[2025-10-24T00:00:00.368378] [INFO ] [REMOTE    ] SW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:00:00.799419] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-01.
[2025-10-24T00:00:02.352349] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T00:00:04.799468] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-02.
[2025-10-24T00:00:10.041581] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-02 (5.24 seconds).
[2025-10-24T00:00:11.204887] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-03.
[2025-10-24T00:00:12.849063] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T00:00:13.601236] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-04.
[2025-10-24T00:00:15.523333] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-04 (1.92 seconds).
[2025-10-24T00:00:20.741427] [INFO ] [REMOTE    ] SWK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:00:20.799400] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-01.
[2025-10-24T00:00:22.343202] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T00:00:22.399401] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-02.
[2025-10-24T00:00:24.060306] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T00:00:24.821430] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-05.
[2025-10-24T00:00:25.621835] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-03.
[2025-10-24T00:00:25.724504] [INFO ] [REMOTE    ] SWX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:00:26.648331] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-05 (1.83 seconds).
[2025-10-24T00:00:27.199414] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-06.
[2025-10-24T00:00:27.510103] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T00:00:28.011095] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-04.
[2025-10-24T00:00:28.806686] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-01.
[2025-10-24T00:00:29.330844] [INFO ] [REMOTE    ] SWZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:00:29.358228] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-06 (2.16 seconds).
[2025-10-24T00:00:29.599427] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-07.
[2025-10-24T00:00:30.098287] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-04 (2.09 seconds).
[2025-10-24T00:00:30.135342] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T00:00:30.399494] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-02.
[2025-10-24T00:00:31.199428] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-05.
[2025-10-24T00:00:31.544165] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T00:00:31.713862] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T00:00:31.999447] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-03.
[2025-10-24T00:00:32.799408] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-08.
[2025-10-24T00:00:33.091759] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-05 (1.89 seconds).
[2025-10-24T00:00:33.131393] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T00:00:33.599478] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-04.
[2025-10-24T00:00:34.399427] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-01.
[2025-10-24T00:00:34.626071] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T00:00:34.725179] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T00:00:34.940270] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T00:00:35.199431] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-05.
[2025-10-24T00:00:35.999447] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-06.
[2025-10-24T00:00:36.667793] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T00:00:36.799443] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-06.
[2025-10-24T00:00:37.599492] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-02.
[2025-10-24T00:00:37.805279] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T00:00:38.111922] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T00:00:38.233737] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T00:00:38.399418] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-03.
[2025-10-24T00:00:39.021855] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T00:00:39.199440] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-07.
[2025-10-24T00:00:39.999444] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-07.
[2025-10-24T00:00:40.799419] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-09.
[2025-10-24T00:00:41.095730] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T00:00:41.465269] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T00:00:41.599431] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-08.
[2025-10-24T00:00:42.268475] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T00:00:42.399512] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-04.
[2025-10-24T00:00:42.860720] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T00:00:43.199503] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-08.
[2025-10-24T00:00:43.290544] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T00:00:43.999459] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-09.
[2025-10-24T00:00:44.799483] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-05.
[2025-10-24T00:00:44.849583] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T00:00:45.347350] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T00:00:45.474629] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T00:00:45.599432] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-10.
[2025-10-24T00:00:46.399432] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-09.
[2025-10-24T00:00:46.592155] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T00:00:46.597049] [INFO ] [REMOTE    ] SWX: Full fetch complete (43827 records).
[2025-10-24T00:00:47.208451] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-06.
[2025-10-24T00:00:47.925097] [INFO ] [REMOTE    ] SXC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:00:47.925352] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T00:00:47.999402] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-07.
[2025-10-24T00:00:48.232915] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-09 (1.83 seconds).
[2025-10-24T00:00:48.457986] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-07 (0.46 seconds).
[2025-10-24T00:00:48.799454] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-01.
[2025-10-24T00:00:49.599451] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-10.
[2025-10-24T00:00:50.335873] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T00:00:50.399428] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-02.
[2025-10-24T00:00:51.199474] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-08.
[2025-10-24T00:00:51.495218] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T00:00:51.504497] [INFO ] [REMOTE    ] SWK: Full fetch complete (75545 records).
[2025-10-24T00:00:51.935265] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T00:00:52.005362] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-10.
[2025-10-24T00:00:52.051615] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T00:00:52.810953] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-09.
[2025-10-24T00:00:52.983536] [INFO ] [REMOTE    ] SXI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:00:53.496896] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-09 (0.69 seconds).
[2025-10-24T00:00:53.599450] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-10.
[2025-10-24T00:00:53.881777] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T00:00:53.891683] [INFO ] [REMOTE    ] SW: Full fetch complete (77119 records).
[2025-10-24T00:00:54.276095] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-10 (0.68 seconds).
[2025-10-24T00:00:54.300603] [INFO ] [REMOTE    ] SWZ: Full fetch complete (8271 records).
[2025-10-24T00:00:54.407972] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-03.
[2025-10-24T00:00:55.207191] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-01.
[2025-10-24T00:00:56.110951] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-01 (0.90 seconds).
[2025-10-24T00:00:56.113795] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-02.
[2025-10-24T00:00:56.188677] [INFO ] [REMOTE    ] SXT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:00:56.321402] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T00:00:56.598233] [INFO ] [REMOTE    ] SYF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:00:56.799401] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-01.
[2025-10-24T00:00:56.973897] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T00:00:57.599439] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-03.
[2025-10-24T00:00:58.326943] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T00:00:58.399503] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-01.
[2025-10-24T00:00:58.589037] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T00:00:59.184271] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T00:00:59.199392] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-02.
[2025-10-24T00:00:59.912051] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T00:00:59.999396] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-04.
[2025-10-24T00:01:00.799421] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-03.
[2025-10-24T00:01:00.887581] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T00:01:01.599472] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-02.
[2025-10-24T00:01:02.186253] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T00:01:02.399440] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-05.
[2025-10-24T00:01:03.199419] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-04.
[2025-10-24T00:01:03.278442] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T00:01:03.311764] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T00:01:03.999471] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-06.
[2025-10-24T00:01:04.311365] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T00:01:04.799427] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-04.
[2025-10-24T00:01:04.830669] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T00:01:05.599492] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-05.
[2025-10-24T00:01:06.380789] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T00:01:06.399404] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-05.
[2025-10-24T00:01:06.802000] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-05 (1.20 seconds).
[2025-10-24T00:01:07.199461] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-03.
[2025-10-24T00:01:07.879574] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T00:01:07.999433] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-06.
[2025-10-24T00:01:08.656807] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T00:01:08.799473] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-04.
[2025-10-24T00:01:09.559482] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T00:01:09.599393] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-07.
[2025-10-24T00:01:10.399430] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-06.
[2025-10-24T00:01:10.731230] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T00:01:10.796922] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T00:01:11.199402] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-05.
[2025-10-24T00:01:11.605354] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T00:01:11.999478] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-08.
[2025-10-24T00:01:12.799432] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-07.
[2025-10-24T00:01:13.025549] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-05 (1.83 seconds).
[2025-10-24T00:01:13.514767] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T00:01:13.599405] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-09.
[2025-10-24T00:01:13.676715] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T00:01:14.399473] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-06.
[2025-10-24T00:01:15.172770] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T00:01:15.199410] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-08.
[2025-10-24T00:01:15.999435] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-10.
[2025-10-24T00:01:16.132000] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-08 (0.93 seconds).
[2025-10-24T00:01:16.241998] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-06 (1.84 seconds).
[2025-10-24T00:01:16.799458] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-09.
[2025-10-24T00:01:17.599826] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T00:01:17.599904] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-07.
[2025-10-24T00:01:17.608598] [INFO ] [REMOTE    ] SXC: Full fetch complete (60986 records).
[2025-10-24T00:01:17.779666] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T00:01:18.413250] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-07.
[2025-10-24T00:01:19.063611] [INFO ] [REMOTE    ] SYK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:01:19.084159] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T00:01:19.199432] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-08.
[2025-10-24T00:01:19.999423] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-01.
[2025-10-24T00:01:20.323136] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T00:01:20.489726] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T00:01:20.799460] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-08.
[2025-10-24T00:01:21.599509] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-09.
[2025-10-24T00:01:21.660731] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T00:01:22.399489] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-02.
[2025-10-24T00:01:22.561707] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T00:01:23.003539] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T00:01:23.199439] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-10.
[2025-10-24T00:01:23.999418] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-10.
[2025-10-24T00:01:24.098425] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T00:01:24.463739] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T00:01:24.468790] [INFO ] [REMOTE    ] SXT: Full fetch complete (39611 records).
[2025-10-24T00:01:24.803837] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-09.
[2025-10-24T00:01:24.958729] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T00:01:24.963512] [INFO ] [REMOTE    ] SXI: Full fetch complete (15914 records).
[2025-10-24T00:01:25.621752] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-03.
[2025-10-24T00:01:26.654413] [INFO ] [REMOTE    ] SYY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:01:26.655304] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-01.
[2025-10-24T00:01:26.907278] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-09 (2.10 seconds).
[2025-10-24T00:01:27.055066] [INFO ] [REMOTE    ] T: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:01:27.199425] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-01.
[2025-10-24T00:01:27.341195] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T00:01:27.999415] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-04.
[2025-10-24T00:01:28.476037] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T00:01:28.799488] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-10.
[2025-10-24T00:01:29.602469] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-01 (2.40 seconds).
[2025-10-24T00:01:29.602615] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-02.
[2025-10-24T00:01:29.634555] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T00:01:30.399408] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-05.
[2025-10-24T00:01:30.593953] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T00:01:30.604182] [INFO ] [REMOTE    ] SYF: Full fetch complete (77580 records).
[2025-10-24T00:01:31.202465] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-02.
[2025-10-24T00:01:31.390321] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T00:01:31.999425] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-03.
[2025-10-24T00:01:32.090790] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T00:01:32.799538] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-06.
[2025-10-24T00:01:33.313910] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-02 (2.11 seconds).
[2025-10-24T00:01:33.493617] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T00:01:33.599405] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-04.
[2025-10-24T00:01:34.239888] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T00:01:34.399414] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-03.
[2025-10-24T00:01:35.199522] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-07.
[2025-10-24T00:01:35.561512] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T00:01:35.999458] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-05.
[2025-10-24T00:01:36.503769] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-03 (2.10 seconds).
[2025-10-24T00:01:36.694980] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T00:01:36.799403] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-08.
[2025-10-24T00:01:37.440980] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T00:01:37.599468] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-04.
[2025-10-24T00:01:38.063858] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T00:01:38.399434] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-09.
[2025-10-24T00:01:39.199447] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-06.
[2025-10-24T00:01:40.080316] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-04 (2.48 seconds).
[2025-10-24T00:01:40.092290] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-05.
[2025-10-24T00:01:40.179110] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T00:01:40.799412] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-10.
[2025-10-24T00:01:40.993738] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T00:01:41.599483] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-07.
[2025-10-24T00:01:42.092494] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T00:01:42.399472] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-06.
[2025-10-24T00:01:42.550571] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T00:01:42.559929] [INFO ] [REMOTE    ] SYK: Full fetch complete (69190 records).
[2025-10-24T00:01:43.540507] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T00:01:43.552323] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-08.
[2025-10-24T00:01:44.628483] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-06 (2.23 seconds).
[2025-10-24T00:01:44.639214] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-07.
[2025-10-24T00:01:45.319827] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T00:01:45.331015] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-09.
[2025-10-24T00:01:46.990877] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-07 (2.35 seconds).
[2025-10-24T00:01:47.003023] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-08.
[2025-10-24T00:01:47.118276] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T00:01:47.129839] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-10.
[2025-10-24T00:01:48.815595] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T00:01:48.824915] [INFO ] [REMOTE    ] SYY: Full fetch complete (77246 records).
[2025-10-24T00:01:49.495143] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-08 (2.49 seconds).
[2025-10-24T00:01:49.511941] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-09.
[2025-10-24T00:01:51.801815] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-09 (2.29 seconds).
[2025-10-24T00:01:51.813195] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-10.
[2025-10-24T00:01:54.362739] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-10 (2.55 seconds).
[2025-10-24T00:01:54.372228] [INFO ] [REMOTE    ] T: Full fetch complete (77978 records).
[2025-10-24T00:01:58.128840] [INFO ] [REMOTE    ] TALO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:01:58.150361] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-01.
[2025-10-24T00:01:58.153701] [INFO ] [REMOTE    ] TAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:01:58.181103] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-01.
[2025-10-24T00:01:58.258742] [INFO ] [REMOTE    ] TAL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:01:58.297022] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-01.
[2025-10-24T00:01:58.318579] [INFO ] [REMOTE    ] TAK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:01:58.318888] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-01.
[2025-10-24T00:01:59.892562] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T00:01:59.903702] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-02.
[2025-10-24T00:01:59.933636] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T00:01:59.943342] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-02.
[2025-10-24T00:01:59.980740] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T00:01:59.990516] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-02.
[2025-10-24T00:02:00.053202] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T00:02:00.066598] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-02.
[2025-10-24T00:02:01.229221] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T00:02:01.239251] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-03.
[2025-10-24T00:02:01.577473] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T00:02:01.614284] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-03.
[2025-10-24T00:02:01.616555] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T00:02:01.628591] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-03.
[2025-10-24T00:02:01.678610] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T00:02:01.687952] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-03.
[2025-10-24T00:02:02.729889] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T00:02:02.741036] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-04.
[2025-10-24T00:02:02.923550] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T00:02:02.933534] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-04.
[2025-10-24T00:02:03.418569] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T00:02:03.430257] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-04.
[2025-10-24T00:02:03.459236] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T00:02:03.470085] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-04.
[2025-10-24T00:02:04.188636] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T00:02:04.199223] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-05.
[2025-10-24T00:02:04.411181] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T00:02:04.420825] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-05.
[2025-10-24T00:02:04.986197] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T00:02:04.996602] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-05.
[2025-10-24T00:02:05.497753] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-04 (2.07 seconds).
[2025-10-24T00:02:05.532873] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T00:02:05.542206] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-05.
[2025-10-24T00:02:05.544030] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-06.
[2025-10-24T00:02:05.579216] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T00:02:05.599397] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-06.
[2025-10-24T00:02:06.719431] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T00:02:06.729970] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-06.
[2025-10-24T00:02:07.186022] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T00:02:07.208428] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-07.
[2025-10-24T00:02:07.228243] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T00:02:07.289132] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T00:02:07.999462] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-07.
[2025-10-24T00:02:08.433214] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T00:02:08.799452] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-06.
[2025-10-24T00:02:08.922041] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T00:02:09.187072] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T00:02:09.599468] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-08.
[2025-10-24T00:02:10.352614] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-06 (1.55 seconds).
[2025-10-24T00:02:10.399454] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-08.
[2025-10-24T00:02:10.940417] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T00:02:11.199452] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-09.
[2025-10-24T00:02:11.999414] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-07.
[2025-10-24T00:02:12.196620] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T00:02:12.808004] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-07.
[2025-10-24T00:02:12.826818] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T00:02:13.468306] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T00:02:13.599416] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-10.
[2025-10-24T00:02:14.399525] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-09.
[2025-10-24T00:02:14.661398] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T00:02:14.811706] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T00:02:14.820909] [INFO ] [REMOTE    ] TALO: Full fetch complete (73415 records).
[2025-10-24T00:02:15.201405] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-08.
[2025-10-24T00:02:15.949173] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T00:02:16.004674] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-08.
[2025-10-24T00:02:16.316374] [INFO ] [REMOTE    ] TAP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:02:16.799441] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-10.
[2025-10-24T00:02:17.138718] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T00:02:17.577234] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T00:02:17.599404] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-01.
[2025-10-24T00:02:18.399442] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-09.
[2025-10-24T00:02:18.520495] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T00:02:18.529312] [INFO ] [REMOTE    ] TAC: Full fetch complete (64791 records).
[2025-10-24T00:02:19.202480] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-09.
[2025-10-24T00:02:19.453123] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-01 (1.85 seconds).
[2025-10-24T00:02:19.745720] [INFO ] [REMOTE    ] TBB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:02:19.999427] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-02.
[2025-10-24T00:02:20.094637] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T00:02:20.799482] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-10.
[2025-10-24T00:02:21.052114] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-09 (1.85 seconds).
[2025-10-24T00:02:21.599430] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-01.
[2025-10-24T00:02:21.712526] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T00:02:21.918523] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T00:02:21.927355] [INFO ] [REMOTE    ] TAL: Full fetch complete (75714 records).
[2025-10-24T00:02:22.332453] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T00:02:22.399760] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-03.
[2025-10-24T00:02:23.208923] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-10.
[2025-10-24T00:02:23.374737] [INFO ] [REMOTE    ] TBBB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:02:23.999409] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-02.
[2025-10-24T00:02:24.267508] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T00:02:24.734212] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T00:02:24.799396] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-04.
[2025-10-24T00:02:24.967889] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T00:02:24.976715] [INFO ] [REMOTE    ] TAK: Full fetch complete (72061 records).
[2025-10-24T00:02:25.621281] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-01.
[2025-10-24T00:02:26.400525] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-03.
[2025-10-24T00:02:26.400463] [INFO ] [REMOTE    ] TBI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:02:26.729795] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T00:02:26.864161] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T00:02:27.199507] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-05.
[2025-10-24T00:02:27.251500] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T00:02:27.999502] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-04.
[2025-10-24T00:02:28.799414] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-01.
[2025-10-24T00:02:28.885359] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T00:02:28.950022] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T00:02:29.599427] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-06.
[2025-10-24T00:02:29.759484] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T00:02:30.399482] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-02.
[2025-10-24T00:02:31.199501] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-05.
[2025-10-24T00:02:31.329539] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T00:02:31.455309] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T00:02:31.999462] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-03.
[2025-10-24T00:02:32.093418] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T00:02:32.799438] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-02.
[2025-10-24T00:02:33.129169] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T00:02:33.599453] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-04.
[2025-10-24T00:02:33.859002] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T00:02:34.399478] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-03.
[2025-10-24T00:02:34.815904] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T00:02:35.199499] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-06.
[2025-10-24T00:02:35.998817] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T00:02:36.003175] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-05.
[2025-10-24T00:02:36.026600] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T00:02:36.799455] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-07.
[2025-10-24T00:02:37.286314] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T00:02:37.599444] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-07.
[2025-10-24T00:02:38.399418] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-06.
[2025-10-24T00:02:38.483769] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T00:02:38.743621] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T00:02:39.199422] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-04.
[2025-10-24T00:02:39.438213] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T00:02:39.999438] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-07.
[2025-10-24T00:02:40.799413] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-08.
[2025-10-24T00:02:41.035284] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T00:02:41.197096] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T00:02:41.599481] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-05.
[2025-10-24T00:02:42.399485] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-08.
[2025-10-24T00:02:43.052341] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T00:02:43.098601] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-08 (2.30 seconds).
[2025-10-24T00:02:43.199503] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-08.
[2025-10-24T00:02:43.217687] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T00:02:43.999413] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-06.
[2025-10-24T00:02:44.213755] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T00:02:44.799513] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-09.
[2025-10-24T00:02:45.302167] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T00:02:45.599687] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-09.
[2025-10-24T00:02:46.384847] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T00:02:46.399471] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-07.
[2025-10-24T00:02:46.654159] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-09 (1.85 seconds).
[2025-10-24T00:02:47.199443] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-09.
[2025-10-24T00:02:47.999434] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-10.
[2025-10-24T00:02:48.139308] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T00:02:48.203200] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T00:02:48.799457] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-08.
[2025-10-24T00:02:49.599432] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-10.
[2025-10-24T00:02:49.824276] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T00:02:49.837590] [INFO ] [REMOTE    ] TAP: Full fetch complete (76518 records).
[2025-10-24T00:02:50.137880] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T00:02:50.371969] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T00:02:50.376047] [INFO ] [REMOTE    ] TBB: Full fetch complete (16294 records).
[2025-10-24T00:02:50.407463] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-10.
[2025-10-24T00:02:51.201789] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-09.
[2025-10-24T00:02:51.783287] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T00:02:51.878591] [INFO ] [REMOTE    ] TBI: Full fetch complete (32145 records).
[2025-10-24T00:02:52.004371] [INFO ] [REMOTE    ] TBLU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:02:52.020249] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-01.
[2025-10-24T00:02:52.594432] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T00:02:52.813747] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-02.
[2025-10-24T00:02:52.875041] [INFO ] [REMOTE    ] TBN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:02:52.950411] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T00:02:53.283676] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-02 (0.47 seconds).
[2025-10-24T00:02:53.560619] [INFO ] [REMOTE    ] TCAI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:02:53.599399] [INFO ] [REMOTE    ] TCAI: Fetching primary data for 2025-01.
[2025-10-24T00:02:53.811728] [DEBUG] [REMOTE    ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:02:53.812112] [WARN ] [REMOTE    ] TCAI: No data returned for month 2025-01
[2025-10-24T00:02:53.812217] [FATAL] [REMOTE    ] TCAI: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:02:54.404513] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-01.
[2025-10-24T00:02:54.576860] [INFO ] [REMOTE    ] TCBX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:02:55.095628] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T00:02:55.199445] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-03.
[2025-10-24T00:02:55.536259] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-03 (0.34 seconds).
[2025-10-24T00:02:55.999416] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-10.
[2025-10-24T00:02:56.799447] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-04.
[2025-10-24T00:02:57.155991] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-04 (0.36 seconds).
[2025-10-24T00:02:57.497518] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T00:02:57.504209] [INFO ] [REMOTE    ] TBBB: Full fetch complete (52150 records).
[2025-10-24T00:02:57.603096] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-02.
[2025-10-24T00:02:58.283314] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-02 (0.68 seconds).
[2025-10-24T00:02:58.404696] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-01.
[2025-10-24T00:02:58.638849] [INFO ] [REMOTE    ] TCPA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:02:59.199423] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-05.
[2025-10-24T00:02:59.489790] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T00:02:59.594823] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-05 (0.40 seconds).
[2025-10-24T00:02:59.999435] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-03.
[2025-10-24T00:03:00.580838] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-03 (0.58 seconds).
[2025-10-24T00:03:00.799440] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-02.
[2025-10-24T00:03:01.599447] [INFO ] [REMOTE    ] TCPA: Fetching primary data for 2025-01.
[2025-10-24T00:03:01.741332] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-02 (0.94 seconds).
[2025-10-24T00:03:01.821335] [DEBUG] [REMOTE    ] TCPA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:03:01.821735] [WARN ] [REMOTE    ] TCPA: No data returned for month 2025-01
[2025-10-24T00:03:01.821829] [FATAL] [REMOTE    ] TCPA: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:03:02.404669] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-04.
[2025-10-24T00:03:02.575929] [INFO ] [REMOTE    ] TD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:03:02.756475] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-04 (0.35 seconds).
[2025-10-24T00:03:03.199437] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-05.
[2025-10-24T00:03:03.587187] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-05 (0.39 seconds).
[2025-10-24T00:03:03.999443] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-06.
[2025-10-24T00:03:04.353022] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-06 (0.35 seconds).
[2025-10-24T00:03:04.799442] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-01.
[2025-10-24T00:03:05.599447] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-06.
[2025-10-24T00:03:06.060157] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T00:03:06.399416] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-07.
[2025-10-24T00:03:06.519361] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T00:03:06.735023] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-07 (0.34 seconds).
[2025-10-24T00:03:07.199427] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-08.
[2025-10-24T00:03:07.711756] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-08 (0.51 seconds).
[2025-10-24T00:03:07.999476] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-02.
[2025-10-24T00:03:08.799519] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-03.
[2025-10-24T00:03:09.585723] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T00:03:09.599403] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-04.
[2025-10-24T00:03:09.679099] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T00:03:10.399413] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-03.
[2025-10-24T00:03:10.444441] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-04 (0.85 seconds).
[2025-10-24T00:03:11.199444] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-09.
[2025-10-24T00:03:11.568972] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T00:03:11.999437] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-10.
[2025-10-24T00:03:12.071605] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T00:03:12.417237] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-10 (0.42 seconds).
[2025-10-24T00:03:12.418133] [INFO ] [REMOTE    ] TBLU: Full fetch complete (1221 records).
[2025-10-24T00:03:12.809384] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-07.
[2025-10-24T00:03:13.390378] [INFO ] [REMOTE    ] TDC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:03:13.394898] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T00:03:13.599433] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-04.
[2025-10-24T00:03:14.399440] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-01.
[2025-10-24T00:03:15.199439] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-08.
[2025-10-24T00:03:15.455361] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T00:03:15.553713] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-01 (1.15 seconds).
[2025-10-24T00:03:15.755017] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T00:03:15.999495] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-05.
[2025-10-24T00:03:16.771619] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T00:03:16.799453] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-02.
[2025-10-24T00:03:17.599438] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-09.
[2025-10-24T00:03:18.402249] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-05.
[2025-10-24T00:03:18.403782] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T00:03:18.432060] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T00:03:19.199447] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-03.
[2025-10-24T00:03:19.999425] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-10.
[2025-10-24T00:03:20.212593] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T00:03:20.799499] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-06.
[2025-10-24T00:03:20.959449] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T00:03:20.977614] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T00:03:20.980330] [INFO ] [REMOTE    ] TBN: Full fetch complete (6180 records).
[2025-10-24T00:03:21.604624] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-06.
[2025-10-24T00:03:22.151999] [INFO ] [REMOTE    ] TDF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:03:22.243180] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T00:03:22.363175] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T00:03:22.399406] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-07.
[2025-10-24T00:03:23.199423] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-01.
[2025-10-24T00:03:23.948066] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T00:03:23.999478] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-02.
[2025-10-24T00:03:24.185979] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T00:03:24.779299] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T00:03:24.799406] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-04.
[2025-10-24T00:03:25.599510] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-03.
[2025-10-24T00:03:26.365610] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T00:03:26.399394] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-04.
[2025-10-24T00:03:26.426395] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T00:03:27.199426] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-07.
[2025-10-24T00:03:27.235541] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T00:03:27.999472] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-05.
[2025-10-24T00:03:28.032162] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T00:03:28.799443] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-08.
[2025-10-24T00:03:29.563191] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-08 (0.76 seconds).
[2025-10-24T00:03:29.564523] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T00:03:29.599389] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-06.
[2025-10-24T00:03:30.399469] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-09.
[2025-10-24T00:03:31.011915] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-06 (1.41 seconds).
[2025-10-24T00:03:31.199458] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-05.
[2025-10-24T00:03:31.229763] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-09 (0.83 seconds).
[2025-10-24T00:03:31.955014] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T00:03:31.999465] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-08.
[2025-10-24T00:03:32.799474] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-07.
[2025-10-24T00:03:33.599416] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-06.
[2025-10-24T00:03:33.733806] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T00:03:34.189664] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T00:03:34.410473] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-10.
[2025-10-24T00:03:34.416432] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T00:03:35.199426] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-08.
[2025-10-24T00:03:35.214528] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T00:03:35.216932] [INFO ] [REMOTE    ] TCBX: Full fetch complete (15809 records).
[2025-10-24T00:03:36.016849] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-07.
[2025-10-24T00:03:36.375973] [INFO ] [REMOTE    ] TDG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:03:36.775187] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T00:03:36.799399] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-09.
[2025-10-24T00:03:36.876141] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T00:03:37.599496] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-01.
[2025-10-24T00:03:38.399402] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-09.
[2025-10-24T00:03:38.671978] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-09 (1.87 seconds).
[2025-10-24T00:03:38.765074] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T00:03:39.199430] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-02.
[2025-10-24T00:03:39.999400] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-10.
[2025-10-24T00:03:40.036004] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T00:03:40.329188] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T00:03:40.799469] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-10.
[2025-10-24T00:03:41.604535] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-03.
[2025-10-24T00:03:41.618592] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T00:03:41.628292] [INFO ] [REMOTE    ] TD: Full fetch complete (75863 records).
[2025-10-24T00:03:42.352738] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T00:03:42.373184] [INFO ] [REMOTE    ] TDC: Full fetch complete (67828 records).
[2025-10-24T00:03:42.406680] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-08.
[2025-10-24T00:03:42.993559] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T00:03:43.229454] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-04.
[2025-10-24T00:03:43.293126] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-08 (0.89 seconds).
[2025-10-24T00:03:43.968486] [INFO ] [REMOTE    ] TDOC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:03:44.008481] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-09.
[2025-10-24T00:03:44.766757] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T00:03:44.739252] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T00:03:44.808467] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-01.
[2025-10-24T00:03:45.007003] [INFO ] [REMOTE    ] TDS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:03:45.599439] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-10.
[2025-10-24T00:03:46.090373] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T00:03:46.092197] [INFO ] [REMOTE    ] TDF: Full fetch complete (10310 records).
[2025-10-24T00:03:46.402236] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-01.
[2025-10-24T00:03:46.961834] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-01 (2.15 seconds).
[2025-10-24T00:03:47.206821] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-02.
[2025-10-24T00:03:47.362342] [INFO ] [REMOTE    ] TDW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:03:47.948487] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T00:03:47.999408] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-01.
[2025-10-24T00:03:48.799458] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-05.
[2025-10-24T00:03:49.591300] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-02 (2.38 seconds).
[2025-10-24T00:03:49.600985] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-02.
[2025-10-24T00:03:49.652111] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T00:03:49.980963] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-05 (1.18 seconds).
[2025-10-24T00:03:50.399404] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-03.
[2025-10-24T00:03:51.167045] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-02 (1.57 seconds).
[2025-10-24T00:03:51.199391] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-03.
[2025-10-24T00:03:51.999410] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-02.
[2025-10-24T00:03:52.542099] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-03 (2.14 seconds).
[2025-10-24T00:03:52.772539] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T00:03:52.799401] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-04.
[2025-10-24T00:03:53.572362] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-02 (1.57 seconds).
[2025-10-24T00:03:53.599399] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-04.
[2025-10-24T00:03:54.375759] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T00:03:54.399444] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-05.
[2025-10-24T00:03:55.199425] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-06.
[2025-10-24T00:03:55.295629] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T00:03:55.968321] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T00:03:55.999399] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-06.
[2025-10-24T00:03:56.251520] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T00:03:56.799445] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-07.
[2025-10-24T00:03:57.507411] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T00:03:57.599399] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-07.
[2025-10-24T00:03:57.905533] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T00:03:58.399420] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-05.
[2025-10-24T00:03:59.201159] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-03.
[2025-10-24T00:03:59.203614] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T00:03:59.999516] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-08.
[2025-10-24T00:04:00.397687] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T00:04:00.799445] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-06.
[2025-10-24T00:04:01.017341] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T00:04:01.599413] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-04.
[2025-10-24T00:04:01.715762] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T00:04:02.399424] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-09.
[2025-10-24T00:04:02.525580] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T00:04:03.079068] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T00:04:03.199423] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-05.
[2025-10-24T00:04:03.999444] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-07.
[2025-10-24T00:04:04.058983] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T00:04:04.593342] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T00:04:04.799433] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-06.
[2025-10-24T00:04:05.599362] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-10.
[2025-10-24T00:04:06.193782] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T00:04:06.399495] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-07.
[2025-10-24T00:04:06.455525] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-07 (2.46 seconds).
[2025-10-24T00:04:07.052039] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T00:04:07.058907] [INFO ] [REMOTE    ] TDS: Full fetch complete (61294 records).
[2025-10-24T00:04:07.210025] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-08.
[2025-10-24T00:04:07.746590] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T00:04:08.004676] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-08.
[2025-10-24T00:04:08.526528] [INFO ] [REMOTE    ] TDY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:04:08.736697] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T00:04:08.799440] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-01.
[2025-10-24T00:04:09.599405] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-09.
[2025-10-24T00:04:09.690348] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T00:04:09.783734] [INFO ] [REMOTE    ] TDY: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T00:04:10.399443] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-08.
[2025-10-24T00:04:10.880105] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T00:04:11.199466] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-09.
[2025-10-24T00:04:11.999422] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-10.
[2025-10-24T00:04:12.489048] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-08 (2.09 seconds).
[2025-10-24T00:04:12.754450] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T00:04:12.799404] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-09.
[2025-10-24T00:04:13.089061] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T00:04:13.093320] [INFO ] [REMOTE    ] TDG: Full fetch complete (32014 records).
[2025-10-24T00:04:13.603206] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-02.
[2025-10-24T00:04:14.159618] [INFO ] [REMOTE    ] TE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:04:14.399406] [INFO ] [REMOTE    ] TE: Fetching primary data for 2025-01.
[2025-10-24T00:04:14.804974] [INFO ] [REMOTE    ] TDY: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T00:04:15.199456] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-10.
[2025-10-24T00:04:15.441522] [DEBUG] [REMOTE    ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:04:15.441996] [WARN ] [REMOTE    ] TE: No data returned for month 2025-01
[2025-10-24T00:04:15.442103] [FATAL] [REMOTE    ] TE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:04:15.517880] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-09 (2.72 seconds).
[2025-10-24T00:04:16.004618] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-10.
[2025-10-24T00:04:16.231510] [INFO ] [REMOTE    ] TEAF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:04:16.764099] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T00:04:16.774025] [INFO ] [REMOTE    ] TDW: Full fetch complete (66689 records).
[2025-10-24T00:04:16.808699] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-03.
[2025-10-24T00:04:17.601036] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-01.
[2025-10-24T00:04:18.115224] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-01 (0.51 seconds).
[2025-10-24T00:04:18.214235] [INFO ] [REMOTE    ] TECK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:04:18.217070] [INFO ] [REMOTE    ] TDY: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T00:04:18.399434] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-04.
[2025-10-24T00:04:18.741335] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-10 (2.74 seconds).
[2025-10-24T00:04:18.750692] [INFO ] [REMOTE    ] TDOC: Full fetch complete (77441 records).
[2025-10-24T00:04:19.199866] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-02.
[2025-10-24T00:04:19.896420] [INFO ] [REMOTE    ] TDY: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T00:04:20.005915] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-01.
[2025-10-24T00:04:20.212840] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T00:04:20.357990] [INFO ] [REMOTE    ] TEF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:04:20.799515] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-03.
[2025-10-24T00:04:21.599423] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-05.
[2025-10-24T00:04:21.644621] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T00:04:21.674485] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T00:04:22.338158] [INFO ] [REMOTE    ] TDY: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T00:04:22.399430] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-04.
[2025-10-24T00:04:23.179475] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T00:04:23.199456] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-06.
[2025-10-24T00:04:23.999437] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-01.
[2025-10-24T00:04:24.295346] [INFO ] [REMOTE    ] TDY: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T00:04:24.799451] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-07.
[2025-10-24T00:04:25.194632] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T00:04:25.599483] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-05.
[2025-10-24T00:04:25.900704] [INFO ] [REMOTE    ] TDY: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T00:04:26.227105] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T00:04:26.399446] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-08.
[2025-10-24T00:04:27.199444] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-02.
[2025-10-24T00:04:27.429948] [INFO ] [REMOTE    ] TDY: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T00:04:27.999461] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-06.
[2025-10-24T00:04:28.738088] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T00:04:28.800225] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-09.
[2025-10-24T00:04:29.599441] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-02.
[2025-10-24T00:04:29.750149] [INFO ] [REMOTE    ] TDY: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T00:04:30.399415] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-07.
[2025-10-24T00:04:31.106086] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T00:04:31.146920] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T00:04:31.199400] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-08.
[2025-10-24T00:04:31.908771] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T00:04:31.999477] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-10.
[2025-10-24T00:04:32.799427] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-09.
[2025-10-24T00:04:33.064395] [INFO ] [REMOTE    ] TDY: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T00:04:33.068150] [INFO ] [REMOTE    ] TDY: Full fetch complete (32118 records).
[2025-10-24T00:04:33.546909] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T00:04:33.606804] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-03.
[2025-10-24T00:04:34.317592] [INFO ] [REMOTE    ] TEI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:04:34.399399] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-01.
[2025-10-24T00:04:35.203564] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-10.
[2025-10-24T00:04:35.209407] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T00:04:35.491735] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T00:04:35.986100] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T00:04:35.988466] [INFO ] [REMOTE    ] TEAF: Full fetch complete (10202 records).
[2025-10-24T00:04:36.004595] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-04.
[2025-10-24T00:04:36.804775] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-02.
[2025-10-24T00:04:37.233780] [INFO ] [REMOTE    ] TEL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:04:37.599469] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-01.
[2025-10-24T00:04:37.661264] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T00:04:37.961136] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T00:04:38.399464] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-03.
[2025-10-24T00:04:39.199485] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-05.
[2025-10-24T00:04:39.235443] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-02 (12.04 seconds).
[2025-10-24T00:04:39.346988] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T00:04:39.388974] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T00:04:39.999491] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-03.
[2025-10-24T00:04:40.799480] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-02.
[2025-10-24T00:04:40.837795] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T00:04:41.599417] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-06.
[2025-10-24T00:04:42.388509] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-03 (2.39 seconds).
[2025-10-24T00:04:42.399607] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-04.
[2025-10-24T00:04:42.544423] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T00:04:42.604715] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T00:04:43.199414] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-03.
[2025-10-24T00:04:43.999431] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-04.
[2025-10-24T00:04:44.799418] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-07.
[2025-10-24T00:04:44.890563] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-04 (2.49 seconds).
[2025-10-24T00:04:44.985078] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T00:04:45.599431] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-05.
[2025-10-24T00:04:45.865037] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T00:04:46.235891] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T00:04:46.399401] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-08.
[2025-10-24T00:04:46.772756] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T00:04:47.199460] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-04.
[2025-10-24T00:04:47.999422] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-06.
[2025-10-24T00:04:48.171013] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T00:04:48.799435] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-09.
[2025-10-24T00:04:49.094195] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T00:04:49.155148] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T00:04:49.599457] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-05.
[2025-10-24T00:04:50.230740] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T00:04:50.399453] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-10.
[2025-10-24T00:04:51.199481] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-07.
[2025-10-24T00:04:51.669622] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-05 (2.07 seconds).
[2025-10-24T00:04:51.863288] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T00:04:51.869897] [INFO ] [REMOTE    ] TEF: Full fetch complete (54457 records).
[2025-10-24T00:04:52.019692] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-05.
[2025-10-24T00:04:52.253007] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T00:04:52.804539] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-08.
[2025-10-24T00:04:53.214782] [INFO ] [REMOTE    ] TEN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:04:53.599439] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-06.
[2025-10-24T00:04:53.890773] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T00:04:53.914685] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T00:04:54.399441] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-09.
[2025-10-24T00:04:55.199403] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-01.
[2025-10-24T00:04:55.355195] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T00:04:55.581768] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T00:04:55.999436] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-06.
[2025-10-24T00:04:56.492172] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T00:04:56.799451] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-02.
[2025-10-24T00:04:57.599406] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-10.
[2025-10-24T00:04:57.999831] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T00:04:58.399413] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-03.
[2025-10-24T00:04:58.876214] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T00:04:58.880318] [INFO ] [REMOTE    ] TEI: Full fetch complete (30702 records).
[2025-10-24T00:04:59.204616] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-07.
[2025-10-24T00:04:59.405248] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-06 (3.41 seconds).
[2025-10-24T00:04:59.810378] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T00:05:00.009989] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-04.
[2025-10-24T00:05:00.165753] [INFO ] [REMOTE    ] TEO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:05:00.799437] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-07.
[2025-10-24T00:05:01.535247] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T00:05:01.578076] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-07 (2.37 seconds).
[2025-10-24T00:05:01.599402] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-08.
[2025-10-24T00:05:02.399433] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-05.
[2025-10-24T00:05:02.881106] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-07 (2.08 seconds).
[2025-10-24T00:05:03.199447] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-08.
[2025-10-24T00:05:03.680289] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T00:05:03.840184] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-08 (2.24 seconds).
[2025-10-24T00:05:03.999439] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-06.
[2025-10-24T00:05:04.799455] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-09.
[2025-10-24T00:05:05.046518] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T00:05:05.350068] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T00:05:05.599417] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-07.
[2025-10-24T00:05:06.399406] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-09.
[2025-10-24T00:05:06.543382] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T00:05:06.985620] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T00:05:07.199419] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-08.
[2025-10-24T00:05:07.999416] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-10.
[2025-10-24T00:05:08.443907] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-09 (2.04 seconds).
[2025-10-24T00:05:08.471895] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T00:05:08.799449] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-09.
[2025-10-24T00:05:09.599440] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-10.
[2025-10-24T00:05:09.660091] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T00:05:09.668764] [INFO ] [REMOTE    ] TEL: Full fetch complete (73823 records).
[2025-10-24T00:05:10.288086] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T00:05:10.407949] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-10.
[2025-10-24T00:05:11.141741] [INFO ] [REMOTE    ] TEVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:05:11.184855] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T00:05:11.193940] [INFO ] [REMOTE    ] TECK: Full fetch complete (77531 records).
[2025-10-24T00:05:11.205867] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-01.
[2025-10-24T00:05:11.601295] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T00:05:11.607016] [INFO ] [REMOTE    ] TEN: Full fetch complete (44072 records).
[2025-10-24T00:05:12.001862] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-01.
[2025-10-24T00:05:12.617257] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T00:05:12.800204] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-02.
[2025-10-24T00:05:13.474020] [INFO ] [REMOTE    ] TEX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:05:13.614097] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-01.
[2025-10-24T00:05:13.974167] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T00:05:14.036869] [INFO ] [REMOTE    ] TFC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:05:14.068446] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-01 (2.07 seconds).
[2025-10-24T00:05:14.399459] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-01.
[2025-10-24T00:05:15.169694] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T00:05:15.199405] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-03.
[2025-10-24T00:05:15.999409] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-02.
[2025-10-24T00:05:16.204100] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T00:05:16.348126] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-01 (1.95 seconds).
[2025-10-24T00:05:16.799439] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-02.
[2025-10-24T00:05:17.599418] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-04.
[2025-10-24T00:05:18.024173] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-02 (2.02 seconds).
[2025-10-24T00:05:18.397186] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T00:05:18.405732] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-03.
[2025-10-24T00:05:18.765149] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T00:05:19.199464] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-05.
[2025-10-24T00:05:19.982276] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T00:05:19.999428] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-06.
[2025-10-24T00:05:20.110113] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T00:05:20.780119] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T00:05:20.799532] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-03.
[2025-10-24T00:05:21.599585] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-07.
[2025-10-24T00:05:22.399478] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-02.
[2025-10-24T00:05:22.524798] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T00:05:22.702767] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T00:05:23.199430] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-08.
[2025-10-24T00:05:23.999469] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-04.
[2025-10-24T00:05:24.178900] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T00:05:24.283565] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T00:05:24.799486] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-09.
[2025-10-24T00:05:25.599490] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-04.
[2025-10-24T00:05:26.005235] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T00:05:26.064405] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T00:05:26.399443] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-05.
[2025-10-24T00:05:27.199473] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-03.
[2025-10-24T00:05:27.238826] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T00:05:27.999514] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-05.
[2025-10-24T00:05:28.799491] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-10.
[2025-10-24T00:05:29.191348] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T00:05:29.599412] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-04.
[2025-10-24T00:05:29.713303] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T00:05:29.893820] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T00:05:29.898426] [INFO ] [REMOTE    ] TEO: Full fetch complete (32789 records).
[2025-10-24T00:05:30.400758] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-06.
[2025-10-24T00:05:31.155636] [INFO ] [REMOTE    ] TFII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:05:31.199486] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-01.
[2025-10-24T00:05:31.356498] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T00:05:31.573767] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-05 (5.17 seconds).
[2025-10-24T00:05:31.997549] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T00:05:32.006035] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-06.
[2025-10-24T00:05:32.437979] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T00:05:32.799448] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-07.
[2025-10-24T00:05:33.599439] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-05.
[2025-10-24T00:05:33.913570] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-06 (1.91 seconds).
[2025-10-24T00:05:34.399425] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-02.
[2025-10-24T00:05:34.475474] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T00:05:35.199425] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-07.
[2025-10-24T00:05:35.464826] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T00:05:35.778410] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T00:05:35.999430] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-03.
[2025-10-24T00:05:36.799406] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-08.
[2025-10-24T00:05:37.561204] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T00:05:37.599412] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-04.
[2025-10-24T00:05:38.197807] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T00:05:38.399430] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-06.
[2025-10-24T00:05:38.756393] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-04 (1.16 seconds).
[2025-10-24T00:05:39.026170] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-07 (3.83 seconds).
[2025-10-24T00:05:39.199428] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-08.
[2025-10-24T00:05:39.999453] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-09.
[2025-10-24T00:05:40.244886] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T00:05:40.799444] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-07.
[2025-10-24T00:05:41.351159] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-08 (2.15 seconds).
[2025-10-24T00:05:41.555004] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T00:05:41.599404] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-10.
[2025-10-24T00:05:42.399420] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-09.
[2025-10-24T00:05:42.816522] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-07 (2.02 seconds).
[2025-10-24T00:05:43.101419] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T00:05:43.108929] [INFO ] [REMOTE    ] TEX: Full fetch complete (64425 records).
[2025-10-24T00:05:43.206054] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-08.
[2025-10-24T00:05:44.009826] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-05.
[2025-10-24T00:05:44.504550] [INFO ] [REMOTE    ] TFIN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:05:44.534678] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-09 (2.14 seconds).
[2025-10-24T00:05:44.799482] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-10.
[2025-10-24T00:05:45.324753] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-08 (2.12 seconds).
[2025-10-24T00:05:45.599428] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-09.
[2025-10-24T00:05:46.012053] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T00:05:46.399412] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-01.
[2025-10-24T00:05:46.790762] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T00:05:46.800013] [INFO ] [REMOTE    ] TEVA: Full fetch complete (77780 records).
[2025-10-24T00:05:47.202467] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-06.
[2025-10-24T00:05:47.296013] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T00:05:47.354813] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T00:05:48.008219] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-02.
[2025-10-24T00:05:48.351520] [INFO ] [REMOTE    ] TFPM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:05:48.560387] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T00:05:48.799416] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-07.
[2025-10-24T00:05:49.068368] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T00:05:49.599436] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-10.
[2025-10-24T00:05:50.159707] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T00:05:50.399464] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-01.
[2025-10-24T00:05:51.199416] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-03.
[2025-10-24T00:05:51.333494] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T00:05:51.344752] [INFO ] [REMOTE    ] TFC: Full fetch complete (77843 records).
[2025-10-24T00:05:51.488849] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T00:05:52.006439] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-02.
[2025-10-24T00:05:52.067955] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-03 (0.87 seconds).
[2025-10-24T00:05:52.801205] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-08.
[2025-10-24T00:05:52.914316] [INFO ] [REMOTE    ] TFX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:05:53.257604] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T00:05:53.599429] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-01.
[2025-10-24T00:05:54.276091] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T00:05:54.399402] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-09.
[2025-10-24T00:05:55.069705] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T00:05:55.199404] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-02.
[2025-10-24T00:05:55.393313] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T00:05:55.999447] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-03.
[2025-10-24T00:05:56.773481] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-02 (1.57 seconds).
[2025-10-24T00:05:56.799396] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-04.
[2025-10-24T00:05:57.236283] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T00:05:57.599409] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-03.
[2025-10-24T00:05:58.062848] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T00:05:58.399458] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-05.
[2025-10-24T00:05:59.199422] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-10.
[2025-10-24T00:05:59.300049] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T00:05:59.479978] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T00:05:59.999435] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-04.
[2025-10-24T00:06:00.175302] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T00:06:00.183733] [INFO ] [REMOTE    ] TFII: Full fetch complete (47981 records).
[2025-10-24T00:06:00.809131] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-06.
[2025-10-24T00:06:01.541004] [INFO ] [REMOTE    ] TG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:06:01.563495] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T00:06:01.599397] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-05.
[2025-10-24T00:06:01.942878] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T00:06:02.399428] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-07.
[2025-10-24T00:06:03.067420] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T00:06:03.199399] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-06.
[2025-10-24T00:06:03.671227] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T00:06:03.999458] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-01.
[2025-10-24T00:06:04.784364] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T00:06:04.785174] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T00:06:04.799385] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-07.
[2025-10-24T00:06:05.599442] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-02.
[2025-10-24T00:06:06.267326] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-02 (0.67 seconds).
[2025-10-24T00:06:06.314316] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T00:06:06.399433] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-08.
[2025-10-24T00:06:07.199495] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-03.
[2025-10-24T00:06:07.880208] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T00:06:07.999410] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-09.
[2025-10-24T00:06:08.085494] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T00:06:08.799493] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-08.
[2025-10-24T00:06:09.608739] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-04.
[2025-10-24T00:06:09.610749] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T00:06:09.671485] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T00:06:10.399436] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-10.
[2025-10-24T00:06:10.522976] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T00:06:11.199449] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-04.
[2025-10-24T00:06:11.999427] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-05.
[2025-10-24T00:06:12.117219] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T00:06:12.125332] [INFO ] [REMOTE    ] TFPM: Full fetch complete (53129 records).
[2025-10-24T00:06:12.642208] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T00:06:12.642540] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T00:06:12.804622] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-09.
[2025-10-24T00:06:13.397927] [INFO ] [REMOTE    ] TGE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:06:13.599504] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-06.
[2025-10-24T00:06:14.026463] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T00:06:14.356571] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T00:06:14.399560] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-05.
[2025-10-24T00:06:15.199554] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-07.
[2025-10-24T00:06:15.749821] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T00:06:15.868080] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T00:06:15.999460] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-06.
[2025-10-24T00:06:16.799486] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-10.
[2025-10-24T00:06:17.437791] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T00:06:17.599433] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-07.
[2025-10-24T00:06:17.871328] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T00:06:17.876331] [INFO ] [REMOTE    ] TFIN: Full fetch complete (32713 records).
[2025-10-24T00:06:18.405762] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-08.
[2025-10-24T00:06:19.094141] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T00:06:19.180404] [INFO ] [REMOTE    ] TGLS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:06:19.199402] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-01.
[2025-10-24T00:06:19.313490] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T00:06:19.999408] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-08.
[2025-10-24T00:06:20.405593] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T00:06:20.799463] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-02.
[2025-10-24T00:06:21.344407] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T00:06:21.599452] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-09.
[2025-10-24T00:06:21.943197] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T00:06:22.399435] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-03.
[2025-10-24T00:06:23.190743] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T00:06:23.199527] [INFO ] [REMOTE    ] TGE: Fetching primary data for 2025-01.
[2025-10-24T00:06:23.416987] [DEBUG] [REMOTE    ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:06:23.417315] [WARN ] [REMOTE    ] TGE: No data returned for month 2025-01
[2025-10-24T00:06:23.417400] [FATAL] [REMOTE    ] TGE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:06:24.007128] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-09.
[2025-10-24T00:06:24.120261] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T00:06:24.202111] [INFO ] [REMOTE    ] TGNA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:06:24.799478] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-01.
[2025-10-24T00:06:24.997535] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T00:06:25.599445] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-04.
[2025-10-24T00:06:26.319692] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T00:06:26.399399] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-02.
[2025-10-24T00:06:26.940586] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-04 (1.34 seconds).
[2025-10-24T00:06:27.199417] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-10.
[2025-10-24T00:06:28.002542] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-10.
[2025-10-24T00:06:28.005522] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T00:06:28.543787] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T00:06:28.549808] [INFO ] [REMOTE    ] TFX: Full fetch complete (54694 records).
[2025-10-24T00:06:28.804856] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-03.
[2025-10-24T00:06:28.931412] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-10 (0.93 seconds).
[2025-10-24T00:06:28.949775] [INFO ] [REMOTE    ] TG: Full fetch complete (15143 records).
[2025-10-24T00:06:29.601687] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-05.
[2025-10-24T00:06:30.468366] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T00:06:30.478688] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-04.
[2025-10-24T00:06:30.931779] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T00:06:31.199515] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-06.
[2025-10-24T00:06:32.140948] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T00:06:32.146790] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-07.
[2025-10-24T00:06:32.308113] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T00:06:32.799444] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-05.
[2025-10-24T00:06:33.379947] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T00:06:33.599445] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-08.
[2025-10-24T00:06:34.467612] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T00:06:34.478157] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-06.
[2025-10-24T00:06:34.939165] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T00:06:35.199429] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-09.
[2025-10-24T00:06:36.018708] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T00:06:36.028614] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-07.
[2025-10-24T00:06:36.422466] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T00:06:36.799495] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-10.
[2025-10-24T00:06:37.669237] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T00:06:37.679698] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-08.
[2025-10-24T00:06:37.991577] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T00:06:37.996376] [INFO ] [REMOTE    ] TGLS: Full fetch complete (40549 records).
[2025-10-24T00:06:39.472296] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T00:06:39.483469] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-09.
[2025-10-24T00:06:41.161333] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T00:06:41.172142] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-10.
[2025-10-24T00:06:42.786006] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T00:06:42.794197] [INFO ] [REMOTE    ] TGNA: Full fetch complete (70025 records).
[2025-10-24T00:06:45.911607] [INFO ] [REMOTE    ] TGS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:06:46.031733] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-01.
[2025-10-24T00:06:46.557944] [INFO ] [REMOTE    ] THC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:06:46.609590] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-01.
[2025-10-24T00:06:46.643981] [INFO ] [REMOTE    ] TGT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:06:46.670155] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-01.
[2025-10-24T00:06:46.674137] [INFO ] [REMOTE    ] THG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:06:46.675312] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-01.
[2025-10-24T00:06:47.691859] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T00:06:47.699314] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-02.
[2025-10-24T00:06:47.710581] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T00:06:47.714942] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-02.
[2025-10-24T00:06:47.868071] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-01 (1.26 seconds).
[2025-10-24T00:06:47.877313] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-02.
[2025-10-24T00:06:48.737550] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-01 (2.07 seconds).
[2025-10-24T00:06:48.754378] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-02.
[2025-10-24T00:06:48.766356] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T00:06:48.773406] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-03.
[2025-10-24T00:06:48.879623] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T00:06:48.884490] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-03.
[2025-10-24T00:06:49.522269] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T00:06:49.531742] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-03.
[2025-10-24T00:06:49.830294] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T00:06:49.837335] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-04.
[2025-10-24T00:06:49.990006] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T00:06:49.995450] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-04.
[2025-10-24T00:06:50.672391] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-02 (1.92 seconds).
[2025-10-24T00:06:50.682600] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-03.
[2025-10-24T00:06:50.828492] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T00:06:51.193044] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T00:06:51.202748] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-05.
[2025-10-24T00:06:51.227750] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T00:06:51.999475] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-04.
[2025-10-24T00:06:52.351635] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T00:06:52.799437] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-06.
[2025-10-24T00:06:52.875015] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-03 (2.19 seconds).
[2025-10-24T00:06:53.599415] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-04.
[2025-10-24T00:06:53.819430] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T00:06:54.077755] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T00:06:54.399451] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-07.
[2025-10-24T00:06:55.199446] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-05.
[2025-10-24T00:06:55.722284] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T00:06:55.915842] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-04 (2.32 seconds).
[2025-10-24T00:06:55.957669] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T00:06:55.999396] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-06.
[2025-10-24T00:06:56.799438] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-05.
[2025-10-24T00:06:57.114234] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T00:06:57.599424] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-08.
[2025-10-24T00:06:58.399439] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-07.
[2025-10-24T00:06:58.907027] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T00:06:59.019031] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-05 (2.22 seconds).
[2025-10-24T00:06:59.199410] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-06.
[2025-10-24T00:06:59.556936] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T00:06:59.999438] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-05.
[2025-10-24T00:07:00.799437] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-08.
[2025-10-24T00:07:01.607473] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-09.
[2025-10-24T00:07:01.613339] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-06 (2.41 seconds).
[2025-10-24T00:07:01.765424] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-05 (1.77 seconds).
[2025-10-24T00:07:01.866958] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T00:07:02.399434] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-07.
[2025-10-24T00:07:03.160601] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T00:07:03.199392] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-10.
[2025-10-24T00:07:03.999508] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-09.
[2025-10-24T00:07:04.637516] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T00:07:04.644439] [INFO ] [REMOTE    ] TGS: Full fetch complete (48721 records).
[2025-10-24T00:07:04.784941] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-07 (2.39 seconds).
[2025-10-24T00:07:04.801040] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-06.
[2025-10-24T00:07:05.008900] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T00:07:05.611949] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-10.
[2025-10-24T00:07:06.098892] [INFO ] [REMOTE    ] THIR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:07:06.199051] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T00:07:06.399467] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-07.
[2025-10-24T00:07:06.715686] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T00:07:06.720514] [INFO ] [REMOTE    ] THG: Full fetch complete (31537 records).
[2025-10-24T00:07:07.222141] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-08.
[2025-10-24T00:07:08.001004] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-01.
[2025-10-24T00:07:08.014192] [INFO ] [REMOTE    ] THLV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:07:08.061878] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T00:07:08.358504] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-01 (0.36 seconds).
[2025-10-24T00:07:08.799442] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-01.
[2025-10-24T00:07:09.268741] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-01 (0.47 seconds).
[2025-10-24T00:07:09.503358] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-08 (2.28 seconds).
[2025-10-24T00:07:09.599415] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-02.
[2025-10-24T00:07:10.038376] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T00:07:10.399448] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-09.
[2025-10-24T00:07:11.199491] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-03.
[2025-10-24T00:07:11.651298] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-03 (0.45 seconds).
[2025-10-24T00:07:11.999452] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-08.
[2025-10-24T00:07:12.611293] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-09 (2.21 seconds).
[2025-10-24T00:07:12.799412] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-02.
[2025-10-24T00:07:13.144447] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-02 (0.35 seconds).
[2025-10-24T00:07:13.200949] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T00:07:13.599469] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-03.
[2025-10-24T00:07:13.951204] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-03 (0.35 seconds).
[2025-10-24T00:07:14.399430] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-04.
[2025-10-24T00:07:14.852973] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-04 (0.45 seconds).
[2025-10-24T00:07:15.199440] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-05.
[2025-10-24T00:07:15.618246] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-05 (0.42 seconds).
[2025-10-24T00:07:15.999430] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-04.
[2025-10-24T00:07:16.392457] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-04 (0.39 seconds).
[2025-10-24T00:07:16.799439] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-10.
[2025-10-24T00:07:17.599474] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-05.
[2025-10-24T00:07:18.035879] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-05 (0.44 seconds).
[2025-10-24T00:07:18.399477] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-09.
[2025-10-24T00:07:19.165141] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-10 (2.37 seconds).
[2025-10-24T00:07:19.174508] [INFO ] [REMOTE    ] TGT: Full fetch complete (77955 records).
[2025-10-24T00:07:19.205886] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-06.
[2025-10-24T00:07:19.710597] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-06 (0.50 seconds).
[2025-10-24T00:07:20.002011] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-07.
[2025-10-24T00:07:20.127988] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T00:07:20.649404] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-07 (0.65 seconds).
[2025-10-24T00:07:20.727085] [INFO ] [REMOTE    ] THO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:07:20.799429] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-01.
[2025-10-24T00:07:21.599450] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-10.
[2025-10-24T00:07:22.346519] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T00:07:22.399457] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-06.
[2025-10-24T00:07:22.766556] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-06 (0.37 seconds).
[2025-10-24T00:07:23.154353] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T00:07:23.161601] [INFO ] [REMOTE    ] THC: Full fetch complete (68645 records).
[2025-10-24T00:07:23.204573] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-08.
[2025-10-24T00:07:23.867728] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T00:07:24.005137] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-07.
[2025-10-24T00:07:24.480320] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T00:07:24.585272] [INFO ] [REMOTE    ] THQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:07:24.799417] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-02.
[2025-10-24T00:07:25.599440] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-09.
[2025-10-24T00:07:26.144265] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-09 (0.54 seconds).
[2025-10-24T00:07:26.211981] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T00:07:26.399435] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-08.
[2025-10-24T00:07:26.834682] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T00:07:27.199437] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-03.
[2025-10-24T00:07:27.999487] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-01.
[2025-10-24T00:07:28.799444] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-09.
[2025-10-24T00:07:28.931307] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T00:07:29.153723] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-09 (0.35 seconds).
[2025-10-24T00:07:29.265714] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T00:07:29.599480] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-02.
[2025-10-24T00:07:30.399445] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-10.
[2025-10-24T00:07:30.510570] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T00:07:30.776404] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-10 (0.38 seconds).
[2025-10-24T00:07:30.777331] [INFO ] [REMOTE    ] THLV: Full fetch complete (2527 records).
[2025-10-24T00:07:31.204747] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-04.
[2025-10-24T00:07:31.886453] [INFO ] [REMOTE    ] THR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:07:31.999450] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-03.
[2025-10-24T00:07:32.799474] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-01.
[2025-10-24T00:07:33.003391] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T00:07:33.133444] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T00:07:33.599403] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-05.
[2025-10-24T00:07:33.850908] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T00:07:34.399463] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-04.
[2025-10-24T00:07:35.089255] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T00:07:35.199468] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-10.
[2025-10-24T00:07:35.481466] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-04 (1.08 seconds).
[2025-10-24T00:07:35.544554] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-10 (0.35 seconds).
[2025-10-24T00:07:35.545667] [INFO ] [REMOTE    ] THIR: Full fetch complete (2969 records).
[2025-10-24T00:07:36.004423] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-05.
[2025-10-24T00:07:36.629415] [INFO ] [REMOTE    ] THS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:07:36.799454] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-02.
[2025-10-24T00:07:37.132925] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T00:07:37.599468] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-06.
[2025-10-24T00:07:37.918817] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T00:07:38.399461] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-03.
[2025-10-24T00:07:39.199463] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-06.
[2025-10-24T00:07:39.240920] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T00:07:39.296273] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T00:07:39.999423] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-07.
[2025-10-24T00:07:40.044741] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-06 (0.85 seconds).
[2025-10-24T00:07:40.799483] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-07.
[2025-10-24T00:07:41.494217] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T00:07:41.599408] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-08.
[2025-10-24T00:07:42.242960] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T00:07:42.399403] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-01.
[2025-10-24T00:07:43.123207] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T00:07:43.199399] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-08.
[2025-10-24T00:07:43.726367] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T00:07:43.999455] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-04.
[2025-10-24T00:07:44.190947] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T00:07:44.799436] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-09.
[2025-10-24T00:07:45.050519] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T00:07:45.599424] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-09.
[2025-10-24T00:07:46.364535] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T00:07:46.399398] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-10.
[2025-10-24T00:07:46.711051] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T00:07:47.199436] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-02.
[2025-10-24T00:07:47.551769] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T00:07:47.558617] [INFO ] [REMOTE    ] THO: Full fetch complete (60140 records).
[2025-10-24T00:07:48.004801] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-10.
[2025-10-24T00:07:48.711395] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T00:07:48.800032] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-03.
[2025-10-24T00:07:49.012809] [INFO ] [REMOTE    ] THW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:07:49.140874] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T00:07:49.145107] [INFO ] [REMOTE    ] THQ: Full fetch complete (34722 records).
[2025-10-24T00:07:49.602769] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-05.
[2025-10-24T00:07:50.189214] [INFO ] [REMOTE    ] TIC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:07:50.268822] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T00:07:50.399394] [INFO ] [REMOTE    ] TIC: Fetching primary data for 2025-01.
[2025-10-24T00:07:50.608614] [DEBUG] [REMOTE    ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:07:50.609024] [WARN ] [REMOTE    ] TIC: No data returned for month 2025-01
[2025-10-24T00:07:50.609128] [FATAL] [REMOTE    ] TIC: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:07:50.792857] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T00:07:51.204632] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-06.
[2025-10-24T00:07:51.355566] [INFO ] [REMOTE    ] TIMB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:07:51.999423] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-04.
[2025-10-24T00:07:52.250732] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T00:07:52.799445] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-01.
[2025-10-24T00:07:53.539560] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T00:07:53.599403] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-07.
[2025-10-24T00:07:54.285809] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T00:07:54.399418] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-01.
[2025-10-24T00:07:54.622996] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T00:07:55.199433] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-08.
[2025-10-24T00:07:55.518459] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T00:07:55.999418] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-02.
[2025-10-24T00:07:56.335244] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T00:07:56.799432] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-02.
[2025-10-24T00:07:57.201395] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T00:07:57.599416] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-03.
[2025-10-24T00:07:57.878539] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T00:07:58.399425] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-03.
[2025-10-24T00:07:59.101730] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T00:07:59.199404] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-04.
[2025-10-24T00:07:59.406845] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T00:07:59.999428] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-05.
[2025-10-24T00:08:00.678741] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T00:08:00.799404] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-05.
[2025-10-24T00:08:01.435908] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T00:08:01.599436] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-04.
[2025-10-24T00:08:02.166575] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T00:08:02.399419] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-09.
[2025-10-24T00:08:02.668867] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T00:08:03.199424] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-06.
[2025-10-24T00:08:03.534734] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T00:08:03.999411] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-05.
[2025-10-24T00:08:04.599074] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T00:08:04.799421] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-07.
[2025-10-24T00:08:05.097787] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T00:08:05.599438] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-06.
[2025-10-24T00:08:06.288789] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T00:08:06.399402] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-08.
[2025-10-24T00:08:06.647987] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T00:08:07.199519] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-07.
[2025-10-24T00:08:07.760920] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T00:08:07.999468] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-09.
[2025-10-24T00:08:08.246379] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T00:08:08.799534] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-08.
[2025-10-24T00:08:09.248090] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T00:08:09.599480] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-10.
[2025-10-24T00:08:09.828998] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T00:08:10.399431] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-06.
[2025-10-24T00:08:10.635222] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T00:08:10.638616] [INFO ] [REMOTE    ] THR: Full fetch complete (28794 records).
[2025-10-24T00:08:11.204747] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-10.
[2025-10-24T00:08:11.918229] [INFO ] [REMOTE    ] TISI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:08:11.919553] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T00:08:11.999422] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-09.
[2025-10-24T00:08:12.461356] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T00:08:12.466477] [INFO ] [REMOTE    ] TIMB: Full fetch complete (53036 records).
[2025-10-24T00:08:12.807037] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-07.
[2025-10-24T00:08:12.789944] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T00:08:13.599494] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-10.
[2025-10-24T00:08:13.861408] [INFO ] [REMOTE    ] TIXT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:08:14.399431] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-01.
[2025-10-24T00:08:14.538764] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T00:08:14.661981] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T00:08:14.665582] [INFO ] [REMOTE    ] THW: Full fetch complete (28728 records).
[2025-10-24T00:08:14.961351] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-01 (0.56 seconds).
[2025-10-24T00:08:15.204547] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-08.
[2025-10-24T00:08:15.952346] [INFO ] [REMOTE    ] TJX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:08:15.999403] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-01.
[2025-10-24T00:08:16.791808] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T00:08:16.804406] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-02.
[2025-10-24T00:08:17.122521] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-02 (0.32 seconds).
[2025-10-24T00:08:17.527396] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T00:08:17.599728] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-02.
[2025-10-24T00:08:18.399480] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-01.
[2025-10-24T00:08:19.199420] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-09.
[2025-10-24T00:08:19.336401] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T00:08:19.737566] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-01 (1.34 seconds).
[2025-10-24T00:08:19.999467] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-03.
[2025-10-24T00:08:20.691838] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T00:08:20.799455] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-03.
[2025-10-24T00:08:21.431891] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-03 (0.63 seconds).
[2025-10-24T00:08:21.599412] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-04.
[2025-10-24T00:08:21.759764] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T00:08:22.324698] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T00:08:22.399414] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-05.
[2025-10-24T00:08:23.116928] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-05 (0.72 seconds).
[2025-10-24T00:08:23.199416] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-06.
[2025-10-24T00:08:23.786072] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T00:08:23.999435] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-02.
[2025-10-24T00:08:24.799474] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-04.
[2025-10-24T00:08:25.241833] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T00:08:25.599443] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-10.
[2025-10-24T00:08:26.399431] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-03.
[2025-10-24T00:08:26.918980] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-04 (2.12 seconds).
[2025-10-24T00:08:26.948035] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T00:08:26.954674] [INFO ] [REMOTE    ] THS: Full fetch complete (54572 records).
[2025-10-24T00:08:27.205126] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-07.
[2025-10-24T00:08:27.619099] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T00:08:27.742625] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-07 (0.54 seconds).
[2025-10-24T00:08:28.006773] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-08.
[2025-10-24T00:08:28.163555] [INFO ] [REMOTE    ] TK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:08:28.561983] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T00:08:28.799465] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-05.
[2025-10-24T00:08:29.599428] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-01.
[2025-10-24T00:08:30.399460] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-04.
[2025-10-24T00:08:30.763750] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-05 (1.96 seconds).
[2025-10-24T00:08:30.806376] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T00:08:31.199425] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-06.
[2025-10-24T00:08:31.490615] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T00:08:31.999423] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-09.
[2025-10-24T00:08:32.456123] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-09 (0.46 seconds).
[2025-10-24T00:08:32.799470] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-02.
[2025-10-24T00:08:33.251003] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-06 (2.05 seconds).
[2025-10-24T00:08:33.599471] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-10.
[2025-10-24T00:08:34.076918] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T00:08:34.077998] [INFO ] [REMOTE    ] TISI: Full fetch complete (4825 records).
[2025-10-24T00:08:34.400820] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-05.
[2025-10-24T00:08:34.401624] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T00:08:35.199917] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-07.
[2025-10-24T00:08:35.221591] [INFO ] [REMOTE    ] TKC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:08:35.593449] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T00:08:35.999443] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-01.
[2025-10-24T00:08:36.799418] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-03.
[2025-10-24T00:08:37.302289] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T00:08:37.418508] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-07 (2.22 seconds).
[2025-10-24T00:08:37.599429] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-02.
[2025-10-24T00:08:38.142454] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T00:08:38.399441] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-04.
[2025-10-24T00:08:38.840719] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T00:08:39.199441] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-03.
[2025-10-24T00:08:39.914784] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T00:08:39.999417] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-05.
[2025-10-24T00:08:40.626703] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T00:08:40.799444] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-06.
[2025-10-24T00:08:41.554186] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T00:08:41.599419] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-06.
[2025-10-24T00:08:42.215436] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T00:08:42.399444] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-04.
[2025-10-24T00:08:43.168929] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T00:08:43.199410] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-07.
[2025-10-24T00:08:43.898850] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T00:08:43.999473] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-07.
[2025-10-24T00:08:44.711898] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T00:08:44.799450] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-08.
[2025-10-24T00:08:45.278015] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T00:08:45.599441] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-08.
[2025-10-24T00:08:46.303187] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T00:08:46.399418] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-05.
[2025-10-24T00:08:47.199406] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-08.
[2025-10-24T00:08:47.481943] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-08 (1.88 seconds).
[2025-10-24T00:08:47.812291] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T00:08:47.999439] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-09.
[2025-10-24T00:08:48.529732] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T00:08:48.799457] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-09.
[2025-10-24T00:08:49.599415] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-06.
[2025-10-24T00:08:49.931686] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T00:08:50.240531] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T00:08:50.399406] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-09.
[2025-10-24T00:08:50.725664] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T00:08:51.199448] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-10.
[2025-10-24T00:08:51.811309] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T00:08:51.999468] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-10.
[2025-10-24T00:08:52.799415] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-10.
[2025-10-24T00:08:52.854919] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T00:08:52.864249] [INFO ] [REMOTE    ] TJX: Full fetch complete (77830 records).
[2025-10-24T00:08:53.418972] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T00:08:53.430985] [INFO ] [REMOTE    ] TIXT: Full fetch complete (46130 records).
[2025-10-24T00:08:53.602489] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-07.
[2025-10-24T00:08:54.174485] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T00:08:54.286436] [INFO ] [REMOTE    ] TK: Full fetch complete (56280 records).
[2025-10-24T00:08:55.280685] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T00:08:55.335202] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-08.
[2025-10-24T00:08:56.052302] [INFO ] [REMOTE    ] TKO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:08:56.052638] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-01.
[2025-10-24T00:08:56.635886] [INFO ] [REMOTE    ] TKR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:08:56.636317] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-01.
[2025-10-24T00:08:57.125301] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T00:08:57.173073] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-09.
[2025-10-24T00:08:57.248954] [INFO ] [REMOTE    ] TLK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:08:57.599453] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-01.
[2025-10-24T00:08:57.771171] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T00:08:58.164885] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T00:08:58.399420] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-02.
[2025-10-24T00:08:58.875730] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T00:08:58.955789] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T00:08:59.199501] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-02.
[2025-10-24T00:08:59.999427] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-10.
[2025-10-24T00:09:00.067774] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T00:09:00.313055] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T00:09:00.799460] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-03.
[2025-10-24T00:09:01.419261] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T00:09:01.427302] [INFO ] [REMOTE    ] TKC: Full fetch complete (54498 records).
[2025-10-24T00:09:01.612137] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-02.
[2025-10-24T00:09:02.415017] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-03.
[2025-10-24T00:09:02.460589] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T00:09:02.831863] [INFO ] [REMOTE    ] TLYS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:09:03.148892] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T00:09:03.199432] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-04.
[2025-10-24T00:09:03.999417] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-03.
[2025-10-24T00:09:04.114920] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T00:09:04.541068] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-04 (1.34 seconds).
[2025-10-24T00:09:04.799455] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-04.
[2025-10-24T00:09:05.353679] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T00:09:05.599402] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-04.
[2025-10-24T00:09:06.399430] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-05.
[2025-10-24T00:09:06.667875] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T00:09:07.103306] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T00:09:07.199410] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-01.
[2025-10-24T00:09:07.975825] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T00:09:07.999387] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-02.
[2025-10-24T00:09:08.137041] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T00:09:08.757757] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T00:09:08.799485] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-03.
[2025-10-24T00:09:09.579924] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T00:09:09.599447] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-05.
[2025-10-24T00:09:10.399490] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-04.
[2025-10-24T00:09:11.176112] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T00:09:11.194005] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T00:09:11.199383] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-05.
[2025-10-24T00:09:11.999417] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-05.
[2025-10-24T00:09:12.227573] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T00:09:12.799462] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-06.
[2025-10-24T00:09:13.519189] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T00:09:13.599410] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-06.
[2025-10-24T00:09:14.018682] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T00:09:14.399447] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-06.
[2025-10-24T00:09:15.072988] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T00:09:15.199427] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-07.
[2025-10-24T00:09:15.770834] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T00:09:15.999455] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-06.
[2025-10-24T00:09:16.704146] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T00:09:16.799402] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-08.
[2025-10-24T00:09:17.510591] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T00:09:17.599445] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-07.
[2025-10-24T00:09:18.279605] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T00:09:18.399419] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-09.
[2025-10-24T00:09:19.204946] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-07.
[2025-10-24T00:09:19.221579] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T00:09:19.882834] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T00:09:19.999419] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-10.
[2025-10-24T00:09:20.324732] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T00:09:20.799465] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-07.
[2025-10-24T00:09:21.576205] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T00:09:21.584066] [INFO ] [REMOTE    ] TLK: Full fetch complete (57726 records).
[2025-10-24T00:09:21.605514] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-08.
[2025-10-24T00:09:22.132267] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T00:09:22.405750] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-08.
[2025-10-24T00:09:23.007579] [INFO ] [REMOTE    ] TM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:09:23.199407] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-01.
[2025-10-24T00:09:23.321333] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T00:09:23.916398] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T00:09:23.999415] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-09.
[2025-10-24T00:09:24.763045] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T00:09:24.799490] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-02.
[2025-10-24T00:09:25.400929] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T00:09:25.599414] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-08.
[2025-10-24T00:09:25.963245] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T00:09:26.399460] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-10.
[2025-10-24T00:09:26.450518] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T00:09:27.199449] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-09.
[2025-10-24T00:09:27.883898] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T00:09:27.890353] [INFO ] [REMOTE    ] TKR: Full fetch complete (57909 records).
[2025-10-24T00:09:28.004634] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-03.
[2025-10-24T00:09:28.260283] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T00:09:28.806298] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-10.
[2025-10-24T00:09:29.310012] [INFO ] [REMOTE    ] TME: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:09:29.573319] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T00:09:29.599420] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-04.
[2025-10-24T00:09:29.631833] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T00:09:29.634083] [INFO ] [REMOTE    ] TLYS: Full fetch complete (21115 records).
[2025-10-24T00:09:30.404721] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-01.
[2025-10-24T00:09:30.891705] [INFO ] [REMOTE    ] TMHC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:09:31.199530] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-01.
[2025-10-24T00:09:31.407076] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T00:09:31.999405] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-05.
[2025-10-24T00:09:32.232283] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T00:09:32.799423] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-02.
[2025-10-24T00:09:32.874857] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T00:09:33.279610] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T00:09:33.599485] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-09.
[2025-10-24T00:09:34.385770] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T00:09:34.399402] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-03.
[2025-10-24T00:09:35.134250] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T00:09:35.199450] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-02.
[2025-10-24T00:09:35.999487] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-06.
[2025-10-24T00:09:36.312068] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T00:09:36.763671] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T00:09:36.799409] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-03.
[2025-10-24T00:09:37.599465] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-10.
[2025-10-24T00:09:37.675224] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T00:09:38.126033] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T00:09:38.399456] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-07.
[2025-10-24T00:09:39.199408] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-04.
[2025-10-24T00:09:39.530769] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T00:09:39.538697] [INFO ] [REMOTE    ] TKO: Full fetch complete (65568 records).
[2025-10-24T00:09:40.018959] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-04.
[2025-10-24T00:09:40.401739] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-07 (2.00 seconds).
[2025-10-24T00:09:40.799413] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-08.
[2025-10-24T00:09:41.004703] [INFO ] [REMOTE    ] TMO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:09:41.128547] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T00:09:41.601513] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-05.
[2025-10-24T00:09:41.604860] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T00:09:42.202687] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T00:09:42.399444] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-09.
[2025-10-24T00:09:43.199471] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-05.
[2025-10-24T00:09:43.604407] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T00:09:43.917571] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T00:09:43.999404] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-10.
[2025-10-24T00:09:44.445990] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T00:09:44.799454] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-01.
[2025-10-24T00:09:45.407225] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-10 (1.41 seconds).
[2025-10-24T00:09:45.413438] [INFO ] [REMOTE    ] TM: Full fetch complete (51860 records).
[2025-10-24T00:09:45.606619] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-06.
[2025-10-24T00:09:46.400730] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-06.
[2025-10-24T00:09:46.845872] [INFO ] [REMOTE    ] TNC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:09:46.877096] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-01 (2.08 seconds).
[2025-10-24T00:09:47.142810] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T00:09:47.199405] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-07.
[2025-10-24T00:09:47.999421] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-01.
[2025-10-24T00:09:48.421018] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-06 (2.02 seconds).
[2025-10-24T00:09:48.498680] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T00:09:48.646110] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T00:09:48.799488] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-07.
[2025-10-24T00:09:49.599450] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-02.
[2025-10-24T00:09:50.399433] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-08.
[2025-10-24T00:09:50.540615] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T00:09:50.881397] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T00:09:51.199422] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-03.
[2025-10-24T00:09:51.885373] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T00:09:51.999461] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-09.
[2025-10-24T00:09:52.799421] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-08.
[2025-10-24T00:09:53.045763] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T00:09:53.577956] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T00:09:53.599404] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-04.
[2025-10-24T00:09:54.399437] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-02.
[2025-10-24T00:09:54.838312] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T00:09:55.066008] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-02 (0.67 seconds).
[2025-10-24T00:09:55.199422] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-03.
[2025-10-24T00:09:55.692676] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-04 (2.09 seconds).
[2025-10-24T00:09:55.999407] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-09.
[2025-10-24T00:09:56.012830] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T00:09:56.799446] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-04.
[2025-10-24T00:09:57.599418] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-10.
[2025-10-24T00:09:57.874884] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-04 (1.08 seconds).
[2025-10-24T00:09:57.920667] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T00:09:58.399441] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-05.
[2025-10-24T00:09:59.204546] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-10.
[2025-10-24T00:09:59.215337] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T00:09:59.224271] [INFO ] [REMOTE    ] TMHC: Full fetch complete (66741 records).
[2025-10-24T00:09:59.413536] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T00:10:00.004608] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-05.
[2025-10-24T00:10:00.615078] [INFO ] [REMOTE    ] TNET: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:10:00.799410] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-01.
[2025-10-24T00:10:01.370452] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-10 (2.17 seconds).
[2025-10-24T00:10:01.382623] [INFO ] [REMOTE    ] TME: Full fetch complete (77157 records).
[2025-10-24T00:10:01.612418] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-06.
[2025-10-24T00:10:02.087054] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-05 (2.08 seconds).
[2025-10-24T00:10:02.118525] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T00:10:02.401757] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-02.
[2025-10-24T00:10:02.691830] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T00:10:03.080638] [INFO ] [REMOTE    ] TNGY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:10:03.199446] [INFO ] [REMOTE    ] TNGY: Fetching primary data for 2025-01.
[2025-10-24T00:10:03.821215] [DEBUG] [REMOTE    ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:10:03.821593] [WARN ] [REMOTE    ] TNGY: No data returned for month 2025-01
[2025-10-24T00:10:03.821724] [FATAL] [REMOTE    ] TNGY: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:10:03.957048] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T00:10:04.002918] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-07.
[2025-10-24T00:10:04.585023] [INFO ] [REMOTE    ] TNK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:10:04.799431] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-03.
[2025-10-24T00:10:04.933414] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T00:10:05.599426] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-08.
[2025-10-24T00:10:06.229203] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T00:10:06.399416] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-04.
[2025-10-24T00:10:06.517765] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T00:10:07.199441] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-01.
[2025-10-24T00:10:07.873666] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T00:10:07.999408] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-06.
[2025-10-24T00:10:08.769080] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T00:10:08.799411] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-02.
[2025-10-24T00:10:09.599434] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-05.
[2025-10-24T00:10:09.877501] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T00:10:09.940336] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T00:10:10.399437] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-07.
[2025-10-24T00:10:10.657425] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T00:10:11.199423] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-09.
[2025-10-24T00:10:11.999457] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-06.
[2025-10-24T00:10:12.100152] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T00:10:12.532387] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-07 (2.13 seconds).
[2025-10-24T00:10:12.799408] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-10.
[2025-10-24T00:10:13.191777] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T00:10:13.599430] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-07.
[2025-10-24T00:10:13.668309] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T00:10:13.670677] [INFO ] [REMOTE    ] TNC: Full fetch complete (22148 records).
[2025-10-24T00:10:14.404745] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-03.
[2025-10-24T00:10:14.911762] [INFO ] [REMOTE    ] TNL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:10:15.029931] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T00:10:15.199445] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-01.
[2025-10-24T00:10:15.859877] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T00:10:15.999443] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-04.
[2025-10-24T00:10:16.603045] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T00:10:16.799472] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-08.
[2025-10-24T00:10:17.606689] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-08.
[2025-10-24T00:10:17.625427] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T00:10:18.078701] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-08 (1.28 seconds).
[2025-10-24T00:10:18.399457] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-09.
[2025-10-24T00:10:19.199404] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-02.
[2025-10-24T00:10:19.309602] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T00:10:19.581371] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T00:10:19.999421] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-05.
[2025-10-24T00:10:20.680865] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T00:10:20.799424] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-03.
[2025-10-24T00:10:21.507286] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T00:10:21.599427] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-10.
[2025-10-24T00:10:22.400629] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-09.
[2025-10-24T00:10:22.405686] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T00:10:22.736728] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T00:10:22.741570] [INFO ] [REMOTE    ] TNET: Full fetch complete (41829 records).
[2025-10-24T00:10:23.205080] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-04.
[2025-10-24T00:10:24.002059] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-06.
[2025-10-24T00:10:24.069000] [INFO ] [REMOTE    ] TOL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:10:24.101273] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T00:10:24.799510] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-01.
[2025-10-24T00:10:24.961676] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T00:10:25.467323] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T00:10:25.599411] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-07.
[2025-10-24T00:10:26.399434] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-10.
[2025-10-24T00:10:27.003110] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T00:10:27.199420] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-08.
[2025-10-24T00:10:27.684091] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-01 (2.88 seconds).
[2025-10-24T00:10:27.999493] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-02.
[2025-10-24T00:10:28.274692] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T00:10:28.283984] [INFO ] [REMOTE    ] TMO: Full fetch complete (75753 records).
[2025-10-24T00:10:28.734758] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T00:10:28.803774] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-05.
[2025-10-24T00:10:29.601367] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-09.
[2025-10-24T00:10:29.842850] [INFO ] [REMOTE    ] TOST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:10:29.871319] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T00:10:30.406566] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-03.
[2025-10-24T00:10:30.425510] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T00:10:31.050394] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T00:10:31.199425] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-10.
[2025-10-24T00:10:31.999415] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-01.
[2025-10-24T00:10:32.322757] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T00:10:32.515534] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T00:10:32.521674] [INFO ] [REMOTE    ] TNK: Full fetch complete (51957 records).
[2025-10-24T00:10:32.807171] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-06.
[2025-10-24T00:10:33.604562] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-04.
[2025-10-24T00:10:33.879677] [INFO ] [REMOTE    ] TPB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:10:33.911065] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T00:10:33.999009] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T00:10:34.399477] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-01.
[2025-10-24T00:10:35.199429] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-07.
[2025-10-24T00:10:35.523014] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T00:10:35.585506] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T00:10:35.999456] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-02.
[2025-10-24T00:10:36.714929] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T00:10:36.799419] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-08.
[2025-10-24T00:10:37.599408] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-05.
[2025-10-24T00:10:37.939073] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-02 (1.94 seconds).
[2025-10-24T00:10:38.176687] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T00:10:38.399437] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-03.
[2025-10-24T00:10:39.199417] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-02.
[2025-10-24T00:10:39.469032] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T00:10:39.861394] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T00:10:39.999458] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-04.
[2025-10-24T00:10:40.198019] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T00:10:40.799435] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-09.
[2025-10-24T00:10:41.599428] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-06.
[2025-10-24T00:10:41.971490] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-04 (1.97 seconds).
[2025-10-24T00:10:42.299338] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T00:10:42.399435] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-10.
[2025-10-24T00:10:43.199427] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-03.
[2025-10-24T00:10:43.421058] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T00:10:43.897429] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T00:10:43.904909] [INFO ] [REMOTE    ] TNL: Full fetch complete (59764 records).
[2025-10-24T00:10:44.004556] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-07.
[2025-10-24T00:10:44.403112] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-03 (1.20 seconds).
[2025-10-24T00:10:44.804613] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-05.
[2025-10-24T00:10:45.311095] [INFO ] [REMOTE    ] TPC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:10:45.599407] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-01.
[2025-10-24T00:10:46.051611] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T00:10:46.399438] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-08.
[2025-10-24T00:10:46.863085] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-05 (2.06 seconds).
[2025-10-24T00:10:46.972974] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T00:10:47.199425] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-02.
[2025-10-24T00:10:47.999439] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-04.
[2025-10-24T00:10:48.345048] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-08 (1.95 seconds).
[2025-10-24T00:10:48.394593] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T00:10:48.799420] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-06.
[2025-10-24T00:10:48.898809] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-04 (0.90 seconds).
[2025-10-24T00:10:49.599439] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-03.
[2025-10-24T00:10:50.399401] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-09.
[2025-10-24T00:10:50.862127] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-06 (2.06 seconds).
[2025-10-24T00:10:51.199433] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-05.
[2025-10-24T00:10:51.711505] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-03 (2.11 seconds).
[2025-10-24T00:10:51.999463] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-07.
[2025-10-24T00:10:52.333039] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T00:10:52.361334] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T00:10:52.799452] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-04.
[2025-10-24T00:10:53.599488] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-10.
[2025-10-24T00:10:54.194297] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-07 (2.19 seconds).
[2025-10-24T00:10:54.374673] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T00:10:54.399506] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-06.
[2025-10-24T00:10:55.199428] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-08.
[2025-10-24T00:10:55.310364] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T00:10:55.319161] [INFO ] [REMOTE    ] TOL: Full fetch complete (73699 records).
[2025-10-24T00:10:55.708522] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T00:10:56.013291] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-07.
[2025-10-24T00:10:56.798275] [INFO ] [REMOTE    ] TPH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:10:56.799384] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-01.
[2025-10-24T00:10:57.326749] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-08 (2.13 seconds).
[2025-10-24T00:10:57.328447] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T00:10:57.599439] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-05.
[2025-10-24T00:10:58.199751] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T00:10:58.399418] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-09.
[2025-10-24T00:10:58.764636] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T00:10:59.199427] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-02.
[2025-10-24T00:10:59.999430] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-08.
[2025-10-24T00:11:00.441433] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-09 (2.04 seconds).
[2025-10-24T00:11:00.761794] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T00:11:00.799395] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-03.
[2025-10-24T00:11:01.290035] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T00:11:01.599439] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-06.
[2025-10-24T00:11:02.399442] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-09.
[2025-10-24T00:11:03.075395] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T00:11:03.199413] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-07.
[2025-10-24T00:11:03.597442] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-03 (2.80 seconds).
[2025-10-24T00:11:03.741316] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T00:11:03.999433] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-10.
[2025-10-24T00:11:04.799446] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-10.
[2025-10-24T00:11:04.886705] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T00:11:05.599455] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-04.
[2025-10-24T00:11:05.897478] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T00:11:05.920920] [INFO ] [REMOTE    ] TOST: Full fetch complete (77852 records).
[2025-10-24T00:11:05.921748] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T00:11:05.927878] [INFO ] [REMOTE    ] TPB: Full fetch complete (36311 records).
[2025-10-24T00:11:06.413889] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-08.
[2025-10-24T00:11:07.359845] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T00:11:07.459107] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-05.
[2025-10-24T00:11:08.314868] [INFO ] [REMOTE    ] TPL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:11:08.321393] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-01.
[2025-10-24T00:11:08.456839] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T00:11:08.792544] [INFO ] [REMOTE    ] TPR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:11:08.799391] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-09.
[2025-10-24T00:11:09.428443] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T00:11:09.599410] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-02.
[2025-10-24T00:11:10.054791] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-05 (2.60 seconds).
[2025-10-24T00:11:10.351055] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T00:11:10.399440] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-10.
[2025-10-24T00:11:10.563978] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T00:11:11.199458] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-01.
[2025-10-24T00:11:11.872519] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T00:11:11.879764] [INFO ] [REMOTE    ] TPC: Full fetch complete (55506 records).
[2025-10-24T00:11:12.004619] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-06.
[2025-10-24T00:11:12.807500] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-03.
[2025-10-24T00:11:13.247514] [INFO ] [REMOTE    ] TPVG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:11:13.275430] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-01 (2.08 seconds).
[2025-10-24T00:11:13.467473] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T00:11:13.599394] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-01.
[2025-10-24T00:11:13.764777] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T00:11:14.399408] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-02.
[2025-10-24T00:11:14.777716] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T00:11:15.199431] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-04.
[2025-10-24T00:11:15.999421] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-02.
[2025-10-24T00:11:16.299829] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-02 (1.90 seconds).
[2025-10-24T00:11:16.342130] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T00:11:16.799428] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-05.
[2025-10-24T00:11:17.056592] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T00:11:17.599413] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-07.
[2025-10-24T00:11:17.699113] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T00:11:18.399454] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-03.
[2025-10-24T00:11:19.135409] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T00:11:19.199413] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-03.
[2025-10-24T00:11:19.999409] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-06.
[2025-10-24T00:11:20.505986] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T00:11:20.799481] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-08.
[2025-10-24T00:11:21.410528] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-03 (3.01 seconds).
[2025-10-24T00:11:21.599460] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-04.
[2025-10-24T00:11:22.081350] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-06 (2.08 seconds).
[2025-10-24T00:11:22.296361] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T00:11:22.399428] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-04.
[2025-10-24T00:11:23.199476] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-07.
[2025-10-24T00:11:23.435244] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T00:11:23.999417] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-05.
[2025-10-24T00:11:24.281939] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T00:11:24.556011] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-04 (2.16 seconds).
[2025-10-24T00:11:24.799434] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-08.
[2025-10-24T00:11:25.599456] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-05.
[2025-10-24T00:11:25.716885] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T00:11:25.895461] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T00:11:26.399466] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-06.
[2025-10-24T00:11:26.736299] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-05 (1.14 seconds).
[2025-10-24T00:11:27.199436] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-09.
[2025-10-24T00:11:27.885562] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-09 (0.69 seconds).
[2025-10-24T00:11:27.999401] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-06.
[2025-10-24T00:11:28.799443] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-09.
[2025-10-24T00:11:29.181250] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T00:11:29.504516] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-06 (3.11 seconds).
[2025-10-24T00:11:29.599483] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-07.
[2025-10-24T00:11:30.018109] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T00:11:30.399487] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-10.
[2025-10-24T00:11:31.106307] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T00:11:31.109013] [INFO ] [REMOTE    ] TPL: Full fetch complete (17526 records).
[2025-10-24T00:11:31.200358] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-07.
[2025-10-24T00:11:31.768078] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-07 (2.17 seconds).
[2025-10-24T00:11:32.005957] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-10.
[2025-10-24T00:11:32.336898] [INFO ] [REMOTE    ] TPYP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:11:32.471874] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T00:11:32.799456] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-01.
[2025-10-24T00:11:33.526565] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T00:11:33.534193] [INFO ] [REMOTE    ] TPH: Full fetch complete (65004 records).
[2025-10-24T00:11:33.604096] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-08.
[2025-10-24T00:11:33.857945] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T00:11:34.399436] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-08.
[2025-10-24T00:11:35.199425] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-02.
[2025-10-24T00:11:35.522016] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-08 (1.92 seconds).
[2025-10-24T00:11:35.923451] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T00:11:35.999400] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-03.
[2025-10-24T00:11:36.120046] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T00:11:36.653955] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T00:11:36.799428] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-09.
[2025-10-24T00:11:37.599495] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-04.
[2025-10-24T00:11:38.106414] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T00:11:38.238955] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-04 (0.64 seconds).
[2025-10-24T00:11:38.399433] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-09.
[2025-10-24T00:11:39.199454] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-10.
[2025-10-24T00:11:39.999415] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-05.
[2025-10-24T00:11:40.239583] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T00:11:40.438600] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-05 (0.44 seconds).
[2025-10-24T00:11:40.478442] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T00:11:40.483961] [INFO ] [REMOTE    ] TPVG: Full fetch complete (39298 records).
[2025-10-24T00:11:40.805590] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-10.
[2025-10-24T00:11:41.599430] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-06.
[2025-10-24T00:11:42.336667] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T00:11:42.368069] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T00:11:42.377370] [INFO ] [REMOTE    ] TPR: Full fetch complete (77496 records).
[2025-10-24T00:11:42.411844] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-07.
[2025-10-24T00:11:43.237795] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T00:11:43.240397] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-08.
[2025-10-24T00:11:43.968024] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T00:11:43.999492] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-09.
[2025-10-24T00:11:44.713781] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T00:11:44.799449] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-10.
[2025-10-24T00:11:45.466965] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-10 (0.67 seconds).
[2025-10-24T00:11:45.468850] [INFO ] [REMOTE    ] TPYP: Full fetch complete (12297 records).
[2025-10-24T00:11:48.278550] [INFO ] [REMOTE    ] TRAK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:11:48.301392] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-01.
[2025-10-24T00:11:49.025155] [INFO ] [REMOTE    ] TRC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:11:49.021993] [INFO ] [REMOTE    ] TPZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:11:49.037478] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-01.
[2025-10-24T00:11:49.037802] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-01.
[2025-10-24T00:11:49.108711] [INFO ] [REMOTE    ] TR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:11:49.109115] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-01.
[2025-10-24T00:11:49.285837] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T00:11:49.288259] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-02.
[2025-10-24T00:11:49.901705] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T00:11:49.905267] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-02.
[2025-10-24T00:11:49.984306] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T00:11:50.060836] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T00:11:50.094482] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T00:11:50.357156] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T00:11:50.399406] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-02.
[2025-10-24T00:11:51.199467] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-03.
[2025-10-24T00:11:51.381858] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T00:11:51.984184] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T00:11:51.999412] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-03.
[2025-10-24T00:11:52.730543] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T00:11:52.799411] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-02.
[2025-10-24T00:11:53.599432] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-03.
[2025-10-24T00:11:53.784215] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T00:11:54.399469] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-03.
[2025-10-24T00:11:54.523531] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T00:11:55.199444] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-04.
[2025-10-24T00:11:55.520174] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T00:11:55.999870] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-04.
[2025-10-24T00:11:56.002623] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T00:11:56.734160] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T00:11:56.799410] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-04.
[2025-10-24T00:11:57.599424] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-05.
[2025-10-24T00:11:57.920059] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T00:11:58.210421] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T00:11:58.399466] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-06.
[2025-10-24T00:11:58.839436] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-06 (0.44 seconds).
[2025-10-24T00:11:59.199479] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-05.
[2025-10-24T00:11:59.999407] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-04.
[2025-10-24T00:12:00.185923] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T00:12:00.799431] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-05.
[2025-10-24T00:12:00.872330] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T00:12:01.599451] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-06.
[2025-10-24T00:12:01.745302] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T00:12:02.399446] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-05.
[2025-10-24T00:12:02.539957] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T00:12:03.114931] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-05 (0.72 seconds).
[2025-10-24T00:12:03.199452] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-06.
[2025-10-24T00:12:03.999428] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-07.
[2025-10-24T00:12:04.352095] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T00:12:04.695424] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-07 (0.70 seconds).
[2025-10-24T00:12:04.799500] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-08.
[2025-10-24T00:12:05.599449] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-07.
[2025-10-24T00:12:05.650447] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T00:12:06.310159] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T00:12:06.399413] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-08.
[2025-10-24T00:12:07.026448] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-08 (0.63 seconds).
[2025-10-24T00:12:07.199427] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-09.
[2025-10-24T00:12:07.799606] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-09 (0.60 seconds).
[2025-10-24T00:12:07.999425] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-07.
[2025-10-24T00:12:08.799491] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-10.
[2025-10-24T00:12:09.092378] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T00:12:09.430363] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-10 (0.63 seconds).
[2025-10-24T00:12:09.431577] [INFO ] [REMOTE    ] TPZ: Full fetch complete (8334 records).
[2025-10-24T00:12:09.604561] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-08.
[2025-10-24T00:12:10.404891] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-09.
[2025-10-24T00:12:10.597895] [INFO ] [REMOTE    ] TREX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:12:10.739973] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T00:12:11.199417] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-01.
[2025-10-24T00:12:11.424308] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T00:12:11.999498] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-09.
[2025-10-24T00:12:12.799447] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-06.
[2025-10-24T00:12:13.164815] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T00:12:13.495179] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-01 (2.30 seconds).
[2025-10-24T00:12:13.599490] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-10.
[2025-10-24T00:12:13.635395] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T00:12:14.400595] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-10.
[2025-10-24T00:12:14.401829] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T00:12:14.405769] [INFO ] [REMOTE    ] TRC: Full fetch complete (21764 records).
[2025-10-24T00:12:15.201801] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-02.
[2025-10-24T00:12:15.620066] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T00:12:15.640173] [INFO ] [REMOTE    ] TRGP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:12:15.643974] [INFO ] [REMOTE    ] TR: Full fetch complete (25537 records).
[2025-10-24T00:12:16.004759] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-07.
[2025-10-24T00:12:16.808462] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-01.
[2025-10-24T00:12:16.893091] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T00:12:16.939270] [INFO ] [REMOTE    ] TRN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:12:16.948100] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-02 (1.75 seconds).
[2025-10-24T00:12:17.599472] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-03.
[2025-10-24T00:12:18.399470] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-01.
[2025-10-24T00:12:18.646236] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T00:12:19.199409] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-02.
[2025-10-24T00:12:19.384612] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T00:12:19.821011] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T00:12:19.999451] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-02.
[2025-10-24T00:12:20.799439] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-04.
[2025-10-24T00:12:21.000005] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T00:12:21.156161] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T00:12:21.599440] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-03.
[2025-10-24T00:12:22.399484] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-03.
[2025-10-24T00:12:22.611431] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T00:12:23.062846] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T00:12:23.199432] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-04.
[2025-10-24T00:12:23.999466] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-08.
[2025-10-24T00:12:24.730819] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T00:12:24.799411] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-05.
[2025-10-24T00:12:25.599497] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-05.
[2025-10-24T00:12:25.652513] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-03 (3.25 seconds).
[2025-10-24T00:12:26.204758] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T00:12:26.399506] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-06.
[2025-10-24T00:12:26.857023] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-08 (2.86 seconds).
[2025-10-24T00:12:27.199421] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-04.
[2025-10-24T00:12:27.302330] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T00:12:27.493907] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T00:12:27.999523] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-06.
[2025-10-24T00:12:28.799513] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-07.
[2025-10-24T00:12:28.986010] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T00:12:29.599419] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-09.
[2025-10-24T00:12:29.718520] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T00:12:30.356912] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T00:12:30.374550] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T00:12:30.399394] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-10.
[2025-10-24T00:12:31.109427] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T00:12:31.111894] [INFO ] [REMOTE    ] TRAK: Full fetch complete (13669 records).
[2025-10-24T00:12:31.204715] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-05.
[2025-10-24T00:12:32.009292] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-08.
[2025-10-24T00:12:32.264637] [INFO ] [REMOTE    ] TRNO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:12:32.799412] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-07.
[2025-10-24T00:12:33.601335] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-01.
[2025-10-24T00:12:33.603008] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T00:12:34.064533] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T00:12:34.394406] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-05 (3.19 seconds).
[2025-10-24T00:12:34.405231] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-09.
[2025-10-24T00:12:35.167424] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T00:12:35.199411] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-02.
[2025-10-24T00:12:35.767387] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T00:12:35.999428] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-06.
[2025-10-24T00:12:36.716424] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T00:12:36.799450] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-10.
[2025-10-24T00:12:37.599421] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-03.
[2025-10-24T00:12:37.735607] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T00:12:38.399436] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-07.
[2025-10-24T00:12:38.450410] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T00:12:38.455922] [INFO ] [REMOTE    ] TRN: Full fetch complete (52593 records).
[2025-10-24T00:12:39.212735] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-08.
[2025-10-24T00:12:39.259692] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T00:12:39.834097] [INFO ] [REMOTE    ] TROX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:12:39.999408] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-01.
[2025-10-24T00:12:40.116768] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T00:12:40.799444] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-04.
[2025-10-24T00:12:40.964153] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T00:12:41.599469] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-09.
[2025-10-24T00:12:41.661714] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T00:12:42.399422] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-08.
[2025-10-24T00:12:42.507613] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T00:12:43.199426] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-02.
[2025-10-24T00:12:43.267591] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T00:12:43.999424] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-10.
[2025-10-24T00:12:44.040785] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T00:12:44.801698] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-05.
[2025-10-24T00:12:44.804316] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T00:12:45.599442] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-09.
[2025-10-24T00:12:45.731757] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T00:12:45.740476] [INFO ] [REMOTE    ] TREX: Full fetch complete (71926 records).
[2025-10-24T00:12:46.399420] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-03.
[2025-10-24T00:12:46.461388] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T00:12:47.202830] [INFO ] [REMOTE    ] TRP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:12:47.203021] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-06.
[2025-10-24T00:12:47.437472] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T00:12:47.999425] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-10.
[2025-10-24T00:12:48.223411] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T00:12:48.799416] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-01.
[2025-10-24T00:12:49.505006] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-06 (2.30 seconds).
[2025-10-24T00:12:49.599396] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-07.
[2025-10-24T00:12:49.627454] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T00:12:49.636759] [INFO ] [REMOTE    ] TRGP: Full fetch complete (73627 records).
[2025-10-24T00:12:50.403368] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-04.
[2025-10-24T00:12:51.166859] [INFO ] [REMOTE    ] TRTX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:12:51.195990] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T00:12:51.199513] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-01.
[2025-10-24T00:12:51.261702] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-01 (2.46 seconds).
[2025-10-24T00:12:51.761078] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T00:12:51.999430] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-05.
[2025-10-24T00:12:52.532115] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T00:12:52.799404] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-08.
[2025-10-24T00:12:53.599476] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-02.
[2025-10-24T00:12:53.807076] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T00:12:54.399447] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-06.
[2025-10-24T00:12:54.439732] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T00:12:55.152850] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T00:12:55.199429] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-03.
[2025-10-24T00:12:55.999509] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-09.
[2025-10-24T00:12:56.116874] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T00:12:56.799421] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-07.
[2025-10-24T00:12:57.411681] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-03 (2.21 seconds).
[2025-10-24T00:12:57.599409] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-04.
[2025-10-24T00:12:57.945094] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-09 (1.95 seconds).
[2025-10-24T00:12:58.399427] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-02.
[2025-10-24T00:12:58.546440] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T00:12:59.199441] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-10.
[2025-10-24T00:12:59.552564] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-04 (1.95 seconds).
[2025-10-24T00:12:59.717076] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T00:12:59.999438] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-03.
[2025-10-24T00:13:00.723584] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T00:13:00.730722] [INFO ] [REMOTE    ] TRNO: Full fetch complete (62758 records).
[2025-10-24T00:13:00.806180] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-05.
[2025-10-24T00:13:01.596460] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T00:13:01.604441] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-08.
[2025-10-24T00:13:02.245782] [INFO ] [REMOTE    ] TRU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:13:02.399437] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-04.
[2025-10-24T00:13:02.616766] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T00:13:03.199396] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-06.
[2025-10-24T00:13:03.312165] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T00:13:03.713337] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-04 (1.31 seconds).
[2025-10-24T00:13:03.999442] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-09.
[2025-10-24T00:13:04.799425] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-05.
[2025-10-24T00:13:04.927291] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T00:13:05.599470] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-01.
[2025-10-24T00:13:06.043049] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-09 (2.04 seconds).
[2025-10-24T00:13:06.284764] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T00:13:06.399407] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-06.
[2025-10-24T00:13:07.207895] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-07.
[2025-10-24T00:13:07.212267] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T00:13:07.840803] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T00:13:07.999397] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-07.
[2025-10-24T00:13:08.799482] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-10.
[2025-10-24T00:13:09.095613] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T00:13:09.436504] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T00:13:09.599448] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-08.
[2025-10-24T00:13:10.399493] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-08.
[2025-10-24T00:13:10.595901] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T00:13:10.605041] [INFO ] [REMOTE    ] TROX: Full fetch complete (74144 records).
[2025-10-24T00:13:11.201788] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-02.
[2025-10-24T00:13:11.464810] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-08 (1.87 seconds).
[2025-10-24T00:13:11.917841] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T00:13:12.009882] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-09.
[2025-10-24T00:13:12.217506] [INFO ] [REMOTE    ] TRV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:13:12.594217] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T00:13:12.799505] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-01.
[2025-10-24T00:13:13.599502] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-09.
[2025-10-24T00:13:13.640446] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T00:13:14.399448] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-10.
[2025-10-24T00:13:14.587382] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T00:13:15.039923] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T00:13:15.199504] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-02.
[2025-10-24T00:13:15.751079] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T00:13:15.757275] [INFO ] [REMOTE    ] TRTX: Full fetch complete (53019 records).
[2025-10-24T00:13:16.010966] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-03.
[2025-10-24T00:13:16.814573] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-10.
[2025-10-24T00:13:17.119092] [INFO ] [REMOTE    ] TS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:13:17.149378] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-02 (1.95 seconds).
[2025-10-24T00:13:17.599479] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-01.
[2025-10-24T00:13:17.631262] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T00:13:18.394052] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T00:13:18.402411] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-03.
[2025-10-24T00:13:18.403843] [INFO ] [REMOTE    ] TRP: Full fetch complete (75767 records).
[2025-10-24T00:13:19.204551] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-04.
[2025-10-24T00:13:19.538234] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-01 (1.94 seconds).
[2025-10-24T00:13:19.890205] [INFO ] [REMOTE    ] TSE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:13:19.999394] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-01.
[2025-10-24T00:13:20.488514] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-03 (2.09 seconds).
[2025-10-24T00:13:20.799432] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-02.
[2025-10-24T00:13:21.019028] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T00:13:21.154294] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-04 (1.95 seconds).
[2025-10-24T00:13:21.599483] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-02.
[2025-10-24T00:13:22.399407] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-05.
[2025-10-24T00:13:22.483943] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T00:13:22.510181] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T00:13:23.199441] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-03.
[2025-10-24T00:13:23.999421] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-03.
[2025-10-24T00:13:24.213583] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T00:13:24.345351] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T00:13:24.799445] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-04.
[2025-10-24T00:13:25.547597] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T00:13:25.599404] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-04.
[2025-10-24T00:13:26.395986] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T00:13:26.405616] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-04.
[2025-10-24T00:13:26.920854] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T00:13:27.199432] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-06.
[2025-10-24T00:13:27.999418] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-05.
[2025-10-24T00:13:28.305380] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-04 (1.90 seconds).
[2025-10-24T00:13:28.799460] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-05.
[2025-10-24T00:13:28.927270] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T00:13:29.384298] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T00:13:29.599471] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-07.
[2025-10-24T00:13:30.399403] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-06.
[2025-10-24T00:13:30.504977] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T00:13:31.199416] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-06.
[2025-10-24T00:13:31.437944] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T00:13:31.620487] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T00:13:31.999433] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-08.
[2025-10-24T00:13:32.799450] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-07.
[2025-10-24T00:13:32.923874] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T00:13:33.599465] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-05.
[2025-10-24T00:13:33.749184] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T00:13:33.782529] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T00:13:34.399436] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-09.
[2025-10-24T00:13:35.199448] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-08.
[2025-10-24T00:13:35.322326] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T00:13:35.999429] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-06.
[2025-10-24T00:13:36.118393] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T00:13:36.495349] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T00:13:36.799451] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-10.
[2025-10-24T00:13:37.516149] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T00:13:37.599437] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-07.
[2025-10-24T00:13:38.399441] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-07.
[2025-10-24T00:13:38.676360] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T00:13:38.685573] [INFO ] [REMOTE    ] TRU: Full fetch complete (74203 records).
[2025-10-24T00:13:39.199488] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-09.
[2025-10-24T00:13:39.351333] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T00:13:39.976224] [INFO ] [REMOTE    ] TSI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:13:40.009752] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-08.
[2025-10-24T00:13:40.016508] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T00:13:40.368844] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T00:13:40.799451] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-01.
[2025-10-24T00:13:41.439115] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-01 (0.64 seconds).
[2025-10-24T00:13:41.599432] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-02.
[2025-10-24T00:13:41.705326] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T00:13:42.399423] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-10.
[2025-10-24T00:13:42.623126] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T00:13:43.199465] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-03.
[2025-10-24T00:13:43.536005] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T00:13:43.541112] [INFO ] [REMOTE    ] TSE: Full fetch complete (40851 records).
[2025-10-24T00:13:44.007910] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-09.
[2025-10-24T00:13:44.146032] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T00:13:44.807567] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-08.
[2025-10-24T00:13:44.912842] [INFO ] [REMOTE    ] TSLX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:13:45.599423] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-01.
[2025-10-24T00:13:45.767967] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T00:13:46.334262] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T00:13:46.399409] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-09.
[2025-10-24T00:13:46.800795] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T00:13:47.199438] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-10.
[2025-10-24T00:13:47.999487] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-04.
[2025-10-24T00:13:48.113436] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T00:13:48.656898] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-04 (0.66 seconds).
[2025-10-24T00:13:48.799486] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-02.
[2025-10-24T00:13:48.898522] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T00:13:48.907359] [INFO ] [REMOTE    ] TS: Full fetch complete (74882 records).
[2025-10-24T00:13:49.621412] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-10.
[2025-10-24T00:13:50.261931] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T00:13:50.411397] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-03.
[2025-10-24T00:13:50.545998] [INFO ] [REMOTE    ] TSM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:13:51.199448] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-01.
[2025-10-24T00:13:51.336543] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T00:13:51.344957] [INFO ] [REMOTE    ] TRV: Full fetch complete (69973 records).
[2025-10-24T00:13:52.000420] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-05.
[2025-10-24T00:13:52.077687] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T00:13:52.663576] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-05 (0.66 seconds).
[2025-10-24T00:13:52.807264] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-06.
[2025-10-24T00:13:52.851297] [INFO ] [REMOTE    ] TSN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:13:53.602433] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-04.
[2025-10-24T00:13:53.603322] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T00:13:53.818218] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-01 (2.62 seconds).
[2025-10-24T00:13:54.399437] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-07.
[2025-10-24T00:13:55.187297] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T00:13:55.204500] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-08.
[2025-10-24T00:13:55.217164] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T00:13:55.956934] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T00:13:55.999423] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-09.
[2025-10-24T00:13:56.749786] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T00:13:56.799411] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-10.
[2025-10-24T00:13:57.599417] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-05.
[2025-10-24T00:13:57.662800] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-10 (0.86 seconds).
[2025-10-24T00:13:57.665454] [INFO ] [REMOTE    ] TSI: Full fetch complete (13979 records).
[2025-10-24T00:13:58.410712] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-01.
[2025-10-24T00:13:58.801344] [INFO ] [REMOTE    ] TSQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:13:59.046873] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T00:13:59.199458] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-01.
[2025-10-24T00:13:59.999418] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T00:13:59.999487] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-06.
[2025-10-24T00:14:00.215706] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T00:14:00.799429] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-02.
[2025-10-24T00:14:01.511965] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T00:14:01.599449] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-02.
[2025-10-24T00:14:02.393836] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T00:14:02.403584] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-07.
[2025-10-24T00:14:03.199442] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-03.
[2025-10-24T00:14:03.860833] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T00:14:03.999408] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-08.
[2025-10-24T00:14:04.086348] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-02 (2.49 seconds).
[2025-10-24T00:14:04.799518] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-03.
[2025-10-24T00:14:05.063421] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-03 (1.86 seconds).
[2025-10-24T00:14:05.338991] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T00:14:05.599449] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-09.
[2025-10-24T00:14:06.399503] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-04.
[2025-10-24T00:14:06.967347] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T00:14:07.199429] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-10.
[2025-10-24T00:14:07.754079] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-03 (2.95 seconds).
[2025-10-24T00:14:07.999455] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-02.
[2025-10-24T00:14:08.186780] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T00:14:08.469033] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-02 (0.47 seconds).
[2025-10-24T00:14:08.723468] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T00:14:08.730801] [INFO ] [REMOTE    ] TSLX: Full fetch complete (50854 records).
[2025-10-24T00:14:08.804549] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-05.
[2025-10-24T00:14:09.604707] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-03.
[2025-10-24T00:14:10.056064] [INFO ] [REMOTE    ] TT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:14:10.399422] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-01.
[2025-10-24T00:14:10.450484] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T00:14:10.703420] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T00:14:11.199462] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-04.
[2025-10-24T00:14:11.999401] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-06.
[2025-10-24T00:14:12.199119] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T00:14:12.799493] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-02.
[2025-10-24T00:14:13.599435] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-04.
[2025-10-24T00:14:13.879178] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T00:14:13.988013] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-04 (2.79 seconds).
[2025-10-24T00:14:14.399455] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-05.
[2025-10-24T00:14:14.415621] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T00:14:14.627683] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T00:14:15.199455] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-03.
[2025-10-24T00:14:15.999487] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-05.
[2025-10-24T00:14:16.799611] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-07.
[2025-10-24T00:14:17.198226] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-05 (1.20 seconds).
[2025-10-24T00:14:17.603185] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-06.
[2025-10-24T00:14:17.608364] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-03 (2.41 seconds).
[2025-10-24T00:14:17.814180] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-05 (3.41 seconds).
[2025-10-24T00:14:18.399414] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-04.
[2025-10-24T00:14:18.601563] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T00:14:18.941403] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-07 (2.14 seconds).
[2025-10-24T00:14:19.199432] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-06.
[2025-10-24T00:14:19.999411] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-07.
[2025-10-24T00:14:20.160053] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T00:14:20.570210] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-07 (0.57 seconds).
[2025-10-24T00:14:20.799428] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-08.
[2025-10-24T00:14:21.442744] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-06 (2.24 seconds).
[2025-10-24T00:14:21.599487] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-08.
[2025-10-24T00:14:22.375809] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T00:14:22.399404] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-09.
[2025-10-24T00:14:22.439671] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T00:14:23.125743] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T00:14:23.199429] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-10.
[2025-10-24T00:14:23.948290] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T00:14:23.950625] [INFO ] [REMOTE    ] TSQ: Full fetch complete (16337 records).
[2025-10-24T00:14:24.004705] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-05.
[2025-10-24T00:14:24.804604] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-07.
[2025-10-24T00:14:24.906723] [INFO ] [REMOTE    ] TTAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:14:25.599420] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-09.
[2025-10-24T00:14:25.839826] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T00:14:26.399504] [INFO ] [REMOTE    ] TTAM: Fetching primary data for 2025-01.
[2025-10-24T00:14:26.611392] [DEBUG] [REMOTE    ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:14:26.611731] [WARN ] [REMOTE    ] TTAM: No data returned for month 2025-01
[2025-10-24T00:14:26.611817] [FATAL] [REMOTE    ] TTAM: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:14:27.203771] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-06.
[2025-10-24T00:14:27.427365] [INFO ] [REMOTE    ] TTC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:14:27.509491] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-09 (1.91 seconds).
[2025-10-24T00:14:27.825868] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-07 (3.02 seconds).
[2025-10-24T00:14:27.999416] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-01.
[2025-10-24T00:14:28.799468] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-08.
[2025-10-24T00:14:28.918817] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T00:14:29.066538] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T00:14:29.599431] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-02.
[2025-10-24T00:14:30.399480] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-07.
[2025-10-24T00:14:31.153962] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T00:14:31.199395] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-03.
[2025-10-24T00:14:31.723833] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-08 (2.92 seconds).
[2025-10-24T00:14:31.999395] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-09.
[2025-10-24T00:14:32.156895] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T00:14:32.799420] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-10.
[2025-10-24T00:14:32.977480] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T00:14:33.599489] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-04.
[2025-10-24T00:14:34.399409] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-08.
[2025-10-24T00:14:34.561227] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T00:14:34.570892] [INFO ] [REMOTE    ] TSN: Full fetch complete (76685 records).
[2025-10-24T00:14:35.012953] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-09 (3.01 seconds).
[2025-10-24T00:14:35.152276] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T00:14:35.234121] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-10.
[2025-10-24T00:14:36.006894] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-05.
[2025-10-24T00:14:36.180054] [INFO ] [REMOTE    ] TTE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:14:36.228761] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T00:14:36.230025] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T00:14:36.249354] [INFO ] [REMOTE    ] TSM: Full fetch complete (77999 records).
[2025-10-24T00:14:36.808930] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-01.
[2025-10-24T00:14:37.604405] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-09.
[2025-10-24T00:14:37.769255] [INFO ] [REMOTE    ] TTI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:14:37.793176] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T00:14:38.399404] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-01.
[2025-10-24T00:14:38.748159] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-01 (1.94 seconds).
[2025-10-24T00:14:39.199479] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-06.
[2025-10-24T00:14:39.411609] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T00:14:39.999512] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-02.
[2025-10-24T00:14:40.060310] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T00:14:40.747341] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-06 (1.55 seconds).
[2025-10-24T00:14:40.799522] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-07.
[2025-10-24T00:14:41.599465] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-10.
[2025-10-24T00:14:41.700375] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T00:14:42.287164] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T00:14:42.399423] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-08.
[2025-10-24T00:14:43.199497] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-03.
[2025-10-24T00:14:43.254975] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T00:14:43.262755] [INFO ] [REMOTE    ] TT: Full fetch complete (69961 records).
[2025-10-24T00:14:44.000081] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-02.
[2025-10-24T00:14:44.009228] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T00:14:44.719533] [INFO ] [REMOTE    ] TU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:14:44.799408] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-09.
[2025-10-24T00:14:45.118567] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T00:14:45.397290] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T00:14:45.599419] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-04.
[2025-10-24T00:14:46.291196] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T00:14:46.399405] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-10.
[2025-10-24T00:14:47.199452] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-03.
[2025-10-24T00:14:47.489721] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T00:14:47.713204] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T00:14:47.720132] [INFO ] [REMOTE    ] TTC: Full fetch complete (61828 records).
[2025-10-24T00:14:48.003373] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-05.
[2025-10-24T00:14:48.809699] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-01.
[2025-10-24T00:14:48.950060] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T00:14:49.169945] [INFO ] [REMOTE    ] TUYA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:14:49.599415] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-04.
[2025-10-24T00:14:49.862595] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T00:14:50.250880] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T00:14:50.399455] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-06.
[2025-10-24T00:14:51.100004] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T00:14:51.199452] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-05.
[2025-10-24T00:14:51.999409] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-02.
[2025-10-24T00:14:52.055344] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T00:14:52.560053] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T00:14:52.799418] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-07.
[2025-10-24T00:14:53.599446] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-06.
[2025-10-24T00:14:53.653968] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T00:14:54.403699] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-03.
[2025-10-24T00:14:54.409225] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T00:14:55.205760] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-01.
[2025-10-24T00:14:55.208164] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T00:14:55.998823] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T00:14:56.008615] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-07.
[2025-10-24T00:14:56.574698] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T00:14:56.799434] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-08.
[2025-10-24T00:14:57.599429] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-02.
[2025-10-24T00:14:57.656457] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T00:14:58.399448] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-08.
[2025-10-24T00:14:58.531660] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T00:14:59.199411] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-09.
[2025-10-24T00:14:59.556462] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-02 (1.96 seconds).
[2025-10-24T00:15:00.010486] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-03.
[2025-10-24T00:15:00.031835] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T00:15:00.799450] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-04.
[2025-10-24T00:15:01.348582] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-09 (2.15 seconds).
[2025-10-24T00:15:01.461188] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T00:15:01.599438] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-04.
[2025-10-24T00:15:02.399485] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-09.
[2025-10-24T00:15:02.877760] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-04 (2.08 seconds).
[2025-10-24T00:15:03.199427] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-05.
[2025-10-24T00:15:03.490745] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T00:15:03.876023] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T00:15:03.999408] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-10.
[2025-10-24T00:15:04.799442] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-10.
[2025-10-24T00:15:05.111615] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T00:15:05.599488] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-05.
[2025-10-24T00:15:05.827193] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T00:15:05.835919] [INFO ] [REMOTE    ] TTI: Full fetch complete (66576 records).
[2025-10-24T00:15:06.403712] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-06.
[2025-10-24T00:15:06.673603] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T00:15:06.682840] [INFO ] [REMOTE    ] TTE: Full fetch complete (75070 records).
[2025-10-24T00:15:07.771226] [INFO ] [REMOTE    ] TV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:15:07.789218] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-01.
[2025-10-24T00:15:07.808336] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-05 (2.21 seconds).
[2025-10-24T00:15:08.000131] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-06.
[2025-10-24T00:15:08.220584] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T00:15:08.755768] [INFO ] [REMOTE    ] TVC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:15:08.799391] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-01.
[2025-10-24T00:15:09.281729] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-01 (0.48 seconds).
[2025-10-24T00:15:09.571895] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T00:15:09.599392] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-02.
[2025-10-24T00:15:09.679836] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T00:15:10.399496] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-02.
[2025-10-24T00:15:10.854571] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T00:15:11.036734] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T00:15:11.199442] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-07.
[2025-10-24T00:15:11.999496] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-03.
[2025-10-24T00:15:12.799472] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-03.
[2025-10-24T00:15:12.936764] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T00:15:13.599454] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-08.
[2025-10-24T00:15:13.610582] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T00:15:13.638842] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T00:15:14.399441] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-04.
[2025-10-24T00:15:15.199410] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-07.
[2025-10-24T00:15:15.313950] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T00:15:15.999483] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-04.
[2025-10-24T00:15:16.148181] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T00:15:16.600856] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T00:15:16.809849] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-05.
[2025-10-24T00:15:16.832782] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T00:15:17.196340] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-05 (0.39 seconds).
[2025-10-24T00:15:17.599437] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-05.
[2025-10-24T00:15:18.399443] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-08.
[2025-10-24T00:15:19.136271] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T00:15:19.199461] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-09.
[2025-10-24T00:15:20.001180] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-06.
[2025-10-24T00:15:20.005989] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T00:15:20.523479] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-06 (0.52 seconds).
[2025-10-24T00:15:20.799454] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-09.
[2025-10-24T00:15:21.006953] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T00:15:21.599446] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-06.
[2025-10-24T00:15:22.064883] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-09 (1.27 seconds).
[2025-10-24T00:15:22.399448] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-10.
[2025-10-24T00:15:23.025246] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T00:15:23.199460] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-07.
[2025-10-24T00:15:23.689125] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-07 (0.49 seconds).
[2025-10-24T00:15:23.972598] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T00:15:23.980212] [INFO ] [REMOTE    ] TUYA: Full fetch complete (66937 records).
[2025-10-24T00:15:24.010147] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-07.
[2025-10-24T00:15:24.800069] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-08.
[2025-10-24T00:15:25.334990] [INFO ] [REMOTE    ] TVE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:15:25.330242] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-08 (0.53 seconds).
[2025-10-24T00:15:25.599417] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-01.
[2025-10-24T00:15:25.687159] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T00:15:26.172337] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T00:15:26.399451] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-08.
[2025-10-24T00:15:27.199457] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-10.
[2025-10-24T00:15:27.915286] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T00:15:27.999407] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-09.
[2025-10-24T00:15:28.503240] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-09 (0.50 seconds).
[2025-10-24T00:15:28.799419] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-10.
[2025-10-24T00:15:28.920532] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T00:15:28.929215] [INFO ] [REMOTE    ] TU: Full fetch complete (72855 records).
[2025-10-24T00:15:29.337855] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T00:15:29.340392] [INFO ] [REMOTE    ] TVC: Full fetch complete (5042 records).
[2025-10-24T00:15:29.609510] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-09.
[2025-10-24T00:15:30.407983] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-02.
[2025-10-24T00:15:31.147999] [INFO ] [REMOTE    ] TWI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:15:31.167701] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T00:15:31.206631] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-01.
[2025-10-24T00:15:31.283273] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T00:15:31.638614] [INFO ] [REMOTE    ] TWLO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:15:31.999447] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-01.
[2025-10-24T00:15:32.761626] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T00:15:32.799406] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-02.
[2025-10-24T00:15:33.599431] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-10.
[2025-10-24T00:15:34.044156] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-01 (2.04 seconds).
[2025-10-24T00:15:34.107732] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T00:15:34.399427] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-03.
[2025-10-24T00:15:34.847438] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T00:15:34.853566] [INFO ] [REMOTE    ] TV: Full fetch complete (60829 records).
[2025-10-24T00:15:35.204624] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-03.
[2025-10-24T00:15:35.950530] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T00:15:36.003103] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-04.
[2025-10-24T00:15:36.070023] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T00:15:36.261395] [INFO ] [REMOTE    ] TWN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:15:36.646558] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-04 (0.64 seconds).
[2025-10-24T00:15:36.799471] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-05.
[2025-10-24T00:15:37.240485] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-05 (0.44 seconds).
[2025-10-24T00:15:37.599450] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-06.
[2025-10-24T00:15:37.928100] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-06 (0.33 seconds).
[2025-10-24T00:15:38.399435] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-04.
[2025-10-24T00:15:39.199449] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-07.
[2025-10-24T00:15:39.705416] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-07 (0.51 seconds).
[2025-10-24T00:15:39.999441] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-01.
[2025-10-24T00:15:40.642755] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-01 (0.64 seconds).
[2025-10-24T00:15:40.799445] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-02.
[2025-10-24T00:15:41.599439] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-02.
[2025-10-24T00:15:42.231496] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T00:15:42.399418] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-08.
[2025-10-24T00:15:42.522300] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T00:15:42.864356] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-08 (0.46 seconds).
[2025-10-24T00:15:43.199415] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-03.
[2025-10-24T00:15:43.664257] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-04 (5.26 seconds).
[2025-10-24T00:15:43.999449] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-03.
[2025-10-24T00:15:44.613783] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T00:15:44.799477] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-04.
[2025-10-24T00:15:45.148179] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-03 (1.95 seconds).
[2025-10-24T00:15:45.440423] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-04 (0.64 seconds).
[2025-10-24T00:15:45.599444] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-04.
[2025-10-24T00:15:46.399431] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-05.
[2025-10-24T00:15:47.199415] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-09.
[2025-10-24T00:15:47.692863] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-04 (2.09 seconds).
[2025-10-24T00:15:47.728991] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T00:15:47.747394] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-09 (0.55 seconds).
[2025-10-24T00:15:47.999441] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-10.
[2025-10-24T00:15:48.490273] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T00:15:48.491234] [INFO ] [REMOTE    ] TVE: Full fetch complete (4213 records).
[2025-10-24T00:15:48.802835] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-05.
[2025-10-24T00:15:49.604789] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-05.
[2025-10-24T00:15:49.773810] [INFO ] [REMOTE    ] TWO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:15:50.251440] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T00:15:50.399477] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-01.
[2025-10-24T00:15:50.918043] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-05 (2.12 seconds).
[2025-10-24T00:15:51.199446] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-06.
[2025-10-24T00:15:51.653692] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T00:15:51.668140] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-06 (0.47 seconds).
[2025-10-24T00:15:51.999450] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-06.
[2025-10-24T00:15:52.799445] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-02.
[2025-10-24T00:15:53.462426] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T00:15:53.599403] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-06.
[2025-10-24T00:15:54.342595] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T00:15:54.399443] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-03.
[2025-10-24T00:15:55.142438] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T00:15:55.199438] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-07.
[2025-10-24T00:15:55.999443] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-07.
[2025-10-24T00:15:56.089014] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T00:15:56.799418] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-04.
[2025-10-24T00:15:57.281109] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-07 (2.08 seconds).
[2025-10-24T00:15:57.481160] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T00:15:57.599423] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-07.
[2025-10-24T00:15:58.184075] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T00:15:58.325072] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T00:15:58.399435] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-08.
[2025-10-24T00:15:58.847293] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T00:15:59.199446] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-05.
[2025-10-24T00:15:59.999443] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-09.
[2025-10-24T00:16:00.621852] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T00:16:00.799434] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-08.
[2025-10-24T00:16:01.608139] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-10.
[2025-10-24T00:16:01.614160] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-05 (2.41 seconds).
[2025-10-24T00:16:02.143409] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T00:16:02.162606] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T00:16:02.164885] [INFO ] [REMOTE    ] TWN: Full fetch complete (5216 records).
[2025-10-24T00:16:02.404772] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-09.
[2025-10-24T00:16:03.131175] [INFO ] [REMOTE    ] TWOD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:16:03.199427] [INFO ] [REMOTE    ] TWOD: Fetching primary data for 2025-01.
[2025-10-24T00:16:03.430499] [DEBUG] [REMOTE    ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:16:03.430879] [WARN ] [REMOTE    ] TWOD: No data returned for month 2025-01
[2025-10-24T00:16:03.430986] [FATAL] [REMOTE    ] TWOD: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:16:03.825264] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T00:16:04.000047] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-08.
[2025-10-24T00:16:04.199092] [INFO ] [REMOTE    ] TX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:16:04.799443] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-06.
[2025-10-24T00:16:05.599445] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-01.
[2025-10-24T00:16:06.202792] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-08 (2.20 seconds).
[2025-10-24T00:16:06.405166] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-09.
[2025-10-24T00:16:06.408701] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T00:16:06.820711] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T00:16:07.199486] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-07.
[2025-10-24T00:16:07.999416] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-02.
[2025-10-24T00:16:08.481134] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-09 (2.08 seconds).
[2025-10-24T00:16:08.799423] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-10.
[2025-10-24T00:16:09.143034] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T00:16:09.328846] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T00:16:09.599449] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-10.
[2025-10-24T00:16:10.188453] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T00:16:10.195116] [INFO ] [REMOTE    ] TWI: Full fetch complete (52083 records).
[2025-10-24T00:16:10.404689] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-08.
[2025-10-24T00:16:11.212061] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-03.
[2025-10-24T00:16:11.644802] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-10 (2.05 seconds).
[2025-10-24T00:16:11.678530] [INFO ] [REMOTE    ] TXNM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:16:11.688844] [INFO ] [REMOTE    ] TWLO: Full fetch complete (76604 records).
[2025-10-24T00:16:11.999541] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-01.
[2025-10-24T00:16:12.241194] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T00:16:12.650858] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T00:16:12.804519] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-09.
[2025-10-24T00:16:13.238923] [INFO ] [REMOTE    ] TXO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:16:13.387923] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T00:16:13.599465] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-01.
[2025-10-24T00:16:14.399450] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-02.
[2025-10-24T00:16:14.493542] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T00:16:14.680626] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-09 (1.88 seconds).
[2025-10-24T00:16:15.199445] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-04.
[2025-10-24T00:16:15.555946] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T00:16:15.999432] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-03.
[2025-10-24T00:16:16.383937] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-04 (1.18 seconds).
[2025-10-24T00:16:16.799507] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-05.
[2025-10-24T00:16:17.599423] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-10.
[2025-10-24T00:16:17.741850] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T00:16:17.791006] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T00:16:18.399437] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-02.
[2025-10-24T00:16:19.135619] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-02 (0.74 seconds).
[2025-10-24T00:16:19.199421] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-03.
[2025-10-24T00:16:19.269246] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T00:16:19.277910] [INFO ] [REMOTE    ] TWO: Full fetch complete (69254 records).
[2025-10-24T00:16:19.825058] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-03 (0.63 seconds).
[2025-10-24T00:16:20.003831] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-06.
[2025-10-24T00:16:20.757203] [INFO ] [REMOTE    ] TXT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:16:20.799394] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-01.
[2025-10-24T00:16:21.106424] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T00:16:21.599440] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-04.
[2025-10-24T00:16:22.395636] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T00:16:22.399401] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-07.
[2025-10-24T00:16:22.476966] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T00:16:23.199445] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-04.
[2025-10-24T00:16:23.630528] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T00:16:23.999437] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-02.
[2025-10-24T00:16:24.746160] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T00:16:24.799405] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-05.
[2025-10-24T00:16:25.599437] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-05.
[2025-10-24T00:16:25.697112] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T00:16:26.399458] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-08.
[2025-10-24T00:16:26.759719] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T00:16:26.891174] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-05 (2.09 seconds).
[2025-10-24T00:16:27.199414] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-06.
[2025-10-24T00:16:27.584914] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T00:16:27.999437] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-06.
[2025-10-24T00:16:28.481760] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T00:16:28.799438] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-09.
[2025-10-24T00:16:29.123397] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T00:16:29.599451] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-03.
[2025-10-24T00:16:29.851359] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T00:16:30.399453] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-07.
[2025-10-24T00:16:31.204557] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-07.
[2025-10-24T00:16:31.224360] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T00:16:31.520010] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T00:16:31.999467] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-10.
[2025-10-24T00:16:32.747501] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T00:16:32.751955] [INFO ] [REMOTE    ] TX: Full fetch complete (35442 records).
[2025-10-24T00:16:32.815003] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-08.
[2025-10-24T00:16:33.009163] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T00:16:33.616778] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-04.
[2025-10-24T00:16:33.809039] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T00:16:34.055573] [INFO ] [REMOTE    ] TY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:16:34.399443] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-09.
[2025-10-24T00:16:35.199409] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-01.
[2025-10-24T00:16:35.506817] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T00:16:35.538665] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-04 (1.92 seconds).
[2025-10-24T00:16:35.749459] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-01 (0.55 seconds).
[2025-10-24T00:16:35.999452] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-05.
[2025-10-24T00:16:36.799448] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-10.
[2025-10-24T00:16:37.599411] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-08.
[2025-10-24T00:16:37.827126] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-05 (1.83 seconds).
[2025-10-24T00:16:37.976937] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T00:16:37.981098] [INFO ] [REMOTE    ] TXO: Full fetch complete (27303 records).
[2025-10-24T00:16:38.402086] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-02.
[2025-10-24T00:16:39.194678] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T00:16:39.204680] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-06.
[2025-10-24T00:16:39.220388] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T00:16:39.999495] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-09.
[2025-10-24T00:16:40.799434] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-03.
[2025-10-24T00:16:40.856414] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T00:16:41.421228] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T00:16:41.463825] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T00:16:41.599443] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-04.
[2025-10-24T00:16:42.399508] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-10.
[2025-10-24T00:16:42.423804] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T00:16:43.199500] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-05.
[2025-10-24T00:16:43.944578] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T00:16:43.945595] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T00:16:43.955162] [INFO ] [REMOTE    ] TXNM: Full fetch complete (62762 records).
[2025-10-24T00:16:44.011765] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-06.
[2025-10-24T00:16:44.577980] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T00:16:44.799418] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-07.
[2025-10-24T00:16:45.590603] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T00:16:45.599395] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-08.
[2025-10-24T00:16:46.307155] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T00:16:46.399402] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-09.
[2025-10-24T00:16:47.199415] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-07.
[2025-10-24T00:16:47.225326] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-09 (0.83 seconds).
[2025-10-24T00:16:47.999430] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-10.
[2025-10-24T00:16:48.514921] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-10 (0.52 seconds).
[2025-10-24T00:16:48.516586] [INFO ] [REMOTE    ] TY: Full fetch complete (11303 records).
[2025-10-24T00:16:48.957046] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T00:16:48.979215] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-08.
[2025-10-24T00:16:50.636493] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T00:16:50.646758] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-09.
[2025-10-24T00:16:52.048422] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T00:16:52.058695] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-10.
[2025-10-24T00:16:53.775308] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T00:16:53.784087] [INFO ] [REMOTE    ] TXT: Full fetch complete (72444 records).
[2025-10-24T00:16:56.773746] [INFO ] [REMOTE    ] TYG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:16:56.858334] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-01.
[2025-10-24T00:16:57.041300] [INFO ] [REMOTE    ] TYL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:16:57.059507] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-01.
[2025-10-24T00:16:57.429870] [INFO ] [REMOTE    ] U: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:16:57.452316] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-01.
[2025-10-24T00:16:57.491561] [INFO ] [REMOTE    ] UA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:16:57.491862] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-01.
[2025-10-24T00:16:58.161679] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T00:16:58.166784] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-02.
[2025-10-24T00:16:58.368718] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T00:16:58.373012] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-02.
[2025-10-24T00:16:59.126580] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T00:16:59.127514] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T00:16:59.137245] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-02.
[2025-10-24T00:16:59.141495] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-03.
[2025-10-24T00:16:59.507195] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T00:16:59.511843] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-03.
[2025-10-24T00:16:59.842112] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-01 (2.39 seconds).
[2025-10-24T00:16:59.853020] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-02.
[2025-10-24T00:17:00.073180] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T00:17:00.077181] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-04.
[2025-10-24T00:17:00.836976] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T00:17:00.847329] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-03.
[2025-10-24T00:17:00.904802] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T00:17:00.910217] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-04.
[2025-10-24T00:17:01.239275] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-04 (1.16 seconds).
[2025-10-24T00:17:01.599436] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-05.
[2025-10-24T00:17:01.944793] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-02 (2.09 seconds).
[2025-10-24T00:17:02.142480] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T00:17:02.399410] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-03.
[2025-10-24T00:17:02.626936] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T00:17:02.758363] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T00:17:03.199464] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-04.
[2025-10-24T00:17:03.999469] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-06.
[2025-10-24T00:17:04.518336] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-03 (2.12 seconds).
[2025-10-24T00:17:04.799421] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-04.
[2025-10-24T00:17:05.076662] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T00:17:05.096182] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T00:17:05.599474] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-07.
[2025-10-24T00:17:06.399438] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-05.
[2025-10-24T00:17:06.656957] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T00:17:07.105044] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-04 (2.31 seconds).
[2025-10-24T00:17:07.199433] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-05.
[2025-10-24T00:17:07.968023] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T00:17:07.999405] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-06.
[2025-10-24T00:17:08.285251] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T00:17:08.799550] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-08.
[2025-10-24T00:17:09.599425] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-05.
[2025-10-24T00:17:09.627553] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T00:17:09.728156] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-08 (0.93 seconds).
[2025-10-24T00:17:10.399500] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-09.
[2025-10-24T00:17:11.199435] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-06.
[2025-10-24T00:17:11.275268] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T00:17:11.831624] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-05 (2.23 seconds).
[2025-10-24T00:17:11.999416] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-06.
[2025-10-24T00:17:12.183944] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T00:17:12.799440] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-10.
[2025-10-24T00:17:13.599422] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-07.
[2025-10-24T00:17:13.624464] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T00:17:13.627272] [INFO ] [REMOTE    ] TYG: Full fetch complete (22118 records).
[2025-10-24T00:17:14.317027] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-06 (2.32 seconds).
[2025-10-24T00:17:14.404534] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-07.
[2025-10-24T00:17:14.899246] [INFO ] [REMOTE    ] UAA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:17:15.199423] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-07.
[2025-10-24T00:17:15.250069] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T00:17:15.999415] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-08.
[2025-10-24T00:17:16.341873] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T00:17:16.799422] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-08.
[2025-10-24T00:17:16.900376] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-07 (2.50 seconds).
[2025-10-24T00:17:17.599422] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-01.
[2025-10-24T00:17:17.943574] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T00:17:18.038307] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T00:17:18.399431] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-09.
[2025-10-24T00:17:19.063385] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T00:17:19.199444] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-08.
[2025-10-24T00:17:19.525331] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T00:17:19.999421] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-02.
[2025-10-24T00:17:20.799507] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-09.
[2025-10-24T00:17:21.599453] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-10.
[2025-10-24T00:17:21.728150] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-08 (2.53 seconds).
[2025-10-24T00:17:21.832830] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T00:17:22.399407] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-03.
[2025-10-24T00:17:22.730578] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T00:17:22.729907] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T00:17:22.745278] [INFO ] [REMOTE    ] TYL: Full fetch complete (31628 records).
[2025-10-24T00:17:23.214805] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-09.
[2025-10-24T00:17:24.000106] [INFO ] [REMOTE    ] UAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:17:24.000207] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-10.
[2025-10-24T00:17:24.799493] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-01.
[2025-10-24T00:17:25.545636] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T00:17:25.599431] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-02.
[2025-10-24T00:17:25.665678] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-09 (2.45 seconds).
[2025-10-24T00:17:25.836448] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-10 (1.84 seconds).
[2025-10-24T00:17:25.846756] [INFO ] [REMOTE    ] UA: Full fetch complete (73217 records).
[2025-10-24T00:17:26.108203] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-02 (0.51 seconds).
[2025-10-24T00:17:26.174595] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-03 (3.78 seconds).
[2025-10-24T00:17:26.424110] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-03.
[2025-10-24T00:17:27.134780] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T00:17:27.204547] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-10.
[2025-10-24T00:17:27.423134] [INFO ] [REMOTE    ] UBER: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:17:27.999476] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-01.
[2025-10-24T00:17:28.799485] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-04.
[2025-10-24T00:17:29.599484] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-04.
[2025-10-24T00:17:29.690213] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-10 (2.49 seconds).
[2025-10-24T00:17:29.699979] [INFO ] [REMOTE    ] U: Full fetch complete (77975 records).
[2025-10-24T00:17:30.423858] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T00:17:30.426632] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-05.
[2025-10-24T00:17:30.635111] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-01 (2.64 seconds).
[2025-10-24T00:17:30.935111] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-04 (2.14 seconds).
[2025-10-24T00:17:31.205400] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-05.
[2025-10-24T00:17:31.294707] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T00:17:31.298712] [INFO ] [REMOTE    ] UBS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:17:31.999421] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-06.
[2025-10-24T00:17:32.613928] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T00:17:32.799425] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-01.
[2025-10-24T00:17:33.143859] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-05 (1.94 seconds).
[2025-10-24T00:17:33.599512] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-07.
[2025-10-24T00:17:34.267056] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T00:17:34.399420] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-08.
[2025-10-24T00:17:35.058736] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T00:17:35.199567] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-06.
[2025-10-24T00:17:35.670369] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-01 (2.87 seconds).
[2025-10-24T00:17:35.999459] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-02.
[2025-10-24T00:17:36.799445] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-09.
[2025-10-24T00:17:36.980406] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T00:17:37.382967] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T00:17:37.599449] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-10.
[2025-10-24T00:17:37.739973] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T00:17:38.199294] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T00:17:38.200589] [INFO ] [REMOTE    ] UAN: Full fetch complete (7837 records).
[2025-10-24T00:17:38.406410] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-03.
[2025-10-24T00:17:39.137978] [INFO ] [REMOTE    ] UCB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:17:39.199412] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-01.
[2025-10-24T00:17:39.999431] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-07.
[2025-10-24T00:17:40.387309] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-03 (1.98 seconds).
[2025-10-24T00:17:40.682151] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T00:17:40.799422] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-02.
[2025-10-24T00:17:41.599427] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-02.
[2025-10-24T00:17:41.947553] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-07 (1.95 seconds).
[2025-10-24T00:17:42.079635] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T00:17:42.399483] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-08.
[2025-10-24T00:17:43.199437] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-03.
[2025-10-24T00:17:43.999416] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-04.
[2025-10-24T00:17:44.058874] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-02 (2.46 seconds).
[2025-10-24T00:17:44.157848] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T00:17:44.780327] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T00:17:44.799400] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-09.
[2025-10-24T00:17:45.599422] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-03.
[2025-10-24T00:17:45.941442] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-04 (1.94 seconds).
[2025-10-24T00:17:46.399430] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-04.
[2025-10-24T00:17:46.769030] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-09 (1.97 seconds).
[2025-10-24T00:17:47.199440] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-10.
[2025-10-24T00:17:47.999461] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-05.
[2025-10-24T00:17:48.047271] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-03 (2.45 seconds).
[2025-10-24T00:17:48.085463] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T00:17:48.799441] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-04.
[2025-10-24T00:17:49.166361] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T00:17:49.175744] [INFO ] [REMOTE    ] UAA: Full fetch complete (77643 records).
[2025-10-24T00:17:49.610200] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-05.
[2025-10-24T00:17:49.891724] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-05 (1.89 seconds).
[2025-10-24T00:17:50.404550] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-06.
[2025-10-24T00:17:50.671117] [INFO ] [REMOTE    ] UDR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:17:51.031997] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T00:17:51.070331] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-04 (2.27 seconds).
[2025-10-24T00:17:51.199415] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-06.
[2025-10-24T00:17:51.999428] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-01.
[2025-10-24T00:17:52.248265] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-06 (1.84 seconds).
[2025-10-24T00:17:52.501809] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T00:17:52.799453] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-07.
[2025-10-24T00:17:53.599460] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-07.
[2025-10-24T00:17:53.669213] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T00:17:54.399512] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-02.
[2025-10-24T00:17:54.716054] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T00:17:55.072591] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T00:17:55.199447] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-08.
[2025-10-24T00:17:55.999439] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-05.
[2025-10-24T00:17:56.107605] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T00:17:56.799412] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-08.
[2025-10-24T00:17:56.891482] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T00:17:57.599454] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-09.
[2025-10-24T00:17:58.261835] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T00:17:58.399447] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-09.
[2025-10-24T00:17:58.486239] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-05 (2.49 seconds).
[2025-10-24T00:17:59.199402] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-06.
[2025-10-24T00:17:59.457039] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-09 (1.86 seconds).
[2025-10-24T00:17:59.567297] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T00:17:59.999434] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-10.
[2025-10-24T00:18:00.799444] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-10.
[2025-10-24T00:18:01.441930] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T00:18:01.449253] [INFO ] [REMOTE    ] UCB: Full fetch complete (55069 records).
[2025-10-24T00:18:01.602689] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-03.
[2025-10-24T00:18:02.662747] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-06 (3.46 seconds).
[2025-10-24T00:18:02.784624] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-07.
[2025-10-24T00:18:02.896326] [INFO ] [REMOTE    ] UE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:18:02.923291] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-10 (2.12 seconds).
[2025-10-24T00:18:02.933235] [INFO ] [REMOTE    ] UBS: Full fetch complete (75955 records).
[2025-10-24T00:18:03.201346] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-01.
[2025-10-24T00:18:04.178817] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-03 (2.58 seconds).
[2025-10-24T00:18:04.249371] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-04.
[2025-10-24T00:18:04.429019] [INFO ] [REMOTE    ] UFI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:18:04.720235] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T00:18:04.799446] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-02.
[2025-10-24T00:18:05.599434] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-01.
[2025-10-24T00:18:06.210949] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-07 (3.43 seconds).
[2025-10-24T00:18:06.212390] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T00:18:06.399434] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-03.
[2025-10-24T00:18:07.180456] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-04 (2.93 seconds).
[2025-10-24T00:18:07.199454] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-05.
[2025-10-24T00:18:07.220897] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T00:18:08.004635] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-02.
[2025-10-24T00:18:08.020570] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T00:18:08.651389] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-02 (0.65 seconds).
[2025-10-24T00:18:08.799482] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-04.
[2025-10-24T00:18:08.898685] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T00:18:09.599435] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-03.
[2025-10-24T00:18:10.378353] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T00:18:10.399405] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-04.
[2025-10-24T00:18:10.439103] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T00:18:11.199434] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-08.
[2025-10-24T00:18:11.276818] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-04 (0.88 seconds).
[2025-10-24T00:18:11.999455] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-06.
[2025-10-24T00:18:12.799483] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-05.
[2025-10-24T00:18:13.571745] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-08 (2.37 seconds).
[2025-10-24T00:18:13.573277] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T00:18:13.599434] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-06.
[2025-10-24T00:18:13.655718] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T00:18:14.393810] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T00:18:14.399401] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-07.
[2025-10-24T00:18:15.144457] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T00:18:15.199460] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-09.
[2025-10-24T00:18:15.999436] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-05.
[2025-10-24T00:18:16.799486] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-07.
[2025-10-24T00:18:17.143968] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-09 (1.94 seconds).
[2025-10-24T00:18:17.540672] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T00:18:17.599463] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-06.
[2025-10-24T00:18:18.399422] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-08.
[2025-10-24T00:18:18.518384] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T00:18:18.839025] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T00:18:19.053215] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T00:18:19.199468] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-10.
[2025-10-24T00:18:19.999449] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-07.
[2025-10-24T00:18:20.799459] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-08.
[2025-10-24T00:18:21.599241] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T00:18:21.608566] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-09.
[2025-10-24T00:18:21.682890] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-10 (2.48 seconds).
[2025-10-24T00:18:21.692077] [INFO ] [REMOTE    ] UBER: Full fetch complete (77986 records).
[2025-10-24T00:18:22.333901] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T00:18:22.335899] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T00:18:22.403108] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-09.
[2025-10-24T00:18:23.214545] [INFO ] [REMOTE    ] UGI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:18:23.210029] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-10.
[2025-10-24T00:18:23.999411] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-01.
[2025-10-24T00:18:24.083222] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T00:18:24.085473] [INFO ] [REMOTE    ] UFI: Full fetch complete (12408 records).
[2025-10-24T00:18:24.433794] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-09 (2.03 seconds).
[2025-10-24T00:18:24.804567] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-10.
[2025-10-24T00:18:25.302586] [INFO ] [REMOTE    ] UGP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:18:25.599415] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-08.
[2025-10-24T00:18:25.876913] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T00:18:26.099429] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T00:18:26.108867] [INFO ] [REMOTE    ] UDR: Full fetch complete (75126 records).
[2025-10-24T00:18:26.404546] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-02.
[2025-10-24T00:18:27.201071] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-01.
[2025-10-24T00:18:27.381244] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T00:18:27.650744] [INFO ] [REMOTE    ] UHAL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:18:27.999521] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-01.
[2025-10-24T00:18:28.098209] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T00:18:28.735098] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T00:18:28.787786] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T00:18:28.799413] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-02.
[2025-10-24T00:18:29.599421] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-02.
[2025-10-24T00:18:29.711623] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T00:18:30.399457] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-09.
[2025-10-24T00:18:31.115629] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T00:18:31.199461] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-03.
[2025-10-24T00:18:31.999415] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-03.
[2025-10-24T00:18:32.187708] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T00:18:32.799411] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-10.
[2025-10-24T00:18:32.894602] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T00:18:33.599442] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-03.
[2025-10-24T00:18:33.630276] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T00:18:34.259687] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T00:18:34.266620] [INFO ] [REMOTE    ] UE: Full fetch complete (61049 records).
[2025-10-24T00:18:34.401198] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T00:18:34.400807] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-04.
[2025-10-24T00:18:35.204596] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-04.
[2025-10-24T00:18:35.697464] [INFO ] [REMOTE    ] UHS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:18:35.999447] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-04.
[2025-10-24T00:18:36.251820] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T00:18:36.439087] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-04 (2.04 seconds).
[2025-10-24T00:18:36.799445] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-05.
[2025-10-24T00:18:37.543108] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T00:18:37.599444] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-05.
[2025-10-24T00:18:37.758837] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-05 (0.96 seconds).
[2025-10-24T00:18:38.399418] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-06.
[2025-10-24T00:18:39.199422] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-05.
[2025-10-24T00:18:39.257866] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T00:18:39.396869] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T00:18:39.999491] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-06.
[2025-10-24T00:18:40.799435] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-07.
[2025-10-24T00:18:40.887932] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T00:18:41.599434] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-06.
[2025-10-24T00:18:41.638171] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T00:18:41.832983] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T00:18:42.399439] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-08.
[2025-10-24T00:18:42.992935] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T00:18:43.012697] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-08 (0.61 seconds).
[2025-10-24T00:18:43.199437] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-01.
[2025-10-24T00:18:43.999456] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-07.
[2025-10-24T00:18:44.685697] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T00:18:44.799411] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-07.
[2025-10-24T00:18:45.599433] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-09.
[2025-10-24T00:18:45.722381] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T00:18:46.399414] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-02.
[2025-10-24T00:18:46.569684] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T00:18:46.689633] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T00:18:47.199484] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-08.
[2025-10-24T00:18:47.979290] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T00:18:47.999407] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-03.
[2025-10-24T00:18:48.615149] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T00:18:48.799432] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-08.
[2025-10-24T00:18:49.599440] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-09.
[2025-10-24T00:18:49.693350] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T00:18:50.339708] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T00:18:50.399395] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-09.
[2025-10-24T00:18:51.199417] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-04.
[2025-10-24T00:18:51.300061] [DEBUG] [REMOTE    ] UHS: Error fetching primary data for 2025-04: 'API call returned an empty response.'
[2025-10-24T00:18:51.300361] [WARN ] [REMOTE    ] UHS: No data returned for month 2025-04
[2025-10-24T00:18:51.300453] [FATAL] [REMOTE    ] UHS: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:18:51.476808] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-09 (1.88 seconds).
[2025-10-24T00:18:52.003728] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-10.
[2025-10-24T00:18:52.067817] [INFO ] [REMOTE    ] UHT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:18:52.094206] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T00:18:52.799447] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-10.
[2025-10-24T00:18:53.081027] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T00:18:53.085058] [INFO ] [REMOTE    ] UHAL: Full fetch complete (23449 records).
[2025-10-24T00:18:53.604695] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-10.
[2025-10-24T00:18:54.312147] [INFO ] [REMOTE    ] UI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:18:54.331820] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T00:18:54.339493] [INFO ] [REMOTE    ] UGP: Full fetch complete (62261 records).
[2025-10-24T00:18:54.404506] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-01.
[2025-10-24T00:18:55.203247] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-01.
[2025-10-24T00:18:55.250611] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T00:18:55.278840] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T00:18:55.295884] [INFO ] [REMOTE    ] UGI: Full fetch complete (73444 records).
[2025-10-24T00:18:56.004035] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-02.
[2025-10-24T00:18:56.365366] [INFO ] [REMOTE    ] UIS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:18:56.365715] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T00:18:56.786144] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T00:18:56.804824] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-01.
[2025-10-24T00:18:57.329792] [INFO ] [REMOTE    ] UL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:18:57.599433] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-02.
[2025-10-24T00:18:58.214827] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T00:18:58.230169] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T00:18:58.399446] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-03.
[2025-10-24T00:18:59.199454] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-03.
[2025-10-24T00:18:59.232922] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T00:18:59.999432] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-04.
[2025-10-24T00:19:00.045386] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T00:19:00.799425] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-02.
[2025-10-24T00:19:01.000790] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T00:19:01.599428] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-04.
[2025-10-24T00:19:02.168847] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T00:19:02.399478] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-01.
[2025-10-24T00:19:02.502871] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-04 (0.90 seconds).
[2025-10-24T00:19:03.199443] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-05.
[2025-10-24T00:19:03.979140] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T00:19:03.999391] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-03.
[2025-10-24T00:19:04.150814] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T00:19:04.799444] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-02.
[2025-10-24T00:19:05.402563] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T00:19:05.599423] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-06.
[2025-10-24T00:19:06.399405] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-04.
[2025-10-24T00:19:06.417612] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T00:19:06.727592] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-02 (1.93 seconds).
[2025-10-24T00:19:07.199435] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-03.
[2025-10-24T00:19:07.777273] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-04 (1.38 seconds).
[2025-10-24T00:19:07.999422] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-05.
[2025-10-24T00:19:08.799431] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-05.
[2025-10-24T00:19:09.199576] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-03 (2.00 seconds).
[2025-10-24T00:19:09.232510] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T00:19:09.599435] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-07.
[2025-10-24T00:19:09.704966] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T00:19:10.399480] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-06.
[2025-10-24T00:19:10.414226] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T00:19:11.199439] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-04.
[2025-10-24T00:19:11.602968] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T00:19:11.999462] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-08.
[2025-10-24T00:19:12.799438] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-07.
[2025-10-24T00:19:12.813628] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T00:19:13.175838] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T00:19:13.599480] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-06.
[2025-10-24T00:19:14.265875] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T00:19:14.399416] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-08.
[2025-10-24T00:19:14.446271] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-06 (0.85 seconds).
[2025-10-24T00:19:15.199471] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-07.
[2025-10-24T00:19:15.929412] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T00:19:15.981756] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-07 (0.78 seconds).
[2025-10-24T00:19:15.999400] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-08.
[2025-10-24T00:19:16.799434] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-09.
[2025-10-24T00:19:17.085935] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T00:19:17.599445] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-09.
[2025-10-24T00:19:18.115236] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-09 (1.32 seconds).
[2025-10-24T00:19:18.363249] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T00:19:18.399398] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-10.
[2025-10-24T00:19:19.199412] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-10.
[2025-10-24T00:19:19.513124] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T00:19:19.516840] [INFO ] [REMOTE    ] UI: Full fetch complete (19800 records).
[2025-10-24T00:19:20.004587] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-09.
[2025-10-24T00:19:20.570880] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T00:19:20.663401] [INFO ] [REMOTE    ] UIS: Full fetch complete (52021 records).
[2025-10-24T00:19:20.806985] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-05.
[2025-10-24T00:19:20.861856] [INFO ] [REMOTE    ] ULS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:19:20.917355] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T00:19:21.605310] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-10.
[2025-10-24T00:19:22.284553] [INFO ] [REMOTE    ] UMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:19:22.311734] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T00:19:22.314682] [INFO ] [REMOTE    ] UHT: Full fetch complete (15055 records).
[2025-10-24T00:19:22.402585] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-01.
[2025-10-24T00:19:22.844895] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-05 (2.04 seconds).
[2025-10-24T00:19:23.205841] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-06.
[2025-10-24T00:19:23.592000] [INFO ] [REMOTE    ] UMH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:19:23.679722] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T00:19:23.999445] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-02.
[2025-10-24T00:19:24.799407] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-01.
[2025-10-24T00:19:25.136867] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-06 (1.93 seconds).
[2025-10-24T00:19:25.251946] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T00:19:25.599436] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-01.
[2025-10-24T00:19:26.399407] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-03.
[2025-10-24T00:19:26.737393] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-01 (1.94 seconds).
[2025-10-24T00:19:26.803505] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T00:19:27.199485] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-07.
[2025-10-24T00:19:27.874981] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T00:19:27.999441] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-04.
[2025-10-24T00:19:28.799503] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-02.
[2025-10-24T00:19:29.154478] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-07 (1.95 seconds).
[2025-10-24T00:19:29.196430] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T00:19:29.599503] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-05.
[2025-10-24T00:19:29.941866] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T00:19:30.399495] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-03.
[2025-10-24T00:19:30.851914] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T00:19:31.199476] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-06.
[2025-10-24T00:19:31.731600] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T00:19:31.999479] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-04.
[2025-10-24T00:19:32.437354] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T00:19:32.799464] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-08.
[2025-10-24T00:19:33.544977] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T00:19:33.599397] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-05.
[2025-10-24T00:19:34.399466] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-07.
[2025-10-24T00:19:34.706305] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T00:19:34.850299] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T00:19:35.199443] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-06.
[2025-10-24T00:19:35.841108] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T00:19:35.999434] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-09.
[2025-10-24T00:19:36.549044] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T00:19:36.799439] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-08.
[2025-10-24T00:19:37.599419] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-07.
[2025-10-24T00:19:37.813281] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T00:19:37.978430] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T00:19:38.399487] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-02.
[2025-10-24T00:19:39.001468] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T00:19:39.199439] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-08.
[2025-10-24T00:19:40.002322] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-10.
[2025-10-24T00:19:40.004049] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T00:19:40.575944] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T00:19:40.799449] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-03.
[2025-10-24T00:19:41.599439] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-09.
[2025-10-24T00:19:41.892249] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T00:19:41.901416] [INFO ] [REMOTE    ] UL: Full fetch complete (77082 records).
[2025-10-24T00:19:42.403522] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-09.
[2025-10-24T00:19:42.768565] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T00:19:43.184953] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T00:19:43.207524] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-04.
[2025-10-24T00:19:43.419549] [INFO ] [REMOTE    ] UNF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:19:43.916327] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T00:19:43.999462] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-10.
[2025-10-24T00:19:44.799421] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-01.
[2025-10-24T00:19:45.208153] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-04 (2.00 seconds).
[2025-10-24T00:19:45.358790] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T00:19:45.365106] [INFO ] [REMOTE    ] ULS: Full fetch complete (53794 records).
[2025-10-24T00:19:45.605548] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-05.
[2025-10-24T00:19:45.885798] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T00:19:46.407060] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-10.
[2025-10-24T00:19:46.804110] [INFO ] [REMOTE    ] UNFI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:19:47.199428] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-01.
[2025-10-24T00:19:47.424044] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T00:19:47.927173] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T00:19:47.934208] [INFO ] [REMOTE    ] UMH: Full fetch complete (47448 records).
[2025-10-24T00:19:48.007740] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-06.
[2025-10-24T00:19:48.671497] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T00:19:48.808127] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-02.
[2025-10-24T00:19:49.321214] [INFO ] [REMOTE    ] UNH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:19:49.599433] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-02.
[2025-10-24T00:19:49.684226] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T00:19:49.764851] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T00:19:50.399470] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-01.
[2025-10-24T00:19:50.847228] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T00:19:51.199438] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-03.
[2025-10-24T00:19:51.999444] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-07.
[2025-10-24T00:19:52.600083] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-01 (2.20 seconds).
[2025-10-24T00:19:52.799433] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-02.
[2025-10-24T00:19:52.824912] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T00:19:53.599451] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-04.
[2025-10-24T00:19:53.806733] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T00:19:54.399442] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-08.
[2025-10-24T00:19:55.112204] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-02 (2.31 seconds).
[2025-10-24T00:19:55.194595] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T00:19:55.202336] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-03.
[2025-10-24T00:19:55.999405] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-05.
[2025-10-24T00:19:56.176926] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T00:19:56.211465] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T00:19:56.799435] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-04.
[2025-10-24T00:19:57.248787] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T00:19:57.599420] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-09.
[2025-10-24T00:19:57.807259] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T00:19:58.399440] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-05.
[2025-10-24T00:19:59.119541] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T00:19:59.187343] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T00:19:59.199397] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-06.
[2025-10-24T00:19:59.999441] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-10.
[2025-10-24T00:20:00.799431] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-03.
[2025-10-24T00:20:00.879853] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T00:20:01.599433] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-06.
[2025-10-24T00:20:02.028310] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-10 (2.03 seconds).
[2025-10-24T00:20:02.039741] [INFO ] [REMOTE    ] UMC: Full fetch complete (76662 records).
[2025-10-24T00:20:02.408086] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-07.
[2025-10-24T00:20:02.606484] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T00:20:03.226364] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-07.
[2025-10-24T00:20:03.437455] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-03 (2.64 seconds).
[2025-10-24T00:20:03.632237] [INFO ] [REMOTE    ] UNM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:20:03.999439] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-04.
[2025-10-24T00:20:04.249107] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T00:20:04.250727] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T00:20:04.799463] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-08.
[2025-10-24T00:20:05.552838] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T00:20:05.599403] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-09.
[2025-10-24T00:20:06.399412] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-08.
[2025-10-24T00:20:06.602745] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-04 (2.60 seconds).
[2025-10-24T00:20:06.603621] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T00:20:07.199488] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-10.
[2025-10-24T00:20:07.890522] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T00:20:07.999453] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-05.
[2025-10-24T00:20:08.194193] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T00:20:08.198834] [INFO ] [REMOTE    ] UNF: Full fetch complete (18100 records).
[2025-10-24T00:20:08.804632] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-01.
[2025-10-24T00:20:09.457434] [INFO ] [REMOTE    ] UNMA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:20:09.599419] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-01.
[2025-10-24T00:20:10.116425] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-01 (0.52 seconds).
[2025-10-24T00:20:10.405207] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-09.
[2025-10-24T00:20:10.421733] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T00:20:10.877399] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-05 (2.88 seconds).
[2025-10-24T00:20:11.199479] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-02.
[2025-10-24T00:20:12.006531] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-06.
[2025-10-24T00:20:12.024948] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T00:20:12.491453] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T00:20:12.799471] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-10.
[2025-10-24T00:20:13.599447] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-03.
[2025-10-24T00:20:14.383066] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T00:20:14.391105] [INFO ] [REMOTE    ] UNFI: Full fetch complete (59887 records).
[2025-10-24T00:20:14.424028] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-02.
[2025-10-24T00:20:14.836445] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-06 (2.83 seconds).
[2025-10-24T00:20:15.101032] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-02 (0.68 seconds).
[2025-10-24T00:20:15.202728] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-03.
[2025-10-24T00:20:15.344842] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T00:20:15.895924] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T00:20:15.973981] [INFO ] [REMOTE    ] UNP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:20:15.999409] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-01.
[2025-10-24T00:20:16.799451] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-04.
[2025-10-24T00:20:17.356793] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T00:20:17.599424] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-07.
[2025-10-24T00:20:17.829167] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T00:20:18.399412] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-04.
[2025-10-24T00:20:19.199445] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-05.
[2025-10-24T00:20:19.751829] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T00:20:19.999400] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-06.
[2025-10-24T00:20:20.209403] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T00:20:20.299610] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-07 (2.70 seconds).
[2025-10-24T00:20:20.571473] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T00:20:20.799469] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-05.
[2025-10-24T00:20:21.599521] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-02.
[2025-10-24T00:20:22.399412] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-07.
[2025-10-24T00:20:22.511476] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T00:20:22.764501] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-07 (0.37 seconds).
[2025-10-24T00:20:23.199424] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-06.
[2025-10-24T00:20:23.316508] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T00:20:23.999411] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-08.
[2025-10-24T00:20:24.534007] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-08 (0.53 seconds).
[2025-10-24T00:20:24.799422] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-03.
[2025-10-24T00:20:24.856020] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T00:20:25.599447] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-08.
[2025-10-24T00:20:26.399457] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-09.
[2025-10-24T00:20:26.451882] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T00:20:26.900947] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-09 (0.50 seconds).
[2025-10-24T00:20:27.199491] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-04.
[2025-10-24T00:20:27.999426] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-10.
[2025-10-24T00:20:28.177468] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-08 (2.58 seconds).
[2025-10-24T00:20:28.562026] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-10 (0.56 seconds).
[2025-10-24T00:20:28.563294] [INFO ] [REMOTE    ] UNMA: Full fetch complete (5412 records).
[2025-10-24T00:20:28.799417] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-09.
[2025-10-24T00:20:29.509297] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-04 (2.31 seconds).
[2025-10-24T00:20:29.602629] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-05.
[2025-10-24T00:20:29.818104] [INFO ] [REMOTE    ] UP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:20:30.399512] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-07.
[2025-10-24T00:20:31.199504] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-01.
[2025-10-24T00:20:32.067419] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-09 (3.27 seconds).
[2025-10-24T00:20:32.068450] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-05 (2.47 seconds).
[2025-10-24T00:20:32.090807] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-10.
[2025-10-24T00:20:32.124176] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T00:20:32.715064] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T00:20:32.799435] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-02.
[2025-10-24T00:20:33.599457] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-06.
[2025-10-24T00:20:34.115211] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T00:20:34.399454] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-08.
[2025-10-24T00:20:34.551439] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-10 (2.46 seconds).
[2025-10-24T00:20:34.560900] [INFO ] [REMOTE    ] UNH: Full fetch complete (77960 records).
[2025-10-24T00:20:35.223861] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T00:20:35.217480] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-03.
[2025-10-24T00:20:36.003418] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-07.
[2025-10-24T00:20:36.114855] [INFO ] [REMOTE    ] UPS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:20:36.142840] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T00:20:36.808121] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-09.
[2025-10-24T00:20:36.826976] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T00:20:37.599478] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-01.
[2025-10-24T00:20:37.977128] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-07 (1.97 seconds).
[2025-10-24T00:20:38.399430] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-08.
[2025-10-24T00:20:38.492409] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T00:20:39.199473] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-10.
[2025-10-24T00:20:39.632558] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-01 (2.03 seconds).
[2025-10-24T00:20:39.999430] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-02.
[2025-10-24T00:20:40.301563] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-08 (1.90 seconds).
[2025-10-24T00:20:40.800866] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-09.
[2025-10-24T00:20:40.803330] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T00:20:40.811808] [INFO ] [REMOTE    ] UNM: Full fetch complete (69947 records).
[2025-10-24T00:20:41.604549] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-04.
[2025-10-24T00:20:42.272372] [INFO ] [REMOTE    ] URI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:20:42.275096] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-02 (2.28 seconds).
[2025-10-24T00:20:42.399415] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-01.
[2025-10-24T00:20:42.767254] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-09 (1.97 seconds).
[2025-10-24T00:20:43.204602] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-03.
[2025-10-24T00:20:43.221271] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T00:20:43.660878] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-01 (1.26 seconds).
[2025-10-24T00:20:43.999437] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-05.
[2025-10-24T00:20:44.799454] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-10.
[2025-10-24T00:20:45.338945] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-03 (2.13 seconds).
[2025-10-24T00:20:45.583715] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T00:20:45.599397] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-06.
[2025-10-24T00:20:46.399441] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-02.
[2025-10-24T00:20:46.670104] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T00:20:46.679567] [INFO ] [REMOTE    ] UNP: Full fetch complete (77146 records).
[2025-10-24T00:20:47.093787] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T00:20:47.219411] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-07.
[2025-10-24T00:20:47.666020] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T00:20:48.004588] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-03.
[2025-10-24T00:20:48.241166] [INFO ] [REMOTE    ] USA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:20:48.789874] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T00:20:48.799527] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-08.
[2025-10-24T00:20:49.599426] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-04.
[2025-10-24T00:20:49.842288] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T00:20:50.399409] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-01.
[2025-10-24T00:20:50.469330] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T00:20:51.199433] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-04.
[2025-10-24T00:20:51.715309] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-04 (2.12 seconds).
[2025-10-24T00:20:51.870287] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T00:20:51.999438] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-05.
[2025-10-24T00:20:52.799431] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-02.
[2025-10-24T00:20:52.890396] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T00:20:53.599452] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-05.
[2025-10-24T00:20:53.976505] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T00:20:54.087067] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-05 (2.09 seconds).
[2025-10-24T00:20:54.399432] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-09.
[2025-10-24T00:20:54.797219] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-05 (1.20 seconds).
[2025-10-24T00:20:55.199433] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-06.
[2025-10-24T00:20:55.999418] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-06.
[2025-10-24T00:20:56.513483] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-09 (2.11 seconds).
[2025-10-24T00:20:56.623775] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T00:20:56.799438] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-10.
[2025-10-24T00:20:57.599480] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-03.
[2025-10-24T00:20:57.834788] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-06 (1.84 seconds).
[2025-10-24T00:20:58.399468] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-07.
[2025-10-24T00:20:58.827790] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-03 (1.23 seconds).
[2025-10-24T00:20:58.860327] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-10 (2.06 seconds).
[2025-10-24T00:20:58.869137] [INFO ] [REMOTE    ] UP: Full fetch complete (63044 records).
[2025-10-24T00:20:59.209296] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-04.
[2025-10-24T00:21:00.004569] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-07.
[2025-10-24T00:21:00.268292] [INFO ] [REMOTE    ] USAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:21:00.670528] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T00:21:00.744122] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-07 (2.34 seconds).
[2025-10-24T00:21:00.799398] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-05.
[2025-10-24T00:21:01.319241] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T00:21:01.599438] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-08.
[2025-10-24T00:21:02.299298] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T00:21:02.399463] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-08.
[2025-10-24T00:21:03.199442] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-06.
[2025-10-24T00:21:03.676100] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-08 (2.08 seconds).
[2025-10-24T00:21:03.834910] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T00:21:03.999395] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-09.
[2025-10-24T00:21:04.506591] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T00:21:04.799510] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-07.
[2025-10-24T00:21:05.490754] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T00:21:05.599446] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-10.
[2025-10-24T00:21:06.253463] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T00:21:06.399445] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-08.
[2025-10-24T00:21:06.705400] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T00:21:06.710886] [INFO ] [REMOTE    ] URI: Full fetch complete (52702 records).
[2025-10-24T00:21:07.208976] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-09.
[2025-10-24T00:21:07.605206] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T00:21:08.004726] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-01.
[2025-10-24T00:21:08.215818] [INFO ] [REMOTE    ] USB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:21:08.799464] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-01.
[2025-10-24T00:21:09.387975] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T00:21:09.469065] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-09 (2.26 seconds).
[2025-10-24T00:21:09.599461] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-02.
[2025-10-24T00:21:10.399436] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-09.
[2025-10-24T00:21:10.632712] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T00:21:10.871014] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T00:21:11.199442] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-10.
[2025-10-24T00:21:11.882999] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T00:21:11.999453] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-02.
[2025-10-24T00:21:12.799467] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-03.
[2025-10-24T00:21:13.380275] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-10 (2.18 seconds).
[2025-10-24T00:21:13.390215] [INFO ] [REMOTE    ] UPS: Full fetch complete (77880 records).
[2025-10-24T00:21:13.563500] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T00:21:13.613753] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-10.
[2025-10-24T00:21:14.077363] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T00:21:14.408119] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-03.
[2025-10-24T00:21:14.958593] [INFO ] [REMOTE    ] USFD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:21:15.199428] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-01.
[2025-10-24T00:21:15.247195] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T00:21:15.254273] [INFO ] [REMOTE    ] USA: Full fetch complete (52532 records).
[2025-10-24T00:21:16.010312] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-04.
[2025-10-24T00:21:16.566495] [INFO ] [REMOTE    ] USNA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:21:16.612446] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T00:21:16.634851] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-03 (2.23 seconds).
[2025-10-24T00:21:16.799408] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-04.
[2025-10-24T00:21:17.169992] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-04 (1.16 seconds).
[2025-10-24T00:21:17.599513] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-05.
[2025-10-24T00:21:18.399428] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-01.
[2025-10-24T00:21:18.763146] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T00:21:18.793220] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T00:21:19.141123] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T00:21:19.199418] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-02.
[2025-10-24T00:21:19.999413] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-06.
[2025-10-24T00:21:20.245405] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T00:21:20.799433] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-02.
[2025-10-24T00:21:21.082397] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T00:21:21.599432] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-03.
[2025-10-24T00:21:22.400710] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-05.
[2025-10-24T00:21:22.418170] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T00:21:22.717212] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T00:21:23.199481] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-07.
[2025-10-24T00:21:23.999482] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-04.
[2025-10-24T00:21:24.252676] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T00:21:24.390601] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-05 (1.99 seconds).
[2025-10-24T00:21:24.799470] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-08.
[2025-10-24T00:21:25.072180] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T00:21:25.599418] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-06.
[2025-10-24T00:21:25.797400] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T00:21:26.399467] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-05.
[2025-10-24T00:21:27.199416] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-09.
[2025-10-24T00:21:27.248640] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T00:21:27.485229] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T00:21:27.999418] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-06.
[2025-10-24T00:21:28.311704] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T00:21:28.799452] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-03.
[2025-10-24T00:21:28.980035] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T00:21:29.599467] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-07.
[2025-10-24T00:21:30.168416] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T00:21:30.399493] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-07.
[2025-10-24T00:21:31.095312] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T00:21:31.128115] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-07 (0.73 seconds).
[2025-10-24T00:21:31.199445] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-08.
[2025-10-24T00:21:31.999442] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-08.
[2025-10-24T00:21:32.641194] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-08 (0.64 seconds).
[2025-10-24T00:21:32.799457] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-09.
[2025-10-24T00:21:32.945718] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T00:21:33.599429] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-09.
[2025-10-24T00:21:33.684790] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T00:21:34.399442] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-10.
[2025-10-24T00:21:35.199427] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-10.
[2025-10-24T00:21:35.413247] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T00:21:35.417168] [INFO ] [REMOTE    ] USAC: Full fetch complete (35291 records).
[2025-10-24T00:21:35.606484] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-09 (2.01 seconds).
[2025-10-24T00:21:36.004532] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-10.
[2025-10-24T00:21:36.093074] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T00:21:36.132377] [INFO ] [REMOTE    ] USNA: Full fetch complete (27221 records).
[2025-10-24T00:21:36.810792] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-04.
[2025-10-24T00:21:37.224056] [INFO ] [REMOTE    ] USPH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:21:37.620367] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-01.
[2025-10-24T00:21:37.947744] [INFO ] [REMOTE    ] UTF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:21:37.972154] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T00:21:37.981328] [INFO ] [REMOTE    ] USB: Full fetch complete (77867 records).
[2025-10-24T00:21:38.424872] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-01.
[2025-10-24T00:21:38.623262] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T00:21:38.742407] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T00:21:39.204686] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-05.
[2025-10-24T00:21:39.284595] [INFO ] [REMOTE    ] UTI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:21:39.422594] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T00:21:39.999444] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-02.
[2025-10-24T00:21:40.799421] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-01.
[2025-10-24T00:21:40.898267] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T00:21:40.976378] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-05 (1.77 seconds).
[2025-10-24T00:21:41.599438] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-06.
[2025-10-24T00:21:42.297874] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T00:21:42.399430] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-02.
[2025-10-24T00:21:43.183067] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T00:21:43.199407] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-07.
[2025-10-24T00:21:43.864075] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T00:21:43.999433] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-03.
[2025-10-24T00:21:44.799469] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-03.
[2025-10-24T00:21:44.850755] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T00:21:45.475678] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T00:21:45.599450] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-02.
[2025-10-24T00:21:45.834236] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T00:21:46.399442] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-04.
[2025-10-24T00:21:46.800591] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T00:21:47.199470] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-08.
[2025-10-24T00:21:47.506868] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T00:21:47.999445] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-03.
[2025-10-24T00:21:48.799402] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-04.
[2025-10-24T00:21:48.905236] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T00:21:49.284517] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T00:21:49.599431] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-04.
[2025-10-24T00:21:50.107758] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-04 (1.31 seconds).
[2025-10-24T00:21:50.399437] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-05.
[2025-10-24T00:21:51.025829] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T00:21:51.199444] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-05.
[2025-10-24T00:21:51.405920] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T00:21:51.999447] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-06.
[2025-10-24T00:21:52.721628] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T00:21:52.799409] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-05.
[2025-10-24T00:21:53.004845] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T00:21:53.599454] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-09.
[2025-10-24T00:21:53.875873] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T00:21:54.399457] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-07.
[2025-10-24T00:21:55.199425] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-06.
[2025-10-24T00:21:55.254236] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T00:21:55.454093] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T00:21:55.999420] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-08.
[2025-10-24T00:21:56.068138] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T00:21:56.799419] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-10.
[2025-10-24T00:21:56.985577] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T00:21:57.599432] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-07.
[2025-10-24T00:21:58.399428] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-06.
[2025-10-24T00:21:58.560818] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T00:21:58.569720] [INFO ] [REMOTE    ] USFD: Full fetch complete (74341 records).
[2025-10-24T00:21:58.880620] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T00:21:59.202694] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-08.
[2025-10-24T00:21:59.911622] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T00:21:59.999406] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-07.
[2025-10-24T00:22:00.323234] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T00:22:00.799442] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-09.
[2025-10-24T00:22:01.463288] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T00:22:01.599438] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-09.
[2025-10-24T00:22:02.253248] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T00:22:02.399448] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-10.
[2025-10-24T00:22:02.572336] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T00:22:03.199476] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-08.
[2025-10-24T00:22:03.999848] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-10.
[2025-10-24T00:22:04.002515] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T00:22:04.010889] [INFO ] [REMOTE    ] UTF: Full fetch complete (43927 records).
[2025-10-24T00:22:04.718672] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T00:22:04.799462] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-09.
[2025-10-24T00:22:05.038250] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T00:22:05.041569] [INFO ] [REMOTE    ] USPH: Full fetch complete (22972 records).
[2025-10-24T00:22:06.328453] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T00:22:06.337041] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-10.
[2025-10-24T00:22:07.855024] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T00:22:07.861772] [INFO ] [REMOTE    ] UTI: Full fetch complete (58946 records).
[2025-10-24T00:22:11.220015] [INFO ] [REMOTE    ] UTL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:22:11.341635] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-01.
[2025-10-24T00:22:11.375142] [INFO ] [REMOTE    ] UVV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:22:11.380284] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-01.
[2025-10-24T00:22:11.416070] [INFO ] [REMOTE    ] UVE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:22:11.464677] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-01.
[2025-10-24T00:22:11.496480] [INFO ] [REMOTE    ] UTZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:22:11.497058] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-01.
[2025-10-24T00:22:12.187620] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T00:22:12.190758] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-02.
[2025-10-24T00:22:12.268188] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T00:22:12.272031] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-02.
[2025-10-24T00:22:12.474569] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T00:22:12.478583] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-02.
[2025-10-24T00:22:12.818903] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T00:22:12.827792] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-02.
[2025-10-24T00:22:12.957796] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T00:22:12.960191] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-03.
[2025-10-24T00:22:13.287933] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T00:22:13.433123] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T00:22:13.599446] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-03.
[2025-10-24T00:22:13.719687] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T00:22:13.934206] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T00:22:14.399423] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-03.
[2025-10-24T00:22:14.689998] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T00:22:15.199422] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-04.
[2025-10-24T00:22:15.446315] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T00:22:15.999418] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-04.
[2025-10-24T00:22:16.014318] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T00:22:16.799497] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-04.
[2025-10-24T00:22:17.178881] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-04 (1.18 seconds).
[2025-10-24T00:22:17.599516] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-03.
[2025-10-24T00:22:17.888028] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T00:22:18.399487] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-05.
[2025-10-24T00:22:19.192843] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T00:22:19.201825] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-05.
[2025-10-24T00:22:19.209385] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T00:22:19.999473] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-04.
[2025-10-24T00:22:20.476295] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-05 (1.27 seconds).
[2025-10-24T00:22:20.799488] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-05.
[2025-10-24T00:22:21.599498] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-06.
[2025-10-24T00:22:21.641687] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T00:22:21.698740] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T00:22:22.367365] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T00:22:22.399430] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-07.
[2025-10-24T00:22:23.196464] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T00:22:23.199388] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-08.
[2025-10-24T00:22:23.999465] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-06.
[2025-10-24T00:22:24.219446] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T00:22:24.799422] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-05.
[2025-10-24T00:22:25.108317] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T00:22:25.599430] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-09.
[2025-10-24T00:22:26.399416] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-07.
[2025-10-24T00:22:26.418368] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T00:22:26.609139] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T00:22:27.199501] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-10.
[2025-10-24T00:22:27.759333] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T00:22:27.999480] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-06.
[2025-10-24T00:22:28.127275] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-10 (0.93 seconds).
[2025-10-24T00:22:28.131355] [INFO ] [REMOTE    ] UTL: Full fetch complete (15852 records).
[2025-10-24T00:22:28.804736] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-08.
[2025-10-24T00:22:29.286786] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T00:22:29.346340] [INFO ] [REMOTE    ] UWMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:22:29.599477] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-06.
[2025-10-24T00:22:29.934435] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T00:22:30.399502] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-01.
[2025-10-24T00:22:31.207381] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-09.
[2025-10-24T00:22:31.212416] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T00:22:31.715359] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T00:22:31.999427] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-02.
[2025-10-24T00:22:32.302123] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T00:22:32.799462] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-10.
[2025-10-24T00:22:33.366668] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T00:22:33.599451] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-07.
[2025-10-24T00:22:33.857990] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T00:22:33.861674] [INFO ] [REMOTE    ] UVV: Full fetch complete (30204 records).
[2025-10-24T00:22:34.409110] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-07.
[2025-10-24T00:22:35.073696] [INFO ] [REMOTE    ] UZD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:22:35.199460] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-03.
[2025-10-24T00:22:35.266541] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T00:22:35.804353] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T00:22:35.999414] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-08.
[2025-10-24T00:22:36.764855] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T00:22:36.799395] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-04.
[2025-10-24T00:22:37.042399] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T00:22:37.599454] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-09.
[2025-10-24T00:22:38.399395] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-08.
[2025-10-24T00:22:38.507712] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T00:22:38.580590] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T00:22:39.199439] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-10.
[2025-10-24T00:22:39.886197] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T00:22:39.999404] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-09.
[2025-10-24T00:22:40.241509] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T00:22:40.245447] [INFO ] [REMOTE    ] UVE: Full fetch complete (30330 records).
[2025-10-24T00:22:40.808272] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-05.
[2025-10-24T00:22:41.452423] [INFO ] [REMOTE    ] UZE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:22:41.564385] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T00:22:41.599395] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-10.
[2025-10-24T00:22:42.399441] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-01.
[2025-10-24T00:22:42.737406] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T00:22:42.824997] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-01 (0.43 seconds).
[2025-10-24T00:22:43.100164] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T00:22:43.107530] [INFO ] [REMOTE    ] UTZ: Full fetch complete (64441 records).
[2025-10-24T00:22:43.204899] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-06.
[2025-10-24T00:22:44.004527] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-01.
[2025-10-24T00:22:44.290852] [INFO ] [REMOTE    ] UZF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:22:44.766243] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T00:22:44.799422] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-02.
[2025-10-24T00:22:44.961042] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T00:22:45.411222] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T00:22:45.599421] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-07.
[2025-10-24T00:22:46.399491] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-01.
[2025-10-24T00:22:47.018901] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T00:22:47.199455] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-02.
[2025-10-24T00:22:47.355574] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T00:22:47.591154] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-02 (0.39 seconds).
[2025-10-24T00:22:47.999437] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-03.
[2025-10-24T00:22:48.633804] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-03 (0.63 seconds).
[2025-10-24T00:22:48.799419] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-04.
[2025-10-24T00:22:49.586633] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T00:22:49.599397] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-02.
[2025-10-24T00:22:50.233878] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T00:22:50.399449] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-03.
[2025-10-24T00:22:51.117897] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T00:22:51.199428] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-04.
[2025-10-24T00:22:51.925916] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T00:22:51.999438] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-05.
[2025-10-24T00:22:52.706966] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T00:22:52.799430] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-05.
[2025-10-24T00:22:53.417475] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T00:22:53.599424] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-06.
[2025-10-24T00:22:54.284473] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T00:22:54.399435] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-06.
[2025-10-24T00:22:55.025570] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T00:22:55.199435] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-08.
[2025-10-24T00:22:55.999440] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-03.
[2025-10-24T00:22:56.797244] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T00:22:56.799499] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-07.
[2025-10-24T00:22:57.014958] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T00:22:57.400660] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T00:22:57.599457] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-04.
[2025-10-24T00:22:58.164155] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T00:22:58.399438] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-08.
[2025-10-24T00:22:59.199434] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-09.
[2025-10-24T00:22:59.999477] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-07.
[2025-10-24T00:23:00.799512] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-05.
[2025-10-24T00:23:04.486563] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-07 (4.49 seconds).
[2025-10-24T00:23:04.488128] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-08.
[2025-10-24T00:23:04.526115] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-08 (6.13 seconds).
[2025-10-24T00:23:04.529733] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-09.
[2025-10-24T00:23:04.677680] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-05 (3.88 seconds).
[2025-10-24T00:23:04.679761] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-06.
[2025-10-24T00:23:05.029484] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-09 (0.50 seconds).
[2025-10-24T00:23:05.031501] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-10.
[2025-10-24T00:23:05.310359] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T00:23:05.313734] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-09.
[2025-10-24T00:23:05.378817] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T00:23:05.599469] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-07.
[2025-10-24T00:23:05.619893] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T00:23:05.621662] [INFO ] [REMOTE    ] UZE: Full fetch complete (9743 records).
[2025-10-24T00:23:05.932953] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-07 (0.33 seconds).
[2025-10-24T00:23:06.012999] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T00:23:06.099412] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-09 (6.90 seconds).
[2025-10-24T00:23:06.404743] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-10.
[2025-10-24T00:23:06.902708] [INFO ] [REMOTE    ] V: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:23:06.970832] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-10 (0.57 seconds).
[2025-10-24T00:23:06.972252] [INFO ] [REMOTE    ] UZD: Full fetch complete (8823 records).
[2025-10-24T00:23:07.204624] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-08.
[2025-10-24T00:23:08.006125] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-01.
[2025-10-24T00:23:08.150524] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-08 (0.95 seconds).
[2025-10-24T00:23:08.206905] [INFO ] [REMOTE    ] VAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:23:08.799455] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-01.
[2025-10-24T00:23:09.599424] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-09.
[2025-10-24T00:23:10.013432] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T00:23:10.113260] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-09 (0.51 seconds).
[2025-10-24T00:23:10.245767] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-01 (2.24 seconds).
[2025-10-24T00:23:10.399432] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-02.
[2025-10-24T00:23:11.199448] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-10.
[2025-10-24T00:23:11.433021] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T00:23:11.999492] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-10.
[2025-10-24T00:23:12.485200] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T00:23:12.486306] [INFO ] [REMOTE    ] UZF: Full fetch complete (8324 records).
[2025-10-24T00:23:12.807276] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-03.
[2025-10-24T00:23:12.870113] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T00:23:12.879793] [INFO ] [REMOTE    ] UWMC: Full fetch complete (75931 records).
[2025-10-24T00:23:13.650437] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-02.
[2025-10-24T00:23:14.108570] [INFO ] [REMOTE    ] VAL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:23:14.399898] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-01.
[2025-10-24T00:23:14.401515] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T00:23:14.987794] [INFO ] [REMOTE    ] VALE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:23:15.199456] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-01.
[2025-10-24T00:23:15.532831] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-02 (1.88 seconds).
[2025-10-24T00:23:15.679106] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T00:23:15.999493] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-02.
[2025-10-24T00:23:16.799459] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-04.
[2025-10-24T00:23:17.387526] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-01 (2.19 seconds).
[2025-10-24T00:23:17.424077] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T00:23:17.599407] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-03.
[2025-10-24T00:23:17.926751] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T00:23:18.399439] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-02.
[2025-10-24T00:23:19.199439] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-05.
[2025-10-24T00:23:19.321435] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T00:23:19.999463] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-03.
[2025-10-24T00:23:20.385622] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-02 (1.99 seconds).
[2025-10-24T00:23:20.766093] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T00:23:20.799449] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-03.
[2025-10-24T00:23:21.599446] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-06.
[2025-10-24T00:23:22.256531] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-03 (2.26 seconds).
[2025-10-24T00:23:22.399415] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-04.
[2025-10-24T00:23:22.943503] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T00:23:22.993358] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-03 (2.19 seconds).
[2025-10-24T00:23:23.199490] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-04.
[2025-10-24T00:23:23.999464] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-04.
[2025-10-24T00:23:24.635209] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-04 (2.24 seconds).
[2025-10-24T00:23:24.799422] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-07.
[2025-10-24T00:23:25.038705] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T00:23:25.599511] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-05.
[2025-10-24T00:23:25.784016] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T00:23:26.254520] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T00:23:26.399503] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-08.
[2025-10-24T00:23:26.898247] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T00:23:27.199465] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-05.
[2025-10-24T00:23:27.756312] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T00:23:27.999408] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-05.
[2025-10-24T00:23:28.799457] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-06.
[2025-10-24T00:23:29.430200] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-05 (2.23 seconds).
[2025-10-24T00:23:29.599407] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-06.
[2025-10-24T00:23:30.021594] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-05 (2.02 seconds).
[2025-10-24T00:23:30.399427] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-09.
[2025-10-24T00:23:30.524688] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T00:23:31.199454] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-07.
[2025-10-24T00:23:31.750414] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T00:23:31.860109] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-06 (2.26 seconds).
[2025-10-24T00:23:31.999438] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-07.
[2025-10-24T00:23:32.799424] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-06.
[2025-10-24T00:23:32.920797] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T00:23:33.599434] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-08.
[2025-10-24T00:23:34.068108] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-07 (2.07 seconds).
[2025-10-24T00:23:34.399460] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-10.
[2025-10-24T00:23:34.848552] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-06 (2.05 seconds).
[2025-10-24T00:23:35.204561] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-07.
[2025-10-24T00:23:35.228532] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T00:23:35.608285] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T00:23:35.614063] [INFO ] [REMOTE    ] VAC: Full fetch complete (48757 records).
[2025-10-24T00:23:36.001473] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-08.
[2025-10-24T00:23:36.808605] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-09.
[2025-10-24T00:23:36.921284] [INFO ] [REMOTE    ] VATE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:23:37.327092] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-07 (2.12 seconds).
[2025-10-24T00:23:37.599418] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-08.
[2025-10-24T00:23:38.304104] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-08 (2.30 seconds).
[2025-10-24T00:23:38.399399] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-09.
[2025-10-24T00:23:38.537201] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T00:23:39.199436] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-01.
[2025-10-24T00:23:39.642358] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T00:23:39.999417] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-09.
[2025-10-24T00:23:40.297838] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T00:23:40.617865] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-09 (2.22 seconds).
[2025-10-24T00:23:40.799436] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-02.
[2025-10-24T00:23:41.599427] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-10.
[2025-10-24T00:23:41.765078] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T00:23:41.914666] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T00:23:42.399459] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-10.
[2025-10-24T00:23:43.199440] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-10.
[2025-10-24T00:23:43.723405] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-10 (2.12 seconds).
[2025-10-24T00:23:43.733764] [INFO ] [REMOTE    ] V: Full fetch complete (77925 records).
[2025-10-24T00:23:44.003255] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-03.
[2025-10-24T00:23:44.225435] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T00:23:44.235728] [INFO ] [REMOTE    ] VAL: Full fetch complete (72930 records).
[2025-10-24T00:23:44.944514] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T00:23:44.988129] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-04.
[2025-10-24T00:23:45.431697] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-10 (2.23 seconds).
[2025-10-24T00:23:45.515933] [INFO ] [REMOTE    ] VALE: Full fetch complete (77873 records).
[2025-10-24T00:23:45.751234] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T00:23:45.830487] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-05.
[2025-10-24T00:23:46.943884] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T00:23:47.000919] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-06.
[2025-10-24T00:23:47.252636] [INFO ] [REMOTE    ] VBF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:23:47.277725] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-01.
[2025-10-24T00:23:47.651883] [INFO ] [REMOTE    ] VCV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:23:47.808298] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T00:23:48.004576] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-01.
[2025-10-24T00:23:48.139253] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T00:23:48.413057] [INFO ] [REMOTE    ] VEEV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:23:48.799434] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-07.
[2025-10-24T00:23:48.861705] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T00:23:49.290714] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-07 (0.49 seconds).
[2025-10-24T00:23:49.599455] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-08.
[2025-10-24T00:23:50.198297] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T00:23:50.399424] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-02.
[2025-10-24T00:23:51.199445] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-02.
[2025-10-24T00:23:51.246290] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T00:23:51.938924] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-02 (0.74 seconds).
[2025-10-24T00:23:51.999404] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-01.
[2025-10-24T00:23:52.799492] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-03.
[2025-10-24T00:23:53.540955] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T00:23:53.583581] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T00:23:53.599413] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-02.
[2025-10-24T00:23:54.399429] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-04.
[2025-10-24T00:23:54.831502] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T00:23:55.050147] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T00:23:55.199438] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-03.
[2025-10-24T00:23:55.999444] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-09.
[2025-10-24T00:23:56.633054] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-09 (0.63 seconds).
[2025-10-24T00:23:56.799436] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-03.
[2025-10-24T00:23:56.924474] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T00:23:57.599481] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-10.
[2025-10-24T00:23:57.615776] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T00:23:58.211075] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-10 (0.61 seconds).
[2025-10-24T00:23:58.212595] [INFO ] [REMOTE    ] VATE: Full fetch complete (10652 records).
[2025-10-24T00:23:58.406713] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-04.
[2025-10-24T00:23:59.204523] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-04.
[2025-10-24T00:23:59.309503] [INFO ] [REMOTE    ] VEL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:23:59.999409] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-05.
[2025-10-24T00:24:00.204479] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T00:24:00.227110] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T00:24:00.429195] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-05 (0.43 seconds).
[2025-10-24T00:24:00.799440] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-01.
[2025-10-24T00:24:01.240127] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T00:24:01.599425] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-02.
[2025-10-24T00:24:02.349369] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T00:24:02.399406] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-03.
[2025-10-24T00:24:03.199431] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-05.
[2025-10-24T00:24:03.367153] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T00:24:03.999456] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-04.
[2025-10-24T00:24:04.799443] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-06.
[2025-10-24T00:24:04.813946] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T00:24:04.977078] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T00:24:05.546474] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T00:24:05.599419] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-07.
[2025-10-24T00:24:06.399430] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-05.
[2025-10-24T00:24:06.483770] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T00:24:06.952064] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T00:24:07.199532] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-08.
[2025-10-24T00:24:07.999449] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-05.
[2025-10-24T00:24:08.035620] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T00:24:08.550188] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T00:24:08.799548] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-06.
[2025-10-24T00:24:09.521777] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T00:24:09.599546] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-07.
[2025-10-24T00:24:10.234830] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-07 (0.64 seconds).
[2025-10-24T00:24:10.399533] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-06.
[2025-10-24T00:24:11.199539] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-06.
[2025-10-24T00:24:11.392029] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T00:24:11.999537] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-09.
[2025-10-24T00:24:12.728202] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T00:24:12.799511] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-10.
[2025-10-24T00:24:12.925270] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T00:24:13.599444] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-07.
[2025-10-24T00:24:13.638094] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T00:24:13.640932] [INFO ] [REMOTE    ] VBF: Full fetch complete (10928 records).
[2025-10-24T00:24:14.407121] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-08.
[2025-10-24T00:24:14.841390] [INFO ] [REMOTE    ] VET: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:24:15.199504] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-01.
[2025-10-24T00:24:15.217522] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T00:24:15.341215] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T00:24:15.999504] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-09.
[2025-10-24T00:24:16.799443] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-08.
[2025-10-24T00:24:16.882678] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T00:24:16.902985] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T00:24:17.599477] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-02.
[2025-10-24T00:24:18.346450] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T00:24:18.399487] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-09.
[2025-10-24T00:24:19.149904] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T00:24:19.199505] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-07.
[2025-10-24T00:24:19.999495] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-03.
[2025-10-24T00:24:20.057381] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T00:24:20.124752] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T00:24:20.799504] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-10.
[2025-10-24T00:24:21.511264] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T00:24:21.594537] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T00:24:21.597345] [INFO ] [REMOTE    ] VEL: Full fetch complete (17192 records).
[2025-10-24T00:24:21.604607] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-04.
[2025-10-24T00:24:22.401713] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-08.
[2025-10-24T00:24:22.779156] [INFO ] [REMOTE    ] VFC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:24:23.199492] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-10.
[2025-10-24T00:24:23.427144] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T00:24:23.564193] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-08 (1.16 seconds).
[2025-10-24T00:24:23.999468] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-01.
[2025-10-24T00:24:24.799434] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-09.
[2025-10-24T00:24:24.944723] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T00:24:24.953057] [INFO ] [REMOTE    ] VEEV: Full fetch complete (68390 records).
[2025-10-24T00:24:25.599443] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-05.
[2025-10-24T00:24:25.838050] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T00:24:25.967124] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-01 (1.97 seconds).
[2025-10-24T00:24:26.239006] [INFO ] [REMOTE    ] VG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:24:26.399402] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-01.
[2025-10-24T00:24:27.199412] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-10.
[2025-10-24T00:24:27.273588] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T00:24:27.407407] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T00:24:27.908609] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T00:24:27.910572] [INFO ] [REMOTE    ] VCV: Full fetch complete (18329 records).
[2025-10-24T00:24:28.008034] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-02.
[2025-10-24T00:24:28.804604] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-06.
[2025-10-24T00:24:29.041881] [INFO ] [REMOTE    ] VGI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:24:29.599494] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-02.
[2025-10-24T00:24:29.950019] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-02 (1.94 seconds).
[2025-10-24T00:24:30.052115] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T00:24:30.399497] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-01.
[2025-10-24T00:24:31.022258] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T00:24:31.199440] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-03.
[2025-10-24T00:24:31.306079] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T00:24:31.999433] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-03.
[2025-10-24T00:24:32.799419] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-07.
[2025-10-24T00:24:33.184877] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T00:24:33.599451] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-04.
[2025-10-24T00:24:33.950462] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-03 (1.95 seconds).
[2025-10-24T00:24:34.091236] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T00:24:34.399450] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-02.
[2025-10-24T00:24:34.987993] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T00:24:35.199425] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-03.
[2025-10-24T00:24:35.562529] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T00:24:35.793763] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T00:24:35.999418] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-04.
[2025-10-24T00:24:36.624198] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-04 (0.62 seconds).
[2025-10-24T00:24:36.799427] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-04.
[2025-10-24T00:24:37.599439] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-05.
[2025-10-24T00:24:38.181688] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T00:24:38.399415] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-08.
[2025-10-24T00:24:38.868270] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-04 (2.07 seconds).
[2025-10-24T00:24:39.199495] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-05.
[2025-10-24T00:24:39.862262] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T00:24:39.999430] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-06.
[2025-10-24T00:24:40.595362] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T00:24:40.799423] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-09.
[2025-10-24T00:24:41.140789] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-05 (1.94 seconds).
[2025-10-24T00:24:41.599434] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-05.
[2025-10-24T00:24:42.174853] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T00:24:42.399431] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-07.
[2025-10-24T00:24:42.985600] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T00:24:43.199412] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-10.
[2025-10-24T00:24:43.564255] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-05 (1.96 seconds).
[2025-10-24T00:24:43.999407] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-06.
[2025-10-24T00:24:44.799418] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-08.
[2025-10-24T00:24:44.840103] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T00:24:44.848581] [INFO ] [REMOTE    ] VET: Full fetch complete (64502 records).
[2025-10-24T00:24:45.606071] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T00:24:45.606188] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-06.
[2025-10-24T00:24:46.051763] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-06 (2.05 seconds).
[2025-10-24T00:24:46.278442] [INFO ] [REMOTE    ] VGM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:24:46.399397] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-01.
[2025-10-24T00:24:47.199421] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-07.
[2025-10-24T00:24:47.229895] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-01 (0.83 seconds).
[2025-10-24T00:24:47.484351] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T00:24:47.999431] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-07.
[2025-10-24T00:24:48.799435] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-09.
[2025-10-24T00:24:49.150483] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-07 (1.95 seconds).
[2025-10-24T00:24:49.587143] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T00:24:49.599394] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-10.
[2025-10-24T00:24:50.030396] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-10 (0.43 seconds).
[2025-10-24T00:24:50.031853] [INFO ] [REMOTE    ] VGI: Full fetch complete (7568 records).
[2025-10-24T00:24:50.357020] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-07 (2.36 seconds).
[2025-10-24T00:24:50.408714] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-02.
[2025-10-24T00:24:51.155120] [INFO ] [REMOTE    ] VHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:24:51.199394] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-01.
[2025-10-24T00:24:51.507298] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T00:24:51.663848] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-01 (0.46 seconds).
[2025-10-24T00:24:51.999424] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-02.
[2025-10-24T00:24:52.520360] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-02 (0.52 seconds).
[2025-10-24T00:24:52.799411] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-03.
[2025-10-24T00:24:53.389106] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T00:24:53.599456] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-03.
[2025-10-24T00:24:54.279895] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T00:24:54.399429] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-04.
[2025-10-24T00:24:55.199419] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-04.
[2025-10-24T00:24:55.443201] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T00:24:55.582968] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-04 (0.38 seconds).
[2025-10-24T00:24:55.999411] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-05.
[2025-10-24T00:24:56.485252] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T00:24:56.799442] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-06.
[2025-10-24T00:24:57.284537] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-06 (0.49 seconds).
[2025-10-24T00:24:57.599433] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-08.
[2025-10-24T00:24:58.399432] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-08.
[2025-10-24T00:24:59.199428] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-07.
[2025-10-24T00:24:59.619331] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-08 (2.02 seconds).
[2025-10-24T00:24:59.790881] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T00:24:59.999472] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-08.
[2025-10-24T00:25:00.438381] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T00:25:00.501198] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-08 (0.50 seconds).
[2025-10-24T00:25:00.799494] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-09.
[2025-10-24T00:25:01.281281] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-09 (0.48 seconds).
[2025-10-24T00:25:01.599460] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-05.
[2025-10-24T00:25:02.399447] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-10.
[2025-10-24T00:25:02.763106] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T00:25:02.950946] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T00:25:02.952051] [INFO ] [REMOTE    ] VHI: Full fetch complete (4322 records).
[2025-10-24T00:25:03.204573] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-06.
[2025-10-24T00:25:03.908602] [INFO ] [REMOTE    ] VIA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:25:03.999424] [INFO ] [REMOTE    ] VIA: Fetching primary data for 2025-01.
[2025-10-24T00:25:04.301451] [DEBUG] [REMOTE    ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:25:04.301837] [WARN ] [REMOTE    ] VIA: No data returned for month 2025-01
[2025-10-24T00:25:04.302094] [FATAL] [REMOTE    ] VIA: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:25:04.315965] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T00:25:04.804582] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-09.
[2025-10-24T00:25:05.088236] [INFO ] [REMOTE    ] VICI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:25:05.599439] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-07.
[2025-10-24T00:25:06.399410] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-09.
[2025-10-24T00:25:06.715488] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T00:25:06.815755] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-09 (2.01 seconds).
[2025-10-24T00:25:07.199439] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-10.
[2025-10-24T00:25:07.999423] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-01.
[2025-10-24T00:25:08.242014] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T00:25:08.799398] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-08.
[2025-10-24T00:25:09.303479] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-10 (2.10 seconds).
[2025-10-24T00:25:09.313520] [INFO ] [REMOTE    ] VG: Full fetch complete (73078 records).
[2025-10-24T00:25:09.522723] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T00:25:09.609376] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-10.
[2025-10-24T00:25:10.301586] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-01 (2.30 seconds).
[2025-10-24T00:25:10.388635] [INFO ] [REMOTE    ] VIK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:25:10.399397] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-01.
[2025-10-24T00:25:11.199504] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-09.
[2025-10-24T00:25:11.587805] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-10 (1.98 seconds).
[2025-10-24T00:25:11.597561] [INFO ] [REMOTE    ] VFC: Full fetch complete (77749 records).
[2025-10-24T00:25:12.001724] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-02.
[2025-10-24T00:25:12.207754] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T00:25:12.330991] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T00:25:12.812314] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-10.
[2025-10-24T00:25:13.209127] [INFO ] [REMOTE    ] VIPS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:25:13.599440] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-02.
[2025-10-24T00:25:13.756828] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T00:25:13.761996] [INFO ] [REMOTE    ] VGM: Full fetch complete (25750 records).
[2025-10-24T00:25:14.169969] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-02 (2.17 seconds).
[2025-10-24T00:25:14.403382] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-03.
[2025-10-24T00:25:15.069860] [INFO ] [REMOTE    ] VIRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:25:15.199435] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-01.
[2025-10-24T00:25:15.272258] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T00:25:15.999463] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-03.
[2025-10-24T00:25:16.374100] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T00:25:16.802629] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-01.
[2025-10-24T00:25:16.805308] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T00:25:17.599447] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-02.
[2025-10-24T00:25:17.728099] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T00:25:18.399479] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-04.
[2025-10-24T00:25:18.525011] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T00:25:18.713860] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T00:25:19.199453] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-02.
[2025-10-24T00:25:19.873171] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T00:25:19.999395] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-05.
[2025-10-24T00:25:20.799470] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-04.
[2025-10-24T00:25:20.922780] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T00:25:21.599466] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-03.
[2025-10-24T00:25:21.802896] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T00:25:22.399406] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-03.
[2025-10-24T00:25:22.766817] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-04 (1.97 seconds).
[2025-10-24T00:25:23.199420] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-05.
[2025-10-24T00:25:23.315262] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T00:25:23.999481] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-04.
[2025-10-24T00:25:24.132056] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T00:25:24.799473] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-06.
[2025-10-24T00:25:25.202542] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T00:25:25.272420] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T00:25:25.599423] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-06.
[2025-10-24T00:25:26.103921] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T00:25:26.399406] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-04.
[2025-10-24T00:25:27.154750] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T00:25:27.199413] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-05.
[2025-10-24T00:25:27.738719] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-04 (1.34 seconds).
[2025-10-24T00:25:27.999437] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-07.
[2025-10-24T00:25:28.804508] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-05.
[2025-10-24T00:25:28.821417] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T00:25:29.599499] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-07.
[2025-10-24T00:25:29.813215] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T00:25:30.399413] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-08.
[2025-10-24T00:25:30.608631] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T00:25:31.199422] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-06.
[2025-10-24T00:25:31.685591] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-07 (2.09 seconds).
[2025-10-24T00:25:31.999410] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-06.
[2025-10-24T00:25:32.181527] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T00:25:32.487545] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T00:25:32.799455] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-08.
[2025-10-24T00:25:33.604522] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-09.
[2025-10-24T00:25:33.626747] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T00:25:34.399411] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-07.
[2025-10-24T00:25:34.839584] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T00:25:34.993272] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T00:25:35.199458] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-10.
[2025-10-24T00:25:35.756251] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T00:25:35.999467] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-08.
[2025-10-24T00:25:36.799429] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-09.
[2025-10-24T00:25:36.834720] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T00:25:36.843523] [INFO ] [REMOTE    ] VIK: Full fetch complete (75924 records).
[2025-10-24T00:25:37.604760] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-07.
[2025-10-24T00:25:37.765213] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T00:25:38.344379] [INFO ] [REMOTE    ] VIST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:25:38.399395] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-01.
[2025-10-24T00:25:38.700797] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-09 (1.90 seconds).
[2025-10-24T00:25:39.199451] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-10.
[2025-10-24T00:25:39.272276] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T00:25:39.999431] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-08.
[2025-10-24T00:25:40.073142] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T00:25:40.799409] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-09.
[2025-10-24T00:25:41.064025] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T00:25:41.075082] [INFO ] [REMOTE    ] VICI: Full fetch complete (77803 records).
[2025-10-24T00:25:41.500183] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T00:25:41.601419] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-02.
[2025-10-24T00:25:42.431079] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-09.
[2025-10-24T00:25:42.581037] [INFO ] [REMOTE    ] VIV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:25:42.785563] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-09 (1.99 seconds).
[2025-10-24T00:25:43.195854] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T00:25:43.204149] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-01.
[2025-10-24T00:25:43.999491] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-03.
[2025-10-24T00:25:44.146339] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T00:25:44.350629] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-01 (1.15 seconds).
[2025-10-24T00:25:44.799448] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-10.
[2025-10-24T00:25:45.599431] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-02.
[2025-10-24T00:25:45.688032] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T00:25:46.172325] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T00:25:46.180432] [INFO ] [REMOTE    ] VIRT: Full fetch complete (67531 records).
[2025-10-24T00:25:46.404581] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-10.
[2025-10-24T00:25:46.915709] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T00:25:47.204599] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-04.
[2025-10-24T00:25:47.626220] [INFO ] [REMOTE    ] VKQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:25:47.999423] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-03.
[2025-10-24T00:25:48.147082] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T00:25:48.157616] [INFO ] [REMOTE    ] VIPS: Full fetch complete (74867 records).
[2025-10-24T00:25:48.800303] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-01.
[2025-10-24T00:25:49.085550] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T00:25:49.443006] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T00:25:49.603373] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-04.
[2025-10-24T00:25:49.756116] [INFO ] [REMOTE    ] VLN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:25:49.765925] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-01 (0.97 seconds).
[2025-10-24T00:25:50.399437] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-01.
[2025-10-24T00:25:51.204704] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-02.
[2025-10-24T00:25:51.221101] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T00:25:51.876862] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T00:25:51.999393] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-02.
[2025-10-24T00:25:52.039813] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T00:25:52.799476] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-03.
[2025-10-24T00:25:53.137294] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T00:25:53.393498] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T00:25:53.599413] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-03.
[2025-10-24T00:25:54.399474] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-05.
[2025-10-24T00:25:54.597158] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T00:25:55.199456] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-04.
[2025-10-24T00:25:55.999434] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-05.
[2025-10-24T00:25:56.116697] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T00:25:56.177954] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T00:25:56.799441] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-05.
[2025-10-24T00:25:57.545189] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T00:25:57.599405] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-06.
[2025-10-24T00:25:57.863712] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T00:25:58.399438] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-06.
[2025-10-24T00:25:59.199438] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-06.
[2025-10-24T00:25:59.675010] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-06 (2.08 seconds).
[2025-10-24T00:25:59.973228] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T00:25:59.999400] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-07.
[2025-10-24T00:26:00.251816] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T00:26:00.799433] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-04.
[2025-10-24T00:26:01.599455] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-07.
[2025-10-24T00:26:01.970434] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T00:26:02.009442] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-07 (2.01 seconds).
[2025-10-24T00:26:02.399407] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-05.
[2025-10-24T00:26:02.611682] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-07 (1.01 seconds).
[2025-10-24T00:26:03.199483] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-07.
[2025-10-24T00:26:03.491915] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T00:26:03.999509] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-08.
[2025-10-24T00:26:04.799413] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-08.
[2025-10-24T00:26:05.008124] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T00:26:05.045780] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T00:26:05.599420] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-09.
[2025-10-24T00:26:06.381312] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T00:26:06.399412] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-08.
[2025-10-24T00:26:06.432510] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-09 (0.83 seconds).
[2025-10-24T00:26:07.199441] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-06.
[2025-10-24T00:26:07.999495] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-09.
[2025-10-24T00:26:08.125745] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T00:26:08.347469] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T00:26:08.799431] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-07.
[2025-10-24T00:26:09.580625] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T00:26:09.599407] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-10.
[2025-10-24T00:26:10.287973] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T00:26:10.399447] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-09.
[2025-10-24T00:26:11.096025] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T00:26:11.103325] [INFO ] [REMOTE    ] VIV: Full fetch complete (64329 records).
[2025-10-24T00:26:11.201760] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-08.
[2025-10-24T00:26:11.969613] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T00:26:12.000787] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-10.
[2025-10-24T00:26:12.572956] [INFO ] [REMOTE    ] VLO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:26:12.628472] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-10 (0.63 seconds).
[2025-10-24T00:26:12.632265] [INFO ] [REMOTE    ] VKQ: Full fetch complete (24587 records).
[2025-10-24T00:26:12.803152] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-01.
[2025-10-24T00:26:12.960981] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T00:26:13.604547] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-10.
[2025-10-24T00:26:13.912283] [INFO ] [REMOTE    ] VLRS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:26:14.399463] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-09.
[2025-10-24T00:26:14.774115] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-01 (1.97 seconds).
[2025-10-24T00:26:14.959257] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T00:26:14.971467] [INFO ] [REMOTE    ] VIST: Full fetch complete (67522 records).
[2025-10-24T00:26:15.209313] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-02.
[2025-10-24T00:26:15.977111] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T00:26:16.018907] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-01.
[2025-10-24T00:26:16.378199] [INFO ] [REMOTE    ] VLT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:26:16.799409] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-01.
[2025-10-24T00:26:16.987171] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T00:26:17.549026] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T00:26:17.549606] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T00:26:17.599403] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-02.
[2025-10-24T00:26:18.399429] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-03.
[2025-10-24T00:26:19.075936] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T00:26:19.199450] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-10.
[2025-10-24T00:26:19.999485] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-02.
[2025-10-24T00:26:20.346145] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-03 (1.95 seconds).
[2025-10-24T00:26:20.637010] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T00:26:20.763405] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T00:26:20.774609] [INFO ] [REMOTE    ] VLN: Full fetch complete (43264 records).
[2025-10-24T00:26:20.805202] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-03.
[2025-10-24T00:26:21.611789] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-04.
[2025-10-24T00:26:22.117139] [INFO ] [REMOTE    ] VLTO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:26:22.399409] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-03.
[2025-10-24T00:26:22.425776] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T00:26:23.050019] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T00:26:23.199451] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-04.
[2025-10-24T00:26:23.670247] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-04 (2.06 seconds).
[2025-10-24T00:26:23.990577] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T00:26:23.999390] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-05.
[2025-10-24T00:26:24.499796] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-05 (0.50 seconds).
[2025-10-24T00:26:24.799443] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-06.
[2025-10-24T00:26:25.376320] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T00:26:25.599439] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-05.
[2025-10-24T00:26:26.399447] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-04.
[2025-10-24T00:26:27.199409] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-07.
[2025-10-24T00:26:27.309528] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T00:26:27.804473] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-07 (0.61 seconds).
[2025-10-24T00:26:28.005190] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-08.
[2025-10-24T00:26:28.019036] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T00:26:28.672472] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T00:26:28.799445] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-06.
[2025-10-24T00:26:29.599448] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-05.
[2025-10-24T00:26:30.399444] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-09.
[2025-10-24T00:26:30.601355] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T00:26:31.007782] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T00:26:31.130129] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T00:26:31.199442] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-07.
[2025-10-24T00:26:31.999464] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-06.
[2025-10-24T00:26:32.799427] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-01.
[2025-10-24T00:26:33.207800] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-07 (2.01 seconds).
[2025-10-24T00:26:33.412758] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-06 (1.41 seconds).
[2025-10-24T00:26:33.599425] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-07.
[2025-10-24T00:26:34.376845] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T00:26:34.399398] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-02.
[2025-10-24T00:26:35.153429] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T00:26:35.199401] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-08.
[2025-10-24T00:26:35.926023] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T00:26:35.999404] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-03.
[2025-10-24T00:26:36.519239] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T00:26:36.799454] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-08.
[2025-10-24T00:26:37.599475] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-09.
[2025-10-24T00:26:37.681576] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T00:26:38.399492] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-10.
[2025-10-24T00:26:38.711264] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T00:26:38.828756] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-10 (0.43 seconds).
[2025-10-24T00:26:38.830021] [INFO ] [REMOTE    ] VLT: Full fetch complete (7424 records).
[2025-10-24T00:26:39.108400] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T00:26:39.200898] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-09.
[2025-10-24T00:26:39.973107] [INFO ] [REMOTE    ] VMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:26:39.999401] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-01.
[2025-10-24T00:26:40.799485] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-10.
[2025-10-24T00:26:41.189423] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-09 (1.99 seconds).
[2025-10-24T00:26:41.599502] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-10.
[2025-10-24T00:26:41.634978] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T00:26:41.879692] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T00:26:41.885910] [INFO ] [REMOTE    ] VLRS: Full fetch complete (58251 records).
[2025-10-24T00:26:42.422432] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-02.
[2025-10-24T00:26:43.199226] [INFO ] [REMOTE    ] VMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:26:43.199460] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-04.
[2025-10-24T00:26:43.411757] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T00:26:43.420742] [INFO ] [REMOTE    ] VLO: Full fetch complete (76911 records).
[2025-10-24T00:26:44.018829] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-01.
[2025-10-24T00:26:44.140237] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T00:26:44.800930] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-03.
[2025-10-24T00:26:44.904109] [INFO ] [REMOTE    ] VMO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:26:44.891436] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-01 (0.87 seconds).
[2025-10-24T00:26:44.941164] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T00:26:45.599430] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-01.
[2025-10-24T00:26:46.399417] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-05.
[2025-10-24T00:26:46.613093] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T00:26:46.657551] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T00:26:47.199454] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-02.
[2025-10-24T00:26:47.999452] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-02.
[2025-10-24T00:26:48.067460] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T00:26:48.363749] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T00:26:48.799440] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-03.
[2025-10-24T00:26:48.916127] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T00:26:49.599415] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-03.
[2025-10-24T00:26:49.844163] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T00:26:50.399415] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-04.
[2025-10-24T00:26:50.635027] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T00:26:51.199484] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-06.
[2025-10-24T00:26:51.999444] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-04.
[2025-10-24T00:26:52.249060] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T00:26:52.399953] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T00:26:52.799465] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-05.
[2025-10-24T00:26:53.289633] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T00:26:53.599458] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-05.
[2025-10-24T00:26:54.230364] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T00:26:54.399430] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-07.
[2025-10-24T00:26:54.611939] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T00:26:55.199490] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-06.
[2025-10-24T00:26:55.999475] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-04.
[2025-10-24T00:26:56.070043] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T00:26:56.102893] [DEBUG] [REMOTE    ] VMI: Error fetching primary data for 2025-04: 'API call returned an empty response.'
[2025-10-24T00:26:56.103457] [WARN ] [REMOTE    ] VMI: No data returned for month 2025-04
[2025-10-24T00:26:56.103557] [FATAL] [REMOTE    ] VMI: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:26:56.503154] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T00:26:56.804704] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-07.
[2025-10-24T00:26:56.953246] [INFO ] [REMOTE    ] VNO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:26:57.599441] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-06.
[2025-10-24T00:26:57.923561] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T00:26:58.399452] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-01.
[2025-10-24T00:26:59.199455] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-08.
[2025-10-24T00:26:59.279058] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T00:26:59.811821] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-08 (0.61 seconds).
[2025-10-24T00:26:59.999434] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-09.
[2025-10-24T00:27:00.050166] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T00:27:00.799436] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-08.
[2025-10-24T00:27:01.152908] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T00:27:01.599450] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-07.
[2025-10-24T00:27:02.399472] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-02.
[2025-10-24T00:27:02.521199] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T00:27:03.199468] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-09.
[2025-10-24T00:27:03.260112] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T00:27:03.768324] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T00:27:03.999455] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-10.
[2025-10-24T00:27:04.647553] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T00:27:04.799411] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-08.
[2025-10-24T00:27:05.100180] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T00:27:05.103893] [INFO ] [REMOTE    ] VMO: Full fetch complete (30729 records).
[2025-10-24T00:27:05.602689] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-03.
[2025-10-24T00:27:06.348314] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T00:27:06.399398] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-09.
[2025-10-24T00:27:07.170024] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T00:27:07.199393] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-04.
[2025-10-24T00:27:07.644444] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T00:27:07.999456] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-10.
[2025-10-24T00:27:08.799445] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-10.
[2025-10-24T00:27:08.849273] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T00:27:09.586159] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T00:27:09.594171] [INFO ] [REMOTE    ] VLTO: Full fetch complete (67368 records).
[2025-10-24T00:27:09.626629] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-05.
[2025-10-24T00:27:10.223776] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T00:27:10.242807] [INFO ] [REMOTE    ] VMC: Full fetch complete (62290 records).
[2025-10-24T00:27:11.381184] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T00:27:11.391458] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-06.
[2025-10-24T00:27:13.001703] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T00:27:13.012607] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-07.
[2025-10-24T00:27:14.720203] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T00:27:14.731674] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-08.
[2025-10-24T00:27:16.388669] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T00:27:16.399295] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-09.
[2025-10-24T00:27:17.999233] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T00:27:18.010151] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-10.
[2025-10-24T00:27:19.592825] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T00:27:19.601182] [INFO ] [REMOTE    ] VNO: Full fetch complete (70492 records).
[2025-10-24T00:27:21.984187] [INFO ] [REMOTE    ] VOYG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:27:22.027595] [INFO ] [REMOTE    ] VOYG: Fetching primary data for 2025-01.
[2025-10-24T00:27:22.370796] [DEBUG] [REMOTE    ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:27:22.435719] [WARN ] [REMOTE    ] VOYG: No data returned for month 2025-01
[2025-10-24T00:27:22.492783] [FATAL] [REMOTE    ] VOYG: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:27:22.888907] [INFO ] [REMOTE    ] VOC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:27:22.923747] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-01.
[2025-10-24T00:27:23.139894] [INFO ] [REMOTE    ] VOYA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:27:23.219138] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-01.
[2025-10-24T00:27:23.258923] [INFO ] [REMOTE    ] VNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:27:23.296402] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-01.
[2025-10-24T00:27:23.829041] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T00:27:23.866545] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-02.
[2025-10-24T00:27:23.971941] [INFO ] [REMOTE    ] VPG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:27:23.972259] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-01.
[2025-10-24T00:27:24.833332] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T00:27:24.842442] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-02.
[2025-10-24T00:27:24.868894] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T00:27:24.878144] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-02.
[2025-10-24T00:27:24.902995] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T00:27:24.913327] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-02.
[2025-10-24T00:27:24.914192] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T00:27:24.917780] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-03.
[2025-10-24T00:27:25.421804] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-02 (0.51 seconds).
[2025-10-24T00:27:25.424952] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-03.
[2025-10-24T00:27:25.725990] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T00:27:25.728240] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-04.
[2025-10-24T00:27:26.331836] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-03 (0.91 seconds).
[2025-10-24T00:27:26.336720] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-04.
[2025-10-24T00:27:26.355279] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-04 (0.63 seconds).
[2025-10-24T00:27:26.397025] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T00:27:26.395418] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-05.
[2025-10-24T00:27:26.399442] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T00:27:26.415998] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-03.
[2025-10-24T00:27:26.417295] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-03.
[2025-10-24T00:27:26.952372] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-05 (0.56 seconds).
[2025-10-24T00:27:27.199478] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-06.
[2025-10-24T00:27:27.475868] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T00:27:27.979871] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T00:27:27.999394] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-04.
[2025-10-24T00:27:28.027570] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T00:27:28.073908] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T00:27:28.799523] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-05.
[2025-10-24T00:27:29.599413] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-04.
[2025-10-24T00:27:29.713121] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T00:27:29.761124] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-05 (0.96 seconds).
[2025-10-24T00:27:30.399430] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-05.
[2025-10-24T00:27:31.199452] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-06.
[2025-10-24T00:27:31.262164] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T00:27:31.692326] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T00:27:31.999458] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-05.
[2025-10-24T00:27:32.227963] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T00:27:32.799514] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-07.
[2025-10-24T00:27:33.560443] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T00:27:33.593882] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T00:27:33.599382] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-08.
[2025-10-24T00:27:34.103966] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-08 (0.50 seconds).
[2025-10-24T00:27:34.399450] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-06.
[2025-10-24T00:27:35.199442] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-07.
[2025-10-24T00:27:35.716512] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T00:27:35.999421] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-09.
[2025-10-24T00:27:36.223870] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T00:27:36.771978] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T00:27:36.799404] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-10.
[2025-10-24T00:27:37.561635] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T00:27:37.563612] [INFO ] [REMOTE    ] VOC: Full fetch complete (13275 records).
[2025-10-24T00:27:37.604723] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-07.
[2025-10-24T00:27:38.410449] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-08.
[2025-10-24T00:27:38.715472] [INFO ] [REMOTE    ] VPV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:27:39.190056] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T00:27:39.201545] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-06.
[2025-10-24T00:27:39.422572] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T00:27:39.999499] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-08.
[2025-10-24T00:27:40.721491] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T00:27:40.799534] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-07.
[2025-10-24T00:27:41.558594] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T00:27:41.599452] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-09.
[2025-10-24T00:27:42.399522] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-01.
[2025-10-24T00:27:42.413290] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T00:27:42.448870] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T00:27:43.178361] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T00:27:43.199398] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-10.
[2025-10-24T00:27:43.922693] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-10 (0.72 seconds).
[2025-10-24T00:27:43.926326] [INFO ] [REMOTE    ] VPG: Full fetch complete (23167 records).
[2025-10-24T00:27:44.004597] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-09.
[2025-10-24T00:27:44.806839] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-08.
[2025-10-24T00:27:45.211161] [INFO ] [REMOTE    ] VRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:27:45.599490] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-02.
[2025-10-24T00:27:45.679989] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T00:27:46.352014] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T00:27:46.399412] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-03.
[2025-10-24T00:27:46.435783] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T00:27:46.854946] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-03 (0.46 seconds).
[2025-10-24T00:27:47.199477] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-04.
[2025-10-24T00:27:47.936477] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T00:27:47.999436] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-09.
[2025-10-24T00:27:48.799438] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-10.
[2025-10-24T00:27:49.190963] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T00:27:49.599446] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-05.
[2025-10-24T00:27:49.856199] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T00:27:49.863371] [INFO ] [REMOTE    ] VOYA: Full fetch complete (61558 records).
[2025-10-24T00:27:50.249967] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T00:27:50.428693] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-10.
[2025-10-24T00:27:51.203411] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-01.
[2025-10-24T00:27:51.285796] [INFO ] [REMOTE    ] VRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:27:51.979637] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T00:27:51.987985] [INFO ] [REMOTE    ] VNT: Full fetch complete (64274 records).
[2025-10-24T00:27:52.009428] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-06.
[2025-10-24T00:27:52.323943] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T00:27:52.700475] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T00:27:52.799491] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-01.
[2025-10-24T00:27:53.479149] [INFO ] [REMOTE    ] VRTS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:27:53.599466] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-07.
[2025-10-24T00:27:54.225847] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T00:27:54.399432] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-08.
[2025-10-24T00:27:55.018092] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T00:27:55.199466] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-09.
[2025-10-24T00:27:55.263756] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-01 (2.46 seconds).
[2025-10-24T00:27:55.896341] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T00:27:55.999465] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-02.
[2025-10-24T00:27:56.799465] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-02.
[2025-10-24T00:27:57.599482] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-01.
[2025-10-24T00:27:58.086497] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T00:27:58.233884] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T00:27:58.408792] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-02.
[2025-10-24T00:27:58.415840] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-02 (2.42 seconds).
[2025-10-24T00:27:59.044764] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T00:27:59.199459] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-03.
[2025-10-24T00:27:59.999469] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-03.
[2025-10-24T00:28:00.799471] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-10.
[2025-10-24T00:28:01.409540] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T00:28:01.451290] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-10 (0.65 seconds).
[2025-10-24T00:28:01.452634] [INFO ] [REMOTE    ] VPV: Full fetch complete (8820 records).
[2025-10-24T00:28:01.605504] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-04.
[2025-10-24T00:28:01.890534] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-03 (2.69 seconds).
[2025-10-24T00:28:02.404686] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-03.
[2025-10-24T00:28:02.664904] [INFO ] [REMOTE    ] VSCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:28:03.018707] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T00:28:03.204579] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-01.
[2025-10-24T00:28:03.215883] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T00:28:03.999618] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-04.
[2025-10-24T00:28:04.799478] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-04.
[2025-10-24T00:28:05.014888] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T00:28:05.411607] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T00:28:05.599519] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-05.
[2025-10-24T00:28:06.382551] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-04 (2.38 seconds).
[2025-10-24T00:28:06.399435] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-02.
[2025-10-24T00:28:06.515354] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T00:28:07.199562] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-05.
[2025-10-24T00:28:07.875349] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T00:28:07.999463] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-06.
[2025-10-24T00:28:08.107485] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T00:28:08.799461] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-03.
[2025-10-24T00:28:09.284045] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T00:28:09.599436] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-07.
[2025-10-24T00:28:10.399792] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-06.
[2025-10-24T00:28:10.400969] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T00:28:11.099401] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T00:28:11.199480] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-05.
[2025-10-24T00:28:11.387439] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T00:28:11.999434] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-04.
[2025-10-24T00:28:12.799469] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-07.
[2025-10-24T00:28:13.599410] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-08.
[2025-10-24T00:28:13.633241] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T00:28:13.683020] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-05 (2.48 seconds).
[2025-10-24T00:28:13.956391] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T00:28:14.399447] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-08.
[2025-10-24T00:28:14.889784] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T00:28:15.015922] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T00:28:15.199450] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-09.
[2025-10-24T00:28:15.866589] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-09 (0.67 seconds).
[2025-10-24T00:28:15.999405] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-06.
[2025-10-24T00:28:16.799482] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-10.
[2025-10-24T00:28:17.599475] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-09.
[2025-10-24T00:28:17.609666] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T00:28:17.611732] [INFO ] [REMOTE    ] VRTS: Full fetch complete (11851 records).
[2025-10-24T00:28:18.404496] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-05.
[2025-10-24T00:28:18.580095] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-06 (2.58 seconds).
[2025-10-24T00:28:18.864175] [INFO ] [REMOTE    ] VSH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:28:19.096520] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T00:28:19.199426] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-01.
[2025-10-24T00:28:19.999480] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-07.
[2025-10-24T00:28:20.302609] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T00:28:20.799506] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-06.
[2025-10-24T00:28:20.879404] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T00:28:21.599492] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-02.
[2025-10-24T00:28:22.399427] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-10.
[2025-10-24T00:28:22.610387] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-07 (2.61 seconds).
[2025-10-24T00:28:22.627056] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T00:28:22.746106] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T00:28:23.199441] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-03.
[2025-10-24T00:28:23.754249] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T00:28:23.760380] [INFO ] [REMOTE    ] VRE: Full fetch complete (48760 records).
[2025-10-24T00:28:24.005156] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-08.
[2025-10-24T00:28:24.802135] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-07.
[2025-10-24T00:28:25.120847] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T00:28:25.125236] [INFO ] [REMOTE    ] VST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:28:25.599428] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-04.
[2025-10-24T00:28:26.399428] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-01.
[2025-10-24T00:28:26.472594] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-08 (2.47 seconds).
[2025-10-24T00:28:26.738631] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T00:28:27.199440] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-09.
[2025-10-24T00:28:27.346166] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T00:28:27.999487] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-05.
[2025-10-24T00:28:28.799458] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-08.
[2025-10-24T00:28:28.976873] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-01 (2.58 seconds).
[2025-10-24T00:28:29.599431] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-02.
[2025-10-24T00:28:29.654171] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T00:28:29.743056] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-09 (2.54 seconds).
[2025-10-24T00:28:30.399435] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-10.
[2025-10-24T00:28:30.603726] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T00:28:31.199497] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-09.
[2025-10-24T00:28:31.999507] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-06.
[2025-10-24T00:28:32.092168] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-02 (2.49 seconds).
[2025-10-24T00:28:32.635606] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T00:28:32.799420] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-10.
[2025-10-24T00:28:32.869888] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-10 (2.47 seconds).
[2025-10-24T00:28:32.879393] [INFO ] [REMOTE    ] VRT: Full fetch complete (77932 records).
[2025-10-24T00:28:33.599673] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-03.
[2025-10-24T00:28:33.831555] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T00:28:34.410584] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-07.
[2025-10-24T00:28:34.440212] [INFO ] [REMOTE    ] VSTS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:28:34.543517] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T00:28:34.552520] [INFO ] [REMOTE    ] VSCO: Full fetch complete (76433 records).
[2025-10-24T00:28:35.215300] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-01.
[2025-10-24T00:28:35.968389] [INFO ] [REMOTE    ] VTEX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:28:35.999392] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-01.
[2025-10-24T00:28:36.235093] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T00:28:36.265773] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-03 (2.67 seconds).
[2025-10-24T00:28:36.799420] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-04.
[2025-10-24T00:28:36.847902] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T00:28:37.381953] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T00:28:37.599441] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-02.
[2025-10-24T00:28:38.399442] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-02.
[2025-10-24T00:28:39.021917] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T00:28:39.199440] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-03.
[2025-10-24T00:28:39.368799] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-04 (2.57 seconds).
[2025-10-24T00:28:39.855533] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T00:28:39.999428] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-03.
[2025-10-24T00:28:40.772488] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T00:28:40.799399] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-08.
[2025-10-24T00:28:41.599471] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-04.
[2025-10-24T00:28:41.656421] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T00:28:42.399474] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-05.
[2025-10-24T00:28:42.471895] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T00:28:43.198203] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T00:28:43.209128] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-09.
[2025-10-24T00:28:43.999498] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-04.
[2025-10-24T00:28:44.799805] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-05.
[2025-10-24T00:28:44.805461] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T00:28:44.872053] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-05 (2.47 seconds).
[2025-10-24T00:28:45.599443] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-06.
[2025-10-24T00:28:45.637809] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T00:28:46.345094] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T00:28:46.399395] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-06.
[2025-10-24T00:28:47.199479] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-10.
[2025-10-24T00:28:47.907290] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T00:28:47.999418] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-07.
[2025-10-24T00:28:48.339892] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-06 (2.74 seconds).
[2025-10-24T00:28:48.804596] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-07.
[2025-10-24T00:28:48.825466] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T00:28:48.834892] [INFO ] [REMOTE    ] VSH: Full fetch complete (70958 records).
[2025-10-24T00:28:49.605461] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-05.
[2025-10-24T00:28:49.714630] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T00:28:50.289636] [INFO ] [REMOTE    ] VTLE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:28:50.399492] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-01.
[2025-10-24T00:28:51.148497] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-07 (2.34 seconds).
[2025-10-24T00:28:51.199415] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-08.
[2025-10-24T00:28:51.442286] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T00:28:52.004569] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-06.
[2025-10-24T00:28:52.020024] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T00:28:52.799499] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-02.
[2025-10-24T00:28:53.569415] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T00:28:53.604555] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-07.
[2025-10-24T00:28:53.619860] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-08 (2.42 seconds).
[2025-10-24T00:28:54.321841] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T00:28:54.399421] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-03.
[2025-10-24T00:28:54.953820] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T00:28:55.199453] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-08.
[2025-10-24T00:28:55.902715] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T00:28:55.999447] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-08.
[2025-10-24T00:28:56.799475] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-09.
[2025-10-24T00:28:56.875859] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T00:28:57.553477] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T00:28:57.599409] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-09.
[2025-10-24T00:28:58.399423] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-09.
[2025-10-24T00:28:59.100143] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-09 (2.30 seconds).
[2025-10-24T00:28:59.173970] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T00:28:59.199450] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-10.
[2025-10-24T00:28:59.999435] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-10.
[2025-10-24T00:29:00.081070] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T00:29:00.761794] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T00:29:00.769117] [INFO ] [REMOTE    ] VTEX: Full fetch complete (61095 records).
[2025-10-24T00:29:00.804585] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-04.
[2025-10-24T00:29:01.605906] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-10.
[2025-10-24T00:29:02.120419] [INFO ] [REMOTE    ] VTMX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:29:02.399471] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-01.
[2025-10-24T00:29:02.556046] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-10 (2.56 seconds).
[2025-10-24T00:29:02.566003] [INFO ] [REMOTE    ] VST: Full fetch complete (77888 records).
[2025-10-24T00:29:02.598355] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T00:29:03.213878] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-05.
[2025-10-24T00:29:03.384358] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T00:29:03.404200] [INFO ] [REMOTE    ] VSTS: Full fetch complete (69742 records).
[2025-10-24T00:29:03.537596] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T00:29:04.008152] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-02.
[2025-10-24T00:29:04.784053] [INFO ] [REMOTE    ] VTN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:29:04.799415] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-01.
[2025-10-24T00:29:04.997598] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T00:29:05.231127] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T00:29:05.583004] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T00:29:05.600939] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-06.
[2025-10-24T00:29:05.667399] [INFO ] [REMOTE    ] VTOL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:29:06.399443] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-01.
[2025-10-24T00:29:07.199416] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-03.
[2025-10-24T00:29:07.213704] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T00:29:07.306104] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T00:29:07.792422] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T00:29:07.999444] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-04.
[2025-10-24T00:29:08.799450] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-02.
[2025-10-24T00:29:09.137868] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T00:29:09.599411] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-05.
[2025-10-24T00:29:09.759457] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T00:29:10.399443] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-07.
[2025-10-24T00:29:10.616068] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T00:29:11.199438] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-06.
[2025-10-24T00:29:11.999413] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-02.
[2025-10-24T00:29:12.181050] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T00:29:12.240158] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T00:29:12.423903] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-02 (0.42 seconds).
[2025-10-24T00:29:12.799421] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-03.
[2025-10-24T00:29:13.599431] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-08.
[2025-10-24T00:29:13.779714] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T00:29:14.399433] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-03.
[2025-10-24T00:29:15.199486] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-04.
[2025-10-24T00:29:15.287458] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T00:29:15.321446] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T00:29:15.999440] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-07.
[2025-10-24T00:29:16.058105] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T00:29:16.799431] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-04.
[2025-10-24T00:29:17.018770] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T00:29:17.542320] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T00:29:17.599398] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-05.
[2025-10-24T00:29:18.399474] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-09.
[2025-10-24T00:29:18.728612] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T00:29:19.199445] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-06.
[2025-10-24T00:29:19.827948] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T00:29:19.999422] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-08.
[2025-10-24T00:29:20.315403] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T00:29:20.800989] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-07.
[2025-10-24T00:29:20.803817] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T00:29:21.599453] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-10.
[2025-10-24T00:29:21.889363] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T00:29:22.399455] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-05.
[2025-10-24T00:29:23.013720] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T00:29:23.141693] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T00:29:23.148759] [INFO ] [REMOTE    ] VTLE: Full fetch complete (68398 records).
[2025-10-24T00:29:23.207070] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-09.
[2025-10-24T00:29:24.005424] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-08.
[2025-10-24T00:29:24.314478] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T00:29:24.570961] [INFO ] [REMOTE    ] VTR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:29:24.799425] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-10.
[2025-10-24T00:29:24.909562] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T00:29:25.599436] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-01.
[2025-10-24T00:29:25.773119] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T00:29:25.776463] [INFO ] [REMOTE    ] VTMX: Full fetch complete (25807 records).
[2025-10-24T00:29:26.404613] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-09.
[2025-10-24T00:29:27.046507] [INFO ] [REMOTE    ] VTS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:29:27.199397] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-06.
[2025-10-24T00:29:27.305699] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T00:29:27.435210] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T00:29:27.681916] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-06 (0.48 seconds).
[2025-10-24T00:29:27.999459] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-01.
[2025-10-24T00:29:28.799427] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-10.
[2025-10-24T00:29:29.101503] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T00:29:29.599444] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-07.
[2025-10-24T00:29:29.764293] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T00:29:29.767889] [INFO ] [REMOTE    ] VTOL: Full fetch complete (26468 records).
[2025-10-24T00:29:30.404543] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-02.
[2025-10-24T00:29:30.460086] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T00:29:31.063805] [INFO ] [REMOTE    ] VVR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:29:31.199430] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-02.
[2025-10-24T00:29:31.999406] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-08.
[2025-10-24T00:29:32.198045] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T00:29:32.225793] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T00:29:32.435240] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T00:29:32.799442] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-03.
[2025-10-24T00:29:33.599433] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-09.
[2025-10-24T00:29:34.136133] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T00:29:34.360592] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T00:29:34.399479] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-04.
[2025-10-24T00:29:35.199441] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-03.
[2025-10-24T00:29:35.682040] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T00:29:35.999487] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-01.
[2025-10-24T00:29:36.799523] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-10.
[2025-10-24T00:29:36.968534] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T00:29:37.599502] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-04.
[2025-10-24T00:29:37.606609] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T00:29:37.610375] [INFO ] [REMOTE    ] VTN: Full fetch complete (11014 records).
[2025-10-24T00:29:37.759495] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T00:29:38.414503] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-05.
[2025-10-24T00:29:38.804885] [INFO ] [REMOTE    ] VVV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:29:39.199422] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-01.
[2025-10-24T00:29:39.445628] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T00:29:39.730414] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T00:29:39.999434] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-05.
[2025-10-24T00:29:40.804617] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-06.
[2025-10-24T00:29:40.819393] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T00:29:41.599557] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-02.
[2025-10-24T00:29:41.852780] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-05 (1.85 seconds).
[2025-10-24T00:29:42.203402] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T00:29:42.399429] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-07.
[2025-10-24T00:29:43.199432] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-06.
[2025-10-24T00:29:43.237113] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T00:29:43.712391] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T00:29:43.999439] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-08.
[2025-10-24T00:29:44.799406] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-03.
[2025-10-24T00:29:44.920555] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T00:29:45.267765] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T00:29:45.599428] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-09.
[2025-10-24T00:29:46.399412] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-07.
[2025-10-24T00:29:46.471677] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T00:29:47.030844] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T00:29:47.199452] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-04.
[2025-10-24T00:29:47.999455] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-10.
[2025-10-24T00:29:48.275623] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-07 (1.88 seconds).
[2025-10-24T00:29:48.799415] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-08.
[2025-10-24T00:29:48.912956] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T00:29:48.962497] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T00:29:48.967695] [INFO ] [REMOTE    ] VTS: Full fetch complete (41603 records).
[2025-10-24T00:29:49.607325] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-05.
[2025-10-24T00:29:50.305064] [INFO ] [REMOTE    ] VVX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:29:50.399435] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-02.
[2025-10-24T00:29:50.579822] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T00:29:51.077660] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T00:29:51.199481] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-01.
[2025-10-24T00:29:51.249115] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T00:29:51.999431] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-09.
[2025-10-24T00:29:52.300760] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T00:29:52.799444] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-02.
[2025-10-24T00:29:53.599462] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-06.
[2025-10-24T00:29:53.749355] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T00:29:53.876089] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T00:29:54.399433] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-03.
[2025-10-24T00:29:54.985538] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T00:29:55.199420] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-03.
[2025-10-24T00:29:55.574879] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T00:29:55.999477] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-10.
[2025-10-24T00:29:56.663404] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T00:29:56.799414] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-07.
[2025-10-24T00:29:57.599413] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-04.
[2025-10-24T00:29:57.623788] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T00:29:57.633118] [INFO ] [REMOTE    ] VTR: Full fetch complete (76449 records).
[2025-10-24T00:29:58.165721] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T00:29:58.404517] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-04.
[2025-10-24T00:29:58.800299] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T00:29:59.162041] [INFO ] [REMOTE    ] VYX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:29:59.199423] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-08.
[2025-10-24T00:29:59.546328] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T00:29:59.999442] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-05.
[2025-10-24T00:30:00.799403] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-01.
[2025-10-24T00:30:00.915165] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T00:30:01.284699] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T00:30:01.599491] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-06.
[2025-10-24T00:30:02.186410] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T00:30:02.399463] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-09.
[2025-10-24T00:30:02.675890] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T00:30:03.199451] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-05.
[2025-10-24T00:30:03.999513] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-07.
[2025-10-24T00:30:04.048955] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T00:30:04.588049] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T00:30:04.721786] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-07 (0.72 seconds).
[2025-10-24T00:30:04.799399] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-08.
[2025-10-24T00:30:05.599436] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-10.
[2025-10-24T00:30:06.084576] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T00:30:06.399442] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-06.
[2025-10-24T00:30:06.949384] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T00:30:06.957982] [INFO ] [REMOTE    ] VVV: Full fetch complete (72457 records).
[2025-10-24T00:30:07.207083] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-09.
[2025-10-24T00:30:07.848420] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T00:30:08.003410] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-02.
[2025-10-24T00:30:08.436300] [INFO ] [REMOTE    ] VZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:30:08.578242] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T00:30:08.799502] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-07.
[2025-10-24T00:30:09.599420] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-01.
[2025-10-24T00:30:09.698858] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T00:30:10.068422] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T00:30:10.399417] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-08.
[2025-10-24T00:30:11.199457] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-10.
[2025-10-24T00:30:11.577129] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T00:30:11.972849] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-01 (2.37 seconds).
[2025-10-24T00:30:11.999403] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-02.
[2025-10-24T00:30:12.025490] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T00:30:12.029965] [INFO ] [REMOTE    ] VVX: Full fetch complete (33101 records).
[2025-10-24T00:30:12.810664] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-09.
[2025-10-24T00:30:13.329335] [INFO ] [REMOTE    ] W: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:30:13.599438] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-03.
[2025-10-24T00:30:14.245216] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-02 (2.25 seconds).
[2025-10-24T00:30:14.391916] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T00:30:14.399478] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-03.
[2025-10-24T00:30:14.988847] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T00:30:15.199494] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-01.
[2025-10-24T00:30:15.999471] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-10.
[2025-10-24T00:30:16.412511] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-03 (2.01 seconds).
[2025-10-24T00:30:16.799473] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-04.
[2025-10-24T00:30:17.054887] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-01 (1.86 seconds).
[2025-10-24T00:30:17.439977] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T00:30:17.446347] [INFO ] [REMOTE    ] VVR: Full fetch complete (46692 records).
[2025-10-24T00:30:17.609895] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-02.
[2025-10-24T00:30:18.406726] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-04.
[2025-10-24T00:30:18.554368] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T00:30:18.809628] [INFO ] [REMOTE    ] WAB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:30:19.133299] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T00:30:19.199414] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-01.
[2025-10-24T00:30:19.999436] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-03.
[2025-10-24T00:30:20.679410] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-04 (2.27 seconds).
[2025-10-24T00:30:20.752852] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T00:30:20.799400] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-02.
[2025-10-24T00:30:21.599453] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-05.
[2025-10-24T00:30:22.259267] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-03 (2.26 seconds).
[2025-10-24T00:30:22.399387] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-04.
[2025-10-24T00:30:22.574615] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T00:30:23.199448] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-03.
[2025-10-24T00:30:23.948257] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-05 (2.35 seconds).
[2025-10-24T00:30:23.999391] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-06.
[2025-10-24T00:30:24.567207] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-04 (2.17 seconds).
[2025-10-24T00:30:24.799405] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-05.
[2025-10-24T00:30:24.971304] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T00:30:25.599438] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-04.
[2025-10-24T00:30:26.302222] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-06 (2.30 seconds).
[2025-10-24T00:30:26.399394] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-07.
[2025-10-24T00:30:26.632532] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-05 (1.83 seconds).
[2025-10-24T00:30:27.199461] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-06.
[2025-10-24T00:30:27.429059] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T00:30:27.999422] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-05.
[2025-10-24T00:30:28.572112] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-07 (2.17 seconds).
[2025-10-24T00:30:28.799416] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-08.
[2025-10-24T00:30:29.055037] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-06 (1.86 seconds).
[2025-10-24T00:30:29.194737] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-05 (1.20 seconds).
[2025-10-24T00:30:29.599437] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-06.
[2025-10-24T00:30:30.399456] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-07.
[2025-10-24T00:30:31.133740] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-08 (2.33 seconds).
[2025-10-24T00:30:31.203353] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-09.
[2025-10-24T00:30:31.209547] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T00:30:31.999496] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-07.
[2025-10-24T00:30:32.451862] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T00:30:32.799492] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-05.
[2025-10-24T00:30:33.599445] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-08.
[2025-10-24T00:30:33.655279] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-09 (2.45 seconds).
[2025-10-24T00:30:33.824951] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-07 (1.83 seconds).
[2025-10-24T00:30:34.070630] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-05 (1.27 seconds).
[2025-10-24T00:30:34.399444] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-10.
[2025-10-24T00:30:35.199406] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-08.
[2025-10-24T00:30:35.563339] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-08 (1.96 seconds).
[2025-10-24T00:30:35.999443] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-09.
[2025-10-24T00:30:36.797862] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T00:30:36.807303] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-06.
[2025-10-24T00:30:36.836824] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-10 (2.44 seconds).
[2025-10-24T00:30:36.846156] [INFO ] [REMOTE    ] VZ: Full fetch complete (77971 records).
[2025-10-24T00:30:37.603527] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-09.
[2025-10-24T00:30:38.155129] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-09 (2.16 seconds).
[2025-10-24T00:30:38.349214] [INFO ] [REMOTE    ] WAL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:30:38.399395] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-01.
[2025-10-24T00:30:38.432524] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T00:30:39.199450] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-07.
[2025-10-24T00:30:39.340770] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T00:30:39.999449] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-10.
[2025-10-24T00:30:40.089894] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T00:30:40.799444] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-02.
[2025-10-24T00:30:40.927323] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T00:30:41.599452] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-08.
[2025-10-24T00:30:41.913992] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-10 (1.91 seconds).
[2025-10-24T00:30:41.923000] [INFO ] [REMOTE    ] W: Full fetch complete (77507 records).
[2025-10-24T00:30:42.402423] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-10.
[2025-10-24T00:30:42.442960] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T00:30:43.207871] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-03.
[2025-10-24T00:30:43.266807] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T00:30:43.517326] [INFO ] [REMOTE    ] WAT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:30:43.981715] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T00:30:43.989260] [INFO ] [REMOTE    ] WAB: Full fetch complete (64406 records).
[2025-10-24T00:30:44.004569] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-09.
[2025-10-24T00:30:44.809133] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-01.
[2025-10-24T00:30:45.194036] [INFO ] [REMOTE    ] WBI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:30:45.195554] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T00:30:45.599413] [INFO ] [REMOTE    ] WBI: Fetching primary data for 2025-01.
[2025-10-24T00:30:45.707911] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T00:30:45.805216] [DEBUG] [REMOTE    ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:30:45.805584] [WARN ] [REMOTE    ] WBI: No data returned for month 2025-01
[2025-10-24T00:30:45.805712] [FATAL] [REMOTE    ] WBI: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:30:46.400078] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-10.
[2025-10-24T00:30:46.519932] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T00:30:46.608340] [INFO ] [REMOTE    ] WBS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:30:47.199444] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-01.
[2025-10-24T00:30:47.999430] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-02.
[2025-10-24T00:30:48.054780] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T00:30:48.062822] [INFO ] [REMOTE    ] VYX: Full fetch complete (70213 records).
[2025-10-24T00:30:48.801256] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-04.
[2025-10-24T00:30:48.941517] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T00:30:49.303454] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T00:30:49.548325] [INFO ] [REMOTE    ] WBX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:30:49.599461] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-01.
[2025-10-24T00:30:50.399415] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-02.
[2025-10-24T00:30:50.644567] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T00:30:50.846384] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T00:30:51.199499] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-03.
[2025-10-24T00:30:51.919125] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T00:30:51.999463] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-05.
[2025-10-24T00:30:52.614725] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T00:30:52.799449] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-02.
[2025-10-24T00:30:53.236603] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T00:30:53.599471] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-04.
[2025-10-24T00:30:53.645006] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T00:30:54.399439] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-03.
[2025-10-24T00:30:54.646451] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T00:30:55.199454] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-05.
[2025-10-24T00:30:55.755524] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T00:30:55.999454] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-06.
[2025-10-24T00:30:56.721019] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T00:30:56.799443] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-06.
[2025-10-24T00:30:57.500768] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T00:30:57.599441] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-07.
[2025-10-24T00:30:58.093332] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T00:30:58.399427] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-07.
[2025-10-24T00:30:59.199434] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-04.
[2025-10-24T00:30:59.274417] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T00:30:59.999466] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-03.
[2025-10-24T00:31:00.058840] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T00:31:00.787675] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T00:31:00.799391] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-05.
[2025-10-24T00:31:01.329080] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T00:31:01.599458] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-08.
[2025-10-24T00:31:02.399436] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-04.
[2025-10-24T00:31:02.473846] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T00:31:03.052816] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T00:31:03.079680] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T00:31:03.199471] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-09.
[2025-10-24T00:31:03.999452] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-06.
[2025-10-24T00:31:04.799408] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-08.
[2025-10-24T00:31:04.931863] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T00:31:05.599420] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-05.
[2025-10-24T00:31:05.776717] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T00:31:06.372547] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T00:31:06.399393] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-09.
[2025-10-24T00:31:06.482764] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T00:31:07.199446] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-07.
[2025-10-24T00:31:07.999430] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-10.
[2025-10-24T00:31:08.038259] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T00:31:08.658512] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T00:31:08.799418] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-08.
[2025-10-24T00:31:09.149110] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T00:31:09.158232] [INFO ] [REMOTE    ] WAT: Full fetch complete (50952 records).
[2025-10-24T00:31:09.603318] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-10.
[2025-10-24T00:31:10.417061] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-06.
[2025-10-24T00:31:10.528617] [INFO ] [REMOTE    ] WCC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:31:10.555024] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T00:31:11.199415] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-09.
[2025-10-24T00:31:11.324084] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T00:31:11.332777] [INFO ] [REMOTE    ] WAL: Full fetch complete (67352 records).
[2025-10-24T00:31:11.536907] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T00:31:12.001688] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-07.
[2025-10-24T00:31:12.764428] [INFO ] [REMOTE    ] WCN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:31:12.760029] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T00:31:12.799391] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-01.
[2025-10-24T00:31:13.004781] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T00:31:13.599439] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-08.
[2025-10-24T00:31:14.198571] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T00:31:14.324959] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T00:31:14.399432] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-09.
[2025-10-24T00:31:14.991728] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-09 (0.59 seconds).
[2025-10-24T00:31:15.199480] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-10.
[2025-10-24T00:31:15.999472] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-01.
[2025-10-24T00:31:16.799439] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-10.
[2025-10-24T00:31:16.867732] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T00:31:16.876554] [INFO ] [REMOTE    ] WBS: Full fetch complete (70374 records).
[2025-10-24T00:31:17.503492] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T00:31:17.517483] [INFO ] [REMOTE    ] WBX: Full fetch complete (21428 records).
[2025-10-24T00:31:17.610513] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-02.
[2025-10-24T00:31:17.871754] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T00:31:18.404099] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-02.
[2025-10-24T00:31:19.198162] [INFO ] [REMOTE    ] WD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:31:19.224665] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-01.
[2025-10-24T00:31:19.559223] [INFO ] [REMOTE    ] WDH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:31:19.583444] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-02 (1.97 seconds).
[2025-10-24T00:31:19.999411] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-01.
[2025-10-24T00:31:20.058244] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T00:31:20.099824] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T00:31:20.449567] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-01 (0.45 seconds).
[2025-10-24T00:31:20.799433] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-03.
[2025-10-24T00:31:21.599434] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-03.
[2025-10-24T00:31:22.399423] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-02.
[2025-10-24T00:31:22.489973] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T00:31:23.199487] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-04.
[2025-10-24T00:31:23.210062] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T00:31:23.248014] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T00:31:23.999459] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-02.
[2025-10-24T00:31:24.799435] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-04.
[2025-10-24T00:31:25.087199] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T00:31:25.130345] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T00:31:25.599444] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-05.
[2025-10-24T00:31:26.407158] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-03.
[2025-10-24T00:31:26.410523] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T00:31:27.008687] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T00:31:27.199436] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-05.
[2025-10-24T00:31:27.621576] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T00:31:27.999431] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-06.
[2025-10-24T00:31:28.759968] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T00:31:28.799419] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-03.
[2025-10-24T00:31:29.599422] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-04.
[2025-10-24T00:31:29.633483] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T00:31:29.762125] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T00:31:30.399408] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-06.
[2025-10-24T00:31:30.816988] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T00:31:31.199440] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-04.
[2025-10-24T00:31:31.840695] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T00:31:31.999412] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-07.
[2025-10-24T00:31:32.142813] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-04 (0.94 seconds).
[2025-10-24T00:31:32.799464] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-05.
[2025-10-24T00:31:33.599451] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-05.
[2025-10-24T00:31:33.680637] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T00:31:33.972108] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T00:31:34.072271] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T00:31:34.399438] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-06.
[2025-10-24T00:31:35.199420] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-08.
[2025-10-24T00:31:35.305883] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T00:31:35.999457] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-07.
[2025-10-24T00:31:36.799474] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-06.
[2025-10-24T00:31:36.830548] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T00:31:37.015388] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T00:31:37.599408] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-08.
[2025-10-24T00:31:37.871375] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T00:31:38.399492] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-09.
[2025-10-24T00:31:38.591894] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T00:31:39.199443] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-09.
[2025-10-24T00:31:39.999414] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-07.
[2025-10-24T00:31:40.103201] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T00:31:40.601062] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T00:31:40.799472] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-10.
[2025-10-24T00:31:41.221498] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T00:31:41.599441] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-10.
[2025-10-24T00:31:42.358065] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T00:31:42.366574] [INFO ] [REMOTE    ] WCN: Full fetch complete (69499 records).
[2025-10-24T00:31:42.404587] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-07.
[2025-10-24T00:31:42.777266] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T00:31:42.831032] [INFO ] [REMOTE    ] WDH: Full fetch complete (23958 records).
[2025-10-24T00:31:43.203872] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-08.
[2025-10-24T00:31:44.248698] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T00:31:44.259073] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-08.
[2025-10-24T00:31:44.421731] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-08 (1.22 seconds).
[2025-10-24T00:31:44.803527] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-09.
[2025-10-24T00:31:44.887250] [INFO ] [REMOTE    ] WDI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:31:45.319867] [INFO ] [REMOTE    ] WDS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:31:45.599404] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-01.
[2025-10-24T00:31:45.744942] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T00:31:45.796784] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T00:31:46.399579] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-01.
[2025-10-24T00:31:47.204546] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-10.
[2025-10-24T00:31:47.220756] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T00:31:47.279960] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T00:31:47.999494] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-02.
[2025-10-24T00:31:48.114259] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T00:31:48.117412] [INFO ] [REMOTE    ] WD: Full fetch complete (33026 records).
[2025-10-24T00:31:48.804591] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-02.
[2025-10-24T00:31:49.311516] [INFO ] [REMOTE    ] WEA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:31:49.425895] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T00:31:49.599467] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-03.
[2025-10-24T00:31:49.978774] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T00:31:50.399444] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-09.
[2025-10-24T00:31:51.199725] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-03.
[2025-10-24T00:31:51.199607] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T00:31:51.927354] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T00:31:51.999451] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-10.
[2025-10-24T00:31:52.253119] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T00:31:52.799506] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-01.
[2025-10-24T00:31:53.345227] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T00:31:53.354318] [INFO ] [REMOTE    ] WCC: Full fetch complete (57028 records).
[2025-10-24T00:31:53.467561] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-01 (0.67 seconds).
[2025-10-24T00:31:53.604509] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-04.
[2025-10-24T00:31:54.408739] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-04.
[2025-10-24T00:31:54.734009] [INFO ] [REMOTE    ] WEAV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:31:55.163606] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T00:31:55.199409] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-02.
[2025-10-24T00:31:55.644125] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T00:31:55.817844] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T00:31:55.999426] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-01.
[2025-10-24T00:31:56.799451] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-03.
[2025-10-24T00:31:57.409553] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T00:31:57.521055] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T00:31:57.599440] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-04.
[2025-10-24T00:31:58.282633] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-04 (0.68 seconds).
[2025-10-24T00:31:58.399409] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-05.
[2025-10-24T00:31:59.199430] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-02.
[2025-10-24T00:31:59.473711] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T00:31:59.999508] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-05.
[2025-10-24T00:32:00.756101] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T00:32:00.799448] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-03.
[2025-10-24T00:32:01.207158] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-05 (1.21 seconds).
[2025-10-24T00:32:01.599420] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-05.
[2025-10-24T00:32:01.980898] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T00:32:02.319121] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-05 (0.72 seconds).
[2025-10-24T00:32:02.399427] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-06.
[2025-10-24T00:32:03.159161] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T00:32:03.199393] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-07.
[2025-10-24T00:32:03.999420] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-06.
[2025-10-24T00:32:04.348108] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T00:32:04.799484] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-04.
[2025-10-24T00:32:05.599420] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-08.
[2025-10-24T00:32:05.630856] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T00:32:06.012275] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T00:32:06.399412] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-05.
[2025-10-24T00:32:06.661800] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T00:32:07.199432] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-07.
[2025-10-24T00:32:07.952663] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T00:32:07.999472] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-09.
[2025-10-24T00:32:08.799432] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-06.
[2025-10-24T00:32:08.808714] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T00:32:09.008291] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T00:32:09.599441] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-06.
[2025-10-24T00:32:10.264322] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T00:32:10.345602] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T00:32:10.399451] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-10.
[2025-10-24T00:32:11.199414] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-08.
[2025-10-24T00:32:11.411632] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T00:32:11.415748] [INFO ] [REMOTE    ] WDI: Full fetch complete (30330 records).
[2025-10-24T00:32:11.999453] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-07.
[2025-10-24T00:32:12.800233] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-07.
[2025-10-24T00:32:12.802451] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T00:32:13.468747] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T00:32:13.604242] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-09.
[2025-10-24T00:32:13.605059] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T00:32:14.399472] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-08.
[2025-10-24T00:32:15.200298] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T00:32:15.200381] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-08.
[2025-10-24T00:32:15.865161] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T00:32:15.888735] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T00:32:15.999466] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-09.
[2025-10-24T00:32:16.442169] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-09 (0.44 seconds).
[2025-10-24T00:32:16.799436] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-09.
[2025-10-24T00:32:17.599469] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-10.
[2025-10-24T00:32:18.237036] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T00:32:18.399466] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-10.
[2025-10-24T00:32:18.796943] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T00:32:18.805568] [INFO ] [REMOTE    ] WDS: Full fetch complete (64166 records).
[2025-10-24T00:32:19.209788] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-10.
[2025-10-24T00:32:19.898039] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T00:32:19.900254] [INFO ] [REMOTE    ] WEA: Full fetch complete (10117 records).
[2025-10-24T00:32:20.111201] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T00:32:20.220001] [INFO ] [REMOTE    ] WEAV: Full fetch complete (61765 records).
[2025-10-24T00:32:23.880840] [INFO ] [REMOTE    ] WEX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:32:24.001062] [INFO ] [REMOTE    ] WES: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:32:24.001406] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-01.
[2025-10-24T00:32:24.104764] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-01.
[2025-10-24T00:32:24.132627] [INFO ] [REMOTE    ] WELL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:32:24.152500] [INFO ] [REMOTE    ] WEC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:32:24.152939] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-01.
[2025-10-24T00:32:24.153372] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-01.
[2025-10-24T00:32:25.603988] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-01 (1.60 seconds).
[2025-10-24T00:32:25.610895] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-02.
[2025-10-24T00:32:25.713111] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T00:32:25.723416] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-02.
[2025-10-24T00:32:25.757036] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T00:32:25.767163] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-02.
[2025-10-24T00:32:25.796525] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T00:32:25.807691] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-02.
[2025-10-24T00:32:26.869221] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T00:32:26.876846] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-03.
[2025-10-24T00:32:27.385238] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T00:32:27.394848] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-03.
[2025-10-24T00:32:27.637210] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-02 (1.91 seconds).
[2025-10-24T00:32:27.675807] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T00:32:27.999484] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-03.
[2025-10-24T00:32:28.597467] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T00:32:28.799432] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-04.
[2025-10-24T00:32:28.891586] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T00:32:29.599484] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-04.
[2025-10-24T00:32:29.877391] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T00:32:30.410180] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-03.
[2025-10-24T00:32:30.415296] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T00:32:31.199476] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-05.
[2025-10-24T00:32:31.254024] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T00:32:31.999448] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-04.
[2025-10-24T00:32:32.311994] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T00:32:32.620376] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T00:32:32.799442] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-04.
[2025-10-24T00:32:33.599430] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-05.
[2025-10-24T00:32:33.758616] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T00:32:34.399434] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-05.
[2025-10-24T00:32:34.745189] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-04 (1.95 seconds).
[2025-10-24T00:32:35.084810] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T00:32:35.199438] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-05.
[2025-10-24T00:32:35.999441] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-06.
[2025-10-24T00:32:36.194217] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T00:32:36.799510] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-06.
[2025-10-24T00:32:37.039057] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T00:32:37.604530] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-06.
[2025-10-24T00:32:37.623667] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T00:32:38.284499] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T00:32:38.399406] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-07.
[2025-10-24T00:32:39.121986] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T00:32:39.199419] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-06.
[2025-10-24T00:32:39.713367] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T00:32:39.999459] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-07.
[2025-10-24T00:32:40.573795] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T00:32:40.799446] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-07.
[2025-10-24T00:32:41.599436] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-07.
[2025-10-24T00:32:41.817153] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T00:32:42.136395] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T00:32:42.399435] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-08.
[2025-10-24T00:32:43.041234] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T00:32:43.199448] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-08.
[2025-10-24T00:32:43.781617] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T00:32:43.999447] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-08.
[2025-10-24T00:32:44.739097] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T00:32:44.799484] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-09.
[2025-10-24T00:32:45.425803] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T00:32:45.599527] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-09.
[2025-10-24T00:32:46.100330] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T00:32:46.399436] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-10.
[2025-10-24T00:32:47.199423] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-09.
[2025-10-24T00:32:47.450209] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-09 (1.85 seconds).
[2025-10-24T00:32:47.572607] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T00:32:47.577777] [INFO ] [REMOTE    ] WEX: Full fetch complete (50418 records).
[2025-10-24T00:32:48.000541] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-08.
[2025-10-24T00:32:48.807595] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-10.
[2025-10-24T00:32:48.869365] [INFO ] [REMOTE    ] WF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:32:48.900691] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T00:32:49.599429] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-01.
[2025-10-24T00:32:49.729598] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T00:32:50.399427] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-10.
[2025-10-24T00:32:50.417607] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T00:32:50.465407] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T00:32:50.478553] [INFO ] [REMOTE    ] WEC: Full fetch complete (75897 records).
[2025-10-24T00:32:51.199622] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-02.
[2025-10-24T00:32:51.980209] [INFO ] [REMOTE    ] WFC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:32:51.988307] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T00:32:52.004536] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-01.
[2025-10-24T00:32:52.016737] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T00:32:52.025943] [INFO ] [REMOTE    ] WELL: Full fetch complete (76007 records).
[2025-10-24T00:32:52.804630] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-09.
[2025-10-24T00:32:53.459721] [INFO ] [REMOTE    ] WFG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:32:53.599420] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-01.
[2025-10-24T00:32:54.063200] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-01 (2.06 seconds).
[2025-10-24T00:32:54.399448] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-02.
[2025-10-24T00:32:54.573627] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T00:32:54.685945] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T00:32:55.199451] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-10.
[2025-10-24T00:32:55.999424] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-03.
[2025-10-24T00:32:56.180396] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T00:32:56.784448] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T00:32:56.799389] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-03.
[2025-10-24T00:32:56.923075] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T00:32:56.933463] [INFO ] [REMOTE    ] WES: Full fetch complete (70651 records).
[2025-10-24T00:32:57.609731] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-04.
[2025-10-24T00:32:58.333284] [INFO ] [REMOTE    ] WGO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:32:58.399434] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-01.
[2025-10-24T00:32:58.624689] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T00:32:58.995860] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-03 (2.20 seconds).
[2025-10-24T00:32:59.199407] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-04.
[2025-10-24T00:32:59.860953] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T00:32:59.999442] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-05.
[2025-10-24T00:33:00.799455] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-02.
[2025-10-24T00:33:00.962116] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-05 (0.96 seconds).
[2025-10-24T00:33:01.529019] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-04 (2.33 seconds).
[2025-10-24T00:33:01.599472] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-06.
[2025-10-24T00:33:02.237384] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T00:33:02.337286] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T00:33:02.399415] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-07.
[2025-10-24T00:33:03.199418] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-05.
[2025-10-24T00:33:03.507956] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T00:33:03.999468] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-08.
[2025-10-24T00:33:04.710669] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T00:33:04.799441] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-02.
[2025-10-24T00:33:05.296710] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-05 (2.10 seconds).
[2025-10-24T00:33:05.599432] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-03.
[2025-10-24T00:33:05.958348] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T00:33:06.399486] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-09.
[2025-10-24T00:33:07.199476] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-03.
[2025-10-24T00:33:07.206980] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T00:33:07.290212] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T00:33:07.999467] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-04.
[2025-10-24T00:33:08.407221] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T00:33:08.799489] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-10.
[2025-10-24T00:33:09.553619] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T00:33:09.576391] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T00:33:09.578572] [INFO ] [REMOTE    ] WF: Full fetch complete (16010 records).
[2025-10-24T00:33:09.607914] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-04.
[2025-10-24T00:33:10.404700] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-05.
[2025-10-24T00:33:10.746685] [INFO ] [REMOTE    ] WH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:33:11.006365] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-04 (1.40 seconds).
[2025-10-24T00:33:11.199458] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-05.
[2025-10-24T00:33:11.948629] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T00:33:11.999399] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-06.
[2025-10-24T00:33:12.285713] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T00:33:12.799452] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-01.
[2025-10-24T00:33:13.610549] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-06.
[2025-10-24T00:33:13.613270] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T00:33:14.282140] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T00:33:14.399414] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-06.
[2025-10-24T00:33:15.199423] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-02.
[2025-10-24T00:33:15.508946] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-06 (1.90 seconds).
[2025-10-24T00:33:15.533976] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T00:33:15.999433] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-07.
[2025-10-24T00:33:16.748766] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T00:33:16.799396] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-03.
[2025-10-24T00:33:17.599425] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-07.
[2025-10-24T00:33:18.152243] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-07 (2.15 seconds).
[2025-10-24T00:33:18.405279] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-07.
[2025-10-24T00:33:18.409734] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T00:33:18.443427] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T00:33:19.199451] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-08.
[2025-10-24T00:33:19.791605] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T00:33:19.999400] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-08.
[2025-10-24T00:33:20.396073] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T00:33:20.799439] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-08.
[2025-10-24T00:33:21.146526] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T00:33:21.599427] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-09.
[2025-10-24T00:33:22.399395] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-04.
[2025-10-24T00:33:22.961494] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-08 (2.16 seconds).
[2025-10-24T00:33:23.083875] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T00:33:23.199399] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-10.
[2025-10-24T00:33:23.999472] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-09.
[2025-10-24T00:33:24.033306] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T00:33:24.740986] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T00:33:24.747794] [INFO ] [REMOTE    ] WGO: Full fetch complete (57183 records).
[2025-10-24T00:33:24.811262] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-09.
[2025-10-24T00:33:25.603673] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-05.
[2025-10-24T00:33:26.104507] [INFO ] [REMOTE    ] WHD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:33:26.134540] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-09 (2.14 seconds).
[2025-10-24T00:33:26.212537] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T00:33:26.399465] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-10.
[2025-10-24T00:33:26.943174] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T00:33:27.199403] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-06.
[2025-10-24T00:33:27.474925] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T00:33:27.479341] [INFO ] [REMOTE    ] WFG: Full fetch complete (36532 records).
[2025-10-24T00:33:28.001567] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-10.
[2025-10-24T00:33:28.706074] [INFO ] [REMOTE    ] WHG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:33:28.729957] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T00:33:28.799409] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-07.
[2025-10-24T00:33:29.599456] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-01.
[2025-10-24T00:33:30.164983] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-10 (2.16 seconds).
[2025-10-24T00:33:30.174766] [INFO ] [REMOTE    ] WFC: Full fetch complete (77927 records).
[2025-10-24T00:33:30.404801] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-01.
[2025-10-24T00:33:30.603026] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T00:33:30.952936] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-01 (0.55 seconds).
[2025-10-24T00:33:31.145230] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T00:33:31.199685] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-08.
[2025-10-24T00:33:31.720541] [INFO ] [REMOTE    ] WHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:33:31.999537] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-01.
[2025-10-24T00:33:32.799456] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-02.
[2025-10-24T00:33:32.874083] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T00:33:33.599503] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-09.
[2025-10-24T00:33:33.665461] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T00:33:34.150257] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T00:33:34.399464] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-02.
[2025-10-24T00:33:35.199426] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-02.
[2025-10-24T00:33:35.273981] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T00:33:35.767440] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-02 (0.57 seconds).
[2025-10-24T00:33:35.999445] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-10.
[2025-10-24T00:33:36.063852] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T00:33:36.799431] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-03.
[2025-10-24T00:33:37.372479] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-03 (0.57 seconds).
[2025-10-24T00:33:37.584956] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T00:33:37.594131] [INFO ] [REMOTE    ] WH: Full fetch complete (65737 records).
[2025-10-24T00:33:37.606514] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-03.
[2025-10-24T00:33:38.404556] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-04.
[2025-10-24T00:33:39.084611] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-04 (0.68 seconds).
[2025-10-24T00:33:39.170821] [INFO ] [REMOTE    ] WIA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:33:39.199400] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-01.
[2025-10-24T00:33:39.444445] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T00:33:39.827922] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T00:33:39.999451] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-05.
[2025-10-24T00:33:40.604756] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T00:33:40.799440] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-06.
[2025-10-24T00:33:41.415006] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T00:33:41.599422] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-02.
[2025-10-24T00:33:42.184813] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T00:33:42.399442] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-03.
[2025-10-24T00:33:43.003143] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T00:33:43.199457] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-04.
[2025-10-24T00:33:43.783452] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-04 (0.58 seconds).
[2025-10-24T00:33:43.999469] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-03.
[2025-10-24T00:33:44.799482] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-05.
[2025-10-24T00:33:45.448450] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T00:33:45.604367] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-06.
[2025-10-24T00:33:45.609307] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T00:33:46.206459] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T00:33:46.399446] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-07.
[2025-10-24T00:33:46.998000] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T00:33:47.199422] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-04.
[2025-10-24T00:33:47.999577] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-07.
[2025-10-24T00:33:48.609005] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-07 (0.61 seconds).
[2025-10-24T00:33:48.799474] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-04.
[2025-10-24T00:33:48.842439] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T00:33:49.599485] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-08.
[2025-10-24T00:33:50.222804] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T00:33:50.399416] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-05.
[2025-10-24T00:33:50.669878] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T00:33:51.199436] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-09.
[2025-10-24T00:33:51.901499] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T00:33:51.902503] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T00:33:51.999419] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-05.
[2025-10-24T00:33:52.799467] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-06.
[2025-10-24T00:33:53.599465] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-08.
[2025-10-24T00:33:53.808574] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T00:33:53.982509] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-08 (0.38 seconds).
[2025-10-24T00:33:54.282111] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T00:33:54.399423] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-07.
[2025-10-24T00:33:55.199444] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-09.
[2025-10-24T00:33:55.657069] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-09 (0.46 seconds).
[2025-10-24T00:33:55.928299] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T00:33:55.999411] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-10.
[2025-10-24T00:33:56.368260] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-10 (0.37 seconds).
[2025-10-24T00:33:56.369111] [INFO ] [REMOTE    ] WHG: Full fetch complete (4359 records).
[2025-10-24T00:33:56.804517] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-06.
[2025-10-24T00:33:57.449982] [INFO ] [REMOTE    ] WINN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:33:57.599436] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-10.
[2025-10-24T00:33:58.215425] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-10 (0.62 seconds).
[2025-10-24T00:33:58.217073] [INFO ] [REMOTE    ] WIA: Full fetch complete (7284 records).
[2025-10-24T00:33:58.410151] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-08.
[2025-10-24T00:33:58.758102] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T00:33:59.206214] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-07.
[2025-10-24T00:33:59.411379] [INFO ] [REMOTE    ] WIT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:33:59.728728] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T00:33:59.999438] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-01.
[2025-10-24T00:34:00.799444] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-09.
[2025-10-24T00:34:01.391342] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-07 (2.19 seconds).
[2025-10-24T00:34:01.599422] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-08.
[2025-10-24T00:34:01.706446] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T00:34:02.079475] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T00:34:02.399446] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-02.
[2025-10-24T00:34:03.199425] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-10.
[2025-10-24T00:34:03.444334] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T00:34:03.981254] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T00:34:03.999394] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-03.
[2025-10-24T00:34:04.320405] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T00:34:04.327889] [INFO ] [REMOTE    ] WHD: Full fetch complete (58033 records).
[2025-10-24T00:34:04.801584] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-01.
[2025-10-24T00:34:05.604418] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-09.
[2025-10-24T00:34:05.686681] [INFO ] [REMOTE    ] WIW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:34:05.776919] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T00:34:05.779804] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T00:34:06.399428] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-01.
[2025-10-24T00:34:07.199411] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-02.
[2025-10-24T00:34:07.323221] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T00:34:07.467304] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T00:34:07.988951] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T00:34:07.999388] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-03.
[2025-10-24T00:34:08.799407] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-04.
[2025-10-24T00:34:08.965503] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T00:34:09.599440] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-10.
[2025-10-24T00:34:10.342679] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T00:34:10.399396] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-05.
[2025-10-24T00:34:11.199428] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-02.
[2025-10-24T00:34:11.455108] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T00:34:11.463613] [INFO ] [REMOTE    ] WHR: Full fetch complete (69773 records).
[2025-10-24T00:34:12.043397] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-04.
[2025-10-24T00:34:12.116456] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T00:34:12.154202] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T00:34:12.807139] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-06.
[2025-10-24T00:34:12.955580] [INFO ] [REMOTE    ] WK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:34:13.048029] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T00:34:13.599440] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-01.
[2025-10-24T00:34:14.399468] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-03.
[2025-10-24T00:34:14.734520] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-06 (1.93 seconds).
[2025-10-24T00:34:15.062178] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T00:34:15.199402] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-07.
[2025-10-24T00:34:15.469723] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T00:34:15.999449] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-02.
[2025-10-24T00:34:16.799423] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-04.
[2025-10-24T00:34:17.194229] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-07 (1.99 seconds).
[2025-10-24T00:34:17.388264] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T00:34:17.503570] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-04 (0.70 seconds).
[2025-10-24T00:34:17.599405] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-05.
[2025-10-24T00:34:18.399423] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-05.
[2025-10-24T00:34:18.432284] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T00:34:19.076156] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T00:34:19.199405] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-03.
[2025-10-24T00:34:19.999488] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-06.
[2025-10-24T00:34:20.692772] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T00:34:20.776134] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T00:34:20.799401] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-07.
[2025-10-24T00:34:21.595618] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T00:34:21.599390] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-08.
[2025-10-24T00:34:22.371824] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T00:34:22.399405] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-08.
[2025-10-24T00:34:23.199434] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-09.
[2025-10-24T00:34:23.999416] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-06.
[2025-10-24T00:34:24.144441] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T00:34:24.184487] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T00:34:24.793561] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T00:34:24.799383] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-07.
[2025-10-24T00:34:25.599416] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-09.
[2025-10-24T00:34:25.901949] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T00:34:26.399537] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-04.
[2025-10-24T00:34:27.199455] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-10.
[2025-10-24T00:34:27.414984] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T00:34:27.904162] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T00:34:27.972285] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T00:34:27.974736] [INFO ] [REMOTE    ] WINN: Full fetch complete (17325 records).
[2025-10-24T00:34:28.004717] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-08.
[2025-10-24T00:34:28.804779] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-10.
[2025-10-24T00:34:29.147610] [INFO ] [REMOTE    ] WKC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:34:29.161974] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-08 (1.16 seconds).
[2025-10-24T00:34:29.599437] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-01.
[2025-10-24T00:34:30.388480] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T00:34:30.397887] [INFO ] [REMOTE    ] WIT: Full fetch complete (76019 records).
[2025-10-24T00:34:30.410135] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-05.
[2025-10-24T00:34:31.024176] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T00:34:31.204776] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-02.
[2025-10-24T00:34:31.870132] [INFO ] [REMOTE    ] WLK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:34:31.919626] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T00:34:31.999400] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-01.
[2025-10-24T00:34:32.288046] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T00:34:32.799486] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-03.
[2025-10-24T00:34:33.051192] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T00:34:33.599441] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-02.
[2025-10-24T00:34:34.275283] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T00:34:34.399470] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-06.
[2025-10-24T00:34:34.728945] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T00:34:35.199453] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-04.
[2025-10-24T00:34:35.699560] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T00:34:35.999445] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-07.
[2025-10-24T00:34:36.719145] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T00:34:36.799503] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-03.
[2025-10-24T00:34:37.494610] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T00:34:37.599467] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-08.
[2025-10-24T00:34:38.399489] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-05.
[2025-10-24T00:34:38.442861] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T00:34:39.174706] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T00:34:39.199414] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-04.
[2025-10-24T00:34:39.476551] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T00:34:39.999484] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-09.
[2025-10-24T00:34:40.804665] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-09.
[2025-10-24T00:34:40.820474] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T00:34:40.894693] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T00:34:41.599433] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-10.
[2025-10-24T00:34:42.395911] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T00:34:42.404150] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-06.
[2025-10-24T00:34:42.702831] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T00:34:42.706447] [INFO ] [REMOTE    ] WIW: Full fetch complete (29282 records).
[2025-10-24T00:34:43.204509] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-10.
[2025-10-24T00:34:43.920626] [INFO ] [REMOTE    ] WLKP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:34:43.901384] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T00:34:43.999393] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-01.
[2025-10-24T00:34:44.724611] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T00:34:44.736096] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T00:34:44.738689] [INFO ] [REMOTE    ] WK: Full fetch complete (53472 records).
[2025-10-24T00:34:44.804636] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-05.
[2025-10-24T00:34:45.604632] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-07.
[2025-10-24T00:34:45.869792] [INFO ] [REMOTE    ] WLTG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:34:46.399502] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-02.
[2025-10-24T00:34:46.662930] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T00:34:46.697981] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T00:34:46.812778] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-02 (0.41 seconds).
[2025-10-24T00:34:47.199455] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-08.
[2025-10-24T00:34:47.999448] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-06.
[2025-10-24T00:34:48.558697] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T00:34:48.799433] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-09.
[2025-10-24T00:34:49.599463] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-03.
[2025-10-24T00:34:49.705254] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T00:34:50.187728] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T00:34:50.295591] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T00:34:50.399429] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-07.
[2025-10-24T00:34:51.199437] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-01.
[2025-10-24T00:34:51.557816] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-01 (0.36 seconds).
[2025-10-24T00:34:51.999414] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-02.
[2025-10-24T00:34:52.088264] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T00:34:52.358660] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-02 (0.36 seconds).
[2025-10-24T00:34:52.799439] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-03.
[2025-10-24T00:34:53.153356] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-03 (0.35 seconds).
[2025-10-24T00:34:53.599464] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-10.
[2025-10-24T00:34:54.399451] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-04.
[2025-10-24T00:34:54.971268] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-04 (0.57 seconds).
[2025-10-24T00:34:54.986751] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T00:34:54.992516] [INFO ] [REMOTE    ] WKC: Full fetch complete (50160 records).
[2025-10-24T00:34:55.204722] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-05.
[2025-10-24T00:34:55.667686] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-05 (0.46 seconds).
[2025-10-24T00:34:56.004839] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-06.
[2025-10-24T00:34:56.324488] [INFO ] [REMOTE    ] WLY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:34:56.383420] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-06 (0.38 seconds).
[2025-10-24T00:34:56.799432] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-07.
[2025-10-24T00:34:57.233135] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-07 (0.43 seconds).
[2025-10-24T00:34:57.599424] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-08.
[2025-10-24T00:34:58.036123] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T00:34:58.399427] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-04.
[2025-10-24T00:34:59.143250] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T00:34:59.199447] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-09.
[2025-10-24T00:34:59.546446] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-09 (0.35 seconds).
[2025-10-24T00:34:59.999423] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-05.
[2025-10-24T00:35:00.750363] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T00:35:00.799407] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-06.
[2025-10-24T00:35:01.536885] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T00:35:01.599473] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-07.
[2025-10-24T00:35:02.229638] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T00:35:02.399477] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-08.
[2025-10-24T00:35:03.199408] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-01.
[2025-10-24T00:35:03.999414] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-10.
[2025-10-24T00:35:04.178270] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T00:35:04.232081] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T00:35:04.365170] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-10 (0.37 seconds).
[2025-10-24T00:35:04.366083] [INFO ] [REMOTE    ] WLTG: Full fetch complete (1666 records).
[2025-10-24T00:35:04.804709] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-09.
[2025-10-24T00:35:05.340597] [INFO ] [REMOTE    ] WM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:35:05.599452] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-01.
[2025-10-24T00:35:06.399426] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-02.
[2025-10-24T00:35:06.522363] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T00:35:07.199446] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-10.
[2025-10-24T00:35:07.606246] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T00:35:07.662162] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T00:35:07.999437] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-08.
[2025-10-24T00:35:08.622936] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T00:35:08.631155] [INFO ] [REMOTE    ] WLK: Full fetch complete (64094 records).
[2025-10-24T00:35:08.782530] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T00:35:08.799424] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-03.
[2025-10-24T00:35:09.604623] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-09.
[2025-10-24T00:35:10.051480] [INFO ] [REMOTE    ] WMB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:35:10.161168] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T00:35:10.332579] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T00:35:10.399404] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-10.
[2025-10-24T00:35:11.199413] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-01.
[2025-10-24T00:35:11.307810] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T00:35:11.309956] [INFO ] [REMOTE    ] WLKP: Full fetch complete (10072 records).
[2025-10-24T00:35:12.004560] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-04.
[2025-10-24T00:35:12.418479] [INFO ] [REMOTE    ] WMK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:35:12.799475] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-02.
[2025-10-24T00:35:13.107029] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T00:35:13.178531] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T00:35:13.599455] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-05.
[2025-10-24T00:35:14.399426] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-01.
[2025-10-24T00:35:14.510011] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T00:35:14.998310] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T00:35:15.012723] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T00:35:15.199441] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-02.
[2025-10-24T00:35:15.999492] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-02.
[2025-10-24T00:35:16.799472] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-06.
[2025-10-24T00:35:16.841333] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T00:35:16.993352] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T00:35:17.599451] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-03.
[2025-10-24T00:35:18.115507] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T00:35:18.399445] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-03.
[2025-10-24T00:35:18.654707] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T00:35:19.199435] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-03.
[2025-10-24T00:35:19.999472] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-07.
[2025-10-24T00:35:20.340441] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-03 (1.94 seconds).
[2025-10-24T00:35:20.799430] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-04.
[2025-10-24T00:35:21.145457] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-03 (1.95 seconds).
[2025-10-24T00:35:21.389358] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T00:35:21.599444] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-04.
[2025-10-24T00:35:22.399516] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-08.
[2025-10-24T00:35:22.719211] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-04 (1.92 seconds).
[2025-10-24T00:35:23.199471] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-05.
[2025-10-24T00:35:23.237904] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T00:35:23.716482] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-04 (2.12 seconds).
[2025-10-24T00:35:23.999429] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-09.
[2025-10-24T00:35:24.799509] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-05.
[2025-10-24T00:35:25.109261] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T00:35:25.165742] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T00:35:25.599446] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-06.
[2025-10-24T00:35:26.399419] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-10.
[2025-10-24T00:35:26.755162] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-05 (1.96 seconds).
[2025-10-24T00:35:27.199423] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-06.
[2025-10-24T00:35:27.423779] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T00:35:27.676132] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T00:35:27.681518] [INFO ] [REMOTE    ] WLY: Full fetch complete (42931 records).
[2025-10-24T00:35:28.012417] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-07.
[2025-10-24T00:35:28.805846] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-04.
[2025-10-24T00:35:28.992957] [INFO ] [REMOTE    ] WMS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:35:29.167737] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-06 (1.97 seconds).
[2025-10-24T00:35:29.558728] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T00:35:29.599410] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-05.
[2025-10-24T00:35:30.148978] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-07 (2.14 seconds).
[2025-10-24T00:35:30.399438] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-07.
[2025-10-24T00:35:30.645189] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T00:35:31.199434] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-08.
[2025-10-24T00:35:31.999495] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-06.
[2025-10-24T00:35:32.376203] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-07 (1.98 seconds).
[2025-10-24T00:35:32.799415] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-08.
[2025-10-24T00:35:32.890569] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T00:35:33.028978] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T00:35:33.599418] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-09.
[2025-10-24T00:35:34.399429] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-07.
[2025-10-24T00:35:34.741569] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T00:35:35.199431] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-01.
[2025-10-24T00:35:35.293612] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T00:35:35.547192] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-09 (1.95 seconds).
[2025-10-24T00:35:35.999484] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-08.
[2025-10-24T00:35:36.651123] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T00:35:36.799412] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-02.
[2025-10-24T00:35:36.921303] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T00:35:37.599462] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-09.
[2025-10-24T00:35:38.280205] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T00:35:38.399440] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-09.
[2025-10-24T00:35:39.199542] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-10.
[2025-10-24T00:35:39.295683] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T00:35:39.681776] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-09 (2.08 seconds).
[2025-10-24T00:35:39.999451] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-10.
[2025-10-24T00:35:40.696884] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T00:35:40.706188] [INFO ] [REMOTE    ] WMB: Full fetch complete (77851 records).
[2025-10-24T00:35:40.799738] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-10.
[2025-10-24T00:35:40.858864] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-10 (0.86 seconds).
[2025-10-24T00:35:40.900405] [INFO ] [REMOTE    ] WMK: Full fetch complete (20022 records).
[2025-10-24T00:35:41.607458] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-03.
[2025-10-24T00:35:43.161969] [INFO ] [REMOTE    ] WMT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:35:43.173896] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-01.
[2025-10-24T00:35:43.173404] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-10 (2.37 seconds).
[2025-10-24T00:35:43.205365] [INFO ] [REMOTE    ] WM: Full fetch complete (73834 records).
[2025-10-24T00:35:43.432441] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T00:35:43.519237] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-04.
[2025-10-24T00:35:43.891860] [INFO ] [REMOTE    ] WNC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:35:44.045593] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-01.
[2025-10-24T00:35:45.061491] [INFO ] [REMOTE    ] WOLF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:35:45.062051] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-01.
[2025-10-24T00:35:45.183321] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T00:35:45.551493] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T00:35:45.599404] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-02.
[2025-10-24T00:35:45.661885] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-01 (2.49 seconds).
[2025-10-24T00:35:46.399497] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-05.
[2025-10-24T00:35:47.095938] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T00:35:47.165310] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-01 (2.10 seconds).
[2025-10-24T00:35:47.199418] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-02.
[2025-10-24T00:35:47.930052] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T00:35:47.999438] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-06.
[2025-10-24T00:35:48.799429] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-03.
[2025-10-24T00:35:49.322482] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-02 (2.12 seconds).
[2025-10-24T00:35:49.599323] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T00:35:49.599404] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-03.
[2025-10-24T00:35:50.408471] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-02.
[2025-10-24T00:35:50.410996] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T00:35:51.199444] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-04.
[2025-10-24T00:35:51.871004] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-03 (2.27 seconds).
[2025-10-24T00:35:51.999458] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-04.
[2025-10-24T00:35:52.593591] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-02 (2.19 seconds).
[2025-10-24T00:35:52.799476] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-03.
[2025-10-24T00:35:52.917312] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T00:35:53.599477] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-05.
[2025-10-24T00:35:53.995673] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-04 (2.00 seconds).
[2025-10-24T00:35:54.399439] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-05.
[2025-10-24T00:35:55.121178] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T00:35:55.199396] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-06.
[2025-10-24T00:35:55.295951] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-03 (2.50 seconds).
[2025-10-24T00:35:55.999429] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-04.
[2025-10-24T00:35:56.678115] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-05 (2.28 seconds).
[2025-10-24T00:35:56.708389] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T00:35:56.799429] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-06.
[2025-10-24T00:35:57.599429] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-07.
[2025-10-24T00:35:58.399481] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-07.
[2025-10-24T00:35:58.586296] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-04 (2.59 seconds).
[2025-10-24T00:35:59.096610] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-06 (2.30 seconds).
[2025-10-24T00:35:59.139206] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T00:35:59.199442] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-08.
[2025-10-24T00:35:59.944209] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T00:35:59.999398] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-08.
[2025-10-24T00:36:00.760071] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T00:36:00.799414] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-09.
[2025-10-24T00:36:01.541231] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T00:36:01.599448] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-09.
[2025-10-24T00:36:02.365884] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T00:36:02.399485] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-05.
[2025-10-24T00:36:02.912287] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T00:36:03.199451] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-10.
[2025-10-24T00:36:03.999558] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-07.
[2025-10-24T00:36:04.543508] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-05 (2.14 seconds).
[2025-10-24T00:36:04.637264] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T00:36:04.643835] [INFO ] [REMOTE    ] WMS: Full fetch complete (57080 records).
[2025-10-24T00:36:04.804699] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-10.
[2025-10-24T00:36:05.601445] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-06.
[2025-10-24T00:36:06.037194] [INFO ] [REMOTE    ] WOR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:36:06.053176] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T00:36:06.059702] [INFO ] [REMOTE    ] WNC: Full fetch complete (57794 records).
[2025-10-24T00:36:06.402760] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-01.
[2025-10-24T00:36:06.523784] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-07 (2.52 seconds).
[2025-10-24T00:36:07.207453] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-08.
[2025-10-24T00:36:07.526256] [INFO ] [REMOTE    ] WOW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:36:07.514154] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T00:36:07.999417] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-02.
[2025-10-24T00:36:08.107768] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-06 (2.51 seconds).
[2025-10-24T00:36:08.799440] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-07.
[2025-10-24T00:36:09.110294] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T00:36:09.359532] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-08 (2.15 seconds).
[2025-10-24T00:36:09.599416] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-09.
[2025-10-24T00:36:10.399446] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-03.
[2025-10-24T00:36:11.199433] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-01.
[2025-10-24T00:36:11.312722] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-07 (2.51 seconds).
[2025-10-24T00:36:11.804203] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T00:36:11.999409] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-04.
[2025-10-24T00:36:12.083589] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-09 (2.48 seconds).
[2025-10-24T00:36:12.270393] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T00:36:12.799462] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-10.
[2025-10-24T00:36:13.261501] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T00:36:13.599439] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-02.
[2025-10-24T00:36:14.399415] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-05.
[2025-10-24T00:36:14.716098] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T00:36:14.990541] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-10 (2.19 seconds).
[2025-10-24T00:36:14.999542] [INFO ] [REMOTE    ] WOLF: Full fetch complete (77138 records).
[2025-10-24T00:36:15.202705] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-08.
[2025-10-24T00:36:15.666085] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-05 (1.27 seconds).
[2025-10-24T00:36:16.004862] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-06.
[2025-10-24T00:36:16.520983] [INFO ] [REMOTE    ] WPC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:36:16.799406] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-01.
[2025-10-24T00:36:17.153857] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T00:36:17.599413] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-07.
[2025-10-24T00:36:17.923330] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-08 (2.72 seconds).
[2025-10-24T00:36:18.399460] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-09.
[2025-10-24T00:36:18.577978] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T00:36:18.895900] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T00:36:19.199464] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-08.
[2025-10-24T00:36:19.999420] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-02.
[2025-10-24T00:36:20.234998] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T00:36:20.759707] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-09 (2.36 seconds).
[2025-10-24T00:36:20.799439] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-10.
[2025-10-24T00:36:21.534420] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T00:36:21.599400] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-03.
[2025-10-24T00:36:22.399494] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-09.
[2025-10-24T00:36:22.717247] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T00:36:22.726516] [INFO ] [REMOTE    ] WMT: Full fetch complete (77980 records).
[2025-10-24T00:36:23.222479] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-03.
[2025-10-24T00:36:23.513858] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T00:36:23.767530] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T00:36:24.007568] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-10.
[2025-10-24T00:36:24.319948] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T00:36:24.402491] [INFO ] [REMOTE    ] WPM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:36:24.799445] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-01.
[2025-10-24T00:36:25.221059] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T00:36:25.225485] [INFO ] [REMOTE    ] WOR: Full fetch complete (36255 records).
[2025-10-24T00:36:25.602820] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-04.
[2025-10-24T00:36:26.399590] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-04.
[2025-10-24T00:36:26.512270] [INFO ] [REMOTE    ] WPP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:36:26.539928] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T00:36:26.980903] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-04 (1.38 seconds).
[2025-10-24T00:36:27.199449] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-01.
[2025-10-24T00:36:27.834537] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T00:36:27.999463] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-02.
[2025-10-24T00:36:28.160278] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T00:36:28.799491] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-05.
[2025-10-24T00:36:29.599429] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-05.
[2025-10-24T00:36:29.782574] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T00:36:29.865193] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T00:36:30.399463] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-03.
[2025-10-24T00:36:31.088036] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T00:36:31.199488] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-02.
[2025-10-24T00:36:31.999506] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-06.
[2025-10-24T00:36:32.220608] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T00:36:32.301453] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T00:36:32.799456] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-04.
[2025-10-24T00:36:33.155358] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T00:36:33.599447] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-03.
[2025-10-24T00:36:34.399446] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-07.
[2025-10-24T00:36:34.879818] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-04 (2.08 seconds).
[2025-10-24T00:36:34.992333] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T00:36:35.199408] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-05.
[2025-10-24T00:36:35.242906] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T00:36:35.999437] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-06.
[2025-10-24T00:36:36.799417] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-08.
[2025-10-24T00:36:36.887549] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T00:36:37.578460] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T00:36:37.599398] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-07.
[2025-10-24T00:36:37.868755] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T00:36:38.399433] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-06.
[2025-10-24T00:36:39.199435] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-04.
[2025-10-24T00:36:39.340098] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T00:36:39.999440] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-09.
[2025-10-24T00:36:40.200405] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T00:36:40.657505] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T00:36:40.799440] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-05.
[2025-10-24T00:36:41.430465] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T00:36:41.599420] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-10.
[2025-10-24T00:36:41.793025] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T00:36:42.399456] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-07.
[2025-10-24T00:36:42.551157] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T00:36:42.557112] [INFO ] [REMOTE    ] WOW: Full fetch complete (43111 records).
[2025-10-24T00:36:43.204712] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-08.
[2025-10-24T00:36:43.881211] [INFO ] [REMOTE    ] WRB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:36:43.999419] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-01.
[2025-10-24T00:36:44.322519] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T00:36:44.799499] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-08.
[2025-10-24T00:36:44.967792] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T00:36:45.378434] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T00:36:45.599449] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-06.
[2025-10-24T00:36:46.399423] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-02.
[2025-10-24T00:36:46.793529] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T00:36:47.181130] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T00:36:47.199393] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-07.
[2025-10-24T00:36:47.999414] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-09.
[2025-10-24T00:36:48.110995] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T00:36:48.799403] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-09.
[2025-10-24T00:36:48.894938] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T00:36:49.587039] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T00:36:49.599407] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-10.
[2025-10-24T00:36:50.399412] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-08.
[2025-10-24T00:36:50.776959] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-09 (1.98 seconds).
[2025-10-24T00:36:51.199424] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-10.
[2025-10-24T00:36:51.244502] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T00:36:51.252937] [INFO ] [REMOTE    ] WPC: Full fetch complete (70458 records).
[2025-10-24T00:36:51.989373] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T00:36:52.018320] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-03.
[2025-10-24T00:36:52.777967] [INFO ] [REMOTE    ] WRBY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:36:52.799393] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-01.
[2025-10-24T00:36:52.882190] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T00:36:52.891353] [INFO ] [REMOTE    ] WPM: Full fetch complete (76434 records).
[2025-10-24T00:36:53.601005] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-09.
[2025-10-24T00:36:54.155524] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-03 (2.14 seconds).
[2025-10-24T00:36:54.405548] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-04.
[2025-10-24T00:36:54.411061] [INFO ] [REMOTE    ] WS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:36:54.441443] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T00:36:55.098007] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T00:36:55.199407] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-10.
[2025-10-24T00:36:55.999405] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-02.
[2025-10-24T00:36:56.275050] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T00:36:56.667132] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T00:36:56.673924] [INFO ] [REMOTE    ] WPP: Full fetch complete (47767 records).
[2025-10-24T00:36:56.804514] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-05.
[2025-10-24T00:36:57.603927] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-01.
[2025-10-24T00:36:57.701691] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T00:36:58.190145] [INFO ] [REMOTE    ] WSM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:36:58.399417] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-01.
[2025-10-24T00:36:58.559154] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T00:36:58.622241] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T00:36:59.199440] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-06.
[2025-10-24T00:36:59.999427] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-02.
[2025-10-24T00:37:00.149695] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T00:37:00.799426] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-03.
[2025-10-24T00:37:00.889926] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T00:37:01.267233] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T00:37:01.599493] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-03.
[2025-10-24T00:37:02.399427] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-07.
[2025-10-24T00:37:02.514675] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T00:37:02.576428] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T00:37:03.199445] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-04.
[2025-10-24T00:37:03.999415] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-02.
[2025-10-24T00:37:04.242051] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T00:37:04.799434] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-08.
[2025-10-24T00:37:04.956822] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T00:37:05.263379] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T00:37:05.599441] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-04.
[2025-10-24T00:37:06.187437] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T00:37:06.358275] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T00:37:06.399396] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-05.
[2025-10-24T00:37:07.199408] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-03.
[2025-10-24T00:37:07.473207] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T00:37:07.999454] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-05.
[2025-10-24T00:37:08.799418] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-09.
[2025-10-24T00:37:09.031792] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T00:37:09.599432] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-04.
[2025-10-24T00:37:09.715959] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T00:37:10.399462] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-06.
[2025-10-24T00:37:10.455599] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T00:37:11.165664] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T00:37:11.199430] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-05.
[2025-10-24T00:37:11.222993] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T00:37:11.999463] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-06.
[2025-10-24T00:37:12.799423] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-07.
[2025-10-24T00:37:13.093321] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-05 (1.89 seconds).
[2025-10-24T00:37:13.599486] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-06.
[2025-10-24T00:37:13.647579] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T00:37:13.909776] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T00:37:14.399441] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-07.
[2025-10-24T00:37:15.199483] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-08.
[2025-10-24T00:37:15.231297] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T00:37:15.711744] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T00:37:15.999458] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-07.
[2025-10-24T00:37:16.324888] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T00:37:16.799468] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-09.
[2025-10-24T00:37:17.489894] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T00:37:17.599430] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-08.
[2025-10-24T00:37:17.914584] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T00:37:18.399451] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-10.
[2025-10-24T00:37:19.199442] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-10.
[2025-10-24T00:37:19.295979] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T00:37:19.999457] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-08.
[2025-10-24T00:37:20.103223] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T00:37:20.112438] [INFO ] [REMOTE    ] WRB: Full fetch complete (73870 records).
[2025-10-24T00:37:20.237444] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T00:37:20.281256] [INFO ] [REMOTE    ] WS: Full fetch complete (35480 records).
[2025-10-24T00:37:20.810510] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-09.
[2025-10-24T00:37:21.936361] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T00:37:22.064861] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-09.
[2025-10-24T00:37:22.865774] [INFO ] [REMOTE    ] WSO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:37:22.876849] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-01.
[2025-10-24T00:37:22.972536] [INFO ] [REMOTE    ] WSR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:37:22.976730] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-09 (2.17 seconds).
[2025-10-24T00:37:23.199456] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-10.
[2025-10-24T00:37:23.759481] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T00:37:23.801639] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T00:37:23.999490] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-01.
[2025-10-24T00:37:24.799496] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-02.
[2025-10-24T00:37:24.842867] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T00:37:24.851808] [INFO ] [REMOTE    ] WRBY: Full fetch complete (73646 records).
[2025-10-24T00:37:25.179897] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T00:37:25.599410] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-10.
[2025-10-24T00:37:25.985527] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T00:37:26.399527] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-03.
[2025-10-24T00:37:26.927878] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T00:37:26.935771] [INFO ] [REMOTE    ] WSM: Full fetch complete (71303 records).
[2025-10-24T00:37:27.204532] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-02.
[2025-10-24T00:37:27.650338] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T00:37:27.999491] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-04.
[2025-10-24T00:37:28.253759] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T00:37:28.799479] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-03.
[2025-10-24T00:37:29.153876] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T00:37:29.599425] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-05.
[2025-10-24T00:37:29.638160] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T00:37:30.399428] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-04.
[2025-10-24T00:37:30.443775] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T00:37:31.199419] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-06.
[2025-10-24T00:37:31.667275] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T00:37:31.999505] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-05.
[2025-10-24T00:37:32.418460] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T00:37:32.799477] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-07.
[2025-10-24T00:37:32.910495] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T00:37:33.599446] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-06.
[2025-10-24T00:37:33.716730] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T00:37:34.399427] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-08.
[2025-10-24T00:37:34.757451] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T00:37:35.199466] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-07.
[2025-10-24T00:37:35.556748] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-08 (1.16 seconds).
[2025-10-24T00:37:35.999430] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-09.
[2025-10-24T00:37:36.300115] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T00:37:36.799445] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-08.
[2025-10-24T00:37:37.397448] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T00:37:37.536113] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T00:37:37.599413] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-09.
[2025-10-24T00:37:38.399447] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-10.
[2025-10-24T00:37:38.674133] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T00:37:39.199433] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-10.
[2025-10-24T00:37:39.770486] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T00:37:39.776061] [INFO ] [REMOTE    ] WSO: Full fetch complete (36012 records).
[2025-10-24T00:37:40.305544] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T00:37:40.313723] [INFO ] [REMOTE    ] WSR: Full fetch complete (32668 records).
[2025-10-24T00:37:42.557006] [INFO ] [REMOTE    ] WTM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:37:42.677921] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-01.
[2025-10-24T00:37:43.473974] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T00:37:43.513552] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-02.
[2025-10-24T00:37:43.822598] [INFO ] [REMOTE    ] WTI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:37:43.843545] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-01.
[2025-10-24T00:37:43.903588] [INFO ] [REMOTE    ] WST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:37:43.924551] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-01.
[2025-10-24T00:37:43.977853] [INFO ] [REMOTE    ] WT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:37:43.978180] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-01.
[2025-10-24T00:37:44.067857] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T00:37:44.068831] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-03.
[2025-10-24T00:37:44.604231] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-03 (0.54 seconds).
[2025-10-24T00:37:44.799432] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-04.
[2025-10-24T00:37:45.300227] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-04 (0.50 seconds).
[2025-10-24T00:37:45.413408] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T00:37:45.501106] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T00:37:45.599449] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-02.
[2025-10-24T00:37:45.726109] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T00:37:46.399475] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-05.
[2025-10-24T00:37:46.878993] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-05 (0.48 seconds).
[2025-10-24T00:37:47.163917] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T00:37:47.199402] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-06.
[2025-10-24T00:37:47.746839] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-06 (0.55 seconds).
[2025-10-24T00:37:47.999418] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-07.
[2025-10-24T00:37:48.451021] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T00:37:48.799482] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-03.
[2025-10-24T00:37:49.599433] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-08.
[2025-10-24T00:37:50.096771] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-08 (0.50 seconds).
[2025-10-24T00:37:50.399410] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-09.
[2025-10-24T00:37:50.457256] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T00:37:51.095059] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T00:37:51.199421] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-10.
[2025-10-24T00:37:51.841722] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-10 (0.64 seconds).
[2025-10-24T00:37:51.843223] [INFO ] [REMOTE    ] WTM: Full fetch complete (2792 records).
[2025-10-24T00:37:52.021748] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-02.
[2025-10-24T00:37:52.762681] [INFO ] [REMOTE    ] WTRG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:37:52.799412] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-01.
[2025-10-24T00:37:53.555159] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T00:37:53.599468] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-02.
[2025-10-24T00:37:54.399491] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-04.
[2025-10-24T00:37:54.512506] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T00:37:55.113431] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T00:37:55.199398] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-03.
[2025-10-24T00:37:55.999431] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-02.
[2025-10-24T00:37:56.113373] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T00:37:56.781002] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T00:37:56.799427] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-03.
[2025-10-24T00:37:57.599414] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-04.
[2025-10-24T00:37:57.681389] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T00:37:58.392902] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T00:37:58.404691] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-03.
[2025-10-24T00:37:59.206099] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-05.
[2025-10-24T00:37:59.211160] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T00:37:59.999421] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-05.
[2025-10-24T00:38:00.171694] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T00:38:00.771179] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T00:38:00.799400] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-06.
[2025-10-24T00:38:01.599407] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-04.
[2025-10-24T00:38:01.865328] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T00:38:02.318235] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T00:38:02.399400] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-07.
[2025-10-24T00:38:03.199443] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-06.
[2025-10-24T00:38:03.362759] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T00:38:03.999467] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-05.
[2025-10-24T00:38:04.045522] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T00:38:04.480515] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T00:38:04.799474] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-08.
[2025-10-24T00:38:05.599470] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-07.
[2025-10-24T00:38:05.754700] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-05 (1.76 seconds).
[2025-10-24T00:38:05.907254] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T00:38:06.399516] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-06.
[2025-10-24T00:38:07.199447] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-04.
[2025-10-24T00:38:07.296858] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T00:38:07.999444] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-08.
[2025-10-24T00:38:08.079047] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T00:38:08.335522] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T00:38:08.799437] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-05.
[2025-10-24T00:38:09.599466] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-07.
[2025-10-24T00:38:09.789404] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T00:38:10.399435] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-09.
[2025-10-24T00:38:10.469898] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T00:38:11.199477] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-09.
[2025-10-24T00:38:11.322562] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T00:38:11.876483] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T00:38:11.999499] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-06.
[2025-10-24T00:38:12.799426] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-08.
[2025-10-24T00:38:12.840244] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T00:38:13.599449] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-10.
[2025-10-24T00:38:13.886453] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T00:38:14.399504] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-07.
[2025-10-24T00:38:14.517687] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T00:38:15.199408] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-09.
[2025-10-24T00:38:15.285132] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T00:38:15.294436] [INFO ] [REMOTE    ] WT: Full fetch complete (69833 records).
[2025-10-24T00:38:16.011527] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-10.
[2025-10-24T00:38:16.181006] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T00:38:16.748788] [INFO ] [REMOTE    ] WTS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:38:16.799408] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-01.
[2025-10-24T00:38:16.889608] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T00:38:17.592843] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T00:38:17.599410] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-10.
[2025-10-24T00:38:17.601730] [INFO ] [REMOTE    ] WST: Full fetch complete (54642 records).
[2025-10-24T00:38:17.901831] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T00:38:18.399467] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-02.
[2025-10-24T00:38:18.954676] [INFO ] [REMOTE    ] WTTR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:38:19.199444] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-08.
[2025-10-24T00:38:19.407290] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T00:38:19.416225] [INFO ] [REMOTE    ] WTRG: Full fetch complete (73917 records).
[2025-10-24T00:38:19.708616] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T00:38:20.005568] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-03.
[2025-10-24T00:38:20.831836] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-01.
[2025-10-24T00:38:20.861122] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T00:38:20.927433] [INFO ] [REMOTE    ] WU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:38:21.186386] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T00:38:21.599480] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-04.
[2025-10-24T00:38:22.399484] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-01.
[2025-10-24T00:38:22.442140] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T00:38:22.808047] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T00:38:23.199471] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-09.
[2025-10-24T00:38:23.999548] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-05.
[2025-10-24T00:38:24.223379] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T00:38:24.740669] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T00:38:24.799490] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-10.
[2025-10-24T00:38:25.130341] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T00:38:25.599480] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-02.
[2025-10-24T00:38:26.399510] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-02.
[2025-10-24T00:38:26.591333] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T00:38:26.600316] [INFO ] [REMOTE    ] WTI: Full fetch complete (63937 records).
[2025-10-24T00:38:27.148935] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T00:38:27.219680] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-06.
[2025-10-24T00:38:27.987543] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T00:38:28.005522] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-03.
[2025-10-24T00:38:28.191488] [INFO ] [REMOTE    ] WWW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:38:28.222627] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T00:38:28.799441] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-03.
[2025-10-24T00:38:29.599461] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-01.
[2025-10-24T00:38:29.839589] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T00:38:30.399421] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-07.
[2025-10-24T00:38:30.667424] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T00:38:31.199423] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-04.
[2025-10-24T00:38:31.249984] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T00:38:31.445763] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T00:38:31.999461] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-08.
[2025-10-24T00:38:32.799515] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-02.
[2025-10-24T00:38:33.158548] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T00:38:33.182513] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T00:38:33.599433] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-09.
[2025-10-24T00:38:34.399491] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-05.
[2025-10-24T00:38:34.430514] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T00:38:34.478703] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T00:38:35.199448] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-03.
[2025-10-24T00:38:35.999414] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-04.
[2025-10-24T00:38:36.208384] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T00:38:36.799430] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-06.
[2025-10-24T00:38:37.000242] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T00:38:37.599460] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-04.
[2025-10-24T00:38:37.634420] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T00:38:38.399415] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-05.
[2025-10-24T00:38:38.882489] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-06 (2.08 seconds).
[2025-10-24T00:38:39.199410] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-07.
[2025-10-24T00:38:39.382552] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T00:38:39.999447] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-05.
[2025-10-24T00:38:40.053436] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T00:38:40.799438] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-10.
[2025-10-24T00:38:41.213392] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-07 (2.01 seconds).
[2025-10-24T00:38:41.599467] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-06.
[2025-10-24T00:38:41.676136] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T00:38:41.693093] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T00:38:41.696780] [INFO ] [REMOTE    ] WTS: Full fetch complete (25705 records).
[2025-10-24T00:38:42.402055] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-06.
[2025-10-24T00:38:42.934932] [INFO ] [REMOTE    ] WY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:38:42.957161] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T00:38:43.199420] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-01.
[2025-10-24T00:38:43.708560] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T00:38:43.999412] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-08.
[2025-10-24T00:38:44.710684] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T00:38:44.799394] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-02.
[2025-10-24T00:38:45.599412] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-07.
[2025-10-24T00:38:45.915678] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-08 (1.92 seconds).
[2025-10-24T00:38:46.399432] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-07.
[2025-10-24T00:38:46.554200] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-02 (1.75 seconds).
[2025-10-24T00:38:46.984960] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T00:38:47.199495] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-03.
[2025-10-24T00:38:47.976980] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T00:38:47.999412] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-08.
[2025-10-24T00:38:48.799467] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-09.
[2025-10-24T00:38:49.021877] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T00:38:49.106079] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T00:38:49.599437] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-09.
[2025-10-24T00:38:50.399430] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-04.
[2025-10-24T00:38:50.811805] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-09 (2.01 seconds).
[2025-10-24T00:38:51.199456] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-10.
[2025-10-24T00:38:51.260815] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T00:38:51.892038] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T00:38:51.999444] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-10.
[2025-10-24T00:38:52.799478] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-05.
[2025-10-24T00:38:53.071077] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T00:38:53.080355] [INFO ] [REMOTE    ] WU: Full fetch complete (77519 records).
[2025-10-24T00:38:53.498983] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T00:38:53.507611] [INFO ] [REMOTE    ] WTTR: Full fetch complete (65531 records).
[2025-10-24T00:38:53.600583] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-08.
[2025-10-24T00:38:54.734601] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-05 (1.94 seconds).
[2025-10-24T00:38:54.763565] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-06.
[2025-10-24T00:38:55.711854] [INFO ] [REMOTE    ] XFLT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:38:55.716569] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-01.
[2025-10-24T00:38:55.839816] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-08 (2.24 seconds).
[2025-10-24T00:38:56.004677] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-09.
[2025-10-24T00:38:56.270134] [INFO ] [REMOTE    ] XHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:38:56.299911] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T00:38:56.799457] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-07.
[2025-10-24T00:38:57.111787] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T00:38:57.599571] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-01.
[2025-10-24T00:38:57.885934] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-09 (1.88 seconds).
[2025-10-24T00:38:58.399431] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-02.
[2025-10-24T00:38:58.702630] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T00:38:58.737884] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T00:38:59.199487] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-08.
[2025-10-24T00:38:59.610852] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T00:38:59.999440] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-02.
[2025-10-24T00:39:00.799412] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-10.
[2025-10-24T00:39:01.276841] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-08 (2.08 seconds).
[2025-10-24T00:39:01.357771] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T00:39:01.599492] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-03.
[2025-10-24T00:39:02.404558] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-09.
[2025-10-24T00:39:02.419638] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T00:39:02.429492] [INFO ] [REMOTE    ] WWW: Full fetch complete (70648 records).
[2025-10-24T00:39:03.202619] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-03.
[2025-10-24T00:39:03.381194] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T00:39:03.744605] [INFO ] [REMOTE    ] XIFR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:39:03.999416] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-04.
[2025-10-24T00:39:04.331164] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T00:39:04.639125] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T00:39:04.799416] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-04.
[2025-10-24T00:39:05.595431] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T00:39:05.604361] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-10.
[2025-10-24T00:39:06.239413] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T00:39:06.399477] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-05.
[2025-10-24T00:39:07.199431] [INFO ] [REMOTE    ] XIFR: Fetching primary data for 2025-01.
[2025-10-24T00:39:07.400036] [DEBUG] [REMOTE    ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T00:39:07.400261] [WARN ] [REMOTE    ] XIFR: No data returned for month 2025-01
[2025-10-24T00:39:07.400351] [FATAL] [REMOTE    ] XIFR: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T00:39:07.579034] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T00:39:07.609492] [INFO ] [REMOTE    ] WY: Full fetch complete (77041 records).
[2025-10-24T00:39:08.008534] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-05.
[2025-10-24T00:39:08.095431] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T00:39:08.801189] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-06.
[2025-10-24T00:39:08.883285] [INFO ] [REMOTE    ] XOM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:39:09.363201] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T00:39:09.604738] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-01.
[2025-10-24T00:39:09.722318] [INFO ] [REMOTE    ] XPER: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:39:10.399468] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-06.
[2025-10-24T00:39:10.426683] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T00:39:11.199502] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-07.
[2025-10-24T00:39:11.690944] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T00:39:11.999879] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-01.
[2025-10-24T00:39:11.999755] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-01 (2.40 seconds).
[2025-10-24T00:39:12.669601] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T00:39:12.798434] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T00:39:12.804259] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-07.
[2025-10-24T00:39:13.599443] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-08.
[2025-10-24T00:39:14.210249] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T00:39:14.399438] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-02.
[2025-10-24T00:39:15.186171] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T00:39:15.199406] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-09.
[2025-10-24T00:39:15.999460] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-02.
[2025-10-24T00:39:16.386673] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-02 (1.99 seconds).
[2025-10-24T00:39:16.691973] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T00:39:16.799419] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-10.
[2025-10-24T00:39:17.195547] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T00:39:17.599478] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-03.
[2025-10-24T00:39:17.982138] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T00:39:17.989121] [INFO ] [REMOTE    ] XHR: Full fetch complete (61903 records).
[2025-10-24T00:39:18.426523] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-03.
[2025-10-24T00:39:18.836787] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T00:39:19.204728] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-04.
[2025-10-24T00:39:19.422024] [INFO ] [REMOTE    ] XPEV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:39:19.999466] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-08.
[2025-10-24T00:39:20.651375] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T00:39:20.767908] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-03 (2.34 seconds).
[2025-10-24T00:39:20.799418] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-04.
[2025-10-24T00:39:21.289368] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T00:39:21.599443] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-01.
[2025-10-24T00:39:22.399437] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-05.
[2025-10-24T00:39:23.199523] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-09.
[2025-10-24T00:39:23.402679] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-04 (2.60 seconds).
[2025-10-24T00:39:23.629682] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T00:39:23.999418] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-05.
[2025-10-24T00:39:24.083347] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-01 (2.48 seconds).
[2025-10-24T00:39:24.560628] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T00:39:24.799454] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-02.
[2025-10-24T00:39:25.599514] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-06.
[2025-10-24T00:39:26.347246] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-05 (2.35 seconds).
[2025-10-24T00:39:26.399400] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-06.
[2025-10-24T00:39:26.724606] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T00:39:26.908703] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-02 (2.11 seconds).
[2025-10-24T00:39:27.199492] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-03.
[2025-10-24T00:39:27.999510] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-10.
[2025-10-24T00:39:28.733106] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-06 (2.33 seconds).
[2025-10-24T00:39:28.799464] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-07.
[2025-10-24T00:39:29.247083] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T00:39:29.252759] [INFO ] [REMOTE    ] XFLT: Full fetch complete (43960 records).
[2025-10-24T00:39:29.633469] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-07.
[2025-10-24T00:39:29.845854] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-03 (2.65 seconds).
[2025-10-24T00:39:30.409225] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-04.
[2025-10-24T00:39:30.590701] [INFO ] [REMOTE    ] XPO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:39:30.777604] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T00:39:31.199463] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-01.
[2025-10-24T00:39:31.230794] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-07 (2.43 seconds).
[2025-10-24T00:39:31.999463] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-08.
[2025-10-24T00:39:32.799479] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-08.
[2025-10-24T00:39:32.954885] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-04 (2.55 seconds).
[2025-10-24T00:39:32.994292] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T00:39:33.599441] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-05.
[2025-10-24T00:39:33.896629] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T00:39:34.371639] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-08 (2.37 seconds).
[2025-10-24T00:39:34.399397] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-09.
[2025-10-24T00:39:35.199462] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-02.
[2025-10-24T00:39:35.999417] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-09.
[2025-10-24T00:39:36.051770] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-05 (2.45 seconds).
[2025-10-24T00:39:36.684066] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-09 (2.28 seconds).
[2025-10-24T00:39:36.799428] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-06.
[2025-10-24T00:39:36.839376] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T00:39:37.446784] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T00:39:37.599450] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-03.
[2025-10-24T00:39:38.399452] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-10.
[2025-10-24T00:39:38.975713] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-06 (2.18 seconds).
[2025-10-24T00:39:39.071357] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T00:39:39.199442] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-04.
[2025-10-24T00:39:39.999470] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-07.
[2025-10-24T00:39:40.799442] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-10.
[2025-10-24T00:39:40.852827] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-10 (2.45 seconds).
[2025-10-24T00:39:40.862042] [INFO ] [REMOTE    ] XOM: Full fetch complete (77973 records).
[2025-10-24T00:39:41.306099] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-04 (2.11 seconds).
[2025-10-24T00:39:41.602773] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-05.
[2025-10-24T00:39:42.157305] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T00:39:42.207596] [INFO ] [REMOTE    ] XPER: Full fetch complete (43665 records).
[2025-10-24T00:39:42.266071] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-07 (2.27 seconds).
[2025-10-24T00:39:42.480575] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-08.
[2025-10-24T00:39:42.794568] [INFO ] [REMOTE    ] XPOF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:39:43.203842] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-01.
[2025-10-24T00:39:43.248769] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T00:39:43.918949] [INFO ] [REMOTE    ] XPRO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:39:43.999411] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-06.
[2025-10-24T00:39:44.458766] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T00:39:44.799516] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-02.
[2025-10-24T00:39:44.964086] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-08 (2.48 seconds).
[2025-10-24T00:39:45.599460] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-09.
[2025-10-24T00:39:45.653758] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T00:39:46.107232] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T00:39:46.399442] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-07.
[2025-10-24T00:39:47.199456] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-01.
[2025-10-24T00:39:47.999442] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-03.
[2025-10-24T00:39:48.043849] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-09 (2.44 seconds).
[2025-10-24T00:39:48.103152] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T00:39:48.757735] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T00:39:48.799404] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-02.
[2025-10-24T00:39:49.599433] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-08.
[2025-10-24T00:39:49.655324] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T00:39:50.188493] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T00:39:50.399433] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-04.
[2025-10-24T00:39:50.939223] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T00:39:51.199448] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-10.
[2025-10-24T00:39:51.949995] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T00:39:51.999418] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-05.
[2025-10-24T00:39:52.799452] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-03.
[2025-10-24T00:39:53.470954] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-10 (2.27 seconds).
[2025-10-24T00:39:53.480233] [INFO ] [REMOTE    ] XPEV: Full fetch complete (77772 records).
[2025-10-24T00:39:53.627197] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-09.
[2025-10-24T00:39:53.701945] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T00:39:54.204817] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T00:39:54.401711] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-04.
[2025-10-24T00:39:55.035980] [INFO ] [REMOTE    ] XYF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:39:55.199418] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-06.
[2025-10-24T00:39:55.426626] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-09 (1.80 seconds).
[2025-10-24T00:39:55.702465] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T00:39:55.999444] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-05.
[2025-10-24T00:39:56.163343] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T00:39:56.799453] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-10.
[2025-10-24T00:39:57.599476] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-07.
[2025-10-24T00:39:57.646401] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T00:39:58.399460] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-06.
[2025-10-24T00:39:58.432989] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T00:39:58.441064] [INFO ] [REMOTE    ] XPO: Full fetch complete (69579 records).
[2025-10-24T00:39:58.862429] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T00:39:59.205053] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-01.
[2025-10-24T00:39:59.716367] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T00:39:59.899431] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T00:39:59.977579] [INFO ] [REMOTE    ] XYL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:39:59.999403] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-01.
[2025-10-24T00:40:00.799444] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-02.
[2025-10-24T00:40:01.581060] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T00:40:01.600864] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-02.
[2025-10-24T00:40:01.604808] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T00:40:02.399438] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-08.
[2025-10-24T00:40:03.199456] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-03.
[2025-10-24T00:40:03.403090] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T00:40:03.999420] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-03.
[2025-10-24T00:40:04.060154] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-03 (0.86 seconds).
[2025-10-24T00:40:04.106796] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T00:40:04.799431] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-07.
[2025-10-24T00:40:05.599437] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-09.
[2025-10-24T00:40:05.871858] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T00:40:06.399477] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-04.
[2025-10-24T00:40:06.430003] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T00:40:06.958401] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T00:40:07.199446] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-08.
[2025-10-24T00:40:07.626622] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T00:40:07.999477] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-05.
[2025-10-24T00:40:08.789849] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T00:40:08.799402] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-04.
[2025-10-24T00:40:09.233302] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T00:40:09.599478] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-09.
[2025-10-24T00:40:10.399432] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-06.
[2025-10-24T00:40:10.689224] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T00:40:10.760190] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T00:40:11.199511] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-10.
[2025-10-24T00:40:11.524909] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T00:40:11.999464] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-10.
[2025-10-24T00:40:12.797427] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T00:40:12.805046] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-05.
[2025-10-24T00:40:12.806828] [INFO ] [REMOTE    ] XPRO: Full fetch complete (66485 records).
[2025-10-24T00:40:13.318556] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T00:40:13.328346] [INFO ] [REMOTE    ] XPOF: Full fetch complete (52937 records).
[2025-10-24T00:40:13.606888] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-07.
[2025-10-24T00:40:14.702148] [INFO ] [REMOTE    ] XYZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:40:14.758570] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-01.
[2025-10-24T00:40:14.887727] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-05 (2.08 seconds).
[2025-10-24T00:40:15.129304] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T00:40:15.204606] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-06.
[2025-10-24T00:40:15.498476] [INFO ] [REMOTE    ] YALA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:40:15.999419] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-01.
[2025-10-24T00:40:16.170716] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T00:40:16.799464] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-02.
[2025-10-24T00:40:16.851930] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T00:40:17.050627] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T00:40:17.599501] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-07.
[2025-10-24T00:40:18.399497] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-08.
[2025-10-24T00:40:19.065548] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-02 (2.27 seconds).
[2025-10-24T00:40:19.199465] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-03.
[2025-10-24T00:40:19.333962] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T00:40:19.805834] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T00:40:19.999450] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-02.
[2025-10-24T00:40:20.799436] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-08.
[2025-10-24T00:40:21.127325] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T00:40:21.566500] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-03 (2.37 seconds).
[2025-10-24T00:40:21.599416] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-03.
[2025-10-24T00:40:22.399489] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-04.
[2025-10-24T00:40:22.505025] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T00:40:22.752841] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T00:40:23.199448] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-04.
[2025-10-24T00:40:23.999470] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-09.
[2025-10-24T00:40:24.513298] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-04 (2.11 seconds).
[2025-10-24T00:40:24.787021] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T00:40:24.799399] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-05.
[2025-10-24T00:40:25.599463] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-05.
[2025-10-24T00:40:25.685509] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T00:40:26.399474] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-10.
[2025-10-24T00:40:26.440123] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T00:40:27.199435] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-06.
[2025-10-24T00:40:28.004782] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-09.
[2025-10-24T00:40:28.031043] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-05 (2.43 seconds).
[2025-10-24T00:40:28.070750] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T00:40:28.079758] [INFO ] [REMOTE    ] XYL: Full fetch complete (70043 records).
[2025-10-24T00:40:28.741032] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T00:40:28.812925] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-06.
[2025-10-24T00:40:29.279828] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T00:40:29.609331] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-07.
[2025-10-24T00:40:29.656982] [INFO ] [REMOTE    ] YELP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:40:30.399505] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-10.
[2025-10-24T00:40:30.977501] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T00:40:31.070393] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-06 (2.26 seconds).
[2025-10-24T00:40:31.199402] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-07.
[2025-10-24T00:40:31.459680] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T00:40:31.463901] [INFO ] [REMOTE    ] XYF: Full fetch complete (33826 records).
[2025-10-24T00:40:32.000336] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-01.
[2025-10-24T00:40:32.792544] [INFO ] [REMOTE    ] YETI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:40:32.799393] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-01.
[2025-10-24T00:40:33.579702] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T00:40:33.599396] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-02.
[2025-10-24T00:40:33.694149] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-07 (2.49 seconds).
[2025-10-24T00:40:34.399473] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-08.
[2025-10-24T00:40:34.526386] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T00:40:35.048691] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T00:40:35.199437] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-02.
[2025-10-24T00:40:35.518513] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T00:40:35.999433] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-08.
[2025-10-24T00:40:36.799435] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-09.
[2025-10-24T00:40:36.861417] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T00:40:37.599431] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-03.
[2025-10-24T00:40:38.030032] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T00:40:38.408292] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-03.
[2025-10-24T00:40:38.413821] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-08 (2.41 seconds).
[2025-10-24T00:40:39.199508] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-09.
[2025-10-24T00:40:39.340158] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T00:40:39.999425] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-10.
[2025-10-24T00:40:40.034887] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T00:40:40.799413] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-04.
[2025-10-24T00:40:41.179267] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T00:40:41.184524] [INFO ] [REMOTE    ] YALA: Full fetch complete (47119 records).
[2025-10-24T00:40:41.319669] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-09 (2.12 seconds).
[2025-10-24T00:40:41.603937] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-10.
[2025-10-24T00:40:42.029146] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T00:40:42.422794] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-04.
[2025-10-24T00:40:42.606756] [INFO ] [REMOTE    ] YEXT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:40:43.199445] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-05.
[2025-10-24T00:40:43.866232] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-10 (2.26 seconds).
[2025-10-24T00:40:43.875554] [INFO ] [REMOTE    ] XYZ: Full fetch complete (74803 records).
[2025-10-24T00:40:44.004587] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-01.
[2025-10-24T00:40:44.305388] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T00:40:44.681386] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T00:40:44.807583] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-05.
[2025-10-24T00:40:44.964175] [INFO ] [REMOTE    ] YMM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:40:45.331609] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T00:40:45.599444] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-02.
[2025-10-24T00:40:46.399426] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-01.
[2025-10-24T00:40:46.659708] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-05 (1.85 seconds).
[2025-10-24T00:40:46.736299] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T00:40:47.199436] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-03.
[2025-10-24T00:40:47.999444] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-06.
[2025-10-24T00:40:48.145756] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T00:40:48.664201] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T00:40:48.799406] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-06.
[2025-10-24T00:40:49.599520] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T00:40:49.599599] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-02.
[2025-10-24T00:40:50.375931] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T00:40:50.399405] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-07.
[2025-10-24T00:40:51.199419] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-07.
[2025-10-24T00:40:51.442929] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T00:40:51.999482] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-04.
[2025-10-24T00:40:52.249273] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T00:40:52.799447] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-08.
[2025-10-24T00:40:52.861535] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T00:40:53.578176] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T00:40:53.599395] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-05.
[2025-10-24T00:40:54.399432] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-03.
[2025-10-24T00:40:54.656397] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T00:40:54.941050] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T00:40:55.199457] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-09.
[2025-10-24T00:40:55.907045] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T00:40:55.999435] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-08.
[2025-10-24T00:40:56.799427] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-04.
[2025-10-24T00:40:56.927616] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T00:40:57.569844] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T00:40:57.599479] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-10.
[2025-10-24T00:40:58.399509] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-09.
[2025-10-24T00:40:58.619637] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T00:40:59.199481] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-05.
[2025-10-24T00:40:59.353083] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T00:40:59.362168] [INFO ] [REMOTE    ] YETI: Full fetch complete (75528 records).
[2025-10-24T00:40:59.791597] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T00:40:59.999868] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-10.
[2025-10-24T00:41:00.805197] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-06.
[2025-10-24T00:41:00.899081] [INFO ] [REMOTE    ] YOU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:41:00.964557] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-05 (1.77 seconds).
[2025-10-24T00:41:01.599424] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-06.
[2025-10-24T00:41:01.638973] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T00:41:01.647266] [INFO ] [REMOTE    ] YELP: Full fetch complete (64741 records).
[2025-10-24T00:41:02.405549] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-01.
[2025-10-24T00:41:02.535388] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T00:41:03.123615] [INFO ] [REMOTE    ] YPF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:41:03.199408] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-07.
[2025-10-24T00:41:03.319984] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T00:41:03.804023] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T00:41:03.999442] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-07.
[2025-10-24T00:41:04.466995] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T00:41:04.799468] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-08.
[2025-10-24T00:41:05.417523] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T00:41:05.599455] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-08.
[2025-10-24T00:41:06.327386] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T00:41:06.399430] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-09.
[2025-10-24T00:41:07.199446] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-01.
[2025-10-24T00:41:07.560474] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-08 (1.96 seconds).
[2025-10-24T00:41:07.701813] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T00:41:07.999533] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-10.
[2025-10-24T00:41:08.778960] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T00:41:08.799398] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-02.
[2025-10-24T00:41:09.506065] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T00:41:09.513996] [INFO ] [REMOTE    ] YEXT: Full fetch complete (63071 records).
[2025-10-24T00:41:09.604553] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-02.
[2025-10-24T00:41:10.412205] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-09.
[2025-10-24T00:41:10.457325] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T00:41:11.200142] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-03.
[2025-10-24T00:41:11.255161] [INFO ] [REMOTE    ] YRD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:41:11.433175] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T00:41:11.999486] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-01.
[2025-10-24T00:41:12.140292] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T00:41:12.799451] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-10.
[2025-10-24T00:41:12.851515] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T00:41:13.069797] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T00:41:13.599490] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-04.
[2025-10-24T00:41:14.411911] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-02.
[2025-10-24T00:41:14.413802] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T00:41:14.424389] [INFO ] [REMOTE    ] YMM: Full fetch complete (76464 records).
[2025-10-24T00:41:15.221384] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T00:41:15.209127] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-03.
[2025-10-24T00:41:15.573109] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T00:41:16.014550] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-05.
[2025-10-24T00:41:16.067890] [INFO ] [REMOTE    ] YSG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:41:16.799425] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-03.
[2025-10-24T00:41:17.203879] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T00:41:17.599423] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-04.
[2025-10-24T00:41:17.816407] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T00:41:17.848606] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T00:41:18.399446] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-06.
[2025-10-24T00:41:19.199415] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-04.
[2025-10-24T00:41:19.312985] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T00:41:19.669616] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T00:41:19.999475] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-07.
[2025-10-24T00:41:20.192495] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T00:41:20.799470] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-01.
[2025-10-24T00:41:21.594924] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T00:41:21.599383] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-02.
[2025-10-24T00:41:21.841709] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T00:41:22.399521] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-05.
[2025-10-24T00:41:22.409621] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T00:41:23.199475] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-03.
[2025-10-24T00:41:23.999410] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-05.
[2025-10-24T00:41:24.235168] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T00:41:24.270753] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T00:41:24.471666] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T00:41:24.799452] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-08.
[2025-10-24T00:41:25.599457] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-04.
[2025-10-24T00:41:26.157360] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T00:41:26.399462] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-06.
[2025-10-24T00:41:26.578529] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T00:41:27.199469] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-06.
[2025-10-24T00:41:27.986804] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T00:41:27.999404] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-07.
[2025-10-24T00:41:28.071297] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T00:41:28.799445] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-09.
[2025-10-24T00:41:29.599429] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-05.
[2025-10-24T00:41:29.716540] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T00:41:30.173059] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T00:41:30.399434] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-10.
[2025-10-24T00:41:30.444035] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T00:41:31.199484] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-07.
[2025-10-24T00:41:31.999478] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-06.
[2025-10-24T00:41:32.127324] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T00:41:32.128097] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T00:41:32.141271] [INFO ] [REMOTE    ] YPF: Full fetch complete (73870 records).
[2025-10-24T00:41:32.801193] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-08.
[2025-10-24T00:41:33.608066] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-08.
[2025-10-24T00:41:33.611902] [INFO ] [REMOTE    ] YUM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:41:33.635177] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T00:41:34.399470] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-01.
[2025-10-24T00:41:34.460151] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T00:41:34.652423] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T00:41:35.199437] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-09.
[2025-10-24T00:41:35.999415] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-07.
[2025-10-24T00:41:36.057558] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T00:41:36.133514] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T00:41:36.799440] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-09.
[2025-10-24T00:41:37.416043] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T00:41:37.599462] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-02.
[2025-10-24T00:41:38.399417] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-10.
[2025-10-24T00:41:38.558590] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T00:41:39.180293] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T00:41:39.183024] [INFO ] [REMOTE    ] YRD: Full fetch complete (18766 records).
[2025-10-24T00:41:39.208282] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-10.
[2025-10-24T00:41:39.485917] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-02 (1.89 seconds).
[2025-10-24T00:41:40.008253] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-08.
[2025-10-24T00:41:40.443801] [INFO ] [REMOTE    ] YUMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:41:40.799451] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-01.
[2025-10-24T00:41:41.020375] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T00:41:41.029313] [INFO ] [REMOTE    ] YOU: Full fetch complete (72312 records).
[2025-10-24T00:41:41.384887] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T00:41:41.636988] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-09.
[2025-10-24T00:41:42.415077] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-03.
[2025-10-24T00:41:42.585124] [INFO ] [REMOTE    ] ZBH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:41:42.622931] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T00:41:42.808278] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T00:41:43.199471] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-01.
[2025-10-24T00:41:43.999411] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-02.
[2025-10-24T00:41:44.299370] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T00:41:44.799449] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-04.
[2025-10-24T00:41:44.983199] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T00:41:45.599434] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-02.
[2025-10-24T00:41:45.846770] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T00:41:46.399492] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-03.
[2025-10-24T00:41:46.739300] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-04 (1.94 seconds).
[2025-10-24T00:41:47.199452] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-05.
[2025-10-24T00:41:47.323039] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T00:41:47.999437] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-03.
[2025-10-24T00:41:48.315449] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T00:41:48.799433] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-04.
[2025-10-24T00:41:49.034198] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-05 (1.83 seconds).
[2025-10-24T00:41:49.599423] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-06.
[2025-10-24T00:41:49.754601] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T00:41:50.399454] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-04.
[2025-10-24T00:41:50.455026] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T00:41:51.031474] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T00:41:51.199429] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-10.
[2025-10-24T00:41:51.849227] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T00:41:51.955950] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T00:41:51.960889] [INFO ] [REMOTE    ] YSG: Full fetch complete (32595 records).
[2025-10-24T00:41:52.006161] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-07.
[2025-10-24T00:41:52.808073] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-05.
[2025-10-24T00:41:53.177029] [INFO ] [REMOTE    ] ZEPP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:41:53.599405] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-01.
[2025-10-24T00:41:53.740070] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T00:41:54.087399] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-01 (0.49 seconds).
[2025-10-24T00:41:54.399424] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-02.
[2025-10-24T00:41:54.709889] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T00:41:54.957264] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-02 (0.56 seconds).
[2025-10-24T00:41:55.199433] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-08.
[2025-10-24T00:41:55.999460] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-05.
[2025-10-24T00:41:56.799422] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-03.
[2025-10-24T00:41:57.081190] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-08 (1.88 seconds).
[2025-10-24T00:41:57.170354] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-03 (0.37 seconds).
[2025-10-24T00:41:57.599417] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-04.
[2025-10-24T00:41:57.818525] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T00:41:57.998626] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-04 (0.40 seconds).
[2025-10-24T00:41:58.399433] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-06.
[2025-10-24T00:41:59.199433] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-06.
[2025-10-24T00:41:59.999432] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-09.
[2025-10-24T00:42:00.155203] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T00:42:00.799482] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-07.
[2025-10-24T00:42:00.889711] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T00:42:01.599442] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-07.
[2025-10-24T00:42:01.825609] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-09 (1.83 seconds).
[2025-10-24T00:42:02.254184] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T00:42:02.399430] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-08.
[2025-10-24T00:42:03.199412] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-05.
[2025-10-24T00:42:03.454552] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-07 (1.86 seconds).
[2025-10-24T00:42:03.606327] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-05 (0.41 seconds).
[2025-10-24T00:42:03.999427] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-10.
[2025-10-24T00:42:04.220552] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T00:42:04.799436] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-09.
[2025-10-24T00:42:05.599468] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-06.
[2025-10-24T00:42:05.795539] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T00:42:05.804311] [INFO ] [REMOTE    ] YUM: Full fetch complete (74646 records).
[2025-10-24T00:42:06.301076] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T00:42:06.399770] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-07.
[2025-10-24T00:42:06.728936] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T00:42:07.204572] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-10.
[2025-10-24T00:42:07.304165] [INFO ] [REMOTE    ] ZETA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:42:07.585556] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T00:42:07.999449] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-01.
[2025-10-24T00:42:08.799422] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-08.
[2025-10-24T00:42:08.987358] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T00:42:08.999229] [INFO ] [REMOTE    ] ZBH: Full fetch complete (73894 records).
[2025-10-24T00:42:09.603501] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-08.
[2025-10-24T00:42:10.477781] [INFO ] [REMOTE    ] ZGN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:42:10.478233] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-01.
[2025-10-24T00:42:10.506968] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-01 (2.51 seconds).
[2025-10-24T00:42:10.613495] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T00:42:10.844671] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T00:42:11.199442] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-02.
[2025-10-24T00:42:11.999446] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-09.
[2025-10-24T00:42:12.033393] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T00:42:12.799499] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-02.
[2025-10-24T00:42:13.219743] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-02 (2.02 seconds).
[2025-10-24T00:42:13.599477] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-03.
[2025-10-24T00:42:13.838079] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T00:42:13.868987] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T00:42:14.399449] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-10.
[2025-10-24T00:42:15.199419] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-03.
[2025-10-24T00:42:15.677794] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-03 (2.08 seconds).
[2025-10-24T00:42:15.999443] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-09.
[2025-10-24T00:42:16.193709] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T00:42:16.202740] [INFO ] [REMOTE    ] YUMC: Full fetch complete (76455 records).
[2025-10-24T00:42:16.808337] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-04.
[2025-10-24T00:42:17.115453] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T00:42:17.607172] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-04.
[2025-10-24T00:42:17.715464] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T00:42:17.778320] [INFO ] [REMOTE    ] ZH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:42:18.399491] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-01.
[2025-10-24T00:42:18.700708] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T00:42:18.794406] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-04 (1.19 seconds).
[2025-10-24T00:42:19.124205] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T00:42:19.199518] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-02.
[2025-10-24T00:42:19.999468] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-05.
[2025-10-24T00:42:20.732467] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T00:42:20.799402] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-03.
[2025-10-24T00:42:21.546437] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T00:42:21.599395] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-06.
[2025-10-24T00:42:21.799542] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T00:42:22.399471] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-04.
[2025-10-24T00:42:23.054291] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T00:42:23.199462] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-10.
[2025-10-24T00:42:23.787511] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-04 (1.39 seconds).
[2025-10-24T00:42:23.999420] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-05.
[2025-10-24T00:42:24.307760] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T00:42:24.312355] [INFO ] [REMOTE    ] ZEPP: Full fetch complete (21374 records).
[2025-10-24T00:42:24.709314] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T00:42:24.800684] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-06.
[2025-10-24T00:42:25.575377] [INFO ] [REMOTE    ] ZIM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:42:25.599422] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-01.
[2025-10-24T00:42:25.985206] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T00:42:26.399493] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-07.
[2025-10-24T00:42:27.199501] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-05.
[2025-10-24T00:42:27.703104] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T00:42:27.760971] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-01 (2.16 seconds).
[2025-10-24T00:42:27.999450] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-02.
[2025-10-24T00:42:28.799445] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-08.
[2025-10-24T00:42:29.228159] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-05 (2.03 seconds).
[2025-10-24T00:42:29.599437] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-07.
[2025-10-24T00:42:29.628257] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T00:42:29.917346] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T00:42:30.399412] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-03.
[2025-10-24T00:42:31.199411] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-06.
[2025-10-24T00:42:31.229182] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T00:42:31.999502] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-08.
[2025-10-24T00:42:32.770493] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-03 (2.37 seconds).
[2025-10-24T00:42:32.799438] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-09.
[2025-10-24T00:42:33.422808] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-06 (2.22 seconds).
[2025-10-24T00:42:33.455010] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T00:42:33.599420] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-09.
[2025-10-24T00:42:34.106216] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T00:42:34.399469] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-07.
[2025-10-24T00:42:35.020143] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T00:42:35.199423] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-10.
[2025-10-24T00:42:35.999502] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-10.
[2025-10-24T00:42:36.628764] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T00:42:36.636783] [INFO ] [REMOTE    ] ZGN: Full fetch complete (58820 records).
[2025-10-24T00:42:36.803676] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-04.
[2025-10-24T00:42:37.051259] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T00:42:37.056545] [INFO ] [REMOTE    ] ZH: Full fetch complete (39737 records).
[2025-10-24T00:42:37.204299] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-07 (2.80 seconds).
[2025-10-24T00:42:37.608105] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-08.
[2025-10-24T00:42:38.686048] [INFO ] [REMOTE    ] ZIP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:42:38.686392] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-01.
[2025-10-24T00:42:39.064746] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-04 (2.26 seconds).
[2025-10-24T00:42:39.199410] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-05.
[2025-10-24T00:42:39.995025] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T00:42:40.001387] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-02.
[2025-10-24T00:42:40.251284] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-08 (2.64 seconds).
[2025-10-24T00:42:40.799462] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-09.
[2025-10-24T00:42:41.362758] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T00:42:41.487163] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-05 (2.29 seconds).
[2025-10-24T00:42:41.599448] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-03.
[2025-10-24T00:42:42.399455] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-06.
[2025-10-24T00:42:43.162312] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T00:42:43.199418] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-04.
[2025-10-24T00:42:43.273266] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-09 (2.47 seconds).
[2025-10-24T00:42:43.999433] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-10.
[2025-10-24T00:42:44.662377] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-06 (2.26 seconds).
[2025-10-24T00:42:44.799414] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-07.
[2025-10-24T00:42:44.905538] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T00:42:45.599472] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-05.
[2025-10-24T00:42:46.479384] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-10 (2.48 seconds).
[2025-10-24T00:42:46.489596] [INFO ] [REMOTE    ] ZETA: Full fetch complete (77735 records).
[2025-10-24T00:42:47.191628] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-07 (2.39 seconds).
[2025-10-24T00:42:47.243974] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-08.
[2025-10-24T00:42:47.352992] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T00:42:47.364497] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-06.
[2025-10-24T00:42:48.889479] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T00:42:48.898848] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-07.
[2025-10-24T00:42:49.462799] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-08 (2.22 seconds).
[2025-10-24T00:42:49.474147] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-09.
[2025-10-24T00:42:50.419428] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T00:42:50.429446] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-08.
[2025-10-24T00:42:51.603481] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-09 (2.13 seconds).
[2025-10-24T00:42:51.614937] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-10.
[2025-10-24T00:42:52.076938] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T00:42:52.087199] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-09.
[2025-10-24T00:42:53.574224] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T00:42:53.582970] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-10.
[2025-10-24T00:42:53.710212] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-10 (2.10 seconds).
[2025-10-24T00:42:53.720047] [INFO ] [REMOTE    ] ZIM: Full fetch complete (77567 records).
[2025-10-24T00:42:55.047586] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T00:42:55.055992] [INFO ] [REMOTE    ] ZIP: Full fetch complete (60806 records).
[2025-10-24T00:42:58.402060] [INFO ] [REMOTE    ] ZKH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:42:58.455990] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-01.
[2025-10-24T00:42:58.685853] [INFO ] [REMOTE    ] ZTR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:42:58.812170] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-01.
[2025-10-24T00:42:58.988006] [INFO ] [REMOTE    ] ZK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:42:59.007918] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-01.
[2025-10-24T00:42:59.050521] [INFO ] [REMOTE    ] ZTO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:42:59.051277] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-01.
[2025-10-24T00:42:59.375446] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T00:42:59.378046] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-02.
[2025-10-24T00:43:00.077718] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T00:43:00.085777] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-02.
[2025-10-24T00:43:00.164252] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T00:43:00.167407] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-03.
[2025-10-24T00:43:00.402671] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T00:43:00.409585] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-02.
[2025-10-24T00:43:00.820085] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T00:43:00.830064] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-02.
[2025-10-24T00:43:01.111854] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T00:43:01.114524] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-04.
[2025-10-24T00:43:01.300291] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T00:43:01.306320] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-03.
[2025-10-24T00:43:01.527498] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T00:43:01.543013] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-04 (0.43 seconds).
[2025-10-24T00:43:01.599498] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-03.
[2025-10-24T00:43:02.298267] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T00:43:02.399453] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-04.
[2025-10-24T00:43:02.637165] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T00:43:02.875272] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T00:43:03.199423] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-04.
[2025-10-24T00:43:03.364882] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T00:43:03.999486] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-03.
[2025-10-24T00:43:04.799434] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-05.
[2025-10-24T00:43:04.939418] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T00:43:05.599497] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-05.
[2025-10-24T00:43:05.624935] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T00:43:05.802670] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T00:43:06.399438] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-06.
[2025-10-24T00:43:07.104228] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T00:43:07.199436] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-06.
[2025-10-24T00:43:07.345745] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T00:43:07.999441] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-05.
[2025-10-24T00:43:08.586782] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-05 (0.59 seconds).
[2025-10-24T00:43:08.682851] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T00:43:08.799503] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-07.
[2025-10-24T00:43:09.599456] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-07.
[2025-10-24T00:43:09.798459] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T00:43:10.399449] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-06.
[2025-10-24T00:43:10.982914] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T00:43:11.016739] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T00:43:11.199496] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-08.
[2025-10-24T00:43:11.999449] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-07.
[2025-10-24T00:43:12.246212] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T00:43:12.799420] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-08.
[2025-10-24T00:43:12.962890] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T00:43:13.599499] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-09.
[2025-10-24T00:43:14.296394] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T00:43:14.399407] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-08.
[2025-10-24T00:43:14.595159] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T00:43:15.169010] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T00:43:15.199413] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-10.
[2025-10-24T00:43:15.999421] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-04.
[2025-10-24T00:43:16.105792] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T00:43:16.109563] [INFO ] [REMOTE    ] ZTR: Full fetch complete (26877 records).
[2025-10-24T00:43:16.806598] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-09.
[2025-10-24T00:43:17.323832] [INFO ] [REMOTE    ] ZTS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:43:17.598481] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T00:43:17.600393] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-09.
[2025-10-24T00:43:17.750772] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T00:43:18.399497] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-01.
[2025-10-24T00:43:19.005754] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T00:43:19.199458] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-10.
[2025-10-24T00:43:19.710714] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-10 (0.51 seconds).
[2025-10-24T00:43:19.712042] [INFO ] [REMOTE    ] ZKH: Full fetch complete (11752 records).
[2025-10-24T00:43:20.004672] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-05.
[2025-10-24T00:43:20.344373] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-01 (1.94 seconds).
[2025-10-24T00:43:20.810002] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-10.
[2025-10-24T00:43:20.969300] [INFO ] [REMOTE    ] ZVIA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:43:21.599423] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-01.
[2025-10-24T00:43:21.844831] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T00:43:21.911938] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T00:43:21.919514] [INFO ] [REMOTE    ] ZK: Full fetch complete (57121 records).
[2025-10-24T00:43:22.410518] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-06.
[2025-10-24T00:43:23.087756] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T00:43:23.204520] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-02.
[2025-10-24T00:43:23.347341] [INFO ] [REMOTE    ] ZWS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull).
[2025-10-24T00:43:23.735479] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T00:43:23.999440] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-07.
[2025-10-24T00:43:24.799433] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-02.
[2025-10-24T00:43:25.038343] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T00:43:25.599432] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-03.
[2025-10-24T00:43:25.750905] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T00:43:26.159497] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T00:43:26.399463] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-01.
[2025-10-24T00:43:27.199422] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-03.
[2025-10-24T00:43:27.497093] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T00:43:27.806338] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T00:43:27.999437] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-02.
[2025-10-24T00:43:28.624236] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T00:43:28.799471] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-04.
[2025-10-24T00:43:29.368634] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T00:43:29.599397] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-08.
[2025-10-24T00:43:30.076263] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T00:43:30.399460] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-04.
[2025-10-24T00:43:31.199444] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-05.
[2025-10-24T00:43:31.325504] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T00:43:31.999442] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-03.
[2025-10-24T00:43:32.226181] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T00:43:32.729492] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T00:43:32.799534] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-09.
[2025-10-24T00:43:33.511986] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T00:43:33.599412] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-04.
[2025-10-24T00:43:34.379121] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T00:43:34.399417] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-10.
[2025-10-24T00:43:35.199419] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-06.
[2025-10-24T00:43:35.322245] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T00:43:35.775431] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T00:43:35.784739] [INFO ] [REMOTE    ] ZTO: Full fetch complete (72672 records).
[2025-10-24T00:43:36.004549] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-05.
[2025-10-24T00:43:36.602179] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T00:43:36.799436] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-07.
[2025-10-24T00:43:37.599418] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-05.
[2025-10-24T00:43:37.699470] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T00:43:38.287897] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T00:43:38.399425] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-08.
[2025-10-24T00:43:39.055328] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T00:43:39.199433] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-06.
[2025-10-24T00:43:39.989416] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T00:43:39.999385] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-09.
[2025-10-24T00:43:40.766963] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T00:43:40.799412] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-07.
[2025-10-24T00:43:41.349886] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T00:43:41.599430] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-10.
[2025-10-24T00:43:42.399487] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-06.
[2025-10-24T00:43:42.471499] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T00:43:43.064921] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T00:43:43.071533] [INFO ] [REMOTE    ] ZVIA: Full fetch complete (52478 records).
[2025-10-24T00:43:43.209700] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-08.
[2025-10-24T00:43:44.188701] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T00:43:44.200723] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-07.
[2025-10-24T00:43:44.864266] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T00:43:44.873799] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-09.
[2025-10-24T00:43:46.144850] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T00:43:46.156493] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-08.
[2025-10-24T00:43:46.370994] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T00:43:46.399396] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-10.
[2025-10-24T00:43:47.876583] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T00:43:47.885738] [INFO ] [REMOTE    ] ZWS: Full fetch complete (62043 records).
[2025-10-24T00:43:48.296505] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-08 (2.14 seconds).
[2025-10-24T00:43:48.329365] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-09.
[2025-10-24T00:43:50.217132] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-09 (1.89 seconds).
[2025-10-24T00:43:50.228707] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-10.
[2025-10-24T00:43:51.954803] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T00:43:51.963866] [INFO ] [REMOTE    ] ZTS: Full fetch complete (76880 records).
[2025-10-24T00:43:53.327880] [DEBUG] [SYMBOL    ] Starting fetch of NYSE Symbols.
[2025-10-24T00:43:54.983158] [DEBUG] [SYMBOL    ] Found 2419 valid NYSE symbols.
[2025-10-24T00:43:54.983282] [INFO ] [SYMBOL    ] Completed fetch of NYSE Symbols.
[2025-10-24T01:11:44.771871] [INFO ] [MAIN      ] Using last completed trading day: 2025-10-23
[2025-10-24T01:11:44.772075] [INFO ] [MAIN      ] YUM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:11:44.832150] [DEBUG] [LOCAL     ] YUM: Loaded 51489 existing records from primary storage.
[2025-10-24T01:11:44.832343] [INFO ] [MAIN      ] YUM: Loaded 51489 primary data records.
[2025-10-24T01:11:45.162235] [DEBUG] [MAIN      ] YUM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:11:45.191091] [INFO ] [MAIN      ] YUM: Generated 139 derivative records from 51489 primary records.
[2025-10-24T01:11:45.191210] [DEBUG] [LOCAL     ] YUM: Saving derivative data.
[2025-10-24T01:11:45.191525] [FATAL] [LOCAL     ] YUM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime'
[2025-10-24T01:11:45.191609] [FATAL] [MAIN      ] YUM: Failed to save derivative data.
[2025-10-24T01:15:54.400290] [INFO ] [MAIN      ] Using last completed trading day: 2025-10-23
[2025-10-24T01:15:54.400897] [INFO ] [MAIN      ] YUM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:15:54.462095] [DEBUG] [LOCAL     ] YUM: Loaded 51489 existing records from primary storage.
[2025-10-24T01:15:54.462363] [INFO ] [MAIN      ] YUM: Loaded 51489 primary data records.
[2025-10-24T01:15:54.796527] [DEBUG] [MAIN      ] YUM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:15:54.824889] [INFO ] [MAIN      ] YUM: Generated 139 derivative records from 51489 primary records.
[2025-10-24T01:15:54.825071] [DEBUG] [LOCAL     ] YUM: Saving derivative data.
[2025-10-24T01:15:54.839404] [DEBUG] [LOCAL     ] YUM: Derivative data saved (139 records).
[2025-10-24T01:15:54.839530] [INFO ] [MAIN      ] YUM: Successfully saved derivative data.
[2025-10-24T01:16:16.196760] [INFO ] [MAIN      ] Using last completed trading day: 2025-10-23
[2025-10-24T01:16:16.196900] [INFO ] [MAIN      ] Refreshing symbols list before derivative generation...
[2025-10-24T01:16:16.196976] [INFO ] [MAIN      ] Starting TDM symbol refresh process.
[2025-10-24T01:16:16.197075] [INFO ] [MAIN      ] Fetching latest NYSE symbols list.
[2025-10-24T01:16:16.197144] [DEBUG] [SYMBOL    ] Starting fetch of NYSE Symbols.
[2025-10-24T01:16:17.222834] [DEBUG] [SYMBOL    ] Found 2419 valid NYSE symbols.
[2025-10-24T01:16:17.223025] [INFO ] [SYMBOL    ] Completed fetch of NYSE Symbols.
[2025-10-24T01:16:17.223285] [INFO ] [MAIN      ] Filtered out 54 blacklisted symbols.
[2025-10-24T01:16:17.223886] [INFO ] [LOCAL     ] Symbols cache updated with 2367 symbols.
[2025-10-24T01:16:17.223983] [INFO ] [MAIN      ] Successfully refreshed symbols list.
[2025-10-24T01:16:17.224071] [INFO ] [MAIN      ] Finished TDM symbol refresh process.
[2025-10-24T01:16:17.224219] [INFO ] [MAIN      ] Pruning stale symbols...
[2025-10-24T01:16:17.224315] [INFO ] [MAIN      ] Starting TDM stale symbol pruning process.
[2025-10-24T01:16:17.224412] [INFO ] [LOCAL     ] Reading cached symbols list.
[2025-10-24T01:16:17.224857] [DEBUG] [LOCAL     ] Found 2367 symbols in cached list.
[2025-10-24T01:16:17.224945] [INFO ] [LOCAL     ] Completed reading cached symbols list.
[2025-10-24T01:16:17.225160] [INFO ] [MAIN      ] Including 54 blacklisted symbols for pruning.
[2025-10-24T01:16:17.225251] [INFO ] [MAIN      ] Pruning data for symbols not in current list of 2367 valid symbols.
[2025-10-24T01:16:17.225343] [INFO ] [LOCAL     ] Starting pruning of local symbol history data for inactive/invalid symbols.
[2025-10-24T01:16:17.225441] [DEBUG] [LOCAL     ] Checking directory: '/opt/tdm/output/data/primary_storage'
[2025-10-24T01:16:17.251393] [DEBUG] [LOCAL     ] Checking directory: '/opt/tdm/output/data/derivative_storage'
[2025-10-24T01:16:17.251596] [INFO ] [LOCAL     ] Deleted 0 obsolete data files.
[2025-10-24T01:16:17.251711] [INFO ] [LOCAL     ] Completed pruning of unlisted local symbol history data.
[2025-10-24T01:16:17.251803] [INFO ] [MAIN      ] Successfully pruned stale symbol data.
[2025-10-24T01:16:17.251901] [INFO ] [MAIN      ] Finished TDM stale symbol pruning process.
[2025-10-24T01:16:17.252023] [INFO ] [MAIN      ] Running derivative generation in single-threaded mode
[2025-10-24T01:16:17.252115] [INFO ] [MAIN      ] Wiping all existing derivative data before regeneration.
[2025-10-24T01:16:17.252210] [INFO ] [LOCAL     ] Starting deletion of all local derivative data.
[2025-10-24T01:16:17.252455] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv
[2025-10-24T01:16:17.252549] [INFO ] [LOCAL     ] Deleted 1 derivative data files.
[2025-10-24T01:16:17.252638] [INFO ] [LOCAL     ] Scanning primary storage for available symbols.
[2025-10-24T01:16:17.254860] [INFO ] [LOCAL     ] Found 2164 symbols with primary data.
[2025-10-24T01:16:17.254948] [INFO ] [MAIN      ] Starting derivative generation for 2164 symbols.
[2025-10-24T01:16:17.255052] [INFO ] [MAIN      ] A: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:17.316884] [DEBUG] [LOCAL     ] A: Loaded 51001 existing records from primary storage.
[2025-10-24T01:16:17.317060] [INFO ] [MAIN      ] A: Loaded 51001 primary data records.
[2025-10-24T01:16:17.646151] [DEBUG] [MAIN      ] A: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:17.673837] [INFO ] [MAIN      ] A: Generated 139 derivative records from 51001 primary records.
[2025-10-24T01:16:17.673983] [DEBUG] [LOCAL     ] A: Saving derivative data.
[2025-10-24T01:16:17.686014] [DEBUG] [LOCAL     ] A: Derivative data saved (139 records).
[2025-10-24T01:16:17.686097] [INFO ] [MAIN      ] A: Successfully saved derivative data.
[2025-10-24T01:16:17.688310] [INFO ] [MAIN      ] Derivative Progress: 1/2164 symbols. A took 0.4s. Estimated remaining time: 15m 37s
[2025-10-24T01:16:17.688414] [INFO ] [MAIN      ] AA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:17.741583] [DEBUG] [LOCAL     ] AA: Loaded 54012 existing records from primary storage.
[2025-10-24T01:16:17.741800] [INFO ] [MAIN      ] AA: Loaded 54012 primary data records.
[2025-10-24T01:16:18.050273] [DEBUG] [MAIN      ] AA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:18.076085] [INFO ] [MAIN      ] AA: Generated 139 derivative records from 54012 primary records.
[2025-10-24T01:16:18.076246] [DEBUG] [LOCAL     ] AA: Saving derivative data.
[2025-10-24T01:16:18.088142] [DEBUG] [LOCAL     ] AA: Derivative data saved (139 records).
[2025-10-24T01:16:18.088228] [INFO ] [MAIN      ] AA: Successfully saved derivative data.
[2025-10-24T01:16:18.090753] [INFO ] [MAIN      ] Derivative Progress: 2/2164 symbols. AA took 0.4s. Estimated remaining time: 15m 3s
[2025-10-24T01:16:18.090859] [INFO ] [MAIN      ] AAMI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:18.113073] [DEBUG] [LOCAL     ] AAMI: Loaded 24527 existing records from primary storage.
[2025-10-24T01:16:18.113232] [INFO ] [MAIN      ] AAMI: Loaded 24527 primary data records.
[2025-10-24T01:16:18.468249] [DEBUG] [MAIN      ] AAMI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:18.498432] [INFO ] [MAIN      ] AAMI: Generated 139 derivative records from 24527 primary records.
[2025-10-24T01:16:18.498661] [DEBUG] [LOCAL     ] AAMI: Saving derivative data.
[2025-10-24T01:16:18.511202] [DEBUG] [LOCAL     ] AAMI: Derivative data saved (139 records).
[2025-10-24T01:16:18.511365] [INFO ] [MAIN      ] AAMI: Successfully saved derivative data.
[2025-10-24T01:16:18.513110] [INFO ] [MAIN      ] Derivative Progress: 3/2164 symbols. AAMI took 0.4s. Estimated remaining time: 15m 6s
[2025-10-24T01:16:18.513239] [INFO ] [MAIN      ] AAP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:18.566049] [DEBUG] [LOCAL     ] AAP: Loaded 52090 existing records from primary storage.
[2025-10-24T01:16:18.566255] [INFO ] [MAIN      ] AAP: Loaded 52090 primary data records.
[2025-10-24T01:16:19.017632] [DEBUG] [MAIN      ] AAP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:19.060614] [INFO ] [MAIN      ] AAP: Generated 139 derivative records from 52090 primary records.
[2025-10-24T01:16:19.060865] [DEBUG] [LOCAL     ] AAP: Saving derivative data.
[2025-10-24T01:16:19.082546] [DEBUG] [LOCAL     ] AAP: Derivative data saved (139 records).
[2025-10-24T01:16:19.082782] [INFO ] [MAIN      ] AAP: Successfully saved derivative data.
[2025-10-24T01:16:19.087143] [INFO ] [MAIN      ] Derivative Progress: 4/2164 symbols. AAP took 0.6s. Estimated remaining time: 16m 29s
[2025-10-24T01:16:19.088956] [INFO ] [MAIN      ] AAT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:19.134834] [DEBUG] [LOCAL     ] AAT: Loaded 30402 existing records from primary storage.
[2025-10-24T01:16:19.135051] [INFO ] [MAIN      ] AAT: Loaded 30402 primary data records.
[2025-10-24T01:16:19.563430] [DEBUG] [MAIN      ] AAT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:19.601623] [INFO ] [MAIN      ] AAT: Generated 139 derivative records from 30402 primary records.
[2025-10-24T01:16:19.601831] [DEBUG] [LOCAL     ] AAT: Saving derivative data.
[2025-10-24T01:16:19.613412] [DEBUG] [LOCAL     ] AAT: Derivative data saved (139 records).
[2025-10-24T01:16:19.613537] [INFO ] [MAIN      ] AAT: Successfully saved derivative data.
[2025-10-24T01:16:19.615783] [INFO ] [MAIN      ] Derivative Progress: 5/2164 symbols. AAT took 0.5s. Estimated remaining time: 16m 58s
[2025-10-24T01:16:19.615884] [INFO ] [MAIN      ] AB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:19.639997] [DEBUG] [LOCAL     ] AB: Loaded 24773 existing records from primary storage.
[2025-10-24T01:16:19.640163] [INFO ] [MAIN      ] AB: Loaded 24773 primary data records.
[2025-10-24T01:16:19.978029] [DEBUG] [MAIN      ] AB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:20.004323] [INFO ] [MAIN      ] AB: Generated 139 derivative records from 24773 primary records.
[2025-10-24T01:16:20.004422] [DEBUG] [LOCAL     ] AB: Saving derivative data.
[2025-10-24T01:16:20.016829] [DEBUG] [LOCAL     ] AB: Derivative data saved (139 records).
[2025-10-24T01:16:20.016916] [INFO ] [MAIN      ] AB: Successfully saved derivative data.
[2025-10-24T01:16:20.018693] [INFO ] [MAIN      ] Derivative Progress: 6/2164 symbols. AB took 0.4s. Estimated remaining time: 16m 33s
[2025-10-24T01:16:20.018789] [INFO ] [MAIN      ] ABCB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:20.047119] [DEBUG] [LOCAL     ] ABCB: Loaded 30498 existing records from primary storage.
[2025-10-24T01:16:20.047274] [INFO ] [MAIN      ] ABCB: Loaded 30498 primary data records.
[2025-10-24T01:16:20.356101] [DEBUG] [MAIN      ] ABCB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:20.386060] [INFO ] [MAIN      ] ABCB: Generated 139 derivative records from 30498 primary records.
[2025-10-24T01:16:20.386442] [DEBUG] [LOCAL     ] ABCB: Saving derivative data.
[2025-10-24T01:16:20.398490] [DEBUG] [LOCAL     ] ABCB: Derivative data saved (139 records).
[2025-10-24T01:16:20.398635] [INFO ] [MAIN      ] ABCB: Successfully saved derivative data.
[2025-10-24T01:16:20.401123] [INFO ] [MAIN      ] Derivative Progress: 7/2164 symbols. ABCB took 0.4s. Estimated remaining time: 16m 9s
[2025-10-24T01:16:20.401454] [INFO ] [MAIN      ] ABM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:20.436459] [DEBUG] [LOCAL     ] ABM: Loaded 32319 existing records from primary storage.
[2025-10-24T01:16:20.436673] [INFO ] [MAIN      ] ABM: Loaded 32319 primary data records.
[2025-10-24T01:16:20.777228] [DEBUG] [MAIN      ] ABM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:20.802893] [INFO ] [MAIN      ] ABM: Generated 139 derivative records from 32319 primary records.
[2025-10-24T01:16:20.803003] [DEBUG] [LOCAL     ] ABM: Saving derivative data.
[2025-10-24T01:16:20.814298] [DEBUG] [LOCAL     ] ABM: Derivative data saved (139 records).
[2025-10-24T01:16:20.814375] [INFO ] [MAIN      ] ABM: Successfully saved derivative data.
[2025-10-24T01:16:20.816902] [INFO ] [MAIN      ] Derivative Progress: 8/2164 symbols. ABM took 0.4s. Estimated remaining time: 15m 59s
[2025-10-24T01:16:20.817005] [INFO ] [MAIN      ] ABR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:20.867046] [DEBUG] [LOCAL     ] ABR: Loaded 52253 existing records from primary storage.
[2025-10-24T01:16:20.867210] [INFO ] [MAIN      ] ABR: Loaded 52253 primary data records.
[2025-10-24T01:16:21.172351] [DEBUG] [MAIN      ] ABR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:21.199195] [INFO ] [MAIN      ] ABR: Generated 139 derivative records from 52253 primary records.
[2025-10-24T01:16:21.199391] [DEBUG] [LOCAL     ] ABR: Saving derivative data.
[2025-10-24T01:16:21.211378] [DEBUG] [LOCAL     ] ABR: Derivative data saved (139 records).
[2025-10-24T01:16:21.211489] [INFO ] [MAIN      ] ABR: Successfully saved derivative data.
[2025-10-24T01:16:21.214095] [INFO ] [MAIN      ] Derivative Progress: 9/2164 symbols. ABR took 0.4s. Estimated remaining time: 15m 47s
[2025-10-24T01:16:21.214235] [INFO ] [MAIN      ] ABT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:21.267721] [DEBUG] [LOCAL     ] ABT: Loaded 54014 existing records from primary storage.
[2025-10-24T01:16:21.267903] [INFO ] [MAIN      ] ABT: Loaded 54014 primary data records.
[2025-10-24T01:16:21.581530] [DEBUG] [MAIN      ] ABT: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:16:21.608474] [INFO ] [MAIN      ] ABT: Generated 139 derivative records from 54014 primary records.
[2025-10-24T01:16:21.608686] [DEBUG] [LOCAL     ] ABT: Saving derivative data.
[2025-10-24T01:16:21.620208] [DEBUG] [LOCAL     ] ABT: Derivative data saved (139 records).
[2025-10-24T01:16:21.620295] [INFO ] [MAIN      ] ABT: Successfully saved derivative data.
[2025-10-24T01:16:21.622877] [INFO ] [MAIN      ] Derivative Progress: 10/2164 symbols. ABT took 0.4s. Estimated remaining time: 15m 40s
[2025-10-24T01:16:21.622976] [INFO ] [MAIN      ] ACA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:21.645046] [DEBUG] [LOCAL     ] ACA: Loaded 22636 existing records from primary storage.
[2025-10-24T01:16:21.645207] [INFO ] [MAIN      ] ACA: Loaded 22636 primary data records.
[2025-10-24T01:16:21.970980] [DEBUG] [MAIN      ] ACA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:21.997921] [INFO ] [MAIN      ] ACA: Generated 139 derivative records from 22636 primary records.
[2025-10-24T01:16:21.998088] [DEBUG] [LOCAL     ] ACA: Saving derivative data.
[2025-10-24T01:16:22.009785] [DEBUG] [LOCAL     ] ACA: Derivative data saved (139 records).
[2025-10-24T01:16:22.009877] [INFO ] [MAIN      ] ACA: Successfully saved derivative data.
[2025-10-24T01:16:22.011704] [INFO ] [MAIN      ] Derivative Progress: 11/2164 symbols. ACA took 0.4s. Estimated remaining time: 15m 30s
[2025-10-24T01:16:22.011797] [INFO ] [MAIN      ] ACCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:22.047031] [DEBUG] [LOCAL     ] ACCO: Loaded 36869 existing records from primary storage.
[2025-10-24T01:16:22.047200] [INFO ] [MAIN      ] ACCO: Loaded 36869 primary data records.
[2025-10-24T01:16:22.373996] [DEBUG] [MAIN      ] ACCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:22.400555] [INFO ] [MAIN      ] ACCO: Generated 139 derivative records from 36869 primary records.
[2025-10-24T01:16:22.400714] [DEBUG] [LOCAL     ] ACCO: Saving derivative data.
[2025-10-24T01:16:22.412262] [DEBUG] [LOCAL     ] ACCO: Derivative data saved (139 records).
[2025-10-24T01:16:22.412346] [INFO ] [MAIN      ] ACCO: Successfully saved derivative data.
[2025-10-24T01:16:22.414782] [INFO ] [MAIN      ] Derivative Progress: 12/2164 symbols. ACCO took 0.4s. Estimated remaining time: 15m 25s
[2025-10-24T01:16:22.414879] [INFO ] [MAIN      ] ACEL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:22.440946] [DEBUG] [LOCAL     ] ACEL: Loaded 26458 existing records from primary storage.
[2025-10-24T01:16:22.441116] [INFO ] [MAIN      ] ACEL: Loaded 26458 primary data records.
[2025-10-24T01:16:22.789415] [DEBUG] [MAIN      ] ACEL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:22.816009] [INFO ] [MAIN      ] ACEL: Generated 139 derivative records from 26458 primary records.
[2025-10-24T01:16:22.816178] [DEBUG] [LOCAL     ] ACEL: Saving derivative data.
[2025-10-24T01:16:22.827983] [DEBUG] [LOCAL     ] ACEL: Derivative data saved (139 records).
[2025-10-24T01:16:22.828073] [INFO ] [MAIN      ] ACEL: Successfully saved derivative data.
[2025-10-24T01:16:22.830497] [INFO ] [MAIN      ] Derivative Progress: 13/2164 symbols. ACEL took 0.4s. Estimated remaining time: 15m 22s
[2025-10-24T01:16:22.830600] [INFO ] [MAIN      ] ACHR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:22.886422] [DEBUG] [LOCAL     ] ACHR: Loaded 54208 existing records from primary storage.
[2025-10-24T01:16:22.886638] [INFO ] [MAIN      ] ACHR: Loaded 54208 primary data records.
[2025-10-24T01:16:23.210774] [DEBUG] [MAIN      ] ACHR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:23.238386] [INFO ] [MAIN      ] ACHR: Generated 139 derivative records from 54208 primary records.
[2025-10-24T01:16:23.238571] [DEBUG] [LOCAL     ] ACHR: Saving derivative data.
[2025-10-24T01:16:23.250321] [DEBUG] [LOCAL     ] ACHR: Derivative data saved (139 records).
[2025-10-24T01:16:23.250405] [INFO ] [MAIN      ] ACHR: Successfully saved derivative data.
[2025-10-24T01:16:23.252981] [INFO ] [MAIN      ] Derivative Progress: 14/2164 symbols. ACHR took 0.4s. Estimated remaining time: 15m 21s
[2025-10-24T01:16:23.253080] [INFO ] [MAIN      ] ACI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:23.302997] [DEBUG] [LOCAL     ] ACI: Loaded 53675 existing records from primary storage.
[2025-10-24T01:16:23.303163] [INFO ] [MAIN      ] ACI: Loaded 53675 primary data records.
[2025-10-24T01:16:23.609242] [DEBUG] [MAIN      ] ACI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:23.638589] [INFO ] [MAIN      ] ACI: Generated 139 derivative records from 53675 primary records.
[2025-10-24T01:16:23.638793] [DEBUG] [LOCAL     ] ACI: Saving derivative data.
[2025-10-24T01:16:23.650556] [DEBUG] [LOCAL     ] ACI: Derivative data saved (139 records).
[2025-10-24T01:16:23.650682] [INFO ] [MAIN      ] ACI: Successfully saved derivative data.
[2025-10-24T01:16:23.653318] [INFO ] [MAIN      ] Derivative Progress: 15/2164 symbols. ACI took 0.4s. Estimated remaining time: 15m 16s
[2025-10-24T01:16:23.653437] [INFO ] [MAIN      ] ACM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:23.693752] [DEBUG] [LOCAL     ] ACM: Loaded 43000 existing records from primary storage.
[2025-10-24T01:16:23.693918] [INFO ] [MAIN      ] ACM: Loaded 43000 primary data records.
[2025-10-24T01:16:24.029701] [DEBUG] [MAIN      ] ACM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:24.057177] [INFO ] [MAIN      ] ACM: Generated 139 derivative records from 43000 primary records.
[2025-10-24T01:16:24.057324] [DEBUG] [LOCAL     ] ACM: Saving derivative data.
[2025-10-24T01:16:24.070233] [DEBUG] [LOCAL     ] ACM: Derivative data saved (139 records).
[2025-10-24T01:16:24.070343] [INFO ] [MAIN      ] ACM: Successfully saved derivative data.
[2025-10-24T01:16:24.072821] [INFO ] [MAIN      ] Derivative Progress: 16/2164 symbols. ACM took 0.4s. Estimated remaining time: 15m 15s
[2025-10-24T01:16:24.072936] [INFO ] [MAIN      ] ACN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:24.124672] [DEBUG] [LOCAL     ] ACN: Loaded 53828 existing records from primary storage.
[2025-10-24T01:16:24.124844] [INFO ] [MAIN      ] ACN: Loaded 53828 primary data records.
[2025-10-24T01:16:24.434193] [DEBUG] [MAIN      ] ACN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:24.460126] [INFO ] [MAIN      ] ACN: Generated 139 derivative records from 53828 primary records.
[2025-10-24T01:16:24.460250] [DEBUG] [LOCAL     ] ACN: Saving derivative data.
[2025-10-24T01:16:24.472064] [DEBUG] [LOCAL     ] ACN: Derivative data saved (139 records).
[2025-10-24T01:16:24.472147] [INFO ] [MAIN      ] ACN: Successfully saved derivative data.
[2025-10-24T01:16:24.474741] [INFO ] [MAIN      ] Derivative Progress: 17/2164 symbols. ACN took 0.4s. Estimated remaining time: 15m 11s
[2025-10-24T01:16:24.474850] [INFO ] [MAIN      ] ACP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:24.502283] [DEBUG] [LOCAL     ] ACP: Loaded 31336 existing records from primary storage.
[2025-10-24T01:16:24.502441] [INFO ] [MAIN      ] ACP: Loaded 31336 primary data records.
[2025-10-24T01:16:24.834630] [DEBUG] [MAIN      ] ACP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:24.860141] [INFO ] [MAIN      ] ACP: Generated 139 derivative records from 31336 primary records.
[2025-10-24T01:16:24.860264] [DEBUG] [LOCAL     ] ACP: Saving derivative data.
[2025-10-24T01:16:24.871242] [DEBUG] [LOCAL     ] ACP: Derivative data saved (139 records).
[2025-10-24T01:16:24.871335] [INFO ] [MAIN      ] ACP: Successfully saved derivative data.
[2025-10-24T01:16:24.873745] [INFO ] [MAIN      ] Derivative Progress: 18/2164 symbols. ACP took 0.4s. Estimated remaining time: 15m 8s
[2025-10-24T01:16:24.873843] [INFO ] [MAIN      ] ACR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:24.881330] [DEBUG] [LOCAL     ] ACR: Loaded 5325 existing records from primary storage.
[2025-10-24T01:16:24.881458] [INFO ] [MAIN      ] ACR: Loaded 5325 primary data records.
[2025-10-24T01:16:25.187700] [DEBUG] [MAIN      ] ACR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:25.216170] [INFO ] [MAIN      ] ACR: Generated 139 derivative records from 5325 primary records.
[2025-10-24T01:16:25.216374] [DEBUG] [LOCAL     ] ACR: Saving derivative data.
[2025-10-24T01:16:25.228323] [DEBUG] [LOCAL     ] ACR: Derivative data saved (139 records).
[2025-10-24T01:16:25.228431] [INFO ] [MAIN      ] ACR: Successfully saved derivative data.
[2025-10-24T01:16:25.230490] [INFO ] [MAIN      ] Derivative Progress: 19/2164 symbols. ACR took 0.4s. Estimated remaining time: 14m 60s
[2025-10-24T01:16:25.230591] [INFO ] [MAIN      ] ACRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:25.261810] [DEBUG] [LOCAL     ] ACRE: Loaded 33455 existing records from primary storage.
[2025-10-24T01:16:25.261978] [INFO ] [MAIN      ] ACRE: Loaded 33455 primary data records.
[2025-10-24T01:16:25.579589] [DEBUG] [MAIN      ] ACRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:25.606532] [INFO ] [MAIN      ] ACRE: Generated 139 derivative records from 33455 primary records.
[2025-10-24T01:16:25.606737] [DEBUG] [LOCAL     ] ACRE: Saving derivative data.
[2025-10-24T01:16:25.618196] [DEBUG] [LOCAL     ] ACRE: Derivative data saved (139 records).
[2025-10-24T01:16:25.618288] [INFO ] [MAIN      ] ACRE: Successfully saved derivative data.
[2025-10-24T01:16:25.620852] [INFO ] [MAIN      ] Derivative Progress: 20/2164 symbols. ACRE took 0.4s. Estimated remaining time: 14m 56s
[2025-10-24T01:16:25.620958] [INFO ] [MAIN      ] ACV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:25.631040] [DEBUG] [LOCAL     ] ACV: Loaded 7456 existing records from primary storage.
[2025-10-24T01:16:25.631187] [INFO ] [MAIN      ] ACV: Loaded 7456 primary data records.
[2025-10-24T01:16:25.945575] [DEBUG] [MAIN      ] ACV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:25.976410] [INFO ] [MAIN      ] ACV: Generated 139 derivative records from 7456 primary records.
[2025-10-24T01:16:25.976584] [DEBUG] [LOCAL     ] ACV: Saving derivative data.
[2025-10-24T01:16:25.987668] [DEBUG] [LOCAL     ] ACV: Derivative data saved (139 records).
[2025-10-24T01:16:25.987779] [INFO ] [MAIN      ] ACV: Successfully saved derivative data.
[2025-10-24T01:16:25.989751] [INFO ] [MAIN      ] Derivative Progress: 21/2164 symbols. ACV took 0.4s. Estimated remaining time: 14m 51s
[2025-10-24T01:16:25.989848] [INFO ] [MAIN      ] ACVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:26.032290] [WARN ] [STATE     ] Received SIGINT signal. Initiating graceful shutdown...
[2025-10-24T01:16:26.034290] [DEBUG] [LOCAL     ] ACVA: Loaded 49608 existing records from primary storage.
[2025-10-24T01:16:26.034413] [INFO ] [MAIN      ] ACVA: Loaded 49608 primary data records.
[2025-10-24T01:16:26.359331] [DEBUG] [MAIN      ] ACVA: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:16:26.385954] [INFO ] [MAIN      ] ACVA: Generated 139 derivative records from 49608 primary records.
[2025-10-24T01:16:26.386139] [DEBUG] [LOCAL     ] ACVA: Saving derivative data.
[2025-10-24T01:16:26.398103] [DEBUG] [LOCAL     ] ACVA: Derivative data saved (139 records).
[2025-10-24T01:16:26.398204] [INFO ] [MAIN      ] ACVA: Successfully saved derivative data.
[2025-10-24T01:16:26.400795] [INFO ] [MAIN      ] Derivative Progress: 22/2164 symbols. ACVA took 0.4s. Estimated remaining time: 14m 50s
[2025-10-24T01:16:26.400949] [WARN ] [MAIN      ] Shutdown requested, stopping derivative generation at symbol 23/2164.
[2025-10-24T01:16:26.401036] [INFO ] [MAIN      ] Derivative generation success rate: 100.0% (22/2164 symbols)
[2025-10-24T01:16:39.891405] [INFO ] [MAIN      ] Using last completed trading day: 2025-10-23
[2025-10-24T01:16:39.891541] [INFO ] [MAIN      ] Refreshing symbols list before derivative generation...
[2025-10-24T01:16:39.891615] [INFO ] [MAIN      ] Starting TDM symbol refresh process.
[2025-10-24T01:16:39.891726] [INFO ] [MAIN      ] Fetching latest NYSE symbols list.
[2025-10-24T01:16:39.891796] [DEBUG] [SYMBOL    ] Starting fetch of NYSE Symbols.
[2025-10-24T01:16:41.016305] [DEBUG] [SYMBOL    ] Found 2419 valid NYSE symbols.
[2025-10-24T01:16:41.016471] [INFO ] [SYMBOL    ] Completed fetch of NYSE Symbols.
[2025-10-24T01:16:41.016740] [INFO ] [MAIN      ] Filtered out 54 blacklisted symbols.
[2025-10-24T01:16:41.017305] [INFO ] [LOCAL     ] Symbols cache updated with 2367 symbols.
[2025-10-24T01:16:41.017379] [INFO ] [MAIN      ] Successfully refreshed symbols list.
[2025-10-24T01:16:41.017447] [INFO ] [MAIN      ] Finished TDM symbol refresh process.
[2025-10-24T01:16:41.017542] [INFO ] [MAIN      ] Pruning stale symbols...
[2025-10-24T01:16:41.017612] [INFO ] [MAIN      ] Starting TDM stale symbol pruning process.
[2025-10-24T01:16:41.017723] [INFO ] [LOCAL     ] Reading cached symbols list.
[2025-10-24T01:16:41.018129] [DEBUG] [LOCAL     ] Found 2367 symbols in cached list.
[2025-10-24T01:16:41.018197] [INFO ] [LOCAL     ] Completed reading cached symbols list.
[2025-10-24T01:16:41.018390] [INFO ] [MAIN      ] Including 54 blacklisted symbols for pruning.
[2025-10-24T01:16:41.018464] [INFO ] [MAIN      ] Pruning data for symbols not in current list of 2367 valid symbols.
[2025-10-24T01:16:41.018533] [INFO ] [LOCAL     ] Starting pruning of local symbol history data for inactive/invalid symbols.
[2025-10-24T01:16:41.018600] [DEBUG] [LOCAL     ] Checking directory: '/opt/tdm/output/data/primary_storage'
[2025-10-24T01:16:41.045103] [DEBUG] [LOCAL     ] Checking directory: '/opt/tdm/output/data/derivative_storage'
[2025-10-24T01:16:41.045271] [INFO ] [LOCAL     ] Deleted 0 obsolete data files.
[2025-10-24T01:16:41.045341] [INFO ] [LOCAL     ] Completed pruning of unlisted local symbol history data.
[2025-10-24T01:16:41.045410] [INFO ] [MAIN      ] Successfully pruned stale symbol data.
[2025-10-24T01:16:41.045477] [INFO ] [MAIN      ] Finished TDM stale symbol pruning process.
[2025-10-24T01:16:41.045566] [INFO ] [MAIN      ] Running derivative generation in parallel mode
[2025-10-24T01:16:41.045637] [INFO ] [MAIN      ] Wiping all existing derivative data before regeneration.
[2025-10-24T01:16:41.045733] [INFO ] [LOCAL     ] Starting deletion of all local derivative data.
[2025-10-24T01:16:41.045932] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv
[2025-10-24T01:16:41.046070] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv
[2025-10-24T01:16:41.046202] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv
[2025-10-24T01:16:41.046330] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv
[2025-10-24T01:16:41.046462] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv
[2025-10-24T01:16:41.046600] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv
[2025-10-24T01:16:41.046770] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv
[2025-10-24T01:16:41.046905] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv
[2025-10-24T01:16:41.047040] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/AAMI.csv
[2025-10-24T01:16:41.047176] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv
[2025-10-24T01:16:41.047313] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv
[2025-10-24T01:16:41.047456] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv
[2025-10-24T01:16:41.047591] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv
[2025-10-24T01:16:41.047773] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv
[2025-10-24T01:16:41.047911] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv
[2025-10-24T01:16:41.048040] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv
[2025-10-24T01:16:41.048176] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv
[2025-10-24T01:16:41.048310] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv
[2025-10-24T01:16:41.048441] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv
[2025-10-24T01:16:41.048574] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv
[2025-10-24T01:16:41.048731] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv
[2025-10-24T01:16:41.048866] [DEBUG] [LOCAL     ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv
[2025-10-24T01:16:41.048936] [INFO ] [LOCAL     ] Deleted 22 derivative data files.
[2025-10-24T01:16:41.049007] [INFO ] [LOCAL     ] Scanning primary storage for available symbols.
[2025-10-24T01:16:41.051180] [INFO ] [LOCAL     ] Found 2164 symbols with primary data.
[2025-10-24T01:16:41.051317] [INFO ] [MAIN      ] Starting parallel derivative generation with 3 worker threads for 2164 symbols
[2025-10-24T01:16:41.051745] [INFO ] [MAIN      ] A: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:41.051982] [INFO ] [MAIN      ] AA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:41.053022] [INFO ] [MAIN      ] AAMI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:41.087309] [DEBUG] [LOCAL     ] AAMI: Loaded 24527 existing records from primary storage.
[2025-10-24T01:16:41.087580] [INFO ] [MAIN      ] AAMI: Loaded 24527 primary data records.
[2025-10-24T01:16:41.274690] [DEBUG] [LOCAL     ] A: Loaded 51001 existing records from primary storage.
[2025-10-24T01:16:41.292234] [DEBUG] [LOCAL     ] AA: Loaded 54012 existing records from primary storage.
[2025-10-24T01:16:41.308150] [INFO ] [MAIN      ] A: Loaded 51001 primary data records.
[2025-10-24T01:16:41.348599] [INFO ] [MAIN      ] AA: Loaded 54012 primary data records.
[2025-10-24T01:16:42.209913] [DEBUG] [MAIN      ] AAMI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:42.260285] [DEBUG] [MAIN      ] A: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:42.300265] [DEBUG] [MAIN      ] AA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:42.340839] [INFO ] [MAIN      ] AAMI: Generated 139 derivative records from 24527 primary records.
[2025-10-24T01:16:42.345853] [DEBUG] [LOCAL     ] AAMI: Saving derivative data.
[2025-10-24T01:16:42.369380] [DEBUG] [LOCAL     ] AAMI: Derivative data saved (139 records).
[2025-10-24T01:16:42.371008] [INFO ] [MAIN      ] AAMI: Successfully saved derivative data.
[2025-10-24T01:16:42.377411] [INFO ] [MAIN      ] Derivative Progress: 1/2164 symbols completed. AAMI took 1.3s. Estimated remaining: 47m 48s. Rate: 45.2 symbols/min
[2025-10-24T01:16:42.377994] [INFO ] [MAIN      ] AAP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:42.389385] [INFO ] [MAIN      ] A: Generated 139 derivative records from 51001 primary records.
[2025-10-24T01:16:42.391867] [DEBUG] [LOCAL     ] A: Saving derivative data.
[2025-10-24T01:16:42.391631] [INFO ] [MAIN      ] AA: Generated 139 derivative records from 54012 primary records.
[2025-10-24T01:16:42.392312] [DEBUG] [LOCAL     ] AA: Saving derivative data.
[2025-10-24T01:16:42.415859] [DEBUG] [LOCAL     ] A: Derivative data saved (139 records).
[2025-10-24T01:16:42.416908] [DEBUG] [LOCAL     ] AA: Derivative data saved (139 records).
[2025-10-24T01:16:42.417321] [INFO ] [MAIN      ] A: Successfully saved derivative data.
[2025-10-24T01:16:42.417507] [INFO ] [MAIN      ] AA: Successfully saved derivative data.
[2025-10-24T01:16:42.420699] [INFO ] [MAIN      ] Derivative Progress: 2/2164 symbols completed. AA took 1.4s. Estimated remaining: 24m 40s. Rate: 87.6 symbols/min
[2025-10-24T01:16:42.420959] [INFO ] [MAIN      ] AAT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:42.438393] [INFO ] [MAIN      ] Derivative Progress: 3/2164 symbols completed. A took 1.4s. Estimated remaining: 16m 39s. Rate: 129.8 symbols/min
[2025-10-24T01:16:42.438979] [INFO ] [MAIN      ] AB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:42.463639] [DEBUG] [LOCAL     ] AAP: Loaded 52090 existing records from primary storage.
[2025-10-24T01:16:42.464250] [INFO ] [MAIN      ] AAP: Loaded 52090 primary data records.
[2025-10-24T01:16:42.604108] [DEBUG] [LOCAL     ] AAT: Loaded 30402 existing records from primary storage.
[2025-10-24T01:16:42.620119] [DEBUG] [LOCAL     ] AB: Loaded 24773 existing records from primary storage.
[2025-10-24T01:16:42.659187] [INFO ] [MAIN      ] AAT: Loaded 30402 primary data records.
[2025-10-24T01:16:42.657286] [INFO ] [MAIN      ] AB: Loaded 24773 primary data records.
[2025-10-24T01:16:43.436091] [DEBUG] [MAIN      ] AAP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:43.493596] [DEBUG] [MAIN      ] AAT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:43.519120] [DEBUG] [MAIN      ] AB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:43.541581] [INFO ] [MAIN      ] AAP: Generated 139 derivative records from 52090 primary records.
[2025-10-24T01:16:43.542966] [DEBUG] [LOCAL     ] AAP: Saving derivative data.
[2025-10-24T01:16:43.563337] [DEBUG] [LOCAL     ] AAP: Derivative data saved (139 records).
[2025-10-24T01:16:43.564093] [INFO ] [MAIN      ] AAP: Successfully saved derivative data.
[2025-10-24T01:16:43.566924] [INFO ] [MAIN      ] Derivative Progress: 4/2164 symbols completed. AAP took 1.2s. Estimated remaining: 22m 38s. Rate: 95.4 symbols/min
[2025-10-24T01:16:43.571928] [INFO ] [MAIN      ] ABCB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:43.605609] [INFO ] [MAIN      ] AB: Generated 139 derivative records from 24773 primary records.
[2025-10-24T01:16:43.606307] [DEBUG] [LOCAL     ] AB: Saving derivative data.
[2025-10-24T01:16:43.621031] [INFO ] [MAIN      ] AAT: Generated 139 derivative records from 30402 primary records.
[2025-10-24T01:16:43.633800] [DEBUG] [LOCAL     ] ABCB: Loaded 30498 existing records from primary storage.
[2025-10-24T01:16:43.634032] [INFO ] [MAIN      ] ABCB: Loaded 30498 primary data records.
[2025-10-24T01:16:43.632707] [DEBUG] [LOCAL     ] AAT: Saving derivative data.
[2025-10-24T01:16:43.633155] [DEBUG] [LOCAL     ] AB: Derivative data saved (139 records).
[2025-10-24T01:16:43.639595] [INFO ] [MAIN      ] AB: Successfully saved derivative data.
[2025-10-24T01:16:43.682866] [INFO ] [MAIN      ] Derivative Progress: 5/2164 symbols completed. AB took 1.2s. Estimated remaining: 18m 56s. Rate: 114.0 symbols/min
[2025-10-24T01:16:43.690222] [INFO ] [MAIN      ] ABM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:43.759039] [DEBUG] [LOCAL     ] AAT: Derivative data saved (139 records).
[2025-10-24T01:16:43.781379] [INFO ] [MAIN      ] AAT: Successfully saved derivative data.
[2025-10-24T01:16:43.834742] [INFO ] [MAIN      ] Derivative Progress: 6/2164 symbols completed. AAT took 1.4s. Estimated remaining: 16m 41s. Rate: 129.3 symbols/min
[2025-10-24T01:16:43.962837] [INFO ] [MAIN      ] ABR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:43.986720] [DEBUG] [LOCAL     ] ABM: Loaded 32319 existing records from primary storage.
[2025-10-24T01:16:43.988190] [INFO ] [MAIN      ] ABM: Loaded 32319 primary data records.
[2025-10-24T01:16:44.393446] [DEBUG] [LOCAL     ] ABR: Loaded 52253 existing records from primary storage.
[2025-10-24T01:16:44.393852] [DEBUG] [MAIN      ] ABCB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:44.406561] [INFO ] [MAIN      ] ABR: Loaded 52253 primary data records.
[2025-10-24T01:16:44.756045] [DEBUG] [MAIN      ] ABM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:44.783930] [INFO ] [MAIN      ] ABCB: Generated 139 derivative records from 30498 primary records.
[2025-10-24T01:16:44.786070] [DEBUG] [LOCAL     ] ABCB: Saving derivative data.
[2025-10-24T01:16:44.802819] [DEBUG] [LOCAL     ] ABCB: Derivative data saved (139 records).
[2025-10-24T01:16:44.803569] [INFO ] [MAIN      ] ABCB: Successfully saved derivative data.
[2025-10-24T01:16:44.805731] [INFO ] [MAIN      ] Derivative Progress: 7/2164 symbols completed. ABCB took 1.2s. Estimated remaining: 19m 17s. Rate: 111.9 symbols/min
[2025-10-24T01:16:44.807508] [INFO ] [MAIN      ] ABT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:44.830966] [DEBUG] [MAIN      ] ABR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:44.844261] [INFO ] [MAIN      ] ABM: Generated 139 derivative records from 32319 primary records.
[2025-10-24T01:16:44.844491] [DEBUG] [LOCAL     ] ABM: Saving derivative data.
[2025-10-24T01:16:44.861385] [DEBUG] [LOCAL     ] ABM: Derivative data saved (139 records).
[2025-10-24T01:16:44.861639] [INFO ] [MAIN      ] ABM: Successfully saved derivative data.
[2025-10-24T01:16:44.864040] [INFO ] [MAIN      ] Derivative Progress: 8/2164 symbols completed. ABM took 1.2s. Estimated remaining: 17m 8s. Rate: 125.9 symbols/min
[2025-10-24T01:16:44.867276] [INFO ] [MAIN      ] ACA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:44.926857] [DEBUG] [LOCAL     ] ACA: Loaded 22636 existing records from primary storage.
[2025-10-24T01:16:44.926446] [DEBUG] [LOCAL     ] ABT: Loaded 54014 existing records from primary storage.
[2025-10-24T01:16:44.927052] [INFO ] [MAIN      ] ACA: Loaded 22636 primary data records.
[2025-10-24T01:16:44.925555] [INFO ] [MAIN      ] ABR: Generated 139 derivative records from 52253 primary records.
[2025-10-24T01:16:44.927349] [DEBUG] [LOCAL     ] ABR: Saving derivative data.
[2025-10-24T01:16:44.927398] [INFO ] [MAIN      ] ABT: Loaded 54014 primary data records.
[2025-10-24T01:16:45.226172] [DEBUG] [LOCAL     ] ABR: Derivative data saved (139 records).
[2025-10-24T01:16:45.345251] [INFO ] [MAIN      ] ABR: Successfully saved derivative data.
[2025-10-24T01:16:45.386993] [INFO ] [MAIN      ] Derivative Progress: 9/2164 symbols completed. ABR took 1.4s. Estimated remaining: 17m 18s. Rate: 124.5 symbols/min
[2025-10-24T01:16:45.425739] [INFO ] [MAIN      ] ACCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:45.567582] [DEBUG] [MAIN      ] ACA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:45.607717] [DEBUG] [MAIN      ] ABT: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:16:45.635067] [DEBUG] [LOCAL     ] ACCO: Loaded 36869 existing records from primary storage.
[2025-10-24T01:16:45.638697] [INFO ] [MAIN      ] ACCO: Loaded 36869 primary data records.
[2025-10-24T01:16:45.987670] [INFO ] [MAIN      ] ACA: Generated 139 derivative records from 22636 primary records.
[2025-10-24T01:16:45.990713] [DEBUG] [LOCAL     ] ACA: Saving derivative data.
[2025-10-24T01:16:45.992869] [INFO ] [MAIN      ] ABT: Generated 139 derivative records from 54014 primary records.
[2025-10-24T01:16:45.993315] [DEBUG] [LOCAL     ] ABT: Saving derivative data.
[2025-10-24T01:16:46.015333] [DEBUG] [LOCAL     ] ACA: Derivative data saved (139 records).
[2025-10-24T01:16:46.019398] [DEBUG] [LOCAL     ] ABT: Derivative data saved (139 records).
[2025-10-24T01:16:46.018939] [INFO ] [MAIN      ] ACA: Successfully saved derivative data.
[2025-10-24T01:16:46.021806] [INFO ] [MAIN      ] ABT: Successfully saved derivative data.
[2025-10-24T01:16:46.021684] [INFO ] [MAIN      ] Derivative Progress: 10/2164 symbols completed. ACA took 1.2s. Estimated remaining: 17m 51s. Rate: 120.7 symbols/min
[2025-10-24T01:16:46.024733] [INFO ] [MAIN      ] Derivative Progress: 11/2164 symbols completed. ABT took 1.2s. Estimated remaining: 16m 13s. Rate: 132.7 symbols/min
[2025-10-24T01:16:46.024863] [INFO ] [MAIN      ] ACHR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:46.024662] [INFO ] [MAIN      ] ACEL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:46.043582] [DEBUG] [MAIN      ] ACCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:46.084929] [DEBUG] [LOCAL     ] ACEL: Loaded 26458 existing records from primary storage.
[2025-10-24T01:16:46.098551] [INFO ] [MAIN      ] ACEL: Loaded 26458 primary data records.
[2025-10-24T01:16:46.225119] [DEBUG] [LOCAL     ] ACHR: Loaded 54208 existing records from primary storage.
[2025-10-24T01:16:46.251158] [INFO ] [MAIN      ] ACHR: Loaded 54208 primary data records.
[2025-10-24T01:16:46.271976] [INFO ] [MAIN      ] ACCO: Generated 139 derivative records from 36869 primary records.
[2025-10-24T01:16:46.296471] [DEBUG] [LOCAL     ] ACCO: Saving derivative data.
[2025-10-24T01:16:46.582267] [DEBUG] [LOCAL     ] ACCO: Derivative data saved (139 records).
[2025-10-24T01:16:46.588049] [INFO ] [MAIN      ] ACCO: Successfully saved derivative data.
[2025-10-24T01:16:46.590983] [INFO ] [MAIN      ] Derivative Progress: 12/2164 symbols completed. ACCO took 1.2s. Estimated remaining: 16m 33s. Rate: 130.0 symbols/min
[2025-10-24T01:16:46.596495] [INFO ] [MAIN      ] ACI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:46.804394] [DEBUG] [MAIN      ] ACEL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:46.872859] [DEBUG] [LOCAL     ] ACI: Loaded 53675 existing records from primary storage.
[2025-10-24T01:16:46.880533] [INFO ] [MAIN      ] ACI: Loaded 53675 primary data records.
[2025-10-24T01:16:46.880881] [DEBUG] [MAIN      ] ACHR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:46.991540] [INFO ] [MAIN      ] ACEL: Generated 139 derivative records from 26458 primary records.
[2025-10-24T01:16:47.005380] [DEBUG] [LOCAL     ] ACEL: Saving derivative data.
[2025-10-24T01:16:47.075904] [DEBUG] [LOCAL     ] ACEL: Derivative data saved (139 records).
[2025-10-24T01:16:47.095411] [INFO ] [MAIN      ] ACEL: Successfully saved derivative data.
[2025-10-24T01:16:47.103799] [INFO ] [MAIN      ] Derivative Progress: 13/2164 symbols completed. ACEL took 1.1s. Estimated remaining: 16m 41s. Rate: 128.9 symbols/min
[2025-10-24T01:16:47.229327] [INFO ] [MAIN      ] ACHR: Generated 139 derivative records from 54208 primary records.
[2025-10-24T01:16:47.230019] [DEBUG] [LOCAL     ] ACHR: Saving derivative data.
[2025-10-24T01:16:47.243129] [DEBUG] [LOCAL     ] ACHR: Derivative data saved (139 records).
[2025-10-24T01:16:47.243255] [INFO ] [MAIN      ] ACHR: Successfully saved derivative data.
[2025-10-24T01:16:47.245834] [INFO ] [MAIN      ] Derivative Progress: 14/2164 symbols completed. ACHR took 1.2s. Estimated remaining: 15m 51s. Rate: 135.6 symbols/min
[2025-10-24T01:16:47.264698] [DEBUG] [MAIN      ] ACI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:47.289995] [INFO ] [MAIN      ] ACI: Generated 139 derivative records from 53675 primary records.
[2025-10-24T01:16:47.290097] [DEBUG] [LOCAL     ] ACI: Saving derivative data.
[2025-10-24T01:16:47.302058] [DEBUG] [LOCAL     ] ACI: Derivative data saved (139 records).
[2025-10-24T01:16:47.302137] [INFO ] [MAIN      ] ACI: Successfully saved derivative data.
[2025-10-24T01:16:47.304718] [INFO ] [MAIN      ] Derivative Progress: 15/2164 symbols completed. ACI took 0.7s. Estimated remaining: 14m 56s. Rate: 143.9 symbols/min
[2025-10-24T01:16:47.305258] [INFO ] [MAIN      ] ACN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:47.305330] [INFO ] [MAIN      ] ACP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:47.305170] [INFO ] [MAIN      ] ACM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:47.358999] [DEBUG] [LOCAL     ] ACP: Loaded 31336 existing records from primary storage.
[2025-10-24T01:16:47.359197] [INFO ] [MAIN      ] ACP: Loaded 31336 primary data records.
[2025-10-24T01:16:47.497904] [DEBUG] [LOCAL     ] ACM: Loaded 43000 existing records from primary storage.
[2025-10-24T01:16:47.514259] [DEBUG] [LOCAL     ] ACN: Loaded 53828 existing records from primary storage.
[2025-10-24T01:16:47.514401] [INFO ] [MAIN      ] ACM: Loaded 43000 primary data records.
[2025-10-24T01:16:47.535233] [INFO ] [MAIN      ] ACN: Loaded 53828 primary data records.
[2025-10-24T01:16:48.404698] [DEBUG] [MAIN      ] ACP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:48.451142] [DEBUG] [MAIN      ] ACM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:48.483033] [DEBUG] [MAIN      ] ACN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:48.504367] [INFO ] [MAIN      ] ACP: Generated 139 derivative records from 31336 primary records.
[2025-10-24T01:16:48.505274] [DEBUG] [LOCAL     ] ACP: Saving derivative data.
[2025-10-24T01:16:48.518926] [DEBUG] [LOCAL     ] ACP: Derivative data saved (139 records).
[2025-10-24T01:16:48.519352] [INFO ] [MAIN      ] ACP: Successfully saved derivative data.
[2025-10-24T01:16:48.526755] [INFO ] [MAIN      ] Derivative Progress: 16/2164 symbols completed. ACP took 1.2s. Estimated remaining: 16m 44s. Rate: 128.4 symbols/min
[2025-10-24T01:16:48.529888] [INFO ] [MAIN      ] ACR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:48.549292] [DEBUG] [LOCAL     ] ACR: Loaded 5325 existing records from primary storage.
[2025-10-24T01:16:48.551547] [INFO ] [MAIN      ] ACR: Loaded 5325 primary data records.
[2025-10-24T01:16:48.563196] [INFO ] [MAIN      ] ACM: Generated 139 derivative records from 43000 primary records.
[2025-10-24T01:16:48.608345] [DEBUG] [LOCAL     ] ACM: Saving derivative data.
[2025-10-24T01:16:48.684554] [DEBUG] [LOCAL     ] ACM: Derivative data saved (139 records).
[2025-10-24T01:16:48.748858] [INFO ] [MAIN      ] ACM: Successfully saved derivative data.
[2025-10-24T01:16:48.871253] [INFO ] [MAIN      ] ACN: Generated 139 derivative records from 53828 primary records.
[2025-10-24T01:16:48.873329] [INFO ] [MAIN      ] Derivative Progress: 17/2164 symbols completed. ACM took 1.6s. Estimated remaining: 16m 28s. Rate: 130.4 symbols/min
[2025-10-24T01:16:48.873699] [INFO ] [MAIN      ] ACRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:48.874172] [DEBUG] [LOCAL     ] ACN: Saving derivative data.
[2025-10-24T01:16:48.888557] [DEBUG] [LOCAL     ] ACN: Derivative data saved (139 records).
[2025-10-24T01:16:48.890545] [INFO ] [MAIN      ] ACN: Successfully saved derivative data.
[2025-10-24T01:16:48.893629] [INFO ] [MAIN      ] Derivative Progress: 18/2164 symbols completed. ACN took 1.6s. Estimated remaining: 15m 35s. Rate: 137.7 symbols/min
[2025-10-24T01:16:48.893931] [INFO ] [MAIN      ] ACV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:48.911989] [DEBUG] [LOCAL     ] ACV: Loaded 7456 existing records from primary storage.
[2025-10-24T01:16:48.912362] [INFO ] [MAIN      ] ACV: Loaded 7456 primary data records.
[2025-10-24T01:16:49.032808] [DEBUG] [LOCAL     ] ACRE: Loaded 33455 existing records from primary storage.
[2025-10-24T01:16:49.059201] [INFO ] [MAIN      ] ACRE: Loaded 33455 primary data records.
[2025-10-24T01:16:49.277948] [DEBUG] [MAIN      ] ACR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:49.607000] [INFO ] [MAIN      ] ACR: Generated 139 derivative records from 5325 primary records.
[2025-10-24T01:16:49.607692] [DEBUG] [LOCAL     ] ACR: Saving derivative data.
[2025-10-24T01:16:49.631131] [DEBUG] [MAIN      ] ACV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:49.636354] [DEBUG] [LOCAL     ] ACR: Derivative data saved (139 records).
[2025-10-24T01:16:49.649613] [INFO ] [MAIN      ] ACR: Successfully saved derivative data.
[2025-10-24T01:16:49.652894] [INFO ] [MAIN      ] Derivative Progress: 19/2164 symbols completed. ACR took 1.1s. Estimated remaining: 16m 11s. Rate: 132.5 symbols/min
[2025-10-24T01:16:49.658964] [INFO ] [MAIN      ] ACVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:49.688349] [DEBUG] [MAIN      ] ACRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:49.734542] [INFO ] [MAIN      ] ACV: Generated 139 derivative records from 7456 primary records.
[2025-10-24T01:16:49.738751] [DEBUG] [LOCAL     ] ACV: Saving derivative data.
[2025-10-24T01:16:49.771406] [DEBUG] [LOCAL     ] ACV: Derivative data saved (139 records).
[2025-10-24T01:16:49.774166] [DEBUG] [LOCAL     ] ACVA: Loaded 49608 existing records from primary storage.
[2025-10-24T01:16:49.775458] [INFO ] [MAIN      ] ACVA: Loaded 49608 primary data records.
[2025-10-24T01:16:49.774376] [INFO ] [MAIN      ] ACV: Successfully saved derivative data.
[2025-10-24T01:16:49.784514] [INFO ] [MAIN      ] Derivative Progress: 20/2164 symbols completed. ACV took 0.9s. Estimated remaining: 15m 36s. Rate: 137.4 symbols/min
[2025-10-24T01:16:49.787975] [INFO ] [MAIN      ] ADC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:49.973900] [INFO ] [MAIN      ] ACRE: Generated 139 derivative records from 33455 primary records.
[2025-10-24T01:16:50.099602] [DEBUG] [LOCAL     ] ACRE: Saving derivative data.
[2025-10-24T01:16:50.134848] [DEBUG] [LOCAL     ] ACRE: Derivative data saved (139 records).
[2025-10-24T01:16:50.136095] [INFO ] [MAIN      ] ACRE: Successfully saved derivative data.
[2025-10-24T01:16:50.138426] [INFO ] [MAIN      ] Derivative Progress: 21/2164 symbols completed. ACRE took 1.3s. Estimated remaining: 15m 27s. Rate: 138.7 symbols/min
[2025-10-24T01:16:50.139215] [INFO ] [MAIN      ] ADCT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:50.163148] [DEBUG] [LOCAL     ] ADC: Loaded 46761 existing records from primary storage.
[2025-10-24T01:16:50.164085] [INFO ] [MAIN      ] ADC: Loaded 46761 primary data records.
[2025-10-24T01:16:50.315764] [DEBUG] [MAIN      ] ACVA: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:16:50.541308] [DEBUG] [LOCAL     ] ADCT: Loaded 35735 existing records from primary storage.
[2025-10-24T01:16:50.551594] [INFO ] [MAIN      ] ADCT: Loaded 35735 primary data records.
[2025-10-24T01:16:50.877288] [INFO ] [MAIN      ] ACVA: Generated 139 derivative records from 49608 primary records.
[2025-10-24T01:16:50.878453] [DEBUG] [LOCAL     ] ACVA: Saving derivative data.
[2025-10-24T01:16:50.893180] [DEBUG] [LOCAL     ] ACVA: Derivative data saved (139 records).
[2025-10-24T01:16:50.893476] [INFO ] [MAIN      ] ACVA: Successfully saved derivative data.
[2025-10-24T01:16:50.908198] [INFO ] [MAIN      ] Derivative Progress: 22/2164 symbols completed. ACVA took 1.2s. Estimated remaining: 15m 60s. Rate: 133.9 symbols/min
[2025-10-24T01:16:50.908704] [INFO ] [MAIN      ] ADM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:50.906029] [DEBUG] [MAIN      ] ADC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:50.950004] [DEBUG] [MAIN      ] ADCT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:50.988128] [INFO ] [MAIN      ] ADC: Generated 139 derivative records from 46761 primary records.
[2025-10-24T01:16:50.991498] [DEBUG] [LOCAL     ] ADC: Saving derivative data.
[2025-10-24T01:16:51.007345] [DEBUG] [LOCAL     ] ADC: Derivative data saved (139 records).
[2025-10-24T01:16:51.023319] [INFO ] [MAIN      ] ADC: Successfully saved derivative data.
[2025-10-24T01:16:51.029524] [INFO ] [MAIN      ] Derivative Progress: 23/2164 symbols completed. ADC took 1.2s. Estimated remaining: 15m 29s. Rate: 138.3 symbols/min
[2025-10-24T01:16:51.030776] [DEBUG] [LOCAL     ] ADM: Loaded 53780 existing records from primary storage.
[2025-10-24T01:16:51.031116] [INFO ] [MAIN      ] ADNT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:51.031028] [INFO ] [MAIN      ] ADM: Loaded 53780 primary data records.
[2025-10-24T01:16:51.126466] [INFO ] [MAIN      ] ADCT: Generated 139 derivative records from 35735 primary records.
[2025-10-24T01:16:51.143169] [DEBUG] [LOCAL     ] ADCT: Saving derivative data.
[2025-10-24T01:16:51.202679] [DEBUG] [LOCAL     ] ADCT: Derivative data saved (139 records).
[2025-10-24T01:16:51.357895] [INFO ] [MAIN      ] ADCT: Successfully saved derivative data.
[2025-10-24T01:16:51.361144] [INFO ] [MAIN      ] Derivative Progress: 24/2164 symbols completed. ADCT took 1.2s. Estimated remaining: 15m 19s. Rate: 139.7 symbols/min
[2025-10-24T01:16:51.361500] [INFO ] [MAIN      ] ADT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:51.384390] [DEBUG] [LOCAL     ] ADNT: Loaded 46574 existing records from primary storage.
[2025-10-24T01:16:51.384760] [INFO ] [MAIN      ] ADNT: Loaded 46574 primary data records.
[2025-10-24T01:16:51.736867] [DEBUG] [MAIN      ] ADM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:51.750472] [DEBUG] [LOCAL     ] ADT: Loaded 53825 existing records from primary storage.
[2025-10-24T01:16:51.753809] [INFO ] [MAIN      ] ADT: Loaded 53825 primary data records.
[2025-10-24T01:16:52.092102] [DEBUG] [MAIN      ] ADNT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:52.106752] [INFO ] [MAIN      ] ADM: Generated 139 derivative records from 53780 primary records.
[2025-10-24T01:16:52.109859] [DEBUG] [LOCAL     ] ADM: Saving derivative data.
[2025-10-24T01:16:52.124334] [DEBUG] [LOCAL     ] ADM: Derivative data saved (139 records).
[2025-10-24T01:16:52.128361] [INFO ] [MAIN      ] ADM: Successfully saved derivative data.
[2025-10-24T01:16:52.134700] [INFO ] [MAIN      ] Derivative Progress: 25/2164 symbols completed. ADM took 1.2s. Estimated remaining: 15m 48s. Rate: 135.3 symbols/min
[2025-10-24T01:16:52.135497] [INFO ] [MAIN      ] ADX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:52.171102] [DEBUG] [MAIN      ] ADT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:52.185869] [INFO ] [MAIN      ] ADNT: Generated 139 derivative records from 46574 primary records.
[2025-10-24T01:16:52.198462] [DEBUG] [LOCAL     ] ADNT: Saving derivative data.
[2025-10-24T01:16:52.199097] [DEBUG] [LOCAL     ] ADX: Loaded 27825 existing records from primary storage.
[2025-10-24T01:16:52.199244] [INFO ] [MAIN      ] ADX: Loaded 27825 primary data records.
[2025-10-24T01:16:52.300042] [DEBUG] [LOCAL     ] ADNT: Derivative data saved (139 records).
[2025-10-24T01:16:52.313191] [INFO ] [MAIN      ] ADNT: Successfully saved derivative data.
[2025-10-24T01:16:52.315407] [INFO ] [MAIN      ] Derivative Progress: 26/2164 symbols completed. ADNT took 1.3s. Estimated remaining: 15m 26s. Rate: 138.5 symbols/min
[2025-10-24T01:16:52.321456] [INFO ] [MAIN      ] AEE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:52.527245] [INFO ] [MAIN      ] ADT: Generated 139 derivative records from 53825 primary records.
[2025-10-24T01:16:52.527472] [DEBUG] [LOCAL     ] ADT: Saving derivative data.
[2025-10-24T01:16:52.542409] [DEBUG] [LOCAL     ] ADT: Derivative data saved (139 records).
[2025-10-24T01:16:52.543151] [INFO ] [MAIN      ] ADT: Successfully saved derivative data.
[2025-10-24T01:16:52.546343] [INFO ] [MAIN      ] Derivative Progress: 27/2164 symbols completed. ADT took 1.2s. Estimated remaining: 15m 10s. Rate: 140.9 symbols/min
[2025-10-24T01:16:52.556922] [INFO ] [MAIN      ] AEFC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:52.574384] [DEBUG] [LOCAL     ] AEFC: Loaded 7685 existing records from primary storage.
[2025-10-24T01:16:52.588183] [INFO ] [MAIN      ] AEFC: Loaded 7685 primary data records.
[2025-10-24T01:16:52.613458] [DEBUG] [MAIN      ] ADX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:52.612965] [DEBUG] [LOCAL     ] AEE: Loaded 50377 existing records from primary storage.
[2025-10-24T01:16:52.682597] [INFO ] [MAIN      ] AEE: Loaded 50377 primary data records.
[2025-10-24T01:16:53.278952] [INFO ] [MAIN      ] ADX: Generated 139 derivative records from 27825 primary records.
[2025-10-24T01:16:53.279566] [DEBUG] [LOCAL     ] ADX: Saving derivative data.
[2025-10-24T01:16:53.292464] [DEBUG] [LOCAL     ] ADX: Derivative data saved (139 records).
[2025-10-24T01:16:53.293277] [INFO ] [MAIN      ] ADX: Successfully saved derivative data.
[2025-10-24T01:16:53.295773] [INFO ] [MAIN      ] Derivative Progress: 28/2164 symbols completed. ADX took 1.2s. Estimated remaining: 15m 34s. Rate: 137.2 symbols/min
[2025-10-24T01:16:53.315350] [DEBUG] [MAIN      ] AEFC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:53.327585] [DEBUG] [MAIN      ] AEE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:53.386731] [INFO ] [MAIN      ] AEFC: Generated 139 derivative records from 7685 primary records.
[2025-10-24T01:16:53.388677] [DEBUG] [LOCAL     ] AEFC: Saving derivative data.
[2025-10-24T01:16:53.388576] [INFO ] [MAIN      ] AEE: Generated 139 derivative records from 50377 primary records.
[2025-10-24T01:16:53.389119] [DEBUG] [LOCAL     ] AEE: Saving derivative data.
[2025-10-24T01:16:53.411055] [DEBUG] [LOCAL     ] AEE: Derivative data saved (139 records).
[2025-10-24T01:16:53.412075] [DEBUG] [LOCAL     ] AEFC: Derivative data saved (139 records).
[2025-10-24T01:16:53.412320] [INFO ] [MAIN      ] AEE: Successfully saved derivative data.
[2025-10-24T01:16:53.412234] [INFO ] [MAIN      ] AEFC: Successfully saved derivative data.
[2025-10-24T01:16:53.414589] [INFO ] [MAIN      ] Derivative Progress: 29/2164 symbols completed. AEE took 1.1s. Estimated remaining: 15m 10s. Rate: 140.7 symbols/min
[2025-10-24T01:16:53.417253] [INFO ] [MAIN      ] Derivative Progress: 30/2164 symbols completed. AEFC took 0.9s. Estimated remaining: 14m 40s. Rate: 145.6 symbols/min
[2025-10-24T01:16:53.417862] [INFO ] [MAIN      ] AEG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:53.418277] [INFO ] [MAIN      ] AEO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:53.418120] [INFO ] [MAIN      ] AEM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:53.492352] [DEBUG] [LOCAL     ] AEG: Loaded 49897 existing records from primary storage.
[2025-10-24T01:16:53.494172] [INFO ] [MAIN      ] AEG: Loaded 49897 primary data records.
[2025-10-24T01:16:53.548142] [DEBUG] [LOCAL     ] AEM: Loaded 53865 existing records from primary storage.
[2025-10-24T01:16:53.574776] [INFO ] [MAIN      ] AEM: Loaded 53865 primary data records.
[2025-10-24T01:16:53.618841] [DEBUG] [LOCAL     ] AEO: Loaded 53953 existing records from primary storage.
[2025-10-24T01:16:53.655365] [INFO ] [MAIN      ] AEO: Loaded 53953 primary data records.
[2025-10-24T01:16:54.467454] [DEBUG] [MAIN      ] AEG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:54.495743] [DEBUG] [MAIN      ] AEM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:54.532265] [DEBUG] [MAIN      ] AEO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:54.585900] [INFO ] [MAIN      ] AEG: Generated 139 derivative records from 49897 primary records.
[2025-10-24T01:16:54.586692] [DEBUG] [LOCAL     ] AEG: Saving derivative data.
[2025-10-24T01:16:54.601439] [DEBUG] [LOCAL     ] AEG: Derivative data saved (139 records).
[2025-10-24T01:16:54.602719] [INFO ] [MAIN      ] AEG: Successfully saved derivative data.
[2025-10-24T01:16:54.604907] [INFO ] [MAIN      ] Derivative Progress: 31/2164 symbols completed. AEG took 1.2s. Estimated remaining: 15m 33s. Rate: 137.2 symbols/min
[2025-10-24T01:16:54.606089] [INFO ] [MAIN      ] AER: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:54.613818] [INFO ] [MAIN      ] AEM: Generated 139 derivative records from 53865 primary records.
[2025-10-24T01:16:54.615622] [DEBUG] [LOCAL     ] AEM: Saving derivative data.
[2025-10-24T01:16:54.623727] [INFO ] [MAIN      ] AEO: Generated 139 derivative records from 53953 primary records.
[2025-10-24T01:16:54.635616] [DEBUG] [LOCAL     ] AEM: Derivative data saved (139 records).
[2025-10-24T01:16:54.635808] [DEBUG] [LOCAL     ] AEO: Saving derivative data.
[2025-10-24T01:16:54.635960] [INFO ] [MAIN      ] AEM: Successfully saved derivative data.
[2025-10-24T01:16:54.639375] [INFO ] [MAIN      ] Derivative Progress: 32/2164 symbols completed. AEM took 1.2s. Estimated remaining: 15m 5s. Rate: 141.3 symbols/min
[2025-10-24T01:16:54.639918] [INFO ] [MAIN      ] AES: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:54.653530] [DEBUG] [LOCAL     ] AEO: Derivative data saved (139 records).
[2025-10-24T01:16:54.653712] [INFO ] [MAIN      ] AEO: Successfully saved derivative data.
[2025-10-24T01:16:54.656313] [INFO ] [MAIN      ] Derivative Progress: 33/2164 symbols completed. AEO took 1.2s. Estimated remaining: 14m 39s. Rate: 145.5 symbols/min
[2025-10-24T01:16:54.656611] [INFO ] [MAIN      ] AESI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:54.705711] [DEBUG] [LOCAL     ] AER: Loaded 48226 existing records from primary storage.
[2025-10-24T01:16:54.705889] [INFO ] [MAIN      ] AER: Loaded 48226 primary data records.
[2025-10-24T01:16:54.848599] [DEBUG] [LOCAL     ] AES: Loaded 54053 existing records from primary storage.
[2025-10-24T01:16:54.888449] [INFO ] [MAIN      ] AES: Loaded 54053 primary data records.
[2025-10-24T01:16:55.019508] [DEBUG] [LOCAL     ] AESI: Loaded 50191 existing records from primary storage.
[2025-10-24T01:16:55.122255] [INFO ] [MAIN      ] AESI: Loaded 50191 primary data records.
[2025-10-24T01:16:55.773193] [DEBUG] [MAIN      ] AER: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:55.816005] [DEBUG] [MAIN      ] AES: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:55.865872] [DEBUG] [MAIN      ] AESI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:55.905540] [INFO ] [MAIN      ] AER: Generated 139 derivative records from 48226 primary records.
[2025-10-24T01:16:55.911902] [DEBUG] [LOCAL     ] AER: Saving derivative data.
[2025-10-24T01:16:55.932769] [DEBUG] [LOCAL     ] AER: Derivative data saved (139 records).
[2025-10-24T01:16:55.941339] [INFO ] [MAIN      ] AER: Successfully saved derivative data.
[2025-10-24T01:16:55.945074] [INFO ] [MAIN      ] Derivative Progress: 34/2164 symbols completed. AER took 1.3s. Estimated remaining: 15m 33s. Rate: 137.0 symbols/min
[2025-10-24T01:16:55.947129] [INFO ] [MAIN      ] AFB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:55.958742] [INFO ] [MAIN      ] AES: Generated 139 derivative records from 54053 primary records.
[2025-10-24T01:16:55.960981] [DEBUG] [LOCAL     ] AES: Saving derivative data.
[2025-10-24T01:16:55.976623] [INFO ] [MAIN      ] AESI: Generated 139 derivative records from 50191 primary records.
[2025-10-24T01:16:55.981112] [DEBUG] [LOCAL     ] AES: Derivative data saved (139 records).
[2025-10-24T01:16:55.986804] [DEBUG] [LOCAL     ] AESI: Saving derivative data.
[2025-10-24T01:16:55.986670] [DEBUG] [LOCAL     ] AFB: Loaded 11099 existing records from primary storage.
[2025-10-24T01:16:55.987355] [INFO ] [MAIN      ] AFB: Loaded 11099 primary data records.
[2025-10-24T01:16:56.011975] [INFO ] [MAIN      ] AES: Successfully saved derivative data.
[2025-10-24T01:16:56.076847] [INFO ] [MAIN      ] Derivative Progress: 35/2164 symbols completed. AES took 1.4s. Estimated remaining: 15m 14s. Rate: 139.8 symbols/min
[2025-10-24T01:16:56.055671] [DEBUG] [LOCAL     ] AESI: Derivative data saved (139 records).
[2025-10-24T01:16:56.094469] [INFO ] [MAIN      ] AESI: Successfully saved derivative data.
[2025-10-24T01:16:56.099868] [INFO ] [MAIN      ] AFG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:56.103837] [INFO ] [MAIN      ] Derivative Progress: 36/2164 symbols completed. AESI took 1.4s. Estimated remaining: 14m 50s. Rate: 143.5 symbols/min
[2025-10-24T01:16:56.110527] [INFO ] [MAIN      ] AFGB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:56.185275] [DEBUG] [LOCAL     ] AFGB: Loaded 2217 existing records from primary storage.
[2025-10-24T01:16:56.201819] [INFO ] [MAIN      ] AFGB: Loaded 2217 primary data records.
[2025-10-24T01:16:56.458737] [DEBUG] [LOCAL     ] AFG: Loaded 32088 existing records from primary storage.
[2025-10-24T01:16:56.465580] [INFO ] [MAIN      ] AFG: Loaded 32088 primary data records.
[2025-10-24T01:16:57.029158] [DEBUG] [MAIN      ] AFB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:57.082347] [DEBUG] [MAIN      ] AFGB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:57.112174] [INFO ] [MAIN      ] AFB: Generated 139 derivative records from 11099 primary records.
[2025-10-24T01:16:57.125244] [DEBUG] [LOCAL     ] AFB: Saving derivative data.
[2025-10-24T01:16:57.137462] [DEBUG] [MAIN      ] AFG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:57.145677] [DEBUG] [LOCAL     ] AFB: Derivative data saved (139 records).
[2025-10-24T01:16:57.157758] [INFO ] [MAIN      ] AFB: Successfully saved derivative data.
[2025-10-24T01:16:57.163686] [INFO ] [MAIN      ] Derivative Progress: 37/2164 symbols completed. AFB took 1.2s. Estimated remaining: 15m 26s. Rate: 137.8 symbols/min
[2025-10-24T01:16:57.164574] [INFO ] [MAIN      ] AFGC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:57.178771] [DEBUG] [LOCAL     ] AFGC: Loaded 2557 existing records from primary storage.
[2025-10-24T01:16:57.181338] [INFO ] [MAIN      ] AFGC: Loaded 2557 primary data records.
[2025-10-24T01:16:57.265890] [INFO ] [MAIN      ] AFGB: Generated 139 derivative records from 2217 primary records.
[2025-10-24T01:16:57.276628] [DEBUG] [LOCAL     ] AFGB: Saving derivative data.
[2025-10-24T01:16:57.347298] [DEBUG] [LOCAL     ] AFGB: Derivative data saved (139 records).
[2025-10-24T01:16:57.387895] [INFO ] [MAIN      ] AFGB: Successfully saved derivative data.
[2025-10-24T01:16:57.510514] [INFO ] [MAIN      ] Derivative Progress: 38/2164 symbols completed. AFGB took 1.4s. Estimated remaining: 15m 21s. Rate: 138.5 symbols/min
[2025-10-24T01:16:57.525090] [INFO ] [MAIN      ] AFGD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:57.529901] [INFO ] [MAIN      ] AFG: Generated 139 derivative records from 32088 primary records.
[2025-10-24T01:16:57.531447] [DEBUG] [LOCAL     ] AFG: Saving derivative data.
[2025-10-24T01:16:57.534568] [DEBUG] [LOCAL     ] AFGD: Loaded 1757 existing records from primary storage.
[2025-10-24T01:16:57.535978] [INFO ] [MAIN      ] AFGD: Loaded 1757 primary data records.
[2025-10-24T01:16:57.561234] [DEBUG] [LOCAL     ] AFG: Derivative data saved (139 records).
[2025-10-24T01:16:57.591849] [INFO ] [MAIN      ] AFG: Successfully saved derivative data.
[2025-10-24T01:16:57.603695] [INFO ] [MAIN      ] Derivative Progress: 39/2164 symbols completed. AFG took 1.5s. Estimated remaining: 15m 2s. Rate: 141.4 symbols/min
[2025-10-24T01:16:57.605059] [INFO ] [MAIN      ] AFGE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:57.690594] [DEBUG] [LOCAL     ] AFGE: Loaded 2248 existing records from primary storage.
[2025-10-24T01:16:57.712136] [INFO ] [MAIN      ] AFGE: Loaded 2248 primary data records.
[2025-10-24T01:16:58.016345] [DEBUG] [MAIN      ] AFGC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:58.291096] [DEBUG] [MAIN      ] AFGD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:58.313447] [INFO ] [MAIN      ] AFGC: Generated 139 derivative records from 2557 primary records.
[2025-10-24T01:16:58.316759] [DEBUG] [LOCAL     ] AFGC: Saving derivative data.
[2025-10-24T01:16:58.329837] [DEBUG] [LOCAL     ] AFGC: Derivative data saved (139 records).
[2025-10-24T01:16:58.330875] [INFO ] [MAIN      ] AFGC: Successfully saved derivative data.
[2025-10-24T01:16:58.333707] [INFO ] [MAIN      ] Derivative Progress: 40/2164 symbols completed. AFGC took 1.2s. Estimated remaining: 15m 18s. Rate: 138.9 symbols/min
[2025-10-24T01:16:58.333906] [INFO ] [MAIN      ] AFL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:58.354787] [DEBUG] [MAIN      ] AFGE: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:16:58.385327] [INFO ] [MAIN      ] AFGD: Generated 139 derivative records from 1757 primary records.
[2025-10-24T01:16:58.388057] [DEBUG] [LOCAL     ] AFGD: Saving derivative data.
[2025-10-24T01:16:58.416984] [DEBUG] [LOCAL     ] AFGD: Derivative data saved (139 records).
[2025-10-24T01:16:58.418374] [INFO ] [MAIN      ] AFGD: Successfully saved derivative data.
[2025-10-24T01:16:58.421155] [INFO ] [MAIN      ] Derivative Progress: 41/2164 symbols completed. AFGD took 0.9s. Estimated remaining: 14m 59s. Rate: 141.6 symbols/min
[2025-10-24T01:16:58.421619] [INFO ] [MAIN      ] AG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:58.446676] [DEBUG] [LOCAL     ] AFL: Loaded 53562 existing records from primary storage.
[2025-10-24T01:16:58.447597] [INFO ] [MAIN      ] AFGE: Generated 139 derivative records from 2248 primary records.
[2025-10-24T01:16:58.448046] [INFO ] [MAIN      ] AFL: Loaded 53562 primary data records.
[2025-10-24T01:16:58.448475] [DEBUG] [LOCAL     ] AFGE: Saving derivative data.
[2025-10-24T01:16:58.500400] [DEBUG] [LOCAL     ] AFGE: Derivative data saved (139 records).
[2025-10-24T01:16:58.509447] [INFO ] [MAIN      ] AFGE: Successfully saved derivative data.
[2025-10-24T01:16:58.541904] [INFO ] [MAIN      ] Derivative Progress: 42/2164 symbols completed. AFGE took 0.9s. Estimated remaining: 14m 44s. Rate: 144.1 symbols/min
[2025-10-24T01:16:58.551249] [INFO ] [MAIN      ] AGCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:58.809416] [DEBUG] [LOCAL     ] AG: Loaded 54033 existing records from primary storage.
[2025-10-24T01:16:58.810029] [INFO ] [MAIN      ] AG: Loaded 54033 primary data records.
[2025-10-24T01:16:58.962709] [DEBUG] [LOCAL     ] AGCO: Loaded 42392 existing records from primary storage.
[2025-10-24T01:16:58.996601] [INFO ] [MAIN      ] AGCO: Loaded 42392 primary data records.
[2025-10-24T01:16:59.515203] [DEBUG] [MAIN      ] AFL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:59.579433] [DEBUG] [MAIN      ] AG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:59.598475] [INFO ] [MAIN      ] AFL: Generated 139 derivative records from 53562 primary records.
[2025-10-24T01:16:59.599629] [DEBUG] [LOCAL     ] AFL: Saving derivative data.
[2025-10-24T01:16:59.628715] [DEBUG] [LOCAL     ] AFL: Derivative data saved (139 records).
[2025-10-24T01:16:59.628995] [INFO ] [MAIN      ] AFL: Successfully saved derivative data.
[2025-10-24T01:16:59.629293] [DEBUG] [MAIN      ] AGCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:16:59.632145] [INFO ] [MAIN      ] Derivative Progress: 43/2164 symbols completed. AFL took 1.3s. Estimated remaining: 15m 17s. Rate: 138.9 symbols/min
[2025-10-24T01:16:59.674982] [INFO ] [MAIN      ] AG: Generated 139 derivative records from 54033 primary records.
[2025-10-24T01:16:59.676464] [DEBUG] [LOCAL     ] AG: Saving derivative data.
[2025-10-24T01:16:59.694586] [DEBUG] [LOCAL     ] AG: Derivative data saved (139 records).
[2025-10-24T01:16:59.694510] [INFO ] [MAIN      ] AGCO: Generated 139 derivative records from 42392 primary records.
[2025-10-24T01:16:59.694792] [DEBUG] [LOCAL     ] AGCO: Saving derivative data.
[2025-10-24T01:16:59.694863] [INFO ] [MAIN      ] AG: Successfully saved derivative data.
[2025-10-24T01:16:59.698249] [INFO ] [MAIN      ] Derivative Progress: 44/2164 symbols completed. AG took 1.3s. Estimated remaining: 14m 58s. Rate: 141.6 symbols/min
[2025-10-24T01:16:59.710153] [DEBUG] [LOCAL     ] AGCO: Derivative data saved (139 records).
[2025-10-24T01:16:59.710239] [INFO ] [MAIN      ] AGCO: Successfully saved derivative data.
[2025-10-24T01:16:59.712558] [INFO ] [MAIN      ] Derivative Progress: 45/2164 symbols completed. AGCO took 1.2s. Estimated remaining: 14m 39s. Rate: 144.7 symbols/min
[2025-10-24T01:16:59.713066] [INFO ] [MAIN      ] AGD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:59.713113] [INFO ] [MAIN      ] AGI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:59.713157] [INFO ] [MAIN      ] AGL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:16:59.738272] [DEBUG] [LOCAL     ] AGD: Loaded 19375 existing records from primary storage.
[2025-10-24T01:16:59.738539] [INFO ] [MAIN      ] AGD: Loaded 19375 primary data records.
[2025-10-24T01:17:00.088902] [DEBUG] [LOCAL     ] AGL: Loaded 52979 existing records from primary storage.
[2025-10-24T01:17:00.089343] [INFO ] [MAIN      ] AGL: Loaded 52979 primary data records.
[2025-10-24T01:17:00.111946] [DEBUG] [LOCAL     ] AGI: Loaded 53813 existing records from primary storage.
[2025-10-24T01:17:00.122846] [INFO ] [MAIN      ] AGI: Loaded 53813 primary data records.
[2025-10-24T01:17:00.725255] [DEBUG] [MAIN      ] AGD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:00.764190] [DEBUG] [MAIN      ] AGL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:00.815720] [DEBUG] [MAIN      ] AGI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:00.837724] [INFO ] [MAIN      ] AGD: Generated 139 derivative records from 19375 primary records.
[2025-10-24T01:17:00.841501] [DEBUG] [LOCAL     ] AGD: Saving derivative data.
[2025-10-24T01:17:00.857309] [DEBUG] [LOCAL     ] AGD: Derivative data saved (139 records).
[2025-10-24T01:17:00.862412] [INFO ] [MAIN      ] AGD: Successfully saved derivative data.
[2025-10-24T01:17:00.865195] [INFO ] [MAIN      ] Derivative Progress: 46/2164 symbols completed. AGD took 1.2s. Estimated remaining: 15m 12s. Rate: 139.3 symbols/min
[2025-10-24T01:17:00.865961] [INFO ] [MAIN      ] AGM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:00.882825] [INFO ] [MAIN      ] AGL: Generated 139 derivative records from 52979 primary records.
[2025-10-24T01:17:00.892639] [DEBUG] [LOCAL     ] AGL: Saving derivative data.
[2025-10-24T01:17:00.892342] [DEBUG] [LOCAL     ] AGM: Loaded 10659 existing records from primary storage.
[2025-10-24T01:17:00.893156] [INFO ] [MAIN      ] AGM: Loaded 10659 primary data records.
[2025-10-24T01:17:01.012633] [DEBUG] [LOCAL     ] AGL: Derivative data saved (139 records).
[2025-10-24T01:17:01.012808] [INFO ] [MAIN      ] AGL: Successfully saved derivative data.
[2025-10-24T01:17:00.997881] [INFO ] [MAIN      ] AGI: Generated 139 derivative records from 53813 primary records.
[2025-10-24T01:17:01.018804] [INFO ] [MAIN      ] Derivative Progress: 47/2164 symbols completed. AGL took 1.3s. Estimated remaining: 14m 59s. Rate: 141.2 symbols/min
[2025-10-24T01:17:01.019060] [INFO ] [MAIN      ] AGO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:01.018975] [DEBUG] [LOCAL     ] AGI: Saving derivative data.
[2025-10-24T01:17:01.121230] [DEBUG] [LOCAL     ] AGI: Derivative data saved (139 records).
[2025-10-24T01:17:01.121696] [INFO ] [MAIN      ] AGI: Successfully saved derivative data.
[2025-10-24T01:17:01.278712] [INFO ] [MAIN      ] Derivative Progress: 48/2164 symbols completed. AGI took 1.6s. Estimated remaining: 14m 52s. Rate: 142.4 symbols/min
[2025-10-24T01:17:01.286006] [INFO ] [MAIN      ] AGRO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:01.303438] [DEBUG] [LOCAL     ] AGO: Loaded 27888 existing records from primary storage.
[2025-10-24T01:17:01.304263] [INFO ] [MAIN      ] AGO: Loaded 27888 primary data records.
[2025-10-24T01:17:01.515383] [DEBUG] [LOCAL     ] AGRO: Loaded 32732 existing records from primary storage.
[2025-10-24T01:17:01.645395] [INFO ] [MAIN      ] AGRO: Loaded 32732 primary data records.
[2025-10-24T01:17:01.746153] [DEBUG] [MAIN      ] AGM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:02.042818] [DEBUG] [MAIN      ] AGO: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:17:02.071883] [INFO ] [MAIN      ] AGM: Generated 139 derivative records from 10659 primary records.
[2025-10-24T01:17:02.074851] [DEBUG] [LOCAL     ] AGM: Saving derivative data.
[2025-10-24T01:17:02.096301] [DEBUG] [LOCAL     ] AGM: Derivative data saved (139 records).
[2025-10-24T01:17:02.100986] [INFO ] [MAIN      ] AGM: Successfully saved derivative data.
[2025-10-24T01:17:02.104244] [INFO ] [MAIN      ] Derivative Progress: 49/2164 symbols completed. AGM took 1.2s. Estimated remaining: 15m 9s. Rate: 139.6 symbols/min
[2025-10-24T01:17:02.106409] [INFO ] [MAIN      ] AGX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:02.123225] [DEBUG] [MAIN      ] AGRO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:02.152713] [INFO ] [MAIN      ] AGO: Generated 139 derivative records from 27888 primary records.
[2025-10-24T01:17:02.168489] [DEBUG] [LOCAL     ] AGO: Saving derivative data.
[2025-10-24T01:17:02.199096] [DEBUG] [LOCAL     ] AGO: Derivative data saved (139 records).
[2025-10-24T01:17:02.201265] [INFO ] [MAIN      ] AGO: Successfully saved derivative data.
[2025-10-24T01:17:02.202108] [DEBUG] [LOCAL     ] AGX: Loaded 32812 existing records from primary storage.
[2025-10-24T01:17:02.208119] [INFO ] [MAIN      ] AGX: Loaded 32812 primary data records.
[2025-10-24T01:17:02.204972] [INFO ] [MAIN      ] Derivative Progress: 50/2164 symbols completed. AGO took 1.2s. Estimated remaining: 14m 54s. Rate: 141.8 symbols/min
[2025-10-24T01:17:02.208805] [INFO ] [MAIN      ] AHH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:02.301252] [INFO ] [MAIN      ] AGRO: Generated 139 derivative records from 32732 primary records.
[2025-10-24T01:17:02.323730] [DEBUG] [LOCAL     ] AGRO: Saving derivative data.
[2025-10-24T01:17:02.454262] [DEBUG] [LOCAL     ] AGRO: Derivative data saved (139 records).
[2025-10-24T01:17:02.466292] [INFO ] [MAIN      ] AGRO: Successfully saved derivative data.
[2025-10-24T01:17:02.595893] [INFO ] [MAIN      ] Derivative Progress: 51/2164 symbols completed. AGRO took 1.3s. Estimated remaining: 14m 53s. Rate: 142.0 symbols/min
[2025-10-24T01:17:02.596883] [DEBUG] [LOCAL     ] AHH: Loaded 40406 existing records from primary storage.
[2025-10-24T01:17:02.597456] [INFO ] [MAIN      ] AHH: Loaded 40406 primary data records.
[2025-10-24T01:17:02.597222] [INFO ] [MAIN      ] AHR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:02.980420] [DEBUG] [LOCAL     ] AHR: Loaded 49276 existing records from primary storage.
[2025-10-24T01:17:02.982514] [INFO ] [MAIN      ] AHR: Loaded 49276 primary data records.
[2025-10-24T01:17:03.053620] [DEBUG] [MAIN      ] AGX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:03.400401] [DEBUG] [MAIN      ] AHH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:03.423080] [INFO ] [MAIN      ] AGX: Generated 139 derivative records from 32812 primary records.
[2025-10-24T01:17:03.424972] [DEBUG] [LOCAL     ] AGX: Saving derivative data.
[2025-10-24T01:17:03.445339] [DEBUG] [LOCAL     ] AGX: Derivative data saved (139 records).
[2025-10-24T01:17:03.445474] [INFO ] [MAIN      ] AGX: Successfully saved derivative data.
[2025-10-24T01:17:03.448207] [INFO ] [MAIN      ] Derivative Progress: 52/2164 symbols completed. AGX took 1.3s. Estimated remaining: 15m 10s. Rate: 139.3 symbols/min
[2025-10-24T01:17:03.448449] [INFO ] [MAIN      ] AHT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:03.462636] [DEBUG] [MAIN      ] AHR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:03.495527] [DEBUG] [LOCAL     ] AHT: Loaded 6449 existing records from primary storage.
[2025-10-24T01:17:03.496562] [INFO ] [MAIN      ] AHT: Loaded 6449 primary data records.
[2025-10-24T01:17:03.607531] [INFO ] [MAIN      ] AHH: Generated 139 derivative records from 40406 primary records.
[2025-10-24T01:17:03.612364] [DEBUG] [LOCAL     ] AHH: Saving derivative data.
[2025-10-24T01:17:03.704570] [DEBUG] [LOCAL     ] AHH: Derivative data saved (139 records).
[2025-10-24T01:17:03.815130] [INFO ] [MAIN      ] AHH: Successfully saved derivative data.
[2025-10-24T01:17:03.828264] [INFO ] [MAIN      ] Derivative Progress: 53/2164 symbols completed. AHH took 1.6s. Estimated remaining: 15m 7s. Rate: 139.6 symbols/min
[2025-10-24T01:17:03.831259] [INFO ] [MAIN      ] AI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:03.842330] [INFO ] [MAIN      ] AHR: Generated 139 derivative records from 49276 primary records.
[2025-10-24T01:17:03.843329] [DEBUG] [LOCAL     ] AHR: Saving derivative data.
[2025-10-24T01:17:03.857608] [DEBUG] [LOCAL     ] AHR: Derivative data saved (139 records).
[2025-10-24T01:17:03.857857] [INFO ] [MAIN      ] AHR: Successfully saved derivative data.
[2025-10-24T01:17:03.860413] [INFO ] [MAIN      ] Derivative Progress: 54/2164 symbols completed. AHR took 1.3s. Estimated remaining: 14m 51s. Rate: 142.0 symbols/min
[2025-10-24T01:17:03.860630] [INFO ] [MAIN      ] AIG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:03.881830] [DEBUG] [MAIN      ] AHT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:03.960331] [DEBUG] [LOCAL     ] AI: Loaded 54154 existing records from primary storage.
[2025-10-24T01:17:03.961203] [INFO ] [MAIN      ] AI: Loaded 54154 primary data records.
[2025-10-24T01:17:03.977620] [INFO ] [MAIN      ] AHT: Generated 139 derivative records from 6449 primary records.
[2025-10-24T01:17:04.037548] [DEBUG] [LOCAL     ] AHT: Saving derivative data.
[2025-10-24T01:17:04.079887] [DEBUG] [LOCAL     ] AIG: Loaded 53845 existing records from primary storage.
[2025-10-24T01:17:04.110877] [INFO ] [MAIN      ] AIG: Loaded 53845 primary data records.
[2025-10-24T01:17:04.117628] [DEBUG] [LOCAL     ] AHT: Derivative data saved (139 records).
[2025-10-24T01:17:04.171905] [INFO ] [MAIN      ] AHT: Successfully saved derivative data.
[2025-10-24T01:17:04.236878] [INFO ] [MAIN      ] Derivative Progress: 55/2164 symbols completed. AHT took 0.8s. Estimated remaining: 14m 49s. Rate: 142.3 symbols/min
[2025-10-24T01:17:04.305626] [INFO ] [MAIN      ] AIN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:04.638618] [DEBUG] [LOCAL     ] AIN: Loaded 24456 existing records from primary storage.
[2025-10-24T01:17:04.639607] [INFO ] [MAIN      ] AIN: Loaded 24456 primary data records.
[2025-10-24T01:17:04.974779] [DEBUG] [MAIN      ] AI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:05.008702] [DEBUG] [MAIN      ] AIG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:05.076073] [DEBUG] [MAIN      ] AIN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:05.079186] [INFO ] [MAIN      ] AI: Generated 139 derivative records from 54154 primary records.
[2025-10-24T01:17:05.082439] [DEBUG] [LOCAL     ] AI: Saving derivative data.
[2025-10-24T01:17:05.111038] [DEBUG] [LOCAL     ] AI: Derivative data saved (139 records).
[2025-10-24T01:17:05.114812] [INFO ] [MAIN      ] AI: Successfully saved derivative data.
[2025-10-24T01:17:05.115008] [INFO ] [MAIN      ] AIG: Generated 139 derivative records from 53845 primary records.
[2025-10-24T01:17:05.120607] [INFO ] [MAIN      ] Derivative Progress: 56/2164 symbols completed. AI took 1.3s. Estimated remaining: 15m 6s. Rate: 139.6 symbols/min
[2025-10-24T01:17:05.121102] [INFO ] [MAIN      ] AIO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:05.121336] [DEBUG] [LOCAL     ] AIG: Saving derivative data.
[2025-10-24T01:17:05.141210] [DEBUG] [LOCAL     ] AIG: Derivative data saved (139 records).
[2025-10-24T01:17:05.146027] [INFO ] [MAIN      ] AIG: Successfully saved derivative data.
[2025-10-24T01:17:05.151326] [INFO ] [MAIN      ] Derivative Progress: 57/2164 symbols completed. AIG took 1.3s. Estimated remaining: 14m 51s. Rate: 141.9 symbols/min
[2025-10-24T01:17:05.151912] [INFO ] [MAIN      ] AIR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:05.158556] [DEBUG] [LOCAL     ] AIO: Loaded 13054 existing records from primary storage.
[2025-10-24T01:17:05.159584] [INFO ] [MAIN      ] AIO: Loaded 13054 primary data records.
[2025-10-24T01:17:05.262873] [INFO ] [MAIN      ] AIN: Generated 139 derivative records from 24456 primary records.
[2025-10-24T01:17:05.304229] [DEBUG] [LOCAL     ] AIN: Saving derivative data.
[2025-10-24T01:17:05.345149] [DEBUG] [LOCAL     ] AIN: Derivative data saved (139 records).
[2025-10-24T01:17:05.453726] [INFO ] [MAIN      ] AIN: Successfully saved derivative data.
[2025-10-24T01:17:05.549688] [DEBUG] [LOCAL     ] AIR: Loaded 28815 existing records from primary storage.
[2025-10-24T01:17:05.563071] [INFO ] [MAIN      ] Derivative Progress: 58/2164 symbols completed. AIN took 1.3s. Estimated remaining: 14m 50s. Rate: 142.0 symbols/min
[2025-10-24T01:17:05.572021] [INFO ] [MAIN      ] AIR: Loaded 28815 primary data records.
[2025-10-24T01:17:05.914787] [DEBUG] [MAIN      ] AIO: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:17:05.968509] [INFO ] [MAIN      ] AIO: Generated 139 derivative records from 13054 primary records.
[2025-10-24T01:17:05.968865] [DEBUG] [LOCAL     ] AIO: Saving derivative data.
[2025-10-24T01:17:06.005713] [DEBUG] [LOCAL     ] AIO: Derivative data saved (139 records).
[2025-10-24T01:17:06.001553] [DEBUG] [MAIN      ] AIR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:06.005940] [INFO ] [MAIN      ] AIO: Successfully saved derivative data.
[2025-10-24T01:17:06.009194] [INFO ] [MAIN      ] Derivative Progress: 59/2164 symbols completed. AIO took 0.9s. Estimated remaining: 14m 50s. Rate: 141.8 symbols/min
[2025-10-24T01:17:06.048699] [INFO ] [MAIN      ] AIR: Generated 139 derivative records from 28815 primary records.
[2025-10-24T01:17:06.048898] [DEBUG] [LOCAL     ] AIR: Saving derivative data.
[2025-10-24T01:17:06.062571] [DEBUG] [LOCAL     ] AIR: Derivative data saved (139 records).
[2025-10-24T01:17:06.062817] [INFO ] [MAIN      ] AIR: Successfully saved derivative data.
[2025-10-24T01:17:06.065846] [INFO ] [MAIN      ] Derivative Progress: 60/2164 symbols completed. AIR took 0.9s. Estimated remaining: 14m 37s. Rate: 143.9 symbols/min
[2025-10-24T01:17:06.066785] [INFO ] [MAIN      ] AIT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:06.067269] [INFO ] [MAIN      ] AIV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:06.067183] [INFO ] [MAIN      ] AIZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:06.112671] [DEBUG] [LOCAL     ] AIT: Loaded 26768 existing records from primary storage.
[2025-10-24T01:17:06.113019] [INFO ] [MAIN      ] AIT: Loaded 26768 primary data records.
[2025-10-24T01:17:06.246469] [DEBUG] [LOCAL     ] AIZ: Loaded 29404 existing records from primary storage.
[2025-10-24T01:17:06.289390] [INFO ] [MAIN      ] AIZ: Loaded 29404 primary data records.
[2025-10-24T01:17:06.345131] [DEBUG] [LOCAL     ] AIV: Loaded 42214 existing records from primary storage.
[2025-10-24T01:17:06.367637] [INFO ] [MAIN      ] AIV: Loaded 42214 primary data records.
[2025-10-24T01:17:07.323426] [DEBUG] [MAIN      ] AIT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:07.369156] [DEBUG] [MAIN      ] AIZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:07.395073] [DEBUG] [MAIN      ] AIV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:07.463320] [INFO ] [MAIN      ] AIZ: Generated 139 derivative records from 29404 primary records.
[2025-10-24T01:17:07.465602] [DEBUG] [LOCAL     ] AIZ: Saving derivative data.
[2025-10-24T01:17:07.465845] [INFO ] [MAIN      ] AIT: Generated 139 derivative records from 26768 primary records.
[2025-10-24T01:17:07.471542] [DEBUG] [LOCAL     ] AIT: Saving derivative data.
[2025-10-24T01:17:07.508184] [DEBUG] [LOCAL     ] AIT: Derivative data saved (139 records).
[2025-10-24T01:17:07.510729] [INFO ] [MAIN      ] AIT: Successfully saved derivative data.
[2025-10-24T01:17:07.515403] [INFO ] [MAIN      ] Derivative Progress: 61/2164 symbols completed. AIT took 1.4s. Estimated remaining: 15m 12s. Rate: 138.3 symbols/min
[2025-10-24T01:17:07.510411] [DEBUG] [LOCAL     ] AIZ: Derivative data saved (139 records).
[2025-10-24T01:17:07.515683] [INFO ] [MAIN      ] AIZN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:07.515932] [INFO ] [MAIN      ] AIZ: Successfully saved derivative data.
[2025-10-24T01:17:07.516302] [INFO ] [MAIN      ] AIV: Generated 139 derivative records from 42214 primary records.
[2025-10-24T01:17:07.516730] [DEBUG] [LOCAL     ] AIV: Saving derivative data.
[2025-10-24T01:17:07.519921] [INFO ] [MAIN      ] Derivative Progress: 62/2164 symbols completed. AIZ took 1.5s. Estimated remaining: 14m 57s. Rate: 140.5 symbols/min
[2025-10-24T01:17:07.521214] [INFO ] [MAIN      ] AJG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:07.539818] [DEBUG] [LOCAL     ] AIV: Derivative data saved (139 records).
[2025-10-24T01:17:07.543360] [DEBUG] [LOCAL     ] AIZN: Loaded 3838 existing records from primary storage.
[2025-10-24T01:17:07.543533] [INFO ] [MAIN      ] AIZN: Loaded 3838 primary data records.
[2025-10-24T01:17:07.555000] [INFO ] [MAIN      ] AIV: Successfully saved derivative data.
[2025-10-24T01:17:07.579884] [INFO ] [MAIN      ] Derivative Progress: 63/2164 symbols completed. AIV took 1.5s. Estimated remaining: 14m 45s. Rate: 142.5 symbols/min
[2025-10-24T01:17:07.604885] [INFO ] [MAIN      ] AKR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:07.899608] [DEBUG] [LOCAL     ] AJG: Loaded 46707 existing records from primary storage.
[2025-10-24T01:17:07.899954] [INFO ] [MAIN      ] AJG: Loaded 46707 primary data records.
[2025-10-24T01:17:08.004330] [DEBUG] [LOCAL     ] AKR: Loaded 46444 existing records from primary storage.
[2025-10-24T01:17:08.026928] [INFO ] [MAIN      ] AKR: Loaded 46444 primary data records.
[2025-10-24T01:17:08.406273] [DEBUG] [MAIN      ] AIZN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:08.697085] [INFO ] [MAIN      ] AIZN: Generated 139 derivative records from 3838 primary records.
[2025-10-24T01:17:08.698234] [DEBUG] [MAIN      ] AJG: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:17:08.710373] [DEBUG] [LOCAL     ] AIZN: Saving derivative data.
[2025-10-24T01:17:08.731581] [DEBUG] [LOCAL     ] AIZN: Derivative data saved (139 records).
[2025-10-24T01:17:08.732139] [INFO ] [MAIN      ] AIZN: Successfully saved derivative data.
[2025-10-24T01:17:08.738474] [INFO ] [MAIN      ] Derivative Progress: 64/2164 symbols completed. AIZN took 1.2s. Estimated remaining: 15m 8s. Rate: 138.7 symbols/min
[2025-10-24T01:17:08.752123] [INFO ] [MAIN      ] AL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:08.754103] [DEBUG] [MAIN      ] AKR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:08.819698] [INFO ] [MAIN      ] AJG: Generated 139 derivative records from 46707 primary records.
[2025-10-24T01:17:08.824556] [DEBUG] [LOCAL     ] AJG: Saving derivative data.
[2025-10-24T01:17:08.841233] [DEBUG] [LOCAL     ] AL: Loaded 45163 existing records from primary storage.
[2025-10-24T01:17:08.850857] [INFO ] [MAIN      ] AL: Loaded 45163 primary data records.
[2025-10-24T01:17:08.855329] [INFO ] [MAIN      ] AKR: Generated 139 derivative records from 46444 primary records.
[2025-10-24T01:17:08.855099] [DEBUG] [LOCAL     ] AJG: Derivative data saved (139 records).
[2025-10-24T01:17:08.867675] [DEBUG] [LOCAL     ] AKR: Saving derivative data.
[2025-10-24T01:17:08.892049] [INFO ] [MAIN      ] AJG: Successfully saved derivative data.
[2025-10-24T01:17:08.927878] [INFO ] [MAIN      ] Derivative Progress: 65/2164 symbols completed. AJG took 1.4s. Estimated remaining: 15m 0s. Rate: 139.9 symbols/min
[2025-10-24T01:17:08.953183] [INFO ] [MAIN      ] ALB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:08.977541] [DEBUG] [LOCAL     ] AKR: Derivative data saved (139 records).
[2025-10-24T01:17:08.995039] [INFO ] [MAIN      ] AKR: Successfully saved derivative data.
[2025-10-24T01:17:09.060217] [INFO ] [MAIN      ] Derivative Progress: 66/2164 symbols completed. AKR took 1.5s. Estimated remaining: 14m 50s. Rate: 141.4 symbols/min
[2025-10-24T01:17:09.060618] [INFO ] [MAIN      ] ALC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:09.222327] [DEBUG] [MAIN      ] AL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:09.273410] [DEBUG] [LOCAL     ] ALB: Loaded 53752 existing records from primary storage.
[2025-10-24T01:17:09.274191] [INFO ] [MAIN      ] ALB: Loaded 53752 primary data records.
[2025-10-24T01:17:09.407197] [DEBUG] [LOCAL     ] ALC: Loaded 51590 existing records from primary storage.
[2025-10-24T01:17:09.429182] [INFO ] [MAIN      ] ALC: Loaded 51590 primary data records.
[2025-10-24T01:17:09.870417] [INFO ] [MAIN      ] AL: Generated 139 derivative records from 45163 primary records.
[2025-10-24T01:17:09.972967] [DEBUG] [LOCAL     ] AL: Saving derivative data.
[2025-10-24T01:17:10.003372] [DEBUG] [LOCAL     ] AL: Derivative data saved (139 records).
[2025-10-24T01:17:10.005384] [INFO ] [MAIN      ] AL: Successfully saved derivative data.
[2025-10-24T01:17:10.009369] [INFO ] [MAIN      ] Derivative Progress: 67/2164 symbols completed. AL took 1.3s. Estimated remaining: 15m 6s. Rate: 138.8 symbols/min
[2025-10-24T01:17:10.010763] [INFO ] [MAIN      ] ALE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:10.036800] [DEBUG] [MAIN      ] ALB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:10.096733] [DEBUG] [MAIN      ] ALC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:10.134480] [DEBUG] [LOCAL     ] ALE: Loaded 32276 existing records from primary storage.
[2025-10-24T01:17:10.137056] [INFO ] [MAIN      ] ALE: Loaded 32276 primary data records.
[2025-10-24T01:17:10.308977] [INFO ] [MAIN      ] ALB: Generated 139 derivative records from 53752 primary records.
[2025-10-24T01:17:10.309770] [DEBUG] [LOCAL     ] ALB: Saving derivative data.
[2025-10-24T01:17:10.377533] [DEBUG] [LOCAL     ] ALB: Derivative data saved (139 records).
[2025-10-24T01:17:10.396778] [INFO ] [MAIN      ] ALB: Successfully saved derivative data.
[2025-10-24T01:17:10.421368] [INFO ] [MAIN      ] Derivative Progress: 68/2164 symbols completed. ALB took 1.5s. Estimated remaining: 15m 5s. Rate: 138.9 symbols/min
[2025-10-24T01:17:10.422086] [INFO ] [MAIN      ] ALEX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:10.617056] [INFO ] [MAIN      ] ALC: Generated 139 derivative records from 51590 primary records.
[2025-10-24T01:17:10.618830] [DEBUG] [LOCAL     ] ALC: Saving derivative data.
[2025-10-24T01:17:10.633210] [DEBUG] [LOCAL     ] ALC: Derivative data saved (139 records).
[2025-10-24T01:17:10.633500] [INFO ] [MAIN      ] ALC: Successfully saved derivative data.
[2025-10-24T01:17:10.637123] [INFO ] [MAIN      ] Derivative Progress: 69/2164 symbols completed. ALC took 1.6s. Estimated remaining: 14m 58s. Rate: 139.9 symbols/min
[2025-10-24T01:17:10.637795] [INFO ] [MAIN      ] ALG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:10.669851] [DEBUG] [LOCAL     ] ALG: Loaded 9765 existing records from primary storage.
[2025-10-24T01:17:10.671792] [DEBUG] [LOCAL     ] ALEX: Loaded 31013 existing records from primary storage.
[2025-10-24T01:17:10.671957] [INFO ] [MAIN      ] ALG: Loaded 9765 primary data records.
[2025-10-24T01:17:10.672507] [INFO ] [MAIN      ] ALEX: Loaded 31013 primary data records.
[2025-10-24T01:17:10.838069] [DEBUG] [MAIN      ] ALE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:11.358835] [INFO ] [MAIN      ] ALE: Generated 139 derivative records from 32276 primary records.
[2025-10-24T01:17:11.359319] [DEBUG] [LOCAL     ] ALE: Saving derivative data.
[2025-10-24T01:17:11.375318] [DEBUG] [LOCAL     ] ALE: Derivative data saved (139 records).
[2025-10-24T01:17:11.375886] [INFO ] [MAIN      ] ALE: Successfully saved derivative data.
[2025-10-24T01:17:11.378282] [INFO ] [MAIN      ] Derivative Progress: 70/2164 symbols completed. ALE took 1.4s. Estimated remaining: 15m 7s. Rate: 138.5 symbols/min
[2025-10-24T01:17:11.378915] [INFO ] [MAIN      ] ALIT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:11.397136] [DEBUG] [MAIN      ] ALG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:11.434390] [DEBUG] [MAIN      ] ALEX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:11.504501] [INFO ] [MAIN      ] ALG: Generated 139 derivative records from 9765 primary records.
[2025-10-24T01:17:11.504184] [DEBUG] [LOCAL     ] ALIT: Loaded 53163 existing records from primary storage.
[2025-10-24T01:17:11.506194] [DEBUG] [LOCAL     ] ALG: Saving derivative data.
[2025-10-24T01:17:11.506253] [INFO ] [MAIN      ] ALIT: Loaded 53163 primary data records.
[2025-10-24T01:17:11.549309] [DEBUG] [LOCAL     ] ALG: Derivative data saved (139 records).
[2025-10-24T01:17:11.572442] [INFO ] [MAIN      ] ALG: Successfully saved derivative data.
[2025-10-24T01:17:11.583726] [INFO ] [MAIN      ] Derivative Progress: 71/2164 symbols completed. ALG took 0.9s. Estimated remaining: 15m 0s. Rate: 139.5 symbols/min
[2025-10-24T01:17:11.611927] [INFO ] [MAIN      ] ALK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:11.649485] [INFO ] [MAIN      ] ALEX: Generated 139 derivative records from 31013 primary records.
[2025-10-24T01:17:11.670263] [DEBUG] [LOCAL     ] ALEX: Saving derivative data.
[2025-10-24T01:17:11.852409] [DEBUG] [LOCAL     ] ALEX: Derivative data saved (139 records).
[2025-10-24T01:17:11.852908] [INFO ] [MAIN      ] ALEX: Successfully saved derivative data.
[2025-10-24T01:17:11.855186] [INFO ] [MAIN      ] Derivative Progress: 72/2164 symbols completed. ALEX took 1.4s. Estimated remaining: 14m 55s. Rate: 140.2 symbols/min
[2025-10-24T01:17:11.856193] [INFO ] [MAIN      ] ALL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:11.897911] [DEBUG] [MAIN      ] ALIT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:11.926876] [DEBUG] [LOCAL     ] ALK: Loaded 53477 existing records from primary storage.
[2025-10-24T01:17:11.928821] [INFO ] [MAIN      ] ALK: Loaded 53477 primary data records.
[2025-10-24T01:17:12.148534] [DEBUG] [LOCAL     ] ALL: Loaded 49959 existing records from primary storage.
[2025-10-24T01:17:12.257600] [INFO ] [MAIN      ] ALL: Loaded 49959 primary data records.
[2025-10-24T01:17:12.433516] [INFO ] [MAIN      ] ALIT: Generated 139 derivative records from 53163 primary records.
[2025-10-24T01:17:12.467610] [DEBUG] [LOCAL     ] ALIT: Saving derivative data.
[2025-10-24T01:17:12.650468] [DEBUG] [LOCAL     ] ALIT: Derivative data saved (139 records).
[2025-10-24T01:17:12.655120] [INFO ] [MAIN      ] ALIT: Successfully saved derivative data.
[2025-10-24T01:17:12.658367] [INFO ] [MAIN      ] Derivative Progress: 73/2164 symbols completed. ALIT took 1.3s. Estimated remaining: 15m 5s. Rate: 138.6 symbols/min
[2025-10-24T01:17:12.673947] [DEBUG] [MAIN      ] ALK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:12.712929] [INFO ] [MAIN      ] ALK: Generated 139 derivative records from 53477 primary records.
[2025-10-24T01:17:12.715443] [DEBUG] [LOCAL     ] ALK: Saving derivative data.
[2025-10-24T01:17:12.737890] [DEBUG] [MAIN      ] ALL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:12.756757] [DEBUG] [LOCAL     ] ALK: Derivative data saved (139 records).
[2025-10-24T01:17:12.759089] [INFO ] [MAIN      ] ALK: Successfully saved derivative data.
[2025-10-24T01:17:12.762381] [INFO ] [MAIN      ] Derivative Progress: 74/2164 symbols completed. ALK took 1.2s. Estimated remaining: 14m 56s. Rate: 140.0 symbols/min
[2025-10-24T01:17:12.780204] [INFO ] [MAIN      ] ALL: Generated 139 derivative records from 49959 primary records.
[2025-10-24T01:17:12.780339] [DEBUG] [LOCAL     ] ALL: Saving derivative data.
[2025-10-24T01:17:12.793191] [DEBUG] [LOCAL     ] ALL: Derivative data saved (139 records).
[2025-10-24T01:17:12.793278] [INFO ] [MAIN      ] ALL: Successfully saved derivative data.
[2025-10-24T01:17:12.796105] [INFO ] [MAIN      ] Derivative Progress: 75/2164 symbols completed. ALL took 0.9s. Estimated remaining: 14m 44s. Rate: 141.8 symbols/min
[2025-10-24T01:17:12.796929] [INFO ] [MAIN      ] ALLY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:12.796774] [INFO ] [MAIN      ] ALSN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:12.796694] [INFO ] [MAIN      ] ALLE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:12.880102] [DEBUG] [LOCAL     ] ALSN: Loaded 43535 existing records from primary storage.
[2025-10-24T01:17:12.881127] [DEBUG] [LOCAL     ] ALLY: Loaded 53610 existing records from primary storage.
[2025-10-24T01:17:12.882832] [INFO ] [MAIN      ] ALLY: Loaded 53610 primary data records.
[2025-10-24T01:17:12.882702] [INFO ] [MAIN      ] ALSN: Loaded 43535 primary data records.
[2025-10-24T01:17:12.959491] [DEBUG] [LOCAL     ] ALLE: Loaded 44288 existing records from primary storage.
[2025-10-24T01:17:12.977136] [INFO ] [MAIN      ] ALLE: Loaded 44288 primary data records.
[2025-10-24T01:17:13.908311] [DEBUG] [MAIN      ] ALSN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:13.960056] [DEBUG] [MAIN      ] ALLE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:13.961759] [DEBUG] [MAIN      ] ALLY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:14.041095] [INFO ] [MAIN      ] ALSN: Generated 139 derivative records from 43535 primary records.
[2025-10-24T01:17:14.042028] [DEBUG] [LOCAL     ] ALSN: Saving derivative data.
[2025-10-24T01:17:14.065819] [DEBUG] [LOCAL     ] ALSN: Derivative data saved (139 records).
[2025-10-24T01:17:14.069544] [INFO ] [MAIN      ] ALSN: Successfully saved derivative data.
[2025-10-24T01:17:14.072186] [INFO ] [MAIN      ] Derivative Progress: 76/2164 symbols completed. ALSN took 1.3s. Estimated remaining: 15m 7s. Rate: 138.1 symbols/min
[2025-10-24T01:17:14.072863] [INFO ] [MAIN      ] ALTG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:14.079791] [INFO ] [MAIN      ] ALLY: Generated 139 derivative records from 53610 primary records.
[2025-10-24T01:17:14.081971] [DEBUG] [LOCAL     ] ALLY: Saving derivative data.
[2025-10-24T01:17:14.084072] [INFO ] [MAIN      ] ALLE: Generated 139 derivative records from 44288 primary records.
[2025-10-24T01:17:14.085953] [DEBUG] [LOCAL     ] ALLE: Saving derivative data.
[2025-10-24T01:17:14.099771] [DEBUG] [LOCAL     ] ALLY: Derivative data saved (139 records).
[2025-10-24T01:17:14.107766] [INFO ] [MAIN      ] ALLY: Successfully saved derivative data.
[2025-10-24T01:17:14.112945] [DEBUG] [LOCAL     ] ALLE: Derivative data saved (139 records).
[2025-10-24T01:17:14.116670] [INFO ] [MAIN      ] Derivative Progress: 77/2164 symbols completed. ALLY took 1.3s. Estimated remaining: 14m 56s. Rate: 139.7 symbols/min
[2025-10-24T01:17:14.117584] [INFO ] [MAIN      ] ALUR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:14.117107] [INFO ] [MAIN      ] ALLE: Successfully saved derivative data.
[2025-10-24T01:17:14.120884] [INFO ] [MAIN      ] Derivative Progress: 78/2164 symbols completed. ALLE took 1.3s. Estimated remaining: 14m 44s. Rate: 141.5 symbols/min
[2025-10-24T01:17:14.121092] [INFO ] [MAIN      ] ALV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:14.139600] [DEBUG] [LOCAL     ] ALTG: Loaded 23210 existing records from primary storage.
[2025-10-24T01:17:14.140047] [INFO ] [MAIN      ] ALTG: Loaded 23210 primary data records.
[2025-10-24T01:17:14.229435] [DEBUG] [LOCAL     ] ALUR: Loaded 9313 existing records from primary storage.
[2025-10-24T01:17:14.245371] [INFO ] [MAIN      ] ALUR: Loaded 9313 primary data records.
[2025-10-24T01:17:14.607018] [DEBUG] [LOCAL     ] ALV: Loaded 42508 existing records from primary storage.
[2025-10-24T01:17:14.635423] [INFO ] [MAIN      ] ALV: Loaded 42508 primary data records.
[2025-10-24T01:17:15.146277] [DEBUG] [MAIN      ] ALTG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:15.180426] [DEBUG] [MAIN      ] ALUR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:15.227337] [DEBUG] [MAIN      ] ALV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:15.263101] [INFO ] [MAIN      ] ALTG: Generated 139 derivative records from 23210 primary records.
[2025-10-24T01:17:15.263929] [DEBUG] [LOCAL     ] ALTG: Saving derivative data.
[2025-10-24T01:17:15.288613] [DEBUG] [LOCAL     ] ALTG: Derivative data saved (139 records).
[2025-10-24T01:17:15.290788] [INFO ] [MAIN      ] ALTG: Successfully saved derivative data.
[2025-10-24T01:17:15.293157] [INFO ] [MAIN      ] Derivative Progress: 79/2164 symbols completed. ALTG took 1.2s. Estimated remaining: 15m 4s. Rate: 138.4 symbols/min
[2025-10-24T01:17:15.294135] [INFO ] [MAIN      ] ALX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:15.301809] [INFO ] [MAIN      ] ALUR: Generated 139 derivative records from 9313 primary records.
[2025-10-24T01:17:15.303906] [DEBUG] [LOCAL     ] ALUR: Saving derivative data.
[2025-10-24T01:17:15.322854] [DEBUG] [LOCAL     ] ALUR: Derivative data saved (139 records).
[2025-10-24T01:17:15.317192] [INFO ] [MAIN      ] ALV: Generated 139 derivative records from 42508 primary records.
[2025-10-24T01:17:15.323122] [DEBUG] [LOCAL     ] ALV: Saving derivative data.
[2025-10-24T01:17:15.323327] [INFO ] [MAIN      ] ALUR: Successfully saved derivative data.
[2025-10-24T01:17:15.327130] [INFO ] [MAIN      ] Derivative Progress: 80/2164 symbols completed. ALUR took 1.2s. Estimated remaining: 14m 53s. Rate: 140.0 symbols/min
[2025-10-24T01:17:15.328194] [INFO ] [MAIN      ] AM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:15.333910] [DEBUG] [LOCAL     ] ALX: Loaded 7365 existing records from primary storage.
[2025-10-24T01:17:15.341845] [INFO ] [MAIN      ] ALX: Loaded 7365 primary data records.
[2025-10-24T01:17:15.347229] [DEBUG] [LOCAL     ] ALV: Derivative data saved (139 records).
[2025-10-24T01:17:15.378613] [INFO ] [MAIN      ] ALV: Successfully saved derivative data.
[2025-10-24T01:17:15.381738] [INFO ] [MAIN      ] Derivative Progress: 81/2164 symbols completed. ALV took 1.3s. Estimated remaining: 14m 43s. Rate: 141.6 symbols/min
[2025-10-24T01:17:15.381964] [INFO ] [MAIN      ] AMBC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:15.697945] [DEBUG] [LOCAL     ] AMBC: Loaded 36148 existing records from primary storage.
[2025-10-24T01:17:15.701058] [INFO ] [MAIN      ] AMBC: Loaded 36148 primary data records.
[2025-10-24T01:17:15.759894] [DEBUG] [LOCAL     ] AM: Loaded 52213 existing records from primary storage.
[2025-10-24T01:17:15.783696] [INFO ] [MAIN      ] AM: Loaded 52213 primary data records.
[2025-10-24T01:17:16.137852] [DEBUG] [MAIN      ] ALX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:16.434742] [INFO ] [MAIN      ] ALX: Generated 139 derivative records from 7365 primary records.
[2025-10-24T01:17:16.439044] [DEBUG] [LOCAL     ] ALX: Saving derivative data.
[2025-10-24T01:17:16.467008] [DEBUG] [MAIN      ] AM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:16.479006] [DEBUG] [LOCAL     ] ALX: Derivative data saved (139 records).
[2025-10-24T01:17:16.500733] [INFO ] [MAIN      ] ALX: Successfully saved derivative data.
[2025-10-24T01:17:16.500578] [DEBUG] [MAIN      ] AMBC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:16.504331] [INFO ] [MAIN      ] Derivative Progress: 82/2164 symbols completed. ALX took 1.2s. Estimated remaining: 15m 0s. Rate: 138.8 symbols/min
[2025-10-24T01:17:16.520283] [INFO ] [MAIN      ] AMBP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:16.566906] [INFO ] [MAIN      ] AM: Generated 139 derivative records from 52213 primary records.
[2025-10-24T01:17:16.578275] [DEBUG] [LOCAL     ] AM: Saving derivative data.
[2025-10-24T01:17:16.599778] [DEBUG] [LOCAL     ] AM: Derivative data saved (139 records).
[2025-10-24T01:17:16.602322] [INFO ] [MAIN      ] AM: Successfully saved derivative data.
[2025-10-24T01:17:16.608116] [INFO ] [MAIN      ] Derivative Progress: 83/2164 symbols completed. AM took 1.3s. Estimated remaining: 14m 51s. Rate: 140.1 symbols/min
[2025-10-24T01:17:16.608454] [INFO ] [MAIN      ] AMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:16.624117] [INFO ] [MAIN      ] AMBC: Generated 139 derivative records from 36148 primary records.
[2025-10-24T01:17:16.624684] [DEBUG] [LOCAL     ] AMBC: Saving derivative data.
[2025-10-24T01:17:16.628124] [DEBUG] [LOCAL     ] AMBP: Loaded 44670 existing records from primary storage.
[2025-10-24T01:17:16.628855] [INFO ] [MAIN      ] AMBP: Loaded 44670 primary data records.
[2025-10-24T01:17:16.664029] [DEBUG] [LOCAL     ] AMBC: Derivative data saved (139 records).
[2025-10-24T01:17:16.674913] [INFO ] [MAIN      ] AMBC: Successfully saved derivative data.
[2025-10-24T01:17:16.683189] [INFO ] [MAIN      ] Derivative Progress: 84/2164 symbols completed. AMBC took 1.3s. Estimated remaining: 14m 42s. Rate: 141.4 symbols/min
[2025-10-24T01:17:16.702513] [INFO ] [MAIN      ] AMCR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:17.071404] [DEBUG] [LOCAL     ] AMC: Loaded 54156 existing records from primary storage.
[2025-10-24T01:17:17.071933] [INFO ] [MAIN      ] AMC: Loaded 54156 primary data records.
[2025-10-24T01:17:17.198829] [DEBUG] [LOCAL     ] AMCR: Loaded 54060 existing records from primary storage.
[2025-10-24T01:17:17.202827] [INFO ] [MAIN      ] AMCR: Loaded 54060 primary data records.
[2025-10-24T01:17:17.765235] [DEBUG] [MAIN      ] AMBP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:17.827889] [DEBUG] [MAIN      ] AMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:17.886585] [DEBUG] [MAIN      ] AMCR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:17.886895] [INFO ] [MAIN      ] AMBP: Generated 139 derivative records from 44670 primary records.
[2025-10-24T01:17:17.912048] [DEBUG] [LOCAL     ] AMBP: Saving derivative data.
[2025-10-24T01:17:17.933070] [DEBUG] [LOCAL     ] AMBP: Derivative data saved (139 records).
[2025-10-24T01:17:17.938993] [INFO ] [MAIN      ] AMBP: Successfully saved derivative data.
[2025-10-24T01:17:17.943109] [INFO ] [MAIN      ] Derivative Progress: 85/2164 symbols completed. AMBP took 1.4s. Estimated remaining: 15m 2s. Rate: 138.2 symbols/min
[2025-10-24T01:17:17.944561] [INFO ] [MAIN      ] AME: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:17.956326] [INFO ] [MAIN      ] AMC: Generated 139 derivative records from 54156 primary records.
[2025-10-24T01:17:17.960842] [DEBUG] [LOCAL     ] AMC: Saving derivative data.
[2025-10-24T01:17:17.985418] [DEBUG] [LOCAL     ] AMC: Derivative data saved (139 records).
[2025-10-24T01:17:17.985780] [INFO ] [MAIN      ] AMC: Successfully saved derivative data.
[2025-10-24T01:17:17.990901] [INFO ] [MAIN      ] Derivative Progress: 86/2164 symbols completed. AMC took 1.4s. Estimated remaining: 14m 53s. Rate: 139.7 symbols/min
[2025-10-24T01:17:17.991768] [INFO ] [MAIN      ] AMG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:18.000136] [INFO ] [MAIN      ] AMCR: Generated 139 derivative records from 54060 primary records.
[2025-10-24T01:17:18.000409] [DEBUG] [LOCAL     ] AMCR: Saving derivative data.
[2025-10-24T01:17:18.014351] [DEBUG] [LOCAL     ] AMCR: Derivative data saved (139 records).
[2025-10-24T01:17:18.014814] [INFO ] [MAIN      ] AMCR: Successfully saved derivative data.
[2025-10-24T01:17:18.018110] [INFO ] [MAIN      ] Derivative Progress: 87/2164 symbols completed. AMCR took 1.3s. Estimated remaining: 14m 43s. Rate: 141.2 symbols/min
[2025-10-24T01:17:18.030172] [INFO ] [MAIN      ] AMH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:18.046270] [DEBUG] [LOCAL     ] AMG: Loaded 20186 existing records from primary storage.
[2025-10-24T01:17:18.048720] [INFO ] [MAIN      ] AMG: Loaded 20186 primary data records.
[2025-10-24T01:17:18.123980] [DEBUG] [LOCAL     ] AME: Loaded 48787 existing records from primary storage.
[2025-10-24T01:17:18.163264] [INFO ] [MAIN      ] AME: Loaded 48787 primary data records.
[2025-10-24T01:17:18.600825] [DEBUG] [LOCAL     ] AMH: Loaded 52212 existing records from primary storage.
[2025-10-24T01:17:18.606961] [INFO ] [MAIN      ] AMH: Loaded 52212 primary data records.
[2025-10-24T01:17:19.159305] [DEBUG] [MAIN      ] AMG: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:17:19.191673] [DEBUG] [MAIN      ] AME: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:19.257105] [DEBUG] [MAIN      ] AMH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:19.285617] [INFO ] [MAIN      ] AMG: Generated 139 derivative records from 20186 primary records.
[2025-10-24T01:17:19.287928] [DEBUG] [LOCAL     ] AMG: Saving derivative data.
[2025-10-24T01:17:19.306249] [DEBUG] [LOCAL     ] AMG: Derivative data saved (139 records).
[2025-10-24T01:17:19.308833] [INFO ] [MAIN      ] AMG: Successfully saved derivative data.
[2025-10-24T01:17:19.310173] [INFO ] [MAIN      ] AME: Generated 139 derivative records from 48787 primary records.
[2025-10-24T01:17:19.313748] [INFO ] [MAIN      ] Derivative Progress: 88/2164 symbols completed. AMG took 1.3s. Estimated remaining: 15m 3s. Rate: 138.0 symbols/min
[2025-10-24T01:17:19.313879] [DEBUG] [LOCAL     ] AME: Saving derivative data.
[2025-10-24T01:17:19.332702] [DEBUG] [LOCAL     ] AME: Derivative data saved (139 records).
[2025-10-24T01:17:19.335608] [INFO ] [MAIN      ] AME: Successfully saved derivative data.
[2025-10-24T01:17:19.342598] [INFO ] [MAIN      ] Derivative Progress: 89/2164 symbols completed. AME took 1.4s. Estimated remaining: 14m 53s. Rate: 139.5 symbols/min
[2025-10-24T01:17:19.346033] [INFO ] [MAIN      ] AMH: Generated 139 derivative records from 52212 primary records.
[2025-10-24T01:17:19.346140] [DEBUG] [LOCAL     ] AMH: Saving derivative data.
[2025-10-24T01:17:19.358332] [DEBUG] [LOCAL     ] AMH: Derivative data saved (139 records).
[2025-10-24T01:17:19.358417] [INFO ] [MAIN      ] AMH: Successfully saved derivative data.
[2025-10-24T01:17:19.361726] [INFO ] [MAIN      ] Derivative Progress: 90/2164 symbols completed. AMH took 1.3s. Estimated remaining: 14m 43s. Rate: 141.0 symbols/min
[2025-10-24T01:17:19.362198] [INFO ] [MAIN      ] AMN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:19.362279] [INFO ] [MAIN      ] AMPX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:19.362441] [INFO ] [MAIN      ] AMP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:19.455598] [DEBUG] [LOCAL     ] AMP: Loaded 31992 existing records from primary storage.
[2025-10-24T01:17:19.468394] [INFO ] [MAIN      ] AMP: Loaded 31992 primary data records.
[2025-10-24T01:17:19.469407] [DEBUG] [LOCAL     ] AMPX: Loaded 52829 existing records from primary storage.
[2025-10-24T01:17:19.475210] [INFO ] [MAIN      ] AMPX: Loaded 52829 primary data records.
[2025-10-24T01:17:19.493607] [DEBUG] [LOCAL     ] AMN: Loaded 41883 existing records from primary storage.
[2025-10-24T01:17:19.534607] [INFO ] [MAIN      ] AMN: Loaded 41883 primary data records.
[2025-10-24T01:17:20.488176] [DEBUG] [MAIN      ] AMPX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:20.490135] [DEBUG] [MAIN      ] AMP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:20.541723] [DEBUG] [MAIN      ] AMN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:20.624600] [INFO ] [MAIN      ] AMPX: Generated 139 derivative records from 52829 primary records.
[2025-10-24T01:17:20.624844] [DEBUG] [LOCAL     ] AMPX: Saving derivative data.
[2025-10-24T01:17:20.629249] [INFO ] [MAIN      ] AMP: Generated 139 derivative records from 31992 primary records.
[2025-10-24T01:17:20.634942] [DEBUG] [LOCAL     ] AMP: Saving derivative data.
[2025-10-24T01:17:20.648547] [DEBUG] [LOCAL     ] AMPX: Derivative data saved (139 records).
[2025-10-24T01:17:20.658691] [INFO ] [MAIN      ] AMPX: Successfully saved derivative data.
[2025-10-24T01:17:20.663495] [DEBUG] [LOCAL     ] AMP: Derivative data saved (139 records).
[2025-10-24T01:17:20.666789] [INFO ] [MAIN      ] Derivative Progress: 91/2164 symbols completed. AMPX took 1.3s. Estimated remaining: 15m 2s. Rate: 137.8 symbols/min
[2025-10-24T01:17:20.667476] [INFO ] [MAIN      ] AMPY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:20.670844] [INFO ] [MAIN      ] AMP: Successfully saved derivative data.
[2025-10-24T01:17:20.673736] [INFO ] [MAIN      ] Derivative Progress: 92/2164 symbols completed. AMP took 1.3s. Estimated remaining: 14m 52s. Rate: 139.3 symbols/min
[2025-10-24T01:17:20.673928] [INFO ] [MAIN      ] AMR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:20.674270] [INFO ] [MAIN      ] AMN: Generated 139 derivative records from 41883 primary records.
[2025-10-24T01:17:20.675883] [DEBUG] [LOCAL     ] AMN: Saving derivative data.
[2025-10-24T01:17:20.690297] [DEBUG] [LOCAL     ] AMN: Derivative data saved (139 records).
[2025-10-24T01:17:20.690614] [INFO ] [MAIN      ] AMN: Successfully saved derivative data.
[2025-10-24T01:17:20.693899] [INFO ] [MAIN      ] Derivative Progress: 93/2164 symbols completed. AMN took 1.3s. Estimated remaining: 14m 43s. Rate: 140.8 symbols/min
[2025-10-24T01:17:20.694256] [INFO ] [MAIN      ] AMRC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:20.731613] [DEBUG] [LOCAL     ] AMR: Loaded 28953 existing records from primary storage.
[2025-10-24T01:17:20.731922] [INFO ] [MAIN      ] AMR: Loaded 28953 primary data records.
[2025-10-24T01:17:20.879785] [DEBUG] [LOCAL     ] AMPY: Loaded 39691 existing records from primary storage.
[2025-10-24T01:17:20.881422] [DEBUG] [LOCAL     ] AMRC: Loaded 38781 existing records from primary storage.
[2025-10-24T01:17:20.882063] [INFO ] [MAIN      ] AMRC: Loaded 38781 primary data records.
[2025-10-24T01:17:20.881553] [INFO ] [MAIN      ] AMPY: Loaded 39691 primary data records.
[2025-10-24T01:17:21.791111] [DEBUG] [MAIN      ] AMR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:21.845229] [DEBUG] [MAIN      ] AMRC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:21.859316] [DEBUG] [MAIN      ] AMPY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:21.891893] [INFO ] [MAIN      ] AMR: Generated 139 derivative records from 28953 primary records.
[2025-10-24T01:17:21.895415] [DEBUG] [LOCAL     ] AMR: Saving derivative data.
[2025-10-24T01:17:21.914743] [DEBUG] [LOCAL     ] AMR: Derivative data saved (139 records).
[2025-10-24T01:17:21.915295] [INFO ] [MAIN      ] AMR: Successfully saved derivative data.
[2025-10-24T01:17:21.919518] [INFO ] [MAIN      ] Derivative Progress: 94/2164 symbols completed. AMR took 1.2s. Estimated remaining: 14m 60s. Rate: 138.0 symbols/min
[2025-10-24T01:17:21.923091] [INFO ] [MAIN      ] AMT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:21.933453] [INFO ] [MAIN      ] AMRC: Generated 139 derivative records from 38781 primary records.
[2025-10-24T01:17:21.934118] [DEBUG] [LOCAL     ] AMRC: Saving derivative data.
[2025-10-24T01:17:21.945264] [INFO ] [MAIN      ] AMPY: Generated 139 derivative records from 39691 primary records.
[2025-10-24T01:17:21.950196] [DEBUG] [LOCAL     ] AMRC: Derivative data saved (139 records).
[2025-10-24T01:17:21.950357] [INFO ] [MAIN      ] AMRC: Successfully saved derivative data.
[2025-10-24T01:17:21.950533] [DEBUG] [LOCAL     ] AMPY: Saving derivative data.
[2025-10-24T01:17:21.952825] [INFO ] [MAIN      ] Derivative Progress: 95/2164 symbols completed. AMRC took 1.3s. Estimated remaining: 14m 51s. Rate: 139.4 symbols/min
[2025-10-24T01:17:21.954063] [INFO ] [MAIN      ] AMTB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:21.967084] [DEBUG] [LOCAL     ] AMPY: Derivative data saved (139 records).
[2025-10-24T01:17:21.967538] [INFO ] [MAIN      ] AMPY: Successfully saved derivative data.
[2025-10-24T01:17:21.970029] [INFO ] [MAIN      ] Derivative Progress: 96/2164 symbols completed. AMPY took 1.3s. Estimated remaining: 14m 41s. Rate: 140.8 symbols/min
[2025-10-24T01:17:21.970530] [INFO ] [MAIN      ] AMTD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:21.981003] [DEBUG] [LOCAL     ] AMTD: Loaded 3818 existing records from primary storage.
[2025-10-24T01:17:21.981267] [INFO ] [MAIN      ] AMTD: Loaded 3818 primary data records.
[2025-10-24T01:17:22.077390] [DEBUG] [LOCAL     ] AMTB: Loaded 20600 existing records from primary storage.
[2025-10-24T01:17:22.106060] [INFO ] [MAIN      ] AMTB: Loaded 20600 primary data records.
[2025-10-24T01:17:22.146504] [DEBUG] [LOCAL     ] AMT: Loaded 52814 existing records from primary storage.
[2025-10-24T01:17:22.276797] [INFO ] [MAIN      ] AMT: Loaded 52814 primary data records.
[2025-10-24T01:17:22.932054] [DEBUG] [MAIN      ] AMTD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:22.973282] [DEBUG] [MAIN      ] AMTB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:23.005291] [DEBUG] [MAIN      ] AMT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:23.049457] [INFO ] [MAIN      ] AMTD: Generated 139 derivative records from 3818 primary records.
[2025-10-24T01:17:23.051689] [DEBUG] [LOCAL     ] AMTD: Saving derivative data.
[2025-10-24T01:17:23.064464] [DEBUG] [LOCAL     ] AMTD: Derivative data saved (139 records).
[2025-10-24T01:17:23.069485] [INFO ] [MAIN      ] AMTD: Successfully saved derivative data.
[2025-10-24T01:17:23.071946] [INFO ] [MAIN      ] Derivative Progress: 97/2164 symbols completed. AMTD took 1.1s. Estimated remaining: 14m 55s. Rate: 138.5 symbols/min
[2025-10-24T01:17:23.073495] [INFO ] [MAIN      ] AMTM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:23.077809] [INFO ] [MAIN      ] AMT: Generated 139 derivative records from 52814 primary records.
[2025-10-24T01:17:23.079559] [INFO ] [MAIN      ] AMTB: Generated 139 derivative records from 20600 primary records.
[2025-10-24T01:17:23.079796] [DEBUG] [LOCAL     ] AMT: Saving derivative data.
[2025-10-24T01:17:23.080150] [DEBUG] [LOCAL     ] AMTB: Saving derivative data.
[2025-10-24T01:17:23.102742] [DEBUG] [LOCAL     ] AMTB: Derivative data saved (139 records).
[2025-10-24T01:17:23.104735] [DEBUG] [LOCAL     ] AMT: Derivative data saved (139 records).
[2025-10-24T01:17:23.104065] [INFO ] [MAIN      ] AMTB: Successfully saved derivative data.
[2025-10-24T01:17:23.107159] [INFO ] [MAIN      ] Derivative Progress: 98/2164 symbols completed. AMTB took 1.2s. Estimated remaining: 14m 47s. Rate: 139.8 symbols/min
[2025-10-24T01:17:23.107295] [INFO ] [MAIN      ] AMT: Successfully saved derivative data.
[2025-10-24T01:17:23.110436] [INFO ] [MAIN      ] Derivative Progress: 99/2164 symbols completed. AMT took 1.2s. Estimated remaining: 14m 37s. Rate: 141.2 symbols/min
[2025-10-24T01:17:23.107490] [INFO ] [MAIN      ] AMWL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:23.110841] [INFO ] [MAIN      ] AMX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:23.125593] [DEBUG] [LOCAL     ] AMWL: Loaded 9907 existing records from primary storage.
[2025-10-24T01:17:23.126019] [INFO ] [MAIN      ] AMWL: Loaded 9907 primary data records.
[2025-10-24T01:17:23.261147] [DEBUG] [LOCAL     ] AMTM: Loaded 50606 existing records from primary storage.
[2025-10-24T01:17:23.276780] [INFO ] [MAIN      ] AMTM: Loaded 50606 primary data records.
[2025-10-24T01:17:23.574003] [DEBUG] [LOCAL     ] AMX: Loaded 49530 existing records from primary storage.
[2025-10-24T01:17:23.592041] [INFO ] [MAIN      ] AMX: Loaded 49530 primary data records.
[2025-10-24T01:17:24.168437] [DEBUG] [MAIN      ] AMWL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:24.200948] [DEBUG] [MAIN      ] AMTM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:24.249092] [DEBUG] [MAIN      ] AMX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:24.275014] [INFO ] [MAIN      ] AMWL: Generated 139 derivative records from 9907 primary records.
[2025-10-24T01:17:24.277404] [DEBUG] [LOCAL     ] AMWL: Saving derivative data.
[2025-10-24T01:17:24.292741] [DEBUG] [LOCAL     ] AMWL: Derivative data saved (139 records).
[2025-10-24T01:17:24.296285] [INFO ] [MAIN      ] AMWL: Successfully saved derivative data.
[2025-10-24T01:17:24.300849] [INFO ] [MAIN      ] Derivative Progress: 100/2164 symbols completed. AMWL took 1.2s. Estimated remaining: 14m 53s. Rate: 138.7 symbols/min
[2025-10-24T01:17:24.302476] [INFO ] [MAIN      ] AN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:24.303048] [INFO ] [MAIN      ] AMTM: Generated 139 derivative records from 50606 primary records.
[2025-10-24T01:17:24.306318] [DEBUG] [LOCAL     ] AMTM: Saving derivative data.
[2025-10-24T01:17:24.323492] [DEBUG] [LOCAL     ] AMTM: Derivative data saved (139 records).
[2025-10-24T01:17:24.326868] [INFO ] [MAIN      ] AMX: Generated 139 derivative records from 49530 primary records.
[2025-10-24T01:17:24.325242] [INFO ] [MAIN      ] AMTM: Successfully saved derivative data.
[2025-10-24T01:17:24.327071] [DEBUG] [LOCAL     ] AMX: Saving derivative data.
[2025-10-24T01:17:24.330634] [INFO ] [MAIN      ] Derivative Progress: 101/2164 symbols completed. AMTM took 1.3s. Estimated remaining: 14m 44s. Rate: 140.0 symbols/min
[2025-10-24T01:17:24.338186] [INFO ] [MAIN      ] ANET: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:24.352031] [DEBUG] [LOCAL     ] AMX: Derivative data saved (139 records).
[2025-10-24T01:17:24.352300] [INFO ] [MAIN      ] AMX: Successfully saved derivative data.
[2025-10-24T01:17:24.354710] [INFO ] [MAIN      ] Derivative Progress: 102/2164 symbols completed. AMX took 1.2s. Estimated remaining: 14m 35s. Rate: 141.3 symbols/min
[2025-10-24T01:17:24.355170] [INFO ] [MAIN      ] ANF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:24.369797] [DEBUG] [LOCAL     ] AN: Loaded 31320 existing records from primary storage.
[2025-10-24T01:17:24.369980] [INFO ] [MAIN      ] AN: Loaded 31320 primary data records.
[2025-10-24T01:17:24.731136] [DEBUG] [LOCAL     ] ANF: Loaded 52408 existing records from primary storage.
[2025-10-24T01:17:24.731961] [INFO ] [MAIN      ] ANF: Loaded 52408 primary data records.
[2025-10-24T01:17:24.733677] [DEBUG] [LOCAL     ] ANET: Loaded 54156 existing records from primary storage.
[2025-10-24T01:17:24.790801] [INFO ] [MAIN      ] ANET: Loaded 54156 primary data records.
[2025-10-24T01:17:25.365873] [DEBUG] [MAIN      ] AN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:25.413166] [INFO ] [MAIN      ] AN: Generated 139 derivative records from 31320 primary records.
[2025-10-24T01:17:25.426179] [DEBUG] [LOCAL     ] AN: Saving derivative data.
[2025-10-24T01:17:25.427039] [DEBUG] [MAIN      ] ANF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:25.452512] [DEBUG] [LOCAL     ] AN: Derivative data saved (139 records).
[2025-10-24T01:17:25.455565] [INFO ] [MAIN      ] AN: Successfully saved derivative data.
[2025-10-24T01:17:25.459822] [INFO ] [MAIN      ] Derivative Progress: 103/2164 symbols completed. AN took 1.2s. Estimated remaining: 14m 49s. Rate: 139.2 symbols/min
[2025-10-24T01:17:25.472917] [DEBUG] [MAIN      ] ANET: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:25.523445] [INFO ] [MAIN      ] ANF: Generated 139 derivative records from 52408 primary records.
[2025-10-24T01:17:25.524273] [DEBUG] [LOCAL     ] ANF: Saving derivative data.
[2025-10-24T01:17:25.536892] [INFO ] [MAIN      ] ANET: Generated 139 derivative records from 54156 primary records.
[2025-10-24T01:17:25.539954] [DEBUG] [LOCAL     ] ANET: Saving derivative data.
[2025-10-24T01:17:25.539781] [DEBUG] [LOCAL     ] ANF: Derivative data saved (139 records).
[2025-10-24T01:17:25.540411] [INFO ] [MAIN      ] ANF: Successfully saved derivative data.
[2025-10-24T01:17:25.542976] [INFO ] [MAIN      ] Derivative Progress: 104/2164 symbols completed. ANF took 1.2s. Estimated remaining: 14m 41s. Rate: 140.3 symbols/min
[2025-10-24T01:17:25.554478] [DEBUG] [LOCAL     ] ANET: Derivative data saved (139 records).
[2025-10-24T01:17:25.554566] [INFO ] [MAIN      ] ANET: Successfully saved derivative data.
[2025-10-24T01:17:25.557485] [INFO ] [MAIN      ] Derivative Progress: 105/2164 symbols completed. ANET took 1.2s. Estimated remaining: 14m 33s. Rate: 141.6 symbols/min
[2025-10-24T01:17:25.558032] [INFO ] [MAIN      ] ANRO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:25.558316] [INFO ] [MAIN      ] ANVS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:25.558209] [INFO ] [MAIN      ] AOD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:25.591268] [DEBUG] [LOCAL     ] ANRO: Loaded 19930 existing records from primary storage.
[2025-10-24T01:17:25.598967] [INFO ] [MAIN      ] ANRO: Loaded 19930 primary data records.
[2025-10-24T01:17:25.721893] [DEBUG] [LOCAL     ] AOD: Loaded 31093 existing records from primary storage.
[2025-10-24T01:17:25.724632] [DEBUG] [LOCAL     ] ANVS: Loaded 24118 existing records from primary storage.
[2025-10-24T01:17:25.740484] [INFO ] [MAIN      ] ANVS: Loaded 24118 primary data records.
[2025-10-24T01:17:25.735128] [INFO ] [MAIN      ] AOD: Loaded 31093 primary data records.
[2025-10-24T01:17:26.554556] [DEBUG] [MAIN      ] ANRO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:26.603562] [DEBUG] [MAIN      ] AOD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:26.618033] [DEBUG] [MAIN      ] ANVS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:26.689283] [INFO ] [MAIN      ] ANRO: Generated 139 derivative records from 19930 primary records.
[2025-10-24T01:17:26.692074] [DEBUG] [LOCAL     ] ANRO: Saving derivative data.
[2025-10-24T01:17:26.713802] [DEBUG] [LOCAL     ] ANRO: Derivative data saved (139 records).
[2025-10-24T01:17:26.714749] [INFO ] [MAIN      ] ANRO: Successfully saved derivative data.
[2025-10-24T01:17:26.719169] [INFO ] [MAIN      ] Derivative Progress: 106/2164 symbols completed. ANRO took 1.2s. Estimated remaining: 14m 47s. Rate: 139.3 symbols/min
[2025-10-24T01:17:26.720243] [INFO ] [MAIN      ] AOMR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:26.724532] [INFO ] [MAIN      ] AOD: Generated 139 derivative records from 31093 primary records.
[2025-10-24T01:17:26.727358] [INFO ] [MAIN      ] ANVS: Generated 139 derivative records from 24118 primary records.
[2025-10-24T01:17:26.725573] [DEBUG] [LOCAL     ] AOD: Saving derivative data.
[2025-10-24T01:17:26.727524] [DEBUG] [LOCAL     ] ANVS: Saving derivative data.
[2025-10-24T01:17:26.747675] [DEBUG] [LOCAL     ] ANVS: Derivative data saved (139 records).
[2025-10-24T01:17:26.751840] [INFO ] [MAIN      ] ANVS: Successfully saved derivative data.
[2025-10-24T01:17:26.755175] [INFO ] [MAIN      ] Derivative Progress: 107/2164 symbols completed. ANVS took 1.2s. Estimated remaining: 14m 39s. Rate: 140.5 symbols/min
[2025-10-24T01:17:26.752012] [DEBUG] [LOCAL     ] AOD: Derivative data saved (139 records).
[2025-10-24T01:17:26.755514] [INFO ] [MAIN      ] AON: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:26.755669] [INFO ] [MAIN      ] AOD: Successfully saved derivative data.
[2025-10-24T01:17:26.764315] [INFO ] [MAIN      ] Derivative Progress: 108/2164 symbols completed. AOD took 1.2s. Estimated remaining: 14m 30s. Rate: 141.8 symbols/min
[2025-10-24T01:17:26.764697] [INFO ] [MAIN      ] AORT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:26.773773] [DEBUG] [LOCAL     ] AOMR: Loaded 16387 existing records from primary storage.
[2025-10-24T01:17:26.774065] [INFO ] [MAIN      ] AOMR: Loaded 16387 primary data records.
[2025-10-24T01:17:27.097358] [DEBUG] [LOCAL     ] AORT: Loaded 29058 existing records from primary storage.
[2025-10-24T01:17:27.110587] [INFO ] [MAIN      ] AORT: Loaded 29058 primary data records.
[2025-10-24T01:17:27.133765] [DEBUG] [LOCAL     ] AON: Loaded 45341 existing records from primary storage.
[2025-10-24T01:17:27.151079] [INFO ] [MAIN      ] AON: Loaded 45341 primary data records.
[2025-10-24T01:17:27.817843] [DEBUG] [MAIN      ] AOMR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:27.862972] [DEBUG] [MAIN      ] AORT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:27.898922] [DEBUG] [MAIN      ] AON: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:27.927860] [INFO ] [MAIN      ] AOMR: Generated 139 derivative records from 16387 primary records.
[2025-10-24T01:17:27.928591] [DEBUG] [LOCAL     ] AOMR: Saving derivative data.
[2025-10-24T01:17:27.947931] [DEBUG] [LOCAL     ] AOMR: Derivative data saved (139 records).
[2025-10-24T01:17:27.950228] [INFO ] [MAIN      ] AOMR: Successfully saved derivative data.
[2025-10-24T01:17:27.953100] [INFO ] [MAIN      ] Derivative Progress: 109/2164 symbols completed. AOMR took 1.2s. Estimated remaining: 14m 44s. Rate: 139.4 symbols/min
[2025-10-24T01:17:27.953293] [INFO ] [MAIN      ] AOS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:27.974743] [INFO ] [MAIN      ] AORT: Generated 139 derivative records from 29058 primary records.
[2025-10-24T01:17:27.975308] [DEBUG] [LOCAL     ] AORT: Saving derivative data.
[2025-10-24T01:17:27.993842] [DEBUG] [LOCAL     ] AORT: Derivative data saved (139 records).
[2025-10-24T01:17:27.996244] [INFO ] [MAIN      ] AORT: Successfully saved derivative data.
[2025-10-24T01:17:27.998775] [INFO ] [MAIN      ] Derivative Progress: 110/2164 symbols completed. AORT took 1.2s. Estimated remaining: 14m 37s. Rate: 140.6 symbols/min
[2025-10-24T01:17:27.995893] [INFO ] [MAIN      ] AON: Generated 139 derivative records from 45341 primary records.
[2025-10-24T01:17:27.999187] [INFO ] [MAIN      ] AP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:27.999911] [DEBUG] [LOCAL     ] AON: Saving derivative data.
[2025-10-24T01:17:28.012701] [DEBUG] [LOCAL     ] AON: Derivative data saved (139 records).
[2025-10-24T01:17:28.012831] [INFO ] [MAIN      ] AON: Successfully saved derivative data.
[2025-10-24T01:17:28.015457] [INFO ] [MAIN      ] Derivative Progress: 111/2164 symbols completed. AON took 1.3s. Estimated remaining: 14m 29s. Rate: 141.8 symbols/min
[2025-10-24T01:17:28.015738] [INFO ] [MAIN      ] APAM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:28.034119] [DEBUG] [LOCAL     ] AP: Loaded 7470 existing records from primary storage.
[2025-10-24T01:17:28.034349] [INFO ] [MAIN      ] AP: Loaded 7470 primary data records.
[2025-10-24T01:17:28.166153] [DEBUG] [LOCAL     ] AOS: Loaded 49003 existing records from primary storage.
[2025-10-24T01:17:28.182002] [INFO ] [MAIN      ] AOS: Loaded 49003 primary data records.
[2025-10-24T01:17:28.474099] [DEBUG] [LOCAL     ] APAM: Loaded 35893 existing records from primary storage.
[2025-10-24T01:17:28.485698] [INFO ] [MAIN      ] APAM: Loaded 35893 primary data records.
[2025-10-24T01:17:29.006403] [DEBUG] [MAIN      ] AP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:29.043757] [DEBUG] [MAIN      ] AOS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:29.088533] [DEBUG] [MAIN      ] APAM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:29.128315] [INFO ] [MAIN      ] AP: Generated 139 derivative records from 7470 primary records.
[2025-10-24T01:17:29.134429] [DEBUG] [LOCAL     ] AP: Saving derivative data.
[2025-10-24T01:17:29.148732] [DEBUG] [LOCAL     ] AP: Derivative data saved (139 records).
[2025-10-24T01:17:29.152569] [INFO ] [MAIN      ] AP: Successfully saved derivative data.
[2025-10-24T01:17:29.156442] [INFO ] [MAIN      ] Derivative Progress: 112/2164 symbols completed. AP took 1.2s. Estimated remaining: 14m 41s. Rate: 139.7 symbols/min
[2025-10-24T01:17:29.159187] [INFO ] [MAIN      ] APD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:29.158976] [INFO ] [MAIN      ] AOS: Generated 139 derivative records from 49003 primary records.
[2025-10-24T01:17:29.159672] [DEBUG] [LOCAL     ] AOS: Saving derivative data.
[2025-10-24T01:17:29.178464] [DEBUG] [LOCAL     ] AOS: Derivative data saved (139 records).
[2025-10-24T01:17:29.182115] [INFO ] [MAIN      ] AOS: Successfully saved derivative data.
[2025-10-24T01:17:29.185223] [INFO ] [MAIN      ] Derivative Progress: 113/2164 symbols completed. AOS took 1.2s. Estimated remaining: 14m 34s. Rate: 140.9 symbols/min
[2025-10-24T01:17:29.186115] [INFO ] [MAIN      ] APG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:29.185938] [INFO ] [MAIN      ] APAM: Generated 139 derivative records from 35893 primary records.
[2025-10-24T01:17:29.186858] [DEBUG] [LOCAL     ] APAM: Saving derivative data.
[2025-10-24T01:17:29.205852] [DEBUG] [LOCAL     ] APAM: Derivative data saved (139 records).
[2025-10-24T01:17:29.206054] [INFO ] [MAIN      ] APAM: Successfully saved derivative data.
[2025-10-24T01:17:29.209362] [INFO ] [MAIN      ] Derivative Progress: 114/2164 symbols completed. APAM took 1.2s. Estimated remaining: 14m 26s. Rate: 142.0 symbols/min
[2025-10-24T01:17:29.209675] [INFO ] [MAIN      ] APH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:29.242462] [DEBUG] [LOCAL     ] APD: Loaded 45754 existing records from primary storage.
[2025-10-24T01:17:29.243935] [INFO ] [MAIN      ] APD: Loaded 45754 primary data records.
[2025-10-24T01:17:29.501096] [DEBUG] [LOCAL     ] APG: Loaded 50997 existing records from primary storage.
[2025-10-24T01:17:29.628564] [INFO ] [MAIN      ] APG: Loaded 50997 primary data records.
[2025-10-24T01:17:29.629556] [DEBUG] [LOCAL     ] APH: Loaded 54081 existing records from primary storage.
[2025-10-24T01:17:29.629742] [INFO ] [MAIN      ] APH: Loaded 54081 primary data records.
[2025-10-24T01:17:30.289894] [DEBUG] [MAIN      ] APD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:30.348373] [DEBUG] [MAIN      ] APH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:30.378192] [DEBUG] [MAIN      ] APG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:30.394870] [INFO ] [MAIN      ] APD: Generated 139 derivative records from 45754 primary records.
[2025-10-24T01:17:30.398949] [DEBUG] [LOCAL     ] APD: Saving derivative data.
[2025-10-24T01:17:30.417129] [DEBUG] [LOCAL     ] APD: Derivative data saved (139 records).
[2025-10-24T01:17:30.417878] [INFO ] [MAIN      ] APD: Successfully saved derivative data.
[2025-10-24T01:17:30.423900] [INFO ] [MAIN      ] Derivative Progress: 115/2164 symbols completed. APD took 1.3s. Estimated remaining: 14m 40s. Rate: 139.8 symbols/min
[2025-10-24T01:17:30.424092] [INFO ] [MAIN      ] APLE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:30.455780] [INFO ] [MAIN      ] APH: Generated 139 derivative records from 54081 primary records.
[2025-10-24T01:17:30.456704] [DEBUG] [LOCAL     ] APH: Saving derivative data.
[2025-10-24T01:17:30.461379] [INFO ] [MAIN      ] APG: Generated 139 derivative records from 50997 primary records.
[2025-10-24T01:17:30.484191] [DEBUG] [LOCAL     ] APG: Saving derivative data.
[2025-10-24T01:17:30.487217] [DEBUG] [LOCAL     ] APH: Derivative data saved (139 records).
[2025-10-24T01:17:30.488313] [INFO ] [MAIN      ] APH: Successfully saved derivative data.
[2025-10-24T01:17:30.491147] [INFO ] [MAIN      ] Derivative Progress: 116/2164 symbols completed. APH took 1.3s. Estimated remaining: 14m 33s. Rate: 140.8 symbols/min
[2025-10-24T01:17:30.491354] [INFO ] [MAIN      ] APO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:30.506947] [DEBUG] [LOCAL     ] APG: Derivative data saved (139 records).
[2025-10-24T01:17:30.522332] [INFO ] [MAIN      ] APG: Successfully saved derivative data.
[2025-10-24T01:17:30.525206] [INFO ] [MAIN      ] Derivative Progress: 117/2164 symbols completed. APG took 1.3s. Estimated remaining: 14m 26s. Rate: 141.9 symbols/min
[2025-10-24T01:17:30.525637] [INFO ] [MAIN      ] APOS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:30.528832] [DEBUG] [LOCAL     ] APLE: Loaded 52333 existing records from primary storage.
[2025-10-24T01:17:30.529723] [INFO ] [MAIN      ] APLE: Loaded 52333 primary data records.
[2025-10-24T01:17:30.627564] [DEBUG] [LOCAL     ] APOS: Loaded 7105 existing records from primary storage.
[2025-10-24T01:17:30.656307] [INFO ] [MAIN      ] APOS: Loaded 7105 primary data records.
[2025-10-24T01:17:30.861431] [DEBUG] [LOCAL     ] APO: Loaded 53775 existing records from primary storage.
[2025-10-24T01:17:30.962523] [INFO ] [MAIN      ] APO: Loaded 53775 primary data records.
[2025-10-24T01:17:31.529337] [DEBUG] [MAIN      ] APLE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:31.562456] [DEBUG] [MAIN      ] APOS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:31.609425] [DEBUG] [MAIN      ] APO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:31.653753] [INFO ] [MAIN      ] APLE: Generated 139 derivative records from 52333 primary records.
[2025-10-24T01:17:31.657145] [DEBUG] [LOCAL     ] APLE: Saving derivative data.
[2025-10-24T01:17:31.660816] [INFO ] [MAIN      ] APOS: Generated 139 derivative records from 7105 primary records.
[2025-10-24T01:17:31.661321] [DEBUG] [LOCAL     ] APOS: Saving derivative data.
[2025-10-24T01:17:31.678590] [DEBUG] [LOCAL     ] APLE: Derivative data saved (139 records).
[2025-10-24T01:17:31.689026] [INFO ] [MAIN      ] APLE: Successfully saved derivative data.
[2025-10-24T01:17:31.691921] [DEBUG] [LOCAL     ] APOS: Derivative data saved (139 records).
[2025-10-24T01:17:31.694866] [INFO ] [MAIN      ] Derivative Progress: 118/2164 symbols completed. APLE took 1.3s. Estimated remaining: 14m 38s. Rate: 139.8 symbols/min
[2025-10-24T01:17:31.695103] [INFO ] [MAIN      ] APOS: Successfully saved derivative data.
[2025-10-24T01:17:31.700883] [INFO ] [MAIN      ] Derivative Progress: 119/2164 symbols completed. APOS took 1.2s. Estimated remaining: 14m 30s. Rate: 141.0 symbols/min
[2025-10-24T01:17:31.704550] [INFO ] [MAIN      ] APO: Generated 139 derivative records from 53775 primary records.
[2025-10-24T01:17:31.704666] [DEBUG] [LOCAL     ] APO: Saving derivative data.
[2025-10-24T01:17:31.716733] [DEBUG] [LOCAL     ] APO: Derivative data saved (139 records).
[2025-10-24T01:17:31.716815] [INFO ] [MAIN      ] APO: Successfully saved derivative data.
[2025-10-24T01:17:31.719538] [INFO ] [MAIN      ] Derivative Progress: 120/2164 symbols completed. APO took 1.2s. Estimated remaining: 14m 23s. Rate: 142.1 symbols/min
[2025-10-24T01:17:31.720205] [INFO ] [MAIN      ] AQNB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:31.720352] [INFO ] [MAIN      ] AQN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:31.720055] [INFO ] [MAIN      ] APTV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:31.730105] [DEBUG] [LOCAL     ] AQNB: Loaded 3899 existing records from primary storage.
[2025-10-24T01:17:31.730424] [INFO ] [MAIN      ] AQNB: Loaded 3899 primary data records.
[2025-10-24T01:17:32.151782] [DEBUG] [LOCAL     ] AQN: Loaded 52016 existing records from primary storage.
[2025-10-24T01:17:32.152131] [INFO ] [MAIN      ] AQN: Loaded 52016 primary data records.
[2025-10-24T01:17:32.176695] [DEBUG] [LOCAL     ] APTV: Loaded 52199 existing records from primary storage.
[2025-10-24T01:17:32.176980] [INFO ] [MAIN      ] APTV: Loaded 52199 primary data records.
[2025-10-24T01:17:32.768202] [DEBUG] [MAIN      ] AQNB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:32.823099] [INFO ] [MAIN      ] AQNB: Generated 139 derivative records from 3899 primary records.
[2025-10-24T01:17:32.823377] [DEBUG] [MAIN      ] APTV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:32.831084] [DEBUG] [LOCAL     ] AQNB: Saving derivative data.
[2025-10-24T01:17:32.846742] [DEBUG] [MAIN      ] AQN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:32.881614] [DEBUG] [LOCAL     ] AQNB: Derivative data saved (139 records).
[2025-10-24T01:17:32.882021] [INFO ] [MAIN      ] AQNB: Successfully saved derivative data.
[2025-10-24T01:17:32.888201] [INFO ] [MAIN      ] Derivative Progress: 121/2164 symbols completed. AQNB took 1.2s. Estimated remaining: 14m 35s. Rate: 140.1 symbols/min
[2025-10-24T01:17:32.889516] [INFO ] [MAIN      ] AR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:32.924128] [INFO ] [MAIN      ] APTV: Generated 139 derivative records from 52199 primary records.
[2025-10-24T01:17:32.926355] [DEBUG] [LOCAL     ] APTV: Saving derivative data.
[2025-10-24T01:17:32.926555] [INFO ] [MAIN      ] AQN: Generated 139 derivative records from 52016 primary records.
[2025-10-24T01:17:32.927791] [DEBUG] [LOCAL     ] AQN: Saving derivative data.
[2025-10-24T01:17:32.940365] [DEBUG] [LOCAL     ] APTV: Derivative data saved (139 records).
[2025-10-24T01:17:32.940493] [INFO ] [MAIN      ] APTV: Successfully saved derivative data.
[2025-10-24T01:17:32.943584] [INFO ] [MAIN      ] Derivative Progress: 122/2164 symbols completed. APTV took 1.2s. Estimated remaining: 14m 29s. Rate: 141.1 symbols/min
[2025-10-24T01:17:32.943890] [INFO ] [MAIN      ] ARCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:32.969679] [DEBUG] [LOCAL     ] AQN: Derivative data saved (139 records).
[2025-10-24T01:17:32.969954] [INFO ] [MAIN      ] AQN: Successfully saved derivative data.
[2025-10-24T01:17:32.972302] [INFO ] [MAIN      ] Derivative Progress: 123/2164 symbols completed. AQN took 1.3s. Estimated remaining: 14m 22s. Rate: 142.1 symbols/min
[2025-10-24T01:17:32.972542] [INFO ] [MAIN      ] ARDC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:32.992040] [DEBUG] [LOCAL     ] AR: Loaded 53980 existing records from primary storage.
[2025-10-24T01:17:32.992307] [INFO ] [MAIN      ] AR: Loaded 53980 primary data records.
[2025-10-24T01:17:33.122106] [DEBUG] [LOCAL     ] ARDC: Loaded 15301 existing records from primary storage.
[2025-10-24T01:17:33.137938] [INFO ] [MAIN      ] ARDC: Loaded 15301 primary data records.
[2025-10-24T01:17:33.429192] [DEBUG] [LOCAL     ] ARCO: Loaded 44509 existing records from primary storage.
[2025-10-24T01:17:33.446281] [INFO ] [MAIN      ] ARCO: Loaded 44509 primary data records.
[2025-10-24T01:17:34.009443] [DEBUG] [MAIN      ] AR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:34.055137] [DEBUG] [MAIN      ] ARDC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:34.104906] [DEBUG] [MAIN      ] ARCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:34.108273] [INFO ] [MAIN      ] AR: Generated 139 derivative records from 53980 primary records.
[2025-10-24T01:17:34.121970] [DEBUG] [LOCAL     ] AR: Saving derivative data.
[2025-10-24T01:17:34.138293] [DEBUG] [LOCAL     ] AR: Derivative data saved (139 records).
[2025-10-24T01:17:34.138441] [INFO ] [MAIN      ] AR: Successfully saved derivative data.
[2025-10-24T01:17:34.146544] [INFO ] [MAIN      ] Derivative Progress: 124/2164 symbols completed. AR took 1.3s. Estimated remaining: 14m 34s. Rate: 140.1 symbols/min
[2025-10-24T01:17:34.152115] [INFO ] [MAIN      ] ARDT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:34.190551] [INFO ] [MAIN      ] ARCO: Generated 139 derivative records from 44509 primary records.
[2025-10-24T01:17:34.194241] [DEBUG] [LOCAL     ] ARCO: Saving derivative data.
[2025-10-24T01:17:34.196607] [INFO ] [MAIN      ] ARDC: Generated 139 derivative records from 15301 primary records.
[2025-10-24T01:17:34.216279] [DEBUG] [LOCAL     ] ARDT: Loaded 27612 existing records from primary storage.
[2025-10-24T01:17:34.216353] [DEBUG] [LOCAL     ] ARCO: Derivative data saved (139 records).
[2025-10-24T01:17:34.216463] [DEBUG] [LOCAL     ] ARDC: Saving derivative data.
[2025-10-24T01:17:34.217007] [INFO ] [MAIN      ] ARDT: Loaded 27612 primary data records.
[2025-10-24T01:17:34.217272] [INFO ] [MAIN      ] ARCO: Successfully saved derivative data.
[2025-10-24T01:17:34.221466] [INFO ] [MAIN      ] Derivative Progress: 125/2164 symbols completed. ARCO took 1.3s. Estimated remaining: 14m 27s. Rate: 141.1 symbols/min
[2025-10-24T01:17:34.256212] [INFO ] [MAIN      ] ARE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:34.269765] [DEBUG] [LOCAL     ] ARDC: Derivative data saved (139 records).
[2025-10-24T01:17:34.278528] [INFO ] [MAIN      ] ARDC: Successfully saved derivative data.
[2025-10-24T01:17:34.304930] [INFO ] [MAIN      ] Derivative Progress: 126/2164 symbols completed. ARDC took 1.3s. Estimated remaining: 14m 21s. Rate: 142.0 symbols/min
[2025-10-24T01:17:34.314341] [INFO ] [MAIN      ] ARES: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:34.606449] [DEBUG] [LOCAL     ] ARE: Loaded 51277 existing records from primary storage.
[2025-10-24T01:17:34.607110] [INFO ] [MAIN      ] ARE: Loaded 51277 primary data records.
[2025-10-24T01:17:34.774056] [DEBUG] [LOCAL     ] ARES: Loaded 50046 existing records from primary storage.
[2025-10-24T01:17:34.773020] [DEBUG] [MAIN      ] ARDT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:34.779380] [INFO ] [MAIN      ] ARES: Loaded 50046 primary data records.
[2025-10-24T01:17:35.303810] [INFO ] [MAIN      ] ARDT: Generated 139 derivative records from 27612 primary records.
[2025-10-24T01:17:35.304671] [DEBUG] [LOCAL     ] ARDT: Saving derivative data.
[2025-10-24T01:17:35.320607] [DEBUG] [LOCAL     ] ARDT: Derivative data saved (139 records).
[2025-10-24T01:17:35.321614] [INFO ] [MAIN      ] ARDT: Successfully saved derivative data.
[2025-10-24T01:17:35.325685] [INFO ] [MAIN      ] Derivative Progress: 127/2164 symbols completed. ARDT took 1.2s. Estimated remaining: 14m 31s. Rate: 140.4 symbols/min
[2025-10-24T01:17:35.325931] [INFO ] [MAIN      ] ARI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:35.347631] [DEBUG] [MAIN      ] ARE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:35.375863] [DEBUG] [MAIN      ] ARES: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:35.438387] [DEBUG] [LOCAL     ] ARI: Loaded 43804 existing records from primary storage.
[2025-10-24T01:17:35.443877] [INFO ] [MAIN      ] ARI: Loaded 43804 primary data records.
[2025-10-24T01:17:35.564538] [INFO ] [MAIN      ] ARE: Generated 139 derivative records from 51277 primary records.
[2025-10-24T01:17:35.575266] [DEBUG] [LOCAL     ] ARE: Saving derivative data.
[2025-10-24T01:17:35.632083] [DEBUG] [LOCAL     ] ARE: Derivative data saved (139 records).
[2025-10-24T01:17:35.654181] [INFO ] [MAIN      ] ARE: Successfully saved derivative data.
[2025-10-24T01:17:35.656941] [INFO ] [MAIN      ] Derivative Progress: 128/2164 symbols completed. ARE took 1.4s. Estimated remaining: 14m 29s. Rate: 140.6 symbols/min
[2025-10-24T01:17:35.761495] [INFO ] [MAIN      ] ARES: Generated 139 derivative records from 50046 primary records.
[2025-10-24T01:17:35.775360] [DEBUG] [LOCAL     ] ARES: Saving derivative data.
[2025-10-24T01:17:35.775762] [INFO ] [MAIN      ] ARLO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:35.791436] [DEBUG] [LOCAL     ] ARES: Derivative data saved (139 records).
[2025-10-24T01:17:35.792594] [INFO ] [MAIN      ] ARES: Successfully saved derivative data.
[2025-10-24T01:17:35.795735] [INFO ] [MAIN      ] Derivative Progress: 129/2164 symbols completed. ARES took 1.5s. Estimated remaining: 14m 24s. Rate: 141.4 symbols/min
[2025-10-24T01:17:35.796022] [INFO ] [MAIN      ] ARMK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:35.821450] [DEBUG] [MAIN      ] ARI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:35.886137] [DEBUG] [LOCAL     ] ARLO: Loaded 43851 existing records from primary storage.
[2025-10-24T01:17:35.901078] [INFO ] [MAIN      ] ARLO: Loaded 43851 primary data records.
[2025-10-24T01:17:35.943048] [DEBUG] [LOCAL     ] ARMK: Loaded 50743 existing records from primary storage.
[2025-10-24T01:17:35.967851] [INFO ] [MAIN      ] ARMK: Loaded 50743 primary data records.
[2025-10-24T01:17:36.555798] [INFO ] [MAIN      ] ARI: Generated 139 derivative records from 43804 primary records.
[2025-10-24T01:17:36.569814] [DEBUG] [LOCAL     ] ARI: Saving derivative data.
[2025-10-24T01:17:36.584085] [DEBUG] [LOCAL     ] ARI: Derivative data saved (139 records).
[2025-10-24T01:17:36.585293] [INFO ] [MAIN      ] ARI: Successfully saved derivative data.
[2025-10-24T01:17:36.587781] [INFO ] [MAIN      ] Derivative Progress: 130/2164 symbols completed. ARI took 1.3s. Estimated remaining: 14m 29s. Rate: 140.4 symbols/min
[2025-10-24T01:17:36.588260] [INFO ] [MAIN      ] AROC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:36.616709] [DEBUG] [MAIN      ] ARLO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:36.655057] [DEBUG] [MAIN      ] ARMK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:36.698278] [DEBUG] [LOCAL     ] AROC: Loaded 49443 existing records from primary storage.
[2025-10-24T01:17:36.704499] [INFO ] [MAIN      ] AROC: Loaded 49443 primary data records.
[2025-10-24T01:17:36.862698] [INFO ] [MAIN      ] ARLO: Generated 139 derivative records from 43851 primary records.
[2025-10-24T01:17:36.876962] [INFO ] [MAIN      ] ARMK: Generated 139 derivative records from 50743 primary records.
[2025-10-24T01:17:36.895886] [DEBUG] [LOCAL     ] ARLO: Saving derivative data.
[2025-10-24T01:17:36.895998] [DEBUG] [LOCAL     ] ARMK: Saving derivative data.
[2025-10-24T01:17:37.066910] [DEBUG] [LOCAL     ] ARMK: Derivative data saved (139 records).
[2025-10-24T01:17:37.072764] [INFO ] [MAIN      ] ARMK: Successfully saved derivative data.
[2025-10-24T01:17:37.076154] [DEBUG] [LOCAL     ] ARLO: Derivative data saved (139 records).
[2025-10-24T01:17:37.079198] [INFO ] [MAIN      ] Derivative Progress: 131/2164 symbols completed. ARMK took 1.3s. Estimated remaining: 14m 30s. Rate: 140.3 symbols/min
[2025-10-24T01:17:37.093823] [INFO ] [MAIN      ] ARLO: Successfully saved derivative data.
[2025-10-24T01:17:37.094470] [INFO ] [MAIN      ] ARR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:37.097547] [INFO ] [MAIN      ] Derivative Progress: 132/2164 symbols completed. ARLO took 1.3s. Estimated remaining: 14m 23s. Rate: 141.3 symbols/min
[2025-10-24T01:17:37.098508] [INFO ] [MAIN      ] ARW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:37.135793] [DEBUG] [MAIN      ] AROC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:37.181040] [DEBUG] [LOCAL     ] ARW: Loaded 33415 existing records from primary storage.
[2025-10-24T01:17:37.184173] [INFO ] [MAIN      ] ARW: Loaded 33415 primary data records.
[2025-10-24T01:17:37.315129] [DEBUG] [LOCAL     ] ARR: Loaded 52475 existing records from primary storage.
[2025-10-24T01:17:37.316532] [INFO ] [MAIN      ] ARR: Loaded 52475 primary data records.
[2025-10-24T01:17:37.571056] [INFO ] [MAIN      ] AROC: Generated 139 derivative records from 49443 primary records.
[2025-10-24T01:17:37.610468] [DEBUG] [LOCAL     ] AROC: Saving derivative data.
[2025-10-24T01:17:37.802370] [DEBUG] [LOCAL     ] AROC: Derivative data saved (139 records).
[2025-10-24T01:17:37.815810] [INFO ] [MAIN      ] AROC: Successfully saved derivative data.
[2025-10-24T01:17:37.818491] [INFO ] [MAIN      ] Derivative Progress: 133/2164 symbols completed. AROC took 1.2s. Estimated remaining: 14m 27s. Rate: 140.6 symbols/min
[2025-10-24T01:17:37.841678] [DEBUG] [MAIN      ] ARW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:37.881002] [DEBUG] [MAIN      ] ARR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:37.900918] [INFO ] [MAIN      ] ARW: Generated 139 derivative records from 33415 primary records.
[2025-10-24T01:17:37.904352] [DEBUG] [LOCAL     ] ARW: Saving derivative data.
[2025-10-24T01:17:37.923499] [DEBUG] [LOCAL     ] ARW: Derivative data saved (139 records).
[2025-10-24T01:17:37.923821] [INFO ] [MAIN      ] ARW: Successfully saved derivative data.
[2025-10-24T01:17:37.925931] [INFO ] [MAIN      ] Derivative Progress: 134/2164 symbols completed. ARW took 0.8s. Estimated remaining: 14m 22s. Rate: 141.4 symbols/min
[2025-10-24T01:17:37.932011] [INFO ] [MAIN      ] ARR: Generated 139 derivative records from 52475 primary records.
[2025-10-24T01:17:37.932102] [DEBUG] [LOCAL     ] ARR: Saving derivative data.
[2025-10-24T01:17:37.943855] [DEBUG] [LOCAL     ] ARR: Derivative data saved (139 records).
[2025-10-24T01:17:37.943942] [INFO ] [MAIN      ] ARR: Successfully saved derivative data.
[2025-10-24T01:17:37.946469] [INFO ] [MAIN      ] Derivative Progress: 135/2164 symbols completed. ARR took 0.9s. Estimated remaining: 14m 15s. Rate: 142.4 symbols/min
[2025-10-24T01:17:37.947121] [INFO ] [MAIN      ] AS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:37.947243] [INFO ] [MAIN      ] ASA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:37.947710] [INFO ] [MAIN      ] ASAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:37.968171] [DEBUG] [LOCAL     ] ASA: Loaded 15779 existing records from primary storage.
[2025-10-24T01:17:37.968337] [INFO ] [MAIN      ] ASA: Loaded 15779 primary data records.
[2025-10-24T01:17:38.334694] [DEBUG] [LOCAL     ] AS: Loaded 53587 existing records from primary storage.
[2025-10-24T01:17:38.335017] [INFO ] [MAIN      ] AS: Loaded 53587 primary data records.
[2025-10-24T01:17:38.432573] [DEBUG] [LOCAL     ] ASAN: Loaded 53116 existing records from primary storage.
[2025-10-24T01:17:38.454836] [INFO ] [MAIN      ] ASAN: Loaded 53116 primary data records.
[2025-10-24T01:17:38.960382] [DEBUG] [MAIN      ] ASA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:39.011368] [DEBUG] [MAIN      ] AS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:39.053262] [INFO ] [MAIN      ] ASA: Generated 139 derivative records from 15779 primary records.
[2025-10-24T01:17:39.052720] [DEBUG] [MAIN      ] ASAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:39.054550] [DEBUG] [LOCAL     ] ASA: Saving derivative data.
[2025-10-24T01:17:39.083630] [DEBUG] [LOCAL     ] ASA: Derivative data saved (139 records).
[2025-10-24T01:17:39.083967] [INFO ] [MAIN      ] ASA: Successfully saved derivative data.
[2025-10-24T01:17:39.086525] [INFO ] [MAIN      ] Derivative Progress: 136/2164 symbols completed. ASA took 1.1s. Estimated remaining: 14m 25s. Rate: 140.6 symbols/min
[2025-10-24T01:17:39.089362] [INFO ] [MAIN      ] ASB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:39.115737] [INFO ] [MAIN      ] AS: Generated 139 derivative records from 53587 primary records.
[2025-10-24T01:17:39.119503] [DEBUG] [LOCAL     ] AS: Saving derivative data.
[2025-10-24T01:17:39.134505] [INFO ] [MAIN      ] ASAN: Generated 139 derivative records from 53116 primary records.
[2025-10-24T01:17:39.136409] [DEBUG] [LOCAL     ] ASAN: Saving derivative data.
[2025-10-24T01:17:39.148516] [DEBUG] [LOCAL     ] AS: Derivative data saved (139 records).
[2025-10-24T01:17:39.149148] [INFO ] [MAIN      ] AS: Successfully saved derivative data.
[2025-10-24T01:17:39.151508] [INFO ] [MAIN      ] Derivative Progress: 137/2164 symbols completed. AS took 1.2s. Estimated remaining: 14m 20s. Rate: 141.5 symbols/min
[2025-10-24T01:17:39.161715] [INFO ] [MAIN      ] ASBA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:39.188860] [DEBUG] [LOCAL     ] ASAN: Derivative data saved (139 records).
[2025-10-24T01:17:39.190123] [DEBUG] [LOCAL     ] ASB: Loaded 50074 existing records from primary storage.
[2025-10-24T01:17:39.190301] [INFO ] [MAIN      ] ASAN: Successfully saved derivative data.
[2025-10-24T01:17:39.192815] [DEBUG] [LOCAL     ] ASBA: Loaded 3490 existing records from primary storage.
[2025-10-24T01:17:39.192902] [INFO ] [MAIN      ] ASB: Loaded 50074 primary data records.
[2025-10-24T01:17:39.195951] [INFO ] [MAIN      ] ASBA: Loaded 3490 primary data records.
[2025-10-24T01:17:39.195861] [INFO ] [MAIN      ] Derivative Progress: 138/2164 symbols completed. ASAN took 1.2s. Estimated remaining: 14m 14s. Rate: 142.4 symbols/min
[2025-10-24T01:17:39.196597] [INFO ] [MAIN      ] ASC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:39.763512] [DEBUG] [LOCAL     ] ASC: Loaded 37473 existing records from primary storage.
[2025-10-24T01:17:39.877527] [INFO ] [MAIN      ] ASC: Loaded 37473 primary data records.
[2025-10-24T01:17:40.209109] [DEBUG] [MAIN      ] ASBA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:40.237790] [DEBUG] [MAIN      ] ASB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:40.346769] [DEBUG] [MAIN      ] ASC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:40.386674] [INFO ] [MAIN      ] ASBA: Generated 139 derivative records from 3490 primary records.
[2025-10-24T01:17:40.388881] [DEBUG] [LOCAL     ] ASBA: Saving derivative data.
[2025-10-24T01:17:40.406343] [DEBUG] [LOCAL     ] ASBA: Derivative data saved (139 records).
[2025-10-24T01:17:40.406885] [INFO ] [MAIN      ] ASBA: Successfully saved derivative data.
[2025-10-24T01:17:40.409552] [INFO ] [MAIN      ] Derivative Progress: 139/2164 symbols completed. ASBA took 1.2s. Estimated remaining: 14m 25s. Rate: 140.5 symbols/min
[2025-10-24T01:17:40.411518] [INFO ] [MAIN      ] ASG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:40.412586] [INFO ] [MAIN      ] ASB: Generated 139 derivative records from 50074 primary records.
[2025-10-24T01:17:40.412907] [DEBUG] [LOCAL     ] ASB: Saving derivative data.
[2025-10-24T01:17:40.428792] [DEBUG] [LOCAL     ] ASB: Derivative data saved (139 records).
[2025-10-24T01:17:40.430456] [INFO ] [MAIN      ] ASB: Successfully saved derivative data.
[2025-10-24T01:17:40.434480] [INFO ] [MAIN      ] Derivative Progress: 140/2164 symbols completed. ASB took 1.3s. Estimated remaining: 14m 19s. Rate: 141.5 symbols/min
[2025-10-24T01:17:40.434750] [INFO ] [MAIN      ] ASGI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:40.447481] [INFO ] [MAIN      ] ASC: Generated 139 derivative records from 37473 primary records.
[2025-10-24T01:17:40.448416] [DEBUG] [LOCAL     ] ASC: Saving derivative data.
[2025-10-24T01:17:40.455634] [DEBUG] [LOCAL     ] ASG: Loaded 19473 existing records from primary storage.
[2025-10-24T01:17:40.455948] [INFO ] [MAIN      ] ASG: Loaded 19473 primary data records.
[2025-10-24T01:17:40.555914] [DEBUG] [LOCAL     ] ASC: Derivative data saved (139 records).
[2025-10-24T01:17:40.577595] [INFO ] [MAIN      ] ASC: Successfully saved derivative data.
[2025-10-24T01:17:40.580430] [INFO ] [MAIN      ] Derivative Progress: 141/2164 symbols completed. ASC took 1.4s. Estimated remaining: 14m 14s. Rate: 142.1 symbols/min
[2025-10-24T01:17:40.606723] [INFO ] [MAIN      ] ASGN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:40.623778] [DEBUG] [LOCAL     ] ASGI: Loaded 23093 existing records from primary storage.
[2025-10-24T01:17:40.623983] [INFO ] [MAIN      ] ASGI: Loaded 23093 primary data records.
[2025-10-24T01:17:41.160478] [DEBUG] [LOCAL     ] ASGN: Loaded 37036 existing records from primary storage.
[2025-10-24T01:17:41.161114] [INFO ] [MAIN      ] ASGN: Loaded 37036 primary data records.
[2025-10-24T01:17:41.468590] [DEBUG] [MAIN      ] ASG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:41.528556] [DEBUG] [MAIN      ] ASGI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:41.555351] [INFO ] [MAIN      ] ASG: Generated 139 derivative records from 19473 primary records.
[2025-10-24T01:17:41.562639] [DEBUG] [LOCAL     ] ASG: Saving derivative data.
[2025-10-24T01:17:41.591292] [DEBUG] [LOCAL     ] ASG: Derivative data saved (139 records).
[2025-10-24T01:17:41.588551] [DEBUG] [MAIN      ] ASGN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:41.592899] [INFO ] [MAIN      ] ASG: Successfully saved derivative data.
[2025-10-24T01:17:41.609309] [INFO ] [MAIN      ] Derivative Progress: 142/2164 symbols completed. ASG took 1.2s. Estimated remaining: 14m 22s. Rate: 140.7 symbols/min
[2025-10-24T01:17:41.610940] [INFO ] [MAIN      ] ASH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:41.632816] [INFO ] [MAIN      ] ASGI: Generated 139 derivative records from 23093 primary records.
[2025-10-24T01:17:41.636583] [DEBUG] [LOCAL     ] ASGI: Saving derivative data.
[2025-10-24T01:17:41.656599] [DEBUG] [LOCAL     ] ASGI: Derivative data saved (139 records).
[2025-10-24T01:17:41.668473] [INFO ] [MAIN      ] ASGI: Successfully saved derivative data.
[2025-10-24T01:17:41.672098] [INFO ] [MAIN      ] Derivative Progress: 143/2164 symbols completed. ASGI took 1.2s. Estimated remaining: 14m 17s. Rate: 141.5 symbols/min
[2025-10-24T01:17:41.674686] [INFO ] [MAIN      ] ASIX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:41.674935] [INFO ] [MAIN      ] ASGN: Generated 139 derivative records from 37036 primary records.
[2025-10-24T01:17:41.675385] [DEBUG] [LOCAL     ] ASGN: Saving derivative data.
[2025-10-24T01:17:41.701559] [DEBUG] [LOCAL     ] ASGN: Derivative data saved (139 records).
[2025-10-24T01:17:41.702738] [INFO ] [MAIN      ] ASGN: Successfully saved derivative data.
[2025-10-24T01:17:41.702631] [DEBUG] [LOCAL     ] ASH: Loaded 37640 existing records from primary storage.
[2025-10-24T01:17:41.705419] [INFO ] [MAIN      ] Derivative Progress: 144/2164 symbols completed. ASGN took 1.1s. Estimated remaining: 14m 11s. Rate: 142.4 symbols/min
[2025-10-24T01:17:41.705578] [INFO ] [MAIN      ] ASH: Loaded 37640 primary data records.
[2025-10-24T01:17:41.705894] [INFO ] [MAIN      ] ASPN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:41.817959] [DEBUG] [LOCAL     ] ASIX: Loaded 23134 existing records from primary storage.
[2025-10-24T01:17:41.830584] [INFO ] [MAIN      ] ASIX: Loaded 23134 primary data records.
[2025-10-24T01:17:42.173162] [DEBUG] [LOCAL     ] ASPN: Loaded 50218 existing records from primary storage.
[2025-10-24T01:17:42.203027] [INFO ] [MAIN      ] ASPN: Loaded 50218 primary data records.
[2025-10-24T01:17:42.723773] [DEBUG] [MAIN      ] ASH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:42.759078] [DEBUG] [MAIN      ] ASIX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:42.798084] [DEBUG] [MAIN      ] ASPN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:42.834470] [INFO ] [MAIN      ] ASH: Generated 139 derivative records from 37640 primary records.
[2025-10-24T01:17:42.837164] [DEBUG] [LOCAL     ] ASH: Saving derivative data.
[2025-10-24T01:17:42.854610] [DEBUG] [LOCAL     ] ASH: Derivative data saved (139 records).
[2025-10-24T01:17:42.855133] [INFO ] [MAIN      ] ASH: Successfully saved derivative data.
[2025-10-24T01:17:42.857416] [INFO ] [MAIN      ] Derivative Progress: 145/2164 symbols completed. ASH took 1.2s. Estimated remaining: 14m 21s. Rate: 140.8 symbols/min
[2025-10-24T01:17:42.861510] [INFO ] [MAIN      ] ASR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:42.869554] [INFO ] [MAIN      ] ASIX: Generated 139 derivative records from 23134 primary records.
[2025-10-24T01:17:42.870114] [DEBUG] [LOCAL     ] ASIX: Saving derivative data.
[2025-10-24T01:17:42.872362] [INFO ] [MAIN      ] ASPN: Generated 139 derivative records from 50218 primary records.
[2025-10-24T01:17:42.886187] [DEBUG] [LOCAL     ] ASIX: Derivative data saved (139 records).
[2025-10-24T01:17:42.883524] [DEBUG] [LOCAL     ] ASPN: Saving derivative data.
[2025-10-24T01:17:42.886421] [INFO ] [MAIN      ] ASIX: Successfully saved derivative data.
[2025-10-24T01:17:42.893094] [INFO ] [MAIN      ] Derivative Progress: 146/2164 symbols completed. ASIX took 1.2s. Estimated remaining: 14m 15s. Rate: 141.7 symbols/min
[2025-10-24T01:17:42.893524] [DEBUG] [LOCAL     ] ASR: Loaded 9477 existing records from primary storage.
[2025-10-24T01:17:42.900701] [INFO ] [MAIN      ] ASR: Loaded 9477 primary data records.
[2025-10-24T01:17:42.900876] [INFO ] [MAIN      ] ASX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:42.969894] [DEBUG] [LOCAL     ] ASPN: Derivative data saved (139 records).
[2025-10-24T01:17:42.986835] [INFO ] [MAIN      ] ASPN: Successfully saved derivative data.
[2025-10-24T01:17:43.001623] [INFO ] [MAIN      ] Derivative Progress: 147/2164 symbols completed. ASPN took 1.3s. Estimated remaining: 14m 10s. Rate: 142.4 symbols/min
[2025-10-24T01:17:43.009381] [INFO ] [MAIN      ] ATEN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:43.245329] [DEBUG] [LOCAL     ] ATEN: Loaded 37929 existing records from primary storage.
[2025-10-24T01:17:43.247472] [INFO ] [MAIN      ] ATEN: Loaded 37929 primary data records.
[2025-10-24T01:17:43.293375] [DEBUG] [LOCAL     ] ASX: Loaded 53258 existing records from primary storage.
[2025-10-24T01:17:43.331328] [INFO ] [MAIN      ] ASX: Loaded 53258 primary data records.
[2025-10-24T01:17:43.586982] [DEBUG] [MAIN      ] ASR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:44.012032] [INFO ] [MAIN      ] ASR: Generated 139 derivative records from 9477 primary records.
[2025-10-24T01:17:44.012508] [DEBUG] [LOCAL     ] ASR: Saving derivative data.
[2025-10-24T01:17:44.028961] [DEBUG] [LOCAL     ] ASR: Derivative data saved (139 records).
[2025-10-24T01:17:44.029614] [INFO ] [MAIN      ] ASR: Successfully saved derivative data.
[2025-10-24T01:17:44.032163] [INFO ] [MAIN      ] Derivative Progress: 148/2164 symbols completed. ASR took 1.2s. Estimated remaining: 14m 18s. Rate: 141.0 symbols/min
[2025-10-24T01:17:44.045499] [DEBUG] [MAIN      ] ATEN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:44.092529] [DEBUG] [MAIN      ] ASX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:44.118209] [INFO ] [MAIN      ] ATEN: Generated 139 derivative records from 37929 primary records.
[2025-10-24T01:17:44.121489] [DEBUG] [LOCAL     ] ATEN: Saving derivative data.
[2025-10-24T01:17:44.138688] [DEBUG] [LOCAL     ] ATEN: Derivative data saved (139 records).
[2025-10-24T01:17:44.139127] [INFO ] [MAIN      ] ATEN: Successfully saved derivative data.
[2025-10-24T01:17:44.141822] [INFO ] [MAIN      ] Derivative Progress: 149/2164 symbols completed. ATEN took 1.1s. Estimated remaining: 14m 13s. Rate: 141.7 symbols/min
[2025-10-24T01:17:44.150805] [INFO ] [MAIN      ] ASX: Generated 139 derivative records from 53258 primary records.
[2025-10-24T01:17:44.151009] [DEBUG] [LOCAL     ] ASX: Saving derivative data.
[2025-10-24T01:17:44.164133] [DEBUG] [LOCAL     ] ASX: Derivative data saved (139 records).
[2025-10-24T01:17:44.164239] [INFO ] [MAIN      ] ASX: Successfully saved derivative data.
[2025-10-24T01:17:44.167997] [INFO ] [MAIN      ] Derivative Progress: 150/2164 symbols completed. ASX took 1.3s. Estimated remaining: 14m 7s. Rate: 142.6 symbols/min
[2025-10-24T01:17:44.168582] [INFO ] [MAIN      ] ATGE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:44.168856] [INFO ] [MAIN      ] ATHS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:44.168712] [INFO ] [MAIN      ] ATHM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:44.183041] [DEBUG] [LOCAL     ] ATHS: Loaded 6531 existing records from primary storage.
[2025-10-24T01:17:44.183345] [INFO ] [MAIN      ] ATHS: Loaded 6531 primary data records.
[2025-10-24T01:17:44.411467] [DEBUG] [LOCAL     ] ATHM: Loaded 31467 existing records from primary storage.
[2025-10-24T01:17:44.416146] [INFO ] [MAIN      ] ATHM: Loaded 31467 primary data records.
[2025-10-24T01:17:44.520496] [DEBUG] [LOCAL     ] ATGE: Loaded 30576 existing records from primary storage.
[2025-10-24T01:17:44.574537] [INFO ] [MAIN      ] ATGE: Loaded 30576 primary data records.
[2025-10-24T01:17:45.241978] [DEBUG] [MAIN      ] ATHS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:45.288824] [DEBUG] [MAIN      ] ATHM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:45.335592] [DEBUG] [MAIN      ] ATGE: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:17:45.398518] [INFO ] [MAIN      ] ATHS: Generated 139 derivative records from 6531 primary records.
[2025-10-24T01:17:45.401343] [DEBUG] [LOCAL     ] ATHS: Saving derivative data.
[2025-10-24T01:17:45.401811] [INFO ] [MAIN      ] ATHM: Generated 139 derivative records from 31467 primary records.
[2025-10-24T01:17:45.404432] [DEBUG] [LOCAL     ] ATHM: Saving derivative data.
[2025-10-24T01:17:45.419806] [DEBUG] [LOCAL     ] ATHS: Derivative data saved (139 records).
[2025-10-24T01:17:45.420681] [INFO ] [MAIN      ] ATHS: Successfully saved derivative data.
[2025-10-24T01:17:45.430335] [INFO ] [MAIN      ] Derivative Progress: 151/2164 symbols completed. ATHS took 1.3s. Estimated remaining: 14m 18s. Rate: 140.7 symbols/min
[2025-10-24T01:17:45.433373] [INFO ] [MAIN      ] ATI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:45.440691] [DEBUG] [LOCAL     ] ATHM: Derivative data saved (139 records).
[2025-10-24T01:17:45.443395] [INFO ] [MAIN      ] ATHM: Successfully saved derivative data.
[2025-10-24T01:17:45.447442] [INFO ] [MAIN      ] Derivative Progress: 152/2164 symbols completed. ATHM took 1.3s. Estimated remaining: 14m 12s. Rate: 141.6 symbols/min
[2025-10-24T01:17:45.447797] [INFO ] [MAIN      ] ATKR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:45.452610] [INFO ] [MAIN      ] ATGE: Generated 139 derivative records from 30576 primary records.
[2025-10-24T01:17:45.452974] [DEBUG] [LOCAL     ] ATGE: Saving derivative data.
[2025-10-24T01:17:45.466837] [DEBUG] [LOCAL     ] ATGE: Derivative data saved (139 records).
[2025-10-24T01:17:45.466939] [INFO ] [MAIN      ] ATGE: Successfully saved derivative data.
[2025-10-24T01:17:45.469368] [INFO ] [MAIN      ] Derivative Progress: 153/2164 symbols completed. ATGE took 1.3s. Estimated remaining: 14m 7s. Rate: 142.5 symbols/min
[2025-10-24T01:17:45.469785] [INFO ] [MAIN      ] ATMU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:45.540613] [DEBUG] [LOCAL     ] ATKR: Loaded 35023 existing records from primary storage.
[2025-10-24T01:17:45.541972] [INFO ] [MAIN      ] ATKR: Loaded 35023 primary data records.
[2025-10-24T01:17:45.541585] [DEBUG] [LOCAL     ] ATI: Loaded 51668 existing records from primary storage.
[2025-10-24T01:17:45.542635] [INFO ] [MAIN      ] ATI: Loaded 51668 primary data records.
[2025-10-24T01:17:45.655939] [DEBUG] [LOCAL     ] ATMU: Loaded 38930 existing records from primary storage.
[2025-10-24T01:17:45.688794] [INFO ] [MAIN      ] ATMU: Loaded 38930 primary data records.
[2025-10-24T01:17:46.624796] [DEBUG] [MAIN      ] ATKR: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:17:46.681877] [DEBUG] [MAIN      ] ATI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:46.696489] [DEBUG] [MAIN      ] ATMU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:46.743711] [INFO ] [MAIN      ] ATKR: Generated 139 derivative records from 35023 primary records.
[2025-10-24T01:17:46.750924] [DEBUG] [LOCAL     ] ATKR: Saving derivative data.
[2025-10-24T01:17:46.770028] [DEBUG] [LOCAL     ] ATKR: Derivative data saved (139 records).
[2025-10-24T01:17:46.770590] [INFO ] [MAIN      ] ATKR: Successfully saved derivative data.
[2025-10-24T01:17:46.772918] [INFO ] [MAIN      ] Derivative Progress: 154/2164 symbols completed. ATKR took 1.3s. Estimated remaining: 14m 18s. Rate: 140.6 symbols/min
[2025-10-24T01:17:46.774368] [INFO ] [MAIN      ] ATO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:46.789992] [INFO ] [MAIN      ] ATMU: Generated 139 derivative records from 38930 primary records.
[2025-10-24T01:17:46.787920] [INFO ] [MAIN      ] ATI: Generated 139 derivative records from 51668 primary records.
[2025-10-24T01:17:46.790235] [DEBUG] [LOCAL     ] ATI: Saving derivative data.
[2025-10-24T01:17:46.790942] [DEBUG] [LOCAL     ] ATMU: Saving derivative data.
[2025-10-24T01:17:46.816050] [DEBUG] [LOCAL     ] ATI: Derivative data saved (139 records).
[2025-10-24T01:17:46.815953] [DEBUG] [LOCAL     ] ATMU: Derivative data saved (139 records).
[2025-10-24T01:17:46.816339] [INFO ] [MAIN      ] ATMU: Successfully saved derivative data.
[2025-10-24T01:17:46.816596] [INFO ] [MAIN      ] ATI: Successfully saved derivative data.
[2025-10-24T01:17:46.820589] [INFO ] [MAIN      ] Derivative Progress: 155/2164 symbols completed. ATMU took 1.4s. Estimated remaining: 14m 12s. Rate: 141.4 symbols/min
[2025-10-24T01:17:46.823940] [INFO ] [MAIN      ] ATR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:46.824040] [INFO ] [MAIN      ] Derivative Progress: 156/2164 symbols completed. ATI took 1.4s. Estimated remaining: 14m 7s. Rate: 142.3 symbols/min
[2025-10-24T01:17:46.824714] [INFO ] [MAIN      ] ATS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:46.870603] [DEBUG] [LOCAL     ] ATS: Loaded 17109 existing records from primary storage.
[2025-10-24T01:17:46.871034] [INFO ] [MAIN      ] ATS: Loaded 17109 primary data records.
[2025-10-24T01:17:46.880411] [DEBUG] [LOCAL     ] ATO: Loaded 41787 existing records from primary storage.
[2025-10-24T01:17:46.892921] [INFO ] [MAIN      ] ATO: Loaded 41787 primary data records.
[2025-10-24T01:17:47.114747] [DEBUG] [LOCAL     ] ATR: Loaded 30587 existing records from primary storage.
[2025-10-24T01:17:47.137111] [INFO ] [MAIN      ] ATR: Loaded 30587 primary data records.
[2025-10-24T01:17:47.949554] [DEBUG] [MAIN      ] ATO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:47.961967] [DEBUG] [MAIN      ] ATS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:48.001151] [DEBUG] [MAIN      ] ATR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:48.075814] [INFO ] [MAIN      ] ATO: Generated 139 derivative records from 41787 primary records.
[2025-10-24T01:17:48.081795] [DEBUG] [LOCAL     ] ATO: Saving derivative data.
[2025-10-24T01:17:48.098138] [DEBUG] [LOCAL     ] ATO: Derivative data saved (139 records).
[2025-10-24T01:17:48.098304] [INFO ] [MAIN      ] ATO: Successfully saved derivative data.
[2025-10-24T01:17:48.101615] [INFO ] [MAIN      ] Derivative Progress: 157/2164 symbols completed. ATO took 1.3s. Estimated remaining: 14m 17s. Rate: 140.5 symbols/min
[2025-10-24T01:17:48.107496] [INFO ] [MAIN      ] ATS: Generated 139 derivative records from 17109 primary records.
[2025-10-24T01:17:48.107913] [INFO ] [MAIN      ] ATUS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:48.107809] [DEBUG] [LOCAL     ] ATS: Saving derivative data.
[2025-10-24T01:17:48.113683] [INFO ] [MAIN      ] ATR: Generated 139 derivative records from 30587 primary records.
[2025-10-24T01:17:48.121063] [DEBUG] [LOCAL     ] ATR: Saving derivative data.
[2025-10-24T01:17:48.126557] [DEBUG] [LOCAL     ] ATS: Derivative data saved (139 records).
[2025-10-24T01:17:48.127001] [INFO ] [MAIN      ] ATS: Successfully saved derivative data.
[2025-10-24T01:17:48.129579] [INFO ] [MAIN      ] Derivative Progress: 158/2164 symbols completed. ATS took 1.3s. Estimated remaining: 14m 12s. Rate: 141.3 symbols/min
[2025-10-24T01:17:48.141729] [DEBUG] [LOCAL     ] ATR: Derivative data saved (139 records).
[2025-10-24T01:17:48.141871] [INFO ] [MAIN      ] ATR: Successfully saved derivative data.
[2025-10-24T01:17:48.142139] [INFO ] [MAIN      ] AU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:48.145619] [INFO ] [MAIN      ] Derivative Progress: 159/2164 symbols completed. ATR took 1.3s. Estimated remaining: 14m 6s. Rate: 142.2 symbols/min
[2025-10-24T01:17:48.146052] [INFO ] [MAIN      ] AUB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:48.187907] [DEBUG] [LOCAL     ] ATUS: Loaded 50328 existing records from primary storage.
[2025-10-24T01:17:48.188309] [INFO ] [MAIN      ] ATUS: Loaded 50328 primary data records.
[2025-10-24T01:17:48.375860] [DEBUG] [LOCAL     ] AUB: Loaded 46182 existing records from primary storage.
[2025-10-24T01:17:48.407694] [DEBUG] [LOCAL     ] AU: Loaded 53478 existing records from primary storage.
[2025-10-24T01:17:48.406300] [INFO ] [MAIN      ] AUB: Loaded 46182 primary data records.
[2025-10-24T01:17:48.409506] [INFO ] [MAIN      ] AU: Loaded 53478 primary data records.
[2025-10-24T01:17:49.351466] [DEBUG] [MAIN      ] ATUS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:49.399479] [DEBUG] [MAIN      ] AU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:49.448488] [DEBUG] [MAIN      ] AUB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:49.473512] [INFO ] [MAIN      ] ATUS: Generated 139 derivative records from 50328 primary records.
[2025-10-24T01:17:49.474066] [DEBUG] [LOCAL     ] ATUS: Saving derivative data.
[2025-10-24T01:17:49.496026] [DEBUG] [LOCAL     ] ATUS: Derivative data saved (139 records).
[2025-10-24T01:17:49.496522] [INFO ] [MAIN      ] ATUS: Successfully saved derivative data.
[2025-10-24T01:17:49.502014] [INFO ] [MAIN      ] Derivative Progress: 160/2164 symbols completed. ATUS took 1.4s. Estimated remaining: 14m 17s. Rate: 140.2 symbols/min
[2025-10-24T01:17:49.506307] [INFO ] [MAIN      ] AUNA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:49.529817] [DEBUG] [LOCAL     ] AUNA: Loaded 5285 existing records from primary storage.
[2025-10-24T01:17:49.523577] [INFO ] [MAIN      ] AU: Generated 139 derivative records from 53478 primary records.
[2025-10-24T01:17:49.530565] [INFO ] [MAIN      ] AUNA: Loaded 5285 primary data records.
[2025-10-24T01:17:49.543946] [DEBUG] [LOCAL     ] AU: Saving derivative data.
[2025-10-24T01:17:49.572088] [INFO ] [MAIN      ] AUB: Generated 139 derivative records from 46182 primary records.
[2025-10-24T01:17:49.572348] [DEBUG] [LOCAL     ] AUB: Saving derivative data.
[2025-10-24T01:17:49.637554] [DEBUG] [LOCAL     ] AU: Derivative data saved (139 records).
[2025-10-24T01:17:49.644928] [INFO ] [MAIN      ] AU: Successfully saved derivative data.
[2025-10-24T01:17:49.652871] [DEBUG] [LOCAL     ] AUB: Derivative data saved (139 records).
[2025-10-24T01:17:49.661860] [INFO ] [MAIN      ] Derivative Progress: 161/2164 symbols completed. AU took 1.5s. Estimated remaining: 14m 14s. Rate: 140.8 symbols/min
[2025-10-24T01:17:49.673826] [INFO ] [MAIN      ] AVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:49.662105] [INFO ] [MAIN      ] AUB: Successfully saved derivative data.
[2025-10-24T01:17:49.688861] [INFO ] [MAIN      ] Derivative Progress: 162/2164 symbols completed. AUB took 1.5s. Estimated remaining: 14m 8s. Rate: 141.6 symbols/min
[2025-10-24T01:17:49.735251] [INFO ] [MAIN      ] AVAL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:49.884307] [DEBUG] [LOCAL     ] AVAL: Loaded 8525 existing records from primary storage.
[2025-10-24T01:17:49.895626] [INFO ] [MAIN      ] AVAL: Loaded 8525 primary data records.
[2025-10-24T01:17:50.035835] [DEBUG] [LOCAL     ] AVA: Loaded 38535 existing records from primary storage.
[2025-10-24T01:17:50.069962] [INFO ] [MAIN      ] AVA: Loaded 38535 primary data records.
[2025-10-24T01:17:50.433305] [DEBUG] [MAIN      ] AUNA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:50.616466] [DEBUG] [MAIN      ] AVAL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:50.643934] [INFO ] [MAIN      ] AUNA: Generated 139 derivative records from 5285 primary records.
[2025-10-24T01:17:50.644067] [DEBUG] [LOCAL     ] AUNA: Saving derivative data.
[2025-10-24T01:17:50.659826] [DEBUG] [LOCAL     ] AUNA: Derivative data saved (139 records).
[2025-10-24T01:17:50.660184] [INFO ] [MAIN      ] AUNA: Successfully saved derivative data.
[2025-10-24T01:17:50.678921] [INFO ] [MAIN      ] Derivative Progress: 163/2164 symbols completed. AUNA took 1.2s. Estimated remaining: 14m 15s. Rate: 140.5 symbols/min
[2025-10-24T01:17:50.679619] [DEBUG] [MAIN      ] AVA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:50.716535] [INFO ] [MAIN      ] AVAL: Generated 139 derivative records from 8525 primary records.
[2025-10-24T01:17:50.718056] [DEBUG] [LOCAL     ] AVAL: Saving derivative data.
[2025-10-24T01:17:50.737772] [DEBUG] [LOCAL     ] AVAL: Derivative data saved (139 records).
[2025-10-24T01:17:50.739043] [INFO ] [MAIN      ] AVAL: Successfully saved derivative data.
[2025-10-24T01:17:50.744028] [INFO ] [MAIN      ] AVA: Generated 139 derivative records from 38535 primary records.
[2025-10-24T01:17:50.742264] [INFO ] [MAIN      ] Derivative Progress: 164/2164 symbols completed. AVAL took 1.0s. Estimated remaining: 14m 10s. Rate: 141.2 symbols/min
[2025-10-24T01:17:50.744403] [DEBUG] [LOCAL     ] AVA: Saving derivative data.
[2025-10-24T01:17:50.756204] [DEBUG] [LOCAL     ] AVA: Derivative data saved (139 records).
[2025-10-24T01:17:50.756286] [INFO ] [MAIN      ] AVA: Successfully saved derivative data.
[2025-10-24T01:17:50.759172] [INFO ] [MAIN      ] Derivative Progress: 165/2164 symbols completed. AVA took 1.1s. Estimated remaining: 14m 5s. Rate: 142.0 symbols/min
[2025-10-24T01:17:50.760017] [INFO ] [MAIN      ] AVD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:50.759888] [INFO ] [MAIN      ] AVB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:50.760100] [INFO ] [MAIN      ] AVK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:50.787689] [DEBUG] [LOCAL     ] AVD: Loaded 21435 existing records from primary storage.
[2025-10-24T01:17:50.796047] [INFO ] [MAIN      ] AVD: Loaded 21435 primary data records.
[2025-10-24T01:17:50.808636] [DEBUG] [LOCAL     ] AVK: Loaded 18738 existing records from primary storage.
[2025-10-24T01:17:50.856261] [INFO ] [MAIN      ] AVK: Loaded 18738 primary data records.
[2025-10-24T01:17:50.994528] [DEBUG] [LOCAL     ] AVB: Loaded 42433 existing records from primary storage.
[2025-10-24T01:17:51.018249] [INFO ] [MAIN      ] AVB: Loaded 42433 primary data records.
[2025-10-24T01:17:51.901839] [DEBUG] [MAIN      ] AVK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:51.934120] [DEBUG] [MAIN      ] AVD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:51.973821] [DEBUG] [MAIN      ] AVB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:52.063795] [INFO ] [MAIN      ] AVK: Generated 139 derivative records from 18738 primary records.
[2025-10-24T01:17:52.066169] [INFO ] [MAIN      ] AVD: Generated 139 derivative records from 21435 primary records.
[2025-10-24T01:17:52.066862] [DEBUG] [LOCAL     ] AVK: Saving derivative data.
[2025-10-24T01:17:52.066679] [DEBUG] [LOCAL     ] AVD: Saving derivative data.
[2025-10-24T01:17:52.083505] [DEBUG] [LOCAL     ] AVD: Derivative data saved (139 records).
[2025-10-24T01:17:52.084150] [INFO ] [MAIN      ] AVD: Successfully saved derivative data.
[2025-10-24T01:17:52.082020] [INFO ] [MAIN      ] AVB: Generated 139 derivative records from 42433 primary records.
[2025-10-24T01:17:52.094075] [INFO ] [MAIN      ] Derivative Progress: 166/2164 symbols completed. AVD took 1.3s. Estimated remaining: 14m 15s. Rate: 140.2 symbols/min
[2025-10-24T01:17:52.094389] [INFO ] [MAIN      ] AVNS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:52.096691] [DEBUG] [LOCAL     ] AVB: Saving derivative data.
[2025-10-24T01:17:52.102851] [DEBUG] [LOCAL     ] AVK: Derivative data saved (139 records).
[2025-10-24T01:17:52.103756] [INFO ] [MAIN      ] AVK: Successfully saved derivative data.
[2025-10-24T01:17:52.107241] [INFO ] [MAIN      ] Derivative Progress: 167/2164 symbols completed. AVK took 1.3s. Estimated remaining: 14m 10s. Rate: 141.0 symbols/min
[2025-10-24T01:17:52.108066] [INFO ] [MAIN      ] AVNT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:52.121701] [DEBUG] [LOCAL     ] AVB: Derivative data saved (139 records).
[2025-10-24T01:17:52.121926] [INFO ] [MAIN      ] AVB: Successfully saved derivative data.
[2025-10-24T01:17:52.125445] [INFO ] [MAIN      ] Derivative Progress: 168/2164 symbols completed. AVB took 1.4s. Estimated remaining: 14m 4s. Rate: 141.8 symbols/min
[2025-10-24T01:17:52.125730] [INFO ] [MAIN      ] AVTR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:52.169302] [DEBUG] [LOCAL     ] AVNS: Loaded 33758 existing records from primary storage.
[2025-10-24T01:17:52.169922] [INFO ] [MAIN      ] AVNS: Loaded 33758 primary data records.
[2025-10-24T01:17:52.314179] [DEBUG] [LOCAL     ] AVNT: Loaded 38855 existing records from primary storage.
[2025-10-24T01:17:52.352577] [INFO ] [MAIN      ] AVNT: Loaded 38855 primary data records.
[2025-10-24T01:17:52.347246] [DEBUG] [LOCAL     ] AVTR: Loaded 53961 existing records from primary storage.
[2025-10-24T01:17:52.390852] [INFO ] [MAIN      ] AVTR: Loaded 53961 primary data records.
[2025-10-24T01:17:53.222195] [DEBUG] [MAIN      ] AVNS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:53.293428] [DEBUG] [MAIN      ] AVTR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:53.297019] [DEBUG] [MAIN      ] AVNT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:53.335616] [INFO ] [MAIN      ] AVNS: Generated 139 derivative records from 33758 primary records.
[2025-10-24T01:17:53.337033] [DEBUG] [LOCAL     ] AVNS: Saving derivative data.
[2025-10-24T01:17:53.357222] [DEBUG] [LOCAL     ] AVNS: Derivative data saved (139 records).
[2025-10-24T01:17:53.364812] [INFO ] [MAIN      ] AVNS: Successfully saved derivative data.
[2025-10-24T01:17:53.368147] [INFO ] [MAIN      ] Derivative Progress: 169/2164 symbols completed. AVNS took 1.3s. Estimated remaining: 14m 14s. Rate: 140.2 symbols/min
[2025-10-24T01:17:53.370213] [INFO ] [MAIN      ] AVY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:53.406448] [INFO ] [MAIN      ] AVTR: Generated 139 derivative records from 53961 primary records.
[2025-10-24T01:17:53.404466] [INFO ] [MAIN      ] AVNT: Generated 139 derivative records from 38855 primary records.
[2025-10-24T01:17:53.406817] [DEBUG] [LOCAL     ] AVTR: Saving derivative data.
[2025-10-24T01:17:53.406917] [DEBUG] [LOCAL     ] AVNT: Saving derivative data.
[2025-10-24T01:17:53.441180] [DEBUG] [LOCAL     ] AVNT: Derivative data saved (139 records).
[2025-10-24T01:17:53.442944] [INFO ] [MAIN      ] AVNT: Successfully saved derivative data.
[2025-10-24T01:17:53.443456] [DEBUG] [LOCAL     ] AVTR: Derivative data saved (139 records).
[2025-10-24T01:17:53.448499] [INFO ] [MAIN      ] Derivative Progress: 170/2164 symbols completed. AVNT took 1.3s. Estimated remaining: 14m 9s. Rate: 140.9 symbols/min
[2025-10-24T01:17:53.448931] [INFO ] [MAIN      ] AVTR: Successfully saved derivative data.
[2025-10-24T01:17:53.459205] [INFO ] [MAIN      ] AWF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:53.462605] [INFO ] [MAIN      ] Derivative Progress: 171/2164 symbols completed. AVTR took 1.3s. Estimated remaining: 14m 4s. Rate: 141.7 symbols/min
[2025-10-24T01:17:53.464898] [INFO ] [MAIN      ] AWI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:53.467232] [DEBUG] [LOCAL     ] AVY: Loaded 38485 existing records from primary storage.
[2025-10-24T01:17:53.468352] [INFO ] [MAIN      ] AVY: Loaded 38485 primary data records.
[2025-10-24T01:17:53.824867] [DEBUG] [LOCAL     ] AWI: Loaded 25291 existing records from primary storage.
[2025-10-24T01:17:53.847390] [DEBUG] [LOCAL     ] AWF: Loaded 24216 existing records from primary storage.
[2025-10-24T01:17:53.888024] [INFO ] [MAIN      ] AWF: Loaded 24216 primary data records.
[2025-10-24T01:17:53.887863] [INFO ] [MAIN      ] AWI: Loaded 25291 primary data records.
[2025-10-24T01:17:54.603916] [DEBUG] [MAIN      ] AVY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:54.653100] [DEBUG] [MAIN      ] AWI: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:17:54.702363] [DEBUG] [MAIN      ] AWF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:54.751412] [INFO ] [MAIN      ] AVY: Generated 139 derivative records from 38485 primary records.
[2025-10-24T01:17:54.756554] [DEBUG] [LOCAL     ] AVY: Saving derivative data.
[2025-10-24T01:17:54.775399] [DEBUG] [LOCAL     ] AVY: Derivative data saved (139 records).
[2025-10-24T01:17:54.779143] [INFO ] [MAIN      ] AVY: Successfully saved derivative data.
[2025-10-24T01:17:54.783272] [INFO ] [MAIN      ] Derivative Progress: 172/2164 symbols completed. AVY took 1.4s. Estimated remaining: 14m 14s. Rate: 140.0 symbols/min
[2025-10-24T01:17:54.783636] [INFO ] [MAIN      ] AWK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:54.787167] [INFO ] [MAIN      ] AWI: Generated 139 derivative records from 25291 primary records.
[2025-10-24T01:17:54.787897] [DEBUG] [LOCAL     ] AWI: Saving derivative data.
[2025-10-24T01:17:54.806794] [DEBUG] [LOCAL     ] AWI: Derivative data saved (139 records).
[2025-10-24T01:17:54.807089] [INFO ] [MAIN      ] AWI: Successfully saved derivative data.
[2025-10-24T01:17:54.811479] [INFO ] [MAIN      ] Derivative Progress: 173/2164 symbols completed. AWI took 1.3s. Estimated remaining: 14m 9s. Rate: 140.7 symbols/min
[2025-10-24T01:17:54.811799] [INFO ] [MAIN      ] AWP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:54.819887] [INFO ] [MAIN      ] AWF: Generated 139 derivative records from 24216 primary records.
[2025-10-24T01:17:54.820226] [DEBUG] [LOCAL     ] AWF: Saving derivative data.
[2025-10-24T01:17:54.839331] [DEBUG] [LOCAL     ] AWF: Derivative data saved (139 records).
[2025-10-24T01:17:54.839730] [INFO ] [MAIN      ] AWF: Successfully saved derivative data.
[2025-10-24T01:17:54.843891] [INFO ] [MAIN      ] Derivative Progress: 174/2164 symbols completed. AWF took 1.4s. Estimated remaining: 14m 4s. Rate: 141.5 symbols/min
[2025-10-24T01:17:54.844273] [INFO ] [MAIN      ] AWR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:54.866358] [DEBUG] [LOCAL     ] AWP: Loaded 21729 existing records from primary storage.
[2025-10-24T01:17:54.866712] [INFO ] [MAIN      ] AWP: Loaded 21729 primary data records.
[2025-10-24T01:17:55.016722] [DEBUG] [LOCAL     ] AWK: Loaded 48705 existing records from primary storage.
[2025-10-24T01:17:55.039392] [INFO ] [MAIN      ] AWK: Loaded 48705 primary data records.
[2025-10-24T01:17:55.256569] [DEBUG] [LOCAL     ] AWR: Loaded 22853 existing records from primary storage.
[2025-10-24T01:17:55.305195] [INFO ] [MAIN      ] AWR: Loaded 22853 primary data records.
[2025-10-24T01:17:55.951585] [DEBUG] [MAIN      ] AWP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:56.006958] [DEBUG] [MAIN      ] AWK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:56.046964] [DEBUG] [MAIN      ] AWR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:56.072505] [INFO ] [MAIN      ] AWP: Generated 139 derivative records from 21729 primary records.
[2025-10-24T01:17:56.077400] [DEBUG] [LOCAL     ] AWP: Saving derivative data.
[2025-10-24T01:17:56.096374] [DEBUG] [LOCAL     ] AWP: Derivative data saved (139 records).
[2025-10-24T01:17:56.100951] [INFO ] [MAIN      ] AWP: Successfully saved derivative data.
[2025-10-24T01:17:56.104047] [INFO ] [MAIN      ] Derivative Progress: 175/2164 symbols completed. AWP took 1.3s. Estimated remaining: 14m 13s. Rate: 139.9 symbols/min
[2025-10-24T01:17:56.106714] [INFO ] [MAIN      ] AX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:56.138507] [INFO ] [MAIN      ] AWK: Generated 139 derivative records from 48705 primary records.
[2025-10-24T01:17:56.141423] [DEBUG] [LOCAL     ] AWK: Saving derivative data.
[2025-10-24T01:17:56.152463] [INFO ] [MAIN      ] AWR: Generated 139 derivative records from 22853 primary records.
[2025-10-24T01:17:56.160411] [DEBUG] [LOCAL     ] AWR: Saving derivative data.
[2025-10-24T01:17:56.165103] [DEBUG] [LOCAL     ] AWK: Derivative data saved (139 records).
[2025-10-24T01:17:56.168019] [INFO ] [MAIN      ] AWK: Successfully saved derivative data.
[2025-10-24T01:17:56.178284] [INFO ] [MAIN      ] Derivative Progress: 176/2164 symbols completed. AWK took 1.4s. Estimated remaining: 14m 9s. Rate: 140.6 symbols/min
[2025-10-24T01:17:56.180468] [INFO ] [MAIN      ] AXL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:56.192489] [DEBUG] [LOCAL     ] AWR: Derivative data saved (139 records).
[2025-10-24T01:17:56.195210] [INFO ] [MAIN      ] AWR: Successfully saved derivative data.
[2025-10-24T01:17:56.196486] [DEBUG] [LOCAL     ] AX: Loaded 27971 existing records from primary storage.
[2025-10-24T01:17:56.196762] [INFO ] [MAIN      ] AX: Loaded 27971 primary data records.
[2025-10-24T01:17:56.200869] [INFO ] [MAIN      ] Derivative Progress: 177/2164 symbols completed. AWR took 1.4s. Estimated remaining: 14m 4s. Rate: 141.3 symbols/min
[2025-10-24T01:17:56.201374] [INFO ] [MAIN      ] AXP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:56.586504] [DEBUG] [LOCAL     ] AXL: Loaded 50912 existing records from primary storage.
[2025-10-24T01:17:56.588979] [INFO ] [MAIN      ] AXL: Loaded 50912 primary data records.
[2025-10-24T01:17:56.714693] [DEBUG] [LOCAL     ] AXP: Loaded 53545 existing records from primary storage.
[2025-10-24T01:17:56.736245] [INFO ] [MAIN      ] AXP: Loaded 53545 primary data records.
[2025-10-24T01:17:57.121286] [DEBUG] [MAIN      ] AX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:57.288229] [DEBUG] [MAIN      ] AXL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:57.326073] [INFO ] [MAIN      ] AX: Generated 139 derivative records from 27971 primary records.
[2025-10-24T01:17:57.343232] [DEBUG] [MAIN      ] AXP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:57.343882] [DEBUG] [LOCAL     ] AX: Saving derivative data.
[2025-10-24T01:17:57.376046] [DEBUG] [LOCAL     ] AX: Derivative data saved (139 records).
[2025-10-24T01:17:57.379482] [INFO ] [MAIN      ] AX: Successfully saved derivative data.
[2025-10-24T01:17:57.385984] [INFO ] [MAIN      ] Derivative Progress: 178/2164 symbols completed. AX took 1.3s. Estimated remaining: 14m 12s. Rate: 139.9 symbols/min
[2025-10-24T01:17:57.407848] [INFO ] [MAIN      ] AXL: Generated 139 derivative records from 50912 primary records.
[2025-10-24T01:17:57.408260] [DEBUG] [LOCAL     ] AXL: Saving derivative data.
[2025-10-24T01:17:57.430474] [INFO ] [MAIN      ] AXP: Generated 139 derivative records from 53545 primary records.
[2025-10-24T01:17:57.430285] [DEBUG] [LOCAL     ] AXL: Derivative data saved (139 records).
[2025-10-24T01:17:57.430756] [DEBUG] [LOCAL     ] AXP: Saving derivative data.
[2025-10-24T01:17:57.430807] [INFO ] [MAIN      ] AXL: Successfully saved derivative data.
[2025-10-24T01:17:57.435572] [INFO ] [MAIN      ] Derivative Progress: 179/2164 symbols completed. AXL took 1.3s. Estimated remaining: 14m 7s. Rate: 140.6 symbols/min
[2025-10-24T01:17:57.448209] [DEBUG] [LOCAL     ] AXP: Derivative data saved (139 records).
[2025-10-24T01:17:57.448396] [INFO ] [MAIN      ] AXP: Successfully saved derivative data.
[2025-10-24T01:17:57.453095] [INFO ] [MAIN      ] Derivative Progress: 180/2164 symbols completed. AXP took 1.3s. Estimated remaining: 14m 2s. Rate: 141.4 symbols/min
[2025-10-24T01:17:57.453810] [INFO ] [MAIN      ] AXS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:57.453728] [INFO ] [MAIN      ] AXR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:57.453975] [INFO ] [MAIN      ] AXTA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:57.462383] [DEBUG] [LOCAL     ] AXR: Loaded 2921 existing records from primary storage.
[2025-10-24T01:17:57.462854] [INFO ] [MAIN      ] AXR: Loaded 2921 primary data records.
[2025-10-24T01:17:57.822913] [DEBUG] [LOCAL     ] AXS: Loaded 39045 existing records from primary storage.
[2025-10-24T01:17:57.839129] [INFO ] [MAIN      ] AXS: Loaded 39045 primary data records.
[2025-10-24T01:17:57.893878] [DEBUG] [LOCAL     ] AXTA: Loaded 52680 existing records from primary storage.
[2025-10-24T01:17:57.912756] [INFO ] [MAIN      ] AXTA: Loaded 52680 primary data records.
[2025-10-24T01:17:58.767163] [DEBUG] [MAIN      ] AXR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:58.848114] [DEBUG] [MAIN      ] AXS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:58.897368] [DEBUG] [MAIN      ] AXTA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:17:58.901503] [INFO ] [MAIN      ] AXR: Generated 139 derivative records from 2921 primary records.
[2025-10-24T01:17:58.917835] [DEBUG] [LOCAL     ] AXR: Saving derivative data.
[2025-10-24T01:17:58.944872] [DEBUG] [LOCAL     ] AXR: Derivative data saved (139 records).
[2025-10-24T01:17:58.945342] [INFO ] [MAIN      ] AXR: Successfully saved derivative data.
[2025-10-24T01:17:58.953081] [INFO ] [MAIN      ] Derivative Progress: 181/2164 symbols completed. AXR took 1.5s. Estimated remaining: 14m 13s. Rate: 139.4 symbols/min
[2025-10-24T01:17:58.960302] [INFO ] [MAIN      ] AYI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:58.997342] [INFO ] [MAIN      ] AXTA: Generated 139 derivative records from 52680 primary records.
[2025-10-24T01:17:58.997608] [INFO ] [MAIN      ] AXS: Generated 139 derivative records from 39045 primary records.
[2025-10-24T01:17:58.997955] [DEBUG] [LOCAL     ] AXS: Saving derivative data.
[2025-10-24T01:17:58.998667] [DEBUG] [LOCAL     ] AXTA: Saving derivative data.
[2025-10-24T01:17:59.039140] [DEBUG] [LOCAL     ] AYI: Loaded 24188 existing records from primary storage.
[2025-10-24T01:17:59.042098] [INFO ] [MAIN      ] AYI: Loaded 24188 primary data records.
[2025-10-24T01:17:59.042876] [DEBUG] [LOCAL     ] AXS: Derivative data saved (139 records).
[2025-10-24T01:17:59.038694] [DEBUG] [LOCAL     ] AXTA: Derivative data saved (139 records).
[2025-10-24T01:17:59.043056] [INFO ] [MAIN      ] AXS: Successfully saved derivative data.
[2025-10-24T01:17:59.043339] [INFO ] [MAIN      ] AXTA: Successfully saved derivative data.
[2025-10-24T01:17:59.046016] [INFO ] [MAIN      ] Derivative Progress: 182/2164 symbols completed. AXS took 1.6s. Estimated remaining: 14m 9s. Rate: 140.0 symbols/min
[2025-10-24T01:17:59.075777] [INFO ] [MAIN      ] AZO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:59.076006] [INFO ] [MAIN      ] Derivative Progress: 183/2164 symbols completed. AXTA took 1.6s. Estimated remaining: 14m 5s. Rate: 140.7 symbols/min
[2025-10-24T01:17:59.104453] [INFO ] [MAIN      ] AZZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:17:59.204112] [DEBUG] [LOCAL     ] AZO: Loaded 10939 existing records from primary storage.
[2025-10-24T01:17:59.216698] [INFO ] [MAIN      ] AZO: Loaded 10939 primary data records.
[2025-10-24T01:17:59.507945] [DEBUG] [LOCAL     ] AZZ: Loaded 23076 existing records from primary storage.
[2025-10-24T01:17:59.545350] [INFO ] [MAIN      ] AZZ: Loaded 23076 primary data records.
[2025-10-24T01:18:00.072897] [DEBUG] [MAIN      ] AYI: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:18:00.110477] [DEBUG] [MAIN      ] AZO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:00.148417] [DEBUG] [MAIN      ] AZZ: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:18:00.186639] [INFO ] [MAIN      ] AYI: Generated 139 derivative records from 24188 primary records.
[2025-10-24T01:18:00.189044] [DEBUG] [LOCAL     ] AYI: Saving derivative data.
[2025-10-24T01:18:00.209591] [DEBUG] [LOCAL     ] AYI: Derivative data saved (139 records).
[2025-10-24T01:18:00.211300] [INFO ] [MAIN      ] AYI: Successfully saved derivative data.
[2025-10-24T01:18:00.213752] [INFO ] [MAIN      ] Derivative Progress: 184/2164 symbols completed. AYI took 1.3s. Estimated remaining: 14m 12s. Rate: 139.5 symbols/min
[2025-10-24T01:18:00.214279] [INFO ] [MAIN      ] BA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:00.224620] [INFO ] [MAIN      ] AZO: Generated 139 derivative records from 10939 primary records.
[2025-10-24T01:18:00.228639] [DEBUG] [LOCAL     ] AZO: Saving derivative data.
[2025-10-24T01:18:00.243317] [DEBUG] [LOCAL     ] AZO: Derivative data saved (139 records).
[2025-10-24T01:18:00.245318] [INFO ] [MAIN      ] AZO: Successfully saved derivative data.
[2025-10-24T01:18:00.248114] [INFO ] [MAIN      ] Derivative Progress: 185/2164 symbols completed. AZO took 1.2s. Estimated remaining: 14m 7s. Rate: 140.2 symbols/min
[2025-10-24T01:18:00.248394] [INFO ] [MAIN      ] BABA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:00.249096] [INFO ] [MAIN      ] AZZ: Generated 139 derivative records from 23076 primary records.
[2025-10-24T01:18:00.249375] [DEBUG] [LOCAL     ] AZZ: Saving derivative data.
[2025-10-24T01:18:00.261999] [DEBUG] [LOCAL     ] AZZ: Derivative data saved (139 records).
[2025-10-24T01:18:00.262225] [INFO ] [MAIN      ] AZZ: Successfully saved derivative data.
[2025-10-24T01:18:00.265162] [INFO ] [MAIN      ] Derivative Progress: 186/2164 symbols completed. AZZ took 1.2s. Estimated remaining: 14m 2s. Rate: 140.9 symbols/min
[2025-10-24T01:18:00.265814] [INFO ] [MAIN      ] BAC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:00.306858] [DEBUG] [LOCAL     ] BA: Loaded 54180 existing records from primary storage.
[2025-10-24T01:18:00.307269] [INFO ] [MAIN      ] BA: Loaded 54180 primary data records.
[2025-10-24T01:18:00.705136] [DEBUG] [LOCAL     ] BABA: Loaded 54210 existing records from primary storage.
[2025-10-24T01:18:00.706228] [DEBUG] [LOCAL     ] BAC: Loaded 54198 existing records from primary storage.
[2025-10-24T01:18:00.705452] [INFO ] [MAIN      ] BABA: Loaded 54210 primary data records.
[2025-10-24T01:18:00.706604] [INFO ] [MAIN      ] BAC: Loaded 54198 primary data records.
[2025-10-24T01:18:01.343708] [DEBUG] [MAIN      ] BA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:01.405601] [DEBUG] [MAIN      ] BABA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:01.408899] [DEBUG] [MAIN      ] BAC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:01.439343] [INFO ] [MAIN      ] BA: Generated 139 derivative records from 54180 primary records.
[2025-10-24T01:18:01.440479] [DEBUG] [LOCAL     ] BA: Saving derivative data.
[2025-10-24T01:18:01.458349] [DEBUG] [LOCAL     ] BA: Derivative data saved (139 records).
[2025-10-24T01:18:01.458698] [INFO ] [MAIN      ] BA: Successfully saved derivative data.
[2025-10-24T01:18:01.466748] [INFO ] [MAIN      ] Derivative Progress: 187/2164 symbols completed. BA took 1.3s. Estimated remaining: 14m 10s. Rate: 139.5 symbols/min
[2025-10-24T01:18:01.469237] [INFO ] [MAIN      ] BAH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:01.497726] [INFO ] [MAIN      ] BABA: Generated 139 derivative records from 54210 primary records.
[2025-10-24T01:18:01.499500] [DEBUG] [LOCAL     ] BABA: Saving derivative data.
[2025-10-24T01:18:01.499639] [INFO ] [MAIN      ] BAC: Generated 139 derivative records from 54198 primary records.
[2025-10-24T01:18:01.500211] [DEBUG] [LOCAL     ] BAC: Saving derivative data.
[2025-10-24T01:18:01.523359] [DEBUG] [LOCAL     ] BAC: Derivative data saved (139 records).
[2025-10-24T01:18:01.525489] [DEBUG] [LOCAL     ] BABA: Derivative data saved (139 records).
[2025-10-24T01:18:01.525811] [INFO ] [MAIN      ] BAC: Successfully saved derivative data.
[2025-10-24T01:18:01.538195] [INFO ] [MAIN      ] BABA: Successfully saved derivative data.
[2025-10-24T01:18:01.541913] [INFO ] [MAIN      ] Derivative Progress: 188/2164 symbols completed. BABA took 1.3s. Estimated remaining: 14m 6s. Rate: 140.1 symbols/min
[2025-10-24T01:18:01.544978] [INFO ] [MAIN      ] Derivative Progress: 189/2164 symbols completed. BAC took 1.3s. Estimated remaining: 14m 1s. Rate: 140.9 symbols/min
[2025-10-24T01:18:01.544905] [INFO ] [MAIN      ] BAK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:01.545518] [INFO ] [MAIN      ] BALL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:01.570500] [DEBUG] [LOCAL     ] BAH: Loaded 52022 existing records from primary storage.
[2025-10-24T01:18:01.571021] [INFO ] [MAIN      ] BAH: Loaded 52022 primary data records.
[2025-10-24T01:18:01.745043] [DEBUG] [LOCAL     ] BAK: Loaded 39731 existing records from primary storage.
[2025-10-24T01:18:01.923892] [INFO ] [MAIN      ] BAK: Loaded 39731 primary data records.
[2025-10-24T01:18:02.078061] [DEBUG] [LOCAL     ] BALL: Loaded 52314 existing records from primary storage.
[2025-10-24T01:18:02.102975] [INFO ] [MAIN      ] BALL: Loaded 52314 primary data records.
[2025-10-24T01:18:02.443480] [DEBUG] [MAIN      ] BAH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:02.665395] [DEBUG] [MAIN      ] BAK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:02.700814] [INFO ] [MAIN      ] BAH: Generated 139 derivative records from 52022 primary records.
[2025-10-24T01:18:02.703731] [DEBUG] [LOCAL     ] BAH: Saving derivative data.
[2025-10-24T01:18:02.737814] [DEBUG] [MAIN      ] BALL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:02.740906] [DEBUG] [LOCAL     ] BAH: Derivative data saved (139 records).
[2025-10-24T01:18:02.743930] [INFO ] [MAIN      ] BAH: Successfully saved derivative data.
[2025-10-24T01:18:02.765165] [INFO ] [MAIN      ] Derivative Progress: 190/2164 symbols completed. BAH took 1.3s. Estimated remaining: 14m 9s. Rate: 139.5 symbols/min
[2025-10-24T01:18:02.766474] [INFO ] [MAIN      ] BAM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:02.769436] [INFO ] [MAIN      ] BAK: Generated 139 derivative records from 39731 primary records.
[2025-10-24T01:18:02.769977] [DEBUG] [LOCAL     ] BAK: Saving derivative data.
[2025-10-24T01:18:02.787467] [DEBUG] [LOCAL     ] BAK: Derivative data saved (139 records).
[2025-10-24T01:18:02.789757] [INFO ] [MAIN      ] BAK: Successfully saved derivative data.
[2025-10-24T01:18:02.796316] [INFO ] [MAIN      ] Derivative Progress: 191/2164 symbols completed. BAK took 1.3s. Estimated remaining: 14m 4s. Rate: 140.2 symbols/min
[2025-10-24T01:18:02.797257] [INFO ] [MAIN      ] BANC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:02.809137] [INFO ] [MAIN      ] BALL: Generated 139 derivative records from 52314 primary records.
[2025-10-24T01:18:02.809444] [DEBUG] [LOCAL     ] BALL: Saving derivative data.
[2025-10-24T01:18:02.838495] [DEBUG] [LOCAL     ] BALL: Derivative data saved (139 records).
[2025-10-24T01:18:02.838747] [INFO ] [MAIN      ] BALL: Successfully saved derivative data.
[2025-10-24T01:18:02.842119] [INFO ] [MAIN      ] Derivative Progress: 192/2164 symbols completed. BALL took 1.3s. Estimated remaining: 14m 0s. Rate: 140.8 symbols/min
[2025-10-24T01:18:02.842512] [INFO ] [MAIN      ] BAP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:02.863681] [DEBUG] [LOCAL     ] BAM: Loaded 52467 existing records from primary storage.
[2025-10-24T01:18:02.864192] [INFO ] [MAIN      ] BAM: Loaded 52467 primary data records.
[2025-10-24T01:18:03.126455] [DEBUG] [LOCAL     ] BAP: Loaded 25703 existing records from primary storage.
[2025-10-24T01:18:03.228874] [DEBUG] [LOCAL     ] BANC: Loaded 51774 existing records from primary storage.
[2025-10-24T01:18:03.229013] [INFO ] [MAIN      ] BAP: Loaded 25703 primary data records.
[2025-10-24T01:18:03.229283] [INFO ] [MAIN      ] BANC: Loaded 51774 primary data records.
[2025-10-24T01:18:03.859915] [DEBUG] [MAIN      ] BAM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:03.913505] [DEBUG] [MAIN      ] BAP: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:18:03.942721] [DEBUG] [MAIN      ] BANC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:03.962109] [INFO ] [MAIN      ] BAM: Generated 139 derivative records from 52467 primary records.
[2025-10-24T01:18:03.965052] [DEBUG] [LOCAL     ] BAM: Saving derivative data.
[2025-10-24T01:18:03.980955] [DEBUG] [LOCAL     ] BAM: Derivative data saved (139 records).
[2025-10-24T01:18:03.986687] [INFO ] [MAIN      ] BAM: Successfully saved derivative data.
[2025-10-24T01:18:03.991132] [INFO ] [MAIN      ] Derivative Progress: 193/2164 symbols completed. BAM took 1.2s. Estimated remaining: 14m 7s. Rate: 139.6 symbols/min
[2025-10-24T01:18:04.008027] [INFO ] [MAIN      ] BAP: Generated 139 derivative records from 25703 primary records.
[2025-10-24T01:18:04.008291] [DEBUG] [LOCAL     ] BAP: Saving derivative data.
[2025-10-24T01:18:04.023886] [DEBUG] [LOCAL     ] BAP: Derivative data saved (139 records).
[2025-10-24T01:18:04.025134] [INFO ] [MAIN      ] BAP: Successfully saved derivative data.
[2025-10-24T01:18:04.029043] [INFO ] [MAIN      ] Derivative Progress: 194/2164 symbols completed. BAP took 1.2s. Estimated remaining: 14m 3s. Rate: 140.3 symbols/min
[2025-10-24T01:18:04.029383] [INFO ] [MAIN      ] BANC: Generated 139 derivative records from 51774 primary records.
[2025-10-24T01:18:04.029497] [DEBUG] [LOCAL     ] BANC: Saving derivative data.
[2025-10-24T01:18:04.041659] [DEBUG] [LOCAL     ] BANC: Derivative data saved (139 records).
[2025-10-24T01:18:04.041747] [INFO ] [MAIN      ] BANC: Successfully saved derivative data.
[2025-10-24T01:18:04.044893] [INFO ] [MAIN      ] Derivative Progress: 195/2164 symbols completed. BANC took 1.2s. Estimated remaining: 13m 58s. Rate: 141.0 symbols/min
[2025-10-24T01:18:04.045319] [INFO ] [MAIN      ] BAX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:04.045365] [INFO ] [MAIN      ] BB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:04.045273] [INFO ] [MAIN      ] BARK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:04.116926] [DEBUG] [LOCAL     ] BARK: Loaded 38445 existing records from primary storage.
[2025-10-24T01:18:04.117246] [INFO ] [MAIN      ] BARK: Loaded 38445 primary data records.
[2025-10-24T01:18:04.267778] [DEBUG] [LOCAL     ] BAX: Loaded 53927 existing records from primary storage.
[2025-10-24T01:18:04.268718] [DEBUG] [LOCAL     ] BB: Loaded 53262 existing records from primary storage.
[2025-10-24T01:18:04.285279] [INFO ] [MAIN      ] BB: Loaded 53262 primary data records.
[2025-10-24T01:18:04.285415] [INFO ] [MAIN      ] BAX: Loaded 53927 primary data records.
[2025-10-24T01:18:05.285373] [DEBUG] [MAIN      ] BARK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:05.338372] [DEBUG] [MAIN      ] BAX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:05.368432] [DEBUG] [MAIN      ] BB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:05.423564] [INFO ] [MAIN      ] BARK: Generated 139 derivative records from 38445 primary records.
[2025-10-24T01:18:05.426365] [DEBUG] [LOCAL     ] BARK: Saving derivative data.
[2025-10-24T01:18:05.447127] [DEBUG] [LOCAL     ] BARK: Derivative data saved (139 records).
[2025-10-24T01:18:05.448443] [INFO ] [MAIN      ] BARK: Successfully saved derivative data.
[2025-10-24T01:18:05.454002] [INFO ] [MAIN      ] Derivative Progress: 196/2164 symbols completed. BARK took 1.4s. Estimated remaining: 14m 7s. Rate: 139.3 symbols/min
[2025-10-24T01:18:05.457343] [INFO ] [MAIN      ] BBAI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:05.467239] [INFO ] [MAIN      ] BAX: Generated 139 derivative records from 53927 primary records.
[2025-10-24T01:18:05.470304] [DEBUG] [LOCAL     ] BAX: Saving derivative data.
[2025-10-24T01:18:05.487386] [DEBUG] [LOCAL     ] BAX: Derivative data saved (139 records).
[2025-10-24T01:18:05.488236] [INFO ] [MAIN      ] BB: Generated 139 derivative records from 53262 primary records.
[2025-10-24T01:18:05.488604] [INFO ] [MAIN      ] BAX: Successfully saved derivative data.
[2025-10-24T01:18:05.488759] [DEBUG] [LOCAL     ] BB: Saving derivative data.
[2025-10-24T01:18:05.491371] [INFO ] [MAIN      ] Derivative Progress: 197/2164 symbols completed. BAX took 1.4s. Estimated remaining: 14m 3s. Rate: 140.0 symbols/min
[2025-10-24T01:18:05.492959] [INFO ] [MAIN      ] BBAR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:05.506737] [DEBUG] [LOCAL     ] BB: Derivative data saved (139 records).
[2025-10-24T01:18:05.506949] [INFO ] [MAIN      ] BB: Successfully saved derivative data.
[2025-10-24T01:18:05.511270] [INFO ] [MAIN      ] Derivative Progress: 198/2164 symbols completed. BB took 1.5s. Estimated remaining: 13m 59s. Rate: 140.7 symbols/min
[2025-10-24T01:18:05.511539] [INFO ] [MAIN      ] BBD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:05.569858] [DEBUG] [LOCAL     ] BBAI: Loaded 54210 existing records from primary storage.
[2025-10-24T01:18:05.572173] [INFO ] [MAIN      ] BBAI: Loaded 54210 primary data records.
[2025-10-24T01:18:05.639916] [DEBUG] [LOCAL     ] BBAR: Loaded 42977 existing records from primary storage.
[2025-10-24T01:18:05.664151] [INFO ] [MAIN      ] BBAR: Loaded 42977 primary data records.
[2025-10-24T01:18:05.912935] [DEBUG] [LOCAL     ] BBD: Loaded 53662 existing records from primary storage.
[2025-10-24T01:18:05.955801] [INFO ] [MAIN      ] BBD: Loaded 53662 primary data records.
[2025-10-24T01:18:06.676627] [DEBUG] [MAIN      ] BBAI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:06.677210] [DEBUG] [MAIN      ] BBAR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:06.746674] [DEBUG] [MAIN      ] BBD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:06.788506] [INFO ] [MAIN      ] BBAR: Generated 139 derivative records from 42977 primary records.
[2025-10-24T01:18:06.792194] [DEBUG] [LOCAL     ] BBAR: Saving derivative data.
[2025-10-24T01:18:06.806923] [INFO ] [MAIN      ] BBAI: Generated 139 derivative records from 54210 primary records.
[2025-10-24T01:18:06.808742] [DEBUG] [LOCAL     ] BBAR: Derivative data saved (139 records).
[2025-10-24T01:18:06.810039] [INFO ] [MAIN      ] BBAR: Successfully saved derivative data.
[2025-10-24T01:18:06.813708] [INFO ] [MAIN      ] Derivative Progress: 199/2164 symbols completed. BBAR took 1.3s. Estimated remaining: 14m 7s. Rate: 139.2 symbols/min
[2025-10-24T01:18:06.809130] [DEBUG] [LOCAL     ] BBAI: Saving derivative data.
[2025-10-24T01:18:06.814017] [INFO ] [MAIN      ] BBDC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:06.838766] [DEBUG] [LOCAL     ] BBAI: Derivative data saved (139 records).
[2025-10-24T01:18:06.840219] [INFO ] [MAIN      ] BBAI: Successfully saved derivative data.
[2025-10-24T01:18:06.847283] [INFO ] [MAIN      ] BBD: Generated 139 derivative records from 53662 primary records.
[2025-10-24T01:18:06.844560] [INFO ] [MAIN      ] Derivative Progress: 200/2164 symbols completed. BBAI took 1.4s. Estimated remaining: 14m 2s. Rate: 139.9 symbols/min
[2025-10-24T01:18:06.847536] [INFO ] [MAIN      ] BBN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:06.847674] [DEBUG] [LOCAL     ] BBD: Saving derivative data.
[2025-10-24T01:18:06.872296] [DEBUG] [LOCAL     ] BBD: Derivative data saved (139 records).
[2025-10-24T01:18:06.872680] [INFO ] [MAIN      ] BBD: Successfully saved derivative data.
[2025-10-24T01:18:06.877358] [INFO ] [MAIN      ] Derivative Progress: 201/2164 symbols completed. BBD took 1.4s. Estimated remaining: 13m 58s. Rate: 140.5 symbols/min
[2025-10-24T01:18:06.877803] [INFO ] [MAIN      ] BBU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:06.897813] [DEBUG] [LOCAL     ] BBDC: Loaded 33064 existing records from primary storage.
[2025-10-24T01:18:06.900280] [INFO ] [MAIN      ] BBDC: Loaded 33064 primary data records.
[2025-10-24T01:18:06.945305] [DEBUG] [LOCAL     ] BBN: Loaded 17906 existing records from primary storage.
[2025-10-24T01:18:06.980949] [INFO ] [MAIN      ] BBN: Loaded 17906 primary data records.
[2025-10-24T01:18:06.999774] [DEBUG] [LOCAL     ] BBU: Loaded 5819 existing records from primary storage.
[2025-10-24T01:18:07.005070] [INFO ] [MAIN      ] BBU: Loaded 5819 primary data records.
[2025-10-24T01:18:08.005318] [DEBUG] [MAIN      ] BBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:08.053549] [DEBUG] [MAIN      ] BBU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:08.081707] [DEBUG] [MAIN      ] BBN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:08.136178] [INFO ] [MAIN      ] BBDC: Generated 139 derivative records from 33064 primary records.
[2025-10-24T01:18:08.140397] [DEBUG] [LOCAL     ] BBDC: Saving derivative data.
[2025-10-24T01:18:08.162786] [DEBUG] [LOCAL     ] BBDC: Derivative data saved (139 records).
[2025-10-24T01:18:08.165863] [INFO ] [MAIN      ] BBDC: Successfully saved derivative data.
[2025-10-24T01:18:08.169073] [INFO ] [MAIN      ] Derivative Progress: 202/2164 symbols completed. BBDC took 1.4s. Estimated remaining: 14m 6s. Rate: 139.1 symbols/min
[2025-10-24T01:18:08.173070] [INFO ] [MAIN      ] BBN: Generated 139 derivative records from 17906 primary records.
[2025-10-24T01:18:08.175188] [DEBUG] [LOCAL     ] BBN: Saving derivative data.
[2025-10-24T01:18:08.175962] [INFO ] [MAIN      ] BBU: Generated 139 derivative records from 5819 primary records.
[2025-10-24T01:18:08.173450] [INFO ] [MAIN      ] BBUC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:08.176364] [DEBUG] [LOCAL     ] BBU: Saving derivative data.
[2025-10-24T01:18:08.199732] [DEBUG] [LOCAL     ] BBN: Derivative data saved (139 records).
[2025-10-24T01:18:08.202631] [INFO ] [MAIN      ] BBN: Successfully saved derivative data.
[2025-10-24T01:18:08.202305] [DEBUG] [LOCAL     ] BBU: Derivative data saved (139 records).
[2025-10-24T01:18:08.212089] [INFO ] [MAIN      ] Derivative Progress: 203/2164 symbols completed. BBN took 1.4s. Estimated remaining: 14m 2s. Rate: 139.7 symbols/min
[2025-10-24T01:18:08.212399] [INFO ] [MAIN      ] BBVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:08.212203] [INFO ] [MAIN      ] BBU: Successfully saved derivative data.
[2025-10-24T01:18:08.217137] [INFO ] [MAIN      ] Derivative Progress: 204/2164 symbols completed. BBU took 1.3s. Estimated remaining: 13m 57s. Rate: 140.4 symbols/min
[2025-10-24T01:18:08.218124] [INFO ] [MAIN      ] BBW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:08.226369] [DEBUG] [LOCAL     ] BBUC: Loaded 14063 existing records from primary storage.
[2025-10-24T01:18:08.226528] [INFO ] [MAIN      ] BBUC: Loaded 14063 primary data records.
[2025-10-24T01:18:08.580797] [DEBUG] [LOCAL     ] BBW: Loaded 27371 existing records from primary storage.
[2025-10-24T01:18:08.584282] [INFO ] [MAIN      ] BBW: Loaded 27371 primary data records.
[2025-10-24T01:18:08.679280] [DEBUG] [LOCAL     ] BBVA: Loaded 49463 existing records from primary storage.
[2025-10-24T01:18:08.705511] [INFO ] [MAIN      ] BBVA: Loaded 49463 primary data records.
[2025-10-24T01:18:09.306772] [DEBUG] [MAIN      ] BBUC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:09.365997] [DEBUG] [MAIN      ] BBW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:09.404772] [DEBUG] [MAIN      ] BBVA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:09.425273] [INFO ] [MAIN      ] BBUC: Generated 139 derivative records from 14063 primary records.
[2025-10-24T01:18:09.429380] [DEBUG] [LOCAL     ] BBUC: Saving derivative data.
[2025-10-24T01:18:09.459442] [DEBUG] [LOCAL     ] BBUC: Derivative data saved (139 records).
[2025-10-24T01:18:09.460502] [INFO ] [MAIN      ] BBUC: Successfully saved derivative data.
[2025-10-24T01:18:09.464568] [INFO ] [MAIN      ] Derivative Progress: 205/2164 symbols completed. BBUC took 1.3s. Estimated remaining: 14m 5s. Rate: 139.1 symbols/min
[2025-10-24T01:18:09.467186] [INFO ] [MAIN      ] BBWI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:09.493726] [INFO ] [MAIN      ] BBW: Generated 139 derivative records from 27371 primary records.
[2025-10-24T01:18:09.494461] [DEBUG] [LOCAL     ] BBW: Saving derivative data.
[2025-10-24T01:18:09.509603] [DEBUG] [LOCAL     ] BBW: Derivative data saved (139 records).
[2025-10-24T01:18:09.514721] [INFO ] [MAIN      ] BBW: Successfully saved derivative data.
[2025-10-24T01:18:09.518145] [INFO ] [MAIN      ] Derivative Progress: 206/2164 symbols completed. BBW took 1.3s. Estimated remaining: 14m 1s. Rate: 139.7 symbols/min
[2025-10-24T01:18:09.518465] [INFO ] [MAIN      ] BBY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:09.524069] [INFO ] [MAIN      ] BBVA: Generated 139 derivative records from 49463 primary records.
[2025-10-24T01:18:09.524444] [DEBUG] [LOCAL     ] BBVA: Saving derivative data.
[2025-10-24T01:18:09.540100] [DEBUG] [LOCAL     ] BBVA: Derivative data saved (139 records).
[2025-10-24T01:18:09.556090] [INFO ] [MAIN      ] BBVA: Successfully saved derivative data.
[2025-10-24T01:18:09.561382] [INFO ] [MAIN      ] Derivative Progress: 207/2164 symbols completed. BBVA took 1.3s. Estimated remaining: 13m 57s. Rate: 140.3 symbols/min
[2025-10-24T01:18:09.562008] [INFO ] [MAIN      ] BC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:09.586777] [DEBUG] [LOCAL     ] BBWI: Loaded 53981 existing records from primary storage.
[2025-10-24T01:18:09.587410] [INFO ] [MAIN      ] BBWI: Loaded 53981 primary data records.
[2025-10-24T01:18:09.856053] [DEBUG] [LOCAL     ] BBY: Loaded 53823 existing records from primary storage.
[2025-10-24T01:18:10.031758] [INFO ] [MAIN      ] BBY: Loaded 53823 primary data records.
[2025-10-24T01:18:10.033375] [DEBUG] [LOCAL     ] BC: Loaded 44257 existing records from primary storage.
[2025-10-24T01:18:10.039176] [INFO ] [MAIN      ] BC: Loaded 44257 primary data records.
[2025-10-24T01:18:10.732406] [DEBUG] [MAIN      ] BBWI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:10.786464] [DEBUG] [MAIN      ] BBY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:10.840281] [DEBUG] [MAIN      ] BC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:10.866235] [INFO ] [MAIN      ] BBWI: Generated 139 derivative records from 53981 primary records.
[2025-10-24T01:18:10.873224] [DEBUG] [LOCAL     ] BBWI: Saving derivative data.
[2025-10-24T01:18:10.892169] [DEBUG] [LOCAL     ] BBWI: Derivative data saved (139 records).
[2025-10-24T01:18:10.895102] [INFO ] [MAIN      ] BBWI: Successfully saved derivative data.
[2025-10-24T01:18:10.903799] [INFO ] [MAIN      ] Derivative Progress: 208/2164 symbols completed. BBWI took 1.4s. Estimated remaining: 14m 5s. Rate: 138.9 symbols/min
[2025-10-24T01:18:10.914582] [INFO ] [MAIN      ] BBY: Generated 139 derivative records from 53823 primary records.
[2025-10-24T01:18:10.918435] [DEBUG] [LOCAL     ] BBY: Saving derivative data.
[2025-10-24T01:18:10.934805] [DEBUG] [LOCAL     ] BBY: Derivative data saved (139 records).
[2025-10-24T01:18:10.934924] [INFO ] [MAIN      ] BBY: Successfully saved derivative data.
[2025-10-24T01:18:10.937595] [INFO ] [MAIN      ] Derivative Progress: 209/2164 symbols completed. BBY took 1.4s. Estimated remaining: 14m 1s. Rate: 139.5 symbols/min
[2025-10-24T01:18:10.940938] [INFO ] [MAIN      ] BC: Generated 139 derivative records from 44257 primary records.
[2025-10-24T01:18:10.941032] [DEBUG] [LOCAL     ] BC: Saving derivative data.
[2025-10-24T01:18:10.955855] [DEBUG] [LOCAL     ] BC: Derivative data saved (139 records).
[2025-10-24T01:18:10.955973] [INFO ] [MAIN      ] BC: Successfully saved derivative data.
[2025-10-24T01:18:10.959049] [INFO ] [MAIN      ] Derivative Progress: 210/2164 symbols completed. BC took 1.4s. Estimated remaining: 13m 57s. Rate: 140.1 symbols/min
[2025-10-24T01:18:10.959629] [INFO ] [MAIN      ] BCAT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:10.959769] [INFO ] [MAIN      ] BCE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:10.959930] [INFO ] [MAIN      ] BCC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:11.000473] [DEBUG] [LOCAL     ] BCC: Loaded 28829 existing records from primary storage.
[2025-10-24T01:18:11.000669] [INFO ] [MAIN      ] BCC: Loaded 28829 primary data records.
[2025-10-24T01:18:11.127327] [DEBUG] [LOCAL     ] BCAT: Loaded 34467 existing records from primary storage.
[2025-10-24T01:18:11.150490] [INFO ] [MAIN      ] BCAT: Loaded 34467 primary data records.
[2025-10-24T01:18:11.394864] [DEBUG] [LOCAL     ] BCE: Loaded 52643 existing records from primary storage.
[2025-10-24T01:18:11.400331] [INFO ] [MAIN      ] BCE: Loaded 52643 primary data records.
[2025-10-24T01:18:12.053541] [DEBUG] [MAIN      ] BCC: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:18:12.094156] [DEBUG] [MAIN      ] BCAT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:12.134713] [DEBUG] [MAIN      ] BCE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:12.180788] [INFO ] [MAIN      ] BCC: Generated 139 derivative records from 28829 primary records.
[2025-10-24T01:18:12.181797] [DEBUG] [LOCAL     ] BCC: Saving derivative data.
[2025-10-24T01:18:12.204302] [DEBUG] [LOCAL     ] BCC: Derivative data saved (139 records).
[2025-10-24T01:18:12.206270] [INFO ] [MAIN      ] BCC: Successfully saved derivative data.
[2025-10-24T01:18:12.209067] [INFO ] [MAIN      ] Derivative Progress: 211/2164 symbols completed. BCC took 1.2s. Estimated remaining: 14m 4s. Rate: 138.9 symbols/min
[2025-10-24T01:18:12.211326] [INFO ] [MAIN      ] BCH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:12.218611] [INFO ] [MAIN      ] BCAT: Generated 139 derivative records from 34467 primary records.
[2025-10-24T01:18:12.220442] [DEBUG] [LOCAL     ] BCAT: Saving derivative data.
[2025-10-24T01:18:12.237431] [DEBUG] [LOCAL     ] BCAT: Derivative data saved (139 records).
[2025-10-24T01:18:12.239083] [INFO ] [MAIN      ] BCAT: Successfully saved derivative data.
[2025-10-24T01:18:12.244252] [INFO ] [MAIN      ] Derivative Progress: 212/2164 symbols completed. BCAT took 1.3s. Estimated remaining: 13m 60s. Rate: 139.5 symbols/min
[2025-10-24T01:18:12.246261] [INFO ] [MAIN      ] BCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:12.247380] [INFO ] [MAIN      ] BCE: Generated 139 derivative records from 52643 primary records.
[2025-10-24T01:18:12.247849] [DEBUG] [LOCAL     ] BCE: Saving derivative data.
[2025-10-24T01:18:12.261470] [DEBUG] [LOCAL     ] BCE: Derivative data saved (139 records).
[2025-10-24T01:18:12.261605] [INFO ] [MAIN      ] BCE: Successfully saved derivative data.
[2025-10-24T01:18:12.264682] [INFO ] [MAIN      ] Derivative Progress: 213/2164 symbols completed. BCE took 1.3s. Estimated remaining: 13m 55s. Rate: 140.1 symbols/min
[2025-10-24T01:18:12.273121] [INFO ] [MAIN      ] BCS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:12.288184] [DEBUG] [LOCAL     ] BCH: Loaded 30215 existing records from primary storage.
[2025-10-24T01:18:12.288382] [INFO ] [MAIN      ] BCH: Loaded 30215 primary data records.
[2025-10-24T01:18:12.500439] [DEBUG] [LOCAL     ] BCO: Loaded 25109 existing records from primary storage.
[2025-10-24T01:18:12.626304] [INFO ] [MAIN      ] BCO: Loaded 25109 primary data records.
[2025-10-24T01:18:12.707919] [DEBUG] [LOCAL     ] BCS: Loaded 53831 existing records from primary storage.
[2025-10-24T01:18:12.720751] [INFO ] [MAIN      ] BCS: Loaded 53831 primary data records.
[2025-10-24T01:18:13.272764] [DEBUG] [MAIN      ] BCH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:13.311893] [DEBUG] [MAIN      ] BCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:13.352333] [DEBUG] [MAIN      ] BCS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:13.390479] [INFO ] [MAIN      ] BCH: Generated 139 derivative records from 30215 primary records.
[2025-10-24T01:18:13.393977] [DEBUG] [LOCAL     ] BCH: Saving derivative data.
[2025-10-24T01:18:13.412233] [DEBUG] [LOCAL     ] BCH: Derivative data saved (139 records).
[2025-10-24T01:18:13.415546] [INFO ] [MAIN      ] BCH: Successfully saved derivative data.
[2025-10-24T01:18:13.419735] [INFO ] [MAIN      ] Derivative Progress: 214/2164 symbols completed. BCH took 1.2s. Estimated remaining: 14m 2s. Rate: 139.0 symbols/min
[2025-10-24T01:18:13.423730] [INFO ] [MAIN      ] BCSF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:13.422342] [INFO ] [MAIN      ] BCO: Generated 139 derivative records from 25109 primary records.
[2025-10-24T01:18:13.424617] [DEBUG] [LOCAL     ] BCO: Saving derivative data.
[2025-10-24T01:18:13.443590] [DEBUG] [LOCAL     ] BCO: Derivative data saved (139 records).
[2025-10-24T01:18:13.443752] [INFO ] [MAIN      ] BCO: Successfully saved derivative data.
[2025-10-24T01:18:13.440619] [INFO ] [MAIN      ] BCS: Generated 139 derivative records from 53831 primary records.
[2025-10-24T01:18:13.446217] [DEBUG] [LOCAL     ] BCS: Saving derivative data.
[2025-10-24T01:18:13.445991] [INFO ] [MAIN      ] Derivative Progress: 215/2164 symbols completed. BCO took 1.2s. Estimated remaining: 13m 58s. Rate: 139.6 symbols/min
[2025-10-24T01:18:13.446901] [INFO ] [MAIN      ] BCX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:13.461436] [DEBUG] [LOCAL     ] BCS: Derivative data saved (139 records).
[2025-10-24T01:18:13.461725] [INFO ] [MAIN      ] BCS: Successfully saved derivative data.
[2025-10-24T01:18:13.464706] [INFO ] [MAIN      ] Derivative Progress: 216/2164 symbols completed. BCS took 1.2s. Estimated remaining: 13m 53s. Rate: 140.2 symbols/min
[2025-10-24T01:18:13.465007] [INFO ] [MAIN      ] BDC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:13.492608] [DEBUG] [LOCAL     ] BCSF: Loaded 28326 existing records from primary storage.
[2025-10-24T01:18:13.493287] [INFO ] [MAIN      ] BCSF: Loaded 28326 primary data records.
[2025-10-24T01:18:13.528072] [DEBUG] [LOCAL     ] BCX: Loaded 22191 existing records from primary storage.
[2025-10-24T01:18:13.538444] [INFO ] [MAIN      ] BCX: Loaded 22191 primary data records.
[2025-10-24T01:18:13.636354] [DEBUG] [LOCAL     ] BDC: Loaded 24096 existing records from primary storage.
[2025-10-24T01:18:13.698918] [INFO ] [MAIN      ] BDC: Loaded 24096 primary data records.
[2025-10-24T01:18:14.515899] [DEBUG] [MAIN      ] BCSF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:14.558453] [DEBUG] [MAIN      ] BCX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:14.597625] [DEBUG] [MAIN      ] BDC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:14.627637] [INFO ] [MAIN      ] BCSF: Generated 139 derivative records from 28326 primary records.
[2025-10-24T01:18:14.631615] [DEBUG] [LOCAL     ] BCSF: Saving derivative data.
[2025-10-24T01:18:14.654594] [DEBUG] [LOCAL     ] BCSF: Derivative data saved (139 records).
[2025-10-24T01:18:14.656931] [INFO ] [MAIN      ] BCSF: Successfully saved derivative data.
[2025-10-24T01:18:14.661900] [INFO ] [MAIN      ] Derivative Progress: 217/2164 symbols completed. BCSF took 1.2s. Estimated remaining: 13m 60s. Rate: 139.1 symbols/min
[2025-10-24T01:18:14.663900] [INFO ] [MAIN      ] BDJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:14.670124] [INFO ] [MAIN      ] BCX: Generated 139 derivative records from 22191 primary records.
[2025-10-24T01:18:14.670544] [DEBUG] [LOCAL     ] BCX: Saving derivative data.
[2025-10-24T01:18:14.688287] [DEBUG] [LOCAL     ] BCX: Derivative data saved (139 records).
[2025-10-24T01:18:14.688609] [INFO ] [MAIN      ] BCX: Successfully saved derivative data.
[2025-10-24T01:18:14.691247] [INFO ] [MAIN      ] Derivative Progress: 218/2164 symbols completed. BCX took 1.2s. Estimated remaining: 13m 56s. Rate: 139.7 symbols/min
[2025-10-24T01:18:14.693288] [INFO ] [MAIN      ] BDN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:14.695929] [INFO ] [MAIN      ] BDC: Generated 139 derivative records from 24096 primary records.
[2025-10-24T01:18:14.696291] [DEBUG] [LOCAL     ] BDC: Saving derivative data.
[2025-10-24T01:18:14.717507] [DEBUG] [LOCAL     ] BDC: Derivative data saved (139 records).
[2025-10-24T01:18:14.717666] [INFO ] [MAIN      ] BDC: Successfully saved derivative data.
[2025-10-24T01:18:14.720518] [INFO ] [MAIN      ] Derivative Progress: 219/2164 symbols completed. BDC took 1.3s. Estimated remaining: 13m 52s. Rate: 140.3 symbols/min
[2025-10-24T01:18:14.720820] [INFO ] [MAIN      ] BDX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:14.733784] [DEBUG] [LOCAL     ] BDJ: Loaded 29478 existing records from primary storage.
[2025-10-24T01:18:14.733941] [INFO ] [MAIN      ] BDJ: Loaded 29478 primary data records.
[2025-10-24T01:18:15.063984] [DEBUG] [LOCAL     ] BDN: Loaded 47979 existing records from primary storage.
[2025-10-24T01:18:15.064759] [INFO ] [MAIN      ] BDN: Loaded 47979 primary data records.
[2025-10-24T01:18:15.198711] [DEBUG] [LOCAL     ] BDX: Loaded 52509 existing records from primary storage.
[2025-10-24T01:18:15.226744] [INFO ] [MAIN      ] BDX: Loaded 52509 primary data records.
[2025-10-24T01:18:15.712250] [DEBUG] [MAIN      ] BDJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:15.764007] [DEBUG] [MAIN      ] BDN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:15.812118] [DEBUG] [MAIN      ] BDX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:15.838154] [INFO ] [MAIN      ] BDJ: Generated 139 derivative records from 29478 primary records.
[2025-10-24T01:18:15.841589] [DEBUG] [LOCAL     ] BDJ: Saving derivative data.
[2025-10-24T01:18:15.865137] [DEBUG] [LOCAL     ] BDJ: Derivative data saved (139 records).
[2025-10-24T01:18:15.869289] [INFO ] [MAIN      ] BDJ: Successfully saved derivative data.
[2025-10-24T01:18:15.872111] [INFO ] [MAIN      ] Derivative Progress: 220/2164 symbols completed. BDJ took 1.2s. Estimated remaining: 13m 58s. Rate: 139.2 symbols/min
[2025-10-24T01:18:15.879762] [INFO ] [MAIN      ] BE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:15.899246] [INFO ] [MAIN      ] BDN: Generated 139 derivative records from 47979 primary records.
[2025-10-24T01:18:15.901369] [DEBUG] [LOCAL     ] BDN: Saving derivative data.
[2025-10-24T01:18:15.904730] [INFO ] [MAIN      ] BDX: Generated 139 derivative records from 52509 primary records.
[2025-10-24T01:18:15.917172] [DEBUG] [LOCAL     ] BDX: Saving derivative data.
[2025-10-24T01:18:15.917920] [DEBUG] [LOCAL     ] BDN: Derivative data saved (139 records).
[2025-10-24T01:18:15.918784] [INFO ] [MAIN      ] BDN: Successfully saved derivative data.
[2025-10-24T01:18:15.929058] [INFO ] [MAIN      ] Derivative Progress: 221/2164 symbols completed. BDN took 1.2s. Estimated remaining: 13m 54s. Rate: 139.8 symbols/min
[2025-10-24T01:18:15.932688] [INFO ] [MAIN      ] BEKE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:15.934705] [DEBUG] [LOCAL     ] BDX: Derivative data saved (139 records).
[2025-10-24T01:18:15.935408] [INFO ] [MAIN      ] BDX: Successfully saved derivative data.
[2025-10-24T01:18:15.939050] [INFO ] [MAIN      ] Derivative Progress: 222/2164 symbols completed. BDX took 1.2s. Estimated remaining: 13m 50s. Rate: 140.4 symbols/min
[2025-10-24T01:18:15.953258] [INFO ] [MAIN      ] BEN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:15.978322] [DEBUG] [LOCAL     ] BE: Loaded 54051 existing records from primary storage.
[2025-10-24T01:18:15.978615] [INFO ] [MAIN      ] BE: Loaded 54051 primary data records.
[2025-10-24T01:18:16.218378] [DEBUG] [LOCAL     ] BEKE: Loaded 53575 existing records from primary storage.
[2025-10-24T01:18:16.218863] [INFO ] [MAIN      ] BEKE: Loaded 53575 primary data records.
[2025-10-24T01:18:16.480337] [DEBUG] [LOCAL     ] BEN: Loaded 53501 existing records from primary storage.
[2025-10-24T01:18:16.485510] [INFO ] [MAIN      ] BEN: Loaded 53501 primary data records.
[2025-10-24T01:18:17.010704] [DEBUG] [MAIN      ] BE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:17.055760] [DEBUG] [MAIN      ] BEKE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:17.119511] [DEBUG] [MAIN      ] BEN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:17.122451] [INFO ] [MAIN      ] BE: Generated 139 derivative records from 54051 primary records.
[2025-10-24T01:18:17.138672] [DEBUG] [LOCAL     ] BE: Saving derivative data.
[2025-10-24T01:18:17.163031] [DEBUG] [LOCAL     ] BE: Derivative data saved (139 records).
[2025-10-24T01:18:17.166953] [INFO ] [MAIN      ] BE: Successfully saved derivative data.
[2025-10-24T01:18:17.172995] [INFO ] [MAIN      ] Derivative Progress: 223/2164 symbols completed. BE took 1.3s. Estimated remaining: 13m 57s. Rate: 139.2 symbols/min
[2025-10-24T01:18:17.183631] [INFO ] [MAIN      ] BEKE: Generated 139 derivative records from 53575 primary records.
[2025-10-24T01:18:17.184005] [DEBUG] [LOCAL     ] BEKE: Saving derivative data.
[2025-10-24T01:18:17.197267] [DEBUG] [LOCAL     ] BEKE: Derivative data saved (139 records).
[2025-10-24T01:18:17.197397] [INFO ] [MAIN      ] BEKE: Successfully saved derivative data.
[2025-10-24T01:18:17.200105] [INFO ] [MAIN      ] Derivative Progress: 224/2164 symbols completed. BEKE took 1.3s. Estimated remaining: 13m 53s. Rate: 139.8 symbols/min
[2025-10-24T01:18:17.210200] [INFO ] [MAIN      ] BEN: Generated 139 derivative records from 53501 primary records.
[2025-10-24T01:18:17.210470] [DEBUG] [LOCAL     ] BEN: Saving derivative data.
[2025-10-24T01:18:17.224137] [DEBUG] [LOCAL     ] BEN: Derivative data saved (139 records).
[2025-10-24T01:18:17.224352] [INFO ] [MAIN      ] BEN: Successfully saved derivative data.
[2025-10-24T01:18:17.228594] [INFO ] [MAIN      ] Derivative Progress: 225/2164 symbols completed. BEN took 1.3s. Estimated remaining: 13m 49s. Rate: 140.4 symbols/min
[2025-10-24T01:18:17.229261] [INFO ] [MAIN      ] BEP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:17.229468] [INFO ] [MAIN      ] BEPH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:17.229619] [INFO ] [MAIN      ] BEPC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:17.244758] [DEBUG] [LOCAL     ] BEPH: Loaded 4915 existing records from primary storage.
[2025-10-24T01:18:17.244991] [INFO ] [MAIN      ] BEPH: Loaded 4915 primary data records.
[2025-10-24T01:18:17.592467] [DEBUG] [LOCAL     ] BEP: Loaded 39180 existing records from primary storage.
[2025-10-24T01:18:17.593338] [INFO ] [MAIN      ] BEP: Loaded 39180 primary data records.
[2025-10-24T01:18:17.625801] [DEBUG] [LOCAL     ] BEPC: Loaded 46678 existing records from primary storage.
[2025-10-24T01:18:17.650767] [INFO ] [MAIN      ] BEPC: Loaded 46678 primary data records.
[2025-10-24T01:18:18.252312] [DEBUG] [MAIN      ] BEPH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:18.303300] [DEBUG] [MAIN      ] BEP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:18.344095] [INFO ] [MAIN      ] BEPH: Generated 139 derivative records from 4915 primary records.
[2025-10-24T01:18:18.345468] [DEBUG] [MAIN      ] BEPC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:18.345855] [DEBUG] [LOCAL     ] BEPH: Saving derivative data.
[2025-10-24T01:18:18.373837] [DEBUG] [LOCAL     ] BEPH: Derivative data saved (139 records).
[2025-10-24T01:18:18.375054] [INFO ] [MAIN      ] BEPH: Successfully saved derivative data.
[2025-10-24T01:18:18.377939] [INFO ] [MAIN      ] Derivative Progress: 226/2164 symbols completed. BEPH took 1.1s. Estimated remaining: 13m 55s. Rate: 139.3 symbols/min
[2025-10-24T01:18:18.380960] [INFO ] [MAIN      ] BEPI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:18.395011] [DEBUG] [LOCAL     ] BEPI: Loaded 3579 existing records from primary storage.
[2025-10-24T01:18:18.398156] [INFO ] [MAIN      ] BEPI: Loaded 3579 primary data records.
[2025-10-24T01:18:18.505714] [INFO ] [MAIN      ] BEP: Generated 139 derivative records from 39180 primary records.
[2025-10-24T01:18:18.521852] [DEBUG] [LOCAL     ] BEP: Saving derivative data.
[2025-10-24T01:18:18.703183] [INFO ] [MAIN      ] BEPC: Generated 139 derivative records from 46678 primary records.
[2025-10-24T01:18:18.715259] [DEBUG] [LOCAL     ] BEPC: Saving derivative data.
[2025-10-24T01:18:18.717337] [DEBUG] [LOCAL     ] BEP: Derivative data saved (139 records).
[2025-10-24T01:18:18.717781] [INFO ] [MAIN      ] BEP: Successfully saved derivative data.
[2025-10-24T01:18:18.729315] [INFO ] [MAIN      ] Derivative Progress: 227/2164 symbols completed. BEP took 1.5s. Estimated remaining: 13m 53s. Rate: 139.4 symbols/min
[2025-10-24T01:18:18.729879] [INFO ] [MAIN      ] BEPJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:18.735116] [DEBUG] [LOCAL     ] BEPC: Derivative data saved (139 records).
[2025-10-24T01:18:18.736258] [INFO ] [MAIN      ] BEPC: Successfully saved derivative data.
[2025-10-24T01:18:18.739360] [INFO ] [MAIN      ] Derivative Progress: 228/2164 symbols completed. BEPC took 1.5s. Estimated remaining: 13m 49s. Rate: 140.0 symbols/min
[2025-10-24T01:18:18.739889] [INFO ] [MAIN      ] BFAM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:18.743083] [DEBUG] [LOCAL     ] BEPJ: Loaded 3089 existing records from primary storage.
[2025-10-24T01:18:18.743417] [INFO ] [MAIN      ] BEPJ: Loaded 3089 primary data records.
[2025-10-24T01:18:19.094893] [DEBUG] [MAIN      ] BEPI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:19.096135] [DEBUG] [LOCAL     ] BFAM: Loaded 34042 existing records from primary storage.
[2025-10-24T01:18:19.112021] [INFO ] [MAIN      ] BFAM: Loaded 34042 primary data records.
[2025-10-24T01:18:19.491541] [DEBUG] [MAIN      ] BEPJ: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:18:19.491827] [INFO ] [MAIN      ] BEPI: Generated 139 derivative records from 3579 primary records.
[2025-10-24T01:18:19.505194] [DEBUG] [LOCAL     ] BEPI: Saving derivative data.
[2025-10-24T01:18:19.520882] [DEBUG] [LOCAL     ] BEPI: Derivative data saved (139 records).
[2025-10-24T01:18:19.521040] [INFO ] [MAIN      ] BEPI: Successfully saved derivative data.
[2025-10-24T01:18:19.526633] [INFO ] [MAIN      ] Derivative Progress: 229/2164 symbols completed. BEPI took 1.1s. Estimated remaining: 13m 52s. Rate: 139.5 symbols/min
[2025-10-24T01:18:19.528048] [INFO ] [MAIN      ] BFH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:19.554880] [INFO ] [MAIN      ] BEPJ: Generated 139 derivative records from 3089 primary records.
[2025-10-24T01:18:19.555377] [DEBUG] [LOCAL     ] BEPJ: Saving derivative data.
[2025-10-24T01:18:19.591036] [DEBUG] [LOCAL     ] BEPJ: Derivative data saved (139 records).
[2025-10-24T01:18:19.586966] [DEBUG] [MAIN      ] BFAM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:19.602322] [INFO ] [MAIN      ] BEPJ: Successfully saved derivative data.
[2025-10-24T01:18:19.610127] [INFO ] [MAIN      ] Derivative Progress: 230/2164 symbols completed. BEPJ took 0.9s. Estimated remaining: 13m 49s. Rate: 140.0 symbols/min
[2025-10-24T01:18:19.625245] [INFO ] [MAIN      ] BFK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:19.626856] [DEBUG] [LOCAL     ] BFH: Loaded 41734 existing records from primary storage.
[2025-10-24T01:18:19.630407] [INFO ] [MAIN      ] BFH: Loaded 41734 primary data records.
[2025-10-24T01:18:19.769253] [DEBUG] [LOCAL     ] BFK: Loaded 14005 existing records from primary storage.
[2025-10-24T01:18:19.784514] [INFO ] [MAIN      ] BFK: Loaded 14005 primary data records.
[2025-10-24T01:18:19.955001] [INFO ] [MAIN      ] BFAM: Generated 139 derivative records from 34042 primary records.
[2025-10-24T01:18:20.098148] [DEBUG] [LOCAL     ] BFAM: Saving derivative data.
[2025-10-24T01:18:20.144922] [DEBUG] [LOCAL     ] BFAM: Derivative data saved (139 records).
[2025-10-24T01:18:20.145419] [INFO ] [MAIN      ] BFAM: Successfully saved derivative data.
[2025-10-24T01:18:20.173429] [INFO ] [MAIN      ] Derivative Progress: 231/2164 symbols completed. BFAM took 1.4s. Estimated remaining: 13m 49s. Rate: 139.8 symbols/min
[2025-10-24T01:18:20.182714] [INFO ] [MAIN      ] BFLY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:20.458151] [DEBUG] [MAIN      ] BFH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:20.523537] [DEBUG] [LOCAL     ] BFLY: Loaded 52246 existing records from primary storage.
[2025-10-24T01:18:20.526196] [INFO ] [MAIN      ] BFLY: Loaded 52246 primary data records.
[2025-10-24T01:18:20.626092] [DEBUG] [MAIN      ] BFK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:20.882159] [INFO ] [MAIN      ] BFH: Generated 139 derivative records from 41734 primary records.
[2025-10-24T01:18:20.884917] [DEBUG] [LOCAL     ] BFH: Saving derivative data.
[2025-10-24T01:18:20.899919] [DEBUG] [LOCAL     ] BFH: Derivative data saved (139 records).
[2025-10-24T01:18:20.900050] [INFO ] [MAIN      ] BFH: Successfully saved derivative data.
[2025-10-24T01:18:20.903308] [INFO ] [MAIN      ] Derivative Progress: 232/2164 symbols completed. BFH took 1.4s. Estimated remaining: 13m 52s. Rate: 139.4 symbols/min
[2025-10-24T01:18:20.903563] [INFO ] [MAIN      ] BFS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:20.921740] [INFO ] [MAIN      ] BFK: Generated 139 derivative records from 14005 primary records.
[2025-10-24T01:18:20.926848] [DEBUG] [LOCAL     ] BFS: Loaded 9613 existing records from primary storage.
[2025-10-24T01:18:20.927184] [DEBUG] [LOCAL     ] BFK: Saving derivative data.
[2025-10-24T01:18:20.927261] [INFO ] [MAIN      ] BFS: Loaded 9613 primary data records.
[2025-10-24T01:18:20.984265] [DEBUG] [LOCAL     ] BFK: Derivative data saved (139 records).
[2025-10-24T01:18:20.984900] [INFO ] [MAIN      ] BFK: Successfully saved derivative data.
[2025-10-24T01:18:20.995411] [INFO ] [MAIN      ] Derivative Progress: 233/2164 symbols completed. BFK took 1.4s. Estimated remaining: 13m 48s. Rate: 139.9 symbols/min
[2025-10-24T01:18:20.996182] [INFO ] [MAIN      ] BFZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:21.073269] [DEBUG] [MAIN      ] BFLY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:21.152685] [DEBUG] [LOCAL     ] BFZ: Loaded 12179 existing records from primary storage.
[2025-10-24T01:18:21.283126] [INFO ] [MAIN      ] BFZ: Loaded 12179 primary data records.
[2025-10-24T01:18:21.682046] [DEBUG] [MAIN      ] BFS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:21.682887] [INFO ] [MAIN      ] BFLY: Generated 139 derivative records from 52246 primary records.
[2025-10-24T01:18:21.698949] [DEBUG] [LOCAL     ] BFLY: Saving derivative data.
[2025-10-24T01:18:21.721471] [DEBUG] [LOCAL     ] BFLY: Derivative data saved (139 records).
[2025-10-24T01:18:21.725715] [INFO ] [MAIN      ] BFLY: Successfully saved derivative data.
[2025-10-24T01:18:21.729388] [INFO ] [MAIN      ] Derivative Progress: 234/2164 symbols completed. BFLY took 1.5s. Estimated remaining: 13m 50s. Rate: 139.5 symbols/min
[2025-10-24T01:18:21.730351] [INFO ] [MAIN      ] BG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:21.764553] [INFO ] [MAIN      ] BFS: Generated 139 derivative records from 9613 primary records.
[2025-10-24T01:18:21.764748] [DEBUG] [LOCAL     ] BFS: Saving derivative data.
[2025-10-24T01:18:21.762475] [DEBUG] [MAIN      ] BFZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:21.796464] [DEBUG] [LOCAL     ] BFS: Derivative data saved (139 records).
[2025-10-24T01:18:21.797179] [INFO ] [MAIN      ] BFS: Successfully saved derivative data.
[2025-10-24T01:18:21.799385] [INFO ] [MAIN      ] Derivative Progress: 235/2164 symbols completed. BFS took 0.9s. Estimated remaining: 13m 47s. Rate: 140.0 symbols/min
[2025-10-24T01:18:21.801265] [INFO ] [MAIN      ] BGB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:21.835561] [INFO ] [MAIN      ] BFZ: Generated 139 derivative records from 12179 primary records.
[2025-10-24T01:18:21.848221] [DEBUG] [LOCAL     ] BFZ: Saving derivative data.
[2025-10-24T01:18:21.851201] [DEBUG] [LOCAL     ] BG: Loaded 50877 existing records from primary storage.
[2025-10-24T01:18:21.864426] [INFO ] [MAIN      ] BG: Loaded 50877 primary data records.
[2025-10-24T01:18:21.866897] [DEBUG] [LOCAL     ] BGB: Loaded 17727 existing records from primary storage.
[2025-10-24T01:18:21.890417] [DEBUG] [LOCAL     ] BFZ: Derivative data saved (139 records).
[2025-10-24T01:18:21.890567] [INFO ] [MAIN      ] BGB: Loaded 17727 primary data records.
[2025-10-24T01:18:21.890628] [INFO ] [MAIN      ] BFZ: Successfully saved derivative data.
[2025-10-24T01:18:21.909058] [INFO ] [MAIN      ] Derivative Progress: 236/2164 symbols completed. BFZ took 0.9s. Estimated remaining: 13m 44s. Rate: 140.4 symbols/min
[2025-10-24T01:18:21.931728] [INFO ] [MAIN      ] BGH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:22.167768] [DEBUG] [LOCAL     ] BGH: Loaded 17182 existing records from primary storage.
[2025-10-24T01:18:22.282230] [INFO ] [MAIN      ] BGH: Loaded 17182 primary data records.
[2025-10-24T01:18:22.873022] [DEBUG] [MAIN      ] BG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:22.914255] [DEBUG] [MAIN      ] BGB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:22.960038] [DEBUG] [MAIN      ] BGH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:23.001727] [INFO ] [MAIN      ] BG: Generated 139 derivative records from 50877 primary records.
[2025-10-24T01:18:23.002202] [DEBUG] [LOCAL     ] BG: Saving derivative data.
[2025-10-24T01:18:23.022549] [DEBUG] [LOCAL     ] BG: Derivative data saved (139 records).
[2025-10-24T01:18:23.030000] [INFO ] [MAIN      ] BG: Successfully saved derivative data.
[2025-10-24T01:18:23.035895] [INFO ] [MAIN      ] Derivative Progress: 237/2164 symbols completed. BG took 1.3s. Estimated remaining: 13m 49s. Rate: 139.4 symbols/min
[2025-10-24T01:18:23.037933] [INFO ] [MAIN      ] BGR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:23.045078] [INFO ] [MAIN      ] BGB: Generated 139 derivative records from 17727 primary records.
[2025-10-24T01:18:23.046877] [DEBUG] [LOCAL     ] BGB: Saving derivative data.
[2025-10-24T01:18:23.071009] [DEBUG] [LOCAL     ] BGB: Derivative data saved (139 records).
[2025-10-24T01:18:23.079316] [INFO ] [MAIN      ] BGH: Generated 139 derivative records from 17182 primary records.
[2025-10-24T01:18:23.078900] [DEBUG] [LOCAL     ] BGR: Loaded 13505 existing records from primary storage.
[2025-10-24T01:18:23.079537] [INFO ] [MAIN      ] BGR: Loaded 13505 primary data records.
[2025-10-24T01:18:23.079691] [DEBUG] [LOCAL     ] BGH: Saving derivative data.
[2025-10-24T01:18:23.079752] [INFO ] [MAIN      ] BGB: Successfully saved derivative data.
[2025-10-24T01:18:23.127089] [INFO ] [MAIN      ] Derivative Progress: 238/2164 symbols completed. BGB took 1.3s. Estimated remaining: 13m 46s. Rate: 139.9 symbols/min
[2025-10-24T01:18:23.188535] [DEBUG] [LOCAL     ] BGH: Derivative data saved (139 records).
[2025-10-24T01:18:23.198940] [INFO ] [MAIN      ] BGH: Successfully saved derivative data.
[2025-10-24T01:18:23.202230] [INFO ] [MAIN      ] Derivative Progress: 239/2164 symbols completed. BGH took 1.3s. Estimated remaining: 13m 43s. Rate: 140.4 symbols/min
[2025-10-24T01:18:23.407301] [DEBUG] [MAIN      ] BGR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:23.433301] [INFO ] [MAIN      ] BGR: Generated 139 derivative records from 13505 primary records.
[2025-10-24T01:18:23.433484] [DEBUG] [LOCAL     ] BGR: Saving derivative data.
[2025-10-24T01:18:23.445101] [DEBUG] [LOCAL     ] BGR: Derivative data saved (139 records).
[2025-10-24T01:18:23.445181] [INFO ] [MAIN      ] BGR: Successfully saved derivative data.
[2025-10-24T01:18:23.447629] [INFO ] [MAIN      ] Derivative Progress: 240/2164 symbols completed. BGR took 0.4s. Estimated remaining: 13m 41s. Rate: 140.6 symbols/min
[2025-10-24T01:18:23.448342] [INFO ] [MAIN      ] BGT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:23.448427] [INFO ] [MAIN      ] BGSF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:23.448212] [INFO ] [MAIN      ] BGS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:23.463676] [DEBUG] [LOCAL     ] BGSF: Loaded 8278 existing records from primary storage.
[2025-10-24T01:18:23.463835] [INFO ] [MAIN      ] BGSF: Loaded 8278 primary data records.
[2025-10-24T01:18:23.535745] [DEBUG] [LOCAL     ] BGT: Loaded 16269 existing records from primary storage.
[2025-10-24T01:18:23.561590] [INFO ] [MAIN      ] BGT: Loaded 16269 primary data records.
[2025-10-24T01:18:23.919205] [DEBUG] [LOCAL     ] BGS: Loaded 50870 existing records from primary storage.
[2025-10-24T01:18:23.935941] [INFO ] [MAIN      ] BGS: Loaded 50870 primary data records.
[2025-10-24T01:18:24.457197] [DEBUG] [MAIN      ] BGSF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:24.498605] [DEBUG] [MAIN      ] BGT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:24.540012] [DEBUG] [MAIN      ] BGS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:24.545986] [INFO ] [MAIN      ] BGSF: Generated 139 derivative records from 8278 primary records.
[2025-10-24T01:18:24.560252] [DEBUG] [LOCAL     ] BGSF: Saving derivative data.
[2025-10-24T01:18:24.575105] [DEBUG] [LOCAL     ] BGSF: Derivative data saved (139 records).
[2025-10-24T01:18:24.577420] [INFO ] [MAIN      ] BGSF: Successfully saved derivative data.
[2025-10-24T01:18:24.581335] [INFO ] [MAIN      ] Derivative Progress: 241/2164 symbols completed. BGSF took 1.1s. Estimated remaining: 13m 46s. Rate: 139.7 symbols/min
[2025-10-24T01:18:24.581623] [INFO ] [MAIN      ] BGX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:24.609199] [INFO ] [MAIN      ] BGT: Generated 139 derivative records from 16269 primary records.
[2025-10-24T01:18:24.609675] [DEBUG] [LOCAL     ] BGX: Loaded 11274 existing records from primary storage.
[2025-10-24T01:18:24.612341] [INFO ] [MAIN      ] BGX: Loaded 11274 primary data records.
[2025-10-24T01:18:24.612238] [DEBUG] [LOCAL     ] BGT: Saving derivative data.
[2025-10-24T01:18:24.681464] [DEBUG] [LOCAL     ] BGT: Derivative data saved (139 records).
[2025-10-24T01:18:24.714457] [INFO ] [MAIN      ] BGT: Successfully saved derivative data.
[2025-10-24T01:18:24.714298] [INFO ] [MAIN      ] BGS: Generated 139 derivative records from 50870 primary records.
[2025-10-24T01:18:24.730834] [DEBUG] [LOCAL     ] BGS: Saving derivative data.
[2025-10-24T01:18:24.734924] [INFO ] [MAIN      ] Derivative Progress: 242/2164 symbols completed. BGT took 1.3s. Estimated remaining: 13m 43s. Rate: 140.0 symbols/min
[2025-10-24T01:18:24.742961] [INFO ] [MAIN      ] BGY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:24.763503] [DEBUG] [LOCAL     ] BGS: Derivative data saved (139 records).
[2025-10-24T01:18:24.763629] [INFO ] [MAIN      ] BGS: Successfully saved derivative data.
[2025-10-24T01:18:24.772231] [INFO ] [MAIN      ] Derivative Progress: 243/2164 symbols completed. BGS took 1.3s. Estimated remaining: 13m 40s. Rate: 140.6 symbols/min
[2025-10-24T01:18:24.772545] [INFO ] [MAIN      ] BH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:24.996833] [DEBUG] [LOCAL     ] BGY: Loaded 21463 existing records from primary storage.
[2025-10-24T01:18:24.997893] [DEBUG] [LOCAL     ] BH: Loaded 16562 existing records from primary storage.
[2025-10-24T01:18:24.998584] [INFO ] [MAIN      ] BGY: Loaded 21463 primary data records.
[2025-10-24T01:18:24.999137] [INFO ] [MAIN      ] BH: Loaded 16562 primary data records.
[2025-10-24T01:18:25.622203] [DEBUG] [MAIN      ] BGX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:25.692894] [DEBUG] [MAIN      ] BH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:25.693783] [DEBUG] [MAIN      ] BGY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:25.731313] [INFO ] [MAIN      ] BGX: Generated 139 derivative records from 11274 primary records.
[2025-10-24T01:18:25.734532] [DEBUG] [LOCAL     ] BGX: Saving derivative data.
[2025-10-24T01:18:25.755896] [DEBUG] [LOCAL     ] BGX: Derivative data saved (139 records).
[2025-10-24T01:18:25.756078] [INFO ] [MAIN      ] BGX: Successfully saved derivative data.
[2025-10-24T01:18:25.762367] [INFO ] [MAIN      ] Derivative Progress: 244/2164 symbols completed. BGX took 1.2s. Estimated remaining: 13m 44s. Rate: 139.8 symbols/min
[2025-10-24T01:18:25.762554] [INFO ] [MAIN      ] BHC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:25.784924] [INFO ] [MAIN      ] BGY: Generated 139 derivative records from 21463 primary records.
[2025-10-24T01:18:25.786726] [INFO ] [MAIN      ] BH: Generated 139 derivative records from 16562 primary records.
[2025-10-24T01:18:25.787108] [DEBUG] [LOCAL     ] BGY: Saving derivative data.
[2025-10-24T01:18:25.787040] [DEBUG] [LOCAL     ] BH: Saving derivative data.
[2025-10-24T01:18:25.807167] [DEBUG] [LOCAL     ] BH: Derivative data saved (139 records).
[2025-10-24T01:18:25.820972] [INFO ] [MAIN      ] BH: Successfully saved derivative data.
[2025-10-24T01:18:25.821810] [DEBUG] [LOCAL     ] BGY: Derivative data saved (139 records).
[2025-10-24T01:18:25.822086] [INFO ] [MAIN      ] BGY: Successfully saved derivative data.
[2025-10-24T01:18:25.824551] [INFO ] [MAIN      ] Derivative Progress: 245/2164 symbols completed. BH took 1.1s. Estimated remaining: 13m 41s. Rate: 140.3 symbols/min
[2025-10-24T01:18:25.828095] [INFO ] [MAIN      ] BHE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:25.828176] [INFO ] [MAIN      ] Derivative Progress: 246/2164 symbols completed. BGY took 1.1s. Estimated remaining: 13m 37s. Rate: 140.9 symbols/min
[2025-10-24T01:18:25.828965] [INFO ] [MAIN      ] BHK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:25.847090] [DEBUG] [LOCAL     ] BHC: Loaded 46912 existing records from primary storage.
[2025-10-24T01:18:25.847316] [INFO ] [MAIN      ] BHC: Loaded 46912 primary data records.
[2025-10-24T01:18:25.982753] [DEBUG] [LOCAL     ] BHE: Loaded 23812 existing records from primary storage.
[2025-10-24T01:18:25.994138] [DEBUG] [LOCAL     ] BHK: Loaded 24125 existing records from primary storage.
[2025-10-24T01:18:26.009709] [INFO ] [MAIN      ] BHE: Loaded 23812 primary data records.
[2025-10-24T01:18:26.031227] [INFO ] [MAIN      ] BHK: Loaded 24125 primary data records.
[2025-10-24T01:18:26.854915] [DEBUG] [MAIN      ] BHC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:26.907367] [DEBUG] [MAIN      ] BHE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:26.907635] [DEBUG] [MAIN      ] BHK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:26.965595] [INFO ] [MAIN      ] BHC: Generated 139 derivative records from 46912 primary records.
[2025-10-24T01:18:26.969327] [DEBUG] [LOCAL     ] BHC: Saving derivative data.
[2025-10-24T01:18:26.987692] [DEBUG] [LOCAL     ] BHC: Derivative data saved (139 records).
[2025-10-24T01:18:26.992595] [INFO ] [MAIN      ] BHC: Successfully saved derivative data.
[2025-10-24T01:18:26.998114] [INFO ] [MAIN      ] Derivative Progress: 247/2164 symbols completed. BHC took 1.2s. Estimated remaining: 13m 42s. Rate: 139.9 symbols/min
[2025-10-24T01:18:27.002027] [INFO ] [MAIN      ] BHP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:27.005604] [INFO ] [MAIN      ] BHK: Generated 139 derivative records from 24125 primary records.
[2025-10-24T01:18:27.006988] [DEBUG] [LOCAL     ] BHK: Saving derivative data.
[2025-10-24T01:18:27.010224] [INFO ] [MAIN      ] BHE: Generated 139 derivative records from 23812 primary records.
[2025-10-24T01:18:27.017403] [DEBUG] [LOCAL     ] BHE: Saving derivative data.
[2025-10-24T01:18:27.021721] [DEBUG] [LOCAL     ] BHK: Derivative data saved (139 records).
[2025-10-24T01:18:27.022149] [INFO ] [MAIN      ] BHK: Successfully saved derivative data.
[2025-10-24T01:18:27.025368] [INFO ] [MAIN      ] Derivative Progress: 248/2164 symbols completed. BHK took 1.2s. Estimated remaining: 13m 39s. Rate: 140.4 symbols/min
[2025-10-24T01:18:27.025580] [INFO ] [MAIN      ] BHR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:27.037633] [DEBUG] [LOCAL     ] BHE: Derivative data saved (139 records).
[2025-10-24T01:18:27.037925] [INFO ] [MAIN      ] BHE: Successfully saved derivative data.
[2025-10-24T01:18:27.040788] [INFO ] [MAIN      ] Derivative Progress: 249/2164 symbols completed. BHE took 1.2s. Estimated remaining: 13m 35s. Rate: 141.0 symbols/min
[2025-10-24T01:18:27.041238] [INFO ] [MAIN      ] BHVN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:27.076434] [DEBUG] [LOCAL     ] BHR: Loaded 22181 existing records from primary storage.
[2025-10-24T01:18:27.076592] [INFO ] [MAIN      ] BHR: Loaded 22181 primary data records.
[2025-10-24T01:18:27.209259] [DEBUG] [LOCAL     ] BHP: Loaded 53753 existing records from primary storage.
[2025-10-24T01:18:27.226707] [INFO ] [MAIN      ] BHP: Loaded 53753 primary data records.
[2025-10-24T01:18:27.519776] [DEBUG] [LOCAL     ] BHVN: Loaded 51012 existing records from primary storage.
[2025-10-24T01:18:27.531728] [INFO ] [MAIN      ] BHVN: Loaded 51012 primary data records.
[2025-10-24T01:18:28.051490] [DEBUG] [MAIN      ] BHR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:28.098105] [DEBUG] [MAIN      ] BHP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:28.140266] [INFO ] [MAIN      ] BHR: Generated 139 derivative records from 22181 primary records.
[2025-10-24T01:18:28.137947] [DEBUG] [MAIN      ] BHVN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:28.140581] [DEBUG] [LOCAL     ] BHR: Saving derivative data.
[2025-10-24T01:18:28.169870] [DEBUG] [LOCAL     ] BHR: Derivative data saved (139 records).
[2025-10-24T01:18:28.171954] [INFO ] [MAIN      ] BHR: Successfully saved derivative data.
[2025-10-24T01:18:28.174863] [INFO ] [MAIN      ] Derivative Progress: 250/2164 symbols completed. BHR took 1.1s. Estimated remaining: 13m 40s. Rate: 140.0 symbols/min
[2025-10-24T01:18:28.175686] [INFO ] [MAIN      ] BILL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:28.208800] [INFO ] [MAIN      ] BHP: Generated 139 derivative records from 53753 primary records.
[2025-10-24T01:18:28.209866] [DEBUG] [LOCAL     ] BHP: Saving derivative data.
[2025-10-24T01:18:28.243238] [DEBUG] [LOCAL     ] BHP: Derivative data saved (139 records).
[2025-10-24T01:18:28.243869] [INFO ] [MAIN      ] BHVN: Generated 139 derivative records from 51012 primary records.
[2025-10-24T01:18:28.244119] [INFO ] [MAIN      ] BHP: Successfully saved derivative data.
[2025-10-24T01:18:28.246714] [INFO ] [MAIN      ] Derivative Progress: 251/2164 symbols completed. BHP took 1.2s. Estimated remaining: 13m 37s. Rate: 140.5 symbols/min
[2025-10-24T01:18:28.247006] [INFO ] [MAIN      ] BIO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:28.244322] [DEBUG] [LOCAL     ] BHVN: Saving derivative data.
[2025-10-24T01:18:28.260826] [DEBUG] [LOCAL     ] BHVN: Derivative data saved (139 records).
[2025-10-24T01:18:28.263398] [INFO ] [MAIN      ] BHVN: Successfully saved derivative data.
[2025-10-24T01:18:28.281746] [INFO ] [MAIN      ] Derivative Progress: 252/2164 symbols completed. BHVN took 1.2s. Estimated remaining: 13m 34s. Rate: 141.0 symbols/min
[2025-10-24T01:18:28.282021] [INFO ] [MAIN      ] BIP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:28.284612] [DEBUG] [LOCAL     ] BILL: Loaded 52879 existing records from primary storage.
[2025-10-24T01:18:28.285230] [INFO ] [MAIN      ] BILL: Loaded 52879 primary data records.
[2025-10-24T01:18:28.382177] [DEBUG] [LOCAL     ] BIO: Loaded 23969 existing records from primary storage.
[2025-10-24T01:18:28.401403] [INFO ] [MAIN      ] BIO: Loaded 23969 primary data records.
[2025-10-24T01:18:28.717920] [DEBUG] [LOCAL     ] BIP: Loaded 39164 existing records from primary storage.
[2025-10-24T01:18:28.736506] [INFO ] [MAIN      ] BIP: Loaded 39164 primary data records.
[2025-10-24T01:18:29.323490] [DEBUG] [MAIN      ] BILL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:29.355632] [DEBUG] [MAIN      ] BIO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:29.413693] [DEBUG] [MAIN      ] BIP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:29.445022] [INFO ] [MAIN      ] BILL: Generated 139 derivative records from 52879 primary records.
[2025-10-24T01:18:29.448225] [DEBUG] [LOCAL     ] BILL: Saving derivative data.
[2025-10-24T01:18:29.466306] [DEBUG] [LOCAL     ] BILL: Derivative data saved (139 records).
[2025-10-24T01:18:29.466854] [INFO ] [MAIN      ] BILL: Successfully saved derivative data.
[2025-10-24T01:18:29.463551] [INFO ] [MAIN      ] BIO: Generated 139 derivative records from 23969 primary records.
[2025-10-24T01:18:29.466995] [DEBUG] [LOCAL     ] BIO: Saving derivative data.
[2025-10-24T01:18:29.470000] [INFO ] [MAIN      ] Derivative Progress: 253/2164 symbols completed. BILL took 1.3s. Estimated remaining: 13m 39s. Rate: 140.0 symbols/min
[2025-10-24T01:18:29.485179] [DEBUG] [LOCAL     ] BIO: Derivative data saved (139 records).
[2025-10-24T01:18:29.489252] [INFO ] [MAIN      ] BIO: Successfully saved derivative data.
[2025-10-24T01:18:29.493060] [INFO ] [MAIN      ] Derivative Progress: 254/2164 symbols completed. BIO took 1.2s. Estimated remaining: 13m 35s. Rate: 140.5 symbols/min
[2025-10-24T01:18:29.497798] [INFO ] [MAIN      ] BIP: Generated 139 derivative records from 39164 primary records.
[2025-10-24T01:18:29.497986] [DEBUG] [LOCAL     ] BIP: Saving derivative data.
[2025-10-24T01:18:29.510024] [DEBUG] [LOCAL     ] BIP: Derivative data saved (139 records).
[2025-10-24T01:18:29.510110] [INFO ] [MAIN      ] BIP: Successfully saved derivative data.
[2025-10-24T01:18:29.512929] [INFO ] [MAIN      ] Derivative Progress: 255/2164 symbols completed. BIP took 1.2s. Estimated remaining: 13m 32s. Rate: 141.1 symbols/min
[2025-10-24T01:18:29.513382] [INFO ] [MAIN      ] BIPC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:29.513560] [INFO ] [MAIN      ] BIPH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:29.513940] [INFO ] [MAIN      ] BIPI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:29.522409] [DEBUG] [LOCAL     ] BIPI: Loaded 2834 existing records from primary storage.
[2025-10-24T01:18:29.524849] [DEBUG] [LOCAL     ] BIPH: Loaded 2366 existing records from primary storage.
[2025-10-24T01:18:29.525084] [INFO ] [MAIN      ] BIPI: Loaded 2834 primary data records.
[2025-10-24T01:18:29.525411] [INFO ] [MAIN      ] BIPH: Loaded 2366 primary data records.
[2025-10-24T01:18:30.164535] [DEBUG] [LOCAL     ] BIPC: Loaded 41390 existing records from primary storage.
[2025-10-24T01:18:30.165859] [INFO ] [MAIN      ] BIPC: Loaded 41390 primary data records.
[2025-10-24T01:18:30.508629] [DEBUG] [MAIN      ] BIPH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:30.533943] [DEBUG] [MAIN      ] BIPI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:30.593853] [DEBUG] [MAIN      ] BIPC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:30.642436] [INFO ] [MAIN      ] BIPH: Generated 139 derivative records from 2366 primary records.
[2025-10-24T01:18:30.638087] [INFO ] [MAIN      ] BIPI: Generated 139 derivative records from 2834 primary records.
[2025-10-24T01:18:30.643313] [DEBUG] [LOCAL     ] BIPI: Saving derivative data.
[2025-10-24T01:18:30.643210] [DEBUG] [LOCAL     ] BIPH: Saving derivative data.
[2025-10-24T01:18:30.664422] [DEBUG] [LOCAL     ] BIPI: Derivative data saved (139 records).
[2025-10-24T01:18:30.668795] [DEBUG] [LOCAL     ] BIPH: Derivative data saved (139 records).
[2025-10-24T01:18:30.669037] [INFO ] [MAIN      ] BIPI: Successfully saved derivative data.
[2025-10-24T01:18:30.669110] [INFO ] [MAIN      ] BIPH: Successfully saved derivative data.
[2025-10-24T01:18:30.672255] [INFO ] [MAIN      ] Derivative Progress: 256/2164 symbols completed. BIPH took 1.2s. Estimated remaining: 13m 37s. Rate: 140.1 symbols/min
[2025-10-24T01:18:30.672429] [INFO ] [MAIN      ] BIPJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:30.676755] [INFO ] [MAIN      ] Derivative Progress: 257/2164 symbols completed. BIPI took 1.2s. Estimated remaining: 13m 33s. Rate: 140.7 symbols/min
[2025-10-24T01:18:30.678108] [INFO ] [MAIN      ] BIRK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:30.690461] [DEBUG] [LOCAL     ] BIPJ: Loaded 3108 existing records from primary storage.
[2025-10-24T01:18:30.690884] [INFO ] [MAIN      ] BIPJ: Loaded 3108 primary data records.
[2025-10-24T01:18:30.730034] [INFO ] [MAIN      ] BIPC: Generated 139 derivative records from 41390 primary records.
[2025-10-24T01:18:30.757563] [DEBUG] [LOCAL     ] BIPC: Saving derivative data.
[2025-10-24T01:18:30.810084] [DEBUG] [LOCAL     ] BIPC: Derivative data saved (139 records).
[2025-10-24T01:18:30.810288] [INFO ] [MAIN      ] BIPC: Successfully saved derivative data.
[2025-10-24T01:18:30.818929] [INFO ] [MAIN      ] Derivative Progress: 258/2164 symbols completed. BIPC took 1.3s. Estimated remaining: 13m 31s. Rate: 141.0 symbols/min
[2025-10-24T01:18:30.824569] [INFO ] [MAIN      ] BIT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:31.078381] [DEBUG] [LOCAL     ] BIRK: Loaded 51506 existing records from primary storage.
[2025-10-24T01:18:31.083765] [INFO ] [MAIN      ] BIRK: Loaded 51506 primary data records.
[2025-10-24T01:18:31.172177] [DEBUG] [LOCAL     ] BIT: Loaded 23886 existing records from primary storage.
[2025-10-24T01:18:31.182722] [INFO ] [MAIN      ] BIT: Loaded 23886 primary data records.
[2025-10-24T01:18:31.600205] [DEBUG] [MAIN      ] BIPJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:31.780053] [DEBUG] [MAIN      ] BIRK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:31.817774] [DEBUG] [MAIN      ] BIT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:31.853115] [INFO ] [MAIN      ] BIPJ: Generated 139 derivative records from 3108 primary records.
[2025-10-24T01:18:31.859597] [DEBUG] [LOCAL     ] BIPJ: Saving derivative data.
[2025-10-24T01:18:31.880217] [DEBUG] [LOCAL     ] BIPJ: Derivative data saved (139 records).
[2025-10-24T01:18:31.880439] [INFO ] [MAIN      ] BIPJ: Successfully saved derivative data.
[2025-10-24T01:18:31.883670] [INFO ] [MAIN      ] Derivative Progress: 259/2164 symbols completed. BIPJ took 1.2s. Estimated remaining: 13m 35s. Rate: 140.2 symbols/min
[2025-10-24T01:18:31.884352] [INFO ] [MAIN      ] BJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:31.900530] [INFO ] [MAIN      ] BIRK: Generated 139 derivative records from 51506 primary records.
[2025-10-24T01:18:31.903232] [DEBUG] [LOCAL     ] BIRK: Saving derivative data.
[2025-10-24T01:18:31.922826] [DEBUG] [LOCAL     ] BIRK: Derivative data saved (139 records).
[2025-10-24T01:18:31.924620] [INFO ] [MAIN      ] BIT: Generated 139 derivative records from 23886 primary records.
[2025-10-24T01:18:31.924893] [INFO ] [MAIN      ] BIRK: Successfully saved derivative data.
[2025-10-24T01:18:31.928814] [INFO ] [MAIN      ] Derivative Progress: 260/2164 symbols completed. BIRK took 1.3s. Estimated remaining: 13m 32s. Rate: 140.7 symbols/min
[2025-10-24T01:18:31.929115] [DEBUG] [LOCAL     ] BIT: Saving derivative data.
[2025-10-24T01:18:31.929370] [INFO ] [MAIN      ] BK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:31.956510] [DEBUG] [LOCAL     ] BIT: Derivative data saved (139 records).
[2025-10-24T01:18:31.956764] [INFO ] [MAIN      ] BIT: Successfully saved derivative data.
[2025-10-24T01:18:31.959679] [INFO ] [MAIN      ] Derivative Progress: 261/2164 symbols completed. BIT took 1.1s. Estimated remaining: 13m 29s. Rate: 141.2 symbols/min
[2025-10-24T01:18:31.960155] [INFO ] [MAIN      ] BKD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:31.980280] [DEBUG] [LOCAL     ] BJ: Loaded 51834 existing records from primary storage.
[2025-10-24T01:18:31.980551] [INFO ] [MAIN      ] BJ: Loaded 51834 primary data records.
[2025-10-24T01:18:32.353363] [DEBUG] [LOCAL     ] BK: Loaded 53936 existing records from primary storage.
[2025-10-24T01:18:32.353880] [INFO ] [MAIN      ] BK: Loaded 53936 primary data records.
[2025-10-24T01:18:32.371724] [DEBUG] [LOCAL     ] BKD: Loaded 50716 existing records from primary storage.
[2025-10-24T01:18:32.390285] [INFO ] [MAIN      ] BKD: Loaded 50716 primary data records.
[2025-10-24T01:18:33.052240] [DEBUG] [MAIN      ] BJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:33.097055] [DEBUG] [MAIN      ] BK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:33.132286] [DEBUG] [MAIN      ] BKD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:33.182872] [INFO ] [MAIN      ] BJ: Generated 139 derivative records from 51834 primary records.
[2025-10-24T01:18:33.186832] [DEBUG] [LOCAL     ] BJ: Saving derivative data.
[2025-10-24T01:18:33.206795] [DEBUG] [LOCAL     ] BJ: Derivative data saved (139 records).
[2025-10-24T01:18:33.209070] [INFO ] [MAIN      ] BJ: Successfully saved derivative data.
[2025-10-24T01:18:33.216321] [INFO ] [MAIN      ] Derivative Progress: 262/2164 symbols completed. BJ took 1.3s. Estimated remaining: 13m 34s. Rate: 140.2 symbols/min
[2025-10-24T01:18:33.217353] [INFO ] [MAIN      ] BKE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:33.224317] [INFO ] [MAIN      ] BK: Generated 139 derivative records from 53936 primary records.
[2025-10-24T01:18:33.225512] [DEBUG] [LOCAL     ] BK: Saving derivative data.
[2025-10-24T01:18:33.243126] [INFO ] [MAIN      ] BKD: Generated 139 derivative records from 50716 primary records.
[2025-10-24T01:18:33.246310] [DEBUG] [LOCAL     ] BK: Derivative data saved (139 records).
[2025-10-24T01:18:33.246434] [DEBUG] [LOCAL     ] BKD: Saving derivative data.
[2025-10-24T01:18:33.247405] [INFO ] [MAIN      ] BK: Successfully saved derivative data.
[2025-10-24T01:18:33.259714] [INFO ] [MAIN      ] Derivative Progress: 263/2164 symbols completed. BK took 1.3s. Estimated remaining: 13m 31s. Rate: 140.6 symbols/min
[2025-10-24T01:18:33.260512] [INFO ] [MAIN      ] BKH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:33.264912] [DEBUG] [LOCAL     ] BKD: Derivative data saved (139 records).
[2025-10-24T01:18:33.265290] [INFO ] [MAIN      ] BKD: Successfully saved derivative data.
[2025-10-24T01:18:33.268311] [INFO ] [MAIN      ] Derivative Progress: 264/2164 symbols completed. BKD took 1.3s. Estimated remaining: 13m 28s. Rate: 141.2 symbols/min
[2025-10-24T01:18:33.268694] [INFO ] [MAIN      ] BKKT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:33.321451] [DEBUG] [LOCAL     ] BKE: Loaded 33794 existing records from primary storage.
[2025-10-24T01:18:33.321933] [INFO ] [MAIN      ] BKE: Loaded 33794 primary data records.
[2025-10-24T01:18:33.460902] [DEBUG] [LOCAL     ] BKKT: Loaded 37753 existing records from primary storage.
[2025-10-24T01:18:33.461169] [INFO ] [MAIN      ] BKKT: Loaded 37753 primary data records.
[2025-10-24T01:18:33.459133] [DEBUG] [LOCAL     ] BKH: Loaded 37650 existing records from primary storage.
[2025-10-24T01:18:33.491719] [INFO ] [MAIN      ] BKH: Loaded 37650 primary data records.
[2025-10-24T01:18:34.399389] [DEBUG] [MAIN      ] BKE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:34.429548] [DEBUG] [MAIN      ] BKKT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:34.482781] [DEBUG] [MAIN      ] BKH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:34.538517] [INFO ] [MAIN      ] BKE: Generated 139 derivative records from 33794 primary records.
[2025-10-24T01:18:34.542093] [DEBUG] [LOCAL     ] BKE: Saving derivative data.
[2025-10-24T01:18:34.546377] [INFO ] [MAIN      ] BKKT: Generated 139 derivative records from 37753 primary records.
[2025-10-24T01:18:34.562223] [DEBUG] [LOCAL     ] BKKT: Saving derivative data.
[2025-10-24T01:18:34.559336] [DEBUG] [LOCAL     ] BKE: Derivative data saved (139 records).
[2025-10-24T01:18:34.564037] [INFO ] [MAIN      ] BKE: Successfully saved derivative data.
[2025-10-24T01:18:34.566329] [INFO ] [MAIN      ] Derivative Progress: 265/2164 symbols completed. BKE took 1.3s. Estimated remaining: 13m 33s. Rate: 140.1 symbols/min
[2025-10-24T01:18:34.578833] [INFO ] [MAIN      ] BKN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:34.582254] [DEBUG] [LOCAL     ] BKKT: Derivative data saved (139 records).
[2025-10-24T01:18:34.586981] [INFO ] [MAIN      ] BKKT: Successfully saved derivative data.
[2025-10-24T01:18:34.591438] [INFO ] [MAIN      ] Derivative Progress: 266/2164 symbols completed. BKKT took 1.3s. Estimated remaining: 13m 30s. Rate: 140.6 symbols/min
[2025-10-24T01:18:34.592384] [INFO ] [MAIN      ] BKSY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:34.599166] [INFO ] [MAIN      ] BKH: Generated 139 derivative records from 37650 primary records.
[2025-10-24T01:18:34.599352] [DEBUG] [LOCAL     ] BKH: Saving derivative data.
[2025-10-24T01:18:34.611174] [DEBUG] [LOCAL     ] BKN: Loaded 7337 existing records from primary storage.
[2025-10-24T01:18:34.611298] [INFO ] [MAIN      ] BKN: Loaded 7337 primary data records.
[2025-10-24T01:18:34.649008] [DEBUG] [LOCAL     ] BKH: Derivative data saved (139 records).
[2025-10-24T01:18:34.695697] [INFO ] [MAIN      ] BKH: Successfully saved derivative data.
[2025-10-24T01:18:34.724158] [INFO ] [MAIN      ] Derivative Progress: 267/2164 symbols completed. BKH took 1.5s. Estimated remaining: 13m 28s. Rate: 140.9 symbols/min
[2025-10-24T01:18:34.724578] [INFO ] [MAIN      ] BKT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:34.951373] [DEBUG] [LOCAL     ] BKT: Loaded 12907 existing records from primary storage.
[2025-10-24T01:18:34.952024] [INFO ] [MAIN      ] BKT: Loaded 12907 primary data records.
[2025-10-24T01:18:34.995408] [DEBUG] [LOCAL     ] BKSY: Loaded 49291 existing records from primary storage.
[2025-10-24T01:18:35.036721] [INFO ] [MAIN      ] BKSY: Loaded 49291 primary data records.
[2025-10-24T01:18:35.685485] [DEBUG] [MAIN      ] BKN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:35.736816] [DEBUG] [MAIN      ] BKT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:35.775496] [DEBUG] [MAIN      ] BKSY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:35.807514] [INFO ] [MAIN      ] BKN: Generated 139 derivative records from 7337 primary records.
[2025-10-24T01:18:35.812689] [DEBUG] [LOCAL     ] BKN: Saving derivative data.
[2025-10-24T01:18:35.826898] [DEBUG] [LOCAL     ] BKN: Derivative data saved (139 records).
[2025-10-24T01:18:35.827370] [INFO ] [MAIN      ] BKN: Successfully saved derivative data.
[2025-10-24T01:18:35.833896] [INFO ] [MAIN      ] Derivative Progress: 268/2164 symbols completed. BKN took 1.3s. Estimated remaining: 13m 32s. Rate: 140.1 symbols/min
[2025-10-24T01:18:35.848160] [INFO ] [MAIN      ] BKT: Generated 139 derivative records from 12907 primary records.
[2025-10-24T01:18:35.849397] [DEBUG] [LOCAL     ] BKT: Saving derivative data.
[2025-10-24T01:18:35.866867] [DEBUG] [LOCAL     ] BKT: Derivative data saved (139 records).
[2025-10-24T01:18:35.868872] [INFO ] [MAIN      ] BKT: Successfully saved derivative data.
[2025-10-24T01:18:35.871470] [INFO ] [MAIN      ] Derivative Progress: 269/2164 symbols completed. BKT took 1.1s. Estimated remaining: 13m 29s. Rate: 140.6 symbols/min
[2025-10-24T01:18:35.871838] [INFO ] [MAIN      ] BKSY: Generated 139 derivative records from 49291 primary records.
[2025-10-24T01:18:35.872279] [DEBUG] [LOCAL     ] BKSY: Saving derivative data.
[2025-10-24T01:18:35.885685] [DEBUG] [LOCAL     ] BKSY: Derivative data saved (139 records).
[2025-10-24T01:18:35.885796] [INFO ] [MAIN      ] BKSY: Successfully saved derivative data.
[2025-10-24T01:18:35.890325] [INFO ] [MAIN      ] Derivative Progress: 270/2164 symbols completed. BKSY took 1.3s. Estimated remaining: 13m 26s. Rate: 141.1 symbols/min
[2025-10-24T01:18:35.891202] [INFO ] [MAIN      ] BLCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:35.891095] [INFO ] [MAIN      ] BKU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:35.891295] [INFO ] [MAIN      ] BKV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:35.957876] [DEBUG] [LOCAL     ] BKV: Loaded 29546 existing records from primary storage.
[2025-10-24T01:18:35.960357] [DEBUG] [LOCAL     ] BLCO: Loaded 35092 existing records from primary storage.
[2025-10-24T01:18:35.962134] [INFO ] [MAIN      ] BLCO: Loaded 35092 primary data records.
[2025-10-24T01:18:35.962367] [INFO ] [MAIN      ] BKV: Loaded 29546 primary data records.
[2025-10-24T01:18:36.030242] [DEBUG] [LOCAL     ] BKU: Loaded 42479 existing records from primary storage.
[2025-10-24T01:18:36.088722] [INFO ] [MAIN      ] BKU: Loaded 42479 primary data records.
[2025-10-24T01:18:36.958112] [DEBUG] [MAIN      ] BKV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:37.006265] [DEBUG] [MAIN      ] BKU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:37.016172] [DEBUG] [MAIN      ] BLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:37.098773] [INFO ] [MAIN      ] BKV: Generated 139 derivative records from 29546 primary records.
[2025-10-24T01:18:37.104685] [DEBUG] [LOCAL     ] BKV: Saving derivative data.
[2025-10-24T01:18:37.121366] [DEBUG] [LOCAL     ] BKV: Derivative data saved (139 records).
[2025-10-24T01:18:37.121803] [INFO ] [MAIN      ] BKV: Successfully saved derivative data.
[2025-10-24T01:18:37.126463] [INFO ] [MAIN      ] Derivative Progress: 271/2164 symbols completed. BKV took 1.2s. Estimated remaining: 13m 31s. Rate: 140.1 symbols/min
[2025-10-24T01:18:37.127033] [INFO ] [MAIN      ] BLD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:37.129841] [INFO ] [MAIN      ] BKU: Generated 139 derivative records from 42479 primary records.
[2025-10-24T01:18:37.133144] [DEBUG] [LOCAL     ] BKU: Saving derivative data.
[2025-10-24T01:18:37.152850] [INFO ] [MAIN      ] BLCO: Generated 139 derivative records from 35092 primary records.
[2025-10-24T01:18:37.152970] [DEBUG] [LOCAL     ] BKU: Derivative data saved (139 records).
[2025-10-24T01:18:37.153488] [INFO ] [MAIN      ] BKU: Successfully saved derivative data.
[2025-10-24T01:18:37.156764] [INFO ] [MAIN      ] Derivative Progress: 272/2164 symbols completed. BKU took 1.3s. Estimated remaining: 13m 28s. Rate: 140.6 symbols/min
[2025-10-24T01:18:37.164561] [DEBUG] [LOCAL     ] BLCO: Saving derivative data.
[2025-10-24T01:18:37.164807] [INFO ] [MAIN      ] BLE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:37.179823] [DEBUG] [LOCAL     ] BLCO: Derivative data saved (139 records).
[2025-10-24T01:18:37.188516] [INFO ] [MAIN      ] BLCO: Successfully saved derivative data.
[2025-10-24T01:18:37.191552] [INFO ] [MAIN      ] Derivative Progress: 273/2164 symbols completed. BLCO took 1.3s. Estimated remaining: 13m 24s. Rate: 141.0 symbols/min
[2025-10-24T01:18:37.193853] [DEBUG] [LOCAL     ] BLD: Loaded 27205 existing records from primary storage.
[2025-10-24T01:18:37.197391] [INFO ] [MAIN      ] BLK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:37.197950] [INFO ] [MAIN      ] BLD: Loaded 27205 primary data records.
[2025-10-24T01:18:37.266831] [DEBUG] [LOCAL     ] BLE: Loaded 13680 existing records from primary storage.
[2025-10-24T01:18:37.289802] [INFO ] [MAIN      ] BLE: Loaded 13680 primary data records.
[2025-10-24T01:18:37.740331] [DEBUG] [LOCAL     ] BLK: Loaded 34356 existing records from primary storage.
[2025-10-24T01:18:37.749790] [INFO ] [MAIN      ] BLK: Loaded 34356 primary data records.
[2025-10-24T01:18:38.248543] [DEBUG] [MAIN      ] BLE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:38.260967] [DEBUG] [MAIN      ] BLD: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:18:38.328235] [DEBUG] [MAIN      ] BLK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:38.368480] [INFO ] [MAIN      ] BLD: Generated 139 derivative records from 27205 primary records.
[2025-10-24T01:18:38.370536] [DEBUG] [LOCAL     ] BLD: Saving derivative data.
[2025-10-24T01:18:38.383163] [INFO ] [MAIN      ] BLE: Generated 139 derivative records from 13680 primary records.
[2025-10-24T01:18:38.389881] [DEBUG] [LOCAL     ] BLD: Derivative data saved (139 records).
[2025-10-24T01:18:38.390671] [INFO ] [MAIN      ] BLD: Successfully saved derivative data.
[2025-10-24T01:18:38.390374] [DEBUG] [LOCAL     ] BLE: Saving derivative data.
[2025-10-24T01:18:38.397509] [INFO ] [MAIN      ] Derivative Progress: 274/2164 symbols completed. BLD took 1.3s. Estimated remaining: 13m 29s. Rate: 140.1 symbols/min
[2025-10-24T01:18:38.397875] [INFO ] [MAIN      ] BLND: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:38.413799] [DEBUG] [LOCAL     ] BLE: Derivative data saved (139 records).
[2025-10-24T01:18:38.416252] [INFO ] [MAIN      ] BLE: Successfully saved derivative data.
[2025-10-24T01:18:38.423986] [INFO ] [MAIN      ] Derivative Progress: 275/2164 symbols completed. BLE took 1.3s. Estimated remaining: 13m 26s. Rate: 140.6 symbols/min
[2025-10-24T01:18:38.424340] [INFO ] [MAIN      ] BLW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:38.432090] [INFO ] [MAIN      ] BLK: Generated 139 derivative records from 34356 primary records.
[2025-10-24T01:18:38.432229] [DEBUG] [LOCAL     ] BLK: Saving derivative data.
[2025-10-24T01:18:38.451631] [DEBUG] [LOCAL     ] BLK: Derivative data saved (139 records).
[2025-10-24T01:18:38.451813] [INFO ] [MAIN      ] BLK: Successfully saved derivative data.
[2025-10-24T01:18:38.455427] [INFO ] [MAIN      ] Derivative Progress: 276/2164 symbols completed. BLK took 1.3s. Estimated remaining: 13m 23s. Rate: 141.1 symbols/min
[2025-10-24T01:18:38.455844] [INFO ] [MAIN      ] BLX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:38.474385] [DEBUG] [LOCAL     ] BLW: Loaded 13028 existing records from primary storage.
[2025-10-24T01:18:38.474611] [INFO ] [MAIN      ] BLW: Loaded 13028 primary data records.
[2025-10-24T01:18:38.619969] [DEBUG] [LOCAL     ] BLND: Loaded 49593 existing records from primary storage.
[2025-10-24T01:18:38.627015] [INFO ] [MAIN      ] BLND: Loaded 49593 primary data records.
[2025-10-24T01:18:38.643601] [DEBUG] [LOCAL     ] BLX: Loaded 15499 existing records from primary storage.
[2025-10-24T01:18:38.700748] [INFO ] [MAIN      ] BLX: Loaded 15499 primary data records.
[2025-10-24T01:18:39.479566] [DEBUG] [MAIN      ] BLW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:39.586396] [DEBUG] [MAIN      ] BLND: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:39.587550] [DEBUG] [MAIN      ] BLX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:39.650764] [INFO ] [MAIN      ] BLW: Generated 139 derivative records from 13028 primary records.
[2025-10-24T01:18:39.653956] [DEBUG] [LOCAL     ] BLW: Saving derivative data.
[2025-10-24T01:18:39.675374] [DEBUG] [LOCAL     ] BLW: Derivative data saved (139 records).
[2025-10-24T01:18:39.677233] [INFO ] [MAIN      ] BLW: Successfully saved derivative data.
[2025-10-24T01:18:39.684068] [INFO ] [MAIN      ] Derivative Progress: 277/2164 symbols completed. BLW took 1.3s. Estimated remaining: 13m 28s. Rate: 140.1 symbols/min
[2025-10-24T01:18:39.685106] [INFO ] [MAIN      ] BMA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:39.684683] [INFO ] [MAIN      ] BLND: Generated 139 derivative records from 49593 primary records.
[2025-10-24T01:18:39.685299] [DEBUG] [LOCAL     ] BLND: Saving derivative data.
[2025-10-24T01:18:39.690343] [INFO ] [MAIN      ] BLX: Generated 139 derivative records from 15499 primary records.
[2025-10-24T01:18:39.690737] [DEBUG] [LOCAL     ] BLX: Saving derivative data.
[2025-10-24T01:18:39.702171] [DEBUG] [LOCAL     ] BLND: Derivative data saved (139 records).
[2025-10-24T01:18:39.702998] [INFO ] [MAIN      ] BLND: Successfully saved derivative data.
[2025-10-24T01:18:39.712998] [INFO ] [MAIN      ] Derivative Progress: 278/2164 symbols completed. BLND took 1.3s. Estimated remaining: 13m 25s. Rate: 140.6 symbols/min
[2025-10-24T01:18:39.716203] [INFO ] [MAIN      ] BME: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:39.719893] [DEBUG] [LOCAL     ] BLX: Derivative data saved (139 records).
[2025-10-24T01:18:39.720008] [INFO ] [MAIN      ] BLX: Successfully saved derivative data.
[2025-10-24T01:18:39.722747] [INFO ] [MAIN      ] Derivative Progress: 279/2164 symbols completed. BLX took 1.3s. Estimated remaining: 13m 22s. Rate: 141.1 symbols/min
[2025-10-24T01:18:39.722951] [INFO ] [MAIN      ] BMEZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:39.733827] [DEBUG] [LOCAL     ] BME: Loaded 11273 existing records from primary storage.
[2025-10-24T01:18:39.734085] [INFO ] [MAIN      ] BME: Loaded 11273 primary data records.
[2025-10-24T01:18:39.955887] [DEBUG] [LOCAL     ] BMA: Loaded 36874 existing records from primary storage.
[2025-10-24T01:18:39.960692] [DEBUG] [LOCAL     ] BMEZ: Loaded 25188 existing records from primary storage.
[2025-10-24T01:18:40.061722] [INFO ] [MAIN      ] BMA: Loaded 36874 primary data records.
[2025-10-24T01:18:40.018727] [INFO ] [MAIN      ] BMEZ: Loaded 25188 primary data records.
[2025-10-24T01:18:40.783636] [DEBUG] [MAIN      ] BME: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:40.839773] [DEBUG] [MAIN      ] BMA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:40.867720] [INFO ] [MAIN      ] BME: Generated 139 derivative records from 11273 primary records.
[2025-10-24T01:18:40.874690] [DEBUG] [LOCAL     ] BME: Saving derivative data.
[2025-10-24T01:18:40.875551] [DEBUG] [MAIN      ] BMEZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:40.905309] [DEBUG] [LOCAL     ] BME: Derivative data saved (139 records).
[2025-10-24T01:18:40.907608] [INFO ] [MAIN      ] BME: Successfully saved derivative data.
[2025-10-24T01:18:40.910377] [INFO ] [MAIN      ] Derivative Progress: 280/2164 symbols completed. BME took 1.2s. Estimated remaining: 13m 26s. Rate: 140.2 symbols/min
[2025-10-24T01:18:40.911130] [INFO ] [MAIN      ] BMI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:40.967487] [DEBUG] [LOCAL     ] BMI: Loaded 25126 existing records from primary storage.
[2025-10-24T01:18:40.974339] [INFO ] [MAIN      ] BMA: Generated 139 derivative records from 36874 primary records.
[2025-10-24T01:18:40.974468] [DEBUG] [LOCAL     ] BMA: Saving derivative data.
[2025-10-24T01:18:40.975154] [INFO ] [MAIN      ] BMI: Loaded 25126 primary data records.
[2025-10-24T01:18:40.988285] [DEBUG] [LOCAL     ] BMA: Derivative data saved (139 records).
[2025-10-24T01:18:40.988402] [INFO ] [MAIN      ] BMA: Successfully saved derivative data.
[2025-10-24T01:18:41.031809] [INFO ] [MAIN      ] Derivative Progress: 281/2164 symbols completed. BMA took 1.3s. Estimated remaining: 13m 24s. Rate: 140.5 symbols/min
[2025-10-24T01:18:41.063001] [INFO ] [MAIN      ] BMN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:41.063463] [INFO ] [MAIN      ] BMEZ: Generated 139 derivative records from 25188 primary records.
[2025-10-24T01:18:41.086451] [DEBUG] [LOCAL     ] BMEZ: Saving derivative data.
[2025-10-24T01:18:41.123923] [DEBUG] [LOCAL     ] BMEZ: Derivative data saved (139 records).
[2025-10-24T01:18:41.130074] [INFO ] [MAIN      ] BMEZ: Successfully saved derivative data.
[2025-10-24T01:18:41.160051] [DEBUG] [LOCAL     ] BMN: Loaded 2661 existing records from primary storage.
[2025-10-24T01:18:41.159742] [INFO ] [MAIN      ] Derivative Progress: 282/2164 symbols completed. BMEZ took 1.4s. Estimated remaining: 13m 22s. Rate: 140.9 symbols/min
[2025-10-24T01:18:41.191123] [INFO ] [MAIN      ] BMN: Loaded 2661 primary data records.
[2025-10-24T01:18:41.211810] [INFO ] [MAIN      ] BMO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:41.682702] [DEBUG] [LOCAL     ] BMO: Loaded 41220 existing records from primary storage.
[2025-10-24T01:18:41.684456] [INFO ] [MAIN      ] BMO: Loaded 41220 primary data records.
[2025-10-24T01:18:41.684056] [DEBUG] [MAIN      ] BMI: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:18:41.980399] [DEBUG] [MAIN      ] BMN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:42.148493] [INFO ] [MAIN      ] BMI: Generated 139 derivative records from 25126 primary records.
[2025-10-24T01:18:42.149529] [DEBUG] [LOCAL     ] BMI: Saving derivative data.
[2025-10-24T01:18:42.169150] [DEBUG] [LOCAL     ] BMI: Derivative data saved (139 records).
[2025-10-24T01:18:42.171026] [INFO ] [MAIN      ] BMI: Successfully saved derivative data.
[2025-10-24T01:18:42.174354] [INFO ] [MAIN      ] Derivative Progress: 283/2164 symbols completed. BMI took 1.3s. Estimated remaining: 13m 25s. Rate: 140.2 symbols/min
[2025-10-24T01:18:42.182633] [INFO ] [MAIN      ] BMN: Generated 139 derivative records from 2661 primary records.
[2025-10-24T01:18:42.183009] [DEBUG] [LOCAL     ] BMN: Saving derivative data.
[2025-10-24T01:18:42.196882] [DEBUG] [LOCAL     ] BMN: Derivative data saved (139 records).
[2025-10-24T01:18:42.197098] [INFO ] [MAIN      ] BMN: Successfully saved derivative data.
[2025-10-24T01:18:42.201331] [INFO ] [MAIN      ] Derivative Progress: 284/2164 symbols completed. BMN took 1.1s. Estimated remaining: 13m 22s. Rate: 140.7 symbols/min
[2025-10-24T01:18:42.214296] [DEBUG] [MAIN      ] BMO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:42.242097] [INFO ] [MAIN      ] BMO: Generated 139 derivative records from 41220 primary records.
[2025-10-24T01:18:42.242264] [DEBUG] [LOCAL     ] BMO: Saving derivative data.
[2025-10-24T01:18:42.255148] [DEBUG] [LOCAL     ] BMO: Derivative data saved (139 records).
[2025-10-24T01:18:42.255258] [INFO ] [MAIN      ] BMO: Successfully saved derivative data.
[2025-10-24T01:18:42.259582] [INFO ] [MAIN      ] Derivative Progress: 285/2164 symbols completed. BMO took 1.0s. Estimated remaining: 13m 19s. Rate: 141.1 symbols/min
[2025-10-24T01:18:42.260424] [INFO ] [MAIN      ] BNED: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:42.260344] [INFO ] [MAIN      ] BMY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:42.260530] [INFO ] [MAIN      ] BN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:42.300118] [DEBUG] [LOCAL     ] BNED: Loaded 28371 existing records from primary storage.
[2025-10-24T01:18:42.300573] [INFO ] [MAIN      ] BNED: Loaded 28371 primary data records.
[2025-10-24T01:18:42.506722] [DEBUG] [LOCAL     ] BMY: Loaded 54147 existing records from primary storage.
[2025-10-24T01:18:42.507221] [INFO ] [MAIN      ] BMY: Loaded 54147 primary data records.
[2025-10-24T01:18:42.580223] [DEBUG] [LOCAL     ] BN: Loaded 53372 existing records from primary storage.
[2025-10-24T01:18:42.751855] [INFO ] [MAIN      ] BN: Loaded 53372 primary data records.
[2025-10-24T01:18:43.376202] [DEBUG] [MAIN      ] BNED: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:43.427980] [DEBUG] [MAIN      ] BMY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:43.470684] [INFO ] [MAIN      ] BNED: Generated 139 derivative records from 28371 primary records.
[2025-10-24T01:18:43.488507] [DEBUG] [LOCAL     ] BNED: Saving derivative data.
[2025-10-24T01:18:43.494387] [DEBUG] [MAIN      ] BN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:43.520952] [DEBUG] [LOCAL     ] BNED: Derivative data saved (139 records).
[2025-10-24T01:18:43.521151] [INFO ] [MAIN      ] BNED: Successfully saved derivative data.
[2025-10-24T01:18:43.524482] [INFO ] [MAIN      ] Derivative Progress: 286/2164 symbols completed. BNED took 1.3s. Estimated remaining: 13m 24s. Rate: 140.1 symbols/min
[2025-10-24T01:18:43.528944] [INFO ] [MAIN      ] BNH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:43.547924] [DEBUG] [LOCAL     ] BNH: Loaded 4720 existing records from primary storage.
[2025-10-24T01:18:43.554395] [INFO ] [MAIN      ] BNH: Loaded 4720 primary data records.
[2025-10-24T01:18:43.554833] [INFO ] [MAIN      ] BMY: Generated 139 derivative records from 54147 primary records.
[2025-10-24T01:18:43.562102] [DEBUG] [LOCAL     ] BMY: Saving derivative data.
[2025-10-24T01:18:43.764424] [DEBUG] [LOCAL     ] BMY: Derivative data saved (139 records).
[2025-10-24T01:18:43.891583] [INFO ] [MAIN      ] BMY: Successfully saved derivative data.
[2025-10-24T01:18:43.895072] [INFO ] [MAIN      ] Derivative Progress: 287/2164 symbols completed. BMY took 1.6s. Estimated remaining: 13m 23s. Rate: 140.2 symbols/min
[2025-10-24T01:18:43.895984] [INFO ] [MAIN      ] BNJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:43.916369] [INFO ] [MAIN      ] BN: Generated 139 derivative records from 53372 primary records.
[2025-10-24T01:18:43.920524] [DEBUG] [LOCAL     ] BNJ: Loaded 2508 existing records from primary storage.
[2025-10-24T01:18:43.921438] [DEBUG] [LOCAL     ] BN: Saving derivative data.
[2025-10-24T01:18:43.920923] [INFO ] [MAIN      ] BNJ: Loaded 2508 primary data records.
[2025-10-24T01:18:44.044750] [DEBUG] [LOCAL     ] BN: Derivative data saved (139 records).
[2025-10-24T01:18:44.067338] [INFO ] [MAIN      ] BN: Successfully saved derivative data.
[2025-10-24T01:18:44.110481] [INFO ] [MAIN      ] Derivative Progress: 288/2164 symbols completed. BN took 1.8s. Estimated remaining: 13m 22s. Rate: 140.4 symbols/min
[2025-10-24T01:18:44.310336] [INFO ] [MAIN      ] BNL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:44.345760] [DEBUG] [MAIN      ] BNH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:44.418279] [DEBUG] [MAIN      ] BNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:44.433357] [INFO ] [MAIN      ] BNH: Generated 139 derivative records from 4720 primary records.
[2025-10-24T01:18:44.447005] [DEBUG] [LOCAL     ] BNH: Saving derivative data.
[2025-10-24T01:18:44.449230] [DEBUG] [LOCAL     ] BNL: Loaded 47358 existing records from primary storage.
[2025-10-24T01:18:44.452482] [INFO ] [MAIN      ] BNL: Loaded 47358 primary data records.
[2025-10-24T01:18:44.540184] [DEBUG] [LOCAL     ] BNH: Derivative data saved (139 records).
[2025-10-24T01:18:44.540365] [INFO ] [MAIN      ] BNH: Successfully saved derivative data.
[2025-10-24T01:18:44.562833] [INFO ] [MAIN      ] Derivative Progress: 289/2164 symbols completed. BNH took 1.0s. Estimated remaining: 13m 21s. Rate: 140.4 symbols/min
[2025-10-24T01:18:44.577447] [INFO ] [MAIN      ] BNS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:44.800493] [INFO ] [MAIN      ] BNJ: Generated 139 derivative records from 2508 primary records.
[2025-10-24T01:18:44.801748] [DEBUG] [LOCAL     ] BNJ: Saving derivative data.
[2025-10-24T01:18:44.814402] [DEBUG] [LOCAL     ] BNJ: Derivative data saved (139 records).
[2025-10-24T01:18:44.814918] [INFO ] [MAIN      ] BNJ: Successfully saved derivative data.
[2025-10-24T01:18:44.832540] [INFO ] [MAIN      ] Derivative Progress: 290/2164 symbols completed. BNJ took 0.9s. Estimated remaining: 13m 20s. Rate: 140.6 symbols/min
[2025-10-24T01:18:44.833345] [INFO ] [MAIN      ] BNT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:44.841351] [DEBUG] [LOCAL     ] BNT: Loaded 3545 existing records from primary storage.
[2025-10-24T01:18:44.843979] [INFO ] [MAIN      ] BNT: Loaded 3545 primary data records.
[2025-10-24T01:18:44.917077] [DEBUG] [LOCAL     ] BNS: Loaded 51760 existing records from primary storage.
[2025-10-24T01:18:44.943809] [INFO ] [MAIN      ] BNS: Loaded 51760 primary data records.
[2025-10-24T01:18:45.296027] [DEBUG] [MAIN      ] BNL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:45.571891] [INFO ] [MAIN      ] BNL: Generated 139 derivative records from 47358 primary records.
[2025-10-24T01:18:45.586763] [DEBUG] [MAIN      ] BNT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:45.586294] [DEBUG] [LOCAL     ] BNL: Saving derivative data.
[2025-10-24T01:18:45.629687] [DEBUG] [LOCAL     ] BNL: Derivative data saved (139 records).
[2025-10-24T01:18:45.629903] [INFO ] [MAIN      ] BNL: Successfully saved derivative data.
[2025-10-24T01:18:45.636525] [INFO ] [MAIN      ] Derivative Progress: 291/2164 symbols completed. BNL took 1.3s. Estimated remaining: 13m 22s. Rate: 140.1 symbols/min
[2025-10-24T01:18:45.653107] [INFO ] [MAIN      ] BNY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:45.652920] [DEBUG] [MAIN      ] BNS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:45.711026] [DEBUG] [LOCAL     ] BNY: Loaded 7273 existing records from primary storage.
[2025-10-24T01:18:45.717809] [INFO ] [MAIN      ] BNY: Loaded 7273 primary data records.
[2025-10-24T01:18:45.754947] [INFO ] [MAIN      ] BNT: Generated 139 derivative records from 3545 primary records.
[2025-10-24T01:18:45.773301] [DEBUG] [LOCAL     ] BNT: Saving derivative data.
[2025-10-24T01:18:45.873504] [DEBUG] [LOCAL     ] BNT: Derivative data saved (139 records).
[2025-10-24T01:18:45.880352] [INFO ] [MAIN      ] BNS: Generated 139 derivative records from 51760 primary records.
[2025-10-24T01:18:45.927307] [DEBUG] [LOCAL     ] BNS: Saving derivative data.
[2025-10-24T01:18:45.916918] [INFO ] [MAIN      ] BNT: Successfully saved derivative data.
[2025-10-24T01:18:45.948732] [INFO ] [MAIN      ] Derivative Progress: 292/2164 symbols completed. BNT took 1.1s. Estimated remaining: 13m 21s. Rate: 140.3 symbols/min
[2025-10-24T01:18:45.955129] [INFO ] [MAIN      ] BOC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:46.028080] [DEBUG] [LOCAL     ] BNS: Derivative data saved (139 records).
[2025-10-24T01:18:46.071691] [INFO ] [MAIN      ] BNS: Successfully saved derivative data.
[2025-10-24T01:18:46.237585] [INFO ] [MAIN      ] Derivative Progress: 293/2164 symbols completed. BNS took 1.7s. Estimated remaining: 13m 19s. Rate: 140.4 symbols/min
[2025-10-24T01:18:46.239698] [INFO ] [MAIN      ] BOE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:46.252159] [DEBUG] [LOCAL     ] BOC: Loaded 18283 existing records from primary storage.
[2025-10-24T01:18:46.252972] [INFO ] [MAIN      ] BOC: Loaded 18283 primary data records.
[2025-10-24T01:18:46.388779] [DEBUG] [LOCAL     ] BOE: Loaded 18140 existing records from primary storage.
[2025-10-24T01:18:46.408576] [INFO ] [MAIN      ] BOE: Loaded 18140 primary data records.
[2025-10-24T01:18:46.853690] [DEBUG] [MAIN      ] BNY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:47.026931] [DEBUG] [MAIN      ] BOC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:47.062637] [INFO ] [MAIN      ] BNY: Generated 139 derivative records from 7273 primary records.
[2025-10-24T01:18:47.077910] [DEBUG] [LOCAL     ] BNY: Saving derivative data.
[2025-10-24T01:18:47.078638] [DEBUG] [MAIN      ] BOE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:47.093114] [DEBUG] [LOCAL     ] BNY: Derivative data saved (139 records).
[2025-10-24T01:18:47.108925] [INFO ] [MAIN      ] BNY: Successfully saved derivative data.
[2025-10-24T01:18:47.111192] [INFO ] [MAIN      ] Derivative Progress: 294/2164 symbols completed. BNY took 1.5s. Estimated remaining: 13m 22s. Rate: 139.9 symbols/min
[2025-10-24T01:18:47.111804] [INFO ] [MAIN      ] BOH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:47.131355] [INFO ] [MAIN      ] BOC: Generated 139 derivative records from 18283 primary records.
[2025-10-24T01:18:47.134931] [DEBUG] [LOCAL     ] BOC: Saving derivative data.
[2025-10-24T01:18:47.157404] [DEBUG] [LOCAL     ] BOC: Derivative data saved (139 records).
[2025-10-24T01:18:47.158024] [INFO ] [MAIN      ] BOC: Successfully saved derivative data.
[2025-10-24T01:18:47.163755] [INFO ] [MAIN      ] Derivative Progress: 295/2164 symbols completed. BOC took 1.2s. Estimated remaining: 13m 19s. Rate: 140.4 symbols/min
[2025-10-24T01:18:47.164159] [INFO ] [MAIN      ] BOND: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:47.178808] [DEBUG] [LOCAL     ] BOH: Loaded 30852 existing records from primary storage.
[2025-10-24T01:18:47.180384] [INFO ] [MAIN      ] BOH: Loaded 30852 primary data records.
[2025-10-24T01:18:47.247696] [INFO ] [MAIN      ] BOE: Generated 139 derivative records from 18140 primary records.
[2025-10-24T01:18:47.271062] [DEBUG] [LOCAL     ] BOE: Saving derivative data.
[2025-10-24T01:18:47.347263] [DEBUG] [LOCAL     ] BOE: Derivative data saved (139 records).
[2025-10-24T01:18:47.396841] [INFO ] [MAIN      ] BOE: Successfully saved derivative data.
[2025-10-24T01:18:47.508612] [INFO ] [MAIN      ] Derivative Progress: 296/2164 symbols completed. BOE took 1.3s. Estimated remaining: 13m 18s. Rate: 140.4 symbols/min
[2025-10-24T01:18:47.519366] [INFO ] [MAIN      ] BORR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:47.519193] [DEBUG] [LOCAL     ] BOND: Loaded 32652 existing records from primary storage.
[2025-10-24T01:18:47.520104] [INFO ] [MAIN      ] BOND: Loaded 32652 primary data records.
[2025-10-24T01:18:47.862846] [DEBUG] [LOCAL     ] BORR: Loaded 51455 existing records from primary storage.
[2025-10-24T01:18:47.863172] [INFO ] [MAIN      ] BORR: Loaded 51455 primary data records.
[2025-10-24T01:18:47.907730] [DEBUG] [MAIN      ] BOH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:48.217904] [DEBUG] [MAIN      ] BOND: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:48.249183] [INFO ] [MAIN      ] BOH: Generated 139 derivative records from 30852 primary records.
[2025-10-24T01:18:48.252600] [DEBUG] [LOCAL     ] BOH: Saving derivative data.
[2025-10-24T01:18:48.268772] [DEBUG] [LOCAL     ] BOH: Derivative data saved (139 records).
[2025-10-24T01:18:48.269372] [INFO ] [MAIN      ] BOH: Successfully saved derivative data.
[2025-10-24T01:18:48.272270] [INFO ] [MAIN      ] Derivative Progress: 297/2164 symbols completed. BOH took 1.2s. Estimated remaining: 13m 20s. Rate: 140.1 symbols/min
[2025-10-24T01:18:48.276086] [INFO ] [MAIN      ] BOW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:48.300268] [DEBUG] [MAIN      ] BORR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:48.344143] [DEBUG] [LOCAL     ] BOW: Loaded 22949 existing records from primary storage.
[2025-10-24T01:18:48.344910] [INFO ] [MAIN      ] BOND: Generated 139 derivative records from 32652 primary records.
[2025-10-24T01:18:48.348922] [INFO ] [MAIN      ] BOW: Loaded 22949 primary data records.
[2025-10-24T01:18:48.349022] [DEBUG] [LOCAL     ] BOND: Saving derivative data.
[2025-10-24T01:18:48.414981] [DEBUG] [LOCAL     ] BOND: Derivative data saved (139 records).
[2025-10-24T01:18:48.449333] [INFO ] [MAIN      ] BOND: Successfully saved derivative data.
[2025-10-24T01:18:48.478878] [INFO ] [MAIN      ] Derivative Progress: 298/2164 symbols completed. BOND took 1.3s. Estimated remaining: 13m 18s. Rate: 140.3 symbols/min
[2025-10-24T01:18:48.751402] [INFO ] [MAIN      ] BORR: Generated 139 derivative records from 51455 primary records.
[2025-10-24T01:18:48.751628] [DEBUG] [LOCAL     ] BORR: Saving derivative data.
[2025-10-24T01:18:48.765893] [DEBUG] [LOCAL     ] BORR: Derivative data saved (139 records).
[2025-10-24T01:18:48.766671] [INFO ] [MAIN      ] BORR: Successfully saved derivative data.
[2025-10-24T01:18:48.770032] [INFO ] [MAIN      ] Derivative Progress: 299/2164 symbols completed. BORR took 1.3s. Estimated remaining: 13m 17s. Rate: 140.5 symbols/min
[2025-10-24T01:18:48.791513] [DEBUG] [MAIN      ] BOW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:48.819704] [INFO ] [MAIN      ] BOW: Generated 139 derivative records from 22949 primary records.
[2025-10-24T01:18:48.819869] [DEBUG] [LOCAL     ] BOW: Saving derivative data.
[2025-10-24T01:18:48.832203] [DEBUG] [LOCAL     ] BOW: Derivative data saved (139 records).
[2025-10-24T01:18:48.832296] [INFO ] [MAIN      ] BOW: Successfully saved derivative data.
[2025-10-24T01:18:48.834955] [INFO ] [MAIN      ] Derivative Progress: 300/2164 symbols completed. BOW took 0.6s. Estimated remaining: 13m 14s. Rate: 140.9 symbols/min
[2025-10-24T01:18:48.835621] [INFO ] [MAIN      ] BP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:48.835783] [INFO ] [MAIN      ] BR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:48.835854] [INFO ] [MAIN      ] BOX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:48.889412] [DEBUG] [LOCAL     ] BR: Loaded 34763 existing records from primary storage.
[2025-10-24T01:18:48.891431] [INFO ] [MAIN      ] BR: Loaded 34763 primary data records.
[2025-10-24T01:18:48.968997] [DEBUG] [LOCAL     ] BOX: Loaded 50435 existing records from primary storage.
[2025-10-24T01:18:49.003154] [INFO ] [MAIN      ] BOX: Loaded 50435 primary data records.
[2025-10-24T01:18:49.145314] [DEBUG] [LOCAL     ] BP: Loaded 54096 existing records from primary storage.
[2025-10-24T01:18:49.184555] [INFO ] [MAIN      ] BP: Loaded 54096 primary data records.
[2025-10-24T01:18:49.918338] [DEBUG] [MAIN      ] BR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:49.934543] [DEBUG] [MAIN      ] BOX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:49.994700] [DEBUG] [MAIN      ] BP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:50.021508] [INFO ] [MAIN      ] BR: Generated 139 derivative records from 34763 primary records.
[2025-10-24T01:18:50.026304] [INFO ] [MAIN      ] BOX: Generated 139 derivative records from 50435 primary records.
[2025-10-24T01:18:50.026426] [DEBUG] [LOCAL     ] BOX: Saving derivative data.
[2025-10-24T01:18:50.026889] [DEBUG] [LOCAL     ] BR: Saving derivative data.
[2025-10-24T01:18:50.050741] [DEBUG] [LOCAL     ] BOX: Derivative data saved (139 records).
[2025-10-24T01:18:50.051912] [INFO ] [MAIN      ] BOX: Successfully saved derivative data.
[2025-10-24T01:18:50.053111] [DEBUG] [LOCAL     ] BR: Derivative data saved (139 records).
[2025-10-24T01:18:50.056074] [INFO ] [MAIN      ] Derivative Progress: 301/2164 symbols completed. BOX took 1.2s. Estimated remaining: 13m 18s. Rate: 140.0 symbols/min
[2025-10-24T01:18:50.056251] [INFO ] [MAIN      ] BR: Successfully saved derivative data.
[2025-10-24T01:18:50.056392] [INFO ] [MAIN      ] BRBR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:50.059141] [INFO ] [MAIN      ] Derivative Progress: 302/2164 symbols completed. BR took 1.2s. Estimated remaining: 13m 15s. Rate: 140.5 symbols/min
[2025-10-24T01:18:50.059804] [INFO ] [MAIN      ] BRC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:50.080623] [INFO ] [MAIN      ] BP: Generated 139 derivative records from 54096 primary records.
[2025-10-24T01:18:50.080821] [DEBUG] [LOCAL     ] BP: Saving derivative data.
[2025-10-24T01:18:50.097610] [DEBUG] [LOCAL     ] BRC: Loaded 18403 existing records from primary storage.
[2025-10-24T01:18:50.100039] [INFO ] [MAIN      ] BRC: Loaded 18403 primary data records.
[2025-10-24T01:18:50.100507] [DEBUG] [LOCAL     ] BP: Derivative data saved (139 records).
[2025-10-24T01:18:50.112194] [INFO ] [MAIN      ] BP: Successfully saved derivative data.
[2025-10-24T01:18:50.115090] [INFO ] [MAIN      ] Derivative Progress: 303/2164 symbols completed. BP took 1.3s. Estimated remaining: 13m 13s. Rate: 140.9 symbols/min
[2025-10-24T01:18:50.148548] [INFO ] [MAIN      ] BRCC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:50.297275] [DEBUG] [LOCAL     ] BRBR: Loaded 52189 existing records from primary storage.
[2025-10-24T01:18:50.387847] [INFO ] [MAIN      ] BRBR: Loaded 52189 primary data records.
[2025-10-24T01:18:50.704358] [DEBUG] [LOCAL     ] BRCC: Loaded 40288 existing records from primary storage.
[2025-10-24T01:18:50.802142] [INFO ] [MAIN      ] BRCC: Loaded 40288 primary data records.
[2025-10-24T01:18:51.003988] [DEBUG] [MAIN      ] BRC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:51.234674] [DEBUG] [MAIN      ] BRBR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:51.269115] [INFO ] [MAIN      ] BRC: Generated 139 derivative records from 18403 primary records.
[2025-10-24T01:18:51.279153] [DEBUG] [LOCAL     ] BRC: Saving derivative data.
[2025-10-24T01:18:51.288242] [DEBUG] [MAIN      ] BRCC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:51.312812] [DEBUG] [LOCAL     ] BRC: Derivative data saved (139 records).
[2025-10-24T01:18:51.316189] [INFO ] [MAIN      ] BRC: Successfully saved derivative data.
[2025-10-24T01:18:51.319203] [INFO ] [MAIN      ] Derivative Progress: 304/2164 symbols completed. BRC took 1.3s. Estimated remaining: 13m 17s. Rate: 140.0 symbols/min
[2025-10-24T01:18:51.328402] [INFO ] [MAIN      ] BRO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:51.348679] [INFO ] [MAIN      ] BRBR: Generated 139 derivative records from 52189 primary records.
[2025-10-24T01:18:51.352047] [DEBUG] [LOCAL     ] BRBR: Saving derivative data.
[2025-10-24T01:18:51.371200] [DEBUG] [LOCAL     ] BRBR: Derivative data saved (139 records).
[2025-10-24T01:18:51.372546] [INFO ] [MAIN      ] BRBR: Successfully saved derivative data.
[2025-10-24T01:18:51.376555] [INFO ] [MAIN      ] Derivative Progress: 305/2164 symbols completed. BRBR took 1.3s. Estimated remaining: 13m 14s. Rate: 140.4 symbols/min
[2025-10-24T01:18:51.378862] [INFO ] [MAIN      ] BROS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:51.379100] [INFO ] [MAIN      ] BRCC: Generated 139 derivative records from 40288 primary records.
[2025-10-24T01:18:51.379966] [DEBUG] [LOCAL     ] BRCC: Saving derivative data.
[2025-10-24T01:18:51.406836] [DEBUG] [LOCAL     ] BRCC: Derivative data saved (139 records).
[2025-10-24T01:18:51.407083] [INFO ] [MAIN      ] BRCC: Successfully saved derivative data.
[2025-10-24T01:18:51.409997] [INFO ] [MAIN      ] Derivative Progress: 306/2164 symbols completed. BRCC took 1.3s. Estimated remaining: 13m 12s. Rate: 140.8 symbols/min
[2025-10-24T01:18:51.410532] [INFO ] [MAIN      ] BRSP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:51.428833] [DEBUG] [LOCAL     ] BRO: Loaded 52483 existing records from primary storage.
[2025-10-24T01:18:51.429907] [INFO ] [MAIN      ] BRO: Loaded 52483 primary data records.
[2025-10-24T01:18:51.776034] [DEBUG] [LOCAL     ] BRSP: Loaded 36715 existing records from primary storage.
[2025-10-24T01:18:51.776739] [INFO ] [MAIN      ] BRSP: Loaded 36715 primary data records.
[2025-10-24T01:18:51.790213] [DEBUG] [LOCAL     ] BROS: Loaded 53688 existing records from primary storage.
[2025-10-24T01:18:51.800294] [INFO ] [MAIN      ] BROS: Loaded 53688 primary data records.
[2025-10-24T01:18:52.409558] [DEBUG] [MAIN      ] BRO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:52.460613] [DEBUG] [MAIN      ] BRSP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:52.486907] [INFO ] [MAIN      ] BRO: Generated 139 derivative records from 52483 primary records.
[2025-10-24T01:18:52.487816] [DEBUG] [LOCAL     ] BRO: Saving derivative data.
[2025-10-24T01:18:52.502932] [DEBUG] [MAIN      ] BROS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:52.533307] [DEBUG] [LOCAL     ] BRO: Derivative data saved (139 records).
[2025-10-24T01:18:52.535002] [INFO ] [MAIN      ] BRO: Successfully saved derivative data.
[2025-10-24T01:18:52.541309] [INFO ] [MAIN      ] Derivative Progress: 307/2164 symbols completed. BRO took 1.2s. Estimated remaining: 13m 15s. Rate: 140.1 symbols/min
[2025-10-24T01:18:52.546471] [INFO ] [MAIN      ] BRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:52.567317] [DEBUG] [LOCAL     ] BRT: Loaded 5310 existing records from primary storage.
[2025-10-24T01:18:52.567836] [INFO ] [MAIN      ] BRT: Loaded 5310 primary data records.
[2025-10-24T01:18:52.676673] [INFO ] [MAIN      ] BROS: Generated 139 derivative records from 53688 primary records.
[2025-10-24T01:18:52.689757] [DEBUG] [LOCAL     ] BROS: Saving derivative data.
[2025-10-24T01:18:52.690048] [INFO ] [MAIN      ] BRSP: Generated 139 derivative records from 36715 primary records.
[2025-10-24T01:18:52.690917] [DEBUG] [LOCAL     ] BRSP: Saving derivative data.
[2025-10-24T01:18:52.792435] [DEBUG] [LOCAL     ] BRSP: Derivative data saved (139 records).
[2025-10-24T01:18:52.925251] [INFO ] [MAIN      ] BRSP: Successfully saved derivative data.
[2025-10-24T01:18:52.945496] [DEBUG] [LOCAL     ] BROS: Derivative data saved (139 records).
[2025-10-24T01:18:52.945676] [INFO ] [MAIN      ] BROS: Successfully saved derivative data.
[2025-10-24T01:18:52.956714] [INFO ] [MAIN      ] Derivative Progress: 308/2164 symbols completed. BROS took 1.6s. Estimated remaining: 13m 15s. Rate: 140.1 symbols/min
[2025-10-24T01:18:52.959871] [INFO ] [MAIN      ] Derivative Progress: 309/2164 symbols completed. BRSP took 1.5s. Estimated remaining: 13m 12s. Rate: 140.6 symbols/min
[2025-10-24T01:18:52.959806] [INFO ] [MAIN      ] BRW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:52.960140] [INFO ] [MAIN      ] BRX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:52.991905] [DEBUG] [MAIN      ] BRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:53.014201] [DEBUG] [LOCAL     ] BRW: Loaded 21145 existing records from primary storage.
[2025-10-24T01:18:53.015910] [INFO ] [MAIN      ] BRW: Loaded 21145 primary data records.
[2025-10-24T01:18:53.357003] [DEBUG] [LOCAL     ] BRX: Loaded 52194 existing records from primary storage.
[2025-10-24T01:18:53.360374] [INFO ] [MAIN      ] BRX: Loaded 52194 primary data records.
[2025-10-24T01:18:53.466584] [INFO ] [MAIN      ] BRT: Generated 139 derivative records from 5310 primary records.
[2025-10-24T01:18:53.470311] [DEBUG] [LOCAL     ] BRT: Saving derivative data.
[2025-10-24T01:18:53.498852] [DEBUG] [LOCAL     ] BRT: Derivative data saved (139 records).
[2025-10-24T01:18:53.531538] [INFO ] [MAIN      ] BRT: Successfully saved derivative data.
[2025-10-24T01:18:53.679373] [INFO ] [MAIN      ] Derivative Progress: 310/2164 symbols completed. BRT took 1.1s. Estimated remaining: 13m 13s. Rate: 140.2 symbols/min
[2025-10-24T01:18:53.680132] [INFO ] [MAIN      ] BSAC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:53.697981] [DEBUG] [MAIN      ] BRW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:53.752331] [DEBUG] [LOCAL     ] BSAC: Loaded 33040 existing records from primary storage.
[2025-10-24T01:18:53.755718] [INFO ] [MAIN      ] BSAC: Loaded 33040 primary data records.
[2025-10-24T01:18:53.800846] [INFO ] [MAIN      ] BRW: Generated 139 derivative records from 21145 primary records.
[2025-10-24T01:18:53.825713] [DEBUG] [LOCAL     ] BRW: Saving derivative data.
[2025-10-24T01:18:53.813447] [DEBUG] [MAIN      ] BRX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:53.880546] [DEBUG] [LOCAL     ] BRW: Derivative data saved (139 records).
[2025-10-24T01:18:53.896619] [INFO ] [MAIN      ] BRW: Successfully saved derivative data.
[2025-10-24T01:18:53.902307] [INFO ] [MAIN      ] Derivative Progress: 311/2164 symbols completed. BRW took 0.9s. Estimated remaining: 13m 12s. Rate: 140.5 symbols/min
[2025-10-24T01:18:53.902689] [INFO ] [MAIN      ] BSBR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:54.134908] [INFO ] [MAIN      ] BRX: Generated 139 derivative records from 52194 primary records.
[2025-10-24T01:18:54.146792] [DEBUG] [LOCAL     ] BRX: Saving derivative data.
[2025-10-24T01:18:54.147928] [DEBUG] [LOCAL     ] BSBR: Loaded 36041 existing records from primary storage.
[2025-10-24T01:18:54.148183] [INFO ] [MAIN      ] BSBR: Loaded 36041 primary data records.
[2025-10-24T01:18:54.203288] [DEBUG] [LOCAL     ] BRX: Derivative data saved (139 records).
[2025-10-24T01:18:54.217114] [INFO ] [MAIN      ] BRX: Successfully saved derivative data.
[2025-10-24T01:18:54.255977] [INFO ] [MAIN      ] Derivative Progress: 312/2164 symbols completed. BRX took 1.3s. Estimated remaining: 13m 11s. Rate: 140.5 symbols/min
[2025-10-24T01:18:54.276437] [INFO ] [MAIN      ] BSL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:54.502289] [DEBUG] [LOCAL     ] BSL: Loaded 7937 existing records from primary storage.
[2025-10-24T01:18:54.502914] [DEBUG] [MAIN      ] BSAC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:54.503123] [INFO ] [MAIN      ] BSL: Loaded 7937 primary data records.
[2025-10-24T01:18:54.852332] [DEBUG] [MAIN      ] BSBR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:54.908381] [INFO ] [MAIN      ] BSAC: Generated 139 derivative records from 33040 primary records.
[2025-10-24T01:18:54.920934] [DEBUG] [LOCAL     ] BSAC: Saving derivative data.
[2025-10-24T01:18:54.935188] [DEBUG] [LOCAL     ] BSAC: Derivative data saved (139 records).
[2025-10-24T01:18:54.935402] [INFO ] [MAIN      ] BSAC: Successfully saved derivative data.
[2025-10-24T01:18:54.940929] [INFO ] [MAIN      ] Derivative Progress: 313/2164 symbols completed. BSAC took 1.3s. Estimated remaining: 13m 12s. Rate: 140.3 symbols/min
[2025-10-24T01:18:54.964739] [DEBUG] [MAIN      ] BSL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:54.984785] [INFO ] [MAIN      ] BSBR: Generated 139 derivative records from 36041 primary records.
[2025-10-24T01:18:54.986145] [DEBUG] [LOCAL     ] BSBR: Saving derivative data.
[2025-10-24T01:18:55.003515] [DEBUG] [LOCAL     ] BSBR: Derivative data saved (139 records).
[2025-10-24T01:18:55.004809] [INFO ] [MAIN      ] BSBR: Successfully saved derivative data.
[2025-10-24T01:18:55.007539] [INFO ] [MAIN      ] Derivative Progress: 314/2164 symbols completed. BSBR took 1.1s. Estimated remaining: 13m 9s. Rate: 140.6 symbols/min
[2025-10-24T01:18:55.015206] [INFO ] [MAIN      ] BSL: Generated 139 derivative records from 7937 primary records.
[2025-10-24T01:18:55.015300] [DEBUG] [LOCAL     ] BSL: Saving derivative data.
[2025-10-24T01:18:55.026256] [DEBUG] [LOCAL     ] BSL: Derivative data saved (139 records).
[2025-10-24T01:18:55.026336] [INFO ] [MAIN      ] BSL: Successfully saved derivative data.
[2025-10-24T01:18:55.029255] [INFO ] [MAIN      ] Derivative Progress: 315/2164 symbols completed. BSL took 0.8s. Estimated remaining: 13m 6s. Rate: 141.1 symbols/min
[2025-10-24T01:18:55.029709] [INFO ] [MAIN      ] BSM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:55.029757] [INFO ] [MAIN      ] BST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:55.029801] [INFO ] [MAIN      ] BSTZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:55.056733] [DEBUG] [LOCAL     ] BST: Loaded 18480 existing records from primary storage.
[2025-10-24T01:18:55.056939] [INFO ] [MAIN      ] BST: Loaded 18480 primary data records.
[2025-10-24T01:18:55.150060] [DEBUG] [LOCAL     ] BSTZ: Loaded 24564 existing records from primary storage.
[2025-10-24T01:18:55.178150] [INFO ] [MAIN      ] BSTZ: Loaded 24564 primary data records.
[2025-10-24T01:18:55.310541] [DEBUG] [LOCAL     ] BSM: Loaded 32463 existing records from primary storage.
[2025-10-24T01:18:55.481461] [INFO ] [MAIN      ] BSM: Loaded 32463 primary data records.
[2025-10-24T01:18:56.006900] [DEBUG] [MAIN      ] BST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:56.048242] [DEBUG] [MAIN      ] BSTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:56.079282] [DEBUG] [MAIN      ] BSM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:56.124867] [INFO ] [MAIN      ] BST: Generated 139 derivative records from 18480 primary records.
[2025-10-24T01:18:56.126812] [DEBUG] [LOCAL     ] BST: Saving derivative data.
[2025-10-24T01:18:56.143048] [DEBUG] [LOCAL     ] BST: Derivative data saved (139 records).
[2025-10-24T01:18:56.143340] [INFO ] [MAIN      ] BST: Successfully saved derivative data.
[2025-10-24T01:18:56.147685] [INFO ] [MAIN      ] Derivative Progress: 316/2164 symbols completed. BST took 1.1s. Estimated remaining: 13m 10s. Rate: 140.3 symbols/min
[2025-10-24T01:18:56.148762] [INFO ] [MAIN      ] BSX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:56.148947] [INFO ] [MAIN      ] BSTZ: Generated 139 derivative records from 24564 primary records.
[2025-10-24T01:18:56.152295] [DEBUG] [LOCAL     ] BSTZ: Saving derivative data.
[2025-10-24T01:18:56.168327] [DEBUG] [LOCAL     ] BSTZ: Derivative data saved (139 records).
[2025-10-24T01:18:56.166790] [INFO ] [MAIN      ] BSM: Generated 139 derivative records from 32463 primary records.
[2025-10-24T01:18:56.168537] [DEBUG] [LOCAL     ] BSM: Saving derivative data.
[2025-10-24T01:18:56.168607] [INFO ] [MAIN      ] BSTZ: Successfully saved derivative data.
[2025-10-24T01:18:56.171531] [INFO ] [MAIN      ] Derivative Progress: 317/2164 symbols completed. BSTZ took 1.1s. Estimated remaining: 13m 7s. Rate: 140.8 symbols/min
[2025-10-24T01:18:56.172359] [INFO ] [MAIN      ] BTA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:56.185001] [DEBUG] [LOCAL     ] BSM: Derivative data saved (139 records).
[2025-10-24T01:18:56.185170] [INFO ] [MAIN      ] BSM: Successfully saved derivative data.
[2025-10-24T01:18:56.188158] [INFO ] [MAIN      ] Derivative Progress: 318/2164 symbols completed. BSM took 1.2s. Estimated remaining: 13m 4s. Rate: 141.2 symbols/min
[2025-10-24T01:18:56.189594] [INFO ] [MAIN      ] BTE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:56.193993] [DEBUG] [LOCAL     ] BTA: Loaded 5788 existing records from primary storage.
[2025-10-24T01:18:56.194100] [INFO ] [MAIN      ] BTA: Loaded 5788 primary data records.
[2025-10-24T01:18:56.544739] [DEBUG] [LOCAL     ] BSX: Loaded 54078 existing records from primary storage.
[2025-10-24T01:18:56.545019] [INFO ] [MAIN      ] BSX: Loaded 54078 primary data records.
[2025-10-24T01:18:56.668506] [DEBUG] [LOCAL     ] BTE: Loaded 53081 existing records from primary storage.
[2025-10-24T01:18:56.668855] [INFO ] [MAIN      ] BTE: Loaded 53081 primary data records.
[2025-10-24T01:18:57.224407] [DEBUG] [MAIN      ] BTA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:57.269969] [DEBUG] [MAIN      ] BSX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:57.316782] [DEBUG] [MAIN      ] BTE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:57.332282] [INFO ] [MAIN      ] BTA: Generated 139 derivative records from 5788 primary records.
[2025-10-24T01:18:57.336500] [DEBUG] [LOCAL     ] BTA: Saving derivative data.
[2025-10-24T01:18:57.352864] [DEBUG] [LOCAL     ] BTA: Derivative data saved (139 records).
[2025-10-24T01:18:57.353081] [INFO ] [MAIN      ] BTA: Successfully saved derivative data.
[2025-10-24T01:18:57.356230] [INFO ] [MAIN      ] Derivative Progress: 319/2164 symbols completed. BTA took 1.2s. Estimated remaining: 13m 8s. Rate: 140.4 symbols/min
[2025-10-24T01:18:57.359628] [INFO ] [MAIN      ] BTI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:57.376042] [INFO ] [MAIN      ] BSX: Generated 139 derivative records from 54078 primary records.
[2025-10-24T01:18:57.378722] [DEBUG] [LOCAL     ] BSX: Saving derivative data.
[2025-10-24T01:18:57.403111] [DEBUG] [LOCAL     ] BSX: Derivative data saved (139 records).
[2025-10-24T01:18:57.403790] [INFO ] [MAIN      ] BSX: Successfully saved derivative data.
[2025-10-24T01:18:57.410012] [INFO ] [MAIN      ] BTE: Generated 139 derivative records from 53081 primary records.
[2025-10-24T01:18:57.409291] [INFO ] [MAIN      ] Derivative Progress: 320/2164 symbols completed. BSX took 1.3s. Estimated remaining: 13m 6s. Rate: 140.8 symbols/min
[2025-10-24T01:18:57.410380] [INFO ] [MAIN      ] BTO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:57.410441] [DEBUG] [LOCAL     ] BTE: Saving derivative data.
[2025-10-24T01:18:57.438364] [DEBUG] [LOCAL     ] BTE: Derivative data saved (139 records).
[2025-10-24T01:18:57.438965] [INFO ] [MAIN      ] BTE: Successfully saved derivative data.
[2025-10-24T01:18:57.443628] [INFO ] [MAIN      ] Derivative Progress: 321/2164 symbols completed. BTE took 1.3s. Estimated remaining: 13m 3s. Rate: 141.2 symbols/min
[2025-10-24T01:18:57.445987] [INFO ] [MAIN      ] BTT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:57.454565] [DEBUG] [LOCAL     ] BTO: Loaded 8744 existing records from primary storage.
[2025-10-24T01:18:57.468190] [INFO ] [MAIN      ] BTO: Loaded 8744 primary data records.
[2025-10-24T01:18:57.502548] [DEBUG] [LOCAL     ] BTI: Loaded 53980 existing records from primary storage.
[2025-10-24T01:18:57.550754] [INFO ] [MAIN      ] BTI: Loaded 53980 primary data records.
[2025-10-24T01:18:57.665199] [DEBUG] [LOCAL     ] BTT: Loaded 15457 existing records from primary storage.
[2025-10-24T01:18:57.722169] [INFO ] [MAIN      ] BTT: Loaded 15457 primary data records.
[2025-10-24T01:18:58.434717] [DEBUG] [MAIN      ] BTO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:58.467261] [DEBUG] [MAIN      ] BTI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:58.492574] [DEBUG] [MAIN      ] BTT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:58.565668] [INFO ] [MAIN      ] BTO: Generated 139 derivative records from 8744 primary records.
[2025-10-24T01:18:58.568924] [DEBUG] [LOCAL     ] BTO: Saving derivative data.
[2025-10-24T01:18:58.585360] [DEBUG] [LOCAL     ] BTO: Derivative data saved (139 records).
[2025-10-24T01:18:58.585817] [INFO ] [MAIN      ] BTO: Successfully saved derivative data.
[2025-10-24T01:18:58.588382] [INFO ] [MAIN      ] Derivative Progress: 322/2164 symbols completed. BTO took 1.2s. Estimated remaining: 13m 7s. Rate: 140.5 symbols/min
[2025-10-24T01:18:58.594025] [INFO ] [MAIN      ] BTI: Generated 139 derivative records from 53980 primary records.
[2025-10-24T01:18:58.594499] [DEBUG] [LOCAL     ] BTI: Saving derivative data.
[2025-10-24T01:18:58.594713] [INFO ] [MAIN      ] BTU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:58.611746] [INFO ] [MAIN      ] BTT: Generated 139 derivative records from 15457 primary records.
[2025-10-24T01:18:58.612467] [DEBUG] [LOCAL     ] BTT: Saving derivative data.
[2025-10-24T01:18:58.612280] [DEBUG] [LOCAL     ] BTI: Derivative data saved (139 records).
[2025-10-24T01:18:58.613268] [INFO ] [MAIN      ] BTI: Successfully saved derivative data.
[2025-10-24T01:18:58.616742] [INFO ] [MAIN      ] Derivative Progress: 323/2164 symbols completed. BTI took 1.3s. Estimated remaining: 13m 4s. Rate: 140.9 symbols/min
[2025-10-24T01:18:58.617037] [INFO ] [MAIN      ] BTZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:58.628426] [DEBUG] [LOCAL     ] BTT: Derivative data saved (139 records).
[2025-10-24T01:18:58.628612] [INFO ] [MAIN      ] BTT: Successfully saved derivative data.
[2025-10-24T01:18:58.631285] [INFO ] [MAIN      ] Derivative Progress: 324/2164 symbols completed. BTT took 1.2s. Estimated remaining: 13m 1s. Rate: 141.3 symbols/min
[2025-10-24T01:18:58.631555] [INFO ] [MAIN      ] BUD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:58.675977] [DEBUG] [LOCAL     ] BTZ: Loaded 22521 existing records from primary storage.
[2025-10-24T01:18:58.676199] [INFO ] [MAIN      ] BTZ: Loaded 22521 primary data records.
[2025-10-24T01:18:58.808486] [DEBUG] [LOCAL     ] BTU: Loaded 53724 existing records from primary storage.
[2025-10-24T01:18:58.812035] [INFO ] [MAIN      ] BTU: Loaded 53724 primary data records.
[2025-10-24T01:18:59.116297] [DEBUG] [LOCAL     ] BUD: Loaded 52986 existing records from primary storage.
[2025-10-24T01:18:59.136102] [INFO ] [MAIN      ] BUD: Loaded 52986 primary data records.
[2025-10-24T01:18:59.685587] [DEBUG] [MAIN      ] BTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:59.724127] [DEBUG] [MAIN      ] BTU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:59.771717] [DEBUG] [MAIN      ] BUD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:18:59.803107] [INFO ] [MAIN      ] BTZ: Generated 139 derivative records from 22521 primary records.
[2025-10-24T01:18:59.803639] [DEBUG] [LOCAL     ] BTZ: Saving derivative data.
[2025-10-24T01:18:59.821300] [DEBUG] [LOCAL     ] BTZ: Derivative data saved (139 records).
[2025-10-24T01:18:59.821588] [INFO ] [MAIN      ] BTZ: Successfully saved derivative data.
[2025-10-24T01:18:59.829533] [INFO ] [MAIN      ] Derivative Progress: 325/2164 symbols completed. BTZ took 1.2s. Estimated remaining: 13m 5s. Rate: 140.5 symbols/min
[2025-10-24T01:18:59.830189] [INFO ] [MAIN      ] BUI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:59.839028] [INFO ] [MAIN      ] BTU: Generated 139 derivative records from 53724 primary records.
[2025-10-24T01:18:59.842971] [DEBUG] [LOCAL     ] BTU: Saving derivative data.
[2025-10-24T01:18:59.849531] [INFO ] [MAIN      ] BUD: Generated 139 derivative records from 52986 primary records.
[2025-10-24T01:18:59.858679] [DEBUG] [LOCAL     ] BUD: Saving derivative data.
[2025-10-24T01:18:59.865331] [DEBUG] [LOCAL     ] BUI: Loaded 11873 existing records from primary storage.
[2025-10-24T01:18:59.866151] [INFO ] [MAIN      ] BUI: Loaded 11873 primary data records.
[2025-10-24T01:18:59.874342] [DEBUG] [LOCAL     ] BTU: Derivative data saved (139 records).
[2025-10-24T01:18:59.906790] [INFO ] [MAIN      ] BTU: Successfully saved derivative data.
[2025-10-24T01:18:59.934150] [DEBUG] [LOCAL     ] BUD: Derivative data saved (139 records).
[2025-10-24T01:18:59.937004] [INFO ] [MAIN      ] Derivative Progress: 326/2164 symbols completed. BTU took 1.3s. Estimated remaining: 13m 3s. Rate: 140.8 symbols/min
[2025-10-24T01:18:59.944574] [INFO ] [MAIN      ] BUD: Successfully saved derivative data.
[2025-10-24T01:18:59.952732] [INFO ] [MAIN      ] Derivative Progress: 327/2164 symbols completed. BUD took 1.3s. Estimated remaining: 13m 0s. Rate: 141.3 symbols/min
[2025-10-24T01:18:59.937179] [INFO ] [MAIN      ] BUR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:18:59.953072] [INFO ] [MAIN      ] BURL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:00.244367] [DEBUG] [LOCAL     ] BURL: Loaded 45718 existing records from primary storage.
[2025-10-24T01:19:00.245854] [INFO ] [MAIN      ] BURL: Loaded 45718 primary data records.
[2025-10-24T01:19:00.278023] [DEBUG] [LOCAL     ] BUR: Loaded 45815 existing records from primary storage.
[2025-10-24T01:19:00.312451] [INFO ] [MAIN      ] BUR: Loaded 45815 primary data records.
[2025-10-24T01:19:00.538974] [DEBUG] [MAIN      ] BUI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:00.924162] [INFO ] [MAIN      ] BUI: Generated 139 derivative records from 11873 primary records.
[2025-10-24T01:19:00.925346] [DEBUG] [LOCAL     ] BUI: Saving derivative data.
[2025-10-24T01:19:00.951225] [DEBUG] [LOCAL     ] BUI: Derivative data saved (139 records).
[2025-10-24T01:19:00.951906] [INFO ] [MAIN      ] BUI: Successfully saved derivative data.
[2025-10-24T01:19:00.952480] [DEBUG] [MAIN      ] BURL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:00.955403] [INFO ] [MAIN      ] Derivative Progress: 328/2164 symbols completed. BUI took 1.1s. Estimated remaining: 13m 3s. Rate: 140.7 symbols/min
[2025-10-24T01:19:00.988577] [DEBUG] [MAIN      ] BUR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:01.047823] [INFO ] [MAIN      ] BUR: Generated 139 derivative records from 45815 primary records.
[2025-10-24T01:19:01.050111] [DEBUG] [LOCAL     ] BUR: Saving derivative data.
[2025-10-24T01:19:01.050337] [INFO ] [MAIN      ] BURL: Generated 139 derivative records from 45718 primary records.
[2025-10-24T01:19:01.051355] [DEBUG] [LOCAL     ] BURL: Saving derivative data.
[2025-10-24T01:19:01.077386] [DEBUG] [LOCAL     ] BUR: Derivative data saved (139 records).
[2025-10-24T01:19:01.077498] [DEBUG] [LOCAL     ] BURL: Derivative data saved (139 records).
[2025-10-24T01:19:01.077792] [INFO ] [MAIN      ] BURL: Successfully saved derivative data.
[2025-10-24T01:19:01.081135] [INFO ] [MAIN      ] Derivative Progress: 329/2164 symbols completed. BURL took 1.1s. Estimated remaining: 13m 1s. Rate: 141.0 symbols/min
[2025-10-24T01:19:01.081289] [INFO ] [MAIN      ] BUR: Successfully saved derivative data.
[2025-10-24T01:19:01.084380] [INFO ] [MAIN      ] Derivative Progress: 330/2164 symbols completed. BUR took 1.1s. Estimated remaining: 12m 58s. Rate: 141.4 symbols/min
[2025-10-24T01:19:01.084938] [INFO ] [MAIN      ] BUXX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:01.085079] [INFO ] [MAIN      ] BV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:01.085563] [INFO ] [MAIN      ] BVN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:01.105309] [DEBUG] [LOCAL     ] BUXX: Loaded 15467 existing records from primary storage.
[2025-10-24T01:19:01.105480] [INFO ] [MAIN      ] BUXX: Loaded 15467 primary data records.
[2025-10-24T01:19:01.473416] [DEBUG] [LOCAL     ] BV: Loaded 38734 existing records from primary storage.
[2025-10-24T01:19:01.473909] [INFO ] [MAIN      ] BV: Loaded 38734 primary data records.
[2025-10-24T01:19:01.486969] [DEBUG] [LOCAL     ] BVN: Loaded 44895 existing records from primary storage.
[2025-10-24T01:19:01.513798] [INFO ] [MAIN      ] BVN: Loaded 44895 primary data records.
[2025-10-24T01:19:02.162915] [DEBUG] [MAIN      ] BUXX: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:19:02.216417] [DEBUG] [MAIN      ] BV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:02.248458] [INFO ] [MAIN      ] BUXX: Generated 139 derivative records from 15467 primary records.
[2025-10-24T01:19:02.248816] [DEBUG] [MAIN      ] BVN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:02.267333] [DEBUG] [LOCAL     ] BUXX: Saving derivative data.
[2025-10-24T01:19:02.290712] [DEBUG] [LOCAL     ] BUXX: Derivative data saved (139 records).
[2025-10-24T01:19:02.294193] [INFO ] [MAIN      ] BUXX: Successfully saved derivative data.
[2025-10-24T01:19:02.299682] [INFO ] [MAIN      ] Derivative Progress: 331/2164 symbols completed. BUXX took 1.2s. Estimated remaining: 13m 2s. Rate: 140.6 symbols/min
[2025-10-24T01:19:02.303198] [INFO ] [MAIN      ] BW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:02.319402] [INFO ] [MAIN      ] BV: Generated 139 derivative records from 38734 primary records.
[2025-10-24T01:19:02.321227] [DEBUG] [LOCAL     ] BV: Saving derivative data.
[2025-10-24T01:19:02.336449] [DEBUG] [LOCAL     ] BV: Derivative data saved (139 records).
[2025-10-24T01:19:02.336241] [INFO ] [MAIN      ] BVN: Generated 139 derivative records from 44895 primary records.
[2025-10-24T01:19:02.336714] [INFO ] [MAIN      ] BV: Successfully saved derivative data.
[2025-10-24T01:19:02.336765] [DEBUG] [LOCAL     ] BVN: Saving derivative data.
[2025-10-24T01:19:02.339475] [INFO ] [MAIN      ] Derivative Progress: 332/2164 symbols completed. BV took 1.3s. Estimated remaining: 12m 60s. Rate: 141.0 symbols/min
[2025-10-24T01:19:02.339813] [INFO ] [MAIN      ] BWA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:02.353583] [DEBUG] [LOCAL     ] BVN: Derivative data saved (139 records).
[2025-10-24T01:19:02.353944] [INFO ] [MAIN      ] BVN: Successfully saved derivative data.
[2025-10-24T01:19:02.357776] [INFO ] [MAIN      ] Derivative Progress: 333/2164 symbols completed. BVN took 1.3s. Estimated remaining: 12m 57s. Rate: 141.4 symbols/min
[2025-10-24T01:19:02.358463] [INFO ] [MAIN      ] BWG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:02.414030] [DEBUG] [LOCAL     ] BWG: Loaded 12676 existing records from primary storage.
[2025-10-24T01:19:02.414237] [INFO ] [MAIN      ] BWG: Loaded 12676 primary data records.
[2025-10-24T01:19:02.427258] [DEBUG] [LOCAL     ] BW: Loaded 40674 existing records from primary storage.
[2025-10-24T01:19:02.461366] [INFO ] [MAIN      ] BW: Loaded 40674 primary data records.
[2025-10-24T01:19:02.650185] [DEBUG] [LOCAL     ] BWA: Loaded 52452 existing records from primary storage.
[2025-10-24T01:19:02.656233] [INFO ] [MAIN      ] BWA: Loaded 52452 primary data records.
[2025-10-24T01:19:03.404247] [DEBUG] [MAIN      ] BWG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:03.437973] [DEBUG] [MAIN      ] BW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:03.469898] [DEBUG] [MAIN      ] BWA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:03.510543] [INFO ] [MAIN      ] BWG: Generated 139 derivative records from 12676 primary records.
[2025-10-24T01:19:03.513609] [DEBUG] [LOCAL     ] BWG: Saving derivative data.
[2025-10-24T01:19:03.534564] [DEBUG] [LOCAL     ] BWG: Derivative data saved (139 records).
[2025-10-24T01:19:03.538488] [INFO ] [MAIN      ] BWG: Successfully saved derivative data.
[2025-10-24T01:19:03.542471] [INFO ] [MAIN      ] Derivative Progress: 334/2164 symbols completed. BWG took 1.2s. Estimated remaining: 13m 1s. Rate: 140.6 symbols/min
[2025-10-24T01:19:03.544854] [INFO ] [MAIN      ] BWLP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:03.548043] [INFO ] [MAIN      ] BW: Generated 139 derivative records from 40674 primary records.
[2025-10-24T01:19:03.548253] [DEBUG] [LOCAL     ] BW: Saving derivative data.
[2025-10-24T01:19:03.550603] [INFO ] [MAIN      ] BWA: Generated 139 derivative records from 52452 primary records.
[2025-10-24T01:19:03.550887] [DEBUG] [LOCAL     ] BWA: Saving derivative data.
[2025-10-24T01:19:03.574196] [DEBUG] [LOCAL     ] BW: Derivative data saved (139 records).
[2025-10-24T01:19:03.574665] [DEBUG] [LOCAL     ] BWA: Derivative data saved (139 records).
[2025-10-24T01:19:03.575042] [INFO ] [MAIN      ] BWA: Successfully saved derivative data.
[2025-10-24T01:19:03.574926] [INFO ] [MAIN      ] BW: Successfully saved derivative data.
[2025-10-24T01:19:03.578395] [INFO ] [MAIN      ] Derivative Progress: 335/2164 symbols completed. BWA took 1.2s. Estimated remaining: 12m 58s. Rate: 141.0 symbols/min
[2025-10-24T01:19:03.581873] [INFO ] [MAIN      ] Derivative Progress: 336/2164 symbols completed. BW took 1.3s. Estimated remaining: 12m 55s. Rate: 141.4 symbols/min
[2025-10-24T01:19:03.578746] [INFO ] [MAIN      ] BWMX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:03.582725] [INFO ] [MAIN      ] BWNB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:03.612756] [DEBUG] [LOCAL     ] BWMX: Loaded 7900 existing records from primary storage.
[2025-10-24T01:19:03.613607] [DEBUG] [LOCAL     ] BWNB: Loaded 4067 existing records from primary storage.
[2025-10-24T01:19:03.613354] [DEBUG] [LOCAL     ] BWLP: Loaded 32265 existing records from primary storage.
[2025-10-24T01:19:03.613912] [INFO ] [MAIN      ] BWMX: Loaded 7900 primary data records.
[2025-10-24T01:19:03.613953] [INFO ] [MAIN      ] BWNB: Loaded 4067 primary data records.
[2025-10-24T01:19:03.614072] [INFO ] [MAIN      ] BWLP: Loaded 32265 primary data records.
[2025-10-24T01:19:04.543247] [DEBUG] [MAIN      ] BWMX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:04.580578] [DEBUG] [MAIN      ] BWNB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:04.586396] [DEBUG] [MAIN      ] BWLP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:04.664442] [INFO ] [MAIN      ] BWMX: Generated 139 derivative records from 7900 primary records.
[2025-10-24T01:19:04.667036] [DEBUG] [LOCAL     ] BWMX: Saving derivative data.
[2025-10-24T01:19:04.671289] [INFO ] [MAIN      ] BWLP: Generated 139 derivative records from 32265 primary records.
[2025-10-24T01:19:04.671741] [DEBUG] [LOCAL     ] BWLP: Saving derivative data.
[2025-10-24T01:19:04.692417] [DEBUG] [LOCAL     ] BWMX: Derivative data saved (139 records).
[2025-10-24T01:19:04.692554] [INFO ] [MAIN      ] BWMX: Successfully saved derivative data.
[2025-10-24T01:19:04.696811] [INFO ] [MAIN      ] Derivative Progress: 337/2164 symbols completed. BWMX took 1.1s. Estimated remaining: 12m 59s. Rate: 140.8 symbols/min
[2025-10-24T01:19:04.701114] [DEBUG] [LOCAL     ] BWLP: Derivative data saved (139 records).
[2025-10-24T01:19:04.701237] [INFO ] [MAIN      ] BWLP: Successfully saved derivative data.
[2025-10-24T01:19:04.704543] [INFO ] [MAIN      ] BWNB: Generated 139 derivative records from 4067 primary records.
[2025-10-24T01:19:04.704853] [INFO ] [MAIN      ] Derivative Progress: 338/2164 symbols completed. BWLP took 1.2s. Estimated remaining: 12m 56s. Rate: 141.2 symbols/min
[2025-10-24T01:19:04.705072] [DEBUG] [LOCAL     ] BWNB: Saving derivative data.
[2025-10-24T01:19:04.705264] [INFO ] [MAIN      ] BWXT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:04.704742] [INFO ] [MAIN      ] BWSN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:04.717635] [DEBUG] [LOCAL     ] BWNB: Derivative data saved (139 records).
[2025-10-24T01:19:04.717908] [INFO ] [MAIN      ] BWNB: Successfully saved derivative data.
[2025-10-24T01:19:04.720901] [INFO ] [MAIN      ] Derivative Progress: 339/2164 symbols completed. BWNB took 1.1s. Estimated remaining: 12m 53s. Rate: 141.6 symbols/min
[2025-10-24T01:19:04.721226] [INFO ] [MAIN      ] BXC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:04.727340] [DEBUG] [LOCAL     ] BWSN: Loaded 5082 existing records from primary storage.
[2025-10-24T01:19:04.727598] [INFO ] [MAIN      ] BWSN: Loaded 5082 primary data records.
[2025-10-24T01:19:04.850426] [DEBUG] [LOCAL     ] BXC: Loaded 13472 existing records from primary storage.
[2025-10-24T01:19:04.872083] [INFO ] [MAIN      ] BXC: Loaded 13472 primary data records.
[2025-10-24T01:19:05.140025] [DEBUG] [LOCAL     ] BWXT: Loaded 47605 existing records from primary storage.
[2025-10-24T01:19:05.161540] [INFO ] [MAIN      ] BWXT: Loaded 47605 primary data records.
[2025-10-24T01:19:05.765917] [DEBUG] [MAIN      ] BWSN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:05.813990] [DEBUG] [MAIN      ] BXC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:05.862027] [DEBUG] [MAIN      ] BWXT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:05.879495] [INFO ] [MAIN      ] BWSN: Generated 139 derivative records from 5082 primary records.
[2025-10-24T01:19:05.880673] [DEBUG] [LOCAL     ] BWSN: Saving derivative data.
[2025-10-24T01:19:05.899865] [DEBUG] [LOCAL     ] BWSN: Derivative data saved (139 records).
[2025-10-24T01:19:05.900181] [INFO ] [MAIN      ] BWSN: Successfully saved derivative data.
[2025-10-24T01:19:05.902683] [INFO ] [MAIN      ] Derivative Progress: 340/2164 symbols completed. BWSN took 1.2s. Estimated remaining: 12m 57s. Rate: 140.8 symbols/min
[2025-10-24T01:19:05.904268] [INFO ] [MAIN      ] BXMT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:05.926691] [INFO ] [MAIN      ] BXC: Generated 139 derivative records from 13472 primary records.
[2025-10-24T01:19:05.927358] [DEBUG] [LOCAL     ] BXC: Saving derivative data.
[2025-10-24T01:19:05.940979] [INFO ] [MAIN      ] BWXT: Generated 139 derivative records from 47605 primary records.
[2025-10-24T01:19:05.944778] [DEBUG] [LOCAL     ] BWXT: Saving derivative data.
[2025-10-24T01:19:05.946616] [DEBUG] [LOCAL     ] BXC: Derivative data saved (139 records).
[2025-10-24T01:19:05.954340] [INFO ] [MAIN      ] BXC: Successfully saved derivative data.
[2025-10-24T01:19:05.969922] [INFO ] [MAIN      ] Derivative Progress: 341/2164 symbols completed. BXC took 1.2s. Estimated remaining: 12m 55s. Rate: 141.2 symbols/min
[2025-10-24T01:19:05.973334] [INFO ] [MAIN      ] BXMX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:05.973545] [DEBUG] [LOCAL     ] BWXT: Derivative data saved (139 records).
[2025-10-24T01:19:05.974126] [INFO ] [MAIN      ] BWXT: Successfully saved derivative data.
[2025-10-24T01:19:05.977605] [INFO ] [MAIN      ] Derivative Progress: 342/2164 symbols completed. BWXT took 1.3s. Estimated remaining: 12m 52s. Rate: 141.6 symbols/min
[2025-10-24T01:19:05.978126] [INFO ] [MAIN      ] BXP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:05.996620] [DEBUG] [LOCAL     ] BXMT: Loaded 47621 existing records from primary storage.
[2025-10-24T01:19:05.997004] [INFO ] [MAIN      ] BXMT: Loaded 47621 primary data records.
[2025-10-24T01:19:06.118518] [DEBUG] [LOCAL     ] BXMX: Loaded 19294 existing records from primary storage.
[2025-10-24T01:19:06.139311] [INFO ] [MAIN      ] BXMX: Loaded 19294 primary data records.
[2025-10-24T01:19:06.468689] [DEBUG] [LOCAL     ] BXP: Loaded 50203 existing records from primary storage.
[2025-10-24T01:19:06.529702] [INFO ] [MAIN      ] BXP: Loaded 50203 primary data records.
[2025-10-24T01:19:06.965810] [DEBUG] [MAIN      ] BXMT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:07.017456] [DEBUG] [MAIN      ] BXMX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:07.073080] [INFO ] [MAIN      ] BXMT: Generated 139 derivative records from 47621 primary records.
[2025-10-24T01:19:07.072721] [DEBUG] [MAIN      ] BXP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:07.073591] [DEBUG] [LOCAL     ] BXMT: Saving derivative data.
[2025-10-24T01:19:07.104044] [DEBUG] [LOCAL     ] BXMT: Derivative data saved (139 records).
[2025-10-24T01:19:07.106793] [INFO ] [MAIN      ] BXMT: Successfully saved derivative data.
[2025-10-24T01:19:07.109462] [INFO ] [MAIN      ] Derivative Progress: 343/2164 symbols completed. BXMT took 1.2s. Estimated remaining: 12m 55s. Rate: 140.9 symbols/min
[2025-10-24T01:19:07.120440] [INFO ] [MAIN      ] BXMX: Generated 139 derivative records from 19294 primary records.
[2025-10-24T01:19:07.120670] [DEBUG] [LOCAL     ] BXMX: Saving derivative data.
[2025-10-24T01:19:07.139109] [DEBUG] [LOCAL     ] BXMX: Derivative data saved (139 records).
[2025-10-24T01:19:07.139500] [INFO ] [MAIN      ] BXMX: Successfully saved derivative data.
[2025-10-24T01:19:07.145702] [INFO ] [MAIN      ] Derivative Progress: 344/2164 symbols completed. BXMX took 1.2s. Estimated remaining: 12m 53s. Rate: 141.3 symbols/min
[2025-10-24T01:19:07.148879] [INFO ] [MAIN      ] BXP: Generated 139 derivative records from 50203 primary records.
[2025-10-24T01:19:07.148987] [DEBUG] [LOCAL     ] BXP: Saving derivative data.
[2025-10-24T01:19:07.161401] [DEBUG] [LOCAL     ] BXP: Derivative data saved (139 records).
[2025-10-24T01:19:07.161515] [INFO ] [MAIN      ] BXP: Successfully saved derivative data.
[2025-10-24T01:19:07.164736] [INFO ] [MAIN      ] Derivative Progress: 345/2164 symbols completed. BXP took 1.2s. Estimated remaining: 12m 50s. Rate: 141.7 symbols/min
[2025-10-24T01:19:07.165145] [INFO ] [MAIN      ] BXSL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:07.165190] [INFO ] [MAIN      ] BYD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:07.165241] [INFO ] [MAIN      ] BY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:07.197428] [DEBUG] [LOCAL     ] BY: Loaded 21757 existing records from primary storage.
[2025-10-24T01:19:07.207180] [INFO ] [MAIN      ] BY: Loaded 21757 primary data records.
[2025-10-24T01:19:07.358508] [DEBUG] [LOCAL     ] BXSL: Loaded 48587 existing records from primary storage.
[2025-10-24T01:19:07.372199] [INFO ] [MAIN      ] BXSL: Loaded 48587 primary data records.
[2025-10-24T01:19:07.400412] [DEBUG] [LOCAL     ] BYD: Loaded 45312 existing records from primary storage.
[2025-10-24T01:19:07.461239] [INFO ] [MAIN      ] BYD: Loaded 45312 primary data records.
[2025-10-24T01:19:08.296566] [DEBUG] [MAIN      ] BY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:08.342699] [DEBUG] [MAIN      ] BYD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:08.374813] [DEBUG] [MAIN      ] BXSL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:08.412098] [INFO ] [MAIN      ] BY: Generated 139 derivative records from 21757 primary records.
[2025-10-24T01:19:08.412790] [DEBUG] [LOCAL     ] BY: Saving derivative data.
[2025-10-24T01:19:08.431214] [DEBUG] [LOCAL     ] BY: Derivative data saved (139 records).
[2025-10-24T01:19:08.432174] [INFO ] [MAIN      ] BY: Successfully saved derivative data.
[2025-10-24T01:19:08.440311] [INFO ] [MAIN      ] Derivative Progress: 346/2164 symbols completed. BY took 1.3s. Estimated remaining: 12m 54s. Rate: 140.9 symbols/min
[2025-10-24T01:19:08.441828] [INFO ] [MAIN      ] BYM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:08.461574] [INFO ] [MAIN      ] BYD: Generated 139 derivative records from 45312 primary records.
[2025-10-24T01:19:08.469363] [DEBUG] [LOCAL     ] BYD: Saving derivative data.
[2025-10-24T01:19:08.471363] [DEBUG] [LOCAL     ] BYM: Loaded 11423 existing records from primary storage.
[2025-10-24T01:19:08.472416] [INFO ] [MAIN      ] BYM: Loaded 11423 primary data records.
[2025-10-24T01:19:08.484513] [DEBUG] [LOCAL     ] BYD: Derivative data saved (139 records).
[2025-10-24T01:19:08.497444] [INFO ] [MAIN      ] BYD: Successfully saved derivative data.
[2025-10-24T01:19:08.500685] [INFO ] [MAIN      ] Derivative Progress: 347/2164 symbols completed. BYD took 1.3s. Estimated remaining: 12m 52s. Rate: 141.2 symbols/min
[2025-10-24T01:19:08.532576] [INFO ] [MAIN      ] BZH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:08.598004] [INFO ] [MAIN      ] BXSL: Generated 139 derivative records from 48587 primary records.
[2025-10-24T01:19:08.598354] [DEBUG] [LOCAL     ] BXSL: Saving derivative data.
[2025-10-24T01:19:08.817978] [DEBUG] [LOCAL     ] BXSL: Derivative data saved (139 records).
[2025-10-24T01:19:08.818206] [INFO ] [MAIN      ] BXSL: Successfully saved derivative data.
[2025-10-24T01:19:08.821316] [INFO ] [MAIN      ] Derivative Progress: 348/2164 symbols completed. BXSL took 1.7s. Estimated remaining: 12m 51s. Rate: 141.3 symbols/min
[2025-10-24T01:19:08.821671] [INFO ] [MAIN      ] CAAP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:08.837089] [DEBUG] [LOCAL     ] BZH: Loaded 32220 existing records from primary storage.
[2025-10-24T01:19:08.837988] [INFO ] [MAIN      ] BZH: Loaded 32220 primary data records.
[2025-10-24T01:19:08.962639] [DEBUG] [LOCAL     ] CAAP: Loaded 20016 existing records from primary storage.
[2025-10-24T01:19:08.979093] [INFO ] [MAIN      ] CAAP: Loaded 20016 primary data records.
[2025-10-24T01:19:09.346394] [DEBUG] [MAIN      ] BYM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:09.637943] [DEBUG] [MAIN      ] BZH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:09.662395] [INFO ] [MAIN      ] BYM: Generated 139 derivative records from 11423 primary records.
[2025-10-24T01:19:09.664366] [DEBUG] [LOCAL     ] BYM: Saving derivative data.
[2025-10-24T01:19:09.679400] [DEBUG] [LOCAL     ] BYM: Derivative data saved (139 records).
[2025-10-24T01:19:09.679517] [INFO ] [MAIN      ] BYM: Successfully saved derivative data.
[2025-10-24T01:19:09.681953] [INFO ] [MAIN      ] Derivative Progress: 349/2164 symbols completed. BYM took 1.2s. Estimated remaining: 12m 53s. Rate: 140.9 symbols/min
[2025-10-24T01:19:09.685384] [INFO ] [MAIN      ] CABO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:09.707901] [DEBUG] [MAIN      ] CAAP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:09.752189] [DEBUG] [LOCAL     ] CABO: Loaded 16738 existing records from primary storage.
[2025-10-24T01:19:09.753021] [INFO ] [MAIN      ] CABO: Loaded 16738 primary data records.
[2025-10-24T01:19:09.779595] [INFO ] [MAIN      ] BZH: Generated 139 derivative records from 32220 primary records.
[2025-10-24T01:19:09.814924] [DEBUG] [LOCAL     ] BZH: Saving derivative data.
[2025-10-24T01:19:09.882409] [DEBUG] [LOCAL     ] BZH: Derivative data saved (139 records).
[2025-10-24T01:19:09.893328] [INFO ] [MAIN      ] BZH: Successfully saved derivative data.
[2025-10-24T01:19:09.896385] [INFO ] [MAIN      ] Derivative Progress: 350/2164 symbols completed. BZH took 1.4s. Estimated remaining: 12m 51s. Rate: 141.1 symbols/min
[2025-10-24T01:19:09.903078] [INFO ] [MAIN      ] CACI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:10.083638] [INFO ] [MAIN      ] CAAP: Generated 139 derivative records from 20016 primary records.
[2025-10-24T01:19:10.092989] [DEBUG] [LOCAL     ] CAAP: Saving derivative data.
[2025-10-24T01:19:10.114514] [DEBUG] [LOCAL     ] CAAP: Derivative data saved (139 records).
[2025-10-24T01:19:10.114892] [INFO ] [MAIN      ] CAAP: Successfully saved derivative data.
[2025-10-24T01:19:10.119422] [INFO ] [MAIN      ] Derivative Progress: 351/2164 symbols completed. CAAP took 1.3s. Estimated remaining: 12m 50s. Rate: 141.3 symbols/min
[2025-10-24T01:19:10.119691] [INFO ] [MAIN      ] CADE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:10.130272] [DEBUG] [LOCAL     ] CACI: Loaded 22671 existing records from primary storage.
[2025-10-24T01:19:10.130468] [INFO ] [MAIN      ] CACI: Loaded 22671 primary data records.
[2025-10-24T01:19:10.484669] [DEBUG] [MAIN      ] CABO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:10.518425] [DEBUG] [LOCAL     ] CADE: Loaded 50063 existing records from primary storage.
[2025-10-24T01:19:10.520743] [INFO ] [MAIN      ] CADE: Loaded 50063 primary data records.
[2025-10-24T01:19:10.862374] [DEBUG] [MAIN      ] CACI: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:19:10.886225] [INFO ] [MAIN      ] CABO: Generated 139 derivative records from 16738 primary records.
[2025-10-24T01:19:10.890336] [DEBUG] [LOCAL     ] CABO: Saving derivative data.
[2025-10-24T01:19:10.913180] [DEBUG] [LOCAL     ] CABO: Derivative data saved (139 records).
[2025-10-24T01:19:10.915816] [INFO ] [MAIN      ] CABO: Successfully saved derivative data.
[2025-10-24T01:19:10.921000] [INFO ] [MAIN      ] Derivative Progress: 352/2164 symbols completed. CABO took 1.2s. Estimated remaining: 12m 51s. Rate: 140.9 symbols/min
[2025-10-24T01:19:10.921556] [INFO ] [MAIN      ] CAE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:10.961911] [DEBUG] [MAIN      ] CADE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:10.962326] [INFO ] [MAIN      ] CACI: Generated 139 derivative records from 22671 primary records.
[2025-10-24T01:19:10.974852] [DEBUG] [LOCAL     ] CACI: Saving derivative data.
[2025-10-24T01:19:11.002185] [DEBUG] [LOCAL     ] CACI: Derivative data saved (139 records).
[2025-10-24T01:19:11.002304] [INFO ] [MAIN      ] CACI: Successfully saved derivative data.
[2025-10-24T01:19:11.008136] [INFO ] [MAIN      ] Derivative Progress: 353/2164 symbols completed. CACI took 1.1s. Estimated remaining: 12m 49s. Rate: 141.2 symbols/min
[2025-10-24T01:19:11.008435] [INFO ] [MAIN      ] CAF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:11.035572] [DEBUG] [LOCAL     ] CAF: Loaded 3501 existing records from primary storage.
[2025-10-24T01:19:11.036040] [INFO ] [MAIN      ] CAF: Loaded 3501 primary data records.
[2025-10-24T01:19:11.037884] [DEBUG] [LOCAL     ] CAE: Loaded 39307 existing records from primary storage.
[2025-10-24T01:19:11.082264] [INFO ] [MAIN      ] CAE: Loaded 39307 primary data records.
[2025-10-24T01:19:11.219531] [INFO ] [MAIN      ] CADE: Generated 139 derivative records from 50063 primary records.
[2025-10-24T01:19:11.281124] [DEBUG] [LOCAL     ] CADE: Saving derivative data.
[2025-10-24T01:19:11.567731] [DEBUG] [LOCAL     ] CADE: Derivative data saved (139 records).
[2025-10-24T01:19:11.673141] [INFO ] [MAIN      ] CADE: Successfully saved derivative data.
[2025-10-24T01:19:11.692858] [INFO ] [MAIN      ] Derivative Progress: 354/2164 symbols completed. CADE took 1.6s. Estimated remaining: 12m 50s. Rate: 141.0 symbols/min
[2025-10-24T01:19:11.693750] [INFO ] [MAIN      ] CAG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:11.723983] [DEBUG] [MAIN      ] CAF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:11.794870] [DEBUG] [MAIN      ] CAE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:11.899246] [INFO ] [MAIN      ] CAF: Generated 139 derivative records from 3501 primary records.
[2025-10-24T01:19:11.901093] [DEBUG] [LOCAL     ] CAG: Loaded 54056 existing records from primary storage.
[2025-10-24T01:19:11.904214] [INFO ] [MAIN      ] CAG: Loaded 54056 primary data records.
[2025-10-24T01:19:11.904282] [DEBUG] [LOCAL     ] CAF: Saving derivative data.
[2025-10-24T01:19:12.008097] [DEBUG] [LOCAL     ] CAF: Derivative data saved (139 records).
[2025-10-24T01:19:12.026579] [INFO ] [MAIN      ] CAF: Successfully saved derivative data.
[2025-10-24T01:19:12.030805] [INFO ] [MAIN      ] Derivative Progress: 355/2164 symbols completed. CAF took 1.0s. Estimated remaining: 12m 49s. Rate: 141.1 symbols/min
[2025-10-24T01:19:12.062133] [INFO ] [MAIN      ] CAH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:12.257535] [INFO ] [MAIN      ] CAE: Generated 139 derivative records from 39307 primary records.
[2025-10-24T01:19:12.257795] [DEBUG] [LOCAL     ] CAE: Saving derivative data.
[2025-10-24T01:19:12.272231] [DEBUG] [LOCAL     ] CAE: Derivative data saved (139 records).
[2025-10-24T01:19:12.272515] [INFO ] [MAIN      ] CAE: Successfully saved derivative data.
[2025-10-24T01:19:12.276771] [INFO ] [MAIN      ] Derivative Progress: 356/2164 symbols completed. CAE took 1.4s. Estimated remaining: 12m 48s. Rate: 141.2 symbols/min
[2025-10-24T01:19:12.277218] [INFO ] [MAIN      ] CAL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:12.318088] [DEBUG] [MAIN      ] CAG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:12.366864] [DEBUG] [LOCAL     ] CAH: Loaded 51788 existing records from primary storage.
[2025-10-24T01:19:12.379148] [INFO ] [MAIN      ] CAH: Loaded 51788 primary data records.
[2025-10-24T01:19:12.380468] [DEBUG] [LOCAL     ] CAL: Loaded 43036 existing records from primary storage.
[2025-10-24T01:19:12.380592] [INFO ] [MAIN      ] CAL: Loaded 43036 primary data records.
[2025-10-24T01:19:13.034986] [INFO ] [MAIN      ] CAG: Generated 139 derivative records from 54056 primary records.
[2025-10-24T01:19:13.036024] [DEBUG] [LOCAL     ] CAG: Saving derivative data.
[2025-10-24T01:19:13.051574] [DEBUG] [LOCAL     ] CAG: Derivative data saved (139 records).
[2025-10-24T01:19:13.052384] [INFO ] [MAIN      ] CAG: Successfully saved derivative data.
[2025-10-24T01:19:13.055475] [INFO ] [MAIN      ] Derivative Progress: 357/2164 symbols completed. CAG took 1.4s. Estimated remaining: 12m 49s. Rate: 140.9 symbols/min
[2025-10-24T01:19:13.055949] [INFO ] [MAIN      ] CALX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:13.087439] [DEBUG] [MAIN      ] CAL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:13.101661] [DEBUG] [MAIN      ] CAH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:13.172635] [DEBUG] [LOCAL     ] CALX: Loaded 37506 existing records from primary storage.
[2025-10-24T01:19:13.178335] [INFO ] [MAIN      ] CALX: Loaded 37506 primary data records.
[2025-10-24T01:19:13.481096] [INFO ] [MAIN      ] CAL: Generated 139 derivative records from 43036 primary records.
[2025-10-24T01:19:13.503348] [DEBUG] [LOCAL     ] CAL: Saving derivative data.
[2025-10-24T01:19:13.506046] [INFO ] [MAIN      ] CAH: Generated 139 derivative records from 51788 primary records.
[2025-10-24T01:19:13.506159] [DEBUG] [LOCAL     ] CAH: Saving derivative data.
[2025-10-24T01:19:13.529801] [DEBUG] [LOCAL     ] CAL: Derivative data saved (139 records).
[2025-10-24T01:19:13.533681] [DEBUG] [LOCAL     ] CAH: Derivative data saved (139 records).
[2025-10-24T01:19:13.534105] [INFO ] [MAIN      ] CAL: Successfully saved derivative data.
[2025-10-24T01:19:13.534876] [INFO ] [MAIN      ] CAH: Successfully saved derivative data.
[2025-10-24T01:19:13.538227] [INFO ] [MAIN      ] Derivative Progress: 358/2164 symbols completed. CAH took 1.5s. Estimated remaining: 12m 49s. Rate: 140.9 symbols/min
[2025-10-24T01:19:13.541282] [INFO ] [MAIN      ] Derivative Progress: 359/2164 symbols completed. CAL took 1.3s. Estimated remaining: 12m 47s. Rate: 141.3 symbols/min
[2025-10-24T01:19:13.563794] [DEBUG] [MAIN      ] CALX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:13.591378] [INFO ] [MAIN      ] CALX: Generated 139 derivative records from 37506 primary records.
[2025-10-24T01:19:13.591597] [DEBUG] [LOCAL     ] CALX: Saving derivative data.
[2025-10-24T01:19:13.604166] [DEBUG] [LOCAL     ] CALX: Derivative data saved (139 records).
[2025-10-24T01:19:13.604264] [INFO ] [MAIN      ] CALX: Successfully saved derivative data.
[2025-10-24T01:19:13.607949] [INFO ] [MAIN      ] Derivative Progress: 360/2164 symbols completed. CALX took 0.6s. Estimated remaining: 12m 44s. Rate: 141.6 symbols/min
[2025-10-24T01:19:13.608472] [INFO ] [MAIN      ] CAPL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:13.608593] [INFO ] [MAIN      ] CARR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:13.608777] [INFO ] [MAIN      ] CANG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:13.621419] [DEBUG] [LOCAL     ] CAPL: Loaded 5425 existing records from primary storage.
[2025-10-24T01:19:13.621823] [INFO ] [MAIN      ] CAPL: Loaded 5425 primary data records.
[2025-10-24T01:19:13.789757] [DEBUG] [LOCAL     ] CANG: Loaded 27174 existing records from primary storage.
[2025-10-24T01:19:13.824692] [INFO ] [MAIN      ] CANG: Loaded 27174 primary data records.
[2025-10-24T01:19:14.098137] [DEBUG] [LOCAL     ] CARR: Loaded 53993 existing records from primary storage.
[2025-10-24T01:19:14.121752] [INFO ] [MAIN      ] CARR: Loaded 53993 primary data records.
[2025-10-24T01:19:14.671239] [DEBUG] [MAIN      ] CAPL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:14.702623] [DEBUG] [MAIN      ] CANG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:14.751153] [DEBUG] [MAIN      ] CARR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:14.809122] [INFO ] [MAIN      ] CAPL: Generated 139 derivative records from 5425 primary records.
[2025-10-24T01:19:14.812899] [DEBUG] [LOCAL     ] CAPL: Saving derivative data.
[2025-10-24T01:19:14.813428] [INFO ] [MAIN      ] CANG: Generated 139 derivative records from 27174 primary records.
[2025-10-24T01:19:14.814699] [DEBUG] [LOCAL     ] CANG: Saving derivative data.
[2025-10-24T01:19:14.843340] [DEBUG] [LOCAL     ] CANG: Derivative data saved (139 records).
[2025-10-24T01:19:14.843241] [DEBUG] [LOCAL     ] CAPL: Derivative data saved (139 records).
[2025-10-24T01:19:14.846035] [INFO ] [MAIN      ] CANG: Successfully saved derivative data.
[2025-10-24T01:19:14.849055] [INFO ] [MAIN      ] Derivative Progress: 361/2164 symbols completed. CANG took 1.2s. Estimated remaining: 12m 48s. Rate: 140.8 symbols/min
[2025-10-24T01:19:14.849402] [INFO ] [MAIN      ] CARS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:14.846131] [INFO ] [MAIN      ] CAPL: Successfully saved derivative data.
[2025-10-24T01:19:14.851979] [INFO ] [MAIN      ] Derivative Progress: 362/2164 symbols completed. CAPL took 1.2s. Estimated remaining: 12m 46s. Rate: 141.2 symbols/min
[2025-10-24T01:19:14.852546] [INFO ] [MAIN      ] CAT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:14.855701] [INFO ] [MAIN      ] CARR: Generated 139 derivative records from 53993 primary records.
[2025-10-24T01:19:14.856032] [DEBUG] [LOCAL     ] CARR: Saving derivative data.
[2025-10-24T01:19:14.869206] [DEBUG] [LOCAL     ] CARR: Derivative data saved (139 records).
[2025-10-24T01:19:14.869291] [INFO ] [MAIN      ] CARR: Successfully saved derivative data.
[2025-10-24T01:19:14.872482] [INFO ] [MAIN      ] Derivative Progress: 363/2164 symbols completed. CARR took 1.3s. Estimated remaining: 12m 43s. Rate: 141.6 symbols/min
[2025-10-24T01:19:14.872801] [INFO ] [MAIN      ] CATO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:14.884616] [DEBUG] [LOCAL     ] CATO: Loaded 6677 existing records from primary storage.
[2025-10-24T01:19:14.884837] [INFO ] [MAIN      ] CATO: Loaded 6677 primary data records.
[2025-10-24T01:19:15.022056] [DEBUG] [LOCAL     ] CARS: Loaded 40089 existing records from primary storage.
[2025-10-24T01:19:15.057029] [INFO ] [MAIN      ] CARS: Loaded 40089 primary data records.
[2025-10-24T01:19:15.355799] [DEBUG] [LOCAL     ] CAT: Loaded 53317 existing records from primary storage.
[2025-10-24T01:19:15.362734] [INFO ] [MAIN      ] CAT: Loaded 53317 primary data records.
[2025-10-24T01:19:15.907624] [DEBUG] [MAIN      ] CATO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:15.949181] [DEBUG] [MAIN      ] CARS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:16.006205] [DEBUG] [MAIN      ] CAT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:16.008913] [INFO ] [MAIN      ] CATO: Generated 139 derivative records from 6677 primary records.
[2025-10-24T01:19:16.026959] [DEBUG] [LOCAL     ] CATO: Saving derivative data.
[2025-10-24T01:19:16.045828] [DEBUG] [LOCAL     ] CATO: Derivative data saved (139 records).
[2025-10-24T01:19:16.046274] [INFO ] [MAIN      ] CATO: Successfully saved derivative data.
[2025-10-24T01:19:16.051960] [INFO ] [MAIN      ] Derivative Progress: 364/2164 symbols completed. CATO took 1.2s. Estimated remaining: 12m 46s. Rate: 140.9 symbols/min
[2025-10-24T01:19:16.052697] [INFO ] [MAIN      ] CAVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:16.079790] [INFO ] [MAIN      ] CARS: Generated 139 derivative records from 40089 primary records.
[2025-10-24T01:19:16.084152] [DEBUG] [LOCAL     ] CARS: Saving derivative data.
[2025-10-24T01:19:16.101951] [INFO ] [MAIN      ] CAT: Generated 139 derivative records from 53317 primary records.
[2025-10-24T01:19:16.102071] [DEBUG] [LOCAL     ] CARS: Derivative data saved (139 records).
[2025-10-24T01:19:16.102247] [INFO ] [MAIN      ] CARS: Successfully saved derivative data.
[2025-10-24T01:19:16.105303] [INFO ] [MAIN      ] Derivative Progress: 365/2164 symbols completed. CARS took 1.3s. Estimated remaining: 12m 44s. Rate: 141.2 symbols/min
[2025-10-24T01:19:16.102330] [DEBUG] [LOCAL     ] CAT: Saving derivative data.
[2025-10-24T01:19:16.105550] [INFO ] [MAIN      ] CB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:16.134171] [DEBUG] [LOCAL     ] CAT: Derivative data saved (139 records).
[2025-10-24T01:19:16.134358] [INFO ] [MAIN      ] CAT: Successfully saved derivative data.
[2025-10-24T01:19:16.137555] [INFO ] [MAIN      ] Derivative Progress: 366/2164 symbols completed. CAT took 1.3s. Estimated remaining: 12m 42s. Rate: 141.6 symbols/min
[2025-10-24T01:19:16.138028] [INFO ] [MAIN      ] CBAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:16.163635] [DEBUG] [LOCAL     ] CAVA: Loaded 53932 existing records from primary storage.
[2025-10-24T01:19:16.163960] [INFO ] [MAIN      ] CAVA: Loaded 53932 primary data records.
[2025-10-24T01:19:16.227943] [DEBUG] [LOCAL     ] CBAN: Loaded 10233 existing records from primary storage.
[2025-10-24T01:19:16.286379] [INFO ] [MAIN      ] CBAN: Loaded 10233 primary data records.
[2025-10-24T01:19:16.643432] [DEBUG] [LOCAL     ] CB: Loaded 50346 existing records from primary storage.
[2025-10-24T01:19:16.660377] [INFO ] [MAIN      ] CB: Loaded 50346 primary data records.
[2025-10-24T01:19:17.163632] [DEBUG] [MAIN      ] CAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:17.193875] [DEBUG] [MAIN      ] CBAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:17.236900] [DEBUG] [MAIN      ] CB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:17.276905] [INFO ] [MAIN      ] CAVA: Generated 139 derivative records from 53932 primary records.
[2025-10-24T01:19:17.278891] [INFO ] [MAIN      ] CBAN: Generated 139 derivative records from 10233 primary records.
[2025-10-24T01:19:17.279024] [DEBUG] [LOCAL     ] CAVA: Saving derivative data.
[2025-10-24T01:19:17.282459] [DEBUG] [LOCAL     ] CBAN: Saving derivative data.
[2025-10-24T01:19:17.302969] [DEBUG] [LOCAL     ] CAVA: Derivative data saved (139 records).
[2025-10-24T01:19:17.306826] [INFO ] [MAIN      ] CAVA: Successfully saved derivative data.
[2025-10-24T01:19:17.311461] [INFO ] [MAIN      ] Derivative Progress: 367/2164 symbols completed. CAVA took 1.3s. Estimated remaining: 12m 45s. Rate: 140.9 symbols/min
[2025-10-24T01:19:17.312193] [INFO ] [MAIN      ] CBL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:17.316489] [DEBUG] [LOCAL     ] CBAN: Derivative data saved (139 records).
[2025-10-24T01:19:17.319403] [INFO ] [MAIN      ] CBAN: Successfully saved derivative data.
[2025-10-24T01:19:17.321908] [INFO ] [MAIN      ] Derivative Progress: 368/2164 symbols completed. CBAN took 1.2s. Estimated remaining: 12m 43s. Rate: 141.3 symbols/min
[2025-10-24T01:19:17.322099] [INFO ] [MAIN      ] CBRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:17.326608] [INFO ] [MAIN      ] CB: Generated 139 derivative records from 50346 primary records.
[2025-10-24T01:19:17.326794] [DEBUG] [LOCAL     ] CB: Saving derivative data.
[2025-10-24T01:19:17.349353] [DEBUG] [LOCAL     ] CBL: Loaded 16114 existing records from primary storage.
[2025-10-24T01:19:17.350248] [INFO ] [MAIN      ] CBL: Loaded 16114 primary data records.
[2025-10-24T01:19:17.350069] [DEBUG] [LOCAL     ] CB: Derivative data saved (139 records).
[2025-10-24T01:19:17.370918] [INFO ] [MAIN      ] CB: Successfully saved derivative data.
[2025-10-24T01:19:17.416774] [INFO ] [MAIN      ] Derivative Progress: 369/2164 symbols completed. CB took 1.3s. Estimated remaining: 12m 41s. Rate: 141.6 symbols/min
[2025-10-24T01:19:17.435049] [INFO ] [MAIN      ] CBT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:17.690488] [DEBUG] [LOCAL     ] CBRE: Loaded 50665 existing records from primary storage.
[2025-10-24T01:19:17.691407] [INFO ] [MAIN      ] CBRE: Loaded 50665 primary data records.
[2025-10-24T01:19:17.791476] [DEBUG] [LOCAL     ] CBT: Loaded 31110 existing records from primary storage.
[2025-10-24T01:19:17.807830] [INFO ] [MAIN      ] CBT: Loaded 31110 primary data records.
[2025-10-24T01:19:18.360342] [DEBUG] [MAIN      ] CBL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:18.404574] [DEBUG] [MAIN      ] CBRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:18.447944] [INFO ] [MAIN      ] CBL: Generated 139 derivative records from 16114 primary records.
[2025-10-24T01:19:18.453267] [DEBUG] [MAIN      ] CBT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:18.453342] [DEBUG] [LOCAL     ] CBL: Saving derivative data.
[2025-10-24T01:19:18.485198] [DEBUG] [LOCAL     ] CBL: Derivative data saved (139 records).
[2025-10-24T01:19:18.485324] [INFO ] [MAIN      ] CBL: Successfully saved derivative data.
[2025-10-24T01:19:18.490456] [INFO ] [MAIN      ] Derivative Progress: 370/2164 symbols completed. CBL took 1.2s. Estimated remaining: 12m 43s. Rate: 141.0 symbols/min
[2025-10-24T01:19:18.491235] [INFO ] [MAIN      ] CBU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:18.495628] [INFO ] [MAIN      ] CBRE: Generated 139 derivative records from 50665 primary records.
[2025-10-24T01:19:18.496240] [DEBUG] [LOCAL     ] CBRE: Saving derivative data.
[2025-10-24T01:19:18.512413] [DEBUG] [LOCAL     ] CBRE: Derivative data saved (139 records).
[2025-10-24T01:19:18.513205] [INFO ] [MAIN      ] CBRE: Successfully saved derivative data.
[2025-10-24T01:19:18.515779] [INFO ] [MAIN      ] Derivative Progress: 371/2164 symbols completed. CBRE took 1.2s. Estimated remaining: 12m 41s. Rate: 141.4 symbols/min
[2025-10-24T01:19:18.515968] [INFO ] [MAIN      ] CBZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:18.541506] [DEBUG] [LOCAL     ] CBU: Loaded 22766 existing records from primary storage.
[2025-10-24T01:19:18.543555] [INFO ] [MAIN      ] CBT: Generated 139 derivative records from 31110 primary records.
[2025-10-24T01:19:18.543932] [DEBUG] [LOCAL     ] CBT: Saving derivative data.
[2025-10-24T01:19:18.543856] [INFO ] [MAIN      ] CBU: Loaded 22766 primary data records.
[2025-10-24T01:19:18.606923] [DEBUG] [LOCAL     ] CBT: Derivative data saved (139 records).
[2025-10-24T01:19:18.640203] [INFO ] [MAIN      ] CBT: Successfully saved derivative data.
[2025-10-24T01:19:18.670350] [INFO ] [MAIN      ] Derivative Progress: 372/2164 symbols completed. CBT took 1.2s. Estimated remaining: 12m 39s. Rate: 141.6 symbols/min
[2025-10-24T01:19:18.670966] [INFO ] [MAIN      ] CC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:18.738387] [DEBUG] [LOCAL     ] CBZ: Loaded 34489 existing records from primary storage.
[2025-10-24T01:19:18.873147] [INFO ] [MAIN      ] CBZ: Loaded 34489 primary data records.
[2025-10-24T01:19:19.211434] [DEBUG] [LOCAL     ] CC: Loaded 53392 existing records from primary storage.
[2025-10-24T01:19:19.214001] [INFO ] [MAIN      ] CC: Loaded 53392 primary data records.
[2025-10-24T01:19:19.299967] [DEBUG] [MAIN      ] CBU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:19.569630] [DEBUG] [MAIN      ] CBZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:19.602768] [INFO ] [MAIN      ] CBU: Generated 139 derivative records from 22766 primary records.
[2025-10-24T01:19:19.604033] [DEBUG] [LOCAL     ] CBU: Saving derivative data.
[2025-10-24T01:19:19.621103] [DEBUG] [LOCAL     ] CBU: Derivative data saved (139 records).
[2025-10-24T01:19:19.621800] [INFO ] [MAIN      ] CBU: Successfully saved derivative data.
[2025-10-24T01:19:19.626632] [INFO ] [MAIN      ] Derivative Progress: 373/2164 symbols completed. CBU took 1.1s. Estimated remaining: 12m 41s. Rate: 141.1 symbols/min
[2025-10-24T01:19:19.642451] [DEBUG] [MAIN      ] CC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:19.662740] [INFO ] [MAIN      ] CBZ: Generated 139 derivative records from 34489 primary records.
[2025-10-24T01:19:19.665101] [DEBUG] [LOCAL     ] CBZ: Saving derivative data.
[2025-10-24T01:19:19.681841] [DEBUG] [LOCAL     ] CBZ: Derivative data saved (139 records).
[2025-10-24T01:19:19.681976] [INFO ] [MAIN      ] CBZ: Successfully saved derivative data.
[2025-10-24T01:19:19.684663] [INFO ] [MAIN      ] Derivative Progress: 374/2164 symbols completed. CBZ took 1.2s. Estimated remaining: 12m 39s. Rate: 141.5 symbols/min
[2025-10-24T01:19:19.693065] [INFO ] [MAIN      ] CC: Generated 139 derivative records from 53392 primary records.
[2025-10-24T01:19:19.693159] [DEBUG] [LOCAL     ] CC: Saving derivative data.
[2025-10-24T01:19:19.705100] [DEBUG] [LOCAL     ] CC: Derivative data saved (139 records).
[2025-10-24T01:19:19.705185] [INFO ] [MAIN      ] CC: Successfully saved derivative data.
[2025-10-24T01:19:19.708237] [INFO ] [MAIN      ] Derivative Progress: 375/2164 symbols completed. CC took 1.0s. Estimated remaining: 12m 37s. Rate: 141.8 symbols/min
[2025-10-24T01:19:19.708713] [INFO ] [MAIN      ] CCJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:19.708668] [INFO ] [MAIN      ] CCI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:19.708770] [INFO ] [MAIN      ] CCIF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:19.731067] [DEBUG] [LOCAL     ] CCIF: Loaded 15230 existing records from primary storage.
[2025-10-24T01:19:19.731261] [INFO ] [MAIN      ] CCIF: Loaded 15230 primary data records.
[2025-10-24T01:19:19.969338] [DEBUG] [LOCAL     ] CCI: Loaded 53497 existing records from primary storage.
[2025-10-24T01:19:20.087896] [INFO ] [MAIN      ] CCI: Loaded 53497 primary data records.
[2025-10-24T01:19:20.089072] [DEBUG] [LOCAL     ] CCJ: Loaded 54080 existing records from primary storage.
[2025-10-24T01:19:20.121180] [INFO ] [MAIN      ] CCJ: Loaded 54080 primary data records.
[2025-10-24T01:19:20.754196] [DEBUG] [MAIN      ] CCIF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:20.800935] [DEBUG] [MAIN      ] CCI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:20.840227] [INFO ] [MAIN      ] CCIF: Generated 139 derivative records from 15230 primary records.
[2025-10-24T01:19:20.835307] [DEBUG] [MAIN      ] CCJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:20.853372] [DEBUG] [LOCAL     ] CCIF: Saving derivative data.
[2025-10-24T01:19:20.871906] [DEBUG] [LOCAL     ] CCIF: Derivative data saved (139 records).
[2025-10-24T01:19:20.872361] [INFO ] [MAIN      ] CCIF: Successfully saved derivative data.
[2025-10-24T01:19:20.877186] [INFO ] [MAIN      ] Derivative Progress: 376/2164 symbols completed. CCIF took 1.2s. Estimated remaining: 12m 40s. Rate: 141.2 symbols/min
[2025-10-24T01:19:20.879029] [INFO ] [MAIN      ] CCK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:20.898532] [INFO ] [MAIN      ] CCI: Generated 139 derivative records from 53497 primary records.
[2025-10-24T01:19:20.900228] [DEBUG] [LOCAL     ] CCI: Saving derivative data.
[2025-10-24T01:19:20.919363] [DEBUG] [LOCAL     ] CCI: Derivative data saved (139 records).
[2025-10-24T01:19:20.919571] [INFO ] [MAIN      ] CCI: Successfully saved derivative data.
[2025-10-24T01:19:20.922467] [INFO ] [MAIN      ] Derivative Progress: 377/2164 symbols completed. CCI took 1.2s. Estimated remaining: 12m 38s. Rate: 141.5 symbols/min
[2025-10-24T01:19:20.922755] [INFO ] [MAIN      ] CCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:20.923584] [INFO ] [MAIN      ] CCJ: Generated 139 derivative records from 54080 primary records.
[2025-10-24T01:19:20.934445] [DEBUG] [LOCAL     ] CCJ: Saving derivative data.
[2025-10-24T01:19:20.946902] [DEBUG] [LOCAL     ] CCJ: Derivative data saved (139 records).
[2025-10-24T01:19:20.947245] [INFO ] [MAIN      ] CCJ: Successfully saved derivative data.
[2025-10-24T01:19:20.949832] [INFO ] [MAIN      ] Derivative Progress: 378/2164 symbols completed. CCJ took 1.2s. Estimated remaining: 12m 35s. Rate: 141.8 symbols/min
[2025-10-24T01:19:20.950313] [INFO ] [MAIN      ] CCRD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:20.970449] [DEBUG] [LOCAL     ] CCK: Loaded 46879 existing records from primary storage.
[2025-10-24T01:19:20.972693] [INFO ] [MAIN      ] CCK: Loaded 46879 primary data records.
[2025-10-24T01:19:21.088882] [DEBUG] [LOCAL     ] CCRD: Loaded 9620 existing records from primary storage.
[2025-10-24T01:19:21.105388] [INFO ] [MAIN      ] CCRD: Loaded 9620 primary data records.
[2025-10-24T01:19:21.390087] [DEBUG] [LOCAL     ] CCO: Loaded 48899 existing records from primary storage.
[2025-10-24T01:19:21.418713] [INFO ] [MAIN      ] CCO: Loaded 48899 primary data records.
[2025-10-24T01:19:21.950589] [DEBUG] [MAIN      ] CCK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:21.990413] [DEBUG] [MAIN      ] CCRD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:22.039352] [DEBUG] [MAIN      ] CCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:22.062292] [INFO ] [MAIN      ] CCK: Generated 139 derivative records from 46879 primary records.
[2025-10-24T01:19:22.063754] [DEBUG] [LOCAL     ] CCK: Saving derivative data.
[2025-10-24T01:19:22.082576] [DEBUG] [LOCAL     ] CCK: Derivative data saved (139 records).
[2025-10-24T01:19:22.084048] [INFO ] [MAIN      ] CCK: Successfully saved derivative data.
[2025-10-24T01:19:22.089116] [INFO ] [MAIN      ] Derivative Progress: 379/2164 symbols completed. CCK took 1.2s. Estimated remaining: 12m 38s. Rate: 141.2 symbols/min
[2025-10-24T01:19:22.092711] [INFO ] [MAIN      ] CCS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:22.105162] [INFO ] [MAIN      ] CCRD: Generated 139 derivative records from 9620 primary records.
[2025-10-24T01:19:22.108012] [DEBUG] [LOCAL     ] CCRD: Saving derivative data.
[2025-10-24T01:19:22.124203] [DEBUG] [LOCAL     ] CCRD: Derivative data saved (139 records).
[2025-10-24T01:19:22.124495] [INFO ] [MAIN      ] CCRD: Successfully saved derivative data.
[2025-10-24T01:19:22.126674] [INFO ] [MAIN      ] Derivative Progress: 380/2164 symbols completed. CCRD took 1.2s. Estimated remaining: 12m 36s. Rate: 141.5 symbols/min
[2025-10-24T01:19:22.137588] [INFO ] [MAIN      ] CCO: Generated 139 derivative records from 48899 primary records.
[2025-10-24T01:19:22.135313] [INFO ] [MAIN      ] CCU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:22.137734] [DEBUG] [LOCAL     ] CCO: Saving derivative data.
[2025-10-24T01:19:22.151157] [DEBUG] [LOCAL     ] CCO: Derivative data saved (139 records).
[2025-10-24T01:19:22.151294] [INFO ] [MAIN      ] CCO: Successfully saved derivative data.
[2025-10-24T01:19:22.154252] [INFO ] [MAIN      ] Derivative Progress: 381/2164 symbols completed. CCO took 1.2s. Estimated remaining: 12m 34s. Rate: 141.9 symbols/min
[2025-10-24T01:19:22.155444] [INFO ] [MAIN      ] CDE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:22.166197] [DEBUG] [LOCAL     ] CCS: Loaded 30142 existing records from primary storage.
[2025-10-24T01:19:22.166546] [INFO ] [MAIN      ] CCS: Loaded 30142 primary data records.
[2025-10-24T01:19:22.265179] [DEBUG] [LOCAL     ] CCU: Loaded 21744 existing records from primary storage.
[2025-10-24T01:19:22.281881] [INFO ] [MAIN      ] CCU: Loaded 21744 primary data records.
[2025-10-24T01:19:22.846772] [DEBUG] [LOCAL     ] CDE: Loaded 54034 existing records from primary storage.
[2025-10-24T01:19:22.847365] [INFO ] [MAIN      ] CDE: Loaded 54034 primary data records.
[2025-10-24T01:19:23.179110] [DEBUG] [MAIN      ] CCS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:23.216147] [DEBUG] [MAIN      ] CCU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:23.284779] [INFO ] [MAIN      ] CCS: Generated 139 derivative records from 30142 primary records.
[2025-10-24T01:19:23.282357] [DEBUG] [MAIN      ] CDE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:23.285448] [DEBUG] [LOCAL     ] CCS: Saving derivative data.
[2025-10-24T01:19:23.316878] [DEBUG] [LOCAL     ] CCS: Derivative data saved (139 records).
[2025-10-24T01:19:23.317168] [INFO ] [MAIN      ] CCS: Successfully saved derivative data.
[2025-10-24T01:19:23.320287] [INFO ] [MAIN      ] Derivative Progress: 382/2164 symbols completed. CCS took 1.2s. Estimated remaining: 12m 37s. Rate: 141.2 symbols/min
[2025-10-24T01:19:23.323782] [INFO ] [MAIN      ] CDLR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:23.330598] [INFO ] [MAIN      ] CCU: Generated 139 derivative records from 21744 primary records.
[2025-10-24T01:19:23.332670] [DEBUG] [LOCAL     ] CCU: Saving derivative data.
[2025-10-24T01:19:23.348038] [DEBUG] [LOCAL     ] CCU: Derivative data saved (139 records).
[2025-10-24T01:19:23.351339] [INFO ] [MAIN      ] CCU: Successfully saved derivative data.
[2025-10-24T01:19:23.354139] [INFO ] [MAIN      ] Derivative Progress: 383/2164 symbols completed. CCU took 1.2s. Estimated remaining: 12m 35s. Rate: 141.6 symbols/min
[2025-10-24T01:19:23.356530] [INFO ] [MAIN      ] CDP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:23.365276] [DEBUG] [LOCAL     ] CDLR: Loaded 10267 existing records from primary storage.
[2025-10-24T01:19:23.365969] [INFO ] [MAIN      ] CDLR: Loaded 10267 primary data records.
[2025-10-24T01:19:23.529554] [INFO ] [MAIN      ] CDE: Generated 139 derivative records from 54034 primary records.
[2025-10-24T01:19:23.540339] [DEBUG] [LOCAL     ] CDE: Saving derivative data.
[2025-10-24T01:19:23.702488] [DEBUG] [LOCAL     ] CDE: Derivative data saved (139 records).
[2025-10-24T01:19:23.703523] [INFO ] [MAIN      ] CDE: Successfully saved derivative data.
[2025-10-24T01:19:23.707782] [INFO ] [MAIN      ] Derivative Progress: 384/2164 symbols completed. CDE took 1.6s. Estimated remaining: 12m 34s. Rate: 141.6 symbols/min
[2025-10-24T01:19:23.709075] [INFO ] [MAIN      ] CDRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:23.724300] [DEBUG] [LOCAL     ] CDP: Loaded 42604 existing records from primary storage.
[2025-10-24T01:19:23.724941] [INFO ] [MAIN      ] CDP: Loaded 42604 primary data records.
[2025-10-24T01:19:24.040441] [DEBUG] [LOCAL     ] CDRE: Loaded 24851 existing records from primary storage.
[2025-10-24T01:19:24.040781] [INFO ] [MAIN      ] CDRE: Loaded 24851 primary data records.
[2025-10-24T01:19:24.090449] [DEBUG] [MAIN      ] CDLR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:24.461459] [DEBUG] [MAIN      ] CDP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:24.481585] [INFO ] [MAIN      ] CDLR: Generated 139 derivative records from 10267 primary records.
[2025-10-24T01:19:24.482315] [DEBUG] [LOCAL     ] CDLR: Saving derivative data.
[2025-10-24T01:19:24.499182] [DEBUG] [LOCAL     ] CDLR: Derivative data saved (139 records).
[2025-10-24T01:19:24.501324] [INFO ] [MAIN      ] CDLR: Successfully saved derivative data.
[2025-10-24T01:19:24.506792] [INFO ] [MAIN      ] Derivative Progress: 385/2164 symbols completed. CDLR took 1.2s. Estimated remaining: 12m 35s. Rate: 141.3 symbols/min
[2025-10-24T01:19:24.510383] [INFO ] [MAIN      ] CE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:24.535456] [DEBUG] [MAIN      ] CDRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:24.539343] [INFO ] [MAIN      ] CDP: Generated 139 derivative records from 42604 primary records.
[2025-10-24T01:19:24.550580] [DEBUG] [LOCAL     ] CDP: Saving derivative data.
[2025-10-24T01:19:24.566431] [DEBUG] [LOCAL     ] CDP: Derivative data saved (139 records).
[2025-10-24T01:19:24.566631] [INFO ] [MAIN      ] CDP: Successfully saved derivative data.
[2025-10-24T01:19:24.571310] [INFO ] [MAIN      ] Derivative Progress: 386/2164 symbols completed. CDP took 1.2s. Estimated remaining: 12m 33s. Rate: 141.6 symbols/min
[2025-10-24T01:19:24.572386] [INFO ] [MAIN      ] CEE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:24.614089] [INFO ] [MAIN      ] CDRE: Generated 139 derivative records from 24851 primary records.
[2025-10-24T01:19:24.611401] [DEBUG] [LOCAL     ] CEE: Loaded 5144 existing records from primary storage.
[2025-10-24T01:19:24.614553] [DEBUG] [LOCAL     ] CDRE: Saving derivative data.
[2025-10-24T01:19:24.615162] [INFO ] [MAIN      ] CEE: Loaded 5144 primary data records.
[2025-10-24T01:19:24.704487] [DEBUG] [LOCAL     ] CDRE: Derivative data saved (139 records).
[2025-10-24T01:19:24.734494] [INFO ] [MAIN      ] CDRE: Successfully saved derivative data.
[2025-10-24T01:19:24.745931] [INFO ] [MAIN      ] Derivative Progress: 387/2164 symbols completed. CDRE took 1.0s. Estimated remaining: 12m 32s. Rate: 141.8 symbols/min
[2025-10-24T01:19:24.758932] [INFO ] [MAIN      ] CEPU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:24.781954] [DEBUG] [LOCAL     ] CE: Loaded 51618 existing records from primary storage.
[2025-10-24T01:19:24.833361] [INFO ] [MAIN      ] CE: Loaded 51618 primary data records.
[2025-10-24T01:19:25.080689] [DEBUG] [LOCAL     ] CEPU: Loaded 27303 existing records from primary storage.
[2025-10-24T01:19:25.081352] [INFO ] [MAIN      ] CEPU: Loaded 27303 primary data records.
[2025-10-24T01:19:25.490760] [DEBUG] [MAIN      ] CEE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:25.676542] [DEBUG] [MAIN      ] CE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:25.697916] [INFO ] [MAIN      ] CEE: Generated 139 derivative records from 5144 primary records.
[2025-10-24T01:19:25.698555] [DEBUG] [LOCAL     ] CEE: Saving derivative data.
[2025-10-24T01:19:25.715958] [DEBUG] [LOCAL     ] CEE: Derivative data saved (139 records).
[2025-10-24T01:19:25.716263] [INFO ] [MAIN      ] CEE: Successfully saved derivative data.
[2025-10-24T01:19:25.718501] [INFO ] [MAIN      ] Derivative Progress: 388/2164 symbols completed. CEE took 1.1s. Estimated remaining: 12m 34s. Rate: 141.4 symbols/min
[2025-10-24T01:19:25.736162] [DEBUG] [MAIN      ] CEPU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:25.777017] [INFO ] [MAIN      ] CE: Generated 139 derivative records from 51618 primary records.
[2025-10-24T01:19:25.780701] [DEBUG] [LOCAL     ] CE: Saving derivative data.
[2025-10-24T01:19:25.795442] [DEBUG] [LOCAL     ] CE: Derivative data saved (139 records).
[2025-10-24T01:19:25.795557] [INFO ] [MAIN      ] CE: Successfully saved derivative data.
[2025-10-24T01:19:25.799540] [INFO ] [MAIN      ] Derivative Progress: 389/2164 symbols completed. CE took 1.3s. Estimated remaining: 12m 32s. Rate: 141.7 symbols/min
[2025-10-24T01:19:25.809735] [INFO ] [MAIN      ] CEPU: Generated 139 derivative records from 27303 primary records.
[2025-10-24T01:19:25.810040] [DEBUG] [LOCAL     ] CEPU: Saving derivative data.
[2025-10-24T01:19:25.823476] [DEBUG] [LOCAL     ] CEPU: Derivative data saved (139 records).
[2025-10-24T01:19:25.823746] [INFO ] [MAIN      ] CEPU: Successfully saved derivative data.
[2025-10-24T01:19:25.828473] [INFO ] [MAIN      ] Derivative Progress: 390/2164 symbols completed. CEPU took 1.1s. Estimated remaining: 12m 30s. Rate: 142.0 symbols/min
[2025-10-24T01:19:25.829208] [INFO ] [MAIN      ] CFG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:25.829355] [INFO ] [MAIN      ] CF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:25.830096] [INFO ] [MAIN      ] CFR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:25.920688] [DEBUG] [LOCAL     ] CFR: Loaded 32608 existing records from primary storage.
[2025-10-24T01:19:25.935969] [DEBUG] [LOCAL     ] CF: Loaded 52489 existing records from primary storage.
[2025-10-24T01:19:25.935011] [INFO ] [MAIN      ] CFR: Loaded 32608 primary data records.
[2025-10-24T01:19:25.936943] [DEBUG] [LOCAL     ] CFG: Loaded 54013 existing records from primary storage.
[2025-10-24T01:19:25.937328] [INFO ] [MAIN      ] CFG: Loaded 54013 primary data records.
[2025-10-24T01:19:25.936139] [INFO ] [MAIN      ] CF: Loaded 52489 primary data records.
[2025-10-24T01:19:27.007940] [DEBUG] [MAIN      ] CFG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:27.038600] [DEBUG] [MAIN      ] CFR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:27.076852] [DEBUG] [MAIN      ] CF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:27.152495] [INFO ] [MAIN      ] CFG: Generated 139 derivative records from 54013 primary records.
[2025-10-24T01:19:27.155426] [DEBUG] [LOCAL     ] CFG: Saving derivative data.
[2025-10-24T01:19:27.178072] [DEBUG] [LOCAL     ] CFG: Derivative data saved (139 records).
[2025-10-24T01:19:27.178774] [INFO ] [MAIN      ] CFG: Successfully saved derivative data.
[2025-10-24T01:19:27.182928] [INFO ] [MAIN      ] Derivative Progress: 391/2164 symbols completed. CFG took 1.4s. Estimated remaining: 12m 33s. Rate: 141.2 symbols/min
[2025-10-24T01:19:27.183736] [INFO ] [MAIN      ] CGAU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:27.192298] [INFO ] [MAIN      ] CFR: Generated 139 derivative records from 32608 primary records.
[2025-10-24T01:19:27.193046] [DEBUG] [LOCAL     ] CFR: Saving derivative data.
[2025-10-24T01:19:27.194218] [INFO ] [MAIN      ] CF: Generated 139 derivative records from 52489 primary records.
[2025-10-24T01:19:27.201869] [DEBUG] [LOCAL     ] CF: Saving derivative data.
[2025-10-24T01:19:27.207716] [DEBUG] [LOCAL     ] CFR: Derivative data saved (139 records).
[2025-10-24T01:19:27.208261] [INFO ] [MAIN      ] CFR: Successfully saved derivative data.
[2025-10-24T01:19:27.220837] [INFO ] [MAIN      ] Derivative Progress: 392/2164 symbols completed. CFR took 1.4s. Estimated remaining: 12m 31s. Rate: 141.5 symbols/min
[2025-10-24T01:19:27.224683] [INFO ] [MAIN      ] CGV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:27.226486] [DEBUG] [LOCAL     ] CF: Derivative data saved (139 records).
[2025-10-24T01:19:27.227165] [INFO ] [MAIN      ] CF: Successfully saved derivative data.
[2025-10-24T01:19:27.236329] [INFO ] [MAIN      ] Derivative Progress: 393/2164 symbols completed. CF took 1.4s. Estimated remaining: 12m 29s. Rate: 141.9 symbols/min
[2025-10-24T01:19:27.237193] [INFO ] [MAIN      ] CHCT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:27.242706] [DEBUG] [LOCAL     ] CGV: Loaded 1368 existing records from primary storage.
[2025-10-24T01:19:27.243041] [INFO ] [MAIN      ] CGV: Loaded 1368 primary data records.
[2025-10-24T01:19:27.408506] [DEBUG] [LOCAL     ] CGAU: Loaded 44258 existing records from primary storage.
[2025-10-24T01:19:27.459997] [INFO ] [MAIN      ] CGAU: Loaded 44258 primary data records.
[2025-10-24T01:19:27.593123] [DEBUG] [LOCAL     ] CHCT: Loaded 24374 existing records from primary storage.
[2025-10-24T01:19:27.605528] [INFO ] [MAIN      ] CHCT: Loaded 24374 primary data records.
[2025-10-24T01:19:28.289936] [DEBUG] [MAIN      ] CGV: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:19:28.336423] [DEBUG] [MAIN      ] CHCT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:28.362756] [DEBUG] [MAIN      ] CGAU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:28.432526] [INFO ] [MAIN      ] CGV: Generated 139 derivative records from 1368 primary records.
[2025-10-24T01:19:28.440991] [DEBUG] [LOCAL     ] CGV: Saving derivative data.
[2025-10-24T01:19:28.454971] [DEBUG] [LOCAL     ] CGV: Derivative data saved (139 records).
[2025-10-24T01:19:28.456936] [INFO ] [MAIN      ] CGV: Successfully saved derivative data.
[2025-10-24T01:19:28.459857] [INFO ] [MAIN      ] CHCT: Generated 139 derivative records from 24374 primary records.
[2025-10-24T01:19:28.464870] [INFO ] [MAIN      ] Derivative Progress: 394/2164 symbols completed. CGV took 1.2s. Estimated remaining: 12m 32s. Rate: 141.2 symbols/min
[2025-10-24T01:19:28.465872] [INFO ] [MAIN      ] CHD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:28.467091] [DEBUG] [LOCAL     ] CHCT: Saving derivative data.
[2025-10-24T01:19:28.481738] [INFO ] [MAIN      ] CGAU: Generated 139 derivative records from 44258 primary records.
[2025-10-24T01:19:28.485028] [DEBUG] [LOCAL     ] CHCT: Derivative data saved (139 records).
[2025-10-24T01:19:28.485301] [INFO ] [MAIN      ] CHCT: Successfully saved derivative data.
[2025-10-24T01:19:28.488944] [INFO ] [MAIN      ] Derivative Progress: 395/2164 symbols completed. CHCT took 1.3s. Estimated remaining: 12m 30s. Rate: 141.5 symbols/min
[2025-10-24T01:19:28.485401] [DEBUG] [LOCAL     ] CGAU: Saving derivative data.
[2025-10-24T01:19:28.489674] [INFO ] [MAIN      ] CHE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:28.504521] [DEBUG] [LOCAL     ] CGAU: Derivative data saved (139 records).
[2025-10-24T01:19:28.504932] [INFO ] [MAIN      ] CGAU: Successfully saved derivative data.
[2025-10-24T01:19:28.507929] [INFO ] [MAIN      ] Derivative Progress: 396/2164 symbols completed. CGAU took 1.3s. Estimated remaining: 12m 28s. Rate: 141.9 symbols/min
[2025-10-24T01:19:28.508139] [INFO ] [MAIN      ] CHGG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:28.528398] [DEBUG] [LOCAL     ] CHE: Loaded 15444 existing records from primary storage.
[2025-10-24T01:19:28.529114] [INFO ] [MAIN      ] CHE: Loaded 15444 primary data records.
[2025-10-24T01:19:28.715785] [DEBUG] [LOCAL     ] CHD: Loaded 52693 existing records from primary storage.
[2025-10-24T01:19:28.723880] [INFO ] [MAIN      ] CHD: Loaded 52693 primary data records.
[2025-10-24T01:19:28.883016] [DEBUG] [LOCAL     ] CHGG: Loaded 47817 existing records from primary storage.
[2025-10-24T01:19:29.003952] [INFO ] [MAIN      ] CHGG: Loaded 47817 primary data records.
[2025-10-24T01:19:29.639868] [DEBUG] [MAIN      ] CHE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:29.673613] [DEBUG] [MAIN      ] CHD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:29.724890] [DEBUG] [MAIN      ] CHGG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:29.764124] [INFO ] [MAIN      ] CHE: Generated 139 derivative records from 15444 primary records.
[2025-10-24T01:19:29.767308] [DEBUG] [LOCAL     ] CHE: Saving derivative data.
[2025-10-24T01:19:29.786148] [DEBUG] [LOCAL     ] CHE: Derivative data saved (139 records).
[2025-10-24T01:19:29.786326] [INFO ] [MAIN      ] CHE: Successfully saved derivative data.
[2025-10-24T01:19:29.792526] [INFO ] [MAIN      ] Derivative Progress: 397/2164 symbols completed. CHE took 1.3s. Estimated remaining: 12m 31s. Rate: 141.2 symbols/min
[2025-10-24T01:19:29.793051] [INFO ] [MAIN      ] CHH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:29.807780] [INFO ] [MAIN      ] CHGG: Generated 139 derivative records from 47817 primary records.
[2025-10-24T01:19:29.808105] [INFO ] [MAIN      ] CHD: Generated 139 derivative records from 52693 primary records.
[2025-10-24T01:19:29.808228] [DEBUG] [LOCAL     ] CHGG: Saving derivative data.
[2025-10-24T01:19:29.808921] [DEBUG] [LOCAL     ] CHD: Saving derivative data.
[2025-10-24T01:19:29.821443] [DEBUG] [LOCAL     ] CHGG: Derivative data saved (139 records).
[2025-10-24T01:19:29.822415] [INFO ] [MAIN      ] CHGG: Successfully saved derivative data.
[2025-10-24T01:19:29.826304] [INFO ] [MAIN      ] Derivative Progress: 398/2164 symbols completed. CHGG took 1.3s. Estimated remaining: 12m 29s. Rate: 141.5 symbols/min
[2025-10-24T01:19:29.847402] [INFO ] [MAIN      ] CHMI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:29.847239] [DEBUG] [LOCAL     ] CHD: Derivative data saved (139 records).
[2025-10-24T01:19:29.848191] [INFO ] [MAIN      ] CHD: Successfully saved derivative data.
[2025-10-24T01:19:29.853379] [INFO ] [MAIN      ] Derivative Progress: 399/2164 symbols completed. CHD took 1.4s. Estimated remaining: 12m 27s. Rate: 141.8 symbols/min
[2025-10-24T01:19:29.853770] [INFO ] [MAIN      ] CHN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:29.872736] [DEBUG] [LOCAL     ] CHH: Loaded 32509 existing records from primary storage.
[2025-10-24T01:19:29.877310] [INFO ] [MAIN      ] CHH: Loaded 32509 primary data records.
[2025-10-24T01:19:29.881828] [DEBUG] [LOCAL     ] CHN: Loaded 5027 existing records from primary storage.
[2025-10-24T01:19:29.934134] [DEBUG] [LOCAL     ] CHMI: Loaded 21277 existing records from primary storage.
[2025-10-24T01:19:29.934486] [INFO ] [MAIN      ] CHN: Loaded 5027 primary data records.
[2025-10-24T01:19:29.965853] [INFO ] [MAIN      ] CHMI: Loaded 21277 primary data records.
[2025-10-24T01:19:30.891341] [DEBUG] [MAIN      ] CHH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:30.892289] [DEBUG] [MAIN      ] CHN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:30.955856] [DEBUG] [MAIN      ] CHMI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:31.007854] [INFO ] [MAIN      ] CHH: Generated 139 derivative records from 32509 primary records.
[2025-10-24T01:19:31.012251] [DEBUG] [LOCAL     ] CHH: Saving derivative data.
[2025-10-24T01:19:31.015958] [INFO ] [MAIN      ] CHN: Generated 139 derivative records from 5027 primary records.
[2025-10-24T01:19:31.024396] [DEBUG] [LOCAL     ] CHN: Saving derivative data.
[2025-10-24T01:19:31.035983] [DEBUG] [LOCAL     ] CHH: Derivative data saved (139 records).
[2025-10-24T01:19:31.037986] [INFO ] [MAIN      ] CHH: Successfully saved derivative data.
[2025-10-24T01:19:31.045199] [DEBUG] [LOCAL     ] CHN: Derivative data saved (139 records).
[2025-10-24T01:19:31.043704] [INFO ] [MAIN      ] Derivative Progress: 400/2164 symbols completed. CHH took 1.3s. Estimated remaining: 12m 30s. Rate: 141.2 symbols/min
[2025-10-24T01:19:31.045908] [INFO ] [MAIN      ] CHN: Successfully saved derivative data.
[2025-10-24T01:19:31.046058] [INFO ] [MAIN      ] CHPT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:31.049161] [INFO ] [MAIN      ] Derivative Progress: 401/2164 symbols completed. CHN took 1.2s. Estimated remaining: 12m 27s. Rate: 141.5 symbols/min
[2025-10-24T01:19:31.051745] [INFO ] [MAIN      ] CHT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:31.057436] [INFO ] [MAIN      ] CHMI: Generated 139 derivative records from 21277 primary records.
[2025-10-24T01:19:31.057583] [DEBUG] [LOCAL     ] CHMI: Saving derivative data.
[2025-10-24T01:19:31.070163] [DEBUG] [LOCAL     ] CHMI: Derivative data saved (139 records).
[2025-10-24T01:19:31.070418] [INFO ] [MAIN      ] CHMI: Successfully saved derivative data.
[2025-10-24T01:19:31.073300] [INFO ] [MAIN      ] Derivative Progress: 402/2164 symbols completed. CHMI took 1.2s. Estimated remaining: 12m 25s. Rate: 141.9 symbols/min
[2025-10-24T01:19:31.073597] [INFO ] [MAIN      ] CI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:31.090073] [DEBUG] [LOCAL     ] CHT: Loaded 19339 existing records from primary storage.
[2025-10-24T01:19:31.090535] [INFO ] [MAIN      ] CHT: Loaded 19339 primary data records.
[2025-10-24T01:19:31.464526] [DEBUG] [LOCAL     ] CHPT: Loaded 47199 existing records from primary storage.
[2025-10-24T01:19:31.465494] [INFO ] [MAIN      ] CHPT: Loaded 47199 primary data records.
[2025-10-24T01:19:31.596177] [DEBUG] [LOCAL     ] CI: Loaded 49907 existing records from primary storage.
[2025-10-24T01:19:31.614852] [INFO ] [MAIN      ] CI: Loaded 49907 primary data records.
[2025-10-24T01:19:32.167569] [DEBUG] [MAIN      ] CHT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:32.210102] [DEBUG] [MAIN      ] CHPT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:32.250536] [DEBUG] [MAIN      ] CI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:32.299318] [INFO ] [MAIN      ] CHT: Generated 139 derivative records from 19339 primary records.
[2025-10-24T01:19:32.302775] [DEBUG] [LOCAL     ] CHT: Saving derivative data.
[2025-10-24T01:19:32.327052] [DEBUG] [LOCAL     ] CHT: Derivative data saved (139 records).
[2025-10-24T01:19:32.332532] [INFO ] [MAIN      ] CHT: Successfully saved derivative data.
[2025-10-24T01:19:32.335585] [INFO ] [MAIN      ] Derivative Progress: 403/2164 symbols completed. CHT took 1.3s. Estimated remaining: 12m 28s. Rate: 141.2 symbols/min
[2025-10-24T01:19:32.341031] [INFO ] [MAIN      ] CHPT: Generated 139 derivative records from 47199 primary records.
[2025-10-24T01:19:32.344423] [DEBUG] [LOCAL     ] CHPT: Saving derivative data.
[2025-10-24T01:19:32.361967] [DEBUG] [LOCAL     ] CHPT: Derivative data saved (139 records).
[2025-10-24T01:19:32.362279] [INFO ] [MAIN      ] CI: Generated 139 derivative records from 49907 primary records.
[2025-10-24T01:19:32.362447] [INFO ] [MAIN      ] CHPT: Successfully saved derivative data.
[2025-10-24T01:19:32.362787] [DEBUG] [LOCAL     ] CI: Saving derivative data.
[2025-10-24T01:19:32.365803] [INFO ] [MAIN      ] Derivative Progress: 404/2164 symbols completed. CHPT took 1.3s. Estimated remaining: 12m 26s. Rate: 141.5 symbols/min
[2025-10-24T01:19:32.379205] [DEBUG] [LOCAL     ] CI: Derivative data saved (139 records).
[2025-10-24T01:19:32.379415] [INFO ] [MAIN      ] CI: Successfully saved derivative data.
[2025-10-24T01:19:32.383934] [INFO ] [MAIN      ] Derivative Progress: 405/2164 symbols completed. CI took 1.3s. Estimated remaining: 12m 24s. Rate: 141.8 symbols/min
[2025-10-24T01:19:32.384443] [INFO ] [MAIN      ] CIA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:32.384691] [INFO ] [MAIN      ] CIB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:32.384792] [INFO ] [MAIN      ] CIEN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:32.408116] [DEBUG] [LOCAL     ] CIA: Loaded 16554 existing records from primary storage.
[2025-10-24T01:19:32.408291] [INFO ] [MAIN      ] CIA: Loaded 16554 primary data records.
[2025-10-24T01:19:32.498728] [DEBUG] [LOCAL     ] CIB: Loaded 30473 existing records from primary storage.
[2025-10-24T01:19:32.522281] [INFO ] [MAIN      ] CIB: Loaded 30473 primary data records.
[2025-10-24T01:19:32.887257] [DEBUG] [LOCAL     ] CIEN: Loaded 52498 existing records from primary storage.
[2025-10-24T01:19:32.929512] [INFO ] [MAIN      ] CIEN: Loaded 52498 primary data records.
[2025-10-24T01:19:33.501637] [DEBUG] [MAIN      ] CIA: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:19:33.544622] [DEBUG] [MAIN      ] CIB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:33.604244] [DEBUG] [MAIN      ] CIEN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:33.629517] [INFO ] [MAIN      ] CIA: Generated 139 derivative records from 16554 primary records.
[2025-10-24T01:19:33.631043] [DEBUG] [LOCAL     ] CIA: Saving derivative data.
[2025-10-24T01:19:33.646770] [DEBUG] [LOCAL     ] CIA: Derivative data saved (139 records).
[2025-10-24T01:19:33.649923] [INFO ] [MAIN      ] CIA: Successfully saved derivative data.
[2025-10-24T01:19:33.653116] [INFO ] [MAIN      ] Derivative Progress: 406/2164 symbols completed. CIA took 1.3s. Estimated remaining: 12m 27s. Rate: 141.1 symbols/min
[2025-10-24T01:19:33.654872] [INFO ] [MAIN      ] CIF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:33.664409] [INFO ] [MAIN      ] CIB: Generated 139 derivative records from 30473 primary records.
[2025-10-24T01:19:33.673583] [DEBUG] [LOCAL     ] CIF: Loaded 3992 existing records from primary storage.
[2025-10-24T01:19:33.673984] [DEBUG] [LOCAL     ] CIB: Saving derivative data.
[2025-10-24T01:19:33.676436] [INFO ] [MAIN      ] CIF: Loaded 3992 primary data records.
[2025-10-24T01:19:33.714484] [DEBUG] [LOCAL     ] CIB: Derivative data saved (139 records).
[2025-10-24T01:19:33.751189] [INFO ] [MAIN      ] CIB: Successfully saved derivative data.
[2025-10-24T01:19:33.764970] [INFO ] [MAIN      ] Derivative Progress: 407/2164 symbols completed. CIB took 1.4s. Estimated remaining: 12m 26s. Rate: 141.4 symbols/min
[2025-10-24T01:19:33.791002] [INFO ] [MAIN      ] CIG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:33.796623] [INFO ] [MAIN      ] CIEN: Generated 139 derivative records from 52498 primary records.
[2025-10-24T01:19:33.814612] [DEBUG] [LOCAL     ] CIEN: Saving derivative data.
[2025-10-24T01:19:34.042668] [DEBUG] [LOCAL     ] CIEN: Derivative data saved (139 records).
[2025-10-24T01:19:34.055596] [INFO ] [MAIN      ] CIEN: Successfully saved derivative data.
[2025-10-24T01:19:34.059692] [INFO ] [MAIN      ] Derivative Progress: 408/2164 symbols completed. CIEN took 1.7s. Estimated remaining: 12m 25s. Rate: 141.5 symbols/min
[2025-10-24T01:19:34.060142] [INFO ] [MAIN      ] CII: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:34.093426] [DEBUG] [LOCAL     ] CII: Loaded 15213 existing records from primary storage.
[2025-10-24T01:19:34.105869] [INFO ] [MAIN      ] CII: Loaded 15213 primary data records.
[2025-10-24T01:19:34.128447] [DEBUG] [LOCAL     ] CIG: Loaded 44791 existing records from primary storage.
[2025-10-24T01:19:34.130369] [INFO ] [MAIN      ] CIG: Loaded 44791 primary data records.
[2025-10-24T01:19:34.781680] [DEBUG] [MAIN      ] CIF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:34.852495] [DEBUG] [MAIN      ] CII: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:34.856040] [INFO ] [MAIN      ] CIF: Generated 139 derivative records from 3992 primary records.
[2025-10-24T01:19:34.870625] [DEBUG] [LOCAL     ] CIF: Saving derivative data.
[2025-10-24T01:19:34.901777] [DEBUG] [LOCAL     ] CIF: Derivative data saved (139 records).
[2025-10-24T01:19:34.902366] [INFO ] [MAIN      ] CIF: Successfully saved derivative data.
[2025-10-24T01:19:34.896479] [DEBUG] [MAIN      ] CIG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:34.907583] [INFO ] [MAIN      ] Derivative Progress: 409/2164 symbols completed. CIF took 1.3s. Estimated remaining: 12m 26s. Rate: 141.2 symbols/min
[2025-10-24T01:19:34.909521] [INFO ] [MAIN      ] CIM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:35.007022] [INFO ] [MAIN      ] CIG: Generated 139 derivative records from 44791 primary records.
[2025-10-24T01:19:35.006329] [DEBUG] [LOCAL     ] CIM: Loaded 37666 existing records from primary storage.
[2025-10-24T01:19:35.007857] [INFO ] [MAIN      ] CIM: Loaded 37666 primary data records.
[2025-10-24T01:19:35.007479] [INFO ] [MAIN      ] CII: Generated 139 derivative records from 15213 primary records.
[2025-10-24T01:19:35.008078] [DEBUG] [LOCAL     ] CIG: Saving derivative data.
[2025-10-24T01:19:35.021096] [DEBUG] [LOCAL     ] CII: Saving derivative data.
[2025-10-24T01:19:35.138242] [DEBUG] [LOCAL     ] CII: Derivative data saved (139 records).
[2025-10-24T01:19:35.151808] [INFO ] [MAIN      ] CII: Successfully saved derivative data.
[2025-10-24T01:19:35.173002] [INFO ] [MAIN      ] Derivative Progress: 410/2164 symbols completed. CII took 1.1s. Estimated remaining: 12m 25s. Rate: 141.3 symbols/min
[2025-10-24T01:19:35.164318] [DEBUG] [LOCAL     ] CIG: Derivative data saved (139 records).
[2025-10-24T01:19:35.198444] [INFO ] [MAIN      ] CIMN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:35.198240] [INFO ] [MAIN      ] CIG: Successfully saved derivative data.
[2025-10-24T01:19:35.244261] [INFO ] [MAIN      ] Derivative Progress: 411/2164 symbols completed. CIG took 1.5s. Estimated remaining: 12m 23s. Rate: 141.6 symbols/min
[2025-10-24T01:19:35.369130] [INFO ] [MAIN      ] CINT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:35.374168] [DEBUG] [LOCAL     ] CIMN: Loaded 2715 existing records from primary storage.
[2025-10-24T01:19:35.375248] [INFO ] [MAIN      ] CIMN: Loaded 2715 primary data records.
[2025-10-24T01:19:35.536376] [DEBUG] [LOCAL     ] CINT: Loaded 20616 existing records from primary storage.
[2025-10-24T01:19:35.537817] [INFO ] [MAIN      ] CINT: Loaded 20616 primary data records.
[2025-10-24T01:19:36.122349] [DEBUG] [MAIN      ] CIM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:36.178901] [DEBUG] [MAIN      ] CIMN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:36.218954] [DEBUG] [MAIN      ] CINT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:36.255188] [INFO ] [MAIN      ] CIM: Generated 139 derivative records from 37666 primary records.
[2025-10-24T01:19:36.260692] [DEBUG] [LOCAL     ] CIM: Saving derivative data.
[2025-10-24T01:19:36.285819] [DEBUG] [LOCAL     ] CIM: Derivative data saved (139 records).
[2025-10-24T01:19:36.289493] [INFO ] [MAIN      ] CIM: Successfully saved derivative data.
[2025-10-24T01:19:36.295890] [INFO ] [MAIN      ] Derivative Progress: 412/2164 symbols completed. CIM took 1.4s. Estimated remaining: 12m 25s. Rate: 141.1 symbols/min
[2025-10-24T01:19:36.296210] [INFO ] [MAIN      ] CIO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:36.313515] [INFO ] [MAIN      ] CINT: Generated 139 derivative records from 20616 primary records.
[2025-10-24T01:19:36.317217] [INFO ] [MAIN      ] CIMN: Generated 139 derivative records from 2715 primary records.
[2025-10-24T01:19:36.317570] [DEBUG] [LOCAL     ] CINT: Saving derivative data.
[2025-10-24T01:19:36.318717] [DEBUG] [LOCAL     ] CIMN: Saving derivative data.
[2025-10-24T01:19:36.332314] [DEBUG] [LOCAL     ] CINT: Derivative data saved (139 records).
[2025-10-24T01:19:36.338622] [INFO ] [MAIN      ] CINT: Successfully saved derivative data.
[2025-10-24T01:19:36.341599] [INFO ] [MAIN      ] Derivative Progress: 413/2164 symbols completed. CINT took 1.0s. Estimated remaining: 12m 23s. Rate: 141.4 symbols/min
[2025-10-24T01:19:36.350423] [INFO ] [MAIN      ] CION: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:36.355882] [DEBUG] [LOCAL     ] CIMN: Derivative data saved (139 records).
[2025-10-24T01:19:36.356221] [INFO ] [MAIN      ] CIMN: Successfully saved derivative data.
[2025-10-24T01:19:36.359398] [INFO ] [MAIN      ] Derivative Progress: 414/2164 symbols completed. CIMN took 1.2s. Estimated remaining: 12m 21s. Rate: 141.7 symbols/min
[2025-10-24T01:19:36.359908] [INFO ] [MAIN      ] CIVI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:36.374924] [DEBUG] [LOCAL     ] CIO: Loaded 21445 existing records from primary storage.
[2025-10-24T01:19:36.375434] [INFO ] [MAIN      ] CIO: Loaded 21445 primary data records.
[2025-10-24T01:19:36.521011] [DEBUG] [LOCAL     ] CION: Loaded 28261 existing records from primary storage.
[2025-10-24T01:19:36.522468] [INFO ] [MAIN      ] CION: Loaded 28261 primary data records.
[2025-10-24T01:19:36.964037] [DEBUG] [LOCAL     ] CIVI: Loaded 53109 existing records from primary storage.
[2025-10-24T01:19:37.087162] [INFO ] [MAIN      ] CIVI: Loaded 53109 primary data records.
[2025-10-24T01:19:37.431308] [DEBUG] [MAIN      ] CIO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:37.468239] [DEBUG] [MAIN      ] CION: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:37.525066] [DEBUG] [MAIN      ] CIVI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:37.555904] [INFO ] [MAIN      ] CIO: Generated 139 derivative records from 21445 primary records.
[2025-10-24T01:19:37.563088] [DEBUG] [LOCAL     ] CIO: Saving derivative data.
[2025-10-24T01:19:37.576058] [INFO ] [MAIN      ] CION: Generated 139 derivative records from 28261 primary records.
[2025-10-24T01:19:37.577731] [DEBUG] [LOCAL     ] CION: Saving derivative data.
[2025-10-24T01:19:37.584312] [DEBUG] [LOCAL     ] CIO: Derivative data saved (139 records).
[2025-10-24T01:19:37.589052] [INFO ] [MAIN      ] CIO: Successfully saved derivative data.
[2025-10-24T01:19:37.600083] [INFO ] [MAIN      ] Derivative Progress: 415/2164 symbols completed. CIO took 1.3s. Estimated remaining: 12m 24s. Rate: 141.0 symbols/min
[2025-10-24T01:19:37.602768] [INFO ] [MAIN      ] CL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:37.609478] [DEBUG] [LOCAL     ] CION: Derivative data saved (139 records).
[2025-10-24T01:19:37.613979] [INFO ] [MAIN      ] CION: Successfully saved derivative data.
[2025-10-24T01:19:37.617398] [INFO ] [MAIN      ] Derivative Progress: 416/2164 symbols completed. CION took 1.3s. Estimated remaining: 12m 22s. Rate: 141.4 symbols/min
[2025-10-24T01:19:37.617969] [INFO ] [MAIN      ] CLB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:37.626345] [INFO ] [MAIN      ] CIVI: Generated 139 derivative records from 53109 primary records.
[2025-10-24T01:19:37.626554] [DEBUG] [LOCAL     ] CIVI: Saving derivative data.
[2025-10-24T01:19:37.640848] [DEBUG] [LOCAL     ] CIVI: Derivative data saved (139 records).
[2025-10-24T01:19:37.641403] [INFO ] [MAIN      ] CIVI: Successfully saved derivative data.
[2025-10-24T01:19:37.644092] [INFO ] [MAIN      ] Derivative Progress: 417/2164 symbols completed. CIVI took 1.3s. Estimated remaining: 12m 20s. Rate: 141.7 symbols/min
[2025-10-24T01:19:37.644618] [INFO ] [MAIN      ] CLCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:37.672244] [DEBUG] [LOCAL     ] CLCO: Loaded 13277 existing records from primary storage.
[2025-10-24T01:19:37.672412] [INFO ] [MAIN      ] CLCO: Loaded 13277 primary data records.
[2025-10-24T01:19:37.826638] [DEBUG] [LOCAL     ] CLB: Loaded 33810 existing records from primary storage.
[2025-10-24T01:19:37.889970] [INFO ] [MAIN      ] CLB: Loaded 33810 primary data records.
[2025-10-24T01:19:37.879371] [DEBUG] [LOCAL     ] CL: Loaded 54039 existing records from primary storage.
[2025-10-24T01:19:37.908809] [INFO ] [MAIN      ] CL: Loaded 54039 primary data records.
[2025-10-24T01:19:38.759220] [DEBUG] [MAIN      ] CLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:38.829003] [DEBUG] [MAIN      ] CLB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:38.835908] [DEBUG] [MAIN      ] CL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:38.855107] [INFO ] [MAIN      ] CLCO: Generated 139 derivative records from 13277 primary records.
[2025-10-24T01:19:38.869680] [DEBUG] [LOCAL     ] CLCO: Saving derivative data.
[2025-10-24T01:19:38.887460] [DEBUG] [LOCAL     ] CLCO: Derivative data saved (139 records).
[2025-10-24T01:19:38.889574] [INFO ] [MAIN      ] CLCO: Successfully saved derivative data.
[2025-10-24T01:19:38.895356] [INFO ] [MAIN      ] Derivative Progress: 418/2164 symbols completed. CLCO took 1.3s. Estimated remaining: 12m 23s. Rate: 141.0 symbols/min
[2025-10-24T01:19:38.934253] [INFO ] [MAIN      ] CL: Generated 139 derivative records from 54039 primary records.
[2025-10-24T01:19:38.934687] [DEBUG] [LOCAL     ] CL: Saving derivative data.
[2025-10-24T01:19:38.954393] [DEBUG] [LOCAL     ] CL: Derivative data saved (139 records).
[2025-10-24T01:19:38.954742] [INFO ] [MAIN      ] CLB: Generated 139 derivative records from 33810 primary records.
[2025-10-24T01:19:38.955066] [INFO ] [MAIN      ] CL: Successfully saved derivative data.
[2025-10-24T01:19:38.955328] [DEBUG] [LOCAL     ] CLB: Saving derivative data.
[2025-10-24T01:19:38.960797] [INFO ] [MAIN      ] Derivative Progress: 419/2164 symbols completed. CL took 1.4s. Estimated remaining: 12m 21s. Rate: 141.3 symbols/min
[2025-10-24T01:19:38.973441] [DEBUG] [LOCAL     ] CLB: Derivative data saved (139 records).
[2025-10-24T01:19:38.973565] [INFO ] [MAIN      ] CLB: Successfully saved derivative data.
[2025-10-24T01:19:38.977767] [INFO ] [MAIN      ] Derivative Progress: 420/2164 symbols completed. CLB took 1.4s. Estimated remaining: 12m 19s. Rate: 141.6 symbols/min
[2025-10-24T01:19:38.978566] [INFO ] [MAIN      ] CLF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:38.978798] [INFO ] [MAIN      ] CLH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:38.978377] [INFO ] [MAIN      ] CLDT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:39.021265] [DEBUG] [LOCAL     ] CLH: Loaded 27786 existing records from primary storage.
[2025-10-24T01:19:39.021718] [INFO ] [MAIN      ] CLH: Loaded 27786 primary data records.
[2025-10-24T01:19:39.103971] [DEBUG] [LOCAL     ] CLDT: Loaded 25339 existing records from primary storage.
[2025-10-24T01:19:39.126917] [INFO ] [MAIN      ] CLDT: Loaded 25339 primary data records.
[2025-10-24T01:19:39.510690] [DEBUG] [LOCAL     ] CLF: Loaded 54131 existing records from primary storage.
[2025-10-24T01:19:39.547096] [INFO ] [MAIN      ] CLF: Loaded 54131 primary data records.
[2025-10-24T01:19:40.109083] [DEBUG] [MAIN      ] CLH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:40.153405] [DEBUG] [MAIN      ] CLDT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:40.217300] [DEBUG] [MAIN      ] CLF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:40.256454] [INFO ] [MAIN      ] CLH: Generated 139 derivative records from 27786 primary records.
[2025-10-24T01:19:40.258547] [DEBUG] [LOCAL     ] CLH: Saving derivative data.
[2025-10-24T01:19:40.276830] [INFO ] [MAIN      ] CLDT: Generated 139 derivative records from 25339 primary records.
[2025-10-24T01:19:40.280281] [DEBUG] [LOCAL     ] CLDT: Saving derivative data.
[2025-10-24T01:19:40.277251] [DEBUG] [LOCAL     ] CLH: Derivative data saved (139 records).
[2025-10-24T01:19:40.281594] [INFO ] [MAIN      ] CLH: Successfully saved derivative data.
[2025-10-24T01:19:40.286228] [INFO ] [MAIN      ] Derivative Progress: 421/2164 symbols completed. CLH took 1.3s. Estimated remaining: 12m 22s. Rate: 140.9 symbols/min
[2025-10-24T01:19:40.287254] [INFO ] [MAIN      ] CLPR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:40.302828] [DEBUG] [LOCAL     ] CLDT: Derivative data saved (139 records).
[2025-10-24T01:19:40.309138] [INFO ] [MAIN      ] CLDT: Successfully saved derivative data.
[2025-10-24T01:19:40.315510] [INFO ] [MAIN      ] Derivative Progress: 422/2164 symbols completed. CLDT took 1.3s. Estimated remaining: 12m 20s. Rate: 141.2 symbols/min
[2025-10-24T01:19:40.325029] [DEBUG] [LOCAL     ] CLPR: Loaded 10044 existing records from primary storage.
[2025-10-24T01:19:40.325156] [INFO ] [MAIN      ] CLVT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:40.325619] [INFO ] [MAIN      ] CLPR: Loaded 10044 primary data records.
[2025-10-24T01:19:40.372952] [INFO ] [MAIN      ] CLF: Generated 139 derivative records from 54131 primary records.
[2025-10-24T01:19:40.402315] [DEBUG] [LOCAL     ] CLF: Saving derivative data.
[2025-10-24T01:19:40.458105] [DEBUG] [LOCAL     ] CLF: Derivative data saved (139 records).
[2025-10-24T01:19:40.485529] [INFO ] [MAIN      ] CLF: Successfully saved derivative data.
[2025-10-24T01:19:40.541971] [INFO ] [MAIN      ] Derivative Progress: 423/2164 symbols completed. CLF took 1.6s. Estimated remaining: 12m 19s. Rate: 141.4 symbols/min
[2025-10-24T01:19:40.685209] [INFO ] [MAIN      ] CLW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:40.709105] [DEBUG] [LOCAL     ] CLVT: Loaded 52276 existing records from primary storage.
[2025-10-24T01:19:40.710150] [INFO ] [MAIN      ] CLVT: Loaded 52276 primary data records.
[2025-10-24T01:19:40.843933] [DEBUG] [LOCAL     ] CLW: Loaded 21377 existing records from primary storage.
[2025-10-24T01:19:40.850583] [INFO ] [MAIN      ] CLW: Loaded 21377 primary data records.
[2025-10-24T01:19:41.241153] [DEBUG] [MAIN      ] CLPR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:41.453553] [INFO ] [MAIN      ] CLPR: Generated 139 derivative records from 10044 primary records.
[2025-10-24T01:19:41.454668] [DEBUG] [LOCAL     ] CLPR: Saving derivative data.
[2025-10-24T01:19:41.470309] [DEBUG] [MAIN      ] CLVT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:41.503309] [DEBUG] [LOCAL     ] CLPR: Derivative data saved (139 records).
[2025-10-24T01:19:41.505954] [INFO ] [MAIN      ] CLPR: Successfully saved derivative data.
[2025-10-24T01:19:41.523266] [DEBUG] [MAIN      ] CLW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:41.526750] [INFO ] [MAIN      ] Derivative Progress: 424/2164 symbols completed. CLPR took 1.2s. Estimated remaining: 12m 21s. Rate: 141.0 symbols/min
[2025-10-24T01:19:41.538672] [INFO ] [MAIN      ] CLX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:41.590801] [INFO ] [MAIN      ] CLVT: Generated 139 derivative records from 52276 primary records.
[2025-10-24T01:19:41.591004] [INFO ] [MAIN      ] CLW: Generated 139 derivative records from 21377 primary records.
[2025-10-24T01:19:41.591738] [DEBUG] [LOCAL     ] CLW: Saving derivative data.
[2025-10-24T01:19:41.591598] [DEBUG] [LOCAL     ] CLVT: Saving derivative data.
[2025-10-24T01:19:41.617259] [DEBUG] [LOCAL     ] CLVT: Derivative data saved (139 records).
[2025-10-24T01:19:41.636678] [DEBUG] [LOCAL     ] CLW: Derivative data saved (139 records).
[2025-10-24T01:19:41.636857] [INFO ] [MAIN      ] CLVT: Successfully saved derivative data.
[2025-10-24T01:19:41.637271] [INFO ] [MAIN      ] CLW: Successfully saved derivative data.
[2025-10-24T01:19:41.640600] [INFO ] [MAIN      ] Derivative Progress: 425/2164 symbols completed. CLVT took 1.3s. Estimated remaining: 12m 19s. Rate: 141.2 symbols/min
[2025-10-24T01:19:41.645732] [INFO ] [MAIN      ] CM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:41.645983] [INFO ] [MAIN      ] Derivative Progress: 426/2164 symbols completed. CLW took 1.0s. Estimated remaining: 12m 17s. Rate: 141.5 symbols/min
[2025-10-24T01:19:41.646923] [INFO ] [MAIN      ] CMA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:41.671435] [DEBUG] [LOCAL     ] CLX: Loaded 52189 existing records from primary storage.
[2025-10-24T01:19:41.671770] [INFO ] [MAIN      ] CLX: Loaded 52189 primary data records.
[2025-10-24T01:19:42.049904] [DEBUG] [LOCAL     ] CMA: Loaded 50557 existing records from primary storage.
[2025-10-24T01:19:42.050731] [INFO ] [MAIN      ] CMA: Loaded 50557 primary data records.
[2025-10-24T01:19:42.051931] [DEBUG] [LOCAL     ] CM: Loaded 48681 existing records from primary storage.
[2025-10-24T01:19:42.083132] [INFO ] [MAIN      ] CM: Loaded 48681 primary data records.
[2025-10-24T01:19:42.736762] [DEBUG] [MAIN      ] CLX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:42.795281] [DEBUG] [MAIN      ] CMA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:42.799142] [INFO ] [MAIN      ] CLX: Generated 139 derivative records from 52189 primary records.
[2025-10-24T01:19:42.799312] [DEBUG] [LOCAL     ] CLX: Saving derivative data.
[2025-10-24T01:19:42.845344] [DEBUG] [LOCAL     ] CLX: Derivative data saved (139 records).
[2025-10-24T01:19:42.845905] [DEBUG] [MAIN      ] CM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:42.846007] [INFO ] [MAIN      ] CLX: Successfully saved derivative data.
[2025-10-24T01:19:42.868303] [INFO ] [MAIN      ] Derivative Progress: 427/2164 symbols completed. CLX took 1.3s. Estimated remaining: 12m 20s. Rate: 140.9 symbols/min
[2025-10-24T01:19:42.869682] [INFO ] [MAIN      ] CMBT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:42.909202] [INFO ] [MAIN      ] CMA: Generated 139 derivative records from 50557 primary records.
[2025-10-24T01:19:42.912360] [INFO ] [MAIN      ] CM: Generated 139 derivative records from 48681 primary records.
[2025-10-24T01:19:42.912421] [DEBUG] [LOCAL     ] CMA: Saving derivative data.
[2025-10-24T01:19:42.912843] [DEBUG] [LOCAL     ] CM: Saving derivative data.
[2025-10-24T01:19:42.936411] [DEBUG] [LOCAL     ] CMBT: Loaded 27899 existing records from primary storage.
[2025-10-24T01:19:42.946819] [INFO ] [MAIN      ] CMBT: Loaded 27899 primary data records.
[2025-10-24T01:19:42.935781] [DEBUG] [LOCAL     ] CMA: Derivative data saved (139 records).
[2025-10-24T01:19:42.946974] [INFO ] [MAIN      ] CMA: Successfully saved derivative data.
[2025-10-24T01:19:42.950095] [DEBUG] [LOCAL     ] CM: Derivative data saved (139 records).
[2025-10-24T01:19:42.984012] [INFO ] [MAIN      ] Derivative Progress: 428/2164 symbols completed. CMA took 1.3s. Estimated remaining: 12m 18s. Rate: 141.2 symbols/min
[2025-10-24T01:19:42.996478] [INFO ] [MAIN      ] CM: Successfully saved derivative data.
[2025-10-24T01:19:42.996289] [INFO ] [MAIN      ] CMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:43.011942] [INFO ] [MAIN      ] Derivative Progress: 429/2164 symbols completed. CM took 1.4s. Estimated remaining: 12m 16s. Rate: 141.5 symbols/min
[2025-10-24T01:19:43.033315] [INFO ] [MAIN      ] CMCM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:43.141046] [DEBUG] [LOCAL     ] CMCM: Loaded 4858 existing records from primary storage.
[2025-10-24T01:19:43.226837] [INFO ] [MAIN      ] CMCM: Loaded 4858 primary data records.
[2025-10-24T01:19:43.419225] [DEBUG] [LOCAL     ] CMC: Loaded 45922 existing records from primary storage.
[2025-10-24T01:19:43.586198] [INFO ] [MAIN      ] CMC: Loaded 45922 primary data records.
[2025-10-24T01:19:43.923005] [DEBUG] [MAIN      ] CMBT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:43.963676] [DEBUG] [MAIN      ] CMCM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:44.016851] [DEBUG] [MAIN      ] CMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:44.030111] [INFO ] [MAIN      ] CMBT: Generated 139 derivative records from 27899 primary records.
[2025-10-24T01:19:44.031331] [DEBUG] [LOCAL     ] CMBT: Saving derivative data.
[2025-10-24T01:19:44.056330] [DEBUG] [LOCAL     ] CMBT: Derivative data saved (139 records).
[2025-10-24T01:19:44.057350] [INFO ] [MAIN      ] CMBT: Successfully saved derivative data.
[2025-10-24T01:19:44.060150] [INFO ] [MAIN      ] Derivative Progress: 430/2164 symbols completed. CMBT took 1.2s. Estimated remaining: 12m 18s. Rate: 141.0 symbols/min
[2025-10-24T01:19:44.063048] [INFO ] [MAIN      ] CMG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:44.069477] [INFO ] [MAIN      ] CMCM: Generated 139 derivative records from 4858 primary records.
[2025-10-24T01:19:44.071463] [DEBUG] [LOCAL     ] CMCM: Saving derivative data.
[2025-10-24T01:19:44.086715] [DEBUG] [LOCAL     ] CMCM: Derivative data saved (139 records).
[2025-10-24T01:19:44.089900] [INFO ] [MAIN      ] CMCM: Successfully saved derivative data.
[2025-10-24T01:19:44.092463] [INFO ] [MAIN      ] Derivative Progress: 431/2164 symbols completed. CMCM took 1.1s. Estimated remaining: 12m 16s. Rate: 141.3 symbols/min
[2025-10-24T01:19:44.092827] [INFO ] [MAIN      ] CMI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:44.098628] [INFO ] [MAIN      ] CMC: Generated 139 derivative records from 45922 primary records.
[2025-10-24T01:19:44.098920] [DEBUG] [LOCAL     ] CMC: Saving derivative data.
[2025-10-24T01:19:44.112384] [DEBUG] [LOCAL     ] CMC: Derivative data saved (139 records).
[2025-10-24T01:19:44.112627] [INFO ] [MAIN      ] CMC: Successfully saved derivative data.
[2025-10-24T01:19:44.117620] [INFO ] [MAIN      ] Derivative Progress: 432/2164 symbols completed. CMC took 1.1s. Estimated remaining: 12m 14s. Rate: 141.6 symbols/min
[2025-10-24T01:19:44.118678] [INFO ] [MAIN      ] CMP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:44.185983] [DEBUG] [LOCAL     ] CMI: Loaded 41922 existing records from primary storage.
[2025-10-24T01:19:44.193922] [INFO ] [MAIN      ] CMI: Loaded 41922 primary data records.
[2025-10-24T01:19:44.201432] [DEBUG] [LOCAL     ] CMG: Loaded 54112 existing records from primary storage.
[2025-10-24T01:19:44.219930] [INFO ] [MAIN      ] CMG: Loaded 54112 primary data records.
[2025-10-24T01:19:44.382350] [DEBUG] [LOCAL     ] CMP: Loaded 35825 existing records from primary storage.
[2025-10-24T01:19:44.382629] [INFO ] [MAIN      ] CMP: Loaded 35825 primary data records.
[2025-10-24T01:19:45.282585] [DEBUG] [MAIN      ] CMI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:45.298815] [DEBUG] [MAIN      ] CMG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:45.345816] [DEBUG] [MAIN      ] CMP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:45.433002] [INFO ] [MAIN      ] CMI: Generated 139 derivative records from 41922 primary records.
[2025-10-24T01:19:45.437204] [DEBUG] [LOCAL     ] CMI: Saving derivative data.
[2025-10-24T01:19:45.438265] [INFO ] [MAIN      ] CMG: Generated 139 derivative records from 54112 primary records.
[2025-10-24T01:19:45.449546] [DEBUG] [LOCAL     ] CMG: Saving derivative data.
[2025-10-24T01:19:45.454478] [INFO ] [MAIN      ] CMP: Generated 139 derivative records from 35825 primary records.
[2025-10-24T01:19:45.467176] [DEBUG] [LOCAL     ] CMP: Saving derivative data.
[2025-10-24T01:19:45.467057] [DEBUG] [LOCAL     ] CMG: Derivative data saved (139 records).
[2025-10-24T01:19:45.467924] [INFO ] [MAIN      ] CMG: Successfully saved derivative data.
[2025-10-24T01:19:45.471562] [INFO ] [MAIN      ] Derivative Progress: 433/2164 symbols completed. CMG took 1.4s. Estimated remaining: 12m 17s. Rate: 140.9 symbols/min
[2025-10-24T01:19:45.473580] [DEBUG] [LOCAL     ] CMI: Derivative data saved (139 records).
[2025-10-24T01:19:45.485737] [INFO ] [MAIN      ] CMI: Successfully saved derivative data.
[2025-10-24T01:19:45.486444] [DEBUG] [LOCAL     ] CMP: Derivative data saved (139 records).
[2025-10-24T01:19:45.489989] [INFO ] [MAIN      ] Derivative Progress: 434/2164 symbols completed. CMI took 1.4s. Estimated remaining: 12m 15s. Rate: 141.2 symbols/min
[2025-10-24T01:19:45.490201] [INFO ] [MAIN      ] CMP: Successfully saved derivative data.
[2025-10-24T01:19:45.493688] [INFO ] [MAIN      ] Derivative Progress: 435/2164 symbols completed. CMP took 1.4s. Estimated remaining: 12m 13s. Rate: 141.5 symbols/min
[2025-10-24T01:19:45.494164] [INFO ] [MAIN      ] CMPO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:45.494365] [INFO ] [MAIN      ] CMRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:45.494432] [INFO ] [MAIN      ] CMS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:45.568405] [DEBUG] [LOCAL     ] CMPO: Loaded 38603 existing records from primary storage.
[2025-10-24T01:19:45.569422] [INFO ] [MAIN      ] CMPO: Loaded 38603 primary data records.
[2025-10-24T01:19:45.569335] [DEBUG] [LOCAL     ] CMRE: Loaded 35849 existing records from primary storage.
[2025-10-24T01:19:45.583180] [INFO ] [MAIN      ] CMRE: Loaded 35849 primary data records.
[2025-10-24T01:19:45.795843] [DEBUG] [LOCAL     ] CMS: Loaded 52913 existing records from primary storage.
[2025-10-24T01:19:45.852009] [INFO ] [MAIN      ] CMS: Loaded 52913 primary data records.
[2025-10-24T01:19:46.558616] [DEBUG] [MAIN      ] CMPO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:46.593854] [DEBUG] [MAIN      ] CMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:46.653242] [DEBUG] [MAIN      ] CMS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:46.691528] [INFO ] [MAIN      ] CMRE: Generated 139 derivative records from 35849 primary records.
[2025-10-24T01:19:46.697194] [DEBUG] [LOCAL     ] CMRE: Saving derivative data.
[2025-10-24T01:19:46.698827] [INFO ] [MAIN      ] CMPO: Generated 139 derivative records from 38603 primary records.
[2025-10-24T01:19:46.701395] [DEBUG] [LOCAL     ] CMPO: Saving derivative data.
[2025-10-24T01:19:46.714511] [DEBUG] [LOCAL     ] CMRE: Derivative data saved (139 records).
[2025-10-24T01:19:46.717459] [INFO ] [MAIN      ] CMRE: Successfully saved derivative data.
[2025-10-24T01:19:46.734563] [DEBUG] [LOCAL     ] CMPO: Derivative data saved (139 records).
[2025-10-24T01:19:46.737176] [INFO ] [MAIN      ] CMPO: Successfully saved derivative data.
[2025-10-24T01:19:46.731244] [INFO ] [MAIN      ] Derivative Progress: 436/2164 symbols completed. CMRE took 1.2s. Estimated remaining: 12m 16s. Rate: 140.9 symbols/min
[2025-10-24T01:19:46.740215] [INFO ] [MAIN      ] CMSA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:46.740451] [INFO ] [MAIN      ] Derivative Progress: 437/2164 symbols completed. CMPO took 1.2s. Estimated remaining: 12m 14s. Rate: 141.2 symbols/min
[2025-10-24T01:19:46.742078] [INFO ] [MAIN      ] CMSC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:46.752599] [DEBUG] [LOCAL     ] CMSA: Loaded 3498 existing records from primary storage.
[2025-10-24T01:19:46.753048] [INFO ] [MAIN      ] CMSA: Loaded 3498 primary data records.
[2025-10-24T01:19:46.755188] [INFO ] [MAIN      ] CMS: Generated 139 derivative records from 52913 primary records.
[2025-10-24T01:19:46.762279] [DEBUG] [LOCAL     ] CMS: Saving derivative data.
[2025-10-24T01:19:46.798033] [DEBUG] [LOCAL     ] CMSC: Loaded 4826 existing records from primary storage.
[2025-10-24T01:19:46.818155] [INFO ] [MAIN      ] CMSC: Loaded 4826 primary data records.
[2025-10-24T01:19:46.821373] [DEBUG] [LOCAL     ] CMS: Derivative data saved (139 records).
[2025-10-24T01:19:46.875634] [INFO ] [MAIN      ] CMS: Successfully saved derivative data.
[2025-10-24T01:19:46.934091] [INFO ] [MAIN      ] Derivative Progress: 438/2164 symbols completed. CMS took 1.4s. Estimated remaining: 12m 12s. Rate: 141.4 symbols/min
[2025-10-24T01:19:46.964733] [INFO ] [MAIN      ] CMSD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:47.077905] [DEBUG] [LOCAL     ] CMSD: Loaded 7641 existing records from primary storage.
[2025-10-24T01:19:47.172295] [INFO ] [MAIN      ] CMSD: Loaded 7641 primary data records.
[2025-10-24T01:19:47.876998] [DEBUG] [MAIN      ] CMSC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:47.905162] [DEBUG] [MAIN      ] CMSA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:47.960792] [DEBUG] [MAIN      ] CMSD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:48.010786] [INFO ] [MAIN      ] CMSC: Generated 139 derivative records from 4826 primary records.
[2025-10-24T01:19:48.014186] [DEBUG] [LOCAL     ] CMSC: Saving derivative data.
[2025-10-24T01:19:48.024091] [INFO ] [MAIN      ] CMSA: Generated 139 derivative records from 3498 primary records.
[2025-10-24T01:19:48.033322] [DEBUG] [LOCAL     ] CMSC: Derivative data saved (139 records).
[2025-10-24T01:19:48.033480] [INFO ] [MAIN      ] CMSC: Successfully saved derivative data.
[2025-10-24T01:19:48.028752] [DEBUG] [LOCAL     ] CMSA: Saving derivative data.
[2025-10-24T01:19:48.035688] [INFO ] [MAIN      ] Derivative Progress: 439/2164 symbols completed. CMSC took 1.3s. Estimated remaining: 12m 15s. Rate: 140.9 symbols/min
[2025-10-24T01:19:48.039667] [INFO ] [MAIN      ] CMTG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:48.051750] [DEBUG] [LOCAL     ] CMSA: Derivative data saved (139 records).
[2025-10-24T01:19:48.052264] [INFO ] [MAIN      ] CMSA: Successfully saved derivative data.
[2025-10-24T01:19:48.058621] [INFO ] [MAIN      ] Derivative Progress: 440/2164 symbols completed. CMSA took 1.3s. Estimated remaining: 12m 13s. Rate: 141.2 symbols/min
[2025-10-24T01:19:48.060491] [INFO ] [MAIN      ] CMU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:48.067268] [INFO ] [MAIN      ] CMSD: Generated 139 derivative records from 7641 primary records.
[2025-10-24T01:19:48.067569] [DEBUG] [LOCAL     ] CMSD: Saving derivative data.
[2025-10-24T01:19:48.080403] [DEBUG] [LOCAL     ] CMSD: Derivative data saved (139 records).
[2025-10-24T01:19:48.091517] [INFO ] [MAIN      ] CMSD: Successfully saved derivative data.
[2025-10-24T01:19:48.094772] [INFO ] [MAIN      ] Derivative Progress: 441/2164 symbols completed. CMSD took 1.1s. Estimated remaining: 12m 11s. Rate: 141.5 symbols/min
[2025-10-24T01:19:48.096874] [INFO ] [MAIN      ] CNA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:48.103051] [DEBUG] [LOCAL     ] CMU: Loaded 6355 existing records from primary storage.
[2025-10-24T01:19:48.104915] [INFO ] [MAIN      ] CMU: Loaded 6355 primary data records.
[2025-10-24T01:19:48.204246] [DEBUG] [LOCAL     ] CMTG: Loaded 35366 existing records from primary storage.
[2025-10-24T01:19:48.233581] [INFO ] [MAIN      ] CMTG: Loaded 35366 primary data records.
[2025-10-24T01:19:48.611821] [DEBUG] [LOCAL     ] CNA: Loaded 32677 existing records from primary storage.
[2025-10-24T01:19:48.666875] [INFO ] [MAIN      ] CNA: Loaded 32677 primary data records.
[2025-10-24T01:19:49.234469] [DEBUG] [MAIN      ] CMU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:49.288331] [DEBUG] [MAIN      ] CMTG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:49.316114] [INFO ] [MAIN      ] CMU: Generated 139 derivative records from 6355 primary records.
[2025-10-24T01:19:49.317677] [DEBUG] [LOCAL     ] CMU: Saving derivative data.
[2025-10-24T01:19:49.346072] [DEBUG] [LOCAL     ] CMU: Derivative data saved (139 records).
[2025-10-24T01:19:49.351859] [INFO ] [MAIN      ] CMU: Successfully saved derivative data.
[2025-10-24T01:19:49.352917] [DEBUG] [MAIN      ] CNA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:49.356332] [INFO ] [MAIN      ] Derivative Progress: 442/2164 symbols completed. CMU took 1.3s. Estimated remaining: 12m 14s. Rate: 140.8 symbols/min
[2025-10-24T01:19:49.370904] [INFO ] [MAIN      ] CNC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:49.411461] [INFO ] [MAIN      ] CMTG: Generated 139 derivative records from 35366 primary records.
[2025-10-24T01:19:49.411987] [DEBUG] [LOCAL     ] CMTG: Saving derivative data.
[2025-10-24T01:19:49.429554] [DEBUG] [LOCAL     ] CMTG: Derivative data saved (139 records).
[2025-10-24T01:19:49.430237] [INFO ] [MAIN      ] CMTG: Successfully saved derivative data.
[2025-10-24T01:19:49.434566] [INFO ] [MAIN      ] Derivative Progress: 443/2164 symbols completed. CMTG took 1.4s. Estimated remaining: 12m 12s. Rate: 141.1 symbols/min
[2025-10-24T01:19:49.452030] [INFO ] [MAIN      ] CNF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:49.455688] [INFO ] [MAIN      ] CNA: Generated 139 derivative records from 32677 primary records.
[2025-10-24T01:19:49.455940] [DEBUG] [LOCAL     ] CNA: Saving derivative data.
[2025-10-24T01:19:49.470314] [DEBUG] [LOCAL     ] CNA: Derivative data saved (139 records).
[2025-10-24T01:19:49.475161] [INFO ] [MAIN      ] CNA: Successfully saved derivative data.
[2025-10-24T01:19:49.479449] [INFO ] [MAIN      ] Derivative Progress: 444/2164 symbols completed. CNA took 1.4s. Estimated remaining: 12m 10s. Rate: 141.4 symbols/min
[2025-10-24T01:19:49.495594] [INFO ] [MAIN      ] CNH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:49.497710] [DEBUG] [LOCAL     ] CNC: Loaded 54169 existing records from primary storage.
[2025-10-24T01:19:49.498169] [INFO ] [MAIN      ] CNC: Loaded 54169 primary data records.
[2025-10-24T01:19:49.538429] [DEBUG] [LOCAL     ] CNF: Loaded 10614 existing records from primary storage.
[2025-10-24T01:19:49.599983] [INFO ] [MAIN      ] CNF: Loaded 10614 primary data records.
[2025-10-24T01:19:50.191046] [DEBUG] [LOCAL     ] CNH: Loaded 53936 existing records from primary storage.
[2025-10-24T01:19:50.192191] [INFO ] [MAIN      ] CNH: Loaded 53936 primary data records.
[2025-10-24T01:19:50.542833] [DEBUG] [MAIN      ] CNC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:50.579517] [DEBUG] [MAIN      ] CNF: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:19:50.648249] [DEBUG] [MAIN      ] CNH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:50.668381] [INFO ] [MAIN      ] CNC: Generated 139 derivative records from 54169 primary records.
[2025-10-24T01:19:50.671455] [DEBUG] [LOCAL     ] CNC: Saving derivative data.
[2025-10-24T01:19:50.703175] [DEBUG] [LOCAL     ] CNC: Derivative data saved (139 records).
[2025-10-24T01:19:50.703827] [INFO ] [MAIN      ] CNC: Successfully saved derivative data.
[2025-10-24T01:19:50.709215] [INFO ] [MAIN      ] Derivative Progress: 445/2164 symbols completed. CNC took 1.3s. Estimated remaining: 12m 13s. Rate: 140.8 symbols/min
[2025-10-24T01:19:50.709908] [INFO ] [MAIN      ] CNI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:50.713266] [INFO ] [MAIN      ] CNF: Generated 139 derivative records from 10614 primary records.
[2025-10-24T01:19:50.719128] [DEBUG] [LOCAL     ] CNF: Saving derivative data.
[2025-10-24T01:19:50.737571] [DEBUG] [LOCAL     ] CNF: Derivative data saved (139 records).
[2025-10-24T01:19:50.740902] [INFO ] [MAIN      ] CNF: Successfully saved derivative data.
[2025-10-24T01:19:50.744861] [INFO ] [MAIN      ] Derivative Progress: 446/2164 symbols completed. CNF took 1.3s. Estimated remaining: 12m 11s. Rate: 141.1 symbols/min
[2025-10-24T01:19:50.745161] [INFO ] [MAIN      ] CNM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:50.749015] [INFO ] [MAIN      ] CNH: Generated 139 derivative records from 53936 primary records.
[2025-10-24T01:19:50.749207] [DEBUG] [LOCAL     ] CNH: Saving derivative data.
[2025-10-24T01:19:50.763916] [DEBUG] [LOCAL     ] CNH: Derivative data saved (139 records).
[2025-10-24T01:19:50.764318] [INFO ] [MAIN      ] CNH: Successfully saved derivative data.
[2025-10-24T01:19:50.767634] [INFO ] [MAIN      ] Derivative Progress: 447/2164 symbols completed. CNH took 1.3s. Estimated remaining: 12m 9s. Rate: 141.4 symbols/min
[2025-10-24T01:19:50.768051] [INFO ] [MAIN      ] CNMD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:50.840039] [DEBUG] [LOCAL     ] CNI: Loaded 52019 existing records from primary storage.
[2025-10-24T01:19:50.840596] [INFO ] [MAIN      ] CNI: Loaded 52019 primary data records.
[2025-10-24T01:19:50.970714] [DEBUG] [LOCAL     ] CNM: Loaded 51372 existing records from primary storage.
[2025-10-24T01:19:50.984260] [DEBUG] [LOCAL     ] CNMD: Loaded 32316 existing records from primary storage.
[2025-10-24T01:19:50.984493] [INFO ] [MAIN      ] CNMD: Loaded 32316 primary data records.
[2025-10-24T01:19:50.984423] [INFO ] [MAIN      ] CNM: Loaded 51372 primary data records.
[2025-10-24T01:19:51.961595] [DEBUG] [MAIN      ] CNI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:52.006490] [DEBUG] [MAIN      ] CNMD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:52.022319] [DEBUG] [MAIN      ] CNM: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:19:52.068288] [INFO ] [MAIN      ] CNI: Generated 139 derivative records from 52019 primary records.
[2025-10-24T01:19:52.068987] [DEBUG] [LOCAL     ] CNI: Saving derivative data.
[2025-10-24T01:19:52.089353] [DEBUG] [LOCAL     ] CNI: Derivative data saved (139 records).
[2025-10-24T01:19:52.089931] [INFO ] [MAIN      ] CNI: Successfully saved derivative data.
[2025-10-24T01:19:52.092474] [INFO ] [MAIN      ] Derivative Progress: 448/2164 symbols completed. CNI took 1.4s. Estimated remaining: 12m 12s. Rate: 140.7 symbols/min
[2025-10-24T01:19:52.108162] [INFO ] [MAIN      ] CNM: Generated 139 derivative records from 51372 primary records.
[2025-10-24T01:19:52.109791] [DEBUG] [LOCAL     ] CNM: Saving derivative data.
[2025-10-24T01:19:52.126692] [DEBUG] [LOCAL     ] CNM: Derivative data saved (139 records).
[2025-10-24T01:19:52.128516] [INFO ] [MAIN      ] CNM: Successfully saved derivative data.
[2025-10-24T01:19:52.133087] [INFO ] [MAIN      ] Derivative Progress: 449/2164 symbols completed. CNM took 1.4s. Estimated remaining: 12m 10s. Rate: 141.0 symbols/min
[2025-10-24T01:19:52.135736] [INFO ] [MAIN      ] CNMD: Generated 139 derivative records from 32316 primary records.
[2025-10-24T01:19:52.135834] [DEBUG] [LOCAL     ] CNMD: Saving derivative data.
[2025-10-24T01:19:52.148125] [DEBUG] [LOCAL     ] CNMD: Derivative data saved (139 records).
[2025-10-24T01:19:52.148232] [INFO ] [MAIN      ] CNMD: Successfully saved derivative data.
[2025-10-24T01:19:52.152624] [INFO ] [MAIN      ] Derivative Progress: 450/2164 symbols completed. CNMD took 1.4s. Estimated remaining: 12m 8s. Rate: 141.3 symbols/min
[2025-10-24T01:19:52.153196] [INFO ] [MAIN      ] CNP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:52.153123] [INFO ] [MAIN      ] CNNE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:52.153235] [INFO ] [MAIN      ] CNO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:52.239596] [DEBUG] [LOCAL     ] CNNE: Loaded 35966 existing records from primary storage.
[2025-10-24T01:19:52.243682] [INFO ] [MAIN      ] CNNE: Loaded 35966 primary data records.
[2025-10-24T01:19:52.270539] [DEBUG] [LOCAL     ] CNO: Loaded 40585 existing records from primary storage.
[2025-10-24T01:19:52.283570] [INFO ] [MAIN      ] CNO: Loaded 40585 primary data records.
[2025-10-24T01:19:52.334403] [DEBUG] [LOCAL     ] CNP: Loaded 53865 existing records from primary storage.
[2025-10-24T01:19:52.402253] [INFO ] [MAIN      ] CNP: Loaded 53865 primary data records.
[2025-10-24T01:19:53.286499] [DEBUG] [MAIN      ] CNNE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:53.321775] [DEBUG] [MAIN      ] CNO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:53.381253] [DEBUG] [MAIN      ] CNP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:53.445437] [INFO ] [MAIN      ] CNNE: Generated 139 derivative records from 35966 primary records.
[2025-10-24T01:19:53.449523] [INFO ] [MAIN      ] CNO: Generated 139 derivative records from 40585 primary records.
[2025-10-24T01:19:53.450331] [DEBUG] [LOCAL     ] CNO: Saving derivative data.
[2025-10-24T01:19:53.450054] [DEBUG] [LOCAL     ] CNNE: Saving derivative data.
[2025-10-24T01:19:53.477765] [DEBUG] [LOCAL     ] CNO: Derivative data saved (139 records).
[2025-10-24T01:19:53.480762] [DEBUG] [LOCAL     ] CNNE: Derivative data saved (139 records).
[2025-10-24T01:19:53.481247] [INFO ] [MAIN      ] CNO: Successfully saved derivative data.
[2025-10-24T01:19:53.480941] [INFO ] [MAIN      ] CNNE: Successfully saved derivative data.
[2025-10-24T01:19:53.485125] [INFO ] [MAIN      ] Derivative Progress: 451/2164 symbols completed. CNNE took 1.3s. Estimated remaining: 12m 11s. Rate: 140.6 symbols/min
[2025-10-24T01:19:53.489868] [INFO ] [MAIN      ] CNQ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:53.490054] [INFO ] [MAIN      ] Derivative Progress: 452/2164 symbols completed. CNO took 1.3s. Estimated remaining: 12m 9s. Rate: 140.9 symbols/min
[2025-10-24T01:19:53.491381] [INFO ] [MAIN      ] CNS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:53.497473] [INFO ] [MAIN      ] CNP: Generated 139 derivative records from 53865 primary records.
[2025-10-24T01:19:53.497692] [DEBUG] [LOCAL     ] CNP: Saving derivative data.
[2025-10-24T01:19:53.511802] [DEBUG] [LOCAL     ] CNP: Derivative data saved (139 records).
[2025-10-24T01:19:53.511912] [INFO ] [MAIN      ] CNP: Successfully saved derivative data.
[2025-10-24T01:19:53.515034] [INFO ] [MAIN      ] Derivative Progress: 453/2164 symbols completed. CNP took 1.4s. Estimated remaining: 12m 7s. Rate: 141.2 symbols/min
[2025-10-24T01:19:53.515638] [INFO ] [MAIN      ] CNX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:53.535464] [DEBUG] [LOCAL     ] CNS: Loaded 21443 existing records from primary storage.
[2025-10-24T01:19:53.535948] [INFO ] [MAIN      ] CNS: Loaded 21443 primary data records.
[2025-10-24T01:19:53.770288] [DEBUG] [LOCAL     ] CNQ: Loaded 53972 existing records from primary storage.
[2025-10-24T01:19:53.777900] [INFO ] [MAIN      ] CNQ: Loaded 53972 primary data records.
[2025-10-24T01:19:54.053175] [DEBUG] [LOCAL     ] CNX: Loaded 51709 existing records from primary storage.
[2025-10-24T01:19:54.082170] [INFO ] [MAIN      ] CNX: Loaded 51709 primary data records.
[2025-10-24T01:19:54.678112] [DEBUG] [MAIN      ] CNS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:54.732862] [DEBUG] [MAIN      ] CNQ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:54.782236] [DEBUG] [MAIN      ] CNX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:54.810216] [INFO ] [MAIN      ] CNS: Generated 139 derivative records from 21443 primary records.
[2025-10-24T01:19:54.811625] [DEBUG] [LOCAL     ] CNS: Saving derivative data.
[2025-10-24T01:19:54.835310] [DEBUG] [LOCAL     ] CNS: Derivative data saved (139 records).
[2025-10-24T01:19:54.840955] [INFO ] [MAIN      ] CNS: Successfully saved derivative data.
[2025-10-24T01:19:54.843561] [INFO ] [MAIN      ] Derivative Progress: 454/2164 symbols completed. CNS took 1.4s. Estimated remaining: 12m 10s. Rate: 140.6 symbols/min
[2025-10-24T01:19:54.849969] [INFO ] [MAIN      ] CODI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:54.865873] [INFO ] [MAIN      ] CNQ: Generated 139 derivative records from 53972 primary records.
[2025-10-24T01:19:54.868132] [DEBUG] [LOCAL     ] CNQ: Saving derivative data.
[2025-10-24T01:19:54.906680] [DEBUG] [LOCAL     ] CNQ: Derivative data saved (139 records).
[2025-10-24T01:19:54.908807] [INFO ] [MAIN      ] CNQ: Successfully saved derivative data.
[2025-10-24T01:19:54.929939] [INFO ] [MAIN      ] Derivative Progress: 455/2164 symbols completed. CNQ took 1.4s. Estimated remaining: 12m 8s. Rate: 140.8 symbols/min
[2025-10-24T01:19:54.930736] [INFO ] [MAIN      ] CNX: Generated 139 derivative records from 51709 primary records.
[2025-10-24T01:19:54.931739] [DEBUG] [LOCAL     ] CNX: Saving derivative data.
[2025-10-24T01:19:54.930974] [INFO ] [MAIN      ] COF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:54.963730] [DEBUG] [LOCAL     ] CNX: Derivative data saved (139 records).
[2025-10-24T01:19:54.965893] [INFO ] [MAIN      ] CNX: Successfully saved derivative data.
[2025-10-24T01:19:54.969893] [INFO ] [MAIN      ] Derivative Progress: 456/2164 symbols completed. CNX took 1.5s. Estimated remaining: 12m 6s. Rate: 141.1 symbols/min
[2025-10-24T01:19:54.970726] [INFO ] [MAIN      ] COLD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:54.973481] [DEBUG] [LOCAL     ] CODI: Loaded 42256 existing records from primary storage.
[2025-10-24T01:19:54.973884] [INFO ] [MAIN      ] CODI: Loaded 42256 primary data records.
[2025-10-24T01:19:55.322373] [DEBUG] [LOCAL     ] COF: Loaded 54015 existing records from primary storage.
[2025-10-24T01:19:55.472044] [INFO ] [MAIN      ] COF: Loaded 54015 primary data records.
[2025-10-24T01:19:55.473232] [DEBUG] [LOCAL     ] COLD: Loaded 52875 existing records from primary storage.
[2025-10-24T01:19:55.514728] [INFO ] [MAIN      ] COLD: Loaded 52875 primary data records.
[2025-10-24T01:19:56.186952] [DEBUG] [MAIN      ] CODI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:56.243946] [DEBUG] [MAIN      ] COLD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:56.272364] [DEBUG] [MAIN      ] COF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:56.294083] [INFO ] [MAIN      ] CODI: Generated 139 derivative records from 42256 primary records.
[2025-10-24T01:19:56.297892] [DEBUG] [LOCAL     ] CODI: Saving derivative data.
[2025-10-24T01:19:56.320965] [DEBUG] [LOCAL     ] CODI: Derivative data saved (139 records).
[2025-10-24T01:19:56.324069] [INFO ] [MAIN      ] CODI: Successfully saved derivative data.
[2025-10-24T01:19:56.331352] [INFO ] [MAIN      ] Derivative Progress: 457/2164 symbols completed. CODI took 1.5s. Estimated remaining: 12m 9s. Rate: 140.4 symbols/min
[2025-10-24T01:19:56.333435] [INFO ] [MAIN      ] COMP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:56.347391] [INFO ] [MAIN      ] COLD: Generated 139 derivative records from 52875 primary records.
[2025-10-24T01:19:56.350538] [DEBUG] [LOCAL     ] COLD: Saving derivative data.
[2025-10-24T01:19:56.368897] [INFO ] [MAIN      ] COF: Generated 139 derivative records from 54015 primary records.
[2025-10-24T01:19:56.369342] [DEBUG] [LOCAL     ] COLD: Derivative data saved (139 records).
[2025-10-24T01:19:56.369508] [DEBUG] [LOCAL     ] COF: Saving derivative data.
[2025-10-24T01:19:56.369600] [INFO ] [MAIN      ] COLD: Successfully saved derivative data.
[2025-10-24T01:19:56.373081] [INFO ] [MAIN      ] Derivative Progress: 458/2164 symbols completed. COLD took 1.4s. Estimated remaining: 12m 8s. Rate: 140.7 symbols/min
[2025-10-24T01:19:56.373659] [INFO ] [MAIN      ] CON: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:56.386367] [DEBUG] [LOCAL     ] COF: Derivative data saved (139 records).
[2025-10-24T01:19:56.399370] [INFO ] [MAIN      ] COF: Successfully saved derivative data.
[2025-10-24T01:19:56.402404] [INFO ] [MAIN      ] Derivative Progress: 459/2164 symbols completed. COF took 1.5s. Estimated remaining: 12m 6s. Rate: 141.0 symbols/min
[2025-10-24T01:19:56.402970] [INFO ] [MAIN      ] COOK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:56.426861] [DEBUG] [LOCAL     ] COMP: Loaded 53793 existing records from primary storage.
[2025-10-24T01:19:56.427233] [INFO ] [MAIN      ] COMP: Loaded 53793 primary data records.
[2025-10-24T01:19:56.556787] [DEBUG] [LOCAL     ] COOK: Loaded 24994 existing records from primary storage.
[2025-10-24T01:19:56.584006] [INFO ] [MAIN      ] COOK: Loaded 24994 primary data records.
[2025-10-24T01:19:56.667474] [DEBUG] [LOCAL     ] CON: Loaded 39033 existing records from primary storage.
[2025-10-24T01:19:56.809605] [INFO ] [MAIN      ] CON: Loaded 39033 primary data records.
[2025-10-24T01:19:57.425027] [DEBUG] [MAIN      ] COMP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:57.462261] [DEBUG] [MAIN      ] COOK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:57.502333] [DEBUG] [MAIN      ] CON: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:57.533382] [INFO ] [MAIN      ] COMP: Generated 139 derivative records from 53793 primary records.
[2025-10-24T01:19:57.538314] [DEBUG] [LOCAL     ] COMP: Saving derivative data.
[2025-10-24T01:19:57.556512] [DEBUG] [LOCAL     ] COMP: Derivative data saved (139 records).
[2025-10-24T01:19:57.560757] [INFO ] [MAIN      ] COMP: Successfully saved derivative data.
[2025-10-24T01:19:57.564842] [INFO ] [MAIN      ] Derivative Progress: 460/2164 symbols completed. COMP took 1.2s. Estimated remaining: 12m 8s. Rate: 140.4 symbols/min
[2025-10-24T01:19:57.568117] [INFO ] [MAIN      ] COP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:57.570292] [INFO ] [MAIN      ] COOK: Generated 139 derivative records from 24994 primary records.
[2025-10-24T01:19:57.570497] [DEBUG] [LOCAL     ] COOK: Saving derivative data.
[2025-10-24T01:19:57.584923] [DEBUG] [LOCAL     ] COOK: Derivative data saved (139 records).
[2025-10-24T01:19:57.585476] [INFO ] [MAIN      ] COOK: Successfully saved derivative data.
[2025-10-24T01:19:57.591568] [INFO ] [MAIN      ] Derivative Progress: 461/2164 symbols completed. COOK took 1.2s. Estimated remaining: 12m 6s. Rate: 140.7 symbols/min
[2025-10-24T01:19:57.592082] [INFO ] [MAIN      ] COTY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:57.595987] [INFO ] [MAIN      ] CON: Generated 139 derivative records from 39033 primary records.
[2025-10-24T01:19:57.596144] [DEBUG] [LOCAL     ] CON: Saving derivative data.
[2025-10-24T01:19:57.609714] [DEBUG] [LOCAL     ] CON: Derivative data saved (139 records).
[2025-10-24T01:19:57.609976] [INFO ] [MAIN      ] CON: Successfully saved derivative data.
[2025-10-24T01:19:57.612993] [INFO ] [MAIN      ] Derivative Progress: 462/2164 symbols completed. CON took 1.2s. Estimated remaining: 12m 4s. Rate: 141.0 symbols/min
[2025-10-24T01:19:57.613436] [INFO ] [MAIN      ] COUR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:57.682768] [DEBUG] [LOCAL     ] COP: Loaded 54117 existing records from primary storage.
[2025-10-24T01:19:57.693143] [DEBUG] [LOCAL     ] COTY: Loaded 53642 existing records from primary storage.
[2025-10-24T01:19:57.693248] [INFO ] [MAIN      ] COP: Loaded 54117 primary data records.
[2025-10-24T01:19:57.693407] [INFO ] [MAIN      ] COTY: Loaded 53642 primary data records.
[2025-10-24T01:19:57.926847] [DEBUG] [LOCAL     ] COUR: Loaded 49789 existing records from primary storage.
[2025-10-24T01:19:57.947594] [INFO ] [MAIN      ] COUR: Loaded 49789 primary data records.
[2025-10-24T01:19:58.714304] [DEBUG] [MAIN      ] COP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:58.715132] [DEBUG] [MAIN      ] COTY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:58.789180] [DEBUG] [MAIN      ] COUR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:58.825342] [INFO ] [MAIN      ] COP: Generated 139 derivative records from 54117 primary records.
[2025-10-24T01:19:58.830395] [DEBUG] [LOCAL     ] COP: Saving derivative data.
[2025-10-24T01:19:58.847693] [DEBUG] [LOCAL     ] COP: Derivative data saved (139 records).
[2025-10-24T01:19:58.849371] [INFO ] [MAIN      ] COP: Successfully saved derivative data.
[2025-10-24T01:19:58.855792] [INFO ] [MAIN      ] COTY: Generated 139 derivative records from 53642 primary records.
[2025-10-24T01:19:58.855138] [INFO ] [MAIN      ] Derivative Progress: 463/2164 symbols completed. COP took 1.3s. Estimated remaining: 12m 7s. Rate: 140.4 symbols/min
[2025-10-24T01:19:58.856020] [DEBUG] [LOCAL     ] COTY: Saving derivative data.
[2025-10-24T01:19:58.870916] [DEBUG] [LOCAL     ] COTY: Derivative data saved (139 records).
[2025-10-24T01:19:58.874690] [INFO ] [MAIN      ] COTY: Successfully saved derivative data.
[2025-10-24T01:19:58.878275] [INFO ] [MAIN      ] Derivative Progress: 464/2164 symbols completed. COTY took 1.3s. Estimated remaining: 12m 5s. Rate: 140.7 symbols/min
[2025-10-24T01:19:58.881591] [INFO ] [MAIN      ] COUR: Generated 139 derivative records from 49789 primary records.
[2025-10-24T01:19:58.881708] [DEBUG] [LOCAL     ] COUR: Saving derivative data.
[2025-10-24T01:19:58.893659] [DEBUG] [LOCAL     ] COUR: Derivative data saved (139 records).
[2025-10-24T01:19:58.893748] [INFO ] [MAIN      ] COUR: Successfully saved derivative data.
[2025-10-24T01:19:58.897072] [INFO ] [MAIN      ] Derivative Progress: 465/2164 symbols completed. COUR took 1.3s. Estimated remaining: 12m 3s. Rate: 141.0 symbols/min
[2025-10-24T01:19:58.897615] [INFO ] [MAIN      ] CPA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:58.897786] [INFO ] [MAIN      ] CP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:58.897855] [INFO ] [MAIN      ] CPAY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:19:58.961585] [DEBUG] [LOCAL     ] CPAY: Loaded 30232 existing records from primary storage.
[2025-10-24T01:19:58.962245] [DEBUG] [LOCAL     ] CPA: Loaded 27920 existing records from primary storage.
[2025-10-24T01:19:58.962774] [INFO ] [MAIN      ] CPAY: Loaded 30232 primary data records.
[2025-10-24T01:19:58.962909] [INFO ] [MAIN      ] CPA: Loaded 27920 primary data records.
[2025-10-24T01:19:59.170992] [DEBUG] [LOCAL     ] CP: Loaded 53617 existing records from primary storage.
[2025-10-24T01:19:59.210013] [INFO ] [MAIN      ] CP: Loaded 53617 primary data records.
[2025-10-24T01:19:59.924597] [DEBUG] [MAIN      ] CPAY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:59.951982] [DEBUG] [MAIN      ] CPA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:19:59.992372] [DEBUG] [MAIN      ] CP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:00.059821] [INFO ] [MAIN      ] CPAY: Generated 139 derivative records from 30232 primary records.
[2025-10-24T01:20:00.061242] [DEBUG] [LOCAL     ] CPAY: Saving derivative data.
[2025-10-24T01:20:00.066669] [INFO ] [MAIN      ] CPA: Generated 139 derivative records from 27920 primary records.
[2025-10-24T01:20:00.070054] [DEBUG] [LOCAL     ] CPA: Saving derivative data.
[2025-10-24T01:20:00.081770] [DEBUG] [LOCAL     ] CPAY: Derivative data saved (139 records).
[2025-10-24T01:20:00.082788] [INFO ] [MAIN      ] CPAY: Successfully saved derivative data.
[2025-10-24T01:20:00.092448] [INFO ] [MAIN      ] Derivative Progress: 466/2164 symbols completed. CPAY took 1.2s. Estimated remaining: 12m 5s. Rate: 140.5 symbols/min
[2025-10-24T01:20:00.093666] [INFO ] [MAIN      ] CPF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:00.099047] [DEBUG] [LOCAL     ] CPA: Derivative data saved (139 records).
[2025-10-24T01:20:00.099407] [INFO ] [MAIN      ] CPA: Successfully saved derivative data.
[2025-10-24T01:20:00.101625] [INFO ] [MAIN      ] CP: Generated 139 derivative records from 53617 primary records.
[2025-10-24T01:20:00.105033] [INFO ] [MAIN      ] Derivative Progress: 467/2164 symbols completed. CPA took 1.2s. Estimated remaining: 12m 3s. Rate: 140.8 symbols/min
[2025-10-24T01:20:00.105281] [DEBUG] [LOCAL     ] CP: Saving derivative data.
[2025-10-24T01:20:00.106509] [INFO ] [MAIN      ] CPK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:00.120932] [DEBUG] [LOCAL     ] CP: Derivative data saved (139 records).
[2025-10-24T01:20:00.125685] [INFO ] [MAIN      ] CP: Successfully saved derivative data.
[2025-10-24T01:20:00.129385] [INFO ] [MAIN      ] Derivative Progress: 468/2164 symbols completed. CP took 1.2s. Estimated remaining: 12m 1s. Rate: 141.1 symbols/min
[2025-10-24T01:20:00.129713] [INFO ] [MAIN      ] CPNG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:00.138042] [DEBUG] [LOCAL     ] CPF: Loaded 15267 existing records from primary storage.
[2025-10-24T01:20:00.142322] [INFO ] [MAIN      ] CPF: Loaded 15267 primary data records.
[2025-10-24T01:20:00.240768] [DEBUG] [LOCAL     ] CPK: Loaded 14004 existing records from primary storage.
[2025-10-24T01:20:00.258176] [INFO ] [MAIN      ] CPK: Loaded 14004 primary data records.
[2025-10-24T01:20:00.815239] [DEBUG] [LOCAL     ] CPNG: Loaded 54069 existing records from primary storage.
[2025-10-24T01:20:00.815934] [INFO ] [MAIN      ] CPNG: Loaded 54069 primary data records.
[2025-10-24T01:20:01.134743] [DEBUG] [MAIN      ] CPF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:01.168898] [DEBUG] [MAIN      ] CPK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:01.221908] [DEBUG] [MAIN      ] CPNG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:01.236723] [INFO ] [MAIN      ] CPF: Generated 139 derivative records from 15267 primary records.
[2025-10-24T01:20:01.240062] [DEBUG] [LOCAL     ] CPF: Saving derivative data.
[2025-10-24T01:20:01.256818] [DEBUG] [LOCAL     ] CPF: Derivative data saved (139 records).
[2025-10-24T01:20:01.256998] [INFO ] [MAIN      ] CPF: Successfully saved derivative data.
[2025-10-24T01:20:01.264618] [INFO ] [MAIN      ] Derivative Progress: 469/2164 symbols completed. CPF took 1.2s. Estimated remaining: 12m 4s. Rate: 140.6 symbols/min
[2025-10-24T01:20:01.267719] [INFO ] [MAIN      ] CPRI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:01.272892] [INFO ] [MAIN      ] CPK: Generated 139 derivative records from 14004 primary records.
[2025-10-24T01:20:01.273016] [DEBUG] [LOCAL     ] CPK: Saving derivative data.
[2025-10-24T01:20:01.292253] [DEBUG] [LOCAL     ] CPK: Derivative data saved (139 records).
[2025-10-24T01:20:01.295046] [INFO ] [MAIN      ] CPK: Successfully saved derivative data.
[2025-10-24T01:20:01.301061] [INFO ] [MAIN      ] Derivative Progress: 470/2164 symbols completed. CPK took 1.2s. Estimated remaining: 12m 2s. Rate: 140.8 symbols/min
[2025-10-24T01:20:01.301254] [INFO ] [MAIN      ] CPNG: Generated 139 derivative records from 54069 primary records.
[2025-10-24T01:20:01.301600] [INFO ] [MAIN      ] CPS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:01.301816] [DEBUG] [LOCAL     ] CPNG: Saving derivative data.
[2025-10-24T01:20:01.317287] [DEBUG] [LOCAL     ] CPNG: Derivative data saved (139 records).
[2025-10-24T01:20:01.317669] [INFO ] [MAIN      ] CPNG: Successfully saved derivative data.
[2025-10-24T01:20:01.320885] [INFO ] [MAIN      ] Derivative Progress: 471/2164 symbols completed. CPNG took 1.2s. Estimated remaining: 11m 60s. Rate: 141.1 symbols/min
[2025-10-24T01:20:01.321139] [INFO ] [MAIN      ] CPT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:01.377264] [DEBUG] [LOCAL     ] CPRI: Loaded 52812 existing records from primary storage.
[2025-10-24T01:20:01.386739] [DEBUG] [LOCAL     ] CPS: Loaded 25046 existing records from primary storage.
[2025-10-24T01:20:01.386865] [INFO ] [MAIN      ] CPRI: Loaded 52812 primary data records.
[2025-10-24T01:20:01.387176] [INFO ] [MAIN      ] CPS: Loaded 25046 primary data records.
[2025-10-24T01:20:01.623075] [DEBUG] [LOCAL     ] CPT: Loaded 44826 existing records from primary storage.
[2025-10-24T01:20:01.654950] [INFO ] [MAIN      ] CPT: Loaded 44826 primary data records.
[2025-10-24T01:20:02.411320] [DEBUG] [MAIN      ] CPS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:02.417063] [DEBUG] [MAIN      ] CPRI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:02.547697] [DEBUG] [MAIN      ] CPT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:02.583361] [INFO ] [MAIN      ] CPS: Generated 139 derivative records from 25046 primary records.
[2025-10-24T01:20:02.585544] [DEBUG] [LOCAL     ] CPS: Saving derivative data.
[2025-10-24T01:20:02.590112] [INFO ] [MAIN      ] CPRI: Generated 139 derivative records from 52812 primary records.
[2025-10-24T01:20:02.590632] [DEBUG] [LOCAL     ] CPRI: Saving derivative data.
[2025-10-24T01:20:02.605284] [DEBUG] [LOCAL     ] CPS: Derivative data saved (139 records).
[2025-10-24T01:20:02.607057] [INFO ] [MAIN      ] CPS: Successfully saved derivative data.
[2025-10-24T01:20:02.623983] [INFO ] [MAIN      ] Derivative Progress: 472/2164 symbols completed. CPS took 1.3s. Estimated remaining: 12m 3s. Rate: 140.5 symbols/min
[2025-10-24T01:20:02.625286] [INFO ] [MAIN      ] CQP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:02.632965] [DEBUG] [LOCAL     ] CPRI: Derivative data saved (139 records).
[2025-10-24T01:20:02.635318] [INFO ] [MAIN      ] CPRI: Successfully saved derivative data.
[2025-10-24T01:20:02.642118] [INFO ] [MAIN      ] Derivative Progress: 473/2164 symbols completed. CPRI took 1.4s. Estimated remaining: 12m 1s. Rate: 140.8 symbols/min
[2025-10-24T01:20:02.644511] [INFO ] [MAIN      ] CR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:02.646980] [INFO ] [MAIN      ] CPT: Generated 139 derivative records from 44826 primary records.
[2025-10-24T01:20:02.647484] [DEBUG] [LOCAL     ] CPT: Saving derivative data.
[2025-10-24T01:20:02.676305] [DEBUG] [LOCAL     ] CPT: Derivative data saved (139 records).
[2025-10-24T01:20:02.677136] [INFO ] [MAIN      ] CPT: Successfully saved derivative data.
[2025-10-24T01:20:02.676984] [DEBUG] [LOCAL     ] CQP: Loaded 18778 existing records from primary storage.
[2025-10-24T01:20:02.680316] [INFO ] [MAIN      ] Derivative Progress: 474/2164 symbols completed. CPT took 1.4s. Estimated remaining: 11m 59s. Rate: 141.1 symbols/min
[2025-10-24T01:20:02.680871] [INFO ] [MAIN      ] CQP: Loaded 18778 primary data records.
[2025-10-24T01:20:02.680800] [INFO ] [MAIN      ] CRBD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:02.789007] [DEBUG] [LOCAL     ] CR: Loaded 24152 existing records from primary storage.
[2025-10-24T01:20:02.809421] [INFO ] [MAIN      ] CR: Loaded 24152 primary data records.
[2025-10-24T01:20:02.905190] [DEBUG] [LOCAL     ] CRBD: Loaded 8790 existing records from primary storage.
[2025-10-24T01:20:03.111172] [INFO ] [MAIN      ] CRBD: Loaded 8790 primary data records.
[2025-10-24T01:20:03.658970] [DEBUG] [MAIN      ] CQP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:03.695212] [DEBUG] [MAIN      ] CR: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:20:03.738914] [DEBUG] [MAIN      ] CRBD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:03.773221] [INFO ] [MAIN      ] CQP: Generated 139 derivative records from 18778 primary records.
[2025-10-24T01:20:03.776071] [DEBUG] [LOCAL     ] CQP: Saving derivative data.
[2025-10-24T01:20:03.796781] [DEBUG] [LOCAL     ] CQP: Derivative data saved (139 records).
[2025-10-24T01:20:03.797114] [INFO ] [MAIN      ] CQP: Successfully saved derivative data.
[2025-10-24T01:20:03.799698] [INFO ] [MAIN      ] Derivative Progress: 475/2164 symbols completed. CQP took 1.2s. Estimated remaining: 12m 1s. Rate: 140.6 symbols/min
[2025-10-24T01:20:03.799926] [INFO ] [MAIN      ] CRBG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:03.816378] [INFO ] [MAIN      ] CR: Generated 139 derivative records from 24152 primary records.
[2025-10-24T01:20:03.817796] [DEBUG] [LOCAL     ] CR: Saving derivative data.
[2025-10-24T01:20:03.834433] [DEBUG] [LOCAL     ] CR: Derivative data saved (139 records).
[2025-10-24T01:20:03.829734] [INFO ] [MAIN      ] CRBD: Generated 139 derivative records from 8790 primary records.
[2025-10-24T01:20:03.834804] [DEBUG] [LOCAL     ] CRBD: Saving derivative data.
[2025-10-24T01:20:03.834879] [INFO ] [MAIN      ] CR: Successfully saved derivative data.
[2025-10-24T01:20:03.839863] [INFO ] [MAIN      ] Derivative Progress: 476/2164 symbols completed. CR took 1.2s. Estimated remaining: 11m 59s. Rate: 140.8 symbols/min
[2025-10-24T01:20:03.840095] [INFO ] [MAIN      ] CRC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:03.853794] [DEBUG] [LOCAL     ] CRBD: Derivative data saved (139 records).
[2025-10-24T01:20:03.867516] [INFO ] [MAIN      ] CRBD: Successfully saved derivative data.
[2025-10-24T01:20:03.870809] [INFO ] [MAIN      ] Derivative Progress: 477/2164 symbols completed. CRBD took 1.2s. Estimated remaining: 11m 57s. Rate: 141.1 symbols/min
[2025-10-24T01:20:03.871177] [INFO ] [MAIN      ] CRGY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:03.897668] [DEBUG] [LOCAL     ] CRBG: Loaded 52974 existing records from primary storage.
[2025-10-24T01:20:03.898031] [INFO ] [MAIN      ] CRBG: Loaded 52974 primary data records.
[2025-10-24T01:20:04.218042] [DEBUG] [LOCAL     ] CRC: Loaded 44391 existing records from primary storage.
[2025-10-24T01:20:04.232007] [INFO ] [MAIN      ] CRC: Loaded 44391 primary data records.
[2025-10-24T01:20:04.346173] [DEBUG] [LOCAL     ] CRGY: Loaded 52885 existing records from primary storage.
[2025-10-24T01:20:04.369480] [INFO ] [MAIN      ] CRGY: Loaded 52885 primary data records.
[2025-10-24T01:20:04.914372] [DEBUG] [MAIN      ] CRBG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:04.961318] [DEBUG] [MAIN      ] CRC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:05.009907] [DEBUG] [MAIN      ] CRGY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:05.031524] [INFO ] [MAIN      ] CRBG: Generated 139 derivative records from 52974 primary records.
[2025-10-24T01:20:05.032558] [DEBUG] [LOCAL     ] CRBG: Saving derivative data.
[2025-10-24T01:20:05.054189] [DEBUG] [LOCAL     ] CRBG: Derivative data saved (139 records).
[2025-10-24T01:20:05.054540] [INFO ] [MAIN      ] CRBG: Successfully saved derivative data.
[2025-10-24T01:20:05.060714] [INFO ] [MAIN      ] Derivative Progress: 478/2164 symbols completed. CRBG took 1.3s. Estimated remaining: 11m 60s. Rate: 140.6 symbols/min
[2025-10-24T01:20:05.078352] [INFO ] [MAIN      ] CRC: Generated 139 derivative records from 44391 primary records.
[2025-10-24T01:20:05.078782] [DEBUG] [LOCAL     ] CRC: Saving derivative data.
[2025-10-24T01:20:05.092204] [DEBUG] [LOCAL     ] CRC: Derivative data saved (139 records).
[2025-10-24T01:20:05.092675] [INFO ] [MAIN      ] CRC: Successfully saved derivative data.
[2025-10-24T01:20:05.096697] [INFO ] [MAIN      ] Derivative Progress: 479/2164 symbols completed. CRC took 1.3s. Estimated remaining: 11m 58s. Rate: 140.9 symbols/min
[2025-10-24T01:20:05.099592] [INFO ] [MAIN      ] CRGY: Generated 139 derivative records from 52885 primary records.
[2025-10-24T01:20:05.099719] [DEBUG] [LOCAL     ] CRGY: Saving derivative data.
[2025-10-24T01:20:05.111763] [DEBUG] [LOCAL     ] CRGY: Derivative data saved (139 records).
[2025-10-24T01:20:05.111848] [INFO ] [MAIN      ] CRGY: Successfully saved derivative data.
[2025-10-24T01:20:05.115789] [INFO ] [MAIN      ] Derivative Progress: 480/2164 symbols completed. CRGY took 1.2s. Estimated remaining: 11m 56s. Rate: 141.1 symbols/min
[2025-10-24T01:20:05.116353] [INFO ] [MAIN      ] CRK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:05.116279] [INFO ] [MAIN      ] CRH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:05.116500] [INFO ] [MAIN      ] CRI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:05.218713] [DEBUG] [LOCAL     ] CRI: Loaded 49854 existing records from primary storage.
[2025-10-24T01:20:05.219993] [INFO ] [MAIN      ] CRI: Loaded 49854 primary data records.
[2025-10-24T01:20:05.270537] [DEBUG] [LOCAL     ] CRK: Loaded 52603 existing records from primary storage.
[2025-10-24T01:20:05.282854] [INFO ] [MAIN      ] CRK: Loaded 52603 primary data records.
[2025-10-24T01:20:05.364722] [DEBUG] [LOCAL     ] CRH: Loaded 53784 existing records from primary storage.
[2025-10-24T01:20:05.420868] [INFO ] [MAIN      ] CRH: Loaded 53784 primary data records.
[2025-10-24T01:20:06.203680] [DEBUG] [MAIN      ] CRI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:06.230409] [DEBUG] [MAIN      ] CRK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:06.280042] [DEBUG] [MAIN      ] CRH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:06.318077] [INFO ] [MAIN      ] CRI: Generated 139 derivative records from 49854 primary records.
[2025-10-24T01:20:06.321358] [DEBUG] [LOCAL     ] CRI: Saving derivative data.
[2025-10-24T01:20:06.342870] [DEBUG] [LOCAL     ] CRI: Derivative data saved (139 records).
[2025-10-24T01:20:06.345124] [INFO ] [MAIN      ] CRI: Successfully saved derivative data.
[2025-10-24T01:20:06.347705] [INFO ] [MAIN      ] Derivative Progress: 481/2164 symbols completed. CRI took 1.2s. Estimated remaining: 11m 58s. Rate: 140.6 symbols/min
[2025-10-24T01:20:06.348258] [INFO ] [MAIN      ] CRL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:06.348076] [INFO ] [MAIN      ] CRK: Generated 139 derivative records from 52603 primary records.
[2025-10-24T01:20:06.348704] [DEBUG] [LOCAL     ] CRK: Saving derivative data.
[2025-10-24T01:20:06.366541] [DEBUG] [LOCAL     ] CRK: Derivative data saved (139 records).
[2025-10-24T01:20:06.369762] [INFO ] [MAIN      ] CRK: Successfully saved derivative data.
[2025-10-24T01:20:06.376599] [INFO ] [MAIN      ] Derivative Progress: 482/2164 symbols completed. CRK took 1.3s. Estimated remaining: 11m 57s. Rate: 140.8 symbols/min
[2025-10-24T01:20:06.378579] [INFO ] [MAIN      ] CRM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:06.381290] [INFO ] [MAIN      ] CRH: Generated 139 derivative records from 53784 primary records.
[2025-10-24T01:20:06.381634] [DEBUG] [LOCAL     ] CRH: Saving derivative data.
[2025-10-24T01:20:06.394321] [DEBUG] [LOCAL     ] CRH: Derivative data saved (139 records).
[2025-10-24T01:20:06.394615] [INFO ] [MAIN      ] CRH: Successfully saved derivative data.
[2025-10-24T01:20:06.398191] [INFO ] [MAIN      ] Derivative Progress: 483/2164 symbols completed. CRH took 1.3s. Estimated remaining: 11m 55s. Rate: 141.1 symbols/min
[2025-10-24T01:20:06.398398] [INFO ] [MAIN      ] CRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:06.417922] [DEBUG] [LOCAL     ] CRT: Loaded 4832 existing records from primary storage.
[2025-10-24T01:20:06.418108] [INFO ] [MAIN      ] CRT: Loaded 4832 primary data records.
[2025-10-24T01:20:06.539584] [DEBUG] [LOCAL     ] CRL: Loaded 42952 existing records from primary storage.
[2025-10-24T01:20:06.545491] [INFO ] [MAIN      ] CRL: Loaded 42952 primary data records.
[2025-10-24T01:20:06.929236] [DEBUG] [LOCAL     ] CRM: Loaded 54160 existing records from primary storage.
[2025-10-24T01:20:06.941279] [INFO ] [MAIN      ] CRM: Loaded 54160 primary data records.
[2025-10-24T01:20:07.478869] [DEBUG] [MAIN      ] CRT: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:20:07.523570] [DEBUG] [MAIN      ] CRL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:07.561263] [DEBUG] [MAIN      ] CRM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:07.595109] [INFO ] [MAIN      ] CRT: Generated 139 derivative records from 4832 primary records.
[2025-10-24T01:20:07.601275] [DEBUG] [LOCAL     ] CRT: Saving derivative data.
[2025-10-24T01:20:07.621801] [DEBUG] [LOCAL     ] CRT: Derivative data saved (139 records).
[2025-10-24T01:20:07.630885] [INFO ] [MAIN      ] CRT: Successfully saved derivative data.
[2025-10-24T01:20:07.636495] [INFO ] [MAIN      ] Derivative Progress: 484/2164 symbols completed. CRT took 1.2s. Estimated remaining: 11m 57s. Rate: 140.6 symbols/min
[2025-10-24T01:20:07.639094] [INFO ] [MAIN      ] CSAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:07.646522] [INFO ] [MAIN      ] CRL: Generated 139 derivative records from 42952 primary records.
[2025-10-24T01:20:07.647234] [INFO ] [MAIN      ] CRM: Generated 139 derivative records from 54160 primary records.
[2025-10-24T01:20:07.647591] [DEBUG] [LOCAL     ] CRM: Saving derivative data.
[2025-10-24T01:20:07.647504] [DEBUG] [LOCAL     ] CRL: Saving derivative data.
[2025-10-24T01:20:07.669227] [DEBUG] [LOCAL     ] CRM: Derivative data saved (139 records).
[2025-10-24T01:20:07.669428] [INFO ] [MAIN      ] CRM: Successfully saved derivative data.
[2025-10-24T01:20:07.675877] [INFO ] [MAIN      ] Derivative Progress: 485/2164 symbols completed. CRM took 1.3s. Estimated remaining: 11m 55s. Rate: 140.8 symbols/min
[2025-10-24T01:20:07.676304] [INFO ] [MAIN      ] CSL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:07.680592] [DEBUG] [LOCAL     ] CRL: Derivative data saved (139 records).
[2025-10-24T01:20:07.680908] [INFO ] [MAIN      ] CRL: Successfully saved derivative data.
[2025-10-24T01:20:07.683956] [INFO ] [MAIN      ] Derivative Progress: 486/2164 symbols completed. CRL took 1.3s. Estimated remaining: 11m 53s. Rate: 141.1 symbols/min
[2025-10-24T01:20:07.693821] [INFO ] [MAIN      ] CSR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:07.724262] [DEBUG] [LOCAL     ] CSAN: Loaded 42520 existing records from primary storage.
[2025-10-24T01:20:07.724752] [INFO ] [MAIN      ] CSAN: Loaded 42520 primary data records.
[2025-10-24T01:20:07.819781] [DEBUG] [LOCAL     ] CSL: Loaded 31384 existing records from primary storage.
[2025-10-24T01:20:07.812140] [DEBUG] [LOCAL     ] CSR: Loaded 13476 existing records from primary storage.
[2025-10-24T01:20:07.836343] [INFO ] [MAIN      ] CSL: Loaded 31384 primary data records.
[2025-10-24T01:20:07.850689] [INFO ] [MAIN      ] CSR: Loaded 13476 primary data records.
[2025-10-24T01:20:08.699836] [DEBUG] [MAIN      ] CSAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:08.742550] [DEBUG] [MAIN      ] CSR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:08.783104] [DEBUG] [MAIN      ] CSL: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:20:08.832787] [INFO ] [MAIN      ] CSAN: Generated 139 derivative records from 42520 primary records.
[2025-10-24T01:20:08.839684] [DEBUG] [LOCAL     ] CSAN: Saving derivative data.
[2025-10-24T01:20:08.845737] [INFO ] [MAIN      ] CSR: Generated 139 derivative records from 13476 primary records.
[2025-10-24T01:20:08.846226] [DEBUG] [LOCAL     ] CSR: Saving derivative data.
[2025-10-24T01:20:08.863529] [DEBUG] [LOCAL     ] CSAN: Derivative data saved (139 records).
[2025-10-24T01:20:08.874669] [INFO ] [MAIN      ] CSAN: Successfully saved derivative data.
[2025-10-24T01:20:08.881928] [INFO ] [MAIN      ] Derivative Progress: 487/2164 symbols completed. CSAN took 1.2s. Estimated remaining: 11m 56s. Rate: 140.6 symbols/min
[2025-10-24T01:20:08.877724] [DEBUG] [LOCAL     ] CSR: Derivative data saved (139 records).
[2025-10-24T01:20:08.882438] [INFO ] [MAIN      ] CSTM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:08.882818] [INFO ] [MAIN      ] CSR: Successfully saved derivative data.
[2025-10-24T01:20:08.887889] [INFO ] [MAIN      ] Derivative Progress: 488/2164 symbols completed. CSR took 1.2s. Estimated remaining: 11m 54s. Rate: 140.9 symbols/min
[2025-10-24T01:20:08.888552] [INFO ] [MAIN      ] CSV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:08.896192] [INFO ] [MAIN      ] CSL: Generated 139 derivative records from 31384 primary records.
[2025-10-24T01:20:08.896452] [DEBUG] [LOCAL     ] CSL: Saving derivative data.
[2025-10-24T01:20:08.911069] [DEBUG] [LOCAL     ] CSL: Derivative data saved (139 records).
[2025-10-24T01:20:08.914682] [INFO ] [MAIN      ] CSL: Successfully saved derivative data.
[2025-10-24T01:20:08.917722] [INFO ] [MAIN      ] Derivative Progress: 489/2164 symbols completed. CSL took 1.2s. Estimated remaining: 11m 52s. Rate: 141.1 symbols/min
[2025-10-24T01:20:08.918051] [INFO ] [MAIN      ] CTBB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:08.928570] [DEBUG] [LOCAL     ] CSV: Loaded 12479 existing records from primary storage.
[2025-10-24T01:20:08.931389] [INFO ] [MAIN      ] CSV: Loaded 12479 primary data records.
[2025-10-24T01:20:08.974743] [DEBUG] [LOCAL     ] CTBB: Loaded 6424 existing records from primary storage.
[2025-10-24T01:20:08.999026] [INFO ] [MAIN      ] CTBB: Loaded 6424 primary data records.
[2025-10-24T01:20:09.348756] [DEBUG] [LOCAL     ] CSTM: Loaded 47799 existing records from primary storage.
[2025-10-24T01:20:09.418255] [INFO ] [MAIN      ] CSTM: Loaded 47799 primary data records.
[2025-10-24T01:20:09.974251] [DEBUG] [MAIN      ] CSV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:10.015863] [DEBUG] [MAIN      ] CTBB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:10.058328] [DEBUG] [MAIN      ] CSTM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:10.115116] [INFO ] [MAIN      ] CSV: Generated 139 derivative records from 12479 primary records.
[2025-10-24T01:20:10.121939] [DEBUG] [LOCAL     ] CSV: Saving derivative data.
[2025-10-24T01:20:10.138521] [DEBUG] [LOCAL     ] CSV: Derivative data saved (139 records).
[2025-10-24T01:20:10.139038] [INFO ] [MAIN      ] CTBB: Generated 139 derivative records from 6424 primary records.
[2025-10-24T01:20:10.139905] [DEBUG] [LOCAL     ] CTBB: Saving derivative data.
[2025-10-24T01:20:10.140041] [INFO ] [MAIN      ] CSV: Successfully saved derivative data.
[2025-10-24T01:20:10.146378] [INFO ] [MAIN      ] Derivative Progress: 490/2164 symbols completed. CSV took 1.3s. Estimated remaining: 11m 54s. Rate: 140.6 symbols/min
[2025-10-24T01:20:10.160423] [DEBUG] [LOCAL     ] CTBB: Derivative data saved (139 records).
[2025-10-24T01:20:10.156830] [INFO ] [MAIN      ] CTDD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:10.160687] [INFO ] [MAIN      ] CTBB: Successfully saved derivative data.
[2025-10-24T01:20:10.163475] [INFO ] [MAIN      ] Derivative Progress: 491/2164 symbols completed. CTBB took 1.2s. Estimated remaining: 11m 53s. Rate: 140.9 symbols/min
[2025-10-24T01:20:10.164232] [INFO ] [MAIN      ] CTO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:10.171771] [INFO ] [MAIN      ] CSTM: Generated 139 derivative records from 47799 primary records.
[2025-10-24T01:20:10.172088] [DEBUG] [LOCAL     ] CSTM: Saving derivative data.
[2025-10-24T01:20:10.187631] [DEBUG] [LOCAL     ] CSTM: Derivative data saved (139 records).
[2025-10-24T01:20:10.187951] [INFO ] [MAIN      ] CSTM: Successfully saved derivative data.
[2025-10-24T01:20:10.190709] [INFO ] [MAIN      ] Derivative Progress: 492/2164 symbols completed. CSTM took 1.3s. Estimated remaining: 11m 51s. Rate: 141.1 symbols/min
[2025-10-24T01:20:10.190987] [INFO ] [MAIN      ] CTOS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:10.197080] [DEBUG] [LOCAL     ] CTDD: Loaded 5159 existing records from primary storage.
[2025-10-24T01:20:10.197453] [INFO ] [MAIN      ] CTDD: Loaded 5159 primary data records.
[2025-10-24T01:20:10.315737] [DEBUG] [LOCAL     ] CTO: Loaded 27572 existing records from primary storage.
[2025-10-24T01:20:10.337829] [INFO ] [MAIN      ] CTO: Loaded 27572 primary data records.
[2025-10-24T01:20:10.658892] [DEBUG] [LOCAL     ] CTOS: Loaded 37510 existing records from primary storage.
[2025-10-24T01:20:10.659418] [INFO ] [MAIN      ] CTOS: Loaded 37510 primary data records.
[2025-10-24T01:20:11.244868] [DEBUG] [MAIN      ] CTDD: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:20:11.280167] [DEBUG] [MAIN      ] CTO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:11.318154] [DEBUG] [MAIN      ] CTOS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:11.354270] [INFO ] [MAIN      ] CTDD: Generated 139 derivative records from 5159 primary records.
[2025-10-24T01:20:11.358206] [DEBUG] [LOCAL     ] CTDD: Saving derivative data.
[2025-10-24T01:20:11.374569] [DEBUG] [LOCAL     ] CTDD: Derivative data saved (139 records).
[2025-10-24T01:20:11.376239] [INFO ] [MAIN      ] CTDD: Successfully saved derivative data.
[2025-10-24T01:20:11.381721] [INFO ] [MAIN      ] Derivative Progress: 493/2164 symbols completed. CTDD took 1.2s. Estimated remaining: 11m 53s. Rate: 140.6 symbols/min
[2025-10-24T01:20:11.389619] [INFO ] [MAIN      ] CTO: Generated 139 derivative records from 27572 primary records.
[2025-10-24T01:20:11.391734] [DEBUG] [LOCAL     ] CTO: Saving derivative data.
[2025-10-24T01:20:11.405441] [INFO ] [MAIN      ] CTOS: Generated 139 derivative records from 37510 primary records.
[2025-10-24T01:20:11.406670] [DEBUG] [LOCAL     ] CTO: Derivative data saved (139 records).
[2025-10-24T01:20:11.406834] [INFO ] [MAIN      ] CTO: Successfully saved derivative data.
[2025-10-24T01:20:11.406772] [DEBUG] [LOCAL     ] CTOS: Saving derivative data.
[2025-10-24T01:20:11.409969] [INFO ] [MAIN      ] Derivative Progress: 494/2164 symbols completed. CTO took 1.2s. Estimated remaining: 11m 51s. Rate: 140.9 symbols/min
[2025-10-24T01:20:11.421064] [DEBUG] [LOCAL     ] CTOS: Derivative data saved (139 records).
[2025-10-24T01:20:11.421146] [INFO ] [MAIN      ] CTOS: Successfully saved derivative data.
[2025-10-24T01:20:11.424184] [INFO ] [MAIN      ] Derivative Progress: 495/2164 symbols completed. CTOS took 1.2s. Estimated remaining: 11m 49s. Rate: 141.2 symbols/min
[2025-10-24T01:20:11.424679] [INFO ] [MAIN      ] CTRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:11.424605] [INFO ] [MAIN      ] CTRA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:11.424754] [INFO ] [MAIN      ] CTRI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:11.504877] [DEBUG] [LOCAL     ] CTRI: Loaded 41115 existing records from primary storage.
[2025-10-24T01:20:11.506892] [INFO ] [MAIN      ] CTRI: Loaded 41115 primary data records.
[2025-10-24T01:20:11.508240] [DEBUG] [LOCAL     ] CTRE: Loaded 49781 existing records from primary storage.
[2025-10-24T01:20:11.545248] [INFO ] [MAIN      ] CTRE: Loaded 49781 primary data records.
[2025-10-24T01:20:11.654356] [DEBUG] [LOCAL     ] CTRA: Loaded 54037 existing records from primary storage.
[2025-10-24T01:20:11.729465] [INFO ] [MAIN      ] CTRA: Loaded 54037 primary data records.
[2025-10-24T01:20:12.432580] [DEBUG] [MAIN      ] CTRI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:12.460048] [DEBUG] [MAIN      ] CTRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:12.509048] [DEBUG] [MAIN      ] CTRA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:12.556220] [INFO ] [MAIN      ] CTRI: Generated 139 derivative records from 41115 primary records.
[2025-10-24T01:20:12.557999] [DEBUG] [LOCAL     ] CTRI: Saving derivative data.
[2025-10-24T01:20:12.575525] [DEBUG] [LOCAL     ] CTRI: Derivative data saved (139 records).
[2025-10-24T01:20:12.576940] [INFO ] [MAIN      ] CTRE: Generated 139 derivative records from 49781 primary records.
[2025-10-24T01:20:12.577417] [INFO ] [MAIN      ] CTRI: Successfully saved derivative data.
[2025-10-24T01:20:12.577353] [DEBUG] [LOCAL     ] CTRE: Saving derivative data.
[2025-10-24T01:20:12.583738] [INFO ] [MAIN      ] Derivative Progress: 496/2164 symbols completed. CTRI took 1.2s. Estimated remaining: 11m 51s. Rate: 140.7 symbols/min
[2025-10-24T01:20:12.584884] [INFO ] [MAIN      ] CTS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:12.599481] [DEBUG] [LOCAL     ] CTRE: Derivative data saved (139 records).
[2025-10-24T01:20:12.599823] [INFO ] [MAIN      ] CTRE: Successfully saved derivative data.
[2025-10-24T01:20:12.603126] [INFO ] [MAIN      ] Derivative Progress: 497/2164 symbols completed. CTRE took 1.2s. Estimated remaining: 11m 50s. Rate: 141.0 symbols/min
[2025-10-24T01:20:12.603422] [INFO ] [MAIN      ] CTVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:12.608113] [INFO ] [MAIN      ] CTRA: Generated 139 derivative records from 54037 primary records.
[2025-10-24T01:20:12.608316] [DEBUG] [LOCAL     ] CTRA: Saving derivative data.
[2025-10-24T01:20:12.625407] [DEBUG] [LOCAL     ] CTRA: Derivative data saved (139 records).
[2025-10-24T01:20:12.625733] [INFO ] [MAIN      ] CTRA: Successfully saved derivative data.
[2025-10-24T01:20:12.628458] [INFO ] [MAIN      ] Derivative Progress: 498/2164 symbols completed. CTRA took 1.2s. Estimated remaining: 11m 48s. Rate: 141.2 symbols/min
[2025-10-24T01:20:12.628883] [INFO ] [MAIN      ] CUBE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:12.638859] [DEBUG] [LOCAL     ] CTS: Loaded 19655 existing records from primary storage.
[2025-10-24T01:20:12.639080] [INFO ] [MAIN      ] CTS: Loaded 19655 primary data records.
[2025-10-24T01:20:12.829465] [DEBUG] [LOCAL     ] CTVA: Loaded 53693 existing records from primary storage.
[2025-10-24T01:20:12.867593] [INFO ] [MAIN      ] CTVA: Loaded 53693 primary data records.
[2025-10-24T01:20:13.112438] [DEBUG] [LOCAL     ] CUBE: Loaded 51249 existing records from primary storage.
[2025-10-24T01:20:13.134091] [INFO ] [MAIN      ] CUBE: Loaded 51249 primary data records.
[2025-10-24T01:20:13.655506] [DEBUG] [MAIN      ] CTS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:13.703814] [DEBUG] [MAIN      ] CTVA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:13.743686] [INFO ] [MAIN      ] CTS: Generated 139 derivative records from 19655 primary records.
[2025-10-24T01:20:13.744223] [DEBUG] [MAIN      ] CUBE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:13.744360] [DEBUG] [LOCAL     ] CTS: Saving derivative data.
[2025-10-24T01:20:13.777185] [DEBUG] [LOCAL     ] CTS: Derivative data saved (139 records).
[2025-10-24T01:20:13.781214] [INFO ] [MAIN      ] CTS: Successfully saved derivative data.
[2025-10-24T01:20:13.784751] [INFO ] [MAIN      ] Derivative Progress: 499/2164 symbols completed. CTS took 1.2s. Estimated remaining: 11m 50s. Rate: 140.7 symbols/min
[2025-10-24T01:20:13.785437] [INFO ] [MAIN      ] CUBI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:13.819573] [INFO ] [MAIN      ] CTVA: Generated 139 derivative records from 53693 primary records.
[2025-10-24T01:20:13.821688] [DEBUG] [LOCAL     ] CTVA: Saving derivative data.
[2025-10-24T01:20:13.824790] [INFO ] [MAIN      ] CUBE: Generated 139 derivative records from 51249 primary records.
[2025-10-24T01:20:13.825755] [DEBUG] [LOCAL     ] CUBE: Saving derivative data.
[2025-10-24T01:20:13.834824] [DEBUG] [LOCAL     ] CUBI: Loaded 27213 existing records from primary storage.
[2025-10-24T01:20:13.849231] [INFO ] [MAIN      ] CUBI: Loaded 27213 primary data records.
[2025-10-24T01:20:13.855059] [DEBUG] [LOCAL     ] CTVA: Derivative data saved (139 records).
[2025-10-24T01:20:13.855207] [INFO ] [MAIN      ] CTVA: Successfully saved derivative data.
[2025-10-24T01:20:13.858131] [INFO ] [MAIN      ] Derivative Progress: 500/2164 symbols completed. CTVA took 1.3s. Estimated remaining: 11m 48s. Rate: 141.0 symbols/min
[2025-10-24T01:20:13.863938] [INFO ] [MAIN      ] CUK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:13.910031] [DEBUG] [LOCAL     ] CUBE: Derivative data saved (139 records).
[2025-10-24T01:20:13.943855] [INFO ] [MAIN      ] CUBE: Successfully saved derivative data.
[2025-10-24T01:20:13.989285] [INFO ] [MAIN      ] Derivative Progress: 501/2164 symbols completed. CUBE took 1.4s. Estimated remaining: 11m 47s. Rate: 141.2 symbols/min
[2025-10-24T01:20:14.032689] [INFO ] [MAIN      ] CULP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:14.209112] [DEBUG] [LOCAL     ] CULP: Loaded 2847 existing records from primary storage.
[2025-10-24T01:20:14.209315] [INFO ] [MAIN      ] CULP: Loaded 2847 primary data records.
[2025-10-24T01:20:14.338033] [DEBUG] [LOCAL     ] CUK: Loaded 51440 existing records from primary storage.
[2025-10-24T01:20:14.342221] [INFO ] [MAIN      ] CUK: Loaded 51440 primary data records.
[2025-10-24T01:20:14.861697] [DEBUG] [MAIN      ] CUBI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:14.914939] [DEBUG] [MAIN      ] CULP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:14.942174] [DEBUG] [MAIN      ] CUK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:14.980827] [INFO ] [MAIN      ] CUBI: Generated 139 derivative records from 27213 primary records.
[2025-10-24T01:20:14.984258] [DEBUG] [LOCAL     ] CUBI: Saving derivative data.
[2025-10-24T01:20:15.003050] [DEBUG] [LOCAL     ] CUBI: Derivative data saved (139 records).
[2025-10-24T01:20:15.008935] [INFO ] [MAIN      ] CUBI: Successfully saved derivative data.
[2025-10-24T01:20:15.012899] [INFO ] [MAIN      ] Derivative Progress: 502/2164 symbols completed. CUBI took 1.2s. Estimated remaining: 11m 48s. Rate: 140.8 symbols/min
[2025-10-24T01:20:15.013423] [INFO ] [MAIN      ] CURB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:15.033147] [INFO ] [MAIN      ] CUK: Generated 139 derivative records from 51440 primary records.
[2025-10-24T01:20:15.035359] [DEBUG] [LOCAL     ] CUK: Saving derivative data.
[2025-10-24T01:20:15.035557] [INFO ] [MAIN      ] CULP: Generated 139 derivative records from 2847 primary records.
[2025-10-24T01:20:15.036663] [DEBUG] [LOCAL     ] CULP: Saving derivative data.
[2025-10-24T01:20:15.056757] [DEBUG] [LOCAL     ] CUK: Derivative data saved (139 records).
[2025-10-24T01:20:15.059067] [DEBUG] [LOCAL     ] CULP: Derivative data saved (139 records).
[2025-10-24T01:20:15.067270] [INFO ] [MAIN      ] CUK: Successfully saved derivative data.
[2025-10-24T01:20:15.070833] [INFO ] [MAIN      ] Derivative Progress: 503/2164 symbols completed. CUK took 1.2s. Estimated remaining: 11m 47s. Rate: 141.0 symbols/min
[2025-10-24T01:20:15.067500] [INFO ] [MAIN      ] CULP: Successfully saved derivative data.
[2025-10-24T01:20:15.073668] [INFO ] [MAIN      ] CURV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:15.073817] [INFO ] [MAIN      ] Derivative Progress: 504/2164 symbols completed. CULP took 1.0s. Estimated remaining: 11m 45s. Rate: 141.3 symbols/min
[2025-10-24T01:20:15.074624] [INFO ] [MAIN      ] CUZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:15.089692] [DEBUG] [LOCAL     ] CURB: Loaded 33062 existing records from primary storage.
[2025-10-24T01:20:15.089940] [INFO ] [MAIN      ] CURB: Loaded 33062 primary data records.
[2025-10-24T01:20:15.219175] [DEBUG] [LOCAL     ] CURV: Loaded 27396 existing records from primary storage.
[2025-10-24T01:20:15.251054] [INFO ] [MAIN      ] CURV: Loaded 27396 primary data records.
[2025-10-24T01:20:15.613088] [DEBUG] [LOCAL     ] CUZ: Loaded 49765 existing records from primary storage.
[2025-10-24T01:20:15.624217] [INFO ] [MAIN      ] CUZ: Loaded 49765 primary data records.
[2025-10-24T01:20:16.136536] [DEBUG] [MAIN      ] CURB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:16.174002] [DEBUG] [MAIN      ] CURV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:16.230458] [DEBUG] [MAIN      ] CUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:16.253115] [INFO ] [MAIN      ] CURB: Generated 139 derivative records from 33062 primary records.
[2025-10-24T01:20:16.254123] [DEBUG] [LOCAL     ] CURB: Saving derivative data.
[2025-10-24T01:20:16.269565] [DEBUG] [LOCAL     ] CURB: Derivative data saved (139 records).
[2025-10-24T01:20:16.269728] [INFO ] [MAIN      ] CURB: Successfully saved derivative data.
[2025-10-24T01:20:16.272179] [INFO ] [MAIN      ] Derivative Progress: 505/2164 symbols completed. CURB took 1.3s. Estimated remaining: 11m 47s. Rate: 140.8 symbols/min
[2025-10-24T01:20:16.272748] [INFO ] [MAIN      ] CVE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:16.287698] [INFO ] [MAIN      ] CURV: Generated 139 derivative records from 27396 primary records.
[2025-10-24T01:20:16.290382] [DEBUG] [LOCAL     ] CURV: Saving derivative data.
[2025-10-24T01:20:16.310813] [DEBUG] [LOCAL     ] CURV: Derivative data saved (139 records).
[2025-10-24T01:20:16.312424] [INFO ] [MAIN      ] CURV: Successfully saved derivative data.
[2025-10-24T01:20:16.317909] [INFO ] [MAIN      ] Derivative Progress: 506/2164 symbols completed. CURV took 1.2s. Estimated remaining: 11m 45s. Rate: 141.0 symbols/min
[2025-10-24T01:20:16.318169] [INFO ] [MAIN      ] CVEO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:16.322689] [INFO ] [MAIN      ] CUZ: Generated 139 derivative records from 49765 primary records.
[2025-10-24T01:20:16.336637] [DEBUG] [LOCAL     ] CUZ: Saving derivative data.
[2025-10-24T01:20:16.353732] [DEBUG] [LOCAL     ] CUZ: Derivative data saved (139 records).
[2025-10-24T01:20:16.353927] [INFO ] [MAIN      ] CUZ: Successfully saved derivative data.
[2025-10-24T01:20:16.357226] [INFO ] [MAIN      ] Derivative Progress: 507/2164 symbols completed. CUZ took 1.3s. Estimated remaining: 11m 44s. Rate: 141.3 symbols/min
[2025-10-24T01:20:16.357632] [INFO ] [MAIN      ] CVI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:16.366468] [DEBUG] [LOCAL     ] CVEO: Loaded 15266 existing records from primary storage.
[2025-10-24T01:20:16.366987] [INFO ] [MAIN      ] CVEO: Loaded 15266 primary data records.
[2025-10-24T01:20:16.413129] [DEBUG] [LOCAL     ] CVE: Loaded 53957 existing records from primary storage.
[2025-10-24T01:20:16.427057] [INFO ] [MAIN      ] CVE: Loaded 53957 primary data records.
[2025-10-24T01:20:17.073365] [DEBUG] [LOCAL     ] CVI: Loaded 47049 existing records from primary storage.
[2025-10-24T01:20:17.073813] [INFO ] [MAIN      ] CVI: Loaded 47049 primary data records.
[2025-10-24T01:20:17.455607] [DEBUG] [MAIN      ] CVEO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:17.485904] [DEBUG] [MAIN      ] CVE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:17.534703] [DEBUG] [MAIN      ] CVI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:17.570926] [INFO ] [MAIN      ] CVEO: Generated 139 derivative records from 15266 primary records.
[2025-10-24T01:20:17.572448] [DEBUG] [LOCAL     ] CVEO: Saving derivative data.
[2025-10-24T01:20:17.578490] [INFO ] [MAIN      ] CVE: Generated 139 derivative records from 53957 primary records.
[2025-10-24T01:20:17.585719] [DEBUG] [LOCAL     ] CVE: Saving derivative data.
[2025-10-24T01:20:17.591581] [DEBUG] [LOCAL     ] CVEO: Derivative data saved (139 records).
[2025-10-24T01:20:17.594679] [INFO ] [MAIN      ] CVEO: Successfully saved derivative data.
[2025-10-24T01:20:17.606841] [INFO ] [MAIN      ] Derivative Progress: 508/2164 symbols completed. CVEO took 1.3s. Estimated remaining: 11m 46s. Rate: 140.7 symbols/min
[2025-10-24T01:20:17.612240] [DEBUG] [LOCAL     ] CVE: Derivative data saved (139 records).
[2025-10-24T01:20:17.615338] [INFO ] [MAIN      ] CVE: Successfully saved derivative data.
[2025-10-24T01:20:17.618961] [INFO ] [MAIN      ] Derivative Progress: 509/2164 symbols completed. CVE took 1.3s. Estimated remaining: 11m 44s. Rate: 141.0 symbols/min
[2025-10-24T01:20:17.621874] [INFO ] [MAIN      ] CVI: Generated 139 derivative records from 47049 primary records.
[2025-10-24T01:20:17.621987] [DEBUG] [LOCAL     ] CVI: Saving derivative data.
[2025-10-24T01:20:17.633754] [DEBUG] [LOCAL     ] CVI: Derivative data saved (139 records).
[2025-10-24T01:20:17.633838] [INFO ] [MAIN      ] CVI: Successfully saved derivative data.
[2025-10-24T01:20:17.636592] [INFO ] [MAIN      ] Derivative Progress: 510/2164 symbols completed. CVI took 1.3s. Estimated remaining: 11m 42s. Rate: 141.3 symbols/min
[2025-10-24T01:20:17.637098] [INFO ] [MAIN      ] CVLG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:17.637143] [INFO ] [MAIN      ] CW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:17.637286] [INFO ] [MAIN      ] CVS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:17.661354] [DEBUG] [LOCAL     ] CVLG: Loaded 15392 existing records from primary storage.
[2025-10-24T01:20:17.661677] [INFO ] [MAIN      ] CVLG: Loaded 15392 primary data records.
[2025-10-24T01:20:17.733163] [DEBUG] [LOCAL     ] CW: Loaded 22064 existing records from primary storage.
[2025-10-24T01:20:17.748413] [INFO ] [MAIN      ] CW: Loaded 22064 primary data records.
[2025-10-24T01:20:18.162822] [DEBUG] [LOCAL     ] CVS: Loaded 54084 existing records from primary storage.
[2025-10-24T01:20:18.287554] [INFO ] [MAIN      ] CVS: Loaded 54084 primary data records.
[2025-10-24T01:20:18.657198] [DEBUG] [MAIN      ] CVLG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:18.689143] [DEBUG] [MAIN      ] CW: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:20:18.750967] [DEBUG] [MAIN      ] CVS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:18.750680] [INFO ] [MAIN      ] CVLG: Generated 139 derivative records from 15392 primary records.
[2025-10-24T01:20:18.752602] [DEBUG] [LOCAL     ] CVLG: Saving derivative data.
[2025-10-24T01:20:18.786621] [INFO ] [MAIN      ] CW: Generated 139 derivative records from 22064 primary records.
[2025-10-24T01:20:18.784424] [DEBUG] [LOCAL     ] CVLG: Derivative data saved (139 records).
[2025-10-24T01:20:18.786773] [DEBUG] [LOCAL     ] CW: Saving derivative data.
[2025-10-24T01:20:18.786925] [INFO ] [MAIN      ] CVLG: Successfully saved derivative data.
[2025-10-24T01:20:18.792248] [INFO ] [MAIN      ] Derivative Progress: 511/2164 symbols completed. CVLG took 1.2s. Estimated remaining: 11m 44s. Rate: 140.8 symbols/min
[2025-10-24T01:20:18.794524] [INFO ] [MAIN      ] CWAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:18.806361] [DEBUG] [LOCAL     ] CW: Derivative data saved (139 records).
[2025-10-24T01:20:18.806668] [INFO ] [MAIN      ] CW: Successfully saved derivative data.
[2025-10-24T01:20:18.809629] [INFO ] [MAIN      ] Derivative Progress: 512/2164 symbols completed. CW took 1.2s. Estimated remaining: 11m 43s. Rate: 141.1 symbols/min
[2025-10-24T01:20:18.813318] [INFO ] [MAIN      ] CWEN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:18.826673] [INFO ] [MAIN      ] CVS: Generated 139 derivative records from 54084 primary records.
[2025-10-24T01:20:18.826940] [DEBUG] [LOCAL     ] CVS: Saving derivative data.
[2025-10-24T01:20:18.840527] [DEBUG] [LOCAL     ] CVS: Derivative data saved (139 records).
[2025-10-24T01:20:18.840730] [INFO ] [MAIN      ] CVS: Successfully saved derivative data.
[2025-10-24T01:20:18.844480] [INFO ] [MAIN      ] Derivative Progress: 513/2164 symbols completed. CVS took 1.2s. Estimated remaining: 11m 41s. Rate: 141.3 symbols/min
[2025-10-24T01:20:18.844927] [INFO ] [MAIN      ] CWH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:18.894088] [DEBUG] [LOCAL     ] CWAN: Loaded 53059 existing records from primary storage.
[2025-10-24T01:20:18.894411] [INFO ] [MAIN      ] CWAN: Loaded 53059 primary data records.
[2025-10-24T01:20:18.944166] [DEBUG] [LOCAL     ] CWEN: Loaded 45626 existing records from primary storage.
[2025-10-24T01:20:18.988052] [INFO ] [MAIN      ] CWEN: Loaded 45626 primary data records.
[2025-10-24T01:20:19.219011] [DEBUG] [LOCAL     ] CWH: Loaded 51624 existing records from primary storage.
[2025-10-24T01:20:19.344411] [INFO ] [MAIN      ] CWH: Loaded 51624 primary data records.
[2025-10-24T01:20:19.965014] [DEBUG] [MAIN      ] CWAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:20.012358] [DEBUG] [MAIN      ] CWEN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:20.050388] [DEBUG] [MAIN      ] CWH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:20.092138] [INFO ] [MAIN      ] CWAN: Generated 139 derivative records from 53059 primary records.
[2025-10-24T01:20:20.096517] [DEBUG] [LOCAL     ] CWAN: Saving derivative data.
[2025-10-24T01:20:20.118972] [DEBUG] [LOCAL     ] CWAN: Derivative data saved (139 records).
[2025-10-24T01:20:20.119341] [INFO ] [MAIN      ] CWAN: Successfully saved derivative data.
[2025-10-24T01:20:20.122778] [INFO ] [MAIN      ] Derivative Progress: 514/2164 symbols completed. CWAN took 1.3s. Estimated remaining: 11m 43s. Rate: 140.8 symbols/min
[2025-10-24T01:20:20.127277] [INFO ] [MAIN      ] CWK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:20.135966] [INFO ] [MAIN      ] CWH: Generated 139 derivative records from 51624 primary records.
[2025-10-24T01:20:20.136564] [DEBUG] [LOCAL     ] CWH: Saving derivative data.
[2025-10-24T01:20:20.153683] [DEBUG] [LOCAL     ] CWH: Derivative data saved (139 records).
[2025-10-24T01:20:20.154143] [INFO ] [MAIN      ] CWEN: Generated 139 derivative records from 45626 primary records.
[2025-10-24T01:20:20.154248] [INFO ] [MAIN      ] CWH: Successfully saved derivative data.
[2025-10-24T01:20:20.158271] [INFO ] [MAIN      ] Derivative Progress: 515/2164 symbols completed. CWH took 1.3s. Estimated remaining: 11m 42s. Rate: 141.0 symbols/min
[2025-10-24T01:20:20.158485] [INFO ] [MAIN      ] CWT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:20.159089] [DEBUG] [LOCAL     ] CWEN: Saving derivative data.
[2025-10-24T01:20:20.173820] [DEBUG] [LOCAL     ] CWEN: Derivative data saved (139 records).
[2025-10-24T01:20:20.173976] [INFO ] [MAIN      ] CWEN: Successfully saved derivative data.
[2025-10-24T01:20:20.177189] [INFO ] [MAIN      ] Derivative Progress: 516/2164 symbols completed. CWEN took 1.4s. Estimated remaining: 11m 40s. Rate: 141.3 symbols/min
[2025-10-24T01:20:20.177426] [INFO ] [MAIN      ] CX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:20.210588] [DEBUG] [LOCAL     ] CWT: Loaded 28287 existing records from primary storage.
[2025-10-24T01:20:20.212576] [INFO ] [MAIN      ] CWT: Loaded 28287 primary data records.
[2025-10-24T01:20:20.282414] [DEBUG] [LOCAL     ] CWK: Loaded 50023 existing records from primary storage.
[2025-10-24T01:20:20.307969] [INFO ] [MAIN      ] CWK: Loaded 50023 primary data records.
[2025-10-24T01:20:20.616638] [DEBUG] [LOCAL     ] CX: Loaded 53209 existing records from primary storage.
[2025-10-24T01:20:20.681081] [INFO ] [MAIN      ] CX: Loaded 53209 primary data records.
[2025-10-24T01:20:21.234840] [DEBUG] [MAIN      ] CWT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:21.278704] [DEBUG] [MAIN      ] CWK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:21.323034] [DEBUG] [MAIN      ] CX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:21.348257] [INFO ] [MAIN      ] CWT: Generated 139 derivative records from 28287 primary records.
[2025-10-24T01:20:21.350030] [DEBUG] [LOCAL     ] CWT: Saving derivative data.
[2025-10-24T01:20:21.378317] [DEBUG] [LOCAL     ] CWT: Derivative data saved (139 records).
[2025-10-24T01:20:21.378703] [INFO ] [MAIN      ] CWT: Successfully saved derivative data.
[2025-10-24T01:20:21.382548] [INFO ] [MAIN      ] Derivative Progress: 517/2164 symbols completed. CWT took 1.2s. Estimated remaining: 11m 42s. Rate: 140.8 symbols/min
[2025-10-24T01:20:21.383496] [INFO ] [MAIN      ] CXE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:21.386485] [INFO ] [MAIN      ] CWK: Generated 139 derivative records from 50023 primary records.
[2025-10-24T01:20:21.391092] [DEBUG] [LOCAL     ] CWK: Saving derivative data.
[2025-10-24T01:20:21.409038] [DEBUG] [LOCAL     ] CWK: Derivative data saved (139 records).
[2025-10-24T01:20:21.409485] [INFO ] [MAIN      ] CWK: Successfully saved derivative data.
[2025-10-24T01:20:21.414433] [INFO ] [MAIN      ] Derivative Progress: 518/2164 symbols completed. CWK took 1.3s. Estimated remaining: 11m 40s. Rate: 141.0 symbols/min
[2025-10-24T01:20:21.416305] [INFO ] [MAIN      ] CXH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:21.420177] [DEBUG] [LOCAL     ] CXE: Loaded 6427 existing records from primary storage.
[2025-10-24T01:20:21.422038] [INFO ] [MAIN      ] CXE: Loaded 6427 primary data records.
[2025-10-24T01:20:21.489264] [INFO ] [MAIN      ] CX: Generated 139 derivative records from 53209 primary records.
[2025-10-24T01:20:21.509344] [DEBUG] [LOCAL     ] CXH: Loaded 4401 existing records from primary storage.
[2025-10-24T01:20:21.514674] [INFO ] [MAIN      ] CXH: Loaded 4401 primary data records.
[2025-10-24T01:20:21.528275] [DEBUG] [LOCAL     ] CX: Saving derivative data.
[2025-10-24T01:20:21.929345] [DEBUG] [LOCAL     ] CX: Derivative data saved (139 records).
[2025-10-24T01:20:21.947252] [INFO ] [MAIN      ] CX: Successfully saved derivative data.
[2025-10-24T01:20:21.974892] [INFO ] [MAIN      ] Derivative Progress: 519/2164 symbols completed. CX took 1.8s. Estimated remaining: 11m 40s. Rate: 141.0 symbols/min
[2025-10-24T01:20:22.078095] [INFO ] [MAIN      ] CXM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:22.124503] [DEBUG] [MAIN      ] CXE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:22.168631] [DEBUG] [MAIN      ] CXH: Filtered 6966 bins outside market hours, 7762 incomplete bins
[2025-10-24T01:20:22.206381] [DEBUG] [LOCAL     ] CXM: Loaded 47703 existing records from primary storage.
[2025-10-24T01:20:22.208450] [INFO ] [MAIN      ] CXM: Loaded 47703 primary data records.
[2025-10-24T01:20:22.342248] [INFO ] [MAIN      ] CXE: Generated 139 derivative records from 6427 primary records.
[2025-10-24T01:20:22.381141] [DEBUG] [LOCAL     ] CXE: Saving derivative data.
[2025-10-24T01:20:22.567024] [DEBUG] [LOCAL     ] CXE: Derivative data saved (139 records).
[2025-10-24T01:20:22.570860] [INFO ] [MAIN      ] CXE: Successfully saved derivative data.
[2025-10-24T01:20:22.573612] [INFO ] [MAIN      ] Derivative Progress: 520/2164 symbols completed. CXE took 1.2s. Estimated remaining: 11m 40s. Rate: 140.8 symbols/min
[2025-10-24T01:20:22.575552] [INFO ] [MAIN      ] CXT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:22.581264] [INFO ] [MAIN      ] CXH: Generated 139 derivative records from 4401 primary records.
[2025-10-24T01:20:22.581591] [DEBUG] [LOCAL     ] CXH: Saving derivative data.
[2025-10-24T01:20:22.592508] [DEBUG] [LOCAL     ] CXH: Derivative data saved (139 records).
[2025-10-24T01:20:22.593083] [INFO ] [MAIN      ] CXH: Successfully saved derivative data.
[2025-10-24T01:20:22.596198] [INFO ] [MAIN      ] Derivative Progress: 521/2164 symbols completed. CXH took 1.2s. Estimated remaining: 11m 39s. Rate: 141.1 symbols/min
[2025-10-24T01:20:22.597570] [INFO ] [MAIN      ] CXW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:22.637862] [DEBUG] [MAIN      ] CXM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:22.638541] [DEBUG] [LOCAL     ] CXT: Loaded 30880 existing records from primary storage.
[2025-10-24T01:20:22.651415] [INFO ] [MAIN      ] CXT: Loaded 30880 primary data records.
[2025-10-24T01:20:22.843706] [DEBUG] [LOCAL     ] CXW: Loaded 43910 existing records from primary storage.
[2025-10-24T01:20:22.905779] [INFO ] [MAIN      ] CXW: Loaded 43910 primary data records.
[2025-10-24T01:20:23.322380] [INFO ] [MAIN      ] CXM: Generated 139 derivative records from 47703 primary records.
[2025-10-24T01:20:23.337038] [DEBUG] [LOCAL     ] CXM: Saving derivative data.
[2025-10-24T01:20:23.352400] [DEBUG] [LOCAL     ] CXM: Derivative data saved (139 records).
[2025-10-24T01:20:23.354972] [INFO ] [MAIN      ] CXM: Successfully saved derivative data.
[2025-10-24T01:20:23.363437] [INFO ] [MAIN      ] Derivative Progress: 522/2164 symbols completed. CXM took 1.3s. Estimated remaining: 11m 39s. Rate: 140.9 symbols/min
[2025-10-24T01:20:23.376820] [DEBUG] [MAIN      ] CXT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:23.376936] [INFO ] [MAIN      ] CYD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:23.438794] [DEBUG] [MAIN      ] CXW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:23.463742] [DEBUG] [LOCAL     ] CYD: Loaded 27482 existing records from primary storage.
[2025-10-24T01:20:23.466513] [INFO ] [MAIN      ] CXT: Generated 139 derivative records from 30880 primary records.
[2025-10-24T01:20:23.467918] [INFO ] [MAIN      ] CYD: Loaded 27482 primary data records.
[2025-10-24T01:20:23.468418] [DEBUG] [LOCAL     ] CXT: Saving derivative data.
[2025-10-24T01:20:23.592930] [DEBUG] [LOCAL     ] CXT: Derivative data saved (139 records).
[2025-10-24T01:20:23.605217] [INFO ] [MAIN      ] CXT: Successfully saved derivative data.
[2025-10-24T01:20:23.618836] [INFO ] [MAIN      ] Derivative Progress: 523/2164 symbols completed. CXT took 1.0s. Estimated remaining: 11m 38s. Rate: 141.0 symbols/min
[2025-10-24T01:20:23.797292] [INFO ] [MAIN      ] CXW: Generated 139 derivative records from 43910 primary records.
[2025-10-24T01:20:23.797730] [DEBUG] [LOCAL     ] CXW: Saving derivative data.
[2025-10-24T01:20:23.811746] [DEBUG] [LOCAL     ] CXW: Derivative data saved (139 records).
[2025-10-24T01:20:23.811838] [INFO ] [MAIN      ] CXW: Successfully saved derivative data.
[2025-10-24T01:20:23.814893] [INFO ] [MAIN      ] Derivative Progress: 524/2164 symbols completed. CXW took 1.2s. Estimated remaining: 11m 37s. Rate: 141.1 symbols/min
[2025-10-24T01:20:23.834030] [DEBUG] [MAIN      ] CYD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:23.859269] [INFO ] [MAIN      ] CYD: Generated 139 derivative records from 27482 primary records.
[2025-10-24T01:20:23.859377] [DEBUG] [LOCAL     ] CYD: Saving derivative data.
[2025-10-24T01:20:23.870845] [DEBUG] [LOCAL     ] CYD: Derivative data saved (139 records).
[2025-10-24T01:20:23.870925] [INFO ] [MAIN      ] CYD: Successfully saved derivative data.
[2025-10-24T01:20:23.873120] [INFO ] [MAIN      ] Derivative Progress: 525/2164 symbols completed. CYD took 0.5s. Estimated remaining: 11m 36s. Rate: 141.4 symbols/min
[2025-10-24T01:20:23.873571] [INFO ] [MAIN      ] CYH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:23.874002] [INFO ] [MAIN      ] D: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:23.873722] [INFO ] [MAIN      ] DAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:23.942202] [DEBUG] [LOCAL     ] CYH: Loaded 47987 existing records from primary storage.
[2025-10-24T01:20:23.944336] [INFO ] [MAIN      ] CYH: Loaded 47987 primary data records.
[2025-10-24T01:20:24.003228] [DEBUG] [LOCAL     ] D: Loaded 54039 existing records from primary storage.
[2025-10-24T01:20:24.016144] [DEBUG] [LOCAL     ] DAN: Loaded 49732 existing records from primary storage.
[2025-10-24T01:20:24.064214] [INFO ] [MAIN      ] DAN: Loaded 49732 primary data records.
[2025-10-24T01:20:24.072139] [INFO ] [MAIN      ] D: Loaded 54039 primary data records.
[2025-10-24T01:20:24.897904] [DEBUG] [MAIN      ] CYH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:24.940853] [DEBUG] [MAIN      ] DAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:24.946930] [DEBUG] [MAIN      ] D: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:25.007697] [INFO ] [MAIN      ] CYH: Generated 139 derivative records from 47987 primary records.
[2025-10-24T01:20:25.008710] [DEBUG] [LOCAL     ] CYH: Saving derivative data.
[2025-10-24T01:20:25.027963] [DEBUG] [LOCAL     ] CYH: Derivative data saved (139 records).
[2025-10-24T01:20:25.028564] [INFO ] [MAIN      ] CYH: Successfully saved derivative data.
[2025-10-24T01:20:25.031076] [INFO ] [MAIN      ] Derivative Progress: 526/2164 symbols completed. CYH took 1.2s. Estimated remaining: 11m 37s. Rate: 140.9 symbols/min
[2025-10-24T01:20:25.031252] [INFO ] [MAIN      ] DAO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:25.043341] [INFO ] [MAIN      ] DAN: Generated 139 derivative records from 49732 primary records.
[2025-10-24T01:20:25.043873] [DEBUG] [LOCAL     ] DAN: Saving derivative data.
[2025-10-24T01:20:25.043745] [INFO ] [MAIN      ] D: Generated 139 derivative records from 54039 primary records.
[2025-10-24T01:20:25.044439] [DEBUG] [LOCAL     ] D: Saving derivative data.
[2025-10-24T01:20:25.065466] [DEBUG] [LOCAL     ] DAN: Derivative data saved (139 records).
[2025-10-24T01:20:25.072453] [INFO ] [MAIN      ] DAN: Successfully saved derivative data.
[2025-10-24T01:20:25.075247] [INFO ] [MAIN      ] Derivative Progress: 527/2164 symbols completed. DAN took 1.2s. Estimated remaining: 11m 36s. Rate: 141.1 symbols/min
[2025-10-24T01:20:25.072548] [DEBUG] [LOCAL     ] D: Derivative data saved (139 records).
[2025-10-24T01:20:25.075615] [INFO ] [MAIN      ] D: Successfully saved derivative data.
[2025-10-24T01:20:25.075501] [INFO ] [MAIN      ] DAR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:25.078819] [INFO ] [MAIN      ] Derivative Progress: 528/2164 symbols completed. D took 1.2s. Estimated remaining: 11m 34s. Rate: 141.4 symbols/min
[2025-10-24T01:20:25.079268] [INFO ] [MAIN      ] DAVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:25.088422] [DEBUG] [LOCAL     ] DAO: Loaded 19946 existing records from primary storage.
[2025-10-24T01:20:25.088600] [INFO ] [MAIN      ] DAO: Loaded 19946 primary data records.
[2025-10-24T01:20:25.421486] [DEBUG] [LOCAL     ] DAVA: Loaded 42219 existing records from primary storage.
[2025-10-24T01:20:25.437081] [INFO ] [MAIN      ] DAVA: Loaded 42219 primary data records.
[2025-10-24T01:20:25.461528] [DEBUG] [LOCAL     ] DAR: Loaded 52387 existing records from primary storage.
[2025-10-24T01:20:25.478634] [INFO ] [MAIN      ] DAR: Loaded 52387 primary data records.
[2025-10-24T01:20:26.121978] [DEBUG] [MAIN      ] DAO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:26.175883] [DEBUG] [MAIN      ] DAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:26.209145] [DEBUG] [MAIN      ] DAR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:26.211608] [INFO ] [MAIN      ] DAO: Generated 139 derivative records from 19946 primary records.
[2025-10-24T01:20:26.223441] [DEBUG] [LOCAL     ] DAO: Saving derivative data.
[2025-10-24T01:20:26.246205] [DEBUG] [LOCAL     ] DAO: Derivative data saved (139 records).
[2025-10-24T01:20:26.246838] [INFO ] [MAIN      ] DAO: Successfully saved derivative data.
[2025-10-24T01:20:26.253124] [INFO ] [MAIN      ] Derivative Progress: 529/2164 symbols completed. DAO took 1.2s. Estimated remaining: 11m 36s. Rate: 140.9 symbols/min
[2025-10-24T01:20:26.254381] [INFO ] [MAIN      ] DAY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:26.284730] [INFO ] [MAIN      ] DAVA: Generated 139 derivative records from 42219 primary records.
[2025-10-24T01:20:26.286879] [INFO ] [MAIN      ] DAR: Generated 139 derivative records from 52387 primary records.
[2025-10-24T01:20:26.287116] [DEBUG] [LOCAL     ] DAVA: Saving derivative data.
[2025-10-24T01:20:26.287208] [DEBUG] [LOCAL     ] DAR: Saving derivative data.
[2025-10-24T01:20:26.319353] [DEBUG] [LOCAL     ] DAR: Derivative data saved (139 records).
[2025-10-24T01:20:26.320900] [INFO ] [MAIN      ] DAR: Successfully saved derivative data.
[2025-10-24T01:20:26.325684] [INFO ] [MAIN      ] Derivative Progress: 530/2164 symbols completed. DAR took 1.3s. Estimated remaining: 11m 35s. Rate: 141.2 symbols/min
[2025-10-24T01:20:26.326431] [DEBUG] [LOCAL     ] DAVA: Derivative data saved (139 records).
[2025-10-24T01:20:26.326550] [INFO ] [MAIN      ] DB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:26.327221] [INFO ] [MAIN      ] DAVA: Successfully saved derivative data.
[2025-10-24T01:20:26.329624] [INFO ] [MAIN      ] Derivative Progress: 531/2164 symbols completed. DAVA took 1.3s. Estimated remaining: 11m 33s. Rate: 141.4 symbols/min
[2025-10-24T01:20:26.330054] [INFO ] [MAIN      ] DBD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:26.347462] [DEBUG] [LOCAL     ] DAY: Loaded 49492 existing records from primary storage.
[2025-10-24T01:20:26.347960] [INFO ] [MAIN      ] DAY: Loaded 49492 primary data records.
[2025-10-24T01:20:26.543865] [DEBUG] [LOCAL     ] DBD: Loaded 24706 existing records from primary storage.
[2025-10-24T01:20:26.668890] [INFO ] [MAIN      ] DBD: Loaded 24706 primary data records.
[2025-10-24T01:20:26.798030] [DEBUG] [LOCAL     ] DB: Loaded 52840 existing records from primary storage.
[2025-10-24T01:20:26.813756] [INFO ] [MAIN      ] DB: Loaded 52840 primary data records.
[2025-10-24T01:20:27.330242] [DEBUG] [MAIN      ] DAY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:27.369415] [DEBUG] [MAIN      ] DBD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:27.417282] [DEBUG] [MAIN      ] DB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:27.437492] [INFO ] [MAIN      ] DAY: Generated 139 derivative records from 49492 primary records.
[2025-10-24T01:20:27.439418] [DEBUG] [LOCAL     ] DAY: Saving derivative data.
[2025-10-24T01:20:27.455630] [DEBUG] [LOCAL     ] DAY: Derivative data saved (139 records).
[2025-10-24T01:20:27.457231] [INFO ] [MAIN      ] DAY: Successfully saved derivative data.
[2025-10-24T01:20:27.462991] [INFO ] [MAIN      ] Derivative Progress: 532/2164 symbols completed. DAY took 1.2s. Estimated remaining: 11m 35s. Rate: 141.0 symbols/min
[2025-10-24T01:20:27.465827] [INFO ] [MAIN      ] DBI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:27.472176] [INFO ] [MAIN      ] DBD: Generated 139 derivative records from 24706 primary records.
[2025-10-24T01:20:27.474818] [DEBUG] [LOCAL     ] DBD: Saving derivative data.
[2025-10-24T01:20:27.492258] [DEBUG] [LOCAL     ] DBD: Derivative data saved (139 records).
[2025-10-24T01:20:27.492499] [INFO ] [MAIN      ] DBD: Successfully saved derivative data.
[2025-10-24T01:20:27.495152] [INFO ] [MAIN      ] Derivative Progress: 533/2164 symbols completed. DBD took 1.2s. Estimated remaining: 11m 33s. Rate: 141.2 symbols/min
[2025-10-24T01:20:27.495435] [INFO ] [MAIN      ] DBL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:27.502781] [INFO ] [MAIN      ] DB: Generated 139 derivative records from 52840 primary records.
[2025-10-24T01:20:27.502927] [DEBUG] [LOCAL     ] DB: Saving derivative data.
[2025-10-24T01:20:27.526823] [DEBUG] [LOCAL     ] DB: Derivative data saved (139 records).
[2025-10-24T01:20:27.526941] [INFO ] [MAIN      ] DB: Successfully saved derivative data.
[2025-10-24T01:20:27.529903] [INFO ] [MAIN      ] Derivative Progress: 534/2164 symbols completed. DB took 1.2s. Estimated remaining: 11m 31s. Rate: 141.5 symbols/min
[2025-10-24T01:20:27.530206] [INFO ] [MAIN      ] DBRG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:27.535300] [DEBUG] [LOCAL     ] DBL: Loaded 9423 existing records from primary storage.
[2025-10-24T01:20:27.535445] [INFO ] [MAIN      ] DBL: Loaded 9423 primary data records.
[2025-10-24T01:20:27.654685] [DEBUG] [LOCAL     ] DBI: Loaded 43620 existing records from primary storage.
[2025-10-24T01:20:27.655038] [INFO ] [MAIN      ] DBI: Loaded 43620 primary data records.
[2025-10-24T01:20:28.194731] [DEBUG] [LOCAL     ] DBRG: Loaded 50364 existing records from primary storage.
[2025-10-24T01:20:28.203744] [INFO ] [MAIN      ] DBRG: Loaded 50364 primary data records.
[2025-10-24T01:20:28.531435] [DEBUG] [MAIN      ] DBL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:28.570857] [DEBUG] [MAIN      ] DBI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:28.635531] [INFO ] [MAIN      ] DBL: Generated 139 derivative records from 9423 primary records.
[2025-10-24T01:20:28.635123] [DEBUG] [MAIN      ] DBRG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:28.638226] [DEBUG] [LOCAL     ] DBL: Saving derivative data.
[2025-10-24T01:20:28.664153] [DEBUG] [LOCAL     ] DBL: Derivative data saved (139 records).
[2025-10-24T01:20:28.664345] [INFO ] [MAIN      ] DBL: Successfully saved derivative data.
[2025-10-24T01:20:28.666717] [INFO ] [MAIN      ] Derivative Progress: 535/2164 symbols completed. DBL took 1.2s. Estimated remaining: 11m 33s. Rate: 141.0 symbols/min
[2025-10-24T01:20:28.668381] [INFO ] [MAIN      ] DCI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:28.678852] [INFO ] [MAIN      ] DBI: Generated 139 derivative records from 43620 primary records.
[2025-10-24T01:20:28.681509] [DEBUG] [LOCAL     ] DBI: Saving derivative data.
[2025-10-24T01:20:28.695149] [DEBUG] [LOCAL     ] DBI: Derivative data saved (139 records).
[2025-10-24T01:20:28.695426] [INFO ] [MAIN      ] DBI: Successfully saved derivative data.
[2025-10-24T01:20:28.700700] [INFO ] [MAIN      ] Derivative Progress: 536/2164 symbols completed. DBI took 1.2s. Estimated remaining: 11m 31s. Rate: 141.3 symbols/min
[2025-10-24T01:20:28.700963] [INFO ] [MAIN      ] DCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:28.710342] [INFO ] [MAIN      ] DBRG: Generated 139 derivative records from 50364 primary records.
[2025-10-24T01:20:28.710534] [DEBUG] [LOCAL     ] DBRG: Saving derivative data.
[2025-10-24T01:20:28.742985] [DEBUG] [LOCAL     ] DBRG: Derivative data saved (139 records).
[2025-10-24T01:20:28.742834] [DEBUG] [LOCAL     ] DCO: Loaded 15051 existing records from primary storage.
[2025-10-24T01:20:28.743136] [INFO ] [MAIN      ] DBRG: Successfully saved derivative data.
[2025-10-24T01:20:28.746360] [INFO ] [MAIN      ] Derivative Progress: 537/2164 symbols completed. DBRG took 1.2s. Estimated remaining: 11m 30s. Rate: 141.5 symbols/min
[2025-10-24T01:20:28.747665] [INFO ] [MAIN      ] DD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:28.746447] [INFO ] [MAIN      ] DCO: Loaded 15051 primary data records.
[2025-10-24T01:20:28.830390] [DEBUG] [LOCAL     ] DCI: Loaded 37136 existing records from primary storage.
[2025-10-24T01:20:28.852113] [INFO ] [MAIN      ] DCI: Loaded 37136 primary data records.
[2025-10-24T01:20:29.390847] [DEBUG] [LOCAL     ] DD: Loaded 53305 existing records from primary storage.
[2025-10-24T01:20:29.391388] [INFO ] [MAIN      ] DD: Loaded 53305 primary data records.
[2025-10-24T01:20:29.711488] [DEBUG] [MAIN      ] DCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:29.756998] [DEBUG] [MAIN      ] DCI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:29.822457] [INFO ] [MAIN      ] DCO: Generated 139 derivative records from 15051 primary records.
[2025-10-24T01:20:29.816995] [DEBUG] [MAIN      ] DD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:29.824237] [DEBUG] [LOCAL     ] DCO: Saving derivative data.
[2025-10-24T01:20:29.854980] [DEBUG] [LOCAL     ] DCO: Derivative data saved (139 records).
[2025-10-24T01:20:29.855411] [INFO ] [MAIN      ] DCO: Successfully saved derivative data.
[2025-10-24T01:20:29.858096] [INFO ] [MAIN      ] Derivative Progress: 538/2164 symbols completed. DCO took 1.2s. Estimated remaining: 11m 32s. Rate: 141.1 symbols/min
[2025-10-24T01:20:29.869095] [INFO ] [MAIN      ] DCI: Generated 139 derivative records from 37136 primary records.
[2025-10-24T01:20:29.871861] [DEBUG] [LOCAL     ] DCI: Saving derivative data.
[2025-10-24T01:20:29.888464] [DEBUG] [LOCAL     ] DCI: Derivative data saved (139 records).
[2025-10-24T01:20:29.889015] [INFO ] [MAIN      ] DCI: Successfully saved derivative data.
[2025-10-24T01:20:29.891683] [INFO ] [MAIN      ] Derivative Progress: 539/2164 symbols completed. DCI took 1.2s. Estimated remaining: 11m 30s. Rate: 141.3 symbols/min
[2025-10-24T01:20:29.897020] [INFO ] [MAIN      ] DD: Generated 139 derivative records from 53305 primary records.
[2025-10-24T01:20:29.897198] [DEBUG] [LOCAL     ] DD: Saving derivative data.
[2025-10-24T01:20:29.909040] [DEBUG] [LOCAL     ] DD: Derivative data saved (139 records).
[2025-10-24T01:20:29.909121] [INFO ] [MAIN      ] DD: Successfully saved derivative data.
[2025-10-24T01:20:29.911931] [INFO ] [MAIN      ] Derivative Progress: 540/2164 symbols completed. DD took 1.2s. Estimated remaining: 11m 28s. Rate: 141.6 symbols/min
[2025-10-24T01:20:29.912394] [INFO ] [MAIN      ] DDS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:29.912317] [INFO ] [MAIN      ] DDD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:29.912718] [INFO ] [MAIN      ] DDL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:29.930920] [DEBUG] [LOCAL     ] DDS: Loaded 12405 existing records from primary storage.
[2025-10-24T01:20:29.931423] [INFO ] [MAIN      ] DDS: Loaded 12405 primary data records.
[2025-10-24T01:20:30.166774] [DEBUG] [LOCAL     ] DDL: Loaded 37424 existing records from primary storage.
[2025-10-24T01:20:30.298782] [DEBUG] [LOCAL     ] DDD: Loaded 51313 existing records from primary storage.
[2025-10-24T01:20:30.312821] [INFO ] [MAIN      ] DDD: Loaded 51313 primary data records.
[2025-10-24T01:20:30.313356] [INFO ] [MAIN      ] DDL: Loaded 37424 primary data records.
[2025-10-24T01:20:30.930878] [DEBUG] [MAIN      ] DDS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:20:30.996249] [DEBUG] [MAIN      ] DDL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:31.029911] [DEBUG] [MAIN      ] DDD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:31.052999] [INFO ] [MAIN      ] DDS: Generated 139 derivative records from 12405 primary records.
[2025-10-24T01:20:31.054767] [DEBUG] [LOCAL     ] DDS: Saving derivative data.
[2025-10-24T01:20:31.073743] [DEBUG] [LOCAL     ] DDS: Derivative data saved (139 records).
[2025-10-24T01:20:31.075926] [INFO ] [MAIN      ] DDS: Successfully saved derivative data.
[2025-10-24T01:20:31.079970] [INFO ] [MAIN      ] Derivative Progress: 541/2164 symbols completed. DDS took 1.2s. Estimated remaining: 11m 30s. Rate: 141.1 symbols/min
[2025-10-24T01:20:31.083832] [INFO ] [MAIN      ] DDT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:31.099147] [DEBUG] [LOCAL     ] DDT: Loaded 1876 existing records from primary storage.
[2025-10-24T01:20:31.102600] [INFO ] [MAIN      ] DDT: Loaded 1876 primary data records.
[2025-10-24T01:20:31.218444] [INFO ] [MAIN      ] DDL: Generated 139 derivative records from 37424 primary records.
[2025-10-24T01:20:31.236796] [DEBUG] [LOCAL     ] DDL: Saving derivative data.
[2025-10-24T01:20:31.289973] [INFO ] [MAIN      ] DDD: Generated 139 derivative records from 51313 primary records.
[2025-10-24T01:20:31.411431] [DEBUG] [LOCAL     ] DDD: Saving derivative data.
[2025-10-24T01:20:31.427825] [DEBUG] [LOCAL     ] DDL: Derivative data saved (139 records).
[2025-10-24T01:20:31.429619] [INFO ] [MAIN      ] DDL: Successfully saved derivative data.
[2025-10-24T01:20:31.440238] [INFO ] [MAIN      ] Derivative Progress: 542/2164 symbols completed. DDL took 1.5s. Estimated remaining: 11m 29s. Rate: 141.2 symbols/min
[2025-10-24T01:20:31.441341] [INFO ] [MAIN      ] DE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:31.447378] [DEBUG] [LOCAL     ] DDD: Derivative data saved (139 records).
[2025-10-24T01:20:31.448475] [INFO ] [MAIN      ] DDD: Successfully saved derivative data.
[2025-10-24T01:20:31.452146] [INFO ] [MAIN      ] Derivative Progress: 543/2164 symbols completed. DDD took 1.5s. Estimated remaining: 11m 28s. Rate: 141.4 symbols/min
[2025-10-24T01:20:31.452364] [INFO ] [MAIN      ] DEA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:31.476897] [DEBUG] [MAIN      ] DDT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:31.548796] [DEBUG] [LOCAL     ] DEA: Loaded 40311 existing records from primary storage.
[2025-10-24T01:20:31.549266] [INFO ] [MAIN      ] DEA: Loaded 40311 primary data records.
[2025-10-24T01:20:31.561750] [DEBUG] [LOCAL     ] DE: Loaded 47878 existing records from primary storage.
[2025-10-24T01:20:31.561947] [INFO ] [MAIN      ] DE: Loaded 47878 primary data records.
[2025-10-24T01:20:31.768892] [INFO ] [MAIN      ] DDT: Generated 139 derivative records from 1876 primary records.
[2025-10-24T01:20:31.789637] [DEBUG] [LOCAL     ] DDT: Saving derivative data.
[2025-10-24T01:20:32.035089] [DEBUG] [LOCAL     ] DDT: Derivative data saved (139 records).
[2025-10-24T01:20:32.201535] [INFO ] [MAIN      ] DDT: Successfully saved derivative data.
[2025-10-24T01:20:32.219555] [INFO ] [MAIN      ] Derivative Progress: 544/2164 symbols completed. DDT took 1.1s. Estimated remaining: 11m 28s. Rate: 141.2 symbols/min
[2025-10-24T01:20:32.222312] [INFO ] [MAIN      ] DEC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:32.252262] [DEBUG] [MAIN      ] DE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:32.288908] [DEBUG] [LOCAL     ] DEC: Loaded 30427 existing records from primary storage.
[2025-10-24T01:20:32.302285] [DEBUG] [MAIN      ] DEA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:32.302389] [INFO ] [MAIN      ] DEC: Loaded 30427 primary data records.
[2025-10-24T01:20:32.646262] [INFO ] [MAIN      ] DE: Generated 139 derivative records from 47878 primary records.
[2025-10-24T01:20:32.646985] [DEBUG] [LOCAL     ] DE: Saving derivative data.
[2025-10-24T01:20:32.664075] [DEBUG] [LOCAL     ] DE: Derivative data saved (139 records).
[2025-10-24T01:20:32.664705] [INFO ] [MAIN      ] DE: Successfully saved derivative data.
[2025-10-24T01:20:32.668797] [INFO ] [MAIN      ] Derivative Progress: 545/2164 symbols completed. DE took 1.2s. Estimated remaining: 11m 28s. Rate: 141.2 symbols/min
[2025-10-24T01:20:32.669319] [INFO ] [MAIN      ] DEA: Generated 139 derivative records from 40311 primary records.
[2025-10-24T01:20:32.669552] [INFO ] [MAIN      ] DECK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:32.670404] [DEBUG] [LOCAL     ] DEA: Saving derivative data.
[2025-10-24T01:20:32.683996] [DEBUG] [LOCAL     ] DEA: Derivative data saved (139 records).
[2025-10-24T01:20:32.684327] [INFO ] [MAIN      ] DEA: Successfully saved derivative data.
[2025-10-24T01:20:32.687096] [INFO ] [MAIN      ] Derivative Progress: 546/2164 symbols completed. DEA took 1.2s. Estimated remaining: 11m 26s. Rate: 141.4 symbols/min
[2025-10-24T01:20:32.687282] [INFO ] [MAIN      ] DEI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:32.706998] [DEBUG] [MAIN      ] DEC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:32.761205] [INFO ] [MAIN      ] DEC: Generated 139 derivative records from 30427 primary records.
[2025-10-24T01:20:32.761517] [DEBUG] [LOCAL     ] DEC: Saving derivative data.
[2025-10-24T01:20:32.805785] [DEBUG] [LOCAL     ] DEC: Derivative data saved (139 records).
[2025-10-24T01:20:32.807383] [INFO ] [MAIN      ] DEC: Successfully saved derivative data.
[2025-10-24T01:20:32.810405] [INFO ] [MAIN      ] Derivative Progress: 547/2164 symbols completed. DEC took 0.6s. Estimated remaining: 11m 25s. Rate: 141.6 symbols/min
[2025-10-24T01:20:32.807273] [DEBUG] [LOCAL     ] DECK: Loaded 53691 existing records from primary storage.
[2025-10-24T01:20:32.810597] [INFO ] [MAIN      ] DEO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:32.810766] [INFO ] [MAIN      ] DECK: Loaded 53691 primary data records.
[2025-10-24T01:20:32.811990] [DEBUG] [LOCAL     ] DEI: Loaded 48643 existing records from primary storage.
[2025-10-24T01:20:32.832959] [INFO ] [MAIN      ] DEI: Loaded 48643 primary data records.
[2025-10-24T01:20:33.482340] [DEBUG] [LOCAL     ] DEO: Loaded 49560 existing records from primary storage.
[2025-10-24T01:20:33.483068] [INFO ] [MAIN      ] DEO: Loaded 49560 primary data records.
[2025-10-24T01:20:33.799351] [DEBUG] [MAIN      ] DECK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:33.828362] [DEBUG] [MAIN      ] DEI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:33.885896] [DEBUG] [MAIN      ] DEO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:33.911672] [INFO ] [MAIN      ] DECK: Generated 139 derivative records from 53691 primary records.
[2025-10-24T01:20:33.912624] [DEBUG] [LOCAL     ] DECK: Saving derivative data.
[2025-10-24T01:20:33.929705] [INFO ] [MAIN      ] DEI: Generated 139 derivative records from 48643 primary records.
[2025-10-24T01:20:33.932713] [DEBUG] [LOCAL     ] DEI: Saving derivative data.
[2025-10-24T01:20:33.933787] [DEBUG] [LOCAL     ] DECK: Derivative data saved (139 records).
[2025-10-24T01:20:33.943941] [INFO ] [MAIN      ] DECK: Successfully saved derivative data.
[2025-10-24T01:20:33.948889] [INFO ] [MAIN      ] Derivative Progress: 548/2164 symbols completed. DECK took 1.3s. Estimated remaining: 11m 27s. Rate: 141.2 symbols/min
[2025-10-24T01:20:33.951848] [DEBUG] [LOCAL     ] DEI: Derivative data saved (139 records).
[2025-10-24T01:20:33.952693] [INFO ] [MAIN      ] DFH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:33.954045] [INFO ] [MAIN      ] DEI: Successfully saved derivative data.
[2025-10-24T01:20:33.956920] [INFO ] [MAIN      ] Derivative Progress: 549/2164 symbols completed. DEI took 1.3s. Estimated remaining: 11m 25s. Rate: 141.4 symbols/min
[2025-10-24T01:20:33.960694] [INFO ] [MAIN      ] DFIN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:33.969503] [INFO ] [MAIN      ] DEO: Generated 139 derivative records from 49560 primary records.
[2025-10-24T01:20:33.969752] [DEBUG] [LOCAL     ] DEO: Saving derivative data.
[2025-10-24T01:20:33.990234] [DEBUG] [LOCAL     ] DEO: Derivative data saved (139 records).
[2025-10-24T01:20:33.995113] [INFO ] [MAIN      ] DEO: Successfully saved derivative data.
[2025-10-24T01:20:33.997454] [INFO ] [MAIN      ] Derivative Progress: 550/2164 symbols completed. DEO took 1.2s. Estimated remaining: 11m 24s. Rate: 141.7 symbols/min
[2025-10-24T01:20:33.997834] [INFO ] [MAIN      ] DFP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:34.017600] [DEBUG] [LOCAL     ] DFIN: Loaded 22540 existing records from primary storage.
[2025-10-24T01:20:34.018159] [INFO ] [MAIN      ] DFIN: Loaded 22540 primary data records.
[2025-10-24T01:20:34.018782] [DEBUG] [LOCAL     ] DFH: Loaded 31800 existing records from primary storage.
[2025-10-24T01:20:34.026423] [INFO ] [MAIN      ] DFH: Loaded 31800 primary data records.
[2025-10-24T01:20:34.183696] [DEBUG] [LOCAL     ] DFP: Loaded 11089 existing records from primary storage.
[2025-10-24T01:20:34.221477] [INFO ] [MAIN      ] DFP: Loaded 11089 primary data records.
[2025-10-24T01:20:34.973783] [DEBUG] [MAIN      ] DFIN: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:20:35.000123] [DEBUG] [MAIN      ] DFH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:35.039471] [DEBUG] [MAIN      ] DFP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:35.090200] [INFO ] [MAIN      ] DFIN: Generated 139 derivative records from 22540 primary records.
[2025-10-24T01:20:35.094030] [DEBUG] [LOCAL     ] DFIN: Saving derivative data.
[2025-10-24T01:20:35.097624] [INFO ] [MAIN      ] DFH: Generated 139 derivative records from 31800 primary records.
[2025-10-24T01:20:35.104848] [DEBUG] [LOCAL     ] DFH: Saving derivative data.
[2025-10-24T01:20:35.109497] [DEBUG] [LOCAL     ] DFIN: Derivative data saved (139 records).
[2025-10-24T01:20:35.111526] [INFO ] [MAIN      ] DFIN: Successfully saved derivative data.
[2025-10-24T01:20:35.124775] [INFO ] [MAIN      ] Derivative Progress: 551/2164 symbols completed. DFIN took 1.2s. Estimated remaining: 11m 25s. Rate: 141.2 symbols/min
[2025-10-24T01:20:35.129528] [INFO ] [MAIN      ] DG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:35.129159] [DEBUG] [LOCAL     ] DFH: Derivative data saved (139 records).
[2025-10-24T01:20:35.133731] [INFO ] [MAIN      ] DFH: Successfully saved derivative data.
[2025-10-24T01:20:35.135795] [INFO ] [MAIN      ] DFP: Generated 139 derivative records from 11089 primary records.
[2025-10-24T01:20:35.138366] [INFO ] [MAIN      ] Derivative Progress: 552/2164 symbols completed. DFH took 1.2s. Estimated remaining: 11m 24s. Rate: 141.5 symbols/min
[2025-10-24T01:20:35.138694] [DEBUG] [LOCAL     ] DFP: Saving derivative data.
[2025-10-24T01:20:35.138890] [INFO ] [MAIN      ] DGX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:35.154033] [DEBUG] [LOCAL     ] DFP: Derivative data saved (139 records).
[2025-10-24T01:20:35.154342] [INFO ] [MAIN      ] DFP: Successfully saved derivative data.
[2025-10-24T01:20:35.157037] [INFO ] [MAIN      ] Derivative Progress: 553/2164 symbols completed. DFP took 1.2s. Estimated remaining: 11m 22s. Rate: 141.7 symbols/min
[2025-10-24T01:20:35.231060] [DEBUG] [LOCAL     ] DGX: Loaded 44964 existing records from primary storage.
[2025-10-24T01:20:35.231313] [INFO ] [MAIN      ] DGX: Loaded 44964 primary data records.
[2025-10-24T01:20:35.232801] [DEBUG] [LOCAL     ] DG: Loaded 53630 existing records from primary storage.
[2025-10-24T01:20:35.307108] [INFO ] [MAIN      ] DG: Loaded 53630 primary data records.
[2025-10-24T01:20:35.840722] [DEBUG] [MAIN      ] DGX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:35.880946] [DEBUG] [MAIN      ] DG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:35.899122] [INFO ] [MAIN      ] DGX: Generated 139 derivative records from 44964 primary records.
[2025-10-24T01:20:35.899371] [DEBUG] [LOCAL     ] DGX: Saving derivative data.
[2025-10-24T01:20:35.920681] [DEBUG] [LOCAL     ] DGX: Derivative data saved (139 records).
[2025-10-24T01:20:35.922113] [INFO ] [MAIN      ] DGX: Successfully saved derivative data.
[2025-10-24T01:20:35.926911] [INFO ] [MAIN      ] Derivative Progress: 554/2164 symbols completed. DGX took 0.8s. Estimated remaining: 11m 23s. Rate: 141.5 symbols/min
[2025-10-24T01:20:35.932755] [INFO ] [MAIN      ] DG: Generated 139 derivative records from 53630 primary records.
[2025-10-24T01:20:35.932860] [DEBUG] [LOCAL     ] DG: Saving derivative data.
[2025-10-24T01:20:35.944677] [DEBUG] [LOCAL     ] DG: Derivative data saved (139 records).
[2025-10-24T01:20:35.944767] [INFO ] [MAIN      ] DG: Successfully saved derivative data.
[2025-10-24T01:20:35.947879] [INFO ] [MAIN      ] Derivative Progress: 555/2164 symbols completed. DG took 0.8s. Estimated remaining: 11m 21s. Rate: 141.8 symbols/min
[2025-10-24T01:20:35.948331] [INFO ] [MAIN      ] DHF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:35.948451] [INFO ] [MAIN      ] DHR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:35.948572] [INFO ] [MAIN      ] DHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:35.978451] [DEBUG] [LOCAL     ] DHF: Loaded 20928 existing records from primary storage.
[2025-10-24T01:20:35.979020] [INFO ] [MAIN      ] DHF: Loaded 20928 primary data records.
[2025-10-24T01:20:36.351740] [DEBUG] [LOCAL     ] DHR: Loaded 53765 existing records from primary storage.
[2025-10-24T01:20:36.362313] [INFO ] [MAIN      ] DHR: Loaded 53765 primary data records.
[2025-10-24T01:20:36.361905] [DEBUG] [LOCAL     ] DHI: Loaded 53747 existing records from primary storage.
[2025-10-24T01:20:36.362624] [INFO ] [MAIN      ] DHI: Loaded 53747 primary data records.
[2025-10-24T01:20:36.980601] [DEBUG] [MAIN      ] DHF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:37.031291] [DEBUG] [MAIN      ] DHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:37.057501] [INFO ] [MAIN      ] DHF: Generated 139 derivative records from 20928 primary records.
[2025-10-24T01:20:37.068338] [DEBUG] [LOCAL     ] DHF: Saving derivative data.
[2025-10-24T01:20:37.074997] [DEBUG] [MAIN      ] DHR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:37.099848] [DEBUG] [LOCAL     ] DHF: Derivative data saved (139 records).
[2025-10-24T01:20:37.100140] [INFO ] [MAIN      ] DHF: Successfully saved derivative data.
[2025-10-24T01:20:37.103994] [INFO ] [MAIN      ] Derivative Progress: 556/2164 symbols completed. DHF took 1.2s. Estimated remaining: 11m 23s. Rate: 141.3 symbols/min
[2025-10-24T01:20:37.105570] [INFO ] [MAIN      ] DHT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:37.155991] [INFO ] [MAIN      ] DHI: Generated 139 derivative records from 53747 primary records.
[2025-10-24T01:20:37.157904] [DEBUG] [LOCAL     ] DHI: Saving derivative data.
[2025-10-24T01:20:37.160943] [INFO ] [MAIN      ] DHR: Generated 139 derivative records from 53765 primary records.
[2025-10-24T01:20:37.161381] [DEBUG] [LOCAL     ] DHR: Saving derivative data.
[2025-10-24T01:20:37.174334] [DEBUG] [LOCAL     ] DHI: Derivative data saved (139 records).
[2025-10-24T01:20:37.175615] [INFO ] [MAIN      ] DHI: Successfully saved derivative data.
[2025-10-24T01:20:37.202404] [INFO ] [MAIN      ] Derivative Progress: 557/2164 symbols completed. DHI took 1.3s. Estimated remaining: 11m 21s. Rate: 141.5 symbols/min
[2025-10-24T01:20:37.203892] [DEBUG] [LOCAL     ] DHT: Loaded 48212 existing records from primary storage.
[2025-10-24T01:20:37.204677] [DEBUG] [LOCAL     ] DHR: Derivative data saved (139 records).
[2025-10-24T01:20:37.204826] [INFO ] [MAIN      ] DHT: Loaded 48212 primary data records.
[2025-10-24T01:20:37.204984] [INFO ] [MAIN      ] DHX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:37.205292] [INFO ] [MAIN      ] DHR: Successfully saved derivative data.
[2025-10-24T01:20:37.220497] [INFO ] [MAIN      ] Derivative Progress: 558/2164 symbols completed. DHR took 1.3s. Estimated remaining: 11m 20s. Rate: 141.8 symbols/min
[2025-10-24T01:20:37.231479] [INFO ] [MAIN      ] DIAX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:37.336431] [DEBUG] [LOCAL     ] DHX: Loaded 13333 existing records from primary storage.
[2025-10-24T01:20:37.357976] [INFO ] [MAIN      ] DHX: Loaded 13333 primary data records.
[2025-10-24T01:20:37.364428] [DEBUG] [LOCAL     ] DIAX: Loaded 12784 existing records from primary storage.
[2025-10-24T01:20:37.413204] [INFO ] [MAIN      ] DIAX: Loaded 12784 primary data records.
[2025-10-24T01:20:38.178621] [DEBUG] [MAIN      ] DHT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:38.298276] [DEBUG] [MAIN      ] DIAX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:38.298781] [DEBUG] [MAIN      ] DHX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:38.369363] [INFO ] [MAIN      ] DHT: Generated 139 derivative records from 48212 primary records.
[2025-10-24T01:20:38.371226] [DEBUG] [LOCAL     ] DHT: Saving derivative data.
[2025-10-24T01:20:38.394426] [DEBUG] [LOCAL     ] DHT: Derivative data saved (139 records).
[2025-10-24T01:20:38.398891] [INFO ] [MAIN      ] DHT: Successfully saved derivative data.
[2025-10-24T01:20:38.405492] [INFO ] [MAIN      ] Derivative Progress: 559/2164 symbols completed. DHT took 1.3s. Estimated remaining: 11m 21s. Rate: 141.3 symbols/min
[2025-10-24T01:20:38.406505] [INFO ] [MAIN      ] DIN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:38.417055] [INFO ] [MAIN      ] DHX: Generated 139 derivative records from 13333 primary records.
[2025-10-24T01:20:38.419579] [INFO ] [MAIN      ] DIAX: Generated 139 derivative records from 12784 primary records.
[2025-10-24T01:20:38.419816] [DEBUG] [LOCAL     ] DHX: Saving derivative data.
[2025-10-24T01:20:38.420565] [DEBUG] [LOCAL     ] DIAX: Saving derivative data.
[2025-10-24T01:20:38.443699] [DEBUG] [LOCAL     ] DIAX: Derivative data saved (139 records).
[2025-10-24T01:20:38.446887] [DEBUG] [LOCAL     ] DHX: Derivative data saved (139 records).
[2025-10-24T01:20:38.447169] [INFO ] [MAIN      ] DIAX: Successfully saved derivative data.
[2025-10-24T01:20:38.450048] [INFO ] [MAIN      ] Derivative Progress: 560/2164 symbols completed. DIAX took 1.2s. Estimated remaining: 11m 20s. Rate: 141.5 symbols/min
[2025-10-24T01:20:38.450578] [INFO ] [MAIN      ] DINO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:38.450348] [INFO ] [MAIN      ] DHX: Successfully saved derivative data.
[2025-10-24T01:20:38.463758] [INFO ] [MAIN      ] Derivative Progress: 561/2164 symbols completed. DHX took 1.3s. Estimated remaining: 11m 18s. Rate: 141.8 symbols/min
[2025-10-24T01:20:38.464597] [INFO ] [MAIN      ] DIS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:38.485423] [DEBUG] [LOCAL     ] DIN: Loaded 36981 existing records from primary storage.
[2025-10-24T01:20:38.485729] [INFO ] [MAIN      ] DIN: Loaded 36981 primary data records.
[2025-10-24T01:20:38.851692] [DEBUG] [LOCAL     ] DINO: Loaded 53214 existing records from primary storage.
[2025-10-24T01:20:38.854030] [INFO ] [MAIN      ] DINO: Loaded 53214 primary data records.
[2025-10-24T01:20:38.855315] [DEBUG] [LOCAL     ] DIS: Loaded 54178 existing records from primary storage.
[2025-10-24T01:20:38.888063] [INFO ] [MAIN      ] DIS: Loaded 54178 primary data records.
[2025-10-24T01:20:39.469173] [DEBUG] [MAIN      ] DIN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:39.520087] [DEBUG] [MAIN      ] DINO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:39.562709] [DEBUG] [MAIN      ] DIS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:39.588254] [INFO ] [MAIN      ] DIN: Generated 139 derivative records from 36981 primary records.
[2025-10-24T01:20:39.591554] [DEBUG] [LOCAL     ] DIN: Saving derivative data.
[2025-10-24T01:20:39.611428] [DEBUG] [LOCAL     ] DIN: Derivative data saved (139 records).
[2025-10-24T01:20:39.613003] [INFO ] [MAIN      ] DIN: Successfully saved derivative data.
[2025-10-24T01:20:39.616331] [INFO ] [MAIN      ] Derivative Progress: 562/2164 symbols completed. DIN took 1.2s. Estimated remaining: 11m 20s. Rate: 141.3 symbols/min
[2025-10-24T01:20:39.617827] [INFO ] [MAIN      ] DK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:39.625725] [INFO ] [MAIN      ] DINO: Generated 139 derivative records from 53214 primary records.
[2025-10-24T01:20:39.631816] [DEBUG] [LOCAL     ] DINO: Saving derivative data.
[2025-10-24T01:20:39.648090] [DEBUG] [LOCAL     ] DINO: Derivative data saved (139 records).
[2025-10-24T01:20:39.648400] [INFO ] [MAIN      ] DINO: Successfully saved derivative data.
[2025-10-24T01:20:39.652365] [INFO ] [MAIN      ] Derivative Progress: 563/2164 symbols completed. DINO took 1.2s. Estimated remaining: 11m 19s. Rate: 141.6 symbols/min
[2025-10-24T01:20:39.652574] [INFO ] [MAIN      ] DKL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:39.656220] [INFO ] [MAIN      ] DIS: Generated 139 derivative records from 54178 primary records.
[2025-10-24T01:20:39.656513] [DEBUG] [LOCAL     ] DIS: Saving derivative data.
[2025-10-24T01:20:39.682903] [DEBUG] [LOCAL     ] DIS: Derivative data saved (139 records).
[2025-10-24T01:20:39.683112] [INFO ] [MAIN      ] DIS: Successfully saved derivative data.
[2025-10-24T01:20:39.686045] [INFO ] [MAIN      ] Derivative Progress: 564/2164 symbols completed. DIS took 1.2s. Estimated remaining: 11m 17s. Rate: 141.8 symbols/min
[2025-10-24T01:20:39.686424] [INFO ] [MAIN      ] DKS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:39.708950] [DEBUG] [LOCAL     ] DKL: Loaded 16921 existing records from primary storage.
[2025-10-24T01:20:39.709197] [INFO ] [MAIN      ] DKL: Loaded 16921 primary data records.
[2025-10-24T01:20:39.742416] [DEBUG] [LOCAL     ] DK: Loaded 49598 existing records from primary storage.
[2025-10-24T01:20:39.754591] [INFO ] [MAIN      ] DK: Loaded 49598 primary data records.
[2025-10-24T01:20:40.334193] [DEBUG] [LOCAL     ] DKS: Loaded 49595 existing records from primary storage.
[2025-10-24T01:20:40.334719] [INFO ] [MAIN      ] DKS: Loaded 49595 primary data records.
[2025-10-24T01:20:40.711977] [DEBUG] [MAIN      ] DK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:40.742694] [DEBUG] [MAIN      ] DKL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:40.799533] [DEBUG] [MAIN      ] DKS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:40.844240] [INFO ] [MAIN      ] DK: Generated 139 derivative records from 49598 primary records.
[2025-10-24T01:20:40.848827] [INFO ] [MAIN      ] DKL: Generated 139 derivative records from 16921 primary records.
[2025-10-24T01:20:40.849291] [DEBUG] [LOCAL     ] DKL: Saving derivative data.
[2025-10-24T01:20:40.848295] [DEBUG] [LOCAL     ] DK: Saving derivative data.
[2025-10-24T01:20:40.877527] [DEBUG] [LOCAL     ] DKL: Derivative data saved (139 records).
[2025-10-24T01:20:40.877742] [INFO ] [MAIN      ] DKL: Successfully saved derivative data.
[2025-10-24T01:20:40.884102] [DEBUG] [LOCAL     ] DK: Derivative data saved (139 records).
[2025-10-24T01:20:40.884311] [INFO ] [MAIN      ] DK: Successfully saved derivative data.
[2025-10-24T01:20:40.881923] [INFO ] [MAIN      ] Derivative Progress: 565/2164 symbols completed. DKL took 1.2s. Estimated remaining: 11m 19s. Rate: 141.3 symbols/min
[2025-10-24T01:20:40.890298] [INFO ] [MAIN      ] DLB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:40.890700] [INFO ] [MAIN      ] Derivative Progress: 566/2164 symbols completed. DK took 1.3s. Estimated remaining: 11m 17s. Rate: 141.6 symbols/min
[2025-10-24T01:20:40.891403] [INFO ] [MAIN      ] DLR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:40.895350] [INFO ] [MAIN      ] DKS: Generated 139 derivative records from 49595 primary records.
[2025-10-24T01:20:40.895539] [DEBUG] [LOCAL     ] DKS: Saving derivative data.
[2025-10-24T01:20:40.910474] [DEBUG] [LOCAL     ] DKS: Derivative data saved (139 records).
[2025-10-24T01:20:40.910692] [INFO ] [MAIN      ] DKS: Successfully saved derivative data.
[2025-10-24T01:20:40.913630] [INFO ] [MAIN      ] Derivative Progress: 567/2164 symbols completed. DKS took 1.2s. Estimated remaining: 11m 16s. Rate: 141.8 symbols/min
[2025-10-24T01:20:40.914488] [INFO ] [MAIN      ] DLX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:40.942098] [DEBUG] [LOCAL     ] DLB: Loaded 32462 existing records from primary storage.
[2025-10-24T01:20:40.942571] [INFO ] [MAIN      ] DLB: Loaded 32462 primary data records.
[2025-10-24T01:20:41.127425] [DEBUG] [LOCAL     ] DLX: Loaded 28240 existing records from primary storage.
[2025-10-24T01:20:41.162559] [INFO ] [MAIN      ] DLX: Loaded 28240 primary data records.
[2025-10-24T01:20:41.223479] [DEBUG] [LOCAL     ] DLR: Loaded 50985 existing records from primary storage.
[2025-10-24T01:20:41.258210] [INFO ] [MAIN      ] DLR: Loaded 50985 primary data records.
[2025-10-24T01:20:41.977325] [DEBUG] [MAIN      ] DLB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:42.043636] [DEBUG] [MAIN      ] DLX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:42.101908] [DEBUG] [MAIN      ] DLR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:42.150328] [INFO ] [MAIN      ] DLB: Generated 139 derivative records from 32462 primary records.
[2025-10-24T01:20:42.154569] [DEBUG] [LOCAL     ] DLB: Saving derivative data.
[2025-10-24T01:20:42.184878] [DEBUG] [LOCAL     ] DLB: Derivative data saved (139 records).
[2025-10-24T01:20:42.197514] [INFO ] [MAIN      ] DLB: Successfully saved derivative data.
[2025-10-24T01:20:42.203215] [INFO ] [MAIN      ] Derivative Progress: 568/2164 symbols completed. DLB took 1.3s. Estimated remaining: 11m 18s. Rate: 141.3 symbols/min
[2025-10-24T01:20:42.200081] [INFO ] [MAIN      ] DLX: Generated 139 derivative records from 28240 primary records.
[2025-10-24T01:20:42.204573] [DEBUG] [LOCAL     ] DLX: Saving derivative data.
[2025-10-24T01:20:42.229879] [DEBUG] [LOCAL     ] DLX: Derivative data saved (139 records).
[2025-10-24T01:20:42.232889] [INFO ] [MAIN      ] DLX: Successfully saved derivative data.
[2025-10-24T01:20:42.236619] [INFO ] [MAIN      ] Derivative Progress: 569/2164 symbols completed. DLX took 1.3s. Estimated remaining: 11m 16s. Rate: 141.6 symbols/min
[2025-10-24T01:20:42.240413] [INFO ] [MAIN      ] DLR: Generated 139 derivative records from 50985 primary records.
[2025-10-24T01:20:42.240674] [DEBUG] [LOCAL     ] DLR: Saving derivative data.
[2025-10-24T01:20:42.258291] [DEBUG] [LOCAL     ] DLR: Derivative data saved (139 records).
[2025-10-24T01:20:42.258469] [INFO ] [MAIN      ] DLR: Successfully saved derivative data.
[2025-10-24T01:20:42.262314] [INFO ] [MAIN      ] Derivative Progress: 570/2164 symbols completed. DLR took 1.4s. Estimated remaining: 11m 15s. Rate: 141.8 symbols/min
[2025-10-24T01:20:42.263262] [INFO ] [MAIN      ] DLY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:42.263429] [INFO ] [MAIN      ] DMA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:42.263550] [INFO ] [MAIN      ] DMB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:42.278203] [DEBUG] [LOCAL     ] DMA: Loaded 4725 existing records from primary storage.
[2025-10-24T01:20:42.279451] [INFO ] [MAIN      ] DMA: Loaded 4725 primary data records.
[2025-10-24T01:20:42.401868] [DEBUG] [LOCAL     ] DMB: Loaded 10554 existing records from primary storage.
[2025-10-24T01:20:42.441971] [DEBUG] [LOCAL     ] DLY: Loaded 20880 existing records from primary storage.
[2025-10-24T01:20:42.442245] [INFO ] [MAIN      ] DLY: Loaded 20880 primary data records.
[2025-10-24T01:20:42.440323] [INFO ] [MAIN      ] DMB: Loaded 10554 primary data records.
[2025-10-24T01:20:43.488396] [DEBUG] [MAIN      ] DMA: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:20:43.495586] [DEBUG] [MAIN      ] DLY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:43.536962] [DEBUG] [MAIN      ] DMB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:43.607303] [INFO ] [MAIN      ] DMA: Generated 139 derivative records from 4725 primary records.
[2025-10-24T01:20:43.610497] [INFO ] [MAIN      ] DLY: Generated 139 derivative records from 20880 primary records.
[2025-10-24T01:20:43.610812] [DEBUG] [LOCAL     ] DLY: Saving derivative data.
[2025-10-24T01:20:43.611010] [DEBUG] [LOCAL     ] DMA: Saving derivative data.
[2025-10-24T01:20:43.629280] [INFO ] [MAIN      ] DMB: Generated 139 derivative records from 10554 primary records.
[2025-10-24T01:20:43.633951] [DEBUG] [LOCAL     ] DMB: Saving derivative data.
[2025-10-24T01:20:43.634106] [DEBUG] [LOCAL     ] DLY: Derivative data saved (139 records).
[2025-10-24T01:20:43.636621] [INFO ] [MAIN      ] DLY: Successfully saved derivative data.
[2025-10-24T01:20:43.636704] [DEBUG] [LOCAL     ] DMA: Derivative data saved (139 records).
[2025-10-24T01:20:43.639669] [INFO ] [MAIN      ] Derivative Progress: 571/2164 symbols completed. DLY took 1.4s. Estimated remaining: 11m 17s. Rate: 141.2 symbols/min
[2025-10-24T01:20:43.646545] [INFO ] [MAIN      ] DMA: Successfully saved derivative data.
[2025-10-24T01:20:43.646772] [INFO ] [MAIN      ] DMO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:43.650844] [INFO ] [MAIN      ] Derivative Progress: 572/2164 symbols completed. DMA took 1.4s. Estimated remaining: 11m 15s. Rate: 141.5 symbols/min
[2025-10-24T01:20:43.651456] [INFO ] [MAIN      ] DNA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:43.654066] [DEBUG] [LOCAL     ] DMB: Derivative data saved (139 records).
[2025-10-24T01:20:43.654313] [INFO ] [MAIN      ] DMB: Successfully saved derivative data.
[2025-10-24T01:20:43.656848] [INFO ] [MAIN      ] Derivative Progress: 573/2164 symbols completed. DMB took 1.4s. Estimated remaining: 11m 14s. Rate: 141.7 symbols/min
[2025-10-24T01:20:43.657106] [INFO ] [MAIN      ] DNOW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:43.670743] [DEBUG] [LOCAL     ] DMO: Loaded 9835 existing records from primary storage.
[2025-10-24T01:20:43.671022] [INFO ] [MAIN      ] DMO: Loaded 9835 primary data records.
[2025-10-24T01:20:44.005728] [DEBUG] [LOCAL     ] DNA: Loaded 48871 existing records from primary storage.
[2025-10-24T01:20:44.018429] [INFO ] [MAIN      ] DNA: Loaded 48871 primary data records.
[2025-10-24T01:20:44.032891] [DEBUG] [LOCAL     ] DNOW: Loaded 44058 existing records from primary storage.
[2025-10-24T01:20:44.064666] [INFO ] [MAIN      ] DNOW: Loaded 44058 primary data records.
[2025-10-24T01:20:44.653564] [DEBUG] [MAIN      ] DMO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:44.730332] [INFO ] [MAIN      ] DMO: Generated 139 derivative records from 9835 primary records.
[2025-10-24T01:20:44.731118] [DEBUG] [LOCAL     ] DMO: Saving derivative data.
[2025-10-24T01:20:44.730873] [DEBUG] [MAIN      ] DNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:44.748290] [DEBUG] [MAIN      ] DNA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:44.779154] [DEBUG] [LOCAL     ] DMO: Derivative data saved (139 records).
[2025-10-24T01:20:44.782889] [INFO ] [MAIN      ] DMO: Successfully saved derivative data.
[2025-10-24T01:20:44.786095] [INFO ] [MAIN      ] Derivative Progress: 574/2164 symbols completed. DMO took 1.1s. Estimated remaining: 11m 15s. Rate: 141.3 symbols/min
[2025-10-24T01:20:44.789549] [INFO ] [MAIN      ] DNP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:44.814892] [INFO ] [MAIN      ] DNOW: Generated 139 derivative records from 44058 primary records.
[2025-10-24T01:20:44.824822] [DEBUG] [LOCAL     ] DNOW: Saving derivative data.
[2025-10-24T01:20:44.843817] [INFO ] [MAIN      ] DNA: Generated 139 derivative records from 48871 primary records.
[2025-10-24T01:20:44.855839] [DEBUG] [LOCAL     ] DNA: Saving derivative data.
[2025-10-24T01:20:44.858347] [DEBUG] [LOCAL     ] DNP: Loaded 33207 existing records from primary storage.
[2025-10-24T01:20:44.857067] [DEBUG] [LOCAL     ] DNOW: Derivative data saved (139 records).
[2025-10-24T01:20:44.866045] [INFO ] [MAIN      ] DNOW: Successfully saved derivative data.
[2025-10-24T01:20:44.870144] [DEBUG] [LOCAL     ] DNA: Derivative data saved (139 records).
[2025-10-24T01:20:44.858762] [INFO ] [MAIN      ] DNP: Loaded 33207 primary data records.
[2025-10-24T01:20:44.884937] [INFO ] [MAIN      ] Derivative Progress: 575/2164 symbols completed. DNOW took 1.2s. Estimated remaining: 11m 14s. Rate: 141.5 symbols/min
[2025-10-24T01:20:44.909622] [INFO ] [MAIN      ] DNA: Successfully saved derivative data.
[2025-10-24T01:20:44.942081] [INFO ] [MAIN      ] DOC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:44.944765] [INFO ] [MAIN      ] Derivative Progress: 576/2164 symbols completed. DNA took 1.3s. Estimated remaining: 11m 12s. Rate: 141.7 symbols/min
[2025-10-24T01:20:44.967822] [INFO ] [MAIN      ] DOCN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:45.266303] [DEBUG] [LOCAL     ] DOC: Loaded 53944 existing records from primary storage.
[2025-10-24T01:20:45.266723] [INFO ] [MAIN      ] DOC: Loaded 53944 primary data records.
[2025-10-24T01:20:45.364124] [DEBUG] [LOCAL     ] DOCN: Loaded 51493 existing records from primary storage.
[2025-10-24T01:20:45.369612] [DEBUG] [MAIN      ] DNP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:45.395076] [INFO ] [MAIN      ] DOCN: Loaded 51493 primary data records.
[2025-10-24T01:20:45.991126] [INFO ] [MAIN      ] DNP: Generated 139 derivative records from 33207 primary records.
[2025-10-24T01:20:45.992500] [DEBUG] [LOCAL     ] DNP: Saving derivative data.
[2025-10-24T01:20:46.007805] [DEBUG] [LOCAL     ] DNP: Derivative data saved (139 records).
[2025-10-24T01:20:46.009311] [INFO ] [MAIN      ] DNP: Successfully saved derivative data.
[2025-10-24T01:20:46.025092] [INFO ] [MAIN      ] Derivative Progress: 577/2164 symbols completed. DNP took 1.2s. Estimated remaining: 11m 14s. Rate: 141.3 symbols/min
[2025-10-24T01:20:46.025535] [DEBUG] [MAIN      ] DOC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:46.026326] [INFO ] [MAIN      ] DOCS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:46.058393] [DEBUG] [MAIN      ] DOCN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:46.119615] [INFO ] [MAIN      ] DOC: Generated 139 derivative records from 53944 primary records.
[2025-10-24T01:20:46.120529] [DEBUG] [LOCAL     ] DOC: Saving derivative data.
[2025-10-24T01:20:46.155870] [DEBUG] [LOCAL     ] DOC: Derivative data saved (139 records).
[2025-10-24T01:20:46.156601] [INFO ] [MAIN      ] DOC: Successfully saved derivative data.
[2025-10-24T01:20:46.159755] [INFO ] [MAIN      ] Derivative Progress: 578/2164 symbols completed. DOC took 1.2s. Estimated remaining: 11m 13s. Rate: 141.5 symbols/min
[2025-10-24T01:20:46.160029] [INFO ] [MAIN      ] DOLE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:46.163690] [DEBUG] [LOCAL     ] DOCS: Loaded 50676 existing records from primary storage.
[2025-10-24T01:20:46.164071] [INFO ] [MAIN      ] DOCS: Loaded 50676 primary data records.
[2025-10-24T01:20:46.268205] [INFO ] [MAIN      ] DOCN: Generated 139 derivative records from 51493 primary records.
[2025-10-24T01:20:46.279441] [DEBUG] [LOCAL     ] DOCN: Saving derivative data.
[2025-10-24T01:20:46.499241] [DEBUG] [LOCAL     ] DOCN: Derivative data saved (139 records).
[2025-10-24T01:20:46.510569] [INFO ] [MAIN      ] DOCN: Successfully saved derivative data.
[2025-10-24T01:20:46.513950] [INFO ] [MAIN      ] Derivative Progress: 579/2164 symbols completed. DOCN took 1.5s. Estimated remaining: 11m 12s. Rate: 141.5 symbols/min
[2025-10-24T01:20:46.515804] [DEBUG] [LOCAL     ] DOLE: Loaded 39389 existing records from primary storage.
[2025-10-24T01:20:46.516108] [INFO ] [MAIN      ] DOLE: Loaded 39389 primary data records.
[2025-10-24T01:20:46.516242] [INFO ] [MAIN      ] DOUG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:46.837501] [DEBUG] [LOCAL     ] DOUG: Loaded 33959 existing records from primary storage.
[2025-10-24T01:20:46.839021] [INFO ] [MAIN      ] DOUG: Loaded 33959 primary data records.
[2025-10-24T01:20:47.010511] [DEBUG] [MAIN      ] DOCS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:47.287206] [DEBUG] [MAIN      ] DOLE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:47.321510] [INFO ] [MAIN      ] DOCS: Generated 139 derivative records from 50676 primary records.
[2025-10-24T01:20:47.326304] [DEBUG] [LOCAL     ] DOCS: Saving derivative data.
[2025-10-24T01:20:47.342169] [DEBUG] [LOCAL     ] DOCS: Derivative data saved (139 records).
[2025-10-24T01:20:47.342468] [INFO ] [MAIN      ] DOCS: Successfully saved derivative data.
[2025-10-24T01:20:47.353119] [INFO ] [MAIN      ] Derivative Progress: 580/2164 symbols completed. DOCS took 1.3s. Estimated remaining: 11m 13s. Rate: 141.3 symbols/min
[2025-10-24T01:20:47.359126] [INFO ] [MAIN      ] DOV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:47.358866] [DEBUG] [MAIN      ] DOUG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:47.395821] [INFO ] [MAIN      ] DOLE: Generated 139 derivative records from 39389 primary records.
[2025-10-24T01:20:47.397526] [DEBUG] [LOCAL     ] DOLE: Saving derivative data.
[2025-10-24T01:20:47.415706] [DEBUG] [LOCAL     ] DOLE: Derivative data saved (139 records).
[2025-10-24T01:20:47.416031] [INFO ] [MAIN      ] DOLE: Successfully saved derivative data.
[2025-10-24T01:20:47.418994] [INFO ] [MAIN      ] Derivative Progress: 581/2164 symbols completed. DOLE took 1.3s. Estimated remaining: 11m 11s. Rate: 141.5 symbols/min
[2025-10-24T01:20:47.432164] [INFO ] [MAIN      ] DOW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:47.436249] [INFO ] [MAIN      ] DOUG: Generated 139 derivative records from 33959 primary records.
[2025-10-24T01:20:47.436364] [DEBUG] [LOCAL     ] DOUG: Saving derivative data.
[2025-10-24T01:20:47.448583] [DEBUG] [LOCAL     ] DOUG: Derivative data saved (139 records).
[2025-10-24T01:20:47.448851] [INFO ] [MAIN      ] DOUG: Successfully saved derivative data.
[2025-10-24T01:20:47.454312] [INFO ] [MAIN      ] Derivative Progress: 582/2164 symbols completed. DOUG took 0.9s. Estimated remaining: 11m 10s. Rate: 141.7 symbols/min
[2025-10-24T01:20:47.454898] [INFO ] [MAIN      ] DPG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:47.469674] [DEBUG] [LOCAL     ] DOV: Loaded 45957 existing records from primary storage.
[2025-10-24T01:20:47.470103] [INFO ] [MAIN      ] DOV: Loaded 45957 primary data records.
[2025-10-24T01:20:47.595053] [DEBUG] [LOCAL     ] DPG: Loaded 13421 existing records from primary storage.
[2025-10-24T01:20:47.638065] [INFO ] [MAIN      ] DPG: Loaded 13421 primary data records.
[2025-10-24T01:20:47.924942] [DEBUG] [LOCAL     ] DOW: Loaded 54123 existing records from primary storage.
[2025-10-24T01:20:47.946421] [INFO ] [MAIN      ] DOW: Loaded 54123 primary data records.
[2025-10-24T01:20:48.449275] [DEBUG] [MAIN      ] DOV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:48.495597] [DEBUG] [MAIN      ] DPG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:48.547823] [INFO ] [MAIN      ] DOV: Generated 139 derivative records from 45957 primary records.
[2025-10-24T01:20:48.547610] [DEBUG] [MAIN      ] DOW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:48.559870] [DEBUG] [LOCAL     ] DOV: Saving derivative data.
[2025-10-24T01:20:48.579275] [DEBUG] [LOCAL     ] DOV: Derivative data saved (139 records).
[2025-10-24T01:20:48.581065] [INFO ] [MAIN      ] DOV: Successfully saved derivative data.
[2025-10-24T01:20:48.586076] [INFO ] [MAIN      ] Derivative Progress: 583/2164 symbols completed. DOV took 1.2s. Estimated remaining: 11m 11s. Rate: 141.3 symbols/min
[2025-10-24T01:20:48.599266] [INFO ] [MAIN      ] DPG: Generated 139 derivative records from 13421 primary records.
[2025-10-24T01:20:48.601482] [DEBUG] [LOCAL     ] DPG: Saving derivative data.
[2025-10-24T01:20:48.618580] [DEBUG] [LOCAL     ] DPG: Derivative data saved (139 records).
[2025-10-24T01:20:48.619066] [INFO ] [MAIN      ] DPG: Successfully saved derivative data.
[2025-10-24T01:20:48.622403] [INFO ] [MAIN      ] Derivative Progress: 584/2164 symbols completed. DPG took 1.2s. Estimated remaining: 11m 10s. Rate: 141.5 symbols/min
[2025-10-24T01:20:48.624499] [INFO ] [MAIN      ] DOW: Generated 139 derivative records from 54123 primary records.
[2025-10-24T01:20:48.624821] [DEBUG] [LOCAL     ] DOW: Saving derivative data.
[2025-10-24T01:20:48.636781] [DEBUG] [LOCAL     ] DOW: Derivative data saved (139 records).
[2025-10-24T01:20:48.636871] [INFO ] [MAIN      ] DOW: Successfully saved derivative data.
[2025-10-24T01:20:48.639865] [INFO ] [MAIN      ] Derivative Progress: 585/2164 symbols completed. DOW took 1.2s. Estimated remaining: 11m 8s. Rate: 141.8 symbols/min
[2025-10-24T01:20:48.640375] [INFO ] [MAIN      ] DQ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:48.640444] [INFO ] [MAIN      ] DRH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:48.640520] [INFO ] [MAIN      ] DRD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:48.742957] [DEBUG] [LOCAL     ] DQ: Loaded 44070 existing records from primary storage.
[2025-10-24T01:20:48.741200] [DEBUG] [LOCAL     ] DRD: Loaded 38203 existing records from primary storage.
[2025-10-24T01:20:48.743160] [INFO ] [MAIN      ] DQ: Loaded 44070 primary data records.
[2025-10-24T01:20:48.743382] [INFO ] [MAIN      ] DRD: Loaded 38203 primary data records.
[2025-10-24T01:20:48.744346] [DEBUG] [LOCAL     ] DRH: Loaded 50624 existing records from primary storage.
[2025-10-24T01:20:48.756612] [INFO ] [MAIN      ] DRH: Loaded 50624 primary data records.
[2025-10-24T01:20:49.772982] [DEBUG] [MAIN      ] DQ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:49.818916] [DEBUG] [MAIN      ] DRH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:49.847445] [DEBUG] [MAIN      ] DRD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:49.876033] [INFO ] [MAIN      ] DQ: Generated 139 derivative records from 44070 primary records.
[2025-10-24T01:20:49.880504] [DEBUG] [LOCAL     ] DQ: Saving derivative data.
[2025-10-24T01:20:49.897918] [DEBUG] [LOCAL     ] DQ: Derivative data saved (139 records).
[2025-10-24T01:20:49.901949] [INFO ] [MAIN      ] DQ: Successfully saved derivative data.
[2025-10-24T01:20:49.906567] [INFO ] [MAIN      ] Derivative Progress: 586/2164 symbols completed. DQ took 1.3s. Estimated remaining: 11m 10s. Rate: 141.3 symbols/min
[2025-10-24T01:20:49.907036] [INFO ] [MAIN      ] DRI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:49.926300] [INFO ] [MAIN      ] DRH: Generated 139 derivative records from 50624 primary records.
[2025-10-24T01:20:49.928087] [DEBUG] [LOCAL     ] DRH: Saving derivative data.
[2025-10-24T01:20:49.928609] [INFO ] [MAIN      ] DRD: Generated 139 derivative records from 38203 primary records.
[2025-10-24T01:20:49.929507] [DEBUG] [LOCAL     ] DRD: Saving derivative data.
[2025-10-24T01:20:49.956759] [DEBUG] [LOCAL     ] DRH: Derivative data saved (139 records).
[2025-10-24T01:20:49.959410] [DEBUG] [LOCAL     ] DRD: Derivative data saved (139 records).
[2025-10-24T01:20:49.959624] [INFO ] [MAIN      ] DRD: Successfully saved derivative data.
[2025-10-24T01:20:49.959507] [INFO ] [MAIN      ] DRH: Successfully saved derivative data.
[2025-10-24T01:20:49.962942] [INFO ] [MAIN      ] Derivative Progress: 587/2164 symbols completed. DRD took 1.3s. Estimated remaining: 11m 9s. Rate: 141.5 symbols/min
[2025-10-24T01:20:49.963284] [INFO ] [MAIN      ] DRLL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:49.966321] [INFO ] [MAIN      ] Derivative Progress: 588/2164 symbols completed. DRH took 1.3s. Estimated remaining: 11m 7s. Rate: 141.7 symbols/min
[2025-10-24T01:20:49.966657] [INFO ] [MAIN      ] DSL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:49.991551] [DEBUG] [LOCAL     ] DRLL: Loaded 8648 existing records from primary storage.
[2025-10-24T01:20:49.992488] [INFO ] [MAIN      ] DRLL: Loaded 8648 primary data records.
[2025-10-24T01:20:50.052729] [DEBUG] [LOCAL     ] DRI: Loaded 47825 existing records from primary storage.
[2025-10-24T01:20:50.065294] [INFO ] [MAIN      ] DRI: Loaded 47825 primary data records.
[2025-10-24T01:20:50.261306] [DEBUG] [LOCAL     ] DSL: Loaded 29120 existing records from primary storage.
[2025-10-24T01:20:50.432196] [INFO ] [MAIN      ] DSL: Loaded 29120 primary data records.
[2025-10-24T01:20:51.004363] [DEBUG] [MAIN      ] DRLL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:51.034880] [DEBUG] [MAIN      ] DRI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:51.105866] [DEBUG] [MAIN      ] DSL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:51.130146] [INFO ] [MAIN      ] DRLL: Generated 139 derivative records from 8648 primary records.
[2025-10-24T01:20:51.132493] [DEBUG] [LOCAL     ] DRLL: Saving derivative data.
[2025-10-24T01:20:51.135442] [INFO ] [MAIN      ] DRI: Generated 139 derivative records from 47825 primary records.
[2025-10-24T01:20:51.139210] [DEBUG] [LOCAL     ] DRI: Saving derivative data.
[2025-10-24T01:20:51.151411] [DEBUG] [LOCAL     ] DRLL: Derivative data saved (139 records).
[2025-10-24T01:20:51.154045] [INFO ] [MAIN      ] DRLL: Successfully saved derivative data.
[2025-10-24T01:20:51.171828] [DEBUG] [LOCAL     ] DRI: Derivative data saved (139 records).
[2025-10-24T01:20:51.172038] [INFO ] [MAIN      ] DRI: Successfully saved derivative data.
[2025-10-24T01:20:51.170371] [INFO ] [MAIN      ] Derivative Progress: 589/2164 symbols completed. DRLL took 1.2s. Estimated remaining: 11m 9s. Rate: 141.3 symbols/min
[2025-10-24T01:20:51.172373] [INFO ] [MAIN      ] DSM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:51.175350] [INFO ] [MAIN      ] Derivative Progress: 590/2164 symbols completed. DRI took 1.3s. Estimated remaining: 11m 7s. Rate: 141.5 symbols/min
[2025-10-24T01:20:51.175878] [INFO ] [MAIN      ] DSMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:51.192610] [DEBUG] [LOCAL     ] DSMC: Loaded 1780 existing records from primary storage.
[2025-10-24T01:20:51.196963] [INFO ] [MAIN      ] DSL: Generated 139 derivative records from 29120 primary records.
[2025-10-24T01:20:51.197397] [DEBUG] [LOCAL     ] DSL: Saving derivative data.
[2025-10-24T01:20:51.197261] [INFO ] [MAIN      ] DSMC: Loaded 1780 primary data records.
[2025-10-24T01:20:51.237157] [DEBUG] [LOCAL     ] DSM: Loaded 14223 existing records from primary storage.
[2025-10-24T01:20:51.281678] [INFO ] [MAIN      ] DSM: Loaded 14223 primary data records.
[2025-10-24T01:20:51.399578] [DEBUG] [LOCAL     ] DSL: Derivative data saved (139 records).
[2025-10-24T01:20:51.443682] [INFO ] [MAIN      ] DSL: Successfully saved derivative data.
[2025-10-24T01:20:51.479136] [INFO ] [MAIN      ] Derivative Progress: 591/2164 symbols completed. DSL took 1.5s. Estimated remaining: 11m 7s. Rate: 141.6 symbols/min
[2025-10-24T01:20:51.557803] [INFO ] [MAIN      ] DSU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:51.892024] [DEBUG] [LOCAL     ] DSU: Loaded 22973 existing records from primary storage.
[2025-10-24T01:20:51.893695] [INFO ] [MAIN      ] DSU: Loaded 22973 primary data records.
[2025-10-24T01:20:51.985556] [DEBUG] [MAIN      ] DSMC: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:20:52.242456] [DEBUG] [MAIN      ] DSM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:52.291855] [INFO ] [MAIN      ] DSMC: Generated 139 derivative records from 1780 primary records.
[2025-10-24T01:20:52.295045] [DEBUG] [LOCAL     ] DSMC: Saving derivative data.
[2025-10-24T01:20:52.321678] [DEBUG] [LOCAL     ] DSMC: Derivative data saved (139 records).
[2025-10-24T01:20:52.322465] [DEBUG] [MAIN      ] DSU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:52.322680] [INFO ] [MAIN      ] DSMC: Successfully saved derivative data.
[2025-10-24T01:20:52.336810] [INFO ] [MAIN      ] Derivative Progress: 592/2164 symbols completed. DSMC took 1.2s. Estimated remaining: 11m 7s. Rate: 141.4 symbols/min
[2025-10-24T01:20:52.341203] [INFO ] [MAIN      ] DSX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:52.346484] [INFO ] [MAIN      ] DSM: Generated 139 derivative records from 14223 primary records.
[2025-10-24T01:20:52.349957] [DEBUG] [LOCAL     ] DSM: Saving derivative data.
[2025-10-24T01:20:52.363221] [DEBUG] [LOCAL     ] DSM: Derivative data saved (139 records).
[2025-10-24T01:20:52.363463] [INFO ] [MAIN      ] DSM: Successfully saved derivative data.
[2025-10-24T01:20:52.367060] [INFO ] [MAIN      ] Derivative Progress: 593/2164 symbols completed. DSM took 1.2s. Estimated remaining: 11m 6s. Rate: 141.6 symbols/min
[2025-10-24T01:20:52.369014] [INFO ] [MAIN      ] DT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:52.392029] [DEBUG] [LOCAL     ] DSX: Loaded 23599 existing records from primary storage.
[2025-10-24T01:20:52.393373] [INFO ] [MAIN      ] DSX: Loaded 23599 primary data records.
[2025-10-24T01:20:52.433108] [INFO ] [MAIN      ] DSU: Generated 139 derivative records from 22973 primary records.
[2025-10-24T01:20:52.466799] [DEBUG] [LOCAL     ] DSU: Saving derivative data.
[2025-10-24T01:20:52.552322] [DEBUG] [LOCAL     ] DSU: Derivative data saved (139 records).
[2025-10-24T01:20:52.604260] [INFO ] [MAIN      ] DSU: Successfully saved derivative data.
[2025-10-24T01:20:52.734149] [INFO ] [MAIN      ] Derivative Progress: 594/2164 symbols completed. DSU took 1.2s. Estimated remaining: 11m 5s. Rate: 141.6 symbols/min
[2025-10-24T01:20:52.757860] [INFO ] [MAIN      ] DTB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:52.760306] [DEBUG] [LOCAL     ] DT: Loaded 53332 existing records from primary storage.
[2025-10-24T01:20:52.760965] [INFO ] [MAIN      ] DT: Loaded 53332 primary data records.
[2025-10-24T01:20:52.861897] [DEBUG] [LOCAL     ] DTB: Loaded 4918 existing records from primary storage.
[2025-10-24T01:20:52.879098] [INFO ] [MAIN      ] DTB: Loaded 4918 primary data records.
[2025-10-24T01:20:53.442750] [DEBUG] [MAIN      ] DSX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:53.484185] [DEBUG] [MAIN      ] DT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:53.520429] [DEBUG] [MAIN      ] DTB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:53.551613] [INFO ] [MAIN      ] DSX: Generated 139 derivative records from 23599 primary records.
[2025-10-24T01:20:53.554546] [DEBUG] [LOCAL     ] DSX: Saving derivative data.
[2025-10-24T01:20:53.575233] [DEBUG] [LOCAL     ] DSX: Derivative data saved (139 records).
[2025-10-24T01:20:53.580981] [INFO ] [MAIN      ] DSX: Successfully saved derivative data.
[2025-10-24T01:20:53.583568] [INFO ] [MAIN      ] Derivative Progress: 595/2164 symbols completed. DSX took 1.2s. Estimated remaining: 11m 6s. Rate: 141.4 symbols/min
[2025-10-24T01:20:53.585274] [INFO ] [MAIN      ] DTE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:53.603325] [INFO ] [MAIN      ] DT: Generated 139 derivative records from 53332 primary records.
[2025-10-24T01:20:53.605429] [DEBUG] [LOCAL     ] DT: Saving derivative data.
[2025-10-24T01:20:53.605681] [INFO ] [MAIN      ] DTB: Generated 139 derivative records from 4918 primary records.
[2025-10-24T01:20:53.606528] [DEBUG] [LOCAL     ] DTB: Saving derivative data.
[2025-10-24T01:20:53.625977] [DEBUG] [LOCAL     ] DT: Derivative data saved (139 records).
[2025-10-24T01:20:53.629871] [INFO ] [MAIN      ] DT: Successfully saved derivative data.
[2025-10-24T01:20:53.630503] [DEBUG] [LOCAL     ] DTB: Derivative data saved (139 records).
[2025-10-24T01:20:53.630745] [INFO ] [MAIN      ] DTB: Successfully saved derivative data.
[2025-10-24T01:20:53.633356] [INFO ] [MAIN      ] Derivative Progress: 596/2164 symbols completed. DT took 1.3s. Estimated remaining: 11m 5s. Rate: 141.6 symbols/min
[2025-10-24T01:20:53.647133] [INFO ] [MAIN      ] DTG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:53.647234] [INFO ] [MAIN      ] Derivative Progress: 597/2164 symbols completed. DTB took 0.9s. Estimated remaining: 11m 3s. Rate: 141.8 symbols/min
[2025-10-24T01:20:53.648120] [INFO ] [MAIN      ] DTM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:53.659382] [DEBUG] [LOCAL     ] DTG: Loaded 5709 existing records from primary storage.
[2025-10-24T01:20:53.660102] [INFO ] [MAIN      ] DTG: Loaded 5709 primary data records.
[2025-10-24T01:20:53.713013] [DEBUG] [LOCAL     ] DTE: Loaded 47417 existing records from primary storage.
[2025-10-24T01:20:53.741186] [INFO ] [MAIN      ] DTE: Loaded 47417 primary data records.
[2025-10-24T01:20:54.144511] [DEBUG] [LOCAL     ] DTM: Loaded 44045 existing records from primary storage.
[2025-10-24T01:20:54.187271] [INFO ] [MAIN      ] DTM: Loaded 44045 primary data records.
[2025-10-24T01:20:54.668305] [DEBUG] [MAIN      ] DTG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:54.667834] [DEBUG] [MAIN      ] DTE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:54.731307] [DEBUG] [MAIN      ] DTM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:54.774430] [INFO ] [MAIN      ] DTE: Generated 139 derivative records from 47417 primary records.
[2025-10-24T01:20:54.777205] [DEBUG] [LOCAL     ] DTE: Saving derivative data.
[2025-10-24T01:20:54.794307] [INFO ] [MAIN      ] DTG: Generated 139 derivative records from 5709 primary records.
[2025-10-24T01:20:54.795440] [DEBUG] [LOCAL     ] DTE: Derivative data saved (139 records).
[2025-10-24T01:20:54.795858] [DEBUG] [LOCAL     ] DTG: Saving derivative data.
[2025-10-24T01:20:54.795718] [INFO ] [MAIN      ] DTE: Successfully saved derivative data.
[2025-10-24T01:20:54.799682] [INFO ] [MAIN      ] Derivative Progress: 598/2164 symbols completed. DTE took 1.2s. Estimated remaining: 11m 4s. Rate: 141.4 symbols/min
[2025-10-24T01:20:54.814685] [DEBUG] [LOCAL     ] DTG: Derivative data saved (139 records).
[2025-10-24T01:20:54.814815] [INFO ] [MAIN      ] DTG: Successfully saved derivative data.
[2025-10-24T01:20:54.817376] [INFO ] [MAIN      ] Derivative Progress: 599/2164 symbols completed. DTG took 1.2s. Estimated remaining: 11m 3s. Rate: 141.6 symbols/min
[2025-10-24T01:20:54.823681] [INFO ] [MAIN      ] DTM: Generated 139 derivative records from 44045 primary records.
[2025-10-24T01:20:54.823771] [DEBUG] [LOCAL     ] DTM: Saving derivative data.
[2025-10-24T01:20:54.835992] [DEBUG] [LOCAL     ] DTM: Derivative data saved (139 records).
[2025-10-24T01:20:54.836071] [INFO ] [MAIN      ] DTM: Successfully saved derivative data.
[2025-10-24T01:20:54.839041] [INFO ] [MAIN      ] Derivative Progress: 600/2164 symbols completed. DTM took 1.2s. Estimated remaining: 11m 2s. Rate: 141.9 symbols/min
[2025-10-24T01:20:54.839574] [INFO ] [MAIN      ] DTW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:54.839682] [INFO ] [MAIN      ] DUK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:54.839732] [INFO ] [MAIN      ] DUKB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:54.856882] [DEBUG] [LOCAL     ] DUKB: Loaded 6161 existing records from primary storage.
[2025-10-24T01:20:54.857248] [DEBUG] [LOCAL     ] DTW: Loaded 4737 existing records from primary storage.
[2025-10-24T01:20:54.857494] [INFO ] [MAIN      ] DUKB: Loaded 6161 primary data records.
[2025-10-24T01:20:54.857824] [INFO ] [MAIN      ] DTW: Loaded 4737 primary data records.
[2025-10-24T01:20:55.554542] [DEBUG] [LOCAL     ] DUK: Loaded 53818 existing records from primary storage.
[2025-10-24T01:20:55.556000] [INFO ] [MAIN      ] DUK: Loaded 53818 primary data records.
[2025-10-24T01:20:55.895022] [DEBUG] [MAIN      ] DTW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:55.895815] [DEBUG] [MAIN      ] DUKB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:55.963029] [DEBUG] [MAIN      ] DUK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:55.996927] [INFO ] [MAIN      ] DTW: Generated 139 derivative records from 4737 primary records.
[2025-10-24T01:20:55.999242] [DEBUG] [LOCAL     ] DTW: Saving derivative data.
[2025-10-24T01:20:56.000572] [INFO ] [MAIN      ] DUKB: Generated 139 derivative records from 6161 primary records.
[2025-10-24T01:20:56.001296] [DEBUG] [LOCAL     ] DUKB: Saving derivative data.
[2025-10-24T01:20:56.026158] [DEBUG] [LOCAL     ] DUKB: Derivative data saved (139 records).
[2025-10-24T01:20:56.023585] [DEBUG] [LOCAL     ] DTW: Derivative data saved (139 records).
[2025-10-24T01:20:56.026470] [INFO ] [MAIN      ] DTW: Successfully saved derivative data.
[2025-10-24T01:20:56.026310] [INFO ] [MAIN      ] DUKB: Successfully saved derivative data.
[2025-10-24T01:20:56.030887] [INFO ] [MAIN      ] Derivative Progress: 601/2164 symbols completed. DUKB took 1.2s. Estimated remaining: 11m 3s. Rate: 141.4 symbols/min
[2025-10-24T01:20:56.034294] [INFO ] [MAIN      ] Derivative Progress: 602/2164 symbols completed. DTW took 1.2s. Estimated remaining: 11m 2s. Rate: 141.7 symbols/min
[2025-10-24T01:20:56.034218] [INFO ] [MAIN      ] DV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:56.034639] [INFO ] [MAIN      ] DVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:56.044754] [INFO ] [MAIN      ] DUK: Generated 139 derivative records from 53818 primary records.
[2025-10-24T01:20:56.045117] [DEBUG] [LOCAL     ] DUK: Saving derivative data.
[2025-10-24T01:20:56.058021] [DEBUG] [LOCAL     ] DUK: Derivative data saved (139 records).
[2025-10-24T01:20:56.058187] [INFO ] [MAIN      ] DUK: Successfully saved derivative data.
[2025-10-24T01:20:56.060462] [INFO ] [MAIN      ] Derivative Progress: 603/2164 symbols completed. DUK took 1.2s. Estimated remaining: 11m 0s. Rate: 141.9 symbols/min
[2025-10-24T01:20:56.060745] [INFO ] [MAIN      ] DVN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:56.126464] [DEBUG] [LOCAL     ] DVA: Loaded 40950 existing records from primary storage.
[2025-10-24T01:20:56.126810] [INFO ] [MAIN      ] DVA: Loaded 40950 primary data records.
[2025-10-24T01:20:56.268226] [DEBUG] [LOCAL     ] DV: Loaded 51625 existing records from primary storage.
[2025-10-24T01:20:56.285138] [DEBUG] [LOCAL     ] DVN: Loaded 54089 existing records from primary storage.
[2025-10-24T01:20:56.295669] [INFO ] [MAIN      ] DVN: Loaded 54089 primary data records.
[2025-10-24T01:20:56.295887] [INFO ] [MAIN      ] DV: Loaded 51625 primary data records.
[2025-10-24T01:20:57.101360] [DEBUG] [MAIN      ] DVA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:57.137612] [DEBUG] [MAIN      ] DVN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:57.184183] [DEBUG] [MAIN      ] DV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:57.219545] [INFO ] [MAIN      ] DVA: Generated 139 derivative records from 40950 primary records.
[2025-10-24T01:20:57.220060] [DEBUG] [LOCAL     ] DVA: Saving derivative data.
[2025-10-24T01:20:57.245001] [DEBUG] [LOCAL     ] DVA: Derivative data saved (139 records).
[2025-10-24T01:20:57.245737] [INFO ] [MAIN      ] DVA: Successfully saved derivative data.
[2025-10-24T01:20:57.248230] [INFO ] [MAIN      ] Derivative Progress: 604/2164 symbols completed. DVA took 1.2s. Estimated remaining: 11m 2s. Rate: 141.5 symbols/min
[2025-10-24T01:20:57.248683] [INFO ] [MAIN      ] DX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:57.261148] [INFO ] [MAIN      ] DVN: Generated 139 derivative records from 54089 primary records.
[2025-10-24T01:20:57.263678] [DEBUG] [LOCAL     ] DVN: Saving derivative data.
[2025-10-24T01:20:57.277502] [DEBUG] [LOCAL     ] DVN: Derivative data saved (139 records).
[2025-10-24T01:20:57.279699] [INFO ] [MAIN      ] DV: Generated 139 derivative records from 51625 primary records.
[2025-10-24T01:20:57.279909] [DEBUG] [LOCAL     ] DV: Saving derivative data.
[2025-10-24T01:20:57.277905] [INFO ] [MAIN      ] DVN: Successfully saved derivative data.
[2025-10-24T01:20:57.282266] [INFO ] [MAIN      ] Derivative Progress: 605/2164 symbols completed. DVN took 1.2s. Estimated remaining: 11m 0s. Rate: 141.7 symbols/min
[2025-10-24T01:20:57.282537] [INFO ] [MAIN      ] DXC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:57.297945] [DEBUG] [LOCAL     ] DV: Derivative data saved (139 records).
[2025-10-24T01:20:57.298257] [INFO ] [MAIN      ] DV: Successfully saved derivative data.
[2025-10-24T01:20:57.302369] [INFO ] [MAIN      ] Derivative Progress: 606/2164 symbols completed. DV took 1.3s. Estimated remaining: 10m 59s. Rate: 141.9 symbols/min
[2025-10-24T01:20:57.302770] [INFO ] [MAIN      ] DXYZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:57.353353] [DEBUG] [LOCAL     ] DX: Loaded 52920 existing records from primary storage.
[2025-10-24T01:20:57.361162] [INFO ] [MAIN      ] DX: Loaded 52920 primary data records.
[2025-10-24T01:20:57.491126] [DEBUG] [LOCAL     ] DXC: Loaded 50264 existing records from primary storage.
[2025-10-24T01:20:57.491436] [INFO ] [MAIN      ] DXC: Loaded 50264 primary data records.
[2025-10-24T01:20:57.524316] [DEBUG] [LOCAL     ] DXYZ: Loaded 37304 existing records from primary storage.
[2025-10-24T01:20:57.551585] [INFO ] [MAIN      ] DXYZ: Loaded 37304 primary data records.
[2025-10-24T01:20:58.332053] [DEBUG] [MAIN      ] DX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:58.386961] [DEBUG] [MAIN      ] DXYZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:58.386690] [DEBUG] [MAIN      ] DXC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:58.440873] [INFO ] [MAIN      ] DX: Generated 139 derivative records from 52920 primary records.
[2025-10-24T01:20:58.442251] [DEBUG] [LOCAL     ] DX: Saving derivative data.
[2025-10-24T01:20:58.460607] [DEBUG] [LOCAL     ] DX: Derivative data saved (139 records).
[2025-10-24T01:20:58.463717] [INFO ] [MAIN      ] DX: Successfully saved derivative data.
[2025-10-24T01:20:58.466618] [INFO ] [MAIN      ] Derivative Progress: 607/2164 symbols completed. DX took 1.2s. Estimated remaining: 11m 0s. Rate: 141.5 symbols/min
[2025-10-24T01:20:58.467353] [INFO ] [MAIN      ] DY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:58.478569] [INFO ] [MAIN      ] DXYZ: Generated 139 derivative records from 37304 primary records.
[2025-10-24T01:20:58.480575] [INFO ] [MAIN      ] DXC: Generated 139 derivative records from 50264 primary records.
[2025-10-24T01:20:58.480918] [DEBUG] [LOCAL     ] DXC: Saving derivative data.
[2025-10-24T01:20:58.480980] [DEBUG] [LOCAL     ] DXYZ: Saving derivative data.
[2025-10-24T01:20:58.503508] [DEBUG] [LOCAL     ] DXC: Derivative data saved (139 records).
[2025-10-24T01:20:58.506667] [DEBUG] [LOCAL     ] DXYZ: Derivative data saved (139 records).
[2025-10-24T01:20:58.506981] [INFO ] [MAIN      ] DXYZ: Successfully saved derivative data.
[2025-10-24T01:20:58.509676] [INFO ] [MAIN      ] Derivative Progress: 608/2164 symbols completed. DXYZ took 1.2s. Estimated remaining: 10m 59s. Rate: 141.7 symbols/min
[2025-10-24T01:20:58.506800] [INFO ] [MAIN      ] DXC: Successfully saved derivative data.
[2025-10-24T01:20:58.516557] [INFO ] [MAIN      ] E: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:58.519166] [INFO ] [MAIN      ] Derivative Progress: 609/2164 symbols completed. DXC took 1.2s. Estimated remaining: 10m 57s. Rate: 141.9 symbols/min
[2025-10-24T01:20:58.519831] [INFO ] [MAIN      ] EAF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:58.534513] [DEBUG] [LOCAL     ] DY: Loaded 28151 existing records from primary storage.
[2025-10-24T01:20:58.534819] [INFO ] [MAIN      ] DY: Loaded 28151 primary data records.
[2025-10-24T01:20:58.869427] [DEBUG] [LOCAL     ] E: Loaded 33399 existing records from primary storage.
[2025-10-24T01:20:58.870411] [INFO ] [MAIN      ] E: Loaded 33399 primary data records.
[2025-10-24T01:20:58.870308] [DEBUG] [LOCAL     ] EAF: Loaded 41113 existing records from primary storage.
[2025-10-24T01:20:58.870889] [INFO ] [MAIN      ] EAF: Loaded 41113 primary data records.
[2025-10-24T01:20:59.495921] [DEBUG] [MAIN      ] DY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:59.555988] [DEBUG] [MAIN      ] EAF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:59.581218] [DEBUG] [MAIN      ] E: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:20:59.583875] [INFO ] [MAIN      ] DY: Generated 139 derivative records from 28151 primary records.
[2025-10-24T01:20:59.599066] [DEBUG] [LOCAL     ] DY: Saving derivative data.
[2025-10-24T01:20:59.614050] [DEBUG] [LOCAL     ] DY: Derivative data saved (139 records).
[2025-10-24T01:20:59.616923] [INFO ] [MAIN      ] DY: Successfully saved derivative data.
[2025-10-24T01:20:59.624558] [INFO ] [MAIN      ] Derivative Progress: 610/2164 symbols completed. DY took 1.2s. Estimated remaining: 10m 59s. Rate: 141.5 symbols/min
[2025-10-24T01:20:59.626661] [INFO ] [MAIN      ] EAI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:20:59.642538] [DEBUG] [LOCAL     ] EAI: Loaded 3938 existing records from primary storage.
[2025-10-24T01:20:59.647980] [INFO ] [MAIN      ] EAI: Loaded 3938 primary data records.
[2025-10-24T01:20:59.999839] [INFO ] [MAIN      ] EAF: Generated 139 derivative records from 41113 primary records.
[2025-10-24T01:21:00.000700] [INFO ] [MAIN      ] E: Generated 139 derivative records from 33399 primary records.
[2025-10-24T01:21:00.001128] [DEBUG] [LOCAL     ] EAF: Saving derivative data.
[2025-10-24T01:21:00.001188] [DEBUG] [LOCAL     ] E: Saving derivative data.
[2025-10-24T01:21:00.026982] [DEBUG] [LOCAL     ] EAF: Derivative data saved (139 records).
[2025-10-24T01:21:00.028331] [DEBUG] [LOCAL     ] E: Derivative data saved (139 records).
[2025-10-24T01:21:00.028895] [INFO ] [MAIN      ] E: Successfully saved derivative data.
[2025-10-24T01:21:00.029235] [INFO ] [MAIN      ] EAF: Successfully saved derivative data.
[2025-10-24T01:21:00.032563] [INFO ] [MAIN      ] Derivative Progress: 611/2164 symbols completed. E took 1.5s. Estimated remaining: 10m 58s. Rate: 141.6 symbols/min
[2025-10-24T01:21:00.032811] [INFO ] [MAIN      ] EARN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:00.036556] [INFO ] [MAIN      ] Derivative Progress: 612/2164 symbols completed. EAF took 1.5s. Estimated remaining: 10m 57s. Rate: 141.8 symbols/min
[2025-10-24T01:21:00.037695] [INFO ] [MAIN      ] EAT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:00.061567] [DEBUG] [MAIN      ] EAI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:00.111931] [DEBUG] [LOCAL     ] EARN: Loaded 27875 existing records from primary storage.
[2025-10-24T01:21:00.115532] [INFO ] [MAIN      ] EARN: Loaded 27875 primary data records.
[2025-10-24T01:21:00.266946] [DEBUG] [LOCAL     ] EAT: Loaded 50090 existing records from primary storage.
[2025-10-24T01:21:00.315039] [INFO ] [MAIN      ] EAT: Loaded 50090 primary data records.
[2025-10-24T01:21:00.430497] [INFO ] [MAIN      ] EAI: Generated 139 derivative records from 3938 primary records.
[2025-10-24T01:21:00.431234] [DEBUG] [LOCAL     ] EAI: Saving derivative data.
[2025-10-24T01:21:00.560407] [DEBUG] [LOCAL     ] EAI: Derivative data saved (139 records).
[2025-10-24T01:21:00.576009] [INFO ] [MAIN      ] EAI: Successfully saved derivative data.
[2025-10-24T01:21:00.591336] [INFO ] [MAIN      ] Derivative Progress: 613/2164 symbols completed. EAI took 1.0s. Estimated remaining: 10m 57s. Rate: 141.7 symbols/min
[2025-10-24T01:21:00.761576] [DEBUG] [MAIN      ] EARN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:00.796414] [INFO ] [MAIN      ] EARN: Generated 139 derivative records from 27875 primary records.
[2025-10-24T01:21:00.796771] [DEBUG] [LOCAL     ] EARN: Saving derivative data.
[2025-10-24T01:21:00.822453] [DEBUG] [LOCAL     ] EARN: Derivative data saved (139 records).
[2025-10-24T01:21:00.822900] [INFO ] [MAIN      ] EARN: Successfully saved derivative data.
[2025-10-24T01:21:00.822764] [DEBUG] [MAIN      ] EAT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:00.825444] [INFO ] [MAIN      ] Derivative Progress: 614/2164 symbols completed. EARN took 0.8s. Estimated remaining: 10m 56s. Rate: 141.8 symbols/min
[2025-10-24T01:21:00.851407] [INFO ] [MAIN      ] EAT: Generated 139 derivative records from 50090 primary records.
[2025-10-24T01:21:00.851519] [DEBUG] [LOCAL     ] EAT: Saving derivative data.
[2025-10-24T01:21:00.864166] [DEBUG] [LOCAL     ] EAT: Derivative data saved (139 records).
[2025-10-24T01:21:00.864269] [INFO ] [MAIN      ] EAT: Successfully saved derivative data.
[2025-10-24T01:21:00.866951] [INFO ] [MAIN      ] Derivative Progress: 615/2164 symbols completed. EAT took 0.8s. Estimated remaining: 10m 54s. Rate: 142.0 symbols/min
[2025-10-24T01:21:00.867395] [INFO ] [MAIN      ] EB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:00.867957] [INFO ] [MAIN      ] EBR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:00.867512] [INFO ] [MAIN      ] EBF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:00.909079] [DEBUG] [LOCAL     ] EB: Loaded 36426 existing records from primary storage.
[2025-10-24T01:21:00.915977] [DEBUG] [LOCAL     ] EBF: Loaded 19413 existing records from primary storage.
[2025-10-24T01:21:00.925320] [INFO ] [MAIN      ] EB: Loaded 36426 primary data records.
[2025-10-24T01:21:00.925403] [INFO ] [MAIN      ] EBF: Loaded 19413 primary data records.
[2025-10-24T01:21:01.146040] [DEBUG] [LOCAL     ] EBR: Loaded 43686 existing records from primary storage.
[2025-10-24T01:21:01.149743] [INFO ] [MAIN      ] EBR: Loaded 43686 primary data records.
[2025-10-24T01:21:01.944676] [DEBUG] [MAIN      ] EBF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:01.978748] [DEBUG] [MAIN      ] EB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:02.041304] [DEBUG] [MAIN      ] EBR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:02.082606] [INFO ] [MAIN      ] EBF: Generated 139 derivative records from 19413 primary records.
[2025-10-24T01:21:02.085974] [DEBUG] [LOCAL     ] EBF: Saving derivative data.
[2025-10-24T01:21:02.089217] [INFO ] [MAIN      ] EB: Generated 139 derivative records from 36426 primary records.
[2025-10-24T01:21:02.102108] [DEBUG] [LOCAL     ] EB: Saving derivative data.
[2025-10-24T01:21:02.105593] [DEBUG] [LOCAL     ] EBF: Derivative data saved (139 records).
[2025-10-24T01:21:02.107342] [INFO ] [MAIN      ] EBF: Successfully saved derivative data.
[2025-10-24T01:21:02.117706] [INFO ] [MAIN      ] Derivative Progress: 616/2164 symbols completed. EBF took 1.3s. Estimated remaining: 10m 56s. Rate: 141.6 symbols/min
[2025-10-24T01:21:02.126251] [INFO ] [MAIN      ] EBS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:02.126472] [DEBUG] [LOCAL     ] EB: Derivative data saved (139 records).
[2025-10-24T01:21:02.129081] [INFO ] [MAIN      ] EB: Successfully saved derivative data.
[2025-10-24T01:21:02.134929] [INFO ] [MAIN      ] Derivative Progress: 617/2164 symbols completed. EB took 1.3s. Estimated remaining: 10m 55s. Rate: 141.8 symbols/min
[2025-10-24T01:21:02.135936] [INFO ] [MAIN      ] EC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:02.140123] [INFO ] [MAIN      ] EBR: Generated 139 derivative records from 43686 primary records.
[2025-10-24T01:21:02.140373] [DEBUG] [LOCAL     ] EBR: Saving derivative data.
[2025-10-24T01:21:02.153060] [DEBUG] [LOCAL     ] EBR: Derivative data saved (139 records).
[2025-10-24T01:21:02.153324] [INFO ] [MAIN      ] EBR: Successfully saved derivative data.
[2025-10-24T01:21:02.157262] [INFO ] [MAIN      ] Derivative Progress: 618/2164 symbols completed. EBR took 1.3s. Estimated remaining: 10m 53s. Rate: 142.0 symbols/min
[2025-10-24T01:21:02.157630] [INFO ] [MAIN      ] ECAT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:02.211490] [DEBUG] [LOCAL     ] EBS: Loaded 46902 existing records from primary storage.
[2025-10-24T01:21:02.213092] [INFO ] [MAIN      ] EBS: Loaded 46902 primary data records.
[2025-10-24T01:21:02.274800] [DEBUG] [LOCAL     ] EC: Loaded 49210 existing records from primary storage.
[2025-10-24T01:21:02.298953] [INFO ] [MAIN      ] EC: Loaded 49210 primary data records.
[2025-10-24T01:21:02.345499] [DEBUG] [LOCAL     ] ECAT: Loaded 29317 existing records from primary storage.
[2025-10-24T01:21:02.408751] [INFO ] [MAIN      ] ECAT: Loaded 29317 primary data records.
[2025-10-24T01:21:03.252488] [DEBUG] [MAIN      ] EBS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:03.282169] [DEBUG] [MAIN      ] EC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:03.335501] [DEBUG] [MAIN      ] ECAT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:03.382463] [INFO ] [MAIN      ] EBS: Generated 139 derivative records from 46902 primary records.
[2025-10-24T01:21:03.384960] [INFO ] [MAIN      ] EC: Generated 139 derivative records from 49210 primary records.
[2025-10-24T01:21:03.386759] [DEBUG] [LOCAL     ] EC: Saving derivative data.
[2025-10-24T01:21:03.385154] [DEBUG] [LOCAL     ] EBS: Saving derivative data.
[2025-10-24T01:21:03.413349] [DEBUG] [LOCAL     ] EC: Derivative data saved (139 records).
[2025-10-24T01:21:03.413675] [INFO ] [MAIN      ] EC: Successfully saved derivative data.
[2025-10-24T01:21:03.419004] [INFO ] [MAIN      ] Derivative Progress: 619/2164 symbols completed. EC took 1.3s. Estimated remaining: 10m 55s. Rate: 141.6 symbols/min
[2025-10-24T01:21:03.421761] [DEBUG] [LOCAL     ] EBS: Derivative data saved (139 records).
[2025-10-24T01:21:03.422063] [INFO ] [MAIN      ] ECC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:03.422547] [INFO ] [MAIN      ] EBS: Successfully saved derivative data.
[2025-10-24T01:21:03.427192] [INFO ] [MAIN      ] Derivative Progress: 620/2164 symbols completed. EBS took 1.3s. Estimated remaining: 10m 53s. Rate: 141.8 symbols/min
[2025-10-24T01:21:03.428100] [INFO ] [MAIN      ] ECCU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:03.430816] [INFO ] [MAIN      ] ECAT: Generated 139 derivative records from 29317 primary records.
[2025-10-24T01:21:03.431069] [DEBUG] [LOCAL     ] ECAT: Saving derivative data.
[2025-10-24T01:21:03.435085] [DEBUG] [LOCAL     ] ECCU: Loaded 2156 existing records from primary storage.
[2025-10-24T01:21:03.444561] [INFO ] [MAIN      ] ECCU: Loaded 2156 primary data records.
[2025-10-24T01:21:03.484664] [DEBUG] [LOCAL     ] ECAT: Derivative data saved (139 records).
[2025-10-24T01:21:03.517568] [INFO ] [MAIN      ] ECAT: Successfully saved derivative data.
[2025-10-24T01:21:03.554401] [INFO ] [MAIN      ] Derivative Progress: 621/2164 symbols completed. ECAT took 1.4s. Estimated remaining: 10m 52s. Rate: 141.9 symbols/min
[2025-10-24T01:21:03.554967] [INFO ] [MAIN      ] ECG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:03.773474] [DEBUG] [LOCAL     ] ECC: Loaded 43660 existing records from primary storage.
[2025-10-24T01:21:03.773897] [INFO ] [MAIN      ] ECC: Loaded 43660 primary data records.
[2025-10-24T01:21:03.932542] [DEBUG] [LOCAL     ] ECG: Loaded 32971 existing records from primary storage.
[2025-10-24T01:21:04.078732] [INFO ] [MAIN      ] ECG: Loaded 32971 primary data records.
[2025-10-24T01:21:04.315055] [DEBUG] [MAIN      ] ECCU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:04.574189] [DEBUG] [MAIN      ] ECC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:04.620814] [INFO ] [MAIN      ] ECCU: Generated 139 derivative records from 2156 primary records.
[2025-10-24T01:21:04.625357] [DEBUG] [LOCAL     ] ECCU: Saving derivative data.
[2025-10-24T01:21:04.646234] [DEBUG] [MAIN      ] ECG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:04.656839] [DEBUG] [LOCAL     ] ECCU: Derivative data saved (139 records).
[2025-10-24T01:21:04.657003] [INFO ] [MAIN      ] ECCU: Successfully saved derivative data.
[2025-10-24T01:21:04.675271] [INFO ] [MAIN      ] Derivative Progress: 622/2164 symbols completed. ECCU took 1.2s. Estimated remaining: 10m 54s. Rate: 141.6 symbols/min
[2025-10-24T01:21:04.679704] [INFO ] [MAIN      ] ECL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:04.684262] [INFO ] [MAIN      ] ECC: Generated 139 derivative records from 43660 primary records.
[2025-10-24T01:21:04.684928] [DEBUG] [LOCAL     ] ECC: Saving derivative data.
[2025-10-24T01:21:04.702053] [DEBUG] [LOCAL     ] ECC: Derivative data saved (139 records).
[2025-10-24T01:21:04.702285] [INFO ] [MAIN      ] ECC: Successfully saved derivative data.
[2025-10-24T01:21:04.705088] [INFO ] [MAIN      ] Derivative Progress: 623/2164 symbols completed. ECC took 1.3s. Estimated remaining: 10m 52s. Rate: 141.8 symbols/min
[2025-10-24T01:21:04.705328] [INFO ] [MAIN      ] ECO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:04.726681] [INFO ] [MAIN      ] ECG: Generated 139 derivative records from 32971 primary records.
[2025-10-24T01:21:04.727018] [DEBUG] [LOCAL     ] ECG: Saving derivative data.
[2025-10-24T01:21:04.755035] [DEBUG] [LOCAL     ] ECO: Loaded 18178 existing records from primary storage.
[2025-10-24T01:21:04.756592] [DEBUG] [LOCAL     ] ECG: Derivative data saved (139 records).
[2025-10-24T01:21:04.756850] [INFO ] [MAIN      ] ECO: Loaded 18178 primary data records.
[2025-10-24T01:21:04.756911] [INFO ] [MAIN      ] ECG: Successfully saved derivative data.
[2025-10-24T01:21:04.772046] [INFO ] [MAIN      ] Derivative Progress: 624/2164 symbols completed. ECG took 1.2s. Estimated remaining: 10m 51s. Rate: 142.0 symbols/min
[2025-10-24T01:21:04.805819] [INFO ] [MAIN      ] ECVT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:04.881860] [DEBUG] [LOCAL     ] ECL: Loaded 47048 existing records from primary storage.
[2025-10-24T01:21:04.898458] [INFO ] [MAIN      ] ECL: Loaded 47048 primary data records.
[2025-10-24T01:21:05.413244] [DEBUG] [LOCAL     ] ECVT: Loaded 43397 existing records from primary storage.
[2025-10-24T01:21:05.414560] [INFO ] [MAIN      ] ECVT: Loaded 43397 primary data records.
[2025-10-24T01:21:05.607225] [DEBUG] [MAIN      ] ECO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:05.766106] [DEBUG] [MAIN      ] ECL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:05.802764] [INFO ] [MAIN      ] ECO: Generated 139 derivative records from 18178 primary records.
[2025-10-24T01:21:05.803559] [DEBUG] [LOCAL     ] ECO: Saving derivative data.
[2025-10-24T01:21:05.818574] [DEBUG] [LOCAL     ] ECO: Derivative data saved (139 records).
[2025-10-24T01:21:05.822249] [INFO ] [MAIN      ] ECO: Successfully saved derivative data.
[2025-10-24T01:21:05.825424] [INFO ] [MAIN      ] Derivative Progress: 625/2164 symbols completed. ECO took 1.1s. Estimated remaining: 10m 52s. Rate: 141.6 symbols/min
[2025-10-24T01:21:05.825618] [INFO ] [MAIN      ] EDD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:05.840457] [DEBUG] [MAIN      ] ECVT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:05.865158] [INFO ] [MAIN      ] ECL: Generated 139 derivative records from 47048 primary records.
[2025-10-24T01:21:05.865503] [DEBUG] [LOCAL     ] ECL: Saving derivative data.
[2025-10-24T01:21:05.893826] [DEBUG] [LOCAL     ] ECL: Derivative data saved (139 records).
[2025-10-24T01:21:05.895147] [INFO ] [MAIN      ] ECL: Successfully saved derivative data.
[2025-10-24T01:21:05.897721] [INFO ] [MAIN      ] Derivative Progress: 626/2164 symbols completed. ECL took 1.2s. Estimated remaining: 10m 51s. Rate: 141.8 symbols/min
[2025-10-24T01:21:05.898601] [INFO ] [MAIN      ] EDF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:05.915112] [INFO ] [MAIN      ] ECVT: Generated 139 derivative records from 43397 primary records.
[2025-10-24T01:21:05.912882] [DEBUG] [LOCAL     ] EDD: Loaded 27448 existing records from primary storage.
[2025-10-24T01:21:05.915261] [DEBUG] [LOCAL     ] ECVT: Saving derivative data.
[2025-10-24T01:21:05.915406] [INFO ] [MAIN      ] EDD: Loaded 27448 primary data records.
[2025-10-24T01:21:05.976370] [DEBUG] [LOCAL     ] ECVT: Derivative data saved (139 records).
[2025-10-24T01:21:06.014513] [INFO ] [MAIN      ] ECVT: Successfully saved derivative data.
[2025-10-24T01:21:06.041169] [DEBUG] [LOCAL     ] EDF: Loaded 12885 existing records from primary storage.
[2025-10-24T01:21:06.044486] [INFO ] [MAIN      ] Derivative Progress: 627/2164 symbols completed. ECVT took 1.2s. Estimated remaining: 10m 50s. Rate: 142.0 symbols/min
[2025-10-24T01:21:06.041371] [INFO ] [MAIN      ] EDF: Loaded 12885 primary data records.
[2025-10-24T01:21:06.050361] [INFO ] [MAIN      ] EDN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:06.584391] [DEBUG] [LOCAL     ] EDN: Loaded 19477 existing records from primary storage.
[2025-10-24T01:21:06.584837] [INFO ] [MAIN      ] EDN: Loaded 19477 primary data records.
[2025-10-24T01:21:06.907248] [DEBUG] [MAIN      ] EDD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:06.946225] [DEBUG] [MAIN      ] EDF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:06.994187] [DEBUG] [MAIN      ] EDN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:07.018079] [INFO ] [MAIN      ] EDD: Generated 139 derivative records from 27448 primary records.
[2025-10-24T01:21:07.020947] [DEBUG] [LOCAL     ] EDD: Saving derivative data.
[2025-10-24T01:21:07.045776] [DEBUG] [LOCAL     ] EDD: Derivative data saved (139 records).
[2025-10-24T01:21:07.047087] [INFO ] [MAIN      ] EDF: Generated 139 derivative records from 12885 primary records.
[2025-10-24T01:21:07.047201] [INFO ] [MAIN      ] EDD: Successfully saved derivative data.
[2025-10-24T01:21:07.047670] [DEBUG] [LOCAL     ] EDF: Saving derivative data.
[2025-10-24T01:21:07.050298] [INFO ] [MAIN      ] Derivative Progress: 628/2164 symbols completed. EDD took 1.2s. Estimated remaining: 10m 51s. Rate: 141.7 symbols/min
[2025-10-24T01:21:07.066226] [DEBUG] [LOCAL     ] EDF: Derivative data saved (139 records).
[2025-10-24T01:21:07.069146] [INFO ] [MAIN      ] EDN: Generated 139 derivative records from 19477 primary records.
[2025-10-24T01:21:07.069258] [INFO ] [MAIN      ] EDF: Successfully saved derivative data.
[2025-10-24T01:21:07.071978] [INFO ] [MAIN      ] Derivative Progress: 629/2164 symbols completed. EDF took 1.2s. Estimated remaining: 10m 49s. Rate: 141.9 symbols/min
[2025-10-24T01:21:07.072049] [DEBUG] [LOCAL     ] EDN: Saving derivative data.
[2025-10-24T01:21:07.084158] [DEBUG] [LOCAL     ] EDN: Derivative data saved (139 records).
[2025-10-24T01:21:07.084239] [INFO ] [MAIN      ] EDN: Successfully saved derivative data.
[2025-10-24T01:21:07.086715] [INFO ] [MAIN      ] Derivative Progress: 630/2164 symbols completed. EDN took 1.0s. Estimated remaining: 10m 48s. Rate: 142.1 symbols/min
[2025-10-24T01:21:07.087286] [INFO ] [MAIN      ] EDU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:07.087891] [INFO ] [MAIN      ] EEX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:07.087442] [INFO ] [MAIN      ] EE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:07.103816] [DEBUG] [LOCAL     ] EEX: Loaded 9883 existing records from primary storage.
[2025-10-24T01:21:07.103977] [INFO ] [MAIN      ] EEX: Loaded 9883 primary data records.
[2025-10-24T01:21:07.443037] [DEBUG] [LOCAL     ] EE: Loaded 32747 existing records from primary storage.
[2025-10-24T01:21:07.443976] [DEBUG] [LOCAL     ] EDU: Loaded 45102 existing records from primary storage.
[2025-10-24T01:21:07.444236] [INFO ] [MAIN      ] EDU: Loaded 45102 primary data records.
[2025-10-24T01:21:07.444171] [INFO ] [MAIN      ] EE: Loaded 32747 primary data records.
[2025-10-24T01:21:08.182123] [DEBUG] [MAIN      ] EEX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:08.232603] [DEBUG] [MAIN      ] EDU: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:21:08.282618] [DEBUG] [MAIN      ] EE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:08.312274] [INFO ] [MAIN      ] EEX: Generated 139 derivative records from 9883 primary records.
[2025-10-24T01:21:08.313734] [DEBUG] [LOCAL     ] EEX: Saving derivative data.
[2025-10-24T01:21:08.334541] [DEBUG] [LOCAL     ] EEX: Derivative data saved (139 records).
[2025-10-24T01:21:08.334904] [INFO ] [MAIN      ] EEX: Successfully saved derivative data.
[2025-10-24T01:21:08.338361] [INFO ] [MAIN      ] Derivative Progress: 631/2164 symbols completed. EEX took 1.3s. Estimated remaining: 10m 49s. Rate: 141.6 symbols/min
[2025-10-24T01:21:08.342037] [INFO ] [MAIN      ] EFC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:08.348638] [INFO ] [MAIN      ] EDU: Generated 139 derivative records from 45102 primary records.
[2025-10-24T01:21:08.349742] [DEBUG] [LOCAL     ] EDU: Saving derivative data.
[2025-10-24T01:21:08.367205] [DEBUG] [LOCAL     ] EDU: Derivative data saved (139 records).
[2025-10-24T01:21:08.367542] [INFO ] [MAIN      ] EDU: Successfully saved derivative data.
[2025-10-24T01:21:08.371628] [INFO ] [MAIN      ] Derivative Progress: 632/2164 symbols completed. EDU took 1.3s. Estimated remaining: 10m 48s. Rate: 141.9 symbols/min
[2025-10-24T01:21:08.372261] [INFO ] [MAIN      ] EFR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:08.378958] [INFO ] [MAIN      ] EE: Generated 139 derivative records from 32747 primary records.
[2025-10-24T01:21:08.379129] [DEBUG] [LOCAL     ] EE: Saving derivative data.
[2025-10-24T01:21:08.392179] [DEBUG] [LOCAL     ] EE: Derivative data saved (139 records).
[2025-10-24T01:21:08.392311] [INFO ] [MAIN      ] EE: Successfully saved derivative data.
[2025-10-24T01:21:08.395160] [INFO ] [MAIN      ] Derivative Progress: 633/2164 symbols completed. EE took 1.3s. Estimated remaining: 10m 47s. Rate: 142.1 symbols/min
[2025-10-24T01:21:08.395436] [INFO ] [MAIN      ] EFT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:08.419312] [DEBUG] [LOCAL     ] EFR: Loaded 15160 existing records from primary storage.
[2025-10-24T01:21:08.419482] [INFO ] [MAIN      ] EFR: Loaded 15160 primary data records.
[2025-10-24T01:21:08.542515] [DEBUG] [LOCAL     ] EFT: Loaded 12971 existing records from primary storage.
[2025-10-24T01:21:08.555455] [INFO ] [MAIN      ] EFT: Loaded 12971 primary data records.
[2025-10-24T01:21:08.555333] [DEBUG] [LOCAL     ] EFC: Loaded 46626 existing records from primary storage.
[2025-10-24T01:21:08.587430] [INFO ] [MAIN      ] EFC: Loaded 46626 primary data records.
[2025-10-24T01:21:09.408434] [DEBUG] [MAIN      ] EFR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:09.448813] [DEBUG] [MAIN      ] EFT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:09.475934] [DEBUG] [MAIN      ] EFC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:09.524309] [INFO ] [MAIN      ] EFR: Generated 139 derivative records from 15160 primary records.
[2025-10-24T01:21:09.527511] [DEBUG] [LOCAL     ] EFR: Saving derivative data.
[2025-10-24T01:21:09.545516] [DEBUG] [LOCAL     ] EFR: Derivative data saved (139 records).
[2025-10-24T01:21:09.547120] [INFO ] [MAIN      ] EFR: Successfully saved derivative data.
[2025-10-24T01:21:09.549697] [INFO ] [MAIN      ] Derivative Progress: 634/2164 symbols completed. EFR took 1.2s. Estimated remaining: 10m 48s. Rate: 141.7 symbols/min
[2025-10-24T01:21:09.556326] [INFO ] [MAIN      ] EFX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:09.569144] [INFO ] [MAIN      ] EFT: Generated 139 derivative records from 12971 primary records.
[2025-10-24T01:21:09.572228] [INFO ] [MAIN      ] EFC: Generated 139 derivative records from 46626 primary records.
[2025-10-24T01:21:09.572404] [DEBUG] [LOCAL     ] EFT: Saving derivative data.
[2025-10-24T01:21:09.573350] [DEBUG] [LOCAL     ] EFC: Saving derivative data.
[2025-10-24T01:21:09.593190] [DEBUG] [LOCAL     ] EFC: Derivative data saved (139 records).
[2025-10-24T01:21:09.593404] [INFO ] [MAIN      ] EFC: Successfully saved derivative data.
[2025-10-24T01:21:09.598518] [INFO ] [MAIN      ] Derivative Progress: 635/2164 symbols completed. EFC took 1.3s. Estimated remaining: 10m 47s. Rate: 141.9 symbols/min
[2025-10-24T01:21:09.602428] [INFO ] [MAIN      ] EFXT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:09.603169] [DEBUG] [LOCAL     ] EFT: Derivative data saved (139 records).
[2025-10-24T01:21:09.603341] [INFO ] [MAIN      ] EFT: Successfully saved derivative data.
[2025-10-24T01:21:09.606363] [INFO ] [MAIN      ] Derivative Progress: 636/2164 symbols completed. EFT took 1.2s. Estimated remaining: 10m 45s. Rate: 142.1 symbols/min
[2025-10-24T01:21:09.606779] [INFO ] [MAIN      ] EG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:09.641029] [DEBUG] [LOCAL     ] EFX: Loaded 45066 existing records from primary storage.
[2025-10-24T01:21:09.649831] [INFO ] [MAIN      ] EFX: Loaded 45066 primary data records.
[2025-10-24T01:21:09.752823] [DEBUG] [LOCAL     ] EFXT: Loaded 29741 existing records from primary storage.
[2025-10-24T01:21:09.779160] [INFO ] [MAIN      ] EFXT: Loaded 29741 primary data records.
[2025-10-24T01:21:09.812074] [DEBUG] [LOCAL     ] EG: Loaded 27639 existing records from primary storage.
[2025-10-24T01:21:09.852627] [INFO ] [MAIN      ] EG: Loaded 27639 primary data records.
[2025-10-24T01:21:10.670855] [DEBUG] [MAIN      ] EFX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:10.712915] [DEBUG] [MAIN      ] EFXT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:10.758513] [DEBUG] [MAIN      ] EG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:10.787091] [INFO ] [MAIN      ] EFX: Generated 139 derivative records from 45066 primary records.
[2025-10-24T01:21:10.791422] [DEBUG] [LOCAL     ] EFX: Saving derivative data.
[2025-10-24T01:21:10.815551] [DEBUG] [LOCAL     ] EFX: Derivative data saved (139 records).
[2025-10-24T01:21:10.817907] [INFO ] [MAIN      ] EFX: Successfully saved derivative data.
[2025-10-24T01:21:10.821033] [INFO ] [MAIN      ] Derivative Progress: 637/2164 symbols completed. EFX took 1.3s. Estimated remaining: 10m 47s. Rate: 141.7 symbols/min
[2025-10-24T01:21:10.823310] [INFO ] [MAIN      ] EGO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:10.839898] [INFO ] [MAIN      ] EFXT: Generated 139 derivative records from 29741 primary records.
[2025-10-24T01:21:10.841947] [DEBUG] [LOCAL     ] EFXT: Saving derivative data.
[2025-10-24T01:21:10.844758] [INFO ] [MAIN      ] EG: Generated 139 derivative records from 27639 primary records.
[2025-10-24T01:21:10.845257] [DEBUG] [LOCAL     ] EG: Saving derivative data.
[2025-10-24T01:21:10.872500] [DEBUG] [LOCAL     ] EG: Derivative data saved (139 records).
[2025-10-24T01:21:10.871780] [DEBUG] [LOCAL     ] EFXT: Derivative data saved (139 records).
[2025-10-24T01:21:10.885559] [INFO ] [MAIN      ] EG: Successfully saved derivative data.
[2025-10-24T01:21:10.889405] [INFO ] [MAIN      ] Derivative Progress: 638/2164 symbols completed. EG took 1.3s. Estimated remaining: 10m 45s. Rate: 141.9 symbols/min
[2025-10-24T01:21:10.889536] [INFO ] [MAIN      ] EFXT: Successfully saved derivative data.
[2025-10-24T01:21:10.889965] [INFO ] [MAIN      ] EGP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:10.892810] [INFO ] [MAIN      ] Derivative Progress: 639/2164 symbols completed. EFXT took 1.3s. Estimated remaining: 10m 44s. Rate: 142.1 symbols/min
[2025-10-24T01:21:10.893627] [INFO ] [MAIN      ] EGY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:10.917375] [DEBUG] [LOCAL     ] EGO: Loaded 52112 existing records from primary storage.
[2025-10-24T01:21:10.917873] [INFO ] [MAIN      ] EGO: Loaded 52112 primary data records.
[2025-10-24T01:21:11.132038] [DEBUG] [LOCAL     ] EGP: Loaded 30434 existing records from primary storage.
[2025-10-24T01:21:11.132772] [DEBUG] [LOCAL     ] EGY: Loaded 41489 existing records from primary storage.
[2025-10-24T01:21:11.155487] [INFO ] [MAIN      ] EGP: Loaded 30434 primary data records.
[2025-10-24T01:21:11.155759] [INFO ] [MAIN      ] EGY: Loaded 41489 primary data records.
[2025-10-24T01:21:11.962191] [DEBUG] [MAIN      ] EGO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:12.018178] [DEBUG] [MAIN      ] EGP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:12.064988] [DEBUG] [MAIN      ] EGY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:12.086993] [INFO ] [MAIN      ] EGO: Generated 139 derivative records from 52112 primary records.
[2025-10-24T01:21:12.091414] [DEBUG] [LOCAL     ] EGO: Saving derivative data.
[2025-10-24T01:21:12.114059] [DEBUG] [LOCAL     ] EGO: Derivative data saved (139 records).
[2025-10-24T01:21:12.115710] [INFO ] [MAIN      ] EGO: Successfully saved derivative data.
[2025-10-24T01:21:12.124800] [INFO ] [MAIN      ] Derivative Progress: 640/2164 symbols completed. EGO took 1.3s. Estimated remaining: 10m 45s. Rate: 141.7 symbols/min
[2025-10-24T01:21:12.128306] [INFO ] [MAIN      ] EHAB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:12.131214] [INFO ] [MAIN      ] EGP: Generated 139 derivative records from 30434 primary records.
[2025-10-24T01:21:12.131538] [DEBUG] [LOCAL     ] EGP: Saving derivative data.
[2025-10-24T01:21:12.148390] [DEBUG] [LOCAL     ] EGP: Derivative data saved (139 records).
[2025-10-24T01:21:12.150535] [INFO ] [MAIN      ] EGP: Successfully saved derivative data.
[2025-10-24T01:21:12.153557] [INFO ] [MAIN      ] Derivative Progress: 641/2164 symbols completed. EGP took 1.3s. Estimated remaining: 10m 44s. Rate: 141.9 symbols/min
[2025-10-24T01:21:12.156610] [INFO ] [MAIN      ] EHC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:12.160241] [INFO ] [MAIN      ] EGY: Generated 139 derivative records from 41489 primary records.
[2025-10-24T01:21:12.160685] [DEBUG] [LOCAL     ] EGY: Saving derivative data.
[2025-10-24T01:21:12.183094] [DEBUG] [LOCAL     ] EGY: Derivative data saved (139 records).
[2025-10-24T01:21:12.183225] [INFO ] [MAIN      ] EGY: Successfully saved derivative data.
[2025-10-24T01:21:12.186447] [INFO ] [MAIN      ] Derivative Progress: 642/2164 symbols completed. EGY took 1.3s. Estimated remaining: 10m 43s. Rate: 142.1 symbols/min
[2025-10-24T01:21:12.186855] [INFO ] [MAIN      ] EHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:12.200001] [DEBUG] [LOCAL     ] EHAB: Loaded 29510 existing records from primary storage.
[2025-10-24T01:21:12.200258] [INFO ] [MAIN      ] EHAB: Loaded 29510 primary data records.
[2025-10-24T01:21:12.317338] [DEBUG] [LOCAL     ] EHI: Loaded 10593 existing records from primary storage.
[2025-10-24T01:21:12.353713] [INFO ] [MAIN      ] EHI: Loaded 10593 primary data records.
[2025-10-24T01:21:12.354959] [DEBUG] [LOCAL     ] EHC: Loaded 41202 existing records from primary storage.
[2025-10-24T01:21:12.406835] [INFO ] [MAIN      ] EHC: Loaded 41202 primary data records.
[2025-10-24T01:21:13.247117] [DEBUG] [MAIN      ] EHAB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:13.282737] [DEBUG] [MAIN      ] EHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:13.320584] [DEBUG] [MAIN      ] EHC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:13.366095] [INFO ] [MAIN      ] EHAB: Generated 139 derivative records from 29510 primary records.
[2025-10-24T01:21:13.366583] [DEBUG] [LOCAL     ] EHAB: Saving derivative data.
[2025-10-24T01:21:13.371423] [INFO ] [MAIN      ] EHI: Generated 139 derivative records from 10593 primary records.
[2025-10-24T01:21:13.380254] [DEBUG] [LOCAL     ] EHI: Saving derivative data.
[2025-10-24T01:21:13.383160] [DEBUG] [LOCAL     ] EHAB: Derivative data saved (139 records).
[2025-10-24T01:21:13.384310] [INFO ] [MAIN      ] EHAB: Successfully saved derivative data.
[2025-10-24T01:21:13.387716] [INFO ] [MAIN      ] Derivative Progress: 643/2164 symbols completed. EHAB took 1.3s. Estimated remaining: 10m 44s. Rate: 141.7 symbols/min
[2025-10-24T01:21:13.404528] [DEBUG] [LOCAL     ] EHI: Derivative data saved (139 records).
[2025-10-24T01:21:13.406129] [INFO ] [MAIN      ] EHI: Successfully saved derivative data.
[2025-10-24T01:21:13.411875] [INFO ] [MAIN      ] Derivative Progress: 644/2164 symbols completed. EHI took 1.2s. Estimated remaining: 10m 43s. Rate: 141.9 symbols/min
[2025-10-24T01:21:13.412703] [INFO ] [MAIN      ] EHC: Generated 139 derivative records from 41202 primary records.
[2025-10-24T01:21:13.412826] [DEBUG] [LOCAL     ] EHC: Saving derivative data.
[2025-10-24T01:21:13.425001] [DEBUG] [LOCAL     ] EHC: Derivative data saved (139 records).
[2025-10-24T01:21:13.425087] [INFO ] [MAIN      ] EHC: Successfully saved derivative data.
[2025-10-24T01:21:13.427898] [INFO ] [MAIN      ] Derivative Progress: 645/2164 symbols completed. EHC took 1.3s. Estimated remaining: 10m 41s. Rate: 142.1 symbols/min
[2025-10-24T01:21:13.428308] [INFO ] [MAIN      ] EIC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:13.428457] [INFO ] [MAIN      ] EICC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:13.428790] [INFO ] [MAIN      ] EIG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:13.440538] [DEBUG] [LOCAL     ] EICC: Loaded 6220 existing records from primary storage.
[2025-10-24T01:21:13.441175] [INFO ] [MAIN      ] EICC: Loaded 6220 primary data records.
[2025-10-24T01:21:13.546280] [DEBUG] [LOCAL     ] EIG: Loaded 20163 existing records from primary storage.
[2025-10-24T01:21:13.578594] [INFO ] [MAIN      ] EIG: Loaded 20163 primary data records.
[2025-10-24T01:21:13.579457] [DEBUG] [LOCAL     ] EIC: Loaded 22532 existing records from primary storage.
[2025-10-24T01:21:13.641041] [INFO ] [MAIN      ] EIC: Loaded 22532 primary data records.
[2025-10-24T01:21:14.504992] [DEBUG] [MAIN      ] EICC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:14.546089] [DEBUG] [MAIN      ] EIG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:14.583617] [DEBUG] [MAIN      ] EIC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:14.617528] [INFO ] [MAIN      ] EICC: Generated 139 derivative records from 6220 primary records.
[2025-10-24T01:21:14.619065] [DEBUG] [LOCAL     ] EICC: Saving derivative data.
[2025-10-24T01:21:14.637681] [DEBUG] [LOCAL     ] EICC: Derivative data saved (139 records).
[2025-10-24T01:21:14.643527] [INFO ] [MAIN      ] EICC: Successfully saved derivative data.
[2025-10-24T01:21:14.647190] [INFO ] [MAIN      ] Derivative Progress: 646/2164 symbols completed. EICC took 1.2s. Estimated remaining: 10m 43s. Rate: 141.7 symbols/min
[2025-10-24T01:21:14.650562] [INFO ] [MAIN      ] EIX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:14.653313] [INFO ] [MAIN      ] EIG: Generated 139 derivative records from 20163 primary records.
[2025-10-24T01:21:14.656093] [DEBUG] [LOCAL     ] EIG: Saving derivative data.
[2025-10-24T01:21:14.673068] [DEBUG] [LOCAL     ] EIG: Derivative data saved (139 records).
[2025-10-24T01:21:14.673228] [INFO ] [MAIN      ] EIG: Successfully saved derivative data.
[2025-10-24T01:21:14.676553] [INFO ] [MAIN      ] Derivative Progress: 647/2164 symbols completed. EIG took 1.2s. Estimated remaining: 10m 42s. Rate: 141.9 symbols/min
[2025-10-24T01:21:14.677030] [INFO ] [MAIN      ] EL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:14.679491] [INFO ] [MAIN      ] EIC: Generated 139 derivative records from 22532 primary records.
[2025-10-24T01:21:14.679584] [DEBUG] [LOCAL     ] EIC: Saving derivative data.
[2025-10-24T01:21:14.693392] [DEBUG] [LOCAL     ] EIC: Derivative data saved (139 records).
[2025-10-24T01:21:14.693669] [INFO ] [MAIN      ] EIC: Successfully saved derivative data.
[2025-10-24T01:21:14.696408] [INFO ] [MAIN      ] Derivative Progress: 648/2164 symbols completed. EIC took 1.3s. Estimated remaining: 10m 40s. Rate: 142.1 symbols/min
[2025-10-24T01:21:14.696789] [INFO ] [MAIN      ] ELAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:14.754817] [DEBUG] [LOCAL     ] EIX: Loaded 53737 existing records from primary storage.
[2025-10-24T01:21:14.754991] [INFO ] [MAIN      ] EIX: Loaded 53737 primary data records.
[2025-10-24T01:21:14.874393] [DEBUG] [LOCAL     ] EL: Loaded 53769 existing records from primary storage.
[2025-10-24T01:21:14.911757] [INFO ] [MAIN      ] EL: Loaded 53769 primary data records.
[2025-10-24T01:21:14.918824] [DEBUG] [LOCAL     ] ELAN: Loaded 53699 existing records from primary storage.
[2025-10-24T01:21:14.934749] [INFO ] [MAIN      ] ELAN: Loaded 53699 primary data records.
[2025-10-24T01:21:15.744383] [DEBUG] [MAIN      ] EIX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:15.789940] [DEBUG] [MAIN      ] ELAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:15.821385] [DEBUG] [MAIN      ] EL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:15.861941] [INFO ] [MAIN      ] EIX: Generated 139 derivative records from 53737 primary records.
[2025-10-24T01:21:15.865066] [DEBUG] [LOCAL     ] EIX: Saving derivative data.
[2025-10-24T01:21:15.884218] [DEBUG] [LOCAL     ] EIX: Derivative data saved (139 records).
[2025-10-24T01:21:15.887392] [INFO ] [MAIN      ] EIX: Successfully saved derivative data.
[2025-10-24T01:21:15.889934] [INFO ] [MAIN      ] Derivative Progress: 649/2164 symbols completed. EIX took 1.2s. Estimated remaining: 10m 42s. Rate: 141.7 symbols/min
[2025-10-24T01:21:15.890556] [INFO ] [MAIN      ] ELC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:15.904563] [INFO ] [MAIN      ] ELAN: Generated 139 derivative records from 53699 primary records.
[2025-10-24T01:21:15.908185] [DEBUG] [LOCAL     ] ELC: Loaded 3459 existing records from primary storage.
[2025-10-24T01:21:15.908376] [INFO ] [MAIN      ] ELC: Loaded 3459 primary data records.
[2025-10-24T01:21:15.908703] [DEBUG] [LOCAL     ] ELAN: Saving derivative data.
[2025-10-24T01:21:15.955065] [INFO ] [MAIN      ] EL: Generated 139 derivative records from 53769 primary records.
[2025-10-24T01:21:15.974343] [DEBUG] [LOCAL     ] EL: Saving derivative data.
[2025-10-24T01:21:16.005195] [DEBUG] [LOCAL     ] ELAN: Derivative data saved (139 records).
[2025-10-24T01:21:16.023568] [INFO ] [MAIN      ] ELAN: Successfully saved derivative data.
[2025-10-24T01:21:16.026803] [INFO ] [MAIN      ] Derivative Progress: 650/2164 symbols completed. ELAN took 1.3s. Estimated remaining: 10m 40s. Rate: 141.8 symbols/min
[2025-10-24T01:21:16.042856] [DEBUG] [LOCAL     ] EL: Derivative data saved (139 records).
[2025-10-24T01:21:16.043470] [INFO ] [MAIN      ] ELF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:16.043613] [INFO ] [MAIN      ] EL: Successfully saved derivative data.
[2025-10-24T01:21:16.063187] [INFO ] [MAIN      ] Derivative Progress: 651/2164 symbols completed. EL took 1.4s. Estimated remaining: 10m 39s. Rate: 142.0 symbols/min
[2025-10-24T01:21:16.068727] [INFO ] [MAIN      ] ELME: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:16.304703] [DEBUG] [MAIN      ] ELC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:16.306243] [DEBUG] [LOCAL     ] ELME: Loaded 39574 existing records from primary storage.
[2025-10-24T01:21:16.332023] [INFO ] [MAIN      ] ELME: Loaded 39574 primary data records.
[2025-10-24T01:21:16.335450] [DEBUG] [LOCAL     ] ELF: Loaded 52226 existing records from primary storage.
[2025-10-24T01:21:16.357198] [INFO ] [MAIN      ] ELF: Loaded 52226 primary data records.
[2025-10-24T01:21:17.007740] [INFO ] [MAIN      ] ELC: Generated 139 derivative records from 3459 primary records.
[2025-10-24T01:21:17.009689] [DEBUG] [LOCAL     ] ELC: Saving derivative data.
[2025-10-24T01:21:17.023574] [DEBUG] [LOCAL     ] ELC: Derivative data saved (139 records).
[2025-10-24T01:21:17.023866] [INFO ] [MAIN      ] ELC: Successfully saved derivative data.
[2025-10-24T01:21:17.026108] [INFO ] [MAIN      ] Derivative Progress: 652/2164 symbols completed. ELC took 1.1s. Estimated remaining: 10m 40s. Rate: 141.8 symbols/min
[2025-10-24T01:21:17.026664] [INFO ] [MAIN      ] ELP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:17.051311] [DEBUG] [MAIN      ] ELME: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:17.087172] [DEBUG] [MAIN      ] ELF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:17.116708] [DEBUG] [LOCAL     ] ELP: Loaded 25729 existing records from primary storage.
[2025-10-24T01:21:17.120678] [INFO ] [MAIN      ] ELP: Loaded 25729 primary data records.
[2025-10-24T01:21:17.452218] [INFO ] [MAIN      ] ELME: Generated 139 derivative records from 39574 primary records.
[2025-10-24T01:21:17.452950] [DEBUG] [LOCAL     ] ELME: Saving derivative data.
[2025-10-24T01:21:17.473289] [DEBUG] [LOCAL     ] ELME: Derivative data saved (139 records).
[2025-10-24T01:21:17.473928] [INFO ] [MAIN      ] ELME: Successfully saved derivative data.
[2025-10-24T01:21:17.480848] [INFO ] [MAIN      ] Derivative Progress: 653/2164 symbols completed. ELME took 1.4s. Estimated remaining: 10m 40s. Rate: 141.7 symbols/min
[2025-10-24T01:21:17.481940] [INFO ] [MAIN      ] ELS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:17.487618] [INFO ] [MAIN      ] ELF: Generated 139 derivative records from 52226 primary records.
[2025-10-24T01:21:17.487885] [DEBUG] [LOCAL     ] ELF: Saving derivative data.
[2025-10-24T01:21:17.505823] [DEBUG] [LOCAL     ] ELF: Derivative data saved (139 records).
[2025-10-24T01:21:17.506010] [INFO ] [MAIN      ] ELF: Successfully saved derivative data.
[2025-10-24T01:21:17.509623] [INFO ] [MAIN      ] Derivative Progress: 654/2164 symbols completed. ELF took 1.5s. Estimated remaining: 10m 38s. Rate: 141.9 symbols/min
[2025-10-24T01:21:17.510212] [INFO ] [MAIN      ] ELV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:17.529070] [DEBUG] [MAIN      ] ELP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:17.570228] [INFO ] [MAIN      ] ELP: Generated 139 derivative records from 25729 primary records.
[2025-10-24T01:21:17.570414] [DEBUG] [LOCAL     ] ELP: Saving derivative data.
[2025-10-24T01:21:17.584057] [DEBUG] [LOCAL     ] ELP: Derivative data saved (139 records).
[2025-10-24T01:21:17.584294] [INFO ] [MAIN      ] ELP: Successfully saved derivative data.
[2025-10-24T01:21:17.600849] [INFO ] [MAIN      ] Derivative Progress: 655/2164 symbols completed. ELP took 0.6s. Estimated remaining: 10m 37s. Rate: 142.1 symbols/min
[2025-10-24T01:21:17.602418] [DEBUG] [LOCAL     ] ELS: Loaded 50237 existing records from primary storage.
[2025-10-24T01:21:17.616096] [INFO ] [MAIN      ] ELS: Loaded 50237 primary data records.
[2025-10-24T01:21:17.616225] [INFO ] [MAIN      ] EMD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:17.789875] [DEBUG] [LOCAL     ] ELV: Loaded 51124 existing records from primary storage.
[2025-10-24T01:21:17.823053] [DEBUG] [LOCAL     ] EMD: Loaded 20887 existing records from primary storage.
[2025-10-24T01:21:17.828228] [INFO ] [MAIN      ] ELV: Loaded 51124 primary data records.
[2025-10-24T01:21:17.944119] [INFO ] [MAIN      ] EMD: Loaded 20887 primary data records.
[2025-10-24T01:21:18.585682] [DEBUG] [MAIN      ] ELS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:18.645805] [DEBUG] [MAIN      ] ELV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:18.648692] [DEBUG] [MAIN      ] EMD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:18.680236] [INFO ] [MAIN      ] ELS: Generated 139 derivative records from 50237 primary records.
[2025-10-24T01:21:18.681951] [DEBUG] [LOCAL     ] ELS: Saving derivative data.
[2025-10-24T01:21:18.706467] [DEBUG] [LOCAL     ] ELS: Derivative data saved (139 records).
[2025-10-24T01:21:18.706878] [INFO ] [MAIN      ] ELS: Successfully saved derivative data.
[2025-10-24T01:21:18.709527] [INFO ] [MAIN      ] Derivative Progress: 656/2164 symbols completed. ELS took 1.2s. Estimated remaining: 10m 38s. Rate: 141.8 symbols/min
[2025-10-24T01:21:18.713555] [INFO ] [MAIN      ] EME: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:18.735192] [INFO ] [MAIN      ] ELV: Generated 139 derivative records from 51124 primary records.
[2025-10-24T01:21:18.735796] [DEBUG] [LOCAL     ] ELV: Saving derivative data.
[2025-10-24T01:21:18.741275] [INFO ] [MAIN      ] EMD: Generated 139 derivative records from 20887 primary records.
[2025-10-24T01:21:18.741625] [DEBUG] [LOCAL     ] EMD: Saving derivative data.
[2025-10-24T01:21:18.771575] [DEBUG] [LOCAL     ] ELV: Derivative data saved (139 records).
[2025-10-24T01:21:18.772059] [INFO ] [MAIN      ] ELV: Successfully saved derivative data.
[2025-10-24T01:21:18.775671] [INFO ] [MAIN      ] Derivative Progress: 657/2164 symbols completed. ELV took 1.3s. Estimated remaining: 10m 37s. Rate: 141.9 symbols/min
[2025-10-24T01:21:18.776712] [INFO ] [MAIN      ] EMF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:18.780976] [DEBUG] [LOCAL     ] EMD: Derivative data saved (139 records).
[2025-10-24T01:21:18.781137] [INFO ] [MAIN      ] EMD: Successfully saved derivative data.
[2025-10-24T01:21:18.783482] [INFO ] [MAIN      ] Derivative Progress: 658/2164 symbols completed. EMD took 1.2s. Estimated remaining: 10m 36s. Rate: 142.2 symbols/min
[2025-10-24T01:21:18.796404] [DEBUG] [LOCAL     ] EMF: Loaded 3111 existing records from primary storage.
[2025-10-24T01:21:18.797062] [DEBUG] [LOCAL     ] EME: Loaded 30969 existing records from primary storage.
[2025-10-24T01:21:18.797259] [INFO ] [MAIN      ] EME: Loaded 30969 primary data records.
[2025-10-24T01:21:18.797131] [INFO ] [MAIN      ] EMF: Loaded 3111 primary data records.
[2025-10-24T01:21:19.460438] [DEBUG] [MAIN      ] EME: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:19.491417] [DEBUG] [MAIN      ] EMF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:19.541869] [INFO ] [MAIN      ] EME: Generated 139 derivative records from 30969 primary records.
[2025-10-24T01:21:19.545433] [DEBUG] [LOCAL     ] EME: Saving derivative data.
[2025-10-24T01:21:19.559624] [INFO ] [MAIN      ] EMF: Generated 139 derivative records from 3111 primary records.
[2025-10-24T01:21:19.561397] [DEBUG] [LOCAL     ] EME: Derivative data saved (139 records).
[2025-10-24T01:21:19.561536] [DEBUG] [LOCAL     ] EMF: Saving derivative data.
[2025-10-24T01:21:19.561608] [INFO ] [MAIN      ] EME: Successfully saved derivative data.
[2025-10-24T01:21:19.564340] [INFO ] [MAIN      ] Derivative Progress: 659/2164 symbols completed. EME took 0.9s. Estimated remaining: 10m 36s. Rate: 142.0 symbols/min
[2025-10-24T01:21:19.574442] [DEBUG] [LOCAL     ] EMF: Derivative data saved (139 records).
[2025-10-24T01:21:19.574544] [INFO ] [MAIN      ] EMF: Successfully saved derivative data.
[2025-10-24T01:21:19.577210] [INFO ] [MAIN      ] Derivative Progress: 660/2164 symbols completed. EMF took 0.8s. Estimated remaining: 10m 35s. Rate: 142.2 symbols/min
[2025-10-24T01:21:19.577720] [INFO ] [MAIN      ] EMN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:19.577809] [INFO ] [MAIN      ] EMO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:19.577853] [INFO ] [MAIN      ] EMP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:19.586266] [DEBUG] [LOCAL     ] EMP: Loaded 2894 existing records from primary storage.
[2025-10-24T01:21:19.586595] [INFO ] [MAIN      ] EMP: Loaded 2894 primary data records.
[2025-10-24T01:21:19.668198] [DEBUG] [LOCAL     ] EMO: Loaded 13427 existing records from primary storage.
[2025-10-24T01:21:19.692446] [INFO ] [MAIN      ] EMO: Loaded 13427 primary data records.
[2025-10-24T01:21:20.067978] [DEBUG] [LOCAL     ] EMN: Loaded 51204 existing records from primary storage.
[2025-10-24T01:21:20.073717] [INFO ] [MAIN      ] EMN: Loaded 51204 primary data records.
[2025-10-24T01:21:20.606245] [DEBUG] [MAIN      ] EMP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:20.639573] [DEBUG] [MAIN      ] EMO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:20.687437] [DEBUG] [MAIN      ] EMN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:20.723669] [INFO ] [MAIN      ] EMP: Generated 139 derivative records from 2894 primary records.
[2025-10-24T01:21:20.725707] [DEBUG] [LOCAL     ] EMP: Saving derivative data.
[2025-10-24T01:21:20.740495] [DEBUG] [LOCAL     ] EMP: Derivative data saved (139 records).
[2025-10-24T01:21:20.740623] [INFO ] [MAIN      ] EMP: Successfully saved derivative data.
[2025-10-24T01:21:20.743194] [INFO ] [MAIN      ] Derivative Progress: 661/2164 symbols completed. EMP took 1.2s. Estimated remaining: 10m 36s. Rate: 141.8 symbols/min
[2025-10-24T01:21:20.743437] [INFO ] [MAIN      ] EMR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:20.749540] [INFO ] [MAIN      ] EMO: Generated 139 derivative records from 13427 primary records.
[2025-10-24T01:21:20.750054] [DEBUG] [LOCAL     ] EMO: Saving derivative data.
[2025-10-24T01:21:20.766410] [DEBUG] [LOCAL     ] EMO: Derivative data saved (139 records).
[2025-10-24T01:21:20.769264] [INFO ] [MAIN      ] EMO: Successfully saved derivative data.
[2025-10-24T01:21:20.772135] [INFO ] [MAIN      ] Derivative Progress: 662/2164 symbols completed. EMO took 1.2s. Estimated remaining: 10m 35s. Rate: 142.0 symbols/min
[2025-10-24T01:21:20.773911] [INFO ] [MAIN      ] ENB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:20.777556] [INFO ] [MAIN      ] EMN: Generated 139 derivative records from 51204 primary records.
[2025-10-24T01:21:20.777893] [DEBUG] [LOCAL     ] EMN: Saving derivative data.
[2025-10-24T01:21:20.790177] [DEBUG] [LOCAL     ] EMN: Derivative data saved (139 records).
[2025-10-24T01:21:20.790484] [INFO ] [MAIN      ] EMN: Successfully saved derivative data.
[2025-10-24T01:21:20.793486] [INFO ] [MAIN      ] Derivative Progress: 663/2164 symbols completed. EMN took 1.2s. Estimated remaining: 10m 33s. Rate: 142.2 symbols/min
[2025-10-24T01:21:20.793799] [INFO ] [MAIN      ] ENO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:20.798554] [DEBUG] [LOCAL     ] ENO: Loaded 1746 existing records from primary storage.
[2025-10-24T01:21:20.798858] [INFO ] [MAIN      ] ENO: Loaded 1746 primary data records.
[2025-10-24T01:21:21.037539] [DEBUG] [LOCAL     ] EMR: Loaded 53551 existing records from primary storage.
[2025-10-24T01:21:21.169491] [INFO ] [MAIN      ] EMR: Loaded 53551 primary data records.
[2025-10-24T01:21:21.214900] [DEBUG] [LOCAL     ] ENB: Loaded 53901 existing records from primary storage.
[2025-10-24T01:21:21.243283] [INFO ] [MAIN      ] ENB: Loaded 53901 primary data records.
[2025-10-24T01:21:21.873828] [DEBUG] [MAIN      ] ENO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:21.949701] [DEBUG] [MAIN      ] EMR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:21.952308] [DEBUG] [MAIN      ] ENB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:21.985116] [INFO ] [MAIN      ] ENO: Generated 139 derivative records from 1746 primary records.
[2025-10-24T01:21:21.990378] [DEBUG] [LOCAL     ] ENO: Saving derivative data.
[2025-10-24T01:21:22.004440] [DEBUG] [LOCAL     ] ENO: Derivative data saved (139 records).
[2025-10-24T01:21:22.011208] [INFO ] [MAIN      ] ENO: Successfully saved derivative data.
[2025-10-24T01:21:22.014553] [INFO ] [MAIN      ] Derivative Progress: 664/2164 symbols completed. ENO took 1.2s. Estimated remaining: 10m 35s. Rate: 141.8 symbols/min
[2025-10-24T01:21:22.016449] [INFO ] [MAIN      ] ENOV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:22.049617] [INFO ] [MAIN      ] EMR: Generated 139 derivative records from 53551 primary records.
[2025-10-24T01:21:22.063390] [DEBUG] [LOCAL     ] EMR: Saving derivative data.
[2025-10-24T01:21:22.069762] [INFO ] [MAIN      ] ENB: Generated 139 derivative records from 53901 primary records.
[2025-10-24T01:21:22.083779] [DEBUG] [LOCAL     ] ENB: Saving derivative data.
[2025-10-24T01:21:22.088573] [DEBUG] [LOCAL     ] EMR: Derivative data saved (139 records).
[2025-10-24T01:21:22.089891] [INFO ] [MAIN      ] EMR: Successfully saved derivative data.
[2025-10-24T01:21:22.095978] [INFO ] [MAIN      ] Derivative Progress: 665/2164 symbols completed. EMR took 1.4s. Estimated remaining: 10m 34s. Rate: 142.0 symbols/min
[2025-10-24T01:21:22.120808] [DEBUG] [LOCAL     ] ENB: Derivative data saved (139 records).
[2025-10-24T01:21:22.121933] [DEBUG] [LOCAL     ] ENOV: Loaded 44895 existing records from primary storage.
[2025-10-24T01:21:22.122109] [INFO ] [MAIN      ] ENB: Successfully saved derivative data.
[2025-10-24T01:21:22.122218] [INFO ] [MAIN      ] ENOV: Loaded 44895 primary data records.
[2025-10-24T01:21:22.122417] [INFO ] [MAIN      ] ENR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:22.125548] [INFO ] [MAIN      ] Derivative Progress: 666/2164 symbols completed. ENB took 1.4s. Estimated remaining: 10m 32s. Rate: 142.2 symbols/min
[2025-10-24T01:21:22.196706] [INFO ] [MAIN      ] ENS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:22.457497] [DEBUG] [LOCAL     ] ENS: Loaded 29875 existing records from primary storage.
[2025-10-24T01:21:22.458075] [INFO ] [MAIN      ] ENS: Loaded 29875 primary data records.
[2025-10-24T01:21:22.673737] [DEBUG] [LOCAL     ] ENR: Loaded 44097 existing records from primary storage.
[2025-10-24T01:21:22.794173] [INFO ] [MAIN      ] ENR: Loaded 44097 primary data records.
[2025-10-24T01:21:22.934913] [DEBUG] [MAIN      ] ENOV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:23.212187] [DEBUG] [MAIN      ] ENS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:23.239618] [INFO ] [MAIN      ] ENOV: Generated 139 derivative records from 44895 primary records.
[2025-10-24T01:21:23.241744] [DEBUG] [LOCAL     ] ENOV: Saving derivative data.
[2025-10-24T01:21:23.260315] [DEBUG] [LOCAL     ] ENOV: Derivative data saved (139 records).
[2025-10-24T01:21:23.260717] [INFO ] [MAIN      ] ENOV: Successfully saved derivative data.
[2025-10-24T01:21:23.263250] [INFO ] [MAIN      ] Derivative Progress: 667/2164 symbols completed. ENOV took 1.2s. Estimated remaining: 10m 33s. Rate: 141.8 symbols/min
[2025-10-24T01:21:23.275976] [INFO ] [MAIN      ] ENVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:23.276794] [DEBUG] [MAIN      ] ENR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:23.314324] [INFO ] [MAIN      ] ENS: Generated 139 derivative records from 29875 primary records.
[2025-10-24T01:21:23.315631] [DEBUG] [LOCAL     ] ENS: Saving derivative data.
[2025-10-24T01:21:23.329221] [DEBUG] [LOCAL     ] ENVA: Loaded 25451 existing records from primary storage.
[2025-10-24T01:21:23.336603] [INFO ] [MAIN      ] ENVA: Loaded 25451 primary data records.
[2025-10-24T01:21:23.343513] [DEBUG] [LOCAL     ] ENS: Derivative data saved (139 records).
[2025-10-24T01:21:23.374345] [INFO ] [MAIN      ] ENS: Successfully saved derivative data.
[2025-10-24T01:21:23.377353] [INFO ] [MAIN      ] Derivative Progress: 668/2164 symbols completed. ENS took 1.2s. Estimated remaining: 10m 32s. Rate: 142.0 symbols/min
[2025-10-24T01:21:23.415388] [INFO ] [MAIN      ] EOD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:23.642809] [INFO ] [MAIN      ] ENR: Generated 139 derivative records from 44097 primary records.
[2025-10-24T01:21:23.657580] [DEBUG] [LOCAL     ] ENR: Saving derivative data.
[2025-10-24T01:21:23.658027] [DEBUG] [LOCAL     ] EOD: Loaded 14980 existing records from primary storage.
[2025-10-24T01:21:23.658851] [INFO ] [MAIN      ] EOD: Loaded 14980 primary data records.
[2025-10-24T01:21:23.724620] [DEBUG] [LOCAL     ] ENR: Derivative data saved (139 records).
[2025-10-24T01:21:23.748768] [INFO ] [MAIN      ] ENR: Successfully saved derivative data.
[2025-10-24T01:21:23.776221] [INFO ] [MAIN      ] Derivative Progress: 669/2164 symbols completed. ENR took 1.7s. Estimated remaining: 10m 32s. Rate: 142.0 symbols/min
[2025-10-24T01:21:23.790263] [INFO ] [MAIN      ] EOG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:24.019725] [DEBUG] [MAIN      ] ENVA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:24.080211] [DEBUG] [LOCAL     ] EOG: Loaded 53780 existing records from primary storage.
[2025-10-24T01:21:24.081420] [INFO ] [MAIN      ] EOG: Loaded 53780 primary data records.
[2025-10-24T01:21:24.204354] [INFO ] [MAIN      ] ENVA: Generated 139 derivative records from 25451 primary records.
[2025-10-24T01:21:24.230173] [DEBUG] [LOCAL     ] ENVA: Saving derivative data.
[2025-10-24T01:21:24.235676] [DEBUG] [MAIN      ] EOD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:24.421111] [DEBUG] [LOCAL     ] ENVA: Derivative data saved (139 records).
[2025-10-24T01:21:24.431595] [INFO ] [MAIN      ] ENVA: Successfully saved derivative data.
[2025-10-24T01:21:24.434884] [INFO ] [MAIN      ] Derivative Progress: 670/2164 symbols completed. ENVA took 1.2s. Estimated remaining: 10m 32s. Rate: 141.9 symbols/min
[2025-10-24T01:21:24.437898] [INFO ] [MAIN      ] EOI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:24.462451] [INFO ] [MAIN      ] EOD: Generated 139 derivative records from 14980 primary records.
[2025-10-24T01:21:24.462763] [DEBUG] [LOCAL     ] EOD: Saving derivative data.
[2025-10-24T01:21:24.480502] [DEBUG] [LOCAL     ] EOD: Derivative data saved (139 records).
[2025-10-24T01:21:24.469113] [DEBUG] [LOCAL     ] EOI: Loaded 10479 existing records from primary storage.
[2025-10-24T01:21:24.480818] [INFO ] [MAIN      ] EOI: Loaded 10479 primary data records.
[2025-10-24T01:21:24.480640] [INFO ] [MAIN      ] EOD: Successfully saved derivative data.
[2025-10-24T01:21:24.489900] [INFO ] [MAIN      ] Derivative Progress: 671/2164 symbols completed. EOD took 1.1s. Estimated remaining: 10m 31s. Rate: 142.0 symbols/min
[2025-10-24T01:21:24.495952] [INFO ] [MAIN      ] EOS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:24.615735] [DEBUG] [MAIN      ] EOG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:24.730145] [DEBUG] [LOCAL     ] EOS: Loaded 14754 existing records from primary storage.
[2025-10-24T01:21:24.849076] [INFO ] [MAIN      ] EOS: Loaded 14754 primary data records.
[2025-10-24T01:21:25.257603] [INFO ] [MAIN      ] EOG: Generated 139 derivative records from 53780 primary records.
[2025-10-24T01:21:25.257862] [DEBUG] [LOCAL     ] EOG: Saving derivative data.
[2025-10-24T01:21:25.272458] [DEBUG] [LOCAL     ] EOG: Derivative data saved (139 records).
[2025-10-24T01:21:25.272609] [INFO ] [MAIN      ] EOG: Successfully saved derivative data.
[2025-10-24T01:21:25.275528] [INFO ] [MAIN      ] Derivative Progress: 672/2164 symbols completed. EOG took 1.5s. Estimated remaining: 10m 31s. Rate: 141.9 symbols/min
[2025-10-24T01:21:25.275722] [INFO ] [MAIN      ] EOT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:25.293479] [DEBUG] [MAIN      ] EOI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:25.317414] [DEBUG] [LOCAL     ] EOT: Loaded 7087 existing records from primary storage.
[2025-10-24T01:21:25.321530] [INFO ] [MAIN      ] EOT: Loaded 7087 primary data records.
[2025-10-24T01:21:25.403457] [DEBUG] [MAIN      ] EOS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:25.671782] [INFO ] [MAIN      ] EOI: Generated 139 derivative records from 10479 primary records.
[2025-10-24T01:21:25.673418] [DEBUG] [LOCAL     ] EOI: Saving derivative data.
[2025-10-24T01:21:25.690841] [DEBUG] [LOCAL     ] EOI: Derivative data saved (139 records).
[2025-10-24T01:21:25.692534] [INFO ] [MAIN      ] EOI: Successfully saved derivative data.
[2025-10-24T01:21:25.699899] [INFO ] [MAIN      ] Derivative Progress: 673/2164 symbols completed. EOI took 1.3s. Estimated remaining: 10m 31s. Rate: 141.9 symbols/min
[2025-10-24T01:21:25.704672] [INFO ] [MAIN      ] EOS: Generated 139 derivative records from 14754 primary records.
[2025-10-24T01:21:25.705014] [DEBUG] [LOCAL     ] EOS: Saving derivative data.
[2025-10-24T01:21:25.720115] [DEBUG] [LOCAL     ] EOS: Derivative data saved (139 records).
[2025-10-24T01:21:25.720278] [INFO ] [MAIN      ] EOS: Successfully saved derivative data.
[2025-10-24T01:21:25.723231] [INFO ] [MAIN      ] Derivative Progress: 674/2164 symbols completed. EOS took 1.2s. Estimated remaining: 10m 29s. Rate: 142.1 symbols/min
[2025-10-24T01:21:25.735920] [DEBUG] [MAIN      ] EOT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:25.761579] [INFO ] [MAIN      ] EOT: Generated 139 derivative records from 7087 primary records.
[2025-10-24T01:21:25.761709] [DEBUG] [LOCAL     ] EOT: Saving derivative data.
[2025-10-24T01:21:25.772834] [DEBUG] [LOCAL     ] EOT: Derivative data saved (139 records).
[2025-10-24T01:21:25.772916] [INFO ] [MAIN      ] EOT: Successfully saved derivative data.
[2025-10-24T01:21:25.775393] [INFO ] [MAIN      ] Derivative Progress: 675/2164 symbols completed. EOT took 0.5s. Estimated remaining: 10m 28s. Rate: 142.2 symbols/min
[2025-10-24T01:21:25.776127] [INFO ] [MAIN      ] EPAC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:25.776401] [INFO ] [MAIN      ] EPAM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:25.776674] [INFO ] [MAIN      ] EPC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:25.805784] [DEBUG] [LOCAL     ] EPAC: Loaded 26571 existing records from primary storage.
[2025-10-24T01:21:25.806307] [INFO ] [MAIN      ] EPAC: Loaded 26571 primary data records.
[2025-10-24T01:21:26.019578] [DEBUG] [LOCAL     ] EPC: Loaded 40003 existing records from primary storage.
[2025-10-24T01:21:26.043802] [INFO ] [MAIN      ] EPC: Loaded 40003 primary data records.
[2025-10-24T01:21:26.020521] [DEBUG] [LOCAL     ] EPAM: Loaded 39611 existing records from primary storage.
[2025-10-24T01:21:26.044149] [INFO ] [MAIN      ] EPAM: Loaded 39611 primary data records.
[2025-10-24T01:21:26.815428] [DEBUG] [MAIN      ] EPAC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:26.885869] [DEBUG] [MAIN      ] EPAM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:26.884927] [DEBUG] [MAIN      ] EPC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:26.919584] [INFO ] [MAIN      ] EPAC: Generated 139 derivative records from 26571 primary records.
[2025-10-24T01:21:26.928221] [DEBUG] [LOCAL     ] EPAC: Saving derivative data.
[2025-10-24T01:21:26.950599] [DEBUG] [LOCAL     ] EPAC: Derivative data saved (139 records).
[2025-10-24T01:21:26.954753] [INFO ] [MAIN      ] EPAC: Successfully saved derivative data.
[2025-10-24T01:21:26.957448] [INFO ] [MAIN      ] Derivative Progress: 676/2164 symbols completed. EPAC took 1.2s. Estimated remaining: 10m 29s. Rate: 141.9 symbols/min
[2025-10-24T01:21:26.958851] [INFO ] [MAIN      ] EPD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:26.972978] [INFO ] [MAIN      ] EPAM: Generated 139 derivative records from 39611 primary records.
[2025-10-24T01:21:26.976896] [INFO ] [MAIN      ] EPC: Generated 139 derivative records from 40003 primary records.
[2025-10-24T01:21:26.977175] [DEBUG] [LOCAL     ] EPC: Saving derivative data.
[2025-10-24T01:21:26.977233] [DEBUG] [LOCAL     ] EPAM: Saving derivative data.
[2025-10-24T01:21:27.001865] [DEBUG] [LOCAL     ] EPC: Derivative data saved (139 records).
[2025-10-24T01:21:27.002041] [INFO ] [MAIN      ] EPC: Successfully saved derivative data.
[2025-10-24T01:21:27.005845] [DEBUG] [LOCAL     ] EPAM: Derivative data saved (139 records).
[2025-10-24T01:21:27.009196] [INFO ] [MAIN      ] Derivative Progress: 677/2164 symbols completed. EPC took 1.2s. Estimated remaining: 10m 28s. Rate: 142.0 symbols/min
[2025-10-24T01:21:27.009389] [INFO ] [MAIN      ] EPRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:27.010070] [INFO ] [MAIN      ] EPAM: Successfully saved derivative data.
[2025-10-24T01:21:27.013143] [INFO ] [MAIN      ] Derivative Progress: 678/2164 symbols completed. EPAM took 1.2s. Estimated remaining: 10m 27s. Rate: 142.3 symbols/min
[2025-10-24T01:21:27.014115] [INFO ] [MAIN      ] EQBK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:27.064460] [DEBUG] [LOCAL     ] EQBK: Loaded 11385 existing records from primary storage.
[2025-10-24T01:21:27.065676] [DEBUG] [LOCAL     ] EPD: Loaded 53998 existing records from primary storage.
[2025-10-24T01:21:27.066060] [INFO ] [MAIN      ] EQBK: Loaded 11385 primary data records.
[2025-10-24T01:21:27.066356] [INFO ] [MAIN      ] EPD: Loaded 53998 primary data records.
[2025-10-24T01:21:27.384460] [DEBUG] [LOCAL     ] EPRT: Loaded 48861 existing records from primary storage.
[2025-10-24T01:21:27.595279] [INFO ] [MAIN      ] EPRT: Loaded 48861 primary data records.
[2025-10-24T01:21:28.090899] [DEBUG] [MAIN      ] EQBK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:28.119939] [DEBUG] [MAIN      ] EPD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:28.176971] [DEBUG] [MAIN      ] EPRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:28.203972] [INFO ] [MAIN      ] EQBK: Generated 139 derivative records from 11385 primary records.
[2025-10-24T01:21:28.206071] [DEBUG] [LOCAL     ] EQBK: Saving derivative data.
[2025-10-24T01:21:28.222752] [DEBUG] [LOCAL     ] EQBK: Derivative data saved (139 records).
[2025-10-24T01:21:28.224978] [INFO ] [MAIN      ] EQBK: Successfully saved derivative data.
[2025-10-24T01:21:28.232406] [INFO ] [MAIN      ] Derivative Progress: 679/2164 symbols completed. EQBK took 1.2s. Estimated remaining: 10m 28s. Rate: 141.9 symbols/min
[2025-10-24T01:21:28.236287] [INFO ] [MAIN      ] EQH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:28.242373] [INFO ] [MAIN      ] EPD: Generated 139 derivative records from 53998 primary records.
[2025-10-24T01:21:28.245568] [DEBUG] [LOCAL     ] EPD: Saving derivative data.
[2025-10-24T01:21:28.257309] [INFO ] [MAIN      ] EPRT: Generated 139 derivative records from 48861 primary records.
[2025-10-24T01:21:28.260744] [DEBUG] [LOCAL     ] EPRT: Saving derivative data.
[2025-10-24T01:21:28.270629] [DEBUG] [LOCAL     ] EPD: Derivative data saved (139 records).
[2025-10-24T01:21:28.273330] [INFO ] [MAIN      ] EPD: Successfully saved derivative data.
[2025-10-24T01:21:28.276996] [INFO ] [MAIN      ] Derivative Progress: 680/2164 symbols completed. EPD took 1.3s. Estimated remaining: 10m 27s. Rate: 142.0 symbols/min
[2025-10-24T01:21:28.278433] [INFO ] [MAIN      ] EQNR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:28.279423] [DEBUG] [LOCAL     ] EPRT: Derivative data saved (139 records).
[2025-10-24T01:21:28.279507] [INFO ] [MAIN      ] EPRT: Successfully saved derivative data.
[2025-10-24T01:21:28.282852] [INFO ] [MAIN      ] Derivative Progress: 681/2164 symbols completed. EPRT took 1.3s. Estimated remaining: 10m 25s. Rate: 142.3 symbols/min
[2025-10-24T01:21:28.283355] [INFO ] [MAIN      ] EQR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:28.325217] [DEBUG] [LOCAL     ] EQH: Loaded 53065 existing records from primary storage.
[2025-10-24T01:21:28.325751] [INFO ] [MAIN      ] EQH: Loaded 53065 primary data records.
[2025-10-24T01:21:28.514582] [DEBUG] [LOCAL     ] EQNR: Loaded 53437 existing records from primary storage.
[2025-10-24T01:21:28.538692] [INFO ] [MAIN      ] EQNR: Loaded 53437 primary data records.
[2025-10-24T01:21:28.670451] [DEBUG] [LOCAL     ] EQR: Loaded 52192 existing records from primary storage.
[2025-10-24T01:21:28.705056] [INFO ] [MAIN      ] EQR: Loaded 52192 primary data records.
[2025-10-24T01:21:29.437817] [DEBUG] [MAIN      ] EQH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:29.534633] [DEBUG] [MAIN      ] EQR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:29.562827] [DEBUG] [MAIN      ] EQNR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:29.616230] [INFO ] [MAIN      ] EQH: Generated 139 derivative records from 53065 primary records.
[2025-10-24T01:21:29.617474] [DEBUG] [LOCAL     ] EQH: Saving derivative data.
[2025-10-24T01:21:29.637214] [DEBUG] [LOCAL     ] EQH: Derivative data saved (139 records).
[2025-10-24T01:21:29.639560] [INFO ] [MAIN      ] EQH: Successfully saved derivative data.
[2025-10-24T01:21:29.642469] [INFO ] [MAIN      ] Derivative Progress: 682/2164 symbols completed. EQH took 1.4s. Estimated remaining: 10m 27s. Rate: 141.8 symbols/min
[2025-10-24T01:21:29.649746] [INFO ] [MAIN      ] EQT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:29.655121] [INFO ] [MAIN      ] EQR: Generated 139 derivative records from 52192 primary records.
[2025-10-24T01:21:29.657981] [DEBUG] [LOCAL     ] EQR: Saving derivative data.
[2025-10-24T01:21:29.657580] [INFO ] [MAIN      ] EQNR: Generated 139 derivative records from 53437 primary records.
[2025-10-24T01:21:29.659313] [DEBUG] [LOCAL     ] EQNR: Saving derivative data.
[2025-10-24T01:21:29.678763] [DEBUG] [LOCAL     ] EQR: Derivative data saved (139 records).
[2025-10-24T01:21:29.678968] [INFO ] [MAIN      ] EQR: Successfully saved derivative data.
[2025-10-24T01:21:29.682318] [INFO ] [MAIN      ] Derivative Progress: 683/2164 symbols completed. EQR took 1.4s. Estimated remaining: 10m 26s. Rate: 142.0 symbols/min
[2025-10-24T01:21:29.682764] [INFO ] [MAIN      ] EQV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:29.699129] [DEBUG] [LOCAL     ] EQNR: Derivative data saved (139 records).
[2025-10-24T01:21:29.699497] [INFO ] [MAIN      ] EQNR: Successfully saved derivative data.
[2025-10-24T01:21:29.705961] [INFO ] [MAIN      ] Derivative Progress: 684/2164 symbols completed. EQNR took 1.4s. Estimated remaining: 10m 25s. Rate: 142.2 symbols/min
[2025-10-24T01:21:29.702602] [DEBUG] [LOCAL     ] EQV: Loaded 2771 existing records from primary storage.
[2025-10-24T01:21:29.706357] [INFO ] [MAIN      ] ERJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:29.706677] [INFO ] [MAIN      ] EQV: Loaded 2771 primary data records.
[2025-10-24T01:21:29.881913] [DEBUG] [LOCAL     ] EQT: Loaded 54075 existing records from primary storage.
[2025-10-24T01:21:29.918603] [INFO ] [MAIN      ] EQT: Loaded 54075 primary data records.
[2025-10-24T01:21:30.175824] [DEBUG] [LOCAL     ] ERJ: Loaded 50666 existing records from primary storage.
[2025-10-24T01:21:30.219306] [INFO ] [MAIN      ] ERJ: Loaded 50666 primary data records.
[2025-10-24T01:21:30.795288] [DEBUG] [MAIN      ] EQV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:30.869471] [DEBUG] [MAIN      ] ERJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:30.883119] [DEBUG] [MAIN      ] EQT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:30.887215] [INFO ] [MAIN      ] EQV: Generated 139 derivative records from 2771 primary records.
[2025-10-24T01:21:30.913744] [DEBUG] [LOCAL     ] EQV: Saving derivative data.
[2025-10-24T01:21:30.938897] [DEBUG] [LOCAL     ] EQV: Derivative data saved (139 records).
[2025-10-24T01:21:30.941574] [INFO ] [MAIN      ] EQV: Successfully saved derivative data.
[2025-10-24T01:21:30.944451] [INFO ] [MAIN      ] Derivative Progress: 685/2164 symbols completed. EQV took 1.3s. Estimated remaining: 10m 26s. Rate: 141.8 symbols/min
[2025-10-24T01:21:30.948767] [INFO ] [MAIN      ] ERO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:30.976094] [INFO ] [MAIN      ] ERJ: Generated 139 derivative records from 50666 primary records.
[2025-10-24T01:21:30.976298] [DEBUG] [LOCAL     ] ERJ: Saving derivative data.
[2025-10-24T01:21:30.998475] [INFO ] [MAIN      ] EQT: Generated 139 derivative records from 54075 primary records.
[2025-10-24T01:21:31.000682] [DEBUG] [LOCAL     ] EQT: Saving derivative data.
[2025-10-24T01:21:31.002947] [DEBUG] [LOCAL     ] ERJ: Derivative data saved (139 records).
[2025-10-24T01:21:31.003371] [INFO ] [MAIN      ] ERJ: Successfully saved derivative data.
[2025-10-24T01:21:31.013686] [INFO ] [MAIN      ] Derivative Progress: 686/2164 symbols completed. ERJ took 1.3s. Estimated remaining: 10m 25s. Rate: 141.9 symbols/min
[2025-10-24T01:21:31.016821] [INFO ] [MAIN      ] ESAB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:31.020312] [DEBUG] [LOCAL     ] EQT: Derivative data saved (139 records).
[2025-10-24T01:21:31.020753] [INFO ] [MAIN      ] EQT: Successfully saved derivative data.
[2025-10-24T01:21:31.035334] [INFO ] [MAIN      ] Derivative Progress: 687/2164 symbols completed. EQT took 1.4s. Estimated remaining: 10m 23s. Rate: 142.1 symbols/min
[2025-10-24T01:21:31.035804] [INFO ] [MAIN      ] ESE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:31.036681] [DEBUG] [LOCAL     ] ERO: Loaded 42461 existing records from primary storage.
[2025-10-24T01:21:31.037476] [INFO ] [MAIN      ] ERO: Loaded 42461 primary data records.
[2025-10-24T01:21:31.160134] [DEBUG] [LOCAL     ] ESE: Loaded 16534 existing records from primary storage.
[2025-10-24T01:21:31.200308] [INFO ] [MAIN      ] ESE: Loaded 16534 primary data records.
[2025-10-24T01:21:31.381462] [DEBUG] [LOCAL     ] ESAB: Loaded 26116 existing records from primary storage.
[2025-10-24T01:21:31.394554] [INFO ] [MAIN      ] ESAB: Loaded 26116 primary data records.
[2025-10-24T01:21:32.056449] [DEBUG] [MAIN      ] ERO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:32.096416] [DEBUG] [MAIN      ] ESE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:32.144070] [INFO ] [MAIN      ] ERO: Generated 139 derivative records from 42461 primary records.
[2025-10-24T01:21:32.144973] [DEBUG] [LOCAL     ] ERO: Saving derivative data.
[2025-10-24T01:21:32.144521] [DEBUG] [MAIN      ] ESAB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:32.176198] [DEBUG] [LOCAL     ] ERO: Derivative data saved (139 records).
[2025-10-24T01:21:32.177532] [INFO ] [MAIN      ] ERO: Successfully saved derivative data.
[2025-10-24T01:21:32.183340] [INFO ] [MAIN      ] Derivative Progress: 688/2164 symbols completed. ERO took 1.2s. Estimated remaining: 10m 25s. Rate: 141.8 symbols/min
[2025-10-24T01:21:32.201996] [INFO ] [MAIN      ] ESE: Generated 139 derivative records from 16534 primary records.
[2025-10-24T01:21:32.203140] [DEBUG] [LOCAL     ] ESE: Saving derivative data.
[2025-10-24T01:21:32.218609] [DEBUG] [LOCAL     ] ESE: Derivative data saved (139 records).
[2025-10-24T01:21:32.218837] [INFO ] [MAIN      ] ESE: Successfully saved derivative data.
[2025-10-24T01:21:32.221830] [INFO ] [MAIN      ] Derivative Progress: 689/2164 symbols completed. ESE took 1.2s. Estimated remaining: 10m 23s. Rate: 142.0 symbols/min
[2025-10-24T01:21:32.224100] [INFO ] [MAIN      ] ESAB: Generated 139 derivative records from 26116 primary records.
[2025-10-24T01:21:32.224269] [DEBUG] [LOCAL     ] ESAB: Saving derivative data.
[2025-10-24T01:21:32.236471] [DEBUG] [LOCAL     ] ESAB: Derivative data saved (139 records).
[2025-10-24T01:21:32.236558] [INFO ] [MAIN      ] ESAB: Successfully saved derivative data.
[2025-10-24T01:21:32.239672] [INFO ] [MAIN      ] Derivative Progress: 690/2164 symbols completed. ESAB took 1.2s. Estimated remaining: 10m 22s. Rate: 142.2 symbols/min
[2025-10-24T01:21:32.240147] [INFO ] [MAIN      ] ESI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:32.240309] [INFO ] [MAIN      ] ESRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:32.240371] [INFO ] [MAIN      ] ESNT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:32.294600] [DEBUG] [LOCAL     ] ESRT: Loaded 46911 existing records from primary storage.
[2025-10-24T01:21:32.294797] [INFO ] [MAIN      ] ESRT: Loaded 46911 primary data records.
[2025-10-24T01:21:32.422797] [DEBUG] [LOCAL     ] ESNT: Loaded 38188 existing records from primary storage.
[2025-10-24T01:21:32.433869] [INFO ] [MAIN      ] ESNT: Loaded 38188 primary data records.
[2025-10-24T01:21:32.720708] [DEBUG] [LOCAL     ] ESI: Loaded 51006 existing records from primary storage.
[2025-10-24T01:21:32.745413] [INFO ] [MAIN      ] ESI: Loaded 51006 primary data records.
[2025-10-24T01:21:33.283987] [DEBUG] [MAIN      ] ESRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:33.329377] [DEBUG] [MAIN      ] ESNT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:33.365456] [INFO ] [MAIN      ] ESRT: Generated 139 derivative records from 46911 primary records.
[2025-10-24T01:21:33.367197] [DEBUG] [LOCAL     ] ESRT: Saving derivative data.
[2025-10-24T01:21:33.381058] [DEBUG] [MAIN      ] ESI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:33.409682] [DEBUG] [LOCAL     ] ESRT: Derivative data saved (139 records).
[2025-10-24T01:21:33.409940] [INFO ] [MAIN      ] ESRT: Successfully saved derivative data.
[2025-10-24T01:21:33.412924] [INFO ] [MAIN      ] Derivative Progress: 691/2164 symbols completed. ESRT took 1.2s. Estimated remaining: 10m 23s. Rate: 141.8 symbols/min
[2025-10-24T01:21:33.413498] [INFO ] [MAIN      ] ESS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:33.439897] [INFO ] [MAIN      ] ESNT: Generated 139 derivative records from 38188 primary records.
[2025-10-24T01:21:33.449659] [DEBUG] [LOCAL     ] ESNT: Saving derivative data.
[2025-10-24T01:21:33.475933] [DEBUG] [LOCAL     ] ESS: Loaded 30386 existing records from primary storage.
[2025-10-24T01:21:33.481460] [INFO ] [MAIN      ] ESS: Loaded 30386 primary data records.
[2025-10-24T01:21:33.482847] [DEBUG] [LOCAL     ] ESNT: Derivative data saved (139 records).
[2025-10-24T01:21:33.553791] [INFO ] [MAIN      ] ESNT: Successfully saved derivative data.
[2025-10-24T01:21:33.573251] [INFO ] [MAIN      ] Derivative Progress: 692/2164 symbols completed. ESNT took 1.3s. Estimated remaining: 10m 22s. Rate: 141.9 symbols/min
[2025-10-24T01:21:33.569758] [INFO ] [MAIN      ] ESI: Generated 139 derivative records from 51006 primary records.
[2025-10-24T01:21:33.583924] [INFO ] [MAIN      ] ESTC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:33.589451] [DEBUG] [LOCAL     ] ESI: Saving derivative data.
[2025-10-24T01:21:33.663528] [DEBUG] [LOCAL     ] ESI: Derivative data saved (139 records).
[2025-10-24T01:21:33.679925] [INFO ] [MAIN      ] ESI: Successfully saved derivative data.
[2025-10-24T01:21:33.707101] [INFO ] [MAIN      ] Derivative Progress: 693/2164 symbols completed. ESI took 1.5s. Estimated remaining: 10m 21s. Rate: 142.1 symbols/min
[2025-10-24T01:21:33.855957] [INFO ] [MAIN      ] ET: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:33.884411] [DEBUG] [LOCAL     ] ESTC: Loaded 50579 existing records from primary storage.
[2025-10-24T01:21:33.884723] [INFO ] [MAIN      ] ESTC: Loaded 50579 primary data records.
[2025-10-24T01:21:34.178763] [DEBUG] [LOCAL     ] ET: Loaded 54179 existing records from primary storage.
[2025-10-24T01:21:34.275497] [INFO ] [MAIN      ] ET: Loaded 54179 primary data records.
[2025-10-24T01:21:34.319531] [DEBUG] [MAIN      ] ESS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:34.806091] [DEBUG] [MAIN      ] ESTC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:34.828854] [INFO ] [MAIN      ] ESS: Generated 139 derivative records from 30386 primary records.
[2025-10-24T01:21:34.832596] [DEBUG] [LOCAL     ] ESS: Saving derivative data.
[2025-10-24T01:21:34.863920] [DEBUG] [LOCAL     ] ESS: Derivative data saved (139 records).
[2025-10-24T01:21:34.869085] [INFO ] [MAIN      ] ESS: Successfully saved derivative data.
[2025-10-24T01:21:34.873068] [INFO ] [MAIN      ] Derivative Progress: 694/2164 symbols completed. ESS took 1.5s. Estimated remaining: 10m 22s. Rate: 141.7 symbols/min
[2025-10-24T01:21:34.878850] [INFO ] [MAIN      ] ETB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:34.912526] [DEBUG] [MAIN      ] ET: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:34.935735] [INFO ] [MAIN      ] ESTC: Generated 139 derivative records from 50579 primary records.
[2025-10-24T01:21:34.942999] [DEBUG] [LOCAL     ] ESTC: Saving derivative data.
[2025-10-24T01:21:34.965704] [DEBUG] [LOCAL     ] ETB: Loaded 11826 existing records from primary storage.
[2025-10-24T01:21:34.973062] [INFO ] [MAIN      ] ETB: Loaded 11826 primary data records.
[2025-10-24T01:21:34.968381] [DEBUG] [LOCAL     ] ESTC: Derivative data saved (139 records).
[2025-10-24T01:21:35.000487] [INFO ] [MAIN      ] ESTC: Successfully saved derivative data.
[2025-10-24T01:21:35.016586] [INFO ] [MAIN      ] Derivative Progress: 695/2164 symbols completed. ESTC took 1.4s. Estimated remaining: 10m 21s. Rate: 141.9 symbols/min
[2025-10-24T01:21:35.048831] [INFO ] [MAIN      ] ETD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:35.235358] [INFO ] [MAIN      ] ET: Generated 139 derivative records from 54179 primary records.
[2025-10-24T01:21:35.235799] [DEBUG] [LOCAL     ] ET: Saving derivative data.
[2025-10-24T01:21:35.386131] [DEBUG] [LOCAL     ] ETD: Loaded 27262 existing records from primary storage.
[2025-10-24T01:21:35.388435] [INFO ] [MAIN      ] ETD: Loaded 27262 primary data records.
[2025-10-24T01:21:35.391321] [DEBUG] [LOCAL     ] ET: Derivative data saved (139 records).
[2025-10-24T01:21:35.392371] [INFO ] [MAIN      ] ET: Successfully saved derivative data.
[2025-10-24T01:21:35.410033] [INFO ] [MAIN      ] Derivative Progress: 696/2164 symbols completed. ET took 1.6s. Estimated remaining: 10m 21s. Rate: 141.9 symbols/min
[2025-10-24T01:21:35.432459] [INFO ] [MAIN      ] ETG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:35.717112] [DEBUG] [LOCAL     ] ETG: Loaded 16587 existing records from primary storage.
[2025-10-24T01:21:35.717746] [INFO ] [MAIN      ] ETG: Loaded 16587 primary data records.
[2025-10-24T01:21:35.798573] [DEBUG] [MAIN      ] ETB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:36.120499] [DEBUG] [MAIN      ] ETD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:36.169830] [INFO ] [MAIN      ] ETB: Generated 139 derivative records from 11826 primary records.
[2025-10-24T01:21:36.185765] [DEBUG] [LOCAL     ] ETB: Saving derivative data.
[2025-10-24T01:21:36.186151] [DEBUG] [MAIN      ] ETG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:36.217311] [DEBUG] [LOCAL     ] ETB: Derivative data saved (139 records).
[2025-10-24T01:21:36.218951] [INFO ] [MAIN      ] ETB: Successfully saved derivative data.
[2025-10-24T01:21:36.222713] [INFO ] [MAIN      ] Derivative Progress: 697/2164 symbols completed. ETB took 1.3s. Estimated remaining: 10m 21s. Rate: 141.7 symbols/min
[2025-10-24T01:21:36.223091] [INFO ] [MAIN      ] ETJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:36.226466] [INFO ] [MAIN      ] ETD: Generated 139 derivative records from 27262 primary records.
[2025-10-24T01:21:36.229506] [DEBUG] [LOCAL     ] ETD: Saving derivative data.
[2025-10-24T01:21:36.247095] [DEBUG] [LOCAL     ] ETD: Derivative data saved (139 records).
[2025-10-24T01:21:36.253200] [INFO ] [MAIN      ] ETD: Successfully saved derivative data.
[2025-10-24T01:21:36.259276] [INFO ] [MAIN      ] Derivative Progress: 698/2164 symbols completed. ETD took 1.2s. Estimated remaining: 10m 20s. Rate: 141.9 symbols/min
[2025-10-24T01:21:36.267468] [INFO ] [MAIN      ] ETN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:36.269007] [DEBUG] [LOCAL     ] ETJ: Loaded 16510 existing records from primary storage.
[2025-10-24T01:21:36.272392] [INFO ] [MAIN      ] ETJ: Loaded 16510 primary data records.
[2025-10-24T01:21:36.298733] [INFO ] [MAIN      ] ETG: Generated 139 derivative records from 16587 primary records.
[2025-10-24T01:21:36.336238] [DEBUG] [LOCAL     ] ETG: Saving derivative data.
[2025-10-24T01:21:36.424213] [DEBUG] [LOCAL     ] ETG: Derivative data saved (139 records).
[2025-10-24T01:21:36.466460] [INFO ] [MAIN      ] ETG: Successfully saved derivative data.
[2025-10-24T01:21:36.663338] [INFO ] [MAIN      ] Derivative Progress: 699/2164 symbols completed. ETG took 1.2s. Estimated remaining: 10m 20s. Rate: 141.9 symbols/min
[2025-10-24T01:21:36.678707] [INFO ] [MAIN      ] ETO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:36.711216] [DEBUG] [LOCAL     ] ETN: Loaded 52954 existing records from primary storage.
[2025-10-24T01:21:36.709735] [DEBUG] [LOCAL     ] ETO: Loaded 6917 existing records from primary storage.
[2025-10-24T01:21:36.711699] [INFO ] [MAIN      ] ETN: Loaded 52954 primary data records.
[2025-10-24T01:21:36.711780] [INFO ] [MAIN      ] ETO: Loaded 6917 primary data records.
[2025-10-24T01:21:37.132306] [DEBUG] [MAIN      ] ETJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:37.402367] [INFO ] [MAIN      ] ETJ: Generated 139 derivative records from 16510 primary records.
[2025-10-24T01:21:37.404031] [DEBUG] [MAIN      ] ETN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:37.404216] [DEBUG] [LOCAL     ] ETJ: Saving derivative data.
[2025-10-24T01:21:37.433559] [DEBUG] [LOCAL     ] ETJ: Derivative data saved (139 records).
[2025-10-24T01:21:37.448899] [DEBUG] [MAIN      ] ETO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:37.446717] [INFO ] [MAIN      ] ETJ: Successfully saved derivative data.
[2025-10-24T01:21:37.466094] [INFO ] [MAIN      ] Derivative Progress: 700/2164 symbols completed. ETJ took 1.2s. Estimated remaining: 10m 20s. Rate: 141.7 symbols/min
[2025-10-24T01:21:37.469136] [INFO ] [MAIN      ] ETR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:37.502466] [INFO ] [MAIN      ] ETN: Generated 139 derivative records from 52954 primary records.
[2025-10-24T01:21:37.507598] [DEBUG] [LOCAL     ] ETN: Saving derivative data.
[2025-10-24T01:21:37.525237] [INFO ] [MAIN      ] ETO: Generated 139 derivative records from 6917 primary records.
[2025-10-24T01:21:37.532890] [DEBUG] [LOCAL     ] ETO: Saving derivative data.
[2025-10-24T01:21:37.538118] [DEBUG] [LOCAL     ] ETN: Derivative data saved (139 records).
[2025-10-24T01:21:37.538228] [INFO ] [MAIN      ] ETN: Successfully saved derivative data.
[2025-10-24T01:21:37.548708] [INFO ] [MAIN      ] Derivative Progress: 701/2164 symbols completed. ETN took 1.3s. Estimated remaining: 10m 19s. Rate: 141.9 symbols/min
[2025-10-24T01:21:37.552873] [INFO ] [MAIN      ] ETSY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:37.569779] [DEBUG] [LOCAL     ] ETO: Derivative data saved (139 records).
[2025-10-24T01:21:37.570266] [INFO ] [MAIN      ] ETO: Successfully saved derivative data.
[2025-10-24T01:21:37.571172] [DEBUG] [LOCAL     ] ETR: Loaded 53572 existing records from primary storage.
[2025-10-24T01:21:37.574588] [INFO ] [MAIN      ] ETR: Loaded 53572 primary data records.
[2025-10-24T01:21:37.574445] [INFO ] [MAIN      ] Derivative Progress: 702/2164 symbols completed. ETO took 0.9s. Estimated remaining: 10m 18s. Rate: 142.0 symbols/min
[2025-10-24T01:21:37.575024] [INFO ] [MAIN      ] ETV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:37.765491] [DEBUG] [LOCAL     ] ETV: Loaded 21947 existing records from primary storage.
[2025-10-24T01:21:37.788849] [INFO ] [MAIN      ] ETV: Loaded 21947 primary data records.
[2025-10-24T01:21:38.003565] [DEBUG] [LOCAL     ] ETSY: Loaded 53952 existing records from primary storage.
[2025-10-24T01:21:38.028612] [INFO ] [MAIN      ] ETSY: Loaded 53952 primary data records.
[2025-10-24T01:21:38.604082] [DEBUG] [MAIN      ] ETR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:38.654208] [DEBUG] [MAIN      ] ETV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:38.703428] [DEBUG] [MAIN      ] ETSY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:38.703816] [INFO ] [MAIN      ] ETR: Generated 139 derivative records from 53572 primary records.
[2025-10-24T01:21:38.721454] [DEBUG] [LOCAL     ] ETR: Saving derivative data.
[2025-10-24T01:21:38.757037] [DEBUG] [LOCAL     ] ETR: Derivative data saved (139 records).
[2025-10-24T01:21:38.757694] [INFO ] [MAIN      ] ETR: Successfully saved derivative data.
[2025-10-24T01:21:38.766820] [INFO ] [MAIN      ] Derivative Progress: 703/2164 symbols completed. ETR took 1.3s. Estimated remaining: 10m 19s. Rate: 141.7 symbols/min
[2025-10-24T01:21:38.776979] [INFO ] [MAIN      ] ETV: Generated 139 derivative records from 21947 primary records.
[2025-10-24T01:21:38.781159] [DEBUG] [LOCAL     ] ETV: Saving derivative data.
[2025-10-24T01:21:38.791275] [INFO ] [MAIN      ] ETSY: Generated 139 derivative records from 53952 primary records.
[2025-10-24T01:21:38.796196] [DEBUG] [LOCAL     ] ETV: Derivative data saved (139 records).
[2025-10-24T01:21:38.794590] [DEBUG] [LOCAL     ] ETSY: Saving derivative data.
[2025-10-24T01:21:38.796338] [INFO ] [MAIN      ] ETV: Successfully saved derivative data.
[2025-10-24T01:21:38.799229] [INFO ] [MAIN      ] Derivative Progress: 704/2164 symbols completed. ETV took 1.2s. Estimated remaining: 10m 17s. Rate: 141.9 symbols/min
[2025-10-24T01:21:38.811809] [DEBUG] [LOCAL     ] ETSY: Derivative data saved (139 records).
[2025-10-24T01:21:38.811968] [INFO ] [MAIN      ] ETSY: Successfully saved derivative data.
[2025-10-24T01:21:38.815237] [INFO ] [MAIN      ] Derivative Progress: 705/2164 symbols completed. ETSY took 1.3s. Estimated remaining: 10m 16s. Rate: 142.1 symbols/min
[2025-10-24T01:21:38.815958] [INFO ] [MAIN      ] ETX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:38.815872] [INFO ] [MAIN      ] ETW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:38.816550] [INFO ] [MAIN      ] ETY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:38.831070] [DEBUG] [LOCAL     ] ETX: Loaded 5361 existing records from primary storage.
[2025-10-24T01:21:38.831260] [INFO ] [MAIN      ] ETX: Loaded 5361 primary data records.
[2025-10-24T01:21:38.959390] [DEBUG] [LOCAL     ] ETY: Loaded 22481 existing records from primary storage.
[2025-10-24T01:21:38.979167] [INFO ] [MAIN      ] ETY: Loaded 22481 primary data records.
[2025-10-24T01:21:38.980315] [DEBUG] [LOCAL     ] ETW: Loaded 25243 existing records from primary storage.
[2025-10-24T01:21:39.001395] [INFO ] [MAIN      ] ETW: Loaded 25243 primary data records.
[2025-10-24T01:21:39.804225] [DEBUG] [MAIN      ] ETX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:39.836197] [DEBUG] [MAIN      ] ETY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:39.874099] [DEBUG] [MAIN      ] ETW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:39.921936] [INFO ] [MAIN      ] ETX: Generated 139 derivative records from 5361 primary records.
[2025-10-24T01:21:39.925952] [DEBUG] [LOCAL     ] ETX: Saving derivative data.
[2025-10-24T01:21:39.941806] [DEBUG] [LOCAL     ] ETX: Derivative data saved (139 records).
[2025-10-24T01:21:39.942396] [INFO ] [MAIN      ] ETX: Successfully saved derivative data.
[2025-10-24T01:21:39.945111] [INFO ] [MAIN      ] Derivative Progress: 706/2164 symbols completed. ETX took 1.1s. Estimated remaining: 10m 17s. Rate: 141.7 symbols/min
[2025-10-24T01:21:39.947900] [INFO ] [MAIN      ] EVC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:39.954216] [INFO ] [MAIN      ] ETY: Generated 139 derivative records from 22481 primary records.
[2025-10-24T01:21:39.954536] [DEBUG] [LOCAL     ] ETY: Saving derivative data.
[2025-10-24T01:21:39.957251] [INFO ] [MAIN      ] ETW: Generated 139 derivative records from 25243 primary records.
[2025-10-24T01:21:39.969732] [DEBUG] [LOCAL     ] ETY: Derivative data saved (139 records).
[2025-10-24T01:21:39.969877] [INFO ] [MAIN      ] ETY: Successfully saved derivative data.
[2025-10-24T01:21:39.966723] [DEBUG] [LOCAL     ] ETW: Saving derivative data.
[2025-10-24T01:21:39.973446] [INFO ] [MAIN      ] Derivative Progress: 707/2164 symbols completed. ETY took 1.2s. Estimated remaining: 10m 16s. Rate: 141.9 symbols/min
[2025-10-24T01:21:39.987919] [INFO ] [MAIN      ] EVEX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:39.990021] [DEBUG] [LOCAL     ] ETW: Derivative data saved (139 records).
[2025-10-24T01:21:39.990439] [INFO ] [MAIN      ] ETW: Successfully saved derivative data.
[2025-10-24T01:21:39.992903] [INFO ] [MAIN      ] Derivative Progress: 708/2164 symbols completed. ETW took 1.2s. Estimated remaining: 10m 15s. Rate: 142.1 symbols/min
[2025-10-24T01:21:39.994333] [INFO ] [MAIN      ] EVF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:40.001295] [DEBUG] [LOCAL     ] EVC: Loaded 17929 existing records from primary storage.
[2025-10-24T01:21:40.001608] [INFO ] [MAIN      ] EVC: Loaded 17929 primary data records.
[2025-10-24T01:21:40.122239] [DEBUG] [LOCAL     ] EVF: Loaded 9771 existing records from primary storage.
[2025-10-24T01:21:40.143449] [INFO ] [MAIN      ] EVF: Loaded 9771 primary data records.
[2025-10-24T01:21:40.401701] [DEBUG] [LOCAL     ] EVEX: Loaded 33354 existing records from primary storage.
[2025-10-24T01:21:40.430294] [INFO ] [MAIN      ] EVEX: Loaded 33354 primary data records.
[2025-10-24T01:21:40.993502] [DEBUG] [MAIN      ] EVC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:41.029083] [DEBUG] [MAIN      ] EVF: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:21:41.078073] [DEBUG] [MAIN      ] EVEX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:41.114745] [INFO ] [MAIN      ] EVC: Generated 139 derivative records from 17929 primary records.
[2025-10-24T01:21:41.119316] [DEBUG] [LOCAL     ] EVC: Saving derivative data.
[2025-10-24T01:21:41.134050] [INFO ] [MAIN      ] EVF: Generated 139 derivative records from 9771 primary records.
[2025-10-24T01:21:41.140451] [DEBUG] [LOCAL     ] EVF: Saving derivative data.
[2025-10-24T01:21:41.140210] [DEBUG] [LOCAL     ] EVC: Derivative data saved (139 records).
[2025-10-24T01:21:41.143357] [INFO ] [MAIN      ] EVC: Successfully saved derivative data.
[2025-10-24T01:21:41.147125] [INFO ] [MAIN      ] Derivative Progress: 709/2164 symbols completed. EVC took 1.2s. Estimated remaining: 10m 16s. Rate: 141.8 symbols/min
[2025-10-24T01:21:41.147416] [INFO ] [MAIN      ] EVG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:41.163749] [DEBUG] [LOCAL     ] EVF: Derivative data saved (139 records).
[2025-10-24T01:21:41.167098] [INFO ] [MAIN      ] EVF: Successfully saved derivative data.
[2025-10-24T01:21:41.169563] [INFO ] [MAIN      ] Derivative Progress: 710/2164 symbols completed. EVF took 1.2s. Estimated remaining: 10m 15s. Rate: 141.9 symbols/min
[2025-10-24T01:21:41.172073] [INFO ] [MAIN      ] EVEX: Generated 139 derivative records from 33354 primary records.
[2025-10-24T01:21:41.170009] [INFO ] [MAIN      ] EVH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:41.172195] [DEBUG] [LOCAL     ] EVEX: Saving derivative data.
[2025-10-24T01:21:41.175935] [DEBUG] [LOCAL     ] EVG: Loaded 5779 existing records from primary storage.
[2025-10-24T01:21:41.176577] [INFO ] [MAIN      ] EVG: Loaded 5779 primary data records.
[2025-10-24T01:21:41.224676] [DEBUG] [LOCAL     ] EVEX: Derivative data saved (139 records).
[2025-10-24T01:21:41.232010] [INFO ] [MAIN      ] EVEX: Successfully saved derivative data.
[2025-10-24T01:21:41.243255] [INFO ] [MAIN      ] Derivative Progress: 711/2164 symbols completed. EVEX took 1.3s. Estimated remaining: 10m 13s. Rate: 142.1 symbols/min
[2025-10-24T01:21:41.256671] [INFO ] [MAIN      ] EVN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:41.502617] [DEBUG] [LOCAL     ] EVN: Loaded 10894 existing records from primary storage.
[2025-10-24T01:21:41.511324] [INFO ] [MAIN      ] EVN: Loaded 10894 primary data records.
[2025-10-24T01:21:41.624717] [DEBUG] [LOCAL     ] EVH: Loaded 49979 existing records from primary storage.
[2025-10-24T01:21:41.636679] [INFO ] [MAIN      ] EVH: Loaded 49979 primary data records.
[2025-10-24T01:21:42.140228] [DEBUG] [MAIN      ] EVG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:42.187842] [DEBUG] [MAIN      ] EVN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:42.226526] [DEBUG] [MAIN      ] EVH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:42.247109] [INFO ] [MAIN      ] EVG: Generated 139 derivative records from 5779 primary records.
[2025-10-24T01:21:42.247242] [DEBUG] [LOCAL     ] EVG: Saving derivative data.
[2025-10-24T01:21:42.265025] [DEBUG] [LOCAL     ] EVG: Derivative data saved (139 records).
[2025-10-24T01:21:42.265149] [INFO ] [MAIN      ] EVG: Successfully saved derivative data.
[2025-10-24T01:21:42.268420] [INFO ] [MAIN      ] Derivative Progress: 712/2164 symbols completed. EVG took 1.1s. Estimated remaining: 10m 14s. Rate: 141.8 symbols/min
[2025-10-24T01:21:42.270389] [INFO ] [MAIN      ] EVR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:42.291695] [INFO ] [MAIN      ] EVN: Generated 139 derivative records from 10894 primary records.
[2025-10-24T01:21:42.293064] [DEBUG] [LOCAL     ] EVN: Saving derivative data.
[2025-10-24T01:21:42.302379] [INFO ] [MAIN      ] EVH: Generated 139 derivative records from 49979 primary records.
[2025-10-24T01:21:42.304024] [DEBUG] [LOCAL     ] EVH: Saving derivative data.
[2025-10-24T01:21:42.306767] [DEBUG] [LOCAL     ] EVN: Derivative data saved (139 records).
[2025-10-24T01:21:42.317286] [INFO ] [MAIN      ] EVN: Successfully saved derivative data.
[2025-10-24T01:21:42.320819] [INFO ] [MAIN      ] Derivative Progress: 713/2164 symbols completed. EVN took 1.1s. Estimated remaining: 10m 13s. Rate: 142.0 symbols/min
[2025-10-24T01:21:42.321099] [INFO ] [MAIN      ] EVT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:42.349466] [DEBUG] [LOCAL     ] EVH: Derivative data saved (139 records).
[2025-10-24T01:21:42.350805] [INFO ] [MAIN      ] EVH: Successfully saved derivative data.
[2025-10-24T01:21:42.354491] [DEBUG] [LOCAL     ] EVR: Loaded 33793 existing records from primary storage.
[2025-10-24T01:21:42.354831] [INFO ] [MAIN      ] EVR: Loaded 33793 primary data records.
[2025-10-24T01:21:42.353211] [INFO ] [MAIN      ] Derivative Progress: 714/2164 symbols completed. EVH took 1.2s. Estimated remaining: 10m 12s. Rate: 142.2 symbols/min
[2025-10-24T01:21:42.355170] [INFO ] [MAIN      ] EVTC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:42.441441] [DEBUG] [LOCAL     ] EVT: Loaded 16606 existing records from primary storage.
[2025-10-24T01:21:42.468902] [INFO ] [MAIN      ] EVT: Loaded 16606 primary data records.
[2025-10-24T01:21:42.855144] [DEBUG] [LOCAL     ] EVTC: Loaded 26985 existing records from primary storage.
[2025-10-24T01:21:42.999392] [INFO ] [MAIN      ] EVTC: Loaded 26985 primary data records.
[2025-10-24T01:21:43.373569] [DEBUG] [MAIN      ] EVR: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:21:43.379464] [DEBUG] [MAIN      ] EVT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:43.453441] [DEBUG] [MAIN      ] EVTC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:43.497506] [INFO ] [MAIN      ] EVT: Generated 139 derivative records from 16606 primary records.
[2025-10-24T01:21:43.497900] [INFO ] [MAIN      ] EVR: Generated 139 derivative records from 33793 primary records.
[2025-10-24T01:21:43.501103] [DEBUG] [LOCAL     ] EVT: Saving derivative data.
[2025-10-24T01:21:43.500900] [DEBUG] [LOCAL     ] EVR: Saving derivative data.
[2025-10-24T01:21:43.517053] [DEBUG] [LOCAL     ] EVR: Derivative data saved (139 records).
[2025-10-24T01:21:43.517283] [INFO ] [MAIN      ] EVR: Successfully saved derivative data.
[2025-10-24T01:21:43.521267] [INFO ] [MAIN      ] Derivative Progress: 715/2164 symbols completed. EVR took 1.3s. Estimated remaining: 10m 13s. Rate: 141.8 symbols/min
[2025-10-24T01:21:43.535904] [DEBUG] [LOCAL     ] EVT: Derivative data saved (139 records).
[2025-10-24T01:21:43.536666] [INFO ] [MAIN      ] EVT: Successfully saved derivative data.
[2025-10-24T01:21:43.536076] [INFO ] [MAIN      ] EVTL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:43.540960] [INFO ] [MAIN      ] Derivative Progress: 716/2164 symbols completed. EVT took 1.2s. Estimated remaining: 10m 12s. Rate: 142.0 symbols/min
[2025-10-24T01:21:43.541688] [INFO ] [MAIN      ] EVTR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:43.557332] [INFO ] [MAIN      ] EVTC: Generated 139 derivative records from 26985 primary records.
[2025-10-24T01:21:43.557542] [DEBUG] [LOCAL     ] EVTC: Saving derivative data.
[2025-10-24T01:21:43.587105] [DEBUG] [LOCAL     ] EVTC: Derivative data saved (139 records).
[2025-10-24T01:21:43.587400] [INFO ] [MAIN      ] EVTC: Successfully saved derivative data.
[2025-10-24T01:21:43.590267] [INFO ] [MAIN      ] Derivative Progress: 717/2164 symbols completed. EVTC took 1.2s. Estimated remaining: 10m 11s. Rate: 142.2 symbols/min
[2025-10-24T01:21:43.590687] [INFO ] [MAIN      ] EW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:43.602419] [DEBUG] [LOCAL     ] EVTR: Loaded 25689 existing records from primary storage.
[2025-10-24T01:21:43.613846] [INFO ] [MAIN      ] EVTR: Loaded 25689 primary data records.
[2025-10-24T01:21:43.636412] [DEBUG] [LOCAL     ] EVTL: Loaded 41735 existing records from primary storage.
[2025-10-24T01:21:43.680362] [INFO ] [MAIN      ] EVTL: Loaded 41735 primary data records.
[2025-10-24T01:21:44.174126] [DEBUG] [LOCAL     ] EW: Loaded 53780 existing records from primary storage.
[2025-10-24T01:21:44.174533] [INFO ] [MAIN      ] EW: Loaded 53780 primary data records.
[2025-10-24T01:21:44.553961] [DEBUG] [MAIN      ] EVTR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:44.589183] [DEBUG] [MAIN      ] EVTL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:44.693497] [DEBUG] [MAIN      ] EW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:44.728549] [INFO ] [MAIN      ] EVTR: Generated 139 derivative records from 25689 primary records.
[2025-10-24T01:21:44.730121] [DEBUG] [LOCAL     ] EVTR: Saving derivative data.
[2025-10-24T01:21:44.746767] [INFO ] [MAIN      ] EVTL: Generated 139 derivative records from 41735 primary records.
[2025-10-24T01:21:44.747575] [DEBUG] [LOCAL     ] EVTL: Saving derivative data.
[2025-10-24T01:21:44.749389] [DEBUG] [LOCAL     ] EVTR: Derivative data saved (139 records).
[2025-10-24T01:21:44.750143] [INFO ] [MAIN      ] EVTR: Successfully saved derivative data.
[2025-10-24T01:21:44.759960] [INFO ] [MAIN      ] Derivative Progress: 718/2164 symbols completed. EVTR took 1.2s. Estimated remaining: 10m 12s. Rate: 141.8 symbols/min
[2025-10-24T01:21:44.767457] [DEBUG] [LOCAL     ] EVTL: Derivative data saved (139 records).
[2025-10-24T01:21:44.768711] [INFO ] [MAIN      ] EVTL: Successfully saved derivative data.
[2025-10-24T01:21:44.771517] [INFO ] [MAIN      ] Derivative Progress: 719/2164 symbols completed. EVTL took 1.2s. Estimated remaining: 10m 10s. Rate: 142.0 symbols/min
[2025-10-24T01:21:44.776580] [INFO ] [MAIN      ] EW: Generated 139 derivative records from 53780 primary records.
[2025-10-24T01:21:44.776698] [DEBUG] [LOCAL     ] EW: Saving derivative data.
[2025-10-24T01:21:44.788265] [DEBUG] [LOCAL     ] EW: Derivative data saved (139 records).
[2025-10-24T01:21:44.788343] [INFO ] [MAIN      ] EW: Successfully saved derivative data.
[2025-10-24T01:21:44.791482] [INFO ] [MAIN      ] Derivative Progress: 720/2164 symbols completed. EW took 1.2s. Estimated remaining: 10m 9s. Rate: 142.2 symbols/min
[2025-10-24T01:21:44.791897] [INFO ] [MAIN      ] EXG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:44.792112] [INFO ] [MAIN      ] EXK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:44.792504] [INFO ] [MAIN      ] EXP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:44.836917] [DEBUG] [LOCAL     ] EXG: Loaded 33832 existing records from primary storage.
[2025-10-24T01:21:44.847059] [INFO ] [MAIN      ] EXG: Loaded 33832 primary data records.
[2025-10-24T01:21:44.847682] [DEBUG] [LOCAL     ] EXP: Loaded 29302 existing records from primary storage.
[2025-10-24T01:21:44.896373] [INFO ] [MAIN      ] EXP: Loaded 29302 primary data records.
[2025-10-24T01:21:45.092871] [DEBUG] [LOCAL     ] EXK: Loaded 53575 existing records from primary storage.
[2025-10-24T01:21:45.106205] [INFO ] [MAIN      ] EXK: Loaded 53575 primary data records.
[2025-10-24T01:21:45.800210] [DEBUG] [MAIN      ] EXG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:45.835590] [DEBUG] [MAIN      ] EXP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:45.882203] [DEBUG] [MAIN      ] EXK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:45.901520] [INFO ] [MAIN      ] EXG: Generated 139 derivative records from 33832 primary records.
[2025-10-24T01:21:45.903255] [DEBUG] [LOCAL     ] EXG: Saving derivative data.
[2025-10-24T01:21:45.922239] [DEBUG] [LOCAL     ] EXG: Derivative data saved (139 records).
[2025-10-24T01:21:45.922680] [INFO ] [MAIN      ] EXG: Successfully saved derivative data.
[2025-10-24T01:21:45.926060] [INFO ] [MAIN      ] Derivative Progress: 721/2164 symbols completed. EXG took 1.1s. Estimated remaining: 10m 10s. Rate: 141.9 symbols/min
[2025-10-24T01:21:45.928734] [INFO ] [MAIN      ] EXPD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:45.943052] [INFO ] [MAIN      ] EXP: Generated 139 derivative records from 29302 primary records.
[2025-10-24T01:21:45.946077] [DEBUG] [LOCAL     ] EXP: Saving derivative data.
[2025-10-24T01:21:45.960002] [DEBUG] [LOCAL     ] EXP: Derivative data saved (139 records).
[2025-10-24T01:21:45.961685] [INFO ] [MAIN      ] EXP: Successfully saved derivative data.
[2025-10-24T01:21:45.965393] [INFO ] [MAIN      ] Derivative Progress: 722/2164 symbols completed. EXP took 1.2s. Estimated remaining: 10m 9s. Rate: 142.1 symbols/min
[2025-10-24T01:21:45.966014] [INFO ] [MAIN      ] EXK: Generated 139 derivative records from 53575 primary records.
[2025-10-24T01:21:45.966248] [INFO ] [MAIN      ] EXR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:45.966493] [DEBUG] [LOCAL     ] EXK: Saving derivative data.
[2025-10-24T01:21:45.979578] [DEBUG] [LOCAL     ] EXK: Derivative data saved (139 records).
[2025-10-24T01:21:45.980000] [INFO ] [MAIN      ] EXK: Successfully saved derivative data.
[2025-10-24T01:21:45.983638] [INFO ] [MAIN      ] Derivative Progress: 723/2164 symbols completed. EXK took 1.2s. Estimated remaining: 10m 8s. Rate: 142.3 symbols/min
[2025-10-24T01:21:45.983944] [INFO ] [MAIN      ] F: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:46.017617] [DEBUG] [LOCAL     ] EXPD: Loaded 48043 existing records from primary storage.
[2025-10-24T01:21:46.017944] [INFO ] [MAIN      ] EXPD: Loaded 48043 primary data records.
[2025-10-24T01:21:46.205897] [DEBUG] [LOCAL     ] EXR: Loaded 45770 existing records from primary storage.
[2025-10-24T01:21:46.237803] [INFO ] [MAIN      ] EXR: Loaded 45770 primary data records.
[2025-10-24T01:21:46.417802] [DEBUG] [LOCAL     ] F: Loaded 54210 existing records from primary storage.
[2025-10-24T01:21:46.439206] [INFO ] [MAIN      ] F: Loaded 54210 primary data records.
[2025-10-24T01:21:47.035230] [DEBUG] [MAIN      ] EXPD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:47.077273] [DEBUG] [MAIN      ] EXR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:47.120310] [DEBUG] [MAIN      ] F: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:47.153596] [INFO ] [MAIN      ] EXPD: Generated 139 derivative records from 48043 primary records.
[2025-10-24T01:21:47.156019] [DEBUG] [LOCAL     ] EXPD: Saving derivative data.
[2025-10-24T01:21:47.179661] [DEBUG] [LOCAL     ] EXPD: Derivative data saved (139 records).
[2025-10-24T01:21:47.180330] [INFO ] [MAIN      ] EXPD: Successfully saved derivative data.
[2025-10-24T01:21:47.188040] [INFO ] [MAIN      ] Derivative Progress: 724/2164 symbols completed. EXPD took 1.3s. Estimated remaining: 10m 9s. Rate: 141.9 symbols/min
[2025-10-24T01:21:47.189374] [INFO ] [MAIN      ] FAF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:47.210234] [INFO ] [MAIN      ] EXR: Generated 139 derivative records from 45770 primary records.
[2025-10-24T01:21:47.212626] [INFO ] [MAIN      ] F: Generated 139 derivative records from 54210 primary records.
[2025-10-24T01:21:47.213278] [DEBUG] [LOCAL     ] F: Saving derivative data.
[2025-10-24T01:21:47.213211] [DEBUG] [LOCAL     ] EXR: Saving derivative data.
[2025-10-24T01:21:47.236540] [DEBUG] [LOCAL     ] F: Derivative data saved (139 records).
[2025-10-24T01:21:47.242875] [DEBUG] [LOCAL     ] EXR: Derivative data saved (139 records).
[2025-10-24T01:21:47.243092] [INFO ] [MAIN      ] F: Successfully saved derivative data.
[2025-10-24T01:21:47.257166] [INFO ] [MAIN      ] Derivative Progress: 725/2164 symbols completed. F took 1.3s. Estimated remaining: 10m 8s. Rate: 142.1 symbols/min
[2025-10-24T01:21:47.257310] [INFO ] [MAIN      ] EXR: Successfully saved derivative data.
[2025-10-24T01:21:47.257957] [INFO ] [MAIN      ] FBIN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:47.260901] [INFO ] [MAIN      ] Derivative Progress: 726/2164 symbols completed. EXR took 1.3s. Estimated remaining: 10m 7s. Rate: 142.3 symbols/min
[2025-10-24T01:21:47.262024] [INFO ] [MAIN      ] FBK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:47.282763] [DEBUG] [LOCAL     ] FAF: Loaded 41784 existing records from primary storage.
[2025-10-24T01:21:47.283020] [INFO ] [MAIN      ] FAF: Loaded 41784 primary data records.
[2025-10-24T01:21:47.438375] [DEBUG] [LOCAL     ] FBK: Loaded 27617 existing records from primary storage.
[2025-10-24T01:21:47.505631] [INFO ] [MAIN      ] FBK: Loaded 27617 primary data records.
[2025-10-24T01:21:47.749689] [DEBUG] [LOCAL     ] FBIN: Loaded 50736 existing records from primary storage.
[2025-10-24T01:21:47.761773] [INFO ] [MAIN      ] FBIN: Loaded 50736 primary data records.
[2025-10-24T01:21:48.303895] [DEBUG] [MAIN      ] FAF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:48.352322] [DEBUG] [MAIN      ] FBK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:48.390708] [INFO ] [MAIN      ] FAF: Generated 139 derivative records from 41784 primary records.
[2025-10-24T01:21:48.403265] [DEBUG] [LOCAL     ] FAF: Saving derivative data.
[2025-10-24T01:21:48.404134] [DEBUG] [MAIN      ] FBIN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:48.430356] [DEBUG] [LOCAL     ] FAF: Derivative data saved (139 records).
[2025-10-24T01:21:48.434200] [INFO ] [MAIN      ] FAF: Successfully saved derivative data.
[2025-10-24T01:21:48.437852] [INFO ] [MAIN      ] Derivative Progress: 727/2164 symbols completed. FAF took 1.2s. Estimated remaining: 10m 8s. Rate: 141.9 symbols/min
[2025-10-24T01:21:48.440254] [INFO ] [MAIN      ] FBP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:48.464227] [INFO ] [MAIN      ] FBK: Generated 139 derivative records from 27617 primary records.
[2025-10-24T01:21:48.466530] [DEBUG] [LOCAL     ] FBK: Saving derivative data.
[2025-10-24T01:21:48.479931] [DEBUG] [LOCAL     ] FBK: Derivative data saved (139 records).
[2025-10-24T01:21:48.491987] [INFO ] [MAIN      ] FBK: Successfully saved derivative data.
[2025-10-24T01:21:48.494831] [INFO ] [MAIN      ] Derivative Progress: 728/2164 symbols completed. FBK took 1.2s. Estimated remaining: 10m 6s. Rate: 142.1 symbols/min
[2025-10-24T01:21:48.491896] [INFO ] [MAIN      ] FBIN: Generated 139 derivative records from 50736 primary records.
[2025-10-24T01:21:48.495180] [DEBUG] [LOCAL     ] FBIN: Saving derivative data.
[2025-10-24T01:21:48.495001] [INFO ] [MAIN      ] FBRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:48.507903] [DEBUG] [LOCAL     ] FBIN: Derivative data saved (139 records).
[2025-10-24T01:21:48.523033] [INFO ] [MAIN      ] FBIN: Successfully saved derivative data.
[2025-10-24T01:21:48.526408] [INFO ] [MAIN      ] Derivative Progress: 729/2164 symbols completed. FBIN took 1.3s. Estimated remaining: 10m 5s. Rate: 142.3 symbols/min
[2025-10-24T01:21:48.526708] [INFO ] [MAIN      ] FC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:48.528720] [DEBUG] [LOCAL     ] FBP: Loaded 45946 existing records from primary storage.
[2025-10-24T01:21:48.529050] [INFO ] [MAIN      ] FBP: Loaded 45946 primary data records.
[2025-10-24T01:21:48.678839] [DEBUG] [LOCAL     ] FC: Loaded 14390 existing records from primary storage.
[2025-10-24T01:21:48.705915] [INFO ] [MAIN      ] FC: Loaded 14390 primary data records.
[2025-10-24T01:21:48.937153] [DEBUG] [LOCAL     ] FBRT: Loaded 35460 existing records from primary storage.
[2025-10-24T01:21:48.956584] [INFO ] [MAIN      ] FBRT: Loaded 35460 primary data records.
[2025-10-24T01:21:49.519386] [DEBUG] [MAIN      ] FBP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:49.553452] [DEBUG] [MAIN      ] FC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:49.596456] [DEBUG] [MAIN      ] FBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:49.649394] [INFO ] [MAIN      ] FBP: Generated 139 derivative records from 45946 primary records.
[2025-10-24T01:21:49.652234] [INFO ] [MAIN      ] FC: Generated 139 derivative records from 14390 primary records.
[2025-10-24T01:21:49.652842] [DEBUG] [LOCAL     ] FBP: Saving derivative data.
[2025-10-24T01:21:49.653058] [DEBUG] [LOCAL     ] FC: Saving derivative data.
[2025-10-24T01:21:49.676552] [DEBUG] [LOCAL     ] FBP: Derivative data saved (139 records).
[2025-10-24T01:21:49.679525] [INFO ] [MAIN      ] FBP: Successfully saved derivative data.
[2025-10-24T01:21:49.682243] [INFO ] [MAIN      ] Derivative Progress: 730/2164 symbols completed. FBP took 1.2s. Estimated remaining: 10m 6s. Rate: 141.9 symbols/min
[2025-10-24T01:21:49.682447] [DEBUG] [LOCAL     ] FC: Derivative data saved (139 records).
[2025-10-24T01:21:49.685332] [INFO ] [MAIN      ] FCF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:49.685483] [INFO ] [MAIN      ] FC: Successfully saved derivative data.
[2025-10-24T01:21:49.689230] [INFO ] [MAIN      ] Derivative Progress: 731/2164 symbols completed. FC took 1.2s. Estimated remaining: 10m 5s. Rate: 142.1 symbols/min
[2025-10-24T01:21:49.689703] [INFO ] [MAIN      ] FCN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:49.697636] [INFO ] [MAIN      ] FBRT: Generated 139 derivative records from 35460 primary records.
[2025-10-24T01:21:49.697941] [DEBUG] [LOCAL     ] FBRT: Saving derivative data.
[2025-10-24T01:21:49.711241] [DEBUG] [LOCAL     ] FBRT: Derivative data saved (139 records).
[2025-10-24T01:21:49.711368] [INFO ] [MAIN      ] FBRT: Successfully saved derivative data.
[2025-10-24T01:21:49.715824] [INFO ] [MAIN      ] Derivative Progress: 732/2164 symbols completed. FBRT took 1.2s. Estimated remaining: 10m 4s. Rate: 142.3 symbols/min
[2025-10-24T01:21:49.716040] [INFO ] [MAIN      ] FCPT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:49.744749] [DEBUG] [LOCAL     ] FCN: Loaded 26198 existing records from primary storage.
[2025-10-24T01:21:49.745098] [INFO ] [MAIN      ] FCN: Loaded 26198 primary data records.
[2025-10-24T01:21:49.884442] [DEBUG] [LOCAL     ] FCF: Loaded 39380 existing records from primary storage.
[2025-10-24T01:21:49.885984] [DEBUG] [LOCAL     ] FCPT: Loaded 37208 existing records from primary storage.
[2025-10-24T01:21:49.896659] [INFO ] [MAIN      ] FCPT: Loaded 37208 primary data records.
[2025-10-24T01:21:49.896481] [INFO ] [MAIN      ] FCF: Loaded 39380 primary data records.
[2025-10-24T01:21:50.753860] [DEBUG] [MAIN      ] FCN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:50.807792] [DEBUG] [MAIN      ] FCF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:50.842162] [INFO ] [MAIN      ] FCN: Generated 139 derivative records from 26198 primary records.
[2025-10-24T01:21:50.839696] [DEBUG] [MAIN      ] FCPT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:50.843569] [DEBUG] [LOCAL     ] FCN: Saving derivative data.
[2025-10-24T01:21:50.872584] [DEBUG] [LOCAL     ] FCN: Derivative data saved (139 records).
[2025-10-24T01:21:50.874931] [INFO ] [MAIN      ] FCN: Successfully saved derivative data.
[2025-10-24T01:21:50.877591] [INFO ] [MAIN      ] Derivative Progress: 733/2164 symbols completed. FCN took 1.2s. Estimated remaining: 10m 5s. Rate: 142.0 symbols/min
[2025-10-24T01:21:50.912863] [INFO ] [MAIN      ] FCF: Generated 139 derivative records from 39380 primary records.
[2025-10-24T01:21:50.912985] [DEBUG] [LOCAL     ] FCF: Saving derivative data.
[2025-10-24T01:21:50.925883] [INFO ] [MAIN      ] FCPT: Generated 139 derivative records from 37208 primary records.
[2025-10-24T01:21:50.926568] [DEBUG] [LOCAL     ] FCPT: Saving derivative data.
[2025-10-24T01:21:50.928674] [DEBUG] [LOCAL     ] FCF: Derivative data saved (139 records).
[2025-10-24T01:21:50.929038] [INFO ] [MAIN      ] FCF: Successfully saved derivative data.
[2025-10-24T01:21:50.939181] [INFO ] [MAIN      ] Derivative Progress: 734/2164 symbols completed. FCF took 1.3s. Estimated remaining: 10m 4s. Rate: 142.1 symbols/min
[2025-10-24T01:21:50.943818] [DEBUG] [LOCAL     ] FCPT: Derivative data saved (139 records).
[2025-10-24T01:21:50.943908] [INFO ] [MAIN      ] FCPT: Successfully saved derivative data.
[2025-10-24T01:21:50.946969] [INFO ] [MAIN      ] Derivative Progress: 735/2164 symbols completed. FCPT took 1.2s. Estimated remaining: 10m 3s. Rate: 142.3 symbols/min
[2025-10-24T01:21:50.947412] [INFO ] [MAIN      ] FCT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:50.947562] [INFO ] [MAIN      ] FDP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:50.948204] [INFO ] [MAIN      ] FCX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:50.976377] [DEBUG] [LOCAL     ] FCT: Loaded 14945 existing records from primary storage.
[2025-10-24T01:21:50.976534] [INFO ] [MAIN      ] FCT: Loaded 14945 primary data records.
[2025-10-24T01:21:51.100414] [DEBUG] [LOCAL     ] FDP: Loaded 29865 existing records from primary storage.
[2025-10-24T01:21:51.130586] [INFO ] [MAIN      ] FDP: Loaded 29865 primary data records.
[2025-10-24T01:21:51.462711] [DEBUG] [LOCAL     ] FCX: Loaded 54091 existing records from primary storage.
[2025-10-24T01:21:51.513962] [INFO ] [MAIN      ] FCX: Loaded 54091 primary data records.
[2025-10-24T01:21:51.967573] [DEBUG] [MAIN      ] FCT: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:21:52.007583] [DEBUG] [MAIN      ] FDP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:52.069898] [INFO ] [MAIN      ] FCT: Generated 139 derivative records from 14945 primary records.
[2025-10-24T01:21:52.070293] [DEBUG] [MAIN      ] FCX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:52.083100] [DEBUG] [LOCAL     ] FCT: Saving derivative data.
[2025-10-24T01:21:52.102901] [DEBUG] [LOCAL     ] FCT: Derivative data saved (139 records).
[2025-10-24T01:21:52.106277] [INFO ] [MAIN      ] FCT: Successfully saved derivative data.
[2025-10-24T01:21:52.109017] [INFO ] [MAIN      ] Derivative Progress: 736/2164 symbols completed. FCT took 1.2s. Estimated remaining: 10m 4s. Rate: 142.0 symbols/min
[2025-10-24T01:21:52.110895] [INFO ] [MAIN      ] FDS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:52.118274] [INFO ] [MAIN      ] FDP: Generated 139 derivative records from 29865 primary records.
[2025-10-24T01:21:52.119086] [DEBUG] [LOCAL     ] FDP: Saving derivative data.
[2025-10-24T01:21:52.138445] [DEBUG] [LOCAL     ] FDP: Derivative data saved (139 records).
[2025-10-24T01:21:52.141225] [INFO ] [MAIN      ] FDP: Successfully saved derivative data.
[2025-10-24T01:21:52.144192] [INFO ] [MAIN      ] Derivative Progress: 737/2164 symbols completed. FDP took 1.2s. Estimated remaining: 10m 2s. Rate: 142.1 symbols/min
[2025-10-24T01:21:52.151984] [INFO ] [MAIN      ] FDX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:52.156296] [INFO ] [MAIN      ] FCX: Generated 139 derivative records from 54091 primary records.
[2025-10-24T01:21:52.156388] [DEBUG] [LOCAL     ] FCX: Saving derivative data.
[2025-10-24T01:21:52.179894] [DEBUG] [LOCAL     ] FCX: Derivative data saved (139 records).
[2025-10-24T01:21:52.181368] [INFO ] [MAIN      ] FCX: Successfully saved derivative data.
[2025-10-24T01:21:52.181247] [DEBUG] [LOCAL     ] FDS: Loaded 28305 existing records from primary storage.
[2025-10-24T01:21:52.185085] [INFO ] [MAIN      ] Derivative Progress: 738/2164 symbols completed. FCX took 1.2s. Estimated remaining: 10m 1s. Rate: 142.3 symbols/min
[2025-10-24T01:21:52.181584] [INFO ] [MAIN      ] FDS: Loaded 28305 primary data records.
[2025-10-24T01:21:52.185633] [INFO ] [MAIN      ] FE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:52.580970] [DEBUG] [LOCAL     ] FDX: Loaded 51522 existing records from primary storage.
[2025-10-24T01:21:52.581554] [INFO ] [MAIN      ] FDX: Loaded 51522 primary data records.
[2025-10-24T01:21:52.701351] [DEBUG] [LOCAL     ] FE: Loaded 53821 existing records from primary storage.
[2025-10-24T01:21:52.705357] [INFO ] [MAIN      ] FE: Loaded 53821 primary data records.
[2025-10-24T01:21:53.255240] [DEBUG] [MAIN      ] FDS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:53.303444] [DEBUG] [MAIN      ] FDX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:53.343808] [DEBUG] [MAIN      ] FE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:53.368921] [INFO ] [MAIN      ] FDS: Generated 139 derivative records from 28305 primary records.
[2025-10-24T01:21:53.375168] [DEBUG] [LOCAL     ] FDS: Saving derivative data.
[2025-10-24T01:21:53.393609] [DEBUG] [LOCAL     ] FDS: Derivative data saved (139 records).
[2025-10-24T01:21:53.396710] [INFO ] [MAIN      ] FDS: Successfully saved derivative data.
[2025-10-24T01:21:53.401067] [INFO ] [MAIN      ] Derivative Progress: 739/2164 symbols completed. FDS took 1.3s. Estimated remaining: 10m 2s. Rate: 142.0 symbols/min
[2025-10-24T01:21:53.401802] [INFO ] [MAIN      ] FERG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:53.418853] [INFO ] [MAIN      ] FDX: Generated 139 derivative records from 51522 primary records.
[2025-10-24T01:21:53.420513] [DEBUG] [LOCAL     ] FDX: Saving derivative data.
[2025-10-24T01:21:53.421193] [INFO ] [MAIN      ] FE: Generated 139 derivative records from 53821 primary records.
[2025-10-24T01:21:53.421863] [DEBUG] [LOCAL     ] FE: Saving derivative data.
[2025-10-24T01:21:53.446249] [DEBUG] [LOCAL     ] FE: Derivative data saved (139 records).
[2025-10-24T01:21:53.444402] [DEBUG] [LOCAL     ] FDX: Derivative data saved (139 records).
[2025-10-24T01:21:53.446451] [INFO ] [MAIN      ] FE: Successfully saved derivative data.
[2025-10-24T01:21:53.446544] [INFO ] [MAIN      ] FDX: Successfully saved derivative data.
[2025-10-24T01:21:53.449848] [INFO ] [MAIN      ] Derivative Progress: 740/2164 symbols completed. FE took 1.3s. Estimated remaining: 10m 1s. Rate: 142.1 symbols/min
[2025-10-24T01:21:53.452734] [INFO ] [MAIN      ] FF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:53.452801] [INFO ] [MAIN      ] Derivative Progress: 741/2164 symbols completed. FDX took 1.3s. Estimated remaining: 9m 60s. Rate: 142.3 symbols/min
[2025-10-24T01:21:53.453470] [INFO ] [MAIN      ] FFA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:53.476881] [DEBUG] [LOCAL     ] FFA: Loaded 5602 existing records from primary storage.
[2025-10-24T01:21:53.477914] [INFO ] [MAIN      ] FFA: Loaded 5602 primary data records.
[2025-10-24T01:21:53.553073] [DEBUG] [LOCAL     ] FERG: Loaded 49080 existing records from primary storage.
[2025-10-24T01:21:53.573785] [INFO ] [MAIN      ] FERG: Loaded 49080 primary data records.
[2025-10-24T01:21:53.613968] [DEBUG] [LOCAL     ] FF: Loaded 23773 existing records from primary storage.
[2025-10-24T01:21:53.642747] [INFO ] [MAIN      ] FF: Loaded 23773 primary data records.
[2025-10-24T01:21:54.430035] [DEBUG] [MAIN      ] FFA: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:21:54.463766] [DEBUG] [MAIN      ] FERG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:54.493415] [DEBUG] [MAIN      ] FF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:54.567528] [INFO ] [MAIN      ] FERG: Generated 139 derivative records from 49080 primary records.
[2025-10-24T01:21:54.562844] [INFO ] [MAIN      ] FFA: Generated 139 derivative records from 5602 primary records.
[2025-10-24T01:21:54.568079] [DEBUG] [LOCAL     ] FERG: Saving derivative data.
[2025-10-24T01:21:54.568547] [DEBUG] [LOCAL     ] FFA: Saving derivative data.
[2025-10-24T01:21:54.591947] [DEBUG] [LOCAL     ] FFA: Derivative data saved (139 records).
[2025-10-24T01:21:54.592590] [INFO ] [MAIN      ] FFA: Successfully saved derivative data.
[2025-10-24T01:21:54.596745] [DEBUG] [LOCAL     ] FERG: Derivative data saved (139 records).
[2025-10-24T01:21:54.596987] [INFO ] [MAIN      ] FERG: Successfully saved derivative data.
[2025-10-24T01:21:54.599474] [INFO ] [MAIN      ] Derivative Progress: 742/2164 symbols completed. FFA took 1.1s. Estimated remaining: 10m 1s. Rate: 142.0 symbols/min
[2025-10-24T01:21:54.605620] [INFO ] [MAIN      ] Derivative Progress: 743/2164 symbols completed. FERG took 1.2s. Estimated remaining: 9m 60s. Rate: 142.2 symbols/min
[2025-10-24T01:21:54.605532] [INFO ] [MAIN      ] FFC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:54.606207] [INFO ] [MAIN      ] FFWM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:54.611019] [INFO ] [MAIN      ] FF: Generated 139 derivative records from 23773 primary records.
[2025-10-24T01:21:54.611185] [DEBUG] [LOCAL     ] FF: Saving derivative data.
[2025-10-24T01:21:54.625083] [DEBUG] [LOCAL     ] FF: Derivative data saved (139 records).
[2025-10-24T01:21:54.625475] [INFO ] [MAIN      ] FF: Successfully saved derivative data.
[2025-10-24T01:21:54.628624] [INFO ] [MAIN      ] Derivative Progress: 744/2164 symbols completed. FF took 1.2s. Estimated remaining: 9m 58s. Rate: 142.4 symbols/min
[2025-10-24T01:21:54.628947] [INFO ] [MAIN      ] FG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:54.651844] [DEBUG] [LOCAL     ] FFC: Loaded 16737 existing records from primary storage.
[2025-10-24T01:21:54.652052] [INFO ] [MAIN      ] FFC: Loaded 16737 primary data records.
[2025-10-24T01:21:54.777218] [DEBUG] [LOCAL     ] FFWM: Loaded 35895 existing records from primary storage.
[2025-10-24T01:21:54.778418] [INFO ] [MAIN      ] FFWM: Loaded 35895 primary data records.
[2025-10-24T01:21:54.778957] [DEBUG] [LOCAL     ] FG: Loaded 21445 existing records from primary storage.
[2025-10-24T01:21:54.799864] [INFO ] [MAIN      ] FG: Loaded 21445 primary data records.
[2025-10-24T01:21:55.639864] [DEBUG] [MAIN      ] FFC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:55.680698] [DEBUG] [MAIN      ] FFWM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:55.714956] [DEBUG] [MAIN      ] FG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:55.747470] [INFO ] [MAIN      ] FFC: Generated 139 derivative records from 16737 primary records.
[2025-10-24T01:21:55.747712] [DEBUG] [LOCAL     ] FFC: Saving derivative data.
[2025-10-24T01:21:55.773076] [DEBUG] [LOCAL     ] FFC: Derivative data saved (139 records).
[2025-10-24T01:21:55.773488] [INFO ] [MAIN      ] FFC: Successfully saved derivative data.
[2025-10-24T01:21:55.779244] [INFO ] [MAIN      ] Derivative Progress: 745/2164 symbols completed. FFC took 1.2s. Estimated remaining: 9m 59s. Rate: 142.0 symbols/min
[2025-10-24T01:21:55.779848] [INFO ] [MAIN      ] FGN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:55.800694] [DEBUG] [LOCAL     ] FGN: Loaded 3575 existing records from primary storage.
[2025-10-24T01:21:55.801271] [INFO ] [MAIN      ] FGN: Loaded 3575 primary data records.
[2025-10-24T01:21:55.796736] [INFO ] [MAIN      ] FFWM: Generated 139 derivative records from 35895 primary records.
[2025-10-24T01:21:55.803427] [INFO ] [MAIN      ] FG: Generated 139 derivative records from 21445 primary records.
[2025-10-24T01:21:55.803678] [DEBUG] [LOCAL     ] FFWM: Saving derivative data.
[2025-10-24T01:21:55.824567] [DEBUG] [LOCAL     ] FG: Saving derivative data.
[2025-10-24T01:21:55.925390] [DEBUG] [LOCAL     ] FFWM: Derivative data saved (139 records).
[2025-10-24T01:21:55.916239] [DEBUG] [LOCAL     ] FG: Derivative data saved (139 records).
[2025-10-24T01:21:55.936212] [INFO ] [MAIN      ] FG: Successfully saved derivative data.
[2025-10-24T01:21:55.939472] [INFO ] [MAIN      ] Derivative Progress: 746/2164 symbols completed. FG took 1.3s. Estimated remaining: 9m 59s. Rate: 142.1 symbols/min
[2025-10-24T01:21:55.936418] [INFO ] [MAIN      ] FFWM: Successfully saved derivative data.
[2025-10-24T01:21:55.955622] [INFO ] [MAIN      ] FHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:55.964248] [INFO ] [MAIN      ] Derivative Progress: 747/2164 symbols completed. FFWM took 1.4s. Estimated remaining: 9m 57s. Rate: 142.3 symbols/min
[2025-10-24T01:21:56.017429] [INFO ] [MAIN      ] FHN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:56.182147] [DEBUG] [MAIN      ] FGN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:56.196935] [DEBUG] [LOCAL     ] FHI: Loaded 39641 existing records from primary storage.
[2025-10-24T01:21:56.197450] [INFO ] [MAIN      ] FHI: Loaded 39641 primary data records.
[2025-10-24T01:21:56.351450] [DEBUG] [LOCAL     ] FHN: Loaded 53789 existing records from primary storage.
[2025-10-24T01:21:56.418677] [INFO ] [MAIN      ] FHN: Loaded 53789 primary data records.
[2025-10-24T01:21:56.678551] [INFO ] [MAIN      ] FGN: Generated 139 derivative records from 3575 primary records.
[2025-10-24T01:21:56.731332] [DEBUG] [LOCAL     ] FGN: Saving derivative data.
[2025-10-24T01:21:56.866359] [DEBUG] [LOCAL     ] FGN: Derivative data saved (139 records).
[2025-10-24T01:21:56.867738] [INFO ] [MAIN      ] FGN: Successfully saved derivative data.
[2025-10-24T01:21:56.870361] [INFO ] [MAIN      ] Derivative Progress: 748/2164 symbols completed. FGN took 1.1s. Estimated remaining: 9m 58s. Rate: 142.1 symbols/min
[2025-10-24T01:21:56.889837] [DEBUG] [MAIN      ] FHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:56.926490] [INFO ] [MAIN      ] FHI: Generated 139 derivative records from 39641 primary records.
[2025-10-24T01:21:56.926723] [DEBUG] [LOCAL     ] FHI: Saving derivative data.
[2025-10-24T01:21:56.955498] [DEBUG] [LOCAL     ] FHI: Derivative data saved (139 records).
[2025-10-24T01:21:56.955608] [INFO ] [MAIN      ] FHI: Successfully saved derivative data.
[2025-10-24T01:21:56.958028] [INFO ] [MAIN      ] Derivative Progress: 749/2164 symbols completed. FHI took 1.0s. Estimated remaining: 9m 57s. Rate: 142.3 symbols/min
[2025-10-24T01:21:56.958313] [DEBUG] [MAIN      ] FHN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:56.984371] [INFO ] [MAIN      ] FHN: Generated 139 derivative records from 53789 primary records.
[2025-10-24T01:21:56.984582] [DEBUG] [LOCAL     ] FHN: Saving derivative data.
[2025-10-24T01:21:56.996928] [DEBUG] [LOCAL     ] FHN: Derivative data saved (139 records).
[2025-10-24T01:21:56.997033] [INFO ] [MAIN      ] FHN: Successfully saved derivative data.
[2025-10-24T01:21:57.000158] [INFO ] [MAIN      ] Derivative Progress: 750/2164 symbols completed. FHN took 1.0s. Estimated remaining: 9m 56s. Rate: 142.4 symbols/min
[2025-10-24T01:21:57.000835] [INFO ] [MAIN      ] FIGS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:57.000628] [INFO ] [MAIN      ] FI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:57.000732] [INFO ] [MAIN      ] FICO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:57.030066] [DEBUG] [LOCAL     ] FICO: Loaded 22189 existing records from primary storage.
[2025-10-24T01:21:57.030217] [INFO ] [MAIN      ] FICO: Loaded 22189 primary data records.
[2025-10-24T01:21:57.248698] [DEBUG] [LOCAL     ] FIGS: Loaded 48846 existing records from primary storage.
[2025-10-24T01:21:57.269187] [INFO ] [MAIN      ] FIGS: Loaded 48846 primary data records.
[2025-10-24T01:21:57.436927] [DEBUG] [LOCAL     ] FI: Loaded 53968 existing records from primary storage.
[2025-10-24T01:21:57.476792] [INFO ] [MAIN      ] FI: Loaded 53968 primary data records.
[2025-10-24T01:21:58.048717] [DEBUG] [MAIN      ] FICO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:58.089856] [DEBUG] [MAIN      ] FIGS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:58.126169] [DEBUG] [MAIN      ] FI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:58.150420] [INFO ] [MAIN      ] FICO: Generated 139 derivative records from 22189 primary records.
[2025-10-24T01:21:58.155470] [DEBUG] [LOCAL     ] FICO: Saving derivative data.
[2025-10-24T01:21:58.174770] [DEBUG] [LOCAL     ] FICO: Derivative data saved (139 records).
[2025-10-24T01:21:58.175262] [INFO ] [MAIN      ] FICO: Successfully saved derivative data.
[2025-10-24T01:21:58.178143] [INFO ] [MAIN      ] Derivative Progress: 751/2164 symbols completed. FICO took 1.2s. Estimated remaining: 9m 57s. Rate: 142.1 symbols/min
[2025-10-24T01:21:58.180404] [INFO ] [MAIN      ] FIHL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:58.201780] [INFO ] [MAIN      ] FI: Generated 139 derivative records from 53968 primary records.
[2025-10-24T01:21:58.205115] [DEBUG] [LOCAL     ] FI: Saving derivative data.
[2025-10-24T01:21:58.205616] [INFO ] [MAIN      ] FIGS: Generated 139 derivative records from 48846 primary records.
[2025-10-24T01:21:58.206568] [DEBUG] [LOCAL     ] FIGS: Saving derivative data.
[2025-10-24T01:21:58.236675] [DEBUG] [LOCAL     ] FI: Derivative data saved (139 records).
[2025-10-24T01:21:58.239699] [INFO ] [MAIN      ] FI: Successfully saved derivative data.
[2025-10-24T01:21:58.242950] [INFO ] [MAIN      ] Derivative Progress: 752/2164 symbols completed. FI took 1.2s. Estimated remaining: 9m 56s. Rate: 142.2 symbols/min
[2025-10-24T01:21:58.239763] [DEBUG] [LOCAL     ] FIGS: Derivative data saved (139 records).
[2025-10-24T01:21:58.243300] [INFO ] [MAIN      ] FINS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:58.243461] [INFO ] [MAIN      ] FIGS: Successfully saved derivative data.
[2025-10-24T01:21:58.246311] [INFO ] [MAIN      ] Derivative Progress: 753/2164 symbols completed. FIGS took 1.2s. Estimated remaining: 9m 54s. Rate: 142.4 symbols/min
[2025-10-24T01:21:58.246622] [INFO ] [MAIN      ] FINV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:58.264406] [DEBUG] [LOCAL     ] FIHL: Loaded 39341 existing records from primary storage.
[2025-10-24T01:21:58.264842] [INFO ] [MAIN      ] FIHL: Loaded 39341 primary data records.
[2025-10-24T01:21:58.289935] [DEBUG] [LOCAL     ] FINS: Loaded 8300 existing records from primary storage.
[2025-10-24T01:21:58.325419] [INFO ] [MAIN      ] FINS: Loaded 8300 primary data records.
[2025-10-24T01:21:58.770243] [DEBUG] [LOCAL     ] FINV: Loaded 45555 existing records from primary storage.
[2025-10-24T01:21:58.783456] [INFO ] [MAIN      ] FINV: Loaded 45555 primary data records.
[2025-10-24T01:21:59.284849] [DEBUG] [MAIN      ] FIHL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:59.299730] [DEBUG] [MAIN      ] FINS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:59.354862] [DEBUG] [MAIN      ] FINV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:21:59.408894] [INFO ] [MAIN      ] FIHL: Generated 139 derivative records from 39341 primary records.
[2025-10-24T01:21:59.411822] [INFO ] [MAIN      ] FINS: Generated 139 derivative records from 8300 primary records.
[2025-10-24T01:21:59.412098] [DEBUG] [LOCAL     ] FINS: Saving derivative data.
[2025-10-24T01:21:59.411951] [DEBUG] [LOCAL     ] FIHL: Saving derivative data.
[2025-10-24T01:21:59.445305] [DEBUG] [LOCAL     ] FIHL: Derivative data saved (139 records).
[2025-10-24T01:21:59.445526] [INFO ] [MAIN      ] FIHL: Successfully saved derivative data.
[2025-10-24T01:21:59.443826] [DEBUG] [LOCAL     ] FINS: Derivative data saved (139 records).
[2025-10-24T01:21:59.447182] [INFO ] [MAIN      ] FINS: Successfully saved derivative data.
[2025-10-24T01:21:59.449589] [INFO ] [MAIN      ] Derivative Progress: 754/2164 symbols completed. FINS took 1.2s. Estimated remaining: 9m 55s. Rate: 142.1 symbols/min
[2025-10-24T01:21:59.449965] [INFO ] [MAIN      ] FIS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:59.449840] [INFO ] [MAIN      ] FINV: Generated 139 derivative records from 45555 primary records.
[2025-10-24T01:21:59.453234] [INFO ] [MAIN      ] Derivative Progress: 755/2164 symbols completed. FIHL took 1.3s. Estimated remaining: 9m 54s. Rate: 142.3 symbols/min
[2025-10-24T01:21:59.453631] [INFO ] [MAIN      ] FIX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:59.453871] [DEBUG] [LOCAL     ] FINV: Saving derivative data.
[2025-10-24T01:21:59.467533] [DEBUG] [LOCAL     ] FINV: Derivative data saved (139 records).
[2025-10-24T01:21:59.467734] [INFO ] [MAIN      ] FINV: Successfully saved derivative data.
[2025-10-24T01:21:59.470720] [INFO ] [MAIN      ] Derivative Progress: 756/2164 symbols completed. FINV took 1.2s. Estimated remaining: 9m 53s. Rate: 142.5 symbols/min
[2025-10-24T01:21:59.471110] [INFO ] [MAIN      ] FLC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:21:59.489064] [DEBUG] [LOCAL     ] FLC: Loaded 5444 existing records from primary storage.
[2025-10-24T01:21:59.489315] [INFO ] [MAIN      ] FLC: Loaded 5444 primary data records.
[2025-10-24T01:21:59.597403] [DEBUG] [LOCAL     ] FIX: Loaded 28670 existing records from primary storage.
[2025-10-24T01:21:59.614326] [INFO ] [MAIN      ] FIX: Loaded 28670 primary data records.
[2025-10-24T01:21:59.939211] [DEBUG] [LOCAL     ] FIS: Loaded 53715 existing records from primary storage.
[2025-10-24T01:21:59.970012] [INFO ] [MAIN      ] FIS: Loaded 53715 primary data records.
[2025-10-24T01:22:00.455079] [DEBUG] [MAIN      ] FLC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:00.491585] [DEBUG] [MAIN      ] FIX: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:00.535257] [DEBUG] [MAIN      ] FIS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:00.574493] [INFO ] [MAIN      ] FLC: Generated 139 derivative records from 5444 primary records.
[2025-10-24T01:22:00.577910] [DEBUG] [LOCAL     ] FLC: Saving derivative data.
[2025-10-24T01:22:00.603791] [DEBUG] [LOCAL     ] FLC: Derivative data saved (139 records).
[2025-10-24T01:22:00.607450] [INFO ] [MAIN      ] FLC: Successfully saved derivative data.
[2025-10-24T01:22:00.613615] [INFO ] [MAIN      ] Derivative Progress: 757/2164 symbols completed. FLC took 1.1s. Estimated remaining: 9m 54s. Rate: 142.1 symbols/min
[2025-10-24T01:22:00.616435] [INFO ] [MAIN      ] FLG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:00.616889] [INFO ] [MAIN      ] FIX: Generated 139 derivative records from 28670 primary records.
[2025-10-24T01:22:00.618062] [DEBUG] [LOCAL     ] FIX: Saving derivative data.
[2025-10-24T01:22:00.636690] [INFO ] [MAIN      ] FIS: Generated 139 derivative records from 53715 primary records.
[2025-10-24T01:22:00.641723] [DEBUG] [LOCAL     ] FIX: Derivative data saved (139 records).
[2025-10-24T01:22:00.642002] [INFO ] [MAIN      ] FIX: Successfully saved derivative data.
[2025-10-24T01:22:00.644755] [INFO ] [MAIN      ] Derivative Progress: 758/2164 symbols completed. FIX took 1.2s. Estimated remaining: 9m 53s. Rate: 142.3 symbols/min
[2025-10-24T01:22:00.642079] [DEBUG] [LOCAL     ] FIS: Saving derivative data.
[2025-10-24T01:22:00.645046] [INFO ] [MAIN      ] FLNG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:00.659219] [DEBUG] [LOCAL     ] FIS: Derivative data saved (139 records).
[2025-10-24T01:22:00.659368] [INFO ] [MAIN      ] FIS: Successfully saved derivative data.
[2025-10-24T01:22:00.662524] [INFO ] [MAIN      ] Derivative Progress: 759/2164 symbols completed. FIS took 1.2s. Estimated remaining: 9m 52s. Rate: 142.5 symbols/min
[2025-10-24T01:22:00.662851] [INFO ] [MAIN      ] FLO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:00.711050] [DEBUG] [LOCAL     ] FLNG: Loaded 33502 existing records from primary storage.
[2025-10-24T01:22:00.711209] [INFO ] [MAIN      ] FLNG: Loaded 33502 primary data records.
[2025-10-24T01:22:00.919864] [DEBUG] [LOCAL     ] FLO: Loaded 52445 existing records from primary storage.
[2025-10-24T01:22:00.918438] [DEBUG] [LOCAL     ] FLG: Loaded 53708 existing records from primary storage.
[2025-10-24T01:22:01.051883] [INFO ] [MAIN      ] FLO: Loaded 52445 primary data records.
[2025-10-24T01:22:01.061033] [INFO ] [MAIN      ] FLG: Loaded 53708 primary data records.
[2025-10-24T01:22:01.742446] [DEBUG] [MAIN      ] FLNG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:01.798096] [DEBUG] [MAIN      ] FLO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:01.818306] [INFO ] [MAIN      ] FLNG: Generated 139 derivative records from 33502 primary records.
[2025-10-24T01:22:01.821313] [DEBUG] [LOCAL     ] FLNG: Saving derivative data.
[2025-10-24T01:22:01.848824] [DEBUG] [LOCAL     ] FLNG: Derivative data saved (139 records).
[2025-10-24T01:22:01.854453] [INFO ] [MAIN      ] FLNG: Successfully saved derivative data.
[2025-10-24T01:22:01.857717] [INFO ] [MAIN      ] Derivative Progress: 760/2164 symbols completed. FLNG took 1.2s. Estimated remaining: 9m 53s. Rate: 142.1 symbols/min
[2025-10-24T01:22:01.859773] [INFO ] [MAIN      ] FLR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:01.860208] [DEBUG] [MAIN      ] FLG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:01.901689] [INFO ] [MAIN      ] FLO: Generated 139 derivative records from 52445 primary records.
[2025-10-24T01:22:01.903414] [DEBUG] [LOCAL     ] FLO: Saving derivative data.
[2025-10-24T01:22:01.934855] [DEBUG] [LOCAL     ] FLO: Derivative data saved (139 records).
[2025-10-24T01:22:01.937404] [INFO ] [MAIN      ] FLO: Successfully saved derivative data.
[2025-10-24T01:22:01.940538] [INFO ] [MAIN      ] Derivative Progress: 761/2164 symbols completed. FLO took 1.3s. Estimated remaining: 9m 52s. Rate: 142.3 symbols/min
[2025-10-24T01:22:01.942829] [INFO ] [MAIN      ] FLS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:01.963688] [INFO ] [MAIN      ] FLG: Generated 139 derivative records from 53708 primary records.
[2025-10-24T01:22:01.963806] [DEBUG] [LOCAL     ] FLG: Saving derivative data.
[2025-10-24T01:22:01.965089] [DEBUG] [LOCAL     ] FLR: Loaded 53643 existing records from primary storage.
[2025-10-24T01:22:01.965568] [INFO ] [MAIN      ] FLR: Loaded 53643 primary data records.
[2025-10-24T01:22:02.048132] [DEBUG] [LOCAL     ] FLG: Derivative data saved (139 records).
[2025-10-24T01:22:02.089617] [INFO ] [MAIN      ] FLG: Successfully saved derivative data.
[2025-10-24T01:22:02.104799] [INFO ] [MAIN      ] Derivative Progress: 762/2164 symbols completed. FLG took 1.5s. Estimated remaining: 9m 51s. Rate: 142.4 symbols/min
[2025-10-24T01:22:02.148390] [INFO ] [MAIN      ] FLUT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:02.335171] [DEBUG] [LOCAL     ] FLS: Loaded 50773 existing records from primary storage.
[2025-10-24T01:22:02.335760] [INFO ] [MAIN      ] FLS: Loaded 50773 primary data records.
[2025-10-24T01:22:02.661451] [DEBUG] [LOCAL     ] FLUT: Loaded 51016 existing records from primary storage.
[2025-10-24T01:22:02.663147] [INFO ] [MAIN      ] FLUT: Loaded 51016 primary data records.
[2025-10-24T01:22:02.782085] [DEBUG] [MAIN      ] FLR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:03.009992] [DEBUG] [MAIN      ] FLS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:03.040996] [INFO ] [MAIN      ] FLR: Generated 139 derivative records from 53643 primary records.
[2025-10-24T01:22:03.041313] [DEBUG] [LOCAL     ] FLR: Saving derivative data.
[2025-10-24T01:22:03.059028] [DEBUG] [LOCAL     ] FLR: Derivative data saved (139 records).
[2025-10-24T01:22:03.062331] [INFO ] [MAIN      ] FLR: Successfully saved derivative data.
[2025-10-24T01:22:03.065027] [INFO ] [MAIN      ] Derivative Progress: 763/2164 symbols completed. FLR took 1.2s. Estimated remaining: 9m 51s. Rate: 142.2 symbols/min
[2025-10-24T01:22:03.079481] [DEBUG] [MAIN      ] FLUT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:03.094919] [INFO ] [MAIN      ] FLS: Generated 139 derivative records from 50773 primary records.
[2025-10-24T01:22:03.095969] [DEBUG] [LOCAL     ] FLS: Saving derivative data.
[2025-10-24T01:22:03.109637] [DEBUG] [LOCAL     ] FLS: Derivative data saved (139 records).
[2025-10-24T01:22:03.110638] [INFO ] [MAIN      ] FLS: Successfully saved derivative data.
[2025-10-24T01:22:03.113750] [INFO ] [MAIN      ] Derivative Progress: 764/2164 symbols completed. FLS took 1.2s. Estimated remaining: 9m 50s. Rate: 142.3 symbols/min
[2025-10-24T01:22:03.126311] [INFO ] [MAIN      ] FLUT: Generated 139 derivative records from 51016 primary records.
[2025-10-24T01:22:03.126414] [DEBUG] [LOCAL     ] FLUT: Saving derivative data.
[2025-10-24T01:22:03.138778] [DEBUG] [LOCAL     ] FLUT: Derivative data saved (139 records).
[2025-10-24T01:22:03.138857] [INFO ] [MAIN      ] FLUT: Successfully saved derivative data.
[2025-10-24T01:22:03.141625] [INFO ] [MAIN      ] Derivative Progress: 765/2164 symbols completed. FLUT took 1.0s. Estimated remaining: 9m 49s. Rate: 142.5 symbols/min
[2025-10-24T01:22:03.142078] [INFO ] [MAIN      ] FMN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:03.142007] [INFO ] [MAIN      ] FMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:03.142142] [INFO ] [MAIN      ] FLXR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:03.152548] [DEBUG] [LOCAL     ] FMN: Loaded 5496 existing records from primary storage.
[2025-10-24T01:22:03.152861] [INFO ] [MAIN      ] FMN: Loaded 5496 primary data records.
[2025-10-24T01:22:03.267549] [DEBUG] [LOCAL     ] FLXR: Loaded 21596 existing records from primary storage.
[2025-10-24T01:22:03.279701] [INFO ] [MAIN      ] FLXR: Loaded 21596 primary data records.
[2025-10-24T01:22:03.629341] [DEBUG] [LOCAL     ] FMC: Loaded 52264 existing records from primary storage.
[2025-10-24T01:22:03.695274] [INFO ] [MAIN      ] FMC: Loaded 52264 primary data records.
[2025-10-24T01:22:04.140214] [DEBUG] [MAIN      ] FMN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:04.177299] [DEBUG] [MAIN      ] FLXR: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:04.242474] [INFO ] [MAIN      ] FMN: Generated 139 derivative records from 5496 primary records.
[2025-10-24T01:22:04.242738] [DEBUG] [MAIN      ] FMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:04.243107] [DEBUG] [LOCAL     ] FMN: Saving derivative data.
[2025-10-24T01:22:04.271222] [DEBUG] [LOCAL     ] FMN: Derivative data saved (139 records).
[2025-10-24T01:22:04.271478] [INFO ] [MAIN      ] FMN: Successfully saved derivative data.
[2025-10-24T01:22:04.276997] [INFO ] [MAIN      ] Derivative Progress: 766/2164 symbols completed. FMN took 1.1s. Estimated remaining: 9m 50s. Rate: 142.2 symbols/min
[2025-10-24T01:22:04.280268] [INFO ] [MAIN      ] FMS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:04.284717] [INFO ] [MAIN      ] FLXR: Generated 139 derivative records from 21596 primary records.
[2025-10-24T01:22:04.288041] [DEBUG] [LOCAL     ] FLXR: Saving derivative data.
[2025-10-24T01:22:04.301949] [DEBUG] [LOCAL     ] FLXR: Derivative data saved (139 records).
[2025-10-24T01:22:04.302107] [INFO ] [MAIN      ] FLXR: Successfully saved derivative data.
[2025-10-24T01:22:04.305037] [INFO ] [MAIN      ] Derivative Progress: 767/2164 symbols completed. FLXR took 1.2s. Estimated remaining: 9m 49s. Rate: 142.4 symbols/min
[2025-10-24T01:22:04.305442] [INFO ] [MAIN      ] FMX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:04.324695] [INFO ] [MAIN      ] FMC: Generated 139 derivative records from 52264 primary records.
[2025-10-24T01:22:04.325080] [DEBUG] [LOCAL     ] FMC: Saving derivative data.
[2025-10-24T01:22:04.348501] [DEBUG] [LOCAL     ] FMS: Loaded 30525 existing records from primary storage.
[2025-10-24T01:22:04.348928] [INFO ] [MAIN      ] FMS: Loaded 30525 primary data records.
[2025-10-24T01:22:04.348598] [DEBUG] [LOCAL     ] FMC: Derivative data saved (139 records).
[2025-10-24T01:22:04.380088] [INFO ] [MAIN      ] FMC: Successfully saved derivative data.
[2025-10-24T01:22:04.405181] [INFO ] [MAIN      ] Derivative Progress: 768/2164 symbols completed. FMC took 1.3s. Estimated remaining: 9m 48s. Rate: 142.5 symbols/min
[2025-10-24T01:22:04.441516] [INFO ] [MAIN      ] FMY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:04.471633] [DEBUG] [LOCAL     ] FMX: Loaded 40643 existing records from primary storage.
[2025-10-24T01:22:04.482955] [INFO ] [MAIN      ] FMX: Loaded 40643 primary data records.
[2025-10-24T01:22:04.570412] [DEBUG] [LOCAL     ] FMY: Loaded 1365 existing records from primary storage.
[2025-10-24T01:22:04.784704] [INFO ] [MAIN      ] FMY: Loaded 1365 primary data records.
[2025-10-24T01:22:05.336609] [DEBUG] [MAIN      ] FMS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:05.376757] [DEBUG] [MAIN      ] FMX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:05.423440] [DEBUG] [MAIN      ] FMY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:05.458341] [INFO ] [MAIN      ] FMS: Generated 139 derivative records from 30525 primary records.
[2025-10-24T01:22:05.461331] [DEBUG] [LOCAL     ] FMS: Saving derivative data.
[2025-10-24T01:22:05.484568] [INFO ] [MAIN      ] FMX: Generated 139 derivative records from 40643 primary records.
[2025-10-24T01:22:05.485697] [DEBUG] [LOCAL     ] FMX: Saving derivative data.
[2025-10-24T01:22:05.485552] [DEBUG] [LOCAL     ] FMS: Derivative data saved (139 records).
[2025-10-24T01:22:05.487886] [INFO ] [MAIN      ] FMS: Successfully saved derivative data.
[2025-10-24T01:22:05.493334] [INFO ] [MAIN      ] Derivative Progress: 769/2164 symbols completed. FMS took 1.2s. Estimated remaining: 9m 49s. Rate: 142.2 symbols/min
[2025-10-24T01:22:05.503050] [INFO ] [MAIN      ] FN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:05.507428] [DEBUG] [LOCAL     ] FMX: Derivative data saved (139 records).
[2025-10-24T01:22:05.507816] [INFO ] [MAIN      ] FMX: Successfully saved derivative data.
[2025-10-24T01:22:05.512716] [INFO ] [MAIN      ] Derivative Progress: 770/2164 symbols completed. FMX took 1.2s. Estimated remaining: 9m 47s. Rate: 142.4 symbols/min
[2025-10-24T01:22:05.513028] [INFO ] [MAIN      ] FNB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:05.515801] [INFO ] [MAIN      ] FMY: Generated 139 derivative records from 1365 primary records.
[2025-10-24T01:22:05.515893] [DEBUG] [LOCAL     ] FMY: Saving derivative data.
[2025-10-24T01:22:05.525515] [DEBUG] [LOCAL     ] FMY: Derivative data saved (139 records).
[2025-10-24T01:22:05.525852] [INFO ] [MAIN      ] FMY: Successfully saved derivative data.
[2025-10-24T01:22:05.528480] [INFO ] [MAIN      ] Derivative Progress: 771/2164 symbols completed. FMY took 1.1s. Estimated remaining: 9m 46s. Rate: 142.6 symbols/min
[2025-10-24T01:22:05.528860] [INFO ] [MAIN      ] FND: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:05.560242] [DEBUG] [LOCAL     ] FN: Loaded 37580 existing records from primary storage.
[2025-10-24T01:22:05.560425] [INFO ] [MAIN      ] FN: Loaded 37580 primary data records.
[2025-10-24T01:22:05.800240] [DEBUG] [LOCAL     ] FNB: Loaded 52992 existing records from primary storage.
[2025-10-24T01:22:05.930181] [INFO ] [MAIN      ] FNB: Loaded 52992 primary data records.
[2025-10-24T01:22:05.931409] [DEBUG] [LOCAL     ] FND: Loaded 52447 existing records from primary storage.
[2025-10-24T01:22:05.931699] [INFO ] [MAIN      ] FND: Loaded 52447 primary data records.
[2025-10-24T01:22:06.543604] [DEBUG] [MAIN      ] FN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:06.595940] [DEBUG] [MAIN      ] FND: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:06.626473] [INFO ] [MAIN      ] FN: Generated 139 derivative records from 37580 primary records.
[2025-10-24T01:22:06.626816] [DEBUG] [MAIN      ] FNB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:06.627204] [DEBUG] [LOCAL     ] FN: Saving derivative data.
[2025-10-24T01:22:06.659153] [DEBUG] [LOCAL     ] FN: Derivative data saved (139 records).
[2025-10-24T01:22:06.660013] [INFO ] [MAIN      ] FN: Successfully saved derivative data.
[2025-10-24T01:22:06.662573] [INFO ] [MAIN      ] Derivative Progress: 772/2164 symbols completed. FN took 1.2s. Estimated remaining: 9m 47s. Rate: 142.3 symbols/min
[2025-10-24T01:22:06.667254] [INFO ] [MAIN      ] FNF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:06.699163] [INFO ] [MAIN      ] FNB: Generated 139 derivative records from 52992 primary records.
[2025-10-24T01:22:06.697196] [INFO ] [MAIN      ] FND: Generated 139 derivative records from 52447 primary records.
[2025-10-24T01:22:06.699349] [DEBUG] [LOCAL     ] FNB: Saving derivative data.
[2025-10-24T01:22:06.699434] [DEBUG] [LOCAL     ] FND: Saving derivative data.
[2025-10-24T01:22:06.724138] [DEBUG] [LOCAL     ] FND: Derivative data saved (139 records).
[2025-10-24T01:22:06.722667] [DEBUG] [LOCAL     ] FNB: Derivative data saved (139 records).
[2025-10-24T01:22:06.724424] [INFO ] [MAIN      ] FNB: Successfully saved derivative data.
[2025-10-24T01:22:06.727967] [INFO ] [MAIN      ] Derivative Progress: 773/2164 symbols completed. FNB took 1.2s. Estimated remaining: 9m 46s. Rate: 142.4 symbols/min
[2025-10-24T01:22:06.728161] [INFO ] [MAIN      ] FNV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:06.728383] [INFO ] [MAIN      ] FND: Successfully saved derivative data.
[2025-10-24T01:22:06.741554] [INFO ] [MAIN      ] Derivative Progress: 774/2164 symbols completed. FND took 1.2s. Estimated remaining: 9m 45s. Rate: 142.6 symbols/min
[2025-10-24T01:22:06.741832] [INFO ] [MAIN      ] FOA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:06.762860] [DEBUG] [LOCAL     ] FNF: Loaded 49061 existing records from primary storage.
[2025-10-24T01:22:06.766596] [INFO ] [MAIN      ] FNF: Loaded 49061 primary data records.
[2025-10-24T01:22:06.828030] [DEBUG] [LOCAL     ] FOA: Loaded 13094 existing records from primary storage.
[2025-10-24T01:22:06.843231] [INFO ] [MAIN      ] FOA: Loaded 13094 primary data records.
[2025-10-24T01:22:07.097734] [DEBUG] [LOCAL     ] FNV: Loaded 46446 existing records from primary storage.
[2025-10-24T01:22:07.219969] [INFO ] [MAIN      ] FNV: Loaded 46446 primary data records.
[2025-10-24T01:22:07.844917] [DEBUG] [MAIN      ] FNF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:07.879424] [DEBUG] [MAIN      ] FOA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:07.930616] [DEBUG] [MAIN      ] FNV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:07.960995] [INFO ] [MAIN      ] FNF: Generated 139 derivative records from 49061 primary records.
[2025-10-24T01:22:07.965245] [INFO ] [MAIN      ] FOA: Generated 139 derivative records from 13094 primary records.
[2025-10-24T01:22:07.965326] [DEBUG] [LOCAL     ] FNF: Saving derivative data.
[2025-10-24T01:22:07.965559] [DEBUG] [LOCAL     ] FOA: Saving derivative data.
[2025-10-24T01:22:07.988387] [DEBUG] [LOCAL     ] FNF: Derivative data saved (139 records).
[2025-10-24T01:22:07.990789] [INFO ] [MAIN      ] FNF: Successfully saved derivative data.
[2025-10-24T01:22:07.995686] [INFO ] [MAIN      ] Derivative Progress: 775/2164 symbols completed. FNF took 1.3s. Estimated remaining: 9m 46s. Rate: 142.2 symbols/min
[2025-10-24T01:22:07.991354] [DEBUG] [LOCAL     ] FOA: Derivative data saved (139 records).
[2025-10-24T01:22:07.996233] [INFO ] [MAIN      ] FOF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:07.996337] [INFO ] [MAIN      ] FOA: Successfully saved derivative data.
[2025-10-24T01:22:08.000190] [INFO ] [MAIN      ] Derivative Progress: 776/2164 symbols completed. FOA took 1.3s. Estimated remaining: 9m 45s. Rate: 142.4 symbols/min
[2025-10-24T01:22:08.000902] [INFO ] [MAIN      ] FOR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:08.013539] [INFO ] [MAIN      ] FNV: Generated 139 derivative records from 46446 primary records.
[2025-10-24T01:22:08.013767] [DEBUG] [LOCAL     ] FNV: Saving derivative data.
[2025-10-24T01:22:08.034381] [DEBUG] [LOCAL     ] FNV: Derivative data saved (139 records).
[2025-10-24T01:22:08.034878] [INFO ] [MAIN      ] FNV: Successfully saved derivative data.
[2025-10-24T01:22:08.034724] [DEBUG] [LOCAL     ] FOF: Loaded 8451 existing records from primary storage.
[2025-10-24T01:22:08.037902] [INFO ] [MAIN      ] Derivative Progress: 777/2164 symbols completed. FNV took 1.3s. Estimated remaining: 9m 44s. Rate: 142.6 symbols/min
[2025-10-24T01:22:08.038708] [INFO ] [MAIN      ] FOF: Loaded 8451 primary data records.
[2025-10-24T01:22:08.056843] [INFO ] [MAIN      ] FOUR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:08.068413] [DEBUG] [LOCAL     ] FOR: Loaded 19591 existing records from primary storage.
[2025-10-24T01:22:08.124374] [INFO ] [MAIN      ] FOR: Loaded 19591 primary data records.
[2025-10-24T01:22:08.664963] [DEBUG] [LOCAL     ] FOUR: Loaded 50041 existing records from primary storage.
[2025-10-24T01:22:08.666820] [INFO ] [MAIN      ] FOUR: Loaded 50041 primary data records.
[2025-10-24T01:22:08.974258] [DEBUG] [MAIN      ] FOF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:09.022824] [DEBUG] [MAIN      ] FOR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:09.077987] [DEBUG] [MAIN      ] FOUR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:09.096678] [INFO ] [MAIN      ] FOF: Generated 139 derivative records from 8451 primary records.
[2025-10-24T01:22:09.100384] [DEBUG] [LOCAL     ] FOF: Saving derivative data.
[2025-10-24T01:22:09.122899] [DEBUG] [LOCAL     ] FOF: Derivative data saved (139 records).
[2025-10-24T01:22:09.129061] [INFO ] [MAIN      ] FOF: Successfully saved derivative data.
[2025-10-24T01:22:09.132979] [INFO ] [MAIN      ] Derivative Progress: 778/2164 symbols completed. FOF took 1.1s. Estimated remaining: 9m 44s. Rate: 142.3 symbols/min
[2025-10-24T01:22:09.136546] [INFO ] [MAIN      ] FOR: Generated 139 derivative records from 19591 primary records.
[2025-10-24T01:22:09.138064] [DEBUG] [LOCAL     ] FOR: Saving derivative data.
[2025-10-24T01:22:09.154497] [DEBUG] [LOCAL     ] FOR: Derivative data saved (139 records).
[2025-10-24T01:22:09.156216] [INFO ] [MAIN      ] FOR: Successfully saved derivative data.
[2025-10-24T01:22:09.161674] [INFO ] [MAIN      ] Derivative Progress: 779/2164 symbols completed. FOR took 1.2s. Estimated remaining: 9m 43s. Rate: 142.5 symbols/min
[2025-10-24T01:22:09.165027] [INFO ] [MAIN      ] FOUR: Generated 139 derivative records from 50041 primary records.
[2025-10-24T01:22:09.165121] [DEBUG] [LOCAL     ] FOUR: Saving derivative data.
[2025-10-24T01:22:09.177119] [DEBUG] [LOCAL     ] FOUR: Derivative data saved (139 records).
[2025-10-24T01:22:09.177215] [INFO ] [MAIN      ] FOUR: Successfully saved derivative data.
[2025-10-24T01:22:09.179801] [INFO ] [MAIN      ] Derivative Progress: 780/2164 symbols completed. FOUR took 1.1s. Estimated remaining: 9m 42s. Rate: 142.6 symbols/min
[2025-10-24T01:22:09.180253] [INFO ] [MAIN      ] FPF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:09.180699] [INFO ] [MAIN      ] FPH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:09.180403] [INFO ] [MAIN      ] FPI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:09.209601] [DEBUG] [LOCAL     ] FPF: Loaded 18898 existing records from primary storage.
[2025-10-24T01:22:09.209849] [INFO ] [MAIN      ] FPF: Loaded 18898 primary data records.
[2025-10-24T01:22:09.300255] [DEBUG] [LOCAL     ] FPH: Loaded 19347 existing records from primary storage.
[2025-10-24T01:22:09.336049] [INFO ] [MAIN      ] FPH: Loaded 19347 primary data records.
[2025-10-24T01:22:09.409970] [DEBUG] [LOCAL     ] FPI: Loaded 31560 existing records from primary storage.
[2025-10-24T01:22:09.444501] [INFO ] [MAIN      ] FPI: Loaded 31560 primary data records.
[2025-10-24T01:22:10.238227] [DEBUG] [MAIN      ] FPF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:10.282768] [DEBUG] [MAIN      ] FPH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:10.319136] [DEBUG] [MAIN      ] FPI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:10.358969] [INFO ] [MAIN      ] FPF: Generated 139 derivative records from 18898 primary records.
[2025-10-24T01:22:10.365333] [DEBUG] [LOCAL     ] FPF: Saving derivative data.
[2025-10-24T01:22:10.381091] [DEBUG] [LOCAL     ] FPF: Derivative data saved (139 records).
[2025-10-24T01:22:10.383253] [INFO ] [MAIN      ] FPF: Successfully saved derivative data.
[2025-10-24T01:22:10.388416] [INFO ] [MAIN      ] Derivative Progress: 781/2164 symbols completed. FPF took 1.2s. Estimated remaining: 9m 43s. Rate: 142.3 symbols/min
[2025-10-24T01:22:10.389797] [INFO ] [MAIN      ] FR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:10.395180] [INFO ] [MAIN      ] FPH: Generated 139 derivative records from 19347 primary records.
[2025-10-24T01:22:10.395786] [DEBUG] [LOCAL     ] FPH: Saving derivative data.
[2025-10-24T01:22:10.410361] [DEBUG] [LOCAL     ] FPH: Derivative data saved (139 records).
[2025-10-24T01:22:10.413385] [INFO ] [MAIN      ] FPH: Successfully saved derivative data.
[2025-10-24T01:22:10.416590] [INFO ] [MAIN      ] Derivative Progress: 782/2164 symbols completed. FPH took 1.2s. Estimated remaining: 9m 42s. Rate: 142.5 symbols/min
[2025-10-24T01:22:10.413830] [INFO ] [MAIN      ] FPI: Generated 139 derivative records from 31560 primary records.
[2025-10-24T01:22:10.417086] [DEBUG] [LOCAL     ] FPI: Saving derivative data.
[2025-10-24T01:22:10.416923] [INFO ] [MAIN      ] FRA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:10.430394] [DEBUG] [LOCAL     ] FPI: Derivative data saved (139 records).
[2025-10-24T01:22:10.430589] [INFO ] [MAIN      ] FPI: Successfully saved derivative data.
[2025-10-24T01:22:10.433686] [INFO ] [MAIN      ] Derivative Progress: 783/2164 symbols completed. FPI took 1.3s. Estimated remaining: 9m 41s. Rate: 142.6 symbols/min
[2025-10-24T01:22:10.433995] [INFO ] [MAIN      ] FRGE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:10.455665] [DEBUG] [LOCAL     ] FRA: Loaded 14116 existing records from primary storage.
[2025-10-24T01:22:10.455966] [INFO ] [MAIN      ] FRA: Loaded 14116 primary data records.
[2025-10-24T01:22:10.575056] [DEBUG] [LOCAL     ] FRGE: Loaded 15605 existing records from primary storage.
[2025-10-24T01:22:10.575353] [INFO ] [MAIN      ] FRGE: Loaded 15605 primary data records.
[2025-10-24T01:22:10.631326] [DEBUG] [LOCAL     ] FR: Loaded 46973 existing records from primary storage.
[2025-10-24T01:22:10.664907] [INFO ] [MAIN      ] FR: Loaded 46973 primary data records.
[2025-10-24T01:22:11.468161] [DEBUG] [MAIN      ] FRA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:11.494951] [DEBUG] [MAIN      ] FRGE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:11.534224] [DEBUG] [MAIN      ] FR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:11.598048] [INFO ] [MAIN      ] FRA: Generated 139 derivative records from 14116 primary records.
[2025-10-24T01:22:11.599060] [DEBUG] [LOCAL     ] FRA: Saving derivative data.
[2025-10-24T01:22:11.619635] [INFO ] [MAIN      ] FRGE: Generated 139 derivative records from 15605 primary records.
[2025-10-24T01:22:11.619422] [DEBUG] [LOCAL     ] FRA: Derivative data saved (139 records).
[2025-10-24T01:22:11.620099] [DEBUG] [LOCAL     ] FRGE: Saving derivative data.
[2025-10-24T01:22:11.622725] [INFO ] [MAIN      ] FR: Generated 139 derivative records from 46973 primary records.
[2025-10-24T01:22:11.623316] [DEBUG] [LOCAL     ] FR: Saving derivative data.
[2025-10-24T01:22:11.622242] [INFO ] [MAIN      ] FRA: Successfully saved derivative data.
[2025-10-24T01:22:11.626121] [INFO ] [MAIN      ] Derivative Progress: 784/2164 symbols completed. FRA took 1.2s. Estimated remaining: 9m 42s. Rate: 142.3 symbols/min
[2025-10-24T01:22:11.626607] [INFO ] [MAIN      ] FRO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:11.650806] [DEBUG] [LOCAL     ] FRGE: Derivative data saved (139 records).
[2025-10-24T01:22:11.651476] [DEBUG] [LOCAL     ] FR: Derivative data saved (139 records).
[2025-10-24T01:22:11.651727] [INFO ] [MAIN      ] FR: Successfully saved derivative data.
[2025-10-24T01:22:11.651856] [INFO ] [MAIN      ] FRGE: Successfully saved derivative data.
[2025-10-24T01:22:11.654782] [INFO ] [MAIN      ] Derivative Progress: 785/2164 symbols completed. FRGE took 1.2s. Estimated remaining: 9m 41s. Rate: 142.5 symbols/min
[2025-10-24T01:22:11.658105] [INFO ] [MAIN      ] FRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:11.658474] [INFO ] [MAIN      ] Derivative Progress: 786/2164 symbols completed. FR took 1.3s. Estimated remaining: 9m 40s. Rate: 142.6 symbols/min
[2025-10-24T01:22:11.659046] [INFO ] [MAIN      ] FSCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:11.726281] [DEBUG] [LOCAL     ] FRO: Loaded 52061 existing records from primary storage.
[2025-10-24T01:22:11.726584] [INFO ] [MAIN      ] FRO: Loaded 52061 primary data records.
[2025-10-24T01:22:11.824939] [DEBUG] [LOCAL     ] FRT: Loaded 41727 existing records from primary storage.
[2025-10-24T01:22:11.876102] [INFO ] [MAIN      ] FRT: Loaded 41727 primary data records.
[2025-10-24T01:22:11.890184] [DEBUG] [LOCAL     ] FSCO: Loaded 38800 existing records from primary storage.
[2025-10-24T01:22:11.890545] [INFO ] [MAIN      ] FSCO: Loaded 38800 primary data records.
[2025-10-24T01:22:12.771864] [DEBUG] [MAIN      ] FRO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:12.819248] [DEBUG] [MAIN      ] FSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:12.857582] [DEBUG] [MAIN      ] FRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:12.901087] [INFO ] [MAIN      ] FRO: Generated 139 derivative records from 52061 primary records.
[2025-10-24T01:22:12.901786] [DEBUG] [LOCAL     ] FRO: Saving derivative data.
[2025-10-24T01:22:12.922838] [DEBUG] [LOCAL     ] FRO: Derivative data saved (139 records).
[2025-10-24T01:22:12.924247] [INFO ] [MAIN      ] FRO: Successfully saved derivative data.
[2025-10-24T01:22:12.929730] [INFO ] [MAIN      ] Derivative Progress: 787/2164 symbols completed. FRO took 1.3s. Estimated remaining: 9m 41s. Rate: 142.3 symbols/min
[2025-10-24T01:22:12.932320] [INFO ] [MAIN      ] FSK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:12.940247] [INFO ] [MAIN      ] FSCO: Generated 139 derivative records from 38800 primary records.
[2025-10-24T01:22:12.941871] [DEBUG] [LOCAL     ] FSCO: Saving derivative data.
[2025-10-24T01:22:12.944440] [INFO ] [MAIN      ] FRT: Generated 139 derivative records from 41727 primary records.
[2025-10-24T01:22:12.945104] [DEBUG] [LOCAL     ] FRT: Saving derivative data.
[2025-10-24T01:22:12.966993] [DEBUG] [LOCAL     ] FSCO: Derivative data saved (139 records).
[2025-10-24T01:22:12.967843] [INFO ] [MAIN      ] FSCO: Successfully saved derivative data.
[2025-10-24T01:22:12.973476] [INFO ] [MAIN      ] Derivative Progress: 788/2164 symbols completed. FSCO took 1.3s. Estimated remaining: 9m 40s. Rate: 142.4 symbols/min
[2025-10-24T01:22:12.974007] [INFO ] [MAIN      ] FSLY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:12.973608] [DEBUG] [LOCAL     ] FRT: Derivative data saved (139 records).
[2025-10-24T01:22:12.974824] [INFO ] [MAIN      ] FRT: Successfully saved derivative data.
[2025-10-24T01:22:12.978335] [INFO ] [MAIN      ] Derivative Progress: 789/2164 symbols completed. FRT took 1.3s. Estimated remaining: 9m 38s. Rate: 142.6 symbols/min
[2025-10-24T01:22:12.978796] [INFO ] [MAIN      ] FSM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:13.014884] [DEBUG] [LOCAL     ] FSK: Loaded 49831 existing records from primary storage.
[2025-10-24T01:22:13.015323] [INFO ] [MAIN      ] FSK: Loaded 49831 primary data records.
[2025-10-24T01:22:13.230599] [DEBUG] [LOCAL     ] FSM: Loaded 53690 existing records from primary storage.
[2025-10-24T01:22:13.375418] [DEBUG] [LOCAL     ] FSLY: Loaded 51652 existing records from primary storage.
[2025-10-24T01:22:13.376097] [INFO ] [MAIN      ] FSM: Loaded 53690 primary data records.
[2025-10-24T01:22:13.376417] [INFO ] [MAIN      ] FSLY: Loaded 51652 primary data records.
[2025-10-24T01:22:14.058796] [DEBUG] [MAIN      ] FSK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:14.119263] [DEBUG] [MAIN      ] FSLY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:14.122622] [DEBUG] [MAIN      ] FSM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:14.170986] [INFO ] [MAIN      ] FSK: Generated 139 derivative records from 49831 primary records.
[2025-10-24T01:22:14.172329] [DEBUG] [LOCAL     ] FSK: Saving derivative data.
[2025-10-24T01:22:14.192665] [DEBUG] [LOCAL     ] FSK: Derivative data saved (139 records).
[2025-10-24T01:22:14.196867] [INFO ] [MAIN      ] FSK: Successfully saved derivative data.
[2025-10-24T01:22:14.199589] [INFO ] [MAIN      ] Derivative Progress: 790/2164 symbols completed. FSK took 1.3s. Estimated remaining: 9m 39s. Rate: 142.3 symbols/min
[2025-10-24T01:22:14.201468] [INFO ] [MAIN      ] FSS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:14.217024] [INFO ] [MAIN      ] FSLY: Generated 139 derivative records from 51652 primary records.
[2025-10-24T01:22:14.218961] [DEBUG] [LOCAL     ] FSLY: Saving derivative data.
[2025-10-24T01:22:14.221167] [INFO ] [MAIN      ] FSM: Generated 139 derivative records from 53690 primary records.
[2025-10-24T01:22:14.221946] [DEBUG] [LOCAL     ] FSM: Saving derivative data.
[2025-10-24T01:22:14.241826] [DEBUG] [LOCAL     ] FSLY: Derivative data saved (139 records).
[2025-10-24T01:22:14.253901] [INFO ] [MAIN      ] FSLY: Successfully saved derivative data.
[2025-10-24T01:22:14.258046] [INFO ] [MAIN      ] Derivative Progress: 791/2164 symbols completed. FSLY took 1.3s. Estimated remaining: 9m 38s. Rate: 142.4 symbols/min
[2025-10-24T01:22:14.258526] [INFO ] [MAIN      ] FT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:14.258389] [DEBUG] [LOCAL     ] FSM: Derivative data saved (139 records).
[2025-10-24T01:22:14.259150] [INFO ] [MAIN      ] FSM: Successfully saved derivative data.
[2025-10-24T01:22:14.262687] [INFO ] [MAIN      ] Derivative Progress: 792/2164 symbols completed. FSM took 1.3s. Estimated remaining: 9m 37s. Rate: 142.6 symbols/min
[2025-10-24T01:22:14.263083] [INFO ] [MAIN      ] FTHY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:14.283742] [DEBUG] [LOCAL     ] FSS: Loaded 33299 existing records from primary storage.
[2025-10-24T01:22:14.284273] [DEBUG] [LOCAL     ] FT: Loaded 6885 existing records from primary storage.
[2025-10-24T01:22:14.284529] [INFO ] [MAIN      ] FSS: Loaded 33299 primary data records.
[2025-10-24T01:22:14.284762] [INFO ] [MAIN      ] FT: Loaded 6885 primary data records.
[2025-10-24T01:22:14.398052] [DEBUG] [LOCAL     ] FTHY: Loaded 12371 existing records from primary storage.
[2025-10-24T01:22:14.428752] [INFO ] [MAIN      ] FTHY: Loaded 12371 primary data records.
[2025-10-24T01:22:15.235161] [DEBUG] [MAIN      ] FSS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:15.266513] [DEBUG] [MAIN      ] FT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:15.299353] [DEBUG] [MAIN      ] FTHY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:15.358995] [INFO ] [MAIN      ] FSS: Generated 139 derivative records from 33299 primary records.
[2025-10-24T01:22:15.363396] [DEBUG] [LOCAL     ] FSS: Saving derivative data.
[2025-10-24T01:22:15.376264] [INFO ] [MAIN      ] FTHY: Generated 139 derivative records from 12371 primary records.
[2025-10-24T01:22:15.380684] [DEBUG] [LOCAL     ] FTHY: Saving derivative data.
[2025-10-24T01:22:15.384163] [DEBUG] [LOCAL     ] FSS: Derivative data saved (139 records).
[2025-10-24T01:22:15.391869] [INFO ] [MAIN      ] FSS: Successfully saved derivative data.
[2025-10-24T01:22:15.399757] [INFO ] [MAIN      ] Derivative Progress: 793/2164 symbols completed. FSS took 1.2s. Estimated remaining: 9m 38s. Rate: 142.3 symbols/min
[2025-10-24T01:22:15.397129] [DEBUG] [LOCAL     ] FTHY: Derivative data saved (139 records).
[2025-10-24T01:22:15.400501] [INFO ] [MAIN      ] FTHY: Successfully saved derivative data.
[2025-10-24T01:22:15.403820] [INFO ] [MAIN      ] Derivative Progress: 794/2164 symbols completed. FTHY took 1.1s. Estimated remaining: 9m 37s. Rate: 142.5 symbols/min
[2025-10-24T01:22:15.405502] [INFO ] [MAIN      ] FT: Generated 139 derivative records from 6885 primary records.
[2025-10-24T01:22:15.405621] [DEBUG] [LOCAL     ] FT: Saving derivative data.
[2025-10-24T01:22:15.416230] [DEBUG] [LOCAL     ] FT: Derivative data saved (139 records).
[2025-10-24T01:22:15.416310] [INFO ] [MAIN      ] FT: Successfully saved derivative data.
[2025-10-24T01:22:15.418791] [INFO ] [MAIN      ] Derivative Progress: 795/2164 symbols completed. FT took 1.2s. Estimated remaining: 9m 36s. Rate: 142.7 symbols/min
[2025-10-24T01:22:15.419219] [INFO ] [MAIN      ] FTI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:15.419319] [INFO ] [MAIN      ] FTK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:15.419907] [INFO ] [MAIN      ] FTS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:15.478865] [DEBUG] [LOCAL     ] FTK: Loaded 33227 existing records from primary storage.
[2025-10-24T01:22:15.479129] [INFO ] [MAIN      ] FTK: Loaded 33227 primary data records.
[2025-10-24T01:22:15.550826] [DEBUG] [LOCAL     ] FTS: Loaded 42787 existing records from primary storage.
[2025-10-24T01:22:15.576609] [INFO ] [MAIN      ] FTS: Loaded 42787 primary data records.
[2025-10-24T01:22:15.681578] [DEBUG] [LOCAL     ] FTI: Loaded 53683 existing records from primary storage.
[2025-10-24T01:22:15.737670] [INFO ] [MAIN      ] FTI: Loaded 53683 primary data records.
[2025-10-24T01:22:16.508143] [DEBUG] [MAIN      ] FTK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:16.521185] [DEBUG] [MAIN      ] FTS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:16.571147] [DEBUG] [MAIN      ] FTI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:16.632060] [INFO ] [MAIN      ] FTK: Generated 139 derivative records from 33227 primary records.
[2025-10-24T01:22:16.635306] [DEBUG] [LOCAL     ] FTK: Saving derivative data.
[2025-10-24T01:22:16.653970] [DEBUG] [LOCAL     ] FTK: Derivative data saved (139 records).
[2025-10-24T01:22:16.657925] [INFO ] [MAIN      ] FTK: Successfully saved derivative data.
[2025-10-24T01:22:16.660517] [INFO ] [MAIN      ] Derivative Progress: 796/2164 symbols completed. FTK took 1.2s. Estimated remaining: 9m 37s. Rate: 142.3 symbols/min
[2025-10-24T01:22:16.661016] [INFO ] [MAIN      ] FTS: Generated 139 derivative records from 42787 primary records.
[2025-10-24T01:22:16.661154] [INFO ] [MAIN      ] FTV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:16.664046] [INFO ] [MAIN      ] FTI: Generated 139 derivative records from 53683 primary records.
[2025-10-24T01:22:16.664244] [DEBUG] [LOCAL     ] FTS: Saving derivative data.
[2025-10-24T01:22:16.664513] [DEBUG] [LOCAL     ] FTI: Saving derivative data.
[2025-10-24T01:22:16.691139] [DEBUG] [LOCAL     ] FTS: Derivative data saved (139 records).
[2025-10-24T01:22:16.694141] [DEBUG] [LOCAL     ] FTI: Derivative data saved (139 records).
[2025-10-24T01:22:16.694517] [INFO ] [MAIN      ] FTS: Successfully saved derivative data.
[2025-10-24T01:22:16.697799] [INFO ] [MAIN      ] Derivative Progress: 797/2164 symbols completed. FTS took 1.3s. Estimated remaining: 9m 36s. Rate: 142.5 symbols/min
[2025-10-24T01:22:16.698153] [INFO ] [MAIN      ] FTI: Successfully saved derivative data.
[2025-10-24T01:22:16.698689] [INFO ] [MAIN      ] FTWO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:16.706119] [INFO ] [MAIN      ] Derivative Progress: 798/2164 symbols completed. FTI took 1.3s. Estimated remaining: 9m 35s. Rate: 142.6 symbols/min
[2025-10-24T01:22:16.706777] [INFO ] [MAIN      ] FUBO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:16.713433] [DEBUG] [LOCAL     ] FTWO: Loaded 1966 existing records from primary storage.
[2025-10-24T01:22:16.713703] [INFO ] [MAIN      ] FTWO: Loaded 1966 primary data records.
[2025-10-24T01:22:17.059485] [DEBUG] [LOCAL     ] FTV: Loaded 53399 existing records from primary storage.
[2025-10-24T01:22:17.060127] [INFO ] [MAIN      ] FTV: Loaded 53399 primary data records.
[2025-10-24T01:22:17.138092] [DEBUG] [LOCAL     ] FUBO: Loaded 54106 existing records from primary storage.
[2025-10-24T01:22:17.172591] [INFO ] [MAIN      ] FUBO: Loaded 54106 primary data records.
[2025-10-24T01:22:17.621110] [DEBUG] [MAIN      ] FTWO: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:17.788138] [DEBUG] [MAIN      ] FTV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:17.824288] [DEBUG] [MAIN      ] FUBO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:17.846584] [INFO ] [MAIN      ] FTWO: Generated 139 derivative records from 1966 primary records.
[2025-10-24T01:22:17.848478] [DEBUG] [LOCAL     ] FTWO: Saving derivative data.
[2025-10-24T01:22:17.866210] [DEBUG] [LOCAL     ] FTWO: Derivative data saved (139 records).
[2025-10-24T01:22:17.867253] [INFO ] [MAIN      ] FTWO: Successfully saved derivative data.
[2025-10-24T01:22:17.870000] [INFO ] [MAIN      ] Derivative Progress: 799/2164 symbols completed. FTWO took 1.2s. Estimated remaining: 9m 35s. Rate: 142.3 symbols/min
[2025-10-24T01:22:17.872058] [INFO ] [MAIN      ] FUL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:17.897056] [INFO ] [MAIN      ] FTV: Generated 139 derivative records from 53399 primary records.
[2025-10-24T01:22:17.897734] [DEBUG] [LOCAL     ] FTV: Saving derivative data.
[2025-10-24T01:22:17.909517] [INFO ] [MAIN      ] FUBO: Generated 139 derivative records from 54106 primary records.
[2025-10-24T01:22:17.915440] [DEBUG] [LOCAL     ] FUBO: Saving derivative data.
[2025-10-24T01:22:17.915364] [DEBUG] [LOCAL     ] FTV: Derivative data saved (139 records).
[2025-10-24T01:22:17.915693] [INFO ] [MAIN      ] FTV: Successfully saved derivative data.
[2025-10-24T01:22:17.935507] [INFO ] [MAIN      ] Derivative Progress: 800/2164 symbols completed. FTV took 1.3s. Estimated remaining: 9m 34s. Rate: 142.5 symbols/min
[2025-10-24T01:22:17.936717] [INFO ] [MAIN      ] FUN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:17.938726] [DEBUG] [LOCAL     ] FUBO: Derivative data saved (139 records).
[2025-10-24T01:22:17.938864] [INFO ] [MAIN      ] FUBO: Successfully saved derivative data.
[2025-10-24T01:22:17.942346] [INFO ] [MAIN      ] Derivative Progress: 801/2164 symbols completed. FUBO took 1.2s. Estimated remaining: 9m 33s. Rate: 142.7 symbols/min
[2025-10-24T01:22:17.951961] [INFO ] [MAIN      ] FVR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:17.955352] [DEBUG] [LOCAL     ] FUL: Loaded 32220 existing records from primary storage.
[2025-10-24T01:22:17.955705] [INFO ] [MAIN      ] FUL: Loaded 32220 primary data records.
[2025-10-24T01:22:18.112051] [DEBUG] [LOCAL     ] FVR: Loaded 20893 existing records from primary storage.
[2025-10-24T01:22:18.144532] [INFO ] [MAIN      ] FVR: Loaded 20893 primary data records.
[2025-10-24T01:22:18.432495] [DEBUG] [LOCAL     ] FUN: Loaded 52412 existing records from primary storage.
[2025-10-24T01:22:18.461115] [INFO ] [MAIN      ] FUN: Loaded 52412 primary data records.
[2025-10-24T01:22:18.978065] [DEBUG] [MAIN      ] FUL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:19.015883] [DEBUG] [MAIN      ] FVR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:19.078429] [DEBUG] [MAIN      ] FUN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:19.110998] [INFO ] [MAIN      ] FUL: Generated 139 derivative records from 32220 primary records.
[2025-10-24T01:22:19.116275] [DEBUG] [LOCAL     ] FUL: Saving derivative data.
[2025-10-24T01:22:19.140275] [DEBUG] [LOCAL     ] FUL: Derivative data saved (139 records).
[2025-10-24T01:22:19.142924] [INFO ] [MAIN      ] FVR: Generated 139 derivative records from 20893 primary records.
[2025-10-24T01:22:19.144874] [DEBUG] [LOCAL     ] FVR: Saving derivative data.
[2025-10-24T01:22:19.144610] [INFO ] [MAIN      ] FUL: Successfully saved derivative data.
[2025-10-24T01:22:19.147735] [INFO ] [MAIN      ] Derivative Progress: 802/2164 symbols completed. FUL took 1.3s. Estimated remaining: 9m 34s. Rate: 142.3 symbols/min
[2025-10-24T01:22:19.148864] [INFO ] [MAIN      ] FVRR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:19.165052] [DEBUG] [LOCAL     ] FVR: Derivative data saved (139 records).
[2025-10-24T01:22:19.169419] [INFO ] [MAIN      ] FVR: Successfully saved derivative data.
[2025-10-24T01:22:19.172021] [INFO ] [MAIN      ] Derivative Progress: 803/2164 symbols completed. FVR took 1.2s. Estimated remaining: 9m 33s. Rate: 142.5 symbols/min
[2025-10-24T01:22:19.176060] [INFO ] [MAIN      ] FUN: Generated 139 derivative records from 52412 primary records.
[2025-10-24T01:22:19.176385] [DEBUG] [LOCAL     ] FUN: Saving derivative data.
[2025-10-24T01:22:19.176178] [INFO ] [MAIN      ] FXED: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:19.207520] [DEBUG] [LOCAL     ] FUN: Derivative data saved (139 records).
[2025-10-24T01:22:19.207379] [DEBUG] [LOCAL     ] FXED: Loaded 1237 existing records from primary storage.
[2025-10-24T01:22:19.207751] [INFO ] [MAIN      ] FUN: Successfully saved derivative data.
[2025-10-24T01:22:19.211160] [INFO ] [MAIN      ] Derivative Progress: 804/2164 symbols completed. FUN took 1.3s. Estimated remaining: 9m 32s. Rate: 142.7 symbols/min
[2025-10-24T01:22:19.211559] [INFO ] [MAIN      ] G: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:19.211430] [INFO ] [MAIN      ] FXED: Loaded 1237 primary data records.
[2025-10-24T01:22:19.328118] [DEBUG] [LOCAL     ] FVRR: Loaded 40750 existing records from primary storage.
[2025-10-24T01:22:19.346737] [INFO ] [MAIN      ] FVRR: Loaded 40750 primary data records.
[2025-10-24T01:22:19.846206] [DEBUG] [LOCAL     ] G: Loaded 50463 existing records from primary storage.
[2025-10-24T01:22:19.846614] [INFO ] [MAIN      ] G: Loaded 50463 primary data records.
[2025-10-24T01:22:20.212606] [DEBUG] [MAIN      ] FXED: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:20.248707] [DEBUG] [MAIN      ] FVRR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:20.297283] [DEBUG] [MAIN      ] G: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:20.320975] [INFO ] [MAIN      ] FXED: Generated 139 derivative records from 1237 primary records.
[2025-10-24T01:22:20.325454] [DEBUG] [LOCAL     ] FXED: Saving derivative data.
[2025-10-24T01:22:20.342812] [DEBUG] [LOCAL     ] FXED: Derivative data saved (139 records).
[2025-10-24T01:22:20.342988] [INFO ] [MAIN      ] FXED: Successfully saved derivative data.
[2025-10-24T01:22:20.346268] [INFO ] [MAIN      ] Derivative Progress: 805/2164 symbols completed. FXED took 1.2s. Estimated remaining: 9m 33s. Rate: 142.4 symbols/min
[2025-10-24T01:22:20.351915] [INFO ] [MAIN      ] GAB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:20.371613] [INFO ] [MAIN      ] FVRR: Generated 139 derivative records from 40750 primary records.
[2025-10-24T01:22:20.373275] [DEBUG] [LOCAL     ] FVRR: Saving derivative data.
[2025-10-24T01:22:20.384363] [INFO ] [MAIN      ] G: Generated 139 derivative records from 50463 primary records.
[2025-10-24T01:22:20.396609] [DEBUG] [LOCAL     ] FVRR: Derivative data saved (139 records).
[2025-10-24T01:22:20.396720] [DEBUG] [LOCAL     ] G: Saving derivative data.
[2025-10-24T01:22:20.397117] [INFO ] [MAIN      ] FVRR: Successfully saved derivative data.
[2025-10-24T01:22:20.402958] [INFO ] [MAIN      ] Derivative Progress: 806/2164 symbols completed. FVRR took 1.3s. Estimated remaining: 9m 32s. Rate: 142.5 symbols/min
[2025-10-24T01:22:20.421974] [INFO ] [MAIN      ] GAM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:20.423514] [DEBUG] [LOCAL     ] G: Derivative data saved (139 records).
[2025-10-24T01:22:20.424387] [DEBUG] [LOCAL     ] GAB: Loaded 27609 existing records from primary storage.
[2025-10-24T01:22:20.424911] [INFO ] [MAIN      ] G: Successfully saved derivative data.
[2025-10-24T01:22:20.425232] [INFO ] [MAIN      ] GAB: Loaded 27609 primary data records.
[2025-10-24T01:22:20.428343] [INFO ] [MAIN      ] Derivative Progress: 807/2164 symbols completed. G took 1.2s. Estimated remaining: 9m 31s. Rate: 142.7 symbols/min
[2025-10-24T01:22:20.459796] [INFO ] [MAIN      ] GAP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:20.517787] [DEBUG] [LOCAL     ] GAM: Loaded 3836 existing records from primary storage.
[2025-10-24T01:22:20.539367] [INFO ] [MAIN      ] GAM: Loaded 3836 primary data records.
[2025-10-24T01:22:21.067877] [DEBUG] [LOCAL     ] GAP: Loaded 54043 existing records from primary storage.
[2025-10-24T01:22:21.068979] [INFO ] [MAIN      ] GAP: Loaded 54043 primary data records.
[2025-10-24T01:22:21.204504] [DEBUG] [MAIN      ] GAB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:21.451919] [DEBUG] [MAIN      ] GAM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:21.485731] [INFO ] [MAIN      ] GAB: Generated 139 derivative records from 27609 primary records.
[2025-10-24T01:22:21.489450] [DEBUG] [LOCAL     ] GAB: Saving derivative data.
[2025-10-24T01:22:21.508858] [DEBUG] [LOCAL     ] GAB: Derivative data saved (139 records).
[2025-10-24T01:22:21.513378] [INFO ] [MAIN      ] GAB: Successfully saved derivative data.
[2025-10-24T01:22:21.533314] [INFO ] [MAIN      ] Derivative Progress: 808/2164 symbols completed. GAB took 1.2s. Estimated remaining: 9m 31s. Rate: 142.4 symbols/min
[2025-10-24T01:22:21.530841] [DEBUG] [MAIN      ] GAP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:21.552949] [INFO ] [MAIN      ] GAM: Generated 139 derivative records from 3836 primary records.
[2025-10-24T01:22:21.555506] [DEBUG] [LOCAL     ] GAM: Saving derivative data.
[2025-10-24T01:22:21.583146] [DEBUG] [LOCAL     ] GAM: Derivative data saved (139 records).
[2025-10-24T01:22:21.587295] [INFO ] [MAIN      ] GAM: Successfully saved derivative data.
[2025-10-24T01:22:21.591320] [INFO ] [MAIN      ] Derivative Progress: 809/2164 symbols completed. GAM took 1.2s. Estimated remaining: 9m 30s. Rate: 142.5 symbols/min
[2025-10-24T01:22:21.599449] [INFO ] [MAIN      ] GAP: Generated 139 derivative records from 54043 primary records.
[2025-10-24T01:22:21.599700] [DEBUG] [LOCAL     ] GAP: Saving derivative data.
[2025-10-24T01:22:21.619520] [DEBUG] [LOCAL     ] GAP: Derivative data saved (139 records).
[2025-10-24T01:22:21.619741] [INFO ] [MAIN      ] GAP: Successfully saved derivative data.
[2025-10-24T01:22:21.624026] [INFO ] [MAIN      ] Derivative Progress: 810/2164 symbols completed. GAP took 1.2s. Estimated remaining: 9m 29s. Rate: 142.7 symbols/min
[2025-10-24T01:22:21.624808] [INFO ] [MAIN      ] GATX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:21.624991] [INFO ] [MAIN      ] GBCI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:21.625366] [INFO ] [MAIN      ] GBAB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:21.651703] [DEBUG] [LOCAL     ] GBAB: Loaded 12790 existing records from primary storage.
[2025-10-24T01:22:21.651984] [INFO ] [MAIN      ] GBAB: Loaded 12790 primary data records.
[2025-10-24T01:22:21.721827] [DEBUG] [LOCAL     ] GATX: Loaded 18194 existing records from primary storage.
[2025-10-24T01:22:21.727392] [INFO ] [MAIN      ] GATX: Loaded 18194 primary data records.
[2025-10-24T01:22:21.907380] [DEBUG] [LOCAL     ] GBCI: Loaded 41514 existing records from primary storage.
[2025-10-24T01:22:21.954868] [INFO ] [MAIN      ] GBCI: Loaded 41514 primary data records.
[2025-10-24T01:22:22.916956] [DEBUG] [MAIN      ] GBAB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:22.943462] [DEBUG] [MAIN      ] GATX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:22.984003] [DEBUG] [MAIN      ] GBCI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:23.033473] [INFO ] [MAIN      ] GATX: Generated 139 derivative records from 18194 primary records.
[2025-10-24T01:22:23.037326] [DEBUG] [LOCAL     ] GATX: Saving derivative data.
[2025-10-24T01:22:23.055299] [INFO ] [MAIN      ] GBAB: Generated 139 derivative records from 12790 primary records.
[2025-10-24T01:22:23.055700] [DEBUG] [LOCAL     ] GATX: Derivative data saved (139 records).
[2025-10-24T01:22:23.055552] [DEBUG] [LOCAL     ] GBAB: Saving derivative data.
[2025-10-24T01:22:23.057705] [INFO ] [MAIN      ] GATX: Successfully saved derivative data.
[2025-10-24T01:22:23.066491] [INFO ] [MAIN      ] GBCI: Generated 139 derivative records from 41514 primary records.
[2025-10-24T01:22:23.072246] [INFO ] [MAIN      ] Derivative Progress: 811/2164 symbols completed. GATX took 1.4s. Estimated remaining: 9m 31s. Rate: 142.3 symbols/min
[2025-10-24T01:22:23.073217] [DEBUG] [LOCAL     ] GBAB: Derivative data saved (139 records).
[2025-10-24T01:22:23.073563] [INFO ] [MAIN      ] GBTG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:23.073459] [DEBUG] [LOCAL     ] GBCI: Saving derivative data.
[2025-10-24T01:22:23.073378] [INFO ] [MAIN      ] GBAB: Successfully saved derivative data.
[2025-10-24T01:22:23.076216] [INFO ] [MAIN      ] Derivative Progress: 812/2164 symbols completed. GBAB took 1.5s. Estimated remaining: 9m 29s. Rate: 142.4 symbols/min
[2025-10-24T01:22:23.076448] [INFO ] [MAIN      ] GBX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:23.091557] [DEBUG] [LOCAL     ] GBCI: Derivative data saved (139 records).
[2025-10-24T01:22:23.091895] [INFO ] [MAIN      ] GBCI: Successfully saved derivative data.
[2025-10-24T01:22:23.095150] [INFO ] [MAIN      ] Derivative Progress: 813/2164 symbols completed. GBCI took 1.5s. Estimated remaining: 9m 28s. Rate: 142.6 symbols/min
[2025-10-24T01:22:23.095614] [INFO ] [MAIN      ] GCI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:23.130832] [DEBUG] [LOCAL     ] GBX: Loaded 28356 existing records from primary storage.
[2025-10-24T01:22:23.141698] [INFO ] [MAIN      ] GBX: Loaded 28356 primary data records.
[2025-10-24T01:22:23.165773] [DEBUG] [LOCAL     ] GBTG: Loaded 40489 existing records from primary storage.
[2025-10-24T01:22:23.192611] [INFO ] [MAIN      ] GBTG: Loaded 40489 primary data records.
[2025-10-24T01:22:23.360400] [DEBUG] [LOCAL     ] GCI: Loaded 43883 existing records from primary storage.
[2025-10-24T01:22:23.402858] [INFO ] [MAIN      ] GCI: Loaded 43883 primary data records.
[2025-10-24T01:22:24.117394] [DEBUG] [MAIN      ] GBTG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:24.116873] [DEBUG] [MAIN      ] GBX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:24.177079] [DEBUG] [MAIN      ] GCI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:24.216973] [INFO ] [MAIN      ] GBTG: Generated 139 derivative records from 40489 primary records.
[2025-10-24T01:22:24.214749] [INFO ] [MAIN      ] GBX: Generated 139 derivative records from 28356 primary records.
[2025-10-24T01:22:24.217490] [DEBUG] [LOCAL     ] GBTG: Saving derivative data.
[2025-10-24T01:22:24.217664] [DEBUG] [LOCAL     ] GBX: Saving derivative data.
[2025-10-24T01:22:24.234486] [DEBUG] [LOCAL     ] GBTG: Derivative data saved (139 records).
[2025-10-24T01:22:24.237308] [INFO ] [MAIN      ] GBTG: Successfully saved derivative data.
[2025-10-24T01:22:24.247668] [INFO ] [MAIN      ] Derivative Progress: 814/2164 symbols completed. GBTG took 1.2s. Estimated remaining: 9m 29s. Rate: 142.3 symbols/min
[2025-10-24T01:22:24.252268] [DEBUG] [LOCAL     ] GBX: Derivative data saved (139 records).
[2025-10-24T01:22:24.252747] [INFO ] [MAIN      ] GBX: Successfully saved derivative data.
[2025-10-24T01:22:24.255075] [INFO ] [MAIN      ] Derivative Progress: 815/2164 symbols completed. GBX took 1.2s. Estimated remaining: 9m 28s. Rate: 142.5 symbols/min
[2025-10-24T01:22:24.252419] [INFO ] [MAIN      ] GCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:24.255266] [INFO ] [MAIN      ] GCTS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:24.262375] [INFO ] [MAIN      ] GCI: Generated 139 derivative records from 43883 primary records.
[2025-10-24T01:22:24.262732] [DEBUG] [LOCAL     ] GCI: Saving derivative data.
[2025-10-24T01:22:24.274470] [DEBUG] [LOCAL     ] GCI: Derivative data saved (139 records).
[2025-10-24T01:22:24.274737] [INFO ] [MAIN      ] GCI: Successfully saved derivative data.
[2025-10-24T01:22:24.278255] [INFO ] [MAIN      ] Derivative Progress: 816/2164 symbols completed. GCI took 1.2s. Estimated remaining: 9m 27s. Rate: 142.6 symbols/min
[2025-10-24T01:22:24.278742] [INFO ] [MAIN      ] GCV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:24.300626] [DEBUG] [LOCAL     ] GCTS: Loaded 20365 existing records from primary storage.
[2025-10-24T01:22:24.310719] [INFO ] [MAIN      ] GCTS: Loaded 20365 primary data records.
[2025-10-24T01:22:24.311009] [DEBUG] [LOCAL     ] GCV: Loaded 7854 existing records from primary storage.
[2025-10-24T01:22:24.311398] [INFO ] [MAIN      ] GCV: Loaded 7854 primary data records.
[2025-10-24T01:22:24.322981] [DEBUG] [LOCAL     ] GCO: Loaded 22941 existing records from primary storage.
[2025-10-24T01:22:24.333264] [INFO ] [MAIN      ] GCO: Loaded 22941 primary data records.
[2025-10-24T01:22:25.316414] [DEBUG] [MAIN      ] GCTS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:25.367530] [DEBUG] [MAIN      ] GCV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:25.362237] [DEBUG] [MAIN      ] GCO: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:25.451484] [INFO ] [MAIN      ] GCTS: Generated 139 derivative records from 20365 primary records.
[2025-10-24T01:22:25.455182] [INFO ] [MAIN      ] GCO: Generated 139 derivative records from 22941 primary records.
[2025-10-24T01:22:25.455814] [DEBUG] [LOCAL     ] GCTS: Saving derivative data.
[2025-10-24T01:22:25.456399] [DEBUG] [LOCAL     ] GCO: Saving derivative data.
[2025-10-24T01:22:25.489835] [DEBUG] [LOCAL     ] GCTS: Derivative data saved (139 records).
[2025-10-24T01:22:25.490323] [INFO ] [MAIN      ] GCTS: Successfully saved derivative data.
[2025-10-24T01:22:25.486763] [DEBUG] [LOCAL     ] GCO: Derivative data saved (139 records).
[2025-10-24T01:22:25.492998] [INFO ] [MAIN      ] Derivative Progress: 817/2164 symbols completed. GCTS took 1.2s. Estimated remaining: 9m 28s. Rate: 142.3 symbols/min
[2025-10-24T01:22:25.490555] [INFO ] [MAIN      ] GCO: Successfully saved derivative data.
[2025-10-24T01:22:25.493547] [INFO ] [MAIN      ] GD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:25.496456] [INFO ] [MAIN      ] Derivative Progress: 818/2164 symbols completed. GCO took 1.2s. Estimated remaining: 9m 27s. Rate: 142.5 symbols/min
[2025-10-24T01:22:25.497495] [INFO ] [MAIN      ] GDDY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:25.500133] [INFO ] [MAIN      ] GCV: Generated 139 derivative records from 7854 primary records.
[2025-10-24T01:22:25.501130] [DEBUG] [LOCAL     ] GCV: Saving derivative data.
[2025-10-24T01:22:25.514119] [DEBUG] [LOCAL     ] GCV: Derivative data saved (139 records).
[2025-10-24T01:22:25.514352] [INFO ] [MAIN      ] GCV: Successfully saved derivative data.
[2025-10-24T01:22:25.518870] [INFO ] [MAIN      ] Derivative Progress: 819/2164 symbols completed. GCV took 1.2s. Estimated remaining: 9m 26s. Rate: 142.7 symbols/min
[2025-10-24T01:22:25.519205] [INFO ] [MAIN      ] GDIV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:25.532151] [DEBUG] [LOCAL     ] GDIV: Loaded 3522 existing records from primary storage.
[2025-10-24T01:22:25.532434] [INFO ] [MAIN      ] GDIV: Loaded 3522 primary data records.
[2025-10-24T01:22:25.698317] [DEBUG] [LOCAL     ] GD: Loaded 46837 existing records from primary storage.
[2025-10-24T01:22:25.698558] [INFO ] [MAIN      ] GD: Loaded 46837 primary data records.
[2025-10-24T01:22:25.715025] [DEBUG] [LOCAL     ] GDDY: Loaded 49956 existing records from primary storage.
[2025-10-24T01:22:25.752027] [INFO ] [MAIN      ] GDDY: Loaded 49956 primary data records.
[2025-10-24T01:22:26.565862] [DEBUG] [MAIN      ] GDIV: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:26.622838] [DEBUG] [MAIN      ] GDDY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:26.624577] [DEBUG] [MAIN      ] GD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:26.679831] [INFO ] [MAIN      ] GDIV: Generated 139 derivative records from 3522 primary records.
[2025-10-24T01:22:26.683101] [DEBUG] [LOCAL     ] GDIV: Saving derivative data.
[2025-10-24T01:22:26.702694] [DEBUG] [LOCAL     ] GDIV: Derivative data saved (139 records).
[2025-10-24T01:22:26.707315] [INFO ] [MAIN      ] GDIV: Successfully saved derivative data.
[2025-10-24T01:22:26.709845] [INFO ] [MAIN      ] Derivative Progress: 820/2164 symbols completed. GDIV took 1.2s. Estimated remaining: 9m 27s. Rate: 142.3 symbols/min
[2025-10-24T01:22:26.713358] [INFO ] [MAIN      ] GDO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:26.721443] [INFO ] [MAIN      ] GD: Generated 139 derivative records from 46837 primary records.
[2025-10-24T01:22:26.722978] [DEBUG] [LOCAL     ] GD: Saving derivative data.
[2025-10-24T01:22:26.727097] [INFO ] [MAIN      ] GDDY: Generated 139 derivative records from 49956 primary records.
[2025-10-24T01:22:26.727214] [DEBUG] [LOCAL     ] GDDY: Saving derivative data.
[2025-10-24T01:22:26.739597] [DEBUG] [LOCAL     ] GD: Derivative data saved (139 records).
[2025-10-24T01:22:26.753818] [INFO ] [MAIN      ] GD: Successfully saved derivative data.
[2025-10-24T01:22:26.744752] [DEBUG] [LOCAL     ] GDO: Loaded 5905 existing records from primary storage.
[2025-10-24T01:22:26.756607] [DEBUG] [LOCAL     ] GDDY: Derivative data saved (139 records).
[2025-10-24T01:22:26.759673] [INFO ] [MAIN      ] Derivative Progress: 821/2164 symbols completed. GD took 1.3s. Estimated remaining: 9m 26s. Rate: 142.5 symbols/min
[2025-10-24T01:22:26.760015] [INFO ] [MAIN      ] GDDY: Successfully saved derivative data.
[2025-10-24T01:22:26.759918] [INFO ] [MAIN      ] GDO: Loaded 5905 primary data records.
[2025-10-24T01:22:26.760259] [INFO ] [MAIN      ] GDOT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:26.775185] [INFO ] [MAIN      ] Derivative Progress: 822/2164 symbols completed. GDDY took 1.3s. Estimated remaining: 9m 24s. Rate: 142.7 symbols/min
[2025-10-24T01:22:26.795831] [INFO ] [MAIN      ] GDV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:26.967412] [DEBUG] [LOCAL     ] GDV: Loaded 19241 existing records from primary storage.
[2025-10-24T01:22:27.001527] [INFO ] [MAIN      ] GDV: Loaded 19241 primary data records.
[2025-10-24T01:22:27.208910] [DEBUG] [LOCAL     ] GDOT: Loaded 37911 existing records from primary storage.
[2025-10-24T01:22:27.233221] [INFO ] [MAIN      ] GDOT: Loaded 37911 primary data records.
[2025-10-24T01:22:27.746624] [DEBUG] [MAIN      ] GDO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:27.798396] [DEBUG] [MAIN      ] GDV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:27.843009] [DEBUG] [MAIN      ] GDOT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:27.863588] [INFO ] [MAIN      ] GDO: Generated 139 derivative records from 5905 primary records.
[2025-10-24T01:22:27.867182] [DEBUG] [LOCAL     ] GDO: Saving derivative data.
[2025-10-24T01:22:27.889127] [DEBUG] [LOCAL     ] GDO: Derivative data saved (139 records).
[2025-10-24T01:22:27.892629] [INFO ] [MAIN      ] GDO: Successfully saved derivative data.
[2025-10-24T01:22:27.896048] [INFO ] [MAIN      ] Derivative Progress: 823/2164 symbols completed. GDO took 1.2s. Estimated remaining: 9m 25s. Rate: 142.4 symbols/min
[2025-10-24T01:22:27.904874] [INFO ] [MAIN      ] GDV: Generated 139 derivative records from 19241 primary records.
[2025-10-24T01:22:27.905959] [DEBUG] [LOCAL     ] GDV: Saving derivative data.
[2025-10-24T01:22:27.928508] [INFO ] [MAIN      ] GDOT: Generated 139 derivative records from 37911 primary records.
[2025-10-24T01:22:27.926771] [DEBUG] [LOCAL     ] GDV: Derivative data saved (139 records).
[2025-10-24T01:22:27.928714] [DEBUG] [LOCAL     ] GDOT: Saving derivative data.
[2025-10-24T01:22:27.929274] [INFO ] [MAIN      ] GDV: Successfully saved derivative data.
[2025-10-24T01:22:27.931555] [INFO ] [MAIN      ] Derivative Progress: 824/2164 symbols completed. GDV took 1.1s. Estimated remaining: 9m 24s. Rate: 142.5 symbols/min
[2025-10-24T01:22:27.943338] [DEBUG] [LOCAL     ] GDOT: Derivative data saved (139 records).
[2025-10-24T01:22:27.943469] [INFO ] [MAIN      ] GDOT: Successfully saved derivative data.
[2025-10-24T01:22:27.946554] [INFO ] [MAIN      ] Derivative Progress: 825/2164 symbols completed. GDOT took 1.2s. Estimated remaining: 9m 23s. Rate: 142.7 symbols/min
[2025-10-24T01:22:27.947064] [INFO ] [MAIN      ] GEL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:27.947195] [INFO ] [MAIN      ] GE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:27.947981] [INFO ] [MAIN      ] GEF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:27.979704] [DEBUG] [LOCAL     ] GEF: Loaded 20824 existing records from primary storage.
[2025-10-24T01:22:27.979923] [INFO ] [MAIN      ] GEF: Loaded 20824 primary data records.
[2025-10-24T01:22:28.081197] [DEBUG] [LOCAL     ] GEL: Loaded 31358 existing records from primary storage.
[2025-10-24T01:22:28.097440] [INFO ] [MAIN      ] GEL: Loaded 31358 primary data records.
[2025-10-24T01:22:28.455827] [DEBUG] [LOCAL     ] GE: Loaded 54083 existing records from primary storage.
[2025-10-24T01:22:28.457030] [INFO ] [MAIN      ] GE: Loaded 54083 primary data records.
[2025-10-24T01:22:29.008462] [DEBUG] [MAIN      ] GEF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:29.051018] [DEBUG] [MAIN      ] GEL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:29.098970] [INFO ] [MAIN      ] GEF: Generated 139 derivative records from 20824 primary records.
[2025-10-24T01:22:29.098753] [DEBUG] [MAIN      ] GE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:29.099288] [DEBUG] [LOCAL     ] GEF: Saving derivative data.
[2025-10-24T01:22:29.128853] [DEBUG] [LOCAL     ] GEF: Derivative data saved (139 records).
[2025-10-24T01:22:29.129429] [INFO ] [MAIN      ] GEF: Successfully saved derivative data.
[2025-10-24T01:22:29.131708] [INFO ] [MAIN      ] Derivative Progress: 826/2164 symbols completed. GEF took 1.2s. Estimated remaining: 9m 24s. Rate: 142.4 symbols/min
[2025-10-24T01:22:29.134831] [INFO ] [MAIN      ] GENI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:29.157217] [INFO ] [MAIN      ] GEL: Generated 139 derivative records from 31358 primary records.
[2025-10-24T01:22:29.159108] [DEBUG] [LOCAL     ] GEL: Saving derivative data.
[2025-10-24T01:22:29.180381] [DEBUG] [LOCAL     ] GEL: Derivative data saved (139 records).
[2025-10-24T01:22:29.177841] [INFO ] [MAIN      ] GE: Generated 139 derivative records from 54083 primary records.
[2025-10-24T01:22:29.180598] [INFO ] [MAIN      ] GEL: Successfully saved derivative data.
[2025-10-24T01:22:29.180792] [DEBUG] [LOCAL     ] GE: Saving derivative data.
[2025-10-24T01:22:29.183427] [INFO ] [MAIN      ] Derivative Progress: 827/2164 symbols completed. GEL took 1.2s. Estimated remaining: 9m 23s. Rate: 142.5 symbols/min
[2025-10-24T01:22:29.183797] [INFO ] [MAIN      ] GEO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:29.212234] [DEBUG] [LOCAL     ] GE: Derivative data saved (139 records).
[2025-10-24T01:22:29.212402] [INFO ] [MAIN      ] GE: Successfully saved derivative data.
[2025-10-24T01:22:29.215864] [INFO ] [MAIN      ] Derivative Progress: 828/2164 symbols completed. GE took 1.3s. Estimated remaining: 9m 22s. Rate: 142.7 symbols/min
[2025-10-24T01:22:29.217610] [INFO ] [MAIN      ] GES: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:29.234616] [DEBUG] [LOCAL     ] GENI: Loaded 53310 existing records from primary storage.
[2025-10-24T01:22:29.234906] [INFO ] [MAIN      ] GENI: Loaded 53310 primary data records.
[2025-10-24T01:22:29.597126] [DEBUG] [LOCAL     ] GEO: Loaded 52037 existing records from primary storage.
[2025-10-24T01:22:29.598015] [DEBUG] [LOCAL     ] GES: Loaded 38089 existing records from primary storage.
[2025-10-24T01:22:29.598264] [INFO ] [MAIN      ] GES: Loaded 38089 primary data records.
[2025-10-24T01:22:29.598330] [INFO ] [MAIN      ] GEO: Loaded 52037 primary data records.
[2025-10-24T01:22:30.273929] [DEBUG] [MAIN      ] GENI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:30.327419] [DEBUG] [MAIN      ] GEO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:30.363573] [DEBUG] [MAIN      ] GES: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:30.381933] [INFO ] [MAIN      ] GENI: Generated 139 derivative records from 53310 primary records.
[2025-10-24T01:22:30.385906] [DEBUG] [LOCAL     ] GENI: Saving derivative data.
[2025-10-24T01:22:30.405118] [DEBUG] [LOCAL     ] GENI: Derivative data saved (139 records).
[2025-10-24T01:22:30.407844] [INFO ] [MAIN      ] GENI: Successfully saved derivative data.
[2025-10-24T01:22:30.414911] [INFO ] [MAIN      ] Derivative Progress: 829/2164 symbols completed. GENI took 1.3s. Estimated remaining: 9m 23s. Rate: 142.4 symbols/min
[2025-10-24T01:22:30.416321] [INFO ] [MAIN      ] GETY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:30.437520] [INFO ] [MAIN      ] GEO: Generated 139 derivative records from 52037 primary records.
[2025-10-24T01:22:30.439432] [DEBUG] [LOCAL     ] GEO: Saving derivative data.
[2025-10-24T01:22:30.460155] [INFO ] [MAIN      ] GES: Generated 139 derivative records from 38089 primary records.
[2025-10-24T01:22:30.461923] [DEBUG] [LOCAL     ] GES: Saving derivative data.
[2025-10-24T01:22:30.465264] [DEBUG] [LOCAL     ] GEO: Derivative data saved (139 records).
[2025-10-24T01:22:30.466074] [INFO ] [MAIN      ] GEO: Successfully saved derivative data.
[2025-10-24T01:22:30.478046] [INFO ] [MAIN      ] Derivative Progress: 830/2164 symbols completed. GEO took 1.3s. Estimated remaining: 9m 22s. Rate: 142.5 symbols/min
[2025-10-24T01:22:30.480722] [INFO ] [MAIN      ] GEV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:30.492989] [DEBUG] [LOCAL     ] GES: Derivative data saved (139 records).
[2025-10-24T01:22:30.493121] [INFO ] [MAIN      ] GES: Successfully saved derivative data.
[2025-10-24T01:22:30.497434] [INFO ] [MAIN      ] Derivative Progress: 831/2164 symbols completed. GES took 1.3s. Estimated remaining: 9m 21s. Rate: 142.7 symbols/min
[2025-10-24T01:22:30.498896] [DEBUG] [LOCAL     ] GETY: Loaded 35534 existing records from primary storage.
[2025-10-24T01:22:30.499193] [INFO ] [MAIN      ] GF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:30.499329] [INFO ] [MAIN      ] GETY: Loaded 35534 primary data records.
[2025-10-24T01:22:30.584884] [DEBUG] [LOCAL     ] GF: Loaded 2643 existing records from primary storage.
[2025-10-24T01:22:30.606916] [INFO ] [MAIN      ] GF: Loaded 2643 primary data records.
[2025-10-24T01:22:31.050819] [DEBUG] [LOCAL     ] GEV: Loaded 53379 existing records from primary storage.
[2025-10-24T01:22:31.172848] [INFO ] [MAIN      ] GEV: Loaded 53379 primary data records.
[2025-10-24T01:22:31.495255] [DEBUG] [MAIN      ] GETY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:31.541899] [DEBUG] [MAIN      ] GF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:31.589344] [DEBUG] [MAIN      ] GEV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:31.609153] [INFO ] [MAIN      ] GETY: Generated 139 derivative records from 35534 primary records.
[2025-10-24T01:22:31.610006] [DEBUG] [LOCAL     ] GETY: Saving derivative data.
[2025-10-24T01:22:31.632982] [DEBUG] [LOCAL     ] GETY: Derivative data saved (139 records).
[2025-10-24T01:22:31.635164] [INFO ] [MAIN      ] GETY: Successfully saved derivative data.
[2025-10-24T01:22:31.640375] [INFO ] [MAIN      ] Derivative Progress: 832/2164 symbols completed. GETY took 1.2s. Estimated remaining: 9m 21s. Rate: 142.4 symbols/min
[2025-10-24T01:22:31.645304] [INFO ] [MAIN      ] GFF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:31.656907] [INFO ] [MAIN      ] GF: Generated 139 derivative records from 2643 primary records.
[2025-10-24T01:22:31.657379] [DEBUG] [LOCAL     ] GF: Saving derivative data.
[2025-10-24T01:22:31.669895] [INFO ] [MAIN      ] GEV: Generated 139 derivative records from 53379 primary records.
[2025-10-24T01:22:31.672402] [DEBUG] [LOCAL     ] GEV: Saving derivative data.
[2025-10-24T01:22:31.672097] [DEBUG] [LOCAL     ] GF: Derivative data saved (139 records).
[2025-10-24T01:22:31.681273] [INFO ] [MAIN      ] GF: Successfully saved derivative data.
[2025-10-24T01:22:31.693504] [INFO ] [MAIN      ] Derivative Progress: 833/2164 symbols completed. GF took 1.2s. Estimated remaining: 9m 20s. Rate: 142.5 symbols/min
[2025-10-24T01:22:31.695960] [DEBUG] [LOCAL     ] GEV: Derivative data saved (139 records).
[2025-10-24T01:22:31.696181] [INFO ] [MAIN      ] GFI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:31.696255] [INFO ] [MAIN      ] GEV: Successfully saved derivative data.
[2025-10-24T01:22:31.699496] [INFO ] [MAIN      ] Derivative Progress: 834/2164 symbols completed. GEV took 1.2s. Estimated remaining: 9m 19s. Rate: 142.7 symbols/min
[2025-10-24T01:22:31.700706] [INFO ] [MAIN      ] GFL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:31.713196] [DEBUG] [LOCAL     ] GFF: Loaded 29553 existing records from primary storage.
[2025-10-24T01:22:31.713691] [INFO ] [MAIN      ] GFF: Loaded 29553 primary data records.
[2025-10-24T01:22:32.092791] [DEBUG] [LOCAL     ] GFI: Loaded 53505 existing records from primary storage.
[2025-10-24T01:22:32.094253] [INFO ] [MAIN      ] GFI: Loaded 53505 primary data records.
[2025-10-24T01:22:32.172195] [DEBUG] [LOCAL     ] GFL: Loaded 47819 existing records from primary storage.
[2025-10-24T01:22:32.198613] [INFO ] [MAIN      ] GFL: Loaded 47819 primary data records.
[2025-10-24T01:22:32.744241] [DEBUG] [MAIN      ] GFF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:32.797912] [INFO ] [MAIN      ] GFF: Generated 139 derivative records from 29553 primary records.
[2025-10-24T01:22:32.816111] [DEBUG] [LOCAL     ] GFF: Saving derivative data.
[2025-10-24T01:22:32.816610] [DEBUG] [MAIN      ] GFI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:32.816016] [DEBUG] [MAIN      ] GFL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:32.858314] [DEBUG] [LOCAL     ] GFF: Derivative data saved (139 records).
[2025-10-24T01:22:32.860103] [INFO ] [MAIN      ] GFF: Successfully saved derivative data.
[2025-10-24T01:22:32.870563] [INFO ] [MAIN      ] Derivative Progress: 835/2164 symbols completed. GFF took 1.2s. Estimated remaining: 9m 20s. Rate: 142.4 symbols/min
[2025-10-24T01:22:32.872852] [INFO ] [MAIN      ] GFR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:32.897276] [DEBUG] [LOCAL     ] GFR: Loaded 7396 existing records from primary storage.
[2025-10-24T01:22:32.901477] [INFO ] [MAIN      ] GFR: Loaded 7396 primary data records.
[2025-10-24T01:22:33.002517] [INFO ] [MAIN      ] GFI: Generated 139 derivative records from 53505 primary records.
[2025-10-24T01:22:33.036996] [DEBUG] [LOCAL     ] GFI: Saving derivative data.
[2025-10-24T01:22:33.026374] [INFO ] [MAIN      ] GFL: Generated 139 derivative records from 47819 primary records.
[2025-10-24T01:22:33.037333] [DEBUG] [LOCAL     ] GFL: Saving derivative data.
[2025-10-24T01:22:33.142346] [DEBUG] [LOCAL     ] GFL: Derivative data saved (139 records).
[2025-10-24T01:22:33.229385] [INFO ] [MAIN      ] GFL: Successfully saved derivative data.
[2025-10-24T01:22:33.291268] [DEBUG] [LOCAL     ] GFI: Derivative data saved (139 records).
[2025-10-24T01:22:33.299838] [INFO ] [MAIN      ] Derivative Progress: 836/2164 symbols completed. GFL took 1.6s. Estimated remaining: 9m 20s. Rate: 142.4 symbols/min
[2025-10-24T01:22:33.308754] [INFO ] [MAIN      ] GFI: Successfully saved derivative data.
[2025-10-24T01:22:33.311348] [INFO ] [MAIN      ] Derivative Progress: 837/2164 symbols completed. GFI took 1.6s. Estimated remaining: 9m 18s. Rate: 142.6 symbols/min
[2025-10-24T01:22:33.311633] [INFO ] [MAIN      ] GGG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:33.308867] [INFO ] [MAIN      ] GGB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:33.344405] [DEBUG] [MAIN      ] GFR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:33.411149] [DEBUG] [LOCAL     ] GGG: Loaded 40930 existing records from primary storage.
[2025-10-24T01:22:33.429425] [DEBUG] [LOCAL     ] GGB: Loaded 51938 existing records from primary storage.
[2025-10-24T01:22:33.428507] [INFO ] [MAIN      ] GGG: Loaded 40930 primary data records.
[2025-10-24T01:22:33.429717] [INFO ] [MAIN      ] GGB: Loaded 51938 primary data records.
[2025-10-24T01:22:33.823576] [INFO ] [MAIN      ] GFR: Generated 139 derivative records from 7396 primary records.
[2025-10-24T01:22:34.067366] [DEBUG] [LOCAL     ] GFR: Saving derivative data.
[2025-10-24T01:22:34.082438] [DEBUG] [LOCAL     ] GFR: Derivative data saved (139 records).
[2025-10-24T01:22:34.083876] [INFO ] [MAIN      ] GFR: Successfully saved derivative data.
[2025-10-24T01:22:34.087309] [INFO ] [MAIN      ] Derivative Progress: 838/2164 symbols completed. GFR took 1.2s. Estimated remaining: 9m 19s. Rate: 142.4 symbols/min
[2025-10-24T01:22:34.128841] [DEBUG] [MAIN      ] GGG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:34.129063] [DEBUG] [MAIN      ] GGB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:34.193963] [INFO ] [MAIN      ] GGG: Generated 139 derivative records from 40930 primary records.
[2025-10-24T01:22:34.196671] [DEBUG] [LOCAL     ] GGG: Saving derivative data.
[2025-10-24T01:22:34.208054] [INFO ] [MAIN      ] GGB: Generated 139 derivative records from 51938 primary records.
[2025-10-24T01:22:34.211221] [DEBUG] [LOCAL     ] GGB: Saving derivative data.
[2025-10-24T01:22:34.212961] [DEBUG] [LOCAL     ] GGG: Derivative data saved (139 records).
[2025-10-24T01:22:34.213344] [INFO ] [MAIN      ] GGG: Successfully saved derivative data.
[2025-10-24T01:22:34.216488] [INFO ] [MAIN      ] Derivative Progress: 839/2164 symbols completed. GGG took 0.9s. Estimated remaining: 9m 18s. Rate: 142.5 symbols/min
[2025-10-24T01:22:34.228170] [DEBUG] [LOCAL     ] GGB: Derivative data saved (139 records).
[2025-10-24T01:22:34.228292] [INFO ] [MAIN      ] GGB: Successfully saved derivative data.
[2025-10-24T01:22:34.230906] [INFO ] [MAIN      ] Derivative Progress: 840/2164 symbols completed. GGB took 0.9s. Estimated remaining: 9m 17s. Rate: 142.7 symbols/min
[2025-10-24T01:22:34.231439] [INFO ] [MAIN      ] GGT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:34.231600] [INFO ] [MAIN      ] GGZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:34.232133] [INFO ] [MAIN      ] GHC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:34.239153] [DEBUG] [LOCAL     ] GHC: Loaded 2978 existing records from primary storage.
[2025-10-24T01:22:34.242043] [INFO ] [MAIN      ] GHC: Loaded 2978 primary data records.
[2025-10-24T01:22:34.241808] [DEBUG] [LOCAL     ] GGZ: Loaded 2357 existing records from primary storage.
[2025-10-24T01:22:34.264736] [INFO ] [MAIN      ] GGZ: Loaded 2357 primary data records.
[2025-10-24T01:22:34.493584] [DEBUG] [LOCAL     ] GGT: Loaded 14575 existing records from primary storage.
[2025-10-24T01:22:34.530339] [INFO ] [MAIN      ] GGT: Loaded 14575 primary data records.
[2025-10-24T01:22:35.284538] [DEBUG] [MAIN      ] GGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:35.317321] [DEBUG] [MAIN      ] GHC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:35.358586] [DEBUG] [MAIN      ] GGT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:35.398121] [INFO ] [MAIN      ] GGZ: Generated 139 derivative records from 2357 primary records.
[2025-10-24T01:22:35.398960] [DEBUG] [LOCAL     ] GGZ: Saving derivative data.
[2025-10-24T01:22:35.416370] [DEBUG] [LOCAL     ] GGZ: Derivative data saved (139 records).
[2025-10-24T01:22:35.417088] [INFO ] [MAIN      ] GGZ: Successfully saved derivative data.
[2025-10-24T01:22:35.420182] [INFO ] [MAIN      ] Derivative Progress: 841/2164 symbols completed. GGZ took 1.2s. Estimated remaining: 9m 17s. Rate: 142.4 symbols/min
[2025-10-24T01:22:35.424393] [INFO ] [MAIN      ] GHG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:35.424286] [INFO ] [MAIN      ] GHC: Generated 139 derivative records from 2978 primary records.
[2025-10-24T01:22:35.427184] [DEBUG] [LOCAL     ] GHC: Saving derivative data.
[2025-10-24T01:22:35.440733] [DEBUG] [LOCAL     ] GHC: Derivative data saved (139 records).
[2025-10-24T01:22:35.443692] [DEBUG] [LOCAL     ] GHG: Loaded 3296 existing records from primary storage.
[2025-10-24T01:22:35.443877] [INFO ] [MAIN      ] GHC: Successfully saved derivative data.
[2025-10-24T01:22:35.444010] [INFO ] [MAIN      ] GHG: Loaded 3296 primary data records.
[2025-10-24T01:22:35.446547] [INFO ] [MAIN      ] Derivative Progress: 842/2164 symbols completed. GHC took 1.2s. Estimated remaining: 9m 16s. Rate: 142.6 symbols/min
[2025-10-24T01:22:35.485402] [INFO ] [MAIN      ] GHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:35.578282] [INFO ] [MAIN      ] GGT: Generated 139 derivative records from 14575 primary records.
[2025-10-24T01:22:35.599576] [DEBUG] [LOCAL     ] GGT: Saving derivative data.
[2025-10-24T01:22:35.643158] [DEBUG] [LOCAL     ] GHI: Loaded 7953 existing records from primary storage.
[2025-10-24T01:22:35.786672] [DEBUG] [LOCAL     ] GGT: Derivative data saved (139 records).
[2025-10-24T01:22:35.786827] [INFO ] [MAIN      ] GHI: Loaded 7953 primary data records.
[2025-10-24T01:22:35.786966] [INFO ] [MAIN      ] GGT: Successfully saved derivative data.
[2025-10-24T01:22:35.811699] [INFO ] [MAIN      ] Derivative Progress: 843/2164 symbols completed. GGT took 1.6s. Estimated remaining: 9m 16s. Rate: 142.6 symbols/min
[2025-10-24T01:22:35.824460] [INFO ] [MAIN      ] GHLD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:35.930387] [DEBUG] [LOCAL     ] GHLD: Loaded 4346 existing records from primary storage.
[2025-10-24T01:22:35.960704] [INFO ] [MAIN      ] GHLD: Loaded 4346 primary data records.
[2025-10-24T01:22:36.416883] [DEBUG] [MAIN      ] GHG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:36.458809] [DEBUG] [MAIN      ] GHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:36.501377] [INFO ] [MAIN      ] GHG: Generated 139 derivative records from 3296 primary records.
[2025-10-24T01:22:36.502148] [DEBUG] [LOCAL     ] GHG: Saving derivative data.
[2025-10-24T01:22:36.529606] [DEBUG] [MAIN      ] GHLD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:36.529130] [DEBUG] [LOCAL     ] GHG: Derivative data saved (139 records).
[2025-10-24T01:22:36.542587] [INFO ] [MAIN      ] GHG: Successfully saved derivative data.
[2025-10-24T01:22:36.548446] [INFO ] [MAIN      ] Derivative Progress: 844/2164 symbols completed. GHG took 1.1s. Estimated remaining: 9m 16s. Rate: 142.4 symbols/min
[2025-10-24T01:22:36.549271] [INFO ] [MAIN      ] GHM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:36.550601] [INFO ] [MAIN      ] GHI: Generated 139 derivative records from 7953 primary records.
[2025-10-24T01:22:36.551296] [DEBUG] [LOCAL     ] GHI: Saving derivative data.
[2025-10-24T01:22:36.568210] [DEBUG] [LOCAL     ] GHI: Derivative data saved (139 records).
[2025-10-24T01:22:36.573488] [INFO ] [MAIN      ] GHI: Successfully saved derivative data.
[2025-10-24T01:22:36.576621] [INFO ] [MAIN      ] Derivative Progress: 845/2164 symbols completed. GHI took 1.1s. Estimated remaining: 9m 15s. Rate: 142.6 symbols/min
[2025-10-24T01:22:36.577113] [INFO ] [MAIN      ] GHY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:36.586243] [DEBUG] [LOCAL     ] GHM: Loaded 14417 existing records from primary storage.
[2025-10-24T01:22:36.587747] [INFO ] [MAIN      ] GHM: Loaded 14417 primary data records.
[2025-10-24T01:22:36.753893] [DEBUG] [LOCAL     ] GHY: Loaded 21009 existing records from primary storage.
[2025-10-24T01:22:36.859722] [INFO ] [MAIN      ] GHY: Loaded 21009 primary data records.
[2025-10-24T01:22:36.973601] [INFO ] [MAIN      ] GHLD: Generated 139 derivative records from 4346 primary records.
[2025-10-24T01:22:37.002573] [DEBUG] [LOCAL     ] GHLD: Saving derivative data.
[2025-10-24T01:22:37.073513] [DEBUG] [LOCAL     ] GHLD: Derivative data saved (139 records).
[2025-10-24T01:22:37.081804] [INFO ] [MAIN      ] GHLD: Successfully saved derivative data.
[2025-10-24T01:22:37.084792] [INFO ] [MAIN      ] Derivative Progress: 846/2164 symbols completed. GHLD took 1.3s. Estimated remaining: 9m 15s. Rate: 142.6 symbols/min
[2025-10-24T01:22:37.215263] [INFO ] [MAIN      ] GIB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:37.279850] [DEBUG] [MAIN      ] GHM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:37.331718] [DEBUG] [LOCAL     ] GIB: Loaded 31579 existing records from primary storage.
[2025-10-24T01:22:37.345605] [INFO ] [MAIN      ] GIB: Loaded 31579 primary data records.
[2025-10-24T01:22:37.346044] [DEBUG] [MAIN      ] GHY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:37.480522] [INFO ] [MAIN      ] GHM: Generated 139 derivative records from 14417 primary records.
[2025-10-24T01:22:37.540821] [DEBUG] [LOCAL     ] GHM: Saving derivative data.
[2025-10-24T01:22:37.681783] [DEBUG] [LOCAL     ] GHM: Derivative data saved (139 records).
[2025-10-24T01:22:37.682532] [INFO ] [MAIN      ] GHM: Successfully saved derivative data.
[2025-10-24T01:22:37.685500] [INFO ] [MAIN      ] Derivative Progress: 847/2164 symbols completed. GHM took 1.1s. Estimated remaining: 9m 15s. Rate: 142.5 symbols/min
[2025-10-24T01:22:37.685996] [INFO ] [MAIN      ] GIC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:37.700449] [INFO ] [MAIN      ] GHY: Generated 139 derivative records from 21009 primary records.
[2025-10-24T01:22:37.700914] [DEBUG] [LOCAL     ] GHY: Saving derivative data.
[2025-10-24T01:22:37.718455] [DEBUG] [LOCAL     ] GHY: Derivative data saved (139 records).
[2025-10-24T01:22:37.718806] [INFO ] [MAIN      ] GHY: Successfully saved derivative data.
[2025-10-24T01:22:37.721757] [INFO ] [MAIN      ] Derivative Progress: 848/2164 symbols completed. GHY took 1.1s. Estimated remaining: 9m 14s. Rate: 142.7 symbols/min
[2025-10-24T01:22:37.722052] [INFO ] [MAIN      ] GIL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:37.729719] [DEBUG] [LOCAL     ] GIC: Loaded 13240 existing records from primary storage.
[2025-10-24T01:22:37.731217] [INFO ] [MAIN      ] GIC: Loaded 13240 primary data records.
[2025-10-24T01:22:37.743943] [DEBUG] [MAIN      ] GIB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:38.093513] [DEBUG] [LOCAL     ] GIL: Loaded 44321 existing records from primary storage.
[2025-10-24T01:22:38.094479] [INFO ] [MAIN      ] GIL: Loaded 44321 primary data records.
[2025-10-24T01:22:38.127859] [INFO ] [MAIN      ] GIB: Generated 139 derivative records from 31579 primary records.
[2025-10-24T01:22:38.139996] [DEBUG] [LOCAL     ] GIB: Saving derivative data.
[2025-10-24T01:22:38.221250] [DEBUG] [LOCAL     ] GIB: Derivative data saved (139 records).
[2025-10-24T01:22:38.231818] [INFO ] [MAIN      ] GIB: Successfully saved derivative data.
[2025-10-24T01:22:38.240535] [INFO ] [MAIN      ] Derivative Progress: 849/2164 symbols completed. GIB took 1.0s. Estimated remaining: 9m 13s. Rate: 142.6 symbols/min
[2025-10-24T01:22:38.240987] [INFO ] [MAIN      ] GIS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:38.441909] [DEBUG] [MAIN      ] GIC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:38.495791] [INFO ] [MAIN      ] GIC: Generated 139 derivative records from 13240 primary records.
[2025-10-24T01:22:38.496271] [DEBUG] [LOCAL     ] GIC: Saving derivative data.
[2025-10-24T01:22:38.508336] [DEBUG] [LOCAL     ] GIC: Derivative data saved (139 records).
[2025-10-24T01:22:38.511839] [INFO ] [MAIN      ] GIC: Successfully saved derivative data.
[2025-10-24T01:22:38.529301] [INFO ] [MAIN      ] Derivative Progress: 850/2164 symbols completed. GIC took 0.8s. Estimated remaining: 9m 13s. Rate: 142.7 symbols/min
[2025-10-24T01:22:38.531090] [INFO ] [MAIN      ] GKOS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:38.540469] [DEBUG] [LOCAL     ] GIS: Loaded 54065 existing records from primary storage.
[2025-10-24T01:22:38.547130] [DEBUG] [MAIN      ] GIL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:38.546855] [INFO ] [MAIN      ] GIS: Loaded 54065 primary data records.
[2025-10-24T01:22:38.897898] [DEBUG] [LOCAL     ] GKOS: Loaded 42738 existing records from primary storage.
[2025-10-24T01:22:38.901889] [INFO ] [MAIN      ] GKOS: Loaded 42738 primary data records.
[2025-10-24T01:22:39.105273] [INFO ] [MAIN      ] GIL: Generated 139 derivative records from 44321 primary records.
[2025-10-24T01:22:39.263882] [DEBUG] [LOCAL     ] GIL: Saving derivative data.
[2025-10-24T01:22:39.278474] [DEBUG] [LOCAL     ] GIL: Derivative data saved (139 records).
[2025-10-24T01:22:39.279514] [INFO ] [MAIN      ] GIL: Successfully saved derivative data.
[2025-10-24T01:22:39.282400] [INFO ] [MAIN      ] Derivative Progress: 851/2164 symbols completed. GIL took 1.6s. Estimated remaining: 9m 13s. Rate: 142.5 symbols/min
[2025-10-24T01:22:39.283351] [INFO ] [MAIN      ] GL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:39.297152] [DEBUG] [MAIN      ] GIS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:39.358443] [DEBUG] [MAIN      ] GKOS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:39.358695] [INFO ] [MAIN      ] GIS: Generated 139 derivative records from 54065 primary records.
[2025-10-24T01:22:39.382270] [DEBUG] [LOCAL     ] GL: Loaded 37689 existing records from primary storage.
[2025-10-24T01:22:39.369046] [DEBUG] [LOCAL     ] GIS: Saving derivative data.
[2025-10-24T01:22:39.382414] [INFO ] [MAIN      ] GL: Loaded 37689 primary data records.
[2025-10-24T01:22:39.419772] [DEBUG] [LOCAL     ] GIS: Derivative data saved (139 records).
[2025-10-24T01:22:39.507249] [INFO ] [MAIN      ] GIS: Successfully saved derivative data.
[2025-10-24T01:22:39.530424] [INFO ] [MAIN      ] Derivative Progress: 852/2164 symbols completed. GIS took 1.3s. Estimated remaining: 9m 12s. Rate: 142.6 symbols/min
[2025-10-24T01:22:39.536127] [INFO ] [MAIN      ] GLOB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:39.749457] [INFO ] [MAIN      ] GKOS: Generated 139 derivative records from 42738 primary records.
[2025-10-24T01:22:39.749801] [DEBUG] [LOCAL     ] GKOS: Saving derivative data.
[2025-10-24T01:22:39.773921] [DEBUG] [LOCAL     ] GKOS: Derivative data saved (139 records).
[2025-10-24T01:22:39.774589] [INFO ] [MAIN      ] GKOS: Successfully saved derivative data.
[2025-10-24T01:22:39.777380] [INFO ] [MAIN      ] Derivative Progress: 853/2164 symbols completed. GKOS took 1.2s. Estimated remaining: 9m 11s. Rate: 142.7 symbols/min
[2025-10-24T01:22:39.799576] [DEBUG] [LOCAL     ] GLOB: Loaded 48426 existing records from primary storage.
[2025-10-24T01:22:39.812313] [DEBUG] [MAIN      ] GL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:39.799927] [INFO ] [MAIN      ] GLOB: Loaded 48426 primary data records.
[2025-10-24T01:22:40.135442] [INFO ] [MAIN      ] GL: Generated 139 derivative records from 37689 primary records.
[2025-10-24T01:22:40.136371] [DEBUG] [LOCAL     ] GL: Saving derivative data.
[2025-10-24T01:22:40.149537] [DEBUG] [LOCAL     ] GL: Derivative data saved (139 records).
[2025-10-24T01:22:40.149712] [INFO ] [MAIN      ] GL: Successfully saved derivative data.
[2025-10-24T01:22:40.152517] [INFO ] [MAIN      ] Derivative Progress: 854/2164 symbols completed. GL took 0.9s. Estimated remaining: 9m 11s. Rate: 142.7 symbols/min
[2025-10-24T01:22:40.171070] [DEBUG] [MAIN      ] GLOB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:40.195957] [INFO ] [MAIN      ] GLOB: Generated 139 derivative records from 48426 primary records.
[2025-10-24T01:22:40.196052] [DEBUG] [LOCAL     ] GLOB: Saving derivative data.
[2025-10-24T01:22:40.207658] [DEBUG] [LOCAL     ] GLOB: Derivative data saved (139 records).
[2025-10-24T01:22:40.207739] [INFO ] [MAIN      ] GLOB: Successfully saved derivative data.
[2025-10-24T01:22:40.210233] [INFO ] [MAIN      ] Derivative Progress: 855/2164 symbols completed. GLOB took 0.7s. Estimated remaining: 9m 10s. Rate: 142.8 symbols/min
[2025-10-24T01:22:40.210671] [INFO ] [MAIN      ] GLP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:40.210754] [INFO ] [MAIN      ] GM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:40.210916] [INFO ] [MAIN      ] GLW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:40.228012] [DEBUG] [LOCAL     ] GLP: Loaded 9259 existing records from primary storage.
[2025-10-24T01:22:40.228287] [INFO ] [MAIN      ] GLP: Loaded 9259 primary data records.
[2025-10-24T01:22:40.565962] [DEBUG] [LOCAL     ] GM: Loaded 54119 existing records from primary storage.
[2025-10-24T01:22:40.566461] [INFO ] [MAIN      ] GM: Loaded 54119 primary data records.
[2025-10-24T01:22:40.706593] [DEBUG] [LOCAL     ] GLW: Loaded 54025 existing records from primary storage.
[2025-10-24T01:22:40.729677] [INFO ] [MAIN      ] GLW: Loaded 54025 primary data records.
[2025-10-24T01:22:41.208275] [DEBUG] [MAIN      ] GLP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:41.240677] [DEBUG] [MAIN      ] GM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:41.296334] [DEBUG] [MAIN      ] GLW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:41.324973] [INFO ] [MAIN      ] GLP: Generated 139 derivative records from 9259 primary records.
[2025-10-24T01:22:41.331007] [DEBUG] [LOCAL     ] GLP: Saving derivative data.
[2025-10-24T01:22:41.333738] [INFO ] [MAIN      ] GM: Generated 139 derivative records from 54119 primary records.
[2025-10-24T01:22:41.346747] [DEBUG] [LOCAL     ] GLP: Derivative data saved (139 records).
[2025-10-24T01:22:41.347004] [DEBUG] [LOCAL     ] GM: Saving derivative data.
[2025-10-24T01:22:41.349231] [INFO ] [MAIN      ] GLP: Successfully saved derivative data.
[2025-10-24T01:22:41.352158] [INFO ] [MAIN      ] Derivative Progress: 856/2164 symbols completed. GLP took 1.1s. Estimated remaining: 9m 11s. Rate: 142.5 symbols/min
[2025-10-24T01:22:41.360541] [INFO ] [MAIN      ] GME: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:41.366890] [DEBUG] [LOCAL     ] GM: Derivative data saved (139 records).
[2025-10-24T01:22:41.367078] [INFO ] [MAIN      ] GM: Successfully saved derivative data.
[2025-10-24T01:22:41.369470] [INFO ] [MAIN      ] Derivative Progress: 857/2164 symbols completed. GM took 1.2s. Estimated remaining: 9m 10s. Rate: 142.7 symbols/min
[2025-10-24T01:22:41.369788] [INFO ] [MAIN      ] GMED: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:41.385130] [INFO ] [MAIN      ] GLW: Generated 139 derivative records from 54025 primary records.
[2025-10-24T01:22:41.385369] [DEBUG] [LOCAL     ] GLW: Saving derivative data.
[2025-10-24T01:22:41.398303] [DEBUG] [LOCAL     ] GLW: Derivative data saved (139 records).
[2025-10-24T01:22:41.398479] [INFO ] [MAIN      ] GLW: Successfully saved derivative data.
[2025-10-24T01:22:41.401476] [INFO ] [MAIN      ] Derivative Progress: 858/2164 symbols completed. GLW took 1.2s. Estimated remaining: 9m 9s. Rate: 142.9 symbols/min
[2025-10-24T01:22:41.402000] [INFO ] [MAIN      ] GMRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:41.451202] [DEBUG] [LOCAL     ] GMED: Loaded 48462 existing records from primary storage.
[2025-10-24T01:22:41.453361] [INFO ] [MAIN      ] GMED: Loaded 48462 primary data records.
[2025-10-24T01:22:41.554274] [DEBUG] [LOCAL     ] GME: Loaded 54171 existing records from primary storage.
[2025-10-24T01:22:41.580145] [INFO ] [MAIN      ] GME: Loaded 54171 primary data records.
[2025-10-24T01:22:41.592482] [DEBUG] [LOCAL     ] GMRE: Loaded 36569 existing records from primary storage.
[2025-10-24T01:22:41.677484] [INFO ] [MAIN      ] GMRE: Loaded 36569 primary data records.
[2025-10-24T01:22:42.437308] [DEBUG] [MAIN      ] GMED: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:42.479507] [DEBUG] [MAIN      ] GMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:42.516197] [DEBUG] [MAIN      ] GME: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:42.550754] [INFO ] [MAIN      ] GMED: Generated 139 derivative records from 48462 primary records.
[2025-10-24T01:22:42.553569] [DEBUG] [LOCAL     ] GMED: Saving derivative data.
[2025-10-24T01:22:42.576576] [DEBUG] [LOCAL     ] GMED: Derivative data saved (139 records).
[2025-10-24T01:22:42.578388] [INFO ] [MAIN      ] GMED: Successfully saved derivative data.
[2025-10-24T01:22:42.580608] [INFO ] [MAIN      ] Derivative Progress: 859/2164 symbols completed. GMED took 1.2s. Estimated remaining: 9m 9s. Rate: 142.6 symbols/min
[2025-10-24T01:22:42.582523] [INFO ] [MAIN      ] GNE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:42.588122] [INFO ] [MAIN      ] GMRE: Generated 139 derivative records from 36569 primary records.
[2025-10-24T01:22:42.588704] [DEBUG] [LOCAL     ] GMRE: Saving derivative data.
[2025-10-24T01:22:42.602887] [DEBUG] [LOCAL     ] GMRE: Derivative data saved (139 records).
[2025-10-24T01:22:42.603129] [INFO ] [MAIN      ] GMRE: Successfully saved derivative data.
[2025-10-24T01:22:42.608254] [INFO ] [MAIN      ] Derivative Progress: 860/2164 symbols completed. GMRE took 1.2s. Estimated remaining: 9m 8s. Rate: 142.7 symbols/min
[2025-10-24T01:22:42.609338] [INFO ] [MAIN      ] GNK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:42.617915] [INFO ] [MAIN      ] GME: Generated 139 derivative records from 54171 primary records.
[2025-10-24T01:22:42.618035] [DEBUG] [LOCAL     ] GME: Saving derivative data.
[2025-10-24T01:22:42.635440] [DEBUG] [LOCAL     ] GNE: Loaded 18205 existing records from primary storage.
[2025-10-24T01:22:42.635923] [INFO ] [MAIN      ] GNE: Loaded 18205 primary data records.
[2025-10-24T01:22:42.667894] [DEBUG] [LOCAL     ] GME: Derivative data saved (139 records).
[2025-10-24T01:22:42.691756] [INFO ] [MAIN      ] GME: Successfully saved derivative data.
[2025-10-24T01:22:42.716774] [INFO ] [MAIN      ] Derivative Progress: 861/2164 symbols completed. GME took 1.4s. Estimated remaining: 9m 7s. Rate: 142.8 symbols/min
[2025-10-24T01:22:42.743671] [INFO ] [MAIN      ] GNL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:42.965001] [DEBUG] [LOCAL     ] GNK: Loaded 39706 existing records from primary storage.
[2025-10-24T01:22:42.965624] [INFO ] [MAIN      ] GNK: Loaded 39706 primary data records.
[2025-10-24T01:22:43.291787] [DEBUG] [LOCAL     ] GNL: Loaded 46808 existing records from primary storage.
[2025-10-24T01:22:43.292265] [INFO ] [MAIN      ] GNL: Loaded 46808 primary data records.
[2025-10-24T01:22:43.461825] [DEBUG] [MAIN      ] GNE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:43.691445] [DEBUG] [MAIN      ] GNK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:43.742139] [DEBUG] [MAIN      ] GNL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:43.744588] [INFO ] [MAIN      ] GNE: Generated 139 derivative records from 18205 primary records.
[2025-10-24T01:22:43.758771] [DEBUG] [LOCAL     ] GNE: Saving derivative data.
[2025-10-24T01:22:43.780395] [DEBUG] [LOCAL     ] GNE: Derivative data saved (139 records).
[2025-10-24T01:22:43.784035] [INFO ] [MAIN      ] GNE: Successfully saved derivative data.
[2025-10-24T01:22:43.789032] [INFO ] [MAIN      ] Derivative Progress: 862/2164 symbols completed. GNE took 1.2s. Estimated remaining: 9m 8s. Rate: 142.6 symbols/min
[2025-10-24T01:22:43.792676] [INFO ] [MAIN      ] GNRC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:43.798603] [INFO ] [MAIN      ] GNK: Generated 139 derivative records from 39706 primary records.
[2025-10-24T01:22:43.798973] [DEBUG] [LOCAL     ] GNK: Saving derivative data.
[2025-10-24T01:22:43.815105] [DEBUG] [LOCAL     ] GNK: Derivative data saved (139 records).
[2025-10-24T01:22:43.819453] [INFO ] [MAIN      ] GNK: Successfully saved derivative data.
[2025-10-24T01:22:43.823770] [INFO ] [MAIN      ] Derivative Progress: 863/2164 symbols completed. GNK took 1.2s. Estimated remaining: 9m 7s. Rate: 142.7 symbols/min
[2025-10-24T01:22:43.823981] [INFO ] [MAIN      ] GNT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:43.826859] [INFO ] [MAIN      ] GNL: Generated 139 derivative records from 46808 primary records.
[2025-10-24T01:22:43.826968] [DEBUG] [LOCAL     ] GNL: Saving derivative data.
[2025-10-24T01:22:43.846352] [DEBUG] [LOCAL     ] GNT: Loaded 8683 existing records from primary storage.
[2025-10-24T01:22:43.842130] [DEBUG] [LOCAL     ] GNL: Derivative data saved (139 records).
[2025-10-24T01:22:43.846689] [INFO ] [MAIN      ] GNT: Loaded 8683 primary data records.
[2025-10-24T01:22:43.846811] [INFO ] [MAIN      ] GNL: Successfully saved derivative data.
[2025-10-24T01:22:43.849946] [INFO ] [MAIN      ] Derivative Progress: 864/2164 symbols completed. GNL took 1.1s. Estimated remaining: 9m 6s. Rate: 142.9 symbols/min
[2025-10-24T01:22:43.892593] [INFO ] [MAIN      ] GNW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:44.022459] [DEBUG] [LOCAL     ] GNRC: Loaded 45673 existing records from primary storage.
[2025-10-24T01:22:44.060227] [INFO ] [MAIN      ] GNRC: Loaded 45673 primary data records.
[2025-10-24T01:22:44.363608] [DEBUG] [LOCAL     ] GNW: Loaded 51738 existing records from primary storage.
[2025-10-24T01:22:44.493875] [INFO ] [MAIN      ] GNW: Loaded 51738 primary data records.
[2025-10-24T01:22:44.829273] [DEBUG] [MAIN      ] GNT: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:44.870357] [DEBUG] [MAIN      ] GNRC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:44.911288] [INFO ] [MAIN      ] GNT: Generated 139 derivative records from 8683 primary records.
[2025-10-24T01:22:44.921507] [DEBUG] [LOCAL     ] GNT: Saving derivative data.
[2025-10-24T01:22:44.927375] [DEBUG] [MAIN      ] GNW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:44.958569] [DEBUG] [LOCAL     ] GNT: Derivative data saved (139 records).
[2025-10-24T01:22:44.962354] [INFO ] [MAIN      ] GNT: Successfully saved derivative data.
[2025-10-24T01:22:44.965878] [INFO ] [MAIN      ] Derivative Progress: 865/2164 symbols completed. GNT took 1.1s. Estimated remaining: 9m 7s. Rate: 142.6 symbols/min
[2025-10-24T01:22:44.966168] [INFO ] [MAIN      ] GOF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:44.971574] [INFO ] [MAIN      ] GNRC: Generated 139 derivative records from 45673 primary records.
[2025-10-24T01:22:44.972318] [DEBUG] [LOCAL     ] GNRC: Saving derivative data.
[2025-10-24T01:22:44.986539] [DEBUG] [LOCAL     ] GNRC: Derivative data saved (139 records).
[2025-10-24T01:22:44.989694] [INFO ] [MAIN      ] GNRC: Successfully saved derivative data.
[2025-10-24T01:22:44.994760] [INFO ] [MAIN      ] Derivative Progress: 866/2164 symbols completed. GNRC took 1.2s. Estimated remaining: 9m 5s. Rate: 142.8 symbols/min
[2025-10-24T01:22:44.998000] [INFO ] [MAIN      ] GOLF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:45.006797] [INFO ] [MAIN      ] GNW: Generated 139 derivative records from 51738 primary records.
[2025-10-24T01:22:45.007113] [DEBUG] [LOCAL     ] GNW: Saving derivative data.
[2025-10-24T01:22:45.021243] [DEBUG] [LOCAL     ] GNW: Derivative data saved (139 records).
[2025-10-24T01:22:45.021511] [INFO ] [MAIN      ] GNW: Successfully saved derivative data.
[2025-10-24T01:22:45.025287] [INFO ] [MAIN      ] Derivative Progress: 867/2164 symbols completed. GNW took 1.1s. Estimated remaining: 9m 4s. Rate: 142.9 symbols/min
[2025-10-24T01:22:45.025575] [INFO ] [MAIN      ] GOOS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:45.064447] [DEBUG] [LOCAL     ] GOF: Loaded 43072 existing records from primary storage.
[2025-10-24T01:22:45.072975] [INFO ] [MAIN      ] GOF: Loaded 43072 primary data records.
[2025-10-24T01:22:45.119710] [DEBUG] [LOCAL     ] GOLF: Loaded 30411 existing records from primary storage.
[2025-10-24T01:22:45.151022] [INFO ] [MAIN      ] GOLF: Loaded 30411 primary data records.
[2025-10-24T01:22:45.383241] [DEBUG] [LOCAL     ] GOOS: Loaded 44323 existing records from primary storage.
[2025-10-24T01:22:45.499881] [INFO ] [MAIN      ] GOOS: Loaded 44323 primary data records.
[2025-10-24T01:22:46.068617] [DEBUG] [MAIN      ] GOF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:46.101798] [DEBUG] [MAIN      ] GOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:46.142287] [DEBUG] [MAIN      ] GOOS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:46.192416] [INFO ] [MAIN      ] GOF: Generated 139 derivative records from 43072 primary records.
[2025-10-24T01:22:46.192926] [DEBUG] [LOCAL     ] GOF: Saving derivative data.
[2025-10-24T01:22:46.213904] [DEBUG] [LOCAL     ] GOF: Derivative data saved (139 records).
[2025-10-24T01:22:46.207950] [INFO ] [MAIN      ] GOLF: Generated 139 derivative records from 30411 primary records.
[2025-10-24T01:22:46.214101] [INFO ] [MAIN      ] GOF: Successfully saved derivative data.
[2025-10-24T01:22:46.215614] [DEBUG] [LOCAL     ] GOLF: Saving derivative data.
[2025-10-24T01:22:46.218147] [INFO ] [MAIN      ] Derivative Progress: 868/2164 symbols completed. GOF took 1.3s. Estimated remaining: 9m 5s. Rate: 142.6 symbols/min
[2025-10-24T01:22:46.233667] [DEBUG] [LOCAL     ] GOLF: Derivative data saved (139 records).
[2025-10-24T01:22:46.235364] [INFO ] [MAIN      ] GOLF: Successfully saved derivative data.
[2025-10-24T01:22:46.238143] [INFO ] [MAIN      ] Derivative Progress: 869/2164 symbols completed. GOLF took 1.2s. Estimated remaining: 9m 4s. Rate: 142.8 symbols/min
[2025-10-24T01:22:46.240477] [INFO ] [MAIN      ] GOOS: Generated 139 derivative records from 44323 primary records.
[2025-10-24T01:22:46.240701] [DEBUG] [LOCAL     ] GOOS: Saving derivative data.
[2025-10-24T01:22:46.252997] [DEBUG] [LOCAL     ] GOOS: Derivative data saved (139 records).
[2025-10-24T01:22:46.253155] [INFO ] [MAIN      ] GOOS: Successfully saved derivative data.
[2025-10-24T01:22:46.256484] [INFO ] [MAIN      ] Derivative Progress: 870/2164 symbols completed. GOOS took 1.2s. Estimated remaining: 9m 3s. Rate: 142.9 symbols/min
[2025-10-24T01:22:46.257113] [INFO ] [MAIN      ] GPI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:46.257021] [INFO ] [MAIN      ] GOTU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:46.257282] [INFO ] [MAIN      ] GPC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:46.276978] [DEBUG] [LOCAL     ] GPI: Loaded 14863 existing records from primary storage.
[2025-10-24T01:22:46.277137] [INFO ] [MAIN      ] GPI: Loaded 14863 primary data records.
[2025-10-24T01:22:46.434000] [DEBUG] [LOCAL     ] GOTU: Loaded 37025 existing records from primary storage.
[2025-10-24T01:22:46.460775] [INFO ] [MAIN      ] GOTU: Loaded 37025 primary data records.
[2025-10-24T01:22:46.692248] [DEBUG] [LOCAL     ] GPC: Loaded 46263 existing records from primary storage.
[2025-10-24T01:22:46.710675] [INFO ] [MAIN      ] GPC: Loaded 46263 primary data records.
[2025-10-24T01:22:47.250104] [DEBUG] [MAIN      ] GPI: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:47.293978] [DEBUG] [MAIN      ] GOTU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:47.337511] [DEBUG] [MAIN      ] GPC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:47.351759] [INFO ] [MAIN      ] GPI: Generated 139 derivative records from 14863 primary records.
[2025-10-24T01:22:47.351877] [DEBUG] [LOCAL     ] GPI: Saving derivative data.
[2025-10-24T01:22:47.367982] [DEBUG] [LOCAL     ] GPI: Derivative data saved (139 records).
[2025-10-24T01:22:47.368216] [INFO ] [MAIN      ] GPI: Successfully saved derivative data.
[2025-10-24T01:22:47.378043] [INFO ] [MAIN      ] Derivative Progress: 871/2164 symbols completed. GPI took 1.1s. Estimated remaining: 9m 4s. Rate: 142.7 symbols/min
[2025-10-24T01:22:47.378668] [INFO ] [MAIN      ] GPJA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:47.395464] [DEBUG] [LOCAL     ] GPJA: Loaded 4128 existing records from primary storage.
[2025-10-24T01:22:47.399485] [INFO ] [MAIN      ] GPJA: Loaded 4128 primary data records.
[2025-10-24T01:22:47.512325] [INFO ] [MAIN      ] GOTU: Generated 139 derivative records from 37025 primary records.
[2025-10-24T01:22:47.516356] [DEBUG] [LOCAL     ] GOTU: Saving derivative data.
[2025-10-24T01:22:47.565946] [DEBUG] [LOCAL     ] GOTU: Derivative data saved (139 records).
[2025-10-24T01:22:47.613414] [INFO ] [MAIN      ] GOTU: Successfully saved derivative data.
[2025-10-24T01:22:47.620494] [INFO ] [MAIN      ] Derivative Progress: 872/2164 symbols completed. GOTU took 1.4s. Estimated remaining: 9m 3s. Rate: 142.7 symbols/min
[2025-10-24T01:22:47.692079] [INFO ] [MAIN      ] GPK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:47.771003] [INFO ] [MAIN      ] GPC: Generated 139 derivative records from 46263 primary records.
[2025-10-24T01:22:47.780004] [DEBUG] [LOCAL     ] GPC: Saving derivative data.
[2025-10-24T01:22:47.795344] [DEBUG] [LOCAL     ] GPC: Derivative data saved (139 records).
[2025-10-24T01:22:47.796071] [INFO ] [MAIN      ] GPC: Successfully saved derivative data.
[2025-10-24T01:22:47.799569] [INFO ] [MAIN      ] Derivative Progress: 873/2164 symbols completed. GPC took 1.5s. Estimated remaining: 9m 2s. Rate: 142.8 symbols/min
[2025-10-24T01:22:47.800147] [INFO ] [MAIN      ] GPMT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:47.830816] [DEBUG] [MAIN      ] GPJA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:47.867632] [DEBUG] [LOCAL     ] GPMT: Loaded 26058 existing records from primary storage.
[2025-10-24T01:22:47.870902] [INFO ] [MAIN      ] GPMT: Loaded 26058 primary data records.
[2025-10-24T01:22:48.011443] [DEBUG] [LOCAL     ] GPK: Loaded 53166 existing records from primary storage.
[2025-10-24T01:22:48.075882] [INFO ] [MAIN      ] GPK: Loaded 53166 primary data records.
[2025-10-24T01:22:48.327338] [INFO ] [MAIN      ] GPJA: Generated 139 derivative records from 4128 primary records.
[2025-10-24T01:22:48.362682] [DEBUG] [LOCAL     ] GPJA: Saving derivative data.
[2025-10-24T01:22:48.510310] [DEBUG] [LOCAL     ] GPJA: Derivative data saved (139 records).
[2025-10-24T01:22:48.510927] [INFO ] [MAIN      ] GPJA: Successfully saved derivative data.
[2025-10-24T01:22:48.513630] [INFO ] [MAIN      ] Derivative Progress: 874/2164 symbols completed. GPJA took 1.1s. Estimated remaining: 9m 2s. Rate: 142.7 symbols/min
[2025-10-24T01:22:48.514294] [INFO ] [MAIN      ] GPN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:48.536862] [DEBUG] [MAIN      ] GPMT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:48.594943] [DEBUG] [MAIN      ] GPK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:48.639113] [INFO ] [MAIN      ] GPMT: Generated 139 derivative records from 26058 primary records.
[2025-10-24T01:22:48.640866] [DEBUG] [LOCAL     ] GPMT: Saving derivative data.
[2025-10-24T01:22:48.640504] [DEBUG] [LOCAL     ] GPN: Loaded 52198 existing records from primary storage.
[2025-10-24T01:22:48.641141] [INFO ] [MAIN      ] GPN: Loaded 52198 primary data records.
[2025-10-24T01:22:48.733770] [DEBUG] [LOCAL     ] GPMT: Derivative data saved (139 records).
[2025-10-24T01:22:48.766554] [INFO ] [MAIN      ] GPMT: Successfully saved derivative data.
[2025-10-24T01:22:48.769605] [INFO ] [MAIN      ] Derivative Progress: 875/2164 symbols completed. GPMT took 1.0s. Estimated remaining: 9m 2s. Rate: 142.8 symbols/min
[2025-10-24T01:22:48.795858] [INFO ] [MAIN      ] GPOR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:48.979773] [INFO ] [MAIN      ] GPK: Generated 139 derivative records from 53166 primary records.
[2025-10-24T01:22:48.980137] [DEBUG] [LOCAL     ] GPK: Saving derivative data.
[2025-10-24T01:22:49.001335] [DEBUG] [LOCAL     ] GPK: Derivative data saved (139 records).
[2025-10-24T01:22:49.002006] [INFO ] [MAIN      ] GPK: Successfully saved derivative data.
[2025-10-24T01:22:49.002553] [DEBUG] [LOCAL     ] GPOR: Loaded 23577 existing records from primary storage.
[2025-10-24T01:22:49.006156] [INFO ] [MAIN      ] Derivative Progress: 876/2164 symbols completed. GPK took 1.3s. Estimated remaining: 9m 1s. Rate: 142.8 symbols/min
[2025-10-24T01:22:49.006578] [INFO ] [MAIN      ] GPOR: Loaded 23577 primary data records.
[2025-10-24T01:22:49.006691] [INFO ] [MAIN      ] GPRK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:49.338252] [DEBUG] [LOCAL     ] GPRK: Loaded 40214 existing records from primary storage.
[2025-10-24T01:22:49.338762] [INFO ] [MAIN      ] GPRK: Loaded 40214 primary data records.
[2025-10-24T01:22:49.389558] [DEBUG] [MAIN      ] GPN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:49.752859] [DEBUG] [MAIN      ] GPOR: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:49.781490] [INFO ] [MAIN      ] GPN: Generated 139 derivative records from 52198 primary records.
[2025-10-24T01:22:49.784607] [DEBUG] [LOCAL     ] GPN: Saving derivative data.
[2025-10-24T01:22:49.800277] [DEBUG] [LOCAL     ] GPN: Derivative data saved (139 records).
[2025-10-24T01:22:49.801072] [INFO ] [MAIN      ] GPN: Successfully saved derivative data.
[2025-10-24T01:22:49.806918] [INFO ] [MAIN      ] Derivative Progress: 877/2164 symbols completed. GPN took 1.3s. Estimated remaining: 9m 1s. Rate: 142.7 symbols/min
[2025-10-24T01:22:49.808265] [INFO ] [MAIN      ] GRBK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:49.829669] [DEBUG] [MAIN      ] GPRK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:49.862075] [INFO ] [MAIN      ] GPOR: Generated 139 derivative records from 23577 primary records.
[2025-10-24T01:22:49.862447] [DEBUG] [LOCAL     ] GPOR: Saving derivative data.
[2025-10-24T01:22:49.888517] [DEBUG] [LOCAL     ] GPOR: Derivative data saved (139 records).
[2025-10-24T01:22:49.889006] [DEBUG] [LOCAL     ] GRBK: Loaded 26788 existing records from primary storage.
[2025-10-24T01:22:49.892306] [INFO ] [MAIN      ] GPOR: Successfully saved derivative data.
[2025-10-24T01:22:49.895100] [INFO ] [MAIN      ] Derivative Progress: 878/2164 symbols completed. GPOR took 1.1s. Estimated remaining: 9m 0s. Rate: 142.8 symbols/min
[2025-10-24T01:22:49.897075] [INFO ] [MAIN      ] GRC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:49.895374] [INFO ] [MAIN      ] GRBK: Loaded 26788 primary data records.
[2025-10-24T01:22:49.986223] [DEBUG] [LOCAL     ] GRC: Loaded 9356 existing records from primary storage.
[2025-10-24T01:22:50.016891] [INFO ] [MAIN      ] GPRK: Generated 139 derivative records from 40214 primary records.
[2025-10-24T01:22:50.014415] [INFO ] [MAIN      ] GRC: Loaded 9356 primary data records.
[2025-10-24T01:22:50.017039] [DEBUG] [LOCAL     ] GPRK: Saving derivative data.
[2025-10-24T01:22:50.199951] [DEBUG] [LOCAL     ] GPRK: Derivative data saved (139 records).
[2025-10-24T01:22:50.336397] [INFO ] [MAIN      ] GPRK: Successfully saved derivative data.
[2025-10-24T01:22:50.403196] [INFO ] [MAIN      ] Derivative Progress: 879/2164 symbols completed. GPRK took 1.4s. Estimated remaining: 8m 60s. Rate: 142.8 symbols/min
[2025-10-24T01:22:50.408578] [INFO ] [MAIN      ] GRMN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:50.569815] [DEBUG] [MAIN      ] GRBK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:50.620375] [DEBUG] [LOCAL     ] GRMN: Loaded 40017 existing records from primary storage.
[2025-10-24T01:22:50.621713] [DEBUG] [MAIN      ] GRC: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:50.622292] [INFO ] [MAIN      ] GRMN: Loaded 40017 primary data records.
[2025-10-24T01:22:50.982856] [INFO ] [MAIN      ] GRBK: Generated 139 derivative records from 26788 primary records.
[2025-10-24T01:22:50.983185] [DEBUG] [LOCAL     ] GRBK: Saving derivative data.
[2025-10-24T01:22:50.998343] [DEBUG] [LOCAL     ] GRBK: Derivative data saved (139 records).
[2025-10-24T01:22:51.000922] [INFO ] [MAIN      ] GRBK: Successfully saved derivative data.
[2025-10-24T01:22:51.005982] [INFO ] [MAIN      ] GRC: Generated 139 derivative records from 9356 primary records.
[2025-10-24T01:22:51.005417] [INFO ] [MAIN      ] Derivative Progress: 880/2164 symbols completed. GRBK took 1.2s. Estimated remaining: 8m 60s. Rate: 142.7 symbols/min
[2025-10-24T01:22:51.006256] [DEBUG] [LOCAL     ] GRC: Saving derivative data.
[2025-10-24T01:22:51.007671] [INFO ] [MAIN      ] GRND: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:51.020341] [DEBUG] [LOCAL     ] GRC: Derivative data saved (139 records).
[2025-10-24T01:22:51.021851] [INFO ] [MAIN      ] GRC: Successfully saved derivative data.
[2025-10-24T01:22:51.026119] [INFO ] [MAIN      ] Derivative Progress: 881/2164 symbols completed. GRC took 1.1s. Estimated remaining: 8m 59s. Rate: 142.9 symbols/min
[2025-10-24T01:22:51.026863] [INFO ] [MAIN      ] GRNT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:51.041307] [DEBUG] [MAIN      ] GRMN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:51.093802] [INFO ] [MAIN      ] GRMN: Generated 139 derivative records from 40017 primary records.
[2025-10-24T01:22:51.094045] [DEBUG] [LOCAL     ] GRMN: Saving derivative data.
[2025-10-24T01:22:51.132187] [DEBUG] [LOCAL     ] GRMN: Derivative data saved (139 records).
[2025-10-24T01:22:51.133279] [INFO ] [MAIN      ] GRMN: Successfully saved derivative data.
[2025-10-24T01:22:51.134368] [DEBUG] [LOCAL     ] GRNT: Loaded 34218 existing records from primary storage.
[2025-10-24T01:22:51.134530] [INFO ] [MAIN      ] GRNT: Loaded 34218 primary data records.
[2025-10-24T01:22:51.137718] [DEBUG] [LOCAL     ] GRND: Loaded 50545 existing records from primary storage.
[2025-10-24T01:22:51.136974] [INFO ] [MAIN      ] Derivative Progress: 882/2164 symbols completed. GRMN took 0.7s. Estimated remaining: 8m 58s. Rate: 143.0 symbols/min
[2025-10-24T01:22:51.149868] [INFO ] [MAIN      ] GROV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:51.170281] [INFO ] [MAIN      ] GRND: Loaded 50545 primary data records.
[2025-10-24T01:22:51.338878] [DEBUG] [LOCAL     ] GROV: Loaded 8639 existing records from primary storage.
[2025-10-24T01:22:51.349552] [INFO ] [MAIN      ] GROV: Loaded 8639 primary data records.
[2025-10-24T01:22:52.143898] [DEBUG] [MAIN      ] GRNT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:52.149102] [DEBUG] [MAIN      ] GRND: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:52.196636] [DEBUG] [MAIN      ] GROV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:52.256679] [INFO ] [MAIN      ] GRNT: Generated 139 derivative records from 34218 primary records.
[2025-10-24T01:22:52.258467] [DEBUG] [LOCAL     ] GRNT: Saving derivative data.
[2025-10-24T01:22:52.263001] [INFO ] [MAIN      ] GRND: Generated 139 derivative records from 50545 primary records.
[2025-10-24T01:22:52.273388] [DEBUG] [LOCAL     ] GRND: Saving derivative data.
[2025-10-24T01:22:52.276521] [DEBUG] [LOCAL     ] GRNT: Derivative data saved (139 records).
[2025-10-24T01:22:52.276924] [INFO ] [MAIN      ] GRNT: Successfully saved derivative data.
[2025-10-24T01:22:52.289138] [INFO ] [MAIN      ] Derivative Progress: 883/2164 symbols completed. GRNT took 1.3s. Estimated remaining: 8m 59s. Rate: 142.7 symbols/min
[2025-10-24T01:22:52.292313] [INFO ] [MAIN      ] GROV: Generated 139 derivative records from 8639 primary records.
[2025-10-24T01:22:52.292717] [DEBUG] [LOCAL     ] GROV: Saving derivative data.
[2025-10-24T01:22:52.294737] [DEBUG] [LOCAL     ] GRND: Derivative data saved (139 records).
[2025-10-24T01:22:52.295031] [INFO ] [MAIN      ] GRND: Successfully saved derivative data.
[2025-10-24T01:22:52.298240] [INFO ] [MAIN      ] Derivative Progress: 884/2164 symbols completed. GRND took 1.3s. Estimated remaining: 8m 58s. Rate: 142.9 symbols/min
[2025-10-24T01:22:52.308697] [DEBUG] [LOCAL     ] GROV: Derivative data saved (139 records).
[2025-10-24T01:22:52.308779] [INFO ] [MAIN      ] GROV: Successfully saved derivative data.
[2025-10-24T01:22:52.311385] [INFO ] [MAIN      ] Derivative Progress: 885/2164 symbols completed. GROV took 1.2s. Estimated remaining: 8m 57s. Rate: 143.0 symbols/min
[2025-10-24T01:22:52.311802] [INFO ] [MAIN      ] GRX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:52.311893] [INFO ] [MAIN      ] GS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:52.311960] [INFO ] [MAIN      ] GSBD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:52.321497] [DEBUG] [LOCAL     ] GRX: Loaded 4873 existing records from primary storage.
[2025-10-24T01:22:52.321898] [INFO ] [MAIN      ] GRX: Loaded 4873 primary data records.
[2025-10-24T01:22:52.666014] [DEBUG] [LOCAL     ] GSBD: Loaded 39823 existing records from primary storage.
[2025-10-24T01:22:52.681887] [INFO ] [MAIN      ] GSBD: Loaded 39823 primary data records.
[2025-10-24T01:22:52.683107] [DEBUG] [LOCAL     ] GS: Loaded 52152 existing records from primary storage.
[2025-10-24T01:22:52.705446] [INFO ] [MAIN      ] GS: Loaded 52152 primary data records.
[2025-10-24T01:22:53.349434] [DEBUG] [MAIN      ] GRX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:53.412170] [DEBUG] [MAIN      ] GSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:53.441853] [INFO ] [MAIN      ] GRX: Generated 139 derivative records from 4873 primary records.
[2025-10-24T01:22:53.442242] [DEBUG] [LOCAL     ] GRX: Saving derivative data.
[2025-10-24T01:22:53.455819] [DEBUG] [MAIN      ] GS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:53.482564] [DEBUG] [LOCAL     ] GRX: Derivative data saved (139 records).
[2025-10-24T01:22:53.482835] [INFO ] [MAIN      ] GRX: Successfully saved derivative data.
[2025-10-24T01:22:53.485184] [INFO ] [MAIN      ] Derivative Progress: 886/2164 symbols completed. GRX took 1.2s. Estimated remaining: 8m 57s. Rate: 142.7 symbols/min
[2025-10-24T01:22:53.486239] [INFO ] [MAIN      ] GSK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:53.533483] [INFO ] [MAIN      ] GSBD: Generated 139 derivative records from 39823 primary records.
[2025-10-24T01:22:53.550431] [DEBUG] [LOCAL     ] GSBD: Saving derivative data.
[2025-10-24T01:22:53.550683] [INFO ] [MAIN      ] GS: Generated 139 derivative records from 52152 primary records.
[2025-10-24T01:22:53.551807] [DEBUG] [LOCAL     ] GS: Saving derivative data.
[2025-10-24T01:22:53.577539] [DEBUG] [LOCAL     ] GSBD: Derivative data saved (139 records).
[2025-10-24T01:22:53.592258] [INFO ] [MAIN      ] GSBD: Successfully saved derivative data.
[2025-10-24T01:22:53.595518] [INFO ] [MAIN      ] Derivative Progress: 887/2164 symbols completed. GSBD took 1.3s. Estimated remaining: 8m 56s. Rate: 142.9 symbols/min
[2025-10-24T01:22:53.596758] [DEBUG] [LOCAL     ] GSK: Loaded 53900 existing records from primary storage.
[2025-10-24T01:22:53.597029] [INFO ] [MAIN      ] GSK: Loaded 53900 primary data records.
[2025-10-24T01:22:53.597319] [INFO ] [MAIN      ] GSL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:53.593121] [DEBUG] [LOCAL     ] GS: Derivative data saved (139 records).
[2025-10-24T01:22:53.628726] [INFO ] [MAIN      ] GS: Successfully saved derivative data.
[2025-10-24T01:22:53.666723] [INFO ] [MAIN      ] Derivative Progress: 888/2164 symbols completed. GS took 1.4s. Estimated remaining: 8m 55s. Rate: 143.0 symbols/min
[2025-10-24T01:22:53.689223] [INFO ] [MAIN      ] GTES: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:53.949408] [DEBUG] [LOCAL     ] GSL: Loaded 33099 existing records from primary storage.
[2025-10-24T01:22:53.949785] [INFO ] [MAIN      ] GSL: Loaded 33099 primary data records.
[2025-10-24T01:22:54.162909] [DEBUG] [LOCAL     ] GTES: Loaded 50654 existing records from primary storage.
[2025-10-24T01:22:54.276022] [INFO ] [MAIN      ] GTES: Loaded 50654 primary data records.
[2025-10-24T01:22:54.436922] [DEBUG] [MAIN      ] GSK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:54.638312] [DEBUG] [MAIN      ] GSL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:54.662094] [INFO ] [MAIN      ] GSK: Generated 139 derivative records from 53900 primary records.
[2025-10-24T01:22:54.663514] [DEBUG] [LOCAL     ] GSK: Saving derivative data.
[2025-10-24T01:22:54.681967] [DEBUG] [LOCAL     ] GSK: Derivative data saved (139 records).
[2025-10-24T01:22:54.682384] [INFO ] [MAIN      ] GSK: Successfully saved derivative data.
[2025-10-24T01:22:54.685147] [INFO ] [MAIN      ] Derivative Progress: 889/2164 symbols completed. GSK took 1.2s. Estimated remaining: 8m 56s. Rate: 142.8 symbols/min
[2025-10-24T01:22:54.693033] [INFO ] [MAIN      ] GTLS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:54.703780] [DEBUG] [MAIN      ] GTES: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:54.739451] [INFO ] [MAIN      ] GSL: Generated 139 derivative records from 33099 primary records.
[2025-10-24T01:22:54.741350] [DEBUG] [LOCAL     ] GSL: Saving derivative data.
[2025-10-24T01:22:54.768996] [DEBUG] [LOCAL     ] GSL: Derivative data saved (139 records).
[2025-10-24T01:22:54.772027] [INFO ] [MAIN      ] GSL: Successfully saved derivative data.
[2025-10-24T01:22:54.774808] [INFO ] [MAIN      ] Derivative Progress: 890/2164 symbols completed. GSL took 1.2s. Estimated remaining: 8m 55s. Rate: 142.9 symbols/min
[2025-10-24T01:22:54.775821] [INFO ] [MAIN      ] GTN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:54.794331] [DEBUG] [LOCAL     ] GTLS: Loaded 43429 existing records from primary storage.
[2025-10-24T01:22:54.795240] [INFO ] [MAIN      ] GTLS: Loaded 43429 primary data records.
[2025-10-24T01:22:54.831463] [INFO ] [MAIN      ] GTES: Generated 139 derivative records from 50654 primary records.
[2025-10-24T01:22:54.881906] [DEBUG] [LOCAL     ] GTES: Saving derivative data.
[2025-10-24T01:22:54.968079] [DEBUG] [LOCAL     ] GTES: Derivative data saved (139 records).
[2025-10-24T01:22:54.968895] [INFO ] [MAIN      ] GTES: Successfully saved derivative data.
[2025-10-24T01:22:54.974887] [INFO ] [MAIN      ] Derivative Progress: 891/2164 symbols completed. GTES took 1.3s. Estimated remaining: 8m 54s. Rate: 143.0 symbols/min
[2025-10-24T01:22:54.988225] [INFO ] [MAIN      ] GTY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:55.004728] [DEBUG] [LOCAL     ] GTN: Loaded 45076 existing records from primary storage.
[2025-10-24T01:22:55.019678] [INFO ] [MAIN      ] GTN: Loaded 45076 primary data records.
[2025-10-24T01:22:55.463605] [DEBUG] [LOCAL     ] GTY: Loaded 30273 existing records from primary storage.
[2025-10-24T01:22:55.463996] [INFO ] [MAIN      ] GTY: Loaded 30273 primary data records.
[2025-10-24T01:22:55.785966] [DEBUG] [MAIN      ] GTLS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:55.826013] [DEBUG] [MAIN      ] GTN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:55.871895] [INFO ] [MAIN      ] GTLS: Generated 139 derivative records from 43429 primary records.
[2025-10-24T01:22:55.886087] [DEBUG] [LOCAL     ] GTLS: Saving derivative data.
[2025-10-24T01:22:55.888832] [DEBUG] [MAIN      ] GTY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:55.920951] [DEBUG] [LOCAL     ] GTLS: Derivative data saved (139 records).
[2025-10-24T01:22:55.923153] [INFO ] [MAIN      ] GTLS: Successfully saved derivative data.
[2025-10-24T01:22:55.926572] [INFO ] [MAIN      ] Derivative Progress: 892/2164 symbols completed. GTLS took 1.2s. Estimated remaining: 8m 55s. Rate: 142.8 symbols/min
[2025-10-24T01:22:55.927375] [INFO ] [MAIN      ] GUG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:55.930452] [INFO ] [MAIN      ] GTN: Generated 139 derivative records from 45076 primary records.
[2025-10-24T01:22:55.930749] [DEBUG] [LOCAL     ] GTN: Saving derivative data.
[2025-10-24T01:22:55.947383] [DEBUG] [LOCAL     ] GTN: Derivative data saved (139 records).
[2025-10-24T01:22:55.950084] [INFO ] [MAIN      ] GTN: Successfully saved derivative data.
[2025-10-24T01:22:55.953249] [INFO ] [MAIN      ] Derivative Progress: 893/2164 symbols completed. GTN took 1.2s. Estimated remaining: 8m 54s. Rate: 142.9 symbols/min
[2025-10-24T01:22:55.956575] [INFO ] [MAIN      ] GUT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:55.968369] [DEBUG] [LOCAL     ] GUG: Loaded 12223 existing records from primary storage.
[2025-10-24T01:22:55.969021] [INFO ] [MAIN      ] GUG: Loaded 12223 primary data records.
[2025-10-24T01:22:56.090166] [INFO ] [MAIN      ] GTY: Generated 139 derivative records from 30273 primary records.
[2025-10-24T01:22:56.116949] [DEBUG] [LOCAL     ] GTY: Saving derivative data.
[2025-10-24T01:22:56.122745] [DEBUG] [LOCAL     ] GUT: Loaded 15608 existing records from primary storage.
[2025-10-24T01:22:56.153707] [INFO ] [MAIN      ] GUT: Loaded 15608 primary data records.
[2025-10-24T01:22:56.406396] [DEBUG] [LOCAL     ] GTY: Derivative data saved (139 records).
[2025-10-24T01:22:56.427332] [INFO ] [MAIN      ] GTY: Successfully saved derivative data.
[2025-10-24T01:22:56.467776] [INFO ] [MAIN      ] Derivative Progress: 894/2164 symbols completed. GTY took 1.5s. Estimated remaining: 8m 53s. Rate: 142.9 symbols/min
[2025-10-24T01:22:56.495360] [INFO ] [MAIN      ] GVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:56.700106] [DEBUG] [MAIN      ] GUG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:56.738817] [DEBUG] [LOCAL     ] GVA: Loaded 32845 existing records from primary storage.
[2025-10-24T01:22:56.741171] [INFO ] [MAIN      ] GVA: Loaded 32845 primary data records.
[2025-10-24T01:22:56.882495] [DEBUG] [MAIN      ] GUT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:57.101456] [INFO ] [MAIN      ] GUG: Generated 139 derivative records from 12223 primary records.
[2025-10-24T01:22:57.107224] [DEBUG] [LOCAL     ] GUG: Saving derivative data.
[2025-10-24T01:22:57.123184] [DEBUG] [LOCAL     ] GUG: Derivative data saved (139 records).
[2025-10-24T01:22:57.127053] [INFO ] [MAIN      ] GUG: Successfully saved derivative data.
[2025-10-24T01:22:57.129404] [INFO ] [MAIN      ] Derivative Progress: 895/2164 symbols completed. GUG took 1.2s. Estimated remaining: 8m 53s. Rate: 142.8 symbols/min
[2025-10-24T01:22:57.131764] [INFO ] [MAIN      ] GWH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:57.141248] [INFO ] [MAIN      ] GUT: Generated 139 derivative records from 15608 primary records.
[2025-10-24T01:22:57.141614] [DEBUG] [LOCAL     ] GUT: Saving derivative data.
[2025-10-24T01:22:57.165123] [DEBUG] [MAIN      ] GVA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:57.167909] [DEBUG] [LOCAL     ] GUT: Derivative data saved (139 records).
[2025-10-24T01:22:57.168091] [INFO ] [MAIN      ] GUT: Successfully saved derivative data.
[2025-10-24T01:22:57.186718] [INFO ] [MAIN      ] Derivative Progress: 896/2164 symbols completed. GUT took 1.2s. Estimated remaining: 8m 52s. Rate: 142.9 symbols/min
[2025-10-24T01:22:57.190501] [INFO ] [MAIN      ] GWRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:57.202718] [DEBUG] [LOCAL     ] GWH: Loaded 20423 existing records from primary storage.
[2025-10-24T01:22:57.205765] [INFO ] [MAIN      ] GWH: Loaded 20423 primary data records.
[2025-10-24T01:22:57.362957] [INFO ] [MAIN      ] GVA: Generated 139 derivative records from 32845 primary records.
[2025-10-24T01:22:57.392705] [DEBUG] [LOCAL     ] GVA: Saving derivative data.
[2025-10-24T01:22:57.558218] [DEBUG] [LOCAL     ] GVA: Derivative data saved (139 records).
[2025-10-24T01:22:57.559292] [INFO ] [MAIN      ] GVA: Successfully saved derivative data.
[2025-10-24T01:22:57.562382] [INFO ] [MAIN      ] Derivative Progress: 897/2164 symbols completed. GVA took 1.1s. Estimated remaining: 8m 52s. Rate: 142.9 symbols/min
[2025-10-24T01:22:57.562754] [INFO ] [MAIN      ] GWW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:57.565796] [DEBUG] [LOCAL     ] GWRE: Loaded 39790 existing records from primary storage.
[2025-10-24T01:22:57.567378] [INFO ] [MAIN      ] GWRE: Loaded 39790 primary data records.
[2025-10-24T01:22:57.745084] [DEBUG] [LOCAL     ] GWW: Loaded 19343 existing records from primary storage.
[2025-10-24T01:22:57.878770] [INFO ] [MAIN      ] GWW: Loaded 19343 primary data records.
[2025-10-24T01:22:58.080858] [DEBUG] [MAIN      ] GWH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:58.290149] [DEBUG] [MAIN      ] GWRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:58.325565] [INFO ] [MAIN      ] GWH: Generated 139 derivative records from 20423 primary records.
[2025-10-24T01:22:58.339327] [DEBUG] [LOCAL     ] GWH: Saving derivative data.
[2025-10-24T01:22:58.343078] [DEBUG] [MAIN      ] GWW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:58.356116] [DEBUG] [LOCAL     ] GWH: Derivative data saved (139 records).
[2025-10-24T01:22:58.371875] [INFO ] [MAIN      ] GWH: Successfully saved derivative data.
[2025-10-24T01:22:58.374552] [INFO ] [MAIN      ] Derivative Progress: 898/2164 symbols completed. GWH took 1.2s. Estimated remaining: 8m 52s. Rate: 142.8 symbols/min
[2025-10-24T01:22:58.381127] [INFO ] [MAIN      ] GWRE: Generated 139 derivative records from 39790 primary records.
[2025-10-24T01:22:58.381596] [DEBUG] [LOCAL     ] GWRE: Saving derivative data.
[2025-10-24T01:22:58.398253] [DEBUG] [LOCAL     ] GWRE: Derivative data saved (139 records).
[2025-10-24T01:22:58.398423] [INFO ] [MAIN      ] GWRE: Successfully saved derivative data.
[2025-10-24T01:22:58.403202] [INFO ] [MAIN      ] Derivative Progress: 899/2164 symbols completed. GWRE took 1.2s. Estimated remaining: 8m 51s. Rate: 142.9 symbols/min
[2025-10-24T01:22:58.408809] [INFO ] [MAIN      ] GWW: Generated 139 derivative records from 19343 primary records.
[2025-10-24T01:22:58.408899] [DEBUG] [LOCAL     ] GWW: Saving derivative data.
[2025-10-24T01:22:58.420439] [DEBUG] [LOCAL     ] GWW: Derivative data saved (139 records).
[2025-10-24T01:22:58.420534] [INFO ] [MAIN      ] GWW: Successfully saved derivative data.
[2025-10-24T01:22:58.423155] [INFO ] [MAIN      ] Derivative Progress: 900/2164 symbols completed. GWW took 0.9s. Estimated remaining: 8m 50s. Rate: 143.1 symbols/min
[2025-10-24T01:22:58.423551] [INFO ] [MAIN      ] GXO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:58.423716] [INFO ] [MAIN      ] H: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:58.423774] [INFO ] [MAIN      ] GYLD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:58.429193] [DEBUG] [LOCAL     ] GYLD: Loaded 1537 existing records from primary storage.
[2025-10-24T01:22:58.429438] [INFO ] [MAIN      ] GYLD: Loaded 1537 primary data records.
[2025-10-24T01:22:58.760382] [DEBUG] [LOCAL     ] GXO: Loaded 46753 existing records from primary storage.
[2025-10-24T01:22:58.760790] [INFO ] [MAIN      ] GXO: Loaded 46753 primary data records.
[2025-10-24T01:22:58.889938] [DEBUG] [LOCAL     ] H: Loaded 44693 existing records from primary storage.
[2025-10-24T01:22:58.915203] [INFO ] [MAIN      ] H: Loaded 44693 primary data records.
[2025-10-24T01:22:59.454828] [DEBUG] [MAIN      ] GYLD: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:22:59.506068] [DEBUG] [MAIN      ] GXO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:59.533821] [INFO ] [MAIN      ] GYLD: Generated 139 derivative records from 1537 primary records.
[2025-10-24T01:22:59.548921] [DEBUG] [MAIN      ] H: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:22:59.549487] [DEBUG] [LOCAL     ] GYLD: Saving derivative data.
[2025-10-24T01:22:59.576481] [DEBUG] [LOCAL     ] GYLD: Derivative data saved (139 records).
[2025-10-24T01:22:59.581191] [INFO ] [MAIN      ] GYLD: Successfully saved derivative data.
[2025-10-24T01:22:59.583733] [INFO ] [MAIN      ] Derivative Progress: 901/2164 symbols completed. GYLD took 1.2s. Estimated remaining: 8m 51s. Rate: 142.8 symbols/min
[2025-10-24T01:22:59.585927] [INFO ] [MAIN      ] HAE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:59.609840] [INFO ] [MAIN      ] GXO: Generated 139 derivative records from 46753 primary records.
[2025-10-24T01:22:59.611331] [DEBUG] [LOCAL     ] GXO: Saving derivative data.
[2025-10-24T01:22:59.637165] [DEBUG] [LOCAL     ] GXO: Derivative data saved (139 records).
[2025-10-24T01:22:59.637322] [INFO ] [MAIN      ] GXO: Successfully saved derivative data.
[2025-10-24T01:22:59.640323] [INFO ] [MAIN      ] H: Generated 139 derivative records from 44693 primary records.
[2025-10-24T01:22:59.643152] [INFO ] [MAIN      ] Derivative Progress: 902/2164 symbols completed. GXO took 1.2s. Estimated remaining: 8m 50s. Rate: 143.0 symbols/min
[2025-10-24T01:22:59.656101] [INFO ] [MAIN      ] HAFN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:22:59.655990] [DEBUG] [LOCAL     ] H: Saving derivative data.
[2025-10-24T01:22:59.658902] [DEBUG] [LOCAL     ] HAE: Loaded 39587 existing records from primary storage.
[2025-10-24T01:22:59.659523] [INFO ] [MAIN      ] HAE: Loaded 39587 primary data records.
[2025-10-24T01:22:59.692737] [DEBUG] [LOCAL     ] H: Derivative data saved (139 records).
[2025-10-24T01:22:59.708546] [INFO ] [MAIN      ] H: Successfully saved derivative data.
[2025-10-24T01:22:59.711582] [INFO ] [MAIN      ] Derivative Progress: 903/2164 symbols completed. H took 1.3s. Estimated remaining: 8m 49s. Rate: 143.1 symbols/min
[2025-10-24T01:22:59.711957] [INFO ] [MAIN      ] HAL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:00.019513] [DEBUG] [LOCAL     ] HAFN: Loaded 42951 existing records from primary storage.
[2025-10-24T01:23:00.019863] [INFO ] [MAIN      ] HAFN: Loaded 42951 primary data records.
[2025-10-24T01:23:00.169292] [DEBUG] [LOCAL     ] HAL: Loaded 54108 existing records from primary storage.
[2025-10-24T01:23:00.202998] [INFO ] [MAIN      ] HAL: Loaded 54108 primary data records.
[2025-10-24T01:23:00.716074] [DEBUG] [MAIN      ] HAE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:00.773614] [DEBUG] [MAIN      ] HAFN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:00.787073] [INFO ] [MAIN      ] HAE: Generated 139 derivative records from 39587 primary records.
[2025-10-24T01:23:00.792549] [DEBUG] [LOCAL     ] HAE: Saving derivative data.
[2025-10-24T01:23:00.816981] [DEBUG] [LOCAL     ] HAE: Derivative data saved (139 records).
[2025-10-24T01:23:00.822752] [DEBUG] [MAIN      ] HAL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:00.825793] [INFO ] [MAIN      ] HAE: Successfully saved derivative data.
[2025-10-24T01:23:00.840339] [INFO ] [MAIN      ] Derivative Progress: 904/2164 symbols completed. HAE took 1.3s. Estimated remaining: 8m 49s. Rate: 142.8 symbols/min
[2025-10-24T01:23:00.845039] [INFO ] [MAIN      ] HASI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:00.871326] [INFO ] [MAIN      ] HAFN: Generated 139 derivative records from 42951 primary records.
[2025-10-24T01:23:00.872682] [DEBUG] [LOCAL     ] HAFN: Saving derivative data.
[2025-10-24T01:23:00.898465] [DEBUG] [LOCAL     ] HAFN: Derivative data saved (139 records).
[2025-10-24T01:23:00.900353] [INFO ] [MAIN      ] HAFN: Successfully saved derivative data.
[2025-10-24T01:23:00.903164] [INFO ] [MAIN      ] Derivative Progress: 905/2164 symbols completed. HAFN took 1.2s. Estimated remaining: 8m 48s. Rate: 143.0 symbols/min
[2025-10-24T01:23:00.903842] [INFO ] [MAIN      ] HAYW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:00.927553] [INFO ] [MAIN      ] HAL: Generated 139 derivative records from 54108 primary records.
[2025-10-24T01:23:00.929168] [DEBUG] [LOCAL     ] HASI: Loaded 48038 existing records from primary storage.
[2025-10-24T01:23:00.929349] [DEBUG] [LOCAL     ] HAL: Saving derivative data.
[2025-10-24T01:23:00.929592] [INFO ] [MAIN      ] HASI: Loaded 48038 primary data records.
[2025-10-24T01:23:01.016324] [DEBUG] [LOCAL     ] HAL: Derivative data saved (139 records).
[2025-10-24T01:23:01.030954] [INFO ] [MAIN      ] HAL: Successfully saved derivative data.
[2025-10-24T01:23:01.069042] [INFO ] [MAIN      ] Derivative Progress: 906/2164 symbols completed. HAL took 1.4s. Estimated remaining: 8m 48s. Rate: 143.0 symbols/min
[2025-10-24T01:23:01.084332] [INFO ] [MAIN      ] HBB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:01.206247] [DEBUG] [LOCAL     ] HBB: Loaded 6322 existing records from primary storage.
[2025-10-24T01:23:01.339204] [INFO ] [MAIN      ] HBB: Loaded 6322 primary data records.
[2025-10-24T01:23:01.324549] [DEBUG] [LOCAL     ] HAYW: Loaded 49174 existing records from primary storage.
[2025-10-24T01:23:01.363429] [INFO ] [MAIN      ] HAYW: Loaded 49174 primary data records.
[2025-10-24T01:23:01.991041] [DEBUG] [MAIN      ] HASI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:02.050623] [DEBUG] [MAIN      ] HBB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:02.086738] [DEBUG] [MAIN      ] HAYW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:02.110996] [INFO ] [MAIN      ] HASI: Generated 139 derivative records from 48038 primary records.
[2025-10-24T01:23:02.116756] [DEBUG] [LOCAL     ] HASI: Saving derivative data.
[2025-10-24T01:23:02.150886] [DEBUG] [LOCAL     ] HASI: Derivative data saved (139 records).
[2025-10-24T01:23:02.152547] [INFO ] [MAIN      ] HASI: Successfully saved derivative data.
[2025-10-24T01:23:02.154946] [INFO ] [MAIN      ] Derivative Progress: 907/2164 symbols completed. HASI took 1.3s. Estimated remaining: 8m 48s. Rate: 142.8 symbols/min
[2025-10-24T01:23:02.155131] [INFO ] [MAIN      ] HBI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:02.179936] [INFO ] [MAIN      ] HAYW: Generated 139 derivative records from 49174 primary records.
[2025-10-24T01:23:02.180427] [INFO ] [MAIN      ] HBB: Generated 139 derivative records from 6322 primary records.
[2025-10-24T01:23:02.180986] [DEBUG] [LOCAL     ] HAYW: Saving derivative data.
[2025-10-24T01:23:02.181109] [DEBUG] [LOCAL     ] HBB: Saving derivative data.
[2025-10-24T01:23:02.202331] [DEBUG] [LOCAL     ] HBB: Derivative data saved (139 records).
[2025-10-24T01:23:02.207423] [DEBUG] [LOCAL     ] HAYW: Derivative data saved (139 records).
[2025-10-24T01:23:02.209023] [INFO ] [MAIN      ] HBB: Successfully saved derivative data.
[2025-10-24T01:23:02.209241] [INFO ] [MAIN      ] HAYW: Successfully saved derivative data.
[2025-10-24T01:23:02.211712] [INFO ] [MAIN      ] Derivative Progress: 908/2164 symbols completed. HBB took 1.1s. Estimated remaining: 8m 47s. Rate: 142.9 symbols/min
[2025-10-24T01:23:02.214954] [INFO ] [MAIN      ] HBM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:02.215027] [INFO ] [MAIN      ] Derivative Progress: 909/2164 symbols completed. HAYW took 1.3s. Estimated remaining: 8m 46s. Rate: 143.1 symbols/min
[2025-10-24T01:23:02.215513] [INFO ] [MAIN      ] HCA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:02.264759] [DEBUG] [LOCAL     ] HBI: Loaded 53296 existing records from primary storage.
[2025-10-24T01:23:02.265750] [INFO ] [MAIN      ] HBI: Loaded 53296 primary data records.
[2025-10-24T01:23:02.504518] [DEBUG] [LOCAL     ] HBM: Loaded 53369 existing records from primary storage.
[2025-10-24T01:23:02.653639] [INFO ] [MAIN      ] HBM: Loaded 53369 primary data records.
[2025-10-24T01:23:02.676443] [DEBUG] [LOCAL     ] HCA: Loaded 47254 existing records from primary storage.
[2025-10-24T01:23:02.701952] [INFO ] [MAIN      ] HCA: Loaded 47254 primary data records.
[2025-10-24T01:23:03.345494] [DEBUG] [MAIN      ] HBI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:03.396335] [DEBUG] [MAIN      ] HBM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:03.456227] [DEBUG] [MAIN      ] HCA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:03.459706] [INFO ] [MAIN      ] HBI: Generated 139 derivative records from 53296 primary records.
[2025-10-24T01:23:03.476306] [DEBUG] [LOCAL     ] HBI: Saving derivative data.
[2025-10-24T01:23:03.499873] [DEBUG] [LOCAL     ] HBI: Derivative data saved (139 records).
[2025-10-24T01:23:03.501953] [INFO ] [MAIN      ] HBI: Successfully saved derivative data.
[2025-10-24T01:23:03.508280] [INFO ] [MAIN      ] Derivative Progress: 910/2164 symbols completed. HBI took 1.4s. Estimated remaining: 8m 47s. Rate: 142.8 symbols/min
[2025-10-24T01:23:03.512807] [INFO ] [MAIN      ] HCC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:03.526315] [INFO ] [MAIN      ] HBM: Generated 139 derivative records from 53369 primary records.
[2025-10-24T01:23:03.526779] [DEBUG] [LOCAL     ] HBM: Saving derivative data.
[2025-10-24T01:23:03.551410] [INFO ] [MAIN      ] HCA: Generated 139 derivative records from 47254 primary records.
[2025-10-24T01:23:03.555228] [DEBUG] [LOCAL     ] HBM: Derivative data saved (139 records).
[2025-10-24T01:23:03.555620] [DEBUG] [LOCAL     ] HCA: Saving derivative data.
[2025-10-24T01:23:03.557240] [INFO ] [MAIN      ] HBM: Successfully saved derivative data.
[2025-10-24T01:23:03.561866] [INFO ] [MAIN      ] Derivative Progress: 911/2164 symbols completed. HBM took 1.3s. Estimated remaining: 8m 46s. Rate: 142.9 symbols/min
[2025-10-24T01:23:03.569872] [INFO ] [MAIN      ] HCI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:03.577705] [DEBUG] [LOCAL     ] HCA: Derivative data saved (139 records).
[2025-10-24T01:23:03.577879] [INFO ] [MAIN      ] HCA: Successfully saved derivative data.
[2025-10-24T01:23:03.581888] [INFO ] [MAIN      ] Derivative Progress: 912/2164 symbols completed. HCA took 1.4s. Estimated remaining: 8m 45s. Rate: 143.0 symbols/min
[2025-10-24T01:23:03.582204] [INFO ] [MAIN      ] HD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:03.613002] [DEBUG] [LOCAL     ] HCI: Loaded 14149 existing records from primary storage.
[2025-10-24T01:23:03.613587] [INFO ] [MAIN      ] HCI: Loaded 14149 primary data records.
[2025-10-24T01:23:03.692598] [DEBUG] [LOCAL     ] HCC: Loaded 45253 existing records from primary storage.
[2025-10-24T01:23:03.708110] [INFO ] [MAIN      ] HCC: Loaded 45253 primary data records.
[2025-10-24T01:23:04.181622] [DEBUG] [LOCAL     ] HD: Loaded 53854 existing records from primary storage.
[2025-10-24T01:23:04.192077] [INFO ] [MAIN      ] HD: Loaded 53854 primary data records.
[2025-10-24T01:23:04.776435] [DEBUG] [MAIN      ] HCI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:04.825444] [DEBUG] [MAIN      ] HCC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:04.877967] [INFO ] [MAIN      ] HCI: Generated 139 derivative records from 14149 primary records.
[2025-10-24T01:23:04.888693] [DEBUG] [LOCAL     ] HCI: Saving derivative data.
[2025-10-24T01:23:04.890320] [DEBUG] [MAIN      ] HD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:04.905553] [DEBUG] [LOCAL     ] HCI: Derivative data saved (139 records).
[2025-10-24T01:23:04.918065] [INFO ] [MAIN      ] HCI: Successfully saved derivative data.
[2025-10-24T01:23:04.927145] [INFO ] [MAIN      ] Derivative Progress: 913/2164 symbols completed. HCI took 1.4s. Estimated remaining: 8m 46s. Rate: 142.7 symbols/min
[2025-10-24T01:23:04.955193] [INFO ] [MAIN      ] HCC: Generated 139 derivative records from 45253 primary records.
[2025-10-24T01:23:04.957128] [DEBUG] [LOCAL     ] HCC: Saving derivative data.
[2025-10-24T01:23:04.976351] [INFO ] [MAIN      ] HD: Generated 139 derivative records from 53854 primary records.
[2025-10-24T01:23:04.979667] [DEBUG] [LOCAL     ] HCC: Derivative data saved (139 records).
[2025-10-24T01:23:04.980029] [INFO ] [MAIN      ] HCC: Successfully saved derivative data.
[2025-10-24T01:23:04.980174] [DEBUG] [LOCAL     ] HD: Saving derivative data.
[2025-10-24T01:23:04.984322] [INFO ] [MAIN      ] Derivative Progress: 914/2164 symbols completed. HCC took 1.5s. Estimated remaining: 8m 45s. Rate: 142.8 symbols/min
[2025-10-24T01:23:05.001344] [DEBUG] [LOCAL     ] HD: Derivative data saved (139 records).
[2025-10-24T01:23:05.001577] [INFO ] [MAIN      ] HD: Successfully saved derivative data.
[2025-10-24T01:23:05.007482] [INFO ] [MAIN      ] Derivative Progress: 915/2164 symbols completed. HD took 1.4s. Estimated remaining: 8m 44s. Rate: 143.0 symbols/min
[2025-10-24T01:23:05.008200] [INFO ] [MAIN      ] HDB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:05.008422] [INFO ] [MAIN      ] HE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:05.008581] [INFO ] [MAIN      ] HEI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:05.077398] [DEBUG] [LOCAL     ] HEI: Loaded 30697 existing records from primary storage.
[2025-10-24T01:23:05.077674] [INFO ] [MAIN      ] HEI: Loaded 30697 primary data records.
[2025-10-24T01:23:05.206851] [DEBUG] [LOCAL     ] HDB: Loaded 52296 existing records from primary storage.
[2025-10-24T01:23:05.207182] [INFO ] [MAIN      ] HDB: Loaded 52296 primary data records.
[2025-10-24T01:23:05.241115] [DEBUG] [LOCAL     ] HE: Loaded 49115 existing records from primary storage.
[2025-10-24T01:23:05.247066] [INFO ] [MAIN      ] HE: Loaded 49115 primary data records.
[2025-10-24T01:23:06.110336] [DEBUG] [MAIN      ] HEI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:06.151510] [DEBUG] [MAIN      ] HDB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:06.191945] [DEBUG] [MAIN      ] HE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:06.224735] [INFO ] [MAIN      ] HEI: Generated 139 derivative records from 30697 primary records.
[2025-10-24T01:23:06.229143] [DEBUG] [LOCAL     ] HEI: Saving derivative data.
[2025-10-24T01:23:06.251160] [DEBUG] [LOCAL     ] HEI: Derivative data saved (139 records).
[2025-10-24T01:23:06.254952] [INFO ] [MAIN      ] HEI: Successfully saved derivative data.
[2025-10-24T01:23:06.261083] [INFO ] [MAIN      ] Derivative Progress: 916/2164 symbols completed. HEI took 1.3s. Estimated remaining: 8m 45s. Rate: 142.7 symbols/min
[2025-10-24T01:23:06.263942] [INFO ] [MAIN      ] HEQ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:06.277374] [INFO ] [MAIN      ] HDB: Generated 139 derivative records from 52296 primary records.
[2025-10-24T01:23:06.277609] [DEBUG] [LOCAL     ] HDB: Saving derivative data.
[2025-10-24T01:23:06.290139] [INFO ] [MAIN      ] HE: Generated 139 derivative records from 49115 primary records.
[2025-10-24T01:23:06.294960] [DEBUG] [LOCAL     ] HEQ: Loaded 6802 existing records from primary storage.
[2025-10-24T01:23:06.297534] [INFO ] [MAIN      ] HEQ: Loaded 6802 primary data records.
[2025-10-24T01:23:06.297637] [DEBUG] [LOCAL     ] HDB: Derivative data saved (139 records).
[2025-10-24T01:23:06.297854] [DEBUG] [LOCAL     ] HE: Saving derivative data.
[2025-10-24T01:23:06.297960] [INFO ] [MAIN      ] HDB: Successfully saved derivative data.
[2025-10-24T01:23:06.300765] [INFO ] [MAIN      ] Derivative Progress: 917/2164 symbols completed. HDB took 1.3s. Estimated remaining: 8m 44s. Rate: 142.8 symbols/min
[2025-10-24T01:23:06.351909] [INFO ] [MAIN      ] HESM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:06.393953] [DEBUG] [LOCAL     ] HE: Derivative data saved (139 records).
[2025-10-24T01:23:06.422891] [INFO ] [MAIN      ] HE: Successfully saved derivative data.
[2025-10-24T01:23:06.434341] [INFO ] [MAIN      ] Derivative Progress: 918/2164 symbols completed. HE took 1.4s. Estimated remaining: 8m 43s. Rate: 142.9 symbols/min
[2025-10-24T01:23:06.439330] [INFO ] [MAIN      ] HFRO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:06.679980] [DEBUG] [LOCAL     ] HFRO: Loaded 16411 existing records from primary storage.
[2025-10-24T01:23:06.680161] [INFO ] [MAIN      ] HFRO: Loaded 16411 primary data records.
[2025-10-24T01:23:06.789552] [DEBUG] [LOCAL     ] HESM: Loaded 48963 existing records from primary storage.
[2025-10-24T01:23:06.796511] [INFO ] [MAIN      ] HESM: Loaded 48963 primary data records.
[2025-10-24T01:23:07.374616] [DEBUG] [MAIN      ] HEQ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:07.418037] [DEBUG] [MAIN      ] HFRO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:07.455576] [DEBUG] [MAIN      ] HESM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:07.474367] [INFO ] [MAIN      ] HEQ: Generated 139 derivative records from 6802 primary records.
[2025-10-24T01:23:07.477899] [DEBUG] [LOCAL     ] HEQ: Saving derivative data.
[2025-10-24T01:23:07.497621] [DEBUG] [LOCAL     ] HEQ: Derivative data saved (139 records).
[2025-10-24T01:23:07.500928] [INFO ] [MAIN      ] HEQ: Successfully saved derivative data.
[2025-10-24T01:23:07.504503] [INFO ] [MAIN      ] Derivative Progress: 919/2164 symbols completed. HEQ took 1.2s. Estimated remaining: 8m 44s. Rate: 142.7 symbols/min
[2025-10-24T01:23:07.506161] [INFO ] [MAIN      ] HGER: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:07.519537] [INFO ] [MAIN      ] HFRO: Generated 139 derivative records from 16411 primary records.
[2025-10-24T01:23:07.521990] [DEBUG] [LOCAL     ] HFRO: Saving derivative data.
[2025-10-24T01:23:07.540626] [DEBUG] [LOCAL     ] HFRO: Derivative data saved (139 records).
[2025-10-24T01:23:07.542536] [INFO ] [MAIN      ] HFRO: Successfully saved derivative data.
[2025-10-24T01:23:07.548148] [DEBUG] [LOCAL     ] HGER: Loaded 15736 existing records from primary storage.
[2025-10-24T01:23:07.549939] [INFO ] [MAIN      ] HGER: Loaded 15736 primary data records.
[2025-10-24T01:23:07.552554] [INFO ] [MAIN      ] Derivative Progress: 920/2164 symbols completed. HFRO took 1.1s. Estimated remaining: 8m 43s. Rate: 142.8 symbols/min
[2025-10-24T01:23:07.566689] [INFO ] [MAIN      ] HGLB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:07.566945] [INFO ] [MAIN      ] HESM: Generated 139 derivative records from 48963 primary records.
[2025-10-24T01:23:07.587948] [DEBUG] [LOCAL     ] HESM: Saving derivative data.
[2025-10-24T01:23:07.639369] [DEBUG] [LOCAL     ] HESM: Derivative data saved (139 records).
[2025-10-24T01:23:07.664741] [INFO ] [MAIN      ] HESM: Successfully saved derivative data.
[2025-10-24T01:23:07.675388] [INFO ] [MAIN      ] Derivative Progress: 921/2164 symbols completed. HESM took 1.3s. Estimated remaining: 8m 42s. Rate: 142.9 symbols/min
[2025-10-24T01:23:07.679897] [INFO ] [MAIN      ] HGTY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:07.741313] [DEBUG] [LOCAL     ] HGLB: Loaded 9671 existing records from primary storage.
[2025-10-24T01:23:07.858588] [INFO ] [MAIN      ] HGLB: Loaded 9671 primary data records.
[2025-10-24T01:23:07.957864] [DEBUG] [LOCAL     ] HGTY: Loaded 13442 existing records from primary storage.
[2025-10-24T01:23:07.964992] [INFO ] [MAIN      ] HGTY: Loaded 13442 primary data records.
[2025-10-24T01:23:08.502776] [DEBUG] [MAIN      ] HGER: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:08.552531] [DEBUG] [MAIN      ] HGLB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:08.595130] [DEBUG] [MAIN      ] HGTY: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:23:08.612073] [INFO ] [MAIN      ] HGER: Generated 139 derivative records from 15736 primary records.
[2025-10-24T01:23:08.612416] [DEBUG] [LOCAL     ] HGER: Saving derivative data.
[2025-10-24T01:23:08.628943] [DEBUG] [LOCAL     ] HGER: Derivative data saved (139 records).
[2025-10-24T01:23:08.629500] [INFO ] [MAIN      ] HGER: Successfully saved derivative data.
[2025-10-24T01:23:08.633990] [INFO ] [MAIN      ] Derivative Progress: 922/2164 symbols completed. HGER took 1.1s. Estimated remaining: 8m 42s. Rate: 142.7 symbols/min
[2025-10-24T01:23:08.635826] [INFO ] [MAIN      ] HGV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:08.683056] [INFO ] [MAIN      ] HGTY: Generated 139 derivative records from 13442 primary records.
[2025-10-24T01:23:08.685351] [INFO ] [MAIN      ] HGLB: Generated 139 derivative records from 9671 primary records.
[2025-10-24T01:23:08.685583] [DEBUG] [LOCAL     ] HGTY: Saving derivative data.
[2025-10-24T01:23:08.686269] [DEBUG] [LOCAL     ] HGLB: Saving derivative data.
[2025-10-24T01:23:08.706540] [DEBUG] [LOCAL     ] HGLB: Derivative data saved (139 records).
[2025-10-24T01:23:08.722430] [DEBUG] [LOCAL     ] HGTY: Derivative data saved (139 records).
[2025-10-24T01:23:08.723605] [INFO ] [MAIN      ] HGLB: Successfully saved derivative data.
[2025-10-24T01:23:08.723760] [INFO ] [MAIN      ] HGTY: Successfully saved derivative data.
[2025-10-24T01:23:08.726437] [INFO ] [MAIN      ] Derivative Progress: 923/2164 symbols completed. HGLB took 1.2s. Estimated remaining: 8m 41s. Rate: 142.9 symbols/min
[2025-10-24T01:23:08.730805] [DEBUG] [LOCAL     ] HGV: Loaded 46371 existing records from primary storage.
[2025-10-24T01:23:08.731052] [INFO ] [MAIN      ] HGV: Loaded 46371 primary data records.
[2025-10-24T01:23:08.729476] [INFO ] [MAIN      ] HHH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:08.730910] [INFO ] [MAIN      ] Derivative Progress: 924/2164 symbols completed. HGTY took 1.0s. Estimated remaining: 8m 40s. Rate: 143.0 symbols/min
[2025-10-24T01:23:08.752290] [INFO ] [MAIN      ] HI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:09.082082] [DEBUG] [LOCAL     ] HHH: Loaded 33222 existing records from primary storage.
[2025-10-24T01:23:09.082868] [INFO ] [MAIN      ] HHH: Loaded 33222 primary data records.
[2025-10-24T01:23:09.191973] [DEBUG] [LOCAL     ] HI: Loaded 36466 existing records from primary storage.
[2025-10-24T01:23:09.203864] [INFO ] [MAIN      ] HI: Loaded 36466 primary data records.
[2025-10-24T01:23:09.722224] [DEBUG] [MAIN      ] HGV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:09.769579] [DEBUG] [MAIN      ] HHH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:09.797840] [INFO ] [MAIN      ] HGV: Generated 139 derivative records from 46371 primary records.
[2025-10-24T01:23:09.810754] [DEBUG] [LOCAL     ] HGV: Saving derivative data.
[2025-10-24T01:23:09.811107] [DEBUG] [MAIN      ] HI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:09.837058] [DEBUG] [LOCAL     ] HGV: Derivative data saved (139 records).
[2025-10-24T01:23:09.838132] [INFO ] [MAIN      ] HGV: Successfully saved derivative data.
[2025-10-24T01:23:09.841038] [INFO ] [MAIN      ] Derivative Progress: 925/2164 symbols completed. HGV took 1.2s. Estimated remaining: 8m 41s. Rate: 142.8 symbols/min
[2025-10-24T01:23:09.843035] [INFO ] [MAIN      ] HIG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:09.874139] [INFO ] [MAIN      ] HHH: Generated 139 derivative records from 33222 primary records.
[2025-10-24T01:23:09.875722] [DEBUG] [LOCAL     ] HHH: Saving derivative data.
[2025-10-24T01:23:09.906907] [INFO ] [MAIN      ] HI: Generated 139 derivative records from 36466 primary records.
[2025-10-24T01:23:09.908329] [DEBUG] [LOCAL     ] HHH: Derivative data saved (139 records).
[2025-10-24T01:23:09.908702] [DEBUG] [LOCAL     ] HI: Saving derivative data.
[2025-10-24T01:23:09.908588] [INFO ] [MAIN      ] HHH: Successfully saved derivative data.
[2025-10-24T01:23:09.912398] [INFO ] [MAIN      ] Derivative Progress: 926/2164 symbols completed. HHH took 1.2s. Estimated remaining: 8m 40s. Rate: 142.9 symbols/min
[2025-10-24T01:23:09.912914] [INFO ] [MAIN      ] HII: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:09.925895] [DEBUG] [LOCAL     ] HI: Derivative data saved (139 records).
[2025-10-24T01:23:09.927596] [INFO ] [MAIN      ] HI: Successfully saved derivative data.
[2025-10-24T01:23:09.948293] [INFO ] [MAIN      ] Derivative Progress: 927/2164 symbols completed. HI took 1.2s. Estimated remaining: 8m 39s. Rate: 143.0 symbols/min
[2025-10-24T01:23:09.950222] [INFO ] [MAIN      ] HIMS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:09.952133] [DEBUG] [LOCAL     ] HIG: Loaded 51458 existing records from primary storage.
[2025-10-24T01:23:09.952410] [INFO ] [MAIN      ] HIG: Loaded 51458 primary data records.
[2025-10-24T01:23:10.146953] [DEBUG] [LOCAL     ] HII: Loaded 33565 existing records from primary storage.
[2025-10-24T01:23:10.283013] [INFO ] [MAIN      ] HII: Loaded 33565 primary data records.
[2025-10-24T01:23:10.418753] [DEBUG] [LOCAL     ] HIMS: Loaded 54207 existing records from primary storage.
[2025-10-24T01:23:10.422695] [INFO ] [MAIN      ] HIMS: Loaded 54207 primary data records.
[2025-10-24T01:23:11.013747] [DEBUG] [MAIN      ] HIG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:11.060398] [DEBUG] [MAIN      ] HII: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:11.103861] [DEBUG] [MAIN      ] HIMS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:11.106363] [INFO ] [MAIN      ] HIG: Generated 139 derivative records from 51458 primary records.
[2025-10-24T01:23:11.118003] [DEBUG] [LOCAL     ] HIG: Saving derivative data.
[2025-10-24T01:23:11.144696] [DEBUG] [LOCAL     ] HIG: Derivative data saved (139 records).
[2025-10-24T01:23:11.147361] [INFO ] [MAIN      ] HIG: Successfully saved derivative data.
[2025-10-24T01:23:11.153772] [INFO ] [MAIN      ] Derivative Progress: 928/2164 symbols completed. HIG took 1.3s. Estimated remaining: 8m 40s. Rate: 142.7 symbols/min
[2025-10-24T01:23:11.173712] [INFO ] [MAIN      ] HII: Generated 139 derivative records from 33565 primary records.
[2025-10-24T01:23:11.175038] [DEBUG] [LOCAL     ] HII: Saving derivative data.
[2025-10-24T01:23:11.177419] [INFO ] [MAIN      ] HIMS: Generated 139 derivative records from 54207 primary records.
[2025-10-24T01:23:11.177745] [DEBUG] [LOCAL     ] HIMS: Saving derivative data.
[2025-10-24T01:23:11.202757] [DEBUG] [LOCAL     ] HIMS: Derivative data saved (139 records).
[2025-10-24T01:23:11.202360] [DEBUG] [LOCAL     ] HII: Derivative data saved (139 records).
[2025-10-24T01:23:11.203019] [INFO ] [MAIN      ] HII: Successfully saved derivative data.
[2025-10-24T01:23:11.202920] [INFO ] [MAIN      ] HIMS: Successfully saved derivative data.
[2025-10-24T01:23:11.206343] [INFO ] [MAIN      ] Derivative Progress: 929/2164 symbols completed. HIMS took 1.3s. Estimated remaining: 8m 39s. Rate: 142.9 symbols/min
[2025-10-24T01:23:11.209123] [INFO ] [MAIN      ] Derivative Progress: 930/2164 symbols completed. HII took 1.3s. Estimated remaining: 8m 38s. Rate: 143.0 symbols/min
[2025-10-24T01:23:11.209901] [INFO ] [MAIN      ] HIPO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:11.209844] [INFO ] [MAIN      ] HIO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:11.209960] [INFO ] [MAIN      ] HIW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:11.246696] [DEBUG] [LOCAL     ] HIPO: Loaded 21492 existing records from primary storage.
[2025-10-24T01:23:11.255537] [INFO ] [MAIN      ] HIPO: Loaded 21492 primary data records.
[2025-10-24T01:23:11.256145] [DEBUG] [LOCAL     ] HIO: Loaded 24111 existing records from primary storage.
[2025-10-24T01:23:11.267875] [INFO ] [MAIN      ] HIO: Loaded 24111 primary data records.
[2025-10-24T01:23:11.492978] [DEBUG] [LOCAL     ] HIW: Loaded 44737 existing records from primary storage.
[2025-10-24T01:23:11.525732] [INFO ] [MAIN      ] HIW: Loaded 44737 primary data records.
[2025-10-24T01:23:12.266544] [DEBUG] [MAIN      ] HIO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:12.295460] [DEBUG] [MAIN      ] HIPO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:12.357617] [DEBUG] [MAIN      ] HIW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:12.403431] [INFO ] [MAIN      ] HIO: Generated 139 derivative records from 24111 primary records.
[2025-10-24T01:23:12.407111] [DEBUG] [LOCAL     ] HIO: Saving derivative data.
[2025-10-24T01:23:12.421067] [INFO ] [MAIN      ] HIPO: Generated 139 derivative records from 21492 primary records.
[2025-10-24T01:23:12.426979] [DEBUG] [LOCAL     ] HIPO: Saving derivative data.
[2025-10-24T01:23:12.424134] [DEBUG] [LOCAL     ] HIO: Derivative data saved (139 records).
[2025-10-24T01:23:12.427230] [INFO ] [MAIN      ] HIO: Successfully saved derivative data.
[2025-10-24T01:23:12.431291] [INFO ] [MAIN      ] Derivative Progress: 931/2164 symbols completed. HIO took 1.2s. Estimated remaining: 8m 38s. Rate: 142.7 symbols/min
[2025-10-24T01:23:12.432458] [INFO ] [MAIN      ] HIX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:12.446459] [DEBUG] [LOCAL     ] HIPO: Derivative data saved (139 records).
[2025-10-24T01:23:12.447551] [INFO ] [MAIN      ] HIPO: Successfully saved derivative data.
[2025-10-24T01:23:12.450397] [INFO ] [MAIN      ] Derivative Progress: 932/2164 symbols completed. HIPO took 1.2s. Estimated remaining: 8m 37s. Rate: 142.9 symbols/min
[2025-10-24T01:23:12.450575] [INFO ] [MAIN      ] HKD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:12.457420] [INFO ] [MAIN      ] HIW: Generated 139 derivative records from 44737 primary records.
[2025-10-24T01:23:12.457962] [DEBUG] [LOCAL     ] HIW: Saving derivative data.
[2025-10-24T01:23:12.471600] [DEBUG] [LOCAL     ] HIW: Derivative data saved (139 records).
[2025-10-24T01:23:12.471825] [INFO ] [MAIN      ] HIW: Successfully saved derivative data.
[2025-10-24T01:23:12.475006] [INFO ] [MAIN      ] Derivative Progress: 933/2164 symbols completed. HIW took 1.3s. Estimated remaining: 8m 36s. Rate: 143.0 symbols/min
[2025-10-24T01:23:12.475259] [INFO ] [MAIN      ] HL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:12.505065] [DEBUG] [LOCAL     ] HIX: Loaded 20615 existing records from primary storage.
[2025-10-24T01:23:12.507141] [INFO ] [MAIN      ] HIX: Loaded 20615 primary data records.
[2025-10-24T01:23:12.508116] [DEBUG] [LOCAL     ] HKD: Loaded 18788 existing records from primary storage.
[2025-10-24T01:23:12.520532] [INFO ] [MAIN      ] HKD: Loaded 18788 primary data records.
[2025-10-24T01:23:13.021188] [DEBUG] [LOCAL     ] HL: Loaded 54066 existing records from primary storage.
[2025-10-24T01:23:13.041757] [INFO ] [MAIN      ] HL: Loaded 54066 primary data records.
[2025-10-24T01:23:13.536146] [DEBUG] [MAIN      ] HIX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:13.572613] [DEBUG] [MAIN      ] HKD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:13.624919] [DEBUG] [MAIN      ] HL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:13.672364] [INFO ] [MAIN      ] HIX: Generated 139 derivative records from 20615 primary records.
[2025-10-24T01:23:13.674241] [DEBUG] [LOCAL     ] HIX: Saving derivative data.
[2025-10-24T01:23:13.681488] [INFO ] [MAIN      ] HKD: Generated 139 derivative records from 18788 primary records.
[2025-10-24T01:23:13.692438] [DEBUG] [LOCAL     ] HKD: Saving derivative data.
[2025-10-24T01:23:13.695946] [DEBUG] [LOCAL     ] HIX: Derivative data saved (139 records).
[2025-10-24T01:23:13.696447] [INFO ] [MAIN      ] HIX: Successfully saved derivative data.
[2025-10-24T01:23:13.699633] [INFO ] [MAIN      ] Derivative Progress: 934/2164 symbols completed. HIX took 1.3s. Estimated remaining: 8m 37s. Rate: 142.7 symbols/min
[2025-10-24T01:23:13.700095] [INFO ] [MAIN      ] HLF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:13.716319] [DEBUG] [LOCAL     ] HKD: Derivative data saved (139 records).
[2025-10-24T01:23:13.716533] [INFO ] [MAIN      ] HKD: Successfully saved derivative data.
[2025-10-24T01:23:13.719719] [INFO ] [MAIN      ] Derivative Progress: 935/2164 symbols completed. HKD took 1.3s. Estimated remaining: 8m 36s. Rate: 142.9 symbols/min
[2025-10-24T01:23:13.720129] [INFO ] [MAIN      ] HLIO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:13.729082] [INFO ] [MAIN      ] HL: Generated 139 derivative records from 54066 primary records.
[2025-10-24T01:23:13.729323] [DEBUG] [LOCAL     ] HL: Saving derivative data.
[2025-10-24T01:23:13.756329] [DEBUG] [LOCAL     ] HL: Derivative data saved (139 records).
[2025-10-24T01:23:13.756601] [INFO ] [MAIN      ] HL: Successfully saved derivative data.
[2025-10-24T01:23:13.761059] [INFO ] [MAIN      ] Derivative Progress: 936/2164 symbols completed. HL took 1.3s. Estimated remaining: 8m 35s. Rate: 143.0 symbols/min
[2025-10-24T01:23:13.761458] [INFO ] [MAIN      ] HLLY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:13.790055] [DEBUG] [LOCAL     ] HLF: Loaded 48722 existing records from primary storage.
[2025-10-24T01:23:13.790479] [INFO ] [MAIN      ] HLF: Loaded 48722 primary data records.
[2025-10-24T01:23:13.902759] [DEBUG] [LOCAL     ] HLIO: Loaded 28229 existing records from primary storage.
[2025-10-24T01:23:13.909579] [INFO ] [MAIN      ] HLIO: Loaded 28229 primary data records.
[2025-10-24T01:23:13.964764] [DEBUG] [LOCAL     ] HLLY: Loaded 33526 existing records from primary storage.
[2025-10-24T01:23:14.004541] [INFO ] [MAIN      ] HLLY: Loaded 33526 primary data records.
[2025-10-24T01:23:14.803180] [DEBUG] [MAIN      ] HLF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:14.836615] [DEBUG] [MAIN      ] HLIO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:14.866761] [DEBUG] [MAIN      ] HLLY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:14.934548] [INFO ] [MAIN      ] HLF: Generated 139 derivative records from 48722 primary records.
[2025-10-24T01:23:14.936503] [DEBUG] [LOCAL     ] HLF: Saving derivative data.
[2025-10-24T01:23:14.949240] [INFO ] [MAIN      ] HLLY: Generated 139 derivative records from 33526 primary records.
[2025-10-24T01:23:14.953560] [DEBUG] [LOCAL     ] HLF: Derivative data saved (139 records).
[2025-10-24T01:23:14.953962] [DEBUG] [LOCAL     ] HLLY: Saving derivative data.
[2025-10-24T01:23:14.954103] [INFO ] [MAIN      ] HLIO: Generated 139 derivative records from 28229 primary records.
[2025-10-24T01:23:14.954946] [DEBUG] [LOCAL     ] HLIO: Saving derivative data.
[2025-10-24T01:23:14.954254] [INFO ] [MAIN      ] HLF: Successfully saved derivative data.
[2025-10-24T01:23:14.957535] [INFO ] [MAIN      ] Derivative Progress: 937/2164 symbols completed. HLF took 1.3s. Estimated remaining: 8m 36s. Rate: 142.7 symbols/min
[2025-10-24T01:23:14.957788] [INFO ] [MAIN      ] HLN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:14.977153] [DEBUG] [LOCAL     ] HLLY: Derivative data saved (139 records).
[2025-10-24T01:23:14.978902] [INFO ] [MAIN      ] HLLY: Successfully saved derivative data.
[2025-10-24T01:23:14.981573] [DEBUG] [LOCAL     ] HLIO: Derivative data saved (139 records).
[2025-10-24T01:23:14.984883] [INFO ] [MAIN      ] Derivative Progress: 938/2164 symbols completed. HLLY took 1.2s. Estimated remaining: 8m 35s. Rate: 142.9 symbols/min
[2025-10-24T01:23:14.981779] [INFO ] [MAIN      ] HLIO: Successfully saved derivative data.
[2025-10-24T01:23:14.985145] [INFO ] [MAIN      ] HLT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:14.987754] [INFO ] [MAIN      ] Derivative Progress: 939/2164 symbols completed. HLIO took 1.3s. Estimated remaining: 8m 34s. Rate: 143.0 symbols/min
[2025-10-24T01:23:14.987960] [INFO ] [MAIN      ] HLX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:15.046919] [DEBUG] [LOCAL     ] HLN: Loaded 53505 existing records from primary storage.
[2025-10-24T01:23:15.047253] [INFO ] [MAIN      ] HLN: Loaded 53505 primary data records.
[2025-10-24T01:23:15.178997] [DEBUG] [LOCAL     ] HLX: Loaded 47701 existing records from primary storage.
[2025-10-24T01:23:15.183401] [INFO ] [MAIN      ] HLX: Loaded 47701 primary data records.
[2025-10-24T01:23:15.269575] [DEBUG] [LOCAL     ] HLT: Loaded 50826 existing records from primary storage.
[2025-10-24T01:23:15.303150] [INFO ] [MAIN      ] HLT: Loaded 50826 primary data records.
[2025-10-24T01:23:16.051224] [DEBUG] [MAIN      ] HLN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:16.084253] [DEBUG] [MAIN      ] HLX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:16.134546] [DEBUG] [MAIN      ] HLT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:16.174052] [INFO ] [MAIN      ] HLN: Generated 139 derivative records from 53505 primary records.
[2025-10-24T01:23:16.176675] [DEBUG] [LOCAL     ] HLN: Saving derivative data.
[2025-10-24T01:23:16.196532] [DEBUG] [LOCAL     ] HLN: Derivative data saved (139 records).
[2025-10-24T01:23:16.199281] [INFO ] [MAIN      ] HLN: Successfully saved derivative data.
[2025-10-24T01:23:16.202437] [INFO ] [MAIN      ] Derivative Progress: 940/2164 symbols completed. HLN took 1.2s. Estimated remaining: 8m 35s. Rate: 142.7 symbols/min
[2025-10-24T01:23:16.207365] [INFO ] [MAIN      ] HMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:16.206263] [INFO ] [MAIN      ] HLX: Generated 139 derivative records from 47701 primary records.
[2025-10-24T01:23:16.208249] [DEBUG] [LOCAL     ] HLX: Saving derivative data.
[2025-10-24T01:23:16.225048] [INFO ] [MAIN      ] HLT: Generated 139 derivative records from 50826 primary records.
[2025-10-24T01:23:16.228135] [DEBUG] [LOCAL     ] HLX: Derivative data saved (139 records).
[2025-10-24T01:23:16.228405] [DEBUG] [LOCAL     ] HLT: Saving derivative data.
[2025-10-24T01:23:16.228588] [INFO ] [MAIN      ] HLX: Successfully saved derivative data.
[2025-10-24T01:23:16.232403] [INFO ] [MAIN      ] Derivative Progress: 941/2164 symbols completed. HLX took 1.2s. Estimated remaining: 8m 34s. Rate: 142.9 symbols/min
[2025-10-24T01:23:16.232836] [INFO ] [MAIN      ] HMN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:16.252375] [DEBUG] [LOCAL     ] HLT: Derivative data saved (139 records).
[2025-10-24T01:23:16.252572] [INFO ] [MAIN      ] HLT: Successfully saved derivative data.
[2025-10-24T01:23:16.255379] [INFO ] [MAIN      ] Derivative Progress: 942/2164 symbols completed. HLT took 1.3s. Estimated remaining: 8m 33s. Rate: 143.0 symbols/min
[2025-10-24T01:23:16.255816] [INFO ] [MAIN      ] HMY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:16.286360] [DEBUG] [LOCAL     ] HMN: Loaded 23364 existing records from primary storage.
[2025-10-24T01:23:16.287746] [INFO ] [MAIN      ] HMN: Loaded 23364 primary data records.
[2025-10-24T01:23:16.403375] [DEBUG] [LOCAL     ] HMC: Loaded 46564 existing records from primary storage.
[2025-10-24T01:23:16.419611] [INFO ] [MAIN      ] HMC: Loaded 46564 primary data records.
[2025-10-24T01:23:16.720435] [DEBUG] [LOCAL     ] HMY: Loaded 53556 existing records from primary storage.
[2025-10-24T01:23:16.738828] [INFO ] [MAIN      ] HMY: Loaded 53556 primary data records.
[2025-10-24T01:23:17.253554] [DEBUG] [MAIN      ] HMN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:17.293778] [DEBUG] [MAIN      ] HMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:17.342795] [DEBUG] [MAIN      ] HMY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:17.356293] [INFO ] [MAIN      ] HMN: Generated 139 derivative records from 23364 primary records.
[2025-10-24T01:23:17.356550] [DEBUG] [LOCAL     ] HMN: Saving derivative data.
[2025-10-24T01:23:17.376214] [DEBUG] [LOCAL     ] HMN: Derivative data saved (139 records).
[2025-10-24T01:23:17.379672] [INFO ] [MAIN      ] HMN: Successfully saved derivative data.
[2025-10-24T01:23:17.383148] [INFO ] [MAIN      ] Derivative Progress: 943/2164 symbols completed. HMN took 1.2s. Estimated remaining: 8m 33s. Rate: 142.8 symbols/min
[2025-10-24T01:23:17.396941] [INFO ] [MAIN      ] HMC: Generated 139 derivative records from 46564 primary records.
[2025-10-24T01:23:17.397103] [DEBUG] [LOCAL     ] HMC: Saving derivative data.
[2025-10-24T01:23:17.412351] [DEBUG] [LOCAL     ] HMC: Derivative data saved (139 records).
[2025-10-24T01:23:17.414757] [INFO ] [MAIN      ] HMC: Successfully saved derivative data.
[2025-10-24T01:23:17.417707] [INFO ] [MAIN      ] Derivative Progress: 944/2164 symbols completed. HMC took 1.2s. Estimated remaining: 8m 32s. Rate: 142.9 symbols/min
[2025-10-24T01:23:17.420715] [INFO ] [MAIN      ] HMY: Generated 139 derivative records from 53556 primary records.
[2025-10-24T01:23:17.420806] [DEBUG] [LOCAL     ] HMY: Saving derivative data.
[2025-10-24T01:23:17.433262] [DEBUG] [LOCAL     ] HMY: Derivative data saved (139 records).
[2025-10-24T01:23:17.433385] [INFO ] [MAIN      ] HMY: Successfully saved derivative data.
[2025-10-24T01:23:17.436529] [INFO ] [MAIN      ] Derivative Progress: 945/2164 symbols completed. HMY took 1.2s. Estimated remaining: 8m 31s. Rate: 143.0 symbols/min
[2025-10-24T01:23:17.436977] [INFO ] [MAIN      ] HNI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:17.437784] [INFO ] [MAIN      ] HOMB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:17.437892] [INFO ] [MAIN      ] HOG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:17.508098] [DEBUG] [LOCAL     ] HNI: Loaded 29986 existing records from primary storage.
[2025-10-24T01:23:17.509582] [INFO ] [MAIN      ] HNI: Loaded 29986 primary data records.
[2025-10-24T01:23:17.539184] [DEBUG] [LOCAL     ] HOMB: Loaded 44007 existing records from primary storage.
[2025-10-24T01:23:17.570040] [INFO ] [MAIN      ] HOMB: Loaded 44007 primary data records.
[2025-10-24T01:23:17.653876] [DEBUG] [LOCAL     ] HOG: Loaded 50975 existing records from primary storage.
[2025-10-24T01:23:17.718030] [INFO ] [MAIN      ] HOG: Loaded 50975 primary data records.
[2025-10-24T01:23:18.524942] [DEBUG] [MAIN      ] HNI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:18.560738] [DEBUG] [MAIN      ] HOMB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:18.596210] [DEBUG] [MAIN      ] HOG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:18.651363] [INFO ] [MAIN      ] HNI: Generated 139 derivative records from 29986 primary records.
[2025-10-24T01:23:18.653134] [DEBUG] [LOCAL     ] HNI: Saving derivative data.
[2025-10-24T01:23:18.667379] [INFO ] [MAIN      ] HOMB: Generated 139 derivative records from 44007 primary records.
[2025-10-24T01:23:18.669405] [DEBUG] [LOCAL     ] HOMB: Saving derivative data.
[2025-10-24T01:23:18.673226] [DEBUG] [LOCAL     ] HNI: Derivative data saved (139 records).
[2025-10-24T01:23:18.673364] [INFO ] [MAIN      ] HNI: Successfully saved derivative data.
[2025-10-24T01:23:18.675901] [INFO ] [MAIN      ] Derivative Progress: 946/2164 symbols completed. HNI took 1.2s. Estimated remaining: 8m 32s. Rate: 142.7 symbols/min
[2025-10-24T01:23:18.691155] [DEBUG] [LOCAL     ] HOMB: Derivative data saved (139 records).
[2025-10-24T01:23:18.691498] [INFO ] [MAIN      ] HOUS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:18.691972] [INFO ] [MAIN      ] HOG: Generated 139 derivative records from 50975 primary records.
[2025-10-24T01:23:18.692517] [INFO ] [MAIN      ] HOMB: Successfully saved derivative data.
[2025-10-24T01:23:18.695382] [INFO ] [MAIN      ] Derivative Progress: 947/2164 symbols completed. HOMB took 1.3s. Estimated remaining: 8m 31s. Rate: 142.9 symbols/min
[2025-10-24T01:23:18.695636] [INFO ] [MAIN      ] HOV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:18.695738] [DEBUG] [LOCAL     ] HOG: Saving derivative data.
[2025-10-24T01:23:18.709248] [DEBUG] [LOCAL     ] HOG: Derivative data saved (139 records).
[2025-10-24T01:23:18.709492] [INFO ] [MAIN      ] HOG: Successfully saved derivative data.
[2025-10-24T01:23:18.713099] [INFO ] [MAIN      ] Derivative Progress: 948/2164 symbols completed. HOG took 1.3s. Estimated remaining: 8m 30s. Rate: 143.0 symbols/min
[2025-10-24T01:23:18.713344] [INFO ] [MAIN      ] HP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:18.728795] [DEBUG] [LOCAL     ] HOV: Loaded 13847 existing records from primary storage.
[2025-10-24T01:23:18.728956] [INFO ] [MAIN      ] HOV: Loaded 13847 primary data records.
[2025-10-24T01:23:18.922495] [DEBUG] [LOCAL     ] HOUS: Loaded 46115 existing records from primary storage.
[2025-10-24T01:23:19.016878] [INFO ] [MAIN      ] HOUS: Loaded 46115 primary data records.
[2025-10-24T01:23:19.166860] [DEBUG] [LOCAL     ] HP: Loaded 51767 existing records from primary storage.
[2025-10-24T01:23:19.178746] [INFO ] [MAIN      ] HP: Loaded 51767 primary data records.
[2025-10-24T01:23:19.753904] [DEBUG] [MAIN      ] HOV: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:23:19.812597] [DEBUG] [MAIN      ] HOUS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:19.845900] [DEBUG] [MAIN      ] HP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:19.870104] [INFO ] [MAIN      ] HOV: Generated 139 derivative records from 13847 primary records.
[2025-10-24T01:23:19.871970] [DEBUG] [LOCAL     ] HOV: Saving derivative data.
[2025-10-24T01:23:19.889824] [DEBUG] [LOCAL     ] HOV: Derivative data saved (139 records).
[2025-10-24T01:23:19.892025] [INFO ] [MAIN      ] HOV: Successfully saved derivative data.
[2025-10-24T01:23:19.894709] [INFO ] [MAIN      ] Derivative Progress: 949/2164 symbols completed. HOV took 1.2s. Estimated remaining: 8m 31s. Rate: 142.8 symbols/min
[2025-10-24T01:23:19.894904] [INFO ] [MAIN      ] HPE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:19.927067] [INFO ] [MAIN      ] HP: Generated 139 derivative records from 51767 primary records.
[2025-10-24T01:23:19.927441] [DEBUG] [LOCAL     ] HP: Saving derivative data.
[2025-10-24T01:23:19.929903] [INFO ] [MAIN      ] HOUS: Generated 139 derivative records from 46115 primary records.
[2025-10-24T01:23:19.930711] [DEBUG] [LOCAL     ] HOUS: Saving derivative data.
[2025-10-24T01:23:19.952282] [DEBUG] [LOCAL     ] HOUS: Derivative data saved (139 records).
[2025-10-24T01:23:19.955208] [DEBUG] [LOCAL     ] HP: Derivative data saved (139 records).
[2025-10-24T01:23:19.955266] [INFO ] [MAIN      ] HOUS: Successfully saved derivative data.
[2025-10-24T01:23:19.955367] [INFO ] [MAIN      ] HP: Successfully saved derivative data.
[2025-10-24T01:23:19.957891] [INFO ] [MAIN      ] Derivative Progress: 950/2164 symbols completed. HOUS took 1.3s. Estimated remaining: 8m 30s. Rate: 142.9 symbols/min
[2025-10-24T01:23:19.961090] [INFO ] [MAIN      ] HPF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:19.975177] [INFO ] [MAIN      ] Derivative Progress: 951/2164 symbols completed. HP took 1.2s. Estimated remaining: 8m 29s. Rate: 143.0 symbols/min
[2025-10-24T01:23:19.975834] [INFO ] [MAIN      ] HPI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:20.002761] [DEBUG] [LOCAL     ] HPE: Loaded 54087 existing records from primary storage.
[2025-10-24T01:23:20.003157] [INFO ] [MAIN      ] HPE: Loaded 54087 primary data records.
[2025-10-24T01:23:20.007348] [DEBUG] [LOCAL     ] HPF: Loaded 7523 existing records from primary storage.
[2025-10-24T01:23:20.012960] [INFO ] [MAIN      ] HPF: Loaded 7523 primary data records.
[2025-10-24T01:23:20.070203] [DEBUG] [LOCAL     ] HPI: Loaded 10768 existing records from primary storage.
[2025-10-24T01:23:20.133210] [INFO ] [MAIN      ] HPI: Loaded 10768 primary data records.
[2025-10-24T01:23:20.960314] [DEBUG] [MAIN      ] HPF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:20.960580] [DEBUG] [MAIN      ] HPE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:21.005463] [DEBUG] [MAIN      ] HPI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:21.075183] [INFO ] [MAIN      ] HPE: Generated 139 derivative records from 54087 primary records.
[2025-10-24T01:23:21.078254] [DEBUG] [LOCAL     ] HPE: Saving derivative data.
[2025-10-24T01:23:21.080715] [INFO ] [MAIN      ] HPF: Generated 139 derivative records from 7523 primary records.
[2025-10-24T01:23:21.091506] [DEBUG] [LOCAL     ] HPF: Saving derivative data.
[2025-10-24T01:23:21.096009] [DEBUG] [LOCAL     ] HPE: Derivative data saved (139 records).
[2025-10-24T01:23:21.096495] [INFO ] [MAIN      ] HPE: Successfully saved derivative data.
[2025-10-24T01:23:21.100896] [INFO ] [MAIN      ] Derivative Progress: 952/2164 symbols completed. HPE took 1.2s. Estimated remaining: 8m 29s. Rate: 142.8 symbols/min
[2025-10-24T01:23:21.108686] [INFO ] [MAIN      ] HPP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:21.110892] [INFO ] [MAIN      ] HPI: Generated 139 derivative records from 10768 primary records.
[2025-10-24T01:23:21.115263] [DEBUG] [LOCAL     ] HPF: Derivative data saved (139 records).
[2025-10-24T01:23:21.115375] [INFO ] [MAIN      ] HPF: Successfully saved derivative data.
[2025-10-24T01:23:21.115454] [DEBUG] [LOCAL     ] HPI: Saving derivative data.
[2025-10-24T01:23:21.118544] [INFO ] [MAIN      ] Derivative Progress: 953/2164 symbols completed. HPF took 1.2s. Estimated remaining: 8m 28s. Rate: 142.9 symbols/min
[2025-10-24T01:23:21.119092] [INFO ] [MAIN      ] HPQ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:21.130885] [DEBUG] [LOCAL     ] HPI: Derivative data saved (139 records).
[2025-10-24T01:23:21.131160] [INFO ] [MAIN      ] HPI: Successfully saved derivative data.
[2025-10-24T01:23:21.133695] [INFO ] [MAIN      ] Derivative Progress: 954/2164 symbols completed. HPI took 1.2s. Estimated remaining: 8m 27s. Rate: 143.1 symbols/min
[2025-10-24T01:23:21.134017] [INFO ] [MAIN      ] HPS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:21.150515] [DEBUG] [LOCAL     ] HPS: Loaded 10382 existing records from primary storage.
[2025-10-24T01:23:21.150698] [INFO ] [MAIN      ] HPS: Loaded 10382 primary data records.
[2025-10-24T01:23:21.320348] [DEBUG] [LOCAL     ] HPP: Loaded 51560 existing records from primary storage.
[2025-10-24T01:23:21.350483] [INFO ] [MAIN      ] HPP: Loaded 51560 primary data records.
[2025-10-24T01:23:21.569295] [DEBUG] [LOCAL     ] HPQ: Loaded 54059 existing records from primary storage.
[2025-10-24T01:23:21.599798] [INFO ] [MAIN      ] HPQ: Loaded 54059 primary data records.
[2025-10-24T01:23:22.190078] [DEBUG] [MAIN      ] HPS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:22.240961] [DEBUG] [MAIN      ] HPP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:22.274637] [DEBUG] [MAIN      ] HPQ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:22.295042] [INFO ] [MAIN      ] HPS: Generated 139 derivative records from 10382 primary records.
[2025-10-24T01:23:22.301244] [DEBUG] [LOCAL     ] HPS: Saving derivative data.
[2025-10-24T01:23:22.319031] [DEBUG] [LOCAL     ] HPS: Derivative data saved (139 records).
[2025-10-24T01:23:22.319936] [INFO ] [MAIN      ] HPS: Successfully saved derivative data.
[2025-10-24T01:23:22.323031] [INFO ] [MAIN      ] Derivative Progress: 955/2164 symbols completed. HPS took 1.2s. Estimated remaining: 8m 28s. Rate: 142.8 symbols/min
[2025-10-24T01:23:22.323372] [INFO ] [MAIN      ] HQH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:22.347543] [INFO ] [MAIN      ] HPP: Generated 139 derivative records from 51560 primary records.
[2025-10-24T01:23:22.347887] [DEBUG] [LOCAL     ] HPP: Saving derivative data.
[2025-10-24T01:23:22.368568] [DEBUG] [LOCAL     ] HPP: Derivative data saved (139 records).
[2025-10-24T01:23:22.377939] [INFO ] [MAIN      ] HPP: Successfully saved derivative data.
[2025-10-24T01:23:22.381777] [INFO ] [MAIN      ] Derivative Progress: 956/2164 symbols completed. HPP took 1.3s. Estimated remaining: 8m 27s. Rate: 142.9 symbols/min
[2025-10-24T01:23:22.378998] [INFO ] [MAIN      ] HPQ: Generated 139 derivative records from 54059 primary records.
[2025-10-24T01:23:22.382606] [DEBUG] [LOCAL     ] HQH: Loaded 25921 existing records from primary storage.
[2025-10-24T01:23:22.382726] [INFO ] [MAIN      ] HQL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:22.382876] [DEBUG] [LOCAL     ] HPQ: Saving derivative data.
[2025-10-24T01:23:22.383082] [INFO ] [MAIN      ] HQH: Loaded 25921 primary data records.
[2025-10-24T01:23:22.439561] [DEBUG] [LOCAL     ] HPQ: Derivative data saved (139 records).
[2025-10-24T01:23:22.460284] [INFO ] [MAIN      ] HPQ: Successfully saved derivative data.
[2025-10-24T01:23:22.480424] [INFO ] [MAIN      ] Derivative Progress: 957/2164 symbols completed. HPQ took 1.4s. Estimated remaining: 8m 26s. Rate: 143.0 symbols/min
[2025-10-24T01:23:22.490572] [INFO ] [MAIN      ] HR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:22.539284] [DEBUG] [LOCAL     ] HQL: Loaded 17005 existing records from primary storage.
[2025-10-24T01:23:22.564666] [INFO ] [MAIN      ] HQL: Loaded 17005 primary data records.
[2025-10-24T01:23:23.062010] [DEBUG] [LOCAL     ] HR: Loaded 52495 existing records from primary storage.
[2025-10-24T01:23:23.063579] [INFO ] [MAIN      ] HR: Loaded 52495 primary data records.
[2025-10-24T01:23:23.109057] [DEBUG] [MAIN      ] HQH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:23.414206] [DEBUG] [MAIN      ] HQL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:23.442685] [INFO ] [MAIN      ] HQH: Generated 139 derivative records from 25921 primary records.
[2025-10-24T01:23:23.445750] [DEBUG] [LOCAL     ] HQH: Saving derivative data.
[2025-10-24T01:23:23.462417] [DEBUG] [LOCAL     ] HQH: Derivative data saved (139 records).
[2025-10-24T01:23:23.466220] [INFO ] [MAIN      ] HQH: Successfully saved derivative data.
[2025-10-24T01:23:23.471408] [INFO ] [MAIN      ] Derivative Progress: 958/2164 symbols completed. HQH took 1.1s. Estimated remaining: 8m 27s. Rate: 142.8 symbols/min
[2025-10-24T01:23:23.484704] [DEBUG] [MAIN      ] HR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:23.500589] [INFO ] [MAIN      ] HQL: Generated 139 derivative records from 17005 primary records.
[2025-10-24T01:23:23.502055] [DEBUG] [LOCAL     ] HQL: Saving derivative data.
[2025-10-24T01:23:23.520809] [DEBUG] [LOCAL     ] HQL: Derivative data saved (139 records).
[2025-10-24T01:23:23.521230] [INFO ] [MAIN      ] HQL: Successfully saved derivative data.
[2025-10-24T01:23:23.526412] [INFO ] [MAIN      ] Derivative Progress: 959/2164 symbols completed. HQL took 1.1s. Estimated remaining: 8m 26s. Rate: 143.0 symbols/min
[2025-10-24T01:23:23.537069] [INFO ] [MAIN      ] HR: Generated 139 derivative records from 52495 primary records.
[2025-10-24T01:23:23.537431] [DEBUG] [LOCAL     ] HR: Saving derivative data.
[2025-10-24T01:23:23.549599] [DEBUG] [LOCAL     ] HR: Derivative data saved (139 records).
[2025-10-24T01:23:23.549703] [INFO ] [MAIN      ] HR: Successfully saved derivative data.
[2025-10-24T01:23:23.552368] [INFO ] [MAIN      ] Derivative Progress: 960/2164 symbols completed. HR took 1.1s. Estimated remaining: 8m 25s. Rate: 143.1 symbols/min
[2025-10-24T01:23:23.552841] [INFO ] [MAIN      ] HRB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:23.552962] [INFO ] [MAIN      ] HRL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:23.552919] [INFO ] [MAIN      ] HRI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:23.626198] [DEBUG] [LOCAL     ] HRL: Loaded 53511 existing records from primary storage.
[2025-10-24T01:23:23.627984] [INFO ] [MAIN      ] HRL: Loaded 53511 primary data records.
[2025-10-24T01:23:23.700182] [DEBUG] [LOCAL     ] HRI: Loaded 32395 existing records from primary storage.
[2025-10-24T01:23:23.751948] [INFO ] [MAIN      ] HRI: Loaded 32395 primary data records.
[2025-10-24T01:23:23.756265] [DEBUG] [LOCAL     ] HRB: Loaded 48553 existing records from primary storage.
[2025-10-24T01:23:23.826482] [INFO ] [MAIN      ] HRB: Loaded 48553 primary data records.
[2025-10-24T01:23:24.618523] [DEBUG] [MAIN      ] HRI: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:23:24.618169] [DEBUG] [MAIN      ] HRL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:24.666233] [DEBUG] [MAIN      ] HRB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:24.739387] [INFO ] [MAIN      ] HRI: Generated 139 derivative records from 32395 primary records.
[2025-10-24T01:23:24.744240] [DEBUG] [LOCAL     ] HRI: Saving derivative data.
[2025-10-24T01:23:24.743679] [INFO ] [MAIN      ] HRB: Generated 139 derivative records from 48553 primary records.
[2025-10-24T01:23:24.747398] [DEBUG] [LOCAL     ] HRB: Saving derivative data.
[2025-10-24T01:23:24.747234] [INFO ] [MAIN      ] HRL: Generated 139 derivative records from 53511 primary records.
[2025-10-24T01:23:24.748530] [DEBUG] [LOCAL     ] HRL: Saving derivative data.
[2025-10-24T01:23:24.767126] [DEBUG] [LOCAL     ] HRB: Derivative data saved (139 records).
[2025-10-24T01:23:24.769390] [INFO ] [MAIN      ] HRB: Successfully saved derivative data.
[2025-10-24T01:23:24.774997] [INFO ] [MAIN      ] Derivative Progress: 961/2164 symbols completed. HRB took 1.2s. Estimated remaining: 8m 25s. Rate: 142.8 symbols/min
[2025-10-24T01:23:24.775178] [INFO ] [MAIN      ] HRTG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:24.776232] [DEBUG] [LOCAL     ] HRI: Derivative data saved (139 records).
[2025-10-24T01:23:24.783627] [INFO ] [MAIN      ] HRI: Successfully saved derivative data.
[2025-10-24T01:23:24.791348] [DEBUG] [LOCAL     ] HRL: Derivative data saved (139 records).
[2025-10-24T01:23:24.791579] [INFO ] [MAIN      ] HRL: Successfully saved derivative data.
[2025-10-24T01:23:24.789328] [INFO ] [MAIN      ] Derivative Progress: 962/2164 symbols completed. HRI took 1.2s. Estimated remaining: 8m 24s. Rate: 143.0 symbols/min
[2025-10-24T01:23:24.793924] [INFO ] [MAIN      ] HSBC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:24.794404] [INFO ] [MAIN      ] Derivative Progress: 963/2164 symbols completed. HRL took 1.2s. Estimated remaining: 8m 24s. Rate: 143.1 symbols/min
[2025-10-24T01:23:24.794607] [INFO ] [MAIN      ] HSHP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:24.820614] [DEBUG] [LOCAL     ] HSHP: Loaded 14520 existing records from primary storage.
[2025-10-24T01:23:24.821034] [INFO ] [MAIN      ] HSHP: Loaded 14520 primary data records.
[2025-10-24T01:23:24.917113] [DEBUG] [LOCAL     ] HRTG: Loaded 34749 existing records from primary storage.
[2025-10-24T01:23:24.945895] [INFO ] [MAIN      ] HRTG: Loaded 34749 primary data records.
[2025-10-24T01:23:25.180903] [DEBUG] [LOCAL     ] HSBC: Loaded 51359 existing records from primary storage.
[2025-10-24T01:23:25.336072] [INFO ] [MAIN      ] HSBC: Loaded 51359 primary data records.
[2025-10-24T01:23:25.886184] [DEBUG] [MAIN      ] HSHP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:25.923915] [DEBUG] [MAIN      ] HRTG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:25.976307] [DEBUG] [MAIN      ] HSBC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:25.993361] [INFO ] [MAIN      ] HSHP: Generated 139 derivative records from 14520 primary records.
[2025-10-24T01:23:25.996338] [DEBUG] [LOCAL     ] HSHP: Saving derivative data.
[2025-10-24T01:23:26.011487] [DEBUG] [LOCAL     ] HSHP: Derivative data saved (139 records).
[2025-10-24T01:23:26.016879] [INFO ] [MAIN      ] HSHP: Successfully saved derivative data.
[2025-10-24T01:23:26.019127] [INFO ] [MAIN      ] Derivative Progress: 964/2164 symbols completed. HSHP took 1.2s. Estimated remaining: 8m 24s. Rate: 142.8 symbols/min
[2025-10-24T01:23:26.020761] [INFO ] [MAIN      ] HSY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:26.024070] [INFO ] [MAIN      ] HRTG: Generated 139 derivative records from 34749 primary records.
[2025-10-24T01:23:26.027098] [DEBUG] [LOCAL     ] HRTG: Saving derivative data.
[2025-10-24T01:23:26.045385] [DEBUG] [LOCAL     ] HRTG: Derivative data saved (139 records).
[2025-10-24T01:23:26.048933] [INFO ] [MAIN      ] HRTG: Successfully saved derivative data.
[2025-10-24T01:23:26.052282] [INFO ] [MAIN      ] Derivative Progress: 965/2164 symbols completed. HRTG took 1.3s. Estimated remaining: 8m 23s. Rate: 143.0 symbols/min
[2025-10-24T01:23:26.052942] [INFO ] [MAIN      ] HTD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:26.055532] [INFO ] [MAIN      ] HSBC: Generated 139 derivative records from 51359 primary records.
[2025-10-24T01:23:26.055940] [DEBUG] [LOCAL     ] HSBC: Saving derivative data.
[2025-10-24T01:23:26.068701] [DEBUG] [LOCAL     ] HSBC: Derivative data saved (139 records).
[2025-10-24T01:23:26.068917] [INFO ] [MAIN      ] HSBC: Successfully saved derivative data.
[2025-10-24T01:23:26.071452] [INFO ] [MAIN      ] Derivative Progress: 966/2164 symbols completed. HSBC took 1.3s. Estimated remaining: 8m 22s. Rate: 143.1 symbols/min
[2025-10-24T01:23:26.085435] [INFO ] [MAIN      ] HTGC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:26.098556] [DEBUG] [LOCAL     ] HTD: Loaded 14322 existing records from primary storage.
[2025-10-24T01:23:26.098762] [INFO ] [MAIN      ] HTD: Loaded 14322 primary data records.
[2025-10-24T01:23:26.224583] [DEBUG] [LOCAL     ] HSY: Loaded 50734 existing records from primary storage.
[2025-10-24T01:23:26.224965] [INFO ] [MAIN      ] HSY: Loaded 50734 primary data records.
[2025-10-24T01:23:26.571078] [DEBUG] [LOCAL     ] HTGC: Loaded 48027 existing records from primary storage.
[2025-10-24T01:23:26.601949] [INFO ] [MAIN      ] HTGC: Loaded 48027 primary data records.
[2025-10-24T01:23:27.108854] [DEBUG] [MAIN      ] HTD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:27.156534] [DEBUG] [MAIN      ] HSY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:27.214174] [DEBUG] [MAIN      ] HTGC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:27.234138] [INFO ] [MAIN      ] HTD: Generated 139 derivative records from 14322 primary records.
[2025-10-24T01:23:27.239867] [DEBUG] [LOCAL     ] HTD: Saving derivative data.
[2025-10-24T01:23:27.259168] [DEBUG] [LOCAL     ] HTD: Derivative data saved (139 records).
[2025-10-24T01:23:27.259676] [INFO ] [MAIN      ] HTD: Successfully saved derivative data.
[2025-10-24T01:23:27.266364] [INFO ] [MAIN      ] Derivative Progress: 967/2164 symbols completed. HTD took 1.2s. Estimated remaining: 8m 23s. Rate: 142.8 symbols/min
[2025-10-24T01:23:27.267048] [INFO ] [MAIN      ] HTH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:27.270395] [INFO ] [MAIN      ] HSY: Generated 139 derivative records from 50734 primary records.
[2025-10-24T01:23:27.272026] [DEBUG] [LOCAL     ] HSY: Saving derivative data.
[2025-10-24T01:23:27.292225] [DEBUG] [LOCAL     ] HSY: Derivative data saved (139 records).
[2025-10-24T01:23:27.295854] [INFO ] [MAIN      ] HSY: Successfully saved derivative data.
[2025-10-24T01:23:27.300192] [INFO ] [MAIN      ] Derivative Progress: 968/2164 symbols completed. HSY took 1.3s. Estimated remaining: 8m 22s. Rate: 143.0 symbols/min
[2025-10-24T01:23:27.303383] [INFO ] [MAIN      ] HUBB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:27.316796] [INFO ] [MAIN      ] HTGC: Generated 139 derivative records from 48027 primary records.
[2025-10-24T01:23:27.316991] [DEBUG] [LOCAL     ] HTGC: Saving derivative data.
[2025-10-24T01:23:27.338528] [DEBUG] [LOCAL     ] HTH: Loaded 32621 existing records from primary storage.
[2025-10-24T01:23:27.339856] [INFO ] [MAIN      ] HTH: Loaded 32621 primary data records.
[2025-10-24T01:23:27.379946] [DEBUG] [LOCAL     ] HTGC: Derivative data saved (139 records).
[2025-10-24T01:23:27.397683] [INFO ] [MAIN      ] HTGC: Successfully saved derivative data.
[2025-10-24T01:23:27.447587] [INFO ] [MAIN      ] Derivative Progress: 969/2164 symbols completed. HTGC took 1.4s. Estimated remaining: 8m 21s. Rate: 143.1 symbols/min
[2025-10-24T01:23:27.458666] [INFO ] [MAIN      ] HUBS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:27.646238] [DEBUG] [LOCAL     ] HUBB: Loaded 36236 existing records from primary storage.
[2025-10-24T01:23:27.666941] [INFO ] [MAIN      ] HUBB: Loaded 36236 primary data records.
[2025-10-24T01:23:27.850841] [DEBUG] [LOCAL     ] HUBS: Loaded 40156 existing records from primary storage.
[2025-10-24T01:23:27.875991] [INFO ] [MAIN      ] HUBS: Loaded 40156 primary data records.
[2025-10-24T01:23:28.348244] [DEBUG] [MAIN      ] HTH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:28.403188] [DEBUG] [MAIN      ] HUBB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:28.451821] [INFO ] [MAIN      ] HTH: Generated 139 derivative records from 32621 primary records.
[2025-10-24T01:23:28.453664] [DEBUG] [LOCAL     ] HTH: Saving derivative data.
[2025-10-24T01:23:28.451667] [DEBUG] [MAIN      ] HUBS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:23:28.484068] [DEBUG] [LOCAL     ] HTH: Derivative data saved (139 records).
[2025-10-24T01:23:28.487539] [INFO ] [MAIN      ] HTH: Successfully saved derivative data.
[2025-10-24T01:23:28.491857] [INFO ] [MAIN      ] Derivative Progress: 970/2164 symbols completed. HTH took 1.2s. Estimated remaining: 8m 22s. Rate: 142.8 symbols/min
[2025-10-24T01:23:28.496535] [INFO ] [MAIN      ] HUM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:28.517099] [INFO ] [MAIN      ] HUBB: Generated 139 derivative records from 36236 primary records.
[2025-10-24T01:23:28.520887] [DEBUG] [LOCAL     ] HUBB: Saving derivative data.
[2025-10-24T01:23:28.524612] [INFO ] [MAIN      ] HUBS: Generated 139 derivative records from 40156 primary records.
[2025-10-24T01:23:28.534053] [DEBUG] [LOCAL     ] HUBS: Saving derivative data.
[2025-10-24T01:23:28.537205] [DEBUG] [LOCAL     ] HUBB: Derivative data saved (139 records).
[2025-10-24T01:23:28.544905] [INFO ] [MAIN      ] HUBB: Successfully saved derivative data.
[2025-10-24T01:23:28.552271] [DEBUG] [LOCAL     ] HUBS: Derivative data saved (139 records).
[2025-10-24T01:23:28.549399] [INFO ] [MAIN      ] Derivative Progress: 971/2164 symbols completed. HUBB took 1.2s. Estimated remaining: 8m 21s. Rate: 143.0 symbols/min
[2025-10-24T01:23:28.552869] [INFO ] [MAIN      ] HUBS: Successfully saved derivative data.
[2025-10-24T01:23:28.552557] [INFO ] [MAIN      ] HUN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:28.556293] [INFO ] [MAIN      ] Derivative Progress: 972/2164 symbols completed. HUBS took 1.1s. Estimated remaining: 8m 20s. Rate: 143.1 symbols/min
[2025-10-24T01:23:28.556705] [INFO ] [MAIN      ] HUYA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:28.592965] [DEBUG] [LOCAL     ] HUM: Loaded 49574 existing records from primary storage.
[2025-10-24T01:23:28.593457] [INFO ] [MAIN      ] HUM: Loaded 49574 primary data records.
[2025-10-24T01:23:28.930293] [DEBUG] [LOCAL     ] HUYA: Loaded 43945 existing records from primary storage.
[2025-10-24T01:23:28.930700] [INFO ] [MAIN      ] HUYA: Loaded 43945 primary data records.
[2025-10-24T01:23:28.999078] [DEBUG] [LOCAL     ] HUN: Loaded 53600 existing records from primary storage.
[2025-10-24T01:23:29.029944] [INFO ] [MAIN      ] HUN: Loaded 53600 primary data records.
[2025-10-24T01:23:29.659519] [DEBUG] [MAIN      ] HUM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:29.733717] [DEBUG] [MAIN      ] HUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:29.772321] [INFO ] [MAIN      ] HUM: Generated 139 derivative records from 49574 primary records.
[2025-10-24T01:23:29.780167] [DEBUG] [LOCAL     ] HUM: Saving derivative data.
[2025-10-24T01:23:29.820500] [DEBUG] [MAIN      ] HUN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:29.854043] [DEBUG] [LOCAL     ] HUM: Derivative data saved (139 records).
[2025-10-24T01:23:29.856907] [INFO ] [MAIN      ] HUM: Successfully saved derivative data.
[2025-10-24T01:23:29.861113] [INFO ] [MAIN      ] Derivative Progress: 973/2164 symbols completed. HUM took 1.4s. Estimated remaining: 8m 20s. Rate: 142.8 symbols/min
[2025-10-24T01:23:29.872557] [INFO ] [MAIN      ] HUYA: Generated 139 derivative records from 43945 primary records.
[2025-10-24T01:23:29.874097] [DEBUG] [LOCAL     ] HUYA: Saving derivative data.
[2025-10-24T01:23:29.899966] [DEBUG] [LOCAL     ] HUYA: Derivative data saved (139 records).
[2025-10-24T01:23:29.903106] [INFO ] [MAIN      ] HUYA: Successfully saved derivative data.
[2025-10-24T01:23:29.907242] [INFO ] [MAIN      ] Derivative Progress: 974/2164 symbols completed. HUYA took 1.4s. Estimated remaining: 8m 20s. Rate: 142.9 symbols/min
[2025-10-24T01:23:29.913312] [INFO ] [MAIN      ] HUN: Generated 139 derivative records from 53600 primary records.
[2025-10-24T01:23:29.913469] [DEBUG] [LOCAL     ] HUN: Saving derivative data.
[2025-10-24T01:23:29.926389] [DEBUG] [LOCAL     ] HUN: Derivative data saved (139 records).
[2025-10-24T01:23:29.926567] [INFO ] [MAIN      ] HUN: Successfully saved derivative data.
[2025-10-24T01:23:29.930176] [INFO ] [MAIN      ] Derivative Progress: 975/2164 symbols completed. HUN took 1.4s. Estimated remaining: 8m 19s. Rate: 143.1 symbols/min
[2025-10-24T01:23:29.930887] [INFO ] [MAIN      ] HWM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:29.930784] [INFO ] [MAIN      ] HVT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:29.931468] [INFO ] [MAIN      ] HXL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:29.957977] [DEBUG] [LOCAL     ] HVT: Loaded 14832 existing records from primary storage.
[2025-10-24T01:23:29.958427] [INFO ] [MAIN      ] HVT: Loaded 14832 primary data records.
[2025-10-24T01:23:30.198685] [DEBUG] [LOCAL     ] HXL: Loaded 46178 existing records from primary storage.
[2025-10-24T01:23:30.225201] [INFO ] [MAIN      ] HXL: Loaded 46178 primary data records.
[2025-10-24T01:23:30.239844] [DEBUG] [LOCAL     ] HWM: Loaded 53083 existing records from primary storage.
[2025-10-24T01:23:30.326520] [INFO ] [MAIN      ] HWM: Loaded 53083 primary data records.
[2025-10-24T01:23:31.066198] [DEBUG] [MAIN      ] HVT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:31.104462] [DEBUG] [MAIN      ] HXL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:31.140025] [DEBUG] [MAIN      ] HWM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:31.190365] [INFO ] [MAIN      ] HVT: Generated 139 derivative records from 14832 primary records.
[2025-10-24T01:23:31.193519] [DEBUG] [LOCAL     ] HVT: Saving derivative data.
[2025-10-24T01:23:31.213236] [INFO ] [MAIN      ] HXL: Generated 139 derivative records from 46178 primary records.
[2025-10-24T01:23:31.218322] [DEBUG] [LOCAL     ] HVT: Derivative data saved (139 records).
[2025-10-24T01:23:31.215465] [DEBUG] [LOCAL     ] HXL: Saving derivative data.
[2025-10-24T01:23:31.218674] [INFO ] [MAIN      ] HVT: Successfully saved derivative data.
[2025-10-24T01:23:31.223226] [INFO ] [MAIN      ] Derivative Progress: 976/2164 symbols completed. HVT took 1.3s. Estimated remaining: 8m 19s. Rate: 142.8 symbols/min
[2025-10-24T01:23:31.224579] [INFO ] [MAIN      ] HY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:31.236946] [DEBUG] [LOCAL     ] HXL: Derivative data saved (139 records).
[2025-10-24T01:23:31.238774] [INFO ] [MAIN      ] HXL: Successfully saved derivative data.
[2025-10-24T01:23:31.241516] [INFO ] [MAIN      ] Derivative Progress: 977/2164 symbols completed. HXL took 1.3s. Estimated remaining: 8m 18s. Rate: 142.9 symbols/min
[2025-10-24T01:23:31.241761] [INFO ] [MAIN      ] HYI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:31.246991] [INFO ] [MAIN      ] HWM: Generated 139 derivative records from 53083 primary records.
[2025-10-24T01:23:31.247256] [DEBUG] [LOCAL     ] HWM: Saving derivative data.
[2025-10-24T01:23:31.260324] [DEBUG] [LOCAL     ] HY: Loaded 9894 existing records from primary storage.
[2025-10-24T01:23:31.265109] [DEBUG] [LOCAL     ] HWM: Derivative data saved (139 records).
[2025-10-24T01:23:31.267230] [INFO ] [MAIN      ] HY: Loaded 9894 primary data records.
[2025-10-24T01:23:31.267461] [INFO ] [MAIN      ] HWM: Successfully saved derivative data.
[2025-10-24T01:23:31.291910] [INFO ] [MAIN      ] Derivative Progress: 978/2164 symbols completed. HWM took 1.4s. Estimated remaining: 8m 17s. Rate: 143.0 symbols/min
[2025-10-24T01:23:31.319186] [INFO ] [MAIN      ] HYT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:31.319584] [DEBUG] [LOCAL     ] HYI: Loaded 9666 existing records from primary storage.
[2025-10-24T01:23:31.333032] [INFO ] [MAIN      ] HYI: Loaded 9666 primary data records.
[2025-10-24T01:23:31.899622] [DEBUG] [LOCAL     ] HYT: Loaded 33782 existing records from primary storage.
[2025-10-24T01:23:31.901044] [INFO ] [MAIN      ] HYT: Loaded 33782 primary data records.
[2025-10-24T01:23:32.234365] [DEBUG] [MAIN      ] HY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:32.260692] [DEBUG] [MAIN      ] HYI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:32.319008] [DEBUG] [MAIN      ] HYT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:32.336980] [INFO ] [MAIN      ] HY: Generated 139 derivative records from 9894 primary records.
[2025-10-24T01:23:32.339710] [DEBUG] [LOCAL     ] HY: Saving derivative data.
[2025-10-24T01:23:32.354245] [DEBUG] [LOCAL     ] HY: Derivative data saved (139 records).
[2025-10-24T01:23:32.354373] [INFO ] [MAIN      ] HY: Successfully saved derivative data.
[2025-10-24T01:23:32.361699] [INFO ] [MAIN      ] Derivative Progress: 979/2164 symbols completed. HY took 1.1s. Estimated remaining: 8m 18s. Rate: 142.8 symbols/min
[2025-10-24T01:23:32.363314] [INFO ] [MAIN      ] HYTR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:32.370522] [INFO ] [MAIN      ] HYI: Generated 139 derivative records from 9666 primary records.
[2025-10-24T01:23:32.374004] [DEBUG] [LOCAL     ] HYTR: Loaded 3121 existing records from primary storage.
[2025-10-24T01:23:32.371024] [DEBUG] [LOCAL     ] HYI: Saving derivative data.
[2025-10-24T01:23:32.374476] [INFO ] [MAIN      ] HYTR: Loaded 3121 primary data records.
[2025-10-24T01:23:32.444317] [DEBUG] [LOCAL     ] HYI: Derivative data saved (139 records).
[2025-10-24T01:23:32.444601] [INFO ] [MAIN      ] HYI: Successfully saved derivative data.
[2025-10-24T01:23:32.447353] [INFO ] [MAIN      ] Derivative Progress: 980/2164 symbols completed. HYI took 1.2s. Estimated remaining: 8m 17s. Rate: 142.9 symbols/min
[2025-10-24T01:23:32.447638] [INFO ] [MAIN      ] HZO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:32.623016] [INFO ] [MAIN      ] HYT: Generated 139 derivative records from 33782 primary records.
[2025-10-24T01:23:32.723283] [DEBUG] [LOCAL     ] HYT: Saving derivative data.
[2025-10-24T01:23:32.757544] [DEBUG] [LOCAL     ] HYT: Derivative data saved (139 records).
[2025-10-24T01:23:32.757736] [INFO ] [MAIN      ] HYT: Successfully saved derivative data.
[2025-10-24T01:23:32.761352] [INFO ] [MAIN      ] Derivative Progress: 981/2164 symbols completed. HYT took 1.4s. Estimated remaining: 8m 16s. Rate: 143.0 symbols/min
[2025-10-24T01:23:32.763089] [INFO ] [MAIN      ] IAE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:32.773360] [DEBUG] [LOCAL     ] HZO: Loaded 28679 existing records from primary storage.
[2025-10-24T01:23:32.774212] [INFO ] [MAIN      ] HZO: Loaded 28679 primary data records.
[2025-10-24T01:23:32.851312] [DEBUG] [LOCAL     ] IAE: Loaded 6361 existing records from primary storage.
[2025-10-24T01:23:32.884960] [INFO ] [MAIN      ] IAE: Loaded 6361 primary data records.
[2025-10-24T01:23:33.256552] [DEBUG] [MAIN      ] HYTR: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:23:33.451309] [DEBUG] [MAIN      ] HZO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:33.453498] [INFO ] [MAIN      ] HYTR: Generated 139 derivative records from 3121 primary records.
[2025-10-24T01:23:33.465072] [DEBUG] [LOCAL     ] HYTR: Saving derivative data.
[2025-10-24T01:23:33.480856] [DEBUG] [LOCAL     ] HYTR: Derivative data saved (139 records).
[2025-10-24T01:23:33.481732] [INFO ] [MAIN      ] HYTR: Successfully saved derivative data.
[2025-10-24T01:23:33.486909] [INFO ] [MAIN      ] Derivative Progress: 982/2164 symbols completed. HYTR took 1.1s. Estimated remaining: 8m 16s. Rate: 142.9 symbols/min
[2025-10-24T01:23:33.487099] [INFO ] [MAIN      ] IAG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:33.502284] [DEBUG] [MAIN      ] IAE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:33.538338] [INFO ] [MAIN      ] HZO: Generated 139 derivative records from 28679 primary records.
[2025-10-24T01:23:33.541039] [DEBUG] [LOCAL     ] HZO: Saving derivative data.
[2025-10-24T01:23:33.588896] [DEBUG] [LOCAL     ] HZO: Derivative data saved (139 records).
[2025-10-24T01:23:33.590124] [INFO ] [MAIN      ] IAE: Generated 139 derivative records from 6361 primary records.
[2025-10-24T01:23:33.590381] [DEBUG] [LOCAL     ] IAE: Saving derivative data.
[2025-10-24T01:23:33.590493] [INFO ] [MAIN      ] HZO: Successfully saved derivative data.
[2025-10-24T01:23:33.594029] [INFO ] [MAIN      ] Derivative Progress: 983/2164 symbols completed. HZO took 1.1s. Estimated remaining: 8m 16s. Rate: 143.0 symbols/min
[2025-10-24T01:23:33.594455] [INFO ] [MAIN      ] IBM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:33.601792] [DEBUG] [LOCAL     ] IAG: Loaded 53882 existing records from primary storage.
[2025-10-24T01:23:33.603986] [INFO ] [MAIN      ] IAG: Loaded 53882 primary data records.
[2025-10-24T01:23:33.656564] [DEBUG] [LOCAL     ] IAE: Derivative data saved (139 records).
[2025-10-24T01:23:33.710441] [INFO ] [MAIN      ] IAE: Successfully saved derivative data.
[2025-10-24T01:23:33.718012] [INFO ] [MAIN      ] Derivative Progress: 984/2164 symbols completed. IAE took 1.0s. Estimated remaining: 8m 15s. Rate: 143.1 symbols/min
[2025-10-24T01:23:33.740507] [INFO ] [MAIN      ] IBN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:33.947059] [DEBUG] [LOCAL     ] IBM: Loaded 54018 existing records from primary storage.
[2025-10-24T01:23:33.949007] [INFO ] [MAIN      ] IBM: Loaded 54018 primary data records.
[2025-10-24T01:23:34.096261] [DEBUG] [MAIN      ] IAG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:34.301173] [DEBUG] [LOCAL     ] IBN: Loaded 53220 existing records from primary storage.
[2025-10-24T01:23:34.304359] [INFO ] [MAIN      ] IBN: Loaded 53220 primary data records.
[2025-10-24T01:23:34.656189] [INFO ] [MAIN      ] IAG: Generated 139 derivative records from 53882 primary records.
[2025-10-24T01:23:34.657063] [DEBUG] [LOCAL     ] IAG: Saving derivative data.
[2025-10-24T01:23:34.670283] [DEBUG] [LOCAL     ] IAG: Derivative data saved (139 records).
[2025-10-24T01:23:34.671996] [INFO ] [MAIN      ] IAG: Successfully saved derivative data.
[2025-10-24T01:23:34.677187] [INFO ] [MAIN      ] Derivative Progress: 985/2164 symbols completed. IAG took 1.2s. Estimated remaining: 8m 15s. Rate: 142.9 symbols/min
[2025-10-24T01:23:34.678514] [INFO ] [MAIN      ] IBP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:34.694124] [DEBUG] [MAIN      ] IBM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:34.735915] [DEBUG] [MAIN      ] IBN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:34.782316] [DEBUG] [LOCAL     ] IBP: Loaded 28822 existing records from primary storage.
[2025-10-24T01:23:34.783262] [INFO ] [MAIN      ] IBP: Loaded 28822 primary data records.
[2025-10-24T01:23:34.793704] [INFO ] [MAIN      ] IBM: Generated 139 derivative records from 54018 primary records.
[2025-10-24T01:23:34.801471] [DEBUG] [LOCAL     ] IBM: Saving derivative data.
[2025-10-24T01:23:34.829729] [DEBUG] [LOCAL     ] IBM: Derivative data saved (139 records).
[2025-10-24T01:23:34.829874] [INFO ] [MAIN      ] IBM: Successfully saved derivative data.
[2025-10-24T01:23:34.857630] [INFO ] [MAIN      ] Derivative Progress: 986/2164 symbols completed. IBM took 1.3s. Estimated remaining: 8m 14s. Rate: 143.0 symbols/min
[2025-10-24T01:23:34.873739] [INFO ] [MAIN      ] IBTA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:35.139629] [INFO ] [MAIN      ] IBN: Generated 139 derivative records from 53220 primary records.
[2025-10-24T01:23:35.149140] [DEBUG] [LOCAL     ] IBN: Saving derivative data.
[2025-10-24T01:23:35.163999] [DEBUG] [LOCAL     ] IBN: Derivative data saved (139 records).
[2025-10-24T01:23:35.168244] [INFO ] [MAIN      ] IBN: Successfully saved derivative data.
[2025-10-24T01:23:35.174081] [INFO ] [MAIN      ] Derivative Progress: 987/2164 symbols completed. IBN took 1.4s. Estimated remaining: 8m 14s. Rate: 143.0 symbols/min
[2025-10-24T01:23:35.190570] [INFO ] [MAIN      ] ICE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:35.194761] [DEBUG] [LOCAL     ] IBTA: Loaded 36287 existing records from primary storage.
[2025-10-24T01:23:35.195509] [INFO ] [MAIN      ] IBTA: Loaded 36287 primary data records.
[2025-10-24T01:23:35.529769] [DEBUG] [MAIN      ] IBP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:35.574407] [DEBUG] [LOCAL     ] ICE: Loaded 53399 existing records from primary storage.
[2025-10-24T01:23:35.577661] [INFO ] [MAIN      ] ICE: Loaded 53399 primary data records.
[2025-10-24T01:23:35.732383] [DEBUG] [MAIN      ] IBTA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:35.849092] [INFO ] [MAIN      ] IBP: Generated 139 derivative records from 28822 primary records.
[2025-10-24T01:23:35.914453] [DEBUG] [LOCAL     ] IBP: Saving derivative data.
[2025-10-24T01:23:35.934990] [DEBUG] [LOCAL     ] IBP: Derivative data saved (139 records).
[2025-10-24T01:23:35.938530] [INFO ] [MAIN      ] IBP: Successfully saved derivative data.
[2025-10-24T01:23:35.941672] [INFO ] [MAIN      ] Derivative Progress: 988/2164 symbols completed. IBP took 1.3s. Estimated remaining: 8m 14s. Rate: 142.9 symbols/min
[2025-10-24T01:23:35.961075] [INFO ] [MAIN      ] IBTA: Generated 139 derivative records from 36287 primary records.
[2025-10-24T01:23:35.961464] [DEBUG] [LOCAL     ] IBTA: Saving derivative data.
[2025-10-24T01:23:35.974943] [DEBUG] [LOCAL     ] IBTA: Derivative data saved (139 records).
[2025-10-24T01:23:35.975147] [INFO ] [MAIN      ] IBTA: Successfully saved derivative data.
[2025-10-24T01:23:35.978249] [INFO ] [MAIN      ] Derivative Progress: 989/2164 symbols completed. IBTA took 1.1s. Estimated remaining: 8m 13s. Rate: 143.0 symbols/min
[2025-10-24T01:23:35.995980] [DEBUG] [MAIN      ] ICE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:36.024616] [INFO ] [MAIN      ] ICE: Generated 139 derivative records from 53399 primary records.
[2025-10-24T01:23:36.024972] [DEBUG] [LOCAL     ] ICE: Saving derivative data.
[2025-10-24T01:23:36.038203] [DEBUG] [LOCAL     ] ICE: Derivative data saved (139 records).
[2025-10-24T01:23:36.038368] [INFO ] [MAIN      ] ICE: Successfully saved derivative data.
[2025-10-24T01:23:36.042924] [INFO ] [MAIN      ] Derivative Progress: 990/2164 symbols completed. ICE took 0.9s. Estimated remaining: 8m 12s. Rate: 143.1 symbols/min
[2025-10-24T01:23:36.043828] [INFO ] [MAIN      ] IDE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:36.043975] [INFO ] [MAIN      ] IDA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:36.043589] [INFO ] [MAIN      ] ICL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:36.062974] [DEBUG] [LOCAL     ] IDE: Loaded 9157 existing records from primary storage.
[2025-10-24T01:23:36.063300] [INFO ] [MAIN      ] IDE: Loaded 9157 primary data records.
[2025-10-24T01:23:36.192274] [DEBUG] [LOCAL     ] IDA: Loaded 32984 existing records from primary storage.
[2025-10-24T01:23:36.200728] [INFO ] [MAIN      ] IDA: Loaded 32984 primary data records.
[2025-10-24T01:23:36.403755] [DEBUG] [LOCAL     ] ICL: Loaded 38354 existing records from primary storage.
[2025-10-24T01:23:36.559813] [INFO ] [MAIN      ] ICL: Loaded 38354 primary data records.
[2025-10-24T01:23:37.145260] [DEBUG] [MAIN      ] IDE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:37.170482] [DEBUG] [MAIN      ] IDA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:37.219488] [DEBUG] [MAIN      ] ICL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:37.258541] [INFO ] [MAIN      ] IDE: Generated 139 derivative records from 9157 primary records.
[2025-10-24T01:23:37.259367] [DEBUG] [LOCAL     ] IDE: Saving derivative data.
[2025-10-24T01:23:37.276127] [DEBUG] [LOCAL     ] IDE: Derivative data saved (139 records).
[2025-10-24T01:23:37.277046] [INFO ] [MAIN      ] IDE: Successfully saved derivative data.
[2025-10-24T01:23:37.279810] [INFO ] [MAIN      ] Derivative Progress: 991/2164 symbols completed. IDE took 1.2s. Estimated remaining: 8m 13s. Rate: 142.9 symbols/min
[2025-10-24T01:23:37.282494] [INFO ] [MAIN      ] IDT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:37.284839] [INFO ] [MAIN      ] IDA: Generated 139 derivative records from 32984 primary records.
[2025-10-24T01:23:37.285564] [DEBUG] [LOCAL     ] IDA: Saving derivative data.
[2025-10-24T01:23:37.304361] [DEBUG] [LOCAL     ] IDA: Derivative data saved (139 records).
[2025-10-24T01:23:37.306171] [INFO ] [MAIN      ] IDA: Successfully saved derivative data.
[2025-10-24T01:23:37.308773] [INFO ] [MAIN      ] Derivative Progress: 992/2164 symbols completed. IDA took 1.3s. Estimated remaining: 8m 12s. Rate: 143.0 symbols/min
[2025-10-24T01:23:37.309008] [INFO ] [MAIN      ] IEX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:37.315303] [INFO ] [MAIN      ] ICL: Generated 139 derivative records from 38354 primary records.
[2025-10-24T01:23:37.315524] [DEBUG] [LOCAL     ] ICL: Saving derivative data.
[2025-10-24T01:23:37.328256] [DEBUG] [LOCAL     ] ICL: Derivative data saved (139 records).
[2025-10-24T01:23:37.328428] [INFO ] [MAIN      ] ICL: Successfully saved derivative data.
[2025-10-24T01:23:37.338302] [INFO ] [MAIN      ] Derivative Progress: 993/2164 symbols completed. ICL took 1.3s. Estimated remaining: 8m 11s. Rate: 143.1 symbols/min
[2025-10-24T01:23:37.339406] [DEBUG] [LOCAL     ] IDT: Loaded 18655 existing records from primary storage.
[2025-10-24T01:23:37.339736] [INFO ] [MAIN      ] IDT: Loaded 18655 primary data records.
[2025-10-24T01:23:37.338779] [INFO ] [MAIN      ] IFF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:37.492199] [DEBUG] [LOCAL     ] IEX: Loaded 38489 existing records from primary storage.
[2025-10-24T01:23:37.519744] [INFO ] [MAIN      ] IEX: Loaded 38489 primary data records.
[2025-10-24T01:23:37.821428] [DEBUG] [LOCAL     ] IFF: Loaded 51608 existing records from primary storage.
[2025-10-24T01:23:37.857721] [INFO ] [MAIN      ] IFF: Loaded 51608 primary data records.
[2025-10-24T01:23:38.312278] [DEBUG] [MAIN      ] IDT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:38.363795] [DEBUG] [MAIN      ] IEX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:38.396515] [INFO ] [MAIN      ] IDT: Generated 139 derivative records from 18655 primary records.
[2025-10-24T01:23:38.410107] [DEBUG] [MAIN      ] IFF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:38.412547] [DEBUG] [LOCAL     ] IDT: Saving derivative data.
[2025-10-24T01:23:38.446405] [DEBUG] [LOCAL     ] IDT: Derivative data saved (139 records).
[2025-10-24T01:23:38.448976] [INFO ] [MAIN      ] IDT: Successfully saved derivative data.
[2025-10-24T01:23:38.454223] [INFO ] [MAIN      ] Derivative Progress: 994/2164 symbols completed. IDT took 1.2s. Estimated remaining: 8m 11s. Rate: 142.9 symbols/min
[2025-10-24T01:23:38.460325] [INFO ] [MAIN      ] IFN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:38.465850] [INFO ] [MAIN      ] IEX: Generated 139 derivative records from 38489 primary records.
[2025-10-24T01:23:38.468478] [DEBUG] [LOCAL     ] IEX: Saving derivative data.
[2025-10-24T01:23:38.483353] [DEBUG] [LOCAL     ] IEX: Derivative data saved (139 records).
[2025-10-24T01:23:38.483602] [INFO ] [MAIN      ] IEX: Successfully saved derivative data.
[2025-10-24T01:23:38.495069] [INFO ] [MAIN      ] Derivative Progress: 995/2164 symbols completed. IEX took 1.2s. Estimated remaining: 8m 10s. Rate: 143.0 symbols/min
[2025-10-24T01:23:38.495396] [INFO ] [MAIN      ] IFS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:38.509823] [INFO ] [MAIN      ] IFF: Generated 139 derivative records from 51608 primary records.
[2025-10-24T01:23:38.511792] [DEBUG] [LOCAL     ] IFN: Loaded 18692 existing records from primary storage.
[2025-10-24T01:23:38.512080] [INFO ] [MAIN      ] IFN: Loaded 18692 primary data records.
[2025-10-24T01:23:38.512251] [DEBUG] [LOCAL     ] IFF: Saving derivative data.
[2025-10-24T01:23:38.585268] [DEBUG] [LOCAL     ] IFF: Derivative data saved (139 records).
[2025-10-24T01:23:38.610777] [INFO ] [MAIN      ] IFF: Successfully saved derivative data.
[2025-10-24T01:23:38.664402] [INFO ] [MAIN      ] Derivative Progress: 996/2164 symbols completed. IFF took 1.3s. Estimated remaining: 8m 10s. Rate: 143.1 symbols/min
[2025-10-24T01:23:38.670446] [DEBUG] [LOCAL     ] IFS: Loaded 22293 existing records from primary storage.
[2025-10-24T01:23:38.724065] [INFO ] [MAIN      ] IFS: Loaded 22293 primary data records.
[2025-10-24T01:23:38.700763] [INFO ] [MAIN      ] IGA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:39.023356] [DEBUG] [LOCAL     ] IGA: Loaded 10175 existing records from primary storage.
[2025-10-24T01:23:39.058039] [INFO ] [MAIN      ] IGA: Loaded 10175 primary data records.
[2025-10-24T01:23:39.559175] [DEBUG] [MAIN      ] IFN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:39.598239] [DEBUG] [MAIN      ] IFS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:39.659362] [DEBUG] [MAIN      ] IGA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:39.685438] [INFO ] [MAIN      ] IFN: Generated 139 derivative records from 18692 primary records.
[2025-10-24T01:23:39.686318] [DEBUG] [LOCAL     ] IFN: Saving derivative data.
[2025-10-24T01:23:39.695209] [INFO ] [MAIN      ] IFS: Generated 139 derivative records from 22293 primary records.
[2025-10-24T01:23:39.709530] [DEBUG] [LOCAL     ] IFN: Derivative data saved (139 records).
[2025-10-24T01:23:39.706588] [DEBUG] [LOCAL     ] IFS: Saving derivative data.
[2025-10-24T01:23:39.709809] [INFO ] [MAIN      ] IFN: Successfully saved derivative data.
[2025-10-24T01:23:39.715524] [INFO ] [MAIN      ] Derivative Progress: 997/2164 symbols completed. IFN took 1.3s. Estimated remaining: 8m 10s. Rate: 142.9 symbols/min
[2025-10-24T01:23:39.728087] [DEBUG] [LOCAL     ] IFS: Derivative data saved (139 records).
[2025-10-24T01:23:39.728619] [INFO ] [MAIN      ] IFS: Successfully saved derivative data.
[2025-10-24T01:23:39.728754] [INFO ] [MAIN      ] IGD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:39.736131] [INFO ] [MAIN      ] Derivative Progress: 998/2164 symbols completed. IFS took 1.2s. Estimated remaining: 8m 9s. Rate: 143.0 symbols/min
[2025-10-24T01:23:39.736770] [INFO ] [MAIN      ] IGI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:39.756939] [INFO ] [MAIN      ] IGA: Generated 139 derivative records from 10175 primary records.
[2025-10-24T01:23:39.757359] [DEBUG] [LOCAL     ] IGI: Loaded 4171 existing records from primary storage.
[2025-10-24T01:23:39.757728] [DEBUG] [LOCAL     ] IGA: Saving derivative data.
[2025-10-24T01:23:39.757800] [INFO ] [MAIN      ] IGI: Loaded 4171 primary data records.
[2025-10-24T01:23:39.843396] [DEBUG] [LOCAL     ] IGA: Derivative data saved (139 records).
[2025-10-24T01:23:39.866239] [INFO ] [MAIN      ] IGA: Successfully saved derivative data.
[2025-10-24T01:23:39.897936] [INFO ] [MAIN      ] Derivative Progress: 999/2164 symbols completed. IGA took 1.2s. Estimated remaining: 8m 8s. Rate: 143.1 symbols/min
[2025-10-24T01:23:39.921931] [INFO ] [MAIN      ] IGR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:39.921712] [DEBUG] [LOCAL     ] IGD: Loaded 19340 existing records from primary storage.
[2025-10-24T01:23:39.938414] [INFO ] [MAIN      ] IGD: Loaded 19340 primary data records.
[2025-10-24T01:23:40.473828] [DEBUG] [LOCAL     ] IGR: Loaded 30712 existing records from primary storage.
[2025-10-24T01:23:40.482705] [INFO ] [MAIN      ] IGR: Loaded 30712 primary data records.
[2025-10-24T01:23:40.865160] [DEBUG] [MAIN      ] IGI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:40.908629] [DEBUG] [MAIN      ] IGD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:40.957295] [DEBUG] [MAIN      ] IGR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:40.979156] [INFO ] [MAIN      ] IGI: Generated 139 derivative records from 4171 primary records.
[2025-10-24T01:23:40.984713] [DEBUG] [LOCAL     ] IGI: Saving derivative data.
[2025-10-24T01:23:41.001037] [DEBUG] [LOCAL     ] IGI: Derivative data saved (139 records).
[2025-10-24T01:23:41.004008] [INFO ] [MAIN      ] IGI: Successfully saved derivative data.
[2025-10-24T01:23:41.006926] [INFO ] [MAIN      ] Derivative Progress: 1000/2164 symbols completed. IGI took 1.3s. Estimated remaining: 8m 9s. Rate: 142.9 symbols/min
[2025-10-24T01:23:41.008154] [INFO ] [MAIN      ] IH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:41.023824] [DEBUG] [LOCAL     ] IH: Loaded 2735 existing records from primary storage.
[2025-10-24T01:23:41.026790] [INFO ] [MAIN      ] IH: Loaded 2735 primary data records.
[2025-10-24T01:23:41.111620] [INFO ] [MAIN      ] IGR: Generated 139 derivative records from 30712 primary records.
[2025-10-24T01:23:41.129077] [DEBUG] [LOCAL     ] IGR: Saving derivative data.
[2025-10-24T01:23:41.111960] [INFO ] [MAIN      ] IGD: Generated 139 derivative records from 19340 primary records.
[2025-10-24T01:23:41.142624] [DEBUG] [LOCAL     ] IGD: Saving derivative data.
[2025-10-24T01:23:41.175321] [DEBUG] [LOCAL     ] IGR: Derivative data saved (139 records).
[2025-10-24T01:23:41.185706] [INFO ] [MAIN      ] IGR: Successfully saved derivative data.
[2025-10-24T01:23:41.195261] [INFO ] [MAIN      ] Derivative Progress: 1001/2164 symbols completed. IGR took 1.3s. Estimated remaining: 8m 8s. Rate: 143.0 symbols/min
[2025-10-24T01:23:41.208970] [INFO ] [MAIN      ] IHD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:41.242141] [DEBUG] [LOCAL     ] IGD: Derivative data saved (139 records).
[2025-10-24T01:23:41.243576] [INFO ] [MAIN      ] IGD: Successfully saved derivative data.
[2025-10-24T01:23:41.250066] [INFO ] [MAIN      ] Derivative Progress: 1002/2164 symbols completed. IGD took 1.5s. Estimated remaining: 8m 7s. Rate: 143.1 symbols/min
[2025-10-24T01:23:41.250242] [INFO ] [MAIN      ] IHG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:41.372407] [DEBUG] [LOCAL     ] IHD: Loaded 7400 existing records from primary storage.
[2025-10-24T01:23:41.372839] [INFO ] [MAIN      ] IHD: Loaded 7400 primary data records.
[2025-10-24T01:23:41.540451] [DEBUG] [LOCAL     ] IHG: Loaded 24115 existing records from primary storage.
[2025-10-24T01:23:41.678515] [INFO ] [MAIN      ] IHG: Loaded 24115 primary data records.
[2025-10-24T01:23:41.874000] [DEBUG] [MAIN      ] IH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:42.042165] [DEBUG] [MAIN      ] IHD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:42.102824] [INFO ] [MAIN      ] IH: Generated 139 derivative records from 2735 primary records.
[2025-10-24T01:23:42.103605] [DEBUG] [LOCAL     ] IH: Saving derivative data.
[2025-10-24T01:23:42.104569] [DEBUG] [MAIN      ] IHG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:42.130941] [DEBUG] [LOCAL     ] IH: Derivative data saved (139 records).
[2025-10-24T01:23:42.131112] [INFO ] [MAIN      ] IH: Successfully saved derivative data.
[2025-10-24T01:23:42.133920] [INFO ] [MAIN      ] Derivative Progress: 1003/2164 symbols completed. IH took 1.1s. Estimated remaining: 8m 7s. Rate: 142.9 symbols/min
[2025-10-24T01:23:42.154583] [INFO ] [MAIN      ] IHD: Generated 139 derivative records from 7400 primary records.
[2025-10-24T01:23:42.155280] [DEBUG] [LOCAL     ] IHD: Saving derivative data.
[2025-10-24T01:23:42.173101] [DEBUG] [LOCAL     ] IHD: Derivative data saved (139 records).
[2025-10-24T01:23:42.176116] [INFO ] [MAIN      ] IHD: Successfully saved derivative data.
[2025-10-24T01:23:42.179616] [INFO ] [MAIN      ] Derivative Progress: 1004/2164 symbols completed. IHD took 1.0s. Estimated remaining: 8m 7s. Rate: 143.0 symbols/min
[2025-10-24T01:23:42.182833] [INFO ] [MAIN      ] IHG: Generated 139 derivative records from 24115 primary records.
[2025-10-24T01:23:42.182962] [DEBUG] [LOCAL     ] IHG: Saving derivative data.
[2025-10-24T01:23:42.195322] [DEBUG] [LOCAL     ] IHG: Derivative data saved (139 records).
[2025-10-24T01:23:42.195405] [INFO ] [MAIN      ] IHG: Successfully saved derivative data.
[2025-10-24T01:23:42.198364] [INFO ] [MAIN      ] Derivative Progress: 1005/2164 symbols completed. IHG took 0.9s. Estimated remaining: 8m 6s. Rate: 143.2 symbols/min
[2025-10-24T01:23:42.199060] [INFO ] [MAIN      ] IIIN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:42.198992] [INFO ] [MAIN      ] IHS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:42.199491] [INFO ] [MAIN      ] IIF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:42.212520] [DEBUG] [LOCAL     ] IIF: Loaded 5300 existing records from primary storage.
[2025-10-24T01:23:42.212818] [INFO ] [MAIN      ] IIF: Loaded 5300 primary data records.
[2025-10-24T01:23:42.343003] [DEBUG] [LOCAL     ] IIIN: Loaded 16364 existing records from primary storage.
[2025-10-24T01:23:42.343716] [INFO ] [MAIN      ] IIIN: Loaded 16364 primary data records.
[2025-10-24T01:23:42.391821] [DEBUG] [LOCAL     ] IHS: Loaded 37440 existing records from primary storage.
[2025-10-24T01:23:42.420421] [INFO ] [MAIN      ] IHS: Loaded 37440 primary data records.
[2025-10-24T01:23:43.216941] [DEBUG] [MAIN      ] IIF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:43.256951] [DEBUG] [MAIN      ] IIIN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:43.310770] [DEBUG] [MAIN      ] IHS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:43.343019] [INFO ] [MAIN      ] IIF: Generated 139 derivative records from 5300 primary records.
[2025-10-24T01:23:43.347003] [DEBUG] [LOCAL     ] IIF: Saving derivative data.
[2025-10-24T01:23:43.372131] [DEBUG] [LOCAL     ] IIF: Derivative data saved (139 records).
[2025-10-24T01:23:43.373155] [INFO ] [MAIN      ] IIF: Successfully saved derivative data.
[2025-10-24T01:23:43.379607] [INFO ] [MAIN      ] Derivative Progress: 1006/2164 symbols completed. IIF took 1.2s. Estimated remaining: 8m 6s. Rate: 142.9 symbols/min
[2025-10-24T01:23:43.380926] [INFO ] [MAIN      ] IIM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:43.387341] [INFO ] [MAIN      ] IIIN: Generated 139 derivative records from 16364 primary records.
[2025-10-24T01:23:43.389168] [DEBUG] [LOCAL     ] IIIN: Saving derivative data.
[2025-10-24T01:23:43.411590] [DEBUG] [LOCAL     ] IIIN: Derivative data saved (139 records).
[2025-10-24T01:23:43.413089] [INFO ] [MAIN      ] IIIN: Successfully saved derivative data.
[2025-10-24T01:23:43.418086] [INFO ] [MAIN      ] Derivative Progress: 1007/2164 symbols completed. IIIN took 1.2s. Estimated remaining: 8m 5s. Rate: 143.1 symbols/min
[2025-10-24T01:23:43.418791] [INFO ] [MAIN      ] IIPR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:43.428358] [INFO ] [MAIN      ] IHS: Generated 139 derivative records from 37440 primary records.
[2025-10-24T01:23:43.428591] [DEBUG] [LOCAL     ] IHS: Saving derivative data.
[2025-10-24T01:23:43.430160] [DEBUG] [LOCAL     ] IIM: Loaded 15593 existing records from primary storage.
[2025-10-24T01:23:43.431039] [INFO ] [MAIN      ] IIM: Loaded 15593 primary data records.
[2025-10-24T01:23:43.561808] [DEBUG] [LOCAL     ] IHS: Derivative data saved (139 records).
[2025-10-24T01:23:43.583611] [INFO ] [MAIN      ] IHS: Successfully saved derivative data.
[2025-10-24T01:23:43.609275] [INFO ] [MAIN      ] Derivative Progress: 1008/2164 symbols completed. IHS took 1.4s. Estimated remaining: 8m 5s. Rate: 143.1 symbols/min
[2025-10-24T01:23:43.783968] [INFO ] [MAIN      ] IMAX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:43.785765] [DEBUG] [LOCAL     ] IIPR: Loaded 29025 existing records from primary storage.
[2025-10-24T01:23:43.786610] [INFO ] [MAIN      ] IIPR: Loaded 29025 primary data records.
[2025-10-24T01:23:44.151849] [DEBUG] [MAIN      ] IIM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:44.165229] [DEBUG] [LOCAL     ] IMAX: Loaded 43819 existing records from primary storage.
[2025-10-24T01:23:44.169838] [INFO ] [MAIN      ] IMAX: Loaded 43819 primary data records.
[2025-10-24T01:23:44.542963] [DEBUG] [MAIN      ] IIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:44.583583] [INFO ] [MAIN      ] IIM: Generated 139 derivative records from 15593 primary records.
[2025-10-24T01:23:44.585765] [DEBUG] [LOCAL     ] IIM: Saving derivative data.
[2025-10-24T01:23:44.607904] [DEBUG] [LOCAL     ] IIM: Derivative data saved (139 records).
[2025-10-24T01:23:44.608303] [INFO ] [MAIN      ] IIM: Successfully saved derivative data.
[2025-10-24T01:23:44.611439] [INFO ] [MAIN      ] Derivative Progress: 1009/2164 symbols completed. IIM took 1.2s. Estimated remaining: 8m 5s. Rate: 142.9 symbols/min
[2025-10-24T01:23:44.611708] [INFO ] [MAIN      ] INFA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:44.628904] [INFO ] [MAIN      ] IIPR: Generated 139 derivative records from 29025 primary records.
[2025-10-24T01:23:44.643162] [DEBUG] [LOCAL     ] IIPR: Saving derivative data.
[2025-10-24T01:23:44.642877] [DEBUG] [MAIN      ] IMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:44.672473] [DEBUG] [LOCAL     ] IIPR: Derivative data saved (139 records).
[2025-10-24T01:23:44.686375] [INFO ] [MAIN      ] IIPR: Successfully saved derivative data.
[2025-10-24T01:23:44.694308] [INFO ] [MAIN      ] Derivative Progress: 1010/2164 symbols completed. IIPR took 1.3s. Estimated remaining: 8m 4s. Rate: 143.0 symbols/min
[2025-10-24T01:23:44.694749] [INFO ] [MAIN      ] INFY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:44.720907] [DEBUG] [LOCAL     ] INFA: Loaded 48954 existing records from primary storage.
[2025-10-24T01:23:44.724433] [INFO ] [MAIN      ] INFA: Loaded 48954 primary data records.
[2025-10-24T01:23:44.869357] [INFO ] [MAIN      ] IMAX: Generated 139 derivative records from 43819 primary records.
[2025-10-24T01:23:44.886469] [DEBUG] [LOCAL     ] IMAX: Saving derivative data.
[2025-10-24T01:23:45.149824] [DEBUG] [LOCAL     ] IMAX: Derivative data saved (139 records).
[2025-10-24T01:23:45.152436] [DEBUG] [LOCAL     ] INFY: Loaded 53986 existing records from primary storage.
[2025-10-24T01:23:45.152785] [INFO ] [MAIN      ] IMAX: Successfully saved derivative data.
[2025-10-24T01:23:45.152927] [INFO ] [MAIN      ] INFY: Loaded 53986 primary data records.
[2025-10-24T01:23:45.156200] [INFO ] [MAIN      ] Derivative Progress: 1011/2164 symbols completed. IMAX took 1.4s. Estimated remaining: 8m 4s. Rate: 143.0 symbols/min
[2025-10-24T01:23:45.156801] [INFO ] [MAIN      ] ING: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:45.495834] [DEBUG] [MAIN      ] INFA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:45.528925] [DEBUG] [LOCAL     ] ING: Loaded 51066 existing records from primary storage.
[2025-10-24T01:23:45.529771] [INFO ] [MAIN      ] ING: Loaded 51066 primary data records.
[2025-10-24T01:23:45.821483] [DEBUG] [MAIN      ] INFY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:45.926558] [INFO ] [MAIN      ] INFA: Generated 139 derivative records from 48954 primary records.
[2025-10-24T01:23:45.927481] [DEBUG] [LOCAL     ] INFA: Saving derivative data.
[2025-10-24T01:23:45.943530] [DEBUG] [LOCAL     ] INFA: Derivative data saved (139 records).
[2025-10-24T01:23:45.947214] [INFO ] [MAIN      ] INFA: Successfully saved derivative data.
[2025-10-24T01:23:45.950997] [INFO ] [MAIN      ] Derivative Progress: 1012/2164 symbols completed. INFA took 1.3s. Estimated remaining: 8m 4s. Rate: 142.9 symbols/min
[2025-10-24T01:23:45.952349] [INFO ] [MAIN      ] INGM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:45.974857] [INFO ] [MAIN      ] INFY: Generated 139 derivative records from 53986 primary records.
[2025-10-24T01:23:45.975934] [DEBUG] [MAIN      ] ING: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:45.976378] [DEBUG] [LOCAL     ] INFY: Saving derivative data.
[2025-10-24T01:23:46.010366] [DEBUG] [LOCAL     ] INFY: Derivative data saved (139 records).
[2025-10-24T01:23:46.019434] [INFO ] [MAIN      ] INFY: Successfully saved derivative data.
[2025-10-24T01:23:46.023317] [INFO ] [MAIN      ] Derivative Progress: 1013/2164 symbols completed. INFY took 1.3s. Estimated remaining: 8m 3s. Rate: 143.0 symbols/min
[2025-10-24T01:23:46.026396] [INFO ] [MAIN      ] INGR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:46.041818] [DEBUG] [LOCAL     ] INGM: Loaded 28324 existing records from primary storage.
[2025-10-24T01:23:46.043594] [INFO ] [MAIN      ] INGM: Loaded 28324 primary data records.
[2025-10-24T01:23:46.151896] [INFO ] [MAIN      ] ING: Generated 139 derivative records from 51066 primary records.
[2025-10-24T01:23:46.177262] [DEBUG] [LOCAL     ] ING: Saving derivative data.
[2025-10-24T01:23:46.221573] [DEBUG] [LOCAL     ] INGR: Loaded 34005 existing records from primary storage.
[2025-10-24T01:23:46.241839] [INFO ] [MAIN      ] INGR: Loaded 34005 primary data records.
[2025-10-24T01:23:46.459029] [DEBUG] [LOCAL     ] ING: Derivative data saved (139 records).
[2025-10-24T01:23:46.509471] [INFO ] [MAIN      ] ING: Successfully saved derivative data.
[2025-10-24T01:23:46.512899] [INFO ] [MAIN      ] Derivative Progress: 1014/2164 symbols completed. ING took 1.4s. Estimated remaining: 8m 3s. Rate: 143.0 symbols/min
[2025-10-24T01:23:46.518813] [INFO ] [MAIN      ] INN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:46.739332] [DEBUG] [MAIN      ] INGM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:46.775598] [DEBUG] [LOCAL     ] INN: Loaded 41707 existing records from primary storage.
[2025-10-24T01:23:46.776103] [INFO ] [MAIN      ] INN: Loaded 41707 primary data records.
[2025-10-24T01:23:46.981354] [DEBUG] [MAIN      ] INGR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:47.130881] [INFO ] [MAIN      ] INGM: Generated 139 derivative records from 28324 primary records.
[2025-10-24T01:23:47.132950] [DEBUG] [LOCAL     ] INGM: Saving derivative data.
[2025-10-24T01:23:47.156519] [DEBUG] [LOCAL     ] INGM: Derivative data saved (139 records).
[2025-10-24T01:23:47.156735] [INFO ] [MAIN      ] INGM: Successfully saved derivative data.
[2025-10-24T01:23:47.159136] [INFO ] [MAIN      ] Derivative Progress: 1015/2164 symbols completed. INGM took 1.2s. Estimated remaining: 8m 2s. Rate: 142.9 symbols/min
[2025-10-24T01:23:47.160418] [INFO ] [MAIN      ] INSP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:47.192848] [INFO ] [MAIN      ] INGR: Generated 139 derivative records from 34005 primary records.
[2025-10-24T01:23:47.193435] [DEBUG] [LOCAL     ] INGR: Saving derivative data.
[2025-10-24T01:23:47.193905] [DEBUG] [MAIN      ] INN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:47.231094] [DEBUG] [LOCAL     ] INGR: Derivative data saved (139 records).
[2025-10-24T01:23:47.243473] [INFO ] [MAIN      ] INGR: Successfully saved derivative data.
[2025-10-24T01:23:47.244805] [DEBUG] [LOCAL     ] INSP: Loaded 38813 existing records from primary storage.
[2025-10-24T01:23:47.247853] [INFO ] [MAIN      ] Derivative Progress: 1016/2164 symbols completed. INGR took 1.2s. Estimated remaining: 8m 2s. Rate: 143.0 symbols/min
[2025-10-24T01:23:47.249033] [INFO ] [MAIN      ] INSW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:47.248443] [INFO ] [MAIN      ] INSP: Loaded 38813 primary data records.
[2025-10-24T01:23:47.663639] [INFO ] [MAIN      ] INN: Generated 139 derivative records from 41707 primary records.
[2025-10-24T01:23:47.695069] [DEBUG] [LOCAL     ] INN: Saving derivative data.
[2025-10-24T01:23:47.698065] [DEBUG] [LOCAL     ] INSW: Loaded 39476 existing records from primary storage.
[2025-10-24T01:23:47.711823] [DEBUG] [LOCAL     ] INN: Derivative data saved (139 records).
[2025-10-24T01:23:47.708774] [INFO ] [MAIN      ] INSW: Loaded 39476 primary data records.
[2025-10-24T01:23:47.712195] [INFO ] [MAIN      ] INN: Successfully saved derivative data.
[2025-10-24T01:23:47.737889] [INFO ] [MAIN      ] Derivative Progress: 1017/2164 symbols completed. INN took 1.2s. Estimated remaining: 8m 1s. Rate: 143.0 symbols/min
[2025-10-24T01:23:47.787935] [INFO ] [MAIN      ] INVH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:48.055129] [DEBUG] [MAIN      ] INSP: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:23:48.091508] [DEBUG] [LOCAL     ] INVH: Loaded 53583 existing records from primary storage.
[2025-10-24T01:23:48.095310] [INFO ] [MAIN      ] INVH: Loaded 53583 primary data records.
[2025-10-24T01:23:48.427596] [DEBUG] [MAIN      ] INSW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:48.456677] [INFO ] [MAIN      ] INSP: Generated 139 derivative records from 38813 primary records.
[2025-10-24T01:23:48.460595] [DEBUG] [LOCAL     ] INSP: Saving derivative data.
[2025-10-24T01:23:48.480515] [DEBUG] [LOCAL     ] INSP: Derivative data saved (139 records).
[2025-10-24T01:23:48.483839] [INFO ] [MAIN      ] INSP: Successfully saved derivative data.
[2025-10-24T01:23:48.486811] [INFO ] [MAIN      ] Derivative Progress: 1018/2164 symbols completed. INSP took 1.3s. Estimated remaining: 8m 1s. Rate: 142.9 symbols/min
[2025-10-24T01:23:48.494266] [INFO ] [MAIN      ] INSW: Generated 139 derivative records from 39476 primary records.
[2025-10-24T01:23:48.494459] [DEBUG] [LOCAL     ] INSW: Saving derivative data.
[2025-10-24T01:23:48.520820] [DEBUG] [LOCAL     ] INSW: Derivative data saved (139 records).
[2025-10-24T01:23:48.521169] [INFO ] [MAIN      ] INSW: Successfully saved derivative data.
[2025-10-24T01:23:48.521028] [DEBUG] [MAIN      ] INVH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:48.523774] [INFO ] [MAIN      ] Derivative Progress: 1019/2164 symbols completed. INSW took 1.3s. Estimated remaining: 8m 0s. Rate: 143.0 symbols/min
[2025-10-24T01:23:48.549361] [INFO ] [MAIN      ] INVH: Generated 139 derivative records from 53583 primary records.
[2025-10-24T01:23:48.549487] [DEBUG] [LOCAL     ] INVH: Saving derivative data.
[2025-10-24T01:23:48.561147] [DEBUG] [LOCAL     ] INVH: Derivative data saved (139 records).
[2025-10-24T01:23:48.561238] [INFO ] [MAIN      ] INVH: Successfully saved derivative data.
[2025-10-24T01:23:48.564091] [INFO ] [MAIN      ] Derivative Progress: 1020/2164 symbols completed. INVH took 0.8s. Estimated remaining: 7m 59s. Rate: 143.2 symbols/min
[2025-10-24T01:23:48.564549] [INFO ] [MAIN      ] INVX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:48.564703] [INFO ] [MAIN      ] IOT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:48.564746] [INFO ] [MAIN      ] IONQ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:48.617106] [DEBUG] [LOCAL     ] INVX: Loaded 29267 existing records from primary storage.
[2025-10-24T01:23:48.617420] [INFO ] [MAIN      ] INVX: Loaded 29267 primary data records.
[2025-10-24T01:23:48.752449] [DEBUG] [LOCAL     ] IOT: Loaded 53849 existing records from primary storage.
[2025-10-24T01:23:48.757628] [INFO ] [MAIN      ] IOT: Loaded 53849 primary data records.
[2025-10-24T01:23:48.816305] [DEBUG] [LOCAL     ] IONQ: Loaded 54178 existing records from primary storage.
[2025-10-24T01:23:48.845333] [INFO ] [MAIN      ] IONQ: Loaded 54178 primary data records.
[2025-10-24T01:23:49.702778] [DEBUG] [MAIN      ] INVX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:49.740907] [DEBUG] [MAIN      ] IOT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:49.783900] [DEBUG] [MAIN      ] IONQ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:49.825508] [INFO ] [MAIN      ] INVX: Generated 139 derivative records from 29267 primary records.
[2025-10-24T01:23:49.832549] [DEBUG] [LOCAL     ] INVX: Saving derivative data.
[2025-10-24T01:23:49.851507] [DEBUG] [LOCAL     ] INVX: Derivative data saved (139 records).
[2025-10-24T01:23:49.853681] [INFO ] [MAIN      ] INVX: Successfully saved derivative data.
[2025-10-24T01:23:49.861925] [INFO ] [MAIN      ] IOT: Generated 139 derivative records from 53849 primary records.
[2025-10-24T01:23:49.858266] [INFO ] [MAIN      ] Derivative Progress: 1021/2164 symbols completed. INVX took 1.3s. Estimated remaining: 8m 0s. Rate: 142.9 symbols/min
[2025-10-24T01:23:49.863859] [DEBUG] [LOCAL     ] IOT: Saving derivative data.
[2025-10-24T01:23:49.863990] [INFO ] [MAIN      ] IP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:49.868364] [INFO ] [MAIN      ] IONQ: Generated 139 derivative records from 54178 primary records.
[2025-10-24T01:23:49.868685] [DEBUG] [LOCAL     ] IONQ: Saving derivative data.
[2025-10-24T01:23:49.890094] [DEBUG] [LOCAL     ] IOT: Derivative data saved (139 records).
[2025-10-24T01:23:49.896225] [DEBUG] [LOCAL     ] IONQ: Derivative data saved (139 records).
[2025-10-24T01:23:49.896528] [INFO ] [MAIN      ] IOT: Successfully saved derivative data.
[2025-10-24T01:23:49.896770] [INFO ] [MAIN      ] IONQ: Successfully saved derivative data.
[2025-10-24T01:23:49.899459] [INFO ] [MAIN      ] Derivative Progress: 1022/2164 symbols completed. IOT took 1.3s. Estimated remaining: 7m 59s. Rate: 143.0 symbols/min
[2025-10-24T01:23:49.903030] [INFO ] [MAIN      ] Derivative Progress: 1023/2164 symbols completed. IONQ took 1.3s. Estimated remaining: 7m 58s. Rate: 143.1 symbols/min
[2025-10-24T01:23:49.903337] [INFO ] [MAIN      ] IPI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:49.902936] [INFO ] [MAIN      ] IPG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:49.960529] [DEBUG] [LOCAL     ] IPI: Loaded 21531 existing records from primary storage.
[2025-10-24T01:23:49.960827] [INFO ] [MAIN      ] IPI: Loaded 21531 primary data records.
[2025-10-24T01:23:49.994311] [DEBUG] [LOCAL     ] IP: Loaded 53690 existing records from primary storage.
[2025-10-24T01:23:50.033076] [INFO ] [MAIN      ] IP: Loaded 53690 primary data records.
[2025-10-24T01:23:50.355710] [DEBUG] [LOCAL     ] IPG: Loaded 53720 existing records from primary storage.
[2025-10-24T01:23:50.479257] [INFO ] [MAIN      ] IPG: Loaded 53720 primary data records.
[2025-10-24T01:23:50.946871] [DEBUG] [MAIN      ] IP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:50.946571] [DEBUG] [MAIN      ] IPI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:51.009513] [DEBUG] [MAIN      ] IPG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:51.053852] [INFO ] [MAIN      ] IP: Generated 139 derivative records from 53690 primary records.
[2025-10-24T01:23:51.056050] [DEBUG] [LOCAL     ] IP: Saving derivative data.
[2025-10-24T01:23:51.059430] [INFO ] [MAIN      ] IPI: Generated 139 derivative records from 21531 primary records.
[2025-10-24T01:23:51.070699] [DEBUG] [LOCAL     ] IPI: Saving derivative data.
[2025-10-24T01:23:51.071616] [DEBUG] [LOCAL     ] IP: Derivative data saved (139 records).
[2025-10-24T01:23:51.072669] [INFO ] [MAIN      ] IP: Successfully saved derivative data.
[2025-10-24T01:23:51.084533] [INFO ] [MAIN      ] Derivative Progress: 1024/2164 symbols completed. IP took 1.2s. Estimated remaining: 7m 59s. Rate: 142.9 symbols/min
[2025-10-24T01:23:51.084862] [INFO ] [MAIN      ] IQI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:51.091468] [DEBUG] [LOCAL     ] IPI: Derivative data saved (139 records).
[2025-10-24T01:23:51.092077] [INFO ] [MAIN      ] IPI: Successfully saved derivative data.
[2025-10-24T01:23:51.094563] [INFO ] [MAIN      ] Derivative Progress: 1025/2164 symbols completed. IPI took 1.2s. Estimated remaining: 7m 58s. Rate: 143.0 symbols/min
[2025-10-24T01:23:51.096389] [INFO ] [MAIN      ] IQV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:51.107511] [INFO ] [MAIN      ] IPG: Generated 139 derivative records from 53720 primary records.
[2025-10-24T01:23:51.107860] [DEBUG] [LOCAL     ] IPG: Saving derivative data.
[2025-10-24T01:23:51.125897] [DEBUG] [LOCAL     ] IQI: Loaded 17831 existing records from primary storage.
[2025-10-24T01:23:51.126321] [INFO ] [MAIN      ] IQI: Loaded 17831 primary data records.
[2025-10-24T01:23:51.141615] [DEBUG] [LOCAL     ] IPG: Derivative data saved (139 records).
[2025-10-24T01:23:51.176286] [INFO ] [MAIN      ] IPG: Successfully saved derivative data.
[2025-10-24T01:23:51.185340] [INFO ] [MAIN      ] Derivative Progress: 1026/2164 symbols completed. IPG took 1.3s. Estimated remaining: 7m 57s. Rate: 143.1 symbols/min
[2025-10-24T01:23:51.185615] [INFO ] [MAIN      ] IR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:51.470774] [DEBUG] [LOCAL     ] IQV: Loaded 50338 existing records from primary storage.
[2025-10-24T01:23:51.471267] [INFO ] [MAIN      ] IQV: Loaded 50338 primary data records.
[2025-10-24T01:23:51.858821] [DEBUG] [LOCAL     ] IR: Loaded 53119 existing records from primary storage.
[2025-10-24T01:23:51.859504] [INFO ] [MAIN      ] IR: Loaded 53119 primary data records.
[2025-10-24T01:23:52.016726] [DEBUG] [MAIN      ] IQI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:52.252130] [DEBUG] [MAIN      ] IQV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:52.290513] [INFO ] [MAIN      ] IQI: Generated 139 derivative records from 17831 primary records.
[2025-10-24T01:23:52.290961] [DEBUG] [LOCAL     ] IQI: Saving derivative data.
[2025-10-24T01:23:52.318605] [DEBUG] [LOCAL     ] IQI: Derivative data saved (139 records).
[2025-10-24T01:23:52.325629] [INFO ] [MAIN      ] IQI: Successfully saved derivative data.
[2025-10-24T01:23:52.328448] [INFO ] [MAIN      ] Derivative Progress: 1027/2164 symbols completed. IQI took 1.2s. Estimated remaining: 7m 57s. Rate: 142.9 symbols/min
[2025-10-24T01:23:52.328623] [INFO ] [MAIN      ] IRM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:52.329031] [DEBUG] [MAIN      ] IR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:52.365929] [INFO ] [MAIN      ] IQV: Generated 139 derivative records from 50338 primary records.
[2025-10-24T01:23:52.369137] [DEBUG] [LOCAL     ] IQV: Saving derivative data.
[2025-10-24T01:23:52.386032] [DEBUG] [LOCAL     ] IQV: Derivative data saved (139 records).
[2025-10-24T01:23:52.386189] [INFO ] [MAIN      ] IQV: Successfully saved derivative data.
[2025-10-24T01:23:52.403117] [INFO ] [MAIN      ] Derivative Progress: 1028/2164 symbols completed. IQV took 1.3s. Estimated remaining: 7m 57s. Rate: 143.0 symbols/min
[2025-10-24T01:23:52.403426] [INFO ] [MAIN      ] IRS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:52.414683] [INFO ] [MAIN      ] IR: Generated 139 derivative records from 53119 primary records.
[2025-10-24T01:23:52.428160] [DEBUG] [LOCAL     ] IR: Saving derivative data.
[2025-10-24T01:23:52.429852] [DEBUG] [LOCAL     ] IRM: Loaded 49213 existing records from primary storage.
[2025-10-24T01:23:52.443443] [DEBUG] [LOCAL     ] IR: Derivative data saved (139 records).
[2025-10-24T01:23:52.443929] [INFO ] [MAIN      ] IR: Successfully saved derivative data.
[2025-10-24T01:23:52.446998] [INFO ] [MAIN      ] Derivative Progress: 1029/2164 symbols completed. IR took 1.3s. Estimated remaining: 7m 56s. Rate: 143.1 symbols/min
[2025-10-24T01:23:52.443690] [INFO ] [MAIN      ] IRM: Loaded 49213 primary data records.
[2025-10-24T01:23:52.447464] [INFO ] [MAIN      ] IRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:52.613226] [DEBUG] [LOCAL     ] IRS: Loaded 23500 existing records from primary storage.
[2025-10-24T01:23:52.647447] [INFO ] [MAIN      ] IRS: Loaded 23500 primary data records.
[2025-10-24T01:23:52.918982] [DEBUG] [LOCAL     ] IRT: Loaded 50769 existing records from primary storage.
[2025-10-24T01:23:52.950769] [INFO ] [MAIN      ] IRT: Loaded 50769 primary data records.
[2025-10-24T01:23:53.416560] [DEBUG] [MAIN      ] IRM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:53.460661] [DEBUG] [MAIN      ] IRS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:53.495411] [DEBUG] [MAIN      ] IRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:53.533018] [INFO ] [MAIN      ] IRM: Generated 139 derivative records from 49213 primary records.
[2025-10-24T01:23:53.533609] [DEBUG] [LOCAL     ] IRM: Saving derivative data.
[2025-10-24T01:23:53.551967] [DEBUG] [LOCAL     ] IRM: Derivative data saved (139 records).
[2025-10-24T01:23:53.555617] [INFO ] [MAIN      ] IRM: Successfully saved derivative data.
[2025-10-24T01:23:53.557481] [INFO ] [MAIN      ] IRS: Generated 139 derivative records from 23500 primary records.
[2025-10-24T01:23:53.559927] [INFO ] [MAIN      ] Derivative Progress: 1030/2164 symbols completed. IRM took 1.2s. Estimated remaining: 7m 56s. Rate: 142.9 symbols/min
[2025-10-24T01:23:53.560313] [DEBUG] [LOCAL     ] IRS: Saving derivative data.
[2025-10-24T01:23:53.560463] [INFO ] [MAIN      ] ISD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:53.578460] [DEBUG] [LOCAL     ] IRS: Derivative data saved (139 records).
[2025-10-24T01:23:53.578796] [INFO ] [MAIN      ] IRS: Successfully saved derivative data.
[2025-10-24T01:23:53.581465] [INFO ] [MAIN      ] Derivative Progress: 1031/2164 symbols completed. IRS took 1.2s. Estimated remaining: 7m 55s. Rate: 143.0 symbols/min
[2025-10-24T01:23:53.581931] [INFO ] [MAIN      ] IT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:53.594413] [INFO ] [MAIN      ] IRT: Generated 139 derivative records from 50769 primary records.
[2025-10-24T01:23:53.595118] [DEBUG] [LOCAL     ] IRT: Saving derivative data.
[2025-10-24T01:23:53.613406] [DEBUG] [LOCAL     ] IRT: Derivative data saved (139 records).
[2025-10-24T01:23:53.613632] [INFO ] [MAIN      ] IRT: Successfully saved derivative data.
[2025-10-24T01:23:53.617000] [INFO ] [MAIN      ] Derivative Progress: 1032/2164 symbols completed. IRT took 1.2s. Estimated remaining: 7m 54s. Rate: 143.1 symbols/min
[2025-10-24T01:23:53.614152] [DEBUG] [LOCAL     ] ISD: Loaded 15726 existing records from primary storage.
[2025-10-24T01:23:53.617216] [INFO ] [MAIN      ] ITGR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:53.617845] [INFO ] [MAIN      ] ISD: Loaded 15726 primary data records.
[2025-10-24T01:23:53.926999] [DEBUG] [LOCAL     ] ITGR: Loaded 31335 existing records from primary storage.
[2025-10-24T01:23:53.971319] [INFO ] [MAIN      ] ITGR: Loaded 31335 primary data records.
[2025-10-24T01:23:53.972762] [DEBUG] [LOCAL     ] IT: Loaded 42542 existing records from primary storage.
[2025-10-24T01:23:54.010634] [INFO ] [MAIN      ] IT: Loaded 42542 primary data records.
[2025-10-24T01:23:54.613246] [DEBUG] [MAIN      ] ISD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:54.654909] [DEBUG] [MAIN      ] ITGR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:54.694475] [DEBUG] [MAIN      ] IT: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:23:54.730170] [INFO ] [MAIN      ] ISD: Generated 139 derivative records from 15726 primary records.
[2025-10-24T01:23:54.734573] [DEBUG] [LOCAL     ] ISD: Saving derivative data.
[2025-10-24T01:23:54.750529] [DEBUG] [LOCAL     ] ISD: Derivative data saved (139 records).
[2025-10-24T01:23:54.752761] [INFO ] [MAIN      ] ISD: Successfully saved derivative data.
[2025-10-24T01:23:54.756100] [INFO ] [MAIN      ] Derivative Progress: 1033/2164 symbols completed. ISD took 1.2s. Estimated remaining: 7m 55s. Rate: 142.9 symbols/min
[2025-10-24T01:23:54.770157] [INFO ] [MAIN      ] ITGR: Generated 139 derivative records from 31335 primary records.
[2025-10-24T01:23:54.771757] [DEBUG] [LOCAL     ] ITGR: Saving derivative data.
[2025-10-24T01:23:54.774334] [INFO ] [MAIN      ] IT: Generated 139 derivative records from 42542 primary records.
[2025-10-24T01:23:54.774783] [DEBUG] [LOCAL     ] IT: Saving derivative data.
[2025-10-24T01:23:54.799992] [DEBUG] [LOCAL     ] IT: Derivative data saved (139 records).
[2025-10-24T01:23:54.800203] [INFO ] [MAIN      ] IT: Successfully saved derivative data.
[2025-10-24T01:23:54.800090] [DEBUG] [LOCAL     ] ITGR: Derivative data saved (139 records).
[2025-10-24T01:23:54.803137] [INFO ] [MAIN      ] Derivative Progress: 1034/2164 symbols completed. IT took 1.2s. Estimated remaining: 7m 54s. Rate: 143.0 symbols/min
[2025-10-24T01:23:54.803379] [INFO ] [MAIN      ] ITGR: Successfully saved derivative data.
[2025-10-24T01:23:54.805974] [INFO ] [MAIN      ] Derivative Progress: 1035/2164 symbols completed. ITGR took 1.2s. Estimated remaining: 7m 53s. Rate: 143.2 symbols/min
[2025-10-24T01:23:54.806350] [INFO ] [MAIN      ] ITUB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:54.806448] [INFO ] [MAIN      ] ITT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:54.806558] [INFO ] [MAIN      ] ITW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:54.866601] [DEBUG] [LOCAL     ] ITT: Loaded 32539 existing records from primary storage.
[2025-10-24T01:23:54.866798] [INFO ] [MAIN      ] ITT: Loaded 32539 primary data records.
[2025-10-24T01:23:55.009696] [DEBUG] [LOCAL     ] ITUB: Loaded 53701 existing records from primary storage.
[2025-10-24T01:23:55.008810] [DEBUG] [LOCAL     ] ITW: Loaded 45963 existing records from primary storage.
[2025-10-24T01:23:55.036259] [INFO ] [MAIN      ] ITUB: Loaded 53701 primary data records.
[2025-10-24T01:23:55.051088] [INFO ] [MAIN      ] ITW: Loaded 45963 primary data records.
[2025-10-24T01:23:55.874951] [DEBUG] [MAIN      ] ITT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:55.918839] [DEBUG] [MAIN      ] ITUB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:55.947607] [DEBUG] [MAIN      ] ITW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:55.991376] [INFO ] [MAIN      ] ITT: Generated 139 derivative records from 32539 primary records.
[2025-10-24T01:23:55.992304] [DEBUG] [LOCAL     ] ITT: Saving derivative data.
[2025-10-24T01:23:56.012608] [DEBUG] [LOCAL     ] ITT: Derivative data saved (139 records).
[2025-10-24T01:23:56.014613] [INFO ] [MAIN      ] ITT: Successfully saved derivative data.
[2025-10-24T01:23:56.018249] [INFO ] [MAIN      ] Derivative Progress: 1036/2164 symbols completed. ITT took 1.2s. Estimated remaining: 7m 54s. Rate: 142.9 symbols/min
[2025-10-24T01:23:56.021089] [INFO ] [MAIN      ] IVR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:56.030752] [INFO ] [MAIN      ] ITUB: Generated 139 derivative records from 53701 primary records.
[2025-10-24T01:23:56.032923] [DEBUG] [LOCAL     ] ITUB: Saving derivative data.
[2025-10-24T01:23:56.032836] [INFO ] [MAIN      ] ITW: Generated 139 derivative records from 45963 primary records.
[2025-10-24T01:23:56.033633] [DEBUG] [LOCAL     ] ITW: Saving derivative data.
[2025-10-24T01:23:56.046285] [DEBUG] [LOCAL     ] ITUB: Derivative data saved (139 records).
[2025-10-24T01:23:56.055356] [INFO ] [MAIN      ] ITUB: Successfully saved derivative data.
[2025-10-24T01:23:56.059900] [INFO ] [MAIN      ] Derivative Progress: 1037/2164 symbols completed. ITUB took 1.3s. Estimated remaining: 7m 53s. Rate: 143.0 symbols/min
[2025-10-24T01:23:56.060190] [INFO ] [MAIN      ] IVT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:56.062199] [DEBUG] [LOCAL     ] ITW: Derivative data saved (139 records).
[2025-10-24T01:23:56.062691] [INFO ] [MAIN      ] ITW: Successfully saved derivative data.
[2025-10-24T01:23:56.066877] [INFO ] [MAIN      ] Derivative Progress: 1038/2164 symbols completed. ITW took 1.3s. Estimated remaining: 7m 52s. Rate: 143.2 symbols/min
[2025-10-24T01:23:56.079363] [INFO ] [MAIN      ] IVZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:56.102590] [DEBUG] [LOCAL     ] IVR: Loaded 48202 existing records from primary storage.
[2025-10-24T01:23:56.112596] [INFO ] [MAIN      ] IVR: Loaded 48202 primary data records.
[2025-10-24T01:23:56.227696] [DEBUG] [LOCAL     ] IVT: Loaded 31625 existing records from primary storage.
[2025-10-24T01:23:56.231406] [INFO ] [MAIN      ] IVT: Loaded 31625 primary data records.
[2025-10-24T01:23:56.661804] [DEBUG] [LOCAL     ] IVZ: Loaded 53518 existing records from primary storage.
[2025-10-24T01:23:56.777996] [INFO ] [MAIN      ] IVZ: Loaded 53518 primary data records.
[2025-10-24T01:23:57.141841] [DEBUG] [MAIN      ] IVR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:57.173172] [DEBUG] [MAIN      ] IVT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:57.234478] [DEBUG] [MAIN      ] IVZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:57.272955] [INFO ] [MAIN      ] IVT: Generated 139 derivative records from 31625 primary records.
[2025-10-24T01:23:57.276211] [INFO ] [MAIN      ] IVR: Generated 139 derivative records from 48202 primary records.
[2025-10-24T01:23:57.275881] [DEBUG] [LOCAL     ] IVT: Saving derivative data.
[2025-10-24T01:23:57.276719] [DEBUG] [LOCAL     ] IVR: Saving derivative data.
[2025-10-24T01:23:57.291416] [DEBUG] [LOCAL     ] IVR: Derivative data saved (139 records).
[2025-10-24T01:23:57.305518] [INFO ] [MAIN      ] IVR: Successfully saved derivative data.
[2025-10-24T01:23:57.309485] [INFO ] [MAIN      ] Derivative Progress: 1039/2164 symbols completed. IVR took 1.3s. Estimated remaining: 7m 52s. Rate: 142.9 symbols/min
[2025-10-24T01:23:57.310038] [INFO ] [MAIN      ] IX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:57.312124] [DEBUG] [LOCAL     ] IVT: Derivative data saved (139 records).
[2025-10-24T01:23:57.312320] [INFO ] [MAIN      ] IVT: Successfully saved derivative data.
[2025-10-24T01:23:57.315109] [INFO ] [MAIN      ] Derivative Progress: 1040/2164 symbols completed. IVT took 1.3s. Estimated remaining: 7m 52s. Rate: 143.0 symbols/min
[2025-10-24T01:23:57.315452] [INFO ] [MAIN      ] J: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:57.334189] [INFO ] [MAIN      ] IVZ: Generated 139 derivative records from 53518 primary records.
[2025-10-24T01:23:57.334861] [DEBUG] [LOCAL     ] IVZ: Saving derivative data.
[2025-10-24T01:23:57.359060] [DEBUG] [LOCAL     ] IVZ: Derivative data saved (139 records).
[2025-10-24T01:23:57.358875] [DEBUG] [LOCAL     ] IX: Loaded 22244 existing records from primary storage.
[2025-10-24T01:23:57.359587] [INFO ] [MAIN      ] IVZ: Successfully saved derivative data.
[2025-10-24T01:23:57.362585] [INFO ] [MAIN      ] Derivative Progress: 1041/2164 symbols completed. IVZ took 1.3s. Estimated remaining: 7m 51s. Rate: 143.2 symbols/min
[2025-10-24T01:23:57.362863] [INFO ] [MAIN      ] JBGS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:57.363149] [INFO ] [MAIN      ] IX: Loaded 22244 primary data records.
[2025-10-24T01:23:57.518218] [DEBUG] [LOCAL     ] J: Loaded 40852 existing records from primary storage.
[2025-10-24T01:23:57.524702] [INFO ] [MAIN      ] J: Loaded 40852 primary data records.
[2025-10-24T01:23:57.692445] [DEBUG] [LOCAL     ] JBGS: Loaded 41920 existing records from primary storage.
[2025-10-24T01:23:57.860890] [INFO ] [MAIN      ] JBGS: Loaded 41920 primary data records.
[2025-10-24T01:23:58.477991] [DEBUG] [MAIN      ] IX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:58.516768] [DEBUG] [MAIN      ] J: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:58.574451] [DEBUG] [MAIN      ] JBGS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:58.607679] [INFO ] [MAIN      ] IX: Generated 139 derivative records from 22244 primary records.
[2025-10-24T01:23:58.609828] [DEBUG] [LOCAL     ] IX: Saving derivative data.
[2025-10-24T01:23:58.630292] [DEBUG] [LOCAL     ] IX: Derivative data saved (139 records).
[2025-10-24T01:23:58.632111] [INFO ] [MAIN      ] IX: Successfully saved derivative data.
[2025-10-24T01:23:58.635583] [INFO ] [MAIN      ] Derivative Progress: 1042/2164 symbols completed. IX took 1.3s. Estimated remaining: 7m 51s. Rate: 142.9 symbols/min
[2025-10-24T01:23:58.636429] [INFO ] [MAIN      ] JBI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:58.640187] [INFO ] [MAIN      ] J: Generated 139 derivative records from 40852 primary records.
[2025-10-24T01:23:58.643670] [DEBUG] [LOCAL     ] J: Saving derivative data.
[2025-10-24T01:23:58.661911] [DEBUG] [LOCAL     ] J: Derivative data saved (139 records).
[2025-10-24T01:23:58.662056] [INFO ] [MAIN      ] J: Successfully saved derivative data.
[2025-10-24T01:23:58.664983] [INFO ] [MAIN      ] Derivative Progress: 1043/2164 symbols completed. J took 1.3s. Estimated remaining: 7m 50s. Rate: 143.0 symbols/min
[2025-10-24T01:23:58.665318] [INFO ] [MAIN      ] JBL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:58.669405] [INFO ] [MAIN      ] JBGS: Generated 139 derivative records from 41920 primary records.
[2025-10-24T01:23:58.669609] [DEBUG] [LOCAL     ] JBGS: Saving derivative data.
[2025-10-24T01:23:58.692065] [DEBUG] [LOCAL     ] JBGS: Derivative data saved (139 records).
[2025-10-24T01:23:58.692567] [INFO ] [MAIN      ] JBGS: Successfully saved derivative data.
[2025-10-24T01:23:58.697098] [INFO ] [MAIN      ] Derivative Progress: 1044/2164 symbols completed. JBGS took 1.3s. Estimated remaining: 7m 50s. Rate: 143.1 symbols/min
[2025-10-24T01:23:58.697636] [INFO ] [MAIN      ] JBND: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:58.716868] [DEBUG] [LOCAL     ] JBI: Loaded 42829 existing records from primary storage.
[2025-10-24T01:23:58.717079] [INFO ] [MAIN      ] JBI: Loaded 42829 primary data records.
[2025-10-24T01:23:58.898398] [DEBUG] [LOCAL     ] JBL: Loaded 48679 existing records from primary storage.
[2025-10-24T01:23:59.045598] [INFO ] [MAIN      ] JBL: Loaded 48679 primary data records.
[2025-10-24T01:23:59.054775] [DEBUG] [LOCAL     ] JBND: Loaded 27627 existing records from primary storage.
[2025-10-24T01:23:59.055227] [INFO ] [MAIN      ] JBND: Loaded 27627 primary data records.
[2025-10-24T01:23:59.706385] [DEBUG] [MAIN      ] JBI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:59.757420] [DEBUG] [MAIN      ] JBL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:59.785050] [DEBUG] [MAIN      ] JBND: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:23:59.812038] [INFO ] [MAIN      ] JBI: Generated 139 derivative records from 42829 primary records.
[2025-10-24T01:23:59.816576] [DEBUG] [LOCAL     ] JBI: Saving derivative data.
[2025-10-24T01:23:59.838684] [DEBUG] [LOCAL     ] JBI: Derivative data saved (139 records).
[2025-10-24T01:23:59.843266] [INFO ] [MAIN      ] JBI: Successfully saved derivative data.
[2025-10-24T01:23:59.846173] [INFO ] [MAIN      ] Derivative Progress: 1045/2164 symbols completed. JBI took 1.2s. Estimated remaining: 7m 50s. Rate: 142.9 symbols/min
[2025-10-24T01:23:59.850372] [INFO ] [MAIN      ] JBTM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:59.861548] [INFO ] [MAIN      ] JBL: Generated 139 derivative records from 48679 primary records.
[2025-10-24T01:23:59.862617] [DEBUG] [LOCAL     ] JBL: Saving derivative data.
[2025-10-24T01:23:59.865462] [INFO ] [MAIN      ] JBND: Generated 139 derivative records from 27627 primary records.
[2025-10-24T01:23:59.865572] [DEBUG] [LOCAL     ] JBND: Saving derivative data.
[2025-10-24T01:23:59.888800] [DEBUG] [LOCAL     ] JBL: Derivative data saved (139 records).
[2025-10-24T01:23:59.890945] [DEBUG] [LOCAL     ] JBND: Derivative data saved (139 records).
[2025-10-24T01:23:59.899034] [INFO ] [MAIN      ] JBND: Successfully saved derivative data.
[2025-10-24T01:23:59.899147] [INFO ] [MAIN      ] JBL: Successfully saved derivative data.
[2025-10-24T01:23:59.901907] [INFO ] [MAIN      ] Derivative Progress: 1046/2164 symbols completed. JBL took 1.2s. Estimated remaining: 7m 49s. Rate: 143.0 symbols/min
[2025-10-24T01:23:59.904622] [INFO ] [MAIN      ] JCE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:59.904921] [INFO ] [MAIN      ] Derivative Progress: 1047/2164 symbols completed. JBND took 1.2s. Estimated remaining: 7m 48s. Rate: 143.1 symbols/min
[2025-10-24T01:23:59.905047] [INFO ] [MAIN      ] JCI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:23:59.922037] [DEBUG] [LOCAL     ] JBTM: Loaded 33794 existing records from primary storage.
[2025-10-24T01:23:59.922436] [INFO ] [MAIN      ] JBTM: Loaded 33794 primary data records.
[2025-10-24T01:23:59.989222] [DEBUG] [LOCAL     ] JCE: Loaded 7275 existing records from primary storage.
[2025-10-24T01:24:00.006946] [INFO ] [MAIN      ] JCE: Loaded 7275 primary data records.
[2025-10-24T01:24:00.493439] [DEBUG] [LOCAL     ] JCI: Loaded 53905 existing records from primary storage.
[2025-10-24T01:24:00.530996] [INFO ] [MAIN      ] JCI: Loaded 53905 primary data records.
[2025-10-24T01:24:00.919942] [DEBUG] [MAIN      ] JBTM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:00.983282] [DEBUG] [MAIN      ] JCE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:01.020673] [INFO ] [MAIN      ] JBTM: Generated 139 derivative records from 33794 primary records.
[2025-10-24T01:24:01.020406] [DEBUG] [MAIN      ] JCI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:01.021132] [DEBUG] [LOCAL     ] JBTM: Saving derivative data.
[2025-10-24T01:24:01.050323] [DEBUG] [LOCAL     ] JBTM: Derivative data saved (139 records).
[2025-10-24T01:24:01.050456] [INFO ] [MAIN      ] JBTM: Successfully saved derivative data.
[2025-10-24T01:24:01.054199] [INFO ] [MAIN      ] Derivative Progress: 1048/2164 symbols completed. JBTM took 1.2s. Estimated remaining: 7m 49s. Rate: 142.9 symbols/min
[2025-10-24T01:24:01.085431] [INFO ] [MAIN      ] JCE: Generated 139 derivative records from 7275 primary records.
[2025-10-24T01:24:01.087056] [DEBUG] [LOCAL     ] JCE: Saving derivative data.
[2025-10-24T01:24:01.088932] [INFO ] [MAIN      ] JCI: Generated 139 derivative records from 53905 primary records.
[2025-10-24T01:24:01.090157] [DEBUG] [LOCAL     ] JCI: Saving derivative data.
[2025-10-24T01:24:01.117268] [DEBUG] [LOCAL     ] JCI: Derivative data saved (139 records).
[2025-10-24T01:24:01.121870] [INFO ] [MAIN      ] JCI: Successfully saved derivative data.
[2025-10-24T01:24:01.125237] [INFO ] [MAIN      ] Derivative Progress: 1049/2164 symbols completed. JCI took 1.2s. Estimated remaining: 7m 48s. Rate: 143.0 symbols/min
[2025-10-24T01:24:01.121963] [DEBUG] [LOCAL     ] JCE: Derivative data saved (139 records).
[2025-10-24T01:24:01.125779] [INFO ] [MAIN      ] JCE: Successfully saved derivative data.
[2025-10-24T01:24:01.129192] [INFO ] [MAIN      ] Derivative Progress: 1050/2164 symbols completed. JCE took 1.2s. Estimated remaining: 7m 47s. Rate: 143.2 symbols/min
[2025-10-24T01:24:01.130133] [INFO ] [MAIN      ] JELD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:01.130219] [INFO ] [MAIN      ] JFR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:01.130068] [INFO ] [MAIN      ] JEF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:01.199355] [DEBUG] [LOCAL     ] JFR: Loaded 31341 existing records from primary storage.
[2025-10-24T01:24:01.199797] [INFO ] [MAIN      ] JFR: Loaded 31341 primary data records.
[2025-10-24T01:24:01.338380] [DEBUG] [LOCAL     ] JELD: Loaded 46140 existing records from primary storage.
[2025-10-24T01:24:01.342782] [INFO ] [MAIN      ] JELD: Loaded 46140 primary data records.
[2025-10-24T01:24:01.369959] [DEBUG] [LOCAL     ] JEF: Loaded 50570 existing records from primary storage.
[2025-10-24T01:24:01.380768] [INFO ] [MAIN      ] JEF: Loaded 50570 primary data records.
[2025-10-24T01:24:02.181479] [DEBUG] [MAIN      ] JFR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:02.224897] [DEBUG] [MAIN      ] JELD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:02.320304] [DEBUG] [MAIN      ] JEF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:02.364543] [INFO ] [MAIN      ] JFR: Generated 139 derivative records from 31341 primary records.
[2025-10-24T01:24:02.366747] [DEBUG] [LOCAL     ] JFR: Saving derivative data.
[2025-10-24T01:24:02.385985] [DEBUG] [LOCAL     ] JFR: Derivative data saved (139 records).
[2025-10-24T01:24:02.386791] [INFO ] [MAIN      ] JFR: Successfully saved derivative data.
[2025-10-24T01:24:02.392503] [INFO ] [MAIN      ] Derivative Progress: 1051/2164 symbols completed. JFR took 1.3s. Estimated remaining: 7m 47s. Rate: 142.9 symbols/min
[2025-10-24T01:24:02.394255] [INFO ] [MAIN      ] JGH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:02.404623] [INFO ] [MAIN      ] JELD: Generated 139 derivative records from 46140 primary records.
[2025-10-24T01:24:02.405166] [DEBUG] [LOCAL     ] JELD: Saving derivative data.
[2025-10-24T01:24:02.427106] [DEBUG] [LOCAL     ] JELD: Derivative data saved (139 records).
[2025-10-24T01:24:02.434275] [INFO ] [MAIN      ] JELD: Successfully saved derivative data.
[2025-10-24T01:24:02.438573] [INFO ] [MAIN      ] Derivative Progress: 1052/2164 symbols completed. JELD took 1.3s. Estimated remaining: 7m 47s. Rate: 143.0 symbols/min
[2025-10-24T01:24:02.440439] [DEBUG] [LOCAL     ] JGH: Loaded 12607 existing records from primary storage.
[2025-10-24T01:24:02.440744] [INFO ] [MAIN      ] JHG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:02.442172] [INFO ] [MAIN      ] JGH: Loaded 12607 primary data records.
[2025-10-24T01:24:02.445519] [INFO ] [MAIN      ] JEF: Generated 139 derivative records from 50570 primary records.
[2025-10-24T01:24:02.446090] [DEBUG] [LOCAL     ] JEF: Saving derivative data.
[2025-10-24T01:24:02.525286] [DEBUG] [LOCAL     ] JEF: Derivative data saved (139 records).
[2025-10-24T01:24:02.539935] [INFO ] [MAIN      ] JEF: Successfully saved derivative data.
[2025-10-24T01:24:02.552143] [INFO ] [MAIN      ] Derivative Progress: 1053/2164 symbols completed. JEF took 1.4s. Estimated remaining: 7m 46s. Rate: 143.1 symbols/min
[2025-10-24T01:24:02.557901] [INFO ] [MAIN      ] JHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:02.648241] [DEBUG] [LOCAL     ] JHI: Loaded 4173 existing records from primary storage.
[2025-10-24T01:24:02.692251] [INFO ] [MAIN      ] JHI: Loaded 4173 primary data records.
[2025-10-24T01:24:02.943479] [DEBUG] [LOCAL     ] JHG: Loaded 47835 existing records from primary storage.
[2025-10-24T01:24:02.965549] [INFO ] [MAIN      ] JHG: Loaded 47835 primary data records.
[2025-10-24T01:24:03.460345] [DEBUG] [MAIN      ] JGH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:03.499362] [DEBUG] [MAIN      ] JHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:03.539288] [DEBUG] [MAIN      ] JHG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:03.573730] [INFO ] [MAIN      ] JGH: Generated 139 derivative records from 12607 primary records.
[2025-10-24T01:24:03.575199] [DEBUG] [LOCAL     ] JGH: Saving derivative data.
[2025-10-24T01:24:03.595508] [DEBUG] [LOCAL     ] JGH: Derivative data saved (139 records).
[2025-10-24T01:24:03.597046] [INFO ] [MAIN      ] JGH: Successfully saved derivative data.
[2025-10-24T01:24:03.601315] [INFO ] [MAIN      ] Derivative Progress: 1054/2164 symbols completed. JGH took 1.2s. Estimated remaining: 7m 46s. Rate: 142.9 symbols/min
[2025-10-24T01:24:03.602903] [INFO ] [MAIN      ] JHS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:03.613339] [DEBUG] [LOCAL     ] JHS: Loaded 3034 existing records from primary storage.
[2025-10-24T01:24:03.615673] [INFO ] [MAIN      ] JHI: Generated 139 derivative records from 4173 primary records.
[2025-10-24T01:24:03.618801] [DEBUG] [LOCAL     ] JHI: Saving derivative data.
[2025-10-24T01:24:03.618458] [INFO ] [MAIN      ] JHS: Loaded 3034 primary data records.
[2025-10-24T01:24:03.710414] [DEBUG] [LOCAL     ] JHI: Derivative data saved (139 records).
[2025-10-24T01:24:03.729227] [INFO ] [MAIN      ] JHG: Generated 139 derivative records from 47835 primary records.
[2025-10-24T01:24:03.722599] [INFO ] [MAIN      ] JHI: Successfully saved derivative data.
[2025-10-24T01:24:03.742895] [INFO ] [MAIN      ] Derivative Progress: 1055/2164 symbols completed. JHI took 1.2s. Estimated remaining: 7m 45s. Rate: 143.0 symbols/min
[2025-10-24T01:24:03.743574] [DEBUG] [LOCAL     ] JHG: Saving derivative data.
[2025-10-24T01:24:03.743767] [INFO ] [MAIN      ] JHX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:03.951709] [DEBUG] [LOCAL     ] JHG: Derivative data saved (139 records).
[2025-10-24T01:24:03.952233] [INFO ] [MAIN      ] JHG: Successfully saved derivative data.
[2025-10-24T01:24:03.955074] [INFO ] [MAIN      ] Derivative Progress: 1056/2164 symbols completed. JHG took 1.5s. Estimated remaining: 7m 45s. Rate: 143.1 symbols/min
[2025-10-24T01:24:03.955707] [INFO ] [MAIN      ] JILL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:03.989052] [DEBUG] [LOCAL     ] JILL: Loaded 15317 existing records from primary storage.
[2025-10-24T01:24:03.989480] [INFO ] [MAIN      ] JILL: Loaded 15317 primary data records.
[2025-10-24T01:24:04.130457] [DEBUG] [MAIN      ] JHS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:04.142315] [DEBUG] [LOCAL     ] JHX: Loaded 53589 existing records from primary storage.
[2025-10-24T01:24:04.184607] [INFO ] [MAIN      ] JHX: Loaded 53589 primary data records.
[2025-10-24T01:24:04.719628] [INFO ] [MAIN      ] JHS: Generated 139 derivative records from 3034 primary records.
[2025-10-24T01:24:04.721417] [DEBUG] [LOCAL     ] JHS: Saving derivative data.
[2025-10-24T01:24:04.744890] [DEBUG] [LOCAL     ] JHS: Derivative data saved (139 records).
[2025-10-24T01:24:04.745031] [INFO ] [MAIN      ] JHS: Successfully saved derivative data.
[2025-10-24T01:24:04.742753] [DEBUG] [MAIN      ] JILL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:04.758581] [INFO ] [MAIN      ] Derivative Progress: 1057/2164 symbols completed. JHS took 1.2s. Estimated remaining: 7m 45s. Rate: 142.9 symbols/min
[2025-10-24T01:24:04.762784] [INFO ] [MAIN      ] JKS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:04.796494] [DEBUG] [MAIN      ] JHX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:04.828888] [INFO ] [MAIN      ] JILL: Generated 139 derivative records from 15317 primary records.
[2025-10-24T01:24:04.832287] [DEBUG] [LOCAL     ] JILL: Saving derivative data.
[2025-10-24T01:24:04.860934] [DEBUG] [LOCAL     ] JILL: Derivative data saved (139 records).
[2025-10-24T01:24:04.861854] [DEBUG] [LOCAL     ] JKS: Loaded 39480 existing records from primary storage.
[2025-10-24T01:24:04.864338] [INFO ] [MAIN      ] JKS: Loaded 39480 primary data records.
[2025-10-24T01:24:04.862068] [INFO ] [MAIN      ] JILL: Successfully saved derivative data.
[2025-10-24T01:24:04.866861] [INFO ] [MAIN      ] Derivative Progress: 1058/2164 symbols completed. JILL took 0.9s. Estimated remaining: 7m 44s. Rate: 143.0 symbols/min
[2025-10-24T01:24:04.879326] [INFO ] [MAIN      ] JLL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:05.182911] [INFO ] [MAIN      ] JHX: Generated 139 derivative records from 53589 primary records.
[2025-10-24T01:24:05.183147] [DEBUG] [LOCAL     ] JHX: Saving derivative data.
[2025-10-24T01:24:05.208188] [DEBUG] [LOCAL     ] JHX: Derivative data saved (139 records).
[2025-10-24T01:24:05.207376] [DEBUG] [LOCAL     ] JLL: Loaded 31765 existing records from primary storage.
[2025-10-24T01:24:05.208993] [INFO ] [MAIN      ] JLL: Loaded 31765 primary data records.
[2025-10-24T01:24:05.208917] [INFO ] [MAIN      ] JHX: Successfully saved derivative data.
[2025-10-24T01:24:05.236708] [INFO ] [MAIN      ] Derivative Progress: 1059/2164 symbols completed. JHX took 1.5s. Estimated remaining: 7m 43s. Rate: 143.0 symbols/min
[2025-10-24T01:24:05.244348] [INFO ] [MAIN      ] JLS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:05.350998] [DEBUG] [LOCAL     ] JLS: Loaded 4024 existing records from primary storage.
[2025-10-24T01:24:05.373848] [INFO ] [MAIN      ] JLS: Loaded 4024 primary data records.
[2025-10-24T01:24:05.669446] [DEBUG] [MAIN      ] JKS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:05.921343] [DEBUG] [MAIN      ] JLL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:05.915733] [INFO ] [MAIN      ] JKS: Generated 139 derivative records from 39480 primary records.
[2025-10-24T01:24:05.921614] [DEBUG] [LOCAL     ] JKS: Saving derivative data.
[2025-10-24T01:24:05.948339] [DEBUG] [LOCAL     ] JKS: Derivative data saved (139 records).
[2025-10-24T01:24:05.948829] [INFO ] [MAIN      ] JKS: Successfully saved derivative data.
[2025-10-24T01:24:05.953268] [INFO ] [MAIN      ] Derivative Progress: 1060/2164 symbols completed. JKS took 1.2s. Estimated remaining: 7m 43s. Rate: 143.0 symbols/min
[2025-10-24T01:24:05.958527] [INFO ] [MAIN      ] JMIA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:05.978254] [DEBUG] [MAIN      ] JLS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:06.008214] [INFO ] [MAIN      ] JLL: Generated 139 derivative records from 31765 primary records.
[2025-10-24T01:24:06.010947] [DEBUG] [LOCAL     ] JLL: Saving derivative data.
[2025-10-24T01:24:06.043625] [DEBUG] [LOCAL     ] JLL: Derivative data saved (139 records).
[2025-10-24T01:24:06.044149] [INFO ] [MAIN      ] JLL: Successfully saved derivative data.
[2025-10-24T01:24:06.046822] [INFO ] [MAIN      ] Derivative Progress: 1061/2164 symbols completed. JLL took 1.2s. Estimated remaining: 7m 43s. Rate: 143.1 symbols/min
[2025-10-24T01:24:06.050051] [INFO ] [MAIN      ] JNJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:06.053335] [INFO ] [MAIN      ] JLS: Generated 139 derivative records from 4024 primary records.
[2025-10-24T01:24:06.053460] [DEBUG] [LOCAL     ] JLS: Saving derivative data.
[2025-10-24T01:24:06.066065] [DEBUG] [LOCAL     ] JLS: Derivative data saved (139 records).
[2025-10-24T01:24:06.081035] [INFO ] [MAIN      ] JLS: Successfully saved derivative data.
[2025-10-24T01:24:06.083662] [INFO ] [MAIN      ] Derivative Progress: 1062/2164 symbols completed. JLS took 0.8s. Estimated remaining: 7m 42s. Rate: 143.2 symbols/min
[2025-10-24T01:24:06.085086] [INFO ] [MAIN      ] JOBY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:06.084743] [DEBUG] [LOCAL     ] JMIA: Loaded 51570 existing records from primary storage.
[2025-10-24T01:24:06.085616] [INFO ] [MAIN      ] JMIA: Loaded 51570 primary data records.
[2025-10-24T01:24:06.447686] [DEBUG] [LOCAL     ] JNJ: Loaded 54143 existing records from primary storage.
[2025-10-24T01:24:06.448539] [INFO ] [MAIN      ] JNJ: Loaded 54143 primary data records.
[2025-10-24T01:24:06.449393] [DEBUG] [LOCAL     ] JOBY: Loaded 54199 existing records from primary storage.
[2025-10-24T01:24:06.450212] [INFO ] [MAIN      ] JOBY: Loaded 54199 primary data records.
[2025-10-24T01:24:07.099593] [DEBUG] [MAIN      ] JMIA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:07.149403] [INFO ] [MAIN      ] JMIA: Generated 139 derivative records from 51570 primary records.
[2025-10-24T01:24:07.150432] [DEBUG] [LOCAL     ] JMIA: Saving derivative data.
[2025-10-24T01:24:07.188078] [DEBUG] [LOCAL     ] JMIA: Derivative data saved (139 records).
[2025-10-24T01:24:07.188475] [DEBUG] [MAIN      ] JOBY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:07.188229] [INFO ] [MAIN      ] JMIA: Successfully saved derivative data.
[2025-10-24T01:24:07.183363] [DEBUG] [MAIN      ] JNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:07.191260] [INFO ] [MAIN      ] Derivative Progress: 1063/2164 symbols completed. JMIA took 1.2s. Estimated remaining: 7m 42s. Rate: 143.0 symbols/min
[2025-10-24T01:24:07.261347] [INFO ] [MAIN      ] JOBY: Generated 139 derivative records from 54199 primary records.
[2025-10-24T01:24:07.263806] [DEBUG] [LOCAL     ] JOBY: Saving derivative data.
[2025-10-24T01:24:07.263585] [INFO ] [MAIN      ] JNJ: Generated 139 derivative records from 54143 primary records.
[2025-10-24T01:24:07.264736] [DEBUG] [LOCAL     ] JNJ: Saving derivative data.
[2025-10-24T01:24:07.286179] [DEBUG] [LOCAL     ] JOBY: Derivative data saved (139 records).
[2025-10-24T01:24:07.290137] [INFO ] [MAIN      ] JOBY: Successfully saved derivative data.
[2025-10-24T01:24:07.294913] [INFO ] [MAIN      ] Derivative Progress: 1064/2164 symbols completed. JOBY took 1.2s. Estimated remaining: 7m 41s. Rate: 143.1 symbols/min
[2025-10-24T01:24:07.296236] [DEBUG] [LOCAL     ] JNJ: Derivative data saved (139 records).
[2025-10-24T01:24:07.296715] [INFO ] [MAIN      ] JNJ: Successfully saved derivative data.
[2025-10-24T01:24:07.299230] [INFO ] [MAIN      ] Derivative Progress: 1065/2164 symbols completed. JNJ took 1.2s. Estimated remaining: 7m 40s. Rate: 143.2 symbols/min
[2025-10-24T01:24:07.299914] [INFO ] [MAIN      ] JOF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:07.299839] [INFO ] [MAIN      ] JPM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:07.299712] [INFO ] [MAIN      ] JOE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:07.312314] [DEBUG] [LOCAL     ] JOF: Loaded 6978 existing records from primary storage.
[2025-10-24T01:24:07.312542] [INFO ] [MAIN      ] JOF: Loaded 6978 primary data records.
[2025-10-24T01:24:07.507797] [DEBUG] [LOCAL     ] JOE: Loaded 23818 existing records from primary storage.
[2025-10-24T01:24:07.634386] [INFO ] [MAIN      ] JOE: Loaded 23818 primary data records.
[2025-10-24T01:24:07.764141] [DEBUG] [LOCAL     ] JPM: Loaded 54184 existing records from primary storage.
[2025-10-24T01:24:07.780525] [INFO ] [MAIN      ] JPM: Loaded 54184 primary data records.
[2025-10-24T01:24:08.275443] [DEBUG] [MAIN      ] JOF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:08.323741] [DEBUG] [MAIN      ] JOE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:08.368437] [DEBUG] [MAIN      ] JPM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:08.367842] [INFO ] [MAIN      ] JOF: Generated 139 derivative records from 6978 primary records.
[2025-10-24T01:24:08.380952] [DEBUG] [LOCAL     ] JOF: Saving derivative data.
[2025-10-24T01:24:08.401066] [DEBUG] [LOCAL     ] JOF: Derivative data saved (139 records).
[2025-10-24T01:24:08.404711] [INFO ] [MAIN      ] JOF: Successfully saved derivative data.
[2025-10-24T01:24:08.406946] [INFO ] [MAIN      ] Derivative Progress: 1066/2164 symbols completed. JOF took 1.1s. Estimated remaining: 7m 41s. Rate: 143.0 symbols/min
[2025-10-24T01:24:08.407368] [INFO ] [MAIN      ] JQC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:08.431114] [INFO ] [MAIN      ] JOE: Generated 139 derivative records from 23818 primary records.
[2025-10-24T01:24:08.434315] [DEBUG] [LOCAL     ] JOE: Saving derivative data.
[2025-10-24T01:24:08.446808] [INFO ] [MAIN      ] JPM: Generated 139 derivative records from 54184 primary records.
[2025-10-24T01:24:08.456980] [DEBUG] [LOCAL     ] JPM: Saving derivative data.
[2025-10-24T01:24:08.459204] [DEBUG] [LOCAL     ] JOE: Derivative data saved (139 records).
[2025-10-24T01:24:08.459468] [INFO ] [MAIN      ] JOE: Successfully saved derivative data.
[2025-10-24T01:24:08.472586] [INFO ] [MAIN      ] Derivative Progress: 1067/2164 symbols completed. JOE took 1.2s. Estimated remaining: 7m 40s. Rate: 143.1 symbols/min
[2025-10-24T01:24:08.473154] [INFO ] [MAIN      ] JRI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:08.485160] [DEBUG] [LOCAL     ] JPM: Derivative data saved (139 records).
[2025-10-24T01:24:08.485256] [INFO ] [MAIN      ] JPM: Successfully saved derivative data.
[2025-10-24T01:24:08.486055] [DEBUG] [LOCAL     ] JQC: Loaded 34130 existing records from primary storage.
[2025-10-24T01:24:08.489050] [INFO ] [MAIN      ] Derivative Progress: 1068/2164 symbols completed. JPM took 1.2s. Estimated remaining: 7m 39s. Rate: 143.2 symbols/min
[2025-10-24T01:24:08.489446] [INFO ] [MAIN      ] JQC: Loaded 34130 primary data records.
[2025-10-24T01:24:08.489747] [INFO ] [MAIN      ] JRS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:08.617294] [DEBUG] [LOCAL     ] JRI: Loaded 15370 existing records from primary storage.
[2025-10-24T01:24:08.643357] [INFO ] [MAIN      ] JRI: Loaded 15370 primary data records.
[2025-10-24T01:24:08.644045] [DEBUG] [LOCAL     ] JRS: Loaded 11582 existing records from primary storage.
[2025-10-24T01:24:08.673935] [INFO ] [MAIN      ] JRS: Loaded 11582 primary data records.
[2025-10-24T01:24:09.479318] [DEBUG] [MAIN      ] JQC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:09.510124] [DEBUG] [MAIN      ] JRI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:09.551912] [DEBUG] [MAIN      ] JRS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:24:09.613080] [INFO ] [MAIN      ] JRI: Generated 139 derivative records from 15370 primary records.
[2025-10-24T01:24:09.617328] [DEBUG] [LOCAL     ] JRI: Saving derivative data.
[2025-10-24T01:24:09.616945] [INFO ] [MAIN      ] JQC: Generated 139 derivative records from 34130 primary records.
[2025-10-24T01:24:09.618385] [DEBUG] [LOCAL     ] JQC: Saving derivative data.
[2025-10-24T01:24:09.633378] [DEBUG] [LOCAL     ] JRI: Derivative data saved (139 records).
[2025-10-24T01:24:09.641214] [INFO ] [MAIN      ] JRI: Successfully saved derivative data.
[2025-10-24T01:24:09.643897] [INFO ] [MAIN      ] Derivative Progress: 1069/2164 symbols completed. JRI took 1.2s. Estimated remaining: 7m 40s. Rate: 143.0 symbols/min
[2025-10-24T01:24:09.648595] [DEBUG] [LOCAL     ] JQC: Derivative data saved (139 records).
[2025-10-24T01:24:09.649309] [INFO ] [MAIN      ] JQC: Successfully saved derivative data.
[2025-10-24T01:24:09.648910] [INFO ] [MAIN      ] JXN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:09.651892] [INFO ] [MAIN      ] Derivative Progress: 1070/2164 symbols completed. JQC took 1.2s. Estimated remaining: 7m 39s. Rate: 143.1 symbols/min
[2025-10-24T01:24:09.654214] [INFO ] [MAIN      ] K: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:09.654704] [INFO ] [MAIN      ] JRS: Generated 139 derivative records from 11582 primary records.
[2025-10-24T01:24:09.654843] [DEBUG] [LOCAL     ] JRS: Saving derivative data.
[2025-10-24T01:24:09.666962] [DEBUG] [LOCAL     ] JRS: Derivative data saved (139 records).
[2025-10-24T01:24:09.667201] [INFO ] [MAIN      ] JRS: Successfully saved derivative data.
[2025-10-24T01:24:09.670363] [INFO ] [MAIN      ] Derivative Progress: 1071/2164 symbols completed. JRS took 1.2s. Estimated remaining: 7m 38s. Rate: 143.2 symbols/min
[2025-10-24T01:24:09.670559] [INFO ] [MAIN      ] KAI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:09.691634] [DEBUG] [LOCAL     ] KAI: Loaded 13504 existing records from primary storage.
[2025-10-24T01:24:09.707530] [INFO ] [MAIN      ] KAI: Loaded 13504 primary data records.
[2025-10-24T01:24:09.859914] [DEBUG] [LOCAL     ] JXN: Loaded 44543 existing records from primary storage.
[2025-10-24T01:24:09.887012] [INFO ] [MAIN      ] JXN: Loaded 44543 primary data records.
[2025-10-24T01:24:09.861083] [DEBUG] [LOCAL     ] K: Loaded 50741 existing records from primary storage.
[2025-10-24T01:24:09.937725] [INFO ] [MAIN      ] K: Loaded 50741 primary data records.
[2025-10-24T01:24:10.761127] [DEBUG] [MAIN      ] KAI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:10.805074] [DEBUG] [MAIN      ] JXN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:10.841751] [DEBUG] [MAIN      ] K: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:10.889280] [INFO ] [MAIN      ] KAI: Generated 139 derivative records from 13504 primary records.
[2025-10-24T01:24:10.892204] [DEBUG] [LOCAL     ] KAI: Saving derivative data.
[2025-10-24T01:24:10.910969] [DEBUG] [LOCAL     ] KAI: Derivative data saved (139 records).
[2025-10-24T01:24:10.913735] [INFO ] [MAIN      ] KAI: Successfully saved derivative data.
[2025-10-24T01:24:10.916771] [INFO ] [MAIN      ] Derivative Progress: 1072/2164 symbols completed. KAI took 1.2s. Estimated remaining: 7m 38s. Rate: 143.0 symbols/min
[2025-10-24T01:24:10.919612] [INFO ] [MAIN      ] KAR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:10.919498] [INFO ] [MAIN      ] JXN: Generated 139 derivative records from 44543 primary records.
[2025-10-24T01:24:10.922730] [DEBUG] [LOCAL     ] JXN: Saving derivative data.
[2025-10-24T01:24:10.939509] [DEBUG] [LOCAL     ] JXN: Derivative data saved (139 records).
[2025-10-24T01:24:10.934840] [INFO ] [MAIN      ] K: Generated 139 derivative records from 50741 primary records.
[2025-10-24T01:24:10.939987] [DEBUG] [LOCAL     ] K: Saving derivative data.
[2025-10-24T01:24:10.939833] [INFO ] [MAIN      ] JXN: Successfully saved derivative data.
[2025-10-24T01:24:10.943797] [INFO ] [MAIN      ] Derivative Progress: 1073/2164 symbols completed. JXN took 1.3s. Estimated remaining: 7m 37s. Rate: 143.1 symbols/min
[2025-10-24T01:24:10.944292] [INFO ] [MAIN      ] KB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:10.957106] [DEBUG] [LOCAL     ] K: Derivative data saved (139 records).
[2025-10-24T01:24:10.957249] [INFO ] [MAIN      ] K: Successfully saved derivative data.
[2025-10-24T01:24:10.960496] [INFO ] [MAIN      ] Derivative Progress: 1074/2164 symbols completed. K took 1.3s. Estimated remaining: 7m 37s. Rate: 143.2 symbols/min
[2025-10-24T01:24:10.960869] [INFO ] [MAIN      ] KBDC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:11.007295] [DEBUG] [LOCAL     ] KBDC: Loaded 22805 existing records from primary storage.
[2025-10-24T01:24:11.019565] [DEBUG] [LOCAL     ] KB: Loaded 23127 existing records from primary storage.
[2025-10-24T01:24:11.021413] [INFO ] [MAIN      ] KB: Loaded 23127 primary data records.
[2025-10-24T01:24:11.021487] [INFO ] [MAIN      ] KBDC: Loaded 22805 primary data records.
[2025-10-24T01:24:11.022833] [DEBUG] [LOCAL     ] KAR: Loaded 40036 existing records from primary storage.
[2025-10-24T01:24:11.043691] [INFO ] [MAIN      ] KAR: Loaded 40036 primary data records.
[2025-10-24T01:24:11.961682] [DEBUG] [MAIN      ] KBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:12.007309] [DEBUG] [MAIN      ] KAR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:12.007936] [DEBUG] [MAIN      ] KB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:12.084439] [INFO ] [MAIN      ] KBDC: Generated 139 derivative records from 22805 primary records.
[2025-10-24T01:24:12.086156] [DEBUG] [LOCAL     ] KBDC: Saving derivative data.
[2025-10-24T01:24:12.097532] [INFO ] [MAIN      ] KAR: Generated 139 derivative records from 40036 primary records.
[2025-10-24T01:24:12.102482] [DEBUG] [LOCAL     ] KAR: Saving derivative data.
[2025-10-24T01:24:12.102112] [DEBUG] [LOCAL     ] KBDC: Derivative data saved (139 records).
[2025-10-24T01:24:12.105486] [INFO ] [MAIN      ] KB: Generated 139 derivative records from 23127 primary records.
[2025-10-24T01:24:12.105752] [INFO ] [MAIN      ] KBDC: Successfully saved derivative data.
[2025-10-24T01:24:12.105632] [DEBUG] [LOCAL     ] KB: Saving derivative data.
[2025-10-24T01:24:12.108378] [INFO ] [MAIN      ] Derivative Progress: 1075/2164 symbols completed. KBDC took 1.1s. Estimated remaining: 7m 37s. Rate: 143.0 symbols/min
[2025-10-24T01:24:12.121366] [DEBUG] [LOCAL     ] KAR: Derivative data saved (139 records).
[2025-10-24T01:24:12.121788] [INFO ] [MAIN      ] KAR: Successfully saved derivative data.
[2025-10-24T01:24:12.121522] [INFO ] [MAIN      ] KBH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:12.131573] [INFO ] [MAIN      ] Derivative Progress: 1076/2164 symbols completed. KAR took 1.2s. Estimated remaining: 7m 36s. Rate: 143.1 symbols/min
[2025-10-24T01:24:12.133896] [INFO ] [MAIN      ] KBR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:12.137152] [DEBUG] [LOCAL     ] KB: Derivative data saved (139 records).
[2025-10-24T01:24:12.137316] [INFO ] [MAIN      ] KB: Successfully saved derivative data.
[2025-10-24T01:24:12.140193] [INFO ] [MAIN      ] Derivative Progress: 1077/2164 symbols completed. KB took 1.2s. Estimated remaining: 7m 35s. Rate: 143.3 symbols/min
[2025-10-24T01:24:12.140582] [INFO ] [MAIN      ] KD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:12.211405] [DEBUG] [LOCAL     ] KBH: Loaded 49027 existing records from primary storage.
[2025-10-24T01:24:12.211777] [INFO ] [MAIN      ] KBH: Loaded 49027 primary data records.
[2025-10-24T01:24:12.278977] [DEBUG] [LOCAL     ] KBR: Loaded 48343 existing records from primary storage.
[2025-10-24T01:24:12.323727] [INFO ] [MAIN      ] KBR: Loaded 48343 primary data records.
[2025-10-24T01:24:12.361335] [DEBUG] [LOCAL     ] KD: Loaded 52704 existing records from primary storage.
[2025-10-24T01:24:12.389509] [INFO ] [MAIN      ] KD: Loaded 52704 primary data records.
[2025-10-24T01:24:13.220288] [DEBUG] [MAIN      ] KBH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:13.284571] [DEBUG] [MAIN      ] KBR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:13.302433] [DEBUG] [MAIN      ] KD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:13.329447] [INFO ] [MAIN      ] KBH: Generated 139 derivative records from 49027 primary records.
[2025-10-24T01:24:13.333004] [DEBUG] [LOCAL     ] KBH: Saving derivative data.
[2025-10-24T01:24:13.354140] [DEBUG] [LOCAL     ] KBH: Derivative data saved (139 records).
[2025-10-24T01:24:13.354910] [INFO ] [MAIN      ] KBH: Successfully saved derivative data.
[2025-10-24T01:24:13.359150] [INFO ] [MAIN      ] Derivative Progress: 1078/2164 symbols completed. KBH took 1.2s. Estimated remaining: 7m 36s. Rate: 143.0 symbols/min
[2025-10-24T01:24:13.374981] [INFO ] [MAIN      ] KBR: Generated 139 derivative records from 48343 primary records.
[2025-10-24T01:24:13.376156] [DEBUG] [LOCAL     ] KBR: Saving derivative data.
[2025-10-24T01:24:13.391736] [DEBUG] [LOCAL     ] KBR: Derivative data saved (139 records).
[2025-10-24T01:24:13.392014] [INFO ] [MAIN      ] KBR: Successfully saved derivative data.
[2025-10-24T01:24:13.394458] [INFO ] [MAIN      ] Derivative Progress: 1079/2164 symbols completed. KBR took 1.3s. Estimated remaining: 7m 35s. Rate: 143.1 symbols/min
[2025-10-24T01:24:13.397353] [INFO ] [MAIN      ] KD: Generated 139 derivative records from 52704 primary records.
[2025-10-24T01:24:13.397699] [DEBUG] [LOCAL     ] KD: Saving derivative data.
[2025-10-24T01:24:13.409662] [DEBUG] [LOCAL     ] KD: Derivative data saved (139 records).
[2025-10-24T01:24:13.409752] [INFO ] [MAIN      ] KD: Successfully saved derivative data.
[2025-10-24T01:24:13.412552] [INFO ] [MAIN      ] Derivative Progress: 1080/2164 symbols completed. KD took 1.3s. Estimated remaining: 7m 34s. Rate: 143.2 symbols/min
[2025-10-24T01:24:13.413035] [INFO ] [MAIN      ] KEN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:13.413084] [INFO ] [MAIN      ] KEP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:13.413156] [INFO ] [MAIN      ] KEX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:13.422040] [DEBUG] [LOCAL     ] KEN: Loaded 4616 existing records from primary storage.
[2025-10-24T01:24:13.422463] [INFO ] [MAIN      ] KEN: Loaded 4616 primary data records.
[2025-10-24T01:24:13.762694] [DEBUG] [LOCAL     ] KEX: Loaded 39000 existing records from primary storage.
[2025-10-24T01:24:13.763459] [INFO ] [MAIN      ] KEX: Loaded 39000 primary data records.
[2025-10-24T01:24:13.764281] [DEBUG] [LOCAL     ] KEP: Loaded 32795 existing records from primary storage.
[2025-10-24T01:24:13.785102] [INFO ] [MAIN      ] KEP: Loaded 32795 primary data records.
[2025-10-24T01:24:14.428699] [DEBUG] [MAIN      ] KEN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:14.493411] [DEBUG] [MAIN      ] KEX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:14.496128] [INFO ] [MAIN      ] KEN: Generated 139 derivative records from 4616 primary records.
[2025-10-24T01:24:14.516895] [DEBUG] [LOCAL     ] KEN: Saving derivative data.
[2025-10-24T01:24:14.524667] [DEBUG] [MAIN      ] KEP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:14.559967] [DEBUG] [LOCAL     ] KEN: Derivative data saved (139 records).
[2025-10-24T01:24:14.561005] [INFO ] [MAIN      ] KEN: Successfully saved derivative data.
[2025-10-24T01:24:14.563064] [INFO ] [MAIN      ] Derivative Progress: 1081/2164 symbols completed. KEN took 1.2s. Estimated remaining: 7m 34s. Rate: 143.0 symbols/min
[2025-10-24T01:24:14.565033] [INFO ] [MAIN      ] KEYS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:14.597747] [INFO ] [MAIN      ] KEX: Generated 139 derivative records from 39000 primary records.
[2025-10-24T01:24:14.598210] [DEBUG] [LOCAL     ] KEX: Saving derivative data.
[2025-10-24T01:24:14.601388] [INFO ] [MAIN      ] KEP: Generated 139 derivative records from 32795 primary records.
[2025-10-24T01:24:14.611639] [DEBUG] [LOCAL     ] KEP: Saving derivative data.
[2025-10-24T01:24:14.613553] [DEBUG] [LOCAL     ] KEX: Derivative data saved (139 records).
[2025-10-24T01:24:14.623555] [INFO ] [MAIN      ] KEX: Successfully saved derivative data.
[2025-10-24T01:24:14.626210] [INFO ] [MAIN      ] Derivative Progress: 1082/2164 symbols completed. KEX took 1.2s. Estimated remaining: 7m 34s. Rate: 143.1 symbols/min
[2025-10-24T01:24:14.633934] [INFO ] [MAIN      ] KF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:14.638787] [DEBUG] [LOCAL     ] KEP: Derivative data saved (139 records).
[2025-10-24T01:24:14.638890] [INFO ] [MAIN      ] KEP: Successfully saved derivative data.
[2025-10-24T01:24:14.641751] [INFO ] [MAIN      ] Derivative Progress: 1083/2164 symbols completed. KEP took 1.2s. Estimated remaining: 7m 33s. Rate: 143.3 symbols/min
[2025-10-24T01:24:14.642052] [INFO ] [MAIN      ] KFRC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:14.661585] [DEBUG] [LOCAL     ] KF: Loaded 2362 existing records from primary storage.
[2025-10-24T01:24:14.662053] [INFO ] [MAIN      ] KF: Loaded 2362 primary data records.
[2025-10-24T01:24:14.663672] [DEBUG] [LOCAL     ] KEYS: Loaded 43425 existing records from primary storage.
[2025-10-24T01:24:14.724818] [INFO ] [MAIN      ] KEYS: Loaded 43425 primary data records.
[2025-10-24T01:24:14.815118] [DEBUG] [LOCAL     ] KFRC: Loaded 21004 existing records from primary storage.
[2025-10-24T01:24:14.833291] [INFO ] [MAIN      ] KFRC: Loaded 21004 primary data records.
[2025-10-24T01:24:15.635023] [DEBUG] [MAIN      ] KF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:15.680459] [DEBUG] [MAIN      ] KFRC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:15.714846] [DEBUG] [MAIN      ] KEYS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:15.739137] [INFO ] [MAIN      ] KF: Generated 139 derivative records from 2362 primary records.
[2025-10-24T01:24:15.744054] [DEBUG] [LOCAL     ] KF: Saving derivative data.
[2025-10-24T01:24:15.761349] [DEBUG] [LOCAL     ] KF: Derivative data saved (139 records).
[2025-10-24T01:24:15.764371] [INFO ] [MAIN      ] KF: Successfully saved derivative data.
[2025-10-24T01:24:15.766839] [INFO ] [MAIN      ] Derivative Progress: 1084/2164 symbols completed. KF took 1.1s. Estimated remaining: 7m 33s. Rate: 143.0 symbols/min
[2025-10-24T01:24:15.773399] [INFO ] [MAIN      ] KFS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:15.782165] [INFO ] [MAIN      ] KFRC: Generated 139 derivative records from 21004 primary records.
[2025-10-24T01:24:15.785695] [DEBUG] [LOCAL     ] KFRC: Saving derivative data.
[2025-10-24T01:24:15.802938] [DEBUG] [LOCAL     ] KFS: Loaded 8762 existing records from primary storage.
[2025-10-24T01:24:15.805300] [INFO ] [MAIN      ] KFS: Loaded 8762 primary data records.
[2025-10-24T01:24:15.844561] [DEBUG] [LOCAL     ] KFRC: Derivative data saved (139 records).
[2025-10-24T01:24:15.869888] [INFO ] [MAIN      ] KFRC: Successfully saved derivative data.
[2025-10-24T01:24:15.923447] [INFO ] [MAIN      ] Derivative Progress: 1085/2164 symbols completed. KFRC took 1.3s. Estimated remaining: 7m 32s. Rate: 143.1 symbols/min
[2025-10-24T01:24:15.926542] [INFO ] [MAIN      ] KEYS: Generated 139 derivative records from 43425 primary records.
[2025-10-24T01:24:15.926014] [INFO ] [MAIN      ] KFY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:15.926721] [DEBUG] [LOCAL     ] KEYS: Saving derivative data.
[2025-10-24T01:24:15.995963] [DEBUG] [LOCAL     ] KEYS: Derivative data saved (139 records).
[2025-10-24T01:24:16.022066] [INFO ] [MAIN      ] KEYS: Successfully saved derivative data.
[2025-10-24T01:24:16.025936] [INFO ] [MAIN      ] Derivative Progress: 1086/2164 symbols completed. KEYS took 1.5s. Estimated remaining: 7m 32s. Rate: 143.2 symbols/min
[2025-10-24T01:24:16.026327] [INFO ] [MAIN      ] KGC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:16.164671] [DEBUG] [LOCAL     ] KFY: Loaded 29699 existing records from primary storage.
[2025-10-24T01:24:16.165563] [INFO ] [MAIN      ] KFY: Loaded 29699 primary data records.
[2025-10-24T01:24:16.527233] [DEBUG] [MAIN      ] KFS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:16.540287] [DEBUG] [LOCAL     ] KGC: Loaded 54089 existing records from primary storage.
[2025-10-24T01:24:16.544514] [INFO ] [MAIN      ] KGC: Loaded 54089 primary data records.
[2025-10-24T01:24:16.995854] [DEBUG] [MAIN      ] KFY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:16.999706] [INFO ] [MAIN      ] KFS: Generated 139 derivative records from 8762 primary records.
[2025-10-24T01:24:17.017235] [DEBUG] [LOCAL     ] KFS: Saving derivative data.
[2025-10-24T01:24:17.043492] [DEBUG] [LOCAL     ] KFS: Derivative data saved (139 records).
[2025-10-24T01:24:17.044037] [INFO ] [MAIN      ] KFS: Successfully saved derivative data.
[2025-10-24T01:24:17.046397] [INFO ] [MAIN      ] Derivative Progress: 1087/2164 symbols completed. KFS took 1.3s. Estimated remaining: 7m 32s. Rate: 143.0 symbols/min
[2025-10-24T01:24:17.046703] [INFO ] [MAIN      ] KGS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:17.074332] [INFO ] [MAIN      ] KFY: Generated 139 derivative records from 29699 primary records.
[2025-10-24T01:24:17.075549] [DEBUG] [LOCAL     ] KFY: Saving derivative data.
[2025-10-24T01:24:17.115000] [DEBUG] [LOCAL     ] KFY: Derivative data saved (139 records).
[2025-10-24T01:24:17.115190] [INFO ] [MAIN      ] KFY: Successfully saved derivative data.
[2025-10-24T01:24:17.134350] [INFO ] [MAIN      ] Derivative Progress: 1088/2164 symbols completed. KFY took 1.2s. Estimated remaining: 7m 31s. Rate: 143.1 symbols/min
[2025-10-24T01:24:17.135711] [DEBUG] [MAIN      ] KGC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:17.134958] [INFO ] [MAIN      ] KIM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:17.189615] [DEBUG] [LOCAL     ] KGS: Loaded 46358 existing records from primary storage.
[2025-10-24T01:24:17.189880] [INFO ] [MAIN      ] KGS: Loaded 46358 primary data records.
[2025-10-24T01:24:17.416745] [INFO ] [MAIN      ] KGC: Generated 139 derivative records from 54089 primary records.
[2025-10-24T01:24:17.417024] [DEBUG] [LOCAL     ] KGC: Saving derivative data.
[2025-10-24T01:24:17.547854] [DEBUG] [LOCAL     ] KIM: Loaded 53384 existing records from primary storage.
[2025-10-24T01:24:17.573148] [DEBUG] [LOCAL     ] KGC: Derivative data saved (139 records).
[2025-10-24T01:24:17.573317] [INFO ] [MAIN      ] KGC: Successfully saved derivative data.
[2025-10-24T01:24:17.700607] [INFO ] [MAIN      ] Derivative Progress: 1089/2164 symbols completed. KGC took 1.7s. Estimated remaining: 7m 31s. Rate: 143.1 symbols/min
[2025-10-24T01:24:17.685791] [INFO ] [MAIN      ] KIM: Loaded 53384 primary data records.
[2025-10-24T01:24:17.710893] [INFO ] [MAIN      ] KIO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:17.903876] [DEBUG] [LOCAL     ] KIO: Loaded 21847 existing records from primary storage.
[2025-10-24T01:24:17.973094] [INFO ] [MAIN      ] KIO: Loaded 21847 primary data records.
[2025-10-24T01:24:18.429637] [DEBUG] [MAIN      ] KGS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:18.492333] [DEBUG] [MAIN      ] KIM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:18.547826] [INFO ] [MAIN      ] KGS: Generated 139 derivative records from 46358 primary records.
[2025-10-24T01:24:18.549264] [DEBUG] [MAIN      ] KIO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:18.549402] [DEBUG] [LOCAL     ] KGS: Saving derivative data.
[2025-10-24T01:24:18.587567] [DEBUG] [LOCAL     ] KGS: Derivative data saved (139 records).
[2025-10-24T01:24:18.592744] [INFO ] [MAIN      ] KGS: Successfully saved derivative data.
[2025-10-24T01:24:18.595452] [INFO ] [MAIN      ] Derivative Progress: 1090/2164 symbols completed. KGS took 1.5s. Estimated remaining: 7m 31s. Rate: 142.9 symbols/min
[2025-10-24T01:24:18.596761] [INFO ] [MAIN      ] KKR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:18.609479] [INFO ] [MAIN      ] KIM: Generated 139 derivative records from 53384 primary records.
[2025-10-24T01:24:18.611422] [DEBUG] [LOCAL     ] KIM: Saving derivative data.
[2025-10-24T01:24:18.629164] [DEBUG] [LOCAL     ] KIM: Derivative data saved (139 records).
[2025-10-24T01:24:18.629469] [INFO ] [MAIN      ] KIM: Successfully saved derivative data.
[2025-10-24T01:24:18.633396] [INFO ] [MAIN      ] Derivative Progress: 1091/2164 symbols completed. KIM took 1.5s. Estimated remaining: 7m 30s. Rate: 143.1 symbols/min
[2025-10-24T01:24:18.634576] [INFO ] [MAIN      ] KKRS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:18.643435] [INFO ] [MAIN      ] KIO: Generated 139 derivative records from 21847 primary records.
[2025-10-24T01:24:18.645545] [DEBUG] [LOCAL     ] KIO: Saving derivative data.
[2025-10-24T01:24:18.679300] [DEBUG] [LOCAL     ] KKRS: Loaded 5564 existing records from primary storage.
[2025-10-24T01:24:18.680917] [INFO ] [MAIN      ] KKRS: Loaded 5564 primary data records.
[2025-10-24T01:24:18.681869] [DEBUG] [LOCAL     ] KIO: Derivative data saved (139 records).
[2025-10-24T01:24:18.687684] [INFO ] [MAIN      ] KIO: Successfully saved derivative data.
[2025-10-24T01:24:18.726380] [INFO ] [MAIN      ] Derivative Progress: 1092/2164 symbols completed. KIO took 1.0s. Estimated remaining: 7m 29s. Rate: 143.2 symbols/min
[2025-10-24T01:24:18.734761] [INFO ] [MAIN      ] KLC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:18.840940] [DEBUG] [LOCAL     ] KKR: Loaded 53890 existing records from primary storage.
[2025-10-24T01:24:18.859909] [INFO ] [MAIN      ] KKR: Loaded 53890 primary data records.
[2025-10-24T01:24:19.143610] [DEBUG] [LOCAL     ] KLC: Loaded 36361 existing records from primary storage.
[2025-10-24T01:24:19.145485] [INFO ] [MAIN      ] KLC: Loaded 36361 primary data records.
[2025-10-24T01:24:19.769421] [DEBUG] [MAIN      ] KKRS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:24:19.832265] [DEBUG] [MAIN      ] KKR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:19.879824] [DEBUG] [MAIN      ] KLC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:19.908285] [INFO ] [MAIN      ] KKRS: Generated 139 derivative records from 5564 primary records.
[2025-10-24T01:24:19.913935] [DEBUG] [LOCAL     ] KKRS: Saving derivative data.
[2025-10-24T01:24:19.936125] [DEBUG] [LOCAL     ] KKRS: Derivative data saved (139 records).
[2025-10-24T01:24:19.939951] [INFO ] [MAIN      ] KKRS: Successfully saved derivative data.
[2025-10-24T01:24:19.943295] [INFO ] [MAIN      ] Derivative Progress: 1093/2164 symbols completed. KKRS took 1.3s. Estimated remaining: 7m 30s. Rate: 142.9 symbols/min
[2025-10-24T01:24:19.956618] [INFO ] [MAIN      ] KKR: Generated 139 derivative records from 53890 primary records.
[2025-10-24T01:24:19.958166] [DEBUG] [LOCAL     ] KKR: Saving derivative data.
[2025-10-24T01:24:19.977510] [INFO ] [MAIN      ] KLC: Generated 139 derivative records from 36361 primary records.
[2025-10-24T01:24:19.978928] [DEBUG] [LOCAL     ] KKR: Derivative data saved (139 records).
[2025-10-24T01:24:19.979056] [DEBUG] [LOCAL     ] KLC: Saving derivative data.
[2025-10-24T01:24:19.979391] [INFO ] [MAIN      ] KKR: Successfully saved derivative data.
[2025-10-24T01:24:19.984346] [INFO ] [MAIN      ] Derivative Progress: 1094/2164 symbols completed. KKR took 1.4s. Estimated remaining: 7m 29s. Rate: 143.0 symbols/min
[2025-10-24T01:24:19.997094] [DEBUG] [LOCAL     ] KLC: Derivative data saved (139 records).
[2025-10-24T01:24:19.997263] [INFO ] [MAIN      ] KLC: Successfully saved derivative data.
[2025-10-24T01:24:20.000320] [INFO ] [MAIN      ] Derivative Progress: 1095/2164 symbols completed. KLC took 1.3s. Estimated remaining: 7m 28s. Rate: 143.2 symbols/min
[2025-10-24T01:24:20.000773] [INFO ] [MAIN      ] KMPB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:20.001081] [INFO ] [MAIN      ] KMPR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:20.000900] [INFO ] [MAIN      ] KMI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:20.011397] [DEBUG] [LOCAL     ] KMPB: Loaded 3495 existing records from primary storage.
[2025-10-24T01:24:20.011877] [INFO ] [MAIN      ] KMPB: Loaded 3495 primary data records.
[2025-10-24T01:24:20.260837] [DEBUG] [LOCAL     ] KMPR: Loaded 40795 existing records from primary storage.
[2025-10-24T01:24:20.266173] [INFO ] [MAIN      ] KMPR: Loaded 40795 primary data records.
[2025-10-24T01:24:20.534729] [DEBUG] [LOCAL     ] KMI: Loaded 54083 existing records from primary storage.
[2025-10-24T01:24:20.551297] [INFO ] [MAIN      ] KMI: Loaded 54083 primary data records.
[2025-10-24T01:24:21.086458] [DEBUG] [MAIN      ] KMPB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:21.132893] [DEBUG] [MAIN      ] KMPR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:21.177626] [INFO ] [MAIN      ] KMPB: Generated 139 derivative records from 3495 primary records.
[2025-10-24T01:24:21.178411] [DEBUG] [MAIN      ] KMI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:21.189496] [DEBUG] [LOCAL     ] KMPB: Saving derivative data.
[2025-10-24T01:24:21.206432] [DEBUG] [LOCAL     ] KMPB: Derivative data saved (139 records).
[2025-10-24T01:24:21.210737] [INFO ] [MAIN      ] KMPB: Successfully saved derivative data.
[2025-10-24T01:24:21.215624] [INFO ] [MAIN      ] Derivative Progress: 1096/2164 symbols completed. KMPB took 1.2s. Estimated remaining: 7m 28s. Rate: 142.9 symbols/min
[2025-10-24T01:24:21.216250] [INFO ] [MAIN      ] KMT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:21.237620] [INFO ] [MAIN      ] KMPR: Generated 139 derivative records from 40795 primary records.
[2025-10-24T01:24:21.238104] [DEBUG] [LOCAL     ] KMPR: Saving derivative data.
[2025-10-24T01:24:21.257391] [DEBUG] [LOCAL     ] KMPR: Derivative data saved (139 records).
[2025-10-24T01:24:21.268385] [INFO ] [MAIN      ] KMPR: Successfully saved derivative data.
[2025-10-24T01:24:21.271004] [INFO ] [MAIN      ] Derivative Progress: 1097/2164 symbols completed. KMPR took 1.3s. Estimated remaining: 7m 28s. Rate: 143.0 symbols/min
[2025-10-24T01:24:21.273325] [INFO ] [MAIN      ] KMX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:21.273559] [INFO ] [MAIN      ] KMI: Generated 139 derivative records from 54083 primary records.
[2025-10-24T01:24:21.274054] [DEBUG] [LOCAL     ] KMI: Saving derivative data.
[2025-10-24T01:24:21.300513] [DEBUG] [LOCAL     ] KMI: Derivative data saved (139 records).
[2025-10-24T01:24:21.301855] [DEBUG] [LOCAL     ] KMT: Loaded 43150 existing records from primary storage.
[2025-10-24T01:24:21.302118] [INFO ] [MAIN      ] KMT: Loaded 43150 primary data records.
[2025-10-24T01:24:21.302416] [INFO ] [MAIN      ] KMI: Successfully saved derivative data.
[2025-10-24T01:24:21.369300] [INFO ] [MAIN      ] Derivative Progress: 1098/2164 symbols completed. KMI took 1.4s. Estimated remaining: 7m 27s. Rate: 143.1 symbols/min
[2025-10-24T01:24:21.405526] [INFO ] [MAIN      ] KN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:21.656317] [DEBUG] [LOCAL     ] KMX: Loaded 53676 existing records from primary storage.
[2025-10-24T01:24:21.656922] [INFO ] [MAIN      ] KMX: Loaded 53676 primary data records.
[2025-10-24T01:24:21.813606] [DEBUG] [LOCAL     ] KN: Loaded 38737 existing records from primary storage.
[2025-10-24T01:24:21.834900] [INFO ] [MAIN      ] KN: Loaded 38737 primary data records.
[2025-10-24T01:24:22.317982] [DEBUG] [MAIN      ] KMT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:22.470475] [DEBUG] [MAIN      ] KMX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:22.486531] [INFO ] [MAIN      ] KMT: Generated 139 derivative records from 43150 primary records.
[2025-10-24T01:24:22.490048] [DEBUG] [LOCAL     ] KMT: Saving derivative data.
[2025-10-24T01:24:22.517429] [DEBUG] [LOCAL     ] KMT: Derivative data saved (139 records).
[2025-10-24T01:24:22.523284] [INFO ] [MAIN      ] KMT: Successfully saved derivative data.
[2025-10-24T01:24:22.527284] [DEBUG] [MAIN      ] KN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:22.530241] [INFO ] [MAIN      ] Derivative Progress: 1099/2164 symbols completed. KMT took 1.3s. Estimated remaining: 7m 27s. Rate: 142.9 symbols/min
[2025-10-24T01:24:22.547377] [INFO ] [MAIN      ] KNF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:22.611833] [DEBUG] [LOCAL     ] KNF: Loaded 36958 existing records from primary storage.
[2025-10-24T01:24:22.597456] [INFO ] [MAIN      ] KMX: Generated 139 derivative records from 53676 primary records.
[2025-10-24T01:24:22.616726] [INFO ] [MAIN      ] KNF: Loaded 36958 primary data records.
[2025-10-24T01:24:22.617177] [DEBUG] [LOCAL     ] KMX: Saving derivative data.
[2025-10-24T01:24:22.765260] [INFO ] [MAIN      ] KN: Generated 139 derivative records from 38737 primary records.
[2025-10-24T01:24:22.770616] [DEBUG] [LOCAL     ] KN: Saving derivative data.
[2025-10-24T01:24:22.746912] [DEBUG] [LOCAL     ] KMX: Derivative data saved (139 records).
[2025-10-24T01:24:22.786309] [INFO ] [MAIN      ] KMX: Successfully saved derivative data.
[2025-10-24T01:24:22.798965] [INFO ] [MAIN      ] Derivative Progress: 1100/2164 symbols completed. KMX took 1.5s. Estimated remaining: 7m 27s. Rate: 142.9 symbols/min
[2025-10-24T01:24:22.799749] [INFO ] [MAIN      ] KNOP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:22.842004] [DEBUG] [LOCAL     ] KN: Derivative data saved (139 records).
[2025-10-24T01:24:22.950932] [INFO ] [MAIN      ] KN: Successfully saved derivative data.
[2025-10-24T01:24:22.970183] [INFO ] [MAIN      ] Derivative Progress: 1101/2164 symbols completed. KN took 1.6s. Estimated remaining: 7m 26s. Rate: 143.0 symbols/min
[2025-10-24T01:24:22.970865] [INFO ] [MAIN      ] KNSL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:22.978594] [DEBUG] [LOCAL     ] KNOP: Loaded 10130 existing records from primary storage.
[2025-10-24T01:24:22.978929] [INFO ] [MAIN      ] KNOP: Loaded 10130 primary data records.
[2025-10-24T01:24:23.157745] [DEBUG] [LOCAL     ] KNSL: Loaded 18471 existing records from primary storage.
[2025-10-24T01:24:23.293706] [INFO ] [MAIN      ] KNSL: Loaded 18471 primary data records.
[2025-10-24T01:24:23.532868] [DEBUG] [MAIN      ] KNF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:23.715833] [DEBUG] [MAIN      ] KNOP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:23.778034] [INFO ] [MAIN      ] KNF: Generated 139 derivative records from 36958 primary records.
[2025-10-24T01:24:23.781463] [DEBUG] [LOCAL     ] KNF: Saving derivative data.
[2025-10-24T01:24:23.806895] [DEBUG] [LOCAL     ] KNF: Derivative data saved (139 records).
[2025-10-24T01:24:23.810234] [INFO ] [MAIN      ] KNF: Successfully saved derivative data.
[2025-10-24T01:24:23.817254] [INFO ] [MAIN      ] Derivative Progress: 1102/2164 symbols completed. KNF took 1.3s. Estimated remaining: 7m 26s. Rate: 142.9 symbols/min
[2025-10-24T01:24:23.831723] [INFO ] [MAIN      ] KNTK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:23.831278] [INFO ] [MAIN      ] KNOP: Generated 139 derivative records from 10130 primary records.
[2025-10-24T01:24:23.833327] [DEBUG] [MAIN      ] KNSL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:23.833432] [DEBUG] [LOCAL     ] KNOP: Saving derivative data.
[2025-10-24T01:24:23.861704] [DEBUG] [LOCAL     ] KNOP: Derivative data saved (139 records).
[2025-10-24T01:24:23.863337] [INFO ] [MAIN      ] KNOP: Successfully saved derivative data.
[2025-10-24T01:24:23.867108] [INFO ] [MAIN      ] Derivative Progress: 1103/2164 symbols completed. KNOP took 1.1s. Estimated remaining: 7m 25s. Rate: 143.0 symbols/min
[2025-10-24T01:24:23.870300] [INFO ] [MAIN      ] KNX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:23.909152] [INFO ] [MAIN      ] KNSL: Generated 139 derivative records from 18471 primary records.
[2025-10-24T01:24:23.909451] [DEBUG] [LOCAL     ] KNSL: Saving derivative data.
[2025-10-24T01:24:23.924690] [DEBUG] [LOCAL     ] KNSL: Derivative data saved (139 records).
[2025-10-24T01:24:23.926371] [INFO ] [MAIN      ] KNSL: Successfully saved derivative data.
[2025-10-24T01:24:23.930539] [INFO ] [MAIN      ] Derivative Progress: 1104/2164 symbols completed. KNSL took 1.0s. Estimated remaining: 7m 24s. Rate: 143.1 symbols/min
[2025-10-24T01:24:23.947636] [INFO ] [MAIN      ] KODK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:23.963527] [DEBUG] [LOCAL     ] KNTK: Loaded 47587 existing records from primary storage.
[2025-10-24T01:24:23.964011] [INFO ] [MAIN      ] KNTK: Loaded 47587 primary data records.
[2025-10-24T01:24:24.102762] [DEBUG] [LOCAL     ] KNX: Loaded 53035 existing records from primary storage.
[2025-10-24T01:24:24.127961] [INFO ] [MAIN      ] KNX: Loaded 53035 primary data records.
[2025-10-24T01:24:24.524928] [DEBUG] [LOCAL     ] KODK: Loaded 44027 existing records from primary storage.
[2025-10-24T01:24:24.526672] [INFO ] [MAIN      ] KODK: Loaded 44027 primary data records.
[2025-10-24T01:24:25.055936] [DEBUG] [MAIN      ] KNTK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:25.100703] [DEBUG] [MAIN      ] KNX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:25.142755] [DEBUG] [MAIN      ] KODK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:25.166859] [INFO ] [MAIN      ] KNTK: Generated 139 derivative records from 47587 primary records.
[2025-10-24T01:24:25.168679] [DEBUG] [LOCAL     ] KNTK: Saving derivative data.
[2025-10-24T01:24:25.188241] [DEBUG] [LOCAL     ] KNTK: Derivative data saved (139 records).
[2025-10-24T01:24:25.191905] [INFO ] [MAIN      ] KNTK: Successfully saved derivative data.
[2025-10-24T01:24:25.195559] [INFO ] [MAIN      ] Derivative Progress: 1105/2164 symbols completed. KNTK took 1.4s. Estimated remaining: 7m 25s. Rate: 142.8 symbols/min
[2025-10-24T01:24:25.199576] [INFO ] [MAIN      ] KOF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:25.207996] [INFO ] [MAIN      ] KNX: Generated 139 derivative records from 53035 primary records.
[2025-10-24T01:24:25.208234] [DEBUG] [LOCAL     ] KNX: Saving derivative data.
[2025-10-24T01:24:25.224179] [DEBUG] [LOCAL     ] KNX: Derivative data saved (139 records).
[2025-10-24T01:24:25.224560] [INFO ] [MAIN      ] KNX: Successfully saved derivative data.
[2025-10-24T01:24:25.226990] [INFO ] [MAIN      ] Derivative Progress: 1106/2164 symbols completed. KNX took 1.4s. Estimated remaining: 7m 24s. Rate: 143.0 symbols/min
[2025-10-24T01:24:25.228673] [INFO ] [MAIN      ] KOP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:25.232275] [INFO ] [MAIN      ] KODK: Generated 139 derivative records from 44027 primary records.
[2025-10-24T01:24:25.232515] [DEBUG] [LOCAL     ] KODK: Saving derivative data.
[2025-10-24T01:24:25.253036] [DEBUG] [LOCAL     ] KODK: Derivative data saved (139 records).
[2025-10-24T01:24:25.253270] [INFO ] [MAIN      ] KODK: Successfully saved derivative data.
[2025-10-24T01:24:25.257521] [INFO ] [MAIN      ] Derivative Progress: 1107/2164 symbols completed. KODK took 1.3s. Estimated remaining: 7m 23s. Rate: 143.1 symbols/min
[2025-10-24T01:24:25.273742] [INFO ] [MAIN      ] KORE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:25.268358] [DEBUG] [LOCAL     ] KOF: Loaded 26676 existing records from primary storage.
[2025-10-24T01:24:25.274747] [INFO ] [MAIN      ] KOF: Loaded 26676 primary data records.
[2025-10-24T01:24:25.348769] [DEBUG] [LOCAL     ] KOP: Loaded 17418 existing records from primary storage.
[2025-10-24T01:24:25.380502] [DEBUG] [LOCAL     ] KORE: Loaded 2189 existing records from primary storage.
[2025-10-24T01:24:25.380687] [INFO ] [MAIN      ] KOP: Loaded 17418 primary data records.
[2025-10-24T01:24:25.392827] [INFO ] [MAIN      ] KORE: Loaded 2189 primary data records.
[2025-10-24T01:24:26.390209] [DEBUG] [MAIN      ] KOF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:26.450347] [DEBUG] [MAIN      ] KORE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:26.451138] [DEBUG] [MAIN      ] KOP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:26.532182] [INFO ] [MAIN      ] KOF: Generated 139 derivative records from 26676 primary records.
[2025-10-24T01:24:26.538900] [DEBUG] [LOCAL     ] KOF: Saving derivative data.
[2025-10-24T01:24:26.559770] [DEBUG] [LOCAL     ] KOF: Derivative data saved (139 records).
[2025-10-24T01:24:26.563430] [INFO ] [MAIN      ] KOF: Successfully saved derivative data.
[2025-10-24T01:24:26.569295] [INFO ] [MAIN      ] Derivative Progress: 1108/2164 symbols completed. KOF took 1.4s. Estimated remaining: 7m 24s. Rate: 142.8 symbols/min
[2025-10-24T01:24:26.569784] [INFO ] [MAIN      ] KORE: Generated 139 derivative records from 2189 primary records.
[2025-10-24T01:24:26.572726] [DEBUG] [LOCAL     ] KORE: Saving derivative data.
[2025-10-24T01:24:26.575006] [INFO ] [MAIN      ] KOP: Generated 139 derivative records from 17418 primary records.
[2025-10-24T01:24:26.575476] [DEBUG] [LOCAL     ] KOP: Saving derivative data.
[2025-10-24T01:24:26.597019] [DEBUG] [LOCAL     ] KORE: Derivative data saved (139 records).
[2025-10-24T01:24:26.600410] [DEBUG] [LOCAL     ] KOP: Derivative data saved (139 records).
[2025-10-24T01:24:26.600715] [INFO ] [MAIN      ] KORE: Successfully saved derivative data.
[2025-10-24T01:24:26.600635] [INFO ] [MAIN      ] KOP: Successfully saved derivative data.
[2025-10-24T01:24:26.604460] [INFO ] [MAIN      ] Derivative Progress: 1109/2164 symbols completed. KORE took 1.3s. Estimated remaining: 7m 23s. Rate: 142.9 symbols/min
[2025-10-24T01:24:26.609160] [INFO ] [MAIN      ] Derivative Progress: 1110/2164 symbols completed. KOP took 1.4s. Estimated remaining: 7m 22s. Rate: 143.1 symbols/min
[2025-10-24T01:24:26.609935] [INFO ] [MAIN      ] KR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:26.609999] [INFO ] [MAIN      ] KRC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:26.609795] [INFO ] [MAIN      ] KOS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:26.733064] [DEBUG] [LOCAL     ] KRC: Loaded 48386 existing records from primary storage.
[2025-10-24T01:24:26.736008] [DEBUG] [LOCAL     ] KR: Loaded 54071 existing records from primary storage.
[2025-10-24T01:24:26.736282] [INFO ] [MAIN      ] KRC: Loaded 48386 primary data records.
[2025-10-24T01:24:26.736428] [INFO ] [MAIN      ] KR: Loaded 54071 primary data records.
[2025-10-24T01:24:26.737245] [DEBUG] [LOCAL     ] KOS: Loaded 53483 existing records from primary storage.
[2025-10-24T01:24:26.768093] [INFO ] [MAIN      ] KOS: Loaded 53483 primary data records.
[2025-10-24T01:24:27.812575] [DEBUG] [MAIN      ] KRC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:27.857126] [DEBUG] [MAIN      ] KOS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:27.888164] [DEBUG] [MAIN      ] KR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:27.980947] [INFO ] [MAIN      ] KRC: Generated 139 derivative records from 48386 primary records.
[2025-10-24T01:24:27.987108] [DEBUG] [LOCAL     ] KRC: Saving derivative data.
[2025-10-24T01:24:28.002220] [INFO ] [MAIN      ] KOS: Generated 139 derivative records from 53483 primary records.
[2025-10-24T01:24:28.007481] [DEBUG] [LOCAL     ] KRC: Derivative data saved (139 records).
[2025-10-24T01:24:28.012888] [DEBUG] [LOCAL     ] KOS: Saving derivative data.
[2025-10-24T01:24:28.014324] [INFO ] [MAIN      ] KRC: Successfully saved derivative data.
[2025-10-24T01:24:28.019111] [INFO ] [MAIN      ] Derivative Progress: 1111/2164 symbols completed. KRC took 1.4s. Estimated remaining: 7m 23s. Rate: 142.8 symbols/min
[2025-10-24T01:24:28.026917] [INFO ] [MAIN      ] KREF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:28.038174] [INFO ] [MAIN      ] KR: Generated 139 derivative records from 54071 primary records.
[2025-10-24T01:24:28.038553] [DEBUG] [LOCAL     ] KR: Saving derivative data.
[2025-10-24T01:24:28.037138] [DEBUG] [LOCAL     ] KOS: Derivative data saved (139 records).
[2025-10-24T01:24:28.039375] [INFO ] [MAIN      ] KOS: Successfully saved derivative data.
[2025-10-24T01:24:28.042936] [INFO ] [MAIN      ] Derivative Progress: 1112/2164 symbols completed. KOS took 1.4s. Estimated remaining: 7m 22s. Rate: 142.9 symbols/min
[2025-10-24T01:24:28.051759] [INFO ] [MAIN      ] KRG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:28.057495] [DEBUG] [LOCAL     ] KR: Derivative data saved (139 records).
[2025-10-24T01:24:28.058396] [INFO ] [MAIN      ] KR: Successfully saved derivative data.
[2025-10-24T01:24:28.062991] [INFO ] [MAIN      ] Derivative Progress: 1113/2164 symbols completed. KR took 1.5s. Estimated remaining: 7m 21s. Rate: 143.0 symbols/min
[2025-10-24T01:24:28.063893] [INFO ] [MAIN      ] KRO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:28.122689] [DEBUG] [LOCAL     ] KRO: Loaded 26739 existing records from primary storage.
[2025-10-24T01:24:28.124336] [INFO ] [MAIN      ] KRO: Loaded 26739 primary data records.
[2025-10-24T01:24:28.123822] [DEBUG] [LOCAL     ] KREF: Loaded 38364 existing records from primary storage.
[2025-10-24T01:24:28.161089] [INFO ] [MAIN      ] KREF: Loaded 38364 primary data records.
[2025-10-24T01:24:28.405179] [DEBUG] [LOCAL     ] KRG: Loaded 49641 existing records from primary storage.
[2025-10-24T01:24:28.460375] [INFO ] [MAIN      ] KRG: Loaded 49641 primary data records.
[2025-10-24T01:24:29.300726] [DEBUG] [MAIN      ] KREF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:29.300342] [DEBUG] [MAIN      ] KRO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:29.361300] [DEBUG] [MAIN      ] KRG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:29.417563] [INFO ] [MAIN      ] KREF: Generated 139 derivative records from 38364 primary records.
[2025-10-24T01:24:29.421305] [DEBUG] [LOCAL     ] KREF: Saving derivative data.
[2025-10-24T01:24:29.443559] [DEBUG] [LOCAL     ] KREF: Derivative data saved (139 records).
[2025-10-24T01:24:29.446544] [INFO ] [MAIN      ] KRO: Generated 139 derivative records from 26739 primary records.
[2025-10-24T01:24:29.446637] [INFO ] [MAIN      ] KREF: Successfully saved derivative data.
[2025-10-24T01:24:29.449631] [DEBUG] [LOCAL     ] KRO: Saving derivative data.
[2025-10-24T01:24:29.453228] [INFO ] [MAIN      ] Derivative Progress: 1114/2164 symbols completed. KREF took 1.4s. Estimated remaining: 7m 21s. Rate: 142.7 symbols/min
[2025-10-24T01:24:29.454586] [INFO ] [MAIN      ] KRP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:29.470036] [INFO ] [MAIN      ] KRG: Generated 139 derivative records from 49641 primary records.
[2025-10-24T01:24:29.471916] [DEBUG] [LOCAL     ] KRG: Saving derivative data.
[2025-10-24T01:24:29.482089] [DEBUG] [LOCAL     ] KRO: Derivative data saved (139 records).
[2025-10-24T01:24:29.484752] [INFO ] [MAIN      ] KRO: Successfully saved derivative data.
[2025-10-24T01:24:29.488905] [INFO ] [MAIN      ] Derivative Progress: 1115/2164 symbols completed. KRO took 1.4s. Estimated remaining: 7m 21s. Rate: 142.8 symbols/min
[2025-10-24T01:24:29.489813] [INFO ] [MAIN      ] KSS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:29.491356] [DEBUG] [LOCAL     ] KRG: Derivative data saved (139 records).
[2025-10-24T01:24:29.491491] [INFO ] [MAIN      ] KRG: Successfully saved derivative data.
[2025-10-24T01:24:29.495851] [INFO ] [MAIN      ] Derivative Progress: 1116/2164 symbols completed. KRG took 1.4s. Estimated remaining: 7m 20s. Rate: 142.9 symbols/min
[2025-10-24T01:24:29.496373] [INFO ] [MAIN      ] KT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:29.536700] [DEBUG] [LOCAL     ] KRP: Loaded 36127 existing records from primary storage.
[2025-10-24T01:24:29.537002] [INFO ] [MAIN      ] KRP: Loaded 36127 primary data records.
[2025-10-24T01:24:29.932038] [DEBUG] [LOCAL     ] KSS: Loaded 53970 existing records from primary storage.
[2025-10-24T01:24:29.947513] [DEBUG] [LOCAL     ] KT: Loaded 45680 existing records from primary storage.
[2025-10-24T01:24:29.947993] [INFO ] [MAIN      ] KT: Loaded 45680 primary data records.
[2025-10-24T01:24:29.947737] [INFO ] [MAIN      ] KSS: Loaded 53970 primary data records.
[2025-10-24T01:24:30.621448] [DEBUG] [MAIN      ] KRP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:30.677003] [DEBUG] [MAIN      ] KT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:30.713276] [DEBUG] [MAIN      ] KSS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:30.717759] [INFO ] [MAIN      ] KRP: Generated 139 derivative records from 36127 primary records.
[2025-10-24T01:24:30.721237] [DEBUG] [LOCAL     ] KRP: Saving derivative data.
[2025-10-24T01:24:30.759767] [DEBUG] [LOCAL     ] KRP: Derivative data saved (139 records).
[2025-10-24T01:24:30.765955] [INFO ] [MAIN      ] KRP: Successfully saved derivative data.
[2025-10-24T01:24:30.773280] [INFO ] [MAIN      ] Derivative Progress: 1117/2164 symbols completed. KRP took 1.3s. Estimated remaining: 7m 20s. Rate: 142.7 symbols/min
[2025-10-24T01:24:30.781786] [INFO ] [MAIN      ] KTB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:30.805546] [INFO ] [MAIN      ] KT: Generated 139 derivative records from 45680 primary records.
[2025-10-24T01:24:30.807545] [DEBUG] [LOCAL     ] KT: Saving derivative data.
[2025-10-24T01:24:30.828693] [DEBUG] [LOCAL     ] KT: Derivative data saved (139 records).
[2025-10-24T01:24:30.829478] [INFO ] [MAIN      ] KT: Successfully saved derivative data.
[2025-10-24T01:24:30.832506] [INFO ] [MAIN      ] Derivative Progress: 1118/2164 symbols completed. KT took 1.3s. Estimated remaining: 7m 20s. Rate: 142.8 symbols/min
[2025-10-24T01:24:30.847491] [INFO ] [MAIN      ] KTF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:30.847280] [INFO ] [MAIN      ] KSS: Generated 139 derivative records from 53970 primary records.
[2025-10-24T01:24:30.848465] [DEBUG] [LOCAL     ] KSS: Saving derivative data.
[2025-10-24T01:24:30.867009] [DEBUG] [LOCAL     ] KSS: Derivative data saved (139 records).
[2025-10-24T01:24:30.871328] [INFO ] [MAIN      ] KSS: Successfully saved derivative data.
[2025-10-24T01:24:30.876410] [INFO ] [MAIN      ] Derivative Progress: 1119/2164 symbols completed. KSS took 1.4s. Estimated remaining: 7m 19s. Rate: 142.9 symbols/min
[2025-10-24T01:24:30.889383] [INFO ] [MAIN      ] KVUE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:30.896405] [DEBUG] [LOCAL     ] KTF: Loaded 11723 existing records from primary storage.
[2025-10-24T01:24:30.898078] [DEBUG] [LOCAL     ] KTB: Loaded 40495 existing records from primary storage.
[2025-10-24T01:24:30.898927] [INFO ] [MAIN      ] KTF: Loaded 11723 primary data records.
[2025-10-24T01:24:30.898787] [INFO ] [MAIN      ] KTB: Loaded 40495 primary data records.
[2025-10-24T01:24:31.691029] [DEBUG] [LOCAL     ] KVUE: Loaded 54057 existing records from primary storage.
[2025-10-24T01:24:31.693447] [INFO ] [MAIN      ] KVUE: Loaded 54057 primary data records.
[2025-10-24T01:24:32.042505] [DEBUG] [MAIN      ] KTF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:32.070547] [DEBUG] [MAIN      ] KTB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:32.140463] [DEBUG] [MAIN      ] KVUE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:32.165570] [INFO ] [MAIN      ] KTF: Generated 139 derivative records from 11723 primary records.
[2025-10-24T01:24:32.170544] [DEBUG] [LOCAL     ] KTF: Saving derivative data.
[2025-10-24T01:24:32.188384] [DEBUG] [LOCAL     ] KTF: Derivative data saved (139 records).
[2025-10-24T01:24:32.192276] [INFO ] [MAIN      ] KTF: Successfully saved derivative data.
[2025-10-24T01:24:32.199108] [INFO ] [MAIN      ] Derivative Progress: 1120/2164 symbols completed. KTF took 1.4s. Estimated remaining: 7m 19s. Rate: 142.6 symbols/min
[2025-10-24T01:24:32.192491] [INFO ] [MAIN      ] KTB: Generated 139 derivative records from 40495 primary records.
[2025-10-24T01:24:32.199853] [INFO ] [MAIN      ] KVYO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:32.200512] [DEBUG] [LOCAL     ] KTB: Saving derivative data.
[2025-10-24T01:24:32.222188] [DEBUG] [LOCAL     ] KTB: Derivative data saved (139 records).
[2025-10-24T01:24:32.222746] [INFO ] [MAIN      ] KTB: Successfully saved derivative data.
[2025-10-24T01:24:32.225707] [INFO ] [MAIN      ] Derivative Progress: 1121/2164 symbols completed. KTB took 1.4s. Estimated remaining: 7m 18s. Rate: 142.7 symbols/min
[2025-10-24T01:24:32.230966] [INFO ] [MAIN      ] KW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:32.235629] [INFO ] [MAIN      ] KVUE: Generated 139 derivative records from 54057 primary records.
[2025-10-24T01:24:32.235943] [DEBUG] [LOCAL     ] KVUE: Saving derivative data.
[2025-10-24T01:24:32.250317] [DEBUG] [LOCAL     ] KVUE: Derivative data saved (139 records).
[2025-10-24T01:24:32.250979] [INFO ] [MAIN      ] KVUE: Successfully saved derivative data.
[2025-10-24T01:24:32.254160] [INFO ] [MAIN      ] Derivative Progress: 1122/2164 symbols completed. KVUE took 1.4s. Estimated remaining: 7m 18s. Rate: 142.9 symbols/min
[2025-10-24T01:24:32.254728] [INFO ] [MAIN      ] KWR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:32.311842] [DEBUG] [LOCAL     ] KVYO: Loaded 51270 existing records from primary storage.
[2025-10-24T01:24:32.313427] [INFO ] [MAIN      ] KVYO: Loaded 51270 primary data records.
[2025-10-24T01:24:32.433333] [DEBUG] [LOCAL     ] KW: Loaded 40548 existing records from primary storage.
[2025-10-24T01:24:32.420753] [DEBUG] [LOCAL     ] KWR: Loaded 15764 existing records from primary storage.
[2025-10-24T01:24:32.445795] [INFO ] [MAIN      ] KW: Loaded 40548 primary data records.
[2025-10-24T01:24:32.446234] [INFO ] [MAIN      ] KWR: Loaded 15764 primary data records.
[2025-10-24T01:24:33.388854] [DEBUG] [MAIN      ] KVYO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:33.446995] [DEBUG] [MAIN      ] KW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:33.477453] [DEBUG] [MAIN      ] KWR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:33.530385] [INFO ] [MAIN      ] KVYO: Generated 139 derivative records from 51270 primary records.
[2025-10-24T01:24:33.533071] [DEBUG] [LOCAL     ] KVYO: Saving derivative data.
[2025-10-24T01:24:33.557220] [DEBUG] [LOCAL     ] KVYO: Derivative data saved (139 records).
[2025-10-24T01:24:33.560260] [INFO ] [MAIN      ] KVYO: Successfully saved derivative data.
[2025-10-24T01:24:33.565828] [INFO ] [MAIN      ] Derivative Progress: 1123/2164 symbols completed. KVYO took 1.4s. Estimated remaining: 7m 18s. Rate: 142.6 symbols/min
[2025-10-24T01:24:33.572730] [INFO ] [MAIN      ] KW: Generated 139 derivative records from 40548 primary records.
[2025-10-24T01:24:33.576813] [DEBUG] [LOCAL     ] KW: Saving derivative data.
[2025-10-24T01:24:33.596022] [DEBUG] [LOCAL     ] KW: Derivative data saved (139 records).
[2025-10-24T01:24:33.598997] [INFO ] [MAIN      ] KW: Successfully saved derivative data.
[2025-10-24T01:24:33.598712] [INFO ] [MAIN      ] KWR: Generated 139 derivative records from 15764 primary records.
[2025-10-24T01:24:33.602380] [INFO ] [MAIN      ] Derivative Progress: 1124/2164 symbols completed. KW took 1.4s. Estimated remaining: 7m 17s. Rate: 142.7 symbols/min
[2025-10-24T01:24:33.602971] [DEBUG] [LOCAL     ] KWR: Saving derivative data.
[2025-10-24T01:24:33.617065] [DEBUG] [LOCAL     ] KWR: Derivative data saved (139 records).
[2025-10-24T01:24:33.617243] [INFO ] [MAIN      ] KWR: Successfully saved derivative data.
[2025-10-24T01:24:33.621377] [INFO ] [MAIN      ] Derivative Progress: 1125/2164 symbols completed. KWR took 1.4s. Estimated remaining: 7m 16s. Rate: 142.8 symbols/min
[2025-10-24T01:24:33.622096] [INFO ] [MAIN      ] KYN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:33.622361] [INFO ] [MAIN      ] LAC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:33.622204] [INFO ] [MAIN      ] L: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:33.676406] [DEBUG] [LOCAL     ] KYN: Loaded 30347 existing records from primary storage.
[2025-10-24T01:24:33.690292] [INFO ] [MAIN      ] KYN: Loaded 30347 primary data records.
[2025-10-24T01:24:33.719060] [DEBUG] [LOCAL     ] L: Loaded 41436 existing records from primary storage.
[2025-10-24T01:24:33.753104] [INFO ] [MAIN      ] L: Loaded 41436 primary data records.
[2025-10-24T01:24:33.936493] [DEBUG] [LOCAL     ] LAC: Loaded 52961 existing records from primary storage.
[2025-10-24T01:24:33.963095] [INFO ] [MAIN      ] LAC: Loaded 52961 primary data records.
[2025-10-24T01:24:34.685411] [DEBUG] [MAIN      ] KYN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:34.723497] [DEBUG] [MAIN      ] L: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:34.765754] [DEBUG] [MAIN      ] LAC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:34.802235] [INFO ] [MAIN      ] KYN: Generated 139 derivative records from 30347 primary records.
[2025-10-24T01:24:34.803094] [DEBUG] [LOCAL     ] KYN: Saving derivative data.
[2025-10-24T01:24:34.826472] [DEBUG] [LOCAL     ] KYN: Derivative data saved (139 records).
[2025-10-24T01:24:34.828231] [INFO ] [MAIN      ] KYN: Successfully saved derivative data.
[2025-10-24T01:24:34.833509] [INFO ] [MAIN      ] Derivative Progress: 1126/2164 symbols completed. KYN took 1.2s. Estimated remaining: 7m 17s. Rate: 142.6 symbols/min
[2025-10-24T01:24:34.834409] [INFO ] [MAIN      ] LAD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:34.842581] [INFO ] [MAIN      ] L: Generated 139 derivative records from 41436 primary records.
[2025-10-24T01:24:34.845358] [DEBUG] [LOCAL     ] L: Saving derivative data.
[2025-10-24T01:24:34.859586] [DEBUG] [LOCAL     ] L: Derivative data saved (139 records).
[2025-10-24T01:24:34.861711] [INFO ] [MAIN      ] LAC: Generated 139 derivative records from 52961 primary records.
[2025-10-24T01:24:34.861833] [DEBUG] [LOCAL     ] LAC: Saving derivative data.
[2025-10-24T01:24:34.861958] [INFO ] [MAIN      ] L: Successfully saved derivative data.
[2025-10-24T01:24:34.865094] [INFO ] [MAIN      ] Derivative Progress: 1127/2164 symbols completed. L took 1.2s. Estimated remaining: 7m 16s. Rate: 142.7 symbols/min
[2025-10-24T01:24:34.865384] [INFO ] [MAIN      ] LADR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:34.877380] [DEBUG] [LOCAL     ] LAC: Derivative data saved (139 records).
[2025-10-24T01:24:34.877746] [INFO ] [MAIN      ] LAC: Successfully saved derivative data.
[2025-10-24T01:24:34.880148] [INFO ] [MAIN      ] Derivative Progress: 1128/2164 symbols completed. LAC took 1.3s. Estimated remaining: 7m 15s. Rate: 142.8 symbols/min
[2025-10-24T01:24:34.880484] [INFO ] [MAIN      ] LANV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:34.891334] [DEBUG] [LOCAL     ] LANV: Loaded 2803 existing records from primary storage.
[2025-10-24T01:24:34.891706] [INFO ] [MAIN      ] LANV: Loaded 2803 primary data records.
[2025-10-24T01:24:34.978917] [DEBUG] [LOCAL     ] LAD: Loaded 23562 existing records from primary storage.
[2025-10-24T01:24:35.019468] [INFO ] [MAIN      ] LAD: Loaded 23562 primary data records.
[2025-10-24T01:24:35.204703] [DEBUG] [LOCAL     ] LADR: Loaded 39650 existing records from primary storage.
[2025-10-24T01:24:35.328115] [INFO ] [MAIN      ] LADR: Loaded 39650 primary data records.
[2025-10-24T01:24:35.916545] [DEBUG] [MAIN      ] LANV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:35.956615] [DEBUG] [MAIN      ] LAD: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:24:36.003847] [DEBUG] [MAIN      ] LADR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:36.035343] [INFO ] [MAIN      ] LANV: Generated 139 derivative records from 2803 primary records.
[2025-10-24T01:24:36.038428] [DEBUG] [LOCAL     ] LANV: Saving derivative data.
[2025-10-24T01:24:36.051263] [DEBUG] [LOCAL     ] LANV: Derivative data saved (139 records).
[2025-10-24T01:24:36.051503] [INFO ] [MAIN      ] LANV: Successfully saved derivative data.
[2025-10-24T01:24:36.054270] [INFO ] [MAIN      ] Derivative Progress: 1129/2164 symbols completed. LANV took 1.2s. Estimated remaining: 7m 15s. Rate: 142.6 symbols/min
[2025-10-24T01:24:36.057671] [INFO ] [MAIN      ] LAW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:36.073239] [INFO ] [MAIN      ] LAD: Generated 139 derivative records from 23562 primary records.
[2025-10-24T01:24:36.075099] [DEBUG] [LOCAL     ] LAD: Saving derivative data.
[2025-10-24T01:24:36.095726] [DEBUG] [LOCAL     ] LAW: Loaded 15075 existing records from primary storage.
[2025-10-24T01:24:36.097028] [INFO ] [MAIN      ] LAW: Loaded 15075 primary data records.
[2025-10-24T01:24:36.102815] [DEBUG] [LOCAL     ] LAD: Derivative data saved (139 records).
[2025-10-24T01:24:36.132457] [INFO ] [MAIN      ] LAD: Successfully saved derivative data.
[2025-10-24T01:24:36.179721] [INFO ] [MAIN      ] Derivative Progress: 1130/2164 symbols completed. LAD took 1.3s. Estimated remaining: 7m 15s. Rate: 142.7 symbols/min
[2025-10-24T01:24:36.205575] [INFO ] [MAIN      ] LAZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:36.220131] [INFO ] [MAIN      ] LADR: Generated 139 derivative records from 39650 primary records.
[2025-10-24T01:24:36.220743] [DEBUG] [LOCAL     ] LADR: Saving derivative data.
[2025-10-24T01:24:36.429259] [DEBUG] [LOCAL     ] LADR: Derivative data saved (139 records).
[2025-10-24T01:24:36.430203] [INFO ] [MAIN      ] LADR: Successfully saved derivative data.
[2025-10-24T01:24:36.433430] [INFO ] [MAIN      ] Derivative Progress: 1131/2164 symbols completed. LADR took 1.6s. Estimated remaining: 7m 14s. Rate: 142.7 symbols/min
[2025-10-24T01:24:36.433764] [INFO ] [MAIN      ] LB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:36.471821] [DEBUG] [LOCAL     ] LAZ: Loaded 44787 existing records from primary storage.
[2025-10-24T01:24:36.472036] [INFO ] [MAIN      ] LAZ: Loaded 44787 primary data records.
[2025-10-24T01:24:36.620997] [DEBUG] [MAIN      ] LAW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:36.633241] [DEBUG] [LOCAL     ] LB: Loaded 37214 existing records from primary storage.
[2025-10-24T01:24:36.683888] [INFO ] [MAIN      ] LB: Loaded 37214 primary data records.
[2025-10-24T01:24:37.162415] [INFO ] [MAIN      ] LAW: Generated 139 derivative records from 15075 primary records.
[2025-10-24T01:24:37.176055] [DEBUG] [MAIN      ] LAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:37.177197] [DEBUG] [LOCAL     ] LAW: Saving derivative data.
[2025-10-24T01:24:37.203967] [DEBUG] [LOCAL     ] LAW: Derivative data saved (139 records).
[2025-10-24T01:24:37.205097] [INFO ] [MAIN      ] LAW: Successfully saved derivative data.
[2025-10-24T01:24:37.208104] [INFO ] [MAIN      ] Derivative Progress: 1132/2164 symbols completed. LAW took 1.2s. Estimated remaining: 7m 14s. Rate: 142.6 symbols/min
[2025-10-24T01:24:37.209042] [INFO ] [MAIN      ] LBRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:37.233364] [DEBUG] [MAIN      ] LB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:37.267721] [INFO ] [MAIN      ] LAZ: Generated 139 derivative records from 44787 primary records.
[2025-10-24T01:24:37.283061] [DEBUG] [LOCAL     ] LAZ: Saving derivative data.
[2025-10-24T01:24:37.300620] [DEBUG] [LOCAL     ] LAZ: Derivative data saved (139 records).
[2025-10-24T01:24:37.304494] [INFO ] [MAIN      ] LAZ: Successfully saved derivative data.
[2025-10-24T01:24:37.307397] [INFO ] [MAIN      ] Derivative Progress: 1133/2164 symbols completed. LAZ took 1.1s. Estimated remaining: 7m 13s. Rate: 142.7 symbols/min
[2025-10-24T01:24:37.310917] [INFO ] [MAIN      ] LC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:37.329561] [DEBUG] [LOCAL     ] LBRT: Loaded 53393 existing records from primary storage.
[2025-10-24T01:24:37.329819] [INFO ] [MAIN      ] LBRT: Loaded 53393 primary data records.
[2025-10-24T01:24:37.371912] [INFO ] [MAIN      ] LB: Generated 139 derivative records from 37214 primary records.
[2025-10-24T01:24:37.406008] [DEBUG] [LOCAL     ] LB: Saving derivative data.
[2025-10-24T01:24:37.453160] [DEBUG] [LOCAL     ] LB: Derivative data saved (139 records).
[2025-10-24T01:24:37.474083] [INFO ] [MAIN      ] LB: Successfully saved derivative data.
[2025-10-24T01:24:37.542972] [INFO ] [MAIN      ] Derivative Progress: 1134/2164 symbols completed. LB took 1.1s. Estimated remaining: 7m 13s. Rate: 142.8 symbols/min
[2025-10-24T01:24:37.543280] [INFO ] [MAIN      ] LCII: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:37.739424] [DEBUG] [LOCAL     ] LC: Loaded 48645 existing records from primary storage.
[2025-10-24T01:24:37.747980] [INFO ] [MAIN      ] LC: Loaded 48645 primary data records.
[2025-10-24T01:24:37.865044] [DEBUG] [LOCAL     ] LCII: Loaded 26970 existing records from primary storage.
[2025-10-24T01:24:37.871290] [INFO ] [MAIN      ] LCII: Loaded 26970 primary data records.
[2025-10-24T01:24:38.248598] [DEBUG] [MAIN      ] LBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:38.452214] [INFO ] [MAIN      ] LBRT: Generated 139 derivative records from 53393 primary records.
[2025-10-24T01:24:38.461365] [DEBUG] [LOCAL     ] LBRT: Saving derivative data.
[2025-10-24T01:24:38.467445] [DEBUG] [MAIN      ] LC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:38.495588] [DEBUG] [LOCAL     ] LBRT: Derivative data saved (139 records).
[2025-10-24T01:24:38.496186] [INFO ] [MAIN      ] LBRT: Successfully saved derivative data.
[2025-10-24T01:24:38.499136] [INFO ] [MAIN      ] Derivative Progress: 1135/2164 symbols completed. LBRT took 1.3s. Estimated remaining: 7m 13s. Rate: 142.6 symbols/min
[2025-10-24T01:24:38.501239] [INFO ] [MAIN      ] LDI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:38.525024] [DEBUG] [MAIN      ] LCII: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:24:38.567910] [INFO ] [MAIN      ] LC: Generated 139 derivative records from 48645 primary records.
[2025-10-24T01:24:38.568423] [DEBUG] [LOCAL     ] LC: Saving derivative data.
[2025-10-24T01:24:38.599969] [DEBUG] [LOCAL     ] LC: Derivative data saved (139 records).
[2025-10-24T01:24:38.601444] [INFO ] [MAIN      ] LC: Successfully saved derivative data.
[2025-10-24T01:24:38.602291] [DEBUG] [LOCAL     ] LDI: Loaded 45498 existing records from primary storage.
[2025-10-24T01:24:38.605887] [INFO ] [MAIN      ] LDI: Loaded 45498 primary data records.
[2025-10-24T01:24:38.608604] [INFO ] [MAIN      ] Derivative Progress: 1136/2164 symbols completed. LC took 1.3s. Estimated remaining: 7m 12s. Rate: 142.7 symbols/min
[2025-10-24T01:24:38.616236] [INFO ] [MAIN      ] LDOS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:38.733985] [INFO ] [MAIN      ] LCII: Generated 139 derivative records from 26970 primary records.
[2025-10-24T01:24:38.760785] [DEBUG] [LOCAL     ] LCII: Saving derivative data.
[2025-10-24T01:24:38.967435] [DEBUG] [LOCAL     ] LCII: Derivative data saved (139 records).
[2025-10-24T01:24:38.971050] [INFO ] [MAIN      ] LCII: Successfully saved derivative data.
[2025-10-24T01:24:38.974135] [INFO ] [MAIN      ] Derivative Progress: 1137/2164 symbols completed. LCII took 1.4s. Estimated remaining: 7m 12s. Rate: 142.7 symbols/min
[2025-10-24T01:24:38.990253] [INFO ] [MAIN      ] LEA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:38.994922] [DEBUG] [LOCAL     ] LDOS: Loaded 44903 existing records from primary storage.
[2025-10-24T01:24:38.995607] [INFO ] [MAIN      ] LDOS: Loaded 44903 primary data records.
[2025-10-24T01:24:39.328895] [DEBUG] [MAIN      ] LDI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:39.358447] [DEBUG] [LOCAL     ] LEA: Loaded 41368 existing records from primary storage.
[2025-10-24T01:24:39.360793] [INFO ] [MAIN      ] LEA: Loaded 41368 primary data records.
[2025-10-24T01:24:39.735397] [INFO ] [MAIN      ] LDI: Generated 139 derivative records from 45498 primary records.
[2025-10-24T01:24:39.736045] [DEBUG] [MAIN      ] LDOS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:39.736119] [DEBUG] [LOCAL     ] LDI: Saving derivative data.
[2025-10-24T01:24:39.764792] [DEBUG] [LOCAL     ] LDI: Derivative data saved (139 records).
[2025-10-24T01:24:39.766684] [INFO ] [MAIN      ] LDI: Successfully saved derivative data.
[2025-10-24T01:24:39.769958] [INFO ] [MAIN      ] Derivative Progress: 1138/2164 symbols completed. LDI took 1.3s. Estimated remaining: 7m 12s. Rate: 142.6 symbols/min
[2025-10-24T01:24:39.791912] [INFO ] [MAIN      ] LDOS: Generated 139 derivative records from 44903 primary records.
[2025-10-24T01:24:39.793992] [DEBUG] [LOCAL     ] LDOS: Saving derivative data.
[2025-10-24T01:24:39.820869] [DEBUG] [LOCAL     ] LDOS: Derivative data saved (139 records).
[2025-10-24T01:24:39.818051] [DEBUG] [MAIN      ] LEA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:39.821116] [INFO ] [MAIN      ] LDOS: Successfully saved derivative data.
[2025-10-24T01:24:39.835464] [INFO ] [MAIN      ] Derivative Progress: 1139/2164 symbols completed. LDOS took 1.2s. Estimated remaining: 7m 11s. Rate: 142.7 symbols/min
[2025-10-24T01:24:39.851837] [INFO ] [MAIN      ] LEA: Generated 139 derivative records from 41368 primary records.
[2025-10-24T01:24:39.852015] [DEBUG] [LOCAL     ] LEA: Saving derivative data.
[2025-10-24T01:24:39.864860] [DEBUG] [LOCAL     ] LEA: Derivative data saved (139 records).
[2025-10-24T01:24:39.864993] [INFO ] [MAIN      ] LEA: Successfully saved derivative data.
[2025-10-24T01:24:39.868356] [INFO ] [MAIN      ] Derivative Progress: 1140/2164 symbols completed. LEA took 0.9s. Estimated remaining: 7m 10s. Rate: 142.9 symbols/min
[2025-10-24T01:24:39.868810] [INFO ] [MAIN      ] LEG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:39.869055] [INFO ] [MAIN      ] LEO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:39.868986] [INFO ] [MAIN      ] LEN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:39.897191] [DEBUG] [LOCAL     ] LEO: Loaded 16918 existing records from primary storage.
[2025-10-24T01:24:39.897349] [INFO ] [MAIN      ] LEO: Loaded 16918 primary data records.
[2025-10-24T01:24:40.124190] [DEBUG] [LOCAL     ] LEG: Loaded 50311 existing records from primary storage.
[2025-10-24T01:24:40.275176] [INFO ] [MAIN      ] LEG: Loaded 50311 primary data records.
[2025-10-24T01:24:40.276104] [DEBUG] [LOCAL     ] LEN: Loaded 53586 existing records from primary storage.
[2025-10-24T01:24:40.276247] [INFO ] [MAIN      ] LEN: Loaded 53586 primary data records.
[2025-10-24T01:24:40.889317] [DEBUG] [MAIN      ] LEO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:40.937988] [DEBUG] [MAIN      ] LEG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:40.980056] [INFO ] [MAIN      ] LEO: Generated 139 derivative records from 16918 primary records.
[2025-10-24T01:24:40.979563] [DEBUG] [MAIN      ] LEN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:40.998305] [DEBUG] [LOCAL     ] LEO: Saving derivative data.
[2025-10-24T01:24:41.018683] [DEBUG] [LOCAL     ] LEO: Derivative data saved (139 records).
[2025-10-24T01:24:41.019235] [INFO ] [MAIN      ] LEO: Successfully saved derivative data.
[2025-10-24T01:24:41.023752] [INFO ] [MAIN      ] Derivative Progress: 1141/2164 symbols completed. LEO took 1.2s. Estimated remaining: 7m 10s. Rate: 142.6 symbols/min
[2025-10-24T01:24:41.025480] [INFO ] [MAIN      ] LEVI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:41.045921] [INFO ] [MAIN      ] LEG: Generated 139 derivative records from 50311 primary records.
[2025-10-24T01:24:41.049060] [DEBUG] [LOCAL     ] LEG: Saving derivative data.
[2025-10-24T01:24:41.063944] [DEBUG] [LOCAL     ] LEG: Derivative data saved (139 records).
[2025-10-24T01:24:41.064349] [INFO ] [MAIN      ] LEN: Generated 139 derivative records from 53586 primary records.
[2025-10-24T01:24:41.064546] [DEBUG] [LOCAL     ] LEN: Saving derivative data.
[2025-10-24T01:24:41.064481] [INFO ] [MAIN      ] LEG: Successfully saved derivative data.
[2025-10-24T01:24:41.067872] [INFO ] [MAIN      ] Derivative Progress: 1142/2164 symbols completed. LEG took 1.2s. Estimated remaining: 7m 10s. Rate: 142.7 symbols/min
[2025-10-24T01:24:41.068216] [INFO ] [MAIN      ] LFT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:41.093166] [DEBUG] [LOCAL     ] LEN: Derivative data saved (139 records).
[2025-10-24T01:24:41.093319] [INFO ] [MAIN      ] LEN: Successfully saved derivative data.
[2025-10-24T01:24:41.096285] [INFO ] [MAIN      ] Derivative Progress: 1143/2164 symbols completed. LEN took 1.2s. Estimated remaining: 7m 9s. Rate: 142.9 symbols/min
[2025-10-24T01:24:41.096926] [INFO ] [MAIN      ] LGI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:41.114737] [DEBUG] [LOCAL     ] LEVI: Loaded 52204 existing records from primary storage.
[2025-10-24T01:24:41.118703] [INFO ] [MAIN      ] LEVI: Loaded 52204 primary data records.
[2025-10-24T01:24:41.206233] [DEBUG] [LOCAL     ] LFT: Loaded 18234 existing records from primary storage.
[2025-10-24T01:24:41.206526] [DEBUG] [LOCAL     ] LGI: Loaded 10003 existing records from primary storage.
[2025-10-24T01:24:41.216955] [INFO ] [MAIN      ] LFT: Loaded 18234 primary data records.
[2025-10-24T01:24:41.217024] [INFO ] [MAIN      ] LGI: Loaded 10003 primary data records.
[2025-10-24T01:24:42.121826] [DEBUG] [MAIN      ] LEVI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:42.190128] [INFO ] [MAIN      ] LEVI: Generated 139 derivative records from 52204 primary records.
[2025-10-24T01:24:42.188138] [DEBUG] [MAIN      ] LGI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:42.190521] [DEBUG] [MAIN      ] LFT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:42.213147] [DEBUG] [LOCAL     ] LEVI: Saving derivative data.
[2025-10-24T01:24:42.231300] [DEBUG] [LOCAL     ] LEVI: Derivative data saved (139 records).
[2025-10-24T01:24:42.232807] [INFO ] [MAIN      ] LEVI: Successfully saved derivative data.
[2025-10-24T01:24:42.236872] [INFO ] [MAIN      ] Derivative Progress: 1144/2164 symbols completed. LEVI took 1.2s. Estimated remaining: 7m 9s. Rate: 142.6 symbols/min
[2025-10-24T01:24:42.239189] [INFO ] [MAIN      ] LH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:42.274055] [INFO ] [MAIN      ] LGI: Generated 139 derivative records from 10003 primary records.
[2025-10-24T01:24:42.284413] [DEBUG] [LOCAL     ] LGI: Saving derivative data.
[2025-10-24T01:24:42.296703] [INFO ] [MAIN      ] LFT: Generated 139 derivative records from 18234 primary records.
[2025-10-24T01:24:42.297209] [DEBUG] [LOCAL     ] LFT: Saving derivative data.
[2025-10-24T01:24:42.308351] [DEBUG] [LOCAL     ] LGI: Derivative data saved (139 records).
[2025-10-24T01:24:42.309031] [INFO ] [MAIN      ] LGI: Successfully saved derivative data.
[2025-10-24T01:24:42.313440] [INFO ] [MAIN      ] Derivative Progress: 1145/2164 symbols completed. LGI took 1.2s. Estimated remaining: 7m 8s. Rate: 142.7 symbols/min
[2025-10-24T01:24:42.323541] [INFO ] [MAIN      ] LHX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:42.328020] [DEBUG] [LOCAL     ] LFT: Derivative data saved (139 records).
[2025-10-24T01:24:42.328136] [INFO ] [MAIN      ] LFT: Successfully saved derivative data.
[2025-10-24T01:24:42.331055] [INFO ] [MAIN      ] Derivative Progress: 1146/2164 symbols completed. LFT took 1.3s. Estimated remaining: 7m 8s. Rate: 142.9 symbols/min
[2025-10-24T01:24:42.332670] [DEBUG] [LOCAL     ] LH: Loaded 37267 existing records from primary storage.
[2025-10-24T01:24:42.332927] [INFO ] [MAIN      ] LII: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:42.333002] [INFO ] [MAIN      ] LH: Loaded 37267 primary data records.
[2025-10-24T01:24:42.680687] [DEBUG] [LOCAL     ] LII: Loaded 28039 existing records from primary storage.
[2025-10-24T01:24:42.682164] [INFO ] [MAIN      ] LII: Loaded 28039 primary data records.
[2025-10-24T01:24:42.772783] [DEBUG] [LOCAL     ] LHX: Loaded 48769 existing records from primary storage.
[2025-10-24T01:24:42.796040] [INFO ] [MAIN      ] LHX: Loaded 48769 primary data records.
[2025-10-24T01:24:43.321167] [DEBUG] [MAIN      ] LH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:43.367398] [DEBUG] [MAIN      ] LII: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:43.406221] [INFO ] [MAIN      ] LH: Generated 139 derivative records from 37267 primary records.
[2025-10-24T01:24:43.406727] [DEBUG] [LOCAL     ] LH: Saving derivative data.
[2025-10-24T01:24:43.414424] [DEBUG] [MAIN      ] LHX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:43.441403] [DEBUG] [LOCAL     ] LH: Derivative data saved (139 records).
[2025-10-24T01:24:43.444808] [INFO ] [MAIN      ] LH: Successfully saved derivative data.
[2025-10-24T01:24:43.449192] [INFO ] [MAIN      ] Derivative Progress: 1147/2164 symbols completed. LH took 1.2s. Estimated remaining: 7m 8s. Rate: 142.7 symbols/min
[2025-10-24T01:24:43.453481] [INFO ] [MAIN      ] LION: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:43.483534] [INFO ] [MAIN      ] LHX: Generated 139 derivative records from 48769 primary records.
[2025-10-24T01:24:43.484020] [DEBUG] [LOCAL     ] LHX: Saving derivative data.
[2025-10-24T01:24:43.498535] [INFO ] [MAIN      ] LII: Generated 139 derivative records from 28039 primary records.
[2025-10-24T01:24:43.498733] [DEBUG] [LOCAL     ] LII: Saving derivative data.
[2025-10-24T01:24:43.511904] [DEBUG] [LOCAL     ] LHX: Derivative data saved (139 records).
[2025-10-24T01:24:43.519695] [INFO ] [MAIN      ] LHX: Successfully saved derivative data.
[2025-10-24T01:24:43.524667] [DEBUG] [LOCAL     ] LII: Derivative data saved (139 records).
[2025-10-24T01:24:43.527591] [INFO ] [MAIN      ] Derivative Progress: 1148/2164 symbols completed. LHX took 1.2s. Estimated remaining: 7m 7s. Rate: 142.8 symbols/min
[2025-10-24T01:24:43.527939] [INFO ] [MAIN      ] LII: Successfully saved derivative data.
[2025-10-24T01:24:43.531006] [INFO ] [MAIN      ] Derivative Progress: 1149/2164 symbols completed. LII took 1.2s. Estimated remaining: 7m 6s. Rate: 142.9 symbols/min
[2025-10-24T01:24:43.532725] [INFO ] [MAIN      ] LLY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:43.528105] [INFO ] [MAIN      ] LITB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:43.548428] [DEBUG] [LOCAL     ] LION: Loaded 47284 existing records from primary storage.
[2025-10-24T01:24:43.550068] [INFO ] [MAIN      ] LION: Loaded 47284 primary data records.
[2025-10-24T01:24:43.595404] [DEBUG] [LOCAL     ] LITB: Loaded 3886 existing records from primary storage.
[2025-10-24T01:24:43.615895] [INFO ] [MAIN      ] LITB: Loaded 3886 primary data records.
[2025-10-24T01:24:44.245636] [DEBUG] [LOCAL     ] LLY: Loaded 53575 existing records from primary storage.
[2025-10-24T01:24:44.246494] [INFO ] [MAIN      ] LLY: Loaded 53575 primary data records.
[2025-10-24T01:24:44.560515] [DEBUG] [MAIN      ] LION: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:44.595425] [DEBUG] [MAIN      ] LITB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:44.651154] [DEBUG] [MAIN      ] LLY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:44.670847] [INFO ] [MAIN      ] LION: Generated 139 derivative records from 47284 primary records.
[2025-10-24T01:24:44.672362] [DEBUG] [LOCAL     ] LION: Saving derivative data.
[2025-10-24T01:24:44.686790] [DEBUG] [LOCAL     ] LION: Derivative data saved (139 records).
[2025-10-24T01:24:44.687063] [INFO ] [MAIN      ] LITB: Generated 139 derivative records from 3886 primary records.
[2025-10-24T01:24:44.689179] [INFO ] [MAIN      ] LION: Successfully saved derivative data.
[2025-10-24T01:24:44.692077] [INFO ] [MAIN      ] Derivative Progress: 1150/2164 symbols completed. LION took 1.2s. Estimated remaining: 7m 6s. Rate: 142.7 symbols/min
[2025-10-24T01:24:44.692462] [INFO ] [MAIN      ] LMND: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:44.689273] [DEBUG] [LOCAL     ] LITB: Saving derivative data.
[2025-10-24T01:24:44.707479] [DEBUG] [LOCAL     ] LITB: Derivative data saved (139 records).
[2025-10-24T01:24:44.711419] [INFO ] [MAIN      ] LITB: Successfully saved derivative data.
[2025-10-24T01:24:44.715779] [INFO ] [MAIN      ] Derivative Progress: 1151/2164 symbols completed. LITB took 1.2s. Estimated remaining: 7m 6s. Rate: 142.8 symbols/min
[2025-10-24T01:24:44.716423] [INFO ] [MAIN      ] LMT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:44.724275] [INFO ] [MAIN      ] LLY: Generated 139 derivative records from 53575 primary records.
[2025-10-24T01:24:44.724537] [DEBUG] [LOCAL     ] LLY: Saving derivative data.
[2025-10-24T01:24:44.737316] [DEBUG] [LOCAL     ] LLY: Derivative data saved (139 records).
[2025-10-24T01:24:44.737610] [INFO ] [MAIN      ] LLY: Successfully saved derivative data.
[2025-10-24T01:24:44.739848] [INFO ] [MAIN      ] Derivative Progress: 1152/2164 symbols completed. LLY took 1.2s. Estimated remaining: 7m 5s. Rate: 142.9 symbols/min
[2025-10-24T01:24:44.740115] [INFO ] [MAIN      ] LNC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:44.787976] [DEBUG] [LOCAL     ] LMND: Loaded 52502 existing records from primary storage.
[2025-10-24T01:24:44.788245] [INFO ] [MAIN      ] LMND: Loaded 52502 primary data records.
[2025-10-24T01:24:44.967354] [DEBUG] [LOCAL     ] LMT: Loaded 49977 existing records from primary storage.
[2025-10-24T01:24:45.077738] [INFO ] [MAIN      ] LMT: Loaded 49977 primary data records.
[2025-10-24T01:24:45.121727] [DEBUG] [LOCAL     ] LNC: Loaded 51801 existing records from primary storage.
[2025-10-24T01:24:45.153375] [INFO ] [MAIN      ] LNC: Loaded 51801 primary data records.
[2025-10-24T01:24:45.725838] [DEBUG] [MAIN      ] LMND: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:45.767537] [DEBUG] [MAIN      ] LMT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:45.806806] [DEBUG] [MAIN      ] LNC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:45.828380] [INFO ] [MAIN      ] LMND: Generated 139 derivative records from 52502 primary records.
[2025-10-24T01:24:45.831752] [DEBUG] [LOCAL     ] LMND: Saving derivative data.
[2025-10-24T01:24:45.851353] [DEBUG] [LOCAL     ] LMND: Derivative data saved (139 records).
[2025-10-24T01:24:45.851474] [INFO ] [MAIN      ] LMND: Successfully saved derivative data.
[2025-10-24T01:24:45.857281] [INFO ] [MAIN      ] Derivative Progress: 1153/2164 symbols completed. LMND took 1.2s. Estimated remaining: 7m 5s. Rate: 142.7 symbols/min
[2025-10-24T01:24:45.875741] [INFO ] [MAIN      ] LMT: Generated 139 derivative records from 49977 primary records.
[2025-10-24T01:24:45.875923] [DEBUG] [LOCAL     ] LMT: Saving derivative data.
[2025-10-24T01:24:45.895034] [DEBUG] [LOCAL     ] LMT: Derivative data saved (139 records).
[2025-10-24T01:24:45.895190] [INFO ] [MAIN      ] LMT: Successfully saved derivative data.
[2025-10-24T01:24:45.897254] [INFO ] [MAIN      ] LNC: Generated 139 derivative records from 51801 primary records.
[2025-10-24T01:24:45.900014] [INFO ] [MAIN      ] Derivative Progress: 1154/2164 symbols completed. LMT took 1.2s. Estimated remaining: 7m 4s. Rate: 142.8 symbols/min
[2025-10-24T01:24:45.900284] [DEBUG] [LOCAL     ] LNC: Saving derivative data.
[2025-10-24T01:24:45.911946] [DEBUG] [LOCAL     ] LNC: Derivative data saved (139 records).
[2025-10-24T01:24:45.912042] [INFO ] [MAIN      ] LNC: Successfully saved derivative data.
[2025-10-24T01:24:45.914787] [INFO ] [MAIN      ] Derivative Progress: 1155/2164 symbols completed. LNC took 1.2s. Estimated remaining: 7m 4s. Rate: 142.9 symbols/min
[2025-10-24T01:24:45.915150] [INFO ] [MAIN      ] LNG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:45.915254] [INFO ] [MAIN      ] LNN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:45.915358] [INFO ] [MAIN      ] LND: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:45.925810] [DEBUG] [LOCAL     ] LND: Loaded 4995 existing records from primary storage.
[2025-10-24T01:24:45.926607] [INFO ] [MAIN      ] LND: Loaded 4995 primary data records.
[2025-10-24T01:24:46.017971] [DEBUG] [LOCAL     ] LNN: Loaded 11727 existing records from primary storage.
[2025-10-24T01:24:46.049021] [INFO ] [MAIN      ] LNN: Loaded 11727 primary data records.
[2025-10-24T01:24:46.454851] [DEBUG] [LOCAL     ] LNG: Loaded 51448 existing records from primary storage.
[2025-10-24T01:24:46.488400] [INFO ] [MAIN      ] LNG: Loaded 51448 primary data records.
[2025-10-24T01:24:46.929635] [DEBUG] [MAIN      ] LND: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:46.963276] [DEBUG] [MAIN      ] LNN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:47.018584] [INFO ] [MAIN      ] LND: Generated 139 derivative records from 4995 primary records.
[2025-10-24T01:24:47.021935] [DEBUG] [LOCAL     ] LND: Saving derivative data.
[2025-10-24T01:24:47.036197] [DEBUG] [MAIN      ] LNG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:47.069554] [DEBUG] [LOCAL     ] LND: Derivative data saved (139 records).
[2025-10-24T01:24:47.070208] [INFO ] [MAIN      ] LND: Successfully saved derivative data.
[2025-10-24T01:24:47.072598] [INFO ] [MAIN      ] Derivative Progress: 1156/2164 symbols completed. LND took 1.2s. Estimated remaining: 7m 4s. Rate: 142.7 symbols/min
[2025-10-24T01:24:47.074703] [INFO ] [MAIN      ] LOAR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:47.083547] [INFO ] [MAIN      ] LNN: Generated 139 derivative records from 11727 primary records.
[2025-10-24T01:24:47.085698] [DEBUG] [LOCAL     ] LNN: Saving derivative data.
[2025-10-24T01:24:47.106251] [DEBUG] [LOCAL     ] LNN: Derivative data saved (139 records).
[2025-10-24T01:24:47.106503] [INFO ] [MAIN      ] LNN: Successfully saved derivative data.
[2025-10-24T01:24:47.110840] [INFO ] [MAIN      ] Derivative Progress: 1157/2164 symbols completed. LNN took 1.2s. Estimated remaining: 7m 3s. Rate: 142.8 symbols/min
[2025-10-24T01:24:47.114921] [INFO ] [MAIN      ] LOB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:47.115244] [INFO ] [MAIN      ] LNG: Generated 139 derivative records from 51448 primary records.
[2025-10-24T01:24:47.116042] [DEBUG] [LOCAL     ] LNG: Saving derivative data.
[2025-10-24T01:24:47.138562] [DEBUG] [LOCAL     ] LNG: Derivative data saved (139 records).
[2025-10-24T01:24:47.138868] [INFO ] [MAIN      ] LNG: Successfully saved derivative data.
[2025-10-24T01:24:47.141995] [INFO ] [MAIN      ] Derivative Progress: 1158/2164 symbols completed. LNG took 1.2s. Estimated remaining: 7m 2s. Rate: 142.9 symbols/min
[2025-10-24T01:24:47.143394] [INFO ] [MAIN      ] LOCL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:47.156508] [DEBUG] [LOCAL     ] LOAR: Loaded 42355 existing records from primary storage.
[2025-10-24T01:24:47.156717] [INFO ] [MAIN      ] LOAR: Loaded 42355 primary data records.
[2025-10-24T01:24:47.237817] [DEBUG] [LOCAL     ] LOCL: Loaded 3523 existing records from primary storage.
[2025-10-24T01:24:47.250894] [INFO ] [MAIN      ] LOCL: Loaded 3523 primary data records.
[2025-10-24T01:24:47.297561] [DEBUG] [LOCAL     ] LOB: Loaded 26868 existing records from primary storage.
[2025-10-24T01:24:47.297797] [INFO ] [MAIN      ] LOB: Loaded 26868 primary data records.
[2025-10-24T01:24:48.161284] [DEBUG] [MAIN      ] LOAR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:48.202155] [DEBUG] [MAIN      ] LOB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:48.233120] [DEBUG] [MAIN      ] LOCL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:48.295086] [INFO ] [MAIN      ] LOAR: Generated 139 derivative records from 42355 primary records.
[2025-10-24T01:24:48.295525] [DEBUG] [LOCAL     ] LOAR: Saving derivative data.
[2025-10-24T01:24:48.312545] [DEBUG] [LOCAL     ] LOAR: Derivative data saved (139 records).
[2025-10-24T01:24:48.312721] [INFO ] [MAIN      ] LOAR: Successfully saved derivative data.
[2025-10-24T01:24:48.315149] [INFO ] [MAIN      ] Derivative Progress: 1159/2164 symbols completed. LOAR took 1.2s. Estimated remaining: 7m 3s. Rate: 142.7 symbols/min
[2025-10-24T01:24:48.316496] [INFO ] [MAIN      ] LOMA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:48.316031] [INFO ] [MAIN      ] LOB: Generated 139 derivative records from 26868 primary records.
[2025-10-24T01:24:48.318738] [DEBUG] [LOCAL     ] LOB: Saving derivative data.
[2025-10-24T01:24:48.321550] [INFO ] [MAIN      ] LOCL: Generated 139 derivative records from 3523 primary records.
[2025-10-24T01:24:48.322564] [DEBUG] [LOCAL     ] LOCL: Saving derivative data.
[2025-10-24T01:24:48.345211] [DEBUG] [LOCAL     ] LOCL: Derivative data saved (139 records).
[2025-10-24T01:24:48.340843] [DEBUG] [LOCAL     ] LOB: Derivative data saved (139 records).
[2025-10-24T01:24:48.345356] [INFO ] [MAIN      ] LOCL: Successfully saved derivative data.
[2025-10-24T01:24:48.345598] [INFO ] [MAIN      ] LOB: Successfully saved derivative data.
[2025-10-24T01:24:48.349005] [INFO ] [MAIN      ] Derivative Progress: 1160/2164 symbols completed. LOB took 1.2s. Estimated remaining: 7m 2s. Rate: 142.8 symbols/min
[2025-10-24T01:24:48.352126] [INFO ] [MAIN      ] Derivative Progress: 1161/2164 symbols completed. LOCL took 1.2s. Estimated remaining: 7m 1s. Rate: 143.0 symbols/min
[2025-10-24T01:24:48.352353] [INFO ] [MAIN      ] LPG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:48.351863] [INFO ] [MAIN      ] LOW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:48.378771] [DEBUG] [LOCAL     ] LOMA: Loaded 33036 existing records from primary storage.
[2025-10-24T01:24:48.378930] [INFO ] [MAIN      ] LOMA: Loaded 33036 primary data records.
[2025-10-24T01:24:48.707716] [DEBUG] [LOCAL     ] LPG: Loaded 39472 existing records from primary storage.
[2025-10-24T01:24:48.708178] [INFO ] [MAIN      ] LPG: Loaded 39472 primary data records.
[2025-10-24T01:24:48.820021] [DEBUG] [LOCAL     ] LOW: Loaded 53351 existing records from primary storage.
[2025-10-24T01:24:48.832213] [INFO ] [MAIN      ] LOW: Loaded 53351 primary data records.
[2025-10-24T01:24:49.348354] [DEBUG] [MAIN      ] LOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:49.406104] [DEBUG] [MAIN      ] LPG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:49.437880] [INFO ] [MAIN      ] LOMA: Generated 139 derivative records from 33036 primary records.
[2025-10-24T01:24:49.441023] [DEBUG] [LOCAL     ] LOMA: Saving derivative data.
[2025-10-24T01:24:49.441477] [DEBUG] [MAIN      ] LOW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:49.468803] [DEBUG] [LOCAL     ] LOMA: Derivative data saved (139 records).
[2025-10-24T01:24:49.472808] [INFO ] [MAIN      ] LOMA: Successfully saved derivative data.
[2025-10-24T01:24:49.475735] [INFO ] [MAIN      ] Derivative Progress: 1162/2164 symbols completed. LOMA took 1.2s. Estimated remaining: 7m 1s. Rate: 142.7 symbols/min
[2025-10-24T01:24:49.476495] [INFO ] [MAIN      ] LPL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:49.494133] [INFO ] [MAIN      ] LPG: Generated 139 derivative records from 39472 primary records.
[2025-10-24T01:24:49.503818] [DEBUG] [LOCAL     ] LPG: Saving derivative data.
[2025-10-24T01:24:49.532047] [DEBUG] [LOCAL     ] LPL: Loaded 29271 existing records from primary storage.
[2025-10-24T01:24:49.535761] [INFO ] [MAIN      ] LPL: Loaded 29271 primary data records.
[2025-10-24T01:24:49.542372] [DEBUG] [LOCAL     ] LPG: Derivative data saved (139 records).
[2025-10-24T01:24:49.581875] [INFO ] [MAIN      ] LPG: Successfully saved derivative data.
[2025-10-24T01:24:49.597521] [INFO ] [MAIN      ] Derivative Progress: 1163/2164 symbols completed. LPG took 1.2s. Estimated remaining: 7m 0s. Rate: 142.8 symbols/min
[2025-10-24T01:24:49.628854] [INFO ] [MAIN      ] LPX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:49.631526] [INFO ] [MAIN      ] LOW: Generated 139 derivative records from 53351 primary records.
[2025-10-24T01:24:49.649349] [DEBUG] [LOCAL     ] LOW: Saving derivative data.
[2025-10-24T01:24:49.700163] [DEBUG] [LOCAL     ] LOW: Derivative data saved (139 records).
[2025-10-24T01:24:49.732688] [INFO ] [MAIN      ] LOW: Successfully saved derivative data.
[2025-10-24T01:24:49.740140] [INFO ] [MAIN      ] Derivative Progress: 1164/2164 symbols completed. LOW took 1.4s. Estimated remaining: 6m 60s. Rate: 142.9 symbols/min
[2025-10-24T01:24:49.853739] [INFO ] [MAIN      ] LRN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:49.886261] [DEBUG] [LOCAL     ] LPX: Loaded 40357 existing records from primary storage.
[2025-10-24T01:24:49.887183] [INFO ] [MAIN      ] LPX: Loaded 40357 primary data records.
[2025-10-24T01:24:50.248850] [DEBUG] [LOCAL     ] LRN: Loaded 39569 existing records from primary storage.
[2025-10-24T01:24:50.249815] [INFO ] [MAIN      ] LRN: Loaded 39569 primary data records.
[2025-10-24T01:24:50.319364] [DEBUG] [MAIN      ] LPL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:50.612788] [INFO ] [MAIN      ] LPL: Generated 139 derivative records from 29271 primary records.
[2025-10-24T01:24:50.609303] [DEBUG] [MAIN      ] LPX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:50.613014] [DEBUG] [LOCAL     ] LPL: Saving derivative data.
[2025-10-24T01:24:50.638631] [DEBUG] [LOCAL     ] LPL: Derivative data saved (139 records).
[2025-10-24T01:24:50.639126] [INFO ] [MAIN      ] LPL: Successfully saved derivative data.
[2025-10-24T01:24:50.645794] [INFO ] [MAIN      ] Derivative Progress: 1165/2164 symbols completed. LPL took 1.2s. Estimated remaining: 6m 60s. Rate: 142.8 symbols/min
[2025-10-24T01:24:50.646275] [INFO ] [MAIN      ] LSPD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:50.672603] [DEBUG] [MAIN      ] LRN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:50.717950] [INFO ] [MAIN      ] LPX: Generated 139 derivative records from 40357 primary records.
[2025-10-24T01:24:50.718410] [DEBUG] [LOCAL     ] LPX: Saving derivative data.
[2025-10-24T01:24:50.749462] [DEBUG] [LOCAL     ] LPX: Derivative data saved (139 records).
[2025-10-24T01:24:50.752922] [INFO ] [MAIN      ] LPX: Successfully saved derivative data.
[2025-10-24T01:24:50.754518] [DEBUG] [LOCAL     ] LSPD: Loaded 42619 existing records from primary storage.
[2025-10-24T01:24:50.757586] [INFO ] [MAIN      ] Derivative Progress: 1166/2164 symbols completed. LPX took 1.1s. Estimated remaining: 6m 59s. Rate: 142.9 symbols/min
[2025-10-24T01:24:50.758118] [INFO ] [MAIN      ] LTC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:50.760633] [INFO ] [MAIN      ] LSPD: Loaded 42619 primary data records.
[2025-10-24T01:24:50.766772] [INFO ] [MAIN      ] LRN: Generated 139 derivative records from 39569 primary records.
[2025-10-24T01:24:50.784670] [DEBUG] [LOCAL     ] LRN: Saving derivative data.
[2025-10-24T01:24:50.853343] [DEBUG] [LOCAL     ] LRN: Derivative data saved (139 records).
[2025-10-24T01:24:50.887234] [INFO ] [MAIN      ] LRN: Successfully saved derivative data.
[2025-10-24T01:24:50.890282] [INFO ] [MAIN      ] Derivative Progress: 1167/2164 symbols completed. LRN took 1.0s. Estimated remaining: 6m 58s. Rate: 142.9 symbols/min
[2025-10-24T01:24:50.918751] [INFO ] [MAIN      ] LTH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:51.101042] [DEBUG] [LOCAL     ] LTC: Loaded 30851 existing records from primary storage.
[2025-10-24T01:24:51.101457] [INFO ] [MAIN      ] LTC: Loaded 30851 primary data records.
[2025-10-24T01:24:51.475995] [DEBUG] [LOCAL     ] LTH: Loaded 51990 existing records from primary storage.
[2025-10-24T01:24:51.476530] [INFO ] [MAIN      ] LTH: Loaded 51990 primary data records.
[2025-10-24T01:24:51.580760] [DEBUG] [MAIN      ] LSPD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:51.850353] [DEBUG] [MAIN      ] LTC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:51.885965] [INFO ] [MAIN      ] LSPD: Generated 139 derivative records from 42619 primary records.
[2025-10-24T01:24:51.889173] [DEBUG] [LOCAL     ] LSPD: Saving derivative data.
[2025-10-24T01:24:51.910319] [DEBUG] [LOCAL     ] LSPD: Derivative data saved (139 records).
[2025-10-24T01:24:51.918277] [INFO ] [MAIN      ] LSPD: Successfully saved derivative data.
[2025-10-24T01:24:51.925737] [INFO ] [MAIN      ] Derivative Progress: 1168/2164 symbols completed. LSPD took 1.3s. Estimated remaining: 6m 59s. Rate: 142.8 symbols/min
[2025-10-24T01:24:51.926229] [DEBUG] [MAIN      ] LTH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:51.952511] [INFO ] [MAIN      ] LTC: Generated 139 derivative records from 30851 primary records.
[2025-10-24T01:24:51.952784] [DEBUG] [LOCAL     ] LTC: Saving derivative data.
[2025-10-24T01:24:51.968216] [DEBUG] [LOCAL     ] LTC: Derivative data saved (139 records).
[2025-10-24T01:24:51.970188] [INFO ] [MAIN      ] LTC: Successfully saved derivative data.
[2025-10-24T01:24:51.973066] [INFO ] [MAIN      ] Derivative Progress: 1169/2164 symbols completed. LTC took 1.2s. Estimated remaining: 6m 58s. Rate: 142.9 symbols/min
[2025-10-24T01:24:51.981899] [INFO ] [MAIN      ] LTH: Generated 139 derivative records from 51990 primary records.
[2025-10-24T01:24:51.981997] [DEBUG] [LOCAL     ] LTH: Saving derivative data.
[2025-10-24T01:24:51.994457] [DEBUG] [LOCAL     ] LTH: Derivative data saved (139 records).
[2025-10-24T01:24:51.994540] [INFO ] [MAIN      ] LTH: Successfully saved derivative data.
[2025-10-24T01:24:51.997235] [INFO ] [MAIN      ] Derivative Progress: 1170/2164 symbols completed. LTH took 1.1s. Estimated remaining: 6m 57s. Rate: 143.0 symbols/min
[2025-10-24T01:24:51.997736] [INFO ] [MAIN      ] LTM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:52.000697] [INFO ] [MAIN      ] LU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:52.000778] [INFO ] [MAIN      ] LUCK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:52.055258] [DEBUG] [LOCAL     ] LUCK: Loaded 23995 existing records from primary storage.
[2025-10-24T01:24:52.055464] [INFO ] [MAIN      ] LUCK: Loaded 23995 primary data records.
[2025-10-24T01:24:52.189701] [DEBUG] [LOCAL     ] LTM: Loaded 39574 existing records from primary storage.
[2025-10-24T01:24:52.190000] [INFO ] [MAIN      ] LTM: Loaded 39574 primary data records.
[2025-10-24T01:24:52.196444] [DEBUG] [LOCAL     ] LU: Loaded 49548 existing records from primary storage.
[2025-10-24T01:24:52.218530] [INFO ] [MAIN      ] LU: Loaded 49548 primary data records.
[2025-10-24T01:24:53.071561] [DEBUG] [MAIN      ] LUCK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:53.111404] [DEBUG] [MAIN      ] LTM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:53.163980] [DEBUG] [MAIN      ] LU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:53.200917] [INFO ] [MAIN      ] LUCK: Generated 139 derivative records from 23995 primary records.
[2025-10-24T01:24:53.203039] [DEBUG] [LOCAL     ] LUCK: Saving derivative data.
[2025-10-24T01:24:53.224967] [DEBUG] [LOCAL     ] LUCK: Derivative data saved (139 records).
[2025-10-24T01:24:53.225709] [INFO ] [MAIN      ] LUCK: Successfully saved derivative data.
[2025-10-24T01:24:53.232913] [INFO ] [MAIN      ] Derivative Progress: 1171/2164 symbols completed. LUCK took 1.2s. Estimated remaining: 6m 57s. Rate: 142.8 symbols/min
[2025-10-24T01:24:53.240753] [INFO ] [MAIN      ] LUMN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:53.241426] [INFO ] [MAIN      ] LTM: Generated 139 derivative records from 39574 primary records.
[2025-10-24T01:24:53.242002] [DEBUG] [LOCAL     ] LTM: Saving derivative data.
[2025-10-24T01:24:53.257263] [DEBUG] [LOCAL     ] LTM: Derivative data saved (139 records).
[2025-10-24T01:24:53.259907] [INFO ] [MAIN      ] LTM: Successfully saved derivative data.
[2025-10-24T01:24:53.259687] [INFO ] [MAIN      ] LU: Generated 139 derivative records from 49548 primary records.
[2025-10-24T01:24:53.263247] [DEBUG] [LOCAL     ] LU: Saving derivative data.
[2025-10-24T01:24:53.262768] [INFO ] [MAIN      ] Derivative Progress: 1172/2164 symbols completed. LTM took 1.3s. Estimated remaining: 6m 57s. Rate: 142.9 symbols/min
[2025-10-24T01:24:53.264352] [INFO ] [MAIN      ] LUV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:53.278947] [DEBUG] [LOCAL     ] LU: Derivative data saved (139 records).
[2025-10-24T01:24:53.279614] [INFO ] [MAIN      ] LU: Successfully saved derivative data.
[2025-10-24T01:24:53.284542] [INFO ] [MAIN      ] Derivative Progress: 1173/2164 symbols completed. LU took 1.3s. Estimated remaining: 6m 56s. Rate: 143.0 symbols/min
[2025-10-24T01:24:53.285170] [INFO ] [MAIN      ] LVS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:53.350703] [DEBUG] [LOCAL     ] LUMN: Loaded 54035 existing records from primary storage.
[2025-10-24T01:24:53.351208] [INFO ] [MAIN      ] LUMN: Loaded 54035 primary data records.
[2025-10-24T01:24:53.529110] [DEBUG] [LOCAL     ] LUV: Loaded 54079 existing records from primary storage.
[2025-10-24T01:24:53.563413] [INFO ] [MAIN      ] LUV: Loaded 54079 primary data records.
[2025-10-24T01:24:53.531814] [DEBUG] [LOCAL     ] LVS: Loaded 53959 existing records from primary storage.
[2025-10-24T01:24:53.587842] [INFO ] [MAIN      ] LVS: Loaded 53959 primary data records.
[2025-10-24T01:24:54.322160] [DEBUG] [MAIN      ] LUMN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:54.383856] [DEBUG] [MAIN      ] LUV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:54.389448] [DEBUG] [MAIN      ] LVS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:54.432724] [INFO ] [MAIN      ] LUMN: Generated 139 derivative records from 54035 primary records.
[2025-10-24T01:24:54.437337] [DEBUG] [LOCAL     ] LUMN: Saving derivative data.
[2025-10-24T01:24:54.453176] [DEBUG] [LOCAL     ] LUMN: Derivative data saved (139 records).
[2025-10-24T01:24:54.454577] [INFO ] [MAIN      ] LUMN: Successfully saved derivative data.
[2025-10-24T01:24:54.457868] [INFO ] [MAIN      ] Derivative Progress: 1174/2164 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 56s. Rate: 142.8 symbols/min
[2025-10-24T01:24:54.460754] [INFO ] [MAIN      ] LVWR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:54.484842] [INFO ] [MAIN      ] LUV: Generated 139 derivative records from 54079 primary records.
[2025-10-24T01:24:54.492806] [DEBUG] [LOCAL     ] LUV: Saving derivative data.
[2025-10-24T01:24:54.513102] [INFO ] [MAIN      ] LVS: Generated 139 derivative records from 53959 primary records.
[2025-10-24T01:24:54.515024] [DEBUG] [LOCAL     ] LVS: Saving derivative data.
[2025-10-24T01:24:54.517820] [DEBUG] [LOCAL     ] LUV: Derivative data saved (139 records).
[2025-10-24T01:24:54.518428] [INFO ] [MAIN      ] LUV: Successfully saved derivative data.
[2025-10-24T01:24:54.521718] [INFO ] [MAIN      ] Derivative Progress: 1175/2164 symbols completed. LUV took 1.3s. Estimated remaining: 6m 55s. Rate: 142.9 symbols/min
[2025-10-24T01:24:54.522718] [DEBUG] [LOCAL     ] LVWR: Loaded 18696 existing records from primary storage.
[2025-10-24T01:24:54.523119] [INFO ] [MAIN      ] LW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:54.522997] [INFO ] [MAIN      ] LVWR: Loaded 18696 primary data records.
[2025-10-24T01:24:54.588700] [DEBUG] [LOCAL     ] LVS: Derivative data saved (139 records).
[2025-10-24T01:24:54.595047] [INFO ] [MAIN      ] LVS: Successfully saved derivative data.
[2025-10-24T01:24:54.622613] [INFO ] [MAIN      ] Derivative Progress: 1176/2164 symbols completed. LVS took 1.3s. Estimated remaining: 6m 55s. Rate: 143.0 symbols/min
[2025-10-24T01:24:54.646671] [INFO ] [MAIN      ] LXFR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:54.925779] [DEBUG] [LOCAL     ] LW: Loaded 51535 existing records from primary storage.
[2025-10-24T01:24:54.932222] [INFO ] [MAIN      ] LW: Loaded 51535 primary data records.
[2025-10-24T01:24:54.932614] [DEBUG] [LOCAL     ] LXFR: Loaded 16511 existing records from primary storage.
[2025-10-24T01:24:54.973067] [INFO ] [MAIN      ] LXFR: Loaded 16511 primary data records.
[2025-10-24T01:24:55.578032] [DEBUG] [MAIN      ] LVWR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:55.652177] [DEBUG] [MAIN      ] LW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:55.652540] [DEBUG] [MAIN      ] LXFR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:55.678810] [INFO ] [MAIN      ] LVWR: Generated 139 derivative records from 18696 primary records.
[2025-10-24T01:24:55.685389] [DEBUG] [LOCAL     ] LVWR: Saving derivative data.
[2025-10-24T01:24:55.703632] [DEBUG] [LOCAL     ] LVWR: Derivative data saved (139 records).
[2025-10-24T01:24:55.704465] [INFO ] [MAIN      ] LVWR: Successfully saved derivative data.
[2025-10-24T01:24:55.708385] [INFO ] [MAIN      ] Derivative Progress: 1177/2164 symbols completed. LVWR took 1.2s. Estimated remaining: 6m 55s. Rate: 142.8 symbols/min
[2025-10-24T01:24:55.708554] [INFO ] [MAIN      ] LXP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:55.749396] [INFO ] [MAIN      ] LXFR: Generated 139 derivative records from 16511 primary records.
[2025-10-24T01:24:55.749778] [INFO ] [MAIN      ] LW: Generated 139 derivative records from 51535 primary records.
[2025-10-24T01:24:55.749907] [DEBUG] [LOCAL     ] LXFR: Saving derivative data.
[2025-10-24T01:24:55.764467] [DEBUG] [LOCAL     ] LW: Saving derivative data.
[2025-10-24T01:24:55.786542] [DEBUG] [LOCAL     ] LXFR: Derivative data saved (139 records).
[2025-10-24T01:24:55.790531] [DEBUG] [LOCAL     ] LW: Derivative data saved (139 records).
[2025-10-24T01:24:55.791581] [INFO ] [MAIN      ] LXFR: Successfully saved derivative data.
[2025-10-24T01:24:55.792552] [INFO ] [MAIN      ] LW: Successfully saved derivative data.
[2025-10-24T01:24:55.795538] [INFO ] [MAIN      ] Derivative Progress: 1178/2164 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 54s. Rate: 142.9 symbols/min
[2025-10-24T01:24:55.795832] [INFO ] [MAIN      ] LXU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:55.798679] [INFO ] [MAIN      ] Derivative Progress: 1179/2164 symbols completed. LW took 1.3s. Estimated remaining: 6m 53s. Rate: 143.0 symbols/min
[2025-10-24T01:24:55.814497] [INFO ] [MAIN      ] LYB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:55.816571] [DEBUG] [LOCAL     ] LXP: Loaded 51121 existing records from primary storage.
[2025-10-24T01:24:55.817000] [INFO ] [MAIN      ] LXP: Loaded 51121 primary data records.
[2025-10-24T01:24:56.018508] [DEBUG] [LOCAL     ] LXU: Loaded 31710 existing records from primary storage.
[2025-10-24T01:24:56.134965] [INFO ] [MAIN      ] LXU: Loaded 31710 primary data records.
[2025-10-24T01:24:56.300975] [DEBUG] [LOCAL     ] LYB: Loaded 54011 existing records from primary storage.
[2025-10-24T01:24:56.301251] [INFO ] [MAIN      ] LYB: Loaded 54011 primary data records.
[2025-10-24T01:24:56.888891] [DEBUG] [MAIN      ] LXP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:56.939665] [DEBUG] [MAIN      ] LXU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:56.971881] [INFO ] [MAIN      ] LXP: Generated 139 derivative records from 51121 primary records.
[2025-10-24T01:24:56.987213] [DEBUG] [LOCAL     ] LXP: Saving derivative data.
[2025-10-24T01:24:56.988405] [DEBUG] [MAIN      ] LYB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:57.015036] [DEBUG] [LOCAL     ] LXP: Derivative data saved (139 records).
[2025-10-24T01:24:57.015918] [INFO ] [MAIN      ] LXP: Successfully saved derivative data.
[2025-10-24T01:24:57.024201] [INFO ] [MAIN      ] Derivative Progress: 1180/2164 symbols completed. LXP took 1.3s. Estimated remaining: 6m 54s. Rate: 142.7 symbols/min
[2025-10-24T01:24:57.026339] [INFO ] [MAIN      ] LYG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:57.040130] [INFO ] [MAIN      ] LXU: Generated 139 derivative records from 31710 primary records.
[2025-10-24T01:24:57.043127] [DEBUG] [LOCAL     ] LXU: Saving derivative data.
[2025-10-24T01:24:57.061916] [DEBUG] [LOCAL     ] LXU: Derivative data saved (139 records).
[2025-10-24T01:24:57.063510] [INFO ] [MAIN      ] LXU: Successfully saved derivative data.
[2025-10-24T01:24:57.067896] [INFO ] [MAIN      ] Derivative Progress: 1181/2164 symbols completed. LXU took 1.3s. Estimated remaining: 6m 53s. Rate: 142.9 symbols/min
[2025-10-24T01:24:57.065406] [INFO ] [MAIN      ] LYB: Generated 139 derivative records from 54011 primary records.
[2025-10-24T01:24:57.068295] [INFO ] [MAIN      ] LYV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:57.068508] [DEBUG] [LOCAL     ] LYB: Saving derivative data.
[2025-10-24T01:24:57.082177] [DEBUG] [LOCAL     ] LYB: Derivative data saved (139 records).
[2025-10-24T01:24:57.082346] [INFO ] [MAIN      ] LYB: Successfully saved derivative data.
[2025-10-24T01:24:57.085525] [INFO ] [MAIN      ] Derivative Progress: 1182/2164 symbols completed. LYB took 1.3s. Estimated remaining: 6m 52s. Rate: 143.0 symbols/min
[2025-10-24T01:24:57.085751] [INFO ] [MAIN      ] LZB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:57.122335] [DEBUG] [LOCAL     ] LYG: Loaded 53036 existing records from primary storage.
[2025-10-24T01:24:57.134860] [INFO ] [MAIN      ] LYG: Loaded 53036 primary data records.
[2025-10-24T01:24:57.300211] [DEBUG] [LOCAL     ] LYV: Loaded 51383 existing records from primary storage.
[2025-10-24T01:24:57.307548] [DEBUG] [LOCAL     ] LZB: Loaded 35281 existing records from primary storage.
[2025-10-24T01:24:57.306575] [INFO ] [MAIN      ] LYV: Loaded 51383 primary data records.
[2025-10-24T01:24:57.318333] [INFO ] [MAIN      ] LZB: Loaded 35281 primary data records.
[2025-10-24T01:24:58.283593] [DEBUG] [MAIN      ] LYG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:58.336996] [DEBUG] [MAIN      ] LYV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:58.337949] [DEBUG] [MAIN      ] LZB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:58.429992] [INFO ] [MAIN      ] LYG: Generated 139 derivative records from 53036 primary records.
[2025-10-24T01:24:58.431217] [DEBUG] [LOCAL     ] LYG: Saving derivative data.
[2025-10-24T01:24:58.451067] [DEBUG] [LOCAL     ] LYG: Derivative data saved (139 records).
[2025-10-24T01:24:58.453316] [INFO ] [MAIN      ] LYG: Successfully saved derivative data.
[2025-10-24T01:24:58.456115] [INFO ] [MAIN      ] Derivative Progress: 1183/2164 symbols completed. LYG took 1.4s. Estimated remaining: 6m 52s. Rate: 142.7 symbols/min
[2025-10-24T01:24:58.462053] [INFO ] [MAIN      ] LYV: Generated 139 derivative records from 51383 primary records.
[2025-10-24T01:24:58.464523] [DEBUG] [LOCAL     ] LYV: Saving derivative data.
[2025-10-24T01:24:58.464891] [INFO ] [MAIN      ] LZB: Generated 139 derivative records from 35281 primary records.
[2025-10-24T01:24:58.466117] [DEBUG] [LOCAL     ] LZB: Saving derivative data.
[2025-10-24T01:24:58.489260] [DEBUG] [LOCAL     ] LYV: Derivative data saved (139 records).
[2025-10-24T01:24:58.492569] [INFO ] [MAIN      ] LYV: Successfully saved derivative data.
[2025-10-24T01:24:58.492451] [DEBUG] [LOCAL     ] LZB: Derivative data saved (139 records).
[2025-10-24T01:24:58.496334] [INFO ] [MAIN      ] LZB: Successfully saved derivative data.
[2025-10-24T01:24:58.496052] [INFO ] [MAIN      ] Derivative Progress: 1184/2164 symbols completed. LYV took 1.4s. Estimated remaining: 6m 52s. Rate: 142.8 symbols/min
[2025-10-24T01:24:58.500974] [INFO ] [MAIN      ] Derivative Progress: 1185/2164 symbols completed. LZB took 1.4s. Estimated remaining: 6m 51s. Rate: 142.9 symbols/min
[2025-10-24T01:24:58.501498] [INFO ] [MAIN      ] MA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:58.501424] [INFO ] [MAIN      ] M: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:58.501674] [INFO ] [MAIN      ] LZM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:58.530384] [DEBUG] [LOCAL     ] LZM: Loaded 14964 existing records from primary storage.
[2025-10-24T01:24:58.530686] [INFO ] [MAIN      ] LZM: Loaded 14964 primary data records.
[2025-10-24T01:24:58.736617] [DEBUG] [LOCAL     ] M: Loaded 53934 existing records from primary storage.
[2025-10-24T01:24:58.747404] [INFO ] [MAIN      ] M: Loaded 53934 primary data records.
[2025-10-24T01:24:58.871438] [DEBUG] [LOCAL     ] MA: Loaded 52828 existing records from primary storage.
[2025-10-24T01:24:58.885750] [INFO ] [MAIN      ] MA: Loaded 52828 primary data records.
[2025-10-24T01:24:59.710737] [DEBUG] [MAIN      ] LZM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:59.759428] [DEBUG] [MAIN      ] M: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:59.794486] [DEBUG] [MAIN      ] MA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:24:59.833505] [INFO ] [MAIN      ] LZM: Generated 139 derivative records from 14964 primary records.
[2025-10-24T01:24:59.835674] [DEBUG] [LOCAL     ] LZM: Saving derivative data.
[2025-10-24T01:24:59.855453] [DEBUG] [LOCAL     ] LZM: Derivative data saved (139 records).
[2025-10-24T01:24:59.855687] [INFO ] [MAIN      ] LZM: Successfully saved derivative data.
[2025-10-24T01:24:59.859160] [INFO ] [MAIN      ] Derivative Progress: 1186/2164 symbols completed. LZM took 1.4s. Estimated remaining: 6m 51s. Rate: 142.7 symbols/min
[2025-10-24T01:24:59.859529] [INFO ] [MAIN      ] MAA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:59.883330] [INFO ] [MAIN      ] MA: Generated 139 derivative records from 52828 primary records.
[2025-10-24T01:24:59.883039] [INFO ] [MAIN      ] M: Generated 139 derivative records from 53934 primary records.
[2025-10-24T01:24:59.883597] [DEBUG] [LOCAL     ] M: Saving derivative data.
[2025-10-24T01:24:59.883727] [DEBUG] [LOCAL     ] MA: Saving derivative data.
[2025-10-24T01:24:59.910269] [DEBUG] [LOCAL     ] MA: Derivative data saved (139 records).
[2025-10-24T01:24:59.910369] [DEBUG] [LOCAL     ] M: Derivative data saved (139 records).
[2025-10-24T01:24:59.910625] [INFO ] [MAIN      ] MA: Successfully saved derivative data.
[2025-10-24T01:24:59.910858] [INFO ] [MAIN      ] M: Successfully saved derivative data.
[2025-10-24T01:24:59.914095] [INFO ] [MAIN      ] Derivative Progress: 1187/2164 symbols completed. MA took 1.4s. Estimated remaining: 6m 51s. Rate: 142.8 symbols/min
[2025-10-24T01:24:59.914386] [INFO ] [MAIN      ] MAC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:59.917372] [INFO ] [MAIN      ] Derivative Progress: 1188/2164 symbols completed. M took 1.4s. Estimated remaining: 6m 50s. Rate: 142.9 symbols/min
[2025-10-24T01:24:59.917911] [INFO ] [MAIN      ] MAGN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:24:59.952696] [DEBUG] [LOCAL     ] MAA: Loaded 43322 existing records from primary storage.
[2025-10-24T01:24:59.953055] [INFO ] [MAIN      ] MAA: Loaded 43322 primary data records.
[2025-10-24T01:25:00.102756] [DEBUG] [LOCAL     ] MAGN: Loaded 36410 existing records from primary storage.
[2025-10-24T01:25:00.115333] [INFO ] [MAIN      ] MAGN: Loaded 36410 primary data records.
[2025-10-24T01:25:00.208092] [DEBUG] [LOCAL     ] MAC: Loaded 49975 existing records from primary storage.
[2025-10-24T01:25:00.276857] [INFO ] [MAIN      ] MAC: Loaded 49975 primary data records.
[2025-10-24T01:25:01.033506] [DEBUG] [MAIN      ] MAGN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:01.048897] [DEBUG] [MAIN      ] MAA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:01.112748] [DEBUG] [MAIN      ] MAC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:01.184288] [INFO ] [MAIN      ] MAGN: Generated 139 derivative records from 36410 primary records.
[2025-10-24T01:25:01.188296] [DEBUG] [LOCAL     ] MAGN: Saving derivative data.
[2025-10-24T01:25:01.188895] [INFO ] [MAIN      ] MAA: Generated 139 derivative records from 43322 primary records.
[2025-10-24T01:25:01.194809] [DEBUG] [LOCAL     ] MAA: Saving derivative data.
[2025-10-24T01:25:01.219416] [DEBUG] [LOCAL     ] MAGN: Derivative data saved (139 records).
[2025-10-24T01:25:01.222005] [INFO ] [MAIN      ] MAGN: Successfully saved derivative data.
[2025-10-24T01:25:01.225897] [DEBUG] [LOCAL     ] MAA: Derivative data saved (139 records).
[2025-10-24T01:25:01.230247] [INFO ] [MAIN      ] Derivative Progress: 1189/2164 symbols completed. MAGN took 1.3s. Estimated remaining: 6m 50s. Rate: 142.6 symbols/min
[2025-10-24T01:25:01.230443] [INFO ] [MAIN      ] MAA: Successfully saved derivative data.
[2025-10-24T01:25:01.234966] [INFO ] [MAIN      ] MAIN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:01.237632] [INFO ] [MAIN      ] Derivative Progress: 1190/2164 symbols completed. MAA took 1.4s. Estimated remaining: 6m 49s. Rate: 142.7 symbols/min
[2025-10-24T01:25:01.241885] [INFO ] [MAIN      ] MAC: Generated 139 derivative records from 49975 primary records.
[2025-10-24T01:25:01.242991] [INFO ] [MAIN      ] MAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:01.242855] [DEBUG] [LOCAL     ] MAC: Saving derivative data.
[2025-10-24T01:25:01.259415] [DEBUG] [LOCAL     ] MAC: Derivative data saved (139 records).
[2025-10-24T01:25:01.259667] [INFO ] [MAIN      ] MAC: Successfully saved derivative data.
[2025-10-24T01:25:01.264131] [INFO ] [MAIN      ] Derivative Progress: 1191/2164 symbols completed. MAC took 1.3s. Estimated remaining: 6m 49s. Rate: 142.9 symbols/min
[2025-10-24T01:25:01.264573] [INFO ] [MAIN      ] MANU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:01.331429] [DEBUG] [LOCAL     ] MAIN: Loaded 42219 existing records from primary storage.
[2025-10-24T01:25:01.333637] [INFO ] [MAIN      ] MAIN: Loaded 42219 primary data records.
[2025-10-24T01:25:01.346702] [DEBUG] [LOCAL     ] MANU: Loaded 27359 existing records from primary storage.
[2025-10-24T01:25:01.408182] [INFO ] [MAIN      ] MANU: Loaded 27359 primary data records.
[2025-10-24T01:25:01.502152] [DEBUG] [LOCAL     ] MAN: Loaded 44638 existing records from primary storage.
[2025-10-24T01:25:01.551432] [INFO ] [MAIN      ] MAN: Loaded 44638 primary data records.
[2025-10-24T01:25:02.467674] [DEBUG] [MAIN      ] MAIN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:02.511204] [DEBUG] [MAIN      ] MANU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:02.566369] [DEBUG] [MAIN      ] MAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:02.616036] [INFO ] [MAIN      ] MAIN: Generated 139 derivative records from 42219 primary records.
[2025-10-24T01:25:02.618592] [DEBUG] [LOCAL     ] MAIN: Saving derivative data.
[2025-10-24T01:25:02.640846] [DEBUG] [LOCAL     ] MAIN: Derivative data saved (139 records).
[2025-10-24T01:25:02.641744] [INFO ] [MAIN      ] MAIN: Successfully saved derivative data.
[2025-10-24T01:25:02.645024] [INFO ] [MAIN      ] Derivative Progress: 1192/2164 symbols completed. MAIN took 1.4s. Estimated remaining: 6m 49s. Rate: 142.6 symbols/min
[2025-10-24T01:25:02.641196] [INFO ] [MAIN      ] MANU: Generated 139 derivative records from 27359 primary records.
[2025-10-24T01:25:02.645348] [INFO ] [MAIN      ] MAS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:02.645925] [DEBUG] [LOCAL     ] MANU: Saving derivative data.
[2025-10-24T01:25:02.668474] [DEBUG] [LOCAL     ] MANU: Derivative data saved (139 records).
[2025-10-24T01:25:02.669374] [INFO ] [MAIN      ] MANU: Successfully saved derivative data.
[2025-10-24T01:25:02.672048] [INFO ] [MAIN      ] Derivative Progress: 1193/2164 symbols completed. MANU took 1.4s. Estimated remaining: 6m 48s. Rate: 142.7 symbols/min
[2025-10-24T01:25:02.674499] [INFO ] [MAIN      ] MATV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:02.677562] [INFO ] [MAIN      ] MAN: Generated 139 derivative records from 44638 primary records.
[2025-10-24T01:25:02.677975] [DEBUG] [LOCAL     ] MAN: Saving derivative data.
[2025-10-24T01:25:02.691287] [DEBUG] [LOCAL     ] MAN: Derivative data saved (139 records).
[2025-10-24T01:25:02.691926] [INFO ] [MAIN      ] MAN: Successfully saved derivative data.
[2025-10-24T01:25:02.694822] [INFO ] [MAIN      ] Derivative Progress: 1194/2164 symbols completed. MAN took 1.5s. Estimated remaining: 6m 48s. Rate: 142.8 symbols/min
[2025-10-24T01:25:02.695375] [INFO ] [MAIN      ] MATX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:02.725040] [DEBUG] [LOCAL     ] MATV: Loaded 35246 existing records from primary storage.
[2025-10-24T01:25:02.725296] [INFO ] [MAIN      ] MATV: Loaded 35246 primary data records.
[2025-10-24T01:25:02.890939] [DEBUG] [LOCAL     ] MATX: Loaded 32093 existing records from primary storage.
[2025-10-24T01:25:02.928152] [DEBUG] [LOCAL     ] MAS: Loaded 52573 existing records from primary storage.
[2025-10-24T01:25:02.965775] [INFO ] [MAIN      ] MATX: Loaded 32093 primary data records.
[2025-10-24T01:25:02.965975] [INFO ] [MAIN      ] MAS: Loaded 52573 primary data records.
[2025-10-24T01:25:03.789268] [DEBUG] [MAIN      ] MATV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:03.850913] [DEBUG] [MAIN      ] MATX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:03.850581] [DEBUG] [MAIN      ] MAS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:03.894681] [INFO ] [MAIN      ] MATV: Generated 139 derivative records from 35246 primary records.
[2025-10-24T01:25:03.895166] [DEBUG] [LOCAL     ] MATV: Saving derivative data.
[2025-10-24T01:25:03.913389] [DEBUG] [LOCAL     ] MATV: Derivative data saved (139 records).
[2025-10-24T01:25:03.914931] [INFO ] [MAIN      ] MATV: Successfully saved derivative data.
[2025-10-24T01:25:03.918062] [INFO ] [MAIN      ] Derivative Progress: 1195/2164 symbols completed. MATV took 1.2s. Estimated remaining: 6m 48s. Rate: 142.6 symbols/min
[2025-10-24T01:25:03.921383] [INFO ] [MAIN      ] MAX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:03.944241] [INFO ] [MAIN      ] MAS: Generated 139 derivative records from 52573 primary records.
[2025-10-24T01:25:03.945108] [DEBUG] [LOCAL     ] MAS: Saving derivative data.
[2025-10-24T01:25:03.954738] [INFO ] [MAIN      ] MATX: Generated 139 derivative records from 32093 primary records.
[2025-10-24T01:25:03.955160] [DEBUG] [LOCAL     ] MATX: Saving derivative data.
[2025-10-24T01:25:03.976772] [DEBUG] [LOCAL     ] MAS: Derivative data saved (139 records).
[2025-10-24T01:25:03.981345] [INFO ] [MAIN      ] MAS: Successfully saved derivative data.
[2025-10-24T01:25:03.981444] [DEBUG] [LOCAL     ] MATX: Derivative data saved (139 records).
[2025-10-24T01:25:03.984490] [INFO ] [MAIN      ] Derivative Progress: 1196/2164 symbols completed. MAS took 1.3s. Estimated remaining: 6m 47s. Rate: 142.7 symbols/min
[2025-10-24T01:25:03.985807] [INFO ] [MAIN      ] MBC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:03.985619] [INFO ] [MAIN      ] MATX: Successfully saved derivative data.
[2025-10-24T01:25:03.988725] [INFO ] [MAIN      ] Derivative Progress: 1197/2164 symbols completed. MATX took 1.3s. Estimated remaining: 6m 46s. Rate: 142.8 symbols/min
[2025-10-24T01:25:03.998098] [INFO ] [MAIN      ] MBI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:03.999285] [DEBUG] [LOCAL     ] MAX: Loaded 30905 existing records from primary storage.
[2025-10-24T01:25:03.999389] [INFO ] [MAIN      ] MAX: Loaded 30905 primary data records.
[2025-10-24T01:25:04.329483] [DEBUG] [LOCAL     ] MBI: Loaded 24075 existing records from primary storage.
[2025-10-24T01:25:04.330277] [INFO ] [MAIN      ] MBI: Loaded 24075 primary data records.
[2025-10-24T01:25:04.433305] [DEBUG] [LOCAL     ] MBC: Loaded 44219 existing records from primary storage.
[2025-10-24T01:25:04.451505] [INFO ] [MAIN      ] MBC: Loaded 44219 primary data records.
[2025-10-24T01:25:04.992576] [DEBUG] [MAIN      ] MAX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:05.044909] [DEBUG] [MAIN      ] MBI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:05.089939] [INFO ] [MAIN      ] MAX: Generated 139 derivative records from 30905 primary records.
[2025-10-24T01:25:05.087001] [DEBUG] [MAIN      ] MBC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:05.105572] [DEBUG] [LOCAL     ] MAX: Saving derivative data.
[2025-10-24T01:25:05.124779] [DEBUG] [LOCAL     ] MAX: Derivative data saved (139 records).
[2025-10-24T01:25:05.129239] [INFO ] [MAIN      ] MAX: Successfully saved derivative data.
[2025-10-24T01:25:05.133614] [INFO ] [MAIN      ] Derivative Progress: 1198/2164 symbols completed. MAX took 1.2s. Estimated remaining: 6m 46s. Rate: 142.6 symbols/min
[2025-10-24T01:25:05.154053] [INFO ] [MAIN      ] MBI: Generated 139 derivative records from 24075 primary records.
[2025-10-24T01:25:05.156613] [DEBUG] [LOCAL     ] MBI: Saving derivative data.
[2025-10-24T01:25:05.173939] [DEBUG] [LOCAL     ] MBI: Derivative data saved (139 records).
[2025-10-24T01:25:05.175231] [INFO ] [MAIN      ] MBI: Successfully saved derivative data.
[2025-10-24T01:25:05.178310] [INFO ] [MAIN      ] Derivative Progress: 1199/2164 symbols completed. MBI took 1.2s. Estimated remaining: 6m 46s. Rate: 142.7 symbols/min
[2025-10-24T01:25:05.180130] [INFO ] [MAIN      ] MBC: Generated 139 derivative records from 44219 primary records.
[2025-10-24T01:25:05.180236] [DEBUG] [LOCAL     ] MBC: Saving derivative data.
[2025-10-24T01:25:05.192277] [DEBUG] [LOCAL     ] MBC: Derivative data saved (139 records).
[2025-10-24T01:25:05.192357] [INFO ] [MAIN      ] MBC: Successfully saved derivative data.
[2025-10-24T01:25:05.195380] [INFO ] [MAIN      ] Derivative Progress: 1200/2164 symbols completed. MBC took 1.2s. Estimated remaining: 6m 45s. Rate: 142.8 symbols/min
[2025-10-24T01:25:05.196071] [INFO ] [MAIN      ] MC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:05.196218] [INFO ] [MAIN      ] MCB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:05.196458] [INFO ] [MAIN      ] MCI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:05.214929] [DEBUG] [LOCAL     ] MCI: Loaded 6219 existing records from primary storage.
[2025-10-24T01:25:05.215191] [INFO ] [MAIN      ] MCI: Loaded 6219 primary data records.
[2025-10-24T01:25:05.257863] [DEBUG] [LOCAL     ] MCB: Loaded 11348 existing records from primary storage.
[2025-10-24T01:25:05.321981] [INFO ] [MAIN      ] MCB: Loaded 11348 primary data records.
[2025-10-24T01:25:05.613367] [DEBUG] [LOCAL     ] MC: Loaded 43947 existing records from primary storage.
[2025-10-24T01:25:05.626520] [INFO ] [MAIN      ] MC: Loaded 43947 primary data records.
[2025-10-24T01:25:06.254099] [DEBUG] [MAIN      ] MCI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:06.304972] [DEBUG] [MAIN      ] MCB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:06.335818] [INFO ] [MAIN      ] MCI: Generated 139 derivative records from 6219 primary records.
[2025-10-24T01:25:06.350382] [DEBUG] [MAIN      ] MC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:06.350902] [DEBUG] [LOCAL     ] MCI: Saving derivative data.
[2025-10-24T01:25:06.382991] [DEBUG] [LOCAL     ] MCI: Derivative data saved (139 records).
[2025-10-24T01:25:06.385614] [INFO ] [MAIN      ] MCI: Successfully saved derivative data.
[2025-10-24T01:25:06.389688] [INFO ] [MAIN      ] Derivative Progress: 1201/2164 symbols completed. MCI took 1.2s. Estimated remaining: 6m 45s. Rate: 142.6 symbols/min
[2025-10-24T01:25:06.392476] [INFO ] [MAIN      ] MCK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:06.406571] [INFO ] [MAIN      ] MCB: Generated 139 derivative records from 11348 primary records.
[2025-10-24T01:25:06.411399] [DEBUG] [LOCAL     ] MCB: Saving derivative data.
[2025-10-24T01:25:06.425091] [DEBUG] [LOCAL     ] MCB: Derivative data saved (139 records).
[2025-10-24T01:25:06.427323] [INFO ] [MAIN      ] MCB: Successfully saved derivative data.
[2025-10-24T01:25:06.430486] [INFO ] [MAIN      ] Derivative Progress: 1202/2164 symbols completed. MCB took 1.2s. Estimated remaining: 6m 44s. Rate: 142.7 symbols/min
[2025-10-24T01:25:06.430858] [INFO ] [MAIN      ] MCN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:06.435199] [INFO ] [MAIN      ] MC: Generated 139 derivative records from 43947 primary records.
[2025-10-24T01:25:06.444455] [DEBUG] [LOCAL     ] MC: Saving derivative data.
[2025-10-24T01:25:06.459493] [DEBUG] [LOCAL     ] MC: Derivative data saved (139 records).
[2025-10-24T01:25:06.471345] [INFO ] [MAIN      ] MC: Successfully saved derivative data.
[2025-10-24T01:25:06.474918] [INFO ] [MAIN      ] Derivative Progress: 1203/2164 symbols completed. MC took 1.3s. Estimated remaining: 6m 44s. Rate: 142.8 symbols/min
[2025-10-24T01:25:06.476955] [DEBUG] [LOCAL     ] MCK: Loaded 38261 existing records from primary storage.
[2025-10-24T01:25:06.480694] [INFO ] [MAIN      ] MCR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:06.480981] [DEBUG] [LOCAL     ] MCN: Loaded 8036 existing records from primary storage.
[2025-10-24T01:25:06.481117] [INFO ] [MAIN      ] MCK: Loaded 38261 primary data records.
[2025-10-24T01:25:06.481768] [INFO ] [MAIN      ] MCN: Loaded 8036 primary data records.
[2025-10-24T01:25:06.665568] [DEBUG] [LOCAL     ] MCR: Loaded 8908 existing records from primary storage.
[2025-10-24T01:25:06.699713] [INFO ] [MAIN      ] MCR: Loaded 8908 primary data records.
[2025-10-24T01:25:07.436548] [DEBUG] [MAIN      ] MCN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:07.468427] [DEBUG] [MAIN      ] MCK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:07.496816] [DEBUG] [MAIN      ] MCR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:07.588602] [INFO ] [MAIN      ] MCN: Generated 139 derivative records from 8036 primary records.
[2025-10-24T01:25:07.592064] [INFO ] [MAIN      ] MCK: Generated 139 derivative records from 38261 primary records.
[2025-10-24T01:25:07.592143] [DEBUG] [LOCAL     ] MCN: Saving derivative data.
[2025-10-24T01:25:07.591819] [INFO ] [MAIN      ] MCR: Generated 139 derivative records from 8908 primary records.
[2025-10-24T01:25:07.592443] [DEBUG] [LOCAL     ] MCK: Saving derivative data.
[2025-10-24T01:25:07.593808] [DEBUG] [LOCAL     ] MCR: Saving derivative data.
[2025-10-24T01:25:07.615680] [DEBUG] [LOCAL     ] MCK: Derivative data saved (139 records).
[2025-10-24T01:25:07.616572] [INFO ] [MAIN      ] MCK: Successfully saved derivative data.
[2025-10-24T01:25:07.617296] [DEBUG] [LOCAL     ] MCN: Derivative data saved (139 records).
[2025-10-24T01:25:07.620031] [INFO ] [MAIN      ] Derivative Progress: 1204/2164 symbols completed. MCK took 1.2s. Estimated remaining: 6m 44s. Rate: 142.6 symbols/min
[2025-10-24T01:25:07.621244] [INFO ] [MAIN      ] MCN: Successfully saved derivative data.
[2025-10-24T01:25:07.631186] [INFO ] [MAIN      ] MCS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:07.638550] [INFO ] [MAIN      ] Derivative Progress: 1205/2164 symbols completed. MCN took 1.2s. Estimated remaining: 6m 43s. Rate: 142.7 symbols/min
[2025-10-24T01:25:07.640040] [DEBUG] [LOCAL     ] MCR: Derivative data saved (139 records).
[2025-10-24T01:25:07.640769] [INFO ] [MAIN      ] MCY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:07.640879] [INFO ] [MAIN      ] MCR: Successfully saved derivative data.
[2025-10-24T01:25:07.643519] [INFO ] [MAIN      ] Derivative Progress: 1206/2164 symbols completed. MCR took 1.2s. Estimated remaining: 6m 42s. Rate: 142.8 symbols/min
[2025-10-24T01:25:07.644250] [INFO ] [MAIN      ] MD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:07.680794] [DEBUG] [LOCAL     ] MCS: Loaded 21310 existing records from primary storage.
[2025-10-24T01:25:07.680969] [INFO ] [MAIN      ] MCS: Loaded 21310 primary data records.
[2025-10-24T01:25:07.785769] [DEBUG] [LOCAL     ] MCY: Loaded 23681 existing records from primary storage.
[2025-10-24T01:25:07.807978] [INFO ] [MAIN      ] MCY: Loaded 23681 primary data records.
[2025-10-24T01:25:07.804788] [DEBUG] [LOCAL     ] MD: Loaded 38809 existing records from primary storage.
[2025-10-24T01:25:07.808792] [INFO ] [MAIN      ] MD: Loaded 38809 primary data records.
[2025-10-24T01:25:08.674016] [DEBUG] [MAIN      ] MCS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:08.716463] [DEBUG] [MAIN      ] MCY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:08.729137] [DEBUG] [MAIN      ] MD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:08.792612] [INFO ] [MAIN      ] MCS: Generated 139 derivative records from 21310 primary records.
[2025-10-24T01:25:08.793475] [DEBUG] [LOCAL     ] MCS: Saving derivative data.
[2025-10-24T01:25:08.812620] [DEBUG] [LOCAL     ] MCS: Derivative data saved (139 records).
[2025-10-24T01:25:08.814099] [INFO ] [MAIN      ] MCS: Successfully saved derivative data.
[2025-10-24T01:25:08.819774] [INFO ] [MAIN      ] Derivative Progress: 1207/2164 symbols completed. MCS took 1.2s. Estimated remaining: 6m 43s. Rate: 142.6 symbols/min
[2025-10-24T01:25:08.819968] [INFO ] [MAIN      ] MDST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:08.830157] [INFO ] [MAIN      ] MCY: Generated 139 derivative records from 23681 primary records.
[2025-10-24T01:25:08.831036] [DEBUG] [LOCAL     ] MCY: Saving derivative data.
[2025-10-24T01:25:08.833329] [INFO ] [MAIN      ] MD: Generated 139 derivative records from 38809 primary records.
[2025-10-24T01:25:08.834396] [DEBUG] [LOCAL     ] MD: Saving derivative data.
[2025-10-24T01:25:08.846220] [DEBUG] [LOCAL     ] MCY: Derivative data saved (139 records).
[2025-10-24T01:25:08.849116] [INFO ] [MAIN      ] MCY: Successfully saved derivative data.
[2025-10-24T01:25:08.852995] [INFO ] [MAIN      ] Derivative Progress: 1208/2164 symbols completed. MCY took 1.2s. Estimated remaining: 6m 42s. Rate: 142.7 symbols/min
[2025-10-24T01:25:08.861447] [INFO ] [MAIN      ] MDT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:08.870583] [DEBUG] [LOCAL     ] MDST: Loaded 6167 existing records from primary storage.
[2025-10-24T01:25:08.871611] [DEBUG] [LOCAL     ] MD: Derivative data saved (139 records).
[2025-10-24T01:25:08.871999] [INFO ] [MAIN      ] MD: Successfully saved derivative data.
[2025-10-24T01:25:08.874957] [INFO ] [MAIN      ] Derivative Progress: 1209/2164 symbols completed. MD took 1.2s. Estimated remaining: 6m 41s. Rate: 142.8 symbols/min
[2025-10-24T01:25:08.875462] [INFO ] [MAIN      ] MDU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:08.875106] [INFO ] [MAIN      ] MDST: Loaded 6167 primary data records.
[2025-10-24T01:25:09.257486] [DEBUG] [LOCAL     ] MDT: Loaded 54068 existing records from primary storage.
[2025-10-24T01:25:09.258158] [INFO ] [MAIN      ] MDT: Loaded 54068 primary data records.
[2025-10-24T01:25:09.394843] [DEBUG] [LOCAL     ] MDU: Loaded 48379 existing records from primary storage.
[2025-10-24T01:25:09.397709] [INFO ] [MAIN      ] MDU: Loaded 48379 primary data records.
[2025-10-24T01:25:09.515396] [DEBUG] [MAIN      ] MDST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:09.914410] [INFO ] [MAIN      ] MDST: Generated 139 derivative records from 6167 primary records.
[2025-10-24T01:25:09.953481] [DEBUG] [LOCAL     ] MDST: Saving derivative data.
[2025-10-24T01:25:10.068481] [DEBUG] [LOCAL     ] MDST: Derivative data saved (139 records).
[2025-10-24T01:25:10.217990] [INFO ] [MAIN      ] MDST: Successfully saved derivative data.
[2025-10-24T01:25:10.231184] [INFO ] [MAIN      ] Derivative Progress: 1210/2164 symbols completed. MDST took 1.4s. Estimated remaining: 6m 41s. Rate: 142.6 symbols/min
[2025-10-24T01:25:10.231551] [INFO ] [MAIN      ] MDV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:10.253373] [DEBUG] [LOCAL     ] MDV: Loaded 8334 existing records from primary storage.
[2025-10-24T01:25:10.254282] [INFO ] [MAIN      ] MDV: Loaded 8334 primary data records.
[2025-10-24T01:25:10.323357] [DEBUG] [MAIN      ] MDT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:10.532603] [DEBUG] [MAIN      ] MDU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:10.712204] [INFO ] [MAIN      ] MDT: Generated 139 derivative records from 54068 primary records.
[2025-10-24T01:25:10.718674] [DEBUG] [LOCAL     ] MDT: Saving derivative data.
[2025-10-24T01:25:10.723498] [INFO ] [MAIN      ] MDU: Generated 139 derivative records from 48379 primary records.
[2025-10-24T01:25:10.735497] [DEBUG] [LOCAL     ] MDT: Derivative data saved (139 records).
[2025-10-24T01:25:10.735863] [DEBUG] [LOCAL     ] MDU: Saving derivative data.
[2025-10-24T01:25:10.736158] [INFO ] [MAIN      ] MDT: Successfully saved derivative data.
[2025-10-24T01:25:10.753096] [DEBUG] [MAIN      ] MDV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:10.751923] [INFO ] [MAIN      ] Derivative Progress: 1211/2164 symbols completed. MDT took 1.9s. Estimated remaining: 6m 41s. Rate: 142.6 symbols/min
[2025-10-24T01:25:10.774887] [INFO ] [MAIN      ] MEC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:10.780604] [DEBUG] [LOCAL     ] MDU: Derivative data saved (139 records).
[2025-10-24T01:25:10.781301] [INFO ] [MAIN      ] MDU: Successfully saved derivative data.
[2025-10-24T01:25:10.784990] [INFO ] [MAIN      ] Derivative Progress: 1212/2164 symbols completed. MDU took 1.9s. Estimated remaining: 6m 40s. Rate: 142.7 symbols/min
[2025-10-24T01:25:10.789592] [INFO ] [MAIN      ] MED: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:10.819823] [INFO ] [MAIN      ] MDV: Generated 139 derivative records from 8334 primary records.
[2025-10-24T01:25:10.820011] [DEBUG] [LOCAL     ] MDV: Saving derivative data.
[2025-10-24T01:25:10.835155] [DEBUG] [LOCAL     ] MEC: Loaded 17069 existing records from primary storage.
[2025-10-24T01:25:10.835606] [DEBUG] [LOCAL     ] MED: Loaded 21092 existing records from primary storage.
[2025-10-24T01:25:10.843269] [INFO ] [MAIN      ] MED: Loaded 21092 primary data records.
[2025-10-24T01:25:10.843205] [INFO ] [MAIN      ] MEC: Loaded 17069 primary data records.
[2025-10-24T01:25:10.988992] [DEBUG] [LOCAL     ] MDV: Derivative data saved (139 records).
[2025-10-24T01:25:11.072830] [INFO ] [MAIN      ] MDV: Successfully saved derivative data.
[2025-10-24T01:25:11.136104] [INFO ] [MAIN      ] Derivative Progress: 1213/2164 symbols completed. MDV took 0.9s. Estimated remaining: 6m 40s. Rate: 142.7 symbols/min
[2025-10-24T01:25:11.494767] [DEBUG] [MAIN      ] MEC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:11.528966] [DEBUG] [MAIN      ] MED: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:11.571750] [INFO ] [MAIN      ] MEC: Generated 139 derivative records from 17069 primary records.
[2025-10-24T01:25:11.572084] [DEBUG] [LOCAL     ] MEC: Saving derivative data.
[2025-10-24T01:25:11.594391] [INFO ] [MAIN      ] MED: Generated 139 derivative records from 21092 primary records.
[2025-10-24T01:25:11.592333] [DEBUG] [LOCAL     ] MEC: Derivative data saved (139 records).
[2025-10-24T01:25:11.594550] [DEBUG] [LOCAL     ] MED: Saving derivative data.
[2025-10-24T01:25:11.594993] [INFO ] [MAIN      ] MEC: Successfully saved derivative data.
[2025-10-24T01:25:11.597229] [INFO ] [MAIN      ] Derivative Progress: 1214/2164 symbols completed. MEC took 0.8s. Estimated remaining: 6m 40s. Rate: 142.7 symbols/min
[2025-10-24T01:25:11.609138] [DEBUG] [LOCAL     ] MED: Derivative data saved (139 records).
[2025-10-24T01:25:11.609226] [INFO ] [MAIN      ] MED: Successfully saved derivative data.
[2025-10-24T01:25:11.611341] [INFO ] [MAIN      ] Derivative Progress: 1215/2164 symbols completed. MED took 0.8s. Estimated remaining: 6m 39s. Rate: 142.8 symbols/min
[2025-10-24T01:25:11.611819] [INFO ] [MAIN      ] MEG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:11.611955] [INFO ] [MAIN      ] MEI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:11.612237] [INFO ] [MAIN      ] MEGI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:11.661814] [DEBUG] [LOCAL     ] MEGI: Loaded 19865 existing records from primary storage.
[2025-10-24T01:25:11.663990] [DEBUG] [LOCAL     ] MEI: Loaded 31496 existing records from primary storage.
[2025-10-24T01:25:11.664113] [INFO ] [MAIN      ] MEGI: Loaded 19865 primary data records.
[2025-10-24T01:25:11.672967] [INFO ] [MAIN      ] MEI: Loaded 31496 primary data records.
[2025-10-24T01:25:11.673875] [DEBUG] [LOCAL     ] MEG: Loaded 31806 existing records from primary storage.
[2025-10-24T01:25:11.709197] [INFO ] [MAIN      ] MEG: Loaded 31806 primary data records.
[2025-10-24T01:25:12.718876] [DEBUG] [MAIN      ] MEGI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:12.720435] [DEBUG] [MAIN      ] MEI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:12.766235] [DEBUG] [MAIN      ] MEG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:12.854726] [INFO ] [MAIN      ] MEGI: Generated 139 derivative records from 19865 primary records.
[2025-10-24T01:25:12.855036] [INFO ] [MAIN      ] MEI: Generated 139 derivative records from 31496 primary records.
[2025-10-24T01:25:12.857923] [DEBUG] [LOCAL     ] MEGI: Saving derivative data.
[2025-10-24T01:25:12.858504] [DEBUG] [LOCAL     ] MEI: Saving derivative data.
[2025-10-24T01:25:12.858205] [INFO ] [MAIN      ] MEG: Generated 139 derivative records from 31806 primary records.
[2025-10-24T01:25:12.860457] [DEBUG] [LOCAL     ] MEG: Saving derivative data.
[2025-10-24T01:25:12.880977] [DEBUG] [LOCAL     ] MEI: Derivative data saved (139 records).
[2025-10-24T01:25:12.884000] [INFO ] [MAIN      ] MEI: Successfully saved derivative data.
[2025-10-24T01:25:12.897895] [INFO ] [MAIN      ] Derivative Progress: 1216/2164 symbols completed. MEI took 1.3s. Estimated remaining: 6m 39s. Rate: 142.5 symbols/min
[2025-10-24T01:25:12.899459] [INFO ] [MAIN      ] MET: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:12.907310] [DEBUG] [LOCAL     ] MEGI: Derivative data saved (139 records).
[2025-10-24T01:25:12.908957] [DEBUG] [LOCAL     ] MEG: Derivative data saved (139 records).
[2025-10-24T01:25:12.909301] [INFO ] [MAIN      ] MEGI: Successfully saved derivative data.
[2025-10-24T01:25:12.909483] [INFO ] [MAIN      ] MEG: Successfully saved derivative data.
[2025-10-24T01:25:12.913190] [INFO ] [MAIN      ] Derivative Progress: 1217/2164 symbols completed. MEG took 1.3s. Estimated remaining: 6m 38s. Rate: 142.7 symbols/min
[2025-10-24T01:25:12.917103] [INFO ] [MAIN      ] Derivative Progress: 1218/2164 symbols completed. MEGI took 1.3s. Estimated remaining: 6m 38s. Rate: 142.8 symbols/min
[2025-10-24T01:25:12.917020] [INFO ] [MAIN      ] MFA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:12.917409] [INFO ] [MAIN      ] MFAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:12.928006] [DEBUG] [LOCAL     ] MFAN: Loaded 4331 existing records from primary storage.
[2025-10-24T01:25:12.928283] [INFO ] [MAIN      ] MFAN: Loaded 4331 primary data records.
[2025-10-24T01:25:13.224985] [DEBUG] [LOCAL     ] MFA: Loaded 45870 existing records from primary storage.
[2025-10-24T01:25:13.225328] [INFO ] [MAIN      ] MFA: Loaded 45870 primary data records.
[2025-10-24T01:25:13.224006] [DEBUG] [LOCAL     ] MET: Loaded 53677 existing records from primary storage.
[2025-10-24T01:25:13.408979] [INFO ] [MAIN      ] MET: Loaded 53677 primary data records.
[2025-10-24T01:25:14.052893] [DEBUG] [MAIN      ] MFAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:14.122480] [DEBUG] [MAIN      ] MET: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:14.121894] [DEBUG] [MAIN      ] MFA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:14.151289] [INFO ] [MAIN      ] MFAN: Generated 139 derivative records from 4331 primary records.
[2025-10-24T01:25:14.153988] [DEBUG] [LOCAL     ] MFAN: Saving derivative data.
[2025-10-24T01:25:14.168088] [DEBUG] [LOCAL     ] MFAN: Derivative data saved (139 records).
[2025-10-24T01:25:14.172147] [INFO ] [MAIN      ] MFAN: Successfully saved derivative data.
[2025-10-24T01:25:14.179829] [INFO ] [MAIN      ] Derivative Progress: 1219/2164 symbols completed. MFAN took 1.3s. Estimated remaining: 6m 38s. Rate: 142.5 symbols/min
[2025-10-24T01:25:14.180779] [INFO ] [MAIN      ] MFAO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:14.204966] [DEBUG] [LOCAL     ] MFAO: Loaded 3900 existing records from primary storage.
[2025-10-24T01:25:14.207369] [INFO ] [MAIN      ] MFAO: Loaded 3900 primary data records.
[2025-10-24T01:25:14.342622] [INFO ] [MAIN      ] MET: Generated 139 derivative records from 53677 primary records.
[2025-10-24T01:25:14.470698] [DEBUG] [LOCAL     ] MET: Saving derivative data.
[2025-10-24T01:25:14.409009] [INFO ] [MAIN      ] MFA: Generated 139 derivative records from 45870 primary records.
[2025-10-24T01:25:14.529433] [DEBUG] [LOCAL     ] MFA: Saving derivative data.
[2025-10-24T01:25:14.553489] [DEBUG] [LOCAL     ] MET: Derivative data saved (139 records).
[2025-10-24T01:25:14.555348] [INFO ] [MAIN      ] MET: Successfully saved derivative data.
[2025-10-24T01:25:14.558561] [INFO ] [MAIN      ] Derivative Progress: 1220/2164 symbols completed. MET took 1.7s. Estimated remaining: 6m 37s. Rate: 142.5 symbols/min
[2025-10-24T01:25:14.559154] [INFO ] [MAIN      ] MFC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:14.561191] [DEBUG] [LOCAL     ] MFA: Derivative data saved (139 records).
[2025-10-24T01:25:14.561631] [INFO ] [MAIN      ] MFA: Successfully saved derivative data.
[2025-10-24T01:25:14.564754] [INFO ] [MAIN      ] Derivative Progress: 1221/2164 symbols completed. MFA took 1.6s. Estimated remaining: 6m 37s. Rate: 142.7 symbols/min
[2025-10-24T01:25:14.565403] [INFO ] [MAIN      ] MFG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:14.590010] [DEBUG] [MAIN      ] MFAO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:14.662479] [DEBUG] [LOCAL     ] MFC: Loaded 51351 existing records from primary storage.
[2025-10-24T01:25:14.664249] [INFO ] [MAIN      ] MFC: Loaded 51351 primary data records.
[2025-10-24T01:25:14.732207] [INFO ] [MAIN      ] MFAO: Generated 139 derivative records from 3900 primary records.
[2025-10-24T01:25:14.712735] [DEBUG] [LOCAL     ] MFG: Loaded 49876 existing records from primary storage.
[2025-10-24T01:25:14.754133] [DEBUG] [LOCAL     ] MFAO: Saving derivative data.
[2025-10-24T01:25:14.761245] [INFO ] [MAIN      ] MFG: Loaded 49876 primary data records.
[2025-10-24T01:25:14.845777] [DEBUG] [LOCAL     ] MFAO: Derivative data saved (139 records).
[2025-10-24T01:25:15.072563] [INFO ] [MAIN      ] MFAO: Successfully saved derivative data.
[2025-10-24T01:25:15.107330] [INFO ] [MAIN      ] Derivative Progress: 1222/2164 symbols completed. MFAO took 0.9s. Estimated remaining: 6m 36s. Rate: 142.6 symbols/min
[2025-10-24T01:25:15.126223] [INFO ] [MAIN      ] MFM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:15.340724] [DEBUG] [LOCAL     ] MFM: Loaded 14129 existing records from primary storage.
[2025-10-24T01:25:15.341124] [INFO ] [MAIN      ] MFM: Loaded 14129 primary data records.
[2025-10-24T01:25:15.660701] [DEBUG] [MAIN      ] MFC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:15.706968] [DEBUG] [MAIN      ] MFG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:15.742284] [INFO ] [MAIN      ] MFC: Generated 139 derivative records from 51351 primary records.
[2025-10-24T01:25:15.753041] [DEBUG] [LOCAL     ] MFC: Saving derivative data.
[2025-10-24T01:25:15.760738] [DEBUG] [MAIN      ] MFM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:15.785379] [DEBUG] [LOCAL     ] MFC: Derivative data saved (139 records).
[2025-10-24T01:25:15.786711] [INFO ] [MAIN      ] MFC: Successfully saved derivative data.
[2025-10-24T01:25:15.789242] [INFO ] [MAIN      ] Derivative Progress: 1223/2164 symbols completed. MFC took 1.2s. Estimated remaining: 6m 36s. Rate: 142.6 symbols/min
[2025-10-24T01:25:15.791277] [INFO ] [MAIN      ] MFSG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:15.812705] [DEBUG] [LOCAL     ] MFSG: Loaded 5990 existing records from primary storage.
[2025-10-24T01:25:15.814881] [INFO ] [MAIN      ] MFSG: Loaded 5990 primary data records.
[2025-10-24T01:25:15.815231] [INFO ] [MAIN      ] MFG: Generated 139 derivative records from 49876 primary records.
[2025-10-24T01:25:15.835928] [DEBUG] [LOCAL     ] MFG: Saving derivative data.
[2025-10-24T01:25:15.933514] [DEBUG] [LOCAL     ] MFG: Derivative data saved (139 records).
[2025-10-24T01:25:15.961383] [INFO ] [MAIN      ] MFG: Successfully saved derivative data.
[2025-10-24T01:25:15.998499] [INFO ] [MAIN      ] Derivative Progress: 1224/2164 symbols completed. MFG took 1.4s. Estimated remaining: 6m 35s. Rate: 142.6 symbols/min
[2025-10-24T01:25:16.030255] [INFO ] [MAIN      ] MFSI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:16.169470] [INFO ] [MAIN      ] MFM: Generated 139 derivative records from 14129 primary records.
[2025-10-24T01:25:16.170540] [DEBUG] [LOCAL     ] MFM: Saving derivative data.
[2025-10-24T01:25:16.183897] [DEBUG] [LOCAL     ] MFM: Derivative data saved (139 records).
[2025-10-24T01:25:16.184836] [INFO ] [MAIN      ] MFM: Successfully saved derivative data.
[2025-10-24T01:25:16.187974] [INFO ] [MAIN      ] Derivative Progress: 1225/2164 symbols completed. MFM took 1.1s. Estimated remaining: 6m 35s. Rate: 142.7 symbols/min
[2025-10-24T01:25:16.188941] [INFO ] [MAIN      ] MFSV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:16.203030] [DEBUG] [LOCAL     ] MFSI: Loaded 12771 existing records from primary storage.
[2025-10-24T01:25:16.203469] [INFO ] [MAIN      ] MFSI: Loaded 12771 primary data records.
[2025-10-24T01:25:16.237997] [DEBUG] [LOCAL     ] MFSV: Loaded 2986 existing records from primary storage.
[2025-10-24T01:25:16.263867] [INFO ] [MAIN      ] MFSV: Loaded 2986 primary data records.
[2025-10-24T01:25:16.496699] [DEBUG] [MAIN      ] MFSG: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:25:16.933219] [INFO ] [MAIN      ] MFSG: Generated 139 derivative records from 5990 primary records.
[2025-10-24T01:25:16.933526] [DEBUG] [LOCAL     ] MFSG: Saving derivative data.
[2025-10-24T01:25:16.949794] [DEBUG] [LOCAL     ] MFSG: Derivative data saved (139 records).
[2025-10-24T01:25:16.950283] [INFO ] [MAIN      ] MFSG: Successfully saved derivative data.
[2025-10-24T01:25:16.952583] [INFO ] [MAIN      ] Derivative Progress: 1226/2164 symbols completed. MFSG took 1.2s. Estimated remaining: 6m 35s. Rate: 142.6 symbols/min
[2025-10-24T01:25:16.964893] [INFO ] [MAIN      ] MG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:16.966477] [DEBUG] [MAIN      ] MFSI: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:25:17.012154] [DEBUG] [MAIN      ] MFSV: Filtered 6966 bins outside market hours, 7761 incomplete bins
[2025-10-24T01:25:17.034090] [DEBUG] [LOCAL     ] MG: Loaded 15462 existing records from primary storage.
[2025-10-24T01:25:17.041501] [INFO ] [MAIN      ] MG: Loaded 15462 primary data records.
[2025-10-24T01:25:17.185022] [INFO ] [MAIN      ] MFSI: Generated 139 derivative records from 12771 primary records.
[2025-10-24T01:25:17.236697] [DEBUG] [LOCAL     ] MFSI: Saving derivative data.
[2025-10-24T01:25:17.407082] [DEBUG] [LOCAL     ] MFSI: Derivative data saved (139 records).
[2025-10-24T01:25:17.411589] [INFO ] [MAIN      ] MFSI: Successfully saved derivative data.
[2025-10-24T01:25:17.414735] [INFO ] [MAIN      ] Derivative Progress: 1227/2164 symbols completed. MFSI took 1.4s. Estimated remaining: 6m 34s. Rate: 142.6 symbols/min
[2025-10-24T01:25:17.415122] [INFO ] [MAIN      ] MGA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:17.420806] [INFO ] [MAIN      ] MFSV: Generated 139 derivative records from 2986 primary records.
[2025-10-24T01:25:17.421359] [DEBUG] [LOCAL     ] MFSV: Saving derivative data.
[2025-10-24T01:25:17.435007] [DEBUG] [LOCAL     ] MFSV: Derivative data saved (139 records).
[2025-10-24T01:25:17.435511] [INFO ] [MAIN      ] MFSV: Successfully saved derivative data.
[2025-10-24T01:25:17.438468] [INFO ] [MAIN      ] Derivative Progress: 1228/2164 symbols completed. MFSV took 1.2s. Estimated remaining: 6m 34s. Rate: 142.7 symbols/min
[2025-10-24T01:25:17.458517] [DEBUG] [MAIN      ] MG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:17.520247] [INFO ] [MAIN      ] MG: Generated 139 derivative records from 15462 primary records.
[2025-10-24T01:25:17.521548] [DEBUG] [LOCAL     ] MGA: Loaded 50758 existing records from primary storage.
[2025-10-24T01:25:17.521911] [INFO ] [MAIN      ] MGA: Loaded 50758 primary data records.
[2025-10-24T01:25:17.521683] [DEBUG] [LOCAL     ] MG: Saving derivative data.
[2025-10-24T01:25:17.617067] [DEBUG] [LOCAL     ] MG: Derivative data saved (139 records).
[2025-10-24T01:25:17.641278] [INFO ] [MAIN      ] MG: Successfully saved derivative data.
[2025-10-24T01:25:17.643594] [INFO ] [MAIN      ] Derivative Progress: 1229/2164 symbols completed. MG took 0.7s. Estimated remaining: 6m 33s. Rate: 142.7 symbols/min
[2025-10-24T01:25:17.875262] [DEBUG] [MAIN      ] MGA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:17.901019] [INFO ] [MAIN      ] MGA: Generated 139 derivative records from 50758 primary records.
[2025-10-24T01:25:17.901218] [DEBUG] [LOCAL     ] MGA: Saving derivative data.
[2025-10-24T01:25:17.913096] [DEBUG] [LOCAL     ] MGA: Derivative data saved (139 records).
[2025-10-24T01:25:17.913247] [INFO ] [MAIN      ] MGA: Successfully saved derivative data.
[2025-10-24T01:25:17.915683] [INFO ] [MAIN      ] Derivative Progress: 1230/2164 symbols completed. MGA took 0.5s. Estimated remaining: 6m 32s. Rate: 142.8 symbols/min
[2025-10-24T01:25:17.916605] [INFO ] [MAIN      ] MGR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:17.916543] [INFO ] [MAIN      ] MGM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:17.916488] [INFO ] [MAIN      ] MGF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:17.928482] [DEBUG] [LOCAL     ] MGF: Loaded 4146 existing records from primary storage.
[2025-10-24T01:25:17.928859] [INFO ] [MAIN      ] MGF: Loaded 4146 primary data records.
[2025-10-24T01:25:17.972793] [DEBUG] [LOCAL     ] MGR: Loaded 5552 existing records from primary storage.
[2025-10-24T01:25:18.021812] [INFO ] [MAIN      ] MGR: Loaded 5552 primary data records.
[2025-10-24T01:25:18.402167] [DEBUG] [LOCAL     ] MGM: Loaded 53993 existing records from primary storage.
[2025-10-24T01:25:18.418668] [INFO ] [MAIN      ] MGM: Loaded 53993 primary data records.
[2025-10-24T01:25:18.966306] [DEBUG] [MAIN      ] MGF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:19.012840] [DEBUG] [MAIN      ] MGR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:19.038635] [DEBUG] [MAIN      ] MGM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:19.085556] [INFO ] [MAIN      ] MGF: Generated 139 derivative records from 4146 primary records.
[2025-10-24T01:25:19.087502] [DEBUG] [LOCAL     ] MGF: Saving derivative data.
[2025-10-24T01:25:19.108693] [DEBUG] [LOCAL     ] MGF: Derivative data saved (139 records).
[2025-10-24T01:25:19.109900] [INFO ] [MAIN      ] MGF: Successfully saved derivative data.
[2025-10-24T01:25:19.112505] [INFO ] [MAIN      ] Derivative Progress: 1231/2164 symbols completed. MGF took 1.2s. Estimated remaining: 6m 33s. Rate: 142.6 symbols/min
[2025-10-24T01:25:19.113469] [INFO ] [MAIN      ] MGRB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:19.120558] [INFO ] [MAIN      ] MGR: Generated 139 derivative records from 5552 primary records.
[2025-10-24T01:25:19.121329] [DEBUG] [LOCAL     ] MGR: Saving derivative data.
[2025-10-24T01:25:19.125488] [DEBUG] [LOCAL     ] MGRB: Loaded 4007 existing records from primary storage.
[2025-10-24T01:25:19.133175] [INFO ] [MAIN      ] MGRB: Loaded 4007 primary data records.
[2025-10-24T01:25:19.192931] [DEBUG] [LOCAL     ] MGR: Derivative data saved (139 records).
[2025-10-24T01:25:19.215092] [INFO ] [MAIN      ] MGM: Generated 139 derivative records from 53993 primary records.
[2025-10-24T01:25:19.231740] [DEBUG] [LOCAL     ] MGM: Saving derivative data.
[2025-10-24T01:25:19.231862] [INFO ] [MAIN      ] MGR: Successfully saved derivative data.
[2025-10-24T01:25:19.245737] [INFO ] [MAIN      ] Derivative Progress: 1232/2164 symbols completed. MGR took 1.3s. Estimated remaining: 6m 32s. Rate: 142.6 symbols/min
[2025-10-24T01:25:19.266716] [INFO ] [MAIN      ] MGRD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:19.280606] [DEBUG] [LOCAL     ] MGM: Derivative data saved (139 records).
[2025-10-24T01:25:19.308131] [INFO ] [MAIN      ] MGM: Successfully saved derivative data.
[2025-10-24T01:25:19.311089] [INFO ] [MAIN      ] Derivative Progress: 1233/2164 symbols completed. MGM took 1.4s. Estimated remaining: 6m 31s. Rate: 142.7 symbols/min
[2025-10-24T01:25:19.320232] [INFO ] [MAIN      ] MGRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:19.443252] [DEBUG] [LOCAL     ] MGRD: Loaded 2213 existing records from primary storage.
[2025-10-24T01:25:19.457912] [INFO ] [MAIN      ] MGRD: Loaded 2213 primary data records.
[2025-10-24T01:25:19.530514] [DEBUG] [LOCAL     ] MGRE: Loaded 6452 existing records from primary storage.
[2025-10-24T01:25:19.543533] [INFO ] [MAIN      ] MGRE: Loaded 6452 primary data records.
[2025-10-24T01:25:20.094538] [DEBUG] [MAIN      ] MGRB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:20.146423] [DEBUG] [MAIN      ] MGRD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:20.174169] [INFO ] [MAIN      ] MGRB: Generated 139 derivative records from 4007 primary records.
[2025-10-24T01:25:20.188819] [DEBUG] [LOCAL     ] MGRB: Saving derivative data.
[2025-10-24T01:25:20.189822] [DEBUG] [MAIN      ] MGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:20.217484] [DEBUG] [LOCAL     ] MGRB: Derivative data saved (139 records).
[2025-10-24T01:25:20.220606] [INFO ] [MAIN      ] MGRB: Successfully saved derivative data.
[2025-10-24T01:25:20.226406] [INFO ] [MAIN      ] Derivative Progress: 1234/2164 symbols completed. MGRB took 1.1s. Estimated remaining: 6m 31s. Rate: 142.6 symbols/min
[2025-10-24T01:25:20.232193] [INFO ] [MAIN      ] MGY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:20.257462] [INFO ] [MAIN      ] MGRD: Generated 139 derivative records from 2213 primary records.
[2025-10-24T01:25:20.260710] [DEBUG] [LOCAL     ] MGRD: Saving derivative data.
[2025-10-24T01:25:20.274200] [DEBUG] [LOCAL     ] MGRD: Derivative data saved (139 records).
[2025-10-24T01:25:20.274564] [INFO ] [MAIN      ] MGRE: Generated 139 derivative records from 6452 primary records.
[2025-10-24T01:25:20.274718] [INFO ] [MAIN      ] MGRD: Successfully saved derivative data.
[2025-10-24T01:25:20.274841] [DEBUG] [LOCAL     ] MGRE: Saving derivative data.
[2025-10-24T01:25:20.276980] [INFO ] [MAIN      ] Derivative Progress: 1235/2164 symbols completed. MGRD took 1.0s. Estimated remaining: 6m 31s. Rate: 142.7 symbols/min
[2025-10-24T01:25:20.290566] [INFO ] [MAIN      ] MHD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:20.302737] [DEBUG] [LOCAL     ] MGRE: Derivative data saved (139 records).
[2025-10-24T01:25:20.303782] [INFO ] [MAIN      ] MGRE: Successfully saved derivative data.
[2025-10-24T01:25:20.306566] [INFO ] [MAIN      ] Derivative Progress: 1236/2164 symbols completed. MGRE took 1.0s. Estimated remaining: 6m 30s. Rate: 142.8 symbols/min
[2025-10-24T01:25:20.306862] [INFO ] [MAIN      ] MHF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:20.324170] [DEBUG] [LOCAL     ] MGY: Loaded 52808 existing records from primary storage.
[2025-10-24T01:25:20.327431] [INFO ] [MAIN      ] MGY: Loaded 52808 primary data records.
[2025-10-24T01:25:20.428955] [DEBUG] [LOCAL     ] MHF: Loaded 9083 existing records from primary storage.
[2025-10-24T01:25:20.411502] [DEBUG] [LOCAL     ] MHD: Loaded 11963 existing records from primary storage.
[2025-10-24T01:25:20.445305] [INFO ] [MAIN      ] MHD: Loaded 11963 primary data records.
[2025-10-24T01:25:20.445395] [INFO ] [MAIN      ] MHF: Loaded 9083 primary data records.
[2025-10-24T01:25:21.277792] [DEBUG] [MAIN      ] MGY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:21.314455] [DEBUG] [MAIN      ] MHF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:21.326688] [DEBUG] [MAIN      ] MHD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:21.382494] [INFO ] [MAIN      ] MGY: Generated 139 derivative records from 52808 primary records.
[2025-10-24T01:25:21.383586] [DEBUG] [LOCAL     ] MGY: Saving derivative data.
[2025-10-24T01:25:21.400126] [DEBUG] [LOCAL     ] MGY: Derivative data saved (139 records).
[2025-10-24T01:25:21.402429] [INFO ] [MAIN      ] MGY: Successfully saved derivative data.
[2025-10-24T01:25:21.405027] [INFO ] [MAIN      ] Derivative Progress: 1237/2164 symbols completed. MGY took 1.2s. Estimated remaining: 6m 30s. Rate: 142.6 symbols/min
[2025-10-24T01:25:21.406224] [INFO ] [MAIN      ] MHK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:21.419897] [INFO ] [MAIN      ] MHF: Generated 139 derivative records from 9083 primary records.
[2025-10-24T01:25:21.421723] [INFO ] [MAIN      ] MHD: Generated 139 derivative records from 11963 primary records.
[2025-10-24T01:25:21.421954] [DEBUG] [LOCAL     ] MHF: Saving derivative data.
[2025-10-24T01:25:21.422074] [DEBUG] [LOCAL     ] MHD: Saving derivative data.
[2025-10-24T01:25:21.443443] [DEBUG] [LOCAL     ] MHF: Derivative data saved (139 records).
[2025-10-24T01:25:21.445609] [DEBUG] [LOCAL     ] MHD: Derivative data saved (139 records).
[2025-10-24T01:25:21.454373] [INFO ] [MAIN      ] MHF: Successfully saved derivative data.
[2025-10-24T01:25:21.456999] [INFO ] [MAIN      ] Derivative Progress: 1238/2164 symbols completed. MHF took 1.2s. Estimated remaining: 6m 29s. Rate: 142.7 symbols/min
[2025-10-24T01:25:21.457201] [INFO ] [MAIN      ] MHD: Successfully saved derivative data.
[2025-10-24T01:25:21.459819] [INFO ] [MAIN      ] Derivative Progress: 1239/2164 symbols completed. MHD took 1.2s. Estimated remaining: 6m 29s. Rate: 142.8 symbols/min
[2025-10-24T01:25:21.457302] [INFO ] [MAIN      ] MHN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:21.460027] [INFO ] [MAIN      ] MHO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:21.477908] [DEBUG] [LOCAL     ] MHK: Loaded 42331 existing records from primary storage.
[2025-10-24T01:25:21.479771] [INFO ] [MAIN      ] MHK: Loaded 42331 primary data records.
[2025-10-24T01:25:21.557448] [DEBUG] [LOCAL     ] MHN: Loaded 7408 existing records from primary storage.
[2025-10-24T01:25:21.590749] [INFO ] [MAIN      ] MHN: Loaded 7408 primary data records.
[2025-10-24T01:25:21.630568] [DEBUG] [LOCAL     ] MHO: Loaded 23852 existing records from primary storage.
[2025-10-24T01:25:21.668736] [INFO ] [MAIN      ] MHO: Loaded 23852 primary data records.
[2025-10-24T01:25:22.405486] [DEBUG] [MAIN      ] MHK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:22.439401] [DEBUG] [MAIN      ] MHN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:22.482322] [DEBUG] [MAIN      ] MHO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:22.506815] [INFO ] [MAIN      ] MHK: Generated 139 derivative records from 42331 primary records.
[2025-10-24T01:25:22.507225] [DEBUG] [LOCAL     ] MHK: Saving derivative data.
[2025-10-24T01:25:22.527892] [DEBUG] [LOCAL     ] MHK: Derivative data saved (139 records).
[2025-10-24T01:25:22.530804] [INFO ] [MAIN      ] MHK: Successfully saved derivative data.
[2025-10-24T01:25:22.535923] [INFO ] [MAIN      ] Derivative Progress: 1240/2164 symbols completed. MHK took 1.1s. Estimated remaining: 6m 29s. Rate: 142.7 symbols/min
[2025-10-24T01:25:22.536147] [INFO ] [MAIN      ] MIN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:22.543746] [INFO ] [MAIN      ] MHN: Generated 139 derivative records from 7408 primary records.
[2025-10-24T01:25:22.544223] [DEBUG] [LOCAL     ] MHN: Saving derivative data.
[2025-10-24T01:25:22.564496] [DEBUG] [LOCAL     ] MHN: Derivative data saved (139 records).
[2025-10-24T01:25:22.573091] [DEBUG] [LOCAL     ] MIN: Loaded 13984 existing records from primary storage.
[2025-10-24T01:25:22.573312] [INFO ] [MAIN      ] MHO: Generated 139 derivative records from 23852 primary records.
[2025-10-24T01:25:22.573679] [INFO ] [MAIN      ] MIN: Loaded 13984 primary data records.
[2025-10-24T01:25:22.573362] [INFO ] [MAIN      ] MHN: Successfully saved derivative data.
[2025-10-24T01:25:22.573738] [DEBUG] [LOCAL     ] MHO: Saving derivative data.
[2025-10-24T01:25:22.575943] [INFO ] [MAIN      ] Derivative Progress: 1241/2164 symbols completed. MHN took 1.1s. Estimated remaining: 6m 28s. Rate: 142.8 symbols/min
[2025-10-24T01:25:22.576727] [INFO ] [MAIN      ] MIR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:22.633975] [DEBUG] [LOCAL     ] MHO: Derivative data saved (139 records).
[2025-10-24T01:25:22.679081] [INFO ] [MAIN      ] MHO: Successfully saved derivative data.
[2025-10-24T01:25:22.697263] [INFO ] [MAIN      ] Derivative Progress: 1242/2164 symbols completed. MHO took 1.2s. Estimated remaining: 6m 27s. Rate: 142.9 symbols/min
[2025-10-24T01:25:22.702266] [INFO ] [MAIN      ] MITP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:22.926969] [DEBUG] [LOCAL     ] MITP: Loaded 2207 existing records from primary storage.
[2025-10-24T01:25:22.927847] [INFO ] [MAIN      ] MITP: Loaded 2207 primary data records.
[2025-10-24T01:25:23.079257] [DEBUG] [LOCAL     ] MIR: Loaded 51787 existing records from primary storage.
[2025-10-24T01:25:23.107500] [INFO ] [MAIN      ] MIR: Loaded 51787 primary data records.
[2025-10-24T01:25:23.581198] [DEBUG] [MAIN      ] MIN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:23.617468] [DEBUG] [MAIN      ] MITP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:23.671337] [INFO ] [MAIN      ] MIN: Generated 139 derivative records from 13984 primary records.
[2025-10-24T01:25:23.669463] [DEBUG] [MAIN      ] MIR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:23.671606] [DEBUG] [LOCAL     ] MIN: Saving derivative data.
[2025-10-24T01:25:23.701345] [DEBUG] [LOCAL     ] MIN: Derivative data saved (139 records).
[2025-10-24T01:25:23.701488] [INFO ] [MAIN      ] MIN: Successfully saved derivative data.
[2025-10-24T01:25:23.704199] [INFO ] [MAIN      ] Derivative Progress: 1243/2164 symbols completed. MIN took 1.2s. Estimated remaining: 6m 27s. Rate: 142.7 symbols/min
[2025-10-24T01:25:23.714780] [INFO ] [MAIN      ] MITP: Generated 139 derivative records from 2207 primary records.
[2025-10-24T01:25:23.715048] [DEBUG] [LOCAL     ] MITP: Saving derivative data.
[2025-10-24T01:25:23.730042] [DEBUG] [LOCAL     ] MITP: Derivative data saved (139 records).
[2025-10-24T01:25:23.731118] [INFO ] [MAIN      ] MITP: Successfully saved derivative data.
[2025-10-24T01:25:23.733478] [INFO ] [MAIN      ] Derivative Progress: 1244/2164 symbols completed. MITP took 1.0s. Estimated remaining: 6m 27s. Rate: 142.8 symbols/min
[2025-10-24T01:25:23.738456] [INFO ] [MAIN      ] MIR: Generated 139 derivative records from 51787 primary records.
[2025-10-24T01:25:23.738547] [DEBUG] [LOCAL     ] MIR: Saving derivative data.
[2025-10-24T01:25:23.750321] [DEBUG] [LOCAL     ] MIR: Derivative data saved (139 records).
[2025-10-24T01:25:23.750400] [INFO ] [MAIN      ] MIR: Successfully saved derivative data.
[2025-10-24T01:25:23.753371] [INFO ] [MAIN      ] Derivative Progress: 1245/2164 symbols completed. MIR took 1.2s. Estimated remaining: 6m 26s. Rate: 142.9 symbols/min
[2025-10-24T01:25:23.753841] [INFO ] [MAIN      ] MITT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:23.754333] [INFO ] [MAIN      ] MKC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:23.754422] [INFO ] [MAIN      ] MIY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:23.771604] [DEBUG] [LOCAL     ] MIY: Loaded 6252 existing records from primary storage.
[2025-10-24T01:25:23.771944] [INFO ] [MAIN      ] MIY: Loaded 6252 primary data records.
[2025-10-24T01:25:23.909052] [DEBUG] [LOCAL     ] MITT: Loaded 22373 existing records from primary storage.
[2025-10-24T01:25:23.920129] [INFO ] [MAIN      ] MITT: Loaded 22373 primary data records.
[2025-10-24T01:25:24.081099] [DEBUG] [LOCAL     ] MKC: Loaded 52909 existing records from primary storage.
[2025-10-24T01:25:24.209136] [INFO ] [MAIN      ] MKC: Loaded 52909 primary data records.
[2025-10-24T01:25:24.732815] [DEBUG] [MAIN      ] MIY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:24.768503] [DEBUG] [MAIN      ] MITT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:24.859034] [DEBUG] [MAIN      ] MKC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:24.892184] [INFO ] [MAIN      ] MIY: Generated 139 derivative records from 6252 primary records.
[2025-10-24T01:25:24.893926] [DEBUG] [LOCAL     ] MIY: Saving derivative data.
[2025-10-24T01:25:24.914665] [DEBUG] [LOCAL     ] MIY: Derivative data saved (139 records).
[2025-10-24T01:25:24.916579] [INFO ] [MAIN      ] MITT: Generated 139 derivative records from 22373 primary records.
[2025-10-24T01:25:24.918627] [INFO ] [MAIN      ] MIY: Successfully saved derivative data.
[2025-10-24T01:25:24.918905] [DEBUG] [LOCAL     ] MITT: Saving derivative data.
[2025-10-24T01:25:24.921674] [INFO ] [MAIN      ] Derivative Progress: 1246/2164 symbols completed. MIY took 1.2s. Estimated remaining: 6m 26s. Rate: 142.7 symbols/min
[2025-10-24T01:25:24.921924] [INFO ] [MAIN      ] MKL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:24.938517] [DEBUG] [LOCAL     ] MITT: Derivative data saved (139 records).
[2025-10-24T01:25:24.938688] [INFO ] [MAIN      ] MITT: Successfully saved derivative data.
[2025-10-24T01:25:24.942468] [INFO ] [MAIN      ] Derivative Progress: 1247/2164 symbols completed. MITT took 1.2s. Estimated remaining: 6m 25s. Rate: 142.8 symbols/min
[2025-10-24T01:25:24.944908] [INFO ] [MAIN      ] MKC: Generated 139 derivative records from 52909 primary records.
[2025-10-24T01:25:24.945019] [DEBUG] [LOCAL     ] MKC: Saving derivative data.
[2025-10-24T01:25:24.942772] [INFO ] [MAIN      ] MLI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:24.958897] [DEBUG] [LOCAL     ] MKC: Derivative data saved (139 records).
[2025-10-24T01:25:24.959046] [INFO ] [MAIN      ] MKC: Successfully saved derivative data.
[2025-10-24T01:25:24.961947] [INFO ] [MAIN      ] Derivative Progress: 1248/2164 symbols completed. MKC took 1.2s. Estimated remaining: 6m 25s. Rate: 142.9 symbols/min
[2025-10-24T01:25:24.970135] [INFO ] [MAIN      ] MLM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:24.992225] [DEBUG] [LOCAL     ] MKL: Loaded 33977 existing records from primary storage.
[2025-10-24T01:25:25.000836] [INFO ] [MAIN      ] MKL: Loaded 33977 primary data records.
[2025-10-24T01:25:25.145400] [DEBUG] [LOCAL     ] MLM: Loaded 28771 existing records from primary storage.
[2025-10-24T01:25:25.144912] [DEBUG] [LOCAL     ] MLI: Loaded 43734 existing records from primary storage.
[2025-10-24T01:25:25.155839] [INFO ] [MAIN      ] MLM: Loaded 28771 primary data records.
[2025-10-24T01:25:25.161080] [INFO ] [MAIN      ] MLI: Loaded 43734 primary data records.
[2025-10-24T01:25:25.945592] [DEBUG] [MAIN      ] MKL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:26.010141] [DEBUG] [MAIN      ] MLI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:26.013551] [DEBUG] [MAIN      ] MLM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:26.066103] [INFO ] [MAIN      ] MKL: Generated 139 derivative records from 33977 primary records.
[2025-10-24T01:25:26.068933] [DEBUG] [LOCAL     ] MKL: Saving derivative data.
[2025-10-24T01:25:26.088246] [DEBUG] [LOCAL     ] MKL: Derivative data saved (139 records).
[2025-10-24T01:25:26.090022] [INFO ] [MAIN      ] MKL: Successfully saved derivative data.
[2025-10-24T01:25:26.094828] [INFO ] [MAIN      ] Derivative Progress: 1249/2164 symbols completed. MKL took 1.2s. Estimated remaining: 6m 25s. Rate: 142.7 symbols/min
[2025-10-24T01:25:26.096006] [INFO ] [MAIN      ] MLNK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:26.111443] [INFO ] [MAIN      ] MLM: Generated 139 derivative records from 28771 primary records.
[2025-10-24T01:25:26.113489] [INFO ] [MAIN      ] MLI: Generated 139 derivative records from 43734 primary records.
[2025-10-24T01:25:26.113780] [DEBUG] [LOCAL     ] MLI: Saving derivative data.
[2025-10-24T01:25:26.113590] [DEBUG] [LOCAL     ] MLM: Saving derivative data.
[2025-10-24T01:25:26.138298] [DEBUG] [LOCAL     ] MLI: Derivative data saved (139 records).
[2025-10-24T01:25:26.135630] [DEBUG] [LOCAL     ] MLM: Derivative data saved (139 records).
[2025-10-24T01:25:26.138594] [INFO ] [MAIN      ] MLI: Successfully saved derivative data.
[2025-10-24T01:25:26.138689] [INFO ] [MAIN      ] MLM: Successfully saved derivative data.
[2025-10-24T01:25:26.148036] [INFO ] [MAIN      ] Derivative Progress: 1250/2164 symbols completed. MLI took 1.2s. Estimated remaining: 6m 24s. Rate: 142.8 symbols/min
[2025-10-24T01:25:26.151155] [INFO ] [MAIN      ] MLP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:26.151319] [INFO ] [MAIN      ] Derivative Progress: 1251/2164 symbols completed. MLM took 1.2s. Estimated remaining: 6m 23s. Rate: 142.9 symbols/min
[2025-10-24T01:25:26.151720] [INFO ] [MAIN      ] MLR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:26.164431] [DEBUG] [LOCAL     ] MLNK: Loaded 27685 existing records from primary storage.
[2025-10-24T01:25:26.164619] [INFO ] [MAIN      ] MLNK: Loaded 27685 primary data records.
[2025-10-24T01:25:26.206843] [DEBUG] [LOCAL     ] MLP: Loaded 3014 existing records from primary storage.
[2025-10-24T01:25:26.243312] [INFO ] [MAIN      ] MLP: Loaded 3014 primary data records.
[2025-10-24T01:25:26.358158] [DEBUG] [LOCAL     ] MLR: Loaded 12181 existing records from primary storage.
[2025-10-24T01:25:26.402059] [INFO ] [MAIN      ] MLR: Loaded 12181 primary data records.
[2025-10-24T01:25:27.185871] [DEBUG] [MAIN      ] MLNK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:27.228170] [DEBUG] [MAIN      ] MLP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:27.264061] [DEBUG] [MAIN      ] MLR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:27.312356] [INFO ] [MAIN      ] MLNK: Generated 139 derivative records from 27685 primary records.
[2025-10-24T01:25:27.312815] [DEBUG] [LOCAL     ] MLNK: Saving derivative data.
[2025-10-24T01:25:27.326468] [DEBUG] [LOCAL     ] MLNK: Derivative data saved (139 records).
[2025-10-24T01:25:27.328870] [INFO ] [MAIN      ] MLNK: Successfully saved derivative data.
[2025-10-24T01:25:27.331227] [INFO ] [MAIN      ] Derivative Progress: 1252/2164 symbols completed. MLNK took 1.2s. Estimated remaining: 6m 23s. Rate: 142.7 symbols/min
[2025-10-24T01:25:27.334605] [INFO ] [MAIN      ] MMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:27.348042] [INFO ] [MAIN      ] MLP: Generated 139 derivative records from 3014 primary records.
[2025-10-24T01:25:27.348982] [DEBUG] [LOCAL     ] MLP: Saving derivative data.
[2025-10-24T01:25:27.352576] [INFO ] [MAIN      ] MLR: Generated 139 derivative records from 12181 primary records.
[2025-10-24T01:25:27.352864] [DEBUG] [LOCAL     ] MLR: Saving derivative data.
[2025-10-24T01:25:27.379319] [DEBUG] [LOCAL     ] MLP: Derivative data saved (139 records).
[2025-10-24T01:25:27.378705] [DEBUG] [LOCAL     ] MLR: Derivative data saved (139 records).
[2025-10-24T01:25:27.381070] [INFO ] [MAIN      ] MLR: Successfully saved derivative data.
[2025-10-24T01:25:27.384090] [INFO ] [MAIN      ] Derivative Progress: 1253/2164 symbols completed. MLR took 1.2s. Estimated remaining: 6m 23s. Rate: 142.8 symbols/min
[2025-10-24T01:25:27.380956] [INFO ] [MAIN      ] MLP: Successfully saved derivative data.
[2025-10-24T01:25:27.384464] [INFO ] [MAIN      ] MMD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:27.387180] [INFO ] [MAIN      ] Derivative Progress: 1254/2164 symbols completed. MLP took 1.2s. Estimated remaining: 6m 22s. Rate: 143.0 symbols/min
[2025-10-24T01:25:27.388000] [INFO ] [MAIN      ] MMI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:27.421491] [DEBUG] [LOCAL     ] MMD: Loaded 10792 existing records from primary storage.
[2025-10-24T01:25:27.421738] [INFO ] [MAIN      ] MMD: Loaded 10792 primary data records.
[2025-10-24T01:25:27.490833] [DEBUG] [LOCAL     ] MMI: Loaded 15494 existing records from primary storage.
[2025-10-24T01:25:27.518991] [INFO ] [MAIN      ] MMI: Loaded 15494 primary data records.
[2025-10-24T01:25:27.570799] [DEBUG] [LOCAL     ] MMC: Loaded 52316 existing records from primary storage.
[2025-10-24T01:25:27.607438] [INFO ] [MAIN      ] MMC: Loaded 52316 primary data records.
[2025-10-24T01:25:28.377395] [DEBUG] [MAIN      ] MMD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:28.432820] [DEBUG] [MAIN      ] MMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:28.436117] [INFO ] [MAIN      ] MMD: Generated 139 derivative records from 10792 primary records.
[2025-10-24T01:25:28.457717] [DEBUG] [LOCAL     ] MMD: Saving derivative data.
[2025-10-24T01:25:28.465328] [DEBUG] [MAIN      ] MMI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:28.493530] [DEBUG] [LOCAL     ] MMD: Derivative data saved (139 records).
[2025-10-24T01:25:28.496590] [INFO ] [MAIN      ] MMD: Successfully saved derivative data.
[2025-10-24T01:25:28.499976] [INFO ] [MAIN      ] Derivative Progress: 1255/2164 symbols completed. MMD took 1.1s. Estimated remaining: 6m 22s. Rate: 142.8 symbols/min
[2025-10-24T01:25:28.502291] [INFO ] [MAIN      ] MMM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:28.544164] [INFO ] [MAIN      ] MMI: Generated 139 derivative records from 15494 primary records.
[2025-10-24T01:25:28.544739] [INFO ] [MAIN      ] MMC: Generated 139 derivative records from 52316 primary records.
[2025-10-24T01:25:28.545300] [DEBUG] [LOCAL     ] MMI: Saving derivative data.
[2025-10-24T01:25:28.545452] [DEBUG] [LOCAL     ] MMC: Saving derivative data.
[2025-10-24T01:25:28.571592] [DEBUG] [LOCAL     ] MMI: Derivative data saved (139 records).
[2025-10-24T01:25:28.571827] [INFO ] [MAIN      ] MMI: Successfully saved derivative data.
[2025-10-24T01:25:28.586617] [INFO ] [MAIN      ] Derivative Progress: 1256/2164 symbols completed. MMI took 1.2s. Estimated remaining: 6m 21s. Rate: 142.9 symbols/min
[2025-10-24T01:25:28.587085] [INFO ] [MAIN      ] MMS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:28.591806] [DEBUG] [LOCAL     ] MMC: Derivative data saved (139 records).
[2025-10-24T01:25:28.606184] [INFO ] [MAIN      ] MMC: Successfully saved derivative data.
[2025-10-24T01:25:28.612028] [DEBUG] [LOCAL     ] MMM: Loaded 53501 existing records from primary storage.
[2025-10-24T01:25:28.612331] [INFO ] [MAIN      ] MMM: Loaded 53501 primary data records.
[2025-10-24T01:25:28.610512] [INFO ] [MAIN      ] Derivative Progress: 1257/2164 symbols completed. MMC took 1.3s. Estimated remaining: 6m 21s. Rate: 143.0 symbols/min
[2025-10-24T01:25:28.634110] [INFO ] [MAIN      ] MMT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:28.763743] [DEBUG] [LOCAL     ] MMT: Loaded 10170 existing records from primary storage.
[2025-10-24T01:25:28.822295] [INFO ] [MAIN      ] MMT: Loaded 10170 primary data records.
[2025-10-24T01:25:28.823596] [DEBUG] [LOCAL     ] MMS: Loaded 33605 existing records from primary storage.
[2025-10-24T01:25:28.941703] [INFO ] [MAIN      ] MMS: Loaded 33605 primary data records.
[2025-10-24T01:25:29.591979] [DEBUG] [MAIN      ] MMM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:29.642990] [DEBUG] [MAIN      ] MMS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:29.670061] [DEBUG] [MAIN      ] MMT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:29.692296] [INFO ] [MAIN      ] MMM: Generated 139 derivative records from 53501 primary records.
[2025-10-24T01:25:29.694603] [DEBUG] [LOCAL     ] MMM: Saving derivative data.
[2025-10-24T01:25:29.714165] [DEBUG] [LOCAL     ] MMM: Derivative data saved (139 records).
[2025-10-24T01:25:29.715552] [INFO ] [MAIN      ] MMM: Successfully saved derivative data.
[2025-10-24T01:25:29.721145] [INFO ] [MAIN      ] Derivative Progress: 1258/2164 symbols completed. MMM took 1.2s. Estimated remaining: 6m 21s. Rate: 142.8 symbols/min
[2025-10-24T01:25:29.745782] [INFO ] [MAIN      ] MMS: Generated 139 derivative records from 33605 primary records.
[2025-10-24T01:25:29.747295] [DEBUG] [LOCAL     ] MMS: Saving derivative data.
[2025-10-24T01:25:29.749496] [INFO ] [MAIN      ] MMT: Generated 139 derivative records from 10170 primary records.
[2025-10-24T01:25:29.750133] [DEBUG] [LOCAL     ] MMT: Saving derivative data.
[2025-10-24T01:25:29.761896] [DEBUG] [LOCAL     ] MMS: Derivative data saved (139 records).
[2025-10-24T01:25:29.762303] [INFO ] [MAIN      ] MMS: Successfully saved derivative data.
[2025-10-24T01:25:29.765216] [INFO ] [MAIN      ] Derivative Progress: 1259/2164 symbols completed. MMS took 1.2s. Estimated remaining: 6m 20s. Rate: 142.9 symbols/min
[2025-10-24T01:25:29.775568] [DEBUG] [LOCAL     ] MMT: Derivative data saved (139 records).
[2025-10-24T01:25:29.775686] [INFO ] [MAIN      ] MMT: Successfully saved derivative data.
[2025-10-24T01:25:29.778468] [INFO ] [MAIN      ] Derivative Progress: 1260/2164 symbols completed. MMT took 1.1s. Estimated remaining: 6m 19s. Rate: 143.0 symbols/min
[2025-10-24T01:25:29.778905] [INFO ] [MAIN      ] MMU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:29.778950] [INFO ] [MAIN      ] MNR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:29.779000] [INFO ] [MAIN      ] MNSO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:29.798348] [DEBUG] [LOCAL     ] MMU: Loaded 16875 existing records from primary storage.
[2025-10-24T01:25:29.798555] [INFO ] [MAIN      ] MMU: Loaded 16875 primary data records.
[2025-10-24T01:25:29.954384] [DEBUG] [LOCAL     ] MNR: Loaded 25198 existing records from primary storage.
[2025-10-24T01:25:29.978477] [INFO ] [MAIN      ] MNR: Loaded 25198 primary data records.
[2025-10-24T01:25:30.218858] [DEBUG] [LOCAL     ] MNSO: Loaded 44260 existing records from primary storage.
[2025-10-24T01:25:30.248906] [INFO ] [MAIN      ] MNSO: Loaded 44260 primary data records.
[2025-10-24T01:25:30.764063] [DEBUG] [MAIN      ] MMU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:30.808032] [DEBUG] [MAIN      ] MNR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:30.855760] [DEBUG] [MAIN      ] MNSO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:30.878482] [INFO ] [MAIN      ] MMU: Generated 139 derivative records from 16875 primary records.
[2025-10-24T01:25:30.882930] [DEBUG] [LOCAL     ] MMU: Saving derivative data.
[2025-10-24T01:25:30.900790] [DEBUG] [LOCAL     ] MMU: Derivative data saved (139 records).
[2025-10-24T01:25:30.903819] [INFO ] [MAIN      ] MMU: Successfully saved derivative data.
[2025-10-24T01:25:30.906134] [INFO ] [MAIN      ] Derivative Progress: 1261/2164 symbols completed. MMU took 1.1s. Estimated remaining: 6m 19s. Rate: 142.8 symbols/min
[2025-10-24T01:25:30.908910] [INFO ] [MAIN      ] MOD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:30.912393] [INFO ] [MAIN      ] MNR: Generated 139 derivative records from 25198 primary records.
[2025-10-24T01:25:30.915786] [DEBUG] [LOCAL     ] MNR: Saving derivative data.
[2025-10-24T01:25:30.932986] [DEBUG] [LOCAL     ] MNR: Derivative data saved (139 records).
[2025-10-24T01:25:30.934686] [INFO ] [MAIN      ] MNR: Successfully saved derivative data.
[2025-10-24T01:25:30.939307] [INFO ] [MAIN      ] Derivative Progress: 1262/2164 symbols completed. MNR took 1.2s. Estimated remaining: 6m 19s. Rate: 142.9 symbols/min
[2025-10-24T01:25:30.939969] [INFO ] [MAIN      ] MODG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:30.943468] [INFO ] [MAIN      ] MNSO: Generated 139 derivative records from 44260 primary records.
[2025-10-24T01:25:30.943807] [DEBUG] [LOCAL     ] MNSO: Saving derivative data.
[2025-10-24T01:25:30.957400] [DEBUG] [LOCAL     ] MNSO: Derivative data saved (139 records).
[2025-10-24T01:25:30.957675] [INFO ] [MAIN      ] MNSO: Successfully saved derivative data.
[2025-10-24T01:25:30.970320] [INFO ] [MAIN      ] Derivative Progress: 1263/2164 symbols completed. MNSO took 1.2s. Estimated remaining: 6m 18s. Rate: 143.0 symbols/min
[2025-10-24T01:25:30.970817] [INFO ] [MAIN      ] MOH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:30.991396] [DEBUG] [LOCAL     ] MOD: Loaded 44795 existing records from primary storage.
[2025-10-24T01:25:31.004759] [INFO ] [MAIN      ] MOD: Loaded 44795 primary data records.
[2025-10-24T01:25:31.133718] [DEBUG] [LOCAL     ] MODG: Loaded 51898 existing records from primary storage.
[2025-10-24T01:25:31.134011] [INFO ] [MAIN      ] MODG: Loaded 51898 primary data records.
[2025-10-24T01:25:31.319697] [DEBUG] [LOCAL     ] MOH: Loaded 43431 existing records from primary storage.
[2025-10-24T01:25:31.478127] [INFO ] [MAIN      ] MOH: Loaded 43431 primary data records.
[2025-10-24T01:25:32.028696] [DEBUG] [MAIN      ] MOD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:32.066800] [DEBUG] [MAIN      ] MODG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:32.129081] [DEBUG] [MAIN      ] MOH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:32.143372] [INFO ] [MAIN      ] MOD: Generated 139 derivative records from 44795 primary records.
[2025-10-24T01:25:32.149604] [DEBUG] [LOCAL     ] MOD: Saving derivative data.
[2025-10-24T01:25:32.172384] [DEBUG] [LOCAL     ] MOD: Derivative data saved (139 records).
[2025-10-24T01:25:32.175452] [INFO ] [MAIN      ] MOD: Successfully saved derivative data.
[2025-10-24T01:25:32.177836] [INFO ] [MAIN      ] Derivative Progress: 1264/2164 symbols completed. MOD took 1.3s. Estimated remaining: 6m 18s. Rate: 142.8 symbols/min
[2025-10-24T01:25:32.178686] [INFO ] [MAIN      ] MOS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:32.184803] [INFO ] [MAIN      ] MODG: Generated 139 derivative records from 51898 primary records.
[2025-10-24T01:25:32.186449] [DEBUG] [LOCAL     ] MODG: Saving derivative data.
[2025-10-24T01:25:32.203724] [DEBUG] [LOCAL     ] MODG: Derivative data saved (139 records).
[2025-10-24T01:25:32.203936] [INFO ] [MAIN      ] MODG: Successfully saved derivative data.
[2025-10-24T01:25:32.206523] [INFO ] [MAIN      ] Derivative Progress: 1265/2164 symbols completed. MODG took 1.3s. Estimated remaining: 6m 17s. Rate: 142.9 symbols/min
[2025-10-24T01:25:32.210090] [INFO ] [MAIN      ] MOV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:32.214887] [INFO ] [MAIN      ] MOH: Generated 139 derivative records from 43431 primary records.
[2025-10-24T01:25:32.215219] [DEBUG] [LOCAL     ] MOH: Saving derivative data.
[2025-10-24T01:25:32.230356] [DEBUG] [LOCAL     ] MOH: Derivative data saved (139 records).
[2025-10-24T01:25:32.236012] [INFO ] [MAIN      ] MOH: Successfully saved derivative data.
[2025-10-24T01:25:32.239114] [INFO ] [MAIN      ] Derivative Progress: 1266/2164 symbols completed. MOH took 1.3s. Estimated remaining: 6m 17s. Rate: 143.0 symbols/min
[2025-10-24T01:25:32.239574] [INFO ] [MAIN      ] MP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:32.261844] [DEBUG] [LOCAL     ] MOV: Loaded 21238 existing records from primary storage.
[2025-10-24T01:25:32.262225] [INFO ] [MAIN      ] MOV: Loaded 21238 primary data records.
[2025-10-24T01:25:32.394072] [DEBUG] [LOCAL     ] MOS: Loaded 53900 existing records from primary storage.
[2025-10-24T01:25:32.422795] [INFO ] [MAIN      ] MOS: Loaded 53900 primary data records.
[2025-10-24T01:25:32.928727] [DEBUG] [LOCAL     ] MP: Loaded 54134 existing records from primary storage.
[2025-10-24T01:25:32.929159] [INFO ] [MAIN      ] MP: Loaded 54134 primary data records.
[2025-10-24T01:25:33.307883] [DEBUG] [MAIN      ] MOV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:33.340332] [DEBUG] [MAIN      ] MOS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:33.404581] [DEBUG] [MAIN      ] MP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:33.427739] [INFO ] [MAIN      ] MOV: Generated 139 derivative records from 21238 primary records.
[2025-10-24T01:25:33.432059] [DEBUG] [LOCAL     ] MOV: Saving derivative data.
[2025-10-24T01:25:33.433978] [INFO ] [MAIN      ] MOS: Generated 139 derivative records from 53900 primary records.
[2025-10-24T01:25:33.434507] [DEBUG] [LOCAL     ] MOS: Saving derivative data.
[2025-10-24T01:25:33.463478] [DEBUG] [LOCAL     ] MOS: Derivative data saved (139 records).
[2025-10-24T01:25:33.460661] [DEBUG] [LOCAL     ] MOV: Derivative data saved (139 records).
[2025-10-24T01:25:33.463721] [INFO ] [MAIN      ] MOS: Successfully saved derivative data.
[2025-10-24T01:25:33.467292] [INFO ] [MAIN      ] Derivative Progress: 1267/2164 symbols completed. MOS took 1.3s. Estimated remaining: 6m 17s. Rate: 142.8 symbols/min
[2025-10-24T01:25:33.464044] [INFO ] [MAIN      ] MOV: Successfully saved derivative data.
[2025-10-24T01:25:33.469143] [INFO ] [MAIN      ] MPA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:33.472388] [INFO ] [MAIN      ] Derivative Progress: 1268/2164 symbols completed. MOV took 1.3s. Estimated remaining: 6m 16s. Rate: 142.9 symbols/min
[2025-10-24T01:25:33.472761] [INFO ] [MAIN      ] MPC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:33.487001] [DEBUG] [LOCAL     ] MPA: Loaded 5223 existing records from primary storage.
[2025-10-24T01:25:33.487624] [INFO ] [MAIN      ] MPA: Loaded 5223 primary data records.
[2025-10-24T01:25:33.524125] [INFO ] [MAIN      ] MP: Generated 139 derivative records from 54134 primary records.
[2025-10-24T01:25:33.549077] [DEBUG] [LOCAL     ] MP: Saving derivative data.
[2025-10-24T01:25:33.609685] [DEBUG] [LOCAL     ] MP: Derivative data saved (139 records).
[2025-10-24T01:25:33.637119] [INFO ] [MAIN      ] MP: Successfully saved derivative data.
[2025-10-24T01:25:33.665234] [INFO ] [MAIN      ] Derivative Progress: 1269/2164 symbols completed. MP took 1.4s. Estimated remaining: 6m 16s. Rate: 143.0 symbols/min
[2025-10-24T01:25:33.707793] [INFO ] [MAIN      ] MPLX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:33.841474] [DEBUG] [LOCAL     ] MPC: Loaded 52270 existing records from primary storage.
[2025-10-24T01:25:33.841717] [INFO ] [MAIN      ] MPC: Loaded 52270 primary data records.
[2025-10-24T01:25:34.175691] [DEBUG] [LOCAL     ] MPLX: Loaded 51157 existing records from primary storage.
[2025-10-24T01:25:34.177601] [INFO ] [MAIN      ] MPLX: Loaded 51157 primary data records.
[2025-10-24T01:25:34.235793] [DEBUG] [MAIN      ] MPA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:34.540080] [DEBUG] [MAIN      ] MPC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:34.569102] [INFO ] [MAIN      ] MPA: Generated 139 derivative records from 5223 primary records.
[2025-10-24T01:25:34.571752] [DEBUG] [LOCAL     ] MPA: Saving derivative data.
[2025-10-24T01:25:34.585566] [DEBUG] [LOCAL     ] MPA: Derivative data saved (139 records).
[2025-10-24T01:25:34.586704] [INFO ] [MAIN      ] MPA: Successfully saved derivative data.
[2025-10-24T01:25:34.601343] [INFO ] [MAIN      ] Derivative Progress: 1270/2164 symbols completed. MPA took 1.1s. Estimated remaining: 6m 16s. Rate: 142.8 symbols/min
[2025-10-24T01:25:34.602131] [INFO ] [MAIN      ] MPV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:34.601997] [DEBUG] [MAIN      ] MPLX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:34.630382] [DEBUG] [LOCAL     ] MPV: Loaded 4393 existing records from primary storage.
[2025-10-24T01:25:34.634005] [INFO ] [MAIN      ] MPV: Loaded 4393 primary data records.
[2025-10-24T01:25:34.725441] [INFO ] [MAIN      ] MPC: Generated 139 derivative records from 52270 primary records.
[2025-10-24T01:25:34.749144] [DEBUG] [LOCAL     ] MPC: Saving derivative data.
[2025-10-24T01:25:34.943596] [DEBUG] [LOCAL     ] MPC: Derivative data saved (139 records).
[2025-10-24T01:25:34.958333] [INFO ] [MAIN      ] MPC: Successfully saved derivative data.
[2025-10-24T01:25:34.962228] [INFO ] [MAIN      ] Derivative Progress: 1271/2164 symbols completed. MPC took 1.5s. Estimated remaining: 6m 15s. Rate: 142.8 symbols/min
[2025-10-24T01:25:34.962567] [INFO ] [MAIN      ] MPW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:34.972093] [INFO ] [MAIN      ] MPLX: Generated 139 derivative records from 51157 primary records.
[2025-10-24T01:25:34.972424] [DEBUG] [LOCAL     ] MPLX: Saving derivative data.
[2025-10-24T01:25:34.986834] [DEBUG] [LOCAL     ] MPLX: Derivative data saved (139 records).
[2025-10-24T01:25:34.987709] [INFO ] [MAIN      ] MPLX: Successfully saved derivative data.
[2025-10-24T01:25:34.990253] [INFO ] [MAIN      ] Derivative Progress: 1272/2164 symbols completed. MPLX took 1.3s. Estimated remaining: 6m 14s. Rate: 142.9 symbols/min
[2025-10-24T01:25:34.990834] [INFO ] [MAIN      ] MPX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:35.008587] [DEBUG] [LOCAL     ] MPX: Loaded 3981 existing records from primary storage.
[2025-10-24T01:25:35.014078] [INFO ] [MAIN      ] MPX: Loaded 3981 primary data records.
[2025-10-24T01:25:35.013972] [DEBUG] [MAIN      ] MPV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:35.249002] [DEBUG] [LOCAL     ] MPW: Loaded 53872 existing records from primary storage.
[2025-10-24T01:25:35.406552] [INFO ] [MAIN      ] MPW: Loaded 53872 primary data records.
[2025-10-24T01:25:35.568983] [INFO ] [MAIN      ] MPV: Generated 139 derivative records from 4393 primary records.
[2025-10-24T01:25:35.619192] [DEBUG] [LOCAL     ] MPV: Saving derivative data.
[2025-10-24T01:25:35.763148] [DEBUG] [LOCAL     ] MPV: Derivative data saved (139 records).
[2025-10-24T01:25:35.763860] [INFO ] [MAIN      ] MPV: Successfully saved derivative data.
[2025-10-24T01:25:35.767674] [INFO ] [MAIN      ] Derivative Progress: 1273/2164 symbols completed. MPV took 1.2s. Estimated remaining: 6m 14s. Rate: 142.8 symbols/min
[2025-10-24T01:25:35.788780] [DEBUG] [MAIN      ] MPX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:35.836423] [DEBUG] [MAIN      ] MPW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:35.866130] [INFO ] [MAIN      ] MPX: Generated 139 derivative records from 3981 primary records.
[2025-10-24T01:25:35.870389] [DEBUG] [LOCAL     ] MPX: Saving derivative data.
[2025-10-24T01:25:35.887238] [DEBUG] [LOCAL     ] MPX: Derivative data saved (139 records).
[2025-10-24T01:25:35.891440] [INFO ] [MAIN      ] MPX: Successfully saved derivative data.
[2025-10-24T01:25:35.895848] [INFO ] [MAIN      ] Derivative Progress: 1274/2164 symbols completed. MPX took 0.9s. Estimated remaining: 6m 14s. Rate: 142.9 symbols/min
[2025-10-24T01:25:35.899189] [INFO ] [MAIN      ] MPW: Generated 139 derivative records from 53872 primary records.
[2025-10-24T01:25:35.899409] [DEBUG] [LOCAL     ] MPW: Saving derivative data.
[2025-10-24T01:25:35.911803] [DEBUG] [LOCAL     ] MPW: Derivative data saved (139 records).
[2025-10-24T01:25:35.911918] [INFO ] [MAIN      ] MPW: Successfully saved derivative data.
[2025-10-24T01:25:35.915010] [INFO ] [MAIN      ] Derivative Progress: 1275/2164 symbols completed. MPW took 1.0s. Estimated remaining: 6m 13s. Rate: 143.0 symbols/min
[2025-10-24T01:25:35.915891] [INFO ] [MAIN      ] MQT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:35.916080] [INFO ] [MAIN      ] MRC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:35.917003] [INFO ] [MAIN      ] MQY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:35.931167] [DEBUG] [LOCAL     ] MQT: Loaded 8068 existing records from primary storage.
[2025-10-24T01:25:35.932116] [INFO ] [MAIN      ] MQT: Loaded 8068 primary data records.
[2025-10-24T01:25:36.067089] [DEBUG] [LOCAL     ] MQY: Loaded 16740 existing records from primary storage.
[2025-10-24T01:25:36.094071] [INFO ] [MAIN      ] MQY: Loaded 16740 primary data records.
[2025-10-24T01:25:36.353546] [DEBUG] [LOCAL     ] MRC: Loaded 37336 existing records from primary storage.
[2025-10-24T01:25:36.388085] [INFO ] [MAIN      ] MRC: Loaded 37336 primary data records.
[2025-10-24T01:25:36.944934] [DEBUG] [MAIN      ] MQT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:36.986410] [DEBUG] [MAIN      ] MQY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:37.045976] [DEBUG] [MAIN      ] MRC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:37.073708] [INFO ] [MAIN      ] MQT: Generated 139 derivative records from 8068 primary records.
[2025-10-24T01:25:37.074812] [DEBUG] [LOCAL     ] MQT: Saving derivative data.
[2025-10-24T01:25:37.092101] [DEBUG] [LOCAL     ] MQT: Derivative data saved (139 records).
[2025-10-24T01:25:37.089629] [INFO ] [MAIN      ] MQY: Generated 139 derivative records from 16740 primary records.
[2025-10-24T01:25:37.092756] [INFO ] [MAIN      ] MQT: Successfully saved derivative data.
[2025-10-24T01:25:37.095392] [INFO ] [MAIN      ] Derivative Progress: 1276/2164 symbols completed. MQT took 1.2s. Estimated remaining: 6m 13s. Rate: 142.8 symbols/min
[2025-10-24T01:25:37.095558] [DEBUG] [LOCAL     ] MQY: Saving derivative data.
[2025-10-24T01:25:37.097987] [INFO ] [MAIN      ] MRK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:37.111894] [DEBUG] [LOCAL     ] MQY: Derivative data saved (139 records).
[2025-10-24T01:25:37.115209] [INFO ] [MAIN      ] MQY: Successfully saved derivative data.
[2025-10-24T01:25:37.118948] [INFO ] [MAIN      ] Derivative Progress: 1277/2164 symbols completed. MQY took 1.2s. Estimated remaining: 6m 12s. Rate: 142.9 symbols/min
[2025-10-24T01:25:37.122330] [INFO ] [MAIN      ] MS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:37.129515] [INFO ] [MAIN      ] MRC: Generated 139 derivative records from 37336 primary records.
[2025-10-24T01:25:37.129938] [DEBUG] [LOCAL     ] MRC: Saving derivative data.
[2025-10-24T01:25:37.143672] [DEBUG] [LOCAL     ] MRC: Derivative data saved (139 records).
[2025-10-24T01:25:37.143869] [INFO ] [MAIN      ] MRC: Successfully saved derivative data.
[2025-10-24T01:25:37.147157] [INFO ] [MAIN      ] Derivative Progress: 1278/2164 symbols completed. MRC took 1.2s. Estimated remaining: 6m 12s. Rate: 143.0 symbols/min
[2025-10-24T01:25:37.147708] [INFO ] [MAIN      ] MSA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:37.203170] [DEBUG] [LOCAL     ] MRK: Loaded 54180 existing records from primary storage.
[2025-10-24T01:25:37.203539] [INFO ] [MAIN      ] MRK: Loaded 54180 primary data records.
[2025-10-24T01:25:37.302986] [DEBUG] [LOCAL     ] MSA: Loaded 18945 existing records from primary storage.
[2025-10-24T01:25:37.321977] [DEBUG] [LOCAL     ] MS: Loaded 54077 existing records from primary storage.
[2025-10-24T01:25:37.340241] [INFO ] [MAIN      ] MSA: Loaded 18945 primary data records.
[2025-10-24T01:25:37.340524] [INFO ] [MAIN      ] MS: Loaded 54077 primary data records.
[2025-10-24T01:25:38.274306] [DEBUG] [MAIN      ] MRK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:38.311111] [DEBUG] [MAIN      ] MS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:38.357611] [DEBUG] [MAIN      ] MSA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:38.389603] [INFO ] [MAIN      ] MRK: Generated 139 derivative records from 54180 primary records.
[2025-10-24T01:25:38.393101] [DEBUG] [LOCAL     ] MRK: Saving derivative data.
[2025-10-24T01:25:38.411683] [DEBUG] [LOCAL     ] MRK: Derivative data saved (139 records).
[2025-10-24T01:25:38.417873] [INFO ] [MAIN      ] MRK: Successfully saved derivative data.
[2025-10-24T01:25:38.420857] [INFO ] [MAIN      ] Derivative Progress: 1279/2164 symbols completed. MRK took 1.3s. Estimated remaining: 6m 12s. Rate: 142.8 symbols/min
[2025-10-24T01:25:38.426158] [INFO ] [MAIN      ] MSB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:38.426682] [INFO ] [MAIN      ] MS: Generated 139 derivative records from 54077 primary records.
[2025-10-24T01:25:38.427062] [DEBUG] [LOCAL     ] MS: Saving derivative data.
[2025-10-24T01:25:38.443061] [DEBUG] [LOCAL     ] MS: Derivative data saved (139 records).
[2025-10-24T01:25:38.446879] [INFO ] [MAIN      ] MS: Successfully saved derivative data.
[2025-10-24T01:25:38.449977] [INFO ] [MAIN      ] Derivative Progress: 1280/2164 symbols completed. MS took 1.3s. Estimated remaining: 6m 11s. Rate: 142.9 symbols/min
[2025-10-24T01:25:38.450537] [INFO ] [MAIN      ] MSCI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:38.453398] [INFO ] [MAIN      ] MSA: Generated 139 derivative records from 18945 primary records.
[2025-10-24T01:25:38.457912] [DEBUG] [LOCAL     ] MSB: Loaded 8024 existing records from primary storage.
[2025-10-24T01:25:38.458239] [INFO ] [MAIN      ] MSB: Loaded 8024 primary data records.
[2025-10-24T01:25:38.458034] [DEBUG] [LOCAL     ] MSA: Saving derivative data.
[2025-10-24T01:25:38.504051] [DEBUG] [LOCAL     ] MSA: Derivative data saved (139 records).
[2025-10-24T01:25:38.528719] [INFO ] [MAIN      ] MSA: Successfully saved derivative data.
[2025-10-24T01:25:38.574394] [INFO ] [MAIN      ] Derivative Progress: 1281/2164 symbols completed. MSA took 1.4s. Estimated remaining: 6m 11s. Rate: 143.0 symbols/min
[2025-10-24T01:25:38.594318] [INFO ] [MAIN      ] MSD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:38.805320] [DEBUG] [LOCAL     ] MSCI: Loaded 34366 existing records from primary storage.
[2025-10-24T01:25:38.806770] [INFO ] [MAIN      ] MSCI: Loaded 34366 primary data records.
[2025-10-24T01:25:38.910773] [DEBUG] [LOCAL     ] MSD: Loaded 16719 existing records from primary storage.
[2025-10-24T01:25:38.942481] [INFO ] [MAIN      ] MSD: Loaded 16719 primary data records.
[2025-10-24T01:25:39.546767] [DEBUG] [MAIN      ] MSB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:39.610269] [DEBUG] [MAIN      ] MSCI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:39.643227] [DEBUG] [MAIN      ] MSD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:39.659286] [INFO ] [MAIN      ] MSB: Generated 139 derivative records from 8024 primary records.
[2025-10-24T01:25:39.666772] [DEBUG] [LOCAL     ] MSB: Saving derivative data.
[2025-10-24T01:25:39.685928] [DEBUG] [LOCAL     ] MSB: Derivative data saved (139 records).
[2025-10-24T01:25:39.690475] [INFO ] [MAIN      ] MSB: Successfully saved derivative data.
[2025-10-24T01:25:39.694185] [INFO ] [MAIN      ] Derivative Progress: 1282/2164 symbols completed. MSB took 1.3s. Estimated remaining: 6m 11s. Rate: 142.8 symbols/min
[2025-10-24T01:25:39.697105] [INFO ] [MAIN      ] MSDL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:39.718797] [INFO ] [MAIN      ] MSCI: Generated 139 derivative records from 34366 primary records.
[2025-10-24T01:25:39.719344] [DEBUG] [LOCAL     ] MSCI: Saving derivative data.
[2025-10-24T01:25:39.723855] [INFO ] [MAIN      ] MSD: Generated 139 derivative records from 16719 primary records.
[2025-10-24T01:25:39.735598] [DEBUG] [LOCAL     ] MSD: Saving derivative data.
[2025-10-24T01:25:39.735694] [DEBUG] [LOCAL     ] MSCI: Derivative data saved (139 records).
[2025-10-24T01:25:39.745664] [INFO ] [MAIN      ] MSCI: Successfully saved derivative data.
[2025-10-24T01:25:39.749017] [INFO ] [MAIN      ] Derivative Progress: 1283/2164 symbols completed. MSCI took 1.3s. Estimated remaining: 6m 10s. Rate: 142.9 symbols/min
[2025-10-24T01:25:39.757751] [INFO ] [MAIN      ] MSGE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:39.761955] [DEBUG] [LOCAL     ] MSD: Derivative data saved (139 records).
[2025-10-24T01:25:39.763565] [INFO ] [MAIN      ] MSD: Successfully saved derivative data.
[2025-10-24T01:25:39.767181] [INFO ] [MAIN      ] Derivative Progress: 1284/2164 symbols completed. MSD took 1.2s. Estimated remaining: 6m 9s. Rate: 143.0 symbols/min
[2025-10-24T01:25:39.767502] [INFO ] [MAIN      ] MSGS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:39.782517] [DEBUG] [LOCAL     ] MSDL: Loaded 38893 existing records from primary storage.
[2025-10-24T01:25:39.782754] [INFO ] [MAIN      ] MSDL: Loaded 38893 primary data records.
[2025-10-24T01:25:39.924146] [DEBUG] [LOCAL     ] MSGS: Loaded 17313 existing records from primary storage.
[2025-10-24T01:25:39.930713] [INFO ] [MAIN      ] MSGS: Loaded 17313 primary data records.
[2025-10-24T01:25:39.967026] [DEBUG] [LOCAL     ] MSGE: Loaded 27255 existing records from primary storage.
[2025-10-24T01:25:40.016372] [INFO ] [MAIN      ] MSGE: Loaded 27255 primary data records.
[2025-10-24T01:25:40.748330] [DEBUG] [MAIN      ] MSDL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:40.798239] [DEBUG] [MAIN      ] MSGE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:40.797790] [DEBUG] [MAIN      ] MSGS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:40.874257] [INFO ] [MAIN      ] MSGS: Generated 139 derivative records from 17313 primary records.
[2025-10-24T01:25:40.872468] [INFO ] [MAIN      ] MSDL: Generated 139 derivative records from 38893 primary records.
[2025-10-24T01:25:40.876217] [DEBUG] [LOCAL     ] MSGS: Saving derivative data.
[2025-10-24T01:25:40.876618] [DEBUG] [LOCAL     ] MSDL: Saving derivative data.
[2025-10-24T01:25:40.876539] [INFO ] [MAIN      ] MSGE: Generated 139 derivative records from 27255 primary records.
[2025-10-24T01:25:40.884844] [DEBUG] [LOCAL     ] MSGE: Saving derivative data.
[2025-10-24T01:25:40.889341] [DEBUG] [LOCAL     ] MSGS: Derivative data saved (139 records).
[2025-10-24T01:25:40.896783] [INFO ] [MAIN      ] MSGS: Successfully saved derivative data.
[2025-10-24T01:25:40.900886] [INFO ] [MAIN      ] Derivative Progress: 1285/2164 symbols completed. MSGS took 1.1s. Estimated remaining: 6m 9s. Rate: 142.8 symbols/min
[2025-10-24T01:25:40.915097] [DEBUG] [LOCAL     ] MSGE: Derivative data saved (139 records).
[2025-10-24T01:25:40.915208] [DEBUG] [LOCAL     ] MSDL: Derivative data saved (139 records).
[2025-10-24T01:25:40.901080] [INFO ] [MAIN      ] MSI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:40.915795] [INFO ] [MAIN      ] MSGE: Successfully saved derivative data.
[2025-10-24T01:25:40.918869] [INFO ] [MAIN      ] Derivative Progress: 1286/2164 symbols completed. MSGE took 1.2s. Estimated remaining: 6m 9s. Rate: 142.9 symbols/min
[2025-10-24T01:25:40.915551] [INFO ] [MAIN      ] MSDL: Successfully saved derivative data.
[2025-10-24T01:25:40.919018] [INFO ] [MAIN      ] MSM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:40.921497] [INFO ] [MAIN      ] Derivative Progress: 1287/2164 symbols completed. MSDL took 1.2s. Estimated remaining: 6m 8s. Rate: 143.0 symbols/min
[2025-10-24T01:25:40.922158] [INFO ] [MAIN      ] MT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:40.982792] [DEBUG] [LOCAL     ] MSM: Loaded 35752 existing records from primary storage.
[2025-10-24T01:25:40.993532] [INFO ] [MAIN      ] MSM: Loaded 35752 primary data records.
[2025-10-24T01:25:41.006989] [DEBUG] [LOCAL     ] MSI: Loaded 39876 existing records from primary storage.
[2025-10-24T01:25:41.084120] [DEBUG] [LOCAL     ] MT: Loaded 50743 existing records from primary storage.
[2025-10-24T01:25:41.063558] [INFO ] [MAIN      ] MSI: Loaded 39876 primary data records.
[2025-10-24T01:25:41.089393] [INFO ] [MAIN      ] MT: Loaded 50743 primary data records.
[2025-10-24T01:25:41.960879] [DEBUG] [MAIN      ] MSM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:42.004561] [DEBUG] [MAIN      ] MSI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:42.018670] [DEBUG] [MAIN      ] MT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:42.071876] [INFO ] [MAIN      ] MSM: Generated 139 derivative records from 35752 primary records.
[2025-10-24T01:25:42.077271] [DEBUG] [LOCAL     ] MSM: Saving derivative data.
[2025-10-24T01:25:42.091991] [INFO ] [MAIN      ] MSI: Generated 139 derivative records from 39876 primary records.
[2025-10-24T01:25:42.096660] [DEBUG] [LOCAL     ] MSM: Derivative data saved (139 records).
[2025-10-24T01:25:42.096895] [INFO ] [MAIN      ] MSM: Successfully saved derivative data.
[2025-10-24T01:25:42.098890] [INFO ] [MAIN      ] Derivative Progress: 1288/2164 symbols completed. MSM took 1.2s. Estimated remaining: 6m 8s. Rate: 142.8 symbols/min
[2025-10-24T01:25:42.096831] [DEBUG] [LOCAL     ] MSI: Saving derivative data.
[2025-10-24T01:25:42.112573] [INFO ] [MAIN      ] MT: Generated 139 derivative records from 50743 primary records.
[2025-10-24T01:25:42.114233] [DEBUG] [LOCAL     ] MSI: Derivative data saved (139 records).
[2025-10-24T01:25:42.114324] [INFO ] [MAIN      ] MSI: Successfully saved derivative data.
[2025-10-24T01:25:42.113036] [DEBUG] [LOCAL     ] MT: Saving derivative data.
[2025-10-24T01:25:42.117197] [INFO ] [MAIN      ] Derivative Progress: 1289/2164 symbols completed. MSI took 1.2s. Estimated remaining: 6m 7s. Rate: 142.9 symbols/min
[2025-10-24T01:25:42.128906] [DEBUG] [LOCAL     ] MT: Derivative data saved (139 records).
[2025-10-24T01:25:42.129004] [INFO ] [MAIN      ] MT: Successfully saved derivative data.
[2025-10-24T01:25:42.132042] [INFO ] [MAIN      ] Derivative Progress: 1290/2164 symbols completed. MT took 1.2s. Estimated remaining: 6m 7s. Rate: 143.0 symbols/min
[2025-10-24T01:25:42.132519] [INFO ] [MAIN      ] MTDR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:42.132595] [INFO ] [MAIN      ] MTD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:42.132445] [INFO ] [MAIN      ] MTB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:42.153766] [DEBUG] [LOCAL     ] MTD: Loaded 15251 existing records from primary storage.
[2025-10-24T01:25:42.153916] [INFO ] [MAIN      ] MTD: Loaded 15251 primary data records.
[2025-10-24T01:25:42.481602] [DEBUG] [LOCAL     ] MTB: Loaded 46978 existing records from primary storage.
[2025-10-24T01:25:42.496271] [INFO ] [MAIN      ] MTB: Loaded 46978 primary data records.
[2025-10-24T01:25:42.528861] [DEBUG] [LOCAL     ] MTDR: Loaded 52152 existing records from primary storage.
[2025-10-24T01:25:42.534559] [INFO ] [MAIN      ] MTDR: Loaded 52152 primary data records.
[2025-10-24T01:25:43.106775] [DEBUG] [MAIN      ] MTD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:43.154737] [DEBUG] [MAIN      ] MTB: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:25:43.182395] [DEBUG] [MAIN      ] MTDR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:43.206071] [INFO ] [MAIN      ] MTD: Generated 139 derivative records from 15251 primary records.
[2025-10-24T01:25:43.206697] [DEBUG] [LOCAL     ] MTD: Saving derivative data.
[2025-10-24T01:25:43.229521] [DEBUG] [LOCAL     ] MTD: Derivative data saved (139 records).
[2025-10-24T01:25:43.229704] [INFO ] [MAIN      ] MTD: Successfully saved derivative data.
[2025-10-24T01:25:43.233375] [INFO ] [MAIN      ] Derivative Progress: 1291/2164 symbols completed. MTD took 1.1s. Estimated remaining: 6m 7s. Rate: 142.9 symbols/min
[2025-10-24T01:25:43.233760] [INFO ] [MAIN      ] MTG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:43.249367] [INFO ] [MAIN      ] MTB: Generated 139 derivative records from 46978 primary records.
[2025-10-24T01:25:43.250369] [DEBUG] [LOCAL     ] MTB: Saving derivative data.
[2025-10-24T01:25:43.267238] [DEBUG] [LOCAL     ] MTB: Derivative data saved (139 records).
[2025-10-24T01:25:43.268235] [INFO ] [MAIN      ] MTB: Successfully saved derivative data.
[2025-10-24T01:25:43.272742] [INFO ] [MAIN      ] Derivative Progress: 1292/2164 symbols completed. MTB took 1.1s. Estimated remaining: 6m 6s. Rate: 143.0 symbols/min
[2025-10-24T01:25:43.272948] [INFO ] [MAIN      ] MTH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:43.276394] [INFO ] [MAIN      ] MTDR: Generated 139 derivative records from 52152 primary records.
[2025-10-24T01:25:43.276609] [DEBUG] [LOCAL     ] MTDR: Saving derivative data.
[2025-10-24T01:25:43.292180] [DEBUG] [LOCAL     ] MTDR: Derivative data saved (139 records).
[2025-10-24T01:25:43.292826] [INFO ] [MAIN      ] MTDR: Successfully saved derivative data.
[2025-10-24T01:25:43.297940] [INFO ] [MAIN      ] Derivative Progress: 1293/2164 symbols completed. MTDR took 1.2s. Estimated remaining: 6m 5s. Rate: 143.1 symbols/min
[2025-10-24T01:25:43.298367] [INFO ] [MAIN      ] MTN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:43.343367] [DEBUG] [LOCAL     ] MTG: Loaded 51417 existing records from primary storage.
[2025-10-24T01:25:43.343796] [INFO ] [MAIN      ] MTG: Loaded 51417 primary data records.
[2025-10-24T01:25:43.472675] [DEBUG] [LOCAL     ] MTH: Loaded 44086 existing records from primary storage.
[2025-10-24T01:25:43.473160] [INFO ] [MAIN      ] MTH: Loaded 44086 primary data records.
[2025-10-24T01:25:43.619394] [DEBUG] [LOCAL     ] MTN: Loaded 39602 existing records from primary storage.
[2025-10-24T01:25:43.813220] [INFO ] [MAIN      ] MTN: Loaded 39602 primary data records.
[2025-10-24T01:25:44.325840] [DEBUG] [MAIN      ] MTG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:44.368253] [DEBUG] [MAIN      ] MTH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:44.416867] [DEBUG] [MAIN      ] MTN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:44.417104] [INFO ] [MAIN      ] MTG: Generated 139 derivative records from 51417 primary records.
[2025-10-24T01:25:44.431791] [DEBUG] [LOCAL     ] MTG: Saving derivative data.
[2025-10-24T01:25:44.448689] [DEBUG] [LOCAL     ] MTG: Derivative data saved (139 records).
[2025-10-24T01:25:44.451548] [INFO ] [MAIN      ] MTG: Successfully saved derivative data.
[2025-10-24T01:25:44.453867] [INFO ] [MAIN      ] Derivative Progress: 1294/2164 symbols completed. MTG took 1.2s. Estimated remaining: 6m 5s. Rate: 142.9 symbols/min
[2025-10-24T01:25:44.456704] [INFO ] [MAIN      ] MTRN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:44.476326] [INFO ] [MAIN      ] MTH: Generated 139 derivative records from 44086 primary records.
[2025-10-24T01:25:44.484255] [DEBUG] [LOCAL     ] MTH: Saving derivative data.
[2025-10-24T01:25:44.512285] [DEBUG] [LOCAL     ] MTH: Derivative data saved (139 records).
[2025-10-24T01:25:44.509812] [DEBUG] [LOCAL     ] MTRN: Loaded 18229 existing records from primary storage.
[2025-10-24T01:25:44.512800] [INFO ] [MAIN      ] MTH: Successfully saved derivative data.
[2025-10-24T01:25:44.512956] [INFO ] [MAIN      ] MTRN: Loaded 18229 primary data records.
[2025-10-24T01:25:44.515667] [INFO ] [MAIN      ] Derivative Progress: 1295/2164 symbols completed. MTH took 1.2s. Estimated remaining: 6m 5s. Rate: 143.0 symbols/min
[2025-10-24T01:25:44.572246] [INFO ] [MAIN      ] MTUS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:44.572477] [INFO ] [MAIN      ] MTN: Generated 139 derivative records from 39602 primary records.
[2025-10-24T01:25:44.581435] [DEBUG] [LOCAL     ] MTN: Saving derivative data.
[2025-10-24T01:25:44.637838] [DEBUG] [LOCAL     ] MTN: Derivative data saved (139 records).
[2025-10-24T01:25:44.655060] [INFO ] [MAIN      ] MTN: Successfully saved derivative data.
[2025-10-24T01:25:44.688426] [INFO ] [MAIN      ] Derivative Progress: 1296/2164 symbols completed. MTN took 1.4s. Estimated remaining: 6m 4s. Rate: 143.0 symbols/min
[2025-10-24T01:25:44.724429] [INFO ] [MAIN      ] MTW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:44.854417] [DEBUG] [LOCAL     ] MTUS: Loaded 27624 existing records from primary storage.
[2025-10-24T01:25:44.855116] [INFO ] [MAIN      ] MTUS: Loaded 27624 primary data records.
[2025-10-24T01:25:45.071692] [DEBUG] [LOCAL     ] MTW: Loaded 26615 existing records from primary storage.
[2025-10-24T01:25:45.190963] [INFO ] [MAIN      ] MTW: Loaded 26615 primary data records.
[2025-10-24T01:25:45.513675] [DEBUG] [MAIN      ] MTRN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:45.554787] [DEBUG] [MAIN      ] MTUS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:45.613299] [DEBUG] [MAIN      ] MTW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:45.634737] [INFO ] [MAIN      ] MTRN: Generated 139 derivative records from 18229 primary records.
[2025-10-24T01:25:45.638394] [DEBUG] [LOCAL     ] MTRN: Saving derivative data.
[2025-10-24T01:25:45.655520] [DEBUG] [LOCAL     ] MTRN: Derivative data saved (139 records).
[2025-10-24T01:25:45.655906] [INFO ] [MAIN      ] MTRN: Successfully saved derivative data.
[2025-10-24T01:25:45.658177] [INFO ] [MAIN      ] Derivative Progress: 1297/2164 symbols completed. MTRN took 1.2s. Estimated remaining: 6m 4s. Rate: 142.9 symbols/min
[2025-10-24T01:25:45.666112] [INFO ] [MAIN      ] MTX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:45.671519] [INFO ] [MAIN      ] MTUS: Generated 139 derivative records from 27624 primary records.
[2025-10-24T01:25:45.672950] [DEBUG] [LOCAL     ] MTUS: Saving derivative data.
[2025-10-24T01:25:45.691014] [DEBUG] [LOCAL     ] MTUS: Derivative data saved (139 records).
[2025-10-24T01:25:45.694849] [INFO ] [MAIN      ] MTUS: Successfully saved derivative data.
[2025-10-24T01:25:45.698268] [INFO ] [MAIN      ] Derivative Progress: 1298/2164 symbols completed. MTUS took 1.1s. Estimated remaining: 6m 3s. Rate: 143.0 symbols/min
[2025-10-24T01:25:45.705803] [INFO ] [MAIN      ] MTZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:45.719565] [INFO ] [MAIN      ] MTW: Generated 139 derivative records from 26615 primary records.
[2025-10-24T01:25:45.720721] [DEBUG] [LOCAL     ] MTW: Saving derivative data.
[2025-10-24T01:25:45.721815] [DEBUG] [LOCAL     ] MTX: Loaded 22713 existing records from primary storage.
[2025-10-24T01:25:45.722212] [INFO ] [MAIN      ] MTX: Loaded 22713 primary data records.
[2025-10-24T01:25:45.745120] [DEBUG] [LOCAL     ] MTW: Derivative data saved (139 records).
[2025-10-24T01:25:45.789364] [INFO ] [MAIN      ] MTW: Successfully saved derivative data.
[2025-10-24T01:25:45.830757] [INFO ] [MAIN      ] Derivative Progress: 1299/2164 symbols completed. MTW took 1.1s. Estimated remaining: 6m 3s. Rate: 143.1 symbols/min
[2025-10-24T01:25:45.841709] [INFO ] [MAIN      ] MUA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:45.975437] [DEBUG] [LOCAL     ] MTZ: Loaded 43006 existing records from primary storage.
[2025-10-24T01:25:46.089191] [INFO ] [MAIN      ] MTZ: Loaded 43006 primary data records.
[2025-10-24T01:25:46.146422] [DEBUG] [LOCAL     ] MUA: Loaded 11632 existing records from primary storage.
[2025-10-24T01:25:46.179359] [INFO ] [MAIN      ] MUA: Loaded 11632 primary data records.
[2025-10-24T01:25:46.762138] [DEBUG] [MAIN      ] MTX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:46.822614] [DEBUG] [MAIN      ] MTZ: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:25:46.856265] [DEBUG] [MAIN      ] MUA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:46.856571] [INFO ] [MAIN      ] MTX: Generated 139 derivative records from 22713 primary records.
[2025-10-24T01:25:46.872320] [DEBUG] [LOCAL     ] MTX: Saving derivative data.
[2025-10-24T01:25:46.890165] [DEBUG] [LOCAL     ] MTX: Derivative data saved (139 records).
[2025-10-24T01:25:46.893557] [INFO ] [MAIN      ] MTX: Successfully saved derivative data.
[2025-10-24T01:25:46.895877] [INFO ] [MAIN      ] Derivative Progress: 1300/2164 symbols completed. MTX took 1.2s. Estimated remaining: 6m 3s. Rate: 142.9 symbols/min
[2025-10-24T01:25:46.897257] [INFO ] [MAIN      ] MUC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:46.946425] [DEBUG] [LOCAL     ] MUC: Loaded 20783 existing records from primary storage.
[2025-10-24T01:25:46.949409] [INFO ] [MAIN      ] MUA: Generated 139 derivative records from 11632 primary records.
[2025-10-24T01:25:46.949680] [INFO ] [MAIN      ] MUC: Loaded 20783 primary data records.
[2025-10-24T01:25:46.949800] [DEBUG] [LOCAL     ] MUA: Saving derivative data.
[2025-10-24T01:25:47.001682] [INFO ] [MAIN      ] MTZ: Generated 139 derivative records from 43006 primary records.
[2025-10-24T01:25:47.017874] [DEBUG] [LOCAL     ] MUA: Derivative data saved (139 records).
[2025-10-24T01:25:47.035511] [DEBUG] [LOCAL     ] MTZ: Saving derivative data.
[2025-10-24T01:25:47.054533] [INFO ] [MAIN      ] MUA: Successfully saved derivative data.
[2025-10-24T01:25:47.093683] [INFO ] [MAIN      ] Derivative Progress: 1301/2164 symbols completed. MUA took 1.3s. Estimated remaining: 6m 2s. Rate: 143.0 symbols/min
[2025-10-24T01:25:47.103255] [INFO ] [MAIN      ] MUE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:47.096890] [DEBUG] [LOCAL     ] MTZ: Derivative data saved (139 records).
[2025-10-24T01:25:47.119565] [INFO ] [MAIN      ] MTZ: Successfully saved derivative data.
[2025-10-24T01:25:47.129211] [INFO ] [MAIN      ] Derivative Progress: 1302/2164 symbols completed. MTZ took 1.4s. Estimated remaining: 6m 2s. Rate: 143.1 symbols/min
[2025-10-24T01:25:47.146529] [INFO ] [MAIN      ] MUFG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:47.323199] [DEBUG] [LOCAL     ] MUE: Loaded 12258 existing records from primary storage.
[2025-10-24T01:25:47.323433] [INFO ] [MAIN      ] MUE: Loaded 12258 primary data records.
[2025-10-24T01:25:47.675940] [DEBUG] [LOCAL     ] MUFG: Loaded 52806 existing records from primary storage.
[2025-10-24T01:25:47.677239] [INFO ] [MAIN      ] MUFG: Loaded 52806 primary data records.
[2025-10-24T01:25:47.842595] [DEBUG] [MAIN      ] MUC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:48.102398] [DEBUG] [MAIN      ] MUE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:48.130200] [INFO ] [MAIN      ] MUC: Generated 139 derivative records from 20783 primary records.
[2025-10-24T01:25:48.134215] [DEBUG] [LOCAL     ] MUC: Saving derivative data.
[2025-10-24T01:25:48.152313] [DEBUG] [LOCAL     ] MUC: Derivative data saved (139 records).
[2025-10-24T01:25:48.163357] [INFO ] [MAIN      ] MUC: Successfully saved derivative data.
[2025-10-24T01:25:48.171004] [INFO ] [MAIN      ] Derivative Progress: 1303/2164 symbols completed. MUC took 1.3s. Estimated remaining: 6m 2s. Rate: 142.9 symbols/min
[2025-10-24T01:25:48.173596] [DEBUG] [MAIN      ] MUFG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:48.196405] [INFO ] [MAIN      ] MUE: Generated 139 derivative records from 12258 primary records.
[2025-10-24T01:25:48.197856] [DEBUG] [LOCAL     ] MUE: Saving derivative data.
[2025-10-24T01:25:48.215633] [DEBUG] [LOCAL     ] MUE: Derivative data saved (139 records).
[2025-10-24T01:25:48.215981] [INFO ] [MAIN      ] MUE: Successfully saved derivative data.
[2025-10-24T01:25:48.219024] [INFO ] [MAIN      ] Derivative Progress: 1304/2164 symbols completed. MUE took 1.1s. Estimated remaining: 6m 1s. Rate: 143.0 symbols/min
[2025-10-24T01:25:48.224861] [INFO ] [MAIN      ] MUFG: Generated 139 derivative records from 52806 primary records.
[2025-10-24T01:25:48.224960] [DEBUG] [LOCAL     ] MUFG: Saving derivative data.
[2025-10-24T01:25:48.236912] [DEBUG] [LOCAL     ] MUFG: Derivative data saved (139 records).
[2025-10-24T01:25:48.237010] [INFO ] [MAIN      ] MUFG: Successfully saved derivative data.
[2025-10-24T01:25:48.239828] [INFO ] [MAIN      ] Derivative Progress: 1305/2164 symbols completed. MUFG took 1.1s. Estimated remaining: 6m 0s. Rate: 143.1 symbols/min
[2025-10-24T01:25:48.240297] [INFO ] [MAIN      ] MUJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:48.240441] [INFO ] [MAIN      ] MUSA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:48.240531] [INFO ] [MAIN      ] MUR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:48.272956] [DEBUG] [LOCAL     ] MUJ: Loaded 13954 existing records from primary storage.
[2025-10-24T01:25:48.273150] [INFO ] [MAIN      ] MUJ: Loaded 13954 primary data records.
[2025-10-24T01:25:48.301788] [DEBUG] [LOCAL     ] MUSA: Loaded 24766 existing records from primary storage.
[2025-10-24T01:25:48.370207] [INFO ] [MAIN      ] MUSA: Loaded 24766 primary data records.
[2025-10-24T01:25:48.616005] [DEBUG] [LOCAL     ] MUR: Loaded 53250 existing records from primary storage.
[2025-10-24T01:25:48.800522] [INFO ] [MAIN      ] MUR: Loaded 53250 primary data records.
[2025-10-24T01:25:49.257555] [DEBUG] [MAIN      ] MUJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:49.287575] [DEBUG] [MAIN      ] MUSA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:49.341354] [DEBUG] [MAIN      ] MUR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:49.369831] [INFO ] [MAIN      ] MUJ: Generated 139 derivative records from 13954 primary records.
[2025-10-24T01:25:49.373461] [DEBUG] [LOCAL     ] MUJ: Saving derivative data.
[2025-10-24T01:25:49.393954] [DEBUG] [LOCAL     ] MUJ: Derivative data saved (139 records).
[2025-10-24T01:25:49.398911] [INFO ] [MAIN      ] MUJ: Successfully saved derivative data.
[2025-10-24T01:25:49.401554] [INFO ] [MAIN      ] Derivative Progress: 1306/2164 symbols completed. MUJ took 1.2s. Estimated remaining: 6m 0s. Rate: 142.9 symbols/min
[2025-10-24T01:25:49.404402] [INFO ] [MAIN      ] MUX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:49.408302] [INFO ] [MAIN      ] MUSA: Generated 139 derivative records from 24766 primary records.
[2025-10-24T01:25:49.411172] [DEBUG] [LOCAL     ] MUSA: Saving derivative data.
[2025-10-24T01:25:49.424013] [DEBUG] [LOCAL     ] MUSA: Derivative data saved (139 records).
[2025-10-24T01:25:49.424170] [INFO ] [MAIN      ] MUSA: Successfully saved derivative data.
[2025-10-24T01:25:49.428195] [INFO ] [MAIN      ] Derivative Progress: 1307/2164 symbols completed. MUSA took 1.2s. Estimated remaining: 5m 60s. Rate: 143.0 symbols/min
[2025-10-24T01:25:49.431332] [INFO ] [MAIN      ] MVF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:49.436514] [INFO ] [MAIN      ] MUR: Generated 139 derivative records from 53250 primary records.
[2025-10-24T01:25:49.436683] [DEBUG] [LOCAL     ] MUR: Saving derivative data.
[2025-10-24T01:25:49.463404] [DEBUG] [LOCAL     ] MUR: Derivative data saved (139 records).
[2025-10-24T01:25:49.463793] [INFO ] [MAIN      ] MUR: Successfully saved derivative data.
[2025-10-24T01:25:49.467500] [INFO ] [MAIN      ] Derivative Progress: 1308/2164 symbols completed. MUR took 1.2s. Estimated remaining: 5m 59s. Rate: 143.1 symbols/min
[2025-10-24T01:25:49.467966] [INFO ] [MAIN      ] MVO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:49.474498] [DEBUG] [LOCAL     ] MVF: Loaded 12832 existing records from primary storage.
[2025-10-24T01:25:49.474683] [INFO ] [MAIN      ] MVF: Loaded 12832 primary data records.
[2025-10-24T01:25:49.611458] [DEBUG] [LOCAL     ] MVO: Loaded 9083 existing records from primary storage.
[2025-10-24T01:25:49.607277] [DEBUG] [LOCAL     ] MUX: Loaded 44187 existing records from primary storage.
[2025-10-24T01:25:49.612126] [INFO ] [MAIN      ] MVO: Loaded 9083 primary data records.
[2025-10-24T01:25:49.622614] [INFO ] [MAIN      ] MUX: Loaded 44187 primary data records.
[2025-10-24T01:25:50.493279] [DEBUG] [MAIN      ] MVF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:50.540169] [DEBUG] [MAIN      ] MVO: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:25:50.572598] [DEBUG] [MAIN      ] MUX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:50.602798] [INFO ] [MAIN      ] MVF: Generated 139 derivative records from 12832 primary records.
[2025-10-24T01:25:50.603873] [DEBUG] [LOCAL     ] MVF: Saving derivative data.
[2025-10-24T01:25:50.624708] [DEBUG] [LOCAL     ] MVF: Derivative data saved (139 records).
[2025-10-24T01:25:50.627303] [INFO ] [MAIN      ] MVF: Successfully saved derivative data.
[2025-10-24T01:25:50.633875] [INFO ] [MAIN      ] Derivative Progress: 1309/2164 symbols completed. MVF took 1.2s. Estimated remaining: 5m 59s. Rate: 142.9 symbols/min
[2025-10-24T01:25:50.639751] [INFO ] [MAIN      ] MVT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:50.659544] [INFO ] [MAIN      ] MVO: Generated 139 derivative records from 9083 primary records.
[2025-10-24T01:25:50.666356] [DEBUG] [LOCAL     ] MVT: Loaded 9850 existing records from primary storage.
[2025-10-24T01:25:50.666711] [INFO ] [MAIN      ] MUX: Generated 139 derivative records from 44187 primary records.
[2025-10-24T01:25:50.667194] [DEBUG] [LOCAL     ] MUX: Saving derivative data.
[2025-10-24T01:25:50.666865] [DEBUG] [LOCAL     ] MVO: Saving derivative data.
[2025-10-24T01:25:50.667423] [INFO ] [MAIN      ] MVT: Loaded 9850 primary data records.
[2025-10-24T01:25:50.767331] [DEBUG] [LOCAL     ] MUX: Derivative data saved (139 records).
[2025-10-24T01:25:50.774674] [DEBUG] [LOCAL     ] MVO: Derivative data saved (139 records).
[2025-10-24T01:25:50.780036] [INFO ] [MAIN      ] MUX: Successfully saved derivative data.
[2025-10-24T01:25:50.795560] [INFO ] [MAIN      ] Derivative Progress: 1310/2164 symbols completed. MUX took 1.4s. Estimated remaining: 5m 58s. Rate: 143.0 symbols/min
[2025-10-24T01:25:50.807914] [INFO ] [MAIN      ] MWA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:50.785412] [INFO ] [MAIN      ] MVO: Successfully saved derivative data.
[2025-10-24T01:25:50.810633] [INFO ] [MAIN      ] Derivative Progress: 1311/2164 symbols completed. MVO took 1.3s. Estimated remaining: 5m 58s. Rate: 143.1 symbols/min
[2025-10-24T01:25:50.812195] [INFO ] [MAIN      ] MX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:51.037950] [DEBUG] [LOCAL     ] MX: Loaded 22387 existing records from primary storage.
[2025-10-24T01:25:51.039022] [INFO ] [MAIN      ] MX: Loaded 22387 primary data records.
[2025-10-24T01:25:51.199300] [DEBUG] [LOCAL     ] MWA: Loaded 46053 existing records from primary storage.
[2025-10-24T01:25:51.350625] [INFO ] [MAIN      ] MWA: Loaded 46053 primary data records.
[2025-10-24T01:25:51.466290] [DEBUG] [MAIN      ] MVT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:51.706626] [DEBUG] [MAIN      ] MX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:51.726615] [INFO ] [MAIN      ] MVT: Generated 139 derivative records from 9850 primary records.
[2025-10-24T01:25:51.727214] [DEBUG] [LOCAL     ] MVT: Saving derivative data.
[2025-10-24T01:25:51.743131] [DEBUG] [LOCAL     ] MVT: Derivative data saved (139 records).
[2025-10-24T01:25:51.744157] [INFO ] [MAIN      ] MVT: Successfully saved derivative data.
[2025-10-24T01:25:51.747685] [INFO ] [MAIN      ] Derivative Progress: 1312/2164 symbols completed. MVT took 1.1s. Estimated remaining: 5m 58s. Rate: 142.9 symbols/min
[2025-10-24T01:25:51.748579] [INFO ] [MAIN      ] MXF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:51.780399] [DEBUG] [LOCAL     ] MXF: Loaded 5580 existing records from primary storage.
[2025-10-24T01:25:51.777557] [DEBUG] [MAIN      ] MWA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:51.781928] [INFO ] [MAIN      ] MXF: Loaded 5580 primary data records.
[2025-10-24T01:25:51.873860] [INFO ] [MAIN      ] MX: Generated 139 derivative records from 22387 primary records.
[2025-10-24T01:25:51.891273] [DEBUG] [LOCAL     ] MX: Saving derivative data.
[2025-10-24T01:25:51.964545] [DEBUG] [LOCAL     ] MX: Derivative data saved (139 records).
[2025-10-24T01:25:51.987879] [INFO ] [MAIN      ] MX: Successfully saved derivative data.
[2025-10-24T01:25:51.993216] [INFO ] [MAIN      ] Derivative Progress: 1313/2164 symbols completed. MX took 1.2s. Estimated remaining: 5m 57s. Rate: 143.0 symbols/min
[2025-10-24T01:25:52.147970] [INFO ] [MAIN      ] MYD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:52.178539] [INFO ] [MAIN      ] MWA: Generated 139 derivative records from 46053 primary records.
[2025-10-24T01:25:52.176409] [DEBUG] [LOCAL     ] MYD: Loaded 13242 existing records from primary storage.
[2025-10-24T01:25:52.178992] [DEBUG] [LOCAL     ] MWA: Saving derivative data.
[2025-10-24T01:25:52.179094] [INFO ] [MAIN      ] MYD: Loaded 13242 primary data records.
[2025-10-24T01:25:52.300892] [DEBUG] [LOCAL     ] MWA: Derivative data saved (139 records).
[2025-10-24T01:25:52.301221] [INFO ] [MAIN      ] MWA: Successfully saved derivative data.
[2025-10-24T01:25:52.304602] [INFO ] [MAIN      ] Derivative Progress: 1314/2164 symbols completed. MWA took 1.5s. Estimated remaining: 5m 57s. Rate: 143.0 symbols/min
[2025-10-24T01:25:52.322747] [INFO ] [MAIN      ] MYE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:52.357691] [DEBUG] [MAIN      ] MXF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:52.561062] [DEBUG] [LOCAL     ] MYE: Loaded 24133 existing records from primary storage.
[2025-10-24T01:25:52.564700] [INFO ] [MAIN      ] MYE: Loaded 24133 primary data records.
[2025-10-24T01:25:52.742563] [INFO ] [MAIN      ] MXF: Generated 139 derivative records from 5580 primary records.
[2025-10-24T01:25:52.876235] [DEBUG] [LOCAL     ] MXF: Saving derivative data.
[2025-10-24T01:25:52.876573] [DEBUG] [MAIN      ] MYD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:52.914402] [DEBUG] [LOCAL     ] MXF: Derivative data saved (139 records).
[2025-10-24T01:25:52.917916] [INFO ] [MAIN      ] MXF: Successfully saved derivative data.
[2025-10-24T01:25:52.924777] [INFO ] [MAIN      ] Derivative Progress: 1315/2164 symbols completed. MXF took 1.2s. Estimated remaining: 5m 56s. Rate: 143.0 symbols/min
[2025-10-24T01:25:52.925843] [INFO ] [MAIN      ] MYI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:52.954059] [INFO ] [MAIN      ] MYD: Generated 139 derivative records from 13242 primary records.
[2025-10-24T01:25:52.971976] [DEBUG] [LOCAL     ] MYD: Saving derivative data.
[2025-10-24T01:25:52.973815] [DEBUG] [LOCAL     ] MYI: Loaded 19487 existing records from primary storage.
[2025-10-24T01:25:52.974440] [DEBUG] [MAIN      ] MYE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:52.985455] [DEBUG] [LOCAL     ] MYD: Derivative data saved (139 records).
[2025-10-24T01:25:52.981341] [INFO ] [MAIN      ] MYI: Loaded 19487 primary data records.
[2025-10-24T01:25:52.985608] [INFO ] [MAIN      ] MYD: Successfully saved derivative data.
[2025-10-24T01:25:52.998982] [INFO ] [MAIN      ] Derivative Progress: 1316/2164 symbols completed. MYD took 0.9s. Estimated remaining: 5m 56s. Rate: 143.1 symbols/min
[2025-10-24T01:25:53.012315] [INFO ] [MAIN      ] MYN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:53.159425] [DEBUG] [LOCAL     ] MYN: Loaded 10063 existing records from primary storage.
[2025-10-24T01:25:53.200422] [INFO ] [MAIN      ] MYN: Loaded 10063 primary data records.
[2025-10-24T01:25:53.625008] [INFO ] [MAIN      ] MYE: Generated 139 derivative records from 24133 primary records.
[2025-10-24T01:25:53.625355] [DEBUG] [LOCAL     ] MYE: Saving derivative data.
[2025-10-24T01:25:53.639398] [DEBUG] [LOCAL     ] MYE: Derivative data saved (139 records).
[2025-10-24T01:25:53.641561] [INFO ] [MAIN      ] MYE: Successfully saved derivative data.
[2025-10-24T01:25:53.645598] [INFO ] [MAIN      ] Derivative Progress: 1317/2164 symbols completed. MYE took 1.3s. Estimated remaining: 5m 55s. Rate: 143.0 symbols/min
[2025-10-24T01:25:53.659219] [DEBUG] [MAIN      ] MYI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:53.658698] [INFO ] [MAIN      ] NABL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:53.723184] [INFO ] [MAIN      ] MYI: Generated 139 derivative records from 19487 primary records.
[2025-10-24T01:25:53.720971] [DEBUG] [MAIN      ] MYN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:53.734247] [DEBUG] [LOCAL     ] MYI: Saving derivative data.
[2025-10-24T01:25:53.763108] [DEBUG] [LOCAL     ] MYI: Derivative data saved (139 records).
[2025-10-24T01:25:53.766191] [INFO ] [MAIN      ] MYI: Successfully saved derivative data.
[2025-10-24T01:25:53.767056] [DEBUG] [LOCAL     ] NABL: Loaded 39110 existing records from primary storage.
[2025-10-24T01:25:53.771858] [INFO ] [MAIN      ] Derivative Progress: 1318/2164 symbols completed. MYI took 0.8s. Estimated remaining: 5m 55s. Rate: 143.1 symbols/min
[2025-10-24T01:25:53.775331] [INFO ] [MAIN      ] NABL: Loaded 39110 primary data records.
[2025-10-24T01:25:53.969278] [INFO ] [MAIN      ] MYN: Generated 139 derivative records from 10063 primary records.
[2025-10-24T01:25:53.969486] [DEBUG] [LOCAL     ] MYN: Saving derivative data.
[2025-10-24T01:25:54.143858] [DEBUG] [LOCAL     ] MYN: Derivative data saved (139 records).
[2025-10-24T01:25:54.145020] [INFO ] [MAIN      ] MYN: Successfully saved derivative data.
[2025-10-24T01:25:54.148489] [INFO ] [MAIN      ] Derivative Progress: 1319/2164 symbols completed. MYN took 1.1s. Estimated remaining: 5m 54s. Rate: 143.1 symbols/min
[2025-10-24T01:25:54.168196] [DEBUG] [MAIN      ] NABL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:54.193928] [INFO ] [MAIN      ] NABL: Generated 139 derivative records from 39110 primary records.
[2025-10-24T01:25:54.194029] [DEBUG] [LOCAL     ] NABL: Saving derivative data.
[2025-10-24T01:25:54.205339] [DEBUG] [LOCAL     ] NABL: Derivative data saved (139 records).
[2025-10-24T01:25:54.205419] [INFO ] [MAIN      ] NABL: Successfully saved derivative data.
[2025-10-24T01:25:54.208231] [INFO ] [MAIN      ] Derivative Progress: 1320/2164 symbols completed. NABL took 0.5s. Estimated remaining: 5m 54s. Rate: 143.2 symbols/min
[2025-10-24T01:25:54.208716] [INFO ] [MAIN      ] NAC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:54.208799] [INFO ] [MAIN      ] NAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:54.208868] [INFO ] [MAIN      ] NAD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:54.223370] [DEBUG] [LOCAL     ] NAN: Loaded 8556 existing records from primary storage.
[2025-10-24T01:25:54.223877] [INFO ] [MAIN      ] NAN: Loaded 8556 primary data records.
[2025-10-24T01:25:54.437343] [DEBUG] [LOCAL     ] NAC: Loaded 24674 existing records from primary storage.
[2025-10-24T01:25:54.541208] [DEBUG] [LOCAL     ] NAD: Loaded 33735 existing records from primary storage.
[2025-10-24T01:25:54.554959] [INFO ] [MAIN      ] NAD: Loaded 33735 primary data records.
[2025-10-24T01:25:54.554862] [INFO ] [MAIN      ] NAC: Loaded 24674 primary data records.
[2025-10-24T01:25:55.176443] [DEBUG] [MAIN      ] NAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:55.226695] [DEBUG] [MAIN      ] NAD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:55.263336] [DEBUG] [MAIN      ] NAC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:55.285996] [INFO ] [MAIN      ] NAN: Generated 139 derivative records from 8556 primary records.
[2025-10-24T01:25:55.287527] [DEBUG] [LOCAL     ] NAN: Saving derivative data.
[2025-10-24T01:25:55.307555] [DEBUG] [LOCAL     ] NAN: Derivative data saved (139 records).
[2025-10-24T01:25:55.310538] [INFO ] [MAIN      ] NAN: Successfully saved derivative data.
[2025-10-24T01:25:55.313154] [INFO ] [MAIN      ] Derivative Progress: 1321/2164 symbols completed. NAN took 1.1s. Estimated remaining: 5m 54s. Rate: 143.0 symbols/min
[2025-10-24T01:25:55.316978] [INFO ] [MAIN      ] NAT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:55.331346] [INFO ] [MAIN      ] NAD: Generated 139 derivative records from 33735 primary records.
[2025-10-24T01:25:55.333080] [DEBUG] [LOCAL     ] NAD: Saving derivative data.
[2025-10-24T01:25:55.351712] [DEBUG] [LOCAL     ] NAD: Derivative data saved (139 records).
[2025-10-24T01:25:55.354596] [INFO ] [MAIN      ] NAD: Successfully saved derivative data.
[2025-10-24T01:25:55.355287] [INFO ] [MAIN      ] NAC: Generated 139 derivative records from 24674 primary records.
[2025-10-24T01:25:55.358218] [INFO ] [MAIN      ] Derivative Progress: 1322/2164 symbols completed. NAD took 1.1s. Estimated remaining: 5m 53s. Rate: 143.1 symbols/min
[2025-10-24T01:25:55.358603] [DEBUG] [LOCAL     ] NAC: Saving derivative data.
[2025-10-24T01:25:55.358824] [INFO ] [MAIN      ] NATL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:55.388489] [DEBUG] [LOCAL     ] NAC: Derivative data saved (139 records).
[2025-10-24T01:25:55.388728] [INFO ] [MAIN      ] NAC: Successfully saved derivative data.
[2025-10-24T01:25:55.392238] [INFO ] [MAIN      ] Derivative Progress: 1323/2164 symbols completed. NAC took 1.2s. Estimated remaining: 5m 52s. Rate: 143.2 symbols/min
[2025-10-24T01:25:55.392855] [INFO ] [MAIN      ] NAZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:55.423482] [DEBUG] [LOCAL     ] NAZ: Loaded 2688 existing records from primary storage.
[2025-10-24T01:25:55.423926] [INFO ] [MAIN      ] NAZ: Loaded 2688 primary data records.
[2025-10-24T01:25:55.459946] [DEBUG] [LOCAL     ] NAT: Loaded 49578 existing records from primary storage.
[2025-10-24T01:25:55.485999] [INFO ] [MAIN      ] NAT: Loaded 49578 primary data records.
[2025-10-24T01:25:55.506296] [DEBUG] [LOCAL     ] NATL: Loaded 32261 existing records from primary storage.
[2025-10-24T01:25:55.614146] [INFO ] [MAIN      ] NATL: Loaded 32261 primary data records.
[2025-10-24T01:25:56.440053] [DEBUG] [MAIN      ] NAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:56.493716] [DEBUG] [MAIN      ] NAT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:56.533532] [DEBUG] [MAIN      ] NATL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:56.607034] [INFO ] [MAIN      ] NAZ: Generated 139 derivative records from 2688 primary records.
[2025-10-24T01:25:56.609201] [DEBUG] [LOCAL     ] NAZ: Saving derivative data.
[2025-10-24T01:25:56.633346] [DEBUG] [LOCAL     ] NAZ: Derivative data saved (139 records).
[2025-10-24T01:25:56.637464] [INFO ] [MAIN      ] NAZ: Successfully saved derivative data.
[2025-10-24T01:25:56.642857] [INFO ] [MAIN      ] Derivative Progress: 1324/2164 symbols completed. NAZ took 1.2s. Estimated remaining: 5m 52s. Rate: 143.0 symbols/min
[2025-10-24T01:25:56.647306] [INFO ] [MAIN      ] NBB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:56.648051] [INFO ] [MAIN      ] NAT: Generated 139 derivative records from 49578 primary records.
[2025-10-24T01:25:56.651948] [INFO ] [MAIN      ] NATL: Generated 139 derivative records from 32261 primary records.
[2025-10-24T01:25:56.652307] [DEBUG] [LOCAL     ] NATL: Saving derivative data.
[2025-10-24T01:25:56.652087] [DEBUG] [LOCAL     ] NAT: Saving derivative data.
[2025-10-24T01:25:56.688757] [DEBUG] [LOCAL     ] NAT: Derivative data saved (139 records).
[2025-10-24T01:25:56.693070] [DEBUG] [LOCAL     ] NATL: Derivative data saved (139 records).
[2025-10-24T01:25:56.694152] [INFO ] [MAIN      ] NATL: Successfully saved derivative data.
[2025-10-24T01:25:56.705501] [INFO ] [MAIN      ] Derivative Progress: 1325/2164 symbols completed. NATL took 1.3s. Estimated remaining: 5m 52s. Rate: 143.1 symbols/min
[2025-10-24T01:25:56.694335] [INFO ] [MAIN      ] NAT: Successfully saved derivative data.
[2025-10-24T01:25:56.700668] [DEBUG] [LOCAL     ] NBB: Loaded 9081 existing records from primary storage.
[2025-10-24T01:25:56.705930] [INFO ] [MAIN      ] NBHC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:56.706436] [INFO ] [MAIN      ] NBB: Loaded 9081 primary data records.
[2025-10-24T01:25:56.711847] [INFO ] [MAIN      ] Derivative Progress: 1326/2164 symbols completed. NAT took 1.4s. Estimated remaining: 5m 51s. Rate: 143.2 symbols/min
[2025-10-24T01:25:56.726905] [INFO ] [MAIN      ] NBR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:56.975632] [DEBUG] [LOCAL     ] NBHC: Loaded 23975 existing records from primary storage.
[2025-10-24T01:25:57.004312] [INFO ] [MAIN      ] NBHC: Loaded 23975 primary data records.
[2025-10-24T01:25:57.209608] [DEBUG] [LOCAL     ] NBR: Loaded 34642 existing records from primary storage.
[2025-10-24T01:25:57.210086] [INFO ] [MAIN      ] NBR: Loaded 34642 primary data records.
[2025-10-24T01:25:57.990806] [DEBUG] [MAIN      ] NBB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:58.052094] [DEBUG] [MAIN      ] NBHC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:58.078015] [DEBUG] [MAIN      ] NBR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:58.083000] [INFO ] [MAIN      ] NBB: Generated 139 derivative records from 9081 primary records.
[2025-10-24T01:25:58.099775] [DEBUG] [LOCAL     ] NBB: Saving derivative data.
[2025-10-24T01:25:58.126587] [DEBUG] [LOCAL     ] NBB: Derivative data saved (139 records).
[2025-10-24T01:25:58.127167] [INFO ] [MAIN      ] NBB: Successfully saved derivative data.
[2025-10-24T01:25:58.132579] [INFO ] [MAIN      ] Derivative Progress: 1327/2164 symbols completed. NBB took 1.5s. Estimated remaining: 5m 51s. Rate: 142.9 symbols/min
[2025-10-24T01:25:58.136152] [INFO ] [MAIN      ] NBXG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:58.162709] [INFO ] [MAIN      ] NBHC: Generated 139 derivative records from 23975 primary records.
[2025-10-24T01:25:58.166311] [DEBUG] [LOCAL     ] NBHC: Saving derivative data.
[2025-10-24T01:25:58.177812] [INFO ] [MAIN      ] NBR: Generated 139 derivative records from 34642 primary records.
[2025-10-24T01:25:58.190452] [DEBUG] [LOCAL     ] NBR: Saving derivative data.
[2025-10-24T01:25:58.190302] [DEBUG] [LOCAL     ] NBHC: Derivative data saved (139 records).
[2025-10-24T01:25:58.191404] [INFO ] [MAIN      ] NBHC: Successfully saved derivative data.
[2025-10-24T01:25:58.194844] [INFO ] [MAIN      ] Derivative Progress: 1328/2164 symbols completed. NBHC took 1.5s. Estimated remaining: 5m 51s. Rate: 143.0 symbols/min
[2025-10-24T01:25:58.192133] [DEBUG] [LOCAL     ] NBXG: Loaded 21773 existing records from primary storage.
[2025-10-24T01:25:58.203115] [INFO ] [MAIN      ] NBXG: Loaded 21773 primary data records.
[2025-10-24T01:25:58.195319] [INFO ] [MAIN      ] NC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:58.208051] [DEBUG] [LOCAL     ] NBR: Derivative data saved (139 records).
[2025-10-24T01:25:58.208188] [INFO ] [MAIN      ] NBR: Successfully saved derivative data.
[2025-10-24T01:25:58.222804] [INFO ] [MAIN      ] Derivative Progress: 1329/2164 symbols completed. NBR took 1.5s. Estimated remaining: 5m 50s. Rate: 143.1 symbols/min
[2025-10-24T01:25:58.257364] [INFO ] [MAIN      ] NCA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:58.305206] [DEBUG] [LOCAL     ] NC: Loaded 2009 existing records from primary storage.
[2025-10-24T01:25:58.322890] [INFO ] [MAIN      ] NC: Loaded 2009 primary data records.
[2025-10-24T01:25:58.654449] [DEBUG] [LOCAL     ] NCA: Loaded 9801 existing records from primary storage.
[2025-10-24T01:25:58.681021] [INFO ] [MAIN      ] NCA: Loaded 9801 primary data records.
[2025-10-24T01:25:59.215697] [DEBUG] [MAIN      ] NBXG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:59.245578] [DEBUG] [MAIN      ] NC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:59.293866] [DEBUG] [MAIN      ] NCA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:25:59.340279] [INFO ] [MAIN      ] NBXG: Generated 139 derivative records from 21773 primary records.
[2025-10-24T01:25:59.342202] [DEBUG] [LOCAL     ] NBXG: Saving derivative data.
[2025-10-24T01:25:59.348958] [INFO ] [MAIN      ] NC: Generated 139 derivative records from 2009 primary records.
[2025-10-24T01:25:59.360834] [DEBUG] [LOCAL     ] NC: Saving derivative data.
[2025-10-24T01:25:59.363711] [DEBUG] [LOCAL     ] NBXG: Derivative data saved (139 records).
[2025-10-24T01:25:59.367558] [INFO ] [MAIN      ] NBXG: Successfully saved derivative data.
[2025-10-24T01:25:59.375700] [INFO ] [MAIN      ] Derivative Progress: 1330/2164 symbols completed. NBXG took 1.2s. Estimated remaining: 5m 50s. Rate: 142.9 symbols/min
[2025-10-24T01:25:59.375886] [INFO ] [MAIN      ] NCDL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:59.381407] [DEBUG] [LOCAL     ] NC: Derivative data saved (139 records).
[2025-10-24T01:25:59.383075] [INFO ] [MAIN      ] NC: Successfully saved derivative data.
[2025-10-24T01:25:59.385634] [INFO ] [MAIN      ] Derivative Progress: 1331/2164 symbols completed. NC took 1.2s. Estimated remaining: 5m 49s. Rate: 143.0 symbols/min
[2025-10-24T01:25:59.386516] [INFO ] [MAIN      ] NCLH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:59.400016] [INFO ] [MAIN      ] NCA: Generated 139 derivative records from 9801 primary records.
[2025-10-24T01:25:59.400233] [DEBUG] [LOCAL     ] NCA: Saving derivative data.
[2025-10-24T01:25:59.420449] [DEBUG] [LOCAL     ] NCA: Derivative data saved (139 records).
[2025-10-24T01:25:59.421338] [DEBUG] [LOCAL     ] NCDL: Loaded 21793 existing records from primary storage.
[2025-10-24T01:25:59.421751] [INFO ] [MAIN      ] NCDL: Loaded 21793 primary data records.
[2025-10-24T01:25:59.421522] [INFO ] [MAIN      ] NCA: Successfully saved derivative data.
[2025-10-24T01:25:59.425703] [INFO ] [MAIN      ] Derivative Progress: 1332/2164 symbols completed. NCA took 1.2s. Estimated remaining: 5m 49s. Rate: 143.1 symbols/min
[2025-10-24T01:25:59.438238] [INFO ] [MAIN      ] NCZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:25:59.583273] [DEBUG] [LOCAL     ] NCZ: Loaded 12391 existing records from primary storage.
[2025-10-24T01:25:59.613973] [INFO ] [MAIN      ] NCZ: Loaded 12391 primary data records.
[2025-10-24T01:25:59.862291] [DEBUG] [LOCAL     ] NCLH: Loaded 54143 existing records from primary storage.
[2025-10-24T01:25:59.881245] [INFO ] [MAIN      ] NCLH: Loaded 54143 primary data records.
[2025-10-24T01:26:00.409638] [DEBUG] [MAIN      ] NCDL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:00.444051] [DEBUG] [MAIN      ] NCZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:00.492843] [DEBUG] [MAIN      ] NCLH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:00.581460] [INFO ] [MAIN      ] NCDL: Generated 139 derivative records from 21793 primary records.
[2025-10-24T01:26:00.584386] [DEBUG] [LOCAL     ] NCDL: Saving derivative data.
[2025-10-24T01:26:00.599732] [DEBUG] [LOCAL     ] NCDL: Derivative data saved (139 records).
[2025-10-24T01:26:00.600091] [INFO ] [MAIN      ] NCDL: Successfully saved derivative data.
[2025-10-24T01:26:00.602541] [INFO ] [MAIN      ] Derivative Progress: 1333/2164 symbols completed. NCDL took 1.2s. Estimated remaining: 5m 49s. Rate: 142.9 symbols/min
[2025-10-24T01:26:00.615519] [INFO ] [MAIN      ] NCZ: Generated 139 derivative records from 12391 primary records.
[2025-10-24T01:26:00.618485] [DEBUG] [LOCAL     ] NCZ: Saving derivative data.
[2025-10-24T01:26:00.629205] [INFO ] [MAIN      ] NCLH: Generated 139 derivative records from 54143 primary records.
[2025-10-24T01:26:00.632144] [DEBUG] [LOCAL     ] NCLH: Saving derivative data.
[2025-10-24T01:26:00.633686] [DEBUG] [LOCAL     ] NCZ: Derivative data saved (139 records).
[2025-10-24T01:26:00.634383] [INFO ] [MAIN      ] NCZ: Successfully saved derivative data.
[2025-10-24T01:26:00.637001] [INFO ] [MAIN      ] Derivative Progress: 1334/2164 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 48s. Rate: 143.0 symbols/min
[2025-10-24T01:26:00.649136] [DEBUG] [LOCAL     ] NCLH: Derivative data saved (139 records).
[2025-10-24T01:26:00.649230] [INFO ] [MAIN      ] NCLH: Successfully saved derivative data.
[2025-10-24T01:26:00.652450] [INFO ] [MAIN      ] Derivative Progress: 1335/2164 symbols completed. NCLH took 1.3s. Estimated remaining: 5m 47s. Rate: 143.1 symbols/min
[2025-10-24T01:26:00.653109] [INFO ] [MAIN      ] NE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:00.653022] [INFO ] [MAIN      ] NEA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:00.652951] [INFO ] [MAIN      ] NDMO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:00.679027] [DEBUG] [LOCAL     ] NDMO: Loaded 17101 existing records from primary storage.
[2025-10-24T01:26:00.679259] [INFO ] [MAIN      ] NDMO: Loaded 17101 primary data records.
[2025-10-24T01:26:00.820608] [DEBUG] [LOCAL     ] NEA: Loaded 35402 existing records from primary storage.
[2025-10-24T01:26:00.820978] [INFO ] [MAIN      ] NEA: Loaded 35402 primary data records.
[2025-10-24T01:26:00.938750] [DEBUG] [LOCAL     ] NE: Loaded 52682 existing records from primary storage.
[2025-10-24T01:26:01.010425] [INFO ] [MAIN      ] NE: Loaded 52682 primary data records.
[2025-10-24T01:26:01.685923] [DEBUG] [MAIN      ] NDMO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:01.719962] [DEBUG] [MAIN      ] NEA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:01.774007] [DEBUG] [MAIN      ] NE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:01.806993] [INFO ] [MAIN      ] NDMO: Generated 139 derivative records from 17101 primary records.
[2025-10-24T01:26:01.811386] [DEBUG] [LOCAL     ] NDMO: Saving derivative data.
[2025-10-24T01:26:01.824967] [INFO ] [MAIN      ] NEA: Generated 139 derivative records from 35402 primary records.
[2025-10-24T01:26:01.832931] [DEBUG] [LOCAL     ] NEA: Saving derivative data.
[2025-10-24T01:26:01.833920] [DEBUG] [LOCAL     ] NDMO: Derivative data saved (139 records).
[2025-10-24T01:26:01.836155] [INFO ] [MAIN      ] NDMO: Successfully saved derivative data.
[2025-10-24T01:26:01.839075] [INFO ] [MAIN      ] Derivative Progress: 1336/2164 symbols completed. NDMO took 1.2s. Estimated remaining: 5m 48s. Rate: 142.9 symbols/min
[2025-10-24T01:26:01.843188] [INFO ] [MAIN      ] NEE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:01.862049] [DEBUG] [LOCAL     ] NEA: Derivative data saved (139 records).
[2025-10-24T01:26:01.862699] [INFO ] [MAIN      ] NEA: Successfully saved derivative data.
[2025-10-24T01:26:01.865849] [INFO ] [MAIN      ] Derivative Progress: 1337/2164 symbols completed. NEA took 1.2s. Estimated remaining: 5m 47s. Rate: 143.0 symbols/min
[2025-10-24T01:26:01.866190] [INFO ] [MAIN      ] NEM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:01.872407] [INFO ] [MAIN      ] NE: Generated 139 derivative records from 52682 primary records.
[2025-10-24T01:26:01.872879] [DEBUG] [LOCAL     ] NE: Saving derivative data.
[2025-10-24T01:26:01.886307] [DEBUG] [LOCAL     ] NE: Derivative data saved (139 records).
[2025-10-24T01:26:01.886919] [INFO ] [MAIN      ] NE: Successfully saved derivative data.
[2025-10-24T01:26:01.891120] [INFO ] [MAIN      ] Derivative Progress: 1338/2164 symbols completed. NE took 1.2s. Estimated remaining: 5m 46s. Rate: 143.1 symbols/min
[2025-10-24T01:26:01.891869] [INFO ] [MAIN      ] NET: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:01.954082] [DEBUG] [LOCAL     ] NEE: Loaded 54097 existing records from primary storage.
[2025-10-24T01:26:01.954803] [INFO ] [MAIN      ] NEE: Loaded 54097 primary data records.
[2025-10-24T01:26:02.095156] [DEBUG] [LOCAL     ] NEM: Loaded 54098 existing records from primary storage.
[2025-10-24T01:26:02.096002] [INFO ] [MAIN      ] NEM: Loaded 54098 primary data records.
[2025-10-24T01:26:02.446953] [DEBUG] [LOCAL     ] NET: Loaded 53162 existing records from primary storage.
[2025-10-24T01:26:02.476344] [INFO ] [MAIN      ] NET: Loaded 53162 primary data records.
[2025-10-24T01:26:03.052439] [DEBUG] [MAIN      ] NEE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:03.094842] [DEBUG] [MAIN      ] NEM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:03.144133] [INFO ] [MAIN      ] NEE: Generated 139 derivative records from 54097 primary records.
[2025-10-24T01:26:03.144568] [DEBUG] [MAIN      ] NET: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:03.146125] [DEBUG] [LOCAL     ] NEE: Saving derivative data.
[2025-10-24T01:26:03.175214] [DEBUG] [LOCAL     ] NEE: Derivative data saved (139 records).
[2025-10-24T01:26:03.176860] [INFO ] [MAIN      ] NEE: Successfully saved derivative data.
[2025-10-24T01:26:03.180594] [INFO ] [MAIN      ] Derivative Progress: 1339/2164 symbols completed. NEE took 1.3s. Estimated remaining: 5m 46s. Rate: 142.9 symbols/min
[2025-10-24T01:26:03.183546] [INFO ] [MAIN      ] NEU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:03.195477] [INFO ] [MAIN      ] NEM: Generated 139 derivative records from 54098 primary records.
[2025-10-24T01:26:03.196270] [DEBUG] [LOCAL     ] NEM: Saving derivative data.
[2025-10-24T01:26:03.219133] [DEBUG] [LOCAL     ] NEU: Loaded 8671 existing records from primary storage.
[2025-10-24T01:26:03.221152] [INFO ] [MAIN      ] NEU: Loaded 8671 primary data records.
[2025-10-24T01:26:03.233106] [DEBUG] [LOCAL     ] NEM: Derivative data saved (139 records).
[2025-10-24T01:26:03.279166] [INFO ] [MAIN      ] NEM: Successfully saved derivative data.
[2025-10-24T01:26:03.306234] [INFO ] [MAIN      ] Derivative Progress: 1340/2164 symbols completed. NEM took 1.4s. Estimated remaining: 5m 46s. Rate: 143.0 symbols/min
[2025-10-24T01:26:03.335859] [INFO ] [MAIN      ] NEXA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:03.380959] [INFO ] [MAIN      ] NET: Generated 139 derivative records from 53162 primary records.
[2025-10-24T01:26:03.529001] [DEBUG] [LOCAL     ] NET: Saving derivative data.
[2025-10-24T01:26:03.542601] [DEBUG] [LOCAL     ] NEXA: Loaded 5766 existing records from primary storage.
[2025-10-24T01:26:03.543291] [INFO ] [MAIN      ] NEXA: Loaded 5766 primary data records.
[2025-10-24T01:26:03.578870] [DEBUG] [LOCAL     ] NET: Derivative data saved (139 records).
[2025-10-24T01:26:03.616479] [INFO ] [MAIN      ] NET: Successfully saved derivative data.
[2025-10-24T01:26:03.646883] [INFO ] [MAIN      ] Derivative Progress: 1341/2164 symbols completed. NET took 1.8s. Estimated remaining: 5m 45s. Rate: 143.0 symbols/min
[2025-10-24T01:26:03.671751] [INFO ] [MAIN      ] NFG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:03.887711] [DEBUG] [MAIN      ] NEU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:03.941736] [DEBUG] [LOCAL     ] NFG: Loaded 38484 existing records from primary storage.
[2025-10-24T01:26:03.944939] [INFO ] [MAIN      ] NFG: Loaded 38484 primary data records.
[2025-10-24T01:26:03.974824] [DEBUG] [MAIN      ] NEXA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:04.062120] [INFO ] [MAIN      ] NEU: Generated 139 derivative records from 8671 primary records.
[2025-10-24T01:26:04.092589] [DEBUG] [LOCAL     ] NEU: Saving derivative data.
[2025-10-24T01:26:04.126628] [DEBUG] [LOCAL     ] NEU: Derivative data saved (139 records).
[2025-10-24T01:26:04.188358] [INFO ] [MAIN      ] NEU: Successfully saved derivative data.
[2025-10-24T01:26:04.299617] [INFO ] [MAIN      ] Derivative Progress: 1342/2164 symbols completed. NEU took 1.1s. Estimated remaining: 5m 45s. Rate: 143.0 symbols/min
[2025-10-24T01:26:04.313707] [INFO ] [MAIN      ] NFJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:04.331162] [INFO ] [MAIN      ] NEXA: Generated 139 derivative records from 5766 primary records.
[2025-10-24T01:26:04.336951] [DEBUG] [LOCAL     ] NEXA: Saving derivative data.
[2025-10-24T01:26:04.349310] [DEBUG] [LOCAL     ] NEXA: Derivative data saved (139 records).
[2025-10-24T01:26:04.349669] [INFO ] [MAIN      ] NEXA: Successfully saved derivative data.
[2025-10-24T01:26:04.352380] [INFO ] [MAIN      ] Derivative Progress: 1343/2164 symbols completed. NEXA took 1.0s. Estimated remaining: 5m 44s. Rate: 143.0 symbols/min
[2025-10-24T01:26:04.352717] [INFO ] [MAIN      ] NGG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:04.363495] [DEBUG] [LOCAL     ] NFJ: Loaded 19799 existing records from primary storage.
[2025-10-24T01:26:04.363837] [INFO ] [MAIN      ] NFJ: Loaded 19799 primary data records.
[2025-10-24T01:26:04.529613] [DEBUG] [MAIN      ] NFG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:04.730950] [DEBUG] [LOCAL     ] NGG: Loaded 47110 existing records from primary storage.
[2025-10-24T01:26:04.732969] [INFO ] [MAIN      ] NGG: Loaded 47110 primary data records.
[2025-10-24T01:26:05.113535] [DEBUG] [MAIN      ] NFJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:05.115877] [INFO ] [MAIN      ] NFG: Generated 139 derivative records from 38484 primary records.
[2025-10-24T01:26:05.127931] [DEBUG] [LOCAL     ] NFG: Saving derivative data.
[2025-10-24T01:26:05.144869] [DEBUG] [LOCAL     ] NFG: Derivative data saved (139 records).
[2025-10-24T01:26:05.147962] [INFO ] [MAIN      ] NFG: Successfully saved derivative data.
[2025-10-24T01:26:05.152039] [INFO ] [MAIN      ] Derivative Progress: 1344/2164 symbols completed. NFG took 1.5s. Estimated remaining: 5m 44s. Rate: 143.0 symbols/min
[2025-10-24T01:26:05.152234] [INFO ] [MAIN      ] NGL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:05.177971] [DEBUG] [MAIN      ] NGG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:05.208206] [INFO ] [MAIN      ] NFJ: Generated 139 derivative records from 19799 primary records.
[2025-10-24T01:26:05.211036] [DEBUG] [LOCAL     ] NFJ: Saving derivative data.
[2025-10-24T01:26:05.241925] [DEBUG] [LOCAL     ] NGL: Loaded 30035 existing records from primary storage.
[2025-10-24T01:26:05.240833] [DEBUG] [LOCAL     ] NFJ: Derivative data saved (139 records).
[2025-10-24T01:26:05.242122] [INFO ] [MAIN      ] NGL: Loaded 30035 primary data records.
[2025-10-24T01:26:05.242439] [INFO ] [MAIN      ] NFJ: Successfully saved derivative data.
[2025-10-24T01:26:05.267727] [INFO ] [MAIN      ] Derivative Progress: 1345/2164 symbols completed. NFJ took 1.0s. Estimated remaining: 5m 44s. Rate: 143.0 symbols/min
[2025-10-24T01:26:05.313428] [INFO ] [MAIN      ] NGS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:05.405808] [INFO ] [MAIN      ] NGG: Generated 139 derivative records from 47110 primary records.
[2025-10-24T01:26:05.553750] [DEBUG] [LOCAL     ] NGG: Saving derivative data.
[2025-10-24T01:26:05.555377] [DEBUG] [LOCAL     ] NGS: Loaded 10918 existing records from primary storage.
[2025-10-24T01:26:05.555887] [INFO ] [MAIN      ] NGS: Loaded 10918 primary data records.
[2025-10-24T01:26:05.634881] [DEBUG] [LOCAL     ] NGG: Derivative data saved (139 records).
[2025-10-24T01:26:05.652705] [INFO ] [MAIN      ] NGG: Successfully saved derivative data.
[2025-10-24T01:26:05.677571] [INFO ] [MAIN      ] Derivative Progress: 1346/2164 symbols completed. NGG took 1.3s. Estimated remaining: 5m 43s. Rate: 143.0 symbols/min
[2025-10-24T01:26:05.699340] [INFO ] [MAIN      ] NGVC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:05.896802] [DEBUG] [MAIN      ] NGL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:05.918585] [DEBUG] [LOCAL     ] NGVC: Loaded 22904 existing records from primary storage.
[2025-10-24T01:26:05.920380] [INFO ] [MAIN      ] NGVC: Loaded 22904 primary data records.
[2025-10-24T01:26:06.108061] [DEBUG] [MAIN      ] NGS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:26:06.275053] [INFO ] [MAIN      ] NGL: Generated 139 derivative records from 30035 primary records.
[2025-10-24T01:26:06.279949] [DEBUG] [LOCAL     ] NGL: Saving derivative data.
[2025-10-24T01:26:06.297925] [DEBUG] [LOCAL     ] NGL: Derivative data saved (139 records).
[2025-10-24T01:26:06.298565] [INFO ] [MAIN      ] NGL: Successfully saved derivative data.
[2025-10-24T01:26:06.301212] [INFO ] [MAIN      ] Derivative Progress: 1347/2164 symbols completed. NGL took 1.1s. Estimated remaining: 5m 43s. Rate: 143.0 symbols/min
[2025-10-24T01:26:06.301841] [INFO ] [MAIN      ] NGVT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:06.312164] [INFO ] [MAIN      ] NGS: Generated 139 derivative records from 10918 primary records.
[2025-10-24T01:26:06.314062] [DEBUG] [LOCAL     ] NGS: Saving derivative data.
[2025-10-24T01:26:06.345041] [DEBUG] [LOCAL     ] NGS: Derivative data saved (139 records).
[2025-10-24T01:26:06.345886] [DEBUG] [MAIN      ] NGVC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:06.346082] [INFO ] [MAIN      ] NGS: Successfully saved derivative data.
[2025-10-24T01:26:06.368119] [INFO ] [MAIN      ] Derivative Progress: 1348/2164 symbols completed. NGS took 1.1s. Estimated remaining: 5m 42s. Rate: 143.1 symbols/min
[2025-10-24T01:26:06.371718] [DEBUG] [LOCAL     ] NGVT: Loaded 23895 existing records from primary storage.
[2025-10-24T01:26:06.371990] [INFO ] [MAIN      ] NGVT: Loaded 23895 primary data records.
[2025-10-24T01:26:06.682535] [INFO ] [MAIN      ] NGVC: Generated 139 derivative records from 22904 primary records.
[2025-10-24T01:26:06.682743] [DEBUG] [LOCAL     ] NGVC: Saving derivative data.
[2025-10-24T01:26:06.697329] [DEBUG] [LOCAL     ] NGVC: Derivative data saved (139 records).
[2025-10-24T01:26:06.697888] [INFO ] [MAIN      ] NGVC: Successfully saved derivative data.
[2025-10-24T01:26:06.700621] [INFO ] [MAIN      ] Derivative Progress: 1349/2164 symbols completed. NGVC took 1.0s. Estimated remaining: 5m 42s. Rate: 143.1 symbols/min
[2025-10-24T01:26:06.719868] [DEBUG] [MAIN      ] NGVT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:06.744632] [INFO ] [MAIN      ] NGVT: Generated 139 derivative records from 23895 primary records.
[2025-10-24T01:26:06.744806] [DEBUG] [LOCAL     ] NGVT: Saving derivative data.
[2025-10-24T01:26:06.756422] [DEBUG] [LOCAL     ] NGVT: Derivative data saved (139 records).
[2025-10-24T01:26:06.756510] [INFO ] [MAIN      ] NGVT: Successfully saved derivative data.
[2025-10-24T01:26:06.759074] [INFO ] [MAIN      ] Derivative Progress: 1350/2164 symbols completed. NGVT took 0.5s. Estimated remaining: 5m 41s. Rate: 143.2 symbols/min
[2025-10-24T01:26:06.759663] [INFO ] [MAIN      ] NIC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:06.759776] [INFO ] [MAIN      ] NHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:06.759554] [INFO ] [MAIN      ] NI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:06.774368] [DEBUG] [LOCAL     ] NIC: Loaded 8934 existing records from primary storage.
[2025-10-24T01:26:06.774558] [INFO ] [MAIN      ] NIC: Loaded 8934 primary data records.
[2025-10-24T01:26:06.878579] [DEBUG] [LOCAL     ] NHI: Loaded 21978 existing records from primary storage.
[2025-10-24T01:26:06.889265] [INFO ] [MAIN      ] NHI: Loaded 21978 primary data records.
[2025-10-24T01:26:07.285274] [DEBUG] [LOCAL     ] NI: Loaded 53798 existing records from primary storage.
[2025-10-24T01:26:07.317712] [INFO ] [MAIN      ] NI: Loaded 53798 primary data records.
[2025-10-24T01:26:07.820233] [DEBUG] [MAIN      ] NIC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:07.857159] [DEBUG] [MAIN      ] NHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:07.902154] [DEBUG] [MAIN      ] NI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:07.951138] [INFO ] [MAIN      ] NIC: Generated 139 derivative records from 8934 primary records.
[2025-10-24T01:26:07.953260] [DEBUG] [LOCAL     ] NIC: Saving derivative data.
[2025-10-24T01:26:07.972818] [DEBUG] [LOCAL     ] NIC: Derivative data saved (139 records).
[2025-10-24T01:26:07.974811] [INFO ] [MAIN      ] NIC: Successfully saved derivative data.
[2025-10-24T01:26:07.978509] [INFO ] [MAIN      ] Derivative Progress: 1351/2164 symbols completed. NIC took 1.2s. Estimated remaining: 5m 41s. Rate: 143.0 symbols/min
[2025-10-24T01:26:07.975033] [INFO ] [MAIN      ] NHI: Generated 139 derivative records from 21978 primary records.
[2025-10-24T01:26:07.979095] [DEBUG] [LOCAL     ] NHI: Saving derivative data.
[2025-10-24T01:26:07.978976] [INFO ] [MAIN      ] NIE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:07.991214] [INFO ] [MAIN      ] NI: Generated 139 derivative records from 53798 primary records.
[2025-10-24T01:26:07.992928] [DEBUG] [LOCAL     ] NI: Saving derivative data.
[2025-10-24T01:26:07.994583] [DEBUG] [LOCAL     ] NHI: Derivative data saved (139 records).
[2025-10-24T01:26:07.994711] [INFO ] [MAIN      ] NHI: Successfully saved derivative data.
[2025-10-24T01:26:08.004677] [INFO ] [MAIN      ] Derivative Progress: 1352/2164 symbols completed. NHI took 1.2s. Estimated remaining: 5m 41s. Rate: 143.1 symbols/min
[2025-10-24T01:26:08.005014] [INFO ] [MAIN      ] NIM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:08.010167] [DEBUG] [LOCAL     ] NI: Derivative data saved (139 records).
[2025-10-24T01:26:08.012944] [INFO ] [MAIN      ] NI: Successfully saved derivative data.
[2025-10-24T01:26:08.016161] [INFO ] [MAIN      ] Derivative Progress: 1353/2164 symbols completed. NI took 1.3s. Estimated remaining: 5m 40s. Rate: 143.2 symbols/min
[2025-10-24T01:26:08.017554] [INFO ] [MAIN      ] NINE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:08.026084] [DEBUG] [LOCAL     ] NIM: Loaded 3546 existing records from primary storage.
[2025-10-24T01:26:08.027102] [DEBUG] [LOCAL     ] NIE: Loaded 11861 existing records from primary storage.
[2025-10-24T01:26:08.027396] [INFO ] [MAIN      ] NIE: Loaded 11861 primary data records.
[2025-10-24T01:26:08.027472] [INFO ] [MAIN      ] NIM: Loaded 3546 primary data records.
[2025-10-24T01:26:08.353454] [DEBUG] [LOCAL     ] NINE: Loaded 29054 existing records from primary storage.
[2025-10-24T01:26:08.364123] [INFO ] [MAIN      ] NINE: Loaded 29054 primary data records.
[2025-10-24T01:26:09.031923] [DEBUG] [MAIN      ] NIM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:09.071589] [DEBUG] [MAIN      ] NIE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:09.127701] [DEBUG] [MAIN      ] NINE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:09.145840] [INFO ] [MAIN      ] NIM: Generated 139 derivative records from 3546 primary records.
[2025-10-24T01:26:09.149743] [DEBUG] [LOCAL     ] NIM: Saving derivative data.
[2025-10-24T01:26:09.171766] [DEBUG] [LOCAL     ] NIM: Derivative data saved (139 records).
[2025-10-24T01:26:09.173782] [INFO ] [MAIN      ] NIM: Successfully saved derivative data.
[2025-10-24T01:26:09.177936] [INFO ] [MAIN      ] Derivative Progress: 1354/2164 symbols completed. NIM took 1.2s. Estimated remaining: 5m 40s. Rate: 143.0 symbols/min
[2025-10-24T01:26:09.181632] [INFO ] [MAIN      ] NIO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:09.185679] [INFO ] [MAIN      ] NIE: Generated 139 derivative records from 11861 primary records.
[2025-10-24T01:26:09.186333] [DEBUG] [LOCAL     ] NIE: Saving derivative data.
[2025-10-24T01:26:09.202916] [DEBUG] [LOCAL     ] NIE: Derivative data saved (139 records).
[2025-10-24T01:26:09.203349] [INFO ] [MAIN      ] NIE: Successfully saved derivative data.
[2025-10-24T01:26:09.209828] [INFO ] [MAIN      ] Derivative Progress: 1355/2164 symbols completed. NIE took 1.2s. Estimated remaining: 5m 39s. Rate: 143.1 symbols/min
[2025-10-24T01:26:09.210092] [INFO ] [MAIN      ] NJR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:09.213520] [INFO ] [MAIN      ] NINE: Generated 139 derivative records from 29054 primary records.
[2025-10-24T01:26:09.215135] [DEBUG] [LOCAL     ] NINE: Saving derivative data.
[2025-10-24T01:26:09.227979] [DEBUG] [LOCAL     ] NINE: Derivative data saved (139 records).
[2025-10-24T01:26:09.228303] [INFO ] [MAIN      ] NINE: Successfully saved derivative data.
[2025-10-24T01:26:09.231143] [INFO ] [MAIN      ] Derivative Progress: 1356/2164 symbols completed. NINE took 1.2s. Estimated remaining: 5m 39s. Rate: 143.2 symbols/min
[2025-10-24T01:26:09.231470] [INFO ] [MAIN      ] NKX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:09.274578] [DEBUG] [LOCAL     ] NKX: Loaded 13725 existing records from primary storage.
[2025-10-24T01:26:09.275066] [INFO ] [MAIN      ] NKX: Loaded 13725 primary data records.
[2025-10-24T01:26:09.346911] [DEBUG] [LOCAL     ] NIO: Loaded 54192 existing records from primary storage.
[2025-10-24T01:26:09.366030] [INFO ] [MAIN      ] NIO: Loaded 54192 primary data records.
[2025-10-24T01:26:09.518800] [DEBUG] [LOCAL     ] NJR: Loaded 38100 existing records from primary storage.
[2025-10-24T01:26:09.758003] [INFO ] [MAIN      ] NJR: Loaded 38100 primary data records.
[2025-10-24T01:26:10.283213] [DEBUG] [MAIN      ] NKX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:10.319878] [DEBUG] [MAIN      ] NIO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:10.368292] [DEBUG] [MAIN      ] NJR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:10.406855] [INFO ] [MAIN      ] NKX: Generated 139 derivative records from 13725 primary records.
[2025-10-24T01:26:10.410259] [DEBUG] [LOCAL     ] NKX: Saving derivative data.
[2025-10-24T01:26:10.410452] [INFO ] [MAIN      ] NIO: Generated 139 derivative records from 54192 primary records.
[2025-10-24T01:26:10.425326] [DEBUG] [LOCAL     ] NKX: Derivative data saved (139 records).
[2025-10-24T01:26:10.413668] [DEBUG] [LOCAL     ] NIO: Saving derivative data.
[2025-10-24T01:26:10.425526] [INFO ] [MAIN      ] NKX: Successfully saved derivative data.
[2025-10-24T01:26:10.429419] [INFO ] [MAIN      ] Derivative Progress: 1357/2164 symbols completed. NKX took 1.2s. Estimated remaining: 5m 39s. Rate: 143.0 symbols/min
[2025-10-24T01:26:10.439751] [INFO ] [MAIN      ] NLOP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:10.441482] [DEBUG] [LOCAL     ] NIO: Derivative data saved (139 records).
[2025-10-24T01:26:10.444866] [INFO ] [MAIN      ] NIO: Successfully saved derivative data.
[2025-10-24T01:26:10.448826] [INFO ] [MAIN      ] Derivative Progress: 1358/2164 symbols completed. NIO took 1.3s. Estimated remaining: 5m 38s. Rate: 143.1 symbols/min
[2025-10-24T01:26:10.450065] [INFO ] [MAIN      ] NLY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:10.454042] [INFO ] [MAIN      ] NJR: Generated 139 derivative records from 38100 primary records.
[2025-10-24T01:26:10.454248] [DEBUG] [LOCAL     ] NJR: Saving derivative data.
[2025-10-24T01:26:10.469474] [DEBUG] [LOCAL     ] NJR: Derivative data saved (139 records).
[2025-10-24T01:26:10.469732] [INFO ] [MAIN      ] NJR: Successfully saved derivative data.
[2025-10-24T01:26:10.473124] [INFO ] [MAIN      ] Derivative Progress: 1359/2164 symbols completed. NJR took 1.3s. Estimated remaining: 5m 37s. Rate: 143.2 symbols/min
[2025-10-24T01:26:10.473442] [INFO ] [MAIN      ] NMAI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:10.479011] [DEBUG] [LOCAL     ] NLOP: Loaded 11532 existing records from primary storage.
[2025-10-24T01:26:10.479273] [INFO ] [MAIN      ] NLOP: Loaded 11532 primary data records.
[2025-10-24T01:26:10.609627] [DEBUG] [LOCAL     ] NMAI: Loaded 12639 existing records from primary storage.
[2025-10-24T01:26:10.677416] [INFO ] [MAIN      ] NMAI: Loaded 12639 primary data records.
[2025-10-24T01:26:10.929796] [DEBUG] [LOCAL     ] NLY: Loaded 53954 existing records from primary storage.
[2025-10-24T01:26:10.971339] [INFO ] [MAIN      ] NLY: Loaded 53954 primary data records.
[2025-10-24T01:26:11.462531] [DEBUG] [MAIN      ] NLOP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:11.496989] [DEBUG] [MAIN      ] NMAI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:11.558393] [INFO ] [MAIN      ] NLOP: Generated 139 derivative records from 11532 primary records.
[2025-10-24T01:26:11.558565] [DEBUG] [LOCAL     ] NLOP: Saving derivative data.
[2025-10-24T01:26:11.559952] [DEBUG] [MAIN      ] NLY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:11.589984] [DEBUG] [LOCAL     ] NLOP: Derivative data saved (139 records).
[2025-10-24T01:26:11.591502] [INFO ] [MAIN      ] NLOP: Successfully saved derivative data.
[2025-10-24T01:26:11.593829] [INFO ] [MAIN      ] Derivative Progress: 1360/2164 symbols completed. NLOP took 1.2s. Estimated remaining: 5m 37s. Rate: 143.0 symbols/min
[2025-10-24T01:26:11.595288] [INFO ] [MAIN      ] NMCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:11.608363] [INFO ] [MAIN      ] NMAI: Generated 139 derivative records from 12639 primary records.
[2025-10-24T01:26:11.612927] [DEBUG] [LOCAL     ] NMAI: Saving derivative data.
[2025-10-24T01:26:11.630695] [DEBUG] [LOCAL     ] NMCO: Loaded 16776 existing records from primary storage.
[2025-10-24T01:26:11.634061] [INFO ] [MAIN      ] NMCO: Loaded 16776 primary data records.
[2025-10-24T01:26:11.656596] [DEBUG] [LOCAL     ] NMAI: Derivative data saved (139 records).
[2025-10-24T01:26:11.671909] [INFO ] [MAIN      ] NMAI: Successfully saved derivative data.
[2025-10-24T01:26:11.701117] [INFO ] [MAIN      ] Derivative Progress: 1361/2164 symbols completed. NMAI took 1.2s. Estimated remaining: 5m 37s. Rate: 143.1 symbols/min
[2025-10-24T01:26:11.701300] [INFO ] [MAIN      ] NMG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:11.768928] [INFO ] [MAIN      ] NLY: Generated 139 derivative records from 53954 primary records.
[2025-10-24T01:26:11.799300] [DEBUG] [LOCAL     ] NLY: Saving derivative data.
[2025-10-24T01:26:11.834839] [DEBUG] [LOCAL     ] NMG: Loaded 12292 existing records from primary storage.
[2025-10-24T01:26:11.842523] [INFO ] [MAIN      ] NMG: Loaded 12292 primary data records.
[2025-10-24T01:26:11.959364] [DEBUG] [LOCAL     ] NLY: Derivative data saved (139 records).
[2025-10-24T01:26:11.990435] [INFO ] [MAIN      ] NLY: Successfully saved derivative data.
[2025-10-24T01:26:12.005484] [INFO ] [MAIN      ] Derivative Progress: 1362/2164 symbols completed. NLY took 1.6s. Estimated remaining: 5m 36s. Rate: 143.1 symbols/min
[2025-10-24T01:26:12.027270] [INFO ] [MAIN      ] NMI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:12.143293] [DEBUG] [LOCAL     ] NMI: Loaded 4059 existing records from primary storage.
[2025-10-24T01:26:12.147911] [INFO ] [MAIN      ] NMI: Loaded 4059 primary data records.
[2025-10-24T01:26:12.588048] [DEBUG] [MAIN      ] NMCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:12.627366] [DEBUG] [MAIN      ] NMG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:12.672930] [DEBUG] [MAIN      ] NMI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:12.699962] [INFO ] [MAIN      ] NMCO: Generated 139 derivative records from 16776 primary records.
[2025-10-24T01:26:12.708155] [DEBUG] [LOCAL     ] NMCO: Saving derivative data.
[2025-10-24T01:26:12.726791] [DEBUG] [LOCAL     ] NMCO: Derivative data saved (139 records).
[2025-10-24T01:26:12.729115] [INFO ] [MAIN      ] NMCO: Successfully saved derivative data.
[2025-10-24T01:26:12.731995] [INFO ] [MAIN      ] Derivative Progress: 1363/2164 symbols completed. NMCO took 1.1s. Estimated remaining: 5m 36s. Rate: 143.1 symbols/min
[2025-10-24T01:26:12.740767] [INFO ] [MAIN      ] NMG: Generated 139 derivative records from 12292 primary records.
[2025-10-24T01:26:12.742517] [DEBUG] [LOCAL     ] NMG: Saving derivative data.
[2025-10-24T01:26:12.758420] [INFO ] [MAIN      ] NMI: Generated 139 derivative records from 4059 primary records.
[2025-10-24T01:26:12.760035] [DEBUG] [LOCAL     ] NMI: Saving derivative data.
[2025-10-24T01:26:12.761315] [DEBUG] [LOCAL     ] NMG: Derivative data saved (139 records).
[2025-10-24T01:26:12.762248] [INFO ] [MAIN      ] NMG: Successfully saved derivative data.
[2025-10-24T01:26:12.766069] [INFO ] [MAIN      ] Derivative Progress: 1364/2164 symbols completed. NMG took 1.1s. Estimated remaining: 5m 35s. Rate: 143.1 symbols/min
[2025-10-24T01:26:12.776953] [DEBUG] [LOCAL     ] NMI: Derivative data saved (139 records).
[2025-10-24T01:26:12.777045] [INFO ] [MAIN      ] NMI: Successfully saved derivative data.
[2025-10-24T01:26:12.780161] [INFO ] [MAIN      ] Derivative Progress: 1365/2164 symbols completed. NMI took 0.8s. Estimated remaining: 5m 35s. Rate: 143.2 symbols/min
[2025-10-24T01:26:12.780665] [INFO ] [MAIN      ] NMS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:12.780574] [INFO ] [MAIN      ] NMM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:12.780738] [INFO ] [MAIN      ] NMR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:12.788999] [DEBUG] [LOCAL     ] NMS: Loaded 2935 existing records from primary storage.
[2025-10-24T01:26:12.789343] [INFO ] [MAIN      ] NMS: Loaded 2935 primary data records.
[2025-10-24T01:26:12.923266] [DEBUG] [LOCAL     ] NMM: Loaded 14355 existing records from primary storage.
[2025-10-24T01:26:12.939603] [INFO ] [MAIN      ] NMM: Loaded 14355 primary data records.
[2025-10-24T01:26:13.228277] [DEBUG] [LOCAL     ] NMR: Loaded 35672 existing records from primary storage.
[2025-10-24T01:26:13.244701] [INFO ] [MAIN      ] NMR: Loaded 35672 primary data records.
[2025-10-24T01:26:13.757727] [DEBUG] [MAIN      ] NMS: Filtered 6966 bins outside market hours, 7762 incomplete bins
[2025-10-24T01:26:13.795029] [DEBUG] [MAIN      ] NMM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:13.847548] [INFO ] [MAIN      ] NMS: Generated 139 derivative records from 2935 primary records.
[2025-10-24T01:26:13.844517] [DEBUG] [MAIN      ] NMR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:13.847975] [DEBUG] [LOCAL     ] NMS: Saving derivative data.
[2025-10-24T01:26:13.878075] [DEBUG] [LOCAL     ] NMS: Derivative data saved (139 records).
[2025-10-24T01:26:13.879352] [INFO ] [MAIN      ] NMS: Successfully saved derivative data.
[2025-10-24T01:26:13.884014] [INFO ] [MAIN      ] Derivative Progress: 1366/2164 symbols completed. NMS took 1.1s. Estimated remaining: 5m 35s. Rate: 143.1 symbols/min
[2025-10-24T01:26:13.884292] [INFO ] [MAIN      ] NMT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:13.899594] [INFO ] [MAIN      ] NMM: Generated 139 derivative records from 14355 primary records.
[2025-10-24T01:26:13.902247] [DEBUG] [LOCAL     ] NMT: Loaded 2826 existing records from primary storage.
[2025-10-24T01:26:13.902328] [DEBUG] [LOCAL     ] NMM: Saving derivative data.
[2025-10-24T01:26:13.902503] [INFO ] [MAIN      ] NMT: Loaded 2826 primary data records.
[2025-10-24T01:26:13.961316] [DEBUG] [LOCAL     ] NMM: Derivative data saved (139 records).
[2025-10-24T01:26:13.975871] [INFO ] [MAIN      ] NMM: Successfully saved derivative data.
[2025-10-24T01:26:13.998259] [INFO ] [MAIN      ] Derivative Progress: 1367/2164 symbols completed. NMM took 1.2s. Estimated remaining: 5m 34s. Rate: 143.2 symbols/min
[2025-10-24T01:26:14.008922] [INFO ] [MAIN      ] NMZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:14.104276] [INFO ] [MAIN      ] NMR: Generated 139 derivative records from 35672 primary records.
[2025-10-24T01:26:14.226611] [DEBUG] [LOCAL     ] NMR: Saving derivative data.
[2025-10-24T01:26:14.241184] [DEBUG] [LOCAL     ] NMR: Derivative data saved (139 records).
[2025-10-24T01:26:14.242680] [INFO ] [MAIN      ] NMR: Successfully saved derivative data.
[2025-10-24T01:26:14.250011] [DEBUG] [LOCAL     ] NMZ: Loaded 21507 existing records from primary storage.
[2025-10-24T01:26:14.253169] [INFO ] [MAIN      ] Derivative Progress: 1368/2164 symbols completed. NMR took 1.5s. Estimated remaining: 5m 34s. Rate: 143.2 symbols/min
[2025-10-24T01:26:14.253293] [INFO ] [MAIN      ] NMZ: Loaded 21507 primary data records.
[2025-10-24T01:26:14.253954] [INFO ] [MAIN      ] NNI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:14.382997] [DEBUG] [LOCAL     ] NNI: Loaded 10530 existing records from primary storage.
[2025-10-24T01:26:14.420428] [INFO ] [MAIN      ] NNI: Loaded 10530 primary data records.
[2025-10-24T01:26:14.695199] [DEBUG] [MAIN      ] NMT: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:26:14.990467] [INFO ] [MAIN      ] NMT: Generated 139 derivative records from 2826 primary records.
[2025-10-24T01:26:14.988290] [DEBUG] [MAIN      ] NMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:14.990696] [DEBUG] [LOCAL     ] NMT: Saving derivative data.
[2025-10-24T01:26:15.014811] [DEBUG] [LOCAL     ] NMT: Derivative data saved (139 records).
[2025-10-24T01:26:15.015296] [INFO ] [MAIN      ] NMT: Successfully saved derivative data.
[2025-10-24T01:26:15.017954] [INFO ] [MAIN      ] Derivative Progress: 1369/2164 symbols completed. NMT took 1.1s. Estimated remaining: 5m 33s. Rate: 143.1 symbols/min
[2025-10-24T01:26:15.019967] [INFO ] [MAIN      ] NNN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:15.043003] [DEBUG] [MAIN      ] NNI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:15.086459] [INFO ] [MAIN      ] NMZ: Generated 139 derivative records from 21507 primary records.
[2025-10-24T01:26:15.088601] [DEBUG] [LOCAL     ] NMZ: Saving derivative data.
[2025-10-24T01:26:15.116910] [DEBUG] [LOCAL     ] NMZ: Derivative data saved (139 records).
[2025-10-24T01:26:15.117885] [DEBUG] [LOCAL     ] NNN: Loaded 48512 existing records from primary storage.
[2025-10-24T01:26:15.118685] [INFO ] [MAIN      ] NMZ: Successfully saved derivative data.
[2025-10-24T01:26:15.123042] [INFO ] [MAIN      ] Derivative Progress: 1370/2164 symbols completed. NMZ took 1.1s. Estimated remaining: 5m 33s. Rate: 143.2 symbols/min
[2025-10-24T01:26:15.119417] [INFO ] [MAIN      ] NNN: Loaded 48512 primary data records.
[2025-10-24T01:26:15.126556] [INFO ] [MAIN      ] NNY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:15.166731] [INFO ] [MAIN      ] NNI: Generated 139 derivative records from 10530 primary records.
[2025-10-24T01:26:15.202616] [DEBUG] [LOCAL     ] NNI: Saving derivative data.
[2025-10-24T01:26:15.240522] [DEBUG] [LOCAL     ] NNY: Loaded 5814 existing records from primary storage.
[2025-10-24T01:26:15.257403] [DEBUG] [LOCAL     ] NNI: Derivative data saved (139 records).
[2025-10-24T01:26:15.257491] [INFO ] [MAIN      ] NNY: Loaded 5814 primary data records.
[2025-10-24T01:26:15.267913] [INFO ] [MAIN      ] NNI: Successfully saved derivative data.
[2025-10-24T01:26:15.345490] [INFO ] [MAIN      ] Derivative Progress: 1371/2164 symbols completed. NNI took 1.1s. Estimated remaining: 5m 32s. Rate: 143.2 symbols/min
[2025-10-24T01:26:15.497465] [INFO ] [MAIN      ] NOA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:15.764831] [DEBUG] [LOCAL     ] NOA: Loaded 15889 existing records from primary storage.
[2025-10-24T01:26:15.766284] [INFO ] [MAIN      ] NOA: Loaded 15889 primary data records.
[2025-10-24T01:26:15.973315] [DEBUG] [MAIN      ] NNN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:16.133131] [DEBUG] [MAIN      ] NNY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:16.189910] [INFO ] [MAIN      ] NNN: Generated 139 derivative records from 48512 primary records.
[2025-10-24T01:26:16.207715] [DEBUG] [LOCAL     ] NNN: Saving derivative data.
[2025-10-24T01:26:16.207059] [DEBUG] [MAIN      ] NOA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:16.233107] [DEBUG] [LOCAL     ] NNN: Derivative data saved (139 records).
[2025-10-24T01:26:16.240954] [INFO ] [MAIN      ] NNN: Successfully saved derivative data.
[2025-10-24T01:26:16.245451] [INFO ] [MAIN      ] Derivative Progress: 1372/2164 symbols completed. NNN took 1.2s. Estimated remaining: 5m 32s. Rate: 143.1 symbols/min
[2025-10-24T01:26:16.247306] [INFO ] [MAIN      ] NOAH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:16.252406] [INFO ] [MAIN      ] NNY: Generated 139 derivative records from 5814 primary records.
[2025-10-24T01:26:16.255250] [DEBUG] [LOCAL     ] NNY: Saving derivative data.
[2025-10-24T01:26:16.283290] [DEBUG] [LOCAL     ] NNY: Derivative data saved (139 records).
[2025-10-24T01:26:16.285866] [INFO ] [MAIN      ] NNY: Successfully saved derivative data.
[2025-10-24T01:26:16.288756] [INFO ] [MAIN      ] Derivative Progress: 1373/2164 symbols completed. NNY took 1.2s. Estimated remaining: 5m 31s. Rate: 143.2 symbols/min
[2025-10-24T01:26:16.300717] [INFO ] [MAIN      ] NOC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:16.301390] [DEBUG] [LOCAL     ] NOAH: Loaded 19894 existing records from primary storage.
[2025-10-24T01:26:16.301829] [INFO ] [MAIN      ] NOAH: Loaded 19894 primary data records.
[2025-10-24T01:26:16.372947] [INFO ] [MAIN      ] NOA: Generated 139 derivative records from 15889 primary records.
[2025-10-24T01:26:16.397156] [DEBUG] [LOCAL     ] NOA: Saving derivative data.
[2025-10-24T01:26:16.453519] [DEBUG] [LOCAL     ] NOA: Derivative data saved (139 records).
[2025-10-24T01:26:16.485679] [INFO ] [MAIN      ] NOA: Successfully saved derivative data.
[2025-10-24T01:26:16.631939] [INFO ] [MAIN      ] Derivative Progress: 1374/2164 symbols completed. NOA took 1.1s. Estimated remaining: 5m 31s. Rate: 143.2 symbols/min
[2025-10-24T01:26:16.632725] [INFO ] [MAIN      ] NOG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:16.653634] [DEBUG] [LOCAL     ] NOC: Loaded 41909 existing records from primary storage.
[2025-10-24T01:26:16.654007] [INFO ] [MAIN      ] NOC: Loaded 41909 primary data records.
[2025-10-24T01:26:17.011597] [DEBUG] [LOCAL     ] NOG: Loaded 51729 existing records from primary storage.
[2025-10-24T01:26:17.012770] [DEBUG] [MAIN      ] NOAH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:17.012873] [INFO ] [MAIN      ] NOG: Loaded 51729 primary data records.
[2025-10-24T01:26:17.405129] [DEBUG] [MAIN      ] NOC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:17.429738] [INFO ] [MAIN      ] NOAH: Generated 139 derivative records from 19894 primary records.
[2025-10-24T01:26:17.431421] [DEBUG] [LOCAL     ] NOAH: Saving derivative data.
[2025-10-24T01:26:17.449745] [DEBUG] [LOCAL     ] NOAH: Derivative data saved (139 records).
[2025-10-24T01:26:17.449902] [INFO ] [MAIN      ] NOAH: Successfully saved derivative data.
[2025-10-24T01:26:17.455194] [INFO ] [MAIN      ] Derivative Progress: 1375/2164 symbols completed. NOAH took 1.2s. Estimated remaining: 5m 31s. Rate: 143.1 symbols/min
[2025-10-24T01:26:17.456500] [INFO ] [MAIN      ] NOK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:17.476326] [DEBUG] [MAIN      ] NOG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:17.507394] [INFO ] [MAIN      ] NOC: Generated 139 derivative records from 41909 primary records.
[2025-10-24T01:26:17.507922] [DEBUG] [LOCAL     ] NOC: Saving derivative data.
[2025-10-24T01:26:17.523913] [DEBUG] [LOCAL     ] NOC: Derivative data saved (139 records).
[2025-10-24T01:26:17.524802] [INFO ] [MAIN      ] NOC: Successfully saved derivative data.
[2025-10-24T01:26:17.541719] [INFO ] [MAIN      ] Derivative Progress: 1376/2164 symbols completed. NOC took 1.2s. Estimated remaining: 5m 30s. Rate: 143.2 symbols/min
[2025-10-24T01:26:17.545194] [INFO ] [MAIN      ] NOMD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:17.570164] [INFO ] [MAIN      ] NOG: Generated 139 derivative records from 51729 primary records.
[2025-10-24T01:26:17.569754] [DEBUG] [LOCAL     ] NOK: Loaded 54012 existing records from primary storage.
[2025-10-24T01:26:17.570359] [INFO ] [MAIN      ] NOK: Loaded 54012 primary data records.
[2025-10-24T01:26:17.570422] [DEBUG] [LOCAL     ] NOG: Saving derivative data.
[2025-10-24T01:26:17.653067] [DEBUG] [LOCAL     ] NOG: Derivative data saved (139 records).
[2025-10-24T01:26:17.653466] [INFO ] [MAIN      ] NOG: Successfully saved derivative data.
[2025-10-24T01:26:17.669152] [INFO ] [MAIN      ] Derivative Progress: 1377/2164 symbols completed. NOG took 1.0s. Estimated remaining: 5m 30s. Rate: 143.3 symbols/min
[2025-10-24T01:26:17.707815] [INFO ] [MAIN      ] NOTE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:17.802122] [DEBUG] [LOCAL     ] NOMD: Loaded 43545 existing records from primary storage.
[2025-10-24T01:26:17.916183] [INFO ] [MAIN      ] NOMD: Loaded 43545 primary data records.
[2025-10-24T01:26:18.243494] [DEBUG] [LOCAL     ] NOTE: Loaded 39696 existing records from primary storage.
[2025-10-24T01:26:18.244667] [INFO ] [MAIN      ] NOTE: Loaded 39696 primary data records.
[2025-10-24T01:26:18.452297] [DEBUG] [MAIN      ] NOK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:18.623855] [DEBUG] [MAIN      ] NOMD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:18.650741] [INFO ] [MAIN      ] NOK: Generated 139 derivative records from 54012 primary records.
[2025-10-24T01:26:18.652108] [DEBUG] [LOCAL     ] NOK: Saving derivative data.
[2025-10-24T01:26:18.668364] [DEBUG] [LOCAL     ] NOK: Derivative data saved (139 records).
[2025-10-24T01:26:18.669833] [INFO ] [MAIN      ] NOK: Successfully saved derivative data.
[2025-10-24T01:26:18.673407] [INFO ] [MAIN      ] Derivative Progress: 1378/2164 symbols completed. NOK took 1.2s. Estimated remaining: 5m 29s. Rate: 143.1 symbols/min
[2025-10-24T01:26:18.689450] [DEBUG] [MAIN      ] NOTE: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:26:18.710288] [INFO ] [MAIN      ] NOMD: Generated 139 derivative records from 43545 primary records.
[2025-10-24T01:26:18.712562] [DEBUG] [LOCAL     ] NOMD: Saving derivative data.
[2025-10-24T01:26:18.725893] [DEBUG] [LOCAL     ] NOMD: Derivative data saved (139 records).
[2025-10-24T01:26:18.726171] [INFO ] [MAIN      ] NOMD: Successfully saved derivative data.
[2025-10-24T01:26:18.731144] [INFO ] [MAIN      ] Derivative Progress: 1379/2164 symbols completed. NOMD took 1.2s. Estimated remaining: 5m 29s. Rate: 143.2 symbols/min
[2025-10-24T01:26:18.739165] [INFO ] [MAIN      ] NOTE: Generated 139 derivative records from 39696 primary records.
[2025-10-24T01:26:18.739261] [DEBUG] [LOCAL     ] NOTE: Saving derivative data.
[2025-10-24T01:26:18.749599] [DEBUG] [LOCAL     ] NOTE: Derivative data saved (139 records).
[2025-10-24T01:26:18.749699] [INFO ] [MAIN      ] NOTE: Successfully saved derivative data.
[2025-10-24T01:26:18.752370] [INFO ] [MAIN      ] Derivative Progress: 1380/2164 symbols completed. NOTE took 1.0s. Estimated remaining: 5m 28s. Rate: 143.3 symbols/min
[2025-10-24T01:26:18.752788] [INFO ] [MAIN      ] NOV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:18.752931] [INFO ] [MAIN      ] NPCT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:18.752865] [INFO ] [MAIN      ] NOW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:18.777420] [DEBUG] [LOCAL     ] NPCT: Loaded 16524 existing records from primary storage.
[2025-10-24T01:26:18.777585] [INFO ] [MAIN      ] NPCT: Loaded 16524 primary data records.
[2025-10-24T01:26:19.121273] [DEBUG] [LOCAL     ] NOV: Loaded 53551 existing records from primary storage.
[2025-10-24T01:26:19.122002] [INFO ] [MAIN      ] NOV: Loaded 53551 primary data records.
[2025-10-24T01:26:19.160745] [DEBUG] [LOCAL     ] NOW: Loaded 48142 existing records from primary storage.
[2025-10-24T01:26:19.179740] [INFO ] [MAIN      ] NOW: Loaded 48142 primary data records.
[2025-10-24T01:26:19.775354] [DEBUG] [MAIN      ] NPCT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:19.833610] [DEBUG] [MAIN      ] NOW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:19.834197] [DEBUG] [MAIN      ] NOV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:19.894285] [INFO ] [MAIN      ] NPCT: Generated 139 derivative records from 16524 primary records.
[2025-10-24T01:26:19.900682] [DEBUG] [LOCAL     ] NPCT: Saving derivative data.
[2025-10-24T01:26:19.915824] [DEBUG] [LOCAL     ] NPCT: Derivative data saved (139 records).
[2025-10-24T01:26:19.916722] [INFO ] [MAIN      ] NPCT: Successfully saved derivative data.
[2025-10-24T01:26:19.925381] [INFO ] [MAIN      ] Derivative Progress: 1381/2164 symbols completed. NPCT took 1.2s. Estimated remaining: 5m 28s. Rate: 143.1 symbols/min
[2025-10-24T01:26:19.927932] [INFO ] [MAIN      ] NPFD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:19.934137] [INFO ] [MAIN      ] NOV: Generated 139 derivative records from 53551 primary records.
[2025-10-24T01:26:19.937214] [DEBUG] [LOCAL     ] NOV: Saving derivative data.
[2025-10-24T01:26:19.937148] [INFO ] [MAIN      ] NOW: Generated 139 derivative records from 48142 primary records.
[2025-10-24T01:26:19.937631] [DEBUG] [LOCAL     ] NOW: Saving derivative data.
[2025-10-24T01:26:19.966843] [DEBUG] [LOCAL     ] NOW: Derivative data saved (139 records).
[2025-10-24T01:26:19.962190] [DEBUG] [LOCAL     ] NOV: Derivative data saved (139 records).
[2025-10-24T01:26:19.967164] [INFO ] [MAIN      ] NOW: Successfully saved derivative data.
[2025-10-24T01:26:19.967359] [INFO ] [MAIN      ] NOV: Successfully saved derivative data.
[2025-10-24T01:26:19.970424] [INFO ] [MAIN      ] Derivative Progress: 1382/2164 symbols completed. NOW took 1.2s. Estimated remaining: 5m 28s. Rate: 143.2 symbols/min
[2025-10-24T01:26:19.973001] [INFO ] [MAIN      ] NPK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:19.973427] [INFO ] [MAIN      ] Derivative Progress: 1383/2164 symbols completed. NOV took 1.2s. Estimated remaining: 5m 27s. Rate: 143.3 symbols/min
[2025-10-24T01:26:19.978445] [INFO ] [MAIN      ] NPKI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:19.978807] [DEBUG] [LOCAL     ] NPFD: Loaded 10132 existing records from primary storage.
[2025-10-24T01:26:19.979392] [INFO ] [MAIN      ] NPFD: Loaded 10132 primary data records.
[2025-10-24T01:26:20.084420] [DEBUG] [LOCAL     ] NPK: Loaded 8417 existing records from primary storage.
[2025-10-24T01:26:20.088168] [INFO ] [MAIN      ] NPK: Loaded 8417 primary data records.
[2025-10-24T01:26:20.413957] [DEBUG] [LOCAL     ] NPKI: Loaded 40736 existing records from primary storage.
[2025-10-24T01:26:20.434061] [INFO ] [MAIN      ] NPKI: Loaded 40736 primary data records.
[2025-10-24T01:26:20.944753] [DEBUG] [MAIN      ] NPFD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:20.987894] [DEBUG] [MAIN      ] NPK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:21.038849] [DEBUG] [MAIN      ] NPKI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:21.059243] [INFO ] [MAIN      ] NPFD: Generated 139 derivative records from 10132 primary records.
[2025-10-24T01:26:21.059547] [DEBUG] [LOCAL     ] NPFD: Saving derivative data.
[2025-10-24T01:26:21.078077] [DEBUG] [LOCAL     ] NPFD: Derivative data saved (139 records).
[2025-10-24T01:26:21.078573] [INFO ] [MAIN      ] NPFD: Successfully saved derivative data.
[2025-10-24T01:26:21.084243] [INFO ] [MAIN      ] Derivative Progress: 1384/2164 symbols completed. NPFD took 1.2s. Estimated remaining: 5m 27s. Rate: 143.2 symbols/min
[2025-10-24T01:26:21.084613] [INFO ] [MAIN      ] NPO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:21.097876] [INFO ] [MAIN      ] NPK: Generated 139 derivative records from 8417 primary records.
[2025-10-24T01:26:21.100163] [DEBUG] [LOCAL     ] NPK: Saving derivative data.
[2025-10-24T01:26:21.120740] [DEBUG] [LOCAL     ] NPK: Derivative data saved (139 records).
[2025-10-24T01:26:21.120930] [INFO ] [MAIN      ] NPK: Successfully saved derivative data.
[2025-10-24T01:26:21.126016] [INFO ] [MAIN      ] Derivative Progress: 1385/2164 symbols completed. NPK took 1.2s. Estimated remaining: 5m 26s. Rate: 143.3 symbols/min
[2025-10-24T01:26:21.127356] [INFO ] [MAIN      ] NPV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:21.133731] [DEBUG] [LOCAL     ] NPO: Loaded 13600 existing records from primary storage.
[2025-10-24T01:26:21.135108] [INFO ] [MAIN      ] NPO: Loaded 13600 primary data records.
[2025-10-24T01:26:21.151280] [INFO ] [MAIN      ] NPKI: Generated 139 derivative records from 40736 primary records.
[2025-10-24T01:26:21.179938] [DEBUG] [LOCAL     ] NPKI: Saving derivative data.
[2025-10-24T01:26:21.232619] [DEBUG] [LOCAL     ] NPKI: Derivative data saved (139 records).
[2025-10-24T01:26:21.259827] [INFO ] [MAIN      ] NPKI: Successfully saved derivative data.
[2025-10-24T01:26:21.262751] [DEBUG] [LOCAL     ] NPV: Loaded 5400 existing records from primary storage.
[2025-10-24T01:26:21.287131] [INFO ] [MAIN      ] NPV: Loaded 5400 primary data records.
[2025-10-24T01:26:21.276695] [INFO ] [MAIN      ] Derivative Progress: 1386/2164 symbols completed. NPKI took 1.3s. Estimated remaining: 5m 26s. Rate: 143.3 symbols/min
[2025-10-24T01:26:21.319313] [INFO ] [MAIN      ] NPWR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:21.832137] [DEBUG] [LOCAL     ] NPWR: Loaded 43826 existing records from primary storage.
[2025-10-24T01:26:21.833560] [INFO ] [MAIN      ] NPWR: Loaded 43826 primary data records.
[2025-10-24T01:26:22.154118] [DEBUG] [MAIN      ] NPO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:22.195338] [DEBUG] [MAIN      ] NPV: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:26:22.254621] [INFO ] [MAIN      ] NPO: Generated 139 derivative records from 13600 primary records.
[2025-10-24T01:26:22.255088] [DEBUG] [MAIN      ] NPWR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:22.256867] [DEBUG] [LOCAL     ] NPO: Saving derivative data.
[2025-10-24T01:26:22.286918] [DEBUG] [LOCAL     ] NPO: Derivative data saved (139 records).
[2025-10-24T01:26:22.287097] [INFO ] [MAIN      ] NPO: Successfully saved derivative data.
[2025-10-24T01:26:22.290363] [INFO ] [MAIN      ] Derivative Progress: 1387/2164 symbols completed. NPO took 1.2s. Estimated remaining: 5m 26s. Rate: 143.2 symbols/min
[2025-10-24T01:26:22.292803] [INFO ] [MAIN      ] NQP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:22.304117] [INFO ] [MAIN      ] NPV: Generated 139 derivative records from 5400 primary records.
[2025-10-24T01:26:22.306404] [DEBUG] [LOCAL     ] NPV: Saving derivative data.
[2025-10-24T01:26:22.326611] [DEBUG] [LOCAL     ] NQP: Loaded 9104 existing records from primary storage.
[2025-10-24T01:26:22.329164] [DEBUG] [LOCAL     ] NPV: Derivative data saved (139 records).
[2025-10-24T01:26:22.329774] [INFO ] [MAIN      ] NQP: Loaded 9104 primary data records.
[2025-10-24T01:26:22.342373] [INFO ] [MAIN      ] NPV: Successfully saved derivative data.
[2025-10-24T01:26:22.377299] [INFO ] [MAIN      ] Derivative Progress: 1388/2164 symbols completed. NPV took 1.2s. Estimated remaining: 5m 25s. Rate: 143.3 symbols/min
[2025-10-24T01:26:22.398411] [INFO ] [MAIN      ] NRDY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:22.463831] [INFO ] [MAIN      ] NPWR: Generated 139 derivative records from 43826 primary records.
[2025-10-24T01:26:22.628885] [DEBUG] [LOCAL     ] NPWR: Saving derivative data.
[2025-10-24T01:26:22.668496] [DEBUG] [LOCAL     ] NPWR: Derivative data saved (139 records).
[2025-10-24T01:26:22.680968] [DEBUG] [LOCAL     ] NRDY: Loaded 32344 existing records from primary storage.
[2025-10-24T01:26:22.680115] [INFO ] [MAIN      ] NPWR: Successfully saved derivative data.
[2025-10-24T01:26:22.681422] [INFO ] [MAIN      ] NRDY: Loaded 32344 primary data records.
[2025-10-24T01:26:22.684543] [INFO ] [MAIN      ] Derivative Progress: 1389/2164 symbols completed. NPWR took 1.4s. Estimated remaining: 5m 25s. Rate: 143.3 symbols/min
[2025-10-24T01:26:22.706142] [INFO ] [MAIN      ] NREF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:22.821958] [DEBUG] [LOCAL     ] NREF: Loaded 7848 existing records from primary storage.
[2025-10-24T01:26:22.879940] [INFO ] [MAIN      ] NREF: Loaded 7848 primary data records.
[2025-10-24T01:26:23.122519] [DEBUG] [MAIN      ] NQP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:23.436996] [DEBUG] [MAIN      ] NRDY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:23.456070] [INFO ] [MAIN      ] NQP: Generated 139 derivative records from 9104 primary records.
[2025-10-24T01:26:23.457239] [DEBUG] [LOCAL     ] NQP: Saving derivative data.
[2025-10-24T01:26:23.477167] [DEBUG] [LOCAL     ] NQP: Derivative data saved (139 records).
[2025-10-24T01:26:23.477892] [INFO ] [MAIN      ] NQP: Successfully saved derivative data.
[2025-10-24T01:26:23.480837] [INFO ] [MAIN      ] Derivative Progress: 1390/2164 symbols completed. NQP took 1.2s. Estimated remaining: 5m 24s. Rate: 143.2 symbols/min
[2025-10-24T01:26:23.481391] [INFO ] [MAIN      ] NRG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:23.512394] [DEBUG] [MAIN      ] NREF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:23.533490] [INFO ] [MAIN      ] NRDY: Generated 139 derivative records from 32344 primary records.
[2025-10-24T01:26:23.535627] [DEBUG] [LOCAL     ] NRDY: Saving derivative data.
[2025-10-24T01:26:23.551751] [DEBUG] [LOCAL     ] NRDY: Derivative data saved (139 records).
[2025-10-24T01:26:23.552881] [INFO ] [MAIN      ] NRDY: Successfully saved derivative data.
[2025-10-24T01:26:23.558335] [INFO ] [MAIN      ] Derivative Progress: 1391/2164 symbols completed. NRDY took 1.2s. Estimated remaining: 5m 24s. Rate: 143.3 symbols/min
[2025-10-24T01:26:23.558708] [INFO ] [MAIN      ] NRGV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:23.585169] [INFO ] [MAIN      ] NREF: Generated 139 derivative records from 7848 primary records.
[2025-10-24T01:26:23.587120] [DEBUG] [LOCAL     ] NREF: Saving derivative data.
[2025-10-24T01:26:23.603066] [DEBUG] [LOCAL     ] NRG: Loaded 53197 existing records from primary storage.
[2025-10-24T01:26:23.611076] [INFO ] [MAIN      ] NRG: Loaded 53197 primary data records.
[2025-10-24T01:26:23.617190] [DEBUG] [LOCAL     ] NREF: Derivative data saved (139 records).
[2025-10-24T01:26:23.622547] [INFO ] [MAIN      ] NREF: Successfully saved derivative data.
[2025-10-24T01:26:23.625928] [INFO ] [MAIN      ] Derivative Progress: 1392/2164 symbols completed. NREF took 0.9s. Estimated remaining: 5m 23s. Rate: 143.4 symbols/min
[2025-10-24T01:26:23.642434] [INFO ] [MAIN      ] NRK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:23.762199] [DEBUG] [LOCAL     ] NRGV: Loaded 44291 existing records from primary storage.
[2025-10-24T01:26:23.783779] [INFO ] [MAIN      ] NRGV: Loaded 44291 primary data records.
[2025-10-24T01:26:24.083352] [DEBUG] [LOCAL     ] NRK: Loaded 20613 existing records from primary storage.
[2025-10-24T01:26:24.085066] [INFO ] [MAIN      ] NRK: Loaded 20613 primary data records.
[2025-10-24T01:26:24.608205] [DEBUG] [MAIN      ] NRG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:24.651817] [DEBUG] [MAIN      ] NRGV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:24.694900] [DEBUG] [MAIN      ] NRK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:24.724035] [INFO ] [MAIN      ] NRG: Generated 139 derivative records from 53197 primary records.
[2025-10-24T01:26:24.724930] [DEBUG] [LOCAL     ] NRG: Saving derivative data.
[2025-10-24T01:26:24.749671] [DEBUG] [LOCAL     ] NRG: Derivative data saved (139 records).
[2025-10-24T01:26:24.749826] [INFO ] [MAIN      ] NRG: Successfully saved derivative data.
[2025-10-24T01:26:24.754932] [INFO ] [MAIN      ] Derivative Progress: 1393/2164 symbols completed. NRG took 1.3s. Estimated remaining: 5m 23s. Rate: 143.2 symbols/min
[2025-10-24T01:26:24.760531] [INFO ] [MAIN      ] NRGV: Generated 139 derivative records from 44291 primary records.
[2025-10-24T01:26:24.763233] [DEBUG] [LOCAL     ] NRGV: Saving derivative data.
[2025-10-24T01:26:24.779236] [DEBUG] [LOCAL     ] NRGV: Derivative data saved (139 records).
[2025-10-24T01:26:24.779476] [INFO ] [MAIN      ] NRGV: Successfully saved derivative data.
[2025-10-24T01:26:24.783332] [INFO ] [MAIN      ] Derivative Progress: 1394/2164 symbols completed. NRGV took 1.2s. Estimated remaining: 5m 22s. Rate: 143.3 symbols/min
[2025-10-24T01:26:24.785598] [INFO ] [MAIN      ] NRK: Generated 139 derivative records from 20613 primary records.
[2025-10-24T01:26:24.785859] [DEBUG] [LOCAL     ] NRK: Saving derivative data.
[2025-10-24T01:26:24.801235] [DEBUG] [LOCAL     ] NRK: Derivative data saved (139 records).
[2025-10-24T01:26:24.801379] [INFO ] [MAIN      ] NRK: Successfully saved derivative data.
[2025-10-24T01:26:24.804577] [INFO ] [MAIN      ] Derivative Progress: 1395/2164 symbols completed. NRK took 1.2s. Estimated remaining: 5m 22s. Rate: 143.4 symbols/min
[2025-10-24T01:26:24.805051] [INFO ] [MAIN      ] NRP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:24.805168] [INFO ] [MAIN      ] NRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:24.805251] [INFO ] [MAIN      ] NSA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:24.817914] [DEBUG] [LOCAL     ] NRT: Loaded 4930 existing records from primary storage.
[2025-10-24T01:26:24.821562] [INFO ] [MAIN      ] NRT: Loaded 4930 primary data records.
[2025-10-24T01:26:24.821941] [DEBUG] [LOCAL     ] NRP: Loaded 4185 existing records from primary storage.
[2025-10-24T01:26:24.869270] [INFO ] [MAIN      ] NRP: Loaded 4185 primary data records.
[2025-10-24T01:26:25.493994] [DEBUG] [LOCAL     ] NSA: Loaded 45453 existing records from primary storage.
[2025-10-24T01:26:25.495132] [INFO ] [MAIN      ] NSA: Loaded 45453 primary data records.
[2025-10-24T01:26:25.874720] [DEBUG] [MAIN      ] NRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:25.875920] [DEBUG] [MAIN      ] NRP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:25.952801] [DEBUG] [MAIN      ] NSA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:25.979621] [INFO ] [MAIN      ] NRP: Generated 139 derivative records from 4185 primary records.
[2025-10-24T01:26:25.982457] [DEBUG] [LOCAL     ] NRP: Saving derivative data.
[2025-10-24T01:26:25.983398] [INFO ] [MAIN      ] NRT: Generated 139 derivative records from 4930 primary records.
[2025-10-24T01:26:25.998332] [DEBUG] [LOCAL     ] NRP: Derivative data saved (139 records).
[2025-10-24T01:26:25.995946] [DEBUG] [LOCAL     ] NRT: Saving derivative data.
[2025-10-24T01:26:25.998502] [INFO ] [MAIN      ] NRP: Successfully saved derivative data.
[2025-10-24T01:26:26.001555] [INFO ] [MAIN      ] Derivative Progress: 1396/2164 symbols completed. NRP took 1.2s. Estimated remaining: 5m 22s. Rate: 143.2 symbols/min
[2025-10-24T01:26:26.011780] [INFO ] [MAIN      ] NSC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:26.015765] [DEBUG] [LOCAL     ] NRT: Derivative data saved (139 records).
[2025-10-24T01:26:26.016457] [INFO ] [MAIN      ] NRT: Successfully saved derivative data.
[2025-10-24T01:26:26.018734] [INFO ] [MAIN      ] Derivative Progress: 1397/2164 symbols completed. NRT took 1.2s. Estimated remaining: 5m 21s. Rate: 143.3 symbols/min
[2025-10-24T01:26:26.018993] [INFO ] [MAIN      ] NSP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:26.030255] [INFO ] [MAIN      ] NSA: Generated 139 derivative records from 45453 primary records.
[2025-10-24T01:26:26.030633] [DEBUG] [LOCAL     ] NSA: Saving derivative data.
[2025-10-24T01:26:26.052933] [DEBUG] [LOCAL     ] NSA: Derivative data saved (139 records).
[2025-10-24T01:26:26.053177] [INFO ] [MAIN      ] NSA: Successfully saved derivative data.
[2025-10-24T01:26:26.055870] [INFO ] [MAIN      ] Derivative Progress: 1398/2164 symbols completed. NSA took 1.3s. Estimated remaining: 5m 21s. Rate: 143.4 symbols/min
[2025-10-24T01:26:26.056168] [INFO ] [MAIN      ] NTB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:26.082347] [DEBUG] [LOCAL     ] NSP: Loaded 36010 existing records from primary storage.
[2025-10-24T01:26:26.083947] [INFO ] [MAIN      ] NSP: Loaded 36010 primary data records.
[2025-10-24T01:26:26.171219] [DEBUG] [LOCAL     ] NSC: Loaded 49001 existing records from primary storage.
[2025-10-24T01:26:26.182750] [INFO ] [MAIN      ] NSC: Loaded 49001 primary data records.
[2025-10-24T01:26:26.333124] [DEBUG] [LOCAL     ] NTB: Loaded 20317 existing records from primary storage.
[2025-10-24T01:26:26.356413] [INFO ] [MAIN      ] NTB: Loaded 20317 primary data records.
[2025-10-24T01:26:27.071151] [DEBUG] [MAIN      ] NSP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:27.108487] [DEBUG] [MAIN      ] NSC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:27.145916] [DEBUG] [MAIN      ] NTB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:27.185733] [INFO ] [MAIN      ] NSP: Generated 139 derivative records from 36010 primary records.
[2025-10-24T01:26:27.186908] [DEBUG] [LOCAL     ] NSP: Saving derivative data.
[2025-10-24T01:26:27.208294] [DEBUG] [LOCAL     ] NSP: Derivative data saved (139 records).
[2025-10-24T01:26:27.211296] [INFO ] [MAIN      ] NSP: Successfully saved derivative data.
[2025-10-24T01:26:27.217033] [INFO ] [MAIN      ] Derivative Progress: 1399/2164 symbols completed. NSP took 1.2s. Estimated remaining: 5m 21s. Rate: 143.2 symbols/min
[2025-10-24T01:26:27.219145] [INFO ] [MAIN      ] NTR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:27.222450] [INFO ] [MAIN      ] NSC: Generated 139 derivative records from 49001 primary records.
[2025-10-24T01:26:27.223639] [DEBUG] [LOCAL     ] NSC: Saving derivative data.
[2025-10-24T01:26:27.241165] [DEBUG] [LOCAL     ] NSC: Derivative data saved (139 records).
[2025-10-24T01:26:27.242786] [INFO ] [MAIN      ] NSC: Successfully saved derivative data.
[2025-10-24T01:26:27.247146] [INFO ] [MAIN      ] Derivative Progress: 1400/2164 symbols completed. NSC took 1.2s. Estimated remaining: 5m 20s. Rate: 143.3 symbols/min
[2025-10-24T01:26:27.247640] [INFO ] [MAIN      ] NTST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:27.247484] [INFO ] [MAIN      ] NTB: Generated 139 derivative records from 20317 primary records.
[2025-10-24T01:26:27.247889] [DEBUG] [LOCAL     ] NTB: Saving derivative data.
[2025-10-24T01:26:27.260966] [DEBUG] [LOCAL     ] NTB: Derivative data saved (139 records).
[2025-10-24T01:26:27.261111] [INFO ] [MAIN      ] NTB: Successfully saved derivative data.
[2025-10-24T01:26:27.264020] [INFO ] [MAIN      ] Derivative Progress: 1401/2164 symbols completed. NTB took 1.2s. Estimated remaining: 5m 19s. Rate: 143.4 symbols/min
[2025-10-24T01:26:27.264212] [INFO ] [MAIN      ] NU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:27.315316] [DEBUG] [LOCAL     ] NTR: Loaded 53001 existing records from primary storage.
[2025-10-24T01:26:27.315991] [INFO ] [MAIN      ] NTR: Loaded 53001 primary data records.
[2025-10-24T01:26:27.475771] [DEBUG] [LOCAL     ] NTST: Loaded 44366 existing records from primary storage.
[2025-10-24T01:26:27.493190] [INFO ] [MAIN      ] NTST: Loaded 44366 primary data records.
[2025-10-24T01:26:27.518905] [DEBUG] [LOCAL     ] NU: Loaded 54136 existing records from primary storage.
[2025-10-24T01:26:27.547187] [INFO ] [MAIN      ] NU: Loaded 54136 primary data records.
[2025-10-24T01:26:28.304251] [DEBUG] [MAIN      ] NTR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:28.346739] [DEBUG] [MAIN      ] NTST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:28.376983] [DEBUG] [MAIN      ] NU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:28.408749] [INFO ] [MAIN      ] NTR: Generated 139 derivative records from 53001 primary records.
[2025-10-24T01:26:28.409324] [DEBUG] [LOCAL     ] NTR: Saving derivative data.
[2025-10-24T01:26:28.426280] [DEBUG] [LOCAL     ] NTR: Derivative data saved (139 records).
[2025-10-24T01:26:28.429008] [INFO ] [MAIN      ] NTR: Successfully saved derivative data.
[2025-10-24T01:26:28.431818] [INFO ] [MAIN      ] Derivative Progress: 1402/2164 symbols completed. NTR took 1.2s. Estimated remaining: 5m 19s. Rate: 143.2 symbols/min
[2025-10-24T01:26:28.434744] [INFO ] [MAIN      ] NUS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:28.445381] [INFO ] [MAIN      ] NTST: Generated 139 derivative records from 44366 primary records.
[2025-10-24T01:26:28.447861] [DEBUG] [LOCAL     ] NTST: Saving derivative data.
[2025-10-24T01:26:28.462451] [INFO ] [MAIN      ] NU: Generated 139 derivative records from 54136 primary records.
[2025-10-24T01:26:28.464028] [DEBUG] [LOCAL     ] NTST: Derivative data saved (139 records).
[2025-10-24T01:26:28.464135] [DEBUG] [LOCAL     ] NU: Saving derivative data.
[2025-10-24T01:26:28.464216] [INFO ] [MAIN      ] NTST: Successfully saved derivative data.
[2025-10-24T01:26:28.467357] [INFO ] [MAIN      ] Derivative Progress: 1403/2164 symbols completed. NTST took 1.2s. Estimated remaining: 5m 19s. Rate: 143.3 symbols/min
[2025-10-24T01:26:28.475413] [INFO ] [MAIN      ] NUV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:28.500158] [DEBUG] [LOCAL     ] NU: Derivative data saved (139 records).
[2025-10-24T01:26:28.500387] [INFO ] [MAIN      ] NU: Successfully saved derivative data.
[2025-10-24T01:26:28.503803] [INFO ] [MAIN      ] Derivative Progress: 1404/2164 symbols completed. NU took 1.2s. Estimated remaining: 5m 18s. Rate: 143.4 symbols/min
[2025-10-24T01:26:28.505012] [DEBUG] [LOCAL     ] NUS: Loaded 36280 existing records from primary storage.
[2025-10-24T01:26:28.505123] [INFO ] [MAIN      ] NUVB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:28.505380] [INFO ] [MAIN      ] NUS: Loaded 36280 primary data records.
[2025-10-24T01:26:28.623690] [DEBUG] [LOCAL     ] NUV: Loaded 23426 existing records from primary storage.
[2025-10-24T01:26:28.639795] [INFO ] [MAIN      ] NUV: Loaded 23426 primary data records.
[2025-10-24T01:26:28.995183] [DEBUG] [LOCAL     ] NUVB: Loaded 52098 existing records from primary storage.
[2025-10-24T01:26:29.134886] [INFO ] [MAIN      ] NUVB: Loaded 52098 primary data records.
[2025-10-24T01:26:29.498405] [DEBUG] [MAIN      ] NUS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:29.533264] [DEBUG] [MAIN      ] NUV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:29.585886] [DEBUG] [MAIN      ] NUVB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:29.587929] [INFO ] [MAIN      ] NUS: Generated 139 derivative records from 36280 primary records.
[2025-10-24T01:26:29.599439] [DEBUG] [LOCAL     ] NUS: Saving derivative data.
[2025-10-24T01:26:29.621601] [DEBUG] [LOCAL     ] NUS: Derivative data saved (139 records).
[2025-10-24T01:26:29.623904] [INFO ] [MAIN      ] NUS: Successfully saved derivative data.
[2025-10-24T01:26:29.626433] [INFO ] [MAIN      ] Derivative Progress: 1405/2164 symbols completed. NUS took 1.2s. Estimated remaining: 5m 18s. Rate: 143.2 symbols/min
[2025-10-24T01:26:29.626822] [INFO ] [MAIN      ] NUW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:29.635803] [INFO ] [MAIN      ] NUV: Generated 139 derivative records from 23426 primary records.
[2025-10-24T01:26:29.636127] [DEBUG] [LOCAL     ] NUV: Saving derivative data.
[2025-10-24T01:26:29.654149] [DEBUG] [LOCAL     ] NUV: Derivative data saved (139 records).
[2025-10-24T01:26:29.655383] [INFO ] [MAIN      ] NUV: Successfully saved derivative data.
[2025-10-24T01:26:29.662515] [INFO ] [MAIN      ] Derivative Progress: 1406/2164 symbols completed. NUV took 1.2s. Estimated remaining: 5m 17s. Rate: 143.3 symbols/min
[2025-10-24T01:26:29.659557] [DEBUG] [LOCAL     ] NUW: Loaded 6664 existing records from primary storage.
[2025-10-24T01:26:29.665302] [INFO ] [MAIN      ] NUW: Loaded 6664 primary data records.
[2025-10-24T01:26:29.665412] [INFO ] [MAIN      ] NVG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:29.740417] [INFO ] [MAIN      ] NUVB: Generated 139 derivative records from 52098 primary records.
[2025-10-24T01:26:29.740756] [DEBUG] [LOCAL     ] NUVB: Saving derivative data.
[2025-10-24T01:26:29.822201] [DEBUG] [LOCAL     ] NUVB: Derivative data saved (139 records).
[2025-10-24T01:26:29.847609] [INFO ] [MAIN      ] NUVB: Successfully saved derivative data.
[2025-10-24T01:26:29.956487] [INFO ] [MAIN      ] Derivative Progress: 1407/2164 symbols completed. NUVB took 1.5s. Estimated remaining: 5m 17s. Rate: 143.4 symbols/min
[2025-10-24T01:26:30.007429] [INFO ] [MAIN      ] NVGS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:30.009266] [DEBUG] [LOCAL     ] NVG: Loaded 27531 existing records from primary storage.
[2025-10-24T01:26:30.009617] [INFO ] [MAIN      ] NVG: Loaded 27531 primary data records.
[2025-10-24T01:26:30.329094] [DEBUG] [LOCAL     ] NVGS: Loaded 30091 existing records from primary storage.
[2025-10-24T01:26:30.329978] [INFO ] [MAIN      ] NVGS: Loaded 30091 primary data records.
[2025-10-24T01:26:30.514906] [DEBUG] [MAIN      ] NUW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:30.722352] [DEBUG] [MAIN      ] NVG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:30.753472] [INFO ] [MAIN      ] NUW: Generated 139 derivative records from 6664 primary records.
[2025-10-24T01:26:30.767020] [DEBUG] [LOCAL     ] NUW: Saving derivative data.
[2025-10-24T01:26:30.770245] [DEBUG] [MAIN      ] NVGS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:30.795840] [DEBUG] [LOCAL     ] NUW: Derivative data saved (139 records).
[2025-10-24T01:26:30.796569] [INFO ] [MAIN      ] NUW: Successfully saved derivative data.
[2025-10-24T01:26:30.798782] [INFO ] [MAIN      ] Derivative Progress: 1408/2164 symbols completed. NUW took 1.2s. Estimated remaining: 5m 17s. Rate: 143.2 symbols/min
[2025-10-24T01:26:30.822080] [INFO ] [MAIN      ] NVG: Generated 139 derivative records from 27531 primary records.
[2025-10-24T01:26:30.822322] [DEBUG] [LOCAL     ] NVG: Saving derivative data.
[2025-10-24T01:26:30.838424] [DEBUG] [LOCAL     ] NVG: Derivative data saved (139 records).
[2025-10-24T01:26:30.840456] [INFO ] [MAIN      ] NVG: Successfully saved derivative data.
[2025-10-24T01:26:30.843372] [INFO ] [MAIN      ] Derivative Progress: 1409/2164 symbols completed. NVG took 1.2s. Estimated remaining: 5m 16s. Rate: 143.3 symbols/min
[2025-10-24T01:26:30.848480] [INFO ] [MAIN      ] NVGS: Generated 139 derivative records from 30091 primary records.
[2025-10-24T01:26:30.848703] [DEBUG] [LOCAL     ] NVGS: Saving derivative data.
[2025-10-24T01:26:30.860696] [DEBUG] [LOCAL     ] NVGS: Derivative data saved (139 records).
[2025-10-24T01:26:30.860799] [INFO ] [MAIN      ] NVGS: Successfully saved derivative data.
[2025-10-24T01:26:30.863736] [INFO ] [MAIN      ] Derivative Progress: 1410/2164 symbols completed. NVGS took 0.9s. Estimated remaining: 5m 15s. Rate: 143.4 symbols/min
[2025-10-24T01:26:30.864149] [INFO ] [MAIN      ] NVO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:30.864240] [INFO ] [MAIN      ] NVRI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:30.864394] [INFO ] [MAIN      ] NVR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:30.898881] [DEBUG] [LOCAL     ] NVR: Loaded 18511 existing records from primary storage.
[2025-10-24T01:26:30.899217] [INFO ] [MAIN      ] NVR: Loaded 18511 primary data records.
[2025-10-24T01:26:31.054084] [DEBUG] [LOCAL     ] NVRI: Loaded 39257 existing records from primary storage.
[2025-10-24T01:26:31.091542] [INFO ] [MAIN      ] NVRI: Loaded 39257 primary data records.
[2025-10-24T01:26:31.101280] [DEBUG] [LOCAL     ] NVO: Loaded 54174 existing records from primary storage.
[2025-10-24T01:26:31.103670] [INFO ] [MAIN      ] NVO: Loaded 54174 primary data records.
[2025-10-24T01:26:31.913745] [DEBUG] [MAIN      ] NVR: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:26:31.948860] [DEBUG] [MAIN      ] NVRI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:31.991242] [DEBUG] [MAIN      ] NVO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:32.024064] [INFO ] [MAIN      ] NVR: Generated 139 derivative records from 18511 primary records.
[2025-10-24T01:26:32.024877] [DEBUG] [LOCAL     ] NVR: Saving derivative data.
[2025-10-24T01:26:32.043077] [DEBUG] [LOCAL     ] NVR: Derivative data saved (139 records).
[2025-10-24T01:26:32.043233] [INFO ] [MAIN      ] NVR: Successfully saved derivative data.
[2025-10-24T01:26:32.048033] [INFO ] [MAIN      ] Derivative Progress: 1411/2164 symbols completed. NVR took 1.2s. Estimated remaining: 5m 15s. Rate: 143.2 symbols/min
[2025-10-24T01:26:32.048431] [INFO ] [MAIN      ] NVS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:32.063863] [INFO ] [MAIN      ] NVRI: Generated 139 derivative records from 39257 primary records.
[2025-10-24T01:26:32.067923] [DEBUG] [LOCAL     ] NVRI: Saving derivative data.
[2025-10-24T01:26:32.070639] [INFO ] [MAIN      ] NVO: Generated 139 derivative records from 54174 primary records.
[2025-10-24T01:26:32.070873] [DEBUG] [LOCAL     ] NVO: Saving derivative data.
[2025-10-24T01:26:32.094445] [DEBUG] [LOCAL     ] NVRI: Derivative data saved (139 records).
[2025-10-24T01:26:32.095533] [INFO ] [MAIN      ] NVRI: Successfully saved derivative data.
[2025-10-24T01:26:32.097715] [DEBUG] [LOCAL     ] NVO: Derivative data saved (139 records).
[2025-10-24T01:26:32.097929] [INFO ] [MAIN      ] NVO: Successfully saved derivative data.
[2025-10-24T01:26:32.100888] [INFO ] [MAIN      ] Derivative Progress: 1412/2164 symbols completed. NVRI took 1.2s. Estimated remaining: 5m 15s. Rate: 143.3 symbols/min
[2025-10-24T01:26:32.104758] [INFO ] [MAIN      ] Derivative Progress: 1413/2164 symbols completed. NVO took 1.2s. Estimated remaining: 5m 14s. Rate: 143.4 symbols/min
[2025-10-24T01:26:32.104930] [INFO ] [MAIN      ] NVT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:32.104566] [INFO ] [MAIN      ] NVST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:32.147068] [DEBUG] [LOCAL     ] NVS: Loaded 51660 existing records from primary storage.
[2025-10-24T01:26:32.147262] [INFO ] [MAIN      ] NVS: Loaded 51660 primary data records.
[2025-10-24T01:26:32.501190] [DEBUG] [LOCAL     ] NVST: Loaded 51815 existing records from primary storage.
[2025-10-24T01:26:32.501480] [INFO ] [MAIN      ] NVST: Loaded 51815 primary data records.
[2025-10-24T01:26:32.523858] [DEBUG] [LOCAL     ] NVT: Loaded 51798 existing records from primary storage.
[2025-10-24T01:26:32.567691] [INFO ] [MAIN      ] NVT: Loaded 51798 primary data records.
[2025-10-24T01:26:33.124447] [DEBUG] [MAIN      ] NVS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:33.171359] [DEBUG] [MAIN      ] NVST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:33.198286] [DEBUG] [MAIN      ] NVT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:33.227358] [INFO ] [MAIN      ] NVS: Generated 139 derivative records from 51660 primary records.
[2025-10-24T01:26:33.229111] [DEBUG] [LOCAL     ] NVS: Saving derivative data.
[2025-10-24T01:26:33.247307] [DEBUG] [LOCAL     ] NVS: Derivative data saved (139 records).
[2025-10-24T01:26:33.248357] [INFO ] [MAIN      ] NVS: Successfully saved derivative data.
[2025-10-24T01:26:33.251579] [INFO ] [MAIN      ] Derivative Progress: 1414/2164 symbols completed. NVS took 1.2s. Estimated remaining: 5m 14s. Rate: 143.3 symbols/min
[2025-10-24T01:26:33.256275] [INFO ] [MAIN      ] NWG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:33.284272] [INFO ] [MAIN      ] NVT: Generated 139 derivative records from 51798 primary records.
[2025-10-24T01:26:33.284557] [INFO ] [MAIN      ] NVST: Generated 139 derivative records from 51815 primary records.
[2025-10-24T01:26:33.284843] [DEBUG] [LOCAL     ] NVT: Saving derivative data.
[2025-10-24T01:26:33.284791] [DEBUG] [LOCAL     ] NVST: Saving derivative data.
[2025-10-24T01:26:33.308218] [DEBUG] [LOCAL     ] NVST: Derivative data saved (139 records).
[2025-10-24T01:26:33.323856] [DEBUG] [LOCAL     ] NVT: Derivative data saved (139 records).
[2025-10-24T01:26:33.323677] [INFO ] [MAIN      ] NVST: Successfully saved derivative data.
[2025-10-24T01:26:33.326367] [INFO ] [MAIN      ] Derivative Progress: 1415/2164 symbols completed. NVST took 1.2s. Estimated remaining: 5m 14s. Rate: 143.3 symbols/min
[2025-10-24T01:26:33.324058] [INFO ] [MAIN      ] NVT: Successfully saved derivative data.
[2025-10-24T01:26:33.329820] [INFO ] [MAIN      ] NWN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:33.329943] [INFO ] [MAIN      ] Derivative Progress: 1416/2164 symbols completed. NVT took 1.2s. Estimated remaining: 5m 13s. Rate: 143.4 symbols/min
[2025-10-24T01:26:33.330543] [INFO ] [MAIN      ] NX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:33.351230] [DEBUG] [LOCAL     ] NWG: Loaded 51774 existing records from primary storage.
[2025-10-24T01:26:33.351677] [INFO ] [MAIN      ] NWG: Loaded 51774 primary data records.
[2025-10-24T01:26:33.533720] [DEBUG] [LOCAL     ] NWN: Loaded 26582 existing records from primary storage.
[2025-10-24T01:26:33.570830] [DEBUG] [LOCAL     ] NX: Loaded 33545 existing records from primary storage.
[2025-10-24T01:26:33.638797] [INFO ] [MAIN      ] NWN: Loaded 26582 primary data records.
[2025-10-24T01:26:33.703533] [INFO ] [MAIN      ] NX: Loaded 33545 primary data records.
[2025-10-24T01:26:34.340885] [DEBUG] [MAIN      ] NWG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:34.408360] [DEBUG] [MAIN      ] NWN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:34.409165] [DEBUG] [MAIN      ] NX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:34.409599] [INFO ] [MAIN      ] NWG: Generated 139 derivative records from 51774 primary records.
[2025-10-24T01:26:34.432672] [DEBUG] [LOCAL     ] NWG: Saving derivative data.
[2025-10-24T01:26:34.451004] [DEBUG] [LOCAL     ] NWG: Derivative data saved (139 records).
[2025-10-24T01:26:34.452320] [INFO ] [MAIN      ] NWG: Successfully saved derivative data.
[2025-10-24T01:26:34.454523] [INFO ] [MAIN      ] Derivative Progress: 1417/2164 symbols completed. NWG took 1.2s. Estimated remaining: 5m 13s. Rate: 143.3 symbols/min
[2025-10-24T01:26:34.459606] [INFO ] [MAIN      ] NXC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:34.473438] [DEBUG] [LOCAL     ] NXC: Loaded 4096 existing records from primary storage.
[2025-10-24T01:26:34.475020] [INFO ] [MAIN      ] NXC: Loaded 4096 primary data records.
[2025-10-24T01:26:34.643257] [INFO ] [MAIN      ] NX: Generated 139 derivative records from 33545 primary records.
[2025-10-24T01:26:34.653248] [INFO ] [MAIN      ] NWN: Generated 139 derivative records from 26582 primary records.
[2025-10-24T01:26:34.653694] [DEBUG] [LOCAL     ] NWN: Saving derivative data.
[2025-10-24T01:26:34.666567] [DEBUG] [LOCAL     ] NX: Saving derivative data.
[2025-10-24T01:26:34.815139] [DEBUG] [LOCAL     ] NWN: Derivative data saved (139 records).
[2025-10-24T01:26:34.831072] [INFO ] [MAIN      ] NWN: Successfully saved derivative data.
[2025-10-24T01:26:34.840871] [INFO ] [MAIN      ] Derivative Progress: 1418/2164 symbols completed. NWN took 1.5s. Estimated remaining: 5m 12s. Rate: 143.3 symbols/min
[2025-10-24T01:26:34.841777] [INFO ] [MAIN      ] NXDT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:34.845161] [DEBUG] [LOCAL     ] NX: Derivative data saved (139 records).
[2025-10-24T01:26:34.845260] [INFO ] [MAIN      ] NX: Successfully saved derivative data.
[2025-10-24T01:26:34.849941] [INFO ] [MAIN      ] Derivative Progress: 1419/2164 symbols completed. NX took 1.5s. Estimated remaining: 5m 12s. Rate: 143.4 symbols/min
[2025-10-24T01:26:34.850367] [INFO ] [MAIN      ] NXE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:34.869093] [DEBUG] [LOCAL     ] NXDT: Loaded 14863 existing records from primary storage.
[2025-10-24T01:26:34.869450] [INFO ] [MAIN      ] NXDT: Loaded 14863 primary data records.
[2025-10-24T01:26:35.015931] [DEBUG] [MAIN      ] NXC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:35.251819] [DEBUG] [LOCAL     ] NXE: Loaded 53454 existing records from primary storage.
[2025-10-24T01:26:35.254982] [INFO ] [MAIN      ] NXE: Loaded 53454 primary data records.
[2025-10-24T01:26:35.583196] [INFO ] [MAIN      ] NXC: Generated 139 derivative records from 4096 primary records.
[2025-10-24T01:26:35.583824] [DEBUG] [LOCAL     ] NXC: Saving derivative data.
[2025-10-24T01:26:35.599225] [DEBUG] [LOCAL     ] NXC: Derivative data saved (139 records).
[2025-10-24T01:26:35.612045] [INFO ] [MAIN      ] NXC: Successfully saved derivative data.
[2025-10-24T01:26:35.614903] [INFO ] [MAIN      ] Derivative Progress: 1420/2164 symbols completed. NXC took 1.2s. Estimated remaining: 5m 12s. Rate: 143.3 symbols/min
[2025-10-24T01:26:35.615506] [DEBUG] [MAIN      ] NXDT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:35.616100] [INFO ] [MAIN      ] NXG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:35.655673] [DEBUG] [LOCAL     ] NXG: Loaded 10567 existing records from primary storage.
[2025-10-24T01:26:35.657474] [INFO ] [MAIN      ] NXG: Loaded 10567 primary data records.
[2025-10-24T01:26:35.780390] [DEBUG] [MAIN      ] NXE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:35.815115] [INFO ] [MAIN      ] NXDT: Generated 139 derivative records from 14863 primary records.
[2025-10-24T01:26:35.822295] [DEBUG] [LOCAL     ] NXDT: Saving derivative data.
[2025-10-24T01:26:36.052445] [DEBUG] [LOCAL     ] NXDT: Derivative data saved (139 records).
[2025-10-24T01:26:36.055419] [INFO ] [MAIN      ] NXDT: Successfully saved derivative data.
[2025-10-24T01:26:36.058891] [INFO ] [MAIN      ] Derivative Progress: 1421/2164 symbols completed. NXDT took 1.2s. Estimated remaining: 5m 11s. Rate: 143.3 symbols/min
[2025-10-24T01:26:36.059285] [INFO ] [MAIN      ] NXJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:36.084967] [INFO ] [MAIN      ] NXE: Generated 139 derivative records from 53454 primary records.
[2025-10-24T01:26:36.085594] [DEBUG] [LOCAL     ] NXE: Saving derivative data.
[2025-10-24T01:26:36.099486] [DEBUG] [LOCAL     ] NXJ: Loaded 14866 existing records from primary storage.
[2025-10-24T01:26:36.103721] [DEBUG] [LOCAL     ] NXE: Derivative data saved (139 records).
[2025-10-24T01:26:36.103945] [INFO ] [MAIN      ] NXJ: Loaded 14866 primary data records.
[2025-10-24T01:26:36.103877] [INFO ] [MAIN      ] NXE: Successfully saved derivative data.
[2025-10-24T01:26:36.107273] [INFO ] [MAIN      ] Derivative Progress: 1422/2164 symbols completed. NXE took 1.3s. Estimated remaining: 5m 11s. Rate: 143.4 symbols/min
[2025-10-24T01:26:36.107678] [INFO ] [MAIN      ] NXN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:36.195982] [DEBUG] [LOCAL     ] NXN: Loaded 2313 existing records from primary storage.
[2025-10-24T01:26:36.216068] [INFO ] [MAIN      ] NXN: Loaded 2313 primary data records.
[2025-10-24T01:26:36.377408] [DEBUG] [MAIN      ] NXG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:36.823770] [INFO ] [MAIN      ] NXG: Generated 139 derivative records from 10567 primary records.
[2025-10-24T01:26:36.824751] [DEBUG] [LOCAL     ] NXG: Saving derivative data.
[2025-10-24T01:26:36.841842] [DEBUG] [LOCAL     ] NXG: Derivative data saved (139 records).
[2025-10-24T01:26:36.842139] [INFO ] [MAIN      ] NXG: Successfully saved derivative data.
[2025-10-24T01:26:36.845116] [INFO ] [MAIN      ] Derivative Progress: 1423/2164 symbols completed. NXG took 1.2s. Estimated remaining: 5m 10s. Rate: 143.3 symbols/min
[2025-10-24T01:26:36.860111] [DEBUG] [MAIN      ] NXJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:36.895452] [DEBUG] [MAIN      ] NXN: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:26:36.939343] [INFO ] [MAIN      ] NXJ: Generated 139 derivative records from 14866 primary records.
[2025-10-24T01:26:36.942102] [DEBUG] [LOCAL     ] NXJ: Saving derivative data.
[2025-10-24T01:26:36.959460] [DEBUG] [LOCAL     ] NXJ: Derivative data saved (139 records).
[2025-10-24T01:26:36.960961] [INFO ] [MAIN      ] NXJ: Successfully saved derivative data.
[2025-10-24T01:26:36.964024] [INFO ] [MAIN      ] Derivative Progress: 1424/2164 symbols completed. NXJ took 0.9s. Estimated remaining: 5m 10s. Rate: 143.4 symbols/min
[2025-10-24T01:26:36.965881] [INFO ] [MAIN      ] NXN: Generated 139 derivative records from 2313 primary records.
[2025-10-24T01:26:36.966265] [DEBUG] [LOCAL     ] NXN: Saving derivative data.
[2025-10-24T01:26:36.976207] [DEBUG] [LOCAL     ] NXN: Derivative data saved (139 records).
[2025-10-24T01:26:36.976341] [INFO ] [MAIN      ] NXN: Successfully saved derivative data.
[2025-10-24T01:26:36.979353] [INFO ] [MAIN      ] Derivative Progress: 1425/2164 symbols completed. NXN took 0.9s. Estimated remaining: 5m 9s. Rate: 143.5 symbols/min
[2025-10-24T01:26:36.979885] [INFO ] [MAIN      ] NXP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:36.979982] [INFO ] [MAIN      ] NYT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:36.980757] [INFO ] [MAIN      ] NXRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:37.002887] [DEBUG] [LOCAL     ] NXP: Loaded 12306 existing records from primary storage.
[2025-10-24T01:26:37.003119] [INFO ] [MAIN      ] NXP: Loaded 12306 primary data records.
[2025-10-24T01:26:37.042365] [DEBUG] [LOCAL     ] NXRT: Loaded 19039 existing records from primary storage.
[2025-10-24T01:26:37.097717] [INFO ] [MAIN      ] NXRT: Loaded 19039 primary data records.
[2025-10-24T01:26:37.409949] [DEBUG] [LOCAL     ] NYT: Loaded 49803 existing records from primary storage.
[2025-10-24T01:26:37.457138] [INFO ] [MAIN      ] NYT: Loaded 49803 primary data records.
[2025-10-24T01:26:38.039832] [DEBUG] [MAIN      ] NXP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:38.078915] [DEBUG] [MAIN      ] NXRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:38.118745] [DEBUG] [MAIN      ] NYT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:38.142794] [INFO ] [MAIN      ] NXP: Generated 139 derivative records from 12306 primary records.
[2025-10-24T01:26:38.144744] [DEBUG] [LOCAL     ] NXP: Saving derivative data.
[2025-10-24T01:26:38.159590] [DEBUG] [LOCAL     ] NXP: Derivative data saved (139 records).
[2025-10-24T01:26:38.164302] [INFO ] [MAIN      ] NXP: Successfully saved derivative data.
[2025-10-24T01:26:38.166938] [INFO ] [MAIN      ] Derivative Progress: 1426/2164 symbols completed. NXP took 1.2s. Estimated remaining: 5m 9s. Rate: 143.3 symbols/min
[2025-10-24T01:26:38.168241] [INFO ] [MAIN      ] NZF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:38.181497] [INFO ] [MAIN      ] NXRT: Generated 139 derivative records from 19039 primary records.
[2025-10-24T01:26:38.183224] [DEBUG] [LOCAL     ] NXRT: Saving derivative data.
[2025-10-24T01:26:38.201531] [INFO ] [MAIN      ] NYT: Generated 139 derivative records from 49803 primary records.
[2025-10-24T01:26:38.202426] [DEBUG] [LOCAL     ] NYT: Saving derivative data.
[2025-10-24T01:26:38.202319] [DEBUG] [LOCAL     ] NXRT: Derivative data saved (139 records).
[2025-10-24T01:26:38.203114] [INFO ] [MAIN      ] NXRT: Successfully saved derivative data.
[2025-10-24T01:26:38.220300] [INFO ] [MAIN      ] Derivative Progress: 1427/2164 symbols completed. NXRT took 1.2s. Estimated remaining: 5m 8s. Rate: 143.4 symbols/min
[2025-10-24T01:26:38.223185] [INFO ] [MAIN      ] OBDC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:38.227324] [DEBUG] [LOCAL     ] NYT: Derivative data saved (139 records).
[2025-10-24T01:26:38.227766] [INFO ] [MAIN      ] NYT: Successfully saved derivative data.
[2025-10-24T01:26:38.230797] [INFO ] [MAIN      ] Derivative Progress: 1428/2164 symbols completed. NYT took 1.3s. Estimated remaining: 5m 8s. Rate: 143.5 symbols/min
[2025-10-24T01:26:38.231080] [INFO ] [MAIN      ] OBK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:38.242178] [DEBUG] [LOCAL     ] NZF: Loaded 28909 existing records from primary storage.
[2025-10-24T01:26:38.242461] [INFO ] [MAIN      ] NZF: Loaded 28909 primary data records.
[2025-10-24T01:26:38.351994] [DEBUG] [LOCAL     ] OBK: Loaded 16495 existing records from primary storage.
[2025-10-24T01:26:38.355605] [INFO ] [MAIN      ] OBK: Loaded 16495 primary data records.
[2025-10-24T01:26:38.858735] [DEBUG] [LOCAL     ] OBDC: Loaded 52109 existing records from primary storage.
[2025-10-24T01:26:38.872457] [INFO ] [MAIN      ] OBDC: Loaded 52109 primary data records.
[2025-10-24T01:26:39.187027] [DEBUG] [MAIN      ] NZF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:39.222860] [DEBUG] [MAIN      ] OBK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:39.272074] [DEBUG] [MAIN      ] OBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:39.296458] [INFO ] [MAIN      ] NZF: Generated 139 derivative records from 28909 primary records.
[2025-10-24T01:26:39.300497] [DEBUG] [LOCAL     ] NZF: Saving derivative data.
[2025-10-24T01:26:39.325266] [INFO ] [MAIN      ] OBK: Generated 139 derivative records from 16495 primary records.
[2025-10-24T01:26:39.322127] [DEBUG] [LOCAL     ] NZF: Derivative data saved (139 records).
[2025-10-24T01:26:39.329665] [INFO ] [MAIN      ] NZF: Successfully saved derivative data.
[2025-10-24T01:26:39.326505] [DEBUG] [LOCAL     ] OBK: Saving derivative data.
[2025-10-24T01:26:39.333418] [INFO ] [MAIN      ] Derivative Progress: 1429/2164 symbols completed. NZF took 1.2s. Estimated remaining: 5m 8s. Rate: 143.3 symbols/min
[2025-10-24T01:26:39.333595] [INFO ] [MAIN      ] OC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:39.352006] [DEBUG] [LOCAL     ] OBK: Derivative data saved (139 records).
[2025-10-24T01:26:39.355026] [INFO ] [MAIN      ] OBDC: Generated 139 derivative records from 52109 primary records.
[2025-10-24T01:26:39.354746] [INFO ] [MAIN      ] OBK: Successfully saved derivative data.
[2025-10-24T01:26:39.355184] [DEBUG] [LOCAL     ] OBDC: Saving derivative data.
[2025-10-24T01:26:39.358041] [INFO ] [MAIN      ] Derivative Progress: 1430/2164 symbols completed. OBK took 1.1s. Estimated remaining: 5m 7s. Rate: 143.4 symbols/min
[2025-10-24T01:26:39.358345] [INFO ] [MAIN      ] OCFT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:39.371741] [DEBUG] [LOCAL     ] OBDC: Derivative data saved (139 records).
[2025-10-24T01:26:39.372123] [INFO ] [MAIN      ] OBDC: Successfully saved derivative data.
[2025-10-24T01:26:39.375215] [INFO ] [MAIN      ] Derivative Progress: 1431/2164 symbols completed. OBDC took 1.2s. Estimated remaining: 5m 6s. Rate: 143.5 symbols/min
[2025-10-24T01:26:39.375424] [INFO ] [MAIN      ] ODC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:39.383787] [DEBUG] [LOCAL     ] OCFT: Loaded 7130 existing records from primary storage.
[2025-10-24T01:26:39.383959] [INFO ] [MAIN      ] OCFT: Loaded 7130 primary data records.
[2025-10-24T01:26:39.478869] [DEBUG] [LOCAL     ] ODC: Loaded 8741 existing records from primary storage.
[2025-10-24T01:26:39.497585] [INFO ] [MAIN      ] ODC: Loaded 8741 primary data records.
[2025-10-24T01:26:39.649489] [DEBUG] [LOCAL     ] OC: Loaded 45203 existing records from primary storage.
[2025-10-24T01:26:39.683945] [INFO ] [MAIN      ] OC: Loaded 45203 primary data records.
[2025-10-24T01:26:40.382737] [DEBUG] [MAIN      ] OCFT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:40.417752] [DEBUG] [MAIN      ] ODC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:40.452679] [DEBUG] [MAIN      ] OC: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:26:40.495167] [INFO ] [MAIN      ] OCFT: Generated 139 derivative records from 7130 primary records.
[2025-10-24T01:26:40.500404] [DEBUG] [LOCAL     ] OCFT: Saving derivative data.
[2025-10-24T01:26:40.514410] [DEBUG] [LOCAL     ] OCFT: Derivative data saved (139 records).
[2025-10-24T01:26:40.517723] [INFO ] [MAIN      ] OCFT: Successfully saved derivative data.
[2025-10-24T01:26:40.522268] [INFO ] [MAIN      ] Derivative Progress: 1432/2164 symbols completed. OCFT took 1.2s. Estimated remaining: 5m 6s. Rate: 143.3 symbols/min
[2025-10-24T01:26:40.525333] [INFO ] [MAIN      ] ODV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:40.528164] [INFO ] [MAIN      ] ODC: Generated 139 derivative records from 8741 primary records.
[2025-10-24T01:26:40.531191] [DEBUG] [LOCAL     ] ODC: Saving derivative data.
[2025-10-24T01:26:40.545901] [DEBUG] [LOCAL     ] ODC: Derivative data saved (139 records).
[2025-10-24T01:26:40.546152] [INFO ] [MAIN      ] ODC: Successfully saved derivative data.
[2025-10-24T01:26:40.549174] [INFO ] [MAIN      ] Derivative Progress: 1433/2164 symbols completed. ODC took 1.2s. Estimated remaining: 5m 6s. Rate: 143.4 symbols/min
[2025-10-24T01:26:40.549738] [INFO ] [MAIN      ] OEC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:40.549545] [INFO ] [MAIN      ] OC: Generated 139 derivative records from 45203 primary records.
[2025-10-24T01:26:40.550532] [DEBUG] [LOCAL     ] OC: Saving derivative data.
[2025-10-24T01:26:40.563831] [DEBUG] [LOCAL     ] OC: Derivative data saved (139 records).
[2025-10-24T01:26:40.564038] [INFO ] [MAIN      ] OC: Successfully saved derivative data.
[2025-10-24T01:26:40.566582] [INFO ] [MAIN      ] Derivative Progress: 1434/2164 symbols completed. OC took 1.2s. Estimated remaining: 5m 5s. Rate: 143.5 symbols/min
[2025-10-24T01:26:40.566938] [INFO ] [MAIN      ] OFG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:40.590059] [DEBUG] [LOCAL     ] ODV: Loaded 30299 existing records from primary storage.
[2025-10-24T01:26:40.598991] [INFO ] [MAIN      ] ODV: Loaded 30299 primary data records.
[2025-10-24T01:26:40.677832] [DEBUG] [LOCAL     ] OFG: Loaded 20730 existing records from primary storage.
[2025-10-24T01:26:40.703918] [INFO ] [MAIN      ] OFG: Loaded 20730 primary data records.
[2025-10-24T01:26:40.737970] [DEBUG] [LOCAL     ] OEC: Loaded 37414 existing records from primary storage.
[2025-10-24T01:26:40.835357] [INFO ] [MAIN      ] OEC: Loaded 37414 primary data records.
[2025-10-24T01:26:41.560506] [DEBUG] [MAIN      ] ODV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:41.591720] [DEBUG] [MAIN      ] OFG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:41.638889] [DEBUG] [MAIN      ] OEC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:41.681475] [INFO ] [MAIN      ] OFG: Generated 139 derivative records from 20730 primary records.
[2025-10-24T01:26:41.682911] [DEBUG] [LOCAL     ] OFG: Saving derivative data.
[2025-10-24T01:26:41.681636] [INFO ] [MAIN      ] ODV: Generated 139 derivative records from 30299 primary records.
[2025-10-24T01:26:41.683574] [DEBUG] [LOCAL     ] ODV: Saving derivative data.
[2025-10-24T01:26:41.708181] [DEBUG] [LOCAL     ] OFG: Derivative data saved (139 records).
[2025-10-24T01:26:41.709749] [INFO ] [MAIN      ] OFG: Successfully saved derivative data.
[2025-10-24T01:26:41.718761] [DEBUG] [LOCAL     ] ODV: Derivative data saved (139 records).
[2025-10-24T01:26:41.715442] [INFO ] [MAIN      ] Derivative Progress: 1435/2164 symbols completed. OFG took 1.1s. Estimated remaining: 5m 5s. Rate: 143.3 symbols/min
[2025-10-24T01:26:41.719288] [INFO ] [MAIN      ] OGE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:41.719052] [INFO ] [MAIN      ] ODV: Successfully saved derivative data.
[2025-10-24T01:26:41.722985] [INFO ] [MAIN      ] Derivative Progress: 1436/2164 symbols completed. ODV took 1.2s. Estimated remaining: 5m 5s. Rate: 143.4 symbols/min
[2025-10-24T01:26:41.723257] [INFO ] [MAIN      ] OGN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:41.736971] [INFO ] [MAIN      ] OEC: Generated 139 derivative records from 37414 primary records.
[2025-10-24T01:26:41.737460] [DEBUG] [LOCAL     ] OEC: Saving derivative data.
[2025-10-24T01:26:41.751197] [DEBUG] [LOCAL     ] OEC: Derivative data saved (139 records).
[2025-10-24T01:26:41.751430] [INFO ] [MAIN      ] OEC: Successfully saved derivative data.
[2025-10-24T01:26:41.754572] [INFO ] [MAIN      ] Derivative Progress: 1437/2164 symbols completed. OEC took 1.2s. Estimated remaining: 5m 4s. Rate: 143.5 symbols/min
[2025-10-24T01:26:41.754950] [INFO ] [MAIN      ] OGS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:41.807289] [DEBUG] [LOCAL     ] OGE: Loaded 46128 existing records from primary storage.
[2025-10-24T01:26:41.807547] [INFO ] [MAIN      ] OGE: Loaded 46128 primary data records.
[2025-10-24T01:26:41.930123] [DEBUG] [LOCAL     ] OGS: Loaded 34115 existing records from primary storage.
[2025-10-24T01:26:41.947060] [INFO ] [MAIN      ] OGS: Loaded 34115 primary data records.
[2025-10-24T01:26:41.995890] [DEBUG] [LOCAL     ] OGN: Loaded 53494 existing records from primary storage.
[2025-10-24T01:26:42.043986] [INFO ] [MAIN      ] OGN: Loaded 53494 primary data records.
[2025-10-24T01:26:42.850307] [DEBUG] [MAIN      ] OGE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:42.886189] [DEBUG] [MAIN      ] OGS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:42.946397] [DEBUG] [MAIN      ] OGN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:42.993038] [INFO ] [MAIN      ] OGE: Generated 139 derivative records from 46128 primary records.
[2025-10-24T01:26:43.000440] [DEBUG] [LOCAL     ] OGE: Saving derivative data.
[2025-10-24T01:26:43.019018] [DEBUG] [LOCAL     ] OGE: Derivative data saved (139 records).
[2025-10-24T01:26:43.019820] [INFO ] [MAIN      ] OGE: Successfully saved derivative data.
[2025-10-24T01:26:43.019675] [INFO ] [MAIN      ] OGS: Generated 139 derivative records from 34115 primary records.
[2025-10-24T01:26:43.022442] [INFO ] [MAIN      ] Derivative Progress: 1438/2164 symbols completed. OGE took 1.3s. Estimated remaining: 5m 4s. Rate: 143.3 symbols/min
[2025-10-24T01:26:43.025579] [DEBUG] [LOCAL     ] OGS: Saving derivative data.
[2025-10-24T01:26:43.041897] [DEBUG] [LOCAL     ] OGS: Derivative data saved (139 records).
[2025-10-24T01:26:43.042280] [INFO ] [MAIN      ] OGS: Successfully saved derivative data.
[2025-10-24T01:26:43.045196] [INFO ] [MAIN      ] Derivative Progress: 1439/2164 symbols completed. OGS took 1.3s. Estimated remaining: 5m 3s. Rate: 143.4 symbols/min
[2025-10-24T01:26:43.048182] [INFO ] [MAIN      ] OGN: Generated 139 derivative records from 53494 primary records.
[2025-10-24T01:26:43.048333] [DEBUG] [LOCAL     ] OGN: Saving derivative data.
[2025-10-24T01:26:43.060284] [DEBUG] [LOCAL     ] OGN: Derivative data saved (139 records).
[2025-10-24T01:26:43.060367] [INFO ] [MAIN      ] OGN: Successfully saved derivative data.
[2025-10-24T01:26:43.063748] [INFO ] [MAIN      ] Derivative Progress: 1440/2164 symbols completed. OGN took 1.3s. Estimated remaining: 5m 3s. Rate: 143.5 symbols/min
[2025-10-24T01:26:43.064262] [INFO ] [MAIN      ] OHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:43.064470] [INFO ] [MAIN      ] OI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:43.064395] [INFO ] [MAIN      ] OIA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:43.081935] [DEBUG] [LOCAL     ] OIA: Loaded 13127 existing records from primary storage.
[2025-10-24T01:26:43.082156] [INFO ] [MAIN      ] OIA: Loaded 13127 primary data records.
[2025-10-24T01:26:43.444621] [DEBUG] [LOCAL     ] OI: Loaded 47371 existing records from primary storage.
[2025-10-24T01:26:43.445225] [INFO ] [MAIN      ] OI: Loaded 47371 primary data records.
[2025-10-24T01:26:43.446154] [DEBUG] [LOCAL     ] OHI: Loaded 52179 existing records from primary storage.
[2025-10-24T01:26:43.452898] [INFO ] [MAIN      ] OHI: Loaded 52179 primary data records.
[2025-10-24T01:26:44.155043] [DEBUG] [MAIN      ] OIA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:44.217880] [DEBUG] [MAIN      ] OHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:44.252372] [DEBUG] [MAIN      ] OI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:44.256958] [INFO ] [MAIN      ] OIA: Generated 139 derivative records from 13127 primary records.
[2025-10-24T01:26:44.257276] [DEBUG] [LOCAL     ] OIA: Saving derivative data.
[2025-10-24T01:26:44.284820] [DEBUG] [LOCAL     ] OIA: Derivative data saved (139 records).
[2025-10-24T01:26:44.285585] [INFO ] [MAIN      ] OIA: Successfully saved derivative data.
[2025-10-24T01:26:44.291762] [INFO ] [MAIN      ] Derivative Progress: 1441/2164 symbols completed. OIA took 1.2s. Estimated remaining: 5m 3s. Rate: 143.3 symbols/min
[2025-10-24T01:26:44.292044] [INFO ] [MAIN      ] OII: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:44.337897] [INFO ] [MAIN      ] OI: Generated 139 derivative records from 47371 primary records.
[2025-10-24T01:26:44.323630] [INFO ] [MAIN      ] OHI: Generated 139 derivative records from 52179 primary records.
[2025-10-24T01:26:44.338285] [DEBUG] [LOCAL     ] OI: Saving derivative data.
[2025-10-24T01:26:44.338055] [DEBUG] [LOCAL     ] OHI: Saving derivative data.
[2025-10-24T01:26:44.359757] [DEBUG] [LOCAL     ] OI: Derivative data saved (139 records).
[2025-10-24T01:26:44.360440] [INFO ] [MAIN      ] OI: Successfully saved derivative data.
[2025-10-24T01:26:44.365315] [INFO ] [MAIN      ] Derivative Progress: 1442/2164 symbols completed. OI took 1.3s. Estimated remaining: 5m 2s. Rate: 143.4 symbols/min
[2025-10-24T01:26:44.365872] [INFO ] [MAIN      ] OIS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:44.384074] [DEBUG] [LOCAL     ] OHI: Derivative data saved (139 records).
[2025-10-24T01:26:44.386280] [INFO ] [MAIN      ] OHI: Successfully saved derivative data.
[2025-10-24T01:26:44.388468] [DEBUG] [LOCAL     ] OII: Loaded 42179 existing records from primary storage.
[2025-10-24T01:26:44.393090] [INFO ] [MAIN      ] OII: Loaded 42179 primary data records.
[2025-10-24T01:26:44.392492] [INFO ] [MAIN      ] Derivative Progress: 1443/2164 symbols completed. OHI took 1.3s. Estimated remaining: 5m 1s. Rate: 143.5 symbols/min
[2025-10-24T01:26:44.393604] [INFO ] [MAIN      ] OKE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:44.736595] [DEBUG] [LOCAL     ] OIS: Loaded 40115 existing records from primary storage.
[2025-10-24T01:26:44.736951] [INFO ] [MAIN      ] OIS: Loaded 40115 primary data records.
[2025-10-24T01:26:44.855772] [DEBUG] [LOCAL     ] OKE: Loaded 53966 existing records from primary storage.
[2025-10-24T01:26:44.865065] [INFO ] [MAIN      ] OKE: Loaded 53966 primary data records.
[2025-10-24T01:26:45.391216] [DEBUG] [MAIN      ] OII: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:45.449307] [DEBUG] [MAIN      ] OIS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:45.466584] [INFO ] [MAIN      ] OII: Generated 139 derivative records from 42179 primary records.
[2025-10-24T01:26:45.467102] [DEBUG] [LOCAL     ] OII: Saving derivative data.
[2025-10-24T01:26:45.483506] [DEBUG] [MAIN      ] OKE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:45.498437] [DEBUG] [LOCAL     ] OII: Derivative data saved (139 records).
[2025-10-24T01:26:45.510789] [INFO ] [MAIN      ] OII: Successfully saved derivative data.
[2025-10-24T01:26:45.513456] [INFO ] [MAIN      ] Derivative Progress: 1444/2164 symbols completed. OII took 1.2s. Estimated remaining: 5m 1s. Rate: 143.3 symbols/min
[2025-10-24T01:26:45.519488] [INFO ] [MAIN      ] OKLO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:45.555623] [INFO ] [MAIN      ] OIS: Generated 139 derivative records from 40115 primary records.
[2025-10-24T01:26:45.557503] [DEBUG] [LOCAL     ] OIS: Saving derivative data.
[2025-10-24T01:26:45.573523] [INFO ] [MAIN      ] OKE: Generated 139 derivative records from 53966 primary records.
[2025-10-24T01:26:45.574728] [DEBUG] [LOCAL     ] OKE: Saving derivative data.
[2025-10-24T01:26:45.600335] [DEBUG] [LOCAL     ] OIS: Derivative data saved (139 records).
[2025-10-24T01:26:45.600226] [DEBUG] [LOCAL     ] OKE: Derivative data saved (139 records).
[2025-10-24T01:26:45.600729] [INFO ] [MAIN      ] OKE: Successfully saved derivative data.
[2025-10-24T01:26:45.600811] [INFO ] [MAIN      ] OIS: Successfully saved derivative data.
[2025-10-24T01:26:45.618828] [INFO ] [MAIN      ] Derivative Progress: 1445/2164 symbols completed. OKE took 1.2s. Estimated remaining: 5m 1s. Rate: 143.4 symbols/min
[2025-10-24T01:26:45.621440] [INFO ] [MAIN      ] OLN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:45.621785] [INFO ] [MAIN      ] Derivative Progress: 1446/2164 symbols completed. OIS took 1.3s. Estimated remaining: 5m 0s. Rate: 143.5 symbols/min
[2025-10-24T01:26:45.622557] [INFO ] [MAIN      ] OLP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:45.623797] [DEBUG] [LOCAL     ] OKLO: Loaded 54209 existing records from primary storage.
[2025-10-24T01:26:45.624393] [INFO ] [MAIN      ] OKLO: Loaded 54209 primary data records.
[2025-10-24T01:26:45.763858] [DEBUG] [LOCAL     ] OLP: Loaded 10133 existing records from primary storage.
[2025-10-24T01:26:45.830206] [INFO ] [MAIN      ] OLP: Loaded 10133 primary data records.
[2025-10-24T01:26:46.075736] [DEBUG] [LOCAL     ] OLN: Loaded 52381 existing records from primary storage.
[2025-10-24T01:26:46.077005] [INFO ] [MAIN      ] OLN: Loaded 52381 primary data records.
[2025-10-24T01:26:46.648286] [DEBUG] [MAIN      ] OKLO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:46.689287] [DEBUG] [MAIN      ] OLP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:46.746191] [DEBUG] [MAIN      ] OLN: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:26:46.771502] [INFO ] [MAIN      ] OKLO: Generated 139 derivative records from 54209 primary records.
[2025-10-24T01:26:46.773849] [DEBUG] [LOCAL     ] OKLO: Saving derivative data.
[2025-10-24T01:26:46.798282] [DEBUG] [LOCAL     ] OKLO: Derivative data saved (139 records).
[2025-10-24T01:26:46.802084] [INFO ] [MAIN      ] OKLO: Successfully saved derivative data.
[2025-10-24T01:26:46.808790] [INFO ] [MAIN      ] Derivative Progress: 1447/2164 symbols completed. OKLO took 1.3s. Estimated remaining: 5m 0s. Rate: 143.3 symbols/min
[2025-10-24T01:26:46.809069] [INFO ] [MAIN      ] OMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:46.809719] [INFO ] [MAIN      ] OLP: Generated 139 derivative records from 10133 primary records.
[2025-10-24T01:26:46.813525] [DEBUG] [LOCAL     ] OLP: Saving derivative data.
[2025-10-24T01:26:46.832190] [DEBUG] [LOCAL     ] OLP: Derivative data saved (139 records).
[2025-10-24T01:26:46.832674] [INFO ] [MAIN      ] OLP: Successfully saved derivative data.
[2025-10-24T01:26:46.838104] [INFO ] [MAIN      ] Derivative Progress: 1448/2164 symbols completed. OLP took 1.2s. Estimated remaining: 4m 60s. Rate: 143.4 symbols/min
[2025-10-24T01:26:46.839393] [INFO ] [MAIN      ] OMF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:46.840185] [INFO ] [MAIN      ] OLN: Generated 139 derivative records from 52381 primary records.
[2025-10-24T01:26:46.840334] [DEBUG] [LOCAL     ] OLN: Saving derivative data.
[2025-10-24T01:26:46.854580] [DEBUG] [LOCAL     ] OLN: Derivative data saved (139 records).
[2025-10-24T01:26:46.854813] [INFO ] [MAIN      ] OLN: Successfully saved derivative data.
[2025-10-24T01:26:46.859851] [INFO ] [MAIN      ] Derivative Progress: 1449/2164 symbols completed. OLN took 1.2s. Estimated remaining: 4m 59s. Rate: 143.5 symbols/min
[2025-10-24T01:26:46.860316] [INFO ] [MAIN      ] ONIT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:46.889792] [DEBUG] [LOCAL     ] ONIT: Loaded 7548 existing records from primary storage.
[2025-10-24T01:26:46.890362] [INFO ] [MAIN      ] ONIT: Loaded 7548 primary data records.
[2025-10-24T01:26:47.045057] [DEBUG] [LOCAL     ] OMC: Loaded 53682 existing records from primary storage.
[2025-10-24T01:26:47.051939] [DEBUG] [LOCAL     ] OMF: Loaded 46802 existing records from primary storage.
[2025-10-24T01:26:47.051082] [INFO ] [MAIN      ] OMC: Loaded 53682 primary data records.
[2025-10-24T01:26:47.067504] [INFO ] [MAIN      ] OMF: Loaded 46802 primary data records.
[2025-10-24T01:26:47.916197] [DEBUG] [MAIN      ] ONIT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:47.972971] [DEBUG] [MAIN      ] OMF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:47.975544] [DEBUG] [MAIN      ] OMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:48.025723] [INFO ] [MAIN      ] ONIT: Generated 139 derivative records from 7548 primary records.
[2025-10-24T01:26:48.027252] [DEBUG] [LOCAL     ] ONIT: Saving derivative data.
[2025-10-24T01:26:48.056625] [DEBUG] [LOCAL     ] ONIT: Derivative data saved (139 records).
[2025-10-24T01:26:48.057808] [INFO ] [MAIN      ] ONIT: Successfully saved derivative data.
[2025-10-24T01:26:48.061522] [INFO ] [MAIN      ] Derivative Progress: 1450/2164 symbols completed. ONIT took 1.2s. Estimated remaining: 4m 59s. Rate: 143.3 symbols/min
[2025-10-24T01:26:48.063373] [INFO ] [MAIN      ] ONL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:48.078793] [INFO ] [MAIN      ] OMF: Generated 139 derivative records from 46802 primary records.
[2025-10-24T01:26:48.080555] [INFO ] [MAIN      ] OMC: Generated 139 derivative records from 53682 primary records.
[2025-10-24T01:26:48.080995] [DEBUG] [LOCAL     ] OMC: Saving derivative data.
[2025-10-24T01:26:48.080918] [DEBUG] [LOCAL     ] OMF: Saving derivative data.
[2025-10-24T01:26:48.101534] [DEBUG] [LOCAL     ] OMF: Derivative data saved (139 records).
[2025-10-24T01:26:48.112801] [DEBUG] [LOCAL     ] OMC: Derivative data saved (139 records).
[2025-10-24T01:26:48.112747] [INFO ] [MAIN      ] OMF: Successfully saved derivative data.
[2025-10-24T01:26:48.113180] [INFO ] [MAIN      ] OMC: Successfully saved derivative data.
[2025-10-24T01:26:48.116301] [INFO ] [MAIN      ] Derivative Progress: 1451/2164 symbols completed. OMC took 1.3s. Estimated remaining: 4m 58s. Rate: 143.4 symbols/min
[2025-10-24T01:26:48.119700] [INFO ] [MAIN      ] ONON: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:48.119846] [INFO ] [MAIN      ] Derivative Progress: 1452/2164 symbols completed. OMF took 1.3s. Estimated remaining: 4m 58s. Rate: 143.5 symbols/min
[2025-10-24T01:26:48.120580] [INFO ] [MAIN      ] ONTF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:48.134093] [DEBUG] [LOCAL     ] ONL: Loaded 29013 existing records from primary storage.
[2025-10-24T01:26:48.134352] [INFO ] [MAIN      ] ONL: Loaded 29013 primary data records.
[2025-10-24T01:26:48.270367] [DEBUG] [LOCAL     ] ONTF: Loaded 22692 existing records from primary storage.
[2025-10-24T01:26:48.309662] [INFO ] [MAIN      ] ONTF: Loaded 22692 primary data records.
[2025-10-24T01:26:48.622103] [DEBUG] [LOCAL     ] ONON: Loaded 54003 existing records from primary storage.
[2025-10-24T01:26:48.634701] [INFO ] [MAIN      ] ONON: Loaded 54003 primary data records.
[2025-10-24T01:26:49.136036] [DEBUG] [MAIN      ] ONL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:49.171164] [DEBUG] [MAIN      ] ONTF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:49.217263] [DEBUG] [MAIN      ] ONON: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:49.259412] [INFO ] [MAIN      ] ONL: Generated 139 derivative records from 29013 primary records.
[2025-10-24T01:26:49.262772] [DEBUG] [LOCAL     ] ONL: Saving derivative data.
[2025-10-24T01:26:49.284068] [DEBUG] [LOCAL     ] ONL: Derivative data saved (139 records).
[2025-10-24T01:26:49.284955] [INFO ] [MAIN      ] ONL: Successfully saved derivative data.
[2025-10-24T01:26:49.290729] [INFO ] [MAIN      ] Derivative Progress: 1453/2164 symbols completed. ONL took 1.2s. Estimated remaining: 4m 58s. Rate: 143.3 symbols/min
[2025-10-24T01:26:49.293719] [INFO ] [MAIN      ] ONTF: Generated 139 derivative records from 22692 primary records.
[2025-10-24T01:26:49.295296] [DEBUG] [LOCAL     ] ONTF: Saving derivative data.
[2025-10-24T01:26:49.311156] [DEBUG] [LOCAL     ] ONTF: Derivative data saved (139 records).
[2025-10-24T01:26:49.313225] [INFO ] [MAIN      ] ONTF: Successfully saved derivative data.
[2025-10-24T01:26:49.315780] [INFO ] [MAIN      ] Derivative Progress: 1454/2164 symbols completed. ONTF took 1.2s. Estimated remaining: 4m 57s. Rate: 143.4 symbols/min
[2025-10-24T01:26:49.313120] [INFO ] [MAIN      ] ONON: Generated 139 derivative records from 54003 primary records.
[2025-10-24T01:26:49.316139] [DEBUG] [LOCAL     ] ONON: Saving derivative data.
[2025-10-24T01:26:49.329261] [DEBUG] [LOCAL     ] ONON: Derivative data saved (139 records).
[2025-10-24T01:26:49.329368] [INFO ] [MAIN      ] ONON: Successfully saved derivative data.
[2025-10-24T01:26:49.332493] [INFO ] [MAIN      ] Derivative Progress: 1455/2164 symbols completed. ONON took 1.2s. Estimated remaining: 4m 56s. Rate: 143.5 symbols/min
[2025-10-24T01:26:49.333054] [INFO ] [MAIN      ] OPAD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:49.333173] [INFO ] [MAIN      ] OOMA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:49.332950] [INFO ] [MAIN      ] ONTO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:49.376448] [DEBUG] [LOCAL     ] OOMA: Loaded 18375 existing records from primary storage.
[2025-10-24T01:26:49.377198] [DEBUG] [LOCAL     ] OPAD: Loaded 26687 existing records from primary storage.
[2025-10-24T01:26:49.377774] [INFO ] [MAIN      ] OPAD: Loaded 26687 primary data records.
[2025-10-24T01:26:49.377589] [INFO ] [MAIN      ] OOMA: Loaded 18375 primary data records.
[2025-10-24T01:26:49.612070] [DEBUG] [LOCAL     ] ONTO: Loaded 47505 existing records from primary storage.
[2025-10-24T01:26:49.619959] [INFO ] [MAIN      ] ONTO: Loaded 47505 primary data records.
[2025-10-24T01:26:50.371763] [DEBUG] [MAIN      ] OPAD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:50.372326] [DEBUG] [MAIN      ] OOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:50.425763] [DEBUG] [MAIN      ] ONTO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:50.493954] [INFO ] [MAIN      ] OPAD: Generated 139 derivative records from 26687 primary records.
[2025-10-24T01:26:50.496952] [DEBUG] [LOCAL     ] OPAD: Saving derivative data.
[2025-10-24T01:26:50.496785] [INFO ] [MAIN      ] OOMA: Generated 139 derivative records from 18375 primary records.
[2025-10-24T01:26:50.513155] [DEBUG] [LOCAL     ] OOMA: Saving derivative data.
[2025-10-24T01:26:50.513032] [DEBUG] [LOCAL     ] OPAD: Derivative data saved (139 records).
[2025-10-24T01:26:50.526455] [DEBUG] [LOCAL     ] OOMA: Derivative data saved (139 records).
[2025-10-24T01:26:50.514476] [INFO ] [MAIN      ] OPAD: Successfully saved derivative data.
[2025-10-24T01:26:50.528835] [INFO ] [MAIN      ] OOMA: Successfully saved derivative data.
[2025-10-24T01:26:50.531573] [INFO ] [MAIN      ] Derivative Progress: 1456/2164 symbols completed. OPAD took 1.2s. Estimated remaining: 4m 56s. Rate: 143.3 symbols/min
[2025-10-24T01:26:50.534353] [INFO ] [MAIN      ] OPFI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:50.528696] [INFO ] [MAIN      ] ONTO: Generated 139 derivative records from 47505 primary records.
[2025-10-24T01:26:50.534584] [INFO ] [MAIN      ] Derivative Progress: 1457/2164 symbols completed. OOMA took 1.2s. Estimated remaining: 4m 56s. Rate: 143.4 symbols/min
[2025-10-24T01:26:50.534730] [DEBUG] [LOCAL     ] ONTO: Saving derivative data.
[2025-10-24T01:26:50.535360] [INFO ] [MAIN      ] OPP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:50.549685] [DEBUG] [LOCAL     ] ONTO: Derivative data saved (139 records).
[2025-10-24T01:26:50.549965] [INFO ] [MAIN      ] ONTO: Successfully saved derivative data.
[2025-10-24T01:26:50.553334] [INFO ] [MAIN      ] Derivative Progress: 1458/2164 symbols completed. ONTO took 1.2s. Estimated remaining: 4m 55s. Rate: 143.5 symbols/min
[2025-10-24T01:26:50.553724] [INFO ] [MAIN      ] OR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:50.563759] [DEBUG] [LOCAL     ] OPP: Loaded 12463 existing records from primary storage.
[2025-10-24T01:26:50.564058] [INFO ] [MAIN      ] OPP: Loaded 12463 primary data records.
[2025-10-24T01:26:50.938705] [DEBUG] [LOCAL     ] OPFI: Loaded 46281 existing records from primary storage.
[2025-10-24T01:26:50.939117] [INFO ] [MAIN      ] OPFI: Loaded 46281 primary data records.
[2025-10-24T01:26:51.068328] [DEBUG] [LOCAL     ] OR: Loaded 47206 existing records from primary storage.
[2025-10-24T01:26:51.071804] [INFO ] [MAIN      ] OR: Loaded 47206 primary data records.
[2025-10-24T01:26:51.577635] [DEBUG] [MAIN      ] OPP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:51.640020] [DEBUG] [MAIN      ] OPFI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:51.660063] [INFO ] [MAIN      ] OPP: Generated 139 derivative records from 12463 primary records.
[2025-10-24T01:26:51.662042] [DEBUG] [LOCAL     ] OPP: Saving derivative data.
[2025-10-24T01:26:51.686551] [DEBUG] [LOCAL     ] OPP: Derivative data saved (139 records).
[2025-10-24T01:26:51.688416] [INFO ] [MAIN      ] OPP: Successfully saved derivative data.
[2025-10-24T01:26:51.687064] [DEBUG] [MAIN      ] OR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:51.692294] [INFO ] [MAIN      ] Derivative Progress: 1459/2164 symbols completed. OPP took 1.2s. Estimated remaining: 4m 55s. Rate: 143.4 symbols/min
[2025-10-24T01:26:51.692615] [INFO ] [MAIN      ] ORA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:51.753609] [INFO ] [MAIN      ] OPFI: Generated 139 derivative records from 46281 primary records.
[2025-10-24T01:26:51.757283] [INFO ] [MAIN      ] OR: Generated 139 derivative records from 47206 primary records.
[2025-10-24T01:26:51.757501] [DEBUG] [LOCAL     ] OPFI: Saving derivative data.
[2025-10-24T01:26:51.757745] [DEBUG] [LOCAL     ] OR: Saving derivative data.
[2025-10-24T01:26:51.794288] [DEBUG] [LOCAL     ] ORA: Loaded 33371 existing records from primary storage.
[2025-10-24T01:26:51.797323] [INFO ] [MAIN      ] ORA: Loaded 33371 primary data records.
[2025-10-24T01:26:51.821698] [DEBUG] [LOCAL     ] OR: Derivative data saved (139 records).
[2025-10-24T01:26:51.845045] [DEBUG] [LOCAL     ] OPFI: Derivative data saved (139 records).
[2025-10-24T01:26:51.866255] [INFO ] [MAIN      ] OR: Successfully saved derivative data.
[2025-10-24T01:26:51.885965] [INFO ] [MAIN      ] Derivative Progress: 1460/2164 symbols completed. OR took 1.3s. Estimated remaining: 4m 55s. Rate: 143.4 symbols/min
[2025-10-24T01:26:51.866479] [INFO ] [MAIN      ] OPFI: Successfully saved derivative data.
[2025-10-24T01:26:51.913616] [INFO ] [MAIN      ] ORC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:51.917705] [INFO ] [MAIN      ] Derivative Progress: 1461/2164 symbols completed. OPFI took 1.4s. Estimated remaining: 4m 54s. Rate: 143.5 symbols/min
[2025-10-24T01:26:51.929753] [INFO ] [MAIN      ] ORN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:52.171196] [DEBUG] [LOCAL     ] ORN: Loaded 30896 existing records from primary storage.
[2025-10-24T01:26:52.173138] [INFO ] [MAIN      ] ORN: Loaded 30896 primary data records.
[2025-10-24T01:26:52.186380] [DEBUG] [LOCAL     ] ORC: Loaded 52861 existing records from primary storage.
[2025-10-24T01:26:52.211557] [INFO ] [MAIN      ] ORC: Loaded 52861 primary data records.
[2025-10-24T01:26:52.366609] [DEBUG] [MAIN      ] ORA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:52.950010] [INFO ] [MAIN      ] ORA: Generated 139 derivative records from 33371 primary records.
[2025-10-24T01:26:52.950900] [DEBUG] [LOCAL     ] ORA: Saving derivative data.
[2025-10-24T01:26:52.966306] [DEBUG] [LOCAL     ] ORA: Derivative data saved (139 records).
[2025-10-24T01:26:52.966616] [INFO ] [MAIN      ] ORA: Successfully saved derivative data.
[2025-10-24T01:26:52.969096] [INFO ] [MAIN      ] Derivative Progress: 1462/2164 symbols completed. ORA took 1.3s. Estimated remaining: 4m 54s. Rate: 143.4 symbols/min
[2025-10-24T01:26:52.971607] [INFO ] [MAIN      ] OSCR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:52.991283] [DEBUG] [MAIN      ] ORN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:53.016286] [DEBUG] [MAIN      ] ORC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:53.110934] [INFO ] [MAIN      ] ORN: Generated 139 derivative records from 30896 primary records.
[2025-10-24T01:26:53.111617] [DEBUG] [LOCAL     ] ORN: Saving derivative data.
[2025-10-24T01:26:53.112823] [DEBUG] [LOCAL     ] OSCR: Loaded 54159 existing records from primary storage.
[2025-10-24T01:26:53.123998] [INFO ] [MAIN      ] OSCR: Loaded 54159 primary data records.
[2025-10-24T01:26:53.128771] [DEBUG] [LOCAL     ] ORN: Derivative data saved (139 records).
[2025-10-24T01:26:53.129163] [INFO ] [MAIN      ] ORN: Successfully saved derivative data.
[2025-10-24T01:26:53.162150] [INFO ] [MAIN      ] ORC: Generated 139 derivative records from 52861 primary records.
[2025-10-24T01:26:53.164998] [INFO ] [MAIN      ] Derivative Progress: 1463/2164 symbols completed. ORN took 1.2s. Estimated remaining: 4m 53s. Rate: 143.4 symbols/min
[2025-10-24T01:26:53.216844] [INFO ] [MAIN      ] OTIS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:53.216550] [DEBUG] [LOCAL     ] ORC: Saving derivative data.
[2025-10-24T01:26:53.302458] [DEBUG] [LOCAL     ] ORC: Derivative data saved (139 records).
[2025-10-24T01:26:53.448026] [INFO ] [MAIN      ] ORC: Successfully saved derivative data.
[2025-10-24T01:26:53.451911] [INFO ] [MAIN      ] Derivative Progress: 1464/2164 symbols completed. ORC took 1.5s. Estimated remaining: 4m 53s. Rate: 143.4 symbols/min
[2025-10-24T01:26:53.452182] [INFO ] [MAIN      ] OUT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:53.499638] [DEBUG] [MAIN      ] OSCR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:53.544881] [DEBUG] [LOCAL     ] OTIS: Loaded 53082 existing records from primary storage.
[2025-10-24T01:26:53.546923] [INFO ] [MAIN      ] OTIS: Loaded 53082 primary data records.
[2025-10-24T01:26:53.713454] [DEBUG] [LOCAL     ] OUT: Loaded 48059 existing records from primary storage.
[2025-10-24T01:26:53.896098] [INFO ] [MAIN      ] OUT: Loaded 48059 primary data records.
[2025-10-24T01:26:54.026488] [INFO ] [MAIN      ] OSCR: Generated 139 derivative records from 54159 primary records.
[2025-10-24T01:26:54.027078] [DEBUG] [LOCAL     ] OSCR: Saving derivative data.
[2025-10-24T01:26:54.231689] [DEBUG] [LOCAL     ] OSCR: Derivative data saved (139 records).
[2025-10-24T01:26:54.240829] [INFO ] [MAIN      ] OSCR: Successfully saved derivative data.
[2025-10-24T01:26:54.244840] [INFO ] [MAIN      ] Derivative Progress: 1465/2164 symbols completed. OSCR took 1.3s. Estimated remaining: 4m 53s. Rate: 143.3 symbols/min
[2025-10-24T01:26:54.245533] [INFO ] [MAIN      ] OVV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:54.270087] [DEBUG] [MAIN      ] OTIS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:54.315432] [DEBUG] [MAIN      ] OUT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:54.382300] [INFO ] [MAIN      ] OTIS: Generated 139 derivative records from 53082 primary records.
[2025-10-24T01:26:54.389325] [DEBUG] [LOCAL     ] OVV: Loaded 53884 existing records from primary storage.
[2025-10-24T01:26:54.384156] [DEBUG] [LOCAL     ] OTIS: Saving derivative data.
[2025-10-24T01:26:54.389773] [INFO ] [MAIN      ] OVV: Loaded 53884 primary data records.
[2025-10-24T01:26:54.438253] [DEBUG] [LOCAL     ] OTIS: Derivative data saved (139 records).
[2025-10-24T01:26:54.459728] [INFO ] [MAIN      ] OTIS: Successfully saved derivative data.
[2025-10-24T01:26:54.486040] [INFO ] [MAIN      ] Derivative Progress: 1466/2164 symbols completed. OTIS took 1.3s. Estimated remaining: 4m 52s. Rate: 143.4 symbols/min
[2025-10-24T01:26:54.522319] [INFO ] [MAIN      ] OWL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:54.738826] [INFO ] [MAIN      ] OUT: Generated 139 derivative records from 48059 primary records.
[2025-10-24T01:26:54.739151] [DEBUG] [LOCAL     ] OUT: Saving derivative data.
[2025-10-24T01:26:54.753544] [DEBUG] [LOCAL     ] OUT: Derivative data saved (139 records).
[2025-10-24T01:26:54.753781] [INFO ] [MAIN      ] OUT: Successfully saved derivative data.
[2025-10-24T01:26:54.756559] [INFO ] [MAIN      ] Derivative Progress: 1467/2164 symbols completed. OUT took 1.3s. Estimated remaining: 4m 52s. Rate: 143.4 symbols/min
[2025-10-24T01:26:54.757352] [INFO ] [MAIN      ] OWLT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:54.785725] [DEBUG] [LOCAL     ] OWLT: Loaded 9966 existing records from primary storage.
[2025-10-24T01:26:54.786282] [INFO ] [MAIN      ] OWLT: Loaded 9966 primary data records.
[2025-10-24T01:26:54.929075] [DEBUG] [MAIN      ] OVV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:54.941521] [DEBUG] [LOCAL     ] OWL: Loaded 53950 existing records from primary storage.
[2025-10-24T01:26:54.948353] [INFO ] [MAIN      ] OWL: Loaded 53950 primary data records.
[2025-10-24T01:26:55.614729] [INFO ] [MAIN      ] OVV: Generated 139 derivative records from 53884 primary records.
[2025-10-24T01:26:55.616349] [DEBUG] [LOCAL     ] OVV: Saving derivative data.
[2025-10-24T01:26:55.616802] [DEBUG] [MAIN      ] OWLT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:55.649839] [DEBUG] [LOCAL     ] OVV: Derivative data saved (139 records).
[2025-10-24T01:26:55.650023] [INFO ] [MAIN      ] OVV: Successfully saved derivative data.
[2025-10-24T01:26:55.653327] [INFO ] [MAIN      ] Derivative Progress: 1468/2164 symbols completed. OVV took 1.4s. Estimated remaining: 4m 51s. Rate: 143.3 symbols/min
[2025-10-24T01:26:55.688382] [DEBUG] [MAIN      ] OWL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:55.706013] [INFO ] [MAIN      ] OWLT: Generated 139 derivative records from 9966 primary records.
[2025-10-24T01:26:55.707619] [DEBUG] [LOCAL     ] OWLT: Saving derivative data.
[2025-10-24T01:26:55.726054] [DEBUG] [LOCAL     ] OWLT: Derivative data saved (139 records).
[2025-10-24T01:26:55.727418] [INFO ] [MAIN      ] OWLT: Successfully saved derivative data.
[2025-10-24T01:26:55.731900] [INFO ] [MAIN      ] Derivative Progress: 1469/2164 symbols completed. OWLT took 1.0s. Estimated remaining: 4m 51s. Rate: 143.4 symbols/min
[2025-10-24T01:26:55.739476] [INFO ] [MAIN      ] OWL: Generated 139 derivative records from 53950 primary records.
[2025-10-24T01:26:55.739582] [DEBUG] [LOCAL     ] OWL: Saving derivative data.
[2025-10-24T01:26:55.752251] [DEBUG] [LOCAL     ] OWL: Derivative data saved (139 records).
[2025-10-24T01:26:55.752338] [INFO ] [MAIN      ] OWL: Successfully saved derivative data.
[2025-10-24T01:26:55.756669] [INFO ] [MAIN      ] Derivative Progress: 1470/2164 symbols completed. OWL took 1.2s. Estimated remaining: 4m 50s. Rate: 143.5 symbols/min
[2025-10-24T01:26:55.757183] [INFO ] [MAIN      ] OXM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:55.757395] [INFO ] [MAIN      ] PAC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:55.757531] [INFO ] [MAIN      ] PAAS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:55.777111] [DEBUG] [LOCAL     ] PAC: Loaded 11602 existing records from primary storage.
[2025-10-24T01:26:55.777325] [INFO ] [MAIN      ] PAC: Loaded 11602 primary data records.
[2025-10-24T01:26:55.911769] [DEBUG] [LOCAL     ] OXM: Loaded 33367 existing records from primary storage.
[2025-10-24T01:26:55.944993] [INFO ] [MAIN      ] OXM: Loaded 33367 primary data records.
[2025-10-24T01:26:56.224254] [DEBUG] [LOCAL     ] PAAS: Loaded 54015 existing records from primary storage.
[2025-10-24T01:26:56.238159] [INFO ] [MAIN      ] PAAS: Loaded 54015 primary data records.
[2025-10-24T01:26:56.811947] [DEBUG] [MAIN      ] PAC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:56.871031] [DEBUG] [MAIN      ] OXM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:56.895004] [INFO ] [MAIN      ] PAC: Generated 139 derivative records from 11602 primary records.
[2025-10-24T01:26:56.899908] [DEBUG] [LOCAL     ] PAC: Saving derivative data.
[2025-10-24T01:26:56.926868] [DEBUG] [MAIN      ] PAAS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:56.948877] [DEBUG] [LOCAL     ] PAC: Derivative data saved (139 records).
[2025-10-24T01:26:56.954264] [INFO ] [MAIN      ] PAC: Successfully saved derivative data.
[2025-10-24T01:26:56.963992] [INFO ] [MAIN      ] Derivative Progress: 1471/2164 symbols completed. PAC took 1.2s. Estimated remaining: 4m 50s. Rate: 143.3 symbols/min
[2025-10-24T01:26:56.964628] [INFO ] [MAIN      ] PACK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:57.003041] [INFO ] [MAIN      ] OXM: Generated 139 derivative records from 33367 primary records.
[2025-10-24T01:26:57.004984] [INFO ] [MAIN      ] PAAS: Generated 139 derivative records from 54015 primary records.
[2025-10-24T01:26:57.005277] [DEBUG] [LOCAL     ] PAAS: Saving derivative data.
[2025-10-24T01:26:57.005369] [DEBUG] [LOCAL     ] OXM: Saving derivative data.
[2025-10-24T01:26:57.038542] [DEBUG] [LOCAL     ] PAAS: Derivative data saved (139 records).
[2025-10-24T01:26:57.028560] [DEBUG] [LOCAL     ] PACK: Loaded 32108 existing records from primary storage.
[2025-10-24T01:26:57.038936] [INFO ] [MAIN      ] PAAS: Successfully saved derivative data.
[2025-10-24T01:26:57.041237] [INFO ] [MAIN      ] PACK: Loaded 32108 primary data records.
[2025-10-24T01:26:57.044165] [DEBUG] [LOCAL     ] OXM: Derivative data saved (139 records).
[2025-10-24T01:26:57.047277] [INFO ] [MAIN      ] Derivative Progress: 1472/2164 symbols completed. PAAS took 1.3s. Estimated remaining: 4m 50s. Rate: 143.4 symbols/min
[2025-10-24T01:26:57.047581] [INFO ] [MAIN      ] PACS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:57.047714] [INFO ] [MAIN      ] OXM: Successfully saved derivative data.
[2025-10-24T01:26:57.075163] [INFO ] [MAIN      ] Derivative Progress: 1473/2164 symbols completed. OXM took 1.3s. Estimated remaining: 4m 49s. Rate: 143.5 symbols/min
[2025-10-24T01:26:57.087257] [INFO ] [MAIN      ] PAG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:57.437824] [DEBUG] [LOCAL     ] PACS: Loaded 34973 existing records from primary storage.
[2025-10-24T01:26:57.439116] [INFO ] [MAIN      ] PACS: Loaded 34973 primary data records.
[2025-10-24T01:26:57.440158] [DEBUG] [LOCAL     ] PAG: Loaded 21424 existing records from primary storage.
[2025-10-24T01:26:57.464146] [INFO ] [MAIN      ] PAG: Loaded 21424 primary data records.
[2025-10-24T01:26:58.110756] [DEBUG] [MAIN      ] PACK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:58.183998] [DEBUG] [MAIN      ] PACS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:58.184714] [DEBUG] [MAIN      ] PAG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:58.238007] [INFO ] [MAIN      ] PACK: Generated 139 derivative records from 32108 primary records.
[2025-10-24T01:26:58.242982] [DEBUG] [LOCAL     ] PACK: Saving derivative data.
[2025-10-24T01:26:58.260591] [DEBUG] [LOCAL     ] PACK: Derivative data saved (139 records).
[2025-10-24T01:26:58.265369] [INFO ] [MAIN      ] PACK: Successfully saved derivative data.
[2025-10-24T01:26:58.269608] [INFO ] [MAIN      ] Derivative Progress: 1474/2164 symbols completed. PACK took 1.3s. Estimated remaining: 4m 49s. Rate: 143.3 symbols/min
[2025-10-24T01:26:58.269992] [INFO ] [MAIN      ] PAGS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:58.287247] [INFO ] [MAIN      ] PAG: Generated 139 derivative records from 21424 primary records.
[2025-10-24T01:26:58.289413] [DEBUG] [LOCAL     ] PAG: Saving derivative data.
[2025-10-24T01:26:58.306160] [DEBUG] [LOCAL     ] PAG: Derivative data saved (139 records).
[2025-10-24T01:26:58.306864] [INFO ] [MAIN      ] PAG: Successfully saved derivative data.
[2025-10-24T01:26:58.310584] [INFO ] [MAIN      ] Derivative Progress: 1475/2164 symbols completed. PAG took 1.2s. Estimated remaining: 4m 48s. Rate: 143.4 symbols/min
[2025-10-24T01:26:58.314011] [INFO ] [MAIN      ] PAI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:58.314542] [INFO ] [MAIN      ] PACS: Generated 139 derivative records from 34973 primary records.
[2025-10-24T01:26:58.315345] [DEBUG] [LOCAL     ] PACS: Saving derivative data.
[2025-10-24T01:26:58.329383] [DEBUG] [LOCAL     ] PACS: Derivative data saved (139 records).
[2025-10-24T01:26:58.329831] [INFO ] [MAIN      ] PACS: Successfully saved derivative data.
[2025-10-24T01:26:58.332625] [INFO ] [MAIN      ] Derivative Progress: 1476/2164 symbols completed. PACS took 1.3s. Estimated remaining: 4m 48s. Rate: 143.5 symbols/min
[2025-10-24T01:26:58.348277] [INFO ] [MAIN      ] PAM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:58.351878] [DEBUG] [LOCAL     ] PAI: Loaded 2872 existing records from primary storage.
[2025-10-24T01:26:58.352077] [INFO ] [MAIN      ] PAI: Loaded 2872 primary data records.
[2025-10-24T01:26:58.502849] [DEBUG] [LOCAL     ] PAGS: Loaded 53193 existing records from primary storage.
[2025-10-24T01:26:58.559199] [INFO ] [MAIN      ] PAGS: Loaded 53193 primary data records.
[2025-10-24T01:26:58.697473] [DEBUG] [LOCAL     ] PAM: Loaded 29368 existing records from primary storage.
[2025-10-24T01:26:58.714936] [INFO ] [MAIN      ] PAM: Loaded 29368 primary data records.
[2025-10-24T01:26:59.417835] [DEBUG] [MAIN      ] PAI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:59.465485] [INFO ] [MAIN      ] PAI: Generated 139 derivative records from 2872 primary records.
[2025-10-24T01:26:59.465971] [DEBUG] [LOCAL     ] PAI: Saving derivative data.
[2025-10-24T01:26:59.491971] [DEBUG] [LOCAL     ] PAI: Derivative data saved (139 records).
[2025-10-24T01:26:59.487915] [DEBUG] [MAIN      ] PAGS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:59.492208] [INFO ] [MAIN      ] PAI: Successfully saved derivative data.
[2025-10-24T01:26:59.505998] [INFO ] [MAIN      ] Derivative Progress: 1477/2164 symbols completed. PAI took 1.2s. Estimated remaining: 4m 48s. Rate: 143.3 symbols/min
[2025-10-24T01:26:59.507340] [INFO ] [MAIN      ] PAR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:59.525221] [DEBUG] [MAIN      ] PAM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:26:59.592767] [DEBUG] [LOCAL     ] PAR: Loaded 34604 existing records from primary storage.
[2025-10-24T01:26:59.594173] [INFO ] [MAIN      ] PAR: Loaded 34604 primary data records.
[2025-10-24T01:26:59.646894] [INFO ] [MAIN      ] PAGS: Generated 139 derivative records from 53193 primary records.
[2025-10-24T01:26:59.667835] [DEBUG] [LOCAL     ] PAGS: Saving derivative data.
[2025-10-24T01:26:59.725244] [DEBUG] [LOCAL     ] PAGS: Derivative data saved (139 records).
[2025-10-24T01:26:59.737734] [INFO ] [MAIN      ] PAGS: Successfully saved derivative data.
[2025-10-24T01:26:59.747556] [INFO ] [MAIN      ] Derivative Progress: 1478/2164 symbols completed. PAGS took 1.5s. Estimated remaining: 4m 47s. Rate: 143.3 symbols/min
[2025-10-24T01:26:59.772404] [INFO ] [MAIN      ] PARR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:59.931861] [INFO ] [MAIN      ] PAM: Generated 139 derivative records from 29368 primary records.
[2025-10-24T01:26:59.933571] [DEBUG] [LOCAL     ] PAM: Saving derivative data.
[2025-10-24T01:26:59.948241] [DEBUG] [LOCAL     ] PAM: Derivative data saved (139 records).
[2025-10-24T01:26:59.948609] [INFO ] [MAIN      ] PAM: Successfully saved derivative data.
[2025-10-24T01:26:59.952771] [INFO ] [MAIN      ] Derivative Progress: 1479/2164 symbols completed. PAM took 1.6s. Estimated remaining: 4m 47s. Rate: 143.4 symbols/min
[2025-10-24T01:26:59.953052] [INFO ] [MAIN      ] PATH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:26:59.978288] [DEBUG] [MAIN      ] PAR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:00.032062] [DEBUG] [LOCAL     ] PARR: Loaded 48324 existing records from primary storage.
[2025-10-24T01:27:00.032508] [INFO ] [MAIN      ] PARR: Loaded 48324 primary data records.
[2025-10-24T01:27:00.200865] [DEBUG] [LOCAL     ] PATH: Loaded 54070 existing records from primary storage.
[2025-10-24T01:27:00.206871] [INFO ] [MAIN      ] PATH: Loaded 54070 primary data records.
[2025-10-24T01:27:00.358293] [INFO ] [MAIN      ] PAR: Generated 139 derivative records from 34604 primary records.
[2025-10-24T01:27:00.508305] [DEBUG] [LOCAL     ] PAR: Saving derivative data.
[2025-10-24T01:27:00.605879] [DEBUG] [LOCAL     ] PAR: Derivative data saved (139 records).
[2025-10-24T01:27:00.714835] [INFO ] [MAIN      ] PAR: Successfully saved derivative data.
[2025-10-24T01:27:00.728191] [INFO ] [MAIN      ] Derivative Progress: 1480/2164 symbols completed. PAR took 1.2s. Estimated remaining: 4m 46s. Rate: 143.3 symbols/min
[2025-10-24T01:27:00.728938] [INFO ] [MAIN      ] PAXS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:00.761406] [DEBUG] [MAIN      ] PARR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:00.786741] [DEBUG] [LOCAL     ] PAXS: Loaded 21019 existing records from primary storage.
[2025-10-24T01:27:00.789380] [INFO ] [MAIN      ] PAXS: Loaded 21019 primary data records.
[2025-10-24T01:27:00.868366] [DEBUG] [MAIN      ] PATH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:01.222264] [INFO ] [MAIN      ] PARR: Generated 139 derivative records from 48324 primary records.
[2025-10-24T01:27:01.224581] [DEBUG] [LOCAL     ] PARR: Saving derivative data.
[2025-10-24T01:27:01.230822] [INFO ] [MAIN      ] PATH: Generated 139 derivative records from 54070 primary records.
[2025-10-24T01:27:01.241745] [DEBUG] [LOCAL     ] PATH: Saving derivative data.
[2025-10-24T01:27:01.246106] [DEBUG] [LOCAL     ] PARR: Derivative data saved (139 records).
[2025-10-24T01:27:01.257043] [INFO ] [MAIN      ] PARR: Successfully saved derivative data.
[2025-10-24T01:27:01.260043] [DEBUG] [LOCAL     ] PATH: Derivative data saved (139 records).
[2025-10-24T01:27:01.263952] [INFO ] [MAIN      ] Derivative Progress: 1481/2164 symbols completed. PARR took 1.5s. Estimated remaining: 4m 46s. Rate: 143.3 symbols/min
[2025-10-24T01:27:01.264703] [INFO ] [MAIN      ] PAY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:01.265252] [INFO ] [MAIN      ] PATH: Successfully saved derivative data.
[2025-10-24T01:27:01.270921] [INFO ] [MAIN      ] Derivative Progress: 1482/2164 symbols completed. PATH took 1.3s. Estimated remaining: 4m 45s. Rate: 143.4 symbols/min
[2025-10-24T01:27:01.273601] [INFO ] [MAIN      ] PAYC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:01.301420] [DEBUG] [MAIN      ] PAXS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:01.394244] [DEBUG] [LOCAL     ] PAY: Loaded 38809 existing records from primary storage.
[2025-10-24T01:27:01.397049] [INFO ] [MAIN      ] PAXS: Generated 139 derivative records from 21019 primary records.
[2025-10-24T01:27:01.398024] [DEBUG] [LOCAL     ] PAYC: Loaded 36283 existing records from primary storage.
[2025-10-24T01:27:01.398546] [INFO ] [MAIN      ] PAY: Loaded 38809 primary data records.
[2025-10-24T01:27:01.398817] [INFO ] [MAIN      ] PAYC: Loaded 36283 primary data records.
[2025-10-24T01:27:01.398755] [DEBUG] [LOCAL     ] PAXS: Saving derivative data.
[2025-10-24T01:27:01.520768] [DEBUG] [LOCAL     ] PAXS: Derivative data saved (139 records).
[2025-10-24T01:27:01.566216] [INFO ] [MAIN      ] PAXS: Successfully saved derivative data.
[2025-10-24T01:27:01.596976] [INFO ] [MAIN      ] Derivative Progress: 1483/2164 symbols completed. PAXS took 0.9s. Estimated remaining: 4m 45s. Rate: 143.4 symbols/min
[2025-10-24T01:27:02.201310] [DEBUG] [MAIN      ] PAYC: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:27:02.234200] [DEBUG] [MAIN      ] PAY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:02.291889] [INFO ] [MAIN      ] PAYC: Generated 139 derivative records from 36283 primary records.
[2025-10-24T01:27:02.295528] [DEBUG] [LOCAL     ] PAYC: Saving derivative data.
[2025-10-24T01:27:02.300601] [INFO ] [MAIN      ] PAY: Generated 139 derivative records from 38809 primary records.
[2025-10-24T01:27:02.310323] [DEBUG] [LOCAL     ] PAY: Saving derivative data.
[2025-10-24T01:27:02.313297] [DEBUG] [LOCAL     ] PAYC: Derivative data saved (139 records).
[2025-10-24T01:27:02.313519] [INFO ] [MAIN      ] PAYC: Successfully saved derivative data.
[2025-10-24T01:27:02.318430] [INFO ] [MAIN      ] Derivative Progress: 1484/2164 symbols completed. PAYC took 1.0s. Estimated remaining: 4m 45s. Rate: 143.3 symbols/min
[2025-10-24T01:27:02.331139] [DEBUG] [LOCAL     ] PAY: Derivative data saved (139 records).
[2025-10-24T01:27:02.331256] [INFO ] [MAIN      ] PAY: Successfully saved derivative data.
[2025-10-24T01:27:02.334429] [INFO ] [MAIN      ] Derivative Progress: 1485/2164 symbols completed. PAY took 1.1s. Estimated remaining: 4m 44s. Rate: 143.4 symbols/min
[2025-10-24T01:27:02.335110] [INFO ] [MAIN      ] PBA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:02.335013] [INFO ] [MAIN      ] PB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:02.336166] [INFO ] [MAIN      ] PBF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:02.407616] [DEBUG] [LOCAL     ] PB: Loaded 42660 existing records from primary storage.
[2025-10-24T01:27:02.408210] [INFO ] [MAIN      ] PB: Loaded 42660 primary data records.
[2025-10-24T01:27:02.487425] [DEBUG] [LOCAL     ] PBA: Loaded 49535 existing records from primary storage.
[2025-10-24T01:27:02.524261] [INFO ] [MAIN      ] PBA: Loaded 49535 primary data records.
[2025-10-24T01:27:02.550143] [DEBUG] [LOCAL     ] PBF: Loaded 53493 existing records from primary storage.
[2025-10-24T01:27:02.555414] [INFO ] [MAIN      ] PBF: Loaded 53493 primary data records.
[2025-10-24T01:27:03.415162] [DEBUG] [MAIN      ] PB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:03.462867] [DEBUG] [MAIN      ] PBF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:03.492008] [DEBUG] [MAIN      ] PBA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:03.518038] [INFO ] [MAIN      ] PB: Generated 139 derivative records from 42660 primary records.
[2025-10-24T01:27:03.519613] [DEBUG] [LOCAL     ] PB: Saving derivative data.
[2025-10-24T01:27:03.541282] [DEBUG] [LOCAL     ] PB: Derivative data saved (139 records).
[2025-10-24T01:27:03.547544] [INFO ] [MAIN      ] PB: Successfully saved derivative data.
[2025-10-24T01:27:03.552449] [INFO ] [MAIN      ] Derivative Progress: 1486/2164 symbols completed. PB took 1.2s. Estimated remaining: 4m 44s. Rate: 143.2 symbols/min
[2025-10-24T01:27:03.558234] [INFO ] [MAIN      ] PBH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:03.567017] [INFO ] [MAIN      ] PBF: Generated 139 derivative records from 53493 primary records.
[2025-10-24T01:27:03.568576] [DEBUG] [LOCAL     ] PBF: Saving derivative data.
[2025-10-24T01:27:03.578946] [INFO ] [MAIN      ] PBA: Generated 139 derivative records from 49535 primary records.
[2025-10-24T01:27:03.583494] [DEBUG] [LOCAL     ] PBA: Saving derivative data.
[2025-10-24T01:27:03.583854] [DEBUG] [LOCAL     ] PBF: Derivative data saved (139 records).
[2025-10-24T01:27:03.584967] [INFO ] [MAIN      ] PBF: Successfully saved derivative data.
[2025-10-24T01:27:03.594910] [INFO ] [MAIN      ] Derivative Progress: 1487/2164 symbols completed. PBF took 1.3s. Estimated remaining: 4m 43s. Rate: 143.3 symbols/min
[2025-10-24T01:27:03.595208] [INFO ] [MAIN      ] PBI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:03.608084] [DEBUG] [LOCAL     ] PBA: Derivative data saved (139 records).
[2025-10-24T01:27:03.608248] [INFO ] [MAIN      ] PBA: Successfully saved derivative data.
[2025-10-24T01:27:03.611276] [INFO ] [MAIN      ] Derivative Progress: 1488/2164 symbols completed. PBA took 1.3s. Estimated remaining: 4m 43s. Rate: 143.4 symbols/min
[2025-10-24T01:27:03.611568] [INFO ] [MAIN      ] PBR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:03.624983] [DEBUG] [LOCAL     ] PBH: Loaded 32673 existing records from primary storage.
[2025-10-24T01:27:03.625316] [INFO ] [MAIN      ] PBH: Loaded 32673 primary data records.
[2025-10-24T01:27:04.028512] [DEBUG] [LOCAL     ] PBI: Loaded 50327 existing records from primary storage.
[2025-10-24T01:27:04.026216] [DEBUG] [LOCAL     ] PBR: Loaded 54103 existing records from primary storage.
[2025-10-24T01:27:04.029314] [INFO ] [MAIN      ] PBI: Loaded 50327 primary data records.
[2025-10-24T01:27:04.029391] [INFO ] [MAIN      ] PBR: Loaded 54103 primary data records.
[2025-10-24T01:27:04.842619] [DEBUG] [MAIN      ] PBH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:04.909524] [DEBUG] [MAIN      ] PBI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:04.951098] [DEBUG] [MAIN      ] PBR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:04.955877] [INFO ] [MAIN      ] PBH: Generated 139 derivative records from 32673 primary records.
[2025-10-24T01:27:04.957960] [DEBUG] [LOCAL     ] PBH: Saving derivative data.
[2025-10-24T01:27:05.000279] [DEBUG] [LOCAL     ] PBH: Derivative data saved (139 records).
[2025-10-24T01:27:05.001299] [INFO ] [MAIN      ] PBH: Successfully saved derivative data.
[2025-10-24T01:27:05.011429] [INFO ] [MAIN      ] Derivative Progress: 1489/2164 symbols completed. PBH took 1.5s. Estimated remaining: 4m 43s. Rate: 143.2 symbols/min
[2025-10-24T01:27:05.014912] [INFO ] [MAIN      ] PBT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:05.050360] [INFO ] [MAIN      ] PBI: Generated 139 derivative records from 50327 primary records.
[2025-10-24T01:27:05.051200] [DEBUG] [LOCAL     ] PBI: Saving derivative data.
[2025-10-24T01:27:05.077568] [INFO ] [MAIN      ] PBR: Generated 139 derivative records from 54103 primary records.
[2025-10-24T01:27:05.079666] [DEBUG] [LOCAL     ] PBR: Saving derivative data.
[2025-10-24T01:27:05.082043] [DEBUG] [LOCAL     ] PBI: Derivative data saved (139 records).
[2025-10-24T01:27:05.079227] [DEBUG] [LOCAL     ] PBT: Loaded 17415 existing records from primary storage.
[2025-10-24T01:27:05.090798] [INFO ] [MAIN      ] PBI: Successfully saved derivative data.
[2025-10-24T01:27:05.096452] [INFO ] [MAIN      ] PBT: Loaded 17415 primary data records.
[2025-10-24T01:27:05.096342] [INFO ] [MAIN      ] Derivative Progress: 1490/2164 symbols completed. PBI took 1.5s. Estimated remaining: 4m 42s. Rate: 143.3 symbols/min
[2025-10-24T01:27:05.104915] [DEBUG] [LOCAL     ] PBR: Derivative data saved (139 records).
[2025-10-24T01:27:05.097205] [INFO ] [MAIN      ] PCF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:05.115619] [INFO ] [MAIN      ] PBR: Successfully saved derivative data.
[2025-10-24T01:27:05.146417] [INFO ] [MAIN      ] Derivative Progress: 1491/2164 symbols completed. PBR took 1.5s. Estimated remaining: 4m 42s. Rate: 143.3 symbols/min
[2025-10-24T01:27:05.183221] [INFO ] [MAIN      ] PCG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:05.234905] [DEBUG] [LOCAL     ] PCF: Loaded 9131 existing records from primary storage.
[2025-10-24T01:27:05.235110] [INFO ] [MAIN      ] PCF: Loaded 9131 primary data records.
[2025-10-24T01:27:05.810721] [DEBUG] [LOCAL     ] PCG: Loaded 54109 existing records from primary storage.
[2025-10-24T01:27:05.811479] [INFO ] [MAIN      ] PCG: Loaded 54109 primary data records.
[2025-10-24T01:27:05.932385] [DEBUG] [MAIN      ] PBT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:06.050701] [DEBUG] [MAIN      ] PCF: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:27:06.238786] [INFO ] [MAIN      ] PBT: Generated 139 derivative records from 17415 primary records.
[2025-10-24T01:27:06.239185] [DEBUG] [LOCAL     ] PBT: Saving derivative data.
[2025-10-24T01:27:06.256885] [DEBUG] [LOCAL     ] PBT: Derivative data saved (139 records).
[2025-10-24T01:27:06.258102] [INFO ] [MAIN      ] PBT: Successfully saved derivative data.
[2025-10-24T01:27:06.262813] [INFO ] [MAIN      ] Derivative Progress: 1492/2164 symbols completed. PBT took 1.2s. Estimated remaining: 4m 42s. Rate: 143.2 symbols/min
[2025-10-24T01:27:06.265501] [INFO ] [MAIN      ] PCF: Generated 139 derivative records from 9131 primary records.
[2025-10-24T01:27:06.274578] [INFO ] [MAIN      ] PCM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:06.274751] [DEBUG] [LOCAL     ] PCF: Saving derivative data.
[2025-10-24T01:27:06.287771] [DEBUG] [MAIN      ] PCG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:06.292371] [DEBUG] [LOCAL     ] PCF: Derivative data saved (139 records).
[2025-10-24T01:27:06.306205] [INFO ] [MAIN      ] PCF: Successfully saved derivative data.
[2025-10-24T01:27:06.309162] [INFO ] [MAIN      ] Derivative Progress: 1493/2164 symbols completed. PCF took 1.2s. Estimated remaining: 4m 41s. Rate: 143.3 symbols/min
[2025-10-24T01:27:06.311667] [INFO ] [MAIN      ] PCN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:06.324863] [DEBUG] [LOCAL     ] PCM: Loaded 6946 existing records from primary storage.
[2025-10-24T01:27:06.325470] [INFO ] [MAIN      ] PCM: Loaded 6946 primary data records.
[2025-10-24T01:27:06.515717] [DEBUG] [LOCAL     ] PCN: Loaded 25543 existing records from primary storage.
[2025-10-24T01:27:06.548026] [INFO ] [MAIN      ] PCN: Loaded 25543 primary data records.
[2025-10-24T01:27:06.771666] [INFO ] [MAIN      ] PCG: Generated 139 derivative records from 54109 primary records.
[2025-10-24T01:27:06.789772] [DEBUG] [LOCAL     ] PCG: Saving derivative data.
[2025-10-24T01:27:06.840733] [DEBUG] [LOCAL     ] PCG: Derivative data saved (139 records).
[2025-10-24T01:27:06.841041] [INFO ] [MAIN      ] PCG: Successfully saved derivative data.
[2025-10-24T01:27:06.845020] [INFO ] [MAIN      ] Derivative Progress: 1494/2164 symbols completed. PCG took 1.7s. Estimated remaining: 4m 41s. Rate: 143.2 symbols/min
[2025-10-24T01:27:06.845301] [INFO ] [MAIN      ] PCOR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:07.067105] [DEBUG] [MAIN      ] PCM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:07.125061] [DEBUG] [LOCAL     ] PCOR: Loaded 47684 existing records from primary storage.
[2025-10-24T01:27:07.132137] [INFO ] [MAIN      ] PCOR: Loaded 47684 primary data records.
[2025-10-24T01:27:07.238893] [DEBUG] [MAIN      ] PCN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:07.301428] [INFO ] [MAIN      ] PCM: Generated 139 derivative records from 6946 primary records.
[2025-10-24T01:27:07.325296] [DEBUG] [LOCAL     ] PCM: Saving derivative data.
[2025-10-24T01:27:07.498428] [DEBUG] [LOCAL     ] PCM: Derivative data saved (139 records).
[2025-10-24T01:27:07.503985] [INFO ] [MAIN      ] PCM: Successfully saved derivative data.
[2025-10-24T01:27:07.509252] [INFO ] [MAIN      ] Derivative Progress: 1495/2164 symbols completed. PCM took 1.2s. Estimated remaining: 4m 40s. Rate: 143.2 symbols/min
[2025-10-24T01:27:07.512890] [INFO ] [MAIN      ] PCQ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:07.523825] [INFO ] [MAIN      ] PCN: Generated 139 derivative records from 25543 primary records.
[2025-10-24T01:27:07.524126] [DEBUG] [LOCAL     ] PCN: Saving derivative data.
[2025-10-24T01:27:07.541412] [DEBUG] [LOCAL     ] PCN: Derivative data saved (139 records).
[2025-10-24T01:27:07.543664] [INFO ] [MAIN      ] PCN: Successfully saved derivative data.
[2025-10-24T01:27:07.551591] [DEBUG] [LOCAL     ] PCQ: Loaded 12163 existing records from primary storage.
[2025-10-24T01:27:07.568487] [DEBUG] [MAIN      ] PCOR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:07.555282] [INFO ] [MAIN      ] Derivative Progress: 1496/2164 symbols completed. PCN took 1.2s. Estimated remaining: 4m 40s. Rate: 143.3 symbols/min
[2025-10-24T01:27:07.568609] [INFO ] [MAIN      ] PCQ: Loaded 12163 primary data records.
[2025-10-24T01:27:07.583144] [INFO ] [MAIN      ] PD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:07.915437] [INFO ] [MAIN      ] PCOR: Generated 139 derivative records from 47684 primary records.
[2025-10-24T01:27:07.933053] [DEBUG] [LOCAL     ] PCOR: Saving derivative data.
[2025-10-24T01:27:07.940458] [DEBUG] [LOCAL     ] PD: Loaded 48648 existing records from primary storage.
[2025-10-24T01:27:07.959539] [INFO ] [MAIN      ] PD: Loaded 48648 primary data records.
[2025-10-24T01:27:07.959349] [DEBUG] [LOCAL     ] PCOR: Derivative data saved (139 records).
[2025-10-24T01:27:07.960082] [INFO ] [MAIN      ] PCOR: Successfully saved derivative data.
[2025-10-24T01:27:07.964922] [INFO ] [MAIN      ] Derivative Progress: 1497/2164 symbols completed. PCOR took 1.1s. Estimated remaining: 4m 39s. Rate: 143.3 symbols/min
[2025-10-24T01:27:08.028212] [INFO ] [MAIN      ] PDI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:08.184328] [DEBUG] [MAIN      ] PCQ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:08.365632] [INFO ] [MAIN      ] PCQ: Generated 139 derivative records from 12163 primary records.
[2025-10-24T01:27:08.370337] [DEBUG] [LOCAL     ] PCQ: Saving derivative data.
[2025-10-24T01:27:08.412407] [DEBUG] [LOCAL     ] PCQ: Derivative data saved (139 records).
[2025-10-24T01:27:08.405682] [DEBUG] [LOCAL     ] PDI: Loaded 50572 existing records from primary storage.
[2025-10-24T01:27:08.413568] [INFO ] [MAIN      ] PDI: Loaded 50572 primary data records.
[2025-10-24T01:27:08.413376] [DEBUG] [MAIN      ] PD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:08.413465] [INFO ] [MAIN      ] PCQ: Successfully saved derivative data.
[2025-10-24T01:27:08.417505] [INFO ] [MAIN      ] Derivative Progress: 1498/2164 symbols completed. PCQ took 0.9s. Estimated remaining: 4m 39s. Rate: 143.3 symbols/min
[2025-10-24T01:27:08.841881] [INFO ] [MAIN      ] PD: Generated 139 derivative records from 48648 primary records.
[2025-10-24T01:27:08.842310] [DEBUG] [LOCAL     ] PD: Saving derivative data.
[2025-10-24T01:27:08.857010] [DEBUG] [LOCAL     ] PD: Derivative data saved (139 records).
[2025-10-24T01:27:08.857437] [INFO ] [MAIN      ] PD: Successfully saved derivative data.
[2025-10-24T01:27:08.861343] [INFO ] [MAIN      ] Derivative Progress: 1499/2164 symbols completed. PD took 1.3s. Estimated remaining: 4m 39s. Rate: 143.3 symbols/min
[2025-10-24T01:27:08.884078] [DEBUG] [MAIN      ] PDI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:08.911261] [INFO ] [MAIN      ] PDI: Generated 139 derivative records from 50572 primary records.
[2025-10-24T01:27:08.911533] [DEBUG] [LOCAL     ] PDI: Saving derivative data.
[2025-10-24T01:27:08.924337] [DEBUG] [LOCAL     ] PDI: Derivative data saved (139 records).
[2025-10-24T01:27:08.924490] [INFO ] [MAIN      ] PDI: Successfully saved derivative data.
[2025-10-24T01:27:08.928266] [INFO ] [MAIN      ] Derivative Progress: 1500/2164 symbols completed. PDI took 0.9s. Estimated remaining: 4m 38s. Rate: 143.3 symbols/min
[2025-10-24T01:27:08.929070] [INFO ] [MAIN      ] PDO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:08.929288] [INFO ] [MAIN      ] PDM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:08.929170] [INFO ] [MAIN      ] PDS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:08.960629] [DEBUG] [LOCAL     ] PDS: Loaded 16766 existing records from primary storage.
[2025-10-24T01:27:08.960865] [INFO ] [MAIN      ] PDS: Loaded 16766 primary data records.
[2025-10-24T01:27:09.083104] [DEBUG] [LOCAL     ] PDO: Loaded 31605 existing records from primary storage.
[2025-10-24T01:27:09.104028] [INFO ] [MAIN      ] PDO: Loaded 31605 primary data records.
[2025-10-24T01:27:09.297190] [DEBUG] [LOCAL     ] PDM: Loaded 40001 existing records from primary storage.
[2025-10-24T01:27:09.350255] [INFO ] [MAIN      ] PDM: Loaded 40001 primary data records.
[2025-10-24T01:27:09.955419] [DEBUG] [MAIN      ] PDS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:10.020345] [DEBUG] [MAIN      ] PDO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:10.058603] [INFO ] [MAIN      ] PDS: Generated 139 derivative records from 16766 primary records.
[2025-10-24T01:27:10.060248] [DEBUG] [MAIN      ] PDM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:10.062139] [DEBUG] [LOCAL     ] PDS: Saving derivative data.
[2025-10-24T01:27:10.103248] [DEBUG] [LOCAL     ] PDS: Derivative data saved (139 records).
[2025-10-24T01:27:10.111371] [INFO ] [MAIN      ] PDS: Successfully saved derivative data.
[2025-10-24T01:27:10.116518] [INFO ] [MAIN      ] Derivative Progress: 1501/2164 symbols completed. PDS took 1.2s. Estimated remaining: 4m 38s. Rate: 143.2 symbols/min
[2025-10-24T01:27:10.118928] [INFO ] [MAIN      ] PDT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:10.138126] [INFO ] [MAIN      ] PDO: Generated 139 derivative records from 31605 primary records.
[2025-10-24T01:27:10.146657] [DEBUG] [LOCAL     ] PDO: Saving derivative data.
[2025-10-24T01:27:10.162943] [DEBUG] [LOCAL     ] PDO: Derivative data saved (139 records).
[2025-10-24T01:27:10.169031] [INFO ] [MAIN      ] PDO: Successfully saved derivative data.
[2025-10-24T01:27:10.173106] [DEBUG] [LOCAL     ] PDT: Loaded 17588 existing records from primary storage.
[2025-10-24T01:27:10.174373] [INFO ] [MAIN      ] PDT: Loaded 17588 primary data records.
[2025-10-24T01:27:10.172403] [INFO ] [MAIN      ] Derivative Progress: 1502/2164 symbols completed. PDO took 1.2s. Estimated remaining: 4m 37s. Rate: 143.2 symbols/min
[2025-10-24T01:27:10.173905] [INFO ] [MAIN      ] PDM: Generated 139 derivative records from 40001 primary records.
[2025-10-24T01:27:10.186077] [INFO ] [MAIN      ] PDX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:10.217612] [DEBUG] [LOCAL     ] PDM: Saving derivative data.
[2025-10-24T01:27:10.271666] [DEBUG] [LOCAL     ] PDM: Derivative data saved (139 records).
[2025-10-24T01:27:10.294739] [INFO ] [MAIN      ] PDM: Successfully saved derivative data.
[2025-10-24T01:27:10.324915] [INFO ] [MAIN      ] Derivative Progress: 1503/2164 symbols completed. PDM took 1.4s. Estimated remaining: 4m 37s. Rate: 143.3 symbols/min
[2025-10-24T01:27:10.419152] [DEBUG] [LOCAL     ] PDX: Loaded 14236 existing records from primary storage.
[2025-10-24T01:27:10.418464] [INFO ] [MAIN      ] PEB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:10.513982] [INFO ] [MAIN      ] PDX: Loaded 14236 primary data records.
[2025-10-24T01:27:10.907415] [DEBUG] [LOCAL     ] PEB: Loaded 51098 existing records from primary storage.
[2025-10-24T01:27:10.912783] [INFO ] [MAIN      ] PEB: Loaded 51098 primary data records.
[2025-10-24T01:27:10.927282] [DEBUG] [MAIN      ] PDT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:11.282744] [DEBUG] [MAIN      ] PDX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:11.309274] [INFO ] [MAIN      ] PDT: Generated 139 derivative records from 17588 primary records.
[2025-10-24T01:27:11.309877] [DEBUG] [LOCAL     ] PDT: Saving derivative data.
[2025-10-24T01:27:11.328221] [DEBUG] [LOCAL     ] PDT: Derivative data saved (139 records).
[2025-10-24T01:27:11.330189] [INFO ] [MAIN      ] PDT: Successfully saved derivative data.
[2025-10-24T01:27:11.336732] [INFO ] [MAIN      ] Derivative Progress: 1504/2164 symbols completed. PDT took 1.2s. Estimated remaining: 4m 37s. Rate: 143.2 symbols/min
[2025-10-24T01:27:11.337793] [INFO ] [MAIN      ] PEG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:11.357292] [INFO ] [MAIN      ] PDX: Generated 139 derivative records from 14236 primary records.
[2025-10-24T01:27:11.370421] [DEBUG] [LOCAL     ] PDX: Saving derivative data.
[2025-10-24T01:27:11.370673] [DEBUG] [MAIN      ] PEB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:11.400909] [DEBUG] [LOCAL     ] PDX: Derivative data saved (139 records).
[2025-10-24T01:27:11.404832] [INFO ] [MAIN      ] PDX: Successfully saved derivative data.
[2025-10-24T01:27:11.408425] [INFO ] [MAIN      ] Derivative Progress: 1505/2164 symbols completed. PDX took 1.2s. Estimated remaining: 4m 36s. Rate: 143.3 symbols/min
[2025-10-24T01:27:11.408996] [INFO ] [MAIN      ] PEN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:11.456269] [DEBUG] [LOCAL     ] PEG: Loaded 53508 existing records from primary storage.
[2025-10-24T01:27:11.456928] [INFO ] [MAIN      ] PEB: Generated 139 derivative records from 51098 primary records.
[2025-10-24T01:27:11.456978] [INFO ] [MAIN      ] PEG: Loaded 53508 primary data records.
[2025-10-24T01:27:11.457089] [DEBUG] [LOCAL     ] PEB: Saving derivative data.
[2025-10-24T01:27:11.566062] [DEBUG] [LOCAL     ] PEB: Derivative data saved (139 records).
[2025-10-24T01:27:11.595764] [INFO ] [MAIN      ] PEB: Successfully saved derivative data.
[2025-10-24T01:27:11.600615] [INFO ] [MAIN      ] Derivative Progress: 1506/2164 symbols completed. PEB took 1.2s. Estimated remaining: 4m 35s. Rate: 143.3 symbols/min
[2025-10-24T01:27:11.602411] [DEBUG] [LOCAL     ] PEN: Loaded 29706 existing records from primary storage.
[2025-10-24T01:27:11.618562] [INFO ] [MAIN      ] PEN: Loaded 29706 primary data records.
[2025-10-24T01:27:11.618760] [INFO ] [MAIN      ] PERF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:11.950936] [DEBUG] [LOCAL     ] PERF: Loaded 14582 existing records from primary storage.
[2025-10-24T01:27:11.995723] [INFO ] [MAIN      ] PERF: Loaded 14582 primary data records.
[2025-10-24T01:27:12.497136] [DEBUG] [MAIN      ] PEG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:12.539310] [DEBUG] [MAIN      ] PEN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:12.589690] [DEBUG] [MAIN      ] PERF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:12.644179] [INFO ] [MAIN      ] PEG: Generated 139 derivative records from 53508 primary records.
[2025-10-24T01:27:12.645007] [DEBUG] [LOCAL     ] PEG: Saving derivative data.
[2025-10-24T01:27:12.667617] [DEBUG] [LOCAL     ] PEG: Derivative data saved (139 records).
[2025-10-24T01:27:12.668390] [INFO ] [MAIN      ] PEN: Generated 139 derivative records from 29706 primary records.
[2025-10-24T01:27:12.669232] [INFO ] [MAIN      ] PEG: Successfully saved derivative data.
[2025-10-24T01:27:12.673870] [INFO ] [MAIN      ] Derivative Progress: 1507/2164 symbols completed. PEG took 1.3s. Estimated remaining: 4m 35s. Rate: 143.2 symbols/min
[2025-10-24T01:27:12.674884] [DEBUG] [LOCAL     ] PEN: Saving derivative data.
[2025-10-24T01:27:12.674981] [INFO ] [MAIN      ] PFD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:12.695700] [DEBUG] [LOCAL     ] PEN: Derivative data saved (139 records).
[2025-10-24T01:27:12.698922] [INFO ] [MAIN      ] PEN: Successfully saved derivative data.
[2025-10-24T01:27:12.706726] [DEBUG] [LOCAL     ] PFD: Loaded 5392 existing records from primary storage.
[2025-10-24T01:27:12.706118] [INFO ] [MAIN      ] Derivative Progress: 1508/2164 symbols completed. PEN took 1.3s. Estimated remaining: 4m 35s. Rate: 143.2 symbols/min
[2025-10-24T01:27:12.706914] [INFO ] [MAIN      ] PFD: Loaded 5392 primary data records.
[2025-10-24T01:27:12.720095] [INFO ] [MAIN      ] PFE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:12.750560] [INFO ] [MAIN      ] PERF: Generated 139 derivative records from 14582 primary records.
[2025-10-24T01:27:12.783693] [DEBUG] [LOCAL     ] PERF: Saving derivative data.
[2025-10-24T01:27:12.843963] [DEBUG] [LOCAL     ] PERF: Derivative data saved (139 records).
[2025-10-24T01:27:12.885720] [INFO ] [MAIN      ] PERF: Successfully saved derivative data.
[2025-10-24T01:27:12.938195] [INFO ] [MAIN      ] Derivative Progress: 1509/2164 symbols completed. PERF took 1.3s. Estimated remaining: 4m 34s. Rate: 143.3 symbols/min
[2025-10-24T01:27:13.111213] [INFO ] [MAIN      ] PFGC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:13.165025] [DEBUG] [LOCAL     ] PFE: Loaded 54203 existing records from primary storage.
[2025-10-24T01:27:13.165667] [INFO ] [MAIN      ] PFE: Loaded 54203 primary data records.
[2025-10-24T01:27:13.227728] [DEBUG] [MAIN      ] PFD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:13.359454] [DEBUG] [LOCAL     ] PFGC: Loaded 47021 existing records from primary storage.
[2025-10-24T01:27:13.421874] [INFO ] [MAIN      ] PFGC: Loaded 47021 primary data records.
[2025-10-24T01:27:13.878378] [INFO ] [MAIN      ] PFD: Generated 139 derivative records from 5392 primary records.
[2025-10-24T01:27:13.879248] [DEBUG] [LOCAL     ] PFD: Saving derivative data.
[2025-10-24T01:27:13.896693] [DEBUG] [LOCAL     ] PFD: Derivative data saved (139 records).
[2025-10-24T01:27:13.897945] [INFO ] [MAIN      ] PFD: Successfully saved derivative data.
[2025-10-24T01:27:13.916618] [INFO ] [MAIN      ] Derivative Progress: 1510/2164 symbols completed. PFD took 1.2s. Estimated remaining: 4m 34s. Rate: 143.2 symbols/min
[2025-10-24T01:27:13.917520] [DEBUG] [MAIN      ] PFE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:13.921939] [INFO ] [MAIN      ] PFH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:13.960780] [DEBUG] [LOCAL     ] PFH: Loaded 6448 existing records from primary storage.
[2025-10-24T01:27:13.961887] [INFO ] [MAIN      ] PFH: Loaded 6448 primary data records.
[2025-10-24T01:27:14.111171] [DEBUG] [MAIN      ] PFGC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:14.180760] [INFO ] [MAIN      ] PFE: Generated 139 derivative records from 54203 primary records.
[2025-10-24T01:27:14.198151] [DEBUG] [LOCAL     ] PFE: Saving derivative data.
[2025-10-24T01:27:14.394379] [DEBUG] [LOCAL     ] PFE: Derivative data saved (139 records).
[2025-10-24T01:27:14.397865] [INFO ] [MAIN      ] PFE: Successfully saved derivative data.
[2025-10-24T01:27:14.403559] [INFO ] [MAIN      ] Derivative Progress: 1511/2164 symbols completed. PFE took 1.7s. Estimated remaining: 4m 34s. Rate: 143.1 symbols/min
[2025-10-24T01:27:14.404487] [INFO ] [MAIN      ] PFL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:14.423865] [INFO ] [MAIN      ] PFGC: Generated 139 derivative records from 47021 primary records.
[2025-10-24T01:27:14.424283] [DEBUG] [LOCAL     ] PFGC: Saving derivative data.
[2025-10-24T01:27:14.442120] [DEBUG] [LOCAL     ] PFL: Loaded 14547 existing records from primary storage.
[2025-10-24T01:27:14.444004] [INFO ] [MAIN      ] PFL: Loaded 14547 primary data records.
[2025-10-24T01:27:14.498870] [DEBUG] [LOCAL     ] PFGC: Derivative data saved (139 records).
[2025-10-24T01:27:14.545446] [INFO ] [MAIN      ] PFGC: Successfully saved derivative data.
[2025-10-24T01:27:14.557719] [DEBUG] [MAIN      ] PFH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:14.569311] [INFO ] [MAIN      ] Derivative Progress: 1512/2164 symbols completed. PFGC took 1.5s. Estimated remaining: 4m 33s. Rate: 143.2 symbols/min
[2025-10-24T01:27:14.586006] [INFO ] [MAIN      ] PFLT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:14.831093] [INFO ] [MAIN      ] PFH: Generated 139 derivative records from 6448 primary records.
[2025-10-24T01:27:14.847433] [DEBUG] [LOCAL     ] PFH: Saving derivative data.
[2025-10-24T01:27:14.861737] [DEBUG] [LOCAL     ] PFH: Derivative data saved (139 records).
[2025-10-24T01:27:14.863593] [DEBUG] [LOCAL     ] PFLT: Loaded 44559 existing records from primary storage.
[2025-10-24T01:27:14.864536] [INFO ] [MAIN      ] PFLT: Loaded 44559 primary data records.
[2025-10-24T01:27:14.864098] [INFO ] [MAIN      ] PFH: Successfully saved derivative data.
[2025-10-24T01:27:14.868632] [INFO ] [MAIN      ] Derivative Progress: 1513/2164 symbols completed. PFH took 0.9s. Estimated remaining: 4m 33s. Rate: 143.2 symbols/min
[2025-10-24T01:27:15.009582] [DEBUG] [MAIN      ] PFL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:15.264156] [INFO ] [MAIN      ] PFL: Generated 139 derivative records from 14547 primary records.
[2025-10-24T01:27:15.264914] [DEBUG] [LOCAL     ] PFL: Saving derivative data.
[2025-10-24T01:27:15.278370] [DEBUG] [LOCAL     ] PFL: Derivative data saved (139 records).
[2025-10-24T01:27:15.278506] [INFO ] [MAIN      ] PFL: Successfully saved derivative data.
[2025-10-24T01:27:15.281456] [INFO ] [MAIN      ] Derivative Progress: 1514/2164 symbols completed. PFL took 0.9s. Estimated remaining: 4m 32s. Rate: 143.2 symbols/min
[2025-10-24T01:27:15.296868] [DEBUG] [MAIN      ] PFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:15.322840] [INFO ] [MAIN      ] PFLT: Generated 139 derivative records from 44559 primary records.
[2025-10-24T01:27:15.322988] [DEBUG] [LOCAL     ] PFLT: Saving derivative data.
[2025-10-24T01:27:15.335076] [DEBUG] [LOCAL     ] PFLT: Derivative data saved (139 records).
[2025-10-24T01:27:15.335182] [INFO ] [MAIN      ] PFLT: Successfully saved derivative data.
[2025-10-24T01:27:15.337597] [INFO ] [MAIN      ] Derivative Progress: 1515/2164 symbols completed. PFLT took 0.8s. Estimated remaining: 4m 32s. Rate: 143.3 symbols/min
[2025-10-24T01:27:15.338288] [INFO ] [MAIN      ] PFN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:15.338636] [INFO ] [MAIN      ] PFO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:15.338451] [INFO ] [MAIN      ] PFS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:15.351294] [DEBUG] [LOCAL     ] PFO: Loaded 6133 existing records from primary storage.
[2025-10-24T01:27:15.351721] [INFO ] [MAIN      ] PFO: Loaded 6133 primary data records.
[2025-10-24T01:27:15.485898] [DEBUG] [LOCAL     ] PFN: Loaded 22319 existing records from primary storage.
[2025-10-24T01:27:15.486233] [INFO ] [MAIN      ] PFN: Loaded 22319 primary data records.
[2025-10-24T01:27:15.661524] [DEBUG] [LOCAL     ] PFS: Loaded 35957 existing records from primary storage.
[2025-10-24T01:27:15.682523] [INFO ] [MAIN      ] PFS: Loaded 35957 primary data records.
[2025-10-24T01:27:16.386585] [DEBUG] [MAIN      ] PFO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:16.419842] [DEBUG] [MAIN      ] PFN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:16.476819] [DEBUG] [MAIN      ] PFS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:16.528574] [INFO ] [MAIN      ] PFN: Generated 139 derivative records from 22319 primary records.
[2025-10-24T01:27:16.534388] [DEBUG] [LOCAL     ] PFN: Saving derivative data.
[2025-10-24T01:27:16.534702] [INFO ] [MAIN      ] PFO: Generated 139 derivative records from 6133 primary records.
[2025-10-24T01:27:16.548020] [DEBUG] [LOCAL     ] PFN: Derivative data saved (139 records).
[2025-10-24T01:27:16.548251] [INFO ] [MAIN      ] PFN: Successfully saved derivative data.
[2025-10-24T01:27:16.545333] [DEBUG] [LOCAL     ] PFO: Saving derivative data.
[2025-10-24T01:27:16.551197] [INFO ] [MAIN      ] Derivative Progress: 1516/2164 symbols completed. PFN took 1.2s. Estimated remaining: 4m 32s. Rate: 143.1 symbols/min
[2025-10-24T01:27:16.554369] [INFO ] [MAIN      ] PFSI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:16.570348] [DEBUG] [LOCAL     ] PFO: Derivative data saved (139 records).
[2025-10-24T01:27:16.570951] [INFO ] [MAIN      ] PFO: Successfully saved derivative data.
[2025-10-24T01:27:16.573691] [INFO ] [MAIN      ] Derivative Progress: 1517/2164 symbols completed. PFO took 1.2s. Estimated remaining: 4m 31s. Rate: 143.2 symbols/min
[2025-10-24T01:27:16.575264] [INFO ] [MAIN      ] PG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:16.584115] [INFO ] [MAIN      ] PFS: Generated 139 derivative records from 35957 primary records.
[2025-10-24T01:27:16.584370] [DEBUG] [LOCAL     ] PFS: Saving derivative data.
[2025-10-24T01:27:16.600193] [DEBUG] [LOCAL     ] PFS: Derivative data saved (139 records).
[2025-10-24T01:27:16.600600] [INFO ] [MAIN      ] PFS: Successfully saved derivative data.
[2025-10-24T01:27:16.603332] [INFO ] [MAIN      ] Derivative Progress: 1518/2164 symbols completed. PFS took 1.3s. Estimated remaining: 4m 30s. Rate: 143.3 symbols/min
[2025-10-24T01:27:16.613739] [INFO ] [MAIN      ] PGP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:16.632041] [DEBUG] [LOCAL     ] PFSI: Loaded 29349 existing records from primary storage.
[2025-10-24T01:27:16.633707] [INFO ] [MAIN      ] PFSI: Loaded 29349 primary data records.
[2025-10-24T01:27:16.637494] [DEBUG] [LOCAL     ] PGP: Loaded 5713 existing records from primary storage.
[2025-10-24T01:27:16.699787] [INFO ] [MAIN      ] PGP: Loaded 5713 primary data records.
[2025-10-24T01:27:17.104390] [DEBUG] [LOCAL     ] PG: Loaded 54143 existing records from primary storage.
[2025-10-24T01:27:17.196778] [INFO ] [MAIN      ] PG: Loaded 54143 primary data records.
[2025-10-24T01:27:17.741901] [DEBUG] [MAIN      ] PGP: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:27:17.756142] [DEBUG] [MAIN      ] PFSI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:17.837342] [DEBUG] [MAIN      ] PG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:17.884620] [INFO ] [MAIN      ] PFSI: Generated 139 derivative records from 29349 primary records.
[2025-10-24T01:27:17.889804] [DEBUG] [LOCAL     ] PFSI: Saving derivative data.
[2025-10-24T01:27:17.890409] [INFO ] [MAIN      ] PGP: Generated 139 derivative records from 5713 primary records.
[2025-10-24T01:27:17.902690] [DEBUG] [LOCAL     ] PGP: Saving derivative data.
[2025-10-24T01:27:17.909179] [DEBUG] [LOCAL     ] PFSI: Derivative data saved (139 records).
[2025-10-24T01:27:17.910801] [INFO ] [MAIN      ] PFSI: Successfully saved derivative data.
[2025-10-24T01:27:17.922964] [DEBUG] [LOCAL     ] PGP: Derivative data saved (139 records).
[2025-10-24T01:27:17.927074] [INFO ] [MAIN      ] PGP: Successfully saved derivative data.
[2025-10-24T01:27:17.926830] [INFO ] [MAIN      ] Derivative Progress: 1519/2164 symbols completed. PFSI took 1.4s. Estimated remaining: 4m 30s. Rate: 143.1 symbols/min
[2025-10-24T01:27:17.930169] [INFO ] [MAIN      ] PGR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:17.930522] [INFO ] [MAIN      ] Derivative Progress: 1520/2164 symbols completed. PGP took 1.3s. Estimated remaining: 4m 30s. Rate: 143.2 symbols/min
[2025-10-24T01:27:17.935833] [INFO ] [MAIN      ] PGRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:17.943313] [INFO ] [MAIN      ] PG: Generated 139 derivative records from 54143 primary records.
[2025-10-24T01:27:17.943461] [DEBUG] [LOCAL     ] PG: Saving derivative data.
[2025-10-24T01:27:17.957243] [DEBUG] [LOCAL     ] PG: Derivative data saved (139 records).
[2025-10-24T01:27:17.957949] [INFO ] [MAIN      ] PG: Successfully saved derivative data.
[2025-10-24T01:27:17.961274] [INFO ] [MAIN      ] Derivative Progress: 1521/2164 symbols completed. PG took 1.4s. Estimated remaining: 4m 29s. Rate: 143.3 symbols/min
[2025-10-24T01:27:17.961570] [INFO ] [MAIN      ] PGZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:17.974882] [DEBUG] [LOCAL     ] PGZ: Loaded 5521 existing records from primary storage.
[2025-10-24T01:27:17.975277] [INFO ] [MAIN      ] PGZ: Loaded 5521 primary data records.
[2025-10-24T01:27:18.138881] [DEBUG] [LOCAL     ] PGRE: Loaded 47324 existing records from primary storage.
[2025-10-24T01:27:18.195906] [INFO ] [MAIN      ] PGRE: Loaded 47324 primary data records.
[2025-10-24T01:27:18.222982] [DEBUG] [LOCAL     ] PGR: Loaded 53254 existing records from primary storage.
[2025-10-24T01:27:18.386479] [INFO ] [MAIN      ] PGR: Loaded 53254 primary data records.
[2025-10-24T01:27:18.988166] [DEBUG] [MAIN      ] PGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:19.039292] [DEBUG] [MAIN      ] PGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:19.079276] [DEBUG] [MAIN      ] PGR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:19.106272] [INFO ] [MAIN      ] PGZ: Generated 139 derivative records from 5521 primary records.
[2025-10-24T01:27:19.108321] [DEBUG] [LOCAL     ] PGZ: Saving derivative data.
[2025-10-24T01:27:19.129484] [DEBUG] [LOCAL     ] PGZ: Derivative data saved (139 records).
[2025-10-24T01:27:19.130184] [INFO ] [MAIN      ] PGZ: Successfully saved derivative data.
[2025-10-24T01:27:19.134497] [INFO ] [MAIN      ] Derivative Progress: 1522/2164 symbols completed. PGZ took 1.2s. Estimated remaining: 4m 29s. Rate: 143.1 symbols/min
[2025-10-24T01:27:19.135129] [INFO ] [MAIN      ] PH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:19.162752] [INFO ] [MAIN      ] PGRE: Generated 139 derivative records from 47324 primary records.
[2025-10-24T01:27:19.163272] [DEBUG] [LOCAL     ] PGRE: Saving derivative data.
[2025-10-24T01:27:19.165322] [INFO ] [MAIN      ] PGR: Generated 139 derivative records from 53254 primary records.
[2025-10-24T01:27:19.184776] [DEBUG] [LOCAL     ] PGR: Saving derivative data.
[2025-10-24T01:27:19.187460] [DEBUG] [LOCAL     ] PGRE: Derivative data saved (139 records).
[2025-10-24T01:27:19.188797] [INFO ] [MAIN      ] PGRE: Successfully saved derivative data.
[2025-10-24T01:27:19.201544] [INFO ] [MAIN      ] Derivative Progress: 1523/2164 symbols completed. PGRE took 1.3s. Estimated remaining: 4m 29s. Rate: 143.2 symbols/min
[2025-10-24T01:27:19.202383] [INFO ] [MAIN      ] PHG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:19.216108] [DEBUG] [LOCAL     ] PGR: Derivative data saved (139 records).
[2025-10-24T01:27:19.217589] [INFO ] [MAIN      ] PGR: Successfully saved derivative data.
[2025-10-24T01:27:19.218309] [DEBUG] [LOCAL     ] PH: Loaded 36710 existing records from primary storage.
[2025-10-24T01:27:19.221633] [INFO ] [MAIN      ] PH: Loaded 36710 primary data records.
[2025-10-24T01:27:19.221387] [INFO ] [MAIN      ] Derivative Progress: 1524/2164 symbols completed. PGR took 1.3s. Estimated remaining: 4m 28s. Rate: 143.3 symbols/min
[2025-10-24T01:27:19.221871] [INFO ] [MAIN      ] PHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:19.419005] [DEBUG] [LOCAL     ] PHI: Loaded 15292 existing records from primary storage.
[2025-10-24T01:27:19.568041] [INFO ] [MAIN      ] PHI: Loaded 15292 primary data records.
[2025-10-24T01:27:19.702810] [DEBUG] [LOCAL     ] PHG: Loaded 45790 existing records from primary storage.
[2025-10-24T01:27:19.708359] [INFO ] [MAIN      ] PHG: Loaded 45790 primary data records.
[2025-10-24T01:27:20.259032] [DEBUG] [MAIN      ] PH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:20.308503] [DEBUG] [MAIN      ] PHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:20.357673] [DEBUG] [MAIN      ] PHG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:20.384864] [INFO ] [MAIN      ] PH: Generated 139 derivative records from 36710 primary records.
[2025-10-24T01:27:20.388496] [DEBUG] [LOCAL     ] PH: Saving derivative data.
[2025-10-24T01:27:20.408865] [DEBUG] [LOCAL     ] PH: Derivative data saved (139 records).
[2025-10-24T01:27:20.409255] [INFO ] [MAIN      ] PH: Successfully saved derivative data.
[2025-10-24T01:27:20.414751] [INFO ] [MAIN      ] Derivative Progress: 1525/2164 symbols completed. PH took 1.3s. Estimated remaining: 4m 28s. Rate: 143.1 symbols/min
[2025-10-24T01:27:20.415202] [INFO ] [MAIN      ] PHIN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:20.432077] [INFO ] [MAIN      ] PHI: Generated 139 derivative records from 15292 primary records.
[2025-10-24T01:27:20.432444] [DEBUG] [LOCAL     ] PHI: Saving derivative data.
[2025-10-24T01:27:20.459108] [DEBUG] [LOCAL     ] PHI: Derivative data saved (139 records).
[2025-10-24T01:27:20.460568] [INFO ] [MAIN      ] PHI: Successfully saved derivative data.
[2025-10-24T01:27:20.463901] [INFO ] [MAIN      ] Derivative Progress: 1526/2164 symbols completed. PHI took 1.2s. Estimated remaining: 4m 27s. Rate: 143.2 symbols/min
[2025-10-24T01:27:20.464184] [INFO ] [MAIN      ] PHM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:20.466924] [INFO ] [MAIN      ] PHG: Generated 139 derivative records from 45790 primary records.
[2025-10-24T01:27:20.467085] [DEBUG] [LOCAL     ] PHG: Saving derivative data.
[2025-10-24T01:27:20.490864] [DEBUG] [LOCAL     ] PHIN: Loaded 31596 existing records from primary storage.
[2025-10-24T01:27:20.491896] [INFO ] [MAIN      ] PHIN: Loaded 31596 primary data records.
[2025-10-24T01:27:20.492410] [DEBUG] [LOCAL     ] PHG: Derivative data saved (139 records).
[2025-10-24T01:27:20.492909] [INFO ] [MAIN      ] PHG: Successfully saved derivative data.
[2025-10-24T01:27:20.543053] [INFO ] [MAIN      ] Derivative Progress: 1527/2164 symbols completed. PHG took 1.3s. Estimated remaining: 4m 27s. Rate: 143.3 symbols/min
[2025-10-24T01:27:20.548910] [INFO ] [MAIN      ] PHR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:20.850397] [DEBUG] [LOCAL     ] PHM: Loaded 52071 existing records from primary storage.
[2025-10-24T01:27:20.851090] [INFO ] [MAIN      ] PHM: Loaded 52071 primary data records.
[2025-10-24T01:27:20.939543] [DEBUG] [LOCAL     ] PHR: Loaded 38203 existing records from primary storage.
[2025-10-24T01:27:20.958072] [INFO ] [MAIN      ] PHR: Loaded 38203 primary data records.
[2025-10-24T01:27:21.526086] [DEBUG] [MAIN      ] PHIN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:21.600615] [DEBUG] [MAIN      ] PHR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:21.602719] [INFO ] [MAIN      ] PHIN: Generated 139 derivative records from 31596 primary records.
[2025-10-24T01:27:21.658446] [DEBUG] [LOCAL     ] PHIN: Saving derivative data.
[2025-10-24T01:27:21.658309] [DEBUG] [MAIN      ] PHM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:21.701494] [DEBUG] [LOCAL     ] PHIN: Derivative data saved (139 records).
[2025-10-24T01:27:21.703113] [INFO ] [MAIN      ] PHIN: Successfully saved derivative data.
[2025-10-24T01:27:21.705981] [INFO ] [MAIN      ] Derivative Progress: 1528/2164 symbols completed. PHIN took 1.3s. Estimated remaining: 4m 27s. Rate: 143.1 symbols/min
[2025-10-24T01:27:21.734734] [INFO ] [MAIN      ] PHR: Generated 139 derivative records from 38203 primary records.
[2025-10-24T01:27:21.734942] [DEBUG] [LOCAL     ] PHR: Saving derivative data.
[2025-10-24T01:27:21.752096] [DEBUG] [LOCAL     ] PHR: Derivative data saved (139 records).
[2025-10-24T01:27:21.752395] [INFO ] [MAIN      ] PHM: Generated 139 derivative records from 52071 primary records.
[2025-10-24T01:27:21.752548] [INFO ] [MAIN      ] PHR: Successfully saved derivative data.
[2025-10-24T01:27:21.755161] [INFO ] [MAIN      ] Derivative Progress: 1529/2164 symbols completed. PHR took 1.2s. Estimated remaining: 4m 26s. Rate: 143.2 symbols/min
[2025-10-24T01:27:21.752676] [DEBUG] [LOCAL     ] PHM: Saving derivative data.
[2025-10-24T01:27:21.767511] [DEBUG] [LOCAL     ] PHM: Derivative data saved (139 records).
[2025-10-24T01:27:21.767605] [INFO ] [MAIN      ] PHM: Successfully saved derivative data.
[2025-10-24T01:27:21.769897] [INFO ] [MAIN      ] Derivative Progress: 1530/2164 symbols completed. PHM took 1.3s. Estimated remaining: 4m 26s. Rate: 143.3 symbols/min
[2025-10-24T01:27:21.770280] [INFO ] [MAIN      ] PIM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:21.770786] [INFO ] [MAIN      ] PII: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:21.770385] [INFO ] [MAIN      ] PINE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:21.779345] [DEBUG] [LOCAL     ] PIM: Loaded 4876 existing records from primary storage.
[2025-10-24T01:27:21.779729] [INFO ] [MAIN      ] PIM: Loaded 4876 primary data records.
[2025-10-24T01:27:21.894892] [DEBUG] [LOCAL     ] PINE: Loaded 14507 existing records from primary storage.
[2025-10-24T01:27:21.911013] [INFO ] [MAIN      ] PINE: Loaded 14507 primary data records.
[2025-10-24T01:27:22.281789] [DEBUG] [LOCAL     ] PII: Loaded 49002 existing records from primary storage.
[2025-10-24T01:27:22.413039] [INFO ] [MAIN      ] PII: Loaded 49002 primary data records.
[2025-10-24T01:27:22.757045] [DEBUG] [MAIN      ] PIM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:22.789322] [DEBUG] [MAIN      ] PINE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:22.848017] [DEBUG] [MAIN      ] PII: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:22.878554] [INFO ] [MAIN      ] PINE: Generated 139 derivative records from 14507 primary records.
[2025-10-24T01:27:22.879050] [DEBUG] [LOCAL     ] PINE: Saving derivative data.
[2025-10-24T01:27:22.891159] [INFO ] [MAIN      ] PIM: Generated 139 derivative records from 4876 primary records.
[2025-10-24T01:27:22.893338] [DEBUG] [LOCAL     ] PIM: Saving derivative data.
[2025-10-24T01:27:22.899264] [DEBUG] [LOCAL     ] PINE: Derivative data saved (139 records).
[2025-10-24T01:27:22.900534] [INFO ] [MAIN      ] PINE: Successfully saved derivative data.
[2025-10-24T01:27:22.913548] [INFO ] [MAIN      ] Derivative Progress: 1531/2164 symbols completed. PINE took 1.1s. Estimated remaining: 4m 25s. Rate: 143.1 symbols/min
[2025-10-24T01:27:22.918974] [INFO ] [MAIN      ] PINS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:22.918774] [DEBUG] [LOCAL     ] PIM: Derivative data saved (139 records).
[2025-10-24T01:27:22.919443] [INFO ] [MAIN      ] PIM: Successfully saved derivative data.
[2025-10-24T01:27:22.922442] [INFO ] [MAIN      ] Derivative Progress: 1532/2164 symbols completed. PIM took 1.2s. Estimated remaining: 4m 25s. Rate: 143.2 symbols/min
[2025-10-24T01:27:22.926342] [INFO ] [MAIN      ] PIPR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:22.937604] [INFO ] [MAIN      ] PII: Generated 139 derivative records from 49002 primary records.
[2025-10-24T01:27:22.937997] [DEBUG] [LOCAL     ] PII: Saving derivative data.
[2025-10-24T01:27:22.956059] [DEBUG] [LOCAL     ] PII: Derivative data saved (139 records).
[2025-10-24T01:27:22.956155] [INFO ] [MAIN      ] PII: Successfully saved derivative data.
[2025-10-24T01:27:22.959074] [INFO ] [MAIN      ] Derivative Progress: 1533/2164 symbols completed. PII took 1.2s. Estimated remaining: 4m 24s. Rate: 143.3 symbols/min
[2025-10-24T01:27:22.959362] [INFO ] [MAIN      ] PJT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:22.967071] [DEBUG] [LOCAL     ] PIPR: Loaded 15051 existing records from primary storage.
[2025-10-24T01:27:22.967238] [INFO ] [MAIN      ] PIPR: Loaded 15051 primary data records.
[2025-10-24T01:27:23.291926] [DEBUG] [LOCAL     ] PJT: Loaded 21297 existing records from primary storage.
[2025-10-24T01:27:23.306831] [INFO ] [MAIN      ] PJT: Loaded 21297 primary data records.
[2025-10-24T01:27:23.308876] [DEBUG] [LOCAL     ] PINS: Loaded 54083 existing records from primary storage.
[2025-10-24T01:27:23.352306] [INFO ] [MAIN      ] PINS: Loaded 54083 primary data records.
[2025-10-24T01:27:24.001845] [DEBUG] [MAIN      ] PIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:24.045619] [DEBUG] [MAIN      ] PJT: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:27:24.092409] [DEBUG] [MAIN      ] PINS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:24.125750] [INFO ] [MAIN      ] PIPR: Generated 139 derivative records from 15051 primary records.
[2025-10-24T01:27:24.128777] [DEBUG] [LOCAL     ] PIPR: Saving derivative data.
[2025-10-24T01:27:24.153250] [DEBUG] [LOCAL     ] PIPR: Derivative data saved (139 records).
[2025-10-24T01:27:24.157605] [INFO ] [MAIN      ] PIPR: Successfully saved derivative data.
[2025-10-24T01:27:24.161253] [INFO ] [MAIN      ] Derivative Progress: 1534/2164 symbols completed. PIPR took 1.2s. Estimated remaining: 4m 24s. Rate: 143.1 symbols/min
[2025-10-24T01:27:24.166141] [INFO ] [MAIN      ] PK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:24.178056] [INFO ] [MAIN      ] PJT: Generated 139 derivative records from 21297 primary records.
[2025-10-24T01:27:24.179541] [DEBUG] [LOCAL     ] PJT: Saving derivative data.
[2025-10-24T01:27:24.183096] [INFO ] [MAIN      ] PINS: Generated 139 derivative records from 54083 primary records.
[2025-10-24T01:27:24.183398] [DEBUG] [LOCAL     ] PINS: Saving derivative data.
[2025-10-24T01:27:24.196421] [DEBUG] [LOCAL     ] PJT: Derivative data saved (139 records).
[2025-10-24T01:27:24.196778] [INFO ] [MAIN      ] PJT: Successfully saved derivative data.
[2025-10-24T01:27:24.210935] [INFO ] [MAIN      ] Derivative Progress: 1535/2164 symbols completed. PJT took 1.3s. Estimated remaining: 4m 24s. Rate: 143.2 symbols/min
[2025-10-24T01:27:24.211838] [INFO ] [MAIN      ] PKE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:24.211678] [DEBUG] [LOCAL     ] PINS: Derivative data saved (139 records).
[2025-10-24T01:27:24.212400] [INFO ] [MAIN      ] PINS: Successfully saved derivative data.
[2025-10-24T01:27:24.215515] [INFO ] [MAIN      ] Derivative Progress: 1536/2164 symbols completed. PINS took 1.3s. Estimated remaining: 4m 23s. Rate: 143.3 symbols/min
[2025-10-24T01:27:24.215883] [INFO ] [MAIN      ] PKG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:24.249388] [DEBUG] [LOCAL     ] PKE: Loaded 14380 existing records from primary storage.
[2025-10-24T01:27:24.249561] [INFO ] [MAIN      ] PKE: Loaded 14380 primary data records.
[2025-10-24T01:27:24.394448] [DEBUG] [LOCAL     ] PK: Loaded 53137 existing records from primary storage.
[2025-10-24T01:27:24.436205] [INFO ] [MAIN      ] PK: Loaded 53137 primary data records.
[2025-10-24T01:27:24.518881] [DEBUG] [LOCAL     ] PKG: Loaded 38951 existing records from primary storage.
[2025-10-24T01:27:24.678207] [INFO ] [MAIN      ] PKG: Loaded 38951 primary data records.
[2025-10-24T01:27:25.245497] [DEBUG] [MAIN      ] PKE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:25.309460] [DEBUG] [MAIN      ] PK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:25.310198] [DEBUG] [MAIN      ] PKG: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:27:25.354696] [INFO ] [MAIN      ] PKE: Generated 139 derivative records from 14380 primary records.
[2025-10-24T01:27:25.359392] [DEBUG] [LOCAL     ] PKE: Saving derivative data.
[2025-10-24T01:27:25.376491] [DEBUG] [LOCAL     ] PKE: Derivative data saved (139 records).
[2025-10-24T01:27:25.381055] [INFO ] [MAIN      ] PKE: Successfully saved derivative data.
[2025-10-24T01:27:25.387273] [INFO ] [MAIN      ] Derivative Progress: 1537/2164 symbols completed. PKE took 1.2s. Estimated remaining: 4m 23s. Rate: 143.1 symbols/min
[2025-10-24T01:27:25.387995] [INFO ] [MAIN      ] PKST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:25.404516] [INFO ] [MAIN      ] PK: Generated 139 derivative records from 53137 primary records.
[2025-10-24T01:27:25.404786] [DEBUG] [LOCAL     ] PK: Saving derivative data.
[2025-10-24T01:27:25.426218] [INFO ] [MAIN      ] PKG: Generated 139 derivative records from 38951 primary records.
[2025-10-24T01:27:25.425968] [DEBUG] [LOCAL     ] PK: Derivative data saved (139 records).
[2025-10-24T01:27:25.426472] [INFO ] [MAIN      ] PK: Successfully saved derivative data.
[2025-10-24T01:27:25.426552] [DEBUG] [LOCAL     ] PKG: Saving derivative data.
[2025-10-24T01:27:25.429083] [INFO ] [MAIN      ] Derivative Progress: 1538/2164 symbols completed. PK took 1.3s. Estimated remaining: 4m 22s. Rate: 143.2 symbols/min
[2025-10-24T01:27:25.448852] [DEBUG] [LOCAL     ] PKG: Derivative data saved (139 records).
[2025-10-24T01:27:25.436057] [INFO ] [MAIN      ] PKX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:25.448980] [INFO ] [MAIN      ] PKG: Successfully saved derivative data.
[2025-10-24T01:27:25.448123] [DEBUG] [LOCAL     ] PKST: Loaded 18267 existing records from primary storage.
[2025-10-24T01:27:25.449366] [INFO ] [MAIN      ] PKST: Loaded 18267 primary data records.
[2025-10-24T01:27:25.452413] [INFO ] [MAIN      ] Derivative Progress: 1539/2164 symbols completed. PKG took 1.2s. Estimated remaining: 4m 22s. Rate: 143.3 symbols/min
[2025-10-24T01:27:25.452910] [INFO ] [MAIN      ] PL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:25.646125] [DEBUG] [LOCAL     ] PKX: Loaded 22749 existing records from primary storage.
[2025-10-24T01:27:25.779714] [INFO ] [MAIN      ] PKX: Loaded 22749 primary data records.
[2025-10-24T01:27:25.910915] [DEBUG] [LOCAL     ] PL: Loaded 53602 existing records from primary storage.
[2025-10-24T01:27:25.911312] [INFO ] [MAIN      ] PL: Loaded 53602 primary data records.
[2025-10-24T01:27:26.484768] [DEBUG] [MAIN      ] PKST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:26.544238] [DEBUG] [MAIN      ] PKX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:26.591209] [DEBUG] [MAIN      ] PL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:26.597462] [INFO ] [MAIN      ] PKST: Generated 139 derivative records from 18267 primary records.
[2025-10-24T01:27:26.610859] [DEBUG] [LOCAL     ] PKST: Saving derivative data.
[2025-10-24T01:27:26.636546] [DEBUG] [LOCAL     ] PKST: Derivative data saved (139 records).
[2025-10-24T01:27:26.639710] [INFO ] [MAIN      ] PKST: Successfully saved derivative data.
[2025-10-24T01:27:26.645725] [INFO ] [MAIN      ] Derivative Progress: 1540/2164 symbols completed. PKST took 1.3s. Estimated remaining: 4m 22s. Rate: 143.1 symbols/min
[2025-10-24T01:27:26.651610] [INFO ] [MAIN      ] PLD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:26.657477] [INFO ] [MAIN      ] PKX: Generated 139 derivative records from 22749 primary records.
[2025-10-24T01:27:26.660918] [DEBUG] [LOCAL     ] PKX: Saving derivative data.
[2025-10-24T01:27:26.676534] [DEBUG] [LOCAL     ] PKX: Derivative data saved (139 records).
[2025-10-24T01:27:26.679949] [INFO ] [MAIN      ] PKX: Successfully saved derivative data.
[2025-10-24T01:27:26.682444] [INFO ] [MAIN      ] Derivative Progress: 1541/2164 symbols completed. PKX took 1.2s. Estimated remaining: 4m 21s. Rate: 143.2 symbols/min
[2025-10-24T01:27:26.682712] [INFO ] [MAIN      ] PLNT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:26.688599] [INFO ] [MAIN      ] PL: Generated 139 derivative records from 53602 primary records.
[2025-10-24T01:27:26.689133] [DEBUG] [LOCAL     ] PL: Saving derivative data.
[2025-10-24T01:27:26.702011] [DEBUG] [LOCAL     ] PL: Derivative data saved (139 records).
[2025-10-24T01:27:26.702230] [INFO ] [MAIN      ] PL: Successfully saved derivative data.
[2025-10-24T01:27:26.705577] [INFO ] [MAIN      ] Derivative Progress: 1542/2164 symbols completed. PL took 1.3s. Estimated remaining: 4m 20s. Rate: 143.3 symbols/min
[2025-10-24T01:27:26.706033] [INFO ] [MAIN      ] PLOW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:26.754372] [DEBUG] [LOCAL     ] PLOW: Loaded 19740 existing records from primary storage.
[2025-10-24T01:27:26.754540] [INFO ] [MAIN      ] PLOW: Loaded 19740 primary data records.
[2025-10-24T01:27:26.861235] [DEBUG] [LOCAL     ] PLD: Loaded 53803 existing records from primary storage.
[2025-10-24T01:27:26.898264] [INFO ] [MAIN      ] PLD: Loaded 53803 primary data records.
[2025-10-24T01:27:26.905175] [DEBUG] [LOCAL     ] PLNT: Loaded 48347 existing records from primary storage.
[2025-10-24T01:27:26.959683] [INFO ] [MAIN      ] PLNT: Loaded 48347 primary data records.
[2025-10-24T01:27:27.721317] [DEBUG] [MAIN      ] PLOW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:27.762380] [DEBUG] [MAIN      ] PLD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:27.806485] [DEBUG] [MAIN      ] PLNT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:27.842068] [INFO ] [MAIN      ] PLOW: Generated 139 derivative records from 19740 primary records.
[2025-10-24T01:27:27.845572] [DEBUG] [LOCAL     ] PLOW: Saving derivative data.
[2025-10-24T01:27:27.869668] [DEBUG] [LOCAL     ] PLOW: Derivative data saved (139 records).
[2025-10-24T01:27:27.869815] [INFO ] [MAIN      ] PLOW: Successfully saved derivative data.
[2025-10-24T01:27:27.872247] [INFO ] [MAIN      ] Derivative Progress: 1543/2164 symbols completed. PLOW took 1.2s. Estimated remaining: 4m 20s. Rate: 143.1 symbols/min
[2025-10-24T01:27:27.879441] [INFO ] [MAIN      ] PLD: Generated 139 derivative records from 53803 primary records.
[2025-10-24T01:27:27.882082] [DEBUG] [LOCAL     ] PLD: Saving derivative data.
[2025-10-24T01:27:27.896299] [INFO ] [MAIN      ] PLNT: Generated 139 derivative records from 48347 primary records.
[2025-10-24T01:27:27.899399] [DEBUG] [LOCAL     ] PLD: Derivative data saved (139 records).
[2025-10-24T01:27:27.899757] [INFO ] [MAIN      ] PLD: Successfully saved derivative data.
[2025-10-24T01:27:27.904181] [INFO ] [MAIN      ] Derivative Progress: 1544/2164 symbols completed. PLD took 1.3s. Estimated remaining: 4m 20s. Rate: 143.2 symbols/min
[2025-10-24T01:27:27.904338] [DEBUG] [LOCAL     ] PLNT: Saving derivative data.
[2025-10-24T01:27:27.917125] [DEBUG] [LOCAL     ] PLNT: Derivative data saved (139 records).
[2025-10-24T01:27:27.917214] [INFO ] [MAIN      ] PLNT: Successfully saved derivative data.
[2025-10-24T01:27:27.920122] [INFO ] [MAIN      ] Derivative Progress: 1545/2164 symbols completed. PLNT took 1.2s. Estimated remaining: 4m 19s. Rate: 143.3 symbols/min
[2025-10-24T01:27:27.920738] [INFO ] [MAIN      ] PM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:27.920693] [INFO ] [MAIN      ] PLYM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:27.920809] [INFO ] [MAIN      ] PML: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:27.951237] [DEBUG] [LOCAL     ] PML: Loaded 22040 existing records from primary storage.
[2025-10-24T01:27:27.961475] [INFO ] [MAIN      ] PML: Loaded 22040 primary data records.
[2025-10-24T01:27:28.093598] [DEBUG] [LOCAL     ] PLYM: Loaded 34660 existing records from primary storage.
[2025-10-24T01:27:28.122459] [INFO ] [MAIN      ] PLYM: Loaded 34660 primary data records.
[2025-10-24T01:27:28.292491] [DEBUG] [LOCAL     ] PM: Loaded 54064 existing records from primary storage.
[2025-10-24T01:27:28.442142] [INFO ] [MAIN      ] PM: Loaded 54064 primary data records.
[2025-10-24T01:27:28.985220] [DEBUG] [MAIN      ] PML: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:29.030986] [DEBUG] [MAIN      ] PLYM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:29.072433] [DEBUG] [MAIN      ] PM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:29.092147] [INFO ] [MAIN      ] PML: Generated 139 derivative records from 22040 primary records.
[2025-10-24T01:27:29.095451] [DEBUG] [LOCAL     ] PML: Saving derivative data.
[2025-10-24T01:27:29.110200] [DEBUG] [LOCAL     ] PML: Derivative data saved (139 records).
[2025-10-24T01:27:29.113235] [INFO ] [MAIN      ] PML: Successfully saved derivative data.
[2025-10-24T01:27:29.119024] [INFO ] [MAIN      ] Derivative Progress: 1546/2164 symbols completed. PML took 1.2s. Estimated remaining: 4m 19s. Rate: 143.1 symbols/min
[2025-10-24T01:27:29.121827] [INFO ] [MAIN      ] PMM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:29.149205] [DEBUG] [LOCAL     ] PMM: Loaded 10151 existing records from primary storage.
[2025-10-24T01:27:29.151966] [INFO ] [MAIN      ] PLYM: Generated 139 derivative records from 34660 primary records.
[2025-10-24T01:27:29.152048] [INFO ] [MAIN      ] PMM: Loaded 10151 primary data records.
[2025-10-24T01:27:29.152436] [DEBUG] [LOCAL     ] PLYM: Saving derivative data.
[2025-10-24T01:27:29.253610] [DEBUG] [LOCAL     ] PLYM: Derivative data saved (139 records).
[2025-10-24T01:27:29.259461] [INFO ] [MAIN      ] PLYM: Successfully saved derivative data.
[2025-10-24T01:27:29.275019] [INFO ] [MAIN      ] Derivative Progress: 1547/2164 symbols completed. PLYM took 1.4s. Estimated remaining: 4m 19s. Rate: 143.2 symbols/min
[2025-10-24T01:27:29.275244] [INFO ] [MAIN      ] PMO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:29.300736] [INFO ] [MAIN      ] PM: Generated 139 derivative records from 54064 primary records.
[2025-10-24T01:27:29.361284] [DEBUG] [LOCAL     ] PM: Saving derivative data.
[2025-10-24T01:27:29.494685] [DEBUG] [LOCAL     ] PMO: Loaded 9477 existing records from primary storage.
[2025-10-24T01:27:29.498211] [INFO ] [MAIN      ] PMO: Loaded 9477 primary data records.
[2025-10-24T01:27:29.499974] [DEBUG] [LOCAL     ] PM: Derivative data saved (139 records).
[2025-10-24T01:27:29.538311] [INFO ] [MAIN      ] PM: Successfully saved derivative data.
[2025-10-24T01:27:29.576950] [INFO ] [MAIN      ] Derivative Progress: 1548/2164 symbols completed. PM took 1.7s. Estimated remaining: 4m 18s. Rate: 143.2 symbols/min
[2025-10-24T01:27:29.595867] [INFO ] [MAIN      ] PMT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:29.885353] [DEBUG] [MAIN      ] PMM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:29.902759] [DEBUG] [LOCAL     ] PMT: Loaded 41066 existing records from primary storage.
[2025-10-24T01:27:29.906016] [INFO ] [MAIN      ] PMT: Loaded 41066 primary data records.
[2025-10-24T01:27:30.100576] [DEBUG] [MAIN      ] PMO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:30.369516] [INFO ] [MAIN      ] PMM: Generated 139 derivative records from 10151 primary records.
[2025-10-24T01:27:30.369909] [DEBUG] [LOCAL     ] PMM: Saving derivative data.
[2025-10-24T01:27:30.388097] [DEBUG] [LOCAL     ] PMM: Derivative data saved (139 records).
[2025-10-24T01:27:30.388507] [INFO ] [MAIN      ] PMM: Successfully saved derivative data.
[2025-10-24T01:27:30.392184] [INFO ] [MAIN      ] Derivative Progress: 1549/2164 symbols completed. PMM took 1.3s. Estimated remaining: 4m 18s. Rate: 143.1 symbols/min
[2025-10-24T01:27:30.397733] [INFO ] [MAIN      ] PNC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:30.403215] [INFO ] [MAIN      ] PMO: Generated 139 derivative records from 9477 primary records.
[2025-10-24T01:27:30.404717] [DEBUG] [LOCAL     ] PMO: Saving derivative data.
[2025-10-24T01:27:30.434042] [DEBUG] [MAIN      ] PMT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:30.428361] [DEBUG] [LOCAL     ] PMO: Derivative data saved (139 records).
[2025-10-24T01:27:30.434230] [INFO ] [MAIN      ] PMO: Successfully saved derivative data.
[2025-10-24T01:27:30.436975] [INFO ] [MAIN      ] Derivative Progress: 1550/2164 symbols completed. PMO took 1.2s. Estimated remaining: 4m 17s. Rate: 143.2 symbols/min
[2025-10-24T01:27:30.437237] [INFO ] [MAIN      ] PNI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:30.468923] [DEBUG] [LOCAL     ] PNI: Loaded 6914 existing records from primary storage.
[2025-10-24T01:27:30.489443] [INFO ] [MAIN      ] PNI: Loaded 6914 primary data records.
[2025-10-24T01:27:30.626215] [DEBUG] [LOCAL     ] PNC: Loaded 52438 existing records from primary storage.
[2025-10-24T01:27:30.626850] [INFO ] [MAIN      ] PNC: Loaded 52438 primary data records.
[2025-10-24T01:27:30.809617] [INFO ] [MAIN      ] PMT: Generated 139 derivative records from 41066 primary records.
[2025-10-24T01:27:30.809977] [DEBUG] [LOCAL     ] PMT: Saving derivative data.
[2025-10-24T01:27:30.994266] [DEBUG] [LOCAL     ] PMT: Derivative data saved (139 records).
[2025-10-24T01:27:31.143708] [INFO ] [MAIN      ] PMT: Successfully saved derivative data.
[2025-10-24T01:27:31.159961] [INFO ] [MAIN      ] Derivative Progress: 1551/2164 symbols completed. PMT took 1.6s. Estimated remaining: 4m 17s. Rate: 143.1 symbols/min
[2025-10-24T01:27:31.160839] [INFO ] [MAIN      ] PNNT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:31.184960] [DEBUG] [MAIN      ] PNI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:31.237394] [DEBUG] [LOCAL     ] PNNT: Loaded 33582 existing records from primary storage.
[2025-10-24T01:27:31.240818] [INFO ] [MAIN      ] PNNT: Loaded 33582 primary data records.
[2025-10-24T01:27:31.290130] [DEBUG] [MAIN      ] PNC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:31.475775] [INFO ] [MAIN      ] PNI: Generated 139 derivative records from 6914 primary records.
[2025-10-24T01:27:31.478613] [DEBUG] [LOCAL     ] PNI: Saving derivative data.
[2025-10-24T01:27:31.610020] [DEBUG] [LOCAL     ] PNI: Derivative data saved (139 records).
[2025-10-24T01:27:31.613572] [INFO ] [MAIN      ] PNI: Successfully saved derivative data.
[2025-10-24T01:27:31.616852] [INFO ] [MAIN      ] Derivative Progress: 1552/2164 symbols completed. PNI took 1.2s. Estimated remaining: 4m 17s. Rate: 143.1 symbols/min
[2025-10-24T01:27:31.617551] [INFO ] [MAIN      ] PNR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:31.625955] [INFO ] [MAIN      ] PNC: Generated 139 derivative records from 52438 primary records.
[2025-10-24T01:27:31.626292] [DEBUG] [LOCAL     ] PNC: Saving derivative data.
[2025-10-24T01:27:31.642961] [DEBUG] [LOCAL     ] PNC: Derivative data saved (139 records).
[2025-10-24T01:27:31.643357] [INFO ] [MAIN      ] PNC: Successfully saved derivative data.
[2025-10-24T01:27:31.646526] [INFO ] [MAIN      ] Derivative Progress: 1553/2164 symbols completed. PNC took 1.2s. Estimated remaining: 4m 16s. Rate: 143.2 symbols/min
[2025-10-24T01:27:31.647174] [INFO ] [MAIN      ] PNW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:31.665993] [DEBUG] [MAIN      ] PNNT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:31.733632] [INFO ] [MAIN      ] PNNT: Generated 139 derivative records from 33582 primary records.
[2025-10-24T01:27:31.733843] [DEBUG] [LOCAL     ] PNNT: Saving derivative data.
[2025-10-24T01:27:31.733297] [DEBUG] [LOCAL     ] PNR: Loaded 47863 existing records from primary storage.
[2025-10-24T01:27:31.735032] [INFO ] [MAIN      ] PNR: Loaded 47863 primary data records.
[2025-10-24T01:27:31.810436] [DEBUG] [LOCAL     ] PNNT: Derivative data saved (139 records).
[2025-10-24T01:27:31.864578] [INFO ] [MAIN      ] PNNT: Successfully saved derivative data.
[2025-10-24T01:27:31.867319] [INFO ] [MAIN      ] Derivative Progress: 1554/2164 symbols completed. PNNT took 0.7s. Estimated remaining: 4m 15s. Rate: 143.3 symbols/min
[2025-10-24T01:27:31.864508] [DEBUG] [LOCAL     ] PNW: Loaded 45849 existing records from primary storage.
[2025-10-24T01:27:31.867552] [INFO ] [MAIN      ] PNW: Loaded 45849 primary data records.
[2025-10-24T01:27:31.867667] [INFO ] [MAIN      ] POR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:32.416258] [DEBUG] [LOCAL     ] POR: Loaded 47087 existing records from primary storage.
[2025-10-24T01:27:32.416926] [INFO ] [MAIN      ] POR: Loaded 47087 primary data records.
[2025-10-24T01:27:32.730421] [DEBUG] [MAIN      ] PNR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:32.771343] [DEBUG] [MAIN      ] PNW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:32.823129] [INFO ] [MAIN      ] PNR: Generated 139 derivative records from 47863 primary records.
[2025-10-24T01:27:32.823762] [DEBUG] [MAIN      ] POR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:32.823921] [DEBUG] [LOCAL     ] PNR: Saving derivative data.
[2025-10-24T01:27:32.854188] [DEBUG] [LOCAL     ] PNR: Derivative data saved (139 records).
[2025-10-24T01:27:32.855808] [INFO ] [MAIN      ] PNR: Successfully saved derivative data.
[2025-10-24T01:27:32.861618] [INFO ] [MAIN      ] Derivative Progress: 1555/2164 symbols completed. PNR took 1.2s. Estimated remaining: 4m 15s. Rate: 143.1 symbols/min
[2025-10-24T01:27:32.864727] [INFO ] [MAIN      ] POST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:32.875455] [INFO ] [MAIN      ] PNW: Generated 139 derivative records from 45849 primary records.
[2025-10-24T01:27:32.877499] [DEBUG] [LOCAL     ] PNW: Saving derivative data.
[2025-10-24T01:27:32.895418] [DEBUG] [LOCAL     ] PNW: Derivative data saved (139 records).
[2025-10-24T01:27:32.895672] [INFO ] [MAIN      ] PNW: Successfully saved derivative data.
[2025-10-24T01:27:32.898809] [INFO ] [MAIN      ] Derivative Progress: 1556/2164 symbols completed. PNW took 1.3s. Estimated remaining: 4m 15s. Rate: 143.2 symbols/min
[2025-10-24T01:27:32.902154] [INFO ] [MAIN      ] PPG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:32.906116] [INFO ] [MAIN      ] POR: Generated 139 derivative records from 47087 primary records.
[2025-10-24T01:27:32.906322] [DEBUG] [LOCAL     ] POR: Saving derivative data.
[2025-10-24T01:27:32.928366] [DEBUG] [LOCAL     ] POR: Derivative data saved (139 records).
[2025-10-24T01:27:32.928725] [INFO ] [MAIN      ] POR: Successfully saved derivative data.
[2025-10-24T01:27:32.931530] [INFO ] [MAIN      ] Derivative Progress: 1557/2164 symbols completed. POR took 1.1s. Estimated remaining: 4m 14s. Rate: 143.3 symbols/min
[2025-10-24T01:27:32.931850] [INFO ] [MAIN      ] PPL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:32.949173] [DEBUG] [LOCAL     ] POST: Loaded 38731 existing records from primary storage.
[2025-10-24T01:27:32.949770] [INFO ] [MAIN      ] POST: Loaded 38731 primary data records.
[2025-10-24T01:27:33.320565] [DEBUG] [LOCAL     ] PPG: Loaded 50853 existing records from primary storage.
[2025-10-24T01:27:33.322335] [INFO ] [MAIN      ] PPG: Loaded 50853 primary data records.
[2025-10-24T01:27:33.347948] [DEBUG] [LOCAL     ] PPL: Loaded 53894 existing records from primary storage.
[2025-10-24T01:27:33.384777] [INFO ] [MAIN      ] PPL: Loaded 53894 primary data records.
[2025-10-24T01:27:33.972270] [DEBUG] [MAIN      ] POST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:34.029939] [DEBUG] [MAIN      ] PPG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:34.066000] [DEBUG] [MAIN      ] PPL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:34.063792] [INFO ] [MAIN      ] POST: Generated 139 derivative records from 38731 primary records.
[2025-10-24T01:27:34.077957] [DEBUG] [LOCAL     ] POST: Saving derivative data.
[2025-10-24T01:27:34.111208] [DEBUG] [LOCAL     ] POST: Derivative data saved (139 records).
[2025-10-24T01:27:34.113169] [INFO ] [MAIN      ] POST: Successfully saved derivative data.
[2025-10-24T01:27:34.117865] [INFO ] [MAIN      ] Derivative Progress: 1558/2164 symbols completed. POST took 1.3s. Estimated remaining: 4m 14s. Rate: 143.1 symbols/min
[2025-10-24T01:27:34.144881] [INFO ] [MAIN      ] PPL: Generated 139 derivative records from 53894 primary records.
[2025-10-24T01:27:34.142951] [INFO ] [MAIN      ] PPG: Generated 139 derivative records from 50853 primary records.
[2025-10-24T01:27:34.145068] [DEBUG] [LOCAL     ] PPL: Saving derivative data.
[2025-10-24T01:27:34.145150] [DEBUG] [LOCAL     ] PPG: Saving derivative data.
[2025-10-24T01:27:34.169056] [DEBUG] [LOCAL     ] PPG: Derivative data saved (139 records).
[2025-10-24T01:27:34.169907] [INFO ] [MAIN      ] PPG: Successfully saved derivative data.
[2025-10-24T01:27:34.173064] [INFO ] [MAIN      ] Derivative Progress: 1559/2164 symbols completed. PPG took 1.3s. Estimated remaining: 4m 13s. Rate: 143.2 symbols/min
[2025-10-24T01:27:34.173762] [DEBUG] [LOCAL     ] PPL: Derivative data saved (139 records).
[2025-10-24T01:27:34.174195] [INFO ] [MAIN      ] PPL: Successfully saved derivative data.
[2025-10-24T01:27:34.178419] [INFO ] [MAIN      ] Derivative Progress: 1560/2164 symbols completed. PPL took 1.2s. Estimated remaining: 4m 13s. Rate: 143.3 symbols/min
[2025-10-24T01:27:34.179005] [INFO ] [MAIN      ] PRA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:34.179152] [INFO ] [MAIN      ] PR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:34.178926] [INFO ] [MAIN      ] PPT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:34.215215] [DEBUG] [LOCAL     ] PPT: Loaded 19765 existing records from primary storage.
[2025-10-24T01:27:34.216074] [INFO ] [MAIN      ] PPT: Loaded 19765 primary data records.
[2025-10-24T01:27:34.350744] [DEBUG] [LOCAL     ] PRA: Loaded 34625 existing records from primary storage.
[2025-10-24T01:27:34.388952] [INFO ] [MAIN      ] PRA: Loaded 34625 primary data records.
[2025-10-24T01:27:34.615028] [DEBUG] [LOCAL     ] PR: Loaded 54001 existing records from primary storage.
[2025-10-24T01:27:34.634634] [INFO ] [MAIN      ] PR: Loaded 54001 primary data records.
[2025-10-24T01:27:35.250362] [DEBUG] [MAIN      ] PPT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:35.320019] [DEBUG] [MAIN      ] PR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:35.320417] [DEBUG] [MAIN      ] PRA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:35.371057] [INFO ] [MAIN      ] PPT: Generated 139 derivative records from 19765 primary records.
[2025-10-24T01:27:35.376688] [DEBUG] [LOCAL     ] PPT: Saving derivative data.
[2025-10-24T01:27:35.403071] [DEBUG] [LOCAL     ] PPT: Derivative data saved (139 records).
[2025-10-24T01:27:35.406142] [INFO ] [MAIN      ] PPT: Successfully saved derivative data.
[2025-10-24T01:27:35.409628] [INFO ] [MAIN      ] Derivative Progress: 1561/2164 symbols completed. PPT took 1.2s. Estimated remaining: 4m 13s. Rate: 143.1 symbols/min
[2025-10-24T01:27:35.409893] [INFO ] [MAIN      ] PRCS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:35.431865] [DEBUG] [LOCAL     ] PRCS: Loaded 2802 existing records from primary storage.
[2025-10-24T01:27:35.433142] [INFO ] [MAIN      ] PRCS: Loaded 2802 primary data records.
[2025-10-24T01:27:35.432756] [INFO ] [MAIN      ] PRA: Generated 139 derivative records from 34625 primary records.
[2025-10-24T01:27:35.435257] [DEBUG] [LOCAL     ] PRA: Saving derivative data.
[2025-10-24T01:27:35.522054] [INFO ] [MAIN      ] PR: Generated 139 derivative records from 54001 primary records.
[2025-10-24T01:27:35.548344] [DEBUG] [LOCAL     ] PR: Saving derivative data.
[2025-10-24T01:27:35.537700] [DEBUG] [LOCAL     ] PRA: Derivative data saved (139 records).
[2025-10-24T01:27:35.567897] [INFO ] [MAIN      ] PRA: Successfully saved derivative data.
[2025-10-24T01:27:35.570820] [INFO ] [MAIN      ] Derivative Progress: 1562/2164 symbols completed. PRA took 1.4s. Estimated remaining: 4m 12s. Rate: 143.2 symbols/min
[2025-10-24T01:27:35.597448] [INFO ] [MAIN      ] PRG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:35.622444] [DEBUG] [LOCAL     ] PR: Derivative data saved (139 records).
[2025-10-24T01:27:35.655771] [INFO ] [MAIN      ] PR: Successfully saved derivative data.
[2025-10-24T01:27:35.677158] [INFO ] [MAIN      ] Derivative Progress: 1563/2164 symbols completed. PR took 1.5s. Estimated remaining: 4m 12s. Rate: 143.3 symbols/min
[2025-10-24T01:27:35.790211] [INFO ] [MAIN      ] PRGO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:35.825100] [DEBUG] [LOCAL     ] PRG: Loaded 29965 existing records from primary storage.
[2025-10-24T01:27:35.826178] [INFO ] [MAIN      ] PRG: Loaded 29965 primary data records.
[2025-10-24T01:27:36.183755] [DEBUG] [LOCAL     ] PRGO: Loaded 47472 existing records from primary storage.
[2025-10-24T01:27:36.182625] [DEBUG] [MAIN      ] PRCS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:27:36.185404] [INFO ] [MAIN      ] PRGO: Loaded 47472 primary data records.
[2025-10-24T01:27:36.577453] [INFO ] [MAIN      ] PRCS: Generated 139 derivative records from 2802 primary records.
[2025-10-24T01:27:36.580936] [DEBUG] [LOCAL     ] PRCS: Saving derivative data.
[2025-10-24T01:27:36.604400] [DEBUG] [MAIN      ] PRG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:36.606849] [DEBUG] [LOCAL     ] PRCS: Derivative data saved (139 records).
[2025-10-24T01:27:36.621008] [INFO ] [MAIN      ] PRCS: Successfully saved derivative data.
[2025-10-24T01:27:36.624539] [INFO ] [MAIN      ] Derivative Progress: 1564/2164 symbols completed. PRCS took 1.2s. Estimated remaining: 4m 11s. Rate: 143.1 symbols/min
[2025-10-24T01:27:36.624954] [INFO ] [MAIN      ] PRH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:36.649939] [DEBUG] [LOCAL     ] PRH: Loaded 4702 existing records from primary storage.
[2025-10-24T01:27:36.652233] [INFO ] [MAIN      ] PRH: Loaded 4702 primary data records.
[2025-10-24T01:27:36.705397] [DEBUG] [MAIN      ] PRGO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:37.002230] [INFO ] [MAIN      ] PRG: Generated 139 derivative records from 29965 primary records.
[2025-10-24T01:27:37.004242] [DEBUG] [LOCAL     ] PRG: Saving derivative data.
[2025-10-24T01:27:37.029265] [DEBUG] [LOCAL     ] PRG: Derivative data saved (139 records).
[2025-10-24T01:27:37.031794] [INFO ] [MAIN      ] PRG: Successfully saved derivative data.
[2025-10-24T01:27:37.035219] [INFO ] [MAIN      ] Derivative Progress: 1565/2164 symbols completed. PRG took 1.4s. Estimated remaining: 4m 11s. Rate: 143.1 symbols/min
[2025-10-24T01:27:37.035988] [INFO ] [MAIN      ] PRI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:37.046211] [INFO ] [MAIN      ] PRGO: Generated 139 derivative records from 47472 primary records.
[2025-10-24T01:27:37.046848] [DEBUG] [LOCAL     ] PRGO: Saving derivative data.
[2025-10-24T01:27:37.060727] [DEBUG] [LOCAL     ] PRGO: Derivative data saved (139 records).
[2025-10-24T01:27:37.060938] [INFO ] [MAIN      ] PRGO: Successfully saved derivative data.
[2025-10-24T01:27:37.069675] [INFO ] [MAIN      ] Derivative Progress: 1566/2164 symbols completed. PRGO took 1.3s. Estimated remaining: 4m 11s. Rate: 143.2 symbols/min
[2025-10-24T01:27:37.070283] [INFO ] [MAIN      ] PRIM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:37.098259] [DEBUG] [LOCAL     ] PRI: Loaded 17835 existing records from primary storage.
[2025-10-24T01:27:37.097329] [DEBUG] [MAIN      ] PRH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:37.098549] [INFO ] [MAIN      ] PRI: Loaded 17835 primary data records.
[2025-10-24T01:27:37.469569] [DEBUG] [LOCAL     ] PRIM: Loaded 44369 existing records from primary storage.
[2025-10-24T01:27:37.470021] [INFO ] [MAIN      ] PRIM: Loaded 44369 primary data records.
[2025-10-24T01:27:37.791741] [INFO ] [MAIN      ] PRH: Generated 139 derivative records from 4702 primary records.
[2025-10-24T01:27:37.792922] [DEBUG] [LOCAL     ] PRH: Saving derivative data.
[2025-10-24T01:27:37.809914] [DEBUG] [LOCAL     ] PRH: Derivative data saved (139 records).
[2025-10-24T01:27:37.810145] [INFO ] [MAIN      ] PRH: Successfully saved derivative data.
[2025-10-24T01:27:37.814108] [INFO ] [MAIN      ] Derivative Progress: 1567/2164 symbols completed. PRH took 1.2s. Estimated remaining: 4m 10s. Rate: 143.2 symbols/min
[2025-10-24T01:27:37.814849] [INFO ] [MAIN      ] PRKS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:37.833288] [DEBUG] [MAIN      ] PRI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:37.905316] [DEBUG] [MAIN      ] PRIM: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:27:37.934831] [INFO ] [MAIN      ] PRI: Generated 139 derivative records from 17835 primary records.
[2025-10-24T01:27:37.938816] [DEBUG] [LOCAL     ] PRI: Saving derivative data.
[2025-10-24T01:27:37.941526] [DEBUG] [LOCAL     ] PRKS: Loaded 42500 existing records from primary storage.
[2025-10-24T01:27:37.953036] [INFO ] [MAIN      ] PRKS: Loaded 42500 primary data records.
[2025-10-24T01:27:37.963585] [DEBUG] [LOCAL     ] PRI: Derivative data saved (139 records).
[2025-10-24T01:27:38.008805] [INFO ] [MAIN      ] PRI: Successfully saved derivative data.
[2025-10-24T01:27:38.058313] [INFO ] [MAIN      ] Derivative Progress: 1568/2164 symbols completed. PRI took 1.0s. Estimated remaining: 4m 10s. Rate: 143.2 symbols/min
[2025-10-24T01:27:38.083851] [INFO ] [MAIN      ] PRLB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:38.306834] [DEBUG] [LOCAL     ] PRLB: Loaded 20478 existing records from primary storage.
[2025-10-24T01:27:38.308676] [INFO ] [MAIN      ] PRLB: Loaded 20478 primary data records.
[2025-10-24T01:27:38.324553] [INFO ] [MAIN      ] PRIM: Generated 139 derivative records from 44369 primary records.
[2025-10-24T01:27:38.325093] [DEBUG] [LOCAL     ] PRIM: Saving derivative data.
[2025-10-24T01:27:38.404752] [DEBUG] [LOCAL     ] PRIM: Derivative data saved (139 records).
[2025-10-24T01:27:38.421855] [INFO ] [MAIN      ] PRIM: Successfully saved derivative data.
[2025-10-24T01:27:38.433317] [INFO ] [MAIN      ] Derivative Progress: 1569/2164 symbols completed. PRIM took 1.4s. Estimated remaining: 4m 9s. Rate: 143.2 symbols/min
[2025-10-24T01:27:38.438329] [INFO ] [MAIN      ] PRM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:38.650061] [DEBUG] [MAIN      ] PRKS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:38.712133] [DEBUG] [LOCAL     ] PRM: Loaded 44667 existing records from primary storage.
[2025-10-24T01:27:38.715172] [INFO ] [MAIN      ] PRM: Loaded 44667 primary data records.
[2025-10-24T01:27:38.753889] [INFO ] [MAIN      ] PRKS: Generated 139 derivative records from 42500 primary records.
[2025-10-24T01:27:38.773105] [DEBUG] [LOCAL     ] PRKS: Saving derivative data.
[2025-10-24T01:27:38.830901] [DEBUG] [MAIN      ] PRLB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:38.859755] [DEBUG] [LOCAL     ] PRKS: Derivative data saved (139 records).
[2025-10-24T01:27:38.912426] [INFO ] [MAIN      ] PRKS: Successfully saved derivative data.
[2025-10-24T01:27:38.950723] [INFO ] [MAIN      ] Derivative Progress: 1570/2164 symbols completed. PRKS took 1.1s. Estimated remaining: 4m 9s. Rate: 143.2 symbols/min
[2025-10-24T01:27:38.981682] [INFO ] [MAIN      ] PRMB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:39.125293] [INFO ] [MAIN      ] PRLB: Generated 139 derivative records from 20478 primary records.
[2025-10-24T01:27:39.125592] [DEBUG] [LOCAL     ] PRLB: Saving derivative data.
[2025-10-24T01:27:39.138282] [DEBUG] [LOCAL     ] PRLB: Derivative data saved (139 records).
[2025-10-24T01:27:39.138520] [INFO ] [MAIN      ] PRLB: Successfully saved derivative data.
[2025-10-24T01:27:39.140721] [INFO ] [MAIN      ] Derivative Progress: 1571/2164 symbols completed. PRLB took 1.1s. Estimated remaining: 4m 8s. Rate: 143.2 symbols/min
[2025-10-24T01:27:39.141054] [INFO ] [MAIN      ] PRO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:39.172197] [DEBUG] [MAIN      ] PRM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:39.206626] [DEBUG] [LOCAL     ] PRMB: Loaded 53483 existing records from primary storage.
[2025-10-24T01:27:39.207179] [INFO ] [MAIN      ] PRMB: Loaded 53483 primary data records.
[2025-10-24T01:27:39.358955] [DEBUG] [LOCAL     ] PRO: Loaded 40426 existing records from primary storage.
[2025-10-24T01:27:39.386420] [INFO ] [MAIN      ] PRO: Loaded 40426 primary data records.
[2025-10-24T01:27:39.647243] [INFO ] [MAIN      ] PRM: Generated 139 derivative records from 44667 primary records.
[2025-10-24T01:27:39.673276] [DEBUG] [LOCAL     ] PRM: Saving derivative data.
[2025-10-24T01:27:39.854035] [DEBUG] [LOCAL     ] PRM: Derivative data saved (139 records).
[2025-10-24T01:27:39.854720] [INFO ] [MAIN      ] PRM: Successfully saved derivative data.
[2025-10-24T01:27:39.857072] [INFO ] [MAIN      ] Derivative Progress: 1572/2164 symbols completed. PRM took 1.4s. Estimated remaining: 4m 8s. Rate: 143.2 symbols/min
[2025-10-24T01:27:39.857488] [INFO ] [MAIN      ] PRSU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:39.878210] [DEBUG] [MAIN      ] PRMB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:39.913348] [DEBUG] [LOCAL     ] PRSU: Loaded 23223 existing records from primary storage.
[2025-10-24T01:27:39.916834] [INFO ] [MAIN      ] PRSU: Loaded 23223 primary data records.
[2025-10-24T01:27:40.018492] [DEBUG] [MAIN      ] PRO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:40.080984] [INFO ] [MAIN      ] PRMB: Generated 139 derivative records from 53483 primary records.
[2025-10-24T01:27:40.140601] [DEBUG] [LOCAL     ] PRMB: Saving derivative data.
[2025-10-24T01:27:40.277601] [DEBUG] [LOCAL     ] PRMB: Derivative data saved (139 records).
[2025-10-24T01:27:40.279120] [INFO ] [MAIN      ] PRMB: Successfully saved derivative data.
[2025-10-24T01:27:40.284126] [INFO ] [MAIN      ] Derivative Progress: 1573/2164 symbols completed. PRMB took 1.3s. Estimated remaining: 4m 8s. Rate: 143.2 symbols/min
[2025-10-24T01:27:40.295132] [INFO ] [MAIN      ] PRO: Generated 139 derivative records from 40426 primary records.
[2025-10-24T01:27:40.295472] [DEBUG] [LOCAL     ] PRO: Saving derivative data.
[2025-10-24T01:27:40.308467] [DEBUG] [LOCAL     ] PRO: Derivative data saved (139 records).
[2025-10-24T01:27:40.309895] [INFO ] [MAIN      ] PRO: Successfully saved derivative data.
[2025-10-24T01:27:40.312742] [INFO ] [MAIN      ] Derivative Progress: 1574/2164 symbols completed. PRO took 1.2s. Estimated remaining: 4m 7s. Rate: 143.3 symbols/min
[2025-10-24T01:27:40.325398] [DEBUG] [MAIN      ] PRSU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:40.350943] [INFO ] [MAIN      ] PRSU: Generated 139 derivative records from 23223 primary records.
[2025-10-24T01:27:40.351039] [DEBUG] [LOCAL     ] PRSU: Saving derivative data.
[2025-10-24T01:27:40.362817] [DEBUG] [LOCAL     ] PRSU: Derivative data saved (139 records).
[2025-10-24T01:27:40.362903] [INFO ] [MAIN      ] PRSU: Successfully saved derivative data.
[2025-10-24T01:27:40.365251] [INFO ] [MAIN      ] Derivative Progress: 1575/2164 symbols completed. PRSU took 0.5s. Estimated remaining: 4m 7s. Rate: 143.3 symbols/min
[2025-10-24T01:27:40.365625] [INFO ] [MAIN      ] PRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:40.365723] [INFO ] [MAIN      ] PSA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:40.365820] [INFO ] [MAIN      ] PRU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:40.377712] [DEBUG] [LOCAL     ] PRT: Loaded 5085 existing records from primary storage.
[2025-10-24T01:27:40.378031] [INFO ] [MAIN      ] PRT: Loaded 5085 primary data records.
[2025-10-24T01:27:40.710811] [DEBUG] [LOCAL     ] PSA: Loaded 42392 existing records from primary storage.
[2025-10-24T01:27:40.711786] [INFO ] [MAIN      ] PSA: Loaded 42392 primary data records.
[2025-10-24T01:27:40.844473] [DEBUG] [LOCAL     ] PRU: Loaded 51504 existing records from primary storage.
[2025-10-24T01:27:40.850545] [INFO ] [MAIN      ] PRU: Loaded 51504 primary data records.
[2025-10-24T01:27:41.392165] [DEBUG] [MAIN      ] PRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:41.443488] [DEBUG] [MAIN      ] PSA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:41.467278] [DEBUG] [MAIN      ] PRU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:41.501457] [INFO ] [MAIN      ] PRT: Generated 139 derivative records from 5085 primary records.
[2025-10-24T01:27:41.506910] [DEBUG] [LOCAL     ] PRT: Saving derivative data.
[2025-10-24T01:27:41.528517] [DEBUG] [LOCAL     ] PRT: Derivative data saved (139 records).
[2025-10-24T01:27:41.531255] [INFO ] [MAIN      ] PRT: Successfully saved derivative data.
[2025-10-24T01:27:41.535077] [INFO ] [MAIN      ] Derivative Progress: 1576/2164 symbols completed. PRT took 1.2s. Estimated remaining: 4m 6s. Rate: 143.2 symbols/min
[2025-10-24T01:27:41.536254] [INFO ] [MAIN      ] PSBD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:41.544170] [INFO ] [MAIN      ] PSA: Generated 139 derivative records from 42392 primary records.
[2025-10-24T01:27:41.546586] [DEBUG] [LOCAL     ] PSA: Saving derivative data.
[2025-10-24T01:27:41.547411] [INFO ] [MAIN      ] PRU: Generated 139 derivative records from 51504 primary records.
[2025-10-24T01:27:41.547509] [DEBUG] [LOCAL     ] PRU: Saving derivative data.
[2025-10-24T01:27:41.569106] [DEBUG] [LOCAL     ] PSA: Derivative data saved (139 records).
[2025-10-24T01:27:41.570618] [INFO ] [MAIN      ] PSA: Successfully saved derivative data.
[2025-10-24T01:27:41.573134] [INFO ] [MAIN      ] Derivative Progress: 1577/2164 symbols completed. PSA took 1.2s. Estimated remaining: 4m 6s. Rate: 143.3 symbols/min
[2025-10-24T01:27:41.578265] [DEBUG] [LOCAL     ] PSBD: Loaded 8310 existing records from primary storage.
[2025-10-24T01:27:41.577632] [INFO ] [MAIN      ] PSF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:41.580053] [INFO ] [MAIN      ] PSBD: Loaded 8310 primary data records.
[2025-10-24T01:27:41.619321] [DEBUG] [LOCAL     ] PRU: Derivative data saved (139 records).
[2025-10-24T01:27:41.647363] [INFO ] [MAIN      ] PRU: Successfully saved derivative data.
[2025-10-24T01:27:41.650411] [INFO ] [MAIN      ] Derivative Progress: 1578/2164 symbols completed. PRU took 1.3s. Estimated remaining: 4m 5s. Rate: 143.3 symbols/min
[2025-10-24T01:27:41.662372] [INFO ] [MAIN      ] PSFE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:41.704338] [DEBUG] [LOCAL     ] PSF: Loaded 6972 existing records from primary storage.
[2025-10-24T01:27:41.747072] [INFO ] [MAIN      ] PSF: Loaded 6972 primary data records.
[2025-10-24T01:27:42.091047] [DEBUG] [LOCAL     ] PSFE: Loaded 29746 existing records from primary storage.
[2025-10-24T01:27:42.091454] [INFO ] [MAIN      ] PSFE: Loaded 29746 primary data records.
[2025-10-24T01:27:42.522420] [DEBUG] [MAIN      ] PSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:42.575151] [DEBUG] [MAIN      ] PSF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:42.597839] [INFO ] [MAIN      ] PSBD: Generated 139 derivative records from 8310 primary records.
[2025-10-24T01:27:42.599753] [DEBUG] [LOCAL     ] PSBD: Saving derivative data.
[2025-10-24T01:27:42.626895] [DEBUG] [LOCAL     ] PSBD: Derivative data saved (139 records).
[2025-10-24T01:27:42.627170] [INFO ] [MAIN      ] PSBD: Successfully saved derivative data.
[2025-10-24T01:27:42.627502] [DEBUG] [MAIN      ] PSFE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:42.634730] [INFO ] [MAIN      ] Derivative Progress: 1579/2164 symbols completed. PSBD took 1.1s. Estimated remaining: 4m 5s. Rate: 143.2 symbols/min
[2025-10-24T01:27:42.652024] [INFO ] [MAIN      ] PSN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:42.677703] [INFO ] [MAIN      ] PSF: Generated 139 derivative records from 6972 primary records.
[2025-10-24T01:27:42.680574] [DEBUG] [LOCAL     ] PSF: Saving derivative data.
[2025-10-24T01:27:42.704287] [DEBUG] [LOCAL     ] PSF: Derivative data saved (139 records).
[2025-10-24T01:27:42.706689] [INFO ] [MAIN      ] PSF: Successfully saved derivative data.
[2025-10-24T01:27:42.709351] [INFO ] [MAIN      ] Derivative Progress: 1580/2164 symbols completed. PSF took 1.1s. Estimated remaining: 4m 5s. Rate: 143.3 symbols/min
[2025-10-24T01:27:42.711226] [INFO ] [MAIN      ] PSO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:42.731184] [INFO ] [MAIN      ] PSFE: Generated 139 derivative records from 29746 primary records.
[2025-10-24T01:27:42.732872] [DEBUG] [LOCAL     ] PSN: Loaded 45425 existing records from primary storage.
[2025-10-24T01:27:42.733340] [DEBUG] [LOCAL     ] PSFE: Saving derivative data.
[2025-10-24T01:27:42.733448] [INFO ] [MAIN      ] PSN: Loaded 45425 primary data records.
[2025-10-24T01:27:42.779736] [DEBUG] [LOCAL     ] PSFE: Derivative data saved (139 records).
[2025-10-24T01:27:42.792034] [INFO ] [MAIN      ] PSFE: Successfully saved derivative data.
[2025-10-24T01:27:42.815232] [INFO ] [MAIN      ] Derivative Progress: 1581/2164 symbols completed. PSFE took 1.2s. Estimated remaining: 4m 4s. Rate: 143.3 symbols/min
[2025-10-24T01:27:42.827404] [INFO ] [MAIN      ] PSQH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:43.106874] [DEBUG] [LOCAL     ] PSO: Loaded 36855 existing records from primary storage.
[2025-10-24T01:27:43.107338] [INFO ] [MAIN      ] PSO: Loaded 36855 primary data records.
[2025-10-24T01:27:43.195516] [DEBUG] [LOCAL     ] PSQH: Loaded 35712 existing records from primary storage.
[2025-10-24T01:27:43.226431] [INFO ] [MAIN      ] PSQH: Loaded 35712 primary data records.
[2025-10-24T01:27:43.762237] [DEBUG] [MAIN      ] PSN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:43.827709] [DEBUG] [MAIN      ] PSO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:43.851310] [INFO ] [MAIN      ] PSN: Generated 139 derivative records from 45425 primary records.
[2025-10-24T01:27:43.867498] [DEBUG] [LOCAL     ] PSN: Saving derivative data.
[2025-10-24T01:27:43.869136] [DEBUG] [MAIN      ] PSQH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:43.913178] [DEBUG] [LOCAL     ] PSN: Derivative data saved (139 records).
[2025-10-24T01:27:43.915904] [INFO ] [MAIN      ] PSN: Successfully saved derivative data.
[2025-10-24T01:27:43.923406] [INFO ] [MAIN      ] Derivative Progress: 1582/2164 symbols completed. PSN took 1.3s. Estimated remaining: 4m 4s. Rate: 143.2 symbols/min
[2025-10-24T01:27:43.927474] [INFO ] [MAIN      ] PSTG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:43.962457] [INFO ] [MAIN      ] PSO: Generated 139 derivative records from 36855 primary records.
[2025-10-24T01:27:43.963427] [DEBUG] [LOCAL     ] PSO: Saving derivative data.
[2025-10-24T01:27:43.967111] [INFO ] [MAIN      ] PSQH: Generated 139 derivative records from 35712 primary records.
[2025-10-24T01:27:43.977360] [DEBUG] [LOCAL     ] PSQH: Saving derivative data.
[2025-10-24T01:27:43.980539] [DEBUG] [LOCAL     ] PSO: Derivative data saved (139 records).
[2025-10-24T01:27:43.981281] [INFO ] [MAIN      ] PSO: Successfully saved derivative data.
[2025-10-24T01:27:43.984884] [INFO ] [MAIN      ] Derivative Progress: 1583/2164 symbols completed. PSO took 1.3s. Estimated remaining: 4m 3s. Rate: 143.3 symbols/min
[2025-10-24T01:27:44.000569] [INFO ] [MAIN      ] PSTL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:44.014304] [DEBUG] [LOCAL     ] PSQH: Derivative data saved (139 records).
[2025-10-24T01:27:44.014853] [INFO ] [MAIN      ] PSQH: Successfully saved derivative data.
[2025-10-24T01:27:44.017926] [INFO ] [MAIN      ] Derivative Progress: 1584/2164 symbols completed. PSQH took 1.2s. Estimated remaining: 4m 3s. Rate: 143.4 symbols/min
[2025-10-24T01:27:44.018287] [INFO ] [MAIN      ] PSX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:44.037473] [DEBUG] [LOCAL     ] PSTG: Loaded 53212 existing records from primary storage.
[2025-10-24T01:27:44.044281] [INFO ] [MAIN      ] PSTG: Loaded 53212 primary data records.
[2025-10-24T01:27:44.146451] [DEBUG] [LOCAL     ] PSTL: Loaded 20000 existing records from primary storage.
[2025-10-24T01:27:44.165709] [INFO ] [MAIN      ] PSTL: Loaded 20000 primary data records.
[2025-10-24T01:27:44.516162] [DEBUG] [LOCAL     ] PSX: Loaded 53511 existing records from primary storage.
[2025-10-24T01:27:44.516785] [INFO ] [MAIN      ] PSX: Loaded 53511 primary data records.
[2025-10-24T01:27:45.103037] [DEBUG] [MAIN      ] PSTG: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:27:45.155167] [DEBUG] [MAIN      ] PSTL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:45.188828] [DEBUG] [MAIN      ] PSX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:45.209332] [INFO ] [MAIN      ] PSTG: Generated 139 derivative records from 53212 primary records.
[2025-10-24T01:27:45.212844] [DEBUG] [LOCAL     ] PSTG: Saving derivative data.
[2025-10-24T01:27:45.228841] [DEBUG] [LOCAL     ] PSTG: Derivative data saved (139 records).
[2025-10-24T01:27:45.229486] [INFO ] [MAIN      ] PSTG: Successfully saved derivative data.
[2025-10-24T01:27:45.232246] [INFO ] [MAIN      ] Derivative Progress: 1585/2164 symbols completed. PSTG took 1.3s. Estimated remaining: 4m 3s. Rate: 143.2 symbols/min
[2025-10-24T01:27:45.232519] [INFO ] [MAIN      ] PTY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:45.267820] [INFO ] [MAIN      ] PSX: Generated 139 derivative records from 53511 primary records.
[2025-10-24T01:27:45.278764] [DEBUG] [LOCAL     ] PSX: Saving derivative data.
[2025-10-24T01:27:45.281424] [INFO ] [MAIN      ] PSTL: Generated 139 derivative records from 20000 primary records.
[2025-10-24T01:27:45.289290] [DEBUG] [LOCAL     ] PSTL: Saving derivative data.
[2025-10-24T01:27:45.294322] [DEBUG] [LOCAL     ] PSX: Derivative data saved (139 records).
[2025-10-24T01:27:45.295702] [INFO ] [MAIN      ] PSX: Successfully saved derivative data.
[2025-10-24T01:27:45.298931] [INFO ] [MAIN      ] Derivative Progress: 1586/2164 symbols completed. PSX took 1.3s. Estimated remaining: 4m 2s. Rate: 143.3 symbols/min
[2025-10-24T01:27:45.306469] [INFO ] [MAIN      ] PUK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:45.321981] [DEBUG] [LOCAL     ] PSTL: Derivative data saved (139 records).
[2025-10-24T01:27:45.322164] [INFO ] [MAIN      ] PSTL: Successfully saved derivative data.
[2025-10-24T01:27:45.324509] [INFO ] [MAIN      ] Derivative Progress: 1587/2164 symbols completed. PSTL took 1.3s. Estimated remaining: 4m 2s. Rate: 143.3 symbols/min
[2025-10-24T01:27:45.324707] [INFO ] [MAIN      ] PUMP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:45.326285] [DEBUG] [LOCAL     ] PTY: Loaded 38196 existing records from primary storage.
[2025-10-24T01:27:45.327249] [INFO ] [MAIN      ] PTY: Loaded 38196 primary data records.
[2025-10-24T01:27:45.699384] [DEBUG] [LOCAL     ] PUK: Loaded 44662 existing records from primary storage.
[2025-10-24T01:27:45.703428] [INFO ] [MAIN      ] PUK: Loaded 44662 primary data records.
[2025-10-24T01:27:45.702671] [DEBUG] [LOCAL     ] PUMP: Loaded 49808 existing records from primary storage.
[2025-10-24T01:27:45.715488] [INFO ] [MAIN      ] PUMP: Loaded 49808 primary data records.
[2025-10-24T01:27:46.340723] [DEBUG] [MAIN      ] PTY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:46.403132] [DEBUG] [MAIN      ] PUK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:46.427877] [INFO ] [MAIN      ] PTY: Generated 139 derivative records from 38196 primary records.
[2025-10-24T01:27:46.428781] [DEBUG] [LOCAL     ] PTY: Saving derivative data.
[2025-10-24T01:27:46.457892] [DEBUG] [MAIN      ] PUMP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:46.457984] [DEBUG] [LOCAL     ] PTY: Derivative data saved (139 records).
[2025-10-24T01:27:46.461554] [INFO ] [MAIN      ] PTY: Successfully saved derivative data.
[2025-10-24T01:27:46.464336] [INFO ] [MAIN      ] Derivative Progress: 1588/2164 symbols completed. PTY took 1.2s. Estimated remaining: 4m 1s. Rate: 143.2 symbols/min
[2025-10-24T01:27:46.498900] [INFO ] [MAIN      ] PUK: Generated 139 derivative records from 44662 primary records.
[2025-10-24T01:27:46.499272] [DEBUG] [LOCAL     ] PUK: Saving derivative data.
[2025-10-24T01:27:46.518017] [DEBUG] [LOCAL     ] PUK: Derivative data saved (139 records).
[2025-10-24T01:27:46.518132] [INFO ] [MAIN      ] PUK: Successfully saved derivative data.
[2025-10-24T01:27:46.520410] [INFO ] [MAIN      ] Derivative Progress: 1589/2164 symbols completed. PUK took 1.2s. Estimated remaining: 4m 1s. Rate: 143.3 symbols/min
[2025-10-24T01:27:46.526893] [INFO ] [MAIN      ] PUMP: Generated 139 derivative records from 49808 primary records.
[2025-10-24T01:27:46.526992] [DEBUG] [LOCAL     ] PUMP: Saving derivative data.
[2025-10-24T01:27:46.538371] [DEBUG] [LOCAL     ] PUMP: Derivative data saved (139 records).
[2025-10-24T01:27:46.538470] [INFO ] [MAIN      ] PUMP: Successfully saved derivative data.
[2025-10-24T01:27:46.541404] [INFO ] [MAIN      ] Derivative Progress: 1590/2164 symbols completed. PUMP took 1.2s. Estimated remaining: 4m 0s. Rate: 143.4 symbols/min
[2025-10-24T01:27:46.541999] [INFO ] [MAIN      ] PVH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:46.542254] [INFO ] [MAIN      ] PWR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:46.542823] [INFO ] [MAIN      ] PVL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:46.552585] [DEBUG] [LOCAL     ] PVL: Loaded 4774 existing records from primary storage.
[2025-10-24T01:27:46.553045] [INFO ] [MAIN      ] PVL: Loaded 4774 primary data records.
[2025-10-24T01:27:46.936750] [DEBUG] [LOCAL     ] PVH: Loaded 49778 existing records from primary storage.
[2025-10-24T01:27:46.938063] [DEBUG] [LOCAL     ] PWR: Loaded 46797 existing records from primary storage.
[2025-10-24T01:27:46.939250] [INFO ] [MAIN      ] PWR: Loaded 46797 primary data records.
[2025-10-24T01:27:46.939124] [INFO ] [MAIN      ] PVH: Loaded 49778 primary data records.
[2025-10-24T01:27:47.605516] [DEBUG] [MAIN      ] PVL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:47.648233] [DEBUG] [MAIN      ] PWR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:47.691898] [DEBUG] [MAIN      ] PVH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:47.725089] [INFO ] [MAIN      ] PVL: Generated 139 derivative records from 4774 primary records.
[2025-10-24T01:27:47.729721] [DEBUG] [LOCAL     ] PVL: Saving derivative data.
[2025-10-24T01:27:47.750869] [DEBUG] [LOCAL     ] PVL: Derivative data saved (139 records).
[2025-10-24T01:27:47.753101] [INFO ] [MAIN      ] PVL: Successfully saved derivative data.
[2025-10-24T01:27:47.756707] [INFO ] [MAIN      ] Derivative Progress: 1591/2164 symbols completed. PVL took 1.2s. Estimated remaining: 4m 0s. Rate: 143.2 symbols/min
[2025-10-24T01:27:47.757536] [INFO ] [MAIN      ] PX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:47.765971] [INFO ] [MAIN      ] PWR: Generated 139 derivative records from 46797 primary records.
[2025-10-24T01:27:47.767576] [DEBUG] [LOCAL     ] PWR: Saving derivative data.
[2025-10-24T01:27:47.786717] [DEBUG] [LOCAL     ] PWR: Derivative data saved (139 records).
[2025-10-24T01:27:47.790256] [INFO ] [MAIN      ] PVH: Generated 139 derivative records from 49778 primary records.
[2025-10-24T01:27:47.790435] [INFO ] [MAIN      ] PWR: Successfully saved derivative data.
[2025-10-24T01:27:47.790637] [DEBUG] [LOCAL     ] PVH: Saving derivative data.
[2025-10-24T01:27:47.793305] [INFO ] [MAIN      ] Derivative Progress: 1592/2164 symbols completed. PWR took 1.3s. Estimated remaining: 3m 60s. Rate: 143.3 symbols/min
[2025-10-24T01:27:47.794770] [INFO ] [MAIN      ] QBTS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:47.817686] [DEBUG] [LOCAL     ] PVH: Derivative data saved (139 records).
[2025-10-24T01:27:47.817847] [INFO ] [MAIN      ] PVH: Successfully saved derivative data.
[2025-10-24T01:27:47.820530] [INFO ] [MAIN      ] Derivative Progress: 1593/2164 symbols completed. PVH took 1.3s. Estimated remaining: 3m 59s. Rate: 143.3 symbols/min
[2025-10-24T01:27:47.821062] [INFO ] [MAIN      ] QD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:47.836959] [DEBUG] [LOCAL     ] PX: Loaded 34132 existing records from primary storage.
[2025-10-24T01:27:47.837493] [INFO ] [MAIN      ] PX: Loaded 34132 primary data records.
[2025-10-24T01:27:48.043481] [DEBUG] [LOCAL     ] QD: Loaded 27628 existing records from primary storage.
[2025-10-24T01:27:48.061751] [INFO ] [MAIN      ] QD: Loaded 27628 primary data records.
[2025-10-24T01:27:48.312078] [DEBUG] [LOCAL     ] QBTS: Loaded 54210 existing records from primary storage.
[2025-10-24T01:27:48.329040] [INFO ] [MAIN      ] QBTS: Loaded 54210 primary data records.
[2025-10-24T01:27:48.844435] [DEBUG] [MAIN      ] PX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:48.877880] [DEBUG] [MAIN      ] QD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:48.934189] [DEBUG] [MAIN      ] QBTS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:48.955966] [INFO ] [MAIN      ] PX: Generated 139 derivative records from 34132 primary records.
[2025-10-24T01:27:48.956875] [DEBUG] [LOCAL     ] PX: Saving derivative data.
[2025-10-24T01:27:48.979241] [DEBUG] [LOCAL     ] PX: Derivative data saved (139 records).
[2025-10-24T01:27:48.979677] [INFO ] [MAIN      ] PX: Successfully saved derivative data.
[2025-10-24T01:27:48.982542] [INFO ] [MAIN      ] Derivative Progress: 1594/2164 symbols completed. PX took 1.2s. Estimated remaining: 3m 59s. Rate: 143.2 symbols/min
[2025-10-24T01:27:48.988495] [INFO ] [MAIN      ] QGEN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:49.001613] [INFO ] [MAIN      ] QD: Generated 139 derivative records from 27628 primary records.
[2025-10-24T01:27:49.003110] [DEBUG] [LOCAL     ] QD: Saving derivative data.
[2025-10-24T01:27:49.005824] [INFO ] [MAIN      ] QBTS: Generated 139 derivative records from 54210 primary records.
[2025-10-24T01:27:49.013059] [DEBUG] [LOCAL     ] QBTS: Saving derivative data.
[2025-10-24T01:27:49.018047] [DEBUG] [LOCAL     ] QD: Derivative data saved (139 records).
[2025-10-24T01:27:49.018394] [INFO ] [MAIN      ] QD: Successfully saved derivative data.
[2025-10-24T01:27:49.030620] [DEBUG] [LOCAL     ] QBTS: Derivative data saved (139 records).
[2025-10-24T01:27:49.032860] [INFO ] [MAIN      ] Derivative Progress: 1595/2164 symbols completed. QD took 1.2s. Estimated remaining: 3m 58s. Rate: 143.3 symbols/min
[2025-10-24T01:27:49.033359] [INFO ] [MAIN      ] QBTS: Successfully saved derivative data.
[2025-10-24T01:27:49.033504] [INFO ] [MAIN      ] QS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:49.036401] [INFO ] [MAIN      ] Derivative Progress: 1596/2164 symbols completed. QBTS took 1.2s. Estimated remaining: 3m 58s. Rate: 143.4 symbols/min
[2025-10-24T01:27:49.036716] [INFO ] [MAIN      ] QSR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:49.075990] [DEBUG] [LOCAL     ] QGEN: Loaded 49391 existing records from primary storage.
[2025-10-24T01:27:49.076388] [INFO ] [MAIN      ] QGEN: Loaded 49391 primary data records.
[2025-10-24T01:27:49.280819] [DEBUG] [LOCAL     ] QSR: Loaded 52811 existing records from primary storage.
[2025-10-24T01:27:49.297583] [DEBUG] [LOCAL     ] QS: Loaded 54150 existing records from primary storage.
[2025-10-24T01:27:49.297837] [INFO ] [MAIN      ] QSR: Loaded 52811 primary data records.
[2025-10-24T01:27:49.314084] [INFO ] [MAIN      ] QS: Loaded 54150 primary data records.
[2025-10-24T01:27:50.086230] [DEBUG] [MAIN      ] QGEN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:50.128994] [DEBUG] [MAIN      ] QSR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:50.160121] [DEBUG] [MAIN      ] QS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:50.186585] [INFO ] [MAIN      ] QGEN: Generated 139 derivative records from 49391 primary records.
[2025-10-24T01:27:50.189560] [DEBUG] [LOCAL     ] QGEN: Saving derivative data.
[2025-10-24T01:27:50.208634] [DEBUG] [LOCAL     ] QGEN: Derivative data saved (139 records).
[2025-10-24T01:27:50.209598] [INFO ] [MAIN      ] QGEN: Successfully saved derivative data.
[2025-10-24T01:27:50.212934] [INFO ] [MAIN      ] Derivative Progress: 1597/2164 symbols completed. QGEN took 1.2s. Estimated remaining: 3m 58s. Rate: 143.2 symbols/min
[2025-10-24T01:27:50.218525] [INFO ] [MAIN      ] QTWO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:50.231537] [INFO ] [MAIN      ] QS: Generated 139 derivative records from 54150 primary records.
[2025-10-24T01:27:50.234007] [DEBUG] [LOCAL     ] QS: Saving derivative data.
[2025-10-24T01:27:50.233855] [INFO ] [MAIN      ] QSR: Generated 139 derivative records from 52811 primary records.
[2025-10-24T01:27:50.234133] [DEBUG] [LOCAL     ] QSR: Saving derivative data.
[2025-10-24T01:27:50.266401] [DEBUG] [LOCAL     ] QSR: Derivative data saved (139 records).
[2025-10-24T01:27:50.256971] [DEBUG] [LOCAL     ] QS: Derivative data saved (139 records).
[2025-10-24T01:27:50.266570] [INFO ] [MAIN      ] QS: Successfully saved derivative data.
[2025-10-24T01:27:50.269706] [INFO ] [MAIN      ] Derivative Progress: 1598/2164 symbols completed. QS took 1.2s. Estimated remaining: 3m 57s. Rate: 143.3 symbols/min
[2025-10-24T01:27:50.270030] [INFO ] [MAIN      ] QUAD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:50.266696] [INFO ] [MAIN      ] QSR: Successfully saved derivative data.
[2025-10-24T01:27:50.273132] [INFO ] [MAIN      ] Derivative Progress: 1599/2164 symbols completed. QSR took 1.2s. Estimated remaining: 3m 56s. Rate: 143.4 symbols/min
[2025-10-24T01:27:50.273455] [INFO ] [MAIN      ] QVCC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:50.288552] [DEBUG] [LOCAL     ] QTWO: Loaded 39712 existing records from primary storage.
[2025-10-24T01:27:50.290696] [INFO ] [MAIN      ] QTWO: Loaded 39712 primary data records.
[2025-10-24T01:27:50.376948] [DEBUG] [LOCAL     ] QVCC: Loaded 8745 existing records from primary storage.
[2025-10-24T01:27:50.408774] [INFO ] [MAIN      ] QVCC: Loaded 8745 primary data records.
[2025-10-24T01:27:50.413874] [DEBUG] [LOCAL     ] QUAD: Loaded 23146 existing records from primary storage.
[2025-10-24T01:27:50.424681] [INFO ] [MAIN      ] QUAD: Loaded 23146 primary data records.
[2025-10-24T01:27:51.342631] [DEBUG] [MAIN      ] QTWO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:51.411916] [DEBUG] [MAIN      ] QVCC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:51.433680] [DEBUG] [MAIN      ] QUAD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:51.502299] [INFO ] [MAIN      ] QTWO: Generated 139 derivative records from 39712 primary records.
[2025-10-24T01:27:51.506837] [DEBUG] [LOCAL     ] QTWO: Saving derivative data.
[2025-10-24T01:27:51.540664] [DEBUG] [LOCAL     ] QTWO: Derivative data saved (139 records).
[2025-10-24T01:27:51.545966] [INFO ] [MAIN      ] QTWO: Successfully saved derivative data.
[2025-10-24T01:27:51.549225] [INFO ] [MAIN      ] QVCC: Generated 139 derivative records from 8745 primary records.
[2025-10-24T01:27:51.554820] [DEBUG] [LOCAL     ] QVCC: Saving derivative data.
[2025-10-24T01:27:51.554286] [INFO ] [MAIN      ] Derivative Progress: 1600/2164 symbols completed. QTWO took 1.3s. Estimated remaining: 3m 56s. Rate: 143.2 symbols/min
[2025-10-24T01:27:51.569836] [INFO ] [MAIN      ] QVCD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:51.577587] [DEBUG] [LOCAL     ] QVCC: Derivative data saved (139 records).
[2025-10-24T01:27:51.579106] [INFO ] [MAIN      ] QVCC: Successfully saved derivative data.
[2025-10-24T01:27:51.578169] [INFO ] [MAIN      ] QUAD: Generated 139 derivative records from 23146 primary records.
[2025-10-24T01:27:51.583803] [INFO ] [MAIN      ] Derivative Progress: 1601/2164 symbols completed. QVCC took 1.3s. Estimated remaining: 3m 56s. Rate: 143.3 symbols/min
[2025-10-24T01:27:51.586018] [INFO ] [MAIN      ] QXO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:51.584028] [DEBUG] [LOCAL     ] QUAD: Saving derivative data.
[2025-10-24T01:27:51.606609] [DEBUG] [LOCAL     ] QUAD: Derivative data saved (139 records).
[2025-10-24T01:27:51.610361] [INFO ] [MAIN      ] QUAD: Successfully saved derivative data.
[2025-10-24T01:27:51.619371] [DEBUG] [LOCAL     ] QVCD: Loaded 4583 existing records from primary storage.
[2025-10-24T01:27:51.619598] [INFO ] [MAIN      ] QVCD: Loaded 4583 primary data records.
[2025-10-24T01:27:51.618609] [INFO ] [MAIN      ] Derivative Progress: 1602/2164 symbols completed. QUAD took 1.3s. Estimated remaining: 3m 55s. Rate: 143.3 symbols/min
[2025-10-24T01:27:51.633950] [INFO ] [MAIN      ] R: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:52.078153] [DEBUG] [LOCAL     ] R: Loaded 28186 existing records from primary storage.
[2025-10-24T01:27:52.089204] [INFO ] [MAIN      ] R: Loaded 28186 primary data records.
[2025-10-24T01:27:52.123274] [DEBUG] [LOCAL     ] QXO: Loaded 53865 existing records from primary storage.
[2025-10-24T01:27:52.149472] [INFO ] [MAIN      ] QXO: Loaded 53865 primary data records.
[2025-10-24T01:27:52.750812] [DEBUG] [MAIN      ] QVCD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:52.801633] [DEBUG] [MAIN      ] R: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:52.824159] [INFO ] [MAIN      ] QVCD: Generated 139 derivative records from 4583 primary records.
[2025-10-24T01:27:52.838691] [DEBUG] [LOCAL     ] QVCD: Saving derivative data.
[2025-10-24T01:27:52.839172] [DEBUG] [MAIN      ] QXO: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:27:52.866352] [DEBUG] [LOCAL     ] QVCD: Derivative data saved (139 records).
[2025-10-24T01:27:52.869895] [INFO ] [MAIN      ] QVCD: Successfully saved derivative data.
[2025-10-24T01:27:52.872186] [INFO ] [MAIN      ] Derivative Progress: 1603/2164 symbols completed. QVCD took 1.3s. Estimated remaining: 3m 55s. Rate: 143.2 symbols/min
[2025-10-24T01:27:52.903690] [INFO ] [MAIN      ] R: Generated 139 derivative records from 28186 primary records.
[2025-10-24T01:27:52.906524] [DEBUG] [LOCAL     ] R: Saving derivative data.
[2025-10-24T01:27:52.921765] [INFO ] [MAIN      ] QXO: Generated 139 derivative records from 53865 primary records.
[2025-10-24T01:27:52.922810] [DEBUG] [LOCAL     ] QXO: Saving derivative data.
[2025-10-24T01:27:52.924113] [DEBUG] [LOCAL     ] R: Derivative data saved (139 records).
[2025-10-24T01:27:52.924817] [INFO ] [MAIN      ] R: Successfully saved derivative data.
[2025-10-24T01:27:52.928041] [INFO ] [MAIN      ] Derivative Progress: 1604/2164 symbols completed. R took 1.3s. Estimated remaining: 3m 55s. Rate: 143.2 symbols/min
[2025-10-24T01:27:52.939860] [DEBUG] [LOCAL     ] QXO: Derivative data saved (139 records).
[2025-10-24T01:27:52.939944] [INFO ] [MAIN      ] QXO: Successfully saved derivative data.
[2025-10-24T01:27:52.943404] [INFO ] [MAIN      ] Derivative Progress: 1605/2164 symbols completed. QXO took 1.4s. Estimated remaining: 3m 54s. Rate: 143.3 symbols/min
[2025-10-24T01:27:52.943909] [INFO ] [MAIN      ] RAMP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:52.943847] [INFO ] [MAIN      ] RA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:52.944040] [INFO ] [MAIN      ] RACE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:52.989399] [DEBUG] [LOCAL     ] RA: Loaded 22073 existing records from primary storage.
[2025-10-24T01:27:52.989781] [INFO ] [MAIN      ] RA: Loaded 22073 primary data records.
[2025-10-24T01:27:53.107777] [DEBUG] [LOCAL     ] RACE: Loaded 33262 existing records from primary storage.
[2025-10-24T01:27:53.119582] [INFO ] [MAIN      ] RACE: Loaded 33262 primary data records.
[2025-10-24T01:27:53.120155] [DEBUG] [LOCAL     ] RAMP: Loaded 37923 existing records from primary storage.
[2025-10-24T01:27:53.131084] [INFO ] [MAIN      ] RAMP: Loaded 37923 primary data records.
[2025-10-24T01:27:54.034831] [DEBUG] [MAIN      ] RA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:54.068848] [DEBUG] [MAIN      ] RAMP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:54.106026] [DEBUG] [MAIN      ] RACE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:54.160472] [INFO ] [MAIN      ] RA: Generated 139 derivative records from 22073 primary records.
[2025-10-24T01:27:54.163941] [INFO ] [MAIN      ] RAMP: Generated 139 derivative records from 37923 primary records.
[2025-10-24T01:27:54.164134] [DEBUG] [LOCAL     ] RA: Saving derivative data.
[2025-10-24T01:27:54.164277] [DEBUG] [LOCAL     ] RAMP: Saving derivative data.
[2025-10-24T01:27:54.193471] [DEBUG] [LOCAL     ] RA: Derivative data saved (139 records).
[2025-10-24T01:27:54.195373] [INFO ] [MAIN      ] RA: Successfully saved derivative data.
[2025-10-24T01:27:54.195769] [DEBUG] [LOCAL     ] RAMP: Derivative data saved (139 records).
[2025-10-24T01:27:54.199097] [INFO ] [MAIN      ] Derivative Progress: 1606/2164 symbols completed. RA took 1.3s. Estimated remaining: 3m 54s. Rate: 143.1 symbols/min
[2025-10-24T01:27:54.195873] [INFO ] [MAIN      ] RAMP: Successfully saved derivative data.
[2025-10-24T01:27:54.202116] [INFO ] [MAIN      ] RBA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:54.202199] [INFO ] [MAIN      ] Derivative Progress: 1607/2164 symbols completed. RAMP took 1.3s. Estimated remaining: 3m 53s. Rate: 143.2 symbols/min
[2025-10-24T01:27:54.203380] [INFO ] [MAIN      ] RBC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:54.206255] [INFO ] [MAIN      ] RACE: Generated 139 derivative records from 33262 primary records.
[2025-10-24T01:27:54.206553] [DEBUG] [LOCAL     ] RACE: Saving derivative data.
[2025-10-24T01:27:54.220024] [DEBUG] [LOCAL     ] RACE: Derivative data saved (139 records).
[2025-10-24T01:27:54.220154] [INFO ] [MAIN      ] RACE: Successfully saved derivative data.
[2025-10-24T01:27:54.223508] [INFO ] [MAIN      ] Derivative Progress: 1608/2164 symbols completed. RACE took 1.3s. Estimated remaining: 3m 53s. Rate: 143.3 symbols/min
[2025-10-24T01:27:54.223743] [INFO ] [MAIN      ] RBLX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:54.238844] [DEBUG] [LOCAL     ] RBC: Loaded 15417 existing records from primary storage.
[2025-10-24T01:27:54.239242] [INFO ] [MAIN      ] RBC: Loaded 15417 primary data records.
[2025-10-24T01:27:54.414038] [DEBUG] [LOCAL     ] RBA: Loaded 46387 existing records from primary storage.
[2025-10-24T01:27:54.454124] [INFO ] [MAIN      ] RBA: Loaded 46387 primary data records.
[2025-10-24T01:27:54.730242] [DEBUG] [LOCAL     ] RBLX: Loaded 54107 existing records from primary storage.
[2025-10-24T01:27:54.736863] [INFO ] [MAIN      ] RBLX: Loaded 54107 primary data records.
[2025-10-24T01:27:55.228718] [DEBUG] [MAIN      ] RBC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:55.271928] [DEBUG] [MAIN      ] RBA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:55.321158] [DEBUG] [MAIN      ] RBLX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:55.336469] [INFO ] [MAIN      ] RBC: Generated 139 derivative records from 15417 primary records.
[2025-10-24T01:27:55.338151] [DEBUG] [LOCAL     ] RBC: Saving derivative data.
[2025-10-24T01:27:55.358087] [DEBUG] [LOCAL     ] RBC: Derivative data saved (139 records).
[2025-10-24T01:27:55.362041] [INFO ] [MAIN      ] RBC: Successfully saved derivative data.
[2025-10-24T01:27:55.365092] [INFO ] [MAIN      ] Derivative Progress: 1609/2164 symbols completed. RBC took 1.2s. Estimated remaining: 3m 53s. Rate: 143.2 symbols/min
[2025-10-24T01:27:55.365820] [INFO ] [MAIN      ] RBOT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:55.380379] [INFO ] [MAIN      ] RBA: Generated 139 derivative records from 46387 primary records.
[2025-10-24T01:27:55.381923] [DEBUG] [LOCAL     ] RBA: Saving derivative data.
[2025-10-24T01:27:55.388487] [DEBUG] [LOCAL     ] RBOT: Loaded 6293 existing records from primary storage.
[2025-10-24T01:27:55.389055] [INFO ] [MAIN      ] RBOT: Loaded 6293 primary data records.
[2025-10-24T01:27:55.434520] [DEBUG] [LOCAL     ] RBA: Derivative data saved (139 records).
[2025-10-24T01:27:55.449616] [INFO ] [MAIN      ] RBA: Successfully saved derivative data.
[2025-10-24T01:27:55.478897] [INFO ] [MAIN      ] Derivative Progress: 1610/2164 symbols completed. RBA took 1.3s. Estimated remaining: 3m 52s. Rate: 143.2 symbols/min
[2025-10-24T01:27:55.515400] [INFO ] [MAIN      ] RBRK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:55.518865] [INFO ] [MAIN      ] RBLX: Generated 139 derivative records from 54107 primary records.
[2025-10-24T01:27:55.519050] [DEBUG] [LOCAL     ] RBLX: Saving derivative data.
[2025-10-24T01:27:55.571551] [DEBUG] [LOCAL     ] RBLX: Derivative data saved (139 records).
[2025-10-24T01:27:55.589028] [INFO ] [MAIN      ] RBLX: Successfully saved derivative data.
[2025-10-24T01:27:55.594629] [INFO ] [MAIN      ] Derivative Progress: 1611/2164 symbols completed. RBLX took 1.4s. Estimated remaining: 3m 52s. Rate: 143.3 symbols/min
[2025-10-24T01:27:55.732209] [INFO ] [MAIN      ] RC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:55.788963] [DEBUG] [MAIN      ] RBOT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:55.828119] [DEBUG] [LOCAL     ] RBRK: Loaded 53553 existing records from primary storage.
[2025-10-24T01:27:55.829932] [INFO ] [MAIN      ] RBRK: Loaded 53553 primary data records.
[2025-10-24T01:27:55.891405] [DEBUG] [LOCAL     ] RC: Loaded 49201 existing records from primary storage.
[2025-10-24T01:27:55.934321] [INFO ] [MAIN      ] RC: Loaded 49201 primary data records.
[2025-10-24T01:27:56.518189] [INFO ] [MAIN      ] RBOT: Generated 139 derivative records from 6293 primary records.
[2025-10-24T01:27:56.518622] [DEBUG] [LOCAL     ] RBOT: Saving derivative data.
[2025-10-24T01:27:56.533565] [DEBUG] [LOCAL     ] RBOT: Derivative data saved (139 records).
[2025-10-24T01:27:56.534621] [INFO ] [MAIN      ] RBOT: Successfully saved derivative data.
[2025-10-24T01:27:56.537969] [INFO ] [MAIN      ] Derivative Progress: 1612/2164 symbols completed. RBOT took 1.2s. Estimated remaining: 3m 51s. Rate: 143.2 symbols/min
[2025-10-24T01:27:56.538619] [INFO ] [MAIN      ] RCD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:56.551037] [DEBUG] [LOCAL     ] RCD: Loaded 3372 existing records from primary storage.
[2025-10-24T01:27:56.551692] [INFO ] [MAIN      ] RCD: Loaded 3372 primary data records.
[2025-10-24T01:27:56.610266] [DEBUG] [MAIN      ] RBRK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:56.764145] [DEBUG] [MAIN      ] RC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:56.987833] [INFO ] [MAIN      ] RBRK: Generated 139 derivative records from 53553 primary records.
[2025-10-24T01:27:56.991605] [DEBUG] [LOCAL     ] RBRK: Saving derivative data.
[2025-10-24T01:27:57.011157] [INFO ] [MAIN      ] RC: Generated 139 derivative records from 49201 primary records.
[2025-10-24T01:27:57.014583] [DEBUG] [LOCAL     ] RBRK: Derivative data saved (139 records).
[2025-10-24T01:27:57.016322] [INFO ] [MAIN      ] RBRK: Successfully saved derivative data.
[2025-10-24T01:27:57.014930] [DEBUG] [LOCAL     ] RC: Saving derivative data.
[2025-10-24T01:27:57.019964] [INFO ] [MAIN      ] Derivative Progress: 1613/2164 symbols completed. RBRK took 1.5s. Estimated remaining: 3m 51s. Rate: 143.2 symbols/min
[2025-10-24T01:27:57.023499] [INFO ] [MAIN      ] RCI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:57.043506] [DEBUG] [LOCAL     ] RC: Derivative data saved (139 records).
[2025-10-24T01:27:57.058052] [INFO ] [MAIN      ] RC: Successfully saved derivative data.
[2025-10-24T01:27:57.065703] [INFO ] [MAIN      ] Derivative Progress: 1614/2164 symbols completed. RC took 1.3s. Estimated remaining: 3m 50s. Rate: 143.3 symbols/min
[2025-10-24T01:27:57.065551] [DEBUG] [MAIN      ] RCD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:57.066250] [INFO ] [MAIN      ] RCL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:57.120371] [INFO ] [MAIN      ] RCD: Generated 139 derivative records from 3372 primary records.
[2025-10-24T01:27:57.120850] [DEBUG] [LOCAL     ] RCD: Saving derivative data.
[2025-10-24T01:27:57.131703] [DEBUG] [LOCAL     ] RCD: Derivative data saved (139 records).
[2025-10-24T01:27:57.131891] [INFO ] [MAIN      ] RCD: Successfully saved derivative data.
[2025-10-24T01:27:57.134758] [INFO ] [MAIN      ] Derivative Progress: 1615/2164 symbols completed. RCD took 0.6s. Estimated remaining: 3m 50s. Rate: 143.3 symbols/min
[2025-10-24T01:27:57.137010] [INFO ] [MAIN      ] RCS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:57.154025] [DEBUG] [LOCAL     ] RCI: Loaded 48956 existing records from primary storage.
[2025-10-24T01:27:57.168828] [INFO ] [MAIN      ] RCI: Loaded 48956 primary data records.
[2025-10-24T01:27:57.303365] [DEBUG] [LOCAL     ] RCL: Loaded 52040 existing records from primary storage.
[2025-10-24T01:27:57.294927] [DEBUG] [LOCAL     ] RCS: Loaded 12530 existing records from primary storage.
[2025-10-24T01:27:57.308810] [INFO ] [MAIN      ] RCL: Loaded 52040 primary data records.
[2025-10-24T01:27:57.337764] [INFO ] [MAIN      ] RCS: Loaded 12530 primary data records.
[2025-10-24T01:27:58.232743] [DEBUG] [MAIN      ] RCI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:58.279623] [DEBUG] [MAIN      ] RCS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:58.320775] [DEBUG] [MAIN      ] RCL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:58.354224] [INFO ] [MAIN      ] RCI: Generated 139 derivative records from 48956 primary records.
[2025-10-24T01:27:58.356558] [DEBUG] [LOCAL     ] RCI: Saving derivative data.
[2025-10-24T01:27:58.379035] [DEBUG] [LOCAL     ] RCI: Derivative data saved (139 records).
[2025-10-24T01:27:58.380017] [INFO ] [MAIN      ] RCI: Successfully saved derivative data.
[2025-10-24T01:27:58.383161] [INFO ] [MAIN      ] Derivative Progress: 1616/2164 symbols completed. RCI took 1.4s. Estimated remaining: 3m 50s. Rate: 143.1 symbols/min
[2025-10-24T01:27:58.386002] [INFO ] [MAIN      ] RCUS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:58.399624] [INFO ] [MAIN      ] RCS: Generated 139 derivative records from 12530 primary records.
[2025-10-24T01:27:58.402193] [DEBUG] [LOCAL     ] RCS: Saving derivative data.
[2025-10-24T01:27:58.417366] [INFO ] [MAIN      ] RCL: Generated 139 derivative records from 52040 primary records.
[2025-10-24T01:27:58.417674] [DEBUG] [LOCAL     ] RCL: Saving derivative data.
[2025-10-24T01:27:58.418478] [DEBUG] [LOCAL     ] RCS: Derivative data saved (139 records).
[2025-10-24T01:27:58.419118] [INFO ] [MAIN      ] RCS: Successfully saved derivative data.
[2025-10-24T01:27:58.441418] [INFO ] [MAIN      ] Derivative Progress: 1617/2164 symbols completed. RCS took 1.3s. Estimated remaining: 3m 49s. Rate: 143.2 symbols/min
[2025-10-24T01:27:58.441755] [INFO ] [MAIN      ] RDDT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:58.445914] [DEBUG] [LOCAL     ] RCL: Derivative data saved (139 records).
[2025-10-24T01:27:58.446260] [INFO ] [MAIN      ] RCL: Successfully saved derivative data.
[2025-10-24T01:27:58.449633] [INFO ] [MAIN      ] Derivative Progress: 1618/2164 symbols completed. RCL took 1.4s. Estimated remaining: 3m 49s. Rate: 143.3 symbols/min
[2025-10-24T01:27:58.465338] [DEBUG] [LOCAL     ] RCUS: Loaded 43277 existing records from primary storage.
[2025-10-24T01:27:58.465525] [INFO ] [MAIN      ] RCUS: Loaded 43277 primary data records.
[2025-10-24T01:27:58.788247] [DEBUG] [LOCAL     ] RDDT: Loaded 54159 existing records from primary storage.
[2025-10-24T01:27:58.789250] [INFO ] [MAIN      ] RDDT: Loaded 54159 primary data records.
[2025-10-24T01:27:59.099637] [DEBUG] [MAIN      ] RCUS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:59.143128] [INFO ] [MAIN      ] RCUS: Generated 139 derivative records from 43277 primary records.
[2025-10-24T01:27:59.156390] [DEBUG] [LOCAL     ] RCUS: Saving derivative data.
[2025-10-24T01:27:59.156767] [DEBUG] [MAIN      ] RDDT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:27:59.187667] [DEBUG] [LOCAL     ] RCUS: Derivative data saved (139 records).
[2025-10-24T01:27:59.190407] [INFO ] [MAIN      ] RCUS: Successfully saved derivative data.
[2025-10-24T01:27:59.194004] [INFO ] [MAIN      ] Derivative Progress: 1619/2164 symbols completed. RCUS took 0.8s. Estimated remaining: 3m 48s. Rate: 143.2 symbols/min
[2025-10-24T01:27:59.208204] [INFO ] [MAIN      ] RDDT: Generated 139 derivative records from 54159 primary records.
[2025-10-24T01:27:59.208403] [DEBUG] [LOCAL     ] RDDT: Saving derivative data.
[2025-10-24T01:27:59.221337] [DEBUG] [LOCAL     ] RDDT: Derivative data saved (139 records).
[2025-10-24T01:27:59.221466] [INFO ] [MAIN      ] RDDT: Successfully saved derivative data.
[2025-10-24T01:27:59.225477] [INFO ] [MAIN      ] Derivative Progress: 1620/2164 symbols completed. RDDT took 0.8s. Estimated remaining: 3m 48s. Rate: 143.3 symbols/min
[2025-10-24T01:27:59.226178] [INFO ] [MAIN      ] RDN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:59.226302] [INFO ] [MAIN      ] RDW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:59.226878] [INFO ] [MAIN      ] RDY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:27:59.307522] [DEBUG] [LOCAL     ] RDY: Loaded 46507 existing records from primary storage.
[2025-10-24T01:27:59.323352] [INFO ] [MAIN      ] RDY: Loaded 46507 primary data records.
[2025-10-24T01:27:59.382790] [DEBUG] [LOCAL     ] RDN: Loaded 44353 existing records from primary storage.
[2025-10-24T01:27:59.405214] [DEBUG] [LOCAL     ] RDW: Loaded 52676 existing records from primary storage.
[2025-10-24T01:27:59.417502] [INFO ] [MAIN      ] RDN: Loaded 44353 primary data records.
[2025-10-24T01:27:59.417707] [INFO ] [MAIN      ] RDW: Loaded 52676 primary data records.
[2025-10-24T01:28:00.378403] [DEBUG] [MAIN      ] RDY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:00.441483] [DEBUG] [MAIN      ] RDN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:00.453690] [DEBUG] [MAIN      ] RDW: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:28:00.486096] [INFO ] [MAIN      ] RDY: Generated 139 derivative records from 46507 primary records.
[2025-10-24T01:28:00.486779] [DEBUG] [LOCAL     ] RDY: Saving derivative data.
[2025-10-24T01:28:00.510250] [DEBUG] [LOCAL     ] RDY: Derivative data saved (139 records).
[2025-10-24T01:28:00.511888] [INFO ] [MAIN      ] RDY: Successfully saved derivative data.
[2025-10-24T01:28:00.514684] [INFO ] [MAIN      ] Derivative Progress: 1621/2164 symbols completed. RDY took 1.3s. Estimated remaining: 3m 48s. Rate: 143.1 symbols/min
[2025-10-24T01:28:00.518329] [INFO ] [MAIN      ] RELX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:00.538898] [INFO ] [MAIN      ] RDN: Generated 139 derivative records from 44353 primary records.
[2025-10-24T01:28:00.543301] [DEBUG] [LOCAL     ] RDN: Saving derivative data.
[2025-10-24T01:28:00.560601] [DEBUG] [LOCAL     ] RDN: Derivative data saved (139 records).
[2025-10-24T01:28:00.561273] [INFO ] [MAIN      ] RDW: Generated 139 derivative records from 52676 primary records.
[2025-10-24T01:28:00.561490] [INFO ] [MAIN      ] RDN: Successfully saved derivative data.
[2025-10-24T01:28:00.561412] [DEBUG] [LOCAL     ] RDW: Saving derivative data.
[2025-10-24T01:28:00.564863] [INFO ] [MAIN      ] Derivative Progress: 1622/2164 symbols completed. RDN took 1.3s. Estimated remaining: 3m 47s. Rate: 143.2 symbols/min
[2025-10-24T01:28:00.576910] [INFO ] [MAIN      ] RERE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:00.592682] [DEBUG] [LOCAL     ] RDW: Derivative data saved (139 records).
[2025-10-24T01:28:00.593073] [INFO ] [MAIN      ] RDW: Successfully saved derivative data.
[2025-10-24T01:28:00.595945] [INFO ] [MAIN      ] Derivative Progress: 1623/2164 symbols completed. RDW took 1.4s. Estimated remaining: 3m 47s. Rate: 143.3 symbols/min
[2025-10-24T01:28:00.596304] [INFO ] [MAIN      ] RES: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:00.616739] [DEBUG] [LOCAL     ] RELX: Loaded 48903 existing records from primary storage.
[2025-10-24T01:28:00.617130] [INFO ] [MAIN      ] RELX: Loaded 48903 primary data records.
[2025-10-24T01:28:00.834380] [DEBUG] [LOCAL     ] RERE: Loaded 42083 existing records from primary storage.
[2025-10-24T01:28:00.860390] [INFO ] [MAIN      ] RERE: Loaded 42083 primary data records.
[2025-10-24T01:28:01.016576] [DEBUG] [LOCAL     ] RES: Loaded 47208 existing records from primary storage.
[2025-10-24T01:28:01.082253] [INFO ] [MAIN      ] RES: Loaded 47208 primary data records.
[2025-10-24T01:28:01.629705] [DEBUG] [MAIN      ] RELX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:01.668839] [DEBUG] [MAIN      ] RERE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:01.721566] [DEBUG] [MAIN      ] RES: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:01.751331] [INFO ] [MAIN      ] RELX: Generated 139 derivative records from 48903 primary records.
[2025-10-24T01:28:01.758187] [DEBUG] [LOCAL     ] RELX: Saving derivative data.
[2025-10-24T01:28:01.779461] [DEBUG] [LOCAL     ] RELX: Derivative data saved (139 records).
[2025-10-24T01:28:01.783000] [INFO ] [MAIN      ] RELX: Successfully saved derivative data.
[2025-10-24T01:28:01.782484] [INFO ] [MAIN      ] RERE: Generated 139 derivative records from 42083 primary records.
[2025-10-24T01:28:01.783440] [DEBUG] [LOCAL     ] RERE: Saving derivative data.
[2025-10-24T01:28:01.785722] [INFO ] [MAIN      ] Derivative Progress: 1624/2164 symbols completed. RELX took 1.3s. Estimated remaining: 3m 46s. Rate: 143.1 symbols/min
[2025-10-24T01:28:01.807243] [DEBUG] [LOCAL     ] RERE: Derivative data saved (139 records).
[2025-10-24T01:28:01.807553] [INFO ] [MAIN      ] REVG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:01.812305] [INFO ] [MAIN      ] RERE: Successfully saved derivative data.
[2025-10-24T01:28:01.815111] [INFO ] [MAIN      ] Derivative Progress: 1625/2164 symbols completed. RERE took 1.2s. Estimated remaining: 3m 46s. Rate: 143.2 symbols/min
[2025-10-24T01:28:01.815940] [INFO ] [MAIN      ] REX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:01.827608] [INFO ] [MAIN      ] RES: Generated 139 derivative records from 47208 primary records.
[2025-10-24T01:28:01.827965] [DEBUG] [LOCAL     ] RES: Saving derivative data.
[2025-10-24T01:28:01.843442] [DEBUG] [LOCAL     ] RES: Derivative data saved (139 records).
[2025-10-24T01:28:01.843623] [INFO ] [MAIN      ] RES: Successfully saved derivative data.
[2025-10-24T01:28:01.847137] [INFO ] [MAIN      ] Derivative Progress: 1626/2164 symbols completed. RES took 1.3s. Estimated remaining: 3m 45s. Rate: 143.3 symbols/min
[2025-10-24T01:28:01.847485] [INFO ] [MAIN      ] REXR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:01.862819] [DEBUG] [LOCAL     ] REX: Loaded 14444 existing records from primary storage.
[2025-10-24T01:28:01.863077] [INFO ] [MAIN      ] REX: Loaded 14444 primary data records.
[2025-10-24T01:28:01.996901] [DEBUG] [LOCAL     ] REVG: Loaded 40460 existing records from primary storage.
[2025-10-24T01:28:01.997273] [INFO ] [MAIN      ] REVG: Loaded 40460 primary data records.
[2025-10-24T01:28:02.395850] [DEBUG] [LOCAL     ] REXR: Loaded 52569 existing records from primary storage.
[2025-10-24T01:28:02.515951] [INFO ] [MAIN      ] REXR: Loaded 52569 primary data records.
[2025-10-24T01:28:02.924583] [DEBUG] [MAIN      ] REX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:02.957953] [DEBUG] [MAIN      ] REVG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:03.022037] [DEBUG] [MAIN      ] REXR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:03.026170] [INFO ] [MAIN      ] REX: Generated 139 derivative records from 14444 primary records.
[2025-10-24T01:28:03.037709] [DEBUG] [LOCAL     ] REX: Saving derivative data.
[2025-10-24T01:28:03.063443] [DEBUG] [LOCAL     ] REX: Derivative data saved (139 records).
[2025-10-24T01:28:03.063716] [INFO ] [MAIN      ] REX: Successfully saved derivative data.
[2025-10-24T01:28:03.067178] [INFO ] [MAIN      ] Derivative Progress: 1627/2164 symbols completed. REX took 1.3s. Estimated remaining: 3m 45s. Rate: 143.1 symbols/min
[2025-10-24T01:28:03.070868] [INFO ] [MAIN      ] REZI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:03.070750] [INFO ] [MAIN      ] REVG: Generated 139 derivative records from 40460 primary records.
[2025-10-24T01:28:03.071958] [DEBUG] [LOCAL     ] REVG: Saving derivative data.
[2025-10-24T01:28:03.092161] [DEBUG] [LOCAL     ] REVG: Derivative data saved (139 records).
[2025-10-24T01:28:03.092609] [INFO ] [MAIN      ] REVG: Successfully saved derivative data.
[2025-10-24T01:28:03.095828] [INFO ] [MAIN      ] Derivative Progress: 1628/2164 symbols completed. REVG took 1.3s. Estimated remaining: 3m 45s. Rate: 143.2 symbols/min
[2025-10-24T01:28:03.096022] [INFO ] [MAIN      ] RF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:03.106724] [INFO ] [MAIN      ] REXR: Generated 139 derivative records from 52569 primary records.
[2025-10-24T01:28:03.107003] [DEBUG] [LOCAL     ] REXR: Saving derivative data.
[2025-10-24T01:28:03.130532] [DEBUG] [LOCAL     ] REXR: Derivative data saved (139 records).
[2025-10-24T01:28:03.130895] [INFO ] [MAIN      ] REXR: Successfully saved derivative data.
[2025-10-24T01:28:03.134225] [INFO ] [MAIN      ] Derivative Progress: 1629/2164 symbols completed. REXR took 1.3s. Estimated remaining: 3m 44s. Rate: 143.3 symbols/min
[2025-10-24T01:28:03.134607] [INFO ] [MAIN      ] RFI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:03.170322] [DEBUG] [LOCAL     ] REZI: Loaded 47445 existing records from primary storage.
[2025-10-24T01:28:03.170718] [INFO ] [MAIN      ] REZI: Loaded 47445 primary data records.
[2025-10-24T01:28:03.220723] [DEBUG] [LOCAL     ] RFI: Loaded 10283 existing records from primary storage.
[2025-10-24T01:28:03.256341] [INFO ] [MAIN      ] RFI: Loaded 10283 primary data records.
[2025-10-24T01:28:03.334823] [DEBUG] [LOCAL     ] RF: Loaded 54023 existing records from primary storage.
[2025-10-24T01:28:03.361226] [INFO ] [MAIN      ] RF: Loaded 54023 primary data records.
[2025-10-24T01:28:04.133808] [DEBUG] [MAIN      ] RFI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:04.133996] [DEBUG] [MAIN      ] REZI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:04.179773] [DEBUG] [MAIN      ] RF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:04.248031] [INFO ] [MAIN      ] RFI: Generated 139 derivative records from 10283 primary records.
[2025-10-24T01:28:04.250015] [DEBUG] [LOCAL     ] RFI: Saving derivative data.
[2025-10-24T01:28:04.260713] [INFO ] [MAIN      ] RF: Generated 139 derivative records from 54023 primary records.
[2025-10-24T01:28:04.267969] [INFO ] [MAIN      ] REZI: Generated 139 derivative records from 47445 primary records.
[2025-10-24T01:28:04.269739] [DEBUG] [LOCAL     ] REZI: Saving derivative data.
[2025-10-24T01:28:04.270773] [DEBUG] [LOCAL     ] RF: Saving derivative data.
[2025-10-24T01:28:04.285601] [DEBUG] [LOCAL     ] REZI: Derivative data saved (139 records).
[2025-10-24T01:28:04.285679] [DEBUG] [LOCAL     ] RFI: Derivative data saved (139 records).
[2025-10-24T01:28:04.286109] [INFO ] [MAIN      ] REZI: Successfully saved derivative data.
[2025-10-24T01:28:04.286468] [INFO ] [MAIN      ] RFI: Successfully saved derivative data.
[2025-10-24T01:28:04.296058] [INFO ] [MAIN      ] Derivative Progress: 1630/2164 symbols completed. REZI took 1.2s. Estimated remaining: 3m 44s. Rate: 143.1 symbols/min
[2025-10-24T01:28:04.302807] [INFO ] [MAIN      ] RFL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:04.303569] [INFO ] [MAIN      ] Derivative Progress: 1631/2164 symbols completed. RFI took 1.2s. Estimated remaining: 3m 43s. Rate: 143.2 symbols/min
[2025-10-24T01:28:04.303955] [INFO ] [MAIN      ] RFM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:04.303728] [DEBUG] [LOCAL     ] RF: Derivative data saved (139 records).
[2025-10-24T01:28:04.304894] [INFO ] [MAIN      ] RF: Successfully saved derivative data.
[2025-10-24T01:28:04.307638] [INFO ] [MAIN      ] Derivative Progress: 1632/2164 symbols completed. RF took 1.2s. Estimated remaining: 3m 43s. Rate: 143.3 symbols/min
[2025-10-24T01:28:04.307996] [INFO ] [MAIN      ] RFMZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:04.316103] [DEBUG] [LOCAL     ] RFM: Loaded 4225 existing records from primary storage.
[2025-10-24T01:28:04.316409] [INFO ] [MAIN      ] RFM: Loaded 4225 primary data records.
[2025-10-24T01:28:04.436139] [DEBUG] [LOCAL     ] RFMZ: Loaded 9143 existing records from primary storage.
[2025-10-24T01:28:04.415282] [DEBUG] [LOCAL     ] RFL: Loaded 11436 existing records from primary storage.
[2025-10-24T01:28:04.437022] [INFO ] [MAIN      ] RFL: Loaded 11436 primary data records.
[2025-10-24T01:28:04.437167] [INFO ] [MAIN      ] RFMZ: Loaded 9143 primary data records.
[2025-10-24T01:28:05.332879] [DEBUG] [MAIN      ] RFM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:05.391537] [DEBUG] [MAIN      ] RFL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:05.392172] [DEBUG] [MAIN      ] RFMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:05.451572] [INFO ] [MAIN      ] RFM: Generated 139 derivative records from 4225 primary records.
[2025-10-24T01:28:05.455344] [DEBUG] [LOCAL     ] RFM: Saving derivative data.
[2025-10-24T01:28:05.472745] [DEBUG] [LOCAL     ] RFM: Derivative data saved (139 records).
[2025-10-24T01:28:05.476778] [INFO ] [MAIN      ] RFM: Successfully saved derivative data.
[2025-10-24T01:28:05.482151] [INFO ] [MAIN      ] Derivative Progress: 1633/2164 symbols completed. RFM took 1.2s. Estimated remaining: 3m 43s. Rate: 143.2 symbols/min
[2025-10-24T01:28:05.491041] [INFO ] [MAIN      ] RFMZ: Generated 139 derivative records from 9143 primary records.
[2025-10-24T01:28:05.491307] [DEBUG] [LOCAL     ] RFMZ: Saving derivative data.
[2025-10-24T01:28:05.504878] [INFO ] [MAIN      ] RFL: Generated 139 derivative records from 11436 primary records.
[2025-10-24T01:28:05.507575] [DEBUG] [LOCAL     ] RFMZ: Derivative data saved (139 records).
[2025-10-24T01:28:05.507880] [DEBUG] [LOCAL     ] RFL: Saving derivative data.
[2025-10-24T01:28:05.507981] [INFO ] [MAIN      ] RFMZ: Successfully saved derivative data.
[2025-10-24T01:28:05.511019] [INFO ] [MAIN      ] Derivative Progress: 1634/2164 symbols completed. RFMZ took 1.2s. Estimated remaining: 3m 42s. Rate: 143.2 symbols/min
[2025-10-24T01:28:05.523509] [DEBUG] [LOCAL     ] RFL: Derivative data saved (139 records).
[2025-10-24T01:28:05.523624] [INFO ] [MAIN      ] RFL: Successfully saved derivative data.
[2025-10-24T01:28:05.527078] [INFO ] [MAIN      ] Derivative Progress: 1635/2164 symbols completed. RFL took 1.2s. Estimated remaining: 3m 41s. Rate: 143.3 symbols/min
[2025-10-24T01:28:05.527546] [INFO ] [MAIN      ] RGR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:05.527774] [INFO ] [MAIN      ] RH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:05.527964] [INFO ] [MAIN      ] RGT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:05.536489] [DEBUG] [LOCAL     ] RGT: Loaded 2721 existing records from primary storage.
[2025-10-24T01:28:05.536731] [INFO ] [MAIN      ] RGT: Loaded 2721 primary data records.
[2025-10-24T01:28:05.690243] [DEBUG] [LOCAL     ] RGR: Loaded 21085 existing records from primary storage.
[2025-10-24T01:28:05.828068] [INFO ] [MAIN      ] RGR: Loaded 21085 primary data records.
[2025-10-24T01:28:06.013341] [DEBUG] [LOCAL     ] RH: Loaded 47408 existing records from primary storage.
[2025-10-24T01:28:06.152474] [INFO ] [MAIN      ] RH: Loaded 47408 primary data records.
[2025-10-24T01:28:06.529282] [DEBUG] [MAIN      ] RGT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:06.566678] [DEBUG] [MAIN      ] RGR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:06.624813] [DEBUG] [MAIN      ] RH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:06.640770] [INFO ] [MAIN      ] RGT: Generated 139 derivative records from 2721 primary records.
[2025-10-24T01:28:06.642448] [DEBUG] [LOCAL     ] RGT: Saving derivative data.
[2025-10-24T01:28:06.657045] [DEBUG] [LOCAL     ] RGT: Derivative data saved (139 records).
[2025-10-24T01:28:06.657432] [INFO ] [MAIN      ] RGT: Successfully saved derivative data.
[2025-10-24T01:28:06.660322] [INFO ] [MAIN      ] Derivative Progress: 1636/2164 symbols completed. RGT took 1.1s. Estimated remaining: 3m 41s. Rate: 143.2 symbols/min
[2025-10-24T01:28:06.661989] [INFO ] [MAIN      ] RHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:06.667095] [INFO ] [MAIN      ] RGR: Generated 139 derivative records from 21085 primary records.
[2025-10-24T01:28:06.671015] [DEBUG] [LOCAL     ] RGR: Saving derivative data.
[2025-10-24T01:28:06.687102] [DEBUG] [LOCAL     ] RGR: Derivative data saved (139 records).
[2025-10-24T01:28:06.688271] [INFO ] [MAIN      ] RGR: Successfully saved derivative data.
[2025-10-24T01:28:06.690968] [INFO ] [MAIN      ] Derivative Progress: 1637/2164 symbols completed. RGR took 1.2s. Estimated remaining: 3m 41s. Rate: 143.3 symbols/min
[2025-10-24T01:28:06.691172] [INFO ] [MAIN      ] RHP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:06.697736] [INFO ] [MAIN      ] RH: Generated 139 derivative records from 47408 primary records.
[2025-10-24T01:28:06.697869] [DEBUG] [LOCAL     ] RH: Saving derivative data.
[2025-10-24T01:28:06.721512] [DEBUG] [LOCAL     ] RH: Derivative data saved (139 records).
[2025-10-24T01:28:06.721880] [INFO ] [MAIN      ] RH: Successfully saved derivative data.
[2025-10-24T01:28:06.725588] [INFO ] [MAIN      ] Derivative Progress: 1638/2164 symbols completed. RH took 1.2s. Estimated remaining: 3m 40s. Rate: 143.3 symbols/min
[2025-10-24T01:28:06.726107] [INFO ] [MAIN      ] RIG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:06.748409] [DEBUG] [LOCAL     ] RHI: Loaded 50078 existing records from primary storage.
[2025-10-24T01:28:06.748786] [INFO ] [MAIN      ] RHI: Loaded 50078 primary data records.
[2025-10-24T01:28:06.932190] [DEBUG] [LOCAL     ] RHP: Loaded 40539 existing records from primary storage.
[2025-10-24T01:28:06.955187] [INFO ] [MAIN      ] RHP: Loaded 40539 primary data records.
[2025-10-24T01:28:07.234829] [DEBUG] [LOCAL     ] RIG: Loaded 54065 existing records from primary storage.
[2025-10-24T01:28:07.288124] [INFO ] [MAIN      ] RIG: Loaded 54065 primary data records.
[2025-10-24T01:28:07.724593] [DEBUG] [MAIN      ] RHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:07.757537] [DEBUG] [MAIN      ] RHP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:07.819482] [DEBUG] [MAIN      ] RIG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:07.858476] [INFO ] [MAIN      ] RHI: Generated 139 derivative records from 50078 primary records.
[2025-10-24T01:28:07.864204] [INFO ] [MAIN      ] RHP: Generated 139 derivative records from 40539 primary records.
[2025-10-24T01:28:07.864756] [DEBUG] [LOCAL     ] RHI: Saving derivative data.
[2025-10-24T01:28:07.865179] [DEBUG] [LOCAL     ] RHP: Saving derivative data.
[2025-10-24T01:28:07.893514] [DEBUG] [LOCAL     ] RHI: Derivative data saved (139 records).
[2025-10-24T01:28:07.894527] [INFO ] [MAIN      ] RHI: Successfully saved derivative data.
[2025-10-24T01:28:07.895205] [DEBUG] [LOCAL     ] RHP: Derivative data saved (139 records).
[2025-10-24T01:28:07.903720] [INFO ] [MAIN      ] Derivative Progress: 1639/2164 symbols completed. RHI took 1.2s. Estimated remaining: 3m 40s. Rate: 143.2 symbols/min
[2025-10-24T01:28:07.903884] [INFO ] [MAIN      ] RHP: Successfully saved derivative data.
[2025-10-24T01:28:07.907447] [INFO ] [MAIN      ] Derivative Progress: 1640/2164 symbols completed. RHP took 1.2s. Estimated remaining: 3m 39s. Rate: 143.3 symbols/min
[2025-10-24T01:28:07.904449] [INFO ] [MAIN      ] RIO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:07.912156] [INFO ] [MAIN      ] RITM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:07.917270] [INFO ] [MAIN      ] RIG: Generated 139 derivative records from 54065 primary records.
[2025-10-24T01:28:07.917373] [DEBUG] [LOCAL     ] RIG: Saving derivative data.
[2025-10-24T01:28:07.930234] [DEBUG] [LOCAL     ] RIG: Derivative data saved (139 records).
[2025-10-24T01:28:07.930720] [INFO ] [MAIN      ] RIG: Successfully saved derivative data.
[2025-10-24T01:28:07.934500] [INFO ] [MAIN      ] Derivative Progress: 1641/2164 symbols completed. RIG took 1.2s. Estimated remaining: 3m 39s. Rate: 143.3 symbols/min
[2025-10-24T01:28:07.934857] [INFO ] [MAIN      ] RIV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:07.952088] [DEBUG] [LOCAL     ] RIV: Loaded 12714 existing records from primary storage.
[2025-10-24T01:28:07.952478] [INFO ] [MAIN      ] RIV: Loaded 12714 primary data records.
[2025-10-24T01:28:08.127985] [DEBUG] [LOCAL     ] RITM: Loaded 53334 existing records from primary storage.
[2025-10-24T01:28:08.128281] [INFO ] [MAIN      ] RITM: Loaded 53334 primary data records.
[2025-10-24T01:28:08.157184] [DEBUG] [LOCAL     ] RIO: Loaded 53792 existing records from primary storage.
[2025-10-24T01:28:08.167636] [INFO ] [MAIN      ] RIO: Loaded 53792 primary data records.
[2025-10-24T01:28:09.060241] [DEBUG] [MAIN      ] RIV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:09.094769] [DEBUG] [MAIN      ] RITM: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:28:09.148491] [DEBUG] [MAIN      ] RIO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:09.188060] [INFO ] [MAIN      ] RIV: Generated 139 derivative records from 12714 primary records.
[2025-10-24T01:28:09.190091] [INFO ] [MAIN      ] RITM: Generated 139 derivative records from 53334 primary records.
[2025-10-24T01:28:09.192580] [DEBUG] [LOCAL     ] RITM: Saving derivative data.
[2025-10-24T01:28:09.192620] [DEBUG] [LOCAL     ] RIV: Saving derivative data.
[2025-10-24T01:28:09.209859] [DEBUG] [LOCAL     ] RITM: Derivative data saved (139 records).
[2025-10-24T01:28:09.210557] [INFO ] [MAIN      ] RITM: Successfully saved derivative data.
[2025-10-24T01:28:09.220740] [INFO ] [MAIN      ] Derivative Progress: 1642/2164 symbols completed. RITM took 1.3s. Estimated remaining: 3m 39s. Rate: 143.2 symbols/min
[2025-10-24T01:28:09.224120] [INFO ] [MAIN      ] RJF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:09.232261] [DEBUG] [LOCAL     ] RIV: Derivative data saved (139 records).
[2025-10-24T01:28:09.233792] [INFO ] [MAIN      ] RIV: Successfully saved derivative data.
[2025-10-24T01:28:09.236064] [INFO ] [MAIN      ] Derivative Progress: 1643/2164 symbols completed. RIV took 1.3s. Estimated remaining: 3m 38s. Rate: 143.2 symbols/min
[2025-10-24T01:28:09.236319] [INFO ] [MAIN      ] RKT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:09.239382] [INFO ] [MAIN      ] RIO: Generated 139 derivative records from 53792 primary records.
[2025-10-24T01:28:09.239586] [DEBUG] [LOCAL     ] RIO: Saving derivative data.
[2025-10-24T01:28:09.252481] [DEBUG] [LOCAL     ] RIO: Derivative data saved (139 records).
[2025-10-24T01:28:09.252842] [INFO ] [MAIN      ] RIO: Successfully saved derivative data.
[2025-10-24T01:28:09.255375] [INFO ] [MAIN      ] Derivative Progress: 1644/2164 symbols completed. RIO took 1.4s. Estimated remaining: 3m 38s. Rate: 143.3 symbols/min
[2025-10-24T01:28:09.255572] [INFO ] [MAIN      ] RL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:09.335440] [DEBUG] [LOCAL     ] RL: Loaded 39534 existing records from primary storage.
[2025-10-24T01:28:09.336876] [DEBUG] [LOCAL     ] RJF: Loaded 46930 existing records from primary storage.
[2025-10-24T01:28:09.338742] [INFO ] [MAIN      ] RJF: Loaded 46930 primary data records.
[2025-10-24T01:28:09.338554] [INFO ] [MAIN      ] RL: Loaded 39534 primary data records.
[2025-10-24T01:28:09.458820] [DEBUG] [LOCAL     ] RKT: Loaded 54119 existing records from primary storage.
[2025-10-24T01:28:09.513461] [INFO ] [MAIN      ] RKT: Loaded 54119 primary data records.
[2025-10-24T01:28:10.360836] [DEBUG] [MAIN      ] RL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:10.360120] [DEBUG] [MAIN      ] RJF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:10.429379] [DEBUG] [MAIN      ] RKT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:10.473340] [INFO ] [MAIN      ] RJF: Generated 139 derivative records from 46930 primary records.
[2025-10-24T01:28:10.475164] [DEBUG] [LOCAL     ] RJF: Saving derivative data.
[2025-10-24T01:28:10.494774] [INFO ] [MAIN      ] RL: Generated 139 derivative records from 39534 primary records.
[2025-10-24T01:28:10.496679] [DEBUG] [LOCAL     ] RL: Saving derivative data.
[2025-10-24T01:28:10.495545] [DEBUG] [LOCAL     ] RJF: Derivative data saved (139 records).
[2025-10-24T01:28:10.498268] [INFO ] [MAIN      ] RJF: Successfully saved derivative data.
[2025-10-24T01:28:10.516302] [INFO ] [MAIN      ] Derivative Progress: 1645/2164 symbols completed. RJF took 1.3s. Estimated remaining: 3m 38s. Rate: 143.2 symbols/min
[2025-10-24T01:28:10.522841] [INFO ] [MAIN      ] RLI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:10.523834] [DEBUG] [LOCAL     ] RL: Derivative data saved (139 records).
[2025-10-24T01:28:10.525529] [INFO ] [MAIN      ] RL: Successfully saved derivative data.
[2025-10-24T01:28:10.528222] [INFO ] [MAIN      ] Derivative Progress: 1646/2164 symbols completed. RL took 1.3s. Estimated remaining: 3m 37s. Rate: 143.2 symbols/min
[2025-10-24T01:28:10.528597] [INFO ] [MAIN      ] RLJ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:10.537975] [INFO ] [MAIN      ] RKT: Generated 139 derivative records from 54119 primary records.
[2025-10-24T01:28:10.538278] [DEBUG] [LOCAL     ] RKT: Saving derivative data.
[2025-10-24T01:28:10.554302] [DEBUG] [LOCAL     ] RKT: Derivative data saved (139 records).
[2025-10-24T01:28:10.554636] [INFO ] [MAIN      ] RKT: Successfully saved derivative data.
[2025-10-24T01:28:10.560114] [INFO ] [MAIN      ] Derivative Progress: 1647/2164 symbols completed. RKT took 1.3s. Estimated remaining: 3m 36s. Rate: 143.3 symbols/min
[2025-10-24T01:28:10.560604] [INFO ] [MAIN      ] RLTY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:10.589327] [DEBUG] [LOCAL     ] RLI: Loaded 34958 existing records from primary storage.
[2025-10-24T01:28:10.589727] [INFO ] [MAIN      ] RLI: Loaded 34958 primary data records.
[2025-10-24T01:28:10.667721] [DEBUG] [LOCAL     ] RLTY: Loaded 11046 existing records from primary storage.
[2025-10-24T01:28:10.667994] [INFO ] [MAIN      ] RLTY: Loaded 11046 primary data records.
[2025-10-24T01:28:10.812575] [DEBUG] [LOCAL     ] RLJ: Loaded 48283 existing records from primary storage.
[2025-10-24T01:28:10.851071] [INFO ] [MAIN      ] RLJ: Loaded 48283 primary data records.
[2025-10-24T01:28:11.622739] [DEBUG] [MAIN      ] RLI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:11.655449] [DEBUG] [MAIN      ] RLTY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:11.705576] [DEBUG] [MAIN      ] RLJ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:11.750171] [INFO ] [MAIN      ] RLI: Generated 139 derivative records from 34958 primary records.
[2025-10-24T01:28:11.752138] [DEBUG] [LOCAL     ] RLI: Saving derivative data.
[2025-10-24T01:28:11.775865] [DEBUG] [LOCAL     ] RLI: Derivative data saved (139 records).
[2025-10-24T01:28:11.777417] [INFO ] [MAIN      ] RLI: Successfully saved derivative data.
[2025-10-24T01:28:11.784461] [INFO ] [MAIN      ] Derivative Progress: 1648/2164 symbols completed. RLI took 1.3s. Estimated remaining: 3m 36s. Rate: 143.2 symbols/min
[2025-10-24T01:28:11.786402] [INFO ] [MAIN      ] RLTY: Generated 139 derivative records from 11046 primary records.
[2025-10-24T01:28:11.788731] [DEBUG] [LOCAL     ] RLTY: Saving derivative data.
[2025-10-24T01:28:11.802960] [DEBUG] [LOCAL     ] RLTY: Derivative data saved (139 records).
[2025-10-24T01:28:11.804281] [INFO ] [MAIN      ] RLTY: Successfully saved derivative data.
[2025-10-24T01:28:11.807974] [INFO ] [MAIN      ] Derivative Progress: 1649/2164 symbols completed. RLTY took 1.2s. Estimated remaining: 3m 36s. Rate: 143.2 symbols/min
[2025-10-24T01:28:11.808391] [INFO ] [MAIN      ] RLJ: Generated 139 derivative records from 48283 primary records.
[2025-10-24T01:28:11.808886] [DEBUG] [LOCAL     ] RLJ: Saving derivative data.
[2025-10-24T01:28:11.827176] [DEBUG] [LOCAL     ] RLJ: Derivative data saved (139 records).
[2025-10-24T01:28:11.827385] [INFO ] [MAIN      ] RLJ: Successfully saved derivative data.
[2025-10-24T01:28:11.831164] [INFO ] [MAIN      ] Derivative Progress: 1650/2164 symbols completed. RLJ took 1.3s. Estimated remaining: 3m 35s. Rate: 143.3 symbols/min
[2025-10-24T01:28:11.831963] [INFO ] [MAIN      ] RLX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:11.832046] [INFO ] [MAIN      ] RMAX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:11.832233] [INFO ] [MAIN      ] RM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:11.846501] [DEBUG] [LOCAL     ] RM: Loaded 7531 existing records from primary storage.
[2025-10-24T01:28:11.846799] [INFO ] [MAIN      ] RM: Loaded 7531 primary data records.
[2025-10-24T01:28:11.943269] [DEBUG] [LOCAL     ] RMAX: Loaded 21748 existing records from primary storage.
[2025-10-24T01:28:11.953756] [INFO ] [MAIN      ] RMAX: Loaded 21748 primary data records.
[2025-10-24T01:28:12.339857] [DEBUG] [LOCAL     ] RLX: Loaded 48484 existing records from primary storage.
[2025-10-24T01:28:12.380155] [INFO ] [MAIN      ] RLX: Loaded 48484 primary data records.
[2025-10-24T01:28:12.861431] [DEBUG] [MAIN      ] RM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:12.939409] [DEBUG] [MAIN      ] RMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:13.003448] [DEBUG] [MAIN      ] RLX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:13.048546] [INFO ] [MAIN      ] RMAX: Generated 139 derivative records from 21748 primary records.
[2025-10-24T01:28:13.049216] [INFO ] [MAIN      ] RM: Generated 139 derivative records from 7531 primary records.
[2025-10-24T01:28:13.050626] [DEBUG] [LOCAL     ] RMAX: Saving derivative data.
[2025-10-24T01:28:13.050811] [DEBUG] [LOCAL     ] RM: Saving derivative data.
[2025-10-24T01:28:13.066146] [DEBUG] [LOCAL     ] RMAX: Derivative data saved (139 records).
[2025-10-24T01:28:13.080839] [DEBUG] [LOCAL     ] RM: Derivative data saved (139 records).
[2025-10-24T01:28:13.079586] [INFO ] [MAIN      ] RMAX: Successfully saved derivative data.
[2025-10-24T01:28:13.084019] [INFO ] [MAIN      ] Derivative Progress: 1651/2164 symbols completed. RMAX took 1.3s. Estimated remaining: 3m 35s. Rate: 143.1 symbols/min
[2025-10-24T01:28:13.084369] [INFO ] [MAIN      ] RM: Successfully saved derivative data.
[2025-10-24T01:28:13.089954] [INFO ] [MAIN      ] Derivative Progress: 1652/2164 symbols completed. RM took 1.3s. Estimated remaining: 3m 34s. Rate: 143.2 symbols/min
[2025-10-24T01:28:13.090600] [INFO ] [MAIN      ] RMI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:13.087436] [INFO ] [MAIN      ] RMD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:13.095114] [INFO ] [MAIN      ] RLX: Generated 139 derivative records from 48484 primary records.
[2025-10-24T01:28:13.095346] [DEBUG] [LOCAL     ] RLX: Saving derivative data.
[2025-10-24T01:28:13.111779] [DEBUG] [LOCAL     ] RLX: Derivative data saved (139 records).
[2025-10-24T01:28:13.112617] [INFO ] [MAIN      ] RLX: Successfully saved derivative data.
[2025-10-24T01:28:13.119303] [INFO ] [MAIN      ] Derivative Progress: 1653/2164 symbols completed. RLX took 1.3s. Estimated remaining: 3m 34s. Rate: 143.3 symbols/min
[2025-10-24T01:28:13.119807] [INFO ] [MAIN      ] RMM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:13.120045] [DEBUG] [LOCAL     ] RMI: Loaded 4826 existing records from primary storage.
[2025-10-24T01:28:13.121337] [INFO ] [MAIN      ] RMI: Loaded 4826 primary data records.
[2025-10-24T01:28:13.284075] [DEBUG] [LOCAL     ] RMM: Loaded 11008 existing records from primary storage.
[2025-10-24T01:28:13.340193] [INFO ] [MAIN      ] RMM: Loaded 11008 primary data records.
[2025-10-24T01:28:13.341737] [DEBUG] [LOCAL     ] RMD: Loaded 42165 existing records from primary storage.
[2025-10-24T01:28:13.448073] [INFO ] [MAIN      ] RMD: Loaded 42165 primary data records.
[2025-10-24T01:28:14.110305] [DEBUG] [MAIN      ] RMI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:14.167512] [DEBUG] [MAIN      ] RMM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:14.194486] [DEBUG] [MAIN      ] RMD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:14.199375] [INFO ] [MAIN      ] RMI: Generated 139 derivative records from 4826 primary records.
[2025-10-24T01:28:14.213744] [DEBUG] [LOCAL     ] RMI: Saving derivative data.
[2025-10-24T01:28:14.229628] [DEBUG] [LOCAL     ] RMI: Derivative data saved (139 records).
[2025-10-24T01:28:14.230398] [INFO ] [MAIN      ] RMI: Successfully saved derivative data.
[2025-10-24T01:28:14.239193] [INFO ] [MAIN      ] Derivative Progress: 1654/2164 symbols completed. RMI took 1.1s. Estimated remaining: 3m 34s. Rate: 143.2 symbols/min
[2025-10-24T01:28:14.239592] [INFO ] [MAIN      ] RMMZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:14.259927] [DEBUG] [LOCAL     ] RMMZ: Loaded 4821 existing records from primary storage.
[2025-10-24T01:28:14.266979] [INFO ] [MAIN      ] RMMZ: Loaded 4821 primary data records.
[2025-10-24T01:28:14.474429] [INFO ] [MAIN      ] RMD: Generated 139 derivative records from 42165 primary records.
[2025-10-24T01:28:14.583903] [DEBUG] [LOCAL     ] RMD: Saving derivative data.
[2025-10-24T01:28:14.590267] [INFO ] [MAIN      ] RMM: Generated 139 derivative records from 11008 primary records.
[2025-10-24T01:28:14.603516] [DEBUG] [LOCAL     ] RMM: Saving derivative data.
[2025-10-24T01:28:14.629428] [DEBUG] [LOCAL     ] RMM: Derivative data saved (139 records).
[2025-10-24T01:28:14.631760] [DEBUG] [LOCAL     ] RMD: Derivative data saved (139 records).
[2025-10-24T01:28:14.632044] [INFO ] [MAIN      ] RMM: Successfully saved derivative data.
[2025-10-24T01:28:14.632432] [INFO ] [MAIN      ] RMD: Successfully saved derivative data.
[2025-10-24T01:28:14.636280] [INFO ] [MAIN      ] Derivative Progress: 1655/2164 symbols completed. RMM took 1.5s. Estimated remaining: 3m 33s. Rate: 143.2 symbols/min
[2025-10-24T01:28:14.639910] [INFO ] [MAIN      ] Derivative Progress: 1656/2164 symbols completed. RMD took 1.6s. Estimated remaining: 3m 33s. Rate: 143.3 symbols/min
[2025-10-24T01:28:14.639781] [INFO ] [MAIN      ] RMT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:14.641063] [INFO ] [MAIN      ] RNG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:14.676266] [DEBUG] [MAIN      ] RMMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:14.675841] [DEBUG] [LOCAL     ] RMT: Loaded 17211 existing records from primary storage.
[2025-10-24T01:28:14.690779] [INFO ] [MAIN      ] RMT: Loaded 17211 primary data records.
[2025-10-24T01:28:14.875079] [DEBUG] [LOCAL     ] RNG: Loaded 48318 existing records from primary storage.
[2025-10-24T01:28:14.932522] [INFO ] [MAIN      ] RNG: Loaded 48318 primary data records.
[2025-10-24T01:28:15.245247] [INFO ] [MAIN      ] RMMZ: Generated 139 derivative records from 4821 primary records.
[2025-10-24T01:28:15.266755] [DEBUG] [LOCAL     ] RMMZ: Saving derivative data.
[2025-10-24T01:28:15.446556] [DEBUG] [LOCAL     ] RMMZ: Derivative data saved (139 records).
[2025-10-24T01:28:15.446999] [INFO ] [MAIN      ] RMMZ: Successfully saved derivative data.
[2025-10-24T01:28:15.449794] [INFO ] [MAIN      ] Derivative Progress: 1657/2164 symbols completed. RMMZ took 1.2s. Estimated remaining: 3m 32s. Rate: 143.2 symbols/min
[2025-10-24T01:28:15.450226] [INFO ] [MAIN      ] RNGR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:15.475691] [DEBUG] [MAIN      ] RMT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:15.510530] [DEBUG] [LOCAL     ] RNGR: Loaded 20837 existing records from primary storage.
[2025-10-24T01:28:15.514858] [INFO ] [MAIN      ] RNGR: Loaded 20837 primary data records.
[2025-10-24T01:28:15.604915] [DEBUG] [MAIN      ] RNG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:15.762397] [INFO ] [MAIN      ] RMT: Generated 139 derivative records from 17211 primary records.
[2025-10-24T01:28:15.880960] [DEBUG] [LOCAL     ] RMT: Saving derivative data.
[2025-10-24T01:28:15.903825] [DEBUG] [LOCAL     ] RMT: Derivative data saved (139 records).
[2025-10-24T01:28:15.904700] [INFO ] [MAIN      ] RMT: Successfully saved derivative data.
[2025-10-24T01:28:15.912749] [INFO ] [MAIN      ] Derivative Progress: 1658/2164 symbols completed. RMT took 1.3s. Estimated remaining: 3m 32s. Rate: 143.2 symbols/min
[2025-10-24T01:28:15.912979] [INFO ] [MAIN      ] RNP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:15.924313] [INFO ] [MAIN      ] RNG: Generated 139 derivative records from 48318 primary records.
[2025-10-24T01:28:15.924887] [DEBUG] [LOCAL     ] RNG: Saving derivative data.
[2025-10-24T01:28:15.944026] [DEBUG] [LOCAL     ] RNG: Derivative data saved (139 records).
[2025-10-24T01:28:15.944768] [INFO ] [MAIN      ] RNG: Successfully saved derivative data.
[2025-10-24T01:28:15.949203] [INFO ] [MAIN      ] Derivative Progress: 1659/2164 symbols completed. RNG took 1.3s. Estimated remaining: 3m 32s. Rate: 143.2 symbols/min
[2025-10-24T01:28:15.956377] [DEBUG] [LOCAL     ] RNP: Loaded 16013 existing records from primary storage.
[2025-10-24T01:28:15.956514] [INFO ] [MAIN      ] RNR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:15.957741] [INFO ] [MAIN      ] RNP: Loaded 16013 primary data records.
[2025-10-24T01:28:16.052490] [DEBUG] [MAIN      ] RNGR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:16.325740] [DEBUG] [LOCAL     ] RNR: Loaded 33749 existing records from primary storage.
[2025-10-24T01:28:16.328312] [INFO ] [MAIN      ] RNR: Loaded 33749 primary data records.
[2025-10-24T01:28:16.531589] [INFO ] [MAIN      ] RNGR: Generated 139 derivative records from 20837 primary records.
[2025-10-24T01:28:16.548412] [DEBUG] [LOCAL     ] RNGR: Saving derivative data.
[2025-10-24T01:28:16.726521] [DEBUG] [MAIN      ] RNP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:16.743372] [DEBUG] [LOCAL     ] RNGR: Derivative data saved (139 records).
[2025-10-24T01:28:16.744566] [INFO ] [MAIN      ] RNGR: Successfully saved derivative data.
[2025-10-24T01:28:16.750090] [INFO ] [MAIN      ] Derivative Progress: 1660/2164 symbols completed. RNGR took 1.3s. Estimated remaining: 3m 31s. Rate: 143.2 symbols/min
[2025-10-24T01:28:16.750844] [INFO ] [MAIN      ] RNST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:16.786057] [INFO ] [MAIN      ] RNP: Generated 139 derivative records from 16013 primary records.
[2025-10-24T01:28:16.786607] [DEBUG] [LOCAL     ] RNP: Saving derivative data.
[2025-10-24T01:28:16.814629] [DEBUG] [LOCAL     ] RNP: Derivative data saved (139 records).
[2025-10-24T01:28:16.815469] [INFO ] [MAIN      ] RNP: Successfully saved derivative data.
[2025-10-24T01:28:16.816926] [DEBUG] [LOCAL     ] RNST: Loaded 36124 existing records from primary storage.
[2025-10-24T01:28:16.832785] [INFO ] [MAIN      ] RNST: Loaded 36124 primary data records.
[2025-10-24T01:28:16.832466] [INFO ] [MAIN      ] Derivative Progress: 1661/2164 symbols completed. RNP took 0.9s. Estimated remaining: 3m 31s. Rate: 143.2 symbols/min
[2025-10-24T01:28:16.833607] [INFO ] [MAIN      ] ROG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:16.833461] [DEBUG] [MAIN      ] RNR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:17.182888] [DEBUG] [LOCAL     ] ROG: Loaded 21699 existing records from primary storage.
[2025-10-24T01:28:17.185196] [INFO ] [MAIN      ] ROG: Loaded 21699 primary data records.
[2025-10-24T01:28:17.307690] [INFO ] [MAIN      ] RNR: Generated 139 derivative records from 33749 primary records.
[2025-10-24T01:28:17.337287] [DEBUG] [LOCAL     ] RNR: Saving derivative data.
[2025-10-24T01:28:17.599629] [DEBUG] [LOCAL     ] RNR: Derivative data saved (139 records).
[2025-10-24T01:28:17.599806] [INFO ] [MAIN      ] RNR: Successfully saved derivative data.
[2025-10-24T01:28:17.603545] [INFO ] [MAIN      ] Derivative Progress: 1662/2164 symbols completed. RNR took 1.6s. Estimated remaining: 3m 30s. Rate: 143.2 symbols/min
[2025-10-24T01:28:17.604895] [INFO ] [MAIN      ] ROK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:17.623919] [DEBUG] [MAIN      ] RNST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:17.686544] [DEBUG] [MAIN      ] ROG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:17.717324] [DEBUG] [LOCAL     ] ROK: Loaded 43027 existing records from primary storage.
[2025-10-24T01:28:17.720066] [INFO ] [MAIN      ] RNST: Generated 139 derivative records from 36124 primary records.
[2025-10-24T01:28:17.720610] [DEBUG] [LOCAL     ] RNST: Saving derivative data.
[2025-10-24T01:28:17.720705] [INFO ] [MAIN      ] ROK: Loaded 43027 primary data records.
[2025-10-24T01:28:17.798451] [DEBUG] [LOCAL     ] RNST: Derivative data saved (139 records).
[2025-10-24T01:28:17.808853] [INFO ] [MAIN      ] RNST: Successfully saved derivative data.
[2025-10-24T01:28:17.811721] [INFO ] [MAIN      ] Derivative Progress: 1663/2164 symbols completed. RNST took 1.1s. Estimated remaining: 3m 30s. Rate: 143.2 symbols/min
[2025-10-24T01:28:18.084724] [INFO ] [MAIN      ] ROG: Generated 139 derivative records from 21699 primary records.
[2025-10-24T01:28:18.085856] [DEBUG] [LOCAL     ] ROG: Saving derivative data.
[2025-10-24T01:28:18.100407] [DEBUG] [LOCAL     ] ROG: Derivative data saved (139 records).
[2025-10-24T01:28:18.101169] [INFO ] [MAIN      ] ROG: Successfully saved derivative data.
[2025-10-24T01:28:18.104215] [INFO ] [MAIN      ] Derivative Progress: 1664/2164 symbols completed. ROG took 1.3s. Estimated remaining: 3m 29s. Rate: 143.2 symbols/min
[2025-10-24T01:28:18.127777] [DEBUG] [MAIN      ] ROK: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:28:18.156773] [INFO ] [MAIN      ] ROK: Generated 139 derivative records from 43027 primary records.
[2025-10-24T01:28:18.157042] [DEBUG] [LOCAL     ] ROK: Saving derivative data.
[2025-10-24T01:28:18.170197] [DEBUG] [LOCAL     ] ROK: Derivative data saved (139 records).
[2025-10-24T01:28:18.170422] [INFO ] [MAIN      ] ROK: Successfully saved derivative data.
[2025-10-24T01:28:18.174738] [INFO ] [MAIN      ] Derivative Progress: 1665/2164 symbols completed. ROK took 0.6s. Estimated remaining: 3m 29s. Rate: 143.3 symbols/min
[2025-10-24T01:28:18.175283] [INFO ] [MAIN      ] ROL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:18.175402] [INFO ] [MAIN      ] RPT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:18.175637] [INFO ] [MAIN      ] RPM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:18.204290] [DEBUG] [LOCAL     ] RPT: Loaded 19086 existing records from primary storage.
[2025-10-24T01:28:18.204517] [INFO ] [MAIN      ] RPT: Loaded 19086 primary data records.
[2025-10-24T01:28:18.399923] [DEBUG] [LOCAL     ] ROL: Loaded 50634 existing records from primary storage.
[2025-10-24T01:28:18.417629] [DEBUG] [LOCAL     ] RPM: Loaded 42318 existing records from primary storage.
[2025-10-24T01:28:18.436013] [INFO ] [MAIN      ] ROL: Loaded 50634 primary data records.
[2025-10-24T01:28:18.455120] [INFO ] [MAIN      ] RPM: Loaded 42318 primary data records.
[2025-10-24T01:28:19.207367] [DEBUG] [MAIN      ] RPT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:19.243438] [DEBUG] [MAIN      ] ROL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:19.315194] [DEBUG] [MAIN      ] RPM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:19.348729] [INFO ] [MAIN      ] RPT: Generated 139 derivative records from 19086 primary records.
[2025-10-24T01:28:19.352068] [DEBUG] [LOCAL     ] RPT: Saving derivative data.
[2025-10-24T01:28:19.356984] [INFO ] [MAIN      ] ROL: Generated 139 derivative records from 50634 primary records.
[2025-10-24T01:28:19.360685] [DEBUG] [LOCAL     ] ROL: Saving derivative data.
[2025-10-24T01:28:19.373684] [DEBUG] [LOCAL     ] RPT: Derivative data saved (139 records).
[2025-10-24T01:28:19.376290] [INFO ] [MAIN      ] RPT: Successfully saved derivative data.
[2025-10-24T01:28:19.379420] [INFO ] [MAIN      ] Derivative Progress: 1666/2164 symbols completed. RPT took 1.2s. Estimated remaining: 3m 29s. Rate: 143.1 symbols/min
[2025-10-24T01:28:19.379627] [INFO ] [MAIN      ] RQI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:19.400887] [DEBUG] [LOCAL     ] ROL: Derivative data saved (139 records).
[2025-10-24T01:28:19.401549] [INFO ] [MAIN      ] ROL: Successfully saved derivative data.
[2025-10-24T01:28:19.408086] [INFO ] [MAIN      ] Derivative Progress: 1667/2164 symbols completed. ROL took 1.2s. Estimated remaining: 3m 28s. Rate: 143.2 symbols/min
[2025-10-24T01:28:19.409784] [INFO ] [MAIN      ] RRC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:19.412879] [INFO ] [MAIN      ] RPM: Generated 139 derivative records from 42318 primary records.
[2025-10-24T01:28:19.413073] [DEBUG] [LOCAL     ] RPM: Saving derivative data.
[2025-10-24T01:28:19.437137] [DEBUG] [LOCAL     ] RPM: Derivative data saved (139 records).
[2025-10-24T01:28:19.437384] [INFO ] [MAIN      ] RPM: Successfully saved derivative data.
[2025-10-24T01:28:19.441986] [INFO ] [MAIN      ] Derivative Progress: 1668/2164 symbols completed. RPM took 1.3s. Estimated remaining: 3m 28s. Rate: 143.3 symbols/min
[2025-10-24T01:28:19.442417] [INFO ] [MAIN      ] RRX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:19.458394] [DEBUG] [LOCAL     ] RQI: Loaded 28922 existing records from primary storage.
[2025-10-24T01:28:19.458890] [INFO ] [MAIN      ] RQI: Loaded 28922 primary data records.
[2025-10-24T01:28:19.829860] [DEBUG] [LOCAL     ] RRC: Loaded 53305 existing records from primary storage.
[2025-10-24T01:28:19.831818] [INFO ] [MAIN      ] RRC: Loaded 53305 primary data records.
[2025-10-24T01:28:19.887710] [DEBUG] [LOCAL     ] RRX: Loaded 41001 existing records from primary storage.
[2025-10-24T01:28:19.922898] [INFO ] [MAIN      ] RRX: Loaded 41001 primary data records.
[2025-10-24T01:28:20.513536] [DEBUG] [MAIN      ] RQI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:20.566581] [DEBUG] [MAIN      ] RRC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:20.608691] [INFO ] [MAIN      ] RQI: Generated 139 derivative records from 28922 primary records.
[2025-10-24T01:28:20.609186] [DEBUG] [LOCAL     ] RQI: Saving derivative data.
[2025-10-24T01:28:20.611397] [DEBUG] [MAIN      ] RRX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:20.641543] [DEBUG] [LOCAL     ] RQI: Derivative data saved (139 records).
[2025-10-24T01:28:20.646179] [INFO ] [MAIN      ] RQI: Successfully saved derivative data.
[2025-10-24T01:28:20.649831] [INFO ] [MAIN      ] Derivative Progress: 1669/2164 symbols completed. RQI took 1.3s. Estimated remaining: 3m 27s. Rate: 143.1 symbols/min
[2025-10-24T01:28:20.657021] [INFO ] [MAIN      ] RS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:20.679197] [INFO ] [MAIN      ] RRC: Generated 139 derivative records from 53305 primary records.
[2025-10-24T01:28:20.680010] [DEBUG] [LOCAL     ] RRC: Saving derivative data.
[2025-10-24T01:28:20.710742] [DEBUG] [LOCAL     ] RRC: Derivative data saved (139 records).
[2025-10-24T01:28:20.712209] [INFO ] [MAIN      ] RRC: Successfully saved derivative data.
[2025-10-24T01:28:20.715189] [INFO ] [MAIN      ] Derivative Progress: 1670/2164 symbols completed. RRC took 1.3s. Estimated remaining: 3m 27s. Rate: 143.2 symbols/min
[2025-10-24T01:28:20.716328] [DEBUG] [LOCAL     ] RS: Loaded 24797 existing records from primary storage.
[2025-10-24T01:28:20.718842] [INFO ] [MAIN      ] RS: Loaded 24797 primary data records.
[2025-10-24T01:28:20.716479] [INFO ] [MAIN      ] RSF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:20.766720] [INFO ] [MAIN      ] RRX: Generated 139 derivative records from 41001 primary records.
[2025-10-24T01:28:20.800180] [DEBUG] [LOCAL     ] RRX: Saving derivative data.
[2025-10-24T01:28:20.845611] [DEBUG] [LOCAL     ] RSF: Loaded 4278 existing records from primary storage.
[2025-10-24T01:28:20.846990] [INFO ] [MAIN      ] RSF: Loaded 4278 primary data records.
[2025-10-24T01:28:20.938248] [DEBUG] [LOCAL     ] RRX: Derivative data saved (139 records).
[2025-10-24T01:28:21.142883] [INFO ] [MAIN      ] RRX: Successfully saved derivative data.
[2025-10-24T01:28:21.169077] [INFO ] [MAIN      ] Derivative Progress: 1671/2164 symbols completed. RRX took 1.7s. Estimated remaining: 3m 27s. Rate: 143.2 symbols/min
[2025-10-24T01:28:21.185987] [INFO ] [MAIN      ] RSG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:21.400417] [DEBUG] [MAIN      ] RS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:28:21.442211] [DEBUG] [MAIN      ] RSF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:21.475712] [DEBUG] [LOCAL     ] RSG: Loaded 47641 existing records from primary storage.
[2025-10-24T01:28:21.479974] [INFO ] [MAIN      ] RSG: Loaded 47641 primary data records.
[2025-10-24T01:28:21.852393] [INFO ] [MAIN      ] RS: Generated 139 derivative records from 24797 primary records.
[2025-10-24T01:28:21.857779] [DEBUG] [LOCAL     ] RS: Saving derivative data.
[2025-10-24T01:28:21.875928] [DEBUG] [LOCAL     ] RS: Derivative data saved (139 records).
[2025-10-24T01:28:21.876250] [INFO ] [MAIN      ] RS: Successfully saved derivative data.
[2025-10-24T01:28:21.878723] [INFO ] [MAIN      ] Derivative Progress: 1672/2164 symbols completed. RS took 1.2s. Estimated remaining: 3m 26s. Rate: 143.1 symbols/min
[2025-10-24T01:28:21.879134] [INFO ] [MAIN      ] RSI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:21.882452] [INFO ] [MAIN      ] RSF: Generated 139 derivative records from 4278 primary records.
[2025-10-24T01:28:21.883675] [DEBUG] [LOCAL     ] RSF: Saving derivative data.
[2025-10-24T01:28:21.895279] [DEBUG] [LOCAL     ] RSF: Derivative data saved (139 records).
[2025-10-24T01:28:21.895610] [INFO ] [MAIN      ] RSF: Successfully saved derivative data.
[2025-10-24T01:28:21.898396] [INFO ] [MAIN      ] Derivative Progress: 1673/2164 symbols completed. RSF took 1.2s. Estimated remaining: 3m 26s. Rate: 143.2 symbols/min
[2025-10-24T01:28:21.898766] [INFO ] [MAIN      ] RSKD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:21.916254] [DEBUG] [MAIN      ] RSG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:21.979119] [DEBUG] [LOCAL     ] RSI: Loaded 47344 existing records from primary storage.
[2025-10-24T01:28:21.992814] [INFO ] [MAIN      ] RSI: Loaded 47344 primary data records.
[2025-10-24T01:28:21.993751] [DEBUG] [LOCAL     ] RSKD: Loaded 33437 existing records from primary storage.
[2025-10-24T01:28:22.007035] [INFO ] [MAIN      ] RSKD: Loaded 33437 primary data records.
[2025-10-24T01:28:22.221115] [INFO ] [MAIN      ] RSG: Generated 139 derivative records from 47641 primary records.
[2025-10-24T01:28:22.242631] [DEBUG] [LOCAL     ] RSG: Saving derivative data.
[2025-10-24T01:28:22.624770] [DEBUG] [LOCAL     ] RSG: Derivative data saved (139 records).
[2025-10-24T01:28:22.626335] [INFO ] [MAIN      ] RSG: Successfully saved derivative data.
[2025-10-24T01:28:22.630294] [INFO ] [MAIN      ] Derivative Progress: 1674/2164 symbols completed. RSG took 1.4s. Estimated remaining: 3m 25s. Rate: 143.2 symbols/min
[2025-10-24T01:28:22.631388] [INFO ] [MAIN      ] RTO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:22.676385] [DEBUG] [MAIN      ] RSKD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:22.676727] [DEBUG] [MAIN      ] RSI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:22.735801] [DEBUG] [LOCAL     ] RTO: Loaded 40099 existing records from primary storage.
[2025-10-24T01:28:22.738026] [INFO ] [MAIN      ] RTO: Loaded 40099 primary data records.
[2025-10-24T01:28:23.064423] [INFO ] [MAIN      ] RSKD: Generated 139 derivative records from 33437 primary records.
[2025-10-24T01:28:23.065806] [DEBUG] [LOCAL     ] RSKD: Saving derivative data.
[2025-10-24T01:28:23.069084] [INFO ] [MAIN      ] RSI: Generated 139 derivative records from 47344 primary records.
[2025-10-24T01:28:23.069201] [DEBUG] [LOCAL     ] RSI: Saving derivative data.
[2025-10-24T01:28:23.093687] [DEBUG] [LOCAL     ] RSI: Derivative data saved (139 records).
[2025-10-24T01:28:23.094035] [INFO ] [MAIN      ] RSI: Successfully saved derivative data.
[2025-10-24T01:28:23.093464] [DEBUG] [LOCAL     ] RSKD: Derivative data saved (139 records).
[2025-10-24T01:28:23.096686] [INFO ] [MAIN      ] Derivative Progress: 1675/2164 symbols completed. RSI took 1.2s. Estimated remaining: 3m 25s. Rate: 143.2 symbols/min
[2025-10-24T01:28:23.096940] [INFO ] [MAIN      ] RSKD: Successfully saved derivative data.
[2025-10-24T01:28:23.097423] [INFO ] [MAIN      ] RTX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:23.100566] [INFO ] [MAIN      ] Derivative Progress: 1676/2164 symbols completed. RSKD took 1.2s. Estimated remaining: 3m 24s. Rate: 143.2 symbols/min
[2025-10-24T01:28:23.102103] [INFO ] [MAIN      ] RVLV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:23.123559] [DEBUG] [MAIN      ] RTO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:23.180768] [INFO ] [MAIN      ] RTO: Generated 139 derivative records from 40099 primary records.
[2025-10-24T01:28:23.181021] [DEBUG] [LOCAL     ] RTO: Saving derivative data.
[2025-10-24T01:28:23.197690] [DEBUG] [LOCAL     ] RTO: Derivative data saved (139 records).
[2025-10-24T01:28:23.225262] [INFO ] [MAIN      ] RTO: Successfully saved derivative data.
[2025-10-24T01:28:23.229853] [INFO ] [MAIN      ] Derivative Progress: 1677/2164 symbols completed. RTO took 0.6s. Estimated remaining: 3m 24s. Rate: 143.3 symbols/min
[2025-10-24T01:28:23.230149] [INFO ] [MAIN      ] RVT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:23.231255] [DEBUG] [LOCAL     ] RVLV: Loaded 47671 existing records from primary storage.
[2025-10-24T01:28:23.233688] [DEBUG] [LOCAL     ] RTX: Loaded 54096 existing records from primary storage.
[2025-10-24T01:28:23.234288] [INFO ] [MAIN      ] RTX: Loaded 54096 primary data records.
[2025-10-24T01:28:23.234377] [INFO ] [MAIN      ] RVLV: Loaded 47671 primary data records.
[2025-10-24T01:28:23.863527] [DEBUG] [LOCAL     ] RVT: Loaded 26270 existing records from primary storage.
[2025-10-24T01:28:23.890048] [INFO ] [MAIN      ] RVT: Loaded 26270 primary data records.
[2025-10-24T01:28:24.240296] [DEBUG] [MAIN      ] RTX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:24.246099] [DEBUG] [MAIN      ] RVLV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:24.311984] [DEBUG] [MAIN      ] RVT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:24.344500] [INFO ] [MAIN      ] RTX: Generated 139 derivative records from 54096 primary records.
[2025-10-24T01:28:24.345052] [DEBUG] [LOCAL     ] RTX: Saving derivative data.
[2025-10-24T01:28:24.366365] [DEBUG] [LOCAL     ] RTX: Derivative data saved (139 records).
[2025-10-24T01:28:24.369119] [INFO ] [MAIN      ] RVLV: Generated 139 derivative records from 47671 primary records.
[2025-10-24T01:28:24.369304] [INFO ] [MAIN      ] RTX: Successfully saved derivative data.
[2025-10-24T01:28:24.372391] [INFO ] [MAIN      ] Derivative Progress: 1678/2164 symbols completed. RTX took 1.3s. Estimated remaining: 3m 24s. Rate: 143.1 symbols/min
[2025-10-24T01:28:24.373367] [DEBUG] [LOCAL     ] RVLV: Saving derivative data.
[2025-10-24T01:28:24.391739] [DEBUG] [LOCAL     ] RVLV: Derivative data saved (139 records).
[2025-10-24T01:28:24.391840] [INFO ] [MAIN      ] RVLV: Successfully saved derivative data.
[2025-10-24T01:28:24.394415] [INFO ] [MAIN      ] Derivative Progress: 1679/2164 symbols completed. RVLV took 1.3s. Estimated remaining: 3m 23s. Rate: 143.2 symbols/min
[2025-10-24T01:28:24.397241] [INFO ] [MAIN      ] RVT: Generated 139 derivative records from 26270 primary records.
[2025-10-24T01:28:24.397342] [DEBUG] [LOCAL     ] RVT: Saving derivative data.
[2025-10-24T01:28:24.409413] [DEBUG] [LOCAL     ] RVT: Derivative data saved (139 records).
[2025-10-24T01:28:24.409496] [INFO ] [MAIN      ] RVT: Successfully saved derivative data.
[2025-10-24T01:28:24.412205] [INFO ] [MAIN      ] Derivative Progress: 1680/2164 symbols completed. RVT took 1.2s. Estimated remaining: 3m 23s. Rate: 143.3 symbols/min
[2025-10-24T01:28:24.412584] [INFO ] [MAIN      ] RVTY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:24.412669] [INFO ] [MAIN      ] RWT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:24.412741] [INFO ] [MAIN      ] RXO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:24.507542] [DEBUG] [LOCAL     ] RWT: Loaded 40660 existing records from primary storage.
[2025-10-24T01:28:24.507279] [DEBUG] [LOCAL     ] RXO: Loaded 48829 existing records from primary storage.
[2025-10-24T01:28:24.508623] [DEBUG] [LOCAL     ] RVTY: Loaded 48134 existing records from primary storage.
[2025-10-24T01:28:24.508760] [INFO ] [MAIN      ] RXO: Loaded 48829 primary data records.
[2025-10-24T01:28:24.508840] [INFO ] [MAIN      ] RWT: Loaded 40660 primary data records.
[2025-10-24T01:28:24.545529] [INFO ] [MAIN      ] RVTY: Loaded 48134 primary data records.
[2025-10-24T01:28:25.426874] [DEBUG] [MAIN      ] RVTY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:25.447638] [DEBUG] [MAIN      ] RXO: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:28:25.465145] [DEBUG] [MAIN      ] RWT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:25.562440] [INFO ] [MAIN      ] RVTY: Generated 139 derivative records from 48134 primary records.
[2025-10-24T01:28:25.562877] [DEBUG] [LOCAL     ] RVTY: Saving derivative data.
[2025-10-24T01:28:25.576105] [INFO ] [MAIN      ] RWT: Generated 139 derivative records from 40660 primary records.
[2025-10-24T01:28:25.578981] [DEBUG] [LOCAL     ] RVTY: Derivative data saved (139 records).
[2025-10-24T01:28:25.578900] [DEBUG] [LOCAL     ] RWT: Saving derivative data.
[2025-10-24T01:28:25.580520] [INFO ] [MAIN      ] RVTY: Successfully saved derivative data.
[2025-10-24T01:28:25.582851] [INFO ] [MAIN      ] Derivative Progress: 1681/2164 symbols completed. RVTY took 1.2s. Estimated remaining: 3m 22s. Rate: 143.2 symbols/min
[2025-10-24T01:28:25.583537] [INFO ] [MAIN      ] RYAM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:25.584070] [INFO ] [MAIN      ] RXO: Generated 139 derivative records from 48829 primary records.
[2025-10-24T01:28:25.584202] [DEBUG] [LOCAL     ] RXO: Saving derivative data.
[2025-10-24T01:28:25.611259] [DEBUG] [LOCAL     ] RXO: Derivative data saved (139 records).
[2025-10-24T01:28:25.615400] [DEBUG] [LOCAL     ] RWT: Derivative data saved (139 records).
[2025-10-24T01:28:25.615695] [INFO ] [MAIN      ] RXO: Successfully saved derivative data.
[2025-10-24T01:28:25.615897] [INFO ] [MAIN      ] RWT: Successfully saved derivative data.
[2025-10-24T01:28:25.618277] [INFO ] [MAIN      ] Derivative Progress: 1682/2164 symbols completed. RXO took 1.2s. Estimated remaining: 3m 22s. Rate: 143.2 symbols/min
[2025-10-24T01:28:25.622145] [INFO ] [MAIN      ] RYAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:25.622344] [INFO ] [MAIN      ] Derivative Progress: 1683/2164 symbols completed. RWT took 1.2s. Estimated remaining: 3m 21s. Rate: 143.3 symbols/min
[2025-10-24T01:28:25.623055] [INFO ] [MAIN      ] RYI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:25.650589] [DEBUG] [LOCAL     ] RYAM: Loaded 35289 existing records from primary storage.
[2025-10-24T01:28:25.650952] [INFO ] [MAIN      ] RYAM: Loaded 35289 primary data records.
[2025-10-24T01:28:25.778871] [DEBUG] [LOCAL     ] RYI: Loaded 21877 existing records from primary storage.
[2025-10-24T01:28:25.782788] [INFO ] [MAIN      ] RYI: Loaded 21877 primary data records.
[2025-10-24T01:28:25.927622] [DEBUG] [LOCAL     ] RYAN: Loaded 45325 existing records from primary storage.
[2025-10-24T01:28:26.128504] [INFO ] [MAIN      ] RYAN: Loaded 45325 primary data records.
[2025-10-24T01:28:26.654008] [DEBUG] [MAIN      ] RYAM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:26.686508] [DEBUG] [MAIN      ] RYI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:26.733409] [DEBUG] [MAIN      ] RYAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:26.785210] [INFO ] [MAIN      ] RYAM: Generated 139 derivative records from 35289 primary records.
[2025-10-24T01:28:26.785704] [DEBUG] [LOCAL     ] RYAM: Saving derivative data.
[2025-10-24T01:28:26.792286] [INFO ] [MAIN      ] RYI: Generated 139 derivative records from 21877 primary records.
[2025-10-24T01:28:26.801679] [DEBUG] [LOCAL     ] RYI: Saving derivative data.
[2025-10-24T01:28:26.803868] [DEBUG] [LOCAL     ] RYAM: Derivative data saved (139 records).
[2025-10-24T01:28:26.807098] [INFO ] [MAIN      ] RYAM: Successfully saved derivative data.
[2025-10-24T01:28:26.809929] [INFO ] [MAIN      ] Derivative Progress: 1684/2164 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 21s. Rate: 143.2 symbols/min
[2025-10-24T01:28:26.823582] [DEBUG] [LOCAL     ] RYI: Derivative data saved (139 records).
[2025-10-24T01:28:26.811605] [INFO ] [MAIN      ] RYN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:26.826636] [INFO ] [MAIN      ] RYI: Successfully saved derivative data.
[2025-10-24T01:28:26.829263] [INFO ] [MAIN      ] Derivative Progress: 1685/2164 symbols completed. RYI took 1.2s. Estimated remaining: 3m 21s. Rate: 143.2 symbols/min
[2025-10-24T01:28:26.829802] [INFO ] [MAIN      ] RZB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:26.834977] [INFO ] [MAIN      ] RYAN: Generated 139 derivative records from 45325 primary records.
[2025-10-24T01:28:26.835194] [DEBUG] [LOCAL     ] RYAN: Saving derivative data.
[2025-10-24T01:28:26.850360] [DEBUG] [LOCAL     ] RYAN: Derivative data saved (139 records).
[2025-10-24T01:28:26.851000] [INFO ] [MAIN      ] RYAN: Successfully saved derivative data.
[2025-10-24T01:28:26.854293] [DEBUG] [LOCAL     ] RZB: Loaded 5912 existing records from primary storage.
[2025-10-24T01:28:26.857389] [INFO ] [MAIN      ] Derivative Progress: 1686/2164 symbols completed. RYAN took 1.2s. Estimated remaining: 3m 20s. Rate: 143.3 symbols/min
[2025-10-24T01:28:26.857862] [INFO ] [MAIN      ] RZB: Loaded 5912 primary data records.
[2025-10-24T01:28:26.857968] [INFO ] [MAIN      ] RZC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:26.976590] [DEBUG] [LOCAL     ] RZC: Loaded 6506 existing records from primary storage.
[2025-10-24T01:28:26.978452] [INFO ] [MAIN      ] RZC: Loaded 6506 primary data records.
[2025-10-24T01:28:27.129399] [DEBUG] [LOCAL     ] RYN: Loaded 46088 existing records from primary storage.
[2025-10-24T01:28:27.162778] [INFO ] [MAIN      ] RYN: Loaded 46088 primary data records.
[2025-10-24T01:28:27.818060] [DEBUG] [MAIN      ] RZB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:27.850608] [DEBUG] [MAIN      ] RZC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:27.887554] [DEBUG] [MAIN      ] RYN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:27.949385] [INFO ] [MAIN      ] RZB: Generated 139 derivative records from 5912 primary records.
[2025-10-24T01:28:27.952098] [INFO ] [MAIN      ] RZC: Generated 139 derivative records from 6506 primary records.
[2025-10-24T01:28:27.951918] [DEBUG] [LOCAL     ] RZB: Saving derivative data.
[2025-10-24T01:28:27.955131] [DEBUG] [LOCAL     ] RZC: Saving derivative data.
[2025-10-24T01:28:27.968182] [DEBUG] [LOCAL     ] RZB: Derivative data saved (139 records).
[2025-10-24T01:28:27.968320] [INFO ] [MAIN      ] RZB: Successfully saved derivative data.
[2025-10-24T01:28:27.972688] [INFO ] [MAIN      ] Derivative Progress: 1687/2164 symbols completed. RZB took 1.1s. Estimated remaining: 3m 20s. Rate: 143.2 symbols/min
[2025-10-24T01:28:27.972870] [INFO ] [MAIN      ] S: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:27.987092] [DEBUG] [LOCAL     ] RZC: Derivative data saved (139 records).
[2025-10-24T01:28:27.988508] [INFO ] [MAIN      ] RZC: Successfully saved derivative data.
[2025-10-24T01:28:27.991050] [INFO ] [MAIN      ] Derivative Progress: 1688/2164 symbols completed. RZC took 1.1s. Estimated remaining: 3m 19s. Rate: 143.3 symbols/min
[2025-10-24T01:28:27.991660] [INFO ] [MAIN      ] SA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:27.995077] [INFO ] [MAIN      ] RYN: Generated 139 derivative records from 46088 primary records.
[2025-10-24T01:28:27.995193] [DEBUG] [LOCAL     ] RYN: Saving derivative data.
[2025-10-24T01:28:28.008485] [DEBUG] [LOCAL     ] RYN: Derivative data saved (139 records).
[2025-10-24T01:28:28.008766] [INFO ] [MAIN      ] RYN: Successfully saved derivative data.
[2025-10-24T01:28:28.012281] [INFO ] [MAIN      ] Derivative Progress: 1689/2164 symbols completed. RYN took 1.2s. Estimated remaining: 3m 19s. Rate: 143.3 symbols/min
[2025-10-24T01:28:28.012581] [INFO ] [MAIN      ] SABA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:28.048431] [DEBUG] [LOCAL     ] SABA: Loaded 9226 existing records from primary storage.
[2025-10-24T01:28:28.048617] [INFO ] [MAIN      ] SABA: Loaded 9226 primary data records.
[2025-10-24T01:28:28.184233] [DEBUG] [LOCAL     ] SA: Loaded 44981 existing records from primary storage.
[2025-10-24T01:28:28.185909] [DEBUG] [LOCAL     ] S: Loaded 53927 existing records from primary storage.
[2025-10-24T01:28:28.231302] [INFO ] [MAIN      ] SA: Loaded 44981 primary data records.
[2025-10-24T01:28:28.278476] [INFO ] [MAIN      ] S: Loaded 53927 primary data records.
[2025-10-24T01:28:29.040405] [DEBUG] [MAIN      ] SABA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:29.088786] [DEBUG] [MAIN      ] S: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:29.126132] [INFO ] [MAIN      ] SABA: Generated 139 derivative records from 9226 primary records.
[2025-10-24T01:28:29.124284] [DEBUG] [MAIN      ] SA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:29.137318] [DEBUG] [LOCAL     ] SABA: Saving derivative data.
[2025-10-24T01:28:29.155430] [DEBUG] [LOCAL     ] SABA: Derivative data saved (139 records).
[2025-10-24T01:28:29.155710] [INFO ] [MAIN      ] SABA: Successfully saved derivative data.
[2025-10-24T01:28:29.158076] [INFO ] [MAIN      ] Derivative Progress: 1690/2164 symbols completed. SABA took 1.1s. Estimated remaining: 3m 19s. Rate: 143.2 symbols/min
[2025-10-24T01:28:29.158772] [INFO ] [MAIN      ] SAFE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:29.198883] [INFO ] [MAIN      ] SA: Generated 139 derivative records from 44981 primary records.
[2025-10-24T01:28:29.196894] [INFO ] [MAIN      ] S: Generated 139 derivative records from 53927 primary records.
[2025-10-24T01:28:29.199060] [DEBUG] [LOCAL     ] SA: Saving derivative data.
[2025-10-24T01:28:29.199675] [DEBUG] [LOCAL     ] S: Saving derivative data.
[2025-10-24T01:28:29.233096] [DEBUG] [LOCAL     ] SAFE: Loaded 30040 existing records from primary storage.
[2025-10-24T01:28:29.233239] [DEBUG] [LOCAL     ] S: Derivative data saved (139 records).
[2025-10-24T01:28:29.233473] [INFO ] [MAIN      ] SAFE: Loaded 30040 primary data records.
[2025-10-24T01:28:29.232411] [DEBUG] [LOCAL     ] SA: Derivative data saved (139 records).
[2025-10-24T01:28:29.233629] [INFO ] [MAIN      ] S: Successfully saved derivative data.
[2025-10-24T01:28:29.233827] [INFO ] [MAIN      ] SA: Successfully saved derivative data.
[2025-10-24T01:28:29.257496] [INFO ] [MAIN      ] Derivative Progress: 1691/2164 symbols completed. S took 1.3s. Estimated remaining: 3m 18s. Rate: 143.3 symbols/min
[2025-10-24T01:28:29.323823] [INFO ] [MAIN      ] SAH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:29.340448] [INFO ] [MAIN      ] Derivative Progress: 1692/2164 symbols completed. SA took 1.3s. Estimated remaining: 3m 18s. Rate: 143.3 symbols/min
[2025-10-24T01:28:29.350251] [INFO ] [MAIN      ] SAM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:29.579307] [DEBUG] [LOCAL     ] SAM: Loaded 21387 existing records from primary storage.
[2025-10-24T01:28:29.578856] [DEBUG] [LOCAL     ] SAH: Loaded 20933 existing records from primary storage.
[2025-10-24T01:28:29.580620] [INFO ] [MAIN      ] SAM: Loaded 21387 primary data records.
[2025-10-24T01:28:29.581112] [INFO ] [MAIN      ] SAH: Loaded 20933 primary data records.
[2025-10-24T01:28:30.269990] [DEBUG] [MAIN      ] SAFE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:30.341897] [DEBUG] [MAIN      ] SAM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:30.342716] [DEBUG] [MAIN      ] SAH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:30.373725] [INFO ] [MAIN      ] SAFE: Generated 139 derivative records from 30040 primary records.
[2025-10-24T01:28:30.375858] [DEBUG] [LOCAL     ] SAFE: Saving derivative data.
[2025-10-24T01:28:30.394068] [DEBUG] [LOCAL     ] SAFE: Derivative data saved (139 records).
[2025-10-24T01:28:30.395950] [INFO ] [MAIN      ] SAFE: Successfully saved derivative data.
[2025-10-24T01:28:30.400010] [INFO ] [MAIN      ] Derivative Progress: 1693/2164 symbols completed. SAFE took 1.2s. Estimated remaining: 3m 17s. Rate: 143.2 symbols/min
[2025-10-24T01:28:30.427469] [INFO ] [MAIN      ] SAM: Generated 139 derivative records from 21387 primary records.
[2025-10-24T01:28:30.428209] [DEBUG] [LOCAL     ] SAM: Saving derivative data.
[2025-10-24T01:28:30.432095] [INFO ] [MAIN      ] SAH: Generated 139 derivative records from 20933 primary records.
[2025-10-24T01:28:30.432374] [DEBUG] [LOCAL     ] SAH: Saving derivative data.
[2025-10-24T01:28:30.456668] [DEBUG] [LOCAL     ] SAM: Derivative data saved (139 records).
[2025-10-24T01:28:30.456855] [INFO ] [MAIN      ] SAM: Successfully saved derivative data.
[2025-10-24T01:28:30.455278] [DEBUG] [LOCAL     ] SAH: Derivative data saved (139 records).
[2025-10-24T01:28:30.459780] [INFO ] [MAIN      ] SAH: Successfully saved derivative data.
[2025-10-24T01:28:30.459560] [INFO ] [MAIN      ] Derivative Progress: 1694/2164 symbols completed. SAM took 1.1s. Estimated remaining: 3m 17s. Rate: 143.3 symbols/min
[2025-10-24T01:28:30.462791] [INFO ] [MAIN      ] Derivative Progress: 1695/2164 symbols completed. SAH took 1.1s. Estimated remaining: 3m 16s. Rate: 143.4 symbols/min
[2025-10-24T01:28:30.463153] [INFO ] [MAIN      ] SAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:30.463223] [INFO ] [MAIN      ] SAR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:30.463282] [INFO ] [MAIN      ] SAP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:30.490910] [DEBUG] [LOCAL     ] SAR: Loaded 17208 existing records from primary storage.
[2025-10-24T01:28:30.491104] [INFO ] [MAIN      ] SAR: Loaded 17208 primary data records.
[2025-10-24T01:28:30.829449] [DEBUG] [LOCAL     ] SAN: Loaded 53345 existing records from primary storage.
[2025-10-24T01:28:30.838319] [DEBUG] [LOCAL     ] SAP: Loaded 50250 existing records from primary storage.
[2025-10-24T01:28:30.839207] [INFO ] [MAIN      ] SAN: Loaded 53345 primary data records.
[2025-10-24T01:28:30.839322] [INFO ] [MAIN      ] SAP: Loaded 50250 primary data records.
[2025-10-24T01:28:31.472917] [DEBUG] [MAIN      ] SAR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:31.518836] [DEBUG] [MAIN      ] SAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:31.566091] [DEBUG] [MAIN      ] SAP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:31.606607] [INFO ] [MAIN      ] SAR: Generated 139 derivative records from 17208 primary records.
[2025-10-24T01:28:31.607940] [DEBUG] [LOCAL     ] SAR: Saving derivative data.
[2025-10-24T01:28:31.634965] [DEBUG] [LOCAL     ] SAR: Derivative data saved (139 records).
[2025-10-24T01:28:31.635523] [INFO ] [MAIN      ] SAR: Successfully saved derivative data.
[2025-10-24T01:28:31.638815] [INFO ] [MAIN      ] Derivative Progress: 1696/2164 symbols completed. SAR took 1.2s. Estimated remaining: 3m 16s. Rate: 143.2 symbols/min
[2025-10-24T01:28:31.640453] [INFO ] [MAIN      ] SARO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:31.646180] [INFO ] [MAIN      ] SAN: Generated 139 derivative records from 53345 primary records.
[2025-10-24T01:28:31.647329] [DEBUG] [LOCAL     ] SAN: Saving derivative data.
[2025-10-24T01:28:31.667014] [DEBUG] [LOCAL     ] SAN: Derivative data saved (139 records).
[2025-10-24T01:28:31.669007] [INFO ] [MAIN      ] SAN: Successfully saved derivative data.
[2025-10-24T01:28:31.673886] [INFO ] [MAIN      ] Derivative Progress: 1697/2164 symbols completed. SAN took 1.2s. Estimated remaining: 3m 16s. Rate: 143.3 symbols/min
[2025-10-24T01:28:31.674448] [INFO ] [MAIN      ] SB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:31.674889] [INFO ] [MAIN      ] SAP: Generated 139 derivative records from 50250 primary records.
[2025-10-24T01:28:31.675301] [DEBUG] [LOCAL     ] SAP: Saving derivative data.
[2025-10-24T01:28:31.689507] [DEBUG] [LOCAL     ] SAP: Derivative data saved (139 records).
[2025-10-24T01:28:31.689925] [INFO ] [MAIN      ] SAP: Successfully saved derivative data.
[2025-10-24T01:28:31.693708] [INFO ] [MAIN      ] Derivative Progress: 1698/2164 symbols completed. SAP took 1.2s. Estimated remaining: 3m 15s. Rate: 143.4 symbols/min
[2025-10-24T01:28:31.694074] [INFO ] [MAIN      ] SBH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:31.738428] [DEBUG] [LOCAL     ] SARO: Loaded 48571 existing records from primary storage.
[2025-10-24T01:28:31.738770] [INFO ] [MAIN      ] SARO: Loaded 48571 primary data records.
[2025-10-24T01:28:31.863554] [DEBUG] [LOCAL     ] SB: Loaded 32641 existing records from primary storage.
[2025-10-24T01:28:31.867138] [INFO ] [MAIN      ] SB: Loaded 32641 primary data records.
[2025-10-24T01:28:32.184378] [DEBUG] [LOCAL     ] SBH: Loaded 50207 existing records from primary storage.
[2025-10-24T01:28:32.190864] [INFO ] [MAIN      ] SBH: Loaded 50207 primary data records.
[2025-10-24T01:28:32.773935] [DEBUG] [MAIN      ] SARO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:32.806539] [DEBUG] [MAIN      ] SB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:32.855547] [DEBUG] [MAIN      ] SBH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:32.898097] [INFO ] [MAIN      ] SARO: Generated 139 derivative records from 48571 primary records.
[2025-10-24T01:28:32.905192] [INFO ] [MAIN      ] SB: Generated 139 derivative records from 32641 primary records.
[2025-10-24T01:28:32.905322] [DEBUG] [LOCAL     ] SB: Saving derivative data.
[2025-10-24T01:28:32.902773] [DEBUG] [LOCAL     ] SARO: Saving derivative data.
[2025-10-24T01:28:32.922807] [DEBUG] [LOCAL     ] SB: Derivative data saved (139 records).
[2025-10-24T01:28:32.923209] [INFO ] [MAIN      ] SB: Successfully saved derivative data.
[2025-10-24T01:28:32.936400] [INFO ] [MAIN      ] Derivative Progress: 1699/2164 symbols completed. SB took 1.3s. Estimated remaining: 3m 15s. Rate: 143.2 symbols/min
[2025-10-24T01:28:32.939592] [DEBUG] [LOCAL     ] SARO: Derivative data saved (139 records).
[2025-10-24T01:28:32.940188] [INFO ] [MAIN      ] SARO: Successfully saved derivative data.
[2025-10-24T01:28:32.940035] [INFO ] [MAIN      ] SBI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:32.943404] [INFO ] [MAIN      ] Derivative Progress: 1700/2164 symbols completed. SARO took 1.3s. Estimated remaining: 3m 14s. Rate: 143.3 symbols/min
[2025-10-24T01:28:32.943782] [INFO ] [MAIN      ] SBR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:32.950540] [INFO ] [MAIN      ] SBH: Generated 139 derivative records from 50207 primary records.
[2025-10-24T01:28:32.950748] [DEBUG] [LOCAL     ] SBH: Saving derivative data.
[2025-10-24T01:28:32.976679] [DEBUG] [LOCAL     ] SBI: Loaded 7797 existing records from primary storage.
[2025-10-24T01:28:32.972359] [DEBUG] [LOCAL     ] SBH: Derivative data saved (139 records).
[2025-10-24T01:28:32.977403] [DEBUG] [LOCAL     ] SBR: Loaded 7861 existing records from primary storage.
[2025-10-24T01:28:32.977686] [INFO ] [MAIN      ] SBH: Successfully saved derivative data.
[2025-10-24T01:28:32.978041] [INFO ] [MAIN      ] SBI: Loaded 7797 primary data records.
[2025-10-24T01:28:32.978137] [INFO ] [MAIN      ] SBR: Loaded 7861 primary data records.
[2025-10-24T01:28:32.981082] [INFO ] [MAIN      ] Derivative Progress: 1701/2164 symbols completed. SBH took 1.3s. Estimated remaining: 3m 14s. Rate: 143.4 symbols/min
[2025-10-24T01:28:33.102503] [INFO ] [MAIN      ] SBS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:33.667852] [DEBUG] [LOCAL     ] SBS: Loaded 49623 existing records from primary storage.
[2025-10-24T01:28:33.669318] [INFO ] [MAIN      ] SBS: Loaded 49623 primary data records.
[2025-10-24T01:28:33.806033] [DEBUG] [MAIN      ] SBR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:33.878207] [DEBUG] [MAIN      ] SBI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:34.108730] [DEBUG] [MAIN      ] SBS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:34.111580] [INFO ] [MAIN      ] SBR: Generated 139 derivative records from 7861 primary records.
[2025-10-24T01:28:34.125519] [DEBUG] [LOCAL     ] SBR: Saving derivative data.
[2025-10-24T01:28:34.144798] [DEBUG] [LOCAL     ] SBR: Derivative data saved (139 records).
[2025-10-24T01:28:34.145438] [INFO ] [MAIN      ] SBR: Successfully saved derivative data.
[2025-10-24T01:28:34.142901] [INFO ] [MAIN      ] SBI: Generated 139 derivative records from 7797 primary records.
[2025-10-24T01:28:34.149014] [INFO ] [MAIN      ] Derivative Progress: 1702/2164 symbols completed. SBR took 1.2s. Estimated remaining: 3m 14s. Rate: 143.2 symbols/min
[2025-10-24T01:28:34.152126] [DEBUG] [LOCAL     ] SBI: Saving derivative data.
[2025-10-24T01:28:34.152918] [INFO ] [MAIN      ] SBSI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:34.167519] [DEBUG] [LOCAL     ] SBI: Derivative data saved (139 records).
[2025-10-24T01:28:34.167764] [INFO ] [MAIN      ] SBI: Successfully saved derivative data.
[2025-10-24T01:28:34.170394] [INFO ] [MAIN      ] Derivative Progress: 1703/2164 symbols completed. SBI took 1.2s. Estimated remaining: 3m 13s. Rate: 143.3 symbols/min
[2025-10-24T01:28:34.172355] [INFO ] [MAIN      ] SCCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:34.194945] [DEBUG] [LOCAL     ] SBSI: Loaded 14898 existing records from primary storage.
[2025-10-24T01:28:34.195441] [INFO ] [MAIN      ] SBSI: Loaded 14898 primary data records.
[2025-10-24T01:28:34.197762] [INFO ] [MAIN      ] SBS: Generated 139 derivative records from 49623 primary records.
[2025-10-24T01:28:34.198124] [DEBUG] [LOCAL     ] SBS: Saving derivative data.
[2025-10-24T01:28:34.285288] [DEBUG] [LOCAL     ] SBS: Derivative data saved (139 records).
[2025-10-24T01:28:34.285602] [INFO ] [MAIN      ] SBS: Successfully saved derivative data.
[2025-10-24T01:28:34.306905] [INFO ] [MAIN      ] Derivative Progress: 1704/2164 symbols completed. SBS took 1.2s. Estimated remaining: 3m 13s. Rate: 143.3 symbols/min
[2025-10-24T01:28:34.327549] [INFO ] [MAIN      ] SCD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:34.601627] [DEBUG] [LOCAL     ] SCD: Loaded 13638 existing records from primary storage.
[2025-10-24T01:28:34.617781] [INFO ] [MAIN      ] SCD: Loaded 13638 primary data records.
[2025-10-24T01:28:34.632054] [DEBUG] [LOCAL     ] SCCO: Loaded 49917 existing records from primary storage.
[2025-10-24T01:28:34.664980] [INFO ] [MAIN      ] SCCO: Loaded 49917 primary data records.
[2025-10-24T01:28:35.310910] [DEBUG] [MAIN      ] SBSI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:35.367385] [DEBUG] [MAIN      ] SCD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:35.425016] [DEBUG] [MAIN      ] SCCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:35.425361] [INFO ] [MAIN      ] SBSI: Generated 139 derivative records from 14898 primary records.
[2025-10-24T01:28:35.442321] [DEBUG] [LOCAL     ] SBSI: Saving derivative data.
[2025-10-24T01:28:35.465306] [DEBUG] [LOCAL     ] SBSI: Derivative data saved (139 records).
[2025-10-24T01:28:35.467529] [INFO ] [MAIN      ] SBSI: Successfully saved derivative data.
[2025-10-24T01:28:35.472514] [INFO ] [MAIN      ] Derivative Progress: 1705/2164 symbols completed. SBSI took 1.3s. Estimated remaining: 3m 12s. Rate: 143.2 symbols/min
[2025-10-24T01:28:35.474810] [INFO ] [MAIN      ] SCHW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:35.496418] [INFO ] [MAIN      ] SCD: Generated 139 derivative records from 13638 primary records.
[2025-10-24T01:28:35.497167] [DEBUG] [LOCAL     ] SCD: Saving derivative data.
[2025-10-24T01:28:35.516627] [DEBUG] [LOCAL     ] SCD: Derivative data saved (139 records).
[2025-10-24T01:28:35.518884] [INFO ] [MAIN      ] SCD: Successfully saved derivative data.
[2025-10-24T01:28:35.521224] [INFO ] [MAIN      ] Derivative Progress: 1706/2164 symbols completed. SCD took 1.2s. Estimated remaining: 3m 12s. Rate: 143.3 symbols/min
[2025-10-24T01:28:35.521452] [INFO ] [MAIN      ] SCI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:35.518799] [INFO ] [MAIN      ] SCCO: Generated 139 derivative records from 49917 primary records.
[2025-10-24T01:28:35.522311] [DEBUG] [LOCAL     ] SCCO: Saving derivative data.
[2025-10-24T01:28:35.537343] [DEBUG] [LOCAL     ] SCCO: Derivative data saved (139 records).
[2025-10-24T01:28:35.537833] [INFO ] [MAIN      ] SCCO: Successfully saved derivative data.
[2025-10-24T01:28:35.541172] [INFO ] [MAIN      ] Derivative Progress: 1707/2164 symbols completed. SCCO took 1.4s. Estimated remaining: 3m 11s. Rate: 143.3 symbols/min
[2025-10-24T01:28:35.541534] [INFO ] [MAIN      ] SCL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:35.597782] [DEBUG] [LOCAL     ] SCHW: Loaded 54075 existing records from primary storage.
[2025-10-24T01:28:35.598321] [INFO ] [MAIN      ] SCHW: Loaded 54075 primary data records.
[2025-10-24T01:28:35.672741] [DEBUG] [LOCAL     ] SCL: Loaded 15300 existing records from primary storage.
[2025-10-24T01:28:35.695447] [INFO ] [MAIN      ] SCL: Loaded 15300 primary data records.
[2025-10-24T01:28:35.783443] [DEBUG] [LOCAL     ] SCI: Loaded 46439 existing records from primary storage.
[2025-10-24T01:28:35.828304] [INFO ] [MAIN      ] SCI: Loaded 46439 primary data records.
[2025-10-24T01:28:36.699100] [DEBUG] [MAIN      ] SCHW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:36.730533] [DEBUG] [MAIN      ] SCL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:36.771453] [DEBUG] [MAIN      ] SCI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:36.826481] [INFO ] [MAIN      ] SCHW: Generated 139 derivative records from 54075 primary records.
[2025-10-24T01:28:36.828975] [DEBUG] [LOCAL     ] SCHW: Saving derivative data.
[2025-10-24T01:28:36.851594] [DEBUG] [LOCAL     ] SCHW: Derivative data saved (139 records).
[2025-10-24T01:28:36.852464] [INFO ] [MAIN      ] SCHW: Successfully saved derivative data.
[2025-10-24T01:28:36.857408] [INFO ] [MAIN      ] Derivative Progress: 1708/2164 symbols completed. SCHW took 1.4s. Estimated remaining: 3m 11s. Rate: 143.2 symbols/min
[2025-10-24T01:28:36.854982] [INFO ] [MAIN      ] SCL: Generated 139 derivative records from 15300 primary records.
[2025-10-24T01:28:36.859516] [DEBUG] [LOCAL     ] SCL: Saving derivative data.
[2025-10-24T01:28:36.876802] [DEBUG] [LOCAL     ] SCL: Derivative data saved (139 records).
[2025-10-24T01:28:36.878845] [INFO ] [MAIN      ] SCL: Successfully saved derivative data.
[2025-10-24T01:28:36.879092] [INFO ] [MAIN      ] SCI: Generated 139 derivative records from 46439 primary records.
[2025-10-24T01:28:36.882429] [INFO ] [MAIN      ] Derivative Progress: 1709/2164 symbols completed. SCL took 1.3s. Estimated remaining: 3m 11s. Rate: 143.2 symbols/min
[2025-10-24T01:28:36.882771] [DEBUG] [LOCAL     ] SCI: Saving derivative data.
[2025-10-24T01:28:36.895462] [DEBUG] [LOCAL     ] SCI: Derivative data saved (139 records).
[2025-10-24T01:28:36.895556] [INFO ] [MAIN      ] SCI: Successfully saved derivative data.
[2025-10-24T01:28:36.899375] [INFO ] [MAIN      ] Derivative Progress: 1710/2164 symbols completed. SCI took 1.4s. Estimated remaining: 3m 10s. Rate: 143.3 symbols/min
[2025-10-24T01:28:36.899924] [INFO ] [MAIN      ] SCM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:36.900047] [INFO ] [MAIN      ] SD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:36.900241] [INFO ] [MAIN      ] SCS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:36.944702] [DEBUG] [LOCAL     ] SCM: Loaded 20250 existing records from primary storage.
[2025-10-24T01:28:36.952925] [INFO ] [MAIN      ] SCM: Loaded 20250 primary data records.
[2025-10-24T01:28:36.953879] [DEBUG] [LOCAL     ] SD: Loaded 28416 existing records from primary storage.
[2025-10-24T01:28:37.005814] [INFO ] [MAIN      ] SD: Loaded 28416 primary data records.
[2025-10-24T01:28:37.047908] [DEBUG] [LOCAL     ] SCS: Loaded 43507 existing records from primary storage.
[2025-10-24T01:28:37.080757] [INFO ] [MAIN      ] SCS: Loaded 43507 primary data records.
[2025-10-24T01:28:37.971740] [DEBUG] [MAIN      ] SCS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:37.958960] [DEBUG] [MAIN      ] SCM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:37.983354] [DEBUG] [MAIN      ] SD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:38.072416] [INFO ] [MAIN      ] SCS: Generated 139 derivative records from 43507 primary records.
[2025-10-24T01:28:38.072577] [DEBUG] [LOCAL     ] SCS: Saving derivative data.
[2025-10-24T01:28:38.075173] [INFO ] [MAIN      ] SCM: Generated 139 derivative records from 20250 primary records.
[2025-10-24T01:28:38.077380] [INFO ] [MAIN      ] SD: Generated 139 derivative records from 28416 primary records.
[2025-10-24T01:28:38.084505] [DEBUG] [LOCAL     ] SCM: Saving derivative data.
[2025-10-24T01:28:38.088908] [DEBUG] [LOCAL     ] SCS: Derivative data saved (139 records).
[2025-10-24T01:28:38.089104] [DEBUG] [LOCAL     ] SD: Saving derivative data.
[2025-10-24T01:28:38.089780] [INFO ] [MAIN      ] SCS: Successfully saved derivative data.
[2025-10-24T01:28:38.104587] [INFO ] [MAIN      ] Derivative Progress: 1711/2164 symbols completed. SCS took 1.2s. Estimated remaining: 3m 10s. Rate: 143.2 symbols/min
[2025-10-24T01:28:38.111976] [INFO ] [MAIN      ] SDHC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:38.101534] [DEBUG] [LOCAL     ] SCM: Derivative data saved (139 records).
[2025-10-24T01:28:38.113974] [INFO ] [MAIN      ] SCM: Successfully saved derivative data.
[2025-10-24T01:28:38.116796] [DEBUG] [LOCAL     ] SD: Derivative data saved (139 records).
[2025-10-24T01:28:38.116937] [INFO ] [MAIN      ] SD: Successfully saved derivative data.
[2025-10-24T01:28:38.118974] [INFO ] [MAIN      ] Derivative Progress: 1712/2164 symbols completed. SCM took 1.2s. Estimated remaining: 3m 9s. Rate: 143.3 symbols/min
[2025-10-24T01:28:38.121822] [INFO ] [MAIN      ] SDHY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:38.122323] [INFO ] [MAIN      ] Derivative Progress: 1713/2164 symbols completed. SD took 1.2s. Estimated remaining: 3m 9s. Rate: 143.3 symbols/min
[2025-10-24T01:28:38.122563] [INFO ] [MAIN      ] SDRL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:38.139460] [DEBUG] [LOCAL     ] SDHC: Loaded 10434 existing records from primary storage.
[2025-10-24T01:28:38.140013] [INFO ] [MAIN      ] SDHC: Loaded 10434 primary data records.
[2025-10-24T01:28:38.219924] [DEBUG] [LOCAL     ] SDHY: Loaded 11276 existing records from primary storage.
[2025-10-24T01:28:38.261930] [INFO ] [MAIN      ] SDHY: Loaded 11276 primary data records.
[2025-10-24T01:28:38.556976] [DEBUG] [LOCAL     ] SDRL: Loaded 41448 existing records from primary storage.
[2025-10-24T01:28:38.576192] [INFO ] [MAIN      ] SDRL: Loaded 41448 primary data records.
[2025-10-24T01:28:39.137935] [DEBUG] [MAIN      ] SDHC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:39.172084] [DEBUG] [MAIN      ] SDHY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:39.217185] [DEBUG] [MAIN      ] SDRL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:39.258800] [INFO ] [MAIN      ] SDHC: Generated 139 derivative records from 10434 primary records.
[2025-10-24T01:28:39.265773] [INFO ] [MAIN      ] SDHY: Generated 139 derivative records from 11276 primary records.
[2025-10-24T01:28:39.266230] [DEBUG] [LOCAL     ] SDHY: Saving derivative data.
[2025-10-24T01:28:39.266020] [DEBUG] [LOCAL     ] SDHC: Saving derivative data.
[2025-10-24T01:28:39.291785] [DEBUG] [LOCAL     ] SDHY: Derivative data saved (139 records).
[2025-10-24T01:28:39.297284] [DEBUG] [LOCAL     ] SDHC: Derivative data saved (139 records).
[2025-10-24T01:28:39.297484] [INFO ] [MAIN      ] SDHY: Successfully saved derivative data.
[2025-10-24T01:28:39.298130] [INFO ] [MAIN      ] SDHC: Successfully saved derivative data.
[2025-10-24T01:28:39.300900] [INFO ] [MAIN      ] Derivative Progress: 1714/2164 symbols completed. SDHY took 1.2s. Estimated remaining: 3m 9s. Rate: 143.2 symbols/min
[2025-10-24T01:28:39.305121] [INFO ] [MAIN      ] SE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:39.305255] [INFO ] [MAIN      ] Derivative Progress: 1715/2164 symbols completed. SDHC took 1.2s. Estimated remaining: 3m 8s. Rate: 143.3 symbols/min
[2025-10-24T01:28:39.305702] [INFO ] [MAIN      ] SEE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:39.309423] [INFO ] [MAIN      ] SDRL: Generated 139 derivative records from 41448 primary records.
[2025-10-24T01:28:39.309749] [DEBUG] [LOCAL     ] SDRL: Saving derivative data.
[2025-10-24T01:28:39.322580] [DEBUG] [LOCAL     ] SDRL: Derivative data saved (139 records).
[2025-10-24T01:28:39.323151] [INFO ] [MAIN      ] SDRL: Successfully saved derivative data.
[2025-10-24T01:28:39.326133] [INFO ] [MAIN      ] Derivative Progress: 1716/2164 symbols completed. SDRL took 1.2s. Estimated remaining: 3m 8s. Rate: 143.3 symbols/min
[2025-10-24T01:28:39.326377] [INFO ] [MAIN      ] SEG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:39.341746] [DEBUG] [LOCAL     ] SEG: Loaded 12541 existing records from primary storage.
[2025-10-24T01:28:39.342038] [INFO ] [MAIN      ] SEG: Loaded 12541 primary data records.
[2025-10-24T01:28:39.608271] [DEBUG] [LOCAL     ] SE: Loaded 53690 existing records from primary storage.
[2025-10-24T01:28:39.689105] [INFO ] [MAIN      ] SE: Loaded 53690 primary data records.
[2025-10-24T01:28:39.690004] [DEBUG] [LOCAL     ] SEE: Loaded 48408 existing records from primary storage.
[2025-10-24T01:28:39.690274] [INFO ] [MAIN      ] SEE: Loaded 48408 primary data records.
[2025-10-24T01:28:40.314773] [DEBUG] [MAIN      ] SEG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:40.357689] [DEBUG] [MAIN      ] SE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:40.388548] [DEBUG] [MAIN      ] SEE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:40.413943] [INFO ] [MAIN      ] SEG: Generated 139 derivative records from 12541 primary records.
[2025-10-24T01:28:40.416625] [DEBUG] [LOCAL     ] SEG: Saving derivative data.
[2025-10-24T01:28:40.435958] [DEBUG] [LOCAL     ] SEG: Derivative data saved (139 records).
[2025-10-24T01:28:40.437431] [INFO ] [MAIN      ] SEG: Successfully saved derivative data.
[2025-10-24T01:28:40.439811] [INFO ] [MAIN      ] Derivative Progress: 1717/2164 symbols completed. SEG took 1.1s. Estimated remaining: 3m 7s. Rate: 143.2 symbols/min
[2025-10-24T01:28:40.442774] [INFO ] [MAIN      ] SEI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:40.458401] [INFO ] [MAIN      ] SE: Generated 139 derivative records from 53690 primary records.
[2025-10-24T01:28:40.459209] [DEBUG] [LOCAL     ] SE: Saving derivative data.
[2025-10-24T01:28:40.461540] [INFO ] [MAIN      ] SEE: Generated 139 derivative records from 48408 primary records.
[2025-10-24T01:28:40.462753] [DEBUG] [LOCAL     ] SEE: Saving derivative data.
[2025-10-24T01:28:40.487244] [DEBUG] [LOCAL     ] SE: Derivative data saved (139 records).
[2025-10-24T01:28:40.488914] [DEBUG] [LOCAL     ] SEE: Derivative data saved (139 records).
[2025-10-24T01:28:40.489222] [INFO ] [MAIN      ] SE: Successfully saved derivative data.
[2025-10-24T01:28:40.492354] [INFO ] [MAIN      ] Derivative Progress: 1718/2164 symbols completed. SE took 1.2s. Estimated remaining: 3m 7s. Rate: 143.3 symbols/min
[2025-10-24T01:28:40.489370] [INFO ] [MAIN      ] SEE: Successfully saved derivative data.
[2025-10-24T01:28:40.503512] [INFO ] [MAIN      ] SEM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:40.506846] [INFO ] [MAIN      ] Derivative Progress: 1719/2164 symbols completed. SEE took 1.2s. Estimated remaining: 3m 6s. Rate: 143.4 symbols/min
[2025-10-24T01:28:40.507344] [INFO ] [MAIN      ] SEMR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:40.528598] [DEBUG] [LOCAL     ] SEI: Loaded 50409 existing records from primary storage.
[2025-10-24T01:28:40.528814] [INFO ] [MAIN      ] SEI: Loaded 50409 primary data records.
[2025-10-24T01:28:40.732291] [DEBUG] [LOCAL     ] SEMR: Loaded 42346 existing records from primary storage.
[2025-10-24T01:28:40.786888] [DEBUG] [LOCAL     ] SEM: Loaded 43469 existing records from primary storage.
[2025-10-24T01:28:40.787105] [INFO ] [MAIN      ] SEMR: Loaded 42346 primary data records.
[2025-10-24T01:28:40.894585] [INFO ] [MAIN      ] SEM: Loaded 43469 primary data records.
[2025-10-24T01:28:41.583001] [DEBUG] [MAIN      ] SEI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:41.621697] [DEBUG] [MAIN      ] SEMR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:41.649797] [DEBUG] [MAIN      ] SEM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:41.718507] [INFO ] [MAIN      ] SEI: Generated 139 derivative records from 50409 primary records.
[2025-10-24T01:28:41.719550] [DEBUG] [LOCAL     ] SEI: Saving derivative data.
[2025-10-24T01:28:41.723212] [INFO ] [MAIN      ] SEMR: Generated 139 derivative records from 42346 primary records.
[2025-10-24T01:28:41.724052] [DEBUG] [LOCAL     ] SEMR: Saving derivative data.
[2025-10-24T01:28:41.745981] [DEBUG] [LOCAL     ] SEMR: Derivative data saved (139 records).
[2025-10-24T01:28:41.748407] [INFO ] [MAIN      ] SEMR: Successfully saved derivative data.
[2025-10-24T01:28:41.751751] [INFO ] [MAIN      ] Derivative Progress: 1720/2164 symbols completed. SEMR took 1.2s. Estimated remaining: 3m 6s. Rate: 143.2 symbols/min
[2025-10-24T01:28:41.753415] [INFO ] [MAIN      ] SES: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:41.756594] [DEBUG] [LOCAL     ] SEI: Derivative data saved (139 records).
[2025-10-24T01:28:41.757829] [INFO ] [MAIN      ] SEI: Successfully saved derivative data.
[2025-10-24T01:28:41.760666] [INFO ] [MAIN      ] Derivative Progress: 1721/2164 symbols completed. SEI took 1.3s. Estimated remaining: 3m 6s. Rate: 143.3 symbols/min
[2025-10-24T01:28:41.764334] [INFO ] [MAIN      ] SF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:41.764077] [INFO ] [MAIN      ] SEM: Generated 139 derivative records from 43469 primary records.
[2025-10-24T01:28:41.764706] [DEBUG] [LOCAL     ] SEM: Saving derivative data.
[2025-10-24T01:28:41.779998] [DEBUG] [LOCAL     ] SEM: Derivative data saved (139 records).
[2025-10-24T01:28:41.780153] [INFO ] [MAIN      ] SEM: Successfully saved derivative data.
[2025-10-24T01:28:41.783294] [INFO ] [MAIN      ] Derivative Progress: 1722/2164 symbols completed. SEM took 1.3s. Estimated remaining: 3m 5s. Rate: 143.4 symbols/min
[2025-10-24T01:28:41.783820] [INFO ] [MAIN      ] SFB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:41.796367] [DEBUG] [LOCAL     ] SFB: Loaded 3706 existing records from primary storage.
[2025-10-24T01:28:41.796741] [INFO ] [MAIN      ] SFB: Loaded 3706 primary data records.
[2025-10-24T01:28:41.987690] [DEBUG] [LOCAL     ] SES: Loaded 52003 existing records from primary storage.
[2025-10-24T01:28:42.137864] [INFO ] [MAIN      ] SES: Loaded 52003 primary data records.
[2025-10-24T01:28:42.160427] [DEBUG] [LOCAL     ] SF: Loaded 41695 existing records from primary storage.
[2025-10-24T01:28:42.196965] [INFO ] [MAIN      ] SF: Loaded 41695 primary data records.
[2025-10-24T01:28:42.810372] [DEBUG] [MAIN      ] SFB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:42.853111] [DEBUG] [MAIN      ] SES: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:42.889230] [DEBUG] [MAIN      ] SF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:42.915845] [INFO ] [MAIN      ] SFB: Generated 139 derivative records from 3706 primary records.
[2025-10-24T01:28:42.918475] [DEBUG] [LOCAL     ] SFB: Saving derivative data.
[2025-10-24T01:28:42.940947] [DEBUG] [LOCAL     ] SFB: Derivative data saved (139 records).
[2025-10-24T01:28:42.943981] [INFO ] [MAIN      ] SFB: Successfully saved derivative data.
[2025-10-24T01:28:42.950913] [INFO ] [MAIN      ] Derivative Progress: 1723/2164 symbols completed. SFB took 1.2s. Estimated remaining: 3m 5s. Rate: 143.2 symbols/min
[2025-10-24T01:28:42.960102] [INFO ] [MAIN      ] SES: Generated 139 derivative records from 52003 primary records.
[2025-10-24T01:28:42.960442] [DEBUG] [LOCAL     ] SES: Saving derivative data.
[2025-10-24T01:28:42.977142] [DEBUG] [LOCAL     ] SES: Derivative data saved (139 records).
[2025-10-24T01:28:42.979205] [INFO ] [MAIN      ] SF: Generated 139 derivative records from 41695 primary records.
[2025-10-24T01:28:42.979295] [INFO ] [MAIN      ] SES: Successfully saved derivative data.
[2025-10-24T01:28:42.979521] [DEBUG] [LOCAL     ] SF: Saving derivative data.
[2025-10-24T01:28:42.982262] [INFO ] [MAIN      ] Derivative Progress: 1724/2164 symbols completed. SES took 1.2s. Estimated remaining: 3m 4s. Rate: 143.3 symbols/min
[2025-10-24T01:28:42.995007] [DEBUG] [LOCAL     ] SF: Derivative data saved (139 records).
[2025-10-24T01:28:42.995173] [INFO ] [MAIN      ] SF: Successfully saved derivative data.
[2025-10-24T01:28:42.997931] [INFO ] [MAIN      ] Derivative Progress: 1725/2164 symbols completed. SF took 1.2s. Estimated remaining: 3m 4s. Rate: 143.4 symbols/min
[2025-10-24T01:28:42.998543] [INFO ] [MAIN      ] SFBS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:42.998679] [INFO ] [MAIN      ] SG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:42.999096] [INFO ] [MAIN      ] SGHC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:43.025754] [DEBUG] [LOCAL     ] SFBS: Loaded 21618 existing records from primary storage.
[2025-10-24T01:28:43.025972] [INFO ] [MAIN      ] SFBS: Loaded 21618 primary data records.
[2025-10-24T01:28:43.224631] [DEBUG] [LOCAL     ] SG: Loaded 53894 existing records from primary storage.
[2025-10-24T01:28:43.234244] [DEBUG] [LOCAL     ] SGHC: Loaded 47651 existing records from primary storage.
[2025-10-24T01:28:43.260597] [INFO ] [MAIN      ] SG: Loaded 53894 primary data records.
[2025-10-24T01:28:43.380374] [INFO ] [MAIN      ] SGHC: Loaded 47651 primary data records.
[2025-10-24T01:28:44.110454] [DEBUG] [MAIN      ] SFBS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:28:44.201553] [DEBUG] [MAIN      ] SGHC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:44.202095] [INFO ] [MAIN      ] SFBS: Generated 139 derivative records from 21618 primary records.
[2025-10-24T01:28:44.202795] [DEBUG] [MAIN      ] SG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:44.218273] [DEBUG] [LOCAL     ] SFBS: Saving derivative data.
[2025-10-24T01:28:44.258084] [DEBUG] [LOCAL     ] SFBS: Derivative data saved (139 records).
[2025-10-24T01:28:44.267256] [INFO ] [MAIN      ] SFBS: Successfully saved derivative data.
[2025-10-24T01:28:44.272054] [INFO ] [MAIN      ] Derivative Progress: 1726/2164 symbols completed. SFBS took 1.3s. Estimated remaining: 3m 4s. Rate: 143.2 symbols/min
[2025-10-24T01:28:44.277279] [INFO ] [MAIN      ] SGU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:44.314814] [DEBUG] [LOCAL     ] SGU: Loaded 6520 existing records from primary storage.
[2025-10-24T01:28:44.324115] [INFO ] [MAIN      ] SGU: Loaded 6520 primary data records.
[2025-10-24T01:28:44.429299] [INFO ] [MAIN      ] SGHC: Generated 139 derivative records from 47651 primary records.
[2025-10-24T01:28:44.429584] [DEBUG] [LOCAL     ] SGHC: Saving derivative data.
[2025-10-24T01:28:44.413307] [INFO ] [MAIN      ] SG: Generated 139 derivative records from 53894 primary records.
[2025-10-24T01:28:44.477873] [DEBUG] [LOCAL     ] SG: Saving derivative data.
[2025-10-24T01:28:44.543848] [DEBUG] [LOCAL     ] SGHC: Derivative data saved (139 records).
[2025-10-24T01:28:44.590914] [DEBUG] [LOCAL     ] SG: Derivative data saved (139 records).
[2025-10-24T01:28:44.609009] [INFO ] [MAIN      ] SGHC: Successfully saved derivative data.
[2025-10-24T01:28:44.625560] [INFO ] [MAIN      ] SG: Successfully saved derivative data.
[2025-10-24T01:28:44.651488] [INFO ] [MAIN      ] Derivative Progress: 1727/2164 symbols completed. SGHC took 1.7s. Estimated remaining: 3m 3s. Rate: 143.2 symbols/min
[2025-10-24T01:28:44.666113] [INFO ] [MAIN      ] SHAK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:44.666363] [INFO ] [MAIN      ] Derivative Progress: 1728/2164 symbols completed. SG took 1.7s. Estimated remaining: 3m 3s. Rate: 143.3 symbols/min
[2025-10-24T01:28:44.675850] [INFO ] [MAIN      ] SHCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:44.862810] [DEBUG] [MAIN      ] SGU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:44.888199] [DEBUG] [LOCAL     ] SHCO: Loaded 25438 existing records from primary storage.
[2025-10-24T01:28:44.901722] [INFO ] [MAIN      ] SHCO: Loaded 25438 primary data records.
[2025-10-24T01:28:45.086111] [DEBUG] [LOCAL     ] SHAK: Loaded 49001 existing records from primary storage.
[2025-10-24T01:28:45.119449] [INFO ] [MAIN      ] SHAK: Loaded 49001 primary data records.
[2025-10-24T01:28:45.328187] [INFO ] [MAIN      ] SGU: Generated 139 derivative records from 6520 primary records.
[2025-10-24T01:28:45.348505] [DEBUG] [LOCAL     ] SGU: Saving derivative data.
[2025-10-24T01:28:45.595437] [DEBUG] [LOCAL     ] SGU: Derivative data saved (139 records).
[2025-10-24T01:28:45.604325] [INFO ] [MAIN      ] SGU: Successfully saved derivative data.
[2025-10-24T01:28:45.606794] [INFO ] [MAIN      ] Derivative Progress: 1729/2164 symbols completed. SGU took 1.3s. Estimated remaining: 3m 2s. Rate: 143.2 symbols/min
[2025-10-24T01:28:45.607422] [INFO ] [MAIN      ] SHEL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:45.629140] [DEBUG] [MAIN      ] SHCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:45.682045] [INFO ] [MAIN      ] SHCO: Generated 139 derivative records from 25438 primary records.
[2025-10-24T01:28:45.694699] [DEBUG] [MAIN      ] SHAK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:45.694818] [DEBUG] [LOCAL     ] SHCO: Saving derivative data.
[2025-10-24T01:28:45.739922] [DEBUG] [LOCAL     ] SHEL: Loaded 54065 existing records from primary storage.
[2025-10-24T01:28:45.738627] [DEBUG] [LOCAL     ] SHCO: Derivative data saved (139 records).
[2025-10-24T01:28:45.742841] [INFO ] [MAIN      ] SHEL: Loaded 54065 primary data records.
[2025-10-24T01:28:45.743129] [INFO ] [MAIN      ] SHCO: Successfully saved derivative data.
[2025-10-24T01:28:45.746361] [INFO ] [MAIN      ] Derivative Progress: 1730/2164 symbols completed. SHCO took 1.1s. Estimated remaining: 3m 2s. Rate: 143.2 symbols/min
[2025-10-24T01:28:45.778303] [INFO ] [MAIN      ] SHG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:46.074423] [DEBUG] [LOCAL     ] SHG: Loaded 26875 existing records from primary storage.
[2025-10-24T01:28:46.075135] [INFO ] [MAIN      ] SHG: Loaded 26875 primary data records.
[2025-10-24T01:28:46.177910] [INFO ] [MAIN      ] SHAK: Generated 139 derivative records from 49001 primary records.
[2025-10-24T01:28:46.181639] [DEBUG] [LOCAL     ] SHAK: Saving derivative data.
[2025-10-24T01:28:46.267752] [DEBUG] [LOCAL     ] SHAK: Derivative data saved (139 records).
[2025-10-24T01:28:46.386251] [INFO ] [MAIN      ] SHAK: Successfully saved derivative data.
[2025-10-24T01:28:46.389222] [INFO ] [MAIN      ] Derivative Progress: 1731/2164 symbols completed. SHAK took 1.7s. Estimated remaining: 3m 1s. Rate: 143.2 symbols/min
[2025-10-24T01:28:46.389666] [INFO ] [MAIN      ] SHO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:46.411694] [DEBUG] [MAIN      ] SHEL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:46.470622] [DEBUG] [MAIN      ] SHG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:46.504673] [INFO ] [MAIN      ] SHEL: Generated 139 derivative records from 54065 primary records.
[2025-10-24T01:28:46.506301] [DEBUG] [LOCAL     ] SHEL: Saving derivative data.
[2025-10-24T01:28:46.508032] [DEBUG] [LOCAL     ] SHO: Loaded 49414 existing records from primary storage.
[2025-10-24T01:28:46.508897] [INFO ] [MAIN      ] SHO: Loaded 49414 primary data records.
[2025-10-24T01:28:46.555792] [DEBUG] [LOCAL     ] SHEL: Derivative data saved (139 records).
[2025-10-24T01:28:46.580429] [INFO ] [MAIN      ] SHEL: Successfully saved derivative data.
[2025-10-24T01:28:46.605574] [INFO ] [MAIN      ] Derivative Progress: 1732/2164 symbols completed. SHEL took 1.0s. Estimated remaining: 3m 1s. Rate: 143.2 symbols/min
[2025-10-24T01:28:46.633275] [INFO ] [MAIN      ] SHOC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:46.716134] [DEBUG] [LOCAL     ] SHOC: Loaded 3025 existing records from primary storage.
[2025-10-24T01:28:46.832736] [INFO ] [MAIN      ] SHOC: Loaded 3025 primary data records.
[2025-10-24T01:28:46.943546] [INFO ] [MAIN      ] SHG: Generated 139 derivative records from 26875 primary records.
[2025-10-24T01:28:46.954878] [DEBUG] [LOCAL     ] SHG: Saving derivative data.
[2025-10-24T01:28:46.973081] [DEBUG] [LOCAL     ] SHG: Derivative data saved (139 records).
[2025-10-24T01:28:46.978972] [INFO ] [MAIN      ] SHG: Successfully saved derivative data.
[2025-10-24T01:28:46.992791] [INFO ] [MAIN      ] Derivative Progress: 1733/2164 symbols completed. SHG took 1.2s. Estimated remaining: 3m 1s. Rate: 143.2 symbols/min
[2025-10-24T01:28:46.998205] [INFO ] [MAIN      ] SHW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:47.186349] [DEBUG] [MAIN      ] SHO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:47.245901] [DEBUG] [MAIN      ] SHOC: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:28:47.279721] [DEBUG] [LOCAL     ] SHW: Loaded 50760 existing records from primary storage.
[2025-10-24T01:28:47.282302] [INFO ] [MAIN      ] SHW: Loaded 50760 primary data records.
[2025-10-24T01:28:47.282206] [INFO ] [MAIN      ] SHO: Generated 139 derivative records from 49414 primary records.
[2025-10-24T01:28:47.283630] [DEBUG] [LOCAL     ] SHO: Saving derivative data.
[2025-10-24T01:28:47.385571] [DEBUG] [LOCAL     ] SHO: Derivative data saved (139 records).
[2025-10-24T01:28:47.413477] [INFO ] [MAIN      ] SHO: Successfully saved derivative data.
[2025-10-24T01:28:47.422932] [INFO ] [MAIN      ] Derivative Progress: 1734/2164 symbols completed. SHO took 1.0s. Estimated remaining: 3m 0s. Rate: 143.2 symbols/min
[2025-10-24T01:28:47.428468] [INFO ] [MAIN      ] SID: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:47.654000] [INFO ] [MAIN      ] SHOC: Generated 139 derivative records from 3025 primary records.
[2025-10-24T01:28:47.654186] [DEBUG] [LOCAL     ] SHOC: Saving derivative data.
[2025-10-24T01:28:47.666953] [DEBUG] [LOCAL     ] SHOC: Derivative data saved (139 records).
[2025-10-24T01:28:47.667488] [INFO ] [MAIN      ] SHOC: Successfully saved derivative data.
[2025-10-24T01:28:47.670744] [INFO ] [MAIN      ] Derivative Progress: 1735/2164 symbols completed. SHOC took 1.0s. Estimated remaining: 2m 60s. Rate: 143.3 symbols/min
[2025-10-24T01:28:47.671454] [INFO ] [MAIN      ] SIG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:47.707835] [DEBUG] [MAIN      ] SHW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:47.733392] [DEBUG] [LOCAL     ] SID: Loaded 43285 existing records from primary storage.
[2025-10-24T01:28:47.735182] [INFO ] [MAIN      ] SID: Loaded 43285 primary data records.
[2025-10-24T01:28:47.876871] [DEBUG] [LOCAL     ] SIG: Loaded 45589 existing records from primary storage.
[2025-10-24T01:28:47.884779] [INFO ] [MAIN      ] SIG: Loaded 45589 primary data records.
[2025-10-24T01:28:48.399703] [INFO ] [MAIN      ] SHW: Generated 139 derivative records from 50760 primary records.
[2025-10-24T01:28:48.400230] [DEBUG] [LOCAL     ] SHW: Saving derivative data.
[2025-10-24T01:28:48.414815] [DEBUG] [LOCAL     ] SHW: Derivative data saved (139 records).
[2025-10-24T01:28:48.415026] [INFO ] [MAIN      ] SHW: Successfully saved derivative data.
[2025-10-24T01:28:48.417423] [INFO ] [MAIN      ] Derivative Progress: 1736/2164 symbols completed. SHW took 1.4s. Estimated remaining: 2m 59s. Rate: 143.2 symbols/min
[2025-10-24T01:28:48.417955] [INFO ] [MAIN      ] SII: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:48.439684] [DEBUG] [MAIN      ] SID: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:48.478041] [DEBUG] [LOCAL     ] SII: Loaded 24307 existing records from primary storage.
[2025-10-24T01:28:48.478728] [INFO ] [MAIN      ] SII: Loaded 24307 primary data records.
[2025-10-24T01:28:48.549040] [DEBUG] [MAIN      ] SIG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:48.839120] [INFO ] [MAIN      ] SID: Generated 139 derivative records from 43285 primary records.
[2025-10-24T01:28:48.842961] [DEBUG] [LOCAL     ] SID: Saving derivative data.
[2025-10-24T01:28:48.863089] [DEBUG] [LOCAL     ] SID: Derivative data saved (139 records).
[2025-10-24T01:28:48.867708] [INFO ] [MAIN      ] SID: Successfully saved derivative data.
[2025-10-24T01:28:48.873958] [INFO ] [MAIN      ] Derivative Progress: 1737/2164 symbols completed. SID took 1.4s. Estimated remaining: 2m 59s. Rate: 143.2 symbols/min
[2025-10-24T01:28:48.874797] [INFO ] [MAIN      ] SILA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:48.878318] [INFO ] [MAIN      ] SIG: Generated 139 derivative records from 45589 primary records.
[2025-10-24T01:28:48.878501] [DEBUG] [LOCAL     ] SIG: Saving derivative data.
[2025-10-24T01:28:48.894371] [DEBUG] [LOCAL     ] SIG: Derivative data saved (139 records).
[2025-10-24T01:28:48.897159] [INFO ] [MAIN      ] SIG: Successfully saved derivative data.
[2025-10-24T01:28:48.900305] [INFO ] [MAIN      ] Derivative Progress: 1738/2164 symbols completed. SIG took 1.2s. Estimated remaining: 2m 58s. Rate: 143.3 symbols/min
[2025-10-24T01:28:48.913513] [DEBUG] [MAIN      ] SII: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:48.957116] [DEBUG] [LOCAL     ] SILA: Loaded 30079 existing records from primary storage.
[2025-10-24T01:28:48.960252] [INFO ] [MAIN      ] SILA: Loaded 30079 primary data records.
[2025-10-24T01:28:49.021029] [INFO ] [MAIN      ] SII: Generated 139 derivative records from 24307 primary records.
[2025-10-24T01:28:49.041213] [DEBUG] [LOCAL     ] SII: Saving derivative data.
[2025-10-24T01:28:49.135325] [DEBUG] [LOCAL     ] SII: Derivative data saved (139 records).
[2025-10-24T01:28:49.156951] [INFO ] [MAIN      ] SII: Successfully saved derivative data.
[2025-10-24T01:28:49.275957] [INFO ] [MAIN      ] Derivative Progress: 1739/2164 symbols completed. SII took 0.9s. Estimated remaining: 2m 58s. Rate: 143.3 symbols/min
[2025-10-24T01:28:49.301794] [DEBUG] [MAIN      ] SILA: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:28:49.328118] [INFO ] [MAIN      ] SILA: Generated 139 derivative records from 30079 primary records.
[2025-10-24T01:28:49.328257] [DEBUG] [LOCAL     ] SILA: Saving derivative data.
[2025-10-24T01:28:49.340185] [DEBUG] [LOCAL     ] SILA: Derivative data saved (139 records).
[2025-10-24T01:28:49.340269] [INFO ] [MAIN      ] SILA: Successfully saved derivative data.
[2025-10-24T01:28:49.342833] [INFO ] [MAIN      ] Derivative Progress: 1740/2164 symbols completed. SILA took 0.5s. Estimated remaining: 2m 57s. Rate: 143.3 symbols/min
[2025-10-24T01:28:49.343521] [INFO ] [MAIN      ] SITC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:49.343803] [INFO ] [MAIN      ] SJM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:49.343715] [INFO ] [MAIN      ] SITE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:49.415343] [DEBUG] [LOCAL     ] SITE: Loaded 35740 existing records from primary storage.
[2025-10-24T01:28:49.418671] [DEBUG] [LOCAL     ] SITC: Loaded 42011 existing records from primary storage.
[2025-10-24T01:28:49.417688] [INFO ] [MAIN      ] SITE: Loaded 35740 primary data records.
[2025-10-24T01:28:49.432365] [INFO ] [MAIN      ] SITC: Loaded 42011 primary data records.
[2025-10-24T01:28:49.470462] [DEBUG] [LOCAL     ] SJM: Loaded 50444 existing records from primary storage.
[2025-10-24T01:28:49.514056] [INFO ] [MAIN      ] SJM: Loaded 50444 primary data records.
[2025-10-24T01:28:50.492203] [DEBUG] [MAIN      ] SITE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:50.493214] [DEBUG] [MAIN      ] SITC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:50.494000] [DEBUG] [MAIN      ] SJM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:50.595174] [INFO ] [MAIN      ] SITC: Generated 139 derivative records from 42011 primary records.
[2025-10-24T01:28:50.599043] [DEBUG] [LOCAL     ] SITC: Saving derivative data.
[2025-10-24T01:28:50.600681] [INFO ] [MAIN      ] SITE: Generated 139 derivative records from 35740 primary records.
[2025-10-24T01:28:50.601422] [DEBUG] [LOCAL     ] SITE: Saving derivative data.
[2025-10-24T01:28:50.632322] [DEBUG] [LOCAL     ] SITE: Derivative data saved (139 records).
[2025-10-24T01:28:50.631363] [DEBUG] [LOCAL     ] SITC: Derivative data saved (139 records).
[2025-10-24T01:28:50.634708] [INFO ] [MAIN      ] SITC: Successfully saved derivative data.
[2025-10-24T01:28:50.640292] [INFO ] [MAIN      ] SITE: Successfully saved derivative data.
[2025-10-24T01:28:50.634254] [INFO ] [MAIN      ] SJM: Generated 139 derivative records from 50444 primary records.
[2025-10-24T01:28:50.640542] [INFO ] [MAIN      ] Derivative Progress: 1741/2164 symbols completed. SITC took 1.3s. Estimated remaining: 2m 57s. Rate: 143.2 symbols/min
[2025-10-24T01:28:50.643184] [DEBUG] [LOCAL     ] SJM: Saving derivative data.
[2025-10-24T01:28:50.643715] [INFO ] [MAIN      ] Derivative Progress: 1742/2164 symbols completed. SITE took 1.3s. Estimated remaining: 2m 57s. Rate: 143.3 symbols/min
[2025-10-24T01:28:50.643393] [INFO ] [MAIN      ] SJT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:50.644131] [INFO ] [MAIN      ] SKE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:50.661901] [DEBUG] [LOCAL     ] SJM: Derivative data saved (139 records).
[2025-10-24T01:28:50.662191] [INFO ] [MAIN      ] SJM: Successfully saved derivative data.
[2025-10-24T01:28:50.665139] [INFO ] [MAIN      ] Derivative Progress: 1743/2164 symbols completed. SJM took 1.3s. Estimated remaining: 2m 56s. Rate: 143.3 symbols/min
[2025-10-24T01:28:50.665476] [INFO ] [MAIN      ] SKIL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:50.688207] [DEBUG] [LOCAL     ] SKIL: Loaded 6988 existing records from primary storage.
[2025-10-24T01:28:50.695448] [INFO ] [MAIN      ] SKIL: Loaded 6988 primary data records.
[2025-10-24T01:28:50.759397] [DEBUG] [LOCAL     ] SJT: Loaded 22795 existing records from primary storage.
[2025-10-24T01:28:50.804706] [INFO ] [MAIN      ] SJT: Loaded 22795 primary data records.
[2025-10-24T01:28:50.987714] [DEBUG] [LOCAL     ] SKE: Loaded 37582 existing records from primary storage.
[2025-10-24T01:28:51.106834] [INFO ] [MAIN      ] SKE: Loaded 37582 primary data records.
[2025-10-24T01:28:51.688065] [DEBUG] [MAIN      ] SKIL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:51.727236] [DEBUG] [MAIN      ] SJT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:51.775362] [DEBUG] [MAIN      ] SKE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:51.824275] [INFO ] [MAIN      ] SKIL: Generated 139 derivative records from 6988 primary records.
[2025-10-24T01:28:51.827269] [DEBUG] [LOCAL     ] SKIL: Saving derivative data.
[2025-10-24T01:28:51.831276] [INFO ] [MAIN      ] SJT: Generated 139 derivative records from 22795 primary records.
[2025-10-24T01:28:51.832599] [DEBUG] [LOCAL     ] SJT: Saving derivative data.
[2025-10-24T01:28:51.847728] [DEBUG] [LOCAL     ] SKIL: Derivative data saved (139 records).
[2025-10-24T01:28:51.860713] [DEBUG] [LOCAL     ] SJT: Derivative data saved (139 records).
[2025-10-24T01:28:51.860819] [INFO ] [MAIN      ] SKIL: Successfully saved derivative data.
[2025-10-24T01:28:51.862858] [INFO ] [MAIN      ] Derivative Progress: 1744/2164 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 56s. Rate: 143.2 symbols/min
[2025-10-24T01:28:51.863398] [INFO ] [MAIN      ] SKLZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:51.862956] [INFO ] [MAIN      ] SJT: Successfully saved derivative data.
[2025-10-24T01:28:51.866868] [INFO ] [MAIN      ] Derivative Progress: 1745/2164 symbols completed. SJT took 1.2s. Estimated remaining: 2m 55s. Rate: 143.3 symbols/min
[2025-10-24T01:28:51.867131] [INFO ] [MAIN      ] SKM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:51.875835] [INFO ] [MAIN      ] SKE: Generated 139 derivative records from 37582 primary records.
[2025-10-24T01:28:51.876227] [DEBUG] [LOCAL     ] SKE: Saving derivative data.
[2025-10-24T01:28:51.892630] [DEBUG] [LOCAL     ] SKE: Derivative data saved (139 records).
[2025-10-24T01:28:51.898338] [DEBUG] [LOCAL     ] SKLZ: Loaded 11598 existing records from primary storage.
[2025-10-24T01:28:51.898527] [INFO ] [MAIN      ] SKE: Successfully saved derivative data.
[2025-10-24T01:28:51.901966] [INFO ] [MAIN      ] Derivative Progress: 1746/2164 symbols completed. SKE took 1.3s. Estimated remaining: 2m 55s. Rate: 143.3 symbols/min
[2025-10-24T01:28:51.902380] [INFO ] [MAIN      ] SKT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:51.902226] [INFO ] [MAIN      ] SKLZ: Loaded 11598 primary data records.
[2025-10-24T01:28:52.025570] [DEBUG] [LOCAL     ] SKM: Loaded 35467 existing records from primary storage.
[2025-10-24T01:28:52.036517] [INFO ] [MAIN      ] SKM: Loaded 35467 primary data records.
[2025-10-24T01:28:52.374916] [DEBUG] [LOCAL     ] SKT: Loaded 42521 existing records from primary storage.
[2025-10-24T01:28:52.392408] [INFO ] [MAIN      ] SKT: Loaded 42521 primary data records.
[2025-10-24T01:28:52.863675] [DEBUG] [MAIN      ] SKLZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:52.895813] [DEBUG] [MAIN      ] SKM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:52.947191] [DEBUG] [MAIN      ] SKT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:52.973309] [INFO ] [MAIN      ] SKLZ: Generated 139 derivative records from 11598 primary records.
[2025-10-24T01:28:52.978823] [DEBUG] [LOCAL     ] SKLZ: Saving derivative data.
[2025-10-24T01:28:52.992155] [DEBUG] [LOCAL     ] SKLZ: Derivative data saved (139 records).
[2025-10-24T01:28:52.994933] [INFO ] [MAIN      ] SKM: Generated 139 derivative records from 35467 primary records.
[2025-10-24T01:28:52.995120] [INFO ] [MAIN      ] SKLZ: Successfully saved derivative data.
[2025-10-24T01:28:52.999934] [INFO ] [MAIN      ] Derivative Progress: 1747/2164 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 55s. Rate: 143.2 symbols/min
[2025-10-24T01:28:53.000288] [INFO ] [MAIN      ] SKY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:52.997674] [DEBUG] [LOCAL     ] SKM: Saving derivative data.
[2025-10-24T01:28:53.016439] [DEBUG] [LOCAL     ] SKM: Derivative data saved (139 records).
[2025-10-24T01:28:53.017032] [INFO ] [MAIN      ] SKM: Successfully saved derivative data.
[2025-10-24T01:28:53.022364] [INFO ] [MAIN      ] Derivative Progress: 1748/2164 symbols completed. SKM took 1.2s. Estimated remaining: 2m 54s. Rate: 143.3 symbols/min
[2025-10-24T01:28:53.022738] [INFO ] [MAIN      ] SKYH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:53.030051] [INFO ] [MAIN      ] SKT: Generated 139 derivative records from 42521 primary records.
[2025-10-24T01:28:53.030467] [DEBUG] [LOCAL     ] SKT: Saving derivative data.
[2025-10-24T01:28:53.055835] [DEBUG] [LOCAL     ] SKT: Derivative data saved (139 records).
[2025-10-24T01:28:53.056023] [INFO ] [MAIN      ] SKT: Successfully saved derivative data.
[2025-10-24T01:28:53.058604] [INFO ] [MAIN      ] Derivative Progress: 1749/2164 symbols completed. SKT took 1.2s. Estimated remaining: 2m 54s. Rate: 143.4 symbols/min
[2025-10-24T01:28:53.058949] [INFO ] [MAIN      ] SLB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:53.078503] [DEBUG] [LOCAL     ] SKYH: Loaded 15863 existing records from primary storage.
[2025-10-24T01:28:53.079621] [INFO ] [MAIN      ] SKYH: Loaded 15863 primary data records.
[2025-10-24T01:28:53.091621] [DEBUG] [LOCAL     ] SKY: Loaded 38830 existing records from primary storage.
[2025-10-24T01:28:53.117302] [INFO ] [MAIN      ] SKY: Loaded 38830 primary data records.
[2025-10-24T01:28:53.596196] [DEBUG] [LOCAL     ] SLB: Loaded 54087 existing records from primary storage.
[2025-10-24T01:28:53.623852] [INFO ] [MAIN      ] SLB: Loaded 54087 primary data records.
[2025-10-24T01:28:54.109430] [DEBUG] [MAIN      ] SKYH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:54.138288] [DEBUG] [MAIN      ] SKY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:54.188486] [DEBUG] [MAIN      ] SLB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:54.221425] [INFO ] [MAIN      ] SKYH: Generated 139 derivative records from 15863 primary records.
[2025-10-24T01:28:54.224784] [DEBUG] [LOCAL     ] SKYH: Saving derivative data.
[2025-10-24T01:28:54.245344] [DEBUG] [LOCAL     ] SKYH: Derivative data saved (139 records).
[2025-10-24T01:28:54.245501] [INFO ] [MAIN      ] SKYH: Successfully saved derivative data.
[2025-10-24T01:28:54.249958] [INFO ] [MAIN      ] Derivative Progress: 1750/2164 symbols completed. SKYH took 1.2s. Estimated remaining: 2m 53s. Rate: 143.2 symbols/min
[2025-10-24T01:28:54.250505] [INFO ] [MAIN      ] SKY: Generated 139 derivative records from 38830 primary records.
[2025-10-24T01:28:54.252182] [INFO ] [MAIN      ] SLF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:54.252312] [DEBUG] [LOCAL     ] SKY: Saving derivative data.
[2025-10-24T01:28:54.275870] [DEBUG] [LOCAL     ] SKY: Derivative data saved (139 records).
[2025-10-24T01:28:54.278062] [INFO ] [MAIN      ] SKY: Successfully saved derivative data.
[2025-10-24T01:28:54.280690] [INFO ] [MAIN      ] Derivative Progress: 1751/2164 symbols completed. SKY took 1.3s. Estimated remaining: 2m 53s. Rate: 143.3 symbols/min
[2025-10-24T01:28:54.281145] [INFO ] [MAIN      ] SLG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:54.280925] [INFO ] [MAIN      ] SLB: Generated 139 derivative records from 54087 primary records.
[2025-10-24T01:28:54.281520] [DEBUG] [LOCAL     ] SLB: Saving derivative data.
[2025-10-24T01:28:54.295922] [DEBUG] [LOCAL     ] SLB: Derivative data saved (139 records).
[2025-10-24T01:28:54.296191] [INFO ] [MAIN      ] SLB: Successfully saved derivative data.
[2025-10-24T01:28:54.299313] [INFO ] [MAIN      ] Derivative Progress: 1752/2164 symbols completed. SLB took 1.2s. Estimated remaining: 2m 52s. Rate: 143.4 symbols/min
[2025-10-24T01:28:54.299681] [INFO ] [MAIN      ] SLGN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:54.328535] [DEBUG] [LOCAL     ] SLF: Loaded 38557 existing records from primary storage.
[2025-10-24T01:28:54.328827] [INFO ] [MAIN      ] SLF: Loaded 38557 primary data records.
[2025-10-24T01:28:54.668558] [DEBUG] [LOCAL     ] SLG: Loaded 46144 existing records from primary storage.
[2025-10-24T01:28:54.670255] [INFO ] [MAIN      ] SLG: Loaded 46144 primary data records.
[2025-10-24T01:28:54.670071] [DEBUG] [LOCAL     ] SLGN: Loaded 41337 existing records from primary storage.
[2025-10-24T01:28:54.670565] [INFO ] [MAIN      ] SLGN: Loaded 41337 primary data records.
[2025-10-24T01:28:55.330967] [DEBUG] [MAIN      ] SLF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:55.395148] [DEBUG] [MAIN      ] SLGN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:55.397168] [INFO ] [MAIN      ] SLF: Generated 139 derivative records from 38557 primary records.
[2025-10-24T01:28:55.425019] [DEBUG] [LOCAL     ] SLF: Saving derivative data.
[2025-10-24T01:28:55.425375] [DEBUG] [MAIN      ] SLG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:55.457466] [DEBUG] [LOCAL     ] SLF: Derivative data saved (139 records).
[2025-10-24T01:28:55.459024] [INFO ] [MAIN      ] SLF: Successfully saved derivative data.
[2025-10-24T01:28:55.464339] [INFO ] [MAIN      ] Derivative Progress: 1753/2164 symbols completed. SLF took 1.2s. Estimated remaining: 2m 52s. Rate: 143.2 symbols/min
[2025-10-24T01:28:55.497997] [INFO ] [MAIN      ] SLGN: Generated 139 derivative records from 41337 primary records.
[2025-10-24T01:28:55.500351] [INFO ] [MAIN      ] SLG: Generated 139 derivative records from 46144 primary records.
[2025-10-24T01:28:55.500457] [DEBUG] [LOCAL     ] SLGN: Saving derivative data.
[2025-10-24T01:28:55.500636] [DEBUG] [LOCAL     ] SLG: Saving derivative data.
[2025-10-24T01:28:55.525605] [DEBUG] [LOCAL     ] SLGN: Derivative data saved (139 records).
[2025-10-24T01:28:55.525674] [DEBUG] [LOCAL     ] SLG: Derivative data saved (139 records).
[2025-10-24T01:28:55.525835] [INFO ] [MAIN      ] SLGN: Successfully saved derivative data.
[2025-10-24T01:28:55.525957] [INFO ] [MAIN      ] SLG: Successfully saved derivative data.
[2025-10-24T01:28:55.529598] [INFO ] [MAIN      ] Derivative Progress: 1754/2164 symbols completed. SLG took 1.2s. Estimated remaining: 2m 52s. Rate: 143.3 symbols/min
[2025-10-24T01:28:55.533230] [INFO ] [MAIN      ] Derivative Progress: 1755/2164 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 51s. Rate: 143.4 symbols/min
[2025-10-24T01:28:55.533789] [INFO ] [MAIN      ] SLQT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:55.533841] [INFO ] [MAIN      ] SLVM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:55.533908] [INFO ] [MAIN      ] SM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:55.567220] [DEBUG] [LOCAL     ] SLVM: Loaded 27918 existing records from primary storage.
[2025-10-24T01:28:55.567386] [INFO ] [MAIN      ] SLVM: Loaded 27918 primary data records.
[2025-10-24T01:28:55.745284] [DEBUG] [LOCAL     ] SLQT: Loaded 43671 existing records from primary storage.
[2025-10-24T01:28:55.782052] [INFO ] [MAIN      ] SLQT: Loaded 43671 primary data records.
[2025-10-24T01:28:55.806993] [DEBUG] [LOCAL     ] SM: Loaded 52743 existing records from primary storage.
[2025-10-24T01:28:55.843960] [INFO ] [MAIN      ] SM: Loaded 52743 primary data records.
[2025-10-24T01:28:56.579846] [DEBUG] [MAIN      ] SLVM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:56.626774] [INFO ] [MAIN      ] SLVM: Generated 139 derivative records from 27918 primary records.
[2025-10-24T01:28:56.652209] [DEBUG] [MAIN      ] SM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:56.652480] [DEBUG] [LOCAL     ] SLVM: Saving derivative data.
[2025-10-24T01:28:56.652907] [DEBUG] [MAIN      ] SLQT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:56.698363] [DEBUG] [LOCAL     ] SLVM: Derivative data saved (139 records).
[2025-10-24T01:28:56.701301] [INFO ] [MAIN      ] SLVM: Successfully saved derivative data.
[2025-10-24T01:28:56.707515] [INFO ] [MAIN      ] Derivative Progress: 1756/2164 symbols completed. SLVM took 1.2s. Estimated remaining: 2m 51s. Rate: 143.2 symbols/min
[2025-10-24T01:28:56.708491] [INFO ] [MAIN      ] SMBK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:56.739453] [DEBUG] [LOCAL     ] SMBK: Loaded 8331 existing records from primary storage.
[2025-10-24T01:28:56.742552] [INFO ] [MAIN      ] SMBK: Loaded 8331 primary data records.
[2025-10-24T01:28:56.757459] [INFO ] [MAIN      ] SLQT: Generated 139 derivative records from 43671 primary records.
[2025-10-24T01:28:56.782088] [DEBUG] [LOCAL     ] SLQT: Saving derivative data.
[2025-10-24T01:28:56.886256] [INFO ] [MAIN      ] SM: Generated 139 derivative records from 52743 primary records.
[2025-10-24T01:28:56.899071] [DEBUG] [LOCAL     ] SLQT: Derivative data saved (139 records).
[2025-10-24T01:28:56.924069] [INFO ] [MAIN      ] SLQT: Successfully saved derivative data.
[2025-10-24T01:28:56.924200] [DEBUG] [LOCAL     ] SM: Saving derivative data.
[2025-10-24T01:28:56.929250] [INFO ] [MAIN      ] Derivative Progress: 1757/2164 symbols completed. SLQT took 1.4s. Estimated remaining: 2m 50s. Rate: 143.3 symbols/min
[2025-10-24T01:28:56.939244] [INFO ] [MAIN      ] SMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:56.980077] [DEBUG] [LOCAL     ] SM: Derivative data saved (139 records).
[2025-10-24T01:28:57.098084] [INFO ] [MAIN      ] SM: Successfully saved derivative data.
[2025-10-24T01:28:57.101878] [INFO ] [MAIN      ] Derivative Progress: 1758/2164 symbols completed. SM took 1.6s. Estimated remaining: 2m 50s. Rate: 143.3 symbols/min
[2025-10-24T01:28:57.102251] [INFO ] [MAIN      ] SMFG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:57.115505] [DEBUG] [LOCAL     ] SMC: Loaded 10961 existing records from primary storage.
[2025-10-24T01:28:57.115828] [INFO ] [MAIN      ] SMC: Loaded 10961 primary data records.
[2025-10-24T01:28:57.448913] [DEBUG] [LOCAL     ] SMFG: Loaded 48644 existing records from primary storage.
[2025-10-24T01:28:57.449215] [INFO ] [MAIN      ] SMFG: Loaded 48644 primary data records.
[2025-10-24T01:28:57.483714] [DEBUG] [MAIN      ] SMBK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:57.865021] [INFO ] [MAIN      ] SMBK: Generated 139 derivative records from 8331 primary records.
[2025-10-24T01:28:57.863847] [DEBUG] [MAIN      ] SMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:57.875706] [DEBUG] [LOCAL     ] SMBK: Saving derivative data.
[2025-10-24T01:28:57.896771] [DEBUG] [LOCAL     ] SMBK: Derivative data saved (139 records).
[2025-10-24T01:28:57.899102] [INFO ] [MAIN      ] SMBK: Successfully saved derivative data.
[2025-10-24T01:28:57.901547] [INFO ] [MAIN      ] Derivative Progress: 1759/2164 symbols completed. SMBK took 1.2s. Estimated remaining: 2m 50s. Rate: 143.2 symbols/min
[2025-10-24T01:28:57.901757] [INFO ] [MAIN      ] SMG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:57.925720] [DEBUG] [MAIN      ] SMFG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:57.954524] [INFO ] [MAIN      ] SMC: Generated 139 derivative records from 10961 primary records.
[2025-10-24T01:28:57.955955] [DEBUG] [LOCAL     ] SMC: Saving derivative data.
[2025-10-24T01:28:57.983845] [DEBUG] [LOCAL     ] SMC: Derivative data saved (139 records).
[2025-10-24T01:28:57.988183] [INFO ] [MAIN      ] SMC: Successfully saved derivative data.
[2025-10-24T01:28:58.002238] [INFO ] [MAIN      ] Derivative Progress: 1760/2164 symbols completed. SMC took 1.1s. Estimated remaining: 2m 49s. Rate: 143.3 symbols/min
[2025-10-24T01:28:58.004874] [DEBUG] [LOCAL     ] SMG: Loaded 42957 existing records from primary storage.
[2025-10-24T01:28:58.005920] [INFO ] [MAIN      ] SMHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:58.005985] [INFO ] [MAIN      ] SMG: Loaded 42957 primary data records.
[2025-10-24T01:28:58.103927] [INFO ] [MAIN      ] SMFG: Generated 139 derivative records from 48644 primary records.
[2025-10-24T01:28:58.120929] [DEBUG] [LOCAL     ] SMFG: Saving derivative data.
[2025-10-24T01:28:58.165488] [DEBUG] [LOCAL     ] SMHI: Loaded 12718 existing records from primary storage.
[2025-10-24T01:28:58.326167] [INFO ] [MAIN      ] SMHI: Loaded 12718 primary data records.
[2025-10-24T01:28:58.330021] [DEBUG] [LOCAL     ] SMFG: Derivative data saved (139 records).
[2025-10-24T01:28:58.330425] [INFO ] [MAIN      ] SMFG: Successfully saved derivative data.
[2025-10-24T01:28:58.379077] [INFO ] [MAIN      ] Derivative Progress: 1761/2164 symbols completed. SMFG took 1.3s. Estimated remaining: 2m 49s. Rate: 143.3 symbols/min
[2025-10-24T01:28:58.402384] [INFO ] [MAIN      ] SMP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:58.658172] [DEBUG] [LOCAL     ] SMP: Loaded 18750 existing records from primary storage.
[2025-10-24T01:28:58.658436] [INFO ] [MAIN      ] SMP: Loaded 18750 primary data records.
[2025-10-24T01:28:58.818560] [DEBUG] [MAIN      ] SMG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:59.014890] [DEBUG] [MAIN      ] SMHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:59.072284] [DEBUG] [MAIN      ] SMP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:28:59.072676] [INFO ] [MAIN      ] SMG: Generated 139 derivative records from 42957 primary records.
[2025-10-24T01:28:59.075709] [DEBUG] [LOCAL     ] SMG: Saving derivative data.
[2025-10-24T01:28:59.106957] [DEBUG] [LOCAL     ] SMG: Derivative data saved (139 records).
[2025-10-24T01:28:59.104444] [INFO ] [MAIN      ] SMHI: Generated 139 derivative records from 12718 primary records.
[2025-10-24T01:28:59.107247] [INFO ] [MAIN      ] SMG: Successfully saved derivative data.
[2025-10-24T01:28:59.107154] [DEBUG] [LOCAL     ] SMHI: Saving derivative data.
[2025-10-24T01:28:59.110353] [INFO ] [MAIN      ] Derivative Progress: 1762/2164 symbols completed. SMG took 1.2s. Estimated remaining: 2m 48s. Rate: 143.2 symbols/min
[2025-10-24T01:28:59.111202] [INFO ] [MAIN      ] SMR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:59.125787] [DEBUG] [LOCAL     ] SMHI: Derivative data saved (139 records).
[2025-10-24T01:28:59.126189] [INFO ] [MAIN      ] SMHI: Successfully saved derivative data.
[2025-10-24T01:28:59.130833] [INFO ] [MAIN      ] Derivative Progress: 1763/2164 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 48s. Rate: 143.3 symbols/min
[2025-10-24T01:28:59.134409] [INFO ] [MAIN      ] SMRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:59.146249] [INFO ] [MAIN      ] SMP: Generated 139 derivative records from 18750 primary records.
[2025-10-24T01:28:59.146700] [DEBUG] [LOCAL     ] SMP: Saving derivative data.
[2025-10-24T01:28:59.161672] [DEBUG] [LOCAL     ] SMP: Derivative data saved (139 records).
[2025-10-24T01:28:59.161930] [INFO ] [MAIN      ] SMP: Successfully saved derivative data.
[2025-10-24T01:28:59.165235] [INFO ] [MAIN      ] Derivative Progress: 1764/2164 symbols completed. SMP took 0.8s. Estimated remaining: 2m 47s. Rate: 143.4 symbols/min
[2025-10-24T01:28:59.165741] [INFO ] [MAIN      ] SMWB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:28:59.211787] [DEBUG] [LOCAL     ] SMR: Loaded 54189 existing records from primary storage.
[2025-10-24T01:28:59.211961] [INFO ] [MAIN      ] SMR: Loaded 54189 primary data records.
[2025-10-24T01:28:59.300806] [DEBUG] [LOCAL     ] SMRT: Loaded 44050 existing records from primary storage.
[2025-10-24T01:28:59.334899] [INFO ] [MAIN      ] SMRT: Loaded 44050 primary data records.
[2025-10-24T01:28:59.639633] [DEBUG] [LOCAL     ] SMWB: Loaded 31720 existing records from primary storage.
[2025-10-24T01:28:59.651760] [INFO ] [MAIN      ] SMWB: Loaded 31720 primary data records.
[2025-10-24T01:29:00.196022] [DEBUG] [MAIN      ] SMR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:00.244062] [DEBUG] [MAIN      ] SMRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:00.274214] [DEBUG] [MAIN      ] SMWB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:00.290608] [INFO ] [MAIN      ] SMR: Generated 139 derivative records from 54189 primary records.
[2025-10-24T01:29:00.294741] [DEBUG] [LOCAL     ] SMR: Saving derivative data.
[2025-10-24T01:29:00.314004] [DEBUG] [LOCAL     ] SMR: Derivative data saved (139 records).
[2025-10-24T01:29:00.315180] [INFO ] [MAIN      ] SMR: Successfully saved derivative data.
[2025-10-24T01:29:00.318100] [INFO ] [MAIN      ] Derivative Progress: 1765/2164 symbols completed. SMR took 1.2s. Estimated remaining: 2m 47s. Rate: 143.3 symbols/min
[2025-10-24T01:29:00.319730] [INFO ] [MAIN      ] SN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:00.340633] [INFO ] [MAIN      ] SMRT: Generated 139 derivative records from 44050 primary records.
[2025-10-24T01:29:00.342039] [DEBUG] [LOCAL     ] SMRT: Saving derivative data.
[2025-10-24T01:29:00.359439] [DEBUG] [LOCAL     ] SMRT: Derivative data saved (139 records).
[2025-10-24T01:29:00.359779] [INFO ] [MAIN      ] SMWB: Generated 139 derivative records from 31720 primary records.
[2025-10-24T01:29:00.360011] [DEBUG] [LOCAL     ] SMWB: Saving derivative data.
[2025-10-24T01:29:00.360073] [INFO ] [MAIN      ] SMRT: Successfully saved derivative data.
[2025-10-24T01:29:00.363506] [INFO ] [MAIN      ] Derivative Progress: 1766/2164 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 47s. Rate: 143.3 symbols/min
[2025-10-24T01:29:00.363801] [INFO ] [MAIN      ] SNA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:00.376128] [DEBUG] [LOCAL     ] SMWB: Derivative data saved (139 records).
[2025-10-24T01:29:00.376352] [INFO ] [MAIN      ] SMWB: Successfully saved derivative data.
[2025-10-24T01:29:00.390384] [INFO ] [MAIN      ] Derivative Progress: 1767/2164 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 46s. Rate: 143.4 symbols/min
[2025-10-24T01:29:00.390826] [INFO ] [MAIN      ] SNAP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:00.423704] [DEBUG] [LOCAL     ] SN: Loaded 50369 existing records from primary storage.
[2025-10-24T01:29:00.432551] [INFO ] [MAIN      ] SN: Loaded 50369 primary data records.
[2025-10-24T01:29:00.433615] [DEBUG] [LOCAL     ] SNA: Loaded 25908 existing records from primary storage.
[2025-10-24T01:29:00.478321] [INFO ] [MAIN      ] SNA: Loaded 25908 primary data records.
[2025-10-24T01:29:00.884156] [DEBUG] [LOCAL     ] SNAP: Loaded 54186 existing records from primary storage.
[2025-10-24T01:29:00.907089] [INFO ] [MAIN      ] SNAP: Loaded 54186 primary data records.
[2025-10-24T01:29:01.380465] [DEBUG] [MAIN      ] SN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:01.410842] [DEBUG] [MAIN      ] SNA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:01.462925] [DEBUG] [MAIN      ] SNAP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:01.494757] [INFO ] [MAIN      ] SNA: Generated 139 derivative records from 25908 primary records.
[2025-10-24T01:29:01.496340] [DEBUG] [LOCAL     ] SNA: Saving derivative data.
[2025-10-24T01:29:01.499195] [INFO ] [MAIN      ] SN: Generated 139 derivative records from 50369 primary records.
[2025-10-24T01:29:01.499959] [DEBUG] [LOCAL     ] SN: Saving derivative data.
[2025-10-24T01:29:01.525700] [DEBUG] [LOCAL     ] SN: Derivative data saved (139 records).
[2025-10-24T01:29:01.521333] [DEBUG] [LOCAL     ] SNA: Derivative data saved (139 records).
[2025-10-24T01:29:01.527160] [INFO ] [MAIN      ] SN: Successfully saved derivative data.
[2025-10-24T01:29:01.527220] [INFO ] [MAIN      ] SNA: Successfully saved derivative data.
[2025-10-24T01:29:01.532280] [INFO ] [MAIN      ] Derivative Progress: 1768/2164 symbols completed. SN took 1.2s. Estimated remaining: 2m 46s. Rate: 143.3 symbols/min
[2025-10-24T01:29:01.536379] [INFO ] [MAIN      ] Derivative Progress: 1769/2164 symbols completed. SNA took 1.2s. Estimated remaining: 2m 45s. Rate: 143.3 symbols/min
[2025-10-24T01:29:01.541076] [INFO ] [MAIN      ] SNAP: Generated 139 derivative records from 54186 primary records.
[2025-10-24T01:29:01.541180] [DEBUG] [LOCAL     ] SNAP: Saving derivative data.
[2025-10-24T01:29:01.552830] [DEBUG] [LOCAL     ] SNAP: Derivative data saved (139 records).
[2025-10-24T01:29:01.552938] [INFO ] [MAIN      ] SNAP: Successfully saved derivative data.
[2025-10-24T01:29:01.556436] [INFO ] [MAIN      ] Derivative Progress: 1770/2164 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 45s. Rate: 143.4 symbols/min
[2025-10-24T01:29:01.556903] [INFO ] [MAIN      ] SNDA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:01.556978] [INFO ] [MAIN      ] SNDR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:01.557085] [INFO ] [MAIN      ] SNN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:01.568150] [DEBUG] [LOCAL     ] SNDA: Loaded 4490 existing records from primary storage.
[2025-10-24T01:29:01.568596] [INFO ] [MAIN      ] SNDA: Loaded 4490 primary data records.
[2025-10-24T01:29:01.936150] [DEBUG] [LOCAL     ] SNDR: Loaded 41922 existing records from primary storage.
[2025-10-24T01:29:01.937021] [INFO ] [MAIN      ] SNDR: Loaded 41922 primary data records.
[2025-10-24T01:29:01.979285] [DEBUG] [LOCAL     ] SNN: Loaded 44659 existing records from primary storage.
[2025-10-24T01:29:02.010562] [INFO ] [MAIN      ] SNN: Loaded 44659 primary data records.
[2025-10-24T01:29:02.624446] [DEBUG] [MAIN      ] SNDA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:02.685761] [DEBUG] [MAIN      ] SNDR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:02.704876] [INFO ] [MAIN      ] SNDA: Generated 139 derivative records from 4490 primary records.
[2025-10-24T01:29:02.712553] [DEBUG] [LOCAL     ] SNDA: Saving derivative data.
[2025-10-24T01:29:02.738322] [DEBUG] [LOCAL     ] SNDA: Derivative data saved (139 records).
[2025-10-24T01:29:02.738711] [INFO ] [MAIN      ] SNDA: Successfully saved derivative data.
[2025-10-24T01:29:02.734439] [DEBUG] [MAIN      ] SNN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:02.763876] [INFO ] [MAIN      ] Derivative Progress: 1771/2164 symbols completed. SNDA took 1.2s. Estimated remaining: 2m 45s. Rate: 143.3 symbols/min
[2025-10-24T01:29:02.766495] [INFO ] [MAIN      ] SNOW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:02.798069] [INFO ] [MAIN      ] SNDR: Generated 139 derivative records from 41922 primary records.
[2025-10-24T01:29:02.801032] [DEBUG] [LOCAL     ] SNDR: Saving derivative data.
[2025-10-24T01:29:02.815704] [INFO ] [MAIN      ] SNN: Generated 139 derivative records from 44659 primary records.
[2025-10-24T01:29:02.817201] [DEBUG] [LOCAL     ] SNDR: Derivative data saved (139 records).
[2025-10-24T01:29:02.817540] [DEBUG] [LOCAL     ] SNN: Saving derivative data.
[2025-10-24T01:29:02.817678] [INFO ] [MAIN      ] SNDR: Successfully saved derivative data.
[2025-10-24T01:29:02.820963] [INFO ] [MAIN      ] Derivative Progress: 1772/2164 symbols completed. SNDR took 1.3s. Estimated remaining: 2m 44s. Rate: 143.3 symbols/min
[2025-10-24T01:29:02.822035] [INFO ] [MAIN      ] SNV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:02.849574] [DEBUG] [LOCAL     ] SNN: Derivative data saved (139 records).
[2025-10-24T01:29:02.849801] [INFO ] [MAIN      ] SNN: Successfully saved derivative data.
[2025-10-24T01:29:02.853823] [INFO ] [MAIN      ] Derivative Progress: 1773/2164 symbols completed. SNN took 1.3s. Estimated remaining: 2m 44s. Rate: 143.4 symbols/min
[2025-10-24T01:29:02.854211] [INFO ] [MAIN      ] SNX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:02.873357] [DEBUG] [LOCAL     ] SNOW: Loaded 53967 existing records from primary storage.
[2025-10-24T01:29:02.873810] [INFO ] [MAIN      ] SNOW: Loaded 53967 primary data records.
[2025-10-24T01:29:03.205078] [DEBUG] [LOCAL     ] SNV: Loaded 49425 existing records from primary storage.
[2025-10-24T01:29:03.205501] [INFO ] [MAIN      ] SNV: Loaded 49425 primary data records.
[2025-10-24T01:29:03.324590] [DEBUG] [LOCAL     ] SNX: Loaded 39146 existing records from primary storage.
[2025-10-24T01:29:03.337172] [INFO ] [MAIN      ] SNX: Loaded 39146 primary data records.
[2025-10-24T01:29:03.847805] [DEBUG] [MAIN      ] SNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:03.902016] [DEBUG] [MAIN      ] SNV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:03.932566] [INFO ] [MAIN      ] SNOW: Generated 139 derivative records from 53967 primary records.
[2025-10-24T01:29:03.946411] [DEBUG] [MAIN      ] SNX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:03.945953] [DEBUG] [LOCAL     ] SNOW: Saving derivative data.
[2025-10-24T01:29:03.982699] [DEBUG] [LOCAL     ] SNOW: Derivative data saved (139 records).
[2025-10-24T01:29:03.987327] [INFO ] [MAIN      ] SNOW: Successfully saved derivative data.
[2025-10-24T01:29:03.994157] [INFO ] [MAIN      ] Derivative Progress: 1774/2164 symbols completed. SNOW took 1.2s. Estimated remaining: 2m 43s. Rate: 143.3 symbols/min
[2025-10-24T01:29:03.998091] [INFO ] [MAIN      ] SO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:04.003428] [INFO ] [MAIN      ] SNV: Generated 139 derivative records from 49425 primary records.
[2025-10-24T01:29:04.006729] [DEBUG] [LOCAL     ] SNV: Saving derivative data.
[2025-10-24T01:29:04.024372] [DEBUG] [LOCAL     ] SNV: Derivative data saved (139 records).
[2025-10-24T01:29:04.028257] [INFO ] [MAIN      ] SNX: Generated 139 derivative records from 39146 primary records.
[2025-10-24T01:29:04.028465] [INFO ] [MAIN      ] SNV: Successfully saved derivative data.
[2025-10-24T01:29:04.028586] [DEBUG] [LOCAL     ] SNX: Saving derivative data.
[2025-10-24T01:29:04.032082] [INFO ] [MAIN      ] Derivative Progress: 1775/2164 symbols completed. SNV took 1.2s. Estimated remaining: 2m 43s. Rate: 143.3 symbols/min
[2025-10-24T01:29:04.032975] [INFO ] [MAIN      ] SOBO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:04.046304] [DEBUG] [LOCAL     ] SNX: Derivative data saved (139 records).
[2025-10-24T01:29:04.046556] [INFO ] [MAIN      ] SNX: Successfully saved derivative data.
[2025-10-24T01:29:04.050458] [INFO ] [MAIN      ] Derivative Progress: 1776/2164 symbols completed. SNX took 1.2s. Estimated remaining: 2m 42s. Rate: 143.4 symbols/min
[2025-10-24T01:29:04.050866] [INFO ] [MAIN      ] SOC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:04.115863] [DEBUG] [LOCAL     ] SOBO: Loaded 39668 existing records from primary storage.
[2025-10-24T01:29:04.117060] [DEBUG] [LOCAL     ] SO: Loaded 54005 existing records from primary storage.
[2025-10-24T01:29:04.117423] [INFO ] [MAIN      ] SOBO: Loaded 39668 primary data records.
[2025-10-24T01:29:04.117488] [INFO ] [MAIN      ] SO: Loaded 54005 primary data records.
[2025-10-24T01:29:04.438067] [DEBUG] [LOCAL     ] SOC: Loaded 51616 existing records from primary storage.
[2025-10-24T01:29:04.480999] [INFO ] [MAIN      ] SOC: Loaded 51616 primary data records.
[2025-10-24T01:29:05.131894] [DEBUG] [MAIN      ] SOBO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:05.137554] [DEBUG] [MAIN      ] SO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:05.217606] [DEBUG] [MAIN      ] SOC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:05.237120] [INFO ] [MAIN      ] SO: Generated 139 derivative records from 54005 primary records.
[2025-10-24T01:29:05.240928] [DEBUG] [LOCAL     ] SO: Saving derivative data.
[2025-10-24T01:29:05.253529] [INFO ] [MAIN      ] SOBO: Generated 139 derivative records from 39668 primary records.
[2025-10-24T01:29:05.260530] [DEBUG] [LOCAL     ] SO: Derivative data saved (139 records).
[2025-10-24T01:29:05.261176] [INFO ] [MAIN      ] SO: Successfully saved derivative data.
[2025-10-24T01:29:05.261284] [DEBUG] [LOCAL     ] SOBO: Saving derivative data.
[2025-10-24T01:29:05.265256] [INFO ] [MAIN      ] Derivative Progress: 1777/2164 symbols completed. SO took 1.3s. Estimated remaining: 2m 42s. Rate: 143.3 symbols/min
[2025-10-24T01:29:05.266720] [INFO ] [MAIN      ] SOJC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:05.282015] [DEBUG] [LOCAL     ] SOBO: Derivative data saved (139 records).
[2025-10-24T01:29:05.283762] [INFO ] [MAIN      ] SOBO: Successfully saved derivative data.
[2025-10-24T01:29:05.286770] [INFO ] [MAIN      ] Derivative Progress: 1778/2164 symbols completed. SOBO took 1.3s. Estimated remaining: 2m 42s. Rate: 143.3 symbols/min
[2025-10-24T01:29:05.288534] [INFO ] [MAIN      ] SOJD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:05.291878] [DEBUG] [LOCAL     ] SOJC: Loaded 4596 existing records from primary storage.
[2025-10-24T01:29:05.295178] [INFO ] [MAIN      ] SOJC: Loaded 4596 primary data records.
[2025-10-24T01:29:05.416844] [DEBUG] [LOCAL     ] SOJD: Loaded 12651 existing records from primary storage.
[2025-10-24T01:29:05.465041] [INFO ] [MAIN      ] SOJD: Loaded 12651 primary data records.
[2025-10-24T01:29:05.498111] [INFO ] [MAIN      ] SOC: Generated 139 derivative records from 51616 primary records.
[2025-10-24T01:29:05.648906] [DEBUG] [LOCAL     ] SOC: Saving derivative data.
[2025-10-24T01:29:05.728001] [DEBUG] [LOCAL     ] SOC: Derivative data saved (139 records).
[2025-10-24T01:29:05.729004] [INFO ] [MAIN      ] SOC: Successfully saved derivative data.
[2025-10-24T01:29:05.743323] [INFO ] [MAIN      ] Derivative Progress: 1779/2164 symbols completed. SOC took 1.7s. Estimated remaining: 2m 41s. Rate: 143.3 symbols/min
[2025-10-24T01:29:05.754290] [INFO ] [MAIN      ] SOJE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:05.940129] [DEBUG] [LOCAL     ] SOJE: Loaded 8744 existing records from primary storage.
[2025-10-24T01:29:05.940791] [INFO ] [MAIN      ] SOJE: Loaded 8744 primary data records.
[2025-10-24T01:29:06.128743] [DEBUG] [MAIN      ] SOJC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:06.382950] [DEBUG] [MAIN      ] SOJD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:06.411149] [INFO ] [MAIN      ] SOJC: Generated 139 derivative records from 4596 primary records.
[2025-10-24T01:29:06.414819] [DEBUG] [LOCAL     ] SOJC: Saving derivative data.
[2025-10-24T01:29:06.431379] [DEBUG] [LOCAL     ] SOJC: Derivative data saved (139 records).
[2025-10-24T01:29:06.433302] [INFO ] [MAIN      ] SOJC: Successfully saved derivative data.
[2025-10-24T01:29:06.439693] [INFO ] [MAIN      ] Derivative Progress: 1780/2164 symbols completed. SOJC took 1.2s. Estimated remaining: 2m 41s. Rate: 143.3 symbols/min
[2025-10-24T01:29:06.440121] [INFO ] [MAIN      ] SOL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:06.461852] [DEBUG] [MAIN      ] SOJE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:06.506435] [INFO ] [MAIN      ] SOJD: Generated 139 derivative records from 12651 primary records.
[2025-10-24T01:29:06.507138] [DEBUG] [LOCAL     ] SOJD: Saving derivative data.
[2025-10-24T01:29:06.508596] [DEBUG] [LOCAL     ] SOL: Loaded 13627 existing records from primary storage.
[2025-10-24T01:29:06.509575] [INFO ] [MAIN      ] SOL: Loaded 13627 primary data records.
[2025-10-24T01:29:06.575143] [DEBUG] [LOCAL     ] SOJD: Derivative data saved (139 records).
[2025-10-24T01:29:06.589164] [INFO ] [MAIN      ] SOJD: Successfully saved derivative data.
[2025-10-24T01:29:06.609782] [INFO ] [MAIN      ] Derivative Progress: 1781/2164 symbols completed. SOJD took 1.3s. Estimated remaining: 2m 40s. Rate: 143.3 symbols/min
[2025-10-24T01:29:06.622462] [INFO ] [MAIN      ] SOLV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:06.809376] [INFO ] [MAIN      ] SOJE: Generated 139 derivative records from 8744 primary records.
[2025-10-24T01:29:06.957925] [DEBUG] [LOCAL     ] SOJE: Saving derivative data.
[2025-10-24T01:29:07.005688] [DEBUG] [LOCAL     ] SOJE: Derivative data saved (139 records).
[2025-10-24T01:29:07.007172] [DEBUG] [LOCAL     ] SOLV: Loaded 43676 existing records from primary storage.
[2025-10-24T01:29:07.006126] [INFO ] [MAIN      ] SOJE: Successfully saved derivative data.
[2025-10-24T01:29:07.012739] [INFO ] [MAIN      ] Derivative Progress: 1782/2164 symbols completed. SOJE took 1.3s. Estimated remaining: 2m 40s. Rate: 143.3 symbols/min
[2025-10-24T01:29:07.012918] [INFO ] [MAIN      ] SOLV: Loaded 43676 primary data records.
[2025-10-24T01:29:07.013057] [INFO ] [MAIN      ] SON: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:07.387895] [DEBUG] [MAIN      ] SOL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:07.429738] [DEBUG] [LOCAL     ] SON: Loaded 43926 existing records from primary storage.
[2025-10-24T01:29:07.430524] [INFO ] [MAIN      ] SON: Loaded 43926 primary data records.
[2025-10-24T01:29:07.751824] [INFO ] [MAIN      ] SOL: Generated 139 derivative records from 13627 primary records.
[2025-10-24T01:29:07.757172] [DEBUG] [LOCAL     ] SOL: Saving derivative data.
[2025-10-24T01:29:07.757381] [DEBUG] [MAIN      ] SOLV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:07.786322] [DEBUG] [LOCAL     ] SOL: Derivative data saved (139 records).
[2025-10-24T01:29:07.788463] [INFO ] [MAIN      ] SOL: Successfully saved derivative data.
[2025-10-24T01:29:07.792248] [INFO ] [MAIN      ] Derivative Progress: 1783/2164 symbols completed. SOL took 1.4s. Estimated remaining: 2m 40s. Rate: 143.3 symbols/min
[2025-10-24T01:29:07.815163] [INFO ] [MAIN      ] SOLV: Generated 139 derivative records from 43676 primary records.
[2025-10-24T01:29:07.815495] [DEBUG] [LOCAL     ] SOLV: Saving derivative data.
[2025-10-24T01:29:07.828762] [DEBUG] [MAIN      ] SON: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:07.854176] [DEBUG] [LOCAL     ] SOLV: Derivative data saved (139 records).
[2025-10-24T01:29:07.854920] [INFO ] [MAIN      ] SOLV: Successfully saved derivative data.
[2025-10-24T01:29:07.859773] [INFO ] [MAIN      ] Derivative Progress: 1784/2164 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 39s. Rate: 143.3 symbols/min
[2025-10-24T01:29:07.875784] [INFO ] [MAIN      ] SON: Generated 139 derivative records from 43926 primary records.
[2025-10-24T01:29:07.876049] [DEBUG] [LOCAL     ] SON: Saving derivative data.
[2025-10-24T01:29:07.889680] [DEBUG] [LOCAL     ] SON: Derivative data saved (139 records).
[2025-10-24T01:29:07.889891] [INFO ] [MAIN      ] SON: Successfully saved derivative data.
[2025-10-24T01:29:07.894981] [INFO ] [MAIN      ] Derivative Progress: 1785/2164 symbols completed. SON took 0.9s. Estimated remaining: 2m 39s. Rate: 143.4 symbols/min
[2025-10-24T01:29:07.895612] [INFO ] [MAIN      ] SONY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:07.895697] [INFO ] [MAIN      ] SOR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:07.895780] [INFO ] [MAIN      ] SOS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:07.903628] [DEBUG] [LOCAL     ] SOR: Loaded 2831 existing records from primary storage.
[2025-10-24T01:29:07.904045] [INFO ] [MAIN      ] SOR: Loaded 2831 primary data records.
[2025-10-24T01:29:07.998090] [DEBUG] [LOCAL     ] SOS: Loaded 9744 existing records from primary storage.
[2025-10-24T01:29:08.014184] [INFO ] [MAIN      ] SOS: Loaded 9744 primary data records.
[2025-10-24T01:29:08.608876] [DEBUG] [LOCAL     ] SONY: Loaded 53765 existing records from primary storage.
[2025-10-24T01:29:08.615025] [INFO ] [MAIN      ] SONY: Loaded 53765 primary data records.
[2025-10-24T01:29:08.839611] [DEBUG] [MAIN      ] SOR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:09.014205] [DEBUG] [MAIN      ] SOS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:09.050594] [INFO ] [MAIN      ] SOR: Generated 139 derivative records from 2831 primary records.
[2025-10-24T01:29:09.064369] [DEBUG] [LOCAL     ] SOR: Saving derivative data.
[2025-10-24T01:29:09.064845] [DEBUG] [MAIN      ] SONY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:09.093276] [DEBUG] [LOCAL     ] SOR: Derivative data saved (139 records).
[2025-10-24T01:29:09.097241] [INFO ] [MAIN      ] SOR: Successfully saved derivative data.
[2025-10-24T01:29:09.102075] [INFO ] [MAIN      ] Derivative Progress: 1786/2164 symbols completed. SOR took 1.2s. Estimated remaining: 2m 38s. Rate: 143.3 symbols/min
[2025-10-24T01:29:09.106372] [INFO ] [MAIN      ] SPB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:09.135605] [INFO ] [MAIN      ] SOS: Generated 139 derivative records from 9744 primary records.
[2025-10-24T01:29:09.137127] [DEBUG] [LOCAL     ] SOS: Saving derivative data.
[2025-10-24T01:29:09.154630] [DEBUG] [LOCAL     ] SOS: Derivative data saved (139 records).
[2025-10-24T01:29:09.155298] [INFO ] [MAIN      ] SOS: Successfully saved derivative data.
[2025-10-24T01:29:09.167893] [INFO ] [MAIN      ] SONY: Generated 139 derivative records from 53765 primary records.
[2025-10-24T01:29:09.172419] [INFO ] [MAIN      ] Derivative Progress: 1787/2164 symbols completed. SOS took 1.3s. Estimated remaining: 2m 38s. Rate: 143.3 symbols/min
[2025-10-24T01:29:09.173092] [INFO ] [MAIN      ] SPCE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:09.173218] [DEBUG] [LOCAL     ] SONY: Saving derivative data.
[2025-10-24T01:29:09.188139] [DEBUG] [LOCAL     ] SONY: Derivative data saved (139 records).
[2025-10-24T01:29:09.189185] [INFO ] [MAIN      ] SONY: Successfully saved derivative data.
[2025-10-24T01:29:09.192477] [INFO ] [MAIN      ] Derivative Progress: 1788/2164 symbols completed. SONY took 1.3s. Estimated remaining: 2m 37s. Rate: 143.4 symbols/min
[2025-10-24T01:29:09.192823] [INFO ] [MAIN      ] SPE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:09.210426] [DEBUG] [LOCAL     ] SPB: Loaded 34159 existing records from primary storage.
[2025-10-24T01:29:09.210919] [INFO ] [MAIN      ] SPB: Loaded 34159 primary data records.
[2025-10-24T01:29:09.291710] [DEBUG] [LOCAL     ] SPE: Loaded 6180 existing records from primary storage.
[2025-10-24T01:29:09.308206] [INFO ] [MAIN      ] SPE: Loaded 6180 primary data records.
[2025-10-24T01:29:09.680619] [DEBUG] [LOCAL     ] SPCE: Loaded 50424 existing records from primary storage.
[2025-10-24T01:29:09.698608] [INFO ] [MAIN      ] SPCE: Loaded 50424 primary data records.
[2025-10-24T01:29:10.234781] [DEBUG] [MAIN      ] SPB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:10.280010] [DEBUG] [MAIN      ] SPE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:10.318508] [INFO ] [MAIN      ] SPB: Generated 139 derivative records from 34159 primary records.
[2025-10-24T01:29:10.318733] [DEBUG] [LOCAL     ] SPB: Saving derivative data.
[2025-10-24T01:29:10.334849] [DEBUG] [MAIN      ] SPCE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:10.347167] [DEBUG] [LOCAL     ] SPB: Derivative data saved (139 records).
[2025-10-24T01:29:10.364746] [INFO ] [MAIN      ] SPB: Successfully saved derivative data.
[2025-10-24T01:29:10.368186] [INFO ] [MAIN      ] Derivative Progress: 1789/2164 symbols completed. SPB took 1.3s. Estimated remaining: 2m 37s. Rate: 143.3 symbols/min
[2025-10-24T01:29:10.369695] [INFO ] [MAIN      ] SPG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:10.387861] [INFO ] [MAIN      ] SPE: Generated 139 derivative records from 6180 primary records.
[2025-10-24T01:29:10.388344] [DEBUG] [LOCAL     ] SPE: Saving derivative data.
[2025-10-24T01:29:10.406837] [DEBUG] [LOCAL     ] SPE: Derivative data saved (139 records).
[2025-10-24T01:29:10.408591] [INFO ] [MAIN      ] SPE: Successfully saved derivative data.
[2025-10-24T01:29:10.411441] [INFO ] [MAIN      ] Derivative Progress: 1790/2164 symbols completed. SPE took 1.2s. Estimated remaining: 2m 37s. Rate: 143.3 symbols/min
[2025-10-24T01:29:10.408986] [INFO ] [MAIN      ] SPCE: Generated 139 derivative records from 50424 primary records.
[2025-10-24T01:29:10.411700] [INFO ] [MAIN      ] SPGI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:10.411775] [DEBUG] [LOCAL     ] SPCE: Saving derivative data.
[2025-10-24T01:29:10.437211] [DEBUG] [LOCAL     ] SPCE: Derivative data saved (139 records).
[2025-10-24T01:29:10.437394] [INFO ] [MAIN      ] SPCE: Successfully saved derivative data.
[2025-10-24T01:29:10.440828] [INFO ] [MAIN      ] Derivative Progress: 1791/2164 symbols completed. SPCE took 1.3s. Estimated remaining: 2m 36s. Rate: 143.4 symbols/min
[2025-10-24T01:29:10.441044] [INFO ] [MAIN      ] SPH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:10.462606] [DEBUG] [LOCAL     ] SPG: Loaded 50304 existing records from primary storage.
[2025-10-24T01:29:10.462920] [INFO ] [MAIN      ] SPG: Loaded 50304 primary data records.
[2025-10-24T01:29:10.568551] [DEBUG] [LOCAL     ] SPH: Loaded 16559 existing records from primary storage.
[2025-10-24T01:29:10.585692] [INFO ] [MAIN      ] SPH: Loaded 16559 primary data records.
[2025-10-24T01:29:10.990225] [DEBUG] [LOCAL     ] SPGI: Loaded 46248 existing records from primary storage.
[2025-10-24T01:29:10.996978] [INFO ] [MAIN      ] SPGI: Loaded 46248 primary data records.
[2025-10-24T01:29:11.540638] [DEBUG] [MAIN      ] SPG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:11.572000] [DEBUG] [MAIN      ] SPH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:11.616843] [DEBUG] [MAIN      ] SPGI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:11.663893] [INFO ] [MAIN      ] SPG: Generated 139 derivative records from 50304 primary records.
[2025-10-24T01:29:11.669633] [DEBUG] [LOCAL     ] SPG: Saving derivative data.
[2025-10-24T01:29:11.691188] [INFO ] [MAIN      ] SPH: Generated 139 derivative records from 16559 primary records.
[2025-10-24T01:29:11.688767] [DEBUG] [LOCAL     ] SPG: Derivative data saved (139 records).
[2025-10-24T01:29:11.693838] [INFO ] [MAIN      ] SPG: Successfully saved derivative data.
[2025-10-24T01:29:11.693908] [DEBUG] [LOCAL     ] SPH: Saving derivative data.
[2025-10-24T01:29:11.698334] [INFO ] [MAIN      ] Derivative Progress: 1792/2164 symbols completed. SPG took 1.3s. Estimated remaining: 2m 36s. Rate: 143.2 symbols/min
[2025-10-24T01:29:11.701541] [INFO ] [MAIN      ] SPHR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:11.715514] [DEBUG] [LOCAL     ] SPH: Derivative data saved (139 records).
[2025-10-24T01:29:11.719797] [INFO ] [MAIN      ] SPH: Successfully saved derivative data.
[2025-10-24T01:29:11.725286] [INFO ] [MAIN      ] Derivative Progress: 1793/2164 symbols completed. SPH took 1.3s. Estimated remaining: 2m 35s. Rate: 143.3 symbols/min
[2025-10-24T01:29:11.728866] [INFO ] [MAIN      ] SPIR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:11.729936] [INFO ] [MAIN      ] SPGI: Generated 139 derivative records from 46248 primary records.
[2025-10-24T01:29:11.730118] [DEBUG] [LOCAL     ] SPGI: Saving derivative data.
[2025-10-24T01:29:11.746749] [DEBUG] [LOCAL     ] SPGI: Derivative data saved (139 records).
[2025-10-24T01:29:11.747059] [INFO ] [MAIN      ] SPGI: Successfully saved derivative data.
[2025-10-24T01:29:11.750575] [INFO ] [MAIN      ] Derivative Progress: 1794/2164 symbols completed. SPGI took 1.3s. Estimated remaining: 2m 35s. Rate: 143.4 symbols/min
[2025-10-24T01:29:11.760804] [INFO ] [MAIN      ] SPMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:11.797521] [DEBUG] [LOCAL     ] SPMC: Loaded 5288 existing records from primary storage.
[2025-10-24T01:29:11.797889] [INFO ] [MAIN      ] SPMC: Loaded 5288 primary data records.
[2025-10-24T01:29:11.805060] [DEBUG] [LOCAL     ] SPHR: Loaded 40951 existing records from primary storage.
[2025-10-24T01:29:11.854476] [INFO ] [MAIN      ] SPHR: Loaded 40951 primary data records.
[2025-10-24T01:29:12.004811] [DEBUG] [LOCAL     ] SPIR: Loaded 37729 existing records from primary storage.
[2025-10-24T01:29:12.030289] [INFO ] [MAIN      ] SPIR: Loaded 37729 primary data records.
[2025-10-24T01:29:12.847738] [DEBUG] [MAIN      ] SPMC: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:12.876839] [DEBUG] [MAIN      ] SPHR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:12.926849] [DEBUG] [MAIN      ] SPIR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:12.973118] [INFO ] [MAIN      ] SPMC: Generated 139 derivative records from 5288 primary records.
[2025-10-24T01:29:12.979086] [INFO ] [MAIN      ] SPHR: Generated 139 derivative records from 40951 primary records.
[2025-10-24T01:29:12.974001] [DEBUG] [LOCAL     ] SPMC: Saving derivative data.
[2025-10-24T01:29:12.979790] [DEBUG] [LOCAL     ] SPHR: Saving derivative data.
[2025-10-24T01:29:13.007392] [DEBUG] [LOCAL     ] SPHR: Derivative data saved (139 records).
[2025-10-24T01:29:13.010312] [INFO ] [MAIN      ] SPHR: Successfully saved derivative data.
[2025-10-24T01:29:13.003932] [DEBUG] [LOCAL     ] SPMC: Derivative data saved (139 records).
[2025-10-24T01:29:13.014782] [INFO ] [MAIN      ] Derivative Progress: 1795/2164 symbols completed. SPHR took 1.3s. Estimated remaining: 2m 35s. Rate: 143.2 symbols/min
[2025-10-24T01:29:13.010949] [INFO ] [MAIN      ] SPMC: Successfully saved derivative data.
[2025-10-24T01:29:13.019821] [INFO ] [MAIN      ] Derivative Progress: 1796/2164 symbols completed. SPMC took 1.3s. Estimated remaining: 2m 34s. Rate: 143.3 symbols/min
[2025-10-24T01:29:13.019596] [INFO ] [MAIN      ] SPNT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:13.020828] [INFO ] [MAIN      ] SPOT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:13.029056] [INFO ] [MAIN      ] SPIR: Generated 139 derivative records from 37729 primary records.
[2025-10-24T01:29:13.029283] [DEBUG] [LOCAL     ] SPIR: Saving derivative data.
[2025-10-24T01:29:13.042920] [DEBUG] [LOCAL     ] SPIR: Derivative data saved (139 records).
[2025-10-24T01:29:13.044004] [INFO ] [MAIN      ] SPIR: Successfully saved derivative data.
[2025-10-24T01:29:13.049056] [INFO ] [MAIN      ] Derivative Progress: 1797/2164 symbols completed. SPIR took 1.3s. Estimated remaining: 2m 34s. Rate: 143.4 symbols/min
[2025-10-24T01:29:13.049469] [INFO ] [MAIN      ] SPR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:13.093740] [DEBUG] [LOCAL     ] SPNT: Loaded 34415 existing records from primary storage.
[2025-10-24T01:29:13.094755] [INFO ] [MAIN      ] SPNT: Loaded 34415 primary data records.
[2025-10-24T01:29:13.226567] [DEBUG] [LOCAL     ] SPOT: Loaded 50537 existing records from primary storage.
[2025-10-24T01:29:13.260443] [INFO ] [MAIN      ] SPOT: Loaded 50537 primary data records.
[2025-10-24T01:29:13.306277] [DEBUG] [LOCAL     ] SPR: Loaded 40937 existing records from primary storage.
[2025-10-24T01:29:13.370872] [INFO ] [MAIN      ] SPR: Loaded 40937 primary data records.
[2025-10-24T01:29:14.084254] [DEBUG] [MAIN      ] SPNT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:14.123505] [DEBUG] [MAIN      ] SPOT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:14.172372] [DEBUG] [MAIN      ] SPR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:14.209886] [INFO ] [MAIN      ] SPNT: Generated 139 derivative records from 34415 primary records.
[2025-10-24T01:29:14.214523] [DEBUG] [LOCAL     ] SPNT: Saving derivative data.
[2025-10-24T01:29:14.230437] [DEBUG] [LOCAL     ] SPNT: Derivative data saved (139 records).
[2025-10-24T01:29:14.230857] [INFO ] [MAIN      ] SPNT: Successfully saved derivative data.
[2025-10-24T01:29:14.238784] [INFO ] [MAIN      ] Derivative Progress: 1798/2164 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 33s. Rate: 143.2 symbols/min
[2025-10-24T01:29:14.246102] [INFO ] [MAIN      ] SPOT: Generated 139 derivative records from 50537 primary records.
[2025-10-24T01:29:14.247487] [DEBUG] [LOCAL     ] SPOT: Saving derivative data.
[2025-10-24T01:29:14.250220] [INFO ] [MAIN      ] SPR: Generated 139 derivative records from 40937 primary records.
[2025-10-24T01:29:14.260756] [DEBUG] [LOCAL     ] SPR: Saving derivative data.
[2025-10-24T01:29:14.263005] [DEBUG] [LOCAL     ] SPOT: Derivative data saved (139 records).
[2025-10-24T01:29:14.263127] [INFO ] [MAIN      ] SPOT: Successfully saved derivative data.
[2025-10-24T01:29:14.266364] [INFO ] [MAIN      ] Derivative Progress: 1799/2164 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 33s. Rate: 143.3 symbols/min
[2025-10-24T01:29:14.277765] [DEBUG] [LOCAL     ] SPR: Derivative data saved (139 records).
[2025-10-24T01:29:14.277881] [INFO ] [MAIN      ] SPR: Successfully saved derivative data.
[2025-10-24T01:29:14.281582] [INFO ] [MAIN      ] Derivative Progress: 1800/2164 symbols completed. SPR took 1.2s. Estimated remaining: 2m 32s. Rate: 143.4 symbols/min
[2025-10-24T01:29:14.282012] [INFO ] [MAIN      ] SPRU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:14.282323] [INFO ] [MAIN      ] SPXC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:14.282195] [INFO ] [MAIN      ] SPXX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:14.303939] [DEBUG] [LOCAL     ] SPXX: Loaded 9189 existing records from primary storage.
[2025-10-24T01:29:14.304288] [INFO ] [MAIN      ] SPXX: Loaded 9189 primary data records.
[2025-10-24T01:29:14.309406] [DEBUG] [LOCAL     ] SPRU: Loaded 10031 existing records from primary storage.
[2025-10-24T01:29:14.330102] [INFO ] [MAIN      ] SPRU: Loaded 10031 primary data records.
[2025-10-24T01:29:14.371748] [DEBUG] [LOCAL     ] SPXC: Loaded 23294 existing records from primary storage.
[2025-10-24T01:29:14.414179] [INFO ] [MAIN      ] SPXC: Loaded 23294 primary data records.
[2025-10-24T01:29:15.305628] [DEBUG] [MAIN      ] SPRU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:15.344832] [DEBUG] [MAIN      ] SPXX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:15.371271] [DEBUG] [MAIN      ] SPXC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:15.426352] [INFO ] [MAIN      ] SPRU: Generated 139 derivative records from 10031 primary records.
[2025-10-24T01:29:15.429859] [DEBUG] [LOCAL     ] SPRU: Saving derivative data.
[2025-10-24T01:29:15.447201] [DEBUG] [LOCAL     ] SPRU: Derivative data saved (139 records).
[2025-10-24T01:29:15.451166] [INFO ] [MAIN      ] SPRU: Successfully saved derivative data.
[2025-10-24T01:29:15.454073] [INFO ] [MAIN      ] Derivative Progress: 1801/2164 symbols completed. SPRU took 1.2s. Estimated remaining: 2m 32s. Rate: 143.2 symbols/min
[2025-10-24T01:29:15.454317] [INFO ] [MAIN      ] SQM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:15.465233] [INFO ] [MAIN      ] SPXC: Generated 139 derivative records from 23294 primary records.
[2025-10-24T01:29:15.465586] [INFO ] [MAIN      ] SPXX: Generated 139 derivative records from 9189 primary records.
[2025-10-24T01:29:15.465927] [DEBUG] [LOCAL     ] SPXC: Saving derivative data.
[2025-10-24T01:29:15.465840] [DEBUG] [LOCAL     ] SPXX: Saving derivative data.
[2025-10-24T01:29:15.489934] [DEBUG] [LOCAL     ] SPXX: Derivative data saved (139 records).
[2025-10-24T01:29:15.490224] [INFO ] [MAIN      ] SPXX: Successfully saved derivative data.
[2025-10-24T01:29:15.494226] [INFO ] [MAIN      ] Derivative Progress: 1802/2164 symbols completed. SPXX took 1.2s. Estimated remaining: 2m 32s. Rate: 143.3 symbols/min
[2025-10-24T01:29:15.495515] [INFO ] [MAIN      ] SQNS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:15.496615] [DEBUG] [LOCAL     ] SPXC: Derivative data saved (139 records).
[2025-10-24T01:29:15.497265] [INFO ] [MAIN      ] SPXC: Successfully saved derivative data.
[2025-10-24T01:29:15.500591] [INFO ] [MAIN      ] Derivative Progress: 1803/2164 symbols completed. SPXC took 1.2s. Estimated remaining: 2m 31s. Rate: 143.4 symbols/min
[2025-10-24T01:29:15.500967] [INFO ] [MAIN      ] SR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:15.561852] [DEBUG] [LOCAL     ] SQNS: Loaded 28317 existing records from primary storage.
[2025-10-24T01:29:15.572410] [INFO ] [MAIN      ] SQNS: Loaded 28317 primary data records.
[2025-10-24T01:29:15.573034] [DEBUG] [LOCAL     ] SR: Loaded 32475 existing records from primary storage.
[2025-10-24T01:29:15.578633] [INFO ] [MAIN      ] SR: Loaded 32475 primary data records.
[2025-10-24T01:29:15.595764] [DEBUG] [LOCAL     ] SQM: Loaded 49265 existing records from primary storage.
[2025-10-24T01:29:15.641263] [INFO ] [MAIN      ] SQM: Loaded 49265 primary data records.
[2025-10-24T01:29:16.513087] [DEBUG] [MAIN      ] SR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:16.512833] [DEBUG] [MAIN      ] SQNS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:16.563214] [DEBUG] [MAIN      ] SQM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:16.613620] [INFO ] [MAIN      ] SQNS: Generated 139 derivative records from 28317 primary records.
[2025-10-24T01:29:16.616479] [DEBUG] [LOCAL     ] SQNS: Saving derivative data.
[2025-10-24T01:29:16.633336] [DEBUG] [LOCAL     ] SQNS: Derivative data saved (139 records).
[2025-10-24T01:29:16.633724] [INFO ] [MAIN      ] SQNS: Successfully saved derivative data.
[2025-10-24T01:29:16.636738] [INFO ] [MAIN      ] Derivative Progress: 1804/2164 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 31s. Rate: 143.3 symbols/min
[2025-10-24T01:29:16.640530] [INFO ] [MAIN      ] SRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:16.643778] [INFO ] [MAIN      ] SQM: Generated 139 derivative records from 49265 primary records.
[2025-10-24T01:29:16.643979] [DEBUG] [LOCAL     ] SQM: Saving derivative data.
[2025-10-24T01:29:16.641170] [INFO ] [MAIN      ] SR: Generated 139 derivative records from 32475 primary records.
[2025-10-24T01:29:16.644173] [DEBUG] [LOCAL     ] SR: Saving derivative data.
[2025-10-24T01:29:16.667838] [DEBUG] [LOCAL     ] SQM: Derivative data saved (139 records).
[2025-10-24T01:29:16.668392] [INFO ] [MAIN      ] SQM: Successfully saved derivative data.
[2025-10-24T01:29:16.668119] [DEBUG] [LOCAL     ] SR: Derivative data saved (139 records).
[2025-10-24T01:29:16.672594] [INFO ] [MAIN      ] Derivative Progress: 1805/2164 symbols completed. SQM took 1.2s. Estimated remaining: 2m 30s. Rate: 143.3 symbols/min
[2025-10-24T01:29:16.672850] [INFO ] [MAIN      ] SREA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:16.673432] [INFO ] [MAIN      ] SR: Successfully saved derivative data.
[2025-10-24T01:29:16.676718] [INFO ] [MAIN      ] Derivative Progress: 1806/2164 symbols completed. SR took 1.2s. Estimated remaining: 2m 30s. Rate: 143.4 symbols/min
[2025-10-24T01:29:16.677060] [INFO ] [MAIN      ] SRFM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:16.691114] [DEBUG] [LOCAL     ] SREA: Loaded 9711 existing records from primary storage.
[2025-10-24T01:29:16.691285] [INFO ] [MAIN      ] SREA: Loaded 9711 primary data records.
[2025-10-24T01:29:16.915977] [DEBUG] [LOCAL     ] SRE: Loaded 53793 existing records from primary storage.
[2025-10-24T01:29:16.933385] [INFO ] [MAIN      ] SRE: Loaded 53793 primary data records.
[2025-10-24T01:29:17.031269] [DEBUG] [LOCAL     ] SRFM: Loaded 40399 existing records from primary storage.
[2025-10-24T01:29:17.031538] [INFO ] [MAIN      ] SRFM: Loaded 40399 primary data records.
[2025-10-24T01:29:17.691806] [DEBUG] [MAIN      ] SREA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:17.749892] [DEBUG] [MAIN      ] SRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:17.759075] [INFO ] [MAIN      ] SREA: Generated 139 derivative records from 9711 primary records.
[2025-10-24T01:29:17.777595] [DEBUG] [LOCAL     ] SREA: Saving derivative data.
[2025-10-24T01:29:17.764552] [DEBUG] [MAIN      ] SRFM: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:17.807614] [DEBUG] [LOCAL     ] SREA: Derivative data saved (139 records).
[2025-10-24T01:29:17.808073] [INFO ] [MAIN      ] SREA: Successfully saved derivative data.
[2025-10-24T01:29:17.815239] [INFO ] [MAIN      ] Derivative Progress: 1807/2164 symbols completed. SREA took 1.1s. Estimated remaining: 2m 30s. Rate: 143.3 symbols/min
[2025-10-24T01:29:17.818924] [INFO ] [MAIN      ] SRG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:17.851831] [INFO ] [MAIN      ] SRE: Generated 139 derivative records from 53793 primary records.
[2025-10-24T01:29:17.852103] [DEBUG] [LOCAL     ] SRE: Saving derivative data.
[2025-10-24T01:29:17.859438] [DEBUG] [LOCAL     ] SRG: Loaded 14820 existing records from primary storage.
[2025-10-24T01:29:17.867258] [INFO ] [MAIN      ] SRG: Loaded 14820 primary data records.
[2025-10-24T01:29:17.871713] [DEBUG] [LOCAL     ] SRE: Derivative data saved (139 records).
[2025-10-24T01:29:17.909761] [INFO ] [MAIN      ] SRE: Successfully saved derivative data.
[2025-10-24T01:29:17.952741] [INFO ] [MAIN      ] SRFM: Generated 139 derivative records from 40399 primary records.
[2025-10-24T01:29:17.956599] [INFO ] [MAIN      ] Derivative Progress: 1808/2164 symbols completed. SRE took 1.3s. Estimated remaining: 2m 29s. Rate: 143.3 symbols/min
[2025-10-24T01:29:17.984414] [DEBUG] [LOCAL     ] SRFM: Saving derivative data.
[2025-10-24T01:29:18.006199] [INFO ] [MAIN      ] SRI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:18.074198] [DEBUG] [LOCAL     ] SRFM: Derivative data saved (139 records).
[2025-10-24T01:29:18.079380] [INFO ] [MAIN      ] SRFM: Successfully saved derivative data.
[2025-10-24T01:29:18.083263] [INFO ] [MAIN      ] Derivative Progress: 1809/2164 symbols completed. SRFM took 1.4s. Estimated remaining: 2m 29s. Rate: 143.4 symbols/min
[2025-10-24T01:29:18.189469] [INFO ] [MAIN      ] SRV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:18.218013] [DEBUG] [LOCAL     ] SRI: Loaded 26338 existing records from primary storage.
[2025-10-24T01:29:18.221197] [INFO ] [MAIN      ] SRI: Loaded 26338 primary data records.
[2025-10-24T01:29:18.294768] [DEBUG] [LOCAL     ] SRV: Loaded 7431 existing records from primary storage.
[2025-10-24T01:29:18.324584] [INFO ] [MAIN      ] SRV: Loaded 7431 primary data records.
[2025-10-24T01:29:18.842174] [DEBUG] [MAIN      ] SRG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:18.898301] [DEBUG] [MAIN      ] SRI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:18.935522] [DEBUG] [MAIN      ] SRV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:18.937913] [INFO ] [MAIN      ] SRG: Generated 139 derivative records from 14820 primary records.
[2025-10-24T01:29:18.952322] [DEBUG] [LOCAL     ] SRG: Saving derivative data.
[2025-10-24T01:29:18.969836] [DEBUG] [LOCAL     ] SRG: Derivative data saved (139 records).
[2025-10-24T01:29:18.970150] [INFO ] [MAIN      ] SRG: Successfully saved derivative data.
[2025-10-24T01:29:18.973212] [INFO ] [MAIN      ] Derivative Progress: 1810/2164 symbols completed. SRG took 1.2s. Estimated remaining: 2m 28s. Rate: 143.3 symbols/min
[2025-10-24T01:29:18.973398] [INFO ] [MAIN      ] SSB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:19.003881] [INFO ] [MAIN      ] SRI: Generated 139 derivative records from 26338 primary records.
[2025-10-24T01:29:19.005521] [DEBUG] [LOCAL     ] SRI: Saving derivative data.
[2025-10-24T01:29:19.007880] [INFO ] [MAIN      ] SRV: Generated 139 derivative records from 7431 primary records.
[2025-10-24T01:29:19.009350] [DEBUG] [LOCAL     ] SRV: Saving derivative data.
[2025-10-24T01:29:19.022508] [DEBUG] [LOCAL     ] SRI: Derivative data saved (139 records).
[2025-10-24T01:29:19.039789] [INFO ] [MAIN      ] SRI: Successfully saved derivative data.
[2025-10-24T01:29:19.049407] [INFO ] [MAIN      ] Derivative Progress: 1811/2164 symbols completed. SRI took 1.0s. Estimated remaining: 2m 28s. Rate: 143.4 symbols/min
[2025-10-24T01:29:19.049907] [DEBUG] [LOCAL     ] SRV: Derivative data saved (139 records).
[2025-10-24T01:29:19.050039] [INFO ] [MAIN      ] SRV: Successfully saved derivative data.
[2025-10-24T01:29:19.053157] [INFO ] [MAIN      ] Derivative Progress: 1812/2164 symbols completed. SRV took 0.9s. Estimated remaining: 2m 27s. Rate: 143.4 symbols/min
[2025-10-24T01:29:19.053552] [INFO ] [MAIN      ] SSL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:19.050260] [INFO ] [MAIN      ] SSD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:19.076690] [DEBUG] [LOCAL     ] SSB: Loaded 43090 existing records from primary storage.
[2025-10-24T01:29:19.077396] [INFO ] [MAIN      ] SSB: Loaded 43090 primary data records.
[2025-10-24T01:29:19.227328] [DEBUG] [LOCAL     ] SSD: Loaded 22503 existing records from primary storage.
[2025-10-24T01:29:19.234543] [INFO ] [MAIN      ] SSD: Loaded 22503 primary data records.
[2025-10-24T01:29:19.323097] [DEBUG] [LOCAL     ] SSL: Loaded 41739 existing records from primary storage.
[2025-10-24T01:29:19.333889] [INFO ] [MAIN      ] SSL: Loaded 41739 primary data records.
[2025-10-24T01:29:20.099636] [DEBUG] [MAIN      ] SSB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:20.139110] [DEBUG] [MAIN      ] SSD: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:20.176853] [DEBUG] [MAIN      ] SSL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:20.209684] [INFO ] [MAIN      ] SSB: Generated 139 derivative records from 43090 primary records.
[2025-10-24T01:29:20.213185] [DEBUG] [LOCAL     ] SSB: Saving derivative data.
[2025-10-24T01:29:20.229498] [DEBUG] [LOCAL     ] SSB: Derivative data saved (139 records).
[2025-10-24T01:29:20.232144] [INFO ] [MAIN      ] SSB: Successfully saved derivative data.
[2025-10-24T01:29:20.238070] [INFO ] [MAIN      ] Derivative Progress: 1813/2164 symbols completed. SSB took 1.3s. Estimated remaining: 2m 27s. Rate: 143.3 symbols/min
[2025-10-24T01:29:20.243167] [INFO ] [MAIN      ] SSD: Generated 139 derivative records from 22503 primary records.
[2025-10-24T01:29:20.243322] [DEBUG] [LOCAL     ] SSD: Saving derivative data.
[2025-10-24T01:29:20.261432] [INFO ] [MAIN      ] SSL: Generated 139 derivative records from 41739 primary records.
[2025-10-24T01:29:20.261539] [DEBUG] [LOCAL     ] SSL: Saving derivative data.
[2025-10-24T01:29:20.262026] [DEBUG] [LOCAL     ] SSD: Derivative data saved (139 records).
[2025-10-24T01:29:20.262118] [INFO ] [MAIN      ] SSD: Successfully saved derivative data.
[2025-10-24T01:29:20.265279] [INFO ] [MAIN      ] Derivative Progress: 1814/2164 symbols completed. SSD took 1.2s. Estimated remaining: 2m 26s. Rate: 143.4 symbols/min
[2025-10-24T01:29:20.276262] [DEBUG] [LOCAL     ] SSL: Derivative data saved (139 records).
[2025-10-24T01:29:20.276343] [INFO ] [MAIN      ] SSL: Successfully saved derivative data.
[2025-10-24T01:29:20.279871] [INFO ] [MAIN      ] Derivative Progress: 1815/2164 symbols completed. SSL took 1.2s. Estimated remaining: 2m 26s. Rate: 143.4 symbols/min
[2025-10-24T01:29:20.280501] [INFO ] [MAIN      ] SST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:20.280598] [INFO ] [MAIN      ] SSTK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:20.280695] [INFO ] [MAIN      ] ST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:20.298117] [DEBUG] [LOCAL     ] SST: Loaded 11417 existing records from primary storage.
[2025-10-24T01:29:20.298449] [INFO ] [MAIN      ] SST: Loaded 11417 primary data records.
[2025-10-24T01:29:20.507856] [DEBUG] [LOCAL     ] SSTK: Loaded 25424 existing records from primary storage.
[2025-10-24T01:29:20.622910] [INFO ] [MAIN      ] SSTK: Loaded 25424 primary data records.
[2025-10-24T01:29:20.672577] [DEBUG] [LOCAL     ] ST: Loaded 50012 existing records from primary storage.
[2025-10-24T01:29:20.698327] [INFO ] [MAIN      ] ST: Loaded 50012 primary data records.
[2025-10-24T01:29:21.316033] [DEBUG] [MAIN      ] SST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:21.364957] [DEBUG] [MAIN      ] SSTK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:21.402596] [DEBUG] [MAIN      ] ST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:21.419853] [INFO ] [MAIN      ] SST: Generated 139 derivative records from 11417 primary records.
[2025-10-24T01:29:21.422403] [DEBUG] [LOCAL     ] SST: Saving derivative data.
[2025-10-24T01:29:21.442620] [DEBUG] [LOCAL     ] SST: Derivative data saved (139 records).
[2025-10-24T01:29:21.444490] [INFO ] [MAIN      ] SST: Successfully saved derivative data.
[2025-10-24T01:29:21.453138] [INFO ] [MAIN      ] Derivative Progress: 1816/2164 symbols completed. SST took 1.2s. Estimated remaining: 2m 26s. Rate: 143.3 symbols/min
[2025-10-24T01:29:21.453587] [INFO ] [MAIN      ] STAG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:21.466742] [INFO ] [MAIN      ] SSTK: Generated 139 derivative records from 25424 primary records.
[2025-10-24T01:29:21.466997] [DEBUG] [LOCAL     ] SSTK: Saving derivative data.
[2025-10-24T01:29:21.485041] [DEBUG] [LOCAL     ] SSTK: Derivative data saved (139 records).
[2025-10-24T01:29:21.485335] [INFO ] [MAIN      ] SSTK: Successfully saved derivative data.
[2025-10-24T01:29:21.489261] [INFO ] [MAIN      ] Derivative Progress: 1817/2164 symbols completed. SSTK took 1.2s. Estimated remaining: 2m 25s. Rate: 143.4 symbols/min
[2025-10-24T01:29:21.490012] [INFO ] [MAIN      ] STC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:21.493371] [INFO ] [MAIN      ] ST: Generated 139 derivative records from 50012 primary records.
[2025-10-24T01:29:21.493495] [DEBUG] [LOCAL     ] ST: Saving derivative data.
[2025-10-24T01:29:21.507831] [DEBUG] [LOCAL     ] ST: Derivative data saved (139 records).
[2025-10-24T01:29:21.508056] [INFO ] [MAIN      ] ST: Successfully saved derivative data.
[2025-10-24T01:29:21.513106] [INFO ] [MAIN      ] Derivative Progress: 1818/2164 symbols completed. ST took 1.2s. Estimated remaining: 2m 25s. Rate: 143.4 symbols/min
[2025-10-24T01:29:21.513459] [INFO ] [MAIN      ] STE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:21.528021] [DEBUG] [LOCAL     ] STC: Loaded 17598 existing records from primary storage.
[2025-10-24T01:29:21.528195] [INFO ] [MAIN      ] STC: Loaded 17598 primary data records.
[2025-10-24T01:29:21.724918] [DEBUG] [LOCAL     ] STAG: Loaded 50429 existing records from primary storage.
[2025-10-24T01:29:21.760162] [INFO ] [MAIN      ] STAG: Loaded 50429 primary data records.
[2025-10-24T01:29:21.897706] [DEBUG] [LOCAL     ] STE: Loaded 35341 existing records from primary storage.
[2025-10-24T01:29:21.935502] [INFO ] [MAIN      ] STE: Loaded 35341 primary data records.
[2025-10-24T01:29:22.511335] [DEBUG] [MAIN      ] STC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:22.565842] [DEBUG] [MAIN      ] STAG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:22.611696] [DEBUG] [MAIN      ] STE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:22.636799] [INFO ] [MAIN      ] STC: Generated 139 derivative records from 17598 primary records.
[2025-10-24T01:29:22.639468] [DEBUG] [LOCAL     ] STC: Saving derivative data.
[2025-10-24T01:29:22.661382] [DEBUG] [LOCAL     ] STC: Derivative data saved (139 records).
[2025-10-24T01:29:22.662390] [INFO ] [MAIN      ] STC: Successfully saved derivative data.
[2025-10-24T01:29:22.671464] [INFO ] [MAIN      ] Derivative Progress: 1819/2164 symbols completed. STC took 1.2s. Estimated remaining: 2m 24s. Rate: 143.3 symbols/min
[2025-10-24T01:29:22.673024] [INFO ] [MAIN      ] STEL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:22.693362] [INFO ] [MAIN      ] STAG: Generated 139 derivative records from 50429 primary records.
[2025-10-24T01:29:22.695582] [INFO ] [MAIN      ] STE: Generated 139 derivative records from 35341 primary records.
[2025-10-24T01:29:22.695940] [DEBUG] [LOCAL     ] STE: Saving derivative data.
[2025-10-24T01:29:22.695836] [DEBUG] [LOCAL     ] STAG: Saving derivative data.
[2025-10-24T01:29:22.726477] [DEBUG] [LOCAL     ] STAG: Derivative data saved (139 records).
[2025-10-24T01:29:22.726672] [INFO ] [MAIN      ] STAG: Successfully saved derivative data.
[2025-10-24T01:29:22.724099] [DEBUG] [LOCAL     ] STE: Derivative data saved (139 records).
[2025-10-24T01:29:22.737123] [INFO ] [MAIN      ] STE: Successfully saved derivative data.
[2025-10-24T01:29:22.730630] [INFO ] [MAIN      ] Derivative Progress: 1820/2164 symbols completed. STAG took 1.3s. Estimated remaining: 2m 24s. Rate: 143.4 symbols/min
[2025-10-24T01:29:22.742419] [INFO ] [MAIN      ] STEM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:22.742521] [INFO ] [MAIN      ] Derivative Progress: 1821/2164 symbols completed. STE took 1.2s. Estimated remaining: 2m 23s. Rate: 143.4 symbols/min
[2025-10-24T01:29:22.743277] [INFO ] [MAIN      ] STEW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:22.745006] [DEBUG] [LOCAL     ] STEL: Loaded 22468 existing records from primary storage.
[2025-10-24T01:29:22.745182] [INFO ] [MAIN      ] STEL: Loaded 22468 primary data records.
[2025-10-24T01:29:22.913278] [DEBUG] [LOCAL     ] STEW: Loaded 15156 existing records from primary storage.
[2025-10-24T01:29:22.959509] [INFO ] [MAIN      ] STEW: Loaded 15156 primary data records.
[2025-10-24T01:29:22.983398] [DEBUG] [LOCAL     ] STEM: Loaded 38586 existing records from primary storage.
[2025-10-24T01:29:23.102955] [INFO ] [MAIN      ] STEM: Loaded 38586 primary data records.
[2025-10-24T01:29:23.728901] [DEBUG] [MAIN      ] STEL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:23.797867] [DEBUG] [MAIN      ] STEW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:23.798391] [DEBUG] [MAIN      ] STEM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:23.823604] [INFO ] [MAIN      ] STEL: Generated 139 derivative records from 22468 primary records.
[2025-10-24T01:29:23.825471] [DEBUG] [LOCAL     ] STEL: Saving derivative data.
[2025-10-24T01:29:23.845467] [DEBUG] [LOCAL     ] STEL: Derivative data saved (139 records).
[2025-10-24T01:29:23.846534] [INFO ] [MAIN      ] STEL: Successfully saved derivative data.
[2025-10-24T01:29:23.849508] [INFO ] [MAIN      ] Derivative Progress: 1822/2164 symbols completed. STEL took 1.2s. Estimated remaining: 2m 23s. Rate: 143.3 symbols/min
[2025-10-24T01:29:23.852372] [INFO ] [MAIN      ] STK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:23.882304] [DEBUG] [LOCAL     ] STK: Loaded 9757 existing records from primary storage.
[2025-10-24T01:29:23.884304] [INFO ] [MAIN      ] STK: Loaded 9757 primary data records.
[2025-10-24T01:29:23.978921] [INFO ] [MAIN      ] STEW: Generated 139 derivative records from 15156 primary records.
[2025-10-24T01:29:23.986169] [DEBUG] [LOCAL     ] STEW: Saving derivative data.
[2025-10-24T01:29:23.986381] [INFO ] [MAIN      ] STEM: Generated 139 derivative records from 38586 primary records.
[2025-10-24T01:29:24.011062] [DEBUG] [LOCAL     ] STEM: Saving derivative data.
[2025-10-24T01:29:24.015610] [DEBUG] [LOCAL     ] STEW: Derivative data saved (139 records).
[2025-10-24T01:29:24.051574] [INFO ] [MAIN      ] STEW: Successfully saved derivative data.
[2025-10-24T01:29:24.075301] [DEBUG] [LOCAL     ] STEM: Derivative data saved (139 records).
[2025-10-24T01:29:24.103514] [INFO ] [MAIN      ] Derivative Progress: 1823/2164 symbols completed. STEW took 1.4s. Estimated remaining: 2m 23s. Rate: 143.3 symbols/min
[2025-10-24T01:29:24.107714] [INFO ] [MAIN      ] STEM: Successfully saved derivative data.
[2025-10-24T01:29:24.112117] [INFO ] [MAIN      ] Derivative Progress: 1824/2164 symbols completed. STEM took 1.4s. Estimated remaining: 2m 22s. Rate: 143.4 symbols/min
[2025-10-24T01:29:24.107933] [INFO ] [MAIN      ] STLA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:24.228355] [INFO ] [MAIN      ] STM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:24.268063] [DEBUG] [MAIN      ] STK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:24.352390] [DEBUG] [LOCAL     ] STLA: Loaded 53944 existing records from primary storage.
[2025-10-24T01:29:24.352911] [INFO ] [MAIN      ] STLA: Loaded 53944 primary data records.
[2025-10-24T01:29:24.376286] [DEBUG] [LOCAL     ] STM: Loaded 53963 existing records from primary storage.
[2025-10-24T01:29:24.413797] [INFO ] [MAIN      ] STM: Loaded 53963 primary data records.
[2025-10-24T01:29:24.689801] [INFO ] [MAIN      ] STK: Generated 139 derivative records from 9757 primary records.
[2025-10-24T01:29:24.959192] [DEBUG] [LOCAL     ] STK: Saving derivative data.
[2025-10-24T01:29:24.999408] [DEBUG] [LOCAL     ] STK: Derivative data saved (139 records).
[2025-10-24T01:29:25.000878] [INFO ] [MAIN      ] STK: Successfully saved derivative data.
[2025-10-24T01:29:25.006137] [INFO ] [MAIN      ] Derivative Progress: 1825/2164 symbols completed. STK took 1.2s. Estimated remaining: 2m 22s. Rate: 143.3 symbols/min
[2025-10-24T01:29:25.007018] [INFO ] [MAIN      ] STN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:25.031470] [DEBUG] [MAIN      ] STLA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:25.083432] [DEBUG] [LOCAL     ] STN: Loaded 22702 existing records from primary storage.
[2025-10-24T01:29:25.083677] [INFO ] [MAIN      ] STN: Loaded 22702 primary data records.
[2025-10-24T01:29:25.082862] [DEBUG] [MAIN      ] STM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:25.488698] [INFO ] [MAIN      ] STLA: Generated 139 derivative records from 53944 primary records.
[2025-10-24T01:29:25.490248] [DEBUG] [LOCAL     ] STLA: Saving derivative data.
[2025-10-24T01:29:25.510022] [DEBUG] [LOCAL     ] STLA: Derivative data saved (139 records).
[2025-10-24T01:29:25.513524] [INFO ] [MAIN      ] STLA: Successfully saved derivative data.
[2025-10-24T01:29:25.519381] [INFO ] [MAIN      ] Derivative Progress: 1826/2164 symbols completed. STLA took 1.4s. Estimated remaining: 2m 22s. Rate: 143.3 symbols/min
[2025-10-24T01:29:25.520722] [INFO ] [MAIN      ] STNG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:25.519764] [INFO ] [MAIN      ] STM: Generated 139 derivative records from 53963 primary records.
[2025-10-24T01:29:25.521492] [DEBUG] [LOCAL     ] STM: Saving derivative data.
[2025-10-24T01:29:25.535869] [DEBUG] [LOCAL     ] STM: Derivative data saved (139 records).
[2025-10-24T01:29:25.536210] [INFO ] [MAIN      ] STM: Successfully saved derivative data.
[2025-10-24T01:29:25.541027] [INFO ] [MAIN      ] Derivative Progress: 1827/2164 symbols completed. STM took 1.3s. Estimated remaining: 2m 21s. Rate: 143.4 symbols/min
[2025-10-24T01:29:25.541930] [INFO ] [MAIN      ] STRV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:25.557303] [DEBUG] [MAIN      ] STN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:25.598528] [DEBUG] [LOCAL     ] STRV: Loaded 10739 existing records from primary storage.
[2025-10-24T01:29:25.598907] [INFO ] [MAIN      ] STRV: Loaded 10739 primary data records.
[2025-10-24T01:29:25.723557] [DEBUG] [LOCAL     ] STNG: Loaded 43583 existing records from primary storage.
[2025-10-24T01:29:25.725420] [INFO ] [MAIN      ] STNG: Loaded 43583 primary data records.
[2025-10-24T01:29:26.018429] [INFO ] [MAIN      ] STN: Generated 139 derivative records from 22702 primary records.
[2025-10-24T01:29:26.038335] [DEBUG] [LOCAL     ] STN: Saving derivative data.
[2025-10-24T01:29:26.226216] [DEBUG] [LOCAL     ] STN: Derivative data saved (139 records).
[2025-10-24T01:29:26.240694] [INFO ] [MAIN      ] STN: Successfully saved derivative data.
[2025-10-24T01:29:26.243460] [INFO ] [MAIN      ] Derivative Progress: 1828/2164 symbols completed. STN took 1.2s. Estimated remaining: 2m 21s. Rate: 143.3 symbols/min
[2025-10-24T01:29:26.267882] [DEBUG] [MAIN      ] STRV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:26.302790] [DEBUG] [MAIN      ] STNG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:26.339488] [INFO ] [MAIN      ] STRV: Generated 139 derivative records from 10739 primary records.
[2025-10-24T01:29:26.340075] [DEBUG] [LOCAL     ] STRV: Saving derivative data.
[2025-10-24T01:29:26.357248] [DEBUG] [LOCAL     ] STRV: Derivative data saved (139 records).
[2025-10-24T01:29:26.357585] [INFO ] [MAIN      ] STRV: Successfully saved derivative data.
[2025-10-24T01:29:26.360190] [INFO ] [MAIN      ] Derivative Progress: 1829/2164 symbols completed. STRV took 0.8s. Estimated remaining: 2m 20s. Rate: 143.4 symbols/min
[2025-10-24T01:29:26.365756] [INFO ] [MAIN      ] STNG: Generated 139 derivative records from 43583 primary records.
[2025-10-24T01:29:26.365946] [DEBUG] [LOCAL     ] STNG: Saving derivative data.
[2025-10-24T01:29:26.377928] [DEBUG] [LOCAL     ] STNG: Derivative data saved (139 records).
[2025-10-24T01:29:26.378012] [INFO ] [MAIN      ] STNG: Successfully saved derivative data.
[2025-10-24T01:29:26.381115] [INFO ] [MAIN      ] Derivative Progress: 1830/2164 symbols completed. STNG took 0.9s. Estimated remaining: 2m 20s. Rate: 143.5 symbols/min
[2025-10-24T01:29:26.381626] [INFO ] [MAIN      ] STT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:26.381853] [INFO ] [MAIN      ] STVN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:26.381755] [INFO ] [MAIN      ] STWD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:26.416860] [DEBUG] [LOCAL     ] STVN: Loaded 26897 existing records from primary storage.
[2025-10-24T01:29:26.417038] [INFO ] [MAIN      ] STVN: Loaded 26897 primary data records.
[2025-10-24T01:29:26.604122] [DEBUG] [LOCAL     ] STT: Loaded 51483 existing records from primary storage.
[2025-10-24T01:29:26.605793] [DEBUG] [LOCAL     ] STWD: Loaded 52342 existing records from primary storage.
[2025-10-24T01:29:26.627167] [INFO ] [MAIN      ] STT: Loaded 51483 primary data records.
[2025-10-24T01:29:26.627313] [INFO ] [MAIN      ] STWD: Loaded 52342 primary data records.
[2025-10-24T01:29:27.534165] [DEBUG] [MAIN      ] STVN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:27.564140] [DEBUG] [MAIN      ] STWD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:27.614543] [DEBUG] [MAIN      ] STT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:27.679177] [INFO ] [MAIN      ] STVN: Generated 139 derivative records from 26897 primary records.
[2025-10-24T01:29:27.679545] [DEBUG] [LOCAL     ] STVN: Saving derivative data.
[2025-10-24T01:29:27.687676] [INFO ] [MAIN      ] STWD: Generated 139 derivative records from 52342 primary records.
[2025-10-24T01:29:27.695239] [DEBUG] [LOCAL     ] STWD: Saving derivative data.
[2025-10-24T01:29:27.701833] [DEBUG] [LOCAL     ] STVN: Derivative data saved (139 records).
[2025-10-24T01:29:27.703625] [INFO ] [MAIN      ] STVN: Successfully saved derivative data.
[2025-10-24T01:29:27.706837] [INFO ] [MAIN      ] Derivative Progress: 1831/2164 symbols completed. STVN took 1.3s. Estimated remaining: 2m 19s. Rate: 143.3 symbols/min
[2025-10-24T01:29:27.707198] [INFO ] [MAIN      ] STXD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:27.725417] [DEBUG] [LOCAL     ] STWD: Derivative data saved (139 records).
[2025-10-24T01:29:27.725753] [INFO ] [MAIN      ] STWD: Successfully saved derivative data.
[2025-10-24T01:29:27.728319] [DEBUG] [LOCAL     ] STXD: Loaded 1352 existing records from primary storage.
[2025-10-24T01:29:27.731395] [INFO ] [MAIN      ] Derivative Progress: 1832/2164 symbols completed. STWD took 1.3s. Estimated remaining: 2m 19s. Rate: 143.4 symbols/min
[2025-10-24T01:29:27.734030] [INFO ] [MAIN      ] STXE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:27.731512] [INFO ] [MAIN      ] STXD: Loaded 1352 primary data records.
[2025-10-24T01:29:27.737453] [INFO ] [MAIN      ] STT: Generated 139 derivative records from 51483 primary records.
[2025-10-24T01:29:27.760707] [DEBUG] [LOCAL     ] STT: Saving derivative data.
[2025-10-24T01:29:27.843189] [DEBUG] [LOCAL     ] STXE: Loaded 2067 existing records from primary storage.
[2025-10-24T01:29:27.843861] [DEBUG] [LOCAL     ] STT: Derivative data saved (139 records).
[2025-10-24T01:29:27.861504] [INFO ] [MAIN      ] STXE: Loaded 2067 primary data records.
[2025-10-24T01:29:27.862049] [INFO ] [MAIN      ] STT: Successfully saved derivative data.
[2025-10-24T01:29:27.882980] [INFO ] [MAIN      ] Derivative Progress: 1833/2164 symbols completed. STT took 1.5s. Estimated remaining: 2m 18s. Rate: 143.4 symbols/min
[2025-10-24T01:29:27.927620] [INFO ] [MAIN      ] STXG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:28.173958] [DEBUG] [LOCAL     ] STXG: Loaded 2312 existing records from primary storage.
[2025-10-24T01:29:28.189217] [INFO ] [MAIN      ] STXG: Loaded 2312 primary data records.
[2025-10-24T01:29:28.756736] [DEBUG] [MAIN      ] STXD: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:28.801810] [DEBUG] [MAIN      ] STXE: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:28.856762] [DEBUG] [MAIN      ] STXG: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:28.909110] [INFO ] [MAIN      ] STXD: Generated 139 derivative records from 1352 primary records.
[2025-10-24T01:29:28.910841] [DEBUG] [LOCAL     ] STXD: Saving derivative data.
[2025-10-24T01:29:28.929027] [INFO ] [MAIN      ] STXE: Generated 139 derivative records from 2067 primary records.
[2025-10-24T01:29:28.929963] [DEBUG] [LOCAL     ] STXE: Saving derivative data.
[2025-10-24T01:29:28.930114] [DEBUG] [LOCAL     ] STXD: Derivative data saved (139 records).
[2025-10-24T01:29:28.934677] [INFO ] [MAIN      ] STXD: Successfully saved derivative data.
[2025-10-24T01:29:28.949422] [DEBUG] [LOCAL     ] STXE: Derivative data saved (139 records).
[2025-10-24T01:29:28.949668] [INFO ] [MAIN      ] STXE: Successfully saved derivative data.
[2025-10-24T01:29:28.944226] [INFO ] [MAIN      ] Derivative Progress: 1834/2164 symbols completed. STXD took 1.2s. Estimated remaining: 2m 18s. Rate: 143.3 symbols/min
[2025-10-24T01:29:28.955596] [INFO ] [MAIN      ] STXK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:28.956507] [INFO ] [MAIN      ] Derivative Progress: 1835/2164 symbols completed. STXE took 1.2s. Estimated remaining: 2m 18s. Rate: 143.4 symbols/min
[2025-10-24T01:29:28.956930] [INFO ] [MAIN      ] STXT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:28.968417] [DEBUG] [LOCAL     ] STXK: Loaded 1484 existing records from primary storage.
[2025-10-24T01:29:28.972260] [INFO ] [MAIN      ] STXK: Loaded 1484 primary data records.
[2025-10-24T01:29:28.975013] [INFO ] [MAIN      ] STXG: Generated 139 derivative records from 2312 primary records.
[2025-10-24T01:29:28.987238] [DEBUG] [LOCAL     ] STXG: Saving derivative data.
[2025-10-24T01:29:28.974709] [DEBUG] [LOCAL     ] STXT: Loaded 2533 existing records from primary storage.
[2025-10-24T01:29:29.039915] [INFO ] [MAIN      ] STXT: Loaded 2533 primary data records.
[2025-10-24T01:29:29.093782] [DEBUG] [LOCAL     ] STXG: Derivative data saved (139 records).
[2025-10-24T01:29:29.152820] [INFO ] [MAIN      ] STXG: Successfully saved derivative data.
[2025-10-24T01:29:29.182804] [INFO ] [MAIN      ] Derivative Progress: 1836/2164 symbols completed. STXG took 1.3s. Estimated remaining: 2m 17s. Rate: 143.4 symbols/min
[2025-10-24T01:29:29.414761] [INFO ] [MAIN      ] STXV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:29.507768] [DEBUG] [LOCAL     ] STXV: Loaded 1474 existing records from primary storage.
[2025-10-24T01:29:29.629997] [INFO ] [MAIN      ] STXV: Loaded 1474 primary data records.
[2025-10-24T01:29:30.004927] [DEBUG] [MAIN      ] STXK: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:30.045783] [DEBUG] [MAIN      ] STXT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:30.112539] [DEBUG] [MAIN      ] STXV: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:30.135254] [INFO ] [MAIN      ] STXK: Generated 139 derivative records from 1484 primary records.
[2025-10-24T01:29:30.137023] [DEBUG] [LOCAL     ] STXK: Saving derivative data.
[2025-10-24T01:29:30.153871] [DEBUG] [LOCAL     ] STXK: Derivative data saved (139 records).
[2025-10-24T01:29:30.142904] [INFO ] [MAIN      ] STXT: Generated 139 derivative records from 2533 primary records.
[2025-10-24T01:29:30.154343] [DEBUG] [LOCAL     ] STXT: Saving derivative data.
[2025-10-24T01:29:30.154399] [INFO ] [MAIN      ] STXK: Successfully saved derivative data.
[2025-10-24T01:29:30.158152] [INFO ] [MAIN      ] Derivative Progress: 1837/2164 symbols completed. STXK took 1.2s. Estimated remaining: 2m 17s. Rate: 143.3 symbols/min
[2025-10-24T01:29:30.168727] [INFO ] [MAIN      ] STZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:30.175819] [DEBUG] [LOCAL     ] STXT: Derivative data saved (139 records).
[2025-10-24T01:29:30.176399] [INFO ] [MAIN      ] STXT: Successfully saved derivative data.
[2025-10-24T01:29:30.182943] [INFO ] [MAIN      ] Derivative Progress: 1838/2164 symbols completed. STXT took 1.2s. Estimated remaining: 2m 16s. Rate: 143.4 symbols/min
[2025-10-24T01:29:30.183876] [INFO ] [MAIN      ] SU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:30.191779] [INFO ] [MAIN      ] STXV: Generated 139 derivative records from 1474 primary records.
[2025-10-24T01:29:30.192082] [DEBUG] [LOCAL     ] STXV: Saving derivative data.
[2025-10-24T01:29:30.202883] [DEBUG] [LOCAL     ] STXV: Derivative data saved (139 records).
[2025-10-24T01:29:30.203123] [INFO ] [MAIN      ] STXV: Successfully saved derivative data.
[2025-10-24T01:29:30.206922] [INFO ] [MAIN      ] Derivative Progress: 1839/2164 symbols completed. STXV took 0.8s. Estimated remaining: 2m 16s. Rate: 143.5 symbols/min
[2025-10-24T01:29:30.207134] [INFO ] [MAIN      ] SUI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:30.294177] [DEBUG] [LOCAL     ] SU: Loaded 53820 existing records from primary storage.
[2025-10-24T01:29:30.294525] [INFO ] [MAIN      ] SU: Loaded 53820 primary data records.
[2025-10-24T01:29:30.296101] [DEBUG] [LOCAL     ] STZ: Loaded 52805 existing records from primary storage.
[2025-10-24T01:29:30.297755] [INFO ] [MAIN      ] STZ: Loaded 52805 primary data records.
[2025-10-24T01:29:30.422752] [DEBUG] [LOCAL     ] SUI: Loaded 42165 existing records from primary storage.
[2025-10-24T01:29:30.505390] [INFO ] [MAIN      ] SUI: Loaded 42165 primary data records.
[2025-10-24T01:29:31.357312] [DEBUG] [MAIN      ] SU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:31.359578] [DEBUG] [MAIN      ] STZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:31.432961] [DEBUG] [MAIN      ] SUI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:31.533983] [INFO ] [MAIN      ] SU: Generated 139 derivative records from 53820 primary records.
[2025-10-24T01:29:31.536600] [INFO ] [MAIN      ] SUI: Generated 139 derivative records from 42165 primary records.
[2025-10-24T01:29:31.536844] [DEBUG] [LOCAL     ] SU: Saving derivative data.
[2025-10-24T01:29:31.537004] [DEBUG] [LOCAL     ] SUI: Saving derivative data.
[2025-10-24T01:29:31.573536] [INFO ] [MAIN      ] STZ: Generated 139 derivative records from 52805 primary records.
[2025-10-24T01:29:31.576325] [DEBUG] [LOCAL     ] SUI: Derivative data saved (139 records).
[2025-10-24T01:29:31.565520] [DEBUG] [LOCAL     ] SU: Derivative data saved (139 records).
[2025-10-24T01:29:31.576682] [INFO ] [MAIN      ] SU: Successfully saved derivative data.
[2025-10-24T01:29:31.576806] [DEBUG] [LOCAL     ] STZ: Saving derivative data.
[2025-10-24T01:29:31.581369] [INFO ] [MAIN      ] SUI: Successfully saved derivative data.
[2025-10-24T01:29:31.580773] [INFO ] [MAIN      ] Derivative Progress: 1840/2164 symbols completed. SU took 1.4s. Estimated remaining: 2m 16s. Rate: 143.3 symbols/min
[2025-10-24T01:29:31.599099] [INFO ] [MAIN      ] SUN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:31.600924] [INFO ] [MAIN      ] Derivative Progress: 1841/2164 symbols completed. SUI took 1.4s. Estimated remaining: 2m 15s. Rate: 143.4 symbols/min
[2025-10-24T01:29:31.602707] [DEBUG] [LOCAL     ] STZ: Derivative data saved (139 records).
[2025-10-24T01:29:31.603593] [INFO ] [MAIN      ] STZ: Successfully saved derivative data.
[2025-10-24T01:29:31.603481] [INFO ] [MAIN      ] SUPV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:31.608428] [INFO ] [MAIN      ] Derivative Progress: 1842/2164 symbols completed. STZ took 1.4s. Estimated remaining: 2m 15s. Rate: 143.4 symbols/min
[2025-10-24T01:29:31.609146] [INFO ] [MAIN      ] SUZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:31.693681] [DEBUG] [LOCAL     ] SUN: Loaded 39054 existing records from primary storage.
[2025-10-24T01:29:31.713050] [INFO ] [MAIN      ] SUN: Loaded 39054 primary data records.
[2025-10-24T01:29:31.740295] [DEBUG] [LOCAL     ] SUPV: Loaded 48430 existing records from primary storage.
[2025-10-24T01:29:31.740632] [INFO ] [MAIN      ] SUPV: Loaded 48430 primary data records.
[2025-10-24T01:29:31.742010] [DEBUG] [LOCAL     ] SUZ: Loaded 45832 existing records from primary storage.
[2025-10-24T01:29:31.766861] [INFO ] [MAIN      ] SUZ: Loaded 45832 primary data records.
[2025-10-24T01:29:32.774881] [DEBUG] [MAIN      ] SUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:32.812769] [DEBUG] [MAIN      ] SUPV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:32.832746] [DEBUG] [MAIN      ] SUN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:32.896936] [INFO ] [MAIN      ] SUZ: Generated 139 derivative records from 45832 primary records.
[2025-10-24T01:29:32.899722] [INFO ] [MAIN      ] SUPV: Generated 139 derivative records from 48430 primary records.
[2025-10-24T01:29:32.900156] [DEBUG] [LOCAL     ] SUZ: Saving derivative data.
[2025-10-24T01:29:32.900278] [DEBUG] [LOCAL     ] SUPV: Saving derivative data.
[2025-10-24T01:29:32.925967] [DEBUG] [LOCAL     ] SUPV: Derivative data saved (139 records).
[2025-10-24T01:29:32.923246] [INFO ] [MAIN      ] SUN: Generated 139 derivative records from 39054 primary records.
[2025-10-24T01:29:32.926020] [DEBUG] [LOCAL     ] SUZ: Derivative data saved (139 records).
[2025-10-24T01:29:32.926507] [INFO ] [MAIN      ] SUZ: Successfully saved derivative data.
[2025-10-24T01:29:32.926292] [DEBUG] [LOCAL     ] SUN: Saving derivative data.
[2025-10-24T01:29:32.926370] [INFO ] [MAIN      ] SUPV: Successfully saved derivative data.
[2025-10-24T01:29:32.929144] [INFO ] [MAIN      ] Derivative Progress: 1843/2164 symbols completed. SUZ took 1.3s. Estimated remaining: 2m 14s. Rate: 143.3 symbols/min
[2025-10-24T01:29:32.932127] [INFO ] [MAIN      ] Derivative Progress: 1844/2164 symbols completed. SUPV took 1.3s. Estimated remaining: 2m 14s. Rate: 143.3 symbols/min
[2025-10-24T01:29:32.943227] [DEBUG] [LOCAL     ] SUN: Derivative data saved (139 records).
[2025-10-24T01:29:32.943307] [INFO ] [MAIN      ] SUN: Successfully saved derivative data.
[2025-10-24T01:29:32.946212] [INFO ] [MAIN      ] Derivative Progress: 1845/2164 symbols completed. SUN took 1.3s. Estimated remaining: 2m 13s. Rate: 143.4 symbols/min
[2025-10-24T01:29:32.946713] [INFO ] [MAIN      ] SWK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:32.946619] [INFO ] [MAIN      ] SVV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:32.946803] [INFO ] [MAIN      ] SW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:33.030921] [DEBUG] [LOCAL     ] SVV: Loaded 40525 existing records from primary storage.
[2025-10-24T01:29:33.032587] [INFO ] [MAIN      ] SVV: Loaded 40525 primary data records.
[2025-10-24T01:29:33.046288] [DEBUG] [LOCAL     ] SWK: Loaded 52755 existing records from primary storage.
[2025-10-24T01:29:33.058892] [INFO ] [MAIN      ] SWK: Loaded 52755 primary data records.
[2025-10-24T01:29:33.104687] [DEBUG] [LOCAL     ] SW: Loaded 53568 existing records from primary storage.
[2025-10-24T01:29:33.177150] [INFO ] [MAIN      ] SW: Loaded 53568 primary data records.
[2025-10-24T01:29:33.958771] [DEBUG] [MAIN      ] SVV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:33.982412] [DEBUG] [MAIN      ] SWK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:34.020439] [DEBUG] [MAIN      ] SW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:34.074024] [INFO ] [MAIN      ] SVV: Generated 139 derivative records from 40525 primary records.
[2025-10-24T01:29:34.076008] [DEBUG] [LOCAL     ] SVV: Saving derivative data.
[2025-10-24T01:29:34.076912] [INFO ] [MAIN      ] SWK: Generated 139 derivative records from 52755 primary records.
[2025-10-24T01:29:34.077090] [DEBUG] [LOCAL     ] SWK: Saving derivative data.
[2025-10-24T01:29:34.090028] [DEBUG] [LOCAL     ] SVV: Derivative data saved (139 records).
[2025-10-24T01:29:34.099318] [INFO ] [MAIN      ] SVV: Successfully saved derivative data.
[2025-10-24T01:29:34.106234] [INFO ] [MAIN      ] Derivative Progress: 1846/2164 symbols completed. SVV took 1.2s. Estimated remaining: 2m 13s. Rate: 143.3 symbols/min
[2025-10-24T01:29:34.107483] [DEBUG] [LOCAL     ] SWK: Derivative data saved (139 records).
[2025-10-24T01:29:34.107636] [INFO ] [MAIN      ] SWX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:34.108316] [INFO ] [MAIN      ] SWK: Successfully saved derivative data.
[2025-10-24T01:29:34.112399] [INFO ] [MAIN      ] Derivative Progress: 1847/2164 symbols completed. SWK took 1.2s. Estimated remaining: 2m 13s. Rate: 143.4 symbols/min
[2025-10-24T01:29:34.112837] [INFO ] [MAIN      ] SWZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:34.115087] [INFO ] [MAIN      ] SW: Generated 139 derivative records from 53568 primary records.
[2025-10-24T01:29:34.115558] [DEBUG] [LOCAL     ] SW: Saving derivative data.
[2025-10-24T01:29:34.130685] [DEBUG] [LOCAL     ] SW: Derivative data saved (139 records).
[2025-10-24T01:29:34.134530] [DEBUG] [LOCAL     ] SWZ: Loaded 6009 existing records from primary storage.
[2025-10-24T01:29:34.134175] [INFO ] [MAIN      ] SW: Successfully saved derivative data.
[2025-10-24T01:29:34.134730] [INFO ] [MAIN      ] SWZ: Loaded 6009 primary data records.
[2025-10-24T01:29:34.137675] [INFO ] [MAIN      ] Derivative Progress: 1848/2164 symbols completed. SW took 1.2s. Estimated remaining: 2m 12s. Rate: 143.4 symbols/min
[2025-10-24T01:29:34.150059] [INFO ] [MAIN      ] SXC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:34.289997] [DEBUG] [LOCAL     ] SWX: Loaded 30757 existing records from primary storage.
[2025-10-24T01:29:34.343017] [INFO ] [MAIN      ] SWX: Loaded 30757 primary data records.
[2025-10-24T01:29:34.800973] [DEBUG] [LOCAL     ] SXC: Loaded 41860 existing records from primary storage.
[2025-10-24T01:29:34.801624] [INFO ] [MAIN      ] SXC: Loaded 41860 primary data records.
[2025-10-24T01:29:35.135044] [DEBUG] [MAIN      ] SWZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:35.171994] [DEBUG] [MAIN      ] SWX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:35.217666] [DEBUG] [MAIN      ] SXC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:35.240924] [INFO ] [MAIN      ] SWZ: Generated 139 derivative records from 6009 primary records.
[2025-10-24T01:29:35.241482] [DEBUG] [LOCAL     ] SWZ: Saving derivative data.
[2025-10-24T01:29:35.256720] [DEBUG] [LOCAL     ] SWZ: Derivative data saved (139 records).
[2025-10-24T01:29:35.259668] [INFO ] [MAIN      ] SWZ: Successfully saved derivative data.
[2025-10-24T01:29:35.261531] [INFO ] [MAIN      ] Derivative Progress: 1849/2164 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 12s. Rate: 143.3 symbols/min
[2025-10-24T01:29:35.264447] [INFO ] [MAIN      ] SXI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:35.264705] [INFO ] [MAIN      ] SWX: Generated 139 derivative records from 30757 primary records.
[2025-10-24T01:29:35.265206] [DEBUG] [LOCAL     ] SWX: Saving derivative data.
[2025-10-24T01:29:35.278620] [DEBUG] [LOCAL     ] SWX: Derivative data saved (139 records).
[2025-10-24T01:29:35.281707] [INFO ] [MAIN      ] SWX: Successfully saved derivative data.
[2025-10-24T01:29:35.284688] [INFO ] [MAIN      ] Derivative Progress: 1850/2164 symbols completed. SWX took 1.2s. Estimated remaining: 2m 11s. Rate: 143.4 symbols/min
[2025-10-24T01:29:35.284963] [INFO ] [MAIN      ] SXT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:35.299233] [DEBUG] [LOCAL     ] SXI: Loaded 12093 existing records from primary storage.
[2025-10-24T01:29:35.302430] [INFO ] [MAIN      ] SXI: Loaded 12093 primary data records.
[2025-10-24T01:29:35.362310] [INFO ] [MAIN      ] SXC: Generated 139 derivative records from 41860 primary records.
[2025-10-24T01:29:35.401063] [DEBUG] [LOCAL     ] SXC: Saving derivative data.
[2025-10-24T01:29:35.479454] [DEBUG] [LOCAL     ] SXC: Derivative data saved (139 records).
[2025-10-24T01:29:35.618320] [DEBUG] [LOCAL     ] SXT: Loaded 29769 existing records from primary storage.
[2025-10-24T01:29:35.631907] [INFO ] [MAIN      ] SXT: Loaded 29769 primary data records.
[2025-10-24T01:29:35.631824] [INFO ] [MAIN      ] SXC: Successfully saved derivative data.
[2025-10-24T01:29:35.656026] [INFO ] [MAIN      ] Derivative Progress: 1851/2164 symbols completed. SXC took 1.5s. Estimated remaining: 2m 11s. Rate: 143.4 symbols/min
[2025-10-24T01:29:35.692023] [INFO ] [MAIN      ] SYF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:35.966715] [DEBUG] [MAIN      ] SXI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:36.027084] [DEBUG] [LOCAL     ] SYF: Loaded 53841 existing records from primary storage.
[2025-10-24T01:29:36.030463] [INFO ] [MAIN      ] SYF: Loaded 53841 primary data records.
[2025-10-24T01:29:36.174281] [DEBUG] [MAIN      ] SXT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:36.168835] [INFO ] [MAIN      ] SXI: Generated 139 derivative records from 12093 primary records.
[2025-10-24T01:29:36.212308] [DEBUG] [LOCAL     ] SXI: Saving derivative data.
[2025-10-24T01:29:36.410365] [DEBUG] [LOCAL     ] SXI: Derivative data saved (139 records).
[2025-10-24T01:29:36.412742] [INFO ] [MAIN      ] SXI: Successfully saved derivative data.
[2025-10-24T01:29:36.414772] [INFO ] [MAIN      ] Derivative Progress: 1852/2164 symbols completed. SXI took 1.2s. Estimated remaining: 2m 11s. Rate: 143.3 symbols/min
[2025-10-24T01:29:36.414992] [INFO ] [MAIN      ] SYK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:36.435940] [INFO ] [MAIN      ] SXT: Generated 139 derivative records from 29769 primary records.
[2025-10-24T01:29:36.436287] [DEBUG] [LOCAL     ] SXT: Saving derivative data.
[2025-10-24T01:29:36.450226] [DEBUG] [LOCAL     ] SXT: Derivative data saved (139 records).
[2025-10-24T01:29:36.450472] [INFO ] [MAIN      ] SXT: Successfully saved derivative data.
[2025-10-24T01:29:36.453473] [INFO ] [MAIN      ] Derivative Progress: 1853/2164 symbols completed. SXT took 1.2s. Estimated remaining: 2m 10s. Rate: 143.4 symbols/min
[2025-10-24T01:29:36.453690] [INFO ] [MAIN      ] SYY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:36.480021] [DEBUG] [MAIN      ] SYF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:36.510220] [DEBUG] [LOCAL     ] SYK: Loaded 47139 existing records from primary storage.
[2025-10-24T01:29:36.513959] [INFO ] [MAIN      ] SYK: Loaded 47139 primary data records.
[2025-10-24T01:29:36.858842] [DEBUG] [LOCAL     ] SYY: Loaded 53592 existing records from primary storage.
[2025-10-24T01:29:36.861286] [INFO ] [MAIN      ] SYF: Generated 139 derivative records from 53841 primary records.
[2025-10-24T01:29:36.861568] [INFO ] [MAIN      ] SYY: Loaded 53592 primary data records.
[2025-10-24T01:29:36.861682] [DEBUG] [LOCAL     ] SYF: Saving derivative data.
[2025-10-24T01:29:36.939178] [DEBUG] [LOCAL     ] SYF: Derivative data saved (139 records).
[2025-10-24T01:29:36.975686] [INFO ] [MAIN      ] SYF: Successfully saved derivative data.
[2025-10-24T01:29:36.981884] [INFO ] [MAIN      ] Derivative Progress: 1854/2164 symbols completed. SYF took 1.3s. Estimated remaining: 2m 10s. Rate: 143.4 symbols/min
[2025-10-24T01:29:36.982117] [INFO ] [MAIN      ] T: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:37.194192] [DEBUG] [MAIN      ] SYK: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:37.275058] [DEBUG] [MAIN      ] SYY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:37.274744] [DEBUG] [LOCAL     ] T: Loaded 54188 existing records from primary storage.
[2025-10-24T01:29:37.277749] [INFO ] [MAIN      ] T: Loaded 54188 primary data records.
[2025-10-24T01:29:37.277457] [INFO ] [MAIN      ] SYK: Generated 139 derivative records from 47139 primary records.
[2025-10-24T01:29:37.315182] [DEBUG] [LOCAL     ] SYK: Saving derivative data.
[2025-10-24T01:29:37.408598] [DEBUG] [LOCAL     ] SYK: Derivative data saved (139 records).
[2025-10-24T01:29:37.435170] [INFO ] [MAIN      ] SYK: Successfully saved derivative data.
[2025-10-24T01:29:37.453615] [INFO ] [MAIN      ] Derivative Progress: 1855/2164 symbols completed. SYK took 1.0s. Estimated remaining: 2m 9s. Rate: 143.4 symbols/min
[2025-10-24T01:29:37.470049] [INFO ] [MAIN      ] TAC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:37.643473] [INFO ] [MAIN      ] SYY: Generated 139 derivative records from 53592 primary records.
[2025-10-24T01:29:37.645246] [DEBUG] [LOCAL     ] SYY: Saving derivative data.
[2025-10-24T01:29:37.659960] [DEBUG] [LOCAL     ] SYY: Derivative data saved (139 records).
[2025-10-24T01:29:37.660356] [INFO ] [MAIN      ] SYY: Successfully saved derivative data.
[2025-10-24T01:29:37.663289] [INFO ] [MAIN      ] Derivative Progress: 1856/2164 symbols completed. SYY took 1.2s. Estimated remaining: 2m 9s. Rate: 143.4 symbols/min
[2025-10-24T01:29:37.663946] [INFO ] [MAIN      ] TAK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:37.691960] [DEBUG] [MAIN      ] T: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:37.719902] [DEBUG] [LOCAL     ] TAC: Loaded 43784 existing records from primary storage.
[2025-10-24T01:29:37.720939] [INFO ] [MAIN      ] TAC: Loaded 43784 primary data records.
[2025-10-24T01:29:37.942754] [DEBUG] [LOCAL     ] TAK: Loaded 50590 existing records from primary storage.
[2025-10-24T01:29:38.055699] [INFO ] [MAIN      ] TAK: Loaded 50590 primary data records.
[2025-10-24T01:29:38.146339] [INFO ] [MAIN      ] T: Generated 139 derivative records from 54188 primary records.
[2025-10-24T01:29:38.168023] [DEBUG] [LOCAL     ] T: Saving derivative data.
[2025-10-24T01:29:38.256508] [DEBUG] [LOCAL     ] T: Derivative data saved (139 records).
[2025-10-24T01:29:38.402393] [INFO ] [MAIN      ] T: Successfully saved derivative data.
[2025-10-24T01:29:38.414231] [INFO ] [MAIN      ] Derivative Progress: 1857/2164 symbols completed. T took 1.4s. Estimated remaining: 2m 9s. Rate: 143.3 symbols/min
[2025-10-24T01:29:38.414682] [INFO ] [MAIN      ] TAL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:38.435269] [DEBUG] [MAIN      ] TAC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:38.498932] [DEBUG] [MAIN      ] TAK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:38.514681] [INFO ] [MAIN      ] TAC: Generated 139 derivative records from 43784 primary records.
[2025-10-24T01:29:38.518844] [DEBUG] [LOCAL     ] TAC: Saving derivative data.
[2025-10-24T01:29:38.548457] [DEBUG] [LOCAL     ] TAL: Loaded 52091 existing records from primary storage.
[2025-10-24T01:29:38.548572] [DEBUG] [LOCAL     ] TAC: Derivative data saved (139 records).
[2025-10-24T01:29:38.548881] [INFO ] [MAIN      ] TAL: Loaded 52091 primary data records.
[2025-10-24T01:29:38.551981] [INFO ] [MAIN      ] TAC: Successfully saved derivative data.
[2025-10-24T01:29:38.575698] [INFO ] [MAIN      ] Derivative Progress: 1858/2164 symbols completed. TAC took 1.1s. Estimated remaining: 2m 8s. Rate: 143.4 symbols/min
[2025-10-24T01:29:38.858349] [INFO ] [MAIN      ] TAK: Generated 139 derivative records from 50590 primary records.
[2025-10-24T01:29:38.859192] [DEBUG] [LOCAL     ] TAK: Saving derivative data.
[2025-10-24T01:29:38.872516] [DEBUG] [LOCAL     ] TAK: Derivative data saved (139 records).
[2025-10-24T01:29:38.872753] [INFO ] [MAIN      ] TAK: Successfully saved derivative data.
[2025-10-24T01:29:38.875820] [INFO ] [MAIN      ] Derivative Progress: 1859/2164 symbols completed. TAK took 1.2s. Estimated remaining: 2m 8s. Rate: 143.4 symbols/min
[2025-10-24T01:29:38.895607] [DEBUG] [MAIN      ] TAL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:38.920485] [INFO ] [MAIN      ] TAL: Generated 139 derivative records from 52091 primary records.
[2025-10-24T01:29:38.920595] [DEBUG] [LOCAL     ] TAL: Saving derivative data.
[2025-10-24T01:29:38.932283] [DEBUG] [LOCAL     ] TAL: Derivative data saved (139 records).
[2025-10-24T01:29:38.932365] [INFO ] [MAIN      ] TAL: Successfully saved derivative data.
[2025-10-24T01:29:38.934994] [INFO ] [MAIN      ] Derivative Progress: 1860/2164 symbols completed. TAL took 0.5s. Estimated remaining: 2m 7s. Rate: 143.5 symbols/min
[2025-10-24T01:29:38.935960] [INFO ] [MAIN      ] TALO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:38.936279] [INFO ] [MAIN      ] TBB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:38.936132] [INFO ] [MAIN      ] TAP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:38.952224] [DEBUG] [LOCAL     ] TBB: Loaded 11343 existing records from primary storage.
[2025-10-24T01:29:38.952570] [INFO ] [MAIN      ] TBB: Loaded 11343 primary data records.
[2025-10-24T01:29:39.314459] [DEBUG] [LOCAL     ] TAP: Loaded 53338 existing records from primary storage.
[2025-10-24T01:29:39.314841] [INFO ] [MAIN      ] TAP: Loaded 53338 primary data records.
[2025-10-24T01:29:39.337600] [DEBUG] [LOCAL     ] TALO: Loaded 51375 existing records from primary storage.
[2025-10-24T01:29:39.360712] [INFO ] [MAIN      ] TALO: Loaded 51375 primary data records.
[2025-10-24T01:29:39.923936] [DEBUG] [MAIN      ] TBB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:39.979770] [DEBUG] [MAIN      ] TALO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:39.987269] [DEBUG] [MAIN      ] TAP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:40.018299] [INFO ] [MAIN      ] TBB: Generated 139 derivative records from 11343 primary records.
[2025-10-24T01:29:40.018852] [DEBUG] [LOCAL     ] TBB: Saving derivative data.
[2025-10-24T01:29:40.035304] [DEBUG] [LOCAL     ] TBB: Derivative data saved (139 records).
[2025-10-24T01:29:40.043084] [INFO ] [MAIN      ] TBB: Successfully saved derivative data.
[2025-10-24T01:29:40.047343] [INFO ] [MAIN      ] Derivative Progress: 1861/2164 symbols completed. TBB took 1.1s. Estimated remaining: 2m 7s. Rate: 143.3 symbols/min
[2025-10-24T01:29:40.051604] [INFO ] [MAIN      ] TBBB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:40.077847] [INFO ] [MAIN      ] TALO: Generated 139 derivative records from 51375 primary records.
[2025-10-24T01:29:40.086300] [INFO ] [MAIN      ] TAP: Generated 139 derivative records from 53338 primary records.
[2025-10-24T01:29:40.086539] [DEBUG] [LOCAL     ] TAP: Saving derivative data.
[2025-10-24T01:29:40.086604] [DEBUG] [LOCAL     ] TALO: Saving derivative data.
[2025-10-24T01:29:40.118035] [DEBUG] [LOCAL     ] TALO: Derivative data saved (139 records).
[2025-10-24T01:29:40.119792] [INFO ] [MAIN      ] TALO: Successfully saved derivative data.
[2025-10-24T01:29:40.122337] [INFO ] [MAIN      ] Derivative Progress: 1862/2164 symbols completed. TALO took 1.2s. Estimated remaining: 2m 6s. Rate: 143.4 symbols/min
[2025-10-24T01:29:40.123272] [INFO ] [MAIN      ] TBI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:40.125797] [DEBUG] [LOCAL     ] TBBB: Loaded 35816 existing records from primary storage.
[2025-10-24T01:29:40.126086] [DEBUG] [LOCAL     ] TAP: Derivative data saved (139 records).
[2025-10-24T01:29:40.126365] [INFO ] [MAIN      ] TBBB: Loaded 35816 primary data records.
[2025-10-24T01:29:40.126494] [INFO ] [MAIN      ] TAP: Successfully saved derivative data.
[2025-10-24T01:29:40.140790] [INFO ] [MAIN      ] Derivative Progress: 1863/2164 symbols completed. TAP took 1.2s. Estimated remaining: 2m 6s. Rate: 143.5 symbols/min
[2025-10-24T01:29:40.167804] [INFO ] [MAIN      ] TBN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:40.247373] [DEBUG] [LOCAL     ] TBN: Loaded 4269 existing records from primary storage.
[2025-10-24T01:29:40.251454] [INFO ] [MAIN      ] TBN: Loaded 4269 primary data records.
[2025-10-24T01:29:40.397301] [DEBUG] [LOCAL     ] TBI: Loaded 22933 existing records from primary storage.
[2025-10-24T01:29:40.429229] [INFO ] [MAIN      ] TBI: Loaded 22933 primary data records.
[2025-10-24T01:29:41.114975] [DEBUG] [MAIN      ] TBBB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:41.154900] [DEBUG] [MAIN      ] TBN: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:41.201439] [DEBUG] [MAIN      ] TBI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:41.249225] [INFO ] [MAIN      ] TBN: Generated 139 derivative records from 4269 primary records.
[2025-10-24T01:29:41.256067] [INFO ] [MAIN      ] TBBB: Generated 139 derivative records from 35816 primary records.
[2025-10-24T01:29:41.254266] [DEBUG] [LOCAL     ] TBN: Saving derivative data.
[2025-10-24T01:29:41.256478] [DEBUG] [LOCAL     ] TBBB: Saving derivative data.
[2025-10-24T01:29:41.281464] [DEBUG] [LOCAL     ] TBN: Derivative data saved (139 records).
[2025-10-24T01:29:41.284899] [DEBUG] [LOCAL     ] TBBB: Derivative data saved (139 records).
[2025-10-24T01:29:41.285018] [INFO ] [MAIN      ] TBN: Successfully saved derivative data.
[2025-10-24T01:29:41.290731] [INFO ] [MAIN      ] Derivative Progress: 1864/2164 symbols completed. TBN took 1.1s. Estimated remaining: 2m 6s. Rate: 143.3 symbols/min
[2025-10-24T01:29:41.291470] [INFO ] [MAIN      ] TCBX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:41.291062] [INFO ] [MAIN      ] TBBB: Successfully saved derivative data.
[2025-10-24T01:29:41.295454] [INFO ] [MAIN      ] Derivative Progress: 1865/2164 symbols completed. TBBB took 1.2s. Estimated remaining: 2m 5s. Rate: 143.4 symbols/min
[2025-10-24T01:29:41.297813] [INFO ] [MAIN      ] TBI: Generated 139 derivative records from 22933 primary records.
[2025-10-24T01:29:41.298102] [DEBUG] [LOCAL     ] TBI: Saving derivative data.
[2025-10-24T01:29:41.297985] [INFO ] [MAIN      ] TD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:41.311161] [DEBUG] [LOCAL     ] TBI: Derivative data saved (139 records).
[2025-10-24T01:29:41.313929] [INFO ] [MAIN      ] TBI: Successfully saved derivative data.
[2025-10-24T01:29:41.316626] [INFO ] [MAIN      ] Derivative Progress: 1866/2164 symbols completed. TBI took 1.2s. Estimated remaining: 2m 5s. Rate: 143.5 symbols/min
[2025-10-24T01:29:41.317052] [INFO ] [MAIN      ] TDC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:41.323238] [DEBUG] [LOCAL     ] TCBX: Loaded 10283 existing records from primary storage.
[2025-10-24T01:29:41.323681] [INFO ] [MAIN      ] TCBX: Loaded 10283 primary data records.
[2025-10-24T01:29:41.703551] [DEBUG] [LOCAL     ] TDC: Loaded 46766 existing records from primary storage.
[2025-10-24T01:29:41.705175] [INFO ] [MAIN      ] TDC: Loaded 46766 primary data records.
[2025-10-24T01:29:41.706531] [DEBUG] [LOCAL     ] TD: Loaded 52588 existing records from primary storage.
[2025-10-24T01:29:41.738690] [INFO ] [MAIN      ] TD: Loaded 52588 primary data records.
[2025-10-24T01:29:42.413174] [DEBUG] [MAIN      ] TCBX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:42.467051] [DEBUG] [MAIN      ] TDC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:42.486502] [INFO ] [MAIN      ] TCBX: Generated 139 derivative records from 10283 primary records.
[2025-10-24T01:29:42.499669] [DEBUG] [LOCAL     ] TCBX: Saving derivative data.
[2025-10-24T01:29:42.501286] [DEBUG] [MAIN      ] TD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:42.514928] [DEBUG] [LOCAL     ] TCBX: Derivative data saved (139 records).
[2025-10-24T01:29:42.515173] [INFO ] [MAIN      ] TCBX: Successfully saved derivative data.
[2025-10-24T01:29:42.530281] [INFO ] [MAIN      ] Derivative Progress: 1867/2164 symbols completed. TCBX took 1.2s. Estimated remaining: 2m 4s. Rate: 143.3 symbols/min
[2025-10-24T01:29:42.534884] [INFO ] [MAIN      ] TDF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:42.554835] [DEBUG] [LOCAL     ] TDF: Loaded 6235 existing records from primary storage.
[2025-10-24T01:29:42.557869] [INFO ] [MAIN      ] TDF: Loaded 6235 primary data records.
[2025-10-24T01:29:42.720276] [INFO ] [MAIN      ] TDC: Generated 139 derivative records from 46766 primary records.
[2025-10-24T01:29:42.760388] [DEBUG] [LOCAL     ] TDC: Saving derivative data.
[2025-10-24T01:29:42.870732] [INFO ] [MAIN      ] TD: Generated 139 derivative records from 52588 primary records.
[2025-10-24T01:29:42.887191] [DEBUG] [LOCAL     ] TD: Saving derivative data.
[2025-10-24T01:29:42.894408] [DEBUG] [LOCAL     ] TDC: Derivative data saved (139 records).
[2025-10-24T01:29:42.895129] [INFO ] [MAIN      ] TDC: Successfully saved derivative data.
[2025-10-24T01:29:42.897949] [INFO ] [MAIN      ] Derivative Progress: 1868/2164 symbols completed. TDC took 1.6s. Estimated remaining: 2m 4s. Rate: 143.4 symbols/min
[2025-10-24T01:29:42.907427] [INFO ] [MAIN      ] TDG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:42.910441] [DEBUG] [LOCAL     ] TD: Derivative data saved (139 records).
[2025-10-24T01:29:42.911407] [INFO ] [MAIN      ] TD: Successfully saved derivative data.
[2025-10-24T01:29:42.914355] [INFO ] [MAIN      ] Derivative Progress: 1869/2164 symbols completed. TD took 1.6s. Estimated remaining: 2m 3s. Rate: 143.4 symbols/min
[2025-10-24T01:29:42.914971] [INFO ] [MAIN      ] TDOC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:42.942534] [DEBUG] [MAIN      ] TDF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:42.969398] [DEBUG] [LOCAL     ] TDG: Loaded 22110 existing records from primary storage.
[2025-10-24T01:29:42.970164] [INFO ] [MAIN      ] TDG: Loaded 22110 primary data records.
[2025-10-24T01:29:43.116091] [DEBUG] [LOCAL     ] TDOC: Loaded 53758 existing records from primary storage.
[2025-10-24T01:29:43.132457] [INFO ] [MAIN      ] TDOC: Loaded 53758 primary data records.
[2025-10-24T01:29:43.429715] [INFO ] [MAIN      ] TDF: Generated 139 derivative records from 6235 primary records.
[2025-10-24T01:29:43.435545] [DEBUG] [LOCAL     ] TDF: Saving derivative data.
[2025-10-24T01:29:43.526035] [DEBUG] [LOCAL     ] TDF: Derivative data saved (139 records).
[2025-10-24T01:29:43.641744] [INFO ] [MAIN      ] TDF: Successfully saved derivative data.
[2025-10-24T01:29:43.646948] [INFO ] [MAIN      ] Derivative Progress: 1870/2164 symbols completed. TDF took 1.1s. Estimated remaining: 2m 3s. Rate: 143.4 symbols/min
[2025-10-24T01:29:43.647431] [INFO ] [MAIN      ] TDS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:43.673706] [DEBUG] [MAIN      ] TDG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:43.730796] [DEBUG] [MAIN      ] TDOC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:43.761908] [DEBUG] [LOCAL     ] TDS: Loaded 42409 existing records from primary storage.
[2025-10-24T01:29:43.768384] [INFO ] [MAIN      ] TDS: Loaded 42409 primary data records.
[2025-10-24T01:29:43.932927] [INFO ] [MAIN      ] TDG: Generated 139 derivative records from 22110 primary records.
[2025-10-24T01:29:44.060272] [DEBUG] [LOCAL     ] TDG: Saving derivative data.
[2025-10-24T01:29:44.109526] [DEBUG] [LOCAL     ] TDG: Derivative data saved (139 records).
[2025-10-24T01:29:44.111956] [INFO ] [MAIN      ] TDG: Successfully saved derivative data.
[2025-10-24T01:29:44.114362] [INFO ] [MAIN      ] Derivative Progress: 1871/2164 symbols completed. TDG took 1.2s. Estimated remaining: 2m 3s. Rate: 143.4 symbols/min
[2025-10-24T01:29:44.117344] [INFO ] [MAIN      ] TDOC: Generated 139 derivative records from 53758 primary records.
[2025-10-24T01:29:44.118043] [INFO ] [MAIN      ] TDW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:44.119114] [DEBUG] [LOCAL     ] TDOC: Saving derivative data.
[2025-10-24T01:29:44.133972] [DEBUG] [LOCAL     ] TDOC: Derivative data saved (139 records).
[2025-10-24T01:29:44.134203] [INFO ] [MAIN      ] TDOC: Successfully saved derivative data.
[2025-10-24T01:29:44.137546] [INFO ] [MAIN      ] Derivative Progress: 1872/2164 symbols completed. TDOC took 1.2s. Estimated remaining: 2m 2s. Rate: 143.4 symbols/min
[2025-10-24T01:29:44.138281] [INFO ] [MAIN      ] TDY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:44.157192] [DEBUG] [MAIN      ] TDS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:44.212492] [DEBUG] [LOCAL     ] TDW: Loaded 45265 existing records from primary storage.
[2025-10-24T01:29:44.222408] [INFO ] [MAIN      ] TDW: Loaded 45265 primary data records.
[2025-10-24T01:29:44.222949] [DEBUG] [LOCAL     ] TDY: Loaded 22311 existing records from primary storage.
[2025-10-24T01:29:44.235696] [INFO ] [MAIN      ] TDY: Loaded 22311 primary data records.
[2025-10-24T01:29:44.688268] [INFO ] [MAIN      ] TDS: Generated 139 derivative records from 42409 primary records.
[2025-10-24T01:29:44.752746] [DEBUG] [LOCAL     ] TDS: Saving derivative data.
[2025-10-24T01:29:44.892551] [DEBUG] [LOCAL     ] TDS: Derivative data saved (139 records).
[2025-10-24T01:29:44.894296] [INFO ] [MAIN      ] TDS: Successfully saved derivative data.
[2025-10-24T01:29:44.898674] [INFO ] [MAIN      ] Derivative Progress: 1873/2164 symbols completed. TDS took 1.3s. Estimated remaining: 2m 2s. Rate: 143.4 symbols/min
[2025-10-24T01:29:44.922269] [DEBUG] [MAIN      ] TDW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:44.946604] [DEBUG] [MAIN      ] TDY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:45.000081] [INFO ] [MAIN      ] TDW: Generated 139 derivative records from 45265 primary records.
[2025-10-24T01:29:45.003093] [INFO ] [MAIN      ] TDY: Generated 139 derivative records from 22311 primary records.
[2025-10-24T01:29:45.001528] [DEBUG] [LOCAL     ] TDW: Saving derivative data.
[2025-10-24T01:29:45.003776] [DEBUG] [LOCAL     ] TDY: Saving derivative data.
[2025-10-24T01:29:45.026328] [DEBUG] [LOCAL     ] TDW: Derivative data saved (139 records).
[2025-10-24T01:29:45.027437] [DEBUG] [LOCAL     ] TDY: Derivative data saved (139 records).
[2025-10-24T01:29:45.027538] [INFO ] [MAIN      ] TDY: Successfully saved derivative data.
[2025-10-24T01:29:45.027611] [INFO ] [MAIN      ] TDW: Successfully saved derivative data.
[2025-10-24T01:29:45.030717] [INFO ] [MAIN      ] Derivative Progress: 1874/2164 symbols completed. TDY took 0.9s. Estimated remaining: 2m 1s. Rate: 143.4 symbols/min
[2025-10-24T01:29:45.033268] [INFO ] [MAIN      ] Derivative Progress: 1875/2164 symbols completed. TDW took 0.9s. Estimated remaining: 2m 1s. Rate: 143.5 symbols/min
[2025-10-24T01:29:45.033717] [INFO ] [MAIN      ] TECK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:45.033760] [INFO ] [MAIN      ] TEF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:45.033819] [INFO ] [MAIN      ] TEAF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:45.052892] [DEBUG] [LOCAL     ] TEAF: Loaded 7393 existing records from primary storage.
[2025-10-24T01:29:45.053200] [INFO ] [MAIN      ] TEAF: Loaded 7393 primary data records.
[2025-10-24T01:29:45.239515] [DEBUG] [LOCAL     ] TEF: Loaded 37042 existing records from primary storage.
[2025-10-24T01:29:45.260164] [INFO ] [MAIN      ] TEF: Loaded 37042 primary data records.
[2025-10-24T01:29:45.563105] [DEBUG] [LOCAL     ] TECK: Loaded 53821 existing records from primary storage.
[2025-10-24T01:29:45.563868] [INFO ] [MAIN      ] TECK: Loaded 53821 primary data records.
[2025-10-24T01:29:46.089113] [DEBUG] [MAIN      ] TEAF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:46.139423] [DEBUG] [MAIN      ] TEF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:46.180608] [DEBUG] [MAIN      ] TECK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:46.183397] [INFO ] [MAIN      ] TEAF: Generated 139 derivative records from 7393 primary records.
[2025-10-24T01:29:46.183616] [DEBUG] [LOCAL     ] TEAF: Saving derivative data.
[2025-10-24T01:29:46.220044] [DEBUG] [LOCAL     ] TEAF: Derivative data saved (139 records).
[2025-10-24T01:29:46.222240] [INFO ] [MAIN      ] TEAF: Successfully saved derivative data.
[2025-10-24T01:29:46.227470] [INFO ] [MAIN      ] Derivative Progress: 1876/2164 symbols completed. TEAF took 1.2s. Estimated remaining: 2m 1s. Rate: 143.4 symbols/min
[2025-10-24T01:29:46.228250] [INFO ] [MAIN      ] TEI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:46.249846] [INFO ] [MAIN      ] TEF: Generated 139 derivative records from 37042 primary records.
[2025-10-24T01:29:46.258391] [DEBUG] [LOCAL     ] TEF: Saving derivative data.
[2025-10-24T01:29:46.274978] [DEBUG] [LOCAL     ] TEF: Derivative data saved (139 records).
[2025-10-24T01:29:46.282445] [INFO ] [MAIN      ] TEF: Successfully saved derivative data.
[2025-10-24T01:29:46.287203] [INFO ] [MAIN      ] Derivative Progress: 1877/2164 symbols completed. TEF took 1.3s. Estimated remaining: 2m 0s. Rate: 143.4 symbols/min
[2025-10-24T01:29:46.283536] [DEBUG] [LOCAL     ] TEI: Loaded 21262 existing records from primary storage.
[2025-10-24T01:29:46.287943] [INFO ] [MAIN      ] TEL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:46.288362] [INFO ] [MAIN      ] TEI: Loaded 21262 primary data records.
[2025-10-24T01:29:46.401262] [INFO ] [MAIN      ] TECK: Generated 139 derivative records from 53821 primary records.
[2025-10-24T01:29:46.401475] [DEBUG] [LOCAL     ] TECK: Saving derivative data.
[2025-10-24T01:29:46.498336] [DEBUG] [LOCAL     ] TECK: Derivative data saved (139 records).
[2025-10-24T01:29:46.629551] [INFO ] [MAIN      ] TECK: Successfully saved derivative data.
[2025-10-24T01:29:46.633077] [INFO ] [MAIN      ] Derivative Progress: 1878/2164 symbols completed. TECK took 1.6s. Estimated remaining: 1m 60s. Rate: 143.4 symbols/min
[2025-10-24T01:29:46.633738] [INFO ] [MAIN      ] TEN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:46.689074] [DEBUG] [LOCAL     ] TEL: Loaded 51400 existing records from primary storage.
[2025-10-24T01:29:46.689830] [INFO ] [MAIN      ] TEL: Loaded 51400 primary data records.
[2025-10-24T01:29:46.801721] [DEBUG] [LOCAL     ] TEN: Loaded 30505 existing records from primary storage.
[2025-10-24T01:29:46.814582] [INFO ] [MAIN      ] TEN: Loaded 30505 primary data records.
[2025-10-24T01:29:47.166381] [DEBUG] [MAIN      ] TEI: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:29:47.427993] [INFO ] [MAIN      ] TEI: Generated 139 derivative records from 21262 primary records.
[2025-10-24T01:29:47.429009] [DEBUG] [LOCAL     ] TEI: Saving derivative data.
[2025-10-24T01:29:47.428773] [DEBUG] [MAIN      ] TEL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:47.456548] [DEBUG] [LOCAL     ] TEI: Derivative data saved (139 records).
[2025-10-24T01:29:47.456957] [INFO ] [MAIN      ] TEI: Successfully saved derivative data.
[2025-10-24T01:29:47.459604] [INFO ] [MAIN      ] Derivative Progress: 1879/2164 symbols completed. TEI took 1.2s. Estimated remaining: 1m 59s. Rate: 143.4 symbols/min
[2025-10-24T01:29:47.461939] [INFO ] [MAIN      ] TEO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:47.489268] [DEBUG] [MAIN      ] TEN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:47.540141] [DEBUG] [LOCAL     ] TEO: Loaded 23036 existing records from primary storage.
[2025-10-24T01:29:47.546753] [INFO ] [MAIN      ] TEO: Loaded 23036 primary data records.
[2025-10-24T01:29:47.553202] [INFO ] [MAIN      ] TEL: Generated 139 derivative records from 51400 primary records.
[2025-10-24T01:29:47.569845] [DEBUG] [LOCAL     ] TEL: Saving derivative data.
[2025-10-24T01:29:47.676068] [DEBUG] [LOCAL     ] TEL: Derivative data saved (139 records).
[2025-10-24T01:29:47.687852] [INFO ] [MAIN      ] TEL: Successfully saved derivative data.
[2025-10-24T01:29:47.696310] [INFO ] [MAIN      ] Derivative Progress: 1880/2164 symbols completed. TEL took 1.4s. Estimated remaining: 1m 59s. Rate: 143.4 symbols/min
[2025-10-24T01:29:47.702030] [INFO ] [MAIN      ] TEVA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:47.774979] [INFO ] [MAIN      ] TEN: Generated 139 derivative records from 30505 primary records.
[2025-10-24T01:29:47.892624] [DEBUG] [LOCAL     ] TEN: Saving derivative data.
[2025-10-24T01:29:47.906774] [DEBUG] [LOCAL     ] TEN: Derivative data saved (139 records).
[2025-10-24T01:29:47.906927] [INFO ] [MAIN      ] TEN: Successfully saved derivative data.
[2025-10-24T01:29:47.911023] [INFO ] [MAIN      ] Derivative Progress: 1881/2164 symbols completed. TEN took 1.3s. Estimated remaining: 1m 58s. Rate: 143.4 symbols/min
[2025-10-24T01:29:47.911243] [INFO ] [MAIN      ] TEX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:47.950695] [DEBUG] [MAIN      ] TEO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:47.994464] [DEBUG] [LOCAL     ] TEVA: Loaded 54007 existing records from primary storage.
[2025-10-24T01:29:47.995106] [INFO ] [MAIN      ] TEVA: Loaded 54007 primary data records.
[2025-10-24T01:29:48.105593] [DEBUG] [LOCAL     ] TEX: Loaded 43837 existing records from primary storage.
[2025-10-24T01:29:48.122222] [INFO ] [MAIN      ] TEX: Loaded 43837 primary data records.
[2025-10-24T01:29:48.639033] [INFO ] [MAIN      ] TEO: Generated 139 derivative records from 23036 primary records.
[2025-10-24T01:29:48.640006] [DEBUG] [LOCAL     ] TEO: Saving derivative data.
[2025-10-24T01:29:48.655016] [DEBUG] [LOCAL     ] TEO: Derivative data saved (139 records).
[2025-10-24T01:29:48.655178] [INFO ] [MAIN      ] TEO: Successfully saved derivative data.
[2025-10-24T01:29:48.657928] [INFO ] [MAIN      ] Derivative Progress: 1882/2164 symbols completed. TEO took 1.2s. Estimated remaining: 1m 58s. Rate: 143.4 symbols/min
[2025-10-24T01:29:48.659636] [INFO ] [MAIN      ] TFC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:48.681985] [DEBUG] [MAIN      ] TEVA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:48.729125] [DEBUG] [MAIN      ] TEX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:48.782912] [INFO ] [MAIN      ] TEVA: Generated 139 derivative records from 54007 primary records.
[2025-10-24T01:29:48.786920] [DEBUG] [LOCAL     ] TEVA: Saving derivative data.
[2025-10-24T01:29:48.783896] [DEBUG] [LOCAL     ] TFC: Loaded 54057 existing records from primary storage.
[2025-10-24T01:29:48.799558] [DEBUG] [LOCAL     ] TEVA: Derivative data saved (139 records).
[2025-10-24T01:29:48.800595] [INFO ] [MAIN      ] TFC: Loaded 54057 primary data records.
[2025-10-24T01:29:48.801150] [INFO ] [MAIN      ] TEVA: Successfully saved derivative data.
[2025-10-24T01:29:48.824148] [INFO ] [MAIN      ] Derivative Progress: 1883/2164 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 58s. Rate: 143.4 symbols/min
[2025-10-24T01:29:48.862059] [INFO ] [MAIN      ] TFII: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:49.155867] [INFO ] [MAIN      ] TEX: Generated 139 derivative records from 43837 primary records.
[2025-10-24T01:29:49.157071] [DEBUG] [LOCAL     ] TEX: Saving derivative data.
[2025-10-24T01:29:49.169859] [DEBUG] [LOCAL     ] TFII: Loaded 32486 existing records from primary storage.
[2025-10-24T01:29:49.178538] [INFO ] [MAIN      ] TFII: Loaded 32486 primary data records.
[2025-10-24T01:29:49.189729] [DEBUG] [LOCAL     ] TEX: Derivative data saved (139 records).
[2025-10-24T01:29:49.190062] [INFO ] [MAIN      ] TEX: Successfully saved derivative data.
[2025-10-24T01:29:49.210444] [INFO ] [MAIN      ] Derivative Progress: 1884/2164 symbols completed. TEX took 1.3s. Estimated remaining: 1m 57s. Rate: 143.4 symbols/min
[2025-10-24T01:29:49.227521] [INFO ] [MAIN      ] TFIN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:49.514796] [DEBUG] [LOCAL     ] TFIN: Loaded 23831 existing records from primary storage.
[2025-10-24T01:29:49.515380] [INFO ] [MAIN      ] TFIN: Loaded 23831 primary data records.
[2025-10-24T01:29:49.581285] [DEBUG] [MAIN      ] TFC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:49.883922] [DEBUG] [MAIN      ] TFII: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:49.914101] [INFO ] [MAIN      ] TFC: Generated 139 derivative records from 54057 primary records.
[2025-10-24T01:29:49.914575] [DEBUG] [LOCAL     ] TFC: Saving derivative data.
[2025-10-24T01:29:49.936112] [DEBUG] [LOCAL     ] TFC: Derivative data saved (139 records).
[2025-10-24T01:29:49.949311] [INFO ] [MAIN      ] TFC: Successfully saved derivative data.
[2025-10-24T01:29:49.955310] [DEBUG] [MAIN      ] TFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:49.954572] [INFO ] [MAIN      ] Derivative Progress: 1885/2164 symbols completed. TFC took 1.3s. Estimated remaining: 1m 57s. Rate: 143.4 symbols/min
[2025-10-24T01:29:49.973434] [INFO ] [MAIN      ] TFPM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:49.991149] [INFO ] [MAIN      ] TFII: Generated 139 derivative records from 32486 primary records.
[2025-10-24T01:29:49.992051] [DEBUG] [LOCAL     ] TFII: Saving derivative data.
[2025-10-24T01:29:50.010546] [DEBUG] [LOCAL     ] TFII: Derivative data saved (139 records).
[2025-10-24T01:29:50.010823] [INFO ] [MAIN      ] TFII: Successfully saved derivative data.
[2025-10-24T01:29:50.013419] [INFO ] [MAIN      ] Derivative Progress: 1886/2164 symbols completed. TFII took 1.2s. Estimated remaining: 1m 56s. Rate: 143.4 symbols/min
[2025-10-24T01:29:50.013734] [INFO ] [MAIN      ] TFX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:50.031981] [INFO ] [MAIN      ] TFIN: Generated 139 derivative records from 23831 primary records.
[2025-10-24T01:29:50.032265] [DEBUG] [LOCAL     ] TFIN: Saving derivative data.
[2025-10-24T01:29:50.056863] [DEBUG] [LOCAL     ] TFIN: Derivative data saved (139 records).
[2025-10-24T01:29:50.057166] [INFO ] [MAIN      ] TFIN: Successfully saved derivative data.
[2025-10-24T01:29:50.057887] [DEBUG] [LOCAL     ] TFPM: Loaded 40157 existing records from primary storage.
[2025-10-24T01:29:50.060514] [INFO ] [MAIN      ] Derivative Progress: 1887/2164 symbols completed. TFIN took 0.8s. Estimated remaining: 1m 56s. Rate: 143.5 symbols/min
[2025-10-24T01:29:50.060704] [INFO ] [MAIN      ] TFPM: Loaded 40157 primary data records.
[2025-10-24T01:29:50.061111] [INFO ] [MAIN      ] TG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:50.248492] [DEBUG] [LOCAL     ] TFX: Loaded 35805 existing records from primary storage.
[2025-10-24T01:29:50.277571] [DEBUG] [LOCAL     ] TG: Loaded 10709 existing records from primary storage.
[2025-10-24T01:29:50.296720] [INFO ] [MAIN      ] TG: Loaded 10709 primary data records.
[2025-10-24T01:29:50.296877] [INFO ] [MAIN      ] TFX: Loaded 35805 primary data records.
[2025-10-24T01:29:51.069127] [DEBUG] [MAIN      ] TFPM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:51.135788] [DEBUG] [MAIN      ] TFX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:51.132469] [DEBUG] [MAIN      ] TG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:51.170579] [INFO ] [MAIN      ] TFPM: Generated 139 derivative records from 40157 primary records.
[2025-10-24T01:29:51.174886] [DEBUG] [LOCAL     ] TFPM: Saving derivative data.
[2025-10-24T01:29:51.192699] [DEBUG] [LOCAL     ] TFPM: Derivative data saved (139 records).
[2025-10-24T01:29:51.197841] [INFO ] [MAIN      ] TFPM: Successfully saved derivative data.
[2025-10-24T01:29:51.200881] [INFO ] [MAIN      ] Derivative Progress: 1888/2164 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 56s. Rate: 143.4 symbols/min
[2025-10-24T01:29:51.224284] [INFO ] [MAIN      ] TG: Generated 139 derivative records from 10709 primary records.
[2025-10-24T01:29:51.224743] [DEBUG] [LOCAL     ] TG: Saving derivative data.
[2025-10-24T01:29:51.224666] [INFO ] [MAIN      ] TFX: Generated 139 derivative records from 35805 primary records.
[2025-10-24T01:29:51.225185] [DEBUG] [LOCAL     ] TFX: Saving derivative data.
[2025-10-24T01:29:51.246698] [DEBUG] [LOCAL     ] TG: Derivative data saved (139 records).
[2025-10-24T01:29:51.248695] [DEBUG] [LOCAL     ] TFX: Derivative data saved (139 records).
[2025-10-24T01:29:51.248793] [INFO ] [MAIN      ] TFX: Successfully saved derivative data.
[2025-10-24T01:29:51.248856] [INFO ] [MAIN      ] TG: Successfully saved derivative data.
[2025-10-24T01:29:51.251538] [INFO ] [MAIN      ] Derivative Progress: 1889/2164 symbols completed. TFX took 1.2s. Estimated remaining: 1m 55s. Rate: 143.4 symbols/min
[2025-10-24T01:29:51.254355] [INFO ] [MAIN      ] Derivative Progress: 1890/2164 symbols completed. TG took 1.2s. Estimated remaining: 1m 55s. Rate: 143.5 symbols/min
[2025-10-24T01:29:51.254824] [INFO ] [MAIN      ] TGLS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:51.254996] [INFO ] [MAIN      ] TGS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:51.254903] [INFO ] [MAIN      ] TGNA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:51.294595] [DEBUG] [LOCAL     ] TGLS: Loaded 27762 existing records from primary storage.
[2025-10-24T01:29:51.294809] [INFO ] [MAIN      ] TGLS: Loaded 27762 primary data records.
[2025-10-24T01:29:51.388796] [DEBUG] [LOCAL     ] TGS: Loaded 34102 existing records from primary storage.
[2025-10-24T01:29:51.424218] [INFO ] [MAIN      ] TGS: Loaded 34102 primary data records.
[2025-10-24T01:29:51.523044] [DEBUG] [LOCAL     ] TGNA: Loaded 48836 existing records from primary storage.
[2025-10-24T01:29:51.558253] [INFO ] [MAIN      ] TGNA: Loaded 48836 primary data records.
[2025-10-24T01:29:52.294505] [DEBUG] [MAIN      ] TGLS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:52.336552] [DEBUG] [MAIN      ] TGS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:52.376466] [DEBUG] [MAIN      ] TGNA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:52.405700] [INFO ] [MAIN      ] TGLS: Generated 139 derivative records from 27762 primary records.
[2025-10-24T01:29:52.409171] [DEBUG] [LOCAL     ] TGLS: Saving derivative data.
[2025-10-24T01:29:52.425409] [DEBUG] [LOCAL     ] TGLS: Derivative data saved (139 records).
[2025-10-24T01:29:52.425705] [INFO ] [MAIN      ] TGLS: Successfully saved derivative data.
[2025-10-24T01:29:52.428339] [INFO ] [MAIN      ] Derivative Progress: 1891/2164 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 54s. Rate: 143.4 symbols/min
[2025-10-24T01:29:52.429893] [INFO ] [MAIN      ] TGT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:52.441010] [INFO ] [MAIN      ] TGS: Generated 139 derivative records from 34102 primary records.
[2025-10-24T01:29:52.441377] [DEBUG] [LOCAL     ] TGS: Saving derivative data.
[2025-10-24T01:29:52.457278] [DEBUG] [LOCAL     ] TGS: Derivative data saved (139 records).
[2025-10-24T01:29:52.457419] [INFO ] [MAIN      ] TGS: Successfully saved derivative data.
[2025-10-24T01:29:52.460603] [INFO ] [MAIN      ] Derivative Progress: 1892/2164 symbols completed. TGS took 1.2s. Estimated remaining: 1m 54s. Rate: 143.4 symbols/min
[2025-10-24T01:29:52.462991] [INFO ] [MAIN      ] THC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:52.468872] [INFO ] [MAIN      ] TGNA: Generated 139 derivative records from 48836 primary records.
[2025-10-24T01:29:52.469086] [DEBUG] [LOCAL     ] TGNA: Saving derivative data.
[2025-10-24T01:29:52.482300] [DEBUG] [LOCAL     ] TGNA: Derivative data saved (139 records).
[2025-10-24T01:29:52.482494] [INFO ] [MAIN      ] TGNA: Successfully saved derivative data.
[2025-10-24T01:29:52.485505] [INFO ] [MAIN      ] Derivative Progress: 1893/2164 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 53s. Rate: 143.5 symbols/min
[2025-10-24T01:29:52.485805] [INFO ] [MAIN      ] THG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:52.549264] [DEBUG] [LOCAL     ] THG: Loaded 21631 existing records from primary storage.
[2025-10-24T01:29:52.540840] [DEBUG] [LOCAL     ] TGT: Loaded 54167 existing records from primary storage.
[2025-10-24T01:29:52.551057] [INFO ] [MAIN      ] TGT: Loaded 54167 primary data records.
[2025-10-24T01:29:52.550966] [INFO ] [MAIN      ] THG: Loaded 21631 primary data records.
[2025-10-24T01:29:52.613370] [DEBUG] [LOCAL     ] THC: Loaded 46974 existing records from primary storage.
[2025-10-24T01:29:52.652434] [INFO ] [MAIN      ] THC: Loaded 46974 primary data records.
[2025-10-24T01:29:53.550825] [DEBUG] [MAIN      ] TGT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:53.602768] [DEBUG] [MAIN      ] THG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:53.601318] [DEBUG] [MAIN      ] THC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:53.665016] [INFO ] [MAIN      ] TGT: Generated 139 derivative records from 54167 primary records.
[2025-10-24T01:29:53.668092] [DEBUG] [LOCAL     ] TGT: Saving derivative data.
[2025-10-24T01:29:53.689802] [DEBUG] [LOCAL     ] TGT: Derivative data saved (139 records).
[2025-10-24T01:29:53.690210] [INFO ] [MAIN      ] TGT: Successfully saved derivative data.
[2025-10-24T01:29:53.692819] [INFO ] [MAIN      ] Derivative Progress: 1894/2164 symbols completed. TGT took 1.3s. Estimated remaining: 1m 53s. Rate: 143.4 symbols/min
[2025-10-24T01:29:53.695792] [INFO ] [MAIN      ] THIR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:53.700879] [INFO ] [MAIN      ] THC: Generated 139 derivative records from 46974 primary records.
[2025-10-24T01:29:53.705292] [INFO ] [MAIN      ] THG: Generated 139 derivative records from 21631 primary records.
[2025-10-24T01:29:53.705107] [DEBUG] [LOCAL     ] THC: Saving derivative data.
[2025-10-24T01:29:53.705737] [DEBUG] [LOCAL     ] THG: Saving derivative data.
[2025-10-24T01:29:53.708629] [DEBUG] [LOCAL     ] THIR: Loaded 2480 existing records from primary storage.
[2025-10-24T01:29:53.709259] [INFO ] [MAIN      ] THIR: Loaded 2480 primary data records.
[2025-10-24T01:29:53.764671] [DEBUG] [LOCAL     ] THG: Derivative data saved (139 records).
[2025-10-24T01:29:53.802853] [DEBUG] [LOCAL     ] THC: Derivative data saved (139 records).
[2025-10-24T01:29:53.835698] [INFO ] [MAIN      ] THC: Successfully saved derivative data.
[2025-10-24T01:29:53.802952] [INFO ] [MAIN      ] THG: Successfully saved derivative data.
[2025-10-24T01:29:53.842126] [INFO ] [MAIN      ] Derivative Progress: 1895/2164 symbols completed. THC took 1.4s. Estimated remaining: 1m 53s. Rate: 143.4 symbols/min
[2025-10-24T01:29:53.845069] [INFO ] [MAIN      ] THLV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:53.845265] [INFO ] [MAIN      ] Derivative Progress: 1896/2164 symbols completed. THG took 1.4s. Estimated remaining: 1m 52s. Rate: 143.5 symbols/min
[2025-10-24T01:29:53.866368] [INFO ] [MAIN      ] THO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:54.043625] [DEBUG] [LOCAL     ] THLV: Loaded 1496 existing records from primary storage.
[2025-10-24T01:29:54.043910] [INFO ] [MAIN      ] THLV: Loaded 1496 primary data records.
[2025-10-24T01:29:54.388148] [DEBUG] [LOCAL     ] THO: Loaded 41235 existing records from primary storage.
[2025-10-24T01:29:54.397410] [INFO ] [MAIN      ] THO: Loaded 41235 primary data records.
[2025-10-24T01:29:54.583088] [DEBUG] [MAIN      ] THIR: Filtered 6966 bins outside market hours, 7762 incomplete bins
[2025-10-24T01:29:54.782586] [DEBUG] [MAIN      ] THLV: Filtered 6966 bins outside market hours, 7761 incomplete bins
[2025-10-24T01:29:54.820400] [INFO ] [MAIN      ] THIR: Generated 139 derivative records from 2480 primary records.
[2025-10-24T01:29:54.821360] [DEBUG] [LOCAL     ] THIR: Saving derivative data.
[2025-10-24T01:29:54.837986] [DEBUG] [LOCAL     ] THIR: Derivative data saved (139 records).
[2025-10-24T01:29:54.839668] [INFO ] [MAIN      ] THIR: Successfully saved derivative data.
[2025-10-24T01:29:54.842321] [INFO ] [MAIN      ] Derivative Progress: 1897/2164 symbols completed. THIR took 1.1s. Estimated remaining: 1m 52s. Rate: 143.4 symbols/min
[2025-10-24T01:29:54.842803] [INFO ] [MAIN      ] THQ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:54.861263] [DEBUG] [MAIN      ] THO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:54.899973] [INFO ] [MAIN      ] THLV: Generated 139 derivative records from 1496 primary records.
[2025-10-24T01:29:54.901750] [DEBUG] [LOCAL     ] THLV: Saving derivative data.
[2025-10-24T01:29:54.925166] [DEBUG] [LOCAL     ] THLV: Derivative data saved (139 records).
[2025-10-24T01:29:54.927446] [INFO ] [MAIN      ] THLV: Successfully saved derivative data.
[2025-10-24T01:29:54.929982] [DEBUG] [LOCAL     ] THQ: Loaded 25471 existing records from primary storage.
[2025-10-24T01:29:54.934282] [INFO ] [MAIN      ] THQ: Loaded 25471 primary data records.
[2025-10-24T01:29:54.934039] [INFO ] [MAIN      ] Derivative Progress: 1898/2164 symbols completed. THLV took 1.1s. Estimated remaining: 1m 51s. Rate: 143.4 symbols/min
[2025-10-24T01:29:54.965990] [INFO ] [MAIN      ] THR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:55.292778] [DEBUG] [LOCAL     ] THR: Loaded 19624 existing records from primary storage.
[2025-10-24T01:29:55.297291] [INFO ] [MAIN      ] THR: Loaded 19624 primary data records.
[2025-10-24T01:29:55.297721] [INFO ] [MAIN      ] THO: Generated 139 derivative records from 41235 primary records.
[2025-10-24T01:29:55.298479] [DEBUG] [LOCAL     ] THO: Saving derivative data.
[2025-10-24T01:29:55.363682] [DEBUG] [LOCAL     ] THO: Derivative data saved (139 records).
[2025-10-24T01:29:55.387318] [INFO ] [MAIN      ] THO: Successfully saved derivative data.
[2025-10-24T01:29:55.395388] [INFO ] [MAIN      ] Derivative Progress: 1899/2164 symbols completed. THO took 1.5s. Estimated remaining: 1m 51s. Rate: 143.4 symbols/min
[2025-10-24T01:29:55.403931] [INFO ] [MAIN      ] THS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:55.706964] [DEBUG] [MAIN      ] THQ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:55.705308] [DEBUG] [LOCAL     ] THS: Loaded 38900 existing records from primary storage.
[2025-10-24T01:29:55.707261] [INFO ] [MAIN      ] THS: Loaded 38900 primary data records.
[2025-10-24T01:29:56.078125] [DEBUG] [MAIN      ] THR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:56.094260] [INFO ] [MAIN      ] THQ: Generated 139 derivative records from 25471 primary records.
[2025-10-24T01:29:56.097380] [DEBUG] [LOCAL     ] THQ: Saving derivative data.
[2025-10-24T01:29:56.116572] [DEBUG] [LOCAL     ] THQ: Derivative data saved (139 records).
[2025-10-24T01:29:56.117722] [INFO ] [MAIN      ] THQ: Successfully saved derivative data.
[2025-10-24T01:29:56.122149] [INFO ] [MAIN      ] Derivative Progress: 1900/2164 symbols completed. THQ took 1.3s. Estimated remaining: 1m 50s. Rate: 143.4 symbols/min
[2025-10-24T01:29:56.125932] [INFO ] [MAIN      ] THW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:56.149283] [DEBUG] [MAIN      ] THS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:56.181405] [INFO ] [MAIN      ] THR: Generated 139 derivative records from 19624 primary records.
[2025-10-24T01:29:56.190939] [DEBUG] [LOCAL     ] THW: Loaded 19695 existing records from primary storage.
[2025-10-24T01:29:56.191488] [INFO ] [MAIN      ] THW: Loaded 19695 primary data records.
[2025-10-24T01:29:56.191264] [DEBUG] [LOCAL     ] THR: Saving derivative data.
[2025-10-24T01:29:56.262198] [DEBUG] [LOCAL     ] THR: Derivative data saved (139 records).
[2025-10-24T01:29:56.283892] [INFO ] [MAIN      ] THR: Successfully saved derivative data.
[2025-10-24T01:29:56.308721] [INFO ] [MAIN      ] Derivative Progress: 1901/2164 symbols completed. THR took 1.3s. Estimated remaining: 1m 50s. Rate: 143.4 symbols/min
[2025-10-24T01:29:56.317355] [INFO ] [MAIN      ] TIMB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:56.410753] [INFO ] [MAIN      ] THS: Generated 139 derivative records from 38900 primary records.
[2025-10-24T01:29:56.431430] [DEBUG] [LOCAL     ] THS: Saving derivative data.
[2025-10-24T01:29:56.575499] [DEBUG] [LOCAL     ] THS: Derivative data saved (139 records).
[2025-10-24T01:29:56.588240] [INFO ] [MAIN      ] THS: Successfully saved derivative data.
[2025-10-24T01:29:56.591452] [INFO ] [MAIN      ] Derivative Progress: 1902/2164 symbols completed. THS took 1.2s. Estimated remaining: 1m 50s. Rate: 143.4 symbols/min
[2025-10-24T01:29:56.592047] [INFO ] [MAIN      ] TISI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:56.593629] [DEBUG] [LOCAL     ] TIMB: Loaded 34898 existing records from primary storage.
[2025-10-24T01:29:56.595098] [INFO ] [MAIN      ] TIMB: Loaded 34898 primary data records.
[2025-10-24T01:29:56.657778] [DEBUG] [LOCAL     ] TISI: Loaded 3185 existing records from primary storage.
[2025-10-24T01:29:56.698435] [INFO ] [MAIN      ] TISI: Loaded 3185 primary data records.
[2025-10-24T01:29:57.293821] [DEBUG] [MAIN      ] THW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:57.353489] [DEBUG] [MAIN      ] TIMB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:57.388279] [DEBUG] [MAIN      ] TISI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:57.387100] [INFO ] [MAIN      ] THW: Generated 139 derivative records from 19695 primary records.
[2025-10-24T01:29:57.390709] [DEBUG] [LOCAL     ] THW: Saving derivative data.
[2025-10-24T01:29:57.425206] [DEBUG] [LOCAL     ] THW: Derivative data saved (139 records).
[2025-10-24T01:29:57.429943] [INFO ] [MAIN      ] THW: Successfully saved derivative data.
[2025-10-24T01:29:57.434405] [INFO ] [MAIN      ] Derivative Progress: 1903/2164 symbols completed. THW took 1.3s. Estimated remaining: 1m 49s. Rate: 143.4 symbols/min
[2025-10-24T01:29:57.464941] [INFO ] [MAIN      ] TIMB: Generated 139 derivative records from 34898 primary records.
[2025-10-24T01:29:57.466817] [INFO ] [MAIN      ] TISI: Generated 139 derivative records from 3185 primary records.
[2025-10-24T01:29:57.467132] [DEBUG] [LOCAL     ] TISI: Saving derivative data.
[2025-10-24T01:29:57.467048] [DEBUG] [LOCAL     ] TIMB: Saving derivative data.
[2025-10-24T01:29:57.489042] [DEBUG] [LOCAL     ] TISI: Derivative data saved (139 records).
[2025-10-24T01:29:57.489164] [INFO ] [MAIN      ] TISI: Successfully saved derivative data.
[2025-10-24T01:29:57.491877] [INFO ] [MAIN      ] Derivative Progress: 1904/2164 symbols completed. TISI took 0.9s. Estimated remaining: 1m 49s. Rate: 143.4 symbols/min
[2025-10-24T01:29:57.493382] [DEBUG] [LOCAL     ] TIMB: Derivative data saved (139 records).
[2025-10-24T01:29:57.493721] [INFO ] [MAIN      ] TIMB: Successfully saved derivative data.
[2025-10-24T01:29:57.496037] [INFO ] [MAIN      ] Derivative Progress: 1905/2164 symbols completed. TIMB took 1.2s. Estimated remaining: 1m 48s. Rate: 143.5 symbols/min
[2025-10-24T01:29:57.496854] [INFO ] [MAIN      ] TK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:57.496999] [INFO ] [MAIN      ] TJX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:57.496693] [INFO ] [MAIN      ] TIXT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:57.546968] [DEBUG] [LOCAL     ] TIXT: Loaded 32881 existing records from primary storage.
[2025-10-24T01:29:57.558766] [INFO ] [MAIN      ] TIXT: Loaded 32881 primary data records.
[2025-10-24T01:29:57.564993] [DEBUG] [LOCAL     ] TK: Loaded 39324 existing records from primary storage.
[2025-10-24T01:29:57.640805] [INFO ] [MAIN      ] TK: Loaded 39324 primary data records.
[2025-10-24T01:29:57.791440] [DEBUG] [LOCAL     ] TJX: Loaded 54050 existing records from primary storage.
[2025-10-24T01:29:57.827749] [INFO ] [MAIN      ] TJX: Loaded 54050 primary data records.
[2025-10-24T01:29:58.569750] [DEBUG] [MAIN      ] TIXT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:58.617340] [DEBUG] [MAIN      ] TK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:58.658564] [DEBUG] [MAIN      ] TJX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:58.712809] [INFO ] [MAIN      ] TIXT: Generated 139 derivative records from 32881 primary records.
[2025-10-24T01:29:58.717704] [DEBUG] [LOCAL     ] TIXT: Saving derivative data.
[2025-10-24T01:29:58.735933] [DEBUG] [LOCAL     ] TIXT: Derivative data saved (139 records).
[2025-10-24T01:29:58.739327] [INFO ] [MAIN      ] TIXT: Successfully saved derivative data.
[2025-10-24T01:29:58.739575] [INFO ] [MAIN      ] TK: Generated 139 derivative records from 39324 primary records.
[2025-10-24T01:29:58.743309] [INFO ] [MAIN      ] Derivative Progress: 1906/2164 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 48s. Rate: 143.4 symbols/min
[2025-10-24T01:29:58.744018] [INFO ] [MAIN      ] TKC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:58.744107] [DEBUG] [LOCAL     ] TK: Saving derivative data.
[2025-10-24T01:29:58.761938] [DEBUG] [LOCAL     ] TK: Derivative data saved (139 records).
[2025-10-24T01:29:58.762204] [INFO ] [MAIN      ] TK: Successfully saved derivative data.
[2025-10-24T01:29:58.767108] [INFO ] [MAIN      ] Derivative Progress: 1907/2164 symbols completed. TK took 1.3s. Estimated remaining: 1m 48s. Rate: 143.4 symbols/min
[2025-10-24T01:29:58.769618] [INFO ] [MAIN      ] TKO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:58.770211] [INFO ] [MAIN      ] TJX: Generated 139 derivative records from 54050 primary records.
[2025-10-24T01:29:58.771095] [DEBUG] [LOCAL     ] TJX: Saving derivative data.
[2025-10-24T01:29:58.785619] [DEBUG] [LOCAL     ] TJX: Derivative data saved (139 records).
[2025-10-24T01:29:58.785921] [INFO ] [MAIN      ] TJX: Successfully saved derivative data.
[2025-10-24T01:29:58.790259] [INFO ] [MAIN      ] Derivative Progress: 1908/2164 symbols completed. TJX took 1.3s. Estimated remaining: 1m 47s. Rate: 143.5 symbols/min
[2025-10-24T01:29:58.790561] [INFO ] [MAIN      ] TKR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:29:58.827016] [DEBUG] [LOCAL     ] TKC: Loaded 40332 existing records from primary storage.
[2025-10-24T01:29:58.837058] [INFO ] [MAIN      ] TKC: Loaded 40332 primary data records.
[2025-10-24T01:29:58.954286] [DEBUG] [LOCAL     ] TKR: Loaded 39524 existing records from primary storage.
[2025-10-24T01:29:58.978527] [INFO ] [MAIN      ] TKR: Loaded 39524 primary data records.
[2025-10-24T01:29:59.012778] [DEBUG] [LOCAL     ] TKO: Loaded 43818 existing records from primary storage.
[2025-10-24T01:29:59.076459] [INFO ] [MAIN      ] TKO: Loaded 43818 primary data records.
[2025-10-24T01:29:59.857443] [DEBUG] [MAIN      ] TKC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:59.892076] [DEBUG] [MAIN      ] TKR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:59.960815] [INFO ] [MAIN      ] TKC: Generated 139 derivative records from 40332 primary records.
[2025-10-24T01:29:59.961434] [DEBUG] [MAIN      ] TKO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:29:59.962130] [DEBUG] [LOCAL     ] TKC: Saving derivative data.
[2025-10-24T01:29:59.992991] [DEBUG] [LOCAL     ] TKC: Derivative data saved (139 records).
[2025-10-24T01:29:59.994932] [INFO ] [MAIN      ] TKC: Successfully saved derivative data.
[2025-10-24T01:29:59.999966] [INFO ] [MAIN      ] Derivative Progress: 1909/2164 symbols completed. TKC took 1.3s. Estimated remaining: 1m 47s. Rate: 143.4 symbols/min
[2025-10-24T01:30:00.003432] [INFO ] [MAIN      ] TLK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:00.009312] [INFO ] [MAIN      ] TKR: Generated 139 derivative records from 39524 primary records.
[2025-10-24T01:30:00.010043] [DEBUG] [LOCAL     ] TKR: Saving derivative data.
[2025-10-24T01:30:00.025424] [DEBUG] [LOCAL     ] TKR: Derivative data saved (139 records).
[2025-10-24T01:30:00.025627] [INFO ] [MAIN      ] TKR: Successfully saved derivative data.
[2025-10-24T01:30:00.029769] [INFO ] [MAIN      ] Derivative Progress: 1910/2164 symbols completed. TKR took 1.2s. Estimated remaining: 1m 46s. Rate: 143.4 symbols/min
[2025-10-24T01:30:00.030008] [INFO ] [MAIN      ] TLYS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:00.040423] [INFO ] [MAIN      ] TKO: Generated 139 derivative records from 43818 primary records.
[2025-10-24T01:30:00.040569] [DEBUG] [LOCAL     ] TKO: Saving derivative data.
[2025-10-24T01:30:00.053578] [DEBUG] [LOCAL     ] TKO: Derivative data saved (139 records).
[2025-10-24T01:30:00.053751] [INFO ] [MAIN      ] TKO: Successfully saved derivative data.
[2025-10-24T01:30:00.058128] [INFO ] [MAIN      ] Derivative Progress: 1911/2164 symbols completed. TKO took 1.3s. Estimated remaining: 1m 46s. Rate: 143.5 symbols/min
[2025-10-24T01:30:00.063594] [INFO ] [MAIN      ] TM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:00.081941] [DEBUG] [LOCAL     ] TLYS: Loaded 16609 existing records from primary storage.
[2025-10-24T01:30:00.082159] [INFO ] [MAIN      ] TLYS: Loaded 16609 primary data records.
[2025-10-24T01:30:00.199348] [DEBUG] [LOCAL     ] TLK: Loaded 39028 existing records from primary storage.
[2025-10-24T01:30:00.247597] [INFO ] [MAIN      ] TLK: Loaded 39028 primary data records.
[2025-10-24T01:30:00.343806] [DEBUG] [LOCAL     ] TM: Loaded 36277 existing records from primary storage.
[2025-10-24T01:30:00.485244] [INFO ] [MAIN      ] TM: Loaded 36277 primary data records.
[2025-10-24T01:30:01.049422] [DEBUG] [MAIN      ] TLYS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:01.086267] [DEBUG] [MAIN      ] TLK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:01.137634] [DEBUG] [MAIN      ] TM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:01.178134] [INFO ] [MAIN      ] TLYS: Generated 139 derivative records from 16609 primary records.
[2025-10-24T01:30:01.180679] [DEBUG] [LOCAL     ] TLYS: Saving derivative data.
[2025-10-24T01:30:01.185012] [INFO ] [MAIN      ] TLK: Generated 139 derivative records from 39028 primary records.
[2025-10-24T01:30:01.186907] [DEBUG] [LOCAL     ] TLK: Saving derivative data.
[2025-10-24T01:30:01.200015] [DEBUG] [LOCAL     ] TLYS: Derivative data saved (139 records).
[2025-10-24T01:30:01.200321] [INFO ] [MAIN      ] TLYS: Successfully saved derivative data.
[2025-10-24T01:30:01.202662] [INFO ] [MAIN      ] Derivative Progress: 1912/2164 symbols completed. TLYS took 1.2s. Estimated remaining: 1m 45s. Rate: 143.4 symbols/min
[2025-10-24T01:30:01.203301] [INFO ] [MAIN      ] TME: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:01.217560] [DEBUG] [LOCAL     ] TLK: Derivative data saved (139 records).
[2025-10-24T01:30:01.217772] [INFO ] [MAIN      ] TLK: Successfully saved derivative data.
[2025-10-24T01:30:01.220847] [INFO ] [MAIN      ] Derivative Progress: 1913/2164 symbols completed. TLK took 1.2s. Estimated remaining: 1m 45s. Rate: 143.4 symbols/min
[2025-10-24T01:30:01.221104] [INFO ] [MAIN      ] TMHC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:01.229166] [INFO ] [MAIN      ] TM: Generated 139 derivative records from 36277 primary records.
[2025-10-24T01:30:01.229366] [DEBUG] [LOCAL     ] TM: Saving derivative data.
[2025-10-24T01:30:01.242442] [DEBUG] [LOCAL     ] TM: Derivative data saved (139 records).
[2025-10-24T01:30:01.242689] [INFO ] [MAIN      ] TM: Successfully saved derivative data.
[2025-10-24T01:30:01.247637] [INFO ] [MAIN      ] Derivative Progress: 1914/2164 symbols completed. TM took 1.2s. Estimated remaining: 1m 45s. Rate: 143.5 symbols/min
[2025-10-24T01:30:01.248145] [INFO ] [MAIN      ] TMO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:01.313919] [DEBUG] [LOCAL     ] TME: Loaded 53583 existing records from primary storage.
[2025-10-24T01:30:01.314943] [INFO ] [MAIN      ] TME: Loaded 53583 primary data records.
[2025-10-24T01:30:01.314851] [DEBUG] [LOCAL     ] TMHC: Loaded 46022 existing records from primary storage.
[2025-10-24T01:30:01.315285] [INFO ] [MAIN      ] TMHC: Loaded 46022 primary data records.
[2025-10-24T01:30:01.621928] [DEBUG] [LOCAL     ] TMO: Loaded 52781 existing records from primary storage.
[2025-10-24T01:30:01.640114] [INFO ] [MAIN      ] TMO: Loaded 52781 primary data records.
[2025-10-24T01:30:02.357046] [DEBUG] [MAIN      ] TMHC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:02.357867] [DEBUG] [MAIN      ] TME: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:02.435632] [DEBUG] [MAIN      ] TMO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:02.461527] [INFO ] [MAIN      ] TME: Generated 139 derivative records from 53583 primary records.
[2025-10-24T01:30:02.463502] [DEBUG] [LOCAL     ] TME: Saving derivative data.
[2025-10-24T01:30:02.468264] [INFO ] [MAIN      ] TMHC: Generated 139 derivative records from 46022 primary records.
[2025-10-24T01:30:02.477841] [DEBUG] [LOCAL     ] TMHC: Saving derivative data.
[2025-10-24T01:30:02.480359] [DEBUG] [LOCAL     ] TME: Derivative data saved (139 records).
[2025-10-24T01:30:02.482028] [INFO ] [MAIN      ] TME: Successfully saved derivative data.
[2025-10-24T01:30:02.494215] [INFO ] [MAIN      ] Derivative Progress: 1915/2164 symbols completed. TME took 1.3s. Estimated remaining: 1m 44s. Rate: 143.4 symbols/min
[2025-10-24T01:30:02.495031] [INFO ] [MAIN      ] TNC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:02.498155] [DEBUG] [LOCAL     ] TMHC: Derivative data saved (139 records).
[2025-10-24T01:30:02.501346] [INFO ] [MAIN      ] TMHC: Successfully saved derivative data.
[2025-10-24T01:30:02.503539] [INFO ] [MAIN      ] Derivative Progress: 1916/2164 symbols completed. TMHC took 1.3s. Estimated remaining: 1m 44s. Rate: 143.4 symbols/min
[2025-10-24T01:30:02.505437] [INFO ] [MAIN      ] TNET: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:02.523960] [DEBUG] [LOCAL     ] TNC: Loaded 14222 existing records from primary storage.
[2025-10-24T01:30:02.526463] [INFO ] [MAIN      ] TMO: Generated 139 derivative records from 52781 primary records.
[2025-10-24T01:30:02.526628] [INFO ] [MAIN      ] TNC: Loaded 14222 primary data records.
[2025-10-24T01:30:02.537988] [DEBUG] [LOCAL     ] TMO: Saving derivative data.
[2025-10-24T01:30:02.675017] [DEBUG] [LOCAL     ] TMO: Derivative data saved (139 records).
[2025-10-24T01:30:02.661880] [DEBUG] [LOCAL     ] TNET: Loaded 28369 existing records from primary storage.
[2025-10-24T01:30:02.685463] [INFO ] [MAIN      ] TNET: Loaded 28369 primary data records.
[2025-10-24T01:30:02.685674] [INFO ] [MAIN      ] TMO: Successfully saved derivative data.
[2025-10-24T01:30:02.699819] [INFO ] [MAIN      ] Derivative Progress: 1917/2164 symbols completed. TMO took 1.5s. Estimated remaining: 1m 43s. Rate: 143.5 symbols/min
[2025-10-24T01:30:02.746783] [INFO ] [MAIN      ] TNK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:03.194238] [DEBUG] [LOCAL     ] TNK: Loaded 35590 existing records from primary storage.
[2025-10-24T01:30:03.196046] [INFO ] [MAIN      ] TNK: Loaded 35590 primary data records.
[2025-10-24T01:30:03.515124] [DEBUG] [MAIN      ] TNC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:03.554296] [DEBUG] [MAIN      ] TNET: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:03.603423] [INFO ] [MAIN      ] TNC: Generated 139 derivative records from 14222 primary records.
[2025-10-24T01:30:03.619865] [DEBUG] [LOCAL     ] TNC: Saving derivative data.
[2025-10-24T01:30:03.619470] [DEBUG] [MAIN      ] TNK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:03.649790] [DEBUG] [LOCAL     ] TNC: Derivative data saved (139 records).
[2025-10-24T01:30:03.655195] [INFO ] [MAIN      ] TNET: Generated 139 derivative records from 28369 primary records.
[2025-10-24T01:30:03.652894] [INFO ] [MAIN      ] TNC: Successfully saved derivative data.
[2025-10-24T01:30:03.655328] [DEBUG] [LOCAL     ] TNET: Saving derivative data.
[2025-10-24T01:30:03.659715] [INFO ] [MAIN      ] Derivative Progress: 1918/2164 symbols completed. TNC took 1.2s. Estimated remaining: 1m 43s. Rate: 143.4 symbols/min
[2025-10-24T01:30:03.673551] [DEBUG] [LOCAL     ] TNET: Derivative data saved (139 records).
[2025-10-24T01:30:03.673925] [INFO ] [MAIN      ] TNET: Successfully saved derivative data.
[2025-10-24T01:30:03.678952] [INFO ] [MAIN      ] Derivative Progress: 1919/2164 symbols completed. TNET took 1.2s. Estimated remaining: 1m 42s. Rate: 143.5 symbols/min
[2025-10-24T01:30:03.687205] [INFO ] [MAIN      ] TNK: Generated 139 derivative records from 35590 primary records.
[2025-10-24T01:30:03.687336] [DEBUG] [LOCAL     ] TNK: Saving derivative data.
[2025-10-24T01:30:03.698785] [DEBUG] [LOCAL     ] TNK: Derivative data saved (139 records).
[2025-10-24T01:30:03.698871] [INFO ] [MAIN      ] TNK: Successfully saved derivative data.
[2025-10-24T01:30:03.701577] [INFO ] [MAIN      ] Derivative Progress: 1920/2164 symbols completed. TNK took 1.0s. Estimated remaining: 1m 42s. Rate: 143.5 symbols/min
[2025-10-24T01:30:03.701996] [INFO ] [MAIN      ] TNL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:03.702042] [INFO ] [MAIN      ] TOL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:03.702085] [INFO ] [MAIN      ] TOST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:03.772784] [DEBUG] [LOCAL     ] TNL: Loaded 42070 existing records from primary storage.
[2025-10-24T01:30:03.773167] [INFO ] [MAIN      ] TNL: Loaded 42070 primary data records.
[2025-10-24T01:30:03.918983] [DEBUG] [LOCAL     ] TOL: Loaded 50843 existing records from primary storage.
[2025-10-24T01:30:03.920175] [DEBUG] [LOCAL     ] TOST: Loaded 54080 existing records from primary storage.
[2025-10-24T01:30:03.960252] [INFO ] [MAIN      ] TOST: Loaded 54080 primary data records.
[2025-10-24T01:30:03.936601] [INFO ] [MAIN      ] TOL: Loaded 50843 primary data records.
[2025-10-24T01:30:04.765396] [DEBUG] [MAIN      ] TNL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:04.805284] [DEBUG] [MAIN      ] TOL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:04.830510] [DEBUG] [MAIN      ] TOST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:04.881789] [INFO ] [MAIN      ] TNL: Generated 139 derivative records from 42070 primary records.
[2025-10-24T01:30:04.884383] [DEBUG] [LOCAL     ] TNL: Saving derivative data.
[2025-10-24T01:30:04.906534] [DEBUG] [LOCAL     ] TNL: Derivative data saved (139 records).
[2025-10-24T01:30:04.909926] [INFO ] [MAIN      ] TNL: Successfully saved derivative data.
[2025-10-24T01:30:04.910142] [INFO ] [MAIN      ] TOL: Generated 139 derivative records from 50843 primary records.
[2025-10-24T01:30:04.912096] [DEBUG] [LOCAL     ] TOL: Saving derivative data.
[2025-10-24T01:30:04.912293] [INFO ] [MAIN      ] TOST: Generated 139 derivative records from 54080 primary records.
[2025-10-24T01:30:04.914361] [INFO ] [MAIN      ] Derivative Progress: 1921/2164 symbols completed. TNL took 1.2s. Estimated remaining: 1m 42s. Rate: 143.4 symbols/min
[2025-10-24T01:30:04.914481] [DEBUG] [LOCAL     ] TOST: Saving derivative data.
[2025-10-24T01:30:04.915245] [INFO ] [MAIN      ] TPB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:04.940209] [DEBUG] [LOCAL     ] TOL: Derivative data saved (139 records).
[2025-10-24T01:30:04.941096] [DEBUG] [LOCAL     ] TOST: Derivative data saved (139 records).
[2025-10-24T01:30:04.941309] [INFO ] [MAIN      ] TOST: Successfully saved derivative data.
[2025-10-24T01:30:04.944418] [INFO ] [MAIN      ] TOL: Successfully saved derivative data.
[2025-10-24T01:30:04.944289] [INFO ] [MAIN      ] Derivative Progress: 1922/2164 symbols completed. TOST took 1.2s. Estimated remaining: 1m 41s. Rate: 143.5 symbols/min
[2025-10-24T01:30:04.947317] [INFO ] [MAIN      ] TPC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:04.947433] [INFO ] [MAIN      ] Derivative Progress: 1923/2164 symbols completed. TOL took 1.2s. Estimated remaining: 1m 41s. Rate: 143.5 symbols/min
[2025-10-24T01:30:04.948050] [INFO ] [MAIN      ] TPH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:04.970084] [DEBUG] [LOCAL     ] TPB: Loaded 26451 existing records from primary storage.
[2025-10-24T01:30:04.970246] [INFO ] [MAIN      ] TPB: Loaded 26451 primary data records.
[2025-10-24T01:30:05.293064] [DEBUG] [LOCAL     ] TPC: Loaded 39366 existing records from primary storage.
[2025-10-24T01:30:05.320168] [DEBUG] [LOCAL     ] TPH: Loaded 45097 existing records from primary storage.
[2025-10-24T01:30:05.320303] [INFO ] [MAIN      ] TPC: Loaded 39366 primary data records.
[2025-10-24T01:30:05.320613] [INFO ] [MAIN      ] TPH: Loaded 45097 primary data records.
[2025-10-24T01:30:05.989012] [DEBUG] [MAIN      ] TPB: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:30:06.038384] [DEBUG] [MAIN      ] TPC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:06.069765] [DEBUG] [MAIN      ] TPH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:06.087495] [INFO ] [MAIN      ] TPB: Generated 139 derivative records from 26451 primary records.
[2025-10-24T01:30:06.090555] [DEBUG] [LOCAL     ] TPB: Saving derivative data.
[2025-10-24T01:30:06.108484] [DEBUG] [LOCAL     ] TPB: Derivative data saved (139 records).
[2025-10-24T01:30:06.109088] [INFO ] [MAIN      ] TPB: Successfully saved derivative data.
[2025-10-24T01:30:06.113133] [INFO ] [MAIN      ] Derivative Progress: 1924/2164 symbols completed. TPB took 1.2s. Estimated remaining: 1m 40s. Rate: 143.4 symbols/min
[2025-10-24T01:30:06.119065] [INFO ] [MAIN      ] TPL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:06.146189] [DEBUG] [LOCAL     ] TPL: Loaded 12313 existing records from primary storage.
[2025-10-24T01:30:06.146681] [INFO ] [MAIN      ] TPC: Generated 139 derivative records from 39366 primary records.
[2025-10-24T01:30:06.147149] [DEBUG] [LOCAL     ] TPC: Saving derivative data.
[2025-10-24T01:30:06.147194] [INFO ] [MAIN      ] TPL: Loaded 12313 primary data records.
[2025-10-24T01:30:06.165936] [DEBUG] [LOCAL     ] TPC: Derivative data saved (139 records).
[2025-10-24T01:30:06.172598] [INFO ] [MAIN      ] TPC: Successfully saved derivative data.
[2025-10-24T01:30:06.195303] [INFO ] [MAIN      ] Derivative Progress: 1925/2164 symbols completed. TPC took 1.2s. Estimated remaining: 1m 40s. Rate: 143.5 symbols/min
[2025-10-24T01:30:06.222102] [INFO ] [MAIN      ] TPR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:06.260914] [INFO ] [MAIN      ] TPH: Generated 139 derivative records from 45097 primary records.
[2025-10-24T01:30:06.273678] [DEBUG] [LOCAL     ] TPH: Saving derivative data.
[2025-10-24T01:30:06.325248] [DEBUG] [LOCAL     ] TPH: Derivative data saved (139 records).
[2025-10-24T01:30:06.360269] [INFO ] [MAIN      ] TPH: Successfully saved derivative data.
[2025-10-24T01:30:06.478849] [INFO ] [MAIN      ] Derivative Progress: 1926/2164 symbols completed. TPH took 1.5s. Estimated remaining: 1m 40s. Rate: 143.5 symbols/min
[2025-10-24T01:30:06.479964] [INFO ] [MAIN      ] TPVG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:06.530486] [DEBUG] [MAIN      ] TPL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:06.571116] [DEBUG] [LOCAL     ] TPVG: Loaded 27412 existing records from primary storage.
[2025-10-24T01:30:06.569076] [DEBUG] [LOCAL     ] TPR: Loaded 53752 existing records from primary storage.
[2025-10-24T01:30:06.573071] [INFO ] [MAIN      ] TPR: Loaded 53752 primary data records.
[2025-10-24T01:30:06.573113] [INFO ] [MAIN      ] TPVG: Loaded 27412 primary data records.
[2025-10-24T01:30:07.179856] [INFO ] [MAIN      ] TPL: Generated 139 derivative records from 12313 primary records.
[2025-10-24T01:30:07.182365] [DEBUG] [LOCAL     ] TPL: Saving derivative data.
[2025-10-24T01:30:07.198557] [DEBUG] [LOCAL     ] TPL: Derivative data saved (139 records).
[2025-10-24T01:30:07.199081] [INFO ] [MAIN      ] TPL: Successfully saved derivative data.
[2025-10-24T01:30:07.202187] [INFO ] [MAIN      ] Derivative Progress: 1927/2164 symbols completed. TPL took 1.1s. Estimated remaining: 1m 39s. Rate: 143.4 symbols/min
[2025-10-24T01:30:07.202671] [INFO ] [MAIN      ] TPYP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:07.223840] [DEBUG] [MAIN      ] TPR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:07.244739] [DEBUG] [LOCAL     ] TPYP: Loaded 7924 existing records from primary storage.
[2025-10-24T01:30:07.245327] [INFO ] [MAIN      ] TPYP: Loaded 7924 primary data records.
[2025-10-24T01:30:07.290040] [DEBUG] [MAIN      ] TPVG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:07.619702] [INFO ] [MAIN      ] TPR: Generated 139 derivative records from 53752 primary records.
[2025-10-24T01:30:07.623755] [DEBUG] [LOCAL     ] TPR: Saving derivative data.
[2025-10-24T01:30:07.637583] [DEBUG] [LOCAL     ] TPR: Derivative data saved (139 records).
[2025-10-24T01:30:07.639270] [INFO ] [MAIN      ] TPR: Successfully saved derivative data.
[2025-10-24T01:30:07.645151] [INFO ] [MAIN      ] Derivative Progress: 1928/2164 symbols completed. TPR took 1.4s. Estimated remaining: 1m 39s. Rate: 143.4 symbols/min
[2025-10-24T01:30:07.645498] [INFO ] [MAIN      ] TPZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:07.645763] [INFO ] [MAIN      ] TPVG: Generated 139 derivative records from 27412 primary records.
[2025-10-24T01:30:07.661357] [DEBUG] [MAIN      ] TPYP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:07.662061] [DEBUG] [LOCAL     ] TPVG: Saving derivative data.
[2025-10-24T01:30:07.691243] [DEBUG] [LOCAL     ] TPVG: Derivative data saved (139 records).
[2025-10-24T01:30:07.693458] [INFO ] [MAIN      ] TPVG: Successfully saved derivative data.
[2025-10-24T01:30:07.696239] [INFO ] [MAIN      ] Derivative Progress: 1929/2164 symbols completed. TPVG took 1.2s. Estimated remaining: 1m 38s. Rate: 143.5 symbols/min
[2025-10-24T01:30:07.699459] [INFO ] [MAIN      ] TR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:07.700246] [DEBUG] [LOCAL     ] TPZ: Loaded 4619 existing records from primary storage.
[2025-10-24T01:30:07.703273] [INFO ] [MAIN      ] TPZ: Loaded 4619 primary data records.
[2025-10-24T01:30:07.886599] [DEBUG] [LOCAL     ] TR: Loaded 19306 existing records from primary storage.
[2025-10-24T01:30:07.924901] [INFO ] [MAIN      ] TR: Loaded 19306 primary data records.
[2025-10-24T01:30:08.249306] [INFO ] [MAIN      ] TPYP: Generated 139 derivative records from 7924 primary records.
[2025-10-24T01:30:08.281270] [DEBUG] [LOCAL     ] TPYP: Saving derivative data.
[2025-10-24T01:30:08.442825] [DEBUG] [LOCAL     ] TPYP: Derivative data saved (139 records).
[2025-10-24T01:30:08.443920] [INFO ] [MAIN      ] TPYP: Successfully saved derivative data.
[2025-10-24T01:30:08.446558] [INFO ] [MAIN      ] Derivative Progress: 1930/2164 symbols completed. TPYP took 1.2s. Estimated remaining: 1m 38s. Rate: 143.4 symbols/min
[2025-10-24T01:30:08.448309] [INFO ] [MAIN      ] TRAK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:08.466115] [DEBUG] [MAIN      ] TPZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:08.493040] [DEBUG] [LOCAL     ] TRAK: Loaded 9632 existing records from primary storage.
[2025-10-24T01:30:08.494816] [INFO ] [MAIN      ] TRAK: Loaded 9632 primary data records.
[2025-10-24T01:30:08.708548] [DEBUG] [MAIN      ] TR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:08.843061] [INFO ] [MAIN      ] TPZ: Generated 139 derivative records from 4619 primary records.
[2025-10-24T01:30:08.846579] [DEBUG] [LOCAL     ] TPZ: Saving derivative data.
[2025-10-24T01:30:08.863413] [DEBUG] [LOCAL     ] TPZ: Derivative data saved (139 records).
[2025-10-24T01:30:08.868519] [INFO ] [MAIN      ] TPZ: Successfully saved derivative data.
[2025-10-24T01:30:08.871542] [INFO ] [MAIN      ] Derivative Progress: 1931/2164 symbols completed. TPZ took 1.2s. Estimated remaining: 1m 37s. Rate: 143.4 symbols/min
[2025-10-24T01:30:08.872812] [INFO ] [MAIN      ] TRC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:08.889312] [INFO ] [MAIN      ] TR: Generated 139 derivative records from 19306 primary records.
[2025-10-24T01:30:08.894499] [DEBUG] [LOCAL     ] TR: Saving derivative data.
[2025-10-24T01:30:08.927354] [DEBUG] [LOCAL     ] TR: Derivative data saved (139 records).
[2025-10-24T01:30:08.928154] [INFO ] [MAIN      ] TR: Successfully saved derivative data.
[2025-10-24T01:30:08.931249] [INFO ] [MAIN      ] Derivative Progress: 1932/2164 symbols completed. TR took 1.2s. Estimated remaining: 1m 37s. Rate: 143.5 symbols/min
[2025-10-24T01:30:08.927827] [DEBUG] [LOCAL     ] TRC: Loaded 15456 existing records from primary storage.
[2025-10-24T01:30:08.931833] [DEBUG] [MAIN      ] TRAK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:08.932019] [INFO ] [MAIN      ] TREX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:08.932165] [INFO ] [MAIN      ] TRC: Loaded 15456 primary data records.
[2025-10-24T01:30:09.286362] [DEBUG] [LOCAL     ] TREX: Loaded 50160 existing records from primary storage.
[2025-10-24T01:30:09.290284] [INFO ] [MAIN      ] TREX: Loaded 50160 primary data records.
[2025-10-24T01:30:09.358328] [INFO ] [MAIN      ] TRAK: Generated 139 derivative records from 9632 primary records.
[2025-10-24T01:30:09.364267] [DEBUG] [LOCAL     ] TRAK: Saving derivative data.
[2025-10-24T01:30:09.413253] [DEBUG] [LOCAL     ] TRAK: Derivative data saved (139 records).
[2025-10-24T01:30:09.424034] [INFO ] [MAIN      ] TRAK: Successfully saved derivative data.
[2025-10-24T01:30:09.454749] [INFO ] [MAIN      ] Derivative Progress: 1933/2164 symbols completed. TRAK took 1.0s. Estimated remaining: 1m 37s. Rate: 143.5 symbols/min
[2025-10-24T01:30:09.624114] [DEBUG] [MAIN      ] TRC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:09.664540] [INFO ] [MAIN      ] TRC: Generated 139 derivative records from 15456 primary records.
[2025-10-24T01:30:09.665459] [DEBUG] [LOCAL     ] TRC: Saving derivative data.
[2025-10-24T01:30:09.690378] [DEBUG] [LOCAL     ] TRC: Derivative data saved (139 records).
[2025-10-24T01:30:09.690543] [INFO ] [MAIN      ] TRC: Successfully saved derivative data.
[2025-10-24T01:30:09.689664] [DEBUG] [MAIN      ] TREX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:09.693176] [INFO ] [MAIN      ] Derivative Progress: 1934/2164 symbols completed. TRC took 0.8s. Estimated remaining: 1m 36s. Rate: 143.5 symbols/min
[2025-10-24T01:30:09.719180] [INFO ] [MAIN      ] TREX: Generated 139 derivative records from 50160 primary records.
[2025-10-24T01:30:09.719327] [DEBUG] [LOCAL     ] TREX: Saving derivative data.
[2025-10-24T01:30:09.731018] [DEBUG] [LOCAL     ] TREX: Derivative data saved (139 records).
[2025-10-24T01:30:09.731102] [INFO ] [MAIN      ] TREX: Successfully saved derivative data.
[2025-10-24T01:30:09.733860] [INFO ] [MAIN      ] Derivative Progress: 1935/2164 symbols completed. TREX took 0.8s. Estimated remaining: 1m 36s. Rate: 143.6 symbols/min
[2025-10-24T01:30:09.734283] [INFO ] [MAIN      ] TRGP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:09.734352] [INFO ] [MAIN      ] TRNO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:09.734489] [INFO ] [MAIN      ] TRN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:09.800098] [DEBUG] [LOCAL     ] TRN: Loaded 36448 existing records from primary storage.
[2025-10-24T01:30:09.825295] [INFO ] [MAIN      ] TRN: Loaded 36448 primary data records.
[2025-10-24T01:30:09.848112] [DEBUG] [LOCAL     ] TRGP: Loaded 51093 existing records from primary storage.
[2025-10-24T01:30:09.846927] [DEBUG] [LOCAL     ] TRNO: Loaded 43908 existing records from primary storage.
[2025-10-24T01:30:09.863477] [INFO ] [MAIN      ] TRGP: Loaded 51093 primary data records.
[2025-10-24T01:30:09.890525] [INFO ] [MAIN      ] TRNO: Loaded 43908 primary data records.
[2025-10-24T01:30:10.776478] [DEBUG] [MAIN      ] TRN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:10.838196] [DEBUG] [MAIN      ] TRGP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:10.837429] [DEBUG] [MAIN      ] TRNO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:10.896251] [INFO ] [MAIN      ] TRN: Generated 139 derivative records from 36448 primary records.
[2025-10-24T01:30:10.896936] [DEBUG] [LOCAL     ] TRN: Saving derivative data.
[2025-10-24T01:30:10.920300] [DEBUG] [LOCAL     ] TRN: Derivative data saved (139 records).
[2025-10-24T01:30:10.922666] [INFO ] [MAIN      ] TRN: Successfully saved derivative data.
[2025-10-24T01:30:10.928748] [INFO ] [MAIN      ] Derivative Progress: 1936/2164 symbols completed. TRN took 1.2s. Estimated remaining: 1m 35s. Rate: 143.4 symbols/min
[2025-10-24T01:30:10.934805] [INFO ] [MAIN      ] TRGP: Generated 139 derivative records from 51093 primary records.
[2025-10-24T01:30:10.934429] [INFO ] [MAIN      ] TROX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:10.937505] [INFO ] [MAIN      ] TRNO: Generated 139 derivative records from 43908 primary records.
[2025-10-24T01:30:10.937699] [DEBUG] [LOCAL     ] TRNO: Saving derivative data.
[2025-10-24T01:30:10.937593] [DEBUG] [LOCAL     ] TRGP: Saving derivative data.
[2025-10-24T01:30:10.961080] [DEBUG] [LOCAL     ] TRNO: Derivative data saved (139 records).
[2025-10-24T01:30:10.962570] [DEBUG] [LOCAL     ] TRGP: Derivative data saved (139 records).
[2025-10-24T01:30:10.962784] [INFO ] [MAIN      ] TRNO: Successfully saved derivative data.
[2025-10-24T01:30:10.962926] [INFO ] [MAIN      ] TRGP: Successfully saved derivative data.
[2025-10-24T01:30:10.966601] [INFO ] [MAIN      ] Derivative Progress: 1937/2164 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 35s. Rate: 143.5 symbols/min
[2025-10-24T01:30:10.970219] [INFO ] [MAIN      ] TRP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:10.970285] [INFO ] [MAIN      ] Derivative Progress: 1938/2164 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 34s. Rate: 143.6 symbols/min
[2025-10-24T01:30:10.970891] [INFO ] [MAIN      ] TRTX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:11.024964] [DEBUG] [LOCAL     ] TROX: Loaded 52582 existing records from primary storage.
[2025-10-24T01:30:11.025327] [INFO ] [MAIN      ] TROX: Loaded 52582 primary data records.
[2025-10-24T01:30:11.181108] [DEBUG] [LOCAL     ] TRTX: Loaded 37134 existing records from primary storage.
[2025-10-24T01:30:11.182737] [INFO ] [MAIN      ] TRTX: Loaded 37134 primary data records.
[2025-10-24T01:30:11.188825] [DEBUG] [LOCAL     ] TRP: Loaded 52516 existing records from primary storage.
[2025-10-24T01:30:11.210437] [INFO ] [MAIN      ] TRP: Loaded 52516 primary data records.
[2025-10-24T01:30:12.068898] [DEBUG] [MAIN      ] TROX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:12.121978] [DEBUG] [MAIN      ] TRTX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:12.122219] [DEBUG] [MAIN      ] TRP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:12.194888] [INFO ] [MAIN      ] TROX: Generated 139 derivative records from 52582 primary records.
[2025-10-24T01:30:12.198130] [DEBUG] [LOCAL     ] TROX: Saving derivative data.
[2025-10-24T01:30:12.217028] [DEBUG] [LOCAL     ] TROX: Derivative data saved (139 records).
[2025-10-24T01:30:12.220743] [INFO ] [MAIN      ] TROX: Successfully saved derivative data.
[2025-10-24T01:30:12.225302] [INFO ] [MAIN      ] Derivative Progress: 1939/2164 symbols completed. TROX took 1.3s. Estimated remaining: 1m 34s. Rate: 143.4 symbols/min
[2025-10-24T01:30:12.227565] [INFO ] [MAIN      ] TRP: Generated 139 derivative records from 52516 primary records.
[2025-10-24T01:30:12.228586] [INFO ] [MAIN      ] TRU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:12.228100] [INFO ] [MAIN      ] TRTX: Generated 139 derivative records from 37134 primary records.
[2025-10-24T01:30:12.228911] [DEBUG] [LOCAL     ] TRP: Saving derivative data.
[2025-10-24T01:30:12.229370] [DEBUG] [LOCAL     ] TRTX: Saving derivative data.
[2025-10-24T01:30:12.252525] [DEBUG] [LOCAL     ] TRP: Derivative data saved (139 records).
[2025-10-24T01:30:12.253495] [INFO ] [MAIN      ] TRP: Successfully saved derivative data.
[2025-10-24T01:30:12.257079] [INFO ] [MAIN      ] Derivative Progress: 1940/2164 symbols completed. TRP took 1.3s. Estimated remaining: 1m 34s. Rate: 143.5 symbols/min
[2025-10-24T01:30:12.257318] [INFO ] [MAIN      ] TRV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:12.259328] [DEBUG] [LOCAL     ] TRTX: Derivative data saved (139 records).
[2025-10-24T01:30:12.259725] [INFO ] [MAIN      ] TRTX: Successfully saved derivative data.
[2025-10-24T01:30:12.264063] [INFO ] [MAIN      ] Derivative Progress: 1941/2164 symbols completed. TRTX took 1.3s. Estimated remaining: 1m 33s. Rate: 143.6 symbols/min
[2025-10-24T01:30:12.264410] [INFO ] [MAIN      ] TS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:12.335089] [DEBUG] [LOCAL     ] TRU: Loaded 51849 existing records from primary storage.
[2025-10-24T01:30:12.335398] [INFO ] [MAIN      ] TRU: Loaded 51849 primary data records.
[2025-10-24T01:30:12.422906] [DEBUG] [LOCAL     ] TRV: Loaded 47845 existing records from primary storage.
[2025-10-24T01:30:12.460588] [INFO ] [MAIN      ] TRV: Loaded 47845 primary data records.
[2025-10-24T01:30:12.489708] [DEBUG] [LOCAL     ] TS: Loaded 52030 existing records from primary storage.
[2025-10-24T01:30:12.564383] [INFO ] [MAIN      ] TS: Loaded 52030 primary data records.
[2025-10-24T01:30:13.307404] [DEBUG] [MAIN      ] TRU: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:30:13.336234] [DEBUG] [MAIN      ] TRV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:13.383747] [DEBUG] [MAIN      ] TS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:13.419821] [INFO ] [MAIN      ] TRU: Generated 139 derivative records from 51849 primary records.
[2025-10-24T01:30:13.425007] [DEBUG] [LOCAL     ] TRU: Saving derivative data.
[2025-10-24T01:30:13.443556] [DEBUG] [LOCAL     ] TRU: Derivative data saved (139 records).
[2025-10-24T01:30:13.445792] [INFO ] [MAIN      ] TRU: Successfully saved derivative data.
[2025-10-24T01:30:13.448495] [INFO ] [MAIN      ] Derivative Progress: 1942/2164 symbols completed. TRU took 1.2s. Estimated remaining: 1m 33s. Rate: 143.4 symbols/min
[2025-10-24T01:30:13.446130] [INFO ] [MAIN      ] TRV: Generated 139 derivative records from 47845 primary records.
[2025-10-24T01:30:13.451349] [DEBUG] [LOCAL     ] TRV: Saving derivative data.
[2025-10-24T01:30:13.451472] [INFO ] [MAIN      ] TSE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:13.469255] [DEBUG] [LOCAL     ] TRV: Derivative data saved (139 records).
[2025-10-24T01:30:13.470521] [INFO ] [MAIN      ] TRV: Successfully saved derivative data.
[2025-10-24T01:30:13.475377] [INFO ] [MAIN      ] TS: Generated 139 derivative records from 52030 primary records.
[2025-10-24T01:30:13.475610] [DEBUG] [LOCAL     ] TS: Saving derivative data.
[2025-10-24T01:30:13.473041] [INFO ] [MAIN      ] Derivative Progress: 1943/2164 symbols completed. TRV took 1.2s. Estimated remaining: 1m 32s. Rate: 143.5 symbols/min
[2025-10-24T01:30:13.476104] [INFO ] [MAIN      ] TSI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:13.497316] [DEBUG] [LOCAL     ] TS: Derivative data saved (139 records).
[2025-10-24T01:30:13.497526] [INFO ] [MAIN      ] TS: Successfully saved derivative data.
[2025-10-24T01:30:13.500938] [INFO ] [MAIN      ] Derivative Progress: 1944/2164 symbols completed. TS took 1.2s. Estimated remaining: 1m 32s. Rate: 143.6 symbols/min
[2025-10-24T01:30:13.501125] [INFO ] [MAIN      ] TSLX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:13.508227] [DEBUG] [LOCAL     ] TSI: Loaded 8234 existing records from primary storage.
[2025-10-24T01:30:13.508422] [INFO ] [MAIN      ] TSI: Loaded 8234 primary data records.
[2025-10-24T01:30:13.588382] [DEBUG] [LOCAL     ] TSE: Loaded 27989 existing records from primary storage.
[2025-10-24T01:30:13.611125] [INFO ] [MAIN      ] TSE: Loaded 27989 primary data records.
[2025-10-24T01:30:13.770412] [DEBUG] [LOCAL     ] TSLX: Loaded 36029 existing records from primary storage.
[2025-10-24T01:30:13.850256] [INFO ] [MAIN      ] TSLX: Loaded 36029 primary data records.
[2025-10-24T01:30:14.505593] [DEBUG] [MAIN      ] TSI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:14.538404] [DEBUG] [MAIN      ] TSE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:14.609061] [DEBUG] [MAIN      ] TSLX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:14.631950] [INFO ] [MAIN      ] TSI: Generated 139 derivative records from 8234 primary records.
[2025-10-24T01:30:14.635042] [DEBUG] [LOCAL     ] TSI: Saving derivative data.
[2025-10-24T01:30:14.637580] [INFO ] [MAIN      ] TSE: Generated 139 derivative records from 27989 primary records.
[2025-10-24T01:30:14.648938] [DEBUG] [LOCAL     ] TSI: Derivative data saved (139 records).
[2025-10-24T01:30:14.649024] [DEBUG] [LOCAL     ] TSE: Saving derivative data.
[2025-10-24T01:30:14.651673] [INFO ] [MAIN      ] TSI: Successfully saved derivative data.
[2025-10-24T01:30:14.653674] [INFO ] [MAIN      ] Derivative Progress: 1945/2164 symbols completed. TSI took 1.2s. Estimated remaining: 1m 32s. Rate: 143.4 symbols/min
[2025-10-24T01:30:14.654332] [INFO ] [MAIN      ] TSM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:14.670285] [DEBUG] [LOCAL     ] TSE: Derivative data saved (139 records).
[2025-10-24T01:30:14.670610] [INFO ] [MAIN      ] TSE: Successfully saved derivative data.
[2025-10-24T01:30:14.674763] [INFO ] [MAIN      ] Derivative Progress: 1946/2164 symbols completed. TSE took 1.2s. Estimated remaining: 1m 31s. Rate: 143.5 symbols/min
[2025-10-24T01:30:14.675088] [INFO ] [MAIN      ] TSN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:14.681589] [INFO ] [MAIN      ] TSLX: Generated 139 derivative records from 36029 primary records.
[2025-10-24T01:30:14.682004] [DEBUG] [LOCAL     ] TSLX: Saving derivative data.
[2025-10-24T01:30:14.695434] [DEBUG] [LOCAL     ] TSLX: Derivative data saved (139 records).
[2025-10-24T01:30:14.695565] [INFO ] [MAIN      ] TSLX: Successfully saved derivative data.
[2025-10-24T01:30:14.698053] [INFO ] [MAIN      ] Derivative Progress: 1947/2164 symbols completed. TSLX took 1.2s. Estimated remaining: 1m 31s. Rate: 143.6 symbols/min
[2025-10-24T01:30:14.698329] [INFO ] [MAIN      ] TSQ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:14.726080] [DEBUG] [LOCAL     ] TSQ: Loaded 11726 existing records from primary storage.
[2025-10-24T01:30:14.726335] [INFO ] [MAIN      ] TSQ: Loaded 11726 primary data records.
[2025-10-24T01:30:14.876764] [DEBUG] [LOCAL     ] TSN: Loaded 53474 existing records from primary storage.
[2025-10-24T01:30:14.899111] [DEBUG] [LOCAL     ] TSM: Loaded 54209 existing records from primary storage.
[2025-10-24T01:30:14.925984] [INFO ] [MAIN      ] TSN: Loaded 53474 primary data records.
[2025-10-24T01:30:14.926254] [INFO ] [MAIN      ] TSM: Loaded 54209 primary data records.
[2025-10-24T01:30:15.689046] [DEBUG] [MAIN      ] TSQ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:15.731607] [DEBUG] [MAIN      ] TSN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:15.765130] [DEBUG] [MAIN      ] TSM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:15.788713] [INFO ] [MAIN      ] TSQ: Generated 139 derivative records from 11726 primary records.
[2025-10-24T01:30:15.790335] [DEBUG] [LOCAL     ] TSQ: Saving derivative data.
[2025-10-24T01:30:15.811714] [DEBUG] [LOCAL     ] TSQ: Derivative data saved (139 records).
[2025-10-24T01:30:15.812063] [INFO ] [MAIN      ] TSQ: Successfully saved derivative data.
[2025-10-24T01:30:15.814842] [INFO ] [MAIN      ] Derivative Progress: 1948/2164 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 30s. Rate: 143.5 symbols/min
[2025-10-24T01:30:15.833614] [INFO ] [MAIN      ] TSN: Generated 139 derivative records from 53474 primary records.
[2025-10-24T01:30:15.834816] [DEBUG] [LOCAL     ] TSN: Saving derivative data.
[2025-10-24T01:30:15.837105] [INFO ] [MAIN      ] TSM: Generated 139 derivative records from 54209 primary records.
[2025-10-24T01:30:15.837404] [DEBUG] [LOCAL     ] TSM: Saving derivative data.
[2025-10-24T01:30:15.860466] [DEBUG] [LOCAL     ] TSN: Derivative data saved (139 records).
[2025-10-24T01:30:15.861671] [DEBUG] [LOCAL     ] TSM: Derivative data saved (139 records).
[2025-10-24T01:30:15.861811] [INFO ] [MAIN      ] TSM: Successfully saved derivative data.
[2025-10-24T01:30:15.861392] [INFO ] [MAIN      ] TSN: Successfully saved derivative data.
[2025-10-24T01:30:15.865211] [INFO ] [MAIN      ] Derivative Progress: 1949/2164 symbols completed. TSN took 1.2s. Estimated remaining: 1m 30s. Rate: 143.5 symbols/min
[2025-10-24T01:30:15.868886] [INFO ] [MAIN      ] Derivative Progress: 1950/2164 symbols completed. TSM took 1.2s. Estimated remaining: 1m 29s. Rate: 143.6 symbols/min
[2025-10-24T01:30:15.869378] [INFO ] [MAIN      ] TT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:15.869694] [INFO ] [MAIN      ] TTE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:15.869272] [INFO ] [MAIN      ] TTC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:15.953887] [DEBUG] [LOCAL     ] TT: Loaded 47349 existing records from primary storage.
[2025-10-24T01:30:15.956103] [DEBUG] [LOCAL     ] TTC: Loaded 41771 existing records from primary storage.
[2025-10-24T01:30:15.958171] [INFO ] [MAIN      ] TT: Loaded 47349 primary data records.
[2025-10-24T01:30:15.958348] [INFO ] [MAIN      ] TTC: Loaded 41771 primary data records.
[2025-10-24T01:30:16.047077] [DEBUG] [LOCAL     ] TTE: Loaded 51922 existing records from primary storage.
[2025-10-24T01:30:16.106141] [INFO ] [MAIN      ] TTE: Loaded 51922 primary data records.
[2025-10-24T01:30:16.975848] [DEBUG] [MAIN      ] TTE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:16.990447] [DEBUG] [MAIN      ] TTC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:17.036752] [DEBUG] [MAIN      ] TT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:17.113456] [INFO ] [MAIN      ] TTC: Generated 139 derivative records from 41771 primary records.
[2025-10-24T01:30:17.114237] [DEBUG] [LOCAL     ] TTC: Saving derivative data.
[2025-10-24T01:30:17.130332] [INFO ] [MAIN      ] TTE: Generated 139 derivative records from 51922 primary records.
[2025-10-24T01:30:17.135446] [DEBUG] [LOCAL     ] TTC: Derivative data saved (139 records).
[2025-10-24T01:30:17.135971] [INFO ] [MAIN      ] TTC: Successfully saved derivative data.
[2025-10-24T01:30:17.136130] [DEBUG] [LOCAL     ] TTE: Saving derivative data.
[2025-10-24T01:30:17.140028] [INFO ] [MAIN      ] Derivative Progress: 1951/2164 symbols completed. TTC took 1.3s. Estimated remaining: 1m 29s. Rate: 143.4 symbols/min
[2025-10-24T01:30:17.141624] [INFO ] [MAIN      ] TTI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:17.158518] [DEBUG] [LOCAL     ] TTE: Derivative data saved (139 records).
[2025-10-24T01:30:17.158895] [INFO ] [MAIN      ] TT: Generated 139 derivative records from 47349 primary records.
[2025-10-24T01:30:17.159150] [INFO ] [MAIN      ] TTE: Successfully saved derivative data.
[2025-10-24T01:30:17.159421] [DEBUG] [LOCAL     ] TT: Saving derivative data.
[2025-10-24T01:30:17.162866] [INFO ] [MAIN      ] Derivative Progress: 1952/2164 symbols completed. TTE took 1.3s. Estimated remaining: 1m 29s. Rate: 143.5 symbols/min
[2025-10-24T01:30:17.163502] [INFO ] [MAIN      ] TU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:17.177905] [DEBUG] [LOCAL     ] TT: Derivative data saved (139 records).
[2025-10-24T01:30:17.178078] [INFO ] [MAIN      ] TT: Successfully saved derivative data.
[2025-10-24T01:30:17.181171] [INFO ] [MAIN      ] Derivative Progress: 1953/2164 symbols completed. TT took 1.3s. Estimated remaining: 1m 28s. Rate: 143.6 symbols/min
[2025-10-24T01:30:17.181589] [INFO ] [MAIN      ] TUYA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:17.241454] [DEBUG] [LOCAL     ] TTI: Loaded 47037 existing records from primary storage.
[2025-10-24T01:30:17.241743] [INFO ] [MAIN      ] TTI: Loaded 47037 primary data records.
[2025-10-24T01:30:17.346776] [DEBUG] [LOCAL     ] TU: Loaded 50129 existing records from primary storage.
[2025-10-24T01:30:17.352591] [DEBUG] [LOCAL     ] TUYA: Loaded 46014 existing records from primary storage.
[2025-10-24T01:30:17.374164] [INFO ] [MAIN      ] TU: Loaded 50129 primary data records.
[2025-10-24T01:30:17.380375] [INFO ] [MAIN      ] TUYA: Loaded 46014 primary data records.
[2025-10-24T01:30:18.230738] [DEBUG] [MAIN      ] TTI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:18.260073] [DEBUG] [MAIN      ] TU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:18.303429] [DEBUG] [MAIN      ] TUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:18.383497] [INFO ] [MAIN      ] TTI: Generated 139 derivative records from 47037 primary records.
[2025-10-24T01:30:18.384579] [DEBUG] [LOCAL     ] TTI: Saving derivative data.
[2025-10-24T01:30:18.392762] [INFO ] [MAIN      ] TU: Generated 139 derivative records from 50129 primary records.
[2025-10-24T01:30:18.406269] [DEBUG] [LOCAL     ] TTI: Derivative data saved (139 records).
[2025-10-24T01:30:18.406828] [INFO ] [MAIN      ] TTI: Successfully saved derivative data.
[2025-10-24T01:30:18.408967] [INFO ] [MAIN      ] Derivative Progress: 1954/2164 symbols completed. TTI took 1.3s. Estimated remaining: 1m 28s. Rate: 143.4 symbols/min
[2025-10-24T01:30:18.409119] [DEBUG] [LOCAL     ] TU: Saving derivative data.
[2025-10-24T01:30:18.411894] [INFO ] [MAIN      ] TV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:18.412317] [INFO ] [MAIN      ] TUYA: Generated 139 derivative records from 46014 primary records.
[2025-10-24T01:30:18.425207] [DEBUG] [LOCAL     ] TUYA: Saving derivative data.
[2025-10-24T01:30:18.433020] [DEBUG] [LOCAL     ] TU: Derivative data saved (139 records).
[2025-10-24T01:30:18.440604] [INFO ] [MAIN      ] TU: Successfully saved derivative data.
[2025-10-24T01:30:18.449262] [INFO ] [MAIN      ] Derivative Progress: 1955/2164 symbols completed. TU took 1.3s. Estimated remaining: 1m 27s. Rate: 143.5 symbols/min
[2025-10-24T01:30:18.449532] [DEBUG] [LOCAL     ] TUYA: Derivative data saved (139 records).
[2025-10-24T01:30:18.449877] [INFO ] [MAIN      ] TVC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:18.450270] [INFO ] [MAIN      ] TUYA: Successfully saved derivative data.
[2025-10-24T01:30:18.453263] [INFO ] [MAIN      ] Derivative Progress: 1956/2164 symbols completed. TUYA took 1.3s. Estimated remaining: 1m 27s. Rate: 143.6 symbols/min
[2025-10-24T01:30:18.454016] [INFO ] [MAIN      ] TVE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:18.466123] [DEBUG] [LOCAL     ] TVE: Loaded 2559 existing records from primary storage.
[2025-10-24T01:30:18.466471] [DEBUG] [LOCAL     ] TVC: Loaded 3123 existing records from primary storage.
[2025-10-24T01:30:18.476726] [INFO ] [MAIN      ] TVE: Loaded 2559 primary data records.
[2025-10-24T01:30:18.477062] [INFO ] [MAIN      ] TVC: Loaded 3123 primary data records.
[2025-10-24T01:30:18.647054] [DEBUG] [LOCAL     ] TV: Loaded 41483 existing records from primary storage.
[2025-10-24T01:30:18.737059] [INFO ] [MAIN      ] TV: Loaded 41483 primary data records.
[2025-10-24T01:30:19.491069] [DEBUG] [MAIN      ] TVE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:19.504735] [DEBUG] [MAIN      ] TVC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:19.548145] [DEBUG] [MAIN      ] TV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:19.616029] [INFO ] [MAIN      ] TVE: Generated 139 derivative records from 2559 primary records.
[2025-10-24T01:30:19.619228] [DEBUG] [LOCAL     ] TVE: Saving derivative data.
[2025-10-24T01:30:19.634204] [DEBUG] [LOCAL     ] TVE: Derivative data saved (139 records).
[2025-10-24T01:30:19.634417] [INFO ] [MAIN      ] TVE: Successfully saved derivative data.
[2025-10-24T01:30:19.636957] [INFO ] [MAIN      ] Derivative Progress: 1957/2164 symbols completed. TVE took 1.2s. Estimated remaining: 1m 27s. Rate: 143.4 symbols/min
[2025-10-24T01:30:19.639305] [INFO ] [MAIN      ] TWI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:19.644437] [INFO ] [MAIN      ] TVC: Generated 139 derivative records from 3123 primary records.
[2025-10-24T01:30:19.646299] [INFO ] [MAIN      ] TV: Generated 139 derivative records from 41483 primary records.
[2025-10-24T01:30:19.646451] [DEBUG] [LOCAL     ] TVC: Saving derivative data.
[2025-10-24T01:30:19.646704] [DEBUG] [LOCAL     ] TV: Saving derivative data.
[2025-10-24T01:30:19.670436] [DEBUG] [LOCAL     ] TV: Derivative data saved (139 records).
[2025-10-24T01:30:19.671094] [DEBUG] [LOCAL     ] TVC: Derivative data saved (139 records).
[2025-10-24T01:30:19.671499] [INFO ] [MAIN      ] TV: Successfully saved derivative data.
[2025-10-24T01:30:19.674607] [INFO ] [MAIN      ] Derivative Progress: 1958/2164 symbols completed. TV took 1.3s. Estimated remaining: 1m 26s. Rate: 143.5 symbols/min
[2025-10-24T01:30:19.675154] [INFO ] [MAIN      ] TVC: Successfully saved derivative data.
[2025-10-24T01:30:19.674906] [INFO ] [MAIN      ] TWLO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:19.677564] [INFO ] [MAIN      ] Derivative Progress: 1959/2164 symbols completed. TVC took 1.2s. Estimated remaining: 1m 26s. Rate: 143.6 symbols/min
[2025-10-24T01:30:19.677868] [INFO ] [MAIN      ] TWN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:19.693948] [DEBUG] [LOCAL     ] TWN: Loaded 3242 existing records from primary storage.
[2025-10-24T01:30:19.694160] [INFO ] [MAIN      ] TWN: Loaded 3242 primary data records.
[2025-10-24T01:30:19.790708] [DEBUG] [LOCAL     ] TWI: Loaded 34041 existing records from primary storage.
[2025-10-24T01:30:19.814251] [INFO ] [MAIN      ] TWI: Loaded 34041 primary data records.
[2025-10-24T01:30:20.225731] [DEBUG] [LOCAL     ] TWLO: Loaded 53169 existing records from primary storage.
[2025-10-24T01:30:20.229825] [INFO ] [MAIN      ] TWLO: Loaded 53169 primary data records.
[2025-10-24T01:30:20.716793] [DEBUG] [MAIN      ] TWN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:20.718192] [DEBUG] [MAIN      ] TWI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:20.785245] [DEBUG] [MAIN      ] TWLO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:20.824518] [INFO ] [MAIN      ] TWN: Generated 139 derivative records from 3242 primary records.
[2025-10-24T01:30:20.830934] [DEBUG] [LOCAL     ] TWN: Saving derivative data.
[2025-10-24T01:30:20.829813] [INFO ] [MAIN      ] TWI: Generated 139 derivative records from 34041 primary records.
[2025-10-24T01:30:20.831326] [DEBUG] [LOCAL     ] TWI: Saving derivative data.
[2025-10-24T01:30:20.844913] [DEBUG] [LOCAL     ] TWN: Derivative data saved (139 records).
[2025-10-24T01:30:20.845055] [INFO ] [MAIN      ] TWN: Successfully saved derivative data.
[2025-10-24T01:30:20.847562] [INFO ] [MAIN      ] Derivative Progress: 1960/2164 symbols completed. TWN took 1.2s. Estimated remaining: 1m 25s. Rate: 143.5 symbols/min
[2025-10-24T01:30:20.847891] [INFO ] [MAIN      ] TWO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:20.865057] [DEBUG] [LOCAL     ] TWI: Derivative data saved (139 records).
[2025-10-24T01:30:20.865424] [INFO ] [MAIN      ] TWI: Successfully saved derivative data.
[2025-10-24T01:30:20.868079] [INFO ] [MAIN      ] Derivative Progress: 1961/2164 symbols completed. TWI took 1.2s. Estimated remaining: 1m 25s. Rate: 143.5 symbols/min
[2025-10-24T01:30:20.869540] [INFO ] [MAIN      ] TX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:20.872599] [INFO ] [MAIN      ] TWLO: Generated 139 derivative records from 53169 primary records.
[2025-10-24T01:30:20.872790] [DEBUG] [LOCAL     ] TWLO: Saving derivative data.
[2025-10-24T01:30:20.885887] [DEBUG] [LOCAL     ] TWLO: Derivative data saved (139 records).
[2025-10-24T01:30:20.886095] [INFO ] [MAIN      ] TWLO: Successfully saved derivative data.
[2025-10-24T01:30:20.889706] [INFO ] [MAIN      ] Derivative Progress: 1962/2164 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 24s. Rate: 143.6 symbols/min
[2025-10-24T01:30:20.890074] [INFO ] [MAIN      ] TXNM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:20.908135] [DEBUG] [LOCAL     ] TX: Loaded 23300 existing records from primary storage.
[2025-10-24T01:30:20.918991] [INFO ] [MAIN      ] TX: Loaded 23300 primary data records.
[2025-10-24T01:30:21.045326] [DEBUG] [LOCAL     ] TWO: Loaded 48886 existing records from primary storage.
[2025-10-24T01:30:21.057422] [INFO ] [MAIN      ] TWO: Loaded 48886 primary data records.
[2025-10-24T01:30:21.313155] [DEBUG] [LOCAL     ] TXNM: Loaded 43114 existing records from primary storage.
[2025-10-24T01:30:21.335859] [INFO ] [MAIN      ] TXNM: Loaded 43114 primary data records.
[2025-10-24T01:30:21.868007] [DEBUG] [MAIN      ] TX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:21.898130] [DEBUG] [MAIN      ] TWO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:21.934759] [DEBUG] [MAIN      ] TXNM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:21.991971] [INFO ] [MAIN      ] TX: Generated 139 derivative records from 23300 primary records.
[2025-10-24T01:30:21.994961] [DEBUG] [LOCAL     ] TX: Saving derivative data.
[2025-10-24T01:30:22.010278] [DEBUG] [LOCAL     ] TX: Derivative data saved (139 records).
[2025-10-24T01:30:22.010730] [INFO ] [MAIN      ] TX: Successfully saved derivative data.
[2025-10-24T01:30:22.013160] [INFO ] [MAIN      ] Derivative Progress: 1963/2164 symbols completed. TX took 1.1s. Estimated remaining: 1m 24s. Rate: 143.5 symbols/min
[2025-10-24T01:30:22.016682] [INFO ] [MAIN      ] TWO: Generated 139 derivative records from 48886 primary records.
[2025-10-24T01:30:22.016918] [DEBUG] [LOCAL     ] TWO: Saving derivative data.
[2025-10-24T01:30:22.017782] [INFO ] [MAIN      ] TXNM: Generated 139 derivative records from 43114 primary records.
[2025-10-24T01:30:22.018178] [DEBUG] [LOCAL     ] TXNM: Saving derivative data.
[2025-10-24T01:30:22.030317] [DEBUG] [LOCAL     ] TWO: Derivative data saved (139 records).
[2025-10-24T01:30:22.030667] [INFO ] [MAIN      ] TWO: Successfully saved derivative data.
[2025-10-24T01:30:22.033277] [INFO ] [MAIN      ] Derivative Progress: 1964/2164 symbols completed. TWO took 1.2s. Estimated remaining: 1m 24s. Rate: 143.5 symbols/min
[2025-10-24T01:30:22.044843] [DEBUG] [LOCAL     ] TXNM: Derivative data saved (139 records).
[2025-10-24T01:30:22.044940] [INFO ] [MAIN      ] TXNM: Successfully saved derivative data.
[2025-10-24T01:30:22.047830] [INFO ] [MAIN      ] Derivative Progress: 1965/2164 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 23s. Rate: 143.6 symbols/min
[2025-10-24T01:30:22.048316] [INFO ] [MAIN      ] TY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:22.048243] [INFO ] [MAIN      ] TXO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:22.048478] [INFO ] [MAIN      ] TXT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:22.060998] [DEBUG] [LOCAL     ] TY: Loaded 7553 existing records from primary storage.
[2025-10-24T01:30:22.061347] [INFO ] [MAIN      ] TY: Loaded 7553 primary data records.
[2025-10-24T01:30:22.235960] [DEBUG] [LOCAL     ] TXO: Loaded 20165 existing records from primary storage.
[2025-10-24T01:30:22.264544] [INFO ] [MAIN      ] TXO: Loaded 20165 primary data records.
[2025-10-24T01:30:22.474112] [DEBUG] [LOCAL     ] TXT: Loaded 49899 existing records from primary storage.
[2025-10-24T01:30:22.497719] [INFO ] [MAIN      ] TXT: Loaded 49899 primary data records.
[2025-10-24T01:30:23.045414] [DEBUG] [MAIN      ] TY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:23.090504] [DEBUG] [MAIN      ] TXO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:23.125079] [DEBUG] [MAIN      ] TXT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:23.163623] [INFO ] [MAIN      ] TY: Generated 139 derivative records from 7553 primary records.
[2025-10-24T01:30:23.167185] [DEBUG] [LOCAL     ] TY: Saving derivative data.
[2025-10-24T01:30:23.183247] [DEBUG] [LOCAL     ] TY: Derivative data saved (139 records).
[2025-10-24T01:30:23.183800] [INFO ] [MAIN      ] TY: Successfully saved derivative data.
[2025-10-24T01:30:23.187557] [INFO ] [MAIN      ] Derivative Progress: 1966/2164 symbols completed. TY took 1.1s. Estimated remaining: 1m 23s. Rate: 143.5 symbols/min
[2025-10-24T01:30:23.188987] [INFO ] [MAIN      ] TYG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:23.204218] [INFO ] [MAIN      ] TXO: Generated 139 derivative records from 20165 primary records.
[2025-10-24T01:30:23.208468] [DEBUG] [LOCAL     ] TXO: Saving derivative data.
[2025-10-24T01:30:23.212788] [INFO ] [MAIN      ] TXT: Generated 139 derivative records from 49899 primary records.
[2025-10-24T01:30:23.220783] [DEBUG] [LOCAL     ] TXT: Saving derivative data.
[2025-10-24T01:30:23.230208] [DEBUG] [LOCAL     ] TYG: Loaded 14093 existing records from primary storage.
[2025-10-24T01:30:23.231077] [INFO ] [MAIN      ] TYG: Loaded 14093 primary data records.
[2025-10-24T01:30:23.280954] [DEBUG] [LOCAL     ] TXT: Derivative data saved (139 records).
[2025-10-24T01:30:23.281340] [INFO ] [MAIN      ] TXT: Successfully saved derivative data.
[2025-10-24T01:30:23.284539] [INFO ] [MAIN      ] Derivative Progress: 1967/2164 symbols completed. TXT took 1.2s. Estimated remaining: 1m 22s. Rate: 143.5 symbols/min
[2025-10-24T01:30:23.304530] [INFO ] [MAIN      ] TYL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:23.319882] [DEBUG] [LOCAL     ] TXO: Derivative data saved (139 records).
[2025-10-24T01:30:23.327252] [INFO ] [MAIN      ] TXO: Successfully saved derivative data.
[2025-10-24T01:30:23.334909] [INFO ] [MAIN      ] Derivative Progress: 1968/2164 symbols completed. TXO took 1.3s. Estimated remaining: 1m 22s. Rate: 143.6 symbols/min
[2025-10-24T01:30:23.357215] [INFO ] [MAIN      ] U: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:23.563014] [DEBUG] [LOCAL     ] TYL: Loaded 22120 existing records from primary storage.
[2025-10-24T01:30:23.563460] [INFO ] [MAIN      ] TYL: Loaded 22120 primary data records.
[2025-10-24T01:30:23.739055] [DEBUG] [LOCAL     ] U: Loaded 54189 existing records from primary storage.
[2025-10-24T01:30:23.774284] [INFO ] [MAIN      ] U: Loaded 54189 primary data records.
[2025-10-24T01:30:24.207067] [DEBUG] [MAIN      ] TYG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:24.252762] [DEBUG] [MAIN      ] TYL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:24.296601] [DEBUG] [MAIN      ] U: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:24.314839] [INFO ] [MAIN      ] TYG: Generated 139 derivative records from 14093 primary records.
[2025-10-24T01:30:24.318817] [DEBUG] [LOCAL     ] TYG: Saving derivative data.
[2025-10-24T01:30:24.335311] [DEBUG] [LOCAL     ] TYG: Derivative data saved (139 records).
[2025-10-24T01:30:24.335987] [INFO ] [MAIN      ] TYG: Successfully saved derivative data.
[2025-10-24T01:30:24.338452] [INFO ] [MAIN      ] Derivative Progress: 1969/2164 symbols completed. TYG took 1.1s. Estimated remaining: 1m 22s. Rate: 143.5 symbols/min
[2025-10-24T01:30:24.338711] [INFO ] [MAIN      ] UA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:24.361905] [INFO ] [MAIN      ] TYL: Generated 139 derivative records from 22120 primary records.
[2025-10-24T01:30:24.362335] [DEBUG] [LOCAL     ] TYL: Saving derivative data.
[2025-10-24T01:30:24.392173] [INFO ] [MAIN      ] U: Generated 139 derivative records from 54189 primary records.
[2025-10-24T01:30:24.394950] [DEBUG] [LOCAL     ] TYL: Derivative data saved (139 records).
[2025-10-24T01:30:24.395299] [INFO ] [MAIN      ] TYL: Successfully saved derivative data.
[2025-10-24T01:30:24.397933] [INFO ] [MAIN      ] Derivative Progress: 1970/2164 symbols completed. TYL took 1.1s. Estimated remaining: 1m 21s. Rate: 143.6 symbols/min
[2025-10-24T01:30:24.398321] [DEBUG] [LOCAL     ] U: Saving derivative data.
[2025-10-24T01:30:24.398211] [INFO ] [MAIN      ] UAA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:24.426839] [DEBUG] [LOCAL     ] U: Derivative data saved (139 records).
[2025-10-24T01:30:24.428781] [INFO ] [MAIN      ] U: Successfully saved derivative data.
[2025-10-24T01:30:24.432567] [INFO ] [MAIN      ] Derivative Progress: 1971/2164 symbols completed. U took 1.1s. Estimated remaining: 1m 21s. Rate: 143.6 symbols/min
[2025-10-24T01:30:24.432944] [INFO ] [MAIN      ] UAN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:24.435437] [DEBUG] [LOCAL     ] UA: Loaded 50822 existing records from primary storage.
[2025-10-24T01:30:24.435874] [INFO ] [MAIN      ] UA: Loaded 50822 primary data records.
[2025-10-24T01:30:24.540783] [DEBUG] [LOCAL     ] UAN: Loaded 5331 existing records from primary storage.
[2025-10-24T01:30:24.544335] [INFO ] [MAIN      ] UAN: Loaded 5331 primary data records.
[2025-10-24T01:30:24.887070] [DEBUG] [LOCAL     ] UAA: Loaded 53888 existing records from primary storage.
[2025-10-24T01:30:24.891823] [INFO ] [MAIN      ] UAA: Loaded 53888 primary data records.
[2025-10-24T01:30:25.414124] [DEBUG] [MAIN      ] UA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:25.460973] [DEBUG] [MAIN      ] UAN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:25.504036] [DEBUG] [MAIN      ] UAA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:25.524164] [INFO ] [MAIN      ] UA: Generated 139 derivative records from 50822 primary records.
[2025-10-24T01:30:25.527019] [DEBUG] [LOCAL     ] UA: Saving derivative data.
[2025-10-24T01:30:25.546501] [DEBUG] [LOCAL     ] UA: Derivative data saved (139 records).
[2025-10-24T01:30:25.548448] [INFO ] [MAIN      ] UA: Successfully saved derivative data.
[2025-10-24T01:30:25.554807] [INFO ] [MAIN      ] Derivative Progress: 1972/2164 symbols completed. UA took 1.2s. Estimated remaining: 1m 20s. Rate: 143.5 symbols/min
[2025-10-24T01:30:25.555608] [INFO ] [MAIN      ] UBER: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:25.578840] [INFO ] [MAIN      ] UAN: Generated 139 derivative records from 5331 primary records.
[2025-10-24T01:30:25.580499] [DEBUG] [LOCAL     ] UAN: Saving derivative data.
[2025-10-24T01:30:25.583081] [INFO ] [MAIN      ] UAA: Generated 139 derivative records from 53888 primary records.
[2025-10-24T01:30:25.583860] [DEBUG] [LOCAL     ] UAA: Saving derivative data.
[2025-10-24T01:30:25.595422] [DEBUG] [LOCAL     ] UAN: Derivative data saved (139 records).
[2025-10-24T01:30:25.595555] [INFO ] [MAIN      ] UAN: Successfully saved derivative data.
[2025-10-24T01:30:25.597948] [INFO ] [MAIN      ] Derivative Progress: 1973/2164 symbols completed. UAN took 1.2s. Estimated remaining: 1m 20s. Rate: 143.6 symbols/min
[2025-10-24T01:30:25.598161] [INFO ] [MAIN      ] UBS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:25.610364] [DEBUG] [LOCAL     ] UAA: Derivative data saved (139 records).
[2025-10-24T01:30:25.623738] [INFO ] [MAIN      ] UAA: Successfully saved derivative data.
[2025-10-24T01:30:25.627269] [INFO ] [MAIN      ] Derivative Progress: 1974/2164 symbols completed. UAA took 1.2s. Estimated remaining: 1m 19s. Rate: 143.6 symbols/min
[2025-10-24T01:30:25.627831] [INFO ] [MAIN      ] UCB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:25.652126] [DEBUG] [LOCAL     ] UBER: Loaded 54196 existing records from primary storage.
[2025-10-24T01:30:25.652371] [INFO ] [MAIN      ] UBER: Loaded 54196 primary data records.
[2025-10-24T01:30:25.999448] [DEBUG] [LOCAL     ] UCB: Loaded 38009 existing records from primary storage.
[2025-10-24T01:30:26.000279] [INFO ] [MAIN      ] UCB: Loaded 38009 primary data records.
[2025-10-24T01:30:25.998497] [DEBUG] [LOCAL     ] UBS: Loaded 52657 existing records from primary storage.
[2025-10-24T01:30:26.000913] [INFO ] [MAIN      ] UBS: Loaded 52657 primary data records.
[2025-10-24T01:30:26.725164] [DEBUG] [MAIN      ] UBER: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:26.786313] [DEBUG] [MAIN      ] UCB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:26.804674] [INFO ] [MAIN      ] UBER: Generated 139 derivative records from 54196 primary records.
[2025-10-24T01:30:26.806973] [DEBUG] [LOCAL     ] UBER: Saving derivative data.
[2025-10-24T01:30:26.821159] [DEBUG] [MAIN      ] UBS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:26.855494] [DEBUG] [LOCAL     ] UBER: Derivative data saved (139 records).
[2025-10-24T01:30:26.858861] [INFO ] [MAIN      ] UBER: Successfully saved derivative data.
[2025-10-24T01:30:26.861889] [INFO ] [MAIN      ] Derivative Progress: 1975/2164 symbols completed. UBER took 1.3s. Estimated remaining: 1m 19s. Rate: 143.5 symbols/min
[2025-10-24T01:30:26.862345] [INFO ] [MAIN      ] UDR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:26.893556] [INFO ] [MAIN      ] UCB: Generated 139 derivative records from 38009 primary records.
[2025-10-24T01:30:26.896767] [DEBUG] [LOCAL     ] UCB: Saving derivative data.
[2025-10-24T01:30:26.911530] [DEBUG] [LOCAL     ] UCB: Derivative data saved (139 records).
[2025-10-24T01:30:26.914360] [INFO ] [MAIN      ] UCB: Successfully saved derivative data.
[2025-10-24T01:30:26.916835] [INFO ] [MAIN      ] Derivative Progress: 1976/2164 symbols completed. UCB took 1.3s. Estimated remaining: 1m 19s. Rate: 143.6 symbols/min
[2025-10-24T01:30:26.917545] [INFO ] [MAIN      ] UBS: Generated 139 derivative records from 52657 primary records.
[2025-10-24T01:30:26.933864] [INFO ] [MAIN      ] UE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:26.934331] [DEBUG] [LOCAL     ] UBS: Saving derivative data.
[2025-10-24T01:30:26.948434] [DEBUG] [LOCAL     ] UBS: Derivative data saved (139 records).
[2025-10-24T01:30:26.948865] [INFO ] [MAIN      ] UBS: Successfully saved derivative data.
[2025-10-24T01:30:26.952229] [INFO ] [MAIN      ] Derivative Progress: 1977/2164 symbols completed. UBS took 1.4s. Estimated remaining: 1m 18s. Rate: 143.6 symbols/min
[2025-10-24T01:30:26.953830] [INFO ] [MAIN      ] UFI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:26.976745] [DEBUG] [LOCAL     ] UDR: Loaded 52492 existing records from primary storage.
[2025-10-24T01:30:26.977192] [INFO ] [MAIN      ] UDR: Loaded 52492 primary data records.
[2025-10-24T01:30:27.076748] [DEBUG] [LOCAL     ] UFI: Loaded 8257 existing records from primary storage.
[2025-10-24T01:30:27.099405] [INFO ] [MAIN      ] UFI: Loaded 8257 primary data records.
[2025-10-24T01:30:27.235365] [DEBUG] [LOCAL     ] UE: Loaded 42745 existing records from primary storage.
[2025-10-24T01:30:27.326084] [INFO ] [MAIN      ] UE: Loaded 42745 primary data records.
[2025-10-24T01:30:28.000361] [DEBUG] [MAIN      ] UDR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:28.024607] [DEBUG] [MAIN      ] UFI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:28.080683] [DEBUG] [MAIN      ] UE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:28.124623] [INFO ] [MAIN      ] UDR: Generated 139 derivative records from 52492 primary records.
[2025-10-24T01:30:28.125332] [DEBUG] [LOCAL     ] UDR: Saving derivative data.
[2025-10-24T01:30:28.130461] [INFO ] [MAIN      ] UFI: Generated 139 derivative records from 8257 primary records.
[2025-10-24T01:30:28.131250] [DEBUG] [LOCAL     ] UFI: Saving derivative data.
[2025-10-24T01:30:28.144839] [DEBUG] [LOCAL     ] UDR: Derivative data saved (139 records).
[2025-10-24T01:30:28.158088] [DEBUG] [LOCAL     ] UFI: Derivative data saved (139 records).
[2025-10-24T01:30:28.155159] [INFO ] [MAIN      ] UDR: Successfully saved derivative data.
[2025-10-24T01:30:28.158216] [INFO ] [MAIN      ] UFI: Successfully saved derivative data.
[2025-10-24T01:30:28.161430] [INFO ] [MAIN      ] Derivative Progress: 1978/2164 symbols completed. UDR took 1.3s. Estimated remaining: 1m 18s. Rate: 143.5 symbols/min
[2025-10-24T01:30:28.164170] [INFO ] [MAIN      ] Derivative Progress: 1979/2164 symbols completed. UFI took 1.2s. Estimated remaining: 1m 17s. Rate: 143.6 symbols/min
[2025-10-24T01:30:28.169794] [INFO ] [MAIN      ] UE: Generated 139 derivative records from 42745 primary records.
[2025-10-24T01:30:28.169992] [DEBUG] [LOCAL     ] UE: Saving derivative data.
[2025-10-24T01:30:28.181829] [DEBUG] [LOCAL     ] UE: Derivative data saved (139 records).
[2025-10-24T01:30:28.181935] [INFO ] [MAIN      ] UE: Successfully saved derivative data.
[2025-10-24T01:30:28.184633] [INFO ] [MAIN      ] Derivative Progress: 1980/2164 symbols completed. UE took 1.3s. Estimated remaining: 1m 17s. Rate: 143.6 symbols/min
[2025-10-24T01:30:28.185074] [INFO ] [MAIN      ] UGI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:28.185200] [INFO ] [MAIN      ] UHAL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:28.185669] [INFO ] [MAIN      ] UGP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:28.211358] [DEBUG] [LOCAL     ] UHAL: Loaded 16970 existing records from primary storage.
[2025-10-24T01:30:28.211611] [INFO ] [MAIN      ] UHAL: Loaded 16970 primary data records.
[2025-10-24T01:30:28.393442] [DEBUG] [LOCAL     ] UGP: Loaded 43339 existing records from primary storage.
[2025-10-24T01:30:28.448848] [DEBUG] [LOCAL     ] UGI: Loaded 50834 existing records from primary storage.
[2025-10-24T01:30:28.432206] [INFO ] [MAIN      ] UGP: Loaded 43339 primary data records.
[2025-10-24T01:30:28.450861] [INFO ] [MAIN      ] UGI: Loaded 50834 primary data records.
[2025-10-24T01:30:29.257588] [DEBUG] [MAIN      ] UHAL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:29.304607] [DEBUG] [MAIN      ] UGI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:29.340626] [DEBUG] [MAIN      ] UGP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:29.382021] [INFO ] [MAIN      ] UHAL: Generated 139 derivative records from 16970 primary records.
[2025-10-24T01:30:29.384353] [DEBUG] [LOCAL     ] UHAL: Saving derivative data.
[2025-10-24T01:30:29.412370] [DEBUG] [LOCAL     ] UHAL: Derivative data saved (139 records).
[2025-10-24T01:30:29.416852] [INFO ] [MAIN      ] UHAL: Successfully saved derivative data.
[2025-10-24T01:30:29.422800] [INFO ] [MAIN      ] Derivative Progress: 1981/2164 symbols completed. UHAL took 1.2s. Estimated remaining: 1m 17s. Rate: 143.5 symbols/min
[2025-10-24T01:30:29.424488] [INFO ] [MAIN      ] UHT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:29.429124] [INFO ] [MAIN      ] UGI: Generated 139 derivative records from 50834 primary records.
[2025-10-24T01:30:29.431304] [INFO ] [MAIN      ] UGP: Generated 139 derivative records from 43339 primary records.
[2025-10-24T01:30:29.431537] [DEBUG] [LOCAL     ] UGI: Saving derivative data.
[2025-10-24T01:30:29.432024] [DEBUG] [LOCAL     ] UGP: Saving derivative data.
[2025-10-24T01:30:29.452012] [DEBUG] [LOCAL     ] UGP: Derivative data saved (139 records).
[2025-10-24T01:30:29.456815] [INFO ] [MAIN      ] UGP: Successfully saved derivative data.
[2025-10-24T01:30:29.460414] [DEBUG] [LOCAL     ] UGI: Derivative data saved (139 records).
[2025-10-24T01:30:29.463977] [INFO ] [MAIN      ] UGI: Successfully saved derivative data.
[2025-10-24T01:30:29.463725] [INFO ] [MAIN      ] Derivative Progress: 1982/2164 symbols completed. UGP took 1.3s. Estimated remaining: 1m 16s. Rate: 143.6 symbols/min
[2025-10-24T01:30:29.467521] [INFO ] [MAIN      ] Derivative Progress: 1983/2164 symbols completed. UGI took 1.3s. Estimated remaining: 1m 16s. Rate: 143.6 symbols/min
[2025-10-24T01:30:29.467436] [INFO ] [MAIN      ] UI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:29.467963] [INFO ] [MAIN      ] UIS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:29.473967] [DEBUG] [LOCAL     ] UHT: Loaded 10280 existing records from primary storage.
[2025-10-24T01:30:29.474107] [INFO ] [MAIN      ] UHT: Loaded 10280 primary data records.
[2025-10-24T01:30:29.615487] [DEBUG] [LOCAL     ] UI: Loaded 14283 existing records from primary storage.
[2025-10-24T01:30:29.631236] [INFO ] [MAIN      ] UI: Loaded 14283 primary data records.
[2025-10-24T01:30:29.943193] [DEBUG] [LOCAL     ] UIS: Loaded 36820 existing records from primary storage.
[2025-10-24T01:30:29.974153] [INFO ] [MAIN      ] UIS: Loaded 36820 primary data records.
[2025-10-24T01:30:30.453085] [DEBUG] [MAIN      ] UHT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:30.497444] [DEBUG] [MAIN      ] UI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:30.543755] [DEBUG] [MAIN      ] UIS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:30.567096] [INFO ] [MAIN      ] UHT: Generated 139 derivative records from 10280 primary records.
[2025-10-24T01:30:30.567765] [DEBUG] [LOCAL     ] UHT: Saving derivative data.
[2025-10-24T01:30:30.592139] [DEBUG] [LOCAL     ] UHT: Derivative data saved (139 records).
[2025-10-24T01:30:30.592836] [INFO ] [MAIN      ] UHT: Successfully saved derivative data.
[2025-10-24T01:30:30.597494] [INFO ] [MAIN      ] Derivative Progress: 1984/2164 symbols completed. UHT took 1.2s. Estimated remaining: 1m 15s. Rate: 143.5 symbols/min
[2025-10-24T01:30:30.598497] [INFO ] [MAIN      ] UL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:30.615217] [INFO ] [MAIN      ] UI: Generated 139 derivative records from 14283 primary records.
[2025-10-24T01:30:30.616775] [DEBUG] [LOCAL     ] UI: Saving derivative data.
[2025-10-24T01:30:30.637258] [DEBUG] [LOCAL     ] UI: Derivative data saved (139 records).
[2025-10-24T01:30:30.637431] [INFO ] [MAIN      ] UI: Successfully saved derivative data.
[2025-10-24T01:30:30.637966] [INFO ] [MAIN      ] UIS: Generated 139 derivative records from 36820 primary records.
[2025-10-24T01:30:30.638091] [DEBUG] [LOCAL     ] UIS: Saving derivative data.
[2025-10-24T01:30:30.640431] [INFO ] [MAIN      ] Derivative Progress: 1985/2164 symbols completed. UI took 1.2s. Estimated remaining: 1m 15s. Rate: 143.6 symbols/min
[2025-10-24T01:30:30.641571] [INFO ] [MAIN      ] ULS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:30.654310] [DEBUG] [LOCAL     ] UIS: Derivative data saved (139 records).
[2025-10-24T01:30:30.654522] [INFO ] [MAIN      ] UIS: Successfully saved derivative data.
[2025-10-24T01:30:30.657605] [INFO ] [MAIN      ] Derivative Progress: 1986/2164 symbols completed. UIS took 1.2s. Estimated remaining: 1m 14s. Rate: 143.6 symbols/min
[2025-10-24T01:30:30.671537] [INFO ] [MAIN      ] UMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:30.694221] [DEBUG] [LOCAL     ] UL: Loaded 53459 existing records from primary storage.
[2025-10-24T01:30:30.694397] [INFO ] [MAIN      ] UL: Loaded 53459 primary data records.
[2025-10-24T01:30:30.885687] [DEBUG] [LOCAL     ] ULS: Loaded 38712 existing records from primary storage.
[2025-10-24T01:30:31.039543] [INFO ] [MAIN      ] ULS: Loaded 38712 primary data records.
[2025-10-24T01:30:31.105959] [DEBUG] [LOCAL     ] UMC: Loaded 53054 existing records from primary storage.
[2025-10-24T01:30:31.125558] [INFO ] [MAIN      ] UMC: Loaded 53054 primary data records.
[2025-10-24T01:30:31.734485] [DEBUG] [MAIN      ] UL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:31.796062] [DEBUG] [MAIN      ] ULS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:31.828937] [INFO ] [MAIN      ] UL: Generated 139 derivative records from 53459 primary records.
[2025-10-24T01:30:31.843463] [DEBUG] [MAIN      ] UMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:31.845773] [DEBUG] [LOCAL     ] UL: Saving derivative data.
[2025-10-24T01:30:31.878202] [DEBUG] [LOCAL     ] UL: Derivative data saved (139 records).
[2025-10-24T01:30:31.879291] [INFO ] [MAIN      ] UL: Successfully saved derivative data.
[2025-10-24T01:30:31.883202] [INFO ] [MAIN      ] Derivative Progress: 1987/2164 symbols completed. UL took 1.3s. Estimated remaining: 1m 14s. Rate: 143.5 symbols/min
[2025-10-24T01:30:31.884665] [INFO ] [MAIN      ] UMH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:31.927742] [INFO ] [MAIN      ] ULS: Generated 139 derivative records from 38712 primary records.
[2025-10-24T01:30:31.928522] [DEBUG] [LOCAL     ] ULS: Saving derivative data.
[2025-10-24T01:30:31.959793] [DEBUG] [LOCAL     ] ULS: Derivative data saved (139 records).
[2025-10-24T01:30:31.961716] [DEBUG] [LOCAL     ] UMH: Loaded 34448 existing records from primary storage.
[2025-10-24T01:30:31.961939] [INFO ] [MAIN      ] ULS: Successfully saved derivative data.
[2025-10-24T01:30:31.965246] [INFO ] [MAIN      ] Derivative Progress: 1988/2164 symbols completed. ULS took 1.3s. Estimated remaining: 1m 14s. Rate: 143.6 symbols/min
[2025-10-24T01:30:31.965454] [INFO ] [MAIN      ] UNF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:31.965704] [INFO ] [MAIN      ] UMH: Loaded 34448 primary data records.
[2025-10-24T01:30:32.010719] [INFO ] [MAIN      ] UMC: Generated 139 derivative records from 53054 primary records.
[2025-10-24T01:30:32.069280] [DEBUG] [LOCAL     ] UMC: Saving derivative data.
[2025-10-24T01:30:32.097841] [DEBUG] [LOCAL     ] UNF: Loaded 11947 existing records from primary storage.
[2025-10-24T01:30:32.099042] [INFO ] [MAIN      ] UNF: Loaded 11947 primary data records.
[2025-10-24T01:30:32.253361] [DEBUG] [LOCAL     ] UMC: Derivative data saved (139 records).
[2025-10-24T01:30:32.253589] [INFO ] [MAIN      ] UMC: Successfully saved derivative data.
[2025-10-24T01:30:32.271985] [INFO ] [MAIN      ] Derivative Progress: 1989/2164 symbols completed. UMC took 1.6s. Estimated remaining: 1m 13s. Rate: 143.6 symbols/min
[2025-10-24T01:30:32.421270] [INFO ] [MAIN      ] UNFI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:32.691551] [DEBUG] [MAIN      ] UMH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:32.736197] [DEBUG] [LOCAL     ] UNFI: Loaded 42908 existing records from primary storage.
[2025-10-24T01:30:32.739895] [INFO ] [MAIN      ] UNFI: Loaded 42908 primary data records.
[2025-10-24T01:30:32.831134] [DEBUG] [MAIN      ] UNF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:33.153403] [INFO ] [MAIN      ] UMH: Generated 139 derivative records from 34448 primary records.
[2025-10-24T01:30:33.159343] [DEBUG] [LOCAL     ] UMH: Saving derivative data.
[2025-10-24T01:30:33.179997] [DEBUG] [LOCAL     ] UMH: Derivative data saved (139 records).
[2025-10-24T01:30:33.180580] [INFO ] [MAIN      ] UMH: Successfully saved derivative data.
[2025-10-24T01:30:33.184398] [INFO ] [MAIN      ] Derivative Progress: 1990/2164 symbols completed. UMH took 1.3s. Estimated remaining: 1m 13s. Rate: 143.5 symbols/min
[2025-10-24T01:30:33.188669] [INFO ] [MAIN      ] UNF: Generated 139 derivative records from 11947 primary records.
[2025-10-24T01:30:33.188757] [INFO ] [MAIN      ] UNH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:33.189177] [DEBUG] [LOCAL     ] UNF: Saving derivative data.
[2025-10-24T01:30:33.205183] [DEBUG] [LOCAL     ] UNF: Derivative data saved (139 records).
[2025-10-24T01:30:33.205571] [INFO ] [MAIN      ] UNF: Successfully saved derivative data.
[2025-10-24T01:30:33.210541] [INFO ] [MAIN      ] Derivative Progress: 1991/2164 symbols completed. UNF took 1.2s. Estimated remaining: 1m 12s. Rate: 143.6 symbols/min
[2025-10-24T01:30:33.211143] [INFO ] [MAIN      ] UNM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:33.224684] [DEBUG] [MAIN      ] UNFI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:33.283911] [INFO ] [MAIN      ] UNFI: Generated 139 derivative records from 42908 primary records.
[2025-10-24T01:30:33.284107] [DEBUG] [LOCAL     ] UNFI: Saving derivative data.
[2025-10-24T01:30:33.330208] [DEBUG] [LOCAL     ] UNH: Loaded 54209 existing records from primary storage.
[2025-10-24T01:30:33.330767] [INFO ] [MAIN      ] UNH: Loaded 54209 primary data records.
[2025-10-24T01:30:33.331879] [DEBUG] [LOCAL     ] UNM: Loaded 48281 existing records from primary storage.
[2025-10-24T01:30:33.331170] [DEBUG] [LOCAL     ] UNFI: Derivative data saved (139 records).
[2025-10-24T01:30:33.352805] [INFO ] [MAIN      ] UNFI: Successfully saved derivative data.
[2025-10-24T01:30:33.355738] [INFO ] [MAIN      ] Derivative Progress: 1992/2164 symbols completed. UNFI took 0.9s. Estimated remaining: 1m 12s. Rate: 143.6 symbols/min
[2025-10-24T01:30:33.352725] [INFO ] [MAIN      ] UNM: Loaded 48281 primary data records.
[2025-10-24T01:30:33.366456] [INFO ] [MAIN      ] UNMA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:33.596056] [DEBUG] [LOCAL     ] UNMA: Loaded 3427 existing records from primary storage.
[2025-10-24T01:30:33.805544] [INFO ] [MAIN      ] UNMA: Loaded 3427 primary data records.
[2025-10-24T01:30:34.295191] [DEBUG] [MAIN      ] UNH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:34.335610] [DEBUG] [MAIN      ] UNM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:34.385291] [DEBUG] [MAIN      ] UNMA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:34.435308] [INFO ] [MAIN      ] UNH: Generated 139 derivative records from 54209 primary records.
[2025-10-24T01:30:34.444395] [DEBUG] [LOCAL     ] UNH: Saving derivative data.
[2025-10-24T01:30:34.451947] [INFO ] [MAIN      ] UNM: Generated 139 derivative records from 48281 primary records.
[2025-10-24T01:30:34.467241] [DEBUG] [LOCAL     ] UNH: Derivative data saved (139 records).
[2025-10-24T01:30:34.471295] [INFO ] [MAIN      ] UNH: Successfully saved derivative data.
[2025-10-24T01:30:34.475017] [INFO ] [MAIN      ] Derivative Progress: 1993/2164 symbols completed. UNH took 1.3s. Estimated remaining: 1m 12s. Rate: 143.5 symbols/min
[2025-10-24T01:30:34.467381] [DEBUG] [LOCAL     ] UNM: Saving derivative data.
[2025-10-24T01:30:34.492830] [INFO ] [MAIN      ] UNMA: Generated 139 derivative records from 3427 primary records.
[2025-10-24T01:30:34.493270] [DEBUG] [LOCAL     ] UNM: Derivative data saved (139 records).
[2025-10-24T01:30:34.493678] [DEBUG] [LOCAL     ] UNMA: Saving derivative data.
[2025-10-24T01:30:34.493779] [INFO ] [MAIN      ] UNM: Successfully saved derivative data.
[2025-10-24T01:30:34.497462] [INFO ] [MAIN      ] Derivative Progress: 1994/2164 symbols completed. UNM took 1.3s. Estimated remaining: 1m 11s. Rate: 143.5 symbols/min
[2025-10-24T01:30:34.509173] [DEBUG] [LOCAL     ] UNMA: Derivative data saved (139 records).
[2025-10-24T01:30:34.509317] [INFO ] [MAIN      ] UNMA: Successfully saved derivative data.
[2025-10-24T01:30:34.513780] [INFO ] [MAIN      ] Derivative Progress: 1995/2164 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 11s. Rate: 143.6 symbols/min
[2025-10-24T01:30:34.514775] [INFO ] [MAIN      ] UP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:34.514583] [INFO ] [MAIN      ] UPS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:34.514412] [INFO ] [MAIN      ] UNP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:34.612368] [DEBUG] [LOCAL     ] UP: Loaded 44786 existing records from primary storage.
[2025-10-24T01:30:34.614490] [INFO ] [MAIN      ] UP: Loaded 44786 primary data records.
[2025-10-24T01:30:34.621027] [DEBUG] [LOCAL     ] UPS: Loaded 54111 existing records from primary storage.
[2025-10-24T01:30:34.678939] [INFO ] [MAIN      ] UPS: Loaded 54111 primary data records.
[2025-10-24T01:30:34.731617] [DEBUG] [LOCAL     ] UNP: Loaded 53752 existing records from primary storage.
[2025-10-24T01:30:34.796903] [INFO ] [MAIN      ] UNP: Loaded 53752 primary data records.
[2025-10-24T01:30:35.714085] [DEBUG] [MAIN      ] UP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:35.756061] [DEBUG] [MAIN      ] UPS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:35.787409] [DEBUG] [MAIN      ] UNP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:35.843129] [INFO ] [MAIN      ] UP: Generated 139 derivative records from 44786 primary records.
[2025-10-24T01:30:35.845540] [DEBUG] [LOCAL     ] UP: Saving derivative data.
[2025-10-24T01:30:35.868791] [DEBUG] [LOCAL     ] UP: Derivative data saved (139 records).
[2025-10-24T01:30:35.869468] [INFO ] [MAIN      ] UP: Successfully saved derivative data.
[2025-10-24T01:30:35.877509] [INFO ] [MAIN      ] Derivative Progress: 1996/2164 symbols completed. UP took 1.4s. Estimated remaining: 1m 10s. Rate: 143.5 symbols/min
[2025-10-24T01:30:35.882470] [INFO ] [MAIN      ] URI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:35.887705] [INFO ] [MAIN      ] UPS: Generated 139 derivative records from 54111 primary records.
[2025-10-24T01:30:35.888235] [DEBUG] [LOCAL     ] UPS: Saving derivative data.
[2025-10-24T01:30:35.891699] [INFO ] [MAIN      ] UNP: Generated 139 derivative records from 53752 primary records.
[2025-10-24T01:30:35.904477] [DEBUG] [LOCAL     ] UPS: Derivative data saved (139 records).
[2025-10-24T01:30:35.904690] [DEBUG] [LOCAL     ] UNP: Saving derivative data.
[2025-10-24T01:30:35.904861] [INFO ] [MAIN      ] UPS: Successfully saved derivative data.
[2025-10-24T01:30:35.909715] [INFO ] [MAIN      ] Derivative Progress: 1997/2164 symbols completed. UPS took 1.4s. Estimated remaining: 1m 10s. Rate: 143.5 symbols/min
[2025-10-24T01:30:35.910456] [INFO ] [MAIN      ] USA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:35.924111] [DEBUG] [LOCAL     ] UNP: Derivative data saved (139 records).
[2025-10-24T01:30:35.924281] [INFO ] [MAIN      ] UNP: Successfully saved derivative data.
[2025-10-24T01:30:35.928718] [INFO ] [MAIN      ] Derivative Progress: 1998/2164 symbols completed. UNP took 1.4s. Estimated remaining: 1m 9s. Rate: 143.6 symbols/min
[2025-10-24T01:30:35.929501] [INFO ] [MAIN      ] USAC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:35.960626] [DEBUG] [LOCAL     ] URI: Loaded 34614 existing records from primary storage.
[2025-10-24T01:30:35.961141] [INFO ] [MAIN      ] URI: Loaded 34614 primary data records.
[2025-10-24T01:30:36.121787] [DEBUG] [LOCAL     ] USAC: Loaded 21803 existing records from primary storage.
[2025-10-24T01:30:36.151414] [INFO ] [MAIN      ] USAC: Loaded 21803 primary data records.
[2025-10-24T01:30:36.216172] [DEBUG] [LOCAL     ] USA: Loaded 36639 existing records from primary storage.
[2025-10-24T01:30:36.354413] [INFO ] [MAIN      ] USA: Loaded 36639 primary data records.
[2025-10-24T01:30:36.981348] [DEBUG] [MAIN      ] URI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:37.022609] [DEBUG] [MAIN      ] USAC: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:30:37.066247] [DEBUG] [MAIN      ] USA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:37.119892] [INFO ] [MAIN      ] URI: Generated 139 derivative records from 34614 primary records.
[2025-10-24T01:30:37.122108] [DEBUG] [LOCAL     ] URI: Saving derivative data.
[2025-10-24T01:30:37.146108] [DEBUG] [LOCAL     ] URI: Derivative data saved (139 records).
[2025-10-24T01:30:37.149318] [INFO ] [MAIN      ] URI: Successfully saved derivative data.
[2025-10-24T01:30:37.153142] [INFO ] [MAIN      ] Derivative Progress: 1999/2164 symbols completed. URI took 1.3s. Estimated remaining: 1m 9s. Rate: 143.5 symbols/min
[2025-10-24T01:30:37.155349] [INFO ] [MAIN      ] USB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:37.153769] [INFO ] [MAIN      ] USAC: Generated 139 derivative records from 21803 primary records.
[2025-10-24T01:30:37.156759] [DEBUG] [LOCAL     ] USAC: Saving derivative data.
[2025-10-24T01:30:37.171561] [DEBUG] [LOCAL     ] USAC: Derivative data saved (139 records).
[2025-10-24T01:30:37.171919] [INFO ] [MAIN      ] USAC: Successfully saved derivative data.
[2025-10-24T01:30:37.175930] [INFO ] [MAIN      ] Derivative Progress: 2000/2164 symbols completed. USAC took 1.2s. Estimated remaining: 1m 9s. Rate: 143.5 symbols/min
[2025-10-24T01:30:37.180338] [INFO ] [MAIN      ] USFD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:37.184673] [INFO ] [MAIN      ] USA: Generated 139 derivative records from 36639 primary records.
[2025-10-24T01:30:37.185052] [DEBUG] [LOCAL     ] USA: Saving derivative data.
[2025-10-24T01:30:37.198553] [DEBUG] [LOCAL     ] USA: Derivative data saved (139 records).
[2025-10-24T01:30:37.199167] [INFO ] [MAIN      ] USA: Successfully saved derivative data.
[2025-10-24T01:30:37.203689] [INFO ] [MAIN      ] Derivative Progress: 2001/2164 symbols completed. USA took 1.3s. Estimated remaining: 1m 8s. Rate: 143.6 symbols/min
[2025-10-24T01:30:37.204031] [INFO ] [MAIN      ] USNA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:37.270432] [DEBUG] [LOCAL     ] USNA: Loaded 18214 existing records from primary storage.
[2025-10-24T01:30:37.270727] [INFO ] [MAIN      ] USNA: Loaded 18214 primary data records.
[2025-10-24T01:30:37.294048] [DEBUG] [LOCAL     ] USB: Loaded 54078 existing records from primary storage.
[2025-10-24T01:30:37.344503] [INFO ] [MAIN      ] USB: Loaded 54078 primary data records.
[2025-10-24T01:30:37.500554] [DEBUG] [LOCAL     ] USFD: Loaded 51509 existing records from primary storage.
[2025-10-24T01:30:37.515668] [INFO ] [MAIN      ] USFD: Loaded 51509 primary data records.
[2025-10-24T01:30:38.327942] [DEBUG] [MAIN      ] USB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:38.328757] [DEBUG] [MAIN      ] USNA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:38.403117] [DEBUG] [MAIN      ] USFD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:38.442750] [INFO ] [MAIN      ] USNA: Generated 139 derivative records from 18214 primary records.
[2025-10-24T01:30:38.445580] [DEBUG] [LOCAL     ] USNA: Saving derivative data.
[2025-10-24T01:30:38.446136] [INFO ] [MAIN      ] USB: Generated 139 derivative records from 54078 primary records.
[2025-10-24T01:30:38.449436] [DEBUG] [LOCAL     ] USB: Saving derivative data.
[2025-10-24T01:30:38.463548] [DEBUG] [LOCAL     ] USNA: Derivative data saved (139 records).
[2025-10-24T01:30:38.467414] [INFO ] [MAIN      ] USNA: Successfully saved derivative data.
[2025-10-24T01:30:38.484354] [INFO ] [MAIN      ] Derivative Progress: 2002/2164 symbols completed. USNA took 1.3s. Estimated remaining: 1m 8s. Rate: 143.4 symbols/min
[2025-10-24T01:30:38.487545] [INFO ] [MAIN      ] USPH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:38.496352] [DEBUG] [LOCAL     ] USB: Derivative data saved (139 records).
[2025-10-24T01:30:38.498409] [INFO ] [MAIN      ] USB: Successfully saved derivative data.
[2025-10-24T01:30:38.502759] [INFO ] [MAIN      ] Derivative Progress: 2003/2164 symbols completed. USB took 1.3s. Estimated remaining: 1m 7s. Rate: 143.5 symbols/min
[2025-10-24T01:30:38.505404] [INFO ] [MAIN      ] UTF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:38.511401] [INFO ] [MAIN      ] USFD: Generated 139 derivative records from 51509 primary records.
[2025-10-24T01:30:38.511788] [DEBUG] [LOCAL     ] USFD: Saving derivative data.
[2025-10-24T01:30:38.534341] [DEBUG] [LOCAL     ] USFD: Derivative data saved (139 records).
[2025-10-24T01:30:38.535811] [DEBUG] [LOCAL     ] USPH: Loaded 17083 existing records from primary storage.
[2025-10-24T01:30:38.536130] [INFO ] [MAIN      ] USFD: Successfully saved derivative data.
[2025-10-24T01:30:38.539984] [INFO ] [MAIN      ] Derivative Progress: 2004/2164 symbols completed. USFD took 1.4s. Estimated remaining: 1m 7s. Rate: 143.6 symbols/min
[2025-10-24T01:30:38.536440] [INFO ] [MAIN      ] USPH: Loaded 17083 primary data records.
[2025-10-24T01:30:38.540172] [INFO ] [MAIN      ] UTI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:38.676840] [DEBUG] [LOCAL     ] UTF: Loaded 31254 existing records from primary storage.
[2025-10-24T01:30:38.688060] [INFO ] [MAIN      ] UTF: Loaded 31254 primary data records.
[2025-10-24T01:30:39.034406] [DEBUG] [LOCAL     ] UTI: Loaded 40647 existing records from primary storage.
[2025-10-24T01:30:39.063702] [INFO ] [MAIN      ] UTI: Loaded 40647 primary data records.
[2025-10-24T01:30:39.765965] [DEBUG] [MAIN      ] USPH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:39.811312] [DEBUG] [MAIN      ] UTF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:39.895514] [INFO ] [MAIN      ] USPH: Generated 139 derivative records from 17083 primary records.
[2025-10-24T01:30:39.896563] [DEBUG] [LOCAL     ] USPH: Saving derivative data.
[2025-10-24T01:30:39.896300] [DEBUG] [MAIN      ] UTI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:39.927325] [INFO ] [MAIN      ] UTF: Generated 139 derivative records from 31254 primary records.
[2025-10-24T01:30:39.923828] [DEBUG] [LOCAL     ] USPH: Derivative data saved (139 records).
[2025-10-24T01:30:39.927539] [INFO ] [MAIN      ] USPH: Successfully saved derivative data.
[2025-10-24T01:30:39.930837] [INFO ] [MAIN      ] Derivative Progress: 2005/2164 symbols completed. USPH took 1.4s. Estimated remaining: 1m 7s. Rate: 143.4 symbols/min
[2025-10-24T01:30:39.927843] [DEBUG] [LOCAL     ] UTF: Saving derivative data.
[2025-10-24T01:30:39.932701] [INFO ] [MAIN      ] UTL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:39.951214] [DEBUG] [LOCAL     ] UTF: Derivative data saved (139 records).
[2025-10-24T01:30:39.954494] [INFO ] [MAIN      ] UTF: Successfully saved derivative data.
[2025-10-24T01:30:39.961735] [INFO ] [MAIN      ] Derivative Progress: 2006/2164 symbols completed. UTF took 1.5s. Estimated remaining: 1m 6s. Rate: 143.5 symbols/min
[2025-10-24T01:30:39.966598] [INFO ] [MAIN      ] UTZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:39.976528] [DEBUG] [LOCAL     ] UTL: Loaded 11902 existing records from primary storage.
[2025-10-24T01:30:39.977101] [INFO ] [MAIN      ] UTL: Loaded 11902 primary data records.
[2025-10-24T01:30:40.024845] [INFO ] [MAIN      ] UTI: Generated 139 derivative records from 40647 primary records.
[2025-10-24T01:30:40.063580] [DEBUG] [LOCAL     ] UTI: Saving derivative data.
[2025-10-24T01:30:40.140079] [DEBUG] [LOCAL     ] UTI: Derivative data saved (139 records).
[2025-10-24T01:30:40.324532] [INFO ] [MAIN      ] UTI: Successfully saved derivative data.
[2025-10-24T01:30:40.336172] [INFO ] [MAIN      ] Derivative Progress: 2007/2164 symbols completed. UTI took 1.8s. Estimated remaining: 1m 6s. Rate: 143.5 symbols/min
[2025-10-24T01:30:40.338569] [INFO ] [MAIN      ] UVE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:40.352284] [DEBUG] [LOCAL     ] UTZ: Loaded 44488 existing records from primary storage.
[2025-10-24T01:30:40.353567] [INFO ] [MAIN      ] UTZ: Loaded 44488 primary data records.
[2025-10-24T01:30:40.533499] [DEBUG] [LOCAL     ] UVE: Loaded 22079 existing records from primary storage.
[2025-10-24T01:30:40.658020] [INFO ] [MAIN      ] UVE: Loaded 22079 primary data records.
[2025-10-24T01:30:40.821197] [DEBUG] [MAIN      ] UTL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:41.039701] [DEBUG] [MAIN      ] UTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:41.071123] [INFO ] [MAIN      ] UTL: Generated 139 derivative records from 11902 primary records.
[2025-10-24T01:30:41.085013] [DEBUG] [LOCAL     ] UTL: Saving derivative data.
[2025-10-24T01:30:41.085330] [DEBUG] [MAIN      ] UVE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:41.115002] [DEBUG] [LOCAL     ] UTL: Derivative data saved (139 records).
[2025-10-24T01:30:41.118631] [INFO ] [MAIN      ] UTL: Successfully saved derivative data.
[2025-10-24T01:30:41.121572] [INFO ] [MAIN      ] Derivative Progress: 2008/2164 symbols completed. UTL took 1.2s. Estimated remaining: 1m 5s. Rate: 143.4 symbols/min
[2025-10-24T01:30:41.138591] [INFO ] [MAIN      ] UTZ: Generated 139 derivative records from 44488 primary records.
[2025-10-24T01:30:41.139891] [DEBUG] [LOCAL     ] UTZ: Saving derivative data.
[2025-10-24T01:30:41.153496] [INFO ] [MAIN      ] UVE: Generated 139 derivative records from 22079 primary records.
[2025-10-24T01:30:41.156215] [DEBUG] [LOCAL     ] UVE: Saving derivative data.
[2025-10-24T01:30:41.159598] [DEBUG] [LOCAL     ] UTZ: Derivative data saved (139 records).
[2025-10-24T01:30:41.171560] [DEBUG] [LOCAL     ] UVE: Derivative data saved (139 records).
[2025-10-24T01:30:41.166978] [INFO ] [MAIN      ] UTZ: Successfully saved derivative data.
[2025-10-24T01:30:41.171780] [INFO ] [MAIN      ] UVE: Successfully saved derivative data.
[2025-10-24T01:30:41.175675] [INFO ] [MAIN      ] Derivative Progress: 2009/2164 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 5s. Rate: 143.5 symbols/min
[2025-10-24T01:30:41.179099] [INFO ] [MAIN      ] Derivative Progress: 2010/2164 symbols completed. UVE took 0.8s. Estimated remaining: 1m 4s. Rate: 143.5 symbols/min
[2025-10-24T01:30:41.179596] [INFO ] [MAIN      ] UVV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:41.179699] [INFO ] [MAIN      ] UZD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:41.179774] [INFO ] [MAIN      ] UWMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:41.191599] [DEBUG] [LOCAL     ] UZD: Loaded 5805 existing records from primary storage.
[2025-10-24T01:30:41.191987] [INFO ] [MAIN      ] UZD: Loaded 5805 primary data records.
[2025-10-24T01:30:41.517120] [DEBUG] [LOCAL     ] UVV: Loaded 22875 existing records from primary storage.
[2025-10-24T01:30:41.517981] [INFO ] [MAIN      ] UVV: Loaded 22875 primary data records.
[2025-10-24T01:30:41.640123] [DEBUG] [LOCAL     ] UWMC: Loaded 53348 existing records from primary storage.
[2025-10-24T01:30:41.644180] [INFO ] [MAIN      ] UWMC: Loaded 53348 primary data records.
[2025-10-24T01:30:42.262302] [DEBUG] [MAIN      ] UZD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:42.314758] [DEBUG] [MAIN      ] UVV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:42.354522] [DEBUG] [MAIN      ] UWMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:42.354872] [INFO ] [MAIN      ] UZD: Generated 139 derivative records from 5805 primary records.
[2025-10-24T01:30:42.370145] [DEBUG] [LOCAL     ] UZD: Saving derivative data.
[2025-10-24T01:30:42.385752] [DEBUG] [LOCAL     ] UZD: Derivative data saved (139 records).
[2025-10-24T01:30:42.389821] [INFO ] [MAIN      ] UZD: Successfully saved derivative data.
[2025-10-24T01:30:42.392739] [INFO ] [MAIN      ] Derivative Progress: 2011/2164 symbols completed. UZD took 1.2s. Estimated remaining: 1m 4s. Rate: 143.4 symbols/min
[2025-10-24T01:30:42.394054] [INFO ] [MAIN      ] UZE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:42.416803] [DEBUG] [LOCAL     ] UZE: Loaded 6952 existing records from primary storage.
[2025-10-24T01:30:42.418718] [INFO ] [MAIN      ] UZE: Loaded 6952 primary data records.
[2025-10-24T01:30:42.421831] [INFO ] [MAIN      ] UVV: Generated 139 derivative records from 22875 primary records.
[2025-10-24T01:30:42.443850] [DEBUG] [LOCAL     ] UVV: Saving derivative data.
[2025-10-24T01:30:42.543574] [INFO ] [MAIN      ] UWMC: Generated 139 derivative records from 53348 primary records.
[2025-10-24T01:30:42.547004] [DEBUG] [LOCAL     ] UVV: Derivative data saved (139 records).
[2025-10-24T01:30:42.557558] [DEBUG] [LOCAL     ] UWMC: Saving derivative data.
[2025-10-24T01:30:42.567941] [INFO ] [MAIN      ] UVV: Successfully saved derivative data.
[2025-10-24T01:30:42.589902] [INFO ] [MAIN      ] Derivative Progress: 2012/2164 symbols completed. UVV took 1.4s. Estimated remaining: 1m 4s. Rate: 143.5 symbols/min
[2025-10-24T01:30:42.632732] [INFO ] [MAIN      ] V: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:42.760998] [DEBUG] [LOCAL     ] UWMC: Derivative data saved (139 records).
[2025-10-24T01:30:42.761212] [INFO ] [MAIN      ] UWMC: Successfully saved derivative data.
[2025-10-24T01:30:42.764555] [INFO ] [MAIN      ] Derivative Progress: 2013/2164 symbols completed. UWMC took 1.6s. Estimated remaining: 1m 3s. Rate: 143.5 symbols/min
[2025-10-24T01:30:42.764966] [INFO ] [MAIN      ] VAC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:42.830045] [DEBUG] [MAIN      ] UZE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:42.832199] [DEBUG] [LOCAL     ] VAC: Loaded 33922 existing records from primary storage.
[2025-10-24T01:30:42.847166] [INFO ] [MAIN      ] VAC: Loaded 33922 primary data records.
[2025-10-24T01:30:42.979130] [DEBUG] [LOCAL     ] V: Loaded 54139 existing records from primary storage.
[2025-10-24T01:30:42.983237] [INFO ] [MAIN      ] V: Loaded 54139 primary data records.
[2025-10-24T01:30:43.516200] [INFO ] [MAIN      ] UZE: Generated 139 derivative records from 6952 primary records.
[2025-10-24T01:30:43.525709] [DEBUG] [LOCAL     ] UZE: Saving derivative data.
[2025-10-24T01:30:43.539121] [DEBUG] [LOCAL     ] UZE: Derivative data saved (139 records).
[2025-10-24T01:30:43.539292] [INFO ] [MAIN      ] UZE: Successfully saved derivative data.
[2025-10-24T01:30:43.541854] [INFO ] [MAIN      ] Derivative Progress: 2014/2164 symbols completed. UZE took 1.1s. Estimated remaining: 1m 3s. Rate: 143.4 symbols/min
[2025-10-24T01:30:43.542149] [INFO ] [MAIN      ] VAL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:43.564074] [DEBUG] [MAIN      ] VAC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:43.603523] [DEBUG] [MAIN      ] V: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:43.658475] [DEBUG] [LOCAL     ] VAL: Loaded 50242 existing records from primary storage.
[2025-10-24T01:30:43.661375] [INFO ] [MAIN      ] VAC: Generated 139 derivative records from 33922 primary records.
[2025-10-24T01:30:43.660986] [INFO ] [MAIN      ] VAL: Loaded 50242 primary data records.
[2025-10-24T01:30:43.676432] [DEBUG] [LOCAL     ] VAC: Saving derivative data.
[2025-10-24T01:30:43.752667] [DEBUG] [LOCAL     ] VAC: Derivative data saved (139 records).
[2025-10-24T01:30:43.760945] [INFO ] [MAIN      ] VAC: Successfully saved derivative data.
[2025-10-24T01:30:43.779979] [INFO ] [MAIN      ] Derivative Progress: 2015/2164 symbols completed. VAC took 1.0s. Estimated remaining: 1m 2s. Rate: 143.5 symbols/min
[2025-10-24T01:30:43.795171] [INFO ] [MAIN      ] VALE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:43.891033] [INFO ] [MAIN      ] V: Generated 139 derivative records from 54139 primary records.
[2025-10-24T01:30:43.998430] [DEBUG] [LOCAL     ] V: Saving derivative data.
[2025-10-24T01:30:44.022598] [DEBUG] [LOCAL     ] V: Derivative data saved (139 records).
[2025-10-24T01:30:44.023749] [INFO ] [MAIN      ] V: Successfully saved derivative data.
[2025-10-24T01:30:44.027396] [INFO ] [MAIN      ] Derivative Progress: 2016/2164 symbols completed. V took 1.4s. Estimated remaining: 1m 2s. Rate: 143.5 symbols/min
[2025-10-24T01:30:44.027790] [INFO ] [MAIN      ] VATE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:44.052692] [DEBUG] [LOCAL     ] VATE: Loaded 5078 existing records from primary storage.
[2025-10-24T01:30:44.053735] [INFO ] [MAIN      ] VATE: Loaded 5078 primary data records.
[2025-10-24T01:30:44.125413] [DEBUG] [LOCAL     ] VALE: Loaded 54083 existing records from primary storage.
[2025-10-24T01:30:44.156212] [INFO ] [MAIN      ] VALE: Loaded 54083 primary data records.
[2025-10-24T01:30:44.291151] [DEBUG] [MAIN      ] VAL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:44.759378] [INFO ] [MAIN      ] VAL: Generated 139 derivative records from 50242 primary records.
[2025-10-24T01:30:44.760627] [DEBUG] [LOCAL     ] VAL: Saving derivative data.
[2025-10-24T01:30:44.773626] [DEBUG] [LOCAL     ] VAL: Derivative data saved (139 records).
[2025-10-24T01:30:44.774414] [INFO ] [MAIN      ] VAL: Successfully saved derivative data.
[2025-10-24T01:30:44.777606] [INFO ] [MAIN      ] Derivative Progress: 2017/2164 symbols completed. VAL took 1.2s. Estimated remaining: 1m 1s. Rate: 143.4 symbols/min
[2025-10-24T01:30:44.780513] [INFO ] [MAIN      ] VBF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:44.796804] [DEBUG] [MAIN      ] VALE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:44.825110] [DEBUG] [MAIN      ] VATE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:44.850270] [DEBUG] [LOCAL     ] VBF: Loaded 7227 existing records from primary storage.
[2025-10-24T01:30:44.853669] [INFO ] [MAIN      ] VBF: Loaded 7227 primary data records.
[2025-10-24T01:30:45.188327] [INFO ] [MAIN      ] VALE: Generated 139 derivative records from 54083 primary records.
[2025-10-24T01:30:45.189953] [DEBUG] [LOCAL     ] VALE: Saving derivative data.
[2025-10-24T01:30:45.208688] [DEBUG] [LOCAL     ] VALE: Derivative data saved (139 records).
[2025-10-24T01:30:45.210515] [INFO ] [MAIN      ] VALE: Successfully saved derivative data.
[2025-10-24T01:30:45.208977] [INFO ] [MAIN      ] VATE: Generated 139 derivative records from 5078 primary records.
[2025-10-24T01:30:45.215772] [DEBUG] [LOCAL     ] VATE: Saving derivative data.
[2025-10-24T01:30:45.215532] [INFO ] [MAIN      ] Derivative Progress: 2018/2164 symbols completed. VALE took 1.4s. Estimated remaining: 1m 1s. Rate: 143.4 symbols/min
[2025-10-24T01:30:45.217054] [INFO ] [MAIN      ] VCV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:45.228639] [DEBUG] [LOCAL     ] VATE: Derivative data saved (139 records).
[2025-10-24T01:30:45.228909] [INFO ] [MAIN      ] VATE: Successfully saved derivative data.
[2025-10-24T01:30:45.232474] [INFO ] [MAIN      ] Derivative Progress: 2019/2164 symbols completed. VATE took 1.2s. Estimated remaining: 1m 1s. Rate: 143.5 symbols/min
[2025-10-24T01:30:45.233186] [INFO ] [MAIN      ] VEEV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:45.265991] [DEBUG] [MAIN      ] VBF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:45.282119] [DEBUG] [LOCAL     ] VCV: Loaded 13232 existing records from primary storage.
[2025-10-24T01:30:45.284770] [INFO ] [MAIN      ] VCV: Loaded 13232 primary data records.
[2025-10-24T01:30:45.482917] [DEBUG] [LOCAL     ] VEEV: Loaded 47474 existing records from primary storage.
[2025-10-24T01:30:45.498009] [INFO ] [MAIN      ] VEEV: Loaded 47474 primary data records.
[2025-10-24T01:30:45.986472] [INFO ] [MAIN      ] VBF: Generated 139 derivative records from 7227 primary records.
[2025-10-24T01:30:45.996920] [DEBUG] [LOCAL     ] VBF: Saving derivative data.
[2025-10-24T01:30:46.013478] [DEBUG] [LOCAL     ] VBF: Derivative data saved (139 records).
[2025-10-24T01:30:46.014720] [INFO ] [MAIN      ] VBF: Successfully saved derivative data.
[2025-10-24T01:30:46.020084] [INFO ] [MAIN      ] Derivative Progress: 2020/2164 symbols completed. VBF took 1.2s. Estimated remaining: 1m 0s. Rate: 143.4 symbols/min
[2025-10-24T01:30:46.024738] [INFO ] [MAIN      ] VEL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:46.040073] [DEBUG] [MAIN      ] VCV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:46.087506] [DEBUG] [LOCAL     ] VEL: Loaded 11991 existing records from primary storage.
[2025-10-24T01:30:46.088753] [INFO ] [MAIN      ] VEL: Loaded 11991 primary data records.
[2025-10-24T01:30:46.151957] [DEBUG] [MAIN      ] VEEV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:46.314205] [INFO ] [MAIN      ] VCV: Generated 139 derivative records from 13232 primary records.
[2025-10-24T01:30:46.441338] [DEBUG] [LOCAL     ] VCV: Saving derivative data.
[2025-10-24T01:30:46.502442] [DEBUG] [LOCAL     ] VCV: Derivative data saved (139 records).
[2025-10-24T01:30:46.503363] [INFO ] [MAIN      ] VCV: Successfully saved derivative data.
[2025-10-24T01:30:46.506674] [INFO ] [MAIN      ] Derivative Progress: 2021/2164 symbols completed. VCV took 1.3s. Estimated remaining: 59.8s. Rate: 143.4 symbols/min
[2025-10-24T01:30:46.506870] [INFO ] [MAIN      ] VET: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:46.524727] [INFO ] [MAIN      ] VEEV: Generated 139 derivative records from 47474 primary records.
[2025-10-24T01:30:46.525157] [DEBUG] [LOCAL     ] VEEV: Saving derivative data.
[2025-10-24T01:30:46.538503] [DEBUG] [LOCAL     ] VEEV: Derivative data saved (139 records).
[2025-10-24T01:30:46.539102] [INFO ] [MAIN      ] VEEV: Successfully saved derivative data.
[2025-10-24T01:30:46.541928] [INFO ] [MAIN      ] Derivative Progress: 2022/2164 symbols completed. VEEV took 1.3s. Estimated remaining: 59.4s. Rate: 143.5 symbols/min
[2025-10-24T01:30:46.542233] [INFO ] [MAIN      ] VFC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:46.569082] [DEBUG] [MAIN      ] VEL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:46.598469] [DEBUG] [LOCAL     ] VET: Loaded 44405 existing records from primary storage.
[2025-10-24T01:30:46.598910] [INFO ] [MAIN      ] VET: Loaded 44405 primary data records.
[2025-10-24T01:30:46.828444] [DEBUG] [LOCAL     ] VFC: Loaded 53996 existing records from primary storage.
[2025-10-24T01:30:46.931152] [INFO ] [MAIN      ] VFC: Loaded 53996 primary data records.
[2025-10-24T01:30:47.052039] [INFO ] [MAIN      ] VEL: Generated 139 derivative records from 11991 primary records.
[2025-10-24T01:30:47.067187] [DEBUG] [LOCAL     ] VEL: Saving derivative data.
[2025-10-24T01:30:47.123867] [DEBUG] [LOCAL     ] VEL: Derivative data saved (139 records).
[2025-10-24T01:30:47.124045] [INFO ] [MAIN      ] VEL: Successfully saved derivative data.
[2025-10-24T01:30:47.135732] [INFO ] [MAIN      ] Derivative Progress: 2023/2164 symbols completed. VEL took 1.1s. Estimated remaining: 59.0s. Rate: 143.5 symbols/min
[2025-10-24T01:30:47.289708] [DEBUG] [MAIN      ] VET: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:47.326774] [INFO ] [MAIN      ] VET: Generated 139 derivative records from 44405 primary records.
[2025-10-24T01:30:47.339042] [DEBUG] [LOCAL     ] VET: Saving derivative data.
[2025-10-24T01:30:47.338972] [DEBUG] [MAIN      ] VFC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:47.364958] [DEBUG] [LOCAL     ] VET: Derivative data saved (139 records).
[2025-10-24T01:30:47.366375] [INFO ] [MAIN      ] VET: Successfully saved derivative data.
[2025-10-24T01:30:47.370901] [INFO ] [MAIN      ] Derivative Progress: 2024/2164 symbols completed. VET took 0.9s. Estimated remaining: 58.5s. Rate: 143.5 symbols/min
[2025-10-24T01:30:47.381332] [INFO ] [MAIN      ] VFC: Generated 139 derivative records from 53996 primary records.
[2025-10-24T01:30:47.381502] [DEBUG] [LOCAL     ] VFC: Saving derivative data.
[2025-10-24T01:30:47.393549] [DEBUG] [LOCAL     ] VFC: Derivative data saved (139 records).
[2025-10-24T01:30:47.393661] [INFO ] [MAIN      ] VFC: Successfully saved derivative data.
[2025-10-24T01:30:47.396551] [INFO ] [MAIN      ] Derivative Progress: 2025/2164 symbols completed. VFC took 0.9s. Estimated remaining: 58.1s. Rate: 143.6 symbols/min
[2025-10-24T01:30:47.397135] [INFO ] [MAIN      ] VGM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:47.397055] [INFO ] [MAIN      ] VGI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:47.397544] [INFO ] [MAIN      ] VHI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:47.405305] [DEBUG] [LOCAL     ] VHI: Loaded 2684 existing records from primary storage.
[2025-10-24T01:30:47.411579] [INFO ] [MAIN      ] VHI: Loaded 2684 primary data records.
[2025-10-24T01:30:47.446132] [DEBUG] [LOCAL     ] VGI: Loaded 5240 existing records from primary storage.
[2025-10-24T01:30:47.458345] [INFO ] [MAIN      ] VGI: Loaded 5240 primary data records.
[2025-10-24T01:30:47.603411] [DEBUG] [LOCAL     ] VGM: Loaded 18736 existing records from primary storage.
[2025-10-24T01:30:47.609531] [INFO ] [MAIN      ] VGM: Loaded 18736 primary data records.
[2025-10-24T01:30:48.400341] [DEBUG] [MAIN      ] VHI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:48.424221] [DEBUG] [MAIN      ] VGI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:48.471688] [DEBUG] [MAIN      ] VGM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:48.517049] [INFO ] [MAIN      ] VHI: Generated 139 derivative records from 2684 primary records.
[2025-10-24T01:30:48.518077] [DEBUG] [LOCAL     ] VHI: Saving derivative data.
[2025-10-24T01:30:48.520388] [INFO ] [MAIN      ] VGI: Generated 139 derivative records from 5240 primary records.
[2025-10-24T01:30:48.520683] [DEBUG] [LOCAL     ] VGI: Saving derivative data.
[2025-10-24T01:30:48.533439] [DEBUG] [LOCAL     ] VHI: Derivative data saved (139 records).
[2025-10-24T01:30:48.539458] [INFO ] [MAIN      ] VHI: Successfully saved derivative data.
[2025-10-24T01:30:48.543381] [DEBUG] [LOCAL     ] VGI: Derivative data saved (139 records).
[2025-10-24T01:30:48.543543] [INFO ] [MAIN      ] VGI: Successfully saved derivative data.
[2025-10-24T01:30:48.546734] [INFO ] [MAIN      ] Derivative Progress: 2026/2164 symbols completed. VHI took 1.1s. Estimated remaining: 57.7s. Rate: 143.4 symbols/min
[2025-10-24T01:30:48.546899] [INFO ] [MAIN      ] VICI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:48.550227] [INFO ] [MAIN      ] Derivative Progress: 2027/2164 symbols completed. VGI took 1.2s. Estimated remaining: 57.3s. Rate: 143.5 symbols/min
[2025-10-24T01:30:48.550849] [INFO ] [MAIN      ] VIK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:48.556349] [INFO ] [MAIN      ] VGM: Generated 139 derivative records from 18736 primary records.
[2025-10-24T01:30:48.556582] [DEBUG] [LOCAL     ] VGM: Saving derivative data.
[2025-10-24T01:30:48.569166] [DEBUG] [LOCAL     ] VGM: Derivative data saved (139 records).
[2025-10-24T01:30:48.569341] [INFO ] [MAIN      ] VGM: Successfully saved derivative data.
[2025-10-24T01:30:48.572059] [INFO ] [MAIN      ] Derivative Progress: 2028/2164 symbols completed. VGM took 1.2s. Estimated remaining: 56.8s. Rate: 143.6 symbols/min
[2025-10-24T01:30:48.572349] [INFO ] [MAIN      ] VIPS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:48.657936] [DEBUG] [LOCAL     ] VIK: Loaded 52713 existing records from primary storage.
[2025-10-24T01:30:48.656703] [DEBUG] [LOCAL     ] VICI: Loaded 54043 existing records from primary storage.
[2025-10-24T01:30:48.658135] [INFO ] [MAIN      ] VICI: Loaded 54043 primary data records.
[2025-10-24T01:30:48.658220] [INFO ] [MAIN      ] VIK: Loaded 52713 primary data records.
[2025-10-24T01:30:48.833074] [DEBUG] [LOCAL     ] VIPS: Loaded 51623 existing records from primary storage.
[2025-10-24T01:30:48.833337] [INFO ] [MAIN      ] VIPS: Loaded 51623 primary data records.
[2025-10-24T01:30:49.619678] [DEBUG] [MAIN      ] VIK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:49.618990] [DEBUG] [MAIN      ] VICI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:49.671575] [DEBUG] [MAIN      ] VIPS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:49.740898] [INFO ] [MAIN      ] VICI: Generated 139 derivative records from 54043 primary records.
[2025-10-24T01:30:49.743485] [DEBUG] [LOCAL     ] VICI: Saving derivative data.
[2025-10-24T01:30:49.745724] [INFO ] [MAIN      ] VIK: Generated 139 derivative records from 52713 primary records.
[2025-10-24T01:30:49.748969] [DEBUG] [LOCAL     ] VIK: Saving derivative data.
[2025-10-24T01:30:49.762441] [DEBUG] [LOCAL     ] VICI: Derivative data saved (139 records).
[2025-10-24T01:30:49.769854] [INFO ] [MAIN      ] VICI: Successfully saved derivative data.
[2025-10-24T01:30:49.774880] [DEBUG] [LOCAL     ] VIK: Derivative data saved (139 records).
[2025-10-24T01:30:49.777734] [INFO ] [MAIN      ] Derivative Progress: 2029/2164 symbols completed. VICI took 1.2s. Estimated remaining: 56.5s. Rate: 143.4 symbols/min
[2025-10-24T01:30:49.778164] [INFO ] [MAIN      ] VIRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:49.775371] [INFO ] [MAIN      ] VIK: Successfully saved derivative data.
[2025-10-24T01:30:49.781577] [INFO ] [MAIN      ] Derivative Progress: 2030/2164 symbols completed. VIK took 1.2s. Estimated remaining: 56.0s. Rate: 143.5 symbols/min
[2025-10-24T01:30:49.782787] [INFO ] [MAIN      ] VIST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:49.785032] [INFO ] [MAIN      ] VIPS: Generated 139 derivative records from 51623 primary records.
[2025-10-24T01:30:49.785542] [DEBUG] [LOCAL     ] VIPS: Saving derivative data.
[2025-10-24T01:30:49.798690] [DEBUG] [LOCAL     ] VIPS: Derivative data saved (139 records).
[2025-10-24T01:30:49.798776] [INFO ] [MAIN      ] VIPS: Successfully saved derivative data.
[2025-10-24T01:30:49.802256] [INFO ] [MAIN      ] Derivative Progress: 2031/2164 symbols completed. VIPS took 1.2s. Estimated remaining: 55.6s. Rate: 143.6 symbols/min
[2025-10-24T01:30:49.802788] [INFO ] [MAIN      ] VIV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:49.881513] [DEBUG] [LOCAL     ] VIST: Loaded 47029 existing records from primary storage.
[2025-10-24T01:30:49.882220] [INFO ] [MAIN      ] VIST: Loaded 47029 primary data records.
[2025-10-24T01:30:49.916821] [DEBUG] [LOCAL     ] VIRT: Loaded 46759 existing records from primary storage.
[2025-10-24T01:30:49.952210] [INFO ] [MAIN      ] VIRT: Loaded 46759 primary data records.
[2025-10-24T01:30:50.055800] [DEBUG] [LOCAL     ] VIV: Loaded 44842 existing records from primary storage.
[2025-10-24T01:30:50.102681] [INFO ] [MAIN      ] VIV: Loaded 44842 primary data records.
[2025-10-24T01:30:50.905557] [DEBUG] [MAIN      ] VIST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:50.918971] [DEBUG] [MAIN      ] VIRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:50.975783] [DEBUG] [MAIN      ] VIV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:51.019508] [INFO ] [MAIN      ] VIST: Generated 139 derivative records from 47029 primary records.
[2025-10-24T01:30:51.024503] [DEBUG] [LOCAL     ] VIST: Saving derivative data.
[2025-10-24T01:30:51.043877] [DEBUG] [LOCAL     ] VIST: Derivative data saved (139 records).
[2025-10-24T01:30:51.044983] [INFO ] [MAIN      ] VIST: Successfully saved derivative data.
[2025-10-24T01:30:51.047620] [INFO ] [MAIN      ] Derivative Progress: 2032/2164 symbols completed. VIST took 1.3s. Estimated remaining: 55.2s. Rate: 143.4 symbols/min
[2025-10-24T01:30:51.048076] [INFO ] [MAIN      ] VKQ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:51.054348] [INFO ] [MAIN      ] VIRT: Generated 139 derivative records from 46759 primary records.
[2025-10-24T01:30:51.056518] [DEBUG] [LOCAL     ] VIRT: Saving derivative data.
[2025-10-24T01:30:51.073821] [DEBUG] [LOCAL     ] VIRT: Derivative data saved (139 records).
[2025-10-24T01:30:51.075924] [INFO ] [MAIN      ] VIRT: Successfully saved derivative data.
[2025-10-24T01:30:51.079120] [INFO ] [MAIN      ] Derivative Progress: 2033/2164 symbols completed. VIRT took 1.3s. Estimated remaining: 54.8s. Rate: 143.5 symbols/min
[2025-10-24T01:30:51.076187] [INFO ] [MAIN      ] VIV: Generated 139 derivative records from 44842 primary records.
[2025-10-24T01:30:51.079567] [INFO ] [MAIN      ] VLN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:51.080128] [DEBUG] [LOCAL     ] VIV: Saving derivative data.
[2025-10-24T01:30:51.098960] [DEBUG] [LOCAL     ] VIV: Derivative data saved (139 records).
[2025-10-24T01:30:51.099299] [INFO ] [MAIN      ] VIV: Successfully saved derivative data.
[2025-10-24T01:30:51.101797] [INFO ] [MAIN      ] Derivative Progress: 2034/2164 symbols completed. VIV took 1.3s. Estimated remaining: 54.3s. Rate: 143.6 symbols/min
[2025-10-24T01:30:51.102498] [INFO ] [MAIN      ] VLO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:51.110043] [DEBUG] [LOCAL     ] VKQ: Loaded 17940 existing records from primary storage.
[2025-10-24T01:30:51.110165] [INFO ] [MAIN      ] VKQ: Loaded 17940 primary data records.
[2025-10-24T01:30:51.233754] [DEBUG] [LOCAL     ] VLN: Loaded 31255 existing records from primary storage.
[2025-10-24T01:30:51.250886] [INFO ] [MAIN      ] VLN: Loaded 31255 primary data records.
[2025-10-24T01:30:51.656108] [DEBUG] [LOCAL     ] VLO: Loaded 53345 existing records from primary storage.
[2025-10-24T01:30:51.657458] [INFO ] [MAIN      ] VLO: Loaded 53345 primary data records.
[2025-10-24T01:30:52.097260] [DEBUG] [MAIN      ] VKQ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:52.149679] [DEBUG] [MAIN      ] VLN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:52.176083] [INFO ] [MAIN      ] VKQ: Generated 139 derivative records from 17940 primary records.
[2025-10-24T01:30:52.178626] [DEBUG] [LOCAL     ] VKQ: Saving derivative data.
[2025-10-24T01:30:52.208361] [DEBUG] [LOCAL     ] VKQ: Derivative data saved (139 records).
[2025-10-24T01:30:52.209052] [DEBUG] [MAIN      ] VLO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:52.209288] [INFO ] [MAIN      ] VKQ: Successfully saved derivative data.
[2025-10-24T01:30:52.224933] [INFO ] [MAIN      ] Derivative Progress: 2035/2164 symbols completed. VKQ took 1.2s. Estimated remaining: 54.0s. Rate: 143.4 symbols/min
[2025-10-24T01:30:52.229403] [INFO ] [MAIN      ] VLRS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:52.270551] [INFO ] [MAIN      ] VLN: Generated 139 derivative records from 31255 primary records.
[2025-10-24T01:30:52.272562] [DEBUG] [LOCAL     ] VLN: Saving derivative data.
[2025-10-24T01:30:52.273052] [INFO ] [MAIN      ] VLO: Generated 139 derivative records from 53345 primary records.
[2025-10-24T01:30:52.273364] [DEBUG] [LOCAL     ] VLO: Saving derivative data.
[2025-10-24T01:30:52.295412] [DEBUG] [LOCAL     ] VLN: Derivative data saved (139 records).
[2025-10-24T01:30:52.308462] [DEBUG] [LOCAL     ] VLO: Derivative data saved (139 records).
[2025-10-24T01:30:52.309663] [INFO ] [MAIN      ] VLO: Successfully saved derivative data.
[2025-10-24T01:30:52.313098] [INFO ] [MAIN      ] Derivative Progress: 2036/2164 symbols completed. VLO took 1.2s. Estimated remaining: 53.5s. Rate: 143.5 symbols/min
[2025-10-24T01:30:52.307975] [INFO ] [MAIN      ] VLN: Successfully saved derivative data.
[2025-10-24T01:30:52.313279] [INFO ] [MAIN      ] VLT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:52.316917] [INFO ] [MAIN      ] Derivative Progress: 2037/2164 symbols completed. VLN took 1.2s. Estimated remaining: 53.1s. Rate: 143.6 symbols/min
[2025-10-24T01:30:52.317613] [INFO ] [MAIN      ] VLTO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:52.319239] [DEBUG] [LOCAL     ] VLRS: Loaded 39561 existing records from primary storage.
[2025-10-24T01:30:52.319724] [INFO ] [MAIN      ] VLRS: Loaded 39561 primary data records.
[2025-10-24T01:30:52.387981] [DEBUG] [LOCAL     ] VLT: Loaded 4306 existing records from primary storage.
[2025-10-24T01:30:52.394186] [INFO ] [MAIN      ] VLT: Loaded 4306 primary data records.
[2025-10-24T01:30:52.988462] [DEBUG] [LOCAL     ] VLTO: Loaded 46360 existing records from primary storage.
[2025-10-24T01:30:52.988946] [INFO ] [MAIN      ] VLTO: Loaded 46360 primary data records.
[2025-10-24T01:30:53.325292] [DEBUG] [MAIN      ] VLRS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:53.357828] [DEBUG] [MAIN      ] VLT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:53.407245] [DEBUG] [MAIN      ] VLTO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:53.448888] [INFO ] [MAIN      ] VLRS: Generated 139 derivative records from 39561 primary records.
[2025-10-24T01:30:53.451825] [DEBUG] [LOCAL     ] VLRS: Saving derivative data.
[2025-10-24T01:30:53.457701] [INFO ] [MAIN      ] VLT: Generated 139 derivative records from 4306 primary records.
[2025-10-24T01:30:53.468377] [DEBUG] [LOCAL     ] VLT: Saving derivative data.
[2025-10-24T01:30:53.471697] [DEBUG] [LOCAL     ] VLRS: Derivative data saved (139 records).
[2025-10-24T01:30:53.474491] [INFO ] [MAIN      ] VLRS: Successfully saved derivative data.
[2025-10-24T01:30:53.476908] [INFO ] [MAIN      ] Derivative Progress: 2038/2164 symbols completed. VLRS took 1.2s. Estimated remaining: 52.7s. Rate: 143.4 symbols/min
[2025-10-24T01:30:53.488712] [DEBUG] [LOCAL     ] VLT: Derivative data saved (139 records).
[2025-10-24T01:30:53.488965] [INFO ] [MAIN      ] VLT: Successfully saved derivative data.
[2025-10-24T01:30:53.491341] [INFO ] [MAIN      ] Derivative Progress: 2039/2164 symbols completed. VLT took 1.2s. Estimated remaining: 52.3s. Rate: 143.5 symbols/min
[2025-10-24T01:30:53.497292] [INFO ] [MAIN      ] VLTO: Generated 139 derivative records from 46360 primary records.
[2025-10-24T01:30:53.497454] [DEBUG] [LOCAL     ] VLTO: Saving derivative data.
[2025-10-24T01:30:53.509781] [DEBUG] [LOCAL     ] VLTO: Derivative data saved (139 records).
[2025-10-24T01:30:53.509910] [INFO ] [MAIN      ] VLTO: Successfully saved derivative data.
[2025-10-24T01:30:53.512920] [INFO ] [MAIN      ] Derivative Progress: 2040/2164 symbols completed. VLTO took 1.2s. Estimated remaining: 51.8s. Rate: 143.6 symbols/min
[2025-10-24T01:30:53.513480] [INFO ] [MAIN      ] VNO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:53.513409] [INFO ] [MAIN      ] VMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:53.513550] [INFO ] [MAIN      ] VMO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:53.537488] [DEBUG] [LOCAL     ] VMO: Loaded 20786 existing records from primary storage.
[2025-10-24T01:30:53.537663] [INFO ] [MAIN      ] VMO: Loaded 20786 primary data records.
[2025-10-24T01:30:53.879162] [DEBUG] [LOCAL     ] VNO: Loaded 49140 existing records from primary storage.
[2025-10-24T01:30:53.886964] [INFO ] [MAIN      ] VNO: Loaded 49140 primary data records.
[2025-10-24T01:30:53.762324] [DEBUG] [LOCAL     ] VMC: Loaded 42397 existing records from primary storage.
[2025-10-24T01:30:53.888018] [INFO ] [MAIN      ] VMC: Loaded 42397 primary data records.
[2025-10-24T01:30:54.531422] [DEBUG] [MAIN      ] VMO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:54.589573] [DEBUG] [MAIN      ] VNO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:54.622164] [DEBUG] [MAIN      ] VMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:54.647313] [INFO ] [MAIN      ] VMO: Generated 139 derivative records from 20786 primary records.
[2025-10-24T01:30:54.647776] [DEBUG] [LOCAL     ] VMO: Saving derivative data.
[2025-10-24T01:30:54.669676] [DEBUG] [LOCAL     ] VMO: Derivative data saved (139 records).
[2025-10-24T01:30:54.669932] [INFO ] [MAIN      ] VMO: Successfully saved derivative data.
[2025-10-24T01:30:54.672064] [INFO ] [MAIN      ] Derivative Progress: 2041/2164 symbols completed. VMO took 1.2s. Estimated remaining: 51.4s. Rate: 143.5 symbols/min
[2025-10-24T01:30:54.675792] [INFO ] [MAIN      ] VNT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:54.696634] [INFO ] [MAIN      ] VNO: Generated 139 derivative records from 49140 primary records.
[2025-10-24T01:30:54.698186] [DEBUG] [LOCAL     ] VNO: Saving derivative data.
[2025-10-24T01:30:54.701149] [INFO ] [MAIN      ] VMC: Generated 139 derivative records from 42397 primary records.
[2025-10-24T01:30:54.702004] [DEBUG] [LOCAL     ] VMC: Saving derivative data.
[2025-10-24T01:30:54.728454] [DEBUG] [LOCAL     ] VMC: Derivative data saved (139 records).
[2025-10-24T01:30:54.728755] [INFO ] [MAIN      ] VMC: Successfully saved derivative data.
[2025-10-24T01:30:54.727765] [DEBUG] [LOCAL     ] VNO: Derivative data saved (139 records).
[2025-10-24T01:30:54.731491] [INFO ] [MAIN      ] Derivative Progress: 2042/2164 symbols completed. VMC took 1.2s. Estimated remaining: 51.0s. Rate: 143.5 symbols/min
[2025-10-24T01:30:54.742362] [INFO ] [MAIN      ] VOC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:54.742235] [INFO ] [MAIN      ] VNO: Successfully saved derivative data.
[2025-10-24T01:30:54.745272] [INFO ] [MAIN      ] Derivative Progress: 2043/2164 symbols completed. VNO took 1.2s. Estimated remaining: 50.6s. Rate: 143.6 symbols/min
[2025-10-24T01:30:54.745752] [INFO ] [MAIN      ] VOYA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:54.770535] [DEBUG] [LOCAL     ] VOC: Loaded 9134 existing records from primary storage.
[2025-10-24T01:30:54.771426] [DEBUG] [LOCAL     ] VNT: Loaded 44209 existing records from primary storage.
[2025-10-24T01:30:54.771727] [INFO ] [MAIN      ] VOC: Loaded 9134 primary data records.
[2025-10-24T01:30:54.783248] [INFO ] [MAIN      ] VNT: Loaded 44209 primary data records.
[2025-10-24T01:30:55.131437] [DEBUG] [LOCAL     ] VOYA: Loaded 42078 existing records from primary storage.
[2025-10-24T01:30:55.448980] [INFO ] [MAIN      ] VOYA: Loaded 42078 primary data records.
[2025-10-24T01:30:55.796730] [DEBUG] [MAIN      ] VNT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:55.795474] [DEBUG] [MAIN      ] VOC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:55.864998] [DEBUG] [MAIN      ] VOYA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:55.905008] [INFO ] [MAIN      ] VNT: Generated 139 derivative records from 44209 primary records.
[2025-10-24T01:30:55.909407] [DEBUG] [LOCAL     ] VNT: Saving derivative data.
[2025-10-24T01:30:55.915545] [INFO ] [MAIN      ] VOC: Generated 139 derivative records from 9134 primary records.
[2025-10-24T01:30:55.916162] [DEBUG] [LOCAL     ] VOC: Saving derivative data.
[2025-10-24T01:30:55.930309] [DEBUG] [LOCAL     ] VNT: Derivative data saved (139 records).
[2025-10-24T01:30:55.930465] [INFO ] [MAIN      ] VNT: Successfully saved derivative data.
[2025-10-24T01:30:55.942293] [INFO ] [MAIN      ] Derivative Progress: 2044/2164 symbols completed. VNT took 1.3s. Estimated remaining: 50.2s. Rate: 143.5 symbols/min
[2025-10-24T01:30:55.946920] [INFO ] [MAIN      ] VPG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:55.948165] [DEBUG] [LOCAL     ] VOC: Derivative data saved (139 records).
[2025-10-24T01:30:55.948589] [INFO ] [MAIN      ] VOC: Successfully saved derivative data.
[2025-10-24T01:30:55.952573] [INFO ] [MAIN      ] Derivative Progress: 2045/2164 symbols completed. VOC took 1.2s. Estimated remaining: 49.7s. Rate: 143.5 symbols/min
[2025-10-24T01:30:55.955047] [INFO ] [MAIN      ] VPV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:55.959819] [INFO ] [MAIN      ] VOYA: Generated 139 derivative records from 42078 primary records.
[2025-10-24T01:30:55.960188] [DEBUG] [LOCAL     ] VOYA: Saving derivative data.
[2025-10-24T01:30:55.978828] [DEBUG] [LOCAL     ] VOYA: Derivative data saved (139 records).
[2025-10-24T01:30:55.978999] [INFO ] [MAIN      ] VOYA: Successfully saved derivative data.
[2025-10-24T01:30:55.981533] [INFO ] [MAIN      ] Derivative Progress: 2046/2164 symbols completed. VOYA took 1.2s. Estimated remaining: 49.3s. Rate: 143.6 symbols/min
[2025-10-24T01:30:55.985684] [INFO ] [MAIN      ] VRE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:55.985446] [DEBUG] [LOCAL     ] VPV: Loaded 5234 existing records from primary storage.
[2025-10-24T01:30:55.993168] [INFO ] [MAIN      ] VPV: Loaded 5234 primary data records.
[2025-10-24T01:30:56.025485] [DEBUG] [LOCAL     ] VPG: Loaded 16985 existing records from primary storage.
[2025-10-24T01:30:56.037708] [INFO ] [MAIN      ] VPG: Loaded 16985 primary data records.
[2025-10-24T01:30:56.502864] [DEBUG] [LOCAL     ] VRE: Loaded 35499 existing records from primary storage.
[2025-10-24T01:30:56.509067] [INFO ] [MAIN      ] VRE: Loaded 35499 primary data records.
[2025-10-24T01:30:57.006901] [DEBUG] [MAIN      ] VPV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:57.019784] [DEBUG] [MAIN      ] VPG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:57.094147] [DEBUG] [MAIN      ] VRE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:57.129451] [INFO ] [MAIN      ] VPV: Generated 139 derivative records from 5234 primary records.
[2025-10-24T01:30:57.129832] [INFO ] [MAIN      ] VPG: Generated 139 derivative records from 16985 primary records.
[2025-10-24T01:30:57.131254] [DEBUG] [LOCAL     ] VPV: Saving derivative data.
[2025-10-24T01:30:57.131769] [DEBUG] [LOCAL     ] VPG: Saving derivative data.
[2025-10-24T01:30:57.154468] [DEBUG] [LOCAL     ] VPG: Derivative data saved (139 records).
[2025-10-24T01:30:57.157433] [INFO ] [MAIN      ] VPG: Successfully saved derivative data.
[2025-10-24T01:30:57.159825] [DEBUG] [LOCAL     ] VPV: Derivative data saved (139 records).
[2025-10-24T01:30:57.162303] [INFO ] [MAIN      ] Derivative Progress: 2047/2164 symbols completed. VPG took 1.2s. Estimated remaining: 48.9s. Rate: 143.5 symbols/min
[2025-10-24T01:30:57.162507] [INFO ] [MAIN      ] VRT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:57.162595] [INFO ] [MAIN      ] VPV: Successfully saved derivative data.
[2025-10-24T01:30:57.165685] [INFO ] [MAIN      ] Derivative Progress: 2048/2164 symbols completed. VPV took 1.2s. Estimated remaining: 48.5s. Rate: 143.5 symbols/min
[2025-10-24T01:30:57.166174] [INFO ] [MAIN      ] VRTS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:57.177088] [INFO ] [MAIN      ] VRE: Generated 139 derivative records from 35499 primary records.
[2025-10-24T01:30:57.177447] [DEBUG] [LOCAL     ] VRE: Saving derivative data.
[2025-10-24T01:30:57.192487] [DEBUG] [LOCAL     ] VRE: Derivative data saved (139 records).
[2025-10-24T01:30:57.192724] [INFO ] [MAIN      ] VRE: Successfully saved derivative data.
[2025-10-24T01:30:57.195897] [INFO ] [MAIN      ] Derivative Progress: 2049/2164 symbols completed. VRE took 1.2s. Estimated remaining: 48.1s. Rate: 143.6 symbols/min
[2025-10-24T01:30:57.196264] [INFO ] [MAIN      ] VSCO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:57.201588] [DEBUG] [LOCAL     ] VRTS: Loaded 9434 existing records from primary storage.
[2025-10-24T01:30:57.201746] [INFO ] [MAIN      ] VRTS: Loaded 9434 primary data records.
[2025-10-24T01:30:57.536190] [DEBUG] [LOCAL     ] VRT: Loaded 54143 existing records from primary storage.
[2025-10-24T01:30:57.537660] [INFO ] [MAIN      ] VRT: Loaded 54143 primary data records.
[2025-10-24T01:30:57.609724] [DEBUG] [LOCAL     ] VSCO: Loaded 53067 existing records from primary storage.
[2025-10-24T01:30:57.636898] [INFO ] [MAIN      ] VSCO: Loaded 53067 primary data records.
[2025-10-24T01:30:58.201957] [DEBUG] [MAIN      ] VRTS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:30:58.265159] [DEBUG] [MAIN      ] VRT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:58.295322] [DEBUG] [MAIN      ] VSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:58.317759] [INFO ] [MAIN      ] VRTS: Generated 139 derivative records from 9434 primary records.
[2025-10-24T01:30:58.322783] [DEBUG] [LOCAL     ] VRTS: Saving derivative data.
[2025-10-24T01:30:58.345735] [DEBUG] [LOCAL     ] VRTS: Derivative data saved (139 records).
[2025-10-24T01:30:58.347183] [INFO ] [MAIN      ] VRTS: Successfully saved derivative data.
[2025-10-24T01:30:58.350444] [INFO ] [MAIN      ] Derivative Progress: 2050/2164 symbols completed. VRTS took 1.2s. Estimated remaining: 47.7s. Rate: 143.5 symbols/min
[2025-10-24T01:30:58.353727] [INFO ] [MAIN      ] VSH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:58.380031] [INFO ] [MAIN      ] VRT: Generated 139 derivative records from 54143 primary records.
[2025-10-24T01:30:58.380639] [DEBUG] [LOCAL     ] VRT: Saving derivative data.
[2025-10-24T01:30:58.411662] [INFO ] [MAIN      ] VSCO: Generated 139 derivative records from 53067 primary records.
[2025-10-24T01:30:58.414259] [DEBUG] [LOCAL     ] VRT: Derivative data saved (139 records).
[2025-10-24T01:30:58.414608] [DEBUG] [LOCAL     ] VSCO: Saving derivative data.
[2025-10-24T01:30:58.414850] [INFO ] [MAIN      ] VRT: Successfully saved derivative data.
[2025-10-24T01:30:58.418852] [INFO ] [MAIN      ] Derivative Progress: 2051/2164 symbols completed. VRT took 1.3s. Estimated remaining: 47.2s. Rate: 143.5 symbols/min
[2025-10-24T01:30:58.419151] [INFO ] [MAIN      ] VST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:58.451931] [DEBUG] [LOCAL     ] VSH: Loaded 48614 existing records from primary storage.
[2025-10-24T01:30:58.452117] [INFO ] [MAIN      ] VSH: Loaded 48614 primary data records.
[2025-10-24T01:30:58.450820] [DEBUG] [LOCAL     ] VSCO: Derivative data saved (139 records).
[2025-10-24T01:30:58.473321] [INFO ] [MAIN      ] VSCO: Successfully saved derivative data.
[2025-10-24T01:30:58.512323] [INFO ] [MAIN      ] Derivative Progress: 2052/2164 symbols completed. VSCO took 1.3s. Estimated remaining: 46.8s. Rate: 143.6 symbols/min
[2025-10-24T01:30:58.538626] [INFO ] [MAIN      ] VSTS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:58.802171] [DEBUG] [LOCAL     ] VST: Loaded 54099 existing records from primary storage.
[2025-10-24T01:30:58.804163] [INFO ] [MAIN      ] VST: Loaded 54099 primary data records.
[2025-10-24T01:30:58.886767] [DEBUG] [LOCAL     ] VSTS: Loaded 49200 existing records from primary storage.
[2025-10-24T01:30:58.910256] [INFO ] [MAIN      ] VSTS: Loaded 49200 primary data records.
[2025-10-24T01:30:59.340037] [DEBUG] [MAIN      ] VSH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:59.512803] [INFO ] [MAIN      ] VSH: Generated 139 derivative records from 48614 primary records.
[2025-10-24T01:30:59.532084] [DEBUG] [MAIN      ] VST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:59.531231] [DEBUG] [LOCAL     ] VSH: Saving derivative data.
[2025-10-24T01:30:59.561759] [DEBUG] [MAIN      ] VSTS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:30:59.588773] [DEBUG] [LOCAL     ] VSH: Derivative data saved (139 records).
[2025-10-24T01:30:59.590455] [INFO ] [MAIN      ] VSH: Successfully saved derivative data.
[2025-10-24T01:30:59.594132] [INFO ] [MAIN      ] Derivative Progress: 2053/2164 symbols completed. VSH took 1.2s. Estimated remaining: 46.4s. Rate: 143.5 symbols/min
[2025-10-24T01:30:59.635171] [INFO ] [MAIN      ] VSTS: Generated 139 derivative records from 49200 primary records.
[2025-10-24T01:30:59.636886] [INFO ] [MAIN      ] VST: Generated 139 derivative records from 54099 primary records.
[2025-10-24T01:30:59.636615] [DEBUG] [LOCAL     ] VSTS: Saving derivative data.
[2025-10-24T01:30:59.637293] [DEBUG] [LOCAL     ] VST: Saving derivative data.
[2025-10-24T01:30:59.659432] [DEBUG] [LOCAL     ] VSTS: Derivative data saved (139 records).
[2025-10-24T01:30:59.660755] [DEBUG] [LOCAL     ] VST: Derivative data saved (139 records).
[2025-10-24T01:30:59.660881] [INFO ] [MAIN      ] VST: Successfully saved derivative data.
[2025-10-24T01:30:59.660964] [INFO ] [MAIN      ] VSTS: Successfully saved derivative data.
[2025-10-24T01:30:59.663374] [INFO ] [MAIN      ] Derivative Progress: 2054/2164 symbols completed. VST took 1.2s. Estimated remaining: 46.0s. Rate: 143.5 symbols/min
[2025-10-24T01:30:59.666220] [INFO ] [MAIN      ] Derivative Progress: 2055/2164 symbols completed. VSTS took 1.1s. Estimated remaining: 45.5s. Rate: 143.6 symbols/min
[2025-10-24T01:30:59.666638] [INFO ] [MAIN      ] VTEX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:59.666857] [INFO ] [MAIN      ] VTLE: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:59.666746] [INFO ] [MAIN      ] VTMX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:30:59.692853] [DEBUG] [LOCAL     ] VTMX: Loaded 17668 existing records from primary storage.
[2025-10-24T01:30:59.693033] [INFO ] [MAIN      ] VTMX: Loaded 17668 primary data records.
[2025-10-24T01:30:59.872638] [DEBUG] [LOCAL     ] VTEX: Loaded 43140 existing records from primary storage.
[2025-10-24T01:30:59.890709] [INFO ] [MAIN      ] VTEX: Loaded 43140 primary data records.
[2025-10-24T01:31:00.149958] [DEBUG] [LOCAL     ] VTLE: Loaded 47877 existing records from primary storage.
[2025-10-24T01:31:00.151669] [INFO ] [MAIN      ] VTLE: Loaded 47877 primary data records.
[2025-10-24T01:31:00.670881] [DEBUG] [MAIN      ] VTMX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:00.704459] [DEBUG] [MAIN      ] VTEX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:00.747497] [DEBUG] [MAIN      ] VTLE: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:00.799126] [INFO ] [MAIN      ] VTEX: Generated 139 derivative records from 43140 primary records.
[2025-10-24T01:31:00.803097] [DEBUG] [LOCAL     ] VTEX: Saving derivative data.
[2025-10-24T01:31:00.819912] [DEBUG] [LOCAL     ] VTEX: Derivative data saved (139 records).
[2025-10-24T01:31:00.821069] [INFO ] [MAIN      ] VTMX: Generated 139 derivative records from 17668 primary records.
[2025-10-24T01:31:00.821202] [INFO ] [MAIN      ] VTEX: Successfully saved derivative data.
[2025-10-24T01:31:00.823937] [INFO ] [MAIN      ] Derivative Progress: 2056/2164 symbols completed. VTEX took 1.2s. Estimated remaining: 45.2s. Rate: 143.5 symbols/min
[2025-10-24T01:31:00.824466] [INFO ] [MAIN      ] VTN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:00.825217] [DEBUG] [LOCAL     ] VTMX: Saving derivative data.
[2025-10-24T01:31:00.838895] [INFO ] [MAIN      ] VTLE: Generated 139 derivative records from 47877 primary records.
[2025-10-24T01:31:00.839811] [DEBUG] [LOCAL     ] VTLE: Saving derivative data.
[2025-10-24T01:31:00.843995] [DEBUG] [LOCAL     ] VTMX: Derivative data saved (139 records).
[2025-10-24T01:31:00.844098] [INFO ] [MAIN      ] VTMX: Successfully saved derivative data.
[2025-10-24T01:31:00.846790] [INFO ] [MAIN      ] Derivative Progress: 2057/2164 symbols completed. VTMX took 1.2s. Estimated remaining: 44.7s. Rate: 143.5 symbols/min
[2025-10-24T01:31:00.847012] [INFO ] [MAIN      ] VTOL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:00.861875] [DEBUG] [LOCAL     ] VTN: Loaded 7335 existing records from primary storage.
[2025-10-24T01:31:00.862907] [INFO ] [MAIN      ] VTN: Loaded 7335 primary data records.
[2025-10-24T01:31:00.948529] [DEBUG] [LOCAL     ] VTLE: Derivative data saved (139 records).
[2025-10-24T01:31:00.972542] [INFO ] [MAIN      ] VTLE: Successfully saved derivative data.
[2025-10-24T01:31:00.979068] [INFO ] [MAIN      ] Derivative Progress: 2058/2164 symbols completed. VTLE took 1.3s. Estimated remaining: 44.3s. Rate: 143.6 symbols/min
[2025-10-24T01:31:00.979819] [INFO ] [MAIN      ] VTR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:01.035696] [DEBUG] [LOCAL     ] VTOL: Loaded 19509 existing records from primary storage.
[2025-10-24T01:31:01.065858] [INFO ] [MAIN      ] VTOL: Loaded 19509 primary data records.
[2025-10-24T01:31:01.582394] [DEBUG] [LOCAL     ] VTR: Loaded 53049 existing records from primary storage.
[2025-10-24T01:31:01.583164] [DEBUG] [MAIN      ] VTN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:01.598682] [INFO ] [MAIN      ] VTR: Loaded 53049 primary data records.
[2025-10-24T01:31:01.804216] [DEBUG] [MAIN      ] VTOL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:01.989089] [INFO ] [MAIN      ] VTN: Generated 139 derivative records from 7335 primary records.
[2025-10-24T01:31:01.991400] [DEBUG] [LOCAL     ] VTN: Saving derivative data.
[2025-10-24T01:31:02.009687] [DEBUG] [LOCAL     ] VTN: Derivative data saved (139 records).
[2025-10-24T01:31:02.010511] [INFO ] [MAIN      ] VTN: Successfully saved derivative data.
[2025-10-24T01:31:02.015169] [INFO ] [MAIN      ] Derivative Progress: 2059/2164 symbols completed. VTN took 1.2s. Estimated remaining: 43.9s. Rate: 143.5 symbols/min
[2025-10-24T01:31:02.015631] [INFO ] [MAIN      ] VTS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:02.025925] [INFO ] [MAIN      ] VTOL: Generated 139 derivative records from 19509 primary records.
[2025-10-24T01:31:02.039734] [DEBUG] [MAIN      ] VTR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:02.039865] [DEBUG] [LOCAL     ] VTOL: Saving derivative data.
[2025-10-24T01:31:02.077338] [DEBUG] [LOCAL     ] VTOL: Derivative data saved (139 records).
[2025-10-24T01:31:02.077855] [INFO ] [MAIN      ] VTOL: Successfully saved derivative data.
[2025-10-24T01:31:02.082621] [INFO ] [MAIN      ] Derivative Progress: 2060/2164 symbols completed. VTOL took 1.2s. Estimated remaining: 43.5s. Rate: 143.5 symbols/min
[2025-10-24T01:31:02.083724] [INFO ] [MAIN      ] VVR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:02.104767] [DEBUG] [LOCAL     ] VTS: Loaded 30045 existing records from primary storage.
[2025-10-24T01:31:02.105422] [INFO ] [MAIN      ] VTS: Loaded 30045 primary data records.
[2025-10-24T01:31:02.189614] [INFO ] [MAIN      ] VTR: Generated 139 derivative records from 53049 primary records.
[2025-10-24T01:31:02.234758] [DEBUG] [LOCAL     ] VVR: Loaded 31357 existing records from primary storage.
[2025-10-24T01:31:02.223020] [DEBUG] [LOCAL     ] VTR: Saving derivative data.
[2025-10-24T01:31:02.235055] [INFO ] [MAIN      ] VVR: Loaded 31357 primary data records.
[2025-10-24T01:31:02.378899] [DEBUG] [LOCAL     ] VTR: Derivative data saved (139 records).
[2025-10-24T01:31:02.412733] [INFO ] [MAIN      ] VTR: Successfully saved derivative data.
[2025-10-24T01:31:02.554777] [INFO ] [MAIN      ] Derivative Progress: 2061/2164 symbols completed. VTR took 1.6s. Estimated remaining: 43.1s. Rate: 143.5 symbols/min
[2025-10-24T01:31:02.579635] [INFO ] [MAIN      ] VVV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:02.774106] [DEBUG] [MAIN      ] VTS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:02.833805] [DEBUG] [LOCAL     ] VVV: Loaded 50497 existing records from primary storage.
[2025-10-24T01:31:02.834132] [INFO ] [MAIN      ] VVV: Loaded 50497 primary data records.
[2025-10-24T01:31:02.878091] [DEBUG] [MAIN      ] VVR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:02.980792] [INFO ] [MAIN      ] VTS: Generated 139 derivative records from 30045 primary records.
[2025-10-24T01:31:02.986171] [DEBUG] [LOCAL     ] VTS: Saving derivative data.
[2025-10-24T01:31:03.215712] [DEBUG] [LOCAL     ] VTS: Derivative data saved (139 records).
[2025-10-24T01:31:03.229044] [INFO ] [MAIN      ] VTS: Successfully saved derivative data.
[2025-10-24T01:31:03.232170] [INFO ] [MAIN      ] Derivative Progress: 2062/2164 symbols completed. VTS took 1.2s. Estimated remaining: 42.6s. Rate: 143.5 symbols/min
[2025-10-24T01:31:03.234426] [INFO ] [MAIN      ] VVX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:03.249765] [INFO ] [MAIN      ] VVR: Generated 139 derivative records from 31357 primary records.
[2025-10-24T01:31:03.250010] [DEBUG] [LOCAL     ] VVR: Saving derivative data.
[2025-10-24T01:31:03.268121] [DEBUG] [LOCAL     ] VVR: Derivative data saved (139 records).
[2025-10-24T01:31:03.277198] [DEBUG] [LOCAL     ] VVX: Loaded 23194 existing records from primary storage.
[2025-10-24T01:31:03.278917] [INFO ] [MAIN      ] VVX: Loaded 23194 primary data records.
[2025-10-24T01:31:03.278079] [INFO ] [MAIN      ] VVR: Successfully saved derivative data.
[2025-10-24T01:31:03.302838] [INFO ] [MAIN      ] Derivative Progress: 2063/2164 symbols completed. VVR took 1.2s. Estimated remaining: 42.2s. Rate: 143.6 symbols/min
[2025-10-24T01:31:03.338013] [INFO ] [MAIN      ] VYX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:03.371278] [DEBUG] [MAIN      ] VVV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:03.642095] [INFO ] [MAIN      ] VVV: Generated 139 derivative records from 50497 primary records.
[2025-10-24T01:31:03.643076] [DEBUG] [LOCAL     ] VVV: Saving derivative data.
[2025-10-24T01:31:03.656494] [DEBUG] [LOCAL     ] VVV: Derivative data saved (139 records).
[2025-10-24T01:31:03.659167] [INFO ] [MAIN      ] VVV: Successfully saved derivative data.
[2025-10-24T01:31:03.662553] [INFO ] [MAIN      ] Derivative Progress: 2064/2164 symbols completed. VVV took 1.1s. Estimated remaining: 41.8s. Rate: 143.6 symbols/min
[2025-10-24T01:31:03.662768] [INFO ] [MAIN      ] VZ: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:03.683819] [DEBUG] [LOCAL     ] VYX: Loaded 48651 existing records from primary storage.
[2025-10-24T01:31:03.684506] [INFO ] [MAIN      ] VYX: Loaded 48651 primary data records.
[2025-10-24T01:31:03.858505] [DEBUG] [MAIN      ] VVX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:04.065830] [DEBUG] [LOCAL     ] VZ: Loaded 54181 existing records from primary storage.
[2025-10-24T01:31:04.067339] [INFO ] [MAIN      ] VZ: Loaded 54181 primary data records.
[2025-10-24T01:31:04.402886] [INFO ] [MAIN      ] VVX: Generated 139 derivative records from 23194 primary records.
[2025-10-24T01:31:04.411663] [DEBUG] [LOCAL     ] VVX: Saving derivative data.
[2025-10-24T01:31:04.411505] [DEBUG] [MAIN      ] VYX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:04.440889] [DEBUG] [LOCAL     ] VVX: Derivative data saved (139 records).
[2025-10-24T01:31:04.443158] [INFO ] [MAIN      ] VVX: Successfully saved derivative data.
[2025-10-24T01:31:04.446433] [INFO ] [MAIN      ] Derivative Progress: 2065/2164 symbols completed. VVX took 1.2s. Estimated remaining: 41.4s. Rate: 143.5 symbols/min
[2025-10-24T01:31:04.446751] [INFO ] [MAIN      ] W: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:04.483823] [INFO ] [MAIN      ] VYX: Generated 139 derivative records from 48651 primary records.
[2025-10-24T01:31:04.488943] [DEBUG] [MAIN      ] VZ: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:04.499882] [DEBUG] [LOCAL     ] VYX: Saving derivative data.
[2025-10-24T01:31:04.518100] [DEBUG] [LOCAL     ] VYX: Derivative data saved (139 records).
[2025-10-24T01:31:04.533954] [INFO ] [MAIN      ] VYX: Successfully saved derivative data.
[2025-10-24T01:31:04.536457] [INFO ] [MAIN      ] Derivative Progress: 2066/2164 symbols completed. VYX took 1.2s. Estimated remaining: 41.0s. Rate: 143.6 symbols/min
[2025-10-24T01:31:04.537617] [INFO ] [MAIN      ] WAB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:04.563068] [DEBUG] [LOCAL     ] W: Loaded 53793 existing records from primary storage.
[2025-10-24T01:31:04.566696] [INFO ] [MAIN      ] W: Loaded 53793 primary data records.
[2025-10-24T01:31:04.629278] [INFO ] [MAIN      ] VZ: Generated 139 derivative records from 54181 primary records.
[2025-10-24T01:31:04.666523] [DEBUG] [LOCAL     ] VZ: Saving derivative data.
[2025-10-24T01:31:04.720008] [DEBUG] [LOCAL     ] VZ: Derivative data saved (139 records).
[2025-10-24T01:31:04.741756] [INFO ] [MAIN      ] VZ: Successfully saved derivative data.
[2025-10-24T01:31:04.758698] [INFO ] [MAIN      ] Derivative Progress: 2067/2164 symbols completed. VZ took 1.1s. Estimated remaining: 40.5s. Rate: 143.6 symbols/min
[2025-10-24T01:31:04.758953] [INFO ] [MAIN      ] WAL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:04.809489] [DEBUG] [LOCAL     ] WAB: Loaded 44111 existing records from primary storage.
[2025-10-24T01:31:04.925332] [INFO ] [MAIN      ] WAB: Loaded 44111 primary data records.
[2025-10-24T01:31:05.302218] [DEBUG] [LOCAL     ] WAL: Loaded 46034 existing records from primary storage.
[2025-10-24T01:31:05.302728] [INFO ] [MAIN      ] WAL: Loaded 46034 primary data records.
[2025-10-24T01:31:05.457995] [DEBUG] [MAIN      ] W: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:05.689304] [DEBUG] [MAIN      ] WAB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:05.726285] [INFO ] [MAIN      ] W: Generated 139 derivative records from 53793 primary records.
[2025-10-24T01:31:05.730167] [DEBUG] [LOCAL     ] W: Saving derivative data.
[2025-10-24T01:31:05.762077] [DEBUG] [LOCAL     ] W: Derivative data saved (139 records).
[2025-10-24T01:31:05.763248] [DEBUG] [MAIN      ] WAL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:05.763807] [INFO ] [MAIN      ] W: Successfully saved derivative data.
[2025-10-24T01:31:05.781988] [INFO ] [MAIN      ] Derivative Progress: 2068/2164 symbols completed. W took 1.3s. Estimated remaining: 40.1s. Rate: 143.5 symbols/min
[2025-10-24T01:31:05.798823] [INFO ] [MAIN      ] WAB: Generated 139 derivative records from 44111 primary records.
[2025-10-24T01:31:05.801461] [DEBUG] [LOCAL     ] WAB: Saving derivative data.
[2025-10-24T01:31:05.818109] [DEBUG] [LOCAL     ] WAB: Derivative data saved (139 records).
[2025-10-24T01:31:05.819331] [INFO ] [MAIN      ] WAB: Successfully saved derivative data.
[2025-10-24T01:31:05.821628] [INFO ] [MAIN      ] Derivative Progress: 2069/2164 symbols completed. WAB took 1.3s. Estimated remaining: 39.7s. Rate: 143.6 symbols/min
[2025-10-24T01:31:05.826562] [INFO ] [MAIN      ] WAL: Generated 139 derivative records from 46034 primary records.
[2025-10-24T01:31:05.826797] [DEBUG] [LOCAL     ] WAL: Saving derivative data.
[2025-10-24T01:31:05.838469] [DEBUG] [LOCAL     ] WAL: Derivative data saved (139 records).
[2025-10-24T01:31:05.838566] [INFO ] [MAIN      ] WAL: Successfully saved derivative data.
[2025-10-24T01:31:05.840905] [INFO ] [MAIN      ] Derivative Progress: 2070/2164 symbols completed. WAL took 1.1s. Estimated remaining: 39.3s. Rate: 143.6 symbols/min
[2025-10-24T01:31:05.841339] [INFO ] [MAIN      ] WAT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:05.841485] [INFO ] [MAIN      ] WBX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:05.841608] [INFO ] [MAIN      ] WBS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:05.858115] [DEBUG] [LOCAL     ] WBX: Loaded 9989 existing records from primary storage.
[2025-10-24T01:31:05.858370] [INFO ] [MAIN      ] WBX: Loaded 9989 primary data records.
[2025-10-24T01:31:06.191267] [DEBUG] [LOCAL     ] WAT: Loaded 35962 existing records from primary storage.
[2025-10-24T01:31:06.204957] [INFO ] [MAIN      ] WAT: Loaded 35962 primary data records.
[2025-10-24T01:31:06.205837] [DEBUG] [LOCAL     ] WBS: Loaded 49206 existing records from primary storage.
[2025-10-24T01:31:06.227889] [INFO ] [MAIN      ] WBS: Loaded 49206 primary data records.
[2025-10-24T01:31:06.839247] [DEBUG] [MAIN      ] WBX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:06.890574] [DEBUG] [MAIN      ] WAT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:06.926176] [DEBUG] [MAIN      ] WBS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:06.946252] [INFO ] [MAIN      ] WBX: Generated 139 derivative records from 9989 primary records.
[2025-10-24T01:31:06.949802] [DEBUG] [LOCAL     ] WBX: Saving derivative data.
[2025-10-24T01:31:06.963804] [DEBUG] [LOCAL     ] WBX: Derivative data saved (139 records).
[2025-10-24T01:31:06.964099] [INFO ] [MAIN      ] WBX: Successfully saved derivative data.
[2025-10-24T01:31:06.966754] [INFO ] [MAIN      ] Derivative Progress: 2071/2164 symbols completed. WBX took 1.1s. Estimated remaining: 38.9s. Rate: 143.5 symbols/min
[2025-10-24T01:31:06.970220] [INFO ] [MAIN      ] WCC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:07.000553] [INFO ] [MAIN      ] WBS: Generated 139 derivative records from 49206 primary records.
[2025-10-24T01:31:07.002544] [DEBUG] [LOCAL     ] WBS: Saving derivative data.
[2025-10-24T01:31:07.002830] [INFO ] [MAIN      ] WAT: Generated 139 derivative records from 35962 primary records.
[2025-10-24T01:31:07.003549] [DEBUG] [LOCAL     ] WAT: Saving derivative data.
[2025-10-24T01:31:07.024315] [DEBUG] [LOCAL     ] WBS: Derivative data saved (139 records).
[2025-10-24T01:31:07.033294] [INFO ] [MAIN      ] WBS: Successfully saved derivative data.
[2025-10-24T01:31:07.035895] [DEBUG] [LOCAL     ] WAT: Derivative data saved (139 records).
[2025-10-24T01:31:07.038397] [INFO ] [MAIN      ] Derivative Progress: 2072/2164 symbols completed. WBS took 1.2s. Estimated remaining: 38.5s. Rate: 143.6 symbols/min
[2025-10-24T01:31:07.038631] [INFO ] [MAIN      ] WCN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:07.038882] [INFO ] [MAIN      ] WAT: Successfully saved derivative data.
[2025-10-24T01:31:07.041170] [INFO ] [MAIN      ] Derivative Progress: 2073/2164 symbols completed. WAT took 1.2s. Estimated remaining: 38.0s. Rate: 143.6 symbols/min
[2025-10-24T01:31:07.041510] [INFO ] [MAIN      ] WD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:07.056427] [DEBUG] [LOCAL     ] WCC: Loaded 38640 existing records from primary storage.
[2025-10-24T01:31:07.056593] [INFO ] [MAIN      ] WCC: Loaded 38640 primary data records.
[2025-10-24T01:31:07.216876] [DEBUG] [LOCAL     ] WD: Loaded 22618 existing records from primary storage.
[2025-10-24T01:31:07.267322] [INFO ] [MAIN      ] WD: Loaded 22618 primary data records.
[2025-10-24T01:31:07.545084] [DEBUG] [LOCAL     ] WCN: Loaded 48248 existing records from primary storage.
[2025-10-24T01:31:07.545557] [INFO ] [MAIN      ] WCN: Loaded 48248 primary data records.
[2025-10-24T01:31:08.058487] [DEBUG] [MAIN      ] WCC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:08.099456] [DEBUG] [MAIN      ] WD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:08.141431] [DEBUG] [MAIN      ] WCN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:08.159268] [INFO ] [MAIN      ] WCC: Generated 139 derivative records from 38640 primary records.
[2025-10-24T01:31:08.164666] [DEBUG] [LOCAL     ] WCC: Saving derivative data.
[2025-10-24T01:31:08.186254] [DEBUG] [LOCAL     ] WCC: Derivative data saved (139 records).
[2025-10-24T01:31:08.188909] [INFO ] [MAIN      ] WCC: Successfully saved derivative data.
[2025-10-24T01:31:08.191831] [INFO ] [MAIN      ] Derivative Progress: 2074/2164 symbols completed. WCC took 1.2s. Estimated remaining: 37.6s. Rate: 143.5 symbols/min
[2025-10-24T01:31:08.194607] [INFO ] [MAIN      ] WDH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:08.205166] [INFO ] [MAIN      ] WD: Generated 139 derivative records from 22618 primary records.
[2025-10-24T01:31:08.205634] [DEBUG] [LOCAL     ] WD: Saving derivative data.
[2025-10-24T01:31:08.231227] [DEBUG] [LOCAL     ] WDH: Loaded 18142 existing records from primary storage.
[2025-10-24T01:31:08.232601] [INFO ] [MAIN      ] WDH: Loaded 18142 primary data records.
[2025-10-24T01:31:08.233186] [DEBUG] [LOCAL     ] WD: Derivative data saved (139 records).
[2025-10-24T01:31:08.235188] [INFO ] [MAIN      ] WD: Successfully saved derivative data.
[2025-10-24T01:31:08.242771] [INFO ] [MAIN      ] Derivative Progress: 2075/2164 symbols completed. WD took 1.2s. Estimated remaining: 37.2s. Rate: 143.6 symbols/min
[2025-10-24T01:31:08.243039] [INFO ] [MAIN      ] WDI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:08.273767] [INFO ] [MAIN      ] WCN: Generated 139 derivative records from 48248 primary records.
[2025-10-24T01:31:08.274006] [DEBUG] [LOCAL     ] WCN: Saving derivative data.
[2025-10-24T01:31:08.362196] [DEBUG] [LOCAL     ] WCN: Derivative data saved (139 records).
[2025-10-24T01:31:08.362330] [INFO ] [MAIN      ] WCN: Successfully saved derivative data.
[2025-10-24T01:31:08.391303] [INFO ] [MAIN      ] Derivative Progress: 2076/2164 symbols completed. WCN took 1.4s. Estimated remaining: 36.8s. Rate: 143.6 symbols/min
[2025-10-24T01:31:08.447476] [INFO ] [MAIN      ] WDS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:08.572593] [DEBUG] [LOCAL     ] WDI: Loaded 21400 existing records from primary storage.
[2025-10-24T01:31:08.573526] [INFO ] [MAIN      ] WDI: Loaded 21400 primary data records.
[2025-10-24T01:31:08.932979] [DEBUG] [LOCAL     ] WDS: Loaded 43353 existing records from primary storage.
[2025-10-24T01:31:08.934032] [INFO ] [MAIN      ] WDS: Loaded 43353 primary data records.
[2025-10-24T01:31:08.934966] [DEBUG] [MAIN      ] WDH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:09.289627] [DEBUG] [MAIN      ] WDI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:09.373761] [INFO ] [MAIN      ] WDH: Generated 139 derivative records from 18142 primary records.
[2025-10-24T01:31:09.376535] [DEBUG] [LOCAL     ] WDH: Saving derivative data.
[2025-10-24T01:31:09.395214] [DEBUG] [LOCAL     ] WDH: Derivative data saved (139 records).
[2025-10-24T01:31:09.396787] [INFO ] [MAIN      ] WDH: Successfully saved derivative data.
[2025-10-24T01:31:09.400383] [INFO ] [MAIN      ] Derivative Progress: 2077/2164 symbols completed. WDH took 1.2s. Estimated remaining: 36.4s. Rate: 143.5 symbols/min
[2025-10-24T01:31:09.405122] [INFO ] [MAIN      ] WEA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:09.421837] [DEBUG] [MAIN      ] WDS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:09.436033] [INFO ] [MAIN      ] WDI: Generated 139 derivative records from 21400 primary records.
[2025-10-24T01:31:09.437208] [DEBUG] [LOCAL     ] WDI: Saving derivative data.
[2025-10-24T01:31:09.458766] [DEBUG] [LOCAL     ] WDI: Derivative data saved (139 records).
[2025-10-24T01:31:09.456985] [DEBUG] [LOCAL     ] WEA: Loaded 7912 existing records from primary storage.
[2025-10-24T01:31:09.459226] [INFO ] [MAIN      ] WDI: Successfully saved derivative data.
[2025-10-24T01:31:09.462003] [INFO ] [MAIN      ] WEA: Loaded 7912 primary data records.
[2025-10-24T01:31:09.461878] [INFO ] [MAIN      ] Derivative Progress: 2078/2164 symbols completed. WDI took 1.2s. Estimated remaining: 35.9s. Rate: 143.6 symbols/min
[2025-10-24T01:31:09.470153] [INFO ] [MAIN      ] WEAV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:09.805004] [INFO ] [MAIN      ] WDS: Generated 139 derivative records from 43353 primary records.
[2025-10-24T01:31:09.821307] [DEBUG] [LOCAL     ] WEAV: Loaded 42662 existing records from primary storage.
[2025-10-24T01:31:09.821515] [INFO ] [MAIN      ] WEAV: Loaded 42662 primary data records.
[2025-10-24T01:31:09.821766] [DEBUG] [LOCAL     ] WDS: Saving derivative data.
[2025-10-24T01:31:09.926385] [DEBUG] [LOCAL     ] WDS: Derivative data saved (139 records).
[2025-10-24T01:31:09.943748] [INFO ] [MAIN      ] WDS: Successfully saved derivative data.
[2025-10-24T01:31:09.946083] [INFO ] [MAIN      ] Derivative Progress: 2079/2164 symbols completed. WDS took 1.5s. Estimated remaining: 35.5s. Rate: 143.6 symbols/min
[2025-10-24T01:31:09.958740] [INFO ] [MAIN      ] WEC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:10.161666] [DEBUG] [MAIN      ] WEA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:10.233887] [DEBUG] [LOCAL     ] WEC: Loaded 52524 existing records from primary storage.
[2025-10-24T01:31:10.248693] [INFO ] [MAIN      ] WEC: Loaded 52524 primary data records.
[2025-10-24T01:31:10.249045] [INFO ] [MAIN      ] WEA: Generated 139 derivative records from 7912 primary records.
[2025-10-24T01:31:10.280606] [DEBUG] [LOCAL     ] WEA: Saving derivative data.
[2025-10-24T01:31:10.270457] [DEBUG] [MAIN      ] WEAV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:10.354680] [DEBUG] [LOCAL     ] WEA: Derivative data saved (139 records).
[2025-10-24T01:31:10.381498] [INFO ] [MAIN      ] WEA: Successfully saved derivative data.
[2025-10-24T01:31:10.383815] [INFO ] [MAIN      ] Derivative Progress: 2080/2164 symbols completed. WEA took 1.0s. Estimated remaining: 35.1s. Rate: 143.6 symbols/min
[2025-10-24T01:31:10.384352] [INFO ] [MAIN      ] WELL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:10.630528] [INFO ] [MAIN      ] WEAV: Generated 139 derivative records from 42662 primary records.
[2025-10-24T01:31:10.632681] [DEBUG] [LOCAL     ] WEAV: Saving derivative data.
[2025-10-24T01:31:10.659960] [DEBUG] [LOCAL     ] WEAV: Derivative data saved (139 records).
[2025-10-24T01:31:10.660192] [INFO ] [MAIN      ] WEAV: Successfully saved derivative data.
[2025-10-24T01:31:10.662735] [INFO ] [MAIN      ] Derivative Progress: 2081/2164 symbols completed. WEAV took 1.2s. Estimated remaining: 34.7s. Rate: 143.6 symbols/min
[2025-10-24T01:31:10.663259] [INFO ] [MAIN      ] WES: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:10.695828] [DEBUG] [MAIN      ] WEC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:10.708840] [DEBUG] [LOCAL     ] WELL: Loaded 52666 existing records from primary storage.
[2025-10-24T01:31:10.712450] [INFO ] [MAIN      ] WELL: Loaded 52666 primary data records.
[2025-10-24T01:31:11.058834] [DEBUG] [LOCAL     ] WES: Loaded 49086 existing records from primary storage.
[2025-10-24T01:31:11.062288] [INFO ] [MAIN      ] WES: Loaded 49086 primary data records.
[2025-10-24T01:31:11.179976] [INFO ] [MAIN      ] WEC: Generated 139 derivative records from 52524 primary records.
[2025-10-24T01:31:11.230126] [DEBUG] [LOCAL     ] WEC: Saving derivative data.
[2025-10-24T01:31:11.384087] [DEBUG] [LOCAL     ] WEC: Derivative data saved (139 records).
[2025-10-24T01:31:11.384717] [INFO ] [MAIN      ] WEC: Successfully saved derivative data.
[2025-10-24T01:31:11.387170] [INFO ] [MAIN      ] Derivative Progress: 2082/2164 symbols completed. WEC took 1.4s. Estimated remaining: 34.3s. Rate: 143.5 symbols/min
[2025-10-24T01:31:11.387886] [INFO ] [MAIN      ] WEX: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:11.409011] [DEBUG] [MAIN      ] WELL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:11.480910] [DEBUG] [LOCAL     ] WEX: Loaded 32584 existing records from primary storage.
[2025-10-24T01:31:11.482444] [DEBUG] [MAIN      ] WES: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:11.482038] [INFO ] [MAIN      ] WEX: Loaded 32584 primary data records.
[2025-10-24T01:31:11.600175] [INFO ] [MAIN      ] WELL: Generated 139 derivative records from 52666 primary records.
[2025-10-24T01:31:11.604120] [DEBUG] [LOCAL     ] WELL: Saving derivative data.
[2025-10-24T01:31:11.683038] [DEBUG] [LOCAL     ] WELL: Derivative data saved (139 records).
[2025-10-24T01:31:11.859011] [INFO ] [MAIN      ] WELL: Successfully saved derivative data.
[2025-10-24T01:31:11.862089] [INFO ] [MAIN      ] Derivative Progress: 2083/2164 symbols completed. WELL took 1.5s. Estimated remaining: 33.9s. Rate: 143.5 symbols/min
[2025-10-24T01:31:11.876104] [INFO ] [MAIN      ] WES: Generated 139 derivative records from 49086 primary records.
[2025-10-24T01:31:11.876774] [DEBUG] [LOCAL     ] WES: Saving derivative data.
[2025-10-24T01:31:11.896371] [DEBUG] [LOCAL     ] WES: Derivative data saved (139 records).
[2025-10-24T01:31:11.896668] [INFO ] [MAIN      ] WES: Successfully saved derivative data.
[2025-10-24T01:31:11.900225] [INFO ] [MAIN      ] Derivative Progress: 2084/2164 symbols completed. WES took 1.2s. Estimated remaining: 33.4s. Rate: 143.6 symbols/min
[2025-10-24T01:31:11.916267] [DEBUG] [MAIN      ] WEX: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:11.940905] [INFO ] [MAIN      ] WEX: Generated 139 derivative records from 32584 primary records.
[2025-10-24T01:31:11.941010] [DEBUG] [LOCAL     ] WEX: Saving derivative data.
[2025-10-24T01:31:11.952492] [DEBUG] [LOCAL     ] WEX: Derivative data saved (139 records).
[2025-10-24T01:31:11.952583] [INFO ] [MAIN      ] WEX: Successfully saved derivative data.
[2025-10-24T01:31:11.955344] [INFO ] [MAIN      ] Derivative Progress: 2085/2164 symbols completed. WEX took 0.6s. Estimated remaining: 33.0s. Rate: 143.6 symbols/min
[2025-10-24T01:31:11.955795] [INFO ] [MAIN      ] WF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:11.955919] [INFO ] [MAIN      ] WFG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:11.955984] [INFO ] [MAIN      ] WFC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:11.971389] [DEBUG] [LOCAL     ] WF: Loaded 10779 existing records from primary storage.
[2025-10-24T01:31:11.971636] [INFO ] [MAIN      ] WF: Loaded 10779 primary data records.
[2025-10-24T01:31:12.091925] [DEBUG] [LOCAL     ] WFG: Loaded 24704 existing records from primary storage.
[2025-10-24T01:31:12.148711] [INFO ] [MAIN      ] WFG: Loaded 24704 primary data records.
[2025-10-24T01:31:12.412454] [DEBUG] [LOCAL     ] WFC: Loaded 54138 existing records from primary storage.
[2025-10-24T01:31:12.435316] [INFO ] [MAIN      ] WFC: Loaded 54138 primary data records.
[2025-10-24T01:31:12.951000] [DEBUG] [MAIN      ] WF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:12.996798] [DEBUG] [MAIN      ] WFG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:13.038130] [DEBUG] [MAIN      ] WFC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:13.059067] [INFO ] [MAIN      ] WF: Generated 139 derivative records from 10779 primary records.
[2025-10-24T01:31:13.061428] [DEBUG] [LOCAL     ] WF: Saving derivative data.
[2025-10-24T01:31:13.083554] [DEBUG] [LOCAL     ] WF: Derivative data saved (139 records).
[2025-10-24T01:31:13.086848] [INFO ] [MAIN      ] WF: Successfully saved derivative data.
[2025-10-24T01:31:13.090724] [INFO ] [MAIN      ] Derivative Progress: 2086/2164 symbols completed. WF took 1.1s. Estimated remaining: 32.6s. Rate: 143.5 symbols/min
[2025-10-24T01:31:13.096692] [INFO ] [MAIN      ] WGO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:13.102182] [INFO ] [MAIN      ] WFG: Generated 139 derivative records from 24704 primary records.
[2025-10-24T01:31:13.102300] [DEBUG] [LOCAL     ] WFG: Saving derivative data.
[2025-10-24T01:31:13.120632] [DEBUG] [LOCAL     ] WFG: Derivative data saved (139 records).
[2025-10-24T01:31:13.122087] [INFO ] [MAIN      ] WFG: Successfully saved derivative data.
[2025-10-24T01:31:13.124883] [INFO ] [MAIN      ] Derivative Progress: 2087/2164 symbols completed. WFG took 1.2s. Estimated remaining: 32.2s. Rate: 143.6 symbols/min
[2025-10-24T01:31:13.127296] [INFO ] [MAIN      ] WH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:13.127133] [INFO ] [MAIN      ] WFC: Generated 139 derivative records from 54138 primary records.
[2025-10-24T01:31:13.127862] [DEBUG] [LOCAL     ] WFC: Saving derivative data.
[2025-10-24T01:31:13.141427] [DEBUG] [LOCAL     ] WFC: Derivative data saved (139 records).
[2025-10-24T01:31:13.141723] [INFO ] [MAIN      ] WFC: Successfully saved derivative data.
[2025-10-24T01:31:13.144906] [INFO ] [MAIN      ] Derivative Progress: 2088/2164 symbols completed. WFC took 1.2s. Estimated remaining: 31.7s. Rate: 143.7 symbols/min
[2025-10-24T01:31:13.145121] [INFO ] [MAIN      ] WHD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:13.173836] [DEBUG] [LOCAL     ] WGO: Loaded 38321 existing records from primary storage.
[2025-10-24T01:31:13.174152] [INFO ] [MAIN      ] WGO: Loaded 38321 primary data records.
[2025-10-24T01:31:13.351198] [DEBUG] [LOCAL     ] WH: Loaded 45647 existing records from primary storage.
[2025-10-24T01:31:13.386276] [INFO ] [MAIN      ] WH: Loaded 45647 primary data records.
[2025-10-24T01:31:13.598828] [DEBUG] [LOCAL     ] WHD: Loaded 40265 existing records from primary storage.
[2025-10-24T01:31:13.622412] [INFO ] [MAIN      ] WHD: Loaded 40265 primary data records.
[2025-10-24T01:31:14.227262] [DEBUG] [MAIN      ] WGO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:14.273284] [DEBUG] [MAIN      ] WH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:14.330818] [DEBUG] [MAIN      ] WHD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:14.358084] [INFO ] [MAIN      ] WGO: Generated 139 derivative records from 38321 primary records.
[2025-10-24T01:31:14.361435] [DEBUG] [LOCAL     ] WGO: Saving derivative data.
[2025-10-24T01:31:14.380346] [DEBUG] [LOCAL     ] WGO: Derivative data saved (139 records).
[2025-10-24T01:31:14.387311] [INFO ] [MAIN      ] WGO: Successfully saved derivative data.
[2025-10-24T01:31:14.396935] [INFO ] [MAIN      ] Derivative Progress: 2089/2164 symbols completed. WGO took 1.3s. Estimated remaining: 31.4s. Rate: 143.5 symbols/min
[2025-10-24T01:31:14.397139] [INFO ] [MAIN      ] WHG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:14.409422] [INFO ] [MAIN      ] WH: Generated 139 derivative records from 45647 primary records.
[2025-10-24T01:31:14.414671] [DEBUG] [LOCAL     ] WH: Saving derivative data.
[2025-10-24T01:31:14.412510] [DEBUG] [LOCAL     ] WHG: Loaded 3056 existing records from primary storage.
[2025-10-24T01:31:14.415926] [INFO ] [MAIN      ] WHG: Loaded 3056 primary data records.
[2025-10-24T01:31:14.416584] [INFO ] [MAIN      ] WHD: Generated 139 derivative records from 40265 primary records.
[2025-10-24T01:31:14.417104] [DEBUG] [LOCAL     ] WHD: Saving derivative data.
[2025-10-24T01:31:14.494698] [DEBUG] [LOCAL     ] WH: Derivative data saved (139 records).
[2025-10-24T01:31:14.530515] [DEBUG] [LOCAL     ] WHD: Derivative data saved (139 records).
[2025-10-24T01:31:14.571517] [INFO ] [MAIN      ] WHD: Successfully saved derivative data.
[2025-10-24T01:31:14.574472] [INFO ] [MAIN      ] Derivative Progress: 2090/2164 symbols completed. WHD took 1.4s. Estimated remaining: 30.9s. Rate: 143.6 symbols/min
[2025-10-24T01:31:14.535790] [INFO ] [MAIN      ] WH: Successfully saved derivative data.
[2025-10-24T01:31:14.579118] [INFO ] [MAIN      ] WHR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:14.583200] [INFO ] [MAIN      ] Derivative Progress: 2091/2164 symbols completed. WH took 1.5s. Estimated remaining: 30.5s. Rate: 143.6 symbols/min
[2025-10-24T01:31:14.605442] [INFO ] [MAIN      ] WIA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:14.783961] [DEBUG] [LOCAL     ] WIA: Loaded 5067 existing records from primary storage.
[2025-10-24T01:31:14.784532] [INFO ] [MAIN      ] WIA: Loaded 5067 primary data records.
[2025-10-24T01:31:15.135840] [DEBUG] [LOCAL     ] WHR: Loaded 49256 existing records from primary storage.
[2025-10-24T01:31:15.136254] [INFO ] [MAIN      ] WHR: Loaded 49256 primary data records.
[2025-10-24T01:31:15.335459] [DEBUG] [MAIN      ] WHG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:15.493896] [DEBUG] [MAIN      ] WIA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:15.522826] [INFO ] [MAIN      ] WHG: Generated 139 derivative records from 3056 primary records.
[2025-10-24T01:31:15.525058] [DEBUG] [LOCAL     ] WHG: Saving derivative data.
[2025-10-24T01:31:15.550484] [DEBUG] [LOCAL     ] WHG: Derivative data saved (139 records).
[2025-10-24T01:31:15.551101] [DEBUG] [MAIN      ] WHR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:15.551480] [INFO ] [MAIN      ] WHG: Successfully saved derivative data.
[2025-10-24T01:31:15.565667] [INFO ] [MAIN      ] Derivative Progress: 2092/2164 symbols completed. WHG took 1.2s. Estimated remaining: 30.1s. Rate: 143.5 symbols/min
[2025-10-24T01:31:15.566207] [INFO ] [MAIN      ] WINN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:15.593441] [DEBUG] [LOCAL     ] WINN: Loaded 11255 existing records from primary storage.
[2025-10-24T01:31:15.593717] [INFO ] [MAIN      ] WIA: Generated 139 derivative records from 5067 primary records.
[2025-10-24T01:31:15.594233] [INFO ] [MAIN      ] WINN: Loaded 11255 primary data records.
[2025-10-24T01:31:15.594467] [DEBUG] [LOCAL     ] WIA: Saving derivative data.
[2025-10-24T01:31:15.644965] [DEBUG] [LOCAL     ] WIA: Derivative data saved (139 records).
[2025-10-24T01:31:15.678997] [INFO ] [MAIN      ] WIA: Successfully saved derivative data.
[2025-10-24T01:31:15.696787] [INFO ] [MAIN      ] Derivative Progress: 2093/2164 symbols completed. WIA took 1.1s. Estimated remaining: 29.7s. Rate: 143.6 symbols/min
[2025-10-24T01:31:15.719672] [INFO ] [MAIN      ] WIT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:15.961032] [INFO ] [MAIN      ] WHR: Generated 139 derivative records from 49256 primary records.
[2025-10-24T01:31:15.970088] [DEBUG] [LOCAL     ] WHR: Saving derivative data.
[2025-10-24T01:31:15.983768] [DEBUG] [LOCAL     ] WHR: Derivative data saved (139 records).
[2025-10-24T01:31:15.984725] [INFO ] [MAIN      ] WHR: Successfully saved derivative data.
[2025-10-24T01:31:15.987479] [INFO ] [MAIN      ] Derivative Progress: 2094/2164 symbols completed. WHR took 1.4s. Estimated remaining: 29.2s. Rate: 143.6 symbols/min
[2025-10-24T01:31:15.987761] [INFO ] [MAIN      ] WIW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:16.042629] [DEBUG] [MAIN      ] WINN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:16.065586] [DEBUG] [LOCAL     ] WIW: Loaded 20389 existing records from primary storage.
[2025-10-24T01:31:16.067723] [INFO ] [MAIN      ] WIW: Loaded 20389 primary data records.
[2025-10-24T01:31:16.081414] [DEBUG] [LOCAL     ] WIT: Loaded 52922 existing records from primary storage.
[2025-10-24T01:31:16.082197] [INFO ] [MAIN      ] WIT: Loaded 52922 primary data records.
[2025-10-24T01:31:16.682460] [INFO ] [MAIN      ] WINN: Generated 139 derivative records from 11255 primary records.
[2025-10-24T01:31:16.683263] [DEBUG] [LOCAL     ] WINN: Saving derivative data.
[2025-10-24T01:31:16.697316] [DEBUG] [LOCAL     ] WINN: Derivative data saved (139 records).
[2025-10-24T01:31:16.698463] [INFO ] [MAIN      ] WINN: Successfully saved derivative data.
[2025-10-24T01:31:16.700699] [INFO ] [MAIN      ] Derivative Progress: 2095/2164 symbols completed. WINN took 1.1s. Estimated remaining: 28.8s. Rate: 143.6 symbols/min
[2025-10-24T01:31:16.701948] [INFO ] [MAIN      ] WK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:16.739565] [DEBUG] [MAIN      ] WIT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:16.740099] [DEBUG] [MAIN      ] WIW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:16.809171] [DEBUG] [LOCAL     ] WK: Loaded 37264 existing records from primary storage.
[2025-10-24T01:31:16.812319] [INFO ] [MAIN      ] WK: Loaded 37264 primary data records.
[2025-10-24T01:31:17.151400] [INFO ] [MAIN      ] WIW: Generated 139 derivative records from 20389 primary records.
[2025-10-24T01:31:17.157533] [DEBUG] [LOCAL     ] WIW: Saving derivative data.
[2025-10-24T01:31:17.157765] [INFO ] [MAIN      ] WIT: Generated 139 derivative records from 52922 primary records.
[2025-10-24T01:31:17.158792] [DEBUG] [LOCAL     ] WIT: Saving derivative data.
[2025-10-24T01:31:17.187922] [DEBUG] [LOCAL     ] WIT: Derivative data saved (139 records).
[2025-10-24T01:31:17.188354] [INFO ] [MAIN      ] WIT: Successfully saved derivative data.
[2025-10-24T01:31:17.185088] [DEBUG] [LOCAL     ] WIW: Derivative data saved (139 records).
[2025-10-24T01:31:17.191695] [INFO ] [MAIN      ] Derivative Progress: 2096/2164 symbols completed. WIT took 1.5s. Estimated remaining: 28.4s. Rate: 143.5 symbols/min
[2025-10-24T01:31:17.188550] [INFO ] [MAIN      ] WIW: Successfully saved derivative data.
[2025-10-24T01:31:17.191871] [INFO ] [MAIN      ] WKC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:17.194810] [INFO ] [MAIN      ] Derivative Progress: 2097/2164 symbols completed. WIW took 1.2s. Estimated remaining: 28.0s. Rate: 143.6 symbols/min
[2025-10-24T01:31:17.195721] [INFO ] [MAIN      ] WLK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:17.214584] [DEBUG] [MAIN      ] WK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:17.279038] [DEBUG] [LOCAL     ] WKC: Loaded 34728 existing records from primary storage.
[2025-10-24T01:31:17.279274] [INFO ] [MAIN      ] WK: Generated 139 derivative records from 37264 primary records.
[2025-10-24T01:31:17.279515] [DEBUG] [LOCAL     ] WK: Saving derivative data.
[2025-10-24T01:31:17.279626] [INFO ] [MAIN      ] WKC: Loaded 34728 primary data records.
[2025-10-24T01:31:17.396596] [DEBUG] [LOCAL     ] WK: Derivative data saved (139 records).
[2025-10-24T01:31:17.397301] [DEBUG] [LOCAL     ] WLK: Loaded 46176 existing records from primary storage.
[2025-10-24T01:31:17.408529] [INFO ] [MAIN      ] WLK: Loaded 46176 primary data records.
[2025-10-24T01:31:17.408384] [INFO ] [MAIN      ] WK: Successfully saved derivative data.
[2025-10-24T01:31:17.411730] [INFO ] [MAIN      ] Derivative Progress: 2098/2164 symbols completed. WK took 0.7s. Estimated remaining: 27.6s. Rate: 143.6 symbols/min
[2025-10-24T01:31:17.947825] [DEBUG] [MAIN      ] WKC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:17.987502] [DEBUG] [MAIN      ] WLK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:18.011621] [INFO ] [MAIN      ] WKC: Generated 139 derivative records from 34728 primary records.
[2025-10-24T01:31:18.012988] [DEBUG] [LOCAL     ] WKC: Saving derivative data.
[2025-10-24T01:31:18.027243] [DEBUG] [LOCAL     ] WKC: Derivative data saved (139 records).
[2025-10-24T01:31:18.027369] [INFO ] [MAIN      ] WKC: Successfully saved derivative data.
[2025-10-24T01:31:18.030845] [INFO ] [MAIN      ] Derivative Progress: 2099/2164 symbols completed. WKC took 0.8s. Estimated remaining: 27.2s. Rate: 143.6 symbols/min
[2025-10-24T01:31:18.038105] [INFO ] [MAIN      ] WLK: Generated 139 derivative records from 46176 primary records.
[2025-10-24T01:31:18.038197] [DEBUG] [LOCAL     ] WLK: Saving derivative data.
[2025-10-24T01:31:18.049707] [DEBUG] [LOCAL     ] WLK: Derivative data saved (139 records).
[2025-10-24T01:31:18.049788] [INFO ] [MAIN      ] WLK: Successfully saved derivative data.
[2025-10-24T01:31:18.052294] [INFO ] [MAIN      ] Derivative Progress: 2100/2164 symbols completed. WLK took 0.9s. Estimated remaining: 26.7s. Rate: 143.7 symbols/min
[2025-10-24T01:31:18.052907] [INFO ] [MAIN      ] WLY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:18.053134] [INFO ] [MAIN      ] WLKP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:18.053051] [INFO ] [MAIN      ] WM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:18.065738] [DEBUG] [LOCAL     ] WLKP: Loaded 7323 existing records from primary storage.
[2025-10-24T01:31:18.066046] [INFO ] [MAIN      ] WLKP: Loaded 7323 primary data records.
[2025-10-24T01:31:18.240350] [DEBUG] [LOCAL     ] WLY: Loaded 29962 existing records from primary storage.
[2025-10-24T01:31:18.373763] [INFO ] [MAIN      ] WLY: Loaded 29962 primary data records.
[2025-10-24T01:31:18.535586] [DEBUG] [LOCAL     ] WM: Loaded 51209 existing records from primary storage.
[2025-10-24T01:31:18.564468] [INFO ] [MAIN      ] WM: Loaded 51209 primary data records.
[2025-10-24T01:31:19.041611] [DEBUG] [MAIN      ] WLKP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:19.084633] [DEBUG] [MAIN      ] WLY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:19.139628] [DEBUG] [MAIN      ] WM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:19.143314] [INFO ] [MAIN      ] WLKP: Generated 139 derivative records from 7323 primary records.
[2025-10-24T01:31:19.160628] [DEBUG] [LOCAL     ] WLKP: Saving derivative data.
[2025-10-24T01:31:19.180534] [DEBUG] [LOCAL     ] WLKP: Derivative data saved (139 records).
[2025-10-24T01:31:19.179295] [INFO ] [MAIN      ] WLY: Generated 139 derivative records from 29962 primary records.
[2025-10-24T01:31:19.182725] [DEBUG] [LOCAL     ] WLY: Saving derivative data.
[2025-10-24T01:31:19.182409] [INFO ] [MAIN      ] WLKP: Successfully saved derivative data.
[2025-10-24T01:31:19.195891] [INFO ] [MAIN      ] Derivative Progress: 2101/2164 symbols completed. WLKP took 1.1s. Estimated remaining: 26.3s. Rate: 143.6 symbols/min
[2025-10-24T01:31:19.200466] [DEBUG] [LOCAL     ] WLY: Derivative data saved (139 records).
[2025-10-24T01:31:19.197827] [INFO ] [MAIN      ] WMB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:19.200809] [INFO ] [MAIN      ] WLY: Successfully saved derivative data.
[2025-10-24T01:31:19.204967] [INFO ] [MAIN      ] Derivative Progress: 2102/2164 symbols completed. WLY took 1.2s. Estimated remaining: 25.9s. Rate: 143.6 symbols/min
[2025-10-24T01:31:19.207370] [INFO ] [MAIN      ] WMK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:19.219949] [INFO ] [MAIN      ] WM: Generated 139 derivative records from 51209 primary records.
[2025-10-24T01:31:19.220202] [DEBUG] [LOCAL     ] WM: Saving derivative data.
[2025-10-24T01:31:19.237780] [DEBUG] [LOCAL     ] WM: Derivative data saved (139 records).
[2025-10-24T01:31:19.238165] [INFO ] [MAIN      ] WM: Successfully saved derivative data.
[2025-10-24T01:31:19.241809] [INFO ] [MAIN      ] Derivative Progress: 2103/2164 symbols completed. WM took 1.2s. Estimated remaining: 25.5s. Rate: 143.7 symbols/min
[2025-10-24T01:31:19.242126] [INFO ] [MAIN      ] WMS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:19.249544] [DEBUG] [LOCAL     ] WMK: Loaded 14724 existing records from primary storage.
[2025-10-24T01:31:19.249882] [INFO ] [MAIN      ] WMK: Loaded 14724 primary data records.
[2025-10-24T01:31:19.441726] [DEBUG] [LOCAL     ] WMB: Loaded 54062 existing records from primary storage.
[2025-10-24T01:31:19.478702] [INFO ] [MAIN      ] WMB: Loaded 54062 primary data records.
[2025-10-24T01:31:19.671122] [DEBUG] [LOCAL     ] WMS: Loaded 39739 existing records from primary storage.
[2025-10-24T01:31:19.703838] [INFO ] [MAIN      ] WMS: Loaded 39739 primary data records.
[2025-10-24T01:31:20.286119] [DEBUG] [MAIN      ] WMK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:20.341061] [DEBUG] [MAIN      ] WMB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:20.374728] [INFO ] [MAIN      ] WMK: Generated 139 derivative records from 14724 primary records.
[2025-10-24T01:31:20.381191] [DEBUG] [LOCAL     ] WMK: Saving derivative data.
[2025-10-24T01:31:20.382894] [DEBUG] [MAIN      ] WMS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:20.413220] [DEBUG] [LOCAL     ] WMK: Derivative data saved (139 records).
[2025-10-24T01:31:20.413391] [INFO ] [MAIN      ] WMK: Successfully saved derivative data.
[2025-10-24T01:31:20.417260] [INFO ] [MAIN      ] Derivative Progress: 2104/2164 symbols completed. WMK took 1.2s. Estimated remaining: 25.1s. Rate: 143.6 symbols/min
[2025-10-24T01:31:20.418972] [INFO ] [MAIN      ] WMT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:20.455361] [INFO ] [MAIN      ] WMB: Generated 139 derivative records from 54062 primary records.
[2025-10-24T01:31:20.455769] [DEBUG] [LOCAL     ] WMB: Saving derivative data.
[2025-10-24T01:31:20.458251] [INFO ] [MAIN      ] WMS: Generated 139 derivative records from 39739 primary records.
[2025-10-24T01:31:20.459359] [DEBUG] [LOCAL     ] WMS: Saving derivative data.
[2025-10-24T01:31:20.472147] [DEBUG] [LOCAL     ] WMB: Derivative data saved (139 records).
[2025-10-24T01:31:20.479735] [INFO ] [MAIN      ] WMB: Successfully saved derivative data.
[2025-10-24T01:31:20.484865] [DEBUG] [LOCAL     ] WMS: Derivative data saved (139 records).
[2025-10-24T01:31:20.488055] [INFO ] [MAIN      ] Derivative Progress: 2105/2164 symbols completed. WMB took 1.3s. Estimated remaining: 24.6s. Rate: 143.6 symbols/min
[2025-10-24T01:31:20.485148] [INFO ] [MAIN      ] WMS: Successfully saved derivative data.
[2025-10-24T01:31:20.491417] [INFO ] [MAIN      ] WNC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:20.491526] [INFO ] [MAIN      ] Derivative Progress: 2106/2164 symbols completed. WMS took 1.2s. Estimated remaining: 24.2s. Rate: 143.7 symbols/min
[2025-10-24T01:31:20.509782] [INFO ] [MAIN      ] WOLF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:20.536474] [DEBUG] [LOCAL     ] WMT: Loaded 54190 existing records from primary storage.
[2025-10-24T01:31:20.537185] [INFO ] [MAIN      ] WMT: Loaded 54190 primary data records.
[2025-10-24T01:31:20.731363] [DEBUG] [LOCAL     ] WNC: Loaded 38303 existing records from primary storage.
[2025-10-24T01:31:20.774961] [INFO ] [MAIN      ] WNC: Loaded 38303 primary data records.
[2025-10-24T01:31:20.893238] [DEBUG] [LOCAL     ] WOLF: Loaded 53356 existing records from primary storage.
[2025-10-24T01:31:20.932444] [INFO ] [MAIN      ] WOLF: Loaded 53356 primary data records.
[2025-10-24T01:31:21.605523] [DEBUG] [MAIN      ] WMT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:21.666768] [INFO ] [MAIN      ] WMT: Generated 139 derivative records from 54190 primary records.
[2025-10-24T01:31:21.664004] [DEBUG] [MAIN      ] WNC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:21.675118] [DEBUG] [LOCAL     ] WMT: Saving derivative data.
[2025-10-24T01:31:21.694231] [DEBUG] [MAIN      ] WOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:21.707634] [DEBUG] [LOCAL     ] WMT: Derivative data saved (139 records).
[2025-10-24T01:31:21.708209] [INFO ] [MAIN      ] WMT: Successfully saved derivative data.
[2025-10-24T01:31:21.711316] [INFO ] [MAIN      ] Derivative Progress: 2107/2164 symbols completed. WMT took 1.3s. Estimated remaining: 23.8s. Rate: 143.6 symbols/min
[2025-10-24T01:31:21.724406] [INFO ] [MAIN      ] WOR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:21.775191] [DEBUG] [LOCAL     ] WOR: Loaded 23641 existing records from primary storage.
[2025-10-24T01:31:21.783096] [INFO ] [MAIN      ] WOR: Loaded 23641 primary data records.
[2025-10-24T01:31:21.799296] [INFO ] [MAIN      ] WNC: Generated 139 derivative records from 38303 primary records.
[2025-10-24T01:31:21.821623] [DEBUG] [LOCAL     ] WNC: Saving derivative data.
[2025-10-24T01:31:21.898168] [DEBUG] [LOCAL     ] WNC: Derivative data saved (139 records).
[2025-10-24T01:31:21.903765] [INFO ] [MAIN      ] WNC: Successfully saved derivative data.
[2025-10-24T01:31:21.911696] [INFO ] [MAIN      ] Derivative Progress: 2108/2164 symbols completed. WNC took 1.4s. Estimated remaining: 23.4s. Rate: 143.6 symbols/min
[2025-10-24T01:31:21.927347] [INFO ] [MAIN      ] WOW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:21.942737] [INFO ] [MAIN      ] WOLF: Generated 139 derivative records from 53356 primary records.
[2025-10-24T01:31:21.959768] [DEBUG] [LOCAL     ] WOLF: Saving derivative data.
[2025-10-24T01:31:22.194240] [DEBUG] [LOCAL     ] WOLF: Derivative data saved (139 records).
[2025-10-24T01:31:22.194402] [INFO ] [MAIN      ] WOLF: Successfully saved derivative data.
[2025-10-24T01:31:22.197454] [INFO ] [MAIN      ] Derivative Progress: 2109/2164 symbols completed. WOLF took 1.7s. Estimated remaining: 23.0s. Rate: 143.6 symbols/min
[2025-10-24T01:31:22.199414] [INFO ] [MAIN      ] WPC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:22.215868] [DEBUG] [LOCAL     ] WOW: Loaded 31346 existing records from primary storage.
[2025-10-24T01:31:22.217629] [INFO ] [MAIN      ] WOW: Loaded 31346 primary data records.
[2025-10-24T01:31:22.543837] [DEBUG] [MAIN      ] WOR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:22.580091] [DEBUG] [LOCAL     ] WPC: Loaded 48471 existing records from primary storage.
[2025-10-24T01:31:22.584208] [INFO ] [MAIN      ] WPC: Loaded 48471 primary data records.
[2025-10-24T01:31:22.797309] [DEBUG] [MAIN      ] WOW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:22.933396] [INFO ] [MAIN      ] WOR: Generated 139 derivative records from 23641 primary records.
[2025-10-24T01:31:22.935773] [DEBUG] [LOCAL     ] WOR: Saving derivative data.
[2025-10-24T01:31:22.955973] [DEBUG] [LOCAL     ] WOR: Derivative data saved (139 records).
[2025-10-24T01:31:22.959147] [INFO ] [MAIN      ] WOR: Successfully saved derivative data.
[2025-10-24T01:31:22.964098] [INFO ] [MAIN      ] Derivative Progress: 2110/2164 symbols completed. WOR took 1.2s. Estimated remaining: 22.6s. Rate: 143.6 symbols/min
[2025-10-24T01:31:22.966751] [INFO ] [MAIN      ] WPM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:22.989253] [INFO ] [MAIN      ] WOW: Generated 139 derivative records from 31346 primary records.
[2025-10-24T01:31:22.989666] [DEBUG] [LOCAL     ] WOW: Saving derivative data.
[2025-10-24T01:31:23.009885] [DEBUG] [LOCAL     ] WOW: Derivative data saved (139 records).
[2025-10-24T01:31:23.010102] [INFO ] [MAIN      ] WOW: Successfully saved derivative data.
[2025-10-24T01:31:23.020988] [INFO ] [MAIN      ] Derivative Progress: 2111/2164 symbols completed. WOW took 1.1s. Estimated remaining: 22.1s. Rate: 143.6 symbols/min
[2025-10-24T01:31:23.028922] [INFO ] [MAIN      ] WPP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:23.029371] [DEBUG] [MAIN      ] WPC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:23.104518] [DEBUG] [LOCAL     ] WPM: Loaded 53176 existing records from primary storage.
[2025-10-24T01:31:23.105238] [INFO ] [MAIN      ] WPM: Loaded 53176 primary data records.
[2025-10-24T01:31:23.164003] [DEBUG] [LOCAL     ] WPP: Loaded 34564 existing records from primary storage.
[2025-10-24T01:31:23.189633] [INFO ] [MAIN      ] WPP: Loaded 34564 primary data records.
[2025-10-24T01:31:23.226708] [INFO ] [MAIN      ] WPC: Generated 139 derivative records from 48471 primary records.
[2025-10-24T01:31:23.263015] [DEBUG] [LOCAL     ] WPC: Saving derivative data.
[2025-10-24T01:31:23.471561] [DEBUG] [LOCAL     ] WPC: Derivative data saved (139 records).
[2025-10-24T01:31:23.625182] [INFO ] [MAIN      ] WPC: Successfully saved derivative data.
[2025-10-24T01:31:23.629060] [INFO ] [MAIN      ] Derivative Progress: 2112/2164 symbols completed. WPC took 1.4s. Estimated remaining: 21.7s. Rate: 143.6 symbols/min
[2025-10-24T01:31:23.730158] [INFO ] [MAIN      ] WRB: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:23.784799] [DEBUG] [MAIN      ] WPM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:23.834981] [DEBUG] [MAIN      ] WPP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:23.873229] [DEBUG] [LOCAL     ] WRB: Loaded 51176 existing records from primary storage.
[2025-10-24T01:31:23.875152] [INFO ] [MAIN      ] WRB: Loaded 51176 primary data records.
[2025-10-24T01:31:24.260497] [INFO ] [MAIN      ] WPM: Generated 139 derivative records from 53176 primary records.
[2025-10-24T01:31:24.260928] [DEBUG] [LOCAL     ] WPM: Saving derivative data.
[2025-10-24T01:31:24.265738] [INFO ] [MAIN      ] WPP: Generated 139 derivative records from 34564 primary records.
[2025-10-24T01:31:24.273449] [DEBUG] [LOCAL     ] WPP: Saving derivative data.
[2025-10-24T01:31:24.279188] [DEBUG] [LOCAL     ] WPM: Derivative data saved (139 records).
[2025-10-24T01:31:24.279796] [INFO ] [MAIN      ] WPM: Successfully saved derivative data.
[2025-10-24T01:31:24.293878] [DEBUG] [LOCAL     ] WPP: Derivative data saved (139 records).
[2025-10-24T01:31:24.291038] [INFO ] [MAIN      ] Derivative Progress: 2113/2164 symbols completed. WPM took 1.3s. Estimated remaining: 21.3s. Rate: 143.5 symbols/min
[2025-10-24T01:31:24.294200] [INFO ] [MAIN      ] WPP: Successfully saved derivative data.
[2025-10-24T01:31:24.297369] [INFO ] [MAIN      ] Derivative Progress: 2114/2164 symbols completed. WPP took 1.3s. Estimated remaining: 20.9s. Rate: 143.6 symbols/min
[2025-10-24T01:31:24.318333] [DEBUG] [MAIN      ] WRB: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:24.344117] [INFO ] [MAIN      ] WRB: Generated 139 derivative records from 51176 primary records.
[2025-10-24T01:31:24.344311] [DEBUG] [LOCAL     ] WRB: Saving derivative data.
[2025-10-24T01:31:24.355958] [DEBUG] [LOCAL     ] WRB: Derivative data saved (139 records).
[2025-10-24T01:31:24.356050] [INFO ] [MAIN      ] WRB: Successfully saved derivative data.
[2025-10-24T01:31:24.359482] [INFO ] [MAIN      ] Derivative Progress: 2115/2164 symbols completed. WRB took 0.6s. Estimated remaining: 20.5s. Rate: 143.7 symbols/min
[2025-10-24T01:31:24.360157] [INFO ] [MAIN      ] WS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:24.359997] [INFO ] [MAIN      ] WRBY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:24.360083] [INFO ] [MAIN      ] WSM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:24.388634] [DEBUG] [LOCAL     ] WS: Loaded 23638 existing records from primary storage.
[2025-10-24T01:31:24.388922] [INFO ] [MAIN      ] WS: Loaded 23638 primary data records.
[2025-10-24T01:31:24.735779] [DEBUG] [LOCAL     ] WSM: Loaded 49047 existing records from primary storage.
[2025-10-24T01:31:24.737135] [DEBUG] [LOCAL     ] WRBY: Loaded 51034 existing records from primary storage.
[2025-10-24T01:31:24.737503] [INFO ] [MAIN      ] WSM: Loaded 49047 primary data records.
[2025-10-24T01:31:24.737600] [INFO ] [MAIN      ] WRBY: Loaded 51034 primary data records.
[2025-10-24T01:31:25.360949] [DEBUG] [MAIN      ] WS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:25.410498] [INFO ] [MAIN      ] WS: Generated 139 derivative records from 23638 primary records.
[2025-10-24T01:31:25.430863] [DEBUG] [LOCAL     ] WS: Saving derivative data.
[2025-10-24T01:31:25.431444] [DEBUG] [MAIN      ] WSM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:25.465194] [DEBUG] [LOCAL     ] WS: Derivative data saved (139 records).
[2025-10-24T01:31:25.479072] [INFO ] [MAIN      ] WS: Successfully saved derivative data.
[2025-10-24T01:31:25.483375] [INFO ] [MAIN      ] Derivative Progress: 2116/2164 symbols completed. WS took 1.1s. Estimated remaining: 20.1s. Rate: 143.5 symbols/min
[2025-10-24T01:31:25.481047] [DEBUG] [MAIN      ] WRBY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:25.502078] [INFO ] [MAIN      ] WSO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:25.556108] [DEBUG] [LOCAL     ] WSO: Loaded 26088 existing records from primary storage.
[2025-10-24T01:31:25.559266] [INFO ] [MAIN      ] WSO: Loaded 26088 primary data records.
[2025-10-24T01:31:25.600955] [INFO ] [MAIN      ] WSM: Generated 139 derivative records from 49047 primary records.
[2025-10-24T01:31:25.573246] [INFO ] [MAIN      ] WRBY: Generated 139 derivative records from 51034 primary records.
[2025-10-24T01:31:25.635236] [DEBUG] [LOCAL     ] WSM: Saving derivative data.
[2025-10-24T01:31:25.635123] [DEBUG] [LOCAL     ] WRBY: Saving derivative data.
[2025-10-24T01:31:25.694502] [DEBUG] [LOCAL     ] WSM: Derivative data saved (139 records).
[2025-10-24T01:31:25.705832] [INFO ] [MAIN      ] WSM: Successfully saved derivative data.
[2025-10-24T01:31:25.732078] [INFO ] [MAIN      ] Derivative Progress: 2117/2164 symbols completed. WSM took 1.4s. Estimated remaining: 19.6s. Rate: 143.6 symbols/min
[2025-10-24T01:31:25.758327] [INFO ] [MAIN      ] WSR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:25.758176] [DEBUG] [LOCAL     ] WRBY: Derivative data saved (139 records).
[2025-10-24T01:31:25.906701] [INFO ] [MAIN      ] WRBY: Successfully saved derivative data.
[2025-10-24T01:31:25.919481] [INFO ] [MAIN      ] Derivative Progress: 2118/2164 symbols completed. WRBY took 1.6s. Estimated remaining: 19.2s. Rate: 143.6 symbols/min
[2025-10-24T01:31:25.919865] [INFO ] [MAIN      ] WST: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:25.948153] [DEBUG] [LOCAL     ] WSR: Loaded 22684 existing records from primary storage.
[2025-10-24T01:31:25.948923] [INFO ] [MAIN      ] WSR: Loaded 22684 primary data records.
[2025-10-24T01:31:26.114017] [DEBUG] [MAIN      ] WSO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:26.168747] [DEBUG] [LOCAL     ] WST: Loaded 37059 existing records from primary storage.
[2025-10-24T01:31:26.347459] [INFO ] [MAIN      ] WST: Loaded 37059 primary data records.
[2025-10-24T01:31:26.789942] [INFO ] [MAIN      ] WSO: Generated 139 derivative records from 26088 primary records.
[2025-10-24T01:31:26.795606] [DEBUG] [LOCAL     ] WSO: Saving derivative data.
[2025-10-24T01:31:26.904800] [DEBUG] [MAIN      ] WSR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:26.943353] [DEBUG] [LOCAL     ] WSO: Derivative data saved (139 records).
[2025-10-24T01:31:26.945703] [INFO ] [MAIN      ] WSO: Successfully saved derivative data.
[2025-10-24T01:31:26.950903] [INFO ] [MAIN      ] Derivative Progress: 2119/2164 symbols completed. WSO took 1.4s. Estimated remaining: 18.8s. Rate: 143.5 symbols/min
[2025-10-24T01:31:26.954216] [INFO ] [MAIN      ] WT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:26.977155] [INFO ] [MAIN      ] WSR: Generated 139 derivative records from 22684 primary records.
[2025-10-24T01:31:26.977608] [DEBUG] [LOCAL     ] WSR: Saving derivative data.
[2025-10-24T01:31:26.995406] [DEBUG] [LOCAL     ] WSR: Derivative data saved (139 records).
[2025-10-24T01:31:26.996676] [INFO ] [MAIN      ] WSR: Successfully saved derivative data.
[2025-10-24T01:31:27.001141] [INFO ] [MAIN      ] Derivative Progress: 2120/2164 symbols completed. WSR took 1.2s. Estimated remaining: 18.4s. Rate: 143.6 symbols/min
[2025-10-24T01:31:27.001710] [INFO ] [MAIN      ] WTI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:27.030754] [DEBUG] [MAIN      ] WST: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:27.087433] [DEBUG] [LOCAL     ] WT: Loaded 48552 existing records from primary storage.
[2025-10-24T01:31:27.089861] [INFO ] [MAIN      ] WT: Loaded 48552 primary data records.
[2025-10-24T01:31:27.243727] [INFO ] [MAIN      ] WST: Generated 139 derivative records from 37059 primary records.
[2025-10-24T01:31:27.245233] [DEBUG] [LOCAL     ] WTI: Loaded 45096 existing records from primary storage.
[2025-10-24T01:31:27.262349] [DEBUG] [LOCAL     ] WST: Saving derivative data.
[2025-10-24T01:31:27.262577] [INFO ] [MAIN      ] WTI: Loaded 45096 primary data records.
[2025-10-24T01:31:27.548631] [DEBUG] [LOCAL     ] WST: Derivative data saved (139 records).
[2025-10-24T01:31:27.582634] [INFO ] [MAIN      ] WST: Successfully saved derivative data.
[2025-10-24T01:31:27.602697] [INFO ] [MAIN      ] Derivative Progress: 2121/2164 symbols completed. WST took 1.7s. Estimated remaining: 18.0s. Rate: 143.5 symbols/min
[2025-10-24T01:31:27.626815] [INFO ] [MAIN      ] WTRG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:27.820011] [DEBUG] [MAIN      ] WT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:27.869817] [DEBUG] [MAIN      ] WTI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:27.908501] [DEBUG] [LOCAL     ] WTRG: Loaded 51295 existing records from primary storage.
[2025-10-24T01:31:27.912477] [INFO ] [MAIN      ] WTRG: Loaded 51295 primary data records.
[2025-10-24T01:31:28.223441] [INFO ] [MAIN      ] WT: Generated 139 derivative records from 48552 primary records.
[2025-10-24T01:31:28.226741] [DEBUG] [LOCAL     ] WT: Saving derivative data.
[2025-10-24T01:31:28.243336] [DEBUG] [LOCAL     ] WT: Derivative data saved (139 records).
[2025-10-24T01:31:28.244123] [INFO ] [MAIN      ] WT: Successfully saved derivative data.
[2025-10-24T01:31:28.247089] [INFO ] [MAIN      ] Derivative Progress: 2122/2164 symbols completed. WT took 1.3s. Estimated remaining: 17.6s. Rate: 143.5 symbols/min
[2025-10-24T01:31:28.243495] [INFO ] [MAIN      ] WTI: Generated 139 derivative records from 45096 primary records.
[2025-10-24T01:31:28.247271] [INFO ] [MAIN      ] WTS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:28.247438] [DEBUG] [LOCAL     ] WTI: Saving derivative data.
[2025-10-24T01:31:28.261310] [DEBUG] [LOCAL     ] WTI: Derivative data saved (139 records).
[2025-10-24T01:31:28.261683] [INFO ] [MAIN      ] WTI: Successfully saved derivative data.
[2025-10-24T01:31:28.264901] [INFO ] [MAIN      ] Derivative Progress: 2123/2164 symbols completed. WTI took 1.3s. Estimated remaining: 17.1s. Rate: 143.6 symbols/min
[2025-10-24T01:31:28.265291] [INFO ] [MAIN      ] WTTR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:28.289323] [DEBUG] [MAIN      ] WTRG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:28.297295] [DEBUG] [LOCAL     ] WTS: Loaded 17345 existing records from primary storage.
[2025-10-24T01:31:28.310864] [INFO ] [MAIN      ] WTS: Loaded 17345 primary data records.
[2025-10-24T01:31:28.491738] [DEBUG] [LOCAL     ] WTTR: Loaded 44859 existing records from primary storage.
[2025-10-24T01:31:28.636313] [INFO ] [MAIN      ] WTTR: Loaded 44859 primary data records.
[2025-10-24T01:31:28.790609] [INFO ] [MAIN      ] WTRG: Generated 139 derivative records from 51295 primary records.
[2025-10-24T01:31:28.827711] [DEBUG] [LOCAL     ] WTRG: Saving derivative data.
[2025-10-24T01:31:29.009174] [DEBUG] [LOCAL     ] WTRG: Derivative data saved (139 records).
[2025-10-24T01:31:29.009450] [INFO ] [MAIN      ] WTRG: Successfully saved derivative data.
[2025-10-24T01:31:29.012578] [INFO ] [MAIN      ] Derivative Progress: 2124/2164 symbols completed. WTRG took 1.4s. Estimated remaining: 16.7s. Rate: 143.5 symbols/min
[2025-10-24T01:31:29.013992] [INFO ] [MAIN      ] WU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:29.033194] [DEBUG] [MAIN      ] WTS: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:31:29.093244] [DEBUG] [MAIN      ] WTTR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:29.126023] [INFO ] [MAIN      ] WTS: Generated 139 derivative records from 17345 primary records.
[2025-10-24T01:31:29.128294] [DEBUG] [LOCAL     ] WTS: Saving derivative data.
[2025-10-24T01:31:29.132454] [DEBUG] [LOCAL     ] WU: Loaded 53877 existing records from primary storage.
[2025-10-24T01:31:29.133109] [INFO ] [MAIN      ] WU: Loaded 53877 primary data records.
[2025-10-24T01:31:29.145479] [DEBUG] [LOCAL     ] WTS: Derivative data saved (139 records).
[2025-10-24T01:31:29.146068] [INFO ] [MAIN      ] WTS: Successfully saved derivative data.
[2025-10-24T01:31:29.168734] [INFO ] [MAIN      ] Derivative Progress: 2125/2164 symbols completed. WTS took 0.9s. Estimated remaining: 16.3s. Rate: 143.6 symbols/min
[2025-10-24T01:31:29.214089] [INFO ] [MAIN      ] WWW: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:29.455601] [INFO ] [MAIN      ] WTTR: Generated 139 derivative records from 44859 primary records.
[2025-10-24T01:31:29.455884] [DEBUG] [LOCAL     ] WTTR: Saving derivative data.
[2025-10-24T01:31:29.468959] [DEBUG] [LOCAL     ] WTTR: Derivative data saved (139 records).
[2025-10-24T01:31:29.469217] [INFO ] [MAIN      ] WTTR: Successfully saved derivative data.
[2025-10-24T01:31:29.472296] [INFO ] [MAIN      ] Derivative Progress: 2126/2164 symbols completed. WTTR took 1.2s. Estimated remaining: 15.9s. Rate: 143.6 symbols/min
[2025-10-24T01:31:29.472922] [INFO ] [MAIN      ] WY: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:29.508478] [DEBUG] [LOCAL     ] WWW: Loaded 49577 existing records from primary storage.
[2025-10-24T01:31:29.509228] [INFO ] [MAIN      ] WWW: Loaded 49577 primary data records.
[2025-10-24T01:31:29.765285] [DEBUG] [MAIN      ] WU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:29.865409] [DEBUG] [LOCAL     ] WY: Loaded 53597 existing records from primary storage.
[2025-10-24T01:31:29.866197] [INFO ] [MAIN      ] WY: Loaded 53597 primary data records.
[2025-10-24T01:31:30.189727] [INFO ] [MAIN      ] WU: Generated 139 derivative records from 53877 primary records.
[2025-10-24T01:31:30.189940] [DEBUG] [LOCAL     ] WU: Saving derivative data.
[2025-10-24T01:31:30.204482] [DEBUG] [LOCAL     ] WU: Derivative data saved (139 records).
[2025-10-24T01:31:30.205282] [INFO ] [MAIN      ] WU: Successfully saved derivative data.
[2025-10-24T01:31:30.209511] [INFO ] [MAIN      ] Derivative Progress: 2127/2164 symbols completed. WU took 1.2s. Estimated remaining: 15.5s. Rate: 143.5 symbols/min
[2025-10-24T01:31:30.211394] [INFO ] [MAIN      ] XFLT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:30.229978] [DEBUG] [MAIN      ] WWW: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:30.279519] [DEBUG] [LOCAL     ] XFLT: Loaded 30116 existing records from primary storage.
[2025-10-24T01:31:30.295107] [INFO ] [MAIN      ] XFLT: Loaded 30116 primary data records.
[2025-10-24T01:31:30.295921] [DEBUG] [MAIN      ] WY: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:30.445087] [INFO ] [MAIN      ] WWW: Generated 139 derivative records from 49577 primary records.
[2025-10-24T01:31:30.457092] [DEBUG] [LOCAL     ] WWW: Saving derivative data.
[2025-10-24T01:31:30.544669] [DEBUG] [LOCAL     ] WWW: Derivative data saved (139 records).
[2025-10-24T01:31:30.645021] [INFO ] [MAIN      ] WWW: Successfully saved derivative data.
[2025-10-24T01:31:30.664157] [INFO ] [MAIN      ] Derivative Progress: 2128/2164 symbols completed. WWW took 1.5s. Estimated remaining: 15.0s. Rate: 143.5 symbols/min
[2025-10-24T01:31:30.677352] [INFO ] [MAIN      ] WY: Generated 139 derivative records from 53597 primary records.
[2025-10-24T01:31:30.678199] [DEBUG] [LOCAL     ] WY: Saving derivative data.
[2025-10-24T01:31:30.692762] [DEBUG] [LOCAL     ] WY: Derivative data saved (139 records).
[2025-10-24T01:31:30.692867] [INFO ] [MAIN      ] WY: Successfully saved derivative data.
[2025-10-24T01:31:30.696525] [INFO ] [MAIN      ] Derivative Progress: 2129/2164 symbols completed. WY took 1.2s. Estimated remaining: 14.6s. Rate: 143.6 symbols/min
[2025-10-24T01:31:30.715527] [DEBUG] [MAIN      ] XFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:30.741172] [INFO ] [MAIN      ] XFLT: Generated 139 derivative records from 30116 primary records.
[2025-10-24T01:31:30.741321] [DEBUG] [LOCAL     ] XFLT: Saving derivative data.
[2025-10-24T01:31:30.752543] [DEBUG] [LOCAL     ] XFLT: Derivative data saved (139 records).
[2025-10-24T01:31:30.752627] [INFO ] [MAIN      ] XFLT: Successfully saved derivative data.
[2025-10-24T01:31:30.755938] [INFO ] [MAIN      ] Derivative Progress: 2130/2164 symbols completed. XFLT took 0.5s. Estimated remaining: 14.2s. Rate: 143.6 symbols/min
[2025-10-24T01:31:30.756506] [INFO ] [MAIN      ] XHR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:30.756592] [INFO ] [MAIN      ] XOM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:30.756699] [INFO ] [MAIN      ] XPER: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:30.801417] [DEBUG] [LOCAL     ] XPER: Loaded 30878 existing records from primary storage.
[2025-10-24T01:31:30.801692] [INFO ] [MAIN      ] XPER: Loaded 30878 primary data records.
[2025-10-24T01:31:30.889172] [DEBUG] [LOCAL     ] XHR: Loaded 43601 existing records from primary storage.
[2025-10-24T01:31:30.935194] [INFO ] [MAIN      ] XHR: Loaded 43601 primary data records.
[2025-10-24T01:31:31.296519] [DEBUG] [LOCAL     ] XOM: Loaded 54183 existing records from primary storage.
[2025-10-24T01:31:31.303213] [INFO ] [MAIN      ] XOM: Loaded 54183 primary data records.
[2025-10-24T01:31:31.885059] [DEBUG] [MAIN      ] XPER: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:31.923259] [DEBUG] [MAIN      ] XHR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:31.978891] [DEBUG] [MAIN      ] XOM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:31.998419] [INFO ] [MAIN      ] XPER: Generated 139 derivative records from 30878 primary records.
[2025-10-24T01:31:32.002854] [DEBUG] [LOCAL     ] XPER: Saving derivative data.
[2025-10-24T01:31:32.024525] [DEBUG] [LOCAL     ] XPER: Derivative data saved (139 records).
[2025-10-24T01:31:32.025086] [INFO ] [MAIN      ] XPER: Successfully saved derivative data.
[2025-10-24T01:31:32.027585] [INFO ] [MAIN      ] Derivative Progress: 2131/2164 symbols completed. XPER took 1.3s. Estimated remaining: 13.8s. Rate: 143.5 symbols/min
[2025-10-24T01:31:32.034221] [INFO ] [MAIN      ] XPEV: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:32.043719] [INFO ] [MAIN      ] XHR: Generated 139 derivative records from 43601 primary records.
[2025-10-24T01:31:32.046080] [DEBUG] [LOCAL     ] XHR: Saving derivative data.
[2025-10-24T01:31:32.067319] [DEBUG] [LOCAL     ] XHR: Derivative data saved (139 records).
[2025-10-24T01:31:32.068112] [INFO ] [MAIN      ] XHR: Successfully saved derivative data.
[2025-10-24T01:31:32.071682] [INFO ] [MAIN      ] Derivative Progress: 2132/2164 symbols completed. XHR took 1.3s. Estimated remaining: 13.4s. Rate: 143.6 symbols/min
[2025-10-24T01:31:32.074888] [INFO ] [MAIN      ] XPO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:32.084476] [INFO ] [MAIN      ] XOM: Generated 139 derivative records from 54183 primary records.
[2025-10-24T01:31:32.084990] [DEBUG] [LOCAL     ] XOM: Saving derivative data.
[2025-10-24T01:31:32.114440] [DEBUG] [LOCAL     ] XOM: Derivative data saved (139 records).
[2025-10-24T01:31:32.114810] [INFO ] [MAIN      ] XOM: Successfully saved derivative data.
[2025-10-24T01:31:32.118293] [INFO ] [MAIN      ] Derivative Progress: 2133/2164 symbols completed. XOM took 1.4s. Estimated remaining: 13.0s. Rate: 143.6 symbols/min
[2025-10-24T01:31:32.119146] [INFO ] [MAIN      ] XPOF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:32.140998] [DEBUG] [LOCAL     ] XPEV: Loaded 54006 existing records from primary storage.
[2025-10-24T01:31:32.141299] [INFO ] [MAIN      ] XPEV: Loaded 54006 primary data records.
[2025-10-24T01:31:32.308864] [DEBUG] [LOCAL     ] XPO: Loaded 47814 existing records from primary storage.
[2025-10-24T01:31:32.367475] [INFO ] [MAIN      ] XPO: Loaded 47814 primary data records.
[2025-10-24T01:31:32.520419] [DEBUG] [LOCAL     ] XPOF: Loaded 37137 existing records from primary storage.
[2025-10-24T01:31:32.559819] [INFO ] [MAIN      ] XPOF: Loaded 37137 primary data records.
[2025-10-24T01:31:33.255071] [DEBUG] [MAIN      ] XPEV: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:33.306537] [DEBUG] [MAIN      ] XPO: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:31:33.339555] [DEBUG] [MAIN      ] XPOF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:33.358717] [INFO ] [MAIN      ] XPEV: Generated 139 derivative records from 54006 primary records.
[2025-10-24T01:31:33.363289] [DEBUG] [LOCAL     ] XPEV: Saving derivative data.
[2025-10-24T01:31:33.386499] [DEBUG] [LOCAL     ] XPEV: Derivative data saved (139 records).
[2025-10-24T01:31:33.388024] [INFO ] [MAIN      ] XPEV: Successfully saved derivative data.
[2025-10-24T01:31:33.394112] [INFO ] [MAIN      ] Derivative Progress: 2134/2164 symbols completed. XPEV took 1.4s. Estimated remaining: 12.5s. Rate: 143.5 symbols/min
[2025-10-24T01:31:33.395516] [INFO ] [MAIN      ] XPRO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:33.410179] [INFO ] [MAIN      ] XPO: Generated 139 derivative records from 47814 primary records.
[2025-10-24T01:31:33.413135] [DEBUG] [LOCAL     ] XPO: Saving derivative data.
[2025-10-24T01:31:33.425346] [INFO ] [MAIN      ] XPOF: Generated 139 derivative records from 37137 primary records.
[2025-10-24T01:31:33.427781] [DEBUG] [LOCAL     ] XPOF: Saving derivative data.
[2025-10-24T01:31:33.430933] [DEBUG] [LOCAL     ] XPO: Derivative data saved (139 records).
[2025-10-24T01:31:33.438999] [INFO ] [MAIN      ] XPO: Successfully saved derivative data.
[2025-10-24T01:31:33.453933] [INFO ] [MAIN      ] Derivative Progress: 2135/2164 symbols completed. XPO took 1.4s. Estimated remaining: 12.1s. Rate: 143.5 symbols/min
[2025-10-24T01:31:33.457443] [DEBUG] [LOCAL     ] XPOF: Derivative data saved (139 records).
[2025-10-24T01:31:33.455911] [INFO ] [MAIN      ] XYF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:33.457763] [INFO ] [MAIN      ] XPOF: Successfully saved derivative data.
[2025-10-24T01:31:33.460868] [INFO ] [MAIN      ] Derivative Progress: 2136/2164 symbols completed. XPOF took 1.3s. Estimated remaining: 11.7s. Rate: 143.6 symbols/min
[2025-10-24T01:31:33.461236] [INFO ] [MAIN      ] XYL: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:33.480837] [DEBUG] [LOCAL     ] XPRO: Loaded 46174 existing records from primary storage.
[2025-10-24T01:31:33.481528] [INFO ] [MAIN      ] XPRO: Loaded 46174 primary data records.
[2025-10-24T01:31:33.633404] [DEBUG] [LOCAL     ] XYF: Loaded 27493 existing records from primary storage.
[2025-10-24T01:31:33.680774] [INFO ] [MAIN      ] XYF: Loaded 27493 primary data records.
[2025-10-24T01:31:33.925490] [DEBUG] [LOCAL     ] XYL: Loaded 47890 existing records from primary storage.
[2025-10-24T01:31:33.955520] [INFO ] [MAIN      ] XYL: Loaded 47890 primary data records.
[2025-10-24T01:31:34.509452] [DEBUG] [MAIN      ] XPRO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:34.546468] [DEBUG] [MAIN      ] XYF: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:31:34.596061] [DEBUG] [MAIN      ] XYL: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:34.626114] [INFO ] [MAIN      ] XPRO: Generated 139 derivative records from 46174 primary records.
[2025-10-24T01:31:34.629179] [DEBUG] [LOCAL     ] XPRO: Saving derivative data.
[2025-10-24T01:31:34.654420] [DEBUG] [LOCAL     ] XPRO: Derivative data saved (139 records).
[2025-10-24T01:31:34.656301] [INFO ] [MAIN      ] XPRO: Successfully saved derivative data.
[2025-10-24T01:31:34.658989] [INFO ] [MAIN      ] Derivative Progress: 2137/2164 symbols completed. XPRO took 1.3s. Estimated remaining: 11.3s. Rate: 143.5 symbols/min
[2025-10-24T01:31:34.662332] [INFO ] [MAIN      ] YALA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:34.663862] [INFO ] [MAIN      ] XYF: Generated 139 derivative records from 27493 primary records.
[2025-10-24T01:31:34.663992] [DEBUG] [LOCAL     ] XYF: Saving derivative data.
[2025-10-24T01:31:34.679376] [DEBUG] [LOCAL     ] XYF: Derivative data saved (139 records).
[2025-10-24T01:31:34.679681] [INFO ] [MAIN      ] XYF: Successfully saved derivative data.
[2025-10-24T01:31:34.682690] [INFO ] [MAIN      ] Derivative Progress: 2138/2164 symbols completed. XYF took 1.2s. Estimated remaining: 10.9s. Rate: 143.5 symbols/min
[2025-10-24T01:31:34.682993] [INFO ] [MAIN      ] YELP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:34.691169] [INFO ] [MAIN      ] XYL: Generated 139 derivative records from 47890 primary records.
[2025-10-24T01:31:34.691363] [DEBUG] [LOCAL     ] XYL: Saving derivative data.
[2025-10-24T01:31:34.713483] [DEBUG] [LOCAL     ] XYL: Derivative data saved (139 records).
[2025-10-24T01:31:34.713746] [INFO ] [MAIN      ] XYL: Successfully saved derivative data.
[2025-10-24T01:31:34.717172] [INFO ] [MAIN      ] Derivative Progress: 2139/2164 symbols completed. XYL took 1.3s. Estimated remaining: 10.4s. Rate: 143.6 symbols/min
[2025-10-24T01:31:34.717547] [INFO ] [MAIN      ] YETI: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:34.734423] [DEBUG] [LOCAL     ] YALA: Loaded 36512 existing records from primary storage.
[2025-10-24T01:31:34.743841] [INFO ] [MAIN      ] YALA: Loaded 36512 primary data records.
[2025-10-24T01:31:34.900927] [DEBUG] [LOCAL     ] YELP: Loaded 45479 existing records from primary storage.
[2025-10-24T01:31:35.085315] [INFO ] [MAIN      ] YELP: Loaded 45479 primary data records.
[2025-10-24T01:31:35.238773] [DEBUG] [LOCAL     ] YETI: Loaded 52897 existing records from primary storage.
[2025-10-24T01:31:35.261094] [INFO ] [MAIN      ] YETI: Loaded 52897 primary data records.
[2025-10-24T01:31:35.827227] [DEBUG] [MAIN      ] YALA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:35.868545] [DEBUG] [MAIN      ] YELP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:35.909816] [INFO ] [MAIN      ] YALA: Generated 139 derivative records from 36512 primary records.
[2025-10-24T01:31:35.910416] [DEBUG] [LOCAL     ] YALA: Saving derivative data.
[2025-10-24T01:31:35.927283] [DEBUG] [MAIN      ] YETI: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:35.956669] [DEBUG] [LOCAL     ] YALA: Derivative data saved (139 records).
[2025-10-24T01:31:35.958699] [INFO ] [MAIN      ] YALA: Successfully saved derivative data.
[2025-10-24T01:31:35.961931] [INFO ] [MAIN      ] YELP: Generated 139 derivative records from 45479 primary records.
[2025-10-24T01:31:35.962150] [DEBUG] [LOCAL     ] YELP: Saving derivative data.
[2025-10-24T01:31:35.966232] [INFO ] [MAIN      ] Derivative Progress: 2140/2164 symbols completed. YALA took 1.3s. Estimated remaining: 10.0s. Rate: 143.5 symbols/min
[2025-10-24T01:31:35.981174] [DEBUG] [LOCAL     ] YELP: Derivative data saved (139 records).
[2025-10-24T01:31:35.981337] [INFO ] [MAIN      ] YEXT: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:35.981503] [INFO ] [MAIN      ] YELP: Successfully saved derivative data.
[2025-10-24T01:31:35.984365] [INFO ] [MAIN      ] Derivative Progress: 2141/2164 symbols completed. YELP took 1.3s. Estimated remaining: 9.6s. Rate: 143.5 symbols/min
[2025-10-24T01:31:35.986050] [INFO ] [MAIN      ] YMM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:36.000910] [INFO ] [MAIN      ] YETI: Generated 139 derivative records from 52897 primary records.
[2025-10-24T01:31:36.001263] [DEBUG] [LOCAL     ] YETI: Saving derivative data.
[2025-10-24T01:31:36.014513] [DEBUG] [LOCAL     ] YETI: Derivative data saved (139 records).
[2025-10-24T01:31:36.014822] [INFO ] [MAIN      ] YETI: Successfully saved derivative data.
[2025-10-24T01:31:36.018716] [INFO ] [MAIN      ] Derivative Progress: 2142/2164 symbols completed. YETI took 1.3s. Estimated remaining: 9.2s. Rate: 143.6 symbols/min
[2025-10-24T01:31:36.019270] [INFO ] [MAIN      ] YOU: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:36.062917] [DEBUG] [LOCAL     ] YEXT: Loaded 43337 existing records from primary storage.
[2025-10-24T01:31:36.063237] [INFO ] [MAIN      ] YEXT: Loaded 43337 primary data records.
[2025-10-24T01:31:36.176482] [DEBUG] [LOCAL     ] YMM: Loaded 52966 existing records from primary storage.
[2025-10-24T01:31:36.198345] [INFO ] [MAIN      ] YMM: Loaded 52966 primary data records.
[2025-10-24T01:31:36.517623] [DEBUG] [LOCAL     ] YOU: Loaded 49826 existing records from primary storage.
[2025-10-24T01:31:36.518043] [INFO ] [MAIN      ] YOU: Loaded 49826 primary data records.
[2025-10-24T01:31:37.051254] [DEBUG] [MAIN      ] YEXT: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:37.089337] [DEBUG] [MAIN      ] YMM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:37.131166] [DEBUG] [MAIN      ] YOU: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:37.155344] [INFO ] [MAIN      ] YEXT: Generated 139 derivative records from 43337 primary records.
[2025-10-24T01:31:37.155867] [DEBUG] [LOCAL     ] YEXT: Saving derivative data.
[2025-10-24T01:31:37.175446] [DEBUG] [LOCAL     ] YEXT: Derivative data saved (139 records).
[2025-10-24T01:31:37.178240] [INFO ] [MAIN      ] YEXT: Successfully saved derivative data.
[2025-10-24T01:31:37.182368] [INFO ] [MAIN      ] Derivative Progress: 2143/2164 symbols completed. YEXT took 1.2s. Estimated remaining: 8.8s. Rate: 143.5 symbols/min
[2025-10-24T01:31:37.189557] [INFO ] [MAIN      ] YMM: Generated 139 derivative records from 52966 primary records.
[2025-10-24T01:31:37.191947] [DEBUG] [LOCAL     ] YMM: Saving derivative data.
[2025-10-24T01:31:37.210538] [DEBUG] [LOCAL     ] YMM: Derivative data saved (139 records).
[2025-10-24T01:31:37.209943] [INFO ] [MAIN      ] YOU: Generated 139 derivative records from 49826 primary records.
[2025-10-24T01:31:37.210631] [INFO ] [MAIN      ] YMM: Successfully saved derivative data.
[2025-10-24T01:31:37.210763] [DEBUG] [LOCAL     ] YOU: Saving derivative data.
[2025-10-24T01:31:37.213605] [INFO ] [MAIN      ] Derivative Progress: 2144/2164 symbols completed. YMM took 1.2s. Estimated remaining: 8.4s. Rate: 143.5 symbols/min
[2025-10-24T01:31:37.225465] [DEBUG] [LOCAL     ] YOU: Derivative data saved (139 records).
[2025-10-24T01:31:37.225559] [INFO ] [MAIN      ] YOU: Successfully saved derivative data.
[2025-10-24T01:31:37.228929] [INFO ] [MAIN      ] Derivative Progress: 2145/2164 symbols completed. YOU took 1.2s. Estimated remaining: 7.9s. Rate: 143.6 symbols/min
[2025-10-24T01:31:37.229341] [INFO ] [MAIN      ] YPF: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:37.229414] [INFO ] [MAIN      ] YSG: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:37.229489] [INFO ] [MAIN      ] YRD: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:37.253216] [DEBUG] [LOCAL     ] YRD: Loaded 11205 existing records from primary storage.
[2025-10-24T01:31:37.253580] [INFO ] [MAIN      ] YRD: Loaded 11205 primary data records.
[2025-10-24T01:31:37.355991] [DEBUG] [LOCAL     ] YSG: Loaded 25773 existing records from primary storage.
[2025-10-24T01:31:37.372580] [INFO ] [MAIN      ] YSG: Loaded 25773 primary data records.
[2025-10-24T01:31:37.810788] [DEBUG] [LOCAL     ] YPF: Loaded 51139 existing records from primary storage.
[2025-10-24T01:31:37.910258] [INFO ] [MAIN      ] YPF: Loaded 51139 primary data records.
[2025-10-24T01:31:38.239176] [DEBUG] [MAIN      ] YRD: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:38.276633] [DEBUG] [MAIN      ] YSG: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:38.334756] [DEBUG] [MAIN      ] YPF: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:38.362977] [INFO ] [MAIN      ] YRD: Generated 139 derivative records from 11205 primary records.
[2025-10-24T01:31:38.363374] [DEBUG] [LOCAL     ] YRD: Saving derivative data.
[2025-10-24T01:31:38.378331] [DEBUG] [LOCAL     ] YRD: Derivative data saved (139 records).
[2025-10-24T01:31:38.381662] [INFO ] [MAIN      ] YRD: Successfully saved derivative data.
[2025-10-24T01:31:38.388599] [INFO ] [MAIN      ] Derivative Progress: 2146/2164 symbols completed. YRD took 1.2s. Estimated remaining: 7.5s. Rate: 143.5 symbols/min
[2025-10-24T01:31:38.386014] [INFO ] [MAIN      ] YSG: Generated 139 derivative records from 25773 primary records.
[2025-10-24T01:31:38.388790] [INFO ] [MAIN      ] YUM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:38.389569] [DEBUG] [LOCAL     ] YSG: Saving derivative data.
[2025-10-24T01:31:38.405953] [DEBUG] [LOCAL     ] YSG: Derivative data saved (139 records).
[2025-10-24T01:31:38.408202] [INFO ] [MAIN      ] YSG: Successfully saved derivative data.
[2025-10-24T01:31:38.413483] [INFO ] [MAIN      ] Derivative Progress: 2147/2164 symbols completed. YSG took 1.2s. Estimated remaining: 7.1s. Rate: 143.6 symbols/min
[2025-10-24T01:31:38.414160] [INFO ] [MAIN      ] YUMC: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:38.417670] [INFO ] [MAIN      ] YPF: Generated 139 derivative records from 51139 primary records.
[2025-10-24T01:31:38.417775] [DEBUG] [LOCAL     ] YPF: Saving derivative data.
[2025-10-24T01:31:38.432141] [DEBUG] [LOCAL     ] YPF: Derivative data saved (139 records).
[2025-10-24T01:31:38.432302] [INFO ] [MAIN      ] YPF: Successfully saved derivative data.
[2025-10-24T01:31:38.435996] [INFO ] [MAIN      ] Derivative Progress: 2148/2164 symbols completed. YPF took 1.2s. Estimated remaining: 6.7s. Rate: 143.6 symbols/min
[2025-10-24T01:31:38.436476] [INFO ] [MAIN      ] ZBH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:38.492764] [DEBUG] [LOCAL     ] YUM: Loaded 51489 existing records from primary storage.
[2025-10-24T01:31:38.492931] [INFO ] [MAIN      ] YUM: Loaded 51489 primary data records.
[2025-10-24T01:31:38.632779] [DEBUG] [LOCAL     ] YUMC: Loaded 52963 existing records from primary storage.
[2025-10-24T01:31:38.649832] [INFO ] [MAIN      ] YUMC: Loaded 52963 primary data records.
[2025-10-24T01:31:38.933329] [DEBUG] [LOCAL     ] ZBH: Loaded 51035 existing records from primary storage.
[2025-10-24T01:31:38.945748] [INFO ] [MAIN      ] ZBH: Loaded 51035 primary data records.
[2025-10-24T01:31:39.517674] [DEBUG] [MAIN      ] YUM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:39.564119] [DEBUG] [MAIN      ] YUMC: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:39.586706] [INFO ] [MAIN      ] YUM: Generated 139 derivative records from 51489 primary records.
[2025-10-24T01:31:39.589803] [DEBUG] [LOCAL     ] YUM: Saving derivative data.
[2025-10-24T01:31:39.615105] [DEBUG] [MAIN      ] ZBH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:39.618004] [DEBUG] [LOCAL     ] YUM: Derivative data saved (139 records).
[2025-10-24T01:31:39.619377] [INFO ] [MAIN      ] YUM: Successfully saved derivative data.
[2025-10-24T01:31:39.622152] [INFO ] [MAIN      ] Derivative Progress: 2149/2164 symbols completed. YUM took 1.2s. Estimated remaining: 6.3s. Rate: 143.5 symbols/min
[2025-10-24T01:31:39.634355] [INFO ] [MAIN      ] ZEPP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:39.671056] [INFO ] [MAIN      ] YUMC: Generated 139 derivative records from 52963 primary records.
[2025-10-24T01:31:39.686858] [DEBUG] [LOCAL     ] ZEPP: Loaded 19786 existing records from primary storage.
[2025-10-24T01:31:39.682633] [DEBUG] [LOCAL     ] YUMC: Saving derivative data.
[2025-10-24T01:31:39.687455] [INFO ] [MAIN      ] ZEPP: Loaded 19786 primary data records.
[2025-10-24T01:31:39.746522] [DEBUG] [LOCAL     ] YUMC: Derivative data saved (139 records).
[2025-10-24T01:31:39.772888] [INFO ] [MAIN      ] ZBH: Generated 139 derivative records from 51035 primary records.
[2025-10-24T01:31:39.784799] [INFO ] [MAIN      ] YUMC: Successfully saved derivative data.
[2025-10-24T01:31:39.793872] [INFO ] [MAIN      ] Derivative Progress: 2150/2164 symbols completed. YUMC took 1.4s. Estimated remaining: 5.9s. Rate: 143.5 symbols/min
[2025-10-24T01:31:39.784682] [DEBUG] [LOCAL     ] ZBH: Saving derivative data.
[2025-10-24T01:31:39.808728] [INFO ] [MAIN      ] ZETA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:39.825086] [DEBUG] [LOCAL     ] ZBH: Derivative data saved (139 records).
[2025-10-24T01:31:39.835884] [INFO ] [MAIN      ] ZBH: Successfully saved derivative data.
[2025-10-24T01:31:39.850256] [INFO ] [MAIN      ] Derivative Progress: 2151/2164 symbols completed. ZBH took 1.4s. Estimated remaining: 5.4s. Rate: 143.6 symbols/min
[2025-10-24T01:31:39.855816] [INFO ] [MAIN      ] ZGN: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:40.105170] [DEBUG] [MAIN      ] ZEPP: Filtered 6966 bins outside market hours, 7760 incomplete bins
[2025-10-24T01:31:40.106982] [DEBUG] [LOCAL     ] ZGN: Loaded 41195 existing records from primary storage.
[2025-10-24T01:31:40.118021] [INFO ] [MAIN      ] ZGN: Loaded 41195 primary data records.
[2025-10-24T01:31:40.122736] [DEBUG] [LOCAL     ] ZETA: Loaded 54008 existing records from primary storage.
[2025-10-24T01:31:40.123088] [INFO ] [MAIN      ] ZETA: Loaded 54008 primary data records.
[2025-10-24T01:31:40.763564] [INFO ] [MAIN      ] ZEPP: Generated 139 derivative records from 19786 primary records.
[2025-10-24T01:31:40.764870] [DEBUG] [LOCAL     ] ZEPP: Saving derivative data.
[2025-10-24T01:31:40.777745] [DEBUG] [LOCAL     ] ZEPP: Derivative data saved (139 records).
[2025-10-24T01:31:40.777872] [INFO ] [MAIN      ] ZEPP: Successfully saved derivative data.
[2025-10-24T01:31:40.780739] [INFO ] [MAIN      ] Derivative Progress: 2152/2164 symbols completed. ZEPP took 1.1s. Estimated remaining: 5.0s. Rate: 143.5 symbols/min
[2025-10-24T01:31:40.782041] [INFO ] [MAIN      ] ZH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:40.827146] [DEBUG] [MAIN      ] ZGN: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:40.827714] [DEBUG] [MAIN      ] ZETA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:40.863982] [DEBUG] [LOCAL     ] ZH: Loaded 24766 existing records from primary storage.
[2025-10-24T01:31:40.864918] [INFO ] [MAIN      ] ZH: Loaded 24766 primary data records.
[2025-10-24T01:31:41.224232] [INFO ] [MAIN      ] ZETA: Generated 139 derivative records from 54008 primary records.
[2025-10-24T01:31:41.229477] [DEBUG] [LOCAL     ] ZETA: Saving derivative data.
[2025-10-24T01:31:41.247151] [DEBUG] [LOCAL     ] ZETA: Derivative data saved (139 records).
[2025-10-24T01:31:41.247748] [INFO ] [MAIN      ] ZGN: Generated 139 derivative records from 41195 primary records.
[2025-10-24T01:31:41.248109] [INFO ] [MAIN      ] ZETA: Successfully saved derivative data.
[2025-10-24T01:31:41.252276] [INFO ] [MAIN      ] Derivative Progress: 2153/2164 symbols completed. ZETA took 1.4s. Estimated remaining: 4.6s. Rate: 143.5 symbols/min
[2025-10-24T01:31:41.252529] [INFO ] [MAIN      ] ZIM: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:41.252608] [DEBUG] [LOCAL     ] ZGN: Saving derivative data.
[2025-10-24T01:31:41.266896] [DEBUG] [LOCAL     ] ZGN: Derivative data saved (139 records).
[2025-10-24T01:31:41.267429] [INFO ] [MAIN      ] ZGN: Successfully saved derivative data.
[2025-10-24T01:31:41.272066] [INFO ] [MAIN      ] Derivative Progress: 2154/2164 symbols completed. ZGN took 1.4s. Estimated remaining: 4.2s. Rate: 143.6 symbols/min
[2025-10-24T01:31:41.272329] [INFO ] [MAIN      ] ZIP: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:41.291272] [DEBUG] [MAIN      ] ZH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:41.352102] [INFO ] [MAIN      ] ZH: Generated 139 derivative records from 24766 primary records.
[2025-10-24T01:31:41.352367] [DEBUG] [LOCAL     ] ZH: Saving derivative data.
[2025-10-24T01:31:41.380311] [DEBUG] [LOCAL     ] ZH: Derivative data saved (139 records).
[2025-10-24T01:31:41.382818] [INFO ] [MAIN      ] ZH: Successfully saved derivative data.
[2025-10-24T01:31:41.400328] [INFO ] [MAIN      ] Derivative Progress: 2155/2164 symbols completed. ZH took 0.6s. Estimated remaining: 3.8s. Rate: 143.6 symbols/min
[2025-10-24T01:31:41.402842] [INFO ] [MAIN      ] ZK: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:41.405816] [DEBUG] [LOCAL     ] ZIP: Loaded 43737 existing records from primary storage.
[2025-10-24T01:31:41.406221] [INFO ] [MAIN      ] ZIP: Loaded 43737 primary data records.
[2025-10-24T01:31:41.418799] [DEBUG] [LOCAL     ] ZIM: Loaded 53836 existing records from primary storage.
[2025-10-24T01:31:41.438975] [INFO ] [MAIN      ] ZIM: Loaded 53836 primary data records.
[2025-10-24T01:31:41.912117] [DEBUG] [LOCAL     ] ZK: Loaded 39272 existing records from primary storage.
[2025-10-24T01:31:41.964231] [INFO ] [MAIN      ] ZK: Loaded 39272 primary data records.
[2025-10-24T01:31:42.449502] [DEBUG] [MAIN      ] ZIM: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:42.451777] [DEBUG] [MAIN      ] ZIP: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:42.531379] [DEBUG] [MAIN      ] ZK: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:42.574935] [INFO ] [MAIN      ] ZIM: Generated 139 derivative records from 53836 primary records.
[2025-10-24T01:31:42.578229] [DEBUG] [LOCAL     ] ZIM: Saving derivative data.
[2025-10-24T01:31:42.583753] [INFO ] [MAIN      ] ZIP: Generated 139 derivative records from 43737 primary records.
[2025-10-24T01:31:42.596529] [DEBUG] [LOCAL     ] ZIM: Derivative data saved (139 records).
[2025-10-24T01:31:42.602457] [DEBUG] [LOCAL     ] ZIP: Saving derivative data.
[2025-10-24T01:31:42.603118] [INFO ] [MAIN      ] ZIM: Successfully saved derivative data.
[2025-10-24T01:31:42.607937] [INFO ] [MAIN      ] Derivative Progress: 2156/2164 symbols completed. ZIM took 1.4s. Estimated remaining: 3.3s. Rate: 143.5 symbols/min
[2025-10-24T01:31:42.617354] [INFO ] [MAIN      ] ZKH: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:42.622950] [DEBUG] [LOCAL     ] ZIP: Derivative data saved (139 records).
[2025-10-24T01:31:42.627136] [INFO ] [MAIN      ] ZIP: Successfully saved derivative data.
[2025-10-24T01:31:42.631811] [INFO ] [MAIN      ] Derivative Progress: 2157/2164 symbols completed. ZIP took 1.4s. Estimated remaining: 2.9s. Rate: 143.5 symbols/min
[2025-10-24T01:31:42.632142] [INFO ] [MAIN      ] ZTO: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:42.645362] [INFO ] [MAIN      ] ZK: Generated 139 derivative records from 39272 primary records.
[2025-10-24T01:31:42.650396] [DEBUG] [LOCAL     ] ZKH: Loaded 7354 existing records from primary storage.
[2025-10-24T01:31:42.650851] [INFO ] [MAIN      ] ZKH: Loaded 7354 primary data records.
[2025-10-24T01:31:42.650915] [DEBUG] [LOCAL     ] ZK: Saving derivative data.
[2025-10-24T01:31:42.732873] [DEBUG] [LOCAL     ] ZK: Derivative data saved (139 records).
[2025-10-24T01:31:42.773126] [INFO ] [MAIN      ] ZK: Successfully saved derivative data.
[2025-10-24T01:31:42.796454] [INFO ] [MAIN      ] Derivative Progress: 2158/2164 symbols completed. ZK took 1.4s. Estimated remaining: 2.5s. Rate: 143.6 symbols/min
[2025-10-24T01:31:42.917781] [DEBUG] [LOCAL     ] ZTO: Loaded 49634 existing records from primary storage.
[2025-10-24T01:31:43.024522] [INFO ] [MAIN      ] ZTO: Loaded 49634 primary data records.
[2025-10-24T01:31:43.365738] [DEBUG] [MAIN      ] ZKH: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:43.404933] [INFO ] [MAIN      ] ZKH: Generated 139 derivative records from 7354 primary records.
[2025-10-24T01:31:43.405379] [DEBUG] [LOCAL     ] ZKH: Saving derivative data.
[2025-10-24T01:31:43.416968] [DEBUG] [LOCAL     ] ZKH: Derivative data saved (139 records).
[2025-10-24T01:31:43.417188] [INFO ] [MAIN      ] ZKH: Successfully saved derivative data.
[2025-10-24T01:31:43.421346] [INFO ] [MAIN      ] Derivative Progress: 2159/2164 symbols completed. ZKH took 0.8s. Estimated remaining: 2.1s. Rate: 143.6 symbols/min
[2025-10-24T01:31:43.439406] [DEBUG] [MAIN      ] ZTO: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:43.469932] [INFO ] [MAIN      ] ZTO: Generated 139 derivative records from 49634 primary records.
[2025-10-24T01:31:43.470198] [DEBUG] [LOCAL     ] ZTO: Saving derivative data.
[2025-10-24T01:31:43.483220] [DEBUG] [LOCAL     ] ZTO: Derivative data saved (139 records).
[2025-10-24T01:31:43.483333] [INFO ] [MAIN      ] ZTO: Successfully saved derivative data.
[2025-10-24T01:31:43.488240] [INFO ] [MAIN      ] Derivative Progress: 2160/2164 symbols completed. ZTO took 0.9s. Estimated remaining: 1.7s. Rate: 143.6 symbols/min
[2025-10-24T01:31:43.489040] [INFO ] [MAIN      ] ZTR: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:43.489128] [INFO ] [MAIN      ] ZTS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:43.489190] [INFO ] [MAIN      ] ZVIA: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:43.518368] [DEBUG] [LOCAL     ] ZTR: Loaded 16659 existing records from primary storage.
[2025-10-24T01:31:43.518752] [INFO ] [MAIN      ] ZTR: Loaded 16659 primary data records.
[2025-10-24T01:31:43.688484] [DEBUG] [LOCAL     ] ZVIA: Loaded 36071 existing records from primary storage.
[2025-10-24T01:31:43.706636] [INFO ] [MAIN      ] ZVIA: Loaded 36071 primary data records.
[2025-10-24T01:31:43.903535] [DEBUG] [LOCAL     ] ZTS: Loaded 53500 existing records from primary storage.
[2025-10-24T01:31:43.984403] [INFO ] [MAIN      ] ZTS: Loaded 53500 primary data records.
[2025-10-24T01:31:44.695708] [DEBUG] [MAIN      ] ZTR: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:44.764886] [DEBUG] [MAIN      ] ZTS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:44.793908] [DEBUG] [MAIN      ] ZVIA: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:44.798272] [INFO ] [MAIN      ] ZTR: Generated 139 derivative records from 16659 primary records.
[2025-10-24T01:31:44.812230] [DEBUG] [LOCAL     ] ZTR: Saving derivative data.
[2025-10-24T01:31:44.835374] [DEBUG] [LOCAL     ] ZTR: Derivative data saved (139 records).
[2025-10-24T01:31:44.836390] [INFO ] [MAIN      ] ZTR: Successfully saved derivative data.
[2025-10-24T01:31:44.839544] [INFO ] [MAIN      ] Derivative Progress: 2161/2164 symbols completed. ZTR took 1.4s. Estimated remaining: 1.3s. Rate: 143.5 symbols/min
[2025-10-24T01:31:44.846891] [INFO ] [MAIN      ] ZWS: Starting derivative data generation with 30-minute intervals.
[2025-10-24T01:31:44.878894] [INFO ] [MAIN      ] ZTS: Generated 139 derivative records from 53500 primary records.
[2025-10-24T01:31:44.882776] [DEBUG] [LOCAL     ] ZTS: Saving derivative data.
[2025-10-24T01:31:44.901692] [DEBUG] [LOCAL     ] ZTS: Derivative data saved (139 records).
[2025-10-24T01:31:44.902063] [INFO ] [MAIN      ] ZTS: Successfully saved derivative data.
[2025-10-24T01:31:44.919538] [INFO ] [MAIN      ] Derivative Progress: 2162/2164 symbols completed. ZTS took 1.4s. Estimated remaining: 0.8s. Rate: 143.5 symbols/min
[2025-10-24T01:31:44.924786] [INFO ] [MAIN      ] ZVIA: Generated 139 derivative records from 36071 primary records.
[2025-10-24T01:31:44.925318] [DEBUG] [LOCAL     ] ZVIA: Saving derivative data.
[2025-10-24T01:31:44.954457] [DEBUG] [LOCAL     ] ZVIA: Derivative data saved (139 records).
[2025-10-24T01:31:44.954760] [INFO ] [MAIN      ] ZVIA: Successfully saved derivative data.
[2025-10-24T01:31:44.955537] [DEBUG] [LOCAL     ] ZWS: Loaded 42439 existing records from primary storage.
[2025-10-24T01:31:44.961209] [INFO ] [MAIN      ] ZWS: Loaded 42439 primary data records.
[2025-10-24T01:31:44.961081] [INFO ] [MAIN      ] Derivative Progress: 2163/2164 symbols completed. ZVIA took 1.5s. Estimated remaining: 0.4s. Rate: 143.6 symbols/min
[2025-10-24T01:31:45.274746] [DEBUG] [MAIN      ] ZWS: Filtered 6966 bins outside market hours, 7759 incomplete bins
[2025-10-24T01:31:45.302834] [INFO ] [MAIN      ] ZWS: Generated 139 derivative records from 42439 primary records.
[2025-10-24T01:31:45.303036] [DEBUG] [LOCAL     ] ZWS: Saving derivative data.
[2025-10-24T01:31:45.314835] [DEBUG] [LOCAL     ] ZWS: Derivative data saved (139 records).
[2025-10-24T01:31:45.314917] [INFO ] [MAIN      ] ZWS: Successfully saved derivative data.
[2025-10-24T01:31:45.317924] [INFO ] [MAIN      ] Derivative Progress: 2164/2164 symbols completed. ZWS took 0.5s. Estimated remaining: 0.0s. Rate: 143.6 symbols/min
[2025-10-24T01:31:45.319049] [INFO ] [MAIN      ] Parallel derivative generation completed in 15m 4s
[2025-10-24T01:31:45.319479] [INFO ] [MAIN      ] Derivative generation success rate: 100.0% (2164/2164 symbols)
[2025-10-24T01:31:48.222628] [DEBUG] [EMAIL     ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2164/2164 @ 100.00%)'
[2025-10-24T17:00:00.840782] [INFO ] [MAIN      ] Using last completed trading day: 2025-10-24
[2025-10-24T17:00:01.020220] [DEBUG] [R-STATUS  ] Registered 'tdm' as a dependent service.
[2025-10-24T17:00:01.020386] [INFO ] [STATE     ] Waiting for all dependent services to be clear...
[2025-10-24T17:00:01.223737] [WARN ] [tdm-status] Service 'tdm' is not running.
[2025-10-24T17:00:01.224071] [WARN ] [STATE     ] State set to: RUNNING
[2025-10-24T17:00:01.224149] [INFO ] [MAIN      ] Refreshing symbols list before update...
[2025-10-24T17:00:01.224192] [INFO ] [MAIN      ] Starting TDM symbol refresh process.
[2025-10-24T17:00:01.224270] [INFO ] [MAIN      ] Fetching latest NYSE symbols list.
[2025-10-24T17:00:01.224306] [DEBUG] [SYMBOL    ] Starting fetch of NYSE Symbols.
[2025-10-24T17:00:02.826916] [DEBUG] [SYMBOL    ] Found 2418 valid NYSE symbols.
[2025-10-24T17:00:02.827186] [INFO ] [SYMBOL    ] Completed fetch of NYSE Symbols.
[2025-10-24T17:00:02.827506] [INFO ] [MAIN      ] Filtered out 54 blacklisted symbols.
[2025-10-24T17:00:02.828318] [INFO ] [LOCAL     ] Symbols cache updated with 2366 symbols.
[2025-10-24T17:00:02.828396] [INFO ] [MAIN      ] Successfully refreshed symbols list.
[2025-10-24T17:00:02.828452] [INFO ] [MAIN      ] Finished TDM symbol refresh process.
[2025-10-24T17:00:02.828548] [INFO ] [MAIN      ] Pruning stale symbols...
[2025-10-24T17:00:02.828686] [INFO ] [MAIN      ] Starting TDM stale symbol pruning process.
[2025-10-24T17:00:02.828757] [INFO ] [LOCAL     ] Reading cached symbols list.
[2025-10-24T17:00:02.829327] [DEBUG] [LOCAL     ] Found 2366 symbols in cached list.
[2025-10-24T17:00:02.829394] [INFO ] [LOCAL     ] Completed reading cached symbols list.
[2025-10-24T17:00:02.829635] [INFO ] [MAIN      ] Including 54 blacklisted symbols for pruning.
[2025-10-24T17:00:02.829746] [INFO ] [MAIN      ] Pruning data for symbols not in current list of 2366 valid symbols.
[2025-10-24T17:00:02.829801] [INFO ] [LOCAL     ] Starting pruning of local symbol history data for inactive/invalid symbols.
[2025-10-24T17:00:02.829856] [DEBUG] [LOCAL     ] Checking directory: '/opt/tdm/output/data/primary_storage'
[2025-10-24T17:00:02.833802] [DEBUG] [LOCAL     ] Deleted /opt/tdm/output/data/primary_storage/MLNK.csv (symbol MLNK no longer active).
[2025-10-24T17:00:02.870496] [DEBUG] [LOCAL     ] Checking directory: '/opt/tdm/output/data/derivative_storage'
[2025-10-24T17:00:02.872739] [DEBUG] [LOCAL     ] Deleted /opt/tdm/output/data/derivative_storage/MLNK.csv (symbol MLNK no longer active).
[2025-10-24T17:00:02.897292] [INFO ] [LOCAL     ] Deleted 2 obsolete data files.
[2025-10-24T17:00:02.897484] [INFO ] [LOCAL     ] Completed pruning of unlisted local symbol history data.
[2025-10-24T17:00:02.897525] [INFO ] [MAIN      ] Successfully pruned stale symbol data.
[2025-10-24T17:00:02.897730] [INFO ] [MAIN      ] Finished TDM stale symbol pruning process.
[2025-10-24T17:00:02.897814] [INFO ] [LOCAL     ] Reading cached symbols list.
[2025-10-24T17:00:02.898184] [DEBUG] [LOCAL     ] Found 2366 symbols in cached list.
[2025-10-24T17:00:02.898221] [INFO ] [LOCAL     ] Completed reading cached symbols list.
[2025-10-24T17:00:02.898275] [INFO ] [MAIN      ] Starting incremental update for 2366 symbols.
[2025-10-24T17:00:02.898304] [INFO ] [MAIN      ] Running in parallel mode
[2025-10-24T17:00:02.898476] [INFO ] [MAIN      ] Starting parallel primary update with 4 worker threads for 2366 symbols
[2025-10-24T17:00:03.486502] [INFO ] [MAIN      ] AA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:03.635755] [INFO ] [MAIN      ] AAMI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:03.636633] [INFO ] [MAIN      ] A: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:03.658459] [INFO ] [MAIN      ] AAM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:03.660720] [DEBUG] [LOCAL     ] AAM: No existing data file found in primary storage.
[2025-10-24T17:00:03.660831] [WARN ] [MAIN      ] AAM: No existing data found, performing full refresh instead.
[2025-10-24T17:00:03.660954] [INFO ] [MAIN      ] AAM: Wiping existing primary data before full refresh.
[2025-10-24T17:00:03.660999] [INFO ] [LOCAL     ] AAM: Starting deletion of primary data.
[2025-10-24T17:00:03.661143] [DEBUG] [LOCAL     ] AAM: No primary data file found to delete.
[2025-10-24T17:00:03.661198] [INFO ] [MAIN      ] AAM: Starting full primary refresh.
[2025-10-24T17:00:03.917426] [DEBUG] [LOCAL     ] AAMI: Loaded 24527 existing records from primary storage.
[2025-10-24T17:00:03.979542] [INFO ] [MAIN      ] AAMI: Loaded 24527 existing records.
[2025-10-24T17:00:04.021038] [DEBUG] [LOCAL     ] AA: Loaded 54012 existing records from primary storage.
[2025-10-24T17:00:04.123957] [INFO ] [MAIN      ] AA: Loaded 54012 existing records.
[2025-10-24T17:00:04.250056] [DEBUG] [LOCAL     ] A: Loaded 51001 existing records from primary storage.
[2025-10-24T17:00:04.284206] [INFO ] [REMOTE    ] AAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:04.304395] [INFO ] [REMOTE    ] AAM: Fetching primary data for 2025-01.
[2025-10-24T17:00:04.320009] [INFO ] [MAIN      ] A: Loaded 51001 existing records.
[2025-10-24T17:00:04.542864] [WARN ] [MAIN      ] AAMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:04.554735] [INFO ] [MAIN      ] AAMI: Wiping existing primary data before full refresh.
[2025-10-24T17:00:04.574196] [INFO ] [LOCAL     ] AAMI: Starting deletion of primary data.
[2025-10-24T17:00:04.610891] [DEBUG] [LOCAL     ] AAMI: Deleted primary data file.
[2025-10-24T17:00:04.670426] [INFO ] [MAIN      ] AAMI: Starting full primary refresh.
[2025-10-24T17:00:04.711004] [WARN ] [MAIN      ] AA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:04.810093] [INFO ] [MAIN      ] AA: Wiping existing primary data before full refresh.
[2025-10-24T17:00:04.776112] [WARN ] [MAIN      ] A: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:04.815487] [INFO ] [LOCAL     ] AA: Starting deletion of primary data.
[2025-10-24T17:00:04.823011] [DEBUG] [LOCAL     ] AA: Deleted primary data file.
[2025-10-24T17:00:04.823096] [INFO ] [MAIN      ] A: Wiping existing primary data before full refresh.
[2025-10-24T17:00:04.828382] [INFO ] [MAIN      ] AA: Starting full primary refresh.
[2025-10-24T17:00:04.833670] [INFO ] [LOCAL     ] A: Starting deletion of primary data.
[2025-10-24T17:00:04.908952] [DEBUG] [LOCAL     ] A: Deleted primary data file.
[2025-10-24T17:00:04.958532] [INFO ] [MAIN      ] A: Starting full primary refresh.
[2025-10-24T17:00:05.636194] [INFO ] [REMOTE    ] AAMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:05.747512] [INFO ] [REMOTE    ] AAMI: Fetching primary data for 2025-01.
[2025-10-24T17:00:05.883242] [INFO ] [REMOTE    ] AA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:05.902871] [INFO ] [REMOTE    ] AA: Fetching primary data for 2025-01.
[2025-10-24T17:00:05.939840] [INFO ] [REMOTE    ] A: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:05.940163] [INFO ] [REMOTE    ] A: Fetching primary data for 2025-01.
[2025-10-24T17:00:06.271997] [INFO ] [REMOTE    ] AAM: Incremental fetch complete for 2025-01 (1.97 seconds).
[2025-10-24T17:00:06.272924] [INFO ] [REMOTE    ] AAM: Fetching primary data for 2025-02.
[2025-10-24T17:00:07.453622] [INFO ] [REMOTE    ] AAM: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T17:00:07.455030] [INFO ] [REMOTE    ] AAM: Fetching primary data for 2025-03.
[2025-10-24T17:00:07.597946] [INFO ] [REMOTE    ] AAMI: Incremental fetch complete for 2025-01 (1.85 seconds).
[2025-10-24T17:00:07.601700] [INFO ] [REMOTE    ] AAMI: Fetching primary data for 2025-02.
[2025-10-24T17:00:08.797012] [INFO ] [REMOTE    ] AAM: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T17:00:08.798328] [INFO ] [REMOTE    ] AAM: Fetching primary data for 2025-04.
[2025-10-24T17:00:08.859000] [INFO ] [REMOTE    ] AA: Incremental fetch complete for 2025-01 (2.96 seconds).
[2025-10-24T17:00:08.869431] [INFO ] [REMOTE    ] AA: Fetching primary data for 2025-02.
[2025-10-24T17:00:09.219325] [INFO ] [REMOTE    ] AAM: Incremental fetch complete for 2025-04 (0.42 seconds).
[2025-10-24T17:00:09.220632] [INFO ] [REMOTE    ] AAM: Fetching primary data for 2025-05.
[2025-10-24T17:00:09.329380] [INFO ] [REMOTE    ] A: Incremental fetch complete for 2025-01 (3.39 seconds).
[2025-10-24T17:00:09.339086] [INFO ] [REMOTE    ] A: Fetching primary data for 2025-02.
[2025-10-24T17:00:09.380296] [INFO ] [REMOTE    ] AAMI: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T17:00:09.384199] [INFO ] [REMOTE    ] AAMI: Fetching primary data for 2025-03.
[2025-10-24T17:00:09.478150] [INFO ] [REMOTE    ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds).
[2025-10-24T17:00:09.479378] [INFO ] [REMOTE    ] AAM: Fetching primary data for 2025-06.
[2025-10-24T17:00:09.816422] [INFO ] [REMOTE    ] AAM: Incremental fetch complete for 2025-06 (0.34 seconds).
[2025-10-24T17:00:09.817281] [INFO ] [REMOTE    ] AAM: Fetching primary data for 2025-07.
[2025-10-24T17:00:10.266190] [INFO ] [REMOTE    ] AAM: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T17:00:10.267082] [INFO ] [REMOTE    ] AAM: Fetching primary data for 2025-08.
[2025-10-24T17:00:10.928054] [INFO ] [REMOTE    ] AAM: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T17:00:10.929266] [INFO ] [REMOTE    ] AAM: Fetching primary data for 2025-09.
[2025-10-24T17:00:10.945292] [INFO ] [REMOTE    ] AAMI: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T17:00:10.950987] [INFO ] [REMOTE    ] AAMI: Fetching primary data for 2025-04.
[2025-10-24T17:00:11.111340] [INFO ] [REMOTE    ] AA: Incremental fetch complete for 2025-02 (2.24 seconds).
[2025-10-24T17:00:11.121671] [INFO ] [REMOTE    ] AA: Fetching primary data for 2025-03.
[2025-10-24T17:00:11.231130] [INFO ] [REMOTE    ] AAM: Incremental fetch complete for 2025-09 (0.30 seconds).
[2025-10-24T17:00:11.232042] [INFO ] [REMOTE    ] AAM: Fetching primary data for 2025-10.
[2025-10-24T17:00:11.410118] [INFO ] [REMOTE    ] A: Incremental fetch complete for 2025-02 (2.07 seconds).
[2025-10-24T17:00:11.419702] [INFO ] [REMOTE    ] A: Fetching primary data for 2025-03.
[2025-10-24T17:00:12.588040] [INFO ] [REMOTE    ] AAMI: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T17:00:12.597992] [INFO ] [REMOTE    ] AAMI: Fetching primary data for 2025-05.
[2025-10-24T17:00:13.120196] [INFO ] [REMOTE    ] A: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T17:00:13.131116] [INFO ] [REMOTE    ] A: Fetching primary data for 2025-04.
[2025-10-24T17:00:13.163633] [INFO ] [REMOTE    ] AA: Incremental fetch complete for 2025-03 (2.04 seconds).
[2025-10-24T17:00:13.174868] [INFO ] [REMOTE    ] AA: Fetching primary data for 2025-04.
[2025-10-24T17:00:13.459246] [INFO ] [REMOTE    ] AAMI: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T17:00:13.464612] [INFO ] [REMOTE    ] AAMI: Fetching primary data for 2025-06.
[2025-10-24T17:00:13.768246] [INFO ] [REMOTE    ] AAM: Incremental fetch complete for 2025-10 (2.54 seconds).
[2025-10-24T17:00:13.768951] [INFO ] [REMOTE    ] AAM: Full fetch complete (909 records).
[2025-10-24T17:00:13.769024] [DEBUG] [VALIDATOR ] AAM: Validating primary data.
[2025-10-24T17:00:13.769369] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:00:13.769454] [FATAL] [MAIN      ] AAM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:00:13.769497] [WARN ] [MAIN      ] AAM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:00:13.769560] [INFO ] [LOCAL     ] AAM: Starting deletion of primary data.
[2025-10-24T17:00:13.769626] [DEBUG] [LOCAL     ] AAM: No primary data file found to delete.
[2025-10-24T17:00:13.769707] [INFO ] [LOCAL     ] AAM: Starting deletion of derivative data.
[2025-10-24T17:00:13.769768] [DEBUG] [LOCAL     ] AAM: No derivative data file found to delete.
[2025-10-24T17:00:13.769824] [INFO ] [MAIN      ] Update Progress: 1/2366 symbols completed. AAM took 10.9s. Estimated remaining: 7h 8m 31s. Rate: 5.5 symbols/min
[2025-10-24T17:00:13.939739] [INFO ] [MAIN      ] AAP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:13.990368] [DEBUG] [LOCAL     ] AAP: Loaded 52090 existing records from primary storage.
[2025-10-24T17:00:13.990711] [INFO ] [MAIN      ] AAP: Loaded 52090 existing records.
[2025-10-24T17:00:14.172136] [WARN ] [MAIN      ] AAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:14.172414] [INFO ] [MAIN      ] AAP: Wiping existing primary data before full refresh.
[2025-10-24T17:00:14.172495] [INFO ] [LOCAL     ] AAP: Starting deletion of primary data.
[2025-10-24T17:00:14.173481] [DEBUG] [LOCAL     ] AAP: Deleted primary data file.
[2025-10-24T17:00:14.173542] [INFO ] [MAIN      ] AAP: Starting full primary refresh.
[2025-10-24T17:00:14.332566] [INFO ] [REMOTE    ] AAMI: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T17:00:14.417848] [INFO ] [REMOTE    ] AAMI: Fetching primary data for 2025-07.
[2025-10-24T17:00:14.552352] [INFO ] [REMOTE    ] AAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:14.552692] [INFO ] [REMOTE    ] AAP: Fetching primary data for 2025-01.
[2025-10-24T17:00:14.856525] [INFO ] [REMOTE    ] A: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T17:00:14.868039] [INFO ] [REMOTE    ] A: Fetching primary data for 2025-05.
[2025-10-24T17:00:15.359424] [INFO ] [REMOTE    ] AA: Incremental fetch complete for 2025-04 (2.18 seconds).
[2025-10-24T17:00:15.373581] [INFO ] [REMOTE    ] AA: Fetching primary data for 2025-05.
[2025-10-24T17:00:15.768500] [INFO ] [REMOTE    ] AAMI: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T17:00:15.774444] [INFO ] [REMOTE    ] AAMI: Fetching primary data for 2025-08.
[2025-10-24T17:00:16.259356] [INFO ] [REMOTE    ] AAP: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T17:00:16.269509] [INFO ] [REMOTE    ] AAP: Fetching primary data for 2025-02.
[2025-10-24T17:00:16.492989] [INFO ] [REMOTE    ] A: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T17:00:16.507066] [INFO ] [REMOTE    ] A: Fetching primary data for 2025-06.
[2025-10-24T17:00:16.701685] [INFO ] [REMOTE    ] AAMI: Incremental fetch complete for 2025-08 (0.93 seconds).
[2025-10-24T17:00:16.707018] [INFO ] [REMOTE    ] AAMI: Fetching primary data for 2025-09.
[2025-10-24T17:00:17.578539] [INFO ] [REMOTE    ] AA: Incremental fetch complete for 2025-05 (2.20 seconds).
[2025-10-24T17:00:17.591177] [INFO ] [REMOTE    ] AA: Fetching primary data for 2025-06.
[2025-10-24T17:00:17.914805] [INFO ] [REMOTE    ] AAP: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T17:00:17.929083] [INFO ] [REMOTE    ] AAP: Fetching primary data for 2025-03.
[2025-10-24T17:00:17.971821] [INFO ] [REMOTE    ] AAMI: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T17:00:17.979624] [INFO ] [REMOTE    ] AAMI: Fetching primary data for 2025-10.
[2025-10-24T17:00:18.635578] [INFO ] [REMOTE    ] A: Incremental fetch complete for 2025-06 (2.13 seconds).
[2025-10-24T17:00:18.645805] [INFO ] [REMOTE    ] A: Fetching primary data for 2025-07.
[2025-10-24T17:00:19.031265] [INFO ] [REMOTE    ] AA: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T17:00:19.042016] [INFO ] [REMOTE    ] AA: Fetching primary data for 2025-07.
[2025-10-24T17:00:19.362431] [INFO ] [REMOTE    ] AAMI: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T17:00:19.367226] [INFO ] [REMOTE    ] AAMI: Full fetch complete (33081 records).
[2025-10-24T17:00:19.367402] [DEBUG] [VALIDATOR ] AAMI: Validating primary data.
[2025-10-24T17:00:19.806336] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present.
[2025-10-24T17:00:19.806517] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed.
[2025-10-24T17:00:19.806990] [INFO ] [MAIN      ] AAMI: Fetched primary data is valid.
[2025-10-24T17:00:19.807102] [DEBUG] [LOCAL     ] AAMI: Saving primary data.
[2025-10-24T17:00:19.807634] [FATAL] [LOCAL     ] AAMI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:00:19.807862] [FATAL] [MAIN      ] AAMI: Failed to save primary data.
[2025-10-24T17:00:19.808206] [WARN ] [MAIN      ] AAMI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:00:19.808281] [INFO ] [LOCAL     ] AAMI: Starting deletion of primary data.
[2025-10-24T17:00:19.808344] [DEBUG] [LOCAL     ] AAMI: No primary data file found to delete.
[2025-10-24T17:00:19.808384] [INFO ] [LOCAL     ] AAMI: Starting deletion of derivative data.
[2025-10-24T17:00:19.808686] [DEBUG] [LOCAL     ] AAMI: Deleted derivative data file.
[2025-10-24T17:00:19.808842] [INFO ] [MAIN      ] Update Progress: 2/2366 symbols completed. AAMI took 16.9s. Estimated remaining: 5h 33m 8s. Rate: 7.1 symbols/min
[2025-10-24T17:00:19.921062] [INFO ] [REMOTE    ] AAP: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T17:00:19.959782] [INFO ] [REMOTE    ] AAP: Fetching primary data for 2025-04.
[2025-10-24T17:00:20.029113] [INFO ] [MAIN      ] AAT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:20.061587] [DEBUG] [LOCAL     ] AAT: Loaded 30402 existing records from primary storage.
[2025-10-24T17:00:20.061895] [INFO ] [MAIN      ] AAT: Loaded 30402 existing records.
[2025-10-24T17:00:20.246848] [WARN ] [MAIN      ] AAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:20.247172] [INFO ] [MAIN      ] AAT: Wiping existing primary data before full refresh.
[2025-10-24T17:00:20.247236] [INFO ] [LOCAL     ] AAT: Starting deletion of primary data.
[2025-10-24T17:00:20.247731] [DEBUG] [LOCAL     ] AAT: Deleted primary data file.
[2025-10-24T17:00:20.247803] [INFO ] [MAIN      ] AAT: Starting full primary refresh.
[2025-10-24T17:00:20.603805] [INFO ] [REMOTE    ] A: Incremental fetch complete for 2025-07 (1.96 seconds).
[2025-10-24T17:00:20.644439] [INFO ] [REMOTE    ] AAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:20.655209] [INFO ] [REMOTE    ] AAT: Fetching primary data for 2025-01.
[2025-10-24T17:00:20.658213] [INFO ] [REMOTE    ] A: Fetching primary data for 2025-08.
[2025-10-24T17:00:20.690997] [INFO ] [REMOTE    ] AA: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T17:00:20.702838] [INFO ] [REMOTE    ] AA: Fetching primary data for 2025-08.
[2025-10-24T17:00:21.706031] [INFO ] [REMOTE    ] AAT: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T17:00:21.711731] [INFO ] [REMOTE    ] AAT: Fetching primary data for 2025-02.
[2025-10-24T17:00:21.971876] [INFO ] [REMOTE    ] AAP: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T17:00:21.983497] [INFO ] [REMOTE    ] AAP: Fetching primary data for 2025-05.
[2025-10-24T17:00:22.328588] [INFO ] [REMOTE    ] AA: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T17:00:22.342929] [INFO ] [REMOTE    ] AA: Fetching primary data for 2025-09.
[2025-10-24T17:00:22.583864] [INFO ] [REMOTE    ] A: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T17:00:22.598299] [INFO ] [REMOTE    ] A: Fetching primary data for 2025-09.
[2025-10-24T17:00:22.750090] [INFO ] [REMOTE    ] AAT: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T17:00:22.755845] [INFO ] [REMOTE    ] AAT: Fetching primary data for 2025-03.
[2025-10-24T17:00:23.710135] [INFO ] [REMOTE    ] AAP: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T17:00:23.721999] [INFO ] [REMOTE    ] AAP: Fetching primary data for 2025-06.
[2025-10-24T17:00:23.937615] [INFO ] [REMOTE    ] AAT: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T17:00:23.944374] [INFO ] [REMOTE    ] AAT: Fetching primary data for 2025-04.
[2025-10-24T17:00:24.269010] [INFO ] [REMOTE    ] AA: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T17:00:24.280886] [INFO ] [REMOTE    ] AA: Fetching primary data for 2025-10.
[2025-10-24T17:00:24.431299] [INFO ] [REMOTE    ] A: Incremental fetch complete for 2025-09 (1.83 seconds).
[2025-10-24T17:00:24.442444] [INFO ] [REMOTE    ] A: Fetching primary data for 2025-10.
[2025-10-24T17:00:25.084091] [INFO ] [REMOTE    ] AAT: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T17:00:25.091974] [INFO ] [REMOTE    ] AAT: Fetching primary data for 2025-05.
[2025-10-24T17:00:25.523979] [INFO ] [REMOTE    ] AAP: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T17:00:25.534840] [INFO ] [REMOTE    ] AAP: Fetching primary data for 2025-07.
[2025-10-24T17:00:25.872162] [INFO ] [REMOTE    ] AAT: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T17:00:25.878892] [INFO ] [REMOTE    ] AAT: Fetching primary data for 2025-06.
[2025-10-24T17:00:26.141794] [INFO ] [REMOTE    ] A: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T17:00:26.152675] [INFO ] [REMOTE    ] A: Full fetch complete (73539 records).
[2025-10-24T17:00:26.153527] [DEBUG] [VALIDATOR ] A: Validating primary data.
[2025-10-24T17:00:26.538715] [INFO ] [REMOTE    ] AA: Incremental fetch complete for 2025-10 (2.26 seconds).
[2025-10-24T17:00:26.587276] [DEBUG] [VALIDATOR ] A: All expected trading days are present.
[2025-10-24T17:00:26.587484] [DEBUG] [VALIDATOR ] A: Primary data validation passed.
[2025-10-24T17:00:26.588634] [INFO ] [MAIN      ] A: Fetched primary data is valid.
[2025-10-24T17:00:26.588748] [DEBUG] [LOCAL     ] A: Saving primary data.
[2025-10-24T17:00:26.587399] [INFO ] [REMOTE    ] AA: Full fetch complete (77343 records).
[2025-10-24T17:00:26.589046] [DEBUG] [VALIDATOR ] AA: Validating primary data.
[2025-10-24T17:00:26.589925] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:00:26.590017] [FATAL] [MAIN      ] AA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:00:26.590061] [WARN ] [MAIN      ] AA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:00:26.590127] [INFO ] [LOCAL     ] AA: Starting deletion of primary data.
[2025-10-24T17:00:26.590193] [DEBUG] [LOCAL     ] AA: No primary data file found to delete.
[2025-10-24T17:00:26.590244] [INFO ] [LOCAL     ] AA: Starting deletion of derivative data.
[2025-10-24T17:00:26.590420] [DEBUG] [LOCAL     ] AA: Deleted derivative data file.
[2025-10-24T17:00:26.591103] [INFO ] [MAIN      ] Update Progress: 3/2366 symbols completed. AA took 23.7s. Estimated remaining: 5h 11m 2s. Rate: 7.6 symbols/min
[2025-10-24T17:00:26.591354] [FATAL] [LOCAL     ] A: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:00:26.634994] [FATAL] [MAIN      ] A: Failed to save primary data.
[2025-10-24T17:00:26.661507] [WARN ] [MAIN      ] A: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:00:26.673417] [INFO ] [LOCAL     ] A: Starting deletion of primary data.
[2025-10-24T17:00:26.697634] [DEBUG] [LOCAL     ] A: No primary data file found to delete.
[2025-10-24T17:00:26.697848] [INFO ] [LOCAL     ] A: Starting deletion of derivative data.
[2025-10-24T17:00:26.698279] [DEBUG] [LOCAL     ] A: Deleted derivative data file.
[2025-10-24T17:00:26.746093] [INFO ] [MAIN      ] Update Progress: 4/2366 symbols completed. A took 23.8s. Estimated remaining: 3h 54m 42s. Rate: 10.1 symbols/min
[2025-10-24T17:00:26.778061] [INFO ] [MAIN      ] AAUC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:26.803500] [DEBUG] [LOCAL     ] AAUC: No existing data file found in primary storage.
[2025-10-24T17:00:26.808998] [WARN ] [MAIN      ] AAUC: No existing data found, performing full refresh instead.
[2025-10-24T17:00:26.829622] [INFO ] [MAIN      ] AAUC: Wiping existing primary data before full refresh.
[2025-10-24T17:00:26.838547] [INFO ] [LOCAL     ] AAUC: Starting deletion of primary data.
[2025-10-24T17:00:26.879863] [DEBUG] [LOCAL     ] AAUC: No primary data file found to delete.
[2025-10-24T17:00:26.880032] [INFO ] [MAIN      ] AAUC: Starting full primary refresh.
[2025-10-24T17:00:27.061209] [INFO ] [MAIN      ] AB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:27.078264] [INFO ] [REMOTE    ] AAT: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T17:00:27.097143] [INFO ] [REMOTE    ] AAT: Fetching primary data for 2025-07.
[2025-10-24T17:00:27.319884] [DEBUG] [LOCAL     ] AB: Loaded 24773 existing records from primary storage.
[2025-10-24T17:00:27.352860] [INFO ] [MAIN      ] AB: Loaded 24773 existing records.
[2025-10-24T17:00:27.376461] [INFO ] [REMOTE    ] AAUC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:27.382125] [INFO ] [REMOTE    ] AAUC: Fetching primary data for 2025-01.
[2025-10-24T17:00:27.564547] [INFO ] [REMOTE    ] AAP: Incremental fetch complete for 2025-07 (2.03 seconds).
[2025-10-24T17:00:27.603527] [WARN ] [MAIN      ] AB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:27.604021] [INFO ] [MAIN      ] AB: Wiping existing primary data before full refresh.
[2025-10-24T17:00:27.604139] [INFO ] [LOCAL     ] AB: Starting deletion of primary data.
[2025-10-24T17:00:27.604710] [DEBUG] [LOCAL     ] AB: Deleted primary data file.
[2025-10-24T17:00:27.604819] [INFO ] [MAIN      ] AB: Starting full primary refresh.
[2025-10-24T17:00:27.604668] [INFO ] [REMOTE    ] AAP: Fetching primary data for 2025-08.
[2025-10-24T17:00:27.670967] [DEBUG] [REMOTE    ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:00:27.696034] [WARN ] [REMOTE    ] AAUC: No data returned for month 2025-01
[2025-10-24T17:00:27.715574] [FATAL] [REMOTE    ] AAUC: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:00:27.729931] [FATAL] [MAIN      ] AAUC: Failed to fetch primary data.
[2025-10-24T17:00:27.730025] [WARN ] [MAIN      ] AAUC: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:00:27.730415] [INFO ] [LOCAL     ] AAUC: Starting deletion of primary data.
[2025-10-24T17:00:27.740995] [DEBUG] [LOCAL     ] AAUC: No primary data file found to delete.
[2025-10-24T17:00:27.746189] [INFO ] [LOCAL     ] AAUC: Starting deletion of derivative data.
[2025-10-24T17:00:27.756508] [DEBUG] [LOCAL     ] AAUC: No derivative data file found to delete.
[2025-10-24T17:00:27.772387] [INFO ] [MAIN      ] Update Progress: 5/2366 symbols completed. AAUC took 1.2s. Estimated remaining: 3h 15m 46s. Rate: 12.1 symbols/min
[2025-10-24T17:00:28.134611] [INFO ] [MAIN      ] ABBV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:28.158461] [DEBUG] [LOCAL     ] ABBV: No existing data file found in primary storage.
[2025-10-24T17:00:28.169069] [WARN ] [MAIN      ] ABBV: No existing data found, performing full refresh instead.
[2025-10-24T17:00:28.169255] [INFO ] [MAIN      ] ABBV: Wiping existing primary data before full refresh.
[2025-10-24T17:00:28.183807] [INFO ] [LOCAL     ] ABBV: Starting deletion of primary data.
[2025-10-24T17:00:28.189446] [INFO ] [REMOTE    ] AB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:28.189891] [INFO ] [REMOTE    ] AB: Fetching primary data for 2025-01.
[2025-10-24T17:00:28.189597] [DEBUG] [LOCAL     ] ABBV: No primary data file found to delete.
[2025-10-24T17:00:28.190878] [INFO ] [MAIN      ] ABBV: Starting full primary refresh.
[2025-10-24T17:00:28.587257] [INFO ] [REMOTE    ] ABBV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:28.587831] [INFO ] [REMOTE    ] ABBV: Fetching primary data for 2025-01.
[2025-10-24T17:00:28.607129] [INFO ] [REMOTE    ] AAT: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T17:00:28.615003] [INFO ] [REMOTE    ] AAT: Fetching primary data for 2025-08.
[2025-10-24T17:00:29.221334] [INFO ] [REMOTE    ] AAP: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T17:00:29.236190] [INFO ] [REMOTE    ] AAP: Fetching primary data for 2025-09.
[2025-10-24T17:00:29.576917] [INFO ] [REMOTE    ] AB: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T17:00:29.584251] [INFO ] [REMOTE    ] AB: Fetching primary data for 2025-02.
[2025-10-24T17:00:29.901796] [INFO ] [REMOTE    ] AAT: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T17:00:29.910378] [INFO ] [REMOTE    ] AAT: Fetching primary data for 2025-09.
[2025-10-24T17:00:30.428405] [INFO ] [REMOTE    ] ABBV: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T17:00:30.438936] [INFO ] [REMOTE    ] ABBV: Fetching primary data for 2025-02.
[2025-10-24T17:00:31.006265] [INFO ] [REMOTE    ] AAP: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T17:00:31.020860] [INFO ] [REMOTE    ] AAP: Fetching primary data for 2025-10.
[2025-10-24T17:00:31.094063] [INFO ] [REMOTE    ] AB: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T17:00:31.103502] [INFO ] [REMOTE    ] AB: Fetching primary data for 2025-03.
[2025-10-24T17:00:31.192349] [INFO ] [REMOTE    ] AAT: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T17:00:31.198721] [INFO ] [REMOTE    ] AAT: Fetching primary data for 2025-10.
[2025-10-24T17:00:32.014420] [INFO ] [REMOTE    ] ABBV: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T17:00:32.024412] [INFO ] [REMOTE    ] ABBV: Fetching primary data for 2025-03.
[2025-10-24T17:00:32.123754] [INFO ] [REMOTE    ] AAT: Incremental fetch complete for 2025-10 (0.93 seconds).
[2025-10-24T17:00:32.129138] [INFO ] [REMOTE    ] AAT: Full fetch complete (43050 records).
[2025-10-24T17:00:32.129235] [DEBUG] [VALIDATOR ] AAT: Validating primary data.
[2025-10-24T17:00:32.534737] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present.
[2025-10-24T17:00:32.534818] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed.
[2025-10-24T17:00:32.535274] [INFO ] [MAIN      ] AAT: Fetched primary data is valid.
[2025-10-24T17:00:32.535339] [DEBUG] [LOCAL     ] AAT: Saving primary data.
[2025-10-24T17:00:32.535766] [FATAL] [LOCAL     ] AAT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:00:32.535859] [FATAL] [MAIN      ] AAT: Failed to save primary data.
[2025-10-24T17:00:32.535903] [WARN ] [MAIN      ] AAT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:00:32.535940] [INFO ] [LOCAL     ] AAT: Starting deletion of primary data.
[2025-10-24T17:00:32.536048] [DEBUG] [LOCAL     ] AAT: No primary data file found to delete.
[2025-10-24T17:00:32.536123] [INFO ] [LOCAL     ] AAT: Starting deletion of derivative data.
[2025-10-24T17:00:32.536332] [DEBUG] [LOCAL     ] AAT: Deleted derivative data file.
[2025-10-24T17:00:32.536453] [INFO ] [MAIN      ] Update Progress: 6/2366 symbols completed. AAT took 12.7s. Estimated remaining: 3h 14m 18s. Rate: 12.1 symbols/min
[2025-10-24T17:00:32.722408] [INFO ] [MAIN      ] ABCB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:32.767851] [INFO ] [REMOTE    ] AB: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T17:00:32.786874] [INFO ] [REMOTE    ] AB: Fetching primary data for 2025-04.
[2025-10-24T17:00:32.789266] [DEBUG] [LOCAL     ] ABCB: Loaded 30498 existing records from primary storage.
[2025-10-24T17:00:32.789619] [INFO ] [MAIN      ] ABCB: Loaded 30498 existing records.
[2025-10-24T17:00:32.998513] [WARN ] [MAIN      ] ABCB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:33.006799] [INFO ] [MAIN      ] ABCB: Wiping existing primary data before full refresh.
[2025-10-24T17:00:33.006940] [INFO ] [LOCAL     ] ABCB: Starting deletion of primary data.
[2025-10-24T17:00:33.007435] [DEBUG] [LOCAL     ] ABCB: Deleted primary data file.
[2025-10-24T17:00:33.008411] [INFO ] [REMOTE    ] AAP: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T17:00:33.007495] [INFO ] [MAIN      ] ABCB: Starting full primary refresh.
[2025-10-24T17:00:33.081504] [INFO ] [REMOTE    ] AAP: Full fetch complete (75046 records).
[2025-10-24T17:00:33.093077] [DEBUG] [VALIDATOR ] AAP: Validating primary data.
[2025-10-24T17:00:33.692339] [INFO ] [REMOTE    ] ABCB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:33.726245] [INFO ] [REMOTE    ] ABCB: Fetching primary data for 2025-01.
[2025-10-24T17:00:33.786110] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present.
[2025-10-24T17:00:33.786358] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed.
[2025-10-24T17:00:33.787140] [INFO ] [MAIN      ] AAP: Fetched primary data is valid.
[2025-10-24T17:00:33.787225] [DEBUG] [LOCAL     ] AAP: Saving primary data.
[2025-10-24T17:00:33.787915] [FATAL] [LOCAL     ] AAP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:00:33.788055] [FATAL] [MAIN      ] AAP: Failed to save primary data.
[2025-10-24T17:00:33.788128] [WARN ] [MAIN      ] AAP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:00:33.788202] [INFO ] [LOCAL     ] AAP: Starting deletion of primary data.
[2025-10-24T17:00:33.788400] [DEBUG] [LOCAL     ] AAP: No primary data file found to delete.
[2025-10-24T17:00:33.788469] [INFO ] [LOCAL     ] AAP: Starting deletion of derivative data.
[2025-10-24T17:00:33.788623] [DEBUG] [LOCAL     ] AAP: Deleted derivative data file.
[2025-10-24T17:00:33.789958] [INFO ] [MAIN      ] Update Progress: 7/2366 symbols completed. AAP took 20.0s. Estimated remaining: 2h 53m 30s. Rate: 13.6 symbols/min
[2025-10-24T17:00:33.972732] [INFO ] [MAIN      ] ABEV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:33.973214] [DEBUG] [LOCAL     ] ABEV: No existing data file found in primary storage.
[2025-10-24T17:00:33.973352] [WARN ] [MAIN      ] ABEV: No existing data found, performing full refresh instead.
[2025-10-24T17:00:33.973921] [INFO ] [MAIN      ] ABEV: Wiping existing primary data before full refresh.
[2025-10-24T17:00:33.989863] [INFO ] [LOCAL     ] ABEV: Starting deletion of primary data.
[2025-10-24T17:00:34.001384] [DEBUG] [LOCAL     ] ABEV: No primary data file found to delete.
[2025-10-24T17:00:34.002930] [INFO ] [REMOTE    ] ABBV: Incremental fetch complete for 2025-03 (1.98 seconds).
[2025-10-24T17:00:34.002034] [INFO ] [MAIN      ] ABEV: Starting full primary refresh.
[2025-10-24T17:00:34.035609] [INFO ] [REMOTE    ] ABBV: Fetching primary data for 2025-04.
[2025-10-24T17:00:34.142406] [INFO ] [REMOTE    ] AB: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T17:00:34.198737] [INFO ] [REMOTE    ] AB: Fetching primary data for 2025-05.
[2025-10-24T17:00:34.438894] [INFO ] [REMOTE    ] ABEV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:34.439317] [INFO ] [REMOTE    ] ABEV: Fetching primary data for 2025-01.
[2025-10-24T17:00:35.085175] [INFO ] [REMOTE    ] ABCB: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T17:00:35.091913] [INFO ] [REMOTE    ] ABCB: Fetching primary data for 2025-02.
[2025-10-24T17:00:35.357512] [INFO ] [REMOTE    ] AB: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T17:00:35.364322] [INFO ] [REMOTE    ] AB: Fetching primary data for 2025-06.
[2025-10-24T17:00:36.154533] [INFO ] [REMOTE    ] ABEV: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T17:00:36.167333] [INFO ] [REMOTE    ] ABEV: Fetching primary data for 2025-02.
[2025-10-24T17:00:36.183201] [INFO ] [REMOTE    ] AB: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T17:00:36.192797] [INFO ] [REMOTE    ] AB: Fetching primary data for 2025-07.
[2025-10-24T17:00:36.255681] [INFO ] [REMOTE    ] ABCB: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T17:00:36.262335] [INFO ] [REMOTE    ] ABCB: Fetching primary data for 2025-03.
[2025-10-24T17:00:36.331453] [INFO ] [REMOTE    ] ABBV: Incremental fetch complete for 2025-04 (2.30 seconds).
[2025-10-24T17:00:36.342923] [INFO ] [REMOTE    ] ABBV: Fetching primary data for 2025-05.
[2025-10-24T17:00:37.006371] [INFO ] [REMOTE    ] AB: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T17:00:37.012141] [INFO ] [REMOTE    ] AB: Fetching primary data for 2025-08.
[2025-10-24T17:00:37.230125] [INFO ] [REMOTE    ] ABCB: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T17:00:37.237310] [INFO ] [REMOTE    ] ABCB: Fetching primary data for 2025-04.
[2025-10-24T17:00:37.640026] [INFO ] [REMOTE    ] ABEV: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T17:00:37.649996] [INFO ] [REMOTE    ] ABEV: Fetching primary data for 2025-03.
[2025-10-24T17:00:37.698211] [INFO ] [REMOTE    ] AB: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T17:00:37.703617] [INFO ] [REMOTE    ] AB: Fetching primary data for 2025-09.
[2025-10-24T17:00:38.048639] [INFO ] [REMOTE    ] ABBV: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T17:00:38.059704] [INFO ] [REMOTE    ] ABBV: Fetching primary data for 2025-06.
[2025-10-24T17:00:38.480859] [INFO ] [REMOTE    ] ABCB: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T17:00:38.489242] [INFO ] [REMOTE    ] ABCB: Fetching primary data for 2025-05.
[2025-10-24T17:00:38.539110] [INFO ] [REMOTE    ] AB: Incremental fetch complete for 2025-09 (0.84 seconds).
[2025-10-24T17:00:38.544767] [INFO ] [REMOTE    ] AB: Fetching primary data for 2025-10.
[2025-10-24T17:00:39.303479] [INFO ] [REMOTE    ] ABCB: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T17:00:39.309954] [INFO ] [REMOTE    ] ABCB: Fetching primary data for 2025-06.
[2025-10-24T17:00:39.427992] [INFO ] [REMOTE    ] ABEV: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T17:00:39.440396] [INFO ] [REMOTE    ] ABEV: Fetching primary data for 2025-04.
[2025-10-24T17:00:39.854935] [INFO ] [REMOTE    ] ABBV: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T17:00:39.879900] [INFO ] [REMOTE    ] ABBV: Fetching primary data for 2025-07.
[2025-10-24T17:00:39.880504] [INFO ] [REMOTE    ] AB: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T17:00:39.886789] [INFO ] [REMOTE    ] AB: Full fetch complete (43690 records).
[2025-10-24T17:00:39.886950] [DEBUG] [VALIDATOR ] AB: Validating primary data.
[2025-10-24T17:00:39.888724] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:00:39.888905] [FATAL] [MAIN      ] AB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:00:39.888981] [WARN ] [MAIN      ] AB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:00:39.889059] [INFO ] [LOCAL     ] AB: Starting deletion of primary data.
[2025-10-24T17:00:39.889134] [DEBUG] [LOCAL     ] AB: No primary data file found to delete.
[2025-10-24T17:00:39.889174] [INFO ] [LOCAL     ] AB: Starting deletion of derivative data.
[2025-10-24T17:00:39.889372] [DEBUG] [LOCAL     ] AB: Deleted derivative data file.
[2025-10-24T17:00:39.889488] [INFO ] [MAIN      ] Update Progress: 8/2366 symbols completed. AB took 13.1s. Estimated remaining: 3h 1m 43s. Rate: 13.0 symbols/min
[2025-10-24T17:00:40.085744] [INFO ] [MAIN      ] ABG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:40.086004] [DEBUG] [LOCAL     ] ABG: No existing data file found in primary storage.
[2025-10-24T17:00:40.086098] [WARN ] [MAIN      ] ABG: No existing data found, performing full refresh instead.
[2025-10-24T17:00:40.086376] [INFO ] [MAIN      ] ABG: Wiping existing primary data before full refresh.
[2025-10-24T17:00:40.086624] [INFO ] [LOCAL     ] ABG: Starting deletion of primary data.
[2025-10-24T17:00:40.086731] [DEBUG] [LOCAL     ] ABG: No primary data file found to delete.
[2025-10-24T17:00:40.086775] [INFO ] [MAIN      ] ABG: Starting full primary refresh.
[2025-10-24T17:00:40.386306] [INFO ] [REMOTE    ] ABCB: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T17:00:40.431046] [INFO ] [REMOTE    ] ABCB: Fetching primary data for 2025-07.
[2025-10-24T17:00:40.474017] [INFO ] [REMOTE    ] ABG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:40.474290] [INFO ] [REMOTE    ] ABG: Fetching primary data for 2025-01.
[2025-10-24T17:00:40.865807] [INFO ] [REMOTE    ] ABEV: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T17:00:40.878342] [INFO ] [REMOTE    ] ABEV: Fetching primary data for 2025-05.
[2025-10-24T17:00:41.306979] [INFO ] [REMOTE    ] ABCB: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T17:00:41.314605] [INFO ] [REMOTE    ] ABCB: Fetching primary data for 2025-08.
[2025-10-24T17:00:41.599726] [INFO ] [REMOTE    ] ABG: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T17:00:41.604143] [INFO ] [REMOTE    ] ABG: Fetching primary data for 2025-02.
[2025-10-24T17:00:41.932163] [INFO ] [REMOTE    ] ABBV: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T17:00:41.943826] [INFO ] [REMOTE    ] ABBV: Fetching primary data for 2025-08.
[2025-10-24T17:00:42.083397] [INFO ] [REMOTE    ] ABEV: Incremental fetch complete for 2025-05 (1.21 seconds).
[2025-10-24T17:00:42.094451] [INFO ] [REMOTE    ] ABEV: Fetching primary data for 2025-06.
[2025-10-24T17:00:42.585859] [INFO ] [REMOTE    ] ABG: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T17:00:42.590562] [INFO ] [REMOTE    ] ABG: Fetching primary data for 2025-03.
[2025-10-24T17:00:42.655604] [INFO ] [REMOTE    ] ABCB: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T17:00:42.663804] [INFO ] [REMOTE    ] ABCB: Fetching primary data for 2025-09.
[2025-10-24T17:00:43.602274] [INFO ] [REMOTE    ] ABEV: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T17:00:43.631457] [INFO ] [REMOTE    ] ABEV: Fetching primary data for 2025-07.
[2025-10-24T17:00:43.637298] [INFO ] [REMOTE    ] ABCB: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T17:00:43.645453] [INFO ] [REMOTE    ] ABCB: Fetching primary data for 2025-10.
[2025-10-24T17:00:43.739697] [INFO ] [REMOTE    ] ABBV: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T17:00:43.752332] [INFO ] [REMOTE    ] ABBV: Fetching primary data for 2025-09.
[2025-10-24T17:00:43.768041] [INFO ] [REMOTE    ] ABG: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T17:00:43.773923] [INFO ] [REMOTE    ] ABG: Fetching primary data for 2025-04.
[2025-10-24T17:00:44.724429] [INFO ] [REMOTE    ] ABG: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T17:00:44.731033] [INFO ] [REMOTE    ] ABG: Fetching primary data for 2025-05.
[2025-10-24T17:00:45.003473] [INFO ] [REMOTE    ] ABEV: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T17:00:45.015243] [INFO ] [REMOTE    ] ABEV: Fetching primary data for 2025-08.
[2025-10-24T17:00:45.038228] [INFO ] [REMOTE    ] ABCB: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T17:00:45.044342] [INFO ] [REMOTE    ] ABCB: Full fetch complete (44872 records).
[2025-10-24T17:00:45.044456] [DEBUG] [VALIDATOR ] ABCB: Validating primary data.
[2025-10-24T17:00:45.494088] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present.
[2025-10-24T17:00:45.496138] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed.
[2025-10-24T17:00:45.495920] [INFO ] [REMOTE    ] ABG: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T17:00:45.496989] [INFO ] [MAIN      ] ABCB: Fetched primary data is valid.
[2025-10-24T17:00:45.500821] [DEBUG] [LOCAL     ] ABCB: Saving primary data.
[2025-10-24T17:00:45.501680] [FATAL] [LOCAL     ] ABCB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:00:45.501968] [FATAL] [MAIN      ] ABCB: Failed to save primary data.
[2025-10-24T17:00:45.502419] [INFO ] [REMOTE    ] ABG: Fetching primary data for 2025-06.
[2025-10-24T17:00:45.502523] [WARN ] [MAIN      ] ABCB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:00:45.502781] [INFO ] [LOCAL     ] ABCB: Starting deletion of primary data.
[2025-10-24T17:00:45.503951] [DEBUG] [LOCAL     ] ABCB: No primary data file found to delete.
[2025-10-24T17:00:45.504007] [INFO ] [LOCAL     ] ABCB: Starting deletion of derivative data.
[2025-10-24T17:00:45.504173] [DEBUG] [LOCAL     ] ABCB: Deleted derivative data file.
[2025-10-24T17:00:45.505157] [INFO ] [MAIN      ] Update Progress: 9/2366 symbols completed. ABCB took 13.0s. Estimated remaining: 3h 5m 58s. Rate: 12.7 symbols/min
[2025-10-24T17:00:45.710064] [INFO ] [MAIN      ] ABM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:45.749555] [DEBUG] [LOCAL     ] ABM: Loaded 32319 existing records from primary storage.
[2025-10-24T17:00:45.749870] [INFO ] [MAIN      ] ABM: Loaded 32319 existing records.
[2025-10-24T17:00:45.951148] [INFO ] [REMOTE    ] ABBV: Incremental fetch complete for 2025-09 (2.20 seconds).
[2025-10-24T17:00:45.997902] [WARN ] [MAIN      ] ABM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:45.998801] [INFO ] [MAIN      ] ABM: Wiping existing primary data before full refresh.
[2025-10-24T17:00:45.998885] [INFO ] [LOCAL     ] ABM: Starting deletion of primary data.
[2025-10-24T17:00:45.998523] [INFO ] [REMOTE    ] ABBV: Fetching primary data for 2025-10.
[2025-10-24T17:00:45.999940] [DEBUG] [LOCAL     ] ABM: Deleted primary data file.
[2025-10-24T17:00:46.000032] [INFO ] [MAIN      ] ABM: Starting full primary refresh.
[2025-10-24T17:00:46.411878] [INFO ] [REMOTE    ] ABG: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T17:00:46.440824] [INFO ] [REMOTE    ] ABM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:46.441750] [INFO ] [REMOTE    ] ABM: Fetching primary data for 2025-01.
[2025-10-24T17:00:46.442371] [INFO ] [REMOTE    ] ABG: Fetching primary data for 2025-07.
[2025-10-24T17:00:46.517164] [INFO ] [REMOTE    ] ABEV: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T17:00:46.529142] [INFO ] [REMOTE    ] ABEV: Fetching primary data for 2025-09.
[2025-10-24T17:00:47.342536] [INFO ] [REMOTE    ] ABG: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T17:00:47.347372] [INFO ] [REMOTE    ] ABG: Fetching primary data for 2025-08.
[2025-10-24T17:00:47.691147] [INFO ] [REMOTE    ] ABM: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T17:00:47.697074] [INFO ] [REMOTE    ] ABM: Fetching primary data for 2025-02.
[2025-10-24T17:00:48.265199] [INFO ] [REMOTE    ] ABEV: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T17:00:48.277604] [INFO ] [REMOTE    ] ABEV: Fetching primary data for 2025-10.
[2025-10-24T17:00:48.394445] [INFO ] [REMOTE    ] ABBV: Incremental fetch complete for 2025-10 (2.40 seconds).
[2025-10-24T17:00:48.404499] [INFO ] [REMOTE    ] ABBV: Full fetch complete (77843 records).
[2025-10-24T17:00:48.404710] [DEBUG] [VALIDATOR ] ABBV: Validating primary data.
[2025-10-24T17:00:48.543767] [INFO ] [REMOTE    ] ABG: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T17:00:48.632996] [INFO ] [REMOTE    ] ABG: Fetching primary data for 2025-09.
[2025-10-24T17:00:48.761079] [INFO ] [REMOTE    ] ABM: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T17:00:48.782198] [INFO ] [REMOTE    ] ABM: Fetching primary data for 2025-03.
[2025-10-24T17:00:48.876390] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present.
[2025-10-24T17:00:48.876476] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed.
[2025-10-24T17:00:48.877232] [INFO ] [MAIN      ] ABBV: Fetched primary data is valid.
[2025-10-24T17:00:48.877302] [DEBUG] [LOCAL     ] ABBV: Saving primary data.
[2025-10-24T17:00:48.878003] [FATAL] [LOCAL     ] ABBV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:00:48.878100] [FATAL] [MAIN      ] ABBV: Failed to save primary data.
[2025-10-24T17:00:48.878143] [WARN ] [MAIN      ] ABBV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:00:48.878179] [INFO ] [LOCAL     ] ABBV: Starting deletion of primary data.
[2025-10-24T17:00:48.878235] [DEBUG] [LOCAL     ] ABBV: No primary data file found to delete.
[2025-10-24T17:00:48.878272] [INFO ] [LOCAL     ] ABBV: Starting deletion of derivative data.
[2025-10-24T17:00:48.878311] [DEBUG] [LOCAL     ] ABBV: No derivative data file found to delete.
[2025-10-24T17:00:48.879622] [INFO ] [MAIN      ] Update Progress: 10/2366 symbols completed. ABBV took 21.1s. Estimated remaining: 3h 0m 33s. Rate: 13.0 symbols/min
[2025-10-24T17:00:49.050325] [INFO ] [MAIN      ] ABR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:49.107334] [DEBUG] [LOCAL     ] ABR: Loaded 52253 existing records from primary storage.
[2025-10-24T17:00:49.107825] [INFO ] [MAIN      ] ABR: Loaded 52253 existing records.
[2025-10-24T17:00:49.357577] [WARN ] [MAIN      ] ABR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:49.357910] [INFO ] [MAIN      ] ABR: Wiping existing primary data before full refresh.
[2025-10-24T17:00:49.357984] [INFO ] [LOCAL     ] ABR: Starting deletion of primary data.
[2025-10-24T17:00:49.359108] [DEBUG] [LOCAL     ] ABR: Deleted primary data file.
[2025-10-24T17:00:49.359184] [INFO ] [MAIN      ] ABR: Starting full primary refresh.
[2025-10-24T17:00:49.835044] [INFO ] [REMOTE    ] ABG: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T17:00:49.850921] [INFO ] [REMOTE    ] ABG: Fetching primary data for 2025-10.
[2025-10-24T17:00:49.970603] [INFO ] [REMOTE    ] ABR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:49.971350] [INFO ] [REMOTE    ] ABR: Fetching primary data for 2025-01.
[2025-10-24T17:00:50.016931] [INFO ] [REMOTE    ] ABEV: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T17:00:50.033945] [INFO ] [REMOTE    ] ABEV: Full fetch complete (77334 records).
[2025-10-24T17:00:50.034174] [DEBUG] [VALIDATOR ] ABEV: Validating primary data.
[2025-10-24T17:00:50.444933] [INFO ] [REMOTE    ] ABM: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T17:00:50.489461] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present.
[2025-10-24T17:00:50.489821] [INFO ] [REMOTE    ] ABM: Fetching primary data for 2025-04.
[2025-10-24T17:00:50.489911] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed.
[2025-10-24T17:00:50.491579] [INFO ] [MAIN      ] ABEV: Fetched primary data is valid.
[2025-10-24T17:00:50.491777] [DEBUG] [LOCAL     ] ABEV: Saving primary data.
[2025-10-24T17:00:50.492358] [FATAL] [LOCAL     ] ABEV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:00:50.492444] [FATAL] [MAIN      ] ABEV: Failed to save primary data.
[2025-10-24T17:00:50.492509] [WARN ] [MAIN      ] ABEV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:00:50.492580] [INFO ] [LOCAL     ] ABEV: Starting deletion of primary data.
[2025-10-24T17:00:50.492673] [DEBUG] [LOCAL     ] ABEV: No primary data file found to delete.
[2025-10-24T17:00:50.492741] [INFO ] [LOCAL     ] ABEV: Starting deletion of derivative data.
[2025-10-24T17:00:50.492792] [DEBUG] [LOCAL     ] ABEV: No derivative data file found to delete.
[2025-10-24T17:00:50.493885] [INFO ] [MAIN      ] Update Progress: 11/2366 symbols completed. ABEV took 16.7s. Estimated remaining: 2h 49m 50s. Rate: 13.9 symbols/min
[2025-10-24T17:00:50.664152] [INFO ] [MAIN      ] ABT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:50.722132] [DEBUG] [LOCAL     ] ABT: Loaded 54014 existing records from primary storage.
[2025-10-24T17:00:50.722447] [INFO ] [MAIN      ] ABT: Loaded 54014 existing records.
[2025-10-24T17:00:50.901002] [WARN ] [MAIN      ] ABT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:50.901196] [INFO ] [MAIN      ] ABT: Wiping existing primary data before full refresh.
[2025-10-24T17:00:50.901244] [INFO ] [LOCAL     ] ABT: Starting deletion of primary data.
[2025-10-24T17:00:50.902317] [DEBUG] [LOCAL     ] ABT: Deleted primary data file.
[2025-10-24T17:00:50.902375] [INFO ] [MAIN      ] ABT: Starting full primary refresh.
[2025-10-24T17:00:51.051012] [INFO ] [REMOTE    ] ABG: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T17:00:51.073591] [INFO ] [REMOTE    ] ABG: Full fetch complete (26708 records).
[2025-10-24T17:00:51.099041] [DEBUG] [VALIDATOR ] ABG: Validating primary data.
[2025-10-24T17:00:51.410958] [INFO ] [REMOTE    ] ABT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:51.438843] [INFO ] [REMOTE    ] ABT: Fetching primary data for 2025-01.
[2025-10-24T17:00:51.699536] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present.
[2025-10-24T17:00:51.699775] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed.
[2025-10-24T17:00:51.700249] [INFO ] [MAIN      ] ABG: Fetched primary data is valid.
[2025-10-24T17:00:51.700349] [DEBUG] [LOCAL     ] ABG: Saving primary data.
[2025-10-24T17:00:51.701333] [FATAL] [LOCAL     ] ABG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:00:51.701556] [FATAL] [MAIN      ] ABG: Failed to save primary data.
[2025-10-24T17:00:51.701665] [WARN ] [MAIN      ] ABG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:00:51.701854] [INFO ] [LOCAL     ] ABG: Starting deletion of primary data.
[2025-10-24T17:00:51.702007] [DEBUG] [LOCAL     ] ABG: No primary data file found to delete.
[2025-10-24T17:00:51.702280] [INFO ] [LOCAL     ] ABG: Starting deletion of derivative data.
[2025-10-24T17:00:51.702468] [DEBUG] [LOCAL     ] ABG: No derivative data file found to delete.
[2025-10-24T17:00:51.702702] [INFO ] [MAIN      ] Update Progress: 12/2366 symbols completed. ABG took 11.8s. Estimated remaining: 2h 39m 34s. Rate: 14.8 symbols/min
[2025-10-24T17:00:51.898848] [INFO ] [REMOTE    ] ABR: Incremental fetch complete for 2025-01 (1.93 seconds).
[2025-10-24T17:00:51.960784] [INFO ] [REMOTE    ] ABM: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T17:00:51.961843] [INFO ] [MAIN      ] ACA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:00:51.958973] [INFO ] [REMOTE    ] ABR: Fetching primary data for 2025-02.
[2025-10-24T17:00:51.971029] [INFO ] [REMOTE    ] ABM: Fetching primary data for 2025-05.
[2025-10-24T17:00:51.995221] [DEBUG] [LOCAL     ] ACA: Loaded 22636 existing records from primary storage.
[2025-10-24T17:00:51.995527] [INFO ] [MAIN      ] ACA: Loaded 22636 existing records.
[2025-10-24T17:00:52.218333] [WARN ] [MAIN      ] ACA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:00:52.219205] [INFO ] [MAIN      ] ACA: Wiping existing primary data before full refresh.
[2025-10-24T17:00:52.219271] [INFO ] [LOCAL     ] ACA: Starting deletion of primary data.
[2025-10-24T17:00:52.219939] [DEBUG] [LOCAL     ] ACA: Deleted primary data file.
[2025-10-24T17:00:52.220002] [INFO ] [MAIN      ] ACA: Starting full primary refresh.
[2025-10-24T17:00:52.589498] [INFO ] [REMOTE    ] ACA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:00:52.589850] [INFO ] [REMOTE    ] ACA: Fetching primary data for 2025-01.
[2025-10-24T17:00:52.897040] [INFO ] [REMOTE    ] ABM: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T17:00:52.902772] [INFO ] [REMOTE    ] ABM: Fetching primary data for 2025-06.
[2025-10-24T17:00:53.509435] [INFO ] [REMOTE    ] ABT: Incremental fetch complete for 2025-01 (2.07 seconds).
[2025-10-24T17:00:53.520002] [INFO ] [REMOTE    ] ABT: Fetching primary data for 2025-02.
[2025-10-24T17:00:53.715366] [INFO ] [REMOTE    ] ABR: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T17:00:53.725217] [INFO ] [REMOTE    ] ABR: Fetching primary data for 2025-03.
[2025-10-24T17:00:53.784870] [INFO ] [REMOTE    ] ACA: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T17:00:53.791987] [INFO ] [REMOTE    ] ACA: Fetching primary data for 2025-02.
[2025-10-24T17:00:54.283196] [INFO ] [REMOTE    ] ABM: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T17:00:54.290716] [INFO ] [REMOTE    ] ABM: Fetching primary data for 2025-07.
[2025-10-24T17:00:54.770743] [INFO ] [REMOTE    ] ACA: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T17:00:54.775773] [INFO ] [REMOTE    ] ACA: Fetching primary data for 2025-03.
[2025-10-24T17:00:55.268993] [INFO ] [REMOTE    ] ABR: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T17:00:55.280993] [INFO ] [REMOTE    ] ABR: Fetching primary data for 2025-04.
[2025-10-24T17:00:55.326769] [INFO ] [REMOTE    ] ABM: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T17:00:55.334982] [INFO ] [REMOTE    ] ABM: Fetching primary data for 2025-08.
[2025-10-24T17:00:55.335907] [INFO ] [REMOTE    ] ABT: Incremental fetch complete for 2025-02 (1.82 seconds).
[2025-10-24T17:00:55.347858] [INFO ] [REMOTE    ] ABT: Fetching primary data for 2025-03.
[2025-10-24T17:00:55.709236] [INFO ] [REMOTE    ] ACA: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T17:00:55.715765] [INFO ] [REMOTE    ] ACA: Fetching primary data for 2025-04.
[2025-10-24T17:00:56.632389] [INFO ] [REMOTE    ] ABM: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T17:00:56.641829] [INFO ] [REMOTE    ] ABM: Fetching primary data for 2025-09.
[2025-10-24T17:00:56.725229] [INFO ] [REMOTE    ] ACA: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T17:00:56.733338] [INFO ] [REMOTE    ] ACA: Fetching primary data for 2025-05.
[2025-10-24T17:00:56.871042] [INFO ] [REMOTE    ] ABR: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T17:00:56.882525] [INFO ] [REMOTE    ] ABR: Fetching primary data for 2025-05.
[2025-10-24T17:00:57.265773] [INFO ] [REMOTE    ] ABT: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T17:00:57.276858] [INFO ] [REMOTE    ] ABT: Fetching primary data for 2025-04.
[2025-10-24T17:00:57.851700] [INFO ] [REMOTE    ] ACA: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T17:00:57.857483] [INFO ] [REMOTE    ] ACA: Fetching primary data for 2025-06.
[2025-10-24T17:00:58.134449] [INFO ] [REMOTE    ] ABM: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T17:00:58.143931] [INFO ] [REMOTE    ] ABM: Fetching primary data for 2025-10.
[2025-10-24T17:00:58.492929] [INFO ] [REMOTE    ] ABR: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T17:00:58.504284] [INFO ] [REMOTE    ] ABR: Fetching primary data for 2025-06.
[2025-10-24T17:00:58.772098] [INFO ] [REMOTE    ] ABT: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T17:00:58.783419] [INFO ] [REMOTE    ] ABT: Fetching primary data for 2025-05.
[2025-10-24T17:00:58.961788] [INFO ] [REMOTE    ] ACA: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T17:00:58.967176] [INFO ] [REMOTE    ] ACA: Fetching primary data for 2025-07.
[2025-10-24T17:00:59.521701] [INFO ] [REMOTE    ] ABM: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T17:00:59.528469] [INFO ] [REMOTE    ] ABM: Full fetch complete (45097 records).
[2025-10-24T17:00:59.528594] [DEBUG] [VALIDATOR ] ABM: Validating primary data.
[2025-10-24T17:00:59.955761] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present.
[2025-10-24T17:00:59.956052] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed.
[2025-10-24T17:00:59.956695] [INFO ] [MAIN      ] ABM: Fetched primary data is valid.
[2025-10-24T17:00:59.956930] [DEBUG] [LOCAL     ] ABM: Saving primary data.
[2025-10-24T17:00:59.968573] [FATAL] [LOCAL     ] ABM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:00:59.970634] [FATAL] [MAIN      ] ABM: Failed to save primary data.
[2025-10-24T17:00:59.970827] [WARN ] [MAIN      ] ABM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:00:59.971133] [INFO ] [LOCAL     ] ABM: Starting deletion of primary data.
[2025-10-24T17:00:59.972182] [INFO ] [REMOTE    ] ACA: Incremental fetch complete for 2025-07 (1.01 seconds).
[2025-10-24T17:00:59.971400] [DEBUG] [LOCAL     ] ABM: No primary data file found to delete.
[2025-10-24T17:00:59.977905] [INFO ] [LOCAL     ] ABM: Starting deletion of derivative data.
[2025-10-24T17:00:59.978428] [INFO ] [REMOTE    ] ACA: Fetching primary data for 2025-08.
[2025-10-24T17:00:59.978487] [DEBUG] [LOCAL     ] ABM: Deleted derivative data file.
[2025-10-24T17:00:59.980115] [INFO ] [MAIN      ] Update Progress: 13/2366 symbols completed. ABM took 14.5s. Estimated remaining: 2h 52m 12s. Rate: 13.7 symbols/min
[2025-10-24T17:01:00.178676] [INFO ] [MAIN      ] ACCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:01:00.191462] [INFO ] [REMOTE    ] ABR: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T17:01:00.202600] [INFO ] [REMOTE    ] ABR: Fetching primary data for 2025-07.
[2025-10-24T17:01:00.240863] [DEBUG] [LOCAL     ] ACCO: Loaded 36869 existing records from primary storage.
[2025-10-24T17:01:00.241149] [INFO ] [MAIN      ] ACCO: Loaded 36869 existing records.
[2025-10-24T17:01:00.423168] [WARN ] [MAIN      ] ACCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:01:00.423556] [INFO ] [MAIN      ] ACCO: Wiping existing primary data before full refresh.
[2025-10-24T17:01:00.423672] [INFO ] [LOCAL     ] ACCO: Starting deletion of primary data.
[2025-10-24T17:01:00.424349] [DEBUG] [LOCAL     ] ACCO: Deleted primary data file.
[2025-10-24T17:01:00.424406] [INFO ] [MAIN      ] ACCO: Starting full primary refresh.
[2025-10-24T17:01:00.619575] [INFO ] [REMOTE    ] ABT: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T17:01:00.677317] [INFO ] [REMOTE    ] ABT: Fetching primary data for 2025-06.
[2025-10-24T17:01:00.889016] [INFO ] [REMOTE    ] ACCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:01:00.889381] [INFO ] [REMOTE    ] ACCO: Fetching primary data for 2025-01.
[2025-10-24T17:01:01.481582] [INFO ] [REMOTE    ] ACA: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T17:01:01.487197] [INFO ] [REMOTE    ] ACA: Fetching primary data for 2025-09.
[2025-10-24T17:01:03.168534] [INFO ] [REMOTE    ] ABR: Incremental fetch complete for 2025-07 (2.97 seconds).
[2025-10-24T17:01:03.183929] [INFO ] [REMOTE    ] ABR: Fetching primary data for 2025-08.
[2025-10-24T17:01:03.641523] [INFO ] [REMOTE    ] ACA: Incremental fetch complete for 2025-09 (2.15 seconds).
[2025-10-24T17:01:03.646222] [INFO ] [REMOTE    ] ACA: Fetching primary data for 2025-10.
[2025-10-24T17:01:05.015454] [INFO ] [REMOTE    ] ACCO: Incremental fetch complete for 2025-01 (4.13 seconds).
[2025-10-24T17:01:05.023400] [INFO ] [REMOTE    ] ACCO: Fetching primary data for 2025-02.
[2025-10-24T17:01:05.121935] [INFO ] [REMOTE    ] ABR: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T17:01:05.133391] [INFO ] [REMOTE    ] ABR: Fetching primary data for 2025-09.
[2025-10-24T17:01:05.336131] [INFO ] [REMOTE    ] ABT: Incremental fetch complete for 2025-06 (4.66 seconds).
[2025-10-24T17:01:05.346976] [INFO ] [REMOTE    ] ABT: Fetching primary data for 2025-07.
[2025-10-24T17:01:06.084211] [INFO ] [REMOTE    ] ACA: Incremental fetch complete for 2025-10 (2.44 seconds).
[2025-10-24T17:01:06.088182] [INFO ] [REMOTE    ] ACA: Full fetch complete (34219 records).
[2025-10-24T17:01:06.088266] [DEBUG] [VALIDATOR ] ACA: Validating primary data.
[2025-10-24T17:01:06.488774] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present.
[2025-10-24T17:01:06.488909] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed.
[2025-10-24T17:01:06.489815] [INFO ] [MAIN      ] ACA: Fetched primary data is valid.
[2025-10-24T17:01:06.490466] [INFO ] [REMOTE    ] ACCO: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T17:01:06.490550] [DEBUG] [LOCAL     ] ACA: Saving primary data.
[2025-10-24T17:01:06.497925] [INFO ] [REMOTE    ] ACCO: Fetching primary data for 2025-03.
[2025-10-24T17:01:06.498100] [FATAL] [LOCAL     ] ACA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:01:06.498935] [FATAL] [MAIN      ] ACA: Failed to save primary data.
[2025-10-24T17:01:06.499025] [WARN ] [MAIN      ] ACA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:01:06.499117] [INFO ] [LOCAL     ] ACA: Starting deletion of primary data.
[2025-10-24T17:01:06.499193] [DEBUG] [LOCAL     ] ACA: No primary data file found to delete.
[2025-10-24T17:01:06.499232] [INFO ] [LOCAL     ] ACA: Starting deletion of derivative data.
[2025-10-24T17:01:06.499402] [DEBUG] [LOCAL     ] ACA: Deleted derivative data file.
[2025-10-24T17:01:06.499494] [INFO ] [MAIN      ] Update Progress: 14/2366 symbols completed. ACA took 14.8s. Estimated remaining: 2h 58m 5s. Rate: 13.2 symbols/min
[2025-10-24T17:01:06.675046] [INFO ] [MAIN      ] ACEL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:01:06.701859] [DEBUG] [LOCAL     ] ACEL: Loaded 26458 existing records from primary storage.
[2025-10-24T17:01:06.702113] [INFO ] [MAIN      ] ACEL: Loaded 26458 existing records.
[2025-10-24T17:01:06.886308] [WARN ] [MAIN      ] ACEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:01:06.886554] [INFO ] [MAIN      ] ACEL: Wiping existing primary data before full refresh.
[2025-10-24T17:01:06.886637] [INFO ] [LOCAL     ] ACEL: Starting deletion of primary data.
[2025-10-24T17:01:06.887254] [DEBUG] [LOCAL     ] ACEL: Deleted primary data file.
[2025-10-24T17:01:06.887311] [INFO ] [MAIN      ] ACEL: Starting full primary refresh.
[2025-10-24T17:01:07.275365] [INFO ] [REMOTE    ] ACEL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:01:07.276104] [INFO ] [REMOTE    ] ACEL: Fetching primary data for 2025-01.
[2025-10-24T17:01:07.311208] [INFO ] [REMOTE    ] ABT: Incremental fetch complete for 2025-07 (1.96 seconds).
[2025-10-24T17:01:07.324185] [INFO ] [REMOTE    ] ABT: Fetching primary data for 2025-08.
[2025-10-24T17:01:07.353528] [INFO ] [REMOTE    ] ABR: Incremental fetch complete for 2025-09 (2.22 seconds).
[2025-10-24T17:01:07.365014] [INFO ] [REMOTE    ] ABR: Fetching primary data for 2025-10.
[2025-10-24T17:01:08.178069] [INFO ] [REMOTE    ] ACCO: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T17:01:08.187479] [INFO ] [REMOTE    ] ACCO: Fetching primary data for 2025-04.
[2025-10-24T17:01:08.238472] [INFO ] [REMOTE    ] ACEL: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T17:01:08.947610] [INFO ] [REMOTE    ] ACEL: Fetching primary data for 2025-02.
[2025-10-24T17:01:09.056716] [INFO ] [REMOTE    ] ABT: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T17:01:09.169069] [INFO ] [REMOTE    ] ABR: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T17:01:09.180832] [INFO ] [REMOTE    ] ABR: Full fetch complete (75363 records).
[2025-10-24T17:01:09.180978] [DEBUG] [VALIDATOR ] ABR: Validating primary data.
[2025-10-24T17:01:09.582169] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present.
[2025-10-24T17:01:09.582249] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed.
[2025-10-24T17:01:09.582998] [INFO ] [MAIN      ] ABR: Fetched primary data is valid.
[2025-10-24T17:01:09.583063] [DEBUG] [LOCAL     ] ABR: Saving primary data.
[2025-10-24T17:01:09.583695] [FATAL] [LOCAL     ] ABR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:01:09.583788] [FATAL] [MAIN      ] ABR: Failed to save primary data.
[2025-10-24T17:01:09.583834] [WARN ] [MAIN      ] ABR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:01:09.583871] [INFO ] [LOCAL     ] ABR: Starting deletion of primary data.
[2025-10-24T17:01:09.583925] [DEBUG] [LOCAL     ] ABR: No primary data file found to delete.
[2025-10-24T17:01:09.583963] [INFO ] [LOCAL     ] ABR: Starting deletion of derivative data.
[2025-10-24T17:01:09.584117] [DEBUG] [LOCAL     ] ABR: Deleted derivative data file.
[2025-10-24T17:01:09.584981] [INFO ] [MAIN      ] Update Progress: 15/2366 symbols completed. ABR took 20.7s. Estimated remaining: 2h 54m 12s. Rate: 13.5 symbols/min
[2025-10-24T17:01:09.755878] [INFO ] [REMOTE    ] ABT: Fetching primary data for 2025-09.
[2025-10-24T17:01:09.788978] [INFO ] [MAIN      ] ACHR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:01:09.848943] [DEBUG] [LOCAL     ] ACHR: Loaded 54208 existing records from primary storage.
[2025-10-24T17:01:09.849450] [INFO ] [MAIN      ] ACHR: Loaded 54208 existing records.
[2025-10-24T17:01:10.068425] [INFO ] [REMOTE    ] ACCO: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T17:01:10.103831] [WARN ] [MAIN      ] ACHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:01:10.112539] [INFO ] [MAIN      ] ACHR: Wiping existing primary data before full refresh.
[2025-10-24T17:01:10.119075] [INFO ] [LOCAL     ] ACHR: Starting deletion of primary data.
[2025-10-24T17:01:10.129280] [INFO ] [REMOTE    ] ACEL: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T17:01:10.134844] [DEBUG] [LOCAL     ] ACHR: Deleted primary data file.
[2025-10-24T17:01:10.135341] [INFO ] [MAIN      ] ACHR: Starting full primary refresh.
[2025-10-24T17:01:10.494195] [INFO ] [REMOTE    ] ACHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:01:10.547717] [INFO ] [REMOTE    ] ACHR: Fetching primary data for 2025-01.
[2025-10-24T17:01:11.347743] [INFO ] [REMOTE    ] ACCO: Fetching primary data for 2025-05.
[2025-10-24T17:01:11.531167] [INFO ] [REMOTE    ] ABT: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T17:01:12.147752] [INFO ] [REMOTE    ] ABT: Fetching primary data for 2025-10.
[2025-10-24T17:01:12.644228] [INFO ] [REMOTE    ] ACCO: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T17:01:12.752996] [INFO ] [REMOTE    ] ACHR: Incremental fetch complete for 2025-01 (2.21 seconds).
[2025-10-24T17:01:12.947676] [INFO ] [REMOTE    ] ACHR: Fetching primary data for 2025-02.
[2025-10-24T17:01:13.747746] [INFO ] [REMOTE    ] ACCO: Fetching primary data for 2025-06.
[2025-10-24T17:01:13.975074] [INFO ] [REMOTE    ] ABT: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T17:01:13.985081] [INFO ] [REMOTE    ] ABT: Full fetch complete (77772 records).
[2025-10-24T17:01:13.985220] [DEBUG] [VALIDATOR ] ABT: Validating primary data.
[2025-10-24T17:01:14.401529] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present.
[2025-10-24T17:01:14.401677] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed.
[2025-10-24T17:01:14.402525] [INFO ] [MAIN      ] ABT: Fetched primary data is valid.
[2025-10-24T17:01:14.402590] [DEBUG] [LOCAL     ] ABT: Saving primary data.
[2025-10-24T17:01:14.403345] [FATAL] [LOCAL     ] ABT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:01:14.403435] [FATAL] [MAIN      ] ABT: Failed to save primary data.
[2025-10-24T17:01:14.403477] [WARN ] [MAIN      ] ABT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:01:14.403512] [INFO ] [LOCAL     ] ABT: Starting deletion of primary data.
[2025-10-24T17:01:14.403575] [DEBUG] [LOCAL     ] ABT: No primary data file found to delete.
[2025-10-24T17:01:14.403611] [INFO ] [LOCAL     ] ABT: Starting deletion of derivative data.
[2025-10-24T17:01:14.403909] [DEBUG] [LOCAL     ] ABT: Deleted derivative data file.
[2025-10-24T17:01:14.405174] [INFO ] [MAIN      ] Update Progress: 16/2366 symbols completed. ABT took 23.9s. Estimated remaining: 2h 55m 3s. Rate: 13.4 symbols/min
[2025-10-24T17:01:14.572092] [INFO ] [REMOTE    ] ACEL: Fetching primary data for 2025-03.
[2025-10-24T17:01:14.574586] [INFO ] [MAIN      ] ACI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:01:14.625982] [DEBUG] [LOCAL     ] ACI: Loaded 53675 existing records from primary storage.
[2025-10-24T17:01:14.626310] [INFO ] [MAIN      ] ACI: Loaded 53675 existing records.
[2025-10-24T17:01:14.805686] [WARN ] [MAIN      ] ACI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:01:14.805892] [INFO ] [MAIN      ] ACI: Wiping existing primary data before full refresh.
[2025-10-24T17:01:14.805938] [INFO ] [LOCAL     ] ACI: Starting deletion of primary data.
[2025-10-24T17:01:14.806823] [DEBUG] [LOCAL     ] ACI: Deleted primary data file.
[2025-10-24T17:01:14.806880] [INFO ] [MAIN      ] ACI: Starting full primary refresh.
[2025-10-24T17:01:15.194275] [INFO ] [REMOTE    ] ACCO: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T17:01:15.216033] [INFO ] [REMOTE    ] ACI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:01:15.249890] [INFO ] [REMOTE    ] ACHR: Incremental fetch complete for 2025-02 (2.30 seconds).
[2025-10-24T17:01:15.347673] [INFO ] [REMOTE    ] ACI: Fetching primary data for 2025-01.
[2025-10-24T17:01:15.530292] [INFO ] [REMOTE    ] ACEL: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T17:01:16.147670] [INFO ] [REMOTE    ] ACCO: Fetching primary data for 2025-07.
[2025-10-24T17:01:16.947621] [INFO ] [REMOTE    ] ACEL: Fetching primary data for 2025-04.
[2025-10-24T17:01:17.031682] [INFO ] [REMOTE    ] ACI: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T17:01:17.212506] [INFO ] [REMOTE    ] ACCO: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T17:01:17.747695] [INFO ] [REMOTE    ] ACCO: Fetching primary data for 2025-08.
[2025-10-24T17:01:18.179685] [INFO ] [REMOTE    ] ACEL: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T17:01:18.547751] [INFO ] [REMOTE    ] ACI: Fetching primary data for 2025-02.
[2025-10-24T17:01:18.985368] [INFO ] [REMOTE    ] ACCO: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T17:01:19.347708] [INFO ] [REMOTE    ] ACCO: Fetching primary data for 2025-09.
[2025-10-24T17:01:19.905546] [INFO ] [REMOTE    ] ACI: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T17:01:20.147727] [INFO ] [REMOTE    ] ACI: Fetching primary data for 2025-03.
[2025-10-24T17:01:20.680114] [INFO ] [REMOTE    ] ACCO: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T17:01:20.947748] [INFO ] [REMOTE    ] ACEL: Fetching primary data for 2025-05.
[2025-10-24T17:01:21.747624] [INFO ] [REMOTE    ] ACCO: Fetching primary data for 2025-10.
[2025-10-24T17:01:21.927955] [INFO ] [REMOTE    ] ACI: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T17:01:22.286558] [INFO ] [REMOTE    ] ACEL: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T17:01:22.547669] [INFO ] [REMOTE    ] ACHR: Fetching primary data for 2025-03.
[2025-10-24T17:01:22.953937] [INFO ] [REMOTE    ] ACCO: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T17:01:22.960880] [INFO ] [REMOTE    ] ACCO: Full fetch complete (53906 records).
[2025-10-24T17:01:22.961016] [DEBUG] [VALIDATOR ] ACCO: Validating primary data.
[2025-10-24T17:01:23.349879] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present.
[2025-10-24T17:01:23.349586] [INFO ] [REMOTE    ] ACI: Fetching primary data for 2025-04.
[2025-10-24T17:01:23.350404] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed.
[2025-10-24T17:01:23.351800] [INFO ] [MAIN      ] ACCO: Fetched primary data is valid.
[2025-10-24T17:01:23.351871] [DEBUG] [LOCAL     ] ACCO: Saving primary data.
[2025-10-24T17:01:23.352497] [FATAL] [LOCAL     ] ACCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:01:23.352589] [FATAL] [MAIN      ] ACCO: Failed to save primary data.
[2025-10-24T17:01:23.352682] [WARN ] [MAIN      ] ACCO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:01:23.352752] [INFO ] [LOCAL     ] ACCO: Starting deletion of primary data.
[2025-10-24T17:01:23.352818] [DEBUG] [LOCAL     ] ACCO: No primary data file found to delete.
[2025-10-24T17:01:23.352854] [INFO ] [LOCAL     ] ACCO: Starting deletion of derivative data.
[2025-10-24T17:01:23.353021] [DEBUG] [LOCAL     ] ACCO: Deleted derivative data file.
[2025-10-24T17:01:23.354073] [INFO ] [MAIN      ] Update Progress: 17/2366 symbols completed. ACCO took 23.4s. Estimated remaining: 3h 5m 17s. Rate: 12.7 symbols/min
[2025-10-24T17:01:23.525559] [INFO ] [MAIN      ] ACM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:01:23.570810] [DEBUG] [LOCAL     ] ACM: Loaded 43000 existing records from primary storage.
[2025-10-24T17:01:23.571111] [INFO ] [MAIN      ] ACM: Loaded 43000 existing records.
[2025-10-24T17:01:23.760700] [WARN ] [MAIN      ] ACM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:01:23.760921] [INFO ] [MAIN      ] ACM: Wiping existing primary data before full refresh.
[2025-10-24T17:01:23.760967] [INFO ] [LOCAL     ] ACM: Starting deletion of primary data.
[2025-10-24T17:01:23.761825] [DEBUG] [LOCAL     ] ACM: Deleted primary data file.
[2025-10-24T17:01:23.761885] [INFO ] [MAIN      ] ACM: Starting full primary refresh.
[2025-10-24T17:01:24.153608] [INFO ] [REMOTE    ] ACEL: Fetching primary data for 2025-06.
[2025-10-24T17:01:24.170590] [INFO ] [REMOTE    ] ACM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:01:24.934961] [INFO ] [REMOTE    ] ACI: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T17:01:24.947884] [INFO ] [REMOTE    ] ACM: Fetching primary data for 2025-01.
[2025-10-24T17:01:24.995746] [INFO ] [REMOTE    ] ACHR: Incremental fetch complete for 2025-03 (2.45 seconds).
[2025-10-24T17:01:25.084853] [INFO ] [REMOTE    ] ACEL: Incremental fetch complete for 2025-06 (0.93 seconds).
[2025-10-24T17:01:25.747673] [INFO ] [REMOTE    ] ACEL: Fetching primary data for 2025-07.
[2025-10-24T17:01:26.161936] [INFO ] [REMOTE    ] ACM: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T17:01:26.547632] [INFO ] [REMOTE    ] ACHR: Fetching primary data for 2025-04.
[2025-10-24T17:01:26.586586] [INFO ] [REMOTE    ] ACEL: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T17:01:27.347726] [INFO ] [REMOTE    ] ACM: Fetching primary data for 2025-02.
[2025-10-24T17:01:28.147690] [INFO ] [REMOTE    ] ACI: Fetching primary data for 2025-05.
[2025-10-24T17:01:28.770178] [INFO ] [REMOTE    ] ACHR: Incremental fetch complete for 2025-04 (2.22 seconds).
[2025-10-24T17:01:28.894937] [INFO ] [REMOTE    ] ACM: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T17:01:28.947717] [INFO ] [REMOTE    ] ACHR: Fetching primary data for 2025-05.
[2025-10-24T17:01:29.734001] [INFO ] [REMOTE    ] ACI: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T17:01:29.747609] [INFO ] [REMOTE    ] ACI: Fetching primary data for 2025-06.
[2025-10-24T17:01:30.547729] [INFO ] [REMOTE    ] ACEL: Fetching primary data for 2025-08.
[2025-10-24T17:01:31.342986] [INFO ] [REMOTE    ] ACI: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T17:01:31.353839] [INFO ] [REMOTE    ] ACM: Fetching primary data for 2025-03.
[2025-10-24T17:01:31.594560] [INFO ] [REMOTE    ] ACEL: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T17:01:31.654720] [INFO ] [REMOTE    ] ACHR: Incremental fetch complete for 2025-05 (2.71 seconds).
[2025-10-24T17:01:32.147686] [INFO ] [REMOTE    ] ACI: Fetching primary data for 2025-07.
[2025-10-24T17:01:32.573304] [INFO ] [REMOTE    ] ACM: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T17:01:32.947681] [INFO ] [REMOTE    ] ACEL: Fetching primary data for 2025-09.
[2025-10-24T17:01:33.475581] [INFO ] [REMOTE    ] ACI: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T17:01:33.695288] [INFO ] [REMOTE    ] ACEL: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T17:01:33.747606] [INFO ] [REMOTE    ] ACEL: Fetching primary data for 2025-10.
[2025-10-24T17:01:34.547608] [INFO ] [REMOTE    ] ACHR: Fetching primary data for 2025-06.
[2025-10-24T17:01:34.685299] [INFO ] [REMOTE    ] ACEL: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T17:01:34.689913] [INFO ] [REMOTE    ] ACEL: Full fetch complete (38526 records).
[2025-10-24T17:01:34.690057] [DEBUG] [VALIDATOR ] ACEL: Validating primary data.
[2025-10-24T17:01:34.690761] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:01:34.690848] [FATAL] [MAIN      ] ACEL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:01:34.690891] [WARN ] [MAIN      ] ACEL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:01:34.690932] [INFO ] [LOCAL     ] ACEL: Starting deletion of primary data.
[2025-10-24T17:01:34.690991] [DEBUG] [LOCAL     ] ACEL: No primary data file found to delete.
[2025-10-24T17:01:34.691042] [INFO ] [LOCAL     ] ACEL: Starting deletion of derivative data.
[2025-10-24T17:01:34.691269] [DEBUG] [LOCAL     ] ACEL: Deleted derivative data file.
[2025-10-24T17:01:34.691376] [INFO ] [MAIN      ] Update Progress: 18/2366 symbols completed. ACEL took 28.2s. Estimated remaining: 3h 19m 34s. Rate: 11.8 symbols/min
[2025-10-24T17:01:34.889544] [INFO ] [MAIN      ] ACN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:01:34.942687] [DEBUG] [LOCAL     ] ACN: Loaded 53828 existing records from primary storage.
[2025-10-24T17:01:34.943012] [INFO ] [MAIN      ] ACN: Loaded 53828 existing records.
[2025-10-24T17:01:35.150828] [WARN ] [MAIN      ] ACN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:01:35.151066] [INFO ] [MAIN      ] ACN: Wiping existing primary data before full refresh.
[2025-10-24T17:01:35.151134] [INFO ] [LOCAL     ] ACN: Starting deletion of primary data.
[2025-10-24T17:01:35.152282] [DEBUG] [LOCAL     ] ACN: Deleted primary data file.
[2025-10-24T17:01:35.152342] [INFO ] [MAIN      ] ACN: Starting full primary refresh.
[2025-10-24T17:01:35.359942] [INFO ] [REMOTE    ] ACI: Fetching primary data for 2025-08.
[2025-10-24T17:01:35.508331] [INFO ] [REMOTE    ] ACN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:01:36.147667] [INFO ] [REMOTE    ] ACN: Fetching primary data for 2025-01.
[2025-10-24T17:01:36.947621] [INFO ] [REMOTE    ] ACM: Fetching primary data for 2025-04.
[2025-10-24T17:01:37.186861] [INFO ] [REMOTE    ] ACI: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T17:01:37.231793] [INFO ] [REMOTE    ] ACHR: Incremental fetch complete for 2025-06 (2.68 seconds).
[2025-10-24T17:01:37.747710] [INFO ] [REMOTE    ] ACI: Fetching primary data for 2025-09.
[2025-10-24T17:01:38.169162] [INFO ] [REMOTE    ] ACN: Incremental fetch complete for 2025-01 (2.02 seconds).
[2025-10-24T17:01:38.295506] [INFO ] [REMOTE    ] ACM: Incremental fetch complete for 2025-04 (1.35 seconds).
[2025-10-24T17:01:38.547674] [INFO ] [REMOTE    ] ACM: Fetching primary data for 2025-05.
[2025-10-24T17:01:39.132319] [INFO ] [REMOTE    ] ACI: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T17:01:39.347713] [INFO ] [REMOTE    ] ACI: Fetching primary data for 2025-10.
[2025-10-24T17:01:39.693692] [INFO ] [REMOTE    ] ACM: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T17:01:40.147678] [INFO ] [REMOTE    ] ACM: Fetching primary data for 2025-06.
[2025-10-24T17:01:40.947688] [INFO ] [REMOTE    ] ACHR: Fetching primary data for 2025-07.
[2025-10-24T17:01:41.486543] [INFO ] [REMOTE    ] ACM: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T17:01:41.573882] [INFO ] [REMOTE    ] ACI: Incremental fetch complete for 2025-10 (2.23 seconds).
[2025-10-24T17:01:41.583618] [INFO ] [REMOTE    ] ACI: Full fetch complete (77232 records).
[2025-10-24T17:01:41.583797] [DEBUG] [VALIDATOR ] ACI: Validating primary data.
[2025-10-24T17:01:41.750925] [INFO ] [REMOTE    ] ACM: Fetching primary data for 2025-07.
[2025-10-24T17:01:41.999206] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present.
[2025-10-24T17:01:41.999288] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed.
[2025-10-24T17:01:42.000081] [INFO ] [MAIN      ] ACI: Fetched primary data is valid.
[2025-10-24T17:01:42.000149] [DEBUG] [LOCAL     ] ACI: Saving primary data.
[2025-10-24T17:01:42.000802] [FATAL] [LOCAL     ] ACI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:01:42.000891] [FATAL] [MAIN      ] ACI: Failed to save primary data.
[2025-10-24T17:01:42.000935] [WARN ] [MAIN      ] ACI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:01:42.000972] [INFO ] [LOCAL     ] ACI: Starting deletion of primary data.
[2025-10-24T17:01:42.001026] [DEBUG] [LOCAL     ] ACI: No primary data file found to delete.
[2025-10-24T17:01:42.001110] [INFO ] [LOCAL     ] ACI: Starting deletion of derivative data.
[2025-10-24T17:01:42.001309] [DEBUG] [LOCAL     ] ACI: Deleted derivative data file.
[2025-10-24T17:01:42.001954] [INFO ] [MAIN      ] Update Progress: 19/2366 symbols completed. ACI took 27.6s. Estimated remaining: 3h 24m 2s. Rate: 11.5 symbols/min
[2025-10-24T17:01:42.186484] [INFO ] [MAIN      ] ACP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:01:42.216510] [DEBUG] [LOCAL     ] ACP: Loaded 31336 existing records from primary storage.
[2025-10-24T17:01:42.217135] [INFO ] [MAIN      ] ACP: Loaded 31336 existing records.
[2025-10-24T17:01:42.396454] [WARN ] [MAIN      ] ACP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:01:42.396703] [INFO ] [MAIN      ] ACP: Wiping existing primary data before full refresh.
[2025-10-24T17:01:42.396760] [INFO ] [LOCAL     ] ACP: Starting deletion of primary data.
[2025-10-24T17:01:42.397334] [DEBUG] [LOCAL     ] ACP: Deleted primary data file.
[2025-10-24T17:01:42.397390] [INFO ] [MAIN      ] ACP: Starting full primary refresh.
[2025-10-24T17:01:42.553876] [INFO ] [REMOTE    ] ACN: Fetching primary data for 2025-02.
[2025-10-24T17:01:42.780638] [INFO ] [REMOTE    ] ACP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:01:43.169947] [INFO ] [REMOTE    ] ACM: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T17:01:43.362293] [INFO ] [REMOTE    ] ACP: Fetching primary data for 2025-01.
[2025-10-24T17:01:43.364888] [INFO ] [REMOTE    ] ACHR: Incremental fetch complete for 2025-07 (2.42 seconds).
[2025-10-24T17:01:44.145554] [INFO ] [REMOTE    ] ACN: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T17:01:44.154570] [INFO ] [REMOTE    ] ACHR: Fetching primary data for 2025-08.
[2025-10-24T17:01:44.406197] [INFO ] [REMOTE    ] ACP: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T17:01:44.947703] [INFO ] [REMOTE    ] ACM: Fetching primary data for 2025-08.
[2025-10-24T17:01:45.747756] [INFO ] [REMOTE    ] ACP: Fetching primary data for 2025-02.
[2025-10-24T17:01:46.154373] [INFO ] [REMOTE    ] ACHR: Incremental fetch complete for 2025-08 (2.00 seconds).
[2025-10-24T17:01:46.543057] [INFO ] [REMOTE    ] ACM: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T17:01:46.551322] [INFO ] [REMOTE    ] ACHR: Fetching primary data for 2025-09.
[2025-10-24T17:01:46.653035] [INFO ] [REMOTE    ] ACP: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T17:01:47.347742] [INFO ] [REMOTE    ] ACP: Fetching primary data for 2025-03.
[2025-10-24T17:01:48.147696] [INFO ] [REMOTE    ] ACN: Fetching primary data for 2025-03.
[2025-10-24T17:01:48.681435] [INFO ] [REMOTE    ] ACP: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T17:01:48.860514] [INFO ] [REMOTE    ] ACHR: Incremental fetch complete for 2025-09 (2.31 seconds).
[2025-10-24T17:01:48.947623] [INFO ] [REMOTE    ] ACM: Fetching primary data for 2025-09.
[2025-10-24T17:01:49.747727] [INFO ] [REMOTE    ] ACHR: Fetching primary data for 2025-10.
[2025-10-24T17:01:50.203408] [INFO ] [REMOTE    ] ACM: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T17:01:50.256616] [INFO ] [REMOTE    ] ACN: Incremental fetch complete for 2025-03 (2.11 seconds).
[2025-10-24T17:01:50.547638] [INFO ] [REMOTE    ] ACM: Fetching primary data for 2025-10.
[2025-10-24T17:01:51.347731] [INFO ] [REMOTE    ] ACN: Fetching primary data for 2025-04.
[2025-10-24T17:01:52.057081] [INFO ] [REMOTE    ] ACM: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T17:01:52.064741] [INFO ] [REMOTE    ] ACM: Full fetch complete (63004 records).
[2025-10-24T17:01:52.064922] [DEBUG] [VALIDATOR ] ACM: Validating primary data.
[2025-10-24T17:01:52.065793] [FATAL] [VALIDATOR ] ACM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:01:52.065907] [FATAL] [MAIN      ] ACM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:01:52.065983] [WARN ] [MAIN      ] ACM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:01:52.066067] [INFO ] [LOCAL     ] ACM: Starting deletion of primary data.
[2025-10-24T17:01:52.066157] [DEBUG] [LOCAL     ] ACM: No primary data file found to delete.
[2025-10-24T17:01:52.066220] [INFO ] [LOCAL     ] ACM: Starting deletion of derivative data.
[2025-10-24T17:01:52.066398] [DEBUG] [LOCAL     ] ACM: Deleted derivative data file.
[2025-10-24T17:01:52.066991] [INFO ] [MAIN      ] Update Progress: 20/2366 symbols completed. ACM took 28.7s. Estimated remaining: 3h 33m 25s. Rate: 11.0 symbols/min
[2025-10-24T17:01:52.152766] [INFO ] [REMOTE    ] ACP: Fetching primary data for 2025-04.
[2025-10-24T17:01:52.250849] [INFO ] [MAIN      ] ACR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:01:52.259633] [DEBUG] [LOCAL     ] ACR: Loaded 5325 existing records from primary storage.
[2025-10-24T17:01:52.259915] [INFO ] [MAIN      ] ACR: Loaded 5325 existing records.
[2025-10-24T17:01:52.473393] [WARN ] [MAIN      ] ACR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:01:52.473834] [INFO ] [MAIN      ] ACR: Wiping existing primary data before full refresh.
[2025-10-24T17:01:52.473936] [INFO ] [LOCAL     ] ACR: Starting deletion of primary data.
[2025-10-24T17:01:52.474268] [DEBUG] [LOCAL     ] ACR: Deleted primary data file.
[2025-10-24T17:01:52.474407] [INFO ] [MAIN      ] ACR: Starting full primary refresh.
[2025-10-24T17:01:52.821137] [INFO ] [REMOTE    ] ACHR: Incremental fetch complete for 2025-10 (3.07 seconds).
[2025-10-24T17:01:52.858135] [INFO ] [REMOTE    ] ACHR: Full fetch complete (77998 records).
[2025-10-24T17:01:52.868593] [DEBUG] [VALIDATOR ] ACHR: Validating primary data.
[2025-10-24T17:01:52.957091] [INFO ] [REMOTE    ] ACR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:01:52.981369] [INFO ] [REMOTE    ] ACR: Fetching primary data for 2025-01.
[2025-10-24T17:01:53.354054] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present.
[2025-10-24T17:01:53.354245] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed.
[2025-10-24T17:01:53.355405] [INFO ] [MAIN      ] ACHR: Fetched primary data is valid.
[2025-10-24T17:01:53.355500] [DEBUG] [LOCAL     ] ACHR: Saving primary data.
[2025-10-24T17:01:53.356672] [FATAL] [LOCAL     ] ACHR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:01:53.356773] [FATAL] [MAIN      ] ACHR: Failed to save primary data.
[2025-10-24T17:01:53.356826] [WARN ] [MAIN      ] ACHR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:01:53.356869] [INFO ] [LOCAL     ] ACHR: Starting deletion of primary data.
[2025-10-24T17:01:53.356925] [DEBUG] [LOCAL     ] ACHR: No primary data file found to delete.
[2025-10-24T17:01:53.356961] [INFO ] [LOCAL     ] ACHR: Starting deletion of derivative data.
[2025-10-24T17:01:53.357107] [DEBUG] [LOCAL     ] ACHR: Deleted derivative data file.
[2025-10-24T17:01:53.357679] [INFO ] [MAIN      ] Update Progress: 21/2366 symbols completed. ACHR took 43.8s. Estimated remaining: 3h 25m 35s. Rate: 11.4 symbols/min
[2025-10-24T17:01:53.519606] [INFO ] [REMOTE    ] ACP: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T17:01:53.590210] [INFO ] [MAIN      ] ACRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:01:53.622244] [INFO ] [REMOTE    ] ACN: Incremental fetch complete for 2025-04 (2.27 seconds).
[2025-10-24T17:01:53.661794] [DEBUG] [LOCAL     ] ACRE: Loaded 33455 existing records from primary storage.
[2025-10-24T17:01:53.662071] [INFO ] [MAIN      ] ACRE: Loaded 33455 existing records.
[2025-10-24T17:01:53.754535] [INFO ] [REMOTE    ] ACP: Fetching primary data for 2025-05.
[2025-10-24T17:01:53.847835] [WARN ] [MAIN      ] ACRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:01:53.848441] [INFO ] [MAIN      ] ACRE: Wiping existing primary data before full refresh.
[2025-10-24T17:01:53.848570] [INFO ] [LOCAL     ] ACRE: Starting deletion of primary data.
[2025-10-24T17:01:53.849283] [DEBUG] [LOCAL     ] ACRE: Deleted primary data file.
[2025-10-24T17:01:53.849376] [INFO ] [MAIN      ] ACRE: Starting full primary refresh.
[2025-10-24T17:01:53.959156] [INFO ] [REMOTE    ] ACR: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T17:01:54.218775] [INFO ] [REMOTE    ] ACRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:01:54.547638] [INFO ] [REMOTE    ] ACRE: Fetching primary data for 2025-01.
[2025-10-24T17:01:55.157049] [INFO ] [REMOTE    ] ACP: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T17:01:55.347699] [INFO ] [REMOTE    ] ACR: Fetching primary data for 2025-02.
[2025-10-24T17:01:56.003046] [INFO ] [REMOTE    ] ACR: Incremental fetch complete for 2025-02 (0.66 seconds).
[2025-10-24T17:01:56.147635] [INFO ] [REMOTE    ] ACP: Fetching primary data for 2025-06.
[2025-10-24T17:01:56.256487] [INFO ] [REMOTE    ] ACRE: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T17:01:56.947615] [INFO ] [REMOTE    ] ACR: Fetching primary data for 2025-03.
[2025-10-24T17:01:57.230610] [INFO ] [REMOTE    ] ACP: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T17:01:57.696095] [INFO ] [REMOTE    ] ACR: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T17:01:57.747728] [INFO ] [REMOTE    ] ACR: Fetching primary data for 2025-04.
[2025-10-24T17:01:58.547753] [INFO ] [REMOTE    ] ACRE: Fetching primary data for 2025-02.
[2025-10-24T17:01:58.637388] [INFO ] [REMOTE    ] ACR: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T17:01:59.347700] [INFO ] [REMOTE    ] ACP: Fetching primary data for 2025-07.
[2025-10-24T17:01:59.614391] [INFO ] [REMOTE    ] ACRE: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T17:02:00.147713] [INFO ] [REMOTE    ] ACR: Fetching primary data for 2025-05.
[2025-10-24T17:02:00.947680] [INFO ] [REMOTE    ] ACRE: Fetching primary data for 2025-03.
[2025-10-24T17:02:01.341344] [INFO ] [REMOTE    ] ACR: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T17:02:01.513090] [INFO ] [REMOTE    ] ACP: Incremental fetch complete for 2025-07 (2.17 seconds).
[2025-10-24T17:02:01.747691] [INFO ] [REMOTE    ] ACN: Fetching primary data for 2025-05.
[2025-10-24T17:02:02.547728] [INFO ] [REMOTE    ] ACP: Fetching primary data for 2025-08.
[2025-10-24T17:02:03.347753] [INFO ] [REMOTE    ] ACR: Fetching primary data for 2025-06.
[2025-10-24T17:02:03.442888] [INFO ] [REMOTE    ] ACRE: Incremental fetch complete for 2025-03 (2.50 seconds).
[2025-10-24T17:02:04.147698] [INFO ] [REMOTE    ] ACRE: Fetching primary data for 2025-04.
[2025-10-24T17:02:04.295777] [INFO ] [REMOTE    ] ACP: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T17:02:04.854541] [INFO ] [REMOTE    ] ACN: Incremental fetch complete for 2025-05 (3.11 seconds).
[2025-10-24T17:02:04.947716] [INFO ] [REMOTE    ] ACN: Fetching primary data for 2025-06.
[2025-10-24T17:02:05.049719] [INFO ] [REMOTE    ] ACR: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T17:02:05.747703] [INFO ] [REMOTE    ] ACP: Fetching primary data for 2025-09.
[2025-10-24T17:02:06.547621] [INFO ] [REMOTE    ] ACR: Fetching primary data for 2025-07.
[2025-10-24T17:02:06.625545] [INFO ] [REMOTE    ] ACRE: Incremental fetch complete for 2025-04 (2.48 seconds).
[2025-10-24T17:02:06.891160] [INFO ] [REMOTE    ] ACN: Incremental fetch complete for 2025-06 (1.94 seconds).
[2025-10-24T17:02:07.041106] [INFO ] [REMOTE    ] ACP: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T17:02:07.164144] [INFO ] [REMOTE    ] ACR: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T17:02:07.347685] [INFO ] [REMOTE    ] ACP: Fetching primary data for 2025-10.
[2025-10-24T17:02:08.147705] [INFO ] [REMOTE    ] ACRE: Fetching primary data for 2025-05.
[2025-10-24T17:02:08.684790] [INFO ] [REMOTE    ] ACP: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T17:02:08.693979] [INFO ] [REMOTE    ] ACP: Full fetch complete (46426 records).
[2025-10-24T17:02:08.694122] [DEBUG] [VALIDATOR ] ACP: Validating primary data.
[2025-10-24T17:02:08.952934] [INFO ] [REMOTE    ] ACN: Fetching primary data for 2025-07.
[2025-10-24T17:02:09.112218] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present.
[2025-10-24T17:02:09.112302] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed.
[2025-10-24T17:02:09.112854] [INFO ] [MAIN      ] ACP: Fetched primary data is valid.
[2025-10-24T17:02:09.112966] [DEBUG] [LOCAL     ] ACP: Saving primary data.
[2025-10-24T17:02:09.113483] [FATAL] [LOCAL     ] ACP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:02:09.113569] [FATAL] [MAIN      ] ACP: Failed to save primary data.
[2025-10-24T17:02:09.113637] [WARN ] [MAIN      ] ACP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:02:09.113746] [INFO ] [LOCAL     ] ACP: Starting deletion of primary data.
[2025-10-24T17:02:09.113813] [DEBUG] [LOCAL     ] ACP: No primary data file found to delete.
[2025-10-24T17:02:09.113853] [INFO ] [LOCAL     ] ACP: Starting deletion of derivative data.
[2025-10-24T17:02:09.114094] [DEBUG] [LOCAL     ] ACP: Deleted derivative data file.
[2025-10-24T17:02:09.114223] [INFO ] [MAIN      ] Update Progress: 22/2366 symbols completed. ACP took 27.1s. Estimated remaining: 3h 44m 8s. Rate: 10.5 symbols/min
[2025-10-24T17:02:09.329711] [INFO ] [MAIN      ] ACV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:02:09.340136] [DEBUG] [LOCAL     ] ACV: Loaded 7456 existing records from primary storage.
[2025-10-24T17:02:09.340379] [INFO ] [MAIN      ] ACV: Loaded 7456 existing records.
[2025-10-24T17:02:09.490560] [INFO ] [REMOTE    ] ACRE: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T17:02:09.552702] [WARN ] [MAIN      ] ACV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:02:09.553164] [INFO ] [MAIN      ] ACV: Wiping existing primary data before full refresh.
[2025-10-24T17:02:09.553213] [INFO ] [LOCAL     ] ACV: Starting deletion of primary data.
[2025-10-24T17:02:09.553447] [DEBUG] [LOCAL     ] ACV: Deleted primary data file.
[2025-10-24T17:02:09.553508] [INFO ] [MAIN      ] ACV: Starting full primary refresh.
[2025-10-24T17:02:09.753411] [INFO ] [REMOTE    ] ACRE: Fetching primary data for 2025-06.
[2025-10-24T17:02:09.969764] [INFO ] [REMOTE    ] ACV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:02:10.547679] [INFO ] [REMOTE    ] ACR: Fetching primary data for 2025-08.
[2025-10-24T17:02:10.913955] [INFO ] [REMOTE    ] ACN: Incremental fetch complete for 2025-07 (1.96 seconds).
[2025-10-24T17:02:11.127430] [INFO ] [REMOTE    ] ACR: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T17:02:11.198178] [INFO ] [REMOTE    ] ACRE: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T17:02:11.347701] [INFO ] [REMOTE    ] ACN: Fetching primary data for 2025-08.
[2025-10-24T17:02:12.147709] [INFO ] [REMOTE    ] ACR: Fetching primary data for 2025-09.
[2025-10-24T17:02:12.542710] [INFO ] [REMOTE    ] ACR: Incremental fetch complete for 2025-09 (0.40 seconds).
[2025-10-24T17:02:12.947716] [INFO ] [REMOTE    ] ACRE: Fetching primary data for 2025-07.
[2025-10-24T17:02:13.414027] [INFO ] [REMOTE    ] ACN: Incremental fetch complete for 2025-08 (2.07 seconds).
[2025-10-24T17:02:13.747724] [INFO ] [REMOTE    ] ACN: Fetching primary data for 2025-09.
[2025-10-24T17:02:14.402167] [INFO ] [REMOTE    ] ACRE: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T17:02:14.547623] [INFO ] [REMOTE    ] ACRE: Fetching primary data for 2025-08.
[2025-10-24T17:02:15.347693] [INFO ] [REMOTE    ] ACR: Fetching primary data for 2025-10.
[2025-10-24T17:02:16.147758] [INFO ] [REMOTE    ] ACV: Fetching primary data for 2025-01.
[2025-10-24T17:02:16.209346] [INFO ] [REMOTE    ] ACR: Incremental fetch complete for 2025-10 (0.86 seconds).
[2025-10-24T17:02:16.213083] [INFO ] [REMOTE    ] ACRE: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T17:02:16.211529] [INFO ] [REMOTE    ] ACR: Full fetch complete (8532 records).
[2025-10-24T17:02:16.220892] [DEBUG] [VALIDATOR ] ACR: Validating primary data.
[2025-10-24T17:02:16.361005] [INFO ] [REMOTE    ] ACN: Incremental fetch complete for 2025-09 (2.61 seconds).
[2025-10-24T17:02:16.703395] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present.
[2025-10-24T17:02:16.703475] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed.
[2025-10-24T17:02:16.703696] [INFO ] [MAIN      ] ACR: Fetched primary data is valid.
[2025-10-24T17:02:16.703761] [DEBUG] [LOCAL     ] ACR: Saving primary data.
[2025-10-24T17:02:16.704008] [FATAL] [LOCAL     ] ACR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:02:16.704094] [FATAL] [MAIN      ] ACR: Failed to save primary data.
[2025-10-24T17:02:16.704137] [WARN ] [MAIN      ] ACR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:02:16.704173] [INFO ] [LOCAL     ] ACR: Starting deletion of primary data.
[2025-10-24T17:02:16.704225] [DEBUG] [LOCAL     ] ACR: No primary data file found to delete.
[2025-10-24T17:02:16.704262] [INFO ] [LOCAL     ] ACR: Starting deletion of derivative data.
[2025-10-24T17:02:16.704463] [DEBUG] [LOCAL     ] ACR: Deleted derivative data file.
[2025-10-24T17:02:16.704559] [INFO ] [MAIN      ] Update Progress: 23/2366 symbols completed. ACR took 24.6s. Estimated remaining: 3h 47m 11s. Rate: 10.3 symbols/min
[2025-10-24T17:02:16.899466] [INFO ] [MAIN      ] ACVA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:02:16.904898] [INFO ] [REMOTE    ] ACV: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T17:02:16.955874] [INFO ] [REMOTE    ] ACN: Fetching primary data for 2025-10.
[2025-10-24T17:02:16.959848] [DEBUG] [LOCAL     ] ACVA: Loaded 49608 existing records from primary storage.
[2025-10-24T17:02:16.960266] [INFO ] [MAIN      ] ACVA: Loaded 49608 existing records.
[2025-10-24T17:02:17.180788] [WARN ] [MAIN      ] ACVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:02:17.181014] [INFO ] [MAIN      ] ACVA: Wiping existing primary data before full refresh.
[2025-10-24T17:02:17.181064] [INFO ] [LOCAL     ] ACVA: Starting deletion of primary data.
[2025-10-24T17:02:17.182030] [DEBUG] [LOCAL     ] ACVA: Deleted primary data file.
[2025-10-24T17:02:17.182091] [INFO ] [MAIN      ] ACVA: Starting full primary refresh.
[2025-10-24T17:02:17.602521] [INFO ] [REMOTE    ] ACVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:02:17.747683] [INFO ] [REMOTE    ] ACRE: Fetching primary data for 2025-09.
[2025-10-24T17:02:18.547716] [INFO ] [REMOTE    ] ACV: Fetching primary data for 2025-02.
[2025-10-24T17:02:18.894931] [INFO ] [REMOTE    ] ACRE: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T17:02:19.164002] [INFO ] [REMOTE    ] ACV: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T17:02:19.227891] [INFO ] [REMOTE    ] ACN: Incremental fetch complete for 2025-10 (2.27 seconds).
[2025-10-24T17:02:19.238153] [INFO ] [REMOTE    ] ACN: Full fetch complete (77417 records).
[2025-10-24T17:02:19.238331] [DEBUG] [VALIDATOR ] ACN: Validating primary data.
[2025-10-24T17:02:19.352720] [INFO ] [REMOTE    ] ACRE: Fetching primary data for 2025-10.
[2025-10-24T17:02:19.639620] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present.
[2025-10-24T17:02:19.639737] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed.
[2025-10-24T17:02:19.640467] [INFO ] [MAIN      ] ACN: Fetched primary data is valid.
[2025-10-24T17:02:19.640513] [DEBUG] [LOCAL     ] ACN: Saving primary data.
[2025-10-24T17:02:19.641224] [FATAL] [LOCAL     ] ACN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:02:19.641320] [FATAL] [MAIN      ] ACN: Failed to save primary data.
[2025-10-24T17:02:19.641363] [WARN ] [MAIN      ] ACN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:02:19.641439] [INFO ] [LOCAL     ] ACN: Starting deletion of primary data.
[2025-10-24T17:02:19.641518] [DEBUG] [LOCAL     ] ACN: No primary data file found to delete.
[2025-10-24T17:02:19.641567] [INFO ] [LOCAL     ] ACN: Starting deletion of derivative data.
[2025-10-24T17:02:19.641816] [DEBUG] [LOCAL     ] ACN: Deleted derivative data file.
[2025-10-24T17:02:19.642981] [INFO ] [MAIN      ] Update Progress: 24/2366 symbols completed. ACN took 45.0s. Estimated remaining: 3h 42m 24s. Rate: 10.5 symbols/min
[2025-10-24T17:02:19.823352] [INFO ] [MAIN      ] AD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:02:19.823517] [DEBUG] [LOCAL     ] AD: No existing data file found in primary storage.
[2025-10-24T17:02:19.823554] [WARN ] [MAIN      ] AD: No existing data found, performing full refresh instead.
[2025-10-24T17:02:19.823693] [INFO ] [MAIN      ] AD: Wiping existing primary data before full refresh.
[2025-10-24T17:02:19.823749] [INFO ] [LOCAL     ] AD: Starting deletion of primary data.
[2025-10-24T17:02:19.823792] [DEBUG] [LOCAL     ] AD: No primary data file found to delete.
[2025-10-24T17:02:19.823825] [INFO ] [MAIN      ] AD: Starting full primary refresh.
[2025-10-24T17:02:20.152833] [INFO ] [REMOTE    ] ACVA: Fetching primary data for 2025-01.
[2025-10-24T17:02:20.195396] [INFO ] [REMOTE    ] AD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:02:20.872254] [INFO ] [REMOTE    ] ACRE: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T17:02:20.878036] [INFO ] [REMOTE    ] ACRE: Full fetch complete (49134 records).
[2025-10-24T17:02:20.878135] [DEBUG] [VALIDATOR ] ACRE: Validating primary data.
[2025-10-24T17:02:20.878952] [FATAL] [VALIDATOR ] ACRE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:02:20.879035] [FATAL] [MAIN      ] ACRE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:02:20.879077] [WARN ] [MAIN      ] ACRE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:02:20.879120] [INFO ] [LOCAL     ] ACRE: Starting deletion of primary data.
[2025-10-24T17:02:20.879178] [DEBUG] [LOCAL     ] ACRE: No primary data file found to delete.
[2025-10-24T17:02:20.879212] [INFO ] [LOCAL     ] ACRE: Starting deletion of derivative data.
[2025-10-24T17:02:20.879348] [DEBUG] [LOCAL     ] ACRE: Deleted derivative data file.
[2025-10-24T17:02:20.879423] [INFO ] [MAIN      ] Update Progress: 25/2366 symbols completed. ACRE took 27.5s. Estimated remaining: 3h 35m 21s. Rate: 10.9 symbols/min
[2025-10-24T17:02:20.955621] [INFO ] [REMOTE    ] AD: Fetching primary data for 2025-01.
[2025-10-24T17:02:21.052608] [INFO ] [MAIN      ] ADC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:02:21.096583] [DEBUG] [LOCAL     ] ADC: Loaded 46761 existing records from primary storage.
[2025-10-24T17:02:21.096888] [INFO ] [MAIN      ] ADC: Loaded 46761 existing records.
[2025-10-24T17:02:21.219493] [DEBUG] [REMOTE    ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:02:21.246818] [WARN ] [REMOTE    ] AD: No data returned for month 2025-01
[2025-10-24T17:02:21.271884] [FATAL] [REMOTE    ] AD: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:02:21.273735] [FATAL] [MAIN      ] AD: Failed to fetch primary data.
[2025-10-24T17:02:21.277260] [WARN ] [MAIN      ] ADC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:02:21.277510] [INFO ] [MAIN      ] ADC: Wiping existing primary data before full refresh.
[2025-10-24T17:02:21.277384] [WARN ] [MAIN      ] AD: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:02:21.277665] [INFO ] [LOCAL     ] ADC: Starting deletion of primary data.
[2025-10-24T17:02:21.277720] [INFO ] [LOCAL     ] AD: Starting deletion of primary data.
[2025-10-24T17:02:21.277879] [DEBUG] [LOCAL     ] AD: No primary data file found to delete.
[2025-10-24T17:02:21.277934] [INFO ] [LOCAL     ] AD: Starting deletion of derivative data.
[2025-10-24T17:02:21.277979] [DEBUG] [LOCAL     ] AD: No derivative data file found to delete.
[2025-10-24T17:02:21.278024] [INFO ] [MAIN      ] Update Progress: 26/2366 symbols completed. AD took 1.6s. Estimated remaining: 3h 27m 34s. Rate: 11.3 symbols/min
[2025-10-24T17:02:21.289059] [DEBUG] [LOCAL     ] ADC: Deleted primary data file.
[2025-10-24T17:02:21.309094] [INFO ] [MAIN      ] ADC: Starting full primary refresh.
[2025-10-24T17:02:21.614518] [INFO ] [MAIN      ] ADCT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:02:21.751988] [INFO ] [REMOTE    ] ACV: Fetching primary data for 2025-03.
[2025-10-24T17:02:21.889788] [INFO ] [REMOTE    ] ADC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:02:21.925612] [INFO ] [REMOTE    ] ACVA: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T17:02:21.926447] [DEBUG] [LOCAL     ] ADCT: Loaded 35735 existing records from primary storage.
[2025-10-24T17:02:21.935609] [INFO ] [MAIN      ] ADCT: Loaded 35735 existing records.
[2025-10-24T17:02:22.115117] [WARN ] [MAIN      ] ADCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:02:22.115333] [INFO ] [MAIN      ] ADCT: Wiping existing primary data before full refresh.
[2025-10-24T17:02:22.115382] [INFO ] [LOCAL     ] ADCT: Starting deletion of primary data.
[2025-10-24T17:02:22.115956] [DEBUG] [LOCAL     ] ADCT: Deleted primary data file.
[2025-10-24T17:02:22.116014] [INFO ] [MAIN      ] ADCT: Starting full primary refresh.
[2025-10-24T17:02:22.491238] [INFO ] [REMOTE    ] ADCT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:02:22.518814] [INFO ] [REMOTE    ] ACV: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T17:02:22.547622] [INFO ] [REMOTE    ] ACV: Fetching primary data for 2025-04.
[2025-10-24T17:02:23.333361] [INFO ] [REMOTE    ] ACV: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T17:02:23.347618] [INFO ] [REMOTE    ] ACV: Fetching primary data for 2025-05.
[2025-10-24T17:02:23.793572] [INFO ] [REMOTE    ] ACV: Incremental fetch complete for 2025-05 (0.45 seconds).
[2025-10-24T17:02:24.147662] [INFO ] [REMOTE    ] ADC: Fetching primary data for 2025-01.
[2025-10-24T17:02:24.947734] [INFO ] [REMOTE    ] ACV: Fetching primary data for 2025-06.
[2025-10-24T17:02:25.234520] [INFO ] [REMOTE    ] ADC: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T17:02:25.338537] [INFO ] [REMOTE    ] ACV: Incremental fetch complete for 2025-06 (0.39 seconds).
[2025-10-24T17:02:25.747670] [INFO ] [REMOTE    ] ACV: Fetching primary data for 2025-07.
[2025-10-24T17:02:26.361582] [INFO ] [REMOTE    ] ACV: Incremental fetch complete for 2025-07 (0.61 seconds).
[2025-10-24T17:02:26.547850] [INFO ] [REMOTE    ] ADC: Fetching primary data for 2025-02.
[2025-10-24T17:02:27.347748] [INFO ] [REMOTE    ] ACVA: Fetching primary data for 2025-02.
[2025-10-24T17:02:28.132707] [INFO ] [REMOTE    ] ADC: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T17:02:28.147592] [INFO ] [REMOTE    ] ADC: Fetching primary data for 2025-03.
[2025-10-24T17:02:28.841118] [INFO ] [REMOTE    ] ACVA: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T17:02:28.947623] [INFO ] [REMOTE    ] ACVA: Fetching primary data for 2025-03.
[2025-10-24T17:02:29.594441] [INFO ] [REMOTE    ] ADC: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T17:02:29.747702] [INFO ] [REMOTE    ] ADC: Fetching primary data for 2025-04.
[2025-10-24T17:02:30.547701] [INFO ] [REMOTE    ] ACV: Fetching primary data for 2025-08.
[2025-10-24T17:02:30.601498] [INFO ] [REMOTE    ] ACVA: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T17:02:31.242302] [INFO ] [REMOTE    ] ACV: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T17:02:31.347719] [INFO ] [REMOTE    ] ADCT: Fetching primary data for 2025-01.
[2025-10-24T17:02:31.462390] [INFO ] [REMOTE    ] ADC: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T17:02:32.147742] [INFO ] [REMOTE    ] ACV: Fetching primary data for 2025-09.
[2025-10-24T17:02:32.697328] [INFO ] [REMOTE    ] ADCT: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T17:02:32.947682] [INFO ] [REMOTE    ] ACVA: Fetching primary data for 2025-04.
[2025-10-24T17:02:32.994615] [INFO ] [REMOTE    ] ACV: Incremental fetch complete for 2025-09 (0.85 seconds).
[2025-10-24T17:02:33.747754] [INFO ] [REMOTE    ] ACV: Fetching primary data for 2025-10.
[2025-10-24T17:02:34.552790] [INFO ] [REMOTE    ] ADCT: Fetching primary data for 2025-02.
[2025-10-24T17:02:34.568669] [INFO ] [REMOTE    ] ACVA: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T17:02:34.801831] [INFO ] [REMOTE    ] ACV: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T17:02:34.804741] [INFO ] [REMOTE    ] ACV: Full fetch complete (10560 records).
[2025-10-24T17:02:34.804876] [DEBUG] [VALIDATOR ] ACV: Validating primary data.
[2025-10-24T17:02:35.215068] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present.
[2025-10-24T17:02:35.215150] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed.
[2025-10-24T17:02:35.215362] [INFO ] [MAIN      ] ACV: Fetched primary data is valid.
[2025-10-24T17:02:35.215405] [DEBUG] [LOCAL     ] ACV: Saving primary data.
[2025-10-24T17:02:35.215713] [FATAL] [LOCAL     ] ACV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:02:35.215803] [FATAL] [MAIN      ] ACV: Failed to save primary data.
[2025-10-24T17:02:35.215846] [WARN ] [MAIN      ] ACV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:02:35.215882] [INFO ] [LOCAL     ] ACV: Starting deletion of primary data.
[2025-10-24T17:02:35.215934] [DEBUG] [LOCAL     ] ACV: No primary data file found to delete.
[2025-10-24T17:02:35.215970] [INFO ] [LOCAL     ] ACV: Starting deletion of derivative data.
[2025-10-24T17:02:35.216120] [DEBUG] [LOCAL     ] ACV: Deleted derivative data file.
[2025-10-24T17:02:35.216237] [INFO ] [MAIN      ] Update Progress: 27/2366 symbols completed. ACV took 26.1s. Estimated remaining: 3h 39m 55s. Rate: 10.6 symbols/min
[2025-10-24T17:02:35.352862] [INFO ] [REMOTE    ] ADC: Fetching primary data for 2025-05.
[2025-10-24T17:02:35.404123] [INFO ] [MAIN      ] ADM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:02:35.462619] [DEBUG] [LOCAL     ] ADM: Loaded 53780 existing records from primary storage.
[2025-10-24T17:02:35.463022] [INFO ] [MAIN      ] ADM: Loaded 53780 existing records.
[2025-10-24T17:02:35.667710] [WARN ] [MAIN      ] ADM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:02:35.667962] [INFO ] [MAIN      ] ADM: Wiping existing primary data before full refresh.
[2025-10-24T17:02:35.668036] [INFO ] [LOCAL     ] ADM: Starting deletion of primary data.
[2025-10-24T17:02:35.668408] [DEBUG] [LOCAL     ] ADM: Deleted primary data file.
[2025-10-24T17:02:35.668465] [INFO ] [MAIN      ] ADM: Starting full primary refresh.
[2025-10-24T17:02:35.943709] [INFO ] [REMOTE    ] ADCT: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T17:02:36.072196] [INFO ] [REMOTE    ] ADM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:02:36.147706] [INFO ] [REMOTE    ] ADM: Fetching primary data for 2025-01.
[2025-10-24T17:02:36.926421] [INFO ] [REMOTE    ] ADC: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T17:02:36.947617] [INFO ] [REMOTE    ] ADC: Fetching primary data for 2025-06.
[2025-10-24T17:02:37.747621] [INFO ] [REMOTE    ] ADCT: Fetching primary data for 2025-03.
[2025-10-24T17:02:37.816467] [INFO ] [REMOTE    ] ADM: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T17:02:38.243006] [INFO ] [REMOTE    ] ADC: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T17:02:38.547675] [INFO ] [REMOTE    ] ACVA: Fetching primary data for 2025-05.
[2025-10-24T17:02:38.679720] [INFO ] [REMOTE    ] ADCT: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T17:02:39.347711] [INFO ] [REMOTE    ] ADCT: Fetching primary data for 2025-04.
[2025-10-24T17:02:40.147683] [INFO ] [REMOTE    ] ADC: Fetching primary data for 2025-07.
[2025-10-24T17:02:40.188776] [INFO ] [REMOTE    ] ACVA: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T17:02:40.472693] [INFO ] [REMOTE    ] ADCT: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T17:02:40.947698] [INFO ] [REMOTE    ] ADM: Fetching primary data for 2025-02.
[2025-10-24T17:02:41.747629] [INFO ] [REMOTE    ] ACVA: Fetching primary data for 2025-06.
[2025-10-24T17:02:42.067215] [INFO ] [REMOTE    ] ADC: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T17:02:42.424473] [INFO ] [REMOTE    ] ADM: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T17:02:42.547710] [INFO ] [REMOTE    ] ADC: Fetching primary data for 2025-08.
[2025-10-24T17:02:43.180694] [INFO ] [REMOTE    ] ACVA: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T17:02:43.347695] [INFO ] [REMOTE    ] ACVA: Fetching primary data for 2025-07.
[2025-10-24T17:02:43.733091] [INFO ] [REMOTE    ] ADC: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T17:02:44.147680] [INFO ] [REMOTE    ] ADM: Fetching primary data for 2025-03.
[2025-10-24T17:02:44.747128] [INFO ] [REMOTE    ] ACVA: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T17:02:44.947748] [INFO ] [REMOTE    ] ADCT: Fetching primary data for 2025-05.
[2025-10-24T17:02:45.747709] [INFO ] [REMOTE    ] ADC: Fetching primary data for 2025-09.
[2025-10-24T17:02:46.268146] [INFO ] [REMOTE    ] ADM: Incremental fetch complete for 2025-03 (2.12 seconds).
[2025-10-24T17:02:46.398942] [INFO ] [REMOTE    ] ADCT: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T17:02:46.547691] [INFO ] [REMOTE    ] ADCT: Fetching primary data for 2025-06.
[2025-10-24T17:02:47.333488] [INFO ] [REMOTE    ] ADC: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T17:02:47.347603] [INFO ] [REMOTE    ] ADC: Fetching primary data for 2025-10.
[2025-10-24T17:02:48.123154] [INFO ] [REMOTE    ] ADCT: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T17:02:48.147666] [INFO ] [REMOTE    ] ADCT: Fetching primary data for 2025-07.
[2025-10-24T17:02:48.901954] [INFO ] [REMOTE    ] ADC: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T17:02:48.912079] [INFO ] [REMOTE    ] ADC: Full fetch complete (66721 records).
[2025-10-24T17:02:48.912290] [DEBUG] [VALIDATOR ] ADC: Validating primary data.
[2025-10-24T17:02:48.952770] [INFO ] [REMOTE    ] ADM: Fetching primary data for 2025-04.
[2025-10-24T17:02:49.338725] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present.
[2025-10-24T17:02:49.338831] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed.
[2025-10-24T17:02:49.339500] [INFO ] [MAIN      ] ADC: Fetched primary data is valid.
[2025-10-24T17:02:49.339546] [DEBUG] [LOCAL     ] ADC: Saving primary data.
[2025-10-24T17:02:49.340124] [FATAL] [LOCAL     ] ADC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:02:49.340250] [FATAL] [MAIN      ] ADC: Failed to save primary data.
[2025-10-24T17:02:49.340293] [WARN ] [MAIN      ] ADC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:02:49.340329] [INFO ] [LOCAL     ] ADC: Starting deletion of primary data.
[2025-10-24T17:02:49.340384] [DEBUG] [LOCAL     ] ADC: No primary data file found to delete.
[2025-10-24T17:02:49.340420] [INFO ] [LOCAL     ] ADC: Starting deletion of derivative data.
[2025-10-24T17:02:49.340597] [DEBUG] [LOCAL     ] ADC: Deleted derivative data file.
[2025-10-24T17:02:49.341027] [INFO ] [MAIN      ] Update Progress: 28/2366 symbols completed. ADC took 28.5s. Estimated remaining: 3h 51m 38s. Rate: 10.1 symbols/min
[2025-10-24T17:02:49.521448] [INFO ] [MAIN      ] ADNT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:02:49.571475] [DEBUG] [LOCAL     ] ADNT: Loaded 46574 existing records from primary storage.
[2025-10-24T17:02:49.571850] [INFO ] [MAIN      ] ADNT: Loaded 46574 existing records.
[2025-10-24T17:02:49.756877] [INFO ] [REMOTE    ] ACVA: Fetching primary data for 2025-08.
[2025-10-24T17:02:49.760104] [WARN ] [MAIN      ] ADNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:02:49.778766] [INFO ] [MAIN      ] ADNT: Wiping existing primary data before full refresh.
[2025-10-24T17:02:49.778843] [INFO ] [LOCAL     ] ADNT: Starting deletion of primary data.
[2025-10-24T17:02:49.782295] [DEBUG] [LOCAL     ] ADNT: Deleted primary data file.
[2025-10-24T17:02:49.783125] [INFO ] [REMOTE    ] ADCT: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T17:02:49.783299] [INFO ] [MAIN      ] ADNT: Starting full primary refresh.
[2025-10-24T17:02:50.148614] [INFO ] [REMOTE    ] ADNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:02:50.547684] [INFO ] [REMOTE    ] ADNT: Fetching primary data for 2025-01.
[2025-10-24T17:02:50.975707] [INFO ] [REMOTE    ] ADM: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T17:02:51.347739] [INFO ] [REMOTE    ] ADCT: Fetching primary data for 2025-08.
[2025-10-24T17:02:51.647195] [INFO ] [REMOTE    ] ACVA: Incremental fetch complete for 2025-08 (1.89 seconds).
[2025-10-24T17:02:52.103596] [INFO ] [REMOTE    ] ADNT: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T17:02:52.147722] [INFO ] [REMOTE    ] ADNT: Fetching primary data for 2025-02.
[2025-10-24T17:02:52.392232] [INFO ] [REMOTE    ] ADCT: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T17:02:52.947743] [INFO ] [REMOTE    ] ADCT: Fetching primary data for 2025-09.
[2025-10-24T17:02:53.655174] [INFO ] [REMOTE    ] ADNT: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T17:02:53.747739] [INFO ] [REMOTE    ] ADM: Fetching primary data for 2025-05.
[2025-10-24T17:02:54.265109] [INFO ] [REMOTE    ] ADCT: Incremental fetch complete for 2025-09 (1.32 seconds).
[2025-10-24T17:02:54.547753] [INFO ] [REMOTE    ] ADCT: Fetching primary data for 2025-10.
[2025-10-24T17:02:55.280852] [INFO ] [REMOTE    ] ADM: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T17:02:55.347695] [INFO ] [REMOTE    ] ADM: Fetching primary data for 2025-06.
[2025-10-24T17:02:56.147728] [INFO ] [REMOTE    ] ADNT: Fetching primary data for 2025-03.
[2025-10-24T17:02:56.414202] [INFO ] [REMOTE    ] ADCT: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T17:02:56.422394] [INFO ] [REMOTE    ] ADCT: Full fetch complete (51420 records).
[2025-10-24T17:02:56.422564] [DEBUG] [VALIDATOR ] ADCT: Validating primary data.
[2025-10-24T17:02:56.813224] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present.
[2025-10-24T17:02:56.813538] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed.
[2025-10-24T17:02:56.814117] [INFO ] [MAIN      ] ADCT: Fetched primary data is valid.
[2025-10-24T17:02:56.814183] [DEBUG] [LOCAL     ] ADCT: Saving primary data.
[2025-10-24T17:02:56.814777] [FATAL] [LOCAL     ] ADCT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:02:56.814901] [FATAL] [MAIN      ] ADCT: Failed to save primary data.
[2025-10-24T17:02:56.814969] [WARN ] [MAIN      ] ADCT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:02:56.815013] [INFO ] [LOCAL     ] ADCT: Starting deletion of primary data.
[2025-10-24T17:02:56.815081] [DEBUG] [LOCAL     ] ADCT: No primary data file found to delete.
[2025-10-24T17:02:56.815137] [INFO ] [LOCAL     ] ADCT: Starting deletion of derivative data.
[2025-10-24T17:02:56.815862] [DEBUG] [LOCAL     ] ADCT: Deleted derivative data file.
[2025-10-24T17:02:56.815964] [INFO ] [MAIN      ] Update Progress: 29/2366 symbols completed. ADCT took 35.5s. Estimated remaining: 3h 53m 35s. Rate: 10.0 symbols/min
[2025-10-24T17:02:56.952818] [INFO ] [REMOTE    ] ACVA: Fetching primary data for 2025-09.
[2025-10-24T17:02:57.000160] [INFO ] [MAIN      ] ADT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:02:57.055803] [DEBUG] [LOCAL     ] ADT: Loaded 53825 existing records from primary storage.
[2025-10-24T17:02:57.056185] [INFO ] [MAIN      ] ADT: Loaded 53825 existing records.
[2025-10-24T17:02:57.254853] [WARN ] [MAIN      ] ADT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:02:57.255204] [INFO ] [MAIN      ] ADT: Wiping existing primary data before full refresh.
[2025-10-24T17:02:57.255306] [INFO ] [LOCAL     ] ADT: Starting deletion of primary data.
[2025-10-24T17:02:57.255997] [DEBUG] [LOCAL     ] ADT: Deleted primary data file.
[2025-10-24T17:02:57.256076] [INFO ] [MAIN      ] ADT: Starting full primary refresh.
[2025-10-24T17:02:57.638902] [INFO ] [REMOTE    ] ADM: Incremental fetch complete for 2025-06 (2.29 seconds).
[2025-10-24T17:02:57.699500] [INFO ] [REMOTE    ] ADT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:02:57.752786] [INFO ] [REMOTE    ] ADT: Fetching primary data for 2025-01.
[2025-10-24T17:02:57.766994] [INFO ] [REMOTE    ] ADNT: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T17:02:58.547635] [INFO ] [REMOTE    ] ADNT: Fetching primary data for 2025-04.
[2025-10-24T17:02:58.801213] [INFO ] [REMOTE    ] ACVA: Incremental fetch complete for 2025-09 (1.85 seconds).
[2025-10-24T17:02:59.347745] [INFO ] [REMOTE    ] ACVA: Fetching primary data for 2025-10.
[2025-10-24T17:02:59.603880] [INFO ] [REMOTE    ] ADNT: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T17:02:59.643799] [INFO ] [REMOTE    ] ADT: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T17:03:00.147634] [INFO ] [REMOTE    ] ADT: Fetching primary data for 2025-02.
[2025-10-24T17:03:00.947683] [INFO ] [REMOTE    ] ADM: Fetching primary data for 2025-07.
[2025-10-24T17:03:01.634247] [INFO ] [REMOTE    ] ACVA: Incremental fetch complete for 2025-10 (2.29 seconds).
[2025-10-24T17:03:01.645011] [INFO ] [REMOTE    ] ACVA: Full fetch complete (71093 records).
[2025-10-24T17:03:01.645213] [DEBUG] [VALIDATOR ] ACVA: Validating primary data.
[2025-10-24T17:03:01.762784] [INFO ] [REMOTE    ] ADNT: Fetching primary data for 2025-05.
[2025-10-24T17:03:02.117707] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present.
[2025-10-24T17:03:02.117827] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed.
[2025-10-24T17:03:02.118607] [INFO ] [MAIN      ] ACVA: Fetched primary data is valid.
[2025-10-24T17:03:02.118706] [DEBUG] [LOCAL     ] ACVA: Saving primary data.
[2025-10-24T17:03:02.119405] [FATAL] [LOCAL     ] ACVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:03:02.119504] [FATAL] [MAIN      ] ACVA: Failed to save primary data.
[2025-10-24T17:03:02.119548] [WARN ] [MAIN      ] ACVA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:03:02.119612] [INFO ] [LOCAL     ] ACVA: Starting deletion of primary data.
[2025-10-24T17:03:02.119716] [DEBUG] [LOCAL     ] ACVA: No primary data file found to delete.
[2025-10-24T17:03:02.119796] [INFO ] [LOCAL     ] ACVA: Starting deletion of derivative data.
[2025-10-24T17:03:02.120150] [DEBUG] [LOCAL     ] ACVA: Deleted derivative data file.
[2025-10-24T17:03:02.120781] [INFO ] [MAIN      ] Update Progress: 30/2366 symbols completed. ACVA took 45.4s. Estimated remaining: 3h 52m 35s. Rate: 10.0 symbols/min
[2025-10-24T17:03:02.299090] [INFO ] [MAIN      ] ADX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:03:02.328245] [DEBUG] [LOCAL     ] ADX: Loaded 27825 existing records from primary storage.
[2025-10-24T17:03:02.328532] [INFO ] [MAIN      ] ADX: Loaded 27825 existing records.
[2025-10-24T17:03:02.515080] [WARN ] [MAIN      ] ADX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:03:02.515510] [INFO ] [MAIN      ] ADX: Wiping existing primary data before full refresh.
[2025-10-24T17:03:02.515571] [INFO ] [LOCAL     ] ADX: Starting deletion of primary data.
[2025-10-24T17:03:02.540284] [DEBUG] [LOCAL     ] ADX: Deleted primary data file.
[2025-10-24T17:03:02.540491] [INFO ] [MAIN      ] ADX: Starting full primary refresh.
[2025-10-24T17:03:02.610179] [INFO ] [REMOTE    ] ADT: Incremental fetch complete for 2025-02 (2.46 seconds).
[2025-10-24T17:03:02.665141] [INFO ] [REMOTE    ] ADT: Fetching primary data for 2025-03.
[2025-10-24T17:03:02.932638] [INFO ] [REMOTE    ] ADX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:03:03.041909] [INFO ] [REMOTE    ] ADM: Incremental fetch complete for 2025-07 (2.09 seconds).
[2025-10-24T17:03:03.347703] [INFO ] [REMOTE    ] ADX: Fetching primary data for 2025-01.
[2025-10-24T17:03:04.147727] [INFO ] [REMOTE    ] ADM: Fetching primary data for 2025-08.
[2025-10-24T17:03:05.134876] [INFO ] [REMOTE    ] ADNT: Incremental fetch complete for 2025-05 (3.37 seconds).
[2025-10-24T17:03:05.144858] [INFO ] [REMOTE    ] ADNT: Fetching primary data for 2025-06.
[2025-10-24T17:03:05.267454] [INFO ] [REMOTE    ] ADX: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T17:03:05.493135] [INFO ] [REMOTE    ] ADT: Incremental fetch complete for 2025-03 (2.83 seconds).
[2025-10-24T17:03:05.624050] [INFO ] [REMOTE    ] ADM: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T17:03:05.747703] [INFO ] [REMOTE    ] ADM: Fetching primary data for 2025-09.
[2025-10-24T17:03:06.547723] [INFO ] [REMOTE    ] ADX: Fetching primary data for 2025-02.
[2025-10-24T17:03:06.910392] [INFO ] [REMOTE    ] ADNT: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T17:03:07.347621] [INFO ] [REMOTE    ] ADNT: Fetching primary data for 2025-07.
[2025-10-24T17:03:07.673343] [INFO ] [REMOTE    ] ADX: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T17:03:07.791479] [INFO ] [REMOTE    ] ADM: Incremental fetch complete for 2025-09 (2.04 seconds).
[2025-10-24T17:03:08.147729] [INFO ] [REMOTE    ] ADT: Fetching primary data for 2025-04.
[2025-10-24T17:03:08.947721] [INFO ] [REMOTE    ] ADX: Fetching primary data for 2025-03.
[2025-10-24T17:03:09.063262] [INFO ] [REMOTE    ] ADNT: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T17:03:09.683199] [INFO ] [REMOTE    ] ADT: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T17:03:09.747629] [INFO ] [REMOTE    ] ADNT: Fetching primary data for 2025-08.
[2025-10-24T17:03:09.780538] [INFO ] [REMOTE    ] ADX: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T17:03:10.547701] [INFO ] [REMOTE    ] ADT: Fetching primary data for 2025-05.
[2025-10-24T17:03:11.233736] [INFO ] [REMOTE    ] ADNT: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T17:03:11.347625] [INFO ] [REMOTE    ] ADNT: Fetching primary data for 2025-09.
[2025-10-24T17:03:11.992487] [INFO ] [REMOTE    ] ADT: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T17:03:12.147725] [INFO ] [REMOTE    ] ADM: Fetching primary data for 2025-10.
[2025-10-24T17:03:12.947681] [INFO ] [REMOTE    ] ADT: Fetching primary data for 2025-06.
[2025-10-24T17:03:13.008276] [INFO ] [REMOTE    ] ADNT: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T17:03:13.747680] [INFO ] [REMOTE    ] ADNT: Fetching primary data for 2025-10.
[2025-10-24T17:03:13.962525] [INFO ] [REMOTE    ] ADM: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T17:03:13.972296] [INFO ] [REMOTE    ] ADM: Full fetch complete (77477 records).
[2025-10-24T17:03:13.972436] [DEBUG] [VALIDATOR ] ADM: Validating primary data.
[2025-10-24T17:03:14.376503] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present.
[2025-10-24T17:03:14.376676] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed.
[2025-10-24T17:03:14.377504] [INFO ] [MAIN      ] ADM: Fetched primary data is valid.
[2025-10-24T17:03:14.377604] [DEBUG] [LOCAL     ] ADM: Saving primary data.
[2025-10-24T17:03:14.378296] [FATAL] [LOCAL     ] ADM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:03:14.378384] [FATAL] [MAIN      ] ADM: Failed to save primary data.
[2025-10-24T17:03:14.378427] [WARN ] [MAIN      ] ADM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:03:14.378473] [INFO ] [LOCAL     ] ADM: Starting deletion of primary data.
[2025-10-24T17:03:14.378529] [DEBUG] [LOCAL     ] ADM: No primary data file found to delete.
[2025-10-24T17:03:14.378567] [INFO ] [LOCAL     ] ADM: Starting deletion of derivative data.
[2025-10-24T17:03:14.378748] [DEBUG] [LOCAL     ] ADM: Deleted derivative data file.
[2025-10-24T17:03:14.379031] [INFO ] [MAIN      ] Update Progress: 31/2366 symbols completed. ADM took 39.2s. Estimated remaining: 4h 0m 23s. Rate: 9.7 symbols/min
[2025-10-24T17:03:14.561568] [INFO ] [REMOTE    ] ADX: Fetching primary data for 2025-04.
[2025-10-24T17:03:14.563327] [INFO ] [MAIN      ] AEE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:03:14.597151] [INFO ] [REMOTE    ] ADT: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T17:03:14.647865] [DEBUG] [LOCAL     ] AEE: Loaded 50377 existing records from primary storage.
[2025-10-24T17:03:14.648166] [INFO ] [MAIN      ] AEE: Loaded 50377 existing records.
[2025-10-24T17:03:14.833585] [WARN ] [MAIN      ] AEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:03:14.833872] [INFO ] [MAIN      ] AEE: Wiping existing primary data before full refresh.
[2025-10-24T17:03:14.833930] [INFO ] [LOCAL     ] AEE: Starting deletion of primary data.
[2025-10-24T17:03:14.834350] [DEBUG] [LOCAL     ] AEE: Deleted primary data file.
[2025-10-24T17:03:14.834408] [INFO ] [MAIN      ] AEE: Starting full primary refresh.
[2025-10-24T17:03:15.195739] [INFO ] [REMOTE    ] AEE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:03:15.347607] [INFO ] [REMOTE    ] ADT: Fetching primary data for 2025-07.
[2025-10-24T17:03:15.387162] [INFO ] [REMOTE    ] ADNT: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T17:03:15.395683] [INFO ] [REMOTE    ] ADNT: Full fetch complete (67741 records).
[2025-10-24T17:03:15.395832] [DEBUG] [VALIDATOR ] ADNT: Validating primary data.
[2025-10-24T17:03:15.792790] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present.
[2025-10-24T17:03:15.792867] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed.
[2025-10-24T17:03:15.793518] [INFO ] [MAIN      ] ADNT: Fetched primary data is valid.
[2025-10-24T17:03:15.793562] [DEBUG] [LOCAL     ] ADNT: Saving primary data.
[2025-10-24T17:03:15.794156] [FATAL] [LOCAL     ] ADNT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:03:15.794248] [FATAL] [MAIN      ] ADNT: Failed to save primary data.
[2025-10-24T17:03:15.794291] [WARN ] [MAIN      ] ADNT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:03:15.794326] [INFO ] [LOCAL     ] ADNT: Starting deletion of primary data.
[2025-10-24T17:03:15.794379] [DEBUG] [LOCAL     ] ADNT: No primary data file found to delete.
[2025-10-24T17:03:15.794413] [INFO ] [LOCAL     ] ADNT: Starting deletion of derivative data.
[2025-10-24T17:03:15.794572] [DEBUG] [LOCAL     ] ADNT: Deleted derivative data file.
[2025-10-24T17:03:15.795066] [INFO ] [MAIN      ] Update Progress: 32/2366 symbols completed. ADNT took 26.5s. Estimated remaining: 3h 54m 29s. Rate: 10.0 symbols/min
[2025-10-24T17:03:15.965465] [INFO ] [MAIN      ] AEFC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:03:15.976358] [DEBUG] [LOCAL     ] AEFC: Loaded 7685 existing records from primary storage.
[2025-10-24T17:03:15.976557] [INFO ] [MAIN      ] AEFC: Loaded 7685 existing records.
[2025-10-24T17:03:16.152764] [INFO ] [REMOTE    ] AEE: Fetching primary data for 2025-01.
[2025-10-24T17:03:16.158553] [WARN ] [MAIN      ] AEFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:03:16.159482] [INFO ] [MAIN      ] AEFC: Wiping existing primary data before full refresh.
[2025-10-24T17:03:16.159533] [INFO ] [LOCAL     ] AEFC: Starting deletion of primary data.
[2025-10-24T17:03:16.159719] [DEBUG] [LOCAL     ] AEFC: Deleted primary data file.
[2025-10-24T17:03:16.159776] [INFO ] [MAIN      ] AEFC: Starting full primary refresh.
[2025-10-24T17:03:16.535346] [INFO ] [REMOTE    ] AEFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:03:16.569427] [INFO ] [REMOTE    ] ADX: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T17:03:16.943513] [INFO ] [REMOTE    ] ADT: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T17:03:16.953793] [INFO ] [REMOTE    ] AEFC: Fetching primary data for 2025-01.
[2025-10-24T17:03:17.586272] [INFO ] [REMOTE    ] AEFC: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T17:03:17.698811] [INFO ] [REMOTE    ] AEE: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T17:03:17.747614] [INFO ] [REMOTE    ] ADX: Fetching primary data for 2025-05.
[2025-10-24T17:03:18.547614] [INFO ] [REMOTE    ] AEE: Fetching primary data for 2025-02.
[2025-10-24T17:03:18.878803] [INFO ] [REMOTE    ] ADX: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T17:03:19.347711] [INFO ] [REMOTE    ] ADX: Fetching primary data for 2025-06.
[2025-10-24T17:03:19.760739] [INFO ] [REMOTE    ] AEE: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T17:03:20.147700] [INFO ] [REMOTE    ] AEFC: Fetching primary data for 2025-02.
[2025-10-24T17:03:20.503243] [INFO ] [REMOTE    ] ADX: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T17:03:20.604755] [INFO ] [REMOTE    ] AEFC: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T17:03:20.947730] [INFO ] [REMOTE    ] ADT: Fetching primary data for 2025-08.
[2025-10-24T17:03:21.747748] [INFO ] [REMOTE    ] ADX: Fetching primary data for 2025-07.
[2025-10-24T17:03:22.547623] [INFO ] [REMOTE    ] AEFC: Fetching primary data for 2025-03.
[2025-10-24T17:03:22.820972] [INFO ] [REMOTE    ] ADT: Incremental fetch complete for 2025-08 (1.87 seconds).
[2025-10-24T17:03:22.964870] [INFO ] [REMOTE    ] ADX: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T17:03:23.064163] [INFO ] [REMOTE    ] AEFC: Incremental fetch complete for 2025-03 (0.52 seconds).
[2025-10-24T17:03:23.347678] [INFO ] [REMOTE    ] ADX: Fetching primary data for 2025-08.
[2025-10-24T17:03:24.147685] [INFO ] [REMOTE    ] AEE: Fetching primary data for 2025-03.
[2025-10-24T17:03:24.200922] [INFO ] [REMOTE    ] ADX: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T17:03:24.947727] [INFO ] [REMOTE    ] ADT: Fetching primary data for 2025-09.
[2025-10-24T17:03:25.747713] [INFO ] [REMOTE    ] AEFC: Fetching primary data for 2025-04.
[2025-10-24T17:03:25.814918] [INFO ] [REMOTE    ] AEE: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T17:03:26.265742] [INFO ] [REMOTE    ] AEFC: Incremental fetch complete for 2025-04 (0.52 seconds).
[2025-10-24T17:03:26.328949] [INFO ] [REMOTE    ] ADT: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T17:03:26.547695] [INFO ] [REMOTE    ] AEFC: Fetching primary data for 2025-05.
[2025-10-24T17:03:27.304318] [INFO ] [REMOTE    ] AEFC: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T17:03:27.347605] [INFO ] [REMOTE    ] AEFC: Fetching primary data for 2025-06.
[2025-10-24T17:03:28.046594] [INFO ] [REMOTE    ] AEFC: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T17:03:28.147629] [INFO ] [REMOTE    ] AEFC: Fetching primary data for 2025-07.
[2025-10-24T17:03:28.596070] [INFO ] [REMOTE    ] AEFC: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T17:03:28.947669] [INFO ] [REMOTE    ] AEE: Fetching primary data for 2025-04.
[2025-10-24T17:03:29.747674] [INFO ] [REMOTE    ] AEFC: Fetching primary data for 2025-08.
[2025-10-24T17:03:30.547625] [INFO ] [REMOTE    ] ADT: Fetching primary data for 2025-10.
[2025-10-24T17:03:30.599928] [INFO ] [REMOTE    ] AEFC: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T17:03:30.760543] [INFO ] [REMOTE    ] AEE: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T17:03:31.347712] [INFO ] [REMOTE    ] ADX: Fetching primary data for 2025-09.
[2025-10-24T17:03:32.144119] [INFO ] [REMOTE    ] ADX: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T17:03:32.149560] [INFO ] [REMOTE    ] AEFC: Fetching primary data for 2025-09.
[2025-10-24T17:03:32.372235] [INFO ] [REMOTE    ] ADT: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T17:03:32.381819] [INFO ] [REMOTE    ] ADT: Full fetch complete (77372 records).
[2025-10-24T17:03:32.381938] [DEBUG] [VALIDATOR ] ADT: Validating primary data.
[2025-10-24T17:03:32.702516] [INFO ] [REMOTE    ] AEFC: Incremental fetch complete for 2025-09 (0.55 seconds).
[2025-10-24T17:03:32.798863] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present.
[2025-10-24T17:03:32.798938] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed.
[2025-10-24T17:03:32.799687] [INFO ] [MAIN      ] ADT: Fetched primary data is valid.
[2025-10-24T17:03:32.799751] [DEBUG] [LOCAL     ] ADT: Saving primary data.
[2025-10-24T17:03:32.800351] [FATAL] [LOCAL     ] ADT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:03:32.800445] [FATAL] [MAIN      ] ADT: Failed to save primary data.
[2025-10-24T17:03:32.800488] [WARN ] [MAIN      ] ADT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:03:32.800524] [INFO ] [LOCAL     ] ADT: Starting deletion of primary data.
[2025-10-24T17:03:32.800577] [DEBUG] [LOCAL     ] ADT: No primary data file found to delete.
[2025-10-24T17:03:32.800613] [INFO ] [LOCAL     ] ADT: Starting deletion of derivative data.
[2025-10-24T17:03:32.800824] [DEBUG] [LOCAL     ] ADT: Deleted derivative data file.
[2025-10-24T17:03:32.801412] [INFO ] [MAIN      ] Update Progress: 33/2366 symbols completed. ADT took 36.0s. Estimated remaining: 4h 7m 20s. Rate: 9.4 symbols/min
[2025-10-24T17:03:32.948639] [INFO ] [REMOTE    ] AEFC: Fetching primary data for 2025-10.
[2025-10-24T17:03:32.974454] [INFO ] [MAIN      ] AEG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:03:33.021988] [DEBUG] [LOCAL     ] AEG: Loaded 49897 existing records from primary storage.
[2025-10-24T17:03:33.022285] [INFO ] [MAIN      ] AEG: Loaded 49897 existing records.
[2025-10-24T17:03:33.199869] [WARN ] [MAIN      ] AEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:03:33.200080] [INFO ] [MAIN      ] AEG: Wiping existing primary data before full refresh.
[2025-10-24T17:03:33.200127] [INFO ] [LOCAL     ] AEG: Starting deletion of primary data.
[2025-10-24T17:03:33.200449] [DEBUG] [LOCAL     ] AEG: Deleted primary data file.
[2025-10-24T17:03:33.200505] [INFO ] [MAIN      ] AEG: Starting full primary refresh.
[2025-10-24T17:03:33.560839] [INFO ] [REMOTE    ] AEG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:03:33.684747] [INFO ] [REMOTE    ] AEFC: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T17:03:33.686312] [INFO ] [REMOTE    ] AEFC: Full fetch complete (11606 records).
[2025-10-24T17:03:33.686385] [DEBUG] [VALIDATOR ] AEFC: Validating primary data.
[2025-10-24T17:03:33.752791] [INFO ] [REMOTE    ] ADX: Fetching primary data for 2025-10.
[2025-10-24T17:03:34.046582] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present.
[2025-10-24T17:03:34.046678] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed.
[2025-10-24T17:03:34.046895] [INFO ] [MAIN      ] AEFC: Fetched primary data is valid.
[2025-10-24T17:03:34.046937] [DEBUG] [LOCAL     ] AEFC: Saving primary data.
[2025-10-24T17:03:34.047148] [FATAL] [LOCAL     ] AEFC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:03:34.047228] [FATAL] [MAIN      ] AEFC: Failed to save primary data.
[2025-10-24T17:03:34.047270] [WARN ] [MAIN      ] AEFC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:03:34.047305] [INFO ] [LOCAL     ] AEFC: Starting deletion of primary data.
[2025-10-24T17:03:34.047352] [DEBUG] [LOCAL     ] AEFC: No primary data file found to delete.
[2025-10-24T17:03:34.047389] [INFO ] [LOCAL     ] AEFC: Starting deletion of derivative data.
[2025-10-24T17:03:34.047578] [DEBUG] [LOCAL     ] AEFC: Deleted derivative data file.
[2025-10-24T17:03:34.047717] [INFO ] [MAIN      ] Update Progress: 34/2366 symbols completed. AEFC took 18.3s. Estimated remaining: 4h 1m 22s. Rate: 9.7 symbols/min
[2025-10-24T17:03:34.217972] [INFO ] [MAIN      ] AEM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:03:34.273287] [DEBUG] [LOCAL     ] AEM: Loaded 53865 existing records from primary storage.
[2025-10-24T17:03:34.273609] [INFO ] [MAIN      ] AEM: Loaded 53865 existing records.
[2025-10-24T17:03:34.449953] [WARN ] [MAIN      ] AEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:03:34.450186] [INFO ] [MAIN      ] AEM: Wiping existing primary data before full refresh.
[2025-10-24T17:03:34.450236] [INFO ] [LOCAL     ] AEM: Starting deletion of primary data.
[2025-10-24T17:03:34.450693] [DEBUG] [LOCAL     ] AEM: Deleted primary data file.
[2025-10-24T17:03:34.450751] [INFO ] [MAIN      ] AEM: Starting full primary refresh.
[2025-10-24T17:03:34.552812] [INFO ] [REMOTE    ] AEG: Fetching primary data for 2025-01.
[2025-10-24T17:03:34.813226] [INFO ] [REMOTE    ] AEM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:03:35.080115] [INFO ] [REMOTE    ] ADX: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T17:03:35.085714] [INFO ] [REMOTE    ] ADX: Full fetch complete (41822 records).
[2025-10-24T17:03:35.085812] [DEBUG] [VALIDATOR ] ADX: Validating primary data.
[2025-10-24T17:03:35.355429] [INFO ] [REMOTE    ] AEE: Fetching primary data for 2025-05.
[2025-10-24T17:03:35.485295] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present.
[2025-10-24T17:03:35.485408] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed.
[2025-10-24T17:03:35.485894] [INFO ] [MAIN      ] ADX: Fetched primary data is valid.
[2025-10-24T17:03:35.485956] [DEBUG] [LOCAL     ] ADX: Saving primary data.
[2025-10-24T17:03:35.486354] [FATAL] [LOCAL     ] ADX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:03:35.486437] [FATAL] [MAIN      ] ADX: Failed to save primary data.
[2025-10-24T17:03:35.486479] [WARN ] [MAIN      ] ADX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:03:35.486513] [INFO ] [LOCAL     ] ADX: Starting deletion of primary data.
[2025-10-24T17:03:35.486564] [DEBUG] [LOCAL     ] ADX: No primary data file found to delete.
[2025-10-24T17:03:35.486599] [INFO ] [LOCAL     ] ADX: Starting deletion of derivative data.
[2025-10-24T17:03:35.486827] [DEBUG] [LOCAL     ] ADX: Deleted derivative data file.
[2025-10-24T17:03:35.486927] [INFO ] [MAIN      ] Update Progress: 35/2366 symbols completed. ADX took 33.4s. Estimated remaining: 3h 55m 58s. Rate: 9.9 symbols/min
[2025-10-24T17:03:35.659213] [INFO ] [MAIN      ] AEO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:03:35.712844] [DEBUG] [LOCAL     ] AEO: Loaded 53953 existing records from primary storage.
[2025-10-24T17:03:35.713185] [INFO ] [MAIN      ] AEO: Loaded 53953 existing records.
[2025-10-24T17:03:35.897005] [WARN ] [MAIN      ] AEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:03:35.897231] [INFO ] [MAIN      ] AEO: Wiping existing primary data before full refresh.
[2025-10-24T17:03:35.897279] [INFO ] [LOCAL     ] AEO: Starting deletion of primary data.
[2025-10-24T17:03:35.897563] [DEBUG] [LOCAL     ] AEO: Deleted primary data file.
[2025-10-24T17:03:35.897677] [INFO ] [MAIN      ] AEO: Starting full primary refresh.
[2025-10-24T17:03:36.157195] [INFO ] [REMOTE    ] AEM: Fetching primary data for 2025-01.
[2025-10-24T17:03:36.282715] [INFO ] [REMOTE    ] AEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:03:36.287334] [INFO ] [REMOTE    ] AEG: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T17:03:36.670968] [INFO ] [REMOTE    ] AEE: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T17:03:36.947632] [INFO ] [REMOTE    ] AEE: Fetching primary data for 2025-06.
[2025-10-24T17:03:37.747713] [INFO ] [REMOTE    ] AEG: Fetching primary data for 2025-02.
[2025-10-24T17:03:37.963709] [INFO ] [REMOTE    ] AEM: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T17:03:38.171995] [INFO ] [REMOTE    ] AEE: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T17:03:38.547733] [INFO ] [REMOTE    ] AEO: Fetching primary data for 2025-01.
[2025-10-24T17:03:38.846738] [INFO ] [REMOTE    ] AEG: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T17:03:39.347694] [INFO ] [REMOTE    ] AEM: Fetching primary data for 2025-02.
[2025-10-24T17:03:40.147686] [INFO ] [REMOTE    ] AEE: Fetching primary data for 2025-07.
[2025-10-24T17:03:40.388484] [INFO ] [REMOTE    ] AEO: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T17:03:40.910524] [INFO ] [REMOTE    ] AEM: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T17:03:40.947631] [INFO ] [REMOTE    ] AEG: Fetching primary data for 2025-03.
[2025-10-24T17:03:41.747674] [INFO ] [REMOTE    ] AEO: Fetching primary data for 2025-02.
[2025-10-24T17:03:41.846585] [INFO ] [REMOTE    ] AEE: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T17:03:42.192514] [INFO ] [REMOTE    ] AEG: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T17:03:42.547742] [INFO ] [REMOTE    ] AEG: Fetching primary data for 2025-04.
[2025-10-24T17:03:43.347627] [INFO ] [REMOTE    ] AEM: Fetching primary data for 2025-03.
[2025-10-24T17:03:43.527001] [INFO ] [REMOTE    ] AEO: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T17:03:44.086114] [INFO ] [REMOTE    ] AEG: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T17:03:44.147668] [INFO ] [REMOTE    ] AEE: Fetching primary data for 2025-08.
[2025-10-24T17:03:44.831191] [INFO ] [REMOTE    ] AEM: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T17:03:44.947672] [INFO ] [REMOTE    ] AEM: Fetching primary data for 2025-04.
[2025-10-24T17:03:45.319639] [INFO ] [REMOTE    ] AEE: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T17:03:45.747723] [INFO ] [REMOTE    ] AEO: Fetching primary data for 2025-03.
[2025-10-24T17:03:46.547755] [INFO ] [REMOTE    ] AEE: Fetching primary data for 2025-09.
[2025-10-24T17:03:46.911148] [INFO ] [REMOTE    ] AEM: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T17:03:47.238341] [INFO ] [REMOTE    ] AEO: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T17:03:47.347685] [INFO ] [REMOTE    ] AEM: Fetching primary data for 2025-05.
[2025-10-24T17:03:48.019869] [INFO ] [REMOTE    ] AEE: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T17:03:48.147721] [INFO ] [REMOTE    ] AEO: Fetching primary data for 2025-04.
[2025-10-24T17:03:48.947750] [INFO ] [REMOTE    ] AEE: Fetching primary data for 2025-10.
[2025-10-24T17:03:49.428237] [INFO ] [REMOTE    ] AEM: Incremental fetch complete for 2025-05 (2.08 seconds).
[2025-10-24T17:03:49.747739] [INFO ] [REMOTE    ] AEG: Fetching primary data for 2025-05.
[2025-10-24T17:03:49.850845] [INFO ] [REMOTE    ] AEO: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T17:03:50.547632] [INFO ] [REMOTE    ] AEO: Fetching primary data for 2025-05.
[2025-10-24T17:03:50.776366] [INFO ] [REMOTE    ] AEE: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T17:03:50.785820] [INFO ] [REMOTE    ] AEE: Full fetch complete (72979 records).
[2025-10-24T17:03:50.785944] [DEBUG] [VALIDATOR ] AEE: Validating primary data.
[2025-10-24T17:03:51.178924] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present.
[2025-10-24T17:03:51.179016] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed.
[2025-10-24T17:03:51.179777] [INFO ] [MAIN      ] AEE: Fetched primary data is valid.
[2025-10-24T17:03:51.180000] [DEBUG] [LOCAL     ] AEE: Saving primary data.
[2025-10-24T17:03:51.180636] [FATAL] [LOCAL     ] AEE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:03:51.180780] [FATAL] [MAIN      ] AEE: Failed to save primary data.
[2025-10-24T17:03:51.180858] [WARN ] [MAIN      ] AEE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:03:51.180946] [INFO ] [LOCAL     ] AEE: Starting deletion of primary data.
[2025-10-24T17:03:51.181028] [DEBUG] [LOCAL     ] AEE: No primary data file found to delete.
[2025-10-24T17:03:51.181067] [INFO ] [LOCAL     ] AEE: Starting deletion of derivative data.
[2025-10-24T17:03:51.181229] [DEBUG] [LOCAL     ] AEE: Deleted derivative data file.
[2025-10-24T17:03:51.181691] [INFO ] [MAIN      ] Update Progress: 36/2366 symbols completed. AEE took 36.8s. Estimated remaining: 4h 6m 15s. Rate: 9.5 symbols/min
[2025-10-24T17:03:51.356493] [INFO ] [REMOTE    ] AEM: Fetching primary data for 2025-06.
[2025-10-24T17:03:51.356353] [INFO ] [MAIN      ] AER: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:03:51.387977] [INFO ] [REMOTE    ] AEG: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T17:03:51.439529] [DEBUG] [LOCAL     ] AER: Loaded 48226 existing records from primary storage.
[2025-10-24T17:03:51.439863] [INFO ] [MAIN      ] AER: Loaded 48226 existing records.
[2025-10-24T17:03:51.616334] [WARN ] [MAIN      ] AER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:03:51.616550] [INFO ] [MAIN      ] AER: Wiping existing primary data before full refresh.
[2025-10-24T17:03:51.616607] [INFO ] [LOCAL     ] AER: Starting deletion of primary data.
[2025-10-24T17:03:51.617090] [DEBUG] [LOCAL     ] AER: Deleted primary data file.
[2025-10-24T17:03:51.617146] [INFO ] [MAIN      ] AER: Starting full primary refresh.
[2025-10-24T17:03:51.989846] [INFO ] [REMOTE    ] AER: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:03:52.071078] [INFO ] [REMOTE    ] AEO: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T17:03:52.147615] [INFO ] [REMOTE    ] AEO: Fetching primary data for 2025-06.
[2025-10-24T17:03:52.947680] [INFO ] [REMOTE    ] AER: Fetching primary data for 2025-01.
[2025-10-24T17:03:53.305497] [INFO ] [REMOTE    ] AEM: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T17:03:53.535178] [INFO ] [REMOTE    ] AEO: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T17:03:53.747714] [INFO ] [REMOTE    ] AEM: Fetching primary data for 2025-07.
[2025-10-24T17:03:54.141952] [INFO ] [REMOTE    ] AER: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T17:03:54.547723] [INFO ] [REMOTE    ] AEO: Fetching primary data for 2025-07.
[2025-10-24T17:03:55.347723] [INFO ] [REMOTE    ] AEG: Fetching primary data for 2025-06.
[2025-10-24T17:03:55.586857] [INFO ] [REMOTE    ] AEM: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T17:03:56.147703] [INFO ] [REMOTE    ] AER: Fetching primary data for 2025-02.
[2025-10-24T17:03:56.203739] [INFO ] [REMOTE    ] AEO: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T17:03:56.947619] [INFO ] [REMOTE    ] AEO: Fetching primary data for 2025-08.
[2025-10-24T17:03:57.136214] [INFO ] [REMOTE    ] AEG: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T17:03:57.747705] [INFO ] [REMOTE    ] AEM: Fetching primary data for 2025-08.
[2025-10-24T17:03:57.806878] [INFO ] [REMOTE    ] AER: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T17:03:58.547777] [INFO ] [REMOTE    ] AER: Fetching primary data for 2025-03.
[2025-10-24T17:03:59.183623] [INFO ] [REMOTE    ] AEO: Incremental fetch complete for 2025-08 (2.24 seconds).
[2025-10-24T17:03:59.347632] [INFO ] [REMOTE    ] AEO: Fetching primary data for 2025-09.
[2025-10-24T17:03:59.576470] [INFO ] [REMOTE    ] AEM: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T17:04:00.147747] [INFO ] [REMOTE    ] AEG: Fetching primary data for 2025-07.
[2025-10-24T17:04:00.345993] [INFO ] [REMOTE    ] AER: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T17:04:00.947771] [INFO ] [REMOTE    ] AEM: Fetching primary data for 2025-09.
[2025-10-24T17:04:01.747708] [INFO ] [REMOTE    ] AER: Fetching primary data for 2025-04.
[2025-10-24T17:04:02.226233] [INFO ] [REMOTE    ] AEO: Incremental fetch complete for 2025-09 (2.88 seconds).
[2025-10-24T17:04:02.271961] [INFO ] [REMOTE    ] AEG: Incremental fetch complete for 2025-07 (2.12 seconds).
[2025-10-24T17:04:02.547686] [INFO ] [REMOTE    ] AEO: Fetching primary data for 2025-10.
[2025-10-24T17:04:03.347752] [INFO ] [REMOTE    ] AEG: Fetching primary data for 2025-08.
[2025-10-24T17:04:03.509552] [INFO ] [REMOTE    ] AEM: Incremental fetch complete for 2025-09 (2.56 seconds).
[2025-10-24T17:04:03.919185] [INFO ] [REMOTE    ] AER: Incremental fetch complete for 2025-04 (2.17 seconds).
[2025-10-24T17:04:04.147701] [INFO ] [REMOTE    ] AER: Fetching primary data for 2025-05.
[2025-10-24T17:04:04.947669] [INFO ] [REMOTE    ] AEM: Fetching primary data for 2025-10.
[2025-10-24T17:04:05.138107] [INFO ] [REMOTE    ] AEO: Incremental fetch complete for 2025-10 (2.59 seconds).
[2025-10-24T17:04:05.151838] [INFO ] [REMOTE    ] AEO: Full fetch complete (77261 records).
[2025-10-24T17:04:05.152072] [DEBUG] [VALIDATOR ] AEO: Validating primary data.
[2025-10-24T17:04:05.154828] [FATAL] [VALIDATOR ] AEO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:04:05.154951] [FATAL] [MAIN      ] AEO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:04:05.155037] [WARN ] [MAIN      ] AEO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:04:05.155126] [INFO ] [LOCAL     ] AEO: Starting deletion of primary data.
[2025-10-24T17:04:05.155205] [DEBUG] [LOCAL     ] AEO: No primary data file found to delete.
[2025-10-24T17:04:05.155262] [INFO ] [LOCAL     ] AEO: Starting deletion of derivative data.
[2025-10-24T17:04:05.155426] [DEBUG] [LOCAL     ] AEO: Deleted derivative data file.
[2025-10-24T17:04:05.156393] [INFO ] [MAIN      ] Update Progress: 37/2366 symbols completed. AEO took 29.7s. Estimated remaining: 4h 14m 9s. Rate: 9.2 symbols/min
[2025-10-24T17:04:05.184047] [INFO ] [REMOTE    ] AEG: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T17:04:05.467336] [INFO ] [REMOTE    ] AER: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T17:04:05.747738] [INFO ] [REMOTE    ] AEG: Fetching primary data for 2025-09.
[2025-10-24T17:04:06.547739] [INFO ] [REMOTE    ] AER: Fetching primary data for 2025-06.
[2025-10-24T17:04:07.073549] [INFO ] [REMOTE    ] AEG: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T17:04:07.110111] [INFO ] [REMOTE    ] AEM: Incremental fetch complete for 2025-10 (2.16 seconds).
[2025-10-24T17:04:07.119740] [INFO ] [REMOTE    ] AEM: Full fetch complete (77485 records).
[2025-10-24T17:04:07.119872] [DEBUG] [VALIDATOR ] AEM: Validating primary data.
[2025-10-24T17:04:07.359572] [INFO ] [REMOTE    ] AEG: Fetching primary data for 2025-10.
[2025-10-24T17:04:07.517566] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present.
[2025-10-24T17:04:07.517684] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed.
[2025-10-24T17:04:07.518453] [INFO ] [MAIN      ] AEM: Fetched primary data is valid.
[2025-10-24T17:04:07.518518] [DEBUG] [LOCAL     ] AEM: Saving primary data.
[2025-10-24T17:04:07.519132] [FATAL] [LOCAL     ] AEM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:04:07.519222] [FATAL] [MAIN      ] AEM: Failed to save primary data.
[2025-10-24T17:04:07.519264] [WARN ] [MAIN      ] AEM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:04:07.519299] [INFO ] [LOCAL     ] AEM: Starting deletion of primary data.
[2025-10-24T17:04:07.519351] [DEBUG] [LOCAL     ] AEM: No primary data file found to delete.
[2025-10-24T17:04:07.519386] [INFO ] [LOCAL     ] AEM: Starting deletion of derivative data.
[2025-10-24T17:04:07.519542] [DEBUG] [LOCAL     ] AEM: Deleted derivative data file.
[2025-10-24T17:04:07.520004] [INFO ] [MAIN      ] Update Progress: 38/2366 symbols completed. AEM took 33.5s. Estimated remaining: 4h 9m 46s. Rate: 9.3 symbols/min
[2025-10-24T17:04:08.123357] [INFO ] [REMOTE    ] AER: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T17:04:08.147596] [INFO ] [REMOTE    ] AER: Fetching primary data for 2025-07.
[2025-10-24T17:04:09.150898] [INFO ] [REMOTE    ] AEG: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T17:04:09.160371] [INFO ] [REMOTE    ] AEG: Full fetch complete (70651 records).
[2025-10-24T17:04:09.160510] [DEBUG] [VALIDATOR ] AEG: Validating primary data.
[2025-10-24T17:04:09.564954] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present.
[2025-10-24T17:04:09.565073] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed.
[2025-10-24T17:04:09.565925] [INFO ] [MAIN      ] AEG: Fetched primary data is valid.
[2025-10-24T17:04:09.566116] [DEBUG] [LOCAL     ] AEG: Saving primary data.
[2025-10-24T17:04:09.566903] [FATAL] [LOCAL     ] AEG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:04:09.567207] [FATAL] [MAIN      ] AEG: Failed to save primary data.
[2025-10-24T17:04:09.567372] [WARN ] [MAIN      ] AEG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:04:09.567464] [INFO ] [LOCAL     ] AEG: Starting deletion of primary data.
[2025-10-24T17:04:09.567578] [DEBUG] [LOCAL     ] AEG: No primary data file found to delete.
[2025-10-24T17:04:09.567693] [INFO ] [LOCAL     ] AEG: Starting deletion of derivative data.
[2025-10-24T17:04:09.567882] [DEBUG] [LOCAL     ] AEG: Deleted derivative data file.
[2025-10-24T17:04:09.568370] [INFO ] [MAIN      ] Update Progress: 39/2366 symbols completed. AEG took 36.8s. Estimated remaining: 4h 5m 18s. Rate: 9.5 symbols/min
[2025-10-24T17:04:09.621833] [INFO ] [REMOTE    ] AER: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T17:04:09.632553] [INFO ] [REMOTE    ] AER: Fetching primary data for 2025-08.
[2025-10-24T17:04:10.987322] [INFO ] [REMOTE    ] AER: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T17:04:11.001265] [INFO ] [REMOTE    ] AER: Fetching primary data for 2025-09.
[2025-10-24T17:04:12.568625] [INFO ] [REMOTE    ] AER: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T17:04:12.578823] [INFO ] [REMOTE    ] AER: Fetching primary data for 2025-10.
[2025-10-24T17:04:13.872592] [INFO ] [REMOTE    ] AER: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T17:04:13.880865] [INFO ] [REMOTE    ] AER: Full fetch complete (69904 records).
[2025-10-24T17:04:13.881008] [DEBUG] [VALIDATOR ] AER: Validating primary data.
[2025-10-24T17:04:14.266980] [DEBUG] [VALIDATOR ] AER: All expected trading days are present.
[2025-10-24T17:04:14.267059] [DEBUG] [VALIDATOR ] AER: Primary data validation passed.
[2025-10-24T17:04:14.267820] [INFO ] [MAIN      ] AER: Fetched primary data is valid.
[2025-10-24T17:04:14.267887] [DEBUG] [LOCAL     ] AER: Saving primary data.
[2025-10-24T17:04:14.268450] [FATAL] [LOCAL     ] AER: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:04:14.268532] [FATAL] [MAIN      ] AER: Failed to save primary data.
[2025-10-24T17:04:14.268604] [WARN ] [MAIN      ] AER: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:04:14.268707] [INFO ] [LOCAL     ] AER: Starting deletion of primary data.
[2025-10-24T17:04:14.268805] [DEBUG] [LOCAL     ] AER: No primary data file found to delete.
[2025-10-24T17:04:14.268852] [INFO ] [LOCAL     ] AER: Starting deletion of derivative data.
[2025-10-24T17:04:14.269025] [DEBUG] [LOCAL     ] AER: Deleted derivative data file.
[2025-10-24T17:04:14.269281] [INFO ] [MAIN      ] Update Progress: 40/2366 symbols completed. AER took 23.1s. Estimated remaining: 4h 3m 37s. Rate: 9.5 symbols/min
[2025-10-24T17:04:14.926469] [INFO ] [MAIN      ] AEXA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:04:14.909725] [INFO ] [MAIN      ] AESI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:04:15.008891] [DEBUG] [LOCAL     ] AEXA: No existing data file found in primary storage.
[2025-10-24T17:04:15.014939] [WARN ] [MAIN      ] AEXA: No existing data found, performing full refresh instead.
[2025-10-24T17:04:15.015106] [INFO ] [MAIN      ] AEXA: Wiping existing primary data before full refresh.
[2025-10-24T17:04:15.016088] [INFO ] [LOCAL     ] AEXA: Starting deletion of primary data.
[2025-10-24T17:04:15.014556] [INFO ] [MAIN      ] AES: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:04:15.016013] [INFO ] [MAIN      ] AFB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:04:15.016355] [DEBUG] [LOCAL     ] AEXA: No primary data file found to delete.
[2025-10-24T17:04:15.016461] [INFO ] [MAIN      ] AEXA: Starting full primary refresh.
[2025-10-24T17:04:15.140188] [DEBUG] [LOCAL     ] AFB: Loaded 11099 existing records from primary storage.
[2025-10-24T17:04:15.151462] [INFO ] [MAIN      ] AFB: Loaded 11099 existing records.
[2025-10-24T17:04:15.616993] [DEBUG] [LOCAL     ] AES: Loaded 54053 existing records from primary storage.
[2025-10-24T17:04:15.600198] [DEBUG] [LOCAL     ] AESI: Loaded 50191 existing records from primary storage.
[2025-10-24T17:04:15.622112] [INFO ] [MAIN      ] AES: Loaded 54053 existing records.
[2025-10-24T17:04:15.635045] [WARN ] [MAIN      ] AFB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:04:15.677926] [INFO ] [REMOTE    ] AEXA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:04:15.687432] [INFO ] [REMOTE    ] AEXA: Fetching primary data for 2025-01.
[2025-10-24T17:04:15.678281] [INFO ] [MAIN      ] AFB: Wiping existing primary data before full refresh.
[2025-10-24T17:04:15.687548] [INFO ] [MAIN      ] AESI: Loaded 50191 existing records.
[2025-10-24T17:04:15.698992] [INFO ] [LOCAL     ] AFB: Starting deletion of primary data.
[2025-10-24T17:04:15.816927] [DEBUG] [LOCAL     ] AFB: Deleted primary data file.
[2025-10-24T17:04:15.858889] [INFO ] [MAIN      ] AFB: Starting full primary refresh.
[2025-10-24T17:04:15.986772] [WARN ] [MAIN      ] AES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:04:15.972306] [DEBUG] [REMOTE    ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:04:16.023991] [INFO ] [MAIN      ] AES: Wiping existing primary data before full refresh.
[2025-10-24T17:04:16.090940] [WARN ] [REMOTE    ] AEXA: No data returned for month 2025-01
[2025-10-24T17:04:16.093936] [WARN ] [MAIN      ] AESI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:04:16.094111] [FATAL] [REMOTE    ] AEXA: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:04:16.109787] [INFO ] [MAIN      ] AESI: Wiping existing primary data before full refresh.
[2025-10-24T17:04:16.099323] [INFO ] [LOCAL     ] AES: Starting deletion of primary data.
[2025-10-24T17:04:16.131760] [FATAL] [MAIN      ] AEXA: Failed to fetch primary data.
[2025-10-24T17:04:16.131812] [INFO ] [LOCAL     ] AESI: Starting deletion of primary data.
[2025-10-24T17:04:16.135252] [WARN ] [MAIN      ] AEXA: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:04:16.140846] [INFO ] [LOCAL     ] AEXA: Starting deletion of primary data.
[2025-10-24T17:04:16.135549] [DEBUG] [LOCAL     ] AES: Deleted primary data file.
[2025-10-24T17:04:16.184160] [DEBUG] [LOCAL     ] AEXA: No primary data file found to delete.
[2025-10-24T17:04:16.184239] [INFO ] [MAIN      ] AES: Starting full primary refresh.
[2025-10-24T17:04:16.189756] [INFO ] [LOCAL     ] AEXA: Starting deletion of derivative data.
[2025-10-24T17:04:16.189811] [DEBUG] [LOCAL     ] AESI: Deleted primary data file.
[2025-10-24T17:04:16.236718] [INFO ] [MAIN      ] AESI: Starting full primary refresh.
[2025-10-24T17:04:16.256007] [DEBUG] [LOCAL     ] AEXA: No derivative data file found to delete.
[2025-10-24T17:04:16.308333] [INFO ] [MAIN      ] Update Progress: 41/2366 symbols completed. AEXA took 2.0s. Estimated remaining: 3h 59m 30s. Rate: 9.7 symbols/min
[2025-10-24T17:04:16.894541] [INFO ] [REMOTE    ] AFB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:04:17.010636] [INFO ] [MAIN      ] AFG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:04:17.007605] [INFO ] [REMOTE    ] AFB: Fetching primary data for 2025-01.
[2025-10-24T17:04:17.221801] [INFO ] [REMOTE    ] AES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:04:17.234254] [INFO ] [REMOTE    ] AES: Fetching primary data for 2025-01.
[2025-10-24T17:04:17.298353] [INFO ] [REMOTE    ] AESI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:04:17.307800] [INFO ] [REMOTE    ] AESI: Fetching primary data for 2025-01.
[2025-10-24T17:04:17.325950] [DEBUG] [LOCAL     ] AFG: Loaded 32088 existing records from primary storage.
[2025-10-24T17:04:17.326249] [INFO ] [MAIN      ] AFG: Loaded 32088 existing records.
[2025-10-24T17:04:17.513360] [WARN ] [MAIN      ] AFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:04:17.513572] [INFO ] [MAIN      ] AFG: Wiping existing primary data before full refresh.
[2025-10-24T17:04:17.513620] [INFO ] [LOCAL     ] AFG: Starting deletion of primary data.
[2025-10-24T17:04:17.513856] [DEBUG] [LOCAL     ] AFG: Deleted primary data file.
[2025-10-24T17:04:17.513908] [INFO ] [MAIN      ] AFG: Starting full primary refresh.
[2025-10-24T17:04:17.889498] [INFO ] [REMOTE    ] AFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:04:17.889858] [INFO ] [REMOTE    ] AFG: Fetching primary data for 2025-01.
[2025-10-24T17:04:18.027837] [INFO ] [REMOTE    ] AFB: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T17:04:18.030725] [INFO ] [REMOTE    ] AFB: Fetching primary data for 2025-02.
[2025-10-24T17:04:18.609128] [INFO ] [REMOTE    ] AESI: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T17:04:18.617874] [INFO ] [REMOTE    ] AESI: Fetching primary data for 2025-02.
[2025-10-24T17:04:18.739703] [INFO ] [REMOTE    ] AFB: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T17:04:18.743596] [INFO ] [REMOTE    ] AFB: Fetching primary data for 2025-03.
[2025-10-24T17:04:19.251970] [INFO ] [REMOTE    ] AFG: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T17:04:19.257320] [INFO ] [REMOTE    ] AFG: Fetching primary data for 2025-02.
[2025-10-24T17:04:19.276614] [INFO ] [REMOTE    ] AFB: Incremental fetch complete for 2025-03 (0.53 seconds).
[2025-10-24T17:04:19.280056] [INFO ] [REMOTE    ] AFB: Fetching primary data for 2025-04.
[2025-10-24T17:04:19.384781] [INFO ] [REMOTE    ] AES: Incremental fetch complete for 2025-01 (2.15 seconds).
[2025-10-24T17:04:19.395090] [INFO ] [REMOTE    ] AES: Fetching primary data for 2025-02.
[2025-10-24T17:04:19.691716] [INFO ] [REMOTE    ] AESI: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T17:04:20.147607] [INFO ] [REMOTE    ] AFB: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T17:04:20.147732] [INFO ] [REMOTE    ] AESI: Fetching primary data for 2025-03.
[2025-10-24T17:04:20.447080] [INFO ] [REMOTE    ] AFG: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T17:04:20.947610] [INFO ] [REMOTE    ] AFG: Fetching primary data for 2025-03.
[2025-10-24T17:04:20.998326] [INFO ] [REMOTE    ] AES: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T17:04:21.446116] [INFO ] [REMOTE    ] AESI: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T17:04:21.747673] [INFO ] [REMOTE    ] AFB: Fetching primary data for 2025-05.
[2025-10-24T17:04:22.282277] [INFO ] [REMOTE    ] AFG: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T17:04:22.315764] [INFO ] [REMOTE    ] AFB: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T17:04:22.547687] [INFO ] [REMOTE    ] AFB: Fetching primary data for 2025-06.
[2025-10-24T17:04:23.086327] [INFO ] [REMOTE    ] AFB: Incremental fetch complete for 2025-06 (0.54 seconds).
[2025-10-24T17:04:23.347759] [INFO ] [REMOTE    ] AFG: Fetching primary data for 2025-04.
[2025-10-24T17:04:24.147716] [INFO ] [REMOTE    ] AFB: Fetching primary data for 2025-07.
[2025-10-24T17:04:24.301778] [INFO ] [REMOTE    ] AFG: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T17:04:24.616941] [INFO ] [REMOTE    ] AFB: Incremental fetch complete for 2025-07 (0.47 seconds).
[2025-10-24T17:04:24.947799] [INFO ] [REMOTE    ] AES: Fetching primary data for 2025-03.
[2025-10-24T17:04:25.747721] [INFO ] [REMOTE    ] AFB: Fetching primary data for 2025-08.
[2025-10-24T17:04:26.460856] [INFO ] [REMOTE    ] AES: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T17:04:26.547020] [INFO ] [REMOTE    ] AFB: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T17:04:26.549468] [INFO ] [REMOTE    ] AESI: Fetching primary data for 2025-04.
[2025-10-24T17:04:27.347681] [INFO ] [REMOTE    ] AES: Fetching primary data for 2025-04.
[2025-10-24T17:04:28.157168] [INFO ] [REMOTE    ] AFG: Fetching primary data for 2025-05.
[2025-10-24T17:04:28.164356] [INFO ] [REMOTE    ] AESI: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T17:04:28.947715] [INFO ] [REMOTE    ] AFB: Fetching primary data for 2025-09.
[2025-10-24T17:04:29.044108] [INFO ] [REMOTE    ] AES: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T17:04:29.138685] [INFO ] [REMOTE    ] AFG: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T17:04:29.747625] [INFO ] [REMOTE    ] AFG: Fetching primary data for 2025-06.
[2025-10-24T17:04:29.951190] [INFO ] [REMOTE    ] AFB: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T17:04:30.547618] [INFO ] [REMOTE    ] AFB: Fetching primary data for 2025-10.
[2025-10-24T17:04:31.012605] [INFO ] [REMOTE    ] AFG: Incremental fetch complete for 2025-06 (1.26 seconds).
[2025-10-24T17:04:31.218874] [INFO ] [REMOTE    ] AFB: Incremental fetch complete for 2025-10 (0.67 seconds).
[2025-10-24T17:04:31.221281] [INFO ] [REMOTE    ] AFB: Full fetch complete (16277 records).
[2025-10-24T17:04:31.221356] [DEBUG] [VALIDATOR ] AFB: Validating primary data.
[2025-10-24T17:04:31.361538] [INFO ] [REMOTE    ] AFG: Fetching primary data for 2025-07.
[2025-10-24T17:04:31.585854] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present.
[2025-10-24T17:04:31.585926] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed.
[2025-10-24T17:04:31.586171] [INFO ] [MAIN      ] AFB: Fetched primary data is valid.
[2025-10-24T17:04:31.586210] [DEBUG] [LOCAL     ] AFB: Saving primary data.
[2025-10-24T17:04:31.586438] [FATAL] [LOCAL     ] AFB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:04:31.586521] [FATAL] [MAIN      ] AFB: Failed to save primary data.
[2025-10-24T17:04:31.586563] [WARN ] [MAIN      ] AFB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:04:31.586597] [INFO ] [LOCAL     ] AFB: Starting deletion of primary data.
[2025-10-24T17:04:31.586667] [DEBUG] [LOCAL     ] AFB: No primary data file found to delete.
[2025-10-24T17:04:31.586743] [INFO ] [LOCAL     ] AFB: Starting deletion of derivative data.
[2025-10-24T17:04:31.586958] [DEBUG] [LOCAL     ] AFB: Deleted derivative data file.
[2025-10-24T17:04:31.587046] [INFO ] [MAIN      ] Update Progress: 42/2366 symbols completed. AFB took 17.2s. Estimated remaining: 4h 7m 47s. Rate: 9.4 symbols/min
[2025-10-24T17:04:31.755802] [INFO ] [MAIN      ] AFGB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:04:31.759659] [DEBUG] [LOCAL     ] AFGB: Loaded 2217 existing records from primary storage.
[2025-10-24T17:04:31.759823] [INFO ] [MAIN      ] AFGB: Loaded 2217 existing records.
[2025-10-24T17:04:31.937483] [WARN ] [MAIN      ] AFGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:04:31.937695] [INFO ] [MAIN      ] AFGB: Wiping existing primary data before full refresh.
[2025-10-24T17:04:31.937752] [INFO ] [LOCAL     ] AFGB: Starting deletion of primary data.
[2025-10-24T17:04:31.937906] [DEBUG] [LOCAL     ] AFGB: Deleted primary data file.
[2025-10-24T17:04:31.937963] [INFO ] [MAIN      ] AFGB: Starting full primary refresh.
[2025-10-24T17:04:32.154850] [INFO ] [REMOTE    ] AES: Fetching primary data for 2025-05.
[2025-10-24T17:04:32.293212] [INFO ] [REMOTE    ] AFGB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:04:32.455318] [INFO ] [REMOTE    ] AFG: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T17:04:32.947638] [INFO ] [REMOTE    ] AESI: Fetching primary data for 2025-05.
[2025-10-24T17:04:33.747759] [INFO ] [REMOTE    ] AFGB: Fetching primary data for 2025-01.
[2025-10-24T17:04:34.357240] [INFO ] [REMOTE    ] AES: Incremental fetch complete for 2025-05 (2.20 seconds).
[2025-10-24T17:04:34.405190] [INFO ] [REMOTE    ] AFGB: Incremental fetch complete for 2025-01 (0.66 seconds).
[2025-10-24T17:04:34.410001] [INFO ] [REMOTE    ] AESI: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T17:04:34.547731] [INFO ] [REMOTE    ] AFGB: Fetching primary data for 2025-02.
[2025-10-24T17:04:34.919062] [INFO ] [REMOTE    ] AFGB: Incremental fetch complete for 2025-02 (0.37 seconds).
[2025-10-24T17:04:35.347681] [INFO ] [REMOTE    ] AESI: Fetching primary data for 2025-06.
[2025-10-24T17:04:36.147636] [INFO ] [REMOTE    ] AFG: Fetching primary data for 2025-08.
[2025-10-24T17:04:36.551711] [INFO ] [REMOTE    ] AESI: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T17:04:36.947672] [INFO ] [REMOTE    ] AES: Fetching primary data for 2025-06.
[2025-10-24T17:04:37.028994] [INFO ] [REMOTE    ] AFG: Incremental fetch complete for 2025-08 (0.88 seconds).
[2025-10-24T17:04:37.747739] [INFO ] [REMOTE    ] AFG: Fetching primary data for 2025-09.
[2025-10-24T17:04:38.547681] [INFO ] [REMOTE    ] AESI: Fetching primary data for 2025-07.
[2025-10-24T17:04:38.831026] [INFO ] [REMOTE    ] AES: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T17:04:38.998573] [INFO ] [REMOTE    ] AFG: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T17:04:39.347686] [INFO ] [REMOTE    ] AFGB: Fetching primary data for 2025-03.
[2025-10-24T17:04:39.872848] [INFO ] [REMOTE    ] AFGB: Incremental fetch complete for 2025-03 (0.53 seconds).
[2025-10-24T17:04:40.147620] [INFO ] [REMOTE    ] AES: Fetching primary data for 2025-07.
[2025-10-24T17:04:40.178066] [INFO ] [REMOTE    ] AESI: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T17:04:40.947719] [INFO ] [REMOTE    ] AESI: Fetching primary data for 2025-08.
[2025-10-24T17:04:41.726732] [INFO ] [REMOTE    ] AES: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T17:04:41.747597] [INFO ] [REMOTE    ] AES: Fetching primary data for 2025-08.
[2025-10-24T17:04:42.547614] [INFO ] [REMOTE    ] AFGB: Fetching primary data for 2025-04.
[2025-10-24T17:04:42.634637] [INFO ] [REMOTE    ] AESI: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T17:04:42.995483] [INFO ] [REMOTE    ] AFGB: Incremental fetch complete for 2025-04 (0.45 seconds).
[2025-10-24T17:04:43.347634] [INFO ] [REMOTE    ] AESI: Fetching primary data for 2025-09.
[2025-10-24T17:04:43.543755] [INFO ] [REMOTE    ] AES: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T17:04:44.147731] [INFO ] [REMOTE    ] AFG: Fetching primary data for 2025-10.
[2025-10-24T17:04:44.947732] [INFO ] [REMOTE    ] AFGB: Fetching primary data for 2025-05.
[2025-10-24T17:04:45.189141] [INFO ] [REMOTE    ] AESI: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T17:04:45.271900] [INFO ] [REMOTE    ] AFG: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T17:04:45.277805] [INFO ] [REMOTE    ] AFG: Full fetch complete (46833 records).
[2025-10-24T17:04:45.277906] [DEBUG] [VALIDATOR ] AFG: Validating primary data.
[2025-10-24T17:04:45.519744] [INFO ] [REMOTE    ] AFGB: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T17:04:45.665299] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present.
[2025-10-24T17:04:45.665377] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed.
[2025-10-24T17:04:45.665888] [INFO ] [MAIN      ] AFG: Fetched primary data is valid.
[2025-10-24T17:04:45.665953] [DEBUG] [LOCAL     ] AFG: Saving primary data.
[2025-10-24T17:04:45.666361] [FATAL] [LOCAL     ] AFG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:04:45.666447] [FATAL] [MAIN      ] AFG: Failed to save primary data.
[2025-10-24T17:04:45.666490] [WARN ] [MAIN      ] AFG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:04:45.666547] [INFO ] [LOCAL     ] AFG: Starting deletion of primary data.
[2025-10-24T17:04:45.666627] [DEBUG] [LOCAL     ] AFG: No primary data file found to delete.
[2025-10-24T17:04:45.666707] [INFO ] [LOCAL     ] AFG: Starting deletion of derivative data.
[2025-10-24T17:04:45.666865] [DEBUG] [LOCAL     ] AFG: Deleted derivative data file.
[2025-10-24T17:04:45.666945] [INFO ] [MAIN      ] Update Progress: 43/2366 symbols completed. AFG took 29.2s. Estimated remaining: 4h 14m 36s. Rate: 9.1 symbols/min
[2025-10-24T17:04:45.752760] [INFO ] [REMOTE    ] AFGB: Fetching primary data for 2025-06.
[2025-10-24T17:04:45.835323] [INFO ] [MAIN      ] AFGC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:04:45.839516] [DEBUG] [LOCAL     ] AFGC: Loaded 2557 existing records from primary storage.
[2025-10-24T17:04:45.839718] [INFO ] [MAIN      ] AFGC: Loaded 2557 existing records.
[2025-10-24T17:04:46.014704] [WARN ] [MAIN      ] AFGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:04:46.014936] [INFO ] [MAIN      ] AFGC: Wiping existing primary data before full refresh.
[2025-10-24T17:04:46.014984] [INFO ] [LOCAL     ] AFGC: Starting deletion of primary data.
[2025-10-24T17:04:46.015163] [DEBUG] [LOCAL     ] AFGC: Deleted primary data file.
[2025-10-24T17:04:46.015221] [INFO ] [MAIN      ] AFGC: Starting full primary refresh.
[2025-10-24T17:04:46.121596] [INFO ] [REMOTE    ] AFGB: Incremental fetch complete for 2025-06 (0.37 seconds).
[2025-10-24T17:04:46.375070] [INFO ] [REMOTE    ] AFGC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:04:46.547701] [INFO ] [REMOTE    ] AFGC: Fetching primary data for 2025-01.
[2025-10-24T17:04:47.050030] [INFO ] [REMOTE    ] AFGC: Incremental fetch complete for 2025-01 (0.50 seconds).
[2025-10-24T17:04:47.347758] [INFO ] [REMOTE    ] AFGB: Fetching primary data for 2025-07.
[2025-10-24T17:04:47.773796] [INFO ] [REMOTE    ] AFGB: Incremental fetch complete for 2025-07 (0.43 seconds).
[2025-10-24T17:04:48.147682] [INFO ] [REMOTE    ] AFGB: Fetching primary data for 2025-08.
[2025-10-24T17:04:48.599806] [INFO ] [REMOTE    ] AFGB: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T17:04:48.947708] [INFO ] [REMOTE    ] AFGC: Fetching primary data for 2025-02.
[2025-10-24T17:04:49.447123] [INFO ] [REMOTE    ] AFGC: Incremental fetch complete for 2025-02 (0.50 seconds).
[2025-10-24T17:04:49.747709] [INFO ] [REMOTE    ] AESI: Fetching primary data for 2025-10.
[2025-10-24T17:04:50.547714] [INFO ] [REMOTE    ] AES: Fetching primary data for 2025-09.
[2025-10-24T17:04:51.347713] [INFO ] [REMOTE    ] AFGB: Fetching primary data for 2025-09.
[2025-10-24T17:04:51.542861] [INFO ] [REMOTE    ] AESI: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T17:04:51.552814] [INFO ] [REMOTE    ] AESI: Full fetch complete (71803 records).
[2025-10-24T17:04:51.552979] [DEBUG] [VALIDATOR ] AESI: Validating primary data.
[2025-10-24T17:04:51.834184] [INFO ] [REMOTE    ] AFGB: Incremental fetch complete for 2025-09 (0.49 seconds).
[2025-10-24T17:04:51.969290] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present.
[2025-10-24T17:04:51.969477] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed.
[2025-10-24T17:04:51.970287] [INFO ] [MAIN      ] AESI: Fetched primary data is valid.
[2025-10-24T17:04:51.970398] [DEBUG] [LOCAL     ] AESI: Saving primary data.
[2025-10-24T17:04:51.971187] [FATAL] [LOCAL     ] AESI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:04:51.971328] [FATAL] [MAIN      ] AESI: Failed to save primary data.
[2025-10-24T17:04:51.971394] [WARN ] [MAIN      ] AESI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:04:51.971486] [INFO ] [LOCAL     ] AESI: Starting deletion of primary data.
[2025-10-24T17:04:51.971562] [DEBUG] [LOCAL     ] AESI: No primary data file found to delete.
[2025-10-24T17:04:51.971619] [INFO ] [LOCAL     ] AESI: Starting deletion of derivative data.
[2025-10-24T17:04:51.971808] [DEBUG] [LOCAL     ] AESI: Deleted derivative data file.
[2025-10-24T17:04:51.972139] [INFO ] [MAIN      ] Update Progress: 44/2366 symbols completed. AESI took 37.7s. Estimated remaining: 4h 14m 15s. Rate: 9.1 symbols/min
[2025-10-24T17:04:52.160610] [INFO ] [REMOTE    ] AFGC: Fetching primary data for 2025-03.
[2025-10-24T17:04:52.188191] [INFO ] [MAIN      ] AFGD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:04:52.198181] [INFO ] [REMOTE    ] AES: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T17:04:52.217271] [DEBUG] [LOCAL     ] AFGD: Loaded 1757 existing records from primary storage.
[2025-10-24T17:04:52.218191] [INFO ] [MAIN      ] AFGD: Loaded 1757 existing records.
[2025-10-24T17:04:52.400398] [WARN ] [MAIN      ] AFGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:04:52.400664] [INFO ] [MAIN      ] AFGD: Wiping existing primary data before full refresh.
[2025-10-24T17:04:52.400727] [INFO ] [LOCAL     ] AFGD: Starting deletion of primary data.
[2025-10-24T17:04:52.400875] [DEBUG] [LOCAL     ] AFGD: Deleted primary data file.
[2025-10-24T17:04:52.400915] [INFO ] [MAIN      ] AFGD: Starting full primary refresh.
[2025-10-24T17:04:52.666785] [INFO ] [REMOTE    ] AFGC: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T17:04:52.764434] [INFO ] [REMOTE    ] AFGD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:04:52.947727] [INFO ] [REMOTE    ] AES: Fetching primary data for 2025-10.
[2025-10-24T17:04:53.747673] [INFO ] [REMOTE    ] AFGD: Fetching primary data for 2025-01.
[2025-10-24T17:04:54.165223] [INFO ] [REMOTE    ] AFGD: Incremental fetch complete for 2025-01 (0.42 seconds).
[2025-10-24T17:04:54.547743] [INFO ] [REMOTE    ] AFGC: Fetching primary data for 2025-04.
[2025-10-24T17:04:54.881999] [INFO ] [REMOTE    ] AES: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T17:04:54.891770] [INFO ] [REMOTE    ] AES: Full fetch complete (77841 records).
[2025-10-24T17:04:54.891938] [DEBUG] [VALIDATOR ] AES: Validating primary data.
[2025-10-24T17:04:54.999137] [INFO ] [REMOTE    ] AFGC: Incremental fetch complete for 2025-04 (0.45 seconds).
[2025-10-24T17:04:55.305926] [DEBUG] [VALIDATOR ] AES: All expected trading days are present.
[2025-10-24T17:04:55.306017] [DEBUG] [VALIDATOR ] AES: Primary data validation passed.
[2025-10-24T17:04:55.306799] [INFO ] [MAIN      ] AES: Fetched primary data is valid.
[2025-10-24T17:04:55.306865] [DEBUG] [LOCAL     ] AES: Saving primary data.
[2025-10-24T17:04:55.307678] [FATAL] [LOCAL     ] AES: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:04:55.307781] [FATAL] [MAIN      ] AES: Failed to save primary data.
[2025-10-24T17:04:55.307879] [WARN ] [MAIN      ] AES: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:04:55.307971] [INFO ] [LOCAL     ] AES: Starting deletion of primary data.
[2025-10-24T17:04:55.308057] [DEBUG] [LOCAL     ] AES: No primary data file found to delete.
[2025-10-24T17:04:55.308096] [INFO ] [LOCAL     ] AES: Starting deletion of derivative data.
[2025-10-24T17:04:55.308238] [DEBUG] [LOCAL     ] AES: Deleted derivative data file.
[2025-10-24T17:04:55.308635] [INFO ] [MAIN      ] Update Progress: 45/2366 symbols completed. AES took 41.0s. Estimated remaining: 4h 11m 22s. Rate: 9.2 symbols/min
[2025-10-24T17:04:55.352763] [INFO ] [REMOTE    ] AFGC: Fetching primary data for 2025-05.
[2025-10-24T17:04:55.486542] [INFO ] [MAIN      ] AFGE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:04:55.490872] [DEBUG] [LOCAL     ] AFGE: Loaded 2248 existing records from primary storage.
[2025-10-24T17:04:55.491050] [INFO ] [MAIN      ] AFGE: Loaded 2248 existing records.
[2025-10-24T17:04:55.667546] [WARN ] [MAIN      ] AFGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:04:55.667785] [INFO ] [MAIN      ] AFGE: Wiping existing primary data before full refresh.
[2025-10-24T17:04:55.667844] [INFO ] [LOCAL     ] AFGE: Starting deletion of primary data.
[2025-10-24T17:04:55.668027] [DEBUG] [LOCAL     ] AFGE: Deleted primary data file.
[2025-10-24T17:04:55.668089] [INFO ] [MAIN      ] AFGE: Starting full primary refresh.
[2025-10-24T17:04:56.031975] [INFO ] [REMOTE    ] AFGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:04:56.026286] [INFO ] [REMOTE    ] AFGC: Incremental fetch complete for 2025-05 (0.67 seconds).
[2025-10-24T17:04:56.147615] [INFO ] [REMOTE    ] AFGC: Fetching primary data for 2025-06.
[2025-10-24T17:04:56.510265] [INFO ] [REMOTE    ] AFGC: Incremental fetch complete for 2025-06 (0.36 seconds).
[2025-10-24T17:04:56.947698] [INFO ] [REMOTE    ] AFGB: Fetching primary data for 2025-10.
[2025-10-24T17:04:57.456001] [INFO ] [REMOTE    ] AFGB: Incremental fetch complete for 2025-10 (0.51 seconds).
[2025-10-24T17:04:57.456909] [INFO ] [REMOTE    ] AFGB: Full fetch complete (3420 records).
[2025-10-24T17:04:57.456988] [DEBUG] [VALIDATOR ] AFGB: Validating primary data.
[2025-10-24T17:04:57.752760] [INFO ] [REMOTE    ] AFGC: Fetching primary data for 2025-07.
[2025-10-24T17:04:57.826041] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present.
[2025-10-24T17:04:57.826123] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed.
[2025-10-24T17:04:57.826248] [INFO ] [MAIN      ] AFGB: Fetched primary data is valid.
[2025-10-24T17:04:57.826289] [DEBUG] [LOCAL     ] AFGB: Saving primary data.
[2025-10-24T17:04:57.826502] [FATAL] [LOCAL     ] AFGB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:04:57.826588] [FATAL] [MAIN      ] AFGB: Failed to save primary data.
[2025-10-24T17:04:57.826631] [WARN ] [MAIN      ] AFGB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:04:57.826717] [INFO ] [LOCAL     ] AFGB: Starting deletion of primary data.
[2025-10-24T17:04:57.826776] [DEBUG] [LOCAL     ] AFGB: No primary data file found to delete.
[2025-10-24T17:04:57.826812] [INFO ] [LOCAL     ] AFGB: Starting deletion of derivative data.
[2025-10-24T17:04:57.826947] [DEBUG] [LOCAL     ] AFGB: Deleted derivative data file.
[2025-10-24T17:04:57.827023] [INFO ] [MAIN      ] Update Progress: 46/2366 symbols completed. AFGB took 26.2s. Estimated remaining: 4h 7m 55s. Rate: 9.4 symbols/min
[2025-10-24T17:04:58.002898] [INFO ] [MAIN      ] AFL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:04:58.056946] [DEBUG] [LOCAL     ] AFL: Loaded 53562 existing records from primary storage.
[2025-10-24T17:04:58.057254] [INFO ] [MAIN      ] AFL: Loaded 53562 existing records.
[2025-10-24T17:04:58.232805] [WARN ] [MAIN      ] AFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:04:58.233040] [INFO ] [MAIN      ] AFL: Wiping existing primary data before full refresh.
[2025-10-24T17:04:58.233086] [INFO ] [LOCAL     ] AFL: Starting deletion of primary data.
[2025-10-24T17:04:58.233306] [DEBUG] [LOCAL     ] AFL: Deleted primary data file.
[2025-10-24T17:04:58.233361] [INFO ] [MAIN      ] AFL: Starting full primary refresh.
[2025-10-24T17:04:58.504630] [INFO ] [REMOTE    ] AFGC: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T17:04:58.555377] [INFO ] [REMOTE    ] AFGC: Fetching primary data for 2025-08.
[2025-10-24T17:04:58.596218] [INFO ] [REMOTE    ] AFL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:04:59.250910] [INFO ] [REMOTE    ] AFGC: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T17:04:59.347705] [INFO ] [REMOTE    ] AFL: Fetching primary data for 2025-01.
[2025-10-24T17:05:00.147696] [INFO ] [REMOTE    ] AFGE: Fetching primary data for 2025-01.
[2025-10-24T17:05:00.718093] [INFO ] [REMOTE    ] AFGE: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T17:05:00.947626] [INFO ] [REMOTE    ] AFGC: Fetching primary data for 2025-09.
[2025-10-24T17:05:01.115125] [INFO ] [REMOTE    ] AFL: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T17:05:01.747634] [INFO ] [REMOTE    ] AFL: Fetching primary data for 2025-02.
[2025-10-24T17:05:01.833387] [INFO ] [REMOTE    ] AFGC: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T17:05:02.547746] [INFO ] [REMOTE    ] AFGC: Fetching primary data for 2025-10.
[2025-10-24T17:05:03.347675] [INFO ] [REMOTE    ] AFGD: Fetching primary data for 2025-02.
[2025-10-24T17:05:03.657925] [INFO ] [REMOTE    ] AFGC: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T17:05:03.658880] [INFO ] [REMOTE    ] AFGC: Full fetch complete (3563 records).
[2025-10-24T17:05:03.658950] [DEBUG] [VALIDATOR ] AFGC: Validating primary data.
[2025-10-24T17:05:04.042924] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present.
[2025-10-24T17:05:04.043058] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed.
[2025-10-24T17:05:04.043333] [INFO ] [MAIN      ] AFGC: Fetched primary data is valid.
[2025-10-24T17:05:04.043517] [DEBUG] [LOCAL     ] AFGC: Saving primary data.
[2025-10-24T17:05:04.043778] [FATAL] [LOCAL     ] AFGC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:05:04.043930] [FATAL] [MAIN      ] AFGC: Failed to save primary data.
[2025-10-24T17:05:04.043975] [WARN ] [MAIN      ] AFGC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:05:04.044131] [INFO ] [LOCAL     ] AFGC: Starting deletion of primary data.
[2025-10-24T17:05:04.044256] [DEBUG] [LOCAL     ] AFGC: No primary data file found to delete.
[2025-10-24T17:05:04.044396] [INFO ] [LOCAL     ] AFGC: Starting deletion of derivative data.
[2025-10-24T17:05:04.044603] [DEBUG] [LOCAL     ] AFGC: Deleted derivative data file.
[2025-10-24T17:05:04.044724] [INFO ] [MAIN      ] Update Progress: 47/2366 symbols completed. AFGC took 18.4s. Estimated remaining: 4h 7m 39s. Rate: 9.4 symbols/min
[2025-10-24T17:05:04.150570] [INFO ] [REMOTE    ] AFGE: Fetching primary data for 2025-02.
[2025-10-24T17:05:04.256285] [INFO ] [MAIN      ] AG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:05:04.259472] [INFO ] [REMOTE    ] AFL: Incremental fetch complete for 2025-02 (2.51 seconds).
[2025-10-24T17:05:04.321124] [DEBUG] [LOCAL     ] AG: Loaded 54033 existing records from primary storage.
[2025-10-24T17:05:04.321475] [INFO ] [MAIN      ] AG: Loaded 54033 existing records.
[2025-10-24T17:05:04.512930] [WARN ] [MAIN      ] AG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:05:04.513138] [INFO ] [MAIN      ] AG: Wiping existing primary data before full refresh.
[2025-10-24T17:05:04.513185] [INFO ] [LOCAL     ] AG: Starting deletion of primary data.
[2025-10-24T17:05:04.513605] [DEBUG] [LOCAL     ] AG: Deleted primary data file.
[2025-10-24T17:05:04.513685] [INFO ] [MAIN      ] AG: Starting full primary refresh.
[2025-10-24T17:05:04.634607] [INFO ] [REMOTE    ] AFGD: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T17:05:04.679424] [INFO ] [REMOTE    ] AFGE: Incremental fetch complete for 2025-02 (0.53 seconds).
[2025-10-24T17:05:04.923531] [INFO ] [REMOTE    ] AG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:05:04.947670] [INFO ] [REMOTE    ] AFGD: Fetching primary data for 2025-03.
[2025-10-24T17:05:05.600360] [INFO ] [REMOTE    ] AFGD: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T17:05:05.747721] [INFO ] [REMOTE    ] AFGD: Fetching primary data for 2025-04.
[2025-10-24T17:05:06.158357] [INFO ] [REMOTE    ] AFGD: Incremental fetch complete for 2025-04 (0.41 seconds).
[2025-10-24T17:05:06.547687] [INFO ] [REMOTE    ] AFL: Fetching primary data for 2025-03.
[2025-10-24T17:05:07.347715] [INFO ] [REMOTE    ] AFGE: Fetching primary data for 2025-03.
[2025-10-24T17:05:07.778046] [INFO ] [REMOTE    ] AFGE: Incremental fetch complete for 2025-03 (0.43 seconds).
[2025-10-24T17:05:08.089717] [INFO ] [REMOTE    ] AFL: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T17:05:08.147634] [INFO ] [REMOTE    ] AFGE: Fetching primary data for 2025-04.
[2025-10-24T17:05:08.475383] [INFO ] [REMOTE    ] AFGE: Incremental fetch complete for 2025-04 (0.33 seconds).
[2025-10-24T17:05:08.947716] [INFO ] [REMOTE    ] AG: Fetching primary data for 2025-01.
[2025-10-24T17:05:09.747727] [INFO ] [REMOTE    ] AFGE: Fetching primary data for 2025-05.
[2025-10-24T17:05:10.201558] [INFO ] [REMOTE    ] AFGE: Incremental fetch complete for 2025-05 (0.45 seconds).
[2025-10-24T17:05:10.547729] [INFO ] [REMOTE    ] AFGD: Fetching primary data for 2025-05.
[2025-10-24T17:05:10.868935] [INFO ] [REMOTE    ] AFGD: Incremental fetch complete for 2025-05 (0.32 seconds).
[2025-10-24T17:05:10.869874] [INFO ] [REMOTE    ] AG: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T17:05:11.347674] [INFO ] [REMOTE    ] AFGD: Fetching primary data for 2025-06.
[2025-10-24T17:05:11.629304] [INFO ] [REMOTE    ] AFGD: Incremental fetch complete for 2025-06 (0.28 seconds).
[2025-10-24T17:05:12.147665] [INFO ] [REMOTE    ] AFGD: Fetching primary data for 2025-07.
[2025-10-24T17:05:12.574366] [INFO ] [REMOTE    ] AFGD: Incremental fetch complete for 2025-07 (0.43 seconds).
[2025-10-24T17:05:12.947699] [INFO ] [REMOTE    ] AFL: Fetching primary data for 2025-04.
[2025-10-24T17:05:13.747695] [INFO ] [REMOTE    ] AFGE: Fetching primary data for 2025-06.
[2025-10-24T17:05:14.205842] [INFO ] [REMOTE    ] AFGE: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T17:05:14.547636] [INFO ] [REMOTE    ] AFGE: Fetching primary data for 2025-07.
[2025-10-24T17:05:14.739825] [INFO ] [REMOTE    ] AFL: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T17:05:14.979446] [INFO ] [REMOTE    ] AFGE: Incremental fetch complete for 2025-07 (0.43 seconds).
[2025-10-24T17:05:15.347687] [INFO ] [REMOTE    ] AFGD: Fetching primary data for 2025-08.
[2025-10-24T17:05:15.800188] [INFO ] [REMOTE    ] AFGD: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T17:05:16.147699] [INFO ] [REMOTE    ] AG: Fetching primary data for 2025-02.
[2025-10-24T17:05:16.947719] [INFO ] [REMOTE    ] AFGD: Fetching primary data for 2025-09.
[2025-10-24T17:05:17.260733] [INFO ] [REMOTE    ] AFGD: Incremental fetch complete for 2025-09 (0.31 seconds).
[2025-10-24T17:05:17.747728] [INFO ] [REMOTE    ] AFL: Fetching primary data for 2025-05.
[2025-10-24T17:05:17.879919] [INFO ] [REMOTE    ] AG: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T17:05:18.547689] [INFO ] [REMOTE    ] AG: Fetching primary data for 2025-03.
[2025-10-24T17:05:19.347738] [INFO ] [REMOTE    ] AFGE: Fetching primary data for 2025-08.
[2025-10-24T17:05:19.500346] [INFO ] [REMOTE    ] AFL: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T17:05:19.914562] [INFO ] [REMOTE    ] AFGE: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T17:05:20.134213] [INFO ] [REMOTE    ] AG: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T17:05:20.147602] [INFO ] [REMOTE    ] AG: Fetching primary data for 2025-04.
[2025-10-24T17:05:20.947682] [INFO ] [REMOTE    ] AFL: Fetching primary data for 2025-06.
[2025-10-24T17:05:21.747692] [INFO ] [REMOTE    ] AFGD: Fetching primary data for 2025-10.
[2025-10-24T17:05:22.253064] [INFO ] [REMOTE    ] AFGD: Incremental fetch complete for 2025-10 (0.51 seconds).
[2025-10-24T17:05:22.263799] [INFO ] [REMOTE    ] AFGD: Full fetch complete (2698 records).
[2025-10-24T17:05:22.283864] [DEBUG] [VALIDATOR ] AFGD: Validating primary data.
[2025-10-24T17:05:22.283713] [INFO ] [REMOTE    ] AFL: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T17:05:22.329385] [INFO ] [REMOTE    ] AG: Incremental fetch complete for 2025-04 (2.18 seconds).
[2025-10-24T17:05:22.553326] [INFO ] [REMOTE    ] AFL: Fetching primary data for 2025-07.
[2025-10-24T17:05:22.676936] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present.
[2025-10-24T17:05:22.677011] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed.
[2025-10-24T17:05:22.677120] [INFO ] [MAIN      ] AFGD: Fetched primary data is valid.
[2025-10-24T17:05:22.677161] [DEBUG] [LOCAL     ] AFGD: Saving primary data.
[2025-10-24T17:05:22.677341] [FATAL] [LOCAL     ] AFGD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:05:22.677436] [FATAL] [MAIN      ] AFGD: Failed to save primary data.
[2025-10-24T17:05:22.677526] [WARN ] [MAIN      ] AFGD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:05:22.677615] [INFO ] [LOCAL     ] AFGD: Starting deletion of primary data.
[2025-10-24T17:05:22.677719] [DEBUG] [LOCAL     ] AFGD: No primary data file found to delete.
[2025-10-24T17:05:22.677766] [INFO ] [LOCAL     ] AFGD: Starting deletion of derivative data.
[2025-10-24T17:05:22.677953] [DEBUG] [LOCAL     ] AFGD: Deleted derivative data file.
[2025-10-24T17:05:22.678042] [INFO ] [MAIN      ] Update Progress: 48/2366 symbols completed. AFGD took 30.7s. Estimated remaining: 4h 17m 23s. Rate: 9.0 symbols/min
[2025-10-24T17:05:22.855371] [INFO ] [MAIN      ] AGCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:05:22.901855] [DEBUG] [LOCAL     ] AGCO: Loaded 42392 existing records from primary storage.
[2025-10-24T17:05:22.902165] [INFO ] [MAIN      ] AGCO: Loaded 42392 existing records.
[2025-10-24T17:05:23.083489] [WARN ] [MAIN      ] AGCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:05:23.083763] [INFO ] [MAIN      ] AGCO: Wiping existing primary data before full refresh.
[2025-10-24T17:05:23.083818] [INFO ] [LOCAL     ] AGCO: Starting deletion of primary data.
[2025-10-24T17:05:23.084114] [DEBUG] [LOCAL     ] AGCO: Deleted primary data file.
[2025-10-24T17:05:23.084172] [INFO ] [MAIN      ] AGCO: Starting full primary refresh.
[2025-10-24T17:05:23.356893] [INFO ] [REMOTE    ] AFGE: Fetching primary data for 2025-09.
[2025-10-24T17:05:23.453533] [INFO ] [REMOTE    ] AGCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:05:23.707637] [INFO ] [REMOTE    ] AFGE: Incremental fetch complete for 2025-09 (0.35 seconds).
[2025-10-24T17:05:24.147618] [INFO ] [REMOTE    ] AG: Fetching primary data for 2025-05.
[2025-10-24T17:05:24.491705] [INFO ] [REMOTE    ] AFL: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T17:05:24.947685] [INFO ] [REMOTE    ] AFL: Fetching primary data for 2025-08.
[2025-10-24T17:05:25.747692] [INFO ] [REMOTE    ] AGCO: Fetching primary data for 2025-01.
[2025-10-24T17:05:26.205686] [INFO ] [REMOTE    ] AG: Incremental fetch complete for 2025-05 (2.06 seconds).
[2025-10-24T17:05:26.448981] [INFO ] [REMOTE    ] AFL: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T17:05:26.547684] [INFO ] [REMOTE    ] AG: Fetching primary data for 2025-06.
[2025-10-24T17:05:27.347728] [INFO ] [REMOTE    ] AFL: Fetching primary data for 2025-09.
[2025-10-24T17:05:27.394381] [INFO ] [REMOTE    ] AGCO: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T17:05:28.147605] [INFO ] [REMOTE    ] AGCO: Fetching primary data for 2025-02.
[2025-10-24T17:05:28.325523] [INFO ] [REMOTE    ] AG: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T17:05:28.947720] [INFO ] [REMOTE    ] AG: Fetching primary data for 2025-07.
[2025-10-24T17:05:29.063440] [INFO ] [REMOTE    ] AFL: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T17:05:29.611372] [INFO ] [REMOTE    ] AGCO: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T17:05:29.747719] [INFO ] [REMOTE    ] AFL: Fetching primary data for 2025-10.
[2025-10-24T17:05:30.547632] [INFO ] [REMOTE    ] AGCO: Fetching primary data for 2025-03.
[2025-10-24T17:05:30.724618] [INFO ] [REMOTE    ] AG: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T17:05:31.347742] [INFO ] [REMOTE    ] AG: Fetching primary data for 2025-08.
[2025-10-24T17:05:31.713014] [INFO ] [REMOTE    ] AFL: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T17:05:31.722821] [INFO ] [REMOTE    ] AFL: Full fetch complete (77072 records).
[2025-10-24T17:05:31.722958] [DEBUG] [VALIDATOR ] AFL: Validating primary data.
[2025-10-24T17:05:32.124753] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present.
[2025-10-24T17:05:32.124902] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed.
[2025-10-24T17:05:32.125735] [INFO ] [MAIN      ] AFL: Fetched primary data is valid.
[2025-10-24T17:05:32.125818] [DEBUG] [LOCAL     ] AFL: Saving primary data.
[2025-10-24T17:05:32.134923] [FATAL] [LOCAL     ] AFL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:05:32.150124] [FATAL] [MAIN      ] AFL: Failed to save primary data.
[2025-10-24T17:05:32.150041] [INFO ] [REMOTE    ] AFGE: Fetching primary data for 2025-10.
[2025-10-24T17:05:32.150298] [WARN ] [MAIN      ] AFL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:05:32.152883] [INFO ] [REMOTE    ] AGCO: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T17:05:32.151806] [INFO ] [LOCAL     ] AFL: Starting deletion of primary data.
[2025-10-24T17:05:32.161780] [DEBUG] [LOCAL     ] AFL: No primary data file found to delete.
[2025-10-24T17:05:32.162004] [INFO ] [LOCAL     ] AFL: Starting deletion of derivative data.
[2025-10-24T17:05:32.162800] [DEBUG] [LOCAL     ] AFL: Deleted derivative data file.
[2025-10-24T17:05:32.163472] [INFO ] [MAIN      ] Update Progress: 49/2366 symbols completed. AFL took 34.3s. Estimated remaining: 4h 19m 30s. Rate: 8.9 symbols/min
[2025-10-24T17:05:32.333818] [INFO ] [MAIN      ] AGD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:05:32.355018] [DEBUG] [LOCAL     ] AGD: Loaded 19375 existing records from primary storage.
[2025-10-24T17:05:32.355258] [INFO ] [MAIN      ] AGD: Loaded 19375 existing records.
[2025-10-24T17:05:32.530738] [WARN ] [MAIN      ] AGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:05:32.530935] [INFO ] [MAIN      ] AGD: Wiping existing primary data before full refresh.
[2025-10-24T17:05:32.530984] [INFO ] [LOCAL     ] AGD: Starting deletion of primary data.
[2025-10-24T17:05:32.531230] [DEBUG] [LOCAL     ] AGD: Deleted primary data file.
[2025-10-24T17:05:32.531269] [INFO ] [MAIN      ] AGD: Starting full primary refresh.
[2025-10-24T17:05:32.639239] [INFO ] [REMOTE    ] AFGE: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T17:05:32.655565] [INFO ] [REMOTE    ] AFGE: Full fetch complete (3307 records).
[2025-10-24T17:05:32.660774] [DEBUG] [VALIDATOR ] AFGE: Validating primary data.
[2025-10-24T17:05:32.971182] [INFO ] [REMOTE    ] AGCO: Fetching primary data for 2025-04.
[2025-10-24T17:05:33.195791] [INFO ] [REMOTE    ] AGD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:05:33.276317] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present.
[2025-10-24T17:05:33.276516] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed.
[2025-10-24T17:05:33.276755] [INFO ] [MAIN      ] AFGE: Fetched primary data is valid.
[2025-10-24T17:05:33.276829] [DEBUG] [LOCAL     ] AFGE: Saving primary data.
[2025-10-24T17:05:33.277192] [FATAL] [LOCAL     ] AFGE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:05:33.277285] [FATAL] [MAIN      ] AFGE: Failed to save primary data.
[2025-10-24T17:05:33.277456] [WARN ] [MAIN      ] AFGE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:05:33.277562] [INFO ] [LOCAL     ] AFGE: Starting deletion of primary data.
[2025-10-24T17:05:33.277773] [DEBUG] [LOCAL     ] AFGE: No primary data file found to delete.
[2025-10-24T17:05:33.277855] [INFO ] [LOCAL     ] AFGE: Starting deletion of derivative data.
[2025-10-24T17:05:33.278164] [DEBUG] [LOCAL     ] AFGE: Deleted derivative data file.
[2025-10-24T17:05:33.278261] [INFO ] [MAIN      ] Update Progress: 50/2366 symbols completed. AFGE took 38.0s. Estimated remaining: 4h 15m 3s. Rate: 9.1 symbols/min
[2025-10-24T17:05:33.425604] [INFO ] [REMOTE    ] AG: Incremental fetch complete for 2025-08 (2.08 seconds).
[2025-10-24T17:05:33.496466] [INFO ] [MAIN      ] AGI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:05:33.554689] [DEBUG] [LOCAL     ] AGI: Loaded 53813 existing records from primary storage.
[2025-10-24T17:05:33.555041] [INFO ] [MAIN      ] AGI: Loaded 53813 existing records.
[2025-10-24T17:05:33.760709] [INFO ] [REMOTE    ] AGD: Fetching primary data for 2025-01.
[2025-10-24T17:05:33.768898] [WARN ] [MAIN      ] AGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:05:33.770262] [INFO ] [MAIN      ] AGI: Wiping existing primary data before full refresh.
[2025-10-24T17:05:33.770334] [INFO ] [LOCAL     ] AGI: Starting deletion of primary data.
[2025-10-24T17:05:33.770558] [DEBUG] [LOCAL     ] AGI: Deleted primary data file.
[2025-10-24T17:05:33.770615] [INFO ] [MAIN      ] AGI: Starting full primary refresh.
[2025-10-24T17:05:34.379303] [INFO ] [REMOTE    ] AGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:05:34.461412] [INFO ] [REMOTE    ] AGCO: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T17:05:34.547738] [INFO ] [REMOTE    ] AGI: Fetching primary data for 2025-01.
[2025-10-24T17:05:35.120208] [INFO ] [REMOTE    ] AGD: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T17:05:35.347672] [INFO ] [REMOTE    ] AGD: Fetching primary data for 2025-02.
[2025-10-24T17:05:35.900846] [INFO ] [REMOTE    ] AGD: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T17:05:36.019536] [INFO ] [REMOTE    ] AGI: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T17:05:36.147637] [INFO ] [REMOTE    ] AGCO: Fetching primary data for 2025-05.
[2025-10-24T17:05:36.947830] [INFO ] [REMOTE    ] AGD: Fetching primary data for 2025-03.
[2025-10-24T17:05:37.729408] [INFO ] [REMOTE    ] AGCO: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T17:05:37.747616] [INFO ] [REMOTE    ] AGI: Fetching primary data for 2025-02.
[2025-10-24T17:05:37.760774] [INFO ] [REMOTE    ] AGD: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T17:05:38.547699] [INFO ] [REMOTE    ] AGD: Fetching primary data for 2025-04.
[2025-10-24T17:05:39.276620] [INFO ] [REMOTE    ] AGI: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T17:05:39.347612] [INFO ] [REMOTE    ] AGI: Fetching primary data for 2025-03.
[2025-10-24T17:05:39.459598] [INFO ] [REMOTE    ] AGD: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T17:05:40.147673] [INFO ] [REMOTE    ] AGCO: Fetching primary data for 2025-06.
[2025-10-24T17:05:40.816696] [INFO ] [REMOTE    ] AGI: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T17:05:40.947683] [INFO ] [REMOTE    ] AG: Fetching primary data for 2025-09.
[2025-10-24T17:05:41.271526] [INFO ] [REMOTE    ] AGCO: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T17:05:41.747758] [INFO ] [REMOTE    ] AGI: Fetching primary data for 2025-04.
[2025-10-24T17:05:42.547698] [INFO ] [REMOTE    ] AGCO: Fetching primary data for 2025-07.
[2025-10-24T17:05:43.085606] [INFO ] [REMOTE    ] AG: Incremental fetch complete for 2025-09 (2.14 seconds).
[2025-10-24T17:05:43.286173] [INFO ] [REMOTE    ] AGI: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T17:05:43.347676] [INFO ] [REMOTE    ] AGD: Fetching primary data for 2025-05.
[2025-10-24T17:05:43.901455] [INFO ] [REMOTE    ] AGCO: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T17:05:44.037267] [INFO ] [REMOTE    ] AGD: Incremental fetch complete for 2025-05 (0.69 seconds).
[2025-10-24T17:05:44.147712] [INFO ] [REMOTE    ] AGI: Fetching primary data for 2025-05.
[2025-10-24T17:05:44.947689] [INFO ] [REMOTE    ] AGCO: Fetching primary data for 2025-08.
[2025-10-24T17:05:45.601784] [INFO ] [REMOTE    ] AGI: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T17:05:45.747678] [INFO ] [REMOTE    ] AGI: Fetching primary data for 2025-06.
[2025-10-24T17:05:46.254196] [INFO ] [REMOTE    ] AGCO: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T17:05:46.547680] [INFO ] [REMOTE    ] AGD: Fetching primary data for 2025-06.
[2025-10-24T17:05:47.347694] [INFO ] [REMOTE    ] AGCO: Fetching primary data for 2025-09.
[2025-10-24T17:05:47.666172] [INFO ] [REMOTE    ] AGD: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T17:05:47.834118] [INFO ] [REMOTE    ] AGI: Incremental fetch complete for 2025-06 (2.09 seconds).
[2025-10-24T17:05:48.147769] [INFO ] [REMOTE    ] AGI: Fetching primary data for 2025-07.
[2025-10-24T17:05:48.732375] [INFO ] [REMOTE    ] AGCO: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T17:05:48.947712] [INFO ] [REMOTE    ] AGD: Fetching primary data for 2025-07.
[2025-10-24T17:05:49.747748] [INFO ] [REMOTE    ] AG: Fetching primary data for 2025-10.
[2025-10-24T17:05:49.865875] [INFO ] [REMOTE    ] AGI: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T17:05:50.050026] [INFO ] [REMOTE    ] AGD: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T17:05:50.547711] [INFO ] [REMOTE    ] AGI: Fetching primary data for 2025-08.
[2025-10-24T17:05:51.347748] [INFO ] [REMOTE    ] AGCO: Fetching primary data for 2025-10.
[2025-10-24T17:05:52.147677] [INFO ] [REMOTE    ] AGD: Fetching primary data for 2025-08.
[2025-10-24T17:05:52.185279] [INFO ] [REMOTE    ] AG: Incremental fetch complete for 2025-10 (2.44 seconds).
[2025-10-24T17:05:52.195628] [INFO ] [REMOTE    ] AG: Full fetch complete (77791 records).
[2025-10-24T17:05:52.195804] [DEBUG] [VALIDATOR ] AG: Validating primary data.
[2025-10-24T17:05:52.388978] [INFO ] [REMOTE    ] AGI: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T17:05:52.644891] [DEBUG] [VALIDATOR ] AG: All expected trading days are present.
[2025-10-24T17:05:52.645081] [DEBUG] [VALIDATOR ] AG: Primary data validation passed.
[2025-10-24T17:05:52.645888] [INFO ] [MAIN      ] AG: Fetched primary data is valid.
[2025-10-24T17:05:52.646032] [DEBUG] [LOCAL     ] AG: Saving primary data.
[2025-10-24T17:05:52.646747] [FATAL] [LOCAL     ] AG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:05:52.646907] [FATAL] [MAIN      ] AG: Failed to save primary data.
[2025-10-24T17:05:52.664804] [WARN ] [MAIN      ] AG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:05:52.664967] [INFO ] [LOCAL     ] AG: Starting deletion of primary data.
[2025-10-24T17:05:52.665483] [DEBUG] [LOCAL     ] AG: No primary data file found to delete.
[2025-10-24T17:05:52.665571] [INFO ] [LOCAL     ] AG: Starting deletion of derivative data.
[2025-10-24T17:05:52.666215] [INFO ] [REMOTE    ] AGCO: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T17:05:52.673591] [DEBUG] [LOCAL     ] AG: Deleted derivative data file.
[2025-10-24T17:05:52.674260] [INFO ] [MAIN      ] Update Progress: 51/2366 symbols completed. AG took 48.6s. Estimated remaining: 4h 24m 37s. Rate: 8.7 symbols/min
[2025-10-24T17:05:52.674394] [INFO ] [REMOTE    ] AGCO: Full fetch complete (61551 records).
[2025-10-24T17:05:52.705996] [DEBUG] [VALIDATOR ] AGCO: Validating primary data.
[2025-10-24T17:05:52.948023] [INFO ] [REMOTE    ] AGI: Fetching primary data for 2025-09.
[2025-10-24T17:05:52.957439] [INFO ] [MAIN      ] AGL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:05:53.165617] [INFO ] [REMOTE    ] AGD: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T17:05:53.277557] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present.
[2025-10-24T17:05:53.277666] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed.
[2025-10-24T17:05:53.278297] [INFO ] [MAIN      ] AGCO: Fetched primary data is valid.
[2025-10-24T17:05:53.278343] [DEBUG] [LOCAL     ] AGCO: Saving primary data.
[2025-10-24T17:05:53.278896] [FATAL] [LOCAL     ] AGCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:05:53.278988] [FATAL] [MAIN      ] AGCO: Failed to save primary data.
[2025-10-24T17:05:53.279030] [WARN ] [MAIN      ] AGCO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:05:53.279097] [INFO ] [LOCAL     ] AGCO: Starting deletion of primary data.
[2025-10-24T17:05:53.279159] [DEBUG] [LOCAL     ] AGCO: No primary data file found to delete.
[2025-10-24T17:05:53.279198] [INFO ] [LOCAL     ] AGCO: Starting deletion of derivative data.
[2025-10-24T17:05:53.279378] [DEBUG] [LOCAL     ] AGCO: Deleted derivative data file.
[2025-10-24T17:05:53.279756] [INFO ] [MAIN      ] Update Progress: 52/2366 symbols completed. AGCO took 30.6s. Estimated remaining: 4h 19m 52s. Rate: 8.9 symbols/min
[2025-10-24T17:05:53.413621] [DEBUG] [LOCAL     ] AGL: Loaded 52979 existing records from primary storage.
[2025-10-24T17:05:53.434606] [INFO ] [MAIN      ] AGL: Loaded 52979 existing records.
[2025-10-24T17:05:53.531552] [INFO ] [MAIN      ] AGM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:05:53.685254] [DEBUG] [LOCAL     ] AGM: Loaded 10659 existing records from primary storage.
[2025-10-24T17:05:53.717420] [INFO ] [MAIN      ] AGM: Loaded 10659 existing records.
[2025-10-24T17:05:53.741706] [WARN ] [MAIN      ] AGL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:05:53.753075] [INFO ] [REMOTE    ] AGD: Fetching primary data for 2025-09.
[2025-10-24T17:05:53.778460] [INFO ] [MAIN      ] AGL: Wiping existing primary data before full refresh.
[2025-10-24T17:05:53.817712] [INFO ] [LOCAL     ] AGL: Starting deletion of primary data.
[2025-10-24T17:05:53.844086] [DEBUG] [LOCAL     ] AGL: Deleted primary data file.
[2025-10-24T17:05:53.847247] [INFO ] [MAIN      ] AGL: Starting full primary refresh.
[2025-10-24T17:05:54.041007] [WARN ] [MAIN      ] AGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:05:54.043538] [INFO ] [MAIN      ] AGM: Wiping existing primary data before full refresh.
[2025-10-24T17:05:54.043674] [INFO ] [LOCAL     ] AGM: Starting deletion of primary data.
[2025-10-24T17:05:54.043998] [DEBUG] [LOCAL     ] AGM: Deleted primary data file.
[2025-10-24T17:05:54.049375] [INFO ] [MAIN      ] AGM: Starting full primary refresh.
[2025-10-24T17:05:54.578438] [INFO ] [REMOTE    ] AGL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:05:54.608137] [INFO ] [REMOTE    ] AGL: Fetching primary data for 2025-01.
[2025-10-24T17:05:54.687776] [INFO ] [REMOTE    ] AGM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:05:54.768710] [INFO ] [REMOTE    ] AGD: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T17:05:54.818103] [INFO ] [REMOTE    ] AGI: Incremental fetch complete for 2025-09 (1.87 seconds).
[2025-10-24T17:05:55.347740] [INFO ] [REMOTE    ] AGM: Fetching primary data for 2025-01.
[2025-10-24T17:05:56.116778] [INFO ] [REMOTE    ] AGM: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T17:05:56.147612] [INFO ] [REMOTE    ] AGM: Fetching primary data for 2025-02.
[2025-10-24T17:05:56.186779] [INFO ] [REMOTE    ] AGL: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T17:05:56.777459] [INFO ] [REMOTE    ] AGM: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T17:05:56.947670] [INFO ] [REMOTE    ] AGD: Fetching primary data for 2025-10.
[2025-10-24T17:05:57.747769] [INFO ] [REMOTE    ] AGM: Fetching primary data for 2025-03.
[2025-10-24T17:05:58.224025] [INFO ] [REMOTE    ] AGD: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T17:05:58.228566] [INFO ] [REMOTE    ] AGD: Full fetch complete (26546 records).
[2025-10-24T17:05:58.228682] [DEBUG] [VALIDATOR ] AGD: Validating primary data.
[2025-10-24T17:05:58.486422] [INFO ] [REMOTE    ] AGM: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T17:05:58.560084] [INFO ] [REMOTE    ] AGL: Fetching primary data for 2025-02.
[2025-10-24T17:05:58.605312] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present.
[2025-10-24T17:05:58.605437] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed.
[2025-10-24T17:05:58.605826] [INFO ] [MAIN      ] AGD: Fetched primary data is valid.
[2025-10-24T17:05:58.605887] [DEBUG] [LOCAL     ] AGD: Saving primary data.
[2025-10-24T17:05:58.606186] [FATAL] [LOCAL     ] AGD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:05:58.606264] [FATAL] [MAIN      ] AGD: Failed to save primary data.
[2025-10-24T17:05:58.606330] [WARN ] [MAIN      ] AGD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:05:58.606398] [INFO ] [LOCAL     ] AGD: Starting deletion of primary data.
[2025-10-24T17:05:58.606456] [DEBUG] [LOCAL     ] AGD: No primary data file found to delete.
[2025-10-24T17:05:58.606492] [INFO ] [LOCAL     ] AGD: Starting deletion of derivative data.
[2025-10-24T17:05:58.606663] [DEBUG] [LOCAL     ] AGD: Deleted derivative data file.
[2025-10-24T17:05:58.606767] [INFO ] [MAIN      ] Update Progress: 53/2366 symbols completed. AGD took 26.4s. Estimated remaining: 4h 18m 44s. Rate: 8.9 symbols/min
[2025-10-24T17:05:58.776897] [INFO ] [MAIN      ] AGO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:05:58.804332] [DEBUG] [LOCAL     ] AGO: Loaded 27888 existing records from primary storage.
[2025-10-24T17:05:58.804583] [INFO ] [MAIN      ] AGO: Loaded 27888 existing records.
[2025-10-24T17:05:58.979747] [WARN ] [MAIN      ] AGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:05:58.979942] [INFO ] [MAIN      ] AGO: Wiping existing primary data before full refresh.
[2025-10-24T17:05:58.979997] [INFO ] [LOCAL     ] AGO: Starting deletion of primary data.
[2025-10-24T17:05:58.980171] [DEBUG] [LOCAL     ] AGO: Deleted primary data file.
[2025-10-24T17:05:58.980212] [INFO ] [MAIN      ] AGO: Starting full primary refresh.
[2025-10-24T17:05:59.330637] [INFO ] [REMOTE    ] AGO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:05:59.347617] [INFO ] [REMOTE    ] AGO: Fetching primary data for 2025-01.
[2025-10-24T17:05:59.932935] [INFO ] [REMOTE    ] AGL: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T17:06:00.147634] [INFO ] [REMOTE    ] AGI: Fetching primary data for 2025-10.
[2025-10-24T17:06:00.947785] [INFO ] [REMOTE    ] AGM: Fetching primary data for 2025-04.
[2025-10-24T17:06:01.354995] [INFO ] [REMOTE    ] AGO: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T17:06:01.747743] [INFO ] [REMOTE    ] AGL: Fetching primary data for 2025-03.
[2025-10-24T17:06:02.547741] [INFO ] [REMOTE    ] AGO: Fetching primary data for 2025-02.
[2025-10-24T17:06:02.717860] [INFO ] [REMOTE    ] AGM: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T17:06:03.011408] [INFO ] [REMOTE    ] AGI: Incremental fetch complete for 2025-10 (2.86 seconds).
[2025-10-24T17:06:03.021375] [INFO ] [REMOTE    ] AGI: Full fetch complete (77349 records).
[2025-10-24T17:06:03.021511] [DEBUG] [VALIDATOR ] AGI: Validating primary data.
[2025-10-24T17:06:03.357916] [INFO ] [REMOTE    ] AGM: Fetching primary data for 2025-05.
[2025-10-24T17:06:03.417113] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present.
[2025-10-24T17:06:03.417192] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed.
[2025-10-24T17:06:03.418244] [INFO ] [MAIN      ] AGI: Fetched primary data is valid.
[2025-10-24T17:06:03.418311] [DEBUG] [LOCAL     ] AGI: Saving primary data.
[2025-10-24T17:06:03.418944] [FATAL] [LOCAL     ] AGI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:06:03.419029] [FATAL] [MAIN      ] AGI: Failed to save primary data.
[2025-10-24T17:06:03.419096] [WARN ] [MAIN      ] AGI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:06:03.419175] [INFO ] [LOCAL     ] AGI: Starting deletion of primary data.
[2025-10-24T17:06:03.419265] [DEBUG] [LOCAL     ] AGI: No primary data file found to delete.
[2025-10-24T17:06:03.419311] [INFO ] [LOCAL     ] AGI: Starting deletion of derivative data.
[2025-10-24T17:06:03.419469] [DEBUG] [LOCAL     ] AGI: Deleted derivative data file.
[2025-10-24T17:06:03.419852] [INFO ] [MAIN      ] Update Progress: 54/2366 symbols completed. AGI took 30.1s. Estimated remaining: 4h 17m 16s. Rate: 9.0 symbols/min
[2025-10-24T17:06:03.595101] [INFO ] [MAIN      ] AGRO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:06:03.626837] [DEBUG] [LOCAL     ] AGRO: Loaded 32732 existing records from primary storage.
[2025-10-24T17:06:03.627100] [INFO ] [MAIN      ] AGRO: Loaded 32732 existing records.
[2025-10-24T17:06:03.802552] [WARN ] [MAIN      ] AGRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:06:03.802834] [INFO ] [MAIN      ] AGRO: Wiping existing primary data before full refresh.
[2025-10-24T17:06:03.802903] [INFO ] [LOCAL     ] AGRO: Starting deletion of primary data.
[2025-10-24T17:06:03.803758] [DEBUG] [LOCAL     ] AGRO: Deleted primary data file.
[2025-10-24T17:06:03.803818] [INFO ] [MAIN      ] AGRO: Starting full primary refresh.
[2025-10-24T17:06:04.165812] [INFO ] [REMOTE    ] AGRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:06:04.166108] [INFO ] [REMOTE    ] AGRO: Fetching primary data for 2025-01.
[2025-10-24T17:06:04.194695] [INFO ] [REMOTE    ] AGM: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T17:06:04.647692] [INFO ] [REMOTE    ] AGO: Incremental fetch complete for 2025-02 (2.10 seconds).
[2025-10-24T17:06:04.915127] [INFO ] [REMOTE    ] AGL: Incremental fetch complete for 2025-03 (3.17 seconds).
[2025-10-24T17:06:04.947602] [INFO ] [REMOTE    ] AGL: Fetching primary data for 2025-04.
[2025-10-24T17:06:05.747748] [INFO ] [REMOTE    ] AGO: Fetching primary data for 2025-03.
[2025-10-24T17:06:06.547699] [INFO ] [REMOTE    ] AGM: Fetching primary data for 2025-06.
[2025-10-24T17:06:06.908411] [INFO ] [REMOTE    ] AGL: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T17:06:06.971908] [INFO ] [REMOTE    ] AGO: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T17:06:07.347744] [INFO ] [REMOTE    ] AGL: Fetching primary data for 2025-05.
[2025-10-24T17:06:07.563369] [INFO ] [REMOTE    ] AGRO: Incremental fetch complete for 2025-01 (3.40 seconds).
[2025-10-24T17:06:07.814327] [INFO ] [REMOTE    ] AGM: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T17:06:08.147685] [INFO ] [REMOTE    ] AGM: Fetching primary data for 2025-07.
[2025-10-24T17:06:08.894614] [INFO ] [REMOTE    ] AGL: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T17:06:08.947744] [INFO ] [REMOTE    ] AGL: Fetching primary data for 2025-06.
[2025-10-24T17:06:08.995744] [INFO ] [REMOTE    ] AGM: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T17:06:09.747692] [INFO ] [REMOTE    ] AGM: Fetching primary data for 2025-08.
[2025-10-24T17:06:10.166157] [INFO ] [REMOTE    ] AGL: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T17:06:10.446161] [INFO ] [REMOTE    ] AGM: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T17:06:10.547671] [INFO ] [REMOTE    ] AGL: Fetching primary data for 2025-07.
[2025-10-24T17:06:11.347675] [INFO ] [REMOTE    ] AGO: Fetching primary data for 2025-04.
[2025-10-24T17:06:12.036238] [INFO ] [REMOTE    ] AGL: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T17:06:12.147673] [INFO ] [REMOTE    ] AGL: Fetching primary data for 2025-08.
[2025-10-24T17:06:12.834707] [INFO ] [REMOTE    ] AGO: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T17:06:12.947667] [INFO ] [REMOTE    ] AGM: Fetching primary data for 2025-09.
[2025-10-24T17:06:13.566748] [INFO ] [REMOTE    ] AGM: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T17:06:13.693990] [INFO ] [REMOTE    ] AGL: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T17:06:13.747617] [INFO ] [REMOTE    ] AGM: Fetching primary data for 2025-10.
[2025-10-24T17:06:14.547616] [INFO ] [REMOTE    ] AGRO: Fetching primary data for 2025-02.
[2025-10-24T17:06:14.688584] [INFO ] [REMOTE    ] AGM: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T17:06:14.691344] [INFO ] [REMOTE    ] AGM: Full fetch complete (13318 records).
[2025-10-24T17:06:14.691442] [DEBUG] [VALIDATOR ] AGM: Validating primary data.
[2025-10-24T17:06:15.103518] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present.
[2025-10-24T17:06:15.103615] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed.
[2025-10-24T17:06:15.103935] [INFO ] [MAIN      ] AGM: Fetched primary data is valid.
[2025-10-24T17:06:15.103988] [DEBUG] [LOCAL     ] AGM: Saving primary data.
[2025-10-24T17:06:15.104212] [FATAL] [LOCAL     ] AGM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:06:15.104293] [FATAL] [MAIN      ] AGM: Failed to save primary data.
[2025-10-24T17:06:15.104335] [WARN ] [MAIN      ] AGM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:06:15.104407] [INFO ] [LOCAL     ] AGM: Starting deletion of primary data.
[2025-10-24T17:06:15.104483] [DEBUG] [LOCAL     ] AGM: No primary data file found to delete.
[2025-10-24T17:06:15.104522] [INFO ] [LOCAL     ] AGM: Starting deletion of derivative data.
[2025-10-24T17:06:15.104712] [DEBUG] [LOCAL     ] AGM: Deleted derivative data file.
[2025-10-24T17:06:15.104809] [INFO ] [MAIN      ] Update Progress: 55/2366 symbols completed. AGM took 21.8s. Estimated remaining: 4h 20m 39s. Rate: 8.9 symbols/min
[2025-10-24T17:06:15.299923] [INFO ] [MAIN      ] AGX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:06:15.336724] [DEBUG] [LOCAL     ] AGX: Loaded 32812 existing records from primary storage.
[2025-10-24T17:06:15.336997] [INFO ] [MAIN      ] AGX: Loaded 32812 existing records.
[2025-10-24T17:06:15.352885] [INFO ] [REMOTE    ] AGO: Fetching primary data for 2025-05.
[2025-10-24T17:06:15.545027] [WARN ] [MAIN      ] AGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:06:15.545242] [INFO ] [MAIN      ] AGX: Wiping existing primary data before full refresh.
[2025-10-24T17:06:15.545293] [INFO ] [LOCAL     ] AGX: Starting deletion of primary data.
[2025-10-24T17:06:15.545925] [DEBUG] [LOCAL     ] AGX: Deleted primary data file.
[2025-10-24T17:06:15.545987] [INFO ] [MAIN      ] AGX: Starting full primary refresh.
[2025-10-24T17:06:15.953772] [INFO ] [REMOTE    ] AGX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:06:15.972504] [INFO ] [REMOTE    ] AGRO: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T17:06:16.147669] [INFO ] [REMOTE    ] AGX: Fetching primary data for 2025-01.
[2025-10-24T17:06:16.407769] [INFO ] [REMOTE    ] AGO: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T17:06:16.947681] [INFO ] [REMOTE    ] AGRO: Fetching primary data for 2025-03.
[2025-10-24T17:06:17.747621] [INFO ] [REMOTE    ] AGL: Fetching primary data for 2025-09.
[2025-10-24T17:06:17.933245] [INFO ] [REMOTE    ] AGX: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T17:06:18.553203] [INFO ] [REMOTE    ] AGO: Fetching primary data for 2025-06.
[2025-10-24T17:06:18.557825] [INFO ] [REMOTE    ] AGRO: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T17:06:19.347632] [INFO ] [REMOTE    ] AGRO: Fetching primary data for 2025-04.
[2025-10-24T17:06:19.516592] [INFO ] [REMOTE    ] AGL: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T17:06:19.575159] [INFO ] [REMOTE    ] AGO: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T17:06:20.147683] [INFO ] [REMOTE    ] AGO: Fetching primary data for 2025-07.
[2025-10-24T17:06:20.712271] [INFO ] [REMOTE    ] AGRO: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T17:06:20.947714] [INFO ] [REMOTE    ] AGX: Fetching primary data for 2025-02.
[2025-10-24T17:06:21.515721] [INFO ] [REMOTE    ] AGO: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T17:06:21.747737] [INFO ] [REMOTE    ] AGO: Fetching primary data for 2025-08.
[2025-10-24T17:06:22.352825] [INFO ] [REMOTE    ] AGX: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T17:06:22.547845] [INFO ] [REMOTE    ] AGX: Fetching primary data for 2025-03.
[2025-10-24T17:06:22.932461] [INFO ] [REMOTE    ] AGO: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T17:06:23.347721] [INFO ] [REMOTE    ] AGO: Fetching primary data for 2025-09.
[2025-10-24T17:06:24.052698] [INFO ] [REMOTE    ] AGX: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T17:06:24.147611] [INFO ] [REMOTE    ] AGX: Fetching primary data for 2025-04.
[2025-10-24T17:06:24.286331] [INFO ] [REMOTE    ] AGO: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T17:06:24.947678] [INFO ] [REMOTE    ] AGL: Fetching primary data for 2025-10.
[2025-10-24T17:06:25.640933] [INFO ] [REMOTE    ] AGX: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T17:06:25.747695] [INFO ] [REMOTE    ] AGRO: Fetching primary data for 2025-05.
[2025-10-24T17:06:26.547714] [INFO ] [REMOTE    ] AGO: Fetching primary data for 2025-10.
[2025-10-24T17:06:26.775186] [INFO ] [REMOTE    ] AGRO: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T17:06:26.892728] [INFO ] [REMOTE    ] AGL: Incremental fetch complete for 2025-10 (1.95 seconds).
[2025-10-24T17:06:26.902912] [INFO ] [REMOTE    ] AGL: Full fetch complete (75594 records).
[2025-10-24T17:06:26.903130] [DEBUG] [VALIDATOR ] AGL: Validating primary data.
[2025-10-24T17:06:26.904852] [FATAL] [VALIDATOR ] AGL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:06:26.904951] [FATAL] [MAIN      ] AGL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:06:26.904997] [WARN ] [MAIN      ] AGL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:06:26.905044] [INFO ] [LOCAL     ] AGL: Starting deletion of primary data.
[2025-10-24T17:06:26.905110] [DEBUG] [LOCAL     ] AGL: No primary data file found to delete.
[2025-10-24T17:06:26.905148] [INFO ] [LOCAL     ] AGL: Starting deletion of derivative data.
[2025-10-24T17:06:26.905403] [DEBUG] [LOCAL     ] AGL: Deleted derivative data file.
[2025-10-24T17:06:26.905911] [INFO ] [MAIN      ] Update Progress: 56/2366 symbols completed. AGL took 34.2s. Estimated remaining: 4h 24m 0s. Rate: 8.7 symbols/min
[2025-10-24T17:06:27.086254] [INFO ] [MAIN      ] AHH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:06:27.131571] [DEBUG] [LOCAL     ] AHH: Loaded 40406 existing records from primary storage.
[2025-10-24T17:06:27.132006] [INFO ] [MAIN      ] AHH: Loaded 40406 existing records.
[2025-10-24T17:06:27.320415] [WARN ] [MAIN      ] AHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:06:27.321140] [INFO ] [MAIN      ] AHH: Wiping existing primary data before full refresh.
[2025-10-24T17:06:27.321263] [INFO ] [LOCAL     ] AHH: Starting deletion of primary data.
[2025-10-24T17:06:27.321699] [DEBUG] [LOCAL     ] AHH: Deleted primary data file.
[2025-10-24T17:06:27.321788] [INFO ] [MAIN      ] AHH: Starting full primary refresh.
[2025-10-24T17:06:27.356307] [INFO ] [REMOTE    ] AGRO: Fetching primary data for 2025-06.
[2025-10-24T17:06:27.696506] [INFO ] [REMOTE    ] AHH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:06:27.849753] [INFO ] [REMOTE    ] AGO: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T17:06:27.855635] [INFO ] [REMOTE    ] AGO: Full fetch complete (39697 records).
[2025-10-24T17:06:27.855802] [DEBUG] [VALIDATOR ] AGO: Validating primary data.
[2025-10-24T17:06:28.151384] [INFO ] [REMOTE    ] AHH: Fetching primary data for 2025-01.
[2025-10-24T17:06:28.242488] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present.
[2025-10-24T17:06:28.242584] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed.
[2025-10-24T17:06:28.243090] [INFO ] [MAIN      ] AGO: Fetched primary data is valid.
[2025-10-24T17:06:28.243191] [DEBUG] [LOCAL     ] AGO: Saving primary data.
[2025-10-24T17:06:28.243602] [FATAL] [LOCAL     ] AGO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:06:28.243704] [FATAL] [MAIN      ] AGO: Failed to save primary data.
[2025-10-24T17:06:28.243773] [WARN ] [MAIN      ] AGO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:06:28.243848] [INFO ] [LOCAL     ] AGO: Starting deletion of primary data.
[2025-10-24T17:06:28.243912] [DEBUG] [LOCAL     ] AGO: No primary data file found to delete.
[2025-10-24T17:06:28.243948] [INFO ] [LOCAL     ] AGO: Starting deletion of derivative data.
[2025-10-24T17:06:28.244103] [DEBUG] [LOCAL     ] AGO: Deleted derivative data file.
[2025-10-24T17:06:28.244201] [INFO ] [MAIN      ] Update Progress: 57/2366 symbols completed. AGO took 29.6s. Estimated remaining: 4h 20m 10s. Rate: 8.9 symbols/min
[2025-10-24T17:06:28.420904] [INFO ] [MAIN      ] AHL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:06:28.421134] [DEBUG] [LOCAL     ] AHL: No existing data file found in primary storage.
[2025-10-24T17:06:28.421190] [WARN ] [MAIN      ] AHL: No existing data found, performing full refresh instead.
[2025-10-24T17:06:28.421320] [INFO ] [MAIN      ] AHL: Wiping existing primary data before full refresh.
[2025-10-24T17:06:28.421364] [INFO ] [LOCAL     ] AHL: Starting deletion of primary data.
[2025-10-24T17:06:28.421406] [DEBUG] [LOCAL     ] AHL: No primary data file found to delete.
[2025-10-24T17:06:28.421437] [INFO ] [MAIN      ] AHL: Starting full primary refresh.
[2025-10-24T17:06:28.803017] [INFO ] [REMOTE    ] AGRO: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T17:06:28.808602] [INFO ] [REMOTE    ] AHL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:06:28.947623] [INFO ] [REMOTE    ] AHL: Fetching primary data for 2025-01.
[2025-10-24T17:06:29.210897] [DEBUG] [REMOTE    ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:06:29.211198] [WARN ] [REMOTE    ] AHL: No data returned for month 2025-01
[2025-10-24T17:06:29.211297] [FATAL] [REMOTE    ] AHL: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:06:29.211389] [FATAL] [MAIN      ] AHL: Failed to fetch primary data.
[2025-10-24T17:06:29.211496] [WARN ] [MAIN      ] AHL: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:06:29.211588] [INFO ] [LOCAL     ] AHL: Starting deletion of primary data.
[2025-10-24T17:06:29.211706] [DEBUG] [LOCAL     ] AHL: No primary data file found to delete.
[2025-10-24T17:06:29.211765] [INFO ] [LOCAL     ] AHL: Starting deletion of derivative data.
[2025-10-24T17:06:29.211810] [DEBUG] [LOCAL     ] AHL: No derivative data file found to delete.
[2025-10-24T17:06:29.211856] [INFO ] [MAIN      ] Update Progress: 58/2366 symbols completed. AHL took 1.0s. Estimated remaining: 4h 16m 13s. Rate: 9.0 symbols/min
[2025-10-24T17:06:29.389815] [INFO ] [MAIN      ] AHR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:06:29.444220] [DEBUG] [LOCAL     ] AHR: Loaded 49276 existing records from primary storage.
[2025-10-24T17:06:29.444621] [INFO ] [MAIN      ] AHR: Loaded 49276 existing records.
[2025-10-24T17:06:29.646818] [WARN ] [MAIN      ] AHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:06:29.647128] [INFO ] [MAIN      ] AHR: Wiping existing primary data before full refresh.
[2025-10-24T17:06:29.647307] [INFO ] [LOCAL     ] AHR: Starting deletion of primary data.
[2025-10-24T17:06:29.648186] [DEBUG] [LOCAL     ] AHR: Deleted primary data file.
[2025-10-24T17:06:29.648244] [INFO ] [MAIN      ] AHR: Starting full primary refresh.
[2025-10-24T17:06:29.748636] [INFO ] [REMOTE    ] AGRO: Fetching primary data for 2025-07.
[2025-10-24T17:06:30.026631] [INFO ] [REMOTE    ] AHH: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T17:06:30.070907] [INFO ] [REMOTE    ] AHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:06:30.547684] [INFO ] [REMOTE    ] AHR: Fetching primary data for 2025-01.
[2025-10-24T17:06:31.045668] [INFO ] [REMOTE    ] AGRO: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T17:06:31.347717] [INFO ] [REMOTE    ] AHH: Fetching primary data for 2025-02.
[2025-10-24T17:06:31.692627] [INFO ] [REMOTE    ] AHR: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T17:06:32.147634] [INFO ] [REMOTE    ] AGRO: Fetching primary data for 2025-08.
[2025-10-24T17:06:32.367399] [INFO ] [REMOTE    ] AHH: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T17:06:32.947673] [INFO ] [REMOTE    ] AHH: Fetching primary data for 2025-03.
[2025-10-24T17:06:33.333147] [INFO ] [REMOTE    ] AGRO: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T17:06:33.747702] [INFO ] [REMOTE    ] AHR: Fetching primary data for 2025-02.
[2025-10-24T17:06:34.553093] [INFO ] [REMOTE    ] AGX: Fetching primary data for 2025-05.
[2025-10-24T17:06:34.570284] [INFO ] [REMOTE    ] AHH: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T17:06:34.744592] [INFO ] [REMOTE    ] AHR: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T17:06:35.347753] [INFO ] [REMOTE    ] AHH: Fetching primary data for 2025-04.
[2025-10-24T17:06:35.831629] [INFO ] [REMOTE    ] AGX: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T17:06:36.147679] [INFO ] [REMOTE    ] AGX: Fetching primary data for 2025-06.
[2025-10-24T17:06:36.492007] [INFO ] [REMOTE    ] AHH: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T17:06:36.947723] [INFO ] [REMOTE    ] AHH: Fetching primary data for 2025-05.
[2025-10-24T17:06:37.610022] [INFO ] [REMOTE    ] AGX: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T17:06:37.747666] [INFO ] [REMOTE    ] AGX: Fetching primary data for 2025-07.
[2025-10-24T17:06:38.354548] [INFO ] [REMOTE    ] AHH: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T17:06:38.547734] [INFO ] [REMOTE    ] AHR: Fetching primary data for 2025-03.
[2025-10-24T17:06:39.301083] [INFO ] [REMOTE    ] AGX: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T17:06:39.347680] [INFO ] [REMOTE    ] AHH: Fetching primary data for 2025-06.
[2025-10-24T17:06:39.696451] [INFO ] [REMOTE    ] AHR: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T17:06:40.147628] [INFO ] [REMOTE    ] AGX: Fetching primary data for 2025-08.
[2025-10-24T17:06:40.680692] [INFO ] [REMOTE    ] AHH: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T17:06:40.947746] [INFO ] [REMOTE    ] AGRO: Fetching primary data for 2025-09.
[2025-10-24T17:06:41.381959] [INFO ] [REMOTE    ] AGX: Incremental fetch complete for 2025-08 (1.23 seconds).
[2025-10-24T17:06:41.747670] [INFO ] [REMOTE    ] AGX: Fetching primary data for 2025-09.
[2025-10-24T17:06:42.402822] [INFO ] [REMOTE    ] AGRO: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T17:06:42.547761] [INFO ] [REMOTE    ] AHH: Fetching primary data for 2025-07.
[2025-10-24T17:06:42.938593] [INFO ] [REMOTE    ] AGX: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T17:06:43.347724] [INFO ] [REMOTE    ] AGRO: Fetching primary data for 2025-10.
[2025-10-24T17:06:43.581390] [INFO ] [REMOTE    ] AHH: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T17:06:44.147631] [INFO ] [REMOTE    ] AHH: Fetching primary data for 2025-08.
[2025-10-24T17:06:44.683414] [INFO ] [REMOTE    ] AGRO: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T17:06:44.689620] [INFO ] [REMOTE    ] AGRO: Full fetch complete (48705 records).
[2025-10-24T17:06:44.689740] [DEBUG] [VALIDATOR ] AGRO: Validating primary data.
[2025-10-24T17:06:44.952813] [INFO ] [REMOTE    ] AHR: Fetching primary data for 2025-04.
[2025-10-24T17:06:45.067069] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present.
[2025-10-24T17:06:45.067162] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed.
[2025-10-24T17:06:45.067788] [INFO ] [MAIN      ] AGRO: Fetched primary data is valid.
[2025-10-24T17:06:45.067893] [DEBUG] [LOCAL     ] AGRO: Saving primary data.
[2025-10-24T17:06:45.068409] [FATAL] [LOCAL     ] AGRO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:06:45.068490] [FATAL] [MAIN      ] AGRO: Failed to save primary data.
[2025-10-24T17:06:45.068556] [WARN ] [MAIN      ] AGRO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:06:45.068626] [INFO ] [LOCAL     ] AGRO: Starting deletion of primary data.
[2025-10-24T17:06:45.068723] [DEBUG] [LOCAL     ] AGRO: No primary data file found to delete.
[2025-10-24T17:06:45.068767] [INFO ] [LOCAL     ] AGRO: Starting deletion of derivative data.
[2025-10-24T17:06:45.068932] [DEBUG] [LOCAL     ] AGRO: Deleted derivative data file.
[2025-10-24T17:06:45.069304] [INFO ] [MAIN      ] Update Progress: 59/2366 symbols completed. AGRO took 41.6s. Estimated remaining: 4h 22m 6s. Rate: 8.8 symbols/min
[2025-10-24T17:06:45.240263] [INFO ] [MAIN      ] AHT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:06:45.263464] [INFO ] [REMOTE    ] AHH: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T17:06:45.274932] [DEBUG] [LOCAL     ] AHT: Loaded 6449 existing records from primary storage.
[2025-10-24T17:06:45.275412] [INFO ] [MAIN      ] AHT: Loaded 6449 existing records.
[2025-10-24T17:06:45.448149] [WARN ] [MAIN      ] AHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:06:45.448330] [INFO ] [MAIN      ] AHT: Wiping existing primary data before full refresh.
[2025-10-24T17:06:45.448380] [INFO ] [LOCAL     ] AHT: Starting deletion of primary data.
[2025-10-24T17:06:45.448614] [DEBUG] [LOCAL     ] AHT: Deleted primary data file.
[2025-10-24T17:06:45.448711] [INFO ] [MAIN      ] AHT: Starting full primary refresh.
[2025-10-24T17:06:45.752843] [INFO ] [REMOTE    ] AGX: Fetching primary data for 2025-10.
[2025-10-24T17:06:45.802358] [INFO ] [REMOTE    ] AHT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:06:46.184326] [INFO ] [REMOTE    ] AHR: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T17:06:46.547742] [INFO ] [REMOTE    ] AHT: Fetching primary data for 2025-01.
[2025-10-24T17:06:47.328349] [INFO ] [REMOTE    ] AHT: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T17:06:47.347605] [INFO ] [REMOTE    ] AHR: Fetching primary data for 2025-05.
[2025-10-24T17:06:47.406674] [INFO ] [REMOTE    ] AGX: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T17:06:47.412459] [INFO ] [REMOTE    ] AGX: Full fetch complete (48852 records).
[2025-10-24T17:06:47.412552] [DEBUG] [VALIDATOR ] AGX: Validating primary data.
[2025-10-24T17:06:47.787998] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present.
[2025-10-24T17:06:47.788074] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed.
[2025-10-24T17:06:47.788587] [INFO ] [MAIN      ] AGX: Fetched primary data is valid.
[2025-10-24T17:06:47.788636] [DEBUG] [LOCAL     ] AGX: Saving primary data.
[2025-10-24T17:06:47.789108] [FATAL] [LOCAL     ] AGX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:06:47.789196] [FATAL] [MAIN      ] AGX: Failed to save primary data.
[2025-10-24T17:06:47.789238] [WARN ] [MAIN      ] AGX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:06:47.789274] [INFO ] [LOCAL     ] AGX: Starting deletion of primary data.
[2025-10-24T17:06:47.789326] [DEBUG] [LOCAL     ] AGX: No primary data file found to delete.
[2025-10-24T17:06:47.789361] [INFO ] [LOCAL     ] AGX: Starting deletion of derivative data.
[2025-10-24T17:06:47.789604] [DEBUG] [LOCAL     ] AGX: Deleted derivative data file.
[2025-10-24T17:06:47.790054] [INFO ] [MAIN      ] Update Progress: 60/2366 symbols completed. AGX took 32.7s. Estimated remaining: 4h 19m 21s. Rate: 8.9 symbols/min
[2025-10-24T17:06:47.963383] [INFO ] [MAIN      ] AI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:06:48.017807] [DEBUG] [LOCAL     ] AI: Loaded 54154 existing records from primary storage.
[2025-10-24T17:06:48.018136] [INFO ] [MAIN      ] AI: Loaded 54154 existing records.
[2025-10-24T17:06:48.160226] [INFO ] [REMOTE    ] AHT: Fetching primary data for 2025-02.
[2025-10-24T17:06:48.200232] [WARN ] [MAIN      ] AI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:06:48.200573] [INFO ] [MAIN      ] AI: Wiping existing primary data before full refresh.
[2025-10-24T17:06:48.200639] [INFO ] [LOCAL     ] AI: Starting deletion of primary data.
[2025-10-24T17:06:48.200948] [DEBUG] [LOCAL     ] AI: Deleted primary data file.
[2025-10-24T17:06:48.201008] [INFO ] [MAIN      ] AI: Starting full primary refresh.
[2025-10-24T17:06:48.557111] [INFO ] [REMOTE    ] AI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:06:48.749705] [INFO ] [REMOTE    ] AHT: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T17:06:48.877375] [INFO ] [REMOTE    ] AHR: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T17:06:48.947707] [INFO ] [REMOTE    ] AHH: Fetching primary data for 2025-09.
[2025-10-24T17:06:49.747681] [INFO ] [REMOTE    ] AHR: Fetching primary data for 2025-06.
[2025-10-24T17:06:50.245324] [INFO ] [REMOTE    ] AHH: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T17:06:50.547678] [INFO ] [REMOTE    ] AHH: Fetching primary data for 2025-10.
[2025-10-24T17:06:51.104512] [INFO ] [REMOTE    ] AHR: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T17:06:51.347740] [INFO ] [REMOTE    ] AI: Fetching primary data for 2025-01.
[2025-10-24T17:06:51.899783] [INFO ] [REMOTE    ] AHH: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T17:06:51.907808] [INFO ] [REMOTE    ] AHH: Full fetch complete (59365 records).
[2025-10-24T17:06:51.907962] [DEBUG] [VALIDATOR ] AHH: Validating primary data.
[2025-10-24T17:06:52.156746] [INFO ] [REMOTE    ] AHR: Fetching primary data for 2025-07.
[2025-10-24T17:06:52.301319] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present.
[2025-10-24T17:06:52.301402] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed.
[2025-10-24T17:06:52.302036] [INFO ] [MAIN      ] AHH: Fetched primary data is valid.
[2025-10-24T17:06:52.302104] [DEBUG] [LOCAL     ] AHH: Saving primary data.
[2025-10-24T17:06:52.302706] [FATAL] [LOCAL     ] AHH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:06:52.302806] [FATAL] [MAIN      ] AHH: Failed to save primary data.
[2025-10-24T17:06:52.302851] [WARN ] [MAIN      ] AHH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:06:52.302887] [INFO ] [LOCAL     ] AHH: Starting deletion of primary data.
[2025-10-24T17:06:52.302943] [DEBUG] [LOCAL     ] AHH: No primary data file found to delete.
[2025-10-24T17:06:52.302978] [INFO ] [LOCAL     ] AHH: Starting deletion of derivative data.
[2025-10-24T17:06:52.303126] [DEBUG] [LOCAL     ] AHH: Deleted derivative data file.
[2025-10-24T17:06:52.303976] [INFO ] [MAIN      ] Update Progress: 61/2366 symbols completed. AHH took 25.4s. Estimated remaining: 4h 17m 50s. Rate: 8.9 symbols/min
[2025-10-24T17:06:52.471110] [INFO ] [MAIN      ] AIG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:06:52.524607] [DEBUG] [LOCAL     ] AIG: Loaded 53845 existing records from primary storage.
[2025-10-24T17:06:52.524973] [INFO ] [MAIN      ] AIG: Loaded 53845 existing records.
[2025-10-24T17:06:52.701889] [WARN ] [MAIN      ] AIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:06:52.702106] [INFO ] [MAIN      ] AIG: Wiping existing primary data before full refresh.
[2025-10-24T17:06:52.702152] [INFO ] [LOCAL     ] AIG: Starting deletion of primary data.
[2025-10-24T17:06:52.702482] [DEBUG] [LOCAL     ] AIG: Deleted primary data file.
[2025-10-24T17:06:52.702521] [INFO ] [MAIN      ] AIG: Starting full primary refresh.
[2025-10-24T17:06:52.956788] [INFO ] [REMOTE    ] AHT: Fetching primary data for 2025-03.
[2025-10-24T17:06:53.080709] [INFO ] [REMOTE    ] AIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:06:53.389236] [INFO ] [REMOTE    ] AI: Incremental fetch complete for 2025-01 (2.04 seconds).
[2025-10-24T17:06:53.603945] [INFO ] [REMOTE    ] AHT: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T17:06:53.605450] [INFO ] [REMOTE    ] AHR: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T17:06:53.747731] [INFO ] [REMOTE    ] AHT: Fetching primary data for 2025-04.
[2025-10-24T17:06:54.146255] [INFO ] [REMOTE    ] AHT: Incremental fetch complete for 2025-04 (0.40 seconds).
[2025-10-24T17:06:54.547673] [INFO ] [REMOTE    ] AIG: Fetching primary data for 2025-01.
[2025-10-24T17:06:55.347745] [INFO ] [REMOTE    ] AHT: Fetching primary data for 2025-05.
[2025-10-24T17:06:55.925059] [INFO ] [REMOTE    ] AHT: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T17:06:56.147612] [INFO ] [REMOTE    ] AHT: Fetching primary data for 2025-06.
[2025-10-24T17:06:56.263490] [INFO ] [REMOTE    ] AIG: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T17:06:56.836059] [INFO ] [REMOTE    ] AHT: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T17:06:56.947735] [INFO ] [REMOTE    ] AI: Fetching primary data for 2025-02.
[2025-10-24T17:06:57.747619] [INFO ] [REMOTE    ] AIG: Fetching primary data for 2025-02.
[2025-10-24T17:06:58.547697] [INFO ] [REMOTE    ] AHR: Fetching primary data for 2025-08.
[2025-10-24T17:06:59.071826] [INFO ] [REMOTE    ] AI: Incremental fetch complete for 2025-02 (2.12 seconds).
[2025-10-24T17:06:59.164567] [INFO ] [REMOTE    ] AIG: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T17:06:59.347630] [INFO ] [REMOTE    ] AIG: Fetching primary data for 2025-03.
[2025-10-24T17:07:00.011210] [INFO ] [REMOTE    ] AHR: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T17:07:00.147620] [INFO ] [REMOTE    ] AHR: Fetching primary data for 2025-09.
[2025-10-24T17:07:00.947671] [INFO ] [REMOTE    ] AI: Fetching primary data for 2025-03.
[2025-10-24T17:07:01.747727] [INFO ] [REMOTE    ] AHT: Fetching primary data for 2025-07.
[2025-10-24T17:07:01.976544] [INFO ] [REMOTE    ] AIG: Incremental fetch complete for 2025-03 (2.63 seconds).
[2025-10-24T17:07:02.344737] [INFO ] [REMOTE    ] AHT: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T17:07:02.517595] [INFO ] [REMOTE    ] AHR: Incremental fetch complete for 2025-09 (2.37 seconds).
[2025-10-24T17:07:02.547620] [INFO ] [REMOTE    ] AHR: Fetching primary data for 2025-10.
[2025-10-24T17:07:03.347688] [INFO ] [REMOTE    ] AIG: Fetching primary data for 2025-04.
[2025-10-24T17:07:03.529919] [INFO ] [REMOTE    ] AI: Incremental fetch complete for 2025-03 (2.58 seconds).
[2025-10-24T17:07:04.147682] [INFO ] [REMOTE    ] AI: Fetching primary data for 2025-04.
[2025-10-24T17:07:04.701107] [INFO ] [REMOTE    ] AHR: Incremental fetch complete for 2025-10 (2.15 seconds).
[2025-10-24T17:07:04.710032] [INFO ] [REMOTE    ] AHR: Full fetch complete (70820 records).
[2025-10-24T17:07:04.710153] [DEBUG] [VALIDATOR ] AHR: Validating primary data.
[2025-10-24T17:07:04.963841] [INFO ] [REMOTE    ] AHT: Fetching primary data for 2025-08.
[2025-10-24T17:07:05.100847] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present.
[2025-10-24T17:07:05.100937] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed.
[2025-10-24T17:07:05.101702] [INFO ] [MAIN      ] AHR: Fetched primary data is valid.
[2025-10-24T17:07:05.101768] [DEBUG] [LOCAL     ] AHR: Saving primary data.
[2025-10-24T17:07:05.102378] [FATAL] [LOCAL     ] AHR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:07:05.102470] [FATAL] [MAIN      ] AHR: Failed to save primary data.
[2025-10-24T17:07:05.102512] [WARN ] [MAIN      ] AHR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:07:05.102546] [INFO ] [LOCAL     ] AHR: Starting deletion of primary data.
[2025-10-24T17:07:05.102601] [DEBUG] [LOCAL     ] AHR: No primary data file found to delete.
[2025-10-24T17:07:05.102635] [INFO ] [LOCAL     ] AHR: Starting deletion of derivative data.
[2025-10-24T17:07:05.102837] [DEBUG] [LOCAL     ] AHR: Deleted derivative data file.
[2025-10-24T17:07:05.103554] [INFO ] [MAIN      ] Update Progress: 62/2366 symbols completed. AHR took 35.9s. Estimated remaining: 4h 21m 30s. Rate: 8.8 symbols/min
[2025-10-24T17:07:05.274593] [INFO ] [MAIN      ] AII: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:07:05.274794] [DEBUG] [LOCAL     ] AII: No existing data file found in primary storage.
[2025-10-24T17:07:05.274838] [WARN ] [MAIN      ] AII: No existing data found, performing full refresh instead.
[2025-10-24T17:07:05.274949] [INFO ] [MAIN      ] AII: Wiping existing primary data before full refresh.
[2025-10-24T17:07:05.274991] [INFO ] [LOCAL     ] AII: Starting deletion of primary data.
[2025-10-24T17:07:05.275032] [DEBUG] [LOCAL     ] AII: No primary data file found to delete.
[2025-10-24T17:07:05.275064] [INFO ] [MAIN      ] AII: Starting full primary refresh.
[2025-10-24T17:07:05.637549] [INFO ] [REMOTE    ] AII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:07:05.747666] [INFO ] [REMOTE    ] AII: Fetching primary data for 2025-01.
[2025-10-24T17:07:05.756938] [INFO ] [REMOTE    ] AHT: Incremental fetch complete for 2025-08 (0.79 seconds).
[2025-10-24T17:07:05.816245] [INFO ] [REMOTE    ] AIG: Incremental fetch complete for 2025-04 (2.47 seconds).
[2025-10-24T17:07:05.978148] [DEBUG] [REMOTE    ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:07:05.978443] [WARN ] [REMOTE    ] AII: No data returned for month 2025-01
[2025-10-24T17:07:05.978532] [FATAL] [REMOTE    ] AII: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:07:05.978599] [FATAL] [MAIN      ] AII: Failed to fetch primary data.
[2025-10-24T17:07:05.978687] [WARN ] [MAIN      ] AII: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:07:05.978757] [INFO ] [LOCAL     ] AII: Starting deletion of primary data.
[2025-10-24T17:07:05.978821] [DEBUG] [LOCAL     ] AII: No primary data file found to delete.
[2025-10-24T17:07:05.978855] [INFO ] [LOCAL     ] AII: Starting deletion of derivative data.
[2025-10-24T17:07:05.978894] [DEBUG] [LOCAL     ] AII: No derivative data file found to delete.
[2025-10-24T17:07:05.978940] [INFO ] [MAIN      ] Update Progress: 63/2366 symbols completed. AII took 0.9s. Estimated remaining: 4h 17m 46s. Rate: 8.9 symbols/min
[2025-10-24T17:07:06.148028] [INFO ] [MAIN      ] AIN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:07:06.173696] [DEBUG] [LOCAL     ] AIN: Loaded 24456 existing records from primary storage.
[2025-10-24T17:07:06.173962] [INFO ] [MAIN      ] AIN: Loaded 24456 existing records.
[2025-10-24T17:07:06.348145] [WARN ] [MAIN      ] AIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:07:06.348379] [INFO ] [MAIN      ] AIN: Wiping existing primary data before full refresh.
[2025-10-24T17:07:06.348504] [INFO ] [LOCAL     ] AIN: Starting deletion of primary data.
[2025-10-24T17:07:06.348865] [DEBUG] [LOCAL     ] AIN: Deleted primary data file.
[2025-10-24T17:07:06.348922] [INFO ] [MAIN      ] AIN: Starting full primary refresh.
[2025-10-24T17:07:06.550773] [INFO ] [REMOTE    ] AHT: Fetching primary data for 2025-09.
[2025-10-24T17:07:06.721765] [INFO ] [REMOTE    ] AIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:07:06.777233] [INFO ] [REMOTE    ] AI: Incremental fetch complete for 2025-04 (2.63 seconds).
[2025-10-24T17:07:07.347624] [INFO ] [REMOTE    ] AIN: Fetching primary data for 2025-01.
[2025-10-24T17:07:07.420089] [INFO ] [REMOTE    ] AHT: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T17:07:08.147626] [INFO ] [REMOTE    ] AHT: Fetching primary data for 2025-10.
[2025-10-24T17:07:08.536376] [INFO ] [REMOTE    ] AIN: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T17:07:08.924804] [INFO ] [REMOTE    ] AHT: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T17:07:08.926709] [INFO ] [REMOTE    ] AHT: Full fetch complete (9043 records).
[2025-10-24T17:07:08.926782] [DEBUG] [VALIDATOR ] AHT: Validating primary data.
[2025-10-24T17:07:08.958068] [INFO ] [REMOTE    ] AIG: Fetching primary data for 2025-05.
[2025-10-24T17:07:09.290267] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present.
[2025-10-24T17:07:09.290345] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed.
[2025-10-24T17:07:09.290587] [INFO ] [MAIN      ] AHT: Fetched primary data is valid.
[2025-10-24T17:07:09.290627] [DEBUG] [LOCAL     ] AHT: Saving primary data.
[2025-10-24T17:07:09.290860] [FATAL] [LOCAL     ] AHT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:07:09.290942] [FATAL] [MAIN      ] AHT: Failed to save primary data.
[2025-10-24T17:07:09.290984] [WARN ] [MAIN      ] AHT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:07:09.291053] [INFO ] [LOCAL     ] AHT: Starting deletion of primary data.
[2025-10-24T17:07:09.291150] [DEBUG] [LOCAL     ] AHT: No primary data file found to delete.
[2025-10-24T17:07:09.291192] [INFO ] [LOCAL     ] AHT: Starting deletion of derivative data.
[2025-10-24T17:07:09.291355] [DEBUG] [LOCAL     ] AHT: Deleted derivative data file.
[2025-10-24T17:07:09.291444] [INFO ] [MAIN      ] Update Progress: 64/2366 symbols completed. AHT took 24.2s. Estimated remaining: 4h 15m 37s. Rate: 9.0 symbols/min
[2025-10-24T17:07:09.490563] [INFO ] [MAIN      ] AIO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:07:09.510342] [DEBUG] [LOCAL     ] AIO: Loaded 13054 existing records from primary storage.
[2025-10-24T17:07:09.510601] [INFO ] [MAIN      ] AIO: Loaded 13054 existing records.
[2025-10-24T17:07:09.721975] [WARN ] [MAIN      ] AIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:07:09.722266] [INFO ] [MAIN      ] AIO: Wiping existing primary data before full refresh.
[2025-10-24T17:07:09.722317] [INFO ] [LOCAL     ] AIO: Starting deletion of primary data.
[2025-10-24T17:07:09.722609] [DEBUG] [LOCAL     ] AIO: Deleted primary data file.
[2025-10-24T17:07:09.722711] [INFO ] [MAIN      ] AIO: Starting full primary refresh.
[2025-10-24T17:07:09.752785] [INFO ] [REMOTE    ] AIN: Fetching primary data for 2025-02.
[2025-10-24T17:07:10.121166] [INFO ] [REMOTE    ] AIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:07:10.547738] [INFO ] [REMOTE    ] AIO: Fetching primary data for 2025-01.
[2025-10-24T17:07:10.665823] [INFO ] [REMOTE    ] AIG: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T17:07:10.764989] [INFO ] [REMOTE    ] AIN: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T17:07:11.179860] [INFO ] [REMOTE    ] AIO: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T17:07:11.347724] [INFO ] [REMOTE    ] AIN: Fetching primary data for 2025-03.
[2025-10-24T17:07:12.147712] [INFO ] [REMOTE    ] AIG: Fetching primary data for 2025-06.
[2025-10-24T17:07:12.259503] [INFO ] [REMOTE    ] AIN: Incremental fetch complete for 2025-03 (0.91 seconds).
[2025-10-24T17:07:12.947634] [INFO ] [REMOTE    ] AI: Fetching primary data for 2025-05.
[2025-10-24T17:07:13.747771] [INFO ] [REMOTE    ] AIO: Fetching primary data for 2025-02.
[2025-10-24T17:07:14.071013] [INFO ] [REMOTE    ] AIG: Incremental fetch complete for 2025-06 (1.92 seconds).
[2025-10-24T17:07:14.388230] [INFO ] [REMOTE    ] AIO: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T17:07:14.547619] [INFO ] [REMOTE    ] AIO: Fetching primary data for 2025-03.
[2025-10-24T17:07:15.107877] [INFO ] [REMOTE    ] AI: Incremental fetch complete for 2025-05 (2.16 seconds).
[2025-10-24T17:07:15.154576] [INFO ] [REMOTE    ] AIO: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T17:07:15.347636] [INFO ] [REMOTE    ] AIO: Fetching primary data for 2025-04.
[2025-10-24T17:07:16.147626] [INFO ] [REMOTE    ] AIG: Fetching primary data for 2025-07.
[2025-10-24T17:07:16.337178] [INFO ] [REMOTE    ] AIO: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T17:07:16.947690] [INFO ] [REMOTE    ] AIO: Fetching primary data for 2025-05.
[2025-10-24T17:07:17.593343] [INFO ] [REMOTE    ] AIO: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T17:07:17.747619] [INFO ] [REMOTE    ] AIN: Fetching primary data for 2025-04.
[2025-10-24T17:07:17.820778] [INFO ] [REMOTE    ] AIG: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T17:07:18.547758] [INFO ] [REMOTE    ] AIG: Fetching primary data for 2025-08.
[2025-10-24T17:07:18.940947] [INFO ] [REMOTE    ] AIN: Incremental fetch complete for 2025-04 (1.19 seconds).
[2025-10-24T17:07:19.347689] [INFO ] [REMOTE    ] AIO: Fetching primary data for 2025-06.
[2025-10-24T17:07:19.786316] [INFO ] [REMOTE    ] AIG: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T17:07:20.056053] [INFO ] [REMOTE    ] AIO: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T17:07:20.147664] [INFO ] [REMOTE    ] AIN: Fetching primary data for 2025-05.
[2025-10-24T17:07:20.947616] [INFO ] [REMOTE    ] AIG: Fetching primary data for 2025-09.
[2025-10-24T17:07:20.985120] [INFO ] [REMOTE    ] AIN: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T17:07:21.747623] [INFO ] [REMOTE    ] AI: Fetching primary data for 2025-06.
[2025-10-24T17:07:22.547749] [INFO ] [REMOTE    ] AIO: Fetching primary data for 2025-07.
[2025-10-24T17:07:22.697148] [INFO ] [REMOTE    ] AIG: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T17:07:23.318479] [INFO ] [REMOTE    ] AIO: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T17:07:23.347632] [INFO ] [REMOTE    ] AIG: Fetching primary data for 2025-10.
[2025-10-24T17:07:24.020519] [INFO ] [REMOTE    ] AI: Incremental fetch complete for 2025-06 (2.27 seconds).
[2025-10-24T17:07:24.147677] [INFO ] [REMOTE    ] AI: Fetching primary data for 2025-07.
[2025-10-24T17:07:24.875441] [INFO ] [REMOTE    ] AIG: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T17:07:24.885430] [INFO ] [REMOTE    ] AIG: Full fetch complete (77564 records).
[2025-10-24T17:07:24.885588] [DEBUG] [VALIDATOR ] AIG: Validating primary data.
[2025-10-24T17:07:24.960678] [INFO ] [REMOTE    ] AIO: Fetching primary data for 2025-08.
[2025-10-24T17:07:25.309563] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present.
[2025-10-24T17:07:25.309907] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed.
[2025-10-24T17:07:25.310721] [INFO ] [MAIN      ] AIG: Fetched primary data is valid.
[2025-10-24T17:07:25.310783] [DEBUG] [LOCAL     ] AIG: Saving primary data.
[2025-10-24T17:07:25.311338] [FATAL] [LOCAL     ] AIG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:07:25.311459] [FATAL] [MAIN      ] AIG: Failed to save primary data.
[2025-10-24T17:07:25.311502] [WARN ] [MAIN      ] AIG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:07:25.311538] [INFO ] [LOCAL     ] AIG: Starting deletion of primary data.
[2025-10-24T17:07:25.311603] [DEBUG] [LOCAL     ] AIG: No primary data file found to delete.
[2025-10-24T17:07:25.311681] [INFO ] [LOCAL     ] AIG: Starting deletion of derivative data.
[2025-10-24T17:07:25.312355] [DEBUG] [LOCAL     ] AIG: Deleted derivative data file.
[2025-10-24T17:07:25.313073] [INFO ] [MAIN      ] Update Progress: 65/2366 symbols completed. AIG took 33.0s. Estimated remaining: 4h 21m 1s. Rate: 8.8 symbols/min
[2025-10-24T17:07:25.490052] [INFO ] [MAIN      ] AIR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:07:25.522570] [DEBUG] [LOCAL     ] AIR: Loaded 28815 existing records from primary storage.
[2025-10-24T17:07:25.522877] [INFO ] [MAIN      ] AIR: Loaded 28815 existing records.
[2025-10-24T17:07:25.715077] [INFO ] [REMOTE    ] AIO: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T17:07:25.720762] [WARN ] [MAIN      ] AIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:07:25.721034] [INFO ] [MAIN      ] AIR: Wiping existing primary data before full refresh.
[2025-10-24T17:07:25.724113] [INFO ] [LOCAL     ] AIR: Starting deletion of primary data.
[2025-10-24T17:07:25.724772] [DEBUG] [LOCAL     ] AIR: Deleted primary data file.
[2025-10-24T17:07:25.724831] [INFO ] [MAIN      ] AIR: Starting full primary refresh.
[2025-10-24T17:07:25.756401] [INFO ] [REMOTE    ] AIN: Fetching primary data for 2025-06.
[2025-10-24T17:07:26.106861] [INFO ] [REMOTE    ] AIR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:07:26.458192] [INFO ] [REMOTE    ] AI: Incremental fetch complete for 2025-07 (2.31 seconds).
[2025-10-24T17:07:26.540267] [INFO ] [REMOTE    ] AIN: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T17:07:26.547593] [INFO ] [REMOTE    ] AIN: Fetching primary data for 2025-07.
[2025-10-24T17:07:27.302881] [INFO ] [REMOTE    ] AIN: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T17:07:27.347709] [INFO ] [REMOTE    ] AI: Fetching primary data for 2025-08.
[2025-10-24T17:07:28.147675] [INFO ] [REMOTE    ] AIN: Fetching primary data for 2025-08.
[2025-10-24T17:07:28.947671] [INFO ] [REMOTE    ] AIR: Fetching primary data for 2025-01.
[2025-10-24T17:07:29.402500] [INFO ] [REMOTE    ] AIN: Incremental fetch complete for 2025-08 (1.25 seconds).
[2025-10-24T17:07:29.577998] [INFO ] [REMOTE    ] AI: Incremental fetch complete for 2025-08 (2.23 seconds).
[2025-10-24T17:07:29.747624] [INFO ] [REMOTE    ] AIO: Fetching primary data for 2025-09.
[2025-10-24T17:07:29.849072] [INFO ] [REMOTE    ] AIR: Incremental fetch complete for 2025-01 (0.90 seconds).
[2025-10-24T17:07:30.547632] [INFO ] [REMOTE    ] AIR: Fetching primary data for 2025-02.
[2025-10-24T17:07:30.665079] [INFO ] [REMOTE    ] AIO: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T17:07:31.347615] [INFO ] [REMOTE    ] AIN: Fetching primary data for 2025-09.
[2025-10-24T17:07:31.523810] [INFO ] [REMOTE    ] AIR: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T17:07:32.147638] [INFO ] [REMOTE    ] AI: Fetching primary data for 2025-09.
[2025-10-24T17:07:32.347206] [INFO ] [REMOTE    ] AIN: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T17:07:32.947708] [INFO ] [REMOTE    ] AIO: Fetching primary data for 2025-10.
[2025-10-24T17:07:33.747684] [INFO ] [REMOTE    ] AIR: Fetching primary data for 2025-03.
[2025-10-24T17:07:33.939378] [INFO ] [REMOTE    ] AIO: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T17:07:33.942308] [INFO ] [REMOTE    ] AIO: Full fetch complete (20042 records).
[2025-10-24T17:07:33.942397] [DEBUG] [VALIDATOR ] AIO: Validating primary data.
[2025-10-24T17:07:34.331761] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present.
[2025-10-24T17:07:34.331859] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed.
[2025-10-24T17:07:34.332189] [INFO ] [MAIN      ] AIO: Fetched primary data is valid.
[2025-10-24T17:07:34.332230] [DEBUG] [LOCAL     ] AIO: Saving primary data.
[2025-10-24T17:07:34.332490] [FATAL] [LOCAL     ] AIO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:07:34.332571] [FATAL] [MAIN      ] AIO: Failed to save primary data.
[2025-10-24T17:07:34.332612] [WARN ] [MAIN      ] AIO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:07:34.332671] [INFO ] [LOCAL     ] AIO: Starting deletion of primary data.
[2025-10-24T17:07:34.332743] [DEBUG] [LOCAL     ] AIO: No primary data file found to delete.
[2025-10-24T17:07:34.332779] [INFO ] [LOCAL     ] AIO: Starting deletion of derivative data.
[2025-10-24T17:07:34.332949] [DEBUG] [LOCAL     ] AIO: Deleted derivative data file.
[2025-10-24T17:07:34.333040] [INFO ] [MAIN      ] Update Progress: 66/2366 symbols completed. AIO took 25.0s. Estimated remaining: 4h 22m 12s. Rate: 8.8 symbols/min
[2025-10-24T17:07:34.511360] [INFO ] [MAIN      ] AIT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:07:34.539606] [DEBUG] [LOCAL     ] AIT: Loaded 26768 existing records from primary storage.
[2025-10-24T17:07:34.539908] [INFO ] [MAIN      ] AIT: Loaded 26768 existing records.
[2025-10-24T17:07:34.572804] [INFO ] [REMOTE    ] AIN: Fetching primary data for 2025-10.
[2025-10-24T17:07:34.730235] [WARN ] [MAIN      ] AIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:07:34.730705] [INFO ] [MAIN      ] AIT: Wiping existing primary data before full refresh.
[2025-10-24T17:07:34.730873] [INFO ] [LOCAL     ] AIT: Starting deletion of primary data.
[2025-10-24T17:07:34.731277] [DEBUG] [LOCAL     ] AIT: Deleted primary data file.
[2025-10-24T17:07:34.731387] [INFO ] [MAIN      ] AIT: Starting full primary refresh.
[2025-10-24T17:07:35.139834] [INFO ] [REMOTE    ] AIT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:07:35.143201] [INFO ] [REMOTE    ] AI: Incremental fetch complete for 2025-09 (3.00 seconds).
[2025-10-24T17:07:35.175348] [INFO ] [REMOTE    ] AIR: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T17:07:35.347715] [INFO ] [REMOTE    ] AIR: Fetching primary data for 2025-04.
[2025-10-24T17:07:35.848970] [INFO ] [REMOTE    ] AIN: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T17:07:35.853736] [INFO ] [REMOTE    ] AIN: Full fetch complete (33705 records).
[2025-10-24T17:07:35.853858] [DEBUG] [VALIDATOR ] AIN: Validating primary data.
[2025-10-24T17:07:36.152787] [INFO ] [REMOTE    ] AI: Fetching primary data for 2025-10.
[2025-10-24T17:07:36.235914] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present.
[2025-10-24T17:07:36.236026] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed.
[2025-10-24T17:07:36.236606] [INFO ] [MAIN      ] AIN: Fetched primary data is valid.
[2025-10-24T17:07:36.236708] [DEBUG] [LOCAL     ] AIN: Saving primary data.
[2025-10-24T17:07:36.237168] [FATAL] [LOCAL     ] AIN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:07:36.237258] [FATAL] [MAIN      ] AIN: Failed to save primary data.
[2025-10-24T17:07:36.237345] [WARN ] [MAIN      ] AIN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:07:36.237436] [INFO ] [LOCAL     ] AIN: Starting deletion of primary data.
[2025-10-24T17:07:36.237546] [DEBUG] [LOCAL     ] AIN: No primary data file found to delete.
[2025-10-24T17:07:36.237602] [INFO ] [LOCAL     ] AIN: Starting deletion of derivative data.
[2025-10-24T17:07:36.237995] [DEBUG] [LOCAL     ] AIN: Deleted derivative data file.
[2025-10-24T17:07:36.238366] [INFO ] [MAIN      ] Update Progress: 67/2366 symbols completed. AIN took 30.3s. Estimated remaining: 4h 19m 16s. Rate: 8.9 symbols/min
[2025-10-24T17:07:36.425094] [INFO ] [MAIN      ] AIV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:07:36.444455] [INFO ] [REMOTE    ] AIR: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T17:07:36.501575] [DEBUG] [LOCAL     ] AIV: Loaded 42214 existing records from primary storage.
[2025-10-24T17:07:36.502014] [INFO ] [MAIN      ] AIV: Loaded 42214 existing records.
[2025-10-24T17:07:36.683399] [WARN ] [MAIN      ] AIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:07:36.683692] [INFO ] [MAIN      ] AIV: Wiping existing primary data before full refresh.
[2025-10-24T17:07:36.683753] [INFO ] [LOCAL     ] AIV: Starting deletion of primary data.
[2025-10-24T17:07:36.684117] [DEBUG] [LOCAL     ] AIV: Deleted primary data file.
[2025-10-24T17:07:36.684157] [INFO ] [MAIN      ] AIV: Starting full primary refresh.
[2025-10-24T17:07:36.955087] [INFO ] [REMOTE    ] AIR: Fetching primary data for 2025-05.
[2025-10-24T17:07:37.055773] [INFO ] [REMOTE    ] AIV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:07:37.682632] [INFO ] [REMOTE    ] AIR: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T17:07:37.747627] [INFO ] [REMOTE    ] AIT: Fetching primary data for 2025-01.
[2025-10-24T17:07:38.487232] [INFO ] [REMOTE    ] AI: Incremental fetch complete for 2025-10 (2.33 seconds).
[2025-10-24T17:07:38.497088] [INFO ] [REMOTE    ] AI: Full fetch complete (77915 records).
[2025-10-24T17:07:38.497223] [DEBUG] [VALIDATOR ] AI: Validating primary data.
[2025-10-24T17:07:38.553356] [INFO ] [REMOTE    ] AIR: Fetching primary data for 2025-06.
[2025-10-24T17:07:38.895221] [DEBUG] [VALIDATOR ] AI: All expected trading days are present.
[2025-10-24T17:07:38.895372] [DEBUG] [VALIDATOR ] AI: Primary data validation passed.
[2025-10-24T17:07:38.896294] [INFO ] [MAIN      ] AI: Fetched primary data is valid.
[2025-10-24T17:07:38.896424] [DEBUG] [LOCAL     ] AI: Saving primary data.
[2025-10-24T17:07:38.897109] [FATAL] [LOCAL     ] AI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:07:38.897216] [FATAL] [MAIN      ] AI: Failed to save primary data.
[2025-10-24T17:07:38.897300] [WARN ] [MAIN      ] AI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:07:38.897368] [INFO ] [LOCAL     ] AI: Starting deletion of primary data.
[2025-10-24T17:07:38.897439] [DEBUG] [LOCAL     ] AI: No primary data file found to delete.
[2025-10-24T17:07:38.897475] [INFO ] [LOCAL     ] AI: Starting deletion of derivative data.
[2025-10-24T17:07:38.897671] [DEBUG] [LOCAL     ] AI: Deleted derivative data file.
[2025-10-24T17:07:38.898040] [INFO ] [MAIN      ] Update Progress: 68/2366 symbols completed. AI took 51.1s. Estimated remaining: 4h 16m 50s. Rate: 8.9 symbols/min
[2025-10-24T17:07:39.104325] [INFO ] [MAIN      ] AIZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:07:39.124054] [INFO ] [REMOTE    ] AIT: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T17:07:39.155776] [DEBUG] [LOCAL     ] AIZ: Loaded 29404 existing records from primary storage.
[2025-10-24T17:07:39.156032] [INFO ] [MAIN      ] AIZ: Loaded 29404 existing records.
[2025-10-24T17:07:39.333875] [WARN ] [MAIN      ] AIZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:07:39.334131] [INFO ] [MAIN      ] AIZ: Wiping existing primary data before full refresh.
[2025-10-24T17:07:39.334187] [INFO ] [LOCAL     ] AIZ: Starting deletion of primary data.
[2025-10-24T17:07:39.334433] [DEBUG] [LOCAL     ] AIZ: Deleted primary data file.
[2025-10-24T17:07:39.334489] [INFO ] [MAIN      ] AIZ: Starting full primary refresh.
[2025-10-24T17:07:39.354549] [INFO ] [REMOTE    ] AIT: Fetching primary data for 2025-02.
[2025-10-24T17:07:39.633053] [INFO ] [REMOTE    ] AIR: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T17:07:39.713507] [INFO ] [REMOTE    ] AIZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:07:40.147620] [INFO ] [REMOTE    ] AIZ: Fetching primary data for 2025-01.
[2025-10-24T17:07:40.320938] [INFO ] [REMOTE    ] AIT: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T17:07:40.947693] [INFO ] [REMOTE    ] AIV: Fetching primary data for 2025-01.
[2025-10-24T17:07:41.411964] [INFO ] [REMOTE    ] AIZ: Incremental fetch complete for 2025-01 (1.26 seconds).
[2025-10-24T17:07:41.747690] [INFO ] [REMOTE    ] AIZ: Fetching primary data for 2025-02.
[2025-10-24T17:07:42.497859] [INFO ] [REMOTE    ] AIV: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T17:07:42.547670] [INFO ] [REMOTE    ] AIV: Fetching primary data for 2025-02.
[2025-10-24T17:07:43.112857] [INFO ] [REMOTE    ] AIZ: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T17:07:43.347702] [INFO ] [REMOTE    ] AIZ: Fetching primary data for 2025-03.
[2025-10-24T17:07:43.717798] [INFO ] [REMOTE    ] AIV: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T17:07:44.147692] [INFO ] [REMOTE    ] AIV: Fetching primary data for 2025-03.
[2025-10-24T17:07:44.665934] [INFO ] [REMOTE    ] AIZ: Incremental fetch complete for 2025-03 (1.32 seconds).
[2025-10-24T17:07:44.947716] [INFO ] [REMOTE    ] AIR: Fetching primary data for 2025-07.
[2025-10-24T17:07:45.213829] [INFO ] [REMOTE    ] AIV: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T17:07:45.747694] [INFO ] [REMOTE    ] AIZ: Fetching primary data for 2025-04.
[2025-10-24T17:07:46.330052] [INFO ] [REMOTE    ] AIR: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T17:07:46.547675] [INFO ] [REMOTE    ] AIR: Fetching primary data for 2025-08.
[2025-10-24T17:07:46.587231] [INFO ] [REMOTE    ] AIZ: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T17:07:47.347741] [INFO ] [REMOTE    ] AIZ: Fetching primary data for 2025-05.
[2025-10-24T17:07:47.780596] [INFO ] [REMOTE    ] AIR: Incremental fetch complete for 2025-08 (1.23 seconds).
[2025-10-24T17:07:48.147733] [INFO ] [REMOTE    ] AIT: Fetching primary data for 2025-03.
[2025-10-24T17:07:48.484686] [INFO ] [REMOTE    ] AIZ: Incremental fetch complete for 2025-05 (1.14 seconds).
[2025-10-24T17:07:48.947687] [INFO ] [REMOTE    ] AIZ: Fetching primary data for 2025-06.
[2025-10-24T17:07:49.232260] [INFO ] [REMOTE    ] AIT: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T17:07:49.747712] [INFO ] [REMOTE    ] AIV: Fetching primary data for 2025-04.
[2025-10-24T17:07:50.187104] [INFO ] [REMOTE    ] AIZ: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T17:07:50.547678] [INFO ] [REMOTE    ] AIZ: Fetching primary data for 2025-07.
[2025-10-24T17:07:50.756539] [INFO ] [REMOTE    ] AIV: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T17:07:51.347605] [INFO ] [REMOTE    ] AIR: Fetching primary data for 2025-09.
[2025-10-24T17:07:51.563158] [INFO ] [REMOTE    ] AIZ: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T17:07:52.147690] [INFO ] [REMOTE    ] AIT: Fetching primary data for 2025-04.
[2025-10-24T17:07:52.595554] [INFO ] [REMOTE    ] AIR: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T17:07:52.947677] [INFO ] [REMOTE    ] AIR: Fetching primary data for 2025-10.
[2025-10-24T17:07:53.594963] [INFO ] [REMOTE    ] AIT: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T17:07:53.747630] [INFO ] [REMOTE    ] AIT: Fetching primary data for 2025-05.
[2025-10-24T17:07:54.477837] [INFO ] [REMOTE    ] AIR: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T17:07:54.484366] [INFO ] [REMOTE    ] AIR: Full fetch complete (40316 records).
[2025-10-24T17:07:54.484469] [DEBUG] [VALIDATOR ] AIR: Validating primary data.
[2025-10-24T17:07:54.555961] [INFO ] [REMOTE    ] AIZ: Fetching primary data for 2025-08.
[2025-10-24T17:07:54.883114] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present.
[2025-10-24T17:07:54.883215] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed.
[2025-10-24T17:07:54.883763] [INFO ] [MAIN      ] AIR: Fetched primary data is valid.
[2025-10-24T17:07:54.883844] [DEBUG] [LOCAL     ] AIR: Saving primary data.
[2025-10-24T17:07:54.884273] [FATAL] [LOCAL     ] AIR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:07:54.884356] [FATAL] [MAIN      ] AIR: Failed to save primary data.
[2025-10-24T17:07:54.884400] [WARN ] [MAIN      ] AIR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:07:54.884464] [INFO ] [LOCAL     ] AIR: Starting deletion of primary data.
[2025-10-24T17:07:54.884523] [DEBUG] [LOCAL     ] AIR: No primary data file found to delete.
[2025-10-24T17:07:54.884559] [INFO ] [LOCAL     ] AIR: Starting deletion of derivative data.
[2025-10-24T17:07:54.884764] [DEBUG] [LOCAL     ] AIR: Deleted derivative data file.
[2025-10-24T17:07:54.884856] [INFO ] [MAIN      ] Update Progress: 69/2366 symbols completed. AIR took 29.6s. Estimated remaining: 4h 21m 52s. Rate: 8.8 symbols/min
[2025-10-24T17:07:55.053824] [INFO ] [MAIN      ] AIZN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:07:55.077236] [DEBUG] [LOCAL     ] AIZN: Loaded 3838 existing records from primary storage.
[2025-10-24T17:07:55.077018] [INFO ] [REMOTE    ] AIT: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T17:07:55.079863] [INFO ] [MAIN      ] AIZN: Loaded 3838 existing records.
[2025-10-24T17:07:55.271222] [WARN ] [MAIN      ] AIZN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:07:55.271468] [INFO ] [MAIN      ] AIZN: Wiping existing primary data before full refresh.
[2025-10-24T17:07:55.271539] [INFO ] [LOCAL     ] AIZN: Starting deletion of primary data.
[2025-10-24T17:07:55.271789] [DEBUG] [LOCAL     ] AIZN: Deleted primary data file.
[2025-10-24T17:07:55.271861] [INFO ] [MAIN      ] AIZN: Starting full primary refresh.
[2025-10-24T17:07:55.352776] [INFO ] [REMOTE    ] AIV: Fetching primary data for 2025-05.
[2025-10-24T17:07:55.623710] [INFO ] [REMOTE    ] AIZN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:07:55.907373] [INFO ] [REMOTE    ] AIZ: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T17:07:56.147630] [INFO ] [REMOTE    ] AIZ: Fetching primary data for 2025-09.
[2025-10-24T17:07:56.947632] [INFO ] [REMOTE    ] AIZN: Fetching primary data for 2025-01.
[2025-10-24T17:07:56.984526] [INFO ] [REMOTE    ] AIV: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T17:07:57.375099] [INFO ] [REMOTE    ] AIZ: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T17:07:57.678667] [INFO ] [REMOTE    ] AIZN: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T17:07:57.747619] [INFO ] [REMOTE    ] AIZN: Fetching primary data for 2025-02.
[2025-10-24T17:07:58.114738] [INFO ] [REMOTE    ] AIZN: Incremental fetch complete for 2025-02 (0.37 seconds).
[2025-10-24T17:07:58.547688] [INFO ] [REMOTE    ] AIT: Fetching primary data for 2025-06.
[2025-10-24T17:07:59.347696] [INFO ] [REMOTE    ] AIZ: Fetching primary data for 2025-10.
[2025-10-24T17:07:59.455743] [INFO ] [REMOTE    ] AIT: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T17:08:00.147635] [INFO ] [REMOTE    ] AIZN: Fetching primary data for 2025-03.
[2025-10-24T17:08:00.682776] [INFO ] [REMOTE    ] AIZ: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T17:08:00.687403] [INFO ] [REMOTE    ] AIZ: Full fetch complete (42723 records).
[2025-10-24T17:08:00.687754] [DEBUG] [VALIDATOR ] AIZ: Validating primary data.
[2025-10-24T17:08:00.955074] [INFO ] [REMOTE    ] AIV: Fetching primary data for 2025-06.
[2025-10-24T17:08:01.129306] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present.
[2025-10-24T17:08:01.129384] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed.
[2025-10-24T17:08:01.129995] [INFO ] [MAIN      ] AIZ: Fetched primary data is valid.
[2025-10-24T17:08:01.130062] [DEBUG] [LOCAL     ] AIZ: Saving primary data.
[2025-10-24T17:08:01.130589] [FATAL] [LOCAL     ] AIZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:08:01.130704] [FATAL] [MAIN      ] AIZ: Failed to save primary data.
[2025-10-24T17:08:01.130752] [WARN ] [MAIN      ] AIZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:08:01.130818] [INFO ] [LOCAL     ] AIZ: Starting deletion of primary data.
[2025-10-24T17:08:01.130880] [DEBUG] [LOCAL     ] AIZ: No primary data file found to delete.
[2025-10-24T17:08:01.130918] [INFO ] [LOCAL     ] AIZ: Starting deletion of derivative data.
[2025-10-24T17:08:01.131094] [DEBUG] [LOCAL     ] AIZ: Deleted derivative data file.
[2025-10-24T17:08:01.131226] [INFO ] [MAIN      ] Update Progress: 70/2366 symbols completed. AIZ took 22.2s. Estimated remaining: 4h 21m 26s. Rate: 8.8 symbols/min
[2025-10-24T17:08:01.386971] [INFO ] [REMOTE    ] AIZN: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T17:08:01.386431] [INFO ] [MAIN      ] AJG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:08:01.461291] [DEBUG] [LOCAL     ] AJG: Loaded 46707 existing records from primary storage.
[2025-10-24T17:08:01.461793] [INFO ] [MAIN      ] AJG: Loaded 46707 existing records.
[2025-10-24T17:08:01.756879] [INFO ] [REMOTE    ] AIZN: Fetching primary data for 2025-04.
[2025-10-24T17:08:01.765102] [WARN ] [MAIN      ] AJG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:08:01.766612] [INFO ] [MAIN      ] AJG: Wiping existing primary data before full refresh.
[2025-10-24T17:08:01.766722] [INFO ] [LOCAL     ] AJG: Starting deletion of primary data.
[2025-10-24T17:08:01.767907] [DEBUG] [LOCAL     ] AJG: Deleted primary data file.
[2025-10-24T17:08:01.767981] [INFO ] [MAIN      ] AJG: Starting full primary refresh.
[2025-10-24T17:08:02.217289] [INFO ] [REMOTE    ] AJG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:08:02.547678] [INFO ] [REMOTE    ] AJG: Fetching primary data for 2025-01.
[2025-10-24T17:08:02.905858] [INFO ] [REMOTE    ] AIV: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T17:08:03.047212] [INFO ] [REMOTE    ] AIZN: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T17:08:03.347679] [INFO ] [REMOTE    ] AIZN: Fetching primary data for 2025-05.
[2025-10-24T17:08:04.104382] [INFO ] [REMOTE    ] AIZN: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T17:08:04.147618] [INFO ] [REMOTE    ] AIZN: Fetching primary data for 2025-06.
[2025-10-24T17:08:04.831337] [INFO ] [REMOTE    ] AIZN: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T17:08:04.947674] [INFO ] [REMOTE    ] AIT: Fetching primary data for 2025-07.
[2025-10-24T17:08:05.454505] [INFO ] [REMOTE    ] AJG: Incremental fetch complete for 2025-01 (2.91 seconds).
[2025-10-24T17:08:05.747610] [INFO ] [REMOTE    ] AJG: Fetching primary data for 2025-02.
[2025-10-24T17:08:06.240016] [INFO ] [REMOTE    ] AIT: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T17:08:06.547737] [INFO ] [REMOTE    ] AIT: Fetching primary data for 2025-08.
[2025-10-24T17:08:07.281774] [INFO ] [REMOTE    ] AJG: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T17:08:07.347687] [INFO ] [REMOTE    ] AIZN: Fetching primary data for 2025-07.
[2025-10-24T17:08:07.712261] [INFO ] [REMOTE    ] AIT: Incremental fetch complete for 2025-08 (1.16 seconds).
[2025-10-24T17:08:08.084700] [INFO ] [REMOTE    ] AIZN: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T17:08:08.147619] [INFO ] [REMOTE    ] AJG: Fetching primary data for 2025-03.
[2025-10-24T17:08:08.947721] [INFO ] [REMOTE    ] AIV: Fetching primary data for 2025-07.
[2025-10-24T17:08:09.747924] [INFO ] [REMOTE    ] AIZN: Fetching primary data for 2025-08.
[2025-10-24T17:08:09.788198] [INFO ] [REMOTE    ] AJG: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T17:08:10.264380] [INFO ] [REMOTE    ] AIV: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T17:08:10.277409] [INFO ] [REMOTE    ] AIZN: Incremental fetch complete for 2025-08 (0.53 seconds).
[2025-10-24T17:08:10.547686] [INFO ] [REMOTE    ] AIT: Fetching primary data for 2025-09.
[2025-10-24T17:08:11.347638] [INFO ] [REMOTE    ] AJG: Fetching primary data for 2025-04.
[2025-10-24T17:08:11.593453] [INFO ] [REMOTE    ] AIT: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T17:08:12.147678] [INFO ] [REMOTE    ] AIT: Fetching primary data for 2025-10.
[2025-10-24T17:08:12.947616] [INFO ] [REMOTE    ] AIZN: Fetching primary data for 2025-09.
[2025-10-24T17:08:13.048985] [INFO ] [REMOTE    ] AJG: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T17:08:13.323820] [INFO ] [REMOTE    ] AIT: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T17:08:13.328308] [INFO ] [REMOTE    ] AIT: Full fetch complete (39017 records).
[2025-10-24T17:08:13.328391] [DEBUG] [VALIDATOR ] AIT: Validating primary data.
[2025-10-24T17:08:13.599189] [INFO ] [REMOTE    ] AIZN: Incremental fetch complete for 2025-09 (0.65 seconds).
[2025-10-24T17:08:13.719624] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present.
[2025-10-24T17:08:13.719736] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed.
[2025-10-24T17:08:13.720229] [INFO ] [MAIN      ] AIT: Fetched primary data is valid.
[2025-10-24T17:08:13.720268] [DEBUG] [LOCAL     ] AIT: Saving primary data.
[2025-10-24T17:08:13.720724] [FATAL] [LOCAL     ] AIT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:08:13.720810] [FATAL] [MAIN      ] AIT: Failed to save primary data.
[2025-10-24T17:08:13.720851] [WARN ] [MAIN      ] AIT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:08:13.720891] [INFO ] [LOCAL     ] AIT: Starting deletion of primary data.
[2025-10-24T17:08:13.720941] [DEBUG] [LOCAL     ] AIT: No primary data file found to delete.
[2025-10-24T17:08:13.721025] [INFO ] [LOCAL     ] AIT: Starting deletion of derivative data.
[2025-10-24T17:08:13.721210] [DEBUG] [LOCAL     ] AIT: Deleted derivative data file.
[2025-10-24T17:08:13.721302] [INFO ] [MAIN      ] Update Progress: 71/2366 symbols completed. AIT took 39.4s. Estimated remaining: 4h 24m 25s. Rate: 8.7 symbols/min
[2025-10-24T17:08:13.752707] [INFO ] [REMOTE    ] AJG: Fetching primary data for 2025-05.
[2025-10-24T17:08:13.893387] [INFO ] [MAIN      ] AKA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:08:13.893564] [DEBUG] [LOCAL     ] AKA: No existing data file found in primary storage.
[2025-10-24T17:08:13.893603] [WARN ] [MAIN      ] AKA: No existing data found, performing full refresh instead.
[2025-10-24T17:08:13.893744] [INFO ] [MAIN      ] AKA: Wiping existing primary data before full refresh.
[2025-10-24T17:08:13.893788] [INFO ] [LOCAL     ] AKA: Starting deletion of primary data.
[2025-10-24T17:08:13.893879] [DEBUG] [LOCAL     ] AKA: No primary data file found to delete.
[2025-10-24T17:08:13.893920] [INFO ] [MAIN      ] AKA: Starting full primary refresh.
[2025-10-24T17:08:14.247149] [INFO ] [REMOTE    ] AKA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:08:14.547689] [INFO ] [REMOTE    ] AIV: Fetching primary data for 2025-08.
[2025-10-24T17:08:15.347616] [INFO ] [REMOTE    ] AIZN: Fetching primary data for 2025-10.
[2025-10-24T17:08:15.529298] [INFO ] [REMOTE    ] AJG: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T17:08:15.863950] [INFO ] [REMOTE    ] AIV: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T17:08:15.894440] [INFO ] [REMOTE    ] AIZN: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T17:08:15.896172] [INFO ] [REMOTE    ] AIZN: Full fetch complete (5762 records).
[2025-10-24T17:08:15.896256] [DEBUG] [VALIDATOR ] AIZN: Validating primary data.
[2025-10-24T17:08:16.152727] [INFO ] [REMOTE    ] AKA: Fetching primary data for 2025-01.
[2025-10-24T17:08:16.274063] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present.
[2025-10-24T17:08:16.274161] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed.
[2025-10-24T17:08:16.274349] [INFO ] [MAIN      ] AIZN: Fetched primary data is valid.
[2025-10-24T17:08:16.274390] [DEBUG] [LOCAL     ] AIZN: Saving primary data.
[2025-10-24T17:08:16.274573] [FATAL] [LOCAL     ] AIZN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:08:16.274682] [FATAL] [MAIN      ] AIZN: Failed to save primary data.
[2025-10-24T17:08:16.274734] [WARN ] [MAIN      ] AIZN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:08:16.274780] [INFO ] [LOCAL     ] AIZN: Starting deletion of primary data.
[2025-10-24T17:08:16.274830] [DEBUG] [LOCAL     ] AIZN: No primary data file found to delete.
[2025-10-24T17:08:16.274866] [INFO ] [LOCAL     ] AIZN: Starting deletion of derivative data.
[2025-10-24T17:08:16.275009] [DEBUG] [LOCAL     ] AIZN: Deleted derivative data file.
[2025-10-24T17:08:16.275080] [INFO ] [MAIN      ] Update Progress: 72/2366 symbols completed. AIZN took 21.4s. Estimated remaining: 4h 21m 60s. Rate: 8.8 symbols/min
[2025-10-24T17:08:16.443864] [INFO ] [MAIN      ] AKR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:08:16.492031] [DEBUG] [LOCAL     ] AKR: Loaded 46444 existing records from primary storage.
[2025-10-24T17:08:16.492311] [INFO ] [MAIN      ] AKR: Loaded 46444 existing records.
[2025-10-24T17:08:16.671084] [WARN ] [MAIN      ] AKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:08:16.671301] [INFO ] [MAIN      ] AKR: Wiping existing primary data before full refresh.
[2025-10-24T17:08:16.671350] [INFO ] [LOCAL     ] AKR: Starting deletion of primary data.
[2025-10-24T17:08:16.672251] [DEBUG] [LOCAL     ] AKR: Deleted primary data file.
[2025-10-24T17:08:16.672322] [INFO ] [MAIN      ] AKR: Starting full primary refresh.
[2025-10-24T17:08:16.775695] [INFO ] [REMOTE    ] AKA: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T17:08:16.952868] [INFO ] [REMOTE    ] AKA: Fetching primary data for 2025-02.
[2025-10-24T17:08:17.039118] [INFO ] [REMOTE    ] AKR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:08:17.589138] [INFO ] [REMOTE    ] AKA: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T17:08:17.747621] [INFO ] [REMOTE    ] AKR: Fetching primary data for 2025-01.
[2025-10-24T17:08:18.547722] [INFO ] [REMOTE    ] AKA: Fetching primary data for 2025-03.
[2025-10-24T17:08:18.903394] [INFO ] [REMOTE    ] AKA: Incremental fetch complete for 2025-03 (0.36 seconds).
[2025-10-24T17:08:19.334100] [INFO ] [REMOTE    ] AKR: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T17:08:19.347590] [INFO ] [REMOTE    ] AKR: Fetching primary data for 2025-02.
[2025-10-24T17:08:20.147662] [INFO ] [REMOTE    ] AIV: Fetching primary data for 2025-09.
[2025-10-24T17:08:20.741001] [INFO ] [REMOTE    ] AKR: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T17:08:20.947710] [INFO ] [REMOTE    ] AKA: Fetching primary data for 2025-04.
[2025-10-24T17:08:21.387165] [INFO ] [REMOTE    ] AKA: Incremental fetch complete for 2025-04 (0.44 seconds).
[2025-10-24T17:08:21.747685] [INFO ] [REMOTE    ] AKA: Fetching primary data for 2025-05.
[2025-10-24T17:08:21.846380] [INFO ] [REMOTE    ] AIV: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T17:08:22.158460] [INFO ] [REMOTE    ] AKA: Incremental fetch complete for 2025-05 (0.41 seconds).
[2025-10-24T17:08:22.547718] [INFO ] [REMOTE    ] AKA: Fetching primary data for 2025-06.
[2025-10-24T17:08:22.976428] [INFO ] [REMOTE    ] AKA: Incremental fetch complete for 2025-06 (0.43 seconds).
[2025-10-24T17:08:23.347682] [INFO ] [REMOTE    ] AIV: Fetching primary data for 2025-10.
[2025-10-24T17:08:24.147639] [INFO ] [REMOTE    ] AKR: Fetching primary data for 2025-03.
[2025-10-24T17:08:24.659317] [INFO ] [REMOTE    ] AIV: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T17:08:24.668171] [INFO ] [REMOTE    ] AIV: Full fetch complete (60371 records).
[2025-10-24T17:08:24.668284] [DEBUG] [VALIDATOR ] AIV: Validating primary data.
[2025-10-24T17:08:24.952839] [INFO ] [REMOTE    ] AKA: Fetching primary data for 2025-07.
[2025-10-24T17:08:25.053606] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present.
[2025-10-24T17:08:25.053708] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed.
[2025-10-24T17:08:25.054345] [INFO ] [MAIN      ] AIV: Fetched primary data is valid.
[2025-10-24T17:08:25.054392] [DEBUG] [LOCAL     ] AIV: Saving primary data.
[2025-10-24T17:08:25.054871] [FATAL] [LOCAL     ] AIV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:08:25.054958] [FATAL] [MAIN      ] AIV: Failed to save primary data.
[2025-10-24T17:08:25.055000] [WARN ] [MAIN      ] AIV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:08:25.055035] [INFO ] [LOCAL     ] AIV: Starting deletion of primary data.
[2025-10-24T17:08:25.055086] [DEBUG] [LOCAL     ] AIV: No primary data file found to delete.
[2025-10-24T17:08:25.055124] [INFO ] [LOCAL     ] AIV: Starting deletion of derivative data.
[2025-10-24T17:08:25.055286] [DEBUG] [LOCAL     ] AIV: Deleted derivative data file.
[2025-10-24T17:08:25.056093] [INFO ] [MAIN      ] Update Progress: 73/2366 symbols completed. AIV took 48.8s. Estimated remaining: 4h 22m 53s. Rate: 8.7 symbols/min
[2025-10-24T17:08:25.228606] [INFO ] [MAIN      ] AL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:08:25.274103] [DEBUG] [LOCAL     ] AL: Loaded 45163 existing records from primary storage.
[2025-10-24T17:08:25.274565] [INFO ] [MAIN      ] AL: Loaded 45163 existing records.
[2025-10-24T17:08:25.353819] [INFO ] [REMOTE    ] AKA: Incremental fetch complete for 2025-07 (0.40 seconds).
[2025-10-24T17:08:25.411756] [INFO ] [REMOTE    ] AKR: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T17:08:25.492686] [WARN ] [MAIN      ] AL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:08:25.492895] [INFO ] [MAIN      ] AL: Wiping existing primary data before full refresh.
[2025-10-24T17:08:25.492942] [INFO ] [LOCAL     ] AL: Starting deletion of primary data.
[2025-10-24T17:08:25.493385] [DEBUG] [LOCAL     ] AL: Deleted primary data file.
[2025-10-24T17:08:25.493441] [INFO ] [MAIN      ] AL: Starting full primary refresh.
[2025-10-24T17:08:25.752903] [INFO ] [REMOTE    ] AKA: Fetching primary data for 2025-08.
[2025-10-24T17:08:25.860784] [INFO ] [REMOTE    ] AL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:08:26.154227] [INFO ] [REMOTE    ] AKA: Incremental fetch complete for 2025-08 (0.40 seconds).
[2025-10-24T17:08:26.547675] [INFO ] [REMOTE    ] AJG: Fetching primary data for 2025-06.
[2025-10-24T17:08:27.347713] [INFO ] [REMOTE    ] AL: Fetching primary data for 2025-01.
[2025-10-24T17:08:28.147706] [INFO ] [REMOTE    ] AKA: Fetching primary data for 2025-09.
[2025-10-24T17:08:28.224079] [INFO ] [REMOTE    ] AJG: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T17:08:28.577217] [INFO ] [REMOTE    ] AKA: Incremental fetch complete for 2025-09 (0.43 seconds).
[2025-10-24T17:08:28.906992] [INFO ] [REMOTE    ] AL: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T17:08:28.947603] [INFO ] [REMOTE    ] AKA: Fetching primary data for 2025-10.
[2025-10-24T17:08:29.718431] [INFO ] [REMOTE    ] AKA: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T17:08:29.719888] [INFO ] [REMOTE    ] AKA: Full fetch complete (2788 records).
[2025-10-24T17:08:29.719967] [DEBUG] [VALIDATOR ] AKA: Validating primary data.
[2025-10-24T17:08:29.720385] [FATAL] [VALIDATOR ] AKA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:08:29.720467] [FATAL] [MAIN      ] AKA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:08:29.720509] [WARN ] [MAIN      ] AKA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:08:29.720546] [INFO ] [LOCAL     ] AKA: Starting deletion of primary data.
[2025-10-24T17:08:29.720600] [DEBUG] [LOCAL     ] AKA: No primary data file found to delete.
[2025-10-24T17:08:29.720684] [INFO ] [LOCAL     ] AKA: Starting deletion of derivative data.
[2025-10-24T17:08:29.720763] [DEBUG] [LOCAL     ] AKA: No derivative data file found to delete.
[2025-10-24T17:08:29.720830] [INFO ] [MAIN      ] Update Progress: 74/2366 symbols completed. AKA took 16.0s. Estimated remaining: 4h 21m 38s. Rate: 8.8 symbols/min
[2025-10-24T17:08:29.752802] [INFO ] [REMOTE    ] AJG: Fetching primary data for 2025-07.
[2025-10-24T17:08:29.905664] [INFO ] [MAIN      ] ALB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:08:29.963081] [DEBUG] [LOCAL     ] ALB: Loaded 53752 existing records from primary storage.
[2025-10-24T17:08:29.963377] [INFO ] [MAIN      ] ALB: Loaded 53752 existing records.
[2025-10-24T17:08:30.142813] [WARN ] [MAIN      ] ALB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:08:30.143024] [INFO ] [MAIN      ] ALB: Wiping existing primary data before full refresh.
[2025-10-24T17:08:30.143075] [INFO ] [LOCAL     ] ALB: Starting deletion of primary data.
[2025-10-24T17:08:30.143678] [DEBUG] [LOCAL     ] ALB: Deleted primary data file.
[2025-10-24T17:08:30.143735] [INFO ] [MAIN      ] ALB: Starting full primary refresh.
[2025-10-24T17:08:30.522494] [INFO ] [REMOTE    ] ALB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:08:30.547602] [INFO ] [REMOTE    ] ALB: Fetching primary data for 2025-01.
[2025-10-24T17:08:31.275071] [INFO ] [REMOTE    ] AJG: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T17:08:31.347628] [INFO ] [REMOTE    ] AJG: Fetching primary data for 2025-08.
[2025-10-24T17:08:32.147700] [INFO ] [REMOTE    ] AL: Fetching primary data for 2025-02.
[2025-10-24T17:08:32.518590] [INFO ] [REMOTE    ] ALB: Incremental fetch complete for 2025-01 (1.97 seconds).
[2025-10-24T17:08:32.555976] [INFO ] [REMOTE    ] AJG: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T17:08:32.947702] [INFO ] [REMOTE    ] AJG: Fetching primary data for 2025-09.
[2025-10-24T17:08:33.614937] [INFO ] [REMOTE    ] AL: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T17:08:33.747690] [INFO ] [REMOTE    ] AL: Fetching primary data for 2025-03.
[2025-10-24T17:08:34.261737] [INFO ] [REMOTE    ] AJG: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T17:08:34.547705] [INFO ] [REMOTE    ] ALB: Fetching primary data for 2025-02.
[2025-10-24T17:08:34.966809] [INFO ] [REMOTE    ] AL: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T17:08:35.347639] [INFO ] [REMOTE    ] AL: Fetching primary data for 2025-04.
[2025-10-24T17:08:36.147722] [INFO ] [REMOTE    ] AKR: Fetching primary data for 2025-04.
[2025-10-24T17:08:36.383806] [INFO ] [REMOTE    ] ALB: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T17:08:36.831799] [INFO ] [REMOTE    ] AL: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T17:08:36.947634] [INFO ] [REMOTE    ] AL: Fetching primary data for 2025-05.
[2025-10-24T17:08:37.582723] [INFO ] [REMOTE    ] AKR: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T17:08:37.747631] [INFO ] [REMOTE    ] AJG: Fetching primary data for 2025-10.
[2025-10-24T17:08:38.333078] [INFO ] [REMOTE    ] AL: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T17:08:38.547696] [INFO ] [REMOTE    ] AL: Fetching primary data for 2025-06.
[2025-10-24T17:08:39.347671] [INFO ] [REMOTE    ] ALB: Fetching primary data for 2025-03.
[2025-10-24T17:08:39.635093] [INFO ] [REMOTE    ] AJG: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T17:08:39.643308] [INFO ] [REMOTE    ] AJG: Full fetch complete (68756 records).
[2025-10-24T17:08:39.643449] [DEBUG] [VALIDATOR ] AJG: Validating primary data.
[2025-10-24T17:08:40.034089] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present.
[2025-10-24T17:08:40.034380] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed.
[2025-10-24T17:08:40.035239] [INFO ] [MAIN      ] AJG: Fetched primary data is valid.
[2025-10-24T17:08:40.035369] [DEBUG] [LOCAL     ] AJG: Saving primary data.
[2025-10-24T17:08:40.036153] [FATAL] [LOCAL     ] AJG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:08:40.036240] [FATAL] [MAIN      ] AJG: Failed to save primary data.
[2025-10-24T17:08:40.036284] [WARN ] [MAIN      ] AJG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:08:40.036345] [INFO ] [LOCAL     ] AJG: Starting deletion of primary data.
[2025-10-24T17:08:40.036406] [DEBUG] [LOCAL     ] AJG: No primary data file found to delete.
[2025-10-24T17:08:40.036442] [INFO ] [LOCAL     ] AJG: Starting deletion of derivative data.
[2025-10-24T17:08:40.036739] [DEBUG] [LOCAL     ] AJG: Deleted derivative data file.
[2025-10-24T17:08:40.037584] [INFO ] [MAIN      ] Update Progress: 75/2366 symbols completed. AJG took 38.9s. Estimated remaining: 4h 23m 17s. Rate: 8.7 symbols/min
[2025-10-24T17:08:40.170300] [INFO ] [REMOTE    ] AKR: Fetching primary data for 2025-05.
[2025-10-24T17:08:40.210821] [INFO ] [REMOTE    ] AL: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T17:08:40.235531] [INFO ] [MAIN      ] ALC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:08:40.297756] [DEBUG] [LOCAL     ] ALC: Loaded 51590 existing records from primary storage.
[2025-10-24T17:08:40.298090] [INFO ] [MAIN      ] ALC: Loaded 51590 existing records.
[2025-10-24T17:08:40.473127] [WARN ] [MAIN      ] ALC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:08:40.473386] [INFO ] [MAIN      ] ALC: Wiping existing primary data before full refresh.
[2025-10-24T17:08:40.473433] [INFO ] [LOCAL     ] ALC: Starting deletion of primary data.
[2025-10-24T17:08:40.473878] [DEBUG] [LOCAL     ] ALC: Deleted primary data file.
[2025-10-24T17:08:40.473935] [INFO ] [MAIN      ] ALC: Starting full primary refresh.
[2025-10-24T17:08:40.831117] [INFO ] [REMOTE    ] ALC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:08:40.952762] [INFO ] [REMOTE    ] ALC: Fetching primary data for 2025-01.
[2025-10-24T17:08:40.967743] [INFO ] [REMOTE    ] ALB: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T17:08:41.652071] [INFO ] [REMOTE    ] AKR: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T17:08:41.747620] [INFO ] [REMOTE    ] AKR: Fetching primary data for 2025-06.
[2025-10-24T17:08:42.547628] [INFO ] [REMOTE    ] AL: Fetching primary data for 2025-07.
[2025-10-24T17:08:42.710024] [INFO ] [REMOTE    ] ALC: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T17:08:43.256100] [INFO ] [REMOTE    ] AKR: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T17:08:43.347612] [INFO ] [REMOTE    ] AKR: Fetching primary data for 2025-07.
[2025-10-24T17:08:43.726814] [INFO ] [REMOTE    ] AL: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T17:08:44.147732] [INFO ] [REMOTE    ] AL: Fetching primary data for 2025-08.
[2025-10-24T17:08:44.469384] [INFO ] [REMOTE    ] AKR: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T17:08:44.947720] [INFO ] [REMOTE    ] ALC: Fetching primary data for 2025-02.
[2025-10-24T17:08:45.237464] [INFO ] [REMOTE    ] AL: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T17:08:45.747685] [INFO ] [REMOTE    ] ALB: Fetching primary data for 2025-04.
[2025-10-24T17:08:46.511345] [INFO ] [REMOTE    ] ALC: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T17:08:46.547710] [INFO ] [REMOTE    ] ALC: Fetching primary data for 2025-03.
[2025-10-24T17:08:47.347690] [INFO ] [REMOTE    ] AL: Fetching primary data for 2025-09.
[2025-10-24T17:08:47.945433] [INFO ] [REMOTE    ] ALB: Incremental fetch complete for 2025-04 (2.20 seconds).
[2025-10-24T17:08:48.036425] [INFO ] [REMOTE    ] ALC: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T17:08:48.147691] [INFO ] [REMOTE    ] ALB: Fetching primary data for 2025-05.
[2025-10-24T17:08:48.952754] [INFO ] [REMOTE    ] AKR: Fetching primary data for 2025-08.
[2025-10-24T17:08:48.972506] [INFO ] [REMOTE    ] AL: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T17:08:49.747721] [INFO ] [REMOTE    ] AL: Fetching primary data for 2025-10.
[2025-10-24T17:08:50.058853] [INFO ] [REMOTE    ] ALB: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T17:08:50.547714] [INFO ] [REMOTE    ] ALC: Fetching primary data for 2025-04.
[2025-10-24T17:08:50.586832] [INFO ] [REMOTE    ] AKR: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T17:08:51.347635] [INFO ] [REMOTE    ] ALB: Fetching primary data for 2025-06.
[2025-10-24T17:08:51.742990] [INFO ] [REMOTE    ] AL: Incremental fetch complete for 2025-10 (2.00 seconds).
[2025-10-24T17:08:51.752185] [INFO ] [REMOTE    ] AL: Full fetch complete (63798 records).
[2025-10-24T17:08:51.752346] [DEBUG] [VALIDATOR ] AL: Validating primary data.
[2025-10-24T17:08:52.156767] [INFO ] [REMOTE    ] AKR: Fetching primary data for 2025-09.
[2025-10-24T17:08:52.156961] [DEBUG] [VALIDATOR ] AL: All expected trading days are present.
[2025-10-24T17:08:52.158329] [DEBUG] [VALIDATOR ] AL: Primary data validation passed.
[2025-10-24T17:08:52.159067] [INFO ] [MAIN      ] AL: Fetched primary data is valid.
[2025-10-24T17:08:52.159261] [DEBUG] [LOCAL     ] AL: Saving primary data.
[2025-10-24T17:08:52.159991] [FATAL] [LOCAL     ] AL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:08:52.160075] [FATAL] [MAIN      ] AL: Failed to save primary data.
[2025-10-24T17:08:52.160140] [WARN ] [MAIN      ] AL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:08:52.160209] [INFO ] [LOCAL     ] AL: Starting deletion of primary data.
[2025-10-24T17:08:52.160270] [DEBUG] [LOCAL     ] AL: No primary data file found to delete.
[2025-10-24T17:08:52.160306] [INFO ] [LOCAL     ] AL: Starting deletion of derivative data.
[2025-10-24T17:08:52.160484] [DEBUG] [LOCAL     ] AL: Deleted derivative data file.
[2025-10-24T17:08:52.161208] [INFO ] [MAIN      ] Update Progress: 76/2366 symbols completed. AL took 27.1s. Estimated remaining: 4h 25m 48s. Rate: 8.6 symbols/min
[2025-10-24T17:08:52.335775] [INFO ] [MAIN      ] ALE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:08:52.393031] [DEBUG] [LOCAL     ] ALE: Loaded 32276 existing records from primary storage.
[2025-10-24T17:08:52.394827] [INFO ] [MAIN      ] ALE: Loaded 32276 existing records.
[2025-10-24T17:08:52.394712] [INFO ] [REMOTE    ] ALC: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T17:08:52.585076] [WARN ] [MAIN      ] ALE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:08:52.585280] [INFO ] [MAIN      ] ALE: Wiping existing primary data before full refresh.
[2025-10-24T17:08:52.585325] [INFO ] [LOCAL     ] ALE: Starting deletion of primary data.
[2025-10-24T17:08:52.585686] [DEBUG] [LOCAL     ] ALE: Deleted primary data file.
[2025-10-24T17:08:52.585741] [INFO ] [MAIN      ] ALE: Starting full primary refresh.
[2025-10-24T17:08:52.946366] [INFO ] [REMOTE    ] ALE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:08:52.947601] [INFO ] [REMOTE    ] ALE: Fetching primary data for 2025-01.
[2025-10-24T17:08:53.313436] [INFO ] [REMOTE    ] ALB: Incremental fetch complete for 2025-06 (1.97 seconds).
[2025-10-24T17:08:53.499735] [INFO ] [REMOTE    ] AKR: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T17:08:53.747706] [INFO ] [REMOTE    ] ALB: Fetching primary data for 2025-07.
[2025-10-24T17:08:53.891975] [INFO ] [REMOTE    ] ALE: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T17:08:54.547735] [INFO ] [REMOTE    ] AKR: Fetching primary data for 2025-10.
[2025-10-24T17:08:55.347617] [INFO ] [REMOTE    ] ALC: Fetching primary data for 2025-05.
[2025-10-24T17:08:55.917701] [INFO ] [REMOTE    ] ALB: Incremental fetch complete for 2025-07 (2.17 seconds).
[2025-10-24T17:08:56.147665] [INFO ] [REMOTE    ] ALB: Fetching primary data for 2025-08.
[2025-10-24T17:08:56.554365] [INFO ] [REMOTE    ] AKR: Incremental fetch complete for 2025-10 (2.01 seconds).
[2025-10-24T17:08:56.564482] [INFO ] [REMOTE    ] AKR: Full fetch complete (65443 records).
[2025-10-24T17:08:56.564686] [DEBUG] [VALIDATOR ] AKR: Validating primary data.
[2025-10-24T17:08:56.954029] [INFO ] [REMOTE    ] ALE: Fetching primary data for 2025-02.
[2025-10-24T17:08:56.991698] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present.
[2025-10-24T17:08:56.992000] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed.
[2025-10-24T17:08:56.992812] [INFO ] [MAIN      ] AKR: Fetched primary data is valid.
[2025-10-24T17:08:56.992923] [DEBUG] [LOCAL     ] AKR: Saving primary data.
[2025-10-24T17:08:56.993666] [FATAL] [LOCAL     ] AKR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:08:56.993773] [FATAL] [MAIN      ] AKR: Failed to save primary data.
[2025-10-24T17:08:56.993921] [WARN ] [MAIN      ] AKR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:08:56.994031] [INFO ] [LOCAL     ] AKR: Starting deletion of primary data.
[2025-10-24T17:08:56.994098] [DEBUG] [LOCAL     ] AKR: No primary data file found to delete.
[2025-10-24T17:08:56.994138] [INFO ] [LOCAL     ] AKR: Starting deletion of derivative data.
[2025-10-24T17:08:56.994283] [DEBUG] [LOCAL     ] AKR: Deleted derivative data file.
[2025-10-24T17:08:56.995169] [INFO ] [MAIN      ] Update Progress: 77/2366 symbols completed. AKR took 40.7s. Estimated remaining: 4h 24m 37s. Rate: 8.7 symbols/min
[2025-10-24T17:08:57.044769] [INFO ] [REMOTE    ] ALC: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T17:08:57.747699] [INFO ] [REMOTE    ] ALC: Fetching primary data for 2025-06.
[2025-10-24T17:08:57.852120] [INFO ] [REMOTE    ] ALE: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T17:08:58.191059] [INFO ] [REMOTE    ] ALB: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T17:08:58.547715] [INFO ] [REMOTE    ] ALB: Fetching primary data for 2025-09.
[2025-10-24T17:08:59.251541] [INFO ] [REMOTE    ] ALC: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T17:08:59.347680] [INFO ] [REMOTE    ] ALE: Fetching primary data for 2025-03.
[2025-10-24T17:09:00.089145] [INFO ] [REMOTE    ] ALE: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T17:09:00.147610] [INFO ] [REMOTE    ] ALC: Fetching primary data for 2025-07.
[2025-10-24T17:09:00.445253] [INFO ] [REMOTE    ] ALB: Incremental fetch complete for 2025-09 (1.90 seconds).
[2025-10-24T17:09:00.947617] [INFO ] [REMOTE    ] ALB: Fetching primary data for 2025-10.
[2025-10-24T17:09:01.747733] [INFO ] [REMOTE    ] ALE: Fetching primary data for 2025-04.
[2025-10-24T17:09:02.504906] [INFO ] [REMOTE    ] ALC: Incremental fetch complete for 2025-07 (2.36 seconds).
[2025-10-24T17:09:02.547711] [INFO ] [REMOTE    ] ALC: Fetching primary data for 2025-08.
[2025-10-24T17:09:05.113744] [INFO ] [REMOTE    ] ALC: Incremental fetch complete for 2025-08 (2.57 seconds).
[2025-10-24T17:09:05.141008] [INFO ] [REMOTE    ] ALC: Fetching primary data for 2025-09.
[2025-10-24T17:09:05.143100] [INFO ] [REMOTE    ] ALE: Incremental fetch complete for 2025-04 (3.40 seconds).
[2025-10-24T17:09:05.151732] [INFO ] [REMOTE    ] ALE: Fetching primary data for 2025-05.
[2025-10-24T17:09:05.258541] [INFO ] [REMOTE    ] ALB: Incremental fetch complete for 2025-10 (4.31 seconds).
[2025-10-24T17:09:05.268827] [INFO ] [REMOTE    ] ALB: Full fetch complete (77104 records).
[2025-10-24T17:09:05.269038] [DEBUG] [VALIDATOR ] ALB: Validating primary data.
[2025-10-24T17:09:05.674748] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present.
[2025-10-24T17:09:05.674877] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed.
[2025-10-24T17:09:05.675777] [INFO ] [MAIN      ] ALB: Fetched primary data is valid.
[2025-10-24T17:09:05.675848] [DEBUG] [LOCAL     ] ALB: Saving primary data.
[2025-10-24T17:09:05.676509] [FATAL] [LOCAL     ] ALB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:09:05.676603] [FATAL] [MAIN      ] ALB: Failed to save primary data.
[2025-10-24T17:09:05.676673] [WARN ] [MAIN      ] ALB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:09:05.676731] [INFO ] [LOCAL     ] ALB: Starting deletion of primary data.
[2025-10-24T17:09:05.676790] [DEBUG] [LOCAL     ] ALB: No primary data file found to delete.
[2025-10-24T17:09:05.676830] [INFO ] [LOCAL     ] ALB: Starting deletion of derivative data.
[2025-10-24T17:09:05.677028] [DEBUG] [LOCAL     ] ALB: Deleted derivative data file.
[2025-10-24T17:09:05.677911] [INFO ] [MAIN      ] Update Progress: 78/2366 symbols completed. ALB took 36.0s. Estimated remaining: 4h 25m 22s. Rate: 8.6 symbols/min
[2025-10-24T17:09:06.706241] [INFO ] [REMOTE    ] ALE: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T17:09:06.712302] [INFO ] [REMOTE    ] ALE: Fetching primary data for 2025-06.
[2025-10-24T17:09:06.885907] [INFO ] [REMOTE    ] ALC: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T17:09:06.897242] [INFO ] [REMOTE    ] ALC: Fetching primary data for 2025-10.
[2025-10-24T17:09:07.889065] [INFO ] [REMOTE    ] ALE: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T17:09:07.894626] [INFO ] [REMOTE    ] ALE: Fetching primary data for 2025-07.
[2025-10-24T17:09:08.688179] [INFO ] [REMOTE    ] ALC: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T17:09:08.698814] [INFO ] [REMOTE    ] ALC: Full fetch complete (73565 records).
[2025-10-24T17:09:08.699072] [DEBUG] [VALIDATOR ] ALC: Validating primary data.
[2025-10-24T17:09:08.700514] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:09:08.700717] [FATAL] [MAIN      ] ALC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:09:08.700793] [WARN ] [MAIN      ] ALC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:09:08.700880] [INFO ] [LOCAL     ] ALC: Starting deletion of primary data.
[2025-10-24T17:09:08.701043] [DEBUG] [LOCAL     ] ALC: No primary data file found to delete.
[2025-10-24T17:09:08.701093] [INFO ] [LOCAL     ] ALC: Starting deletion of derivative data.
[2025-10-24T17:09:08.701318] [DEBUG] [LOCAL     ] ALC: Deleted derivative data file.
[2025-10-24T17:09:08.702428] [INFO ] [MAIN      ] Update Progress: 79/2366 symbols completed. ALC took 28.7s. Estimated remaining: 4h 23m 21s. Rate: 8.7 symbols/min
[2025-10-24T17:09:09.411574] [INFO ] [REMOTE    ] ALE: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T17:09:09.419812] [INFO ] [REMOTE    ] ALE: Fetching primary data for 2025-08.
[2025-10-24T17:09:10.602131] [INFO ] [REMOTE    ] ALE: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T17:09:10.612624] [INFO ] [REMOTE    ] ALE: Fetching primary data for 2025-09.
[2025-10-24T17:09:11.809496] [INFO ] [REMOTE    ] ALE: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T17:09:11.817768] [INFO ] [REMOTE    ] ALE: Fetching primary data for 2025-10.
[2025-10-24T17:09:13.006864] [INFO ] [REMOTE    ] ALE: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T17:09:13.013873] [INFO ] [REMOTE    ] ALE: Full fetch complete (44374 records).
[2025-10-24T17:09:13.013999] [DEBUG] [VALIDATOR ] ALE: Validating primary data.
[2025-10-24T17:09:13.391109] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present.
[2025-10-24T17:09:13.391240] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed.
[2025-10-24T17:09:13.391773] [INFO ] [MAIN      ] ALE: Fetched primary data is valid.
[2025-10-24T17:09:13.391834] [DEBUG] [LOCAL     ] ALE: Saving primary data.
[2025-10-24T17:09:13.392201] [FATAL] [LOCAL     ] ALE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:09:13.392321] [FATAL] [MAIN      ] ALE: Failed to save primary data.
[2025-10-24T17:09:13.392363] [WARN ] [MAIN      ] ALE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:09:13.392396] [INFO ] [LOCAL     ] ALE: Starting deletion of primary data.
[2025-10-24T17:09:13.392445] [DEBUG] [LOCAL     ] ALE: No primary data file found to delete.
[2025-10-24T17:09:13.392479] [INFO ] [LOCAL     ] ALE: Starting deletion of derivative data.
[2025-10-24T17:09:13.392745] [DEBUG] [LOCAL     ] ALE: Deleted derivative data file.
[2025-10-24T17:09:13.392836] [INFO ] [MAIN      ] Update Progress: 80/2366 symbols completed. ALE took 21.2s. Estimated remaining: 4h 22m 10s. Rate: 8.7 symbols/min
[2025-10-24T17:09:13.914006] [INFO ] [MAIN      ] ALEX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:09:13.978946] [INFO ] [MAIN      ] ALH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:09:14.100568] [DEBUG] [LOCAL     ] ALH: No existing data file found in primary storage.
[2025-10-24T17:09:14.100503] [INFO ] [MAIN      ] ALIT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:09:14.100794] [WARN ] [MAIN      ] ALH: No existing data found, performing full refresh instead.
[2025-10-24T17:09:14.103954] [INFO ] [MAIN      ] ALG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:09:14.100937] [INFO ] [MAIN      ] ALH: Wiping existing primary data before full refresh.
[2025-10-24T17:09:14.104193] [INFO ] [LOCAL     ] ALH: Starting deletion of primary data.
[2025-10-24T17:09:14.104739] [DEBUG] [LOCAL     ] ALH: No primary data file found to delete.
[2025-10-24T17:09:14.104813] [INFO ] [MAIN      ] ALH: Starting full primary refresh.
[2025-10-24T17:09:14.230812] [DEBUG] [LOCAL     ] ALG: Loaded 9765 existing records from primary storage.
[2025-10-24T17:09:14.283878] [INFO ] [MAIN      ] ALG: Loaded 9765 existing records.
[2025-10-24T17:09:14.419308] [DEBUG] [LOCAL     ] ALEX: Loaded 31013 existing records from primary storage.
[2025-10-24T17:09:14.458748] [INFO ] [MAIN      ] ALEX: Loaded 31013 existing records.
[2025-10-24T17:09:14.557212] [DEBUG] [LOCAL     ] ALIT: Loaded 53163 existing records from primary storage.
[2025-10-24T17:09:14.609032] [INFO ] [MAIN      ] ALIT: Loaded 53163 existing records.
[2025-10-24T17:09:14.797833] [WARN ] [MAIN      ] ALG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:09:14.830465] [INFO ] [MAIN      ] ALG: Wiping existing primary data before full refresh.
[2025-10-24T17:09:14.841441] [INFO ] [LOCAL     ] ALG: Starting deletion of primary data.
[2025-10-24T17:09:14.855197] [DEBUG] [LOCAL     ] ALG: Deleted primary data file.
[2025-10-24T17:09:14.903158] [INFO ] [MAIN      ] ALG: Starting full primary refresh.
[2025-10-24T17:09:15.094679] [WARN ] [MAIN      ] ALEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:09:15.115438] [INFO ] [REMOTE    ] ALH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:09:15.124013] [INFO ] [MAIN      ] ALEX: Wiping existing primary data before full refresh.
[2025-10-24T17:09:15.133852] [INFO ] [REMOTE    ] ALH: Fetching primary data for 2025-01.
[2025-10-24T17:09:15.118459] [WARN ] [MAIN      ] ALIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:09:15.153290] [INFO ] [LOCAL     ] ALEX: Starting deletion of primary data.
[2025-10-24T17:09:15.185345] [INFO ] [MAIN      ] ALIT: Wiping existing primary data before full refresh.
[2025-10-24T17:09:15.185435] [INFO ] [LOCAL     ] ALIT: Starting deletion of primary data.
[2025-10-24T17:09:15.191313] [DEBUG] [LOCAL     ] ALEX: Deleted primary data file.
[2025-10-24T17:09:15.191431] [DEBUG] [LOCAL     ] ALIT: Deleted primary data file.
[2025-10-24T17:09:15.196737] [INFO ] [MAIN      ] ALIT: Starting full primary refresh.
[2025-10-24T17:09:15.191554] [INFO ] [MAIN      ] ALEX: Starting full primary refresh.
[2025-10-24T17:09:15.463127] [DEBUG] [REMOTE    ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:09:15.560139] [WARN ] [REMOTE    ] ALH: No data returned for month 2025-01
[2025-10-24T17:09:15.570866] [FATAL] [REMOTE    ] ALH: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:09:15.605537] [FATAL] [MAIN      ] ALH: Failed to fetch primary data.
[2025-10-24T17:09:15.756133] [WARN ] [MAIN      ] ALH: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:09:15.756365] [INFO ] [LOCAL     ] ALH: Starting deletion of primary data.
[2025-10-24T17:09:15.788277] [DEBUG] [LOCAL     ] ALH: No primary data file found to delete.
[2025-10-24T17:09:15.912626] [INFO ] [LOCAL     ] ALH: Starting deletion of derivative data.
[2025-10-24T17:09:16.025884] [INFO ] [REMOTE    ] ALG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:09:16.031236] [DEBUG] [LOCAL     ] ALH: No derivative data file found to delete.
[2025-10-24T17:09:16.031673] [INFO ] [MAIN      ] Update Progress: 81/2366 symbols completed. ALH took 2.6s. Estimated remaining: 4h 20m 4s. Rate: 8.8 symbols/min
[2025-10-24T17:09:16.031497] [INFO ] [REMOTE    ] ALG: Fetching primary data for 2025-01.
[2025-10-24T17:09:16.277702] [INFO ] [REMOTE    ] ALIT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:09:16.320330] [INFO ] [REMOTE    ] ALIT: Fetching primary data for 2025-01.
[2025-10-24T17:09:16.333125] [INFO ] [REMOTE    ] ALEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:09:16.334604] [INFO ] [REMOTE    ] ALEX: Fetching primary data for 2025-01.
[2025-10-24T17:09:16.417079] [INFO ] [MAIN      ] ALK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:09:16.475193] [DEBUG] [LOCAL     ] ALK: Loaded 53477 existing records from primary storage.
[2025-10-24T17:09:16.475533] [INFO ] [MAIN      ] ALK: Loaded 53477 existing records.
[2025-10-24T17:09:16.673415] [WARN ] [MAIN      ] ALK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:09:16.673639] [INFO ] [MAIN      ] ALK: Wiping existing primary data before full refresh.
[2025-10-24T17:09:16.673721] [INFO ] [LOCAL     ] ALK: Starting deletion of primary data.
[2025-10-24T17:09:16.674791] [DEBUG] [LOCAL     ] ALK: Deleted primary data file.
[2025-10-24T17:09:16.674852] [INFO ] [MAIN      ] ALK: Starting full primary refresh.
[2025-10-24T17:09:16.995955] [INFO ] [REMOTE    ] ALG: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T17:09:17.015236] [INFO ] [REMOTE    ] ALG: Fetching primary data for 2025-02.
[2025-10-24T17:09:17.082239] [INFO ] [REMOTE    ] ALK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:09:17.082533] [INFO ] [REMOTE    ] ALK: Fetching primary data for 2025-01.
[2025-10-24T17:09:17.330524] [INFO ] [REMOTE    ] ALEX: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T17:09:17.336397] [INFO ] [REMOTE    ] ALEX: Fetching primary data for 2025-02.
[2025-10-24T17:09:17.835567] [INFO ] [REMOTE    ] ALG: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T17:09:17.838404] [INFO ] [REMOTE    ] ALG: Fetching primary data for 2025-03.
[2025-10-24T17:09:18.018009] [INFO ] [REMOTE    ] ALIT: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T17:09:18.028544] [INFO ] [REMOTE    ] ALIT: Fetching primary data for 2025-02.
[2025-10-24T17:09:18.055067] [INFO ] [REMOTE    ] ALEX: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T17:09:18.060268] [INFO ] [REMOTE    ] ALEX: Fetching primary data for 2025-03.
[2025-10-24T17:09:18.574244] [INFO ] [REMOTE    ] ALK: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T17:09:18.584386] [INFO ] [REMOTE    ] ALK: Fetching primary data for 2025-02.
[2025-10-24T17:09:18.747803] [INFO ] [REMOTE    ] ALG: Incremental fetch complete for 2025-03 (0.91 seconds).
[2025-10-24T17:09:18.751278] [INFO ] [REMOTE    ] ALG: Fetching primary data for 2025-04.
[2025-10-24T17:09:19.057417] [INFO ] [REMOTE    ] ALEX: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T17:09:19.347705] [INFO ] [REMOTE    ] ALEX: Fetching primary data for 2025-04.
[2025-10-24T17:09:19.418223] [INFO ] [REMOTE    ] ALIT: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T17:09:19.443608] [INFO ] [REMOTE    ] ALG: Incremental fetch complete for 2025-04 (0.69 seconds).
[2025-10-24T17:09:20.162401] [INFO ] [REMOTE    ] ALIT: Fetching primary data for 2025-03.
[2025-10-24T17:09:20.182155] [INFO ] [REMOTE    ] ALK: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T17:09:20.665860] [INFO ] [REMOTE    ] ALEX: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T17:09:20.947637] [INFO ] [REMOTE    ] ALG: Fetching primary data for 2025-05.
[2025-10-24T17:09:21.545364] [INFO ] [REMOTE    ] ALIT: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T17:09:21.747683] [INFO ] [REMOTE    ] ALK: Fetching primary data for 2025-03.
[2025-10-24T17:09:21.781857] [INFO ] [REMOTE    ] ALG: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T17:09:22.547711] [INFO ] [REMOTE    ] ALG: Fetching primary data for 2025-06.
[2025-10-24T17:09:23.347722] [INFO ] [REMOTE    ] ALEX: Fetching primary data for 2025-05.
[2025-10-24T17:09:23.469137] [INFO ] [REMOTE    ] ALG: Incremental fetch complete for 2025-06 (0.92 seconds).
[2025-10-24T17:09:23.549409] [INFO ] [REMOTE    ] ALK: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T17:09:24.147631] [INFO ] [REMOTE    ] ALG: Fetching primary data for 2025-07.
[2025-10-24T17:09:24.305018] [INFO ] [REMOTE    ] ALEX: Incremental fetch complete for 2025-05 (0.96 seconds).
[2025-10-24T17:09:24.873889] [INFO ] [REMOTE    ] ALG: Incremental fetch complete for 2025-07 (0.73 seconds).
[2025-10-24T17:09:24.947623] [INFO ] [REMOTE    ] ALK: Fetching primary data for 2025-04.
[2025-10-24T17:09:25.747635] [INFO ] [REMOTE    ] ALIT: Fetching primary data for 2025-04.
[2025-10-24T17:09:26.547615] [INFO ] [REMOTE    ] ALG: Fetching primary data for 2025-08.
[2025-10-24T17:09:26.831228] [INFO ] [REMOTE    ] ALK: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T17:09:27.181045] [INFO ] [REMOTE    ] ALIT: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T17:09:27.202492] [INFO ] [REMOTE    ] ALG: Incremental fetch complete for 2025-08 (0.65 seconds).
[2025-10-24T17:09:27.347697] [INFO ] [REMOTE    ] ALIT: Fetching primary data for 2025-05.
[2025-10-24T17:09:28.147708] [INFO ] [REMOTE    ] ALEX: Fetching primary data for 2025-06.
[2025-10-24T17:09:28.947702] [INFO ] [REMOTE    ] ALK: Fetching primary data for 2025-05.
[2025-10-24T17:09:29.167878] [INFO ] [REMOTE    ] ALEX: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T17:09:29.389163] [INFO ] [REMOTE    ] ALIT: Incremental fetch complete for 2025-05 (2.04 seconds).
[2025-10-24T17:09:29.747676] [INFO ] [REMOTE    ] ALEX: Fetching primary data for 2025-07.
[2025-10-24T17:09:30.547697] [INFO ] [REMOTE    ] ALIT: Fetching primary data for 2025-06.
[2025-10-24T17:09:30.804240] [INFO ] [REMOTE    ] ALEX: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T17:09:30.840326] [INFO ] [REMOTE    ] ALK: Incremental fetch complete for 2025-05 (1.89 seconds).
[2025-10-24T17:09:31.347633] [INFO ] [REMOTE    ] ALEX: Fetching primary data for 2025-08.
[2025-10-24T17:09:32.135297] [INFO ] [REMOTE    ] ALIT: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T17:09:32.147599] [INFO ] [REMOTE    ] ALIT: Fetching primary data for 2025-07.
[2025-10-24T17:09:32.340434] [INFO ] [REMOTE    ] ALEX: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T17:09:32.947668] [INFO ] [REMOTE    ] ALEX: Fetching primary data for 2025-09.
[2025-10-24T17:09:33.644106] [INFO ] [REMOTE    ] ALIT: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T17:09:33.747613] [INFO ] [REMOTE    ] ALIT: Fetching primary data for 2025-08.
[2025-10-24T17:09:34.273118] [INFO ] [REMOTE    ] ALEX: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T17:09:34.547704] [INFO ] [REMOTE    ] ALEX: Fetching primary data for 2025-10.
[2025-10-24T17:09:35.347695] [INFO ] [REMOTE    ] ALK: Fetching primary data for 2025-06.
[2025-10-24T17:09:35.473743] [INFO ] [REMOTE    ] ALEX: Incremental fetch complete for 2025-10 (0.93 seconds).
[2025-10-24T17:09:35.480866] [INFO ] [REMOTE    ] ALEX: Full fetch complete (44539 records).
[2025-10-24T17:09:35.480998] [DEBUG] [VALIDATOR ] ALEX: Validating primary data.
[2025-10-24T17:09:35.794085] [INFO ] [REMOTE    ] ALIT: Incremental fetch complete for 2025-08 (2.05 seconds).
[2025-10-24T17:09:35.903605] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present.
[2025-10-24T17:09:35.903714] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed.
[2025-10-24T17:09:35.904267] [INFO ] [MAIN      ] ALEX: Fetched primary data is valid.
[2025-10-24T17:09:35.904330] [DEBUG] [LOCAL     ] ALEX: Saving primary data.
[2025-10-24T17:09:35.904798] [FATAL] [LOCAL     ] ALEX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:09:35.904889] [FATAL] [MAIN      ] ALEX: Failed to save primary data.
[2025-10-24T17:09:35.904936] [WARN ] [MAIN      ] ALEX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:09:35.905005] [INFO ] [LOCAL     ] ALEX: Starting deletion of primary data.
[2025-10-24T17:09:35.905081] [DEBUG] [LOCAL     ] ALEX: No primary data file found to delete.
[2025-10-24T17:09:35.905118] [INFO ] [LOCAL     ] ALEX: Starting deletion of derivative data.
[2025-10-24T17:09:35.905407] [DEBUG] [LOCAL     ] ALEX: Deleted derivative data file.
[2025-10-24T17:09:35.905501] [INFO ] [MAIN      ] Update Progress: 82/2366 symbols completed. ALEX took 22.5s. Estimated remaining: 4h 26m 0s. Rate: 8.6 symbols/min
[2025-10-24T17:09:36.070915] [INFO ] [MAIN      ] ALL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:09:36.120469] [DEBUG] [LOCAL     ] ALL: Loaded 49959 existing records from primary storage.
[2025-10-24T17:09:36.120783] [INFO ] [MAIN      ] ALL: Loaded 49959 existing records.
[2025-10-24T17:09:36.152838] [INFO ] [REMOTE    ] ALIT: Fetching primary data for 2025-09.
[2025-10-24T17:09:36.300659] [WARN ] [MAIN      ] ALL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:09:36.300863] [INFO ] [MAIN      ] ALL: Wiping existing primary data before full refresh.
[2025-10-24T17:09:36.300911] [INFO ] [LOCAL     ] ALL: Starting deletion of primary data.
[2025-10-24T17:09:36.301787] [DEBUG] [LOCAL     ] ALL: Deleted primary data file.
[2025-10-24T17:09:36.301847] [INFO ] [MAIN      ] ALL: Starting full primary refresh.
[2025-10-24T17:09:36.657954] [INFO ] [REMOTE    ] ALL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:09:36.881372] [INFO ] [REMOTE    ] ALK: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T17:09:36.947598] [INFO ] [REMOTE    ] ALK: Fetching primary data for 2025-07.
[2025-10-24T17:09:37.754265] [INFO ] [REMOTE    ] ALG: Fetching primary data for 2025-09.
[2025-10-24T17:09:37.773270] [INFO ] [REMOTE    ] ALIT: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T17:09:38.547696] [INFO ] [REMOTE    ] ALIT: Fetching primary data for 2025-10.
[2025-10-24T17:09:38.615677] [INFO ] [REMOTE    ] ALG: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T17:09:38.845147] [INFO ] [REMOTE    ] ALK: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T17:09:39.347628] [INFO ] [REMOTE    ] ALK: Fetching primary data for 2025-08.
[2025-10-24T17:09:40.156701] [INFO ] [REMOTE    ] ALG: Fetching primary data for 2025-10.
[2025-10-24T17:09:40.161488] [INFO ] [REMOTE    ] ALIT: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T17:09:40.171085] [INFO ] [REMOTE    ] ALIT: Full fetch complete (76626 records).
[2025-10-24T17:09:40.171196] [DEBUG] [VALIDATOR ] ALIT: Validating primary data.
[2025-10-24T17:09:40.556844] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present.
[2025-10-24T17:09:40.556921] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed.
[2025-10-24T17:09:40.557770] [INFO ] [MAIN      ] ALIT: Fetched primary data is valid.
[2025-10-24T17:09:40.557835] [DEBUG] [LOCAL     ] ALIT: Saving primary data.
[2025-10-24T17:09:40.558390] [FATAL] [LOCAL     ] ALIT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:09:40.558499] [FATAL] [MAIN      ] ALIT: Failed to save primary data.
[2025-10-24T17:09:40.558542] [WARN ] [MAIN      ] ALIT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:09:40.558578] [INFO ] [LOCAL     ] ALIT: Starting deletion of primary data.
[2025-10-24T17:09:40.558632] [DEBUG] [LOCAL     ] ALIT: No primary data file found to delete.
[2025-10-24T17:09:40.558706] [INFO ] [LOCAL     ] ALIT: Starting deletion of derivative data.
[2025-10-24T17:09:40.558908] [DEBUG] [LOCAL     ] ALIT: Deleted derivative data file.
[2025-10-24T17:09:40.559585] [INFO ] [MAIN      ] Update Progress: 83/2366 symbols completed. ALIT took 27.2s. Estimated remaining: 4h 24m 49s. Rate: 8.6 symbols/min
[2025-10-24T17:09:40.728436] [INFO ] [MAIN      ] ALLE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:09:40.773972] [DEBUG] [LOCAL     ] ALLE: Loaded 44288 existing records from primary storage.
[2025-10-24T17:09:40.774245] [INFO ] [MAIN      ] ALLE: Loaded 44288 existing records.
[2025-10-24T17:09:40.953391] [INFO ] [REMOTE    ] ALL: Fetching primary data for 2025-01.
[2025-10-24T17:09:40.963941] [WARN ] [MAIN      ] ALLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:09:40.965454] [INFO ] [REMOTE    ] ALG: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T17:09:40.965226] [INFO ] [MAIN      ] ALLE: Wiping existing primary data before full refresh.
[2025-10-24T17:09:40.967223] [INFO ] [LOCAL     ] ALLE: Starting deletion of primary data.
[2025-10-24T17:09:40.967774] [INFO ] [REMOTE    ] ALG: Full fetch complete (15198 records).
[2025-10-24T17:09:40.967843] [DEBUG] [VALIDATOR ] ALG: Validating primary data.
[2025-10-24T17:09:40.981605] [DEBUG] [LOCAL     ] ALLE: Deleted primary data file.
[2025-10-24T17:09:40.988710] [INFO ] [MAIN      ] ALLE: Starting full primary refresh.
[2025-10-24T17:09:41.695814] [INFO ] [REMOTE    ] ALLE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:09:41.704705] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present.
[2025-10-24T17:09:41.705059] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed.
[2025-10-24T17:09:41.705308] [INFO ] [MAIN      ] ALG: Fetched primary data is valid.
[2025-10-24T17:09:41.705380] [DEBUG] [LOCAL     ] ALG: Saving primary data.
[2025-10-24T17:09:41.705809] [FATAL] [LOCAL     ] ALG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:09:41.705915] [FATAL] [MAIN      ] ALG: Failed to save primary data.
[2025-10-24T17:09:41.706079] [WARN ] [MAIN      ] ALG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:09:41.706153] [INFO ] [LOCAL     ] ALG: Starting deletion of primary data.
[2025-10-24T17:09:41.706293] [DEBUG] [LOCAL     ] ALG: No primary data file found to delete.
[2025-10-24T17:09:41.706383] [INFO ] [LOCAL     ] ALG: Starting deletion of derivative data.
[2025-10-24T17:09:41.706584] [DEBUG] [LOCAL     ] ALG: Deleted derivative data file.
[2025-10-24T17:09:41.706700] [INFO ] [MAIN      ] Update Progress: 84/2366 symbols completed. ALG took 28.3s. Estimated remaining: 4h 22m 4s. Rate: 8.7 symbols/min
[2025-10-24T17:09:41.755593] [INFO ] [REMOTE    ] ALLE: Fetching primary data for 2025-01.
[2025-10-24T17:09:41.826539] [INFO ] [REMOTE    ] ALK: Incremental fetch complete for 2025-08 (2.48 seconds).
[2025-10-24T17:09:41.921546] [INFO ] [MAIN      ] ALLY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:09:41.974198] [DEBUG] [LOCAL     ] ALLY: Loaded 53610 existing records from primary storage.
[2025-10-24T17:09:41.974503] [INFO ] [MAIN      ] ALLY: Loaded 53610 existing records.
[2025-10-24T17:09:42.154927] [WARN ] [MAIN      ] ALLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:09:42.155142] [INFO ] [MAIN      ] ALLY: Wiping existing primary data before full refresh.
[2025-10-24T17:09:42.155206] [INFO ] [LOCAL     ] ALLY: Starting deletion of primary data.
[2025-10-24T17:09:42.156155] [DEBUG] [LOCAL     ] ALLY: Deleted primary data file.
[2025-10-24T17:09:42.156235] [INFO ] [MAIN      ] ALLY: Starting full primary refresh.
[2025-10-24T17:09:42.509491] [INFO ] [REMOTE    ] ALLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:09:42.547601] [INFO ] [REMOTE    ] ALLY: Fetching primary data for 2025-01.
[2025-10-24T17:09:42.675000] [INFO ] [REMOTE    ] ALL: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T17:09:43.347688] [INFO ] [REMOTE    ] ALK: Fetching primary data for 2025-09.
[2025-10-24T17:09:43.423773] [INFO ] [REMOTE    ] ALLE: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T17:09:44.147687] [INFO ] [REMOTE    ] ALL: Fetching primary data for 2025-02.
[2025-10-24T17:09:44.396832] [INFO ] [REMOTE    ] ALLY: Incremental fetch complete for 2025-01 (1.85 seconds).
[2025-10-24T17:09:44.947709] [INFO ] [REMOTE    ] ALLY: Fetching primary data for 2025-02.
[2025-10-24T17:09:44.987060] [INFO ] [REMOTE    ] ALK: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T17:09:45.529219] [INFO ] [REMOTE    ] ALL: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T17:09:45.747638] [INFO ] [REMOTE    ] ALK: Fetching primary data for 2025-10.
[2025-10-24T17:09:46.547623] [INFO ] [REMOTE    ] ALL: Fetching primary data for 2025-03.
[2025-10-24T17:09:46.691814] [INFO ] [REMOTE    ] ALLY: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T17:09:47.315886] [INFO ] [REMOTE    ] ALK: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T17:09:47.325492] [INFO ] [REMOTE    ] ALK: Full fetch complete (77039 records).
[2025-10-24T17:09:47.325609] [DEBUG] [VALIDATOR ] ALK: Validating primary data.
[2025-10-24T17:09:47.357037] [INFO ] [REMOTE    ] ALLE: Fetching primary data for 2025-02.
[2025-10-24T17:09:47.718911] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present.
[2025-10-24T17:09:47.718999] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed.
[2025-10-24T17:09:47.719818] [INFO ] [MAIN      ] ALK: Fetched primary data is valid.
[2025-10-24T17:09:47.719920] [DEBUG] [LOCAL     ] ALK: Saving primary data.
[2025-10-24T17:09:47.720691] [FATAL] [LOCAL     ] ALK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:09:47.720786] [FATAL] [MAIN      ] ALK: Failed to save primary data.
[2025-10-24T17:09:47.720829] [WARN ] [MAIN      ] ALK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:09:47.720893] [INFO ] [LOCAL     ] ALK: Starting deletion of primary data.
[2025-10-24T17:09:47.720954] [DEBUG] [LOCAL     ] ALK: No primary data file found to delete.
[2025-10-24T17:09:47.720991] [INFO ] [LOCAL     ] ALK: Starting deletion of derivative data.
[2025-10-24T17:09:47.721144] [DEBUG] [LOCAL     ] ALK: Deleted derivative data file.
[2025-10-24T17:09:47.722312] [INFO ] [MAIN      ] Update Progress: 85/2366 symbols completed. ALK took 31.7s. Estimated remaining: 4h 21m 34s. Rate: 8.7 symbols/min
[2025-10-24T17:09:47.892785] [INFO ] [MAIN      ] ALSN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:09:47.937040] [DEBUG] [LOCAL     ] ALSN: Loaded 43535 existing records from primary storage.
[2025-10-24T17:09:47.937319] [INFO ] [MAIN      ] ALSN: Loaded 43535 existing records.
[2025-10-24T17:09:48.115145] [WARN ] [MAIN      ] ALSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:09:48.115512] [INFO ] [MAIN      ] ALSN: Wiping existing primary data before full refresh.
[2025-10-24T17:09:48.115590] [INFO ] [LOCAL     ] ALSN: Starting deletion of primary data.
[2025-10-24T17:09:48.115987] [DEBUG] [LOCAL     ] ALSN: Deleted primary data file.
[2025-10-24T17:09:48.116116] [INFO ] [MAIN      ] ALSN: Starting full primary refresh.
[2025-10-24T17:09:48.158341] [INFO ] [REMOTE    ] ALLY: Fetching primary data for 2025-03.
[2025-10-24T17:09:48.487040] [INFO ] [REMOTE    ] ALSN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:09:48.522323] [INFO ] [REMOTE    ] ALL: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T17:09:48.684958] [INFO ] [REMOTE    ] ALLE: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T17:09:48.947786] [INFO ] [REMOTE    ] ALL: Fetching primary data for 2025-04.
[2025-10-24T17:09:49.694073] [INFO ] [REMOTE    ] ALLY: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T17:09:49.747624] [INFO ] [REMOTE    ] ALLY: Fetching primary data for 2025-04.
[2025-10-24T17:09:50.547742] [INFO ] [REMOTE    ] ALSN: Fetching primary data for 2025-01.
[2025-10-24T17:09:50.779179] [INFO ] [REMOTE    ] ALL: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T17:09:51.174322] [INFO ] [REMOTE    ] ALLY: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T17:09:51.347614] [INFO ] [REMOTE    ] ALL: Fetching primary data for 2025-05.
[2025-10-24T17:09:52.014864] [INFO ] [REMOTE    ] ALSN: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T17:09:52.147674] [INFO ] [REMOTE    ] ALLY: Fetching primary data for 2025-05.
[2025-10-24T17:09:52.947727] [INFO ] [REMOTE    ] ALSN: Fetching primary data for 2025-02.
[2025-10-24T17:09:52.991127] [INFO ] [REMOTE    ] ALL: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T17:09:53.747747] [INFO ] [REMOTE    ] ALL: Fetching primary data for 2025-06.
[2025-10-24T17:09:53.855834] [INFO ] [REMOTE    ] ALLY: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T17:09:54.372139] [INFO ] [REMOTE    ] ALSN: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T17:09:54.547736] [INFO ] [REMOTE    ] ALSN: Fetching primary data for 2025-03.
[2025-10-24T17:09:54.980301] [INFO ] [REMOTE    ] ALL: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T17:09:55.347702] [INFO ] [REMOTE    ] ALL: Fetching primary data for 2025-07.
[2025-10-24T17:09:55.732019] [INFO ] [REMOTE    ] ALSN: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T17:09:56.147728] [INFO ] [REMOTE    ] ALSN: Fetching primary data for 2025-04.
[2025-10-24T17:09:56.947690] [INFO ] [REMOTE    ] ALLE: Fetching primary data for 2025-03.
[2025-10-24T17:09:57.072432] [INFO ] [REMOTE    ] ALL: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T17:09:57.313731] [INFO ] [REMOTE    ] ALSN: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T17:09:57.747765] [INFO ] [REMOTE    ] ALL: Fetching primary data for 2025-08.
[2025-10-24T17:09:58.362988] [INFO ] [REMOTE    ] ALLE: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T17:09:58.547677] [INFO ] [REMOTE    ] ALLE: Fetching primary data for 2025-04.
[2025-10-24T17:09:59.331430] [INFO ] [REMOTE    ] ALL: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T17:09:59.347592] [INFO ] [REMOTE    ] ALL: Fetching primary data for 2025-09.
[2025-10-24T17:10:00.059808] [INFO ] [REMOTE    ] ALLE: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T17:10:00.147615] [INFO ] [REMOTE    ] ALLE: Fetching primary data for 2025-05.
[2025-10-24T17:10:00.947623] [INFO ] [REMOTE    ] ALSN: Fetching primary data for 2025-05.
[2025-10-24T17:10:01.272246] [INFO ] [REMOTE    ] ALL: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T17:10:01.747719] [INFO ] [REMOTE    ] ALL: Fetching primary data for 2025-10.
[2025-10-24T17:10:02.049455] [INFO ] [REMOTE    ] ALLE: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T17:10:02.547724] [INFO ] [REMOTE    ] ALLE: Fetching primary data for 2025-06.
[2025-10-24T17:10:03.347628] [INFO ] [REMOTE    ] ALLY: Fetching primary data for 2025-06.
[2025-10-24T17:10:03.771160] [INFO ] [REMOTE    ] ALSN: Incremental fetch complete for 2025-05 (2.82 seconds).
[2025-10-24T17:10:04.147737] [INFO ] [REMOTE    ] ALSN: Fetching primary data for 2025-06.
[2025-10-24T17:10:04.915193] [INFO ] [REMOTE    ] ALLE: Incremental fetch complete for 2025-06 (2.37 seconds).
[2025-10-24T17:10:04.947608] [INFO ] [REMOTE    ] ALLE: Fetching primary data for 2025-07.
[2025-10-24T17:10:05.229018] [INFO ] [REMOTE    ] ALL: Incremental fetch complete for 2025-10 (3.48 seconds).
[2025-10-24T17:10:05.238150] [INFO ] [REMOTE    ] ALL: Full fetch complete (72369 records).
[2025-10-24T17:10:05.238319] [DEBUG] [VALIDATOR ] ALL: Validating primary data.
[2025-10-24T17:10:05.654818] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present.
[2025-10-24T17:10:05.654982] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed.
[2025-10-24T17:10:05.655936] [INFO ] [MAIN      ] ALL: Fetched primary data is valid.
[2025-10-24T17:10:05.656020] [DEBUG] [LOCAL     ] ALL: Saving primary data.
[2025-10-24T17:10:05.656980] [FATAL] [LOCAL     ] ALL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:10:05.657148] [FATAL] [MAIN      ] ALL: Failed to save primary data.
[2025-10-24T17:10:05.657216] [WARN ] [MAIN      ] ALL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:10:05.657286] [INFO ] [LOCAL     ] ALL: Starting deletion of primary data.
[2025-10-24T17:10:05.657352] [DEBUG] [LOCAL     ] ALL: No primary data file found to delete.
[2025-10-24T17:10:05.657392] [INFO ] [LOCAL     ] ALL: Starting deletion of derivative data.
[2025-10-24T17:10:05.657581] [DEBUG] [LOCAL     ] ALL: Deleted derivative data file.
[2025-10-24T17:10:05.658761] [INFO ] [MAIN      ] Update Progress: 86/2366 symbols completed. ALL took 29.8s. Estimated remaining: 4h 26m 20s. Rate: 8.6 symbols/min
[2025-10-24T17:10:05.797282] [INFO ] [REMOTE    ] ALSN: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T17:10:05.855996] [INFO ] [REMOTE    ] ALSN: Fetching primary data for 2025-07.
[2025-10-24T17:10:05.875031] [INFO ] [MAIN      ] ALTG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:10:05.900130] [DEBUG] [LOCAL     ] ALTG: Loaded 23210 existing records from primary storage.
[2025-10-24T17:10:05.900398] [INFO ] [MAIN      ] ALTG: Loaded 23210 existing records.
[2025-10-24T17:10:06.088419] [WARN ] [MAIN      ] ALTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:10:06.088584] [INFO ] [MAIN      ] ALTG: Wiping existing primary data before full refresh.
[2025-10-24T17:10:06.088630] [INFO ] [LOCAL     ] ALTG: Starting deletion of primary data.
[2025-10-24T17:10:06.089065] [DEBUG] [LOCAL     ] ALTG: Deleted primary data file.
[2025-10-24T17:10:06.089121] [INFO ] [MAIN      ] ALTG: Starting full primary refresh.
[2025-10-24T17:10:06.459172] [INFO ] [REMOTE    ] ALTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:10:06.547622] [INFO ] [REMOTE    ] ALTG: Fetching primary data for 2025-01.
[2025-10-24T17:10:06.577088] [INFO ] [REMOTE    ] ALLY: Incremental fetch complete for 2025-06 (3.23 seconds).
[2025-10-24T17:10:07.358296] [INFO ] [REMOTE    ] ALLY: Fetching primary data for 2025-07.
[2025-10-24T17:10:07.364004] [INFO ] [REMOTE    ] ALLE: Incremental fetch complete for 2025-07 (2.42 seconds).
[2025-10-24T17:10:07.703801] [INFO ] [REMOTE    ] ALSN: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T17:10:08.147696] [INFO ] [REMOTE    ] ALLE: Fetching primary data for 2025-08.
[2025-10-24T17:10:08.419074] [INFO ] [REMOTE    ] ALTG: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T17:10:08.947676] [INFO ] [REMOTE    ] ALTG: Fetching primary data for 2025-02.
[2025-10-24T17:10:09.056856] [INFO ] [REMOTE    ] ALLY: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T17:10:09.747629] [INFO ] [REMOTE    ] ALLY: Fetching primary data for 2025-08.
[2025-10-24T17:10:09.942838] [INFO ] [REMOTE    ] ALTG: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T17:10:10.547632] [INFO ] [REMOTE    ] ALTG: Fetching primary data for 2025-03.
[2025-10-24T17:10:11.027691] [INFO ] [REMOTE    ] ALLE: Incremental fetch complete for 2025-08 (2.88 seconds).
[2025-10-24T17:10:11.266001] [INFO ] [REMOTE    ] ALLY: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T17:10:11.347634] [INFO ] [REMOTE    ] ALLY: Fetching primary data for 2025-09.
[2025-10-24T17:10:11.483154] [INFO ] [REMOTE    ] ALTG: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T17:10:12.147734] [INFO ] [REMOTE    ] ALTG: Fetching primary data for 2025-04.
[2025-10-24T17:10:12.952567] [INFO ] [REMOTE    ] ALSN: Fetching primary data for 2025-08.
[2025-10-24T17:10:12.962002] [INFO ] [REMOTE    ] ALLY: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T17:10:13.190139] [INFO ] [REMOTE    ] ALTG: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T17:10:13.747748] [INFO ] [REMOTE    ] ALLE: Fetching primary data for 2025-09.
[2025-10-24T17:10:14.411464] [INFO ] [REMOTE    ] ALSN: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T17:10:14.547693] [INFO ] [REMOTE    ] ALSN: Fetching primary data for 2025-09.
[2025-10-24T17:10:15.347685] [INFO ] [REMOTE    ] ALLY: Fetching primary data for 2025-10.
[2025-10-24T17:10:15.731156] [INFO ] [REMOTE    ] ALLE: Incremental fetch complete for 2025-09 (1.98 seconds).
[2025-10-24T17:10:15.829415] [INFO ] [REMOTE    ] ALSN: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T17:10:16.147696] [INFO ] [REMOTE    ] ALSN: Fetching primary data for 2025-10.
[2025-10-24T17:10:16.947629] [INFO ] [REMOTE    ] ALLE: Fetching primary data for 2025-10.
[2025-10-24T17:10:17.314826] [INFO ] [REMOTE    ] ALLY: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T17:10:17.324971] [INFO ] [REMOTE    ] ALLY: Full fetch complete (76867 records).
[2025-10-24T17:10:17.325114] [DEBUG] [VALIDATOR ] ALLY: Validating primary data.
[2025-10-24T17:10:17.325955] [FATAL] [VALIDATOR ] ALLY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:10:17.326049] [FATAL] [MAIN      ] ALLY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:10:17.326092] [WARN ] [MAIN      ] ALLY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:10:17.326132] [INFO ] [LOCAL     ] ALLY: Starting deletion of primary data.
[2025-10-24T17:10:17.326187] [DEBUG] [LOCAL     ] ALLY: No primary data file found to delete.
[2025-10-24T17:10:17.326221] [INFO ] [LOCAL     ] ALLY: Starting deletion of derivative data.
[2025-10-24T17:10:17.326371] [DEBUG] [LOCAL     ] ALLY: Deleted derivative data file.
[2025-10-24T17:10:17.327072] [INFO ] [MAIN      ] Update Progress: 87/2366 symbols completed. ALLY took 35.6s. Estimated remaining: 4h 28m 15s. Rate: 8.5 symbols/min
[2025-10-24T17:10:17.536589] [INFO ] [MAIN      ] ALUR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:10:17.549816] [DEBUG] [LOCAL     ] ALUR: Loaded 9313 existing records from primary storage.
[2025-10-24T17:10:17.550045] [INFO ] [MAIN      ] ALUR: Loaded 9313 existing records.
[2025-10-24T17:10:17.756507] [WARN ] [MAIN      ] ALUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:10:17.749339] [INFO ] [REMOTE    ] ALTG: Fetching primary data for 2025-05.
[2025-10-24T17:10:17.757617] [INFO ] [MAIN      ] ALUR: Wiping existing primary data before full refresh.
[2025-10-24T17:10:17.757750] [INFO ] [LOCAL     ] ALUR: Starting deletion of primary data.
[2025-10-24T17:10:17.758062] [DEBUG] [LOCAL     ] ALUR: Deleted primary data file.
[2025-10-24T17:10:17.758122] [INFO ] [MAIN      ] ALUR: Starting full primary refresh.
[2025-10-24T17:10:17.874485] [INFO ] [REMOTE    ] ALSN: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T17:10:17.938553] [INFO ] [REMOTE    ] ALSN: Full fetch complete (62778 records).
[2025-10-24T17:10:17.949116] [DEBUG] [VALIDATOR ] ALSN: Validating primary data.
[2025-10-24T17:10:18.407928] [INFO ] [REMOTE    ] ALUR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:10:18.552173] [INFO ] [REMOTE    ] ALUR: Fetching primary data for 2025-01.
[2025-10-24T17:10:18.607693] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present.
[2025-10-24T17:10:18.608079] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed.
[2025-10-24T17:10:18.608800] [INFO ] [MAIN      ] ALSN: Fetched primary data is valid.
[2025-10-24T17:10:18.609011] [DEBUG] [LOCAL     ] ALSN: Saving primary data.
[2025-10-24T17:10:18.626390] [FATAL] [LOCAL     ] ALSN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:10:18.629934] [INFO ] [REMOTE    ] ALLE: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T17:10:18.630046] [FATAL] [MAIN      ] ALSN: Failed to save primary data.
[2025-10-24T17:10:18.636837] [WARN ] [MAIN      ] ALSN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:10:18.637373] [INFO ] [LOCAL     ] ALSN: Starting deletion of primary data.
[2025-10-24T17:10:18.637544] [DEBUG] [LOCAL     ] ALSN: No primary data file found to delete.
[2025-10-24T17:10:18.637787] [INFO ] [REMOTE    ] ALLE: Full fetch complete (64610 records).
[2025-10-24T17:10:18.637615] [INFO ] [LOCAL     ] ALSN: Starting deletion of derivative data.
[2025-10-24T17:10:18.637894] [DEBUG] [VALIDATOR ] ALLE: Validating primary data.
[2025-10-24T17:10:18.648229] [DEBUG] [LOCAL     ] ALSN: Deleted derivative data file.
[2025-10-24T17:10:18.649675] [INFO ] [MAIN      ] Update Progress: 88/2366 symbols completed. ALSN took 30.9s. Estimated remaining: 4h 25m 40s. Rate: 8.6 symbols/min
[2025-10-24T17:10:18.650191] [INFO ] [REMOTE    ] ALTG: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T17:10:18.665839] [FATAL] [VALIDATOR ] ALLE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:10:18.718792] [FATAL] [MAIN      ] ALLE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:10:18.724998] [WARN ] [MAIN      ] ALLE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:10:18.730752] [INFO ] [LOCAL     ] ALLE: Starting deletion of primary data.
[2025-10-24T17:10:18.735939] [DEBUG] [LOCAL     ] ALLE: No primary data file found to delete.
[2025-10-24T17:10:18.736018] [INFO ] [LOCAL     ] ALLE: Starting deletion of derivative data.
[2025-10-24T17:10:18.756864] [DEBUG] [LOCAL     ] ALLE: Deleted derivative data file.
[2025-10-24T17:10:18.757704] [INFO ] [MAIN      ] Update Progress: 89/2366 symbols completed. ALLE took 38.2s. Estimated remaining: 4h 22m 36s. Rate: 8.7 symbols/min
[2025-10-24T17:10:18.929531] [INFO ] [MAIN      ] ALV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:10:18.999287] [INFO ] [MAIN      ] ALX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:10:19.019689] [DEBUG] [LOCAL     ] ALX: Loaded 7365 existing records from primary storage.
[2025-10-24T17:10:19.019991] [INFO ] [MAIN      ] ALX: Loaded 7365 existing records.
[2025-10-24T17:10:19.156397] [DEBUG] [LOCAL     ] ALV: Loaded 42508 existing records from primary storage.
[2025-10-24T17:10:19.191625] [INFO ] [MAIN      ] ALV: Loaded 42508 existing records.
[2025-10-24T17:10:19.287097] [WARN ] [MAIN      ] ALX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:10:19.311260] [INFO ] [MAIN      ] ALX: Wiping existing primary data before full refresh.
[2025-10-24T17:10:19.313572] [INFO ] [LOCAL     ] ALX: Starting deletion of primary data.
[2025-10-24T17:10:19.314000] [DEBUG] [LOCAL     ] ALX: Deleted primary data file.
[2025-10-24T17:10:19.324477] [INFO ] [MAIN      ] ALX: Starting full primary refresh.
[2025-10-24T17:10:19.387706] [INFO ] [REMOTE    ] ALTG: Fetching primary data for 2025-06.
[2025-10-24T17:10:19.445011] [WARN ] [MAIN      ] ALV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:10:19.445210] [INFO ] [MAIN      ] ALV: Wiping existing primary data before full refresh.
[2025-10-24T17:10:19.446016] [INFO ] [LOCAL     ] ALV: Starting deletion of primary data.
[2025-10-24T17:10:19.473755] [DEBUG] [LOCAL     ] ALV: Deleted primary data file.
[2025-10-24T17:10:19.487266] [INFO ] [MAIN      ] ALV: Starting full primary refresh.
[2025-10-24T17:10:20.089629] [INFO ] [REMOTE    ] ALX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:10:20.159166] [INFO ] [REMOTE    ] ALX: Fetching primary data for 2025-01.
[2025-10-24T17:10:20.159107] [INFO ] [REMOTE    ] ALV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:10:20.174454] [INFO ] [REMOTE    ] ALUR: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T17:10:20.813949] [INFO ] [REMOTE    ] ALX: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T17:10:20.864321] [INFO ] [REMOTE    ] ALTG: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T17:10:20.947603] [INFO ] [REMOTE    ] ALTG: Fetching primary data for 2025-07.
[2025-10-24T17:10:21.747715] [INFO ] [REMOTE    ] ALV: Fetching primary data for 2025-01.
[2025-10-24T17:10:22.112330] [INFO ] [REMOTE    ] ALTG: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T17:10:22.547710] [INFO ] [REMOTE    ] ALUR: Fetching primary data for 2025-02.
[2025-10-24T17:10:23.347713] [INFO ] [REMOTE    ] ALTG: Fetching primary data for 2025-08.
[2025-10-24T17:10:23.531112] [INFO ] [REMOTE    ] ALUR: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T17:10:23.592763] [INFO ] [REMOTE    ] ALV: Incremental fetch complete for 2025-01 (1.85 seconds).
[2025-10-24T17:10:24.102145] [INFO ] [REMOTE    ] ALTG: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T17:10:24.147706] [INFO ] [REMOTE    ] ALV: Fetching primary data for 2025-02.
[2025-10-24T17:10:24.947699] [INFO ] [REMOTE    ] ALX: Fetching primary data for 2025-02.
[2025-10-24T17:10:25.511278] [INFO ] [REMOTE    ] ALX: Incremental fetch complete for 2025-02 (0.56 seconds).
[2025-10-24T17:10:25.512270] [INFO ] [REMOTE    ] ALV: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T17:10:25.747623] [INFO ] [REMOTE    ] ALUR: Fetching primary data for 2025-03.
[2025-10-24T17:10:26.547627] [INFO ] [REMOTE    ] ALTG: Fetching primary data for 2025-09.
[2025-10-24T17:10:26.937009] [INFO ] [REMOTE    ] ALUR: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T17:10:27.347698] [INFO ] [REMOTE    ] ALV: Fetching primary data for 2025-03.
[2025-10-24T17:10:27.537293] [INFO ] [REMOTE    ] ALTG: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T17:10:28.147675] [INFO ] [REMOTE    ] ALUR: Fetching primary data for 2025-04.
[2025-10-24T17:10:28.889045] [INFO ] [REMOTE    ] ALUR: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T17:10:28.929465] [INFO ] [REMOTE    ] ALV: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T17:10:28.947603] [INFO ] [REMOTE    ] ALV: Fetching primary data for 2025-04.
[2025-10-24T17:10:29.747666] [INFO ] [REMOTE    ] ALX: Fetching primary data for 2025-03.
[2025-10-24T17:10:30.122751] [INFO ] [REMOTE    ] ALX: Incremental fetch complete for 2025-03 (0.38 seconds).
[2025-10-24T17:10:30.547707] [INFO ] [REMOTE    ] ALTG: Fetching primary data for 2025-10.
[2025-10-24T17:10:30.614532] [INFO ] [REMOTE    ] ALV: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T17:10:31.347636] [INFO ] [REMOTE    ] ALUR: Fetching primary data for 2025-05.
[2025-10-24T17:10:31.942373] [INFO ] [REMOTE    ] ALTG: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T17:10:31.946553] [INFO ] [REMOTE    ] ALTG: Full fetch complete (33254 records).
[2025-10-24T17:10:31.946683] [DEBUG] [VALIDATOR ] ALTG: Validating primary data.
[2025-10-24T17:10:31.947553] [FATAL] [VALIDATOR ] ALTG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:10:31.947672] [FATAL] [MAIN      ] ALTG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:10:31.947747] [WARN ] [MAIN      ] ALTG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:10:31.947839] [INFO ] [LOCAL     ] ALTG: Starting deletion of primary data.
[2025-10-24T17:10:31.947923] [DEBUG] [LOCAL     ] ALTG: No primary data file found to delete.
[2025-10-24T17:10:31.947960] [INFO ] [LOCAL     ] ALTG: Starting deletion of derivative data.
[2025-10-24T17:10:31.948099] [DEBUG] [LOCAL     ] ALTG: Deleted derivative data file.
[2025-10-24T17:10:31.948167] [INFO ] [MAIN      ] Update Progress: 90/2366 symbols completed. ALTG took 26.3s. Estimated remaining: 4h 25m 8s. Rate: 8.6 symbols/min
[2025-10-24T17:10:32.126404] [INFO ] [MAIN      ] AM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:10:32.157564] [INFO ] [REMOTE    ] ALV: Fetching primary data for 2025-05.
[2025-10-24T17:10:32.182146] [DEBUG] [LOCAL     ] AM: Loaded 52213 existing records from primary storage.
[2025-10-24T17:10:32.182541] [INFO ] [MAIN      ] AM: Loaded 52213 existing records.
[2025-10-24T17:10:32.362399] [WARN ] [MAIN      ] AM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:10:32.362604] [INFO ] [MAIN      ] AM: Wiping existing primary data before full refresh.
[2025-10-24T17:10:32.362682] [INFO ] [LOCAL     ] AM: Starting deletion of primary data.
[2025-10-24T17:10:32.363052] [DEBUG] [LOCAL     ] AM: Deleted primary data file.
[2025-10-24T17:10:32.363092] [INFO ] [MAIN      ] AM: Starting full primary refresh.
[2025-10-24T17:10:32.659370] [INFO ] [REMOTE    ] ALUR: Incremental fetch complete for 2025-05 (1.31 seconds).
[2025-10-24T17:10:32.737956] [INFO ] [REMOTE    ] AM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:10:32.947613] [INFO ] [REMOTE    ] AM: Fetching primary data for 2025-01.
[2025-10-24T17:10:33.593041] [INFO ] [REMOTE    ] ALV: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T17:10:33.747614] [INFO ] [REMOTE    ] ALV: Fetching primary data for 2025-06.
[2025-10-24T17:10:34.415848] [INFO ] [REMOTE    ] AM: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T17:10:34.547629] [INFO ] [REMOTE    ] AM: Fetching primary data for 2025-02.
[2025-10-24T17:10:35.227384] [INFO ] [REMOTE    ] ALV: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T17:10:35.347601] [INFO ] [REMOTE    ] ALV: Fetching primary data for 2025-07.
[2025-10-24T17:10:36.132587] [INFO ] [REMOTE    ] AM: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T17:10:36.147596] [INFO ] [REMOTE    ] AM: Fetching primary data for 2025-03.
[2025-10-24T17:10:36.956033] [INFO ] [REMOTE    ] ALUR: Fetching primary data for 2025-06.
[2025-10-24T17:10:36.958842] [INFO ] [REMOTE    ] ALV: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T17:10:37.478977] [INFO ] [REMOTE    ] AM: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T17:10:37.696825] [INFO ] [REMOTE    ] ALUR: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T17:10:37.747597] [INFO ] [REMOTE    ] ALUR: Fetching primary data for 2025-07.
[2025-10-24T17:10:38.521580] [INFO ] [REMOTE    ] ALUR: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T17:10:38.547594] [INFO ] [REMOTE    ] ALUR: Fetching primary data for 2025-08.
[2025-10-24T17:10:39.258957] [INFO ] [REMOTE    ] ALUR: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T17:10:39.347635] [INFO ] [REMOTE    ] ALV: Fetching primary data for 2025-08.
[2025-10-24T17:10:40.147715] [INFO ] [REMOTE    ] ALX: Fetching primary data for 2025-04.
[2025-10-24T17:10:40.567043] [INFO ] [REMOTE    ] ALV: Incremental fetch complete for 2025-08 (1.22 seconds).
[2025-10-24T17:10:40.764251] [INFO ] [REMOTE    ] ALX: Incremental fetch complete for 2025-04 (0.62 seconds).
[2025-10-24T17:10:40.947683] [INFO ] [REMOTE    ] ALUR: Fetching primary data for 2025-09.
[2025-10-24T17:10:41.572197] [INFO ] [REMOTE    ] ALUR: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T17:10:41.747716] [INFO ] [REMOTE    ] ALUR: Fetching primary data for 2025-10.
[2025-10-24T17:10:42.547673] [INFO ] [REMOTE    ] AM: Fetching primary data for 2025-04.
[2025-10-24T17:10:42.564406] [INFO ] [REMOTE    ] ALUR: Incremental fetch complete for 2025-10 (0.82 seconds).
[2025-10-24T17:10:42.566265] [INFO ] [REMOTE    ] ALUR: Full fetch complete (18282 records).
[2025-10-24T17:10:42.566362] [DEBUG] [VALIDATOR ] ALUR: Validating primary data.
[2025-10-24T17:10:42.944881] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present.
[2025-10-24T17:10:42.944954] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed.
[2025-10-24T17:10:42.945240] [INFO ] [MAIN      ] ALUR: Fetched primary data is valid.
[2025-10-24T17:10:42.945279] [DEBUG] [LOCAL     ] ALUR: Saving primary data.
[2025-10-24T17:10:42.945513] [FATAL] [LOCAL     ] ALUR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:10:42.945591] [FATAL] [MAIN      ] ALUR: Failed to save primary data.
[2025-10-24T17:10:42.945632] [WARN ] [MAIN      ] ALUR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:10:42.945707] [INFO ] [LOCAL     ] ALUR: Starting deletion of primary data.
[2025-10-24T17:10:42.945763] [DEBUG] [LOCAL     ] ALUR: No primary data file found to delete.
[2025-10-24T17:10:42.945798] [INFO ] [LOCAL     ] ALUR: Starting deletion of derivative data.
[2025-10-24T17:10:42.945950] [DEBUG] [LOCAL     ] ALUR: Deleted derivative data file.
[2025-10-24T17:10:42.946019] [INFO ] [MAIN      ] Update Progress: 91/2366 symbols completed. ALUR took 25.6s. Estimated remaining: 4h 26m 41s. Rate: 8.5 symbols/min
[2025-10-24T17:10:43.114088] [INFO ] [MAIN      ] AMBC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:10:43.148169] [DEBUG] [LOCAL     ] AMBC: Loaded 36148 existing records from primary storage.
[2025-10-24T17:10:43.148443] [INFO ] [MAIN      ] AMBC: Loaded 36148 existing records.
[2025-10-24T17:10:43.334194] [WARN ] [MAIN      ] AMBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:10:43.334466] [INFO ] [MAIN      ] AMBC: Wiping existing primary data before full refresh.
[2025-10-24T17:10:43.334519] [INFO ] [LOCAL     ] AMBC: Starting deletion of primary data.
[2025-10-24T17:10:43.335093] [DEBUG] [LOCAL     ] AMBC: Deleted primary data file.
[2025-10-24T17:10:43.335153] [INFO ] [MAIN      ] AMBC: Starting full primary refresh.
[2025-10-24T17:10:43.356286] [INFO ] [REMOTE    ] ALV: Fetching primary data for 2025-09.
[2025-10-24T17:10:43.703716] [INFO ] [REMOTE    ] AMBC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:10:44.147717] [INFO ] [REMOTE    ] ALX: Fetching primary data for 2025-05.
[2025-10-24T17:10:44.283794] [INFO ] [REMOTE    ] AM: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T17:10:44.779096] [INFO ] [REMOTE    ] ALX: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T17:10:44.947609] [INFO ] [REMOTE    ] AM: Fetching primary data for 2025-05.
[2025-10-24T17:10:45.056860] [INFO ] [REMOTE    ] ALV: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T17:10:45.747624] [INFO ] [REMOTE    ] ALX: Fetching primary data for 2025-06.
[2025-10-24T17:10:46.540708] [INFO ] [REMOTE    ] ALX: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T17:10:46.547593] [INFO ] [REMOTE    ] ALX: Fetching primary data for 2025-07.
[2025-10-24T17:10:46.600018] [INFO ] [REMOTE    ] AM: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T17:10:47.177784] [INFO ] [REMOTE    ] ALX: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T17:10:47.347683] [INFO ] [REMOTE    ] ALX: Fetching primary data for 2025-08.
[2025-10-24T17:10:48.068352] [INFO ] [REMOTE    ] ALX: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T17:10:48.147705] [INFO ] [REMOTE    ] ALX: Fetching primary data for 2025-09.
[2025-10-24T17:10:48.912122] [INFO ] [REMOTE    ] ALX: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T17:10:48.947661] [INFO ] [REMOTE    ] ALV: Fetching primary data for 2025-10.
[2025-10-24T17:10:49.747695] [INFO ] [REMOTE    ] AM: Fetching primary data for 2025-06.
[2025-10-24T17:10:50.547618] [INFO ] [REMOTE    ] AMBC: Fetching primary data for 2025-01.
[2025-10-24T17:10:50.710912] [INFO ] [REMOTE    ] ALV: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T17:10:50.719855] [INFO ] [REMOTE    ] ALV: Full fetch complete (62449 records).
[2025-10-24T17:10:50.719983] [DEBUG] [VALIDATOR ] ALV: Validating primary data.
[2025-10-24T17:10:51.102772] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present.
[2025-10-24T17:10:51.102896] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed.
[2025-10-24T17:10:51.103547] [INFO ] [MAIN      ] ALV: Fetched primary data is valid.
[2025-10-24T17:10:51.103659] [DEBUG] [LOCAL     ] ALV: Saving primary data.
[2025-10-24T17:10:51.104380] [FATAL] [LOCAL     ] ALV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:10:51.104459] [FATAL] [MAIN      ] ALV: Failed to save primary data.
[2025-10-24T17:10:51.104522] [WARN ] [MAIN      ] ALV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:10:51.104589] [INFO ] [LOCAL     ] ALV: Starting deletion of primary data.
[2025-10-24T17:10:51.104674] [DEBUG] [LOCAL     ] ALV: No primary data file found to delete.
[2025-10-24T17:10:51.104731] [INFO ] [LOCAL     ] ALV: Starting deletion of derivative data.
[2025-10-24T17:10:51.104986] [DEBUG] [LOCAL     ] ALV: Deleted derivative data file.
[2025-10-24T17:10:51.105621] [INFO ] [MAIN      ] Update Progress: 92/2366 symbols completed. ALV took 32.5s. Estimated remaining: 4h 27m 2s. Rate: 8.5 symbols/min
[2025-10-24T17:10:51.275140] [INFO ] [MAIN      ] AMBP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:10:51.315860] [DEBUG] [LOCAL     ] AMBP: Loaded 44670 existing records from primary storage.
[2025-10-24T17:10:51.316130] [INFO ] [MAIN      ] AMBP: Loaded 44670 existing records.
[2025-10-24T17:10:51.358729] [INFO ] [REMOTE    ] ALX: Fetching primary data for 2025-10.
[2025-10-24T17:10:51.500194] [WARN ] [MAIN      ] AMBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:10:51.500391] [INFO ] [MAIN      ] AMBP: Wiping existing primary data before full refresh.
[2025-10-24T17:10:51.500438] [INFO ] [LOCAL     ] AMBP: Starting deletion of primary data.
[2025-10-24T17:10:51.501295] [DEBUG] [LOCAL     ] AMBP: Deleted primary data file.
[2025-10-24T17:10:51.501358] [INFO ] [MAIN      ] AMBP: Starting full primary refresh.
[2025-10-24T17:10:51.899864] [INFO ] [REMOTE    ] AMBP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:10:51.915049] [INFO ] [REMOTE    ] AMBC: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T17:10:52.127892] [INFO ] [REMOTE    ] AM: Incremental fetch complete for 2025-06 (2.38 seconds).
[2025-10-24T17:10:52.147597] [INFO ] [REMOTE    ] AM: Fetching primary data for 2025-07.
[2025-10-24T17:10:52.363455] [INFO ] [REMOTE    ] ALX: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T17:10:52.366010] [INFO ] [REMOTE    ] ALX: Full fetch complete (8266 records).
[2025-10-24T17:10:52.366079] [DEBUG] [VALIDATOR ] ALX: Validating primary data.
[2025-10-24T17:10:52.726277] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present.
[2025-10-24T17:10:52.726359] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed.
[2025-10-24T17:10:52.726565] [INFO ] [MAIN      ] ALX: Fetched primary data is valid.
[2025-10-24T17:10:52.726603] [DEBUG] [LOCAL     ] ALX: Saving primary data.
[2025-10-24T17:10:52.726817] [FATAL] [LOCAL     ] ALX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:10:52.726902] [FATAL] [MAIN      ] ALX: Failed to save primary data.
[2025-10-24T17:10:52.726942] [WARN ] [MAIN      ] ALX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:10:52.726976] [INFO ] [LOCAL     ] ALX: Starting deletion of primary data.
[2025-10-24T17:10:52.727023] [DEBUG] [LOCAL     ] ALX: No primary data file found to delete.
[2025-10-24T17:10:52.727057] [INFO ] [LOCAL     ] ALX: Starting deletion of derivative data.
[2025-10-24T17:10:52.727243] [DEBUG] [LOCAL     ] ALX: Deleted derivative data file.
[2025-10-24T17:10:52.727330] [INFO ] [MAIN      ] Update Progress: 93/2366 symbols completed. ALX took 34.0s. Estimated remaining: 4h 24m 42s. Rate: 8.6 symbols/min
[2025-10-24T17:10:52.893675] [INFO ] [MAIN      ] AMBQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:10:52.893873] [DEBUG] [LOCAL     ] AMBQ: No existing data file found in primary storage.
[2025-10-24T17:10:52.893914] [WARN ] [MAIN      ] AMBQ: No existing data found, performing full refresh instead.
[2025-10-24T17:10:52.894021] [INFO ] [MAIN      ] AMBQ: Wiping existing primary data before full refresh.
[2025-10-24T17:10:52.894062] [INFO ] [LOCAL     ] AMBQ: Starting deletion of primary data.
[2025-10-24T17:10:52.894102] [DEBUG] [LOCAL     ] AMBQ: No primary data file found to delete.
[2025-10-24T17:10:52.894134] [INFO ] [MAIN      ] AMBQ: Starting full primary refresh.
[2025-10-24T17:10:52.956871] [INFO ] [REMOTE    ] AMBC: Fetching primary data for 2025-02.
[2025-10-24T17:10:53.246053] [INFO ] [REMOTE    ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:10:53.715751] [INFO ] [REMOTE    ] AM: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T17:10:53.747607] [INFO ] [REMOTE    ] AM: Fetching primary data for 2025-08.
[2025-10-24T17:10:53.867696] [INFO ] [REMOTE    ] AMBC: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T17:10:54.547736] [INFO ] [REMOTE    ] AMBC: Fetching primary data for 2025-03.
[2025-10-24T17:10:55.347749] [INFO ] [REMOTE    ] AMBP: Fetching primary data for 2025-01.
[2025-10-24T17:10:55.489997] [INFO ] [REMOTE    ] AM: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T17:10:55.833229] [INFO ] [REMOTE    ] AMBC: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T17:10:56.147715] [INFO ] [REMOTE    ] AMBQ: Fetching primary data for 2025-01.
[2025-10-24T17:10:56.332780] [DEBUG] [REMOTE    ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:10:56.333091] [WARN ] [REMOTE    ] AMBQ: No data returned for month 2025-01
[2025-10-24T17:10:56.333182] [FATAL] [REMOTE    ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:10:56.333254] [FATAL] [MAIN      ] AMBQ: Failed to fetch primary data.
[2025-10-24T17:10:56.333320] [WARN ] [MAIN      ] AMBQ: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:10:56.333392] [INFO ] [LOCAL     ] AMBQ: Starting deletion of primary data.
[2025-10-24T17:10:56.333456] [DEBUG] [LOCAL     ] AMBQ: No primary data file found to delete.
[2025-10-24T17:10:56.333507] [INFO ] [LOCAL     ] AMBQ: Starting deletion of derivative data.
[2025-10-24T17:10:56.333547] [DEBUG] [LOCAL     ] AMBQ: No derivative data file found to delete.
[2025-10-24T17:10:56.333593] [INFO ] [MAIN      ] Update Progress: 94/2366 symbols completed. AMBQ took 3.6s. Estimated remaining: 4h 23m 14s. Rate: 8.6 symbols/min
[2025-10-24T17:10:56.502334] [INFO ] [MAIN      ] AMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:10:56.558575] [DEBUG] [LOCAL     ] AMC: Loaded 54156 existing records from primary storage.
[2025-10-24T17:10:56.558948] [INFO ] [MAIN      ] AMC: Loaded 54156 existing records.
[2025-10-24T17:10:56.744841] [WARN ] [MAIN      ] AMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:10:56.745075] [INFO ] [MAIN      ] AMC: Wiping existing primary data before full refresh.
[2025-10-24T17:10:56.745124] [INFO ] [LOCAL     ] AMC: Starting deletion of primary data.
[2025-10-24T17:10:56.745923] [DEBUG] [LOCAL     ] AMC: Deleted primary data file.
[2025-10-24T17:10:56.745980] [INFO ] [MAIN      ] AMC: Starting full primary refresh.
[2025-10-24T17:10:56.952934] [INFO ] [REMOTE    ] AM: Fetching primary data for 2025-09.
[2025-10-24T17:10:57.116382] [INFO ] [REMOTE    ] AMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:10:57.558312] [INFO ] [REMOTE    ] AMBP: Incremental fetch complete for 2025-01 (2.21 seconds).
[2025-10-24T17:10:57.747675] [INFO ] [REMOTE    ] AMBC: Fetching primary data for 2025-04.
[2025-10-24T17:10:58.414393] [INFO ] [REMOTE    ] AM: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T17:10:58.547729] [INFO ] [REMOTE    ] AMC: Fetching primary data for 2025-01.
[2025-10-24T17:10:58.922347] [INFO ] [REMOTE    ] AMBC: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T17:10:59.347682] [INFO ] [REMOTE    ] AMBP: Fetching primary data for 2025-02.
[2025-10-24T17:11:00.147676] [INFO ] [REMOTE    ] AM: Fetching primary data for 2025-10.
[2025-10-24T17:11:00.557900] [INFO ] [REMOTE    ] AMC: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T17:11:00.947630] [INFO ] [REMOTE    ] AMBC: Fetching primary data for 2025-05.
[2025-10-24T17:11:01.636366] [INFO ] [REMOTE    ] AMBP: Incremental fetch complete for 2025-02 (2.29 seconds).
[2025-10-24T17:11:01.747694] [INFO ] [REMOTE    ] AMBP: Fetching primary data for 2025-03.
[2025-10-24T17:11:02.477125] [INFO ] [REMOTE    ] AM: Incremental fetch complete for 2025-10 (2.33 seconds).
[2025-10-24T17:11:02.487892] [INFO ] [REMOTE    ] AM: Full fetch complete (75659 records).
[2025-10-24T17:11:02.488017] [DEBUG] [VALIDATOR ] AM: Validating primary data.
[2025-10-24T17:11:02.551850] [INFO ] [REMOTE    ] AMC: Fetching primary data for 2025-02.
[2025-10-24T17:11:02.889765] [DEBUG] [VALIDATOR ] AM: All expected trading days are present.
[2025-10-24T17:11:02.889859] [DEBUG] [VALIDATOR ] AM: Primary data validation passed.
[2025-10-24T17:11:02.890672] [INFO ] [MAIN      ] AM: Fetched primary data is valid.
[2025-10-24T17:11:02.890739] [DEBUG] [LOCAL     ] AM: Saving primary data.
[2025-10-24T17:11:02.891448] [FATAL] [LOCAL     ] AM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:11:02.891552] [FATAL] [MAIN      ] AM: Failed to save primary data.
[2025-10-24T17:11:02.891595] [WARN ] [MAIN      ] AM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:11:02.891684] [INFO ] [LOCAL     ] AM: Starting deletion of primary data.
[2025-10-24T17:11:02.891757] [DEBUG] [LOCAL     ] AM: No primary data file found to delete.
[2025-10-24T17:11:02.891795] [INFO ] [LOCAL     ] AM: Starting deletion of derivative data.
[2025-10-24T17:11:02.891953] [DEBUG] [LOCAL     ] AM: Deleted derivative data file.
[2025-10-24T17:11:02.892722] [INFO ] [MAIN      ] Update Progress: 95/2366 symbols completed. AM took 30.9s. Estimated remaining: 4h 22m 57s. Rate: 8.6 symbols/min
[2025-10-24T17:11:03.066616] [INFO ] [MAIN      ] AMCR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:11:03.088118] [INFO ] [REMOTE    ] AMBC: Incremental fetch complete for 2025-05 (2.14 seconds).
[2025-10-24T17:11:03.144392] [DEBUG] [LOCAL     ] AMCR: Loaded 54060 existing records from primary storage.
[2025-10-24T17:11:03.144743] [INFO ] [MAIN      ] AMCR: Loaded 54060 existing records.
[2025-10-24T17:11:03.320514] [WARN ] [MAIN      ] AMCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:11:03.320787] [INFO ] [MAIN      ] AMCR: Wiping existing primary data before full refresh.
[2025-10-24T17:11:03.320836] [INFO ] [LOCAL     ] AMCR: Starting deletion of primary data.
[2025-10-24T17:11:03.321804] [DEBUG] [LOCAL     ] AMCR: Deleted primary data file.
[2025-10-24T17:11:03.321861] [INFO ] [MAIN      ] AMCR: Starting full primary refresh.
[2025-10-24T17:11:03.352876] [INFO ] [REMOTE    ] AMBC: Fetching primary data for 2025-06.
[2025-10-24T17:11:03.675737] [INFO ] [REMOTE    ] AMCR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:11:04.147765] [INFO ] [REMOTE    ] AMCR: Fetching primary data for 2025-01.
[2025-10-24T17:11:04.506165] [INFO ] [REMOTE    ] AMBC: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T17:11:04.878557] [INFO ] [REMOTE    ] AMC: Incremental fetch complete for 2025-02 (2.33 seconds).
[2025-10-24T17:11:04.947634] [INFO ] [REMOTE    ] AMC: Fetching primary data for 2025-03.
[2025-10-24T17:11:05.103934] [INFO ] [REMOTE    ] AMBP: Incremental fetch complete for 2025-03 (3.36 seconds).
[2025-10-24T17:11:05.747667] [INFO ] [REMOTE    ] AMBP: Fetching primary data for 2025-04.
[2025-10-24T17:11:06.267831] [INFO ] [REMOTE    ] AMCR: Incremental fetch complete for 2025-01 (2.12 seconds).
[2025-10-24T17:11:06.547744] [INFO ] [REMOTE    ] AMBC: Fetching primary data for 2025-07.
[2025-10-24T17:11:07.049637] [INFO ] [REMOTE    ] AMC: Incremental fetch complete for 2025-03 (2.10 seconds).
[2025-10-24T17:11:07.347619] [INFO ] [REMOTE    ] AMC: Fetching primary data for 2025-04.
[2025-10-24T17:11:07.525098] [INFO ] [REMOTE    ] AMBP: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T17:11:07.688117] [INFO ] [REMOTE    ] AMBC: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T17:11:08.147705] [INFO ] [REMOTE    ] AMBP: Fetching primary data for 2025-05.
[2025-10-24T17:11:08.947675] [INFO ] [REMOTE    ] AMCR: Fetching primary data for 2025-02.
[2025-10-24T17:11:09.340573] [INFO ] [REMOTE    ] AMC: Incremental fetch complete for 2025-04 (1.99 seconds).
[2025-10-24T17:11:09.674410] [INFO ] [REMOTE    ] AMBP: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T17:11:09.747618] [INFO ] [REMOTE    ] AMC: Fetching primary data for 2025-05.
[2025-10-24T17:11:10.547696] [INFO ] [REMOTE    ] AMBP: Fetching primary data for 2025-06.
[2025-10-24T17:11:10.645903] [INFO ] [REMOTE    ] AMCR: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T17:11:11.347686] [INFO ] [REMOTE    ] AMCR: Fetching primary data for 2025-03.
[2025-10-24T17:11:11.785911] [INFO ] [REMOTE    ] AMBP: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T17:11:12.147628] [INFO ] [REMOTE    ] AMBC: Fetching primary data for 2025-08.
[2025-10-24T17:11:12.283312] [INFO ] [REMOTE    ] AMC: Incremental fetch complete for 2025-05 (2.54 seconds).
[2025-10-24T17:11:12.586184] [INFO ] [REMOTE    ] AMCR: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T17:11:12.947620] [INFO ] [REMOTE    ] AMCR: Fetching primary data for 2025-04.
[2025-10-24T17:11:13.510116] [INFO ] [REMOTE    ] AMBC: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T17:11:13.747701] [INFO ] [REMOTE    ] AMBP: Fetching primary data for 2025-07.
[2025-10-24T17:11:14.209816] [INFO ] [REMOTE    ] AMCR: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T17:11:14.547627] [INFO ] [REMOTE    ] AMCR: Fetching primary data for 2025-05.
[2025-10-24T17:11:15.319375] [INFO ] [REMOTE    ] AMBP: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T17:11:15.347612] [INFO ] [REMOTE    ] AMBP: Fetching primary data for 2025-08.
[2025-10-24T17:11:16.147616] [INFO ] [REMOTE    ] AMC: Fetching primary data for 2025-06.
[2025-10-24T17:11:16.331637] [INFO ] [REMOTE    ] AMCR: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T17:11:16.895849] [INFO ] [REMOTE    ] AMBP: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T17:11:16.947610] [INFO ] [REMOTE    ] AMBP: Fetching primary data for 2025-09.
[2025-10-24T17:11:17.747739] [INFO ] [REMOTE    ] AMCR: Fetching primary data for 2025-06.
[2025-10-24T17:11:17.914141] [INFO ] [REMOTE    ] AMBP: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T17:11:18.424842] [INFO ] [REMOTE    ] AMC: Incremental fetch complete for 2025-06 (2.28 seconds).
[2025-10-24T17:11:18.547605] [INFO ] [REMOTE    ] AMC: Fetching primary data for 2025-07.
[2025-10-24T17:11:19.333903] [INFO ] [REMOTE    ] AMCR: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T17:11:19.347603] [INFO ] [REMOTE    ] AMBC: Fetching primary data for 2025-09.
[2025-10-24T17:11:20.147711] [INFO ] [REMOTE    ] AMBP: Fetching primary data for 2025-10.
[2025-10-24T17:11:20.607732] [INFO ] [REMOTE    ] AMBC: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T17:11:20.727435] [INFO ] [REMOTE    ] AMC: Incremental fetch complete for 2025-07 (2.18 seconds).
[2025-10-24T17:11:20.947631] [INFO ] [REMOTE    ] AMBC: Fetching primary data for 2025-10.
[2025-10-24T17:11:21.212732] [INFO ] [REMOTE    ] AMBP: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T17:11:21.220374] [INFO ] [REMOTE    ] AMBP: Full fetch complete (64989 records).
[2025-10-24T17:11:21.220508] [DEBUG] [VALIDATOR ] AMBP: Validating primary data.
[2025-10-24T17:11:21.612027] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present.
[2025-10-24T17:11:21.612104] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed.
[2025-10-24T17:11:21.612775] [INFO ] [MAIN      ] AMBP: Fetched primary data is valid.
[2025-10-24T17:11:21.612836] [DEBUG] [LOCAL     ] AMBP: Saving primary data.
[2025-10-24T17:11:21.613387] [FATAL] [LOCAL     ] AMBP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:11:21.613476] [FATAL] [MAIN      ] AMBP: Failed to save primary data.
[2025-10-24T17:11:21.613529] [WARN ] [MAIN      ] AMBP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:11:21.613613] [INFO ] [LOCAL     ] AMBP: Starting deletion of primary data.
[2025-10-24T17:11:21.613722] [DEBUG] [LOCAL     ] AMBP: No primary data file found to delete.
[2025-10-24T17:11:21.613816] [INFO ] [LOCAL     ] AMBP: Starting deletion of derivative data.
[2025-10-24T17:11:21.614019] [DEBUG] [LOCAL     ] AMBP: Deleted derivative data file.
[2025-10-24T17:11:21.614959] [INFO ] [MAIN      ] Update Progress: 96/2366 symbols completed. AMBP took 30.5s. Estimated remaining: 4h 27m 29s. Rate: 8.5 symbols/min
[2025-10-24T17:11:21.756130] [INFO ] [REMOTE    ] AMC: Fetching primary data for 2025-08.
[2025-10-24T17:11:21.789301] [INFO ] [MAIN      ] AME: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:11:21.838319] [DEBUG] [LOCAL     ] AME: Loaded 48787 existing records from primary storage.
[2025-10-24T17:11:21.838610] [INFO ] [MAIN      ] AME: Loaded 48787 existing records.
[2025-10-24T17:11:22.029109] [WARN ] [MAIN      ] AME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:11:22.029281] [INFO ] [MAIN      ] AME: Wiping existing primary data before full refresh.
[2025-10-24T17:11:22.029327] [INFO ] [LOCAL     ] AME: Starting deletion of primary data.
[2025-10-24T17:11:22.030173] [DEBUG] [LOCAL     ] AME: Deleted primary data file.
[2025-10-24T17:11:22.030241] [INFO ] [MAIN      ] AME: Starting full primary refresh.
[2025-10-24T17:11:22.383732] [INFO ] [REMOTE    ] AME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:11:22.443461] [INFO ] [REMOTE    ] AMBC: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T17:11:22.450674] [INFO ] [REMOTE    ] AMBC: Full fetch complete (51887 records).
[2025-10-24T17:11:22.450790] [DEBUG] [VALIDATOR ] AMBC: Validating primary data.
[2025-10-24T17:11:22.551235] [INFO ] [REMOTE    ] AME: Fetching primary data for 2025-01.
[2025-10-24T17:11:22.828526] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present.
[2025-10-24T17:11:22.828601] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed.
[2025-10-24T17:11:22.829175] [INFO ] [MAIN      ] AMBC: Fetched primary data is valid.
[2025-10-24T17:11:22.829236] [DEBUG] [LOCAL     ] AMBC: Saving primary data.
[2025-10-24T17:11:22.829712] [FATAL] [LOCAL     ] AMBC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:11:22.829799] [FATAL] [MAIN      ] AMBC: Failed to save primary data.
[2025-10-24T17:11:22.829842] [WARN ] [MAIN      ] AMBC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:11:22.829908] [INFO ] [LOCAL     ] AMBC: Starting deletion of primary data.
[2025-10-24T17:11:22.829967] [DEBUG] [LOCAL     ] AMBC: No primary data file found to delete.
[2025-10-24T17:11:22.830003] [INFO ] [LOCAL     ] AMBC: Starting deletion of derivative data.
[2025-10-24T17:11:22.830141] [DEBUG] [LOCAL     ] AMBC: Deleted derivative data file.
[2025-10-24T17:11:22.830620] [INFO ] [MAIN      ] Update Progress: 97/2366 symbols completed. AMBC took 39.9s. Estimated remaining: 4h 25m 5s. Rate: 8.6 symbols/min
[2025-10-24T17:11:23.005518] [INFO ] [MAIN      ] AMG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:11:23.028967] [DEBUG] [LOCAL     ] AMG: Loaded 20186 existing records from primary storage.
[2025-10-24T17:11:23.029233] [INFO ] [MAIN      ] AMG: Loaded 20186 existing records.
[2025-10-24T17:11:23.213539] [WARN ] [MAIN      ] AMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:11:23.213767] [INFO ] [MAIN      ] AMG: Wiping existing primary data before full refresh.
[2025-10-24T17:11:23.213816] [INFO ] [LOCAL     ] AMG: Starting deletion of primary data.
[2025-10-24T17:11:23.214244] [DEBUG] [LOCAL     ] AMG: Deleted primary data file.
[2025-10-24T17:11:23.214300] [INFO ] [MAIN      ] AMG: Starting full primary refresh.
[2025-10-24T17:11:23.361539] [INFO ] [REMOTE    ] AMCR: Fetching primary data for 2025-07.
[2025-10-24T17:11:23.591188] [INFO ] [REMOTE    ] AMG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:11:24.039329] [INFO ] [REMOTE    ] AMC: Incremental fetch complete for 2025-08 (2.28 seconds).
[2025-10-24T17:11:24.077523] [INFO ] [REMOTE    ] AME: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T17:11:24.147674] [INFO ] [REMOTE    ] AME: Fetching primary data for 2025-02.
[2025-10-24T17:11:24.786636] [INFO ] [REMOTE    ] AMCR: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T17:11:24.947675] [INFO ] [REMOTE    ] AMC: Fetching primary data for 2025-09.
[2025-10-24T17:11:25.555589] [INFO ] [REMOTE    ] AME: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T17:11:25.747697] [INFO ] [REMOTE    ] AME: Fetching primary data for 2025-03.
[2025-10-24T17:11:26.547610] [INFO ] [REMOTE    ] AMCR: Fetching primary data for 2025-08.
[2025-10-24T17:11:27.048531] [INFO ] [REMOTE    ] AMC: Incremental fetch complete for 2025-09 (2.10 seconds).
[2025-10-24T17:11:27.347734] [INFO ] [REMOTE    ] AMG: Fetching primary data for 2025-01.
[2025-10-24T17:11:28.063709] [INFO ] [REMOTE    ] AMCR: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T17:11:28.079448] [INFO ] [REMOTE    ] AME: Incremental fetch complete for 2025-03 (2.33 seconds).
[2025-10-24T17:11:28.108583] [INFO ] [REMOTE    ] AMG: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T17:11:28.147676] [INFO ] [REMOTE    ] AME: Fetching primary data for 2025-04.
[2025-10-24T17:11:28.947736] [INFO ] [REMOTE    ] AMG: Fetching primary data for 2025-02.
[2025-10-24T17:11:29.747718] [INFO ] [REMOTE    ] AMCR: Fetching primary data for 2025-09.
[2025-10-24T17:11:29.856123] [INFO ] [REMOTE    ] AME: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T17:11:29.951707] [INFO ] [REMOTE    ] AMG: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T17:11:30.547722] [INFO ] [REMOTE    ] AMG: Fetching primary data for 2025-03.
[2025-10-24T17:11:31.287073] [INFO ] [REMOTE    ] AMCR: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T17:11:31.347630] [INFO ] [REMOTE    ] AMCR: Fetching primary data for 2025-10.
[2025-10-24T17:11:31.517244] [INFO ] [REMOTE    ] AMG: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T17:11:32.147688] [INFO ] [REMOTE    ] AMG: Fetching primary data for 2025-04.
[2025-10-24T17:11:32.947618] [INFO ] [REMOTE    ] AMC: Fetching primary data for 2025-10.
[2025-10-24T17:11:33.276016] [INFO ] [REMOTE    ] AMG: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T17:11:33.523614] [INFO ] [REMOTE    ] AMCR: Incremental fetch complete for 2025-10 (2.18 seconds).
[2025-10-24T17:11:33.534378] [INFO ] [REMOTE    ] AMCR: Full fetch complete (77843 records).
[2025-10-24T17:11:33.534597] [DEBUG] [VALIDATOR ] AMCR: Validating primary data.
[2025-10-24T17:11:33.752963] [INFO ] [REMOTE    ] AME: Fetching primary data for 2025-05.
[2025-10-24T17:11:33.962991] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present.
[2025-10-24T17:11:33.963123] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed.
[2025-10-24T17:11:33.964146] [INFO ] [MAIN      ] AMCR: Fetched primary data is valid.
[2025-10-24T17:11:33.964223] [DEBUG] [LOCAL     ] AMCR: Saving primary data.
[2025-10-24T17:11:33.965772] [FATAL] [LOCAL     ] AMCR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:11:33.965952] [FATAL] [MAIN      ] AMCR: Failed to save primary data.
[2025-10-24T17:11:33.966012] [WARN ] [MAIN      ] AMCR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:11:33.966053] [INFO ] [LOCAL     ] AMCR: Starting deletion of primary data.
[2025-10-24T17:11:33.966116] [DEBUG] [LOCAL     ] AMCR: No primary data file found to delete.
[2025-10-24T17:11:33.966152] [INFO ] [LOCAL     ] AMCR: Starting deletion of derivative data.
[2025-10-24T17:11:33.966407] [DEBUG] [LOCAL     ] AMCR: Deleted derivative data file.
[2025-10-24T17:11:33.967438] [INFO ] [MAIN      ] Update Progress: 98/2366 symbols completed. AMCR took 31.1s. Estimated remaining: 4h 26m 33s. Rate: 8.5 symbols/min
[2025-10-24T17:11:34.156804] [INFO ] [MAIN      ] AMH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:11:34.222427] [DEBUG] [LOCAL     ] AMH: Loaded 52212 existing records from primary storage.
[2025-10-24T17:11:34.222937] [INFO ] [MAIN      ] AMH: Loaded 52212 existing records.
[2025-10-24T17:11:34.404615] [WARN ] [MAIN      ] AMH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:11:34.404906] [INFO ] [MAIN      ] AMH: Wiping existing primary data before full refresh.
[2025-10-24T17:11:34.404958] [INFO ] [LOCAL     ] AMH: Starting deletion of primary data.
[2025-10-24T17:11:34.405257] [DEBUG] [LOCAL     ] AMH: Deleted primary data file.
[2025-10-24T17:11:34.405299] [INFO ] [MAIN      ] AMH: Starting full primary refresh.
[2025-10-24T17:11:34.552837] [INFO ] [REMOTE    ] AMG: Fetching primary data for 2025-05.
[2025-10-24T17:11:34.784885] [INFO ] [REMOTE    ] AMH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:11:35.254637] [INFO ] [REMOTE    ] AME: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T17:11:35.347671] [INFO ] [REMOTE    ] AME: Fetching primary data for 2025-06.
[2025-10-24T17:11:35.423957] [INFO ] [REMOTE    ] AMC: Incremental fetch complete for 2025-10 (2.48 seconds).
[2025-10-24T17:11:35.434830] [INFO ] [REMOTE    ] AMC: Full fetch complete (77930 records).
[2025-10-24T17:11:35.435042] [DEBUG] [VALIDATOR ] AMC: Validating primary data.
[2025-10-24T17:11:35.849144] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present.
[2025-10-24T17:11:35.849345] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed.
[2025-10-24T17:11:35.850374] [INFO ] [MAIN      ] AMC: Fetched primary data is valid.
[2025-10-24T17:11:35.850634] [DEBUG] [LOCAL     ] AMC: Saving primary data.
[2025-10-24T17:11:35.857231] [FATAL] [LOCAL     ] AMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:11:35.867002] [FATAL] [MAIN      ] AMC: Failed to save primary data.
[2025-10-24T17:11:35.867634] [INFO ] [REMOTE    ] AMG: Incremental fetch complete for 2025-05 (1.31 seconds).
[2025-10-24T17:11:35.873569] [WARN ] [MAIN      ] AMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:11:35.874098] [INFO ] [LOCAL     ] AMC: Starting deletion of primary data.
[2025-10-24T17:11:35.874197] [DEBUG] [LOCAL     ] AMC: No primary data file found to delete.
[2025-10-24T17:11:35.874240] [INFO ] [LOCAL     ] AMC: Starting deletion of derivative data.
[2025-10-24T17:11:35.874438] [DEBUG] [LOCAL     ] AMC: Deleted derivative data file.
[2025-10-24T17:11:35.875920] [INFO ] [MAIN      ] Update Progress: 99/2366 symbols completed. AMC took 39.5s. Estimated remaining: 4h 24m 28s. Rate: 8.6 symbols/min
[2025-10-24T17:11:36.059249] [INFO ] [MAIN      ] AMN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:11:36.109137] [DEBUG] [LOCAL     ] AMN: Loaded 41883 existing records from primary storage.
[2025-10-24T17:11:36.109551] [INFO ] [MAIN      ] AMN: Loaded 41883 existing records.
[2025-10-24T17:11:36.152883] [INFO ] [REMOTE    ] AMG: Fetching primary data for 2025-06.
[2025-10-24T17:11:36.320848] [WARN ] [MAIN      ] AMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:11:36.321225] [INFO ] [MAIN      ] AMN: Wiping existing primary data before full refresh.
[2025-10-24T17:11:36.321285] [INFO ] [LOCAL     ] AMN: Starting deletion of primary data.
[2025-10-24T17:11:36.321608] [DEBUG] [LOCAL     ] AMN: Deleted primary data file.
[2025-10-24T17:11:36.321715] [INFO ] [MAIN      ] AMN: Starting full primary refresh.
[2025-10-24T17:11:36.704175] [INFO ] [REMOTE    ] AMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:11:36.915882] [INFO ] [REMOTE    ] AMG: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T17:11:36.947628] [INFO ] [REMOTE    ] AMG: Fetching primary data for 2025-07.
[2025-10-24T17:11:37.031192] [INFO ] [REMOTE    ] AME: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T17:11:37.747616] [INFO ] [REMOTE    ] AMN: Fetching primary data for 2025-01.
[2025-10-24T17:11:37.909592] [INFO ] [REMOTE    ] AMG: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T17:11:38.547634] [INFO ] [REMOTE    ] AMG: Fetching primary data for 2025-08.
[2025-10-24T17:11:39.097178] [INFO ] [REMOTE    ] AMN: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T17:11:39.347729] [INFO ] [REMOTE    ] AMH: Fetching primary data for 2025-01.
[2025-10-24T17:11:39.414884] [INFO ] [REMOTE    ] AMG: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T17:11:40.147624] [INFO ] [REMOTE    ] AMG: Fetching primary data for 2025-09.
[2025-10-24T17:11:40.947624] [INFO ] [REMOTE    ] AMN: Fetching primary data for 2025-02.
[2025-10-24T17:11:40.977223] [INFO ] [REMOTE    ] AMG: Incremental fetch complete for 2025-09 (0.83 seconds).
[2025-10-24T17:11:41.235913] [INFO ] [REMOTE    ] AMH: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T17:11:41.747692] [INFO ] [REMOTE    ] AMG: Fetching primary data for 2025-10.
[2025-10-24T17:11:42.174118] [INFO ] [REMOTE    ] AMN: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T17:11:42.547707] [INFO ] [REMOTE    ] AMG: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T17:11:42.547795] [INFO ] [REMOTE    ] AMH: Fetching primary data for 2025-02.
[2025-10-24T17:11:42.553032] [INFO ] [REMOTE    ] AMG: Full fetch complete (29378 records).
[2025-10-24T17:11:42.553181] [DEBUG] [VALIDATOR ] AMG: Validating primary data.
[2025-10-24T17:11:42.554011] [FATAL] [VALIDATOR ] AMG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:11:42.554196] [FATAL] [MAIN      ] AMG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:11:42.554278] [WARN ] [MAIN      ] AMG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:11:42.554362] [INFO ] [LOCAL     ] AMG: Starting deletion of primary data.
[2025-10-24T17:11:42.554440] [DEBUG] [LOCAL     ] AMG: No primary data file found to delete.
[2025-10-24T17:11:42.554479] [INFO ] [LOCAL     ] AMG: Starting deletion of derivative data.
[2025-10-24T17:11:42.554687] [DEBUG] [LOCAL     ] AMG: Deleted derivative data file.
[2025-10-24T17:11:42.554792] [INFO ] [MAIN      ] Update Progress: 100/2366 symbols completed. AMG took 19.7s. Estimated remaining: 4h 24m 14s. Rate: 8.6 symbols/min
[2025-10-24T17:11:42.734089] [INFO ] [MAIN      ] AMP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:11:42.773880] [DEBUG] [LOCAL     ] AMP: Loaded 31992 existing records from primary storage.
[2025-10-24T17:11:42.774185] [INFO ] [MAIN      ] AMP: Loaded 31992 existing records.
[2025-10-24T17:11:42.979966] [WARN ] [MAIN      ] AMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:11:42.980171] [INFO ] [MAIN      ] AMP: Wiping existing primary data before full refresh.
[2025-10-24T17:11:42.980219] [INFO ] [LOCAL     ] AMP: Starting deletion of primary data.
[2025-10-24T17:11:42.980590] [DEBUG] [LOCAL     ] AMP: Deleted primary data file.
[2025-10-24T17:11:42.980683] [INFO ] [MAIN      ] AMP: Starting full primary refresh.
[2025-10-24T17:11:43.352760] [INFO ] [REMOTE    ] AME: Fetching primary data for 2025-07.
[2025-10-24T17:11:43.385825] [INFO ] [REMOTE    ] AMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:11:44.147634] [INFO ] [REMOTE    ] AMN: Fetching primary data for 2025-03.
[2025-10-24T17:11:44.284906] [INFO ] [REMOTE    ] AMH: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T17:11:44.947630] [INFO ] [REMOTE    ] AMP: Fetching primary data for 2025-01.
[2025-10-24T17:11:45.075082] [INFO ] [REMOTE    ] AME: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T17:11:45.365081] [INFO ] [REMOTE    ] AMN: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T17:11:45.747730] [INFO ] [REMOTE    ] AMH: Fetching primary data for 2025-03.
[2025-10-24T17:11:46.380285] [INFO ] [REMOTE    ] AMP: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T17:11:46.547681] [INFO ] [REMOTE    ] AMP: Fetching primary data for 2025-02.
[2025-10-24T17:11:47.097633] [INFO ] [REMOTE    ] AMH: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T17:11:47.347725] [INFO ] [REMOTE    ] AMH: Fetching primary data for 2025-04.
[2025-10-24T17:11:47.448348] [INFO ] [REMOTE    ] AMP: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T17:11:48.147701] [INFO ] [REMOTE    ] AMN: Fetching primary data for 2025-04.
[2025-10-24T17:11:48.947628] [INFO ] [REMOTE    ] AMP: Fetching primary data for 2025-03.
[2025-10-24T17:11:49.123285] [INFO ] [REMOTE    ] AMH: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T17:11:49.591985] [INFO ] [REMOTE    ] AMN: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T17:11:49.747692] [INFO ] [REMOTE    ] AMN: Fetching primary data for 2025-05.
[2025-10-24T17:11:49.972033] [INFO ] [REMOTE    ] AMP: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T17:11:50.547697] [INFO ] [REMOTE    ] AME: Fetching primary data for 2025-08.
[2025-10-24T17:11:50.733287] [INFO ] [REMOTE    ] AMN: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T17:11:51.347683] [INFO ] [REMOTE    ] AMP: Fetching primary data for 2025-04.
[2025-10-24T17:11:52.147632] [INFO ] [REMOTE    ] AMH: Fetching primary data for 2025-05.
[2025-10-24T17:11:52.298571] [INFO ] [REMOTE    ] AME: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T17:11:52.886916] [INFO ] [REMOTE    ] AMP: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T17:11:52.947606] [INFO ] [REMOTE    ] AMP: Fetching primary data for 2025-05.
[2025-10-24T17:11:53.747624] [INFO ] [REMOTE    ] AMN: Fetching primary data for 2025-06.
[2025-10-24T17:11:53.998480] [INFO ] [REMOTE    ] AMH: Incremental fetch complete for 2025-05 (1.85 seconds).
[2025-10-24T17:11:54.272058] [INFO ] [REMOTE    ] AMP: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T17:11:54.547680] [INFO ] [REMOTE    ] AME: Fetching primary data for 2025-09.
[2025-10-24T17:11:55.347626] [INFO ] [REMOTE    ] AMP: Fetching primary data for 2025-06.
[2025-10-24T17:11:55.795262] [INFO ] [REMOTE    ] AMN: Incremental fetch complete for 2025-06 (2.05 seconds).
[2025-10-24T17:11:55.959807] [INFO ] [REMOTE    ] AME: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T17:11:56.147674] [INFO ] [REMOTE    ] AMN: Fetching primary data for 2025-07.
[2025-10-24T17:11:56.752272] [INFO ] [REMOTE    ] AMP: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T17:11:56.947672] [INFO ] [REMOTE    ] AME: Fetching primary data for 2025-10.
[2025-10-24T17:11:57.546915] [INFO ] [REMOTE    ] AMN: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T17:11:57.747691] [INFO ] [REMOTE    ] AMH: Fetching primary data for 2025-06.
[2025-10-24T17:11:58.547621] [INFO ] [REMOTE    ] AMP: Fetching primary data for 2025-07.
[2025-10-24T17:11:58.623955] [INFO ] [REMOTE    ] AME: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T17:11:58.634722] [INFO ] [REMOTE    ] AME: Full fetch complete (70194 records).
[2025-10-24T17:11:58.634878] [DEBUG] [VALIDATOR ] AME: Validating primary data.
[2025-10-24T17:11:59.063723] [DEBUG] [VALIDATOR ] AME: All expected trading days are present.
[2025-10-24T17:11:59.063895] [DEBUG] [VALIDATOR ] AME: Primary data validation passed.
[2025-10-24T17:11:59.064892] [INFO ] [MAIN      ] AME: Fetched primary data is valid.
[2025-10-24T17:11:59.065120] [DEBUG] [LOCAL     ] AME: Saving primary data.
[2025-10-24T17:11:59.065959] [FATAL] [LOCAL     ] AME: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:11:59.066079] [FATAL] [MAIN      ] AME: Failed to save primary data.
[2025-10-24T17:11:59.066128] [WARN ] [MAIN      ] AME: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:11:59.066167] [INFO ] [LOCAL     ] AME: Starting deletion of primary data.
[2025-10-24T17:11:59.066225] [DEBUG] [LOCAL     ] AME: No primary data file found to delete.
[2025-10-24T17:11:59.066262] [INFO ] [LOCAL     ] AME: Starting deletion of derivative data.
[2025-10-24T17:11:59.066577] [DEBUG] [LOCAL     ] AME: Deleted derivative data file.
[2025-10-24T17:11:59.067453] [INFO ] [MAIN      ] Update Progress: 101/2366 symbols completed. AME took 37.5s. Estimated remaining: 4h 27m 41s. Rate: 8.5 symbols/min
[2025-10-24T17:11:59.258498] [INFO ] [MAIN      ] AMPX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:11:59.289225] [INFO ] [REMOTE    ] AMH: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T17:11:59.347002] [DEBUG] [LOCAL     ] AMPX: Loaded 52829 existing records from primary storage.
[2025-10-24T17:11:59.347340] [INFO ] [MAIN      ] AMPX: Loaded 52829 existing records.
[2025-10-24T17:11:59.358958] [INFO ] [REMOTE    ] AMN: Fetching primary data for 2025-08.
[2025-10-24T17:11:59.556468] [WARN ] [MAIN      ] AMPX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:11:59.556817] [INFO ] [MAIN      ] AMPX: Wiping existing primary data before full refresh.
[2025-10-24T17:11:59.556948] [INFO ] [LOCAL     ] AMPX: Starting deletion of primary data.
[2025-10-24T17:11:59.557918] [DEBUG] [LOCAL     ] AMPX: Deleted primary data file.
[2025-10-24T17:11:59.557999] [INFO ] [MAIN      ] AMPX: Starting full primary refresh.
[2025-10-24T17:11:59.693004] [INFO ] [REMOTE    ] AMP: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T17:11:59.980425] [INFO ] [REMOTE    ] AMPX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:12:00.147629] [INFO ] [REMOTE    ] AMPX: Fetching primary data for 2025-01.
[2025-10-24T17:12:00.947629] [INFO ] [REMOTE    ] AMH: Fetching primary data for 2025-07.
[2025-10-24T17:12:01.469461] [INFO ] [REMOTE    ] AMN: Incremental fetch complete for 2025-08 (2.11 seconds).
[2025-10-24T17:12:01.747737] [INFO ] [REMOTE    ] AMN: Fetching primary data for 2025-09.
[2025-10-24T17:12:02.547740] [INFO ] [REMOTE    ] AMP: Fetching primary data for 2025-08.
[2025-10-24T17:12:03.150468] [INFO ] [REMOTE    ] AMPX: Incremental fetch complete for 2025-01 (3.00 seconds).
[2025-10-24T17:12:03.347678] [INFO ] [REMOTE    ] AMPX: Fetching primary data for 2025-02.
[2025-10-24T17:12:04.068533] [INFO ] [REMOTE    ] AMN: Incremental fetch complete for 2025-09 (2.32 seconds).
[2025-10-24T17:12:04.147607] [INFO ] [REMOTE    ] AMN: Fetching primary data for 2025-10.
[2025-10-24T17:12:04.478181] [INFO ] [REMOTE    ] AMH: Incremental fetch complete for 2025-07 (3.53 seconds).
[2025-10-24T17:12:04.554700] [INFO ] [REMOTE    ] AMP: Incremental fetch complete for 2025-08 (2.01 seconds).
[2025-10-24T17:12:04.947630] [INFO ] [REMOTE    ] AMP: Fetching primary data for 2025-09.
[2025-10-24T17:12:05.084348] [INFO ] [REMOTE    ] AMPX: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T17:12:05.747694] [INFO ] [REMOTE    ] AMPX: Fetching primary data for 2025-03.
[2025-10-24T17:12:06.038493] [INFO ] [REMOTE    ] AMN: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T17:12:06.045801] [INFO ] [REMOTE    ] AMN: Full fetch complete (60178 records).
[2025-10-24T17:12:06.045907] [DEBUG] [VALIDATOR ] AMN: Validating primary data.
[2025-10-24T17:12:06.460667] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present.
[2025-10-24T17:12:06.460890] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed.
[2025-10-24T17:12:06.462732] [INFO ] [REMOTE    ] AMP: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T17:12:06.461880] [INFO ] [MAIN      ] AMN: Fetched primary data is valid.
[2025-10-24T17:12:06.462842] [DEBUG] [LOCAL     ] AMN: Saving primary data.
[2025-10-24T17:12:06.470096] [FATAL] [LOCAL     ] AMN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:12:06.470198] [FATAL] [MAIN      ] AMN: Failed to save primary data.
[2025-10-24T17:12:06.470246] [WARN ] [MAIN      ] AMN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:12:06.470311] [INFO ] [LOCAL     ] AMN: Starting deletion of primary data.
[2025-10-24T17:12:06.470689] [DEBUG] [LOCAL     ] AMN: No primary data file found to delete.
[2025-10-24T17:12:06.470745] [INFO ] [LOCAL     ] AMN: Starting deletion of derivative data.
[2025-10-24T17:12:06.470908] [DEBUG] [LOCAL     ] AMN: Deleted derivative data file.
[2025-10-24T17:12:06.471591] [INFO ] [MAIN      ] Update Progress: 102/2366 symbols completed. AMN took 30.6s. Estimated remaining: 4h 27m 40s. Rate: 8.5 symbols/min
[2025-10-24T17:12:06.552829] [INFO ] [REMOTE    ] AMP: Fetching primary data for 2025-10.
[2025-10-24T17:12:06.640815] [INFO ] [MAIN      ] AMPY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:12:06.679022] [DEBUG] [LOCAL     ] AMPY: Loaded 39691 existing records from primary storage.
[2025-10-24T17:12:06.679291] [INFO ] [MAIN      ] AMPY: Loaded 39691 existing records.
[2025-10-24T17:12:06.855183] [WARN ] [MAIN      ] AMPY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:12:06.855396] [INFO ] [MAIN      ] AMPY: Wiping existing primary data before full refresh.
[2025-10-24T17:12:06.855444] [INFO ] [LOCAL     ] AMPY: Starting deletion of primary data.
[2025-10-24T17:12:06.856108] [DEBUG] [LOCAL     ] AMPY: Deleted primary data file.
[2025-10-24T17:12:06.856166] [INFO ] [MAIN      ] AMPY: Starting full primary refresh.
[2025-10-24T17:12:07.233414] [INFO ] [REMOTE    ] AMPY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:12:07.262495] [INFO ] [REMOTE    ] AMPX: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T17:12:07.347634] [INFO ] [REMOTE    ] AMPY: Fetching primary data for 2025-01.
[2025-10-24T17:12:08.010399] [INFO ] [REMOTE    ] AMP: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T17:12:08.016803] [INFO ] [REMOTE    ] AMP: Full fetch complete (47527 records).
[2025-10-24T17:12:08.016905] [DEBUG] [VALIDATOR ] AMP: Validating primary data.
[2025-10-24T17:12:08.160740] [INFO ] [REMOTE    ] AMH: Fetching primary data for 2025-08.
[2025-10-24T17:12:08.414048] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present.
[2025-10-24T17:12:08.414204] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed.
[2025-10-24T17:12:08.414776] [INFO ] [MAIN      ] AMP: Fetched primary data is valid.
[2025-10-24T17:12:08.414859] [DEBUG] [LOCAL     ] AMP: Saving primary data.
[2025-10-24T17:12:08.415531] [FATAL] [LOCAL     ] AMP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:12:08.431971] [FATAL] [MAIN      ] AMP: Failed to save primary data.
[2025-10-24T17:12:08.432119] [WARN ] [MAIN      ] AMP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:12:08.432823] [INFO ] [LOCAL     ] AMP: Starting deletion of primary data.
[2025-10-24T17:12:08.433380] [INFO ] [REMOTE    ] AMPY: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T17:12:08.433605] [DEBUG] [LOCAL     ] AMP: No primary data file found to delete.
[2025-10-24T17:12:08.439225] [INFO ] [LOCAL     ] AMP: Starting deletion of derivative data.
[2025-10-24T17:12:08.440021] [DEBUG] [LOCAL     ] AMP: Deleted derivative data file.
[2025-10-24T17:12:08.440124] [INFO ] [MAIN      ] Update Progress: 103/2366 symbols completed. AMP took 25.9s. Estimated remaining: 4h 25m 41s. Rate: 8.5 symbols/min
[2025-10-24T17:12:08.611271] [INFO ] [MAIN      ] AMR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:12:08.643978] [DEBUG] [LOCAL     ] AMR: Loaded 28953 existing records from primary storage.
[2025-10-24T17:12:08.644239] [INFO ] [MAIN      ] AMR: Loaded 28953 existing records.
[2025-10-24T17:12:08.821880] [WARN ] [MAIN      ] AMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:12:08.822109] [INFO ] [MAIN      ] AMR: Wiping existing primary data before full refresh.
[2025-10-24T17:12:08.822155] [INFO ] [LOCAL     ] AMR: Starting deletion of primary data.
[2025-10-24T17:12:08.822703] [DEBUG] [LOCAL     ] AMR: Deleted primary data file.
[2025-10-24T17:12:08.822759] [INFO ] [MAIN      ] AMR: Starting full primary refresh.
[2025-10-24T17:12:08.952876] [INFO ] [REMOTE    ] AMPX: Fetching primary data for 2025-04.
[2025-10-24T17:12:09.182864] [INFO ] [REMOTE    ] AMR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:12:09.631344] [INFO ] [REMOTE    ] AMH: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T17:12:09.747608] [INFO ] [REMOTE    ] AMH: Fetching primary data for 2025-09.
[2025-10-24T17:12:10.547625] [INFO ] [REMOTE    ] AMR: Fetching primary data for 2025-01.
[2025-10-24T17:12:10.729895] [INFO ] [REMOTE    ] AMPX: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T17:12:11.351615] [INFO ] [REMOTE    ] AMPX: Fetching primary data for 2025-05.
[2025-10-24T17:12:11.354304] [INFO ] [REMOTE    ] AMH: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T17:12:11.714797] [INFO ] [REMOTE    ] AMR: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T17:12:12.147611] [INFO ] [REMOTE    ] AMR: Fetching primary data for 2025-02.
[2025-10-24T17:12:12.947609] [INFO ] [REMOTE    ] AMPY: Fetching primary data for 2025-02.
[2025-10-24T17:12:13.151955] [INFO ] [REMOTE    ] AMPX: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T17:12:13.251323] [INFO ] [REMOTE    ] AMR: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T17:12:13.747687] [INFO ] [REMOTE    ] AMPX: Fetching primary data for 2025-06.
[2025-10-24T17:12:14.054477] [INFO ] [REMOTE    ] AMPY: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T17:12:14.547719] [INFO ] [REMOTE    ] AMR: Fetching primary data for 2025-03.
[2025-10-24T17:12:15.347686] [INFO ] [REMOTE    ] AMH: Fetching primary data for 2025-10.
[2025-10-24T17:12:15.647914] [INFO ] [REMOTE    ] AMR: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T17:12:15.724231] [INFO ] [REMOTE    ] AMPX: Incremental fetch complete for 2025-06 (1.98 seconds).
[2025-10-24T17:12:16.147681] [INFO ] [REMOTE    ] AMR: Fetching primary data for 2025-04.
[2025-10-24T17:12:16.954920] [INFO ] [REMOTE    ] AMPY: Fetching primary data for 2025-03.
[2025-10-24T17:12:16.981038] [INFO ] [REMOTE    ] AMH: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T17:12:16.993235] [INFO ] [REMOTE    ] AMH: Full fetch complete (75117 records).
[2025-10-24T17:12:16.993410] [DEBUG] [VALIDATOR ] AMH: Validating primary data.
[2025-10-24T17:12:17.387622] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present.
[2025-10-24T17:12:17.387734] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed.
[2025-10-24T17:12:17.388614] [INFO ] [MAIN      ] AMH: Fetched primary data is valid.
[2025-10-24T17:12:17.388776] [DEBUG] [LOCAL     ] AMH: Saving primary data.
[2025-10-24T17:12:17.389426] [FATAL] [LOCAL     ] AMH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:12:17.389520] [FATAL] [MAIN      ] AMH: Failed to save primary data.
[2025-10-24T17:12:17.389563] [WARN ] [MAIN      ] AMH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:12:17.389598] [INFO ] [LOCAL     ] AMH: Starting deletion of primary data.
[2025-10-24T17:12:17.389681] [DEBUG] [LOCAL     ] AMH: No primary data file found to delete.
[2025-10-24T17:12:17.389739] [INFO ] [LOCAL     ] AMH: Starting deletion of derivative data.
[2025-10-24T17:12:17.389892] [DEBUG] [LOCAL     ] AMH: Deleted derivative data file.
[2025-10-24T17:12:17.390560] [INFO ] [MAIN      ] Update Progress: 104/2366 symbols completed. AMH took 43.4s. Estimated remaining: 4h 26m 15s. Rate: 8.5 symbols/min
[2025-10-24T17:12:17.562769] [INFO ] [MAIN      ] AMRC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:12:17.582216] [INFO ] [REMOTE    ] AMR: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T17:12:17.623228] [DEBUG] [LOCAL     ] AMRC: Loaded 38781 existing records from primary storage.
[2025-10-24T17:12:17.623500] [INFO ] [MAIN      ] AMRC: Loaded 38781 existing records.
[2025-10-24T17:12:17.761485] [INFO ] [REMOTE    ] AMR: Fetching primary data for 2025-05.
[2025-10-24T17:12:17.800516] [WARN ] [MAIN      ] AMRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:12:17.800730] [INFO ] [MAIN      ] AMRC: Wiping existing primary data before full refresh.
[2025-10-24T17:12:17.800783] [INFO ] [LOCAL     ] AMRC: Starting deletion of primary data.
[2025-10-24T17:12:17.801409] [DEBUG] [LOCAL     ] AMRC: Deleted primary data file.
[2025-10-24T17:12:17.801467] [INFO ] [MAIN      ] AMRC: Starting full primary refresh.
[2025-10-24T17:12:18.170088] [INFO ] [REMOTE    ] AMRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:12:18.185372] [INFO ] [REMOTE    ] AMPY: Incremental fetch complete for 2025-03 (1.23 seconds).
[2025-10-24T17:12:18.547676] [INFO ] [REMOTE    ] AMPY: Fetching primary data for 2025-04.
[2025-10-24T17:12:18.751808] [INFO ] [REMOTE    ] AMR: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T17:12:19.347687] [INFO ] [REMOTE    ] AMPX: Fetching primary data for 2025-07.
[2025-10-24T17:12:19.972629] [INFO ] [REMOTE    ] AMPY: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T17:12:20.147680] [INFO ] [REMOTE    ] AMPY: Fetching primary data for 2025-05.
[2025-10-24T17:12:20.947713] [INFO ] [REMOTE    ] AMRC: Fetching primary data for 2025-01.
[2025-10-24T17:12:21.504549] [INFO ] [REMOTE    ] AMPY: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T17:12:21.555511] [INFO ] [REMOTE    ] AMPX: Incremental fetch complete for 2025-07 (2.21 seconds).
[2025-10-24T17:12:21.747716] [INFO ] [REMOTE    ] AMPY: Fetching primary data for 2025-06.
[2025-10-24T17:12:22.219452] [INFO ] [REMOTE    ] AMRC: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T17:12:22.547683] [INFO ] [REMOTE    ] AMR: Fetching primary data for 2025-06.
[2025-10-24T17:12:23.261223] [INFO ] [REMOTE    ] AMPY: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T17:12:23.347637] [INFO ] [REMOTE    ] AMPX: Fetching primary data for 2025-08.
[2025-10-24T17:12:23.871786] [INFO ] [REMOTE    ] AMR: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T17:12:24.147677] [INFO ] [REMOTE    ] AMPY: Fetching primary data for 2025-07.
[2025-10-24T17:12:24.947696] [INFO ] [REMOTE    ] AMRC: Fetching primary data for 2025-02.
[2025-10-24T17:12:25.201682] [INFO ] [REMOTE    ] AMPX: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T17:12:25.500267] [INFO ] [REMOTE    ] AMPY: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T17:12:25.747712] [INFO ] [REMOTE    ] AMPX: Fetching primary data for 2025-09.
[2025-10-24T17:12:26.192610] [INFO ] [REMOTE    ] AMRC: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T17:12:26.547690] [INFO ] [REMOTE    ] AMR: Fetching primary data for 2025-07.
[2025-10-24T17:12:27.347630] [INFO ] [REMOTE    ] AMRC: Fetching primary data for 2025-03.
[2025-10-24T17:12:27.711920] [INFO ] [REMOTE    ] AMPX: Incremental fetch complete for 2025-09 (1.96 seconds).
[2025-10-24T17:12:28.076901] [INFO ] [REMOTE    ] AMR: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T17:12:28.147623] [INFO ] [REMOTE    ] AMR: Fetching primary data for 2025-08.
[2025-10-24T17:12:28.605537] [INFO ] [REMOTE    ] AMRC: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T17:12:28.947635] [INFO ] [REMOTE    ] AMPX: Fetching primary data for 2025-10.
[2025-10-24T17:12:29.336220] [INFO ] [REMOTE    ] AMR: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T17:12:29.747671] [INFO ] [REMOTE    ] AMPY: Fetching primary data for 2025-08.
[2025-10-24T17:12:30.547668] [INFO ] [REMOTE    ] AMR: Fetching primary data for 2025-09.
[2025-10-24T17:12:31.067411] [INFO ] [REMOTE    ] AMPY: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T17:12:31.229451] [INFO ] [REMOTE    ] AMPX: Incremental fetch complete for 2025-10 (2.28 seconds).
[2025-10-24T17:12:31.239707] [INFO ] [REMOTE    ] AMPX: Full fetch complete (75257 records).
[2025-10-24T17:12:31.239855] [DEBUG] [VALIDATOR ] AMPX: Validating primary data.
[2025-10-24T17:12:31.352728] [INFO ] [REMOTE    ] AMRC: Fetching primary data for 2025-04.
[2025-10-24T17:12:31.640225] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present.
[2025-10-24T17:12:31.640388] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed.
[2025-10-24T17:12:31.641192] [INFO ] [MAIN      ] AMPX: Fetched primary data is valid.
[2025-10-24T17:12:31.641274] [DEBUG] [LOCAL     ] AMPX: Saving primary data.
[2025-10-24T17:12:31.647088] [FATAL] [LOCAL     ] AMPX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:12:31.647230] [FATAL] [MAIN      ] AMPX: Failed to save primary data.
[2025-10-24T17:12:31.656250] [WARN ] [MAIN      ] AMPX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:12:31.657332] [INFO ] [REMOTE    ] AMR: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T17:12:31.656816] [INFO ] [LOCAL     ] AMPX: Starting deletion of primary data.
[2025-10-24T17:12:31.665922] [DEBUG] [LOCAL     ] AMPX: No primary data file found to delete.
[2025-10-24T17:12:31.666321] [INFO ] [LOCAL     ] AMPX: Starting deletion of derivative data.
[2025-10-24T17:12:31.666624] [DEBUG] [LOCAL     ] AMPX: Deleted derivative data file.
[2025-10-24T17:12:31.667566] [INFO ] [MAIN      ] Update Progress: 105/2366 symbols completed. AMPX took 32.6s. Estimated remaining: 4h 28m 43s. Rate: 8.4 symbols/min
[2025-10-24T17:12:31.859917] [INFO ] [MAIN      ] AMRZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:12:31.860105] [DEBUG] [LOCAL     ] AMRZ: No existing data file found in primary storage.
[2025-10-24T17:12:31.860170] [WARN ] [MAIN      ] AMRZ: No existing data found, performing full refresh instead.
[2025-10-24T17:12:31.860287] [INFO ] [MAIN      ] AMRZ: Wiping existing primary data before full refresh.
[2025-10-24T17:12:31.860330] [INFO ] [LOCAL     ] AMRZ: Starting deletion of primary data.
[2025-10-24T17:12:31.860374] [DEBUG] [LOCAL     ] AMRZ: No primary data file found to delete.
[2025-10-24T17:12:31.860407] [INFO ] [MAIN      ] AMRZ: Starting full primary refresh.
[2025-10-24T17:12:32.152829] [INFO ] [REMOTE    ] AMPY: Fetching primary data for 2025-09.
[2025-10-24T17:12:32.259385] [INFO ] [REMOTE    ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:12:32.848991] [INFO ] [REMOTE    ] AMRC: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T17:12:32.947632] [INFO ] [REMOTE    ] AMRZ: Fetching primary data for 2025-01.
[2025-10-24T17:12:33.146381] [DEBUG] [REMOTE    ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:12:33.146711] [WARN ] [REMOTE    ] AMRZ: No data returned for month 2025-01
[2025-10-24T17:12:33.146794] [FATAL] [REMOTE    ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:12:33.146841] [FATAL] [MAIN      ] AMRZ: Failed to fetch primary data.
[2025-10-24T17:12:33.146897] [WARN ] [MAIN      ] AMRZ: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:12:33.146968] [INFO ] [LOCAL     ] AMRZ: Starting deletion of primary data.
[2025-10-24T17:12:33.147029] [DEBUG] [LOCAL     ] AMRZ: No primary data file found to delete.
[2025-10-24T17:12:33.147064] [INFO ] [LOCAL     ] AMRZ: Starting deletion of derivative data.
[2025-10-24T17:12:33.147103] [DEBUG] [LOCAL     ] AMRZ: No derivative data file found to delete.
[2025-10-24T17:12:33.147149] [INFO ] [MAIN      ] Update Progress: 106/2366 symbols completed. AMRZ took 1.5s. Estimated remaining: 4h 26m 36s. Rate: 8.5 symbols/min
[2025-10-24T17:12:33.322070] [INFO ] [MAIN      ] AMT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:12:33.375817] [DEBUG] [LOCAL     ] AMT: Loaded 52814 existing records from primary storage.
[2025-10-24T17:12:33.376127] [INFO ] [MAIN      ] AMT: Loaded 52814 existing records.
[2025-10-24T17:12:33.563932] [WARN ] [MAIN      ] AMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:12:33.564296] [INFO ] [MAIN      ] AMT: Wiping existing primary data before full refresh.
[2025-10-24T17:12:33.564440] [INFO ] [LOCAL     ] AMT: Starting deletion of primary data.
[2025-10-24T17:12:33.571995] [DEBUG] [LOCAL     ] AMT: Deleted primary data file.
[2025-10-24T17:12:33.583760] [INFO ] [MAIN      ] AMT: Starting full primary refresh.
[2025-10-24T17:12:33.622753] [INFO ] [REMOTE    ] AMPY: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T17:12:33.752726] [INFO ] [REMOTE    ] AMPY: Fetching primary data for 2025-10.
[2025-10-24T17:12:33.992847] [INFO ] [REMOTE    ] AMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:12:34.547707] [INFO ] [REMOTE    ] AMRC: Fetching primary data for 2025-05.
[2025-10-24T17:12:35.238022] [INFO ] [REMOTE    ] AMPY: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T17:12:35.246777] [INFO ] [REMOTE    ] AMPY: Full fetch complete (53562 records).
[2025-10-24T17:12:35.246902] [DEBUG] [VALIDATOR ] AMPY: Validating primary data.
[2025-10-24T17:12:35.353066] [INFO ] [REMOTE    ] AMT: Fetching primary data for 2025-01.
[2025-10-24T17:12:35.639317] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present.
[2025-10-24T17:12:35.639506] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed.
[2025-10-24T17:12:35.640130] [INFO ] [MAIN      ] AMPY: Fetched primary data is valid.
[2025-10-24T17:12:35.640210] [DEBUG] [LOCAL     ] AMPY: Saving primary data.
[2025-10-24T17:12:35.640745] [FATAL] [LOCAL     ] AMPY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:12:35.640968] [FATAL] [MAIN      ] AMPY: Failed to save primary data.
[2025-10-24T17:12:35.641099] [WARN ] [MAIN      ] AMPY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:12:35.641237] [INFO ] [LOCAL     ] AMPY: Starting deletion of primary data.
[2025-10-24T17:12:35.641410] [DEBUG] [LOCAL     ] AMPY: No primary data file found to delete.
[2025-10-24T17:12:35.641573] [INFO ] [LOCAL     ] AMPY: Starting deletion of derivative data.
[2025-10-24T17:12:35.641831] [DEBUG] [LOCAL     ] AMPY: Deleted derivative data file.
[2025-10-24T17:12:35.642350] [INFO ] [MAIN      ] Update Progress: 107/2366 symbols completed. AMPY took 29.2s. Estimated remaining: 4h 24m 52s. Rate: 8.5 symbols/min
[2025-10-24T17:12:35.768621] [INFO ] [REMOTE    ] AMRC: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T17:12:35.844624] [INFO ] [MAIN      ] AMTB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:12:35.867797] [DEBUG] [LOCAL     ] AMTB: Loaded 20600 existing records from primary storage.
[2025-10-24T17:12:35.868041] [INFO ] [MAIN      ] AMTB: Loaded 20600 existing records.
[2025-10-24T17:12:36.048401] [WARN ] [MAIN      ] AMTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:12:36.048695] [INFO ] [MAIN      ] AMTB: Wiping existing primary data before full refresh.
[2025-10-24T17:12:36.048752] [INFO ] [LOCAL     ] AMTB: Starting deletion of primary data.
[2025-10-24T17:12:36.049060] [DEBUG] [LOCAL     ] AMTB: Deleted primary data file.
[2025-10-24T17:12:36.049116] [INFO ] [MAIN      ] AMTB: Starting full primary refresh.
[2025-10-24T17:12:36.147689] [INFO ] [REMOTE    ] AMR: Fetching primary data for 2025-10.
[2025-10-24T17:12:36.398976] [INFO ] [REMOTE    ] AMTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:12:36.947701] [INFO ] [REMOTE    ] AMRC: Fetching primary data for 2025-06.
[2025-10-24T17:12:37.161637] [INFO ] [REMOTE    ] AMT: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T17:12:37.636298] [INFO ] [REMOTE    ] AMR: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T17:12:37.641619] [INFO ] [REMOTE    ] AMR: Full fetch complete (40710 records).
[2025-10-24T17:12:37.641735] [DEBUG] [VALIDATOR ] AMR: Validating primary data.
[2025-10-24T17:12:37.759751] [INFO ] [REMOTE    ] AMT: Fetching primary data for 2025-02.
[2025-10-24T17:12:38.052739] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present.
[2025-10-24T17:12:38.054000] [INFO ] [REMOTE    ] AMRC: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T17:12:38.054083] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed.
[2025-10-24T17:12:38.061283] [INFO ] [MAIN      ] AMR: Fetched primary data is valid.
[2025-10-24T17:12:38.061490] [DEBUG] [LOCAL     ] AMR: Saving primary data.
[2025-10-24T17:12:38.062077] [FATAL] [LOCAL     ] AMR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:12:38.062161] [FATAL] [MAIN      ] AMR: Failed to save primary data.
[2025-10-24T17:12:38.062204] [WARN ] [MAIN      ] AMR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:12:38.062250] [INFO ] [LOCAL     ] AMR: Starting deletion of primary data.
[2025-10-24T17:12:38.062327] [DEBUG] [LOCAL     ] AMR: No primary data file found to delete.
[2025-10-24T17:12:38.062363] [INFO ] [LOCAL     ] AMR: Starting deletion of derivative data.
[2025-10-24T17:12:38.062534] [DEBUG] [LOCAL     ] AMR: Deleted derivative data file.
[2025-10-24T17:12:38.062625] [INFO ] [MAIN      ] Update Progress: 108/2366 symbols completed. AMR took 29.6s. Estimated remaining: 4h 23m 9s. Rate: 8.6 symbols/min
[2025-10-24T17:12:38.227704] [INFO ] [MAIN      ] AMTD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:12:38.232595] [DEBUG] [LOCAL     ] AMTD: Loaded 3818 existing records from primary storage.
[2025-10-24T17:12:38.232767] [INFO ] [MAIN      ] AMTD: Loaded 3818 existing records.
[2025-10-24T17:12:38.405926] [WARN ] [MAIN      ] AMTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:12:38.406132] [INFO ] [MAIN      ] AMTD: Wiping existing primary data before full refresh.
[2025-10-24T17:12:38.406178] [INFO ] [LOCAL     ] AMTD: Starting deletion of primary data.
[2025-10-24T17:12:38.406373] [DEBUG] [LOCAL     ] AMTD: Deleted primary data file.
[2025-10-24T17:12:38.406430] [INFO ] [MAIN      ] AMTD: Starting full primary refresh.
[2025-10-24T17:12:38.553483] [INFO ] [REMOTE    ] AMTB: Fetching primary data for 2025-01.
[2025-10-24T17:12:38.765638] [INFO ] [REMOTE    ] AMTD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:12:39.110107] [INFO ] [REMOTE    ] AMT: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T17:12:39.347672] [INFO ] [REMOTE    ] AMRC: Fetching primary data for 2025-07.
[2025-10-24T17:12:40.149983] [INFO ] [REMOTE    ] AMT: Fetching primary data for 2025-03.
[2025-10-24T17:12:40.151701] [INFO ] [REMOTE    ] AMTB: Incremental fetch complete for 2025-01 (1.60 seconds).
[2025-10-24T17:12:40.947700] [INFO ] [REMOTE    ] AMTB: Fetching primary data for 2025-02.
[2025-10-24T17:12:40.949930] [INFO ] [REMOTE    ] AMRC: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T17:12:41.532468] [INFO ] [REMOTE    ] AMT: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T17:12:41.658991] [INFO ] [REMOTE    ] AMTB: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T17:12:41.747629] [INFO ] [REMOTE    ] AMTB: Fetching primary data for 2025-03.
[2025-10-24T17:12:42.547639] [INFO ] [REMOTE    ] AMRC: Fetching primary data for 2025-08.
[2025-10-24T17:12:42.826626] [INFO ] [REMOTE    ] AMTB: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T17:12:43.347721] [INFO ] [REMOTE    ] AMTD: Fetching primary data for 2025-01.
[2025-10-24T17:12:43.818311] [INFO ] [REMOTE    ] AMTD: Incremental fetch complete for 2025-01 (0.47 seconds).
[2025-10-24T17:12:44.057427] [INFO ] [REMOTE    ] AMRC: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T17:12:44.147617] [INFO ] [REMOTE    ] AMRC: Fetching primary data for 2025-09.
[2025-10-24T17:12:44.947675] [INFO ] [REMOTE    ] AMTD: Fetching primary data for 2025-02.
[2025-10-24T17:12:45.584496] [INFO ] [REMOTE    ] AMTD: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T17:12:45.609058] [INFO ] [REMOTE    ] AMRC: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T17:12:45.747610] [INFO ] [REMOTE    ] AMRC: Fetching primary data for 2025-10.
[2025-10-24T17:12:46.547746] [INFO ] [REMOTE    ] AMTD: Fetching primary data for 2025-03.
[2025-10-24T17:12:46.932308] [INFO ] [REMOTE    ] AMTD: Incremental fetch complete for 2025-03 (0.38 seconds).
[2025-10-24T17:12:47.347688] [INFO ] [REMOTE    ] AMTB: Fetching primary data for 2025-04.
[2025-10-24T17:12:47.445091] [INFO ] [REMOTE    ] AMRC: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T17:12:47.452793] [INFO ] [REMOTE    ] AMRC: Full fetch complete (54669 records).
[2025-10-24T17:12:47.452903] [DEBUG] [VALIDATOR ] AMRC: Validating primary data.
[2025-10-24T17:12:47.833943] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present.
[2025-10-24T17:12:47.834053] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed.
[2025-10-24T17:12:47.834660] [INFO ] [MAIN      ] AMRC: Fetched primary data is valid.
[2025-10-24T17:12:47.834721] [DEBUG] [LOCAL     ] AMRC: Saving primary data.
[2025-10-24T17:12:47.835308] [FATAL] [LOCAL     ] AMRC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:12:47.835407] [FATAL] [MAIN      ] AMRC: Failed to save primary data.
[2025-10-24T17:12:47.835489] [WARN ] [MAIN      ] AMRC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:12:47.835568] [INFO ] [LOCAL     ] AMRC: Starting deletion of primary data.
[2025-10-24T17:12:47.835673] [DEBUG] [LOCAL     ] AMRC: No primary data file found to delete.
[2025-10-24T17:12:47.835749] [INFO ] [LOCAL     ] AMRC: Starting deletion of derivative data.
[2025-10-24T17:12:47.835968] [DEBUG] [LOCAL     ] AMRC: Deleted derivative data file.
[2025-10-24T17:12:47.836481] [INFO ] [MAIN      ] Update Progress: 109/2366 symbols completed. AMRC took 30.4s. Estimated remaining: 4h 23m 59s. Rate: 8.5 symbols/min
[2025-10-24T17:12:48.004834] [INFO ] [MAIN      ] AMTM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:12:48.053587] [DEBUG] [LOCAL     ] AMTM: Loaded 50606 existing records from primary storage.
[2025-10-24T17:12:48.053932] [INFO ] [MAIN      ] AMTM: Loaded 50606 existing records.
[2025-10-24T17:12:48.157842] [INFO ] [REMOTE    ] AMTD: Fetching primary data for 2025-04.
[2025-10-24T17:12:48.241483] [WARN ] [MAIN      ] AMTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:12:48.241694] [INFO ] [MAIN      ] AMTM: Wiping existing primary data before full refresh.
[2025-10-24T17:12:48.241762] [INFO ] [LOCAL     ] AMTM: Starting deletion of primary data.
[2025-10-24T17:12:48.242627] [DEBUG] [LOCAL     ] AMTM: Deleted primary data file.
[2025-10-24T17:12:48.242727] [INFO ] [MAIN      ] AMTM: Starting full primary refresh.
[2025-10-24T17:12:48.560173] [INFO ] [REMOTE    ] AMTB: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T17:12:48.626615] [INFO ] [REMOTE    ] AMTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:12:48.648119] [INFO ] [REMOTE    ] AMTD: Incremental fetch complete for 2025-04 (0.49 seconds).
[2025-10-24T17:12:48.947719] [INFO ] [REMOTE    ] AMTM: Fetching primary data for 2025-01.
[2025-10-24T17:12:49.747684] [INFO ] [REMOTE    ] AMTB: Fetching primary data for 2025-05.
[2025-10-24T17:12:50.508196] [INFO ] [REMOTE    ] AMTM: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T17:12:50.547600] [INFO ] [REMOTE    ] AMTM: Fetching primary data for 2025-02.
[2025-10-24T17:12:50.790770] [INFO ] [REMOTE    ] AMTB: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T17:12:51.347743] [INFO ] [REMOTE    ] AMT: Fetching primary data for 2025-04.
[2025-10-24T17:12:51.867012] [INFO ] [REMOTE    ] AMTM: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T17:12:52.147758] [INFO ] [REMOTE    ] AMTM: Fetching primary data for 2025-03.
[2025-10-24T17:12:52.939478] [INFO ] [REMOTE    ] AMT: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T17:12:52.955271] [INFO ] [REMOTE    ] AMTB: Fetching primary data for 2025-06.
[2025-10-24T17:12:53.592416] [INFO ] [REMOTE    ] AMTM: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T17:12:53.632082] [INFO ] [REMOTE    ] AMTB: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T17:12:53.747711] [INFO ] [REMOTE    ] AMTD: Fetching primary data for 2025-05.
[2025-10-24T17:12:54.290820] [INFO ] [REMOTE    ] AMTD: Incremental fetch complete for 2025-05 (0.54 seconds).
[2025-10-24T17:12:54.547694] [INFO ] [REMOTE    ] AMTD: Fetching primary data for 2025-06.
[2025-10-24T17:12:55.233671] [INFO ] [REMOTE    ] AMTD: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T17:12:55.347718] [INFO ] [REMOTE    ] AMTB: Fetching primary data for 2025-07.
[2025-10-24T17:12:56.147634] [INFO ] [REMOTE    ] AMT: Fetching primary data for 2025-05.
[2025-10-24T17:12:56.460938] [INFO ] [REMOTE    ] AMTB: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T17:12:56.947675] [INFO ] [REMOTE    ] AMTB: Fetching primary data for 2025-08.
[2025-10-24T17:12:57.747722] [INFO ] [REMOTE    ] AMTD: Fetching primary data for 2025-07.
[2025-10-24T17:12:57.871068] [INFO ] [REMOTE    ] AMT: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T17:12:57.913824] [INFO ] [REMOTE    ] AMTB: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T17:12:58.077115] [INFO ] [REMOTE    ] AMTD: Incremental fetch complete for 2025-07 (0.33 seconds).
[2025-10-24T17:12:58.547723] [INFO ] [REMOTE    ] AMTM: Fetching primary data for 2025-04.
[2025-10-24T17:12:59.347678] [INFO ] [REMOTE    ] AMTB: Fetching primary data for 2025-09.
[2025-10-24T17:13:00.030889] [INFO ] [REMOTE    ] AMTM: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T17:13:00.147608] [INFO ] [REMOTE    ] AMTM: Fetching primary data for 2025-05.
[2025-10-24T17:13:00.268753] [INFO ] [REMOTE    ] AMTB: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T17:13:00.947704] [INFO ] [REMOTE    ] AMT: Fetching primary data for 2025-06.
[2025-10-24T17:13:01.747611] [INFO ] [REMOTE    ] AMTB: Fetching primary data for 2025-10.
[2025-10-24T17:13:01.872877] [INFO ] [REMOTE    ] AMTM: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T17:13:02.547683] [INFO ] [REMOTE    ] AMTD: Fetching primary data for 2025-08.
[2025-10-24T17:13:03.029111] [INFO ] [REMOTE    ] AMT: Incremental fetch complete for 2025-06 (2.08 seconds).
[2025-10-24T17:13:03.347707] [INFO ] [REMOTE    ] AMT: Fetching primary data for 2025-07.
[2025-10-24T17:13:03.383587] [INFO ] [REMOTE    ] AMTD: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T17:13:03.881827] [INFO ] [REMOTE    ] AMTB: Incremental fetch complete for 2025-10 (2.13 seconds).
[2025-10-24T17:13:03.886029] [INFO ] [REMOTE    ] AMTB: Full fetch complete (29743 records).
[2025-10-24T17:13:03.886111] [DEBUG] [VALIDATOR ] AMTB: Validating primary data.
[2025-10-24T17:13:04.152764] [INFO ] [REMOTE    ] AMTM: Fetching primary data for 2025-06.
[2025-10-24T17:13:04.259062] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present.
[2025-10-24T17:13:04.259142] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed.
[2025-10-24T17:13:04.259531] [INFO ] [MAIN      ] AMTB: Fetched primary data is valid.
[2025-10-24T17:13:04.259571] [DEBUG] [LOCAL     ] AMTB: Saving primary data.
[2025-10-24T17:13:04.259916] [FATAL] [LOCAL     ] AMTB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:13:04.260011] [FATAL] [MAIN      ] AMTB: Failed to save primary data.
[2025-10-24T17:13:04.260083] [WARN ] [MAIN      ] AMTB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:13:04.260173] [INFO ] [LOCAL     ] AMTB: Starting deletion of primary data.
[2025-10-24T17:13:04.260251] [DEBUG] [LOCAL     ] AMTB: No primary data file found to delete.
[2025-10-24T17:13:04.260289] [INFO ] [LOCAL     ] AMTB: Starting deletion of derivative data.
[2025-10-24T17:13:04.260467] [DEBUG] [LOCAL     ] AMTB: Deleted derivative data file.
[2025-10-24T17:13:04.260564] [INFO ] [MAIN      ] Update Progress: 110/2366 symbols completed. AMTB took 28.6s. Estimated remaining: 4h 27m 5s. Rate: 8.4 symbols/min
[2025-10-24T17:13:04.429580] [INFO ] [MAIN      ] AMWL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:13:04.441517] [DEBUG] [LOCAL     ] AMWL: Loaded 9907 existing records from primary storage.
[2025-10-24T17:13:04.441801] [INFO ] [MAIN      ] AMWL: Loaded 9907 existing records.
[2025-10-24T17:13:04.617187] [WARN ] [MAIN      ] AMWL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:13:04.617397] [INFO ] [MAIN      ] AMWL: Wiping existing primary data before full refresh.
[2025-10-24T17:13:04.617450] [INFO ] [LOCAL     ] AMWL: Starting deletion of primary data.
[2025-10-24T17:13:04.617803] [DEBUG] [LOCAL     ] AMWL: Deleted primary data file.
[2025-10-24T17:13:04.617861] [INFO ] [MAIN      ] AMWL: Starting full primary refresh.
[2025-10-24T17:13:04.952782] [INFO ] [REMOTE    ] AMTD: Fetching primary data for 2025-09.
[2025-10-24T17:13:05.014903] [INFO ] [REMOTE    ] AMWL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:13:05.747610] [INFO ] [REMOTE    ] AMWL: Fetching primary data for 2025-01.
[2025-10-24T17:13:05.960306] [INFO ] [REMOTE    ] AMTD: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T17:13:06.536958] [INFO ] [REMOTE    ] AMWL: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T17:13:06.547602] [INFO ] [REMOTE    ] AMWL: Fetching primary data for 2025-02.
[2025-10-24T17:13:06.821217] [INFO ] [REMOTE    ] AMT: Incremental fetch complete for 2025-07 (3.47 seconds).
[2025-10-24T17:13:06.917272] [INFO ] [REMOTE    ] AMTM: Incremental fetch complete for 2025-06 (2.76 seconds).
[2025-10-24T17:13:07.096991] [INFO ] [REMOTE    ] AMWL: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T17:13:07.347722] [INFO ] [REMOTE    ] AMTM: Fetching primary data for 2025-07.
[2025-10-24T17:13:08.147691] [INFO ] [REMOTE    ] AMTD: Fetching primary data for 2025-10.
[2025-10-24T17:13:08.712065] [INFO ] [REMOTE    ] AMTD: Incremental fetch complete for 2025-10 (0.56 seconds).
[2025-10-24T17:13:08.713290] [INFO ] [REMOTE    ] AMTD: Full fetch complete (5357 records).
[2025-10-24T17:13:08.713361] [DEBUG] [VALIDATOR ] AMTD: Validating primary data.
[2025-10-24T17:13:08.952973] [INFO ] [REMOTE    ] AMT: Fetching primary data for 2025-08.
[2025-10-24T17:13:09.100919] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present.
[2025-10-24T17:13:09.101026] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed.
[2025-10-24T17:13:09.101208] [INFO ] [MAIN      ] AMTD: Fetched primary data is valid.
[2025-10-24T17:13:09.101286] [DEBUG] [LOCAL     ] AMTD: Saving primary data.
[2025-10-24T17:13:09.101603] [FATAL] [LOCAL     ] AMTD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:13:09.101773] [FATAL] [MAIN      ] AMTD: Failed to save primary data.
[2025-10-24T17:13:09.101899] [WARN ] [MAIN      ] AMTD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:13:09.102004] [INFO ] [LOCAL     ] AMTD: Starting deletion of primary data.
[2025-10-24T17:13:09.102190] [DEBUG] [LOCAL     ] AMTD: No primary data file found to delete.
[2025-10-24T17:13:09.102287] [INFO ] [LOCAL     ] AMTD: Starting deletion of derivative data.
[2025-10-24T17:13:09.102969] [DEBUG] [LOCAL     ] AMTD: Deleted derivative data file.
[2025-10-24T17:13:09.103065] [INFO ] [MAIN      ] Update Progress: 111/2366 symbols completed. AMTD took 31.0s. Estimated remaining: 4h 26m 12s. Rate: 8.5 symbols/min
[2025-10-24T17:13:09.244844] [INFO ] [REMOTE    ] AMTM: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T17:13:09.325995] [INFO ] [MAIN      ] AMX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:13:09.376813] [DEBUG] [LOCAL     ] AMX: Loaded 49530 existing records from primary storage.
[2025-10-24T17:13:09.377107] [INFO ] [MAIN      ] AMX: Loaded 49530 existing records.
[2025-10-24T17:13:09.558811] [WARN ] [MAIN      ] AMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:13:09.559027] [INFO ] [MAIN      ] AMX: Wiping existing primary data before full refresh.
[2025-10-24T17:13:09.559075] [INFO ] [LOCAL     ] AMX: Starting deletion of primary data.
[2025-10-24T17:13:09.559975] [DEBUG] [LOCAL     ] AMX: Deleted primary data file.
[2025-10-24T17:13:09.560034] [INFO ] [MAIN      ] AMX: Starting full primary refresh.
[2025-10-24T17:13:09.752915] [INFO ] [REMOTE    ] AMTM: Fetching primary data for 2025-08.
[2025-10-24T17:13:09.926272] [INFO ] [REMOTE    ] AMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:13:10.547710] [INFO ] [REMOTE    ] AMWL: Fetching primary data for 2025-03.
[2025-10-24T17:13:10.704947] [INFO ] [REMOTE    ] AMT: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T17:13:10.960704] [INFO ] [REMOTE    ] AMWL: Incremental fetch complete for 2025-03 (0.41 seconds).
[2025-10-24T17:13:11.324342] [INFO ] [REMOTE    ] AMTM: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T17:13:11.347611] [INFO ] [REMOTE    ] AMTM: Fetching primary data for 2025-09.
[2025-10-24T17:13:12.147698] [INFO ] [REMOTE    ] AMX: Fetching primary data for 2025-01.
[2025-10-24T17:13:12.638824] [INFO ] [REMOTE    ] AMTM: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T17:13:12.947678] [INFO ] [REMOTE    ] AMTM: Fetching primary data for 2025-10.
[2025-10-24T17:13:13.529198] [INFO ] [REMOTE    ] AMX: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T17:13:13.747681] [INFO ] [REMOTE    ] AMWL: Fetching primary data for 2025-04.
[2025-10-24T17:13:14.483003] [INFO ] [REMOTE    ] AMWL: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T17:13:14.547715] [INFO ] [REMOTE    ] AMWL: Fetching primary data for 2025-05.
[2025-10-24T17:13:14.652130] [INFO ] [REMOTE    ] AMTM: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T17:13:14.661154] [INFO ] [REMOTE    ] AMTM: Full fetch complete (73560 records).
[2025-10-24T17:13:14.661308] [DEBUG] [VALIDATOR ] AMTM: Validating primary data.
[2025-10-24T17:13:15.054582] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present.
[2025-10-24T17:13:15.054718] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed.
[2025-10-24T17:13:15.055639] [INFO ] [MAIN      ] AMTM: Fetched primary data is valid.
[2025-10-24T17:13:15.055729] [DEBUG] [LOCAL     ] AMTM: Saving primary data.
[2025-10-24T17:13:15.056327] [FATAL] [LOCAL     ] AMTM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:13:15.056418] [FATAL] [MAIN      ] AMTM: Failed to save primary data.
[2025-10-24T17:13:15.056461] [WARN ] [MAIN      ] AMTM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:13:15.056535] [INFO ] [LOCAL     ] AMTM: Starting deletion of primary data.
[2025-10-24T17:13:15.056596] [DEBUG] [LOCAL     ] AMTM: No primary data file found to delete.
[2025-10-24T17:13:15.056632] [INFO ] [LOCAL     ] AMTM: Starting deletion of derivative data.
[2025-10-24T17:13:15.056935] [DEBUG] [LOCAL     ] AMTM: Deleted derivative data file.
[2025-10-24T17:13:15.057678] [INFO ] [MAIN      ] Update Progress: 112/2366 symbols completed. AMTM took 27.2s. Estimated remaining: 4h 25m 42s. Rate: 8.5 symbols/min
[2025-10-24T17:13:15.236190] [INFO ] [MAIN      ] AN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:13:15.237181] [INFO ] [REMOTE    ] AMWL: Incremental fetch complete for 2025-05 (0.69 seconds).
[2025-10-24T17:13:15.271485] [DEBUG] [LOCAL     ] AN: Loaded 31320 existing records from primary storage.
[2025-10-24T17:13:15.271790] [INFO ] [MAIN      ] AN: Loaded 31320 existing records.
[2025-10-24T17:13:15.352938] [INFO ] [REMOTE    ] AMT: Fetching primary data for 2025-09.
[2025-10-24T17:13:15.450625] [WARN ] [MAIN      ] AN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:13:15.450860] [INFO ] [MAIN      ] AN: Wiping existing primary data before full refresh.
[2025-10-24T17:13:15.450907] [INFO ] [LOCAL     ] AN: Starting deletion of primary data.
[2025-10-24T17:13:15.451508] [DEBUG] [LOCAL     ] AN: Deleted primary data file.
[2025-10-24T17:13:15.451564] [INFO ] [MAIN      ] AN: Starting full primary refresh.
[2025-10-24T17:13:15.804796] [INFO ] [REMOTE    ] AN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:13:16.147639] [INFO ] [REMOTE    ] AMWL: Fetching primary data for 2025-06.
[2025-10-24T17:13:16.921403] [INFO ] [REMOTE    ] AMWL: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T17:13:16.947690] [INFO ] [REMOTE    ] AMWL: Fetching primary data for 2025-07.
[2025-10-24T17:13:17.293800] [INFO ] [REMOTE    ] AMT: Incremental fetch complete for 2025-09 (1.94 seconds).
[2025-10-24T17:13:17.746904] [INFO ] [REMOTE    ] AMWL: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T17:13:17.749849] [INFO ] [REMOTE    ] AMWL: Fetching primary data for 2025-08.
[2025-10-24T17:13:18.467400] [INFO ] [REMOTE    ] AMWL: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T17:13:18.547634] [INFO ] [REMOTE    ] AMT: Fetching primary data for 2025-10.
[2025-10-24T17:13:19.347677] [INFO ] [REMOTE    ] AMWL: Fetching primary data for 2025-09.
[2025-10-24T17:13:20.139752] [INFO ] [REMOTE    ] AMWL: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T17:13:20.147596] [INFO ] [REMOTE    ] AN: Fetching primary data for 2025-01.
[2025-10-24T17:13:20.435832] [INFO ] [REMOTE    ] AMT: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T17:13:20.445927] [INFO ] [REMOTE    ] AMT: Full fetch complete (76156 records).
[2025-10-24T17:13:20.446054] [DEBUG] [VALIDATOR ] AMT: Validating primary data.
[2025-10-24T17:13:20.827183] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present.
[2025-10-24T17:13:20.827259] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed.
[2025-10-24T17:13:20.828030] [INFO ] [MAIN      ] AMT: Fetched primary data is valid.
[2025-10-24T17:13:20.828091] [DEBUG] [LOCAL     ] AMT: Saving primary data.
[2025-10-24T17:13:20.828632] [FATAL] [LOCAL     ] AMT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:13:20.828743] [FATAL] [MAIN      ] AMT: Failed to save primary data.
[2025-10-24T17:13:20.828785] [WARN ] [MAIN      ] AMT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:13:20.828825] [INFO ] [LOCAL     ] AMT: Starting deletion of primary data.
[2025-10-24T17:13:20.828876] [DEBUG] [LOCAL     ] AMT: No primary data file found to delete.
[2025-10-24T17:13:20.828911] [INFO ] [LOCAL     ] AMT: Starting deletion of derivative data.
[2025-10-24T17:13:20.829058] [DEBUG] [LOCAL     ] AMT: Deleted derivative data file.
[2025-10-24T17:13:20.829696] [INFO ] [MAIN      ] Update Progress: 113/2366 symbols completed. AMT took 47.7s. Estimated remaining: 4h 25m 9s. Rate: 8.5 symbols/min
[2025-10-24T17:13:20.952845] [INFO ] [REMOTE    ] AMX: Fetching primary data for 2025-02.
[2025-10-24T17:13:20.999204] [INFO ] [MAIN      ] ANET: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:13:21.053988] [DEBUG] [LOCAL     ] ANET: Loaded 54156 existing records from primary storage.
[2025-10-24T17:13:21.054288] [INFO ] [MAIN      ] ANET: Loaded 54156 existing records.
[2025-10-24T17:13:21.232532] [WARN ] [MAIN      ] ANET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:13:21.232890] [INFO ] [MAIN      ] ANET: Wiping existing primary data before full refresh.
[2025-10-24T17:13:21.232944] [INFO ] [LOCAL     ] ANET: Starting deletion of primary data.
[2025-10-24T17:13:21.233807] [DEBUG] [LOCAL     ] ANET: Deleted primary data file.
[2025-10-24T17:13:21.233865] [INFO ] [MAIN      ] ANET: Starting full primary refresh.
[2025-10-24T17:13:21.606931] [INFO ] [REMOTE    ] ANET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:13:21.610301] [INFO ] [REMOTE    ] AN: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T17:13:21.747622] [INFO ] [REMOTE    ] ANET: Fetching primary data for 2025-01.
[2025-10-24T17:13:22.395456] [INFO ] [REMOTE    ] AMX: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T17:13:22.547614] [INFO ] [REMOTE    ] AN: Fetching primary data for 2025-02.
[2025-10-24T17:13:23.347666] [INFO ] [REMOTE    ] AMWL: Fetching primary data for 2025-10.
[2025-10-24T17:13:23.608451] [INFO ] [REMOTE    ] ANET: Incremental fetch complete for 2025-01 (1.86 seconds).
[2025-10-24T17:13:23.631518] [INFO ] [REMOTE    ] AN: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T17:13:24.147694] [INFO ] [REMOTE    ] AN: Fetching primary data for 2025-03.
[2025-10-24T17:13:24.293856] [INFO ] [REMOTE    ] AMWL: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T17:13:24.297682] [INFO ] [REMOTE    ] AMWL: Full fetch complete (14902 records).
[2025-10-24T17:13:24.297767] [DEBUG] [VALIDATOR ] AMWL: Validating primary data.
[2025-10-24T17:13:24.695390] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present.
[2025-10-24T17:13:24.695488] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed.
[2025-10-24T17:13:24.695874] [INFO ] [MAIN      ] AMWL: Fetched primary data is valid.
[2025-10-24T17:13:24.695938] [DEBUG] [LOCAL     ] AMWL: Saving primary data.
[2025-10-24T17:13:24.696332] [FATAL] [LOCAL     ] AMWL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:13:24.696423] [FATAL] [MAIN      ] AMWL: Failed to save primary data.
[2025-10-24T17:13:24.696466] [WARN ] [MAIN      ] AMWL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:13:24.696501] [INFO ] [LOCAL     ] AMWL: Starting deletion of primary data.
[2025-10-24T17:13:24.696557] [DEBUG] [LOCAL     ] AMWL: No primary data file found to delete.
[2025-10-24T17:13:24.696593] [INFO ] [LOCAL     ] AMWL: Starting deletion of derivative data.
[2025-10-24T17:13:24.696806] [DEBUG] [LOCAL     ] AMWL: Deleted derivative data file.
[2025-10-24T17:13:24.696906] [INFO ] [MAIN      ] Update Progress: 114/2366 symbols completed. AMWL took 20.4s. Estimated remaining: 4h 23m 59s. Rate: 8.5 symbols/min
[2025-10-24T17:13:24.874937] [INFO ] [MAIN      ] ANF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:13:24.928415] [DEBUG] [LOCAL     ] ANF: Loaded 52408 existing records from primary storage.
[2025-10-24T17:13:24.928768] [INFO ] [MAIN      ] ANF: Loaded 52408 existing records.
[2025-10-24T17:13:24.952953] [INFO ] [REMOTE    ] ANET: Fetching primary data for 2025-02.
[2025-10-24T17:13:25.122082] [WARN ] [MAIN      ] ANF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:13:25.122322] [INFO ] [MAIN      ] ANF: Wiping existing primary data before full refresh.
[2025-10-24T17:13:25.122392] [INFO ] [LOCAL     ] ANF: Starting deletion of primary data.
[2025-10-24T17:13:25.123253] [DEBUG] [LOCAL     ] ANF: Deleted primary data file.
[2025-10-24T17:13:25.123311] [INFO ] [MAIN      ] ANF: Starting full primary refresh.
[2025-10-24T17:13:25.487413] [INFO ] [REMOTE    ] ANF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:13:25.581508] [INFO ] [REMOTE    ] AN: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T17:13:25.747668] [INFO ] [REMOTE    ] AN: Fetching primary data for 2025-04.
[2025-10-24T17:13:26.547716] [INFO ] [REMOTE    ] AMX: Fetching primary data for 2025-03.
[2025-10-24T17:13:26.851543] [INFO ] [REMOTE    ] AN: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T17:13:26.890138] [INFO ] [REMOTE    ] ANET: Incremental fetch complete for 2025-02 (1.94 seconds).
[2025-10-24T17:13:27.347722] [INFO ] [REMOTE    ] AN: Fetching primary data for 2025-05.
[2025-10-24T17:13:27.974317] [INFO ] [REMOTE    ] AMX: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T17:13:28.147700] [INFO ] [REMOTE    ] ANF: Fetching primary data for 2025-01.
[2025-10-24T17:13:28.719975] [INFO ] [REMOTE    ] AN: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T17:13:28.947672] [INFO ] [REMOTE    ] AMX: Fetching primary data for 2025-04.
[2025-10-24T17:13:29.747695] [INFO ] [REMOTE    ] AN: Fetching primary data for 2025-06.
[2025-10-24T17:13:29.919051] [INFO ] [REMOTE    ] ANF: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T17:13:30.485883] [INFO ] [REMOTE    ] AMX: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T17:13:30.547634] [INFO ] [REMOTE    ] AMX: Fetching primary data for 2025-05.
[2025-10-24T17:13:30.799274] [INFO ] [REMOTE    ] AN: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T17:13:31.347711] [INFO ] [REMOTE    ] ANF: Fetching primary data for 2025-02.
[2025-10-24T17:13:32.134905] [INFO ] [REMOTE    ] AMX: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T17:13:32.147613] [INFO ] [REMOTE    ] AN: Fetching primary data for 2025-07.
[2025-10-24T17:13:32.932199] [INFO ] [REMOTE    ] ANF: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T17:13:32.947593] [INFO ] [REMOTE    ] ANF: Fetching primary data for 2025-03.
[2025-10-24T17:13:33.582042] [INFO ] [REMOTE    ] AN: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T17:13:33.747684] [INFO ] [REMOTE    ] ANET: Fetching primary data for 2025-03.
[2025-10-24T17:13:34.534617] [INFO ] [REMOTE    ] ANF: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T17:13:34.547616] [INFO ] [REMOTE    ] ANF: Fetching primary data for 2025-04.
[2025-10-24T17:13:35.347713] [INFO ] [REMOTE    ] AN: Fetching primary data for 2025-08.
[2025-10-24T17:13:35.908286] [INFO ] [REMOTE    ] ANET: Incremental fetch complete for 2025-03 (2.16 seconds).
[2025-10-24T17:13:36.002700] [INFO ] [REMOTE    ] ANF: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T17:13:36.147682] [INFO ] [REMOTE    ] AMX: Fetching primary data for 2025-06.
[2025-10-24T17:13:36.436036] [INFO ] [REMOTE    ] AN: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T17:13:36.947687] [INFO ] [REMOTE    ] AN: Fetching primary data for 2025-09.
[2025-10-24T17:13:37.614220] [INFO ] [REMOTE    ] AMX: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T17:13:37.747706] [INFO ] [REMOTE    ] AMX: Fetching primary data for 2025-07.
[2025-10-24T17:13:38.138011] [INFO ] [REMOTE    ] AN: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T17:13:38.547716] [INFO ] [REMOTE    ] ANF: Fetching primary data for 2025-05.
[2025-10-24T17:13:39.347669] [INFO ] [REMOTE    ] AN: Fetching primary data for 2025-10.
[2025-10-24T17:13:39.551421] [INFO ] [REMOTE    ] AMX: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T17:13:40.147704] [INFO ] [REMOTE    ] ANET: Fetching primary data for 2025-04.
[2025-10-24T17:13:40.376979] [INFO ] [REMOTE    ] ANF: Incremental fetch complete for 2025-05 (1.83 seconds).
[2025-10-24T17:13:40.587101] [INFO ] [REMOTE    ] AN: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T17:13:40.596299] [INFO ] [REMOTE    ] AN: Full fetch complete (47148 records).
[2025-10-24T17:13:40.596563] [DEBUG] [VALIDATOR ] AN: Validating primary data.
[2025-10-24T17:13:40.952882] [INFO ] [REMOTE    ] ANF: Fetching primary data for 2025-06.
[2025-10-24T17:13:41.032811] [DEBUG] [VALIDATOR ] AN: All expected trading days are present.
[2025-10-24T17:13:41.032944] [DEBUG] [VALIDATOR ] AN: Primary data validation passed.
[2025-10-24T17:13:41.033807] [INFO ] [MAIN      ] AN: Fetched primary data is valid.
[2025-10-24T17:13:41.033913] [DEBUG] [LOCAL     ] AN: Saving primary data.
[2025-10-24T17:13:41.034803] [FATAL] [LOCAL     ] AN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:13:41.034915] [FATAL] [MAIN      ] AN: Failed to save primary data.
[2025-10-24T17:13:41.034960] [WARN ] [MAIN      ] AN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:13:41.034998] [INFO ] [LOCAL     ] AN: Starting deletion of primary data.
[2025-10-24T17:13:41.035061] [DEBUG] [LOCAL     ] AN: No primary data file found to delete.
[2025-10-24T17:13:41.035100] [INFO ] [LOCAL     ] AN: Starting deletion of derivative data.
[2025-10-24T17:13:41.035314] [DEBUG] [LOCAL     ] AN: Deleted derivative data file.
[2025-10-24T17:13:41.035441] [INFO ] [MAIN      ] Update Progress: 115/2366 symbols completed. AN took 26.0s. Estimated remaining: 4h 26m 54s. Rate: 8.4 symbols/min
[2025-10-24T17:13:41.236591] [INFO ] [MAIN      ] ANGX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:13:41.236898] [DEBUG] [LOCAL     ] ANGX: No existing data file found in primary storage.
[2025-10-24T17:13:41.236946] [WARN ] [MAIN      ] ANGX: No existing data found, performing full refresh instead.
[2025-10-24T17:13:41.237076] [INFO ] [MAIN      ] ANGX: Wiping existing primary data before full refresh.
[2025-10-24T17:13:41.237123] [INFO ] [LOCAL     ] ANGX: Starting deletion of primary data.
[2025-10-24T17:13:41.237164] [DEBUG] [LOCAL     ] ANGX: No primary data file found to delete.
[2025-10-24T17:13:41.237196] [INFO ] [MAIN      ] ANGX: Starting full primary refresh.
[2025-10-24T17:13:41.604758] [INFO ] [REMOTE    ] ANGX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:13:41.747752] [INFO ] [REMOTE    ] ANGX: Fetching primary data for 2025-01.
[2025-10-24T17:13:42.015242] [DEBUG] [REMOTE    ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:13:42.015703] [WARN ] [REMOTE    ] ANGX: No data returned for month 2025-01
[2025-10-24T17:13:42.015788] [FATAL] [REMOTE    ] ANGX: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:13:42.015862] [FATAL] [MAIN      ] ANGX: Failed to fetch primary data.
[2025-10-24T17:13:42.015930] [WARN ] [MAIN      ] ANGX: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:13:42.016006] [INFO ] [LOCAL     ] ANGX: Starting deletion of primary data.
[2025-10-24T17:13:42.016077] [DEBUG] [LOCAL     ] ANGX: No primary data file found to delete.
[2025-10-24T17:13:42.016116] [INFO ] [LOCAL     ] ANGX: Starting deletion of derivative data.
[2025-10-24T17:13:42.016159] [DEBUG] [LOCAL     ] ANGX: No derivative data file found to delete.
[2025-10-24T17:13:42.016216] [INFO ] [MAIN      ] Update Progress: 116/2366 symbols completed. ANGX took 1.0s. Estimated remaining: 4h 24m 48s. Rate: 8.5 symbols/min
[2025-10-24T17:13:42.201684] [INFO ] [MAIN      ] ANRO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:13:42.238251] [INFO ] [REMOTE    ] ANET: Incremental fetch complete for 2025-04 (2.09 seconds).
[2025-10-24T17:13:42.265970] [DEBUG] [LOCAL     ] ANRO: Loaded 19930 existing records from primary storage.
[2025-10-24T17:13:42.266448] [INFO ] [MAIN      ] ANRO: Loaded 19930 existing records.
[2025-10-24T17:13:42.462522] [WARN ] [MAIN      ] ANRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:13:42.463095] [INFO ] [MAIN      ] ANRO: Wiping existing primary data before full refresh.
[2025-10-24T17:13:42.463219] [INFO ] [LOCAL     ] ANRO: Starting deletion of primary data.
[2025-10-24T17:13:42.464206] [DEBUG] [LOCAL     ] ANRO: Deleted primary data file.
[2025-10-24T17:13:42.464478] [INFO ] [MAIN      ] ANRO: Starting full primary refresh.
[2025-10-24T17:13:42.550227] [INFO ] [REMOTE    ] AMX: Fetching primary data for 2025-08.
[2025-10-24T17:13:42.733092] [INFO ] [REMOTE    ] ANF: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T17:13:42.918448] [INFO ] [REMOTE    ] ANRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:13:43.347693] [INFO ] [REMOTE    ] ANET: Fetching primary data for 2025-05.
[2025-10-24T17:13:44.028902] [INFO ] [REMOTE    ] AMX: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T17:13:44.147693] [INFO ] [REMOTE    ] ANRO: Fetching primary data for 2025-01.
[2025-10-24T17:13:44.947677] [INFO ] [REMOTE    ] ANF: Fetching primary data for 2025-07.
[2025-10-24T17:13:45.028981] [INFO ] [REMOTE    ] ANRO: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T17:13:45.531262] [INFO ] [REMOTE    ] ANET: Incremental fetch complete for 2025-05 (2.18 seconds).
[2025-10-24T17:13:45.747690] [INFO ] [REMOTE    ] AMX: Fetching primary data for 2025-09.
[2025-10-24T17:13:46.547671] [INFO ] [REMOTE    ] ANET: Fetching primary data for 2025-06.
[2025-10-24T17:13:46.632966] [INFO ] [REMOTE    ] ANF: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T17:13:47.140251] [INFO ] [REMOTE    ] AMX: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T17:13:47.347701] [INFO ] [REMOTE    ] ANF: Fetching primary data for 2025-08.
[2025-10-24T17:13:48.147735] [INFO ] [REMOTE    ] AMX: Fetching primary data for 2025-10.
[2025-10-24T17:13:48.854737] [INFO ] [REMOTE    ] ANF: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T17:13:48.944038] [INFO ] [REMOTE    ] ANET: Incremental fetch complete for 2025-06 (2.40 seconds).
[2025-10-24T17:13:48.954494] [INFO ] [REMOTE    ] ANRO: Fetching primary data for 2025-02.
[2025-10-24T17:13:49.467546] [INFO ] [REMOTE    ] AMX: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T17:13:49.478284] [INFO ] [REMOTE    ] AMX: Full fetch complete (71021 records).
[2025-10-24T17:13:49.478474] [DEBUG] [VALIDATOR ] AMX: Validating primary data.
[2025-10-24T17:13:49.753336] [INFO ] [REMOTE    ] ANET: Fetching primary data for 2025-07.
[2025-10-24T17:13:49.893370] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present.
[2025-10-24T17:13:49.893480] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed.
[2025-10-24T17:13:49.894400] [INFO ] [MAIN      ] AMX: Fetched primary data is valid.
[2025-10-24T17:13:49.894469] [DEBUG] [LOCAL     ] AMX: Saving primary data.
[2025-10-24T17:13:49.895576] [FATAL] [LOCAL     ] AMX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:13:49.895691] [FATAL] [MAIN      ] AMX: Failed to save primary data.
[2025-10-24T17:13:49.895759] [WARN ] [MAIN      ] AMX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:13:49.895830] [INFO ] [LOCAL     ] AMX: Starting deletion of primary data.
[2025-10-24T17:13:49.895898] [DEBUG] [LOCAL     ] AMX: No primary data file found to delete.
[2025-10-24T17:13:49.895935] [INFO ] [LOCAL     ] AMX: Starting deletion of derivative data.
[2025-10-24T17:13:49.896284] [DEBUG] [LOCAL     ] AMX: Deleted derivative data file.
[2025-10-24T17:13:49.897405] [INFO ] [MAIN      ] Update Progress: 117/2366 symbols completed. AMX took 40.8s. Estimated remaining: 4h 24m 57s. Rate: 8.5 symbols/min
[2025-10-24T17:13:50.016267] [INFO ] [REMOTE    ] ANRO: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T17:13:50.547705] [INFO ] [REMOTE    ] ANF: Fetching primary data for 2025-09.
[2025-10-24T17:13:51.347745] [INFO ] [REMOTE    ] ANRO: Fetching primary data for 2025-03.
[2025-10-24T17:13:52.012999] [INFO ] [REMOTE    ] ANET: Incremental fetch complete for 2025-07 (2.26 seconds).
[2025-10-24T17:13:52.147714] [INFO ] [REMOTE    ] ANET: Fetching primary data for 2025-08.
[2025-10-24T17:13:52.264279] [INFO ] [REMOTE    ] ANRO: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T17:13:52.396059] [INFO ] [REMOTE    ] ANF: Incremental fetch complete for 2025-09 (1.85 seconds).
[2025-10-24T17:13:52.947723] [INFO ] [REMOTE    ] ANRO: Fetching primary data for 2025-04.
[2025-10-24T17:13:53.747710] [INFO ] [REMOTE    ] ANF: Fetching primary data for 2025-10.
[2025-10-24T17:13:53.995255] [INFO ] [REMOTE    ] ANRO: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T17:13:54.161430] [INFO ] [REMOTE    ] ANET: Incremental fetch complete for 2025-08 (2.01 seconds).
[2025-10-24T17:13:54.547725] [INFO ] [REMOTE    ] ANET: Fetching primary data for 2025-09.
[2025-10-24T17:13:55.347638] [INFO ] [REMOTE    ] ANRO: Fetching primary data for 2025-05.
[2025-10-24T17:13:55.530863] [INFO ] [REMOTE    ] ANF: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T17:13:55.540314] [INFO ] [REMOTE    ] ANF: Full fetch complete (75784 records).
[2025-10-24T17:13:55.540451] [DEBUG] [VALIDATOR ] ANF: Validating primary data.
[2025-10-24T17:13:55.933885] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present.
[2025-10-24T17:13:55.933965] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed.
[2025-10-24T17:13:55.934791] [INFO ] [MAIN      ] ANF: Fetched primary data is valid.
[2025-10-24T17:13:55.934854] [DEBUG] [LOCAL     ] ANF: Saving primary data.
[2025-10-24T17:13:55.935438] [FATAL] [LOCAL     ] ANF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:13:55.935537] [FATAL] [MAIN      ] ANF: Failed to save primary data.
[2025-10-24T17:13:55.935580] [WARN ] [MAIN      ] ANF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:13:55.935614] [INFO ] [LOCAL     ] ANF: Starting deletion of primary data.
[2025-10-24T17:13:55.935695] [DEBUG] [LOCAL     ] ANF: No primary data file found to delete.
[2025-10-24T17:13:55.935747] [INFO ] [LOCAL     ] ANF: Starting deletion of derivative data.
[2025-10-24T17:13:55.935905] [DEBUG] [LOCAL     ] ANF: Deleted derivative data file.
[2025-10-24T17:13:55.936722] [INFO ] [MAIN      ] Update Progress: 118/2366 symbols completed. ANF took 31.2s. Estimated remaining: 4h 24m 30s. Rate: 8.5 symbols/min
[2025-10-24T17:13:56.440864] [INFO ] [REMOTE    ] ANRO: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T17:13:56.445416] [INFO ] [REMOTE    ] ANRO: Fetching primary data for 2025-06.
[2025-10-24T17:13:56.911737] [INFO ] [REMOTE    ] ANET: Incremental fetch complete for 2025-09 (2.36 seconds).
[2025-10-24T17:13:56.947670] [INFO ] [REMOTE    ] ANET: Fetching primary data for 2025-10.
[2025-10-24T17:13:57.544319] [INFO ] [REMOTE    ] ANRO: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T17:13:57.747747] [INFO ] [REMOTE    ] ANRO: Fetching primary data for 2025-07.
[2025-10-24T17:13:58.635477] [INFO ] [REMOTE    ] ANRO: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T17:13:58.639800] [INFO ] [REMOTE    ] ANRO: Fetching primary data for 2025-08.
[2025-10-24T17:13:59.340585] [INFO ] [REMOTE    ] ANET: Incremental fetch complete for 2025-10 (2.39 seconds).
[2025-10-24T17:13:59.353816] [INFO ] [REMOTE    ] ANET: Full fetch complete (77945 records).
[2025-10-24T17:13:59.353996] [DEBUG] [VALIDATOR ] ANET: Validating primary data.
[2025-10-24T17:13:59.468417] [INFO ] [REMOTE    ] ANRO: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T17:13:59.493323] [INFO ] [REMOTE    ] ANRO: Fetching primary data for 2025-09.
[2025-10-24T17:13:59.776060] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present.
[2025-10-24T17:13:59.776138] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed.
[2025-10-24T17:13:59.776912] [INFO ] [MAIN      ] ANET: Fetched primary data is valid.
[2025-10-24T17:13:59.776973] [DEBUG] [LOCAL     ] ANET: Saving primary data.
[2025-10-24T17:13:59.777581] [FATAL] [LOCAL     ] ANET: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:13:59.777699] [FATAL] [MAIN      ] ANET: Failed to save primary data.
[2025-10-24T17:13:59.777745] [WARN ] [MAIN      ] ANET: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:13:59.777782] [INFO ] [LOCAL     ] ANET: Starting deletion of primary data.
[2025-10-24T17:13:59.777833] [DEBUG] [LOCAL     ] ANET: No primary data file found to delete.
[2025-10-24T17:13:59.777867] [INFO ] [LOCAL     ] ANET: Starting deletion of derivative data.
[2025-10-24T17:13:59.778012] [DEBUG] [LOCAL     ] ANET: Deleted derivative data file.
[2025-10-24T17:13:59.778733] [INFO ] [MAIN      ] Update Progress: 119/2366 symbols completed. ANET took 38.9s. Estimated remaining: 4h 23m 22s. Rate: 8.5 symbols/min
[2025-10-24T17:14:00.337724] [INFO ] [REMOTE    ] ANRO: Incremental fetch complete for 2025-09 (0.84 seconds).
[2025-10-24T17:14:00.340696] [INFO ] [REMOTE    ] ANRO: Fetching primary data for 2025-10.
[2025-10-24T17:14:02.493866] [INFO ] [REMOTE    ] ANRO: Incremental fetch complete for 2025-10 (2.15 seconds).
[2025-10-24T17:14:02.499627] [INFO ] [REMOTE    ] ANRO: Full fetch complete (30523 records).
[2025-10-24T17:14:02.499729] [DEBUG] [VALIDATOR ] ANRO: Validating primary data.
[2025-10-24T17:14:02.861331] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present.
[2025-10-24T17:14:02.861409] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed.
[2025-10-24T17:14:02.861819] [INFO ] [MAIN      ] ANRO: Fetched primary data is valid.
[2025-10-24T17:14:02.861879] [DEBUG] [LOCAL     ] ANRO: Saving primary data.
[2025-10-24T17:14:02.862179] [FATAL] [LOCAL     ] ANRO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:14:02.862260] [FATAL] [MAIN      ] ANRO: Failed to save primary data.
[2025-10-24T17:14:02.862302] [WARN ] [MAIN      ] ANRO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:14:02.862374] [INFO ] [LOCAL     ] ANRO: Starting deletion of primary data.
[2025-10-24T17:14:02.862431] [DEBUG] [LOCAL     ] ANRO: No primary data file found to delete.
[2025-10-24T17:14:02.862466] [INFO ] [LOCAL     ] ANRO: Starting deletion of derivative data.
[2025-10-24T17:14:02.862637] [DEBUG] [LOCAL     ] ANRO: Deleted derivative data file.
[2025-10-24T17:14:02.862759] [INFO ] [MAIN      ] Update Progress: 120/2366 symbols completed. ANRO took 20.8s. Estimated remaining: 4h 22m 1s. Rate: 8.6 symbols/min
[2025-10-24T17:14:03.418422] [INFO ] [MAIN      ] AOD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:14:03.485052] [INFO ] [MAIN      ] AOMD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:14:03.547478] [DEBUG] [LOCAL     ] AOMD: No existing data file found in primary storage.
[2025-10-24T17:14:03.592759] [INFO ] [MAIN      ] ANVS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:14:03.594086] [INFO ] [MAIN      ] AOMR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:14:03.595078] [WARN ] [MAIN      ] AOMD: No existing data found, performing full refresh instead.
[2025-10-24T17:14:03.595353] [INFO ] [MAIN      ] AOMD: Wiping existing primary data before full refresh.
[2025-10-24T17:14:03.595420] [INFO ] [LOCAL     ] AOMD: Starting deletion of primary data.
[2025-10-24T17:14:03.595483] [DEBUG] [LOCAL     ] AOMD: No primary data file found to delete.
[2025-10-24T17:14:03.597765] [INFO ] [MAIN      ] AOMD: Starting full primary refresh.
[2025-10-24T17:14:03.749408] [DEBUG] [LOCAL     ] AOD: Loaded 31093 existing records from primary storage.
[2025-10-24T17:14:03.777377] [INFO ] [MAIN      ] AOD: Loaded 31093 existing records.
[2025-10-24T17:14:03.881366] [DEBUG] [LOCAL     ] ANVS: Loaded 24118 existing records from primary storage.
[2025-10-24T17:14:03.765109] [DEBUG] [LOCAL     ] AOMR: Loaded 16387 existing records from primary storage.
[2025-10-24T17:14:03.892019] [INFO ] [MAIN      ] AOMR: Loaded 16387 existing records.
[2025-10-24T17:14:03.911098] [INFO ] [MAIN      ] ANVS: Loaded 24118 existing records.
[2025-10-24T17:14:04.437019] [WARN ] [MAIN      ] AOD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:14:04.443596] [INFO ] [MAIN      ] AOD: Wiping existing primary data before full refresh.
[2025-10-24T17:14:04.456025] [INFO ] [LOCAL     ] AOD: Starting deletion of primary data.
[2025-10-24T17:14:04.495848] [DEBUG] [LOCAL     ] AOD: Deleted primary data file.
[2025-10-24T17:14:04.510832] [INFO ] [MAIN      ] AOD: Starting full primary refresh.
[2025-10-24T17:14:04.500636] [INFO ] [REMOTE    ] AOMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:14:04.585567] [WARN ] [MAIN      ] ANVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:14:04.585861] [INFO ] [REMOTE    ] AOMD: Fetching primary data for 2025-01.
[2025-10-24T17:14:04.606042] [INFO ] [MAIN      ] ANVS: Wiping existing primary data before full refresh.
[2025-10-24T17:14:04.642067] [INFO ] [LOCAL     ] ANVS: Starting deletion of primary data.
[2025-10-24T17:14:04.672153] [WARN ] [MAIN      ] AOMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:14:04.688168] [INFO ] [MAIN      ] AOMR: Wiping existing primary data before full refresh.
[2025-10-24T17:14:04.694497] [INFO ] [LOCAL     ] AOMR: Starting deletion of primary data.
[2025-10-24T17:14:04.677603] [DEBUG] [LOCAL     ] ANVS: Deleted primary data file.
[2025-10-24T17:14:04.697815] [INFO ] [MAIN      ] ANVS: Starting full primary refresh.
[2025-10-24T17:14:04.724300] [DEBUG] [LOCAL     ] AOMR: Deleted primary data file.
[2025-10-24T17:14:04.739516] [INFO ] [MAIN      ] AOMR: Starting full primary refresh.
[2025-10-24T17:14:05.027806] [DEBUG] [REMOTE    ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:14:05.076890] [WARN ] [REMOTE    ] AOMD: No data returned for month 2025-01
[2025-10-24T17:14:05.143802] [FATAL] [REMOTE    ] AOMD: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:14:05.147794] [FATAL] [MAIN      ] AOMD: Failed to fetch primary data.
[2025-10-24T17:14:05.264278] [WARN ] [MAIN      ] AOMD: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:14:05.297971] [INFO ] [LOCAL     ] AOMD: Starting deletion of primary data.
[2025-10-24T17:14:05.307105] [DEBUG] [LOCAL     ] AOMD: No primary data file found to delete.
[2025-10-24T17:14:05.331518] [INFO ] [LOCAL     ] AOMD: Starting deletion of derivative data.
[2025-10-24T17:14:05.343631] [DEBUG] [LOCAL     ] AOMD: No derivative data file found to delete.
[2025-10-24T17:14:05.357115] [INFO ] [MAIN      ] Update Progress: 121/2366 symbols completed. AOMD took 2.5s. Estimated remaining: 4h 20m 31s. Rate: 8.6 symbols/min
[2025-10-24T17:14:05.407141] [INFO ] [REMOTE    ] AOD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:14:05.487744] [INFO ] [REMOTE    ] AOD: Fetching primary data for 2025-01.
[2025-10-24T17:14:05.761025] [INFO ] [REMOTE    ] ANVS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:14:05.819932] [INFO ] [MAIN      ] AON: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:14:05.788676] [INFO ] [REMOTE    ] ANVS: Fetching primary data for 2025-01.
[2025-10-24T17:14:05.892551] [INFO ] [REMOTE    ] AOMR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:14:05.893122] [INFO ] [REMOTE    ] AOMR: Fetching primary data for 2025-01.
[2025-10-24T17:14:05.934794] [DEBUG] [LOCAL     ] AON: Loaded 45341 existing records from primary storage.
[2025-10-24T17:14:05.935118] [INFO ] [MAIN      ] AON: Loaded 45341 existing records.
[2025-10-24T17:14:06.109734] [WARN ] [MAIN      ] AON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:14:06.109959] [INFO ] [MAIN      ] AON: Wiping existing primary data before full refresh.
[2025-10-24T17:14:06.110007] [INFO ] [LOCAL     ] AON: Starting deletion of primary data.
[2025-10-24T17:14:06.110830] [DEBUG] [LOCAL     ] AON: Deleted primary data file.
[2025-10-24T17:14:06.110889] [INFO ] [MAIN      ] AON: Starting full primary refresh.
[2025-10-24T17:14:06.456409] [INFO ] [REMOTE    ] AON: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:14:06.456733] [INFO ] [REMOTE    ] AON: Fetching primary data for 2025-01.
[2025-10-24T17:14:06.821431] [INFO ] [REMOTE    ] AOMR: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T17:14:06.824252] [INFO ] [REMOTE    ] AOMR: Fetching primary data for 2025-02.
[2025-10-24T17:14:06.869259] [INFO ] [REMOTE    ] AOD: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T17:14:06.876473] [INFO ] [REMOTE    ] AOD: Fetching primary data for 2025-02.
[2025-10-24T17:14:06.989239] [INFO ] [REMOTE    ] ANVS: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T17:14:06.995014] [INFO ] [REMOTE    ] ANVS: Fetching primary data for 2025-02.
[2025-10-24T17:14:07.750226] [INFO ] [REMOTE    ] AOMR: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T17:14:07.757196] [INFO ] [REMOTE    ] AOMR: Fetching primary data for 2025-03.
[2025-10-24T17:14:07.845012] [INFO ] [REMOTE    ] AOD: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T17:14:08.066619] [INFO ] [REMOTE    ] AON: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T17:14:08.147620] [INFO ] [REMOTE    ] AOD: Fetching primary data for 2025-03.
[2025-10-24T17:14:08.296033] [INFO ] [REMOTE    ] ANVS: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T17:14:08.662088] [INFO ] [REMOTE    ] AOMR: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T17:14:08.947708] [INFO ] [REMOTE    ] ANVS: Fetching primary data for 2025-03.
[2025-10-24T17:14:08.970391] [INFO ] [REMOTE    ] AOD: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T17:14:09.747748] [INFO ] [REMOTE    ] AON: Fetching primary data for 2025-02.
[2025-10-24T17:14:09.942529] [INFO ] [REMOTE    ] ANVS: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T17:14:10.547732] [INFO ] [REMOTE    ] AOMR: Fetching primary data for 2025-04.
[2025-10-24T17:14:11.213028] [INFO ] [REMOTE    ] AON: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T17:14:11.347713] [INFO ] [REMOTE    ] AOD: Fetching primary data for 2025-04.
[2025-10-24T17:14:11.371911] [INFO ] [REMOTE    ] AOMR: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T17:14:12.147767] [INFO ] [REMOTE    ] ANVS: Fetching primary data for 2025-04.
[2025-10-24T17:14:12.583253] [INFO ] [REMOTE    ] AOD: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T17:14:12.947628] [INFO ] [REMOTE    ] AOMR: Fetching primary data for 2025-05.
[2025-10-24T17:14:12.976614] [INFO ] [REMOTE    ] ANVS: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T17:14:13.664682] [INFO ] [REMOTE    ] AOMR: Incremental fetch complete for 2025-05 (0.72 seconds).
[2025-10-24T17:14:13.747626] [INFO ] [REMOTE    ] AOMR: Fetching primary data for 2025-06.
[2025-10-24T17:14:14.336561] [INFO ] [REMOTE    ] AOMR: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T17:14:14.547703] [INFO ] [REMOTE    ] ANVS: Fetching primary data for 2025-05.
[2025-10-24T17:14:15.347677] [INFO ] [REMOTE    ] AON: Fetching primary data for 2025-03.
[2025-10-24T17:14:15.771456] [INFO ] [REMOTE    ] ANVS: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T17:14:16.147720] [INFO ] [REMOTE    ] AOMR: Fetching primary data for 2025-07.
[2025-10-24T17:14:16.846477] [INFO ] [REMOTE    ] AOMR: Incremental fetch complete for 2025-07 (0.70 seconds).
[2025-10-24T17:14:16.947687] [INFO ] [REMOTE    ] ANVS: Fetching primary data for 2025-06.
[2025-10-24T17:14:17.054778] [INFO ] [REMOTE    ] AON: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T17:14:17.747671] [INFO ] [REMOTE    ] AOD: Fetching primary data for 2025-05.
[2025-10-24T17:14:18.115419] [INFO ] [REMOTE    ] ANVS: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T17:14:18.555142] [INFO ] [REMOTE    ] ANVS: Fetching primary data for 2025-07.
[2025-10-24T17:14:18.556567] [INFO ] [REMOTE    ] AOD: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T17:14:19.347616] [INFO ] [REMOTE    ] AOD: Fetching primary data for 2025-06.
[2025-10-24T17:14:19.627052] [INFO ] [REMOTE    ] ANVS: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T17:14:20.136832] [INFO ] [REMOTE    ] AOD: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T17:14:20.147612] [INFO ] [REMOTE    ] AOD: Fetching primary data for 2025-07.
[2025-10-24T17:14:20.947686] [INFO ] [REMOTE    ] ANVS: Fetching primary data for 2025-08.
[2025-10-24T17:14:21.141458] [INFO ] [REMOTE    ] AOD: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T17:14:21.747704] [INFO ] [REMOTE    ] AON: Fetching primary data for 2025-04.
[2025-10-24T17:14:21.749356] [INFO ] [REMOTE    ] ANVS: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T17:14:22.547682] [INFO ] [REMOTE    ] AOMR: Fetching primary data for 2025-08.
[2025-10-24T17:14:23.347730] [INFO ] [REMOTE    ] AOD: Fetching primary data for 2025-08.
[2025-10-24T17:14:23.638357] [INFO ] [REMOTE    ] AOMR: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T17:14:23.715392] [INFO ] [REMOTE    ] AON: Incremental fetch complete for 2025-04 (1.97 seconds).
[2025-10-24T17:14:24.147614] [INFO ] [REMOTE    ] AOMR: Fetching primary data for 2025-09.
[2025-10-24T17:14:24.622365] [INFO ] [REMOTE    ] AOD: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T17:14:24.947639] [INFO ] [REMOTE    ] AOD: Fetching primary data for 2025-09.
[2025-10-24T17:14:25.021437] [INFO ] [REMOTE    ] AOMR: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T17:14:25.747629] [INFO ] [REMOTE    ] AOMR: Fetching primary data for 2025-10.
[2025-10-24T17:14:25.907487] [INFO ] [REMOTE    ] AOD: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T17:14:26.475505] [INFO ] [REMOTE    ] AOMR: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T17:14:26.478105] [INFO ] [REMOTE    ] AOMR: Full fetch complete (23058 records).
[2025-10-24T17:14:26.478197] [DEBUG] [VALIDATOR ] AOMR: Validating primary data.
[2025-10-24T17:14:26.552824] [INFO ] [REMOTE    ] AOD: Fetching primary data for 2025-10.
[2025-10-24T17:14:26.868688] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present.
[2025-10-24T17:14:26.868777] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed.
[2025-10-24T17:14:26.869125] [INFO ] [MAIN      ] AOMR: Fetched primary data is valid.
[2025-10-24T17:14:26.869166] [DEBUG] [LOCAL     ] AOMR: Saving primary data.
[2025-10-24T17:14:26.869485] [FATAL] [LOCAL     ] AOMR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:14:26.869594] [FATAL] [MAIN      ] AOMR: Failed to save primary data.
[2025-10-24T17:14:26.869638] [WARN ] [MAIN      ] AOMR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:14:26.869718] [INFO ] [LOCAL     ] AOMR: Starting deletion of primary data.
[2025-10-24T17:14:26.869773] [DEBUG] [LOCAL     ] AOMR: No primary data file found to delete.
[2025-10-24T17:14:26.869809] [INFO ] [LOCAL     ] AOMR: Starting deletion of derivative data.
[2025-10-24T17:14:26.870011] [DEBUG] [LOCAL     ] AOMR: Deleted derivative data file.
[2025-10-24T17:14:26.870102] [INFO ] [MAIN      ] Update Progress: 122/2366 symbols completed. AOMR took 24.0s. Estimated remaining: 4h 24m 51s. Rate: 8.5 symbols/min
[2025-10-24T17:14:27.036692] [INFO ] [MAIN      ] AORT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:14:27.065710] [DEBUG] [LOCAL     ] AORT: Loaded 29058 existing records from primary storage.
[2025-10-24T17:14:27.065983] [INFO ] [MAIN      ] AORT: Loaded 29058 existing records.
[2025-10-24T17:14:27.242847] [WARN ] [MAIN      ] AORT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:14:27.243044] [INFO ] [MAIN      ] AORT: Wiping existing primary data before full refresh.
[2025-10-24T17:14:27.243096] [INFO ] [LOCAL     ] AORT: Starting deletion of primary data.
[2025-10-24T17:14:27.243343] [DEBUG] [LOCAL     ] AORT: Deleted primary data file.
[2025-10-24T17:14:27.243382] [INFO ] [MAIN      ] AORT: Starting full primary refresh.
[2025-10-24T17:14:27.350744] [INFO ] [REMOTE    ] AON: Fetching primary data for 2025-05.
[2025-10-24T17:14:27.604137] [INFO ] [REMOTE    ] AORT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:14:27.682916] [INFO ] [REMOTE    ] AOD: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T17:14:27.689326] [INFO ] [REMOTE    ] AOD: Full fetch complete (44885 records).
[2025-10-24T17:14:27.689448] [DEBUG] [VALIDATOR ] AOD: Validating primary data.
[2025-10-24T17:14:28.060760] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present.
[2025-10-24T17:14:28.060846] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed.
[2025-10-24T17:14:28.061417] [INFO ] [MAIN      ] AOD: Fetched primary data is valid.
[2025-10-24T17:14:28.061486] [DEBUG] [LOCAL     ] AOD: Saving primary data.
[2025-10-24T17:14:28.061953] [FATAL] [LOCAL     ] AOD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:14:28.062040] [FATAL] [MAIN      ] AOD: Failed to save primary data.
[2025-10-24T17:14:28.062082] [WARN ] [MAIN      ] AOD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:14:28.062116] [INFO ] [LOCAL     ] AOD: Starting deletion of primary data.
[2025-10-24T17:14:28.062167] [DEBUG] [LOCAL     ] AOD: No primary data file found to delete.
[2025-10-24T17:14:28.062201] [INFO ] [LOCAL     ] AOD: Starting deletion of derivative data.
[2025-10-24T17:14:28.062385] [DEBUG] [LOCAL     ] AOD: Deleted derivative data file.
[2025-10-24T17:14:28.062477] [INFO ] [MAIN      ] Update Progress: 123/2366 symbols completed. AOD took 25.2s. Estimated remaining: 4h 22m 57s. Rate: 8.5 symbols/min
[2025-10-24T17:14:28.152876] [INFO ] [REMOTE    ] AORT: Fetching primary data for 2025-01.
[2025-10-24T17:14:28.241944] [INFO ] [MAIN      ] AOS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:14:28.290555] [DEBUG] [LOCAL     ] AOS: Loaded 49003 existing records from primary storage.
[2025-10-24T17:14:28.290963] [INFO ] [MAIN      ] AOS: Loaded 49003 existing records.
[2025-10-24T17:14:28.488458] [WARN ] [MAIN      ] AOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:14:28.488848] [INFO ] [MAIN      ] AOS: Wiping existing primary data before full refresh.
[2025-10-24T17:14:28.488910] [INFO ] [LOCAL     ] AOS: Starting deletion of primary data.
[2025-10-24T17:14:28.489874] [DEBUG] [LOCAL     ] AOS: Deleted primary data file.
[2025-10-24T17:14:28.489940] [INFO ] [MAIN      ] AOS: Starting full primary refresh.
[2025-10-24T17:14:28.871755] [INFO ] [REMOTE    ] AOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:14:28.901832] [INFO ] [REMOTE    ] AON: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T17:14:28.947607] [INFO ] [REMOTE    ] AON: Fetching primary data for 2025-06.
[2025-10-24T17:14:29.511263] [INFO ] [REMOTE    ] AORT: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T17:14:29.747677] [INFO ] [REMOTE    ] AORT: Fetching primary data for 2025-02.
[2025-10-24T17:14:30.176939] [INFO ] [REMOTE    ] AON: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T17:14:30.547735] [INFO ] [REMOTE    ] ANVS: Fetching primary data for 2025-09.
[2025-10-24T17:14:30.871064] [INFO ] [REMOTE    ] AORT: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T17:14:31.347638] [INFO ] [REMOTE    ] AON: Fetching primary data for 2025-07.
[2025-10-24T17:14:31.622220] [INFO ] [REMOTE    ] ANVS: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T17:14:32.147728] [INFO ] [REMOTE    ] AOS: Fetching primary data for 2025-01.
[2025-10-24T17:14:32.775321] [INFO ] [REMOTE    ] AON: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T17:14:32.947674] [INFO ] [REMOTE    ] AORT: Fetching primary data for 2025-03.
[2025-10-24T17:14:33.659421] [INFO ] [REMOTE    ] AOS: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T17:14:33.747702] [INFO ] [REMOTE    ] AON: Fetching primary data for 2025-08.
[2025-10-24T17:14:34.269231] [INFO ] [REMOTE    ] AORT: Incremental fetch complete for 2025-03 (1.32 seconds).
[2025-10-24T17:14:34.547669] [INFO ] [REMOTE    ] ANVS: Fetching primary data for 2025-10.
[2025-10-24T17:14:35.304673] [INFO ] [REMOTE    ] AON: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T17:14:35.347603] [INFO ] [REMOTE    ] AON: Fetching primary data for 2025-09.
[2025-10-24T17:14:35.852214] [INFO ] [REMOTE    ] ANVS: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T17:14:35.858221] [INFO ] [REMOTE    ] ANVS: Full fetch complete (36707 records).
[2025-10-24T17:14:35.858309] [DEBUG] [VALIDATOR ] ANVS: Validating primary data.
[2025-10-24T17:14:36.152737] [INFO ] [REMOTE    ] AOS: Fetching primary data for 2025-02.
[2025-10-24T17:14:36.231190] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present.
[2025-10-24T17:14:36.231267] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed.
[2025-10-24T17:14:36.231727] [INFO ] [MAIN      ] ANVS: Fetched primary data is valid.
[2025-10-24T17:14:36.231786] [DEBUG] [LOCAL     ] ANVS: Saving primary data.
[2025-10-24T17:14:36.232121] [FATAL] [LOCAL     ] ANVS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:14:36.232203] [FATAL] [MAIN      ] ANVS: Failed to save primary data.
[2025-10-24T17:14:36.232243] [WARN ] [MAIN      ] ANVS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:14:36.232278] [INFO ] [LOCAL     ] ANVS: Starting deletion of primary data.
[2025-10-24T17:14:36.232328] [DEBUG] [LOCAL     ] ANVS: No primary data file found to delete.
[2025-10-24T17:14:36.232370] [INFO ] [LOCAL     ] ANVS: Starting deletion of derivative data.
[2025-10-24T17:14:36.232529] [DEBUG] [LOCAL     ] ANVS: Deleted derivative data file.
[2025-10-24T17:14:36.232599] [INFO ] [MAIN      ] Update Progress: 124/2366 symbols completed. ANVS took 33.4s. Estimated remaining: 4h 23m 10s. Rate: 8.5 symbols/min
[2025-10-24T17:14:36.396475] [INFO ] [MAIN      ] AP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:14:36.406457] [DEBUG] [LOCAL     ] AP: Loaded 7470 existing records from primary storage.
[2025-10-24T17:14:36.406638] [INFO ] [MAIN      ] AP: Loaded 7470 existing records.
[2025-10-24T17:14:36.580914] [WARN ] [MAIN      ] AP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:14:36.581175] [INFO ] [MAIN      ] AP: Wiping existing primary data before full refresh.
[2025-10-24T17:14:36.581251] [INFO ] [LOCAL     ] AP: Starting deletion of primary data.
[2025-10-24T17:14:36.581570] [DEBUG] [LOCAL     ] AP: Deleted primary data file.
[2025-10-24T17:14:36.581627] [INFO ] [MAIN      ] AP: Starting full primary refresh.
[2025-10-24T17:14:36.939853] [INFO ] [REMOTE    ] AP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:14:36.952740] [INFO ] [REMOTE    ] AP: Fetching primary data for 2025-01.
[2025-10-24T17:14:36.968818] [INFO ] [REMOTE    ] AON: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T17:14:37.600466] [INFO ] [REMOTE    ] AP: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T17:14:37.626408] [INFO ] [REMOTE    ] AOS: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T17:14:37.747594] [INFO ] [REMOTE    ] AP: Fetching primary data for 2025-02.
[2025-10-24T17:14:38.298074] [INFO ] [REMOTE    ] AP: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T17:14:38.547664] [INFO ] [REMOTE    ] AORT: Fetching primary data for 2025-04.
[2025-10-24T17:14:39.347673] [INFO ] [REMOTE    ] AON: Fetching primary data for 2025-10.
[2025-10-24T17:14:39.957828] [INFO ] [REMOTE    ] AORT: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T17:14:40.147690] [INFO ] [REMOTE    ] AOS: Fetching primary data for 2025-03.
[2025-10-24T17:14:40.947699] [INFO ] [REMOTE    ] AORT: Fetching primary data for 2025-05.
[2025-10-24T17:14:40.975814] [INFO ] [REMOTE    ] AON: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T17:14:40.983560] [INFO ] [REMOTE    ] AON: Full fetch complete (65206 records).
[2025-10-24T17:14:40.983720] [DEBUG] [VALIDATOR ] AON: Validating primary data.
[2025-10-24T17:14:41.375892] [DEBUG] [VALIDATOR ] AON: All expected trading days are present.
[2025-10-24T17:14:41.376004] [DEBUG] [VALIDATOR ] AON: Primary data validation passed.
[2025-10-24T17:14:41.376803] [INFO ] [MAIN      ] AON: Fetched primary data is valid.
[2025-10-24T17:14:41.376865] [DEBUG] [LOCAL     ] AON: Saving primary data.
[2025-10-24T17:14:41.377387] [FATAL] [LOCAL     ] AON: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:14:41.377498] [FATAL] [MAIN      ] AON: Failed to save primary data.
[2025-10-24T17:14:41.377552] [WARN ] [MAIN      ] AON: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:14:41.377588] [INFO ] [LOCAL     ] AON: Starting deletion of primary data.
[2025-10-24T17:14:41.377671] [DEBUG] [LOCAL     ] AON: No primary data file found to delete.
[2025-10-24T17:14:41.377729] [INFO ] [LOCAL     ] AON: Starting deletion of derivative data.
[2025-10-24T17:14:41.377882] [DEBUG] [LOCAL     ] AON: Deleted derivative data file.
[2025-10-24T17:14:41.378474] [INFO ] [MAIN      ] Update Progress: 125/2366 symbols completed. AON took 36.0s. Estimated remaining: 4h 22m 29s. Rate: 8.5 symbols/min
[2025-10-24T17:14:41.551962] [INFO ] [MAIN      ] APAM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:14:41.598921] [INFO ] [REMOTE    ] AOS: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T17:14:41.621568] [DEBUG] [LOCAL     ] APAM: Loaded 35893 existing records from primary storage.
[2025-10-24T17:14:41.621897] [INFO ] [MAIN      ] APAM: Loaded 35893 existing records.
[2025-10-24T17:14:41.760510] [INFO ] [REMOTE    ] AOS: Fetching primary data for 2025-04.
[2025-10-24T17:14:41.800595] [WARN ] [MAIN      ] APAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:14:41.800957] [INFO ] [MAIN      ] APAM: Wiping existing primary data before full refresh.
[2025-10-24T17:14:41.801045] [INFO ] [LOCAL     ] APAM: Starting deletion of primary data.
[2025-10-24T17:14:41.801810] [DEBUG] [LOCAL     ] APAM: Deleted primary data file.
[2025-10-24T17:14:41.801870] [INFO ] [MAIN      ] APAM: Starting full primary refresh.
[2025-10-24T17:14:42.164236] [INFO ] [REMOTE    ] APAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:14:42.200387] [INFO ] [REMOTE    ] AORT: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T17:14:42.547725] [INFO ] [REMOTE    ] APAM: Fetching primary data for 2025-01.
[2025-10-24T17:14:43.347753] [INFO ] [REMOTE    ] AP: Fetching primary data for 2025-03.
[2025-10-24T17:14:43.391404] [INFO ] [REMOTE    ] AOS: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T17:14:43.835775] [INFO ] [REMOTE    ] AP: Incremental fetch complete for 2025-03 (0.49 seconds).
[2025-10-24T17:14:43.902694] [INFO ] [REMOTE    ] APAM: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T17:14:44.147713] [INFO ] [REMOTE    ] AP: Fetching primary data for 2025-04.
[2025-10-24T17:14:44.744478] [INFO ] [REMOTE    ] AP: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T17:14:44.947730] [INFO ] [REMOTE    ] AORT: Fetching primary data for 2025-06.
[2025-10-24T17:14:45.747707] [INFO ] [REMOTE    ] AP: Fetching primary data for 2025-05.
[2025-10-24T17:14:46.071416] [INFO ] [REMOTE    ] AORT: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T17:14:46.291528] [INFO ] [REMOTE    ] AP: Incremental fetch complete for 2025-05 (0.54 seconds).
[2025-10-24T17:14:46.547716] [INFO ] [REMOTE    ] APAM: Fetching primary data for 2025-02.
[2025-10-24T17:14:47.347619] [INFO ] [REMOTE    ] AP: Fetching primary data for 2025-06.
[2025-10-24T17:14:47.776554] [INFO ] [REMOTE    ] APAM: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T17:14:47.937783] [INFO ] [REMOTE    ] AP: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T17:14:48.147665] [INFO ] [REMOTE    ] AOS: Fetching primary data for 2025-05.
[2025-10-24T17:14:48.947619] [INFO ] [REMOTE    ] AP: Fetching primary data for 2025-07.
[2025-10-24T17:14:49.685371] [INFO ] [REMOTE    ] AP: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T17:14:49.747750] [INFO ] [REMOTE    ] AP: Fetching primary data for 2025-08.
[2025-10-24T17:14:49.879271] [INFO ] [REMOTE    ] AOS: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T17:14:50.547686] [INFO ] [REMOTE    ] AORT: Fetching primary data for 2025-07.
[2025-10-24T17:14:50.566928] [INFO ] [REMOTE    ] AP: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T17:14:51.347639] [INFO ] [REMOTE    ] APAM: Fetching primary data for 2025-03.
[2025-10-24T17:14:51.742224] [INFO ] [REMOTE    ] AORT: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T17:14:52.147685] [INFO ] [REMOTE    ] AP: Fetching primary data for 2025-09.
[2025-10-24T17:14:52.672329] [INFO ] [REMOTE    ] APAM: Incremental fetch complete for 2025-03 (1.32 seconds).
[2025-10-24T17:14:52.706155] [INFO ] [REMOTE    ] AP: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T17:14:52.947626] [INFO ] [REMOTE    ] AORT: Fetching primary data for 2025-08.
[2025-10-24T17:14:53.747708] [INFO ] [REMOTE    ] AOS: Fetching primary data for 2025-06.
[2025-10-24T17:14:54.347883] [INFO ] [REMOTE    ] AORT: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T17:14:54.547707] [INFO ] [REMOTE    ] AP: Fetching primary data for 2025-10.
[2025-10-24T17:14:55.301453] [INFO ] [REMOTE    ] AOS: Incremental fetch complete for 2025-06 (1.55 seconds).
[2025-10-24T17:14:55.319578] [INFO ] [REMOTE    ] AP: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T17:14:55.321931] [INFO ] [REMOTE    ] AP: Full fetch complete (9131 records).
[2025-10-24T17:14:55.322021] [DEBUG] [VALIDATOR ] AP: Validating primary data.
[2025-10-24T17:14:55.353809] [INFO ] [REMOTE    ] APAM: Fetching primary data for 2025-04.
[2025-10-24T17:14:55.684414] [DEBUG] [VALIDATOR ] AP: All expected trading days are present.
[2025-10-24T17:14:55.684486] [DEBUG] [VALIDATOR ] AP: Primary data validation passed.
[2025-10-24T17:14:55.684723] [INFO ] [MAIN      ] AP: Fetched primary data is valid.
[2025-10-24T17:14:55.684783] [DEBUG] [LOCAL     ] AP: Saving primary data.
[2025-10-24T17:14:55.684983] [FATAL] [LOCAL     ] AP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:14:55.685059] [FATAL] [MAIN      ] AP: Failed to save primary data.
[2025-10-24T17:14:55.685100] [WARN ] [MAIN      ] AP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:14:55.685134] [INFO ] [LOCAL     ] AP: Starting deletion of primary data.
[2025-10-24T17:14:55.685181] [DEBUG] [LOCAL     ] AP: No primary data file found to delete.
[2025-10-24T17:14:55.685215] [INFO ] [LOCAL     ] AP: Starting deletion of derivative data.
[2025-10-24T17:14:55.685360] [DEBUG] [LOCAL     ] AP: Deleted derivative data file.
[2025-10-24T17:14:55.685428] [INFO ] [MAIN      ] Update Progress: 126/2366 symbols completed. AP took 19.5s. Estimated remaining: 4h 24m 32s. Rate: 8.5 symbols/min
[2025-10-24T17:14:55.857939] [INFO ] [MAIN      ] APD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:14:55.902777] [DEBUG] [LOCAL     ] APD: Loaded 45754 existing records from primary storage.
[2025-10-24T17:14:55.903049] [INFO ] [MAIN      ] APD: Loaded 45754 existing records.
[2025-10-24T17:14:56.079444] [WARN ] [MAIN      ] APD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:14:56.079677] [INFO ] [MAIN      ] APD: Wiping existing primary data before full refresh.
[2025-10-24T17:14:56.079745] [INFO ] [LOCAL     ] APD: Starting deletion of primary data.
[2025-10-24T17:14:56.080572] [DEBUG] [LOCAL     ] APD: Deleted primary data file.
[2025-10-24T17:14:56.080629] [INFO ] [MAIN      ] APD: Starting full primary refresh.
[2025-10-24T17:14:56.152887] [INFO ] [REMOTE    ] AOS: Fetching primary data for 2025-07.
[2025-10-24T17:14:56.487858] [INFO ] [REMOTE    ] APD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:14:56.931327] [INFO ] [REMOTE    ] APAM: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T17:14:56.947594] [INFO ] [REMOTE    ] APAM: Fetching primary data for 2025-05.
[2025-10-24T17:14:57.672566] [INFO ] [REMOTE    ] AOS: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T17:14:57.747618] [INFO ] [REMOTE    ] AORT: Fetching primary data for 2025-09.
[2025-10-24T17:14:58.332216] [INFO ] [REMOTE    ] APAM: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T17:14:58.547632] [INFO ] [REMOTE    ] APAM: Fetching primary data for 2025-06.
[2025-10-24T17:14:58.996831] [INFO ] [REMOTE    ] AORT: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T17:14:59.347710] [INFO ] [REMOTE    ] AOS: Fetching primary data for 2025-08.
[2025-10-24T17:14:59.805533] [INFO ] [REMOTE    ] APAM: Incremental fetch complete for 2025-06 (1.26 seconds).
[2025-10-24T17:15:00.147717] [INFO ] [REMOTE    ] AORT: Fetching primary data for 2025-10.
[2025-10-24T17:15:00.947698] [INFO ] [REMOTE    ] APAM: Fetching primary data for 2025-07.
[2025-10-24T17:15:01.174416] [INFO ] [REMOTE    ] AOS: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T17:15:01.472895] [INFO ] [REMOTE    ] AORT: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T17:15:01.477851] [INFO ] [REMOTE    ] AORT: Full fetch complete (42194 records).
[2025-10-24T17:15:01.477972] [DEBUG] [VALIDATOR ] AORT: Validating primary data.
[2025-10-24T17:15:01.478567] [FATAL] [VALIDATOR ] AORT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:15:01.478671] [FATAL] [MAIN      ] AORT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:15:01.478747] [WARN ] [MAIN      ] AORT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:15:01.478814] [INFO ] [LOCAL     ] AORT: Starting deletion of primary data.
[2025-10-24T17:15:01.478880] [DEBUG] [LOCAL     ] AORT: No primary data file found to delete.
[2025-10-24T17:15:01.478917] [INFO ] [LOCAL     ] AORT: Starting deletion of derivative data.
[2025-10-24T17:15:01.479061] [DEBUG] [LOCAL     ] AORT: Deleted derivative data file.
[2025-10-24T17:15:01.479130] [INFO ] [MAIN      ] Update Progress: 127/2366 symbols completed. AORT took 34.6s. Estimated remaining: 4h 24m 2s. Rate: 8.5 symbols/min
[2025-10-24T17:15:01.649371] [INFO ] [MAIN      ] APG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:15:01.702187] [DEBUG] [LOCAL     ] APG: Loaded 50997 existing records from primary storage.
[2025-10-24T17:15:01.702492] [INFO ] [MAIN      ] APG: Loaded 50997 existing records.
[2025-10-24T17:15:01.752757] [INFO ] [REMOTE    ] APD: Fetching primary data for 2025-01.
[2025-10-24T17:15:01.927704] [WARN ] [MAIN      ] APG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:15:01.927948] [INFO ] [MAIN      ] APG: Wiping existing primary data before full refresh.
[2025-10-24T17:15:01.928004] [INFO ] [LOCAL     ] APG: Starting deletion of primary data.
[2025-10-24T17:15:01.928857] [DEBUG] [LOCAL     ] APG: Deleted primary data file.
[2025-10-24T17:15:01.928915] [INFO ] [MAIN      ] APG: Starting full primary refresh.
[2025-10-24T17:15:02.296121] [INFO ] [REMOTE    ] APG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:15:02.378123] [INFO ] [REMOTE    ] APAM: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T17:15:02.547716] [INFO ] [REMOTE    ] APAM: Fetching primary data for 2025-08.
[2025-10-24T17:15:03.347693] [INFO ] [REMOTE    ] APG: Fetching primary data for 2025-01.
[2025-10-24T17:15:04.040011] [INFO ] [REMOTE    ] APD: Incremental fetch complete for 2025-01 (2.29 seconds).
[2025-10-24T17:15:04.089306] [INFO ] [REMOTE    ] APAM: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T17:15:04.147662] [INFO ] [REMOTE    ] APD: Fetching primary data for 2025-02.
[2025-10-24T17:15:04.947687] [INFO ] [REMOTE    ] AOS: Fetching primary data for 2025-09.
[2025-10-24T17:15:05.747713] [INFO ] [REMOTE    ] APAM: Fetching primary data for 2025-09.
[2025-10-24T17:15:05.776827] [INFO ] [REMOTE    ] APG: Incremental fetch complete for 2025-01 (2.43 seconds).
[2025-10-24T17:15:06.103977] [INFO ] [REMOTE    ] APD: Incremental fetch complete for 2025-02 (1.96 seconds).
[2025-10-24T17:15:06.547750] [INFO ] [REMOTE    ] APG: Fetching primary data for 2025-02.
[2025-10-24T17:15:07.225951] [INFO ] [REMOTE    ] APAM: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T17:15:07.299993] [INFO ] [REMOTE    ] AOS: Incremental fetch complete for 2025-09 (2.35 seconds).
[2025-10-24T17:15:07.347669] [INFO ] [REMOTE    ] APAM: Fetching primary data for 2025-10.
[2025-10-24T17:15:07.836950] [INFO ] [REMOTE    ] APG: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T17:15:08.147718] [INFO ] [REMOTE    ] APD: Fetching primary data for 2025-03.
[2025-10-24T17:15:08.947698] [INFO ] [REMOTE    ] APG: Fetching primary data for 2025-03.
[2025-10-24T17:15:09.014849] [INFO ] [REMOTE    ] APAM: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T17:15:09.020916] [INFO ] [REMOTE    ] APAM: Full fetch complete (51922 records).
[2025-10-24T17:15:09.021015] [DEBUG] [VALIDATOR ] APAM: Validating primary data.
[2025-10-24T17:15:09.395393] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present.
[2025-10-24T17:15:09.395476] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed.
[2025-10-24T17:15:09.396046] [INFO ] [MAIN      ] APAM: Fetched primary data is valid.
[2025-10-24T17:15:09.396127] [DEBUG] [LOCAL     ] APAM: Saving primary data.
[2025-10-24T17:15:09.396624] [FATAL] [LOCAL     ] APAM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:15:09.396736] [FATAL] [MAIN      ] APAM: Failed to save primary data.
[2025-10-24T17:15:09.396777] [WARN ] [MAIN      ] APAM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:15:09.396835] [INFO ] [LOCAL     ] APAM: Starting deletion of primary data.
[2025-10-24T17:15:09.396893] [DEBUG] [LOCAL     ] APAM: No primary data file found to delete.
[2025-10-24T17:15:09.396929] [INFO ] [LOCAL     ] APAM: Starting deletion of derivative data.
[2025-10-24T17:15:09.397095] [DEBUG] [LOCAL     ] APAM: Deleted derivative data file.
[2025-10-24T17:15:09.397827] [INFO ] [MAIN      ] Update Progress: 128/2366 symbols completed. APAM took 28.0s. Estimated remaining: 4h 24m 10s. Rate: 8.5 symbols/min
[2025-10-24T17:15:09.565828] [INFO ] [MAIN      ] APH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:15:09.621272] [DEBUG] [LOCAL     ] APH: Loaded 54081 existing records from primary storage.
[2025-10-24T17:15:09.621637] [INFO ] [MAIN      ] APH: Loaded 54081 existing records.
[2025-10-24T17:15:09.751943] [INFO ] [REMOTE    ] AOS: Fetching primary data for 2025-10.
[2025-10-24T17:15:09.808973] [WARN ] [MAIN      ] APH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:15:09.809703] [INFO ] [MAIN      ] APH: Wiping existing primary data before full refresh.
[2025-10-24T17:15:09.809849] [INFO ] [LOCAL     ] APH: Starting deletion of primary data.
[2025-10-24T17:15:09.810958] [DEBUG] [LOCAL     ] APH: Deleted primary data file.
[2025-10-24T17:15:09.811089] [INFO ] [MAIN      ] APH: Starting full primary refresh.
[2025-10-24T17:15:10.183736] [INFO ] [REMOTE    ] APD: Incremental fetch complete for 2025-03 (2.04 seconds).
[2025-10-24T17:15:10.266381] [INFO ] [REMOTE    ] APH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:15:10.296596] [INFO ] [REMOTE    ] APG: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T17:15:10.547727] [INFO ] [REMOTE    ] APD: Fetching primary data for 2025-04.
[2025-10-24T17:15:11.347695] [INFO ] [REMOTE    ] APH: Fetching primary data for 2025-01.
[2025-10-24T17:15:11.572768] [INFO ] [REMOTE    ] AOS: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T17:15:11.582287] [INFO ] [REMOTE    ] AOS: Full fetch complete (71081 records).
[2025-10-24T17:15:11.582470] [DEBUG] [VALIDATOR ] AOS: Validating primary data.
[2025-10-24T17:15:12.032237] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present.
[2025-10-24T17:15:12.032483] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed.
[2025-10-24T17:15:12.033518] [INFO ] [MAIN      ] AOS: Fetched primary data is valid.
[2025-10-24T17:15:12.033617] [DEBUG] [LOCAL     ] AOS: Saving primary data.
[2025-10-24T17:15:12.034602] [FATAL] [LOCAL     ] AOS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:15:12.034818] [FATAL] [MAIN      ] AOS: Failed to save primary data.
[2025-10-24T17:15:12.034889] [WARN ] [MAIN      ] AOS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:15:12.034960] [INFO ] [LOCAL     ] AOS: Starting deletion of primary data.
[2025-10-24T17:15:12.035031] [DEBUG] [LOCAL     ] AOS: No primary data file found to delete.
[2025-10-24T17:15:12.035070] [INFO ] [LOCAL     ] AOS: Starting deletion of derivative data.
[2025-10-24T17:15:12.035257] [DEBUG] [LOCAL     ] AOS: Deleted derivative data file.
[2025-10-24T17:15:12.035699] [INFO ] [MAIN      ] Update Progress: 129/2366 symbols completed. AOS took 44.0s. Estimated remaining: 4h 22m 45s. Rate: 8.5 symbols/min
[2025-10-24T17:15:12.151530] [INFO ] [REMOTE    ] APG: Fetching primary data for 2025-04.
[2025-10-24T17:15:12.249315] [INFO ] [MAIN      ] APLE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:15:12.252244] [INFO ] [REMOTE    ] APD: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T17:15:12.314804] [DEBUG] [LOCAL     ] APLE: Loaded 52333 existing records from primary storage.
[2025-10-24T17:15:12.315117] [INFO ] [MAIN      ] APLE: Loaded 52333 existing records.
[2025-10-24T17:15:12.519670] [WARN ] [MAIN      ] APLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:15:12.519918] [INFO ] [MAIN      ] APLE: Wiping existing primary data before full refresh.
[2025-10-24T17:15:12.519966] [INFO ] [LOCAL     ] APLE: Starting deletion of primary data.
[2025-10-24T17:15:12.520894] [DEBUG] [LOCAL     ] APLE: Deleted primary data file.
[2025-10-24T17:15:12.520953] [INFO ] [MAIN      ] APLE: Starting full primary refresh.
[2025-10-24T17:15:12.932888] [INFO ] [REMOTE    ] APLE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:15:12.955439] [INFO ] [REMOTE    ] APLE: Fetching primary data for 2025-01.
[2025-10-24T17:15:12.977094] [INFO ] [REMOTE    ] APH: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T17:15:13.747701] [INFO ] [REMOTE    ] APD: Fetching primary data for 2025-05.
[2025-10-24T17:15:13.930090] [INFO ] [REMOTE    ] APG: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T17:15:14.302821] [INFO ] [REMOTE    ] APLE: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T17:15:14.547695] [INFO ] [REMOTE    ] APG: Fetching primary data for 2025-05.
[2025-10-24T17:15:15.347727] [INFO ] [REMOTE    ] APH: Fetching primary data for 2025-02.
[2025-10-24T17:15:15.475279] [INFO ] [REMOTE    ] APD: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T17:15:16.088446] [INFO ] [REMOTE    ] APG: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T17:15:16.147688] [INFO ] [REMOTE    ] APG: Fetching primary data for 2025-06.
[2025-10-24T17:15:16.947622] [INFO ] [REMOTE    ] APD: Fetching primary data for 2025-06.
[2025-10-24T17:15:17.089046] [INFO ] [REMOTE    ] APH: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T17:15:17.299578] [INFO ] [REMOTE    ] APG: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T17:15:17.747632] [INFO ] [REMOTE    ] APH: Fetching primary data for 2025-03.
[2025-10-24T17:15:18.332545] [INFO ] [REMOTE    ] APD: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T17:15:18.547893] [INFO ] [REMOTE    ] APLE: Fetching primary data for 2025-02.
[2025-10-24T17:15:19.347759] [INFO ] [REMOTE    ] APD: Fetching primary data for 2025-07.
[2025-10-24T17:15:19.483783] [INFO ] [REMOTE    ] APH: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T17:15:20.020571] [INFO ] [REMOTE    ] APLE: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T17:15:20.147738] [INFO ] [REMOTE    ] APLE: Fetching primary data for 2025-03.
[2025-10-24T17:15:20.615936] [INFO ] [REMOTE    ] APD: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T17:15:20.947710] [INFO ] [REMOTE    ] APH: Fetching primary data for 2025-04.
[2025-10-24T17:15:21.522156] [INFO ] [REMOTE    ] APLE: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T17:15:21.747694] [INFO ] [REMOTE    ] APG: Fetching primary data for 2025-07.
[2025-10-24T17:15:22.484065] [INFO ] [REMOTE    ] APH: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T17:15:22.547609] [INFO ] [REMOTE    ] APH: Fetching primary data for 2025-05.
[2025-10-24T17:15:23.273759] [INFO ] [REMOTE    ] APG: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T17:15:23.347703] [INFO ] [REMOTE    ] APLE: Fetching primary data for 2025-04.
[2025-10-24T17:15:24.147713] [INFO ] [REMOTE    ] APG: Fetching primary data for 2025-08.
[2025-10-24T17:15:24.353507] [INFO ] [REMOTE    ] APH: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T17:15:24.930342] [INFO ] [REMOTE    ] APLE: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T17:15:24.947628] [INFO ] [REMOTE    ] APD: Fetching primary data for 2025-08.
[2025-10-24T17:15:25.742415] [INFO ] [REMOTE    ] APG: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T17:15:25.752315] [INFO ] [REMOTE    ] APLE: Fetching primary data for 2025-05.
[2025-10-24T17:15:26.547697] [INFO ] [REMOTE    ] APH: Fetching primary data for 2025-06.
[2025-10-24T17:15:26.621377] [INFO ] [REMOTE    ] APD: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T17:15:27.347686] [INFO ] [REMOTE    ] APD: Fetching primary data for 2025-09.
[2025-10-24T17:15:27.440847] [INFO ] [REMOTE    ] APLE: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T17:15:28.147726] [INFO ] [REMOTE    ] APLE: Fetching primary data for 2025-06.
[2025-10-24T17:15:28.276409] [INFO ] [REMOTE    ] APH: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T17:15:28.713203] [INFO ] [REMOTE    ] APD: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T17:15:28.947639] [INFO ] [REMOTE    ] APD: Fetching primary data for 2025-10.
[2025-10-24T17:15:29.747627] [INFO ] [REMOTE    ] APG: Fetching primary data for 2025-09.
[2025-10-24T17:15:29.980574] [INFO ] [REMOTE    ] APLE: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T17:15:30.440099] [INFO ] [REMOTE    ] APD: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T17:15:30.448250] [INFO ] [REMOTE    ] APD: Full fetch complete (66952 records).
[2025-10-24T17:15:30.448372] [DEBUG] [VALIDATOR ] APD: Validating primary data.
[2025-10-24T17:15:30.450224] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:15:30.450314] [FATAL] [MAIN      ] APD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:15:30.450356] [WARN ] [MAIN      ] APD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:15:30.450418] [INFO ] [LOCAL     ] APD: Starting deletion of primary data.
[2025-10-24T17:15:30.450481] [DEBUG] [LOCAL     ] APD: No primary data file found to delete.
[2025-10-24T17:15:30.450516] [INFO ] [LOCAL     ] APD: Starting deletion of derivative data.
[2025-10-24T17:15:30.450741] [DEBUG] [LOCAL     ] APD: Deleted derivative data file.
[2025-10-24T17:15:30.451198] [INFO ] [MAIN      ] Update Progress: 130/2366 symbols completed. APD took 34.8s. Estimated remaining: 4h 25m 54s. Rate: 8.4 symbols/min
[2025-10-24T17:15:30.553281] [INFO ] [REMOTE    ] APLE: Fetching primary data for 2025-07.
[2025-10-24T17:15:30.622563] [INFO ] [MAIN      ] APO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:15:30.677101] [DEBUG] [LOCAL     ] APO: Loaded 53775 existing records from primary storage.
[2025-10-24T17:15:30.677395] [INFO ] [MAIN      ] APO: Loaded 53775 existing records.
[2025-10-24T17:15:30.852329] [WARN ] [MAIN      ] APO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:15:30.852536] [INFO ] [MAIN      ] APO: Wiping existing primary data before full refresh.
[2025-10-24T17:15:30.852583] [INFO ] [LOCAL     ] APO: Starting deletion of primary data.
[2025-10-24T17:15:30.853516] [DEBUG] [LOCAL     ] APO: Deleted primary data file.
[2025-10-24T17:15:30.853576] [INFO ] [MAIN      ] APO: Starting full primary refresh.
[2025-10-24T17:15:31.217797] [INFO ] [REMOTE    ] APO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:15:31.347621] [INFO ] [REMOTE    ] APO: Fetching primary data for 2025-01.
[2025-10-24T17:15:31.442068] [INFO ] [REMOTE    ] APG: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T17:15:32.147731] [INFO ] [REMOTE    ] APG: Fetching primary data for 2025-10.
[2025-10-24T17:15:32.397079] [INFO ] [REMOTE    ] APLE: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T17:15:32.947633] [INFO ] [REMOTE    ] APLE: Fetching primary data for 2025-08.
[2025-10-24T17:15:33.288451] [INFO ] [REMOTE    ] APO: Incremental fetch complete for 2025-01 (1.94 seconds).
[2025-10-24T17:15:33.688910] [INFO ] [REMOTE    ] APG: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T17:15:33.698031] [INFO ] [REMOTE    ] APG: Full fetch complete (72264 records).
[2025-10-24T17:15:33.698150] [DEBUG] [VALIDATOR ] APG: Validating primary data.
[2025-10-24T17:15:33.754201] [INFO ] [REMOTE    ] APH: Fetching primary data for 2025-07.
[2025-10-24T17:15:34.109140] [DEBUG] [VALIDATOR ] APG: All expected trading days are present.
[2025-10-24T17:15:34.109217] [DEBUG] [VALIDATOR ] APG: Primary data validation passed.
[2025-10-24T17:15:34.109961] [INFO ] [MAIN      ] APG: Fetched primary data is valid.
[2025-10-24T17:15:34.110028] [DEBUG] [LOCAL     ] APG: Saving primary data.
[2025-10-24T17:15:34.110565] [FATAL] [LOCAL     ] APG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:15:34.110679] [FATAL] [MAIN      ] APG: Failed to save primary data.
[2025-10-24T17:15:34.110732] [WARN ] [MAIN      ] APG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:15:34.110768] [INFO ] [LOCAL     ] APG: Starting deletion of primary data.
[2025-10-24T17:15:34.110820] [DEBUG] [LOCAL     ] APG: No primary data file found to delete.
[2025-10-24T17:15:34.110854] [INFO ] [LOCAL     ] APG: Starting deletion of derivative data.
[2025-10-24T17:15:34.111035] [DEBUG] [LOCAL     ] APG: Deleted derivative data file.
[2025-10-24T17:15:34.111786] [INFO ] [MAIN      ] Update Progress: 131/2366 symbols completed. APG took 32.6s. Estimated remaining: 4h 24m 47s. Rate: 8.4 symbols/min
[2025-10-24T17:15:34.294006] [INFO ] [MAIN      ] APOS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:15:34.304499] [DEBUG] [LOCAL     ] APOS: Loaded 7105 existing records from primary storage.
[2025-10-24T17:15:34.304731] [INFO ] [MAIN      ] APOS: Loaded 7105 existing records.
[2025-10-24T17:15:34.495505] [WARN ] [MAIN      ] APOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:15:34.495829] [INFO ] [MAIN      ] APOS: Wiping existing primary data before full refresh.
[2025-10-24T17:15:34.495978] [INFO ] [LOCAL     ] APOS: Starting deletion of primary data.
[2025-10-24T17:15:34.496219] [DEBUG] [LOCAL     ] APOS: Deleted primary data file.
[2025-10-24T17:15:34.496299] [INFO ] [MAIN      ] APOS: Starting full primary refresh.
[2025-10-24T17:15:34.556074] [INFO ] [REMOTE    ] APO: Fetching primary data for 2025-02.
[2025-10-24T17:15:34.715099] [INFO ] [REMOTE    ] APLE: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T17:15:34.920149] [INFO ] [REMOTE    ] APOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:15:35.347629] [INFO ] [REMOTE    ] APOS: Fetching primary data for 2025-01.
[2025-10-24T17:15:35.745024] [INFO ] [REMOTE    ] APH: Incremental fetch complete for 2025-07 (1.99 seconds).
[2025-10-24T17:15:35.980913] [INFO ] [REMOTE    ] APO: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T17:15:36.053089] [INFO ] [REMOTE    ] APOS: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T17:15:36.147622] [INFO ] [REMOTE    ] APO: Fetching primary data for 2025-03.
[2025-10-24T17:15:36.947637] [INFO ] [REMOTE    ] APH: Fetching primary data for 2025-08.
[2025-10-24T17:15:37.747721] [INFO ] [REMOTE    ] APOS: Fetching primary data for 2025-02.
[2025-10-24T17:15:37.971848] [INFO ] [REMOTE    ] APO: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T17:15:38.129095] [INFO ] [REMOTE    ] APOS: Incremental fetch complete for 2025-02 (0.38 seconds).
[2025-10-24T17:15:38.528006] [INFO ] [REMOTE    ] APH: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T17:15:38.547674] [INFO ] [REMOTE    ] APO: Fetching primary data for 2025-04.
[2025-10-24T17:15:39.347707] [INFO ] [REMOTE    ] APOS: Fetching primary data for 2025-03.
[2025-10-24T17:15:40.087962] [INFO ] [REMOTE    ] APOS: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T17:15:40.147676] [INFO ] [REMOTE    ] APH: Fetching primary data for 2025-09.
[2025-10-24T17:15:40.348005] [INFO ] [REMOTE    ] APO: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T17:15:40.947678] [INFO ] [REMOTE    ] APOS: Fetching primary data for 2025-04.
[2025-10-24T17:15:41.510381] [INFO ] [REMOTE    ] APOS: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T17:15:41.747712] [INFO ] [REMOTE    ] APO: Fetching primary data for 2025-05.
[2025-10-24T17:15:42.071168] [INFO ] [REMOTE    ] APH: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T17:15:42.547694] [INFO ] [REMOTE    ] APLE: Fetching primary data for 2025-09.
[2025-10-24T17:15:43.347715] [INFO ] [REMOTE    ] APOS: Fetching primary data for 2025-05.
[2025-10-24T17:15:43.707941] [INFO ] [REMOTE    ] APO: Incremental fetch complete for 2025-05 (1.96 seconds).
[2025-10-24T17:15:44.087634] [INFO ] [REMOTE    ] APOS: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T17:15:44.147696] [INFO ] [REMOTE    ] APH: Fetching primary data for 2025-10.
[2025-10-24T17:15:44.329930] [INFO ] [REMOTE    ] APLE: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T17:15:44.947684] [INFO ] [REMOTE    ] APLE: Fetching primary data for 2025-10.
[2025-10-24T17:15:45.747636] [INFO ] [REMOTE    ] APOS: Fetching primary data for 2025-06.
[2025-10-24T17:15:46.441446] [INFO ] [REMOTE    ] APH: Incremental fetch complete for 2025-10 (2.29 seconds).
[2025-10-24T17:15:46.451988] [INFO ] [REMOTE    ] APH: Full fetch complete (77870 records).
[2025-10-24T17:15:46.452117] [DEBUG] [VALIDATOR ] APH: Validating primary data.
[2025-10-24T17:15:46.550740] [INFO ] [REMOTE    ] APO: Fetching primary data for 2025-06.
[2025-10-24T17:15:46.581178] [INFO ] [REMOTE    ] APOS: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T17:15:46.879985] [DEBUG] [VALIDATOR ] APH: All expected trading days are present.
[2025-10-24T17:15:46.881369] [INFO ] [REMOTE    ] APLE: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T17:15:46.881546] [DEBUG] [VALIDATOR ] APH: Primary data validation passed.
[2025-10-24T17:15:46.882503] [INFO ] [MAIN      ] APH: Fetched primary data is valid.
[2025-10-24T17:15:46.891192] [DEBUG] [LOCAL     ] APH: Saving primary data.
[2025-10-24T17:15:46.891894] [FATAL] [LOCAL     ] APH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:15:46.892114] [FATAL] [MAIN      ] APH: Failed to save primary data.
[2025-10-24T17:15:46.892193] [WARN ] [MAIN      ] APH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:15:46.892268] [INFO ] [LOCAL     ] APH: Starting deletion of primary data.
[2025-10-24T17:15:46.892341] [DEBUG] [LOCAL     ] APH: No primary data file found to delete.
[2025-10-24T17:15:46.892468] [INFO ] [REMOTE    ] APLE: Full fetch complete (74779 records).
[2025-10-24T17:15:46.892577] [DEBUG] [VALIDATOR ] APLE: Validating primary data.
[2025-10-24T17:15:46.892405] [INFO ] [LOCAL     ] APH: Starting deletion of derivative data.
[2025-10-24T17:15:46.892933] [DEBUG] [LOCAL     ] APH: Deleted derivative data file.
[2025-10-24T17:15:46.893869] [INFO ] [MAIN      ] Update Progress: 132/2366 symbols completed. APH took 37.5s. Estimated remaining: 4h 26m 16s. Rate: 8.4 symbols/min
[2025-10-24T17:15:47.269256] [INFO ] [MAIN      ] APTV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:15:47.347717] [INFO ] [REMOTE    ] APOS: Fetching primary data for 2025-07.
[2025-10-24T17:15:47.491388] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present.
[2025-10-24T17:15:47.491488] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed.
[2025-10-24T17:15:47.492356] [INFO ] [MAIN      ] APLE: Fetched primary data is valid.
[2025-10-24T17:15:47.492448] [DEBUG] [LOCAL     ] APLE: Saving primary data.
[2025-10-24T17:15:47.508263] [FATAL] [LOCAL     ] APLE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:15:47.508502] [FATAL] [MAIN      ] APLE: Failed to save primary data.
[2025-10-24T17:15:47.508571] [WARN ] [MAIN      ] APLE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:15:47.508672] [INFO ] [LOCAL     ] APLE: Starting deletion of primary data.
[2025-10-24T17:15:47.508757] [DEBUG] [LOCAL     ] APLE: No primary data file found to delete.
[2025-10-24T17:15:47.508800] [INFO ] [LOCAL     ] APLE: Starting deletion of derivative data.
[2025-10-24T17:15:47.508962] [DEBUG] [LOCAL     ] APLE: Deleted derivative data file.
[2025-10-24T17:15:47.509860] [INFO ] [MAIN      ] Update Progress: 133/2366 symbols completed. APLE took 35.5s. Estimated remaining: 4h 24m 20s. Rate: 8.4 symbols/min
[2025-10-24T17:15:47.675636] [DEBUG] [LOCAL     ] APTV: Loaded 52199 existing records from primary storage.
[2025-10-24T17:15:47.686412] [INFO ] [MAIN      ] APTV: Loaded 52199 existing records.
[2025-10-24T17:15:47.823432] [INFO ] [MAIN      ] AQN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:15:47.933409] [WARN ] [MAIN      ] APTV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:15:47.933807] [INFO ] [MAIN      ] APTV: Wiping existing primary data before full refresh.
[2025-10-24T17:15:47.933944] [INFO ] [LOCAL     ] APTV: Starting deletion of primary data.
[2025-10-24T17:15:47.934757] [DEBUG] [LOCAL     ] APTV: Deleted primary data file.
[2025-10-24T17:15:47.934813] [INFO ] [MAIN      ] APTV: Starting full primary refresh.
[2025-10-24T17:15:48.056850] [INFO ] [REMOTE    ] APOS: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T17:15:48.107235] [DEBUG] [LOCAL     ] AQN: Loaded 52016 existing records from primary storage.
[2025-10-24T17:15:48.125259] [INFO ] [MAIN      ] AQN: Loaded 52016 existing records.
[2025-10-24T17:15:48.172842] [INFO ] [REMOTE    ] APOS: Fetching primary data for 2025-08.
[2025-10-24T17:15:48.469086] [WARN ] [MAIN      ] AQN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:15:48.479727] [INFO ] [MAIN      ] AQN: Wiping existing primary data before full refresh.
[2025-10-24T17:15:48.502493] [INFO ] [LOCAL     ] AQN: Starting deletion of primary data.
[2025-10-24T17:15:48.539343] [DEBUG] [LOCAL     ] AQN: Deleted primary data file.
[2025-10-24T17:15:48.542196] [INFO ] [REMOTE    ] APTV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:15:48.542346] [INFO ] [MAIN      ] AQN: Starting full primary refresh.
[2025-10-24T17:15:48.744875] [INFO ] [REMOTE    ] APO: Incremental fetch complete for 2025-06 (2.19 seconds).
[2025-10-24T17:15:48.948233] [INFO ] [REMOTE    ] APTV: Fetching primary data for 2025-01.
[2025-10-24T17:15:48.976376] [INFO ] [REMOTE    ] AQN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:15:48.978154] [INFO ] [REMOTE    ] APOS: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T17:15:49.747739] [INFO ] [REMOTE    ] APOS: Fetching primary data for 2025-09.
[2025-10-24T17:15:50.465395] [INFO ] [REMOTE    ] APOS: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T17:15:50.547700] [INFO ] [REMOTE    ] APOS: Fetching primary data for 2025-10.
[2025-10-24T17:15:50.771569] [INFO ] [REMOTE    ] APTV: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T17:15:51.239434] [INFO ] [REMOTE    ] APOS: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T17:15:51.240835] [INFO ] [REMOTE    ] APOS: Full fetch complete (10199 records).
[2025-10-24T17:15:51.240919] [DEBUG] [VALIDATOR ] APOS: Validating primary data.
[2025-10-24T17:15:51.241284] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:15:51.241362] [FATAL] [MAIN      ] APOS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:15:51.241404] [WARN ] [MAIN      ] APOS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:15:51.241440] [INFO ] [LOCAL     ] APOS: Starting deletion of primary data.
[2025-10-24T17:15:51.241501] [DEBUG] [LOCAL     ] APOS: No primary data file found to delete.
[2025-10-24T17:15:51.241572] [INFO ] [LOCAL     ] APOS: Starting deletion of derivative data.
[2025-10-24T17:15:51.241769] [DEBUG] [LOCAL     ] APOS: Deleted derivative data file.
[2025-10-24T17:15:51.241867] [INFO ] [MAIN      ] Update Progress: 134/2366 symbols completed. APOS took 17.1s. Estimated remaining: 4h 23m 16s. Rate: 8.5 symbols/min
[2025-10-24T17:15:51.352805] [INFO ] [REMOTE    ] AQN: Fetching primary data for 2025-01.
[2025-10-24T17:15:51.419081] [INFO ] [MAIN      ] AQNB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:15:51.427311] [DEBUG] [LOCAL     ] AQNB: Loaded 3899 existing records from primary storage.
[2025-10-24T17:15:51.427882] [INFO ] [MAIN      ] AQNB: Loaded 3899 existing records.
[2025-10-24T17:15:51.606740] [WARN ] [MAIN      ] AQNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:15:51.606955] [INFO ] [MAIN      ] AQNB: Wiping existing primary data before full refresh.
[2025-10-24T17:15:51.607029] [INFO ] [LOCAL     ] AQNB: Starting deletion of primary data.
[2025-10-24T17:15:51.607250] [DEBUG] [LOCAL     ] AQNB: Deleted primary data file.
[2025-10-24T17:15:51.607309] [INFO ] [MAIN      ] AQNB: Starting full primary refresh.
[2025-10-24T17:15:51.954064] [INFO ] [REMOTE    ] AQNB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:15:52.147602] [INFO ] [REMOTE    ] AQNB: Fetching primary data for 2025-01.
[2025-10-24T17:15:52.735948] [INFO ] [REMOTE    ] AQNB: Incremental fetch complete for 2025-01 (0.59 seconds).
[2025-10-24T17:15:52.947637] [INFO ] [REMOTE    ] AQNB: Fetching primary data for 2025-02.
[2025-10-24T17:15:53.380072] [INFO ] [REMOTE    ] AQN: Incremental fetch complete for 2025-01 (2.03 seconds).
[2025-10-24T17:15:53.396558] [INFO ] [REMOTE    ] AQNB: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T17:15:53.747617] [INFO ] [REMOTE    ] APO: Fetching primary data for 2025-07.
[2025-10-24T17:15:54.547675] [INFO ] [REMOTE    ] AQNB: Fetching primary data for 2025-03.
[2025-10-24T17:15:55.158637] [INFO ] [REMOTE    ] AQNB: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T17:15:55.347667] [INFO ] [REMOTE    ] AQNB: Fetching primary data for 2025-04.
[2025-10-24T17:15:55.786499] [INFO ] [REMOTE    ] APO: Incremental fetch complete for 2025-07 (2.04 seconds).
[2025-10-24T17:15:55.924309] [INFO ] [REMOTE    ] AQNB: Incremental fetch complete for 2025-04 (0.58 seconds).
[2025-10-24T17:15:56.147632] [INFO ] [REMOTE    ] AQNB: Fetching primary data for 2025-05.
[2025-10-24T17:15:56.681482] [INFO ] [REMOTE    ] AQNB: Incremental fetch complete for 2025-05 (0.53 seconds).
[2025-10-24T17:15:56.947618] [INFO ] [REMOTE    ] APO: Fetching primary data for 2025-08.
[2025-10-24T17:15:57.747639] [INFO ] [REMOTE    ] AQNB: Fetching primary data for 2025-06.
[2025-10-24T17:15:58.473224] [INFO ] [REMOTE    ] AQNB: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T17:15:58.547634] [INFO ] [REMOTE    ] AQN: Fetching primary data for 2025-02.
[2025-10-24T17:15:58.750024] [INFO ] [REMOTE    ] APO: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T17:15:59.347718] [INFO ] [REMOTE    ] APTV: Fetching primary data for 2025-02.
[2025-10-24T17:15:59.993628] [INFO ] [REMOTE    ] AQN: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T17:16:00.147633] [INFO ] [REMOTE    ] AQNB: Fetching primary data for 2025-07.
[2025-10-24T17:16:00.947749] [INFO ] [REMOTE    ] AQN: Fetching primary data for 2025-03.
[2025-10-24T17:16:01.324772] [INFO ] [REMOTE    ] AQNB: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T17:16:01.747692] [INFO ] [REMOTE    ] AQNB: Fetching primary data for 2025-08.
[2025-10-24T17:16:01.805487] [INFO ] [REMOTE    ] APTV: Incremental fetch complete for 2025-02 (2.46 seconds).
[2025-10-24T17:16:02.547742] [INFO ] [REMOTE    ] APTV: Fetching primary data for 2025-03.
[2025-10-24T17:16:03.347732] [INFO ] [REMOTE    ] APO: Fetching primary data for 2025-09.
[2025-10-24T17:16:03.642602] [INFO ] [REMOTE    ] AQNB: Incremental fetch complete for 2025-08 (1.89 seconds).
[2025-10-24T17:16:04.147740] [INFO ] [REMOTE    ] AQNB: Fetching primary data for 2025-09.
[2025-10-24T17:16:04.338779] [INFO ] [REMOTE    ] APTV: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T17:16:04.762525] [INFO ] [REMOTE    ] AQNB: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T17:16:04.802772] [INFO ] [REMOTE    ] AQN: Incremental fetch complete for 2025-03 (3.86 seconds).
[2025-10-24T17:16:04.947725] [INFO ] [REMOTE    ] AQN: Fetching primary data for 2025-04.
[2025-10-24T17:16:05.349438] [INFO ] [REMOTE    ] APO: Incremental fetch complete for 2025-09 (2.00 seconds).
[2025-10-24T17:16:05.747668] [INFO ] [REMOTE    ] APO: Fetching primary data for 2025-10.
[2025-10-24T17:16:06.547683] [INFO ] [REMOTE    ] APTV: Fetching primary data for 2025-04.
[2025-10-24T17:16:06.681407] [INFO ] [REMOTE    ] AQN: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T17:16:07.347637] [INFO ] [REMOTE    ] AQN: Fetching primary data for 2025-05.
[2025-10-24T17:16:07.485971] [INFO ] [REMOTE    ] APO: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T17:16:07.495746] [INFO ] [REMOTE    ] APO: Full fetch complete (77076 records).
[2025-10-24T17:16:07.495929] [DEBUG] [VALIDATOR ] APO: Validating primary data.
[2025-10-24T17:16:07.497196] [FATAL] [VALIDATOR ] APO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:16:07.497307] [FATAL] [MAIN      ] APO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:16:07.497352] [WARN ] [MAIN      ] APO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:16:07.497418] [INFO ] [LOCAL     ] APO: Starting deletion of primary data.
[2025-10-24T17:16:07.497513] [DEBUG] [LOCAL     ] APO: No primary data file found to delete.
[2025-10-24T17:16:07.497565] [INFO ] [LOCAL     ] APO: Starting deletion of derivative data.
[2025-10-24T17:16:07.497758] [DEBUG] [LOCAL     ] APO: Deleted derivative data file.
[2025-10-24T17:16:07.498167] [INFO ] [MAIN      ] Update Progress: 135/2366 symbols completed. APO took 37.0s. Estimated remaining: 4h 25m 41s. Rate: 8.4 symbols/min
[2025-10-24T17:16:07.690590] [INFO ] [MAIN      ] AR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:16:07.747743] [DEBUG] [LOCAL     ] AR: Loaded 53980 existing records from primary storage.
[2025-10-24T17:16:07.748092] [INFO ] [MAIN      ] AR: Loaded 53980 existing records.
[2025-10-24T17:16:07.930758] [WARN ] [MAIN      ] AR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:16:07.931096] [INFO ] [MAIN      ] AR: Wiping existing primary data before full refresh.
[2025-10-24T17:16:07.931197] [INFO ] [LOCAL     ] AR: Starting deletion of primary data.
[2025-10-24T17:16:07.932342] [DEBUG] [LOCAL     ] AR: Deleted primary data file.
[2025-10-24T17:16:07.932405] [INFO ] [MAIN      ] AR: Starting full primary refresh.
[2025-10-24T17:16:08.173790] [INFO ] [REMOTE    ] APTV: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T17:16:08.153816] [INFO ] [REMOTE    ] AQNB: Fetching primary data for 2025-10.
[2025-10-24T17:16:08.333289] [INFO ] [REMOTE    ] AR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:16:08.821145] [INFO ] [REMOTE    ] AQNB: Incremental fetch complete for 2025-10 (0.67 seconds).
[2025-10-24T17:16:08.822154] [INFO ] [REMOTE    ] AQNB: Full fetch complete (5364 records).
[2025-10-24T17:16:08.822222] [DEBUG] [VALIDATOR ] AQNB: Validating primary data.
[2025-10-24T17:16:08.956459] [INFO ] [REMOTE    ] APTV: Fetching primary data for 2025-05.
[2025-10-24T17:16:09.228443] [INFO ] [REMOTE    ] AQN: Incremental fetch complete for 2025-05 (1.88 seconds).
[2025-10-24T17:16:09.235903] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present.
[2025-10-24T17:16:09.236005] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed.
[2025-10-24T17:16:09.246823] [INFO ] [MAIN      ] AQNB: Fetched primary data is valid.
[2025-10-24T17:16:09.246937] [DEBUG] [LOCAL     ] AQNB: Saving primary data.
[2025-10-24T17:16:09.247488] [FATAL] [LOCAL     ] AQNB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:16:09.247572] [FATAL] [MAIN      ] AQNB: Failed to save primary data.
[2025-10-24T17:16:09.247615] [WARN ] [MAIN      ] AQNB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:16:09.247705] [INFO ] [LOCAL     ] AQNB: Starting deletion of primary data.
[2025-10-24T17:16:09.247771] [DEBUG] [LOCAL     ] AQNB: No primary data file found to delete.
[2025-10-24T17:16:09.247807] [INFO ] [LOCAL     ] AQNB: Starting deletion of derivative data.
[2025-10-24T17:16:09.247970] [DEBUG] [LOCAL     ] AQNB: Deleted derivative data file.
[2025-10-24T17:16:09.248054] [INFO ] [MAIN      ] Update Progress: 136/2366 symbols completed. AQNB took 18.0s. Estimated remaining: 4h 24m 5s. Rate: 8.4 symbols/min
[2025-10-24T17:16:09.414849] [INFO ] [MAIN      ] ARCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:16:09.456281] [DEBUG] [LOCAL     ] ARCO: Loaded 44509 existing records from primary storage.
[2025-10-24T17:16:09.456579] [INFO ] [MAIN      ] ARCO: Loaded 44509 existing records.
[2025-10-24T17:16:09.634764] [WARN ] [MAIN      ] ARCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:16:09.635839] [INFO ] [MAIN      ] ARCO: Wiping existing primary data before full refresh.
[2025-10-24T17:16:09.635909] [INFO ] [LOCAL     ] ARCO: Starting deletion of primary data.
[2025-10-24T17:16:09.637271] [DEBUG] [LOCAL     ] ARCO: Deleted primary data file.
[2025-10-24T17:16:09.637330] [INFO ] [MAIN      ] ARCO: Starting full primary refresh.
[2025-10-24T17:16:09.753014] [INFO ] [REMOTE    ] AR: Fetching primary data for 2025-01.
[2025-10-24T17:16:09.991276] [INFO ] [REMOTE    ] ARCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:16:10.547681] [INFO ] [REMOTE    ] ARCO: Fetching primary data for 2025-01.
[2025-10-24T17:16:10.668188] [INFO ] [REMOTE    ] APTV: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T17:16:11.233548] [INFO ] [REMOTE    ] AR: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T17:16:11.347750] [INFO ] [REMOTE    ] APTV: Fetching primary data for 2025-06.
[2025-10-24T17:16:12.147611] [INFO ] [REMOTE    ] AR: Fetching primary data for 2025-02.
[2025-10-24T17:16:12.177904] [INFO ] [REMOTE    ] ARCO: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T17:16:12.793325] [INFO ] [REMOTE    ] APTV: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T17:16:12.947617] [INFO ] [REMOTE    ] APTV: Fetching primary data for 2025-07.
[2025-10-24T17:16:13.731524] [INFO ] [REMOTE    ] AR: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T17:16:13.747600] [INFO ] [REMOTE    ] AR: Fetching primary data for 2025-03.
[2025-10-24T17:16:14.544128] [INFO ] [REMOTE    ] APTV: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T17:16:14.554615] [INFO ] [REMOTE    ] AQN: Fetching primary data for 2025-06.
[2025-10-24T17:16:15.347708] [INFO ] [REMOTE    ] APTV: Fetching primary data for 2025-08.
[2025-10-24T17:16:15.572367] [INFO ] [REMOTE    ] AR: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T17:16:16.147639] [INFO ] [REMOTE    ] ARCO: Fetching primary data for 2025-02.
[2025-10-24T17:16:16.327204] [INFO ] [REMOTE    ] AQN: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T17:16:16.732062] [INFO ] [REMOTE    ] APTV: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T17:16:16.947739] [INFO ] [REMOTE    ] AQN: Fetching primary data for 2025-07.
[2025-10-24T17:16:17.156776] [INFO ] [REMOTE    ] ARCO: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T17:16:17.747740] [INFO ] [REMOTE    ] ARCO: Fetching primary data for 2025-03.
[2025-10-24T17:16:18.547633] [INFO ] [REMOTE    ] APTV: Fetching primary data for 2025-09.
[2025-10-24T17:16:18.664303] [INFO ] [REMOTE    ] AQN: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T17:16:19.196504] [INFO ] [REMOTE    ] ARCO: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T17:16:19.347709] [INFO ] [REMOTE    ] ARCO: Fetching primary data for 2025-04.
[2025-10-24T17:16:19.988246] [INFO ] [REMOTE    ] APTV: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T17:16:20.147700] [INFO ] [REMOTE    ] APTV: Fetching primary data for 2025-10.
[2025-10-24T17:16:20.786108] [INFO ] [REMOTE    ] ARCO: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T17:16:20.947623] [INFO ] [REMOTE    ] AQN: Fetching primary data for 2025-08.
[2025-10-24T17:16:21.563935] [INFO ] [REMOTE    ] APTV: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T17:16:21.573073] [INFO ] [REMOTE    ] APTV: Full fetch complete (75786 records).
[2025-10-24T17:16:21.573247] [DEBUG] [VALIDATOR ] APTV: Validating primary data.
[2025-10-24T17:16:21.756072] [INFO ] [REMOTE    ] ARCO: Fetching primary data for 2025-05.
[2025-10-24T17:16:21.969889] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present.
[2025-10-24T17:16:21.969984] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed.
[2025-10-24T17:16:21.970838] [INFO ] [MAIN      ] APTV: Fetched primary data is valid.
[2025-10-24T17:16:21.970909] [DEBUG] [LOCAL     ] APTV: Saving primary data.
[2025-10-24T17:16:21.971695] [FATAL] [LOCAL     ] APTV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:16:21.971788] [FATAL] [MAIN      ] APTV: Failed to save primary data.
[2025-10-24T17:16:21.971833] [WARN ] [MAIN      ] APTV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:16:21.971898] [INFO ] [LOCAL     ] APTV: Starting deletion of primary data.
[2025-10-24T17:16:21.971961] [DEBUG] [LOCAL     ] APTV: No primary data file found to delete.
[2025-10-24T17:16:21.972000] [INFO ] [LOCAL     ] APTV: Starting deletion of derivative data.
[2025-10-24T17:16:21.972143] [DEBUG] [LOCAL     ] APTV: Deleted derivative data file.
[2025-10-24T17:16:21.972720] [INFO ] [MAIN      ] Update Progress: 137/2366 symbols completed. APTV took 35.1s. Estimated remaining: 4h 25m 30s. Rate: 8.4 symbols/min
[2025-10-24T17:16:22.143774] [INFO ] [MAIN      ] ARDC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:16:22.161680] [DEBUG] [LOCAL     ] ARDC: Loaded 15301 existing records from primary storage.
[2025-10-24T17:16:22.161913] [INFO ] [MAIN      ] ARDC: Loaded 15301 existing records.
[2025-10-24T17:16:22.346579] [WARN ] [MAIN      ] ARDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:16:22.346986] [INFO ] [MAIN      ] ARDC: Wiping existing primary data before full refresh.
[2025-10-24T17:16:22.347199] [INFO ] [LOCAL     ] ARDC: Starting deletion of primary data.
[2025-10-24T17:16:22.347718] [DEBUG] [LOCAL     ] ARDC: Deleted primary data file.
[2025-10-24T17:16:22.347811] [INFO ] [MAIN      ] ARDC: Starting full primary refresh.
[2025-10-24T17:16:22.502918] [INFO ] [REMOTE    ] AQN: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T17:16:22.551874] [INFO ] [REMOTE    ] AR: Fetching primary data for 2025-04.
[2025-10-24T17:16:22.741979] [INFO ] [REMOTE    ] ARDC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:16:23.347621] [INFO ] [REMOTE    ] ARDC: Fetching primary data for 2025-01.
[2025-10-24T17:16:23.495464] [INFO ] [REMOTE    ] ARCO: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T17:16:23.925400] [INFO ] [REMOTE    ] ARDC: Incremental fetch complete for 2025-01 (0.58 seconds).
[2025-10-24T17:16:24.147629] [INFO ] [REMOTE    ] ARDC: Fetching primary data for 2025-02.
[2025-10-24T17:16:24.480266] [INFO ] [REMOTE    ] AR: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T17:16:24.844953] [INFO ] [REMOTE    ] ARDC: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T17:16:24.947690] [INFO ] [REMOTE    ] ARCO: Fetching primary data for 2025-06.
[2025-10-24T17:16:25.747744] [INFO ] [REMOTE    ] AQN: Fetching primary data for 2025-09.
[2025-10-24T17:16:26.399004] [INFO ] [REMOTE    ] ARCO: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T17:16:26.547631] [INFO ] [REMOTE    ] ARDC: Fetching primary data for 2025-03.
[2025-10-24T17:16:27.244819] [INFO ] [REMOTE    ] ARDC: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T17:16:27.347712] [INFO ] [REMOTE    ] AR: Fetching primary data for 2025-05.
[2025-10-24T17:16:27.420200] [INFO ] [REMOTE    ] AQN: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T17:16:28.147739] [INFO ] [REMOTE    ] ARDC: Fetching primary data for 2025-04.
[2025-10-24T17:16:28.803699] [INFO ] [REMOTE    ] AR: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T17:16:28.947614] [INFO ] [REMOTE    ] AR: Fetching primary data for 2025-06.
[2025-10-24T17:16:29.191227] [INFO ] [REMOTE    ] ARDC: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T17:16:29.747675] [INFO ] [REMOTE    ] ARCO: Fetching primary data for 2025-07.
[2025-10-24T17:16:30.553639] [INFO ] [REMOTE    ] ARDC: Fetching primary data for 2025-05.
[2025-10-24T17:16:30.566501] [INFO ] [REMOTE    ] AR: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T17:16:30.972151] [INFO ] [REMOTE    ] ARCO: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T17:16:31.019265] [INFO ] [REMOTE    ] ARDC: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T17:16:31.347639] [INFO ] [REMOTE    ] ARCO: Fetching primary data for 2025-08.
[2025-10-24T17:16:32.147751] [INFO ] [REMOTE    ] AQN: Fetching primary data for 2025-10.
[2025-10-24T17:16:32.868819] [INFO ] [REMOTE    ] ARCO: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T17:16:32.947630] [INFO ] [REMOTE    ] ARCO: Fetching primary data for 2025-09.
[2025-10-24T17:16:33.747637] [INFO ] [REMOTE    ] ARDC: Fetching primary data for 2025-06.
[2025-10-24T17:16:33.802912] [INFO ] [REMOTE    ] AQN: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T17:16:33.812330] [INFO ] [REMOTE    ] AQN: Full fetch complete (75300 records).
[2025-10-24T17:16:33.812469] [DEBUG] [VALIDATOR ] AQN: Validating primary data.
[2025-10-24T17:16:34.203066] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present.
[2025-10-24T17:16:34.203161] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed.
[2025-10-24T17:16:34.203931] [INFO ] [MAIN      ] AQN: Fetched primary data is valid.
[2025-10-24T17:16:34.203993] [DEBUG] [LOCAL     ] AQN: Saving primary data.
[2025-10-24T17:16:34.204567] [FATAL] [LOCAL     ] AQN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:16:34.204680] [FATAL] [MAIN      ] AQN: Failed to save primary data.
[2025-10-24T17:16:34.204761] [WARN ] [MAIN      ] AQN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:16:34.204842] [INFO ] [LOCAL     ] AQN: Starting deletion of primary data.
[2025-10-24T17:16:34.204920] [DEBUG] [LOCAL     ] AQN: No primary data file found to delete.
[2025-10-24T17:16:34.204970] [INFO ] [LOCAL     ] AQN: Starting deletion of derivative data.
[2025-10-24T17:16:34.205164] [DEBUG] [LOCAL     ] AQN: Deleted derivative data file.
[2025-10-24T17:16:34.205600] [INFO ] [MAIN      ] Update Progress: 138/2366 symbols completed. AQN took 46.7s. Estimated remaining: 4h 26m 45s. Rate: 8.4 symbols/min
[2025-10-24T17:16:34.376374] [INFO ] [MAIN      ] ARDT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:16:34.404560] [INFO ] [REMOTE    ] ARCO: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T17:16:34.434579] [DEBUG] [LOCAL     ] ARDT: Loaded 27612 existing records from primary storage.
[2025-10-24T17:16:34.434868] [INFO ] [MAIN      ] ARDT: Loaded 27612 existing records.
[2025-10-24T17:16:34.552754] [INFO ] [REMOTE    ] ARCO: Fetching primary data for 2025-10.
[2025-10-24T17:16:34.615494] [WARN ] [MAIN      ] ARDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:16:34.615765] [INFO ] [MAIN      ] ARDT: Wiping existing primary data before full refresh.
[2025-10-24T17:16:34.615816] [INFO ] [LOCAL     ] ARDT: Starting deletion of primary data.
[2025-10-24T17:16:34.616276] [DEBUG] [LOCAL     ] ARDT: Deleted primary data file.
[2025-10-24T17:16:34.616331] [INFO ] [MAIN      ] ARDT: Starting full primary refresh.
[2025-10-24T17:16:34.927362] [INFO ] [REMOTE    ] ARDC: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T17:16:35.004088] [INFO ] [REMOTE    ] ARDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:16:35.347680] [INFO ] [REMOTE    ] ARDT: Fetching primary data for 2025-01.
[2025-10-24T17:16:35.982456] [INFO ] [REMOTE    ] ARCO: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T17:16:35.989663] [INFO ] [REMOTE    ] ARCO: Full fetch complete (64493 records).
[2025-10-24T17:16:35.989789] [DEBUG] [VALIDATOR ] ARCO: Validating primary data.
[2025-10-24T17:16:35.990441] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:16:35.990528] [FATAL] [MAIN      ] ARCO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:16:35.990569] [WARN ] [MAIN      ] ARCO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:16:35.990607] [INFO ] [LOCAL     ] ARCO: Starting deletion of primary data.
[2025-10-24T17:16:35.990698] [DEBUG] [LOCAL     ] ARCO: No primary data file found to delete.
[2025-10-24T17:16:35.990752] [INFO ] [LOCAL     ] ARCO: Starting deletion of derivative data.
[2025-10-24T17:16:35.990900] [DEBUG] [LOCAL     ] ARCO: Deleted derivative data file.
[2025-10-24T17:16:35.991245] [INFO ] [MAIN      ] Update Progress: 139/2366 symbols completed. ARCO took 26.7s. Estimated remaining: 4h 25m 11s. Rate: 8.4 symbols/min
[2025-10-24T17:16:36.159724] [INFO ] [REMOTE    ] ARDC: Fetching primary data for 2025-07.
[2025-10-24T17:16:36.163286] [INFO ] [MAIN      ] ARE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:16:36.220251] [DEBUG] [LOCAL     ] ARE: Loaded 51277 existing records from primary storage.
[2025-10-24T17:16:36.220578] [INFO ] [MAIN      ] ARE: Loaded 51277 existing records.
[2025-10-24T17:16:36.411718] [WARN ] [MAIN      ] ARE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:16:36.411921] [INFO ] [MAIN      ] ARE: Wiping existing primary data before full refresh.
[2025-10-24T17:16:36.411972] [INFO ] [LOCAL     ] ARE: Starting deletion of primary data.
[2025-10-24T17:16:36.412865] [DEBUG] [LOCAL     ] ARE: Deleted primary data file.
[2025-10-24T17:16:36.412922] [INFO ] [MAIN      ] ARE: Starting full primary refresh.
[2025-10-24T17:16:36.804668] [INFO ] [REMOTE    ] ARE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:16:36.834856] [INFO ] [REMOTE    ] ARDC: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T17:16:36.893927] [INFO ] [REMOTE    ] ARDT: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T17:16:36.947617] [INFO ] [REMOTE    ] ARDC: Fetching primary data for 2025-08.
[2025-10-24T17:16:37.744716] [INFO ] [REMOTE    ] ARDC: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T17:16:37.747853] [INFO ] [REMOTE    ] ARE: Fetching primary data for 2025-01.
[2025-10-24T17:16:38.547696] [INFO ] [REMOTE    ] ARDC: Fetching primary data for 2025-09.
[2025-10-24T17:16:39.358438] [INFO ] [REMOTE    ] AR: Fetching primary data for 2025-07.
[2025-10-24T17:16:39.363970] [INFO ] [REMOTE    ] ARE: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T17:16:39.513964] [INFO ] [REMOTE    ] ARDC: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T17:16:40.147735] [INFO ] [REMOTE    ] ARE: Fetching primary data for 2025-02.
[2025-10-24T17:16:40.947689] [INFO ] [REMOTE    ] ARDT: Fetching primary data for 2025-02.
[2025-10-24T17:16:41.041964] [INFO ] [REMOTE    ] AR: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T17:16:41.403223] [INFO ] [REMOTE    ] ARE: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T17:16:41.747626] [INFO ] [REMOTE    ] AR: Fetching primary data for 2025-08.
[2025-10-24T17:16:42.121737] [INFO ] [REMOTE    ] ARDT: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T17:16:42.547716] [INFO ] [REMOTE    ] ARDT: Fetching primary data for 2025-03.
[2025-10-24T17:16:43.347679] [INFO ] [REMOTE    ] ARDC: Fetching primary data for 2025-10.
[2025-10-24T17:16:43.631268] [INFO ] [REMOTE    ] AR: Incremental fetch complete for 2025-08 (1.88 seconds).
[2025-10-24T17:16:43.851108] [INFO ] [REMOTE    ] ARDT: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T17:16:44.147695] [INFO ] [REMOTE    ] ARDT: Fetching primary data for 2025-04.
[2025-10-24T17:16:44.495499] [INFO ] [REMOTE    ] ARDC: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T17:16:44.501275] [INFO ] [REMOTE    ] ARDC: Full fetch complete (21624 records).
[2025-10-24T17:16:44.501437] [DEBUG] [VALIDATOR ] ARDC: Validating primary data.
[2025-10-24T17:16:44.887508] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present.
[2025-10-24T17:16:44.887602] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed.
[2025-10-24T17:16:44.888002] [INFO ] [MAIN      ] ARDC: Fetched primary data is valid.
[2025-10-24T17:16:44.888062] [DEBUG] [LOCAL     ] ARDC: Saving primary data.
[2025-10-24T17:16:44.888343] [FATAL] [LOCAL     ] ARDC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:16:44.888426] [FATAL] [MAIN      ] ARDC: Failed to save primary data.
[2025-10-24T17:16:44.888467] [WARN ] [MAIN      ] ARDC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:16:44.888525] [INFO ] [LOCAL     ] ARDC: Starting deletion of primary data.
[2025-10-24T17:16:44.888582] [DEBUG] [LOCAL     ] ARDC: No primary data file found to delete.
[2025-10-24T17:16:44.888616] [INFO ] [LOCAL     ] ARDC: Starting deletion of derivative data.
[2025-10-24T17:16:44.888817] [DEBUG] [LOCAL     ] ARDC: Deleted derivative data file.
[2025-10-24T17:16:44.888914] [INFO ] [MAIN      ] Update Progress: 140/2366 symbols completed. ARDC took 22.9s. Estimated remaining: 4h 25m 32s. Rate: 8.4 symbols/min
[2025-10-24T17:16:44.951738] [INFO ] [REMOTE    ] ARE: Fetching primary data for 2025-03.
[2025-10-24T17:16:45.061199] [INFO ] [MAIN      ] ARES: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:16:45.110315] [DEBUG] [LOCAL     ] ARES: Loaded 50046 existing records from primary storage.
[2025-10-24T17:16:45.110611] [INFO ] [MAIN      ] ARES: Loaded 50046 existing records.
[2025-10-24T17:16:45.238597] [INFO ] [REMOTE    ] ARDT: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T17:16:45.320455] [WARN ] [MAIN      ] ARES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:16:45.320690] [INFO ] [MAIN      ] ARES: Wiping existing primary data before full refresh.
[2025-10-24T17:16:45.320747] [INFO ] [LOCAL     ] ARES: Starting deletion of primary data.
[2025-10-24T17:16:45.321584] [DEBUG] [LOCAL     ] ARES: Deleted primary data file.
[2025-10-24T17:16:45.321672] [INFO ] [MAIN      ] ARES: Starting full primary refresh.
[2025-10-24T17:16:45.685535] [INFO ] [REMOTE    ] ARES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:16:45.747600] [INFO ] [REMOTE    ] ARES: Fetching primary data for 2025-01.
[2025-10-24T17:16:46.547634] [INFO ] [REMOTE    ] ARDT: Fetching primary data for 2025-05.
[2025-10-24T17:16:46.925482] [INFO ] [REMOTE    ] ARE: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T17:16:47.013752] [INFO ] [REMOTE    ] ARES: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T17:16:47.347628] [INFO ] [REMOTE    ] ARES: Fetching primary data for 2025-02.
[2025-10-24T17:16:47.631116] [INFO ] [REMOTE    ] ARDT: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T17:16:48.147690] [INFO ] [REMOTE    ] ARDT: Fetching primary data for 2025-06.
[2025-10-24T17:16:48.717802] [INFO ] [REMOTE    ] ARES: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T17:16:48.947622] [INFO ] [REMOTE    ] ARES: Fetching primary data for 2025-03.
[2025-10-24T17:16:49.334413] [INFO ] [REMOTE    ] ARDT: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T17:16:49.747684] [INFO ] [REMOTE    ] ARDT: Fetching primary data for 2025-07.
[2025-10-24T17:16:50.337944] [INFO ] [REMOTE    ] ARES: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T17:16:50.547634] [INFO ] [REMOTE    ] ARES: Fetching primary data for 2025-04.
[2025-10-24T17:16:50.867704] [INFO ] [REMOTE    ] ARDT: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T17:16:51.347635] [INFO ] [REMOTE    ] AR: Fetching primary data for 2025-09.
[2025-10-24T17:16:52.147674] [INFO ] [REMOTE    ] ARE: Fetching primary data for 2025-04.
[2025-10-24T17:16:52.180442] [INFO ] [REMOTE    ] ARES: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T17:16:52.947609] [INFO ] [REMOTE    ] ARES: Fetching primary data for 2025-05.
[2025-10-24T17:16:53.231216] [INFO ] [REMOTE    ] AR: Incremental fetch complete for 2025-09 (1.88 seconds).
[2025-10-24T17:16:53.747672] [INFO ] [REMOTE    ] AR: Fetching primary data for 2025-10.
[2025-10-24T17:16:53.906391] [INFO ] [REMOTE    ] ARE: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T17:16:54.381477] [INFO ] [REMOTE    ] ARES: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T17:16:54.547682] [INFO ] [REMOTE    ] ARDT: Fetching primary data for 2025-08.
[2025-10-24T17:16:55.347692] [INFO ] [REMOTE    ] ARE: Fetching primary data for 2025-05.
[2025-10-24T17:16:55.427430] [INFO ] [REMOTE    ] AR: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T17:16:55.437038] [INFO ] [REMOTE    ] AR: Full fetch complete (77349 records).
[2025-10-24T17:16:55.437212] [DEBUG] [VALIDATOR ] AR: Validating primary data.
[2025-10-24T17:16:55.438127] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:16:55.438238] [FATAL] [MAIN      ] AR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:16:55.438281] [WARN ] [MAIN      ] AR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:16:55.438337] [INFO ] [LOCAL     ] AR: Starting deletion of primary data.
[2025-10-24T17:16:55.438395] [DEBUG] [LOCAL     ] AR: No primary data file found to delete.
[2025-10-24T17:16:55.438430] [INFO ] [LOCAL     ] AR: Starting deletion of derivative data.
[2025-10-24T17:16:55.438609] [DEBUG] [LOCAL     ] AR: Deleted derivative data file.
[2025-10-24T17:16:55.439041] [INFO ] [MAIN      ] Update Progress: 141/2366 symbols completed. AR took 47.9s. Estimated remaining: 4h 26m 18s. Rate: 8.4 symbols/min
[2025-10-24T17:16:55.614873] [INFO ] [MAIN      ] ARI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:16:55.656263] [DEBUG] [LOCAL     ] ARI: Loaded 43804 existing records from primary storage.
[2025-10-24T17:16:55.656536] [INFO ] [MAIN      ] ARI: Loaded 43804 existing records.
[2025-10-24T17:16:55.847856] [WARN ] [MAIN      ] ARI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:16:55.848189] [INFO ] [MAIN      ] ARI: Wiping existing primary data before full refresh.
[2025-10-24T17:16:55.848276] [INFO ] [LOCAL     ] ARI: Starting deletion of primary data.
[2025-10-24T17:16:55.854211] [DEBUG] [LOCAL     ] ARI: Deleted primary data file.
[2025-10-24T17:16:55.863486] [INFO ] [MAIN      ] ARI: Starting full primary refresh.
[2025-10-24T17:16:55.898708] [INFO ] [REMOTE    ] ARDT: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T17:16:56.156414] [INFO ] [REMOTE    ] ARDT: Fetching primary data for 2025-09.
[2025-10-24T17:16:56.276843] [INFO ] [REMOTE    ] ARI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:16:56.739778] [INFO ] [REMOTE    ] ARE: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T17:16:56.947618] [INFO ] [REMOTE    ] ARE: Fetching primary data for 2025-06.
[2025-10-24T17:16:57.230063] [INFO ] [REMOTE    ] ARDT: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T17:16:57.747671] [INFO ] [REMOTE    ] ARES: Fetching primary data for 2025-06.
[2025-10-24T17:16:58.547682] [INFO ] [REMOTE    ] ARI: Fetching primary data for 2025-01.
[2025-10-24T17:16:58.671625] [INFO ] [REMOTE    ] ARE: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T17:16:59.347675] [INFO ] [REMOTE    ] ARDT: Fetching primary data for 2025-10.
[2025-10-24T17:16:59.559991] [INFO ] [REMOTE    ] ARES: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T17:17:00.144101] [INFO ] [REMOTE    ] ARI: Incremental fetch complete for 2025-01 (1.60 seconds).
[2025-10-24T17:17:00.152251] [INFO ] [REMOTE    ] ARE: Fetching primary data for 2025-07.
[2025-10-24T17:17:00.361994] [INFO ] [REMOTE    ] ARDT: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T17:17:00.368855] [INFO ] [REMOTE    ] ARDT: Full fetch complete (41645 records).
[2025-10-24T17:17:00.368968] [DEBUG] [VALIDATOR ] ARDT: Validating primary data.
[2025-10-24T17:17:00.794600] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present.
[2025-10-24T17:17:00.794711] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed.
[2025-10-24T17:17:00.795271] [INFO ] [MAIN      ] ARDT: Fetched primary data is valid.
[2025-10-24T17:17:00.795335] [DEBUG] [LOCAL     ] ARDT: Saving primary data.
[2025-10-24T17:17:00.795819] [FATAL] [LOCAL     ] ARDT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:17:00.795911] [FATAL] [MAIN      ] ARDT: Failed to save primary data.
[2025-10-24T17:17:00.795974] [WARN ] [MAIN      ] ARDT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:17:00.796049] [INFO ] [LOCAL     ] ARDT: Starting deletion of primary data.
[2025-10-24T17:17:00.796110] [DEBUG] [LOCAL     ] ARDT: No primary data file found to delete.
[2025-10-24T17:17:00.796148] [INFO ] [LOCAL     ] ARDT: Starting deletion of derivative data.
[2025-10-24T17:17:00.796288] [DEBUG] [LOCAL     ] ARDT: Deleted derivative data file.
[2025-10-24T17:17:00.796377] [INFO ] [MAIN      ] Update Progress: 142/2366 symbols completed. ARDT took 26.6s. Estimated remaining: 4h 25m 42s. Rate: 8.4 symbols/min
[2025-10-24T17:17:00.956804] [INFO ] [REMOTE    ] ARI: Fetching primary data for 2025-02.
[2025-10-24T17:17:00.985193] [INFO ] [MAIN      ] ARLO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:17:01.029739] [DEBUG] [LOCAL     ] ARLO: Loaded 43851 existing records from primary storage.
[2025-10-24T17:17:01.030052] [INFO ] [MAIN      ] ARLO: Loaded 43851 existing records.
[2025-10-24T17:17:01.226778] [WARN ] [MAIN      ] ARLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:17:01.227002] [INFO ] [MAIN      ] ARLO: Wiping existing primary data before full refresh.
[2025-10-24T17:17:01.227049] [INFO ] [LOCAL     ] ARLO: Starting deletion of primary data.
[2025-10-24T17:17:01.227883] [DEBUG] [LOCAL     ] ARLO: Deleted primary data file.
[2025-10-24T17:17:01.227941] [INFO ] [MAIN      ] ARLO: Starting full primary refresh.
[2025-10-24T17:17:01.649236] [INFO ] [REMOTE    ] ARLO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:17:01.747694] [INFO ] [REMOTE    ] ARLO: Fetching primary data for 2025-01.
[2025-10-24T17:17:02.560289] [INFO ] [REMOTE    ] ARES: Fetching primary data for 2025-07.
[2025-10-24T17:17:02.592033] [INFO ] [REMOTE    ] ARE: Incremental fetch complete for 2025-07 (2.44 seconds).
[2025-10-24T17:17:03.012618] [INFO ] [REMOTE    ] ARI: Incremental fetch complete for 2025-02 (2.06 seconds).
[2025-10-24T17:17:03.347686] [INFO ] [REMOTE    ] ARI: Fetching primary data for 2025-03.
[2025-10-24T17:17:04.147704] [INFO ] [REMOTE    ] ARE: Fetching primary data for 2025-08.
[2025-10-24T17:17:04.606956] [INFO ] [REMOTE    ] ARES: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T17:17:04.902987] [INFO ] [REMOTE    ] ARLO: Incremental fetch complete for 2025-01 (3.16 seconds).
[2025-10-24T17:17:04.947603] [INFO ] [REMOTE    ] ARLO: Fetching primary data for 2025-02.
[2025-10-24T17:17:05.517738] [INFO ] [REMOTE    ] ARI: Incremental fetch complete for 2025-03 (2.17 seconds).
[2025-10-24T17:17:05.629340] [INFO ] [REMOTE    ] ARE: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T17:17:05.747623] [INFO ] [REMOTE    ] ARI: Fetching primary data for 2025-04.
[2025-10-24T17:17:06.412413] [INFO ] [REMOTE    ] ARLO: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T17:17:06.547630] [INFO ] [REMOTE    ] ARES: Fetching primary data for 2025-08.
[2025-10-24T17:17:07.283525] [INFO ] [REMOTE    ] ARI: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T17:17:07.347663] [INFO ] [REMOTE    ] ARLO: Fetching primary data for 2025-03.
[2025-10-24T17:17:08.147621] [INFO ] [REMOTE    ] ARE: Fetching primary data for 2025-09.
[2025-10-24T17:17:08.270253] [INFO ] [REMOTE    ] ARES: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T17:17:08.944006] [INFO ] [REMOTE    ] ARLO: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T17:17:08.953109] [INFO ] [REMOTE    ] ARI: Fetching primary data for 2025-05.
[2025-10-24T17:17:09.747634] [INFO ] [REMOTE    ] ARLO: Fetching primary data for 2025-04.
[2025-10-24T17:17:09.792162] [INFO ] [REMOTE    ] ARE: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T17:17:10.311411] [INFO ] [REMOTE    ] ARI: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T17:17:10.547635] [INFO ] [REMOTE    ] ARES: Fetching primary data for 2025-09.
[2025-10-24T17:17:10.692174] [INFO ] [REMOTE    ] ARLO: Incremental fetch complete for 2025-04 (0.94 seconds).
[2025-10-24T17:17:11.347687] [INFO ] [REMOTE    ] ARLO: Fetching primary data for 2025-05.
[2025-10-24T17:17:11.849291] [INFO ] [REMOTE    ] ARES: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T17:17:12.147669] [INFO ] [REMOTE    ] ARI: Fetching primary data for 2025-06.
[2025-10-24T17:17:12.360421] [INFO ] [REMOTE    ] ARLO: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T17:17:12.947712] [INFO ] [REMOTE    ] ARLO: Fetching primary data for 2025-06.
[2025-10-24T17:17:13.582769] [INFO ] [REMOTE    ] ARI: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T17:17:13.747677] [INFO ] [REMOTE    ] ARES: Fetching primary data for 2025-10.
[2025-10-24T17:17:14.090808] [INFO ] [REMOTE    ] ARLO: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T17:17:14.547692] [INFO ] [REMOTE    ] ARE: Fetching primary data for 2025-10.
[2025-10-24T17:17:15.334519] [INFO ] [REMOTE    ] ARES: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T17:17:15.346535] [INFO ] [REMOTE    ] ARES: Full fetch complete (71727 records).
[2025-10-24T17:17:15.346745] [DEBUG] [VALIDATOR ] ARES: Validating primary data.
[2025-10-24T17:17:15.352873] [INFO ] [REMOTE    ] ARLO: Fetching primary data for 2025-07.
[2025-10-24T17:17:15.897855] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present.
[2025-10-24T17:17:15.897982] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed.
[2025-10-24T17:17:15.899359] [INFO ] [MAIN      ] ARES: Fetched primary data is valid.
[2025-10-24T17:17:15.899495] [DEBUG] [LOCAL     ] ARES: Saving primary data.
[2025-10-24T17:17:15.900271] [FATAL] [LOCAL     ] ARES: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:17:15.900384] [FATAL] [MAIN      ] ARES: Failed to save primary data.
[2025-10-24T17:17:15.900470] [WARN ] [MAIN      ] ARES: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:17:15.900558] [INFO ] [LOCAL     ] ARES: Starting deletion of primary data.
[2025-10-24T17:17:15.900708] [DEBUG] [LOCAL     ] ARES: No primary data file found to delete.
[2025-10-24T17:17:15.900781] [INFO ] [LOCAL     ] ARES: Starting deletion of derivative data.
[2025-10-24T17:17:15.900996] [DEBUG] [LOCAL     ] ARES: Deleted derivative data file.
[2025-10-24T17:17:15.901307] [INFO ] [MAIN      ] Update Progress: 143/2366 symbols completed. ARES took 31.0s. Estimated remaining: 4h 27m 39s. Rate: 8.3 symbols/min
[2025-10-24T17:17:16.147986] [INFO ] [REMOTE    ] ARI: Fetching primary data for 2025-07.
[2025-10-24T17:17:16.147638] [INFO ] [MAIN      ] ARMK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:17:16.207368] [DEBUG] [LOCAL     ] ARMK: Loaded 50743 existing records from primary storage.
[2025-10-24T17:17:16.207868] [INFO ] [MAIN      ] ARMK: Loaded 50743 existing records.
[2025-10-24T17:17:16.394575] [WARN ] [MAIN      ] ARMK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:17:16.394889] [INFO ] [MAIN      ] ARMK: Wiping existing primary data before full refresh.
[2025-10-24T17:17:16.394947] [INFO ] [LOCAL     ] ARMK: Starting deletion of primary data.
[2025-10-24T17:17:16.395825] [DEBUG] [LOCAL     ] ARMK: Deleted primary data file.
[2025-10-24T17:17:16.395884] [INFO ] [MAIN      ] ARMK: Starting full primary refresh.
[2025-10-24T17:17:16.684759] [INFO ] [REMOTE    ] ARE: Incremental fetch complete for 2025-10 (2.14 seconds).
[2025-10-24T17:17:16.737462] [INFO ] [REMOTE    ] ARE: Full fetch complete (72663 records).
[2025-10-24T17:17:16.766248] [DEBUG] [VALIDATOR ] ARE: Validating primary data.
[2025-10-24T17:17:16.793473] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:17:16.797248] [INFO ] [REMOTE    ] ARMK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:17:16.797541] [FATAL] [MAIN      ] ARE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:17:16.797968] [WARN ] [MAIN      ] ARE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:17:16.798065] [INFO ] [LOCAL     ] ARE: Starting deletion of primary data.
[2025-10-24T17:17:16.798137] [DEBUG] [LOCAL     ] ARE: No primary data file found to delete.
[2025-10-24T17:17:16.798176] [INFO ] [LOCAL     ] ARE: Starting deletion of derivative data.
[2025-10-24T17:17:16.798331] [DEBUG] [LOCAL     ] ARE: Deleted derivative data file.
[2025-10-24T17:17:16.798913] [INFO ] [MAIN      ] Update Progress: 144/2366 symbols completed. ARE took 40.8s. Estimated remaining: 4h 25m 54s. Rate: 8.4 symbols/min
[2025-10-24T17:17:16.950243] [INFO ] [REMOTE    ] ARMK: Fetching primary data for 2025-01.
[2025-10-24T17:17:16.977789] [INFO ] [MAIN      ] AROC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:17:17.023731] [DEBUG] [LOCAL     ] AROC: Loaded 49443 existing records from primary storage.
[2025-10-24T17:17:17.024141] [INFO ] [MAIN      ] AROC: Loaded 49443 existing records.
[2025-10-24T17:17:17.211530] [WARN ] [MAIN      ] AROC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:17:17.212013] [INFO ] [MAIN      ] AROC: Wiping existing primary data before full refresh.
[2025-10-24T17:17:17.212247] [INFO ] [LOCAL     ] AROC: Starting deletion of primary data.
[2025-10-24T17:17:17.221946] [DEBUG] [LOCAL     ] AROC: Deleted primary data file.
[2025-10-24T17:17:17.236789] [INFO ] [MAIN      ] AROC: Starting full primary refresh.
[2025-10-24T17:17:17.297845] [INFO ] [REMOTE    ] ARLO: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T17:17:17.651909] [INFO ] [REMOTE    ] ARI: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T17:17:17.656227] [INFO ] [REMOTE    ] AROC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:17:17.747610] [INFO ] [REMOTE    ] AROC: Fetching primary data for 2025-01.
[2025-10-24T17:17:18.518205] [INFO ] [REMOTE    ] ARMK: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T17:17:18.547603] [INFO ] [REMOTE    ] ARMK: Fetching primary data for 2025-02.
[2025-10-24T17:17:19.048541] [INFO ] [REMOTE    ] AROC: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T17:17:19.347636] [INFO ] [REMOTE    ] ARI: Fetching primary data for 2025-08.
[2025-10-24T17:17:20.054612] [INFO ] [REMOTE    ] ARMK: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T17:17:20.147639] [INFO ] [REMOTE    ] ARLO: Fetching primary data for 2025-08.
[2025-10-24T17:17:20.596803] [INFO ] [REMOTE    ] ARI: Incremental fetch complete for 2025-08 (1.25 seconds).
[2025-10-24T17:17:20.947688] [INFO ] [REMOTE    ] AROC: Fetching primary data for 2025-02.
[2025-10-24T17:17:21.305322] [INFO ] [REMOTE    ] ARLO: Incremental fetch complete for 2025-08 (1.16 seconds).
[2025-10-24T17:17:21.747713] [INFO ] [REMOTE    ] ARMK: Fetching primary data for 2025-03.
[2025-10-24T17:17:21.996892] [INFO ] [REMOTE    ] AROC: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T17:17:22.547667] [INFO ] [REMOTE    ] ARLO: Fetching primary data for 2025-09.
[2025-10-24T17:17:22.816209] [INFO ] [REMOTE    ] ARMK: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T17:17:23.347720] [INFO ] [REMOTE    ] ARI: Fetching primary data for 2025-09.
[2025-10-24T17:17:23.945150] [INFO ] [REMOTE    ] ARLO: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T17:17:24.147695] [INFO ] [REMOTE    ] ARMK: Fetching primary data for 2025-04.
[2025-10-24T17:17:24.908981] [INFO ] [REMOTE    ] ARI: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T17:17:24.947674] [INFO ] [REMOTE    ] ARLO: Fetching primary data for 2025-10.
[2025-10-24T17:17:25.697317] [INFO ] [REMOTE    ] ARMK: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T17:17:25.747622] [INFO ] [REMOTE    ] ARMK: Fetching primary data for 2025-05.
[2025-10-24T17:17:26.238838] [INFO ] [REMOTE    ] ARLO: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T17:17:26.246522] [INFO ] [REMOTE    ] ARLO: Full fetch complete (62837 records).
[2025-10-24T17:17:26.246692] [DEBUG] [VALIDATOR ] ARLO: Validating primary data.
[2025-10-24T17:17:26.247498] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:17:26.247589] [FATAL] [MAIN      ] ARLO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:17:26.247633] [WARN ] [MAIN      ] ARLO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:17:26.247728] [INFO ] [LOCAL     ] ARLO: Starting deletion of primary data.
[2025-10-24T17:17:26.247794] [DEBUG] [LOCAL     ] ARLO: No primary data file found to delete.
[2025-10-24T17:17:26.247831] [INFO ] [LOCAL     ] ARLO: Starting deletion of derivative data.
[2025-10-24T17:17:26.248047] [DEBUG] [LOCAL     ] ARLO: Deleted derivative data file.
[2025-10-24T17:17:26.248427] [INFO ] [MAIN      ] Update Progress: 145/2366 symbols completed. ARLO took 25.5s. Estimated remaining: 4h 26m 21s. Rate: 8.3 symbols/min
[2025-10-24T17:17:26.419597] [INFO ] [MAIN      ] ARR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:17:26.472527] [DEBUG] [LOCAL     ] ARR: Loaded 52475 existing records from primary storage.
[2025-10-24T17:17:26.472888] [INFO ] [MAIN      ] ARR: Loaded 52475 existing records.
[2025-10-24T17:17:26.552717] [INFO ] [REMOTE    ] ARI: Fetching primary data for 2025-10.
[2025-10-24T17:17:26.679080] [WARN ] [MAIN      ] ARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:17:26.679382] [INFO ] [MAIN      ] ARR: Wiping existing primary data before full refresh.
[2025-10-24T17:17:26.679454] [INFO ] [LOCAL     ] ARR: Starting deletion of primary data.
[2025-10-24T17:17:26.680876] [DEBUG] [LOCAL     ] ARR: Deleted primary data file.
[2025-10-24T17:17:26.680953] [INFO ] [MAIN      ] ARR: Starting full primary refresh.
[2025-10-24T17:17:27.043132] [INFO ] [REMOTE    ] ARR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:17:27.356185] [INFO ] [REMOTE    ] AROC: Fetching primary data for 2025-03.
[2025-10-24T17:17:27.374789] [INFO ] [REMOTE    ] ARMK: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T17:17:27.814610] [INFO ] [REMOTE    ] ARI: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T17:17:27.821877] [INFO ] [REMOTE    ] ARI: Full fetch complete (61936 records).
[2025-10-24T17:17:27.821986] [DEBUG] [VALIDATOR ] ARI: Validating primary data.
[2025-10-24T17:17:27.822933] [FATAL] [VALIDATOR ] ARI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:17:27.823017] [FATAL] [MAIN      ] ARI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:17:27.823059] [WARN ] [MAIN      ] ARI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:17:27.823097] [INFO ] [LOCAL     ] ARI: Starting deletion of primary data.
[2025-10-24T17:17:27.823151] [DEBUG] [LOCAL     ] ARI: No primary data file found to delete.
[2025-10-24T17:17:27.823184] [INFO ] [LOCAL     ] ARI: Starting deletion of derivative data.
[2025-10-24T17:17:27.823339] [DEBUG] [LOCAL     ] ARI: Deleted derivative data file.
[2025-10-24T17:17:27.823941] [INFO ] [MAIN      ] Update Progress: 146/2366 symbols completed. ARI took 32.4s. Estimated remaining: 4h 24m 49s. Rate: 8.4 symbols/min
[2025-10-24T17:17:27.989287] [INFO ] [MAIN      ] ARW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:17:28.023915] [DEBUG] [LOCAL     ] ARW: Loaded 33415 existing records from primary storage.
[2025-10-24T17:17:28.024171] [INFO ] [MAIN      ] ARW: Loaded 33415 existing records.
[2025-10-24T17:17:28.161744] [INFO ] [REMOTE    ] ARMK: Fetching primary data for 2025-06.
[2025-10-24T17:17:28.200175] [WARN ] [MAIN      ] ARW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:17:28.200384] [INFO ] [MAIN      ] ARW: Wiping existing primary data before full refresh.
[2025-10-24T17:17:28.200431] [INFO ] [LOCAL     ] ARW: Starting deletion of primary data.
[2025-10-24T17:17:28.201268] [DEBUG] [LOCAL     ] ARW: Deleted primary data file.
[2025-10-24T17:17:28.201328] [INFO ] [MAIN      ] ARW: Starting full primary refresh.
[2025-10-24T17:17:28.548990] [INFO ] [REMOTE    ] ARW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:17:28.947625] [INFO ] [REMOTE    ] ARR: Fetching primary data for 2025-01.
[2025-10-24T17:17:29.151894] [INFO ] [REMOTE    ] AROC: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T17:17:29.487618] [INFO ] [REMOTE    ] ARMK: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T17:17:29.747697] [INFO ] [REMOTE    ] ARW: Fetching primary data for 2025-01.
[2025-10-24T17:17:30.393900] [INFO ] [REMOTE    ] ARR: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T17:17:30.547720] [INFO ] [REMOTE    ] ARMK: Fetching primary data for 2025-07.
[2025-10-24T17:17:31.127993] [INFO ] [REMOTE    ] ARW: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T17:17:31.347675] [INFO ] [REMOTE    ] ARW: Fetching primary data for 2025-02.
[2025-10-24T17:17:31.860455] [INFO ] [REMOTE    ] ARMK: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T17:17:32.147684] [INFO ] [REMOTE    ] ARR: Fetching primary data for 2025-02.
[2025-10-24T17:17:32.748251] [INFO ] [REMOTE    ] ARW: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T17:17:32.947683] [INFO ] [REMOTE    ] ARW: Fetching primary data for 2025-03.
[2025-10-24T17:17:33.724150] [INFO ] [REMOTE    ] ARR: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T17:17:33.747632] [INFO ] [REMOTE    ] ARMK: Fetching primary data for 2025-08.
[2025-10-24T17:17:34.489930] [INFO ] [REMOTE    ] ARW: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T17:17:34.547687] [INFO ] [REMOTE    ] ARW: Fetching primary data for 2025-04.
[2025-10-24T17:17:35.202016] [INFO ] [REMOTE    ] ARMK: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T17:17:35.347634] [INFO ] [REMOTE    ] ARMK: Fetching primary data for 2025-09.
[2025-10-24T17:17:35.996424] [INFO ] [REMOTE    ] ARW: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T17:17:36.147734] [INFO ] [REMOTE    ] ARR: Fetching primary data for 2025-03.
[2025-10-24T17:17:36.705308] [INFO ] [REMOTE    ] ARMK: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T17:17:36.947672] [INFO ] [REMOTE    ] ARW: Fetching primary data for 2025-05.
[2025-10-24T17:17:37.747717] [INFO ] [REMOTE    ] AROC: Fetching primary data for 2025-04.
[2025-10-24T17:17:38.130280] [INFO ] [REMOTE    ] ARR: Incremental fetch complete for 2025-03 (1.98 seconds).
[2025-10-24T17:17:38.197706] [INFO ] [REMOTE    ] ARW: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T17:17:38.547745] [INFO ] [REMOTE    ] ARW: Fetching primary data for 2025-06.
[2025-10-24T17:17:39.347673] [INFO ] [REMOTE    ] ARMK: Fetching primary data for 2025-10.
[2025-10-24T17:17:39.421298] [INFO ] [REMOTE    ] AROC: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T17:17:39.712024] [INFO ] [REMOTE    ] ARW: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T17:17:40.147720] [INFO ] [REMOTE    ] AROC: Fetching primary data for 2025-05.
[2025-10-24T17:17:40.947737] [INFO ] [REMOTE    ] ARW: Fetching primary data for 2025-07.
[2025-10-24T17:17:41.216706] [INFO ] [REMOTE    ] ARMK: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T17:17:41.226523] [INFO ] [REMOTE    ] ARMK: Full fetch complete (73003 records).
[2025-10-24T17:17:41.226693] [DEBUG] [VALIDATOR ] ARMK: Validating primary data.
[2025-10-24T17:17:41.622921] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present.
[2025-10-24T17:17:41.623008] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed.
[2025-10-24T17:17:41.623796] [INFO ] [MAIN      ] ARMK: Fetched primary data is valid.
[2025-10-24T17:17:41.623866] [DEBUG] [LOCAL     ] ARMK: Saving primary data.
[2025-10-24T17:17:41.624490] [FATAL] [LOCAL     ] ARMK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:17:41.624586] [FATAL] [MAIN      ] ARMK: Failed to save primary data.
[2025-10-24T17:17:41.624628] [WARN ] [MAIN      ] ARMK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:17:41.624715] [INFO ] [LOCAL     ] ARMK: Starting deletion of primary data.
[2025-10-24T17:17:41.624778] [DEBUG] [LOCAL     ] ARMK: No primary data file found to delete.
[2025-10-24T17:17:41.624813] [INFO ] [LOCAL     ] ARMK: Starting deletion of derivative data.
[2025-10-24T17:17:41.624975] [DEBUG] [LOCAL     ] ARMK: Deleted derivative data file.
[2025-10-24T17:17:41.625454] [INFO ] [MAIN      ] Update Progress: 147/2366 symbols completed. ARMK took 25.7s. Estimated remaining: 4h 26m 22s. Rate: 8.3 symbols/min
[2025-10-24T17:17:41.749639] [INFO ] [REMOTE    ] ARR: Fetching primary data for 2025-04.
[2025-10-24T17:17:41.805519] [INFO ] [MAIN      ] ARX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:17:41.805876] [DEBUG] [LOCAL     ] ARX: No existing data file found in primary storage.
[2025-10-24T17:17:41.805939] [WARN ] [MAIN      ] ARX: No existing data found, performing full refresh instead.
[2025-10-24T17:17:41.806268] [INFO ] [MAIN      ] ARX: Wiping existing primary data before full refresh.
[2025-10-24T17:17:41.806328] [INFO ] [LOCAL     ] ARX: Starting deletion of primary data.
[2025-10-24T17:17:41.806390] [DEBUG] [LOCAL     ] ARX: No primary data file found to delete.
[2025-10-24T17:17:41.806438] [INFO ] [MAIN      ] ARX: Starting full primary refresh.
[2025-10-24T17:17:42.176461] [INFO ] [REMOTE    ] ARW: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T17:17:42.209756] [INFO ] [REMOTE    ] ARX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:17:42.254531] [INFO ] [REMOTE    ] AROC: Incremental fetch complete for 2025-05 (2.11 seconds).
[2025-10-24T17:17:42.547738] [INFO ] [REMOTE    ] ARW: Fetching primary data for 2025-08.
[2025-10-24T17:17:43.347734] [INFO ] [REMOTE    ] ARX: Fetching primary data for 2025-01.
[2025-10-24T17:17:43.580950] [DEBUG] [REMOTE    ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:17:43.581247] [WARN ] [REMOTE    ] ARX: No data returned for month 2025-01
[2025-10-24T17:17:43.581333] [FATAL] [REMOTE    ] ARX: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:17:43.581383] [FATAL] [MAIN      ] ARX: Failed to fetch primary data.
[2025-10-24T17:17:43.581416] [WARN ] [MAIN      ] ARX: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:17:43.581451] [INFO ] [LOCAL     ] ARX: Starting deletion of primary data.
[2025-10-24T17:17:43.581555] [DEBUG] [LOCAL     ] ARX: No primary data file found to delete.
[2025-10-24T17:17:43.581598] [INFO ] [LOCAL     ] ARX: Starting deletion of derivative data.
[2025-10-24T17:17:43.581638] [DEBUG] [LOCAL     ] ARX: No derivative data file found to delete.
[2025-10-24T17:17:43.581729] [INFO ] [MAIN      ] Update Progress: 148/2366 symbols completed. ARX took 2.0s. Estimated remaining: 4h 24m 56s. Rate: 8.4 symbols/min
[2025-10-24T17:17:43.758119] [INFO ] [MAIN      ] AS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:17:43.791599] [INFO ] [REMOTE    ] ARR: Incremental fetch complete for 2025-04 (2.04 seconds).
[2025-10-24T17:17:43.845504] [INFO ] [REMOTE    ] ARW: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T17:17:43.873996] [DEBUG] [LOCAL     ] AS: Loaded 53587 existing records from primary storage.
[2025-10-24T17:17:43.874434] [INFO ] [MAIN      ] AS: Loaded 53587 existing records.
[2025-10-24T17:17:44.055559] [WARN ] [MAIN      ] AS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:17:44.055805] [INFO ] [MAIN      ] AS: Wiping existing primary data before full refresh.
[2025-10-24T17:17:44.055856] [INFO ] [LOCAL     ] AS: Starting deletion of primary data.
[2025-10-24T17:17:44.056314] [DEBUG] [LOCAL     ] AS: Deleted primary data file.
[2025-10-24T17:17:44.056354] [INFO ] [MAIN      ] AS: Starting full primary refresh.
[2025-10-24T17:17:44.153393] [INFO ] [REMOTE    ] AROC: Fetching primary data for 2025-06.
[2025-10-24T17:17:44.417523] [INFO ] [REMOTE    ] AS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:17:44.947767] [INFO ] [REMOTE    ] ARW: Fetching primary data for 2025-09.
[2025-10-24T17:17:45.621143] [INFO ] [REMOTE    ] AROC: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T17:17:45.747702] [INFO ] [REMOTE    ] AS: Fetching primary data for 2025-01.
[2025-10-24T17:17:46.304314] [INFO ] [REMOTE    ] ARW: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T17:17:46.547757] [INFO ] [REMOTE    ] ARW: Fetching primary data for 2025-10.
[2025-10-24T17:17:47.313189] [INFO ] [REMOTE    ] AS: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T17:17:47.347600] [INFO ] [REMOTE    ] AS: Fetching primary data for 2025-02.
[2025-10-24T17:17:47.784941] [INFO ] [REMOTE    ] ARW: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T17:17:47.794771] [INFO ] [REMOTE    ] ARW: Full fetch complete (48628 records).
[2025-10-24T17:17:47.794928] [DEBUG] [VALIDATOR ] ARW: Validating primary data.
[2025-10-24T17:17:48.152743] [INFO ] [REMOTE    ] AROC: Fetching primary data for 2025-07.
[2025-10-24T17:17:48.195634] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present.
[2025-10-24T17:17:48.195809] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed.
[2025-10-24T17:17:48.196395] [INFO ] [MAIN      ] ARW: Fetched primary data is valid.
[2025-10-24T17:17:48.196438] [DEBUG] [LOCAL     ] ARW: Saving primary data.
[2025-10-24T17:17:48.196887] [FATAL] [LOCAL     ] ARW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:17:48.196971] [FATAL] [MAIN      ] ARW: Failed to save primary data.
[2025-10-24T17:17:48.197037] [WARN ] [MAIN      ] ARW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:17:48.197106] [INFO ] [LOCAL     ] ARW: Starting deletion of primary data.
[2025-10-24T17:17:48.197236] [DEBUG] [LOCAL     ] ARW: No primary data file found to delete.
[2025-10-24T17:17:48.197291] [INFO ] [LOCAL     ] ARW: Starting deletion of derivative data.
[2025-10-24T17:17:48.197484] [DEBUG] [LOCAL     ] ARW: Deleted derivative data file.
[2025-10-24T17:17:48.197582] [INFO ] [MAIN      ] Update Progress: 149/2366 symbols completed. ARW took 20.4s. Estimated remaining: 4h 24m 11s. Rate: 8.4 symbols/min
[2025-10-24T17:17:48.403318] [INFO ] [MAIN      ] ASA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:17:48.420632] [DEBUG] [LOCAL     ] ASA: Loaded 15779 existing records from primary storage.
[2025-10-24T17:17:48.420900] [INFO ] [MAIN      ] ASA: Loaded 15779 existing records.
[2025-10-24T17:17:48.617753] [WARN ] [MAIN      ] ASA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:17:48.618029] [INFO ] [MAIN      ] ASA: Wiping existing primary data before full refresh.
[2025-10-24T17:17:48.618081] [INFO ] [LOCAL     ] ASA: Starting deletion of primary data.
[2025-10-24T17:17:48.618387] [DEBUG] [LOCAL     ] ASA: Deleted primary data file.
[2025-10-24T17:17:48.618457] [INFO ] [MAIN      ] ASA: Starting full primary refresh.
[2025-10-24T17:17:48.952533] [INFO ] [REMOTE    ] ARR: Fetching primary data for 2025-05.
[2025-10-24T17:17:49.003189] [INFO ] [REMOTE    ] ASA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:17:49.022354] [INFO ] [REMOTE    ] AS: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T17:17:49.640202] [INFO ] [REMOTE    ] AROC: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T17:17:49.747703] [INFO ] [REMOTE    ] ASA: Fetching primary data for 2025-01.
[2025-10-24T17:17:50.547619] [INFO ] [REMOTE    ] AROC: Fetching primary data for 2025-08.
[2025-10-24T17:17:50.582134] [INFO ] [REMOTE    ] ARR: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T17:17:50.630525] [INFO ] [REMOTE    ] ASA: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T17:17:51.347672] [INFO ] [REMOTE    ] ASA: Fetching primary data for 2025-02.
[2025-10-24T17:17:51.914869] [INFO ] [REMOTE    ] AROC: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T17:17:52.062328] [INFO ] [REMOTE    ] ASA: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T17:17:52.147668] [INFO ] [REMOTE    ] ASA: Fetching primary data for 2025-03.
[2025-10-24T17:17:52.661926] [INFO ] [REMOTE    ] ASA: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T17:17:52.947718] [INFO ] [REMOTE    ] ASA: Fetching primary data for 2025-04.
[2025-10-24T17:17:53.747630] [INFO ] [REMOTE    ] AS: Fetching primary data for 2025-03.
[2025-10-24T17:17:53.784190] [INFO ] [REMOTE    ] ASA: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T17:17:54.547686] [INFO ] [REMOTE    ] ARR: Fetching primary data for 2025-06.
[2025-10-24T17:17:55.142566] [INFO ] [REMOTE    ] AS: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T17:17:55.347690] [INFO ] [REMOTE    ] ASA: Fetching primary data for 2025-05.
[2025-10-24T17:17:56.147729] [INFO ] [REMOTE    ] AS: Fetching primary data for 2025-04.
[2025-10-24T17:17:56.236167] [INFO ] [REMOTE    ] ASA: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T17:17:56.947620] [INFO ] [REMOTE    ] ASA: Fetching primary data for 2025-06.
[2025-10-24T17:17:57.055875] [INFO ] [REMOTE    ] ARR: Incremental fetch complete for 2025-06 (2.51 seconds).
[2025-10-24T17:17:57.590763] [INFO ] [REMOTE    ] ASA: Incremental fetch complete for 2025-06 (0.64 seconds).
[2025-10-24T17:17:57.758670] [INFO ] [REMOTE    ] AROC: Fetching primary data for 2025-09.
[2025-10-24T17:17:57.763874] [INFO ] [REMOTE    ] AS: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T17:17:58.547669] [INFO ] [REMOTE    ] ARR: Fetching primary data for 2025-07.
[2025-10-24T17:17:59.347634] [INFO ] [REMOTE    ] AROC: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T17:17:59.347724] [INFO ] [REMOTE    ] AS: Fetching primary data for 2025-05.
[2025-10-24T17:18:00.147717] [INFO ] [REMOTE    ] AROC: Fetching primary data for 2025-10.
[2025-10-24T17:18:00.862012] [INFO ] [REMOTE    ] ARR: Incremental fetch complete for 2025-07 (2.31 seconds).
[2025-10-24T17:18:00.947615] [INFO ] [REMOTE    ] ARR: Fetching primary data for 2025-08.
[2025-10-24T17:18:01.747736] [INFO ] [REMOTE    ] ASA: Fetching primary data for 2025-07.
[2025-10-24T17:18:01.793245] [INFO ] [REMOTE    ] AS: Incremental fetch complete for 2025-05 (2.45 seconds).
[2025-10-24T17:18:02.333670] [INFO ] [REMOTE    ] AROC: Incremental fetch complete for 2025-10 (2.19 seconds).
[2025-10-24T17:18:02.343158] [INFO ] [REMOTE    ] AROC: Full fetch complete (71408 records).
[2025-10-24T17:18:02.343305] [DEBUG] [VALIDATOR ] AROC: Validating primary data.
[2025-10-24T17:18:02.558671] [INFO ] [REMOTE    ] AS: Fetching primary data for 2025-06.
[2025-10-24T17:18:02.773294] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present.
[2025-10-24T17:18:02.773385] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed.
[2025-10-24T17:18:02.774191] [INFO ] [MAIN      ] AROC: Fetched primary data is valid.
[2025-10-24T17:18:02.774258] [DEBUG] [LOCAL     ] AROC: Saving primary data.
[2025-10-24T17:18:02.774900] [FATAL] [LOCAL     ] AROC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:18:02.774997] [FATAL] [MAIN      ] AROC: Failed to save primary data.
[2025-10-24T17:18:02.775039] [WARN ] [MAIN      ] AROC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:18:02.775073] [INFO ] [LOCAL     ] AROC: Starting deletion of primary data.
[2025-10-24T17:18:02.775126] [DEBUG] [LOCAL     ] AROC: No primary data file found to delete.
[2025-10-24T17:18:02.775161] [INFO ] [LOCAL     ] AROC: Starting deletion of derivative data.
[2025-10-24T17:18:02.775310] [DEBUG] [LOCAL     ] AROC: Deleted derivative data file.
[2025-10-24T17:18:02.775723] [INFO ] [MAIN      ] Update Progress: 150/2366 symbols completed. AROC took 46.0s. Estimated remaining: 4h 25m 53s. Rate: 8.3 symbols/min
[2025-10-24T17:18:02.954074] [INFO ] [MAIN      ] ASAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:18:03.007403] [DEBUG] [LOCAL     ] ASAN: Loaded 53116 existing records from primary storage.
[2025-10-24T17:18:03.007805] [INFO ] [MAIN      ] ASAN: Loaded 53116 existing records.
[2025-10-24T17:18:03.188033] [WARN ] [MAIN      ] ASAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:18:03.188232] [INFO ] [MAIN      ] ASAN: Wiping existing primary data before full refresh.
[2025-10-24T17:18:03.188278] [INFO ] [LOCAL     ] ASAN: Starting deletion of primary data.
[2025-10-24T17:18:03.188828] [DEBUG] [LOCAL     ] ASAN: Deleted primary data file.
[2025-10-24T17:18:03.188886] [INFO ] [MAIN      ] ASAN: Starting full primary refresh.
[2025-10-24T17:18:03.554872] [INFO ] [REMOTE    ] ASAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:18:03.555192] [INFO ] [REMOTE    ] ASAN: Fetching primary data for 2025-01.
[2025-10-24T17:18:03.810350] [INFO ] [REMOTE    ] ASA: Incremental fetch complete for 2025-07 (2.06 seconds).
[2025-10-24T17:18:04.147700] [INFO ] [REMOTE    ] ASA: Fetching primary data for 2025-08.
[2025-10-24T17:18:04.432842] [INFO ] [REMOTE    ] AS: Incremental fetch complete for 2025-06 (1.87 seconds).
[2025-10-24T17:18:04.687793] [INFO ] [REMOTE    ] ARR: Incremental fetch complete for 2025-08 (3.74 seconds).
[2025-10-24T17:18:04.938624] [INFO ] [REMOTE    ] ASA: Incremental fetch complete for 2025-08 (0.79 seconds).
[2025-10-24T17:18:04.947596] [INFO ] [REMOTE    ] ASA: Fetching primary data for 2025-09.
[2025-10-24T17:18:05.555084] [INFO ] [REMOTE    ] ASAN: Incremental fetch complete for 2025-01 (2.00 seconds).
[2025-10-24T17:18:05.747726] [INFO ] [REMOTE    ] ASAN: Fetching primary data for 2025-02.
[2025-10-24T17:18:06.257198] [INFO ] [REMOTE    ] ASA: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T17:18:06.547751] [INFO ] [REMOTE    ] ASA: Fetching primary data for 2025-10.
[2025-10-24T17:18:07.347706] [INFO ] [REMOTE    ] AS: Fetching primary data for 2025-07.
[2025-10-24T17:18:07.664228] [INFO ] [REMOTE    ] ASAN: Incremental fetch complete for 2025-02 (1.92 seconds).
[2025-10-24T17:18:07.934818] [INFO ] [REMOTE    ] ASA: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T17:18:07.940758] [INFO ] [REMOTE    ] ASA: Full fetch complete (20849 records).
[2025-10-24T17:18:07.940989] [DEBUG] [VALIDATOR ] ASA: Validating primary data.
[2025-10-24T17:18:08.152894] [INFO ] [REMOTE    ] ASAN: Fetching primary data for 2025-03.
[2025-10-24T17:18:08.513115] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present.
[2025-10-24T17:18:08.513418] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed.
[2025-10-24T17:18:08.514480] [INFO ] [MAIN      ] ASA: Fetched primary data is valid.
[2025-10-24T17:18:08.514565] [DEBUG] [LOCAL     ] ASA: Saving primary data.
[2025-10-24T17:18:08.515314] [FATAL] [LOCAL     ] ASA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:18:08.515435] [FATAL] [MAIN      ] ASA: Failed to save primary data.
[2025-10-24T17:18:08.515495] [WARN ] [MAIN      ] ASA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:18:08.515552] [INFO ] [LOCAL     ] ASA: Starting deletion of primary data.
[2025-10-24T17:18:08.515673] [DEBUG] [LOCAL     ] ASA: No primary data file found to delete.
[2025-10-24T17:18:08.515754] [INFO ] [LOCAL     ] ASA: Starting deletion of derivative data.
[2025-10-24T17:18:08.515998] [DEBUG] [LOCAL     ] ASA: Deleted derivative data file.
[2025-10-24T17:18:08.516134] [INFO ] [MAIN      ] Update Progress: 151/2366 symbols completed. ASA took 20.3s. Estimated remaining: 4h 25m 25s. Rate: 8.3 symbols/min
[2025-10-24T17:18:08.735388] [INFO ] [MAIN      ] ASB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:18:08.792203] [DEBUG] [LOCAL     ] ASB: Loaded 50074 existing records from primary storage.
[2025-10-24T17:18:08.792862] [INFO ] [MAIN      ] ASB: Loaded 50074 existing records.
[2025-10-24T17:18:08.952802] [INFO ] [REMOTE    ] ARR: Fetching primary data for 2025-09.
[2025-10-24T17:18:09.023015] [WARN ] [MAIN      ] ASB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:18:09.023843] [INFO ] [MAIN      ] ASB: Wiping existing primary data before full refresh.
[2025-10-24T17:18:09.023934] [INFO ] [LOCAL     ] ASB: Starting deletion of primary data.
[2025-10-24T17:18:09.025037] [DEBUG] [LOCAL     ] ASB: Deleted primary data file.
[2025-10-24T17:18:09.025105] [INFO ] [MAIN      ] ASB: Starting full primary refresh.
[2025-10-24T17:18:09.444547] [INFO ] [REMOTE    ] ASB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:18:09.461249] [INFO ] [REMOTE    ] AS: Incremental fetch complete for 2025-07 (2.11 seconds).
[2025-10-24T17:18:09.747747] [INFO ] [REMOTE    ] ASB: Fetching primary data for 2025-01.
[2025-10-24T17:18:09.962303] [INFO ] [REMOTE    ] ASAN: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T17:18:10.547738] [INFO ] [REMOTE    ] AS: Fetching primary data for 2025-08.
[2025-10-24T17:18:10.711010] [INFO ] [REMOTE    ] ARR: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T17:18:11.347758] [INFO ] [REMOTE    ] ASAN: Fetching primary data for 2025-04.
[2025-10-24T17:18:11.406456] [INFO ] [REMOTE    ] ASB: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T17:18:12.055326] [INFO ] [REMOTE    ] AS: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T17:18:12.147722] [INFO ] [REMOTE    ] AS: Fetching primary data for 2025-09.
[2025-10-24T17:18:12.947636] [INFO ] [REMOTE    ] ASB: Fetching primary data for 2025-02.
[2025-10-24T17:18:13.450693] [INFO ] [REMOTE    ] ASAN: Incremental fetch complete for 2025-04 (2.10 seconds).
[2025-10-24T17:18:13.747636] [INFO ] [REMOTE    ] ASAN: Fetching primary data for 2025-05.
[2025-10-24T17:18:14.061038] [INFO ] [REMOTE    ] AS: Incremental fetch complete for 2025-09 (1.91 seconds).
[2025-10-24T17:18:14.547695] [INFO ] [REMOTE    ] AS: Fetching primary data for 2025-10.
[2025-10-24T17:18:15.347717] [INFO ] [REMOTE    ] ARR: Fetching primary data for 2025-10.
[2025-10-24T17:18:15.420873] [INFO ] [REMOTE    ] ASB: Incremental fetch complete for 2025-02 (2.47 seconds).
[2025-10-24T17:18:15.917956] [INFO ] [REMOTE    ] ASAN: Incremental fetch complete for 2025-05 (2.17 seconds).
[2025-10-24T17:18:16.147675] [INFO ] [REMOTE    ] ASB: Fetching primary data for 2025-03.
[2025-10-24T17:18:16.947728] [INFO ] [REMOTE    ] ASAN: Fetching primary data for 2025-06.
[2025-10-24T17:18:17.429748] [INFO ] [REMOTE    ] ARR: Incremental fetch complete for 2025-10 (2.08 seconds).
[2025-10-24T17:18:17.439373] [INFO ] [REMOTE    ] ARR: Full fetch complete (75136 records).
[2025-10-24T17:18:17.439535] [DEBUG] [VALIDATOR ] ARR: Validating primary data.
[2025-10-24T17:18:17.441509] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:18:17.441603] [FATAL] [MAIN      ] ARR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:18:17.441673] [WARN ] [MAIN      ] ARR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:18:17.441734] [INFO ] [LOCAL     ] ARR: Starting deletion of primary data.
[2025-10-24T17:18:17.441791] [DEBUG] [LOCAL     ] ARR: No primary data file found to delete.
[2025-10-24T17:18:17.441834] [INFO ] [LOCAL     ] ARR: Starting deletion of derivative data.
[2025-10-24T17:18:17.442026] [DEBUG] [LOCAL     ] ARR: Deleted derivative data file.
[2025-10-24T17:18:17.442446] [INFO ] [MAIN      ] Update Progress: 152/2366 symbols completed. ARR took 51.2s. Estimated remaining: 4h 25m 43s. Rate: 8.3 symbols/min
[2025-10-24T17:18:17.648495] [INFO ] [MAIN      ] ASBA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:18:17.653213] [INFO ] [REMOTE    ] ASB: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T17:18:17.670308] [DEBUG] [LOCAL     ] ASBA: Loaded 3490 existing records from primary storage.
[2025-10-24T17:18:17.670524] [INFO ] [MAIN      ] ASBA: Loaded 3490 existing records.
[2025-10-24T17:18:17.765632] [INFO ] [REMOTE    ] ASB: Fetching primary data for 2025-04.
[2025-10-24T17:18:17.851614] [WARN ] [MAIN      ] ASBA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:18:17.851878] [INFO ] [MAIN      ] ASBA: Wiping existing primary data before full refresh.
[2025-10-24T17:18:17.851938] [INFO ] [LOCAL     ] ASBA: Starting deletion of primary data.
[2025-10-24T17:18:17.852082] [DEBUG] [LOCAL     ] ASBA: Deleted primary data file.
[2025-10-24T17:18:17.852137] [INFO ] [MAIN      ] ASBA: Starting full primary refresh.
[2025-10-24T17:18:18.238059] [INFO ] [REMOTE    ] AS: Incremental fetch complete for 2025-10 (3.69 seconds).
[2025-10-24T17:18:18.242699] [INFO ] [REMOTE    ] ASBA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:18:18.252390] [INFO ] [REMOTE    ] AS: Full fetch complete (76537 records).
[2025-10-24T17:18:18.252515] [DEBUG] [VALIDATOR ] AS: Validating primary data.
[2025-10-24T17:18:18.254986] [FATAL] [VALIDATOR ] AS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:18:18.255076] [FATAL] [MAIN      ] AS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:18:18.255119] [WARN ] [MAIN      ] AS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:18:18.255160] [INFO ] [LOCAL     ] AS: Starting deletion of primary data.
[2025-10-24T17:18:18.255216] [DEBUG] [LOCAL     ] AS: No primary data file found to delete.
[2025-10-24T17:18:18.255250] [INFO ] [LOCAL     ] AS: Starting deletion of derivative data.
[2025-10-24T17:18:18.255388] [DEBUG] [LOCAL     ] AS: Deleted derivative data file.
[2025-10-24T17:18:18.255849] [INFO ] [MAIN      ] Update Progress: 153/2366 symbols completed. AS took 34.7s. Estimated remaining: 4h 24m 3s. Rate: 8.4 symbols/min
[2025-10-24T17:18:18.425540] [INFO ] [MAIN      ] ASC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:18:18.469512] [DEBUG] [LOCAL     ] ASC: Loaded 37473 existing records from primary storage.
[2025-10-24T17:18:18.469826] [INFO ] [MAIN      ] ASC: Loaded 37473 existing records.
[2025-10-24T17:18:18.549258] [INFO ] [REMOTE    ] ASBA: Fetching primary data for 2025-01.
[2025-10-24T17:18:18.653777] [WARN ] [MAIN      ] ASC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:18:18.654160] [INFO ] [MAIN      ] ASC: Wiping existing primary data before full refresh.
[2025-10-24T17:18:18.654267] [INFO ] [LOCAL     ] ASC: Starting deletion of primary data.
[2025-10-24T17:18:18.654568] [DEBUG] [LOCAL     ] ASC: Deleted primary data file.
[2025-10-24T17:18:18.654750] [INFO ] [MAIN      ] ASC: Starting full primary refresh.
[2025-10-24T17:18:18.802131] [INFO ] [REMOTE    ] ASAN: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T17:18:19.057125] [INFO ] [REMOTE    ] ASC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:18:19.062105] [INFO ] [REMOTE    ] ASBA: Incremental fetch complete for 2025-01 (0.51 seconds).
[2025-10-24T17:18:19.347625] [INFO ] [REMOTE    ] ASBA: Fetching primary data for 2025-02.
[2025-10-24T17:18:19.450290] [INFO ] [REMOTE    ] ASB: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T17:18:19.740735] [INFO ] [REMOTE    ] ASBA: Incremental fetch complete for 2025-02 (0.39 seconds).
[2025-10-24T17:18:20.147681] [INFO ] [REMOTE    ] ASBA: Fetching primary data for 2025-03.
[2025-10-24T17:18:20.758915] [INFO ] [REMOTE    ] ASBA: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T17:18:20.947675] [INFO ] [REMOTE    ] ASC: Fetching primary data for 2025-01.
[2025-10-24T17:18:21.747730] [INFO ] [REMOTE    ] ASB: Fetching primary data for 2025-05.
[2025-10-24T17:18:22.401456] [INFO ] [REMOTE    ] ASC: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T17:18:22.547717] [INFO ] [REMOTE    ] ASAN: Fetching primary data for 2025-07.
[2025-10-24T17:18:23.347623] [INFO ] [REMOTE    ] ASC: Fetching primary data for 2025-02.
[2025-10-24T17:18:23.766524] [INFO ] [REMOTE    ] ASB: Incremental fetch complete for 2025-05 (2.02 seconds).
[2025-10-24T17:18:24.147727] [INFO ] [REMOTE    ] ASBA: Fetching primary data for 2025-04.
[2025-10-24T17:18:24.337396] [INFO ] [REMOTE    ] ASAN: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T17:18:24.481570] [INFO ] [REMOTE    ] ASC: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T17:18:24.696325] [INFO ] [REMOTE    ] ASBA: Incremental fetch complete for 2025-04 (0.55 seconds).
[2025-10-24T17:18:24.947682] [INFO ] [REMOTE    ] ASC: Fetching primary data for 2025-03.
[2025-10-24T17:18:25.747727] [INFO ] [REMOTE    ] ASAN: Fetching primary data for 2025-08.
[2025-10-24T17:18:26.204972] [INFO ] [REMOTE    ] ASC: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T17:18:26.547619] [INFO ] [REMOTE    ] ASC: Fetching primary data for 2025-04.
[2025-10-24T17:18:27.220486] [INFO ] [REMOTE    ] ASAN: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T17:18:27.347631] [INFO ] [REMOTE    ] ASAN: Fetching primary data for 2025-09.
[2025-10-24T17:18:28.129160] [INFO ] [REMOTE    ] ASC: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T17:18:28.147597] [INFO ] [REMOTE    ] ASC: Fetching primary data for 2025-05.
[2025-10-24T17:18:28.947732] [INFO ] [REMOTE    ] ASB: Fetching primary data for 2025-06.
[2025-10-24T17:18:29.081393] [INFO ] [REMOTE    ] ASAN: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T17:18:29.134283] [INFO ] [REMOTE    ] ASC: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T17:18:29.747732] [INFO ] [REMOTE    ] ASC: Fetching primary data for 2025-06.
[2025-10-24T17:18:30.085255] [INFO ] [REMOTE    ] ASB: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T17:18:30.547707] [INFO ] [REMOTE    ] ASB: Fetching primary data for 2025-07.
[2025-10-24T17:18:31.284455] [INFO ] [REMOTE    ] ASC: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T17:18:31.347596] [INFO ] [REMOTE    ] ASC: Fetching primary data for 2025-07.
[2025-10-24T17:18:31.777366] [INFO ] [REMOTE    ] ASB: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T17:18:32.147735] [INFO ] [REMOTE    ] ASAN: Fetching primary data for 2025-10.
[2025-10-24T17:18:32.786221] [INFO ] [REMOTE    ] ASC: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T17:18:32.947640] [INFO ] [REMOTE    ] ASC: Fetching primary data for 2025-08.
[2025-10-24T17:18:33.669452] [INFO ] [REMOTE    ] ASAN: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T17:18:33.678557] [INFO ] [REMOTE    ] ASAN: Full fetch complete (76245 records).
[2025-10-24T17:18:33.678751] [DEBUG] [VALIDATOR ] ASAN: Validating primary data.
[2025-10-24T17:18:33.679721] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:18:33.679821] [FATAL] [MAIN      ] ASAN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:18:33.679902] [WARN ] [MAIN      ] ASAN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:18:33.679994] [INFO ] [LOCAL     ] ASAN: Starting deletion of primary data.
[2025-10-24T17:18:33.680082] [DEBUG] [LOCAL     ] ASAN: No primary data file found to delete.
[2025-10-24T17:18:33.680137] [INFO ] [LOCAL     ] ASAN: Starting deletion of derivative data.
[2025-10-24T17:18:33.680289] [DEBUG] [LOCAL     ] ASAN: Deleted derivative data file.
[2025-10-24T17:18:33.680927] [INFO ] [MAIN      ] Update Progress: 154/2366 symbols completed. ASAN took 30.9s. Estimated remaining: 4h 25m 55s. Rate: 8.3 symbols/min
[2025-10-24T17:18:33.752857] [INFO ] [REMOTE    ] ASB: Fetching primary data for 2025-08.
[2025-10-24T17:18:33.860550] [INFO ] [MAIN      ] ASG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:18:33.882029] [DEBUG] [LOCAL     ] ASG: Loaded 19473 existing records from primary storage.
[2025-10-24T17:18:33.882265] [INFO ] [MAIN      ] ASG: Loaded 19473 existing records.
[2025-10-24T17:18:34.081022] [WARN ] [MAIN      ] ASG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:18:34.081471] [INFO ] [MAIN      ] ASG: Wiping existing primary data before full refresh.
[2025-10-24T17:18:34.081585] [INFO ] [LOCAL     ] ASG: Starting deletion of primary data.
[2025-10-24T17:18:34.082157] [DEBUG] [LOCAL     ] ASG: Deleted primary data file.
[2025-10-24T17:18:34.082222] [INFO ] [MAIN      ] ASG: Starting full primary refresh.
[2025-10-24T17:18:34.241402] [INFO ] [REMOTE    ] ASC: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T17:18:34.459260] [INFO ] [REMOTE    ] ASG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:18:34.547621] [INFO ] [REMOTE    ] ASC: Fetching primary data for 2025-09.
[2025-10-24T17:18:35.347634] [INFO ] [REMOTE    ] ASG: Fetching primary data for 2025-01.
[2025-10-24T17:18:35.538670] [INFO ] [REMOTE    ] ASB: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T17:18:35.604947] [INFO ] [REMOTE    ] ASC: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T17:18:36.147636] [INFO ] [REMOTE    ] ASB: Fetching primary data for 2025-09.
[2025-10-24T17:18:36.608119] [INFO ] [REMOTE    ] ASG: Incremental fetch complete for 2025-01 (1.26 seconds).
[2025-10-24T17:18:36.947694] [INFO ] [REMOTE    ] ASBA: Fetching primary data for 2025-05.
[2025-10-24T17:18:37.599917] [INFO ] [REMOTE    ] ASBA: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T17:18:37.660452] [INFO ] [REMOTE    ] ASB: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T17:18:37.747635] [INFO ] [REMOTE    ] ASBA: Fetching primary data for 2025-06.
[2025-10-24T17:18:38.210244] [INFO ] [REMOTE    ] ASBA: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T17:18:38.547690] [INFO ] [REMOTE    ] ASG: Fetching primary data for 2025-02.
[2025-10-24T17:18:39.347627] [INFO ] [REMOTE    ] ASBA: Fetching primary data for 2025-07.
[2025-10-24T17:18:39.608693] [INFO ] [REMOTE    ] ASG: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T17:18:39.899476] [INFO ] [REMOTE    ] ASBA: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T17:18:40.147719] [INFO ] [REMOTE    ] ASG: Fetching primary data for 2025-03.
[2025-10-24T17:18:40.947672] [INFO ] [REMOTE    ] ASBA: Fetching primary data for 2025-08.
[2025-10-24T17:18:41.085459] [INFO ] [REMOTE    ] ASG: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T17:18:41.452017] [INFO ] [REMOTE    ] ASBA: Incremental fetch complete for 2025-08 (0.50 seconds).
[2025-10-24T17:18:41.747747] [INFO ] [REMOTE    ] ASBA: Fetching primary data for 2025-09.
[2025-10-24T17:18:42.274231] [INFO ] [REMOTE    ] ASBA: Incremental fetch complete for 2025-09 (0.53 seconds).
[2025-10-24T17:18:42.547705] [INFO ] [REMOTE    ] ASBA: Fetching primary data for 2025-10.
[2025-10-24T17:18:43.085860] [INFO ] [REMOTE    ] ASBA: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T17:18:43.087567] [INFO ] [REMOTE    ] ASBA: Full fetch complete (5159 records).
[2025-10-24T17:18:43.087687] [DEBUG] [VALIDATOR ] ASBA: Validating primary data.
[2025-10-24T17:18:43.088168] [FATAL] [VALIDATOR ] ASBA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:18:43.088270] [FATAL] [MAIN      ] ASBA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:18:43.088324] [WARN ] [MAIN      ] ASBA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:18:43.088403] [INFO ] [LOCAL     ] ASBA: Starting deletion of primary data.
[2025-10-24T17:18:43.088485] [DEBUG] [LOCAL     ] ASBA: No primary data file found to delete.
[2025-10-24T17:18:43.088532] [INFO ] [LOCAL     ] ASBA: Starting deletion of derivative data.
[2025-10-24T17:18:43.088709] [DEBUG] [LOCAL     ] ASBA: Deleted derivative data file.
[2025-10-24T17:18:43.088814] [INFO ] [MAIN      ] Update Progress: 155/2366 symbols completed. ASBA took 25.6s. Estimated remaining: 4h 26m 19s. Rate: 8.3 symbols/min
[2025-10-24T17:18:43.277556] [INFO ] [MAIN      ] ASGI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:18:43.300226] [DEBUG] [LOCAL     ] ASGI: Loaded 23093 existing records from primary storage.
[2025-10-24T17:18:43.300487] [INFO ] [MAIN      ] ASGI: Loaded 23093 existing records.
[2025-10-24T17:18:43.352747] [INFO ] [REMOTE    ] ASC: Fetching primary data for 2025-10.
[2025-10-24T17:18:43.477039] [WARN ] [MAIN      ] ASGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:18:43.477262] [INFO ] [MAIN      ] ASGI: Wiping existing primary data before full refresh.
[2025-10-24T17:18:43.477308] [INFO ] [LOCAL     ] ASGI: Starting deletion of primary data.
[2025-10-24T17:18:43.477517] [DEBUG] [LOCAL     ] ASGI: Deleted primary data file.
[2025-10-24T17:18:43.477572] [INFO ] [MAIN      ] ASGI: Starting full primary refresh.
[2025-10-24T17:18:43.838951] [INFO ] [REMOTE    ] ASGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:18:44.147693] [INFO ] [REMOTE    ] ASG: Fetching primary data for 2025-04.
[2025-10-24T17:18:44.440075] [INFO ] [REMOTE    ] ASC: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T17:18:44.447133] [INFO ] [REMOTE    ] ASC: Full fetch complete (56012 records).
[2025-10-24T17:18:44.447275] [DEBUG] [VALIDATOR ] ASC: Validating primary data.
[2025-10-24T17:18:44.829566] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present.
[2025-10-24T17:18:44.829675] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed.
[2025-10-24T17:18:44.830341] [INFO ] [MAIN      ] ASC: Fetched primary data is valid.
[2025-10-24T17:18:44.830383] [DEBUG] [LOCAL     ] ASC: Saving primary data.
[2025-10-24T17:18:44.830863] [FATAL] [LOCAL     ] ASC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:18:44.830950] [FATAL] [MAIN      ] ASC: Failed to save primary data.
[2025-10-24T17:18:44.830991] [WARN ] [MAIN      ] ASC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:18:44.831046] [INFO ] [LOCAL     ] ASC: Starting deletion of primary data.
[2025-10-24T17:18:44.831109] [DEBUG] [LOCAL     ] ASC: No primary data file found to delete.
[2025-10-24T17:18:44.831145] [INFO ] [LOCAL     ] ASC: Starting deletion of derivative data.
[2025-10-24T17:18:44.831274] [DEBUG] [LOCAL     ] ASC: Deleted derivative data file.
[2025-10-24T17:18:44.831927] [INFO ] [MAIN      ] Update Progress: 156/2366 symbols completed. ASC took 26.6s. Estimated remaining: 4h 24m 54s. Rate: 8.3 symbols/min
[2025-10-24T17:18:44.952894] [INFO ] [REMOTE    ] ASGI: Fetching primary data for 2025-01.
[2025-10-24T17:18:45.002554] [INFO ] [MAIN      ] ASGN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:18:45.041297] [DEBUG] [LOCAL     ] ASGN: Loaded 37036 existing records from primary storage.
[2025-10-24T17:18:45.041583] [INFO ] [MAIN      ] ASGN: Loaded 37036 existing records.
[2025-10-24T17:18:45.218613] [WARN ] [MAIN      ] ASGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:18:45.219003] [INFO ] [MAIN      ] ASGN: Wiping existing primary data before full refresh.
[2025-10-24T17:18:45.219067] [INFO ] [LOCAL     ] ASGN: Starting deletion of primary data.
[2025-10-24T17:18:45.233180] [DEBUG] [LOCAL     ] ASGN: Deleted primary data file.
[2025-10-24T17:18:45.233750] [INFO ] [MAIN      ] ASGN: Starting full primary refresh.
[2025-10-24T17:18:45.234226] [INFO ] [REMOTE    ] ASG: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T17:18:45.587383] [INFO ] [REMOTE    ] ASGN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:18:45.747717] [INFO ] [REMOTE    ] ASGN: Fetching primary data for 2025-01.
[2025-10-24T17:18:46.273952] [INFO ] [REMOTE    ] ASGI: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T17:18:46.547735] [INFO ] [REMOTE    ] ASG: Fetching primary data for 2025-05.
[2025-10-24T17:18:46.986018] [INFO ] [REMOTE    ] ASGN: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T17:18:47.347746] [INFO ] [REMOTE    ] ASGN: Fetching primary data for 2025-02.
[2025-10-24T17:18:47.691776] [INFO ] [REMOTE    ] ASG: Incremental fetch complete for 2025-05 (1.14 seconds).
[2025-10-24T17:18:48.147725] [INFO ] [REMOTE    ] ASB: Fetching primary data for 2025-10.
[2025-10-24T17:18:48.709409] [INFO ] [REMOTE    ] ASGN: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T17:18:48.947688] [INFO ] [REMOTE    ] ASGI: Fetching primary data for 2025-02.
[2025-10-24T17:18:49.747610] [INFO ] [REMOTE    ] ASG: Fetching primary data for 2025-06.
[2025-10-24T17:18:49.915439] [INFO ] [REMOTE    ] ASGI: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T17:18:50.547616] [INFO ] [REMOTE    ] ASGN: Fetching primary data for 2025-03.
[2025-10-24T17:18:50.580245] [INFO ] [REMOTE    ] ASB: Incremental fetch complete for 2025-10 (2.43 seconds).
[2025-10-24T17:18:50.589995] [INFO ] [REMOTE    ] ASB: Full fetch complete (72291 records).
[2025-10-24T17:18:50.590135] [DEBUG] [VALIDATOR ] ASB: Validating primary data.
[2025-10-24T17:18:50.911284] [INFO ] [REMOTE    ] ASG: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T17:18:51.021871] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present.
[2025-10-24T17:18:51.021959] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed.
[2025-10-24T17:18:51.022778] [INFO ] [MAIN      ] ASB: Fetched primary data is valid.
[2025-10-24T17:18:51.022842] [DEBUG] [LOCAL     ] ASB: Saving primary data.
[2025-10-24T17:18:51.023452] [FATAL] [LOCAL     ] ASB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:18:51.023544] [FATAL] [MAIN      ] ASB: Failed to save primary data.
[2025-10-24T17:18:51.023586] [WARN ] [MAIN      ] ASB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:18:51.023660] [INFO ] [LOCAL     ] ASB: Starting deletion of primary data.
[2025-10-24T17:18:51.023744] [DEBUG] [LOCAL     ] ASB: No primary data file found to delete.
[2025-10-24T17:18:51.023782] [INFO ] [LOCAL     ] ASB: Starting deletion of derivative data.
[2025-10-24T17:18:51.023923] [DEBUG] [LOCAL     ] ASB: Deleted derivative data file.
[2025-10-24T17:18:51.024133] [INFO ] [MAIN      ] Update Progress: 157/2366 symbols completed. ASB took 42.5s. Estimated remaining: 4h 24m 33s. Rate: 8.4 symbols/min
[2025-10-24T17:18:51.347728] [INFO ] [REMOTE    ] ASG: Fetching primary data for 2025-07.
[2025-10-24T17:18:51.743398] [INFO ] [REMOTE    ] ASGN: Incremental fetch complete for 2025-03 (1.20 seconds).
[2025-10-24T17:18:52.147711] [INFO ] [REMOTE    ] ASGN: Fetching primary data for 2025-04.
[2025-10-24T17:18:52.277881] [INFO ] [REMOTE    ] ASG: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T17:18:52.947773] [INFO ] [REMOTE    ] ASG: Fetching primary data for 2025-08.
[2025-10-24T17:18:53.722084] [INFO ] [REMOTE    ] ASGN: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T17:18:53.747601] [INFO ] [REMOTE    ] ASGN: Fetching primary data for 2025-05.
[2025-10-24T17:18:53.928799] [INFO ] [REMOTE    ] ASG: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T17:18:54.547633] [INFO ] [REMOTE    ] ASGI: Fetching primary data for 2025-03.
[2025-10-24T17:18:54.725993] [INFO ] [REMOTE    ] ASGN: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T17:18:55.347743] [INFO ] [REMOTE    ] ASG: Fetching primary data for 2025-09.
[2025-10-24T17:18:55.515406] [INFO ] [REMOTE    ] ASGI: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T17:18:56.147672] [INFO ] [REMOTE    ] ASGN: Fetching primary data for 2025-06.
[2025-10-24T17:18:56.322164] [INFO ] [REMOTE    ] ASG: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T17:18:56.947619] [INFO ] [REMOTE    ] ASG: Fetching primary data for 2025-10.
[2025-10-24T17:18:57.429302] [INFO ] [REMOTE    ] ASGN: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T17:18:57.747669] [INFO ] [REMOTE    ] ASGI: Fetching primary data for 2025-04.
[2025-10-24T17:18:58.158043] [INFO ] [REMOTE    ] ASG: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T17:18:58.162037] [INFO ] [REMOTE    ] ASG: Full fetch complete (30848 records).
[2025-10-24T17:18:58.162128] [DEBUG] [VALIDATOR ] ASG: Validating primary data.
[2025-10-24T17:18:58.550865] [INFO ] [REMOTE    ] ASGN: Fetching primary data for 2025-07.
[2025-10-24T17:18:58.581290] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present.
[2025-10-24T17:18:58.581447] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed.
[2025-10-24T17:18:58.581999] [INFO ] [MAIN      ] ASG: Fetched primary data is valid.
[2025-10-24T17:18:58.582065] [DEBUG] [LOCAL     ] ASG: Saving primary data.
[2025-10-24T17:18:58.582436] [FATAL] [LOCAL     ] ASG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:18:58.582520] [FATAL] [MAIN      ] ASG: Failed to save primary data.
[2025-10-24T17:18:58.582564] [WARN ] [MAIN      ] ASG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:18:58.582629] [INFO ] [LOCAL     ] ASG: Starting deletion of primary data.
[2025-10-24T17:18:58.582746] [DEBUG] [LOCAL     ] ASG: No primary data file found to delete.
[2025-10-24T17:18:58.582797] [INFO ] [LOCAL     ] ASG: Starting deletion of derivative data.
[2025-10-24T17:18:58.582919] [DEBUG] [LOCAL     ] ASG: Deleted derivative data file.
[2025-10-24T17:18:58.582994] [INFO ] [MAIN      ] Update Progress: 158/2366 symbols completed. ASG took 24.9s. Estimated remaining: 4h 24m 31s. Rate: 8.3 symbols/min
[2025-10-24T17:18:58.958920] [INFO ] [REMOTE    ] ASGI: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T17:18:59.347722] [INFO ] [REMOTE    ] ASGI: Fetching primary data for 2025-05.
[2025-10-24T17:19:00.303444] [INFO ] [REMOTE    ] ASGN: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T17:19:00.312014] [INFO ] [REMOTE    ] ASGN: Fetching primary data for 2025-08.
[2025-10-24T17:19:00.353492] [INFO ] [REMOTE    ] ASGI: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T17:19:00.947706] [INFO ] [REMOTE    ] ASGI: Fetching primary data for 2025-06.
[2025-10-24T17:19:02.374370] [INFO ] [REMOTE    ] ASGN: Incremental fetch complete for 2025-08 (2.06 seconds).
[2025-10-24T17:19:02.384251] [INFO ] [REMOTE    ] ASGI: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T17:19:02.394374] [INFO ] [REMOTE    ] ASGN: Fetching primary data for 2025-09.
[2025-10-24T17:19:02.547673] [INFO ] [REMOTE    ] ASGI: Fetching primary data for 2025-07.
[2025-10-24T17:19:03.777997] [INFO ] [REMOTE    ] ASGI: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T17:19:03.783530] [INFO ] [REMOTE    ] ASGI: Fetching primary data for 2025-08.
[2025-10-24T17:19:04.077320] [INFO ] [REMOTE    ] ASGN: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T17:19:04.147723] [INFO ] [REMOTE    ] ASGN: Fetching primary data for 2025-10.
[2025-10-24T17:19:04.960496] [INFO ] [REMOTE    ] ASGI: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T17:19:04.965967] [INFO ] [REMOTE    ] ASGI: Fetching primary data for 2025-09.
[2025-10-24T17:19:05.630249] [INFO ] [REMOTE    ] ASGN: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T17:19:05.638226] [INFO ] [REMOTE    ] ASGN: Full fetch complete (53864 records).
[2025-10-24T17:19:05.638383] [DEBUG] [VALIDATOR ] ASGN: Validating primary data.
[2025-10-24T17:19:06.056333] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present.
[2025-10-24T17:19:06.056504] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed.
[2025-10-24T17:19:06.057756] [INFO ] [MAIN      ] ASGN: Fetched primary data is valid.
[2025-10-24T17:19:06.058518] [DEBUG] [LOCAL     ] ASGN: Saving primary data.
[2025-10-24T17:19:06.058432] [INFO ] [REMOTE    ] ASGI: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T17:19:06.064466] [FATAL] [LOCAL     ] ASGN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:19:06.064671] [FATAL] [MAIN      ] ASGN: Failed to save primary data.
[2025-10-24T17:19:06.064881] [WARN ] [MAIN      ] ASGN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:19:06.064953] [INFO ] [LOCAL     ] ASGN: Starting deletion of primary data.
[2025-10-24T17:19:06.065282] [INFO ] [REMOTE    ] ASGI: Fetching primary data for 2025-10.
[2025-10-24T17:19:06.065497] [DEBUG] [LOCAL     ] ASGN: No primary data file found to delete.
[2025-10-24T17:19:06.066352] [INFO ] [LOCAL     ] ASGN: Starting deletion of derivative data.
[2025-10-24T17:19:06.066494] [DEBUG] [LOCAL     ] ASGN: Deleted derivative data file.
[2025-10-24T17:19:06.066575] [INFO ] [MAIN      ] Update Progress: 159/2366 symbols completed. ASGN took 21.2s. Estimated remaining: 4h 24m 28s. Rate: 8.3 symbols/min
[2025-10-24T17:19:07.302806] [INFO ] [REMOTE    ] ASGI: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T17:19:07.307243] [INFO ] [REMOTE    ] ASGI: Full fetch complete (32651 records).
[2025-10-24T17:19:07.307329] [DEBUG] [VALIDATOR ] ASGI: Validating primary data.
[2025-10-24T17:19:07.307912] [FATAL] [VALIDATOR ] ASGI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:19:07.308008] [FATAL] [MAIN      ] ASGI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:19:07.308061] [WARN ] [MAIN      ] ASGI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:19:07.308105] [INFO ] [LOCAL     ] ASGI: Starting deletion of primary data.
[2025-10-24T17:19:07.308158] [DEBUG] [LOCAL     ] ASGI: No primary data file found to delete.
[2025-10-24T17:19:07.308193] [INFO ] [LOCAL     ] ASGI: Starting deletion of derivative data.
[2025-10-24T17:19:07.308337] [DEBUG] [LOCAL     ] ASGI: Deleted derivative data file.
[2025-10-24T17:19:07.308433] [INFO ] [MAIN      ] Update Progress: 160/2366 symbols completed. ASGI took 24.2s. Estimated remaining: 4h 22m 59s. Rate: 8.4 symbols/min
[2025-10-24T17:19:07.859155] [INFO ] [MAIN      ] ASPN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:19:07.924112] [INFO ] [MAIN      ] ASR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:19:07.998035] [INFO ] [MAIN      ] ASIX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:19:07.996418] [INFO ] [MAIN      ] ASH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:19:08.008586] [DEBUG] [LOCAL     ] ASR: Loaded 9477 existing records from primary storage.
[2025-10-24T17:19:08.008997] [INFO ] [MAIN      ] ASR: Loaded 9477 existing records.
[2025-10-24T17:19:08.139435] [DEBUG] [LOCAL     ] ASIX: Loaded 23134 existing records from primary storage.
[2025-10-24T17:19:08.150399] [INFO ] [MAIN      ] ASIX: Loaded 23134 existing records.
[2025-10-24T17:19:08.290620] [WARN ] [MAIN      ] ASR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:19:08.332225] [INFO ] [MAIN      ] ASR: Wiping existing primary data before full refresh.
[2025-10-24T17:19:08.356158] [DEBUG] [LOCAL     ] ASH: Loaded 37640 existing records from primary storage.
[2025-10-24T17:19:08.343432] [INFO ] [LOCAL     ] ASR: Starting deletion of primary data.
[2025-10-24T17:19:08.333065] [DEBUG] [LOCAL     ] ASPN: Loaded 50218 existing records from primary storage.
[2025-10-24T17:19:08.356603] [INFO ] [MAIN      ] ASPN: Loaded 50218 existing records.
[2025-10-24T17:19:08.362191] [DEBUG] [LOCAL     ] ASR: Deleted primary data file.
[2025-10-24T17:19:08.367504] [INFO ] [MAIN      ] ASH: Loaded 37640 existing records.
[2025-10-24T17:19:08.393394] [INFO ] [MAIN      ] ASR: Starting full primary refresh.
[2025-10-24T17:19:08.586603] [WARN ] [MAIN      ] ASIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:19:08.632340] [INFO ] [MAIN      ] ASIX: Wiping existing primary data before full refresh.
[2025-10-24T17:19:08.683835] [INFO ] [LOCAL     ] ASIX: Starting deletion of primary data.
[2025-10-24T17:19:08.740201] [DEBUG] [LOCAL     ] ASIX: Deleted primary data file.
[2025-10-24T17:19:08.750691] [INFO ] [MAIN      ] ASIX: Starting full primary refresh.
[2025-10-24T17:19:08.856425] [WARN ] [MAIN      ] ASPN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:19:08.884898] [INFO ] [MAIN      ] ASPN: Wiping existing primary data before full refresh.
[2025-10-24T17:19:08.905861] [INFO ] [LOCAL     ] ASPN: Starting deletion of primary data.
[2025-10-24T17:19:08.957376] [DEBUG] [LOCAL     ] ASPN: Deleted primary data file.
[2025-10-24T17:19:08.957562] [INFO ] [MAIN      ] ASPN: Starting full primary refresh.
[2025-10-24T17:19:09.161775] [WARN ] [MAIN      ] ASH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:19:09.196013] [INFO ] [MAIN      ] ASH: Wiping existing primary data before full refresh.
[2025-10-24T17:19:09.196155] [INFO ] [LOCAL     ] ASH: Starting deletion of primary data.
[2025-10-24T17:19:09.309664] [DEBUG] [LOCAL     ] ASH: Deleted primary data file.
[2025-10-24T17:19:09.371902] [INFO ] [MAIN      ] ASH: Starting full primary refresh.
[2025-10-24T17:19:09.712416] [INFO ] [REMOTE    ] ASR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:19:09.763395] [INFO ] [REMOTE    ] ASR: Fetching primary data for 2025-01.
[2025-10-24T17:19:09.893467] [INFO ] [REMOTE    ] ASIX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:19:09.948715] [INFO ] [REMOTE    ] ASIX: Fetching primary data for 2025-01.
[2025-10-24T17:19:10.256364] [INFO ] [REMOTE    ] ASPN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:19:10.273833] [INFO ] [REMOTE    ] ASPN: Fetching primary data for 2025-01.
[2025-10-24T17:19:10.276335] [INFO ] [REMOTE    ] ASH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:19:10.276631] [INFO ] [REMOTE    ] ASH: Fetching primary data for 2025-01.
[2025-10-24T17:19:10.689626] [INFO ] [REMOTE    ] ASR: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T17:19:10.691463] [INFO ] [REMOTE    ] ASR: Fetching primary data for 2025-02.
[2025-10-24T17:19:11.275040] [INFO ] [REMOTE    ] ASIX: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T17:19:11.279037] [INFO ] [REMOTE    ] ASIX: Fetching primary data for 2025-02.
[2025-10-24T17:19:11.387685] [INFO ] [REMOTE    ] ASR: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T17:19:11.389703] [INFO ] [REMOTE    ] ASR: Fetching primary data for 2025-03.
[2025-10-24T17:19:11.650596] [INFO ] [REMOTE    ] ASH: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T17:19:11.879348] [INFO ] [REMOTE    ] ASIX: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T17:19:12.023261] [INFO ] [REMOTE    ] ASPN: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T17:19:12.143515] [INFO ] [REMOTE    ] ASR: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T17:19:12.147589] [INFO ] [REMOTE    ] ASR: Fetching primary data for 2025-04.
[2025-10-24T17:19:12.935312] [INFO ] [REMOTE    ] ASR: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T17:19:12.947597] [INFO ] [REMOTE    ] ASR: Fetching primary data for 2025-05.
[2025-10-24T17:19:13.747703] [INFO ] [REMOTE    ] ASPN: Fetching primary data for 2025-02.
[2025-10-24T17:19:13.796303] [INFO ] [REMOTE    ] ASR: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T17:19:14.547691] [INFO ] [REMOTE    ] ASR: Fetching primary data for 2025-06.
[2025-10-24T17:19:15.347621] [INFO ] [REMOTE    ] ASIX: Fetching primary data for 2025-03.
[2025-10-24T17:19:15.563293] [INFO ] [REMOTE    ] ASR: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T17:19:15.594577] [INFO ] [REMOTE    ] ASPN: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T17:19:16.147639] [INFO ] [REMOTE    ] ASPN: Fetching primary data for 2025-03.
[2025-10-24T17:19:16.334035] [INFO ] [REMOTE    ] ASIX: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T17:19:16.947637] [INFO ] [REMOTE    ] ASIX: Fetching primary data for 2025-04.
[2025-10-24T17:19:17.747729] [INFO ] [REMOTE    ] ASH: Fetching primary data for 2025-02.
[2025-10-24T17:19:17.954525] [INFO ] [REMOTE    ] ASPN: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T17:19:18.071514] [INFO ] [REMOTE    ] ASIX: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T17:19:18.547676] [INFO ] [REMOTE    ] ASPN: Fetching primary data for 2025-04.
[2025-10-24T17:19:19.042968] [INFO ] [REMOTE    ] ASH: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T17:19:19.347717] [INFO ] [REMOTE    ] ASH: Fetching primary data for 2025-03.
[2025-10-24T17:19:19.822235] [INFO ] [REMOTE    ] ASPN: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T17:19:20.147673] [INFO ] [REMOTE    ] ASR: Fetching primary data for 2025-07.
[2025-10-24T17:19:20.947639] [INFO ] [REMOTE    ] ASIX: Fetching primary data for 2025-05.
[2025-10-24T17:19:21.083183] [INFO ] [REMOTE    ] ASH: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T17:19:21.130446] [INFO ] [REMOTE    ] ASR: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T17:19:21.747700] [INFO ] [REMOTE    ] ASR: Fetching primary data for 2025-08.
[2025-10-24T17:19:21.925062] [INFO ] [REMOTE    ] ASIX: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T17:19:22.346861] [INFO ] [REMOTE    ] ASR: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T17:19:22.547694] [INFO ] [REMOTE    ] ASIX: Fetching primary data for 2025-06.
[2025-10-24T17:19:23.347712] [INFO ] [REMOTE    ] ASR: Fetching primary data for 2025-09.
[2025-10-24T17:19:23.472949] [INFO ] [REMOTE    ] ASIX: Incremental fetch complete for 2025-06 (0.93 seconds).
[2025-10-24T17:19:24.153014] [INFO ] [REMOTE    ] ASH: Fetching primary data for 2025-04.
[2025-10-24T17:19:24.155571] [INFO ] [REMOTE    ] ASR: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T17:19:24.947704] [INFO ] [REMOTE    ] ASPN: Fetching primary data for 2025-05.
[2025-10-24T17:19:25.676289] [INFO ] [REMOTE    ] ASH: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T17:19:25.747602] [INFO ] [REMOTE    ] ASH: Fetching primary data for 2025-05.
[2025-10-24T17:19:26.547684] [INFO ] [REMOTE    ] ASIX: Fetching primary data for 2025-07.
[2025-10-24T17:19:26.976379] [INFO ] [REMOTE    ] ASPN: Incremental fetch complete for 2025-05 (2.03 seconds).
[2025-10-24T17:19:27.050003] [INFO ] [REMOTE    ] ASH: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T17:19:27.309155] [INFO ] [REMOTE    ] ASIX: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T17:19:27.347627] [INFO ] [REMOTE    ] ASIX: Fetching primary data for 2025-08.
[2025-10-24T17:19:28.147694] [INFO ] [REMOTE    ] ASH: Fetching primary data for 2025-06.
[2025-10-24T17:19:28.419154] [INFO ] [REMOTE    ] ASIX: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T17:19:28.947682] [INFO ] [REMOTE    ] ASIX: Fetching primary data for 2025-09.
[2025-10-24T17:19:29.728307] [INFO ] [REMOTE    ] ASH: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T17:19:29.747602] [INFO ] [REMOTE    ] ASH: Fetching primary data for 2025-07.
[2025-10-24T17:19:29.961093] [INFO ] [REMOTE    ] ASIX: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T17:19:30.547677] [INFO ] [REMOTE    ] ASPN: Fetching primary data for 2025-06.
[2025-10-24T17:19:31.126534] [INFO ] [REMOTE    ] ASH: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T17:19:31.347718] [INFO ] [REMOTE    ] ASH: Fetching primary data for 2025-08.
[2025-10-24T17:19:31.896673] [INFO ] [REMOTE    ] ASPN: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T17:19:32.147709] [INFO ] [REMOTE    ] ASPN: Fetching primary data for 2025-07.
[2025-10-24T17:19:32.264213] [INFO ] [REMOTE    ] ASH: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T17:19:32.947621] [INFO ] [REMOTE    ] ASR: Fetching primary data for 2025-10.
[2025-10-24T17:19:33.673582] [INFO ] [REMOTE    ] ASR: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T17:19:33.675526] [INFO ] [REMOTE    ] ASR: Full fetch complete (12495 records).
[2025-10-24T17:19:33.675609] [DEBUG] [VALIDATOR ] ASR: Validating primary data.
[2025-10-24T17:19:33.676134] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:19:33.676235] [FATAL] [MAIN      ] ASR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:19:33.676279] [WARN ] [MAIN      ] ASR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:19:33.676318] [INFO ] [LOCAL     ] ASR: Starting deletion of primary data.
[2025-10-24T17:19:33.676371] [DEBUG] [LOCAL     ] ASR: No primary data file found to delete.
[2025-10-24T17:19:33.676413] [INFO ] [LOCAL     ] ASR: Starting deletion of derivative data.
[2025-10-24T17:19:33.676539] [DEBUG] [LOCAL     ] ASR: Deleted derivative data file.
[2025-10-24T17:19:33.676622] [INFO ] [MAIN      ] Update Progress: 161/2366 symbols completed. ASR took 26.4s. Estimated remaining: 4h 27m 15s. Rate: 8.3 symbols/min
[2025-10-24T17:19:33.747774] [INFO ] [REMOTE    ] ASIX: Fetching primary data for 2025-10.
[2025-10-24T17:19:33.860041] [INFO ] [MAIN      ] ASX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:19:33.891099] [INFO ] [REMOTE    ] ASPN: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T17:19:33.947160] [DEBUG] [LOCAL     ] ASX: Loaded 53258 existing records from primary storage.
[2025-10-24T17:19:33.947511] [INFO ] [MAIN      ] ASX: Loaded 53258 existing records.
[2025-10-24T17:19:34.133397] [WARN ] [MAIN      ] ASX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:19:34.133591] [INFO ] [MAIN      ] ASX: Wiping existing primary data before full refresh.
[2025-10-24T17:19:34.133637] [INFO ] [LOCAL     ] ASX: Starting deletion of primary data.
[2025-10-24T17:19:34.134566] [DEBUG] [LOCAL     ] ASX: Deleted primary data file.
[2025-10-24T17:19:34.134627] [INFO ] [MAIN      ] ASX: Starting full primary refresh.
[2025-10-24T17:19:34.486491] [INFO ] [REMOTE    ] ASX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:19:34.547617] [INFO ] [REMOTE    ] ASPN: Fetching primary data for 2025-08.
[2025-10-24T17:19:34.917481] [INFO ] [REMOTE    ] ASIX: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T17:19:34.922222] [INFO ] [REMOTE    ] ASIX: Full fetch complete (31060 records).
[2025-10-24T17:19:34.922324] [DEBUG] [VALIDATOR ] ASIX: Validating primary data.
[2025-10-24T17:19:35.289323] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present.
[2025-10-24T17:19:35.289406] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed.
[2025-10-24T17:19:35.289822] [INFO ] [MAIN      ] ASIX: Fetched primary data is valid.
[2025-10-24T17:19:35.289881] [DEBUG] [LOCAL     ] ASIX: Saving primary data.
[2025-10-24T17:19:35.290200] [FATAL] [LOCAL     ] ASIX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:19:35.290284] [FATAL] [MAIN      ] ASIX: Failed to save primary data.
[2025-10-24T17:19:35.290325] [WARN ] [MAIN      ] ASIX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:19:35.290358] [INFO ] [LOCAL     ] ASIX: Starting deletion of primary data.
[2025-10-24T17:19:35.290417] [DEBUG] [LOCAL     ] ASIX: No primary data file found to delete.
[2025-10-24T17:19:35.290452] [INFO ] [LOCAL     ] ASIX: Starting deletion of derivative data.
[2025-10-24T17:19:35.290580] [DEBUG] [LOCAL     ] ASIX: Deleted derivative data file.
[2025-10-24T17:19:35.290678] [INFO ] [MAIN      ] Update Progress: 162/2366 symbols completed. ASIX took 28.0s. Estimated remaining: 4h 25m 50s. Rate: 8.3 symbols/min
[2025-10-24T17:19:35.357423] [INFO ] [REMOTE    ] ASH: Fetching primary data for 2025-09.
[2025-10-24T17:19:35.470061] [INFO ] [MAIN      ] ATEN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:19:35.508531] [DEBUG] [LOCAL     ] ATEN: Loaded 37929 existing records from primary storage.
[2025-10-24T17:19:35.508877] [INFO ] [MAIN      ] ATEN: Loaded 37929 existing records.
[2025-10-24T17:19:35.692959] [WARN ] [MAIN      ] ATEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:19:35.693231] [INFO ] [MAIN      ] ATEN: Wiping existing primary data before full refresh.
[2025-10-24T17:19:35.693287] [INFO ] [LOCAL     ] ATEN: Starting deletion of primary data.
[2025-10-24T17:19:35.693949] [DEBUG] [LOCAL     ] ATEN: Deleted primary data file.
[2025-10-24T17:19:35.694008] [INFO ] [MAIN      ] ATEN: Starting full primary refresh.
[2025-10-24T17:19:36.049118] [INFO ] [REMOTE    ] ATEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:19:36.143954] [INFO ] [REMOTE    ] ASPN: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T17:19:36.153355] [INFO ] [REMOTE    ] ASX: Fetching primary data for 2025-01.
[2025-10-24T17:19:36.861405] [INFO ] [REMOTE    ] ASH: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T17:19:36.947705] [INFO ] [REMOTE    ] ATEN: Fetching primary data for 2025-01.
[2025-10-24T17:19:37.699351] [INFO ] [REMOTE    ] ASX: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T17:19:37.747692] [INFO ] [REMOTE    ] ASX: Fetching primary data for 2025-02.
[2025-10-24T17:19:37.962679] [INFO ] [REMOTE    ] ATEN: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T17:19:38.547701] [INFO ] [REMOTE    ] ASPN: Fetching primary data for 2025-09.
[2025-10-24T17:19:39.361507] [INFO ] [REMOTE    ] ASH: Fetching primary data for 2025-10.
[2025-10-24T17:19:39.364107] [INFO ] [REMOTE    ] ASX: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T17:19:40.147620] [INFO ] [REMOTE    ] ATEN: Fetching primary data for 2025-02.
[2025-10-24T17:19:40.206783] [INFO ] [REMOTE    ] ASPN: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T17:19:40.947717] [INFO ] [REMOTE    ] ASX: Fetching primary data for 2025-03.
[2025-10-24T17:19:41.031506] [INFO ] [REMOTE    ] ASH: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T17:19:41.039371] [INFO ] [REMOTE    ] ASH: Full fetch complete (55602 records).
[2025-10-24T17:19:41.039518] [DEBUG] [VALIDATOR ] ASH: Validating primary data.
[2025-10-24T17:19:41.419089] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present.
[2025-10-24T17:19:41.419280] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed.
[2025-10-24T17:19:41.419930] [INFO ] [MAIN      ] ASH: Fetched primary data is valid.
[2025-10-24T17:19:41.420007] [DEBUG] [LOCAL     ] ASH: Saving primary data.
[2025-10-24T17:19:41.420506] [FATAL] [LOCAL     ] ASH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:19:41.420607] [FATAL] [MAIN      ] ASH: Failed to save primary data.
[2025-10-24T17:19:41.420734] [WARN ] [MAIN      ] ASH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:19:41.420881] [INFO ] [LOCAL     ] ASH: Starting deletion of primary data.
[2025-10-24T17:19:41.420953] [DEBUG] [LOCAL     ] ASH: No primary data file found to delete.
[2025-10-24T17:19:41.420990] [INFO ] [LOCAL     ] ASH: Starting deletion of derivative data.
[2025-10-24T17:19:41.421111] [DEBUG] [LOCAL     ] ASH: Deleted derivative data file.
[2025-10-24T17:19:41.421450] [INFO ] [MAIN      ] Update Progress: 163/2366 symbols completed. ASH took 34.1s. Estimated remaining: 4h 25m 28s. Rate: 8.3 symbols/min
[2025-10-24T17:19:41.608710] [INFO ] [REMOTE    ] ATEN: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T17:19:41.642680] [INFO ] [MAIN      ] ATGE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:19:41.673268] [DEBUG] [LOCAL     ] ATGE: Loaded 30576 existing records from primary storage.
[2025-10-24T17:19:41.673520] [INFO ] [MAIN      ] ATGE: Loaded 30576 existing records.
[2025-10-24T17:19:41.752718] [INFO ] [REMOTE    ] ASPN: Fetching primary data for 2025-10.
[2025-10-24T17:19:41.859928] [WARN ] [MAIN      ] ATGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:19:41.860117] [INFO ] [MAIN      ] ATGE: Wiping existing primary data before full refresh.
[2025-10-24T17:19:41.860175] [INFO ] [LOCAL     ] ATGE: Starting deletion of primary data.
[2025-10-24T17:19:41.860751] [DEBUG] [LOCAL     ] ATGE: Deleted primary data file.
[2025-10-24T17:19:41.860808] [INFO ] [MAIN      ] ATGE: Starting full primary refresh.
[2025-10-24T17:19:42.218269] [INFO ] [REMOTE    ] ATGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:19:42.547632] [INFO ] [REMOTE    ] ATGE: Fetching primary data for 2025-01.
[2025-10-24T17:19:43.176575] [INFO ] [REMOTE    ] ASX: Incremental fetch complete for 2025-03 (2.23 seconds).
[2025-10-24T17:19:43.347625] [INFO ] [REMOTE    ] ASX: Fetching primary data for 2025-04.
[2025-10-24T17:19:43.824031] [INFO ] [REMOTE    ] ATGE: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T17:19:43.961307] [INFO ] [REMOTE    ] ASPN: Incremental fetch complete for 2025-10 (2.21 seconds).
[2025-10-24T17:19:43.971088] [INFO ] [REMOTE    ] ASPN: Full fetch complete (72549 records).
[2025-10-24T17:19:43.971256] [DEBUG] [VALIDATOR ] ASPN: Validating primary data.
[2025-10-24T17:19:44.160579] [INFO ] [REMOTE    ] ATEN: Fetching primary data for 2025-03.
[2025-10-24T17:19:44.353947] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present.
[2025-10-24T17:19:44.354029] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed.
[2025-10-24T17:19:44.354815] [INFO ] [MAIN      ] ASPN: Fetched primary data is valid.
[2025-10-24T17:19:44.354877] [DEBUG] [LOCAL     ] ASPN: Saving primary data.
[2025-10-24T17:19:44.355465] [FATAL] [LOCAL     ] ASPN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:19:44.355557] [FATAL] [MAIN      ] ASPN: Failed to save primary data.
[2025-10-24T17:19:44.355600] [WARN ] [MAIN      ] ASPN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:19:44.355635] [INFO ] [LOCAL     ] ASPN: Starting deletion of primary data.
[2025-10-24T17:19:44.355732] [DEBUG] [LOCAL     ] ASPN: No primary data file found to delete.
[2025-10-24T17:19:44.355773] [INFO ] [LOCAL     ] ASPN: Starting deletion of derivative data.
[2025-10-24T17:19:44.355911] [DEBUG] [LOCAL     ] ASPN: Deleted derivative data file.
[2025-10-24T17:19:44.356163] [INFO ] [MAIN      ] Update Progress: 164/2366 symbols completed. ASPN took 37.0s. Estimated remaining: 4h 24m 23s. Rate: 8.3 symbols/min
[2025-10-24T17:19:44.522875] [INFO ] [MAIN      ] ATHM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:19:44.552557] [DEBUG] [LOCAL     ] ATHM: Loaded 31467 existing records from primary storage.
[2025-10-24T17:19:44.552882] [INFO ] [MAIN      ] ATHM: Loaded 31467 existing records.
[2025-10-24T17:19:44.739226] [WARN ] [MAIN      ] ATHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:19:44.739840] [INFO ] [MAIN      ] ATHM: Wiping existing primary data before full refresh.
[2025-10-24T17:19:44.739951] [INFO ] [LOCAL     ] ATHM: Starting deletion of primary data.
[2025-10-24T17:19:44.740877] [DEBUG] [LOCAL     ] ATHM: Deleted primary data file.
[2025-10-24T17:19:44.741031] [INFO ] [MAIN      ] ATHM: Starting full primary refresh.
[2025-10-24T17:19:44.950508] [INFO ] [REMOTE    ] ATGE: Fetching primary data for 2025-02.
[2025-10-24T17:19:44.952684] [INFO ] [REMOTE    ] ASX: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T17:19:45.152180] [INFO ] [REMOTE    ] ATHM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:19:45.414217] [INFO ] [REMOTE    ] ATEN: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T17:19:45.747679] [INFO ] [REMOTE    ] ATEN: Fetching primary data for 2025-04.
[2025-10-24T17:19:46.071739] [INFO ] [REMOTE    ] ATGE: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T17:19:46.547685] [INFO ] [REMOTE    ] ATHM: Fetching primary data for 2025-01.
[2025-10-24T17:19:47.042933] [INFO ] [REMOTE    ] ATEN: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T17:19:47.347720] [INFO ] [REMOTE    ] ATGE: Fetching primary data for 2025-03.
[2025-10-24T17:19:47.696077] [INFO ] [REMOTE    ] ATHM: Incremental fetch complete for 2025-01 (1.15 seconds).
[2025-10-24T17:19:48.147714] [INFO ] [REMOTE    ] ASX: Fetching primary data for 2025-05.
[2025-10-24T17:19:48.792628] [INFO ] [REMOTE    ] ATGE: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T17:19:48.947618] [INFO ] [REMOTE    ] ATEN: Fetching primary data for 2025-05.
[2025-10-24T17:19:49.747631] [INFO ] [REMOTE    ] ATHM: Fetching primary data for 2025-02.
[2025-10-24T17:19:50.126175] [INFO ] [REMOTE    ] ASX: Incremental fetch complete for 2025-05 (1.98 seconds).
[2025-10-24T17:19:50.529860] [INFO ] [REMOTE    ] ATEN: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T17:19:50.547599] [INFO ] [REMOTE    ] ATEN: Fetching primary data for 2025-06.
[2025-10-24T17:19:51.061357] [INFO ] [REMOTE    ] ATHM: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T17:19:51.347750] [INFO ] [REMOTE    ] ATGE: Fetching primary data for 2025-04.
[2025-10-24T17:19:51.613183] [INFO ] [REMOTE    ] ATEN: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T17:19:52.147696] [INFO ] [REMOTE    ] ASX: Fetching primary data for 2025-06.
[2025-10-24T17:19:52.464318] [INFO ] [REMOTE    ] ATGE: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T17:19:52.947637] [INFO ] [REMOTE    ] ATGE: Fetching primary data for 2025-05.
[2025-10-24T17:19:53.527342] [INFO ] [REMOTE    ] ASX: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T17:19:53.747712] [INFO ] [REMOTE    ] ATEN: Fetching primary data for 2025-07.
[2025-10-24T17:19:53.971841] [INFO ] [REMOTE    ] ATGE: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T17:19:54.547671] [INFO ] [REMOTE    ] ATGE: Fetching primary data for 2025-06.
[2025-10-24T17:19:55.208596] [INFO ] [REMOTE    ] ATEN: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T17:19:55.347679] [INFO ] [REMOTE    ] ATEN: Fetching primary data for 2025-08.
[2025-10-24T17:19:55.872156] [INFO ] [REMOTE    ] ATGE: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T17:19:56.147713] [INFO ] [REMOTE    ] ATGE: Fetching primary data for 2025-07.
[2025-10-24T17:19:56.561625] [INFO ] [REMOTE    ] ATEN: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T17:19:56.947717] [INFO ] [REMOTE    ] ASX: Fetching primary data for 2025-07.
[2025-10-24T17:19:57.391674] [INFO ] [REMOTE    ] ATGE: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T17:19:57.747672] [INFO ] [REMOTE    ] ATHM: Fetching primary data for 2025-03.
[2025-10-24T17:19:58.469094] [INFO ] [REMOTE    ] ASX: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T17:19:58.547669] [INFO ] [REMOTE    ] ASX: Fetching primary data for 2025-08.
[2025-10-24T17:19:59.239808] [INFO ] [REMOTE    ] ATHM: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T17:19:59.347606] [INFO ] [REMOTE    ] ATHM: Fetching primary data for 2025-04.
[2025-10-24T17:20:00.147673] [INFO ] [REMOTE    ] ATEN: Fetching primary data for 2025-09.
[2025-10-24T17:20:00.228773] [INFO ] [REMOTE    ] ASX: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T17:20:00.947614] [INFO ] [REMOTE    ] ATGE: Fetching primary data for 2025-08.
[2025-10-24T17:20:01.089729] [INFO ] [REMOTE    ] ATHM: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T17:20:01.747716] [INFO ] [REMOTE    ] ASX: Fetching primary data for 2025-09.
[2025-10-24T17:20:01.884302] [INFO ] [REMOTE    ] ATEN: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T17:20:02.547721] [INFO ] [REMOTE    ] ATEN: Fetching primary data for 2025-10.
[2025-10-24T17:20:02.934898] [INFO ] [REMOTE    ] ATGE: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T17:20:03.347744] [INFO ] [REMOTE    ] ATGE: Fetching primary data for 2025-09.
[2025-10-24T17:20:03.952907] [INFO ] [REMOTE    ] ASX: Incremental fetch complete for 2025-09 (2.21 seconds).
[2025-10-24T17:20:04.147735] [INFO ] [REMOTE    ] ASX: Fetching primary data for 2025-10.
[2025-10-24T17:20:04.467069] [INFO ] [REMOTE    ] ATEN: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T17:20:04.474183] [INFO ] [REMOTE    ] ATEN: Full fetch complete (56608 records).
[2025-10-24T17:20:04.474453] [DEBUG] [VALIDATOR ] ATEN: Validating primary data.
[2025-10-24T17:20:04.878264] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present.
[2025-10-24T17:20:04.878357] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed.
[2025-10-24T17:20:04.879026] [INFO ] [MAIN      ] ATEN: Fetched primary data is valid.
[2025-10-24T17:20:04.879113] [DEBUG] [LOCAL     ] ATEN: Saving primary data.
[2025-10-24T17:20:04.879636] [FATAL] [LOCAL     ] ATEN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:20:04.879764] [FATAL] [MAIN      ] ATEN: Failed to save primary data.
[2025-10-24T17:20:04.879808] [WARN ] [MAIN      ] ATEN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:20:04.879843] [INFO ] [LOCAL     ] ATEN: Starting deletion of primary data.
[2025-10-24T17:20:04.879898] [DEBUG] [LOCAL     ] ATEN: No primary data file found to delete.
[2025-10-24T17:20:04.879933] [INFO ] [LOCAL     ] ATEN: Starting deletion of derivative data.
[2025-10-24T17:20:04.880092] [DEBUG] [LOCAL     ] ATEN: Deleted derivative data file.
[2025-10-24T17:20:04.880555] [INFO ] [MAIN      ] Update Progress: 165/2366 symbols completed. ATEN took 29.6s. Estimated remaining: 4h 27m 14s. Rate: 8.2 symbols/min
[2025-10-24T17:20:04.950565] [INFO ] [REMOTE    ] ATHM: Fetching primary data for 2025-05.
[2025-10-24T17:20:05.057071] [INFO ] [MAIN      ] ATHS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:20:05.065931] [DEBUG] [LOCAL     ] ATHS: Loaded 6531 existing records from primary storage.
[2025-10-24T17:20:05.066159] [INFO ] [MAIN      ] ATHS: Loaded 6531 existing records.
[2025-10-24T17:20:05.229322] [INFO ] [REMOTE    ] ATGE: Incremental fetch complete for 2025-09 (1.88 seconds).
[2025-10-24T17:20:05.292234] [WARN ] [MAIN      ] ATHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:20:05.292616] [INFO ] [MAIN      ] ATHS: Wiping existing primary data before full refresh.
[2025-10-24T17:20:05.292706] [INFO ] [LOCAL     ] ATHS: Starting deletion of primary data.
[2025-10-24T17:20:05.293423] [DEBUG] [LOCAL     ] ATHS: Deleted primary data file.
[2025-10-24T17:20:05.293484] [INFO ] [MAIN      ] ATHS: Starting full primary refresh.
[2025-10-24T17:20:05.665026] [INFO ] [REMOTE    ] ATHS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:20:05.747677] [INFO ] [REMOTE    ] ATHS: Fetching primary data for 2025-01.
[2025-10-24T17:20:06.539277] [INFO ] [REMOTE    ] ASX: Incremental fetch complete for 2025-10 (2.39 seconds).
[2025-10-24T17:20:06.548475] [INFO ] [REMOTE    ] ATGE: Fetching primary data for 2025-10.
[2025-10-24T17:20:06.549720] [INFO ] [REMOTE    ] ASX: Full fetch complete (76790 records).
[2025-10-24T17:20:06.549814] [DEBUG] [VALIDATOR ] ASX: Validating primary data.
[2025-10-24T17:20:06.958337] [INFO ] [REMOTE    ] ATHM: Incremental fetch complete for 2025-05 (2.01 seconds).
[2025-10-24T17:20:06.993722] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present.
[2025-10-24T17:20:06.994505] [INFO ] [REMOTE    ] ATHS: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T17:20:06.996913] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed.
[2025-10-24T17:20:06.998040] [INFO ] [MAIN      ] ASX: Fetched primary data is valid.
[2025-10-24T17:20:06.998105] [DEBUG] [LOCAL     ] ASX: Saving primary data.
[2025-10-24T17:20:06.998762] [FATAL] [LOCAL     ] ASX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:20:06.998842] [FATAL] [MAIN      ] ASX: Failed to save primary data.
[2025-10-24T17:20:06.998908] [WARN ] [MAIN      ] ASX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:20:06.998974] [INFO ] [LOCAL     ] ASX: Starting deletion of primary data.
[2025-10-24T17:20:06.999036] [DEBUG] [LOCAL     ] ASX: No primary data file found to delete.
[2025-10-24T17:20:06.999072] [INFO ] [LOCAL     ] ASX: Starting deletion of derivative data.
[2025-10-24T17:20:06.999192] [DEBUG] [LOCAL     ] ASX: Deleted derivative data file.
[2025-10-24T17:20:06.999774] [INFO ] [MAIN      ] Update Progress: 166/2366 symbols completed. ASX took 33.3s. Estimated remaining: 4h 25m 58s. Rate: 8.3 symbols/min
[2025-10-24T17:20:07.166154] [INFO ] [MAIN      ] ATI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:20:07.216060] [DEBUG] [LOCAL     ] ATI: Loaded 51668 existing records from primary storage.
[2025-10-24T17:20:07.216379] [INFO ] [MAIN      ] ATI: Loaded 51668 existing records.
[2025-10-24T17:20:07.352914] [INFO ] [REMOTE    ] ATHS: Fetching primary data for 2025-02.
[2025-10-24T17:20:07.391477] [WARN ] [MAIN      ] ATI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:20:07.392255] [INFO ] [MAIN      ] ATI: Wiping existing primary data before full refresh.
[2025-10-24T17:20:07.392361] [INFO ] [LOCAL     ] ATI: Starting deletion of primary data.
[2025-10-24T17:20:07.393147] [DEBUG] [LOCAL     ] ATI: Deleted primary data file.
[2025-10-24T17:20:07.393206] [INFO ] [MAIN      ] ATI: Starting full primary refresh.
[2025-10-24T17:20:07.752710] [INFO ] [REMOTE    ] ATI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:20:07.850736] [INFO ] [REMOTE    ] ATGE: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T17:20:07.855602] [INFO ] [REMOTE    ] ATGE: Full fetch complete (45386 records).
[2025-10-24T17:20:07.855793] [DEBUG] [VALIDATOR ] ATGE: Validating primary data.
[2025-10-24T17:20:08.124272] [INFO ] [REMOTE    ] ATHS: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T17:20:08.153341] [INFO ] [REMOTE    ] ATHM: Fetching primary data for 2025-06.
[2025-10-24T17:20:08.268442] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present.
[2025-10-24T17:20:08.268518] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed.
[2025-10-24T17:20:08.269024] [INFO ] [MAIN      ] ATGE: Fetched primary data is valid.
[2025-10-24T17:20:08.269084] [DEBUG] [LOCAL     ] ATGE: Saving primary data.
[2025-10-24T17:20:08.269446] [FATAL] [LOCAL     ] ATGE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:20:08.269544] [FATAL] [MAIN      ] ATGE: Failed to save primary data.
[2025-10-24T17:20:08.269616] [WARN ] [MAIN      ] ATGE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:20:08.269721] [INFO ] [LOCAL     ] ATGE: Starting deletion of primary data.
[2025-10-24T17:20:08.269789] [DEBUG] [LOCAL     ] ATGE: No primary data file found to delete.
[2025-10-24T17:20:08.269825] [INFO ] [LOCAL     ] ATGE: Starting deletion of derivative data.
[2025-10-24T17:20:08.269965] [DEBUG] [LOCAL     ] ATGE: Deleted derivative data file.
[2025-10-24T17:20:08.270037] [INFO ] [MAIN      ] Update Progress: 167/2366 symbols completed. ATGE took 26.8s. Estimated remaining: 4h 24m 32s. Rate: 8.3 symbols/min
[2025-10-24T17:20:08.435081] [INFO ] [MAIN      ] ATKR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:20:08.468697] [DEBUG] [LOCAL     ] ATKR: Loaded 35023 existing records from primary storage.
[2025-10-24T17:20:08.468956] [INFO ] [MAIN      ] ATKR: Loaded 35023 existing records.
[2025-10-24T17:20:08.642193] [WARN ] [MAIN      ] ATKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:20:08.642390] [INFO ] [MAIN      ] ATKR: Wiping existing primary data before full refresh.
[2025-10-24T17:20:08.642442] [INFO ] [LOCAL     ] ATKR: Starting deletion of primary data.
[2025-10-24T17:20:08.643069] [DEBUG] [LOCAL     ] ATKR: Deleted primary data file.
[2025-10-24T17:20:08.643126] [INFO ] [MAIN      ] ATKR: Starting full primary refresh.
[2025-10-24T17:20:08.953276] [INFO ] [REMOTE    ] ATI: Fetching primary data for 2025-01.
[2025-10-24T17:20:08.994937] [INFO ] [REMOTE    ] ATKR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:20:09.554559] [INFO ] [REMOTE    ] ATHM: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T17:20:09.747689] [INFO ] [REMOTE    ] ATHS: Fetching primary data for 2025-03.
[2025-10-24T17:20:10.504503] [INFO ] [REMOTE    ] ATI: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T17:20:10.504738] [INFO ] [REMOTE    ] ATHS: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T17:20:10.547605] [INFO ] [REMOTE    ] ATI: Fetching primary data for 2025-02.
[2025-10-24T17:20:11.347628] [INFO ] [REMOTE    ] ATHS: Fetching primary data for 2025-04.
[2025-10-24T17:20:11.779955] [INFO ] [REMOTE    ] ATI: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T17:20:12.147697] [INFO ] [REMOTE    ] ATHM: Fetching primary data for 2025-07.
[2025-10-24T17:20:12.204369] [INFO ] [REMOTE    ] ATHS: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T17:20:12.947701] [INFO ] [REMOTE    ] ATHS: Fetching primary data for 2025-05.
[2025-10-24T17:20:13.328302] [INFO ] [REMOTE    ] ATHM: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T17:20:13.407841] [INFO ] [REMOTE    ] ATHS: Incremental fetch complete for 2025-05 (0.46 seconds).
[2025-10-24T17:20:13.747636] [INFO ] [REMOTE    ] ATKR: Fetching primary data for 2025-01.
[2025-10-24T17:20:14.547691] [INFO ] [REMOTE    ] ATHM: Fetching primary data for 2025-08.
[2025-10-24T17:20:15.324934] [INFO ] [REMOTE    ] ATKR: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T17:20:15.347597] [INFO ] [REMOTE    ] ATKR: Fetching primary data for 2025-02.
[2025-10-24T17:20:15.864740] [INFO ] [REMOTE    ] ATHM: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T17:20:16.147706] [INFO ] [REMOTE    ] ATI: Fetching primary data for 2025-03.
[2025-10-24T17:20:16.771522] [INFO ] [REMOTE    ] ATKR: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T17:20:16.947757] [INFO ] [REMOTE    ] ATHS: Fetching primary data for 2025-06.
[2025-10-24T17:20:17.608806] [INFO ] [REMOTE    ] ATHS: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T17:20:17.686931] [INFO ] [REMOTE    ] ATI: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T17:20:17.747738] [INFO ] [REMOTE    ] ATI: Fetching primary data for 2025-04.
[2025-10-24T17:20:18.547723] [INFO ] [REMOTE    ] ATHS: Fetching primary data for 2025-07.
[2025-10-24T17:20:18.970670] [INFO ] [REMOTE    ] ATHS: Incremental fetch complete for 2025-07 (0.42 seconds).
[2025-10-24T17:20:19.339723] [INFO ] [REMOTE    ] ATI: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T17:20:19.350067] [INFO ] [REMOTE    ] ATHM: Fetching primary data for 2025-09.
[2025-10-24T17:20:20.147703] [INFO ] [REMOTE    ] ATKR: Fetching primary data for 2025-03.
[2025-10-24T17:20:20.334911] [INFO ] [REMOTE    ] ATHM: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T17:20:20.947694] [INFO ] [REMOTE    ] ATHM: Fetching primary data for 2025-10.
[2025-10-24T17:20:21.747675] [INFO ] [REMOTE    ] ATHS: Fetching primary data for 2025-08.
[2025-10-24T17:20:22.183308] [INFO ] [REMOTE    ] ATHS: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T17:20:22.242514] [INFO ] [REMOTE    ] ATKR: Incremental fetch complete for 2025-03 (2.09 seconds).
[2025-10-24T17:20:22.423121] [INFO ] [REMOTE    ] ATHM: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T17:20:22.428582] [INFO ] [REMOTE    ] ATHM: Full fetch complete (49253 records).
[2025-10-24T17:20:22.428747] [DEBUG] [VALIDATOR ] ATHM: Validating primary data.
[2025-10-24T17:20:22.552828] [INFO ] [REMOTE    ] ATI: Fetching primary data for 2025-05.
[2025-10-24T17:20:22.819408] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present.
[2025-10-24T17:20:22.819553] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed.
[2025-10-24T17:20:22.820454] [INFO ] [MAIN      ] ATHM: Fetched primary data is valid.
[2025-10-24T17:20:22.820533] [DEBUG] [LOCAL     ] ATHM: Saving primary data.
[2025-10-24T17:20:22.821119] [FATAL] [LOCAL     ] ATHM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:20:22.821224] [FATAL] [MAIN      ] ATHM: Failed to save primary data.
[2025-10-24T17:20:22.821294] [WARN ] [MAIN      ] ATHM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:20:22.821378] [INFO ] [LOCAL     ] ATHM: Starting deletion of primary data.
[2025-10-24T17:20:22.821470] [DEBUG] [LOCAL     ] ATHM: No primary data file found to delete.
[2025-10-24T17:20:22.821537] [INFO ] [LOCAL     ] ATHM: Starting deletion of derivative data.
[2025-10-24T17:20:22.821730] [DEBUG] [LOCAL     ] ATHM: Deleted derivative data file.
[2025-10-24T17:20:22.821826] [INFO ] [MAIN      ] Update Progress: 168/2366 symbols completed. ATHM took 38.5s. Estimated remaining: 4h 26m 1s. Rate: 8.3 symbols/min
[2025-10-24T17:20:23.006287] [INFO ] [MAIN      ] ATMU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:20:23.043239] [DEBUG] [LOCAL     ] ATMU: Loaded 38930 existing records from primary storage.
[2025-10-24T17:20:23.043546] [INFO ] [MAIN      ] ATMU: Loaded 38930 existing records.
[2025-10-24T17:20:23.218937] [WARN ] [MAIN      ] ATMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:20:23.219160] [INFO ] [MAIN      ] ATMU: Wiping existing primary data before full refresh.
[2025-10-24T17:20:23.219206] [INFO ] [LOCAL     ] ATMU: Starting deletion of primary data.
[2025-10-24T17:20:23.219871] [DEBUG] [LOCAL     ] ATMU: Deleted primary data file.
[2025-10-24T17:20:23.219928] [INFO ] [MAIN      ] ATMU: Starting full primary refresh.
[2025-10-24T17:20:23.360059] [INFO ] [REMOTE    ] ATHS: Fetching primary data for 2025-09.
[2025-10-24T17:20:23.580631] [INFO ] [REMOTE    ] ATMU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:20:24.092417] [INFO ] [REMOTE    ] ATHS: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T17:20:24.147727] [INFO ] [REMOTE    ] ATKR: Fetching primary data for 2025-04.
[2025-10-24T17:20:24.306889] [INFO ] [REMOTE    ] ATI: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T17:20:24.947693] [INFO ] [REMOTE    ] ATMU: Fetching primary data for 2025-01.
[2025-10-24T17:20:25.451305] [INFO ] [REMOTE    ] ATKR: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T17:20:25.747693] [INFO ] [REMOTE    ] ATI: Fetching primary data for 2025-06.
[2025-10-24T17:20:26.247372] [INFO ] [REMOTE    ] ATMU: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T17:20:26.547710] [INFO ] [REMOTE    ] ATKR: Fetching primary data for 2025-05.
[2025-10-24T17:20:27.347623] [INFO ] [REMOTE    ] ATMU: Fetching primary data for 2025-02.
[2025-10-24T17:20:27.465245] [INFO ] [REMOTE    ] ATI: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T17:20:27.811767] [INFO ] [REMOTE    ] ATKR: Incremental fetch complete for 2025-05 (1.26 seconds).
[2025-10-24T17:20:28.147690] [INFO ] [REMOTE    ] ATI: Fetching primary data for 2025-07.
[2025-10-24T17:20:28.560629] [INFO ] [REMOTE    ] ATMU: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T17:20:28.947625] [INFO ] [REMOTE    ] ATMU: Fetching primary data for 2025-03.
[2025-10-24T17:20:29.403678] [INFO ] [REMOTE    ] ATI: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T17:20:29.747685] [INFO ] [REMOTE    ] ATI: Fetching primary data for 2025-08.
[2025-10-24T17:20:30.079935] [INFO ] [REMOTE    ] ATMU: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T17:20:30.547702] [INFO ] [REMOTE    ] ATMU: Fetching primary data for 2025-04.
[2025-10-24T17:20:31.347632] [INFO ] [REMOTE    ] ATHS: Fetching primary data for 2025-10.
[2025-10-24T17:20:31.511736] [INFO ] [REMOTE    ] ATI: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T17:20:31.998369] [INFO ] [REMOTE    ] ATHS: Incremental fetch complete for 2025-10 (0.65 seconds).
[2025-10-24T17:20:32.000050] [INFO ] [REMOTE    ] ATHS: Full fetch complete (9556 records).
[2025-10-24T17:20:32.000190] [DEBUG] [VALIDATOR ] ATHS: Validating primary data.
[2025-10-24T17:20:32.159159] [INFO ] [REMOTE    ] ATI: Fetching primary data for 2025-09.
[2025-10-24T17:20:32.303767] [INFO ] [REMOTE    ] ATMU: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T17:20:32.406877] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present.
[2025-10-24T17:20:32.406950] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed.
[2025-10-24T17:20:32.407178] [INFO ] [MAIN      ] ATHS: Fetched primary data is valid.
[2025-10-24T17:20:32.407218] [DEBUG] [LOCAL     ] ATHS: Saving primary data.
[2025-10-24T17:20:32.407452] [FATAL] [LOCAL     ] ATHS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:20:32.407535] [FATAL] [MAIN      ] ATHS: Failed to save primary data.
[2025-10-24T17:20:32.407605] [WARN ] [MAIN      ] ATHS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:20:32.407697] [INFO ] [LOCAL     ] ATHS: Starting deletion of primary data.
[2025-10-24T17:20:32.407758] [DEBUG] [LOCAL     ] ATHS: No primary data file found to delete.
[2025-10-24T17:20:32.407795] [INFO ] [LOCAL     ] ATHS: Starting deletion of derivative data.
[2025-10-24T17:20:32.407919] [DEBUG] [LOCAL     ] ATHS: Deleted derivative data file.
[2025-10-24T17:20:32.407988] [INFO ] [MAIN      ] Update Progress: 169/2366 symbols completed. ATHS took 27.5s. Estimated remaining: 4h 26m 24s. Rate: 8.2 symbols/min
[2025-10-24T17:20:32.577281] [INFO ] [MAIN      ] ATO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:20:32.617505] [DEBUG] [LOCAL     ] ATO: Loaded 41787 existing records from primary storage.
[2025-10-24T17:20:32.617849] [INFO ] [MAIN      ] ATO: Loaded 41787 existing records.
[2025-10-24T17:20:32.793226] [WARN ] [MAIN      ] ATO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:20:32.793423] [INFO ] [MAIN      ] ATO: Wiping existing primary data before full refresh.
[2025-10-24T17:20:32.793467] [INFO ] [LOCAL     ] ATO: Starting deletion of primary data.
[2025-10-24T17:20:32.794277] [DEBUG] [LOCAL     ] ATO: Deleted primary data file.
[2025-10-24T17:20:32.794335] [INFO ] [MAIN      ] ATO: Starting full primary refresh.
[2025-10-24T17:20:32.949677] [INFO ] [REMOTE    ] ATMU: Fetching primary data for 2025-05.
[2025-10-24T17:20:33.156700] [INFO ] [REMOTE    ] ATO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:20:33.615298] [INFO ] [REMOTE    ] ATI: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T17:20:33.747611] [INFO ] [REMOTE    ] ATO: Fetching primary data for 2025-01.
[2025-10-24T17:20:34.547614] [INFO ] [REMOTE    ] ATI: Fetching primary data for 2025-10.
[2025-10-24T17:20:34.585086] [INFO ] [REMOTE    ] ATMU: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T17:20:35.197861] [INFO ] [REMOTE    ] ATO: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T17:20:35.347716] [INFO ] [REMOTE    ] ATMU: Fetching primary data for 2025-06.
[2025-10-24T17:20:36.147724] [INFO ] [REMOTE    ] ATO: Fetching primary data for 2025-02.
[2025-10-24T17:20:36.249901] [INFO ] [REMOTE    ] ATI: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T17:20:36.258863] [INFO ] [REMOTE    ] ATI: Full fetch complete (74125 records).
[2025-10-24T17:20:36.258992] [DEBUG] [VALIDATOR ] ATI: Validating primary data.
[2025-10-24T17:20:36.647024] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present.
[2025-10-24T17:20:36.647133] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed.
[2025-10-24T17:20:36.648199] [INFO ] [MAIN      ] ATI: Fetched primary data is valid.
[2025-10-24T17:20:36.648319] [DEBUG] [LOCAL     ] ATI: Saving primary data.
[2025-10-24T17:20:36.649145] [FATAL] [LOCAL     ] ATI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:20:36.649251] [FATAL] [MAIN      ] ATI: Failed to save primary data.
[2025-10-24T17:20:36.649294] [WARN ] [MAIN      ] ATI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:20:36.649355] [INFO ] [LOCAL     ] ATI: Starting deletion of primary data.
[2025-10-24T17:20:36.649418] [DEBUG] [LOCAL     ] ATI: No primary data file found to delete.
[2025-10-24T17:20:36.649498] [INFO ] [LOCAL     ] ATI: Starting deletion of derivative data.
[2025-10-24T17:20:36.649669] [DEBUG] [LOCAL     ] ATI: Deleted derivative data file.
[2025-10-24T17:20:36.649928] [INFO ] [MAIN      ] Update Progress: 170/2366 symbols completed. ATI took 29.7s. Estimated remaining: 4h 25m 37s. Rate: 8.3 symbols/min
[2025-10-24T17:20:36.823713] [INFO ] [MAIN      ] ATR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:20:36.856177] [DEBUG] [LOCAL     ] ATR: Loaded 30587 existing records from primary storage.
[2025-10-24T17:20:36.856441] [INFO ] [MAIN      ] ATR: Loaded 30587 existing records.
[2025-10-24T17:20:36.953933] [INFO ] [REMOTE    ] ATKR: Fetching primary data for 2025-06.
[2025-10-24T17:20:37.016712] [INFO ] [REMOTE    ] ATMU: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T17:20:37.066200] [WARN ] [MAIN      ] ATR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:20:37.066394] [INFO ] [MAIN      ] ATR: Wiping existing primary data before full refresh.
[2025-10-24T17:20:37.066440] [INFO ] [LOCAL     ] ATR: Starting deletion of primary data.
[2025-10-24T17:20:37.067194] [DEBUG] [LOCAL     ] ATR: Deleted primary data file.
[2025-10-24T17:20:37.067251] [INFO ] [MAIN      ] ATR: Starting full primary refresh.
[2025-10-24T17:20:37.417900] [INFO ] [REMOTE    ] ATR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:20:37.665949] [INFO ] [REMOTE    ] ATO: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T17:20:37.747707] [INFO ] [REMOTE    ] ATMU: Fetching primary data for 2025-07.
[2025-10-24T17:20:37.945296] [INFO ] [REMOTE    ] ATKR: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T17:20:38.547753] [INFO ] [REMOTE    ] ATKR: Fetching primary data for 2025-07.
[2025-10-24T17:20:39.187804] [INFO ] [REMOTE    ] ATMU: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T17:20:39.347619] [INFO ] [REMOTE    ] ATMU: Fetching primary data for 2025-08.
[2025-10-24T17:20:39.421439] [INFO ] [REMOTE    ] ATKR: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T17:20:40.147691] [INFO ] [REMOTE    ] ATR: Fetching primary data for 2025-01.
[2025-10-24T17:20:40.531243] [INFO ] [REMOTE    ] ATMU: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T17:20:40.947693] [INFO ] [REMOTE    ] ATKR: Fetching primary data for 2025-08.
[2025-10-24T17:20:41.394714] [INFO ] [REMOTE    ] ATR: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T17:20:41.747699] [INFO ] [REMOTE    ] ATO: Fetching primary data for 2025-03.
[2025-10-24T17:20:42.353017] [INFO ] [REMOTE    ] ATKR: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T17:20:42.547621] [INFO ] [REMOTE    ] ATKR: Fetching primary data for 2025-09.
[2025-10-24T17:20:43.352740] [INFO ] [REMOTE    ] ATMU: Fetching primary data for 2025-09.
[2025-10-24T17:20:43.367835] [INFO ] [REMOTE    ] ATO: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T17:20:43.956554] [INFO ] [REMOTE    ] ATKR: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T17:20:44.147637] [INFO ] [REMOTE    ] ATR: Fetching primary data for 2025-02.
[2025-10-24T17:20:44.516718] [INFO ] [REMOTE    ] ATMU: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T17:20:44.947610] [INFO ] [REMOTE    ] ATKR: Fetching primary data for 2025-10.
[2025-10-24T17:20:44.973892] [INFO ] [REMOTE    ] ATR: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T17:20:45.747735] [INFO ] [REMOTE    ] ATO: Fetching primary data for 2025-04.
[2025-10-24T17:20:46.318627] [INFO ] [REMOTE    ] ATKR: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T17:20:46.324931] [INFO ] [REMOTE    ] ATKR: Full fetch complete (53128 records).
[2025-10-24T17:20:46.325033] [DEBUG] [VALIDATOR ] ATKR: Validating primary data.
[2025-10-24T17:20:46.554155] [INFO ] [REMOTE    ] ATR: Fetching primary data for 2025-03.
[2025-10-24T17:20:46.699359] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present.
[2025-10-24T17:20:46.699430] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed.
[2025-10-24T17:20:46.700015] [INFO ] [MAIN      ] ATKR: Fetched primary data is valid.
[2025-10-24T17:20:46.700076] [DEBUG] [LOCAL     ] ATKR: Saving primary data.
[2025-10-24T17:20:46.700479] [FATAL] [LOCAL     ] ATKR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:20:46.700589] [FATAL] [MAIN      ] ATKR: Failed to save primary data.
[2025-10-24T17:20:46.700630] [WARN ] [MAIN      ] ATKR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:20:46.700705] [INFO ] [LOCAL     ] ATKR: Starting deletion of primary data.
[2025-10-24T17:20:46.700763] [DEBUG] [LOCAL     ] ATKR: No primary data file found to delete.
[2025-10-24T17:20:46.700798] [INFO ] [LOCAL     ] ATKR: Starting deletion of derivative data.
[2025-10-24T17:20:46.700966] [DEBUG] [LOCAL     ] ATKR: Deleted derivative data file.
[2025-10-24T17:20:46.701189] [INFO ] [MAIN      ] Update Progress: 171/2366 symbols completed. ATKR took 38.4s. Estimated remaining: 4h 26m 6s. Rate: 8.2 symbols/min
[2025-10-24T17:20:46.868828] [INFO ] [MAIN      ] ATS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:20:46.886604] [DEBUG] [LOCAL     ] ATS: Loaded 17109 existing records from primary storage.
[2025-10-24T17:20:46.886860] [INFO ] [MAIN      ] ATS: Loaded 17109 existing records.
[2025-10-24T17:20:47.064628] [WARN ] [MAIN      ] ATS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:20:47.064883] [INFO ] [MAIN      ] ATS: Wiping existing primary data before full refresh.
[2025-10-24T17:20:47.065040] [INFO ] [LOCAL     ] ATS: Starting deletion of primary data.
[2025-10-24T17:20:47.065545] [DEBUG] [LOCAL     ] ATS: Deleted primary data file.
[2025-10-24T17:20:47.065606] [INFO ] [MAIN      ] ATS: Starting full primary refresh.
[2025-10-24T17:20:47.302191] [INFO ] [REMOTE    ] ATO: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T17:20:47.364570] [INFO ] [REMOTE    ] ATMU: Fetching primary data for 2025-10.
[2025-10-24T17:20:47.460767] [INFO ] [REMOTE    ] ATS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:20:47.629150] [INFO ] [REMOTE    ] ATR: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T17:20:48.147737] [INFO ] [REMOTE    ] ATO: Fetching primary data for 2025-05.
[2025-10-24T17:20:48.705600] [INFO ] [REMOTE    ] ATMU: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T17:20:48.712399] [INFO ] [REMOTE    ] ATMU: Full fetch complete (56727 records).
[2025-10-24T17:20:48.712512] [DEBUG] [VALIDATOR ] ATMU: Validating primary data.
[2025-10-24T17:20:48.957324] [INFO ] [REMOTE    ] ATR: Fetching primary data for 2025-04.
[2025-10-24T17:20:49.099898] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present.
[2025-10-24T17:20:49.099987] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed.
[2025-10-24T17:20:49.100611] [INFO ] [MAIN      ] ATMU: Fetched primary data is valid.
[2025-10-24T17:20:49.100677] [DEBUG] [LOCAL     ] ATMU: Saving primary data.
[2025-10-24T17:20:49.101149] [FATAL] [LOCAL     ] ATMU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:20:49.101231] [FATAL] [MAIN      ] ATMU: Failed to save primary data.
[2025-10-24T17:20:49.101272] [WARN ] [MAIN      ] ATMU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:20:49.101326] [INFO ] [LOCAL     ] ATMU: Starting deletion of primary data.
[2025-10-24T17:20:49.101403] [DEBUG] [LOCAL     ] ATMU: No primary data file found to delete.
[2025-10-24T17:20:49.101462] [INFO ] [LOCAL     ] ATMU: Starting deletion of derivative data.
[2025-10-24T17:20:49.101639] [DEBUG] [LOCAL     ] ATMU: Deleted derivative data file.
[2025-10-24T17:20:49.102231] [INFO ] [MAIN      ] Update Progress: 172/2366 symbols completed. ATMU took 26.3s. Estimated remaining: 4h 24m 56s. Rate: 8.3 symbols/min
[2025-10-24T17:20:49.280195] [INFO ] [MAIN      ] ATUS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:20:49.324826] [DEBUG] [LOCAL     ] ATUS: Loaded 50328 existing records from primary storage.
[2025-10-24T17:20:49.325149] [INFO ] [MAIN      ] ATUS: Loaded 50328 existing records.
[2025-10-24T17:20:49.502790] [WARN ] [MAIN      ] ATUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:20:49.503038] [INFO ] [MAIN      ] ATUS: Wiping existing primary data before full refresh.
[2025-10-24T17:20:49.503087] [INFO ] [LOCAL     ] ATUS: Starting deletion of primary data.
[2025-10-24T17:20:49.503870] [DEBUG] [LOCAL     ] ATUS: Deleted primary data file.
[2025-10-24T17:20:49.503935] [INFO ] [MAIN      ] ATUS: Starting full primary refresh.
[2025-10-24T17:20:49.752762] [INFO ] [REMOTE    ] ATS: Fetching primary data for 2025-01.
[2025-10-24T17:20:49.872008] [INFO ] [REMOTE    ] ATUS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:20:49.899825] [INFO ] [REMOTE    ] ATO: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T17:20:49.928574] [INFO ] [REMOTE    ] ATR: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T17:20:50.547697] [INFO ] [REMOTE    ] ATO: Fetching primary data for 2025-06.
[2025-10-24T17:20:50.577957] [INFO ] [REMOTE    ] ATS: Incremental fetch complete for 2025-01 (0.83 seconds).
[2025-10-24T17:20:51.347726] [INFO ] [REMOTE    ] ATUS: Fetching primary data for 2025-01.
[2025-10-24T17:20:51.884883] [INFO ] [REMOTE    ] ATO: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T17:20:52.147698] [INFO ] [REMOTE    ] ATO: Fetching primary data for 2025-07.
[2025-10-24T17:20:52.926983] [INFO ] [REMOTE    ] ATUS: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T17:20:52.947615] [INFO ] [REMOTE    ] ATUS: Fetching primary data for 2025-02.
[2025-10-24T17:20:53.159197] [INFO ] [REMOTE    ] ATO: Incremental fetch complete for 2025-07 (1.01 seconds).
[2025-10-24T17:20:53.747709] [INFO ] [REMOTE    ] ATS: Fetching primary data for 2025-02.
[2025-10-24T17:20:53.907669] [INFO ] [REMOTE    ] ATUS: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T17:20:54.547628] [INFO ] [REMOTE    ] ATUS: Fetching primary data for 2025-03.
[2025-10-24T17:20:54.845236] [INFO ] [REMOTE    ] ATS: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T17:20:55.347705] [INFO ] [REMOTE    ] ATR: Fetching primary data for 2025-05.
[2025-10-24T17:20:55.754162] [INFO ] [REMOTE    ] ATUS: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T17:20:56.147729] [INFO ] [REMOTE    ] ATUS: Fetching primary data for 2025-04.
[2025-10-24T17:20:56.476344] [INFO ] [REMOTE    ] ATR: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T17:20:56.947708] [INFO ] [REMOTE    ] ATS: Fetching primary data for 2025-03.
[2025-10-24T17:20:57.695390] [INFO ] [REMOTE    ] ATUS: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T17:20:57.717125] [INFO ] [REMOTE    ] ATS: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T17:20:57.747614] [INFO ] [REMOTE    ] ATS: Fetching primary data for 2025-04.
[2025-10-24T17:20:58.369410] [INFO ] [REMOTE    ] ATS: Incremental fetch complete for 2025-04 (0.62 seconds).
[2025-10-24T17:20:58.547704] [INFO ] [REMOTE    ] ATR: Fetching primary data for 2025-06.
[2025-10-24T17:20:59.347626] [INFO ] [REMOTE    ] ATS: Fetching primary data for 2025-05.
[2025-10-24T17:20:59.404749] [INFO ] [REMOTE    ] ATR: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T17:21:00.147721] [INFO ] [REMOTE    ] ATUS: Fetching primary data for 2025-05.
[2025-10-24T17:21:00.268541] [INFO ] [REMOTE    ] ATS: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T17:21:00.947689] [INFO ] [REMOTE    ] ATR: Fetching primary data for 2025-07.
[2025-10-24T17:21:01.747701] [INFO ] [REMOTE    ] ATO: Fetching primary data for 2025-08.
[2025-10-24T17:21:02.547749] [INFO ] [REMOTE    ] ATS: Fetching primary data for 2025-06.
[2025-10-24T17:21:03.322260] [INFO ] [REMOTE    ] ATS: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T17:21:03.347603] [INFO ] [REMOTE    ] ATS: Fetching primary data for 2025-07.
[2025-10-24T17:21:04.441948] [INFO ] [REMOTE    ] ATS: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T17:21:04.447106] [INFO ] [REMOTE    ] ATS: Fetching primary data for 2025-08.
[2025-10-24T17:21:05.680044] [INFO ] [REMOTE    ] ATS: Incremental fetch complete for 2025-08 (1.23 seconds).
[2025-10-24T17:21:05.684297] [INFO ] [REMOTE    ] ATS: Fetching primary data for 2025-09.
[2025-10-24T17:21:06.198269] [INFO ] [REMOTE    ] ATR: Incremental fetch complete for 2025-07 (5.25 seconds).
[2025-10-24T17:21:06.204973] [INFO ] [REMOTE    ] ATR: Fetching primary data for 2025-08.
[2025-10-24T17:21:06.339353] [INFO ] [REMOTE    ] ATO: Incremental fetch complete for 2025-08 (4.59 seconds).
[2025-10-24T17:21:06.380976] [INFO ] [REMOTE    ] ATS: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T17:21:06.489526] [INFO ] [REMOTE    ] ATUS: Incremental fetch complete for 2025-05 (6.34 seconds).
[2025-10-24T17:21:06.547682] [INFO ] [REMOTE    ] ATUS: Fetching primary data for 2025-06.
[2025-10-24T17:21:07.347632] [INFO ] [REMOTE    ] ATO: Fetching primary data for 2025-09.
[2025-10-24T17:21:07.756721] [INFO ] [REMOTE    ] ATR: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T17:21:08.152419] [INFO ] [REMOTE    ] ATR: Fetching primary data for 2025-09.
[2025-10-24T17:21:08.161375] [INFO ] [REMOTE    ] ATUS: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T17:21:08.584162] [INFO ] [REMOTE    ] ATO: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T17:21:08.947695] [INFO ] [REMOTE    ] ATUS: Fetching primary data for 2025-07.
[2025-10-24T17:21:09.571564] [INFO ] [REMOTE    ] ATR: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T17:21:09.747678] [INFO ] [REMOTE    ] ATO: Fetching primary data for 2025-10.
[2025-10-24T17:21:10.547615] [INFO ] [REMOTE    ] ATR: Fetching primary data for 2025-10.
[2025-10-24T17:21:10.655190] [INFO ] [REMOTE    ] ATUS: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T17:21:11.347672] [INFO ] [REMOTE    ] ATUS: Fetching primary data for 2025-08.
[2025-10-24T17:21:11.611909] [INFO ] [REMOTE    ] ATO: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T17:21:11.619255] [INFO ] [REMOTE    ] ATO: Full fetch complete (60645 records).
[2025-10-24T17:21:11.619400] [DEBUG] [VALIDATOR ] ATO: Validating primary data.
[2025-10-24T17:21:11.968283] [INFO ] [REMOTE    ] ATR: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T17:21:12.033137] [INFO ] [REMOTE    ] ATR: Full fetch complete (43932 records).
[2025-10-24T17:21:12.044057] [DEBUG] [VALIDATOR ] ATR: Validating primary data.
[2025-10-24T17:21:12.149493] [INFO ] [REMOTE    ] ATS: Fetching primary data for 2025-10.
[2025-10-24T17:21:12.143601] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present.
[2025-10-24T17:21:12.183389] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed.
[2025-10-24T17:21:12.184357] [INFO ] [MAIN      ] ATO: Fetched primary data is valid.
[2025-10-24T17:21:12.184441] [DEBUG] [LOCAL     ] ATO: Saving primary data.
[2025-10-24T17:21:12.185033] [FATAL] [LOCAL     ] ATO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:21:12.196054] [FATAL] [MAIN      ] ATO: Failed to save primary data.
[2025-10-24T17:21:12.201268] [WARN ] [MAIN      ] ATO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:21:12.211572] [INFO ] [LOCAL     ] ATO: Starting deletion of primary data.
[2025-10-24T17:21:12.241676] [DEBUG] [LOCAL     ] ATO: No primary data file found to delete.
[2025-10-24T17:21:12.265044] [INFO ] [LOCAL     ] ATO: Starting deletion of derivative data.
[2025-10-24T17:21:12.345391] [DEBUG] [LOCAL     ] ATO: Deleted derivative data file.
[2025-10-24T17:21:12.356953] [INFO ] [MAIN      ] Update Progress: 173/2366 symbols completed. ATO took 39.9s. Estimated remaining: 4h 28m 12s. Rate: 8.2 symbols/min
[2025-10-24T17:21:12.617853] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present.
[2025-10-24T17:21:12.637842] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed.
[2025-10-24T17:21:12.637780] [INFO ] [MAIN      ] AU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:21:12.638438] [INFO ] [MAIN      ] ATR: Fetched primary data is valid.
[2025-10-24T17:21:12.638517] [DEBUG] [LOCAL     ] ATR: Saving primary data.
[2025-10-24T17:21:12.639295] [FATAL] [LOCAL     ] ATR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:21:12.639924] [FATAL] [MAIN      ] ATR: Failed to save primary data.
[2025-10-24T17:21:12.639994] [WARN ] [MAIN      ] ATR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:21:12.640041] [INFO ] [LOCAL     ] ATR: Starting deletion of primary data.
[2025-10-24T17:21:12.640094] [DEBUG] [LOCAL     ] ATR: No primary data file found to delete.
[2025-10-24T17:21:12.640129] [INFO ] [LOCAL     ] ATR: Starting deletion of derivative data.
[2025-10-24T17:21:12.640271] [DEBUG] [LOCAL     ] ATR: Deleted derivative data file.
[2025-10-24T17:21:12.640370] [INFO ] [MAIN      ] Update Progress: 174/2366 symbols completed. ATR took 36.0s. Estimated remaining: 4h 26m 36s. Rate: 8.2 symbols/min
[2025-10-24T17:21:12.818230] [INFO ] [MAIN      ] AUB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:21:12.870745] [DEBUG] [LOCAL     ] AU: Loaded 53478 existing records from primary storage.
[2025-10-24T17:21:12.887132] [INFO ] [MAIN      ] AU: Loaded 53478 existing records.
[2025-10-24T17:21:12.910158] [INFO ] [REMOTE    ] ATUS: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T17:21:13.003480] [INFO ] [REMOTE    ] ATUS: Fetching primary data for 2025-09.
[2025-10-24T17:21:13.063414] [DEBUG] [LOCAL     ] AUB: Loaded 46182 existing records from primary storage.
[2025-10-24T17:21:13.122555] [INFO ] [MAIN      ] AUB: Loaded 46182 existing records.
[2025-10-24T17:21:13.122213] [WARN ] [MAIN      ] AU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:21:13.134173] [INFO ] [MAIN      ] AU: Wiping existing primary data before full refresh.
[2025-10-24T17:21:13.180024] [INFO ] [LOCAL     ] AU: Starting deletion of primary data.
[2025-10-24T17:21:13.218417] [INFO ] [REMOTE    ] ATS: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T17:21:13.236470] [DEBUG] [LOCAL     ] AU: Deleted primary data file.
[2025-10-24T17:21:13.239343] [INFO ] [MAIN      ] AU: Starting full primary refresh.
[2025-10-24T17:21:13.310953] [INFO ] [REMOTE    ] ATS: Full fetch complete (25444 records).
[2025-10-24T17:21:13.338140] [DEBUG] [VALIDATOR ] ATS: Validating primary data.
[2025-10-24T17:21:13.451525] [WARN ] [MAIN      ] AUB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:21:13.479517] [INFO ] [MAIN      ] AUB: Wiping existing primary data before full refresh.
[2025-10-24T17:21:13.493957] [INFO ] [LOCAL     ] AUB: Starting deletion of primary data.
[2025-10-24T17:21:13.601456] [DEBUG] [LOCAL     ] AUB: Deleted primary data file.
[2025-10-24T17:21:13.637563] [INFO ] [MAIN      ] AUB: Starting full primary refresh.
[2025-10-24T17:21:14.152925] [INFO ] [REMOTE    ] AU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:21:14.186639] [INFO ] [REMOTE    ] AU: Fetching primary data for 2025-01.
[2025-10-24T17:21:14.382058] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present.
[2025-10-24T17:21:14.382470] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed.
[2025-10-24T17:21:14.388278] [INFO ] [MAIN      ] ATS: Fetched primary data is valid.
[2025-10-24T17:21:14.393462] [DEBUG] [LOCAL     ] ATS: Saving primary data.
[2025-10-24T17:21:14.427204] [FATAL] [LOCAL     ] ATS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:21:14.462627] [INFO ] [REMOTE    ] AUB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:21:14.458930] [FATAL] [MAIN      ] ATS: Failed to save primary data.
[2025-10-24T17:21:14.463009] [WARN ] [MAIN      ] ATS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:21:14.463114] [INFO ] [LOCAL     ] ATS: Starting deletion of primary data.
[2025-10-24T17:21:14.463272] [DEBUG] [LOCAL     ] ATS: No primary data file found to delete.
[2025-10-24T17:21:14.463327] [INFO ] [LOCAL     ] ATS: Starting deletion of derivative data.
[2025-10-24T17:21:14.463467] [DEBUG] [LOCAL     ] ATS: Deleted derivative data file.
[2025-10-24T17:21:14.463563] [INFO ] [MAIN      ] Update Progress: 175/2366 symbols completed. ATS took 27.8s. Estimated remaining: 4h 25m 20s. Rate: 8.3 symbols/min
[2025-10-24T17:21:14.565848] [INFO ] [REMOTE    ] AUB: Fetching primary data for 2025-01.
[2025-10-24T17:21:14.663326] [INFO ] [MAIN      ] AUNA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:21:14.694273] [INFO ] [REMOTE    ] ATUS: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T17:21:14.697369] [DEBUG] [LOCAL     ] AUNA: Loaded 5285 existing records from primary storage.
[2025-10-24T17:21:14.707561] [INFO ] [MAIN      ] AUNA: Loaded 5285 existing records.
[2025-10-24T17:21:14.886263] [WARN ] [MAIN      ] AUNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:21:14.886483] [INFO ] [MAIN      ] AUNA: Wiping existing primary data before full refresh.
[2025-10-24T17:21:14.886540] [INFO ] [LOCAL     ] AUNA: Starting deletion of primary data.
[2025-10-24T17:21:14.886769] [DEBUG] [LOCAL     ] AUNA: Deleted primary data file.
[2025-10-24T17:21:14.886826] [INFO ] [MAIN      ] AUNA: Starting full primary refresh.
[2025-10-24T17:21:15.243399] [INFO ] [REMOTE    ] AUNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:21:15.347621] [INFO ] [REMOTE    ] AUNA: Fetching primary data for 2025-01.
[2025-10-24T17:21:16.119694] [INFO ] [REMOTE    ] AUNA: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T17:21:16.147603] [INFO ] [REMOTE    ] AUNA: Fetching primary data for 2025-02.
[2025-10-24T17:21:16.355207] [INFO ] [REMOTE    ] AUB: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T17:21:16.392160] [INFO ] [REMOTE    ] AU: Incremental fetch complete for 2025-01 (2.21 seconds).
[2025-10-24T17:21:16.519093] [INFO ] [REMOTE    ] AUNA: Incremental fetch complete for 2025-02 (0.37 seconds).
[2025-10-24T17:21:16.947668] [INFO ] [REMOTE    ] AUNA: Fetching primary data for 2025-03.
[2025-10-24T17:21:17.410522] [INFO ] [REMOTE    ] AUNA: Incremental fetch complete for 2025-03 (0.46 seconds).
[2025-10-24T17:21:17.747713] [INFO ] [REMOTE    ] AUNA: Fetching primary data for 2025-04.
[2025-10-24T17:21:18.356688] [INFO ] [REMOTE    ] AUNA: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T17:21:18.547673] [INFO ] [REMOTE    ] ATUS: Fetching primary data for 2025-10.
[2025-10-24T17:21:19.347752] [INFO ] [REMOTE    ] AUB: Fetching primary data for 2025-02.
[2025-10-24T17:21:20.147726] [INFO ] [REMOTE    ] AUNA: Fetching primary data for 2025-05.
[2025-10-24T17:21:20.340144] [INFO ] [REMOTE    ] ATUS: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T17:21:20.349469] [INFO ] [REMOTE    ] ATUS: Full fetch complete (71477 records).
[2025-10-24T17:21:20.349623] [DEBUG] [VALIDATOR ] ATUS: Validating primary data.
[2025-10-24T17:21:20.766850] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present.
[2025-10-24T17:21:20.767240] [INFO ] [REMOTE    ] AUNA: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T17:21:20.767573] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed.
[2025-10-24T17:21:20.770596] [INFO ] [MAIN      ] ATUS: Fetched primary data is valid.
[2025-10-24T17:21:20.771211] [DEBUG] [LOCAL     ] ATUS: Saving primary data.
[2025-10-24T17:21:20.771846] [FATAL] [LOCAL     ] ATUS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:21:20.771976] [FATAL] [MAIN      ] ATUS: Failed to save primary data.
[2025-10-24T17:21:20.772092] [WARN ] [MAIN      ] ATUS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:21:20.772162] [INFO ] [LOCAL     ] ATUS: Starting deletion of primary data.
[2025-10-24T17:21:20.772226] [DEBUG] [LOCAL     ] ATUS: No primary data file found to delete.
[2025-10-24T17:21:20.772263] [INFO ] [LOCAL     ] ATUS: Starting deletion of derivative data.
[2025-10-24T17:21:20.772387] [DEBUG] [LOCAL     ] ATUS: Deleted derivative data file.
[2025-10-24T17:21:20.772740] [INFO ] [MAIN      ] Update Progress: 176/2366 symbols completed. ATUS took 31.7s. Estimated remaining: 4h 25m 1s. Rate: 8.3 symbols/min
[2025-10-24T17:21:20.948683] [INFO ] [REMOTE    ] AU: Fetching primary data for 2025-02.
[2025-10-24T17:21:20.988308] [INFO ] [REMOTE    ] AUB: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T17:21:21.014088] [INFO ] [MAIN      ] AVA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:21:21.058923] [DEBUG] [LOCAL     ] AVA: Loaded 38535 existing records from primary storage.
[2025-10-24T17:21:21.059203] [INFO ] [MAIN      ] AVA: Loaded 38535 existing records.
[2025-10-24T17:21:21.235071] [WARN ] [MAIN      ] AVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:21:21.235291] [INFO ] [MAIN      ] AVA: Wiping existing primary data before full refresh.
[2025-10-24T17:21:21.235340] [INFO ] [LOCAL     ] AVA: Starting deletion of primary data.
[2025-10-24T17:21:21.236089] [DEBUG] [LOCAL     ] AVA: Deleted primary data file.
[2025-10-24T17:21:21.236146] [INFO ] [MAIN      ] AVA: Starting full primary refresh.
[2025-10-24T17:21:21.595237] [INFO ] [REMOTE    ] AVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:21:21.747708] [INFO ] [REMOTE    ] AVA: Fetching primary data for 2025-01.
[2025-10-24T17:21:22.547682] [INFO ] [REMOTE    ] AUNA: Fetching primary data for 2025-06.
[2025-10-24T17:21:22.758961] [INFO ] [REMOTE    ] AU: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T17:21:22.831021] [INFO ] [REMOTE    ] AVA: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T17:21:22.969791] [INFO ] [REMOTE    ] AUNA: Incremental fetch complete for 2025-06 (0.42 seconds).
[2025-10-24T17:21:23.347632] [INFO ] [REMOTE    ] AUB: Fetching primary data for 2025-03.
[2025-10-24T17:21:24.147723] [INFO ] [REMOTE    ] AU: Fetching primary data for 2025-03.
[2025-10-24T17:21:24.923563] [INFO ] [REMOTE    ] AUB: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T17:21:24.947677] [INFO ] [REMOTE    ] AVA: Fetching primary data for 2025-02.
[2025-10-24T17:21:25.747610] [INFO ] [REMOTE    ] AUB: Fetching primary data for 2025-04.
[2025-10-24T17:21:25.985875] [INFO ] [REMOTE    ] AVA: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T17:21:26.226573] [INFO ] [REMOTE    ] AU: Incremental fetch complete for 2025-03 (2.08 seconds).
[2025-10-24T17:21:26.547725] [INFO ] [REMOTE    ] AU: Fetching primary data for 2025-04.
[2025-10-24T17:21:27.347731] [INFO ] [REMOTE    ] AUNA: Fetching primary data for 2025-07.
[2025-10-24T17:21:27.614687] [INFO ] [REMOTE    ] AUB: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T17:21:28.060752] [INFO ] [REMOTE    ] AUNA: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T17:21:28.148083] [INFO ] [REMOTE    ] AUNA: Fetching primary data for 2025-08.
[2025-10-24T17:21:28.151565] [INFO ] [REMOTE    ] AU: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T17:21:28.723365] [INFO ] [REMOTE    ] AUNA: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T17:21:28.947719] [INFO ] [REMOTE    ] AUB: Fetching primary data for 2025-05.
[2025-10-24T17:21:29.747725] [INFO ] [REMOTE    ] AUNA: Fetching primary data for 2025-09.
[2025-10-24T17:21:30.446922] [INFO ] [REMOTE    ] AUB: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T17:21:30.468232] [INFO ] [REMOTE    ] AUNA: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T17:21:30.547601] [INFO ] [REMOTE    ] AUNA: Fetching primary data for 2025-10.
[2025-10-24T17:21:31.347715] [INFO ] [REMOTE    ] AVA: Fetching primary data for 2025-03.
[2025-10-24T17:21:31.374754] [INFO ] [REMOTE    ] AUNA: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T17:21:31.376396] [INFO ] [REMOTE    ] AUNA: Full fetch complete (7853 records).
[2025-10-24T17:21:31.376464] [DEBUG] [VALIDATOR ] AUNA: Validating primary data.
[2025-10-24T17:21:31.731724] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present.
[2025-10-24T17:21:31.731837] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed.
[2025-10-24T17:21:31.732069] [INFO ] [MAIN      ] AUNA: Fetched primary data is valid.
[2025-10-24T17:21:31.732119] [DEBUG] [LOCAL     ] AUNA: Saving primary data.
[2025-10-24T17:21:31.732360] [FATAL] [LOCAL     ] AUNA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:21:31.732449] [FATAL] [MAIN      ] AUNA: Failed to save primary data.
[2025-10-24T17:21:31.732693] [WARN ] [MAIN      ] AUNA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:21:31.732753] [INFO ] [LOCAL     ] AUNA: Starting deletion of primary data.
[2025-10-24T17:21:31.732805] [DEBUG] [LOCAL     ] AUNA: No primary data file found to delete.
[2025-10-24T17:21:31.732840] [INFO ] [LOCAL     ] AUNA: Starting deletion of derivative data.
[2025-10-24T17:21:31.732969] [DEBUG] [LOCAL     ] AUNA: Deleted derivative data file.
[2025-10-24T17:21:31.733038] [INFO ] [MAIN      ] Update Progress: 177/2366 symbols completed. AUNA took 17.3s. Estimated remaining: 4h 25m 39s. Rate: 8.2 symbols/min
[2025-10-24T17:21:31.897678] [INFO ] [MAIN      ] AVAL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:21:31.907540] [DEBUG] [LOCAL     ] AVAL: Loaded 8525 existing records from primary storage.
[2025-10-24T17:21:31.907783] [INFO ] [MAIN      ] AVAL: Loaded 8525 existing records.
[2025-10-24T17:21:32.081070] [WARN ] [MAIN      ] AVAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:21:32.081279] [INFO ] [MAIN      ] AVAL: Wiping existing primary data before full refresh.
[2025-10-24T17:21:32.081325] [INFO ] [LOCAL     ] AVAL: Starting deletion of primary data.
[2025-10-24T17:21:32.081611] [DEBUG] [LOCAL     ] AVAL: Deleted primary data file.
[2025-10-24T17:21:32.081703] [INFO ] [MAIN      ] AVAL: Starting full primary refresh.
[2025-10-24T17:21:32.157148] [INFO ] [REMOTE    ] AU: Fetching primary data for 2025-05.
[2025-10-24T17:21:32.440682] [INFO ] [REMOTE    ] AVAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:21:32.955383] [INFO ] [REMOTE    ] AVAL: Fetching primary data for 2025-01.
[2025-10-24T17:21:32.960577] [INFO ] [REMOTE    ] AVA: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T17:21:33.747887] [INFO ] [REMOTE    ] AUB: Fetching primary data for 2025-06.
[2025-10-24T17:21:33.752267] [INFO ] [REMOTE    ] AU: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T17:21:33.883607] [INFO ] [REMOTE    ] AVAL: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T17:21:34.547634] [INFO ] [REMOTE    ] AU: Fetching primary data for 2025-06.
[2025-10-24T17:21:35.343032] [INFO ] [REMOTE    ] AUB: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T17:21:35.352185] [INFO ] [REMOTE    ] AVAL: Fetching primary data for 2025-02.
[2025-10-24T17:21:36.147627] [INFO ] [REMOTE    ] AVA: Fetching primary data for 2025-04.
[2025-10-24T17:21:36.183713] [INFO ] [REMOTE    ] AVAL: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T17:21:36.320853] [INFO ] [REMOTE    ] AU: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T17:21:36.947636] [INFO ] [REMOTE    ] AVAL: Fetching primary data for 2025-03.
[2025-10-24T17:21:37.520963] [INFO ] [REMOTE    ] AVA: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T17:21:37.747709] [INFO ] [REMOTE    ] AUB: Fetching primary data for 2025-07.
[2025-10-24T17:21:37.833929] [INFO ] [REMOTE    ] AVAL: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T17:21:38.547673] [INFO ] [REMOTE    ] AVA: Fetching primary data for 2025-05.
[2025-10-24T17:21:39.347708] [INFO ] [REMOTE    ] AVAL: Fetching primary data for 2025-04.
[2025-10-24T17:21:39.516267] [INFO ] [REMOTE    ] AUB: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T17:21:39.593913] [INFO ] [REMOTE    ] AVA: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T17:21:39.922622] [INFO ] [REMOTE    ] AVAL: Incremental fetch complete for 2025-04 (0.57 seconds).
[2025-10-24T17:21:40.147729] [INFO ] [REMOTE    ] AVA: Fetching primary data for 2025-06.
[2025-10-24T17:21:40.947676] [INFO ] [REMOTE    ] AU: Fetching primary data for 2025-07.
[2025-10-24T17:21:41.581701] [INFO ] [REMOTE    ] AVA: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T17:21:41.747732] [INFO ] [REMOTE    ] AVA: Fetching primary data for 2025-07.
[2025-10-24T17:21:42.547714] [INFO ] [REMOTE    ] AUB: Fetching primary data for 2025-08.
[2025-10-24T17:21:42.922189] [INFO ] [REMOTE    ] AU: Incremental fetch complete for 2025-07 (1.97 seconds).
[2025-10-24T17:21:43.245023] [INFO ] [REMOTE    ] AVA: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T17:21:43.347608] [INFO ] [REMOTE    ] AVA: Fetching primary data for 2025-08.
[2025-10-24T17:21:44.152826] [INFO ] [REMOTE    ] AVAL: Fetching primary data for 2025-05.
[2025-10-24T17:21:44.174756] [INFO ] [REMOTE    ] AUB: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T17:21:44.738310] [INFO ] [REMOTE    ] AVA: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T17:21:44.947711] [INFO ] [REMOTE    ] AU: Fetching primary data for 2025-08.
[2025-10-24T17:21:45.033128] [INFO ] [REMOTE    ] AVAL: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T17:21:45.747742] [INFO ] [REMOTE    ] AUB: Fetching primary data for 2025-09.
[2025-10-24T17:21:46.547710] [INFO ] [REMOTE    ] AVAL: Fetching primary data for 2025-06.
[2025-10-24T17:21:46.946217] [INFO ] [REMOTE    ] AU: Incremental fetch complete for 2025-08 (2.00 seconds).
[2025-10-24T17:21:47.030931] [INFO ] [REMOTE    ] AUB: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T17:21:47.347735] [INFO ] [REMOTE    ] AVA: Fetching primary data for 2025-09.
[2025-10-24T17:21:47.439177] [INFO ] [REMOTE    ] AVAL: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T17:21:48.147734] [INFO ] [REMOTE    ] AU: Fetching primary data for 2025-09.
[2025-10-24T17:21:48.947769] [INFO ] [REMOTE    ] AUB: Fetching primary data for 2025-10.
[2025-10-24T17:21:48.986862] [INFO ] [REMOTE    ] AVA: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T17:21:49.747671] [INFO ] [REMOTE    ] AVAL: Fetching primary data for 2025-07.
[2025-10-24T17:21:50.163714] [INFO ] [REMOTE    ] AU: Incremental fetch complete for 2025-09 (2.02 seconds).
[2025-10-24T17:21:50.486359] [INFO ] [REMOTE    ] AVAL: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T17:21:50.547621] [INFO ] [REMOTE    ] AVA: Fetching primary data for 2025-10.
[2025-10-24T17:21:50.612204] [INFO ] [REMOTE    ] AUB: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T17:21:50.620726] [INFO ] [REMOTE    ] AUB: Full fetch complete (66497 records).
[2025-10-24T17:21:50.620844] [DEBUG] [VALIDATOR ] AUB: Validating primary data.
[2025-10-24T17:21:51.019313] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present.
[2025-10-24T17:21:51.019401] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed.
[2025-10-24T17:21:51.020171] [INFO ] [MAIN      ] AUB: Fetched primary data is valid.
[2025-10-24T17:21:51.020256] [DEBUG] [LOCAL     ] AUB: Saving primary data.
[2025-10-24T17:21:51.020818] [FATAL] [LOCAL     ] AUB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:21:51.020913] [FATAL] [MAIN      ] AUB: Failed to save primary data.
[2025-10-24T17:21:51.020957] [WARN ] [MAIN      ] AUB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:21:51.020994] [INFO ] [LOCAL     ] AUB: Starting deletion of primary data.
[2025-10-24T17:21:51.021048] [DEBUG] [LOCAL     ] AUB: No primary data file found to delete.
[2025-10-24T17:21:51.021084] [INFO ] [LOCAL     ] AUB: Starting deletion of derivative data.
[2025-10-24T17:21:51.021210] [DEBUG] [LOCAL     ] AUB: Deleted derivative data file.
[2025-10-24T17:21:51.021293] [INFO ] [MAIN      ] Update Progress: 178/2366 symbols completed. AUB took 38.4s. Estimated remaining: 4h 27m 60s. Rate: 8.2 symbols/min
[2025-10-24T17:21:51.201607] [INFO ] [MAIN      ] AVB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:21:51.242806] [DEBUG] [LOCAL     ] AVB: Loaded 42433 existing records from primary storage.
[2025-10-24T17:21:51.243095] [INFO ] [MAIN      ] AVB: Loaded 42433 existing records.
[2025-10-24T17:21:51.352862] [INFO ] [REMOTE    ] AU: Fetching primary data for 2025-10.
[2025-10-24T17:21:51.427623] [WARN ] [MAIN      ] AVB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:21:51.427836] [INFO ] [MAIN      ] AVB: Wiping existing primary data before full refresh.
[2025-10-24T17:21:51.427884] [INFO ] [LOCAL     ] AVB: Starting deletion of primary data.
[2025-10-24T17:21:51.428700] [DEBUG] [LOCAL     ] AVB: Deleted primary data file.
[2025-10-24T17:21:51.428760] [INFO ] [MAIN      ] AVB: Starting full primary refresh.
[2025-10-24T17:21:51.795192] [INFO ] [REMOTE    ] AVB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:21:51.812752] [INFO ] [REMOTE    ] AVA: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T17:21:51.819357] [INFO ] [REMOTE    ] AVA: Full fetch complete (55427 records).
[2025-10-24T17:21:51.819465] [DEBUG] [VALIDATOR ] AVA: Validating primary data.
[2025-10-24T17:21:52.162896] [INFO ] [REMOTE    ] AVAL: Fetching primary data for 2025-08.
[2025-10-24T17:21:52.217266] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present.
[2025-10-24T17:21:52.217345] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed.
[2025-10-24T17:21:52.218134] [INFO ] [MAIN      ] AVA: Fetched primary data is valid.
[2025-10-24T17:21:52.218198] [DEBUG] [LOCAL     ] AVA: Saving primary data.
[2025-10-24T17:21:52.218714] [FATAL] [LOCAL     ] AVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:21:52.218801] [FATAL] [MAIN      ] AVA: Failed to save primary data.
[2025-10-24T17:21:52.218865] [WARN ] [MAIN      ] AVA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:21:52.218931] [INFO ] [LOCAL     ] AVA: Starting deletion of primary data.
[2025-10-24T17:21:52.218993] [DEBUG] [LOCAL     ] AVA: No primary data file found to delete.
[2025-10-24T17:21:52.219030] [INFO ] [LOCAL     ] AVA: Starting deletion of derivative data.
[2025-10-24T17:21:52.219176] [DEBUG] [LOCAL     ] AVA: Deleted derivative data file.
[2025-10-24T17:21:52.219633] [INFO ] [MAIN      ] Update Progress: 179/2366 symbols completed. AVA took 31.4s. Estimated remaining: 4h 26m 37s. Rate: 8.2 symbols/min
[2025-10-24T17:21:52.389616] [INFO ] [MAIN      ] AVBC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:21:52.389808] [DEBUG] [LOCAL     ] AVBC: No existing data file found in primary storage.
[2025-10-24T17:21:52.389851] [WARN ] [MAIN      ] AVBC: No existing data found, performing full refresh instead.
[2025-10-24T17:21:52.389961] [INFO ] [MAIN      ] AVBC: Wiping existing primary data before full refresh.
[2025-10-24T17:21:52.390004] [INFO ] [LOCAL     ] AVBC: Starting deletion of primary data.
[2025-10-24T17:21:52.390046] [DEBUG] [LOCAL     ] AVBC: No primary data file found to delete.
[2025-10-24T17:21:52.390075] [INFO ] [MAIN      ] AVBC: Starting full primary refresh.
[2025-10-24T17:21:52.749750] [INFO ] [REMOTE    ] AVBC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:21:52.750723] [INFO ] [REMOTE    ] AVAL: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T17:21:52.947696] [INFO ] [REMOTE    ] AVBC: Fetching primary data for 2025-01.
[2025-10-24T17:21:53.152621] [DEBUG] [REMOTE    ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:21:53.153018] [WARN ] [REMOTE    ] AVBC: No data returned for month 2025-01
[2025-10-24T17:21:53.153104] [FATAL] [REMOTE    ] AVBC: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:21:53.153152] [FATAL] [MAIN      ] AVBC: Failed to fetch primary data.
[2025-10-24T17:21:53.153187] [WARN ] [MAIN      ] AVBC: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:21:53.153251] [INFO ] [LOCAL     ] AVBC: Starting deletion of primary data.
[2025-10-24T17:21:53.153314] [DEBUG] [LOCAL     ] AVBC: No primary data file found to delete.
[2025-10-24T17:21:53.153349] [INFO ] [LOCAL     ] AVBC: Starting deletion of derivative data.
[2025-10-24T17:21:53.153392] [DEBUG] [LOCAL     ] AVBC: No derivative data file found to delete.
[2025-10-24T17:21:53.153480] [INFO ] [MAIN      ] Update Progress: 180/2366 symbols completed. AVBC took 0.9s. Estimated remaining: 4h 25m 12s. Rate: 8.2 symbols/min
[2025-10-24T17:21:53.330354] [INFO ] [MAIN      ] AVD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:21:53.351322] [DEBUG] [LOCAL     ] AVD: Loaded 21435 existing records from primary storage.
[2025-10-24T17:21:53.351569] [INFO ] [MAIN      ] AVD: Loaded 21435 existing records.
[2025-10-24T17:21:53.531582] [WARN ] [MAIN      ] AVD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:21:53.531777] [INFO ] [MAIN      ] AVD: Wiping existing primary data before full refresh.
[2025-10-24T17:21:53.531823] [INFO ] [LOCAL     ] AVD: Starting deletion of primary data.
[2025-10-24T17:21:53.532240] [DEBUG] [LOCAL     ] AVD: Deleted primary data file.
[2025-10-24T17:21:53.532296] [INFO ] [MAIN      ] AVD: Starting full primary refresh.
[2025-10-24T17:21:53.750266] [INFO ] [REMOTE    ] AVB: Fetching primary data for 2025-01.
[2025-10-24T17:21:53.890131] [INFO ] [REMOTE    ] AVD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:21:53.917050] [INFO ] [REMOTE    ] AU: Incremental fetch complete for 2025-10 (2.56 seconds).
[2025-10-24T17:21:53.926996] [INFO ] [REMOTE    ] AU: Full fetch complete (76654 records).
[2025-10-24T17:21:53.927167] [DEBUG] [VALIDATOR ] AU: Validating primary data.
[2025-10-24T17:21:54.315552] [DEBUG] [VALIDATOR ] AU: All expected trading days are present.
[2025-10-24T17:21:54.315625] [DEBUG] [VALIDATOR ] AU: Primary data validation passed.
[2025-10-24T17:21:54.316497] [INFO ] [MAIN      ] AU: Fetched primary data is valid.
[2025-10-24T17:21:54.316560] [DEBUG] [LOCAL     ] AU: Saving primary data.
[2025-10-24T17:21:54.317208] [FATAL] [LOCAL     ] AU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:21:54.317295] [FATAL] [MAIN      ] AU: Failed to save primary data.
[2025-10-24T17:21:54.317337] [WARN ] [MAIN      ] AU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:21:54.317406] [INFO ] [LOCAL     ] AU: Starting deletion of primary data.
[2025-10-24T17:21:54.317513] [DEBUG] [LOCAL     ] AU: No primary data file found to delete.
[2025-10-24T17:21:54.317553] [INFO ] [LOCAL     ] AU: Starting deletion of derivative data.
[2025-10-24T17:21:54.317720] [DEBUG] [LOCAL     ] AU: Deleted derivative data file.
[2025-10-24T17:21:54.318138] [INFO ] [MAIN      ] Update Progress: 181/2366 symbols completed. AU took 41.9s. Estimated remaining: 4h 23m 51s. Rate: 8.3 symbols/min
[2025-10-24T17:21:54.486183] [INFO ] [MAIN      ] AVK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:21:54.505568] [DEBUG] [LOCAL     ] AVK: Loaded 18738 existing records from primary storage.
[2025-10-24T17:21:54.505822] [INFO ] [MAIN      ] AVK: Loaded 18738 existing records.
[2025-10-24T17:21:54.559887] [INFO ] [REMOTE    ] AVD: Fetching primary data for 2025-01.
[2025-10-24T17:21:54.684068] [WARN ] [MAIN      ] AVK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:21:54.684271] [INFO ] [MAIN      ] AVK: Wiping existing primary data before full refresh.
[2025-10-24T17:21:54.684334] [INFO ] [LOCAL     ] AVK: Starting deletion of primary data.
[2025-10-24T17:21:54.684936] [DEBUG] [LOCAL     ] AVK: Deleted primary data file.
[2025-10-24T17:21:54.684997] [INFO ] [MAIN      ] AVK: Starting full primary refresh.
[2025-10-24T17:21:55.050307] [INFO ] [REMOTE    ] AVK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:21:55.347619] [INFO ] [REMOTE    ] AVAL: Fetching primary data for 2025-09.
[2025-10-24T17:21:55.412182] [INFO ] [REMOTE    ] AVB: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T17:21:55.717047] [INFO ] [REMOTE    ] AVD: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T17:21:56.147701] [INFO ] [REMOTE    ] AVK: Fetching primary data for 2025-01.
[2025-10-24T17:21:56.364830] [INFO ] [REMOTE    ] AVAL: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T17:21:56.947706] [INFO ] [REMOTE    ] AVB: Fetching primary data for 2025-02.
[2025-10-24T17:21:57.205849] [INFO ] [REMOTE    ] AVK: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T17:21:57.747672] [INFO ] [REMOTE    ] AVAL: Fetching primary data for 2025-10.
[2025-10-24T17:21:58.311535] [INFO ] [REMOTE    ] AVB: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T17:21:58.500384] [INFO ] [REMOTE    ] AVAL: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T17:21:58.502532] [INFO ] [REMOTE    ] AVAL: Full fetch complete (15029 records).
[2025-10-24T17:21:58.502601] [DEBUG] [VALIDATOR ] AVAL: Validating primary data.
[2025-10-24T17:21:58.555898] [INFO ] [REMOTE    ] AVD: Fetching primary data for 2025-02.
[2025-10-24T17:21:58.916477] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present.
[2025-10-24T17:21:58.916562] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed.
[2025-10-24T17:21:58.916925] [INFO ] [MAIN      ] AVAL: Fetched primary data is valid.
[2025-10-24T17:21:58.917007] [DEBUG] [LOCAL     ] AVAL: Saving primary data.
[2025-10-24T17:21:58.917279] [FATAL] [LOCAL     ] AVAL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:21:58.917384] [FATAL] [MAIN      ] AVAL: Failed to save primary data.
[2025-10-24T17:21:58.917478] [WARN ] [MAIN      ] AVAL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:21:58.917563] [INFO ] [LOCAL     ] AVAL: Starting deletion of primary data.
[2025-10-24T17:21:58.917633] [DEBUG] [LOCAL     ] AVAL: No primary data file found to delete.
[2025-10-24T17:21:58.917715] [INFO ] [LOCAL     ] AVAL: Starting deletion of derivative data.
[2025-10-24T17:21:58.917843] [DEBUG] [LOCAL     ] AVAL: Deleted derivative data file.
[2025-10-24T17:21:58.917914] [INFO ] [MAIN      ] Update Progress: 182/2366 symbols completed. AVAL took 27.2s. Estimated remaining: 4h 23m 12s. Rate: 8.3 symbols/min
[2025-10-24T17:21:59.097665] [INFO ] [MAIN      ] AVNS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:21:59.130198] [DEBUG] [LOCAL     ] AVNS: Loaded 33758 existing records from primary storage.
[2025-10-24T17:21:59.130458] [INFO ] [MAIN      ] AVNS: Loaded 33758 existing records.
[2025-10-24T17:21:59.309986] [WARN ] [MAIN      ] AVNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:21:59.310197] [INFO ] [MAIN      ] AVNS: Wiping existing primary data before full refresh.
[2025-10-24T17:21:59.310242] [INFO ] [LOCAL     ] AVNS: Starting deletion of primary data.
[2025-10-24T17:21:59.310895] [DEBUG] [LOCAL     ] AVNS: Deleted primary data file.
[2025-10-24T17:21:59.310953] [INFO ] [MAIN      ] AVNS: Starting full primary refresh.
[2025-10-24T17:21:59.352848] [INFO ] [REMOTE    ] AVK: Fetching primary data for 2025-02.
[2025-10-24T17:21:59.613440] [INFO ] [REMOTE    ] AVD: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T17:21:59.686858] [INFO ] [REMOTE    ] AVNS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:22:00.147623] [INFO ] [REMOTE    ] AVD: Fetching primary data for 2025-03.
[2025-10-24T17:22:00.348424] [INFO ] [REMOTE    ] AVK: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T17:22:00.947620] [INFO ] [REMOTE    ] AVB: Fetching primary data for 2025-03.
[2025-10-24T17:22:01.734330] [INFO ] [REMOTE    ] AVD: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T17:22:01.747605] [INFO ] [REMOTE    ] AVD: Fetching primary data for 2025-04.
[2025-10-24T17:22:02.547616] [INFO ] [REMOTE    ] AVNS: Fetching primary data for 2025-01.
[2025-10-24T17:22:03.347729] [INFO ] [REMOTE    ] AVK: Fetching primary data for 2025-03.
[2025-10-24T17:22:03.414931] [INFO ] [REMOTE    ] AVD: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T17:22:04.147617] [INFO ] [REMOTE    ] AVD: Fetching primary data for 2025-05.
[2025-10-24T17:22:04.191804] [INFO ] [REMOTE    ] AVK: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T17:22:04.303100] [INFO ] [REMOTE    ] AVNS: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T17:22:04.527104] [INFO ] [REMOTE    ] AVB: Incremental fetch complete for 2025-03 (3.58 seconds).
[2025-10-24T17:22:04.877917] [INFO ] [REMOTE    ] AVD: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T17:22:04.947703] [INFO ] [REMOTE    ] AVK: Fetching primary data for 2025-04.
[2025-10-24T17:22:05.747624] [INFO ] [REMOTE    ] AVD: Fetching primary data for 2025-06.
[2025-10-24T17:22:05.997737] [INFO ] [REMOTE    ] AVK: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T17:22:06.547614] [INFO ] [REMOTE    ] AVNS: Fetching primary data for 2025-02.
[2025-10-24T17:22:06.784201] [INFO ] [REMOTE    ] AVD: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T17:22:07.347680] [INFO ] [REMOTE    ] AVB: Fetching primary data for 2025-04.
[2025-10-24T17:22:07.863492] [INFO ] [REMOTE    ] AVNS: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T17:22:08.147691] [INFO ] [REMOTE    ] AVD: Fetching primary data for 2025-07.
[2025-10-24T17:22:08.947621] [INFO ] [REMOTE    ] AVK: Fetching primary data for 2025-05.
[2025-10-24T17:22:09.137024] [INFO ] [REMOTE    ] AVB: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T17:22:09.324854] [INFO ] [REMOTE    ] AVD: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T17:22:09.747628] [INFO ] [REMOTE    ] AVNS: Fetching primary data for 2025-03.
[2025-10-24T17:22:09.982073] [INFO ] [REMOTE    ] AVK: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T17:22:10.547723] [INFO ] [REMOTE    ] AVB: Fetching primary data for 2025-05.
[2025-10-24T17:22:11.077965] [INFO ] [REMOTE    ] AVNS: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T17:22:11.347637] [INFO ] [REMOTE    ] AVD: Fetching primary data for 2025-08.
[2025-10-24T17:22:11.680458] [INFO ] [REMOTE    ] AVB: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T17:22:12.147621] [INFO ] [REMOTE    ] AVNS: Fetching primary data for 2025-04.
[2025-10-24T17:22:12.528022] [INFO ] [REMOTE    ] AVD: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T17:22:12.947683] [INFO ] [REMOTE    ] AVB: Fetching primary data for 2025-06.
[2025-10-24T17:22:13.239230] [INFO ] [REMOTE    ] AVNS: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T17:22:13.747679] [INFO ] [REMOTE    ] AVK: Fetching primary data for 2025-06.
[2025-10-24T17:22:14.087698] [INFO ] [REMOTE    ] AVB: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T17:22:14.547693] [INFO ] [REMOTE    ] AVD: Fetching primary data for 2025-09.
[2025-10-24T17:22:14.681743] [INFO ] [REMOTE    ] AVK: Incremental fetch complete for 2025-06 (0.93 seconds).
[2025-10-24T17:22:15.347621] [INFO ] [REMOTE    ] AVK: Fetching primary data for 2025-07.
[2025-10-24T17:22:15.412159] [INFO ] [REMOTE    ] AVD: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T17:22:16.147615] [INFO ] [REMOTE    ] AVD: Fetching primary data for 2025-10.
[2025-10-24T17:22:16.418214] [INFO ] [REMOTE    ] AVK: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T17:22:16.947721] [INFO ] [REMOTE    ] AVB: Fetching primary data for 2025-07.
[2025-10-24T17:22:17.157335] [INFO ] [REMOTE    ] AVD: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T17:22:17.160635] [INFO ] [REMOTE    ] AVD: Full fetch complete (32425 records).
[2025-10-24T17:22:17.160747] [DEBUG] [VALIDATOR ] AVD: Validating primary data.
[2025-10-24T17:22:17.525301] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present.
[2025-10-24T17:22:17.525374] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed.
[2025-10-24T17:22:17.525782] [INFO ] [MAIN      ] AVD: Fetched primary data is valid.
[2025-10-24T17:22:17.525842] [DEBUG] [LOCAL     ] AVD: Saving primary data.
[2025-10-24T17:22:17.526143] [FATAL] [LOCAL     ] AVD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:22:17.526223] [FATAL] [MAIN      ] AVD: Failed to save primary data.
[2025-10-24T17:22:17.526264] [WARN ] [MAIN      ] AVD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:22:17.526298] [INFO ] [LOCAL     ] AVD: Starting deletion of primary data.
[2025-10-24T17:22:17.526346] [DEBUG] [LOCAL     ] AVD: No primary data file found to delete.
[2025-10-24T17:22:17.526380] [INFO ] [LOCAL     ] AVD: Starting deletion of derivative data.
[2025-10-24T17:22:17.526536] [DEBUG] [LOCAL     ] AVD: Deleted derivative data file.
[2025-10-24T17:22:17.526623] [INFO ] [MAIN      ] Update Progress: 183/2366 symbols completed. AVD took 24.4s. Estimated remaining: 4h 25m 21s. Rate: 8.2 symbols/min
[2025-10-24T17:22:17.696989] [INFO ] [MAIN      ] AVNT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:22:17.732566] [DEBUG] [LOCAL     ] AVNT: Loaded 38855 existing records from primary storage.
[2025-10-24T17:22:17.732889] [INFO ] [MAIN      ] AVNT: Loaded 38855 existing records.
[2025-10-24T17:22:17.753610] [INFO ] [REMOTE    ] AVNS: Fetching primary data for 2025-05.
[2025-10-24T17:22:17.913991] [WARN ] [MAIN      ] AVNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:22:17.914191] [INFO ] [MAIN      ] AVNT: Wiping existing primary data before full refresh.
[2025-10-24T17:22:17.914238] [INFO ] [LOCAL     ] AVNT: Starting deletion of primary data.
[2025-10-24T17:22:17.914947] [DEBUG] [LOCAL     ] AVNT: Deleted primary data file.
[2025-10-24T17:22:17.915006] [INFO ] [MAIN      ] AVNT: Starting full primary refresh.
[2025-10-24T17:22:18.264425] [INFO ] [REMOTE    ] AVNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:22:18.500756] [INFO ] [REMOTE    ] AVB: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T17:22:18.547675] [INFO ] [REMOTE    ] AVNT: Fetching primary data for 2025-01.
[2025-10-24T17:22:19.037737] [INFO ] [REMOTE    ] AVNS: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T17:22:19.347682] [INFO ] [REMOTE    ] AVNS: Fetching primary data for 2025-06.
[2025-10-24T17:22:20.038046] [INFO ] [REMOTE    ] AVNT: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T17:22:20.147667] [INFO ] [REMOTE    ] AVNT: Fetching primary data for 2025-02.
[2025-10-24T17:22:20.398090] [INFO ] [REMOTE    ] AVNS: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T17:22:20.947700] [INFO ] [REMOTE    ] AVNS: Fetching primary data for 2025-07.
[2025-10-24T17:22:21.528719] [INFO ] [REMOTE    ] AVNT: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T17:22:21.747747] [INFO ] [REMOTE    ] AVNT: Fetching primary data for 2025-03.
[2025-10-24T17:22:22.298318] [INFO ] [REMOTE    ] AVNS: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T17:22:22.547629] [INFO ] [REMOTE    ] AVNS: Fetching primary data for 2025-08.
[2025-10-24T17:22:23.237901] [INFO ] [REMOTE    ] AVNT: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T17:22:23.347618] [INFO ] [REMOTE    ] AVNT: Fetching primary data for 2025-04.
[2025-10-24T17:22:23.904086] [INFO ] [REMOTE    ] AVNS: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T17:22:24.147672] [INFO ] [REMOTE    ] AVK: Fetching primary data for 2025-08.
[2025-10-24T17:22:24.838742] [INFO ] [REMOTE    ] AVNT: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T17:22:24.947683] [INFO ] [REMOTE    ] AVNT: Fetching primary data for 2025-05.
[2025-10-24T17:22:25.279736] [INFO ] [REMOTE    ] AVK: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T17:22:25.747676] [INFO ] [REMOTE    ] AVB: Fetching primary data for 2025-08.
[2025-10-24T17:22:26.407394] [INFO ] [REMOTE    ] AVNT: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T17:22:26.547628] [INFO ] [REMOTE    ] AVNT: Fetching primary data for 2025-06.
[2025-10-24T17:22:27.153328] [INFO ] [REMOTE    ] AVB: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T17:22:27.347620] [INFO ] [REMOTE    ] AVB: Fetching primary data for 2025-09.
[2025-10-24T17:22:27.933467] [INFO ] [REMOTE    ] AVNT: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T17:22:28.147639] [INFO ] [REMOTE    ] AVNT: Fetching primary data for 2025-07.
[2025-10-24T17:22:28.947617] [INFO ] [REMOTE    ] AVK: Fetching primary data for 2025-09.
[2025-10-24T17:22:29.045110] [INFO ] [REMOTE    ] AVB: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T17:22:29.737531] [INFO ] [REMOTE    ] AVNT: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T17:22:29.750959] [INFO ] [REMOTE    ] AVNS: Fetching primary data for 2025-09.
[2025-10-24T17:22:29.866757] [INFO ] [REMOTE    ] AVK: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T17:22:30.547689] [INFO ] [REMOTE    ] AVNT: Fetching primary data for 2025-08.
[2025-10-24T17:22:31.197725] [INFO ] [REMOTE    ] AVNS: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T17:22:31.347690] [INFO ] [REMOTE    ] AVK: Fetching primary data for 2025-10.
[2025-10-24T17:22:32.146176] [INFO ] [REMOTE    ] AVNT: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T17:22:32.149339] [INFO ] [REMOTE    ] AVB: Fetching primary data for 2025-10.
[2025-10-24T17:22:32.710197] [INFO ] [REMOTE    ] AVK: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T17:22:32.714891] [INFO ] [REMOTE    ] AVK: Full fetch complete (26543 records).
[2025-10-24T17:22:32.714996] [DEBUG] [VALIDATOR ] AVK: Validating primary data.
[2025-10-24T17:22:32.715631] [FATAL] [VALIDATOR ] AVK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:22:32.715736] [FATAL] [MAIN      ] AVK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:22:32.715814] [WARN ] [MAIN      ] AVK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:22:32.715881] [INFO ] [LOCAL     ] AVK: Starting deletion of primary data.
[2025-10-24T17:22:32.715944] [DEBUG] [LOCAL     ] AVK: No primary data file found to delete.
[2025-10-24T17:22:32.715981] [INFO ] [LOCAL     ] AVK: Starting deletion of derivative data.
[2025-10-24T17:22:32.716129] [DEBUG] [LOCAL     ] AVK: Deleted derivative data file.
[2025-10-24T17:22:32.716206] [INFO ] [MAIN      ] Update Progress: 184/2366 symbols completed. AVK took 38.4s. Estimated remaining: 4h 26m 47s. Rate: 8.2 symbols/min
[2025-10-24T17:22:32.903895] [INFO ] [MAIN      ] AVTR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:22:32.957046] [INFO ] [REMOTE    ] AVNT: Fetching primary data for 2025-09.
[2025-10-24T17:22:32.960151] [DEBUG] [LOCAL     ] AVTR: Loaded 53961 existing records from primary storage.
[2025-10-24T17:22:32.960515] [INFO ] [MAIN      ] AVTR: Loaded 53961 existing records.
[2025-10-24T17:22:33.136428] [WARN ] [MAIN      ] AVTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:22:33.136625] [INFO ] [MAIN      ] AVTR: Wiping existing primary data before full refresh.
[2025-10-24T17:22:33.136724] [INFO ] [LOCAL     ] AVTR: Starting deletion of primary data.
[2025-10-24T17:22:33.138108] [DEBUG] [LOCAL     ] AVTR: Deleted primary data file.
[2025-10-24T17:22:33.138182] [INFO ] [MAIN      ] AVTR: Starting full primary refresh.
[2025-10-24T17:22:33.517714] [INFO ] [REMOTE    ] AVTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:22:33.596070] [INFO ] [REMOTE    ] AVB: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T17:22:33.603680] [INFO ] [REMOTE    ] AVB: Full fetch complete (59510 records).
[2025-10-24T17:22:33.603796] [DEBUG] [VALIDATOR ] AVB: Validating primary data.
[2025-10-24T17:22:33.754041] [INFO ] [REMOTE    ] AVNS: Fetching primary data for 2025-10.
[2025-10-24T17:22:33.993687] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present.
[2025-10-24T17:22:33.993785] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed.
[2025-10-24T17:22:33.994449] [INFO ] [MAIN      ] AVB: Fetched primary data is valid.
[2025-10-24T17:22:33.994672] [DEBUG] [LOCAL     ] AVB: Saving primary data.
[2025-10-24T17:22:33.995228] [FATAL] [LOCAL     ] AVB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:22:33.995371] [FATAL] [MAIN      ] AVB: Failed to save primary data.
[2025-10-24T17:22:33.995437] [WARN ] [MAIN      ] AVB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:22:33.995505] [INFO ] [LOCAL     ] AVB: Starting deletion of primary data.
[2025-10-24T17:22:33.995566] [DEBUG] [LOCAL     ] AVB: No primary data file found to delete.
[2025-10-24T17:22:33.995618] [INFO ] [LOCAL     ] AVB: Starting deletion of derivative data.
[2025-10-24T17:22:33.995773] [DEBUG] [LOCAL     ] AVB: Deleted derivative data file.
[2025-10-24T17:22:33.995860] [INFO ] [MAIN      ] Update Progress: 185/2366 symbols completed. AVB took 43.0s. Estimated remaining: 4h 25m 28s. Rate: 8.2 symbols/min
[2025-10-24T17:22:34.176037] [INFO ] [MAIN      ] AVY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:22:34.197505] [INFO ] [REMOTE    ] AVNT: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T17:22:34.240518] [DEBUG] [LOCAL     ] AVY: Loaded 38485 existing records from primary storage.
[2025-10-24T17:22:34.240840] [INFO ] [MAIN      ] AVY: Loaded 38485 existing records.
[2025-10-24T17:22:34.417074] [WARN ] [MAIN      ] AVY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:22:34.417279] [INFO ] [MAIN      ] AVY: Wiping existing primary data before full refresh.
[2025-10-24T17:22:34.417325] [INFO ] [LOCAL     ] AVY: Starting deletion of primary data.
[2025-10-24T17:22:34.418204] [DEBUG] [LOCAL     ] AVY: Deleted primary data file.
[2025-10-24T17:22:34.418261] [INFO ] [MAIN      ] AVY: Starting full primary refresh.
[2025-10-24T17:22:34.554708] [INFO ] [REMOTE    ] AVTR: Fetching primary data for 2025-01.
[2025-10-24T17:22:34.770729] [INFO ] [REMOTE    ] AVY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:22:34.913404] [INFO ] [REMOTE    ] AVNS: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T17:22:34.919476] [INFO ] [REMOTE    ] AVNS: Full fetch complete (48308 records).
[2025-10-24T17:22:34.919567] [DEBUG] [VALIDATOR ] AVNS: Validating primary data.
[2025-10-24T17:22:35.296746] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present.
[2025-10-24T17:22:35.296834] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed.
[2025-10-24T17:22:35.297364] [INFO ] [MAIN      ] AVNS: Fetched primary data is valid.
[2025-10-24T17:22:35.297404] [DEBUG] [LOCAL     ] AVNS: Saving primary data.
[2025-10-24T17:22:35.297865] [FATAL] [LOCAL     ] AVNS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:22:35.297952] [FATAL] [MAIN      ] AVNS: Failed to save primary data.
[2025-10-24T17:22:35.297995] [WARN ] [MAIN      ] AVNS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:22:35.298030] [INFO ] [LOCAL     ] AVNS: Starting deletion of primary data.
[2025-10-24T17:22:35.298080] [DEBUG] [LOCAL     ] AVNS: No primary data file found to delete.
[2025-10-24T17:22:35.298116] [INFO ] [LOCAL     ] AVNS: Starting deletion of derivative data.
[2025-10-24T17:22:35.298281] [DEBUG] [LOCAL     ] AVNS: Deleted derivative data file.
[2025-10-24T17:22:35.298379] [INFO ] [MAIN      ] Update Progress: 186/2366 symbols completed. AVNS took 36.4s. Estimated remaining: 4h 24m 11s. Rate: 8.3 symbols/min
[2025-10-24T17:22:35.360693] [INFO ] [REMOTE    ] AVY: Fetching primary data for 2025-01.
[2025-10-24T17:22:35.467353] [INFO ] [MAIN      ] AWF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:22:35.490928] [DEBUG] [LOCAL     ] AWF: Loaded 24216 existing records from primary storage.
[2025-10-24T17:22:35.491183] [INFO ] [MAIN      ] AWF: Loaded 24216 existing records.
[2025-10-24T17:22:35.667040] [WARN ] [MAIN      ] AWF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:22:35.667237] [INFO ] [MAIN      ] AWF: Wiping existing primary data before full refresh.
[2025-10-24T17:22:35.667284] [INFO ] [LOCAL     ] AWF: Starting deletion of primary data.
[2025-10-24T17:22:35.667873] [DEBUG] [LOCAL     ] AWF: Deleted primary data file.
[2025-10-24T17:22:35.667933] [INFO ] [MAIN      ] AWF: Starting full primary refresh.
[2025-10-24T17:22:36.016598] [INFO ] [REMOTE    ] AWF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:22:36.147693] [INFO ] [REMOTE    ] AVNT: Fetching primary data for 2025-10.
[2025-10-24T17:22:36.423138] [INFO ] [REMOTE    ] AVTR: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T17:22:36.947636] [INFO ] [REMOTE    ] AVTR: Fetching primary data for 2025-02.
[2025-10-24T17:22:37.117825] [INFO ] [REMOTE    ] AVY: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T17:22:37.511380] [INFO ] [REMOTE    ] AVNT: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T17:22:37.518259] [INFO ] [REMOTE    ] AVNT: Full fetch complete (55937 records).
[2025-10-24T17:22:37.518419] [DEBUG] [VALIDATOR ] AVNT: Validating primary data.
[2025-10-24T17:22:37.753277] [INFO ] [REMOTE    ] AVY: Fetching primary data for 2025-02.
[2025-10-24T17:22:37.902798] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present.
[2025-10-24T17:22:37.902887] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed.
[2025-10-24T17:22:37.903491] [INFO ] [MAIN      ] AVNT: Fetched primary data is valid.
[2025-10-24T17:22:37.903532] [DEBUG] [LOCAL     ] AVNT: Saving primary data.
[2025-10-24T17:22:37.904110] [FATAL] [LOCAL     ] AVNT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:22:37.904205] [FATAL] [MAIN      ] AVNT: Failed to save primary data.
[2025-10-24T17:22:37.904246] [WARN ] [MAIN      ] AVNT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:22:37.904280] [INFO ] [LOCAL     ] AVNT: Starting deletion of primary data.
[2025-10-24T17:22:37.904333] [DEBUG] [LOCAL     ] AVNT: No primary data file found to delete.
[2025-10-24T17:22:37.904367] [INFO ] [LOCAL     ] AVNT: Starting deletion of derivative data.
[2025-10-24T17:22:37.904510] [DEBUG] [LOCAL     ] AVNT: Deleted derivative data file.
[2025-10-24T17:22:37.904872] [INFO ] [MAIN      ] Update Progress: 187/2366 symbols completed. AVNT took 20.4s. Estimated remaining: 4h 23m 9s. Rate: 8.3 symbols/min
[2025-10-24T17:22:38.077120] [INFO ] [MAIN      ] AWI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:22:38.103763] [DEBUG] [LOCAL     ] AWI: Loaded 25291 existing records from primary storage.
[2025-10-24T17:22:38.104041] [INFO ] [MAIN      ] AWI: Loaded 25291 existing records.
[2025-10-24T17:22:38.290831] [WARN ] [MAIN      ] AWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:22:38.291194] [INFO ] [MAIN      ] AWI: Wiping existing primary data before full refresh.
[2025-10-24T17:22:38.291258] [INFO ] [LOCAL     ] AWI: Starting deletion of primary data.
[2025-10-24T17:22:38.291868] [DEBUG] [LOCAL     ] AWI: Deleted primary data file.
[2025-10-24T17:22:38.291926] [INFO ] [MAIN      ] AWI: Starting full primary refresh.
[2025-10-24T17:22:38.548064] [INFO ] [REMOTE    ] AWF: Fetching primary data for 2025-01.
[2025-10-24T17:22:38.671065] [INFO ] [REMOTE    ] AWI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:22:38.705856] [INFO ] [REMOTE    ] AVTR: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T17:22:39.268236] [INFO ] [REMOTE    ] AVY: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T17:22:39.347677] [INFO ] [REMOTE    ] AWI: Fetching primary data for 2025-01.
[2025-10-24T17:22:39.625689] [INFO ] [REMOTE    ] AWF: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T17:22:40.147621] [INFO ] [REMOTE    ] AVTR: Fetching primary data for 2025-03.
[2025-10-24T17:22:40.212269] [INFO ] [REMOTE    ] AWI: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T17:22:40.947719] [INFO ] [REMOTE    ] AWF: Fetching primary data for 2025-02.
[2025-10-24T17:22:41.747683] [INFO ] [REMOTE    ] AWI: Fetching primary data for 2025-02.
[2025-10-24T17:22:42.044763] [INFO ] [REMOTE    ] AVTR: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T17:22:42.087008] [INFO ] [REMOTE    ] AWF: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T17:22:42.547693] [INFO ] [REMOTE    ] AVY: Fetching primary data for 2025-03.
[2025-10-24T17:22:42.778776] [INFO ] [REMOTE    ] AWI: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T17:22:43.347695] [INFO ] [REMOTE    ] AVTR: Fetching primary data for 2025-04.
[2025-10-24T17:22:44.046772] [INFO ] [REMOTE    ] AVY: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T17:22:44.147768] [INFO ] [REMOTE    ] AWI: Fetching primary data for 2025-03.
[2025-10-24T17:22:44.675414] [INFO ] [REMOTE    ] AVTR: Incremental fetch complete for 2025-04 (1.33 seconds).
[2025-10-24T17:22:44.947695] [INFO ] [REMOTE    ] AVTR: Fetching primary data for 2025-05.
[2025-10-24T17:22:45.575898] [INFO ] [REMOTE    ] AWI: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T17:22:45.747721] [INFO ] [REMOTE    ] AWI: Fetching primary data for 2025-04.
[2025-10-24T17:22:46.547637] [INFO ] [REMOTE    ] AWF: Fetching primary data for 2025-03.
[2025-10-24T17:22:46.822710] [INFO ] [REMOTE    ] AVTR: Incremental fetch complete for 2025-05 (1.88 seconds).
[2025-10-24T17:22:47.152978] [INFO ] [REMOTE    ] AWI: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T17:22:47.347672] [INFO ] [REMOTE    ] AWI: Fetching primary data for 2025-05.
[2025-10-24T17:22:47.874485] [INFO ] [REMOTE    ] AWF: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T17:22:48.147716] [INFO ] [REMOTE    ] AWF: Fetching primary data for 2025-04.
[2025-10-24T17:22:48.563766] [INFO ] [REMOTE    ] AWI: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T17:22:48.947631] [INFO ] [REMOTE    ] AWI: Fetching primary data for 2025-06.
[2025-10-24T17:22:49.176686] [INFO ] [REMOTE    ] AWF: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T17:22:49.688709] [INFO ] [REMOTE    ] AWI: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T17:22:49.747670] [INFO ] [REMOTE    ] AWI: Fetching primary data for 2025-07.
[2025-10-24T17:22:50.547725] [INFO ] [REMOTE    ] AWF: Fetching primary data for 2025-05.
[2025-10-24T17:22:51.027343] [INFO ] [REMOTE    ] AWI: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T17:22:51.347634] [INFO ] [REMOTE    ] AVY: Fetching primary data for 2025-04.
[2025-10-24T17:22:51.468199] [INFO ] [REMOTE    ] AWF: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T17:22:52.147672] [INFO ] [REMOTE    ] AWI: Fetching primary data for 2025-08.
[2025-10-24T17:22:52.947632] [INFO ] [REMOTE    ] AWF: Fetching primary data for 2025-06.
[2025-10-24T17:22:53.157476] [INFO ] [REMOTE    ] AVY: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T17:22:53.414362] [INFO ] [REMOTE    ] AWI: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T17:22:53.594378] [INFO ] [REMOTE    ] AWF: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T17:22:53.747713] [INFO ] [REMOTE    ] AWF: Fetching primary data for 2025-07.
[2025-10-24T17:22:54.547702] [INFO ] [REMOTE    ] AVY: Fetching primary data for 2025-05.
[2025-10-24T17:22:54.843245] [INFO ] [REMOTE    ] AWF: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T17:22:55.347638] [INFO ] [REMOTE    ] AWF: Fetching primary data for 2025-08.
[2025-10-24T17:22:55.971392] [INFO ] [REMOTE    ] AVY: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T17:22:56.147710] [INFO ] [REMOTE    ] AVY: Fetching primary data for 2025-06.
[2025-10-24T17:22:56.520333] [INFO ] [REMOTE    ] AWF: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T17:22:56.947612] [INFO ] [REMOTE    ] AWF: Fetching primary data for 2025-09.
[2025-10-24T17:22:57.517371] [INFO ] [REMOTE    ] AVY: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T17:22:57.747716] [INFO ] [REMOTE    ] AVTR: Fetching primary data for 2025-06.
[2025-10-24T17:22:57.901409] [INFO ] [REMOTE    ] AWF: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T17:22:58.547669] [INFO ] [REMOTE    ] AWI: Fetching primary data for 2025-09.
[2025-10-24T17:22:59.347669] [INFO ] [REMOTE    ] AWF: Fetching primary data for 2025-10.
[2025-10-24T17:22:59.662891] [INFO ] [REMOTE    ] AWI: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T17:23:00.147699] [INFO ] [REMOTE    ] AWI: Fetching primary data for 2025-10.
[2025-10-24T17:23:00.947767] [INFO ] [REMOTE    ] AVY: Fetching primary data for 2025-07.
[2025-10-24T17:23:04.457814] [INFO ] [REMOTE    ] AWF: Incremental fetch complete for 2025-10 (5.11 seconds).
[2025-10-24T17:23:04.463020] [INFO ] [REMOTE    ] AWF: Full fetch complete (35981 records).
[2025-10-24T17:23:04.463139] [DEBUG] [VALIDATOR ] AWF: Validating primary data.
[2025-10-24T17:23:04.849083] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present.
[2025-10-24T17:23:04.849457] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed.
[2025-10-24T17:23:04.849956] [INFO ] [MAIN      ] AWF: Fetched primary data is valid.
[2025-10-24T17:23:04.850058] [DEBUG] [LOCAL     ] AWF: Saving primary data.
[2025-10-24T17:23:04.850485] [FATAL] [LOCAL     ] AWF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:23:04.850600] [FATAL] [MAIN      ] AWF: Failed to save primary data.
[2025-10-24T17:23:04.850665] [WARN ] [MAIN      ] AWF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:23:04.850731] [INFO ] [LOCAL     ] AWF: Starting deletion of primary data.
[2025-10-24T17:23:04.850789] [DEBUG] [LOCAL     ] AWF: No primary data file found to delete.
[2025-10-24T17:23:04.850824] [INFO ] [LOCAL     ] AWF: Starting deletion of derivative data.
[2025-10-24T17:23:04.851089] [DEBUG] [LOCAL     ] AWF: Deleted derivative data file.
[2025-10-24T17:23:04.851184] [INFO ] [MAIN      ] Update Progress: 188/2366 symbols completed. AWF took 29.6s. Estimated remaining: 4h 26m 50s. Rate: 8.2 symbols/min
[2025-10-24T17:23:05.037975] [INFO ] [MAIN      ] AWK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:23:05.035635] [INFO ] [REMOTE    ] AWI: Incremental fetch complete for 2025-10 (4.89 seconds).
[2025-10-24T17:23:05.043807] [INFO ] [REMOTE    ] AWI: Full fetch complete (36079 records).
[2025-10-24T17:23:05.043968] [DEBUG] [VALIDATOR ] AWI: Validating primary data.
[2025-10-24T17:23:05.193492] [INFO ] [REMOTE    ] AVTR: Incremental fetch complete for 2025-06 (7.45 seconds).
[2025-10-24T17:23:05.298111] [INFO ] [REMOTE    ] AVTR: Fetching primary data for 2025-07.
[2025-10-24T17:23:05.417333] [DEBUG] [LOCAL     ] AWK: Loaded 48705 existing records from primary storage.
[2025-10-24T17:23:05.428336] [INFO ] [MAIN      ] AWK: Loaded 48705 existing records.
[2025-10-24T17:23:05.614713] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present.
[2025-10-24T17:23:05.615030] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed.
[2025-10-24T17:23:05.621334] [INFO ] [MAIN      ] AWI: Fetched primary data is valid.
[2025-10-24T17:23:05.621421] [DEBUG] [LOCAL     ] AWI: Saving primary data.
[2025-10-24T17:23:05.626977] [FATAL] [LOCAL     ] AWI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:23:05.627080] [FATAL] [MAIN      ] AWI: Failed to save primary data.
[2025-10-24T17:23:05.642522] [WARN ] [MAIN      ] AWI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:23:05.656250] [INFO ] [LOCAL     ] AWI: Starting deletion of primary data.
[2025-10-24T17:23:05.661471] [DEBUG] [LOCAL     ] AWI: No primary data file found to delete.
[2025-10-24T17:23:05.667528] [INFO ] [LOCAL     ] AWI: Starting deletion of derivative data.
[2025-10-24T17:23:05.693140] [DEBUG] [LOCAL     ] AWI: Deleted derivative data file.
[2025-10-24T17:23:05.698613] [INFO ] [MAIN      ] Update Progress: 189/2366 symbols completed. AWI took 27.8s. Estimated remaining: 4h 25m 28s. Rate: 8.2 symbols/min
[2025-10-24T17:23:05.698525] [WARN ] [MAIN      ] AWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:23:05.719424] [INFO ] [MAIN      ] AWK: Wiping existing primary data before full refresh.
[2025-10-24T17:23:05.730783] [INFO ] [LOCAL     ] AWK: Starting deletion of primary data.
[2025-10-24T17:23:05.777335] [DEBUG] [LOCAL     ] AWK: Deleted primary data file.
[2025-10-24T17:23:05.794024] [INFO ] [MAIN      ] AWK: Starting full primary refresh.
[2025-10-24T17:23:06.004987] [INFO ] [MAIN      ] AWP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:23:06.206073] [DEBUG] [LOCAL     ] AWP: Loaded 21729 existing records from primary storage.
[2025-10-24T17:23:06.221606] [INFO ] [MAIN      ] AWP: Loaded 21729 existing records.
[2025-10-24T17:23:06.383965] [INFO ] [REMOTE    ] AWK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:23:06.389878] [INFO ] [REMOTE    ] AWK: Fetching primary data for 2025-01.
[2025-10-24T17:23:06.462434] [WARN ] [MAIN      ] AWP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:23:06.462611] [INFO ] [MAIN      ] AWP: Wiping existing primary data before full refresh.
[2025-10-24T17:23:06.462685] [INFO ] [LOCAL     ] AWP: Starting deletion of primary data.
[2025-10-24T17:23:06.463121] [DEBUG] [LOCAL     ] AWP: Deleted primary data file.
[2025-10-24T17:23:06.463181] [INFO ] [MAIN      ] AWP: Starting full primary refresh.
[2025-10-24T17:23:06.824051] [INFO ] [REMOTE    ] AWP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:23:06.824319] [INFO ] [REMOTE    ] AWP: Fetching primary data for 2025-01.
[2025-10-24T17:23:07.290629] [INFO ] [REMOTE    ] AVTR: Incremental fetch complete for 2025-07 (1.99 seconds).
[2025-10-24T17:23:07.302137] [INFO ] [REMOTE    ] AVTR: Fetching primary data for 2025-08.
[2025-10-24T17:23:07.532255] [INFO ] [REMOTE    ] AVY: Incremental fetch complete for 2025-07 (6.58 seconds).
[2025-10-24T17:23:07.540386] [INFO ] [REMOTE    ] AVY: Fetching primary data for 2025-08.
[2025-10-24T17:23:08.305809] [INFO ] [REMOTE    ] AWK: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T17:23:08.315897] [INFO ] [REMOTE    ] AWK: Fetching primary data for 2025-02.
[2025-10-24T17:23:08.332865] [INFO ] [REMOTE    ] AWP: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T17:23:08.338514] [INFO ] [REMOTE    ] AWP: Fetching primary data for 2025-02.
[2025-10-24T17:23:08.970905] [INFO ] [REMOTE    ] AWP: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T17:23:08.975243] [INFO ] [REMOTE    ] AWP: Fetching primary data for 2025-03.
[2025-10-24T17:23:09.042058] [INFO ] [REMOTE    ] AVY: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T17:23:09.049689] [INFO ] [REMOTE    ] AVY: Fetching primary data for 2025-09.
[2025-10-24T17:23:09.167075] [INFO ] [REMOTE    ] AVTR: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T17:23:09.178677] [INFO ] [REMOTE    ] AVTR: Fetching primary data for 2025-09.
[2025-10-24T17:23:09.545602] [INFO ] [REMOTE    ] AWK: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T17:23:09.747697] [INFO ] [REMOTE    ] AWK: Fetching primary data for 2025-03.
[2025-10-24T17:23:09.897808] [INFO ] [REMOTE    ] AWP: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T17:23:10.117259] [INFO ] [REMOTE    ] AVY: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T17:23:10.547616] [INFO ] [REMOTE    ] AWP: Fetching primary data for 2025-04.
[2025-10-24T17:23:10.847775] [INFO ] [REMOTE    ] AVTR: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T17:23:11.109093] [INFO ] [REMOTE    ] AWK: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T17:23:11.347620] [INFO ] [REMOTE    ] AWK: Fetching primary data for 2025-04.
[2025-10-24T17:23:11.585760] [INFO ] [REMOTE    ] AWP: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T17:23:12.147636] [INFO ] [REMOTE    ] AVTR: Fetching primary data for 2025-10.
[2025-10-24T17:23:12.947620] [INFO ] [REMOTE    ] AVY: Fetching primary data for 2025-10.
[2025-10-24T17:23:13.093543] [INFO ] [REMOTE    ] AWK: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T17:23:13.747620] [INFO ] [REMOTE    ] AWK: Fetching primary data for 2025-05.
[2025-10-24T17:23:14.078948] [INFO ] [REMOTE    ] AVTR: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T17:23:14.088634] [INFO ] [REMOTE    ] AVTR: Full fetch complete (77671 records).
[2025-10-24T17:23:14.088790] [DEBUG] [VALIDATOR ] AVTR: Validating primary data.
[2025-10-24T17:23:14.477247] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present.
[2025-10-24T17:23:14.477361] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed.
[2025-10-24T17:23:14.478376] [INFO ] [MAIN      ] AVTR: Fetched primary data is valid.
[2025-10-24T17:23:14.478463] [DEBUG] [LOCAL     ] AVTR: Saving primary data.
[2025-10-24T17:23:14.479193] [FATAL] [LOCAL     ] AVTR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:23:14.479424] [FATAL] [MAIN      ] AVTR: Failed to save primary data.
[2025-10-24T17:23:14.479515] [WARN ] [MAIN      ] AVTR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:23:14.479778] [INFO ] [LOCAL     ] AVTR: Starting deletion of primary data.
[2025-10-24T17:23:14.479881] [DEBUG] [LOCAL     ] AVTR: No primary data file found to delete.
[2025-10-24T17:23:14.479951] [INFO ] [LOCAL     ] AVTR: Starting deletion of derivative data.
[2025-10-24T17:23:14.480254] [DEBUG] [LOCAL     ] AVTR: Deleted derivative data file.
[2025-10-24T17:23:14.480592] [INFO ] [MAIN      ] Update Progress: 190/2366 symbols completed. AVTR took 41.8s. Estimated remaining: 4h 25m 37s. Rate: 8.2 symbols/min
[2025-10-24T17:23:14.565385] [INFO ] [REMOTE    ] AWP: Fetching primary data for 2025-05.
[2025-10-24T17:23:14.613263] [INFO ] [REMOTE    ] AVY: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T17:23:14.671176] [INFO ] [REMOTE    ] AVY: Full fetch complete (56788 records).
[2025-10-24T17:23:14.684951] [DEBUG] [VALIDATOR ] AVY: Validating primary data.
[2025-10-24T17:23:14.705969] [INFO ] [MAIN      ] AWR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:23:14.969733] [DEBUG] [LOCAL     ] AWR: Loaded 22853 existing records from primary storage.
[2025-10-24T17:23:14.984224] [INFO ] [MAIN      ] AWR: Loaded 22853 existing records.
[2025-10-24T17:23:15.328475] [WARN ] [MAIN      ] AWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:23:15.329191] [INFO ] [MAIN      ] AWR: Wiping existing primary data before full refresh.
[2025-10-24T17:23:15.329039] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present.
[2025-10-24T17:23:15.329329] [INFO ] [LOCAL     ] AWR: Starting deletion of primary data.
[2025-10-24T17:23:15.329423] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed.
[2025-10-24T17:23:15.330360] [INFO ] [MAIN      ] AVY: Fetched primary data is valid.
[2025-10-24T17:23:15.330522] [DEBUG] [LOCAL     ] AVY: Saving primary data.
[2025-10-24T17:23:15.330440] [DEBUG] [LOCAL     ] AWR: Deleted primary data file.
[2025-10-24T17:23:15.330639] [INFO ] [MAIN      ] AWR: Starting full primary refresh.
[2025-10-24T17:23:15.351531] [FATAL] [LOCAL     ] AVY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:23:15.395012] [FATAL] [MAIN      ] AVY: Failed to save primary data.
[2025-10-24T17:23:15.407436] [WARN ] [MAIN      ] AVY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:23:15.412765] [INFO ] [LOCAL     ] AVY: Starting deletion of primary data.
[2025-10-24T17:23:15.424286] [DEBUG] [LOCAL     ] AVY: No primary data file found to delete.
[2025-10-24T17:23:15.424415] [INFO ] [LOCAL     ] AVY: Starting deletion of derivative data.
[2025-10-24T17:23:15.435460] [DEBUG] [LOCAL     ] AVY: Deleted derivative data file.
[2025-10-24T17:23:15.435597] [INFO ] [MAIN      ] Update Progress: 191/2366 symbols completed. AVY took 41.4s. Estimated remaining: 4h 24m 17s. Rate: 8.2 symbols/min
[2025-10-24T17:23:15.906803] [INFO ] [MAIN      ] AX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:23:15.899176] [INFO ] [REMOTE    ] AWK: Incremental fetch complete for 2025-05 (2.15 seconds).
[2025-10-24T17:23:15.962835] [INFO ] [REMOTE    ] AWR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:23:15.963903] [INFO ] [REMOTE    ] AWR: Fetching primary data for 2025-01.
[2025-10-24T17:23:15.948851] [INFO ] [REMOTE    ] AWP: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T17:23:15.994992] [DEBUG] [LOCAL     ] AX: Loaded 27971 existing records from primary storage.
[2025-10-24T17:23:15.995260] [INFO ] [MAIN      ] AX: Loaded 27971 existing records.
[2025-10-24T17:23:16.164317] [INFO ] [REMOTE    ] AWP: Fetching primary data for 2025-06.
[2025-10-24T17:23:16.193146] [WARN ] [MAIN      ] AX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:23:16.193449] [INFO ] [MAIN      ] AX: Wiping existing primary data before full refresh.
[2025-10-24T17:23:16.193495] [INFO ] [LOCAL     ] AX: Starting deletion of primary data.
[2025-10-24T17:23:16.194005] [DEBUG] [LOCAL     ] AX: Deleted primary data file.
[2025-10-24T17:23:16.194061] [INFO ] [MAIN      ] AX: Starting full primary refresh.
[2025-10-24T17:23:16.535310] [INFO ] [REMOTE    ] AX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:23:16.947633] [INFO ] [REMOTE    ] AWK: Fetching primary data for 2025-06.
[2025-10-24T17:23:17.101757] [INFO ] [REMOTE    ] AWP: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T17:23:17.129711] [INFO ] [REMOTE    ] AWR: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T17:23:17.747676] [INFO ] [REMOTE    ] AWR: Fetching primary data for 2025-02.
[2025-10-24T17:23:18.547676] [INFO ] [REMOTE    ] AWP: Fetching primary data for 2025-07.
[2025-10-24T17:23:18.593809] [INFO ] [REMOTE    ] AWK: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T17:23:18.889146] [INFO ] [REMOTE    ] AWR: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T17:23:19.347683] [INFO ] [REMOTE    ] AWR: Fetching primary data for 2025-03.
[2025-10-24T17:23:19.793346] [INFO ] [REMOTE    ] AWP: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T17:23:20.147702] [INFO ] [REMOTE    ] AX: Fetching primary data for 2025-01.
[2025-10-24T17:23:20.420674] [INFO ] [REMOTE    ] AWR: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T17:23:20.947724] [INFO ] [REMOTE    ] AWR: Fetching primary data for 2025-04.
[2025-10-24T17:23:21.236342] [INFO ] [REMOTE    ] AX: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T17:23:21.747733] [INFO ] [REMOTE    ] AWP: Fetching primary data for 2025-08.
[2025-10-24T17:23:22.213387] [INFO ] [REMOTE    ] AWR: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T17:23:22.547631] [INFO ] [REMOTE    ] AX: Fetching primary data for 2025-02.
[2025-10-24T17:23:22.853089] [INFO ] [REMOTE    ] AWP: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T17:23:23.347632] [INFO ] [REMOTE    ] AWP: Fetching primary data for 2025-09.
[2025-10-24T17:23:23.994027] [INFO ] [REMOTE    ] AX: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T17:23:24.044310] [INFO ] [REMOTE    ] AWP: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T17:23:24.147626] [INFO ] [REMOTE    ] AWK: Fetching primary data for 2025-07.
[2025-10-24T17:23:24.947668] [INFO ] [REMOTE    ] AWP: Fetching primary data for 2025-10.
[2025-10-24T17:23:25.747718] [INFO ] [REMOTE    ] AWR: Fetching primary data for 2025-05.
[2025-10-24T17:23:25.803081] [INFO ] [REMOTE    ] AWK: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T17:23:26.046459] [INFO ] [REMOTE    ] AWP: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T17:23:26.050380] [INFO ] [REMOTE    ] AWP: Full fetch complete (31407 records).
[2025-10-24T17:23:26.050503] [DEBUG] [VALIDATOR ] AWP: Validating primary data.
[2025-10-24T17:23:26.051077] [FATAL] [VALIDATOR ] AWP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:23:26.051162] [FATAL] [MAIN      ] AWP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:23:26.051206] [WARN ] [MAIN      ] AWP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:23:26.051244] [INFO ] [LOCAL     ] AWP: Starting deletion of primary data.
[2025-10-24T17:23:26.051299] [DEBUG] [LOCAL     ] AWP: No primary data file found to delete.
[2025-10-24T17:23:26.051339] [INFO ] [LOCAL     ] AWP: Starting deletion of derivative data.
[2025-10-24T17:23:26.051470] [DEBUG] [LOCAL     ] AWP: Deleted derivative data file.
[2025-10-24T17:23:26.051599] [INFO ] [MAIN      ] Update Progress: 192/2366 symbols completed. AWP took 20.4s. Estimated remaining: 4h 24m 48s. Rate: 8.2 symbols/min
[2025-10-24T17:23:26.236308] [INFO ] [MAIN      ] AXL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:23:26.292157] [DEBUG] [LOCAL     ] AXL: Loaded 50912 existing records from primary storage.
[2025-10-24T17:23:26.292572] [INFO ] [MAIN      ] AXL: Loaded 50912 existing records.
[2025-10-24T17:23:26.474842] [WARN ] [MAIN      ] AXL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:23:26.475321] [INFO ] [MAIN      ] AXL: Wiping existing primary data before full refresh.
[2025-10-24T17:23:26.475386] [INFO ] [LOCAL     ] AXL: Starting deletion of primary data.
[2025-10-24T17:23:26.476744] [DEBUG] [LOCAL     ] AXL: Deleted primary data file.
[2025-10-24T17:23:26.476804] [INFO ] [MAIN      ] AXL: Starting full primary refresh.
[2025-10-24T17:23:26.551976] [INFO ] [REMOTE    ] AWK: Fetching primary data for 2025-08.
[2025-10-24T17:23:26.756871] [INFO ] [REMOTE    ] AWR: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T17:23:26.877539] [INFO ] [REMOTE    ] AXL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:23:27.347639] [INFO ] [REMOTE    ] AX: Fetching primary data for 2025-03.
[2025-10-24T17:23:28.147691] [INFO ] [REMOTE    ] AWR: Fetching primary data for 2025-06.
[2025-10-24T17:23:28.237290] [INFO ] [REMOTE    ] AWK: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T17:23:28.732173] [INFO ] [REMOTE    ] AX: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T17:23:28.947733] [INFO ] [REMOTE    ] AWK: Fetching primary data for 2025-09.
[2025-10-24T17:23:29.111886] [INFO ] [REMOTE    ] AWR: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T17:23:29.747697] [INFO ] [REMOTE    ] AX: Fetching primary data for 2025-04.
[2025-10-24T17:23:30.547621] [INFO ] [REMOTE    ] AXL: Fetching primary data for 2025-01.
[2025-10-24T17:23:30.768236] [INFO ] [REMOTE    ] AWK: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T17:23:31.072069] [INFO ] [REMOTE    ] AX: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T17:23:31.347629] [INFO ] [REMOTE    ] AX: Fetching primary data for 2025-05.
[2025-10-24T17:23:32.075033] [INFO ] [REMOTE    ] AXL: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T17:23:32.147598] [INFO ] [REMOTE    ] AXL: Fetching primary data for 2025-02.
[2025-10-24T17:23:32.505966] [INFO ] [REMOTE    ] AX: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T17:23:32.947634] [INFO ] [REMOTE    ] AWK: Fetching primary data for 2025-10.
[2025-10-24T17:23:33.693399] [INFO ] [REMOTE    ] AXL: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T17:23:33.747623] [INFO ] [REMOTE    ] AWR: Fetching primary data for 2025-07.
[2025-10-24T17:23:34.547620] [INFO ] [REMOTE    ] AXL: Fetching primary data for 2025-03.
[2025-10-24T17:23:34.860560] [INFO ] [REMOTE    ] AWR: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T17:23:35.015115] [INFO ] [REMOTE    ] AWK: Incremental fetch complete for 2025-10 (2.07 seconds).
[2025-10-24T17:23:35.024308] [INFO ] [REMOTE    ] AWK: Full fetch complete (70879 records).
[2025-10-24T17:23:35.024454] [DEBUG] [VALIDATOR ] AWK: Validating primary data.
[2025-10-24T17:23:35.355062] [INFO ] [REMOTE    ] AWR: Fetching primary data for 2025-08.
[2025-10-24T17:23:35.412213] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present.
[2025-10-24T17:23:35.412299] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed.
[2025-10-24T17:23:35.413136] [INFO ] [MAIN      ] AWK: Fetched primary data is valid.
[2025-10-24T17:23:35.413199] [DEBUG] [LOCAL     ] AWK: Saving primary data.
[2025-10-24T17:23:35.413849] [FATAL] [LOCAL     ] AWK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:23:35.413935] [FATAL] [MAIN      ] AWK: Failed to save primary data.
[2025-10-24T17:23:35.413976] [WARN ] [MAIN      ] AWK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:23:35.414042] [INFO ] [LOCAL     ] AWK: Starting deletion of primary data.
[2025-10-24T17:23:35.414101] [DEBUG] [LOCAL     ] AWK: No primary data file found to delete.
[2025-10-24T17:23:35.414135] [INFO ] [LOCAL     ] AWK: Starting deletion of derivative data.
[2025-10-24T17:23:35.414275] [DEBUG] [LOCAL     ] AWK: Deleted derivative data file.
[2025-10-24T17:23:35.414729] [INFO ] [MAIN      ] Update Progress: 193/2366 symbols completed. AWK took 30.6s. Estimated remaining: 4h 25m 4s. Rate: 8.2 symbols/min
[2025-10-24T17:23:35.579974] [INFO ] [MAIN      ] AXP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:23:35.629785] [DEBUG] [LOCAL     ] AXP: Loaded 53545 existing records from primary storage.
[2025-10-24T17:23:35.630104] [INFO ] [MAIN      ] AXP: Loaded 53545 existing records.
[2025-10-24T17:23:35.805173] [WARN ] [MAIN      ] AXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:23:35.805452] [INFO ] [MAIN      ] AXP: Wiping existing primary data before full refresh.
[2025-10-24T17:23:35.805506] [INFO ] [LOCAL     ] AXP: Starting deletion of primary data.
[2025-10-24T17:23:35.806511] [DEBUG] [LOCAL     ] AXP: Deleted primary data file.
[2025-10-24T17:23:35.806568] [INFO ] [MAIN      ] AXP: Starting full primary refresh.
[2025-10-24T17:23:36.167947] [INFO ] [REMOTE    ] AXP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:23:36.163120] [INFO ] [REMOTE    ] AX: Fetching primary data for 2025-06.
[2025-10-24T17:23:36.211863] [INFO ] [REMOTE    ] AXL: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T17:23:36.264750] [INFO ] [REMOTE    ] AWR: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T17:23:36.947672] [INFO ] [REMOTE    ] AWR: Fetching primary data for 2025-09.
[2025-10-24T17:23:37.366742] [INFO ] [REMOTE    ] AX: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T17:23:37.747618] [INFO ] [REMOTE    ] AXL: Fetching primary data for 2025-04.
[2025-10-24T17:23:37.868832] [INFO ] [REMOTE    ] AWR: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T17:23:38.547691] [INFO ] [REMOTE    ] AX: Fetching primary data for 2025-07.
[2025-10-24T17:23:39.347637] [INFO ] [REMOTE    ] AXP: Fetching primary data for 2025-01.
[2025-10-24T17:23:39.426215] [INFO ] [REMOTE    ] AXL: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T17:23:39.755482] [INFO ] [REMOTE    ] AX: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T17:23:40.147724] [INFO ] [REMOTE    ] AXL: Fetching primary data for 2025-05.
[2025-10-24T17:23:40.947672] [INFO ] [REMOTE    ] AX: Fetching primary data for 2025-08.
[2025-10-24T17:23:41.195039] [INFO ] [REMOTE    ] AXP: Incremental fetch complete for 2025-01 (1.85 seconds).
[2025-10-24T17:23:41.721272] [INFO ] [REMOTE    ] AXL: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T17:23:41.747684] [INFO ] [REMOTE    ] AXL: Fetching primary data for 2025-06.
[2025-10-24T17:23:41.821086] [INFO ] [REMOTE    ] AX: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T17:23:42.547684] [INFO ] [REMOTE    ] AXP: Fetching primary data for 2025-02.
[2025-10-24T17:23:43.357466] [INFO ] [REMOTE    ] AX: Fetching primary data for 2025-09.
[2025-10-24T17:23:43.366828] [INFO ] [REMOTE    ] AXL: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T17:23:44.147619] [INFO ] [REMOTE    ] AXL: Fetching primary data for 2025-07.
[2025-10-24T17:23:44.310845] [INFO ] [REMOTE    ] AXP: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T17:23:44.337476] [INFO ] [REMOTE    ] AX: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T17:23:44.947723] [INFO ] [REMOTE    ] AXP: Fetching primary data for 2025-03.
[2025-10-24T17:23:45.389809] [INFO ] [REMOTE    ] AXL: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T17:23:45.747740] [INFO ] [REMOTE    ] AWR: Fetching primary data for 2025-10.
[2025-10-24T17:23:46.547731] [INFO ] [REMOTE    ] AXL: Fetching primary data for 2025-08.
[2025-10-24T17:23:47.103772] [INFO ] [REMOTE    ] AXP: Incremental fetch complete for 2025-03 (2.16 seconds).
[2025-10-24T17:23:47.133017] [INFO ] [REMOTE    ] AWR: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T17:23:47.137604] [INFO ] [REMOTE    ] AWR: Full fetch complete (32478 records).
[2025-10-24T17:23:47.137768] [DEBUG] [VALIDATOR ] AWR: Validating primary data.
[2025-10-24T17:23:47.358482] [INFO ] [REMOTE    ] AXP: Fetching primary data for 2025-04.
[2025-10-24T17:23:47.535874] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present.
[2025-10-24T17:23:47.535951] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed.
[2025-10-24T17:23:47.536374] [INFO ] [MAIN      ] AWR: Fetched primary data is valid.
[2025-10-24T17:23:47.536412] [DEBUG] [LOCAL     ] AWR: Saving primary data.
[2025-10-24T17:23:47.536743] [FATAL] [LOCAL     ] AWR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:23:47.536825] [FATAL] [MAIN      ] AWR: Failed to save primary data.
[2025-10-24T17:23:47.536866] [WARN ] [MAIN      ] AWR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:23:47.536900] [INFO ] [LOCAL     ] AWR: Starting deletion of primary data.
[2025-10-24T17:23:47.536948] [DEBUG] [LOCAL     ] AWR: No primary data file found to delete.
[2025-10-24T17:23:47.536982] [INFO ] [LOCAL     ] AWR: Starting deletion of derivative data.
[2025-10-24T17:23:47.537126] [DEBUG] [LOCAL     ] AWR: Deleted derivative data file.
[2025-10-24T17:23:47.537213] [INFO ] [MAIN      ] Update Progress: 194/2366 symbols completed. AWR took 33.1s. Estimated remaining: 4h 25m 50s. Rate: 8.2 symbols/min
[2025-10-24T17:23:47.721086] [INFO ] [MAIN      ] AXR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:23:47.725734] [DEBUG] [LOCAL     ] AXR: Loaded 2921 existing records from primary storage.
[2025-10-24T17:23:47.725903] [INFO ] [MAIN      ] AXR: Loaded 2921 existing records.
[2025-10-24T17:23:47.915190] [WARN ] [MAIN      ] AXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:23:47.915563] [INFO ] [MAIN      ] AXR: Wiping existing primary data before full refresh.
[2025-10-24T17:23:47.915627] [INFO ] [LOCAL     ] AXR: Starting deletion of primary data.
[2025-10-24T17:23:47.915895] [DEBUG] [LOCAL     ] AXR: Deleted primary data file.
[2025-10-24T17:23:47.915945] [INFO ] [MAIN      ] AXR: Starting full primary refresh.
[2025-10-24T17:23:48.159325] [INFO ] [REMOTE    ] AX: Fetching primary data for 2025-10.
[2025-10-24T17:23:48.323874] [INFO ] [REMOTE    ] AXL: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T17:23:48.332635] [INFO ] [REMOTE    ] AXR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:23:48.947676] [INFO ] [REMOTE    ] AXR: Fetching primary data for 2025-01.
[2025-10-24T17:23:49.449446] [INFO ] [REMOTE    ] AX: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T17:23:49.455270] [INFO ] [REMOTE    ] AX: Full fetch complete (42011 records).
[2025-10-24T17:23:49.455440] [DEBUG] [VALIDATOR ] AX: Validating primary data.
[2025-10-24T17:23:49.755276] [INFO ] [REMOTE    ] AXL: Fetching primary data for 2025-09.
[2025-10-24T17:23:49.761574] [INFO ] [REMOTE    ] AXR: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T17:23:49.873470] [DEBUG] [VALIDATOR ] AX: All expected trading days are present.
[2025-10-24T17:23:49.873680] [DEBUG] [VALIDATOR ] AX: Primary data validation passed.
[2025-10-24T17:23:49.874568] [INFO ] [MAIN      ] AX: Fetched primary data is valid.
[2025-10-24T17:23:49.874618] [DEBUG] [LOCAL     ] AX: Saving primary data.
[2025-10-24T17:23:49.875280] [FATAL] [LOCAL     ] AX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:23:49.875496] [FATAL] [MAIN      ] AX: Failed to save primary data.
[2025-10-24T17:23:49.875608] [WARN ] [MAIN      ] AX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:23:49.875966] [INFO ] [LOCAL     ] AX: Starting deletion of primary data.
[2025-10-24T17:23:49.876140] [DEBUG] [LOCAL     ] AX: No primary data file found to delete.
[2025-10-24T17:23:49.876189] [INFO ] [LOCAL     ] AX: Starting deletion of derivative data.
[2025-10-24T17:23:49.886916] [DEBUG] [LOCAL     ] AX: Deleted derivative data file.
[2025-10-24T17:23:49.900953] [INFO ] [MAIN      ] Update Progress: 195/2366 symbols completed. AX took 34.5s. Estimated remaining: 4h 24m 47s. Rate: 8.2 symbols/min
[2025-10-24T17:23:49.940006] [INFO ] [REMOTE    ] AXP: Incremental fetch complete for 2025-04 (2.58 seconds).
[2025-10-24T17:23:50.094054] [INFO ] [MAIN      ] AXS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:23:50.131595] [DEBUG] [LOCAL     ] AXS: Loaded 39045 existing records from primary storage.
[2025-10-24T17:23:50.131901] [INFO ] [MAIN      ] AXS: Loaded 39045 existing records.
[2025-10-24T17:23:50.316689] [WARN ] [MAIN      ] AXS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:23:50.316872] [INFO ] [MAIN      ] AXS: Wiping existing primary data before full refresh.
[2025-10-24T17:23:50.316919] [INFO ] [LOCAL     ] AXS: Starting deletion of primary data.
[2025-10-24T17:23:50.317618] [DEBUG] [LOCAL     ] AXS: Deleted primary data file.
[2025-10-24T17:23:50.317712] [INFO ] [MAIN      ] AXS: Starting full primary refresh.
[2025-10-24T17:23:50.555262] [INFO ] [REMOTE    ] AXR: Fetching primary data for 2025-02.
[2025-10-24T17:23:50.678562] [INFO ] [REMOTE    ] AXS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:23:51.081093] [INFO ] [REMOTE    ] AXR: Incremental fetch complete for 2025-02 (0.53 seconds).
[2025-10-24T17:23:51.347626] [INFO ] [REMOTE    ] AXR: Fetching primary data for 2025-03.
[2025-10-24T17:23:51.432626] [INFO ] [REMOTE    ] AXL: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T17:23:51.971186] [INFO ] [REMOTE    ] AXR: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T17:23:52.147716] [INFO ] [REMOTE    ] AXP: Fetching primary data for 2025-05.
[2025-10-24T17:23:52.947625] [INFO ] [REMOTE    ] AXR: Fetching primary data for 2025-04.
[2025-10-24T17:23:53.510866] [INFO ] [REMOTE    ] AXR: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T17:23:53.747609] [INFO ] [REMOTE    ] AXS: Fetching primary data for 2025-01.
[2025-10-24T17:23:54.196822] [INFO ] [REMOTE    ] AXP: Incremental fetch complete for 2025-05 (2.05 seconds).
[2025-10-24T17:23:54.547738] [INFO ] [REMOTE    ] AXP: Fetching primary data for 2025-06.
[2025-10-24T17:23:55.251991] [INFO ] [REMOTE    ] AXS: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T17:23:55.347607] [INFO ] [REMOTE    ] AXS: Fetching primary data for 2025-02.
[2025-10-24T17:23:56.147620] [INFO ] [REMOTE    ] AXL: Fetching primary data for 2025-10.
[2025-10-24T17:23:56.237474] [INFO ] [REMOTE    ] AXP: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T17:23:56.689827] [INFO ] [REMOTE    ] AXS: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T17:23:56.947683] [INFO ] [REMOTE    ] AXR: Fetching primary data for 2025-05.
[2025-10-24T17:23:57.481109] [INFO ] [REMOTE    ] AXR: Incremental fetch complete for 2025-05 (0.53 seconds).
[2025-10-24T17:23:57.669990] [INFO ] [REMOTE    ] AXL: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T17:23:57.680182] [INFO ] [REMOTE    ] AXL: Full fetch complete (73214 records).
[2025-10-24T17:23:57.680330] [DEBUG] [VALIDATOR ] AXL: Validating primary data.
[2025-10-24T17:23:57.752871] [INFO ] [REMOTE    ] AXS: Fetching primary data for 2025-03.
[2025-10-24T17:23:58.127492] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present.
[2025-10-24T17:23:58.127607] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed.
[2025-10-24T17:23:58.128909] [INFO ] [MAIN      ] AXL: Fetched primary data is valid.
[2025-10-24T17:23:58.129024] [DEBUG] [LOCAL     ] AXL: Saving primary data.
[2025-10-24T17:23:58.129766] [FATAL] [LOCAL     ] AXL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:23:58.129870] [FATAL] [MAIN      ] AXL: Failed to save primary data.
[2025-10-24T17:23:58.129954] [WARN ] [MAIN      ] AXL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:23:58.130043] [INFO ] [LOCAL     ] AXL: Starting deletion of primary data.
[2025-10-24T17:23:58.130140] [DEBUG] [LOCAL     ] AXL: No primary data file found to delete.
[2025-10-24T17:23:58.130207] [INFO ] [LOCAL     ] AXL: Starting deletion of derivative data.
[2025-10-24T17:23:58.130387] [DEBUG] [LOCAL     ] AXL: Deleted derivative data file.
[2025-10-24T17:23:58.130976] [INFO ] [MAIN      ] Update Progress: 196/2366 symbols completed. AXL took 32.1s. Estimated remaining: 4h 24m 50s. Rate: 8.2 symbols/min
[2025-10-24T17:23:58.338500] [INFO ] [MAIN      ] AXTA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:23:58.391694] [DEBUG] [LOCAL     ] AXTA: Loaded 52680 existing records from primary storage.
[2025-10-24T17:23:58.392074] [INFO ] [MAIN      ] AXTA: Loaded 52680 existing records.
[2025-10-24T17:23:58.554425] [INFO ] [REMOTE    ] AXR: Fetching primary data for 2025-06.
[2025-10-24T17:23:58.599115] [WARN ] [MAIN      ] AXTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:23:58.599323] [INFO ] [MAIN      ] AXTA: Wiping existing primary data before full refresh.
[2025-10-24T17:23:58.599381] [INFO ] [LOCAL     ] AXTA: Starting deletion of primary data.
[2025-10-24T17:23:58.600223] [DEBUG] [LOCAL     ] AXTA: Deleted primary data file.
[2025-10-24T17:23:58.600279] [INFO ] [MAIN      ] AXTA: Starting full primary refresh.
[2025-10-24T17:23:59.026275] [INFO ] [REMOTE    ] AXTA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:23:59.027236] [INFO ] [REMOTE    ] AXR: Incremental fetch complete for 2025-06 (0.47 seconds).
[2025-10-24T17:23:59.258186] [INFO ] [REMOTE    ] AXS: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T17:23:59.347631] [INFO ] [REMOTE    ] AXS: Fetching primary data for 2025-04.
[2025-10-24T17:24:00.147677] [INFO ] [REMOTE    ] AXP: Fetching primary data for 2025-07.
[2025-10-24T17:24:00.755986] [INFO ] [REMOTE    ] AXS: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T17:24:00.947666] [INFO ] [REMOTE    ] AXR: Fetching primary data for 2025-07.
[2025-10-24T17:24:01.747635] [INFO ] [REMOTE    ] AXS: Fetching primary data for 2025-05.
[2025-10-24T17:24:02.547624] [INFO ] [REMOTE    ] AXTA: Fetching primary data for 2025-01.
[2025-10-24T17:24:03.022865] [INFO ] [REMOTE    ] AXR: Incremental fetch complete for 2025-07 (2.08 seconds).
[2025-10-24T17:24:03.024338] [INFO ] [REMOTE    ] AXP: Incremental fetch complete for 2025-07 (2.88 seconds).
[2025-10-24T17:24:03.347724] [INFO ] [REMOTE    ] AXR: Fetching primary data for 2025-08.
[2025-10-24T17:24:03.826485] [INFO ] [REMOTE    ] AXR: Incremental fetch complete for 2025-08 (0.48 seconds).
[2025-10-24T17:24:04.147620] [INFO ] [REMOTE    ] AXP: Fetching primary data for 2025-08.
[2025-10-24T17:24:04.391129] [INFO ] [REMOTE    ] AXS: Incremental fetch complete for 2025-05 (2.64 seconds).
[2025-10-24T17:24:04.947765] [INFO ] [REMOTE    ] AXS: Fetching primary data for 2025-06.
[2025-10-24T17:24:05.218354] [INFO ] [REMOTE    ] AXTA: Incremental fetch complete for 2025-01 (2.67 seconds).
[2025-10-24T17:24:05.747627] [INFO ] [REMOTE    ] AXTA: Fetching primary data for 2025-02.
[2025-10-24T17:24:06.216115] [INFO ] [REMOTE    ] AXP: Incremental fetch complete for 2025-08 (2.07 seconds).
[2025-10-24T17:24:06.419127] [INFO ] [REMOTE    ] AXS: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T17:24:06.547718] [INFO ] [REMOTE    ] AXR: Fetching primary data for 2025-09.
[2025-10-24T17:24:07.205472] [INFO ] [REMOTE    ] AXR: Incremental fetch complete for 2025-09 (0.66 seconds).
[2025-10-24T17:24:07.302352] [INFO ] [REMOTE    ] AXTA: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T17:24:07.347676] [INFO ] [REMOTE    ] AXS: Fetching primary data for 2025-07.
[2025-10-24T17:24:08.147671] [INFO ] [REMOTE    ] AXP: Fetching primary data for 2025-09.
[2025-10-24T17:24:08.558545] [INFO ] [REMOTE    ] AXS: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T17:24:08.947711] [INFO ] [REMOTE    ] AXR: Fetching primary data for 2025-10.
[2025-10-24T17:24:09.479623] [INFO ] [REMOTE    ] AXR: Incremental fetch complete for 2025-10 (0.53 seconds).
[2025-10-24T17:24:09.480958] [INFO ] [REMOTE    ] AXR: Full fetch complete (4326 records).
[2025-10-24T17:24:09.481070] [DEBUG] [VALIDATOR ] AXR: Validating primary data.
[2025-10-24T17:24:09.754868] [INFO ] [REMOTE    ] AXTA: Fetching primary data for 2025-03.
[2025-10-24T17:24:09.844194] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present.
[2025-10-24T17:24:09.844270] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed.
[2025-10-24T17:24:09.844412] [INFO ] [MAIN      ] AXR: Fetched primary data is valid.
[2025-10-24T17:24:09.844451] [DEBUG] [LOCAL     ] AXR: Saving primary data.
[2025-10-24T17:24:09.844625] [FATAL] [LOCAL     ] AXR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:24:09.844725] [FATAL] [MAIN      ] AXR: Failed to save primary data.
[2025-10-24T17:24:09.844768] [WARN ] [MAIN      ] AXR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:24:09.844829] [INFO ] [LOCAL     ] AXR: Starting deletion of primary data.
[2025-10-24T17:24:09.844887] [DEBUG] [LOCAL     ] AXR: No primary data file found to delete.
[2025-10-24T17:24:09.844922] [INFO ] [LOCAL     ] AXR: Starting deletion of derivative data.
[2025-10-24T17:24:09.845064] [DEBUG] [LOCAL     ] AXR: Deleted derivative data file.
[2025-10-24T17:24:09.845136] [INFO ] [MAIN      ] Update Progress: 197/2366 symbols completed. AXR took 22.3s. Estimated remaining: 4h 25m 31s. Rate: 8.2 symbols/min
[2025-10-24T17:24:10.317950] [INFO ] [REMOTE    ] AXP: Incremental fetch complete for 2025-09 (2.17 seconds).
[2025-10-24T17:24:10.547741] [INFO ] [REMOTE    ] AXS: Fetching primary data for 2025-08.
[2025-10-24T17:24:11.347731] [INFO ] [REMOTE    ] AXP: Fetching primary data for 2025-10.
[2025-10-24T17:24:11.389565] [INFO ] [REMOTE    ] AXTA: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T17:24:11.835490] [INFO ] [REMOTE    ] AXS: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T17:24:12.147719] [INFO ] [REMOTE    ] AXS: Fetching primary data for 2025-09.
[2025-10-24T17:24:12.947675] [INFO ] [REMOTE    ] AXTA: Fetching primary data for 2025-04.
[2025-10-24T17:24:13.362742] [INFO ] [REMOTE    ] AXP: Incremental fetch complete for 2025-10 (2.02 seconds).
[2025-10-24T17:24:13.372371] [INFO ] [REMOTE    ] AXP: Full fetch complete (77103 records).
[2025-10-24T17:24:13.372509] [DEBUG] [VALIDATOR ] AXP: Validating primary data.
[2025-10-24T17:24:13.770429] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present.
[2025-10-24T17:24:13.770721] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed.
[2025-10-24T17:24:13.771763] [INFO ] [MAIN      ] AXP: Fetched primary data is valid.
[2025-10-24T17:24:13.780727] [DEBUG] [LOCAL     ] AXP: Saving primary data.
[2025-10-24T17:24:13.796808] [FATAL] [LOCAL     ] AXP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:24:13.796995] [FATAL] [MAIN      ] AXP: Failed to save primary data.
[2025-10-24T17:24:13.797278] [WARN ] [MAIN      ] AXP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:24:13.798698] [INFO ] [REMOTE    ] AXS: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T17:24:13.797788] [INFO ] [LOCAL     ] AXP: Starting deletion of primary data.
[2025-10-24T17:24:13.807354] [DEBUG] [LOCAL     ] AXP: No primary data file found to delete.
[2025-10-24T17:24:13.807582] [INFO ] [LOCAL     ] AXP: Starting deletion of derivative data.
[2025-10-24T17:24:13.807792] [DEBUG] [LOCAL     ] AXP: Deleted derivative data file.
[2025-10-24T17:24:13.808043] [INFO ] [MAIN      ] Update Progress: 198/2366 symbols completed. AXP took 38.4s. Estimated remaining: 4h 24m 47s. Rate: 8.2 symbols/min
[2025-10-24T17:24:13.808396] [INFO ] [REMOTE    ] AXS: Fetching primary data for 2025-10.
[2025-10-24T17:24:14.591543] [INFO ] [REMOTE    ] AXTA: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T17:24:14.602579] [INFO ] [REMOTE    ] AXTA: Fetching primary data for 2025-05.
[2025-10-24T17:24:15.513777] [INFO ] [REMOTE    ] AXS: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T17:24:15.521477] [INFO ] [REMOTE    ] AXS: Full fetch complete (56257 records).
[2025-10-24T17:24:15.521613] [DEBUG] [VALIDATOR ] AXS: Validating primary data.
[2025-10-24T17:24:15.928747] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present.
[2025-10-24T17:24:15.928827] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed.
[2025-10-24T17:24:15.929431] [INFO ] [MAIN      ] AXS: Fetched primary data is valid.
[2025-10-24T17:24:15.929472] [DEBUG] [LOCAL     ] AXS: Saving primary data.
[2025-10-24T17:24:15.929997] [FATAL] [LOCAL     ] AXS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:24:15.930100] [FATAL] [MAIN      ] AXS: Failed to save primary data.
[2025-10-24T17:24:15.930170] [WARN ] [MAIN      ] AXS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:24:15.930266] [INFO ] [LOCAL     ] AXS: Starting deletion of primary data.
[2025-10-24T17:24:15.930343] [DEBUG] [LOCAL     ] AXS: No primary data file found to delete.
[2025-10-24T17:24:15.930380] [INFO ] [LOCAL     ] AXS: Starting deletion of derivative data.
[2025-10-24T17:24:15.930525] [DEBUG] [LOCAL     ] AXS: Deleted derivative data file.
[2025-10-24T17:24:15.930619] [INFO ] [MAIN      ] Update Progress: 199/2366 symbols completed. AXS took 26.0s. Estimated remaining: 4h 23m 43s. Rate: 8.2 symbols/min
[2025-10-24T17:24:16.625879] [INFO ] [REMOTE    ] AXTA: Incremental fetch complete for 2025-05 (2.02 seconds).
[2025-10-24T17:24:16.638339] [INFO ] [REMOTE    ] AXTA: Fetching primary data for 2025-06.
[2025-10-24T17:24:18.247015] [INFO ] [REMOTE    ] AXTA: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T17:24:18.257629] [INFO ] [REMOTE    ] AXTA: Fetching primary data for 2025-07.
[2025-10-24T17:24:20.022598] [INFO ] [REMOTE    ] AXTA: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T17:24:20.034083] [INFO ] [REMOTE    ] AXTA: Fetching primary data for 2025-08.
[2025-10-24T17:24:21.582172] [INFO ] [REMOTE    ] AXTA: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T17:24:21.593147] [INFO ] [REMOTE    ] AXTA: Fetching primary data for 2025-09.
[2025-10-24T17:24:23.229444] [INFO ] [REMOTE    ] AXTA: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T17:24:23.240550] [INFO ] [REMOTE    ] AXTA: Fetching primary data for 2025-10.
[2025-10-24T17:24:25.137627] [INFO ] [REMOTE    ] AXTA: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T17:24:25.147779] [INFO ] [REMOTE    ] AXTA: Full fetch complete (75500 records).
[2025-10-24T17:24:25.147943] [DEBUG] [VALIDATOR ] AXTA: Validating primary data.
[2025-10-24T17:24:25.578122] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present.
[2025-10-24T17:24:25.578218] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed.
[2025-10-24T17:24:25.579079] [INFO ] [MAIN      ] AXTA: Fetched primary data is valid.
[2025-10-24T17:24:25.579142] [DEBUG] [LOCAL     ] AXTA: Saving primary data.
[2025-10-24T17:24:25.579757] [FATAL] [LOCAL     ] AXTA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:24:25.579858] [FATAL] [MAIN      ] AXTA: Failed to save primary data.
[2025-10-24T17:24:25.579900] [WARN ] [MAIN      ] AXTA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:24:25.579935] [INFO ] [LOCAL     ] AXTA: Starting deletion of primary data.
[2025-10-24T17:24:25.579987] [DEBUG] [LOCAL     ] AXTA: No primary data file found to delete.
[2025-10-24T17:24:25.580021] [INFO ] [LOCAL     ] AXTA: Starting deletion of derivative data.
[2025-10-24T17:24:25.580169] [DEBUG] [LOCAL     ] AXTA: Deleted derivative data file.
[2025-10-24T17:24:25.580397] [INFO ] [MAIN      ] Update Progress: 200/2366 symbols completed. AXTA took 27.4s. Estimated remaining: 4h 24m 1s. Rate: 8.2 symbols/min
[2025-10-24T17:24:26.211547] [INFO ] [MAIN      ] AZO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:24:26.208614] [INFO ] [MAIN      ] B: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:24:26.249050] [DEBUG] [LOCAL     ] B: No existing data file found in primary storage.
[2025-10-24T17:24:26.249425] [WARN ] [MAIN      ] B: No existing data found, performing full refresh instead.
[2025-10-24T17:24:26.300627] [INFO ] [MAIN      ] B: Wiping existing primary data before full refresh.
[2025-10-24T17:24:26.308281] [INFO ] [LOCAL     ] B: Starting deletion of primary data.
[2025-10-24T17:24:26.308106] [INFO ] [MAIN      ] AZZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:24:26.308427] [DEBUG] [LOCAL     ] B: No primary data file found to delete.
[2025-10-24T17:24:26.308569] [INFO ] [MAIN      ] B: Starting full primary refresh.
[2025-10-24T17:24:26.304740] [INFO ] [MAIN      ] AYI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:24:26.422030] [DEBUG] [LOCAL     ] AZO: Loaded 10939 existing records from primary storage.
[2025-10-24T17:24:26.434887] [INFO ] [MAIN      ] AZO: Loaded 10939 existing records.
[2025-10-24T17:24:26.596929] [DEBUG] [LOCAL     ] AZZ: Loaded 23076 existing records from primary storage.
[2025-10-24T17:24:26.624584] [INFO ] [MAIN      ] AZZ: Loaded 23076 existing records.
[2025-10-24T17:24:26.635433] [DEBUG] [LOCAL     ] AYI: Loaded 24188 existing records from primary storage.
[2025-10-24T17:24:26.696976] [INFO ] [MAIN      ] AYI: Loaded 24188 existing records.
[2025-10-24T17:24:27.214053] [WARN ] [MAIN      ] AZO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:24:27.274998] [INFO ] [MAIN      ] AZO: Wiping existing primary data before full refresh.
[2025-10-24T17:24:27.256019] [WARN ] [MAIN      ] AZZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:24:27.292568] [INFO ] [LOCAL     ] AZO: Starting deletion of primary data.
[2025-10-24T17:24:27.292418] [INFO ] [MAIN      ] AZZ: Wiping existing primary data before full refresh.
[2025-10-24T17:24:27.308572] [INFO ] [REMOTE    ] B: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:24:27.313945] [DEBUG] [LOCAL     ] AZO: Deleted primary data file.
[2025-10-24T17:24:27.343588] [INFO ] [REMOTE    ] B: Fetching primary data for 2025-01.
[2025-10-24T17:24:27.358113] [INFO ] [LOCAL     ] AZZ: Starting deletion of primary data.
[2025-10-24T17:24:27.381053] [INFO ] [MAIN      ] AZO: Starting full primary refresh.
[2025-10-24T17:24:27.380972] [WARN ] [MAIN      ] AYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:24:27.382334] [DEBUG] [LOCAL     ] AZZ: Deleted primary data file.
[2025-10-24T17:24:27.382500] [INFO ] [MAIN      ] AZZ: Starting full primary refresh.
[2025-10-24T17:24:27.402898] [INFO ] [MAIN      ] AYI: Wiping existing primary data before full refresh.
[2025-10-24T17:24:27.450888] [INFO ] [LOCAL     ] AYI: Starting deletion of primary data.
[2025-10-24T17:24:27.592840] [DEBUG] [LOCAL     ] AYI: Deleted primary data file.
[2025-10-24T17:24:27.674334] [INFO ] [MAIN      ] AYI: Starting full primary refresh.
[2025-10-24T17:24:28.628739] [INFO ] [REMOTE    ] AZO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:24:28.692208] [INFO ] [REMOTE    ] AZZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:24:28.692535] [INFO ] [REMOTE    ] AZZ: Fetching primary data for 2025-01.
[2025-10-24T17:24:28.686351] [INFO ] [REMOTE    ] AZO: Fetching primary data for 2025-01.
[2025-10-24T17:24:28.776174] [INFO ] [REMOTE    ] AYI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:24:28.776760] [INFO ] [REMOTE    ] AYI: Fetching primary data for 2025-01.
[2025-10-24T17:24:28.797885] [INFO ] [REMOTE    ] B: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T17:24:28.807083] [INFO ] [REMOTE    ] B: Fetching primary data for 2025-02.
[2025-10-24T17:24:28.992512] [DEBUG] [REMOTE    ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:24:28.992816] [WARN ] [REMOTE    ] B: No data returned for month 2025-02
[2025-10-24T17:24:28.992899] [FATAL] [REMOTE    ] B: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:24:28.992994] [FATAL] [MAIN      ] B: Failed to fetch primary data.
[2025-10-24T17:24:28.993060] [WARN ] [MAIN      ] B: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:24:28.993130] [INFO ] [LOCAL     ] B: Starting deletion of primary data.
[2025-10-24T17:24:28.993229] [DEBUG] [LOCAL     ] B: No primary data file found to delete.
[2025-10-24T17:24:28.993273] [INFO ] [LOCAL     ] B: Starting deletion of derivative data.
[2025-10-24T17:24:28.993315] [DEBUG] [LOCAL     ] B: No derivative data file found to delete.
[2025-10-24T17:24:28.993361] [INFO ] [MAIN      ] Update Progress: 201/2366 symbols completed. B took 3.4s. Estimated remaining: 4h 23m 12s. Rate: 8.2 symbols/min
[2025-10-24T17:24:29.159728] [INFO ] [MAIN      ] BA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:24:29.211125] [DEBUG] [LOCAL     ] BA: Loaded 54180 existing records from primary storage.
[2025-10-24T17:24:29.211411] [INFO ] [MAIN      ] BA: Loaded 54180 existing records.
[2025-10-24T17:24:29.392671] [WARN ] [MAIN      ] BA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:24:29.392897] [INFO ] [MAIN      ] BA: Wiping existing primary data before full refresh.
[2025-10-24T17:24:29.392946] [INFO ] [LOCAL     ] BA: Starting deletion of primary data.
[2025-10-24T17:24:29.393930] [DEBUG] [LOCAL     ] BA: Deleted primary data file.
[2025-10-24T17:24:29.393987] [INFO ] [MAIN      ] BA: Starting full primary refresh.
[2025-10-24T17:24:29.708358] [INFO ] [REMOTE    ] AZO: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T17:24:29.729857] [INFO ] [REMOTE    ] AZO: Fetching primary data for 2025-02.
[2025-10-24T17:24:29.769145] [INFO ] [REMOTE    ] BA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:24:29.770277] [INFO ] [REMOTE    ] BA: Fetching primary data for 2025-01.
[2025-10-24T17:24:29.906318] [INFO ] [REMOTE    ] AZZ: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T17:24:29.910796] [INFO ] [REMOTE    ] AZZ: Fetching primary data for 2025-02.
[2025-10-24T17:24:30.326973] [INFO ] [REMOTE    ] AYI: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T17:24:30.334221] [INFO ] [REMOTE    ] AYI: Fetching primary data for 2025-02.
[2025-10-24T17:24:30.568545] [INFO ] [REMOTE    ] AZO: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T17:24:30.571039] [INFO ] [REMOTE    ] AZO: Fetching primary data for 2025-03.
[2025-10-24T17:24:30.592248] [INFO ] [REMOTE    ] AZZ: Incremental fetch complete for 2025-02 (0.68 seconds).
[2025-10-24T17:24:30.598179] [INFO ] [REMOTE    ] AZZ: Fetching primary data for 2025-03.
[2025-10-24T17:24:31.105610] [INFO ] [REMOTE    ] AYI: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T17:24:31.110348] [INFO ] [REMOTE    ] AYI: Fetching primary data for 2025-03.
[2025-10-24T17:24:31.551992] [INFO ] [REMOTE    ] AZO: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T17:24:31.558534] [INFO ] [REMOTE    ] AZO: Fetching primary data for 2025-04.
[2025-10-24T17:24:31.761610] [INFO ] [REMOTE    ] AZZ: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T17:24:31.768968] [INFO ] [REMOTE    ] AZZ: Fetching primary data for 2025-04.
[2025-10-24T17:24:32.093897] [INFO ] [REMOTE    ] AYI: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T17:24:32.100446] [INFO ] [REMOTE    ] AYI: Fetching primary data for 2025-04.
[2025-10-24T17:24:32.168180] [INFO ] [REMOTE    ] BA: Incremental fetch complete for 2025-01 (2.40 seconds).
[2025-10-24T17:24:32.178694] [INFO ] [REMOTE    ] BA: Fetching primary data for 2025-02.
[2025-10-24T17:24:32.203945] [INFO ] [REMOTE    ] AZO: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T17:24:32.207338] [INFO ] [REMOTE    ] AZO: Fetching primary data for 2025-05.
[2025-10-24T17:24:32.943488] [INFO ] [REMOTE    ] AZZ: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T17:24:32.949304] [INFO ] [REMOTE    ] AZZ: Fetching primary data for 2025-05.
[2025-10-24T17:24:33.007728] [INFO ] [REMOTE    ] AZO: Incremental fetch complete for 2025-05 (0.80 seconds).
[2025-10-24T17:24:33.219965] [INFO ] [REMOTE    ] AYI: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T17:24:33.747686] [INFO ] [REMOTE    ] AYI: Fetching primary data for 2025-05.
[2025-10-24T17:24:34.079864] [INFO ] [REMOTE    ] AZZ: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T17:24:34.396369] [INFO ] [REMOTE    ] BA: Incremental fetch complete for 2025-02 (2.22 seconds).
[2025-10-24T17:24:34.547679] [INFO ] [REMOTE    ] AZZ: Fetching primary data for 2025-06.
[2025-10-24T17:24:34.701794] [INFO ] [REMOTE    ] AYI: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T17:24:35.347713] [INFO ] [REMOTE    ] BA: Fetching primary data for 2025-03.
[2025-10-24T17:24:35.460349] [INFO ] [REMOTE    ] AZZ: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T17:24:36.147748] [INFO ] [REMOTE    ] AZO: Fetching primary data for 2025-06.
[2025-10-24T17:24:36.947617] [INFO ] [REMOTE    ] AYI: Fetching primary data for 2025-06.
[2025-10-24T17:24:36.991701] [INFO ] [REMOTE    ] AZO: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T17:24:37.755676] [INFO ] [REMOTE    ] AZO: Fetching primary data for 2025-07.
[2025-10-24T17:24:37.761959] [INFO ] [REMOTE    ] BA: Incremental fetch complete for 2025-03 (2.41 seconds).
[2025-10-24T17:24:38.205381] [INFO ] [REMOTE    ] AYI: Incremental fetch complete for 2025-06 (1.26 seconds).
[2025-10-24T17:24:38.547748] [INFO ] [REMOTE    ] BA: Fetching primary data for 2025-04.
[2025-10-24T17:24:38.592382] [INFO ] [REMOTE    ] AZO: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T17:24:39.347695] [INFO ] [REMOTE    ] AZO: Fetching primary data for 2025-08.
[2025-10-24T17:24:40.147732] [INFO ] [REMOTE    ] AZZ: Fetching primary data for 2025-07.
[2025-10-24T17:24:40.252964] [INFO ] [REMOTE    ] AZO: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T17:24:40.947611] [INFO ] [REMOTE    ] AZO: Fetching primary data for 2025-09.
[2025-10-24T17:24:41.028202] [INFO ] [REMOTE    ] BA: Incremental fetch complete for 2025-04 (2.48 seconds).
[2025-10-24T17:24:41.232202] [INFO ] [REMOTE    ] AZZ: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T17:24:41.747633] [INFO ] [REMOTE    ] BA: Fetching primary data for 2025-05.
[2025-10-24T17:24:41.907575] [INFO ] [REMOTE    ] AZO: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T17:24:42.547730] [INFO ] [REMOTE    ] AZZ: Fetching primary data for 2025-08.
[2025-10-24T17:24:43.347738] [INFO ] [REMOTE    ] AZO: Fetching primary data for 2025-10.
[2025-10-24T17:24:43.488130] [INFO ] [REMOTE    ] AZZ: Incremental fetch complete for 2025-08 (0.94 seconds).
[2025-10-24T17:24:44.147720] [INFO ] [REMOTE    ] AYI: Fetching primary data for 2025-07.
[2025-10-24T17:24:44.205212] [INFO ] [REMOTE    ] BA: Incremental fetch complete for 2025-05 (2.46 seconds).
[2025-10-24T17:24:44.205467] [INFO ] [REMOTE    ] AZO: Incremental fetch complete for 2025-10 (0.86 seconds).
[2025-10-24T17:24:44.221220] [INFO ] [REMOTE    ] AZO: Full fetch complete (16017 records).
[2025-10-24T17:24:44.221432] [DEBUG] [VALIDATOR ] AZO: Validating primary data.
[2025-10-24T17:24:44.593822] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present.
[2025-10-24T17:24:44.593948] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed.
[2025-10-24T17:24:44.594292] [INFO ] [MAIN      ] AZO: Fetched primary data is valid.
[2025-10-24T17:24:44.594334] [DEBUG] [LOCAL     ] AZO: Saving primary data.
[2025-10-24T17:24:44.594603] [FATAL] [LOCAL     ] AZO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:24:44.594707] [FATAL] [MAIN      ] AZO: Failed to save primary data.
[2025-10-24T17:24:44.594751] [WARN ] [MAIN      ] AZO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:24:44.594785] [INFO ] [LOCAL     ] AZO: Starting deletion of primary data.
[2025-10-24T17:24:44.594836] [DEBUG] [LOCAL     ] AZO: No primary data file found to delete.
[2025-10-24T17:24:44.594924] [INFO ] [LOCAL     ] AZO: Starting deletion of derivative data.
[2025-10-24T17:24:44.595069] [DEBUG] [LOCAL     ] AZO: Deleted derivative data file.
[2025-10-24T17:24:44.595141] [INFO ] [MAIN      ] Update Progress: 202/2366 symbols completed. AZO took 19.0s. Estimated remaining: 4h 24m 33s. Rate: 8.2 symbols/min
[2025-10-24T17:24:44.760738] [INFO ] [MAIN      ] BABA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:24:44.814048] [DEBUG] [LOCAL     ] BABA: Loaded 54210 existing records from primary storage.
[2025-10-24T17:24:44.814347] [INFO ] [MAIN      ] BABA: Loaded 54210 existing records.
[2025-10-24T17:24:44.953177] [INFO ] [REMOTE    ] AZZ: Fetching primary data for 2025-09.
[2025-10-24T17:24:44.997861] [WARN ] [MAIN      ] BABA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:24:44.998092] [INFO ] [MAIN      ] BABA: Wiping existing primary data before full refresh.
[2025-10-24T17:24:44.998151] [INFO ] [LOCAL     ] BABA: Starting deletion of primary data.
[2025-10-24T17:24:44.999256] [DEBUG] [LOCAL     ] BABA: Deleted primary data file.
[2025-10-24T17:24:44.999314] [INFO ] [MAIN      ] BABA: Starting full primary refresh.
[2025-10-24T17:24:45.359168] [INFO ] [REMOTE    ] BABA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:24:45.378813] [INFO ] [REMOTE    ] AYI: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T17:24:45.747620] [INFO ] [REMOTE    ] AYI: Fetching primary data for 2025-08.
[2025-10-24T17:24:46.006724] [INFO ] [REMOTE    ] AZZ: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T17:24:46.547685] [INFO ] [REMOTE    ] AZZ: Fetching primary data for 2025-10.
[2025-10-24T17:24:46.878585] [INFO ] [REMOTE    ] AYI: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T17:24:47.347748] [INFO ] [REMOTE    ] BABA: Fetching primary data for 2025-01.
[2025-10-24T17:24:47.677719] [INFO ] [REMOTE    ] AZZ: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T17:24:47.683227] [INFO ] [REMOTE    ] AZZ: Full fetch complete (32192 records).
[2025-10-24T17:24:47.683310] [DEBUG] [VALIDATOR ] AZZ: Validating primary data.
[2025-10-24T17:24:48.052434] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present.
[2025-10-24T17:24:48.052509] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed.
[2025-10-24T17:24:48.052940] [INFO ] [MAIN      ] AZZ: Fetched primary data is valid.
[2025-10-24T17:24:48.053000] [DEBUG] [LOCAL     ] AZZ: Saving primary data.
[2025-10-24T17:24:48.053313] [FATAL] [LOCAL     ] AZZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:24:48.053397] [FATAL] [MAIN      ] AZZ: Failed to save primary data.
[2025-10-24T17:24:48.053438] [WARN ] [MAIN      ] AZZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:24:48.053472] [INFO ] [LOCAL     ] AZZ: Starting deletion of primary data.
[2025-10-24T17:24:48.053521] [DEBUG] [LOCAL     ] AZZ: No primary data file found to delete.
[2025-10-24T17:24:48.053556] [INFO ] [LOCAL     ] AZZ: Starting deletion of derivative data.
[2025-10-24T17:24:48.053739] [DEBUG] [LOCAL     ] AZZ: Deleted derivative data file.
[2025-10-24T17:24:48.053828] [INFO ] [MAIN      ] Update Progress: 203/2366 symbols completed. AZZ took 22.5s. Estimated remaining: 4h 23m 45s. Rate: 8.2 symbols/min
[2025-10-24T17:24:48.153583] [INFO ] [REMOTE    ] AYI: Fetching primary data for 2025-09.
[2025-10-24T17:24:48.228172] [INFO ] [MAIN      ] BAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:24:48.276835] [DEBUG] [LOCAL     ] BAC: Loaded 54198 existing records from primary storage.
[2025-10-24T17:24:48.277145] [INFO ] [MAIN      ] BAC: Loaded 54198 existing records.
[2025-10-24T17:24:48.480161] [WARN ] [MAIN      ] BAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:24:48.480527] [INFO ] [MAIN      ] BAC: Wiping existing primary data before full refresh.
[2025-10-24T17:24:48.480581] [INFO ] [LOCAL     ] BAC: Starting deletion of primary data.
[2025-10-24T17:24:48.481867] [DEBUG] [LOCAL     ] BAC: Deleted primary data file.
[2025-10-24T17:24:48.481935] [INFO ] [MAIN      ] BAC: Starting full primary refresh.
[2025-10-24T17:24:48.828543] [INFO ] [REMOTE    ] BAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:24:48.947701] [INFO ] [REMOTE    ] BAC: Fetching primary data for 2025-01.
[2025-10-24T17:24:49.262792] [INFO ] [REMOTE    ] AYI: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T17:24:49.747630] [INFO ] [REMOTE    ] BA: Fetching primary data for 2025-06.
[2025-10-24T17:24:49.879257] [INFO ] [REMOTE    ] BABA: Incremental fetch complete for 2025-01 (2.53 seconds).
[2025-10-24T17:24:50.547707] [INFO ] [REMOTE    ] AYI: Fetching primary data for 2025-10.
[2025-10-24T17:24:51.347733] [INFO ] [REMOTE    ] BABA: Fetching primary data for 2025-02.
[2025-10-24T17:24:51.415262] [INFO ] [REMOTE    ] BAC: Incremental fetch complete for 2025-01 (2.47 seconds).
[2025-10-24T17:24:51.714041] [INFO ] [REMOTE    ] AYI: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T17:24:51.718317] [INFO ] [REMOTE    ] AYI: Full fetch complete (36452 records).
[2025-10-24T17:24:51.718396] [DEBUG] [VALIDATOR ] AYI: Validating primary data.
[2025-10-24T17:24:52.091682] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present.
[2025-10-24T17:24:52.091900] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed.
[2025-10-24T17:24:52.092480] [INFO ] [MAIN      ] AYI: Fetched primary data is valid.
[2025-10-24T17:24:52.092554] [DEBUG] [LOCAL     ] AYI: Saving primary data.
[2025-10-24T17:24:52.093024] [FATAL] [LOCAL     ] AYI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:24:52.093204] [FATAL] [MAIN      ] AYI: Failed to save primary data.
[2025-10-24T17:24:52.093273] [WARN ] [MAIN      ] AYI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:24:52.093409] [INFO ] [LOCAL     ] AYI: Starting deletion of primary data.
[2025-10-24T17:24:52.093595] [DEBUG] [LOCAL     ] AYI: No primary data file found to delete.
[2025-10-24T17:24:52.093734] [INFO ] [LOCAL     ] AYI: Starting deletion of derivative data.
[2025-10-24T17:24:52.093981] [DEBUG] [LOCAL     ] AYI: Deleted derivative data file.
[2025-10-24T17:24:52.094121] [INFO ] [MAIN      ] Update Progress: 204/2366 symbols completed. AYI took 26.5s. Estimated remaining: 4h 23m 3s. Rate: 8.2 symbols/min
[2025-10-24T17:24:52.150164] [INFO ] [REMOTE    ] BAC: Fetching primary data for 2025-02.
[2025-10-24T17:24:52.294292] [INFO ] [REMOTE    ] BA: Incremental fetch complete for 2025-06 (2.55 seconds).
[2025-10-24T17:24:52.296480] [INFO ] [MAIN      ] BAH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:24:52.356335] [DEBUG] [LOCAL     ] BAH: Loaded 52022 existing records from primary storage.
[2025-10-24T17:24:52.356627] [INFO ] [MAIN      ] BAH: Loaded 52022 existing records.
[2025-10-24T17:24:52.530128] [WARN ] [MAIN      ] BAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:24:52.530318] [INFO ] [MAIN      ] BAH: Wiping existing primary data before full refresh.
[2025-10-24T17:24:52.530365] [INFO ] [LOCAL     ] BAH: Starting deletion of primary data.
[2025-10-24T17:24:52.531283] [DEBUG] [LOCAL     ] BAH: Deleted primary data file.
[2025-10-24T17:24:52.531339] [INFO ] [MAIN      ] BAH: Starting full primary refresh.
[2025-10-24T17:24:52.880085] [INFO ] [REMOTE    ] BAH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:24:52.947599] [INFO ] [REMOTE    ] BAH: Fetching primary data for 2025-01.
[2025-10-24T17:24:53.593158] [INFO ] [REMOTE    ] BABA: Incremental fetch complete for 2025-02 (2.25 seconds).
[2025-10-24T17:24:53.747609] [INFO ] [REMOTE    ] BA: Fetching primary data for 2025-07.
[2025-10-24T17:24:54.279554] [INFO ] [REMOTE    ] BAC: Incremental fetch complete for 2025-02 (2.13 seconds).
[2025-10-24T17:24:54.547683] [INFO ] [REMOTE    ] BAC: Fetching primary data for 2025-03.
[2025-10-24T17:24:54.784377] [INFO ] [REMOTE    ] BAH: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T17:24:55.347732] [INFO ] [REMOTE    ] BABA: Fetching primary data for 2025-03.
[2025-10-24T17:24:56.147624] [INFO ] [REMOTE    ] BAH: Fetching primary data for 2025-02.
[2025-10-24T17:24:56.322578] [INFO ] [REMOTE    ] BA: Incremental fetch complete for 2025-07 (2.57 seconds).
[2025-10-24T17:24:56.676353] [INFO ] [REMOTE    ] BAC: Incremental fetch complete for 2025-03 (2.13 seconds).
[2025-10-24T17:24:56.947720] [INFO ] [REMOTE    ] BA: Fetching primary data for 2025-08.
[2025-10-24T17:24:57.691178] [INFO ] [REMOTE    ] BABA: Incremental fetch complete for 2025-03 (2.34 seconds).
[2025-10-24T17:24:57.747597] [INFO ] [REMOTE    ] BABA: Fetching primary data for 2025-04.
[2025-10-24T17:24:57.867633] [INFO ] [REMOTE    ] BAH: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T17:24:58.547745] [INFO ] [REMOTE    ] BAC: Fetching primary data for 2025-04.
[2025-10-24T17:24:58.804912] [INFO ] [REMOTE    ] BA: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T17:24:59.347635] [INFO ] [REMOTE    ] BA: Fetching primary data for 2025-09.
[2025-10-24T17:25:00.147729] [INFO ] [REMOTE    ] BAH: Fetching primary data for 2025-03.
[2025-10-24T17:25:00.570310] [INFO ] [REMOTE    ] BABA: Incremental fetch complete for 2025-04 (2.82 seconds).
[2025-10-24T17:25:00.947714] [INFO ] [REMOTE    ] BABA: Fetching primary data for 2025-05.
[2025-10-24T17:25:01.514999] [INFO ] [REMOTE    ] BAC: Incremental fetch complete for 2025-04 (2.97 seconds).
[2025-10-24T17:25:01.747720] [INFO ] [REMOTE    ] BAC: Fetching primary data for 2025-05.
[2025-10-24T17:25:02.129990] [INFO ] [REMOTE    ] BA: Incremental fetch complete for 2025-09 (2.78 seconds).
[2025-10-24T17:25:02.547756] [INFO ] [REMOTE    ] BA: Fetching primary data for 2025-10.
[2025-10-24T17:25:04.004276] [INFO ] [REMOTE    ] BAH: Incremental fetch complete for 2025-03 (3.86 seconds).
[2025-10-24T17:25:04.015427] [INFO ] [REMOTE    ] BAH: Fetching primary data for 2025-04.
[2025-10-24T17:25:04.739774] [INFO ] [REMOTE    ] BABA: Incremental fetch complete for 2025-05 (3.79 seconds).
[2025-10-24T17:25:04.752446] [INFO ] [REMOTE    ] BABA: Fetching primary data for 2025-06.
[2025-10-24T17:25:04.832052] [INFO ] [REMOTE    ] BAC: Incremental fetch complete for 2025-05 (3.08 seconds).
[2025-10-24T17:25:04.947726] [INFO ] [REMOTE    ] BAC: Fetching primary data for 2025-06.
[2025-10-24T17:25:05.677150] [INFO ] [REMOTE    ] BAH: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T17:25:05.747673] [INFO ] [REMOTE    ] BAH: Fetching primary data for 2025-05.
[2025-10-24T17:25:06.220739] [INFO ] [REMOTE    ] BA: Incremental fetch complete for 2025-10 (3.67 seconds).
[2025-10-24T17:25:06.230489] [INFO ] [REMOTE    ] BA: Full fetch complete (77969 records).
[2025-10-24T17:25:06.230621] [DEBUG] [VALIDATOR ] BA: Validating primary data.
[2025-10-24T17:25:06.611924] [DEBUG] [VALIDATOR ] BA: All expected trading days are present.
[2025-10-24T17:25:06.612000] [DEBUG] [VALIDATOR ] BA: Primary data validation passed.
[2025-10-24T17:25:06.612924] [INFO ] [MAIN      ] BA: Fetched primary data is valid.
[2025-10-24T17:25:06.612989] [DEBUG] [LOCAL     ] BA: Saving primary data.
[2025-10-24T17:25:06.613579] [FATAL] [LOCAL     ] BA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:25:06.613694] [FATAL] [MAIN      ] BA: Failed to save primary data.
[2025-10-24T17:25:06.613745] [WARN ] [MAIN      ] BA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:25:06.613788] [INFO ] [LOCAL     ] BA: Starting deletion of primary data.
[2025-10-24T17:25:06.613845] [DEBUG] [LOCAL     ] BA: No primary data file found to delete.
[2025-10-24T17:25:06.613880] [INFO ] [LOCAL     ] BA: Starting deletion of derivative data.
[2025-10-24T17:25:06.614016] [DEBUG] [LOCAL     ] BA: Deleted derivative data file.
[2025-10-24T17:25:06.614727] [INFO ] [MAIN      ] Update Progress: 205/2366 symbols completed. BA took 37.6s. Estimated remaining: 4h 24m 11s. Rate: 8.2 symbols/min
[2025-10-24T17:25:06.782394] [INFO ] [MAIN      ] BAK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:25:06.819636] [DEBUG] [LOCAL     ] BAK: Loaded 39731 existing records from primary storage.
[2025-10-24T17:25:06.819948] [INFO ] [MAIN      ] BAK: Loaded 39731 existing records.
[2025-10-24T17:25:06.996164] [WARN ] [MAIN      ] BAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:25:06.996357] [INFO ] [MAIN      ] BAK: Wiping existing primary data before full refresh.
[2025-10-24T17:25:06.996403] [INFO ] [LOCAL     ] BAK: Starting deletion of primary data.
[2025-10-24T17:25:06.997008] [DEBUG] [LOCAL     ] BAK: Deleted primary data file.
[2025-10-24T17:25:06.997064] [INFO ] [MAIN      ] BAK: Starting full primary refresh.
[2025-10-24T17:25:07.358806] [INFO ] [REMOTE    ] BAK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:25:07.359110] [INFO ] [REMOTE    ] BAK: Fetching primary data for 2025-01.
[2025-10-24T17:25:07.412732] [INFO ] [REMOTE    ] BABA: Incremental fetch complete for 2025-06 (2.66 seconds).
[2025-10-24T17:25:07.423935] [INFO ] [REMOTE    ] BABA: Fetching primary data for 2025-07.
[2025-10-24T17:25:07.565374] [INFO ] [REMOTE    ] BAC: Incremental fetch complete for 2025-06 (2.62 seconds).
[2025-10-24T17:25:07.863571] [INFO ] [REMOTE    ] BAH: Incremental fetch complete for 2025-05 (2.12 seconds).
[2025-10-24T17:25:08.147704] [INFO ] [REMOTE    ] BAH: Fetching primary data for 2025-06.
[2025-10-24T17:25:08.800377] [INFO ] [REMOTE    ] BAK: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T17:25:08.947677] [INFO ] [REMOTE    ] BAK: Fetching primary data for 2025-02.
[2025-10-24T17:25:09.747695] [INFO ] [REMOTE    ] BAC: Fetching primary data for 2025-07.
[2025-10-24T17:25:09.968226] [INFO ] [REMOTE    ] BAH: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T17:25:10.229740] [INFO ] [REMOTE    ] BABA: Incremental fetch complete for 2025-07 (2.81 seconds).
[2025-10-24T17:25:10.273494] [INFO ] [REMOTE    ] BAK: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T17:25:10.547691] [INFO ] [REMOTE    ] BAK: Fetching primary data for 2025-03.
[2025-10-24T17:25:11.347676] [INFO ] [REMOTE    ] BABA: Fetching primary data for 2025-08.
[2025-10-24T17:25:11.696881] [INFO ] [REMOTE    ] BAK: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T17:25:12.147765] [INFO ] [REMOTE    ] BAH: Fetching primary data for 2025-07.
[2025-10-24T17:25:12.239011] [INFO ] [REMOTE    ] BAC: Incremental fetch complete for 2025-07 (2.49 seconds).
[2025-10-24T17:25:12.947639] [INFO ] [REMOTE    ] BAK: Fetching primary data for 2025-04.
[2025-10-24T17:25:13.747704] [INFO ] [REMOTE    ] BAC: Fetching primary data for 2025-08.
[2025-10-24T17:25:13.949324] [INFO ] [REMOTE    ] BAH: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T17:25:14.164183] [INFO ] [REMOTE    ] BABA: Incremental fetch complete for 2025-08 (2.82 seconds).
[2025-10-24T17:25:14.408279] [INFO ] [REMOTE    ] BAK: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T17:25:14.547628] [INFO ] [REMOTE    ] BAK: Fetching primary data for 2025-05.
[2025-10-24T17:25:15.347684] [INFO ] [REMOTE    ] BAH: Fetching primary data for 2025-08.
[2025-10-24T17:25:16.041108] [INFO ] [REMOTE    ] BAK: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T17:25:16.147622] [INFO ] [REMOTE    ] BABA: Fetching primary data for 2025-09.
[2025-10-24T17:25:16.226618] [INFO ] [REMOTE    ] BAC: Incremental fetch complete for 2025-08 (2.48 seconds).
[2025-10-24T17:25:16.783965] [INFO ] [REMOTE    ] BAH: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T17:25:16.947622] [INFO ] [REMOTE    ] BAH: Fetching primary data for 2025-09.
[2025-10-24T17:25:17.747751] [INFO ] [REMOTE    ] BAC: Fetching primary data for 2025-09.
[2025-10-24T17:25:18.547690] [INFO ] [REMOTE    ] BAK: Fetching primary data for 2025-06.
[2025-10-24T17:25:18.625868] [INFO ] [REMOTE    ] BABA: Incremental fetch complete for 2025-09 (2.48 seconds).
[2025-10-24T17:25:18.812006] [INFO ] [REMOTE    ] BAH: Incremental fetch complete for 2025-09 (1.86 seconds).
[2025-10-24T17:25:19.347627] [INFO ] [REMOTE    ] BAH: Fetching primary data for 2025-10.
[2025-10-24T17:25:19.794943] [INFO ] [REMOTE    ] BAC: Incremental fetch complete for 2025-09 (2.05 seconds).
[2025-10-24T17:25:20.152936] [INFO ] [REMOTE    ] BAC: Fetching primary data for 2025-10.
[2025-10-24T17:25:20.165379] [INFO ] [REMOTE    ] BAK: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T17:25:20.947639] [INFO ] [REMOTE    ] BAK: Fetching primary data for 2025-07.
[2025-10-24T17:25:21.337108] [INFO ] [REMOTE    ] BAH: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T17:25:21.346871] [INFO ] [REMOTE    ] BAH: Full fetch complete (75249 records).
[2025-10-24T17:25:21.347025] [DEBUG] [VALIDATOR ] BAH: Validating primary data.
[2025-10-24T17:25:21.746666] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present.
[2025-10-24T17:25:21.746769] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed.
[2025-10-24T17:25:21.747781] [INFO ] [MAIN      ] BAH: Fetched primary data is valid.
[2025-10-24T17:25:21.747954] [DEBUG] [LOCAL     ] BAH: Saving primary data.
[2025-10-24T17:25:21.747878] [INFO ] [REMOTE    ] BABA: Fetching primary data for 2025-10.
[2025-10-24T17:25:21.749367] [FATAL] [LOCAL     ] BAH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:25:21.749449] [FATAL] [MAIN      ] BAH: Failed to save primary data.
[2025-10-24T17:25:21.749491] [WARN ] [MAIN      ] BAH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:25:21.749526] [INFO ] [LOCAL     ] BAH: Starting deletion of primary data.
[2025-10-24T17:25:21.749571] [DEBUG] [LOCAL     ] BAH: No primary data file found to delete.
[2025-10-24T17:25:21.749605] [INFO ] [LOCAL     ] BAH: Starting deletion of derivative data.
[2025-10-24T17:25:21.749768] [DEBUG] [LOCAL     ] BAH: Deleted derivative data file.
[2025-10-24T17:25:21.750150] [INFO ] [MAIN      ] Update Progress: 206/2366 symbols completed. BAH took 29.7s. Estimated remaining: 4h 25m 26s. Rate: 8.1 symbols/min
[2025-10-24T17:25:21.935697] [INFO ] [MAIN      ] BALL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:25:21.983861] [DEBUG] [LOCAL     ] BALL: Loaded 52314 existing records from primary storage.
[2025-10-24T17:25:21.984160] [INFO ] [MAIN      ] BALL: Loaded 52314 existing records.
[2025-10-24T17:25:22.160036] [WARN ] [MAIN      ] BALL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:25:22.160233] [INFO ] [MAIN      ] BALL: Wiping existing primary data before full refresh.
[2025-10-24T17:25:22.160278] [INFO ] [LOCAL     ] BALL: Starting deletion of primary data.
[2025-10-24T17:25:22.161110] [DEBUG] [LOCAL     ] BALL: Deleted primary data file.
[2025-10-24T17:25:22.161165] [INFO ] [MAIN      ] BALL: Starting full primary refresh.
[2025-10-24T17:25:22.516264] [INFO ] [REMOTE    ] BALL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:25:22.545244] [INFO ] [REMOTE    ] BAK: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T17:25:22.553882] [INFO ] [REMOTE    ] BALL: Fetching primary data for 2025-01.
[2025-10-24T17:25:22.726457] [INFO ] [REMOTE    ] BAC: Incremental fetch complete for 2025-10 (2.57 seconds).
[2025-10-24T17:25:22.736916] [INFO ] [REMOTE    ] BAC: Full fetch complete (77988 records).
[2025-10-24T17:25:22.737111] [DEBUG] [VALIDATOR ] BAC: Validating primary data.
[2025-10-24T17:25:23.194705] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present.
[2025-10-24T17:25:23.194847] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed.
[2025-10-24T17:25:23.196341] [INFO ] [MAIN      ] BAC: Fetched primary data is valid.
[2025-10-24T17:25:23.196415] [DEBUG] [LOCAL     ] BAC: Saving primary data.
[2025-10-24T17:25:23.197475] [FATAL] [LOCAL     ] BAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:25:23.197596] [FATAL] [MAIN      ] BAC: Failed to save primary data.
[2025-10-24T17:25:23.197677] [WARN ] [MAIN      ] BAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:25:23.197791] [INFO ] [LOCAL     ] BAC: Starting deletion of primary data.
[2025-10-24T17:25:23.197865] [DEBUG] [LOCAL     ] BAC: No primary data file found to delete.
[2025-10-24T17:25:23.197904] [INFO ] [LOCAL     ] BAC: Starting deletion of derivative data.
[2025-10-24T17:25:23.198074] [DEBUG] [LOCAL     ] BAC: Deleted derivative data file.
[2025-10-24T17:25:23.198501] [INFO ] [MAIN      ] Update Progress: 207/2366 symbols completed. BAC took 35.1s. Estimated remaining: 4h 24m 17s. Rate: 8.2 symbols/min
[2025-10-24T17:25:23.373743] [INFO ] [REMOTE    ] BAK: Fetching primary data for 2025-08.
[2025-10-24T17:25:23.377583] [INFO ] [MAIN      ] BALY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:25:23.377902] [DEBUG] [LOCAL     ] BALY: No existing data file found in primary storage.
[2025-10-24T17:25:23.377950] [WARN ] [MAIN      ] BALY: No existing data found, performing full refresh instead.
[2025-10-24T17:25:23.378076] [INFO ] [MAIN      ] BALY: Wiping existing primary data before full refresh.
[2025-10-24T17:25:23.378122] [INFO ] [LOCAL     ] BALY: Starting deletion of primary data.
[2025-10-24T17:25:23.378166] [DEBUG] [LOCAL     ] BALY: No primary data file found to delete.
[2025-10-24T17:25:23.378200] [INFO ] [MAIN      ] BALY: Starting full primary refresh.
[2025-10-24T17:25:23.764340] [INFO ] [REMOTE    ] BALY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:25:24.062940] [INFO ] [REMOTE    ] BALL: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T17:25:24.147636] [INFO ] [REMOTE    ] BALL: Fetching primary data for 2025-02.
[2025-10-24T17:25:24.480023] [INFO ] [REMOTE    ] BABA: Incremental fetch complete for 2025-10 (2.73 seconds).
[2025-10-24T17:25:24.489271] [INFO ] [REMOTE    ] BABA: Full fetch complete (77610 records).
[2025-10-24T17:25:24.489411] [DEBUG] [VALIDATOR ] BABA: Validating primary data.
[2025-10-24T17:25:24.490330] [FATAL] [VALIDATOR ] BABA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:25:24.490515] [FATAL] [MAIN      ] BABA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:25:24.490562] [WARN ] [MAIN      ] BABA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:25:24.490599] [INFO ] [LOCAL     ] BABA: Starting deletion of primary data.
[2025-10-24T17:25:24.490691] [DEBUG] [LOCAL     ] BABA: No primary data file found to delete.
[2025-10-24T17:25:24.490746] [INFO ] [LOCAL     ] BABA: Starting deletion of derivative data.
[2025-10-24T17:25:24.490946] [DEBUG] [LOCAL     ] BABA: Deleted derivative data file.
[2025-10-24T17:25:24.491437] [INFO ] [MAIN      ] Update Progress: 208/2366 symbols completed. BABA took 39.9s. Estimated remaining: 4h 23m 7s. Rate: 8.2 symbols/min
[2025-10-24T17:25:24.660075] [INFO ] [MAIN      ] BAM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:25:24.724775] [INFO ] [REMOTE    ] BAK: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T17:25:24.734958] [DEBUG] [LOCAL     ] BAM: Loaded 52467 existing records from primary storage.
[2025-10-24T17:25:24.735528] [INFO ] [MAIN      ] BAM: Loaded 52467 existing records.
[2025-10-24T17:25:24.909845] [WARN ] [MAIN      ] BAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:25:24.910017] [INFO ] [MAIN      ] BAM: Wiping existing primary data before full refresh.
[2025-10-24T17:25:24.910062] [INFO ] [LOCAL     ] BAM: Starting deletion of primary data.
[2025-10-24T17:25:24.910976] [DEBUG] [LOCAL     ] BAM: Deleted primary data file.
[2025-10-24T17:25:24.911056] [INFO ] [MAIN      ] BAM: Starting full primary refresh.
[2025-10-24T17:25:24.953269] [INFO ] [REMOTE    ] BAK: Fetching primary data for 2025-09.
[2025-10-24T17:25:25.260365] [INFO ] [REMOTE    ] BAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:25:25.747633] [INFO ] [REMOTE    ] BAM: Fetching primary data for 2025-01.
[2025-10-24T17:25:25.775243] [INFO ] [REMOTE    ] BALL: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T17:25:25.880496] [INFO ] [REMOTE    ] BAK: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T17:25:26.547637] [INFO ] [REMOTE    ] BALL: Fetching primary data for 2025-03.
[2025-10-24T17:25:27.347709] [INFO ] [REMOTE    ] BALY: Fetching primary data for 2025-01.
[2025-10-24T17:25:27.474064] [INFO ] [REMOTE    ] BAM: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T17:25:28.147774] [INFO ] [REMOTE    ] BAK: Fetching primary data for 2025-10.
[2025-10-24T17:25:28.150665] [INFO ] [REMOTE    ] BALL: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T17:25:28.888206] [INFO ] [REMOTE    ] BALY: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T17:25:28.947639] [INFO ] [REMOTE    ] BALL: Fetching primary data for 2025-04.
[2025-10-24T17:25:29.547729] [INFO ] [REMOTE    ] BAK: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T17:25:29.555292] [INFO ] [REMOTE    ] BAK: Full fetch complete (56838 records).
[2025-10-24T17:25:29.555409] [DEBUG] [VALIDATOR ] BAK: Validating primary data.
[2025-10-24T17:25:29.752737] [INFO ] [REMOTE    ] BAM: Fetching primary data for 2025-02.
[2025-10-24T17:25:29.950935] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present.
[2025-10-24T17:25:29.951017] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed.
[2025-10-24T17:25:29.951629] [INFO ] [MAIN      ] BAK: Fetched primary data is valid.
[2025-10-24T17:25:29.951708] [DEBUG] [LOCAL     ] BAK: Saving primary data.
[2025-10-24T17:25:29.952242] [FATAL] [LOCAL     ] BAK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:25:29.952329] [FATAL] [MAIN      ] BAK: Failed to save primary data.
[2025-10-24T17:25:29.952370] [WARN ] [MAIN      ] BAK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:25:29.952416] [INFO ] [LOCAL     ] BAK: Starting deletion of primary data.
[2025-10-24T17:25:29.952502] [DEBUG] [LOCAL     ] BAK: No primary data file found to delete.
[2025-10-24T17:25:29.952553] [INFO ] [LOCAL     ] BAK: Starting deletion of derivative data.
[2025-10-24T17:25:29.952767] [DEBUG] [LOCAL     ] BAK: Deleted derivative data file.
[2025-10-24T17:25:29.953267] [INFO ] [MAIN      ] Update Progress: 209/2366 symbols completed. BAK took 23.3s. Estimated remaining: 4h 22m 40s. Rate: 8.2 symbols/min
[2025-10-24T17:25:30.123055] [INFO ] [MAIN      ] BANC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:25:30.174086] [DEBUG] [LOCAL     ] BANC: Loaded 51774 existing records from primary storage.
[2025-10-24T17:25:30.174400] [INFO ] [MAIN      ] BANC: Loaded 51774 existing records.
[2025-10-24T17:25:30.349668] [WARN ] [MAIN      ] BANC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:25:30.349986] [INFO ] [MAIN      ] BANC: Wiping existing primary data before full refresh.
[2025-10-24T17:25:30.350053] [INFO ] [LOCAL     ] BANC: Starting deletion of primary data.
[2025-10-24T17:25:30.350936] [DEBUG] [LOCAL     ] BANC: Deleted primary data file.
[2025-10-24T17:25:30.350997] [INFO ] [MAIN      ] BANC: Starting full primary refresh.
[2025-10-24T17:25:30.552885] [INFO ] [REMOTE    ] BALY: Fetching primary data for 2025-02.
[2025-10-24T17:25:30.714261] [INFO ] [REMOTE    ] BANC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:25:30.782534] [INFO ] [REMOTE    ] BALL: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T17:25:30.971101] [INFO ] [REMOTE    ] BALY: Incremental fetch complete for 2025-02 (0.42 seconds).
[2025-10-24T17:25:31.352794] [INFO ] [REMOTE    ] BANC: Fetching primary data for 2025-01.
[2025-10-24T17:25:31.368592] [INFO ] [REMOTE    ] BAM: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T17:25:32.147719] [INFO ] [REMOTE    ] BALY: Fetching primary data for 2025-03.
[2025-10-24T17:25:32.890838] [INFO ] [REMOTE    ] BALY: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T17:25:32.947608] [INFO ] [REMOTE    ] BALY: Fetching primary data for 2025-04.
[2025-10-24T17:25:33.217184] [INFO ] [REMOTE    ] BANC: Incremental fetch complete for 2025-01 (1.86 seconds).
[2025-10-24T17:25:33.546832] [INFO ] [REMOTE    ] BALY: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T17:25:33.747709] [INFO ] [REMOTE    ] BANC: Fetching primary data for 2025-02.
[2025-10-24T17:25:34.547698] [INFO ] [REMOTE    ] BAM: Fetching primary data for 2025-03.
[2025-10-24T17:25:35.268965] [INFO ] [REMOTE    ] BANC: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T17:25:35.347610] [INFO ] [REMOTE    ] BANC: Fetching primary data for 2025-03.
[2025-10-24T17:25:36.147624] [INFO ] [REMOTE    ] BALY: Fetching primary data for 2025-05.
[2025-10-24T17:25:36.290780] [INFO ] [REMOTE    ] BAM: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T17:25:36.916700] [INFO ] [REMOTE    ] BALY: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T17:25:36.956422] [INFO ] [REMOTE    ] BALY: Fetching primary data for 2025-06.
[2025-10-24T17:25:36.976205] [INFO ] [REMOTE    ] BANC: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T17:25:37.747720] [INFO ] [REMOTE    ] BAM: Fetching primary data for 2025-04.
[2025-10-24T17:25:37.762967] [INFO ] [REMOTE    ] BALY: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T17:25:38.547675] [INFO ] [REMOTE    ] BANC: Fetching primary data for 2025-04.
[2025-10-24T17:25:39.347622] [INFO ] [REMOTE    ] BALY: Fetching primary data for 2025-07.
[2025-10-24T17:25:39.601110] [INFO ] [REMOTE    ] BAM: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T17:25:40.147614] [INFO ] [REMOTE    ] BAM: Fetching primary data for 2025-05.
[2025-10-24T17:25:40.203094] [INFO ] [REMOTE    ] BALY: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T17:25:40.334508] [INFO ] [REMOTE    ] BANC: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T17:25:40.947720] [INFO ] [REMOTE    ] BANC: Fetching primary data for 2025-05.
[2025-10-24T17:25:41.524092] [INFO ] [REMOTE    ] BAM: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T17:25:41.747719] [INFO ] [REMOTE    ] BAM: Fetching primary data for 2025-06.
[2025-10-24T17:25:42.518885] [INFO ] [REMOTE    ] BANC: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T17:25:42.547726] [INFO ] [REMOTE    ] BALL: Fetching primary data for 2025-05.
[2025-10-24T17:25:43.347728] [INFO ] [REMOTE    ] BANC: Fetching primary data for 2025-06.
[2025-10-24T17:25:43.453770] [INFO ] [REMOTE    ] BAM: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T17:25:44.147696] [INFO ] [REMOTE    ] BALY: Fetching primary data for 2025-08.
[2025-10-24T17:25:44.337424] [INFO ] [REMOTE    ] BALL: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T17:25:44.540059] [INFO ] [REMOTE    ] BALY: Incremental fetch complete for 2025-08 (0.39 seconds).
[2025-10-24T17:25:44.947735] [INFO ] [REMOTE    ] BAM: Fetching primary data for 2025-07.
[2025-10-24T17:25:45.079931] [INFO ] [REMOTE    ] BANC: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T17:25:45.747709] [INFO ] [REMOTE    ] BANC: Fetching primary data for 2025-07.
[2025-10-24T17:25:46.547714] [INFO ] [REMOTE    ] BALL: Fetching primary data for 2025-06.
[2025-10-24T17:25:46.828883] [INFO ] [REMOTE    ] BAM: Incremental fetch complete for 2025-07 (1.88 seconds).
[2025-10-24T17:25:47.347677] [INFO ] [REMOTE    ] BAM: Fetching primary data for 2025-08.
[2025-10-24T17:25:47.436853] [INFO ] [REMOTE    ] BANC: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T17:25:48.147632] [INFO ] [REMOTE    ] BALY: Fetching primary data for 2025-09.
[2025-10-24T17:25:48.256401] [INFO ] [REMOTE    ] BALL: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T17:25:48.863857] [INFO ] [REMOTE    ] BAM: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T17:25:48.903278] [INFO ] [REMOTE    ] BALY: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T17:25:48.947625] [INFO ] [REMOTE    ] BAM: Fetching primary data for 2025-09.
[2025-10-24T17:25:49.747691] [INFO ] [REMOTE    ] BALL: Fetching primary data for 2025-07.
[2025-10-24T17:25:50.547617] [INFO ] [REMOTE    ] BALY: Fetching primary data for 2025-10.
[2025-10-24T17:25:50.706386] [INFO ] [REMOTE    ] BAM: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T17:25:51.347617] [INFO ] [REMOTE    ] BAM: Fetching primary data for 2025-10.
[2025-10-24T17:25:51.477892] [INFO ] [REMOTE    ] BALL: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T17:25:51.519551] [INFO ] [REMOTE    ] BALY: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T17:25:51.523176] [INFO ] [REMOTE    ] BALY: Full fetch complete (16191 records).
[2025-10-24T17:25:51.523269] [DEBUG] [VALIDATOR ] BALY: Validating primary data.
[2025-10-24T17:25:51.719277] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T17:25:51.719588] [FATAL] [MAIN      ] BALY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:25:51.719868] [WARN ] [MAIN      ] BALY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:25:51.719939] [INFO ] [LOCAL     ] BALY: Starting deletion of primary data.
[2025-10-24T17:25:51.720029] [DEBUG] [LOCAL     ] BALY: No primary data file found to delete.
[2025-10-24T17:25:51.720084] [INFO ] [LOCAL     ] BALY: Starting deletion of derivative data.
[2025-10-24T17:25:51.720127] [DEBUG] [LOCAL     ] BALY: No derivative data file found to delete.
[2025-10-24T17:25:51.720183] [INFO ] [MAIN      ] Update Progress: 210/2366 symbols completed. BALY took 28.5s. Estimated remaining: 4h 25m 1s. Rate: 8.1 symbols/min
[2025-10-24T17:25:51.896090] [INFO ] [MAIN      ] BAP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:25:51.922836] [DEBUG] [LOCAL     ] BAP: Loaded 25703 existing records from primary storage.
[2025-10-24T17:25:51.923082] [INFO ] [MAIN      ] BAP: Loaded 25703 existing records.
[2025-10-24T17:25:52.100766] [WARN ] [MAIN      ] BAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:25:52.100975] [INFO ] [MAIN      ] BAP: Wiping existing primary data before full refresh.
[2025-10-24T17:25:52.101023] [INFO ] [LOCAL     ] BAP: Starting deletion of primary data.
[2025-10-24T17:25:52.101799] [DEBUG] [LOCAL     ] BAP: Deleted primary data file.
[2025-10-24T17:25:52.101859] [INFO ] [MAIN      ] BAP: Starting full primary refresh.
[2025-10-24T17:25:52.152713] [INFO ] [REMOTE    ] BALL: Fetching primary data for 2025-08.
[2025-10-24T17:25:52.469702] [INFO ] [REMOTE    ] BAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:25:52.903968] [INFO ] [REMOTE    ] BAM: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T17:25:52.913542] [INFO ] [REMOTE    ] BAM: Full fetch complete (75293 records).
[2025-10-24T17:25:52.913717] [DEBUG] [VALIDATOR ] BAM: Validating primary data.
[2025-10-24T17:25:52.952915] [INFO ] [REMOTE    ] BANC: Fetching primary data for 2025-08.
[2025-10-24T17:25:53.308371] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present.
[2025-10-24T17:25:53.308455] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed.
[2025-10-24T17:25:53.309393] [INFO ] [MAIN      ] BAM: Fetched primary data is valid.
[2025-10-24T17:25:53.309460] [DEBUG] [LOCAL     ] BAM: Saving primary data.
[2025-10-24T17:25:53.310073] [FATAL] [LOCAL     ] BAM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:25:53.310156] [FATAL] [MAIN      ] BAM: Failed to save primary data.
[2025-10-24T17:25:53.310197] [WARN ] [MAIN      ] BAM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:25:53.310232] [INFO ] [LOCAL     ] BAM: Starting deletion of primary data.
[2025-10-24T17:25:53.310283] [DEBUG] [LOCAL     ] BAM: No primary data file found to delete.
[2025-10-24T17:25:53.310318] [INFO ] [LOCAL     ] BAM: Starting deletion of derivative data.
[2025-10-24T17:25:53.310458] [DEBUG] [LOCAL     ] BAM: Deleted derivative data file.
[2025-10-24T17:25:53.310834] [INFO ] [MAIN      ] Update Progress: 211/2366 symbols completed. BAM took 28.8s. Estimated remaining: 4h 23m 55s. Rate: 8.2 symbols/min
[2025-10-24T17:25:53.480178] [INFO ] [MAIN      ] BARK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:25:53.516589] [DEBUG] [LOCAL     ] BARK: Loaded 38445 existing records from primary storage.
[2025-10-24T17:25:53.517086] [INFO ] [MAIN      ] BARK: Loaded 38445 existing records.
[2025-10-24T17:25:53.702010] [WARN ] [MAIN      ] BARK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:25:53.702371] [INFO ] [MAIN      ] BARK: Wiping existing primary data before full refresh.
[2025-10-24T17:25:53.702436] [INFO ] [LOCAL     ] BARK: Starting deletion of primary data.
[2025-10-24T17:25:53.703112] [DEBUG] [LOCAL     ] BARK: Deleted primary data file.
[2025-10-24T17:25:53.703171] [INFO ] [MAIN      ] BARK: Starting full primary refresh.
[2025-10-24T17:25:53.766368] [INFO ] [REMOTE    ] BAP: Fetching primary data for 2025-01.
[2025-10-24T17:25:54.001327] [INFO ] [REMOTE    ] BALL: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T17:25:54.110585] [INFO ] [REMOTE    ] BARK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:25:54.547623] [INFO ] [REMOTE    ] BARK: Fetching primary data for 2025-01.
[2025-10-24T17:25:54.605342] [INFO ] [REMOTE    ] BANC: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T17:25:55.162290] [INFO ] [REMOTE    ] BAP: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T17:25:55.347632] [INFO ] [REMOTE    ] BANC: Fetching primary data for 2025-09.
[2025-10-24T17:25:55.709926] [INFO ] [REMOTE    ] BARK: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T17:25:56.147735] [INFO ] [REMOTE    ] BAP: Fetching primary data for 2025-02.
[2025-10-24T17:25:56.947681] [INFO ] [REMOTE    ] BALL: Fetching primary data for 2025-09.
[2025-10-24T17:25:57.106160] [INFO ] [REMOTE    ] BANC: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T17:25:57.322366] [INFO ] [REMOTE    ] BAP: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T17:25:57.747698] [INFO ] [REMOTE    ] BAP: Fetching primary data for 2025-03.
[2025-10-24T17:25:58.547705] [INFO ] [REMOTE    ] BARK: Fetching primary data for 2025-02.
[2025-10-24T17:25:58.737178] [INFO ] [REMOTE    ] BALL: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T17:25:59.111737] [INFO ] [REMOTE    ] BAP: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T17:25:59.347639] [INFO ] [REMOTE    ] BANC: Fetching primary data for 2025-10.
[2025-10-24T17:25:59.902838] [INFO ] [REMOTE    ] BARK: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T17:26:00.147628] [INFO ] [REMOTE    ] BARK: Fetching primary data for 2025-03.
[2025-10-24T17:26:00.947711] [INFO ] [REMOTE    ] BAP: Fetching primary data for 2025-04.
[2025-10-24T17:26:01.747733] [INFO ] [REMOTE    ] BALL: Fetching primary data for 2025-10.
[2025-10-24T17:26:02.323796] [INFO ] [REMOTE    ] BANC: Incremental fetch complete for 2025-10 (2.98 seconds).
[2025-10-24T17:26:02.333634] [INFO ] [REMOTE    ] BANC: Full fetch complete (74644 records).
[2025-10-24T17:26:02.333832] [DEBUG] [VALIDATOR ] BANC: Validating primary data.
[2025-10-24T17:26:02.725313] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present.
[2025-10-24T17:26:02.725409] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed.
[2025-10-24T17:26:02.726321] [INFO ] [MAIN      ] BANC: Fetched primary data is valid.
[2025-10-24T17:26:02.726390] [DEBUG] [LOCAL     ] BANC: Saving primary data.
[2025-10-24T17:26:02.727050] [FATAL] [LOCAL     ] BANC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:26:02.727136] [FATAL] [MAIN      ] BANC: Failed to save primary data.
[2025-10-24T17:26:02.727179] [WARN ] [MAIN      ] BANC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:26:02.727242] [INFO ] [LOCAL     ] BANC: Starting deletion of primary data.
[2025-10-24T17:26:02.727304] [DEBUG] [LOCAL     ] BANC: No primary data file found to delete.
[2025-10-24T17:26:02.727340] [INFO ] [LOCAL     ] BANC: Starting deletion of derivative data.
[2025-10-24T17:26:02.727519] [DEBUG] [LOCAL     ] BANC: Deleted derivative data file.
[2025-10-24T17:26:02.727827] [INFO ] [MAIN      ] Update Progress: 212/2366 symbols completed. BANC took 32.8s. Estimated remaining: 4h 24m 8s. Rate: 8.2 symbols/min
[2025-10-24T17:26:02.895964] [INFO ] [MAIN      ] BAX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:26:02.945982] [DEBUG] [LOCAL     ] BAX: Loaded 53927 existing records from primary storage.
[2025-10-24T17:26:02.946350] [INFO ] [MAIN      ] BAX: Loaded 53927 existing records.
[2025-10-24T17:26:03.121623] [WARN ] [MAIN      ] BAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:26:03.121921] [INFO ] [MAIN      ] BAX: Wiping existing primary data before full refresh.
[2025-10-24T17:26:03.121974] [INFO ] [LOCAL     ] BAX: Starting deletion of primary data.
[2025-10-24T17:26:03.122703] [DEBUG] [LOCAL     ] BAX: Deleted primary data file.
[2025-10-24T17:26:03.122759] [INFO ] [MAIN      ] BAX: Starting full primary refresh.
[2025-10-24T17:26:03.508832] [INFO ] [REMOTE    ] BAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:26:03.509776] [INFO ] [REMOTE    ] BAX: Fetching primary data for 2025-01.
[2025-10-24T17:26:03.510952] [INFO ] [REMOTE    ] BARK: Incremental fetch complete for 2025-03 (3.36 seconds).
[2025-10-24T17:26:03.520419] [INFO ] [REMOTE    ] BARK: Fetching primary data for 2025-04.
[2025-10-24T17:26:03.536470] [INFO ] [REMOTE    ] BAP: Incremental fetch complete for 2025-04 (2.59 seconds).
[2025-10-24T17:26:04.147610] [INFO ] [REMOTE    ] BAP: Fetching primary data for 2025-05.
[2025-10-24T17:26:04.399355] [INFO ] [REMOTE    ] BALL: Incremental fetch complete for 2025-10 (2.65 seconds).
[2025-10-24T17:26:04.408597] [INFO ] [REMOTE    ] BALL: Full fetch complete (75236 records).
[2025-10-24T17:26:04.408751] [DEBUG] [VALIDATOR ] BALL: Validating primary data.
[2025-10-24T17:26:04.409919] [FATAL] [VALIDATOR ] BALL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:26:04.410018] [FATAL] [MAIN      ] BALL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:26:04.410088] [WARN ] [MAIN      ] BALL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:26:04.410184] [INFO ] [LOCAL     ] BALL: Starting deletion of primary data.
[2025-10-24T17:26:04.410263] [DEBUG] [LOCAL     ] BALL: No primary data file found to delete.
[2025-10-24T17:26:04.410299] [INFO ] [LOCAL     ] BALL: Starting deletion of derivative data.
[2025-10-24T17:26:04.410414] [DEBUG] [LOCAL     ] BALL: Deleted derivative data file.
[2025-10-24T17:26:04.410940] [INFO ] [MAIN      ] Update Progress: 213/2366 symbols completed. BALL took 42.7s. Estimated remaining: 4h 23m 4s. Rate: 8.2 symbols/min
[2025-10-24T17:26:04.576288] [INFO ] [MAIN      ] BB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:26:04.625821] [DEBUG] [LOCAL     ] BB: Loaded 53262 existing records from primary storage.
[2025-10-24T17:26:04.626134] [INFO ] [MAIN      ] BB: Loaded 53262 existing records.
[2025-10-24T17:26:04.799006] [WARN ] [MAIN      ] BB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:26:04.799274] [INFO ] [MAIN      ] BB: Wiping existing primary data before full refresh.
[2025-10-24T17:26:04.799332] [INFO ] [LOCAL     ] BB: Starting deletion of primary data.
[2025-10-24T17:26:04.800191] [DEBUG] [LOCAL     ] BB: Deleted primary data file.
[2025-10-24T17:26:04.800251] [INFO ] [MAIN      ] BB: Starting full primary refresh.
[2025-10-24T17:26:05.212811] [INFO ] [REMOTE    ] BB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:26:05.213182] [INFO ] [REMOTE    ] BB: Fetching primary data for 2025-01.
[2025-10-24T17:26:05.914461] [INFO ] [REMOTE    ] BAX: Incremental fetch complete for 2025-01 (2.40 seconds).
[2025-10-24T17:26:05.925004] [INFO ] [REMOTE    ] BAX: Fetching primary data for 2025-02.
[2025-10-24T17:26:05.988623] [INFO ] [REMOTE    ] BARK: Incremental fetch complete for 2025-04 (2.47 seconds).
[2025-10-24T17:26:06.112840] [INFO ] [REMOTE    ] BAP: Incremental fetch complete for 2025-05 (1.97 seconds).
[2025-10-24T17:26:06.547680] [INFO ] [REMOTE    ] BAP: Fetching primary data for 2025-06.
[2025-10-24T17:26:06.825561] [INFO ] [REMOTE    ] BB: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T17:26:07.347609] [INFO ] [REMOTE    ] BB: Fetching primary data for 2025-02.
[2025-10-24T17:26:07.691968] [INFO ] [REMOTE    ] BAX: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T17:26:07.726887] [INFO ] [REMOTE    ] BAP: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T17:26:08.147737] [INFO ] [REMOTE    ] BARK: Fetching primary data for 2025-05.
[2025-10-24T17:26:08.947698] [INFO ] [REMOTE    ] BAX: Fetching primary data for 2025-03.
[2025-10-24T17:26:09.299781] [INFO ] [REMOTE    ] BARK: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T17:26:09.327156] [INFO ] [REMOTE    ] BB: Incremental fetch complete for 2025-02 (1.98 seconds).
[2025-10-24T17:26:09.747689] [INFO ] [REMOTE    ] BB: Fetching primary data for 2025-03.
[2025-10-24T17:26:10.516609] [INFO ] [REMOTE    ] BAX: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T17:26:10.547747] [INFO ] [REMOTE    ] BAP: Fetching primary data for 2025-07.
[2025-10-24T17:26:11.311833] [INFO ] [REMOTE    ] BB: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T17:26:11.347673] [INFO ] [REMOTE    ] BARK: Fetching primary data for 2025-06.
[2025-10-24T17:26:11.378090] [INFO ] [REMOTE    ] BAP: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T17:26:12.147671] [INFO ] [REMOTE    ] BAX: Fetching primary data for 2025-04.
[2025-10-24T17:26:12.947697] [INFO ] [REMOTE    ] BAP: Fetching primary data for 2025-08.
[2025-10-24T17:26:13.037462] [INFO ] [REMOTE    ] BARK: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T17:26:13.747632] [INFO ] [REMOTE    ] BARK: Fetching primary data for 2025-07.
[2025-10-24T17:26:14.014611] [INFO ] [REMOTE    ] BAX: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T17:26:14.076721] [INFO ] [REMOTE    ] BAP: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T17:26:14.547683] [INFO ] [REMOTE    ] BAP: Fetching primary data for 2025-09.
[2025-10-24T17:26:15.282465] [INFO ] [REMOTE    ] BARK: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T17:26:15.347706] [INFO ] [REMOTE    ] BB: Fetching primary data for 2025-04.
[2025-10-24T17:26:15.496417] [INFO ] [REMOTE    ] BAP: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T17:26:16.147699] [INFO ] [REMOTE    ] BARK: Fetching primary data for 2025-08.
[2025-10-24T17:26:16.947729] [INFO ] [REMOTE    ] BAP: Fetching primary data for 2025-10.
[2025-10-24T17:26:17.150867] [INFO ] [REMOTE    ] BB: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T17:26:17.430114] [INFO ] [REMOTE    ] BARK: Incremental fetch complete for 2025-08 (1.28 seconds).
[2025-10-24T17:26:17.747756] [INFO ] [REMOTE    ] BARK: Fetching primary data for 2025-09.
[2025-10-24T17:26:18.408689] [INFO ] [REMOTE    ] BAP: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T17:26:18.413260] [INFO ] [REMOTE    ] BAP: Full fetch complete (37267 records).
[2025-10-24T17:26:18.413369] [DEBUG] [VALIDATOR ] BAP: Validating primary data.
[2025-10-24T17:26:18.562013] [INFO ] [REMOTE    ] BB: Fetching primary data for 2025-05.
[2025-10-24T17:26:18.826247] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present.
[2025-10-24T17:26:18.826416] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed.
[2025-10-24T17:26:18.826953] [INFO ] [MAIN      ] BAP: Fetched primary data is valid.
[2025-10-24T17:26:18.827132] [DEBUG] [LOCAL     ] BAP: Saving primary data.
[2025-10-24T17:26:18.827685] [FATAL] [LOCAL     ] BAP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:26:18.827771] [FATAL] [MAIN      ] BAP: Failed to save primary data.
[2025-10-24T17:26:18.827829] [WARN ] [MAIN      ] BAP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:26:18.827906] [INFO ] [LOCAL     ] BAP: Starting deletion of primary data.
[2025-10-24T17:26:18.827965] [DEBUG] [LOCAL     ] BAP: No primary data file found to delete.
[2025-10-24T17:26:18.828001] [INFO ] [LOCAL     ] BAP: Starting deletion of derivative data.
[2025-10-24T17:26:18.828141] [DEBUG] [LOCAL     ] BAP: Deleted derivative data file.
[2025-10-24T17:26:18.828215] [INFO ] [MAIN      ] Update Progress: 214/2366 symbols completed. BAP took 27.1s. Estimated remaining: 4h 24m 8s. Rate: 8.1 symbols/min
[2025-10-24T17:26:19.010878] [INFO ] [MAIN      ] BBAI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:26:19.031330] [INFO ] [REMOTE    ] BARK: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T17:26:19.084891] [DEBUG] [LOCAL     ] BBAI: Loaded 54210 existing records from primary storage.
[2025-10-24T17:26:19.085199] [INFO ] [MAIN      ] BBAI: Loaded 54210 existing records.
[2025-10-24T17:26:19.264399] [WARN ] [MAIN      ] BBAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:26:19.264638] [INFO ] [MAIN      ] BBAI: Wiping existing primary data before full refresh.
[2025-10-24T17:26:19.264720] [INFO ] [LOCAL     ] BBAI: Starting deletion of primary data.
[2025-10-24T17:26:19.265229] [DEBUG] [LOCAL     ] BBAI: Deleted primary data file.
[2025-10-24T17:26:19.265293] [INFO ] [MAIN      ] BBAI: Starting full primary refresh.
[2025-10-24T17:26:19.354783] [INFO ] [REMOTE    ] BAX: Fetching primary data for 2025-05.
[2025-10-24T17:26:19.619692] [INFO ] [REMOTE    ] BBAI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:26:20.147706] [INFO ] [REMOTE    ] BARK: Fetching primary data for 2025-10.
[2025-10-24T17:26:20.565076] [INFO ] [REMOTE    ] BB: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T17:26:20.947679] [INFO ] [REMOTE    ] BB: Fetching primary data for 2025-06.
[2025-10-24T17:26:21.074363] [INFO ] [REMOTE    ] BAX: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T17:26:21.755108] [INFO ] [REMOTE    ] BAX: Fetching primary data for 2025-06.
[2025-10-24T17:26:21.757306] [INFO ] [REMOTE    ] BARK: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T17:26:21.764601] [INFO ] [REMOTE    ] BARK: Full fetch complete (55986 records).
[2025-10-24T17:26:21.764795] [DEBUG] [VALIDATOR ] BARK: Validating primary data.
[2025-10-24T17:26:22.145732] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present.
[2025-10-24T17:26:22.145809] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed.
[2025-10-24T17:26:22.146400] [INFO ] [MAIN      ] BARK: Fetched primary data is valid.
[2025-10-24T17:26:22.146438] [DEBUG] [LOCAL     ] BARK: Saving primary data.
[2025-10-24T17:26:22.146883] [FATAL] [LOCAL     ] BARK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:26:22.146969] [FATAL] [MAIN      ] BARK: Failed to save primary data.
[2025-10-24T17:26:22.147010] [WARN ] [MAIN      ] BARK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:26:22.147043] [INFO ] [LOCAL     ] BARK: Starting deletion of primary data.
[2025-10-24T17:26:22.147093] [DEBUG] [LOCAL     ] BARK: No primary data file found to delete.
[2025-10-24T17:26:22.147128] [INFO ] [LOCAL     ] BARK: Starting deletion of derivative data.
[2025-10-24T17:26:22.147253] [DEBUG] [LOCAL     ] BARK: Deleted derivative data file.
[2025-10-24T17:26:22.147746] [INFO ] [MAIN      ] Update Progress: 215/2366 symbols completed. BARK took 28.8s. Estimated remaining: 4h 23m 20s. Rate: 8.2 symbols/min
[2025-10-24T17:26:22.317409] [INFO ] [MAIN      ] BBAR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:26:22.357489] [DEBUG] [LOCAL     ] BBAR: Loaded 42977 existing records from primary storage.
[2025-10-24T17:26:22.357775] [INFO ] [MAIN      ] BBAR: Loaded 42977 existing records.
[2025-10-24T17:26:22.533585] [WARN ] [MAIN      ] BBAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:26:22.533801] [INFO ] [MAIN      ] BBAR: Wiping existing primary data before full refresh.
[2025-10-24T17:26:22.533847] [INFO ] [LOCAL     ] BBAR: Starting deletion of primary data.
[2025-10-24T17:26:22.534487] [DEBUG] [LOCAL     ] BBAR: Deleted primary data file.
[2025-10-24T17:26:22.534542] [INFO ] [MAIN      ] BBAR: Starting full primary refresh.
[2025-10-24T17:26:22.565994] [INFO ] [REMOTE    ] BBAI: Fetching primary data for 2025-01.
[2025-10-24T17:26:22.921089] [INFO ] [REMOTE    ] BBAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:26:22.923329] [INFO ] [REMOTE    ] BB: Incremental fetch complete for 2025-06 (1.98 seconds).
[2025-10-24T17:26:23.311168] [INFO ] [REMOTE    ] BAX: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T17:26:23.347617] [INFO ] [REMOTE    ] BBAR: Fetching primary data for 2025-01.
[2025-10-24T17:26:24.147672] [INFO ] [REMOTE    ] BB: Fetching primary data for 2025-07.
[2025-10-24T17:26:24.773381] [INFO ] [REMOTE    ] BBAR: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T17:26:24.947678] [INFO ] [REMOTE    ] BAX: Fetching primary data for 2025-07.
[2025-10-24T17:26:25.353146] [INFO ] [REMOTE    ] BBAI: Incremental fetch complete for 2025-01 (2.79 seconds).
[2025-10-24T17:26:25.747676] [INFO ] [REMOTE    ] BBAR: Fetching primary data for 2025-02.
[2025-10-24T17:26:26.128425] [INFO ] [REMOTE    ] BB: Incremental fetch complete for 2025-07 (1.98 seconds).
[2025-10-24T17:26:26.482218] [INFO ] [REMOTE    ] BAX: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T17:26:26.547623] [INFO ] [REMOTE    ] BAX: Fetching primary data for 2025-08.
[2025-10-24T17:26:27.092493] [INFO ] [REMOTE    ] BBAR: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T17:26:27.347636] [INFO ] [REMOTE    ] BBAR: Fetching primary data for 2025-03.
[2025-10-24T17:26:28.147720] [INFO ] [REMOTE    ] BBAI: Fetching primary data for 2025-02.
[2025-10-24T17:26:28.418699] [INFO ] [REMOTE    ] BAX: Incremental fetch complete for 2025-08 (1.87 seconds).
[2025-10-24T17:26:28.910248] [INFO ] [REMOTE    ] BBAR: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T17:26:28.947634] [INFO ] [REMOTE    ] BBAR: Fetching primary data for 2025-04.
[2025-10-24T17:26:29.747680] [INFO ] [REMOTE    ] BAX: Fetching primary data for 2025-09.
[2025-10-24T17:26:30.477316] [INFO ] [REMOTE    ] BBAR: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T17:26:30.547631] [INFO ] [REMOTE    ] BBAR: Fetching primary data for 2025-05.
[2025-10-24T17:26:30.594733] [INFO ] [REMOTE    ] BBAI: Incremental fetch complete for 2025-02 (2.45 seconds).
[2025-10-24T17:26:31.347727] [INFO ] [REMOTE    ] BBAI: Fetching primary data for 2025-03.
[2025-10-24T17:26:31.817202] [INFO ] [REMOTE    ] BAX: Incremental fetch complete for 2025-09 (2.07 seconds).
[2025-10-24T17:26:31.902047] [INFO ] [REMOTE    ] BBAR: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T17:26:32.147637] [INFO ] [REMOTE    ] BB: Fetching primary data for 2025-08.
[2025-10-24T17:26:32.947723] [INFO ] [REMOTE    ] BAX: Fetching primary data for 2025-10.
[2025-10-24T17:26:33.747679] [INFO ] [REMOTE    ] BBAR: Fetching primary data for 2025-06.
[2025-10-24T17:26:34.249848] [INFO ] [REMOTE    ] BB: Incremental fetch complete for 2025-08 (2.10 seconds).
[2025-10-24T17:26:34.368088] [INFO ] [REMOTE    ] BBAI: Incremental fetch complete for 2025-03 (3.02 seconds).
[2025-10-24T17:26:34.547634] [INFO ] [REMOTE    ] BB: Fetching primary data for 2025-09.
[2025-10-24T17:26:35.233436] [INFO ] [REMOTE    ] BBAR: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T17:26:35.347608] [INFO ] [REMOTE    ] BBAR: Fetching primary data for 2025-07.
[2025-10-24T17:26:35.503586] [INFO ] [REMOTE    ] BAX: Incremental fetch complete for 2025-10 (2.56 seconds).
[2025-10-24T17:26:35.513478] [INFO ] [REMOTE    ] BAX: Full fetch complete (77622 records).
[2025-10-24T17:26:35.513666] [DEBUG] [VALIDATOR ] BAX: Validating primary data.
[2025-10-24T17:26:35.911581] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present.
[2025-10-24T17:26:35.911680] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed.
[2025-10-24T17:26:35.912599] [INFO ] [MAIN      ] BAX: Fetched primary data is valid.
[2025-10-24T17:26:35.912703] [DEBUG] [LOCAL     ] BAX: Saving primary data.
[2025-10-24T17:26:35.913367] [FATAL] [LOCAL     ] BAX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:26:35.913455] [FATAL] [MAIN      ] BAX: Failed to save primary data.
[2025-10-24T17:26:35.913498] [WARN ] [MAIN      ] BAX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:26:35.913563] [INFO ] [LOCAL     ] BAX: Starting deletion of primary data.
[2025-10-24T17:26:35.913693] [DEBUG] [LOCAL     ] BAX: No primary data file found to delete.
[2025-10-24T17:26:35.913751] [INFO ] [LOCAL     ] BAX: Starting deletion of derivative data.
[2025-10-24T17:26:35.913870] [DEBUG] [LOCAL     ] BAX: Deleted derivative data file.
[2025-10-24T17:26:35.914271] [INFO ] [MAIN      ] Update Progress: 216/2366 symbols completed. BAX took 33.2s. Estimated remaining: 4h 24m 16s. Rate: 8.1 symbols/min
[2025-10-24T17:26:36.088662] [INFO ] [MAIN      ] BBD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:26:36.137955] [DEBUG] [LOCAL     ] BBD: Loaded 53662 existing records from primary storage.
[2025-10-24T17:26:36.138260] [INFO ] [MAIN      ] BBD: Loaded 53662 existing records.
[2025-10-24T17:26:36.174686] [INFO ] [REMOTE    ] BBAI: Fetching primary data for 2025-04.
[2025-10-24T17:26:36.340144] [INFO ] [REMOTE    ] BB: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T17:26:36.363729] [WARN ] [MAIN      ] BBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:26:36.374314] [INFO ] [MAIN      ] BBD: Wiping existing primary data before full refresh.
[2025-10-24T17:26:36.374672] [INFO ] [LOCAL     ] BBD: Starting deletion of primary data.
[2025-10-24T17:26:36.376173] [DEBUG] [LOCAL     ] BBD: Deleted primary data file.
[2025-10-24T17:26:36.376266] [INFO ] [MAIN      ] BBD: Starting full primary refresh.
[2025-10-24T17:26:36.732785] [INFO ] [REMOTE    ] BBD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:26:36.947716] [INFO ] [REMOTE    ] BBD: Fetching primary data for 2025-01.
[2025-10-24T17:26:37.070418] [INFO ] [REMOTE    ] BBAR: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T17:26:37.747744] [INFO ] [REMOTE    ] BB: Fetching primary data for 2025-10.
[2025-10-24T17:26:38.547732] [INFO ] [REMOTE    ] BBAR: Fetching primary data for 2025-08.
[2025-10-24T17:26:38.884511] [INFO ] [REMOTE    ] BBAI: Incremental fetch complete for 2025-04 (2.71 seconds).
[2025-10-24T17:26:38.925934] [INFO ] [REMOTE    ] BBD: Incremental fetch complete for 2025-01 (1.98 seconds).
[2025-10-24T17:26:39.347683] [INFO ] [REMOTE    ] BBD: Fetching primary data for 2025-02.
[2025-10-24T17:26:39.975007] [INFO ] [REMOTE    ] BB: Incremental fetch complete for 2025-10 (2.23 seconds).
[2025-10-24T17:26:39.984931] [INFO ] [REMOTE    ] BB: Full fetch complete (76961 records).
[2025-10-24T17:26:39.985115] [DEBUG] [VALIDATOR ] BB: Validating primary data.
[2025-10-24T17:26:40.176480] [INFO ] [REMOTE    ] BBAI: Fetching primary data for 2025-05.
[2025-10-24T17:26:40.262672] [INFO ] [REMOTE    ] BBAR: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T17:26:40.423769] [DEBUG] [VALIDATOR ] BB: All expected trading days are present.
[2025-10-24T17:26:40.423855] [DEBUG] [VALIDATOR ] BB: Primary data validation passed.
[2025-10-24T17:26:40.424743] [INFO ] [MAIN      ] BB: Fetched primary data is valid.
[2025-10-24T17:26:40.424808] [DEBUG] [LOCAL     ] BB: Saving primary data.
[2025-10-24T17:26:40.425415] [FATAL] [LOCAL     ] BB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:26:40.425511] [FATAL] [MAIN      ] BB: Failed to save primary data.
[2025-10-24T17:26:40.425599] [WARN ] [MAIN      ] BB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:26:40.425732] [INFO ] [LOCAL     ] BB: Starting deletion of primary data.
[2025-10-24T17:26:40.425804] [DEBUG] [LOCAL     ] BB: No primary data file found to delete.
[2025-10-24T17:26:40.425841] [INFO ] [LOCAL     ] BB: Starting deletion of derivative data.
[2025-10-24T17:26:40.425966] [DEBUG] [LOCAL     ] BB: Deleted derivative data file.
[2025-10-24T17:26:40.426243] [INFO ] [MAIN      ] Update Progress: 217/2366 symbols completed. BB took 36.0s. Estimated remaining: 4h 23m 41s. Rate: 8.2 symbols/min
[2025-10-24T17:26:40.601318] [INFO ] [MAIN      ] BBDC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:26:40.630989] [DEBUG] [LOCAL     ] BBDC: Loaded 33064 existing records from primary storage.
[2025-10-24T17:26:40.631250] [INFO ] [MAIN      ] BBDC: Loaded 33064 existing records.
[2025-10-24T17:26:40.806414] [WARN ] [MAIN      ] BBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:26:40.806683] [INFO ] [MAIN      ] BBDC: Wiping existing primary data before full refresh.
[2025-10-24T17:26:40.806762] [INFO ] [LOCAL     ] BBDC: Starting deletion of primary data.
[2025-10-24T17:26:40.807219] [DEBUG] [LOCAL     ] BBDC: Deleted primary data file.
[2025-10-24T17:26:40.807274] [INFO ] [MAIN      ] BBDC: Starting full primary refresh.
[2025-10-24T17:26:40.952296] [INFO ] [REMOTE    ] BBAR: Fetching primary data for 2025-09.
[2025-10-24T17:26:41.171917] [INFO ] [REMOTE    ] BBDC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:26:41.197850] [INFO ] [REMOTE    ] BBD: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T17:26:41.747744] [INFO ] [REMOTE    ] BBDC: Fetching primary data for 2025-01.
[2025-10-24T17:26:42.482789] [INFO ] [REMOTE    ] BBAI: Incremental fetch complete for 2025-05 (2.31 seconds).
[2025-10-24T17:26:42.547673] [INFO ] [REMOTE    ] BBAI: Fetching primary data for 2025-06.
[2025-10-24T17:26:42.701434] [INFO ] [REMOTE    ] BBAR: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T17:26:43.154346] [INFO ] [REMOTE    ] BBDC: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T17:26:43.347635] [INFO ] [REMOTE    ] BBD: Fetching primary data for 2025-03.
[2025-10-24T17:26:44.147692] [INFO ] [REMOTE    ] BBAR: Fetching primary data for 2025-10.
[2025-10-24T17:26:44.661928] [INFO ] [REMOTE    ] BBAI: Incremental fetch complete for 2025-06 (2.11 seconds).
[2025-10-24T17:26:44.947717] [INFO ] [REMOTE    ] BBDC: Fetching primary data for 2025-02.
[2025-10-24T17:26:45.168341] [INFO ] [REMOTE    ] BBD: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T17:26:45.747709] [INFO ] [REMOTE    ] BBAI: Fetching primary data for 2025-07.
[2025-10-24T17:26:46.278500] [INFO ] [REMOTE    ] BBDC: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T17:26:46.308533] [INFO ] [REMOTE    ] BBAR: Incremental fetch complete for 2025-10 (2.16 seconds).
[2025-10-24T17:26:46.317013] [INFO ] [REMOTE    ] BBAR: Full fetch complete (61235 records).
[2025-10-24T17:26:46.317157] [DEBUG] [VALIDATOR ] BBAR: Validating primary data.
[2025-10-24T17:26:46.561070] [INFO ] [REMOTE    ] BBD: Fetching primary data for 2025-04.
[2025-10-24T17:26:46.697211] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present.
[2025-10-24T17:26:46.697304] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed.
[2025-10-24T17:26:46.697996] [INFO ] [MAIN      ] BBAR: Fetched primary data is valid.
[2025-10-24T17:26:46.698061] [DEBUG] [LOCAL     ] BBAR: Saving primary data.
[2025-10-24T17:26:46.698572] [FATAL] [LOCAL     ] BBAR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:26:46.698687] [FATAL] [MAIN      ] BBAR: Failed to save primary data.
[2025-10-24T17:26:46.698740] [WARN ] [MAIN      ] BBAR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:26:46.698782] [INFO ] [LOCAL     ] BBAR: Starting deletion of primary data.
[2025-10-24T17:26:46.698836] [DEBUG] [LOCAL     ] BBAR: No primary data file found to delete.
[2025-10-24T17:26:46.698872] [INFO ] [LOCAL     ] BBAR: Starting deletion of derivative data.
[2025-10-24T17:26:46.699075] [DEBUG] [LOCAL     ] BBAR: Deleted derivative data file.
[2025-10-24T17:26:46.699514] [INFO ] [MAIN      ] Update Progress: 218/2366 symbols completed. BBAR took 24.6s. Estimated remaining: 4h 23m 23s. Rate: 8.2 symbols/min
[2025-10-24T17:26:46.862931] [INFO ] [MAIN      ] BBDO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:26:46.863075] [DEBUG] [LOCAL     ] BBDO: No existing data file found in primary storage.
[2025-10-24T17:26:46.863112] [WARN ] [MAIN      ] BBDO: No existing data found, performing full refresh instead.
[2025-10-24T17:26:46.863221] [INFO ] [MAIN      ] BBDO: Wiping existing primary data before full refresh.
[2025-10-24T17:26:46.863263] [INFO ] [LOCAL     ] BBDO: Starting deletion of primary data.
[2025-10-24T17:26:46.863305] [DEBUG] [LOCAL     ] BBDO: No primary data file found to delete.
[2025-10-24T17:26:46.863377] [INFO ] [MAIN      ] BBDO: Starting full primary refresh.
[2025-10-24T17:26:47.205861] [INFO ] [REMOTE    ] BBDO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:26:47.347636] [INFO ] [REMOTE    ] BBDC: Fetching primary data for 2025-03.
[2025-10-24T17:26:48.147611] [INFO ] [REMOTE    ] BBDO: Fetching primary data for 2025-01.
[2025-10-24T17:26:48.409189] [INFO ] [REMOTE    ] BBD: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T17:26:48.547949] [INFO ] [REMOTE    ] BBAI: Incremental fetch complete for 2025-07 (2.80 seconds).
[2025-10-24T17:26:48.767777] [INFO ] [REMOTE    ] BBDC: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T17:26:48.844034] [INFO ] [REMOTE    ] BBDO: Incremental fetch complete for 2025-01 (0.70 seconds).
[2025-10-24T17:26:48.947634] [INFO ] [REMOTE    ] BBDC: Fetching primary data for 2025-04.
[2025-10-24T17:26:49.747674] [INFO ] [REMOTE    ] BBAI: Fetching primary data for 2025-08.
[2025-10-24T17:26:50.410770] [INFO ] [REMOTE    ] BBDC: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T17:26:50.547636] [INFO ] [REMOTE    ] BBDC: Fetching primary data for 2025-05.
[2025-10-24T17:26:51.347635] [INFO ] [REMOTE    ] BBD: Fetching primary data for 2025-05.
[2025-10-24T17:26:51.620109] [INFO ] [REMOTE    ] BBDC: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T17:26:52.147683] [INFO ] [REMOTE    ] BBDC: Fetching primary data for 2025-06.
[2025-10-24T17:26:52.526416] [INFO ] [REMOTE    ] BBAI: Incremental fetch complete for 2025-08 (2.78 seconds).
[2025-10-24T17:26:52.947631] [INFO ] [REMOTE    ] BBDO: Fetching primary data for 2025-02.
[2025-10-24T17:26:53.196805] [INFO ] [REMOTE    ] BBD: Incremental fetch complete for 2025-05 (1.85 seconds).
[2025-10-24T17:26:53.372726] [INFO ] [REMOTE    ] BBDO: Incremental fetch complete for 2025-02 (0.43 seconds).
[2025-10-24T17:26:53.396272] [INFO ] [REMOTE    ] BBDC: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T17:26:53.747680] [INFO ] [REMOTE    ] BBDO: Fetching primary data for 2025-03.
[2025-10-24T17:26:54.416310] [INFO ] [REMOTE    ] BBDO: Incremental fetch complete for 2025-03 (0.67 seconds).
[2025-10-24T17:26:54.547704] [INFO ] [REMOTE    ] BBAI: Fetching primary data for 2025-09.
[2025-10-24T17:26:55.347738] [INFO ] [REMOTE    ] BBDO: Fetching primary data for 2025-04.
[2025-10-24T17:26:56.092920] [INFO ] [REMOTE    ] BBDO: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T17:26:56.147760] [INFO ] [REMOTE    ] BBD: Fetching primary data for 2025-06.
[2025-10-24T17:26:56.947613] [INFO ] [REMOTE    ] BBDO: Fetching primary data for 2025-05.
[2025-10-24T17:26:57.231279] [INFO ] [REMOTE    ] BBAI: Incremental fetch complete for 2025-09 (2.68 seconds).
[2025-10-24T17:26:57.460842] [INFO ] [REMOTE    ] BBD: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T17:26:57.563757] [INFO ] [REMOTE    ] BBDO: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T17:26:57.747734] [INFO ] [REMOTE    ] BBAI: Fetching primary data for 2025-10.
[2025-10-24T17:26:58.547744] [INFO ] [REMOTE    ] BBDC: Fetching primary data for 2025-07.
[2025-10-24T17:26:59.347758] [INFO ] [REMOTE    ] BBD: Fetching primary data for 2025-07.
[2025-10-24T17:26:59.782060] [INFO ] [REMOTE    ] BBDC: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T17:27:00.147740] [INFO ] [REMOTE    ] BBDC: Fetching primary data for 2025-08.
[2025-10-24T17:27:00.597785] [INFO ] [REMOTE    ] BBAI: Incremental fetch complete for 2025-10 (2.85 seconds).
[2025-10-24T17:27:00.607921] [INFO ] [REMOTE    ] BBAI: Full fetch complete (78000 records).
[2025-10-24T17:27:00.608072] [DEBUG] [VALIDATOR ] BBAI: Validating primary data.
[2025-10-24T17:27:00.971134] [INFO ] [REMOTE    ] BBDO: Fetching primary data for 2025-06.
[2025-10-24T17:27:00.997744] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present.
[2025-10-24T17:27:00.997835] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed.
[2025-10-24T17:27:00.998837] [INFO ] [MAIN      ] BBAI: Fetched primary data is valid.
[2025-10-24T17:27:00.999021] [DEBUG] [LOCAL     ] BBAI: Saving primary data.
[2025-10-24T17:27:00.999716] [FATAL] [LOCAL     ] BBAI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:27:00.999804] [FATAL] [MAIN      ] BBAI: Failed to save primary data.
[2025-10-24T17:27:00.999854] [WARN ] [MAIN      ] BBAI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:27:00.999915] [INFO ] [LOCAL     ] BBAI: Starting deletion of primary data.
[2025-10-24T17:27:00.999993] [DEBUG] [LOCAL     ] BBAI: No primary data file found to delete.
[2025-10-24T17:27:01.000052] [INFO ] [LOCAL     ] BBAI: Starting deletion of derivative data.
[2025-10-24T17:27:01.000244] [DEBUG] [LOCAL     ] BBAI: Deleted derivative data file.
[2025-10-24T17:27:01.000551] [INFO ] [MAIN      ] Update Progress: 219/2366 symbols completed. BBAI took 42.2s. Estimated remaining: 4h 24m 23s. Rate: 8.1 symbols/min
[2025-10-24T17:27:01.171390] [INFO ] [MAIN      ] BBN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:01.193837] [DEBUG] [LOCAL     ] BBN: Loaded 17906 existing records from primary storage.
[2025-10-24T17:27:01.194075] [INFO ] [MAIN      ] BBN: Loaded 17906 existing records.
[2025-10-24T17:27:01.377163] [WARN ] [MAIN      ] BBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:27:01.377609] [INFO ] [MAIN      ] BBN: Wiping existing primary data before full refresh.
[2025-10-24T17:27:01.377704] [INFO ] [LOCAL     ] BBN: Starting deletion of primary data.
[2025-10-24T17:27:01.378090] [DEBUG] [LOCAL     ] BBN: Deleted primary data file.
[2025-10-24T17:27:01.378160] [INFO ] [MAIN      ] BBN: Starting full primary refresh.
[2025-10-24T17:27:01.502096] [INFO ] [REMOTE    ] BBDC: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T17:27:01.688329] [INFO ] [REMOTE    ] BBD: Incremental fetch complete for 2025-07 (2.34 seconds).
[2025-10-24T17:27:01.749374] [INFO ] [REMOTE    ] BBDC: Fetching primary data for 2025-09.
[2025-10-24T17:27:01.798249] [INFO ] [REMOTE    ] BBDO: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T17:27:01.850211] [INFO ] [REMOTE    ] BBN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:02.547633] [INFO ] [REMOTE    ] BBD: Fetching primary data for 2025-08.
[2025-10-24T17:27:03.222170] [INFO ] [REMOTE    ] BBDC: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T17:27:03.347639] [INFO ] [REMOTE    ] BBN: Fetching primary data for 2025-01.
[2025-10-24T17:27:04.147674] [INFO ] [REMOTE    ] BBDO: Fetching primary data for 2025-07.
[2025-10-24T17:27:04.425803] [INFO ] [REMOTE    ] BBD: Incremental fetch complete for 2025-08 (1.88 seconds).
[2025-10-24T17:27:04.494829] [INFO ] [REMOTE    ] BBN: Incremental fetch complete for 2025-01 (1.15 seconds).
[2025-10-24T17:27:04.503343] [INFO ] [REMOTE    ] BBDO: Incremental fetch complete for 2025-07 (0.36 seconds).
[2025-10-24T17:27:04.947674] [INFO ] [REMOTE    ] BBN: Fetching primary data for 2025-02.
[2025-10-24T17:27:05.747630] [INFO ] [REMOTE    ] BBDC: Fetching primary data for 2025-10.
[2025-10-24T17:27:05.897045] [INFO ] [REMOTE    ] BBN: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T17:27:06.547686] [INFO ] [REMOTE    ] BBDO: Fetching primary data for 2025-08.
[2025-10-24T17:27:07.123115] [INFO ] [REMOTE    ] BBDO: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T17:27:07.343707] [INFO ] [REMOTE    ] BBDC: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T17:27:07.349828] [INFO ] [REMOTE    ] BBDO: Fetching primary data for 2025-09.
[2025-10-24T17:27:07.351500] [INFO ] [REMOTE    ] BBDC: Full fetch complete (48873 records).
[2025-10-24T17:27:07.351684] [DEBUG] [VALIDATOR ] BBDC: Validating primary data.
[2025-10-24T17:27:07.745904] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present.
[2025-10-24T17:27:07.745983] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed.
[2025-10-24T17:27:07.746523] [INFO ] [MAIN      ] BBDC: Fetched primary data is valid.
[2025-10-24T17:27:07.746562] [DEBUG] [LOCAL     ] BBDC: Saving primary data.
[2025-10-24T17:27:07.747021] [FATAL] [LOCAL     ] BBDC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:27:07.747106] [FATAL] [MAIN      ] BBDC: Failed to save primary data.
[2025-10-24T17:27:07.747148] [WARN ] [MAIN      ] BBDC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:27:07.747182] [INFO ] [LOCAL     ] BBDC: Starting deletion of primary data.
[2025-10-24T17:27:07.747232] [DEBUG] [LOCAL     ] BBDC: No primary data file found to delete.
[2025-10-24T17:27:07.747285] [INFO ] [LOCAL     ] BBDC: Starting deletion of derivative data.
[2025-10-24T17:27:07.747427] [DEBUG] [LOCAL     ] BBDC: Deleted derivative data file.
[2025-10-24T17:27:07.747518] [INFO ] [MAIN      ] Update Progress: 220/2366 symbols completed. BBDC took 27.3s. Estimated remaining: 4h 24m 10s. Rate: 8.1 symbols/min
[2025-10-24T17:27:07.931479] [INFO ] [MAIN      ] BBT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:07.935927] [DEBUG] [LOCAL     ] BBT: No existing data file found in primary storage.
[2025-10-24T17:27:07.935804] [INFO ] [REMOTE    ] BBDO: Incremental fetch complete for 2025-09 (0.59 seconds).
[2025-10-24T17:27:07.936095] [WARN ] [MAIN      ] BBT: No existing data found, performing full refresh instead.
[2025-10-24T17:27:07.938022] [INFO ] [MAIN      ] BBT: Wiping existing primary data before full refresh.
[2025-10-24T17:27:07.938068] [INFO ] [LOCAL     ] BBT: Starting deletion of primary data.
[2025-10-24T17:27:07.938111] [DEBUG] [LOCAL     ] BBT: No primary data file found to delete.
[2025-10-24T17:27:07.938143] [INFO ] [MAIN      ] BBT: Starting full primary refresh.
[2025-10-24T17:27:08.152948] [INFO ] [REMOTE    ] BBD: Fetching primary data for 2025-09.
[2025-10-24T17:27:08.296324] [INFO ] [REMOTE    ] BBT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:08.947695] [INFO ] [REMOTE    ] BBN: Fetching primary data for 2025-03.
[2025-10-24T17:27:09.747717] [INFO ] [REMOTE    ] BBT: Fetching primary data for 2025-01.
[2025-10-24T17:27:09.908498] [INFO ] [REMOTE    ] BBD: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T17:27:09.957113] [INFO ] [REMOTE    ] BBN: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T17:27:10.210321] [DEBUG] [REMOTE    ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:27:10.210632] [WARN ] [REMOTE    ] BBT: No data returned for month 2025-01
[2025-10-24T17:27:10.210736] [FATAL] [REMOTE    ] BBT: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:27:10.210782] [FATAL] [MAIN      ] BBT: Failed to fetch primary data.
[2025-10-24T17:27:10.210848] [WARN ] [MAIN      ] BBT: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:27:10.210918] [INFO ] [LOCAL     ] BBT: Starting deletion of primary data.
[2025-10-24T17:27:10.210979] [DEBUG] [LOCAL     ] BBT: No primary data file found to delete.
[2025-10-24T17:27:10.211015] [INFO ] [LOCAL     ] BBT: Starting deletion of derivative data.
[2025-10-24T17:27:10.211054] [DEBUG] [LOCAL     ] BBT: No derivative data file found to delete.
[2025-10-24T17:27:10.211099] [INFO ] [MAIN      ] Update Progress: 221/2366 symbols completed. BBT took 2.5s. Estimated remaining: 4h 23m 15s. Rate: 8.1 symbols/min
[2025-10-24T17:27:10.378199] [INFO ] [MAIN      ] BBU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:10.387494] [DEBUG] [LOCAL     ] BBU: Loaded 5819 existing records from primary storage.
[2025-10-24T17:27:10.387737] [INFO ] [MAIN      ] BBU: Loaded 5819 existing records.
[2025-10-24T17:27:10.558482] [INFO ] [REMOTE    ] BBD: Fetching primary data for 2025-10.
[2025-10-24T17:27:10.563101] [WARN ] [MAIN      ] BBU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:27:10.564028] [INFO ] [MAIN      ] BBU: Wiping existing primary data before full refresh.
[2025-10-24T17:27:10.564080] [INFO ] [LOCAL     ] BBU: Starting deletion of primary data.
[2025-10-24T17:27:10.564213] [DEBUG] [LOCAL     ] BBU: Deleted primary data file.
[2025-10-24T17:27:10.564253] [INFO ] [MAIN      ] BBU: Starting full primary refresh.
[2025-10-24T17:27:10.916247] [INFO ] [REMOTE    ] BBU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:11.347669] [INFO ] [REMOTE    ] BBN: Fetching primary data for 2025-04.
[2025-10-24T17:27:12.147676] [INFO ] [REMOTE    ] BBDO: Fetching primary data for 2025-10.
[2025-10-24T17:27:12.377083] [INFO ] [REMOTE    ] BBN: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T17:27:12.484503] [INFO ] [REMOTE    ] BBD: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T17:27:12.494300] [INFO ] [REMOTE    ] BBD: Full fetch complete (77271 records).
[2025-10-24T17:27:12.494426] [DEBUG] [VALIDATOR ] BBD: Validating primary data.
[2025-10-24T17:27:12.793931] [INFO ] [REMOTE    ] BBDO: Incremental fetch complete for 2025-10 (0.65 seconds).
[2025-10-24T17:27:12.811428] [INFO ] [REMOTE    ] BBDO: Full fetch complete (7402 records).
[2025-10-24T17:27:12.845527] [DEBUG] [VALIDATOR ] BBDO: Validating primary data.
[2025-10-24T17:27:12.949675] [INFO ] [REMOTE    ] BBU: Fetching primary data for 2025-01.
[2025-10-24T17:27:12.982143] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present.
[2025-10-24T17:27:12.993146] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed.
[2025-10-24T17:27:13.001603] [INFO ] [MAIN      ] BBD: Fetched primary data is valid.
[2025-10-24T17:27:13.005087] [DEBUG] [LOCAL     ] BBD: Saving primary data.
[2025-10-24T17:27:13.005636] [FATAL] [LOCAL     ] BBD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:27:13.021543] [FATAL] [MAIN      ] BBD: Failed to save primary data.
[2025-10-24T17:27:13.026760] [WARN ] [MAIN      ] BBD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:27:13.045501] [INFO ] [LOCAL     ] BBD: Starting deletion of primary data.
[2025-10-24T17:27:13.055987] [DEBUG] [LOCAL     ] BBD: No primary data file found to delete.
[2025-10-24T17:27:13.065127] [INFO ] [LOCAL     ] BBD: Starting deletion of derivative data.
[2025-10-24T17:27:13.091403] [DEBUG] [LOCAL     ] BBD: Deleted derivative data file.
[2025-10-24T17:27:13.131156] [INFO ] [MAIN      ] Update Progress: 222/2366 symbols completed. BBD took 37.2s. Estimated remaining: 4h 22m 24s. Rate: 8.2 symbols/min
[2025-10-24T17:27:13.424218] [INFO ] [MAIN      ] BBUC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:13.447903] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present.
[2025-10-24T17:27:13.447990] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed.
[2025-10-24T17:27:13.448232] [INFO ] [MAIN      ] BBDO: Fetched primary data is valid.
[2025-10-24T17:27:13.448383] [DEBUG] [LOCAL     ] BBDO: Saving primary data.
[2025-10-24T17:27:13.448607] [FATAL] [LOCAL     ] BBDO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:27:13.448717] [FATAL] [MAIN      ] BBDO: Failed to save primary data.
[2025-10-24T17:27:13.448783] [WARN ] [MAIN      ] BBDO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:27:13.448853] [INFO ] [LOCAL     ] BBDO: Starting deletion of primary data.
[2025-10-24T17:27:13.448912] [DEBUG] [LOCAL     ] BBDO: No primary data file found to delete.
[2025-10-24T17:27:13.448950] [INFO ] [LOCAL     ] BBDO: Starting deletion of derivative data.
[2025-10-24T17:27:13.448991] [DEBUG] [LOCAL     ] BBDO: No derivative data file found to delete.
[2025-10-24T17:27:13.449048] [INFO ] [MAIN      ] Update Progress: 223/2366 symbols completed. BBDO took 26.7s. Estimated remaining: 4h 21m 9s. Rate: 8.2 symbols/min
[2025-10-24T17:27:13.520250] [INFO ] [REMOTE    ] BBU: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T17:27:13.579063] [DEBUG] [LOCAL     ] BBUC: Loaded 14063 existing records from primary storage.
[2025-10-24T17:27:13.594713] [INFO ] [MAIN      ] BBUC: Loaded 14063 existing records.
[2025-10-24T17:27:13.737575] [INFO ] [MAIN      ] BBVA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:13.747835] [INFO ] [REMOTE    ] BBN: Fetching primary data for 2025-05.
[2025-10-24T17:27:13.828819] [WARN ] [MAIN      ] BBUC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:27:13.829165] [INFO ] [MAIN      ] BBUC: Wiping existing primary data before full refresh.
[2025-10-24T17:27:13.829232] [INFO ] [LOCAL     ] BBUC: Starting deletion of primary data.
[2025-10-24T17:27:13.829946] [DEBUG] [LOCAL     ] BBUC: Deleted primary data file.
[2025-10-24T17:27:13.830012] [INFO ] [MAIN      ] BBUC: Starting full primary refresh.
[2025-10-24T17:27:14.117831] [DEBUG] [LOCAL     ] BBVA: Loaded 49463 existing records from primary storage.
[2025-10-24T17:27:14.140405] [INFO ] [MAIN      ] BBVA: Loaded 49463 existing records.
[2025-10-24T17:27:14.356484] [INFO ] [REMOTE    ] BBUC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:14.412581] [WARN ] [MAIN      ] BBVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:27:14.412781] [INFO ] [MAIN      ] BBVA: Wiping existing primary data before full refresh.
[2025-10-24T17:27:14.412831] [INFO ] [LOCAL     ] BBVA: Starting deletion of primary data.
[2025-10-24T17:27:14.413447] [DEBUG] [LOCAL     ] BBVA: Deleted primary data file.
[2025-10-24T17:27:14.413503] [INFO ] [MAIN      ] BBVA: Starting full primary refresh.
[2025-10-24T17:27:14.561600] [INFO ] [REMOTE    ] BBUC: Fetching primary data for 2025-01.
[2025-10-24T17:27:14.788511] [INFO ] [REMOTE    ] BBVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:14.939853] [INFO ] [REMOTE    ] BBN: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T17:27:15.347621] [INFO ] [REMOTE    ] BBN: Fetching primary data for 2025-06.
[2025-10-24T17:27:15.546607] [INFO ] [REMOTE    ] BBUC: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T17:27:16.134471] [INFO ] [REMOTE    ] BBN: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T17:27:16.147640] [INFO ] [REMOTE    ] BBUC: Fetching primary data for 2025-02.
[2025-10-24T17:27:16.893687] [INFO ] [REMOTE    ] BBUC: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T17:27:16.947773] [INFO ] [REMOTE    ] BBN: Fetching primary data for 2025-07.
[2025-10-24T17:27:17.747701] [INFO ] [REMOTE    ] BBVA: Fetching primary data for 2025-01.
[2025-10-24T17:27:18.003228] [INFO ] [REMOTE    ] BBN: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T17:27:18.547709] [INFO ] [REMOTE    ] BBN: Fetching primary data for 2025-08.
[2025-10-24T17:27:19.347679] [INFO ] [REMOTE    ] BBUC: Fetching primary data for 2025-03.
[2025-10-24T17:27:19.539909] [INFO ] [REMOTE    ] BBVA: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T17:27:19.578171] [INFO ] [REMOTE    ] BBN: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T17:27:20.019897] [INFO ] [REMOTE    ] BBUC: Incremental fetch complete for 2025-03 (0.67 seconds).
[2025-10-24T17:27:20.147702] [INFO ] [REMOTE    ] BBVA: Fetching primary data for 2025-02.
[2025-10-24T17:27:20.947733] [INFO ] [REMOTE    ] BBU: Fetching primary data for 2025-02.
[2025-10-24T17:27:21.041691] [DEBUG] [REMOTE    ] BBU: Error fetching primary data for 2025-02: 'API call returned an empty response.'
[2025-10-24T17:27:21.042129] [WARN ] [REMOTE    ] BBU: No data returned for month 2025-02
[2025-10-24T17:27:21.042225] [FATAL] [REMOTE    ] BBU: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:27:21.042318] [FATAL] [MAIN      ] BBU: Failed to fetch primary data.
[2025-10-24T17:27:21.042384] [WARN ] [MAIN      ] BBU: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:27:21.042462] [INFO ] [LOCAL     ] BBU: Starting deletion of primary data.
[2025-10-24T17:27:21.042534] [DEBUG] [LOCAL     ] BBU: No primary data file found to delete.
[2025-10-24T17:27:21.042573] [INFO ] [LOCAL     ] BBU: Starting deletion of derivative data.
[2025-10-24T17:27:21.042805] [DEBUG] [LOCAL     ] BBU: Deleted derivative data file.
[2025-10-24T17:27:21.042894] [INFO ] [MAIN      ] Update Progress: 224/2366 symbols completed. BBU took 10.8s. Estimated remaining: 4h 21m 5s. Rate: 8.2 symbols/min
[2025-10-24T17:27:21.225370] [INFO ] [MAIN      ] BBW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:21.256870] [DEBUG] [LOCAL     ] BBW: Loaded 27371 existing records from primary storage.
[2025-10-24T17:27:21.257208] [INFO ] [MAIN      ] BBW: Loaded 27371 existing records.
[2025-10-24T17:27:21.440969] [WARN ] [MAIN      ] BBW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:27:21.441406] [INFO ] [MAIN      ] BBW: Wiping existing primary data before full refresh.
[2025-10-24T17:27:21.441496] [INFO ] [LOCAL     ] BBW: Starting deletion of primary data.
[2025-10-24T17:27:21.442244] [DEBUG] [LOCAL     ] BBW: Deleted primary data file.
[2025-10-24T17:27:21.442303] [INFO ] [MAIN      ] BBW: Starting full primary refresh.
[2025-10-24T17:27:21.747762] [INFO ] [REMOTE    ] BBUC: Fetching primary data for 2025-04.
[2025-10-24T17:27:21.839712] [INFO ] [REMOTE    ] BBW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:21.872118] [INFO ] [REMOTE    ] BBVA: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T17:27:22.547699] [INFO ] [REMOTE    ] BBN: Fetching primary data for 2025-09.
[2025-10-24T17:27:22.622855] [INFO ] [REMOTE    ] BBUC: Incremental fetch complete for 2025-04 (0.88 seconds).
[2025-10-24T17:27:23.248162] [INFO ] [REMOTE    ] BBN: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T17:27:23.347673] [INFO ] [REMOTE    ] BBN: Fetching primary data for 2025-10.
[2025-10-24T17:27:24.147699] [INFO ] [REMOTE    ] BBW: Fetching primary data for 2025-01.
[2025-10-24T17:27:24.315321] [INFO ] [REMOTE    ] BBN: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T17:27:24.318555] [INFO ] [REMOTE    ] BBN: Full fetch complete (25012 records).
[2025-10-24T17:27:24.318692] [DEBUG] [VALIDATOR ] BBN: Validating primary data.
[2025-10-24T17:27:24.679049] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present.
[2025-10-24T17:27:24.679129] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed.
[2025-10-24T17:27:24.679526] [INFO ] [MAIN      ] BBN: Fetched primary data is valid.
[2025-10-24T17:27:24.679566] [DEBUG] [LOCAL     ] BBN: Saving primary data.
[2025-10-24T17:27:24.679879] [FATAL] [LOCAL     ] BBN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:27:24.680057] [FATAL] [MAIN      ] BBN: Failed to save primary data.
[2025-10-24T17:27:24.680105] [WARN ] [MAIN      ] BBN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:27:24.680139] [INFO ] [LOCAL     ] BBN: Starting deletion of primary data.
[2025-10-24T17:27:24.680190] [DEBUG] [LOCAL     ] BBN: No primary data file found to delete.
[2025-10-24T17:27:24.680225] [INFO ] [LOCAL     ] BBN: Starting deletion of derivative data.
[2025-10-24T17:27:24.680451] [DEBUG] [LOCAL     ] BBN: Deleted derivative data file.
[2025-10-24T17:27:24.680538] [INFO ] [MAIN      ] Update Progress: 225/2366 symbols completed. BBN took 23.7s. Estimated remaining: 4h 20m 22s. Rate: 8.2 symbols/min
[2025-10-24T17:27:24.849006] [INFO ] [MAIN      ] BBWI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:24.898537] [DEBUG] [LOCAL     ] BBWI: Loaded 53981 existing records from primary storage.
[2025-10-24T17:27:24.898887] [INFO ] [MAIN      ] BBWI: Loaded 53981 existing records.
[2025-10-24T17:27:24.960928] [INFO ] [REMOTE    ] BBVA: Fetching primary data for 2025-03.
[2025-10-24T17:27:25.078917] [WARN ] [MAIN      ] BBWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:27:25.079166] [INFO ] [MAIN      ] BBWI: Wiping existing primary data before full refresh.
[2025-10-24T17:27:25.079215] [INFO ] [LOCAL     ] BBWI: Starting deletion of primary data.
[2025-10-24T17:27:25.080377] [DEBUG] [LOCAL     ] BBWI: Deleted primary data file.
[2025-10-24T17:27:25.080435] [INFO ] [MAIN      ] BBWI: Starting full primary refresh.
[2025-10-24T17:27:25.446014] [INFO ] [REMOTE    ] BBW: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T17:27:25.464394] [INFO ] [REMOTE    ] BBWI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:25.747729] [INFO ] [REMOTE    ] BBW: Fetching primary data for 2025-02.
[2025-10-24T17:27:26.547692] [INFO ] [REMOTE    ] BBUC: Fetching primary data for 2025-05.
[2025-10-24T17:27:26.776472] [INFO ] [REMOTE    ] BBVA: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T17:27:26.906375] [INFO ] [REMOTE    ] BBW: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T17:27:27.300250] [INFO ] [REMOTE    ] BBUC: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T17:27:27.347631] [INFO ] [REMOTE    ] BBUC: Fetching primary data for 2025-06.
[2025-10-24T17:27:28.147683] [INFO ] [REMOTE    ] BBVA: Fetching primary data for 2025-04.
[2025-10-24T17:27:28.214622] [INFO ] [REMOTE    ] BBUC: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T17:27:28.947667] [INFO ] [REMOTE    ] BBWI: Fetching primary data for 2025-01.
[2025-10-24T17:27:29.747712] [INFO ] [REMOTE    ] BBW: Fetching primary data for 2025-03.
[2025-10-24T17:27:30.046470] [INFO ] [REMOTE    ] BBVA: Incremental fetch complete for 2025-04 (1.90 seconds).
[2025-10-24T17:27:30.547668] [INFO ] [REMOTE    ] BBUC: Fetching primary data for 2025-07.
[2025-10-24T17:27:30.653096] [INFO ] [REMOTE    ] BBW: Incremental fetch complete for 2025-03 (0.91 seconds).
[2025-10-24T17:27:30.844321] [INFO ] [REMOTE    ] BBWI: Incremental fetch complete for 2025-01 (1.90 seconds).
[2025-10-24T17:27:31.141254] [INFO ] [REMOTE    ] BBUC: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T17:27:31.347675] [INFO ] [REMOTE    ] BBW: Fetching primary data for 2025-04.
[2025-10-24T17:27:32.147727] [INFO ] [REMOTE    ] BBUC: Fetching primary data for 2025-08.
[2025-10-24T17:27:32.704365] [INFO ] [REMOTE    ] BBW: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T17:27:32.722205] [INFO ] [REMOTE    ] BBUC: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T17:27:32.947716] [INFO ] [REMOTE    ] BBWI: Fetching primary data for 2025-02.
[2025-10-24T17:27:33.747729] [INFO ] [REMOTE    ] BBW: Fetching primary data for 2025-05.
[2025-10-24T17:27:34.547699] [INFO ] [REMOTE    ] BBVA: Fetching primary data for 2025-05.
[2025-10-24T17:27:34.725010] [INFO ] [REMOTE    ] BBWI: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T17:27:34.784491] [INFO ] [REMOTE    ] BBW: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T17:27:35.347727] [INFO ] [REMOTE    ] BBWI: Fetching primary data for 2025-03.
[2025-10-24T17:27:36.147687] [INFO ] [REMOTE    ] BBW: Fetching primary data for 2025-06.
[2025-10-24T17:27:36.268807] [INFO ] [REMOTE    ] BBVA: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T17:27:36.947637] [INFO ] [REMOTE    ] BBUC: Fetching primary data for 2025-09.
[2025-10-24T17:27:37.057047] [INFO ] [REMOTE    ] BBWI: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T17:27:37.303297] [INFO ] [REMOTE    ] BBW: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T17:27:37.747603] [INFO ] [REMOTE    ] BBW: Fetching primary data for 2025-07.
[2025-10-24T17:27:37.981569] [INFO ] [REMOTE    ] BBUC: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T17:27:38.547695] [INFO ] [REMOTE    ] BBUC: Fetching primary data for 2025-10.
[2025-10-24T17:27:38.840480] [INFO ] [REMOTE    ] BBW: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T17:27:39.347705] [INFO ] [REMOTE    ] BBWI: Fetching primary data for 2025-04.
[2025-10-24T17:27:39.778725] [INFO ] [REMOTE    ] BBUC: Incremental fetch complete for 2025-10 (1.23 seconds).
[2025-10-24T17:27:39.783359] [INFO ] [REMOTE    ] BBUC: Full fetch complete (19286 records).
[2025-10-24T17:27:39.783481] [DEBUG] [VALIDATOR ] BBUC: Validating primary data.
[2025-10-24T17:27:40.152817] [INFO ] [REMOTE    ] BBVA: Fetching primary data for 2025-06.
[2025-10-24T17:27:40.227048] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present.
[2025-10-24T17:27:40.227194] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed.
[2025-10-24T17:27:40.227723] [INFO ] [MAIN      ] BBUC: Fetched primary data is valid.
[2025-10-24T17:27:40.227790] [DEBUG] [LOCAL     ] BBUC: Saving primary data.
[2025-10-24T17:27:40.228289] [FATAL] [LOCAL     ] BBUC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:27:40.228445] [FATAL] [MAIN      ] BBUC: Failed to save primary data.
[2025-10-24T17:27:40.228510] [WARN ] [MAIN      ] BBUC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:27:40.228580] [INFO ] [LOCAL     ] BBUC: Starting deletion of primary data.
[2025-10-24T17:27:40.228682] [DEBUG] [LOCAL     ] BBUC: No primary data file found to delete.
[2025-10-24T17:27:40.228742] [INFO ] [LOCAL     ] BBUC: Starting deletion of derivative data.
[2025-10-24T17:27:40.229437] [DEBUG] [LOCAL     ] BBUC: Deleted derivative data file.
[2025-10-24T17:27:40.229551] [INFO ] [MAIN      ] Update Progress: 226/2366 symbols completed. BBUC took 27.1s. Estimated remaining: 4h 21m 33s. Rate: 8.2 symbols/min
[2025-10-24T17:27:40.419689] [INFO ] [MAIN      ] BBY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:40.483896] [DEBUG] [LOCAL     ] BBY: Loaded 53823 existing records from primary storage.
[2025-10-24T17:27:40.484369] [INFO ] [MAIN      ] BBY: Loaded 53823 existing records.
[2025-10-24T17:27:40.677261] [WARN ] [MAIN      ] BBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:27:40.677609] [INFO ] [MAIN      ] BBY: Wiping existing primary data before full refresh.
[2025-10-24T17:27:40.677692] [INFO ] [LOCAL     ] BBY: Starting deletion of primary data.
[2025-10-24T17:27:40.678827] [DEBUG] [LOCAL     ] BBY: Deleted primary data file.
[2025-10-24T17:27:40.678895] [INFO ] [MAIN      ] BBY: Starting full primary refresh.
[2025-10-24T17:27:40.962988] [INFO ] [REMOTE    ] BBW: Fetching primary data for 2025-08.
[2025-10-24T17:27:41.077744] [INFO ] [REMOTE    ] BBY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:41.259792] [INFO ] [REMOTE    ] BBWI: Incremental fetch complete for 2025-04 (1.91 seconds).
[2025-10-24T17:27:41.747720] [INFO ] [REMOTE    ] BBY: Fetching primary data for 2025-01.
[2025-10-24T17:27:41.945697] [INFO ] [REMOTE    ] BBVA: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T17:27:41.970220] [INFO ] [REMOTE    ] BBW: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T17:27:42.547688] [INFO ] [REMOTE    ] BBW: Fetching primary data for 2025-09.
[2025-10-24T17:27:43.347633] [INFO ] [REMOTE    ] BBVA: Fetching primary data for 2025-07.
[2025-10-24T17:27:43.467545] [INFO ] [REMOTE    ] BBY: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T17:27:43.992056] [INFO ] [REMOTE    ] BBW: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T17:27:44.147672] [INFO ] [REMOTE    ] BBWI: Fetching primary data for 2025-05.
[2025-10-24T17:27:44.947691] [INFO ] [REMOTE    ] BBY: Fetching primary data for 2025-02.
[2025-10-24T17:27:45.078422] [INFO ] [REMOTE    ] BBVA: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T17:27:45.575950] [INFO ] [REMOTE    ] BBWI: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T17:27:45.747689] [INFO ] [REMOTE    ] BBWI: Fetching primary data for 2025-06.
[2025-10-24T17:27:46.547685] [INFO ] [REMOTE    ] BBVA: Fetching primary data for 2025-08.
[2025-10-24T17:27:46.654924] [INFO ] [REMOTE    ] BBY: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T17:27:47.316801] [INFO ] [REMOTE    ] BBWI: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T17:27:47.347608] [INFO ] [REMOTE    ] BBWI: Fetching primary data for 2025-07.
[2025-10-24T17:27:48.147682] [INFO ] [REMOTE    ] BBY: Fetching primary data for 2025-03.
[2025-10-24T17:27:48.181005] [INFO ] [REMOTE    ] BBVA: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T17:27:48.889202] [INFO ] [REMOTE    ] BBWI: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T17:27:48.947601] [INFO ] [REMOTE    ] BBWI: Fetching primary data for 2025-08.
[2025-10-24T17:27:49.747706] [INFO ] [REMOTE    ] BBW: Fetching primary data for 2025-10.
[2025-10-24T17:27:50.034047] [INFO ] [REMOTE    ] BBY: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T17:27:50.547602] [INFO ] [REMOTE    ] BBY: Fetching primary data for 2025-04.
[2025-10-24T17:27:50.629160] [INFO ] [REMOTE    ] BBWI: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T17:27:51.099858] [INFO ] [REMOTE    ] BBW: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T17:27:51.105804] [INFO ] [REMOTE    ] BBW: Full fetch complete (39508 records).
[2025-10-24T17:27:51.105920] [DEBUG] [VALIDATOR ] BBW: Validating primary data.
[2025-10-24T17:27:51.352774] [INFO ] [REMOTE    ] BBWI: Fetching primary data for 2025-09.
[2025-10-24T17:27:51.476463] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present.
[2025-10-24T17:27:51.476547] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed.
[2025-10-24T17:27:51.477042] [INFO ] [MAIN      ] BBW: Fetched primary data is valid.
[2025-10-24T17:27:51.477105] [DEBUG] [LOCAL     ] BBW: Saving primary data.
[2025-10-24T17:27:51.477577] [FATAL] [LOCAL     ] BBW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:27:51.477691] [FATAL] [MAIN      ] BBW: Failed to save primary data.
[2025-10-24T17:27:51.477740] [WARN ] [MAIN      ] BBW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:27:51.477807] [INFO ] [LOCAL     ] BBW: Starting deletion of primary data.
[2025-10-24T17:27:51.477865] [DEBUG] [LOCAL     ] BBW: No primary data file found to delete.
[2025-10-24T17:27:51.477901] [INFO ] [LOCAL     ] BBW: Starting deletion of derivative data.
[2025-10-24T17:27:51.478024] [DEBUG] [LOCAL     ] BBW: Deleted derivative data file.
[2025-10-24T17:27:51.478099] [INFO ] [MAIN      ] Update Progress: 227/2366 symbols completed. BBW took 30.4s. Estimated remaining: 4h 22m 3s. Rate: 8.2 symbols/min
[2025-10-24T17:27:51.650316] [INFO ] [MAIN      ] BC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:51.689882] [DEBUG] [LOCAL     ] BC: Loaded 44257 existing records from primary storage.
[2025-10-24T17:27:51.690157] [INFO ] [MAIN      ] BC: Loaded 44257 existing records.
[2025-10-24T17:27:51.875388] [WARN ] [MAIN      ] BC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:27:51.875977] [INFO ] [MAIN      ] BC: Wiping existing primary data before full refresh.
[2025-10-24T17:27:51.876025] [INFO ] [LOCAL     ] BC: Starting deletion of primary data.
[2025-10-24T17:27:51.876760] [DEBUG] [LOCAL     ] BC: Deleted primary data file.
[2025-10-24T17:27:51.876819] [INFO ] [MAIN      ] BC: Starting full primary refresh.
[2025-10-24T17:27:52.150366] [INFO ] [REMOTE    ] BBVA: Fetching primary data for 2025-09.
[2025-10-24T17:27:52.244230] [INFO ] [REMOTE    ] BC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:52.285604] [INFO ] [REMOTE    ] BBY: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T17:27:52.947718] [INFO ] [REMOTE    ] BC: Fetching primary data for 2025-01.
[2025-10-24T17:27:53.445692] [INFO ] [REMOTE    ] BBWI: Incremental fetch complete for 2025-09 (2.09 seconds).
[2025-10-24T17:27:53.747622] [INFO ] [REMOTE    ] BBY: Fetching primary data for 2025-05.
[2025-10-24T17:27:53.979556] [INFO ] [REMOTE    ] BBVA: Incremental fetch complete for 2025-09 (1.83 seconds).
[2025-10-24T17:27:54.542532] [INFO ] [REMOTE    ] BC: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T17:27:54.552530] [INFO ] [REMOTE    ] BBVA: Fetching primary data for 2025-10.
[2025-10-24T17:27:55.196300] [INFO ] [REMOTE    ] BBY: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T17:27:55.347631] [INFO ] [REMOTE    ] BBY: Fetching primary data for 2025-06.
[2025-10-24T17:27:56.147677] [INFO ] [REMOTE    ] BBWI: Fetching primary data for 2025-10.
[2025-10-24T17:27:56.401588] [INFO ] [REMOTE    ] BBVA: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T17:27:56.411172] [INFO ] [REMOTE    ] BBVA: Full fetch complete (71910 records).
[2025-10-24T17:27:56.411295] [DEBUG] [VALIDATOR ] BBVA: Validating primary data.
[2025-10-24T17:27:56.865958] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present.
[2025-10-24T17:27:56.866050] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed.
[2025-10-24T17:27:56.866905] [INFO ] [MAIN      ] BBVA: Fetched primary data is valid.
[2025-10-24T17:27:56.866970] [DEBUG] [LOCAL     ] BBVA: Saving primary data.
[2025-10-24T17:27:56.867630] [FATAL] [LOCAL     ] BBVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:27:56.867741] [FATAL] [MAIN      ] BBVA: Failed to save primary data.
[2025-10-24T17:27:56.867783] [WARN ] [MAIN      ] BBVA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:27:56.867817] [INFO ] [LOCAL     ] BBVA: Starting deletion of primary data.
[2025-10-24T17:27:56.867870] [DEBUG] [LOCAL     ] BBVA: No primary data file found to delete.
[2025-10-24T17:27:56.867905] [INFO ] [LOCAL     ] BBVA: Starting deletion of derivative data.
[2025-10-24T17:27:56.868054] [DEBUG] [LOCAL     ] BBVA: Deleted derivative data file.
[2025-10-24T17:27:56.868454] [INFO ] [MAIN      ] Update Progress: 228/2366 symbols completed. BBVA took 43.4s. Estimated remaining: 4h 21m 37s. Rate: 8.2 symbols/min
[2025-10-24T17:27:56.958674] [INFO ] [REMOTE    ] BC: Fetching primary data for 2025-02.
[2025-10-24T17:27:57.042611] [INFO ] [MAIN      ] BCAT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:57.079881] [DEBUG] [LOCAL     ] BCAT: Loaded 34467 existing records from primary storage.
[2025-10-24T17:27:57.080189] [INFO ] [MAIN      ] BCAT: Loaded 34467 existing records.
[2025-10-24T17:27:57.266261] [WARN ] [MAIN      ] BCAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:27:57.266742] [INFO ] [MAIN      ] BCAT: Wiping existing primary data before full refresh.
[2025-10-24T17:27:57.266799] [INFO ] [LOCAL     ] BCAT: Starting deletion of primary data.
[2025-10-24T17:27:57.276632] [DEBUG] [LOCAL     ] BCAT: Deleted primary data file.
[2025-10-24T17:27:57.282683] [INFO ] [MAIN      ] BCAT: Starting full primary refresh.
[2025-10-24T17:27:57.369534] [INFO ] [REMOTE    ] BBY: Incremental fetch complete for 2025-06 (2.02 seconds).
[2025-10-24T17:27:57.656866] [INFO ] [REMOTE    ] BCAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:57.747610] [INFO ] [REMOTE    ] BCAT: Fetching primary data for 2025-01.
[2025-10-24T17:27:58.055316] [INFO ] [REMOTE    ] BBWI: Incremental fetch complete for 2025-10 (1.91 seconds).
[2025-10-24T17:27:58.069863] [INFO ] [REMOTE    ] BBWI: Full fetch complete (77632 records).
[2025-10-24T17:27:58.070066] [DEBUG] [VALIDATOR ] BBWI: Validating primary data.
[2025-10-24T17:27:58.476945] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present.
[2025-10-24T17:27:58.477033] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed.
[2025-10-24T17:27:58.477921] [INFO ] [MAIN      ] BBWI: Fetched primary data is valid.
[2025-10-24T17:27:58.477985] [DEBUG] [LOCAL     ] BBWI: Saving primary data.
[2025-10-24T17:27:58.478545] [FATAL] [LOCAL     ] BBWI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:27:58.478630] [FATAL] [MAIN      ] BBWI: Failed to save primary data.
[2025-10-24T17:27:58.478711] [WARN ] [MAIN      ] BBWI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:27:58.478784] [INFO ] [LOCAL     ] BBWI: Starting deletion of primary data.
[2025-10-24T17:27:58.478846] [DEBUG] [LOCAL     ] BBWI: No primary data file found to delete.
[2025-10-24T17:27:58.478882] [INFO ] [LOCAL     ] BBWI: Starting deletion of derivative data.
[2025-10-24T17:27:58.479010] [DEBUG] [LOCAL     ] BBWI: Deleted derivative data file.
[2025-10-24T17:27:58.479407] [INFO ] [MAIN      ] Update Progress: 229/2366 symbols completed. BBWI took 33.8s. Estimated remaining: 4h 20m 36s. Rate: 8.2 symbols/min
[2025-10-24T17:27:58.559964] [INFO ] [REMOTE    ] BBY: Fetching primary data for 2025-07.
[2025-10-24T17:27:58.656689] [INFO ] [MAIN      ] BCC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:27:58.685261] [DEBUG] [LOCAL     ] BCC: Loaded 28829 existing records from primary storage.
[2025-10-24T17:27:58.685690] [INFO ] [MAIN      ] BCC: Loaded 28829 existing records.
[2025-10-24T17:27:58.834343] [INFO ] [REMOTE    ] BC: Incremental fetch complete for 2025-02 (1.88 seconds).
[2025-10-24T17:27:58.893622] [WARN ] [MAIN      ] BCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:27:58.893824] [INFO ] [MAIN      ] BCC: Wiping existing primary data before full refresh.
[2025-10-24T17:27:58.893879] [INFO ] [LOCAL     ] BCC: Starting deletion of primary data.
[2025-10-24T17:27:58.894432] [DEBUG] [LOCAL     ] BCC: Deleted primary data file.
[2025-10-24T17:27:58.894490] [INFO ] [MAIN      ] BCC: Starting full primary refresh.
[2025-10-24T17:27:59.253535] [INFO ] [REMOTE    ] BCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:27:59.307443] [INFO ] [REMOTE    ] BCAT: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T17:27:59.347620] [INFO ] [REMOTE    ] BC: Fetching primary data for 2025-03.
[2025-10-24T17:28:00.147632] [INFO ] [REMOTE    ] BCAT: Fetching primary data for 2025-02.
[2025-10-24T17:28:00.306562] [INFO ] [REMOTE    ] BBY: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T17:28:00.947682] [INFO ] [REMOTE    ] BBY: Fetching primary data for 2025-08.
[2025-10-24T17:28:01.479710] [INFO ] [REMOTE    ] BC: Incremental fetch complete for 2025-03 (2.13 seconds).
[2025-10-24T17:28:01.747681] [INFO ] [REMOTE    ] BCC: Fetching primary data for 2025-01.
[2025-10-24T17:28:02.067460] [INFO ] [REMOTE    ] BCAT: Incremental fetch complete for 2025-02 (1.92 seconds).
[2025-10-24T17:28:02.547706] [INFO ] [REMOTE    ] BC: Fetching primary data for 2025-04.
[2025-10-24T17:28:03.197974] [INFO ] [REMOTE    ] BCC: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T17:28:03.347726] [INFO ] [REMOTE    ] BCAT: Fetching primary data for 2025-03.
[2025-10-24T17:28:04.147779] [INFO ] [REMOTE    ] BCC: Fetching primary data for 2025-02.
[2025-10-24T17:28:04.883449] [INFO ] [REMOTE    ] BBY: Incremental fetch complete for 2025-08 (3.94 seconds).
[2025-10-24T17:28:04.947694] [INFO ] [REMOTE    ] BBY: Fetching primary data for 2025-09.
[2025-10-24T17:28:05.415187] [INFO ] [REMOTE    ] BC: Incremental fetch complete for 2025-04 (2.87 seconds).
[2025-10-24T17:28:05.752881] [INFO ] [REMOTE    ] BC: Fetching primary data for 2025-05.
[2025-10-24T17:28:05.766239] [INFO ] [REMOTE    ] BCC: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T17:28:06.378617] [INFO ] [REMOTE    ] BCAT: Incremental fetch complete for 2025-03 (3.03 seconds).
[2025-10-24T17:28:06.547689] [INFO ] [REMOTE    ] BCAT: Fetching primary data for 2025-04.
[2025-10-24T17:28:06.895503] [INFO ] [REMOTE    ] BBY: Incremental fetch complete for 2025-09 (1.95 seconds).
[2025-10-24T17:28:07.347676] [INFO ] [REMOTE    ] BCC: Fetching primary data for 2025-03.
[2025-10-24T17:28:07.446463] [INFO ] [REMOTE    ] BC: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T17:28:07.515287] [INFO ] [REMOTE    ] BCAT: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T17:28:08.147682] [INFO ] [REMOTE    ] BCAT: Fetching primary data for 2025-05.
[2025-10-24T17:28:08.388607] [INFO ] [REMOTE    ] BCC: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T17:28:08.947700] [INFO ] [REMOTE    ] BCC: Fetching primary data for 2025-04.
[2025-10-24T17:28:09.674998] [INFO ] [REMOTE    ] BCAT: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T17:28:09.747603] [INFO ] [REMOTE    ] BCAT: Fetching primary data for 2025-06.
[2025-10-24T17:28:10.236823] [INFO ] [REMOTE    ] BCC: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T17:28:10.547673] [INFO ] [REMOTE    ] BCC: Fetching primary data for 2025-05.
[2025-10-24T17:28:11.014272] [INFO ] [REMOTE    ] BCAT: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T17:28:11.347618] [INFO ] [REMOTE    ] BBY: Fetching primary data for 2025-10.
[2025-10-24T17:28:11.594254] [INFO ] [REMOTE    ] BCC: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T17:28:12.147751] [INFO ] [REMOTE    ] BC: Fetching primary data for 2025-06.
[2025-10-24T17:28:12.947682] [INFO ] [REMOTE    ] BCC: Fetching primary data for 2025-06.
[2025-10-24T17:28:13.304403] [INFO ] [REMOTE    ] BBY: Incremental fetch complete for 2025-10 (1.96 seconds).
[2025-10-24T17:28:13.314935] [INFO ] [REMOTE    ] BBY: Full fetch complete (77403 records).
[2025-10-24T17:28:13.315115] [DEBUG] [VALIDATOR ] BBY: Validating primary data.
[2025-10-24T17:28:13.735094] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present.
[2025-10-24T17:28:13.735272] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed.
[2025-10-24T17:28:13.736295] [INFO ] [MAIN      ] BBY: Fetched primary data is valid.
[2025-10-24T17:28:13.736419] [DEBUG] [LOCAL     ] BBY: Saving primary data.
[2025-10-24T17:28:13.737202] [FATAL] [LOCAL     ] BBY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:28:13.737316] [FATAL] [MAIN      ] BBY: Failed to save primary data.
[2025-10-24T17:28:13.737360] [WARN ] [MAIN      ] BBY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:28:13.737429] [INFO ] [LOCAL     ] BBY: Starting deletion of primary data.
[2025-10-24T17:28:13.737527] [DEBUG] [LOCAL     ] BBY: No primary data file found to delete.
[2025-10-24T17:28:13.737576] [INFO ] [LOCAL     ] BBY: Starting deletion of derivative data.
[2025-10-24T17:28:13.737750] [DEBUG] [LOCAL     ] BBY: Deleted derivative data file.
[2025-10-24T17:28:13.738210] [INFO ] [MAIN      ] Update Progress: 230/2366 symbols completed. BBY took 33.5s. Estimated remaining: 4h 21m 43s. Rate: 8.2 symbols/min
[2025-10-24T17:28:13.752805] [INFO ] [REMOTE    ] BCAT: Fetching primary data for 2025-07.
[2025-10-24T17:28:13.888396] [INFO ] [REMOTE    ] BC: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T17:28:13.951507] [INFO ] [MAIN      ] BCE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:28:14.004343] [DEBUG] [LOCAL     ] BCE: Loaded 52643 existing records from primary storage.
[2025-10-24T17:28:14.004699] [INFO ] [MAIN      ] BCE: Loaded 52643 existing records.
[2025-10-24T17:28:14.193968] [WARN ] [MAIN      ] BCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:28:14.194287] [INFO ] [MAIN      ] BCE: Wiping existing primary data before full refresh.
[2025-10-24T17:28:14.194350] [INFO ] [LOCAL     ] BCE: Starting deletion of primary data.
[2025-10-24T17:28:14.194821] [DEBUG] [LOCAL     ] BCE: Deleted primary data file.
[2025-10-24T17:28:14.194878] [INFO ] [MAIN      ] BCE: Starting full primary refresh.
[2025-10-24T17:28:14.550295] [INFO ] [REMOTE    ] BC: Fetching primary data for 2025-07.
[2025-10-24T17:28:14.572069] [INFO ] [REMOTE    ] BCC: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T17:28:14.575895] [INFO ] [REMOTE    ] BCE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:28:15.167544] [INFO ] [REMOTE    ] BCAT: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T17:28:15.347702] [INFO ] [REMOTE    ] BCE: Fetching primary data for 2025-01.
[2025-10-24T17:28:16.147608] [INFO ] [REMOTE    ] BCAT: Fetching primary data for 2025-08.
[2025-10-24T17:28:16.492283] [INFO ] [REMOTE    ] BC: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T17:28:16.947685] [INFO ] [REMOTE    ] BC: Fetching primary data for 2025-08.
[2025-10-24T17:28:17.126941] [INFO ] [REMOTE    ] BCE: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T17:28:17.202020] [INFO ] [REMOTE    ] BCAT: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T17:28:17.747687] [INFO ] [REMOTE    ] BCE: Fetching primary data for 2025-02.
[2025-10-24T17:28:18.486588] [INFO ] [REMOTE    ] BC: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T17:28:18.547706] [INFO ] [REMOTE    ] BCAT: Fetching primary data for 2025-09.
[2025-10-24T17:28:18.926521] [INFO ] [REMOTE    ] BCE: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T17:28:19.347749] [INFO ] [REMOTE    ] BCE: Fetching primary data for 2025-03.
[2025-10-24T17:28:19.955181] [INFO ] [REMOTE    ] BCAT: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T17:28:20.147672] [INFO ] [REMOTE    ] BCAT: Fetching primary data for 2025-10.
[2025-10-24T17:28:20.957824] [INFO ] [REMOTE    ] BC: Fetching primary data for 2025-09.
[2025-10-24T17:28:20.965143] [INFO ] [REMOTE    ] BCE: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T17:28:21.747622] [INFO ] [REMOTE    ] BCE: Fetching primary data for 2025-04.
[2025-10-24T17:28:21.801284] [INFO ] [REMOTE    ] BCAT: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T17:28:21.808073] [INFO ] [REMOTE    ] BCAT: Full fetch complete (50104 records).
[2025-10-24T17:28:21.808193] [DEBUG] [VALIDATOR ] BCAT: Validating primary data.
[2025-10-24T17:28:22.198569] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present.
[2025-10-24T17:28:22.198782] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed.
[2025-10-24T17:28:22.199405] [INFO ] [MAIN      ] BCAT: Fetched primary data is valid.
[2025-10-24T17:28:22.199485] [DEBUG] [LOCAL     ] BCAT: Saving primary data.
[2025-10-24T17:28:22.200058] [FATAL] [LOCAL     ] BCAT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:28:22.200206] [FATAL] [MAIN      ] BCAT: Failed to save primary data.
[2025-10-24T17:28:22.200274] [WARN ] [MAIN      ] BCAT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:28:22.200406] [INFO ] [LOCAL     ] BCAT: Starting deletion of primary data.
[2025-10-24T17:28:22.200562] [DEBUG] [LOCAL     ] BCAT: No primary data file found to delete.
[2025-10-24T17:28:22.200624] [INFO ] [LOCAL     ] BCAT: Starting deletion of derivative data.
[2025-10-24T17:28:22.200892] [DEBUG] [LOCAL     ] BCAT: Deleted derivative data file.
[2025-10-24T17:28:22.201480] [INFO ] [MAIN      ] Update Progress: 231/2366 symbols completed. BCAT took 25.3s. Estimated remaining: 4h 21m 46s. Rate: 8.2 symbols/min
[2025-10-24T17:28:22.329405] [INFO ] [REMOTE    ] BC: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T17:28:22.408284] [INFO ] [MAIN      ] BCH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:28:22.439409] [DEBUG] [LOCAL     ] BCH: Loaded 30215 existing records from primary storage.
[2025-10-24T17:28:22.439747] [INFO ] [MAIN      ] BCH: Loaded 30215 existing records.
[2025-10-24T17:28:22.552894] [INFO ] [REMOTE    ] BCC: Fetching primary data for 2025-07.
[2025-10-24T17:28:22.624735] [WARN ] [MAIN      ] BCH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:28:22.624951] [INFO ] [MAIN      ] BCH: Wiping existing primary data before full refresh.
[2025-10-24T17:28:22.625000] [INFO ] [LOCAL     ] BCH: Starting deletion of primary data.
[2025-10-24T17:28:22.625590] [DEBUG] [LOCAL     ] BCH: Deleted primary data file.
[2025-10-24T17:28:22.625688] [INFO ] [MAIN      ] BCH: Starting full primary refresh.
[2025-10-24T17:28:22.998414] [INFO ] [REMOTE    ] BCH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:28:23.032803] [INFO ] [REMOTE    ] BCE: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T17:28:23.347727] [INFO ] [REMOTE    ] BCE: Fetching primary data for 2025-05.
[2025-10-24T17:28:23.712995] [INFO ] [REMOTE    ] BCC: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T17:28:24.147639] [INFO ] [REMOTE    ] BC: Fetching primary data for 2025-10.
[2025-10-24T17:28:24.947708] [INFO ] [REMOTE    ] BCC: Fetching primary data for 2025-08.
[2025-10-24T17:28:25.103920] [INFO ] [REMOTE    ] BCE: Incremental fetch complete for 2025-05 (1.76 seconds).
[2025-10-24T17:28:25.747621] [INFO ] [REMOTE    ] BCE: Fetching primary data for 2025-06.
[2025-10-24T17:28:25.827546] [INFO ] [REMOTE    ] BC: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T17:28:25.835163] [INFO ] [REMOTE    ] BC: Full fetch complete (63840 records).
[2025-10-24T17:28:25.835280] [DEBUG] [VALIDATOR ] BC: Validating primary data.
[2025-10-24T17:28:26.227529] [DEBUG] [VALIDATOR ] BC: All expected trading days are present.
[2025-10-24T17:28:26.227711] [DEBUG] [VALIDATOR ] BC: Primary data validation passed.
[2025-10-24T17:28:26.228619] [INFO ] [MAIN      ] BC: Fetched primary data is valid.
[2025-10-24T17:28:26.228856] [DEBUG] [LOCAL     ] BC: Saving primary data.
[2025-10-24T17:28:26.229684] [FATAL] [LOCAL     ] BC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:28:26.229770] [FATAL] [MAIN      ] BC: Failed to save primary data.
[2025-10-24T17:28:26.229834] [WARN ] [MAIN      ] BC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:28:26.229902] [INFO ] [LOCAL     ] BC: Starting deletion of primary data.
[2025-10-24T17:28:26.229964] [DEBUG] [LOCAL     ] BC: No primary data file found to delete.
[2025-10-24T17:28:26.229999] [INFO ] [LOCAL     ] BC: Starting deletion of derivative data.
[2025-10-24T17:28:26.230156] [DEBUG] [LOCAL     ] BC: Deleted derivative data file.
[2025-10-24T17:28:26.230524] [INFO ] [MAIN      ] Update Progress: 232/2366 symbols completed. BC took 34.8s. Estimated remaining: 4h 21m 8s. Rate: 8.2 symbols/min
[2025-10-24T17:28:26.355570] [INFO ] [REMOTE    ] BCC: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T17:28:26.430851] [INFO ] [MAIN      ] BCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:28:26.456346] [DEBUG] [LOCAL     ] BCO: Loaded 25109 existing records from primary storage.
[2025-10-24T17:28:26.456618] [INFO ] [MAIN      ] BCO: Loaded 25109 existing records.
[2025-10-24T17:28:26.556368] [INFO ] [REMOTE    ] BCC: Fetching primary data for 2025-09.
[2025-10-24T17:28:26.648752] [WARN ] [MAIN      ] BCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:28:26.648972] [INFO ] [MAIN      ] BCO: Wiping existing primary data before full refresh.
[2025-10-24T17:28:26.649021] [INFO ] [LOCAL     ] BCO: Starting deletion of primary data.
[2025-10-24T17:28:26.649554] [DEBUG] [LOCAL     ] BCO: Deleted primary data file.
[2025-10-24T17:28:26.649610] [INFO ] [MAIN      ] BCO: Starting full primary refresh.
[2025-10-24T17:28:27.010231] [INFO ] [REMOTE    ] BCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:28:27.183065] [INFO ] [REMOTE    ] BCE: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T17:28:27.347638] [INFO ] [REMOTE    ] BCH: Fetching primary data for 2025-01.
[2025-10-24T17:28:27.888525] [INFO ] [REMOTE    ] BCC: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T17:28:28.147633] [INFO ] [REMOTE    ] BCE: Fetching primary data for 2025-07.
[2025-10-24T17:28:28.659612] [INFO ] [REMOTE    ] BCH: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T17:28:28.947717] [INFO ] [REMOTE    ] BCH: Fetching primary data for 2025-02.
[2025-10-24T17:28:29.747684] [INFO ] [REMOTE    ] BCC: Fetching primary data for 2025-10.
[2025-10-24T17:28:29.800513] [INFO ] [REMOTE    ] BCH: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T17:28:29.850054] [INFO ] [REMOTE    ] BCE: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T17:28:30.547730] [INFO ] [REMOTE    ] BCO: Fetching primary data for 2025-01.
[2025-10-24T17:28:30.871664] [INFO ] [REMOTE    ] BCC: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T17:28:30.878301] [INFO ] [REMOTE    ] BCC: Full fetch complete (41703 records).
[2025-10-24T17:28:30.878437] [DEBUG] [VALIDATOR ] BCC: Validating primary data.
[2025-10-24T17:28:31.309387] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present.
[2025-10-24T17:28:31.309467] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed.
[2025-10-24T17:28:31.310010] [INFO ] [MAIN      ] BCC: Fetched primary data is valid.
[2025-10-24T17:28:31.310072] [DEBUG] [LOCAL     ] BCC: Saving primary data.
[2025-10-24T17:28:31.310488] [FATAL] [LOCAL     ] BCC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:28:31.310577] [FATAL] [MAIN      ] BCC: Failed to save primary data.
[2025-10-24T17:28:31.310620] [WARN ] [MAIN      ] BCC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:28:31.310691] [INFO ] [LOCAL     ] BCC: Starting deletion of primary data.
[2025-10-24T17:28:31.310760] [DEBUG] [LOCAL     ] BCC: No primary data file found to delete.
[2025-10-24T17:28:31.310797] [INFO ] [LOCAL     ] BCC: Starting deletion of derivative data.
[2025-10-24T17:28:31.310925] [DEBUG] [LOCAL     ] BCC: Deleted derivative data file.
[2025-10-24T17:28:31.311001] [INFO ] [MAIN      ] Update Progress: 233/2366 symbols completed. BCC took 32.8s. Estimated remaining: 4h 20m 40s. Rate: 8.2 symbols/min
[2025-10-24T17:28:31.355889] [INFO ] [REMOTE    ] BCH: Fetching primary data for 2025-03.
[2025-10-24T17:28:31.507880] [INFO ] [MAIN      ] BCS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:28:31.558594] [DEBUG] [LOCAL     ] BCS: Loaded 53831 existing records from primary storage.
[2025-10-24T17:28:31.558937] [INFO ] [MAIN      ] BCS: Loaded 53831 existing records.
[2025-10-24T17:28:31.751116] [WARN ] [MAIN      ] BCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:28:31.751358] [INFO ] [MAIN      ] BCS: Wiping existing primary data before full refresh.
[2025-10-24T17:28:31.751414] [INFO ] [LOCAL     ] BCS: Starting deletion of primary data.
[2025-10-24T17:28:31.752772] [DEBUG] [LOCAL     ] BCS: Deleted primary data file.
[2025-10-24T17:28:31.752842] [INFO ] [MAIN      ] BCS: Starting full primary refresh.
[2025-10-24T17:28:32.065471] [INFO ] [REMOTE    ] BCO: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T17:28:32.141227] [INFO ] [REMOTE    ] BCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:28:32.147606] [INFO ] [REMOTE    ] BCS: Fetching primary data for 2025-01.
[2025-10-24T17:28:32.795930] [INFO ] [REMOTE    ] BCH: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T17:28:32.947756] [INFO ] [REMOTE    ] BCE: Fetching primary data for 2025-08.
[2025-10-24T17:28:33.747708] [INFO ] [REMOTE    ] BCO: Fetching primary data for 2025-02.
[2025-10-24T17:28:34.310523] [INFO ] [REMOTE    ] BCS: Incremental fetch complete for 2025-01 (2.16 seconds).
[2025-10-24T17:28:34.360302] [INFO ] [REMOTE    ] BCE: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T17:28:34.547615] [INFO ] [REMOTE    ] BCE: Fetching primary data for 2025-09.
[2025-10-24T17:28:34.894638] [INFO ] [REMOTE    ] BCO: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T17:28:35.347678] [INFO ] [REMOTE    ] BCS: Fetching primary data for 2025-02.
[2025-10-24T17:28:35.973021] [INFO ] [REMOTE    ] BCE: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T17:28:36.147679] [INFO ] [REMOTE    ] BCH: Fetching primary data for 2025-04.
[2025-10-24T17:28:36.947680] [INFO ] [REMOTE    ] BCE: Fetching primary data for 2025-10.
[2025-10-24T17:28:37.437307] [INFO ] [REMOTE    ] BCS: Incremental fetch complete for 2025-02 (2.09 seconds).
[2025-10-24T17:28:37.712243] [INFO ] [REMOTE    ] BCH: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T17:28:37.747619] [INFO ] [REMOTE    ] BCO: Fetching primary data for 2025-03.
[2025-10-24T17:28:38.547729] [INFO ] [REMOTE    ] BCS: Fetching primary data for 2025-03.
[2025-10-24T17:28:38.748823] [INFO ] [REMOTE    ] BCO: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T17:28:38.846298] [INFO ] [REMOTE    ] BCE: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T17:28:38.856314] [INFO ] [REMOTE    ] BCE: Full fetch complete (76092 records).
[2025-10-24T17:28:38.856427] [DEBUG] [VALIDATOR ] BCE: Validating primary data.
[2025-10-24T17:28:39.290845] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present.
[2025-10-24T17:28:39.290929] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed.
[2025-10-24T17:28:39.291756] [INFO ] [MAIN      ] BCE: Fetched primary data is valid.
[2025-10-24T17:28:39.291820] [DEBUG] [LOCAL     ] BCE: Saving primary data.
[2025-10-24T17:28:39.292430] [FATAL] [LOCAL     ] BCE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:28:39.292540] [FATAL] [MAIN      ] BCE: Failed to save primary data.
[2025-10-24T17:28:39.292584] [WARN ] [MAIN      ] BCE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:28:39.292631] [INFO ] [LOCAL     ] BCE: Starting deletion of primary data.
[2025-10-24T17:28:39.292734] [DEBUG] [LOCAL     ] BCE: No primary data file found to delete.
[2025-10-24T17:28:39.292776] [INFO ] [LOCAL     ] BCE: Starting deletion of derivative data.
[2025-10-24T17:28:39.292924] [DEBUG] [LOCAL     ] BCE: Deleted derivative data file.
[2025-10-24T17:28:39.293412] [INFO ] [MAIN      ] Update Progress: 234/2366 symbols completed. BCE took 25.6s. Estimated remaining: 4h 20m 38s. Rate: 8.2 symbols/min
[2025-10-24T17:28:39.356004] [INFO ] [REMOTE    ] BCO: Fetching primary data for 2025-04.
[2025-10-24T17:28:39.462139] [INFO ] [MAIN      ] BCSF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:28:39.489465] [DEBUG] [LOCAL     ] BCSF: Loaded 28326 existing records from primary storage.
[2025-10-24T17:28:39.489761] [INFO ] [MAIN      ] BCSF: Loaded 28326 existing records.
[2025-10-24T17:28:39.669591] [WARN ] [MAIN      ] BCSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:28:39.669828] [INFO ] [MAIN      ] BCSF: Wiping existing primary data before full refresh.
[2025-10-24T17:28:39.669877] [INFO ] [LOCAL     ] BCSF: Starting deletion of primary data.
[2025-10-24T17:28:39.670154] [DEBUG] [LOCAL     ] BCSF: Deleted primary data file.
[2025-10-24T17:28:39.670210] [INFO ] [MAIN      ] BCSF: Starting full primary refresh.
[2025-10-24T17:28:40.034911] [INFO ] [REMOTE    ] BCSF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:28:40.147630] [INFO ] [REMOTE    ] BCSF: Fetching primary data for 2025-01.
[2025-10-24T17:28:40.363234] [INFO ] [REMOTE    ] BCS: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T17:28:40.675905] [INFO ] [REMOTE    ] BCO: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T17:28:40.947622] [INFO ] [REMOTE    ] BCO: Fetching primary data for 2025-05.
[2025-10-24T17:28:41.349030] [INFO ] [REMOTE    ] BCSF: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T17:28:41.747675] [INFO ] [REMOTE    ] BCH: Fetching primary data for 2025-05.
[2025-10-24T17:28:42.319703] [INFO ] [REMOTE    ] BCO: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T17:28:42.547637] [INFO ] [REMOTE    ] BCSF: Fetching primary data for 2025-02.
[2025-10-24T17:28:43.129041] [INFO ] [REMOTE    ] BCH: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T17:28:43.347628] [INFO ] [REMOTE    ] BCS: Fetching primary data for 2025-04.
[2025-10-24T17:28:43.373506] [INFO ] [REMOTE    ] BCSF: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T17:28:44.147709] [INFO ] [REMOTE    ] BCSF: Fetching primary data for 2025-03.
[2025-10-24T17:28:44.947718] [INFO ] [REMOTE    ] BCH: Fetching primary data for 2025-06.
[2025-10-24T17:28:45.544701] [INFO ] [REMOTE    ] BCS: Incremental fetch complete for 2025-04 (2.20 seconds).
[2025-10-24T17:28:45.546254] [INFO ] [REMOTE    ] BCSF: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T17:28:45.747663] [INFO ] [REMOTE    ] BCSF: Fetching primary data for 2025-04.
[2025-10-24T17:28:46.050196] [INFO ] [REMOTE    ] BCH: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T17:28:46.547730] [INFO ] [REMOTE    ] BCS: Fetching primary data for 2025-05.
[2025-10-24T17:28:46.892551] [INFO ] [REMOTE    ] BCSF: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T17:28:47.347777] [INFO ] [REMOTE    ] BCO: Fetching primary data for 2025-06.
[2025-10-24T17:28:48.147745] [INFO ] [REMOTE    ] BCH: Fetching primary data for 2025-07.
[2025-10-24T17:28:48.435288] [INFO ] [REMOTE    ] BCS: Incremental fetch complete for 2025-05 (1.89 seconds).
[2025-10-24T17:28:48.552418] [INFO ] [REMOTE    ] BCO: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T17:28:48.947692] [INFO ] [REMOTE    ] BCSF: Fetching primary data for 2025-05.
[2025-10-24T17:28:49.128274] [INFO ] [REMOTE    ] BCH: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T17:28:49.747637] [INFO ] [REMOTE    ] BCO: Fetching primary data for 2025-07.
[2025-10-24T17:28:50.153247] [INFO ] [REMOTE    ] BCSF: Incremental fetch complete for 2025-05 (1.21 seconds).
[2025-10-24T17:28:50.547691] [INFO ] [REMOTE    ] BCS: Fetching primary data for 2025-06.
[2025-10-24T17:28:50.895982] [INFO ] [REMOTE    ] BCO: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T17:28:51.347693] [INFO ] [REMOTE    ] BCO: Fetching primary data for 2025-08.
[2025-10-24T17:28:52.147769] [INFO ] [REMOTE    ] BCSF: Fetching primary data for 2025-06.
[2025-10-24T17:28:52.447734] [INFO ] [REMOTE    ] BCS: Incremental fetch complete for 2025-06 (1.90 seconds).
[2025-10-24T17:28:52.585788] [INFO ] [REMOTE    ] BCO: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T17:28:52.947716] [INFO ] [REMOTE    ] BCH: Fetching primary data for 2025-08.
[2025-10-24T17:28:53.432582] [INFO ] [REMOTE    ] BCSF: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T17:28:53.747736] [INFO ] [REMOTE    ] BCO: Fetching primary data for 2025-09.
[2025-10-24T17:28:54.327786] [INFO ] [REMOTE    ] BCH: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T17:28:54.547626] [INFO ] [REMOTE    ] BCH: Fetching primary data for 2025-09.
[2025-10-24T17:28:54.722366] [INFO ] [REMOTE    ] BCO: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T17:28:55.347677] [INFO ] [REMOTE    ] BCO: Fetching primary data for 2025-10.
[2025-10-24T17:28:55.490637] [INFO ] [REMOTE    ] BCH: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T17:28:56.147822] [INFO ] [REMOTE    ] BCH: Fetching primary data for 2025-10.
[2025-10-24T17:28:56.520009] [INFO ] [REMOTE    ] BCO: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T17:28:56.525381] [INFO ] [REMOTE    ] BCO: Full fetch complete (35982 records).
[2025-10-24T17:28:56.525620] [DEBUG] [VALIDATOR ] BCO: Validating primary data.
[2025-10-24T17:28:56.950117] [INFO ] [REMOTE    ] BCSF: Fetching primary data for 2025-07.
[2025-10-24T17:28:57.061925] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present.
[2025-10-24T17:28:57.062026] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed.
[2025-10-24T17:28:57.062566] [INFO ] [MAIN      ] BCO: Fetched primary data is valid.
[2025-10-24T17:28:57.062612] [DEBUG] [LOCAL     ] BCO: Saving primary data.
[2025-10-24T17:28:57.063158] [FATAL] [LOCAL     ] BCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:28:57.063254] [FATAL] [MAIN      ] BCO: Failed to save primary data.
[2025-10-24T17:28:57.063297] [WARN ] [MAIN      ] BCO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:28:57.063334] [INFO ] [LOCAL     ] BCO: Starting deletion of primary data.
[2025-10-24T17:28:57.063388] [DEBUG] [LOCAL     ] BCO: No primary data file found to delete.
[2025-10-24T17:28:57.063451] [INFO ] [LOCAL     ] BCO: Starting deletion of derivative data.
[2025-10-24T17:28:57.063704] [DEBUG] [LOCAL     ] BCO: Deleted derivative data file.
[2025-10-24T17:28:57.063807] [INFO ] [MAIN      ] Update Progress: 235/2366 symbols completed. BCO took 30.8s. Estimated remaining: 4h 22m 6s. Rate: 8.1 symbols/min
[2025-10-24T17:28:57.312371] [INFO ] [MAIN      ] BCX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:28:57.336554] [DEBUG] [LOCAL     ] BCX: Loaded 22191 existing records from primary storage.
[2025-10-24T17:28:57.336878] [INFO ] [MAIN      ] BCX: Loaded 22191 existing records.
[2025-10-24T17:28:57.516771] [WARN ] [MAIN      ] BCX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:28:57.517204] [INFO ] [MAIN      ] BCX: Wiping existing primary data before full refresh.
[2025-10-24T17:28:57.517337] [INFO ] [LOCAL     ] BCX: Starting deletion of primary data.
[2025-10-24T17:28:57.517731] [DEBUG] [LOCAL     ] BCX: Deleted primary data file.
[2025-10-24T17:28:57.517790] [INFO ] [MAIN      ] BCX: Starting full primary refresh.
[2025-10-24T17:28:57.624603] [INFO ] [REMOTE    ] BCH: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T17:28:57.646994] [INFO ] [REMOTE    ] BCH: Full fetch complete (41885 records).
[2025-10-24T17:28:57.657370] [DEBUG] [VALIDATOR ] BCH: Validating primary data.
[2025-10-24T17:28:57.757990] [INFO ] [REMOTE    ] BCS: Fetching primary data for 2025-07.
[2025-10-24T17:28:58.180756] [INFO ] [REMOTE    ] BCX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:28:58.308565] [INFO ] [REMOTE    ] BCSF: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T17:28:58.329061] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present.
[2025-10-24T17:28:58.329440] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed.
[2025-10-24T17:28:58.329985] [INFO ] [MAIN      ] BCH: Fetched primary data is valid.
[2025-10-24T17:28:58.330047] [DEBUG] [LOCAL     ] BCH: Saving primary data.
[2025-10-24T17:28:58.330442] [FATAL] [LOCAL     ] BCH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:28:58.330527] [FATAL] [MAIN      ] BCH: Failed to save primary data.
[2025-10-24T17:28:58.330574] [WARN ] [MAIN      ] BCH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:28:58.330687] [INFO ] [LOCAL     ] BCH: Starting deletion of primary data.
[2025-10-24T17:28:58.330776] [DEBUG] [LOCAL     ] BCH: No primary data file found to delete.
[2025-10-24T17:28:58.330846] [INFO ] [LOCAL     ] BCH: Starting deletion of derivative data.
[2025-10-24T17:28:58.331024] [DEBUG] [LOCAL     ] BCH: Deleted derivative data file.
[2025-10-24T17:28:58.331134] [INFO ] [MAIN      ] Update Progress: 236/2366 symbols completed. BCH took 36.1s. Estimated remaining: 4h 21m 3s. Rate: 8.2 symbols/min
[2025-10-24T17:28:58.498509] [INFO ] [MAIN      ] BDC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:28:58.524113] [DEBUG] [LOCAL     ] BDC: Loaded 24096 existing records from primary storage.
[2025-10-24T17:28:58.524382] [INFO ] [MAIN      ] BDC: Loaded 24096 existing records.
[2025-10-24T17:28:58.555098] [INFO ] [REMOTE    ] BCSF: Fetching primary data for 2025-08.
[2025-10-24T17:28:58.706969] [WARN ] [MAIN      ] BDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:28:58.707176] [INFO ] [MAIN      ] BDC: Wiping existing primary data before full refresh.
[2025-10-24T17:28:58.707262] [INFO ] [LOCAL     ] BDC: Starting deletion of primary data.
[2025-10-24T17:28:58.707522] [DEBUG] [LOCAL     ] BDC: Deleted primary data file.
[2025-10-24T17:28:58.707581] [INFO ] [MAIN      ] BDC: Starting full primary refresh.
[2025-10-24T17:28:59.052523] [INFO ] [REMOTE    ] BDC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:28:59.347624] [INFO ] [REMOTE    ] BCX: Fetching primary data for 2025-01.
[2025-10-24T17:28:59.516005] [INFO ] [REMOTE    ] BCSF: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T17:28:59.805129] [INFO ] [REMOTE    ] BCS: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T17:29:00.147723] [INFO ] [REMOTE    ] BCS: Fetching primary data for 2025-08.
[2025-10-24T17:29:00.662890] [INFO ] [REMOTE    ] BCX: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T17:29:00.947624] [INFO ] [REMOTE    ] BCX: Fetching primary data for 2025-02.
[2025-10-24T17:29:01.747759] [INFO ] [REMOTE    ] BDC: Fetching primary data for 2025-01.
[2025-10-24T17:29:02.094775] [INFO ] [REMOTE    ] BCS: Incremental fetch complete for 2025-08 (1.95 seconds).
[2025-10-24T17:29:02.547680] [INFO ] [REMOTE    ] BCS: Fetching primary data for 2025-09.
[2025-10-24T17:29:03.347615] [INFO ] [REMOTE    ] BCSF: Fetching primary data for 2025-09.
[2025-10-24T17:29:03.513001] [INFO ] [REMOTE    ] BDC: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T17:29:03.589487] [INFO ] [REMOTE    ] BCX: Incremental fetch complete for 2025-02 (2.64 seconds).
[2025-10-24T17:29:04.147622] [INFO ] [REMOTE    ] BCX: Fetching primary data for 2025-03.
[2025-10-24T17:29:04.614327] [INFO ] [REMOTE    ] BCS: Incremental fetch complete for 2025-09 (2.07 seconds).
[2025-10-24T17:29:04.893395] [INFO ] [REMOTE    ] BCSF: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T17:29:04.947687] [INFO ] [REMOTE    ] BCS: Fetching primary data for 2025-10.
[2025-10-24T17:29:05.235418] [INFO ] [REMOTE    ] BCX: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T17:29:05.747711] [INFO ] [REMOTE    ] BCX: Fetching primary data for 2025-04.
[2025-10-24T17:29:06.547683] [INFO ] [REMOTE    ] BCSF: Fetching primary data for 2025-10.
[2025-10-24T17:29:06.980109] [INFO ] [REMOTE    ] BCX: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T17:29:07.043509] [INFO ] [REMOTE    ] BCS: Incremental fetch complete for 2025-10 (2.10 seconds).
[2025-10-24T17:29:07.056190] [INFO ] [REMOTE    ] BCS: Full fetch complete (77526 records).
[2025-10-24T17:29:07.056440] [DEBUG] [VALIDATOR ] BCS: Validating primary data.
[2025-10-24T17:29:07.356195] [INFO ] [REMOTE    ] BDC: Fetching primary data for 2025-02.
[2025-10-24T17:29:07.491389] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present.
[2025-10-24T17:29:07.491485] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed.
[2025-10-24T17:29:07.492368] [INFO ] [MAIN      ] BCS: Fetched primary data is valid.
[2025-10-24T17:29:07.492445] [DEBUG] [LOCAL     ] BCS: Saving primary data.
[2025-10-24T17:29:07.493178] [FATAL] [LOCAL     ] BCS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:29:07.493278] [FATAL] [MAIN      ] BCS: Failed to save primary data.
[2025-10-24T17:29:07.493321] [WARN ] [MAIN      ] BCS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:29:07.493356] [INFO ] [LOCAL     ] BCS: Starting deletion of primary data.
[2025-10-24T17:29:07.493412] [DEBUG] [LOCAL     ] BCS: No primary data file found to delete.
[2025-10-24T17:29:07.493448] [INFO ] [LOCAL     ] BCS: Starting deletion of derivative data.
[2025-10-24T17:29:07.493673] [DEBUG] [LOCAL     ] BCS: Deleted derivative data file.
[2025-10-24T17:29:07.494072] [INFO ] [MAIN      ] Update Progress: 237/2366 symbols completed. BCS took 36.2s. Estimated remaining: 4h 21m 12s. Rate: 8.2 symbols/min
[2025-10-24T17:29:08.060998] [INFO ] [REMOTE    ] BCSF: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T17:29:08.068161] [INFO ] [REMOTE    ] BCSF: Full fetch complete (39916 records).
[2025-10-24T17:29:08.068271] [DEBUG] [VALIDATOR ] BCSF: Validating primary data.
[2025-10-24T17:29:08.152758] [INFO ] [REMOTE    ] BCX: Fetching primary data for 2025-05.
[2025-10-24T17:29:08.486044] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present.
[2025-10-24T17:29:08.486275] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed.
[2025-10-24T17:29:08.486859] [INFO ] [MAIN      ] BCSF: Fetched primary data is valid.
[2025-10-24T17:29:08.486936] [DEBUG] [LOCAL     ] BCSF: Saving primary data.
[2025-10-24T17:29:08.487415] [FATAL] [LOCAL     ] BCSF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:29:08.487508] [FATAL] [MAIN      ] BCSF: Failed to save primary data.
[2025-10-24T17:29:08.487573] [WARN ] [MAIN      ] BCSF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:29:08.487660] [INFO ] [LOCAL     ] BCSF: Starting deletion of primary data.
[2025-10-24T17:29:08.487738] [DEBUG] [LOCAL     ] BCSF: No primary data file found to delete.
[2025-10-24T17:29:08.487777] [INFO ] [LOCAL     ] BCSF: Starting deletion of derivative data.
[2025-10-24T17:29:08.487918] [DEBUG] [LOCAL     ] BCSF: Deleted derivative data file.
[2025-10-24T17:29:08.488013] [INFO ] [MAIN      ] Update Progress: 238/2366 symbols completed. BCSF took 29.2s. Estimated remaining: 4h 20m 8s. Rate: 8.2 symbols/min
[2025-10-24T17:29:08.567981] [INFO ] [REMOTE    ] BDC: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T17:29:08.947611] [INFO ] [REMOTE    ] BDC: Fetching primary data for 2025-03.
[2025-10-24T17:29:09.345491] [INFO ] [REMOTE    ] BCX: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T17:29:09.747700] [INFO ] [REMOTE    ] BCX: Fetching primary data for 2025-06.
[2025-10-24T17:29:10.316838] [INFO ] [REMOTE    ] BDC: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T17:29:10.547706] [INFO ] [REMOTE    ] BDC: Fetching primary data for 2025-04.
[2025-10-24T17:29:10.893031] [INFO ] [REMOTE    ] BCX: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T17:29:11.347757] [INFO ] [REMOTE    ] BCX: Fetching primary data for 2025-07.
[2025-10-24T17:29:11.682121] [INFO ] [REMOTE    ] BDC: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T17:29:12.147626] [INFO ] [REMOTE    ] BDC: Fetching primary data for 2025-05.
[2025-10-24T17:29:12.244547] [INFO ] [REMOTE    ] BCX: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T17:29:12.947751] [INFO ] [REMOTE    ] BCX: Fetching primary data for 2025-08.
[2025-10-24T17:29:13.384146] [INFO ] [REMOTE    ] BDC: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T17:29:13.747728] [INFO ] [REMOTE    ] BDC: Fetching primary data for 2025-06.
[2025-10-24T17:29:13.897284] [INFO ] [REMOTE    ] BCX: Incremental fetch complete for 2025-08 (0.95 seconds).
[2025-10-24T17:29:14.547740] [INFO ] [REMOTE    ] BCX: Fetching primary data for 2025-09.
[2025-10-24T17:29:14.976558] [INFO ] [REMOTE    ] BDC: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T17:29:15.347721] [INFO ] [REMOTE    ] BDC: Fetching primary data for 2025-07.
[2025-10-24T17:29:15.602430] [INFO ] [REMOTE    ] BCX: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T17:29:16.147706] [INFO ] [REMOTE    ] BCX: Fetching primary data for 2025-10.
[2025-10-24T17:29:16.564887] [INFO ] [REMOTE    ] BDC: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T17:29:16.947702] [INFO ] [REMOTE    ] BDC: Fetching primary data for 2025-08.
[2025-10-24T17:29:17.462987] [INFO ] [REMOTE    ] BCX: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T17:29:17.468118] [INFO ] [REMOTE    ] BCX: Full fetch complete (33614 records).
[2025-10-24T17:29:17.468239] [DEBUG] [VALIDATOR ] BCX: Validating primary data.
[2025-10-24T17:29:17.849257] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present.
[2025-10-24T17:29:17.849369] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed.
[2025-10-24T17:29:17.849979] [INFO ] [MAIN      ] BCX: Fetched primary data is valid.
[2025-10-24T17:29:17.850056] [DEBUG] [LOCAL     ] BCX: Saving primary data.
[2025-10-24T17:29:17.850471] [FATAL] [LOCAL     ] BCX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:29:17.855984] [FATAL] [MAIN      ] BCX: Failed to save primary data.
[2025-10-24T17:29:17.865213] [WARN ] [MAIN      ] BCX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:29:17.865724] [INFO ] [REMOTE    ] BDC: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T17:29:17.865857] [INFO ] [LOCAL     ] BCX: Starting deletion of primary data.
[2025-10-24T17:29:17.871528] [DEBUG] [LOCAL     ] BCX: No primary data file found to delete.
[2025-10-24T17:29:17.871704] [INFO ] [LOCAL     ] BCX: Starting deletion of derivative data.
[2025-10-24T17:29:17.871996] [INFO ] [REMOTE    ] BDC: Fetching primary data for 2025-09.
[2025-10-24T17:29:17.872963] [DEBUG] [LOCAL     ] BCX: Deleted derivative data file.
[2025-10-24T17:29:17.873071] [INFO ] [MAIN      ] Update Progress: 239/2366 symbols completed. BCX took 20.8s. Estimated remaining: 4h 20m 19s. Rate: 8.2 symbols/min
[2025-10-24T17:29:18.911556] [INFO ] [REMOTE    ] BDC: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T17:29:18.916811] [INFO ] [REMOTE    ] BDC: Fetching primary data for 2025-10.
[2025-10-24T17:29:20.162898] [INFO ] [REMOTE    ] BDC: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T17:29:20.167236] [INFO ] [REMOTE    ] BDC: Full fetch complete (35616 records).
[2025-10-24T17:29:20.167328] [DEBUG] [VALIDATOR ] BDC: Validating primary data.
[2025-10-24T17:29:20.541721] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present.
[2025-10-24T17:29:20.541803] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed.
[2025-10-24T17:29:20.542254] [INFO ] [MAIN      ] BDC: Fetched primary data is valid.
[2025-10-24T17:29:20.542293] [DEBUG] [LOCAL     ] BDC: Saving primary data.
[2025-10-24T17:29:20.542638] [FATAL] [LOCAL     ] BDC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:29:20.542747] [FATAL] [MAIN      ] BDC: Failed to save primary data.
[2025-10-24T17:29:20.542789] [WARN ] [MAIN      ] BDC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:29:20.542826] [INFO ] [LOCAL     ] BDC: Starting deletion of primary data.
[2025-10-24T17:29:20.542886] [DEBUG] [LOCAL     ] BDC: No primary data file found to delete.
[2025-10-24T17:29:20.542942] [INFO ] [LOCAL     ] BDC: Starting deletion of derivative data.
[2025-10-24T17:29:20.543062] [DEBUG] [LOCAL     ] BDC: Deleted derivative data file.
[2025-10-24T17:29:20.543170] [INFO ] [MAIN      ] Update Progress: 240/2366 symbols completed. BDC took 22.2s. Estimated remaining: 4h 19m 30s. Rate: 8.2 symbols/min
[2025-10-24T17:29:21.080980] [INFO ] [MAIN      ] BE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:29:21.158514] [INFO ] [MAIN      ] BDX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:29:21.245313] [INFO ] [MAIN      ] BDN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:29:21.242600] [INFO ] [MAIN      ] BDJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:29:21.320364] [DEBUG] [LOCAL     ] BDJ: Loaded 29478 existing records from primary storage.
[2025-10-24T17:29:21.320846] [INFO ] [MAIN      ] BDJ: Loaded 29478 existing records.
[2025-10-24T17:29:21.459959] [DEBUG] [LOCAL     ] BDN: Loaded 47979 existing records from primary storage.
[2025-10-24T17:29:21.458684] [DEBUG] [LOCAL     ] BDX: Loaded 52509 existing records from primary storage.
[2025-10-24T17:29:21.474545] [INFO ] [MAIN      ] BDX: Loaded 52509 existing records.
[2025-10-24T17:29:21.501810] [DEBUG] [LOCAL     ] BE: Loaded 54051 existing records from primary storage.
[2025-10-24T17:29:21.507217] [INFO ] [MAIN      ] BDN: Loaded 47979 existing records.
[2025-10-24T17:29:21.530415] [INFO ] [MAIN      ] BE: Loaded 54051 existing records.
[2025-10-24T17:29:21.805845] [WARN ] [MAIN      ] BDJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:29:21.869206] [INFO ] [MAIN      ] BDJ: Wiping existing primary data before full refresh.
[2025-10-24T17:29:21.878442] [INFO ] [LOCAL     ] BDJ: Starting deletion of primary data.
[2025-10-24T17:29:21.926602] [DEBUG] [LOCAL     ] BDJ: Deleted primary data file.
[2025-10-24T17:29:22.042256] [WARN ] [MAIN      ] BDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:29:22.009763] [INFO ] [MAIN      ] BDJ: Starting full primary refresh.
[2025-10-24T17:29:22.113068] [INFO ] [MAIN      ] BDX: Wiping existing primary data before full refresh.
[2025-10-24T17:29:22.113259] [INFO ] [LOCAL     ] BDX: Starting deletion of primary data.
[2025-10-24T17:29:22.117001] [WARN ] [MAIN      ] BDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:29:22.158339] [INFO ] [MAIN      ] BDN: Wiping existing primary data before full refresh.
[2025-10-24T17:29:22.163822] [INFO ] [LOCAL     ] BDN: Starting deletion of primary data.
[2025-10-24T17:29:22.203233] [DEBUG] [LOCAL     ] BDX: Deleted primary data file.
[2025-10-24T17:29:22.209835] [WARN ] [MAIN      ] BE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:29:22.209990] [INFO ] [MAIN      ] BDX: Starting full primary refresh.
[2025-10-24T17:29:22.215901] [INFO ] [MAIN      ] BE: Wiping existing primary data before full refresh.
[2025-10-24T17:29:22.215988] [INFO ] [LOCAL     ] BE: Starting deletion of primary data.
[2025-10-24T17:29:22.222539] [DEBUG] [LOCAL     ] BE: Deleted primary data file.
[2025-10-24T17:29:22.222754] [INFO ] [MAIN      ] BE: Starting full primary refresh.
[2025-10-24T17:29:22.233840] [DEBUG] [LOCAL     ] BDN: Deleted primary data file.
[2025-10-24T17:29:22.282575] [INFO ] [MAIN      ] BDN: Starting full primary refresh.
[2025-10-24T17:29:23.551418] [INFO ] [REMOTE    ] BDJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:29:23.619451] [INFO ] [REMOTE    ] BDX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:29:23.623798] [INFO ] [REMOTE    ] BDN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:29:23.632763] [INFO ] [REMOTE    ] BDN: Fetching primary data for 2025-01.
[2025-10-24T17:29:23.624161] [INFO ] [REMOTE    ] BDX: Fetching primary data for 2025-01.
[2025-10-24T17:29:23.590859] [INFO ] [REMOTE    ] BDJ: Fetching primary data for 2025-01.
[2025-10-24T17:29:23.655962] [INFO ] [REMOTE    ] BE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:29:23.658021] [INFO ] [REMOTE    ] BE: Fetching primary data for 2025-01.
[2025-10-24T17:29:24.997733] [INFO ] [REMOTE    ] BDJ: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T17:29:25.004477] [INFO ] [REMOTE    ] BDJ: Fetching primary data for 2025-02.
[2025-10-24T17:29:25.161168] [INFO ] [REMOTE    ] BDX: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T17:29:25.172244] [INFO ] [REMOTE    ] BDX: Fetching primary data for 2025-02.
[2025-10-24T17:29:25.223014] [INFO ] [REMOTE    ] BDN: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T17:29:25.233766] [INFO ] [REMOTE    ] BDN: Fetching primary data for 2025-02.
[2025-10-24T17:29:25.637155] [INFO ] [REMOTE    ] BE: Incremental fetch complete for 2025-01 (1.98 seconds).
[2025-10-24T17:29:25.647793] [INFO ] [REMOTE    ] BE: Fetching primary data for 2025-02.
[2025-10-24T17:29:26.187471] [INFO ] [REMOTE    ] BDJ: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T17:29:26.194002] [INFO ] [REMOTE    ] BDJ: Fetching primary data for 2025-03.
[2025-10-24T17:29:26.373926] [INFO ] [REMOTE    ] BDN: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T17:29:26.547713] [INFO ] [REMOTE    ] BDN: Fetching primary data for 2025-03.
[2025-10-24T17:29:26.726624] [INFO ] [REMOTE    ] BDX: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T17:29:27.043841] [INFO ] [REMOTE    ] BE: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T17:29:27.081366] [INFO ] [REMOTE    ] BDJ: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T17:29:27.347679] [INFO ] [REMOTE    ] BE: Fetching primary data for 2025-03.
[2025-10-24T17:29:27.881847] [INFO ] [REMOTE    ] BDN: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T17:29:28.147679] [INFO ] [REMOTE    ] BDJ: Fetching primary data for 2025-04.
[2025-10-24T17:29:28.947682] [INFO ] [REMOTE    ] BDN: Fetching primary data for 2025-04.
[2025-10-24T17:29:29.397192] [INFO ] [REMOTE    ] BE: Incremental fetch complete for 2025-03 (2.05 seconds).
[2025-10-24T17:29:29.432282] [INFO ] [REMOTE    ] BDJ: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T17:29:29.747693] [INFO ] [REMOTE    ] BDX: Fetching primary data for 2025-03.
[2025-10-24T17:29:30.547632] [INFO ] [REMOTE    ] BE: Fetching primary data for 2025-04.
[2025-10-24T17:29:30.694105] [INFO ] [REMOTE    ] BDN: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T17:29:31.178937] [INFO ] [REMOTE    ] BDX: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T17:29:31.347634] [INFO ] [REMOTE    ] BDX: Fetching primary data for 2025-04.
[2025-10-24T17:29:32.147626] [INFO ] [REMOTE    ] BDN: Fetching primary data for 2025-05.
[2025-10-24T17:29:32.535766] [INFO ] [REMOTE    ] BE: Incremental fetch complete for 2025-04 (1.99 seconds).
[2025-10-24T17:29:32.947620] [INFO ] [REMOTE    ] BDJ: Fetching primary data for 2025-05.
[2025-10-24T17:29:33.257966] [INFO ] [REMOTE    ] BDX: Incremental fetch complete for 2025-04 (1.91 seconds).
[2025-10-24T17:29:33.725160] [INFO ] [REMOTE    ] BDN: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T17:29:33.747609] [INFO ] [REMOTE    ] BDN: Fetching primary data for 2025-06.
[2025-10-24T17:29:34.038742] [INFO ] [REMOTE    ] BDJ: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T17:29:34.547673] [INFO ] [REMOTE    ] BDX: Fetching primary data for 2025-05.
[2025-10-24T17:29:35.212954] [INFO ] [REMOTE    ] BDN: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T17:29:35.347687] [INFO ] [REMOTE    ] BDJ: Fetching primary data for 2025-06.
[2025-10-24T17:29:36.147687] [INFO ] [REMOTE    ] BE: Fetching primary data for 2025-05.
[2025-10-24T17:29:36.652731] [INFO ] [REMOTE    ] BDX: Incremental fetch complete for 2025-05 (2.11 seconds).
[2025-10-24T17:29:36.685722] [INFO ] [REMOTE    ] BDJ: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T17:29:36.947726] [INFO ] [REMOTE    ] BDN: Fetching primary data for 2025-07.
[2025-10-24T17:29:37.747698] [INFO ] [REMOTE    ] BDJ: Fetching primary data for 2025-07.
[2025-10-24T17:29:38.155978] [INFO ] [REMOTE    ] BE: Incremental fetch complete for 2025-05 (2.01 seconds).
[2025-10-24T17:29:38.547700] [INFO ] [REMOTE    ] BDX: Fetching primary data for 2025-06.
[2025-10-24T17:29:38.645038] [INFO ] [REMOTE    ] BDN: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T17:29:39.131387] [INFO ] [REMOTE    ] BDJ: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T17:29:39.347668] [INFO ] [REMOTE    ] BDN: Fetching primary data for 2025-08.
[2025-10-24T17:29:40.147725] [INFO ] [REMOTE    ] BE: Fetching primary data for 2025-06.
[2025-10-24T17:29:40.299022] [INFO ] [REMOTE    ] BDX: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T17:29:40.750191] [INFO ] [REMOTE    ] BDN: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T17:29:40.947613] [INFO ] [REMOTE    ] BDJ: Fetching primary data for 2025-08.
[2025-10-24T17:29:41.747698] [INFO ] [REMOTE    ] BDX: Fetching primary data for 2025-07.
[2025-10-24T17:29:41.783629] [INFO ] [REMOTE    ] BDJ: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T17:29:42.259310] [INFO ] [REMOTE    ] BE: Incremental fetch complete for 2025-06 (2.11 seconds).
[2025-10-24T17:29:42.547741] [INFO ] [REMOTE    ] BDN: Fetching primary data for 2025-09.
[2025-10-24T17:29:43.347629] [INFO ] [REMOTE    ] BE: Fetching primary data for 2025-07.
[2025-10-24T17:29:43.677168] [INFO ] [REMOTE    ] BDX: Incremental fetch complete for 2025-07 (1.93 seconds).
[2025-10-24T17:29:43.767617] [INFO ] [REMOTE    ] BDN: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T17:29:44.147730] [INFO ] [REMOTE    ] BDX: Fetching primary data for 2025-08.
[2025-10-24T17:29:44.947743] [INFO ] [REMOTE    ] BDN: Fetching primary data for 2025-10.
[2025-10-24T17:29:45.533345] [INFO ] [REMOTE    ] BE: Incremental fetch complete for 2025-07 (2.19 seconds).
[2025-10-24T17:29:45.747674] [INFO ] [REMOTE    ] BE: Fetching primary data for 2025-08.
[2025-10-24T17:29:46.005979] [INFO ] [REMOTE    ] BDX: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T17:29:46.183041] [INFO ] [REMOTE    ] BDN: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T17:29:46.193104] [INFO ] [REMOTE    ] BDN: Full fetch complete (69398 records).
[2025-10-24T17:29:46.193310] [DEBUG] [VALIDATOR ] BDN: Validating primary data.
[2025-10-24T17:29:46.548501] [INFO ] [REMOTE    ] BDX: Fetching primary data for 2025-09.
[2025-10-24T17:29:46.602401] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present.
[2025-10-24T17:29:46.602516] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed.
[2025-10-24T17:29:46.603778] [INFO ] [MAIN      ] BDN: Fetched primary data is valid.
[2025-10-24T17:29:46.603862] [DEBUG] [LOCAL     ] BDN: Saving primary data.
[2025-10-24T17:29:46.604600] [FATAL] [LOCAL     ] BDN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:29:46.604735] [FATAL] [MAIN      ] BDN: Failed to save primary data.
[2025-10-24T17:29:46.604815] [WARN ] [MAIN      ] BDN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:29:46.604897] [INFO ] [LOCAL     ] BDN: Starting deletion of primary data.
[2025-10-24T17:29:46.604978] [DEBUG] [LOCAL     ] BDN: No primary data file found to delete.
[2025-10-24T17:29:46.605025] [INFO ] [LOCAL     ] BDN: Starting deletion of derivative data.
[2025-10-24T17:29:46.605178] [DEBUG] [LOCAL     ] BDN: Deleted derivative data file.
[2025-10-24T17:29:46.605836] [INFO ] [MAIN      ] Update Progress: 241/2366 symbols completed. BDN took 26.1s. Estimated remaining: 4h 22m 8s. Rate: 8.1 symbols/min
[2025-10-24T17:29:46.778314] [INFO ] [MAIN      ] BEDU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:29:46.778526] [DEBUG] [LOCAL     ] BEDU: No existing data file found in primary storage.
[2025-10-24T17:29:46.778563] [WARN ] [MAIN      ] BEDU: No existing data found, performing full refresh instead.
[2025-10-24T17:29:46.778702] [INFO ] [MAIN      ] BEDU: Wiping existing primary data before full refresh.
[2025-10-24T17:29:46.778754] [INFO ] [LOCAL     ] BEDU: Starting deletion of primary data.
[2025-10-24T17:29:46.778796] [DEBUG] [LOCAL     ] BEDU: No primary data file found to delete.
[2025-10-24T17:29:46.778827] [INFO ] [MAIN      ] BEDU: Starting full primary refresh.
[2025-10-24T17:29:47.134521] [INFO ] [REMOTE    ] BEDU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:29:47.347639] [INFO ] [REMOTE    ] BEDU: Fetching primary data for 2025-01.
[2025-10-24T17:29:47.772051] [INFO ] [REMOTE    ] BEDU: Incremental fetch complete for 2025-01 (0.42 seconds).
[2025-10-24T17:29:48.152924] [INFO ] [REMOTE    ] BEDU: Fetching primary data for 2025-02.
[2025-10-24T17:29:48.171456] [INFO ] [REMOTE    ] BE: Incremental fetch complete for 2025-08 (2.42 seconds).
[2025-10-24T17:29:48.306574] [INFO ] [REMOTE    ] BDX: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T17:29:48.428887] [INFO ] [REMOTE    ] BEDU: Incremental fetch complete for 2025-02 (0.28 seconds).
[2025-10-24T17:29:48.947671] [INFO ] [REMOTE    ] BEDU: Fetching primary data for 2025-03.
[2025-10-24T17:29:49.386184] [INFO ] [REMOTE    ] BEDU: Incremental fetch complete for 2025-03 (0.44 seconds).
[2025-10-24T17:29:49.747664] [INFO ] [REMOTE    ] BEDU: Fetching primary data for 2025-04.
[2025-10-24T17:29:50.106935] [INFO ] [REMOTE    ] BEDU: Incremental fetch complete for 2025-04 (0.36 seconds).
[2025-10-24T17:29:50.547719] [INFO ] [REMOTE    ] BDX: Fetching primary data for 2025-10.
[2025-10-24T17:29:51.347671] [INFO ] [REMOTE    ] BE: Fetching primary data for 2025-09.
[2025-10-24T17:29:52.147614] [INFO ] [REMOTE    ] BDJ: Fetching primary data for 2025-09.
[2025-10-24T17:29:52.387778] [INFO ] [REMOTE    ] BDX: Incremental fetch complete for 2025-10 (1.84 seconds).
[2025-10-24T17:29:52.396815] [INFO ] [REMOTE    ] BDX: Full fetch complete (75451 records).
[2025-10-24T17:29:52.396937] [DEBUG] [VALIDATOR ] BDX: Validating primary data.
[2025-10-24T17:29:52.785422] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present.
[2025-10-24T17:29:52.785500] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed.
[2025-10-24T17:29:52.786282] [INFO ] [MAIN      ] BDX: Fetched primary data is valid.
[2025-10-24T17:29:52.786351] [DEBUG] [LOCAL     ] BDX: Saving primary data.
[2025-10-24T17:29:52.786942] [FATAL] [LOCAL     ] BDX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:29:52.787056] [FATAL] [MAIN      ] BDX: Failed to save primary data.
[2025-10-24T17:29:52.787098] [WARN ] [MAIN      ] BDX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:29:52.787133] [INFO ] [LOCAL     ] BDX: Starting deletion of primary data.
[2025-10-24T17:29:52.787185] [DEBUG] [LOCAL     ] BDX: No primary data file found to delete.
[2025-10-24T17:29:52.787220] [INFO ] [LOCAL     ] BDX: Starting deletion of derivative data.
[2025-10-24T17:29:52.787359] [DEBUG] [LOCAL     ] BDX: Deleted derivative data file.
[2025-10-24T17:29:52.788332] [INFO ] [MAIN      ] Update Progress: 242/2366 symbols completed. BDX took 32.2s. Estimated remaining: 4h 21m 50s. Rate: 8.1 symbols/min
[2025-10-24T17:29:52.956120] [INFO ] [REMOTE    ] BEDU: Fetching primary data for 2025-05.
[2025-10-24T17:29:52.958608] [INFO ] [MAIN      ] BEKE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:29:53.013977] [DEBUG] [LOCAL     ] BEKE: Loaded 53575 existing records from primary storage.
[2025-10-24T17:29:53.014286] [INFO ] [MAIN      ] BEKE: Loaded 53575 existing records.
[2025-10-24T17:29:53.193712] [WARN ] [MAIN      ] BEKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:29:53.194010] [INFO ] [MAIN      ] BEKE: Wiping existing primary data before full refresh.
[2025-10-24T17:29:53.194105] [INFO ] [LOCAL     ] BEKE: Starting deletion of primary data.
[2025-10-24T17:29:53.195432] [DEBUG] [LOCAL     ] BEKE: Deleted primary data file.
[2025-10-24T17:29:53.195507] [INFO ] [MAIN      ] BEKE: Starting full primary refresh.
[2025-10-24T17:29:53.358355] [INFO ] [REMOTE    ] BEDU: Incremental fetch complete for 2025-05 (0.40 seconds).
[2025-10-24T17:29:53.366615] [INFO ] [REMOTE    ] BDJ: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T17:29:53.600046] [INFO ] [REMOTE    ] BEKE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:29:53.690207] [INFO ] [REMOTE    ] BE: Incremental fetch complete for 2025-09 (2.34 seconds).
[2025-10-24T17:29:53.747702] [INFO ] [REMOTE    ] BEDU: Fetching primary data for 2025-06.
[2025-10-24T17:29:53.998516] [INFO ] [REMOTE    ] BEDU: Incremental fetch complete for 2025-06 (0.25 seconds).
[2025-10-24T17:29:54.547702] [INFO ] [REMOTE    ] BEKE: Fetching primary data for 2025-01.
[2025-10-24T17:29:55.347735] [INFO ] [REMOTE    ] BDJ: Fetching primary data for 2025-10.
[2025-10-24T17:29:56.147753] [INFO ] [REMOTE    ] BE: Fetching primary data for 2025-10.
[2025-10-24T17:29:56.313880] [INFO ] [REMOTE    ] BEKE: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T17:29:56.794115] [INFO ] [REMOTE    ] BDJ: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T17:29:56.800022] [INFO ] [REMOTE    ] BDJ: Full fetch complete (42734 records).
[2025-10-24T17:29:56.800124] [DEBUG] [VALIDATOR ] BDJ: Validating primary data.
[2025-10-24T17:29:56.952928] [INFO ] [REMOTE    ] BEDU: Fetching primary data for 2025-07.
[2025-10-24T17:29:57.202316] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present.
[2025-10-24T17:29:57.202401] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed.
[2025-10-24T17:29:57.202937] [INFO ] [MAIN      ] BDJ: Fetched primary data is valid.
[2025-10-24T17:29:57.202999] [DEBUG] [LOCAL     ] BDJ: Saving primary data.
[2025-10-24T17:29:57.203461] [FATAL] [LOCAL     ] BDJ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:29:57.203582] [FATAL] [MAIN      ] BDJ: Failed to save primary data.
[2025-10-24T17:29:57.203623] [WARN ] [MAIN      ] BDJ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:29:57.203694] [INFO ] [LOCAL     ] BDJ: Starting deletion of primary data.
[2025-10-24T17:29:57.203769] [DEBUG] [LOCAL     ] BDJ: No primary data file found to delete.
[2025-10-24T17:29:57.203824] [INFO ] [LOCAL     ] BDJ: Starting deletion of derivative data.
[2025-10-24T17:29:57.204276] [DEBUG] [LOCAL     ] BDJ: Deleted derivative data file.
[2025-10-24T17:29:57.204370] [INFO ] [MAIN      ] Update Progress: 243/2366 symbols completed. BDJ took 36.7s. Estimated remaining: 4h 21m 16s. Rate: 8.1 symbols/min
[2025-10-24T17:29:57.309773] [INFO ] [REMOTE    ] BEDU: Incremental fetch complete for 2025-07 (0.36 seconds).
[2025-10-24T17:29:57.379540] [INFO ] [MAIN      ] BEN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:29:57.429795] [DEBUG] [LOCAL     ] BEN: Loaded 53501 existing records from primary storage.
[2025-10-24T17:29:57.430122] [INFO ] [MAIN      ] BEN: Loaded 53501 existing records.
[2025-10-24T17:29:57.604333] [WARN ] [MAIN      ] BEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:29:57.604556] [INFO ] [MAIN      ] BEN: Wiping existing primary data before full refresh.
[2025-10-24T17:29:57.604603] [INFO ] [LOCAL     ] BEN: Starting deletion of primary data.
[2025-10-24T17:29:57.605546] [DEBUG] [LOCAL     ] BEN: Deleted primary data file.
[2025-10-24T17:29:57.605615] [INFO ] [MAIN      ] BEN: Starting full primary refresh.
[2025-10-24T17:29:57.752945] [INFO ] [REMOTE    ] BEDU: Fetching primary data for 2025-08.
[2025-10-24T17:29:57.968152] [INFO ] [REMOTE    ] BEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:29:58.136976] [INFO ] [REMOTE    ] BEDU: Incremental fetch complete for 2025-08 (0.38 seconds).
[2025-10-24T17:29:58.547760] [INFO ] [REMOTE    ] BEKE: Fetching primary data for 2025-02.
[2025-10-24T17:29:59.036880] [INFO ] [REMOTE    ] BE: Incremental fetch complete for 2025-10 (2.89 seconds).
[2025-10-24T17:29:59.046728] [INFO ] [REMOTE    ] BE: Full fetch complete (77816 records).
[2025-10-24T17:29:59.046878] [DEBUG] [VALIDATOR ] BE: Validating primary data.
[2025-10-24T17:29:59.352812] [INFO ] [REMOTE    ] BEDU: Fetching primary data for 2025-09.
[2025-10-24T17:29:59.429949] [DEBUG] [VALIDATOR ] BE: All expected trading days are present.
[2025-10-24T17:29:59.430026] [DEBUG] [VALIDATOR ] BE: Primary data validation passed.
[2025-10-24T17:29:59.430848] [INFO ] [MAIN      ] BE: Fetched primary data is valid.
[2025-10-24T17:29:59.430910] [DEBUG] [LOCAL     ] BE: Saving primary data.
[2025-10-24T17:29:59.431506] [FATAL] [LOCAL     ] BE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:29:59.431592] [FATAL] [MAIN      ] BE: Failed to save primary data.
[2025-10-24T17:29:59.431633] [WARN ] [MAIN      ] BE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:29:59.431710] [INFO ] [LOCAL     ] BE: Starting deletion of primary data.
[2025-10-24T17:29:59.431771] [DEBUG] [LOCAL     ] BE: No primary data file found to delete.
[2025-10-24T17:29:59.431806] [INFO ] [LOCAL     ] BE: Starting deletion of derivative data.
[2025-10-24T17:29:59.431926] [DEBUG] [LOCAL     ] BE: Deleted derivative data file.
[2025-10-24T17:29:59.432476] [INFO ] [MAIN      ] Update Progress: 244/2366 symbols completed. BE took 38.9s. Estimated remaining: 4h 20m 24s. Rate: 8.1 symbols/min
[2025-10-24T17:29:59.602860] [INFO ] [MAIN      ] BEP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:29:59.639045] [DEBUG] [LOCAL     ] BEP: Loaded 39180 existing records from primary storage.
[2025-10-24T17:29:59.639322] [INFO ] [MAIN      ] BEP: Loaded 39180 existing records.
[2025-10-24T17:29:59.824138] [WARN ] [MAIN      ] BEP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:29:59.824583] [INFO ] [REMOTE    ] BEDU: Incremental fetch complete for 2025-09 (0.47 seconds).
[2025-10-24T17:29:59.825114] [INFO ] [MAIN      ] BEP: Wiping existing primary data before full refresh.
[2025-10-24T17:29:59.827566] [INFO ] [LOCAL     ] BEP: Starting deletion of primary data.
[2025-10-24T17:29:59.828398] [DEBUG] [LOCAL     ] BEP: Deleted primary data file.
[2025-10-24T17:29:59.828459] [INFO ] [MAIN      ] BEP: Starting full primary refresh.
[2025-10-24T17:30:00.152326] [INFO ] [REMOTE    ] BEDU: Fetching primary data for 2025-10.
[2025-10-24T17:30:00.188439] [INFO ] [REMOTE    ] BEP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:30:00.329210] [INFO ] [REMOTE    ] BEKE: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T17:30:00.947733] [INFO ] [REMOTE    ] BEP: Fetching primary data for 2025-01.
[2025-10-24T17:30:01.227209] [INFO ] [REMOTE    ] BEDU: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T17:30:01.228416] [INFO ] [REMOTE    ] BEDU: Full fetch complete (1337 records).
[2025-10-24T17:30:01.228745] [DEBUG] [VALIDATOR ] BEDU: Validating primary data.
[2025-10-24T17:30:01.440893] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days
[2025-10-24T17:30:01.441183] [FATAL] [MAIN      ] BEDU: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:30:01.441284] [WARN ] [MAIN      ] BEDU: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:30:01.441364] [INFO ] [LOCAL     ] BEDU: Starting deletion of primary data.
[2025-10-24T17:30:01.441444] [DEBUG] [LOCAL     ] BEDU: No primary data file found to delete.
[2025-10-24T17:30:01.441484] [INFO ] [LOCAL     ] BEDU: Starting deletion of derivative data.
[2025-10-24T17:30:01.441584] [DEBUG] [LOCAL     ] BEDU: No derivative data file found to delete.
[2025-10-24T17:30:01.441695] [INFO ] [MAIN      ] Update Progress: 245/2366 symbols completed. BEDU took 14.8s. Estimated remaining: 4h 19m 30s. Rate: 8.2 symbols/min
[2025-10-24T17:30:01.644726] [INFO ] [MAIN      ] BEPC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:30:01.707159] [DEBUG] [LOCAL     ] BEPC: Loaded 46678 existing records from primary storage.
[2025-10-24T17:30:01.707901] [INFO ] [MAIN      ] BEPC: Loaded 46678 existing records.
[2025-10-24T17:30:01.753002] [INFO ] [REMOTE    ] BEKE: Fetching primary data for 2025-03.
[2025-10-24T17:30:01.933124] [WARN ] [MAIN      ] BEPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:30:01.933432] [INFO ] [MAIN      ] BEPC: Wiping existing primary data before full refresh.
[2025-10-24T17:30:01.933532] [INFO ] [LOCAL     ] BEPC: Starting deletion of primary data.
[2025-10-24T17:30:01.934077] [DEBUG] [LOCAL     ] BEPC: Deleted primary data file.
[2025-10-24T17:30:01.934140] [INFO ] [MAIN      ] BEPC: Starting full primary refresh.
[2025-10-24T17:30:02.329838] [INFO ] [REMOTE    ] BEPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:30:02.547758] [INFO ] [REMOTE    ] BEN: Fetching primary data for 2025-01.
[2025-10-24T17:30:03.347749] [INFO ] [REMOTE    ] BEPC: Fetching primary data for 2025-01.
[2025-10-24T17:30:03.758511] [INFO ] [REMOTE    ] BEP: Incremental fetch complete for 2025-01 (2.81 seconds).
[2025-10-24T17:30:04.147744] [INFO ] [REMOTE    ] BEP: Fetching primary data for 2025-02.
[2025-10-24T17:30:04.911930] [INFO ] [REMOTE    ] BEKE: Incremental fetch complete for 2025-03 (3.16 seconds).
[2025-10-24T17:30:04.947687] [INFO ] [REMOTE    ] BEKE: Fetching primary data for 2025-04.
[2025-10-24T17:30:05.097576] [INFO ] [REMOTE    ] BEN: Incremental fetch complete for 2025-01 (2.55 seconds).
[2025-10-24T17:30:05.624744] [INFO ] [REMOTE    ] BEPC: Incremental fetch complete for 2025-01 (2.28 seconds).
[2025-10-24T17:30:05.747758] [INFO ] [REMOTE    ] BEN: Fetching primary data for 2025-02.
[2025-10-24T17:30:06.547733] [INFO ] [REMOTE    ] BEPC: Fetching primary data for 2025-02.
[2025-10-24T17:30:07.109208] [INFO ] [REMOTE    ] BEP: Incremental fetch complete for 2025-02 (2.96 seconds).
[2025-10-24T17:30:07.347756] [INFO ] [REMOTE    ] BEP: Fetching primary data for 2025-03.
[2025-10-24T17:30:07.458239] [INFO ] [REMOTE    ] BEKE: Incremental fetch complete for 2025-04 (2.51 seconds).
[2025-10-24T17:30:08.147717] [INFO ] [REMOTE    ] BEKE: Fetching primary data for 2025-05.
[2025-10-24T17:30:08.553413] [INFO ] [REMOTE    ] BEN: Incremental fetch complete for 2025-02 (2.81 seconds).
[2025-10-24T17:30:08.629904] [INFO ] [REMOTE    ] BEPC: Incremental fetch complete for 2025-02 (2.08 seconds).
[2025-10-24T17:30:08.947713] [INFO ] [REMOTE    ] BEPC: Fetching primary data for 2025-03.
[2025-10-24T17:30:09.747703] [INFO ] [REMOTE    ] BEN: Fetching primary data for 2025-03.
[2025-10-24T17:30:10.010230] [INFO ] [REMOTE    ] BEKE: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T17:30:10.552867] [INFO ] [REMOTE    ] BEKE: Fetching primary data for 2025-06.
[2025-10-24T17:30:10.581397] [INFO ] [REMOTE    ] BEPC: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T17:30:10.912161] [INFO ] [REMOTE    ] BEP: Incremental fetch complete for 2025-03 (3.56 seconds).
[2025-10-24T17:30:11.246277] [INFO ] [REMOTE    ] BEN: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T17:30:11.347733] [INFO ] [REMOTE    ] BEN: Fetching primary data for 2025-04.
[2025-10-24T17:30:11.920659] [INFO ] [REMOTE    ] BEKE: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T17:30:12.147689] [INFO ] [REMOTE    ] BEPC: Fetching primary data for 2025-04.
[2025-10-24T17:30:12.947706] [INFO ] [REMOTE    ] BEKE: Fetching primary data for 2025-07.
[2025-10-24T17:30:13.107297] [INFO ] [REMOTE    ] BEN: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T17:30:13.390154] [INFO ] [REMOTE    ] BEPC: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T17:30:13.747677] [INFO ] [REMOTE    ] BEPC: Fetching primary data for 2025-05.
[2025-10-24T17:30:14.280861] [INFO ] [REMOTE    ] BEKE: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T17:30:14.547677] [INFO ] [REMOTE    ] BEKE: Fetching primary data for 2025-08.
[2025-10-24T17:30:15.347627] [INFO ] [REMOTE    ] BEP: Fetching primary data for 2025-04.
[2025-10-24T17:30:15.416878] [INFO ] [REMOTE    ] BEPC: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T17:30:16.147729] [INFO ] [REMOTE    ] BEN: Fetching primary data for 2025-05.
[2025-10-24T17:30:16.881850] [INFO ] [REMOTE    ] BEKE: Incremental fetch complete for 2025-08 (2.33 seconds).
[2025-10-24T17:30:16.947599] [INFO ] [REMOTE    ] BEKE: Fetching primary data for 2025-09.
[2025-10-24T17:30:17.141300] [INFO ] [REMOTE    ] BEP: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T17:30:17.747623] [INFO ] [REMOTE    ] BEP: Fetching primary data for 2025-05.
[2025-10-24T17:30:17.855606] [INFO ] [REMOTE    ] BEN: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T17:30:18.547680] [INFO ] [REMOTE    ] BEN: Fetching primary data for 2025-06.
[2025-10-24T17:30:18.871451] [INFO ] [REMOTE    ] BEKE: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T17:30:19.165479] [INFO ] [REMOTE    ] BEP: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T17:30:19.347682] [INFO ] [REMOTE    ] BEP: Fetching primary data for 2025-06.
[2025-10-24T17:30:20.147731] [INFO ] [REMOTE    ] BEKE: Fetching primary data for 2025-10.
[2025-10-24T17:30:20.244322] [INFO ] [REMOTE    ] BEN: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T17:30:20.830964] [INFO ] [REMOTE    ] BEP: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T17:30:20.947670] [INFO ] [REMOTE    ] BEP: Fetching primary data for 2025-07.
[2025-10-24T17:30:21.747693] [INFO ] [REMOTE    ] BEN: Fetching primary data for 2025-07.
[2025-10-24T17:30:22.214586] [INFO ] [REMOTE    ] BEP: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T17:30:22.547676] [INFO ] [REMOTE    ] BEPC: Fetching primary data for 2025-06.
[2025-10-24T17:30:23.347633] [INFO ] [REMOTE    ] BEP: Fetching primary data for 2025-08.
[2025-10-24T17:30:23.670897] [INFO ] [REMOTE    ] BEN: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T17:30:24.062985] [INFO ] [REMOTE    ] BEPC: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T17:30:24.105897] [INFO ] [REMOTE    ] BEKE: Incremental fetch complete for 2025-10 (3.96 seconds).
[2025-10-24T17:30:24.116039] [INFO ] [REMOTE    ] BEKE: Full fetch complete (77330 records).
[2025-10-24T17:30:24.116210] [DEBUG] [VALIDATOR ] BEKE: Validating primary data.
[2025-10-24T17:30:24.152745] [INFO ] [REMOTE    ] BEN: Fetching primary data for 2025-08.
[2025-10-24T17:30:24.518207] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present.
[2025-10-24T17:30:24.518309] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed.
[2025-10-24T17:30:24.519219] [INFO ] [MAIN      ] BEKE: Fetched primary data is valid.
[2025-10-24T17:30:24.519400] [DEBUG] [LOCAL     ] BEKE: Saving primary data.
[2025-10-24T17:30:24.520184] [FATAL] [LOCAL     ] BEKE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:30:24.520317] [FATAL] [MAIN      ] BEKE: Failed to save primary data.
[2025-10-24T17:30:24.520439] [WARN ] [MAIN      ] BEKE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:30:24.520588] [INFO ] [LOCAL     ] BEKE: Starting deletion of primary data.
[2025-10-24T17:30:24.520692] [DEBUG] [LOCAL     ] BEKE: No primary data file found to delete.
[2025-10-24T17:30:24.527529] [INFO ] [LOCAL     ] BEKE: Starting deletion of derivative data.
[2025-10-24T17:30:24.539391] [DEBUG] [LOCAL     ] BEKE: Deleted derivative data file.
[2025-10-24T17:30:24.540224] [INFO ] [MAIN      ] Update Progress: 246/2366 symbols completed. BEKE took 31.8s. Estimated remaining: 4h 21m 39s. Rate: 8.1 symbols/min
[2025-10-24T17:30:24.540831] [INFO ] [REMOTE    ] BEP: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T17:30:24.734574] [INFO ] [MAIN      ] BEPH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:30:24.742631] [DEBUG] [LOCAL     ] BEPH: Loaded 4915 existing records from primary storage.
[2025-10-24T17:30:24.742864] [INFO ] [MAIN      ] BEPH: Loaded 4915 existing records.
[2025-10-24T17:30:24.943359] [WARN ] [MAIN      ] BEPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:30:24.943623] [INFO ] [MAIN      ] BEPH: Wiping existing primary data before full refresh.
[2025-10-24T17:30:24.943716] [INFO ] [LOCAL     ] BEPH: Starting deletion of primary data.
[2025-10-24T17:30:24.943913] [DEBUG] [LOCAL     ] BEPH: Deleted primary data file.
[2025-10-24T17:30:24.943970] [INFO ] [MAIN      ] BEPH: Starting full primary refresh.
[2025-10-24T17:30:24.956608] [INFO ] [REMOTE    ] BEP: Fetching primary data for 2025-09.
[2025-10-24T17:30:25.332818] [INFO ] [REMOTE    ] BEPH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:30:25.747672] [INFO ] [REMOTE    ] BEPC: Fetching primary data for 2025-07.
[2025-10-24T17:30:25.911456] [INFO ] [REMOTE    ] BEN: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T17:30:26.038097] [INFO ] [REMOTE    ] BEP: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T17:30:26.547675] [INFO ] [REMOTE    ] BEPH: Fetching primary data for 2025-01.
[2025-10-24T17:30:27.135991] [INFO ] [REMOTE    ] BEPH: Incremental fetch complete for 2025-01 (0.59 seconds).
[2025-10-24T17:30:27.255890] [INFO ] [REMOTE    ] BEPC: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T17:30:27.347704] [INFO ] [REMOTE    ] BEPH: Fetching primary data for 2025-02.
[2025-10-24T17:30:27.835514] [INFO ] [REMOTE    ] BEPH: Incremental fetch complete for 2025-02 (0.49 seconds).
[2025-10-24T17:30:28.147679] [INFO ] [REMOTE    ] BEPH: Fetching primary data for 2025-03.
[2025-10-24T17:30:28.636705] [INFO ] [REMOTE    ] BEPH: Incremental fetch complete for 2025-03 (0.49 seconds).
[2025-10-24T17:30:28.947686] [INFO ] [REMOTE    ] BEPC: Fetching primary data for 2025-08.
[2025-10-24T17:30:29.747691] [INFO ] [REMOTE    ] BEP: Fetching primary data for 2025-10.
[2025-10-24T17:30:30.471818] [INFO ] [REMOTE    ] BEPC: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T17:30:30.547671] [INFO ] [REMOTE    ] BEPC: Fetching primary data for 2025-09.
[2025-10-24T17:30:31.347733] [INFO ] [REMOTE    ] BEN: Fetching primary data for 2025-09.
[2025-10-24T17:30:31.420026] [INFO ] [REMOTE    ] BEP: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T17:30:31.428330] [INFO ] [REMOTE    ] BEP: Full fetch complete (59222 records).
[2025-10-24T17:30:31.428455] [DEBUG] [VALIDATOR ] BEP: Validating primary data.
[2025-10-24T17:30:31.814735] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present.
[2025-10-24T17:30:31.814852] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed.
[2025-10-24T17:30:31.815607] [INFO ] [MAIN      ] BEP: Fetched primary data is valid.
[2025-10-24T17:30:31.815671] [DEBUG] [LOCAL     ] BEP: Saving primary data.
[2025-10-24T17:30:31.816210] [FATAL] [LOCAL     ] BEP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:30:31.816333] [FATAL] [MAIN      ] BEP: Failed to save primary data.
[2025-10-24T17:30:31.816386] [WARN ] [MAIN      ] BEP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:30:31.816425] [INFO ] [LOCAL     ] BEP: Starting deletion of primary data.
[2025-10-24T17:30:31.816478] [DEBUG] [LOCAL     ] BEP: No primary data file found to delete.
[2025-10-24T17:30:31.816512] [INFO ] [LOCAL     ] BEP: Starting deletion of derivative data.
[2025-10-24T17:30:31.816637] [DEBUG] [LOCAL     ] BEP: Deleted derivative data file.
[2025-10-24T17:30:31.817236] [INFO ] [MAIN      ] Update Progress: 247/2366 symbols completed. BEP took 32.4s. Estimated remaining: 4h 21m 30s. Rate: 8.1 symbols/min
[2025-10-24T17:30:31.991931] [INFO ] [MAIN      ] BEPI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:30:31.998533] [DEBUG] [LOCAL     ] BEPI: Loaded 3579 existing records from primary storage.
[2025-10-24T17:30:31.998778] [INFO ] [MAIN      ] BEPI: Loaded 3579 existing records.
[2025-10-24T17:30:32.152603] [INFO ] [REMOTE    ] BEPH: Fetching primary data for 2025-04.
[2025-10-24T17:30:32.190922] [WARN ] [MAIN      ] BEPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:30:32.191514] [INFO ] [MAIN      ] BEPI: Wiping existing primary data before full refresh.
[2025-10-24T17:30:32.191626] [INFO ] [LOCAL     ] BEPI: Starting deletion of primary data.
[2025-10-24T17:30:32.192106] [DEBUG] [LOCAL     ] BEPI: Deleted primary data file.
[2025-10-24T17:30:32.192194] [INFO ] [MAIN      ] BEPI: Starting full primary refresh.
[2025-10-24T17:30:32.329083] [INFO ] [REMOTE    ] BEPC: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T17:30:32.595151] [INFO ] [REMOTE    ] BEPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:30:32.602128] [INFO ] [REMOTE    ] BEPH: Incremental fetch complete for 2025-04 (0.45 seconds).
[2025-10-24T17:30:32.947683] [INFO ] [REMOTE    ] BEPH: Fetching primary data for 2025-05.
[2025-10-24T17:30:33.528104] [INFO ] [REMOTE    ] BEN: Incremental fetch complete for 2025-09 (2.18 seconds).
[2025-10-24T17:30:33.550678] [INFO ] [REMOTE    ] BEPH: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T17:30:33.747736] [INFO ] [REMOTE    ] BEPI: Fetching primary data for 2025-01.
[2025-10-24T17:30:34.290930] [INFO ] [REMOTE    ] BEPI: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T17:30:34.547690] [INFO ] [REMOTE    ] BEPI: Fetching primary data for 2025-02.
[2025-10-24T17:30:34.954448] [INFO ] [REMOTE    ] BEPI: Incremental fetch complete for 2025-02 (0.41 seconds).
[2025-10-24T17:30:35.347731] [INFO ] [REMOTE    ] BEPI: Fetching primary data for 2025-03.
[2025-10-24T17:30:35.647523] [INFO ] [REMOTE    ] BEPI: Incremental fetch complete for 2025-03 (0.30 seconds).
[2025-10-24T17:30:36.147687] [INFO ] [REMOTE    ] BEPC: Fetching primary data for 2025-10.
[2025-10-24T17:30:36.947673] [INFO ] [REMOTE    ] BEN: Fetching primary data for 2025-10.
[2025-10-24T17:30:37.747619] [INFO ] [REMOTE    ] BEPH: Fetching primary data for 2025-06.
[2025-10-24T17:30:38.046688] [INFO ] [REMOTE    ] BEPC: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T17:30:38.055698] [INFO ] [REMOTE    ] BEPC: Full fetch complete (68835 records).
[2025-10-24T17:30:38.055821] [DEBUG] [VALIDATOR ] BEPC: Validating primary data.
[2025-10-24T17:30:38.397058] [INFO ] [REMOTE    ] BEPH: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T17:30:38.471609] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present.
[2025-10-24T17:30:38.471726] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed.
[2025-10-24T17:30:38.472465] [INFO ] [MAIN      ] BEPC: Fetched primary data is valid.
[2025-10-24T17:30:38.472528] [DEBUG] [LOCAL     ] BEPC: Saving primary data.
[2025-10-24T17:30:38.473144] [FATAL] [LOCAL     ] BEPC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:30:38.473254] [FATAL] [MAIN      ] BEPC: Failed to save primary data.
[2025-10-24T17:30:38.473296] [WARN ] [MAIN      ] BEPC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:30:38.473359] [INFO ] [LOCAL     ] BEPC: Starting deletion of primary data.
[2025-10-24T17:30:38.473420] [DEBUG] [LOCAL     ] BEPC: No primary data file found to delete.
[2025-10-24T17:30:38.473455] [INFO ] [LOCAL     ] BEPC: Starting deletion of derivative data.
[2025-10-24T17:30:38.473587] [DEBUG] [LOCAL     ] BEPC: Deleted derivative data file.
[2025-10-24T17:30:38.474086] [INFO ] [MAIN      ] Update Progress: 248/2366 symbols completed. BEPC took 37.0s. Estimated remaining: 4h 21m 16s. Rate: 8.1 symbols/min
[2025-10-24T17:30:38.549127] [INFO ] [REMOTE    ] BEPI: Fetching primary data for 2025-04.
[2025-10-24T17:30:38.666516] [INFO ] [MAIN      ] BEPJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:30:38.672485] [DEBUG] [LOCAL     ] BEPJ: Loaded 3089 existing records from primary storage.
[2025-10-24T17:30:38.672694] [INFO ] [MAIN      ] BEPJ: Loaded 3089 existing records.
[2025-10-24T17:30:38.883054] [WARN ] [MAIN      ] BEPJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:30:38.883334] [INFO ] [MAIN      ] BEPJ: Wiping existing primary data before full refresh.
[2025-10-24T17:30:38.883458] [INFO ] [LOCAL     ] BEPJ: Starting deletion of primary data.
[2025-10-24T17:30:38.883834] [DEBUG] [LOCAL     ] BEPJ: Deleted primary data file.
[2025-10-24T17:30:38.883977] [INFO ] [MAIN      ] BEPJ: Starting full primary refresh.
[2025-10-24T17:30:39.071306] [INFO ] [REMOTE    ] BEN: Incremental fetch complete for 2025-10 (2.12 seconds).
[2025-10-24T17:30:39.170396] [INFO ] [REMOTE    ] BEN: Full fetch complete (77062 records).
[2025-10-24T17:30:39.191562] [DEBUG] [VALIDATOR ] BEN: Validating primary data.
[2025-10-24T17:30:39.211424] [INFO ] [REMOTE    ] BEPI: Incremental fetch complete for 2025-04 (0.66 seconds).
[2025-10-24T17:30:39.350975] [INFO ] [REMOTE    ] BEPI: Fetching primary data for 2025-05.
[2025-10-24T17:30:39.415154] [INFO ] [REMOTE    ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:30:39.698363] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present.
[2025-10-24T17:30:39.698459] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed.
[2025-10-24T17:30:39.699339] [INFO ] [MAIN      ] BEN: Fetched primary data is valid.
[2025-10-24T17:30:39.699407] [DEBUG] [LOCAL     ] BEN: Saving primary data.
[2025-10-24T17:30:39.700100] [FATAL] [LOCAL     ] BEN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:30:39.700197] [FATAL] [MAIN      ] BEN: Failed to save primary data.
[2025-10-24T17:30:39.700239] [WARN ] [MAIN      ] BEN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:30:39.700274] [INFO ] [LOCAL     ] BEN: Starting deletion of primary data.
[2025-10-24T17:30:39.700330] [DEBUG] [LOCAL     ] BEN: No primary data file found to delete.
[2025-10-24T17:30:39.700365] [INFO ] [LOCAL     ] BEN: Starting deletion of derivative data.
[2025-10-24T17:30:39.700501] [DEBUG] [LOCAL     ] BEN: Deleted derivative data file.
[2025-10-24T17:30:39.700955] [INFO ] [MAIN      ] Update Progress: 249/2366 symbols completed. BEN took 42.5s. Estimated remaining: 4h 20m 17s. Rate: 8.1 symbols/min
[2025-10-24T17:30:39.878637] [INFO ] [MAIN      ] BFAM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:30:39.914224] [DEBUG] [LOCAL     ] BFAM: Loaded 34042 existing records from primary storage.
[2025-10-24T17:30:39.914520] [INFO ] [MAIN      ] BFAM: Loaded 34042 existing records.
[2025-10-24T17:30:40.038440] [INFO ] [REMOTE    ] BEPI: Incremental fetch complete for 2025-05 (0.69 seconds).
[2025-10-24T17:30:40.143797] [WARN ] [MAIN      ] BFAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:30:40.144041] [INFO ] [MAIN      ] BFAM: Wiping existing primary data before full refresh.
[2025-10-24T17:30:40.144088] [INFO ] [LOCAL     ] BFAM: Starting deletion of primary data.
[2025-10-24T17:30:40.144549] [DEBUG] [LOCAL     ] BFAM: Deleted primary data file.
[2025-10-24T17:30:40.144604] [INFO ] [MAIN      ] BFAM: Starting full primary refresh.
[2025-10-24T17:30:40.156603] [INFO ] [REMOTE    ] BEPJ: Fetching primary data for 2025-01.
[2025-10-24T17:30:40.501803] [INFO ] [REMOTE    ] BFAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:30:40.893266] [INFO ] [REMOTE    ] BEPJ: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T17:30:40.947710] [INFO ] [REMOTE    ] BEPJ: Fetching primary data for 2025-02.
[2025-10-24T17:30:41.394487] [INFO ] [REMOTE    ] BEPJ: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T17:30:41.747751] [INFO ] [REMOTE    ] BEPI: Fetching primary data for 2025-06.
[2025-10-24T17:30:42.372899] [INFO ] [REMOTE    ] BEPI: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T17:30:42.547717] [INFO ] [REMOTE    ] BEPI: Fetching primary data for 2025-07.
[2025-10-24T17:30:42.974579] [INFO ] [REMOTE    ] BEPI: Incremental fetch complete for 2025-07 (0.43 seconds).
[2025-10-24T17:30:43.347675] [INFO ] [REMOTE    ] BEPI: Fetching primary data for 2025-08.
[2025-10-24T17:30:43.849062] [INFO ] [REMOTE    ] BEPI: Incremental fetch complete for 2025-08 (0.50 seconds).
[2025-10-24T17:30:44.147706] [INFO ] [REMOTE    ] BFAM: Fetching primary data for 2025-01.
[2025-10-24T17:30:44.947704] [INFO ] [REMOTE    ] BEPH: Fetching primary data for 2025-07.
[2025-10-24T17:30:45.381090] [INFO ] [REMOTE    ] BFAM: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T17:30:45.512475] [INFO ] [REMOTE    ] BEPH: Incremental fetch complete for 2025-07 (0.56 seconds).
[2025-10-24T17:30:45.747667] [INFO ] [REMOTE    ] BEPH: Fetching primary data for 2025-08.
[2025-10-24T17:30:46.327474] [INFO ] [REMOTE    ] BEPH: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T17:30:46.547685] [INFO ] [REMOTE    ] BEPH: Fetching primary data for 2025-09.
[2025-10-24T17:30:47.065493] [INFO ] [REMOTE    ] BEPH: Incremental fetch complete for 2025-09 (0.52 seconds).
[2025-10-24T17:30:47.347718] [INFO ] [REMOTE    ] BFAM: Fetching primary data for 2025-02.
[2025-10-24T17:30:48.147705] [INFO ] [REMOTE    ] BEPJ: Fetching primary data for 2025-03.
[2025-10-24T17:30:48.524167] [INFO ] [REMOTE    ] BEPJ: Incremental fetch complete for 2025-03 (0.38 seconds).
[2025-10-24T17:30:48.704529] [INFO ] [REMOTE    ] BFAM: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T17:30:48.947691] [INFO ] [REMOTE    ] BEPI: Fetching primary data for 2025-09.
[2025-10-24T17:30:49.500249] [INFO ] [REMOTE    ] BEPI: Incremental fetch complete for 2025-09 (0.55 seconds).
[2025-10-24T17:30:49.747662] [INFO ] [REMOTE    ] BEPI: Fetching primary data for 2025-10.
[2025-10-24T17:30:50.289630] [INFO ] [REMOTE    ] BEPI: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T17:30:50.290717] [INFO ] [REMOTE    ] BEPI: Full fetch complete (4683 records).
[2025-10-24T17:30:50.290789] [DEBUG] [VALIDATOR ] BEPI: Validating primary data.
[2025-10-24T17:30:50.552859] [INFO ] [REMOTE    ] BEPJ: Fetching primary data for 2025-04.
[2025-10-24T17:30:50.665266] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present.
[2025-10-24T17:30:50.665340] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed.
[2025-10-24T17:30:50.665515] [INFO ] [MAIN      ] BEPI: Fetched primary data is valid.
[2025-10-24T17:30:50.665588] [DEBUG] [LOCAL     ] BEPI: Saving primary data.
[2025-10-24T17:30:50.665834] [FATAL] [LOCAL     ] BEPI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:30:50.665949] [FATAL] [MAIN      ] BEPI: Failed to save primary data.
[2025-10-24T17:30:50.665992] [WARN ] [MAIN      ] BEPI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:30:50.666052] [INFO ] [LOCAL     ] BEPI: Starting deletion of primary data.
[2025-10-24T17:30:50.666108] [DEBUG] [LOCAL     ] BEPI: No primary data file found to delete.
[2025-10-24T17:30:50.666143] [INFO ] [LOCAL     ] BEPI: Starting deletion of derivative data.
[2025-10-24T17:30:50.666293] [DEBUG] [LOCAL     ] BEPI: Deleted derivative data file.
[2025-10-24T17:30:50.666381] [INFO ] [MAIN      ] Update Progress: 250/2366 symbols completed. BEPI took 18.8s. Estimated remaining: 4h 20m 40s. Rate: 8.1 symbols/min
[2025-10-24T17:30:50.837197] [INFO ] [MAIN      ] BFH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:30:50.876710] [DEBUG] [LOCAL     ] BFH: Loaded 41734 existing records from primary storage.
[2025-10-24T17:30:50.876992] [INFO ] [MAIN      ] BFH: Loaded 41734 existing records.
[2025-10-24T17:30:51.057567] [WARN ] [MAIN      ] BFH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:30:51.057816] [INFO ] [MAIN      ] BFH: Wiping existing primary data before full refresh.
[2025-10-24T17:30:51.057870] [INFO ] [LOCAL     ] BFH: Starting deletion of primary data.
[2025-10-24T17:30:51.058196] [DEBUG] [LOCAL     ] BFH: Deleted primary data file.
[2025-10-24T17:30:51.058235] [INFO ] [MAIN      ] BFH: Starting full primary refresh.
[2025-10-24T17:30:51.165145] [INFO ] [REMOTE    ] BEPJ: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T17:30:51.352726] [INFO ] [REMOTE    ] BEPH: Fetching primary data for 2025-10.
[2025-10-24T17:30:51.440926] [INFO ] [REMOTE    ] BFH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:30:52.147696] [INFO ] [REMOTE    ] BFAM: Fetching primary data for 2025-03.
[2025-10-24T17:30:52.183841] [INFO ] [REMOTE    ] BEPH: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T17:30:52.185319] [INFO ] [REMOTE    ] BEPH: Full fetch complete (7546 records).
[2025-10-24T17:30:52.185392] [DEBUG] [VALIDATOR ] BEPH: Validating primary data.
[2025-10-24T17:30:52.547819] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present.
[2025-10-24T17:30:52.547898] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed.
[2025-10-24T17:30:52.548103] [INFO ] [MAIN      ] BEPH: Fetched primary data is valid.
[2025-10-24T17:30:52.548163] [DEBUG] [LOCAL     ] BEPH: Saving primary data.
[2025-10-24T17:30:52.548351] [FATAL] [LOCAL     ] BEPH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:30:52.548432] [FATAL] [MAIN      ] BEPH: Failed to save primary data.
[2025-10-24T17:30:52.548472] [WARN ] [MAIN      ] BEPH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:30:52.548547] [INFO ] [LOCAL     ] BEPH: Starting deletion of primary data.
[2025-10-24T17:30:52.548623] [DEBUG] [LOCAL     ] BEPH: No primary data file found to delete.
[2025-10-24T17:30:52.548692] [INFO ] [LOCAL     ] BEPH: Starting deletion of derivative data.
[2025-10-24T17:30:52.548874] [DEBUG] [LOCAL     ] BEPH: Deleted derivative data file.
[2025-10-24T17:30:52.548961] [INFO ] [MAIN      ] Update Progress: 251/2366 symbols completed. BEPH took 28.0s. Estimated remaining: 4h 19m 46s. Rate: 8.1 symbols/min
[2025-10-24T17:30:52.716064] [INFO ] [MAIN      ] BFK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:30:52.730727] [DEBUG] [LOCAL     ] BFK: Loaded 14005 existing records from primary storage.
[2025-10-24T17:30:52.730961] [INFO ] [MAIN      ] BFK: Loaded 14005 existing records.
[2025-10-24T17:30:52.906223] [WARN ] [MAIN      ] BFK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:30:52.906438] [INFO ] [MAIN      ] BFK: Wiping existing primary data before full refresh.
[2025-10-24T17:30:52.906483] [INFO ] [LOCAL     ] BFK: Starting deletion of primary data.
[2025-10-24T17:30:52.906639] [DEBUG] [LOCAL     ] BFK: Deleted primary data file.
[2025-10-24T17:30:52.906730] [INFO ] [MAIN      ] BFK: Starting full primary refresh.
[2025-10-24T17:30:52.959778] [INFO ] [REMOTE    ] BEPJ: Fetching primary data for 2025-05.
[2025-10-24T17:30:53.279090] [INFO ] [REMOTE    ] BFK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:30:53.430569] [INFO ] [REMOTE    ] BEPJ: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T17:30:53.463247] [INFO ] [REMOTE    ] BFAM: Incremental fetch complete for 2025-03 (1.32 seconds).
[2025-10-24T17:30:53.747719] [INFO ] [REMOTE    ] BFH: Fetching primary data for 2025-01.
[2025-10-24T17:30:54.547724] [INFO ] [REMOTE    ] BFK: Fetching primary data for 2025-01.
[2025-10-24T17:30:55.263325] [INFO ] [REMOTE    ] BFH: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T17:30:55.350150] [INFO ] [REMOTE    ] BFAM: Fetching primary data for 2025-04.
[2025-10-24T17:30:55.353698] [INFO ] [REMOTE    ] BFK: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T17:30:56.147693] [INFO ] [REMOTE    ] BEPJ: Fetching primary data for 2025-06.
[2025-10-24T17:30:56.740169] [INFO ] [REMOTE    ] BEPJ: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T17:30:56.826166] [INFO ] [REMOTE    ] BFAM: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T17:30:56.947739] [INFO ] [REMOTE    ] BFH: Fetching primary data for 2025-02.
[2025-10-24T17:30:57.747698] [INFO ] [REMOTE    ] BFAM: Fetching primary data for 2025-05.
[2025-10-24T17:30:58.501346] [INFO ] [REMOTE    ] BFH: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T17:30:58.547699] [INFO ] [REMOTE    ] BEPJ: Fetching primary data for 2025-07.
[2025-10-24T17:30:59.091440] [INFO ] [REMOTE    ] BFAM: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T17:30:59.134392] [INFO ] [REMOTE    ] BEPJ: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T17:30:59.347721] [INFO ] [REMOTE    ] BFK: Fetching primary data for 2025-02.
[2025-10-24T17:31:00.055771] [INFO ] [REMOTE    ] BFK: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T17:31:00.147707] [INFO ] [REMOTE    ] BFK: Fetching primary data for 2025-03.
[2025-10-24T17:31:00.947709] [INFO ] [REMOTE    ] BEPJ: Fetching primary data for 2025-08.
[2025-10-24T17:31:01.610925] [INFO ] [REMOTE    ] BFK: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T17:31:01.747731] [INFO ] [REMOTE    ] BFAM: Fetching primary data for 2025-06.
[2025-10-24T17:31:02.318458] [INFO ] [REMOTE    ] BEPJ: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T17:31:02.547704] [INFO ] [REMOTE    ] BFK: Fetching primary data for 2025-04.
[2025-10-24T17:31:03.347677] [INFO ] [REMOTE    ] BFH: Fetching primary data for 2025-03.
[2025-10-24T17:31:03.661539] [INFO ] [REMOTE    ] BFK: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T17:31:04.098837] [INFO ] [REMOTE    ] BFAM: Incremental fetch complete for 2025-06 (2.35 seconds).
[2025-10-24T17:31:04.147628] [INFO ] [REMOTE    ] BFAM: Fetching primary data for 2025-07.
[2025-10-24T17:31:04.955629] [INFO ] [REMOTE    ] BEPJ: Fetching primary data for 2025-09.
[2025-10-24T17:31:04.960812] [INFO ] [REMOTE    ] BFH: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T17:31:05.328545] [INFO ] [REMOTE    ] BEPJ: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T17:31:05.352230] [INFO ] [REMOTE    ] BFAM: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T17:31:05.747676] [INFO ] [REMOTE    ] BFAM: Fetching primary data for 2025-08.
[2025-10-24T17:31:06.547636] [INFO ] [REMOTE    ] BEPJ: Fetching primary data for 2025-10.
[2025-10-24T17:31:06.975276] [INFO ] [REMOTE    ] BEPJ: Incremental fetch complete for 2025-10 (0.43 seconds).
[2025-10-24T17:31:06.976514] [INFO ] [REMOTE    ] BEPJ: Full fetch complete (4373 records).
[2025-10-24T17:31:06.976597] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data.
[2025-10-24T17:31:06.977066] [FATAL] [VALIDATOR ] BEPJ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:31:06.977154] [FATAL] [MAIN      ] BEPJ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:31:06.977197] [WARN ] [MAIN      ] BEPJ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:31:06.977238] [INFO ] [LOCAL     ] BEPJ: Starting deletion of primary data.
[2025-10-24T17:31:06.977302] [DEBUG] [LOCAL     ] BEPJ: No primary data file found to delete.
[2025-10-24T17:31:06.977349] [INFO ] [LOCAL     ] BEPJ: Starting deletion of derivative data.
[2025-10-24T17:31:06.978019] [DEBUG] [LOCAL     ] BEPJ: Deleted derivative data file.
[2025-10-24T17:31:06.978326] [INFO ] [MAIN      ] Update Progress: 252/2366 symbols completed. BEPJ took 28.5s. Estimated remaining: 4h 20m 38s. Rate: 8.1 symbols/min
[2025-10-24T17:31:07.153828] [INFO ] [MAIN      ] BFLY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:31:07.204180] [DEBUG] [LOCAL     ] BFLY: Loaded 52246 existing records from primary storage.
[2025-10-24T17:31:07.204510] [INFO ] [MAIN      ] BFLY: Loaded 52246 existing records.
[2025-10-24T17:31:07.354089] [INFO ] [REMOTE    ] BFK: Fetching primary data for 2025-05.
[2025-10-24T17:31:07.414792] [INFO ] [REMOTE    ] BFAM: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T17:31:07.413485] [WARN ] [MAIN      ] BFLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:31:07.423160] [INFO ] [MAIN      ] BFLY: Wiping existing primary data before full refresh.
[2025-10-24T17:31:07.423295] [INFO ] [LOCAL     ] BFLY: Starting deletion of primary data.
[2025-10-24T17:31:07.424095] [DEBUG] [LOCAL     ] BFLY: Deleted primary data file.
[2025-10-24T17:31:07.424159] [INFO ] [MAIN      ] BFLY: Starting full primary refresh.
[2025-10-24T17:31:07.816289] [INFO ] [REMOTE    ] BFLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:31:08.147673] [INFO ] [REMOTE    ] BFLY: Fetching primary data for 2025-01.
[2025-10-24T17:31:08.176479] [INFO ] [REMOTE    ] BFK: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T17:31:08.947686] [INFO ] [REMOTE    ] BFK: Fetching primary data for 2025-06.
[2025-10-24T17:31:09.747631] [INFO ] [REMOTE    ] BFH: Fetching primary data for 2025-04.
[2025-10-24T17:31:09.837858] [INFO ] [REMOTE    ] BFK: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T17:31:10.247495] [INFO ] [REMOTE    ] BFLY: Incremental fetch complete for 2025-01 (2.10 seconds).
[2025-10-24T17:31:10.547699] [INFO ] [REMOTE    ] BFLY: Fetching primary data for 2025-02.
[2025-10-24T17:31:11.347625] [INFO ] [REMOTE    ] BFAM: Fetching primary data for 2025-09.
[2025-10-24T17:31:11.626824] [INFO ] [REMOTE    ] BFH: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T17:31:12.147710] [INFO ] [REMOTE    ] BFK: Fetching primary data for 2025-07.
[2025-10-24T17:31:12.283938] [INFO ] [REMOTE    ] BFLY: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T17:31:12.748893] [INFO ] [REMOTE    ] BFAM: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T17:31:12.947689] [INFO ] [REMOTE    ] BFH: Fetching primary data for 2025-05.
[2025-10-24T17:31:12.978258] [INFO ] [REMOTE    ] BFK: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T17:31:13.747721] [INFO ] [REMOTE    ] BFLY: Fetching primary data for 2025-03.
[2025-10-24T17:31:14.451815] [INFO ] [REMOTE    ] BFH: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T17:31:14.547615] [INFO ] [REMOTE    ] BFH: Fetching primary data for 2025-06.
[2025-10-24T17:31:15.347701] [INFO ] [REMOTE    ] BFK: Fetching primary data for 2025-08.
[2025-10-24T17:31:15.635039] [INFO ] [REMOTE    ] BFLY: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T17:31:16.147626] [INFO ] [REMOTE    ] BFAM: Fetching primary data for 2025-10.
[2025-10-24T17:31:16.212802] [INFO ] [REMOTE    ] BFK: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T17:31:16.403777] [INFO ] [REMOTE    ] BFH: Incremental fetch complete for 2025-06 (1.86 seconds).
[2025-10-24T17:31:16.947670] [INFO ] [REMOTE    ] BFH: Fetching primary data for 2025-07.
[2025-10-24T17:31:17.747695] [INFO ] [REMOTE    ] BFLY: Fetching primary data for 2025-04.
[2025-10-24T17:31:17.800359] [INFO ] [REMOTE    ] BFAM: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T17:31:17.807170] [INFO ] [REMOTE    ] BFAM: Full fetch complete (47486 records).
[2025-10-24T17:31:17.807312] [DEBUG] [VALIDATOR ] BFAM: Validating primary data.
[2025-10-24T17:31:18.196447] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present.
[2025-10-24T17:31:18.196550] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed.
[2025-10-24T17:31:18.197325] [INFO ] [MAIN      ] BFAM: Fetched primary data is valid.
[2025-10-24T17:31:18.197446] [DEBUG] [LOCAL     ] BFAM: Saving primary data.
[2025-10-24T17:31:18.198003] [FATAL] [LOCAL     ] BFAM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:31:18.198084] [FATAL] [MAIN      ] BFAM: Failed to save primary data.
[2025-10-24T17:31:18.198127] [WARN ] [MAIN      ] BFAM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:31:18.198161] [INFO ] [LOCAL     ] BFAM: Starting deletion of primary data.
[2025-10-24T17:31:18.198224] [DEBUG] [LOCAL     ] BFAM: No primary data file found to delete.
[2025-10-24T17:31:18.198281] [INFO ] [LOCAL     ] BFAM: Starting deletion of derivative data.
[2025-10-24T17:31:18.198463] [DEBUG] [LOCAL     ] BFAM: Deleted derivative data file.
[2025-10-24T17:31:18.198558] [INFO ] [MAIN      ] Update Progress: 253/2366 symbols completed. BFAM took 38.5s. Estimated remaining: 4h 21m 2s. Rate: 8.1 symbols/min
[2025-10-24T17:31:18.376303] [INFO ] [MAIN      ] BFS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:31:18.388553] [DEBUG] [LOCAL     ] BFS: Loaded 9613 existing records from primary storage.
[2025-10-24T17:31:18.388907] [INFO ] [MAIN      ] BFS: Loaded 9613 existing records.
[2025-10-24T17:31:18.550141] [INFO ] [REMOTE    ] BFH: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T17:31:18.555366] [INFO ] [REMOTE    ] BFK: Fetching primary data for 2025-09.
[2025-10-24T17:31:18.631559] [WARN ] [MAIN      ] BFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:31:18.631811] [INFO ] [MAIN      ] BFS: Wiping existing primary data before full refresh.
[2025-10-24T17:31:18.631861] [INFO ] [LOCAL     ] BFS: Starting deletion of primary data.
[2025-10-24T17:31:18.632043] [DEBUG] [LOCAL     ] BFS: Deleted primary data file.
[2025-10-24T17:31:18.632102] [INFO ] [MAIN      ] BFS: Starting full primary refresh.
[2025-10-24T17:31:18.994622] [INFO ] [REMOTE    ] BFS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:31:19.339204] [INFO ] [REMOTE    ] BFLY: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T17:31:19.349597] [INFO ] [REMOTE    ] BFS: Fetching primary data for 2025-01.
[2025-10-24T17:31:19.368286] [INFO ] [REMOTE    ] BFK: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T17:31:20.147672] [INFO ] [REMOTE    ] BFLY: Fetching primary data for 2025-05.
[2025-10-24T17:31:20.281462] [INFO ] [REMOTE    ] BFS: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T17:31:20.947675] [INFO ] [REMOTE    ] BFK: Fetching primary data for 2025-10.
[2025-10-24T17:31:21.747670] [INFO ] [REMOTE    ] BFH: Fetching primary data for 2025-08.
[2025-10-24T17:31:21.772292] [INFO ] [REMOTE    ] BFK: Incremental fetch complete for 2025-10 (0.82 seconds).
[2025-10-24T17:31:21.775378] [INFO ] [REMOTE    ] BFK: Full fetch complete (19283 records).
[2025-10-24T17:31:21.775463] [DEBUG] [VALIDATOR ] BFK: Validating primary data.
[2025-10-24T17:31:22.182259] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present.
[2025-10-24T17:31:22.182724] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed.
[2025-10-24T17:31:22.184791] [INFO ] [REMOTE    ] BFLY: Incremental fetch complete for 2025-05 (2.04 seconds).
[2025-10-24T17:31:22.183116] [INFO ] [MAIN      ] BFK: Fetched primary data is valid.
[2025-10-24T17:31:22.195204] [DEBUG] [LOCAL     ] BFK: Saving primary data.
[2025-10-24T17:31:22.196157] [FATAL] [LOCAL     ] BFK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:31:22.196239] [FATAL] [MAIN      ] BFK: Failed to save primary data.
[2025-10-24T17:31:22.196301] [WARN ] [MAIN      ] BFK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:31:22.196368] [INFO ] [LOCAL     ] BFK: Starting deletion of primary data.
[2025-10-24T17:31:22.196428] [DEBUG] [LOCAL     ] BFK: No primary data file found to delete.
[2025-10-24T17:31:22.196463] [INFO ] [LOCAL     ] BFK: Starting deletion of derivative data.
[2025-10-24T17:31:22.196581] [DEBUG] [LOCAL     ] BFK: Deleted derivative data file.
[2025-10-24T17:31:22.196675] [INFO ] [MAIN      ] Update Progress: 254/2366 symbols completed. BFK took 29.6s. Estimated remaining: 4h 20m 26s. Rate: 8.1 symbols/min
[2025-10-24T17:31:22.367483] [INFO ] [MAIN      ] BFZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:31:22.384882] [DEBUG] [LOCAL     ] BFZ: Loaded 12179 existing records from primary storage.
[2025-10-24T17:31:22.385109] [INFO ] [MAIN      ] BFZ: Loaded 12179 existing records.
[2025-10-24T17:31:22.557704] [INFO ] [REMOTE    ] BFS: Fetching primary data for 2025-02.
[2025-10-24T17:31:22.563076] [WARN ] [MAIN      ] BFZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:31:22.564216] [INFO ] [MAIN      ] BFZ: Wiping existing primary data before full refresh.
[2025-10-24T17:31:22.564276] [INFO ] [LOCAL     ] BFZ: Starting deletion of primary data.
[2025-10-24T17:31:22.564463] [DEBUG] [LOCAL     ] BFZ: Deleted primary data file.
[2025-10-24T17:31:22.564519] [INFO ] [MAIN      ] BFZ: Starting full primary refresh.
[2025-10-24T17:31:22.928407] [INFO ] [REMOTE    ] BFZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:31:23.349732] [INFO ] [REMOTE    ] BFLY: Fetching primary data for 2025-06.
[2025-10-24T17:31:23.351549] [INFO ] [REMOTE    ] BFS: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T17:31:23.374537] [INFO ] [REMOTE    ] BFH: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T17:31:24.147677] [INFO ] [REMOTE    ] BFH: Fetching primary data for 2025-09.
[2025-10-24T17:31:24.947669] [INFO ] [REMOTE    ] BFS: Fetching primary data for 2025-03.
[2025-10-24T17:31:25.216344] [INFO ] [REMOTE    ] BFLY: Incremental fetch complete for 2025-06 (1.87 seconds).
[2025-10-24T17:31:25.451567] [INFO ] [REMOTE    ] BFH: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T17:31:25.466397] [INFO ] [REMOTE    ] BFS: Incremental fetch complete for 2025-03 (0.52 seconds).
[2025-10-24T17:31:25.747678] [INFO ] [REMOTE    ] BFH: Fetching primary data for 2025-10.
[2025-10-24T17:31:26.547698] [INFO ] [REMOTE    ] BFS: Fetching primary data for 2025-04.
[2025-10-24T17:31:27.114089] [INFO ] [REMOTE    ] BFS: Incremental fetch complete for 2025-04 (0.57 seconds).
[2025-10-24T17:31:27.347627] [INFO ] [REMOTE    ] BFLY: Fetching primary data for 2025-07.
[2025-10-24T17:31:27.504937] [INFO ] [REMOTE    ] BFH: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T17:31:27.513961] [INFO ] [REMOTE    ] BFH: Full fetch complete (60243 records).
[2025-10-24T17:31:27.514102] [DEBUG] [VALIDATOR ] BFH: Validating primary data.
[2025-10-24T17:31:27.949997] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present.
[2025-10-24T17:31:27.950096] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed.
[2025-10-24T17:31:27.950937] [INFO ] [MAIN      ] BFH: Fetched primary data is valid.
[2025-10-24T17:31:27.951002] [DEBUG] [LOCAL     ] BFH: Saving primary data.
[2025-10-24T17:31:27.951516] [FATAL] [LOCAL     ] BFH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:31:27.951611] [FATAL] [MAIN      ] BFH: Failed to save primary data.
[2025-10-24T17:31:27.951688] [WARN ] [MAIN      ] BFH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:31:27.951741] [INFO ] [LOCAL     ] BFH: Starting deletion of primary data.
[2025-10-24T17:31:27.951814] [DEBUG] [LOCAL     ] BFH: No primary data file found to delete.
[2025-10-24T17:31:27.951864] [INFO ] [LOCAL     ] BFH: Starting deletion of derivative data.
[2025-10-24T17:31:27.952001] [DEBUG] [LOCAL     ] BFH: Deleted derivative data file.
[2025-10-24T17:31:27.952328] [INFO ] [MAIN      ] Update Progress: 255/2366 symbols completed. BFH took 37.3s. Estimated remaining: 4h 20m 5s. Rate: 8.1 symbols/min
[2025-10-24T17:31:28.148426] [INFO ] [REMOTE    ] BFZ: Fetching primary data for 2025-01.
[2025-10-24T17:31:28.148312] [INFO ] [MAIN      ] BG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:31:28.204782] [DEBUG] [LOCAL     ] BG: Loaded 50877 existing records from primary storage.
[2025-10-24T17:31:28.205165] [INFO ] [MAIN      ] BG: Loaded 50877 existing records.
[2025-10-24T17:31:28.410786] [WARN ] [MAIN      ] BG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:31:28.411084] [INFO ] [MAIN      ] BG: Wiping existing primary data before full refresh.
[2025-10-24T17:31:28.411143] [INFO ] [LOCAL     ] BG: Starting deletion of primary data.
[2025-10-24T17:31:28.411347] [DEBUG] [LOCAL     ] BG: Deleted primary data file.
[2025-10-24T17:31:28.411403] [INFO ] [MAIN      ] BG: Starting full primary refresh.
[2025-10-24T17:31:28.765900] [INFO ] [REMOTE    ] BG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:31:28.947634] [INFO ] [REMOTE    ] BG: Fetching primary data for 2025-01.
[2025-10-24T17:31:29.043950] [INFO ] [REMOTE    ] BFZ: Incremental fetch complete for 2025-01 (0.90 seconds).
[2025-10-24T17:31:29.166715] [INFO ] [REMOTE    ] BFLY: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T17:31:29.747802] [INFO ] [REMOTE    ] BFLY: Fetching primary data for 2025-08.
[2025-10-24T17:31:30.547675] [INFO ] [REMOTE    ] BFS: Fetching primary data for 2025-05.
[2025-10-24T17:31:30.686526] [INFO ] [REMOTE    ] BG: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T17:31:31.347627] [INFO ] [REMOTE    ] BFZ: Fetching primary data for 2025-02.
[2025-10-24T17:31:31.403125] [INFO ] [REMOTE    ] BFS: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T17:31:31.565496] [INFO ] [REMOTE    ] BFLY: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T17:31:32.147680] [INFO ] [REMOTE    ] BFS: Fetching primary data for 2025-06.
[2025-10-24T17:31:32.360318] [INFO ] [REMOTE    ] BFZ: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T17:31:32.866541] [INFO ] [REMOTE    ] BFS: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T17:31:32.947702] [INFO ] [REMOTE    ] BFS: Fetching primary data for 2025-07.
[2025-10-24T17:31:33.751470] [INFO ] [REMOTE    ] BG: Fetching primary data for 2025-02.
[2025-10-24T17:31:33.754875] [INFO ] [REMOTE    ] BFS: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T17:31:34.547674] [INFO ] [REMOTE    ] BFS: Fetching primary data for 2025-08.
[2025-10-24T17:31:35.266733] [INFO ] [REMOTE    ] BG: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T17:31:35.343718] [INFO ] [REMOTE    ] BFS: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T17:31:35.347591] [INFO ] [REMOTE    ] BFS: Fetching primary data for 2025-09.
[2025-10-24T17:31:36.119416] [INFO ] [REMOTE    ] BFS: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T17:31:36.147607] [INFO ] [REMOTE    ] BFS: Fetching primary data for 2025-10.
[2025-10-24T17:31:36.936554] [INFO ] [REMOTE    ] BFS: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T17:31:36.942070] [INFO ] [REMOTE    ] BFS: Full fetch complete (13066 records).
[2025-10-24T17:31:36.942148] [DEBUG] [VALIDATOR ] BFS: Validating primary data.
[2025-10-24T17:31:36.953892] [INFO ] [REMOTE    ] BFZ: Fetching primary data for 2025-03.
[2025-10-24T17:31:37.310186] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present.
[2025-10-24T17:31:37.310267] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed.
[2025-10-24T17:31:37.310569] [INFO ] [MAIN      ] BFS: Fetched primary data is valid.
[2025-10-24T17:31:37.310608] [DEBUG] [LOCAL     ] BFS: Saving primary data.
[2025-10-24T17:31:37.310942] [FATAL] [LOCAL     ] BFS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:31:37.311027] [FATAL] [MAIN      ] BFS: Failed to save primary data.
[2025-10-24T17:31:37.311068] [WARN ] [MAIN      ] BFS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:31:37.311106] [INFO ] [LOCAL     ] BFS: Starting deletion of primary data.
[2025-10-24T17:31:37.311183] [DEBUG] [LOCAL     ] BFS: No primary data file found to delete.
[2025-10-24T17:31:37.311237] [INFO ] [LOCAL     ] BFS: Starting deletion of derivative data.
[2025-10-24T17:31:37.311365] [DEBUG] [LOCAL     ] BFS: Deleted derivative data file.
[2025-10-24T17:31:37.311439] [INFO ] [MAIN      ] Update Progress: 256/2366 symbols completed. BFS took 19.1s. Estimated remaining: 4h 20m 14s. Rate: 8.1 symbols/min
[2025-10-24T17:31:37.479756] [INFO ] [MAIN      ] BGB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:31:37.498509] [DEBUG] [LOCAL     ] BGB: Loaded 17727 existing records from primary storage.
[2025-10-24T17:31:37.498771] [INFO ] [MAIN      ] BGB: Loaded 17727 existing records.
[2025-10-24T17:31:37.680407] [WARN ] [MAIN      ] BGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:31:37.680621] [INFO ] [MAIN      ] BGB: Wiping existing primary data before full refresh.
[2025-10-24T17:31:37.680772] [INFO ] [LOCAL     ] BGB: Starting deletion of primary data.
[2025-10-24T17:31:37.680983] [DEBUG] [LOCAL     ] BGB: Deleted primary data file.
[2025-10-24T17:31:37.681039] [INFO ] [MAIN      ] BGB: Starting full primary refresh.
[2025-10-24T17:31:37.748531] [INFO ] [REMOTE    ] BFLY: Fetching primary data for 2025-09.
[2025-10-24T17:31:37.925555] [INFO ] [REMOTE    ] BFZ: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T17:31:38.069371] [INFO ] [REMOTE    ] BGB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:31:38.547689] [INFO ] [REMOTE    ] BGB: Fetching primary data for 2025-01.
[2025-10-24T17:31:39.347764] [INFO ] [REMOTE    ] BFZ: Fetching primary data for 2025-04.
[2025-10-24T17:31:39.862835] [INFO ] [REMOTE    ] BFLY: Incremental fetch complete for 2025-09 (2.11 seconds).
[2025-10-24T17:31:39.895573] [INFO ] [REMOTE    ] BGB: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T17:31:40.147627] [INFO ] [REMOTE    ] BGB: Fetching primary data for 2025-02.
[2025-10-24T17:31:40.221448] [INFO ] [REMOTE    ] BFZ: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T17:31:40.947786] [INFO ] [REMOTE    ] BG: Fetching primary data for 2025-03.
[2025-10-24T17:31:40.978273] [INFO ] [REMOTE    ] BGB: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T17:31:41.747714] [INFO ] [REMOTE    ] BGB: Fetching primary data for 2025-03.
[2025-10-24T17:31:42.385739] [INFO ] [REMOTE    ] BG: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T17:31:42.547686] [INFO ] [REMOTE    ] BFLY: Fetching primary data for 2025-10.
[2025-10-24T17:31:42.685379] [INFO ] [REMOTE    ] BGB: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T17:31:43.347698] [INFO ] [REMOTE    ] BGB: Fetching primary data for 2025-04.
[2025-10-24T17:31:44.156860] [INFO ] [REMOTE    ] BG: Fetching primary data for 2025-04.
[2025-10-24T17:31:44.159223] [INFO ] [REMOTE    ] BGB: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T17:31:44.658597] [INFO ] [REMOTE    ] BFLY: Incremental fetch complete for 2025-10 (2.11 seconds).
[2025-10-24T17:31:44.669367] [INFO ] [REMOTE    ] BFLY: Full fetch complete (75498 records).
[2025-10-24T17:31:44.669540] [DEBUG] [VALIDATOR ] BFLY: Validating primary data.
[2025-10-24T17:31:44.952924] [INFO ] [REMOTE    ] BFZ: Fetching primary data for 2025-05.
[2025-10-24T17:31:45.073819] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present.
[2025-10-24T17:31:45.073902] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed.
[2025-10-24T17:31:45.074716] [INFO ] [MAIN      ] BFLY: Fetched primary data is valid.
[2025-10-24T17:31:45.074780] [DEBUG] [LOCAL     ] BFLY: Saving primary data.
[2025-10-24T17:31:45.075364] [FATAL] [LOCAL     ] BFLY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:31:45.075452] [FATAL] [MAIN      ] BFLY: Failed to save primary data.
[2025-10-24T17:31:45.075494] [WARN ] [MAIN      ] BFLY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:31:45.075528] [INFO ] [LOCAL     ] BFLY: Starting deletion of primary data.
[2025-10-24T17:31:45.075581] [DEBUG] [LOCAL     ] BFLY: No primary data file found to delete.
[2025-10-24T17:31:45.075614] [INFO ] [LOCAL     ] BFLY: Starting deletion of derivative data.
[2025-10-24T17:31:45.075792] [DEBUG] [LOCAL     ] BFLY: Deleted derivative data file.
[2025-10-24T17:31:45.076284] [INFO ] [MAIN      ] Update Progress: 257/2366 symbols completed. BFLY took 38.1s. Estimated remaining: 4h 20m 10s. Rate: 8.1 symbols/min
[2025-10-24T17:31:45.272412] [INFO ] [MAIN      ] BGH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:31:45.292332] [DEBUG] [LOCAL     ] BGH: Loaded 17182 existing records from primary storage.
[2025-10-24T17:31:45.292568] [INFO ] [MAIN      ] BGH: Loaded 17182 existing records.
[2025-10-24T17:31:45.476322] [WARN ] [MAIN      ] BGH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:31:45.476628] [INFO ] [MAIN      ] BGH: Wiping existing primary data before full refresh.
[2025-10-24T17:31:45.476714] [INFO ] [LOCAL     ] BGH: Starting deletion of primary data.
[2025-10-24T17:31:45.476917] [DEBUG] [LOCAL     ] BGH: Deleted primary data file.
[2025-10-24T17:31:45.476974] [INFO ] [MAIN      ] BGH: Starting full primary refresh.
[2025-10-24T17:31:45.749072] [INFO ] [REMOTE    ] BGB: Fetching primary data for 2025-05.
[2025-10-24T17:31:45.793358] [INFO ] [REMOTE    ] BFZ: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T17:31:45.890875] [INFO ] [REMOTE    ] BGH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:31:45.935621] [INFO ] [REMOTE    ] BG: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T17:31:46.547711] [INFO ] [REMOTE    ] BFZ: Fetching primary data for 2025-06.
[2025-10-24T17:31:46.802385] [INFO ] [REMOTE    ] BGB: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T17:31:47.347632] [INFO ] [REMOTE    ] BGH: Fetching primary data for 2025-01.
[2025-10-24T17:31:47.432774] [INFO ] [REMOTE    ] BFZ: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T17:31:48.147632] [INFO ] [REMOTE    ] BFZ: Fetching primary data for 2025-07.
[2025-10-24T17:31:48.170043] [INFO ] [REMOTE    ] BGH: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T17:31:48.894705] [INFO ] [REMOTE    ] BFZ: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T17:31:48.947742] [INFO ] [REMOTE    ] BGB: Fetching primary data for 2025-06.
[2025-10-24T17:31:49.747675] [INFO ] [REMOTE    ] BGH: Fetching primary data for 2025-02.
[2025-10-24T17:31:49.797002] [INFO ] [REMOTE    ] BGB: Incremental fetch complete for 2025-06 (0.85 seconds).
[2025-10-24T17:31:50.547635] [INFO ] [REMOTE    ] BG: Fetching primary data for 2025-05.
[2025-10-24T17:31:50.616688] [INFO ] [REMOTE    ] BGH: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T17:31:51.347694] [INFO ] [REMOTE    ] BGB: Fetching primary data for 2025-07.
[2025-10-24T17:31:52.147719] [INFO ] [REMOTE    ] BGH: Fetching primary data for 2025-03.
[2025-10-24T17:31:52.271906] [INFO ] [REMOTE    ] BG: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T17:31:52.296319] [INFO ] [REMOTE    ] BGB: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T17:31:52.947632] [INFO ] [REMOTE    ] BG: Fetching primary data for 2025-06.
[2025-10-24T17:31:53.063895] [INFO ] [REMOTE    ] BGH: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T17:31:53.747728] [INFO ] [REMOTE    ] BFZ: Fetching primary data for 2025-08.
[2025-10-24T17:31:54.469716] [INFO ] [REMOTE    ] BFZ: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T17:31:54.547717] [INFO ] [REMOTE    ] BGB: Fetching primary data for 2025-08.
[2025-10-24T17:31:54.774577] [INFO ] [REMOTE    ] BG: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T17:31:55.218195] [INFO ] [REMOTE    ] BGB: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T17:31:55.347693] [INFO ] [REMOTE    ] BG: Fetching primary data for 2025-07.
[2025-10-24T17:31:56.147705] [INFO ] [REMOTE    ] BGH: Fetching primary data for 2025-04.
[2025-10-24T17:31:56.947708] [INFO ] [REMOTE    ] BGB: Fetching primary data for 2025-09.
[2025-10-24T17:31:57.021063] [INFO ] [REMOTE    ] BGH: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T17:31:57.191034] [INFO ] [REMOTE    ] BG: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T17:31:57.527421] [INFO ] [REMOTE    ] BGB: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T17:31:57.747719] [INFO ] [REMOTE    ] BGB: Fetching primary data for 2025-10.
[2025-10-24T17:31:58.547705] [INFO ] [REMOTE    ] BGH: Fetching primary data for 2025-05.
[2025-10-24T17:31:58.861957] [INFO ] [REMOTE    ] BGB: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T17:31:58.865713] [INFO ] [REMOTE    ] BGB: Full fetch complete (26540 records).
[2025-10-24T17:31:58.865790] [DEBUG] [VALIDATOR ] BGB: Validating primary data.
[2025-10-24T17:31:59.227751] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present.
[2025-10-24T17:31:59.227832] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed.
[2025-10-24T17:31:59.228216] [INFO ] [MAIN      ] BGB: Fetched primary data is valid.
[2025-10-24T17:31:59.228256] [DEBUG] [LOCAL     ] BGB: Saving primary data.
[2025-10-24T17:31:59.228533] [FATAL] [LOCAL     ] BGB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:31:59.228619] [FATAL] [MAIN      ] BGB: Failed to save primary data.
[2025-10-24T17:31:59.228694] [WARN ] [MAIN      ] BGB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:31:59.228742] [INFO ] [LOCAL     ] BGB: Starting deletion of primary data.
[2025-10-24T17:31:59.228793] [DEBUG] [LOCAL     ] BGB: No primary data file found to delete.
[2025-10-24T17:31:59.228829] [INFO ] [LOCAL     ] BGB: Starting deletion of derivative data.
[2025-10-24T17:31:59.228996] [DEBUG] [LOCAL     ] BGB: Deleted derivative data file.
[2025-10-24T17:31:59.229073] [INFO ] [MAIN      ] Update Progress: 258/2366 symbols completed. BGB took 21.9s. Estimated remaining: 4h 20m 57s. Rate: 8.1 symbols/min
[2025-10-24T17:31:59.349307] [INFO ] [REMOTE    ] BG: Fetching primary data for 2025-08.
[2025-10-24T17:31:59.403141] [INFO ] [MAIN      ] BGR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:31:59.420982] [DEBUG] [LOCAL     ] BGR: Loaded 13505 existing records from primary storage.
[2025-10-24T17:31:59.421237] [INFO ] [MAIN      ] BGR: Loaded 13505 existing records.
[2025-10-24T17:31:59.572082] [INFO ] [REMOTE    ] BGH: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T17:31:59.620523] [WARN ] [MAIN      ] BGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:31:59.620760] [INFO ] [MAIN      ] BGR: Wiping existing primary data before full refresh.
[2025-10-24T17:31:59.620813] [INFO ] [LOCAL     ] BGR: Starting deletion of primary data.
[2025-10-24T17:31:59.620975] [DEBUG] [LOCAL     ] BGR: Deleted primary data file.
[2025-10-24T17:31:59.621013] [INFO ] [MAIN      ] BGR: Starting full primary refresh.
[2025-10-24T17:31:59.978860] [INFO ] [REMOTE    ] BGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:32:00.147688] [INFO ] [REMOTE    ] BFZ: Fetching primary data for 2025-09.
[2025-10-24T17:32:00.947684] [INFO ] [REMOTE    ] BGR: Fetching primary data for 2025-01.
[2025-10-24T17:32:01.385320] [INFO ] [REMOTE    ] BFZ: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T17:32:01.747738] [INFO ] [REMOTE    ] BFZ: Fetching primary data for 2025-10.
[2025-10-24T17:32:01.974582] [INFO ] [REMOTE    ] BG: Incremental fetch complete for 2025-08 (2.63 seconds).
[2025-10-24T17:32:02.547884] [INFO ] [REMOTE    ] BGH: Fetching primary data for 2025-06.
[2025-10-24T17:32:03.351429] [INFO ] [REMOTE    ] BG: Fetching primary data for 2025-09.
[2025-10-24T17:32:03.353049] [INFO ] [REMOTE    ] BGR: Incremental fetch complete for 2025-01 (2.41 seconds).
[2025-10-24T17:32:03.831462] [INFO ] [REMOTE    ] BFZ: Incremental fetch complete for 2025-10 (2.08 seconds).
[2025-10-24T17:32:03.834272] [INFO ] [REMOTE    ] BFZ: Full fetch complete (17652 records).
[2025-10-24T17:32:03.834373] [DEBUG] [VALIDATOR ] BFZ: Validating primary data.
[2025-10-24T17:32:03.834856] [FATAL] [VALIDATOR ] BFZ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:32:03.834957] [FATAL] [MAIN      ] BFZ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:32:03.835001] [WARN ] [MAIN      ] BFZ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:32:03.835040] [INFO ] [LOCAL     ] BFZ: Starting deletion of primary data.
[2025-10-24T17:32:03.835094] [DEBUG] [LOCAL     ] BFZ: No primary data file found to delete.
[2025-10-24T17:32:03.835129] [INFO ] [LOCAL     ] BFZ: Starting deletion of derivative data.
[2025-10-24T17:32:03.835259] [DEBUG] [LOCAL     ] BFZ: Deleted derivative data file.
[2025-10-24T17:32:03.835326] [INFO ] [MAIN      ] Update Progress: 259/2366 symbols completed. BFZ took 41.6s. Estimated remaining: 4h 20m 27s. Rate: 8.1 symbols/min
[2025-10-24T17:32:04.022730] [INFO ] [REMOTE    ] BGH: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T17:32:04.040488] [INFO ] [MAIN      ] BGS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:32:04.096487] [DEBUG] [LOCAL     ] BGS: Loaded 50870 existing records from primary storage.
[2025-10-24T17:32:04.096851] [INFO ] [MAIN      ] BGS: Loaded 50870 existing records.
[2025-10-24T17:32:04.153722] [INFO ] [REMOTE    ] BGR: Fetching primary data for 2025-02.
[2025-10-24T17:32:04.288968] [WARN ] [MAIN      ] BGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:32:04.289208] [INFO ] [MAIN      ] BGS: Wiping existing primary data before full refresh.
[2025-10-24T17:32:04.289276] [INFO ] [LOCAL     ] BGS: Starting deletion of primary data.
[2025-10-24T17:32:04.289610] [DEBUG] [LOCAL     ] BGS: Deleted primary data file.
[2025-10-24T17:32:04.289705] [INFO ] [MAIN      ] BGS: Starting full primary refresh.
[2025-10-24T17:32:04.663807] [INFO ] [REMOTE    ] BGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:32:04.947689] [INFO ] [REMOTE    ] BGH: Fetching primary data for 2025-07.
[2025-10-24T17:32:05.206392] [INFO ] [REMOTE    ] BGR: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T17:32:05.367109] [INFO ] [REMOTE    ] BG: Incremental fetch complete for 2025-09 (2.02 seconds).
[2025-10-24T17:32:05.747696] [INFO ] [REMOTE    ] BG: Fetching primary data for 2025-10.
[2025-10-24T17:32:06.012541] [INFO ] [REMOTE    ] BGH: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T17:32:06.547718] [INFO ] [REMOTE    ] BGS: Fetching primary data for 2025-01.
[2025-10-24T17:32:07.326007] [INFO ] [REMOTE    ] BG: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T17:32:07.335188] [INFO ] [REMOTE    ] BG: Full fetch complete (73042 records).
[2025-10-24T17:32:07.335342] [DEBUG] [VALIDATOR ] BG: Validating primary data.
[2025-10-24T17:32:07.356528] [INFO ] [REMOTE    ] BGH: Fetching primary data for 2025-08.
[2025-10-24T17:32:07.726876] [DEBUG] [VALIDATOR ] BG: All expected trading days are present.
[2025-10-24T17:32:07.727012] [DEBUG] [VALIDATOR ] BG: Primary data validation passed.
[2025-10-24T17:32:07.728169] [INFO ] [MAIN      ] BG: Fetched primary data is valid.
[2025-10-24T17:32:07.728252] [DEBUG] [LOCAL     ] BG: Saving primary data.
[2025-10-24T17:32:07.729003] [FATAL] [LOCAL     ] BG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:32:07.729106] [FATAL] [MAIN      ] BG: Failed to save primary data.
[2025-10-24T17:32:07.729175] [WARN ] [MAIN      ] BG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:32:07.729259] [INFO ] [LOCAL     ] BG: Starting deletion of primary data.
[2025-10-24T17:32:07.729396] [DEBUG] [LOCAL     ] BG: No primary data file found to delete.
[2025-10-24T17:32:07.729445] [INFO ] [LOCAL     ] BG: Starting deletion of derivative data.
[2025-10-24T17:32:07.729593] [DEBUG] [LOCAL     ] BG: Deleted derivative data file.
[2025-10-24T17:32:07.729851] [INFO ] [MAIN      ] Update Progress: 260/2366 symbols completed. BG took 39.8s. Estimated remaining: 4h 19m 51s. Rate: 8.1 symbols/min
[2025-10-24T17:32:07.901747] [INFO ] [MAIN      ] BGSF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:32:07.928313] [INFO ] [REMOTE    ] BGS: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T17:32:07.947502] [DEBUG] [LOCAL     ] BGSF: Loaded 8278 existing records from primary storage.
[2025-10-24T17:32:07.947754] [INFO ] [MAIN      ] BGSF: Loaded 8278 existing records.
[2025-10-24T17:32:08.139015] [INFO ] [REMOTE    ] BGH: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T17:32:08.166037] [INFO ] [REMOTE    ] BGR: Fetching primary data for 2025-03.
[2025-10-24T17:32:08.169311] [WARN ] [MAIN      ] BGSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:32:08.170511] [INFO ] [MAIN      ] BGSF: Wiping existing primary data before full refresh.
[2025-10-24T17:32:08.170629] [INFO ] [LOCAL     ] BGSF: Starting deletion of primary data.
[2025-10-24T17:32:08.174497] [DEBUG] [LOCAL     ] BGSF: Deleted primary data file.
[2025-10-24T17:32:08.174828] [INFO ] [MAIN      ] BGSF: Starting full primary refresh.
[2025-10-24T17:32:08.535781] [INFO ] [REMOTE    ] BGSF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:32:08.947732] [INFO ] [REMOTE    ] BGH: Fetching primary data for 2025-09.
[2025-10-24T17:32:09.041077] [INFO ] [REMOTE    ] BGR: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T17:32:09.723939] [INFO ] [REMOTE    ] BGH: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T17:32:09.747598] [INFO ] [REMOTE    ] BGH: Fetching primary data for 2025-10.
[2025-10-24T17:32:10.547628] [INFO ] [REMOTE    ] BGR: Fetching primary data for 2025-04.
[2025-10-24T17:32:10.667359] [INFO ] [REMOTE    ] BGH: Incremental fetch complete for 2025-10 (0.92 seconds).
[2025-10-24T17:32:10.671177] [INFO ] [REMOTE    ] BGH: Full fetch complete (23009 records).
[2025-10-24T17:32:10.671314] [DEBUG] [VALIDATOR ] BGH: Validating primary data.
[2025-10-24T17:32:11.032492] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present.
[2025-10-24T17:32:11.032568] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed.
[2025-10-24T17:32:11.032954] [INFO ] [MAIN      ] BGH: Fetched primary data is valid.
[2025-10-24T17:32:11.033014] [DEBUG] [LOCAL     ] BGH: Saving primary data.
[2025-10-24T17:32:11.033297] [FATAL] [LOCAL     ] BGH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:32:11.033376] [FATAL] [MAIN      ] BGH: Failed to save primary data.
[2025-10-24T17:32:11.033418] [WARN ] [MAIN      ] BGH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:32:11.033452] [INFO ] [LOCAL     ] BGH: Starting deletion of primary data.
[2025-10-24T17:32:11.033499] [DEBUG] [LOCAL     ] BGH: No primary data file found to delete.
[2025-10-24T17:32:11.033533] [INFO ] [LOCAL     ] BGH: Starting deletion of derivative data.
[2025-10-24T17:32:11.033695] [DEBUG] [LOCAL     ] BGH: Deleted derivative data file.
[2025-10-24T17:32:11.033782] [INFO ] [MAIN      ] Update Progress: 261/2366 symbols completed. BGH took 26.0s. Estimated remaining: 4h 19m 11s. Rate: 8.1 symbols/min
[2025-10-24T17:32:11.210324] [INFO ] [MAIN      ] BGT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:32:11.228875] [DEBUG] [LOCAL     ] BGT: Loaded 16269 existing records from primary storage.
[2025-10-24T17:32:11.229107] [INFO ] [MAIN      ] BGT: Loaded 16269 existing records.
[2025-10-24T17:32:11.348105] [INFO ] [REMOTE    ] BGSF: Fetching primary data for 2025-01.
[2025-10-24T17:32:11.371268] [INFO ] [REMOTE    ] BGR: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T17:32:11.428674] [WARN ] [MAIN      ] BGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:32:11.429979] [INFO ] [MAIN      ] BGT: Wiping existing primary data before full refresh.
[2025-10-24T17:32:11.430046] [INFO ] [LOCAL     ] BGT: Starting deletion of primary data.
[2025-10-24T17:32:11.430436] [DEBUG] [LOCAL     ] BGT: Deleted primary data file.
[2025-10-24T17:32:11.430493] [INFO ] [MAIN      ] BGT: Starting full primary refresh.
[2025-10-24T17:32:11.790035] [INFO ] [REMOTE    ] BGT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:32:12.104128] [INFO ] [REMOTE    ] BGSF: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T17:32:12.147610] [INFO ] [REMOTE    ] BGR: Fetching primary data for 2025-05.
[2025-10-24T17:32:12.947688] [INFO ] [REMOTE    ] BGSF: Fetching primary data for 2025-02.
[2025-10-24T17:32:13.109845] [INFO ] [REMOTE    ] BGR: Incremental fetch complete for 2025-05 (0.96 seconds).
[2025-10-24T17:32:13.392866] [INFO ] [REMOTE    ] BGSF: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T17:32:13.747637] [INFO ] [REMOTE    ] BGR: Fetching primary data for 2025-06.
[2025-10-24T17:32:14.547620] [INFO ] [REMOTE    ] BGT: Fetching primary data for 2025-01.
[2025-10-24T17:32:14.746015] [INFO ] [REMOTE    ] BGR: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T17:32:15.347698] [INFO ] [REMOTE    ] BGS: Fetching primary data for 2025-02.
[2025-10-24T17:32:15.897548] [INFO ] [REMOTE    ] BGT: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T17:32:16.147675] [INFO ] [REMOTE    ] BGSF: Fetching primary data for 2025-03.
[2025-10-24T17:32:16.788471] [INFO ] [REMOTE    ] BGSF: Incremental fetch complete for 2025-03 (0.64 seconds).
[2025-10-24T17:32:16.790047] [INFO ] [REMOTE    ] BGS: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T17:32:16.947615] [INFO ] [REMOTE    ] BGSF: Fetching primary data for 2025-04.
[2025-10-24T17:32:17.407893] [INFO ] [REMOTE    ] BGSF: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T17:32:17.747636] [INFO ] [REMOTE    ] BGR: Fetching primary data for 2025-07.
[2025-10-24T17:32:18.547638] [INFO ] [REMOTE    ] BGSF: Fetching primary data for 2025-05.
[2025-10-24T17:32:18.632307] [INFO ] [REMOTE    ] BGR: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T17:32:18.997351] [INFO ] [REMOTE    ] BGSF: Incremental fetch complete for 2025-05 (0.45 seconds).
[2025-10-24T17:32:19.347638] [INFO ] [REMOTE    ] BGS: Fetching primary data for 2025-03.
[2025-10-24T17:32:20.147638] [INFO ] [REMOTE    ] BGT: Fetching primary data for 2025-02.
[2025-10-24T17:32:20.947669] [INFO ] [REMOTE    ] BGSF: Fetching primary data for 2025-06.
[2025-10-24T17:32:20.991897] [INFO ] [REMOTE    ] BGS: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T17:32:21.066993] [INFO ] [REMOTE    ] BGT: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T17:32:21.409504] [INFO ] [REMOTE    ] BGSF: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T17:32:21.747711] [INFO ] [REMOTE    ] BGS: Fetching primary data for 2025-04.
[2025-10-24T17:32:22.547632] [INFO ] [REMOTE    ] BGSF: Fetching primary data for 2025-07.
[2025-10-24T17:32:23.347620] [INFO ] [REMOTE    ] BGR: Fetching primary data for 2025-08.
[2025-10-24T17:32:23.418504] [INFO ] [REMOTE    ] BGSF: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T17:32:23.501709] [INFO ] [REMOTE    ] BGS: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T17:32:24.017442] [INFO ] [REMOTE    ] BGR: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T17:32:24.147687] [INFO ] [REMOTE    ] BGSF: Fetching primary data for 2025-08.
[2025-10-24T17:32:24.722545] [INFO ] [REMOTE    ] BGSF: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T17:32:24.947624] [INFO ] [REMOTE    ] BGS: Fetching primary data for 2025-05.
[2025-10-24T17:32:25.747693] [INFO ] [REMOTE    ] BGSF: Fetching primary data for 2025-09.
[2025-10-24T17:32:26.547614] [INFO ] [REMOTE    ] BGT: Fetching primary data for 2025-03.
[2025-10-24T17:32:26.594297] [INFO ] [REMOTE    ] BGS: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T17:32:26.621789] [INFO ] [REMOTE    ] BGSF: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T17:32:27.310602] [INFO ] [REMOTE    ] BGT: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T17:32:27.347610] [INFO ] [REMOTE    ] BGT: Fetching primary data for 2025-04.
[2025-10-24T17:32:28.147637] [INFO ] [REMOTE    ] BGR: Fetching primary data for 2025-09.
[2025-10-24T17:32:28.314876] [INFO ] [REMOTE    ] BGT: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T17:32:28.947615] [INFO ] [REMOTE    ] BGS: Fetching primary data for 2025-06.
[2025-10-24T17:32:29.104199] [INFO ] [REMOTE    ] BGR: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T17:32:29.747705] [INFO ] [REMOTE    ] BGT: Fetching primary data for 2025-05.
[2025-10-24T17:32:30.520848] [INFO ] [REMOTE    ] BGS: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T17:32:30.547605] [INFO ] [REMOTE    ] BGS: Fetching primary data for 2025-07.
[2025-10-24T17:32:30.715288] [INFO ] [REMOTE    ] BGT: Incremental fetch complete for 2025-05 (0.97 seconds).
[2025-10-24T17:32:31.347639] [INFO ] [REMOTE    ] BGSF: Fetching primary data for 2025-10.
[2025-10-24T17:32:32.147694] [INFO ] [REMOTE    ] BGT: Fetching primary data for 2025-06.
[2025-10-24T17:32:32.285886] [INFO ] [REMOTE    ] BGS: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T17:32:32.420190] [INFO ] [REMOTE    ] BGSF: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T17:32:32.422989] [INFO ] [REMOTE    ] BGSF: Full fetch complete (9740 records).
[2025-10-24T17:32:32.423060] [DEBUG] [VALIDATOR ] BGSF: Validating primary data.
[2025-10-24T17:32:32.787579] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present.
[2025-10-24T17:32:32.787691] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed.
[2025-10-24T17:32:32.788000] [INFO ] [MAIN      ] BGSF: Fetched primary data is valid.
[2025-10-24T17:32:32.788060] [DEBUG] [LOCAL     ] BGSF: Saving primary data.
[2025-10-24T17:32:32.788287] [FATAL] [LOCAL     ] BGSF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:32:32.788359] [FATAL] [MAIN      ] BGSF: Failed to save primary data.
[2025-10-24T17:32:32.788424] [WARN ] [MAIN      ] BGSF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:32:32.788488] [INFO ] [LOCAL     ] BGSF: Starting deletion of primary data.
[2025-10-24T17:32:32.788545] [DEBUG] [LOCAL     ] BGSF: No primary data file found to delete.
[2025-10-24T17:32:32.788581] [INFO ] [LOCAL     ] BGSF: Starting deletion of derivative data.
[2025-10-24T17:32:32.788729] [DEBUG] [LOCAL     ] BGSF: Deleted derivative data file.
[2025-10-24T17:32:32.788816] [INFO ] [MAIN      ] Update Progress: 262/2366 symbols completed. BGSF took 25.1s. Estimated remaining: 4h 20m 59s. Rate: 8.1 symbols/min
[2025-10-24T17:32:32.958607] [INFO ] [REMOTE    ] BGS: Fetching primary data for 2025-08.
[2025-10-24T17:32:32.962591] [INFO ] [MAIN      ] BGX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:32:32.976526] [DEBUG] [LOCAL     ] BGX: Loaded 11274 existing records from primary storage.
[2025-10-24T17:32:32.976788] [INFO ] [MAIN      ] BGX: Loaded 11274 existing records.
[2025-10-24T17:32:33.177399] [WARN ] [MAIN      ] BGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:32:33.189511] [INFO ] [MAIN      ] BGX: Wiping existing primary data before full refresh.
[2025-10-24T17:32:33.190724] [INFO ] [REMOTE    ] BGT: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T17:32:33.190832] [INFO ] [LOCAL     ] BGX: Starting deletion of primary data.
[2025-10-24T17:32:33.194925] [DEBUG] [LOCAL     ] BGX: Deleted primary data file.
[2025-10-24T17:32:33.195486] [INFO ] [MAIN      ] BGX: Starting full primary refresh.
[2025-10-24T17:32:33.703945] [INFO ] [REMOTE    ] BGX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:32:33.747721] [INFO ] [REMOTE    ] BGX: Fetching primary data for 2025-01.
[2025-10-24T17:32:34.547618] [INFO ] [REMOTE    ] BGT: Fetching primary data for 2025-07.
[2025-10-24T17:32:34.645968] [INFO ] [REMOTE    ] BGX: Incremental fetch complete for 2025-01 (0.90 seconds).
[2025-10-24T17:32:34.752311] [INFO ] [REMOTE    ] BGS: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T17:32:35.169853] [INFO ] [REMOTE    ] BGT: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T17:32:35.347715] [INFO ] [REMOTE    ] BGS: Fetching primary data for 2025-09.
[2025-10-24T17:32:36.147747] [INFO ] [REMOTE    ] BGX: Fetching primary data for 2025-02.
[2025-10-24T17:32:36.824523] [INFO ] [REMOTE    ] BGS: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T17:32:36.916785] [INFO ] [REMOTE    ] BGX: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T17:32:36.947708] [INFO ] [REMOTE    ] BGX: Fetching primary data for 2025-03.
[2025-10-24T17:32:37.747633] [INFO ] [REMOTE    ] BGT: Fetching primary data for 2025-08.
[2025-10-24T17:32:37.791246] [INFO ] [REMOTE    ] BGX: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T17:32:38.547733] [INFO ] [REMOTE    ] BGX: Fetching primary data for 2025-04.
[2025-10-24T17:32:38.792978] [INFO ] [REMOTE    ] BGT: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T17:32:39.332430] [INFO ] [REMOTE    ] BGX: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T17:32:39.347603] [INFO ] [REMOTE    ] BGX: Fetching primary data for 2025-05.
[2025-10-24T17:32:40.110310] [INFO ] [REMOTE    ] BGX: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T17:32:40.147664] [INFO ] [REMOTE    ] BGR: Fetching primary data for 2025-10.
[2025-10-24T17:32:40.947704] [INFO ] [REMOTE    ] BGT: Fetching primary data for 2025-09.
[2025-10-24T17:32:41.288890] [INFO ] [REMOTE    ] BGR: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T17:32:41.293306] [INFO ] [REMOTE    ] BGR: Full fetch complete (19878 records).
[2025-10-24T17:32:41.293443] [DEBUG] [VALIDATOR ] BGR: Validating primary data.
[2025-10-24T17:32:41.688759] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present.
[2025-10-24T17:32:41.688845] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed.
[2025-10-24T17:32:41.689208] [INFO ] [MAIN      ] BGR: Fetched primary data is valid.
[2025-10-24T17:32:41.689247] [DEBUG] [LOCAL     ] BGR: Saving primary data.
[2025-10-24T17:32:41.689524] [FATAL] [LOCAL     ] BGR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:32:41.689605] [FATAL] [MAIN      ] BGR: Failed to save primary data.
[2025-10-24T17:32:41.689672] [WARN ] [MAIN      ] BGR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:32:41.689728] [INFO ] [LOCAL     ] BGR: Starting deletion of primary data.
[2025-10-24T17:32:41.689781] [DEBUG] [LOCAL     ] BGR: No primary data file found to delete.
[2025-10-24T17:32:41.689815] [INFO ] [LOCAL     ] BGR: Starting deletion of derivative data.
[2025-10-24T17:32:41.689971] [DEBUG] [LOCAL     ] BGR: Deleted derivative data file.
[2025-10-24T17:32:41.690059] [INFO ] [MAIN      ] Update Progress: 263/2366 symbols completed. BGR took 42.5s. Estimated remaining: 4h 21m 3s. Rate: 8.1 symbols/min
[2025-10-24T17:32:41.752847] [INFO ] [REMOTE    ] BGX: Fetching primary data for 2025-06.
[2025-10-24T17:32:41.864954] [INFO ] [MAIN      ] BGY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:32:41.896431] [INFO ] [REMOTE    ] BGT: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T17:32:41.902498] [DEBUG] [LOCAL     ] BGY: Loaded 21463 existing records from primary storage.
[2025-10-24T17:32:41.903035] [INFO ] [MAIN      ] BGY: Loaded 21463 existing records.
[2025-10-24T17:32:42.081154] [WARN ] [MAIN      ] BGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:32:42.081383] [INFO ] [MAIN      ] BGY: Wiping existing primary data before full refresh.
[2025-10-24T17:32:42.081431] [INFO ] [LOCAL     ] BGY: Starting deletion of primary data.
[2025-10-24T17:32:42.081609] [DEBUG] [LOCAL     ] BGY: Deleted primary data file.
[2025-10-24T17:32:42.081695] [INFO ] [MAIN      ] BGY: Starting full primary refresh.
[2025-10-24T17:32:42.472438] [INFO ] [REMOTE    ] BGY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:32:42.480380] [INFO ] [REMOTE    ] BGX: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T17:32:42.547692] [INFO ] [REMOTE    ] BGY: Fetching primary data for 2025-01.
[2025-10-24T17:32:43.347698] [INFO ] [REMOTE    ] BGX: Fetching primary data for 2025-07.
[2025-10-24T17:32:43.631141] [INFO ] [REMOTE    ] BGY: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T17:32:44.002367] [INFO ] [REMOTE    ] BGX: Incremental fetch complete for 2025-07 (0.65 seconds).
[2025-10-24T17:32:44.147709] [INFO ] [REMOTE    ] BGY: Fetching primary data for 2025-02.
[2025-10-24T17:32:44.947619] [INFO ] [REMOTE    ] BGS: Fetching primary data for 2025-10.
[2025-10-24T17:32:45.041114] [INFO ] [REMOTE    ] BGY: Incremental fetch complete for 2025-02 (0.89 seconds).
[2025-10-24T17:32:45.747691] [INFO ] [REMOTE    ] BGX: Fetching primary data for 2025-08.
[2025-10-24T17:32:46.547638] [INFO ] [REMOTE    ] BGT: Fetching primary data for 2025-10.
[2025-10-24T17:32:46.621244] [INFO ] [REMOTE    ] BGX: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T17:32:46.901426] [INFO ] [REMOTE    ] BGS: Incremental fetch complete for 2025-10 (1.95 seconds).
[2025-10-24T17:32:46.910677] [INFO ] [REMOTE    ] BGS: Full fetch complete (72669 records).
[2025-10-24T17:32:46.910815] [DEBUG] [VALIDATOR ] BGS: Validating primary data.
[2025-10-24T17:32:47.316017] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present.
[2025-10-24T17:32:47.316104] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed.
[2025-10-24T17:32:47.316922] [INFO ] [MAIN      ] BGS: Fetched primary data is valid.
[2025-10-24T17:32:47.316985] [DEBUG] [LOCAL     ] BGS: Saving primary data.
[2025-10-24T17:32:47.317696] [FATAL] [LOCAL     ] BGS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:32:47.317780] [FATAL] [MAIN      ] BGS: Failed to save primary data.
[2025-10-24T17:32:47.317846] [WARN ] [MAIN      ] BGS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:32:47.317915] [INFO ] [LOCAL     ] BGS: Starting deletion of primary data.
[2025-10-24T17:32:47.317979] [DEBUG] [LOCAL     ] BGS: No primary data file found to delete.
[2025-10-24T17:32:47.318015] [INFO ] [LOCAL     ] BGS: Starting deletion of derivative data.
[2025-10-24T17:32:47.318177] [DEBUG] [LOCAL     ] BGS: Deleted derivative data file.
[2025-10-24T17:32:47.318689] [INFO ] [MAIN      ] Update Progress: 264/2366 symbols completed. BGS took 43.5s. Estimated remaining: 4h 20m 41s. Rate: 8.1 symbols/min
[2025-10-24T17:32:47.352885] [INFO ] [REMOTE    ] BGX: Fetching primary data for 2025-09.
[2025-10-24T17:32:47.505064] [INFO ] [MAIN      ] BH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:32:47.506333] [INFO ] [REMOTE    ] BGT: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T17:32:47.510201] [INFO ] [REMOTE    ] BGT: Full fetch complete (24166 records).
[2025-10-24T17:32:47.510324] [DEBUG] [VALIDATOR ] BGT: Validating primary data.
[2025-10-24T17:32:47.645151] [DEBUG] [LOCAL     ] BH: Loaded 16562 existing records from primary storage.
[2025-10-24T17:32:47.651219] [INFO ] [MAIN      ] BH: Loaded 16562 existing records.
[2025-10-24T17:32:48.002883] [WARN ] [MAIN      ] BH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:32:48.025382] [INFO ] [MAIN      ] BH: Wiping existing primary data before full refresh.
[2025-10-24T17:32:48.025494] [INFO ] [LOCAL     ] BH: Starting deletion of primary data.
[2025-10-24T17:32:48.025792] [DEBUG] [LOCAL     ] BH: Deleted primary data file.
[2025-10-24T17:32:48.031160] [INFO ] [MAIN      ] BH: Starting full primary refresh.
[2025-10-24T17:32:48.162474] [INFO ] [REMOTE    ] BGY: Fetching primary data for 2025-03.
[2025-10-24T17:32:48.203984] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present.
[2025-10-24T17:32:48.216175] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed.
[2025-10-24T17:32:48.216707] [INFO ] [MAIN      ] BGT: Fetched primary data is valid.
[2025-10-24T17:32:48.223479] [DEBUG] [LOCAL     ] BGT: Saving primary data.
[2025-10-24T17:32:48.235349] [FATAL] [LOCAL     ] BGT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:32:48.240680] [FATAL] [MAIN      ] BGT: Failed to save primary data.
[2025-10-24T17:32:48.251973] [INFO ] [REMOTE    ] BGX: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T17:32:48.251538] [WARN ] [MAIN      ] BGT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:32:48.268050] [INFO ] [LOCAL     ] BGT: Starting deletion of primary data.
[2025-10-24T17:32:48.284359] [DEBUG] [LOCAL     ] BGT: No primary data file found to delete.
[2025-10-24T17:32:48.287211] [INFO ] [LOCAL     ] BGT: Starting deletion of derivative data.
[2025-10-24T17:32:48.304166] [DEBUG] [LOCAL     ] BGT: Deleted derivative data file.
[2025-10-24T17:32:48.312482] [INFO ] [MAIN      ] Update Progress: 265/2366 symbols completed. BGT took 37.3s. Estimated remaining: 4h 19m 42s. Rate: 8.1 symbols/min
[2025-10-24T17:32:48.678789] [INFO ] [MAIN      ] BHC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:32:48.698301] [INFO ] [REMOTE    ] BH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:32:48.740037] [DEBUG] [LOCAL     ] BHC: Loaded 46912 existing records from primary storage.
[2025-10-24T17:32:48.740332] [INFO ] [MAIN      ] BHC: Loaded 46912 existing records.
[2025-10-24T17:32:48.946127] [WARN ] [MAIN      ] BHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:32:48.946358] [INFO ] [MAIN      ] BHC: Wiping existing primary data before full refresh.
[2025-10-24T17:32:48.946405] [INFO ] [LOCAL     ] BHC: Starting deletion of primary data.
[2025-10-24T17:32:48.946802] [DEBUG] [LOCAL     ] BHC: Deleted primary data file.
[2025-10-24T17:32:48.946861] [INFO ] [MAIN      ] BHC: Starting full primary refresh.
[2025-10-24T17:32:48.958421] [INFO ] [REMOTE    ] BGX: Fetching primary data for 2025-10.
[2025-10-24T17:32:49.304753] [INFO ] [REMOTE    ] BHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:32:49.408204] [INFO ] [REMOTE    ] BGY: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T17:32:49.747686] [INFO ] [REMOTE    ] BHC: Fetching primary data for 2025-01.
[2025-10-24T17:32:50.003032] [INFO ] [REMOTE    ] BGX: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T17:32:50.007809] [INFO ] [REMOTE    ] BGX: Full fetch complete (16484 records).
[2025-10-24T17:32:50.007901] [DEBUG] [VALIDATOR ] BGX: Validating primary data.
[2025-10-24T17:32:50.391187] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present.
[2025-10-24T17:32:50.391303] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed.
[2025-10-24T17:32:50.391701] [INFO ] [MAIN      ] BGX: Fetched primary data is valid.
[2025-10-24T17:32:50.391764] [DEBUG] [LOCAL     ] BGX: Saving primary data.
[2025-10-24T17:32:50.392056] [FATAL] [LOCAL     ] BGX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:32:50.392175] [FATAL] [MAIN      ] BGX: Failed to save primary data.
[2025-10-24T17:32:50.392241] [WARN ] [MAIN      ] BGX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:32:50.392315] [INFO ] [LOCAL     ] BGX: Starting deletion of primary data.
[2025-10-24T17:32:50.392375] [DEBUG] [LOCAL     ] BGX: No primary data file found to delete.
[2025-10-24T17:32:50.392411] [INFO ] [LOCAL     ] BGX: Starting deletion of derivative data.
[2025-10-24T17:32:50.392604] [DEBUG] [LOCAL     ] BGX: Deleted derivative data file.
[2025-10-24T17:32:50.392742] [INFO ] [MAIN      ] Update Progress: 266/2366 symbols completed. BGX took 17.6s. Estimated remaining: 4h 18m 53s. Rate: 8.1 symbols/min
[2025-10-24T17:32:50.567890] [INFO ] [REMOTE    ] BH: Fetching primary data for 2025-01.
[2025-10-24T17:32:50.571413] [INFO ] [MAIN      ] BHE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:32:50.595390] [DEBUG] [LOCAL     ] BHE: Loaded 23812 existing records from primary storage.
[2025-10-24T17:32:50.595680] [INFO ] [MAIN      ] BHE: Loaded 23812 existing records.
[2025-10-24T17:32:50.775276] [WARN ] [MAIN      ] BHE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:32:50.775476] [INFO ] [MAIN      ] BHE: Wiping existing primary data before full refresh.
[2025-10-24T17:32:50.775531] [INFO ] [LOCAL     ] BHE: Starting deletion of primary data.
[2025-10-24T17:32:50.775758] [DEBUG] [LOCAL     ] BHE: Deleted primary data file.
[2025-10-24T17:32:50.775841] [INFO ] [MAIN      ] BHE: Starting full primary refresh.
[2025-10-24T17:32:51.132810] [INFO ] [REMOTE    ] BHE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:32:51.285247] [INFO ] [REMOTE    ] BHC: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T17:32:51.347616] [INFO ] [REMOTE    ] BHC: Fetching primary data for 2025-02.
[2025-10-24T17:32:51.392132] [INFO ] [REMOTE    ] BH: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T17:32:52.147624] [INFO ] [REMOTE    ] BH: Fetching primary data for 2025-02.
[2025-10-24T17:32:52.789816] [INFO ] [REMOTE    ] BH: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T17:32:52.848726] [INFO ] [REMOTE    ] BHC: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T17:32:52.947614] [INFO ] [REMOTE    ] BGY: Fetching primary data for 2025-04.
[2025-10-24T17:32:53.747638] [INFO ] [REMOTE    ] BH: Fetching primary data for 2025-03.
[2025-10-24T17:32:54.226301] [INFO ] [REMOTE    ] BGY: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T17:32:54.512002] [INFO ] [REMOTE    ] BH: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T17:32:54.547719] [INFO ] [REMOTE    ] BHE: Fetching primary data for 2025-01.
[2025-10-24T17:32:55.347665] [INFO ] [REMOTE    ] BH: Fetching primary data for 2025-04.
[2025-10-24T17:32:55.933223] [INFO ] [REMOTE    ] BHE: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T17:32:56.054825] [INFO ] [REMOTE    ] BH: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T17:32:56.147722] [INFO ] [REMOTE    ] BHC: Fetching primary data for 2025-03.
[2025-10-24T17:32:56.947738] [INFO ] [REMOTE    ] BGY: Fetching primary data for 2025-05.
[2025-10-24T17:32:57.673763] [INFO ] [REMOTE    ] BHC: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T17:32:57.747670] [INFO ] [REMOTE    ] BHC: Fetching primary data for 2025-04.
[2025-10-24T17:32:57.957108] [INFO ] [REMOTE    ] BGY: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T17:32:58.547673] [INFO ] [REMOTE    ] BGY: Fetching primary data for 2025-06.
[2025-10-24T17:32:59.205847] [INFO ] [REMOTE    ] BHC: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T17:32:59.347697] [INFO ] [REMOTE    ] BHC: Fetching primary data for 2025-05.
[2025-10-24T17:32:59.505270] [INFO ] [REMOTE    ] BGY: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T17:33:00.147701] [INFO ] [REMOTE    ] BH: Fetching primary data for 2025-05.
[2025-10-24T17:33:00.947701] [INFO ] [REMOTE    ] BGY: Fetching primary data for 2025-07.
[2025-10-24T17:33:01.592532] [INFO ] [REMOTE    ] BHC: Incremental fetch complete for 2025-05 (2.24 seconds).
[2025-10-24T17:33:01.740350] [INFO ] [REMOTE    ] BH: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T17:33:01.747591] [INFO ] [REMOTE    ] BH: Fetching primary data for 2025-06.
[2025-10-24T17:33:02.547672] [INFO ] [REMOTE    ] BHC: Fetching primary data for 2025-06.
[2025-10-24T17:33:03.347624] [INFO ] [REMOTE    ] BHE: Fetching primary data for 2025-02.
[2025-10-24T17:33:03.541104] [INFO ] [REMOTE    ] BGY: Incremental fetch complete for 2025-07 (2.59 seconds).
[2025-10-24T17:33:03.596061] [INFO ] [REMOTE    ] BH: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T17:33:04.147622] [INFO ] [REMOTE    ] BGY: Fetching primary data for 2025-08.
[2025-10-24T17:33:04.308747] [INFO ] [REMOTE    ] BHC: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T17:33:04.569120] [INFO ] [REMOTE    ] BHE: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T17:33:04.947725] [INFO ] [REMOTE    ] BHC: Fetching primary data for 2025-07.
[2025-10-24T17:33:05.077915] [INFO ] [REMOTE    ] BGY: Incremental fetch complete for 2025-08 (0.93 seconds).
[2025-10-24T17:33:05.747691] [INFO ] [REMOTE    ] BGY: Fetching primary data for 2025-09.
[2025-10-24T17:33:06.547726] [INFO ] [REMOTE    ] BH: Fetching primary data for 2025-07.
[2025-10-24T17:33:06.698440] [INFO ] [REMOTE    ] BHC: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T17:33:06.739356] [INFO ] [REMOTE    ] BGY: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T17:33:07.210215] [INFO ] [REMOTE    ] BH: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T17:33:07.347736] [INFO ] [REMOTE    ] BHE: Fetching primary data for 2025-03.
[2025-10-24T17:33:08.147731] [INFO ] [REMOTE    ] BHC: Fetching primary data for 2025-08.
[2025-10-24T17:33:08.792530] [INFO ] [REMOTE    ] BHE: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T17:33:08.947632] [INFO ] [REMOTE    ] BHE: Fetching primary data for 2025-04.
[2025-10-24T17:33:09.609161] [INFO ] [REMOTE    ] BHC: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T17:33:09.747617] [INFO ] [REMOTE    ] BHC: Fetching primary data for 2025-09.
[2025-10-24T17:33:09.827853] [INFO ] [REMOTE    ] BHE: Incremental fetch complete for 2025-04 (0.88 seconds).
[2025-10-24T17:33:10.547672] [INFO ] [REMOTE    ] BGY: Fetching primary data for 2025-10.
[2025-10-24T17:33:11.347742] [INFO ] [REMOTE    ] BH: Fetching primary data for 2025-08.
[2025-10-24T17:33:11.472445] [INFO ] [REMOTE    ] BHC: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T17:33:11.544528] [INFO ] [REMOTE    ] BGY: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T17:33:11.548767] [INFO ] [REMOTE    ] BGY: Full fetch complete (32790 records).
[2025-10-24T17:33:11.548846] [DEBUG] [VALIDATOR ] BGY: Validating primary data.
[2025-10-24T17:33:11.983227] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present.
[2025-10-24T17:33:11.983332] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed.
[2025-10-24T17:33:11.983908] [INFO ] [MAIN      ] BGY: Fetched primary data is valid.
[2025-10-24T17:33:11.983980] [DEBUG] [LOCAL     ] BGY: Saving primary data.
[2025-10-24T17:33:11.984307] [FATAL] [LOCAL     ] BGY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:33:11.984404] [FATAL] [MAIN      ] BGY: Failed to save primary data.
[2025-10-24T17:33:11.984473] [WARN ] [MAIN      ] BGY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:33:11.984543] [INFO ] [LOCAL     ] BGY: Starting deletion of primary data.
[2025-10-24T17:33:11.984681] [DEBUG] [LOCAL     ] BGY: No primary data file found to delete.
[2025-10-24T17:33:11.984766] [INFO ] [LOCAL     ] BGY: Starting deletion of derivative data.
[2025-10-24T17:33:11.984963] [DEBUG] [LOCAL     ] BGY: Deleted derivative data file.
[2025-10-24T17:33:11.985065] [INFO ] [MAIN      ] Update Progress: 267/2366 symbols completed. BGY took 30.3s. Estimated remaining: 4h 20m 37s. Rate: 8.1 symbols/min
[2025-10-24T17:33:12.153262] [INFO ] [REMOTE    ] BHC: Fetching primary data for 2025-10.
[2025-10-24T17:33:12.181255] [INFO ] [MAIN      ] BHK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:33:12.207741] [DEBUG] [LOCAL     ] BHK: Loaded 24125 existing records from primary storage.
[2025-10-24T17:33:12.208184] [INFO ] [MAIN      ] BHK: Loaded 24125 existing records.
[2025-10-24T17:33:12.419774] [WARN ] [MAIN      ] BHK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:33:12.420077] [INFO ] [MAIN      ] BHK: Wiping existing primary data before full refresh.
[2025-10-24T17:33:12.420187] [INFO ] [LOCAL     ] BHK: Starting deletion of primary data.
[2025-10-24T17:33:12.425633] [DEBUG] [LOCAL     ] BHK: Deleted primary data file.
[2025-10-24T17:33:12.425726] [INFO ] [MAIN      ] BHK: Starting full primary refresh.
[2025-10-24T17:33:12.471114] [INFO ] [REMOTE    ] BH: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T17:33:12.806059] [INFO ] [REMOTE    ] BHK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:33:12.947633] [INFO ] [REMOTE    ] BHK: Fetching primary data for 2025-01.
[2025-10-24T17:33:13.753482] [INFO ] [REMOTE    ] BH: Fetching primary data for 2025-09.
[2025-10-24T17:33:13.764543] [INFO ] [REMOTE    ] BHC: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T17:33:13.773631] [INFO ] [REMOTE    ] BHC: Full fetch complete (67561 records).
[2025-10-24T17:33:13.773804] [DEBUG] [VALIDATOR ] BHC: Validating primary data.
[2025-10-24T17:33:13.948673] [INFO ] [REMOTE    ] BHK: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T17:33:14.189548] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present.
[2025-10-24T17:33:14.189635] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed.
[2025-10-24T17:33:14.190707] [INFO ] [MAIN      ] BHC: Fetched primary data is valid.
[2025-10-24T17:33:14.190771] [DEBUG] [LOCAL     ] BHC: Saving primary data.
[2025-10-24T17:33:14.191470] [FATAL] [LOCAL     ] BHC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:33:14.191578] [FATAL] [MAIN      ] BHC: Failed to save primary data.
[2025-10-24T17:33:14.191681] [WARN ] [MAIN      ] BHC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:33:14.191768] [INFO ] [LOCAL     ] BHC: Starting deletion of primary data.
[2025-10-24T17:33:14.191857] [DEBUG] [LOCAL     ] BHC: No primary data file found to delete.
[2025-10-24T17:33:14.191901] [INFO ] [LOCAL     ] BHC: Starting deletion of derivative data.
[2025-10-24T17:33:14.192060] [DEBUG] [LOCAL     ] BHC: Deleted derivative data file.
[2025-10-24T17:33:14.192579] [INFO ] [MAIN      ] Update Progress: 268/2366 symbols completed. BHC took 25.9s. Estimated remaining: 4h 19m 49s. Rate: 8.1 symbols/min
[2025-10-24T17:33:14.366072] [INFO ] [MAIN      ] BHP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:33:14.418761] [DEBUG] [LOCAL     ] BHP: Loaded 53753 existing records from primary storage.
[2025-10-24T17:33:14.419126] [INFO ] [MAIN      ] BHP: Loaded 53753 existing records.
[2025-10-24T17:33:14.562738] [INFO ] [REMOTE    ] BHK: Fetching primary data for 2025-02.
[2025-10-24T17:33:14.606191] [WARN ] [MAIN      ] BHP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:33:14.606595] [INFO ] [MAIN      ] BHP: Wiping existing primary data before full refresh.
[2025-10-24T17:33:14.606689] [INFO ] [LOCAL     ] BHP: Starting deletion of primary data.
[2025-10-24T17:33:14.607197] [DEBUG] [LOCAL     ] BHP: Deleted primary data file.
[2025-10-24T17:33:14.607239] [INFO ] [MAIN      ] BHP: Starting full primary refresh.
[2025-10-24T17:33:14.978339] [INFO ] [REMOTE    ] BH: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T17:33:15.005552] [INFO ] [REMOTE    ] BHP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:33:15.347696] [INFO ] [REMOTE    ] BHE: Fetching primary data for 2025-05.
[2025-10-24T17:33:15.846460] [INFO ] [REMOTE    ] BHK: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T17:33:16.147739] [INFO ] [REMOTE    ] BHP: Fetching primary data for 2025-01.
[2025-10-24T17:33:16.497265] [INFO ] [REMOTE    ] BHE: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T17:33:16.947694] [INFO ] [REMOTE    ] BH: Fetching primary data for 2025-10.
[2025-10-24T17:33:17.747704] [INFO ] [REMOTE    ] BHE: Fetching primary data for 2025-06.
[2025-10-24T17:33:17.954596] [INFO ] [REMOTE    ] BH: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T17:33:17.957616] [INFO ] [REMOTE    ] BH: Full fetch complete (19534 records).
[2025-10-24T17:33:17.957712] [DEBUG] [VALIDATOR ] BH: Validating primary data.
[2025-10-24T17:33:18.324834] [DEBUG] [VALIDATOR ] BH: All expected trading days are present.
[2025-10-24T17:33:18.324998] [DEBUG] [VALIDATOR ] BH: Primary data validation passed.
[2025-10-24T17:33:18.325334] [INFO ] [MAIN      ] BH: Fetched primary data is valid.
[2025-10-24T17:33:18.325425] [DEBUG] [LOCAL     ] BH: Saving primary data.
[2025-10-24T17:33:18.337233] [FATAL] [LOCAL     ] BH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:33:18.351256] [FATAL] [MAIN      ] BH: Failed to save primary data.
[2025-10-24T17:33:18.354009] [WARN ] [MAIN      ] BH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:33:18.354169] [INFO ] [LOCAL     ] BH: Starting deletion of primary data.
[2025-10-24T17:33:18.354458] [DEBUG] [LOCAL     ] BH: No primary data file found to delete.
[2025-10-24T17:33:18.354539] [INFO ] [LOCAL     ] BH: Starting deletion of derivative data.
[2025-10-24T17:33:18.355998] [INFO ] [REMOTE    ] BHP: Incremental fetch complete for 2025-01 (2.21 seconds).
[2025-10-24T17:33:18.356061] [DEBUG] [LOCAL     ] BH: Deleted derivative data file.
[2025-10-24T17:33:18.356293] [INFO ] [MAIN      ] Update Progress: 269/2366 symbols completed. BH took 31.0s. Estimated remaining: 4h 19m 16s. Rate: 8.1 symbols/min
[2025-10-24T17:33:18.539933] [INFO ] [MAIN      ] BHR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:33:18.552261] [INFO ] [REMOTE    ] BHP: Fetching primary data for 2025-02.
[2025-10-24T17:33:18.562927] [DEBUG] [LOCAL     ] BHR: Loaded 22181 existing records from primary storage.
[2025-10-24T17:33:18.563175] [INFO ] [MAIN      ] BHR: Loaded 22181 existing records.
[2025-10-24T17:33:18.743208] [WARN ] [MAIN      ] BHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:33:18.743533] [INFO ] [MAIN      ] BHR: Wiping existing primary data before full refresh.
[2025-10-24T17:33:18.743672] [INFO ] [LOCAL     ] BHR: Starting deletion of primary data.
[2025-10-24T17:33:18.744033] [DEBUG] [LOCAL     ] BHR: Deleted primary data file.
[2025-10-24T17:33:18.744308] [INFO ] [MAIN      ] BHR: Starting full primary refresh.
[2025-10-24T17:33:18.924403] [INFO ] [REMOTE    ] BHE: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T17:33:19.114583] [INFO ] [REMOTE    ] BHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:33:19.347620] [INFO ] [REMOTE    ] BHE: Fetching primary data for 2025-07.
[2025-10-24T17:33:20.147619] [INFO ] [REMOTE    ] BHK: Fetching primary data for 2025-03.
[2025-10-24T17:33:20.199845] [INFO ] [REMOTE    ] BHE: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T17:33:20.248638] [INFO ] [REMOTE    ] BHP: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T17:33:20.947628] [INFO ] [REMOTE    ] BHP: Fetching primary data for 2025-03.
[2025-10-24T17:33:21.090177] [INFO ] [REMOTE    ] BHK: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T17:33:21.747675] [INFO ] [REMOTE    ] BHK: Fetching primary data for 2025-04.
[2025-10-24T17:33:22.547744] [INFO ] [REMOTE    ] BHR: Fetching primary data for 2025-01.
[2025-10-24T17:33:22.657321] [INFO ] [REMOTE    ] BHK: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T17:33:22.841116] [INFO ] [REMOTE    ] BHP: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T17:33:23.347726] [INFO ] [REMOTE    ] BHK: Fetching primary data for 2025-05.
[2025-10-24T17:33:23.613288] [INFO ] [REMOTE    ] BHR: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T17:33:24.147668] [INFO ] [REMOTE    ] BHP: Fetching primary data for 2025-04.
[2025-10-24T17:33:24.575054] [INFO ] [REMOTE    ] BHK: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T17:33:24.947639] [INFO ] [REMOTE    ] BHK: Fetching primary data for 2025-06.
[2025-10-24T17:33:25.747722] [INFO ] [REMOTE    ] BHR: Fetching primary data for 2025-02.
[2025-10-24T17:33:25.840012] [INFO ] [REMOTE    ] BHP: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T17:33:26.026146] [INFO ] [REMOTE    ] BHK: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T17:33:26.284242] [INFO ] [REMOTE    ] BHR: Incremental fetch complete for 2025-02 (0.54 seconds).
[2025-10-24T17:33:26.547696] [INFO ] [REMOTE    ] BHE: Fetching primary data for 2025-08.
[2025-10-24T17:33:27.347683] [INFO ] [REMOTE    ] BHR: Fetching primary data for 2025-03.
[2025-10-24T17:33:27.630759] [INFO ] [REMOTE    ] BHE: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T17:33:28.132981] [INFO ] [REMOTE    ] BHR: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T17:33:28.147702] [INFO ] [REMOTE    ] BHP: Fetching primary data for 2025-05.
[2025-10-24T17:33:28.947700] [INFO ] [REMOTE    ] BHK: Fetching primary data for 2025-07.
[2025-10-24T17:33:29.747678] [INFO ] [REMOTE    ] BHE: Fetching primary data for 2025-09.
[2025-10-24T17:33:30.019022] [INFO ] [REMOTE    ] BHP: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T17:33:30.547720] [INFO ] [REMOTE    ] BHP: Fetching primary data for 2025-06.
[2025-10-24T17:33:30.735867] [INFO ] [REMOTE    ] BHK: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T17:33:30.927010] [INFO ] [REMOTE    ] BHE: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T17:33:31.347697] [INFO ] [REMOTE    ] BHE: Fetching primary data for 2025-10.
[2025-10-24T17:33:32.147619] [INFO ] [REMOTE    ] BHK: Fetching primary data for 2025-08.
[2025-10-24T17:33:32.258026] [INFO ] [REMOTE    ] BHP: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T17:33:32.636947] [INFO ] [REMOTE    ] BHE: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T17:33:32.641192] [INFO ] [REMOTE    ] BHE: Full fetch complete (36344 records).
[2025-10-24T17:33:32.641290] [DEBUG] [VALIDATOR ] BHE: Validating primary data.
[2025-10-24T17:33:32.949174] [INFO ] [REMOTE    ] BHP: Fetching primary data for 2025-07.
[2025-10-24T17:33:33.038631] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present.
[2025-10-24T17:33:33.038790] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed.
[2025-10-24T17:33:33.039471] [INFO ] [MAIN      ] BHE: Fetched primary data is valid.
[2025-10-24T17:33:33.039619] [DEBUG] [LOCAL     ] BHE: Saving primary data.
[2025-10-24T17:33:33.045294] [FATAL] [LOCAL     ] BHE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:33:33.053568] [FATAL] [MAIN      ] BHE: Failed to save primary data.
[2025-10-24T17:33:33.054553] [INFO ] [REMOTE    ] BHK: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T17:33:33.054121] [WARN ] [MAIN      ] BHE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:33:33.060133] [INFO ] [LOCAL     ] BHE: Starting deletion of primary data.
[2025-10-24T17:33:33.060338] [DEBUG] [LOCAL     ] BHE: No primary data file found to delete.
[2025-10-24T17:33:33.060669] [INFO ] [LOCAL     ] BHE: Starting deletion of derivative data.
[2025-10-24T17:33:33.060838] [DEBUG] [LOCAL     ] BHE: Deleted derivative data file.
[2025-10-24T17:33:33.060912] [INFO ] [MAIN      ] Update Progress: 270/2366 symbols completed. BHE took 42.7s. Estimated remaining: 4h 20m 5s. Rate: 8.1 symbols/min
[2025-10-24T17:33:33.231772] [INFO ] [MAIN      ] BHV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:33:33.231970] [DEBUG] [LOCAL     ] BHV: No existing data file found in primary storage.
[2025-10-24T17:33:33.232010] [WARN ] [MAIN      ] BHV: No existing data found, performing full refresh instead.
[2025-10-24T17:33:33.232126] [INFO ] [MAIN      ] BHV: Wiping existing primary data before full refresh.
[2025-10-24T17:33:33.232187] [INFO ] [LOCAL     ] BHV: Starting deletion of primary data.
[2025-10-24T17:33:33.232258] [DEBUG] [LOCAL     ] BHV: No primary data file found to delete.
[2025-10-24T17:33:33.232308] [INFO ] [MAIN      ] BHV: Starting full primary refresh.
[2025-10-24T17:33:33.600608] [INFO ] [REMOTE    ] BHV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:33:33.747615] [INFO ] [REMOTE    ] BHV: Fetching primary data for 2025-01.
[2025-10-24T17:33:34.236736] [INFO ] [REMOTE    ] BHV: Incremental fetch complete for 2025-01 (0.49 seconds).
[2025-10-24T17:33:34.547676] [INFO ] [REMOTE    ] BHV: Fetching primary data for 2025-02.
[2025-10-24T17:33:34.681568] [INFO ] [REMOTE    ] BHP: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T17:33:34.859360] [INFO ] [REMOTE    ] BHV: Incremental fetch complete for 2025-02 (0.31 seconds).
[2025-10-24T17:33:35.347706] [INFO ] [REMOTE    ] BHK: Fetching primary data for 2025-09.
[2025-10-24T17:33:36.147723] [INFO ] [REMOTE    ] BHR: Fetching primary data for 2025-04.
[2025-10-24T17:33:36.471116] [INFO ] [REMOTE    ] BHK: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T17:33:36.947722] [INFO ] [REMOTE    ] BHP: Fetching primary data for 2025-08.
[2025-10-24T17:33:37.191820] [INFO ] [REMOTE    ] BHR: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T17:33:37.747727] [INFO ] [REMOTE    ] BHV: Fetching primary data for 2025-03.
[2025-10-24T17:33:38.088780] [INFO ] [REMOTE    ] BHV: Incremental fetch complete for 2025-03 (0.34 seconds).
[2025-10-24T17:33:38.547731] [INFO ] [REMOTE    ] BHR: Fetching primary data for 2025-05.
[2025-10-24T17:33:38.985611] [INFO ] [REMOTE    ] BHP: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T17:33:39.347705] [INFO ] [REMOTE    ] BHV: Fetching primary data for 2025-04.
[2025-10-24T17:33:39.418707] [INFO ] [REMOTE    ] BHR: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T17:33:39.691235] [INFO ] [REMOTE    ] BHV: Incremental fetch complete for 2025-04 (0.34 seconds).
[2025-10-24T17:33:40.147691] [INFO ] [REMOTE    ] BHP: Fetching primary data for 2025-09.
[2025-10-24T17:33:40.947737] [INFO ] [REMOTE    ] BHK: Fetching primary data for 2025-10.
[2025-10-24T17:33:41.747732] [INFO ] [REMOTE    ] BHR: Fetching primary data for 2025-06.
[2025-10-24T17:33:42.190629] [INFO ] [REMOTE    ] BHK: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T17:33:42.197102] [INFO ] [REMOTE    ] BHK: Full fetch complete (30695 records).
[2025-10-24T17:33:42.197267] [DEBUG] [VALIDATOR ] BHK: Validating primary data.
[2025-10-24T17:33:42.561755] [INFO ] [REMOTE    ] BHP: Incremental fetch complete for 2025-09 (2.41 seconds).
[2025-10-24T17:33:42.548739] [INFO ] [REMOTE    ] BHV: Fetching primary data for 2025-05.
[2025-10-24T17:33:42.710011] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present.
[2025-10-24T17:33:42.710098] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed.
[2025-10-24T17:33:42.710567] [INFO ] [MAIN      ] BHK: Fetched primary data is valid.
[2025-10-24T17:33:42.710607] [DEBUG] [LOCAL     ] BHK: Saving primary data.
[2025-10-24T17:33:42.711056] [FATAL] [LOCAL     ] BHK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:33:42.711142] [FATAL] [MAIN      ] BHK: Failed to save primary data.
[2025-10-24T17:33:42.711184] [WARN ] [MAIN      ] BHK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:33:42.711217] [INFO ] [LOCAL     ] BHK: Starting deletion of primary data.
[2025-10-24T17:33:42.711267] [DEBUG] [LOCAL     ] BHK: No primary data file found to delete.
[2025-10-24T17:33:42.711303] [INFO ] [LOCAL     ] BHK: Starting deletion of derivative data.
[2025-10-24T17:33:42.711481] [DEBUG] [LOCAL     ] BHK: Deleted derivative data file.
[2025-10-24T17:33:42.711580] [INFO ] [MAIN      ] Update Progress: 271/2366 symbols completed. BHK took 30.7s. Estimated remaining: 4h 20m 14s. Rate: 8.1 symbols/min
[2025-10-24T17:33:42.897604] [INFO ] [MAIN      ] BHVN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:33:42.906329] [INFO ] [REMOTE    ] BHR: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T17:33:42.959532] [DEBUG] [LOCAL     ] BHVN: Loaded 51012 existing records from primary storage.
[2025-10-24T17:33:42.959892] [INFO ] [MAIN      ] BHVN: Loaded 51012 existing records.
[2025-10-24T17:33:43.042823] [INFO ] [REMOTE    ] BHV: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T17:33:43.140072] [WARN ] [MAIN      ] BHVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:33:43.140283] [INFO ] [MAIN      ] BHVN: Wiping existing primary data before full refresh.
[2025-10-24T17:33:43.140328] [INFO ] [LOCAL     ] BHVN: Starting deletion of primary data.
[2025-10-24T17:33:43.140825] [DEBUG] [LOCAL     ] BHVN: Deleted primary data file.
[2025-10-24T17:33:43.140881] [INFO ] [MAIN      ] BHVN: Starting full primary refresh.
[2025-10-24T17:33:43.352895] [INFO ] [REMOTE    ] BHP: Fetching primary data for 2025-10.
[2025-10-24T17:33:43.512113] [INFO ] [REMOTE    ] BHVN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:33:44.147674] [INFO ] [REMOTE    ] BHV: Fetching primary data for 2025-06.
[2025-10-24T17:33:44.490988] [INFO ] [REMOTE    ] BHV: Incremental fetch complete for 2025-06 (0.34 seconds).
[2025-10-24T17:33:44.947726] [INFO ] [REMOTE    ] BHV: Fetching primary data for 2025-07.
[2025-10-24T17:33:45.291132] [INFO ] [REMOTE    ] BHV: Incremental fetch complete for 2025-07 (0.34 seconds).
[2025-10-24T17:33:45.327266] [INFO ] [REMOTE    ] BHP: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T17:33:45.337938] [INFO ] [REMOTE    ] BHP: Full fetch complete (77437 records).
[2025-10-24T17:33:45.338113] [DEBUG] [VALIDATOR ] BHP: Validating primary data.
[2025-10-24T17:33:45.723499] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present.
[2025-10-24T17:33:45.723576] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed.
[2025-10-24T17:33:45.724380] [INFO ] [MAIN      ] BHP: Fetched primary data is valid.
[2025-10-24T17:33:45.724442] [DEBUG] [LOCAL     ] BHP: Saving primary data.
[2025-10-24T17:33:45.725027] [FATAL] [LOCAL     ] BHP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:33:45.725121] [FATAL] [MAIN      ] BHP: Failed to save primary data.
[2025-10-24T17:33:45.725162] [WARN ] [MAIN      ] BHP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:33:45.725197] [INFO ] [LOCAL     ] BHP: Starting deletion of primary data.
[2025-10-24T17:33:45.725253] [DEBUG] [LOCAL     ] BHP: No primary data file found to delete.
[2025-10-24T17:33:45.725313] [INFO ] [LOCAL     ] BHP: Starting deletion of derivative data.
[2025-10-24T17:33:45.725578] [DEBUG] [LOCAL     ] BHP: Deleted derivative data file.
[2025-10-24T17:33:45.726139] [INFO ] [MAIN      ] Update Progress: 272/2366 symbols completed. BHP took 31.5s. Estimated remaining: 4h 19m 33s. Rate: 8.1 symbols/min
[2025-10-24T17:33:45.752855] [INFO ] [REMOTE    ] BHV: Fetching primary data for 2025-08.
[2025-10-24T17:33:45.908751] [INFO ] [MAIN      ] BILL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:33:45.960878] [DEBUG] [LOCAL     ] BILL: Loaded 52879 existing records from primary storage.
[2025-10-24T17:33:45.961194] [INFO ] [MAIN      ] BILL: Loaded 52879 existing records.
[2025-10-24T17:33:46.149148] [WARN ] [MAIN      ] BILL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:33:46.149355] [INFO ] [MAIN      ] BILL: Wiping existing primary data before full refresh.
[2025-10-24T17:33:46.149421] [INFO ] [LOCAL     ] BILL: Starting deletion of primary data.
[2025-10-24T17:33:46.149935] [DEBUG] [LOCAL     ] BILL: Deleted primary data file.
[2025-10-24T17:33:46.149993] [INFO ] [MAIN      ] BILL: Starting full primary refresh.
[2025-10-24T17:33:46.316914] [INFO ] [REMOTE    ] BHV: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T17:33:46.552051] [INFO ] [REMOTE    ] BHVN: Fetching primary data for 2025-01.
[2025-10-24T17:33:46.551988] [INFO ] [REMOTE    ] BILL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:33:47.347672] [INFO ] [REMOTE    ] BHV: Fetching primary data for 2025-09.
[2025-10-24T17:33:47.825130] [INFO ] [REMOTE    ] BHV: Incremental fetch complete for 2025-09 (0.48 seconds).
[2025-10-24T17:33:47.986387] [INFO ] [REMOTE    ] BHVN: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T17:33:48.147673] [INFO ] [REMOTE    ] BILL: Fetching primary data for 2025-01.
[2025-10-24T17:33:48.947679] [INFO ] [REMOTE    ] BHR: Fetching primary data for 2025-07.
[2025-10-24T17:33:49.747703] [INFO ] [REMOTE    ] BHVN: Fetching primary data for 2025-02.
[2025-10-24T17:33:49.801737] [INFO ] [REMOTE    ] BHR: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T17:33:50.123702] [INFO ] [REMOTE    ] BILL: Incremental fetch complete for 2025-01 (1.98 seconds).
[2025-10-24T17:33:50.547665] [INFO ] [REMOTE    ] BILL: Fetching primary data for 2025-02.
[2025-10-24T17:33:51.224004] [INFO ] [REMOTE    ] BHVN: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T17:33:51.347704] [INFO ] [REMOTE    ] BHVN: Fetching primary data for 2025-03.
[2025-10-24T17:33:52.147712] [INFO ] [REMOTE    ] BHR: Fetching primary data for 2025-08.
[2025-10-24T17:33:52.248534] [INFO ] [REMOTE    ] BILL: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T17:33:52.889457] [INFO ] [REMOTE    ] BHVN: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T17:33:52.947632] [INFO ] [REMOTE    ] BHVN: Fetching primary data for 2025-04.
[2025-10-24T17:33:53.193593] [INFO ] [REMOTE    ] BHR: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T17:33:53.747704] [INFO ] [REMOTE    ] BILL: Fetching primary data for 2025-03.
[2025-10-24T17:33:54.547621] [INFO ] [REMOTE    ] BHV: Fetching primary data for 2025-10.
[2025-10-24T17:33:54.627590] [INFO ] [REMOTE    ] BHVN: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T17:33:55.347638] [INFO ] [REMOTE    ] BHR: Fetching primary data for 2025-09.
[2025-10-24T17:33:55.517512] [INFO ] [REMOTE    ] BILL: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T17:33:55.532974] [INFO ] [REMOTE    ] BHV: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T17:33:55.533839] [INFO ] [REMOTE    ] BHV: Full fetch complete (1419 records).
[2025-10-24T17:33:55.533906] [DEBUG] [VALIDATOR ] BHV: Validating primary data.
[2025-10-24T17:33:55.710615] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days
[2025-10-24T17:33:55.710831] [FATAL] [MAIN      ] BHV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:33:55.710898] [WARN ] [MAIN      ] BHV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:33:55.710967] [INFO ] [LOCAL     ] BHV: Starting deletion of primary data.
[2025-10-24T17:33:55.711027] [DEBUG] [LOCAL     ] BHV: No primary data file found to delete.
[2025-10-24T17:33:55.711062] [INFO ] [LOCAL     ] BHV: Starting deletion of derivative data.
[2025-10-24T17:33:55.711101] [DEBUG] [LOCAL     ] BHV: No derivative data file found to delete.
[2025-10-24T17:33:55.711154] [INFO ] [MAIN      ] Update Progress: 273/2366 symbols completed. BHV took 22.7s. Estimated remaining: 4h 19m 45s. Rate: 8.1 symbols/min
[2025-10-24T17:33:55.876602] [INFO ] [MAIN      ] BIO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:33:55.900552] [DEBUG] [LOCAL     ] BIO: Loaded 23969 existing records from primary storage.
[2025-10-24T17:33:55.900844] [INFO ] [MAIN      ] BIO: Loaded 23969 existing records.
[2025-10-24T17:33:56.074199] [WARN ] [MAIN      ] BIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:33:56.074435] [INFO ] [MAIN      ] BIO: Wiping existing primary data before full refresh.
[2025-10-24T17:33:56.074482] [INFO ] [LOCAL     ] BIO: Starting deletion of primary data.
[2025-10-24T17:33:56.074807] [DEBUG] [LOCAL     ] BIO: Deleted primary data file.
[2025-10-24T17:33:56.074876] [INFO ] [MAIN      ] BIO: Starting full primary refresh.
[2025-10-24T17:33:56.151217] [INFO ] [REMOTE    ] BILL: Fetching primary data for 2025-04.
[2025-10-24T17:33:56.391620] [INFO ] [REMOTE    ] BHR: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T17:33:56.484623] [INFO ] [REMOTE    ] BIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:33:56.947681] [INFO ] [REMOTE    ] BHR: Fetching primary data for 2025-10.
[2025-10-24T17:33:57.747743] [INFO ] [REMOTE    ] BIO: Fetching primary data for 2025-01.
[2025-10-24T17:33:57.786624] [INFO ] [REMOTE    ] BHR: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T17:33:57.792051] [INFO ] [REMOTE    ] BHR: Full fetch complete (31250 records).
[2025-10-24T17:33:57.792176] [DEBUG] [VALIDATOR ] BHR: Validating primary data.
[2025-10-24T17:33:57.970758] [INFO ] [REMOTE    ] BILL: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T17:33:58.206026] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present.
[2025-10-24T17:33:58.206102] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed.
[2025-10-24T17:33:58.206510] [INFO ] [MAIN      ] BHR: Fetched primary data is valid.
[2025-10-24T17:33:58.206550] [DEBUG] [LOCAL     ] BHR: Saving primary data.
[2025-10-24T17:33:58.206880] [FATAL] [LOCAL     ] BHR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:33:58.206969] [FATAL] [MAIN      ] BHR: Failed to save primary data.
[2025-10-24T17:33:58.207010] [WARN ] [MAIN      ] BHR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:33:58.207044] [INFO ] [LOCAL     ] BHR: Starting deletion of primary data.
[2025-10-24T17:33:58.207092] [DEBUG] [LOCAL     ] BHR: No primary data file found to delete.
[2025-10-24T17:33:58.207126] [INFO ] [LOCAL     ] BHR: Starting deletion of derivative data.
[2025-10-24T17:33:58.207312] [DEBUG] [LOCAL     ] BHR: Deleted derivative data file.
[2025-10-24T17:33:58.207435] [INFO ] [MAIN      ] Update Progress: 274/2366 symbols completed. BHR took 39.8s. Estimated remaining: 4h 18m 60s. Rate: 8.1 symbols/min
[2025-10-24T17:33:58.379390] [INFO ] [MAIN      ] BIP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:33:58.416615] [DEBUG] [LOCAL     ] BIP: Loaded 39164 existing records from primary storage.
[2025-10-24T17:33:58.416913] [INFO ] [MAIN      ] BIP: Loaded 39164 existing records.
[2025-10-24T17:33:58.559405] [INFO ] [REMOTE    ] BILL: Fetching primary data for 2025-05.
[2025-10-24T17:33:58.604732] [WARN ] [MAIN      ] BIP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:33:58.605284] [INFO ] [MAIN      ] BIP: Wiping existing primary data before full refresh.
[2025-10-24T17:33:58.605371] [INFO ] [LOCAL     ] BIP: Starting deletion of primary data.
[2025-10-24T17:33:58.605833] [DEBUG] [LOCAL     ] BIP: Deleted primary data file.
[2025-10-24T17:33:58.605892] [INFO ] [MAIN      ] BIP: Starting full primary refresh.
[2025-10-24T17:33:58.709332] [INFO ] [REMOTE    ] BIO: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T17:33:58.990573] [INFO ] [REMOTE    ] BIP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:33:59.347696] [INFO ] [REMOTE    ] BIO: Fetching primary data for 2025-02.
[2025-10-24T17:34:00.147733] [INFO ] [REMOTE    ] BIP: Fetching primary data for 2025-01.
[2025-10-24T17:34:00.407782] [INFO ] [REMOTE    ] BIO: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T17:34:00.492311] [INFO ] [REMOTE    ] BILL: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T17:34:00.947637] [INFO ] [REMOTE    ] BIO: Fetching primary data for 2025-03.
[2025-10-24T17:34:01.747625] [INFO ] [REMOTE    ] BILL: Fetching primary data for 2025-06.
[2025-10-24T17:34:02.089359] [INFO ] [REMOTE    ] BIP: Incremental fetch complete for 2025-01 (1.94 seconds).
[2025-10-24T17:34:02.547703] [INFO ] [REMOTE    ] BHVN: Fetching primary data for 2025-05.
[2025-10-24T17:34:02.824751] [INFO ] [REMOTE    ] BIO: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T17:34:03.350440] [INFO ] [REMOTE    ] BIO: Fetching primary data for 2025-04.
[2025-10-24T17:34:03.633499] [INFO ] [REMOTE    ] BILL: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T17:34:04.147754] [INFO ] [REMOTE    ] BIP: Fetching primary data for 2025-02.
[2025-10-24T17:34:04.718172] [INFO ] [REMOTE    ] BHVN: Incremental fetch complete for 2025-05 (2.17 seconds).
[2025-10-24T17:34:04.947715] [INFO ] [REMOTE    ] BILL: Fetching primary data for 2025-07.
[2025-10-24T17:34:05.065879] [INFO ] [REMOTE    ] BIO: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T17:34:05.615851] [INFO ] [REMOTE    ] BIP: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T17:34:05.747729] [INFO ] [REMOTE    ] BIO: Fetching primary data for 2025-05.
[2025-10-24T17:34:06.547770] [INFO ] [REMOTE    ] BIP: Fetching primary data for 2025-03.
[2025-10-24T17:34:07.081664] [INFO ] [REMOTE    ] BILL: Incremental fetch complete for 2025-07 (2.13 seconds).
[2025-10-24T17:34:07.262963] [INFO ] [REMOTE    ] BIO: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T17:34:07.347723] [INFO ] [REMOTE    ] BIO: Fetching primary data for 2025-06.
[2025-10-24T17:34:07.998613] [INFO ] [REMOTE    ] BIP: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T17:34:08.147709] [INFO ] [REMOTE    ] BILL: Fetching primary data for 2025-08.
[2025-10-24T17:34:08.395540] [INFO ] [REMOTE    ] BIO: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T17:34:08.947717] [INFO ] [REMOTE    ] BIP: Fetching primary data for 2025-04.
[2025-10-24T17:34:09.747638] [INFO ] [REMOTE    ] BIO: Fetching primary data for 2025-07.
[2025-10-24T17:34:10.079737] [INFO ] [REMOTE    ] BILL: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T17:34:10.547616] [INFO ] [REMOTE    ] BILL: Fetching primary data for 2025-09.
[2025-10-24T17:34:10.622793] [INFO ] [REMOTE    ] BIP: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T17:34:10.650693] [INFO ] [REMOTE    ] BIO: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T17:34:11.347712] [INFO ] [REMOTE    ] BIO: Fetching primary data for 2025-08.
[2025-10-24T17:34:12.147713] [INFO ] [REMOTE    ] BHVN: Fetching primary data for 2025-06.
[2025-10-24T17:34:12.200309] [INFO ] [REMOTE    ] BILL: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T17:34:12.414844] [INFO ] [REMOTE    ] BIO: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T17:34:12.947697] [INFO ] [REMOTE    ] BIP: Fetching primary data for 2025-05.
[2025-10-24T17:34:13.747679] [INFO ] [REMOTE    ] BILL: Fetching primary data for 2025-10.
[2025-10-24T17:34:13.814848] [INFO ] [REMOTE    ] BHVN: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T17:34:14.160164] [INFO ] [REMOTE    ] BIP: Incremental fetch complete for 2025-05 (1.21 seconds).
[2025-10-24T17:34:14.547724] [INFO ] [REMOTE    ] BIO: Fetching primary data for 2025-09.
[2025-10-24T17:34:15.347737] [INFO ] [REMOTE    ] BIP: Fetching primary data for 2025-06.
[2025-10-24T17:34:15.637903] [INFO ] [REMOTE    ] BILL: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T17:34:15.658559] [INFO ] [REMOTE    ] BILL: Full fetch complete (75735 records).
[2025-10-24T17:34:15.661881] [INFO ] [REMOTE    ] BIO: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T17:34:15.661191] [DEBUG] [VALIDATOR ] BILL: Validating primary data.
[2025-10-24T17:34:15.667768] [FATAL] [VALIDATOR ] BILL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:34:15.667942] [FATAL] [MAIN      ] BILL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:34:15.668014] [WARN ] [MAIN      ] BILL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:34:15.668087] [INFO ] [LOCAL     ] BILL: Starting deletion of primary data.
[2025-10-24T17:34:15.668160] [DEBUG] [LOCAL     ] BILL: No primary data file found to delete.
[2025-10-24T17:34:15.668197] [INFO ] [LOCAL     ] BILL: Starting deletion of derivative data.
[2025-10-24T17:34:15.668428] [DEBUG] [LOCAL     ] BILL: Deleted derivative data file.
[2025-10-24T17:34:15.668865] [INFO ] [MAIN      ] Update Progress: 275/2366 symbols completed. BILL took 29.9s. Estimated remaining: 4h 20m 9s. Rate: 8.0 symbols/min
[2025-10-24T17:34:15.856882] [INFO ] [MAIN      ] BIPC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:34:15.901363] [DEBUG] [LOCAL     ] BIPC: Loaded 41390 existing records from primary storage.
[2025-10-24T17:34:15.901784] [INFO ] [MAIN      ] BIPC: Loaded 41390 existing records.
[2025-10-24T17:34:16.094050] [WARN ] [MAIN      ] BIPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:34:16.094358] [INFO ] [MAIN      ] BIPC: Wiping existing primary data before full refresh.
[2025-10-24T17:34:16.094413] [INFO ] [LOCAL     ] BIPC: Starting deletion of primary data.
[2025-10-24T17:34:16.094927] [DEBUG] [LOCAL     ] BIPC: Deleted primary data file.
[2025-10-24T17:34:16.094985] [INFO ] [MAIN      ] BIPC: Starting full primary refresh.
[2025-10-24T17:34:16.153497] [INFO ] [REMOTE    ] BIO: Fetching primary data for 2025-10.
[2025-10-24T17:34:16.502799] [INFO ] [REMOTE    ] BIPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:34:16.505742] [INFO ] [REMOTE    ] BIP: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T17:34:16.947700] [INFO ] [REMOTE    ] BIPC: Fetching primary data for 2025-01.
[2025-10-24T17:34:17.238067] [INFO ] [REMOTE    ] BIO: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T17:34:17.243094] [INFO ] [REMOTE    ] BIO: Full fetch complete (34575 records).
[2025-10-24T17:34:17.243207] [DEBUG] [VALIDATOR ] BIO: Validating primary data.
[2025-10-24T17:34:17.650707] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present.
[2025-10-24T17:34:17.650820] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed.
[2025-10-24T17:34:17.651549] [INFO ] [MAIN      ] BIO: Fetched primary data is valid.
[2025-10-24T17:34:17.651616] [DEBUG] [LOCAL     ] BIO: Saving primary data.
[2025-10-24T17:34:17.652180] [FATAL] [LOCAL     ] BIO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:34:17.652269] [FATAL] [MAIN      ] BIO: Failed to save primary data.
[2025-10-24T17:34:17.652311] [WARN ] [MAIN      ] BIO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:34:17.652349] [INFO ] [LOCAL     ] BIO: Starting deletion of primary data.
[2025-10-24T17:34:17.652407] [DEBUG] [LOCAL     ] BIO: No primary data file found to delete.
[2025-10-24T17:34:17.652446] [INFO ] [LOCAL     ] BIO: Starting deletion of derivative data.
[2025-10-24T17:34:17.652635] [DEBUG] [LOCAL     ] BIO: Deleted derivative data file.
[2025-10-24T17:34:17.652779] [INFO ] [MAIN      ] Update Progress: 276/2366 symbols completed. BIO took 21.9s. Estimated remaining: 4h 19m 20s. Rate: 8.1 symbols/min
[2025-10-24T17:34:17.753252] [INFO ] [REMOTE    ] BHVN: Fetching primary data for 2025-07.
[2025-10-24T17:34:17.846317] [INFO ] [MAIN      ] BIPH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:34:17.851807] [DEBUG] [LOCAL     ] BIPH: Loaded 2366 existing records from primary storage.
[2025-10-24T17:34:17.852044] [INFO ] [MAIN      ] BIPH: Loaded 2366 existing records.
[2025-10-24T17:34:18.043741] [WARN ] [MAIN      ] BIPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:34:18.044012] [INFO ] [MAIN      ] BIPH: Wiping existing primary data before full refresh.
[2025-10-24T17:34:18.044064] [INFO ] [LOCAL     ] BIPH: Starting deletion of primary data.
[2025-10-24T17:34:18.044200] [DEBUG] [LOCAL     ] BIPH: Deleted primary data file.
[2025-10-24T17:34:18.044240] [INFO ] [MAIN      ] BIPH: Starting full primary refresh.
[2025-10-24T17:34:18.436029] [INFO ] [REMOTE    ] BIPH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:34:18.462687] [INFO ] [REMOTE    ] BIPC: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T17:34:18.547696] [INFO ] [REMOTE    ] BIPH: Fetching primary data for 2025-01.
[2025-10-24T17:34:19.327729] [INFO ] [REMOTE    ] BIPH: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T17:34:19.347602] [INFO ] [REMOTE    ] BIPH: Fetching primary data for 2025-02.
[2025-10-24T17:34:19.647117] [INFO ] [REMOTE    ] BHVN: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T17:34:19.758830] [INFO ] [REMOTE    ] BIPH: Incremental fetch complete for 2025-02 (0.41 seconds).
[2025-10-24T17:34:20.147731] [INFO ] [REMOTE    ] BIP: Fetching primary data for 2025-07.
[2025-10-24T17:34:20.947763] [INFO ] [REMOTE    ] BHVN: Fetching primary data for 2025-08.
[2025-10-24T17:34:21.561391] [INFO ] [REMOTE    ] BIP: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T17:34:21.747695] [INFO ] [REMOTE    ] BIP: Fetching primary data for 2025-08.
[2025-10-24T17:34:22.345317] [INFO ] [REMOTE    ] BHVN: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T17:34:22.547745] [INFO ] [REMOTE    ] BIPH: Fetching primary data for 2025-03.
[2025-10-24T17:34:23.014798] [INFO ] [REMOTE    ] BIPH: Incremental fetch complete for 2025-03 (0.47 seconds).
[2025-10-24T17:34:23.215919] [INFO ] [REMOTE    ] BIP: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T17:34:23.347705] [INFO ] [REMOTE    ] BIP: Fetching primary data for 2025-09.
[2025-10-24T17:34:24.147712] [INFO ] [REMOTE    ] BIPH: Fetching primary data for 2025-04.
[2025-10-24T17:34:24.803877] [INFO ] [REMOTE    ] BIPH: Incremental fetch complete for 2025-04 (0.66 seconds).
[2025-10-24T17:34:24.947699] [INFO ] [REMOTE    ] BIPC: Fetching primary data for 2025-02.
[2025-10-24T17:34:24.989167] [INFO ] [REMOTE    ] BIP: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T17:34:25.747724] [INFO ] [REMOTE    ] BIPH: Fetching primary data for 2025-05.
[2025-10-24T17:34:26.120457] [INFO ] [REMOTE    ] BIPH: Incremental fetch complete for 2025-05 (0.37 seconds).
[2025-10-24T17:34:26.474893] [INFO ] [REMOTE    ] BIPC: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T17:34:26.547670] [INFO ] [REMOTE    ] BIPC: Fetching primary data for 2025-03.
[2025-10-24T17:34:27.347685] [INFO ] [REMOTE    ] BIPH: Fetching primary data for 2025-06.
[2025-10-24T17:34:27.779268] [INFO ] [REMOTE    ] BIPH: Incremental fetch complete for 2025-06 (0.43 seconds).
[2025-10-24T17:34:28.121073] [INFO ] [REMOTE    ] BIPC: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T17:34:28.147610] [INFO ] [REMOTE    ] BIPC: Fetching primary data for 2025-04.
[2025-10-24T17:34:28.947718] [INFO ] [REMOTE    ] BHVN: Fetching primary data for 2025-09.
[2025-10-24T17:34:29.747737] [INFO ] [REMOTE    ] BIP: Fetching primary data for 2025-10.
[2025-10-24T17:34:29.907055] [INFO ] [REMOTE    ] BIPC: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T17:34:30.547614] [INFO ] [REMOTE    ] BIPH: Fetching primary data for 2025-07.
[2025-10-24T17:34:30.657445] [INFO ] [REMOTE    ] BHVN: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T17:34:31.203087] [INFO ] [REMOTE    ] BIP: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T17:34:31.210981] [INFO ] [REMOTE    ] BIP: Full fetch complete (57634 records).
[2025-10-24T17:34:31.211173] [DEBUG] [VALIDATOR ] BIP: Validating primary data.
[2025-10-24T17:34:31.279326] [INFO ] [REMOTE    ] BIPH: Incremental fetch complete for 2025-07 (0.73 seconds).
[2025-10-24T17:34:31.352708] [INFO ] [REMOTE    ] BIPC: Fetching primary data for 2025-05.
[2025-10-24T17:34:31.651346] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present.
[2025-10-24T17:34:31.651448] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed.
[2025-10-24T17:34:31.652188] [INFO ] [MAIN      ] BIP: Fetched primary data is valid.
[2025-10-24T17:34:31.652254] [DEBUG] [LOCAL     ] BIP: Saving primary data.
[2025-10-24T17:34:31.652822] [FATAL] [LOCAL     ] BIP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:34:31.652939] [FATAL] [MAIN      ] BIP: Failed to save primary data.
[2025-10-24T17:34:31.652981] [WARN ] [MAIN      ] BIP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:34:31.653017] [INFO ] [LOCAL     ] BIP: Starting deletion of primary data.
[2025-10-24T17:34:31.653069] [DEBUG] [LOCAL     ] BIP: No primary data file found to delete.
[2025-10-24T17:34:31.653104] [INFO ] [LOCAL     ] BIP: Starting deletion of derivative data.
[2025-10-24T17:34:31.653279] [DEBUG] [LOCAL     ] BIP: Deleted derivative data file.
[2025-10-24T17:34:31.653869] [INFO ] [MAIN      ] Update Progress: 277/2366 symbols completed. BIP took 33.4s. Estimated remaining: 4h 20m 2s. Rate: 8.0 symbols/min
[2025-10-24T17:34:32.147744] [INFO ] [REMOTE    ] BIPH: Fetching primary data for 2025-08.
[2025-10-24T17:34:32.644622] [INFO ] [REMOTE    ] BIPH: Incremental fetch complete for 2025-08 (0.50 seconds).
[2025-10-24T17:34:32.838481] [INFO ] [REMOTE    ] BIPC: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T17:34:32.947727] [INFO ] [REMOTE    ] BIPC: Fetching primary data for 2025-06.
[2025-10-24T17:34:33.747759] [INFO ] [REMOTE    ] BHVN: Fetching primary data for 2025-10.
[2025-10-24T17:34:34.070063] [INFO ] [REMOTE    ] BIPC: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T17:34:34.547694] [INFO ] [REMOTE    ] BIPH: Fetching primary data for 2025-09.
[2025-10-24T17:34:34.973668] [INFO ] [REMOTE    ] BIPH: Incremental fetch complete for 2025-09 (0.43 seconds).
[2025-10-24T17:34:35.347672] [INFO ] [REMOTE    ] BIPH: Fetching primary data for 2025-10.
[2025-10-24T17:34:35.502395] [INFO ] [REMOTE    ] BHVN: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T17:34:35.512226] [INFO ] [REMOTE    ] BHVN: Full fetch complete (70776 records).
[2025-10-24T17:34:35.512394] [DEBUG] [VALIDATOR ] BHVN: Validating primary data.
[2025-10-24T17:34:35.790925] [INFO ] [REMOTE    ] BIPH: Incremental fetch complete for 2025-10 (0.44 seconds).
[2025-10-24T17:34:35.814516] [INFO ] [REMOTE    ] BIPH: Full fetch complete (3683 records).
[2025-10-24T17:34:35.814704] [DEBUG] [VALIDATOR ] BIPH: Validating primary data.
[2025-10-24T17:34:36.075714] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present.
[2025-10-24T17:34:36.078130] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed.
[2025-10-24T17:34:36.095021] [INFO ] [MAIN      ] BHVN: Fetched primary data is valid.
[2025-10-24T17:34:36.096274] [DEBUG] [LOCAL     ] BHVN: Saving primary data.
[2025-10-24T17:34:36.096928] [FATAL] [LOCAL     ] BHVN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:34:36.155978] [INFO ] [REMOTE    ] BIPC: Fetching primary data for 2025-07.
[2025-10-24T17:34:36.132595] [FATAL] [MAIN      ] BHVN: Failed to save primary data.
[2025-10-24T17:34:36.156160] [WARN ] [MAIN      ] BHVN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:34:36.156994] [INFO ] [LOCAL     ] BHVN: Starting deletion of primary data.
[2025-10-24T17:34:36.166120] [DEBUG] [LOCAL     ] BHVN: No primary data file found to delete.
[2025-10-24T17:34:36.166230] [INFO ] [LOCAL     ] BHVN: Starting deletion of derivative data.
[2025-10-24T17:34:36.207079] [DEBUG] [LOCAL     ] BHVN: Deleted derivative data file.
[2025-10-24T17:34:36.207797] [INFO ] [MAIN      ] Update Progress: 278/2366 symbols completed. BHVN took 53.5s. Estimated remaining: 4h 19m 32s. Rate: 8.0 symbols/min
[2025-10-24T17:34:36.283856] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present.
[2025-10-24T17:34:36.283920] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed.
[2025-10-24T17:34:36.284030] [INFO ] [MAIN      ] BIPH: Fetched primary data is valid.
[2025-10-24T17:34:36.284065] [DEBUG] [LOCAL     ] BIPH: Saving primary data.
[2025-10-24T17:34:36.284228] [FATAL] [LOCAL     ] BIPH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:34:36.284304] [FATAL] [MAIN      ] BIPH: Failed to save primary data.
[2025-10-24T17:34:36.284344] [WARN ] [MAIN      ] BIPH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:34:36.284378] [INFO ] [LOCAL     ] BIPH: Starting deletion of primary data.
[2025-10-24T17:34:36.284424] [DEBUG] [LOCAL     ] BIPH: No primary data file found to delete.
[2025-10-24T17:34:36.284460] [INFO ] [LOCAL     ] BIPH: Starting deletion of derivative data.
[2025-10-24T17:34:36.284622] [DEBUG] [LOCAL     ] BIPH: Deleted derivative data file.
[2025-10-24T17:34:36.284739] [INFO ] [MAIN      ] Update Progress: 279/2366 symbols completed. BIPH took 18.6s. Estimated remaining: 4h 18m 30s. Rate: 8.1 symbols/min
[2025-10-24T17:34:37.871091] [INFO ] [REMOTE    ] BIPC: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T17:34:37.880275] [INFO ] [REMOTE    ] BIPC: Fetching primary data for 2025-08.
[2025-10-24T17:34:39.351755] [INFO ] [REMOTE    ] BIPC: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T17:34:39.360738] [INFO ] [REMOTE    ] BIPC: Fetching primary data for 2025-09.
[2025-10-24T17:34:40.927807] [INFO ] [REMOTE    ] BIPC: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T17:34:40.938932] [INFO ] [REMOTE    ] BIPC: Fetching primary data for 2025-10.
[2025-10-24T17:34:42.801855] [INFO ] [REMOTE    ] BIPC: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T17:34:42.810368] [INFO ] [REMOTE    ] BIPC: Full fetch complete (60227 records).
[2025-10-24T17:34:42.810568] [DEBUG] [VALIDATOR ] BIPC: Validating primary data.
[2025-10-24T17:34:43.211574] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present.
[2025-10-24T17:34:43.211723] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed.
[2025-10-24T17:34:43.212757] [INFO ] [MAIN      ] BIPC: Fetched primary data is valid.
[2025-10-24T17:34:43.212824] [DEBUG] [LOCAL     ] BIPC: Saving primary data.
[2025-10-24T17:34:43.213625] [FATAL] [LOCAL     ] BIPC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:34:43.213742] [FATAL] [MAIN      ] BIPC: Failed to save primary data.
[2025-10-24T17:34:43.213785] [WARN ] [MAIN      ] BIPC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:34:43.213821] [INFO ] [LOCAL     ] BIPC: Starting deletion of primary data.
[2025-10-24T17:34:43.213878] [DEBUG] [LOCAL     ] BIPC: No primary data file found to delete.
[2025-10-24T17:34:43.213915] [INFO ] [LOCAL     ] BIPC: Starting deletion of derivative data.
[2025-10-24T17:34:43.214109] [DEBUG] [LOCAL     ] BIPC: Deleted derivative data file.
[2025-10-24T17:34:43.214854] [INFO ] [MAIN      ] Update Progress: 280/2366 symbols completed. BIPC took 27.5s. Estimated remaining: 4h 18m 18s. Rate: 8.1 symbols/min
[2025-10-24T17:34:43.776243] [INFO ] [MAIN      ] BIPJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:34:43.920246] [INFO ] [MAIN      ] BIT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:34:43.950228] [INFO ] [MAIN      ] BIPI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:34:43.977030] [INFO ] [MAIN      ] BIRK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:34:43.977794] [DEBUG] [LOCAL     ] BIPJ: Loaded 3108 existing records from primary storage.
[2025-10-24T17:34:43.978395] [INFO ] [MAIN      ] BIPJ: Loaded 3108 existing records.
[2025-10-24T17:34:44.005786] [DEBUG] [LOCAL     ] BIPI: Loaded 2834 existing records from primary storage.
[2025-10-24T17:34:44.026165] [INFO ] [MAIN      ] BIPI: Loaded 2834 existing records.
[2025-10-24T17:34:44.301952] [DEBUG] [LOCAL     ] BIT: Loaded 23886 existing records from primary storage.
[2025-10-24T17:34:44.328443] [WARN ] [MAIN      ] BIPJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:34:44.350306] [DEBUG] [LOCAL     ] BIRK: Loaded 51506 existing records from primary storage.
[2025-10-24T17:34:44.351030] [INFO ] [MAIN      ] BIPJ: Wiping existing primary data before full refresh.
[2025-10-24T17:34:44.350943] [INFO ] [MAIN      ] BIT: Loaded 23886 existing records.
[2025-10-24T17:34:44.365702] [INFO ] [LOCAL     ] BIPJ: Starting deletion of primary data.
[2025-10-24T17:34:44.365551] [INFO ] [MAIN      ] BIRK: Loaded 51506 existing records.
[2025-10-24T17:34:44.463736] [DEBUG] [LOCAL     ] BIPJ: Deleted primary data file.
[2025-10-24T17:34:44.478991] [INFO ] [MAIN      ] BIPJ: Starting full primary refresh.
[2025-10-24T17:34:44.444185] [WARN ] [MAIN      ] BIPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:34:44.512267] [INFO ] [MAIN      ] BIPI: Wiping existing primary data before full refresh.
[2025-10-24T17:34:44.683671] [INFO ] [LOCAL     ] BIPI: Starting deletion of primary data.
[2025-10-24T17:34:44.766907] [DEBUG] [LOCAL     ] BIPI: Deleted primary data file.
[2025-10-24T17:34:44.783582] [INFO ] [MAIN      ] BIPI: Starting full primary refresh.
[2025-10-24T17:34:44.865955] [WARN ] [MAIN      ] BIRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:34:44.964460] [INFO ] [MAIN      ] BIRK: Wiping existing primary data before full refresh.
[2025-10-24T17:34:45.095223] [INFO ] [LOCAL     ] BIRK: Starting deletion of primary data.
[2025-10-24T17:34:45.119825] [DEBUG] [LOCAL     ] BIRK: Deleted primary data file.
[2025-10-24T17:34:45.114483] [WARN ] [MAIN      ] BIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:34:45.130105] [INFO ] [MAIN      ] BIRK: Starting full primary refresh.
[2025-10-24T17:34:45.181781] [INFO ] [MAIN      ] BIT: Wiping existing primary data before full refresh.
[2025-10-24T17:34:45.242915] [INFO ] [LOCAL     ] BIT: Starting deletion of primary data.
[2025-10-24T17:34:45.371369] [DEBUG] [LOCAL     ] BIT: Deleted primary data file.
[2025-10-24T17:34:45.422325] [INFO ] [MAIN      ] BIT: Starting full primary refresh.
[2025-10-24T17:34:45.744489] [INFO ] [REMOTE    ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:34:45.798833] [INFO ] [REMOTE    ] BIPJ: Fetching primary data for 2025-01.
[2025-10-24T17:34:46.093925] [INFO ] [REMOTE    ] BIPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:34:46.106225] [INFO ] [REMOTE    ] BIPI: Fetching primary data for 2025-01.
[2025-10-24T17:34:46.286578] [INFO ] [REMOTE    ] BIRK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:34:46.300105] [INFO ] [REMOTE    ] BIRK: Fetching primary data for 2025-01.
[2025-10-24T17:34:46.329390] [INFO ] [REMOTE    ] BIT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:34:46.329746] [INFO ] [REMOTE    ] BIT: Fetching primary data for 2025-01.
[2025-10-24T17:34:46.344855] [INFO ] [REMOTE    ] BIPJ: Incremental fetch complete for 2025-01 (0.55 seconds).
[2025-10-24T17:34:46.345953] [INFO ] [REMOTE    ] BIPJ: Fetching primary data for 2025-02.
[2025-10-24T17:34:46.693869] [INFO ] [REMOTE    ] BIPJ: Incremental fetch complete for 2025-02 (0.35 seconds).
[2025-10-24T17:34:46.695443] [INFO ] [REMOTE    ] BIPJ: Fetching primary data for 2025-03.
[2025-10-24T17:34:46.861030] [INFO ] [REMOTE    ] BIPI: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T17:34:46.862338] [INFO ] [REMOTE    ] BIPI: Fetching primary data for 2025-02.
[2025-10-24T17:34:47.137423] [INFO ] [REMOTE    ] BIPJ: Incremental fetch complete for 2025-03 (0.44 seconds).
[2025-10-24T17:34:47.138615] [INFO ] [REMOTE    ] BIPJ: Fetching primary data for 2025-04.
[2025-10-24T17:34:47.163960] [INFO ] [REMOTE    ] BIT: Incremental fetch complete for 2025-01 (0.83 seconds).
[2025-10-24T17:34:47.167942] [INFO ] [REMOTE    ] BIT: Fetching primary data for 2025-02.
[2025-10-24T17:34:47.294636] [INFO ] [REMOTE    ] BIPI: Incremental fetch complete for 2025-02 (0.43 seconds).
[2025-10-24T17:34:47.296270] [INFO ] [REMOTE    ] BIPI: Fetching primary data for 2025-03.
[2025-10-24T17:34:47.483555] [INFO ] [REMOTE    ] BIRK: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T17:34:47.492849] [INFO ] [REMOTE    ] BIRK: Fetching primary data for 2025-02.
[2025-10-24T17:34:47.671714] [INFO ] [REMOTE    ] BIPJ: Incremental fetch complete for 2025-04 (0.53 seconds).
[2025-10-24T17:34:47.751694] [INFO ] [REMOTE    ] BIPI: Incremental fetch complete for 2025-03 (0.46 seconds).
[2025-10-24T17:34:48.147717] [INFO ] [REMOTE    ] BIPJ: Fetching primary data for 2025-05.
[2025-10-24T17:34:48.227284] [INFO ] [REMOTE    ] BIT: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T17:34:48.524376] [INFO ] [REMOTE    ] BIPJ: Incremental fetch complete for 2025-05 (0.38 seconds).
[2025-10-24T17:34:48.750362] [INFO ] [REMOTE    ] BIRK: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T17:34:48.947681] [INFO ] [REMOTE    ] BIT: Fetching primary data for 2025-03.
[2025-10-24T17:34:49.747635] [INFO ] [REMOTE    ] BIPI: Fetching primary data for 2025-04.
[2025-10-24T17:34:49.863455] [INFO ] [REMOTE    ] BIT: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T17:34:50.132767] [INFO ] [REMOTE    ] BIPI: Incremental fetch complete for 2025-04 (0.39 seconds).
[2025-10-24T17:34:50.547715] [INFO ] [REMOTE    ] BIT: Fetching primary data for 2025-04.
[2025-10-24T17:34:51.347623] [INFO ] [REMOTE    ] BIPJ: Fetching primary data for 2025-06.
[2025-10-24T17:34:51.550990] [INFO ] [REMOTE    ] BIT: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T17:34:51.756022] [INFO ] [REMOTE    ] BIPJ: Incremental fetch complete for 2025-06 (0.41 seconds).
[2025-10-24T17:34:52.147713] [INFO ] [REMOTE    ] BIRK: Fetching primary data for 2025-03.
[2025-10-24T17:34:52.947736] [INFO ] [REMOTE    ] BIT: Fetching primary data for 2025-05.
[2025-10-24T17:34:53.716868] [INFO ] [REMOTE    ] BIRK: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T17:34:53.747619] [INFO ] [REMOTE    ] BIRK: Fetching primary data for 2025-04.
[2025-10-24T17:34:53.855676] [INFO ] [REMOTE    ] BIT: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T17:34:54.547721] [INFO ] [REMOTE    ] BIT: Fetching primary data for 2025-06.
[2025-10-24T17:34:55.319927] [INFO ] [REMOTE    ] BIT: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T17:34:55.347627] [INFO ] [REMOTE    ] BIT: Fetching primary data for 2025-07.
[2025-10-24T17:34:55.423119] [INFO ] [REMOTE    ] BIRK: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T17:34:56.147671] [INFO ] [REMOTE    ] BIRK: Fetching primary data for 2025-05.
[2025-10-24T17:34:56.392700] [INFO ] [REMOTE    ] BIT: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T17:34:56.947722] [INFO ] [REMOTE    ] BIPI: Fetching primary data for 2025-05.
[2025-10-24T17:34:57.348208] [INFO ] [REMOTE    ] BIPI: Incremental fetch complete for 2025-05 (0.40 seconds).
[2025-10-24T17:34:57.446728] [INFO ] [REMOTE    ] BIRK: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T17:34:57.747739] [INFO ] [REMOTE    ] BIRK: Fetching primary data for 2025-06.
[2025-10-24T17:34:58.547746] [INFO ] [REMOTE    ] BIPJ: Fetching primary data for 2025-07.
[2025-10-24T17:34:59.081532] [INFO ] [REMOTE    ] BIPJ: Incremental fetch complete for 2025-07 (0.53 seconds).
[2025-10-24T17:34:59.335106] [INFO ] [REMOTE    ] BIRK: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T17:34:59.347686] [INFO ] [REMOTE    ] BIPJ: Fetching primary data for 2025-08.
[2025-10-24T17:34:59.706874] [INFO ] [REMOTE    ] BIPJ: Incremental fetch complete for 2025-08 (0.36 seconds).
[2025-10-24T17:35:00.147723] [INFO ] [REMOTE    ] BIRK: Fetching primary data for 2025-07.
[2025-10-24T17:35:00.947704] [INFO ] [REMOTE    ] BIT: Fetching primary data for 2025-08.
[2025-10-24T17:35:01.747748] [INFO ] [REMOTE    ] BIPI: Fetching primary data for 2025-06.
[2025-10-24T17:35:01.985164] [INFO ] [REMOTE    ] BIRK: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T17:35:02.547758] [INFO ] [REMOTE    ] BIPJ: Fetching primary data for 2025-09.
[2025-10-24T17:35:02.733431] [INFO ] [REMOTE    ] BIPI: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T17:35:03.283255] [INFO ] [REMOTE    ] BIT: Incremental fetch complete for 2025-08 (2.34 seconds).
[2025-10-24T17:35:03.347610] [INFO ] [REMOTE    ] BIT: Fetching primary data for 2025-09.
[2025-10-24T17:35:03.430149] [INFO ] [REMOTE    ] BIPJ: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T17:35:04.147703] [INFO ] [REMOTE    ] BIPI: Fetching primary data for 2025-07.
[2025-10-24T17:35:04.940574] [INFO ] [REMOTE    ] BIPI: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T17:35:04.952807] [INFO ] [REMOTE    ] BIPI: Fetching primary data for 2025-08.
[2025-10-24T17:35:04.967601] [INFO ] [REMOTE    ] BIT: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T17:35:05.547035] [INFO ] [REMOTE    ] BIPI: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T17:35:05.747689] [INFO ] [REMOTE    ] BIT: Fetching primary data for 2025-10.
[2025-10-24T17:35:06.547750] [INFO ] [REMOTE    ] BIPJ: Fetching primary data for 2025-10.
[2025-10-24T17:35:07.105435] [INFO ] [REMOTE    ] BIPJ: Incremental fetch complete for 2025-10 (0.56 seconds).
[2025-10-24T17:35:07.106683] [INFO ] [REMOTE    ] BIPJ: Full fetch complete (4148 records).
[2025-10-24T17:35:07.106778] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data.
[2025-10-24T17:35:07.107389] [FATAL] [VALIDATOR ] BIPJ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:35:07.107479] [FATAL] [MAIN      ] BIPJ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:35:07.107525] [WARN ] [MAIN      ] BIPJ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:35:07.107592] [INFO ] [LOCAL     ] BIPJ: Starting deletion of primary data.
[2025-10-24T17:35:07.107689] [DEBUG] [LOCAL     ] BIPJ: No primary data file found to delete.
[2025-10-24T17:35:07.107747] [INFO ] [LOCAL     ] BIPJ: Starting deletion of derivative data.
[2025-10-24T17:35:07.108041] [DEBUG] [LOCAL     ] BIPJ: Deleted derivative data file.
[2025-10-24T17:35:07.108144] [INFO ] [MAIN      ] Update Progress: 281/2366 symbols completed. BIPJ took 23.9s. Estimated remaining: 4h 20m 13s. Rate: 8.0 symbols/min
[2025-10-24T17:35:07.302829] [INFO ] [MAIN      ] BJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:35:07.305320] [INFO ] [REMOTE    ] BIT: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T17:35:07.312193] [INFO ] [REMOTE    ] BIT: Full fetch complete (32409 records).
[2025-10-24T17:35:07.312421] [DEBUG] [VALIDATOR ] BIT: Validating primary data.
[2025-10-24T17:35:07.348087] [INFO ] [REMOTE    ] BIPI: Fetching primary data for 2025-09.
[2025-10-24T17:35:07.698183] [DEBUG] [LOCAL     ] BJ: Loaded 51834 existing records from primary storage.
[2025-10-24T17:35:07.731019] [INFO ] [MAIN      ] BJ: Loaded 51834 existing records.
[2025-10-24T17:35:07.841435] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present.
[2025-10-24T17:35:07.863563] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed.
[2025-10-24T17:35:07.864359] [INFO ] [MAIN      ] BIT: Fetched primary data is valid.
[2025-10-24T17:35:07.864811] [DEBUG] [LOCAL     ] BIT: Saving primary data.
[2025-10-24T17:35:07.875922] [FATAL] [LOCAL     ] BIT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:35:07.881195] [FATAL] [MAIN      ] BIT: Failed to save primary data.
[2025-10-24T17:35:07.891516] [WARN ] [MAIN      ] BIT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:35:07.911201] [INFO ] [LOCAL     ] BIT: Starting deletion of primary data.
[2025-10-24T17:35:07.926901] [DEBUG] [LOCAL     ] BIT: No primary data file found to delete.
[2025-10-24T17:35:07.943783] [INFO ] [LOCAL     ] BIT: Starting deletion of derivative data.
[2025-10-24T17:35:07.949601] [WARN ] [MAIN      ] BJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:35:07.950077] [DEBUG] [LOCAL     ] BIT: Deleted derivative data file.
[2025-10-24T17:35:07.950283] [INFO ] [MAIN      ] Update Progress: 282/2366 symbols completed. BIT took 24.7s. Estimated remaining: 4h 19m 16s. Rate: 8.0 symbols/min
[2025-10-24T17:35:07.950024] [INFO ] [MAIN      ] BJ: Wiping existing primary data before full refresh.
[2025-10-24T17:35:07.961888] [INFO ] [LOCAL     ] BJ: Starting deletion of primary data.
[2025-10-24T17:35:07.995790] [DEBUG] [LOCAL     ] BJ: Deleted primary data file.
[2025-10-24T17:35:08.002239] [INFO ] [MAIN      ] BJ: Starting full primary refresh.
[2025-10-24T17:35:08.158415] [INFO ] [REMOTE    ] BIRK: Fetching primary data for 2025-08.
[2025-10-24T17:35:08.380221] [INFO ] [MAIN      ] BK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:35:08.397250] [INFO ] [REMOTE    ] BIPI: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T17:35:08.554304] [INFO ] [REMOTE    ] BJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:35:08.605209] [DEBUG] [LOCAL     ] BK: Loaded 53936 existing records from primary storage.
[2025-10-24T17:35:08.605796] [INFO ] [MAIN      ] BK: Loaded 53936 existing records.
[2025-10-24T17:35:08.804349] [WARN ] [MAIN      ] BK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:35:08.804700] [INFO ] [MAIN      ] BK: Wiping existing primary data before full refresh.
[2025-10-24T17:35:08.804767] [INFO ] [LOCAL     ] BK: Starting deletion of primary data.
[2025-10-24T17:35:08.805347] [DEBUG] [LOCAL     ] BK: Deleted primary data file.
[2025-10-24T17:35:08.805409] [INFO ] [MAIN      ] BK: Starting full primary refresh.
[2025-10-24T17:35:08.952919] [INFO ] [REMOTE    ] BIPI: Fetching primary data for 2025-10.
[2025-10-24T17:35:09.189726] [INFO ] [REMOTE    ] BK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:35:09.503623] [INFO ] [REMOTE    ] BIPI: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T17:35:09.504747] [INFO ] [REMOTE    ] BIPI: Full fetch complete (4498 records).
[2025-10-24T17:35:09.504825] [DEBUG] [VALIDATOR ] BIPI: Validating primary data.
[2025-10-24T17:35:09.505186] [FATAL] [VALIDATOR ] BIPI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:35:09.505268] [FATAL] [MAIN      ] BIPI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:35:09.505311] [WARN ] [MAIN      ] BIPI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:35:09.505350] [INFO ] [LOCAL     ] BIPI: Starting deletion of primary data.
[2025-10-24T17:35:09.505425] [DEBUG] [LOCAL     ] BIPI: No primary data file found to delete.
[2025-10-24T17:35:09.505485] [INFO ] [LOCAL     ] BIPI: Starting deletion of derivative data.
[2025-10-24T17:35:09.505659] [DEBUG] [LOCAL     ] BIPI: Deleted derivative data file.
[2025-10-24T17:35:09.505748] [INFO ] [MAIN      ] Update Progress: 283/2366 symbols completed. BIPI took 26.3s. Estimated remaining: 4h 18m 26s. Rate: 8.1 symbols/min
[2025-10-24T17:35:09.675085] [INFO ] [MAIN      ] BKD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:35:09.723499] [DEBUG] [LOCAL     ] BKD: Loaded 50716 existing records from primary storage.
[2025-10-24T17:35:09.723844] [INFO ] [MAIN      ] BKD: Loaded 50716 existing records.
[2025-10-24T17:35:09.753995] [INFO ] [REMOTE    ] BJ: Fetching primary data for 2025-01.
[2025-10-24T17:35:09.912543] [WARN ] [MAIN      ] BKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:35:09.912922] [INFO ] [MAIN      ] BKD: Wiping existing primary data before full refresh.
[2025-10-24T17:35:09.913001] [INFO ] [LOCAL     ] BKD: Starting deletion of primary data.
[2025-10-24T17:35:09.913378] [DEBUG] [LOCAL     ] BKD: Deleted primary data file.
[2025-10-24T17:35:09.913440] [INFO ] [MAIN      ] BKD: Starting full primary refresh.
[2025-10-24T17:35:10.234923] [INFO ] [REMOTE    ] BIRK: Incremental fetch complete for 2025-08 (2.08 seconds).
[2025-10-24T17:35:10.325123] [INFO ] [REMOTE    ] BKD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:35:10.547711] [INFO ] [REMOTE    ] BK: Fetching primary data for 2025-01.
[2025-10-24T17:35:11.347713] [INFO ] [REMOTE    ] BKD: Fetching primary data for 2025-01.
[2025-10-24T17:35:11.572719] [INFO ] [REMOTE    ] BJ: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T17:35:12.147682] [INFO ] [REMOTE    ] BJ: Fetching primary data for 2025-02.
[2025-10-24T17:35:12.365325] [INFO ] [REMOTE    ] BK: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T17:35:12.947699] [INFO ] [REMOTE    ] BK: Fetching primary data for 2025-02.
[2025-10-24T17:35:13.037776] [INFO ] [REMOTE    ] BKD: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T17:35:13.513817] [INFO ] [REMOTE    ] BJ: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T17:35:13.747684] [INFO ] [REMOTE    ] BJ: Fetching primary data for 2025-03.
[2025-10-24T17:35:14.428014] [INFO ] [REMOTE    ] BK: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T17:35:14.547608] [INFO ] [REMOTE    ] BK: Fetching primary data for 2025-03.
[2025-10-24T17:35:15.082638] [INFO ] [REMOTE    ] BJ: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T17:35:15.347637] [INFO ] [REMOTE    ] BJ: Fetching primary data for 2025-04.
[2025-10-24T17:35:16.147621] [INFO ] [REMOTE    ] BIRK: Fetching primary data for 2025-09.
[2025-10-24T17:35:16.372633] [INFO ] [REMOTE    ] BK: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T17:35:16.947705] [INFO ] [REMOTE    ] BKD: Fetching primary data for 2025-02.
[2025-10-24T17:35:17.121779] [INFO ] [REMOTE    ] BJ: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T17:35:17.550037] [INFO ] [REMOTE    ] BIRK: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T17:35:17.747672] [INFO ] [REMOTE    ] BIRK: Fetching primary data for 2025-10.
[2025-10-24T17:35:18.237194] [INFO ] [REMOTE    ] BKD: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T17:35:18.547723] [INFO ] [REMOTE    ] BK: Fetching primary data for 2025-04.
[2025-10-24T17:35:19.347671] [INFO ] [REMOTE    ] BKD: Fetching primary data for 2025-03.
[2025-10-24T17:35:19.931806] [INFO ] [REMOTE    ] BIRK: Incremental fetch complete for 2025-10 (2.18 seconds).
[2025-10-24T17:35:19.941577] [INFO ] [REMOTE    ] BIRK: Full fetch complete (73064 records).
[2025-10-24T17:35:19.941757] [DEBUG] [VALIDATOR ] BIRK: Validating primary data.
[2025-10-24T17:35:19.942554] [FATAL] [VALIDATOR ] BIRK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:35:19.942697] [FATAL] [MAIN      ] BIRK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:35:19.942751] [WARN ] [MAIN      ] BIRK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:35:19.942797] [INFO ] [LOCAL     ] BIRK: Starting deletion of primary data.
[2025-10-24T17:35:19.942857] [DEBUG] [LOCAL     ] BIRK: No primary data file found to delete.
[2025-10-24T17:35:19.942892] [INFO ] [LOCAL     ] BIRK: Starting deletion of derivative data.
[2025-10-24T17:35:19.943051] [DEBUG] [LOCAL     ] BIRK: Deleted derivative data file.
[2025-10-24T17:35:19.943807] [INFO ] [MAIN      ] Update Progress: 284/2366 symbols completed. BIRK took 36.7s. Estimated remaining: 4h 18m 40s. Rate: 8.0 symbols/min
[2025-10-24T17:35:20.116450] [INFO ] [MAIN      ] BKE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:35:20.150482] [INFO ] [REMOTE    ] BJ: Fetching primary data for 2025-05.
[2025-10-24T17:35:20.152360] [DEBUG] [LOCAL     ] BKE: Loaded 33794 existing records from primary storage.
[2025-10-24T17:35:20.152603] [INFO ] [MAIN      ] BKE: Loaded 33794 existing records.
[2025-10-24T17:35:20.348062] [WARN ] [MAIN      ] BKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:35:20.348343] [INFO ] [MAIN      ] BKE: Wiping existing primary data before full refresh.
[2025-10-24T17:35:20.348401] [INFO ] [LOCAL     ] BKE: Starting deletion of primary data.
[2025-10-24T17:35:20.348723] [DEBUG] [LOCAL     ] BKE: Deleted primary data file.
[2025-10-24T17:35:20.348780] [INFO ] [MAIN      ] BKE: Starting full primary refresh.
[2025-10-24T17:35:20.743951] [INFO ] [REMOTE    ] BK: Incremental fetch complete for 2025-04 (2.20 seconds).
[2025-10-24T17:35:20.772268] [INFO ] [REMOTE    ] BKE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:35:20.854866] [INFO ] [REMOTE    ] BKD: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T17:35:20.947761] [INFO ] [REMOTE    ] BKE: Fetching primary data for 2025-01.
[2025-10-24T17:35:21.747628] [INFO ] [REMOTE    ] BKD: Fetching primary data for 2025-04.
[2025-10-24T17:35:22.150628] [INFO ] [REMOTE    ] BJ: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T17:35:22.552759] [INFO ] [REMOTE    ] BK: Fetching primary data for 2025-05.
[2025-10-24T17:35:22.567497] [INFO ] [REMOTE    ] BKE: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T17:35:23.352801] [INFO ] [REMOTE    ] BJ: Fetching primary data for 2025-06.
[2025-10-24T17:35:23.360605] [INFO ] [REMOTE    ] BKD: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T17:35:24.147713] [INFO ] [REMOTE    ] BKD: Fetching primary data for 2025-05.
[2025-10-24T17:35:24.503078] [INFO ] [REMOTE    ] BK: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T17:35:24.609174] [INFO ] [REMOTE    ] BJ: Incremental fetch complete for 2025-06 (1.26 seconds).
[2025-10-24T17:35:24.947674] [INFO ] [REMOTE    ] BK: Fetching primary data for 2025-06.
[2025-10-24T17:35:25.574037] [INFO ] [REMOTE    ] BKD: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T17:35:25.747699] [INFO ] [REMOTE    ] BJ: Fetching primary data for 2025-07.
[2025-10-24T17:35:25.838077] [DEBUG] [REMOTE    ] BJ: Error fetching primary data for 2025-07: 'API call returned an empty response.'
[2025-10-24T17:35:25.838262] [WARN ] [REMOTE    ] BJ: No data returned for month 2025-07
[2025-10-24T17:35:25.838345] [FATAL] [REMOTE    ] BJ: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:35:25.838412] [FATAL] [MAIN      ] BJ: Failed to fetch primary data.
[2025-10-24T17:35:25.838448] [WARN ] [MAIN      ] BJ: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:35:25.838518] [INFO ] [LOCAL     ] BJ: Starting deletion of primary data.
[2025-10-24T17:35:25.838588] [DEBUG] [LOCAL     ] BJ: No primary data file found to delete.
[2025-10-24T17:35:25.838633] [INFO ] [LOCAL     ] BJ: Starting deletion of derivative data.
[2025-10-24T17:35:25.838827] [DEBUG] [LOCAL     ] BJ: Deleted derivative data file.
[2025-10-24T17:35:25.838905] [INFO ] [MAIN      ] Update Progress: 285/2366 symbols completed. BJ took 18.7s. Estimated remaining: 4h 18m 21s. Rate: 8.1 symbols/min
[2025-10-24T17:35:26.005058] [INFO ] [MAIN      ] BKH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:35:26.040038] [DEBUG] [LOCAL     ] BKH: Loaded 37650 existing records from primary storage.
[2025-10-24T17:35:26.040300] [INFO ] [MAIN      ] BKH: Loaded 37650 existing records.
[2025-10-24T17:35:26.220538] [WARN ] [MAIN      ] BKH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:35:26.220755] [INFO ] [MAIN      ] BKH: Wiping existing primary data before full refresh.
[2025-10-24T17:35:26.220822] [INFO ] [LOCAL     ] BKH: Starting deletion of primary data.
[2025-10-24T17:35:26.221178] [DEBUG] [LOCAL     ] BKH: Deleted primary data file.
[2025-10-24T17:35:26.221235] [INFO ] [MAIN      ] BKH: Starting full primary refresh.
[2025-10-24T17:35:26.558454] [INFO ] [REMOTE    ] BKD: Fetching primary data for 2025-06.
[2025-10-24T17:35:26.602398] [INFO ] [REMOTE    ] BKH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:35:26.631033] [INFO ] [REMOTE    ] BK: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T17:35:27.347679] [INFO ] [REMOTE    ] BKH: Fetching primary data for 2025-01.
[2025-10-24T17:35:27.827144] [INFO ] [REMOTE    ] BKD: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T17:35:28.147699] [INFO ] [REMOTE    ] BKD: Fetching primary data for 2025-07.
[2025-10-24T17:35:28.732559] [INFO ] [REMOTE    ] BKH: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T17:35:28.947746] [INFO ] [REMOTE    ] BKE: Fetching primary data for 2025-02.
[2025-10-24T17:35:29.664757] [INFO ] [REMOTE    ] BKD: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T17:35:29.747705] [INFO ] [REMOTE    ] BKD: Fetching primary data for 2025-08.
[2025-10-24T17:35:30.354493] [INFO ] [REMOTE    ] BKE: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T17:35:30.547636] [INFO ] [REMOTE    ] BKE: Fetching primary data for 2025-03.
[2025-10-24T17:35:31.348024] [INFO ] [REMOTE    ] BK: Fetching primary data for 2025-07.
[2025-10-24T17:35:31.350547] [INFO ] [REMOTE    ] BKD: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T17:35:31.962145] [INFO ] [REMOTE    ] BKE: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T17:35:32.147674] [INFO ] [REMOTE    ] BKE: Fetching primary data for 2025-04.
[2025-10-24T17:35:32.947665] [INFO ] [REMOTE    ] BKD: Fetching primary data for 2025-09.
[2025-10-24T17:35:33.105518] [INFO ] [REMOTE    ] BK: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T17:35:33.192512] [INFO ] [REMOTE    ] BKE: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T17:35:33.747665] [INFO ] [REMOTE    ] BKH: Fetching primary data for 2025-02.
[2025-10-24T17:35:34.547718] [INFO ] [REMOTE    ] BKE: Fetching primary data for 2025-05.
[2025-10-24T17:35:34.721044] [INFO ] [REMOTE    ] BKD: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T17:35:35.196337] [INFO ] [REMOTE    ] BKH: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T17:35:35.347617] [INFO ] [REMOTE    ] BKD: Fetching primary data for 2025-10.
[2025-10-24T17:35:35.414432] [INFO ] [REMOTE    ] BKE: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T17:35:36.147707] [INFO ] [REMOTE    ] BK: Fetching primary data for 2025-08.
[2025-10-24T17:35:36.947620] [INFO ] [REMOTE    ] BKE: Fetching primary data for 2025-06.
[2025-10-24T17:35:37.136916] [INFO ] [REMOTE    ] BKD: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T17:35:37.146008] [INFO ] [REMOTE    ] BKD: Full fetch complete (72046 records).
[2025-10-24T17:35:37.146177] [DEBUG] [VALIDATOR ] BKD: Validating primary data.
[2025-10-24T17:35:37.534935] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present.
[2025-10-24T17:35:37.535012] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed.
[2025-10-24T17:35:37.535809] [INFO ] [MAIN      ] BKD: Fetched primary data is valid.
[2025-10-24T17:35:37.535878] [DEBUG] [LOCAL     ] BKD: Saving primary data.
[2025-10-24T17:35:37.536462] [FATAL] [LOCAL     ] BKD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:35:37.536556] [FATAL] [MAIN      ] BKD: Failed to save primary data.
[2025-10-24T17:35:37.536598] [WARN ] [MAIN      ] BKD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:35:37.536632] [INFO ] [LOCAL     ] BKD: Starting deletion of primary data.
[2025-10-24T17:35:37.536763] [DEBUG] [LOCAL     ] BKD: No primary data file found to delete.
[2025-10-24T17:35:37.536808] [INFO ] [LOCAL     ] BKD: Starting deletion of derivative data.
[2025-10-24T17:35:37.536937] [DEBUG] [LOCAL     ] BKD: Deleted derivative data file.
[2025-10-24T17:35:37.537549] [INFO ] [MAIN      ] Update Progress: 286/2366 symbols completed. BKD took 28.0s. Estimated remaining: 4h 18m 45s. Rate: 8.0 symbols/min
[2025-10-24T17:35:37.712112] [INFO ] [MAIN      ] BKKT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:35:37.751056] [INFO ] [REMOTE    ] BKH: Fetching primary data for 2025-03.
[2025-10-24T17:35:37.766931] [INFO ] [REMOTE    ] BK: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T17:35:37.793102] [DEBUG] [LOCAL     ] BKKT: Loaded 37753 existing records from primary storage.
[2025-10-24T17:35:37.793393] [INFO ] [MAIN      ] BKKT: Loaded 37753 existing records.
[2025-10-24T17:35:37.965945] [WARN ] [MAIN      ] BKKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:35:37.966137] [INFO ] [MAIN      ] BKKT: Wiping existing primary data before full refresh.
[2025-10-24T17:35:37.966183] [INFO ] [LOCAL     ] BKKT: Starting deletion of primary data.
[2025-10-24T17:35:37.966574] [DEBUG] [LOCAL     ] BKKT: Deleted primary data file.
[2025-10-24T17:35:37.966690] [INFO ] [MAIN      ] BKKT: Starting full primary refresh.
[2025-10-24T17:35:38.276579] [INFO ] [REMOTE    ] BKE: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T17:35:38.342929] [INFO ] [REMOTE    ] BKKT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:35:38.547627] [INFO ] [REMOTE    ] BKKT: Fetching primary data for 2025-01.
[2025-10-24T17:35:39.347618] [INFO ] [REMOTE    ] BKE: Fetching primary data for 2025-07.
[2025-10-24T17:35:39.508977] [INFO ] [REMOTE    ] BKH: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T17:35:39.936857] [INFO ] [REMOTE    ] BKKT: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T17:35:40.147702] [INFO ] [REMOTE    ] BKH: Fetching primary data for 2025-04.
[2025-10-24T17:35:40.621896] [INFO ] [REMOTE    ] BKE: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T17:35:40.947677] [INFO ] [REMOTE    ] BKE: Fetching primary data for 2025-08.
[2025-10-24T17:35:41.626359] [INFO ] [REMOTE    ] BKH: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T17:35:41.747682] [INFO ] [REMOTE    ] BKH: Fetching primary data for 2025-05.
[2025-10-24T17:35:42.196503] [INFO ] [REMOTE    ] BKE: Incremental fetch complete for 2025-08 (1.25 seconds).
[2025-10-24T17:35:42.547762] [INFO ] [REMOTE    ] BK: Fetching primary data for 2025-09.
[2025-10-24T17:35:43.010321] [INFO ] [REMOTE    ] BKH: Incremental fetch complete for 2025-05 (1.26 seconds).
[2025-10-24T17:35:43.347726] [INFO ] [REMOTE    ] BKE: Fetching primary data for 2025-09.
[2025-10-24T17:35:44.147667] [INFO ] [REMOTE    ] BKKT: Fetching primary data for 2025-02.
[2025-10-24T17:35:44.244620] [INFO ] [REMOTE    ] BK: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T17:35:44.304186] [INFO ] [REMOTE    ] BKE: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T17:35:44.947669] [INFO ] [REMOTE    ] BK: Fetching primary data for 2025-10.
[2025-10-24T17:35:45.438887] [INFO ] [REMOTE    ] BKKT: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T17:35:45.747666] [INFO ] [REMOTE    ] BKKT: Fetching primary data for 2025-03.
[2025-10-24T17:35:46.547696] [INFO ] [REMOTE    ] BKH: Fetching primary data for 2025-06.
[2025-10-24T17:35:46.953713] [INFO ] [REMOTE    ] BK: Incremental fetch complete for 2025-10 (2.01 seconds).
[2025-10-24T17:35:46.964986] [INFO ] [REMOTE    ] BK: Full fetch complete (77670 records).
[2025-10-24T17:35:46.965129] [DEBUG] [VALIDATOR ] BK: Validating primary data.
[2025-10-24T17:35:47.124535] [INFO ] [REMOTE    ] BKKT: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T17:35:47.352732] [INFO ] [REMOTE    ] BKKT: Fetching primary data for 2025-04.
[2025-10-24T17:35:47.415235] [DEBUG] [VALIDATOR ] BK: All expected trading days are present.
[2025-10-24T17:35:47.415306] [DEBUG] [VALIDATOR ] BK: Primary data validation passed.
[2025-10-24T17:35:47.416129] [INFO ] [MAIN      ] BK: Fetched primary data is valid.
[2025-10-24T17:35:47.416195] [DEBUG] [LOCAL     ] BK: Saving primary data.
[2025-10-24T17:35:47.416837] [FATAL] [LOCAL     ] BK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:35:47.416925] [FATAL] [MAIN      ] BK: Failed to save primary data.
[2025-10-24T17:35:47.416990] [WARN ] [MAIN      ] BK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:35:47.417059] [INFO ] [LOCAL     ] BK: Starting deletion of primary data.
[2025-10-24T17:35:47.417119] [DEBUG] [LOCAL     ] BK: No primary data file found to delete.
[2025-10-24T17:35:47.417154] [INFO ] [LOCAL     ] BK: Starting deletion of derivative data.
[2025-10-24T17:35:47.417277] [DEBUG] [LOCAL     ] BK: Deleted derivative data file.
[2025-10-24T17:35:47.417626] [INFO ] [MAIN      ] Update Progress: 287/2366 symbols completed. BK took 39.5s. Estimated remaining: 4h 18m 55s. Rate: 8.0 symbols/min
[2025-10-24T17:35:47.589085] [INFO ] [MAIN      ] BKN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:35:47.600672] [DEBUG] [LOCAL     ] BKN: Loaded 7337 existing records from primary storage.
[2025-10-24T17:35:47.600894] [INFO ] [MAIN      ] BKN: Loaded 7337 existing records.
[2025-10-24T17:35:47.776711] [WARN ] [MAIN      ] BKN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:35:47.776921] [INFO ] [MAIN      ] BKN: Wiping existing primary data before full refresh.
[2025-10-24T17:35:47.776965] [INFO ] [LOCAL     ] BKN: Starting deletion of primary data.
[2025-10-24T17:35:47.777144] [DEBUG] [LOCAL     ] BKN: Deleted primary data file.
[2025-10-24T17:35:47.777182] [INFO ] [MAIN      ] BKN: Starting full primary refresh.
[2025-10-24T17:35:48.115794] [INFO ] [REMOTE    ] BKH: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T17:35:48.149407] [INFO ] [REMOTE    ] BKN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:35:48.149529] [INFO ] [REMOTE    ] BKE: Fetching primary data for 2025-10.
[2025-10-24T17:35:48.595297] [INFO ] [REMOTE    ] BKKT: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T17:35:48.947667] [INFO ] [REMOTE    ] BKH: Fetching primary data for 2025-07.
[2025-10-24T17:35:49.639606] [INFO ] [REMOTE    ] BKE: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T17:35:49.648257] [INFO ] [REMOTE    ] BKE: Full fetch complete (50095 records).
[2025-10-24T17:35:49.648391] [DEBUG] [VALIDATOR ] BKE: Validating primary data.
[2025-10-24T17:35:49.753040] [INFO ] [REMOTE    ] BKN: Fetching primary data for 2025-01.
[2025-10-24T17:35:50.033410] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present.
[2025-10-24T17:35:50.033497] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed.
[2025-10-24T17:35:50.034113] [INFO ] [MAIN      ] BKE: Fetched primary data is valid.
[2025-10-24T17:35:50.034176] [DEBUG] [LOCAL     ] BKE: Saving primary data.
[2025-10-24T17:35:50.034686] [FATAL] [LOCAL     ] BKE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:35:50.034775] [FATAL] [MAIN      ] BKE: Failed to save primary data.
[2025-10-24T17:35:50.034817] [WARN ] [MAIN      ] BKE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:35:50.034851] [INFO ] [LOCAL     ] BKE: Starting deletion of primary data.
[2025-10-24T17:35:50.034903] [DEBUG] [LOCAL     ] BKE: No primary data file found to delete.
[2025-10-24T17:35:50.034937] [INFO ] [LOCAL     ] BKE: Starting deletion of derivative data.
[2025-10-24T17:35:50.035053] [DEBUG] [LOCAL     ] BKE: Deleted derivative data file.
[2025-10-24T17:35:50.035276] [INFO ] [MAIN      ] Update Progress: 288/2366 symbols completed. BKE took 30.1s. Estimated remaining: 4h 18m 12s. Rate: 8.0 symbols/min
[2025-10-24T17:35:50.205398] [INFO ] [MAIN      ] BKSY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:35:50.253591] [DEBUG] [LOCAL     ] BKSY: Loaded 49291 existing records from primary storage.
[2025-10-24T17:35:50.253962] [INFO ] [MAIN      ] BKSY: Loaded 49291 existing records.
[2025-10-24T17:35:50.441041] [WARN ] [MAIN      ] BKSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:35:50.441281] [INFO ] [MAIN      ] BKSY: Wiping existing primary data before full refresh.
[2025-10-24T17:35:50.441426] [INFO ] [LOCAL     ] BKSY: Starting deletion of primary data.
[2025-10-24T17:35:50.442233] [DEBUG] [LOCAL     ] BKSY: Deleted primary data file.
[2025-10-24T17:35:50.442292] [INFO ] [MAIN      ] BKSY: Starting full primary refresh.
[2025-10-24T17:35:50.547611] [INFO ] [REMOTE    ] BKKT: Fetching primary data for 2025-05.
[2025-10-24T17:35:50.671712] [INFO ] [REMOTE    ] BKN: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T17:35:50.811420] [INFO ] [REMOTE    ] BKH: Incremental fetch complete for 2025-07 (1.86 seconds).
[2025-10-24T17:35:50.874591] [INFO ] [REMOTE    ] BKSY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:35:51.347748] [INFO ] [REMOTE    ] BKSY: Fetching primary data for 2025-01.
[2025-10-24T17:35:51.674391] [INFO ] [REMOTE    ] BKKT: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T17:35:52.147676] [INFO ] [REMOTE    ] BKN: Fetching primary data for 2025-02.
[2025-10-24T17:35:52.771457] [INFO ] [REMOTE    ] BKN: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T17:35:52.947708] [INFO ] [REMOTE    ] BKN: Fetching primary data for 2025-03.
[2025-10-24T17:35:53.057425] [INFO ] [REMOTE    ] BKSY: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T17:35:53.376988] [INFO ] [REMOTE    ] BKN: Incremental fetch complete for 2025-03 (0.43 seconds).
[2025-10-24T17:35:53.747673] [INFO ] [REMOTE    ] BKN: Fetching primary data for 2025-04.
[2025-10-24T17:35:54.488475] [INFO ] [REMOTE    ] BKN: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T17:35:54.547738] [INFO ] [REMOTE    ] BKH: Fetching primary data for 2025-08.
[2025-10-24T17:35:55.347835] [INFO ] [REMOTE    ] BKN: Fetching primary data for 2025-05.
[2025-10-24T17:35:56.083680] [INFO ] [REMOTE    ] BKN: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T17:35:56.131240] [INFO ] [REMOTE    ] BKH: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T17:35:56.147669] [INFO ] [REMOTE    ] BKH: Fetching primary data for 2025-09.
[2025-10-24T17:35:56.947685] [INFO ] [REMOTE    ] BKKT: Fetching primary data for 2025-06.
[2025-10-24T17:35:57.428265] [INFO ] [REMOTE    ] BKH: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T17:35:57.747613] [INFO ] [REMOTE    ] BKN: Fetching primary data for 2025-06.
[2025-10-24T17:35:57.843893] [INFO ] [REMOTE    ] BKKT: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T17:35:58.447166] [INFO ] [REMOTE    ] BKN: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T17:35:58.547678] [INFO ] [REMOTE    ] BKN: Fetching primary data for 2025-07.
[2025-10-24T17:35:59.287892] [INFO ] [REMOTE    ] BKN: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T17:35:59.347669] [INFO ] [REMOTE    ] BKH: Fetching primary data for 2025-10.
[2025-10-24T17:36:00.147696] [INFO ] [REMOTE    ] BKSY: Fetching primary data for 2025-02.
[2025-10-24T17:36:00.947683] [INFO ] [REMOTE    ] BKN: Fetching primary data for 2025-08.
[2025-10-24T17:36:01.573496] [INFO ] [REMOTE    ] BKH: Incremental fetch complete for 2025-10 (2.23 seconds).
[2025-10-24T17:36:01.582812] [INFO ] [REMOTE    ] BKH: Full fetch complete (53302 records).
[2025-10-24T17:36:01.583024] [DEBUG] [VALIDATOR ] BKH: Validating primary data.
[2025-10-24T17:36:01.782078] [INFO ] [REMOTE    ] BKKT: Fetching primary data for 2025-07.
[2025-10-24T17:36:02.017247] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present.
[2025-10-24T17:36:02.017391] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed.
[2025-10-24T17:36:02.018218] [INFO ] [MAIN      ] BKH: Fetched primary data is valid.
[2025-10-24T17:36:02.018285] [DEBUG] [LOCAL     ] BKH: Saving primary data.
[2025-10-24T17:36:02.019025] [FATAL] [LOCAL     ] BKH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:36:02.019122] [FATAL] [MAIN      ] BKH: Failed to save primary data.
[2025-10-24T17:36:02.019165] [WARN ] [MAIN      ] BKH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:36:02.019200] [INFO ] [LOCAL     ] BKH: Starting deletion of primary data.
[2025-10-24T17:36:02.019261] [DEBUG] [LOCAL     ] BKH: No primary data file found to delete.
[2025-10-24T17:36:02.019297] [INFO ] [LOCAL     ] BKH: Starting deletion of derivative data.
[2025-10-24T17:36:02.019479] [DEBUG] [LOCAL     ] BKH: Deleted derivative data file.
[2025-10-24T17:36:02.019589] [INFO ] [MAIN      ] Update Progress: 289/2366 symbols completed. BKH took 36.2s. Estimated remaining: 4h 18m 37s. Rate: 8.0 symbols/min
[2025-10-24T17:36:02.229728] [INFO ] [MAIN      ] BKT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:36:02.243379] [DEBUG] [LOCAL     ] BKT: Loaded 12907 existing records from primary storage.
[2025-10-24T17:36:02.243603] [INFO ] [MAIN      ] BKT: Loaded 12907 existing records.
[2025-10-24T17:36:02.428324] [WARN ] [MAIN      ] BKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:36:02.428610] [INFO ] [MAIN      ] BKT: Wiping existing primary data before full refresh.
[2025-10-24T17:36:02.428856] [INFO ] [LOCAL     ] BKT: Starting deletion of primary data.
[2025-10-24T17:36:02.429180] [DEBUG] [LOCAL     ] BKT: Deleted primary data file.
[2025-10-24T17:36:02.429223] [INFO ] [MAIN      ] BKT: Starting full primary refresh.
[2025-10-24T17:36:02.828278] [INFO ] [REMOTE    ] BKT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:36:02.830415] [INFO ] [REMOTE    ] BKSY: Incremental fetch complete for 2025-02 (2.68 seconds).
[2025-10-24T17:36:02.829031] [INFO ] [REMOTE    ] BKT: Fetching primary data for 2025-01.
[2025-10-24T17:36:02.937625] [INFO ] [REMOTE    ] BKN: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T17:36:03.347674] [INFO ] [REMOTE    ] BKN: Fetching primary data for 2025-09.
[2025-10-24T17:36:04.147704] [INFO ] [REMOTE    ] BKSY: Fetching primary data for 2025-03.
[2025-10-24T17:36:04.309290] [INFO ] [REMOTE    ] BKN: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T17:36:04.947685] [INFO ] [REMOTE    ] BKN: Fetching primary data for 2025-10.
[2025-10-24T17:36:05.000521] [INFO ] [REMOTE    ] BKT: Incremental fetch complete for 2025-01 (2.17 seconds).
[2025-10-24T17:36:05.701459] [INFO ] [REMOTE    ] BKKT: Incremental fetch complete for 2025-07 (3.92 seconds).
[2025-10-24T17:36:05.747686] [INFO ] [REMOTE    ] BKKT: Fetching primary data for 2025-08.
[2025-10-24T17:36:06.343955] [INFO ] [REMOTE    ] BKSY: Incremental fetch complete for 2025-03 (2.20 seconds).
[2025-10-24T17:36:06.547719] [INFO ] [REMOTE    ] BKSY: Fetching primary data for 2025-04.
[2025-10-24T17:36:06.988840] [INFO ] [REMOTE    ] BKN: Incremental fetch complete for 2025-10 (2.04 seconds).
[2025-10-24T17:36:06.990443] [INFO ] [REMOTE    ] BKN: Full fetch complete (11046 records).
[2025-10-24T17:36:06.990515] [DEBUG] [VALIDATOR ] BKN: Validating primary data.
[2025-10-24T17:36:07.350057] [INFO ] [REMOTE    ] BKT: Fetching primary data for 2025-02.
[2025-10-24T17:36:07.350387] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present.
[2025-10-24T17:36:07.351037] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed.
[2025-10-24T17:36:07.351341] [INFO ] [MAIN      ] BKN: Fetched primary data is valid.
[2025-10-24T17:36:07.351384] [DEBUG] [LOCAL     ] BKN: Saving primary data.
[2025-10-24T17:36:07.351617] [FATAL] [LOCAL     ] BKN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:36:07.351740] [FATAL] [MAIN      ] BKN: Failed to save primary data.
[2025-10-24T17:36:07.351909] [WARN ] [MAIN      ] BKN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:36:07.351983] [INFO ] [LOCAL     ] BKN: Starting deletion of primary data.
[2025-10-24T17:36:07.352044] [DEBUG] [LOCAL     ] BKN: No primary data file found to delete.
[2025-10-24T17:36:07.352081] [INFO ] [LOCAL     ] BKN: Starting deletion of derivative data.
[2025-10-24T17:36:07.352208] [DEBUG] [LOCAL     ] BKN: Deleted derivative data file.
[2025-10-24T17:36:07.352278] [INFO ] [MAIN      ] Update Progress: 290/2366 symbols completed. BKN took 19.9s. Estimated remaining: 4h 18m 15s. Rate: 8.0 symbols/min
[2025-10-24T17:36:07.525549] [INFO ] [MAIN      ] BKU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:36:07.563747] [DEBUG] [LOCAL     ] BKU: Loaded 42479 existing records from primary storage.
[2025-10-24T17:36:07.564020] [INFO ] [MAIN      ] BKU: Loaded 42479 existing records.
[2025-10-24T17:36:07.760751] [WARN ] [MAIN      ] BKU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:36:07.760955] [INFO ] [MAIN      ] BKU: Wiping existing primary data before full refresh.
[2025-10-24T17:36:07.761002] [INFO ] [LOCAL     ] BKU: Starting deletion of primary data.
[2025-10-24T17:36:07.761829] [DEBUG] [LOCAL     ] BKU: Deleted primary data file.
[2025-10-24T17:36:07.761887] [INFO ] [MAIN      ] BKU: Starting full primary refresh.
[2025-10-24T17:36:08.120439] [INFO ] [REMOTE    ] BKU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:36:08.148093] [INFO ] [REMOTE    ] BKU: Fetching primary data for 2025-01.
[2025-10-24T17:36:08.148004] [INFO ] [REMOTE    ] BKKT: Incremental fetch complete for 2025-08 (2.40 seconds).
[2025-10-24T17:36:08.201201] [INFO ] [REMOTE    ] BKT: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T17:36:08.347728] [INFO ] [REMOTE    ] BKSY: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T17:36:08.947736] [INFO ] [REMOTE    ] BKKT: Fetching primary data for 2025-09.
[2025-10-24T17:36:09.747732] [INFO ] [REMOTE    ] BKSY: Fetching primary data for 2025-05.
[2025-10-24T17:36:09.855110] [INFO ] [REMOTE    ] BKU: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T17:36:10.551780] [INFO ] [REMOTE    ] BKT: Fetching primary data for 2025-03.
[2025-10-24T17:36:10.551565] [INFO ] [REMOTE    ] BKKT: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T17:36:11.347619] [INFO ] [REMOTE    ] BKU: Fetching primary data for 2025-02.
[2025-10-24T17:36:11.392000] [INFO ] [REMOTE    ] BKT: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T17:36:11.536612] [INFO ] [REMOTE    ] BKSY: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T17:36:12.147704] [INFO ] [REMOTE    ] BKSY: Fetching primary data for 2025-06.
[2025-10-24T17:36:12.806785] [INFO ] [REMOTE    ] BKU: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T17:36:12.947679] [INFO ] [REMOTE    ] BKKT: Fetching primary data for 2025-10.
[2025-10-24T17:36:13.747684] [INFO ] [REMOTE    ] BKU: Fetching primary data for 2025-03.
[2025-10-24T17:36:14.132597] [INFO ] [REMOTE    ] BKSY: Incremental fetch complete for 2025-06 (1.98 seconds).
[2025-10-24T17:36:14.547729] [INFO ] [REMOTE    ] BKT: Fetching primary data for 2025-04.
[2025-10-24T17:36:14.909200] [INFO ] [REMOTE    ] BKU: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T17:36:15.132831] [INFO ] [REMOTE    ] BKT: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T17:36:15.347622] [INFO ] [REMOTE    ] BKSY: Fetching primary data for 2025-07.
[2025-10-24T17:36:15.442516] [INFO ] [REMOTE    ] BKKT: Incremental fetch complete for 2025-10 (2.49 seconds).
[2025-10-24T17:36:15.451552] [INFO ] [REMOTE    ] BKKT: Full fetch complete (51867 records).
[2025-10-24T17:36:15.451687] [DEBUG] [VALIDATOR ] BKKT: Validating primary data.
[2025-10-24T17:36:15.452295] [FATAL] [VALIDATOR ] BKKT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:36:15.452381] [FATAL] [MAIN      ] BKKT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:36:15.452426] [WARN ] [MAIN      ] BKKT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:36:15.452493] [INFO ] [LOCAL     ] BKKT: Starting deletion of primary data.
[2025-10-24T17:36:15.452579] [DEBUG] [LOCAL     ] BKKT: No primary data file found to delete.
[2025-10-24T17:36:15.452666] [INFO ] [LOCAL     ] BKKT: Starting deletion of derivative data.
[2025-10-24T17:36:15.452849] [DEBUG] [LOCAL     ] BKKT: Deleted derivative data file.
[2025-10-24T17:36:15.453409] [INFO ] [MAIN      ] Update Progress: 291/2366 symbols completed. BKKT took 37.9s. Estimated remaining: 4h 18m 12s. Rate: 8.0 symbols/min
[2025-10-24T17:36:15.619273] [INFO ] [MAIN      ] BKV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:36:15.648683] [DEBUG] [LOCAL     ] BKV: Loaded 29546 existing records from primary storage.
[2025-10-24T17:36:15.648949] [INFO ] [MAIN      ] BKV: Loaded 29546 existing records.
[2025-10-24T17:36:15.823973] [WARN ] [MAIN      ] BKV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:36:15.824179] [INFO ] [MAIN      ] BKV: Wiping existing primary data before full refresh.
[2025-10-24T17:36:15.824225] [INFO ] [LOCAL     ] BKV: Starting deletion of primary data.
[2025-10-24T17:36:15.824762] [DEBUG] [LOCAL     ] BKV: Deleted primary data file.
[2025-10-24T17:36:15.824820] [INFO ] [MAIN      ] BKV: Starting full primary refresh.
[2025-10-24T17:36:16.153242] [INFO ] [REMOTE    ] BKU: Fetching primary data for 2025-04.
[2025-10-24T17:36:16.185229] [INFO ] [REMOTE    ] BKV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:36:16.947720] [INFO ] [REMOTE    ] BKT: Fetching primary data for 2025-05.
[2025-10-24T17:36:17.563854] [INFO ] [REMOTE    ] BKT: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T17:36:17.653748] [INFO ] [REMOTE    ] BKSY: Incremental fetch complete for 2025-07 (2.31 seconds).
[2025-10-24T17:36:17.747630] [INFO ] [REMOTE    ] BKV: Fetching primary data for 2025-01.
[2025-10-24T17:36:17.807711] [INFO ] [REMOTE    ] BKU: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T17:36:18.547730] [INFO ] [REMOTE    ] BKU: Fetching primary data for 2025-05.
[2025-10-24T17:36:19.234149] [INFO ] [REMOTE    ] BKV: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T17:36:19.347626] [INFO ] [REMOTE    ] BKSY: Fetching primary data for 2025-08.
[2025-10-24T17:36:20.147691] [INFO ] [REMOTE    ] BKV: Fetching primary data for 2025-02.
[2025-10-24T17:36:20.217545] [INFO ] [REMOTE    ] BKU: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T17:36:20.947702] [INFO ] [REMOTE    ] BKT: Fetching primary data for 2025-06.
[2025-10-24T17:36:21.211684] [INFO ] [REMOTE    ] BKSY: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T17:36:21.269841] [INFO ] [REMOTE    ] BKV: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T17:36:21.740033] [INFO ] [REMOTE    ] BKT: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T17:36:21.747592] [INFO ] [REMOTE    ] BKT: Fetching primary data for 2025-07.
[2025-10-24T17:36:22.512907] [INFO ] [REMOTE    ] BKT: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T17:36:22.547605] [INFO ] [REMOTE    ] BKT: Fetching primary data for 2025-08.
[2025-10-24T17:36:23.347738] [INFO ] [REMOTE    ] BKV: Fetching primary data for 2025-03.
[2025-10-24T17:36:23.366398] [INFO ] [REMOTE    ] BKT: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T17:36:24.147694] [INFO ] [REMOTE    ] BKSY: Fetching primary data for 2025-09.
[2025-10-24T17:36:24.785359] [INFO ] [REMOTE    ] BKV: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T17:36:24.947638] [INFO ] [REMOTE    ] BKV: Fetching primary data for 2025-04.
[2025-10-24T17:36:25.747622] [INFO ] [REMOTE    ] BKT: Fetching primary data for 2025-09.
[2025-10-24T17:36:25.967579] [INFO ] [REMOTE    ] BKSY: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T17:36:26.224461] [INFO ] [REMOTE    ] BKV: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T17:36:26.427621] [INFO ] [REMOTE    ] BKT: Incremental fetch complete for 2025-09 (0.68 seconds).
[2025-10-24T17:36:26.547634] [INFO ] [REMOTE    ] BKSY: Fetching primary data for 2025-10.
[2025-10-24T17:36:27.347703] [INFO ] [REMOTE    ] BKT: Fetching primary data for 2025-10.
[2025-10-24T17:36:28.147728] [INFO ] [REMOTE    ] BKV: Fetching primary data for 2025-05.
[2025-10-24T17:36:28.161975] [INFO ] [REMOTE    ] BKT: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T17:36:28.166129] [INFO ] [REMOTE    ] BKT: Full fetch complete (16689 records).
[2025-10-24T17:36:28.166204] [DEBUG] [VALIDATOR ] BKT: Validating primary data.
[2025-10-24T17:36:28.166603] [FATAL] [VALIDATOR ] BKT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:36:28.166705] [FATAL] [MAIN      ] BKT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:36:28.166776] [WARN ] [MAIN      ] BKT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:36:28.166848] [INFO ] [LOCAL     ] BKT: Starting deletion of primary data.
[2025-10-24T17:36:28.166912] [DEBUG] [LOCAL     ] BKT: No primary data file found to delete.
[2025-10-24T17:36:28.166949] [INFO ] [LOCAL     ] BKT: Starting deletion of derivative data.
[2025-10-24T17:36:28.167114] [DEBUG] [LOCAL     ] BKT: Deleted derivative data file.
[2025-10-24T17:36:28.167202] [INFO ] [MAIN      ] Update Progress: 292/2366 symbols completed. BKT took 26.1s. Estimated remaining: 4h 18m 41s. Rate: 8.0 symbols/min
[2025-10-24T17:36:28.345686] [INFO ] [MAIN      ] BLCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:36:28.381127] [DEBUG] [LOCAL     ] BLCO: Loaded 35092 existing records from primary storage.
[2025-10-24T17:36:28.381402] [INFO ] [MAIN      ] BLCO: Loaded 35092 existing records.
[2025-10-24T17:36:28.558477] [WARN ] [MAIN      ] BLCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:36:28.558753] [INFO ] [MAIN      ] BLCO: Wiping existing primary data before full refresh.
[2025-10-24T17:36:28.558806] [INFO ] [LOCAL     ] BLCO: Starting deletion of primary data.
[2025-10-24T17:36:28.559382] [DEBUG] [LOCAL     ] BLCO: Deleted primary data file.
[2025-10-24T17:36:28.559439] [INFO ] [MAIN      ] BLCO: Starting full primary refresh.
[2025-10-24T17:36:28.936386] [INFO ] [REMOTE    ] BLCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:36:28.947620] [INFO ] [REMOTE    ] BLCO: Fetching primary data for 2025-01.
[2025-10-24T17:36:29.089154] [INFO ] [REMOTE    ] BKSY: Incremental fetch complete for 2025-10 (2.54 seconds).
[2025-10-24T17:36:29.099721] [INFO ] [REMOTE    ] BKSY: Full fetch complete (70687 records).
[2025-10-24T17:36:29.099880] [DEBUG] [VALIDATOR ] BKSY: Validating primary data.
[2025-10-24T17:36:29.509593] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present.
[2025-10-24T17:36:29.509801] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed.
[2025-10-24T17:36:29.510602] [INFO ] [MAIN      ] BKSY: Fetched primary data is valid.
[2025-10-24T17:36:29.510819] [DEBUG] [LOCAL     ] BKSY: Saving primary data.
[2025-10-24T17:36:29.511538] [FATAL] [LOCAL     ] BKSY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:36:29.511629] [FATAL] [MAIN      ] BKSY: Failed to save primary data.
[2025-10-24T17:36:29.511709] [WARN ] [MAIN      ] BKSY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:36:29.511777] [INFO ] [LOCAL     ] BKSY: Starting deletion of primary data.
[2025-10-24T17:36:29.511839] [DEBUG] [LOCAL     ] BKSY: No primary data file found to delete.
[2025-10-24T17:36:29.511874] [INFO ] [LOCAL     ] BKSY: Starting deletion of derivative data.
[2025-10-24T17:36:29.512011] [DEBUG] [LOCAL     ] BKSY: Deleted derivative data file.
[2025-10-24T17:36:29.512346] [INFO ] [MAIN      ] Update Progress: 293/2366 symbols completed. BKSY took 39.5s. Estimated remaining: 4h 17m 50s. Rate: 8.0 symbols/min
[2025-10-24T17:36:29.635521] [INFO ] [REMOTE    ] BKV: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T17:36:29.726803] [INFO ] [MAIN      ] BLD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:36:29.755623] [INFO ] [REMOTE    ] BKV: Fetching primary data for 2025-06.
[2025-10-24T17:36:29.758927] [DEBUG] [LOCAL     ] BLD: Loaded 27205 existing records from primary storage.
[2025-10-24T17:36:29.759161] [INFO ] [MAIN      ] BLD: Loaded 27205 existing records.
[2025-10-24T17:36:29.954924] [WARN ] [MAIN      ] BLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:36:29.955204] [INFO ] [MAIN      ] BLD: Wiping existing primary data before full refresh.
[2025-10-24T17:36:29.955255] [INFO ] [LOCAL     ] BLD: Starting deletion of primary data.
[2025-10-24T17:36:29.955818] [DEBUG] [LOCAL     ] BLD: Deleted primary data file.
[2025-10-24T17:36:29.955877] [INFO ] [MAIN      ] BLD: Starting full primary refresh.
[2025-10-24T17:36:30.310990] [INFO ] [REMOTE    ] BLCO: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T17:36:30.347286] [INFO ] [REMOTE    ] BLD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:36:30.547637] [INFO ] [REMOTE    ] BLD: Fetching primary data for 2025-01.
[2025-10-24T17:36:31.038872] [INFO ] [REMOTE    ] BKV: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T17:36:31.347616] [INFO ] [REMOTE    ] BKV: Fetching primary data for 2025-07.
[2025-10-24T17:36:31.942776] [INFO ] [REMOTE    ] BLD: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T17:36:32.147721] [INFO ] [REMOTE    ] BLD: Fetching primary data for 2025-02.
[2025-10-24T17:36:32.242610] [INFO ] [REMOTE    ] BKV: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T17:36:32.947705] [INFO ] [REMOTE    ] BKV: Fetching primary data for 2025-08.
[2025-10-24T17:36:33.407833] [INFO ] [REMOTE    ] BLD: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T17:36:33.747669] [INFO ] [REMOTE    ] BLD: Fetching primary data for 2025-03.
[2025-10-24T17:36:33.821077] [INFO ] [REMOTE    ] BKV: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T17:36:34.547716] [INFO ] [REMOTE    ] BLCO: Fetching primary data for 2025-02.
[2025-10-24T17:36:35.004319] [INFO ] [REMOTE    ] BLD: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T17:36:35.347748] [INFO ] [REMOTE    ] BKU: Fetching primary data for 2025-06.
[2025-10-24T17:36:35.560278] [INFO ] [REMOTE    ] BLCO: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T17:36:36.147719] [INFO ] [REMOTE    ] BLCO: Fetching primary data for 2025-03.
[2025-10-24T17:36:36.874375] [INFO ] [REMOTE    ] BKU: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T17:36:36.947675] [INFO ] [REMOTE    ] BKU: Fetching primary data for 2025-07.
[2025-10-24T17:36:37.147045] [INFO ] [REMOTE    ] BLCO: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T17:36:37.747749] [INFO ] [REMOTE    ] BLD: Fetching primary data for 2025-04.
[2025-10-24T17:36:38.006517] [INFO ] [REMOTE    ] BKU: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T17:36:38.547726] [INFO ] [REMOTE    ] BLCO: Fetching primary data for 2025-04.
[2025-10-24T17:36:38.635689] [INFO ] [REMOTE    ] BLD: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T17:36:39.347692] [INFO ] [REMOTE    ] BKU: Fetching primary data for 2025-08.
[2025-10-24T17:36:40.116951] [INFO ] [REMOTE    ] BLCO: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T17:36:40.147684] [INFO ] [REMOTE    ] BKV: Fetching primary data for 2025-09.
[2025-10-24T17:36:40.728056] [INFO ] [REMOTE    ] BKU: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T17:36:40.947622] [INFO ] [REMOTE    ] BLCO: Fetching primary data for 2025-05.
[2025-10-24T17:36:41.383246] [INFO ] [REMOTE    ] BKV: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T17:36:41.747717] [INFO ] [REMOTE    ] BLD: Fetching primary data for 2025-05.
[2025-10-24T17:36:42.503285] [INFO ] [REMOTE    ] BLCO: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T17:36:42.547722] [INFO ] [REMOTE    ] BKV: Fetching primary data for 2025-10.
[2025-10-24T17:36:43.002485] [INFO ] [REMOTE    ] BLD: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T17:36:43.347701] [INFO ] [REMOTE    ] BLD: Fetching primary data for 2025-06.
[2025-10-24T17:36:43.860911] [INFO ] [REMOTE    ] BKV: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T17:36:43.871903] [INFO ] [REMOTE    ] BKV: Full fetch complete (44834 records).
[2025-10-24T17:36:43.872197] [DEBUG] [VALIDATOR ] BKV: Validating primary data.
[2025-10-24T17:36:44.161115] [INFO ] [REMOTE    ] BKU: Fetching primary data for 2025-09.
[2025-10-24T17:36:44.315348] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present.
[2025-10-24T17:36:44.315456] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed.
[2025-10-24T17:36:44.316244] [INFO ] [MAIN      ] BKV: Fetched primary data is valid.
[2025-10-24T17:36:44.316310] [DEBUG] [LOCAL     ] BKV: Saving primary data.
[2025-10-24T17:36:44.316914] [FATAL] [LOCAL     ] BKV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:36:44.317002] [FATAL] [MAIN      ] BKV: Failed to save primary data.
[2025-10-24T17:36:44.317046] [WARN ] [MAIN      ] BKV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:36:44.317082] [INFO ] [LOCAL     ] BKV: Starting deletion of primary data.
[2025-10-24T17:36:44.317178] [DEBUG] [LOCAL     ] BKV: No primary data file found to delete.
[2025-10-24T17:36:44.317236] [INFO ] [LOCAL     ] BKV: Starting deletion of derivative data.
[2025-10-24T17:36:44.317547] [DEBUG] [LOCAL     ] BKV: Deleted derivative data file.
[2025-10-24T17:36:44.317720] [INFO ] [MAIN      ] Update Progress: 294/2366 symbols completed. BKV took 28.9s. Estimated remaining: 4h 18m 35s. Rate: 8.0 symbols/min
[2025-10-24T17:36:44.496208] [INFO ] [MAIN      ] BLDR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:36:44.496520] [DEBUG] [LOCAL     ] BLDR: No existing data file found in primary storage.
[2025-10-24T17:36:44.496691] [WARN ] [MAIN      ] BLDR: No existing data found, performing full refresh instead.
[2025-10-24T17:36:44.496803] [INFO ] [MAIN      ] BLDR: Wiping existing primary data before full refresh.
[2025-10-24T17:36:44.496844] [INFO ] [LOCAL     ] BLDR: Starting deletion of primary data.
[2025-10-24T17:36:44.496886] [DEBUG] [LOCAL     ] BLDR: No primary data file found to delete.
[2025-10-24T17:36:44.496921] [INFO ] [MAIN      ] BLDR: Starting full primary refresh.
[2025-10-24T17:36:44.828066] [INFO ] [REMOTE    ] BLD: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T17:36:44.925452] [INFO ] [REMOTE    ] BLDR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:36:44.947714] [INFO ] [REMOTE    ] BLDR: Fetching primary data for 2025-01.
[2025-10-24T17:36:45.625957] [INFO ] [REMOTE    ] BKU: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T17:36:45.747739] [INFO ] [REMOTE    ] BKU: Fetching primary data for 2025-10.
[2025-10-24T17:36:46.547683] [INFO ] [REMOTE    ] BLCO: Fetching primary data for 2025-06.
[2025-10-24T17:36:46.681536] [INFO ] [REMOTE    ] BLDR: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T17:36:47.086505] [INFO ] [REMOTE    ] BKU: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T17:36:47.095759] [INFO ] [REMOTE    ] BKU: Full fetch complete (61080 records).
[2025-10-24T17:36:47.095964] [DEBUG] [VALIDATOR ] BKU: Validating primary data.
[2025-10-24T17:36:47.358815] [INFO ] [REMOTE    ] BLDR: Fetching primary data for 2025-02.
[2025-10-24T17:36:47.506687] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present.
[2025-10-24T17:36:47.506814] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed.
[2025-10-24T17:36:47.507721] [INFO ] [MAIN      ] BKU: Fetched primary data is valid.
[2025-10-24T17:36:47.507788] [DEBUG] [LOCAL     ] BKU: Saving primary data.
[2025-10-24T17:36:47.508622] [FATAL] [LOCAL     ] BKU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:36:47.508737] [FATAL] [MAIN      ] BKU: Failed to save primary data.
[2025-10-24T17:36:47.508779] [WARN ] [MAIN      ] BKU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:36:47.508815] [INFO ] [LOCAL     ] BKU: Starting deletion of primary data.
[2025-10-24T17:36:47.508876] [DEBUG] [LOCAL     ] BKU: No primary data file found to delete.
[2025-10-24T17:36:47.508912] [INFO ] [LOCAL     ] BKU: Starting deletion of derivative data.
[2025-10-24T17:36:47.509073] [DEBUG] [LOCAL     ] BKU: Deleted derivative data file.
[2025-10-24T17:36:47.509397] [INFO ] [MAIN      ] Update Progress: 295/2366 symbols completed. BKU took 40.2s. Estimated remaining: 4h 17m 57s. Rate: 8.0 symbols/min
[2025-10-24T17:36:47.696169] [INFO ] [MAIN      ] BLE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:36:47.714283] [DEBUG] [LOCAL     ] BLE: Loaded 13680 existing records from primary storage.
[2025-10-24T17:36:47.714605] [INFO ] [MAIN      ] BLE: Loaded 13680 existing records.
[2025-10-24T17:36:47.913011] [WARN ] [MAIN      ] BLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:36:47.913533] [INFO ] [MAIN      ] BLE: Wiping existing primary data before full refresh.
[2025-10-24T17:36:47.913719] [INFO ] [LOCAL     ] BLE: Starting deletion of primary data.
[2025-10-24T17:36:47.914371] [DEBUG] [LOCAL     ] BLE: Deleted primary data file.
[2025-10-24T17:36:47.935934] [INFO ] [MAIN      ] BLE: Starting full primary refresh.
[2025-10-24T17:36:47.937512] [INFO ] [REMOTE    ] BLCO: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T17:36:48.153065] [INFO ] [REMOTE    ] BLCO: Fetching primary data for 2025-07.
[2025-10-24T17:36:48.328398] [INFO ] [REMOTE    ] BLE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:36:48.806527] [INFO ] [REMOTE    ] BLDR: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T17:36:48.947753] [INFO ] [REMOTE    ] BLE: Fetching primary data for 2025-01.
[2025-10-24T17:36:49.172827] [INFO ] [REMOTE    ] BLCO: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T17:36:49.747639] [INFO ] [REMOTE    ] BLCO: Fetching primary data for 2025-08.
[2025-10-24T17:36:49.877300] [INFO ] [REMOTE    ] BLE: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T17:36:50.547693] [INFO ] [REMOTE    ] BLE: Fetching primary data for 2025-02.
[2025-10-24T17:36:50.833476] [INFO ] [REMOTE    ] BLCO: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T17:36:51.348457] [INFO ] [REMOTE    ] BLCO: Fetching primary data for 2025-09.
[2025-10-24T17:36:51.352108] [INFO ] [REMOTE    ] BLE: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T17:36:52.147687] [INFO ] [REMOTE    ] BLD: Fetching primary data for 2025-07.
[2025-10-24T17:36:52.763904] [INFO ] [REMOTE    ] BLCO: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T17:36:52.947638] [INFO ] [REMOTE    ] BLE: Fetching primary data for 2025-03.
[2025-10-24T17:36:53.556726] [INFO ] [REMOTE    ] BLD: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T17:36:53.747710] [INFO ] [REMOTE    ] BLDR: Fetching primary data for 2025-03.
[2025-10-24T17:36:53.945367] [INFO ] [REMOTE    ] BLE: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T17:36:54.547701] [INFO ] [REMOTE    ] BLCO: Fetching primary data for 2025-10.
[2025-10-24T17:36:55.347709] [INFO ] [REMOTE    ] BLD: Fetching primary data for 2025-08.
[2025-10-24T17:36:55.558468] [INFO ] [REMOTE    ] BLDR: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T17:36:55.883915] [INFO ] [REMOTE    ] BLCO: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T17:36:55.890550] [INFO ] [REMOTE    ] BLCO: Full fetch complete (52153 records).
[2025-10-24T17:36:55.890757] [DEBUG] [VALIDATOR ] BLCO: Validating primary data.
[2025-10-24T17:36:56.152915] [INFO ] [REMOTE    ] BLDR: Fetching primary data for 2025-04.
[2025-10-24T17:36:56.339015] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present.
[2025-10-24T17:36:56.339359] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed.
[2025-10-24T17:36:56.340130] [INFO ] [MAIN      ] BLCO: Fetched primary data is valid.
[2025-10-24T17:36:56.340289] [DEBUG] [LOCAL     ] BLCO: Saving primary data.
[2025-10-24T17:36:56.340986] [FATAL] [LOCAL     ] BLCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:36:56.341139] [FATAL] [MAIN      ] BLCO: Failed to save primary data.
[2025-10-24T17:36:56.341286] [WARN ] [MAIN      ] BLCO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:36:56.341506] [INFO ] [LOCAL     ] BLCO: Starting deletion of primary data.
[2025-10-24T17:36:56.341614] [DEBUG] [LOCAL     ] BLCO: No primary data file found to delete.
[2025-10-24T17:36:56.341831] [INFO ] [LOCAL     ] BLCO: Starting deletion of derivative data.
[2025-10-24T17:36:56.342344] [DEBUG] [LOCAL     ] BLCO: Deleted derivative data file.
[2025-10-24T17:36:56.355029] [INFO ] [MAIN      ] Update Progress: 296/2366 symbols completed. BLCO took 28.2s. Estimated remaining: 4h 17m 59s. Rate: 8.0 symbols/min
[2025-10-24T17:36:56.364491] [INFO ] [REMOTE    ] BLD: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T17:36:56.633692] [INFO ] [MAIN      ] BLK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:36:56.680872] [DEBUG] [LOCAL     ] BLK: Loaded 34356 existing records from primary storage.
[2025-10-24T17:36:56.681270] [INFO ] [MAIN      ] BLK: Loaded 34356 existing records.
[2025-10-24T17:36:56.945495] [WARN ] [MAIN      ] BLK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:36:56.945792] [INFO ] [MAIN      ] BLK: Wiping existing primary data before full refresh.
[2025-10-24T17:36:56.945858] [INFO ] [LOCAL     ] BLK: Starting deletion of primary data.
[2025-10-24T17:36:56.946755] [DEBUG] [LOCAL     ] BLK: Deleted primary data file.
[2025-10-24T17:36:56.946824] [INFO ] [MAIN      ] BLK: Starting full primary refresh.
[2025-10-24T17:36:56.952914] [INFO ] [REMOTE    ] BLD: Fetching primary data for 2025-09.
[2025-10-24T17:36:57.376583] [INFO ] [REMOTE    ] BLK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:36:57.747710] [INFO ] [REMOTE    ] BLE: Fetching primary data for 2025-04.
[2025-10-24T17:36:57.908458] [INFO ] [REMOTE    ] BLDR: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T17:36:58.338490] [INFO ] [REMOTE    ] BLD: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T17:36:58.547608] [INFO ] [REMOTE    ] BLDR: Fetching primary data for 2025-05.
[2025-10-24T17:36:58.777487] [INFO ] [REMOTE    ] BLE: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T17:36:59.347741] [INFO ] [REMOTE    ] BLD: Fetching primary data for 2025-10.
[2025-10-24T17:37:00.147745] [INFO ] [REMOTE    ] BLK: Fetching primary data for 2025-01.
[2025-10-24T17:37:00.227751] [INFO ] [REMOTE    ] BLDR: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T17:37:00.527187] [INFO ] [REMOTE    ] BLD: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T17:37:00.531787] [INFO ] [REMOTE    ] BLD: Full fetch complete (39836 records).
[2025-10-24T17:37:00.531911] [DEBUG] [VALIDATOR ] BLD: Validating primary data.
[2025-10-24T17:37:00.905195] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present.
[2025-10-24T17:37:00.905284] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed.
[2025-10-24T17:37:00.905805] [INFO ] [MAIN      ] BLD: Fetched primary data is valid.
[2025-10-24T17:37:00.905868] [DEBUG] [LOCAL     ] BLD: Saving primary data.
[2025-10-24T17:37:00.906334] [FATAL] [LOCAL     ] BLD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:37:00.906427] [FATAL] [MAIN      ] BLD: Failed to save primary data.
[2025-10-24T17:37:00.906469] [WARN ] [MAIN      ] BLD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:37:00.906504] [INFO ] [LOCAL     ] BLD: Starting deletion of primary data.
[2025-10-24T17:37:00.906555] [DEBUG] [LOCAL     ] BLD: No primary data file found to delete.
[2025-10-24T17:37:00.906590] [INFO ] [LOCAL     ] BLD: Starting deletion of derivative data.
[2025-10-24T17:37:00.906753] [DEBUG] [LOCAL     ] BLD: Deleted derivative data file.
[2025-10-24T17:37:00.906847] [INFO ] [MAIN      ] Update Progress: 297/2366 symbols completed. BLD took 31.4s. Estimated remaining: 4h 17m 31s. Rate: 8.0 symbols/min
[2025-10-24T17:37:00.952759] [INFO ] [REMOTE    ] BLE: Fetching primary data for 2025-05.
[2025-10-24T17:37:01.085074] [INFO ] [MAIN      ] BLND: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:37:01.128321] [DEBUG] [LOCAL     ] BLND: Loaded 49593 existing records from primary storage.
[2025-10-24T17:37:01.128612] [INFO ] [MAIN      ] BLND: Loaded 49593 existing records.
[2025-10-24T17:37:01.303887] [WARN ] [MAIN      ] BLND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:37:01.304160] [INFO ] [MAIN      ] BLND: Wiping existing primary data before full refresh.
[2025-10-24T17:37:01.304215] [INFO ] [LOCAL     ] BLND: Starting deletion of primary data.
[2025-10-24T17:37:01.304819] [DEBUG] [LOCAL     ] BLND: Deleted primary data file.
[2025-10-24T17:37:01.304877] [INFO ] [MAIN      ] BLND: Starting full primary refresh.
[2025-10-24T17:37:01.665946] [INFO ] [REMOTE    ] BLND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:37:01.747718] [INFO ] [REMOTE    ] BLDR: Fetching primary data for 2025-06.
[2025-10-24T17:37:02.532612] [INFO ] [REMOTE    ] BLK: Incremental fetch complete for 2025-01 (2.38 seconds).
[2025-10-24T17:37:02.547598] [INFO ] [REMOTE    ] BLK: Fetching primary data for 2025-02.
[2025-10-24T17:37:03.155370] [INFO ] [REMOTE    ] BLE: Incremental fetch complete for 2025-05 (2.20 seconds).
[2025-10-24T17:37:03.347715] [INFO ] [REMOTE    ] BLE: Fetching primary data for 2025-06.
[2025-10-24T17:37:04.050244] [INFO ] [REMOTE    ] BLDR: Incremental fetch complete for 2025-06 (2.30 seconds).
[2025-10-24T17:37:04.147609] [INFO ] [REMOTE    ] BLDR: Fetching primary data for 2025-07.
[2025-10-24T17:37:04.337517] [INFO ] [REMOTE    ] BLE: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T17:37:04.363323] [INFO ] [REMOTE    ] BLK: Incremental fetch complete for 2025-02 (1.82 seconds).
[2025-10-24T17:37:04.947679] [INFO ] [REMOTE    ] BLND: Fetching primary data for 2025-01.
[2025-10-24T17:37:05.747632] [INFO ] [REMOTE    ] BLE: Fetching primary data for 2025-07.
[2025-10-24T17:37:06.265019] [INFO ] [REMOTE    ] BLDR: Incremental fetch complete for 2025-07 (2.12 seconds).
[2025-10-24T17:37:06.547623] [INFO ] [REMOTE    ] BLDR: Fetching primary data for 2025-08.
[2025-10-24T17:37:06.594833] [INFO ] [REMOTE    ] BLND: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T17:37:06.616685] [INFO ] [REMOTE    ] BLE: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T17:37:07.347638] [INFO ] [REMOTE    ] BLE: Fetching primary data for 2025-08.
[2025-10-24T17:37:08.079141] [INFO ] [REMOTE    ] BLE: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T17:37:08.147630] [INFO ] [REMOTE    ] BLND: Fetching primary data for 2025-02.
[2025-10-24T17:37:08.329497] [INFO ] [REMOTE    ] BLDR: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T17:37:08.947671] [INFO ] [REMOTE    ] BLE: Fetching primary data for 2025-09.
[2025-10-24T17:37:09.725180] [INFO ] [REMOTE    ] BLE: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T17:37:09.752901] [INFO ] [REMOTE    ] BLE: Fetching primary data for 2025-10.
[2025-10-24T17:37:09.765321] [INFO ] [REMOTE    ] BLND: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T17:37:10.547634] [INFO ] [REMOTE    ] BLND: Fetching primary data for 2025-03.
[2025-10-24T17:37:10.652074] [INFO ] [REMOTE    ] BLE: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T17:37:10.654388] [INFO ] [REMOTE    ] BLE: Full fetch complete (19421 records).
[2025-10-24T17:37:10.654464] [DEBUG] [VALIDATOR ] BLE: Validating primary data.
[2025-10-24T17:37:10.654915] [FATAL] [VALIDATOR ] BLE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:37:10.654996] [FATAL] [MAIN      ] BLE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:37:10.655039] [WARN ] [MAIN      ] BLE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:37:10.655079] [INFO ] [LOCAL     ] BLE: Starting deletion of primary data.
[2025-10-24T17:37:10.655134] [DEBUG] [LOCAL     ] BLE: No primary data file found to delete.
[2025-10-24T17:37:10.655178] [INFO ] [LOCAL     ] BLE: Starting deletion of derivative data.
[2025-10-24T17:37:10.655346] [DEBUG] [LOCAL     ] BLE: Deleted derivative data file.
[2025-10-24T17:37:10.655433] [INFO ] [MAIN      ] Update Progress: 298/2366 symbols completed. BLE took 23.1s. Estimated remaining: 4h 17m 40s. Rate: 8.0 symbols/min
[2025-10-24T17:37:10.829281] [INFO ] [MAIN      ] BLSH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:37:10.830666] [DEBUG] [LOCAL     ] BLSH: No existing data file found in primary storage.
[2025-10-24T17:37:10.830722] [WARN ] [MAIN      ] BLSH: No existing data found, performing full refresh instead.
[2025-10-24T17:37:10.830906] [INFO ] [MAIN      ] BLSH: Wiping existing primary data before full refresh.
[2025-10-24T17:37:10.830960] [INFO ] [LOCAL     ] BLSH: Starting deletion of primary data.
[2025-10-24T17:37:10.831003] [DEBUG] [LOCAL     ] BLSH: No primary data file found to delete.
[2025-10-24T17:37:10.831035] [INFO ] [MAIN      ] BLSH: Starting full primary refresh.
[2025-10-24T17:37:11.181940] [INFO ] [REMOTE    ] BLSH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:37:11.347669] [INFO ] [REMOTE    ] BLSH: Fetching primary data for 2025-01.
[2025-10-24T17:37:11.554598] [DEBUG] [REMOTE    ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:37:11.554974] [WARN ] [REMOTE    ] BLSH: No data returned for month 2025-01
[2025-10-24T17:37:11.555044] [FATAL] [REMOTE    ] BLSH: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:37:11.555084] [FATAL] [MAIN      ] BLSH: Failed to fetch primary data.
[2025-10-24T17:37:11.555117] [WARN ] [MAIN      ] BLSH: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:37:11.555182] [INFO ] [LOCAL     ] BLSH: Starting deletion of primary data.
[2025-10-24T17:37:11.555244] [DEBUG] [LOCAL     ] BLSH: No primary data file found to delete.
[2025-10-24T17:37:11.555279] [INFO ] [LOCAL     ] BLSH: Starting deletion of derivative data.
[2025-10-24T17:37:11.555317] [DEBUG] [LOCAL     ] BLSH: No derivative data file found to delete.
[2025-10-24T17:37:11.555362] [INFO ] [MAIN      ] Update Progress: 299/2366 symbols completed. BLSH took 0.9s. Estimated remaining: 4h 16m 47s. Rate: 8.0 symbols/min
[2025-10-24T17:37:11.728794] [INFO ] [MAIN      ] BLW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:37:11.743770] [DEBUG] [LOCAL     ] BLW: Loaded 13028 existing records from primary storage.
[2025-10-24T17:37:11.744008] [INFO ] [MAIN      ] BLW: Loaded 13028 existing records.
[2025-10-24T17:37:11.931506] [WARN ] [MAIN      ] BLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:37:11.931731] [INFO ] [MAIN      ] BLW: Wiping existing primary data before full refresh.
[2025-10-24T17:37:11.931870] [INFO ] [LOCAL     ] BLW: Starting deletion of primary data.
[2025-10-24T17:37:11.932411] [DEBUG] [LOCAL     ] BLW: Deleted primary data file.
[2025-10-24T17:37:11.932543] [INFO ] [MAIN      ] BLW: Starting full primary refresh.
[2025-10-24T17:37:12.068623] [INFO ] [REMOTE    ] BLND: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T17:37:12.153250] [INFO ] [REMOTE    ] BLND: Fetching primary data for 2025-04.
[2025-10-24T17:37:12.338303] [INFO ] [REMOTE    ] BLW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:37:12.947637] [INFO ] [REMOTE    ] BLK: Fetching primary data for 2025-03.
[2025-10-24T17:37:13.747623] [INFO ] [REMOTE    ] BLDR: Fetching primary data for 2025-09.
[2025-10-24T17:37:13.888746] [INFO ] [REMOTE    ] BLND: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T17:37:14.547744] [INFO ] [REMOTE    ] BLW: Fetching primary data for 2025-01.
[2025-10-24T17:37:14.916183] [INFO ] [REMOTE    ] BLK: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T17:37:15.322419] [INFO ] [REMOTE    ] BLDR: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T17:37:15.347622] [INFO ] [REMOTE    ] BLDR: Fetching primary data for 2025-10.
[2025-10-24T17:37:15.427107] [INFO ] [REMOTE    ] BLW: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T17:37:16.147723] [INFO ] [REMOTE    ] BLK: Fetching primary data for 2025-04.
[2025-10-24T17:37:16.947623] [INFO ] [REMOTE    ] BLW: Fetching primary data for 2025-02.
[2025-10-24T17:37:16.990110] [INFO ] [REMOTE    ] BLDR: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T17:37:16.999373] [INFO ] [REMOTE    ] BLDR: Full fetch complete (74432 records).
[2025-10-24T17:37:16.999578] [DEBUG] [VALIDATOR ] BLDR: Validating primary data.
[2025-10-24T17:37:17.000355] [FATAL] [VALIDATOR ] BLDR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:37:17.000445] [FATAL] [MAIN      ] BLDR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:37:17.000488] [WARN ] [MAIN      ] BLDR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:37:17.000550] [INFO ] [LOCAL     ] BLDR: Starting deletion of primary data.
[2025-10-24T17:37:17.000613] [DEBUG] [LOCAL     ] BLDR: No primary data file found to delete.
[2025-10-24T17:37:17.000677] [INFO ] [LOCAL     ] BLDR: Starting deletion of derivative data.
[2025-10-24T17:37:17.000740] [DEBUG] [LOCAL     ] BLDR: No derivative data file found to delete.
[2025-10-24T17:37:17.000986] [INFO ] [MAIN      ] Update Progress: 300/2366 symbols completed. BLDR took 32.7s. Estimated remaining: 4h 16m 26s. Rate: 8.1 symbols/min
[2025-10-24T17:37:17.190420] [INFO ] [MAIN      ] BLX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:37:17.208039] [DEBUG] [LOCAL     ] BLX: Loaded 15499 existing records from primary storage.
[2025-10-24T17:37:17.208277] [INFO ] [MAIN      ] BLX: Loaded 15499 existing records.
[2025-10-24T17:37:17.388799] [WARN ] [MAIN      ] BLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:37:17.389002] [INFO ] [MAIN      ] BLX: Wiping existing primary data before full refresh.
[2025-10-24T17:37:17.389048] [INFO ] [LOCAL     ] BLX: Starting deletion of primary data.
[2025-10-24T17:37:17.389392] [DEBUG] [LOCAL     ] BLX: Deleted primary data file.
[2025-10-24T17:37:17.389448] [INFO ] [MAIN      ] BLX: Starting full primary refresh.
[2025-10-24T17:37:17.763107] [INFO ] [REMOTE    ] BLND: Fetching primary data for 2025-05.
[2025-10-24T17:37:17.766231] [INFO ] [REMOTE    ] BLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:37:17.778749] [INFO ] [REMOTE    ] BLW: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T17:37:17.929974] [INFO ] [REMOTE    ] BLK: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T17:37:18.547674] [INFO ] [REMOTE    ] BLW: Fetching primary data for 2025-03.
[2025-10-24T17:37:19.347624] [INFO ] [REMOTE    ] BLX: Fetching primary data for 2025-01.
[2025-10-24T17:37:19.415443] [INFO ] [REMOTE    ] BLND: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T17:37:19.466066] [INFO ] [REMOTE    ] BLW: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T17:37:20.147636] [INFO ] [REMOTE    ] BLND: Fetching primary data for 2025-06.
[2025-10-24T17:37:20.420853] [INFO ] [REMOTE    ] BLX: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T17:37:20.947664] [INFO ] [REMOTE    ] BLK: Fetching primary data for 2025-05.
[2025-10-24T17:37:21.439151] [INFO ] [REMOTE    ] BLND: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T17:37:21.747684] [INFO ] [REMOTE    ] BLX: Fetching primary data for 2025-02.
[2025-10-24T17:37:22.547629] [INFO ] [REMOTE    ] BLW: Fetching primary data for 2025-04.
[2025-10-24T17:37:22.571076] [INFO ] [REMOTE    ] BLX: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T17:37:22.593944] [INFO ] [REMOTE    ] BLK: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T17:37:23.347620] [INFO ] [REMOTE    ] BLX: Fetching primary data for 2025-03.
[2025-10-24T17:37:23.579344] [INFO ] [REMOTE    ] BLW: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T17:37:24.147628] [INFO ] [REMOTE    ] BLW: Fetching primary data for 2025-05.
[2025-10-24T17:37:24.404892] [INFO ] [REMOTE    ] BLX: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T17:37:24.901084] [INFO ] [REMOTE    ] BLW: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T17:37:24.947599] [INFO ] [REMOTE    ] BLW: Fetching primary data for 2025-06.
[2025-10-24T17:37:25.747613] [INFO ] [REMOTE    ] BLX: Fetching primary data for 2025-04.
[2025-10-24T17:37:25.939025] [INFO ] [REMOTE    ] BLW: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T17:37:26.547717] [INFO ] [REMOTE    ] BLK: Fetching primary data for 2025-06.
[2025-10-24T17:37:26.744456] [INFO ] [REMOTE    ] BLX: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T17:37:27.347702] [INFO ] [REMOTE    ] BLND: Fetching primary data for 2025-07.
[2025-10-24T17:37:28.147623] [INFO ] [REMOTE    ] BLW: Fetching primary data for 2025-07.
[2025-10-24T17:37:28.211126] [INFO ] [REMOTE    ] BLK: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T17:37:28.705927] [INFO ] [REMOTE    ] BLND: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T17:37:28.748565] [INFO ] [REMOTE    ] BLW: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T17:37:28.947716] [INFO ] [REMOTE    ] BLND: Fetching primary data for 2025-08.
[2025-10-24T17:37:29.747716] [INFO ] [REMOTE    ] BLX: Fetching primary data for 2025-05.
[2025-10-24T17:37:30.547736] [INFO ] [REMOTE    ] BLW: Fetching primary data for 2025-08.
[2025-10-24T17:37:30.860801] [INFO ] [REMOTE    ] BLX: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T17:37:30.867517] [INFO ] [REMOTE    ] BLND: Incremental fetch complete for 2025-08 (1.92 seconds).
[2025-10-24T17:37:31.347626] [INFO ] [REMOTE    ] BLND: Fetching primary data for 2025-09.
[2025-10-24T17:37:31.365042] [INFO ] [REMOTE    ] BLW: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T17:37:32.147752] [INFO ] [REMOTE    ] BLW: Fetching primary data for 2025-09.
[2025-10-24T17:37:32.947717] [INFO ] [REMOTE    ] BLK: Fetching primary data for 2025-07.
[2025-10-24T17:37:33.093240] [INFO ] [REMOTE    ] BLND: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T17:37:33.094091] [INFO ] [REMOTE    ] BLW: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T17:37:33.747681] [INFO ] [REMOTE    ] BLW: Fetching primary data for 2025-10.
[2025-10-24T17:37:34.553368] [INFO ] [REMOTE    ] BLX: Fetching primary data for 2025-06.
[2025-10-24T17:37:34.568596] [INFO ] [REMOTE    ] BLK: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T17:37:34.777836] [INFO ] [REMOTE    ] BLW: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T17:37:34.781048] [INFO ] [REMOTE    ] BLW: Full fetch complete (19134 records).
[2025-10-24T17:37:34.781134] [DEBUG] [VALIDATOR ] BLW: Validating primary data.
[2025-10-24T17:37:35.148764] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present.
[2025-10-24T17:37:35.148875] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed.
[2025-10-24T17:37:35.149278] [INFO ] [MAIN      ] BLW: Fetched primary data is valid.
[2025-10-24T17:37:35.149384] [DEBUG] [LOCAL     ] BLW: Saving primary data.
[2025-10-24T17:37:35.149809] [FATAL] [LOCAL     ] BLW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:37:35.149891] [FATAL] [MAIN      ] BLW: Failed to save primary data.
[2025-10-24T17:37:35.149936] [WARN ] [MAIN      ] BLW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:37:35.149971] [INFO ] [LOCAL     ] BLW: Starting deletion of primary data.
[2025-10-24T17:37:35.150020] [DEBUG] [LOCAL     ] BLW: No primary data file found to delete.
[2025-10-24T17:37:35.150054] [INFO ] [LOCAL     ] BLW: Starting deletion of derivative data.
[2025-10-24T17:37:35.150231] [DEBUG] [LOCAL     ] BLW: Deleted derivative data file.
[2025-10-24T17:37:35.150322] [INFO ] [MAIN      ] Update Progress: 301/2366 symbols completed. BLW took 23.6s. Estimated remaining: 4h 17m 31s. Rate: 8.0 symbols/min
[2025-10-24T17:37:35.282449] [INFO ] [REMOTE    ] BLX: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T17:37:35.334712] [INFO ] [MAIN      ] BMA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:37:35.355307] [INFO ] [REMOTE    ] BLK: Fetching primary data for 2025-08.
[2025-10-24T17:37:35.371493] [DEBUG] [LOCAL     ] BMA: Loaded 36874 existing records from primary storage.
[2025-10-24T17:37:35.371820] [INFO ] [MAIN      ] BMA: Loaded 36874 existing records.
[2025-10-24T17:37:35.544090] [WARN ] [MAIN      ] BMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:37:35.544321] [INFO ] [MAIN      ] BMA: Wiping existing primary data before full refresh.
[2025-10-24T17:37:35.544368] [INFO ] [LOCAL     ] BMA: Starting deletion of primary data.
[2025-10-24T17:37:35.544979] [DEBUG] [LOCAL     ] BMA: Deleted primary data file.
[2025-10-24T17:37:35.545036] [INFO ] [MAIN      ] BMA: Starting full primary refresh.
[2025-10-24T17:37:35.890628] [INFO ] [REMOTE    ] BMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:37:36.147713] [INFO ] [REMOTE    ] BMA: Fetching primary data for 2025-01.
[2025-10-24T17:37:36.755834] [INFO ] [REMOTE    ] BLK: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T17:37:36.947693] [INFO ] [REMOTE    ] BLK: Fetching primary data for 2025-09.
[2025-10-24T17:37:37.747672] [INFO ] [REMOTE    ] BLND: Fetching primary data for 2025-10.
[2025-10-24T17:37:38.140917] [INFO ] [REMOTE    ] BMA: Incremental fetch complete for 2025-01 (1.99 seconds).
[2025-10-24T17:37:38.357960] [INFO ] [REMOTE    ] BLK: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T17:37:38.547673] [INFO ] [REMOTE    ] BLX: Fetching primary data for 2025-07.
[2025-10-24T17:37:39.347619] [INFO ] [REMOTE    ] BLK: Fetching primary data for 2025-10.
[2025-10-24T17:37:39.438919] [INFO ] [REMOTE    ] BLX: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T17:37:39.498761] [INFO ] [REMOTE    ] BLND: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T17:37:39.508607] [INFO ] [REMOTE    ] BLND: Full fetch complete (72205 records).
[2025-10-24T17:37:39.508814] [DEBUG] [VALIDATOR ] BLND: Validating primary data.
[2025-10-24T17:37:39.915743] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present.
[2025-10-24T17:37:39.915883] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed.
[2025-10-24T17:37:39.916790] [INFO ] [MAIN      ] BLND: Fetched primary data is valid.
[2025-10-24T17:37:39.916872] [DEBUG] [LOCAL     ] BLND: Saving primary data.
[2025-10-24T17:37:39.917725] [FATAL] [LOCAL     ] BLND: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:37:39.917815] [FATAL] [MAIN      ] BLND: Failed to save primary data.
[2025-10-24T17:37:39.917859] [WARN ] [MAIN      ] BLND: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:37:39.917897] [INFO ] [LOCAL     ] BLND: Starting deletion of primary data.
[2025-10-24T17:37:39.917952] [DEBUG] [LOCAL     ] BLND: No primary data file found to delete.
[2025-10-24T17:37:39.917989] [INFO ] [LOCAL     ] BLND: Starting deletion of derivative data.
[2025-10-24T17:37:39.918124] [DEBUG] [LOCAL     ] BLND: Deleted derivative data file.
[2025-10-24T17:37:39.918564] [INFO ] [MAIN      ] Update Progress: 302/2366 symbols completed. BLND took 39.0s. Estimated remaining: 4h 17m 5s. Rate: 8.0 symbols/min
[2025-10-24T17:37:40.097931] [INFO ] [MAIN      ] BME: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:37:40.111479] [DEBUG] [LOCAL     ] BME: Loaded 11273 existing records from primary storage.
[2025-10-24T17:37:40.111798] [INFO ] [MAIN      ] BME: Loaded 11273 existing records.
[2025-10-24T17:37:40.156892] [INFO ] [REMOTE    ] BLX: Fetching primary data for 2025-08.
[2025-10-24T17:37:40.296143] [WARN ] [MAIN      ] BME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:37:40.296367] [INFO ] [MAIN      ] BME: Wiping existing primary data before full refresh.
[2025-10-24T17:37:40.296413] [INFO ] [LOCAL     ] BME: Starting deletion of primary data.
[2025-10-24T17:37:40.296588] [DEBUG] [LOCAL     ] BME: Deleted primary data file.
[2025-10-24T17:37:40.296672] [INFO ] [MAIN      ] BME: Starting full primary refresh.
[2025-10-24T17:37:40.648611] [INFO ] [REMOTE    ] BME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:37:40.947627] [INFO ] [REMOTE    ] BMA: Fetching primary data for 2025-02.
[2025-10-24T17:37:41.021274] [INFO ] [REMOTE    ] BLK: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T17:37:41.028597] [INFO ] [REMOTE    ] BLK: Full fetch complete (52835 records).
[2025-10-24T17:37:41.028760] [DEBUG] [VALIDATOR ] BLK: Validating primary data.
[2025-10-24T17:37:41.359407] [INFO ] [REMOTE    ] BLX: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T17:37:41.454020] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present.
[2025-10-24T17:37:41.454106] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed.
[2025-10-24T17:37:41.454888] [INFO ] [MAIN      ] BLK: Fetched primary data is valid.
[2025-10-24T17:37:41.454953] [DEBUG] [LOCAL     ] BLK: Saving primary data.
[2025-10-24T17:37:41.455427] [FATAL] [LOCAL     ] BLK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:37:41.455529] [FATAL] [MAIN      ] BLK: Failed to save primary data.
[2025-10-24T17:37:41.455598] [WARN ] [MAIN      ] BLK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:37:41.455709] [INFO ] [LOCAL     ] BLK: Starting deletion of primary data.
[2025-10-24T17:37:41.455813] [DEBUG] [LOCAL     ] BLK: No primary data file found to delete.
[2025-10-24T17:37:41.455882] [INFO ] [LOCAL     ] BLK: Starting deletion of derivative data.
[2025-10-24T17:37:41.456048] [DEBUG] [LOCAL     ] BLK: Deleted derivative data file.
[2025-10-24T17:37:41.456161] [INFO ] [MAIN      ] Update Progress: 303/2366 symbols completed. BLK took 45.1s. Estimated remaining: 4h 16m 18s. Rate: 8.0 symbols/min
[2025-10-24T17:37:41.624192] [INFO ] [MAIN      ] BMEZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:37:41.648972] [DEBUG] [LOCAL     ] BMEZ: Loaded 25188 existing records from primary storage.
[2025-10-24T17:37:41.649228] [INFO ] [MAIN      ] BMEZ: Loaded 25188 existing records.
[2025-10-24T17:37:41.748720] [INFO ] [REMOTE    ] BLX: Fetching primary data for 2025-09.
[2025-10-24T17:37:41.836018] [WARN ] [MAIN      ] BMEZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:37:41.836403] [INFO ] [MAIN      ] BMEZ: Wiping existing primary data before full refresh.
[2025-10-24T17:37:41.836472] [INFO ] [LOCAL     ] BMEZ: Starting deletion of primary data.
[2025-10-24T17:37:41.837053] [DEBUG] [LOCAL     ] BMEZ: Deleted primary data file.
[2025-10-24T17:37:41.837113] [INFO ] [MAIN      ] BMEZ: Starting full primary refresh.
[2025-10-24T17:37:42.154814] [INFO ] [REMOTE    ] BMA: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T17:37:42.242545] [INFO ] [REMOTE    ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:37:42.547761] [INFO ] [REMOTE    ] BMEZ: Fetching primary data for 2025-01.
[2025-10-24T17:37:42.665213] [INFO ] [REMOTE    ] BLX: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T17:37:43.347750] [INFO ] [REMOTE    ] BME: Fetching primary data for 2025-01.
[2025-10-24T17:37:43.753093] [INFO ] [REMOTE    ] BMEZ: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T17:37:44.147631] [INFO ] [REMOTE    ] BMEZ: Fetching primary data for 2025-02.
[2025-10-24T17:37:44.301749] [INFO ] [REMOTE    ] BME: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T17:37:44.947689] [INFO ] [REMOTE    ] BME: Fetching primary data for 2025-02.
[2025-10-24T17:37:45.251756] [INFO ] [REMOTE    ] BMEZ: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T17:37:45.473758] [INFO ] [REMOTE    ] BME: Incremental fetch complete for 2025-02 (0.53 seconds).
[2025-10-24T17:37:45.747707] [INFO ] [REMOTE    ] BMA: Fetching primary data for 2025-03.
[2025-10-24T17:37:46.547637] [INFO ] [REMOTE    ] BME: Fetching primary data for 2025-03.
[2025-10-24T17:37:47.110458] [INFO ] [REMOTE    ] BMA: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T17:37:47.333688] [INFO ] [REMOTE    ] BME: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T17:37:47.347676] [INFO ] [REMOTE    ] BMA: Fetching primary data for 2025-04.
[2025-10-24T17:37:48.147720] [INFO ] [REMOTE    ] BME: Fetching primary data for 2025-04.
[2025-10-24T17:37:48.822332] [INFO ] [REMOTE    ] BME: Incremental fetch complete for 2025-04 (0.67 seconds).
[2025-10-24T17:37:48.909298] [INFO ] [REMOTE    ] BMA: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T17:37:48.947693] [INFO ] [REMOTE    ] BLX: Fetching primary data for 2025-10.
[2025-10-24T17:37:49.747692] [INFO ] [REMOTE    ] BME: Fetching primary data for 2025-05.
[2025-10-24T17:37:50.211312] [INFO ] [REMOTE    ] BLX: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T17:37:50.214564] [INFO ] [REMOTE    ] BLX: Full fetch complete (22402 records).
[2025-10-24T17:37:50.214668] [DEBUG] [VALIDATOR ] BLX: Validating primary data.
[2025-10-24T17:37:50.516041] [INFO ] [REMOTE    ] BME: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T17:37:50.559043] [INFO ] [REMOTE    ] BME: Fetching primary data for 2025-06.
[2025-10-24T17:37:50.606058] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present.
[2025-10-24T17:37:50.606128] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed.
[2025-10-24T17:37:50.606546] [INFO ] [MAIN      ] BLX: Fetched primary data is valid.
[2025-10-24T17:37:50.606609] [DEBUG] [LOCAL     ] BLX: Saving primary data.
[2025-10-24T17:37:50.606996] [FATAL] [LOCAL     ] BLX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:37:50.607079] [FATAL] [MAIN      ] BLX: Failed to save primary data.
[2025-10-24T17:37:50.607122] [WARN ] [MAIN      ] BLX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:37:50.607158] [INFO ] [LOCAL     ] BLX: Starting deletion of primary data.
[2025-10-24T17:37:50.607208] [DEBUG] [LOCAL     ] BLX: No primary data file found to delete.
[2025-10-24T17:37:50.607244] [INFO ] [LOCAL     ] BLX: Starting deletion of derivative data.
[2025-10-24T17:37:50.607404] [DEBUG] [LOCAL     ] BLX: Deleted derivative data file.
[2025-10-24T17:37:50.607495] [INFO ] [MAIN      ] Update Progress: 304/2366 symbols completed. BLX took 33.6s. Estimated remaining: 4h 16m 22s. Rate: 8.0 symbols/min
[2025-10-24T17:37:50.779110] [INFO ] [MAIN      ] BMI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:37:50.804089] [DEBUG] [LOCAL     ] BMI: Loaded 25126 existing records from primary storage.
[2025-10-24T17:37:50.804343] [INFO ] [MAIN      ] BMI: Loaded 25126 existing records.
[2025-10-24T17:37:50.997190] [WARN ] [MAIN      ] BMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:37:50.997443] [INFO ] [MAIN      ] BMI: Wiping existing primary data before full refresh.
[2025-10-24T17:37:50.997495] [INFO ] [LOCAL     ] BMI: Starting deletion of primary data.
[2025-10-24T17:37:50.997849] [DEBUG] [LOCAL     ] BMI: Deleted primary data file.
[2025-10-24T17:37:50.997942] [INFO ] [MAIN      ] BMI: Starting full primary refresh.
[2025-10-24T17:37:51.352950] [INFO ] [REMOTE    ] BMA: Fetching primary data for 2025-05.
[2025-10-24T17:37:51.376804] [INFO ] [REMOTE    ] BMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:37:51.385791] [INFO ] [REMOTE    ] BME: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T17:37:52.147638] [INFO ] [REMOTE    ] BMEZ: Fetching primary data for 2025-03.
[2025-10-24T17:37:52.760812] [INFO ] [REMOTE    ] BMA: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T17:37:52.947632] [INFO ] [REMOTE    ] BME: Fetching primary data for 2025-07.
[2025-10-24T17:37:53.419171] [INFO ] [REMOTE    ] BMEZ: Incremental fetch complete for 2025-03 (1.27 seconds).
[2025-10-24T17:37:53.433634] [INFO ] [REMOTE    ] BME: Incremental fetch complete for 2025-07 (0.49 seconds).
[2025-10-24T17:37:53.747673] [INFO ] [REMOTE    ] BME: Fetching primary data for 2025-08.
[2025-10-24T17:37:54.547621] [INFO ] [REMOTE    ] BMI: Fetching primary data for 2025-01.
[2025-10-24T17:37:54.688063] [INFO ] [REMOTE    ] BME: Incremental fetch complete for 2025-08 (0.94 seconds).
[2025-10-24T17:37:55.347663] [INFO ] [REMOTE    ] BMA: Fetching primary data for 2025-06.
[2025-10-24T17:37:55.786516] [INFO ] [REMOTE    ] BMI: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T17:37:56.147601] [INFO ] [REMOTE    ] BMEZ: Fetching primary data for 2025-04.
[2025-10-24T17:37:56.350931] [INFO ] [REMOTE    ] BMA: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T17:37:56.947698] [INFO ] [REMOTE    ] BMA: Fetching primary data for 2025-07.
[2025-10-24T17:37:57.475950] [INFO ] [REMOTE    ] BMEZ: Incremental fetch complete for 2025-04 (1.33 seconds).
[2025-10-24T17:37:57.747687] [INFO ] [REMOTE    ] BMI: Fetching primary data for 2025-02.
[2025-10-24T17:37:58.314999] [INFO ] [REMOTE    ] BMA: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T17:37:58.373746] [INFO ] [REMOTE    ] BMI: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T17:37:58.547688] [INFO ] [REMOTE    ] BMA: Fetching primary data for 2025-08.
[2025-10-24T17:37:59.347735] [INFO ] [REMOTE    ] BME: Fetching primary data for 2025-09.
[2025-10-24T17:37:59.971595] [INFO ] [REMOTE    ] BMA: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T17:38:00.147713] [INFO ] [REMOTE    ] BMI: Fetching primary data for 2025-03.
[2025-10-24T17:38:00.160520] [INFO ] [REMOTE    ] BME: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T17:38:00.947745] [INFO ] [REMOTE    ] BMA: Fetching primary data for 2025-09.
[2025-10-24T17:38:01.747735] [INFO ] [REMOTE    ] BME: Fetching primary data for 2025-10.
[2025-10-24T17:38:01.825634] [INFO ] [REMOTE    ] BMI: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T17:38:02.547710] [INFO ] [REMOTE    ] BMI: Fetching primary data for 2025-04.
[2025-10-24T17:38:03.309700] [INFO ] [REMOTE    ] BME: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T17:38:03.312339] [INFO ] [REMOTE    ] BME: Full fetch complete (15504 records).
[2025-10-24T17:38:03.312418] [DEBUG] [VALIDATOR ] BME: Validating primary data.
[2025-10-24T17:38:03.312910] [FATAL] [VALIDATOR ] BME: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:38:03.312996] [FATAL] [MAIN      ] BME: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:38:03.313061] [WARN ] [MAIN      ] BME: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:38:03.313145] [INFO ] [LOCAL     ] BME: Starting deletion of primary data.
[2025-10-24T17:38:03.313222] [DEBUG] [LOCAL     ] BME: No primary data file found to delete.
[2025-10-24T17:38:03.313272] [INFO ] [LOCAL     ] BME: Starting deletion of derivative data.
[2025-10-24T17:38:03.313429] [DEBUG] [LOCAL     ] BME: Deleted derivative data file.
[2025-10-24T17:38:03.313534] [INFO ] [MAIN      ] Update Progress: 305/2366 symbols completed. BME took 23.4s. Estimated remaining: 4h 16m 50s. Rate: 8.0 symbols/min
[2025-10-24T17:38:03.356708] [INFO ] [REMOTE    ] BMEZ: Fetching primary data for 2025-05.
[2025-10-24T17:38:03.500316] [INFO ] [MAIN      ] BMN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:38:03.505249] [DEBUG] [LOCAL     ] BMN: Loaded 2661 existing records from primary storage.
[2025-10-24T17:38:03.505427] [INFO ] [MAIN      ] BMN: Loaded 2661 existing records.
[2025-10-24T17:38:03.692717] [INFO ] [REMOTE    ] BMA: Incremental fetch complete for 2025-09 (2.74 seconds).
[2025-10-24T17:38:03.712930] [WARN ] [MAIN      ] BMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:38:03.722192] [INFO ] [MAIN      ] BMN: Wiping existing primary data before full refresh.
[2025-10-24T17:38:03.722274] [INFO ] [LOCAL     ] BMN: Starting deletion of primary data.
[2025-10-24T17:38:03.722821] [DEBUG] [LOCAL     ] BMN: Deleted primary data file.
[2025-10-24T17:38:03.722889] [INFO ] [MAIN      ] BMN: Starting full primary refresh.
[2025-10-24T17:38:04.076556] [INFO ] [REMOTE    ] BMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:38:04.147604] [INFO ] [REMOTE    ] BMN: Fetching primary data for 2025-01.
[2025-10-24T17:38:04.301185] [INFO ] [REMOTE    ] BMI: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T17:38:04.646820] [INFO ] [REMOTE    ] BMEZ: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T17:38:04.947702] [INFO ] [REMOTE    ] BMEZ: Fetching primary data for 2025-06.
[2025-10-24T17:38:04.992780] [INFO ] [REMOTE    ] BMN: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T17:38:05.747718] [INFO ] [REMOTE    ] BMN: Fetching primary data for 2025-02.
[2025-10-24T17:38:06.153832] [INFO ] [REMOTE    ] BMEZ: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T17:38:06.256160] [INFO ] [REMOTE    ] BMN: Incremental fetch complete for 2025-02 (0.51 seconds).
[2025-10-24T17:38:06.547638] [INFO ] [REMOTE    ] BMN: Fetching primary data for 2025-03.
[2025-10-24T17:38:06.997717] [INFO ] [REMOTE    ] BMN: Incremental fetch complete for 2025-03 (0.45 seconds).
[2025-10-24T17:38:07.347683] [INFO ] [REMOTE    ] BMEZ: Fetching primary data for 2025-07.
[2025-10-24T17:38:08.147682] [INFO ] [REMOTE    ] BMI: Fetching primary data for 2025-05.
[2025-10-24T17:38:08.450381] [INFO ] [REMOTE    ] BMEZ: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T17:38:08.947733] [INFO ] [REMOTE    ] BMA: Fetching primary data for 2025-10.
[2025-10-24T17:38:09.373961] [INFO ] [REMOTE    ] BMI: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T17:38:09.747746] [INFO ] [REMOTE    ] BMN: Fetching primary data for 2025-04.
[2025-10-24T17:38:10.303903] [INFO ] [REMOTE    ] BMN: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T17:38:10.548018] [INFO ] [REMOTE    ] BMN: Fetching primary data for 2025-05.
[2025-10-24T17:38:10.547948] [INFO ] [REMOTE    ] BMA: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T17:38:10.557200] [INFO ] [REMOTE    ] BMA: Full fetch complete (52441 records).
[2025-10-24T17:38:10.557379] [DEBUG] [VALIDATOR ] BMA: Validating primary data.
[2025-10-24T17:38:10.949025] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present.
[2025-10-24T17:38:10.949111] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed.
[2025-10-24T17:38:10.949809] [INFO ] [MAIN      ] BMA: Fetched primary data is valid.
[2025-10-24T17:38:10.949883] [DEBUG] [LOCAL     ] BMA: Saving primary data.
[2025-10-24T17:38:10.950417] [FATAL] [LOCAL     ] BMA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:38:10.950509] [FATAL] [MAIN      ] BMA: Failed to save primary data.
[2025-10-24T17:38:10.950591] [WARN ] [MAIN      ] BMA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:38:10.950701] [INFO ] [LOCAL     ] BMA: Starting deletion of primary data.
[2025-10-24T17:38:10.950776] [DEBUG] [LOCAL     ] BMA: No primary data file found to delete.
[2025-10-24T17:38:10.950812] [INFO ] [LOCAL     ] BMA: Starting deletion of derivative data.
[2025-10-24T17:38:10.950952] [DEBUG] [LOCAL     ] BMA: Deleted derivative data file.
[2025-10-24T17:38:10.951218] [INFO ] [MAIN      ] Update Progress: 306/2366 symbols completed. BMA took 35.8s. Estimated remaining: 4h 16m 43s. Rate: 8.0 symbols/min
[2025-10-24T17:38:11.123927] [INFO ] [MAIN      ] BMO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:38:11.133992] [INFO ] [REMOTE    ] BMN: Incremental fetch complete for 2025-05 (0.59 seconds).
[2025-10-24T17:38:11.176094] [DEBUG] [LOCAL     ] BMO: Loaded 41220 existing records from primary storage.
[2025-10-24T17:38:11.176464] [INFO ] [MAIN      ] BMO: Loaded 41220 existing records.
[2025-10-24T17:38:11.361911] [INFO ] [REMOTE    ] BMEZ: Fetching primary data for 2025-08.
[2025-10-24T17:38:11.368193] [WARN ] [MAIN      ] BMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:38:11.369637] [INFO ] [MAIN      ] BMO: Wiping existing primary data before full refresh.
[2025-10-24T17:38:11.369740] [INFO ] [LOCAL     ] BMO: Starting deletion of primary data.
[2025-10-24T17:38:11.370591] [DEBUG] [LOCAL     ] BMO: Deleted primary data file.
[2025-10-24T17:38:11.370695] [INFO ] [MAIN      ] BMO: Starting full primary refresh.
[2025-10-24T17:38:11.746936] [INFO ] [REMOTE    ] BMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:38:12.147689] [INFO ] [REMOTE    ] BMO: Fetching primary data for 2025-01.
[2025-10-24T17:38:12.537725] [INFO ] [REMOTE    ] BMEZ: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T17:38:12.947736] [INFO ] [REMOTE    ] BMN: Fetching primary data for 2025-06.
[2025-10-24T17:38:13.630781] [INFO ] [REMOTE    ] BMN: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T17:38:13.656079] [INFO ] [REMOTE    ] BMO: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T17:38:13.747635] [INFO ] [REMOTE    ] BMN: Fetching primary data for 2025-07.
[2025-10-24T17:38:14.147058] [INFO ] [REMOTE    ] BMN: Incremental fetch complete for 2025-07 (0.40 seconds).
[2025-10-24T17:38:14.547677] [INFO ] [REMOTE    ] BMEZ: Fetching primary data for 2025-09.
[2025-10-24T17:38:15.347692] [INFO ] [REMOTE    ] BMO: Fetching primary data for 2025-02.
[2025-10-24T17:38:15.574346] [INFO ] [REMOTE    ] BMEZ: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T17:38:16.147721] [INFO ] [REMOTE    ] BMEZ: Fetching primary data for 2025-10.
[2025-10-24T17:38:16.947681] [INFO ] [REMOTE    ] BMI: Fetching primary data for 2025-06.
[2025-10-24T17:38:17.060945] [INFO ] [REMOTE    ] BMO: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T17:38:17.388498] [INFO ] [REMOTE    ] BMEZ: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T17:38:17.395626] [INFO ] [REMOTE    ] BMEZ: Full fetch complete (39226 records).
[2025-10-24T17:38:17.395765] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data.
[2025-10-24T17:38:17.754797] [INFO ] [REMOTE    ] BMO: Fetching primary data for 2025-03.
[2025-10-24T17:38:17.786881] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present.
[2025-10-24T17:38:17.787113] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed.
[2025-10-24T17:38:17.787785] [INFO ] [MAIN      ] BMEZ: Fetched primary data is valid.
[2025-10-24T17:38:17.787919] [DEBUG] [LOCAL     ] BMEZ: Saving primary data.
[2025-10-24T17:38:17.788402] [FATAL] [LOCAL     ] BMEZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:38:17.788733] [FATAL] [MAIN      ] BMEZ: Failed to save primary data.
[2025-10-24T17:38:17.788863] [WARN ] [MAIN      ] BMEZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:38:17.794113] [INFO ] [LOCAL     ] BMEZ: Starting deletion of primary data.
[2025-10-24T17:38:17.799935] [DEBUG] [LOCAL     ] BMEZ: No primary data file found to delete.
[2025-10-24T17:38:17.802466] [INFO ] [LOCAL     ] BMEZ: Starting deletion of derivative data.
[2025-10-24T17:38:17.802832] [DEBUG] [LOCAL     ] BMEZ: Deleted derivative data file.
[2025-10-24T17:38:17.803432] [INFO ] [MAIN      ] Update Progress: 307/2366 symbols completed. BMEZ took 36.3s. Estimated remaining: 4h 16m 32s. Rate: 8.0 symbols/min
[2025-10-24T17:38:17.804211] [INFO ] [REMOTE    ] BMI: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T17:38:17.985872] [INFO ] [MAIN      ] BMY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:38:18.036039] [DEBUG] [LOCAL     ] BMY: Loaded 54147 existing records from primary storage.
[2025-10-24T17:38:18.036363] [INFO ] [MAIN      ] BMY: Loaded 54147 existing records.
[2025-10-24T17:38:18.227870] [WARN ] [MAIN      ] BMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:38:18.228153] [INFO ] [MAIN      ] BMY: Wiping existing primary data before full refresh.
[2025-10-24T17:38:18.228208] [INFO ] [LOCAL     ] BMY: Starting deletion of primary data.
[2025-10-24T17:38:18.229293] [DEBUG] [LOCAL     ] BMY: Deleted primary data file.
[2025-10-24T17:38:18.229356] [INFO ] [MAIN      ] BMY: Starting full primary refresh.
[2025-10-24T17:38:18.562344] [INFO ] [REMOTE    ] BMI: Fetching primary data for 2025-07.
[2025-10-24T17:38:18.603871] [INFO ] [REMOTE    ] BMY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:38:19.347729] [INFO ] [REMOTE    ] BMY: Fetching primary data for 2025-01.
[2025-10-24T17:38:19.420611] [INFO ] [REMOTE    ] BMO: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T17:38:19.914114] [INFO ] [REMOTE    ] BMI: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T17:38:20.147630] [INFO ] [REMOTE    ] BMO: Fetching primary data for 2025-04.
[2025-10-24T17:38:20.947693] [INFO ] [REMOTE    ] BMI: Fetching primary data for 2025-08.
[2025-10-24T17:38:21.148358] [INFO ] [REMOTE    ] BMY: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T17:38:21.739346] [INFO ] [REMOTE    ] BMO: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T17:38:21.748262] [INFO ] [REMOTE    ] BMY: Fetching primary data for 2025-02.
[2025-10-24T17:38:22.092181] [INFO ] [REMOTE    ] BMI: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T17:38:22.547710] [INFO ] [REMOTE    ] BMO: Fetching primary data for 2025-05.
[2025-10-24T17:38:23.354701] [INFO ] [REMOTE    ] BMI: Fetching primary data for 2025-09.
[2025-10-24T17:38:23.372798] [INFO ] [REMOTE    ] BMY: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T17:38:23.546537] [INFO ] [REMOTE    ] BMO: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T17:38:24.147696] [INFO ] [REMOTE    ] BMN: Fetching primary data for 2025-08.
[2025-10-24T17:38:24.708334] [INFO ] [REMOTE    ] BMI: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T17:38:24.708916] [INFO ] [REMOTE    ] BMN: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T17:38:24.947678] [INFO ] [REMOTE    ] BMN: Fetching primary data for 2025-09.
[2025-10-24T17:38:25.493920] [INFO ] [REMOTE    ] BMN: Incremental fetch complete for 2025-09 (0.55 seconds).
[2025-10-24T17:38:25.747686] [INFO ] [REMOTE    ] BMN: Fetching primary data for 2025-10.
[2025-10-24T17:38:26.406079] [INFO ] [REMOTE    ] BMN: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T17:38:26.407125] [INFO ] [REMOTE    ] BMN: Full fetch complete (3710 records).
[2025-10-24T17:38:26.407199] [DEBUG] [VALIDATOR ] BMN: Validating primary data.
[2025-10-24T17:38:26.555491] [INFO ] [REMOTE    ] BMO: Fetching primary data for 2025-06.
[2025-10-24T17:38:26.763812] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present.
[2025-10-24T17:38:26.763888] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed.
[2025-10-24T17:38:26.764023] [INFO ] [MAIN      ] BMN: Fetched primary data is valid.
[2025-10-24T17:38:26.764061] [DEBUG] [LOCAL     ] BMN: Saving primary data.
[2025-10-24T17:38:26.764230] [FATAL] [LOCAL     ] BMN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:38:26.764308] [FATAL] [MAIN      ] BMN: Failed to save primary data.
[2025-10-24T17:38:26.764349] [WARN ] [MAIN      ] BMN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:38:26.764382] [INFO ] [LOCAL     ] BMN: Starting deletion of primary data.
[2025-10-24T17:38:26.764430] [DEBUG] [LOCAL     ] BMN: No primary data file found to delete.
[2025-10-24T17:38:26.764463] [INFO ] [LOCAL     ] BMN: Starting deletion of derivative data.
[2025-10-24T17:38:26.764615] [DEBUG] [LOCAL     ] BMN: Deleted derivative data file.
[2025-10-24T17:38:26.764729] [INFO ] [MAIN      ] Update Progress: 308/2366 symbols completed. BMN took 23.5s. Estimated remaining: 4h 16m 34s. Rate: 8.0 symbols/min
[2025-10-24T17:38:26.953112] [INFO ] [MAIN      ] BN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:38:27.004882] [DEBUG] [LOCAL     ] BN: Loaded 53372 existing records from primary storage.
[2025-10-24T17:38:27.005236] [INFO ] [MAIN      ] BN: Loaded 53372 existing records.
[2025-10-24T17:38:27.195079] [WARN ] [MAIN      ] BN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:38:27.195366] [INFO ] [MAIN      ] BN: Wiping existing primary data before full refresh.
[2025-10-24T17:38:27.195418] [INFO ] [LOCAL     ] BN: Starting deletion of primary data.
[2025-10-24T17:38:27.196355] [DEBUG] [LOCAL     ] BN: Deleted primary data file.
[2025-10-24T17:38:27.196423] [INFO ] [MAIN      ] BN: Starting full primary refresh.
[2025-10-24T17:38:27.350852] [INFO ] [REMOTE    ] BMY: Fetching primary data for 2025-03.
[2025-10-24T17:38:27.556154] [INFO ] [REMOTE    ] BN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:38:28.041801] [INFO ] [REMOTE    ] BMO: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T17:38:28.147726] [INFO ] [REMOTE    ] BN: Fetching primary data for 2025-01.
[2025-10-24T17:38:28.947747] [INFO ] [REMOTE    ] BMI: Fetching primary data for 2025-10.
[2025-10-24T17:38:29.371453] [INFO ] [REMOTE    ] BMY: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T17:38:29.585456] [INFO ] [REMOTE    ] BN: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T17:38:29.747700] [INFO ] [REMOTE    ] BN: Fetching primary data for 2025-02.
[2025-10-24T17:38:30.415099] [INFO ] [REMOTE    ] BMI: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T17:38:30.420438] [INFO ] [REMOTE    ] BMI: Full fetch complete (34168 records).
[2025-10-24T17:38:30.420516] [DEBUG] [VALIDATOR ] BMI: Validating primary data.
[2025-10-24T17:38:30.557312] [INFO ] [REMOTE    ] BMO: Fetching primary data for 2025-07.
[2025-10-24T17:38:30.785353] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present.
[2025-10-24T17:38:30.785431] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed.
[2025-10-24T17:38:30.785913] [INFO ] [MAIN      ] BMI: Fetched primary data is valid.
[2025-10-24T17:38:30.785973] [DEBUG] [LOCAL     ] BMI: Saving primary data.
[2025-10-24T17:38:30.786303] [FATAL] [LOCAL     ] BMI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:38:30.786377] [FATAL] [MAIN      ] BMI: Failed to save primary data.
[2025-10-24T17:38:30.786439] [WARN ] [MAIN      ] BMI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:38:30.786506] [INFO ] [LOCAL     ] BMI: Starting deletion of primary data.
[2025-10-24T17:38:30.786579] [DEBUG] [LOCAL     ] BMI: No primary data file found to delete.
[2025-10-24T17:38:30.786615] [INFO ] [LOCAL     ] BMI: Starting deletion of derivative data.
[2025-10-24T17:38:30.786792] [DEBUG] [LOCAL     ] BMI: Deleted derivative data file.
[2025-10-24T17:38:30.786880] [INFO ] [MAIN      ] Update Progress: 309/2366 symbols completed. BMI took 40.2s. Estimated remaining: 4h 16m 4s. Rate: 8.0 symbols/min
[2025-10-24T17:38:30.949638] [INFO ] [MAIN      ] BNED: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:38:30.977783] [DEBUG] [LOCAL     ] BNED: Loaded 28371 existing records from primary storage.
[2025-10-24T17:38:30.978032] [INFO ] [MAIN      ] BNED: Loaded 28371 existing records.
[2025-10-24T17:38:31.152099] [WARN ] [MAIN      ] BNED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:38:31.152420] [INFO ] [MAIN      ] BNED: Wiping existing primary data before full refresh.
[2025-10-24T17:38:31.152474] [INFO ] [LOCAL     ] BNED: Starting deletion of primary data.
[2025-10-24T17:38:31.153069] [DEBUG] [LOCAL     ] BNED: Deleted primary data file.
[2025-10-24T17:38:31.153126] [INFO ] [MAIN      ] BNED: Starting full primary refresh.
[2025-10-24T17:38:31.361547] [INFO ] [REMOTE    ] BMY: Fetching primary data for 2025-04.
[2025-10-24T17:38:31.510875] [INFO ] [REMOTE    ] BNED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:38:31.538407] [INFO ] [REMOTE    ] BN: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T17:38:31.736045] [INFO ] [REMOTE    ] BMO: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T17:38:32.147623] [INFO ] [REMOTE    ] BMO: Fetching primary data for 2025-08.
[2025-10-24T17:38:32.947710] [INFO ] [REMOTE    ] BNED: Fetching primary data for 2025-01.
[2025-10-24T17:38:33.550282] [INFO ] [REMOTE    ] BMY: Incremental fetch complete for 2025-04 (2.19 seconds).
[2025-10-24T17:38:33.634143] [INFO ] [REMOTE    ] BMO: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T17:38:33.747701] [INFO ] [REMOTE    ] BMY: Fetching primary data for 2025-05.
[2025-10-24T17:38:34.408832] [INFO ] [REMOTE    ] BNED: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T17:38:34.547710] [INFO ] [REMOTE    ] BN: Fetching primary data for 2025-03.
[2025-10-24T17:38:35.347674] [INFO ] [REMOTE    ] BNED: Fetching primary data for 2025-02.
[2025-10-24T17:38:35.705987] [INFO ] [REMOTE    ] BMY: Incremental fetch complete for 2025-05 (1.96 seconds).
[2025-10-24T17:38:35.973960] [INFO ] [REMOTE    ] BNED: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T17:38:36.147704] [INFO ] [REMOTE    ] BMO: Fetching primary data for 2025-09.
[2025-10-24T17:38:36.373762] [INFO ] [REMOTE    ] BN: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T17:38:36.947712] [INFO ] [REMOTE    ] BMY: Fetching primary data for 2025-06.
[2025-10-24T17:38:37.747732] [INFO ] [REMOTE    ] BNED: Fetching primary data for 2025-03.
[2025-10-24T17:38:37.777584] [INFO ] [REMOTE    ] BMO: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T17:38:38.558973] [INFO ] [REMOTE    ] BN: Fetching primary data for 2025-04.
[2025-10-24T17:38:38.562576] [INFO ] [REMOTE    ] BMY: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T17:38:39.044052] [INFO ] [REMOTE    ] BNED: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T17:38:39.347701] [INFO ] [REMOTE    ] BMY: Fetching primary data for 2025-07.
[2025-10-24T17:38:40.147631] [INFO ] [REMOTE    ] BNED: Fetching primary data for 2025-04.
[2025-10-24T17:38:40.222493] [INFO ] [REMOTE    ] BN: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T17:38:40.947734] [INFO ] [REMOTE    ] BMO: Fetching primary data for 2025-10.
[2025-10-24T17:38:41.089507] [INFO ] [REMOTE    ] BMY: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T17:38:41.428735] [INFO ] [REMOTE    ] BNED: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T17:38:41.747673] [INFO ] [REMOTE    ] BN: Fetching primary data for 2025-05.
[2025-10-24T17:38:42.413333] [INFO ] [REMOTE    ] BMO: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T17:38:42.420868] [INFO ] [REMOTE    ] BMO: Full fetch complete (59852 records).
[2025-10-24T17:38:42.421023] [DEBUG] [VALIDATOR ] BMO: Validating primary data.
[2025-10-24T17:38:42.560700] [INFO ] [REMOTE    ] BMY: Fetching primary data for 2025-08.
[2025-10-24T17:38:42.804239] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present.
[2025-10-24T17:38:42.804319] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed.
[2025-10-24T17:38:42.804996] [INFO ] [MAIN      ] BMO: Fetched primary data is valid.
[2025-10-24T17:38:42.805057] [DEBUG] [LOCAL     ] BMO: Saving primary data.
[2025-10-24T17:38:42.805529] [FATAL] [LOCAL     ] BMO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:38:42.805612] [FATAL] [MAIN      ] BMO: Failed to save primary data.
[2025-10-24T17:38:42.805685] [WARN ] [MAIN      ] BMO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:38:42.805738] [INFO ] [LOCAL     ] BMO: Starting deletion of primary data.
[2025-10-24T17:38:42.805789] [DEBUG] [LOCAL     ] BMO: No primary data file found to delete.
[2025-10-24T17:38:42.805823] [INFO ] [LOCAL     ] BMO: Starting deletion of derivative data.
[2025-10-24T17:38:42.805986] [DEBUG] [LOCAL     ] BMO: Deleted derivative data file.
[2025-10-24T17:38:42.806393] [INFO ] [MAIN      ] Update Progress: 310/2366 symbols completed. BMO took 31.9s. Estimated remaining: 4h 16m 26s. Rate: 8.0 symbols/min
[2025-10-24T17:38:42.974149] [INFO ] [MAIN      ] BNH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:38:42.981843] [DEBUG] [LOCAL     ] BNH: Loaded 4720 existing records from primary storage.
[2025-10-24T17:38:42.982167] [INFO ] [MAIN      ] BNH: Loaded 4720 existing records.
[2025-10-24T17:38:43.166029] [WARN ] [MAIN      ] BNH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:38:43.166355] [INFO ] [MAIN      ] BNH: Wiping existing primary data before full refresh.
[2025-10-24T17:38:43.166488] [INFO ] [LOCAL     ] BNH: Starting deletion of primary data.
[2025-10-24T17:38:43.166769] [DEBUG] [LOCAL     ] BNH: Deleted primary data file.
[2025-10-24T17:38:43.166893] [INFO ] [MAIN      ] BNH: Starting full primary refresh.
[2025-10-24T17:38:43.348769] [INFO ] [REMOTE    ] BNED: Fetching primary data for 2025-05.
[2025-10-24T17:38:43.440468] [INFO ] [REMOTE    ] BN: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T17:38:43.575718] [INFO ] [REMOTE    ] BNH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:38:44.147736] [INFO ] [REMOTE    ] BN: Fetching primary data for 2025-06.
[2025-10-24T17:38:44.682821] [INFO ] [REMOTE    ] BMY: Incremental fetch complete for 2025-08 (2.12 seconds).
[2025-10-24T17:38:44.785704] [INFO ] [REMOTE    ] BNED: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T17:38:44.947669] [INFO ] [REMOTE    ] BMY: Fetching primary data for 2025-09.
[2025-10-24T17:38:45.747682] [INFO ] [REMOTE    ] BNH: Fetching primary data for 2025-01.
[2025-10-24T17:38:45.865043] [INFO ] [REMOTE    ] BN: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T17:38:46.402471] [INFO ] [REMOTE    ] BNH: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T17:38:46.547717] [INFO ] [REMOTE    ] BN: Fetching primary data for 2025-07.
[2025-10-24T17:38:46.796843] [INFO ] [REMOTE    ] BMY: Incremental fetch complete for 2025-09 (1.85 seconds).
[2025-10-24T17:38:47.347704] [INFO ] [REMOTE    ] BNED: Fetching primary data for 2025-06.
[2025-10-24T17:38:48.147638] [INFO ] [REMOTE    ] BMY: Fetching primary data for 2025-10.
[2025-10-24T17:38:48.454937] [INFO ] [REMOTE    ] BN: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T17:38:48.522366] [INFO ] [REMOTE    ] BNED: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T17:38:48.780051] [INFO ] [REMOTE    ] BMY: Incremental fetch complete for 2025-10 (0.63 seconds).
[2025-10-24T17:38:48.789957] [INFO ] [REMOTE    ] BMY: Full fetch complete (77937 records).
[2025-10-24T17:38:48.790120] [DEBUG] [VALIDATOR ] BMY: Validating primary data.
[2025-10-24T17:38:48.951751] [INFO ] [REMOTE    ] BNED: Fetching primary data for 2025-07.
[2025-10-24T17:38:49.184782] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present.
[2025-10-24T17:38:49.184857] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed.
[2025-10-24T17:38:49.185715] [INFO ] [MAIN      ] BMY: Fetched primary data is valid.
[2025-10-24T17:38:49.185775] [DEBUG] [LOCAL     ] BMY: Saving primary data.
[2025-10-24T17:38:49.186334] [FATAL] [LOCAL     ] BMY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:38:49.186426] [FATAL] [MAIN      ] BMY: Failed to save primary data.
[2025-10-24T17:38:49.186467] [WARN ] [MAIN      ] BMY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:38:49.186502] [INFO ] [LOCAL     ] BMY: Starting deletion of primary data.
[2025-10-24T17:38:49.186583] [DEBUG] [LOCAL     ] BMY: No primary data file found to delete.
[2025-10-24T17:38:49.186662] [INFO ] [LOCAL     ] BMY: Starting deletion of derivative data.
[2025-10-24T17:38:49.186851] [DEBUG] [LOCAL     ] BMY: Deleted derivative data file.
[2025-10-24T17:38:49.187267] [INFO ] [MAIN      ] Update Progress: 311/2366 symbols completed. BMY took 31.4s. Estimated remaining: 4h 16m 11s. Rate: 8.0 symbols/min
[2025-10-24T17:38:49.353022] [INFO ] [MAIN      ] BNJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:38:49.357857] [DEBUG] [LOCAL     ] BNJ: Loaded 2508 existing records from primary storage.
[2025-10-24T17:38:49.358037] [INFO ] [MAIN      ] BNJ: Loaded 2508 existing records.
[2025-10-24T17:38:49.530724] [WARN ] [MAIN      ] BNJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:38:49.530913] [INFO ] [MAIN      ] BNJ: Wiping existing primary data before full refresh.
[2025-10-24T17:38:49.530959] [INFO ] [LOCAL     ] BNJ: Starting deletion of primary data.
[2025-10-24T17:38:49.531126] [DEBUG] [LOCAL     ] BNJ: Deleted primary data file.
[2025-10-24T17:38:49.531182] [INFO ] [MAIN      ] BNJ: Starting full primary refresh.
[2025-10-24T17:38:49.759407] [INFO ] [REMOTE    ] BNH: Fetching primary data for 2025-02.
[2025-10-24T17:38:49.881488] [INFO ] [REMOTE    ] BNJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:38:50.493508] [INFO ] [REMOTE    ] BNH: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T17:38:50.514312] [INFO ] [REMOTE    ] BNED: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T17:38:50.547625] [INFO ] [REMOTE    ] BNH: Fetching primary data for 2025-03.
[2025-10-24T17:38:51.111068] [INFO ] [REMOTE    ] BNH: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T17:38:51.347666] [INFO ] [REMOTE    ] BNH: Fetching primary data for 2025-04.
[2025-10-24T17:38:52.052890] [INFO ] [REMOTE    ] BNH: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T17:38:52.147694] [INFO ] [REMOTE    ] BN: Fetching primary data for 2025-08.
[2025-10-24T17:38:52.947722] [INFO ] [REMOTE    ] BNJ: Fetching primary data for 2025-01.
[2025-10-24T17:38:53.564774] [INFO ] [REMOTE    ] BNJ: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T17:38:53.747709] [INFO ] [REMOTE    ] BNED: Fetching primary data for 2025-08.
[2025-10-24T17:38:53.975105] [INFO ] [REMOTE    ] BN: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T17:38:54.547638] [INFO ] [REMOTE    ] BNJ: Fetching primary data for 2025-02.
[2025-10-24T17:38:55.005350] [INFO ] [REMOTE    ] BNJ: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T17:38:55.119734] [INFO ] [REMOTE    ] BNED: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T17:38:55.347666] [INFO ] [REMOTE    ] BNED: Fetching primary data for 2025-09.
[2025-10-24T17:38:56.147690] [INFO ] [REMOTE    ] BN: Fetching primary data for 2025-09.
[2025-10-24T17:38:56.582359] [INFO ] [REMOTE    ] BNED: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T17:38:56.947691] [INFO ] [REMOTE    ] BNJ: Fetching primary data for 2025-03.
[2025-10-24T17:38:57.456837] [INFO ] [REMOTE    ] BNJ: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T17:38:57.589179] [INFO ] [REMOTE    ] BN: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T17:38:57.747634] [INFO ] [REMOTE    ] BNJ: Fetching primary data for 2025-04.
[2025-10-24T17:38:58.308547] [INFO ] [REMOTE    ] BNJ: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T17:38:58.547734] [INFO ] [REMOTE    ] BN: Fetching primary data for 2025-10.
[2025-10-24T17:38:59.347672] [INFO ] [REMOTE    ] BNJ: Fetching primary data for 2025-05.
[2025-10-24T17:38:59.813636] [INFO ] [REMOTE    ] BNJ: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T17:39:00.147673] [INFO ] [REMOTE    ] BNED: Fetching primary data for 2025-10.
[2025-10-24T17:39:00.337152] [INFO ] [REMOTE    ] BN: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T17:39:00.347107] [INFO ] [REMOTE    ] BN: Full fetch complete (76956 records).
[2025-10-24T17:39:00.347272] [DEBUG] [VALIDATOR ] BN: Validating primary data.
[2025-10-24T17:39:00.745734] [DEBUG] [VALIDATOR ] BN: All expected trading days are present.
[2025-10-24T17:39:00.745830] [DEBUG] [VALIDATOR ] BN: Primary data validation passed.
[2025-10-24T17:39:00.746637] [INFO ] [MAIN      ] BN: Fetched primary data is valid.
[2025-10-24T17:39:00.746730] [DEBUG] [LOCAL     ] BN: Saving primary data.
[2025-10-24T17:39:00.747407] [FATAL] [LOCAL     ] BN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:39:00.747535] [FATAL] [MAIN      ] BN: Failed to save primary data.
[2025-10-24T17:39:00.747610] [WARN ] [MAIN      ] BN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:39:00.747719] [INFO ] [LOCAL     ] BN: Starting deletion of primary data.
[2025-10-24T17:39:00.747800] [DEBUG] [LOCAL     ] BN: No primary data file found to delete.
[2025-10-24T17:39:00.747839] [INFO ] [LOCAL     ] BN: Starting deletion of derivative data.
[2025-10-24T17:39:00.748001] [DEBUG] [LOCAL     ] BN: Deleted derivative data file.
[2025-10-24T17:39:00.748600] [INFO ] [MAIN      ] Update Progress: 312/2366 symbols completed. BN took 34.0s. Estimated remaining: 4h 16m 31s. Rate: 8.0 symbols/min
[2025-10-24T17:39:00.927098] [INFO ] [MAIN      ] BNL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:39:00.950168] [INFO ] [REMOTE    ] BNJ: Fetching primary data for 2025-06.
[2025-10-24T17:39:00.971319] [DEBUG] [LOCAL     ] BNL: Loaded 47358 existing records from primary storage.
[2025-10-24T17:39:00.971613] [INFO ] [MAIN      ] BNL: Loaded 47358 existing records.
[2025-10-24T17:39:01.143823] [WARN ] [MAIN      ] BNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:39:01.144022] [INFO ] [MAIN      ] BNL: Wiping existing primary data before full refresh.
[2025-10-24T17:39:01.144066] [INFO ] [LOCAL     ] BNL: Starting deletion of primary data.
[2025-10-24T17:39:01.144932] [DEBUG] [LOCAL     ] BNL: Deleted primary data file.
[2025-10-24T17:39:01.144988] [INFO ] [MAIN      ] BNL: Starting full primary refresh.
[2025-10-24T17:39:01.493698] [INFO ] [REMOTE    ] BNL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:39:01.747708] [INFO ] [REMOTE    ] BNL: Fetching primary data for 2025-01.
[2025-10-24T17:39:01.779667] [INFO ] [REMOTE    ] BNJ: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T17:39:01.793774] [INFO ] [REMOTE    ] BNED: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T17:39:01.799302] [INFO ] [REMOTE    ] BNED: Full fetch complete (41641 records).
[2025-10-24T17:39:01.799447] [DEBUG] [VALIDATOR ] BNED: Validating primary data.
[2025-10-24T17:39:02.187749] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present.
[2025-10-24T17:39:02.187849] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed.
[2025-10-24T17:39:02.188381] [INFO ] [MAIN      ] BNED: Fetched primary data is valid.
[2025-10-24T17:39:02.188422] [DEBUG] [LOCAL     ] BNED: Saving primary data.
[2025-10-24T17:39:02.188956] [FATAL] [LOCAL     ] BNED: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:39:02.189043] [FATAL] [MAIN      ] BNED: Failed to save primary data.
[2025-10-24T17:39:02.189089] [WARN ] [MAIN      ] BNED: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:39:02.189161] [INFO ] [LOCAL     ] BNED: Starting deletion of primary data.
[2025-10-24T17:39:02.189236] [DEBUG] [LOCAL     ] BNED: No primary data file found to delete.
[2025-10-24T17:39:02.189285] [INFO ] [LOCAL     ] BNED: Starting deletion of derivative data.
[2025-10-24T17:39:02.189453] [DEBUG] [LOCAL     ] BNED: Deleted derivative data file.
[2025-10-24T17:39:02.189552] [INFO ] [MAIN      ] Update Progress: 313/2366 symbols completed. BNED took 31.4s. Estimated remaining: 4h 15m 44s. Rate: 8.0 symbols/min
[2025-10-24T17:39:02.369365] [INFO ] [MAIN      ] BNS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:39:02.418969] [DEBUG] [LOCAL     ] BNS: Loaded 51760 existing records from primary storage.
[2025-10-24T17:39:02.419310] [INFO ] [MAIN      ] BNS: Loaded 51760 existing records.
[2025-10-24T17:39:02.558578] [INFO ] [REMOTE    ] BNJ: Fetching primary data for 2025-07.
[2025-10-24T17:39:02.598879] [WARN ] [MAIN      ] BNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:39:02.599231] [INFO ] [MAIN      ] BNS: Wiping existing primary data before full refresh.
[2025-10-24T17:39:02.599278] [INFO ] [LOCAL     ] BNS: Starting deletion of primary data.
[2025-10-24T17:39:02.600155] [DEBUG] [LOCAL     ] BNS: Deleted primary data file.
[2025-10-24T17:39:02.600213] [INFO ] [MAIN      ] BNS: Starting full primary refresh.
[2025-10-24T17:39:02.957825] [INFO ] [REMOTE    ] BNS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:39:03.347687] [INFO ] [REMOTE    ] BNH: Fetching primary data for 2025-05.
[2025-10-24T17:39:04.147673] [INFO ] [REMOTE    ] BNS: Fetching primary data for 2025-01.
[2025-10-24T17:39:04.183724] [INFO ] [REMOTE    ] BNJ: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T17:39:04.680477] [INFO ] [REMOTE    ] BNH: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T17:39:04.764400] [INFO ] [REMOTE    ] BNL: Incremental fetch complete for 2025-01 (3.02 seconds).
[2025-10-24T17:39:04.947673] [INFO ] [REMOTE    ] BNJ: Fetching primary data for 2025-08.
[2025-10-24T17:39:05.432840] [INFO ] [REMOTE    ] BNJ: Incremental fetch complete for 2025-08 (0.49 seconds).
[2025-10-24T17:39:05.747721] [INFO ] [REMOTE    ] BNH: Fetching primary data for 2025-06.
[2025-10-24T17:39:05.889693] [INFO ] [REMOTE    ] BNS: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T17:39:06.456824] [INFO ] [REMOTE    ] BNH: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T17:39:06.547696] [INFO ] [REMOTE    ] BNL: Fetching primary data for 2025-02.
[2025-10-24T17:39:07.347732] [INFO ] [REMOTE    ] BNS: Fetching primary data for 2025-02.
[2025-10-24T17:39:08.147746] [INFO ] [REMOTE    ] BNJ: Fetching primary data for 2025-09.
[2025-10-24T17:39:08.570596] [INFO ] [REMOTE    ] BNJ: Incremental fetch complete for 2025-09 (0.42 seconds).
[2025-10-24T17:39:08.947613] [INFO ] [REMOTE    ] BNJ: Fetching primary data for 2025-10.
[2025-10-24T17:39:09.064165] [INFO ] [REMOTE    ] BNS: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T17:39:09.490611] [INFO ] [REMOTE    ] BNJ: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T17:39:09.491614] [INFO ] [REMOTE    ] BNJ: Full fetch complete (3845 records).
[2025-10-24T17:39:09.491720] [DEBUG] [VALIDATOR ] BNJ: Validating primary data.
[2025-10-24T17:39:09.752896] [INFO ] [REMOTE    ] BNS: Fetching primary data for 2025-03.
[2025-10-24T17:39:09.856441] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present.
[2025-10-24T17:39:09.856518] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed.
[2025-10-24T17:39:09.856681] [INFO ] [MAIN      ] BNJ: Fetched primary data is valid.
[2025-10-24T17:39:09.856742] [DEBUG] [LOCAL     ] BNJ: Saving primary data.
[2025-10-24T17:39:09.856958] [FATAL] [LOCAL     ] BNJ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:39:09.857042] [FATAL] [MAIN      ] BNJ: Failed to save primary data.
[2025-10-24T17:39:09.857084] [WARN ] [MAIN      ] BNJ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:39:09.857147] [INFO ] [LOCAL     ] BNJ: Starting deletion of primary data.
[2025-10-24T17:39:09.857205] [DEBUG] [LOCAL     ] BNJ: No primary data file found to delete.
[2025-10-24T17:39:09.857240] [INFO ] [LOCAL     ] BNJ: Starting deletion of derivative data.
[2025-10-24T17:39:09.857400] [DEBUG] [LOCAL     ] BNJ: Deleted derivative data file.
[2025-10-24T17:39:09.857490] [INFO ] [MAIN      ] Update Progress: 314/2366 symbols completed. BNJ took 20.7s. Estimated remaining: 4h 15m 37s. Rate: 8.0 symbols/min
[2025-10-24T17:39:10.029604] [INFO ] [MAIN      ] BNT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:39:10.035580] [DEBUG] [LOCAL     ] BNT: Loaded 3545 existing records from primary storage.
[2025-10-24T17:39:10.035800] [INFO ] [MAIN      ] BNT: Loaded 3545 existing records.
[2025-10-24T17:39:10.210176] [WARN ] [MAIN      ] BNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:39:10.210424] [INFO ] [MAIN      ] BNT: Wiping existing primary data before full refresh.
[2025-10-24T17:39:10.210469] [INFO ] [LOCAL     ] BNT: Starting deletion of primary data.
[2025-10-24T17:39:10.210756] [DEBUG] [LOCAL     ] BNT: Deleted primary data file.
[2025-10-24T17:39:10.210821] [INFO ] [MAIN      ] BNT: Starting full primary refresh.
[2025-10-24T17:39:10.561380] [INFO ] [REMOTE    ] BNH: Fetching primary data for 2025-07.
[2025-10-24T17:39:10.566079] [INFO ] [REMOTE    ] BNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:39:11.133235] [INFO ] [REMOTE    ] BNH: Incremental fetch complete for 2025-07 (0.57 seconds).
[2025-10-24T17:39:11.347739] [INFO ] [REMOTE    ] BNH: Fetching primary data for 2025-08.
[2025-10-24T17:39:11.521923] [INFO ] [REMOTE    ] BNS: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T17:39:11.559411] [INFO ] [REMOTE    ] BNL: Incremental fetch complete for 2025-02 (5.01 seconds).
[2025-10-24T17:39:11.814835] [INFO ] [REMOTE    ] BNH: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T17:39:12.147719] [INFO ] [REMOTE    ] BNT: Fetching primary data for 2025-01.
[2025-10-24T17:39:12.630536] [INFO ] [REMOTE    ] BNT: Incremental fetch complete for 2025-01 (0.48 seconds).
[2025-10-24T17:39:12.947633] [INFO ] [REMOTE    ] BNH: Fetching primary data for 2025-09.
[2025-10-24T17:39:13.529455] [INFO ] [REMOTE    ] BNH: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T17:39:13.747683] [INFO ] [REMOTE    ] BNL: Fetching primary data for 2025-03.
[2025-10-24T17:39:14.547677] [INFO ] [REMOTE    ] BNH: Fetching primary data for 2025-10.
[2025-10-24T17:39:15.288828] [INFO ] [REMOTE    ] BNH: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T17:39:15.290516] [INFO ] [REMOTE    ] BNH: Full fetch complete (6842 records).
[2025-10-24T17:39:15.290609] [DEBUG] [VALIDATOR ] BNH: Validating primary data.
[2025-10-24T17:39:15.352965] [INFO ] [REMOTE    ] BNS: Fetching primary data for 2025-04.
[2025-10-24T17:39:15.624217] [INFO ] [REMOTE    ] BNL: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T17:39:15.724433] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present.
[2025-10-24T17:39:15.724515] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed.
[2025-10-24T17:39:15.724811] [INFO ] [MAIN      ] BNH: Fetched primary data is valid.
[2025-10-24T17:39:15.724873] [DEBUG] [LOCAL     ] BNH: Saving primary data.
[2025-10-24T17:39:15.725077] [FATAL] [LOCAL     ] BNH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:39:15.725131] [FATAL] [MAIN      ] BNH: Failed to save primary data.
[2025-10-24T17:39:15.725165] [WARN ] [MAIN      ] BNH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:39:15.725207] [INFO ] [LOCAL     ] BNH: Starting deletion of primary data.
[2025-10-24T17:39:15.725254] [DEBUG] [LOCAL     ] BNH: No primary data file found to delete.
[2025-10-24T17:39:15.725288] [INFO ] [LOCAL     ] BNH: Starting deletion of derivative data.
[2025-10-24T17:39:15.725424] [DEBUG] [LOCAL     ] BNH: Deleted derivative data file.
[2025-10-24T17:39:15.725495] [INFO ] [MAIN      ] Update Progress: 315/2366 symbols completed. BNH took 32.9s. Estimated remaining: 4h 15m 20s. Rate: 8.0 symbols/min
[2025-10-24T17:39:15.893735] [INFO ] [MAIN      ] BNY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:39:15.903464] [DEBUG] [LOCAL     ] BNY: Loaded 7273 existing records from primary storage.
[2025-10-24T17:39:15.903742] [INFO ] [MAIN      ] BNY: Loaded 7273 existing records.
[2025-10-24T17:39:16.081217] [WARN ] [MAIN      ] BNY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:39:16.081499] [INFO ] [MAIN      ] BNY: Wiping existing primary data before full refresh.
[2025-10-24T17:39:16.081554] [INFO ] [LOCAL     ] BNY: Starting deletion of primary data.
[2025-10-24T17:39:16.081858] [DEBUG] [LOCAL     ] BNY: Deleted primary data file.
[2025-10-24T17:39:16.081916] [INFO ] [MAIN      ] BNY: Starting full primary refresh.
[2025-10-24T17:39:16.154116] [INFO ] [REMOTE    ] BNT: Fetching primary data for 2025-02.
[2025-10-24T17:39:16.436080] [INFO ] [REMOTE    ] BNY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:39:16.650807] [INFO ] [REMOTE    ] BNT: Incremental fetch complete for 2025-02 (0.50 seconds).
[2025-10-24T17:39:16.947688] [INFO ] [REMOTE    ] BNT: Fetching primary data for 2025-03.
[2025-10-24T17:39:17.347030] [INFO ] [REMOTE    ] BNS: Incremental fetch complete for 2025-04 (1.99 seconds).
[2025-10-24T17:39:17.444211] [INFO ] [REMOTE    ] BNT: Incremental fetch complete for 2025-03 (0.50 seconds).
[2025-10-24T17:39:17.747668] [INFO ] [REMOTE    ] BNY: Fetching primary data for 2025-01.
[2025-10-24T17:39:18.475853] [INFO ] [REMOTE    ] BNY: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T17:39:18.547674] [INFO ] [REMOTE    ] BNY: Fetching primary data for 2025-02.
[2025-10-24T17:39:19.197253] [INFO ] [REMOTE    ] BNY: Incremental fetch complete for 2025-02 (0.65 seconds).
[2025-10-24T17:39:19.347729] [INFO ] [REMOTE    ] BNL: Fetching primary data for 2025-04.
[2025-10-24T17:39:20.147686] [INFO ] [REMOTE    ] BNY: Fetching primary data for 2025-03.
[2025-10-24T17:39:20.638928] [INFO ] [REMOTE    ] BNL: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T17:39:20.880577] [INFO ] [REMOTE    ] BNY: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T17:39:20.947682] [INFO ] [REMOTE    ] BNT: Fetching primary data for 2025-04.
[2025-10-24T17:39:21.318414] [INFO ] [REMOTE    ] BNT: Incremental fetch complete for 2025-04 (0.37 seconds).
[2025-10-24T17:39:21.747719] [INFO ] [REMOTE    ] BNT: Fetching primary data for 2025-05.
[2025-10-24T17:39:22.247407] [INFO ] [REMOTE    ] BNT: Incremental fetch complete for 2025-05 (0.50 seconds).
[2025-10-24T17:39:22.547700] [INFO ] [REMOTE    ] BNT: Fetching primary data for 2025-06.
[2025-10-24T17:39:23.094725] [INFO ] [REMOTE    ] BNT: Incremental fetch complete for 2025-06 (0.55 seconds).
[2025-10-24T17:39:23.347693] [INFO ] [REMOTE    ] BNS: Fetching primary data for 2025-05.
[2025-10-24T17:39:24.147668] [INFO ] [REMOTE    ] BNL: Fetching primary data for 2025-05.
[2025-10-24T17:39:24.915969] [INFO ] [REMOTE    ] BNS: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T17:39:24.947681] [INFO ] [REMOTE    ] BNT: Fetching primary data for 2025-07.
[2025-10-24T17:39:25.356025] [INFO ] [REMOTE    ] BNL: Incremental fetch complete for 2025-05 (1.21 seconds).
[2025-10-24T17:39:25.481741] [INFO ] [REMOTE    ] BNT: Incremental fetch complete for 2025-07 (0.53 seconds).
[2025-10-24T17:39:25.747727] [INFO ] [REMOTE    ] BNS: Fetching primary data for 2025-06.
[2025-10-24T17:39:26.547629] [INFO ] [REMOTE    ] BNL: Fetching primary data for 2025-06.
[2025-10-24T17:39:27.347736] [INFO ] [REMOTE    ] BNY: Fetching primary data for 2025-04.
[2025-10-24T17:39:27.539177] [INFO ] [REMOTE    ] BNS: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T17:39:27.872389] [INFO ] [REMOTE    ] BNY: Incremental fetch complete for 2025-04 (0.52 seconds).
[2025-10-24T17:39:27.960026] [INFO ] [REMOTE    ] BNL: Incremental fetch complete for 2025-06 (1.41 seconds).
[2025-10-24T17:39:28.147676] [INFO ] [REMOTE    ] BNY: Fetching primary data for 2025-05.
[2025-10-24T17:39:28.718459] [INFO ] [REMOTE    ] BNY: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T17:39:28.947672] [INFO ] [REMOTE    ] BNS: Fetching primary data for 2025-07.
[2025-10-24T17:39:29.747714] [INFO ] [REMOTE    ] BNL: Fetching primary data for 2025-07.
[2025-10-24T17:39:30.321821] [INFO ] [REMOTE    ] BNS: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T17:39:30.547691] [INFO ] [REMOTE    ] BNY: Fetching primary data for 2025-06.
[2025-10-24T17:39:31.118120] [INFO ] [REMOTE    ] BNL: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T17:39:31.192747] [INFO ] [REMOTE    ] BNY: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T17:39:31.347674] [INFO ] [REMOTE    ] BNY: Fetching primary data for 2025-07.
[2025-10-24T17:39:32.094855] [INFO ] [REMOTE    ] BNY: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T17:39:32.147615] [INFO ] [REMOTE    ] BNY: Fetching primary data for 2025-08.
[2025-10-24T17:39:32.734913] [INFO ] [REMOTE    ] BNY: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T17:39:32.947718] [INFO ] [REMOTE    ] BNT: Fetching primary data for 2025-08.
[2025-10-24T17:39:33.461899] [INFO ] [REMOTE    ] BNT: Incremental fetch complete for 2025-08 (0.51 seconds).
[2025-10-24T17:39:33.747676] [INFO ] [REMOTE    ] BNY: Fetching primary data for 2025-09.
[2025-10-24T17:39:34.431084] [INFO ] [REMOTE    ] BNY: Incremental fetch complete for 2025-09 (0.68 seconds).
[2025-10-24T17:39:34.547670] [INFO ] [REMOTE    ] BNY: Fetching primary data for 2025-10.
[2025-10-24T17:39:35.347679] [INFO ] [REMOTE    ] BNT: Fetching primary data for 2025-09.
[2025-10-24T17:39:35.388960] [INFO ] [REMOTE    ] BNY: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T17:39:35.391026] [INFO ] [REMOTE    ] BNY: Full fetch complete (10362 records).
[2025-10-24T17:39:35.391098] [DEBUG] [VALIDATOR ] BNY: Validating primary data.
[2025-10-24T17:39:35.751615] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present.
[2025-10-24T17:39:35.751720] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed.
[2025-10-24T17:39:35.751966] [INFO ] [MAIN      ] BNY: Fetched primary data is valid.
[2025-10-24T17:39:35.752085] [DEBUG] [LOCAL     ] BNY: Saving primary data.
[2025-10-24T17:39:35.752308] [FATAL] [LOCAL     ] BNY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:39:35.752386] [FATAL] [MAIN      ] BNY: Failed to save primary data.
[2025-10-24T17:39:35.752426] [WARN ] [MAIN      ] BNY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:39:35.752460] [INFO ] [LOCAL     ] BNY: Starting deletion of primary data.
[2025-10-24T17:39:35.752524] [DEBUG] [LOCAL     ] BNY: No primary data file found to delete.
[2025-10-24T17:39:35.752577] [INFO ] [LOCAL     ] BNY: Starting deletion of derivative data.
[2025-10-24T17:39:35.753096] [DEBUG] [LOCAL     ] BNY: Deleted derivative data file.
[2025-10-24T17:39:35.753182] [INFO ] [MAIN      ] Update Progress: 316/2366 symbols completed. BNY took 20.0s. Estimated remaining: 4h 16m 34s. Rate: 8.0 symbols/min
[2025-10-24T17:39:35.923490] [INFO ] [MAIN      ] BOC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:39:35.942686] [DEBUG] [LOCAL     ] BOC: Loaded 18283 existing records from primary storage.
[2025-10-24T17:39:35.942937] [INFO ] [MAIN      ] BOC: Loaded 18283 existing records.
[2025-10-24T17:39:36.049742] [INFO ] [REMOTE    ] BNT: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T17:39:36.127734] [WARN ] [MAIN      ] BOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:39:36.127986] [INFO ] [MAIN      ] BOC: Wiping existing primary data before full refresh.
[2025-10-24T17:39:36.128063] [INFO ] [LOCAL     ] BOC: Starting deletion of primary data.
[2025-10-24T17:39:36.128479] [DEBUG] [LOCAL     ] BOC: Deleted primary data file.
[2025-10-24T17:39:36.128537] [INFO ] [MAIN      ] BOC: Starting full primary refresh.
[2025-10-24T17:39:36.157342] [INFO ] [REMOTE    ] BNT: Fetching primary data for 2025-10.
[2025-10-24T17:39:36.488390] [INFO ] [REMOTE    ] BOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:39:36.844346] [INFO ] [REMOTE    ] BNT: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T17:39:36.845797] [INFO ] [REMOTE    ] BNT: Full fetch complete (4829 records).
[2025-10-24T17:39:36.845866] [DEBUG] [VALIDATOR ] BNT: Validating primary data.
[2025-10-24T17:39:36.948560] [INFO ] [REMOTE    ] BOC: Fetching primary data for 2025-01.
[2025-10-24T17:39:37.214509] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present.
[2025-10-24T17:39:37.214591] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed.
[2025-10-24T17:39:37.214789] [INFO ] [MAIN      ] BNT: Fetched primary data is valid.
[2025-10-24T17:39:37.214851] [DEBUG] [LOCAL     ] BNT: Saving primary data.
[2025-10-24T17:39:37.215048] [FATAL] [LOCAL     ] BNT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:39:37.215128] [FATAL] [MAIN      ] BNT: Failed to save primary data.
[2025-10-24T17:39:37.215171] [WARN ] [MAIN      ] BNT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:39:37.215207] [INFO ] [LOCAL     ] BNT: Starting deletion of primary data.
[2025-10-24T17:39:37.215256] [DEBUG] [LOCAL     ] BNT: No primary data file found to delete.
[2025-10-24T17:39:37.215292] [INFO ] [LOCAL     ] BNT: Starting deletion of derivative data.
[2025-10-24T17:39:37.215421] [DEBUG] [LOCAL     ] BNT: Deleted derivative data file.
[2025-10-24T17:39:37.215501] [INFO ] [MAIN      ] Update Progress: 317/2366 symbols completed. BNT took 27.4s. Estimated remaining: 4h 15m 47s. Rate: 8.0 symbols/min
[2025-10-24T17:39:37.747690] [INFO ] [REMOTE    ] BNS: Fetching primary data for 2025-08.
[2025-10-24T17:39:37.939728] [INFO ] [REMOTE    ] BOC: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T17:39:38.547619] [INFO ] [REMOTE    ] BNL: Fetching primary data for 2025-08.
[2025-10-24T17:39:39.347631] [INFO ] [REMOTE    ] BOC: Fetching primary data for 2025-02.
[2025-10-24T17:39:39.423211] [INFO ] [REMOTE    ] BNS: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T17:39:39.908035] [INFO ] [REMOTE    ] BNL: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T17:39:40.147720] [INFO ] [REMOTE    ] BNS: Fetching primary data for 2025-09.
[2025-10-24T17:39:40.184700] [INFO ] [REMOTE    ] BOC: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T17:39:40.947732] [INFO ] [REMOTE    ] BOC: Fetching primary data for 2025-03.
[2025-10-24T17:39:41.479463] [INFO ] [REMOTE    ] BNS: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T17:39:41.747699] [INFO ] [REMOTE    ] BNL: Fetching primary data for 2025-09.
[2025-10-24T17:39:41.938093] [INFO ] [REMOTE    ] BOC: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T17:39:42.547735] [INFO ] [REMOTE    ] BNS: Fetching primary data for 2025-10.
[2025-10-24T17:39:43.185544] [INFO ] [REMOTE    ] BNL: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T17:39:43.347697] [INFO ] [REMOTE    ] BNL: Fetching primary data for 2025-10.
[2025-10-24T17:39:43.817461] [INFO ] [REMOTE    ] BNS: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T17:39:43.826831] [INFO ] [REMOTE    ] BNS: Full fetch complete (74600 records).
[2025-10-24T17:39:43.826966] [DEBUG] [VALIDATOR ] BNS: Validating primary data.
[2025-10-24T17:39:44.152894] [INFO ] [REMOTE    ] BOC: Fetching primary data for 2025-04.
[2025-10-24T17:39:44.208407] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present.
[2025-10-24T17:39:44.208501] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed.
[2025-10-24T17:39:44.209518] [INFO ] [MAIN      ] BNS: Fetched primary data is valid.
[2025-10-24T17:39:44.209583] [DEBUG] [LOCAL     ] BNS: Saving primary data.
[2025-10-24T17:39:44.210209] [FATAL] [LOCAL     ] BNS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:39:44.210819] [FATAL] [MAIN      ] BNS: Failed to save primary data.
[2025-10-24T17:39:44.210923] [WARN ] [MAIN      ] BNS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:39:44.210997] [INFO ] [LOCAL     ] BNS: Starting deletion of primary data.
[2025-10-24T17:39:44.211071] [DEBUG] [LOCAL     ] BNS: No primary data file found to delete.
[2025-10-24T17:39:44.211111] [INFO ] [LOCAL     ] BNS: Starting deletion of derivative data.
[2025-10-24T17:39:44.211248] [DEBUG] [LOCAL     ] BNS: Deleted derivative data file.
[2025-10-24T17:39:44.211778] [INFO ] [MAIN      ] Update Progress: 318/2366 symbols completed. BNS took 42.0s. Estimated remaining: 4h 15m 36s. Rate: 8.0 symbols/min
[2025-10-24T17:39:44.809559] [INFO ] [REMOTE    ] BNL: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T17:39:44.818516] [INFO ] [REMOTE    ] BNL: Full fetch complete (67208 records).
[2025-10-24T17:39:44.818706] [DEBUG] [VALIDATOR ] BNL: Validating primary data.
[2025-10-24T17:39:45.301820] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present.
[2025-10-24T17:39:45.302021] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed.
[2025-10-24T17:39:45.303491] [INFO ] [MAIN      ] BNL: Fetched primary data is valid.
[2025-10-24T17:39:45.303586] [DEBUG] [LOCAL     ] BNL: Saving primary data.
[2025-10-24T17:39:45.304306] [FATAL] [LOCAL     ] BNL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:39:45.304419] [FATAL] [MAIN      ] BNL: Failed to save primary data.
[2025-10-24T17:39:45.304494] [WARN ] [MAIN      ] BNL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:39:45.304585] [INFO ] [LOCAL     ] BNL: Starting deletion of primary data.
[2025-10-24T17:39:45.304702] [DEBUG] [LOCAL     ] BNL: No primary data file found to delete.
[2025-10-24T17:39:45.304763] [INFO ] [LOCAL     ] BNL: Starting deletion of derivative data.
[2025-10-24T17:39:45.304907] [DEBUG] [LOCAL     ] BNL: Deleted derivative data file.
[2025-10-24T17:39:45.305318] [INFO ] [MAIN      ] Update Progress: 319/2366 symbols completed. BNL took 44.6s. Estimated remaining: 4h 14m 48s. Rate: 8.0 symbols/min
[2025-10-24T17:39:45.363504] [INFO ] [REMOTE    ] BOC: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T17:39:45.369689] [INFO ] [REMOTE    ] BOC: Fetching primary data for 2025-05.
[2025-10-24T17:39:46.294486] [INFO ] [REMOTE    ] BOC: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T17:39:46.298623] [INFO ] [REMOTE    ] BOC: Fetching primary data for 2025-06.
[2025-10-24T17:39:47.044244] [INFO ] [REMOTE    ] BOC: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T17:39:47.048133] [INFO ] [REMOTE    ] BOC: Fetching primary data for 2025-07.
[2025-10-24T17:39:48.009675] [INFO ] [REMOTE    ] BOC: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T17:39:48.014228] [INFO ] [REMOTE    ] BOC: Fetching primary data for 2025-08.
[2025-10-24T17:39:49.001560] [INFO ] [REMOTE    ] BOC: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T17:39:49.007032] [INFO ] [REMOTE    ] BOC: Fetching primary data for 2025-09.
[2025-10-24T17:39:49.745156] [INFO ] [REMOTE    ] BOC: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T17:39:49.749338] [INFO ] [REMOTE    ] BOC: Fetching primary data for 2025-10.
[2025-10-24T17:39:50.779603] [INFO ] [REMOTE    ] BOC: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T17:39:50.783289] [INFO ] [REMOTE    ] BOC: Full fetch complete (25788 records).
[2025-10-24T17:39:50.783397] [DEBUG] [VALIDATOR ] BOC: Validating primary data.
[2025-10-24T17:39:51.145396] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present.
[2025-10-24T17:39:51.145468] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed.
[2025-10-24T17:39:51.145875] [INFO ] [MAIN      ] BOC: Fetched primary data is valid.
[2025-10-24T17:39:51.145935] [DEBUG] [LOCAL     ] BOC: Saving primary data.
[2025-10-24T17:39:51.146216] [FATAL] [LOCAL     ] BOC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:39:51.146292] [FATAL] [MAIN      ] BOC: Failed to save primary data.
[2025-10-24T17:39:51.146333] [WARN ] [MAIN      ] BOC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:39:51.146366] [INFO ] [LOCAL     ] BOC: Starting deletion of primary data.
[2025-10-24T17:39:51.146423] [DEBUG] [LOCAL     ] BOC: No primary data file found to delete.
[2025-10-24T17:39:51.146489] [INFO ] [LOCAL     ] BOC: Starting deletion of derivative data.
[2025-10-24T17:39:51.146702] [DEBUG] [LOCAL     ] BOC: Deleted derivative data file.
[2025-10-24T17:39:51.146821] [INFO ] [MAIN      ] Update Progress: 320/2366 symbols completed. BOC took 15.4s. Estimated remaining: 4h 14m 30s. Rate: 8.0 symbols/min
[2025-10-24T17:39:51.698249] [INFO ] [MAIN      ] BOE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:39:51.845215] [INFO ] [MAIN      ] BOND: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:39:51.882889] [INFO ] [MAIN      ] BOH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:39:51.885832] [INFO ] [MAIN      ] BOOT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:39:51.893222] [DEBUG] [LOCAL     ] BOOT: No existing data file found in primary storage.
[2025-10-24T17:39:51.893306] [WARN ] [MAIN      ] BOOT: No existing data found, performing full refresh instead.
[2025-10-24T17:39:51.893455] [INFO ] [MAIN      ] BOOT: Wiping existing primary data before full refresh.
[2025-10-24T17:39:51.894247] [DEBUG] [LOCAL     ] BOE: Loaded 18140 existing records from primary storage.
[2025-10-24T17:39:51.894324] [INFO ] [LOCAL     ] BOOT: Starting deletion of primary data.
[2025-10-24T17:39:51.894678] [DEBUG] [LOCAL     ] BOOT: No primary data file found to delete.
[2025-10-24T17:39:51.894975] [INFO ] [MAIN      ] BOE: Loaded 18140 existing records.
[2025-10-24T17:39:51.895079] [INFO ] [MAIN      ] BOOT: Starting full primary refresh.
[2025-10-24T17:39:52.283235] [WARN ] [MAIN      ] BOE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:39:52.301727] [DEBUG] [LOCAL     ] BOND: Loaded 32652 existing records from primary storage.
[2025-10-24T17:39:52.300938] [DEBUG] [LOCAL     ] BOH: Loaded 30852 existing records from primary storage.
[2025-10-24T17:39:52.309032] [INFO ] [MAIN      ] BOND: Loaded 32652 existing records.
[2025-10-24T17:39:52.316392] [INFO ] [MAIN      ] BOH: Loaded 30852 existing records.
[2025-10-24T17:39:52.326169] [INFO ] [MAIN      ] BOE: Wiping existing primary data before full refresh.
[2025-10-24T17:39:52.355717] [INFO ] [LOCAL     ] BOE: Starting deletion of primary data.
[2025-10-24T17:39:52.405263] [DEBUG] [LOCAL     ] BOE: Deleted primary data file.
[2025-10-24T17:39:52.444664] [INFO ] [MAIN      ] BOE: Starting full primary refresh.
[2025-10-24T17:39:52.930433] [WARN ] [MAIN      ] BOH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:39:52.975663] [INFO ] [MAIN      ] BOH: Wiping existing primary data before full refresh.
[2025-10-24T17:39:52.984049] [WARN ] [MAIN      ] BOND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:39:52.987011] [INFO ] [LOCAL     ] BOH: Starting deletion of primary data.
[2025-10-24T17:39:52.986939] [INFO ] [MAIN      ] BOND: Wiping existing primary data before full refresh.
[2025-10-24T17:39:53.000820] [INFO ] [LOCAL     ] BOND: Starting deletion of primary data.
[2025-10-24T17:39:53.058484] [DEBUG] [LOCAL     ] BOH: Deleted primary data file.
[2025-10-24T17:39:53.042334] [DEBUG] [LOCAL     ] BOND: Deleted primary data file.
[2025-10-24T17:39:53.075341] [INFO ] [MAIN      ] BOH: Starting full primary refresh.
[2025-10-24T17:39:53.075264] [INFO ] [REMOTE    ] BOOT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:39:53.080694] [INFO ] [MAIN      ] BOND: Starting full primary refresh.
[2025-10-24T17:39:53.107876] [INFO ] [REMOTE    ] BOOT: Fetching primary data for 2025-01.
[2025-10-24T17:39:53.425005] [INFO ] [REMOTE    ] BOE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:39:53.443843] [INFO ] [REMOTE    ] BOE: Fetching primary data for 2025-01.
[2025-10-24T17:39:53.923410] [INFO ] [REMOTE    ] BOH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:39:53.929613] [INFO ] [REMOTE    ] BOH: Fetching primary data for 2025-01.
[2025-10-24T17:39:54.002412] [INFO ] [REMOTE    ] BOND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:39:54.002769] [INFO ] [REMOTE    ] BOND: Fetching primary data for 2025-01.
[2025-10-24T17:39:54.603381] [INFO ] [REMOTE    ] BOE: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T17:39:54.608331] [INFO ] [REMOTE    ] BOE: Fetching primary data for 2025-02.
[2025-10-24T17:39:54.823849] [INFO ] [REMOTE    ] BOOT: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T17:39:54.832631] [INFO ] [REMOTE    ] BOOT: Fetching primary data for 2025-02.
[2025-10-24T17:39:54.944844] [INFO ] [REMOTE    ] BOND: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T17:39:54.951509] [INFO ] [REMOTE    ] BOND: Fetching primary data for 2025-02.
[2025-10-24T17:39:54.990355] [INFO ] [REMOTE    ] BOH: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T17:39:55.347756] [INFO ] [REMOTE    ] BOH: Fetching primary data for 2025-02.
[2025-10-24T17:39:55.561283] [INFO ] [REMOTE    ] BOE: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T17:39:56.115289] [INFO ] [REMOTE    ] BOND: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T17:39:56.147613] [INFO ] [REMOTE    ] BOE: Fetching primary data for 2025-03.
[2025-10-24T17:39:56.304004] [INFO ] [REMOTE    ] BOOT: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T17:39:56.408094] [INFO ] [REMOTE    ] BOH: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T17:39:56.947677] [INFO ] [REMOTE    ] BOH: Fetching primary data for 2025-03.
[2025-10-24T17:39:57.080495] [INFO ] [REMOTE    ] BOE: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T17:39:57.747719] [INFO ] [REMOTE    ] BOE: Fetching primary data for 2025-04.
[2025-10-24T17:39:58.299620] [INFO ] [REMOTE    ] BOH: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T17:39:58.547612] [INFO ] [REMOTE    ] BOH: Fetching primary data for 2025-04.
[2025-10-24T17:39:58.777902] [INFO ] [REMOTE    ] BOE: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T17:39:59.347672] [INFO ] [REMOTE    ] BOOT: Fetching primary data for 2025-03.
[2025-10-24T17:39:59.932371] [INFO ] [REMOTE    ] BOH: Incremental fetch complete for 2025-04 (1.38 seconds).
[2025-10-24T17:40:00.147687] [INFO ] [REMOTE    ] BOND: Fetching primary data for 2025-03.
[2025-10-24T17:40:00.922198] [INFO ] [REMOTE    ] BOOT: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T17:40:00.947610] [INFO ] [REMOTE    ] BOOT: Fetching primary data for 2025-04.
[2025-10-24T17:40:01.747711] [INFO ] [REMOTE    ] BOE: Fetching primary data for 2025-05.
[2025-10-24T17:40:01.967560] [INFO ] [REMOTE    ] BOND: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T17:40:02.547732] [INFO ] [REMOTE    ] BOND: Fetching primary data for 2025-04.
[2025-10-24T17:40:03.347720] [INFO ] [REMOTE    ] BOH: Fetching primary data for 2025-05.
[2025-10-24T17:40:03.956425] [INFO ] [REMOTE    ] BOOT: Incremental fetch complete for 2025-04 (3.01 seconds).
[2025-10-24T17:40:04.147612] [INFO ] [REMOTE    ] BOOT: Fetching primary data for 2025-05.
[2025-10-24T17:40:04.298733] [INFO ] [REMOTE    ] BOE: Incremental fetch complete for 2025-05 (2.55 seconds).
[2025-10-24T17:40:04.947678] [INFO ] [REMOTE    ] BOE: Fetching primary data for 2025-06.
[2025-10-24T17:40:05.356746] [INFO ] [REMOTE    ] BOH: Incremental fetch complete for 2025-05 (2.01 seconds).
[2025-10-24T17:40:05.747623] [INFO ] [REMOTE    ] BOH: Fetching primary data for 2025-06.
[2025-10-24T17:40:06.146264] [INFO ] [REMOTE    ] BOE: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T17:40:06.152207] [INFO ] [REMOTE    ] BOOT: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T17:40:06.282083] [INFO ] [REMOTE    ] BOND: Incremental fetch complete for 2025-04 (3.73 seconds).
[2025-10-24T17:40:06.547638] [INFO ] [REMOTE    ] BOND: Fetching primary data for 2025-05.
[2025-10-24T17:40:07.347629] [INFO ] [REMOTE    ] BOOT: Fetching primary data for 2025-06.
[2025-10-24T17:40:07.370161] [INFO ] [REMOTE    ] BOH: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T17:40:07.534531] [INFO ] [REMOTE    ] BOND: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T17:40:08.147636] [INFO ] [REMOTE    ] BOND: Fetching primary data for 2025-06.
[2025-10-24T17:40:08.584818] [INFO ] [REMOTE    ] BOOT: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T17:40:08.947620] [INFO ] [REMOTE    ] BOE: Fetching primary data for 2025-07.
[2025-10-24T17:40:09.370971] [INFO ] [REMOTE    ] BOND: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T17:40:09.747618] [INFO ] [REMOTE    ] BOH: Fetching primary data for 2025-07.
[2025-10-24T17:40:09.899341] [INFO ] [REMOTE    ] BOE: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T17:40:10.547721] [INFO ] [REMOTE    ] BOOT: Fetching primary data for 2025-07.
[2025-10-24T17:40:11.048149] [INFO ] [REMOTE    ] BOH: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T17:40:11.347744] [INFO ] [REMOTE    ] BOND: Fetching primary data for 2025-07.
[2025-10-24T17:40:11.821552] [INFO ] [REMOTE    ] BOOT: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T17:40:12.147757] [INFO ] [REMOTE    ] BOH: Fetching primary data for 2025-08.
[2025-10-24T17:40:12.293167] [INFO ] [REMOTE    ] BOND: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T17:40:12.947636] [INFO ] [REMOTE    ] BOND: Fetching primary data for 2025-08.
[2025-10-24T17:40:13.505887] [INFO ] [REMOTE    ] BOH: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T17:40:13.747715] [INFO ] [REMOTE    ] BOOT: Fetching primary data for 2025-08.
[2025-10-24T17:40:14.105322] [INFO ] [REMOTE    ] BOND: Incremental fetch complete for 2025-08 (1.16 seconds).
[2025-10-24T17:40:14.547666] [INFO ] [REMOTE    ] BOND: Fetching primary data for 2025-09.
[2025-10-24T17:40:15.347684] [INFO ] [REMOTE    ] BOH: Fetching primary data for 2025-09.
[2025-10-24T17:40:15.766588] [INFO ] [REMOTE    ] BOOT: Incremental fetch complete for 2025-08 (2.02 seconds).
[2025-10-24T17:40:16.147762] [INFO ] [REMOTE    ] BOOT: Fetching primary data for 2025-09.
[2025-10-24T17:40:16.761927] [INFO ] [REMOTE    ] BOH: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T17:40:16.947744] [INFO ] [REMOTE    ] BOH: Fetching primary data for 2025-10.
[2025-10-24T17:40:17.455794] [INFO ] [REMOTE    ] BOOT: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T17:40:17.539931] [INFO ] [REMOTE    ] BOND: Incremental fetch complete for 2025-09 (2.99 seconds).
[2025-10-24T17:40:17.747714] [INFO ] [REMOTE    ] BOOT: Fetching primary data for 2025-10.
[2025-10-24T17:40:18.521349] [INFO ] [REMOTE    ] BOH: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T17:40:18.531167] [INFO ] [REMOTE    ] BOH: Full fetch complete (45431 records).
[2025-10-24T17:40:18.531332] [DEBUG] [VALIDATOR ] BOH: Validating primary data.
[2025-10-24T17:40:18.552812] [INFO ] [REMOTE    ] BOE: Fetching primary data for 2025-08.
[2025-10-24T17:40:18.935413] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present.
[2025-10-24T17:40:18.935691] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed.
[2025-10-24T17:40:18.936640] [INFO ] [MAIN      ] BOH: Fetched primary data is valid.
[2025-10-24T17:40:18.936773] [DEBUG] [LOCAL     ] BOH: Saving primary data.
[2025-10-24T17:40:18.943832] [FATAL] [LOCAL     ] BOH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:40:18.954709] [FATAL] [MAIN      ] BOH: Failed to save primary data.
[2025-10-24T17:40:18.954876] [WARN ] [MAIN      ] BOH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:40:18.956547] [INFO ] [REMOTE    ] BOOT: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T17:40:18.955549] [INFO ] [LOCAL     ] BOH: Starting deletion of primary data.
[2025-10-24T17:40:18.962876] [DEBUG] [LOCAL     ] BOH: No primary data file found to delete.
[2025-10-24T17:40:18.963365] [INFO ] [LOCAL     ] BOH: Starting deletion of derivative data.
[2025-10-24T17:40:18.963736] [DEBUG] [LOCAL     ] BOH: Deleted derivative data file.
[2025-10-24T17:40:18.963853] [INFO ] [MAIN      ] Update Progress: 321/2366 symbols completed. BOH took 27.7s. Estimated remaining: 4h 16m 32s. Rate: 8.0 symbols/min
[2025-10-24T17:40:18.964088] [INFO ] [REMOTE    ] BOOT: Full fetch complete (59524 records).
[2025-10-24T17:40:19.007715] [DEBUG] [VALIDATOR ] BOOT: Validating primary data.
[2025-10-24T17:40:19.069047] [FATAL] [VALIDATOR ] BOOT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:40:19.069239] [FATAL] [MAIN      ] BOOT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:40:19.069789] [WARN ] [MAIN      ] BOOT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:40:19.090956] [INFO ] [LOCAL     ] BOOT: Starting deletion of primary data.
[2025-10-24T17:40:19.123282] [DEBUG] [LOCAL     ] BOOT: No primary data file found to delete.
[2025-10-24T17:40:19.144103] [INFO ] [LOCAL     ] BOOT: Starting deletion of derivative data.
[2025-10-24T17:40:19.144018] [INFO ] [MAIN      ] BORR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:40:19.144278] [DEBUG] [LOCAL     ] BOOT: No derivative data file found to delete.
[2025-10-24T17:40:19.144825] [INFO ] [MAIN      ] Update Progress: 322/2366 symbols completed. BOOT took 28.0s. Estimated remaining: 4h 15m 38s. Rate: 8.0 symbols/min
[2025-10-24T17:40:19.324262] [INFO ] [MAIN      ] BOW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:40:19.349158] [INFO ] [REMOTE    ] BOND: Fetching primary data for 2025-10.
[2025-10-24T17:40:19.351980] [INFO ] [REMOTE    ] BOE: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T17:40:19.383073] [DEBUG] [LOCAL     ] BORR: Loaded 51455 existing records from primary storage.
[2025-10-24T17:40:19.383552] [INFO ] [MAIN      ] BORR: Loaded 51455 existing records.
[2025-10-24T17:40:19.498480] [DEBUG] [LOCAL     ] BOW: Loaded 22949 existing records from primary storage.
[2025-10-24T17:40:19.509880] [INFO ] [MAIN      ] BOW: Loaded 22949 existing records.
[2025-10-24T17:40:19.688571] [WARN ] [MAIN      ] BORR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:40:19.716942] [INFO ] [MAIN      ] BORR: Wiping existing primary data before full refresh.
[2025-10-24T17:40:19.727426] [INFO ] [LOCAL     ] BORR: Starting deletion of primary data.
[2025-10-24T17:40:19.776919] [DEBUG] [LOCAL     ] BORR: Deleted primary data file.
[2025-10-24T17:40:19.782803] [INFO ] [MAIN      ] BORR: Starting full primary refresh.
[2025-10-24T17:40:19.782478] [WARN ] [MAIN      ] BOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:40:19.848680] [INFO ] [MAIN      ] BOW: Wiping existing primary data before full refresh.
[2025-10-24T17:40:19.860699] [INFO ] [LOCAL     ] BOW: Starting deletion of primary data.
[2025-10-24T17:40:19.887733] [DEBUG] [LOCAL     ] BOW: Deleted primary data file.
[2025-10-24T17:40:19.888030] [INFO ] [MAIN      ] BOW: Starting full primary refresh.
[2025-10-24T17:40:20.153929] [INFO ] [REMOTE    ] BOE: Fetching primary data for 2025-09.
[2025-10-24T17:40:20.513957] [INFO ] [REMOTE    ] BORR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:40:20.585401] [INFO ] [REMOTE    ] BOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:40:20.851456] [INFO ] [REMOTE    ] BOND: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T17:40:20.858322] [INFO ] [REMOTE    ] BOND: Full fetch complete (46637 records).
[2025-10-24T17:40:20.858490] [DEBUG] [VALIDATOR ] BOND: Validating primary data.
[2025-10-24T17:40:20.952997] [INFO ] [REMOTE    ] BORR: Fetching primary data for 2025-01.
[2025-10-24T17:40:21.253103] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present.
[2025-10-24T17:40:21.253717] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed.
[2025-10-24T17:40:21.254850] [INFO ] [MAIN      ] BOND: Fetched primary data is valid.
[2025-10-24T17:40:21.254182] [INFO ] [REMOTE    ] BOE: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T17:40:21.255011] [DEBUG] [LOCAL     ] BOND: Saving primary data.
[2025-10-24T17:40:21.260069] [FATAL] [LOCAL     ] BOND: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:40:21.260448] [FATAL] [MAIN      ] BOND: Failed to save primary data.
[2025-10-24T17:40:21.260517] [WARN ] [MAIN      ] BOND: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:40:21.260561] [INFO ] [LOCAL     ] BOND: Starting deletion of primary data.
[2025-10-24T17:40:21.260615] [DEBUG] [LOCAL     ] BOND: No primary data file found to delete.
[2025-10-24T17:40:21.260682] [INFO ] [LOCAL     ] BOND: Starting deletion of derivative data.
[2025-10-24T17:40:21.260854] [DEBUG] [LOCAL     ] BOND: Deleted derivative data file.
[2025-10-24T17:40:21.260936] [INFO ] [MAIN      ] Update Progress: 323/2366 symbols completed. BOND took 30.1s. Estimated remaining: 4h 14m 56s. Rate: 8.0 symbols/min
[2025-10-24T17:40:21.435380] [INFO ] [MAIN      ] BOX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:40:21.483379] [DEBUG] [LOCAL     ] BOX: Loaded 50435 existing records from primary storage.
[2025-10-24T17:40:21.483791] [INFO ] [MAIN      ] BOX: Loaded 50435 existing records.
[2025-10-24T17:40:21.661538] [WARN ] [MAIN      ] BOX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:40:21.661766] [INFO ] [MAIN      ] BOX: Wiping existing primary data before full refresh.
[2025-10-24T17:40:21.661815] [INFO ] [LOCAL     ] BOX: Starting deletion of primary data.
[2025-10-24T17:40:21.662021] [DEBUG] [LOCAL     ] BOX: Deleted primary data file.
[2025-10-24T17:40:21.662076] [INFO ] [MAIN      ] BOX: Starting full primary refresh.
[2025-10-24T17:40:21.757538] [INFO ] [REMOTE    ] BOW: Fetching primary data for 2025-01.
[2025-10-24T17:40:22.030001] [INFO ] [REMOTE    ] BOX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:40:22.547618] [INFO ] [REMOTE    ] BOX: Fetching primary data for 2025-01.
[2025-10-24T17:40:22.773013] [INFO ] [REMOTE    ] BOW: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T17:40:22.774681] [INFO ] [REMOTE    ] BORR: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T17:40:23.347671] [INFO ] [REMOTE    ] BORR: Fetching primary data for 2025-02.
[2025-10-24T17:40:24.053930] [INFO ] [REMOTE    ] BOX: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T17:40:24.147724] [INFO ] [REMOTE    ] BOX: Fetching primary data for 2025-02.
[2025-10-24T17:40:24.845110] [INFO ] [REMOTE    ] BORR: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T17:40:24.947618] [INFO ] [REMOTE    ] BOE: Fetching primary data for 2025-10.
[2025-10-24T17:40:25.660946] [INFO ] [REMOTE    ] BOX: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T17:40:25.747609] [INFO ] [REMOTE    ] BORR: Fetching primary data for 2025-03.
[2025-10-24T17:40:26.048327] [INFO ] [REMOTE    ] BOE: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T17:40:26.054693] [INFO ] [REMOTE    ] BOE: Full fetch complete (26767 records).
[2025-10-24T17:40:26.054787] [DEBUG] [VALIDATOR ] BOE: Validating primary data.
[2025-10-24T17:40:26.421153] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present.
[2025-10-24T17:40:26.421244] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed.
[2025-10-24T17:40:26.421686] [INFO ] [MAIN      ] BOE: Fetched primary data is valid.
[2025-10-24T17:40:26.421745] [DEBUG] [LOCAL     ] BOE: Saving primary data.
[2025-10-24T17:40:26.422021] [FATAL] [LOCAL     ] BOE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:40:26.422107] [FATAL] [MAIN      ] BOE: Failed to save primary data.
[2025-10-24T17:40:26.422149] [WARN ] [MAIN      ] BOE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:40:26.422182] [INFO ] [LOCAL     ] BOE: Starting deletion of primary data.
[2025-10-24T17:40:26.422230] [DEBUG] [LOCAL     ] BOE: No primary data file found to delete.
[2025-10-24T17:40:26.422266] [INFO ] [LOCAL     ] BOE: Starting deletion of derivative data.
[2025-10-24T17:40:26.422406] [DEBUG] [LOCAL     ] BOE: Deleted derivative data file.
[2025-10-24T17:40:26.422493] [INFO ] [MAIN      ] Update Progress: 324/2366 symbols completed. BOE took 35.3s. Estimated remaining: 4h 14m 34s. Rate: 8.0 symbols/min
[2025-10-24T17:40:26.560413] [INFO ] [REMOTE    ] BOX: Fetching primary data for 2025-03.
[2025-10-24T17:40:26.591567] [INFO ] [MAIN      ] BP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:40:26.640753] [DEBUG] [LOCAL     ] BP: Loaded 54096 existing records from primary storage.
[2025-10-24T17:40:26.641053] [INFO ] [MAIN      ] BP: Loaded 54096 existing records.
[2025-10-24T17:40:26.817753] [WARN ] [MAIN      ] BP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:40:26.817962] [INFO ] [MAIN      ] BP: Wiping existing primary data before full refresh.
[2025-10-24T17:40:26.818007] [INFO ] [LOCAL     ] BP: Starting deletion of primary data.
[2025-10-24T17:40:26.818519] [DEBUG] [LOCAL     ] BP: Deleted primary data file.
[2025-10-24T17:40:26.818574] [INFO ] [MAIN      ] BP: Starting full primary refresh.
[2025-10-24T17:40:27.199176] [INFO ] [REMOTE    ] BP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:40:27.289947] [INFO ] [REMOTE    ] BORR: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T17:40:27.347604] [INFO ] [REMOTE    ] BORR: Fetching primary data for 2025-04.
[2025-10-24T17:40:28.177387] [INFO ] [REMOTE    ] BP: Fetching primary data for 2025-01.
[2025-10-24T17:40:28.199211] [INFO ] [REMOTE    ] BOX: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T17:40:28.601318] [INFO ] [REMOTE    ] BORR: Incremental fetch complete for 2025-04 (1.25 seconds).
[2025-10-24T17:40:28.947739] [INFO ] [REMOTE    ] BOX: Fetching primary data for 2025-04.
[2025-10-24T17:40:29.747624] [INFO ] [REMOTE    ] BOW: Fetching primary data for 2025-02.
[2025-10-24T17:40:30.094578] [INFO ] [REMOTE    ] BP: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T17:40:30.538853] [INFO ] [REMOTE    ] BOW: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T17:40:30.547593] [INFO ] [REMOTE    ] BOW: Fetching primary data for 2025-03.
[2025-10-24T17:40:30.661018] [INFO ] [REMOTE    ] BOX: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T17:40:31.347615] [INFO ] [REMOTE    ] BORR: Fetching primary data for 2025-05.
[2025-10-24T17:40:31.587232] [INFO ] [REMOTE    ] BOW: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T17:40:32.147749] [INFO ] [REMOTE    ] BP: Fetching primary data for 2025-02.
[2025-10-24T17:40:32.931478] [INFO ] [REMOTE    ] BORR: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T17:40:32.947847] [INFO ] [REMOTE    ] BOW: Fetching primary data for 2025-04.
[2025-10-24T17:40:33.649212] [INFO ] [REMOTE    ] BP: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T17:40:33.747699] [INFO ] [REMOTE    ] BORR: Fetching primary data for 2025-06.
[2025-10-24T17:40:34.099083] [INFO ] [REMOTE    ] BOW: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T17:40:34.547639] [INFO ] [REMOTE    ] BP: Fetching primary data for 2025-03.
[2025-10-24T17:40:35.168323] [INFO ] [REMOTE    ] BORR: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T17:40:35.347718] [INFO ] [REMOTE    ] BORR: Fetching primary data for 2025-07.
[2025-10-24T17:40:36.147705] [INFO ] [REMOTE    ] BOW: Fetching primary data for 2025-05.
[2025-10-24T17:40:36.459545] [INFO ] [REMOTE    ] BP: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T17:40:36.947620] [INFO ] [REMOTE    ] BP: Fetching primary data for 2025-04.
[2025-10-24T17:40:37.092575] [INFO ] [REMOTE    ] BORR: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T17:40:37.093582] [INFO ] [REMOTE    ] BOW: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T17:40:37.747672] [INFO ] [REMOTE    ] BOW: Fetching primary data for 2025-06.
[2025-10-24T17:40:38.547711] [INFO ] [REMOTE    ] BOX: Fetching primary data for 2025-05.
[2025-10-24T17:40:38.738933] [INFO ] [REMOTE    ] BOW: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T17:40:39.295983] [INFO ] [REMOTE    ] BP: Incremental fetch complete for 2025-04 (2.35 seconds).
[2025-10-24T17:40:39.347688] [INFO ] [REMOTE    ] BP: Fetching primary data for 2025-05.
[2025-10-24T17:40:39.943595] [INFO ] [REMOTE    ] BOX: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T17:40:40.147677] [INFO ] [REMOTE    ] BOW: Fetching primary data for 2025-07.
[2025-10-24T17:40:40.805093] [INFO ] [REMOTE    ] BOW: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T17:40:40.952758] [INFO ] [REMOTE    ] BOX: Fetching primary data for 2025-06.
[2025-10-24T17:40:40.968852] [INFO ] [REMOTE    ] BP: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T17:40:41.747637] [INFO ] [REMOTE    ] BOW: Fetching primary data for 2025-08.
[2025-10-24T17:40:42.460905] [INFO ] [REMOTE    ] BOX: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T17:40:42.547613] [INFO ] [REMOTE    ] BP: Fetching primary data for 2025-06.
[2025-10-24T17:40:42.648421] [INFO ] [REMOTE    ] BOW: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T17:40:43.347708] [INFO ] [REMOTE    ] BORR: Fetching primary data for 2025-08.
[2025-10-24T17:40:44.147711] [INFO ] [REMOTE    ] BOX: Fetching primary data for 2025-07.
[2025-10-24T17:40:44.381348] [INFO ] [REMOTE    ] BP: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T17:40:44.952747] [INFO ] [REMOTE    ] BOW: Fetching primary data for 2025-09.
[2025-10-24T17:40:44.970476] [INFO ] [REMOTE    ] BORR: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T17:40:45.672517] [INFO ] [REMOTE    ] BOX: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T17:40:45.727165] [INFO ] [REMOTE    ] BOW: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T17:40:45.747612] [INFO ] [REMOTE    ] BOW: Fetching primary data for 2025-10.
[2025-10-24T17:40:46.547620] [INFO ] [REMOTE    ] BP: Fetching primary data for 2025-07.
[2025-10-24T17:40:46.936330] [INFO ] [REMOTE    ] BOW: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T17:40:46.941278] [INFO ] [REMOTE    ] BOW: Full fetch complete (32063 records).
[2025-10-24T17:40:46.941366] [DEBUG] [VALIDATOR ] BOW: Validating primary data.
[2025-10-24T17:40:47.311785] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present.
[2025-10-24T17:40:47.311860] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed.
[2025-10-24T17:40:47.312299] [INFO ] [MAIN      ] BOW: Fetched primary data is valid.
[2025-10-24T17:40:47.312338] [DEBUG] [LOCAL     ] BOW: Saving primary data.
[2025-10-24T17:40:47.312636] [FATAL] [LOCAL     ] BOW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:40:47.312755] [FATAL] [MAIN      ] BOW: Failed to save primary data.
[2025-10-24T17:40:47.312830] [WARN ] [MAIN      ] BOW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:40:47.312924] [INFO ] [LOCAL     ] BOW: Starting deletion of primary data.
[2025-10-24T17:40:47.313001] [DEBUG] [LOCAL     ] BOW: No primary data file found to delete.
[2025-10-24T17:40:47.313040] [INFO ] [LOCAL     ] BOW: Starting deletion of derivative data.
[2025-10-24T17:40:47.313170] [DEBUG] [LOCAL     ] BOW: Deleted derivative data file.
[2025-10-24T17:40:47.313243] [INFO ] [MAIN      ] Update Progress: 325/2366 symbols completed. BOW took 28.2s. Estimated remaining: 4h 15m 51s. Rate: 8.0 symbols/min
[2025-10-24T17:40:47.355671] [INFO ] [REMOTE    ] BORR: Fetching primary data for 2025-09.
[2025-10-24T17:40:47.486723] [INFO ] [MAIN      ] BR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:40:47.520916] [DEBUG] [LOCAL     ] BR: Loaded 34763 existing records from primary storage.
[2025-10-24T17:40:47.521178] [INFO ] [MAIN      ] BR: Loaded 34763 existing records.
[2025-10-24T17:40:47.695155] [WARN ] [MAIN      ] BR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:40:47.695385] [INFO ] [MAIN      ] BR: Wiping existing primary data before full refresh.
[2025-10-24T17:40:47.695437] [INFO ] [LOCAL     ] BR: Starting deletion of primary data.
[2025-10-24T17:40:47.695688] [DEBUG] [LOCAL     ] BR: Deleted primary data file.
[2025-10-24T17:40:47.695743] [INFO ] [MAIN      ] BR: Starting full primary refresh.
[2025-10-24T17:40:48.047789] [INFO ] [REMOTE    ] BR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:40:48.147610] [INFO ] [REMOTE    ] BR: Fetching primary data for 2025-01.
[2025-10-24T17:40:48.276261] [INFO ] [REMOTE    ] BP: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T17:40:48.947699] [INFO ] [REMOTE    ] BP: Fetching primary data for 2025-08.
[2025-10-24T17:40:49.309330] [INFO ] [REMOTE    ] BR: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T17:40:49.347828] [INFO ] [REMOTE    ] BORR: Incremental fetch complete for 2025-09 (1.99 seconds).
[2025-10-24T17:40:49.747624] [INFO ] [REMOTE    ] BR: Fetching primary data for 2025-02.
[2025-10-24T17:40:50.547699] [INFO ] [REMOTE    ] BORR: Fetching primary data for 2025-10.
[2025-10-24T17:40:50.944204] [INFO ] [REMOTE    ] BP: Incremental fetch complete for 2025-08 (2.00 seconds).
[2025-10-24T17:40:51.074339] [INFO ] [REMOTE    ] BR: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T17:40:51.347680] [INFO ] [REMOTE    ] BP: Fetching primary data for 2025-09.
[2025-10-24T17:40:52.147622] [INFO ] [REMOTE    ] BR: Fetching primary data for 2025-03.
[2025-10-24T17:40:52.425243] [INFO ] [REMOTE    ] BORR: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T17:40:52.435756] [INFO ] [REMOTE    ] BORR: Full fetch complete (74540 records).
[2025-10-24T17:40:52.435895] [DEBUG] [VALIDATOR ] BORR: Validating primary data.
[2025-10-24T17:40:52.830556] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present.
[2025-10-24T17:40:52.830688] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed.
[2025-10-24T17:40:52.831557] [INFO ] [MAIN      ] BORR: Fetched primary data is valid.
[2025-10-24T17:40:52.831602] [DEBUG] [LOCAL     ] BORR: Saving primary data.
[2025-10-24T17:40:52.832214] [FATAL] [LOCAL     ] BORR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:40:52.832307] [FATAL] [MAIN      ] BORR: Failed to save primary data.
[2025-10-24T17:40:52.832350] [WARN ] [MAIN      ] BORR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:40:52.832386] [INFO ] [LOCAL     ] BORR: Starting deletion of primary data.
[2025-10-24T17:40:52.832440] [DEBUG] [LOCAL     ] BORR: No primary data file found to delete.
[2025-10-24T17:40:52.832476] [INFO ] [LOCAL     ] BORR: Starting deletion of derivative data.
[2025-10-24T17:40:52.832745] [DEBUG] [LOCAL     ] BORR: Deleted derivative data file.
[2025-10-24T17:40:52.833733] [INFO ] [MAIN      ] Update Progress: 326/2366 symbols completed. BORR took 33.9s. Estimated remaining: 4h 15m 31s. Rate: 8.0 symbols/min
[2025-10-24T17:40:52.949709] [INFO ] [REMOTE    ] BOX: Fetching primary data for 2025-08.
[2025-10-24T17:40:53.016723] [INFO ] [MAIN      ] BRBR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:40:53.051845] [INFO ] [REMOTE    ] BP: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T17:40:53.105416] [DEBUG] [LOCAL     ] BRBR: Loaded 52189 existing records from primary storage.
[2025-10-24T17:40:53.105744] [INFO ] [MAIN      ] BRBR: Loaded 52189 existing records.
[2025-10-24T17:40:53.290753] [WARN ] [MAIN      ] BRBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:40:53.291053] [INFO ] [MAIN      ] BRBR: Wiping existing primary data before full refresh.
[2025-10-24T17:40:53.291173] [INFO ] [LOCAL     ] BRBR: Starting deletion of primary data.
[2025-10-24T17:40:53.292311] [DEBUG] [LOCAL     ] BRBR: Deleted primary data file.
[2025-10-24T17:40:53.292372] [INFO ] [MAIN      ] BRBR: Starting full primary refresh.
[2025-10-24T17:40:53.444574] [INFO ] [REMOTE    ] BR: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T17:40:53.681783] [INFO ] [REMOTE    ] BRBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:40:53.747665] [INFO ] [REMOTE    ] BP: Fetching primary data for 2025-10.
[2025-10-24T17:40:54.547737] [INFO ] [REMOTE    ] BR: Fetching primary data for 2025-04.
[2025-10-24T17:40:54.674142] [INFO ] [REMOTE    ] BOX: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T17:40:55.347718] [INFO ] [REMOTE    ] BOX: Fetching primary data for 2025-09.
[2025-10-24T17:40:55.567862] [INFO ] [REMOTE    ] BR: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T17:40:55.813279] [INFO ] [REMOTE    ] BP: Incremental fetch complete for 2025-10 (2.07 seconds).
[2025-10-24T17:40:55.823071] [INFO ] [REMOTE    ] BP: Full fetch complete (77881 records).
[2025-10-24T17:40:55.823190] [DEBUG] [VALIDATOR ] BP: Validating primary data.
[2025-10-24T17:40:56.157676] [INFO ] [REMOTE    ] BR: Fetching primary data for 2025-05.
[2025-10-24T17:40:56.219181] [DEBUG] [VALIDATOR ] BP: All expected trading days are present.
[2025-10-24T17:40:56.219262] [DEBUG] [VALIDATOR ] BP: Primary data validation passed.
[2025-10-24T17:40:56.220140] [INFO ] [MAIN      ] BP: Fetched primary data is valid.
[2025-10-24T17:40:56.220201] [DEBUG] [LOCAL     ] BP: Saving primary data.
[2025-10-24T17:40:56.220829] [FATAL] [LOCAL     ] BP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:40:56.220919] [FATAL] [MAIN      ] BP: Failed to save primary data.
[2025-10-24T17:40:56.220961] [WARN ] [MAIN      ] BP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:40:56.220996] [INFO ] [LOCAL     ] BP: Starting deletion of primary data.
[2025-10-24T17:40:56.221048] [DEBUG] [LOCAL     ] BP: No primary data file found to delete.
[2025-10-24T17:40:56.221083] [INFO ] [LOCAL     ] BP: Starting deletion of derivative data.
[2025-10-24T17:40:56.221212] [DEBUG] [LOCAL     ] BP: Deleted derivative data file.
[2025-10-24T17:40:56.221735] [INFO ] [MAIN      ] Update Progress: 327/2366 symbols completed. BP took 29.8s. Estimated remaining: 4h 14m 58s. Rate: 8.0 symbols/min
[2025-10-24T17:40:56.393365] [INFO ] [MAIN      ] BRC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:40:56.412759] [DEBUG] [LOCAL     ] BRC: Loaded 18403 existing records from primary storage.
[2025-10-24T17:40:56.412993] [INFO ] [MAIN      ] BRC: Loaded 18403 existing records.
[2025-10-24T17:40:56.592538] [WARN ] [MAIN      ] BRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:40:56.592853] [INFO ] [MAIN      ] BRC: Wiping existing primary data before full refresh.
[2025-10-24T17:40:56.593035] [INFO ] [LOCAL     ] BRC: Starting deletion of primary data.
[2025-10-24T17:40:56.593560] [DEBUG] [LOCAL     ] BRC: Deleted primary data file.
[2025-10-24T17:40:56.593620] [INFO ] [MAIN      ] BRC: Starting full primary refresh.
[2025-10-24T17:40:56.873027] [INFO ] [REMOTE    ] BOX: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T17:40:56.956034] [INFO ] [REMOTE    ] BRBR: Fetching primary data for 2025-01.
[2025-10-24T17:40:57.002088] [INFO ] [REMOTE    ] BRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:40:57.394395] [INFO ] [REMOTE    ] BR: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T17:40:57.747723] [INFO ] [REMOTE    ] BR: Fetching primary data for 2025-06.
[2025-10-24T17:40:58.535391] [INFO ] [REMOTE    ] BRBR: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T17:40:58.547606] [INFO ] [REMOTE    ] BRC: Fetching primary data for 2025-01.
[2025-10-24T17:40:58.791231] [INFO ] [REMOTE    ] BR: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T17:40:59.273233] [INFO ] [REMOTE    ] BRC: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T17:40:59.347608] [INFO ] [REMOTE    ] BOX: Fetching primary data for 2025-10.
[2025-10-24T17:41:00.147638] [INFO ] [REMOTE    ] BRC: Fetching primary data for 2025-02.
[2025-10-24T17:41:00.947636] [INFO ] [REMOTE    ] BRBR: Fetching primary data for 2025-02.
[2025-10-24T17:41:01.747710] [INFO ] [REMOTE    ] BR: Fetching primary data for 2025-07.
[2025-10-24T17:41:01.817373] [INFO ] [REMOTE    ] BOX: Incremental fetch complete for 2025-10 (2.47 seconds).
[2025-10-24T17:41:01.827544] [INFO ] [REMOTE    ] BOX: Full fetch complete (72310 records).
[2025-10-24T17:41:01.827761] [DEBUG] [VALIDATOR ] BOX: Validating primary data.
[2025-10-24T17:41:02.239256] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present.
[2025-10-24T17:41:02.239338] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed.
[2025-10-24T17:41:02.240178] [INFO ] [MAIN      ] BOX: Fetched primary data is valid.
[2025-10-24T17:41:02.240244] [DEBUG] [LOCAL     ] BOX: Saving primary data.
[2025-10-24T17:41:02.240860] [FATAL] [LOCAL     ] BOX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:41:02.240983] [FATAL] [MAIN      ] BOX: Failed to save primary data.
[2025-10-24T17:41:02.241053] [WARN ] [MAIN      ] BOX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:41:02.241133] [INFO ] [LOCAL     ] BOX: Starting deletion of primary data.
[2025-10-24T17:41:02.241236] [DEBUG] [LOCAL     ] BOX: No primary data file found to delete.
[2025-10-24T17:41:02.241314] [INFO ] [LOCAL     ] BOX: Starting deletion of derivative data.
[2025-10-24T17:41:02.241518] [DEBUG] [LOCAL     ] BOX: Deleted derivative data file.
[2025-10-24T17:41:02.242343] [INFO ] [MAIN      ] Update Progress: 328/2366 symbols completed. BOX took 41.0s. Estimated remaining: 4h 14m 41s. Rate: 8.0 symbols/min
[2025-10-24T17:41:02.413893] [INFO ] [MAIN      ] BRCC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:41:02.454151] [DEBUG] [LOCAL     ] BRCC: Loaded 40288 existing records from primary storage.
[2025-10-24T17:41:02.454438] [INFO ] [MAIN      ] BRCC: Loaded 40288 existing records.
[2025-10-24T17:41:02.628605] [WARN ] [MAIN      ] BRCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:41:02.628822] [INFO ] [MAIN      ] BRCC: Wiping existing primary data before full refresh.
[2025-10-24T17:41:02.628866] [INFO ] [LOCAL     ] BRCC: Starting deletion of primary data.
[2025-10-24T17:41:02.629365] [DEBUG] [LOCAL     ] BRCC: Deleted primary data file.
[2025-10-24T17:41:02.629421] [INFO ] [MAIN      ] BRCC: Starting full primary refresh.
[2025-10-24T17:41:02.984122] [INFO ] [REMOTE    ] BRCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:41:02.984456] [INFO ] [REMOTE    ] BRCC: Fetching primary data for 2025-01.
[2025-10-24T17:41:04.141779] [INFO ] [REMOTE    ] BRC: Incremental fetch complete for 2025-02 (3.99 seconds).
[2025-10-24T17:41:04.146448] [INFO ] [REMOTE    ] BRC: Fetching primary data for 2025-03.
[2025-10-24T17:41:04.493300] [INFO ] [REMOTE    ] BRCC: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T17:41:04.501416] [INFO ] [REMOTE    ] BRCC: Fetching primary data for 2025-02.
[2025-10-24T17:41:04.700764] [INFO ] [REMOTE    ] BR: Incremental fetch complete for 2025-07 (2.95 seconds).
[2025-10-24T17:41:04.947728] [INFO ] [REMOTE    ] BR: Fetching primary data for 2025-08.
[2025-10-24T17:41:05.108598] [INFO ] [REMOTE    ] BRC: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T17:41:05.687159] [INFO ] [REMOTE    ] BRCC: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T17:41:05.747602] [INFO ] [REMOTE    ] BRCC: Fetching primary data for 2025-03.
[2025-10-24T17:41:05.789904] [INFO ] [REMOTE    ] BRBR: Incremental fetch complete for 2025-02 (4.84 seconds).
[2025-10-24T17:41:06.068954] [INFO ] [REMOTE    ] BR: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T17:41:06.547666] [INFO ] [REMOTE    ] BRC: Fetching primary data for 2025-04.
[2025-10-24T17:41:06.884027] [INFO ] [REMOTE    ] BRCC: Incremental fetch complete for 2025-03 (1.14 seconds).
[2025-10-24T17:41:07.347728] [INFO ] [REMOTE    ] BRCC: Fetching primary data for 2025-04.
[2025-10-24T17:41:07.454007] [INFO ] [REMOTE    ] BRC: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T17:41:08.147733] [INFO ] [REMOTE    ] BRBR: Fetching primary data for 2025-03.
[2025-10-24T17:41:08.862727] [INFO ] [REMOTE    ] BRCC: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T17:41:08.947603] [INFO ] [REMOTE    ] BRCC: Fetching primary data for 2025-05.
[2025-10-24T17:41:09.574229] [INFO ] [REMOTE    ] BRBR: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T17:41:09.747718] [INFO ] [REMOTE    ] BRC: Fetching primary data for 2025-05.
[2025-10-24T17:41:10.489437] [INFO ] [REMOTE    ] BRCC: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T17:41:10.547612] [INFO ] [REMOTE    ] BRCC: Fetching primary data for 2025-06.
[2025-10-24T17:41:10.863514] [INFO ] [REMOTE    ] BRC: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T17:41:11.347669] [INFO ] [REMOTE    ] BR: Fetching primary data for 2025-09.
[2025-10-24T17:41:11.977863] [INFO ] [REMOTE    ] BRCC: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T17:41:12.147675] [INFO ] [REMOTE    ] BRC: Fetching primary data for 2025-06.
[2025-10-24T17:41:12.854764] [INFO ] [REMOTE    ] BR: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T17:41:12.916373] [INFO ] [REMOTE    ] BRC: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T17:41:12.947600] [INFO ] [REMOTE    ] BRC: Fetching primary data for 2025-07.
[2025-10-24T17:41:13.747632] [INFO ] [REMOTE    ] BRCC: Fetching primary data for 2025-07.
[2025-10-24T17:41:13.980978] [INFO ] [REMOTE    ] BRC: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T17:41:14.547677] [INFO ] [REMOTE    ] BRBR: Fetching primary data for 2025-04.
[2025-10-24T17:41:15.181474] [INFO ] [REMOTE    ] BRCC: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T17:41:15.347632] [INFO ] [REMOTE    ] BR: Fetching primary data for 2025-10.
[2025-10-24T17:41:16.147702] [INFO ] [REMOTE    ] BRC: Fetching primary data for 2025-08.
[2025-10-24T17:41:16.302164] [INFO ] [REMOTE    ] BRBR: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T17:41:16.758442] [INFO ] [REMOTE    ] BRC: Incremental fetch complete for 2025-08 (0.61 seconds).
[2025-10-24T17:41:16.947630] [INFO ] [REMOTE    ] BRC: Fetching primary data for 2025-09.
[2025-10-24T17:41:17.411750] [INFO ] [REMOTE    ] BR: Incremental fetch complete for 2025-10 (2.06 seconds).
[2025-10-24T17:41:17.418272] [INFO ] [REMOTE    ] BR: Full fetch complete (49994 records).
[2025-10-24T17:41:17.418380] [DEBUG] [VALIDATOR ] BR: Validating primary data.
[2025-10-24T17:41:17.766315] [INFO ] [REMOTE    ] BRBR: Fetching primary data for 2025-05.
[2025-10-24T17:41:17.806379] [DEBUG] [VALIDATOR ] BR: All expected trading days are present.
[2025-10-24T17:41:17.806458] [DEBUG] [VALIDATOR ] BR: Primary data validation passed.
[2025-10-24T17:41:17.807186] [INFO ] [MAIN      ] BR: Fetched primary data is valid.
[2025-10-24T17:41:17.807367] [DEBUG] [LOCAL     ] BR: Saving primary data.
[2025-10-24T17:41:17.813007] [FATAL] [LOCAL     ] BR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:41:17.819819] [INFO ] [REMOTE    ] BRC: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T17:41:17.819941] [FATAL] [MAIN      ] BR: Failed to save primary data.
[2025-10-24T17:41:17.824077] [WARN ] [MAIN      ] BR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:41:17.824637] [INFO ] [LOCAL     ] BR: Starting deletion of primary data.
[2025-10-24T17:41:17.824782] [DEBUG] [LOCAL     ] BR: No primary data file found to delete.
[2025-10-24T17:41:17.825114] [INFO ] [LOCAL     ] BR: Starting deletion of derivative data.
[2025-10-24T17:41:17.825260] [DEBUG] [LOCAL     ] BR: Deleted derivative data file.
[2025-10-24T17:41:17.825333] [INFO ] [MAIN      ] Update Progress: 329/2366 symbols completed. BR took 30.5s. Estimated remaining: 4h 15m 23s. Rate: 8.0 symbols/min
[2025-10-24T17:41:17.994919] [INFO ] [MAIN      ] BRCE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:41:17.995099] [DEBUG] [LOCAL     ] BRCE: No existing data file found in primary storage.
[2025-10-24T17:41:17.995138] [WARN ] [MAIN      ] BRCE: No existing data found, performing full refresh instead.
[2025-10-24T17:41:17.995251] [INFO ] [MAIN      ] BRCE: Wiping existing primary data before full refresh.
[2025-10-24T17:41:17.995292] [INFO ] [LOCAL     ] BRCE: Starting deletion of primary data.
[2025-10-24T17:41:17.995333] [DEBUG] [LOCAL     ] BRCE: No primary data file found to delete.
[2025-10-24T17:41:17.995365] [INFO ] [MAIN      ] BRCE: Starting full primary refresh.
[2025-10-24T17:41:18.373068] [INFO ] [REMOTE    ] BRCE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:41:18.547619] [INFO ] [REMOTE    ] BRCE: Fetching primary data for 2025-01.
[2025-10-24T17:41:18.757175] [DEBUG] [REMOTE    ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:41:18.757501] [WARN ] [REMOTE    ] BRCE: No data returned for month 2025-01
[2025-10-24T17:41:18.757584] [FATAL] [REMOTE    ] BRCE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:41:18.757682] [FATAL] [MAIN      ] BRCE: Failed to fetch primary data.
[2025-10-24T17:41:18.757747] [WARN ] [MAIN      ] BRCE: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:41:18.757817] [INFO ] [LOCAL     ] BRCE: Starting deletion of primary data.
[2025-10-24T17:41:18.757880] [DEBUG] [LOCAL     ] BRCE: No primary data file found to delete.
[2025-10-24T17:41:18.757916] [INFO ] [LOCAL     ] BRCE: Starting deletion of derivative data.
[2025-10-24T17:41:18.757975] [DEBUG] [LOCAL     ] BRCE: No derivative data file found to delete.
[2025-10-24T17:41:18.758022] [INFO ] [MAIN      ] Update Progress: 330/2366 symbols completed. BRCE took 0.9s. Estimated remaining: 4h 14m 35s. Rate: 8.0 symbols/min
[2025-10-24T17:41:18.933047] [INFO ] [MAIN      ] BRIE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:41:18.933261] [DEBUG] [LOCAL     ] BRIE: No existing data file found in primary storage.
[2025-10-24T17:41:18.933299] [WARN ] [MAIN      ] BRIE: No existing data found, performing full refresh instead.
[2025-10-24T17:41:18.933415] [INFO ] [MAIN      ] BRIE: Wiping existing primary data before full refresh.
[2025-10-24T17:41:18.933456] [INFO ] [LOCAL     ] BRIE: Starting deletion of primary data.
[2025-10-24T17:41:18.933496] [DEBUG] [LOCAL     ] BRIE: No primary data file found to delete.
[2025-10-24T17:41:18.933528] [INFO ] [MAIN      ] BRIE: Starting full primary refresh.
[2025-10-24T17:41:19.314222] [INFO ] [REMOTE    ] BRIE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:41:19.350899] [INFO ] [REMOTE    ] BRC: Fetching primary data for 2025-10.
[2025-10-24T17:41:19.356257] [INFO ] [REMOTE    ] BRBR: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T17:41:20.147627] [INFO ] [REMOTE    ] BRIE: Fetching primary data for 2025-01.
[2025-10-24T17:41:20.340033] [DEBUG] [REMOTE    ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:41:20.340324] [WARN ] [REMOTE    ] BRIE: No data returned for month 2025-01
[2025-10-24T17:41:20.340411] [FATAL] [REMOTE    ] BRIE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:41:20.340499] [FATAL] [MAIN      ] BRIE: Failed to fetch primary data.
[2025-10-24T17:41:20.340565] [WARN ] [MAIN      ] BRIE: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:41:20.340637] [INFO ] [LOCAL     ] BRIE: Starting deletion of primary data.
[2025-10-24T17:41:20.340738] [DEBUG] [LOCAL     ] BRIE: No primary data file found to delete.
[2025-10-24T17:41:20.340778] [INFO ] [LOCAL     ] BRIE: Starting deletion of derivative data.
[2025-10-24T17:41:20.340895] [DEBUG] [LOCAL     ] BRIE: No derivative data file found to delete.
[2025-10-24T17:41:20.340951] [INFO ] [MAIN      ] Update Progress: 331/2366 symbols completed. BRIE took 1.6s. Estimated remaining: 4h 13m 51s. Rate: 8.0 symbols/min
[2025-10-24T17:41:20.527585] [INFO ] [MAIN      ] BRO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:41:20.536403] [INFO ] [REMOTE    ] BRC: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T17:41:20.540274] [INFO ] [REMOTE    ] BRC: Full fetch complete (28277 records).
[2025-10-24T17:41:20.540384] [DEBUG] [VALIDATOR ] BRC: Validating primary data.
[2025-10-24T17:41:20.892080] [DEBUG] [LOCAL     ] BRO: Loaded 52483 existing records from primary storage.
[2025-10-24T17:41:20.923565] [INFO ] [MAIN      ] BRO: Loaded 52483 existing records.
[2025-10-24T17:41:20.952709] [INFO ] [REMOTE    ] BRBR: Fetching primary data for 2025-06.
[2025-10-24T17:41:20.991934] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present.
[2025-10-24T17:41:21.026899] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed.
[2025-10-24T17:41:21.052459] [INFO ] [MAIN      ] BRC: Fetched primary data is valid.
[2025-10-24T17:41:21.061138] [DEBUG] [LOCAL     ] BRC: Saving primary data.
[2025-10-24T17:41:21.064335] [FATAL] [LOCAL     ] BRC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:41:21.070083] [FATAL] [MAIN      ] BRC: Failed to save primary data.
[2025-10-24T17:41:21.080433] [WARN ] [MAIN      ] BRC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:41:21.080517] [INFO ] [LOCAL     ] BRC: Starting deletion of primary data.
[2025-10-24T17:41:21.085729] [DEBUG] [LOCAL     ] BRC: No primary data file found to delete.
[2025-10-24T17:41:21.090906] [INFO ] [LOCAL     ] BRC: Starting deletion of derivative data.
[2025-10-24T17:41:21.116114] [DEBUG] [LOCAL     ] BRC: Deleted derivative data file.
[2025-10-24T17:41:21.149134] [WARN ] [MAIN      ] BRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:41:21.149418] [INFO ] [MAIN      ] Update Progress: 332/2366 symbols completed. BRC took 24.9s. Estimated remaining: 4h 13m 3s. Rate: 8.0 symbols/min
[2025-10-24T17:41:21.149606] [INFO ] [MAIN      ] BRO: Wiping existing primary data before full refresh.
[2025-10-24T17:41:21.183797] [INFO ] [LOCAL     ] BRO: Starting deletion of primary data.
[2025-10-24T17:41:21.217453] [DEBUG] [LOCAL     ] BRO: Deleted primary data file.
[2025-10-24T17:41:21.229726] [INFO ] [MAIN      ] BRO: Starting full primary refresh.
[2025-10-24T17:41:21.467618] [INFO ] [MAIN      ] BROS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:41:21.753464] [INFO ] [REMOTE    ] BRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:41:21.754830] [INFO ] [REMOTE    ] BRCC: Fetching primary data for 2025-08.
[2025-10-24T17:41:21.771849] [DEBUG] [LOCAL     ] BROS: Loaded 53688 existing records from primary storage.
[2025-10-24T17:41:21.772154] [INFO ] [MAIN      ] BROS: Loaded 53688 existing records.
[2025-10-24T17:41:21.953150] [WARN ] [MAIN      ] BROS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:41:21.953355] [INFO ] [MAIN      ] BROS: Wiping existing primary data before full refresh.
[2025-10-24T17:41:21.953421] [INFO ] [LOCAL     ] BROS: Starting deletion of primary data.
[2025-10-24T17:41:21.954324] [DEBUG] [LOCAL     ] BROS: Deleted primary data file.
[2025-10-24T17:41:21.954380] [INFO ] [MAIN      ] BROS: Starting full primary refresh.
[2025-10-24T17:41:22.306408] [INFO ] [REMOTE    ] BROS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:41:22.552748] [INFO ] [REMOTE    ] BRO: Fetching primary data for 2025-01.
[2025-10-24T17:41:22.569795] [INFO ] [REMOTE    ] BRBR: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T17:41:23.347617] [INFO ] [REMOTE    ] BRBR: Fetching primary data for 2025-07.
[2025-10-24T17:41:23.463769] [INFO ] [REMOTE    ] BRCC: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T17:41:24.147715] [INFO ] [REMOTE    ] BROS: Fetching primary data for 2025-01.
[2025-10-24T17:41:24.304462] [INFO ] [REMOTE    ] BRO: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T17:41:24.870275] [INFO ] [REMOTE    ] BRBR: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T17:41:24.947696] [INFO ] [REMOTE    ] BRBR: Fetching primary data for 2025-08.
[2025-10-24T17:41:25.747674] [INFO ] [REMOTE    ] BRO: Fetching primary data for 2025-02.
[2025-10-24T17:41:26.109853] [INFO ] [REMOTE    ] BROS: Incremental fetch complete for 2025-01 (1.96 seconds).
[2025-10-24T17:41:26.547619] [INFO ] [REMOTE    ] BROS: Fetching primary data for 2025-02.
[2025-10-24T17:41:26.667222] [INFO ] [REMOTE    ] BRBR: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T17:41:27.004600] [INFO ] [REMOTE    ] BRO: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T17:41:27.347678] [INFO ] [REMOTE    ] BRCC: Fetching primary data for 2025-09.
[2025-10-24T17:41:28.147617] [INFO ] [REMOTE    ] BRO: Fetching primary data for 2025-03.
[2025-10-24T17:41:28.472349] [INFO ] [REMOTE    ] BROS: Incremental fetch complete for 2025-02 (1.92 seconds).
[2025-10-24T17:41:28.952890] [INFO ] [REMOTE    ] BROS: Fetching primary data for 2025-03.
[2025-10-24T17:41:28.967933] [INFO ] [REMOTE    ] BRCC: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T17:41:29.747731] [INFO ] [REMOTE    ] BRCC: Fetching primary data for 2025-10.
[2025-10-24T17:41:30.374074] [INFO ] [REMOTE    ] BRO: Incremental fetch complete for 2025-03 (2.23 seconds).
[2025-10-24T17:41:30.547674] [INFO ] [REMOTE    ] BRO: Fetching primary data for 2025-04.
[2025-10-24T17:41:31.038946] [INFO ] [REMOTE    ] BROS: Incremental fetch complete for 2025-03 (2.09 seconds).
[2025-10-24T17:41:31.347731] [INFO ] [REMOTE    ] BROS: Fetching primary data for 2025-04.
[2025-10-24T17:41:31.525491] [INFO ] [REMOTE    ] BRCC: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T17:41:31.532367] [INFO ] [REMOTE    ] BRCC: Full fetch complete (57260 records).
[2025-10-24T17:41:31.532469] [DEBUG] [VALIDATOR ] BRCC: Validating primary data.
[2025-10-24T17:41:31.919333] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present.
[2025-10-24T17:41:31.919466] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed.
[2025-10-24T17:41:31.920328] [INFO ] [MAIN      ] BRCC: Fetched primary data is valid.
[2025-10-24T17:41:31.920409] [DEBUG] [LOCAL     ] BRCC: Saving primary data.
[2025-10-24T17:41:31.920996] [FATAL] [LOCAL     ] BRCC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:41:31.921099] [FATAL] [MAIN      ] BRCC: Failed to save primary data.
[2025-10-24T17:41:31.921142] [WARN ] [MAIN      ] BRCC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:41:31.921179] [INFO ] [LOCAL     ] BRCC: Starting deletion of primary data.
[2025-10-24T17:41:31.921230] [DEBUG] [LOCAL     ] BRCC: No primary data file found to delete.
[2025-10-24T17:41:31.921273] [INFO ] [LOCAL     ] BRCC: Starting deletion of derivative data.
[2025-10-24T17:41:31.921440] [DEBUG] [LOCAL     ] BRCC: Deleted derivative data file.
[2025-10-24T17:41:31.921994] [INFO ] [MAIN      ] Update Progress: 333/2366 symbols completed. BRCC took 29.7s. Estimated remaining: 4h 13m 16s. Rate: 8.0 symbols/min
[2025-10-24T17:41:32.091472] [INFO ] [MAIN      ] BRSL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:41:32.091730] [DEBUG] [LOCAL     ] BRSL: No existing data file found in primary storage.
[2025-10-24T17:41:32.091820] [WARN ] [MAIN      ] BRSL: No existing data found, performing full refresh instead.
[2025-10-24T17:41:32.091971] [INFO ] [MAIN      ] BRSL: Wiping existing primary data before full refresh.
[2025-10-24T17:41:32.092077] [INFO ] [LOCAL     ] BRSL: Starting deletion of primary data.
[2025-10-24T17:41:32.092146] [DEBUG] [LOCAL     ] BRSL: No primary data file found to delete.
[2025-10-24T17:41:32.092181] [INFO ] [MAIN      ] BRSL: Starting full primary refresh.
[2025-10-24T17:41:32.171294] [INFO ] [REMOTE    ] BRBR: Fetching primary data for 2025-09.
[2025-10-24T17:41:32.450708] [INFO ] [REMOTE    ] BRSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:41:32.479728] [INFO ] [REMOTE    ] BRO: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T17:41:32.947674] [INFO ] [REMOTE    ] BRSL: Fetching primary data for 2025-01.
[2025-10-24T17:41:33.142990] [DEBUG] [REMOTE    ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:41:33.143287] [WARN ] [REMOTE    ] BRSL: No data returned for month 2025-01
[2025-10-24T17:41:33.143375] [FATAL] [REMOTE    ] BRSL: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:41:33.143455] [FATAL] [MAIN      ] BRSL: Failed to fetch primary data.
[2025-10-24T17:41:33.143523] [WARN ] [MAIN      ] BRSL: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:41:33.143607] [INFO ] [LOCAL     ] BRSL: Starting deletion of primary data.
[2025-10-24T17:41:33.143713] [DEBUG] [LOCAL     ] BRSL: No primary data file found to delete.
[2025-10-24T17:41:33.143762] [INFO ] [LOCAL     ] BRSL: Starting deletion of derivative data.
[2025-10-24T17:41:33.143805] [DEBUG] [LOCAL     ] BRSL: No derivative data file found to delete.
[2025-10-24T17:41:33.143853] [INFO ] [MAIN      ] Update Progress: 334/2366 symbols completed. BRSL took 1.2s. Estimated remaining: 4h 12m 30s. Rate: 8.0 symbols/min
[2025-10-24T17:41:33.323552] [INFO ] [MAIN      ] BRSP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:41:33.356208] [INFO ] [REMOTE    ] BROS: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T17:41:33.396373] [DEBUG] [LOCAL     ] BRSP: Loaded 36715 existing records from primary storage.
[2025-10-24T17:41:33.396695] [INFO ] [MAIN      ] BRSP: Loaded 36715 existing records.
[2025-10-24T17:41:33.579964] [WARN ] [MAIN      ] BRSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:41:33.580155] [INFO ] [MAIN      ] BRSP: Wiping existing primary data before full refresh.
[2025-10-24T17:41:33.580202] [INFO ] [LOCAL     ] BRSP: Starting deletion of primary data.
[2025-10-24T17:41:33.580872] [DEBUG] [LOCAL     ] BRSP: Deleted primary data file.
[2025-10-24T17:41:33.580929] [INFO ] [MAIN      ] BRSP: Starting full primary refresh.
[2025-10-24T17:41:33.755522] [INFO ] [REMOTE    ] BRO: Fetching primary data for 2025-05.
[2025-10-24T17:41:33.943592] [INFO ] [REMOTE    ] BRSP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:41:34.033497] [INFO ] [REMOTE    ] BRBR: Incremental fetch complete for 2025-09 (1.86 seconds).
[2025-10-24T17:41:34.547679] [INFO ] [REMOTE    ] BRSP: Fetching primary data for 2025-01.
[2025-10-24T17:41:35.347738] [INFO ] [REMOTE    ] BROS: Fetching primary data for 2025-05.
[2025-10-24T17:41:35.755842] [INFO ] [REMOTE    ] BRO: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T17:41:35.878110] [INFO ] [REMOTE    ] BRSP: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T17:41:36.147637] [INFO ] [REMOTE    ] BRSP: Fetching primary data for 2025-02.
[2025-10-24T17:41:36.947614] [INFO ] [REMOTE    ] BRBR: Fetching primary data for 2025-10.
[2025-10-24T17:41:37.197561] [INFO ] [REMOTE    ] BROS: Incremental fetch complete for 2025-05 (1.85 seconds).
[2025-10-24T17:41:37.531958] [INFO ] [REMOTE    ] BRSP: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T17:41:37.747742] [INFO ] [REMOTE    ] BRO: Fetching primary data for 2025-06.
[2025-10-24T17:41:38.547725] [INFO ] [REMOTE    ] BROS: Fetching primary data for 2025-06.
[2025-10-24T17:41:38.596493] [INFO ] [REMOTE    ] BRBR: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T17:41:38.607981] [INFO ] [REMOTE    ] BRBR: Full fetch complete (73255 records).
[2025-10-24T17:41:38.608156] [DEBUG] [VALIDATOR ] BRBR: Validating primary data.
[2025-10-24T17:41:39.001699] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present.
[2025-10-24T17:41:39.001842] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed.
[2025-10-24T17:41:39.002901] [INFO ] [MAIN      ] BRBR: Fetched primary data is valid.
[2025-10-24T17:41:39.003571] [DEBUG] [LOCAL     ] BRBR: Saving primary data.
[2025-10-24T17:41:39.004490] [FATAL] [LOCAL     ] BRBR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:41:39.004597] [FATAL] [MAIN      ] BRBR: Failed to save primary data.
[2025-10-24T17:41:39.004723] [WARN ] [MAIN      ] BRBR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:41:39.004821] [INFO ] [LOCAL     ] BRBR: Starting deletion of primary data.
[2025-10-24T17:41:39.005116] [DEBUG] [LOCAL     ] BRBR: No primary data file found to delete.
[2025-10-24T17:41:39.005173] [INFO ] [LOCAL     ] BRBR: Starting deletion of derivative data.
[2025-10-24T17:41:39.005605] [DEBUG] [LOCAL     ] BRBR: Deleted derivative data file.
[2025-10-24T17:41:39.005963] [INFO ] [MAIN      ] Update Progress: 335/2366 symbols completed. BRBR took 46.2s. Estimated remaining: 4h 12m 13s. Rate: 8.1 symbols/min
[2025-10-24T17:41:39.184380] [INFO ] [MAIN      ] BRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:41:39.192255] [DEBUG] [LOCAL     ] BRT: Loaded 5310 existing records from primary storage.
[2025-10-24T17:41:39.192464] [INFO ] [MAIN      ] BRT: Loaded 5310 existing records.
[2025-10-24T17:41:39.369772] [INFO ] [REMOTE    ] BRSP: Fetching primary data for 2025-03.
[2025-10-24T17:41:39.400285] [WARN ] [MAIN      ] BRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:41:39.401556] [INFO ] [MAIN      ] BRT: Wiping existing primary data before full refresh.
[2025-10-24T17:41:39.401731] [INFO ] [LOCAL     ] BRT: Starting deletion of primary data.
[2025-10-24T17:41:39.401986] [DEBUG] [LOCAL     ] BRT: Deleted primary data file.
[2025-10-24T17:41:39.402119] [INFO ] [MAIN      ] BRT: Starting full primary refresh.
[2025-10-24T17:41:39.719367] [INFO ] [REMOTE    ] BRO: Incremental fetch complete for 2025-06 (1.97 seconds).
[2025-10-24T17:41:39.814989] [INFO ] [REMOTE    ] BRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:41:40.147745] [INFO ] [REMOTE    ] BRO: Fetching primary data for 2025-07.
[2025-10-24T17:41:40.244106] [INFO ] [REMOTE    ] BROS: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T17:41:40.952373] [INFO ] [REMOTE    ] BRT: Fetching primary data for 2025-01.
[2025-10-24T17:41:40.954734] [INFO ] [REMOTE    ] BRSP: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T17:41:41.715322] [INFO ] [REMOTE    ] BRT: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T17:41:41.747722] [INFO ] [REMOTE    ] BRT: Fetching primary data for 2025-02.
[2025-10-24T17:41:41.996866] [INFO ] [REMOTE    ] BRO: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T17:41:42.232502] [INFO ] [REMOTE    ] BRT: Incremental fetch complete for 2025-02 (0.48 seconds).
[2025-10-24T17:41:42.547690] [INFO ] [REMOTE    ] BRT: Fetching primary data for 2025-03.
[2025-10-24T17:41:43.129597] [INFO ] [REMOTE    ] BRT: Incremental fetch complete for 2025-03 (0.58 seconds).
[2025-10-24T17:41:43.347681] [INFO ] [REMOTE    ] BRSP: Fetching primary data for 2025-04.
[2025-10-24T17:41:44.147708] [INFO ] [REMOTE    ] BRO: Fetching primary data for 2025-08.
[2025-10-24T17:41:44.790922] [INFO ] [REMOTE    ] BRSP: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T17:41:44.947734] [INFO ] [REMOTE    ] BRT: Fetching primary data for 2025-04.
[2025-10-24T17:41:45.365063] [INFO ] [REMOTE    ] BRT: Incremental fetch complete for 2025-04 (0.42 seconds).
[2025-10-24T17:41:45.747612] [INFO ] [REMOTE    ] BRT: Fetching primary data for 2025-05.
[2025-10-24T17:41:45.883564] [INFO ] [REMOTE    ] BRO: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T17:41:46.103123] [INFO ] [REMOTE    ] BRT: Incremental fetch complete for 2025-05 (0.36 seconds).
[2025-10-24T17:41:46.547722] [INFO ] [REMOTE    ] BRO: Fetching primary data for 2025-09.
[2025-10-24T17:41:47.347690] [INFO ] [REMOTE    ] BROS: Fetching primary data for 2025-07.
[2025-10-24T17:41:48.147673] [INFO ] [REMOTE    ] BRSP: Fetching primary data for 2025-05.
[2025-10-24T17:41:48.292896] [INFO ] [REMOTE    ] BRO: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T17:41:48.947618] [INFO ] [REMOTE    ] BRO: Fetching primary data for 2025-10.
[2025-10-24T17:41:49.185887] [INFO ] [REMOTE    ] BROS: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T17:41:49.644492] [INFO ] [REMOTE    ] BRSP: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T17:41:49.747681] [INFO ] [REMOTE    ] BRSP: Fetching primary data for 2025-06.
[2025-10-24T17:41:50.547639] [INFO ] [REMOTE    ] BROS: Fetching primary data for 2025-08.
[2025-10-24T17:41:50.880564] [INFO ] [REMOTE    ] BRO: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T17:41:50.890504] [INFO ] [REMOTE    ] BRO: Full fetch complete (75144 records).
[2025-10-24T17:41:50.890708] [DEBUG] [VALIDATOR ] BRO: Validating primary data.
[2025-10-24T17:41:51.241038] [INFO ] [REMOTE    ] BRSP: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T17:41:51.335756] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present.
[2025-10-24T17:41:51.335849] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed.
[2025-10-24T17:41:51.336685] [INFO ] [MAIN      ] BRO: Fetched primary data is valid.
[2025-10-24T17:41:51.336808] [DEBUG] [LOCAL     ] BRO: Saving primary data.
[2025-10-24T17:41:51.337472] [FATAL] [LOCAL     ] BRO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:41:51.337561] [FATAL] [MAIN      ] BRO: Failed to save primary data.
[2025-10-24T17:41:51.337604] [WARN ] [MAIN      ] BRO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:41:51.337664] [INFO ] [LOCAL     ] BRO: Starting deletion of primary data.
[2025-10-24T17:41:51.337742] [DEBUG] [LOCAL     ] BRO: No primary data file found to delete.
[2025-10-24T17:41:51.337779] [INFO ] [LOCAL     ] BRO: Starting deletion of derivative data.
[2025-10-24T17:41:51.337901] [DEBUG] [LOCAL     ] BRO: Deleted derivative data file.
[2025-10-24T17:41:51.338473] [INFO ] [MAIN      ] Update Progress: 336/2366 symbols completed. BRO took 31.0s. Estimated remaining: 4h 12m 35s. Rate: 8.0 symbols/min
[2025-10-24T17:41:51.352712] [INFO ] [REMOTE    ] BRT: Fetching primary data for 2025-06.
[2025-10-24T17:41:51.520485] [INFO ] [MAIN      ] BRW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:41:51.541972] [DEBUG] [LOCAL     ] BRW: Loaded 21145 existing records from primary storage.
[2025-10-24T17:41:51.542198] [INFO ] [MAIN      ] BRW: Loaded 21145 existing records.
[2025-10-24T17:41:51.721697] [WARN ] [MAIN      ] BRW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:41:51.721898] [INFO ] [MAIN      ] BRW: Wiping existing primary data before full refresh.
[2025-10-24T17:41:51.721952] [INFO ] [LOCAL     ] BRW: Starting deletion of primary data.
[2025-10-24T17:41:51.722151] [DEBUG] [LOCAL     ] BRW: Deleted primary data file.
[2025-10-24T17:41:51.722204] [INFO ] [MAIN      ] BRW: Starting full primary refresh.
[2025-10-24T17:41:52.080389] [INFO ] [REMOTE    ] BRW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:41:52.133496] [INFO ] [REMOTE    ] BRT: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T17:41:52.147603] [INFO ] [REMOTE    ] BRW: Fetching primary data for 2025-01.
[2025-10-24T17:41:52.422882] [INFO ] [REMOTE    ] BROS: Incremental fetch complete for 2025-08 (1.88 seconds).
[2025-10-24T17:41:52.947730] [INFO ] [REMOTE    ] BROS: Fetching primary data for 2025-09.
[2025-10-24T17:41:52.982708] [INFO ] [REMOTE    ] BRW: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T17:41:53.747682] [INFO ] [REMOTE    ] BRSP: Fetching primary data for 2025-07.
[2025-10-24T17:41:54.547617] [INFO ] [REMOTE    ] BRT: Fetching primary data for 2025-07.
[2025-10-24T17:41:55.093958] [INFO ] [REMOTE    ] BROS: Incremental fetch complete for 2025-09 (2.15 seconds).
[2025-10-24T17:41:55.128452] [INFO ] [REMOTE    ] BRSP: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T17:41:55.142985] [INFO ] [REMOTE    ] BRT: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T17:41:55.347724] [INFO ] [REMOTE    ] BRT: Fetching primary data for 2025-08.
[2025-10-24T17:41:55.969116] [INFO ] [REMOTE    ] BRT: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T17:41:56.147671] [INFO ] [REMOTE    ] BRT: Fetching primary data for 2025-09.
[2025-10-24T17:41:56.748540] [INFO ] [REMOTE    ] BRT: Incremental fetch complete for 2025-09 (0.60 seconds).
[2025-10-24T17:41:56.947634] [INFO ] [REMOTE    ] BRSP: Fetching primary data for 2025-08.
[2025-10-24T17:41:57.747688] [INFO ] [REMOTE    ] BRT: Fetching primary data for 2025-10.
[2025-10-24T17:41:58.322849] [INFO ] [REMOTE    ] BRSP: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T17:41:58.547614] [INFO ] [REMOTE    ] BROS: Fetching primary data for 2025-10.
[2025-10-24T17:41:58.786050] [INFO ] [REMOTE    ] BRT: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T17:41:58.787981] [INFO ] [REMOTE    ] BRT: Full fetch complete (7144 records).
[2025-10-24T17:41:58.788053] [DEBUG] [VALIDATOR ] BRT: Validating primary data.
[2025-10-24T17:41:59.162108] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present.
[2025-10-24T17:41:59.162186] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed.
[2025-10-24T17:41:59.162363] [INFO ] [MAIN      ] BRT: Fetched primary data is valid.
[2025-10-24T17:41:59.162401] [DEBUG] [LOCAL     ] BRT: Saving primary data.
[2025-10-24T17:41:59.162588] [FATAL] [LOCAL     ] BRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:41:59.162700] [FATAL] [MAIN      ] BRT: Failed to save primary data.
[2025-10-24T17:41:59.162773] [WARN ] [MAIN      ] BRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:41:59.162859] [INFO ] [LOCAL     ] BRT: Starting deletion of primary data.
[2025-10-24T17:41:59.162933] [DEBUG] [LOCAL     ] BRT: No primary data file found to delete.
[2025-10-24T17:41:59.162971] [INFO ] [LOCAL     ] BRT: Starting deletion of derivative data.
[2025-10-24T17:41:59.163119] [DEBUG] [LOCAL     ] BRT: Deleted derivative data file.
[2025-10-24T17:41:59.163209] [INFO ] [MAIN      ] Update Progress: 337/2366 symbols completed. BRT took 20.2s. Estimated remaining: 4h 12m 30s. Rate: 8.0 symbols/min
[2025-10-24T17:41:59.333705] [INFO ] [MAIN      ] BRX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:41:59.347684] [INFO ] [REMOTE    ] BRW: Fetching primary data for 2025-02.
[2025-10-24T17:41:59.385379] [DEBUG] [LOCAL     ] BRX: Loaded 52194 existing records from primary storage.
[2025-10-24T17:41:59.385698] [INFO ] [MAIN      ] BRX: Loaded 52194 existing records.
[2025-10-24T17:41:59.558057] [WARN ] [MAIN      ] BRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:41:59.558310] [INFO ] [MAIN      ] BRX: Wiping existing primary data before full refresh.
[2025-10-24T17:41:59.558366] [INFO ] [LOCAL     ] BRX: Starting deletion of primary data.
[2025-10-24T17:41:59.558886] [DEBUG] [LOCAL     ] BRX: Deleted primary data file.
[2025-10-24T17:41:59.558944] [INFO ] [MAIN      ] BRX: Starting full primary refresh.
[2025-10-24T17:41:59.905627] [INFO ] [REMOTE    ] BRX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:42:00.147667] [INFO ] [REMOTE    ] BRSP: Fetching primary data for 2025-09.
[2025-10-24T17:42:00.330350] [INFO ] [REMOTE    ] BRW: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T17:42:00.947634] [INFO ] [REMOTE    ] BRX: Fetching primary data for 2025-01.
[2025-10-24T17:42:01.747743] [INFO ] [REMOTE    ] BRW: Fetching primary data for 2025-03.
[2025-10-24T17:42:01.810022] [INFO ] [REMOTE    ] BROS: Incremental fetch complete for 2025-10 (3.26 seconds).
[2025-10-24T17:42:01.820081] [INFO ] [REMOTE    ] BROS: Full fetch complete (77274 records).
[2025-10-24T17:42:01.820232] [DEBUG] [VALIDATOR ] BROS: Validating primary data.
[2025-10-24T17:42:02.190395] [INFO ] [REMOTE    ] BRSP: Incremental fetch complete for 2025-09 (2.04 seconds).
[2025-10-24T17:42:02.285682] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present.
[2025-10-24T17:42:02.285770] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed.
[2025-10-24T17:42:02.286740] [INFO ] [MAIN      ] BROS: Fetched primary data is valid.
[2025-10-24T17:42:02.286808] [DEBUG] [LOCAL     ] BROS: Saving primary data.
[2025-10-24T17:42:02.287485] [FATAL] [LOCAL     ] BROS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:42:02.287573] [FATAL] [MAIN      ] BROS: Failed to save primary data.
[2025-10-24T17:42:02.287663] [WARN ] [MAIN      ] BROS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:42:02.287737] [INFO ] [LOCAL     ] BROS: Starting deletion of primary data.
[2025-10-24T17:42:02.287801] [DEBUG] [LOCAL     ] BROS: No primary data file found to delete.
[2025-10-24T17:42:02.287837] [INFO ] [LOCAL     ] BROS: Starting deletion of derivative data.
[2025-10-24T17:42:02.287970] [DEBUG] [LOCAL     ] BROS: Deleted derivative data file.
[2025-10-24T17:42:02.288470] [INFO ] [MAIN      ] Update Progress: 338/2366 symbols completed. BROS took 41.1s. Estimated remaining: 4h 11m 56s. Rate: 8.0 symbols/min
[2025-10-24T17:42:02.457290] [INFO ] [MAIN      ] BSAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:42:02.490575] [DEBUG] [LOCAL     ] BSAC: Loaded 33040 existing records from primary storage.
[2025-10-24T17:42:02.490905] [INFO ] [MAIN      ] BSAC: Loaded 33040 existing records.
[2025-10-24T17:42:02.556087] [INFO ] [REMOTE    ] BRSP: Fetching primary data for 2025-10.
[2025-10-24T17:42:02.675561] [WARN ] [MAIN      ] BSAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:42:02.675797] [INFO ] [MAIN      ] BSAC: Wiping existing primary data before full refresh.
[2025-10-24T17:42:02.675846] [INFO ] [LOCAL     ] BSAC: Starting deletion of primary data.
[2025-10-24T17:42:02.676042] [DEBUG] [LOCAL     ] BSAC: Deleted primary data file.
[2025-10-24T17:42:02.676106] [INFO ] [MAIN      ] BSAC: Starting full primary refresh.
[2025-10-24T17:42:03.037178] [INFO ] [REMOTE    ] BSAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:42:03.347704] [INFO ] [REMOTE    ] BSAC: Fetching primary data for 2025-01.
[2025-10-24T17:42:03.649322] [INFO ] [REMOTE    ] BRW: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T17:42:03.826353] [INFO ] [REMOTE    ] BRX: Incremental fetch complete for 2025-01 (2.88 seconds).
[2025-10-24T17:42:04.147631] [INFO ] [REMOTE    ] BRW: Fetching primary data for 2025-04.
[2025-10-24T17:42:04.370723] [INFO ] [REMOTE    ] BRSP: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T17:42:04.377571] [INFO ] [REMOTE    ] BRSP: Full fetch complete (53952 records).
[2025-10-24T17:42:04.377720] [DEBUG] [VALIDATOR ] BRSP: Validating primary data.
[2025-10-24T17:42:04.766714] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present.
[2025-10-24T17:42:04.766821] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed.
[2025-10-24T17:42:04.767530] [INFO ] [MAIN      ] BRSP: Fetched primary data is valid.
[2025-10-24T17:42:04.767605] [DEBUG] [LOCAL     ] BRSP: Saving primary data.
[2025-10-24T17:42:04.768187] [FATAL] [LOCAL     ] BRSP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:42:04.768284] [FATAL] [MAIN      ] BRSP: Failed to save primary data.
[2025-10-24T17:42:04.768328] [WARN ] [MAIN      ] BRSP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:42:04.768366] [INFO ] [LOCAL     ] BRSP: Starting deletion of primary data.
[2025-10-24T17:42:04.768418] [DEBUG] [LOCAL     ] BRSP: No primary data file found to delete.
[2025-10-24T17:42:04.768453] [INFO ] [LOCAL     ] BRSP: Starting deletion of derivative data.
[2025-10-24T17:42:04.768603] [DEBUG] [LOCAL     ] BRSP: Deleted derivative data file.
[2025-10-24T17:42:04.769076] [INFO ] [MAIN      ] Update Progress: 339/2366 symbols completed. BRSP took 31.6s. Estimated remaining: 4h 11m 19s. Rate: 8.1 symbols/min
[2025-10-24T17:42:04.905167] [INFO ] [REMOTE    ] BSAC: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T17:42:04.955059] [INFO ] [REMOTE    ] BSAC: Fetching primary data for 2025-02.
[2025-10-24T17:42:04.957709] [INFO ] [MAIN      ] BSBR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:42:04.994105] [DEBUG] [LOCAL     ] BSBR: Loaded 36041 existing records from primary storage.
[2025-10-24T17:42:04.994374] [INFO ] [MAIN      ] BSBR: Loaded 36041 existing records.
[2025-10-24T17:42:05.174105] [WARN ] [MAIN      ] BSBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:42:05.174320] [INFO ] [MAIN      ] BSBR: Wiping existing primary data before full refresh.
[2025-10-24T17:42:05.174367] [INFO ] [LOCAL     ] BSBR: Starting deletion of primary data.
[2025-10-24T17:42:05.174999] [DEBUG] [LOCAL     ] BSBR: Deleted primary data file.
[2025-10-24T17:42:05.175058] [INFO ] [MAIN      ] BSBR: Starting full primary refresh.
[2025-10-24T17:42:05.244699] [DEBUG] [REMOTE    ] BRW: Error fetching primary data for 2025-04: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
[2025-10-24T17:42:05.255892] [WARN ] [REMOTE    ] BRW: No data returned for month 2025-04
[2025-10-24T17:42:05.255993] [FATAL] [REMOTE    ] BRW: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:42:05.275393] [FATAL] [MAIN      ] BRW: Failed to fetch primary data.
[2025-10-24T17:42:05.277829] [WARN ] [MAIN      ] BRW: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:42:05.277916] [INFO ] [LOCAL     ] BRW: Starting deletion of primary data.
[2025-10-24T17:42:05.278070] [DEBUG] [LOCAL     ] BRW: No primary data file found to delete.
[2025-10-24T17:42:05.278135] [INFO ] [LOCAL     ] BRW: Starting deletion of derivative data.
[2025-10-24T17:42:05.289068] [DEBUG] [LOCAL     ] BRW: Deleted derivative data file.
[2025-10-24T17:42:05.294325] [INFO ] [MAIN      ] Update Progress: 340/2366 symbols completed. BRW took 14.0s. Estimated remaining: 4h 10m 31s. Rate: 8.1 symbols/min
[2025-10-24T17:42:05.666902] [INFO ] [MAIN      ] BSL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:42:05.728478] [INFO ] [REMOTE    ] BSBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:42:05.737251] [DEBUG] [LOCAL     ] BSL: Loaded 7937 existing records from primary storage.
[2025-10-24T17:42:05.737588] [INFO ] [MAIN      ] BSL: Loaded 7937 existing records.
[2025-10-24T17:42:05.752714] [INFO ] [REMOTE    ] BRX: Fetching primary data for 2025-02.
[2025-10-24T17:42:05.924967] [WARN ] [MAIN      ] BSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:42:05.925218] [INFO ] [MAIN      ] BSL: Wiping existing primary data before full refresh.
[2025-10-24T17:42:05.925304] [INFO ] [LOCAL     ] BSL: Starting deletion of primary data.
[2025-10-24T17:42:05.925672] [DEBUG] [LOCAL     ] BSL: Deleted primary data file.
[2025-10-24T17:42:05.925731] [INFO ] [MAIN      ] BSL: Starting full primary refresh.
[2025-10-24T17:42:06.317317] [INFO ] [REMOTE    ] BSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:42:06.327891] [INFO ] [REMOTE    ] BSAC: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T17:42:06.547711] [INFO ] [REMOTE    ] BSAC: Fetching primary data for 2025-03.
[2025-10-24T17:42:07.301768] [INFO ] [REMOTE    ] BRX: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T17:42:07.347623] [INFO ] [REMOTE    ] BRX: Fetching primary data for 2025-03.
[2025-10-24T17:42:07.864302] [INFO ] [REMOTE    ] BSAC: Incremental fetch complete for 2025-03 (1.32 seconds).
[2025-10-24T17:42:08.147629] [INFO ] [REMOTE    ] BSAC: Fetching primary data for 2025-04.
[2025-10-24T17:42:08.723440] [INFO ] [REMOTE    ] BRX: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T17:42:08.947674] [INFO ] [REMOTE    ] BSBR: Fetching primary data for 2025-01.
[2025-10-24T17:42:09.601108] [INFO ] [REMOTE    ] BSAC: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T17:42:09.747677] [INFO ] [REMOTE    ] BRX: Fetching primary data for 2025-04.
[2025-10-24T17:42:10.368371] [INFO ] [REMOTE    ] BSBR: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T17:42:10.547708] [INFO ] [REMOTE    ] BSBR: Fetching primary data for 2025-02.
[2025-10-24T17:42:11.122469] [INFO ] [REMOTE    ] BRX: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T17:42:11.347692] [INFO ] [REMOTE    ] BRX: Fetching primary data for 2025-05.
[2025-10-24T17:42:11.864482] [INFO ] [REMOTE    ] BSBR: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T17:42:12.147665] [INFO ] [REMOTE    ] BSBR: Fetching primary data for 2025-03.
[2025-10-24T17:42:12.669564] [INFO ] [REMOTE    ] BRX: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T17:42:12.947629] [INFO ] [REMOTE    ] BSAC: Fetching primary data for 2025-05.
[2025-10-24T17:42:13.409946] [INFO ] [REMOTE    ] BSBR: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T17:42:13.747708] [INFO ] [REMOTE    ] BRX: Fetching primary data for 2025-06.
[2025-10-24T17:42:14.413092] [INFO ] [REMOTE    ] BSAC: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T17:42:14.547687] [INFO ] [REMOTE    ] BSAC: Fetching primary data for 2025-06.
[2025-10-24T17:42:15.347691] [INFO ] [REMOTE    ] BSBR: Fetching primary data for 2025-04.
[2025-10-24T17:42:15.511183] [INFO ] [REMOTE    ] BRX: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T17:42:15.848373] [INFO ] [REMOTE    ] BSAC: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T17:42:16.147686] [INFO ] [REMOTE    ] BRX: Fetching primary data for 2025-07.
[2025-10-24T17:42:16.709395] [INFO ] [REMOTE    ] BSBR: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T17:42:16.947723] [INFO ] [REMOTE    ] BSAC: Fetching primary data for 2025-07.
[2025-10-24T17:42:17.700897] [INFO ] [REMOTE    ] BRX: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T17:42:17.747618] [INFO ] [REMOTE    ] BRX: Fetching primary data for 2025-08.
[2025-10-24T17:42:18.271626] [INFO ] [REMOTE    ] BSAC: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T17:42:18.547722] [INFO ] [REMOTE    ] BSL: Fetching primary data for 2025-01.
[2025-10-24T17:42:19.259735] [INFO ] [REMOTE    ] BRX: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T17:42:19.347622] [INFO ] [REMOTE    ] BRX: Fetching primary data for 2025-09.
[2025-10-24T17:42:19.355133] [INFO ] [REMOTE    ] BSL: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T17:42:20.147674] [INFO ] [REMOTE    ] BSAC: Fetching primary data for 2025-08.
[2025-10-24T17:42:20.910837] [INFO ] [REMOTE    ] BRX: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T17:42:20.947631] [INFO ] [REMOTE    ] BRX: Fetching primary data for 2025-10.
[2025-10-24T17:42:21.273803] [INFO ] [REMOTE    ] BSAC: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T17:42:21.747632] [INFO ] [REMOTE    ] BSAC: Fetching primary data for 2025-09.
[2025-10-24T17:42:22.547701] [INFO ] [REMOTE    ] BSBR: Fetching primary data for 2025-05.
[2025-10-24T17:42:22.826010] [INFO ] [REMOTE    ] BRX: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T17:42:22.836189] [INFO ] [REMOTE    ] BRX: Full fetch complete (75153 records).
[2025-10-24T17:42:22.836320] [DEBUG] [VALIDATOR ] BRX: Validating primary data.
[2025-10-24T17:42:23.199114] [INFO ] [REMOTE    ] BSAC: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T17:42:23.263459] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present.
[2025-10-24T17:42:23.263539] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed.
[2025-10-24T17:42:23.264364] [INFO ] [MAIN      ] BRX: Fetched primary data is valid.
[2025-10-24T17:42:23.264428] [DEBUG] [LOCAL     ] BRX: Saving primary data.
[2025-10-24T17:42:23.265088] [FATAL] [LOCAL     ] BRX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:42:23.265205] [FATAL] [MAIN      ] BRX: Failed to save primary data.
[2025-10-24T17:42:23.265276] [WARN ] [MAIN      ] BRX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:42:23.265346] [INFO ] [LOCAL     ] BRX: Starting deletion of primary data.
[2025-10-24T17:42:23.265409] [DEBUG] [LOCAL     ] BRX: No primary data file found to delete.
[2025-10-24T17:42:23.265445] [INFO ] [LOCAL     ] BRX: Starting deletion of derivative data.
[2025-10-24T17:42:23.265584] [DEBUG] [LOCAL     ] BRX: Deleted derivative data file.
[2025-10-24T17:42:23.266166] [INFO ] [MAIN      ] Update Progress: 341/2366 symbols completed. BRX took 24.1s. Estimated remaining: 4h 11m 26s. Rate: 8.1 symbols/min
[2025-10-24T17:42:23.355153] [INFO ] [REMOTE    ] BSAC: Fetching primary data for 2025-10.
[2025-10-24T17:42:23.433924] [INFO ] [MAIN      ] BSM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:42:23.465743] [DEBUG] [LOCAL     ] BSM: Loaded 32463 existing records from primary storage.
[2025-10-24T17:42:23.465996] [INFO ] [MAIN      ] BSM: Loaded 32463 existing records.
[2025-10-24T17:42:23.644592] [WARN ] [MAIN      ] BSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:42:23.644908] [INFO ] [MAIN      ] BSM: Wiping existing primary data before full refresh.
[2025-10-24T17:42:23.644991] [INFO ] [LOCAL     ] BSM: Starting deletion of primary data.
[2025-10-24T17:42:23.652793] [DEBUG] [LOCAL     ] BSM: Deleted primary data file.
[2025-10-24T17:42:23.664417] [INFO ] [MAIN      ] BSM: Starting full primary refresh.
[2025-10-24T17:42:23.733848] [INFO ] [REMOTE    ] BSBR: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T17:42:24.075985] [INFO ] [REMOTE    ] BSM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:42:24.147615] [INFO ] [REMOTE    ] BSM: Fetching primary data for 2025-01.
[2025-10-24T17:42:24.823402] [INFO ] [REMOTE    ] BSAC: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T17:42:24.830591] [INFO ] [REMOTE    ] BSAC: Full fetch complete (45282 records).
[2025-10-24T17:42:24.830729] [DEBUG] [VALIDATOR ] BSAC: Validating primary data.
[2025-10-24T17:42:24.952874] [INFO ] [REMOTE    ] BSBR: Fetching primary data for 2025-06.
[2025-10-24T17:42:25.237098] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present.
[2025-10-24T17:42:25.237221] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed.
[2025-10-24T17:42:25.238023] [INFO ] [MAIN      ] BSAC: Fetched primary data is valid.
[2025-10-24T17:42:25.238087] [DEBUG] [LOCAL     ] BSAC: Saving primary data.
[2025-10-24T17:42:25.238521] [FATAL] [LOCAL     ] BSAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:42:25.238612] [FATAL] [MAIN      ] BSAC: Failed to save primary data.
[2025-10-24T17:42:25.238711] [WARN ] [MAIN      ] BSAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:42:25.238797] [INFO ] [LOCAL     ] BSAC: Starting deletion of primary data.
[2025-10-24T17:42:25.238874] [DEBUG] [LOCAL     ] BSAC: No primary data file found to delete.
[2025-10-24T17:42:25.238911] [INFO ] [LOCAL     ] BSAC: Starting deletion of derivative data.
[2025-10-24T17:42:25.239029] [DEBUG] [LOCAL     ] BSAC: Deleted derivative data file.
[2025-10-24T17:42:25.239109] [INFO ] [MAIN      ] Update Progress: 342/2366 symbols completed. BSAC took 23.0s. Estimated remaining: 4h 10m 46s. Rate: 8.1 symbols/min
[2025-10-24T17:42:25.407678] [INFO ] [MAIN      ] BST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:42:25.426401] [DEBUG] [LOCAL     ] BST: Loaded 18480 existing records from primary storage.
[2025-10-24T17:42:25.426660] [INFO ] [MAIN      ] BST: Loaded 18480 existing records.
[2025-10-24T17:42:25.546050] [INFO ] [REMOTE    ] BSM: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T17:42:25.629049] [WARN ] [MAIN      ] BST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:42:25.629270] [INFO ] [MAIN      ] BST: Wiping existing primary data before full refresh.
[2025-10-24T17:42:25.629329] [INFO ] [LOCAL     ] BST: Starting deletion of primary data.
[2025-10-24T17:42:25.629823] [DEBUG] [LOCAL     ] BST: Deleted primary data file.
[2025-10-24T17:42:25.629893] [INFO ] [MAIN      ] BST: Starting full primary refresh.
[2025-10-24T17:42:25.752766] [INFO ] [REMOTE    ] BSL: Fetching primary data for 2025-02.
[2025-10-24T17:42:25.987636] [INFO ] [REMOTE    ] BST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:42:26.119315] [INFO ] [REMOTE    ] BSBR: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T17:42:26.547613] [INFO ] [REMOTE    ] BSM: Fetching primary data for 2025-02.
[2025-10-24T17:42:26.672816] [INFO ] [REMOTE    ] BSL: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T17:42:27.347727] [INFO ] [REMOTE    ] BSBR: Fetching primary data for 2025-07.
[2025-10-24T17:42:27.910815] [INFO ] [REMOTE    ] BSM: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T17:42:28.147603] [INFO ] [REMOTE    ] BSM: Fetching primary data for 2025-03.
[2025-10-24T17:42:28.863893] [INFO ] [REMOTE    ] BSBR: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T17:42:28.947728] [INFO ] [REMOTE    ] BST: Fetching primary data for 2025-01.
[2025-10-24T17:42:29.082128] [INFO ] [REMOTE    ] BSM: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T17:42:29.747627] [INFO ] [REMOTE    ] BSM: Fetching primary data for 2025-04.
[2025-10-24T17:42:30.069847] [INFO ] [REMOTE    ] BST: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T17:42:30.547733] [INFO ] [REMOTE    ] BSBR: Fetching primary data for 2025-08.
[2025-10-24T17:42:30.850012] [INFO ] [REMOTE    ] BSM: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T17:42:31.347707] [INFO ] [REMOTE    ] BSL: Fetching primary data for 2025-03.
[2025-10-24T17:42:31.755816] [INFO ] [REMOTE    ] BSBR: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T17:42:32.147624] [INFO ] [REMOTE    ] BSBR: Fetching primary data for 2025-09.
[2025-10-24T17:42:32.191375] [INFO ] [REMOTE    ] BSL: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T17:42:32.947633] [INFO ] [REMOTE    ] BSL: Fetching primary data for 2025-04.
[2025-10-24T17:42:33.506191] [INFO ] [REMOTE    ] BSBR: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T17:42:33.723521] [INFO ] [REMOTE    ] BSL: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T17:42:33.747606] [INFO ] [REMOTE    ] BSL: Fetching primary data for 2025-05.
[2025-10-24T17:42:34.441590] [INFO ] [REMOTE    ] BSL: Incremental fetch complete for 2025-05 (0.69 seconds).
[2025-10-24T17:42:34.547626] [INFO ] [REMOTE    ] BSM: Fetching primary data for 2025-05.
[2025-10-24T17:42:35.347623] [INFO ] [REMOTE    ] BST: Fetching primary data for 2025-02.
[2025-10-24T17:42:36.054947] [INFO ] [REMOTE    ] BSM: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T17:42:36.147724] [INFO ] [REMOTE    ] BSBR: Fetching primary data for 2025-10.
[2025-10-24T17:42:36.414599] [INFO ] [REMOTE    ] BST: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T17:42:36.947736] [INFO ] [REMOTE    ] BST: Fetching primary data for 2025-03.
[2025-10-24T17:42:37.683884] [INFO ] [REMOTE    ] BSBR: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T17:42:37.690844] [INFO ] [REMOTE    ] BSBR: Full fetch complete (50898 records).
[2025-10-24T17:42:37.691004] [DEBUG] [VALIDATOR ] BSBR: Validating primary data.
[2025-10-24T17:42:37.752802] [INFO ] [REMOTE    ] BSL: Fetching primary data for 2025-06.
[2025-10-24T17:42:38.097882] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present.
[2025-10-24T17:42:38.105527] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed.
[2025-10-24T17:42:38.118693] [INFO ] [MAIN      ] BSBR: Fetched primary data is valid.
[2025-10-24T17:42:38.119263] [DEBUG] [LOCAL     ] BSBR: Saving primary data.
[2025-10-24T17:42:38.120495] [INFO ] [REMOTE    ] BST: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T17:42:38.120733] [FATAL] [LOCAL     ] BSBR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:42:38.127964] [FATAL] [MAIN      ] BSBR: Failed to save primary data.
[2025-10-24T17:42:38.128441] [WARN ] [MAIN      ] BSBR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:42:38.128933] [INFO ] [LOCAL     ] BSBR: Starting deletion of primary data.
[2025-10-24T17:42:38.129001] [DEBUG] [LOCAL     ] BSBR: No primary data file found to delete.
[2025-10-24T17:42:38.129044] [INFO ] [LOCAL     ] BSBR: Starting deletion of derivative data.
[2025-10-24T17:42:38.129218] [DEBUG] [LOCAL     ] BSBR: Deleted derivative data file.
[2025-10-24T17:42:38.129598] [INFO ] [MAIN      ] Update Progress: 343/2366 symbols completed. BSBR took 33.4s. Estimated remaining: 4h 11m 11s. Rate: 8.1 symbols/min
[2025-10-24T17:42:38.302429] [INFO ] [MAIN      ] BSTZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:42:38.327526] [DEBUG] [LOCAL     ] BSTZ: Loaded 24564 existing records from primary storage.
[2025-10-24T17:42:38.327805] [INFO ] [MAIN      ] BSTZ: Loaded 24564 existing records.
[2025-10-24T17:42:38.489966] [INFO ] [REMOTE    ] BSL: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T17:42:38.512964] [WARN ] [MAIN      ] BSTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:42:38.515490] [INFO ] [MAIN      ] BSTZ: Wiping existing primary data before full refresh.
[2025-10-24T17:42:38.515544] [INFO ] [LOCAL     ] BSTZ: Starting deletion of primary data.
[2025-10-24T17:42:38.516024] [DEBUG] [LOCAL     ] BSTZ: Deleted primary data file.
[2025-10-24T17:42:38.516081] [INFO ] [MAIN      ] BSTZ: Starting full primary refresh.
[2025-10-24T17:42:38.552889] [INFO ] [REMOTE    ] BST: Fetching primary data for 2025-04.
[2025-10-24T17:42:38.887178] [INFO ] [REMOTE    ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:42:39.347715] [INFO ] [REMOTE    ] BSM: Fetching primary data for 2025-06.
[2025-10-24T17:42:39.647139] [INFO ] [REMOTE    ] BST: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T17:42:40.147767] [INFO ] [REMOTE    ] BST: Fetching primary data for 2025-05.
[2025-10-24T17:42:40.639722] [INFO ] [REMOTE    ] BSM: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T17:42:40.947678] [INFO ] [REMOTE    ] BSL: Fetching primary data for 2025-07.
[2025-10-24T17:42:41.393086] [INFO ] [REMOTE    ] BST: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T17:42:41.747723] [INFO ] [REMOTE    ] BSTZ: Fetching primary data for 2025-01.
[2025-10-24T17:42:42.062940] [INFO ] [REMOTE    ] BSL: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T17:42:42.547707] [INFO ] [REMOTE    ] BST: Fetching primary data for 2025-06.
[2025-10-24T17:42:43.347702] [INFO ] [REMOTE    ] BSM: Fetching primary data for 2025-07.
[2025-10-24T17:42:43.600764] [INFO ] [REMOTE    ] BSTZ: Incremental fetch complete for 2025-01 (1.85 seconds).
[2025-10-24T17:42:43.653246] [INFO ] [REMOTE    ] BST: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T17:42:44.147689] [INFO ] [REMOTE    ] BSL: Fetching primary data for 2025-08.
[2025-10-24T17:42:44.429187] [INFO ] [REMOTE    ] BSM: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T17:42:44.674340] [INFO ] [REMOTE    ] BSL: Incremental fetch complete for 2025-08 (0.53 seconds).
[2025-10-24T17:42:44.947752] [INFO ] [REMOTE    ] BST: Fetching primary data for 2025-07.
[2025-10-24T17:42:45.747745] [INFO ] [REMOTE    ] BSM: Fetching primary data for 2025-08.
[2025-10-24T17:42:46.003460] [INFO ] [REMOTE    ] BST: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T17:42:46.547740] [INFO ] [REMOTE    ] BST: Fetching primary data for 2025-08.
[2025-10-24T17:42:47.334752] [INFO ] [REMOTE    ] BSM: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T17:42:47.347609] [INFO ] [REMOTE    ] BSM: Fetching primary data for 2025-09.
[2025-10-24T17:42:47.621220] [INFO ] [REMOTE    ] BST: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T17:42:48.147724] [INFO ] [REMOTE    ] BST: Fetching primary data for 2025-09.
[2025-10-24T17:42:48.783681] [INFO ] [REMOTE    ] BSM: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T17:42:48.870258] [INFO ] [REMOTE    ] BST: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T17:42:48.947725] [INFO ] [REMOTE    ] BSL: Fetching primary data for 2025-09.
[2025-10-24T17:42:49.663451] [INFO ] [REMOTE    ] BSL: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T17:42:49.747698] [INFO ] [REMOTE    ] BSL: Fetching primary data for 2025-10.
[2025-10-24T17:42:50.547740] [INFO ] [REMOTE    ] BSTZ: Fetching primary data for 2025-02.
[2025-10-24T17:42:50.723572] [INFO ] [REMOTE    ] BSL: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T17:42:50.726421] [INFO ] [REMOTE    ] BSL: Full fetch complete (13002 records).
[2025-10-24T17:42:50.726501] [DEBUG] [VALIDATOR ] BSL: Validating primary data.
[2025-10-24T17:42:51.165160] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present.
[2025-10-24T17:42:51.165409] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed.
[2025-10-24T17:42:51.165996] [INFO ] [MAIN      ] BSL: Fetched primary data is valid.
[2025-10-24T17:42:51.166104] [DEBUG] [LOCAL     ] BSL: Saving primary data.
[2025-10-24T17:42:51.166394] [FATAL] [LOCAL     ] BSL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:42:51.166493] [FATAL] [MAIN      ] BSL: Failed to save primary data.
[2025-10-24T17:42:51.166612] [WARN ] [MAIN      ] BSL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:42:51.166863] [INFO ] [LOCAL     ] BSL: Starting deletion of primary data.
[2025-10-24T17:42:51.167028] [DEBUG] [LOCAL     ] BSL: No primary data file found to delete.
[2025-10-24T17:42:51.167109] [INFO ] [LOCAL     ] BSL: Starting deletion of derivative data.
[2025-10-24T17:42:51.167563] [DEBUG] [LOCAL     ] BSL: Deleted derivative data file.
[2025-10-24T17:42:51.167731] [INFO ] [MAIN      ] Update Progress: 344/2366 symbols completed. BSL took 45.9s. Estimated remaining: 4h 11m 36s. Rate: 8.0 symbols/min
[2025-10-24T17:42:51.299061] [INFO ] [REMOTE    ] BSTZ: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T17:42:51.352822] [INFO ] [REMOTE    ] BSM: Fetching primary data for 2025-10.
[2025-10-24T17:42:51.382335] [INFO ] [MAIN      ] BSX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:42:51.442428] [DEBUG] [LOCAL     ] BSX: Loaded 54078 existing records from primary storage.
[2025-10-24T17:42:51.442904] [INFO ] [MAIN      ] BSX: Loaded 54078 existing records.
[2025-10-24T17:42:51.643985] [WARN ] [MAIN      ] BSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:42:51.644260] [INFO ] [MAIN      ] BSX: Wiping existing primary data before full refresh.
[2025-10-24T17:42:51.644310] [INFO ] [LOCAL     ] BSX: Starting deletion of primary data.
[2025-10-24T17:42:51.645456] [DEBUG] [LOCAL     ] BSX: Deleted primary data file.
[2025-10-24T17:42:51.645517] [INFO ] [MAIN      ] BSX: Starting full primary refresh.
[2025-10-24T17:42:52.018048] [INFO ] [REMOTE    ] BSX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:42:52.147728] [INFO ] [REMOTE    ] BSX: Fetching primary data for 2025-01.
[2025-10-24T17:42:52.636867] [INFO ] [REMOTE    ] BSM: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T17:42:52.642353] [INFO ] [REMOTE    ] BSM: Full fetch complete (46634 records).
[2025-10-24T17:42:52.642448] [DEBUG] [VALIDATOR ] BSM: Validating primary data.
[2025-10-24T17:42:52.952849] [INFO ] [REMOTE    ] BSTZ: Fetching primary data for 2025-03.
[2025-10-24T17:42:53.028274] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present.
[2025-10-24T17:42:53.028355] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed.
[2025-10-24T17:42:53.029058] [INFO ] [MAIN      ] BSM: Fetched primary data is valid.
[2025-10-24T17:42:53.029122] [DEBUG] [LOCAL     ] BSM: Saving primary data.
[2025-10-24T17:42:53.029547] [FATAL] [LOCAL     ] BSM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:42:53.029634] [FATAL] [MAIN      ] BSM: Failed to save primary data.
[2025-10-24T17:42:53.029719] [WARN ] [MAIN      ] BSM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:42:53.029793] [INFO ] [LOCAL     ] BSM: Starting deletion of primary data.
[2025-10-24T17:42:53.029865] [DEBUG] [LOCAL     ] BSM: No primary data file found to delete.
[2025-10-24T17:42:53.029913] [INFO ] [LOCAL     ] BSM: Starting deletion of derivative data.
[2025-10-24T17:42:53.030120] [DEBUG] [LOCAL     ] BSM: Deleted derivative data file.
[2025-10-24T17:42:53.030217] [INFO ] [MAIN      ] Update Progress: 345/2366 symbols completed. BSM took 29.8s. Estimated remaining: 4h 10m 56s. Rate: 8.1 symbols/min
[2025-10-24T17:42:53.201401] [INFO ] [MAIN      ] BTA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:42:53.209219] [DEBUG] [LOCAL     ] BTA: Loaded 5788 existing records from primary storage.
[2025-10-24T17:42:53.209466] [INFO ] [MAIN      ] BTA: Loaded 5788 existing records.
[2025-10-24T17:42:53.385932] [WARN ] [MAIN      ] BTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:42:53.386139] [INFO ] [MAIN      ] BTA: Wiping existing primary data before full refresh.
[2025-10-24T17:42:53.386186] [INFO ] [LOCAL     ] BTA: Starting deletion of primary data.
[2025-10-24T17:42:53.386453] [DEBUG] [LOCAL     ] BTA: Deleted primary data file.
[2025-10-24T17:42:53.386513] [INFO ] [MAIN      ] BTA: Starting full primary refresh.
[2025-10-24T17:42:53.748301] [INFO ] [REMOTE    ] BST: Fetching primary data for 2025-10.
[2025-10-24T17:42:53.753714] [INFO ] [REMOTE    ] BTA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:42:53.902468] [INFO ] [REMOTE    ] BSX: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T17:42:53.928887] [INFO ] [REMOTE    ] BSTZ: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T17:42:54.547637] [INFO ] [REMOTE    ] BTA: Fetching primary data for 2025-01.
[2025-10-24T17:42:54.594691] [INFO ] [REMOTE    ] BST: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T17:42:54.598060] [INFO ] [REMOTE    ] BST: Full fetch complete (28239 records).
[2025-10-24T17:42:54.598136] [DEBUG] [VALIDATOR ] BST: Validating primary data.
[2025-10-24T17:42:54.967327] [DEBUG] [VALIDATOR ] BST: All expected trading days are present.
[2025-10-24T17:42:54.967411] [DEBUG] [VALIDATOR ] BST: Primary data validation passed.
[2025-10-24T17:42:54.967842] [INFO ] [MAIN      ] BST: Fetched primary data is valid.
[2025-10-24T17:42:54.967906] [DEBUG] [LOCAL     ] BST: Saving primary data.
[2025-10-24T17:42:54.968197] [FATAL] [LOCAL     ] BST: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:42:54.968280] [FATAL] [MAIN      ] BST: Failed to save primary data.
[2025-10-24T17:42:54.968322] [WARN ] [MAIN      ] BST: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:42:54.968376] [INFO ] [LOCAL     ] BST: Starting deletion of primary data.
[2025-10-24T17:42:54.968463] [DEBUG] [LOCAL     ] BST: No primary data file found to delete.
[2025-10-24T17:42:54.968523] [INFO ] [LOCAL     ] BST: Starting deletion of derivative data.
[2025-10-24T17:42:54.968732] [DEBUG] [LOCAL     ] BST: Deleted derivative data file.
[2025-10-24T17:42:54.968836] [INFO ] [MAIN      ] Update Progress: 346/2366 symbols completed. BST took 29.7s. Estimated remaining: 4h 10m 16s. Rate: 8.1 symbols/min
[2025-10-24T17:42:55.150853] [INFO ] [MAIN      ] BTE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:42:55.201831] [DEBUG] [LOCAL     ] BTE: Loaded 53081 existing records from primary storage.
[2025-10-24T17:42:55.202135] [INFO ] [MAIN      ] BTE: Loaded 53081 existing records.
[2025-10-24T17:42:55.352778] [INFO ] [REMOTE    ] BSTZ: Fetching primary data for 2025-04.
[2025-10-24T17:42:55.382286] [WARN ] [MAIN      ] BTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:42:55.382635] [INFO ] [MAIN      ] BTE: Wiping existing primary data before full refresh.
[2025-10-24T17:42:55.382729] [INFO ] [LOCAL     ] BTE: Starting deletion of primary data.
[2025-10-24T17:42:55.382935] [DEBUG] [LOCAL     ] BTE: Deleted primary data file.
[2025-10-24T17:42:55.382973] [INFO ] [MAIN      ] BTE: Starting full primary refresh.
[2025-10-24T17:42:55.494011] [INFO ] [REMOTE    ] BTA: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T17:42:55.753326] [INFO ] [REMOTE    ] BTE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:42:56.147725] [INFO ] [REMOTE    ] BTA: Fetching primary data for 2025-02.
[2025-10-24T17:42:56.448853] [INFO ] [REMOTE    ] BSTZ: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T17:42:56.594962] [INFO ] [REMOTE    ] BTA: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T17:42:56.947673] [INFO ] [REMOTE    ] BSTZ: Fetching primary data for 2025-05.
[2025-10-24T17:42:57.747626] [INFO ] [REMOTE    ] BTE: Fetching primary data for 2025-01.
[2025-10-24T17:42:58.070683] [INFO ] [REMOTE    ] BSTZ: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T17:42:58.547679] [INFO ] [REMOTE    ] BSX: Fetching primary data for 2025-02.
[2025-10-24T17:42:59.347698] [INFO ] [REMOTE    ] BSTZ: Fetching primary data for 2025-06.
[2025-10-24T17:42:59.519417] [INFO ] [REMOTE    ] BTE: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T17:43:00.147699] [INFO ] [REMOTE    ] BTA: Fetching primary data for 2025-03.
[2025-10-24T17:43:00.316426] [INFO ] [REMOTE    ] BSX: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T17:43:00.486399] [INFO ] [REMOTE    ] BSTZ: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T17:43:00.842142] [INFO ] [REMOTE    ] BTA: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T17:43:00.947627] [INFO ] [REMOTE    ] BSTZ: Fetching primary data for 2025-07.
[2025-10-24T17:43:01.747673] [INFO ] [REMOTE    ] BTE: Fetching primary data for 2025-02.
[2025-10-24T17:43:02.547699] [INFO ] [REMOTE    ] BTA: Fetching primary data for 2025-04.
[2025-10-24T17:43:03.347723] [INFO ] [REMOTE    ] BSX: Fetching primary data for 2025-03.
[2025-10-24T17:43:03.920994] [INFO ] [REMOTE    ] BTA: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T17:43:03.971400] [INFO ] [REMOTE    ] BSTZ: Incremental fetch complete for 2025-07 (3.02 seconds).
[2025-10-24T17:43:04.153288] [INFO ] [REMOTE    ] BTA: Fetching primary data for 2025-05.
[2025-10-24T17:43:04.165277] [INFO ] [REMOTE    ] BTE: Incremental fetch complete for 2025-02 (2.42 seconds).
[2025-10-24T17:43:04.947730] [INFO ] [REMOTE    ] BTE: Fetching primary data for 2025-03.
[2025-10-24T17:43:05.627071] [INFO ] [REMOTE    ] BTA: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T17:43:05.747706] [INFO ] [REMOTE    ] BTA: Fetching primary data for 2025-06.
[2025-10-24T17:43:05.882040] [INFO ] [REMOTE    ] BSX: Incremental fetch complete for 2025-03 (2.53 seconds).
[2025-10-24T17:43:06.315903] [INFO ] [REMOTE    ] BTA: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T17:43:06.547627] [INFO ] [REMOTE    ] BSX: Fetching primary data for 2025-04.
[2025-10-24T17:43:06.707434] [INFO ] [REMOTE    ] BTE: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T17:43:07.347701] [INFO ] [REMOTE    ] BSTZ: Fetching primary data for 2025-08.
[2025-10-24T17:43:08.147695] [INFO ] [REMOTE    ] BTE: Fetching primary data for 2025-04.
[2025-10-24T17:43:08.258887] [INFO ] [REMOTE    ] BSX: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T17:43:08.522203] [INFO ] [REMOTE    ] BSTZ: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T17:43:08.947723] [INFO ] [REMOTE    ] BSTZ: Fetching primary data for 2025-09.
[2025-10-24T17:43:09.747671] [INFO ] [REMOTE    ] BTA: Fetching primary data for 2025-07.
[2025-10-24T17:43:09.835264] [INFO ] [REMOTE    ] BTE: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T17:43:10.061023] [INFO ] [REMOTE    ] BSTZ: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T17:43:10.453721] [INFO ] [REMOTE    ] BTA: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T17:43:10.547637] [INFO ] [REMOTE    ] BSTZ: Fetching primary data for 2025-10.
[2025-10-24T17:43:11.347671] [INFO ] [REMOTE    ] BSX: Fetching primary data for 2025-05.
[2025-10-24T17:43:11.641361] [INFO ] [REMOTE    ] BSTZ: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T17:43:11.645888] [INFO ] [REMOTE    ] BSTZ: Full fetch complete (36268 records).
[2025-10-24T17:43:11.645972] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data.
[2025-10-24T17:43:12.009191] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present.
[2025-10-24T17:43:12.009313] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed.
[2025-10-24T17:43:12.009813] [INFO ] [MAIN      ] BSTZ: Fetched primary data is valid.
[2025-10-24T17:43:12.009878] [DEBUG] [LOCAL     ] BSTZ: Saving primary data.
[2025-10-24T17:43:12.010204] [FATAL] [LOCAL     ] BSTZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:43:12.010290] [FATAL] [MAIN      ] BSTZ: Failed to save primary data.
[2025-10-24T17:43:12.010331] [WARN ] [MAIN      ] BSTZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:43:12.010366] [INFO ] [LOCAL     ] BSTZ: Starting deletion of primary data.
[2025-10-24T17:43:12.010416] [DEBUG] [LOCAL     ] BSTZ: No primary data file found to delete.
[2025-10-24T17:43:12.010450] [INFO ] [LOCAL     ] BSTZ: Starting deletion of derivative data.
[2025-10-24T17:43:12.010592] [DEBUG] [LOCAL     ] BSTZ: Deleted derivative data file.
[2025-10-24T17:43:12.010716] [INFO ] [MAIN      ] Update Progress: 347/2366 symbols completed. BSTZ took 33.9s. Estimated remaining: 4h 11m 5s. Rate: 8.0 symbols/min
[2025-10-24T17:43:12.152820] [INFO ] [REMOTE    ] BTA: Fetching primary data for 2025-08.
[2025-10-24T17:43:12.176481] [INFO ] [MAIN      ] BTI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:43:12.231029] [DEBUG] [LOCAL     ] BTI: Loaded 53980 existing records from primary storage.
[2025-10-24T17:43:12.231327] [INFO ] [MAIN      ] BTI: Loaded 53980 existing records.
[2025-10-24T17:43:12.404131] [WARN ] [MAIN      ] BTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:43:12.404337] [INFO ] [MAIN      ] BTI: Wiping existing primary data before full refresh.
[2025-10-24T17:43:12.404384] [INFO ] [LOCAL     ] BTI: Starting deletion of primary data.
[2025-10-24T17:43:12.404785] [DEBUG] [LOCAL     ] BTI: Deleted primary data file.
[2025-10-24T17:43:12.404846] [INFO ] [MAIN      ] BTI: Starting full primary refresh.
[2025-10-24T17:43:12.584520] [INFO ] [REMOTE    ] BTA: Incremental fetch complete for 2025-08 (0.43 seconds).
[2025-10-24T17:43:12.785413] [INFO ] [REMOTE    ] BTI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:43:12.947726] [INFO ] [REMOTE    ] BTA: Fetching primary data for 2025-09.
[2025-10-24T17:43:13.224965] [INFO ] [REMOTE    ] BSX: Incremental fetch complete for 2025-05 (1.88 seconds).
[2025-10-24T17:43:13.568298] [INFO ] [REMOTE    ] BTA: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T17:43:13.747682] [INFO ] [REMOTE    ] BTE: Fetching primary data for 2025-05.
[2025-10-24T17:43:14.547742] [INFO ] [REMOTE    ] BSX: Fetching primary data for 2025-06.
[2025-10-24T17:43:15.332494] [INFO ] [REMOTE    ] BTE: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T17:43:15.347595] [INFO ] [REMOTE    ] BTE: Fetching primary data for 2025-06.
[2025-10-24T17:43:16.147678] [INFO ] [REMOTE    ] BTI: Fetching primary data for 2025-01.
[2025-10-24T17:43:16.555496] [INFO ] [REMOTE    ] BSX: Incremental fetch complete for 2025-06 (2.01 seconds).
[2025-10-24T17:43:16.947637] [INFO ] [REMOTE    ] BSX: Fetching primary data for 2025-07.
[2025-10-24T17:43:17.376124] [INFO ] [REMOTE    ] BTE: Incremental fetch complete for 2025-06 (2.03 seconds).
[2025-10-24T17:43:17.747710] [INFO ] [REMOTE    ] BTE: Fetching primary data for 2025-07.
[2025-10-24T17:43:18.455208] [INFO ] [REMOTE    ] BTI: Incremental fetch complete for 2025-01 (2.31 seconds).
[2025-10-24T17:43:18.547681] [INFO ] [REMOTE    ] BTA: Fetching primary data for 2025-10.
[2025-10-24T17:43:18.592965] [INFO ] [REMOTE    ] BSX: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T17:43:19.142829] [INFO ] [REMOTE    ] BTA: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T17:43:19.144517] [INFO ] [REMOTE    ] BTA: Full fetch complete (9103 records).
[2025-10-24T17:43:19.144599] [DEBUG] [VALIDATOR ] BTA: Validating primary data.
[2025-10-24T17:43:19.352812] [INFO ] [REMOTE    ] BTI: Fetching primary data for 2025-02.
[2025-10-24T17:43:19.558189] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present.
[2025-10-24T17:43:19.558382] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed.
[2025-10-24T17:43:19.558687] [INFO ] [MAIN      ] BTA: Fetched primary data is valid.
[2025-10-24T17:43:19.558767] [DEBUG] [LOCAL     ] BTA: Saving primary data.
[2025-10-24T17:43:19.560575] [INFO ] [REMOTE    ] BTE: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T17:43:19.559500] [FATAL] [LOCAL     ] BTA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:43:19.571461] [FATAL] [MAIN      ] BTA: Failed to save primary data.
[2025-10-24T17:43:19.571889] [WARN ] [MAIN      ] BTA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:43:19.571965] [INFO ] [LOCAL     ] BTA: Starting deletion of primary data.
[2025-10-24T17:43:19.572066] [DEBUG] [LOCAL     ] BTA: No primary data file found to delete.
[2025-10-24T17:43:19.572447] [INFO ] [LOCAL     ] BTA: Starting deletion of derivative data.
[2025-10-24T17:43:19.572620] [DEBUG] [LOCAL     ] BTA: Deleted derivative data file.
[2025-10-24T17:43:19.572751] [INFO ] [MAIN      ] Update Progress: 348/2366 symbols completed. BTA took 26.5s. Estimated remaining: 4h 10m 58s. Rate: 8.0 symbols/min
[2025-10-24T17:43:19.742375] [INFO ] [MAIN      ] BTO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:43:19.754430] [DEBUG] [LOCAL     ] BTO: Loaded 8744 existing records from primary storage.
[2025-10-24T17:43:19.754692] [INFO ] [MAIN      ] BTO: Loaded 8744 existing records.
[2025-10-24T17:43:19.935071] [WARN ] [MAIN      ] BTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:43:19.935288] [INFO ] [MAIN      ] BTO: Wiping existing primary data before full refresh.
[2025-10-24T17:43:19.935333] [INFO ] [LOCAL     ] BTO: Starting deletion of primary data.
[2025-10-24T17:43:19.935518] [DEBUG] [LOCAL     ] BTO: Deleted primary data file.
[2025-10-24T17:43:19.935571] [INFO ] [MAIN      ] BTO: Starting full primary refresh.
[2025-10-24T17:43:20.154283] [INFO ] [REMOTE    ] BSX: Fetching primary data for 2025-08.
[2025-10-24T17:43:20.296019] [INFO ] [REMOTE    ] BTO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:43:20.947722] [INFO ] [REMOTE    ] BTO: Fetching primary data for 2025-01.
[2025-10-24T17:43:21.136286] [INFO ] [REMOTE    ] BTI: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T17:43:21.567384] [INFO ] [REMOTE    ] BSX: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T17:43:21.747749] [INFO ] [REMOTE    ] BTE: Fetching primary data for 2025-08.
[2025-10-24T17:43:21.933863] [INFO ] [REMOTE    ] BTO: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T17:43:22.547690] [INFO ] [REMOTE    ] BTO: Fetching primary data for 2025-02.
[2025-10-24T17:43:23.071375] [INFO ] [REMOTE    ] BTO: Incremental fetch complete for 2025-02 (0.52 seconds).
[2025-10-24T17:43:23.347712] [INFO ] [REMOTE    ] BTO: Fetching primary data for 2025-03.
[2025-10-24T17:43:23.502380] [INFO ] [REMOTE    ] BTE: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T17:43:23.875267] [INFO ] [REMOTE    ] BTO: Incremental fetch complete for 2025-03 (0.53 seconds).
[2025-10-24T17:43:24.147738] [INFO ] [REMOTE    ] BTE: Fetching primary data for 2025-09.
[2025-10-24T17:43:24.947693] [INFO ] [REMOTE    ] BTI: Fetching primary data for 2025-03.
[2025-10-24T17:43:25.747632] [INFO ] [REMOTE    ] BTO: Fetching primary data for 2025-04.
[2025-10-24T17:43:25.958509] [INFO ] [REMOTE    ] BTE: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T17:43:26.260681] [INFO ] [REMOTE    ] BTI: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T17:43:26.547631] [INFO ] [REMOTE    ] BSX: Fetching primary data for 2025-09.
[2025-10-24T17:43:26.557212] [INFO ] [REMOTE    ] BTO: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T17:43:27.347628] [INFO ] [REMOTE    ] BTO: Fetching primary data for 2025-05.
[2025-10-24T17:43:27.964124] [INFO ] [REMOTE    ] BTO: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T17:43:28.147670] [INFO ] [REMOTE    ] BTO: Fetching primary data for 2025-06.
[2025-10-24T17:43:28.556452] [INFO ] [REMOTE    ] BSX: Incremental fetch complete for 2025-09 (2.01 seconds).
[2025-10-24T17:43:28.827934] [INFO ] [REMOTE    ] BTO: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T17:43:28.947610] [INFO ] [REMOTE    ] BTO: Fetching primary data for 2025-07.
[2025-10-24T17:43:29.520339] [INFO ] [REMOTE    ] BTO: Incremental fetch complete for 2025-07 (0.57 seconds).
[2025-10-24T17:43:29.747694] [INFO ] [REMOTE    ] BTE: Fetching primary data for 2025-10.
[2025-10-24T17:43:30.547681] [INFO ] [REMOTE    ] BTO: Fetching primary data for 2025-08.
[2025-10-24T17:43:31.288661] [INFO ] [REMOTE    ] BTO: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T17:43:31.347671] [INFO ] [REMOTE    ] BTI: Fetching primary data for 2025-04.
[2025-10-24T17:43:31.538494] [INFO ] [REMOTE    ] BTE: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T17:43:31.549360] [INFO ] [REMOTE    ] BTE: Full fetch complete (76357 records).
[2025-10-24T17:43:31.549570] [DEBUG] [VALIDATOR ] BTE: Validating primary data.
[2025-10-24T17:43:31.987297] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present.
[2025-10-24T17:43:31.987401] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed.
[2025-10-24T17:43:31.988418] [INFO ] [MAIN      ] BTE: Fetched primary data is valid.
[2025-10-24T17:43:31.988484] [DEBUG] [LOCAL     ] BTE: Saving primary data.
[2025-10-24T17:43:31.989167] [FATAL] [LOCAL     ] BTE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:43:31.989265] [FATAL] [MAIN      ] BTE: Failed to save primary data.
[2025-10-24T17:43:31.989337] [WARN ] [MAIN      ] BTE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:43:31.989424] [INFO ] [LOCAL     ] BTE: Starting deletion of primary data.
[2025-10-24T17:43:31.989520] [DEBUG] [LOCAL     ] BTE: No primary data file found to delete.
[2025-10-24T17:43:31.989587] [INFO ] [LOCAL     ] BTE: Starting deletion of derivative data.
[2025-10-24T17:43:31.989778] [DEBUG] [LOCAL     ] BTE: Deleted derivative data file.
[2025-10-24T17:43:31.990294] [INFO ] [MAIN      ] Update Progress: 349/2366 symbols completed. BTE took 37.0s. Estimated remaining: 4h 11m 19s. Rate: 8.0 symbols/min
[2025-10-24T17:43:32.153731] [INFO ] [REMOTE    ] BTO: Fetching primary data for 2025-09.
[2025-10-24T17:43:32.194090] [INFO ] [MAIN      ] BTT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:43:32.213992] [DEBUG] [LOCAL     ] BTT: Loaded 15457 existing records from primary storage.
[2025-10-24T17:43:32.214243] [INFO ] [MAIN      ] BTT: Loaded 15457 existing records.
[2025-10-24T17:43:32.418867] [WARN ] [MAIN      ] BTT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:43:32.419078] [INFO ] [MAIN      ] BTT: Wiping existing primary data before full refresh.
[2025-10-24T17:43:32.419125] [INFO ] [LOCAL     ] BTT: Starting deletion of primary data.
[2025-10-24T17:43:32.419296] [DEBUG] [LOCAL     ] BTT: Deleted primary data file.
[2025-10-24T17:43:32.419334] [INFO ] [MAIN      ] BTT: Starting full primary refresh.
[2025-10-24T17:43:32.771169] [INFO ] [REMOTE    ] BTT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:43:32.840783] [INFO ] [REMOTE    ] BTO: Incremental fetch complete for 2025-09 (0.69 seconds).
[2025-10-24T17:43:32.947605] [INFO ] [REMOTE    ] BTT: Fetching primary data for 2025-01.
[2025-10-24T17:43:33.391555] [INFO ] [REMOTE    ] BTI: Incremental fetch complete for 2025-04 (2.04 seconds).
[2025-10-24T17:43:33.747609] [INFO ] [REMOTE    ] BTO: Fetching primary data for 2025-10.
[2025-10-24T17:43:33.797118] [INFO ] [REMOTE    ] BTT: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T17:43:34.547607] [INFO ] [REMOTE    ] BTI: Fetching primary data for 2025-05.
[2025-10-24T17:43:34.617503] [INFO ] [REMOTE    ] BTO: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T17:43:34.619832] [INFO ] [REMOTE    ] BTO: Full fetch complete (13250 records).
[2025-10-24T17:43:34.619901] [DEBUG] [VALIDATOR ] BTO: Validating primary data.
[2025-10-24T17:43:34.993007] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present.
[2025-10-24T17:43:34.993113] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed.
[2025-10-24T17:43:34.993464] [INFO ] [MAIN      ] BTO: Fetched primary data is valid.
[2025-10-24T17:43:34.993521] [DEBUG] [LOCAL     ] BTO: Saving primary data.
[2025-10-24T17:43:34.993780] [FATAL] [LOCAL     ] BTO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:43:34.993881] [FATAL] [MAIN      ] BTO: Failed to save primary data.
[2025-10-24T17:43:34.993953] [WARN ] [MAIN      ] BTO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:43:34.994050] [INFO ] [LOCAL     ] BTO: Starting deletion of primary data.
[2025-10-24T17:43:34.994122] [DEBUG] [LOCAL     ] BTO: No primary data file found to delete.
[2025-10-24T17:43:34.994185] [INFO ] [LOCAL     ] BTO: Starting deletion of derivative data.
[2025-10-24T17:43:34.994328] [DEBUG] [LOCAL     ] BTO: Deleted derivative data file.
[2025-10-24T17:43:34.994399] [INFO ] [MAIN      ] Update Progress: 350/2366 symbols completed. BTO took 15.4s. Estimated remaining: 4h 10m 46s. Rate: 8.0 symbols/min
[2025-10-24T17:43:35.183188] [INFO ] [MAIN      ] BTU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:43:35.237579] [DEBUG] [LOCAL     ] BTU: Loaded 53724 existing records from primary storage.
[2025-10-24T17:43:35.237943] [INFO ] [MAIN      ] BTU: Loaded 53724 existing records.
[2025-10-24T17:43:35.352728] [INFO ] [REMOTE    ] BSX: Fetching primary data for 2025-10.
[2025-10-24T17:43:35.423147] [WARN ] [MAIN      ] BTU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:43:35.423437] [INFO ] [MAIN      ] BTU: Wiping existing primary data before full refresh.
[2025-10-24T17:43:35.423488] [INFO ] [LOCAL     ] BTU: Starting deletion of primary data.
[2025-10-24T17:43:35.423719] [DEBUG] [LOCAL     ] BTU: Deleted primary data file.
[2025-10-24T17:43:35.423777] [INFO ] [MAIN      ] BTU: Starting full primary refresh.
[2025-10-24T17:43:35.791086] [INFO ] [REMOTE    ] BTU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:43:36.147616] [INFO ] [REMOTE    ] BTU: Fetching primary data for 2025-01.
[2025-10-24T17:43:36.441685] [INFO ] [REMOTE    ] BTI: Incremental fetch complete for 2025-05 (1.89 seconds).
[2025-10-24T17:43:36.947677] [INFO ] [REMOTE    ] BTT: Fetching primary data for 2025-02.
[2025-10-24T17:43:37.556752] [INFO ] [REMOTE    ] BSX: Incremental fetch complete for 2025-10 (2.20 seconds).
[2025-10-24T17:43:37.570362] [INFO ] [REMOTE    ] BSX: Full fetch complete (77865 records).
[2025-10-24T17:43:37.570497] [DEBUG] [VALIDATOR ] BSX: Validating primary data.
[2025-10-24T17:43:37.754778] [INFO ] [REMOTE    ] BTI: Fetching primary data for 2025-06.
[2025-10-24T17:43:38.006461] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present.
[2025-10-24T17:43:38.008037] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed.
[2025-10-24T17:43:38.009032] [INFO ] [MAIN      ] BSX: Fetched primary data is valid.
[2025-10-24T17:43:38.009839] [DEBUG] [LOCAL     ] BSX: Saving primary data.
[2025-10-24T17:43:38.010845] [INFO ] [REMOTE    ] BTT: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T17:43:38.011039] [FATAL] [LOCAL     ] BSX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:43:38.015134] [FATAL] [MAIN      ] BSX: Failed to save primary data.
[2025-10-24T17:43:38.015209] [WARN ] [MAIN      ] BSX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:43:38.015259] [INFO ] [LOCAL     ] BSX: Starting deletion of primary data.
[2025-10-24T17:43:38.015314] [DEBUG] [LOCAL     ] BSX: No primary data file found to delete.
[2025-10-24T17:43:38.015352] [INFO ] [LOCAL     ] BSX: Starting deletion of derivative data.
[2025-10-24T17:43:38.015531] [DEBUG] [LOCAL     ] BSX: Deleted derivative data file.
[2025-10-24T17:43:38.015994] [INFO ] [MAIN      ] Update Progress: 351/2366 symbols completed. BSX took 46.8s. Estimated remaining: 4h 10m 13s. Rate: 8.1 symbols/min
[2025-10-24T17:43:38.197920] [INFO ] [MAIN      ] BTX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:43:38.198071] [DEBUG] [LOCAL     ] BTX: No existing data file found in primary storage.
[2025-10-24T17:43:38.198107] [WARN ] [MAIN      ] BTX: No existing data found, performing full refresh instead.
[2025-10-24T17:43:38.198219] [INFO ] [MAIN      ] BTX: Wiping existing primary data before full refresh.
[2025-10-24T17:43:38.198261] [INFO ] [LOCAL     ] BTX: Starting deletion of primary data.
[2025-10-24T17:43:38.198302] [DEBUG] [LOCAL     ] BTX: No primary data file found to delete.
[2025-10-24T17:43:38.198333] [INFO ] [MAIN      ] BTX: Starting full primary refresh.
[2025-10-24T17:43:38.343569] [INFO ] [REMOTE    ] BTU: Incremental fetch complete for 2025-01 (2.20 seconds).
[2025-10-24T17:43:38.552887] [INFO ] [REMOTE    ] BTU: Fetching primary data for 2025-02.
[2025-10-24T17:43:38.614665] [INFO ] [REMOTE    ] BTX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:43:39.347629] [INFO ] [REMOTE    ] BTT: Fetching primary data for 2025-03.
[2025-10-24T17:43:39.405865] [INFO ] [REMOTE    ] BTI: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T17:43:39.981854] [INFO ] [REMOTE    ] BTT: Incremental fetch complete for 2025-03 (0.63 seconds).
[2025-10-24T17:43:40.147728] [INFO ] [REMOTE    ] BTI: Fetching primary data for 2025-07.
[2025-10-24T17:43:40.429237] [INFO ] [REMOTE    ] BTU: Incremental fetch complete for 2025-02 (1.88 seconds).
[2025-10-24T17:43:40.947670] [INFO ] [REMOTE    ] BTU: Fetching primary data for 2025-03.
[2025-10-24T17:43:41.747680] [INFO ] [REMOTE    ] BTX: Fetching primary data for 2025-01.
[2025-10-24T17:43:42.117733] [DEBUG] [REMOTE    ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:43:42.118010] [WARN ] [REMOTE    ] BTX: No data returned for month 2025-01
[2025-10-24T17:43:42.118096] [FATAL] [REMOTE    ] BTX: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:43:42.118178] [FATAL] [MAIN      ] BTX: Failed to fetch primary data.
[2025-10-24T17:43:42.118258] [WARN ] [MAIN      ] BTX: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:43:42.118341] [INFO ] [LOCAL     ] BTX: Starting deletion of primary data.
[2025-10-24T17:43:42.118417] [DEBUG] [LOCAL     ] BTX: No primary data file found to delete.
[2025-10-24T17:43:42.118470] [INFO ] [LOCAL     ] BTX: Starting deletion of derivative data.
[2025-10-24T17:43:42.118525] [DEBUG] [LOCAL     ] BTX: No derivative data file found to delete.
[2025-10-24T17:43:42.118587] [INFO ] [MAIN      ] Update Progress: 352/2366 symbols completed. BTX took 4.1s. Estimated remaining: 4h 9m 46s. Rate: 8.1 symbols/min
[2025-10-24T17:43:42.303982] [INFO ] [MAIN      ] BTZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:43:42.339838] [INFO ] [REMOTE    ] BTI: Incremental fetch complete for 2025-07 (2.19 seconds).
[2025-10-24T17:43:42.370571] [DEBUG] [LOCAL     ] BTZ: Loaded 22521 existing records from primary storage.
[2025-10-24T17:43:42.370897] [INFO ] [MAIN      ] BTZ: Loaded 22521 existing records.
[2025-10-24T17:43:42.560129] [WARN ] [MAIN      ] BTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:43:42.560494] [INFO ] [MAIN      ] BTZ: Wiping existing primary data before full refresh.
[2025-10-24T17:43:42.560569] [INFO ] [LOCAL     ] BTZ: Starting deletion of primary data.
[2025-10-24T17:43:42.554454] [INFO ] [REMOTE    ] BTT: Fetching primary data for 2025-04.
[2025-10-24T17:43:42.561412] [DEBUG] [LOCAL     ] BTZ: Deleted primary data file.
[2025-10-24T17:43:42.561723] [INFO ] [MAIN      ] BTZ: Starting full primary refresh.
[2025-10-24T17:43:42.955769] [INFO ] [REMOTE    ] BTZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:43:42.991774] [INFO ] [REMOTE    ] BTU: Incremental fetch complete for 2025-03 (2.04 seconds).
[2025-10-24T17:43:43.347707] [INFO ] [REMOTE    ] BTU: Fetching primary data for 2025-04.
[2025-10-24T17:43:43.816902] [INFO ] [REMOTE    ] BTT: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T17:43:44.147726] [INFO ] [REMOTE    ] BTT: Fetching primary data for 2025-05.
[2025-10-24T17:43:44.947706] [INFO ] [REMOTE    ] BTZ: Fetching primary data for 2025-01.
[2025-10-24T17:43:45.006162] [INFO ] [REMOTE    ] BTT: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T17:43:45.294242] [INFO ] [REMOTE    ] BTU: Incremental fetch complete for 2025-04 (1.95 seconds).
[2025-10-24T17:43:45.747764] [INFO ] [REMOTE    ] BTT: Fetching primary data for 2025-06.
[2025-10-24T17:43:45.794972] [INFO ] [REMOTE    ] BTZ: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T17:43:46.434782] [INFO ] [REMOTE    ] BTT: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T17:43:46.547728] [INFO ] [REMOTE    ] BTZ: Fetching primary data for 2025-02.
[2025-10-24T17:43:47.347689] [INFO ] [REMOTE    ] BTU: Fetching primary data for 2025-05.
[2025-10-24T17:43:47.730075] [INFO ] [REMOTE    ] BTZ: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T17:43:48.147762] [INFO ] [REMOTE    ] BTT: Fetching primary data for 2025-07.
[2025-10-24T17:43:48.886617] [INFO ] [REMOTE    ] BTT: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T17:43:48.947697] [INFO ] [REMOTE    ] BTT: Fetching primary data for 2025-08.
[2025-10-24T17:43:49.382279] [INFO ] [REMOTE    ] BTU: Incremental fetch complete for 2025-05 (2.03 seconds).
[2025-10-24T17:43:49.551186] [INFO ] [REMOTE    ] BTT: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T17:43:49.747681] [INFO ] [REMOTE    ] BTT: Fetching primary data for 2025-09.
[2025-10-24T17:43:50.547619] [INFO ] [REMOTE    ] BTI: Fetching primary data for 2025-08.
[2025-10-24T17:43:50.691922] [INFO ] [REMOTE    ] BTT: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T17:43:51.347700] [INFO ] [REMOTE    ] BTU: Fetching primary data for 2025-06.
[2025-10-24T17:43:52.147739] [INFO ] [REMOTE    ] BTZ: Fetching primary data for 2025-03.
[2025-10-24T17:43:52.584681] [INFO ] [REMOTE    ] BTI: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T17:43:52.947638] [INFO ] [REMOTE    ] BTI: Fetching primary data for 2025-09.
[2025-10-24T17:43:53.006140] [INFO ] [REMOTE    ] BTZ: Incremental fetch complete for 2025-03 (0.86 seconds).
[2025-10-24T17:43:53.093173] [INFO ] [REMOTE    ] BTU: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T17:43:53.747710] [INFO ] [REMOTE    ] BTZ: Fetching primary data for 2025-04.
[2025-10-24T17:43:54.547712] [INFO ] [REMOTE    ] BTU: Fetching primary data for 2025-07.
[2025-10-24T17:43:54.773148] [INFO ] [REMOTE    ] BTI: Incremental fetch complete for 2025-09 (1.83 seconds).
[2025-10-24T17:43:54.890682] [INFO ] [REMOTE    ] BTZ: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T17:43:55.347725] [INFO ] [REMOTE    ] BTI: Fetching primary data for 2025-10.
[2025-10-24T17:43:55.952401] [INFO ] [REMOTE    ] BTU: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T17:43:56.147707] [INFO ] [REMOTE    ] BTU: Fetching primary data for 2025-08.
[2025-10-24T17:43:56.947711] [INFO ] [REMOTE    ] BTZ: Fetching primary data for 2025-05.
[2025-10-24T17:43:57.106359] [INFO ] [REMOTE    ] BTI: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T17:43:57.116431] [INFO ] [REMOTE    ] BTI: Full fetch complete (77270 records).
[2025-10-24T17:43:57.116627] [DEBUG] [VALIDATOR ] BTI: Validating primary data.
[2025-10-24T17:43:57.117747] [FATAL] [VALIDATOR ] BTI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:43:57.117847] [FATAL] [MAIN      ] BTI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:43:57.117891] [WARN ] [MAIN      ] BTI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:43:57.117935] [INFO ] [LOCAL     ] BTI: Starting deletion of primary data.
[2025-10-24T17:43:57.118034] [DEBUG] [LOCAL     ] BTI: No primary data file found to delete.
[2025-10-24T17:43:57.118091] [INFO ] [LOCAL     ] BTI: Starting deletion of derivative data.
[2025-10-24T17:43:57.118434] [DEBUG] [LOCAL     ] BTI: Deleted derivative data file.
[2025-10-24T17:43:57.119542] [INFO ] [MAIN      ] Update Progress: 353/2366 symbols completed. BTI took 45.1s. Estimated remaining: 4h 10m 22s. Rate: 8.0 symbols/min
[2025-10-24T17:43:57.301237] [INFO ] [MAIN      ] BUD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:43:57.361416] [DEBUG] [LOCAL     ] BUD: Loaded 52986 existing records from primary storage.
[2025-10-24T17:43:57.361925] [INFO ] [MAIN      ] BUD: Loaded 52986 existing records.
[2025-10-24T17:43:57.541842] [WARN ] [MAIN      ] BUD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:43:57.542057] [INFO ] [MAIN      ] BUD: Wiping existing primary data before full refresh.
[2025-10-24T17:43:57.542105] [INFO ] [LOCAL     ] BUD: Starting deletion of primary data.
[2025-10-24T17:43:57.542344] [DEBUG] [LOCAL     ] BUD: Deleted primary data file.
[2025-10-24T17:43:57.542406] [INFO ] [MAIN      ] BUD: Starting full primary refresh.
[2025-10-24T17:43:57.752625] [INFO ] [REMOTE    ] BTT: Fetching primary data for 2025-10.
[2025-10-24T17:43:57.906095] [INFO ] [REMOTE    ] BUD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:43:57.922492] [INFO ] [REMOTE    ] BTZ: Incremental fetch complete for 2025-05 (0.97 seconds).
[2025-10-24T17:43:57.959384] [INFO ] [REMOTE    ] BTU: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T17:43:58.547726] [INFO ] [REMOTE    ] BTZ: Fetching primary data for 2025-06.
[2025-10-24T17:43:58.657759] [INFO ] [REMOTE    ] BTT: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T17:43:58.660665] [INFO ] [REMOTE    ] BTT: Full fetch complete (22568 records).
[2025-10-24T17:43:58.660775] [DEBUG] [VALIDATOR ] BTT: Validating primary data.
[2025-10-24T17:43:59.020725] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present.
[2025-10-24T17:43:59.020802] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed.
[2025-10-24T17:43:59.021173] [INFO ] [MAIN      ] BTT: Fetched primary data is valid.
[2025-10-24T17:43:59.021214] [DEBUG] [LOCAL     ] BTT: Saving primary data.
[2025-10-24T17:43:59.021464] [FATAL] [LOCAL     ] BTT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:43:59.021545] [FATAL] [MAIN      ] BTT: Failed to save primary data.
[2025-10-24T17:43:59.021586] [WARN ] [MAIN      ] BTT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:43:59.021619] [INFO ] [LOCAL     ] BTT: Starting deletion of primary data.
[2025-10-24T17:43:59.021725] [DEBUG] [LOCAL     ] BTT: No primary data file found to delete.
[2025-10-24T17:43:59.021785] [INFO ] [LOCAL     ] BTT: Starting deletion of derivative data.
[2025-10-24T17:43:59.021943] [DEBUG] [LOCAL     ] BTT: Deleted derivative data file.
[2025-10-24T17:43:59.022034] [INFO ] [MAIN      ] Update Progress: 354/2366 symbols completed. BTT took 27.0s. Estimated remaining: 4h 9m 43s. Rate: 8.1 symbols/min
[2025-10-24T17:43:59.188949] [INFO ] [MAIN      ] BUI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:43:59.202677] [DEBUG] [LOCAL     ] BUI: Loaded 11873 existing records from primary storage.
[2025-10-24T17:43:59.202903] [INFO ] [MAIN      ] BUI: Loaded 11873 existing records.
[2025-10-24T17:43:59.353407] [INFO ] [REMOTE    ] BUD: Fetching primary data for 2025-01.
[2025-10-24T17:43:59.382748] [WARN ] [MAIN      ] BUI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:43:59.382960] [INFO ] [MAIN      ] BUI: Wiping existing primary data before full refresh.
[2025-10-24T17:43:59.383050] [INFO ] [LOCAL     ] BUI: Starting deletion of primary data.
[2025-10-24T17:43:59.383269] [DEBUG] [LOCAL     ] BUI: Deleted primary data file.
[2025-10-24T17:43:59.383310] [INFO ] [MAIN      ] BUI: Starting full primary refresh.
[2025-10-24T17:43:59.680477] [INFO ] [REMOTE    ] BTZ: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T17:43:59.768901] [INFO ] [REMOTE    ] BUI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:44:00.147666] [INFO ] [REMOTE    ] BUI: Fetching primary data for 2025-01.
[2025-10-24T17:44:00.947670] [INFO ] [REMOTE    ] BTU: Fetching primary data for 2025-09.
[2025-10-24T17:44:01.579229] [INFO ] [REMOTE    ] BUI: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T17:44:01.747639] [INFO ] [REMOTE    ] BTZ: Fetching primary data for 2025-07.
[2025-10-24T17:44:02.393128] [INFO ] [REMOTE    ] BUD: Incremental fetch complete for 2025-01 (3.04 seconds).
[2025-10-24T17:44:02.547628] [INFO ] [REMOTE    ] BUI: Fetching primary data for 2025-02.
[2025-10-24T17:44:03.169785] [INFO ] [REMOTE    ] BTZ: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T17:44:03.319174] [INFO ] [REMOTE    ] BUI: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T17:44:03.347695] [INFO ] [REMOTE    ] BUI: Fetching primary data for 2025-03.
[2025-10-24T17:44:03.814633] [INFO ] [REMOTE    ] BTU: Incremental fetch complete for 2025-09 (2.87 seconds).
[2025-10-24T17:44:04.130909] [INFO ] [REMOTE    ] BUI: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T17:44:04.147601] [INFO ] [REMOTE    ] BUI: Fetching primary data for 2025-04.
[2025-10-24T17:44:04.947728] [INFO ] [REMOTE    ] BTU: Fetching primary data for 2025-10.
[2025-10-24T17:44:04.987904] [INFO ] [REMOTE    ] BUI: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T17:44:05.747673] [INFO ] [REMOTE    ] BUI: Fetching primary data for 2025-05.
[2025-10-24T17:44:06.547697] [INFO ] [REMOTE    ] BUD: Fetching primary data for 2025-02.
[2025-10-24T17:44:06.656222] [INFO ] [REMOTE    ] BUI: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T17:44:07.001059] [INFO ] [REMOTE    ] BTU: Incremental fetch complete for 2025-10 (2.05 seconds).
[2025-10-24T17:44:07.013584] [INFO ] [REMOTE    ] BTU: Full fetch complete (77303 records).
[2025-10-24T17:44:07.013773] [DEBUG] [VALIDATOR ] BTU: Validating primary data.
[2025-10-24T17:44:07.352718] [INFO ] [REMOTE    ] BTZ: Fetching primary data for 2025-08.
[2025-10-24T17:44:07.407516] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present.
[2025-10-24T17:44:07.407601] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed.
[2025-10-24T17:44:07.408439] [INFO ] [MAIN      ] BTU: Fetched primary data is valid.
[2025-10-24T17:44:07.408499] [DEBUG] [LOCAL     ] BTU: Saving primary data.
[2025-10-24T17:44:07.409122] [FATAL] [LOCAL     ] BTU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:44:07.409206] [FATAL] [MAIN      ] BTU: Failed to save primary data.
[2025-10-24T17:44:07.409268] [WARN ] [MAIN      ] BTU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:44:07.409336] [INFO ] [LOCAL     ] BTU: Starting deletion of primary data.
[2025-10-24T17:44:07.409393] [DEBUG] [LOCAL     ] BTU: No primary data file found to delete.
[2025-10-24T17:44:07.409428] [INFO ] [LOCAL     ] BTU: Starting deletion of derivative data.
[2025-10-24T17:44:07.409593] [DEBUG] [LOCAL     ] BTU: Deleted derivative data file.
[2025-10-24T17:44:07.410158] [INFO ] [MAIN      ] Update Progress: 355/2366 symbols completed. BTU took 32.4s. Estimated remaining: 4h 9m 41s. Rate: 8.1 symbols/min
[2025-10-24T17:44:07.576472] [INFO ] [MAIN      ] BUR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:44:07.618600] [DEBUG] [LOCAL     ] BUR: Loaded 45815 existing records from primary storage.
[2025-10-24T17:44:07.618914] [INFO ] [MAIN      ] BUR: Loaded 45815 existing records.
[2025-10-24T17:44:07.791522] [WARN ] [MAIN      ] BUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:44:07.791760] [INFO ] [MAIN      ] BUR: Wiping existing primary data before full refresh.
[2025-10-24T17:44:07.791810] [INFO ] [LOCAL     ] BUR: Starting deletion of primary data.
[2025-10-24T17:44:07.792173] [DEBUG] [LOCAL     ] BUR: Deleted primary data file.
[2025-10-24T17:44:07.792213] [INFO ] [MAIN      ] BUR: Starting full primary refresh.
[2025-10-24T17:44:08.147597] [INFO ] [REMOTE    ] BUR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:44:08.147705] [INFO ] [REMOTE    ] BUI: Fetching primary data for 2025-06.
[2025-10-24T17:44:08.178437] [INFO ] [REMOTE    ] BUD: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T17:44:08.204816] [INFO ] [REMOTE    ] BTZ: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T17:44:08.913115] [INFO ] [REMOTE    ] BUI: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T17:44:08.947723] [INFO ] [REMOTE    ] BTZ: Fetching primary data for 2025-09.
[2025-10-24T17:44:09.747692] [INFO ] [REMOTE    ] BUI: Fetching primary data for 2025-07.
[2025-10-24T17:44:10.043178] [INFO ] [REMOTE    ] BTZ: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T17:44:10.409918] [INFO ] [REMOTE    ] BUI: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T17:44:10.547612] [INFO ] [REMOTE    ] BUI: Fetching primary data for 2025-08.
[2025-10-24T17:44:11.190928] [INFO ] [REMOTE    ] BUI: Incremental fetch complete for 2025-08 (0.64 seconds).
[2025-10-24T17:44:11.347681] [INFO ] [REMOTE    ] BUI: Fetching primary data for 2025-09.
[2025-10-24T17:44:12.147684] [INFO ] [REMOTE    ] BUR: Fetching primary data for 2025-01.
[2025-10-24T17:44:12.537736] [INFO ] [REMOTE    ] BUI: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T17:44:12.947750] [INFO ] [REMOTE    ] BUI: Fetching primary data for 2025-10.
[2025-10-24T17:44:13.747750] [INFO ] [REMOTE    ] BTZ: Fetching primary data for 2025-10.
[2025-10-24T17:44:13.825218] [INFO ] [REMOTE    ] BUR: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T17:44:13.840746] [INFO ] [REMOTE    ] BUI: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T17:44:13.843361] [INFO ] [REMOTE    ] BUI: Full fetch complete (16498 records).
[2025-10-24T17:44:13.843431] [DEBUG] [VALIDATOR ] BUI: Validating primary data.
[2025-10-24T17:44:14.204933] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present.
[2025-10-24T17:44:14.205016] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed.
[2025-10-24T17:44:14.205345] [INFO ] [MAIN      ] BUI: Fetched primary data is valid.
[2025-10-24T17:44:14.205384] [DEBUG] [LOCAL     ] BUI: Saving primary data.
[2025-10-24T17:44:14.205627] [FATAL] [LOCAL     ] BUI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:44:14.205723] [FATAL] [MAIN      ] BUI: Failed to save primary data.
[2025-10-24T17:44:14.205764] [WARN ] [MAIN      ] BUI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:44:14.205798] [INFO ] [LOCAL     ] BUI: Starting deletion of primary data.
[2025-10-24T17:44:14.205845] [DEBUG] [LOCAL     ] BUI: No primary data file found to delete.
[2025-10-24T17:44:14.205879] [INFO ] [LOCAL     ] BUI: Starting deletion of derivative data.
[2025-10-24T17:44:14.206019] [DEBUG] [LOCAL     ] BUI: Deleted derivative data file.
[2025-10-24T17:44:14.206102] [INFO ] [MAIN      ] Update Progress: 356/2366 symbols completed. BUI took 15.2s. Estimated remaining: 4h 9m 29s. Rate: 8.1 symbols/min
[2025-10-24T17:44:14.372778] [INFO ] [MAIN      ] BURL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:44:14.413026] [DEBUG] [LOCAL     ] BURL: Loaded 45718 existing records from primary storage.
[2025-10-24T17:44:14.413306] [INFO ] [MAIN      ] BURL: Loaded 45718 existing records.
[2025-10-24T17:44:14.551424] [INFO ] [REMOTE    ] BUR: Fetching primary data for 2025-02.
[2025-10-24T17:44:14.591731] [WARN ] [MAIN      ] BURL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:44:14.592038] [INFO ] [MAIN      ] BURL: Wiping existing primary data before full refresh.
[2025-10-24T17:44:14.592178] [INFO ] [LOCAL     ] BURL: Starting deletion of primary data.
[2025-10-24T17:44:14.592578] [DEBUG] [LOCAL     ] BURL: Deleted primary data file.
[2025-10-24T17:44:14.592617] [INFO ] [MAIN      ] BURL: Starting full primary refresh.
[2025-10-24T17:44:14.771891] [INFO ] [REMOTE    ] BTZ: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T17:44:14.866699] [INFO ] [REMOTE    ] BTZ: Full fetch complete (33204 records).
[2025-10-24T17:44:14.889101] [DEBUG] [VALIDATOR ] BTZ: Validating primary data.
[2025-10-24T17:44:15.113037] [INFO ] [REMOTE    ] BURL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:44:15.362303] [INFO ] [REMOTE    ] BUD: Fetching primary data for 2025-03.
[2025-10-24T17:44:15.376988] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present.
[2025-10-24T17:44:15.377047] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed.
[2025-10-24T17:44:15.377611] [INFO ] [MAIN      ] BTZ: Fetched primary data is valid.
[2025-10-24T17:44:15.377816] [DEBUG] [LOCAL     ] BTZ: Saving primary data.
[2025-10-24T17:44:15.378345] [FATAL] [LOCAL     ] BTZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:44:15.378422] [FATAL] [MAIN      ] BTZ: Failed to save primary data.
[2025-10-24T17:44:15.378489] [WARN ] [MAIN      ] BTZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:44:15.378558] [INFO ] [LOCAL     ] BTZ: Starting deletion of primary data.
[2025-10-24T17:44:15.378620] [DEBUG] [LOCAL     ] BTZ: No primary data file found to delete.
[2025-10-24T17:44:15.378715] [INFO ] [LOCAL     ] BTZ: Starting deletion of derivative data.
[2025-10-24T17:44:15.378903] [DEBUG] [LOCAL     ] BTZ: Deleted derivative data file.
[2025-10-24T17:44:15.378996] [INFO ] [MAIN      ] Update Progress: 357/2366 symbols completed. BTZ took 33.3s. Estimated remaining: 4h 8m 47s. Rate: 8.1 symbols/min
[2025-10-24T17:44:15.995878] [INFO ] [REMOTE    ] BUR: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T17:44:16.147712] [INFO ] [REMOTE    ] BUR: Fetching primary data for 2025-03.
[2025-10-24T17:44:16.947710] [INFO ] [REMOTE    ] BURL: Fetching primary data for 2025-01.
[2025-10-24T17:44:17.385306] [INFO ] [REMOTE    ] BUD: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T17:44:17.747703] [INFO ] [REMOTE    ] BUD: Fetching primary data for 2025-04.
[2025-10-24T17:44:18.105164] [INFO ] [REMOTE    ] BUR: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T17:44:18.475315] [INFO ] [REMOTE    ] BURL: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T17:44:18.547684] [INFO ] [REMOTE    ] BUR: Fetching primary data for 2025-04.
[2025-10-24T17:44:19.347685] [INFO ] [REMOTE    ] BURL: Fetching primary data for 2025-02.
[2025-10-24T17:44:19.609120] [INFO ] [REMOTE    ] BUD: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T17:44:20.113185] [INFO ] [REMOTE    ] BUR: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T17:44:20.147688] [INFO ] [REMOTE    ] BUR: Fetching primary data for 2025-05.
[2025-10-24T17:44:20.509789] [INFO ] [REMOTE    ] BURL: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T17:44:20.947724] [INFO ] [REMOTE    ] BURL: Fetching primary data for 2025-03.
[2025-10-24T17:44:21.665022] [INFO ] [REMOTE    ] BUR: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T17:44:21.747727] [INFO ] [REMOTE    ] BUR: Fetching primary data for 2025-06.
[2025-10-24T17:44:22.559060] [INFO ] [REMOTE    ] BUD: Fetching primary data for 2025-05.
[2025-10-24T17:44:22.580292] [INFO ] [REMOTE    ] BURL: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T17:44:23.347639] [INFO ] [REMOTE    ] BURL: Fetching primary data for 2025-04.
[2025-10-24T17:44:23.700922] [INFO ] [REMOTE    ] BUR: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T17:44:24.147700] [INFO ] [REMOTE    ] BUR: Fetching primary data for 2025-07.
[2025-10-24T17:44:24.456601] [INFO ] [REMOTE    ] BUD: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T17:44:24.947730] [INFO ] [REMOTE    ] BUD: Fetching primary data for 2025-06.
[2025-10-24T17:44:25.511685] [INFO ] [REMOTE    ] BURL: Incremental fetch complete for 2025-04 (2.16 seconds).
[2025-10-24T17:44:25.747627] [INFO ] [REMOTE    ] BURL: Fetching primary data for 2025-05.
[2025-10-24T17:44:25.850285] [INFO ] [REMOTE    ] BUR: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T17:44:26.307407] [INFO ] [REMOTE    ] BUD: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T17:44:26.547737] [INFO ] [REMOTE    ] BUR: Fetching primary data for 2025-08.
[2025-10-24T17:44:27.347722] [INFO ] [REMOTE    ] BUD: Fetching primary data for 2025-07.
[2025-10-24T17:44:27.546191] [INFO ] [REMOTE    ] BURL: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T17:44:28.147705] [INFO ] [REMOTE    ] BURL: Fetching primary data for 2025-06.
[2025-10-24T17:44:28.354397] [INFO ] [REMOTE    ] BUR: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T17:44:28.947719] [INFO ] [REMOTE    ] BUR: Fetching primary data for 2025-09.
[2025-10-24T17:44:29.248530] [INFO ] [REMOTE    ] BUD: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T17:44:29.507031] [INFO ] [REMOTE    ] BURL: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T17:44:29.747710] [INFO ] [REMOTE    ] BUD: Fetching primary data for 2025-08.
[2025-10-24T17:44:30.358912] [INFO ] [REMOTE    ] BUR: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T17:44:30.547626] [INFO ] [REMOTE    ] BUR: Fetching primary data for 2025-10.
[2025-10-24T17:44:31.246409] [INFO ] [REMOTE    ] BUD: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T17:44:31.347709] [INFO ] [REMOTE    ] BUD: Fetching primary data for 2025-09.
[2025-10-24T17:44:32.147634] [INFO ] [REMOTE    ] BURL: Fetching primary data for 2025-07.
[2025-10-24T17:44:32.256147] [INFO ] [REMOTE    ] BUR: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T17:44:32.265092] [INFO ] [REMOTE    ] BUR: Full fetch complete (64673 records).
[2025-10-24T17:44:32.265222] [DEBUG] [VALIDATOR ] BUR: Validating primary data.
[2025-10-24T17:44:32.653567] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present.
[2025-10-24T17:44:32.653692] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed.
[2025-10-24T17:44:32.654528] [INFO ] [MAIN      ] BUR: Fetched primary data is valid.
[2025-10-24T17:44:32.654593] [DEBUG] [LOCAL     ] BUR: Saving primary data.
[2025-10-24T17:44:32.655279] [FATAL] [LOCAL     ] BUR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:44:32.655366] [FATAL] [MAIN      ] BUR: Failed to save primary data.
[2025-10-24T17:44:32.655414] [WARN ] [MAIN      ] BUR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:44:32.655496] [INFO ] [LOCAL     ] BUR: Starting deletion of primary data.
[2025-10-24T17:44:32.655568] [DEBUG] [LOCAL     ] BUR: No primary data file found to delete.
[2025-10-24T17:44:32.655618] [INFO ] [LOCAL     ] BUR: Starting deletion of derivative data.
[2025-10-24T17:44:32.655869] [DEBUG] [LOCAL     ] BUR: Deleted derivative data file.
[2025-10-24T17:44:32.656485] [INFO ] [MAIN      ] Update Progress: 358/2366 symbols completed. BUR took 25.2s. Estimated remaining: 4h 9m 35s. Rate: 8.0 symbols/min
[2025-10-24T17:44:33.185800] [INFO ] [REMOTE    ] BUD: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T17:44:33.196852] [INFO ] [REMOTE    ] BUD: Fetching primary data for 2025-10.
[2025-10-24T17:44:33.977449] [INFO ] [REMOTE    ] BURL: Incremental fetch complete for 2025-07 (1.83 seconds).
[2025-10-24T17:44:33.987304] [INFO ] [REMOTE    ] BURL: Fetching primary data for 2025-08.
[2025-10-24T17:44:35.307865] [INFO ] [REMOTE    ] BUD: Incremental fetch complete for 2025-10 (2.11 seconds).
[2025-10-24T17:44:35.317467] [INFO ] [REMOTE    ] BUD: Full fetch complete (76482 records).
[2025-10-24T17:44:35.317605] [DEBUG] [VALIDATOR ] BUD: Validating primary data.
[2025-10-24T17:44:35.521964] [INFO ] [REMOTE    ] BURL: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T17:44:35.600904] [INFO ] [REMOTE    ] BURL: Fetching primary data for 2025-09.
[2025-10-24T17:44:35.750614] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present.
[2025-10-24T17:44:35.750728] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed.
[2025-10-24T17:44:35.751540] [INFO ] [MAIN      ] BUD: Fetched primary data is valid.
[2025-10-24T17:44:35.751581] [DEBUG] [LOCAL     ] BUD: Saving primary data.
[2025-10-24T17:44:35.752185] [FATAL] [LOCAL     ] BUD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:44:35.752283] [FATAL] [MAIN      ] BUD: Failed to save primary data.
[2025-10-24T17:44:35.752325] [WARN ] [MAIN      ] BUD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:44:35.752398] [INFO ] [LOCAL     ] BUD: Starting deletion of primary data.
[2025-10-24T17:44:35.752461] [DEBUG] [LOCAL     ] BUD: No primary data file found to delete.
[2025-10-24T17:44:35.752497] [INFO ] [LOCAL     ] BUD: Starting deletion of derivative data.
[2025-10-24T17:44:35.752693] [DEBUG] [LOCAL     ] BUD: Deleted derivative data file.
[2025-10-24T17:44:35.752991] [INFO ] [MAIN      ] Update Progress: 359/2366 symbols completed. BUD took 38.6s. Estimated remaining: 4h 9m 3s. Rate: 8.1 symbols/min
[2025-10-24T17:44:37.220970] [INFO ] [REMOTE    ] BURL: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T17:44:37.232575] [INFO ] [REMOTE    ] BURL: Fetching primary data for 2025-10.
[2025-10-24T17:44:38.966423] [INFO ] [REMOTE    ] BURL: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T17:44:38.974269] [INFO ] [REMOTE    ] BURL: Full fetch complete (65732 records).
[2025-10-24T17:44:38.974378] [DEBUG] [VALIDATOR ] BURL: Validating primary data.
[2025-10-24T17:44:39.360155] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present.
[2025-10-24T17:44:39.360247] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed.
[2025-10-24T17:44:39.360997] [INFO ] [MAIN      ] BURL: Fetched primary data is valid.
[2025-10-24T17:44:39.361058] [DEBUG] [LOCAL     ] BURL: Saving primary data.
[2025-10-24T17:44:39.361548] [FATAL] [LOCAL     ] BURL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:44:39.361671] [FATAL] [MAIN      ] BURL: Failed to save primary data.
[2025-10-24T17:44:39.361738] [WARN ] [MAIN      ] BURL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:44:39.361787] [INFO ] [LOCAL     ] BURL: Starting deletion of primary data.
[2025-10-24T17:44:39.361873] [DEBUG] [LOCAL     ] BURL: No primary data file found to delete.
[2025-10-24T17:44:39.361933] [INFO ] [LOCAL     ] BURL: Starting deletion of derivative data.
[2025-10-24T17:44:39.362119] [DEBUG] [LOCAL     ] BURL: Deleted derivative data file.
[2025-10-24T17:44:39.362431] [INFO ] [MAIN      ] Update Progress: 360/2366 symbols completed. BURL took 25.2s. Estimated remaining: 4h 8m 34s. Rate: 8.1 symbols/min
[2025-10-24T17:44:39.865890] [INFO ] [MAIN      ] BUXX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:44:40.037691] [INFO ] [MAIN      ] BV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:44:40.046908] [INFO ] [MAIN      ] BVN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:44:40.073969] [INFO ] [MAIN      ] BW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:44:40.089592] [DEBUG] [LOCAL     ] BUXX: Loaded 15467 existing records from primary storage.
[2025-10-24T17:44:40.089919] [INFO ] [MAIN      ] BUXX: Loaded 15467 existing records.
[2025-10-24T17:44:40.321953] [DEBUG] [LOCAL     ] BV: Loaded 38734 existing records from primary storage.
[2025-10-24T17:44:40.320725] [DEBUG] [LOCAL     ] BVN: Loaded 44895 existing records from primary storage.
[2025-10-24T17:44:40.340962] [INFO ] [MAIN      ] BVN: Loaded 44895 existing records.
[2025-10-24T17:44:40.341150] [INFO ] [MAIN      ] BV: Loaded 38734 existing records.
[2025-10-24T17:44:40.355230] [WARN ] [MAIN      ] BUXX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:44:40.379563] [INFO ] [MAIN      ] BUXX: Wiping existing primary data before full refresh.
[2025-10-24T17:44:40.415077] [DEBUG] [LOCAL     ] BW: Loaded 40674 existing records from primary storage.
[2025-10-24T17:44:40.434083] [INFO ] [MAIN      ] BW: Loaded 40674 existing records.
[2025-10-24T17:44:40.446402] [INFO ] [LOCAL     ] BUXX: Starting deletion of primary data.
[2025-10-24T17:44:40.534726] [DEBUG] [LOCAL     ] BUXX: Deleted primary data file.
[2025-10-24T17:44:40.549525] [INFO ] [MAIN      ] BUXX: Starting full primary refresh.
[2025-10-24T17:44:40.957312] [WARN ] [MAIN      ] BV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:44:40.982947] [INFO ] [MAIN      ] BV: Wiping existing primary data before full refresh.
[2025-10-24T17:44:41.006592] [INFO ] [LOCAL     ] BV: Starting deletion of primary data.
[2025-10-24T17:44:41.045732] [DEBUG] [LOCAL     ] BV: Deleted primary data file.
[2025-10-24T17:44:41.097972] [WARN ] [MAIN      ] BVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:44:41.082351] [INFO ] [MAIN      ] BV: Starting full primary refresh.
[2025-10-24T17:44:41.125084] [INFO ] [MAIN      ] BVN: Wiping existing primary data before full refresh.
[2025-10-24T17:44:41.185681] [WARN ] [MAIN      ] BW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:44:41.191033] [INFO ] [LOCAL     ] BVN: Starting deletion of primary data.
[2025-10-24T17:44:41.216984] [INFO ] [MAIN      ] BW: Wiping existing primary data before full refresh.
[2025-10-24T17:44:41.217055] [DEBUG] [LOCAL     ] BVN: Deleted primary data file.
[2025-10-24T17:44:41.242897] [INFO ] [MAIN      ] BVN: Starting full primary refresh.
[2025-10-24T17:44:41.237613] [INFO ] [LOCAL     ] BW: Starting deletion of primary data.
[2025-10-24T17:44:41.316098] [DEBUG] [LOCAL     ] BW: Deleted primary data file.
[2025-10-24T17:44:41.376627] [INFO ] [MAIN      ] BW: Starting full primary refresh.
[2025-10-24T17:44:41.490392] [INFO ] [REMOTE    ] BUXX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:44:41.533865] [INFO ] [REMOTE    ] BUXX: Fetching primary data for 2025-01.
[2025-10-24T17:44:42.441811] [INFO ] [REMOTE    ] BV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:44:42.449954] [INFO ] [REMOTE    ] BV: Fetching primary data for 2025-01.
[2025-10-24T17:44:42.449282] [INFO ] [REMOTE    ] BVN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:44:42.472078] [INFO ] [REMOTE    ] BVN: Fetching primary data for 2025-01.
[2025-10-24T17:44:42.539635] [INFO ] [REMOTE    ] BW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:44:42.540671] [INFO ] [REMOTE    ] BW: Fetching primary data for 2025-01.
[2025-10-24T17:44:42.543549] [INFO ] [REMOTE    ] BUXX: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T17:44:42.547407] [INFO ] [REMOTE    ] BUXX: Fetching primary data for 2025-02.
[2025-10-24T17:44:43.322880] [INFO ] [REMOTE    ] BUXX: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T17:44:43.325699] [INFO ] [REMOTE    ] BUXX: Fetching primary data for 2025-03.
[2025-10-24T17:44:43.690286] [INFO ] [REMOTE    ] BVN: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T17:44:43.698337] [INFO ] [REMOTE    ] BVN: Fetching primary data for 2025-02.
[2025-10-24T17:44:43.786527] [INFO ] [REMOTE    ] BUXX: Incremental fetch complete for 2025-03 (0.46 seconds).
[2025-10-24T17:44:43.789834] [INFO ] [REMOTE    ] BUXX: Fetching primary data for 2025-04.
[2025-10-24T17:44:43.814326] [INFO ] [REMOTE    ] BV: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T17:44:43.820482] [INFO ] [REMOTE    ] BV: Fetching primary data for 2025-02.
[2025-10-24T17:44:44.474189] [INFO ] [REMOTE    ] BW: Incremental fetch complete for 2025-01 (1.93 seconds).
[2025-10-24T17:44:44.482714] [INFO ] [REMOTE    ] BW: Fetching primary data for 2025-02.
[2025-10-24T17:44:44.766677] [INFO ] [REMOTE    ] BVN: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T17:44:44.775237] [INFO ] [REMOTE    ] BVN: Fetching primary data for 2025-03.
[2025-10-24T17:44:44.819105] [INFO ] [REMOTE    ] BUXX: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T17:44:44.947753] [INFO ] [REMOTE    ] BUXX: Fetching primary data for 2025-05.
[2025-10-24T17:44:45.291093] [INFO ] [REMOTE    ] BV: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T17:44:45.523426] [INFO ] [REMOTE    ] BW: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T17:44:45.747635] [INFO ] [REMOTE    ] BW: Fetching primary data for 2025-03.
[2025-10-24T17:44:45.847628] [INFO ] [REMOTE    ] BUXX: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T17:44:45.893769] [INFO ] [REMOTE    ] BVN: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T17:44:46.547728] [INFO ] [REMOTE    ] BUXX: Fetching primary data for 2025-06.
[2025-10-24T17:44:47.290251] [INFO ] [REMOTE    ] BW: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T17:44:47.339368] [INFO ] [REMOTE    ] BUXX: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T17:44:47.347596] [INFO ] [REMOTE    ] BUXX: Fetching primary data for 2025-07.
[2025-10-24T17:44:48.147689] [INFO ] [REMOTE    ] BW: Fetching primary data for 2025-04.
[2025-10-24T17:44:48.266123] [INFO ] [REMOTE    ] BUXX: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T17:44:48.947749] [INFO ] [REMOTE    ] BUXX: Fetching primary data for 2025-08.
[2025-10-24T17:44:49.640014] [INFO ] [REMOTE    ] BW: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T17:44:49.667520] [INFO ] [REMOTE    ] BUXX: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T17:44:49.747692] [INFO ] [REMOTE    ] BUXX: Fetching primary data for 2025-09.
[2025-10-24T17:44:50.547630] [INFO ] [REMOTE    ] BVN: Fetching primary data for 2025-04.
[2025-10-24T17:44:50.599568] [INFO ] [REMOTE    ] BUXX: Incremental fetch complete for 2025-09 (0.85 seconds).
[2025-10-24T17:44:51.347622] [INFO ] [REMOTE    ] BW: Fetching primary data for 2025-05.
[2025-10-24T17:44:52.003870] [INFO ] [REMOTE    ] BVN: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T17:44:52.147629] [INFO ] [REMOTE    ] BVN: Fetching primary data for 2025-05.
[2025-10-24T17:44:52.624265] [INFO ] [REMOTE    ] BW: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T17:44:52.947702] [INFO ] [REMOTE    ] BV: Fetching primary data for 2025-03.
[2025-10-24T17:44:53.566273] [INFO ] [REMOTE    ] BVN: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T17:44:53.747721] [INFO ] [REMOTE    ] BUXX: Fetching primary data for 2025-10.
[2025-10-24T17:44:54.531676] [INFO ] [REMOTE    ] BV: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T17:44:54.547605] [INFO ] [REMOTE    ] BW: Fetching primary data for 2025-06.
[2025-10-24T17:44:54.759551] [INFO ] [REMOTE    ] BUXX: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T17:44:54.762539] [INFO ] [REMOTE    ] BUXX: Full fetch complete (20780 records).
[2025-10-24T17:44:54.762614] [DEBUG] [VALIDATOR ] BUXX: Validating primary data.
[2025-10-24T17:44:55.119790] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present.
[2025-10-24T17:44:55.119871] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed.
[2025-10-24T17:44:55.120252] [INFO ] [MAIN      ] BUXX: Fetched primary data is valid.
[2025-10-24T17:44:55.120313] [DEBUG] [LOCAL     ] BUXX: Saving primary data.
[2025-10-24T17:44:55.120563] [FATAL] [LOCAL     ] BUXX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:44:55.120664] [FATAL] [MAIN      ] BUXX: Failed to save primary data.
[2025-10-24T17:44:55.120723] [WARN ] [MAIN      ] BUXX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:44:55.120763] [INFO ] [LOCAL     ] BUXX: Starting deletion of primary data.
[2025-10-24T17:44:55.120812] [DEBUG] [LOCAL     ] BUXX: No primary data file found to delete.
[2025-10-24T17:44:55.120847] [INFO ] [LOCAL     ] BUXX: Starting deletion of derivative data.
[2025-10-24T17:44:55.121044] [DEBUG] [LOCAL     ] BUXX: Deleted derivative data file.
[2025-10-24T17:44:55.121144] [INFO ] [MAIN      ] Update Progress: 361/2366 symbols completed. BUXX took 15.8s. Estimated remaining: 4h 9m 13s. Rate: 8.0 symbols/min
[2025-10-24T17:44:55.287560] [INFO ] [MAIN      ] BWA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:44:55.336360] [DEBUG] [LOCAL     ] BWA: Loaded 52452 existing records from primary storage.
[2025-10-24T17:44:55.336703] [INFO ] [MAIN      ] BWA: Loaded 52452 existing records.
[2025-10-24T17:44:55.357433] [INFO ] [REMOTE    ] BVN: Fetching primary data for 2025-06.
[2025-10-24T17:44:55.516584] [WARN ] [MAIN      ] BWA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:44:55.516808] [INFO ] [MAIN      ] BWA: Wiping existing primary data before full refresh.
[2025-10-24T17:44:55.516855] [INFO ] [LOCAL     ] BWA: Starting deletion of primary data.
[2025-10-24T17:44:55.517401] [DEBUG] [LOCAL     ] BWA: Deleted primary data file.
[2025-10-24T17:44:55.517458] [INFO ] [MAIN      ] BWA: Starting full primary refresh.
[2025-10-24T17:44:55.870158] [INFO ] [REMOTE    ] BWA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:44:56.058096] [INFO ] [REMOTE    ] BW: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T17:44:56.147668] [INFO ] [REMOTE    ] BW: Fetching primary data for 2025-07.
[2025-10-24T17:44:56.952770] [INFO ] [REMOTE    ] BWA: Fetching primary data for 2025-01.
[2025-10-24T17:44:56.966447] [INFO ] [REMOTE    ] BVN: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T17:44:57.527851] [INFO ] [REMOTE    ] BW: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T17:44:57.747731] [INFO ] [REMOTE    ] BV: Fetching primary data for 2025-04.
[2025-10-24T17:44:58.547628] [INFO ] [REMOTE    ] BW: Fetching primary data for 2025-08.
[2025-10-24T17:44:58.580202] [INFO ] [REMOTE    ] BWA: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T17:44:59.231781] [INFO ] [REMOTE    ] BV: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T17:44:59.347688] [INFO ] [REMOTE    ] BWA: Fetching primary data for 2025-02.
[2025-10-24T17:44:59.998040] [INFO ] [REMOTE    ] BW: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T17:45:00.147633] [INFO ] [REMOTE    ] BW: Fetching primary data for 2025-09.
[2025-10-24T17:45:00.947705] [INFO ] [REMOTE    ] BV: Fetching primary data for 2025-05.
[2025-10-24T17:45:01.159668] [INFO ] [REMOTE    ] BWA: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T17:45:01.747683] [INFO ] [REMOTE    ] BVN: Fetching primary data for 2025-07.
[2025-10-24T17:45:02.023436] [INFO ] [REMOTE    ] BW: Incremental fetch complete for 2025-09 (1.88 seconds).
[2025-10-24T17:45:02.547618] [INFO ] [REMOTE    ] BW: Fetching primary data for 2025-10.
[2025-10-24T17:45:03.109033] [INFO ] [REMOTE    ] BV: Incremental fetch complete for 2025-05 (2.16 seconds).
[2025-10-24T17:45:03.347616] [INFO ] [REMOTE    ] BV: Fetching primary data for 2025-06.
[2025-10-24T17:45:03.978412] [INFO ] [REMOTE    ] BVN: Incremental fetch complete for 2025-07 (2.23 seconds).
[2025-10-24T17:45:04.147740] [INFO ] [REMOTE    ] BWA: Fetching primary data for 2025-03.
[2025-10-24T17:45:04.914587] [INFO ] [REMOTE    ] BW: Incremental fetch complete for 2025-10 (2.37 seconds).
[2025-10-24T17:45:04.923802] [INFO ] [REMOTE    ] BW: Full fetch complete (59310 records).
[2025-10-24T17:45:04.923940] [DEBUG] [VALIDATOR ] BW: Validating primary data.
[2025-10-24T17:45:04.957497] [INFO ] [REMOTE    ] BVN: Fetching primary data for 2025-08.
[2025-10-24T17:45:05.346570] [DEBUG] [VALIDATOR ] BW: All expected trading days are present.
[2025-10-24T17:45:05.346683] [DEBUG] [VALIDATOR ] BW: Primary data validation passed.
[2025-10-24T17:45:05.347633] [INFO ] [MAIN      ] BW: Fetched primary data is valid.
[2025-10-24T17:45:05.347732] [DEBUG] [LOCAL     ] BW: Saving primary data.
[2025-10-24T17:45:05.348293] [FATAL] [LOCAL     ] BW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:45:05.348383] [FATAL] [MAIN      ] BW: Failed to save primary data.
[2025-10-24T17:45:05.348425] [WARN ] [MAIN      ] BW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:45:05.348460] [INFO ] [LOCAL     ] BW: Starting deletion of primary data.
[2025-10-24T17:45:05.348533] [DEBUG] [LOCAL     ] BW: No primary data file found to delete.
[2025-10-24T17:45:05.348614] [INFO ] [LOCAL     ] BW: Starting deletion of derivative data.
[2025-10-24T17:45:05.348908] [DEBUG] [LOCAL     ] BW: Deleted derivative data file.
[2025-10-24T17:45:05.349412] [INFO ] [MAIN      ] Update Progress: 362/2366 symbols completed. BW took 26.0s. Estimated remaining: 4h 9m 21s. Rate: 8.0 symbols/min
[2025-10-24T17:45:05.525160] [INFO ] [MAIN      ] BWG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:45:05.545514] [INFO ] [REMOTE    ] BV: Incremental fetch complete for 2025-06 (2.20 seconds).
[2025-10-24T17:45:05.564097] [DEBUG] [LOCAL     ] BWG: Loaded 12676 existing records from primary storage.
[2025-10-24T17:45:05.564331] [INFO ] [MAIN      ] BWG: Loaded 12676 existing records.
[2025-10-24T17:45:05.744901] [WARN ] [MAIN      ] BWG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:45:05.745176] [INFO ] [MAIN      ] BWG: Wiping existing primary data before full refresh.
[2025-10-24T17:45:05.745263] [INFO ] [LOCAL     ] BWG: Starting deletion of primary data.
[2025-10-24T17:45:05.745552] [DEBUG] [LOCAL     ] BWG: Deleted primary data file.
[2025-10-24T17:45:05.745610] [INFO ] [MAIN      ] BWG: Starting full primary refresh.
[2025-10-24T17:45:05.777132] [INFO ] [REMOTE    ] BV: Fetching primary data for 2025-07.
[2025-10-24T17:45:06.109639] [INFO ] [REMOTE    ] BWG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:45:06.466840] [INFO ] [REMOTE    ] BVN: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T17:45:06.547610] [INFO ] [REMOTE    ] BVN: Fetching primary data for 2025-09.
[2025-10-24T17:45:07.239910] [INFO ] [REMOTE    ] BV: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T17:45:07.241477] [INFO ] [REMOTE    ] BWA: Incremental fetch complete for 2025-03 (3.09 seconds).
[2025-10-24T17:45:07.347700] [INFO ] [REMOTE    ] BWA: Fetching primary data for 2025-04.
[2025-10-24T17:45:08.147715] [INFO ] [REMOTE    ] BWG: Fetching primary data for 2025-01.
[2025-10-24T17:45:08.477627] [INFO ] [REMOTE    ] BVN: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T17:45:08.947633] [INFO ] [REMOTE    ] BV: Fetching primary data for 2025-08.
[2025-10-24T17:45:08.987474] [INFO ] [REMOTE    ] BWG: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T17:45:09.302504] [INFO ] [REMOTE    ] BWA: Incremental fetch complete for 2025-04 (1.95 seconds).
[2025-10-24T17:45:09.747739] [INFO ] [REMOTE    ] BVN: Fetching primary data for 2025-10.
[2025-10-24T17:45:10.343343] [INFO ] [REMOTE    ] BV: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T17:45:10.547703] [INFO ] [REMOTE    ] BV: Fetching primary data for 2025-09.
[2025-10-24T17:45:11.347624] [INFO ] [REMOTE    ] BWA: Fetching primary data for 2025-05.
[2025-10-24T17:45:11.936440] [INFO ] [REMOTE    ] BV: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T17:45:11.968827] [INFO ] [REMOTE    ] BVN: Incremental fetch complete for 2025-10 (2.22 seconds).
[2025-10-24T17:45:11.978225] [INFO ] [REMOTE    ] BVN: Full fetch complete (63614 records).
[2025-10-24T17:45:11.978362] [DEBUG] [VALIDATOR ] BVN: Validating primary data.
[2025-10-24T17:45:12.161570] [INFO ] [REMOTE    ] BV: Fetching primary data for 2025-10.
[2025-10-24T17:45:12.371184] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present.
[2025-10-24T17:45:12.371265] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed.
[2025-10-24T17:45:12.372019] [INFO ] [MAIN      ] BVN: Fetched primary data is valid.
[2025-10-24T17:45:12.372082] [DEBUG] [LOCAL     ] BVN: Saving primary data.
[2025-10-24T17:45:12.372608] [FATAL] [LOCAL     ] BVN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:45:12.372721] [FATAL] [MAIN      ] BVN: Failed to save primary data.
[2025-10-24T17:45:12.372787] [WARN ] [MAIN      ] BVN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:45:12.372856] [INFO ] [LOCAL     ] BVN: Starting deletion of primary data.
[2025-10-24T17:45:12.372917] [DEBUG] [LOCAL     ] BVN: No primary data file found to delete.
[2025-10-24T17:45:12.372952] [INFO ] [LOCAL     ] BVN: Starting deletion of derivative data.
[2025-10-24T17:45:12.373141] [DEBUG] [LOCAL     ] BVN: Deleted derivative data file.
[2025-10-24T17:45:12.373694] [INFO ] [MAIN      ] Update Progress: 363/2366 symbols completed. BVN took 33.0s. Estimated remaining: 4h 9m 11s. Rate: 8.0 symbols/min
[2025-10-24T17:45:12.540808] [INFO ] [MAIN      ] BWLP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:45:12.573818] [DEBUG] [LOCAL     ] BWLP: Loaded 32265 existing records from primary storage.
[2025-10-24T17:45:12.574097] [INFO ] [MAIN      ] BWLP: Loaded 32265 existing records.
[2025-10-24T17:45:12.763687] [WARN ] [MAIN      ] BWLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:45:12.763986] [INFO ] [MAIN      ] BWLP: Wiping existing primary data before full refresh.
[2025-10-24T17:45:12.764134] [INFO ] [LOCAL     ] BWLP: Starting deletion of primary data.
[2025-10-24T17:45:12.764409] [DEBUG] [LOCAL     ] BWLP: Deleted primary data file.
[2025-10-24T17:45:12.764448] [INFO ] [MAIN      ] BWLP: Starting full primary refresh.
[2025-10-24T17:45:12.953350] [INFO ] [REMOTE    ] BWG: Fetching primary data for 2025-02.
[2025-10-24T17:45:13.121524] [INFO ] [REMOTE    ] BWLP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:45:13.355858] [INFO ] [REMOTE    ] BWA: Incremental fetch complete for 2025-05 (2.01 seconds).
[2025-10-24T17:45:13.747670] [INFO ] [REMOTE    ] BWA: Fetching primary data for 2025-06.
[2025-10-24T17:45:13.818003] [INFO ] [REMOTE    ] BWG: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T17:45:13.849039] [INFO ] [REMOTE    ] BV: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T17:45:13.856352] [INFO ] [REMOTE    ] BV: Full fetch complete (55106 records).
[2025-10-24T17:45:13.856463] [DEBUG] [VALIDATOR ] BV: Validating primary data.
[2025-10-24T17:45:14.272463] [DEBUG] [VALIDATOR ] BV: All expected trading days are present.
[2025-10-24T17:45:14.272545] [DEBUG] [VALIDATOR ] BV: Primary data validation passed.
[2025-10-24T17:45:14.273220] [INFO ] [MAIN      ] BV: Fetched primary data is valid.
[2025-10-24T17:45:14.273285] [DEBUG] [LOCAL     ] BV: Saving primary data.
[2025-10-24T17:45:14.273783] [FATAL] [LOCAL     ] BV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:45:14.273871] [FATAL] [MAIN      ] BV: Failed to save primary data.
[2025-10-24T17:45:14.273912] [WARN ] [MAIN      ] BV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:45:14.273944] [INFO ] [LOCAL     ] BV: Starting deletion of primary data.
[2025-10-24T17:45:14.273996] [DEBUG] [LOCAL     ] BV: No primary data file found to delete.
[2025-10-24T17:45:14.274030] [INFO ] [LOCAL     ] BV: Starting deletion of derivative data.
[2025-10-24T17:45:14.274192] [DEBUG] [LOCAL     ] BV: Deleted derivative data file.
[2025-10-24T17:45:14.274269] [INFO ] [MAIN      ] Update Progress: 364/2366 symbols completed. BV took 34.9s. Estimated remaining: 4h 8m 33s. Rate: 8.1 symbols/min
[2025-10-24T17:45:14.439359] [INFO ] [MAIN      ] BWMX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:45:14.449267] [DEBUG] [LOCAL     ] BWMX: Loaded 7900 existing records from primary storage.
[2025-10-24T17:45:14.449502] [INFO ] [MAIN      ] BWMX: Loaded 7900 existing records.
[2025-10-24T17:45:14.547718] [INFO ] [REMOTE    ] BWG: Fetching primary data for 2025-03.
[2025-10-24T17:45:14.625927] [WARN ] [MAIN      ] BWMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:45:14.626132] [INFO ] [MAIN      ] BWMX: Wiping existing primary data before full refresh.
[2025-10-24T17:45:14.626178] [INFO ] [LOCAL     ] BWMX: Starting deletion of primary data.
[2025-10-24T17:45:14.626338] [DEBUG] [LOCAL     ] BWMX: Deleted primary data file.
[2025-10-24T17:45:14.626376] [INFO ] [MAIN      ] BWMX: Starting full primary refresh.
[2025-10-24T17:45:15.023537] [INFO ] [REMOTE    ] BWMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:45:15.195291] [INFO ] [REMOTE    ] BWA: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T17:45:15.347635] [INFO ] [REMOTE    ] BWA: Fetching primary data for 2025-07.
[2025-10-24T17:45:15.358570] [INFO ] [REMOTE    ] BWG: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T17:45:16.147680] [INFO ] [REMOTE    ] BWG: Fetching primary data for 2025-04.
[2025-10-24T17:45:16.793486] [INFO ] [REMOTE    ] BWG: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T17:45:16.947615] [INFO ] [REMOTE    ] BWLP: Fetching primary data for 2025-01.
[2025-10-24T17:45:17.090161] [INFO ] [REMOTE    ] BWA: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T17:45:17.747731] [INFO ] [REMOTE    ] BWA: Fetching primary data for 2025-08.
[2025-10-24T17:45:18.255041] [INFO ] [REMOTE    ] BWLP: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T17:45:18.547743] [INFO ] [REMOTE    ] BWLP: Fetching primary data for 2025-02.
[2025-10-24T17:45:19.347621] [INFO ] [REMOTE    ] BWMX: Fetching primary data for 2025-01.
[2025-10-24T17:45:19.597683] [INFO ] [REMOTE    ] BWA: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T17:45:19.694517] [INFO ] [REMOTE    ] BWLP: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T17:45:20.037771] [INFO ] [REMOTE    ] BWMX: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T17:45:20.147698] [INFO ] [REMOTE    ] BWMX: Fetching primary data for 2025-02.
[2025-10-24T17:45:20.719603] [INFO ] [REMOTE    ] BWMX: Incremental fetch complete for 2025-02 (0.57 seconds).
[2025-10-24T17:45:20.947680] [INFO ] [REMOTE    ] BWMX: Fetching primary data for 2025-03.
[2025-10-24T17:45:21.549405] [INFO ] [REMOTE    ] BWMX: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T17:45:21.747678] [INFO ] [REMOTE    ] BWA: Fetching primary data for 2025-09.
[2025-10-24T17:45:22.547639] [INFO ] [REMOTE    ] BWG: Fetching primary data for 2025-05.
[2025-10-24T17:45:23.347711] [INFO ] [REMOTE    ] BWLP: Fetching primary data for 2025-03.
[2025-10-24T17:45:23.498977] [INFO ] [REMOTE    ] BWA: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T17:45:23.529548] [INFO ] [REMOTE    ] BWG: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T17:45:24.147701] [INFO ] [REMOTE    ] BWMX: Fetching primary data for 2025-04.
[2025-10-24T17:45:24.799548] [INFO ] [REMOTE    ] BWMX: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T17:45:24.856826] [INFO ] [REMOTE    ] BWLP: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T17:45:24.947617] [INFO ] [REMOTE    ] BWLP: Fetching primary data for 2025-04.
[2025-10-24T17:45:25.747718] [INFO ] [REMOTE    ] BWG: Fetching primary data for 2025-06.
[2025-10-24T17:45:26.249012] [INFO ] [REMOTE    ] BWLP: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T17:45:26.317869] [INFO ] [REMOTE    ] BWG: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T17:45:26.547727] [INFO ] [REMOTE    ] BWG: Fetching primary data for 2025-07.
[2025-10-24T17:45:27.227833] [INFO ] [REMOTE    ] BWG: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T17:45:27.347686] [INFO ] [REMOTE    ] BWMX: Fetching primary data for 2025-05.
[2025-10-24T17:45:28.147627] [INFO ] [REMOTE    ] BWA: Fetching primary data for 2025-10.
[2025-10-24T17:45:28.170871] [INFO ] [REMOTE    ] BWMX: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T17:45:28.947717] [INFO ] [REMOTE    ] BWG: Fetching primary data for 2025-08.
[2025-10-24T17:45:29.747612] [INFO ] [REMOTE    ] BWLP: Fetching primary data for 2025-05.
[2025-10-24T17:45:29.870686] [INFO ] [REMOTE    ] BWG: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T17:45:30.086371] [INFO ] [REMOTE    ] BWA: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T17:45:30.095982] [INFO ] [REMOTE    ] BWA: Full fetch complete (75881 records).
[2025-10-24T17:45:30.096112] [DEBUG] [VALIDATOR ] BWA: Validating primary data.
[2025-10-24T17:45:30.484373] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present.
[2025-10-24T17:45:30.484462] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed.
[2025-10-24T17:45:30.485295] [INFO ] [MAIN      ] BWA: Fetched primary data is valid.
[2025-10-24T17:45:30.485361] [DEBUG] [LOCAL     ] BWA: Saving primary data.
[2025-10-24T17:45:30.486035] [FATAL] [LOCAL     ] BWA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:45:30.486177] [FATAL] [MAIN      ] BWA: Failed to save primary data.
[2025-10-24T17:45:30.486242] [WARN ] [MAIN      ] BWA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:45:30.486310] [INFO ] [LOCAL     ] BWA: Starting deletion of primary data.
[2025-10-24T17:45:30.486385] [DEBUG] [LOCAL     ] BWA: No primary data file found to delete.
[2025-10-24T17:45:30.486441] [INFO ] [LOCAL     ] BWA: Starting deletion of derivative data.
[2025-10-24T17:45:30.486577] [DEBUG] [LOCAL     ] BWA: Deleted derivative data file.
[2025-10-24T17:45:30.486949] [INFO ] [MAIN      ] Update Progress: 365/2366 symbols completed. BWA took 35.4s. Estimated remaining: 4h 9m 13s. Rate: 8.0 symbols/min
[2025-10-24T17:45:30.552750] [INFO ] [REMOTE    ] BWG: Fetching primary data for 2025-09.
[2025-10-24T17:45:30.659143] [INFO ] [MAIN      ] BWNB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:45:30.665560] [DEBUG] [LOCAL     ] BWNB: Loaded 4067 existing records from primary storage.
[2025-10-24T17:45:30.665809] [INFO ] [MAIN      ] BWNB: Loaded 4067 existing records.
[2025-10-24T17:45:30.845100] [WARN ] [MAIN      ] BWNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:45:30.845301] [INFO ] [MAIN      ] BWNB: Wiping existing primary data before full refresh.
[2025-10-24T17:45:30.845348] [INFO ] [LOCAL     ] BWNB: Starting deletion of primary data.
[2025-10-24T17:45:30.845513] [DEBUG] [LOCAL     ] BWNB: Deleted primary data file.
[2025-10-24T17:45:30.845570] [INFO ] [MAIN      ] BWNB: Starting full primary refresh.
[2025-10-24T17:45:31.250172] [INFO ] [REMOTE    ] BWNB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:45:31.299057] [INFO ] [REMOTE    ] BWLP: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T17:45:31.347616] [INFO ] [REMOTE    ] BWLP: Fetching primary data for 2025-06.
[2025-10-24T17:45:31.501110] [INFO ] [REMOTE    ] BWG: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T17:45:32.147721] [INFO ] [REMOTE    ] BWNB: Fetching primary data for 2025-01.
[2025-10-24T17:45:32.718959] [INFO ] [REMOTE    ] BWNB: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T17:45:32.830062] [INFO ] [REMOTE    ] BWLP: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T17:45:32.947707] [INFO ] [REMOTE    ] BWLP: Fetching primary data for 2025-07.
[2025-10-24T17:45:33.747705] [INFO ] [REMOTE    ] BWG: Fetching primary data for 2025-10.
[2025-10-24T17:45:34.325851] [INFO ] [REMOTE    ] BWLP: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T17:45:34.511379] [INFO ] [REMOTE    ] BWG: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T17:45:34.513490] [INFO ] [REMOTE    ] BWG: Full fetch complete (17591 records).
[2025-10-24T17:45:34.513571] [DEBUG] [VALIDATOR ] BWG: Validating primary data.
[2025-10-24T17:45:34.552877] [INFO ] [REMOTE    ] BWLP: Fetching primary data for 2025-08.
[2025-10-24T17:45:34.881224] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present.
[2025-10-24T17:45:34.881298] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed.
[2025-10-24T17:45:34.881662] [INFO ] [MAIN      ] BWG: Fetched primary data is valid.
[2025-10-24T17:45:34.881723] [DEBUG] [LOCAL     ] BWG: Saving primary data.
[2025-10-24T17:45:34.881979] [FATAL] [LOCAL     ] BWG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:45:34.882064] [FATAL] [MAIN      ] BWG: Failed to save primary data.
[2025-10-24T17:45:34.882105] [WARN ] [MAIN      ] BWG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:45:34.882139] [INFO ] [LOCAL     ] BWG: Starting deletion of primary data.
[2025-10-24T17:45:34.882191] [DEBUG] [LOCAL     ] BWG: No primary data file found to delete.
[2025-10-24T17:45:34.882254] [INFO ] [LOCAL     ] BWG: Starting deletion of derivative data.
[2025-10-24T17:45:34.882454] [DEBUG] [LOCAL     ] BWG: Deleted derivative data file.
[2025-10-24T17:45:34.882554] [INFO ] [MAIN      ] Update Progress: 366/2366 symbols completed. BWG took 29.5s. Estimated remaining: 4h 8m 49s. Rate: 8.0 symbols/min
[2025-10-24T17:45:35.057952] [INFO ] [MAIN      ] BWSN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:45:35.067385] [DEBUG] [LOCAL     ] BWSN: Loaded 5082 existing records from primary storage.
[2025-10-24T17:45:35.067664] [INFO ] [MAIN      ] BWSN: Loaded 5082 existing records.
[2025-10-24T17:45:35.243835] [WARN ] [MAIN      ] BWSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:45:35.244066] [INFO ] [MAIN      ] BWSN: Wiping existing primary data before full refresh.
[2025-10-24T17:45:35.244118] [INFO ] [LOCAL     ] BWSN: Starting deletion of primary data.
[2025-10-24T17:45:35.244277] [DEBUG] [LOCAL     ] BWSN: Deleted primary data file.
[2025-10-24T17:45:35.244340] [INFO ] [MAIN      ] BWSN: Starting full primary refresh.
[2025-10-24T17:45:35.352767] [INFO ] [REMOTE    ] BWMX: Fetching primary data for 2025-06.
[2025-10-24T17:45:35.607926] [INFO ] [REMOTE    ] BWSN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:45:35.765705] [INFO ] [REMOTE    ] BWLP: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T17:45:36.147705] [INFO ] [REMOTE    ] BWNB: Fetching primary data for 2025-02.
[2025-10-24T17:45:36.173458] [INFO ] [REMOTE    ] BWMX: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T17:45:36.607777] [INFO ] [REMOTE    ] BWNB: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T17:45:36.947746] [INFO ] [REMOTE    ] BWNB: Fetching primary data for 2025-03.
[2025-10-24T17:45:37.484444] [INFO ] [REMOTE    ] BWNB: Incremental fetch complete for 2025-03 (0.54 seconds).
[2025-10-24T17:45:37.747701] [INFO ] [REMOTE    ] BWMX: Fetching primary data for 2025-07.
[2025-10-24T17:45:38.410489] [INFO ] [REMOTE    ] BWMX: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T17:45:38.547705] [INFO ] [REMOTE    ] BWMX: Fetching primary data for 2025-08.
[2025-10-24T17:45:39.317450] [INFO ] [REMOTE    ] BWMX: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T17:45:39.347697] [INFO ] [REMOTE    ] BWNB: Fetching primary data for 2025-04.
[2025-10-24T17:45:39.796258] [INFO ] [REMOTE    ] BWNB: Incremental fetch complete for 2025-04 (0.45 seconds).
[2025-10-24T17:45:40.147667] [INFO ] [REMOTE    ] BWNB: Fetching primary data for 2025-05.
[2025-10-24T17:45:40.894235] [INFO ] [REMOTE    ] BWNB: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T17:45:40.947624] [INFO ] [REMOTE    ] BWSN: Fetching primary data for 2025-01.
[2025-10-24T17:45:41.500082] [INFO ] [REMOTE    ] BWSN: Incremental fetch complete for 2025-01 (0.55 seconds).
[2025-10-24T17:45:41.747667] [INFO ] [REMOTE    ] BWLP: Fetching primary data for 2025-09.
[2025-10-24T17:45:42.547708] [INFO ] [REMOTE    ] BWMX: Fetching primary data for 2025-09.
[2025-10-24T17:45:43.025311] [INFO ] [REMOTE    ] BWLP: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T17:45:43.164998] [INFO ] [REMOTE    ] BWMX: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T17:45:43.347677] [INFO ] [REMOTE    ] BWMX: Fetching primary data for 2025-10.
[2025-10-24T17:45:44.056539] [INFO ] [REMOTE    ] BWMX: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T17:45:44.058273] [INFO ] [REMOTE    ] BWMX: Full fetch complete (9949 records).
[2025-10-24T17:45:44.058343] [DEBUG] [VALIDATOR ] BWMX: Validating primary data.
[2025-10-24T17:45:44.152727] [INFO ] [REMOTE    ] BWNB: Fetching primary data for 2025-06.
[2025-10-24T17:45:44.419449] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present.
[2025-10-24T17:45:44.419522] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed.
[2025-10-24T17:45:44.419795] [INFO ] [MAIN      ] BWMX: Fetched primary data is valid.
[2025-10-24T17:45:44.419854] [DEBUG] [LOCAL     ] BWMX: Saving primary data.
[2025-10-24T17:45:44.420060] [FATAL] [LOCAL     ] BWMX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:45:44.420145] [FATAL] [MAIN      ] BWMX: Failed to save primary data.
[2025-10-24T17:45:44.420186] [WARN ] [MAIN      ] BWMX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:45:44.420247] [INFO ] [LOCAL     ] BWMX: Starting deletion of primary data.
[2025-10-24T17:45:44.420302] [DEBUG] [LOCAL     ] BWMX: No primary data file found to delete.
[2025-10-24T17:45:44.420338] [INFO ] [LOCAL     ] BWMX: Starting deletion of derivative data.
[2025-10-24T17:45:44.420475] [DEBUG] [LOCAL     ] BWMX: Deleted derivative data file.
[2025-10-24T17:45:44.420559] [INFO ] [MAIN      ] Update Progress: 367/2366 symbols completed. BWMX took 30.1s. Estimated remaining: 4h 8m 53s. Rate: 8.0 symbols/min
[2025-10-24T17:45:44.584632] [INFO ] [MAIN      ] BWXT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:45:44.630091] [DEBUG] [LOCAL     ] BWXT: Loaded 47605 existing records from primary storage.
[2025-10-24T17:45:44.630377] [INFO ] [MAIN      ] BWXT: Loaded 47605 existing records.
[2025-10-24T17:45:44.805509] [WARN ] [MAIN      ] BWXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:45:44.805778] [INFO ] [MAIN      ] BWXT: Wiping existing primary data before full refresh.
[2025-10-24T17:45:44.807801] [INFO ] [LOCAL     ] BWXT: Starting deletion of primary data.
[2025-10-24T17:45:44.810255] [INFO ] [REMOTE    ] BWNB: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T17:45:44.810290] [DEBUG] [LOCAL     ] BWXT: Deleted primary data file.
[2025-10-24T17:45:44.810422] [INFO ] [MAIN      ] BWXT: Starting full primary refresh.
[2025-10-24T17:45:44.957420] [INFO ] [REMOTE    ] BWSN: Fetching primary data for 2025-02.
[2025-10-24T17:45:45.159008] [INFO ] [REMOTE    ] BWXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:45:45.473143] [INFO ] [REMOTE    ] BWSN: Incremental fetch complete for 2025-02 (0.52 seconds).
[2025-10-24T17:45:45.747722] [INFO ] [REMOTE    ] BWSN: Fetching primary data for 2025-03.
[2025-10-24T17:45:46.312476] [INFO ] [REMOTE    ] BWSN: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T17:45:46.547744] [INFO ] [REMOTE    ] BWXT: Fetching primary data for 2025-01.
[2025-10-24T17:45:47.347716] [INFO ] [REMOTE    ] BWNB: Fetching primary data for 2025-07.
[2025-10-24T17:45:47.762786] [INFO ] [REMOTE    ] BWNB: Incremental fetch complete for 2025-07 (0.42 seconds).
[2025-10-24T17:45:48.147739] [INFO ] [REMOTE    ] BWNB: Fetching primary data for 2025-08.
[2025-10-24T17:45:48.363948] [INFO ] [REMOTE    ] BWXT: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T17:45:48.707616] [INFO ] [REMOTE    ] BWNB: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T17:45:48.947677] [INFO ] [REMOTE    ] BWXT: Fetching primary data for 2025-02.
[2025-10-24T17:45:49.747677] [INFO ] [REMOTE    ] BWNB: Fetching primary data for 2025-09.
[2025-10-24T17:45:50.372930] [INFO ] [REMOTE    ] BWNB: Incremental fetch complete for 2025-09 (0.63 seconds).
[2025-10-24T17:45:50.547628] [INFO ] [REMOTE    ] BWSN: Fetching primary data for 2025-04.
[2025-10-24T17:45:50.589518] [INFO ] [REMOTE    ] BWXT: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T17:45:51.132491] [INFO ] [REMOTE    ] BWSN: Incremental fetch complete for 2025-04 (0.58 seconds).
[2025-10-24T17:45:51.347699] [INFO ] [REMOTE    ] BWNB: Fetching primary data for 2025-10.
[2025-10-24T17:45:51.805637] [INFO ] [REMOTE    ] BWNB: Incremental fetch complete for 2025-10 (0.46 seconds).
[2025-10-24T17:45:51.806602] [INFO ] [REMOTE    ] BWNB: Full fetch complete (5586 records).
[2025-10-24T17:45:51.806711] [DEBUG] [VALIDATOR ] BWNB: Validating primary data.
[2025-10-24T17:45:52.155223] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present.
[2025-10-24T17:45:52.155326] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed.
[2025-10-24T17:45:52.149749] [INFO ] [REMOTE    ] BWLP: Fetching primary data for 2025-10.
[2025-10-24T17:45:52.155673] [INFO ] [MAIN      ] BWNB: Fetched primary data is valid.
[2025-10-24T17:45:52.155983] [DEBUG] [LOCAL     ] BWNB: Saving primary data.
[2025-10-24T17:45:52.156882] [FATAL] [LOCAL     ] BWNB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:45:52.156962] [FATAL] [MAIN      ] BWNB: Failed to save primary data.
[2025-10-24T17:45:52.157026] [WARN ] [MAIN      ] BWNB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:45:52.157092] [INFO ] [LOCAL     ] BWNB: Starting deletion of primary data.
[2025-10-24T17:45:52.157189] [DEBUG] [LOCAL     ] BWNB: No primary data file found to delete.
[2025-10-24T17:45:52.157231] [INFO ] [LOCAL     ] BWNB: Starting deletion of derivative data.
[2025-10-24T17:45:52.157392] [DEBUG] [LOCAL     ] BWNB: Deleted derivative data file.
[2025-10-24T17:45:52.157478] [INFO ] [MAIN      ] Update Progress: 368/2366 symbols completed. BWNB took 21.7s. Estimated remaining: 4h 8m 47s. Rate: 8.0 symbols/min
[2025-10-24T17:45:52.322753] [INFO ] [MAIN      ] BX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:45:52.322944] [DEBUG] [LOCAL     ] BX: No existing data file found in primary storage.
[2025-10-24T17:45:52.322982] [WARN ] [MAIN      ] BX: No existing data found, performing full refresh instead.
[2025-10-24T17:45:52.323090] [INFO ] [MAIN      ] BX: Wiping existing primary data before full refresh.
[2025-10-24T17:45:52.323130] [INFO ] [LOCAL     ] BX: Starting deletion of primary data.
[2025-10-24T17:45:52.323171] [DEBUG] [LOCAL     ] BX: No primary data file found to delete.
[2025-10-24T17:45:52.323202] [INFO ] [MAIN      ] BX: Starting full primary refresh.
[2025-10-24T17:45:52.684712] [INFO ] [REMOTE    ] BX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:45:52.947724] [INFO ] [REMOTE    ] BX: Fetching primary data for 2025-01.
[2025-10-24T17:45:53.650939] [INFO ] [REMOTE    ] BWLP: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T17:45:53.658029] [INFO ] [REMOTE    ] BWLP: Full fetch complete (47755 records).
[2025-10-24T17:45:53.658286] [DEBUG] [VALIDATOR ] BWLP: Validating primary data.
[2025-10-24T17:45:53.752952] [INFO ] [REMOTE    ] BWXT: Fetching primary data for 2025-03.
[2025-10-24T17:45:54.063724] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present.
[2025-10-24T17:45:54.063827] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed.
[2025-10-24T17:45:54.064537] [INFO ] [MAIN      ] BWLP: Fetched primary data is valid.
[2025-10-24T17:45:54.064606] [DEBUG] [LOCAL     ] BWLP: Saving primary data.
[2025-10-24T17:45:54.065155] [FATAL] [LOCAL     ] BWLP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:45:54.065250] [FATAL] [MAIN      ] BWLP: Failed to save primary data.
[2025-10-24T17:45:54.065293] [WARN ] [MAIN      ] BWLP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:45:54.065356] [INFO ] [LOCAL     ] BWLP: Starting deletion of primary data.
[2025-10-24T17:45:54.065417] [DEBUG] [LOCAL     ] BWLP: No primary data file found to delete.
[2025-10-24T17:45:54.065454] [INFO ] [LOCAL     ] BWLP: Starting deletion of derivative data.
[2025-10-24T17:45:54.065599] [DEBUG] [LOCAL     ] BWLP: Deleted derivative data file.
[2025-10-24T17:45:54.065718] [INFO ] [MAIN      ] Update Progress: 369/2366 symbols completed. BWLP took 41.7s. Estimated remaining: 4h 8m 9s. Rate: 8.0 symbols/min
[2025-10-24T17:45:54.240483] [INFO ] [MAIN      ] BXC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:45:54.257295] [DEBUG] [LOCAL     ] BXC: Loaded 13472 existing records from primary storage.
[2025-10-24T17:45:54.257554] [INFO ] [MAIN      ] BXC: Loaded 13472 existing records.
[2025-10-24T17:45:54.442901] [WARN ] [MAIN      ] BXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:45:54.443272] [INFO ] [MAIN      ] BXC: Wiping existing primary data before full refresh.
[2025-10-24T17:45:54.443328] [INFO ] [LOCAL     ] BXC: Starting deletion of primary data.
[2025-10-24T17:45:54.443574] [DEBUG] [LOCAL     ] BXC: Deleted primary data file.
[2025-10-24T17:45:54.443633] [INFO ] [MAIN      ] BXC: Starting full primary refresh.
[2025-10-24T17:45:54.552768] [INFO ] [REMOTE    ] BWSN: Fetching primary data for 2025-05.
[2025-10-24T17:45:54.809305] [INFO ] [REMOTE    ] BXC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:45:54.854088] [INFO ] [REMOTE    ] BX: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T17:45:55.267506] [INFO ] [REMOTE    ] BWSN: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T17:45:55.298999] [INFO ] [REMOTE    ] BWXT: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T17:45:55.347696] [INFO ] [REMOTE    ] BXC: Fetching primary data for 2025-01.
[2025-10-24T17:45:56.147629] [INFO ] [REMOTE    ] BX: Fetching primary data for 2025-02.
[2025-10-24T17:45:56.245169] [INFO ] [REMOTE    ] BXC: Incremental fetch complete for 2025-01 (0.90 seconds).
[2025-10-24T17:45:56.947683] [INFO ] [REMOTE    ] BWSN: Fetching primary data for 2025-06.
[2025-10-24T17:45:57.642356] [INFO ] [REMOTE    ] BWSN: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T17:45:57.747621] [INFO ] [REMOTE    ] BWSN: Fetching primary data for 2025-07.
[2025-10-24T17:45:57.897591] [INFO ] [REMOTE    ] BX: Incremental fetch complete for 2025-02 (1.75 seconds).
[2025-10-24T17:45:58.215876] [INFO ] [REMOTE    ] BWSN: Incremental fetch complete for 2025-07 (0.47 seconds).
[2025-10-24T17:45:58.547691] [INFO ] [REMOTE    ] BXC: Fetching primary data for 2025-02.
[2025-10-24T17:45:59.338972] [INFO ] [REMOTE    ] BXC: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T17:45:59.347681] [INFO ] [REMOTE    ] BX: Fetching primary data for 2025-03.
[2025-10-24T17:46:00.147674] [INFO ] [REMOTE    ] BXC: Fetching primary data for 2025-03.
[2025-10-24T17:46:00.947687] [INFO ] [REMOTE    ] BWSN: Fetching primary data for 2025-08.
[2025-10-24T17:46:01.123064] [INFO ] [REMOTE    ] BXC: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T17:46:01.747682] [INFO ] [REMOTE    ] BWXT: Fetching primary data for 2025-04.
[2025-10-24T17:46:01.886952] [INFO ] [REMOTE    ] BX: Incremental fetch complete for 2025-03 (2.54 seconds).
[2025-10-24T17:46:02.368508] [INFO ] [REMOTE    ] BWSN: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T17:46:02.547740] [INFO ] [REMOTE    ] BWSN: Fetching primary data for 2025-09.
[2025-10-24T17:46:03.318076] [INFO ] [REMOTE    ] BWSN: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T17:46:03.347594] [INFO ] [REMOTE    ] BWSN: Fetching primary data for 2025-10.
[2025-10-24T17:46:03.783105] [INFO ] [REMOTE    ] BWXT: Incremental fetch complete for 2025-04 (2.04 seconds).
[2025-10-24T17:46:04.147623] [INFO ] [REMOTE    ] BXC: Fetching primary data for 2025-04.
[2025-10-24T17:46:04.179885] [INFO ] [REMOTE    ] BWSN: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T17:46:04.181356] [INFO ] [REMOTE    ] BWSN: Full fetch complete (6425 records).
[2025-10-24T17:46:04.181451] [DEBUG] [VALIDATOR ] BWSN: Validating primary data.
[2025-10-24T17:46:04.551473] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present.
[2025-10-24T17:46:04.551564] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed.
[2025-10-24T17:46:04.551785] [INFO ] [MAIN      ] BWSN: Fetched primary data is valid.
[2025-10-24T17:46:04.551847] [DEBUG] [LOCAL     ] BWSN: Saving primary data.
[2025-10-24T17:46:04.552274] [FATAL] [LOCAL     ] BWSN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:46:04.552361] [FATAL] [MAIN      ] BWSN: Failed to save primary data.
[2025-10-24T17:46:04.552402] [WARN ] [MAIN      ] BWSN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:46:04.552447] [INFO ] [LOCAL     ] BWSN: Starting deletion of primary data.
[2025-10-24T17:46:04.552496] [DEBUG] [LOCAL     ] BWSN: No primary data file found to delete.
[2025-10-24T17:46:04.552530] [INFO ] [LOCAL     ] BWSN: Starting deletion of derivative data.
[2025-10-24T17:46:04.552714] [DEBUG] [LOCAL     ] BWSN: Deleted derivative data file.
[2025-10-24T17:46:04.552805] [INFO ] [MAIN      ] Update Progress: 370/2366 symbols completed. BWSN took 29.7s. Estimated remaining: 4h 8m 18s. Rate: 8.0 symbols/min
[2025-10-24T17:46:04.756113] [INFO ] [MAIN      ] BXMT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:46:04.819211] [DEBUG] [LOCAL     ] BXMT: Loaded 47621 existing records from primary storage.
[2025-10-24T17:46:04.819727] [INFO ] [MAIN      ] BXMT: Loaded 47621 existing records.
[2025-10-24T17:46:04.953228] [INFO ] [REMOTE    ] BWXT: Fetching primary data for 2025-05.
[2025-10-24T17:46:05.103570] [WARN ] [MAIN      ] BXMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:46:05.103901] [INFO ] [MAIN      ] BXMT: Wiping existing primary data before full refresh.
[2025-10-24T17:46:05.103972] [INFO ] [LOCAL     ] BXMT: Starting deletion of primary data.
[2025-10-24T17:46:05.104526] [DEBUG] [LOCAL     ] BXMT: Deleted primary data file.
[2025-10-24T17:46:05.104598] [INFO ] [MAIN      ] BXMT: Starting full primary refresh.
[2025-10-24T17:46:05.583239] [INFO ] [REMOTE    ] BXMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:46:05.747731] [INFO ] [REMOTE    ] BX: Fetching primary data for 2025-04.
[2025-10-24T17:46:06.353749] [INFO ] [REMOTE    ] BXC: Incremental fetch complete for 2025-04 (2.21 seconds).
[2025-10-24T17:46:06.547738] [INFO ] [REMOTE    ] BXMT: Fetching primary data for 2025-01.
[2025-10-24T17:46:07.347710] [INFO ] [REMOTE    ] BXC: Fetching primary data for 2025-05.
[2025-10-24T17:46:08.300691] [INFO ] [REMOTE    ] BX: Incremental fetch complete for 2025-04 (2.55 seconds).
[2025-10-24T17:46:08.314571] [INFO ] [REMOTE    ] BX: Fetching primary data for 2025-05.
[2025-10-24T17:46:08.338171] [INFO ] [REMOTE    ] BXC: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T17:46:08.653189] [INFO ] [REMOTE    ] BXMT: Incremental fetch complete for 2025-01 (2.11 seconds).
[2025-10-24T17:46:08.801463] [INFO ] [REMOTE    ] BWXT: Incremental fetch complete for 2025-05 (3.85 seconds).
[2025-10-24T17:46:08.947675] [INFO ] [REMOTE    ] BWXT: Fetching primary data for 2025-06.
[2025-10-24T17:46:09.747695] [INFO ] [REMOTE    ] BXC: Fetching primary data for 2025-06.
[2025-10-24T17:46:10.223359] [INFO ] [REMOTE    ] BX: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T17:46:10.547620] [INFO ] [REMOTE    ] BX: Fetching primary data for 2025-06.
[2025-10-24T17:46:10.683027] [INFO ] [REMOTE    ] BXC: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T17:46:10.745754] [INFO ] [REMOTE    ] BWXT: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T17:46:11.347625] [INFO ] [REMOTE    ] BWXT: Fetching primary data for 2025-07.
[2025-10-24T17:46:12.147699] [INFO ] [REMOTE    ] BXC: Fetching primary data for 2025-07.
[2025-10-24T17:46:12.831688] [INFO ] [REMOTE    ] BXC: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T17:46:12.934154] [INFO ] [REMOTE    ] BX: Incremental fetch complete for 2025-06 (2.39 seconds).
[2025-10-24T17:46:12.947610] [INFO ] [REMOTE    ] BX: Fetching primary data for 2025-07.
[2025-10-24T17:46:13.034134] [INFO ] [REMOTE    ] BWXT: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T17:46:13.747696] [INFO ] [REMOTE    ] BXC: Fetching primary data for 2025-08.
[2025-10-24T17:46:14.547614] [INFO ] [REMOTE    ] BWXT: Fetching primary data for 2025-08.
[2025-10-24T17:46:14.783726] [INFO ] [REMOTE    ] BXC: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T17:46:14.934165] [INFO ] [REMOTE    ] BX: Incremental fetch complete for 2025-07 (1.99 seconds).
[2025-10-24T17:46:15.347699] [INFO ] [REMOTE    ] BXC: Fetching primary data for 2025-09.
[2025-10-24T17:46:16.147702] [INFO ] [REMOTE    ] BXMT: Fetching primary data for 2025-02.
[2025-10-24T17:46:16.631619] [INFO ] [REMOTE    ] BXC: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T17:46:16.947632] [INFO ] [REMOTE    ] BXC: Fetching primary data for 2025-10.
[2025-10-24T17:46:16.978356] [INFO ] [REMOTE    ] BWXT: Incremental fetch complete for 2025-08 (2.43 seconds).
[2025-10-24T17:46:17.451499] [INFO ] [REMOTE    ] BXMT: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T17:46:17.747623] [INFO ] [REMOTE    ] BXMT: Fetching primary data for 2025-03.
[2025-10-24T17:46:17.902229] [INFO ] [REMOTE    ] BXC: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T17:46:17.904554] [INFO ] [REMOTE    ] BXC: Full fetch complete (18286 records).
[2025-10-24T17:46:17.904623] [DEBUG] [VALIDATOR ] BXC: Validating primary data.
[2025-10-24T17:46:18.270561] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present.
[2025-10-24T17:46:18.270866] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed.
[2025-10-24T17:46:18.271256] [INFO ] [MAIN      ] BXC: Fetched primary data is valid.
[2025-10-24T17:46:18.271298] [DEBUG] [LOCAL     ] BXC: Saving primary data.
[2025-10-24T17:46:18.271565] [FATAL] [LOCAL     ] BXC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:46:18.271694] [FATAL] [MAIN      ] BXC: Failed to save primary data.
[2025-10-24T17:46:18.271743] [WARN ] [MAIN      ] BXC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:46:18.271778] [INFO ] [LOCAL     ] BXC: Starting deletion of primary data.
[2025-10-24T17:46:18.271841] [DEBUG] [LOCAL     ] BXC: No primary data file found to delete.
[2025-10-24T17:46:18.271897] [INFO ] [LOCAL     ] BXC: Starting deletion of derivative data.
[2025-10-24T17:46:18.272444] [DEBUG] [LOCAL     ] BXC: Deleted derivative data file.
[2025-10-24T17:46:18.272542] [INFO ] [MAIN      ] Update Progress: 371/2366 symbols completed. BXC took 24.2s. Estimated remaining: 4h 8m 44s. Rate: 8.0 symbols/min
[2025-10-24T17:46:18.444319] [INFO ] [MAIN      ] BXMX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:46:18.463993] [DEBUG] [LOCAL     ] BXMX: Loaded 19294 existing records from primary storage.
[2025-10-24T17:46:18.464226] [INFO ] [MAIN      ] BXMX: Loaded 19294 existing records.
[2025-10-24T17:46:18.553435] [INFO ] [REMOTE    ] BWXT: Fetching primary data for 2025-09.
[2025-10-24T17:46:18.641897] [WARN ] [MAIN      ] BXMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:46:18.642075] [INFO ] [MAIN      ] BXMX: Wiping existing primary data before full refresh.
[2025-10-24T17:46:18.642125] [INFO ] [LOCAL     ] BXMX: Starting deletion of primary data.
[2025-10-24T17:46:18.642341] [DEBUG] [LOCAL     ] BXMX: Deleted primary data file.
[2025-10-24T17:46:18.642389] [INFO ] [MAIN      ] BXMX: Starting full primary refresh.
[2025-10-24T17:46:19.003384] [INFO ] [REMOTE    ] BXMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:46:19.347611] [INFO ] [REMOTE    ] BXMX: Fetching primary data for 2025-01.
[2025-10-24T17:46:19.458580] [INFO ] [REMOTE    ] BXMT: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T17:46:20.147626] [INFO ] [REMOTE    ] BX: Fetching primary data for 2025-08.
[2025-10-24T17:46:20.467106] [INFO ] [REMOTE    ] BXMX: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T17:46:20.730233] [INFO ] [REMOTE    ] BWXT: Incremental fetch complete for 2025-09 (2.18 seconds).
[2025-10-24T17:46:20.947687] [INFO ] [REMOTE    ] BXMX: Fetching primary data for 2025-02.
[2025-10-24T17:46:21.747619] [INFO ] [REMOTE    ] BWXT: Fetching primary data for 2025-10.
[2025-10-24T17:46:21.984049] [INFO ] [REMOTE    ] BXMX: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T17:46:22.177180] [INFO ] [REMOTE    ] BX: Incremental fetch complete for 2025-08 (2.03 seconds).
[2025-10-24T17:46:22.547701] [INFO ] [REMOTE    ] BXMX: Fetching primary data for 2025-03.
[2025-10-24T17:46:23.347606] [INFO ] [REMOTE    ] BXMT: Fetching primary data for 2025-04.
[2025-10-24T17:46:23.670613] [INFO ] [REMOTE    ] BXMX: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T17:46:23.956888] [INFO ] [REMOTE    ] BWXT: Incremental fetch complete for 2025-10 (2.21 seconds).
[2025-10-24T17:46:23.966176] [INFO ] [REMOTE    ] BWXT: Full fetch complete (68084 records).
[2025-10-24T17:46:23.966302] [DEBUG] [VALIDATOR ] BWXT: Validating primary data.
[2025-10-24T17:46:24.157945] [INFO ] [REMOTE    ] BXMX: Fetching primary data for 2025-04.
[2025-10-24T17:46:24.357787] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present.
[2025-10-24T17:46:24.357872] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed.
[2025-10-24T17:46:24.358744] [INFO ] [MAIN      ] BWXT: Fetched primary data is valid.
[2025-10-24T17:46:24.358812] [DEBUG] [LOCAL     ] BWXT: Saving primary data.
[2025-10-24T17:46:24.359374] [FATAL] [LOCAL     ] BWXT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:46:24.359454] [FATAL] [MAIN      ] BWXT: Failed to save primary data.
[2025-10-24T17:46:24.359497] [WARN ] [MAIN      ] BWXT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:46:24.359556] [INFO ] [LOCAL     ] BWXT: Starting deletion of primary data.
[2025-10-24T17:46:24.359617] [DEBUG] [LOCAL     ] BWXT: No primary data file found to delete.
[2025-10-24T17:46:24.359683] [INFO ] [LOCAL     ] BWXT: Starting deletion of derivative data.
[2025-10-24T17:46:24.359852] [DEBUG] [LOCAL     ] BWXT: Deleted derivative data file.
[2025-10-24T17:46:24.360588] [INFO ] [MAIN      ] Update Progress: 372/2366 symbols completed. BWXT took 39.9s. Estimated remaining: 4h 8m 29s. Rate: 8.0 symbols/min
[2025-10-24T17:46:24.527586] [INFO ] [MAIN      ] BXP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:46:24.572157] [DEBUG] [LOCAL     ] BXP: Loaded 50203 existing records from primary storage.
[2025-10-24T17:46:24.572444] [INFO ] [MAIN      ] BXP: Loaded 50203 existing records.
[2025-10-24T17:46:24.777795] [WARN ] [MAIN      ] BXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:46:24.778016] [INFO ] [MAIN      ] BXP: Wiping existing primary data before full refresh.
[2025-10-24T17:46:24.778063] [INFO ] [LOCAL     ] BXP: Starting deletion of primary data.
[2025-10-24T17:46:24.778581] [DEBUG] [LOCAL     ] BXP: Deleted primary data file.
[2025-10-24T17:46:24.778622] [INFO ] [MAIN      ] BXP: Starting full primary refresh.
[2025-10-24T17:46:24.957832] [INFO ] [REMOTE    ] BX: Fetching primary data for 2025-09.
[2025-10-24T17:46:25.154061] [INFO ] [REMOTE    ] BXP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:46:25.169302] [INFO ] [REMOTE    ] BXMX: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T17:46:25.202523] [INFO ] [REMOTE    ] BXMT: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T17:46:25.747726] [INFO ] [REMOTE    ] BXMX: Fetching primary data for 2025-05.
[2025-10-24T17:46:26.547621] [INFO ] [REMOTE    ] BXP: Fetching primary data for 2025-01.
[2025-10-24T17:46:26.813111] [INFO ] [REMOTE    ] BXMX: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T17:46:26.912495] [INFO ] [REMOTE    ] BX: Incremental fetch complete for 2025-09 (1.95 seconds).
[2025-10-24T17:46:27.347684] [INFO ] [REMOTE    ] BX: Fetching primary data for 2025-10.
[2025-10-24T17:46:27.927191] [INFO ] [REMOTE    ] BXP: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T17:46:28.147733] [INFO ] [REMOTE    ] BXP: Fetching primary data for 2025-02.
[2025-10-24T17:46:28.947722] [INFO ] [REMOTE    ] BXMT: Fetching primary data for 2025-05.
[2025-10-24T17:46:29.329722] [INFO ] [REMOTE    ] BX: Incremental fetch complete for 2025-10 (1.98 seconds).
[2025-10-24T17:46:29.339522] [INFO ] [REMOTE    ] BX: Full fetch complete (77611 records).
[2025-10-24T17:46:29.339713] [DEBUG] [VALIDATOR ] BX: Validating primary data.
[2025-10-24T17:46:29.742562] [DEBUG] [VALIDATOR ] BX: All expected trading days are present.
[2025-10-24T17:46:29.742692] [DEBUG] [VALIDATOR ] BX: Primary data validation passed.
[2025-10-24T17:46:29.743836] [INFO ] [MAIN      ] BX: Fetched primary data is valid.
[2025-10-24T17:46:29.743986] [DEBUG] [LOCAL     ] BX: Saving primary data.
[2025-10-24T17:46:29.744736] [FATAL] [LOCAL     ] BX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:46:29.744873] [FATAL] [MAIN      ] BX: Failed to save primary data.
[2025-10-24T17:46:29.744945] [WARN ] [MAIN      ] BX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:46:29.745017] [INFO ] [LOCAL     ] BX: Starting deletion of primary data.
[2025-10-24T17:46:29.745080] [DEBUG] [LOCAL     ] BX: No primary data file found to delete.
[2025-10-24T17:46:29.745118] [INFO ] [LOCAL     ] BX: Starting deletion of derivative data.
[2025-10-24T17:46:29.745159] [DEBUG] [LOCAL     ] BX: No derivative data file found to delete.
[2025-10-24T17:46:29.745517] [INFO ] [MAIN      ] Update Progress: 373/2366 symbols completed. BX took 37.6s. Estimated remaining: 4h 8m 11s. Rate: 8.0 symbols/min
[2025-10-24T17:46:29.751673] [INFO ] [REMOTE    ] BXMX: Fetching primary data for 2025-06.
[2025-10-24T17:46:29.944038] [INFO ] [MAIN      ] BXSL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:46:29.946312] [INFO ] [REMOTE    ] BXP: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T17:46:30.004128] [DEBUG] [LOCAL     ] BXSL: Loaded 48587 existing records from primary storage.
[2025-10-24T17:46:30.004569] [INFO ] [MAIN      ] BXSL: Loaded 48587 existing records.
[2025-10-24T17:46:30.192429] [WARN ] [MAIN      ] BXSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:46:30.192780] [INFO ] [MAIN      ] BXSL: Wiping existing primary data before full refresh.
[2025-10-24T17:46:30.192881] [INFO ] [LOCAL     ] BXSL: Starting deletion of primary data.
[2025-10-24T17:46:30.193548] [DEBUG] [LOCAL     ] BXSL: Deleted primary data file.
[2025-10-24T17:46:30.193617] [INFO ] [MAIN      ] BXSL: Starting full primary refresh.
[2025-10-24T17:46:30.512864] [INFO ] [REMOTE    ] BXMT: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T17:46:30.548238] [INFO ] [REMOTE    ] BXP: Fetching primary data for 2025-03.
[2025-10-24T17:46:30.604289] [INFO ] [REMOTE    ] BXSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:46:31.033522] [INFO ] [REMOTE    ] BXMX: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T17:46:31.347688] [INFO ] [REMOTE    ] BXMT: Fetching primary data for 2025-06.
[2025-10-24T17:46:32.147673] [INFO ] [REMOTE    ] BXMX: Fetching primary data for 2025-07.
[2025-10-24T17:46:32.398309] [INFO ] [REMOTE    ] BXP: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T17:46:32.831519] [INFO ] [REMOTE    ] BXMT: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T17:46:32.947604] [INFO ] [REMOTE    ] BXP: Fetching primary data for 2025-04.
[2025-10-24T17:46:33.265255] [INFO ] [REMOTE    ] BXMX: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T17:46:33.747734] [INFO ] [REMOTE    ] BXMT: Fetching primary data for 2025-07.
[2025-10-24T17:46:34.487712] [INFO ] [REMOTE    ] BXP: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T17:46:34.547635] [INFO ] [REMOTE    ] BXP: Fetching primary data for 2025-05.
[2025-10-24T17:46:35.352724] [INFO ] [REMOTE    ] BXMX: Fetching primary data for 2025-08.
[2025-10-24T17:46:35.368993] [INFO ] [REMOTE    ] BXMT: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T17:46:35.957382] [INFO ] [REMOTE    ] BXP: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T17:46:35.978240] [INFO ] [REMOTE    ] BXMX: Incremental fetch complete for 2025-08 (0.63 seconds).
[2025-10-24T17:46:36.147717] [INFO ] [REMOTE    ] BXSL: Fetching primary data for 2025-01.
[2025-10-24T17:46:36.947691] [INFO ] [REMOTE    ] BXP: Fetching primary data for 2025-06.
[2025-10-24T17:46:37.747693] [INFO ] [REMOTE    ] BXMT: Fetching primary data for 2025-08.
[2025-10-24T17:46:37.888170] [INFO ] [REMOTE    ] BXSL: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T17:46:38.547709] [INFO ] [REMOTE    ] BXMX: Fetching primary data for 2025-09.
[2025-10-24T17:46:38.711999] [INFO ] [REMOTE    ] BXP: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T17:46:39.331893] [INFO ] [REMOTE    ] BXMT: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T17:46:39.347608] [INFO ] [REMOTE    ] BXMT: Fetching primary data for 2025-09.
[2025-10-24T17:46:39.601972] [INFO ] [REMOTE    ] BXMX: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T17:46:40.147694] [INFO ] [REMOTE    ] BXSL: Fetching primary data for 2025-02.
[2025-10-24T17:46:40.947619] [INFO ] [REMOTE    ] BXP: Fetching primary data for 2025-07.
[2025-10-24T17:46:41.005485] [INFO ] [REMOTE    ] BXMT: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T17:46:41.533080] [INFO ] [REMOTE    ] BXSL: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T17:46:41.747638] [INFO ] [REMOTE    ] BXMX: Fetching primary data for 2025-10.
[2025-10-24T17:46:42.422591] [INFO ] [REMOTE    ] BXP: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T17:46:42.547667] [INFO ] [REMOTE    ] BXSL: Fetching primary data for 2025-03.
[2025-10-24T17:46:42.598674] [INFO ] [REMOTE    ] BXMX: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T17:46:42.602480] [INFO ] [REMOTE    ] BXMX: Full fetch complete (28540 records).
[2025-10-24T17:46:42.602557] [DEBUG] [VALIDATOR ] BXMX: Validating primary data.
[2025-10-24T17:46:42.973055] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present.
[2025-10-24T17:46:42.973145] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed.
[2025-10-24T17:46:42.973598] [INFO ] [MAIN      ] BXMX: Fetched primary data is valid.
[2025-10-24T17:46:42.973690] [DEBUG] [LOCAL     ] BXMX: Saving primary data.
[2025-10-24T17:46:42.974144] [FATAL] [LOCAL     ] BXMX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:46:42.974234] [FATAL] [MAIN      ] BXMX: Failed to save primary data.
[2025-10-24T17:46:42.974276] [WARN ] [MAIN      ] BXMX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:46:42.974311] [INFO ] [LOCAL     ] BXMX: Starting deletion of primary data.
[2025-10-24T17:46:42.974361] [DEBUG] [LOCAL     ] BXMX: No primary data file found to delete.
[2025-10-24T17:46:42.974396] [INFO ] [LOCAL     ] BXMX: Starting deletion of derivative data.
[2025-10-24T17:46:42.974516] [DEBUG] [LOCAL     ] BXMX: Deleted derivative data file.
[2025-10-24T17:46:42.974589] [INFO ] [MAIN      ] Update Progress: 374/2366 symbols completed. BXMX took 24.7s. Estimated remaining: 4h 8m 34s. Rate: 8.0 symbols/min
[2025-10-24T17:46:43.147082] [INFO ] [MAIN      ] BY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:46:43.167822] [DEBUG] [LOCAL     ] BY: Loaded 21757 existing records from primary storage.
[2025-10-24T17:46:43.168091] [INFO ] [MAIN      ] BY: Loaded 21757 existing records.
[2025-10-24T17:46:43.343925] [WARN ] [MAIN      ] BY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:46:43.344123] [INFO ] [MAIN      ] BY: Wiping existing primary data before full refresh.
[2025-10-24T17:46:43.344168] [INFO ] [LOCAL     ] BY: Starting deletion of primary data.
[2025-10-24T17:46:43.344391] [DEBUG] [LOCAL     ] BY: Deleted primary data file.
[2025-10-24T17:46:43.344430] [INFO ] [MAIN      ] BY: Starting full primary refresh.
[2025-10-24T17:46:43.355687] [INFO ] [REMOTE    ] BXMT: Fetching primary data for 2025-10.
[2025-10-24T17:46:43.717228] [INFO ] [REMOTE    ] BY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:46:44.070536] [INFO ] [REMOTE    ] BXSL: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T17:46:44.147615] [INFO ] [REMOTE    ] BXSL: Fetching primary data for 2025-04.
[2025-10-24T17:46:44.947626] [INFO ] [REMOTE    ] BY: Fetching primary data for 2025-01.
[2025-10-24T17:46:45.236681] [INFO ] [REMOTE    ] BXMT: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T17:46:45.245852] [INFO ] [REMOTE    ] BXMT: Full fetch complete (69850 records).
[2025-10-24T17:46:45.245995] [DEBUG] [VALIDATOR ] BXMT: Validating primary data.
[2025-10-24T17:46:45.693057] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present.
[2025-10-24T17:46:45.693180] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed.
[2025-10-24T17:46:45.694457] [INFO ] [MAIN      ] BXMT: Fetched primary data is valid.
[2025-10-24T17:46:45.694546] [DEBUG] [LOCAL     ] BXMT: Saving primary data.
[2025-10-24T17:46:45.695283] [FATAL] [LOCAL     ] BXMT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:46:45.695391] [FATAL] [MAIN      ] BXMT: Failed to save primary data.
[2025-10-24T17:46:45.695509] [WARN ] [MAIN      ] BXMT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:46:45.695701] [INFO ] [LOCAL     ] BXMT: Starting deletion of primary data.
[2025-10-24T17:46:45.695770] [DEBUG] [LOCAL     ] BXMT: No primary data file found to delete.
[2025-10-24T17:46:45.695809] [INFO ] [LOCAL     ] BXMT: Starting deletion of derivative data.
[2025-10-24T17:46:45.696000] [DEBUG] [LOCAL     ] BXMT: Deleted derivative data file.
[2025-10-24T17:46:45.696446] [INFO ] [MAIN      ] Update Progress: 375/2366 symbols completed. BXMT took 41.1s. Estimated remaining: 4h 8m 1s. Rate: 8.0 symbols/min
[2025-10-24T17:46:45.749132] [INFO ] [REMOTE    ] BXP: Fetching primary data for 2025-08.
[2025-10-24T17:46:45.904836] [INFO ] [MAIN      ] BYD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:46:45.940083] [INFO ] [REMOTE    ] BXSL: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T17:46:45.999367] [DEBUG] [LOCAL     ] BYD: Loaded 45312 existing records from primary storage.
[2025-10-24T17:46:45.999711] [INFO ] [MAIN      ] BYD: Loaded 45312 existing records.
[2025-10-24T17:46:46.142500] [INFO ] [REMOTE    ] BY: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T17:46:46.199401] [WARN ] [MAIN      ] BYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:46:46.199664] [INFO ] [MAIN      ] BYD: Wiping existing primary data before full refresh.
[2025-10-24T17:46:46.199726] [INFO ] [LOCAL     ] BYD: Starting deletion of primary data.
[2025-10-24T17:46:46.200084] [DEBUG] [LOCAL     ] BYD: Deleted primary data file.
[2025-10-24T17:46:46.200123] [INFO ] [MAIN      ] BYD: Starting full primary refresh.
[2025-10-24T17:46:46.556392] [INFO ] [REMOTE    ] BY: Fetching primary data for 2025-02.
[2025-10-24T17:46:46.562151] [INFO ] [REMOTE    ] BYD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:46:47.089523] [INFO ] [REMOTE    ] BXP: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T17:46:47.337002] [INFO ] [REMOTE    ] BY: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T17:46:47.347589] [INFO ] [REMOTE    ] BY: Fetching primary data for 2025-03.
[2025-10-24T17:46:48.147702] [INFO ] [REMOTE    ] BYD: Fetching primary data for 2025-01.
[2025-10-24T17:46:48.463950] [INFO ] [REMOTE    ] BY: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T17:46:48.947720] [INFO ] [REMOTE    ] BXSL: Fetching primary data for 2025-05.
[2025-10-24T17:46:49.578989] [INFO ] [REMOTE    ] BYD: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T17:46:49.747683] [INFO ] [REMOTE    ] BYD: Fetching primary data for 2025-02.
[2025-10-24T17:46:50.079153] [INFO ] [REMOTE    ] BXSL: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T17:46:50.547668] [INFO ] [REMOTE    ] BXP: Fetching primary data for 2025-09.
[2025-10-24T17:46:51.305320] [INFO ] [REMOTE    ] BYD: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T17:46:51.347608] [INFO ] [REMOTE    ] BYD: Fetching primary data for 2025-03.
[2025-10-24T17:46:52.147628] [INFO ] [REMOTE    ] BY: Fetching primary data for 2025-04.
[2025-10-24T17:46:52.479090] [INFO ] [REMOTE    ] BXP: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T17:46:52.947605] [INFO ] [REMOTE    ] BXP: Fetching primary data for 2025-10.
[2025-10-24T17:46:53.054693] [INFO ] [REMOTE    ] BYD: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T17:46:53.198906] [INFO ] [REMOTE    ] BY: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T17:46:53.747703] [INFO ] [REMOTE    ] BY: Fetching primary data for 2025-05.
[2025-10-24T17:46:54.547679] [INFO ] [REMOTE    ] BYD: Fetching primary data for 2025-04.
[2025-10-24T17:46:54.641558] [INFO ] [REMOTE    ] BY: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T17:46:55.018454] [INFO ] [REMOTE    ] BXP: Incremental fetch complete for 2025-10 (2.07 seconds).
[2025-10-24T17:46:55.028698] [INFO ] [REMOTE    ] BXP: Full fetch complete (72203 records).
[2025-10-24T17:46:55.028853] [DEBUG] [VALIDATOR ] BXP: Validating primary data.
[2025-10-24T17:46:55.352783] [INFO ] [REMOTE    ] BXSL: Fetching primary data for 2025-06.
[2025-10-24T17:46:55.435593] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present.
[2025-10-24T17:46:55.435711] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed.
[2025-10-24T17:46:55.436524] [INFO ] [MAIN      ] BXP: Fetched primary data is valid.
[2025-10-24T17:46:55.436568] [DEBUG] [LOCAL     ] BXP: Saving primary data.
[2025-10-24T17:46:55.437193] [FATAL] [LOCAL     ] BXP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:46:55.440852] [FATAL] [MAIN      ] BXP: Failed to save primary data.
[2025-10-24T17:46:55.440993] [WARN ] [MAIN      ] BXP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:46:55.441043] [INFO ] [LOCAL     ] BXP: Starting deletion of primary data.
[2025-10-24T17:46:55.441105] [DEBUG] [LOCAL     ] BXP: No primary data file found to delete.
[2025-10-24T17:46:55.441163] [INFO ] [LOCAL     ] BXP: Starting deletion of derivative data.
[2025-10-24T17:46:55.441313] [DEBUG] [LOCAL     ] BXP: Deleted derivative data file.
[2025-10-24T17:46:55.441869] [INFO ] [MAIN      ] Update Progress: 376/2366 symbols completed. BXP took 31.1s. Estimated remaining: 4h 8m 6s. Rate: 8.0 symbols/min
[2025-10-24T17:46:55.615947] [INFO ] [MAIN      ] BYM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:46:55.629738] [DEBUG] [LOCAL     ] BYM: Loaded 11423 existing records from primary storage.
[2025-10-24T17:46:55.629969] [INFO ] [MAIN      ] BYM: Loaded 11423 existing records.
[2025-10-24T17:46:55.808155] [WARN ] [MAIN      ] BYM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:46:55.808456] [INFO ] [MAIN      ] BYM: Wiping existing primary data before full refresh.
[2025-10-24T17:46:55.808579] [INFO ] [LOCAL     ] BYM: Starting deletion of primary data.
[2025-10-24T17:46:55.808783] [DEBUG] [LOCAL     ] BYM: Deleted primary data file.
[2025-10-24T17:46:55.808839] [INFO ] [MAIN      ] BYM: Starting full primary refresh.
[2025-10-24T17:46:56.155518] [INFO ] [REMOTE    ] BY: Fetching primary data for 2025-06.
[2025-10-24T17:46:56.186094] [INFO ] [REMOTE    ] BYM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:46:56.197459] [INFO ] [REMOTE    ] BYD: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T17:46:56.947684] [INFO ] [REMOTE    ] BYM: Fetching primary data for 2025-01.
[2025-10-24T17:46:57.078184] [INFO ] [REMOTE    ] BXSL: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T17:46:57.216905] [INFO ] [REMOTE    ] BY: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T17:46:57.747734] [INFO ] [REMOTE    ] BY: Fetching primary data for 2025-07.
[2025-10-24T17:46:57.897098] [INFO ] [REMOTE    ] BYM: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T17:46:58.547682] [INFO ] [REMOTE    ] BYM: Fetching primary data for 2025-02.
[2025-10-24T17:46:58.855818] [INFO ] [REMOTE    ] BY: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T17:46:59.342478] [INFO ] [REMOTE    ] BYM: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T17:46:59.347596] [INFO ] [REMOTE    ] BYM: Fetching primary data for 2025-03.
[2025-10-24T17:47:00.147636] [INFO ] [REMOTE    ] BYD: Fetching primary data for 2025-05.
[2025-10-24T17:47:00.331712] [INFO ] [REMOTE    ] BYM: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T17:47:00.947668] [INFO ] [REMOTE    ] BXSL: Fetching primary data for 2025-07.
[2025-10-24T17:47:01.747732] [INFO ] [REMOTE    ] BY: Fetching primary data for 2025-08.
[2025-10-24T17:47:02.072783] [INFO ] [REMOTE    ] BYD: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T17:47:02.547699] [INFO ] [REMOTE    ] BYD: Fetching primary data for 2025-06.
[2025-10-24T17:47:02.761715] [INFO ] [REMOTE    ] BXSL: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T17:47:03.347729] [INFO ] [REMOTE    ] BXSL: Fetching primary data for 2025-08.
[2025-10-24T17:47:03.598415] [INFO ] [REMOTE    ] BY: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T17:47:04.147721] [INFO ] [REMOTE    ] BYM: Fetching primary data for 2025-04.
[2025-10-24T17:47:04.326144] [INFO ] [REMOTE    ] BYD: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T17:47:04.944394] [INFO ] [REMOTE    ] BXSL: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T17:47:04.954622] [INFO ] [REMOTE    ] BY: Fetching primary data for 2025-09.
[2025-10-24T17:47:05.085907] [INFO ] [REMOTE    ] BYM: Incremental fetch complete for 2025-04 (0.94 seconds).
[2025-10-24T17:47:05.734983] [INFO ] [REMOTE    ] BY: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T17:47:05.747604] [INFO ] [REMOTE    ] BY: Fetching primary data for 2025-10.
[2025-10-24T17:47:06.547715] [INFO ] [REMOTE    ] BXSL: Fetching primary data for 2025-09.
[2025-10-24T17:47:06.958076] [INFO ] [REMOTE    ] BY: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T17:47:06.962276] [INFO ] [REMOTE    ] BY: Full fetch complete (29691 records).
[2025-10-24T17:47:06.962378] [DEBUG] [VALIDATOR ] BY: Validating primary data.
[2025-10-24T17:47:07.346538] [DEBUG] [VALIDATOR ] BY: All expected trading days are present.
[2025-10-24T17:47:07.346617] [DEBUG] [VALIDATOR ] BY: Primary data validation passed.
[2025-10-24T17:47:07.347167] [INFO ] [MAIN      ] BY: Fetched primary data is valid.
[2025-10-24T17:47:07.347224] [DEBUG] [LOCAL     ] BY: Saving primary data.
[2025-10-24T17:47:07.347557] [FATAL] [LOCAL     ] BY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:47:07.347692] [INFO ] [REMOTE    ] BYD: Fetching primary data for 2025-07.
[2025-10-24T17:47:07.347935] [FATAL] [MAIN      ] BY: Failed to save primary data.
[2025-10-24T17:47:07.348153] [WARN ] [MAIN      ] BY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:47:07.349079] [INFO ] [LOCAL     ] BY: Starting deletion of primary data.
[2025-10-24T17:47:07.349145] [DEBUG] [LOCAL     ] BY: No primary data file found to delete.
[2025-10-24T17:47:07.349184] [INFO ] [LOCAL     ] BY: Starting deletion of derivative data.
[2025-10-24T17:47:07.349317] [DEBUG] [LOCAL     ] BY: Deleted derivative data file.
[2025-10-24T17:47:07.349420] [INFO ] [MAIN      ] Update Progress: 377/2366 symbols completed. BY took 24.4s. Estimated remaining: 4h 8m 21s. Rate: 8.0 symbols/min
[2025-10-24T17:47:07.515953] [INFO ] [MAIN      ] BZH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:47:07.547348] [DEBUG] [LOCAL     ] BZH: Loaded 32220 existing records from primary storage.
[2025-10-24T17:47:07.547603] [INFO ] [MAIN      ] BZH: Loaded 32220 existing records.
[2025-10-24T17:47:07.722505] [WARN ] [MAIN      ] BZH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:47:07.722700] [INFO ] [MAIN      ] BZH: Wiping existing primary data before full refresh.
[2025-10-24T17:47:07.722755] [INFO ] [LOCAL     ] BZH: Starting deletion of primary data.
[2025-10-24T17:47:07.722926] [DEBUG] [LOCAL     ] BZH: Deleted primary data file.
[2025-10-24T17:47:07.722963] [INFO ] [MAIN      ] BZH: Starting full primary refresh.
[2025-10-24T17:47:08.101536] [INFO ] [REMOTE    ] BZH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:47:08.147615] [INFO ] [REMOTE    ] BZH: Fetching primary data for 2025-01.
[2025-10-24T17:47:08.364202] [INFO ] [REMOTE    ] BXSL: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T17:47:08.947712] [INFO ] [REMOTE    ] BXSL: Fetching primary data for 2025-10.
[2025-10-24T17:47:09.028194] [INFO ] [REMOTE    ] BYD: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T17:47:09.512437] [INFO ] [REMOTE    ] BZH: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T17:47:09.747692] [INFO ] [REMOTE    ] BZH: Fetching primary data for 2025-02.
[2025-10-24T17:47:10.547750] [INFO ] [REMOTE    ] BYD: Fetching primary data for 2025-08.
[2025-10-24T17:47:10.935935] [INFO ] [REMOTE    ] BXSL: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T17:47:10.945801] [INFO ] [REMOTE    ] BXSL: Full fetch complete (70088 records).
[2025-10-24T17:47:10.945996] [DEBUG] [VALIDATOR ] BXSL: Validating primary data.
[2025-10-24T17:47:11.359702] [INFO ] [REMOTE    ] BYM: Fetching primary data for 2025-05.
[2025-10-24T17:47:11.363539] [INFO ] [REMOTE    ] BZH: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T17:47:11.395921] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present.
[2025-10-24T17:47:11.396108] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed.
[2025-10-24T17:47:11.397313] [INFO ] [MAIN      ] BXSL: Fetched primary data is valid.
[2025-10-24T17:47:11.397397] [DEBUG] [LOCAL     ] BXSL: Saving primary data.
[2025-10-24T17:47:11.397996] [FATAL] [LOCAL     ] BXSL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:47:11.398292] [FATAL] [MAIN      ] BXSL: Failed to save primary data.
[2025-10-24T17:47:11.398444] [WARN ] [MAIN      ] BXSL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:47:11.398526] [INFO ] [LOCAL     ] BXSL: Starting deletion of primary data.
[2025-10-24T17:47:11.398604] [DEBUG] [LOCAL     ] BXSL: No primary data file found to delete.
[2025-10-24T17:47:11.398691] [INFO ] [LOCAL     ] BXSL: Starting deletion of derivative data.
[2025-10-24T17:47:11.398864] [DEBUG] [LOCAL     ] BXSL: Deleted derivative data file.
[2025-10-24T17:47:11.399220] [INFO ] [MAIN      ] Update Progress: 378/2366 symbols completed. BXSL took 41.7s. Estimated remaining: 4h 7m 56s. Rate: 8.0 symbols/min
[2025-10-24T17:47:11.577316] [INFO ] [MAIN      ] C: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:47:11.577507] [DEBUG] [LOCAL     ] C: No existing data file found in primary storage.
[2025-10-24T17:47:11.577545] [WARN ] [MAIN      ] C: No existing data found, performing full refresh instead.
[2025-10-24T17:47:11.577686] [INFO ] [MAIN      ] C: Wiping existing primary data before full refresh.
[2025-10-24T17:47:11.577748] [INFO ] [LOCAL     ] C: Starting deletion of primary data.
[2025-10-24T17:47:11.577797] [DEBUG] [LOCAL     ] C: No primary data file found to delete.
[2025-10-24T17:47:11.577831] [INFO ] [MAIN      ] C: Starting full primary refresh.
[2025-10-24T17:47:11.938850] [INFO ] [REMOTE    ] C: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:47:11.968267] [INFO ] [REMOTE    ] BYD: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T17:47:12.147726] [INFO ] [REMOTE    ] C: Fetching primary data for 2025-01.
[2025-10-24T17:47:12.240887] [INFO ] [REMOTE    ] BYM: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T17:47:12.947751] [INFO ] [REMOTE    ] BYD: Fetching primary data for 2025-09.
[2025-10-24T17:47:13.747748] [INFO ] [REMOTE    ] BYM: Fetching primary data for 2025-06.
[2025-10-24T17:47:14.095796] [INFO ] [REMOTE    ] C: Incremental fetch complete for 2025-01 (1.95 seconds).
[2025-10-24T17:47:14.430734] [INFO ] [REMOTE    ] BYM: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T17:47:14.499583] [INFO ] [REMOTE    ] BYD: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T17:47:14.547615] [INFO ] [REMOTE    ] BYD: Fetching primary data for 2025-10.
[2025-10-24T17:47:15.347707] [INFO ] [REMOTE    ] BZH: Fetching primary data for 2025-03.
[2025-10-24T17:47:16.147695] [INFO ] [REMOTE    ] C: Fetching primary data for 2025-02.
[2025-10-24T17:47:16.303685] [INFO ] [REMOTE    ] BYD: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T17:47:16.312677] [INFO ] [REMOTE    ] BYD: Full fetch complete (65570 records).
[2025-10-24T17:47:16.312831] [DEBUG] [VALIDATOR ] BYD: Validating primary data.
[2025-10-24T17:47:16.693081] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present.
[2025-10-24T17:47:16.693209] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed.
[2025-10-24T17:47:16.693986] [INFO ] [MAIN      ] BYD: Fetched primary data is valid.
[2025-10-24T17:47:16.694093] [DEBUG] [LOCAL     ] BYD: Saving primary data.
[2025-10-24T17:47:16.694750] [FATAL] [LOCAL     ] BYD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:47:16.694952] [FATAL] [MAIN      ] BYD: Failed to save primary data.
[2025-10-24T17:47:16.695022] [WARN ] [MAIN      ] BYD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:47:16.695066] [INFO ] [LOCAL     ] BYD: Starting deletion of primary data.
[2025-10-24T17:47:16.695122] [DEBUG] [LOCAL     ] BYD: No primary data file found to delete.
[2025-10-24T17:47:16.695157] [INFO ] [LOCAL     ] BYD: Starting deletion of derivative data.
[2025-10-24T17:47:16.695289] [DEBUG] [LOCAL     ] BYD: Deleted derivative data file.
[2025-10-24T17:47:16.695786] [INFO ] [MAIN      ] Update Progress: 379/2366 symbols completed. BYD took 31.0s. Estimated remaining: 4h 7m 37s. Rate: 8.0 symbols/min
[2025-10-24T17:47:16.867841] [INFO ] [MAIN      ] CAAP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:47:16.887726] [INFO ] [REMOTE    ] BZH: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T17:47:16.910109] [DEBUG] [LOCAL     ] CAAP: Loaded 20016 existing records from primary storage.
[2025-10-24T17:47:16.910358] [INFO ] [MAIN      ] CAAP: Loaded 20016 existing records.
[2025-10-24T17:47:16.952793] [INFO ] [REMOTE    ] BZH: Fetching primary data for 2025-04.
[2025-10-24T17:47:17.097296] [WARN ] [MAIN      ] CAAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:47:17.097558] [INFO ] [MAIN      ] CAAP: Wiping existing primary data before full refresh.
[2025-10-24T17:47:17.097620] [INFO ] [LOCAL     ] CAAP: Starting deletion of primary data.
[2025-10-24T17:47:17.097905] [DEBUG] [LOCAL     ] CAAP: Deleted primary data file.
[2025-10-24T17:47:17.097962] [INFO ] [MAIN      ] CAAP: Starting full primary refresh.
[2025-10-24T17:47:17.459434] [INFO ] [REMOTE    ] CAAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:47:17.645210] [INFO ] [REMOTE    ] C: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T17:47:17.747615] [INFO ] [REMOTE    ] C: Fetching primary data for 2025-03.
[2025-10-24T17:47:18.481829] [INFO ] [REMOTE    ] BZH: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T17:47:18.547624] [INFO ] [REMOTE    ] BZH: Fetching primary data for 2025-05.
[2025-10-24T17:47:19.347719] [INFO ] [REMOTE    ] CAAP: Fetching primary data for 2025-01.
[2025-10-24T17:47:19.408324] [INFO ] [REMOTE    ] C: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T17:47:19.990057] [INFO ] [REMOTE    ] BZH: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T17:47:20.147704] [INFO ] [REMOTE    ] BZH: Fetching primary data for 2025-06.
[2025-10-24T17:47:20.357479] [INFO ] [REMOTE    ] CAAP: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T17:47:20.947687] [INFO ] [REMOTE    ] CAAP: Fetching primary data for 2025-02.
[2025-10-24T17:47:21.070694] [INFO ] [REMOTE    ] BZH: Incremental fetch complete for 2025-06 (0.92 seconds).
[2025-10-24T17:47:21.614349] [INFO ] [REMOTE    ] CAAP: Incremental fetch complete for 2025-02 (0.67 seconds).
[2025-10-24T17:47:21.747669] [INFO ] [REMOTE    ] BYM: Fetching primary data for 2025-07.
[2025-10-24T17:47:22.547611] [INFO ] [REMOTE    ] BZH: Fetching primary data for 2025-07.
[2025-10-24T17:47:22.693200] [INFO ] [REMOTE    ] BYM: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T17:47:23.347700] [INFO ] [REMOTE    ] BYM: Fetching primary data for 2025-08.
[2025-10-24T17:47:23.630585] [INFO ] [REMOTE    ] BZH: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T17:47:24.097040] [INFO ] [REMOTE    ] BYM: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T17:47:24.147732] [INFO ] [REMOTE    ] CAAP: Fetching primary data for 2025-03.
[2025-10-24T17:47:24.947702] [INFO ] [REMOTE    ] C: Fetching primary data for 2025-04.
[2025-10-24T17:47:25.223561] [INFO ] [REMOTE    ] CAAP: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T17:47:25.747734] [INFO ] [REMOTE    ] CAAP: Fetching primary data for 2025-04.
[2025-10-24T17:47:26.547740] [INFO ] [REMOTE    ] BZH: Fetching primary data for 2025-08.
[2025-10-24T17:47:26.713621] [INFO ] [REMOTE    ] CAAP: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T17:47:27.186291] [INFO ] [REMOTE    ] C: Incremental fetch complete for 2025-04 (2.24 seconds).
[2025-10-24T17:47:27.347620] [INFO ] [REMOTE    ] C: Fetching primary data for 2025-05.
[2025-10-24T17:47:27.410300] [INFO ] [REMOTE    ] BZH: Incremental fetch complete for 2025-08 (0.86 seconds).
[2025-10-24T17:47:28.147873] [INFO ] [REMOTE    ] BZH: Fetching primary data for 2025-09.
[2025-10-24T17:47:28.947629] [INFO ] [REMOTE    ] BYM: Fetching primary data for 2025-09.
[2025-10-24T17:47:29.230096] [INFO ] [REMOTE    ] BZH: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T17:47:29.277703] [INFO ] [REMOTE    ] C: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T17:47:29.456180] [INFO ] [REMOTE    ] BYM: Incremental fetch complete for 2025-09 (0.51 seconds).
[2025-10-24T17:47:29.747708] [INFO ] [REMOTE    ] C: Fetching primary data for 2025-06.
[2025-10-24T17:47:30.547671] [INFO ] [REMOTE    ] BZH: Fetching primary data for 2025-10.
[2025-10-24T17:47:31.347707] [INFO ] [REMOTE    ] CAAP: Fetching primary data for 2025-05.
[2025-10-24T17:47:31.508368] [INFO ] [REMOTE    ] C: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T17:47:31.900360] [INFO ] [REMOTE    ] BZH: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T17:47:31.905758] [INFO ] [REMOTE    ] BZH: Full fetch complete (47152 records).
[2025-10-24T17:47:31.905858] [DEBUG] [VALIDATOR ] BZH: Validating primary data.
[2025-10-24T17:47:32.152738] [INFO ] [REMOTE    ] BYM: Fetching primary data for 2025-10.
[2025-10-24T17:47:32.290458] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present.
[2025-10-24T17:47:32.290543] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed.
[2025-10-24T17:47:32.291421] [INFO ] [MAIN      ] BZH: Fetched primary data is valid.
[2025-10-24T17:47:32.291509] [DEBUG] [LOCAL     ] BZH: Saving primary data.
[2025-10-24T17:47:32.292062] [FATAL] [LOCAL     ] BZH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:47:32.292147] [FATAL] [MAIN      ] BZH: Failed to save primary data.
[2025-10-24T17:47:32.292189] [WARN ] [MAIN      ] BZH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:47:32.292252] [INFO ] [LOCAL     ] BZH: Starting deletion of primary data.
[2025-10-24T17:47:32.292314] [DEBUG] [LOCAL     ] BZH: No primary data file found to delete.
[2025-10-24T17:47:32.292350] [INFO ] [LOCAL     ] BZH: Starting deletion of derivative data.
[2025-10-24T17:47:32.292507] [DEBUG] [LOCAL     ] BZH: Deleted derivative data file.
[2025-10-24T17:47:32.292602] [INFO ] [MAIN      ] Update Progress: 380/2366 symbols completed. BZH took 24.9s. Estimated remaining: 4h 8m 12s. Rate: 8.0 symbols/min
[2025-10-24T17:47:32.478419] [INFO ] [MAIN      ] CABO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:47:32.479783] [INFO ] [REMOTE    ] CAAP: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T17:47:32.500350] [DEBUG] [LOCAL     ] CABO: Loaded 16738 existing records from primary storage.
[2025-10-24T17:47:32.500608] [INFO ] [MAIN      ] CABO: Loaded 16738 existing records.
[2025-10-24T17:47:32.680927] [WARN ] [MAIN      ] CABO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:47:32.681186] [INFO ] [MAIN      ] CABO: Wiping existing primary data before full refresh.
[2025-10-24T17:47:32.681242] [INFO ] [LOCAL     ] CABO: Starting deletion of primary data.
[2025-10-24T17:47:32.681399] [DEBUG] [LOCAL     ] CABO: Deleted primary data file.
[2025-10-24T17:47:32.681440] [INFO ] [MAIN      ] CABO: Starting full primary refresh.
[2025-10-24T17:47:32.961225] [INFO ] [REMOTE    ] CAAP: Fetching primary data for 2025-06.
[2025-10-24T17:47:33.046402] [INFO ] [REMOTE    ] CABO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:47:33.175852] [INFO ] [REMOTE    ] BYM: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T17:47:33.178328] [INFO ] [REMOTE    ] BYM: Full fetch complete (17197 records).
[2025-10-24T17:47:33.178402] [DEBUG] [VALIDATOR ] BYM: Validating primary data.
[2025-10-24T17:47:33.539193] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present.
[2025-10-24T17:47:33.539267] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed.
[2025-10-24T17:47:33.539606] [INFO ] [MAIN      ] BYM: Fetched primary data is valid.
[2025-10-24T17:47:33.539665] [DEBUG] [LOCAL     ] BYM: Saving primary data.
[2025-10-24T17:47:33.539925] [FATAL] [LOCAL     ] BYM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:47:33.540009] [FATAL] [MAIN      ] BYM: Failed to save primary data.
[2025-10-24T17:47:33.540051] [WARN ] [MAIN      ] BYM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:47:33.540086] [INFO ] [LOCAL     ] BYM: Starting deletion of primary data.
[2025-10-24T17:47:33.540153] [DEBUG] [LOCAL     ] BYM: No primary data file found to delete.
[2025-10-24T17:47:33.540187] [INFO ] [LOCAL     ] BYM: Starting deletion of derivative data.
[2025-10-24T17:47:33.540331] [DEBUG] [LOCAL     ] BYM: Deleted derivative data file.
[2025-10-24T17:47:33.540418] [INFO ] [MAIN      ] Update Progress: 381/2366 symbols completed. BYM took 38.1s. Estimated remaining: 4h 7m 32s. Rate: 8.0 symbols/min
[2025-10-24T17:47:33.709937] [INFO ] [MAIN      ] CACI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:47:33.732288] [DEBUG] [LOCAL     ] CACI: Loaded 22671 existing records from primary storage.
[2025-10-24T17:47:33.732533] [INFO ] [MAIN      ] CACI: Loaded 22671 existing records.
[2025-10-24T17:47:33.752836] [INFO ] [REMOTE    ] CABO: Fetching primary data for 2025-01.
[2025-10-24T17:47:33.926782] [WARN ] [MAIN      ] CACI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:47:33.927762] [INFO ] [REMOTE    ] CAAP: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T17:47:33.931750] [INFO ] [MAIN      ] CACI: Wiping existing primary data before full refresh.
[2025-10-24T17:47:33.931841] [INFO ] [LOCAL     ] CACI: Starting deletion of primary data.
[2025-10-24T17:47:33.932325] [DEBUG] [LOCAL     ] CACI: Deleted primary data file.
[2025-10-24T17:47:33.932382] [INFO ] [MAIN      ] CACI: Starting full primary refresh.
[2025-10-24T17:47:34.285709] [INFO ] [REMOTE    ] CACI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:47:34.547616] [INFO ] [REMOTE    ] CAAP: Fetching primary data for 2025-07.
[2025-10-24T17:47:34.646867] [INFO ] [REMOTE    ] CABO: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T17:47:35.347628] [INFO ] [REMOTE    ] CACI: Fetching primary data for 2025-01.
[2025-10-24T17:47:35.559219] [INFO ] [REMOTE    ] CAAP: Incremental fetch complete for 2025-07 (1.01 seconds).
[2025-10-24T17:47:36.147672] [INFO ] [REMOTE    ] CAAP: Fetching primary data for 2025-08.
[2025-10-24T17:47:36.697416] [INFO ] [REMOTE    ] CACI: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T17:47:36.849471] [INFO ] [REMOTE    ] CAAP: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T17:47:36.947625] [INFO ] [REMOTE    ] CAAP: Fetching primary data for 2025-09.
[2025-10-24T17:47:37.747616] [INFO ] [REMOTE    ] CABO: Fetching primary data for 2025-02.
[2025-10-24T17:47:38.126440] [INFO ] [REMOTE    ] CAAP: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T17:47:38.547615] [INFO ] [REMOTE    ] CAAP: Fetching primary data for 2025-10.
[2025-10-24T17:47:38.612450] [INFO ] [REMOTE    ] CABO: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T17:47:39.347611] [INFO ] [REMOTE    ] CACI: Fetching primary data for 2025-02.
[2025-10-24T17:47:39.739670] [INFO ] [REMOTE    ] CAAP: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T17:47:39.744045] [INFO ] [REMOTE    ] CAAP: Full fetch complete (28018 records).
[2025-10-24T17:47:39.744125] [DEBUG] [VALIDATOR ] CAAP: Validating primary data.
[2025-10-24T17:47:40.113673] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present.
[2025-10-24T17:47:40.113774] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed.
[2025-10-24T17:47:40.114281] [INFO ] [MAIN      ] CAAP: Fetched primary data is valid.
[2025-10-24T17:47:40.114396] [DEBUG] [LOCAL     ] CAAP: Saving primary data.
[2025-10-24T17:47:40.114927] [FATAL] [LOCAL     ] CAAP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:47:40.115031] [FATAL] [MAIN      ] CAAP: Failed to save primary data.
[2025-10-24T17:47:40.115116] [WARN ] [MAIN      ] CAAP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:47:40.115206] [INFO ] [LOCAL     ] CAAP: Starting deletion of primary data.
[2025-10-24T17:47:40.115322] [DEBUG] [LOCAL     ] CAAP: No primary data file found to delete.
[2025-10-24T17:47:40.115378] [INFO ] [LOCAL     ] CAAP: Starting deletion of derivative data.
[2025-10-24T17:47:40.115541] [DEBUG] [LOCAL     ] CAAP: Deleted derivative data file.
[2025-10-24T17:47:40.115676] [INFO ] [MAIN      ] Update Progress: 382/2366 symbols completed. CAAP took 23.4s. Estimated remaining: 4h 7m 20s. Rate: 8.0 symbols/min
[2025-10-24T17:47:40.152799] [INFO ] [REMOTE    ] C: Fetching primary data for 2025-07.
[2025-10-24T17:47:40.290348] [INFO ] [MAIN      ] CADE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:47:40.335477] [DEBUG] [LOCAL     ] CADE: Loaded 50063 existing records from primary storage.
[2025-10-24T17:47:40.335825] [INFO ] [MAIN      ] CADE: Loaded 50063 existing records.
[2025-10-24T17:47:40.524273] [WARN ] [MAIN      ] CADE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:47:40.524567] [INFO ] [MAIN      ] CADE: Wiping existing primary data before full refresh.
[2025-10-24T17:47:40.524668] [INFO ] [LOCAL     ] CADE: Starting deletion of primary data.
[2025-10-24T17:47:40.525330] [DEBUG] [LOCAL     ] CADE: Deleted primary data file.
[2025-10-24T17:47:40.525392] [INFO ] [MAIN      ] CADE: Starting full primary refresh.
[2025-10-24T17:47:40.651501] [INFO ] [REMOTE    ] CACI: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T17:47:40.909146] [INFO ] [REMOTE    ] CADE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:47:40.947601] [INFO ] [REMOTE    ] CADE: Fetching primary data for 2025-01.
[2025-10-24T17:47:41.747688] [INFO ] [REMOTE    ] CABO: Fetching primary data for 2025-03.
[2025-10-24T17:47:42.547726] [INFO ] [REMOTE    ] CACI: Fetching primary data for 2025-03.
[2025-10-24T17:47:42.664265] [INFO ] [REMOTE    ] C: Incremental fetch complete for 2025-07 (2.51 seconds).
[2025-10-24T17:47:42.751339] [INFO ] [REMOTE    ] CADE: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T17:47:42.819172] [INFO ] [REMOTE    ] CABO: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T17:47:43.347706] [INFO ] [REMOTE    ] C: Fetching primary data for 2025-08.
[2025-10-24T17:47:43.980567] [INFO ] [REMOTE    ] CACI: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T17:47:44.147695] [INFO ] [REMOTE    ] CABO: Fetching primary data for 2025-04.
[2025-10-24T17:47:44.948615] [INFO ] [REMOTE    ] CACI: Fetching primary data for 2025-04.
[2025-10-24T17:47:44.950013] [INFO ] [REMOTE    ] CABO: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T17:47:45.173118] [INFO ] [REMOTE    ] C: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T17:47:45.747704] [INFO ] [REMOTE    ] C: Fetching primary data for 2025-09.
[2025-10-24T17:47:46.181895] [INFO ] [REMOTE    ] CACI: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T17:47:46.547622] [INFO ] [REMOTE    ] CABO: Fetching primary data for 2025-05.
[2025-10-24T17:47:47.347612] [INFO ] [REMOTE    ] CADE: Fetching primary data for 2025-02.
[2025-10-24T17:47:47.667177] [INFO ] [REMOTE    ] CABO: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T17:47:47.924096] [INFO ] [REMOTE    ] C: Incremental fetch complete for 2025-09 (2.18 seconds).
[2025-10-24T17:47:48.147677] [INFO ] [REMOTE    ] C: Fetching primary data for 2025-10.
[2025-10-24T17:47:48.702493] [INFO ] [REMOTE    ] CADE: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T17:47:48.947679] [INFO ] [REMOTE    ] CACI: Fetching primary data for 2025-05.
[2025-10-24T17:47:49.747613] [INFO ] [REMOTE    ] CADE: Fetching primary data for 2025-03.
[2025-10-24T17:47:50.163160] [INFO ] [REMOTE    ] CACI: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T17:47:50.518550] [INFO ] [REMOTE    ] C: Incremental fetch complete for 2025-10 (2.37 seconds).
[2025-10-24T17:47:50.528386] [INFO ] [REMOTE    ] C: Full fetch complete (77918 records).
[2025-10-24T17:47:50.528519] [DEBUG] [VALIDATOR ] C: Validating primary data.
[2025-10-24T17:47:50.559544] [INFO ] [REMOTE    ] CACI: Fetching primary data for 2025-06.
[2025-10-24T17:47:50.913730] [DEBUG] [VALIDATOR ] C: All expected trading days are present.
[2025-10-24T17:47:50.913810] [DEBUG] [VALIDATOR ] C: Primary data validation passed.
[2025-10-24T17:47:50.914666] [INFO ] [MAIN      ] C: Fetched primary data is valid.
[2025-10-24T17:47:50.914729] [DEBUG] [LOCAL     ] C: Saving primary data.
[2025-10-24T17:47:50.915314] [FATAL] [LOCAL     ] C: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:47:50.915409] [FATAL] [MAIN      ] C: Failed to save primary data.
[2025-10-24T17:47:50.915450] [WARN ] [MAIN      ] C: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:47:50.915484] [INFO ] [LOCAL     ] C: Starting deletion of primary data.
[2025-10-24T17:47:50.915535] [DEBUG] [LOCAL     ] C: No primary data file found to delete.
[2025-10-24T17:47:50.915569] [INFO ] [LOCAL     ] C: Starting deletion of derivative data.
[2025-10-24T17:47:50.915606] [DEBUG] [LOCAL     ] C: No derivative data file found to delete.
[2025-10-24T17:47:50.915843] [INFO ] [MAIN      ] Update Progress: 383/2366 symbols completed. C took 39.5s. Estimated remaining: 4h 7m 29s. Rate: 8.0 symbols/min
[2025-10-24T17:47:51.086389] [INFO ] [MAIN      ] CAE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:47:51.123762] [DEBUG] [LOCAL     ] CAE: Loaded 39307 existing records from primary storage.
[2025-10-24T17:47:51.124031] [INFO ] [MAIN      ] CAE: Loaded 39307 existing records.
[2025-10-24T17:47:51.300028] [WARN ] [MAIN      ] CAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:47:51.300242] [INFO ] [MAIN      ] CAE: Wiping existing primary data before full refresh.
[2025-10-24T17:47:51.300415] [INFO ] [LOCAL     ] CAE: Starting deletion of primary data.
[2025-10-24T17:47:51.300734] [DEBUG] [LOCAL     ] CAE: Deleted primary data file.
[2025-10-24T17:47:51.300837] [INFO ] [MAIN      ] CAE: Starting full primary refresh.
[2025-10-24T17:47:51.355473] [INFO ] [REMOTE    ] CABO: Fetching primary data for 2025-06.
[2025-10-24T17:47:51.618877] [INFO ] [REMOTE    ] CADE: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T17:47:51.694808] [INFO ] [REMOTE    ] CAE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:47:51.709213] [INFO ] [REMOTE    ] CACI: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T17:47:52.147614] [INFO ] [REMOTE    ] CADE: Fetching primary data for 2025-04.
[2025-10-24T17:47:52.473271] [INFO ] [REMOTE    ] CABO: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T17:47:52.947720] [INFO ] [REMOTE    ] CACI: Fetching primary data for 2025-07.
[2025-10-24T17:47:53.564631] [INFO ] [REMOTE    ] CADE: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T17:47:53.747630] [INFO ] [REMOTE    ] CAE: Fetching primary data for 2025-01.
[2025-10-24T17:47:53.975389] [INFO ] [REMOTE    ] CACI: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T17:47:54.547673] [INFO ] [REMOTE    ] CACI: Fetching primary data for 2025-08.
[2025-10-24T17:47:54.908465] [INFO ] [REMOTE    ] CAE: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T17:47:55.347633] [INFO ] [REMOTE    ] CADE: Fetching primary data for 2025-05.
[2025-10-24T17:47:55.756635] [INFO ] [REMOTE    ] CACI: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T17:47:56.147717] [INFO ] [REMOTE    ] CACI: Fetching primary data for 2025-09.
[2025-10-24T17:47:56.868944] [INFO ] [REMOTE    ] CADE: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T17:47:56.947620] [INFO ] [REMOTE    ] CADE: Fetching primary data for 2025-06.
[2025-10-24T17:47:57.150077] [INFO ] [REMOTE    ] CACI: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T17:47:57.747667] [INFO ] [REMOTE    ] CACI: Fetching primary data for 2025-10.
[2025-10-24T17:47:58.397463] [INFO ] [REMOTE    ] CADE: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T17:47:58.547696] [INFO ] [REMOTE    ] CAE: Fetching primary data for 2025-02.
[2025-10-24T17:47:58.852407] [INFO ] [REMOTE    ] CACI: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T17:47:58.856894] [INFO ] [REMOTE    ] CACI: Full fetch complete (38524 records).
[2025-10-24T17:47:58.856999] [DEBUG] [VALIDATOR ] CACI: Validating primary data.
[2025-10-24T17:47:59.276137] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present.
[2025-10-24T17:47:59.276263] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed.
[2025-10-24T17:47:59.277200] [INFO ] [MAIN      ] CACI: Fetched primary data is valid.
[2025-10-24T17:47:59.277294] [DEBUG] [LOCAL     ] CACI: Saving primary data.
[2025-10-24T17:47:59.278058] [FATAL] [LOCAL     ] CACI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:47:59.278281] [FATAL] [MAIN      ] CACI: Failed to save primary data.
[2025-10-24T17:47:59.278435] [WARN ] [MAIN      ] CACI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:47:59.278509] [INFO ] [LOCAL     ] CACI: Starting deletion of primary data.
[2025-10-24T17:47:59.278582] [DEBUG] [LOCAL     ] CACI: No primary data file found to delete.
[2025-10-24T17:47:59.278621] [INFO ] [LOCAL     ] CACI: Starting deletion of derivative data.
[2025-10-24T17:47:59.278836] [DEBUG] [LOCAL     ] CACI: Deleted derivative data file.
[2025-10-24T17:47:59.278949] [INFO ] [MAIN      ] Update Progress: 384/2366 symbols completed. CACI took 25.7s. Estimated remaining: 4h 7m 26s. Rate: 8.0 symbols/min
[2025-10-24T17:47:59.355588] [INFO ] [REMOTE    ] CADE: Fetching primary data for 2025-07.
[2025-10-24T17:47:59.478051] [INFO ] [MAIN      ] CAF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:47:59.485291] [DEBUG] [LOCAL     ] CAF: Loaded 3501 existing records from primary storage.
[2025-10-24T17:47:59.485527] [INFO ] [MAIN      ] CAF: Loaded 3501 existing records.
[2025-10-24T17:47:59.687180] [WARN ] [MAIN      ] CAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:47:59.687499] [INFO ] [MAIN      ] CAF: Wiping existing primary data before full refresh.
[2025-10-24T17:47:59.687551] [INFO ] [LOCAL     ] CAF: Starting deletion of primary data.
[2025-10-24T17:47:59.687796] [DEBUG] [LOCAL     ] CAF: Deleted primary data file.
[2025-10-24T17:47:59.687854] [INFO ] [MAIN      ] CAF: Starting full primary refresh.
[2025-10-24T17:48:00.100343] [INFO ] [REMOTE    ] CAE: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T17:48:00.120149] [INFO ] [REMOTE    ] CAF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:48:00.147608] [INFO ] [REMOTE    ] CAF: Fetching primary data for 2025-01.
[2025-10-24T17:48:00.947719] [INFO ] [REMOTE    ] CAE: Fetching primary data for 2025-03.
[2025-10-24T17:48:01.233693] [INFO ] [REMOTE    ] CAF: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T17:48:01.747730] [INFO ] [REMOTE    ] CAF: Fetching primary data for 2025-02.
[2025-10-24T17:48:02.079792] [INFO ] [REMOTE    ] CADE: Incremental fetch complete for 2025-07 (2.72 seconds).
[2025-10-24T17:48:02.547723] [INFO ] [REMOTE    ] CADE: Fetching primary data for 2025-08.
[2025-10-24T17:48:03.045870] [INFO ] [REMOTE    ] CAF: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T17:48:03.323058] [INFO ] [REMOTE    ] CAE: Incremental fetch complete for 2025-03 (2.38 seconds).
[2025-10-24T17:48:03.347606] [INFO ] [REMOTE    ] CAE: Fetching primary data for 2025-04.
[2025-10-24T17:48:04.147717] [INFO ] [REMOTE    ] CAF: Fetching primary data for 2025-03.
[2025-10-24T17:48:04.841098] [INFO ] [REMOTE    ] CAF: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T17:48:04.948359] [INFO ] [REMOTE    ] CAF: Fetching primary data for 2025-04.
[2025-10-24T17:48:04.952111] [INFO ] [REMOTE    ] CAE: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T17:48:04.995067] [INFO ] [REMOTE    ] CADE: Incremental fetch complete for 2025-08 (2.45 seconds).
[2025-10-24T17:48:05.584481] [INFO ] [REMOTE    ] CAF: Incremental fetch complete for 2025-04 (0.64 seconds).
[2025-10-24T17:48:05.747670] [INFO ] [REMOTE    ] CAE: Fetching primary data for 2025-05.
[2025-10-24T17:48:06.547684] [INFO ] [REMOTE    ] CAF: Fetching primary data for 2025-05.
[2025-10-24T17:48:06.842863] [INFO ] [REMOTE    ] CAE: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T17:48:07.123394] [INFO ] [REMOTE    ] CAF: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T17:48:07.347670] [INFO ] [REMOTE    ] CAF: Fetching primary data for 2025-06.
[2025-10-24T17:48:07.830261] [INFO ] [REMOTE    ] CAF: Incremental fetch complete for 2025-06 (0.48 seconds).
[2025-10-24T17:48:08.147639] [INFO ] [REMOTE    ] CAE: Fetching primary data for 2025-06.
[2025-10-24T17:48:08.947678] [INFO ] [REMOTE    ] CABO: Fetching primary data for 2025-07.
[2025-10-24T17:48:09.198057] [INFO ] [REMOTE    ] CAE: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T17:48:09.747676] [INFO ] [REMOTE    ] CADE: Fetching primary data for 2025-09.
[2025-10-24T17:48:09.797058] [INFO ] [REMOTE    ] CABO: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T17:48:10.547697] [INFO ] [REMOTE    ] CABO: Fetching primary data for 2025-08.
[2025-10-24T17:48:11.347673] [INFO ] [REMOTE    ] CAE: Fetching primary data for 2025-07.
[2025-10-24T17:48:11.445543] [INFO ] [REMOTE    ] CADE: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T17:48:11.554405] [INFO ] [REMOTE    ] CABO: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T17:48:12.147724] [INFO ] [REMOTE    ] CADE: Fetching primary data for 2025-10.
[2025-10-24T17:48:12.602141] [INFO ] [REMOTE    ] CAE: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T17:48:12.947692] [INFO ] [REMOTE    ] CAF: Fetching primary data for 2025-07.
[2025-10-24T17:48:13.511694] [INFO ] [REMOTE    ] CAF: Incremental fetch complete for 2025-07 (0.56 seconds).
[2025-10-24T17:48:13.747681] [INFO ] [REMOTE    ] CAF: Fetching primary data for 2025-08.
[2025-10-24T17:48:13.893299] [INFO ] [REMOTE    ] CADE: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T17:48:13.902907] [INFO ] [REMOTE    ] CADE: Full fetch complete (70791 records).
[2025-10-24T17:48:13.903043] [DEBUG] [VALIDATOR ] CADE: Validating primary data.
[2025-10-24T17:48:14.209780] [INFO ] [REMOTE    ] CAF: Incremental fetch complete for 2025-08 (0.46 seconds).
[2025-10-24T17:48:14.304513] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present.
[2025-10-24T17:48:14.304603] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed.
[2025-10-24T17:48:14.305417] [INFO ] [MAIN      ] CADE: Fetched primary data is valid.
[2025-10-24T17:48:14.305484] [DEBUG] [LOCAL     ] CADE: Saving primary data.
[2025-10-24T17:48:14.306110] [FATAL] [LOCAL     ] CADE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:48:14.306253] [FATAL] [MAIN      ] CADE: Failed to save primary data.
[2025-10-24T17:48:14.306326] [WARN ] [MAIN      ] CADE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:48:14.306414] [INFO ] [LOCAL     ] CADE: Starting deletion of primary data.
[2025-10-24T17:48:14.306487] [DEBUG] [LOCAL     ] CADE: No primary data file found to delete.
[2025-10-24T17:48:14.306525] [INFO ] [LOCAL     ] CADE: Starting deletion of derivative data.
[2025-10-24T17:48:14.306750] [DEBUG] [LOCAL     ] CADE: Deleted derivative data file.
[2025-10-24T17:48:14.307058] [INFO ] [MAIN      ] Update Progress: 385/2366 symbols completed. CADE took 34.2s. Estimated remaining: 4h 7m 58s. Rate: 8.0 symbols/min
[2025-10-24T17:48:14.474041] [INFO ] [MAIN      ] CAG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:48:14.526021] [DEBUG] [LOCAL     ] CAG: Loaded 54056 existing records from primary storage.
[2025-10-24T17:48:14.526305] [INFO ] [MAIN      ] CAG: Loaded 54056 existing records.
[2025-10-24T17:48:14.555289] [INFO ] [REMOTE    ] CAF: Fetching primary data for 2025-09.
[2025-10-24T17:48:14.711210] [WARN ] [MAIN      ] CAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:48:14.711460] [INFO ] [MAIN      ] CAG: Wiping existing primary data before full refresh.
[2025-10-24T17:48:14.711515] [INFO ] [LOCAL     ] CAG: Starting deletion of primary data.
[2025-10-24T17:48:14.711770] [DEBUG] [LOCAL     ] CAG: Deleted primary data file.
[2025-10-24T17:48:14.711828] [INFO ] [MAIN      ] CAG: Starting full primary refresh.
[2025-10-24T17:48:15.066268] [INFO ] [REMOTE    ] CAG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:48:15.111991] [INFO ] [REMOTE    ] CAF: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T17:48:15.347665] [INFO ] [REMOTE    ] CAE: Fetching primary data for 2025-08.
[2025-10-24T17:48:16.147639] [INFO ] [REMOTE    ] CABO: Fetching primary data for 2025-09.
[2025-10-24T17:48:16.897765] [INFO ] [REMOTE    ] CAE: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T17:48:16.925063] [INFO ] [REMOTE    ] CABO: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T17:48:16.947605] [INFO ] [REMOTE    ] CABO: Fetching primary data for 2025-10.
[2025-10-24T17:48:17.747678] [INFO ] [REMOTE    ] CAE: Fetching primary data for 2025-09.
[2025-10-24T17:48:17.845555] [INFO ] [REMOTE    ] CABO: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T17:48:17.848038] [INFO ] [REMOTE    ] CABO: Full fetch complete (23220 records).
[2025-10-24T17:48:17.848111] [DEBUG] [VALIDATOR ] CABO: Validating primary data.
[2025-10-24T17:48:18.256751] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present.
[2025-10-24T17:48:18.256828] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed.
[2025-10-24T17:48:18.257297] [INFO ] [MAIN      ] CABO: Fetched primary data is valid.
[2025-10-24T17:48:18.257359] [DEBUG] [LOCAL     ] CABO: Saving primary data.
[2025-10-24T17:48:18.257633] [FATAL] [LOCAL     ] CABO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:48:18.257737] [FATAL] [MAIN      ] CABO: Failed to save primary data.
[2025-10-24T17:48:18.257779] [WARN ] [MAIN      ] CABO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:48:18.257845] [INFO ] [LOCAL     ] CABO: Starting deletion of primary data.
[2025-10-24T17:48:18.257900] [DEBUG] [LOCAL     ] CABO: No primary data file found to delete.
[2025-10-24T17:48:18.257935] [INFO ] [LOCAL     ] CABO: Starting deletion of derivative data.
[2025-10-24T17:48:18.258062] [DEBUG] [LOCAL     ] CABO: Deleted derivative data file.
[2025-10-24T17:48:18.258129] [INFO ] [MAIN      ] Update Progress: 386/2366 symbols completed. CABO took 46.0s. Estimated remaining: 4h 7m 32s. Rate: 8.0 symbols/min
[2025-10-24T17:48:18.453074] [INFO ] [MAIN      ] CAH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:48:18.509942] [DEBUG] [LOCAL     ] CAH: Loaded 51788 existing records from primary storage.
[2025-10-24T17:48:18.510275] [INFO ] [MAIN      ] CAH: Loaded 51788 existing records.
[2025-10-24T17:48:18.552825] [INFO ] [REMOTE    ] CAF: Fetching primary data for 2025-10.
[2025-10-24T17:48:18.694789] [WARN ] [MAIN      ] CAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:48:18.695099] [INFO ] [MAIN      ] CAH: Wiping existing primary data before full refresh.
[2025-10-24T17:48:18.695186] [INFO ] [LOCAL     ] CAH: Starting deletion of primary data.
[2025-10-24T17:48:18.696099] [DEBUG] [LOCAL     ] CAH: Deleted primary data file.
[2025-10-24T17:48:18.696158] [INFO ] [MAIN      ] CAH: Starting full primary refresh.
[2025-10-24T17:48:19.110246] [INFO ] [REMOTE    ] CAE: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T17:48:19.114617] [INFO ] [REMOTE    ] CAH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:48:19.278893] [INFO ] [REMOTE    ] CAF: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T17:48:19.280251] [INFO ] [REMOTE    ] CAF: Full fetch complete (5538 records).
[2025-10-24T17:48:19.280324] [DEBUG] [VALIDATOR ] CAF: Validating primary data.
[2025-10-24T17:48:19.352893] [INFO ] [REMOTE    ] CAH: Fetching primary data for 2025-01.
[2025-10-24T17:48:19.656985] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present.
[2025-10-24T17:48:19.657074] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed.
[2025-10-24T17:48:19.657286] [INFO ] [MAIN      ] CAF: Fetched primary data is valid.
[2025-10-24T17:48:19.657354] [DEBUG] [LOCAL     ] CAF: Saving primary data.
[2025-10-24T17:48:19.657594] [FATAL] [LOCAL     ] CAF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:48:19.657711] [FATAL] [MAIN      ] CAF: Failed to save primary data.
[2025-10-24T17:48:19.657788] [WARN ] [MAIN      ] CAF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:48:19.657866] [INFO ] [LOCAL     ] CAF: Starting deletion of primary data.
[2025-10-24T17:48:19.657934] [DEBUG] [LOCAL     ] CAF: No primary data file found to delete.
[2025-10-24T17:48:19.657977] [INFO ] [LOCAL     ] CAF: Starting deletion of derivative data.
[2025-10-24T17:48:19.658137] [DEBUG] [LOCAL     ] CAF: Deleted derivative data file.
[2025-10-24T17:48:19.658373] [INFO ] [MAIN      ] Update Progress: 387/2366 symbols completed. CAF took 20.4s. Estimated remaining: 4h 6m 53s. Rate: 8.0 symbols/min
[2025-10-24T17:48:19.824445] [INFO ] [MAIN      ] CAL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:48:19.864848] [DEBUG] [LOCAL     ] CAL: Loaded 43036 existing records from primary storage.
[2025-10-24T17:48:19.865117] [INFO ] [MAIN      ] CAL: Loaded 43036 existing records.
[2025-10-24T17:48:20.039925] [WARN ] [MAIN      ] CAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:48:20.040121] [INFO ] [MAIN      ] CAL: Wiping existing primary data before full refresh.
[2025-10-24T17:48:20.040167] [INFO ] [LOCAL     ] CAL: Starting deletion of primary data.
[2025-10-24T17:48:20.040615] [DEBUG] [LOCAL     ] CAL: Deleted primary data file.
[2025-10-24T17:48:20.040709] [INFO ] [MAIN      ] CAL: Starting full primary refresh.
[2025-10-24T17:48:20.152868] [INFO ] [REMOTE    ] CAE: Fetching primary data for 2025-10.
[2025-10-24T17:48:20.395626] [INFO ] [REMOTE    ] CAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:48:20.947618] [INFO ] [REMOTE    ] CAL: Fetching primary data for 2025-01.
[2025-10-24T17:48:21.086843] [INFO ] [REMOTE    ] CAH: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T17:48:21.747632] [INFO ] [REMOTE    ] CAH: Fetching primary data for 2025-02.
[2025-10-24T17:48:21.904578] [INFO ] [REMOTE    ] CAE: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T17:48:21.912214] [INFO ] [REMOTE    ] CAE: Full fetch complete (56544 records).
[2025-10-24T17:48:21.912335] [DEBUG] [VALIDATOR ] CAE: Validating primary data.
[2025-10-24T17:48:22.316106] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present.
[2025-10-24T17:48:22.316603] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed.
[2025-10-24T17:48:22.318010] [INFO ] [REMOTE    ] CAL: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T17:48:22.318776] [INFO ] [MAIN      ] CAE: Fetched primary data is valid.
[2025-10-24T17:48:22.326199] [DEBUG] [LOCAL     ] CAE: Saving primary data.
[2025-10-24T17:48:22.327095] [FATAL] [LOCAL     ] CAE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:48:22.327180] [FATAL] [MAIN      ] CAE: Failed to save primary data.
[2025-10-24T17:48:22.327245] [WARN ] [MAIN      ] CAE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:48:22.327338] [INFO ] [LOCAL     ] CAE: Starting deletion of primary data.
[2025-10-24T17:48:22.327569] [DEBUG] [LOCAL     ] CAE: No primary data file found to delete.
[2025-10-24T17:48:22.327622] [INFO ] [LOCAL     ] CAE: Starting deletion of derivative data.
[2025-10-24T17:48:22.327837] [DEBUG] [LOCAL     ] CAE: Deleted derivative data file.
[2025-10-24T17:48:22.328147] [INFO ] [MAIN      ] Update Progress: 388/2366 symbols completed. CAE took 31.4s. Estimated remaining: 4h 6m 21s. Rate: 8.0 symbols/min
[2025-10-24T17:48:22.494558] [INFO ] [MAIN      ] CALX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:48:22.533155] [DEBUG] [LOCAL     ] CALX: Loaded 37506 existing records from primary storage.
[2025-10-24T17:48:22.533444] [INFO ] [MAIN      ] CALX: Loaded 37506 existing records.
[2025-10-24T17:48:22.554063] [INFO ] [REMOTE    ] CAG: Fetching primary data for 2025-01.
[2025-10-24T17:48:22.711813] [WARN ] [MAIN      ] CALX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:48:22.712024] [INFO ] [MAIN      ] CALX: Wiping existing primary data before full refresh.
[2025-10-24T17:48:22.712071] [INFO ] [LOCAL     ] CALX: Starting deletion of primary data.
[2025-10-24T17:48:22.712462] [DEBUG] [LOCAL     ] CALX: Deleted primary data file.
[2025-10-24T17:48:22.712502] [INFO ] [MAIN      ] CALX: Starting full primary refresh.
[2025-10-24T17:48:23.066633] [INFO ] [REMOTE    ] CALX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:48:23.347706] [INFO ] [REMOTE    ] CAL: Fetching primary data for 2025-02.
[2025-10-24T17:48:23.426453] [INFO ] [REMOTE    ] CAH: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T17:48:24.147627] [INFO ] [REMOTE    ] CAH: Fetching primary data for 2025-03.
[2025-10-24T17:48:24.223796] [INFO ] [REMOTE    ] CAG: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T17:48:24.804206] [INFO ] [REMOTE    ] CAL: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T17:48:24.947712] [INFO ] [REMOTE    ] CAL: Fetching primary data for 2025-03.
[2025-10-24T17:48:25.747635] [INFO ] [REMOTE    ] CALX: Fetching primary data for 2025-01.
[2025-10-24T17:48:26.012401] [INFO ] [REMOTE    ] CAH: Incremental fetch complete for 2025-03 (1.86 seconds).
[2025-10-24T17:48:26.538616] [INFO ] [REMOTE    ] CAL: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T17:48:26.547623] [INFO ] [REMOTE    ] CAH: Fetching primary data for 2025-04.
[2025-10-24T17:48:27.226179] [INFO ] [REMOTE    ] CALX: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T17:48:27.347632] [INFO ] [REMOTE    ] CALX: Fetching primary data for 2025-02.
[2025-10-24T17:48:28.147638] [INFO ] [REMOTE    ] CAG: Fetching primary data for 2025-02.
[2025-10-24T17:48:28.391320] [INFO ] [REMOTE    ] CAH: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T17:48:28.758096] [INFO ] [REMOTE    ] CALX: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T17:48:28.947688] [INFO ] [REMOTE    ] CAH: Fetching primary data for 2025-05.
[2025-10-24T17:48:29.651962] [INFO ] [REMOTE    ] CAG: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T17:48:29.747694] [INFO ] [REMOTE    ] CALX: Fetching primary data for 2025-03.
[2025-10-24T17:48:30.545577] [INFO ] [REMOTE    ] CAH: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T17:48:30.555320] [INFO ] [REMOTE    ] CAG: Fetching primary data for 2025-03.
[2025-10-24T17:48:31.225500] [INFO ] [REMOTE    ] CALX: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T17:48:31.347706] [INFO ] [REMOTE    ] CAL: Fetching primary data for 2025-04.
[2025-10-24T17:48:31.454425] [DEBUG] [REMOTE    ] CAL: Error fetching primary data for 2025-04: 'API call returned an empty response.'
[2025-10-24T17:48:31.454928] [WARN ] [REMOTE    ] CAL: No data returned for month 2025-04
[2025-10-24T17:48:31.455030] [FATAL] [REMOTE    ] CAL: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:48:31.455120] [FATAL] [MAIN      ] CAL: Failed to fetch primary data.
[2025-10-24T17:48:31.455193] [WARN ] [MAIN      ] CAL: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:48:31.455273] [INFO ] [LOCAL     ] CAL: Starting deletion of primary data.
[2025-10-24T17:48:31.455344] [DEBUG] [LOCAL     ] CAL: No primary data file found to delete.
[2025-10-24T17:48:31.455381] [INFO ] [LOCAL     ] CAL: Starting deletion of derivative data.
[2025-10-24T17:48:31.455561] [DEBUG] [LOCAL     ] CAL: Deleted derivative data file.
[2025-10-24T17:48:31.455676] [INFO ] [MAIN      ] Update Progress: 389/2366 symbols completed. CAL took 11.8s. Estimated remaining: 4h 6m 22s. Rate: 8.0 symbols/min
[2025-10-24T17:48:31.629761] [INFO ] [MAIN      ] CANG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:48:31.674149] [DEBUG] [LOCAL     ] CANG: Loaded 27174 existing records from primary storage.
[2025-10-24T17:48:31.674538] [INFO ] [MAIN      ] CANG: Loaded 27174 existing records.
[2025-10-24T17:48:31.870077] [WARN ] [MAIN      ] CANG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:48:31.870332] [INFO ] [MAIN      ] CANG: Wiping existing primary data before full refresh.
[2025-10-24T17:48:31.870390] [INFO ] [LOCAL     ] CANG: Starting deletion of primary data.
[2025-10-24T17:48:31.870563] [DEBUG] [LOCAL     ] CANG: Deleted primary data file.
[2025-10-24T17:48:31.870602] [INFO ] [MAIN      ] CANG: Starting full primary refresh.
[2025-10-24T17:48:32.148669] [INFO ] [REMOTE    ] CAH: Fetching primary data for 2025-06.
[2025-10-24T17:48:32.230212] [INFO ] [REMOTE    ] CANG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:48:32.340954] [INFO ] [REMOTE    ] CAG: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T17:48:32.947676] [INFO ] [REMOTE    ] CALX: Fetching primary data for 2025-04.
[2025-10-24T17:48:33.747752] [INFO ] [REMOTE    ] CANG: Fetching primary data for 2025-01.
[2025-10-24T17:48:33.996696] [INFO ] [REMOTE    ] CAH: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T17:48:34.230989] [INFO ] [REMOTE    ] CALX: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T17:48:34.547681] [INFO ] [REMOTE    ] CALX: Fetching primary data for 2025-05.
[2025-10-24T17:48:34.929136] [INFO ] [REMOTE    ] CANG: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T17:48:35.347673] [INFO ] [REMOTE    ] CANG: Fetching primary data for 2025-02.
[2025-10-24T17:48:35.937420] [INFO ] [REMOTE    ] CALX: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T17:48:36.147720] [INFO ] [REMOTE    ] CALX: Fetching primary data for 2025-06.
[2025-10-24T17:48:36.424471] [INFO ] [REMOTE    ] CANG: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T17:48:36.947741] [INFO ] [REMOTE    ] CAG: Fetching primary data for 2025-04.
[2025-10-24T17:48:37.624816] [INFO ] [REMOTE    ] CALX: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T17:48:37.747617] [INFO ] [REMOTE    ] CAH: Fetching primary data for 2025-07.
[2025-10-24T17:48:38.547631] [INFO ] [REMOTE    ] CANG: Fetching primary data for 2025-03.
[2025-10-24T17:48:38.927496] [INFO ] [REMOTE    ] CAG: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T17:48:39.329319] [INFO ] [REMOTE    ] CAH: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T17:48:39.347606] [INFO ] [REMOTE    ] CAH: Fetching primary data for 2025-08.
[2025-10-24T17:48:39.645337] [INFO ] [REMOTE    ] CANG: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T17:48:40.147711] [INFO ] [REMOTE    ] CALX: Fetching primary data for 2025-07.
[2025-10-24T17:48:40.947719] [INFO ] [REMOTE    ] CAG: Fetching primary data for 2025-05.
[2025-10-24T17:48:41.169365] [INFO ] [REMOTE    ] CAH: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T17:48:41.680023] [INFO ] [REMOTE    ] CALX: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T17:48:41.747686] [INFO ] [REMOTE    ] CALX: Fetching primary data for 2025-08.
[2025-10-24T17:48:42.361371] [INFO ] [REMOTE    ] CAG: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T17:48:42.547638] [INFO ] [REMOTE    ] CAH: Fetching primary data for 2025-09.
[2025-10-24T17:48:43.057216] [INFO ] [REMOTE    ] CALX: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T17:48:43.347679] [INFO ] [REMOTE    ] CANG: Fetching primary data for 2025-04.
[2025-10-24T17:48:44.147629] [INFO ] [REMOTE    ] CALX: Fetching primary data for 2025-09.
[2025-10-24T17:48:44.351978] [INFO ] [REMOTE    ] CANG: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T17:48:44.386968] [INFO ] [REMOTE    ] CAH: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T17:48:44.947671] [INFO ] [REMOTE    ] CAH: Fetching primary data for 2025-10.
[2025-10-24T17:48:45.079628] [INFO ] [REMOTE    ] CALX: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T17:48:45.747667] [INFO ] [REMOTE    ] CANG: Fetching primary data for 2025-05.
[2025-10-24T17:48:46.547619] [INFO ] [REMOTE    ] CALX: Fetching primary data for 2025-10.
[2025-10-24T17:48:46.720619] [INFO ] [REMOTE    ] CAH: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T17:48:46.730149] [INFO ] [REMOTE    ] CAH: Full fetch complete (74856 records).
[2025-10-24T17:48:46.730281] [DEBUG] [VALIDATOR ] CAH: Validating primary data.
[2025-10-24T17:48:47.149425] [INFO ] [REMOTE    ] CANG: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T17:48:47.149526] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present.
[2025-10-24T17:48:47.154866] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed.
[2025-10-24T17:48:47.156317] [INFO ] [MAIN      ] CAH: Fetched primary data is valid.
[2025-10-24T17:48:47.156417] [DEBUG] [LOCAL     ] CAH: Saving primary data.
[2025-10-24T17:48:47.157358] [FATAL] [LOCAL     ] CAH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:48:47.157443] [FATAL] [MAIN      ] CAH: Failed to save primary data.
[2025-10-24T17:48:47.157488] [WARN ] [MAIN      ] CAH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:48:47.157553] [INFO ] [LOCAL     ] CAH: Starting deletion of primary data.
[2025-10-24T17:48:47.157616] [DEBUG] [LOCAL     ] CAH: No primary data file found to delete.
[2025-10-24T17:48:47.157685] [INFO ] [LOCAL     ] CAH: Starting deletion of derivative data.
[2025-10-24T17:48:47.157833] [DEBUG] [LOCAL     ] CAH: Deleted derivative data file.
[2025-10-24T17:48:47.158050] [INFO ] [MAIN      ] Update Progress: 390/2366 symbols completed. CAH took 28.9s. Estimated remaining: 4h 6m 56s. Rate: 8.0 symbols/min
[2025-10-24T17:48:47.323582] [INFO ] [MAIN      ] CAPL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:48:47.331735] [DEBUG] [LOCAL     ] CAPL: Loaded 5425 existing records from primary storage.
[2025-10-24T17:48:47.331943] [INFO ] [MAIN      ] CAPL: Loaded 5425 existing records.
[2025-10-24T17:48:47.352758] [INFO ] [REMOTE    ] CANG: Fetching primary data for 2025-06.
[2025-10-24T17:48:47.507155] [WARN ] [MAIN      ] CAPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:48:47.507430] [INFO ] [MAIN      ] CAPL: Wiping existing primary data before full refresh.
[2025-10-24T17:48:47.507483] [INFO ] [LOCAL     ] CAPL: Starting deletion of primary data.
[2025-10-24T17:48:47.507614] [DEBUG] [LOCAL     ] CAPL: Deleted primary data file.
[2025-10-24T17:48:47.507688] [INFO ] [MAIN      ] CAPL: Starting full primary refresh.
[2025-10-24T17:48:47.861661] [INFO ] [REMOTE    ] CAPL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:48:48.014844] [INFO ] [REMOTE    ] CALX: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T17:48:48.021353] [INFO ] [REMOTE    ] CALX: Full fetch complete (54067 records).
[2025-10-24T17:48:48.021509] [DEBUG] [VALIDATOR ] CALX: Validating primary data.
[2025-10-24T17:48:48.152810] [INFO ] [REMOTE    ] CAG: Fetching primary data for 2025-06.
[2025-10-24T17:48:48.428390] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present.
[2025-10-24T17:48:48.428578] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed.
[2025-10-24T17:48:48.429251] [INFO ] [MAIN      ] CALX: Fetched primary data is valid.
[2025-10-24T17:48:48.429323] [DEBUG] [LOCAL     ] CALX: Saving primary data.
[2025-10-24T17:48:48.429850] [FATAL] [LOCAL     ] CALX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:48:48.429941] [FATAL] [MAIN      ] CALX: Failed to save primary data.
[2025-10-24T17:48:48.429982] [WARN ] [MAIN      ] CALX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:48:48.430016] [INFO ] [LOCAL     ] CALX: Starting deletion of primary data.
[2025-10-24T17:48:48.430065] [DEBUG] [LOCAL     ] CALX: No primary data file found to delete.
[2025-10-24T17:48:48.430101] [INFO ] [LOCAL     ] CALX: Starting deletion of derivative data.
[2025-10-24T17:48:48.430237] [DEBUG] [LOCAL     ] CALX: Deleted derivative data file.
[2025-10-24T17:48:48.430489] [INFO ] [MAIN      ] Update Progress: 391/2366 symbols completed. CALX took 26.1s. Estimated remaining: 4h 6m 17s. Rate: 8.0 symbols/min
[2025-10-24T17:48:48.566336] [INFO ] [REMOTE    ] CANG: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T17:48:48.625725] [INFO ] [MAIN      ] CARR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:48:48.675357] [DEBUG] [LOCAL     ] CARR: Loaded 53993 existing records from primary storage.
[2025-10-24T17:48:48.675720] [INFO ] [MAIN      ] CARR: Loaded 53993 existing records.
[2025-10-24T17:48:48.851008] [WARN ] [MAIN      ] CARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:48:48.851237] [INFO ] [MAIN      ] CARR: Wiping existing primary data before full refresh.
[2025-10-24T17:48:48.851284] [INFO ] [LOCAL     ] CARR: Starting deletion of primary data.
[2025-10-24T17:48:48.851818] [DEBUG] [LOCAL     ] CARR: Deleted primary data file.
[2025-10-24T17:48:48.851882] [INFO ] [MAIN      ] CARR: Starting full primary refresh.
[2025-10-24T17:48:48.953836] [INFO ] [REMOTE    ] CAPL: Fetching primary data for 2025-01.
[2025-10-24T17:48:49.213909] [INFO ] [REMOTE    ] CARR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:48:49.747676] [INFO ] [REMOTE    ] CANG: Fetching primary data for 2025-07.
[2025-10-24T17:48:49.783450] [INFO ] [REMOTE    ] CAPL: Incremental fetch complete for 2025-01 (0.83 seconds).
[2025-10-24T17:48:50.172450] [INFO ] [REMOTE    ] CAG: Incremental fetch complete for 2025-06 (2.02 seconds).
[2025-10-24T17:48:50.547639] [INFO ] [REMOTE    ] CAPL: Fetching primary data for 2025-02.
[2025-10-24T17:48:51.167633] [INFO ] [REMOTE    ] CAPL: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T17:48:51.194000] [INFO ] [REMOTE    ] CANG: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T17:48:51.347673] [INFO ] [REMOTE    ] CARR: Fetching primary data for 2025-01.
[2025-10-24T17:48:52.147680] [INFO ] [REMOTE    ] CAPL: Fetching primary data for 2025-03.
[2025-10-24T17:48:52.950571] [INFO ] [REMOTE    ] CANG: Fetching primary data for 2025-08.
[2025-10-24T17:48:52.952152] [INFO ] [REMOTE    ] CAPL: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T17:48:53.182835] [INFO ] [REMOTE    ] CARR: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T17:48:53.747687] [INFO ] [REMOTE    ] CAPL: Fetching primary data for 2025-04.
[2025-10-24T17:48:54.048888] [INFO ] [REMOTE    ] CANG: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T17:48:54.150633] [INFO ] [REMOTE    ] CAPL: Incremental fetch complete for 2025-04 (0.40 seconds).
[2025-10-24T17:48:54.547637] [INFO ] [REMOTE    ] CAPL: Fetching primary data for 2025-05.
[2025-10-24T17:48:55.172232] [INFO ] [REMOTE    ] CAPL: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T17:48:55.347726] [INFO ] [REMOTE    ] CAPL: Fetching primary data for 2025-06.
[2025-10-24T17:48:55.930389] [INFO ] [REMOTE    ] CAPL: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T17:48:56.147678] [INFO ] [REMOTE    ] CANG: Fetching primary data for 2025-09.
[2025-10-24T17:48:56.947672] [INFO ] [REMOTE    ] CAPL: Fetching primary data for 2025-07.
[2025-10-24T17:48:57.601817] [INFO ] [REMOTE    ] CANG: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T17:48:57.616019] [INFO ] [REMOTE    ] CAPL: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T17:48:57.747686] [INFO ] [REMOTE    ] CAG: Fetching primary data for 2025-07.
[2025-10-24T17:48:58.547689] [INFO ] [REMOTE    ] CANG: Fetching primary data for 2025-10.
[2025-10-24T17:48:59.347678] [INFO ] [REMOTE    ] CAPL: Fetching primary data for 2025-08.
[2025-10-24T17:48:59.809313] [INFO ] [REMOTE    ] CAG: Incremental fetch complete for 2025-07 (2.06 seconds).
[2025-10-24T17:48:59.869744] [INFO ] [REMOTE    ] CANG: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T17:48:59.875110] [INFO ] [REMOTE    ] CANG: Full fetch complete (39148 records).
[2025-10-24T17:48:59.875194] [DEBUG] [VALIDATOR ] CANG: Validating primary data.
[2025-10-24T17:49:00.115749] [INFO ] [REMOTE    ] CAPL: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T17:49:00.150089] [INFO ] [REMOTE    ] CAG: Fetching primary data for 2025-08.
[2025-10-24T17:49:00.262400] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present.
[2025-10-24T17:49:00.262485] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed.
[2025-10-24T17:49:00.263037] [INFO ] [MAIN      ] CANG: Fetched primary data is valid.
[2025-10-24T17:49:00.263098] [DEBUG] [LOCAL     ] CANG: Saving primary data.
[2025-10-24T17:49:00.263444] [FATAL] [LOCAL     ] CANG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:49:00.263522] [FATAL] [MAIN      ] CANG: Failed to save primary data.
[2025-10-24T17:49:00.263563] [WARN ] [MAIN      ] CANG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:49:00.263622] [INFO ] [LOCAL     ] CANG: Starting deletion of primary data.
[2025-10-24T17:49:00.263715] [DEBUG] [LOCAL     ] CANG: No primary data file found to delete.
[2025-10-24T17:49:00.263759] [INFO ] [LOCAL     ] CANG: Starting deletion of derivative data.
[2025-10-24T17:49:00.263901] [DEBUG] [LOCAL     ] CANG: Deleted derivative data file.
[2025-10-24T17:49:00.264103] [INFO ] [MAIN      ] Update Progress: 392/2366 symbols completed. CANG took 28.8s. Estimated remaining: 4h 6m 32s. Rate: 8.0 symbols/min
[2025-10-24T17:49:00.460410] [INFO ] [MAIN      ] CARS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:49:00.500254] [DEBUG] [LOCAL     ] CARS: Loaded 40089 existing records from primary storage.
[2025-10-24T17:49:00.500565] [INFO ] [MAIN      ] CARS: Loaded 40089 existing records.
[2025-10-24T17:49:00.680344] [WARN ] [MAIN      ] CARS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:49:00.680614] [INFO ] [MAIN      ] CARS: Wiping existing primary data before full refresh.
[2025-10-24T17:49:00.680696] [INFO ] [LOCAL     ] CARS: Starting deletion of primary data.
[2025-10-24T17:49:00.681141] [DEBUG] [LOCAL     ] CARS: Deleted primary data file.
[2025-10-24T17:49:00.681197] [INFO ] [MAIN      ] CARS: Starting full primary refresh.
[2025-10-24T17:49:00.954323] [INFO ] [REMOTE    ] CAPL: Fetching primary data for 2025-09.
[2025-10-24T17:49:01.034775] [INFO ] [REMOTE    ] CARS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:49:01.747747] [INFO ] [REMOTE    ] CARR: Fetching primary data for 2025-02.
[2025-10-24T17:49:02.210112] [INFO ] [REMOTE    ] CAPL: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T17:49:02.547683] [INFO ] [REMOTE    ] CARS: Fetching primary data for 2025-01.
[2025-10-24T17:49:02.660883] [INFO ] [REMOTE    ] CAG: Incremental fetch complete for 2025-08 (2.51 seconds).
[2025-10-24T17:49:03.347724] [INFO ] [REMOTE    ] CAG: Fetching primary data for 2025-09.
[2025-10-24T17:49:03.562870] [INFO ] [REMOTE    ] CARS: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T17:49:04.147677] [INFO ] [REMOTE    ] CAPL: Fetching primary data for 2025-10.
[2025-10-24T17:49:04.947736] [INFO ] [REMOTE    ] CARS: Fetching primary data for 2025-02.
[2025-10-24T17:49:05.248019] [INFO ] [REMOTE    ] CARR: Incremental fetch complete for 2025-02 (3.50 seconds).
[2025-10-24T17:49:05.448672] [INFO ] [REMOTE    ] CAG: Incremental fetch complete for 2025-09 (2.10 seconds).
[2025-10-24T17:49:05.721179] [INFO ] [REMOTE    ] CAPL: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T17:49:05.722944] [INFO ] [REMOTE    ] CAPL: Full fetch complete (8728 records).
[2025-10-24T17:49:05.723014] [DEBUG] [VALIDATOR ] CAPL: Validating primary data.
[2025-10-24T17:49:05.755591] [INFO ] [REMOTE    ] CAG: Fetching primary data for 2025-10.
[2025-10-24T17:49:06.109508] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present.
[2025-10-24T17:49:06.109610] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed.
[2025-10-24T17:49:06.109854] [INFO ] [MAIN      ] CAPL: Fetched primary data is valid.
[2025-10-24T17:49:06.109910] [DEBUG] [LOCAL     ] CAPL: Saving primary data.
[2025-10-24T17:49:06.110110] [FATAL] [LOCAL     ] CAPL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:49:06.110192] [FATAL] [MAIN      ] CAPL: Failed to save primary data.
[2025-10-24T17:49:06.110235] [WARN ] [MAIN      ] CAPL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:49:06.110269] [INFO ] [LOCAL     ] CAPL: Starting deletion of primary data.
[2025-10-24T17:49:06.110319] [DEBUG] [LOCAL     ] CAPL: No primary data file found to delete.
[2025-10-24T17:49:06.110353] [INFO ] [LOCAL     ] CAPL: Starting deletion of derivative data.
[2025-10-24T17:49:06.110479] [DEBUG] [LOCAL     ] CAPL: Deleted derivative data file.
[2025-10-24T17:49:06.110546] [INFO ] [MAIN      ] Update Progress: 393/2366 symbols completed. CAPL took 19.0s. Estimated remaining: 4h 6m 16s. Rate: 8.0 symbols/min
[2025-10-24T17:49:06.282337] [INFO ] [MAIN      ] CAT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:49:06.332807] [DEBUG] [LOCAL     ] CAT: Loaded 53317 existing records from primary storage.
[2025-10-24T17:49:06.333100] [INFO ] [MAIN      ] CAT: Loaded 53317 existing records.
[2025-10-24T17:49:06.513611] [WARN ] [MAIN      ] CAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:49:06.513819] [INFO ] [MAIN      ] CAT: Wiping existing primary data before full refresh.
[2025-10-24T17:49:06.513866] [INFO ] [LOCAL     ] CAT: Starting deletion of primary data.
[2025-10-24T17:49:06.514050] [DEBUG] [LOCAL     ] CAT: Deleted primary data file.
[2025-10-24T17:49:06.514092] [INFO ] [MAIN      ] CAT: Starting full primary refresh.
[2025-10-24T17:49:06.556283] [INFO ] [REMOTE    ] CARR: Fetching primary data for 2025-03.
[2025-10-24T17:49:06.866592] [INFO ] [REMOTE    ] CARS: Incremental fetch complete for 2025-02 (1.92 seconds).
[2025-10-24T17:49:06.907801] [INFO ] [REMOTE    ] CAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:49:07.347717] [INFO ] [REMOTE    ] CARS: Fetching primary data for 2025-03.
[2025-10-24T17:49:07.743038] [INFO ] [REMOTE    ] CAG: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T17:49:07.752332] [INFO ] [REMOTE    ] CAG: Full fetch complete (77437 records).
[2025-10-24T17:49:07.752466] [DEBUG] [VALIDATOR ] CAG: Validating primary data.
[2025-10-24T17:49:07.754385] [FATAL] [VALIDATOR ] CAG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:49:07.754475] [FATAL] [MAIN      ] CAG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:49:07.754526] [WARN ] [MAIN      ] CAG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:49:07.754610] [INFO ] [LOCAL     ] CAG: Starting deletion of primary data.
[2025-10-24T17:49:07.754729] [DEBUG] [LOCAL     ] CAG: No primary data file found to delete.
[2025-10-24T17:49:07.754789] [INFO ] [LOCAL     ] CAG: Starting deletion of derivative data.
[2025-10-24T17:49:07.754949] [DEBUG] [LOCAL     ] CAG: Deleted derivative data file.
[2025-10-24T17:49:07.755393] [INFO ] [MAIN      ] Update Progress: 394/2366 symbols completed. CAG took 53.4s. Estimated remaining: 4h 5m 39s. Rate: 8.0 symbols/min
[2025-10-24T17:49:07.931476] [INFO ] [MAIN      ] CATO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:49:07.942485] [DEBUG] [LOCAL     ] CATO: Loaded 6677 existing records from primary storage.
[2025-10-24T17:49:07.942736] [INFO ] [MAIN      ] CATO: Loaded 6677 existing records.
[2025-10-24T17:49:08.121775] [WARN ] [MAIN      ] CATO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:49:08.122088] [INFO ] [MAIN      ] CATO: Wiping existing primary data before full refresh.
[2025-10-24T17:49:08.122154] [INFO ] [LOCAL     ] CATO: Starting deletion of primary data.
[2025-10-24T17:49:08.122311] [DEBUG] [LOCAL     ] CATO: Deleted primary data file.
[2025-10-24T17:49:08.122358] [INFO ] [MAIN      ] CATO: Starting full primary refresh.
[2025-10-24T17:49:08.152745] [INFO ] [REMOTE    ] CAT: Fetching primary data for 2025-01.
[2025-10-24T17:49:08.306173] [INFO ] [REMOTE    ] CARR: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T17:49:08.529295] [INFO ] [REMOTE    ] CATO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:49:08.564243] [INFO ] [REMOTE    ] CARS: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T17:49:08.947720] [INFO ] [REMOTE    ] CATO: Fetching primary data for 2025-01.
[2025-10-24T17:49:09.747685] [INFO ] [REMOTE    ] CARS: Fetching primary data for 2025-04.
[2025-10-24T17:49:09.802272] [INFO ] [REMOTE    ] CATO: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T17:49:09.941552] [INFO ] [REMOTE    ] CAT: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T17:49:10.547751] [INFO ] [REMOTE    ] CAT: Fetching primary data for 2025-02.
[2025-10-24T17:49:11.139004] [INFO ] [REMOTE    ] CARS: Incremental fetch complete for 2025-04 (1.39 seconds).
[2025-10-24T17:49:11.347709] [INFO ] [REMOTE    ] CATO: Fetching primary data for 2025-02.
[2025-10-24T17:49:12.053813] [INFO ] [REMOTE    ] CATO: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T17:49:12.147696] [INFO ] [REMOTE    ] CATO: Fetching primary data for 2025-03.
[2025-10-24T17:49:12.371402] [INFO ] [REMOTE    ] CAT: Incremental fetch complete for 2025-02 (1.82 seconds).
[2025-10-24T17:49:12.909424] [INFO ] [REMOTE    ] CATO: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T17:49:12.947683] [INFO ] [REMOTE    ] CATO: Fetching primary data for 2025-04.
[2025-10-24T17:49:13.619047] [INFO ] [REMOTE    ] CATO: Incremental fetch complete for 2025-04 (0.67 seconds).
[2025-10-24T17:49:13.747703] [INFO ] [REMOTE    ] CATO: Fetching primary data for 2025-05.
[2025-10-24T17:49:14.423770] [INFO ] [REMOTE    ] CATO: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T17:49:14.547725] [INFO ] [REMOTE    ] CARS: Fetching primary data for 2025-05.
[2025-10-24T17:49:15.347703] [INFO ] [REMOTE    ] CAT: Fetching primary data for 2025-03.
[2025-10-24T17:49:16.086371] [INFO ] [REMOTE    ] CARS: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T17:49:16.147704] [INFO ] [REMOTE    ] CARS: Fetching primary data for 2025-06.
[2025-10-24T17:49:16.947737] [INFO ] [REMOTE    ] CARR: Fetching primary data for 2025-04.
[2025-10-24T17:49:17.480441] [INFO ] [REMOTE    ] CAT: Incremental fetch complete for 2025-03 (2.13 seconds).
[2025-10-24T17:49:17.529226] [INFO ] [REMOTE    ] CARS: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T17:49:17.747742] [INFO ] [REMOTE    ] CARS: Fetching primary data for 2025-07.
[2025-10-24T17:49:18.547625] [INFO ] [REMOTE    ] CATO: Fetching primary data for 2025-06.
[2025-10-24T17:49:18.592152] [INFO ] [REMOTE    ] CARR: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T17:49:18.682197] [INFO ] [REMOTE    ] CARS: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T17:49:18.927699] [INFO ] [REMOTE    ] CATO: Incremental fetch complete for 2025-06 (0.38 seconds).
[2025-10-24T17:49:19.347714] [INFO ] [REMOTE    ] CARR: Fetching primary data for 2025-05.
[2025-10-24T17:49:20.147615] [INFO ] [REMOTE    ] CATO: Fetching primary data for 2025-07.
[2025-10-24T17:49:20.856743] [INFO ] [REMOTE    ] CATO: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T17:49:20.947723] [INFO ] [REMOTE    ] CAT: Fetching primary data for 2025-04.
[2025-10-24T17:49:21.230200] [INFO ] [REMOTE    ] CARR: Incremental fetch complete for 2025-05 (1.88 seconds).
[2025-10-24T17:49:21.747694] [INFO ] [REMOTE    ] CARR: Fetching primary data for 2025-06.
[2025-10-24T17:49:22.547671] [INFO ] [REMOTE    ] CATO: Fetching primary data for 2025-08.
[2025-10-24T17:49:23.222924] [INFO ] [REMOTE    ] CAT: Incremental fetch complete for 2025-04 (2.28 seconds).
[2025-10-24T17:49:23.266099] [INFO ] [REMOTE    ] CATO: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T17:49:23.313872] [INFO ] [REMOTE    ] CARR: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T17:49:23.347682] [INFO ] [REMOTE    ] CAT: Fetching primary data for 2025-05.
[2025-10-24T17:49:24.147722] [INFO ] [REMOTE    ] CARS: Fetching primary data for 2025-08.
[2025-10-24T17:49:24.947720] [INFO ] [REMOTE    ] CARR: Fetching primary data for 2025-07.
[2025-10-24T17:49:25.250992] [INFO ] [REMOTE    ] CAT: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T17:49:25.653255] [INFO ] [REMOTE    ] CARS: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T17:49:25.747623] [INFO ] [REMOTE    ] CARS: Fetching primary data for 2025-09.
[2025-10-24T17:49:26.547738] [INFO ] [REMOTE    ] CATO: Fetching primary data for 2025-09.
[2025-10-24T17:49:27.175347] [INFO ] [REMOTE    ] CARR: Incremental fetch complete for 2025-07 (2.23 seconds).
[2025-10-24T17:49:27.250040] [INFO ] [REMOTE    ] CARS: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T17:49:27.267361] [INFO ] [REMOTE    ] CATO: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T17:49:27.347698] [INFO ] [REMOTE    ] CARS: Fetching primary data for 2025-10.
[2025-10-24T17:49:28.147693] [INFO ] [REMOTE    ] CAT: Fetching primary data for 2025-06.
[2025-10-24T17:49:28.864516] [INFO ] [REMOTE    ] CARS: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T17:49:28.872285] [INFO ] [REMOTE    ] CARS: Full fetch complete (56643 records).
[2025-10-24T17:49:28.872395] [DEBUG] [VALIDATOR ] CARS: Validating primary data.
[2025-10-24T17:49:28.952876] [INFO ] [REMOTE    ] CATO: Fetching primary data for 2025-10.
[2025-10-24T17:49:29.252146] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present.
[2025-10-24T17:49:29.252215] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed.
[2025-10-24T17:49:29.252881] [INFO ] [MAIN      ] CARS: Fetched primary data is valid.
[2025-10-24T17:49:29.252952] [DEBUG] [LOCAL     ] CARS: Saving primary data.
[2025-10-24T17:49:29.253373] [FATAL] [LOCAL     ] CARS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:49:29.253469] [FATAL] [MAIN      ] CARS: Failed to save primary data.
[2025-10-24T17:49:29.253539] [WARN ] [MAIN      ] CARS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:49:29.253620] [INFO ] [LOCAL     ] CARS: Starting deletion of primary data.
[2025-10-24T17:49:29.253732] [DEBUG] [LOCAL     ] CARS: No primary data file found to delete.
[2025-10-24T17:49:29.253790] [INFO ] [LOCAL     ] CARS: Starting deletion of derivative data.
[2025-10-24T17:49:29.253930] [DEBUG] [LOCAL     ] CARS: Deleted derivative data file.
[2025-10-24T17:49:29.254287] [INFO ] [MAIN      ] Update Progress: 395/2366 symbols completed. CARS took 29.0s. Estimated remaining: 4h 6m 42s. Rate: 8.0 symbols/min
[2025-10-24T17:49:29.420090] [INFO ] [MAIN      ] CAVA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:49:29.473039] [DEBUG] [LOCAL     ] CAVA: Loaded 53932 existing records from primary storage.
[2025-10-24T17:49:29.473331] [INFO ] [MAIN      ] CAVA: Loaded 53932 existing records.
[2025-10-24T17:49:29.678612] [INFO ] [REMOTE    ] CATO: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T17:49:29.677817] [WARN ] [MAIN      ] CAVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:49:29.681306] [INFO ] [MAIN      ] CAVA: Wiping existing primary data before full refresh.
[2025-10-24T17:49:29.681567] [INFO ] [LOCAL     ] CAVA: Starting deletion of primary data.
[2025-10-24T17:49:29.681475] [INFO ] [REMOTE    ] CATO: Full fetch complete (10569 records).
[2025-10-24T17:49:29.681819] [DEBUG] [VALIDATOR ] CATO: Validating primary data.
[2025-10-24T17:49:29.714570] [DEBUG] [LOCAL     ] CAVA: Deleted primary data file.
[2025-10-24T17:49:29.747129] [INFO ] [MAIN      ] CAVA: Starting full primary refresh.
[2025-10-24T17:49:29.758030] [INFO ] [REMOTE    ] CARR: Fetching primary data for 2025-08.
[2025-10-24T17:49:30.450788] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present.
[2025-10-24T17:49:30.461303] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed.
[2025-10-24T17:49:30.491418] [INFO ] [MAIN      ] CATO: Fetched primary data is valid.
[2025-10-24T17:49:30.490955] [INFO ] [REMOTE    ] CAVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:49:30.491628] [DEBUG] [LOCAL     ] CATO: Saving primary data.
[2025-10-24T17:49:30.492619] [FATAL] [LOCAL     ] CATO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:49:30.492747] [FATAL] [MAIN      ] CATO: Failed to save primary data.
[2025-10-24T17:49:30.492790] [WARN ] [MAIN      ] CATO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:49:30.492831] [INFO ] [LOCAL     ] CATO: Starting deletion of primary data.
[2025-10-24T17:49:30.492901] [DEBUG] [LOCAL     ] CATO: No primary data file found to delete.
[2025-10-24T17:49:30.492958] [INFO ] [LOCAL     ] CATO: Starting deletion of derivative data.
[2025-10-24T17:49:30.493161] [DEBUG] [LOCAL     ] CATO: Deleted derivative data file.
[2025-10-24T17:49:30.493269] [INFO ] [MAIN      ] Update Progress: 396/2366 symbols completed. CATO took 22.7s. Estimated remaining: 4h 6m 3s. Rate: 8.0 symbols/min
[2025-10-24T17:49:30.567198] [INFO ] [REMOTE    ] CAVA: Fetching primary data for 2025-01.
[2025-10-24T17:49:30.708632] [INFO ] [MAIN      ] CB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:49:30.713694] [INFO ] [REMOTE    ] CAT: Incremental fetch complete for 2025-06 (2.57 seconds).
[2025-10-24T17:49:30.774048] [DEBUG] [LOCAL     ] CB: Loaded 50346 existing records from primary storage.
[2025-10-24T17:49:30.774397] [INFO ] [MAIN      ] CB: Loaded 50346 existing records.
[2025-10-24T17:49:30.960940] [WARN ] [MAIN      ] CB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:49:30.961158] [INFO ] [MAIN      ] CB: Wiping existing primary data before full refresh.
[2025-10-24T17:49:30.961206] [INFO ] [LOCAL     ] CB: Starting deletion of primary data.
[2025-10-24T17:49:30.961410] [DEBUG] [LOCAL     ] CB: Deleted primary data file.
[2025-10-24T17:49:30.961470] [INFO ] [MAIN      ] CB: Starting full primary refresh.
[2025-10-24T17:49:31.342265] [INFO ] [REMOTE    ] CB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:49:31.347608] [INFO ] [REMOTE    ] CB: Fetching primary data for 2025-01.
[2025-10-24T17:49:31.863735] [INFO ] [REMOTE    ] CARR: Incremental fetch complete for 2025-08 (2.11 seconds).
[2025-10-24T17:49:32.147743] [INFO ] [REMOTE    ] CARR: Fetching primary data for 2025-09.
[2025-10-24T17:49:32.558112] [INFO ] [REMOTE    ] CAVA: Incremental fetch complete for 2025-01 (1.99 seconds).
[2025-10-24T17:49:32.947637] [INFO ] [REMOTE    ] CAVA: Fetching primary data for 2025-02.
[2025-10-24T17:49:33.182930] [INFO ] [REMOTE    ] CB: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T17:49:33.747636] [INFO ] [REMOTE    ] CAT: Fetching primary data for 2025-07.
[2025-10-24T17:49:33.803720] [INFO ] [REMOTE    ] CARR: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T17:49:34.547774] [INFO ] [REMOTE    ] CARR: Fetching primary data for 2025-10.
[2025-10-24T17:49:34.746518] [INFO ] [REMOTE    ] CAVA: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T17:49:35.347677] [INFO ] [REMOTE    ] CB: Fetching primary data for 2025-02.
[2025-10-24T17:49:35.747504] [INFO ] [REMOTE    ] CAT: Incremental fetch complete for 2025-07 (2.00 seconds).
[2025-10-24T17:49:36.147751] [INFO ] [REMOTE    ] CAT: Fetching primary data for 2025-08.
[2025-10-24T17:49:36.292588] [INFO ] [REMOTE    ] CARR: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T17:49:36.304097] [INFO ] [REMOTE    ] CARR: Full fetch complete (77771 records).
[2025-10-24T17:49:36.304361] [DEBUG] [VALIDATOR ] CARR: Validating primary data.
[2025-10-24T17:49:36.753805] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present.
[2025-10-24T17:49:36.753999] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed.
[2025-10-24T17:49:36.755546] [INFO ] [MAIN      ] CARR: Fetched primary data is valid.
[2025-10-24T17:49:36.755744] [DEBUG] [LOCAL     ] CARR: Saving primary data.
[2025-10-24T17:49:36.757134] [FATAL] [LOCAL     ] CARR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:49:36.757264] [FATAL] [MAIN      ] CARR: Failed to save primary data.
[2025-10-24T17:49:36.757333] [WARN ] [MAIN      ] CARR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:49:36.757406] [INFO ] [LOCAL     ] CARR: Starting deletion of primary data.
[2025-10-24T17:49:36.757483] [DEBUG] [LOCAL     ] CARR: No primary data file found to delete.
[2025-10-24T17:49:36.757525] [INFO ] [LOCAL     ] CARR: Starting deletion of derivative data.
[2025-10-24T17:49:36.757830] [DEBUG] [LOCAL     ] CARR: Deleted derivative data file.
[2025-10-24T17:49:36.758581] [INFO ] [MAIN      ] Update Progress: 397/2366 symbols completed. CARR took 48.3s. Estimated remaining: 4h 5m 49s. Rate: 8.0 symbols/min
[2025-10-24T17:49:36.827548] [INFO ] [REMOTE    ] CB: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T17:49:36.947681] [INFO ] [REMOTE    ] CB: Fetching primary data for 2025-03.
[2025-10-24T17:49:37.747718] [INFO ] [REMOTE    ] CAVA: Fetching primary data for 2025-03.
[2025-10-24T17:49:37.979834] [INFO ] [REMOTE    ] CAT: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T17:49:38.547784] [INFO ] [REMOTE    ] CAT: Fetching primary data for 2025-09.
[2025-10-24T17:49:38.618470] [INFO ] [REMOTE    ] CB: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T17:49:39.347760] [INFO ] [REMOTE    ] CB: Fetching primary data for 2025-04.
[2025-10-24T17:49:39.877995] [INFO ] [REMOTE    ] CAVA: Incremental fetch complete for 2025-03 (2.13 seconds).
[2025-10-24T17:49:40.147732] [INFO ] [REMOTE    ] CAVA: Fetching primary data for 2025-04.
[2025-10-24T17:49:40.309470] [INFO ] [REMOTE    ] CAT: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T17:49:40.947745] [INFO ] [REMOTE    ] CAT: Fetching primary data for 2025-10.
[2025-10-24T17:49:41.110558] [INFO ] [REMOTE    ] CB: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T17:49:41.747700] [INFO ] [REMOTE    ] CB: Fetching primary data for 2025-05.
[2025-10-24T17:49:42.231436] [INFO ] [REMOTE    ] CAVA: Incremental fetch complete for 2025-04 (2.08 seconds).
[2025-10-24T17:49:42.547758] [INFO ] [REMOTE    ] CAVA: Fetching primary data for 2025-05.
[2025-10-24T17:49:42.892045] [INFO ] [REMOTE    ] CAT: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T17:49:42.903774] [INFO ] [REMOTE    ] CAT: Full fetch complete (76865 records).
[2025-10-24T17:49:42.904047] [DEBUG] [VALIDATOR ] CAT: Validating primary data.
[2025-10-24T17:49:43.400586] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present.
[2025-10-24T17:49:43.400930] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed.
[2025-10-24T17:49:43.402253] [INFO ] [MAIN      ] CAT: Fetched primary data is valid.
[2025-10-24T17:49:43.402396] [DEBUG] [LOCAL     ] CAT: Saving primary data.
[2025-10-24T17:49:43.403555] [FATAL] [LOCAL     ] CAT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:49:43.403697] [FATAL] [MAIN      ] CAT: Failed to save primary data.
[2025-10-24T17:49:43.403854] [WARN ] [MAIN      ] CAT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:49:43.403979] [INFO ] [LOCAL     ] CAT: Starting deletion of primary data.
[2025-10-24T17:49:43.404087] [DEBUG] [LOCAL     ] CAT: No primary data file found to delete.
[2025-10-24T17:49:43.404272] [INFO ] [LOCAL     ] CAT: Starting deletion of derivative data.
[2025-10-24T17:49:43.404585] [DEBUG] [LOCAL     ] CAT: Deleted derivative data file.
[2025-10-24T17:49:43.405223] [INFO ] [MAIN      ] Update Progress: 398/2366 symbols completed. CAT took 37.3s. Estimated remaining: 4h 5m 38s. Rate: 8.0 symbols/min
[2025-10-24T17:49:43.454507] [INFO ] [REMOTE    ] CB: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T17:49:43.464725] [INFO ] [REMOTE    ] CB: Fetching primary data for 2025-06.
[2025-10-24T17:49:44.523248] [INFO ] [REMOTE    ] CAVA: Incremental fetch complete for 2025-05 (1.98 seconds).
[2025-10-24T17:49:44.536849] [INFO ] [REMOTE    ] CAVA: Fetching primary data for 2025-06.
[2025-10-24T17:49:44.894622] [INFO ] [REMOTE    ] CB: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T17:49:44.947693] [INFO ] [REMOTE    ] CB: Fetching primary data for 2025-07.
[2025-10-24T17:49:46.302520] [INFO ] [REMOTE    ] CAVA: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T17:49:46.314321] [INFO ] [REMOTE    ] CAVA: Fetching primary data for 2025-07.
[2025-10-24T17:49:46.825994] [INFO ] [REMOTE    ] CB: Incremental fetch complete for 2025-07 (1.88 seconds).
[2025-10-24T17:49:46.837304] [INFO ] [REMOTE    ] CB: Fetching primary data for 2025-08.
[2025-10-24T17:49:48.495377] [INFO ] [REMOTE    ] CAVA: Incremental fetch complete for 2025-07 (2.18 seconds).
[2025-10-24T17:49:48.508673] [INFO ] [REMOTE    ] CAVA: Fetching primary data for 2025-08.
[2025-10-24T17:49:48.541170] [INFO ] [REMOTE    ] CB: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T17:49:48.553138] [INFO ] [REMOTE    ] CB: Fetching primary data for 2025-09.
[2025-10-24T17:49:50.232132] [INFO ] [REMOTE    ] CAVA: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T17:49:50.243970] [INFO ] [REMOTE    ] CAVA: Fetching primary data for 2025-09.
[2025-10-24T17:49:50.272996] [INFO ] [REMOTE    ] CB: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T17:49:50.284145] [INFO ] [REMOTE    ] CB: Fetching primary data for 2025-10.
[2025-10-24T17:49:51.989029] [INFO ] [REMOTE    ] CB: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T17:49:51.998559] [INFO ] [REMOTE    ] CB: Full fetch complete (72511 records).
[2025-10-24T17:49:51.998732] [DEBUG] [VALIDATOR ] CB: Validating primary data.
[2025-10-24T17:49:51.999507] [FATAL] [VALIDATOR ] CB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:49:51.999592] [FATAL] [MAIN      ] CB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:49:51.999635] [WARN ] [MAIN      ] CB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:49:51.999712] [INFO ] [LOCAL     ] CB: Starting deletion of primary data.
[2025-10-24T17:49:51.999840] [DEBUG] [LOCAL     ] CB: No primary data file found to delete.
[2025-10-24T17:49:51.999894] [INFO ] [LOCAL     ] CB: Starting deletion of derivative data.
[2025-10-24T17:49:52.000013] [DEBUG] [LOCAL     ] CB: Deleted derivative data file.
[2025-10-24T17:49:52.000290] [INFO ] [MAIN      ] Update Progress: 399/2366 symbols completed. CB took 21.5s. Estimated remaining: 4h 5m 36s. Rate: 8.0 symbols/min
[2025-10-24T17:49:52.160849] [INFO ] [REMOTE    ] CAVA: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T17:49:52.172630] [INFO ] [REMOTE    ] CAVA: Fetching primary data for 2025-10.
[2025-10-24T17:49:54.361979] [INFO ] [REMOTE    ] CAVA: Incremental fetch complete for 2025-10 (2.19 seconds).
[2025-10-24T17:49:54.371575] [INFO ] [REMOTE    ] CAVA: Full fetch complete (77448 records).
[2025-10-24T17:49:54.371756] [DEBUG] [VALIDATOR ] CAVA: Validating primary data.
[2025-10-24T17:49:54.759459] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present.
[2025-10-24T17:49:54.759540] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed.
[2025-10-24T17:49:54.760366] [INFO ] [MAIN      ] CAVA: Fetched primary data is valid.
[2025-10-24T17:49:54.760430] [DEBUG] [LOCAL     ] CAVA: Saving primary data.
[2025-10-24T17:49:54.761036] [FATAL] [LOCAL     ] CAVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:49:54.761125] [FATAL] [MAIN      ] CAVA: Failed to save primary data.
[2025-10-24T17:49:54.761166] [WARN ] [MAIN      ] CAVA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:49:54.761200] [INFO ] [LOCAL     ] CAVA: Starting deletion of primary data.
[2025-10-24T17:49:54.761253] [DEBUG] [LOCAL     ] CAVA: No primary data file found to delete.
[2025-10-24T17:49:54.761287] [INFO ] [LOCAL     ] CAVA: Starting deletion of derivative data.
[2025-10-24T17:49:54.761418] [DEBUG] [LOCAL     ] CAVA: Deleted derivative data file.
[2025-10-24T17:49:54.762088] [INFO ] [MAIN      ] Update Progress: 400/2366 symbols completed. CAVA took 25.5s. Estimated remaining: 4h 5m 5s. Rate: 8.0 symbols/min
[2025-10-24T17:49:55.426516] [INFO ] [MAIN      ] CBO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:49:55.427734] [INFO ] [MAIN      ] CBL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:49:55.446695] [DEBUG] [LOCAL     ] CBO: No existing data file found in primary storage.
[2025-10-24T17:49:55.468501] [WARN ] [MAIN      ] CBO: No existing data found, performing full refresh instead.
[2025-10-24T17:49:55.470902] [INFO ] [MAIN      ] CBNA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:49:55.452415] [INFO ] [MAIN      ] CBAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:49:55.471251] [DEBUG] [LOCAL     ] CBNA: No existing data file found in primary storage.
[2025-10-24T17:49:55.471342] [WARN ] [MAIN      ] CBNA: No existing data found, performing full refresh instead.
[2025-10-24T17:49:55.471891] [INFO ] [MAIN      ] CBO: Wiping existing primary data before full refresh.
[2025-10-24T17:49:55.471505] [INFO ] [MAIN      ] CBNA: Wiping existing primary data before full refresh.
[2025-10-24T17:49:55.471951] [INFO ] [LOCAL     ] CBO: Starting deletion of primary data.
[2025-10-24T17:49:55.472054] [DEBUG] [LOCAL     ] CBO: No primary data file found to delete.
[2025-10-24T17:49:55.472219] [INFO ] [MAIN      ] CBO: Starting full primary refresh.
[2025-10-24T17:49:55.472168] [INFO ] [LOCAL     ] CBNA: Starting deletion of primary data.
[2025-10-24T17:49:55.492850] [DEBUG] [LOCAL     ] CBNA: No primary data file found to delete.
[2025-10-24T17:49:55.511814] [INFO ] [MAIN      ] CBNA: Starting full primary refresh.
[2025-10-24T17:49:55.600089] [DEBUG] [LOCAL     ] CBL: Loaded 16114 existing records from primary storage.
[2025-10-24T17:49:55.620382] [INFO ] [MAIN      ] CBL: Loaded 16114 existing records.
[2025-10-24T17:49:55.674405] [DEBUG] [LOCAL     ] CBAN: Loaded 10233 existing records from primary storage.
[2025-10-24T17:49:55.743921] [INFO ] [MAIN      ] CBAN: Loaded 10233 existing records.
[2025-10-24T17:49:56.336272] [WARN ] [MAIN      ] CBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:49:56.385160] [INFO ] [MAIN      ] CBL: Wiping existing primary data before full refresh.
[2025-10-24T17:49:56.431720] [INFO ] [LOCAL     ] CBL: Starting deletion of primary data.
[2025-10-24T17:49:56.529010] [DEBUG] [LOCAL     ] CBL: Deleted primary data file.
[2025-10-24T17:49:56.532269] [INFO ] [REMOTE    ] CBO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:49:56.532674] [INFO ] [REMOTE    ] CBO: Fetching primary data for 2025-01.
[2025-10-24T17:49:56.532410] [INFO ] [MAIN      ] CBL: Starting full primary refresh.
[2025-10-24T17:49:56.526603] [WARN ] [MAIN      ] CBAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:49:56.560709] [INFO ] [MAIN      ] CBAN: Wiping existing primary data before full refresh.
[2025-10-24T17:49:56.620934] [INFO ] [LOCAL     ] CBAN: Starting deletion of primary data.
[2025-10-24T17:49:56.664721] [DEBUG] [LOCAL     ] CBAN: Deleted primary data file.
[2025-10-24T17:49:56.695984] [INFO ] [REMOTE    ] CBNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:49:56.696268] [INFO ] [REMOTE    ] CBNA: Fetching primary data for 2025-01.
[2025-10-24T17:49:56.702210] [INFO ] [MAIN      ] CBAN: Starting full primary refresh.
[2025-10-24T17:49:56.801473] [DEBUG] [REMOTE    ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:49:56.864668] [WARN ] [REMOTE    ] CBO: No data returned for month 2025-01
[2025-10-24T17:49:56.940746] [FATAL] [REMOTE    ] CBO: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:49:56.958096] [FATAL] [MAIN      ] CBO: Failed to fetch primary data.
[2025-10-24T17:49:56.990942] [WARN ] [MAIN      ] CBO: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:49:57.025683] [INFO ] [LOCAL     ] CBO: Starting deletion of primary data.
[2025-10-24T17:49:57.043607] [DEBUG] [LOCAL     ] CBO: No primary data file found to delete.
[2025-10-24T17:49:57.106493] [INFO ] [LOCAL     ] CBO: Starting deletion of derivative data.
[2025-10-24T17:49:57.137670] [DEBUG] [LOCAL     ] CBO: No derivative data file found to delete.
[2025-10-24T17:49:57.162435] [INFO ] [MAIN      ] Update Progress: 401/2366 symbols completed. CBO took 2.4s. Estimated remaining: 4h 4m 33s. Rate: 8.0 symbols/min
[2025-10-24T17:49:57.324889] [INFO ] [REMOTE    ] CBL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:49:57.389758] [INFO ] [REMOTE    ] CBL: Fetching primary data for 2025-01.
[2025-10-24T17:49:57.498771] [INFO ] [REMOTE    ] CBAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:49:57.501257] [INFO ] [REMOTE    ] CBNA: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T17:49:57.500163] [INFO ] [REMOTE    ] CBAN: Fetching primary data for 2025-01.
[2025-10-24T17:49:57.508517] [INFO ] [REMOTE    ] CBNA: Fetching primary data for 2025-02.
[2025-10-24T17:49:57.579377] [INFO ] [MAIN      ] CBRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:49:57.630135] [DEBUG] [LOCAL     ] CBRE: Loaded 50665 existing records from primary storage.
[2025-10-24T17:49:57.630461] [INFO ] [MAIN      ] CBRE: Loaded 50665 existing records.
[2025-10-24T17:49:57.810586] [WARN ] [MAIN      ] CBRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:49:57.810834] [INFO ] [MAIN      ] CBRE: Wiping existing primary data before full refresh.
[2025-10-24T17:49:57.810883] [INFO ] [LOCAL     ] CBRE: Starting deletion of primary data.
[2025-10-24T17:49:57.811297] [DEBUG] [LOCAL     ] CBRE: Deleted primary data file.
[2025-10-24T17:49:57.811338] [INFO ] [MAIN      ] CBRE: Starting full primary refresh.
[2025-10-24T17:49:57.891350] [INFO ] [REMOTE    ] CBNA: Incremental fetch complete for 2025-02 (0.38 seconds).
[2025-10-24T17:49:57.909205] [INFO ] [REMOTE    ] CBNA: Fetching primary data for 2025-03.
[2025-10-24T17:49:58.182791] [INFO ] [REMOTE    ] CBRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:49:58.183148] [INFO ] [REMOTE    ] CBRE: Fetching primary data for 2025-01.
[2025-10-24T17:49:58.292809] [INFO ] [REMOTE    ] CBNA: Incremental fetch complete for 2025-03 (0.38 seconds).
[2025-10-24T17:49:58.294180] [INFO ] [REMOTE    ] CBNA: Fetching primary data for 2025-04.
[2025-10-24T17:49:58.504579] [INFO ] [REMOTE    ] CBL: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T17:49:58.508941] [INFO ] [REMOTE    ] CBL: Fetching primary data for 2025-02.
[2025-10-24T17:49:58.571764] [INFO ] [REMOTE    ] CBAN: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T17:49:58.574682] [INFO ] [REMOTE    ] CBAN: Fetching primary data for 2025-02.
[2025-10-24T17:49:58.617834] [INFO ] [REMOTE    ] CBNA: Incremental fetch complete for 2025-04 (0.32 seconds).
[2025-10-24T17:49:59.347636] [INFO ] [REMOTE    ] CBNA: Fetching primary data for 2025-05.
[2025-10-24T17:49:59.376609] [INFO ] [REMOTE    ] CBAN: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T17:49:59.490851] [INFO ] [REMOTE    ] CBL: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T17:49:59.657911] [INFO ] [REMOTE    ] CBRE: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T17:49:59.780500] [INFO ] [REMOTE    ] CBNA: Incremental fetch complete for 2025-05 (0.43 seconds).
[2025-10-24T17:50:00.147698] [INFO ] [REMOTE    ] CBAN: Fetching primary data for 2025-03.
[2025-10-24T17:50:00.947634] [INFO ] [REMOTE    ] CBL: Fetching primary data for 2025-03.
[2025-10-24T17:50:01.535151] [INFO ] [REMOTE    ] CBAN: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T17:50:01.747744] [INFO ] [REMOTE    ] CBNA: Fetching primary data for 2025-06.
[2025-10-24T17:50:02.340242] [INFO ] [REMOTE    ] CBL: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T17:50:02.544420] [INFO ] [REMOTE    ] CBNA: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T17:50:02.547609] [INFO ] [REMOTE    ] CBRE: Fetching primary data for 2025-02.
[2025-10-24T17:50:03.347764] [INFO ] [REMOTE    ] CBL: Fetching primary data for 2025-04.
[2025-10-24T17:50:04.147753] [INFO ] [REMOTE    ] CBNA: Fetching primary data for 2025-07.
[2025-10-24T17:50:04.943034] [INFO ] [REMOTE    ] CBRE: Incremental fetch complete for 2025-02 (2.40 seconds).
[2025-10-24T17:50:04.952794] [INFO ] [REMOTE    ] CBAN: Fetching primary data for 2025-04.
[2025-10-24T17:50:05.200327] [INFO ] [REMOTE    ] CBL: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T17:50:05.323269] [INFO ] [REMOTE    ] CBNA: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T17:50:05.747743] [INFO ] [REMOTE    ] CBNA: Fetching primary data for 2025-08.
[2025-10-24T17:50:06.063106] [INFO ] [REMOTE    ] CBAN: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T17:50:06.547725] [INFO ] [REMOTE    ] CBL: Fetching primary data for 2025-05.
[2025-10-24T17:50:06.887758] [INFO ] [REMOTE    ] CBNA: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T17:50:07.347717] [INFO ] [REMOTE    ] CBAN: Fetching primary data for 2025-05.
[2025-10-24T17:50:08.119802] [INFO ] [REMOTE    ] CBAN: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T17:50:08.147623] [INFO ] [REMOTE    ] CBAN: Fetching primary data for 2025-06.
[2025-10-24T17:50:08.202351] [INFO ] [REMOTE    ] CBL: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T17:50:08.654560] [INFO ] [REMOTE    ] CBAN: Incremental fetch complete for 2025-06 (0.51 seconds).
[2025-10-24T17:50:08.947674] [INFO ] [REMOTE    ] CBL: Fetching primary data for 2025-06.
[2025-10-24T17:50:09.747757] [INFO ] [REMOTE    ] CBAN: Fetching primary data for 2025-07.
[2025-10-24T17:50:10.068997] [INFO ] [REMOTE    ] CBL: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T17:50:10.393082] [INFO ] [REMOTE    ] CBAN: Incremental fetch complete for 2025-07 (0.65 seconds).
[2025-10-24T17:50:10.547716] [INFO ] [REMOTE    ] CBRE: Fetching primary data for 2025-03.
[2025-10-24T17:50:11.347729] [INFO ] [REMOTE    ] CBAN: Fetching primary data for 2025-08.
[2025-10-24T17:50:12.147674] [INFO ] [REMOTE    ] CBL: Fetching primary data for 2025-07.
[2025-10-24T17:50:12.295008] [INFO ] [REMOTE    ] CBRE: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T17:50:12.325522] [INFO ] [REMOTE    ] CBAN: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T17:50:12.947680] [INFO ] [REMOTE    ] CBNA: Fetching primary data for 2025-09.
[2025-10-24T17:50:12.962923] [INFO ] [REMOTE    ] CBL: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T17:50:13.392737] [INFO ] [REMOTE    ] CBNA: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T17:50:13.747673] [INFO ] [REMOTE    ] CBNA: Fetching primary data for 2025-10.
[2025-10-24T17:50:14.237975] [INFO ] [REMOTE    ] CBNA: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T17:50:14.239062] [INFO ] [REMOTE    ] CBNA: Full fetch complete (4222 records).
[2025-10-24T17:50:14.239136] [DEBUG] [VALIDATOR ] CBNA: Validating primary data.
[2025-10-24T17:50:14.554340] [INFO ] [REMOTE    ] CBRE: Fetching primary data for 2025-04.
[2025-10-24T17:50:14.638937] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present.
[2025-10-24T17:50:14.639023] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed.
[2025-10-24T17:50:14.639174] [INFO ] [MAIN      ] CBNA: Fetched primary data is valid.
[2025-10-24T17:50:14.639214] [DEBUG] [LOCAL     ] CBNA: Saving primary data.
[2025-10-24T17:50:14.639400] [FATAL] [LOCAL     ] CBNA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:50:14.639484] [FATAL] [MAIN      ] CBNA: Failed to save primary data.
[2025-10-24T17:50:14.639525] [WARN ] [MAIN      ] CBNA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:50:14.639558] [INFO ] [LOCAL     ] CBNA: Starting deletion of primary data.
[2025-10-24T17:50:14.639629] [DEBUG] [LOCAL     ] CBNA: No primary data file found to delete.
[2025-10-24T17:50:14.639700] [INFO ] [LOCAL     ] CBNA: Starting deletion of derivative data.
[2025-10-24T17:50:14.639755] [DEBUG] [LOCAL     ] CBNA: No derivative data file found to delete.
[2025-10-24T17:50:14.639858] [INFO ] [MAIN      ] Update Progress: 402/2366 symbols completed. CBNA took 19.9s. Estimated remaining: 4h 5m 14s. Rate: 8.0 symbols/min
[2025-10-24T17:50:14.803828] [INFO ] [MAIN      ] CBT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:50:14.833572] [DEBUG] [LOCAL     ] CBT: Loaded 31110 existing records from primary storage.
[2025-10-24T17:50:14.833896] [INFO ] [MAIN      ] CBT: Loaded 31110 existing records.
[2025-10-24T17:50:15.022498] [WARN ] [MAIN      ] CBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:50:15.022759] [INFO ] [MAIN      ] CBT: Wiping existing primary data before full refresh.
[2025-10-24T17:50:15.022810] [INFO ] [LOCAL     ] CBT: Starting deletion of primary data.
[2025-10-24T17:50:15.023083] [DEBUG] [LOCAL     ] CBT: Deleted primary data file.
[2025-10-24T17:50:15.023139] [INFO ] [MAIN      ] CBT: Starting full primary refresh.
[2025-10-24T17:50:15.361454] [INFO ] [REMOTE    ] CBL: Fetching primary data for 2025-08.
[2025-10-24T17:50:15.403690] [INFO ] [REMOTE    ] CBT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:50:16.147624] [INFO ] [REMOTE    ] CBT: Fetching primary data for 2025-01.
[2025-10-24T17:50:16.401101] [INFO ] [REMOTE    ] CBL: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T17:50:16.400636] [INFO ] [REMOTE    ] CBRE: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T17:50:16.947674] [INFO ] [REMOTE    ] CBL: Fetching primary data for 2025-09.
[2025-10-24T17:50:17.260845] [INFO ] [REMOTE    ] CBT: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T17:50:17.747679] [INFO ] [REMOTE    ] CBT: Fetching primary data for 2025-02.
[2025-10-24T17:50:17.863200] [INFO ] [REMOTE    ] CBL: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T17:50:18.547692] [INFO ] [REMOTE    ] CBAN: Fetching primary data for 2025-09.
[2025-10-24T17:50:18.724923] [INFO ] [REMOTE    ] CBT: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T17:50:19.347618] [INFO ] [REMOTE    ] CBL: Fetching primary data for 2025-10.
[2025-10-24T17:50:19.481311] [INFO ] [REMOTE    ] CBAN: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T17:50:20.147722] [INFO ] [REMOTE    ] CBRE: Fetching primary data for 2025-05.
[2025-10-24T17:50:20.325822] [INFO ] [REMOTE    ] CBL: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T17:50:20.328903] [INFO ] [REMOTE    ] CBL: Full fetch complete (24674 records).
[2025-10-24T17:50:20.328991] [DEBUG] [VALIDATOR ] CBL: Validating primary data.
[2025-10-24T17:50:20.691043] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present.
[2025-10-24T17:50:20.691120] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed.
[2025-10-24T17:50:20.691521] [INFO ] [MAIN      ] CBL: Fetched primary data is valid.
[2025-10-24T17:50:20.691560] [DEBUG] [LOCAL     ] CBL: Saving primary data.
[2025-10-24T17:50:20.691857] [FATAL] [LOCAL     ] CBL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:50:20.691959] [FATAL] [MAIN      ] CBL: Failed to save primary data.
[2025-10-24T17:50:20.692000] [WARN ] [MAIN      ] CBL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:50:20.692033] [INFO ] [LOCAL     ] CBL: Starting deletion of primary data.
[2025-10-24T17:50:20.692079] [DEBUG] [LOCAL     ] CBL: No primary data file found to delete.
[2025-10-24T17:50:20.692112] [INFO ] [LOCAL     ] CBL: Starting deletion of derivative data.
[2025-10-24T17:50:20.692270] [DEBUG] [LOCAL     ] CBL: Deleted derivative data file.
[2025-10-24T17:50:20.692370] [INFO ] [MAIN      ] Update Progress: 403/2366 symbols completed. CBL took 25.9s. Estimated remaining: 4h 4m 60s. Rate: 8.0 symbols/min
[2025-10-24T17:50:20.857519] [INFO ] [MAIN      ] CBU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:50:20.878865] [DEBUG] [LOCAL     ] CBU: Loaded 22766 existing records from primary storage.
[2025-10-24T17:50:20.879111] [INFO ] [MAIN      ] CBU: Loaded 22766 existing records.
[2025-10-24T17:50:20.952853] [INFO ] [REMOTE    ] CBT: Fetching primary data for 2025-03.
[2025-10-24T17:50:21.079286] [WARN ] [MAIN      ] CBU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:50:21.079487] [INFO ] [MAIN      ] CBU: Wiping existing primary data before full refresh.
[2025-10-24T17:50:21.079534] [INFO ] [LOCAL     ] CBU: Starting deletion of primary data.
[2025-10-24T17:50:21.079858] [DEBUG] [LOCAL     ] CBU: Deleted primary data file.
[2025-10-24T17:50:21.079914] [INFO ] [MAIN      ] CBU: Starting full primary refresh.
[2025-10-24T17:50:21.444417] [INFO ] [REMOTE    ] CBU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:50:21.747620] [INFO ] [REMOTE    ] CBAN: Fetching primary data for 2025-10.
[2025-10-24T17:50:21.824113] [INFO ] [REMOTE    ] CBRE: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T17:50:22.100388] [INFO ] [REMOTE    ] CBT: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T17:50:22.290766] [INFO ] [REMOTE    ] CBAN: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T17:50:22.292880] [INFO ] [REMOTE    ] CBAN: Full fetch complete (16288 records).
[2025-10-24T17:50:22.292954] [DEBUG] [VALIDATOR ] CBAN: Validating primary data.
[2025-10-24T17:50:22.552744] [INFO ] [REMOTE    ] CBU: Fetching primary data for 2025-01.
[2025-10-24T17:50:22.656122] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present.
[2025-10-24T17:50:22.656195] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed.
[2025-10-24T17:50:22.656550] [INFO ] [MAIN      ] CBAN: Fetched primary data is valid.
[2025-10-24T17:50:22.656609] [DEBUG] [LOCAL     ] CBAN: Saving primary data.
[2025-10-24T17:50:22.656864] [FATAL] [LOCAL     ] CBAN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:50:22.656945] [FATAL] [MAIN      ] CBAN: Failed to save primary data.
[2025-10-24T17:50:22.656987] [WARN ] [MAIN      ] CBAN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:50:22.657045] [INFO ] [LOCAL     ] CBAN: Starting deletion of primary data.
[2025-10-24T17:50:22.657100] [DEBUG] [LOCAL     ] CBAN: No primary data file found to delete.
[2025-10-24T17:50:22.657135] [INFO ] [LOCAL     ] CBAN: Starting deletion of derivative data.
[2025-10-24T17:50:22.657276] [DEBUG] [LOCAL     ] CBAN: Deleted derivative data file.
[2025-10-24T17:50:22.657365] [INFO ] [MAIN      ] Update Progress: 404/2366 symbols completed. CBAN took 27.9s. Estimated remaining: 4h 4m 25s. Rate: 8.0 symbols/min
[2025-10-24T17:50:22.829294] [INFO ] [MAIN      ] CBX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:50:22.829482] [DEBUG] [LOCAL     ] CBX: No existing data file found in primary storage.
[2025-10-24T17:50:22.829521] [WARN ] [MAIN      ] CBX: No existing data found, performing full refresh instead.
[2025-10-24T17:50:22.829631] [INFO ] [MAIN      ] CBX: Wiping existing primary data before full refresh.
[2025-10-24T17:50:22.829711] [INFO ] [LOCAL     ] CBX: Starting deletion of primary data.
[2025-10-24T17:50:22.829763] [DEBUG] [LOCAL     ] CBX: No primary data file found to delete.
[2025-10-24T17:50:22.829801] [INFO ] [MAIN      ] CBX: Starting full primary refresh.
[2025-10-24T17:50:23.193411] [INFO ] [REMOTE    ] CBX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:50:23.347626] [INFO ] [REMOTE    ] CBX: Fetching primary data for 2025-01.
[2025-10-24T17:50:23.589066] [DEBUG] [REMOTE    ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:50:23.589321] [WARN ] [REMOTE    ] CBX: No data returned for month 2025-01
[2025-10-24T17:50:23.589411] [FATAL] [REMOTE    ] CBX: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:50:23.589483] [FATAL] [MAIN      ] CBX: Failed to fetch primary data.
[2025-10-24T17:50:23.589549] [WARN ] [MAIN      ] CBX: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:50:23.589629] [INFO ] [LOCAL     ] CBX: Starting deletion of primary data.
[2025-10-24T17:50:23.589740] [DEBUG] [LOCAL     ] CBX: No primary data file found to delete.
[2025-10-24T17:50:23.589787] [INFO ] [LOCAL     ] CBX: Starting deletion of derivative data.
[2025-10-24T17:50:23.589828] [DEBUG] [LOCAL     ] CBX: No derivative data file found to delete.
[2025-10-24T17:50:23.589875] [INFO ] [MAIN      ] Update Progress: 405/2366 symbols completed. CBX took 0.9s. Estimated remaining: 4h 3m 46s. Rate: 8.0 symbols/min
[2025-10-24T17:50:23.770995] [INFO ] [MAIN      ] CBZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:50:23.805972] [DEBUG] [LOCAL     ] CBZ: Loaded 34489 existing records from primary storage.
[2025-10-24T17:50:23.806259] [INFO ] [MAIN      ] CBZ: Loaded 34489 existing records.
[2025-10-24T17:50:23.984876] [INFO ] [REMOTE    ] CBU: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T17:50:24.009779] [WARN ] [MAIN      ] CBZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:50:24.010088] [INFO ] [MAIN      ] CBZ: Wiping existing primary data before full refresh.
[2025-10-24T17:50:24.010146] [INFO ] [LOCAL     ] CBZ: Starting deletion of primary data.
[2025-10-24T17:50:24.010758] [DEBUG] [LOCAL     ] CBZ: Deleted primary data file.
[2025-10-24T17:50:24.010816] [INFO ] [MAIN      ] CBZ: Starting full primary refresh.
[2025-10-24T17:50:24.154700] [INFO ] [REMOTE    ] CBU: Fetching primary data for 2025-02.
[2025-10-24T17:50:24.377850] [INFO ] [REMOTE    ] CBZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:50:24.947712] [INFO ] [REMOTE    ] CBZ: Fetching primary data for 2025-01.
[2025-10-24T17:50:25.126037] [INFO ] [REMOTE    ] CBU: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T17:50:25.748008] [INFO ] [REMOTE    ] CBU: Fetching primary data for 2025-03.
[2025-10-24T17:50:26.152291] [INFO ] [REMOTE    ] CBZ: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T17:50:26.547683] [INFO ] [REMOTE    ] CBZ: Fetching primary data for 2025-02.
[2025-10-24T17:50:26.579503] [INFO ] [REMOTE    ] CBU: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T17:50:27.347700] [INFO ] [REMOTE    ] CBU: Fetching primary data for 2025-04.
[2025-10-24T17:50:27.630161] [INFO ] [REMOTE    ] CBZ: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T17:50:28.147702] [INFO ] [REMOTE    ] CBT: Fetching primary data for 2025-04.
[2025-10-24T17:50:28.554996] [INFO ] [REMOTE    ] CBU: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T17:50:28.947689] [INFO ] [REMOTE    ] CBRE: Fetching primary data for 2025-06.
[2025-10-24T17:50:29.694678] [INFO ] [REMOTE    ] CBT: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T17:50:29.747675] [INFO ] [REMOTE    ] CBZ: Fetching primary data for 2025-03.
[2025-10-24T17:50:30.542026] [INFO ] [REMOTE    ] CBRE: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T17:50:30.551443] [INFO ] [REMOTE    ] CBU: Fetching primary data for 2025-05.
[2025-10-24T17:50:30.985280] [INFO ] [REMOTE    ] CBZ: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T17:50:31.347670] [INFO ] [REMOTE    ] CBT: Fetching primary data for 2025-05.
[2025-10-24T17:50:31.472308] [INFO ] [REMOTE    ] CBU: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T17:50:32.147620] [INFO ] [REMOTE    ] CBZ: Fetching primary data for 2025-04.
[2025-10-24T17:50:32.242070] [INFO ] [REMOTE    ] CBT: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T17:50:32.947691] [INFO ] [REMOTE    ] CBU: Fetching primary data for 2025-06.
[2025-10-24T17:50:33.546902] [INFO ] [REMOTE    ] CBZ: Incremental fetch complete for 2025-04 (1.40 seconds).
[2025-10-24T17:50:33.747715] [INFO ] [REMOTE    ] CBRE: Fetching primary data for 2025-07.
[2025-10-24T17:50:33.915133] [INFO ] [REMOTE    ] CBU: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T17:50:34.547709] [INFO ] [REMOTE    ] CBU: Fetching primary data for 2025-07.
[2025-10-24T17:50:35.347678] [INFO ] [REMOTE    ] CBT: Fetching primary data for 2025-06.
[2025-10-24T17:50:35.595586] [INFO ] [REMOTE    ] CBU: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T17:50:35.671218] [INFO ] [REMOTE    ] CBRE: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T17:50:36.147679] [INFO ] [REMOTE    ] CBRE: Fetching primary data for 2025-08.
[2025-10-24T17:50:36.637840] [INFO ] [REMOTE    ] CBT: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T17:50:36.947672] [INFO ] [REMOTE    ] CBZ: Fetching primary data for 2025-05.
[2025-10-24T17:50:37.747750] [INFO ] [REMOTE    ] CBT: Fetching primary data for 2025-07.
[2025-10-24T17:50:37.827009] [INFO ] [REMOTE    ] CBRE: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T17:50:38.279141] [INFO ] [REMOTE    ] CBZ: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T17:50:38.547731] [INFO ] [REMOTE    ] CBRE: Fetching primary data for 2025-09.
[2025-10-24T17:50:38.612895] [INFO ] [REMOTE    ] CBT: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T17:50:39.347687] [INFO ] [REMOTE    ] CBU: Fetching primary data for 2025-08.
[2025-10-24T17:50:40.147692] [INFO ] [REMOTE    ] CBZ: Fetching primary data for 2025-06.
[2025-10-24T17:50:40.266330] [INFO ] [REMOTE    ] CBRE: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T17:50:40.449631] [INFO ] [REMOTE    ] CBU: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T17:50:40.947685] [INFO ] [REMOTE    ] CBU: Fetching primary data for 2025-09.
[2025-10-24T17:50:41.093363] [INFO ] [REMOTE    ] CBZ: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T17:50:41.747638] [INFO ] [REMOTE    ] CBZ: Fetching primary data for 2025-07.
[2025-10-24T17:50:42.139080] [INFO ] [REMOTE    ] CBU: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T17:50:42.547728] [INFO ] [REMOTE    ] CBRE: Fetching primary data for 2025-10.
[2025-10-24T17:50:42.885387] [INFO ] [REMOTE    ] CBZ: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T17:50:43.347625] [INFO ] [REMOTE    ] CBZ: Fetching primary data for 2025-08.
[2025-10-24T17:50:44.147615] [INFO ] [REMOTE    ] CBU: Fetching primary data for 2025-10.
[2025-10-24T17:50:44.253785] [INFO ] [REMOTE    ] CBRE: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T17:50:44.262882] [INFO ] [REMOTE    ] CBRE: Full fetch complete (73755 records).
[2025-10-24T17:50:44.263032] [DEBUG] [VALIDATOR ] CBRE: Validating primary data.
[2025-10-24T17:50:44.654834] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present.
[2025-10-24T17:50:44.654935] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed.
[2025-10-24T17:50:44.655756] [INFO ] [MAIN      ] CBRE: Fetched primary data is valid.
[2025-10-24T17:50:44.655840] [DEBUG] [LOCAL     ] CBRE: Saving primary data.
[2025-10-24T17:50:44.656558] [FATAL] [LOCAL     ] CBRE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:50:44.656734] [FATAL] [MAIN      ] CBRE: Failed to save primary data.
[2025-10-24T17:50:44.656949] [WARN ] [MAIN      ] CBRE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:50:44.675900] [INFO ] [LOCAL     ] CBRE: Starting deletion of primary data.
[2025-10-24T17:50:44.676078] [DEBUG] [LOCAL     ] CBRE: No primary data file found to delete.
[2025-10-24T17:50:44.676139] [INFO ] [LOCAL     ] CBRE: Starting deletion of derivative data.
[2025-10-24T17:50:44.676529] [DEBUG] [LOCAL     ] CBRE: Deleted derivative data file.
[2025-10-24T17:50:44.677156] [INFO ] [MAIN      ] Update Progress: 406/2366 symbols completed. CBRE took 47.5s. Estimated remaining: 4h 4m 44s. Rate: 8.0 symbols/min
[2025-10-24T17:50:44.678045] [INFO ] [REMOTE    ] CBZ: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T17:50:44.853143] [INFO ] [MAIN      ] CC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:50:44.911194] [DEBUG] [LOCAL     ] CC: Loaded 53392 existing records from primary storage.
[2025-10-24T17:50:44.911561] [INFO ] [MAIN      ] CC: Loaded 53392 existing records.
[2025-10-24T17:50:44.953497] [INFO ] [REMOTE    ] CBT: Fetching primary data for 2025-08.
[2025-10-24T17:50:45.097203] [WARN ] [MAIN      ] CC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:50:45.097431] [INFO ] [MAIN      ] CC: Wiping existing primary data before full refresh.
[2025-10-24T17:50:45.097519] [INFO ] [LOCAL     ] CC: Starting deletion of primary data.
[2025-10-24T17:50:45.097845] [DEBUG] [LOCAL     ] CC: Deleted primary data file.
[2025-10-24T17:50:45.097901] [INFO ] [MAIN      ] CC: Starting full primary refresh.
[2025-10-24T17:50:45.463015] [INFO ] [REMOTE    ] CC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:50:45.486568] [INFO ] [REMOTE    ] CBU: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T17:50:45.491404] [INFO ] [REMOTE    ] CBU: Full fetch complete (32662 records).
[2025-10-24T17:50:45.491511] [DEBUG] [VALIDATOR ] CBU: Validating primary data.
[2025-10-24T17:50:45.752773] [INFO ] [REMOTE    ] CC: Fetching primary data for 2025-01.
[2025-10-24T17:50:45.874055] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present.
[2025-10-24T17:50:45.874130] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed.
[2025-10-24T17:50:45.874662] [INFO ] [MAIN      ] CBU: Fetched primary data is valid.
[2025-10-24T17:50:45.874723] [DEBUG] [LOCAL     ] CBU: Saving primary data.
[2025-10-24T17:50:45.875054] [FATAL] [LOCAL     ] CBU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:50:45.875137] [FATAL] [MAIN      ] CBU: Failed to save primary data.
[2025-10-24T17:50:45.875178] [WARN ] [MAIN      ] CBU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:50:45.875240] [INFO ] [LOCAL     ] CBU: Starting deletion of primary data.
[2025-10-24T17:50:45.875296] [DEBUG] [LOCAL     ] CBU: No primary data file found to delete.
[2025-10-24T17:50:45.875331] [INFO ] [LOCAL     ] CBU: Starting deletion of derivative data.
[2025-10-24T17:50:45.875459] [DEBUG] [LOCAL     ] CBU: Deleted derivative data file.
[2025-10-24T17:50:45.875532] [INFO ] [MAIN      ] Update Progress: 407/2366 symbols completed. CBU took 25.2s. Estimated remaining: 4h 4m 7s. Rate: 8.0 symbols/min
[2025-10-24T17:50:46.046333] [INFO ] [MAIN      ] CCI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:50:46.072877] [INFO ] [REMOTE    ] CBT: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T17:50:46.122208] [DEBUG] [LOCAL     ] CCI: Loaded 53497 existing records from primary storage.
[2025-10-24T17:50:46.122518] [INFO ] [MAIN      ] CCI: Loaded 53497 existing records.
[2025-10-24T17:50:46.296933] [WARN ] [MAIN      ] CCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:50:46.297127] [INFO ] [MAIN      ] CCI: Wiping existing primary data before full refresh.
[2025-10-24T17:50:46.297190] [INFO ] [LOCAL     ] CCI: Starting deletion of primary data.
[2025-10-24T17:50:46.297547] [DEBUG] [LOCAL     ] CCI: Deleted primary data file.
[2025-10-24T17:50:46.297601] [INFO ] [MAIN      ] CCI: Starting full primary refresh.
[2025-10-24T17:50:46.556932] [INFO ] [REMOTE    ] CBZ: Fetching primary data for 2025-09.
[2025-10-24T17:50:46.724465] [INFO ] [REMOTE    ] CCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:50:47.340727] [INFO ] [REMOTE    ] CC: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T17:50:47.350003] [INFO ] [REMOTE    ] CCI: Fetching primary data for 2025-01.
[2025-10-24T17:50:48.048143] [INFO ] [REMOTE    ] CBZ: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T17:50:48.147635] [INFO ] [REMOTE    ] CBZ: Fetching primary data for 2025-10.
[2025-10-24T17:50:48.947639] [INFO ] [REMOTE    ] CBT: Fetching primary data for 2025-09.
[2025-10-24T17:50:49.002407] [INFO ] [REMOTE    ] CCI: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T17:50:49.750080] [INFO ] [REMOTE    ] CC: Fetching primary data for 2025-02.
[2025-10-24T17:50:49.754014] [INFO ] [REMOTE    ] CBZ: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T17:50:49.761057] [INFO ] [REMOTE    ] CBZ: Full fetch complete (46275 records).
[2025-10-24T17:50:49.761156] [DEBUG] [VALIDATOR ] CBZ: Validating primary data.
[2025-10-24T17:50:49.761840] [FATAL] [VALIDATOR ] CBZ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:50:49.761922] [FATAL] [MAIN      ] CBZ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:50:49.761988] [WARN ] [MAIN      ] CBZ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:50:49.762245] [INFO ] [LOCAL     ] CBZ: Starting deletion of primary data.
[2025-10-24T17:50:49.762382] [DEBUG] [LOCAL     ] CBZ: No primary data file found to delete.
[2025-10-24T17:50:49.762426] [INFO ] [LOCAL     ] CBZ: Starting deletion of derivative data.
[2025-10-24T17:50:49.762545] [DEBUG] [LOCAL     ] CBZ: Deleted derivative data file.
[2025-10-24T17:50:49.762956] [INFO ] [MAIN      ] Update Progress: 408/2366 symbols completed. CBZ took 26.2s. Estimated remaining: 4h 3m 42s. Rate: 8.0 symbols/min
[2025-10-24T17:50:49.941535] [INFO ] [MAIN      ] CCIA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:50:49.941794] [DEBUG] [LOCAL     ] CCIA: No existing data file found in primary storage.
[2025-10-24T17:50:49.941860] [WARN ] [MAIN      ] CCIA: No existing data found, performing full refresh instead.
[2025-10-24T17:50:49.942003] [INFO ] [MAIN      ] CCIA: Wiping existing primary data before full refresh.
[2025-10-24T17:50:49.942071] [INFO ] [LOCAL     ] CCIA: Starting deletion of primary data.
[2025-10-24T17:50:49.942161] [DEBUG] [LOCAL     ] CCIA: No primary data file found to delete.
[2025-10-24T17:50:49.942329] [INFO ] [MAIN      ] CCIA: Starting full primary refresh.
[2025-10-24T17:50:50.216160] [INFO ] [REMOTE    ] CBT: Incremental fetch complete for 2025-09 (1.27 seconds).
[2025-10-24T17:50:50.322983] [INFO ] [REMOTE    ] CCIA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:50:50.547698] [INFO ] [REMOTE    ] CCIA: Fetching primary data for 2025-01.
[2025-10-24T17:50:51.115251] [INFO ] [REMOTE    ] CC: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T17:50:51.115397] [INFO ] [REMOTE    ] CCIA: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T17:50:51.347684] [INFO ] [REMOTE    ] CCI: Fetching primary data for 2025-02.
[2025-10-24T17:50:52.147638] [INFO ] [REMOTE    ] CBT: Fetching primary data for 2025-10.
[2025-10-24T17:50:52.935662] [INFO ] [REMOTE    ] CCI: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T17:50:52.947606] [INFO ] [REMOTE    ] CCIA: Fetching primary data for 2025-02.
[2025-10-24T17:50:53.277859] [INFO ] [REMOTE    ] CCIA: Incremental fetch complete for 2025-02 (0.33 seconds).
[2025-10-24T17:50:53.453267] [INFO ] [REMOTE    ] CBT: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T17:50:53.459562] [INFO ] [REMOTE    ] CBT: Full fetch complete (45786 records).
[2025-10-24T17:50:53.459732] [DEBUG] [VALIDATOR ] CBT: Validating primary data.
[2025-10-24T17:50:53.752843] [INFO ] [REMOTE    ] CCI: Fetching primary data for 2025-03.
[2025-10-24T17:50:53.859197] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present.
[2025-10-24T17:50:53.859310] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed.
[2025-10-24T17:50:53.860249] [INFO ] [MAIN      ] CBT: Fetched primary data is valid.
[2025-10-24T17:50:53.860316] [DEBUG] [LOCAL     ] CBT: Saving primary data.
[2025-10-24T17:50:53.861042] [FATAL] [LOCAL     ] CBT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:50:53.861145] [FATAL] [MAIN      ] CBT: Failed to save primary data.
[2025-10-24T17:50:53.861187] [WARN ] [MAIN      ] CBT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:50:53.861223] [INFO ] [LOCAL     ] CBT: Starting deletion of primary data.
[2025-10-24T17:50:53.861279] [DEBUG] [LOCAL     ] CBT: No primary data file found to delete.
[2025-10-24T17:50:53.861316] [INFO ] [LOCAL     ] CBT: Starting deletion of derivative data.
[2025-10-24T17:50:53.861588] [DEBUG] [LOCAL     ] CBT: Deleted derivative data file.
[2025-10-24T17:50:53.861774] [INFO ] [MAIN      ] Update Progress: 409/2366 symbols completed. CBT took 39.2s. Estimated remaining: 4h 3m 18s. Rate: 8.0 symbols/min
[2025-10-24T17:50:54.048262] [INFO ] [MAIN      ] CCIF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:50:54.067044] [DEBUG] [LOCAL     ] CCIF: Loaded 15230 existing records from primary storage.
[2025-10-24T17:50:54.067410] [INFO ] [MAIN      ] CCIF: Loaded 15230 existing records.
[2025-10-24T17:50:54.254548] [WARN ] [MAIN      ] CCIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:50:54.254884] [INFO ] [MAIN      ] CCIF: Wiping existing primary data before full refresh.
[2025-10-24T17:50:54.254981] [INFO ] [LOCAL     ] CCIF: Starting deletion of primary data.
[2025-10-24T17:50:54.255251] [DEBUG] [LOCAL     ] CCIF: Deleted primary data file.
[2025-10-24T17:50:54.255292] [INFO ] [MAIN      ] CCIF: Starting full primary refresh.
[2025-10-24T17:50:54.552808] [INFO ] [REMOTE    ] CC: Fetching primary data for 2025-03.
[2025-10-24T17:50:54.635254] [INFO ] [REMOTE    ] CCIF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:50:55.347675] [INFO ] [REMOTE    ] CCIF: Fetching primary data for 2025-01.
[2025-10-24T17:50:55.832699] [INFO ] [REMOTE    ] CCI: Incremental fetch complete for 2025-03 (2.08 seconds).
[2025-10-24T17:50:55.956929] [INFO ] [REMOTE    ] CC: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T17:50:56.147625] [INFO ] [REMOTE    ] CCI: Fetching primary data for 2025-04.
[2025-10-24T17:50:56.429123] [INFO ] [REMOTE    ] CCIF: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T17:50:56.947723] [INFO ] [REMOTE    ] CCIF: Fetching primary data for 2025-02.
[2025-10-24T17:50:57.747634] [INFO ] [REMOTE    ] CC: Fetching primary data for 2025-04.
[2025-10-24T17:50:57.817174] [INFO ] [REMOTE    ] CCIF: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T17:50:57.854125] [INFO ] [REMOTE    ] CCI: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T17:50:58.547629] [INFO ] [REMOTE    ] CCI: Fetching primary data for 2025-05.
[2025-10-24T17:50:59.355953] [INFO ] [REMOTE    ] CCIA: Fetching primary data for 2025-03.
[2025-10-24T17:50:59.377134] [INFO ] [REMOTE    ] CC: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T17:50:59.707680] [INFO ] [REMOTE    ] CCIA: Incremental fetch complete for 2025-03 (0.35 seconds).
[2025-10-24T17:51:00.109254] [INFO ] [REMOTE    ] CCI: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T17:51:00.147665] [INFO ] [REMOTE    ] CCIA: Fetching primary data for 2025-04.
[2025-10-24T17:51:00.947337] [INFO ] [REMOTE    ] CCIA: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T17:51:00.948547] [INFO ] [REMOTE    ] CCIA: Fetching primary data for 2025-05.
[2025-10-24T17:51:01.747718] [INFO ] [REMOTE    ] CCIF: Fetching primary data for 2025-03.
[2025-10-24T17:51:02.501147] [INFO ] [REMOTE    ] CCIA: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T17:51:02.547638] [INFO ] [REMOTE    ] CCIA: Fetching primary data for 2025-06.
[2025-10-24T17:51:03.347639] [INFO ] [REMOTE    ] CCI: Fetching primary data for 2025-06.
[2025-10-24T17:51:03.398838] [INFO ] [REMOTE    ] CCIF: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T17:51:03.717864] [INFO ] [REMOTE    ] CCIA: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T17:51:04.147709] [INFO ] [REMOTE    ] CCIA: Fetching primary data for 2025-07.
[2025-10-24T17:51:04.778081] [INFO ] [REMOTE    ] CCIA: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T17:51:04.947734] [INFO ] [REMOTE    ] CCIA: Fetching primary data for 2025-08.
[2025-10-24T17:51:05.752869] [INFO ] [REMOTE    ] CCIF: Fetching primary data for 2025-04.
[2025-10-24T17:51:05.768588] [INFO ] [REMOTE    ] CCI: Incremental fetch complete for 2025-06 (2.42 seconds).
[2025-10-24T17:51:06.547765] [INFO ] [REMOTE    ] CCI: Fetching primary data for 2025-07.
[2025-10-24T17:51:06.563417] [INFO ] [REMOTE    ] CCIA: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T17:51:06.801225] [INFO ] [REMOTE    ] CCIF: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T17:51:07.347718] [INFO ] [REMOTE    ] CC: Fetching primary data for 2025-05.
[2025-10-24T17:51:08.150843] [INFO ] [REMOTE    ] CCIF: Fetching primary data for 2025-05.
[2025-10-24T17:51:08.154511] [INFO ] [REMOTE    ] CCI: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T17:51:08.893796] [INFO ] [REMOTE    ] CC: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T17:51:08.947627] [INFO ] [REMOTE    ] CC: Fetching primary data for 2025-06.
[2025-10-24T17:51:08.973204] [INFO ] [REMOTE    ] CCIF: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T17:51:09.747710] [INFO ] [REMOTE    ] CCIA: Fetching primary data for 2025-09.
[2025-10-24T17:51:09.993499] [INFO ] [REMOTE    ] CCIA: Incremental fetch complete for 2025-09 (0.25 seconds).
[2025-10-24T17:51:10.323364] [INFO ] [REMOTE    ] CC: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T17:51:10.547624] [INFO ] [REMOTE    ] CCIA: Fetching primary data for 2025-10.
[2025-10-24T17:51:11.100605] [INFO ] [REMOTE    ] CCIA: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T17:51:11.101587] [INFO ] [REMOTE    ] CCIA: Full fetch complete (2179 records).
[2025-10-24T17:51:11.101699] [DEBUG] [VALIDATOR ] CCIA: Validating primary data.
[2025-10-24T17:51:11.280223] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days
[2025-10-24T17:51:11.280438] [FATAL] [MAIN      ] CCIA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:51:11.280510] [WARN ] [MAIN      ] CCIA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:51:11.280583] [INFO ] [LOCAL     ] CCIA: Starting deletion of primary data.
[2025-10-24T17:51:11.280681] [DEBUG] [LOCAL     ] CCIA: No primary data file found to delete.
[2025-10-24T17:51:11.280741] [INFO ] [LOCAL     ] CCIA: Starting deletion of derivative data.
[2025-10-24T17:51:11.280793] [DEBUG] [LOCAL     ] CCIA: No derivative data file found to delete.
[2025-10-24T17:51:11.280852] [INFO ] [MAIN      ] Update Progress: 410/2366 symbols completed. CCIA took 21.5s. Estimated remaining: 4h 3m 58s. Rate: 8.0 symbols/min
[2025-10-24T17:51:11.352878] [INFO ] [REMOTE    ] CCIF: Fetching primary data for 2025-06.
[2025-10-24T17:51:11.463786] [INFO ] [MAIN      ] CCJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:51:11.515852] [DEBUG] [LOCAL     ] CCJ: Loaded 54080 existing records from primary storage.
[2025-10-24T17:51:11.516156] [INFO ] [MAIN      ] CCJ: Loaded 54080 existing records.
[2025-10-24T17:51:11.701779] [WARN ] [MAIN      ] CCJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:51:11.701997] [INFO ] [MAIN      ] CCJ: Wiping existing primary data before full refresh.
[2025-10-24T17:51:11.702043] [INFO ] [LOCAL     ] CCJ: Starting deletion of primary data.
[2025-10-24T17:51:11.702416] [DEBUG] [LOCAL     ] CCJ: Deleted primary data file.
[2025-10-24T17:51:11.702456] [INFO ] [MAIN      ] CCJ: Starting full primary refresh.
[2025-10-24T17:51:12.078503] [INFO ] [REMOTE    ] CCJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:51:12.147633] [INFO ] [REMOTE    ] CCJ: Fetching primary data for 2025-01.
[2025-10-24T17:51:12.353166] [INFO ] [REMOTE    ] CCIF: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T17:51:12.947683] [INFO ] [REMOTE    ] CCIF: Fetching primary data for 2025-07.
[2025-10-24T17:51:13.747708] [INFO ] [REMOTE    ] CC: Fetching primary data for 2025-07.
[2025-10-24T17:51:13.849612] [INFO ] [REMOTE    ] CCIF: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T17:51:14.041792] [INFO ] [REMOTE    ] CCJ: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T17:51:14.547672] [INFO ] [REMOTE    ] CCJ: Fetching primary data for 2025-02.
[2025-10-24T17:51:15.347678] [INFO ] [REMOTE    ] CCIF: Fetching primary data for 2025-08.
[2025-10-24T17:51:15.548835] [INFO ] [REMOTE    ] CC: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T17:51:16.147683] [INFO ] [REMOTE    ] CC: Fetching primary data for 2025-08.
[2025-10-24T17:51:16.392411] [INFO ] [REMOTE    ] CCJ: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T17:51:16.413014] [INFO ] [REMOTE    ] CCIF: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T17:51:16.947671] [INFO ] [REMOTE    ] CCJ: Fetching primary data for 2025-03.
[2025-10-24T17:51:17.732167] [INFO ] [REMOTE    ] CC: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T17:51:17.747610] [INFO ] [REMOTE    ] CC: Fetching primary data for 2025-09.
[2025-10-24T17:51:18.547702] [INFO ] [REMOTE    ] CCI: Fetching primary data for 2025-08.
[2025-10-24T17:51:18.787688] [INFO ] [REMOTE    ] CCJ: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T17:51:19.361032] [INFO ] [REMOTE    ] CCJ: Fetching primary data for 2025-04.
[2025-10-24T17:51:19.397617] [INFO ] [REMOTE    ] CC: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T17:51:19.976880] [INFO ] [REMOTE    ] CCI: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T17:51:20.147675] [INFO ] [REMOTE    ] CCI: Fetching primary data for 2025-09.
[2025-10-24T17:51:20.947630] [INFO ] [REMOTE    ] CCIF: Fetching primary data for 2025-09.
[2025-10-24T17:51:21.146943] [INFO ] [REMOTE    ] CCJ: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T17:51:21.747732] [INFO ] [REMOTE    ] CCJ: Fetching primary data for 2025-05.
[2025-10-24T17:51:22.112042] [INFO ] [REMOTE    ] CCI: Incremental fetch complete for 2025-09 (1.96 seconds).
[2025-10-24T17:51:22.147835] [INFO ] [REMOTE    ] CCIF: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T17:51:22.547740] [INFO ] [REMOTE    ] CCIF: Fetching primary data for 2025-10.
[2025-10-24T17:51:23.332066] [INFO ] [REMOTE    ] CCJ: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T17:51:23.347616] [INFO ] [REMOTE    ] CCJ: Fetching primary data for 2025-06.
[2025-10-24T17:51:23.594547] [INFO ] [REMOTE    ] CCIF: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T17:51:23.597550] [INFO ] [REMOTE    ] CCIF: Full fetch complete (21998 records).
[2025-10-24T17:51:23.597621] [DEBUG] [VALIDATOR ] CCIF: Validating primary data.
[2025-10-24T17:51:23.965726] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present.
[2025-10-24T17:51:23.965806] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed.
[2025-10-24T17:51:23.966193] [INFO ] [MAIN      ] CCIF: Fetched primary data is valid.
[2025-10-24T17:51:23.966232] [DEBUG] [LOCAL     ] CCIF: Saving primary data.
[2025-10-24T17:51:23.966493] [FATAL] [LOCAL     ] CCIF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:51:23.966588] [FATAL] [MAIN      ] CCIF: Failed to save primary data.
[2025-10-24T17:51:23.966683] [WARN ] [MAIN      ] CCIF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:51:23.966772] [INFO ] [LOCAL     ] CCIF: Starting deletion of primary data.
[2025-10-24T17:51:23.966848] [DEBUG] [LOCAL     ] CCIF: No primary data file found to delete.
[2025-10-24T17:51:23.966887] [INFO ] [LOCAL     ] CCIF: Starting deletion of derivative data.
[2025-10-24T17:51:23.967008] [DEBUG] [LOCAL     ] CCIF: Deleted derivative data file.
[2025-10-24T17:51:23.967078] [INFO ] [MAIN      ] Update Progress: 411/2366 symbols completed. CCIF took 30.1s. Estimated remaining: 4h 4m 16s. Rate: 8.0 symbols/min
[2025-10-24T17:51:24.136327] [INFO ] [MAIN      ] CCK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:51:24.147697] [INFO ] [REMOTE    ] CCI: Fetching primary data for 2025-10.
[2025-10-24T17:51:24.180777] [DEBUG] [LOCAL     ] CCK: Loaded 46879 existing records from primary storage.
[2025-10-24T17:51:24.181067] [INFO ] [MAIN      ] CCK: Loaded 46879 existing records.
[2025-10-24T17:51:24.359102] [WARN ] [MAIN      ] CCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:51:24.359347] [INFO ] [MAIN      ] CCK: Wiping existing primary data before full refresh.
[2025-10-24T17:51:24.359402] [INFO ] [LOCAL     ] CCK: Starting deletion of primary data.
[2025-10-24T17:51:24.359748] [DEBUG] [LOCAL     ] CCK: Deleted primary data file.
[2025-10-24T17:51:24.359803] [INFO ] [MAIN      ] CCK: Starting full primary refresh.
[2025-10-24T17:51:24.707455] [INFO ] [REMOTE    ] CCK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:51:24.947609] [INFO ] [REMOTE    ] CC: Fetching primary data for 2025-10.
[2025-10-24T17:51:25.331633] [INFO ] [REMOTE    ] CCJ: Incremental fetch complete for 2025-06 (1.98 seconds).
[2025-10-24T17:51:25.747695] [INFO ] [REMOTE    ] CCK: Fetching primary data for 2025-01.
[2025-10-24T17:51:25.990147] [INFO ] [REMOTE    ] CCI: Incremental fetch complete for 2025-10 (1.84 seconds).
[2025-10-24T17:51:25.999763] [INFO ] [REMOTE    ] CCI: Full fetch complete (77095 records).
[2025-10-24T17:51:25.999887] [DEBUG] [VALIDATOR ] CCI: Validating primary data.
[2025-10-24T17:51:26.391824] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present.
[2025-10-24T17:51:26.391903] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed.
[2025-10-24T17:51:26.392875] [INFO ] [MAIN      ] CCI: Fetched primary data is valid.
[2025-10-24T17:51:26.392938] [DEBUG] [LOCAL     ] CCI: Saving primary data.
[2025-10-24T17:51:26.393535] [FATAL] [LOCAL     ] CCI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:51:26.393626] [FATAL] [MAIN      ] CCI: Failed to save primary data.
[2025-10-24T17:51:26.393704] [WARN ] [MAIN      ] CCI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:51:26.393748] [INFO ] [LOCAL     ] CCI: Starting deletion of primary data.
[2025-10-24T17:51:26.393800] [DEBUG] [LOCAL     ] CCI: No primary data file found to delete.
[2025-10-24T17:51:26.393834] [INFO ] [LOCAL     ] CCI: Starting deletion of derivative data.
[2025-10-24T17:51:26.394005] [DEBUG] [LOCAL     ] CCI: Deleted derivative data file.
[2025-10-24T17:51:26.394274] [INFO ] [MAIN      ] Update Progress: 412/2366 symbols completed. CCI took 40.5s. Estimated remaining: 4h 3m 44s. Rate: 8.0 symbols/min
[2025-10-24T17:51:26.550049] [INFO ] [REMOTE    ] CCJ: Fetching primary data for 2025-07.
[2025-10-24T17:51:26.567523] [INFO ] [MAIN      ] CCL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:51:26.568338] [DEBUG] [LOCAL     ] CCL: No existing data file found in primary storage.
[2025-10-24T17:51:26.568383] [WARN ] [MAIN      ] CCL: No existing data found, performing full refresh instead.
[2025-10-24T17:51:26.568516] [INFO ] [MAIN      ] CCL: Wiping existing primary data before full refresh.
[2025-10-24T17:51:26.568571] [INFO ] [LOCAL     ] CCL: Starting deletion of primary data.
[2025-10-24T17:51:26.568614] [DEBUG] [LOCAL     ] CCL: No primary data file found to delete.
[2025-10-24T17:51:26.568679] [INFO ] [MAIN      ] CCL: Starting full primary refresh.
[2025-10-24T17:51:26.933246] [INFO ] [REMOTE    ] CCL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:51:26.957966] [INFO ] [REMOTE    ] CC: Incremental fetch complete for 2025-10 (2.01 seconds).
[2025-10-24T17:51:26.967915] [INFO ] [REMOTE    ] CC: Full fetch complete (76205 records).
[2025-10-24T17:51:26.968048] [DEBUG] [VALIDATOR ] CC: Validating primary data.
[2025-10-24T17:51:27.365123] [INFO ] [REMOTE    ] CCL: Fetching primary data for 2025-01.
[2025-10-24T17:51:27.365345] [DEBUG] [VALIDATOR ] CC: All expected trading days are present.
[2025-10-24T17:51:27.366246] [DEBUG] [VALIDATOR ] CC: Primary data validation passed.
[2025-10-24T17:51:27.367142] [INFO ] [MAIN      ] CC: Fetched primary data is valid.
[2025-10-24T17:51:27.367413] [DEBUG] [LOCAL     ] CC: Saving primary data.
[2025-10-24T17:51:27.368175] [FATAL] [LOCAL     ] CC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:51:27.368261] [FATAL] [MAIN      ] CC: Failed to save primary data.
[2025-10-24T17:51:27.368329] [WARN ] [MAIN      ] CC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:51:27.368400] [INFO ] [LOCAL     ] CC: Starting deletion of primary data.
[2025-10-24T17:51:27.368461] [DEBUG] [LOCAL     ] CC: No primary data file found to delete.
[2025-10-24T17:51:27.368497] [INFO ] [LOCAL     ] CC: Starting deletion of derivative data.
[2025-10-24T17:51:27.368619] [DEBUG] [LOCAL     ] CC: Deleted derivative data file.
[2025-10-24T17:51:27.369074] [INFO ] [MAIN      ] Update Progress: 413/2366 symbols completed. CC took 42.7s. Estimated remaining: 4h 3m 6s. Rate: 8.0 symbols/min
[2025-10-24T17:51:27.546133] [INFO ] [REMOTE    ] CCK: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T17:51:27.580442] [INFO ] [MAIN      ] CCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:51:27.625796] [DEBUG] [LOCAL     ] CCO: Loaded 48899 existing records from primary storage.
[2025-10-24T17:51:27.626112] [INFO ] [MAIN      ] CCO: Loaded 48899 existing records.
[2025-10-24T17:51:27.815490] [WARN ] [MAIN      ] CCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:51:27.815740] [INFO ] [MAIN      ] CCO: Wiping existing primary data before full refresh.
[2025-10-24T17:51:27.815794] [INFO ] [LOCAL     ] CCO: Starting deletion of primary data.
[2025-10-24T17:51:27.816235] [DEBUG] [LOCAL     ] CCO: Deleted primary data file.
[2025-10-24T17:51:27.816274] [INFO ] [MAIN      ] CCO: Starting full primary refresh.
[2025-10-24T17:51:28.150054] [INFO ] [REMOTE    ] CCK: Fetching primary data for 2025-02.
[2025-10-24T17:51:28.185937] [INFO ] [REMOTE    ] CCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:51:28.603032] [INFO ] [REMOTE    ] CCJ: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T17:51:28.947638] [INFO ] [REMOTE    ] CCO: Fetching primary data for 2025-01.
[2025-10-24T17:51:29.576508] [INFO ] [REMOTE    ] CCL: Incremental fetch complete for 2025-01 (2.21 seconds).
[2025-10-24T17:51:29.648010] [INFO ] [REMOTE    ] CCK: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T17:51:29.747626] [INFO ] [REMOTE    ] CCK: Fetching primary data for 2025-03.
[2025-10-24T17:51:30.384070] [INFO ] [REMOTE    ] CCO: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T17:51:30.547731] [INFO ] [REMOTE    ] CCJ: Fetching primary data for 2025-08.
[2025-10-24T17:51:31.081241] [INFO ] [REMOTE    ] CCK: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T17:51:31.347684] [INFO ] [REMOTE    ] CCO: Fetching primary data for 2025-02.
[2025-10-24T17:51:32.147677] [INFO ] [REMOTE    ] CCL: Fetching primary data for 2025-02.
[2025-10-24T17:51:32.501366] [INFO ] [REMOTE    ] CCO: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T17:51:32.729834] [INFO ] [REMOTE    ] CCJ: Incremental fetch complete for 2025-08 (2.18 seconds).
[2025-10-24T17:51:32.947618] [INFO ] [REMOTE    ] CCJ: Fetching primary data for 2025-09.
[2025-10-24T17:51:33.747715] [INFO ] [REMOTE    ] CCK: Fetching primary data for 2025-04.
[2025-10-24T17:51:34.265473] [INFO ] [REMOTE    ] CCL: Incremental fetch complete for 2025-02 (2.12 seconds).
[2025-10-24T17:51:34.547623] [INFO ] [REMOTE    ] CCL: Fetching primary data for 2025-03.
[2025-10-24T17:51:34.931440] [INFO ] [REMOTE    ] CCJ: Incremental fetch complete for 2025-09 (1.98 seconds).
[2025-10-24T17:51:35.319367] [INFO ] [REMOTE    ] CCK: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T17:51:35.347604] [INFO ] [REMOTE    ] CCK: Fetching primary data for 2025-05.
[2025-10-24T17:51:36.147624] [INFO ] [REMOTE    ] CCJ: Fetching primary data for 2025-10.
[2025-10-24T17:51:36.871993] [INFO ] [REMOTE    ] CCK: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T17:51:36.918462] [INFO ] [REMOTE    ] CCL: Incremental fetch complete for 2025-03 (2.37 seconds).
[2025-10-24T17:51:36.947620] [INFO ] [REMOTE    ] CCL: Fetching primary data for 2025-04.
[2025-10-24T17:51:37.747670] [INFO ] [REMOTE    ] CCO: Fetching primary data for 2025-03.
[2025-10-24T17:51:38.412922] [INFO ] [REMOTE    ] CCJ: Incremental fetch complete for 2025-10 (2.27 seconds).
[2025-10-24T17:51:38.423376] [INFO ] [REMOTE    ] CCJ: Full fetch complete (77840 records).
[2025-10-24T17:51:38.423526] [DEBUG] [VALIDATOR ] CCJ: Validating primary data.
[2025-10-24T17:51:38.552832] [INFO ] [REMOTE    ] CCK: Fetching primary data for 2025-06.
[2025-10-24T17:51:38.859689] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present.
[2025-10-24T17:51:38.860004] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed.
[2025-10-24T17:51:38.861017] [INFO ] [MAIN      ] CCJ: Fetched primary data is valid.
[2025-10-24T17:51:38.861170] [DEBUG] [LOCAL     ] CCJ: Saving primary data.
[2025-10-24T17:51:38.861945] [FATAL] [LOCAL     ] CCJ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:51:38.862127] [FATAL] [MAIN      ] CCJ: Failed to save primary data.
[2025-10-24T17:51:38.862204] [WARN ] [MAIN      ] CCJ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:51:38.862285] [INFO ] [LOCAL     ] CCJ: Starting deletion of primary data.
[2025-10-24T17:51:38.862454] [DEBUG] [LOCAL     ] CCJ: No primary data file found to delete.
[2025-10-24T17:51:38.862519] [INFO ] [LOCAL     ] CCJ: Starting deletion of derivative data.
[2025-10-24T17:51:38.862893] [DEBUG] [LOCAL     ] CCJ: Deleted derivative data file.
[2025-10-24T17:51:38.863376] [INFO ] [MAIN      ] Update Progress: 414/2366 symbols completed. CCJ took 27.6s. Estimated remaining: 4h 3m 17s. Rate: 8.0 symbols/min
[2025-10-24T17:51:39.035074] [INFO ] [REMOTE    ] CCL: Incremental fetch complete for 2025-04 (2.09 seconds).
[2025-10-24T17:51:39.093991] [INFO ] [MAIN      ] CCRD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:51:39.109027] [DEBUG] [LOCAL     ] CCRD: Loaded 9620 existing records from primary storage.
[2025-10-24T17:51:39.109254] [INFO ] [MAIN      ] CCRD: Loaded 9620 existing records.
[2025-10-24T17:51:39.261799] [INFO ] [REMOTE    ] CCO: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T17:51:39.322330] [WARN ] [MAIN      ] CCRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:51:39.322780] [INFO ] [MAIN      ] CCRD: Wiping existing primary data before full refresh.
[2025-10-24T17:51:39.322828] [INFO ] [LOCAL     ] CCRD: Starting deletion of primary data.
[2025-10-24T17:51:39.322993] [DEBUG] [LOCAL     ] CCRD: Deleted primary data file.
[2025-10-24T17:51:39.323048] [INFO ] [MAIN      ] CCRD: Starting full primary refresh.
[2025-10-24T17:51:39.353213] [INFO ] [REMOTE    ] CCL: Fetching primary data for 2025-05.
[2025-10-24T17:51:39.672842] [INFO ] [REMOTE    ] CCRD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:51:39.952907] [INFO ] [REMOTE    ] CCK: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T17:51:40.147705] [INFO ] [REMOTE    ] CCO: Fetching primary data for 2025-04.
[2025-10-24T17:51:40.947669] [INFO ] [REMOTE    ] CCRD: Fetching primary data for 2025-01.
[2025-10-24T17:51:41.421387] [INFO ] [REMOTE    ] CCL: Incremental fetch complete for 2025-05 (2.07 seconds).
[2025-10-24T17:51:41.751741] [INFO ] [REMOTE    ] CCK: Fetching primary data for 2025-07.
[2025-10-24T17:51:41.752594] [INFO ] [REMOTE    ] CCRD: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T17:51:41.807005] [INFO ] [REMOTE    ] CCO: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T17:51:42.547736] [INFO ] [REMOTE    ] CCO: Fetching primary data for 2025-05.
[2025-10-24T17:51:43.347628] [INFO ] [REMOTE    ] CCL: Fetching primary data for 2025-06.
[2025-10-24T17:51:43.446190] [INFO ] [REMOTE    ] CCK: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T17:51:44.147705] [INFO ] [REMOTE    ] CCK: Fetching primary data for 2025-08.
[2025-10-24T17:51:44.214361] [INFO ] [REMOTE    ] CCO: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T17:51:44.947722] [INFO ] [REMOTE    ] CCO: Fetching primary data for 2025-06.
[2025-10-24T17:51:45.293399] [INFO ] [REMOTE    ] CCL: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T17:51:45.389820] [INFO ] [REMOTE    ] CCK: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T17:51:45.747638] [INFO ] [REMOTE    ] CCRD: Fetching primary data for 2025-02.
[2025-10-24T17:51:46.551144] [INFO ] [REMOTE    ] CCRD: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T17:51:46.547688] [INFO ] [REMOTE    ] CCK: Fetching primary data for 2025-09.
[2025-10-24T17:51:46.587389] [INFO ] [REMOTE    ] CCO: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T17:51:47.347638] [INFO ] [REMOTE    ] CCRD: Fetching primary data for 2025-03.
[2025-10-24T17:51:47.934926] [INFO ] [REMOTE    ] CCRD: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T17:51:48.161944] [INFO ] [REMOTE    ] CCRD: Fetching primary data for 2025-04.
[2025-10-24T17:51:48.164285] [INFO ] [REMOTE    ] CCK: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T17:51:48.751672] [INFO ] [REMOTE    ] CCRD: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T17:51:48.947690] [INFO ] [REMOTE    ] CCK: Fetching primary data for 2025-10.
[2025-10-24T17:51:49.747612] [INFO ] [REMOTE    ] CCRD: Fetching primary data for 2025-05.
[2025-10-24T17:51:50.220443] [INFO ] [REMOTE    ] CCRD: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T17:51:50.547613] [INFO ] [REMOTE    ] CCRD: Fetching primary data for 2025-06.
[2025-10-24T17:51:50.604534] [INFO ] [REMOTE    ] CCK: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T17:51:50.613543] [INFO ] [REMOTE    ] CCK: Full fetch complete (68226 records).
[2025-10-24T17:51:50.613734] [DEBUG] [VALIDATOR ] CCK: Validating primary data.
[2025-10-24T17:51:50.995487] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present.
[2025-10-24T17:51:50.995567] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed.
[2025-10-24T17:51:50.996327] [INFO ] [MAIN      ] CCK: Fetched primary data is valid.
[2025-10-24T17:51:50.996389] [DEBUG] [LOCAL     ] CCK: Saving primary data.
[2025-10-24T17:51:50.996943] [FATAL] [LOCAL     ] CCK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:51:50.997030] [FATAL] [MAIN      ] CCK: Failed to save primary data.
[2025-10-24T17:51:50.997072] [WARN ] [MAIN      ] CCK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:51:50.997107] [INFO ] [LOCAL     ] CCK: Starting deletion of primary data.
[2025-10-24T17:51:50.997157] [DEBUG] [LOCAL     ] CCK: No primary data file found to delete.
[2025-10-24T17:51:50.997192] [INFO ] [LOCAL     ] CCK: Starting deletion of derivative data.
[2025-10-24T17:51:50.997366] [DEBUG] [LOCAL     ] CCK: Deleted derivative data file.
[2025-10-24T17:51:50.997720] [INFO ] [MAIN      ] Update Progress: 415/2366 symbols completed. CCK took 27.0s. Estimated remaining: 4h 3m 32s. Rate: 8.0 symbols/min
[2025-10-24T17:51:51.163705] [INFO ] [MAIN      ] CCS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:51:51.194337] [DEBUG] [LOCAL     ] CCS: Loaded 30142 existing records from primary storage.
[2025-10-24T17:51:51.194590] [INFO ] [MAIN      ] CCS: Loaded 30142 existing records.
[2025-10-24T17:51:51.367727] [INFO ] [REMOTE    ] CCL: Fetching primary data for 2025-07.
[2025-10-24T17:51:51.400689] [WARN ] [MAIN      ] CCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:51:51.401015] [INFO ] [MAIN      ] CCS: Wiping existing primary data before full refresh.
[2025-10-24T17:51:51.402014] [INFO ] [LOCAL     ] CCS: Starting deletion of primary data.
[2025-10-24T17:51:51.411175] [DEBUG] [LOCAL     ] CCS: Deleted primary data file.
[2025-10-24T17:51:51.411583] [INFO ] [MAIN      ] CCS: Starting full primary refresh.
[2025-10-24T17:51:51.411499] [INFO ] [REMOTE    ] CCRD: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T17:51:51.763031] [INFO ] [REMOTE    ] CCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:51:52.147667] [INFO ] [REMOTE    ] CCO: Fetching primary data for 2025-07.
[2025-10-24T17:51:52.947622] [INFO ] [REMOTE    ] CCRD: Fetching primary data for 2025-07.
[2025-10-24T17:51:53.747710] [INFO ] [REMOTE    ] CCS: Fetching primary data for 2025-01.
[2025-10-24T17:51:53.889824] [INFO ] [REMOTE    ] CCO: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T17:51:53.939203] [INFO ] [REMOTE    ] CCRD: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T17:51:53.994603] [INFO ] [REMOTE    ] CCL: Incremental fetch complete for 2025-07 (2.63 seconds).
[2025-10-24T17:51:54.547725] [INFO ] [REMOTE    ] CCL: Fetching primary data for 2025-08.
[2025-10-24T17:51:55.162513] [INFO ] [REMOTE    ] CCS: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T17:51:55.347711] [INFO ] [REMOTE    ] CCRD: Fetching primary data for 2025-08.
[2025-10-24T17:51:56.147698] [INFO ] [REMOTE    ] CCS: Fetching primary data for 2025-02.
[2025-10-24T17:51:56.193117] [INFO ] [REMOTE    ] CCRD: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T17:51:56.602207] [INFO ] [REMOTE    ] CCL: Incremental fetch complete for 2025-08 (2.05 seconds).
[2025-10-24T17:51:56.947690] [INFO ] [REMOTE    ] CCO: Fetching primary data for 2025-08.
[2025-10-24T17:51:57.512265] [INFO ] [REMOTE    ] CCS: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T17:51:57.747742] [INFO ] [REMOTE    ] CCL: Fetching primary data for 2025-09.
[2025-10-24T17:51:58.552872] [INFO ] [REMOTE    ] CCRD: Fetching primary data for 2025-09.
[2025-10-24T17:51:58.564997] [INFO ] [REMOTE    ] CCO: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T17:51:59.175695] [INFO ] [REMOTE    ] CCRD: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T17:51:59.347673] [INFO ] [REMOTE    ] CCO: Fetching primary data for 2025-09.
[2025-10-24T17:51:59.841739] [INFO ] [REMOTE    ] CCL: Incremental fetch complete for 2025-09 (2.09 seconds).
[2025-10-24T17:52:00.147675] [INFO ] [REMOTE    ] CCRD: Fetching primary data for 2025-10.
[2025-10-24T17:52:00.947752] [INFO ] [REMOTE    ] CCS: Fetching primary data for 2025-03.
[2025-10-24T17:52:01.323043] [INFO ] [REMOTE    ] CCO: Incremental fetch complete for 2025-09 (1.98 seconds).
[2025-10-24T17:52:01.637168] [INFO ] [REMOTE    ] CCRD: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T17:52:01.639263] [INFO ] [REMOTE    ] CCRD: Full fetch complete (11748 records).
[2025-10-24T17:52:01.639337] [DEBUG] [VALIDATOR ] CCRD: Validating primary data.
[2025-10-24T17:52:01.752869] [INFO ] [REMOTE    ] CCO: Fetching primary data for 2025-10.
[2025-10-24T17:52:02.024317] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present.
[2025-10-24T17:52:02.024405] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed.
[2025-10-24T17:52:02.024749] [INFO ] [MAIN      ] CCRD: Fetched primary data is valid.
[2025-10-24T17:52:02.024835] [DEBUG] [LOCAL     ] CCRD: Saving primary data.
[2025-10-24T17:52:02.025142] [FATAL] [LOCAL     ] CCRD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:52:02.025241] [FATAL] [MAIN      ] CCRD: Failed to save primary data.
[2025-10-24T17:52:02.025294] [WARN ] [MAIN      ] CCRD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:52:02.025332] [INFO ] [LOCAL     ] CCRD: Starting deletion of primary data.
[2025-10-24T17:52:02.025406] [DEBUG] [LOCAL     ] CCRD: No primary data file found to delete.
[2025-10-24T17:52:02.025468] [INFO ] [LOCAL     ] CCRD: Starting deletion of derivative data.
[2025-10-24T17:52:02.025606] [DEBUG] [LOCAL     ] CCRD: Deleted derivative data file.
[2025-10-24T17:52:02.025732] [INFO ] [MAIN      ] Update Progress: 416/2366 symbols completed. CCRD took 23.2s. Estimated remaining: 4h 3m 41s. Rate: 8.0 symbols/min
[2025-10-24T17:52:02.196778] [INFO ] [MAIN      ] CCU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:52:02.218527] [DEBUG] [LOCAL     ] CCU: Loaded 21744 existing records from primary storage.
[2025-10-24T17:52:02.218793] [INFO ] [MAIN      ] CCU: Loaded 21744 existing records.
[2025-10-24T17:52:02.412210] [WARN ] [MAIN      ] CCU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:52:02.412479] [INFO ] [MAIN      ] CCU: Wiping existing primary data before full refresh.
[2025-10-24T17:52:02.412535] [INFO ] [LOCAL     ] CCU: Starting deletion of primary data.
[2025-10-24T17:52:02.412829] [DEBUG] [LOCAL     ] CCU: Deleted primary data file.
[2025-10-24T17:52:02.412886] [INFO ] [MAIN      ] CCU: Starting full primary refresh.
[2025-10-24T17:52:02.557524] [INFO ] [REMOTE    ] CCL: Fetching primary data for 2025-10.
[2025-10-24T17:52:02.782068] [INFO ] [REMOTE    ] CCU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:52:02.817716] [INFO ] [REMOTE    ] CCS: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T17:52:03.347631] [INFO ] [REMOTE    ] CCU: Fetching primary data for 2025-01.
[2025-10-24T17:52:04.147743] [INFO ] [REMOTE    ] CCS: Fetching primary data for 2025-04.
[2025-10-24T17:52:04.572465] [INFO ] [REMOTE    ] CCO: Incremental fetch complete for 2025-10 (2.82 seconds).
[2025-10-24T17:52:04.580410] [INFO ] [REMOTE    ] CCU: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T17:52:04.590145] [INFO ] [REMOTE    ] CCO: Full fetch complete (67042 records).
[2025-10-24T17:52:04.590260] [DEBUG] [VALIDATOR ] CCO: Validating primary data.
[2025-10-24T17:52:04.590931] [FATAL] [VALIDATOR ] CCO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:52:04.591017] [FATAL] [MAIN      ] CCO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:52:04.591061] [WARN ] [MAIN      ] CCO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:52:04.591099] [INFO ] [LOCAL     ] CCO: Starting deletion of primary data.
[2025-10-24T17:52:04.591155] [DEBUG] [LOCAL     ] CCO: No primary data file found to delete.
[2025-10-24T17:52:04.591189] [INFO ] [LOCAL     ] CCO: Starting deletion of derivative data.
[2025-10-24T17:52:04.591322] [DEBUG] [LOCAL     ] CCO: Deleted derivative data file.
[2025-10-24T17:52:04.591732] [INFO ] [MAIN      ] Update Progress: 417/2366 symbols completed. CCO took 37.2s. Estimated remaining: 4h 3m 10s. Rate: 8.0 symbols/min
[2025-10-24T17:52:04.766935] [INFO ] [MAIN      ] CCZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:52:04.767240] [DEBUG] [LOCAL     ] CCZ: No existing data file found in primary storage.
[2025-10-24T17:52:04.767482] [WARN ] [MAIN      ] CCZ: No existing data found, performing full refresh instead.
[2025-10-24T17:52:04.767678] [INFO ] [MAIN      ] CCZ: Wiping existing primary data before full refresh.
[2025-10-24T17:52:04.767751] [INFO ] [LOCAL     ] CCZ: Starting deletion of primary data.
[2025-10-24T17:52:04.767942] [DEBUG] [LOCAL     ] CCZ: No primary data file found to delete.
[2025-10-24T17:52:04.768016] [INFO ] [MAIN      ] CCZ: Starting full primary refresh.
[2025-10-24T17:52:04.963098] [INFO ] [REMOTE    ] CCU: Fetching primary data for 2025-02.
[2025-10-24T17:52:05.193207] [INFO ] [REMOTE    ] CCZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:52:05.197757] [INFO ] [REMOTE    ] CCL: Incremental fetch complete for 2025-10 (2.64 seconds).
[2025-10-24T17:52:05.208895] [INFO ] [REMOTE    ] CCL: Full fetch complete (77980 records).
[2025-10-24T17:52:05.209111] [DEBUG] [VALIDATOR ] CCL: Validating primary data.
[2025-10-24T17:52:05.642440] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present.
[2025-10-24T17:52:05.642861] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed.
[2025-10-24T17:52:05.644102] [INFO ] [MAIN      ] CCL: Fetched primary data is valid.
[2025-10-24T17:52:05.644207] [DEBUG] [LOCAL     ] CCL: Saving primary data.
[2025-10-24T17:52:05.645617] [FATAL] [LOCAL     ] CCL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:52:05.645734] [FATAL] [MAIN      ] CCL: Failed to save primary data.
[2025-10-24T17:52:05.645797] [WARN ] [MAIN      ] CCL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:52:05.645882] [INFO ] [LOCAL     ] CCL: Starting deletion of primary data.
[2025-10-24T17:52:05.645954] [DEBUG] [LOCAL     ] CCL: No primary data file found to delete.
[2025-10-24T17:52:05.645993] [INFO ] [LOCAL     ] CCL: Starting deletion of derivative data.
[2025-10-24T17:52:05.646035] [DEBUG] [LOCAL     ] CCL: No derivative data file found to delete.
[2025-10-24T17:52:05.646568] [INFO ] [MAIN      ] Update Progress: 418/2366 symbols completed. CCL took 39.3s. Estimated remaining: 4h 2m 33s. Rate: 8.0 symbols/min
[2025-10-24T17:52:05.749114] [INFO ] [REMOTE    ] CCZ: Fetching primary data for 2025-01.
[2025-10-24T17:52:05.842413] [INFO ] [MAIN      ] CDE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:52:05.877388] [INFO ] [REMOTE    ] CCS: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T17:52:05.949980] [DEBUG] [LOCAL     ] CDE: Loaded 54034 existing records from primary storage.
[2025-10-24T17:52:05.950508] [INFO ] [MAIN      ] CDE: Loaded 54034 existing records.
[2025-10-24T17:52:06.151733] [INFO ] [REMOTE    ] CCU: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T17:52:06.176874] [WARN ] [MAIN      ] CDE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:52:06.182373] [INFO ] [MAIN      ] CDE: Wiping existing primary data before full refresh.
[2025-10-24T17:52:06.182492] [INFO ] [LOCAL     ] CDE: Starting deletion of primary data.
[2025-10-24T17:52:06.182991] [DEBUG] [LOCAL     ] CDE: Deleted primary data file.
[2025-10-24T17:52:06.183061] [INFO ] [MAIN      ] CDE: Starting full primary refresh.
[2025-10-24T17:52:06.223544] [INFO ] [REMOTE    ] CCZ: Incremental fetch complete for 2025-01 (0.47 seconds).
[2025-10-24T17:52:06.553204] [INFO ] [REMOTE    ] CCU: Fetching primary data for 2025-03.
[2025-10-24T17:52:06.558269] [INFO ] [REMOTE    ] CDE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:52:07.347702] [INFO ] [REMOTE    ] CDE: Fetching primary data for 2025-01.
[2025-10-24T17:52:07.827842] [INFO ] [REMOTE    ] CCU: Incremental fetch complete for 2025-03 (1.27 seconds).
[2025-10-24T17:52:08.147760] [INFO ] [REMOTE    ] CCS: Fetching primary data for 2025-05.
[2025-10-24T17:52:08.947626] [INFO ] [REMOTE    ] CCZ: Fetching primary data for 2025-02.
[2025-10-24T17:52:08.998393] [INFO ] [REMOTE    ] CDE: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T17:52:09.189564] [INFO ] [REMOTE    ] CCZ: Incremental fetch complete for 2025-02 (0.24 seconds).
[2025-10-24T17:52:09.419799] [INFO ] [REMOTE    ] CCS: Incremental fetch complete for 2025-05 (1.27 seconds).
[2025-10-24T17:52:09.747716] [INFO ] [REMOTE    ] CCZ: Fetching primary data for 2025-03.
[2025-10-24T17:52:09.978823] [INFO ] [REMOTE    ] CCZ: Incremental fetch complete for 2025-03 (0.23 seconds).
[2025-10-24T17:52:10.547753] [INFO ] [REMOTE    ] CDE: Fetching primary data for 2025-02.
[2025-10-24T17:52:11.347686] [INFO ] [REMOTE    ] CCZ: Fetching primary data for 2025-04.
[2025-10-24T17:52:11.655202] [INFO ] [REMOTE    ] CCZ: Incremental fetch complete for 2025-04 (0.31 seconds).
[2025-10-24T17:52:12.147620] [INFO ] [REMOTE    ] CCS: Fetching primary data for 2025-06.
[2025-10-24T17:52:12.275535] [INFO ] [REMOTE    ] CDE: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T17:52:12.947709] [INFO ] [REMOTE    ] CCU: Fetching primary data for 2025-04.
[2025-10-24T17:52:13.113145] [INFO ] [REMOTE    ] CCS: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T17:52:13.747707] [INFO ] [REMOTE    ] CCS: Fetching primary data for 2025-07.
[2025-10-24T17:52:14.168989] [INFO ] [REMOTE    ] CCU: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T17:52:14.547683] [INFO ] [REMOTE    ] CCZ: Fetching primary data for 2025-05.
[2025-10-24T17:52:14.919391] [INFO ] [REMOTE    ] CCZ: Incremental fetch complete for 2025-05 (0.37 seconds).
[2025-10-24T17:52:15.347622] [INFO ] [REMOTE    ] CCZ: Fetching primary data for 2025-06.
[2025-10-24T17:52:15.440220] [INFO ] [REMOTE    ] CCS: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T17:52:15.606040] [DEBUG] [REMOTE    ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:52:15.606414] [WARN ] [REMOTE    ] CCZ: No data returned for month 2025-06
[2025-10-24T17:52:15.606511] [FATAL] [REMOTE    ] CCZ: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:52:15.606588] [FATAL] [MAIN      ] CCZ: Failed to fetch primary data.
[2025-10-24T17:52:15.606629] [WARN ] [MAIN      ] CCZ: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:52:15.606735] [INFO ] [LOCAL     ] CCZ: Starting deletion of primary data.
[2025-10-24T17:52:15.606829] [DEBUG] [LOCAL     ] CCZ: No primary data file found to delete.
[2025-10-24T17:52:15.606891] [INFO ] [LOCAL     ] CCZ: Starting deletion of derivative data.
[2025-10-24T17:52:15.607006] [DEBUG] [LOCAL     ] CCZ: No derivative data file found to delete.
[2025-10-24T17:52:15.607085] [INFO ] [MAIN      ] Update Progress: 419/2366 symbols completed. CCZ took 11.0s. Estimated remaining: 4h 2m 37s. Rate: 8.0 symbols/min
[2025-10-24T17:52:15.794329] [INFO ] [MAIN      ] CDLR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:52:15.805698] [DEBUG] [LOCAL     ] CDLR: Loaded 10267 existing records from primary storage.
[2025-10-24T17:52:15.805943] [INFO ] [MAIN      ] CDLR: Loaded 10267 existing records.
[2025-10-24T17:52:15.987045] [WARN ] [MAIN      ] CDLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:52:15.987342] [INFO ] [MAIN      ] CDLR: Wiping existing primary data before full refresh.
[2025-10-24T17:52:15.987394] [INFO ] [LOCAL     ] CDLR: Starting deletion of primary data.
[2025-10-24T17:52:15.987546] [DEBUG] [LOCAL     ] CDLR: Deleted primary data file.
[2025-10-24T17:52:15.987583] [INFO ] [MAIN      ] CDLR: Starting full primary refresh.
[2025-10-24T17:52:16.152184] [INFO ] [REMOTE    ] CDE: Fetching primary data for 2025-03.
[2025-10-24T17:52:16.342974] [INFO ] [REMOTE    ] CDLR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:52:16.947638] [INFO ] [REMOTE    ] CCU: Fetching primary data for 2025-05.
[2025-10-24T17:52:17.747624] [INFO ] [REMOTE    ] CCS: Fetching primary data for 2025-08.
[2025-10-24T17:52:18.044835] [INFO ] [REMOTE    ] CCU: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T17:52:18.218568] [INFO ] [REMOTE    ] CDE: Incremental fetch complete for 2025-03 (2.07 seconds).
[2025-10-24T17:52:18.547633] [INFO ] [REMOTE    ] CCU: Fetching primary data for 2025-06.
[2025-10-24T17:52:19.199350] [INFO ] [REMOTE    ] CCS: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T17:52:19.347688] [INFO ] [REMOTE    ] CCS: Fetching primary data for 2025-09.
[2025-10-24T17:52:19.852556] [INFO ] [REMOTE    ] CCU: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T17:52:20.147728] [INFO ] [REMOTE    ] CDE: Fetching primary data for 2025-04.
[2025-10-24T17:52:20.791365] [INFO ] [REMOTE    ] CCS: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T17:52:20.947693] [INFO ] [REMOTE    ] CCS: Fetching primary data for 2025-10.
[2025-10-24T17:52:21.747722] [INFO ] [REMOTE    ] CDLR: Fetching primary data for 2025-01.
[2025-10-24T17:52:22.235318] [INFO ] [REMOTE    ] CDE: Incremental fetch complete for 2025-04 (2.09 seconds).
[2025-10-24T17:52:22.280680] [INFO ] [REMOTE    ] CCS: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T17:52:22.285707] [INFO ] [REMOTE    ] CCS: Full fetch complete (44740 records).
[2025-10-24T17:52:22.285791] [DEBUG] [VALIDATOR ] CCS: Validating primary data.
[2025-10-24T17:52:22.476154] [INFO ] [REMOTE    ] CDLR: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T17:52:22.552855] [INFO ] [REMOTE    ] CDLR: Fetching primary data for 2025-02.
[2025-10-24T17:52:22.664797] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present.
[2025-10-24T17:52:22.664877] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed.
[2025-10-24T17:52:22.665449] [INFO ] [MAIN      ] CCS: Fetched primary data is valid.
[2025-10-24T17:52:22.665487] [DEBUG] [LOCAL     ] CCS: Saving primary data.
[2025-10-24T17:52:22.665900] [FATAL] [LOCAL     ] CCS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:52:22.665983] [FATAL] [MAIN      ] CCS: Failed to save primary data.
[2025-10-24T17:52:22.666024] [WARN ] [MAIN      ] CCS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:52:22.666058] [INFO ] [LOCAL     ] CCS: Starting deletion of primary data.
[2025-10-24T17:52:22.666106] [DEBUG] [LOCAL     ] CCS: No primary data file found to delete.
[2025-10-24T17:52:22.666139] [INFO ] [LOCAL     ] CCS: Starting deletion of derivative data.
[2025-10-24T17:52:22.666285] [DEBUG] [LOCAL     ] CCS: Deleted derivative data file.
[2025-10-24T17:52:22.666356] [INFO ] [MAIN      ] Update Progress: 420/2366 symbols completed. CCS took 31.7s. Estimated remaining: 4h 2m 28s. Rate: 8.0 symbols/min
[2025-10-24T17:52:22.830184] [INFO ] [MAIN      ] CDP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:52:22.872010] [DEBUG] [LOCAL     ] CDP: Loaded 42604 existing records from primary storage.
[2025-10-24T17:52:22.872432] [INFO ] [MAIN      ] CDP: Loaded 42604 existing records.
[2025-10-24T17:52:23.048822] [WARN ] [MAIN      ] CDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:52:23.049051] [INFO ] [MAIN      ] CDP: Wiping existing primary data before full refresh.
[2025-10-24T17:52:23.049099] [INFO ] [LOCAL     ] CDP: Starting deletion of primary data.
[2025-10-24T17:52:23.049573] [DEBUG] [LOCAL     ] CDP: Deleted primary data file.
[2025-10-24T17:52:23.049629] [INFO ] [MAIN      ] CDP: Starting full primary refresh.
[2025-10-24T17:52:23.225198] [INFO ] [REMOTE    ] CDLR: Incremental fetch complete for 2025-02 (0.67 seconds).
[2025-10-24T17:52:23.352791] [INFO ] [REMOTE    ] CDE: Fetching primary data for 2025-05.
[2025-10-24T17:52:23.410492] [INFO ] [REMOTE    ] CDP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:52:24.147750] [INFO ] [REMOTE    ] CDP: Fetching primary data for 2025-01.
[2025-10-24T17:52:24.947611] [INFO ] [REMOTE    ] CDLR: Fetching primary data for 2025-03.
[2025-10-24T17:52:25.490195] [INFO ] [REMOTE    ] CDE: Incremental fetch complete for 2025-05 (2.14 seconds).
[2025-10-24T17:52:25.513942] [INFO ] [REMOTE    ] CDLR: Incremental fetch complete for 2025-03 (0.57 seconds).
[2025-10-24T17:52:25.747627] [INFO ] [REMOTE    ] CDLR: Fetching primary data for 2025-04.
[2025-10-24T17:52:25.800338] [INFO ] [REMOTE    ] CDP: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T17:52:26.478638] [INFO ] [REMOTE    ] CDLR: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T17:52:26.547605] [INFO ] [REMOTE    ] CDP: Fetching primary data for 2025-02.
[2025-10-24T17:52:27.347665] [INFO ] [REMOTE    ] CDE: Fetching primary data for 2025-06.
[2025-10-24T17:52:28.085290] [INFO ] [REMOTE    ] CDP: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T17:52:28.147669] [INFO ] [REMOTE    ] CCU: Fetching primary data for 2025-07.
[2025-10-24T17:52:28.932400] [INFO ] [REMOTE    ] CDE: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T17:52:28.947604] [INFO ] [REMOTE    ] CDE: Fetching primary data for 2025-07.
[2025-10-24T17:52:28.974296] [INFO ] [REMOTE    ] CCU: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T17:52:29.747727] [INFO ] [REMOTE    ] CDP: Fetching primary data for 2025-03.
[2025-10-24T17:52:30.547723] [INFO ] [REMOTE    ] CDLR: Fetching primary data for 2025-05.
[2025-10-24T17:52:30.906402] [INFO ] [REMOTE    ] CDE: Incremental fetch complete for 2025-07 (1.96 seconds).
[2025-10-24T17:52:31.113895] [INFO ] [REMOTE    ] CDLR: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T17:52:31.200470] [INFO ] [REMOTE    ] CDP: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T17:52:31.347727] [INFO ] [REMOTE    ] CDP: Fetching primary data for 2025-04.
[2025-10-24T17:52:32.147705] [INFO ] [REMOTE    ] CCU: Fetching primary data for 2025-08.
[2025-10-24T17:52:32.786453] [INFO ] [REMOTE    ] CDP: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T17:52:32.947704] [INFO ] [REMOTE    ] CDE: Fetching primary data for 2025-08.
[2025-10-24T17:52:33.146177] [INFO ] [REMOTE    ] CCU: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T17:52:33.747673] [INFO ] [REMOTE    ] CCU: Fetching primary data for 2025-09.
[2025-10-24T17:52:34.547619] [INFO ] [REMOTE    ] CDLR: Fetching primary data for 2025-06.
[2025-10-24T17:52:34.708269] [INFO ] [REMOTE    ] CCU: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T17:52:34.855308] [INFO ] [REMOTE    ] CDE: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T17:52:35.347617] [INFO ] [REMOTE    ] CDP: Fetching primary data for 2025-05.
[2025-10-24T17:52:35.417422] [INFO ] [REMOTE    ] CDLR: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T17:52:36.147639] [INFO ] [REMOTE    ] CCU: Fetching primary data for 2025-10.
[2025-10-24T17:52:36.726283] [INFO ] [REMOTE    ] CDP: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T17:52:36.947712] [INFO ] [REMOTE    ] CDE: Fetching primary data for 2025-09.
[2025-10-24T17:52:37.137411] [INFO ] [REMOTE    ] CCU: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T17:52:37.142850] [INFO ] [REMOTE    ] CCU: Full fetch complete (32237 records).
[2025-10-24T17:52:37.142963] [DEBUG] [VALIDATOR ] CCU: Validating primary data.
[2025-10-24T17:52:37.544020] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present.
[2025-10-24T17:52:37.544104] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed.
[2025-10-24T17:52:37.544588] [INFO ] [MAIN      ] CCU: Fetched primary data is valid.
[2025-10-24T17:52:37.544667] [DEBUG] [LOCAL     ] CCU: Saving primary data.
[2025-10-24T17:52:37.544990] [FATAL] [LOCAL     ] CCU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:52:37.545072] [FATAL] [MAIN      ] CCU: Failed to save primary data.
[2025-10-24T17:52:37.545120] [WARN ] [MAIN      ] CCU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:52:37.545160] [INFO ] [LOCAL     ] CCU: Starting deletion of primary data.
[2025-10-24T17:52:37.545246] [DEBUG] [LOCAL     ] CCU: No primary data file found to delete.
[2025-10-24T17:52:37.545294] [INFO ] [LOCAL     ] CCU: Starting deletion of derivative data.
[2025-10-24T17:52:37.545491] [DEBUG] [LOCAL     ] CCU: Deleted derivative data file.
[2025-10-24T17:52:37.545599] [INFO ] [MAIN      ] Update Progress: 421/2366 symbols completed. CCU took 35.5s. Estimated remaining: 4h 2m 54s. Rate: 8.0 symbols/min
[2025-10-24T17:52:37.712605] [INFO ] [MAIN      ] CDRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:52:37.738898] [DEBUG] [LOCAL     ] CDRE: Loaded 24851 existing records from primary storage.
[2025-10-24T17:52:37.739160] [INFO ] [MAIN      ] CDRE: Loaded 24851 existing records.
[2025-10-24T17:52:37.752931] [INFO ] [REMOTE    ] CDP: Fetching primary data for 2025-06.
[2025-10-24T17:52:37.916103] [WARN ] [MAIN      ] CDRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:52:37.916334] [INFO ] [MAIN      ] CDRE: Wiping existing primary data before full refresh.
[2025-10-24T17:52:37.916380] [INFO ] [LOCAL     ] CDRE: Starting deletion of primary data.
[2025-10-24T17:52:37.916576] [DEBUG] [LOCAL     ] CDRE: Deleted primary data file.
[2025-10-24T17:52:37.916631] [INFO ] [MAIN      ] CDRE: Starting full primary refresh.
[2025-10-24T17:52:38.272667] [INFO ] [REMOTE    ] CDRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:52:38.547722] [INFO ] [REMOTE    ] CDRE: Fetching primary data for 2025-01.
[2025-10-24T17:52:39.131355] [INFO ] [REMOTE    ] CDE: Incremental fetch complete for 2025-09 (2.18 seconds).
[2025-10-24T17:52:39.267000] [INFO ] [REMOTE    ] CDP: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T17:52:39.347602] [INFO ] [REMOTE    ] CDP: Fetching primary data for 2025-07.
[2025-10-24T17:52:39.748911] [INFO ] [REMOTE    ] CDRE: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T17:52:40.147684] [INFO ] [REMOTE    ] CDRE: Fetching primary data for 2025-02.
[2025-10-24T17:52:40.718417] [INFO ] [REMOTE    ] CDP: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T17:52:40.943598] [INFO ] [REMOTE    ] CDRE: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T17:52:40.947588] [INFO ] [REMOTE    ] CDRE: Fetching primary data for 2025-03.
[2025-10-24T17:52:41.747692] [INFO ] [REMOTE    ] CDLR: Fetching primary data for 2025-07.
[2025-10-24T17:52:42.061237] [INFO ] [REMOTE    ] CDRE: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T17:52:42.547618] [INFO ] [REMOTE    ] CDP: Fetching primary data for 2025-08.
[2025-10-24T17:52:42.628305] [INFO ] [REMOTE    ] CDLR: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T17:52:43.347692] [INFO ] [REMOTE    ] CDLR: Fetching primary data for 2025-08.
[2025-10-24T17:52:43.834372] [INFO ] [REMOTE    ] CDP: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T17:52:44.018535] [INFO ] [REMOTE    ] CDLR: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T17:52:44.147630] [INFO ] [REMOTE    ] CDLR: Fetching primary data for 2025-09.
[2025-10-24T17:52:44.947725] [INFO ] [REMOTE    ] CDE: Fetching primary data for 2025-10.
[2025-10-24T17:52:44.975033] [INFO ] [REMOTE    ] CDLR: Incremental fetch complete for 2025-09 (0.83 seconds).
[2025-10-24T17:52:45.747723] [INFO ] [REMOTE    ] CDLR: Fetching primary data for 2025-10.
[2025-10-24T17:52:46.547758] [INFO ] [REMOTE    ] CDRE: Fetching primary data for 2025-04.
[2025-10-24T17:52:46.751235] [INFO ] [REMOTE    ] CDLR: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T17:52:46.754144] [INFO ] [REMOTE    ] CDLR: Full fetch complete (14213 records).
[2025-10-24T17:52:46.754214] [DEBUG] [VALIDATOR ] CDLR: Validating primary data.
[2025-10-24T17:52:46.754668] [FATAL] [VALIDATOR ] CDLR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:52:46.754750] [FATAL] [MAIN      ] CDLR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:52:46.754792] [WARN ] [MAIN      ] CDLR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:52:46.754830] [INFO ] [LOCAL     ] CDLR: Starting deletion of primary data.
[2025-10-24T17:52:46.754883] [DEBUG] [LOCAL     ] CDLR: No primary data file found to delete.
[2025-10-24T17:52:46.754919] [INFO ] [LOCAL     ] CDLR: Starting deletion of derivative data.
[2025-10-24T17:52:46.755198] [DEBUG] [LOCAL     ] CDLR: Deleted derivative data file.
[2025-10-24T17:52:46.755281] [INFO ] [MAIN      ] Update Progress: 422/2366 symbols completed. CDLR took 31.1s. Estimated remaining: 4h 2m 55s. Rate: 8.0 symbols/min
[2025-10-24T17:52:46.925167] [INFO ] [MAIN      ] CE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:52:46.972969] [DEBUG] [LOCAL     ] CE: Loaded 51618 existing records from primary storage.
[2025-10-24T17:52:46.973261] [INFO ] [MAIN      ] CE: Loaded 51618 existing records.
[2025-10-24T17:52:47.158346] [WARN ] [MAIN      ] CE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:52:47.158535] [INFO ] [MAIN      ] CE: Wiping existing primary data before full refresh.
[2025-10-24T17:52:47.158583] [INFO ] [LOCAL     ] CE: Starting deletion of primary data.
[2025-10-24T17:52:47.158793] [DEBUG] [LOCAL     ] CE: Deleted primary data file.
[2025-10-24T17:52:47.158850] [INFO ] [MAIN      ] CE: Starting full primary refresh.
[2025-10-24T17:52:47.363054] [INFO ] [REMOTE    ] CDP: Fetching primary data for 2025-09.
[2025-10-24T17:52:47.532200] [INFO ] [REMOTE    ] CE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:52:47.702000] [INFO ] [REMOTE    ] CDRE: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T17:52:47.732731] [INFO ] [REMOTE    ] CDE: Incremental fetch complete for 2025-10 (2.79 seconds).
[2025-10-24T17:52:47.742449] [INFO ] [REMOTE    ] CDE: Full fetch complete (77796 records).
[2025-10-24T17:52:47.742596] [DEBUG] [VALIDATOR ] CDE: Validating primary data.
[2025-10-24T17:52:48.125195] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present.
[2025-10-24T17:52:48.125269] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed.
[2025-10-24T17:52:48.126107] [INFO ] [MAIN      ] CDE: Fetched primary data is valid.
[2025-10-24T17:52:48.126169] [DEBUG] [LOCAL     ] CDE: Saving primary data.
[2025-10-24T17:52:48.126754] [FATAL] [LOCAL     ] CDE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:52:48.126845] [FATAL] [MAIN      ] CDE: Failed to save primary data.
[2025-10-24T17:52:48.126885] [WARN ] [MAIN      ] CDE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:52:48.126920] [INFO ] [LOCAL     ] CDE: Starting deletion of primary data.
[2025-10-24T17:52:48.126970] [DEBUG] [LOCAL     ] CDE: No primary data file found to delete.
[2025-10-24T17:52:48.127005] [INFO ] [LOCAL     ] CDE: Starting deletion of derivative data.
[2025-10-24T17:52:48.127126] [DEBUG] [LOCAL     ] CDE: Deleted derivative data file.
[2025-10-24T17:52:48.127801] [INFO ] [MAIN      ] Update Progress: 423/2366 symbols completed. CDE took 42.5s. Estimated remaining: 4h 2m 19s. Rate: 8.0 symbols/min
[2025-10-24T17:52:48.158694] [INFO ] [REMOTE    ] CDRE: Fetching primary data for 2025-05.
[2025-10-24T17:52:48.298252] [INFO ] [MAIN      ] CEE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:52:48.307474] [DEBUG] [LOCAL     ] CEE: Loaded 5144 existing records from primary storage.
[2025-10-24T17:52:48.307719] [INFO ] [MAIN      ] CEE: Loaded 5144 existing records.
[2025-10-24T17:52:48.487104] [WARN ] [MAIN      ] CEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:52:48.487331] [INFO ] [MAIN      ] CEE: Wiping existing primary data before full refresh.
[2025-10-24T17:52:48.487381] [INFO ] [LOCAL     ] CEE: Starting deletion of primary data.
[2025-10-24T17:52:48.487506] [DEBUG] [LOCAL     ] CEE: Deleted primary data file.
[2025-10-24T17:52:48.487543] [INFO ] [MAIN      ] CEE: Starting full primary refresh.
[2025-10-24T17:52:48.843202] [INFO ] [REMOTE    ] CEE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:52:48.881939] [INFO ] [REMOTE    ] CDP: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T17:52:48.947597] [INFO ] [REMOTE    ] CDP: Fetching primary data for 2025-10.
[2025-10-24T17:52:49.184513] [INFO ] [REMOTE    ] CDRE: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T17:52:49.747638] [INFO ] [REMOTE    ] CEE: Fetching primary data for 2025-01.
[2025-10-24T17:52:50.466432] [INFO ] [REMOTE    ] CDP: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T17:52:50.477698] [INFO ] [REMOTE    ] CDP: Full fetch complete (62129 records).
[2025-10-24T17:52:50.477834] [DEBUG] [VALIDATOR ] CDP: Validating primary data.
[2025-10-24T17:52:50.553381] [INFO ] [REMOTE    ] CE: Fetching primary data for 2025-01.
[2025-10-24T17:52:50.585711] [INFO ] [REMOTE    ] CEE: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T17:52:50.887129] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present.
[2025-10-24T17:52:50.887203] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed.
[2025-10-24T17:52:50.887953] [INFO ] [MAIN      ] CDP: Fetched primary data is valid.
[2025-10-24T17:52:50.888014] [DEBUG] [LOCAL     ] CDP: Saving primary data.
[2025-10-24T17:52:50.888489] [FATAL] [LOCAL     ] CDP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:52:50.888573] [FATAL] [MAIN      ] CDP: Failed to save primary data.
[2025-10-24T17:52:50.888615] [WARN ] [MAIN      ] CDP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:52:50.888678] [INFO ] [LOCAL     ] CDP: Starting deletion of primary data.
[2025-10-24T17:52:50.888751] [DEBUG] [LOCAL     ] CDP: No primary data file found to delete.
[2025-10-24T17:52:50.888805] [INFO ] [LOCAL     ] CDP: Starting deletion of derivative data.
[2025-10-24T17:52:50.888932] [DEBUG] [LOCAL     ] CDP: Deleted derivative data file.
[2025-10-24T17:52:50.889003] [INFO ] [MAIN      ] Update Progress: 424/2366 symbols completed. CDP took 28.2s. Estimated remaining: 4h 1m 50s. Rate: 8.0 symbols/min
[2025-10-24T17:52:51.055774] [INFO ] [MAIN      ] CEPU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:52:51.081887] [DEBUG] [LOCAL     ] CEPU: Loaded 27303 existing records from primary storage.
[2025-10-24T17:52:51.082138] [INFO ] [MAIN      ] CEPU: Loaded 27303 existing records.
[2025-10-24T17:52:51.260691] [WARN ] [MAIN      ] CEPU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:52:51.260909] [INFO ] [MAIN      ] CEPU: Wiping existing primary data before full refresh.
[2025-10-24T17:52:51.260970] [INFO ] [LOCAL     ] CEPU: Starting deletion of primary data.
[2025-10-24T17:52:51.261152] [DEBUG] [LOCAL     ] CEPU: Deleted primary data file.
[2025-10-24T17:52:51.261208] [INFO ] [MAIN      ] CEPU: Starting full primary refresh.
[2025-10-24T17:52:51.352816] [INFO ] [REMOTE    ] CDRE: Fetching primary data for 2025-06.
[2025-10-24T17:52:51.625880] [INFO ] [REMOTE    ] CEPU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:52:52.147623] [INFO ] [REMOTE    ] CEPU: Fetching primary data for 2025-01.
[2025-10-24T17:52:52.202638] [INFO ] [REMOTE    ] CE: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T17:52:52.373312] [INFO ] [REMOTE    ] CDRE: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T17:52:52.947680] [INFO ] [REMOTE    ] CEE: Fetching primary data for 2025-02.
[2025-10-24T17:52:53.082544] [INFO ] [REMOTE    ] CEPU: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T17:52:53.747742] [INFO ] [REMOTE    ] CEPU: Fetching primary data for 2025-02.
[2025-10-24T17:52:53.766075] [INFO ] [REMOTE    ] CEE: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T17:52:54.547664] [INFO ] [REMOTE    ] CDRE: Fetching primary data for 2025-07.
[2025-10-24T17:52:54.786486] [INFO ] [REMOTE    ] CEPU: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T17:52:55.347615] [INFO ] [REMOTE    ] CEE: Fetching primary data for 2025-03.
[2025-10-24T17:52:55.577893] [INFO ] [REMOTE    ] CDRE: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T17:52:56.058954] [INFO ] [REMOTE    ] CEE: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T17:52:56.147671] [INFO ] [REMOTE    ] CEE: Fetching primary data for 2025-04.
[2025-10-24T17:52:56.637692] [INFO ] [REMOTE    ] CEE: Incremental fetch complete for 2025-04 (0.49 seconds).
[2025-10-24T17:52:56.947687] [INFO ] [REMOTE    ] CDRE: Fetching primary data for 2025-08.
[2025-10-24T17:52:57.747718] [INFO ] [REMOTE    ] CEPU: Fetching primary data for 2025-03.
[2025-10-24T17:52:58.270711] [INFO ] [REMOTE    ] CDRE: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T17:52:58.547628] [INFO ] [REMOTE    ] CEE: Fetching primary data for 2025-05.
[2025-10-24T17:52:58.608268] [INFO ] [REMOTE    ] CEPU: Incremental fetch complete for 2025-03 (0.86 seconds).
[2025-10-24T17:52:59.133702] [INFO ] [REMOTE    ] CEE: Incremental fetch complete for 2025-05 (0.59 seconds).
[2025-10-24T17:52:59.347694] [INFO ] [REMOTE    ] CDRE: Fetching primary data for 2025-09.
[2025-10-24T17:53:00.147672] [INFO ] [REMOTE    ] CEPU: Fetching primary data for 2025-04.
[2025-10-24T17:53:00.571216] [INFO ] [REMOTE    ] CDRE: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T17:53:00.947671] [INFO ] [REMOTE    ] CDRE: Fetching primary data for 2025-10.
[2025-10-24T17:53:01.747627] [INFO ] [REMOTE    ] CEE: Fetching primary data for 2025-06.
[2025-10-24T17:53:01.968106] [INFO ] [REMOTE    ] CEPU: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T17:53:02.547674] [INFO ] [REMOTE    ] CEPU: Fetching primary data for 2025-05.
[2025-10-24T17:53:02.979493] [INFO ] [REMOTE    ] CDRE: Incremental fetch complete for 2025-10 (2.03 seconds).
[2025-10-24T17:53:02.984100] [INFO ] [REMOTE    ] CDRE: Full fetch complete (35001 records).
[2025-10-24T17:53:02.984187] [DEBUG] [VALIDATOR ] CDRE: Validating primary data.
[2025-10-24T17:53:03.351502] [INFO ] [REMOTE    ] CE: Fetching primary data for 2025-02.
[2025-10-24T17:53:03.370569] [INFO ] [REMOTE    ] CEE: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T17:53:03.384685] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present.
[2025-10-24T17:53:03.385127] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed.
[2025-10-24T17:53:03.385638] [INFO ] [MAIN      ] CDRE: Fetched primary data is valid.
[2025-10-24T17:53:03.385724] [DEBUG] [LOCAL     ] CDRE: Saving primary data.
[2025-10-24T17:53:03.386111] [FATAL] [LOCAL     ] CDRE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:53:03.386190] [FATAL] [MAIN      ] CDRE: Failed to save primary data.
[2025-10-24T17:53:03.386255] [WARN ] [MAIN      ] CDRE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:53:03.386322] [INFO ] [LOCAL     ] CDRE: Starting deletion of primary data.
[2025-10-24T17:53:03.386377] [DEBUG] [LOCAL     ] CDRE: No primary data file found to delete.
[2025-10-24T17:53:03.386418] [INFO ] [LOCAL     ] CDRE: Starting deletion of derivative data.
[2025-10-24T17:53:03.386538] [DEBUG] [LOCAL     ] CDRE: Deleted derivative data file.
[2025-10-24T17:53:03.386668] [INFO ] [MAIN      ] Update Progress: 425/2366 symbols completed. CDRE took 25.8s. Estimated remaining: 4h 2m 5s. Rate: 8.0 symbols/min
[2025-10-24T17:53:03.569388] [INFO ] [MAIN      ] CF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:53:03.619790] [DEBUG] [LOCAL     ] CF: Loaded 52489 existing records from primary storage.
[2025-10-24T17:53:03.620104] [INFO ] [MAIN      ] CF: Loaded 52489 existing records.
[2025-10-24T17:53:03.795309] [WARN ] [MAIN      ] CF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:53:03.795533] [INFO ] [MAIN      ] CF: Wiping existing primary data before full refresh.
[2025-10-24T17:53:03.795581] [INFO ] [LOCAL     ] CF: Starting deletion of primary data.
[2025-10-24T17:53:03.795841] [DEBUG] [LOCAL     ] CF: Deleted primary data file.
[2025-10-24T17:53:03.795898] [INFO ] [MAIN      ] CF: Starting full primary refresh.
[2025-10-24T17:53:04.143489] [INFO ] [REMOTE    ] CF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:53:04.147599] [INFO ] [REMOTE    ] CF: Fetching primary data for 2025-01.
[2025-10-24T17:53:04.532985] [INFO ] [REMOTE    ] CEPU: Incremental fetch complete for 2025-05 (1.99 seconds).
[2025-10-24T17:53:04.947690] [INFO ] [REMOTE    ] CEPU: Fetching primary data for 2025-06.
[2025-10-24T17:53:05.750053] [INFO ] [REMOTE    ] CEE: Fetching primary data for 2025-07.
[2025-10-24T17:53:05.753190] [INFO ] [REMOTE    ] CE: Incremental fetch complete for 2025-02 (2.40 seconds).
[2025-10-24T17:53:06.221564] [INFO ] [REMOTE    ] CEE: Incremental fetch complete for 2025-07 (0.47 seconds).
[2025-10-24T17:53:06.223441] [INFO ] [REMOTE    ] CF: Incremental fetch complete for 2025-01 (2.08 seconds).
[2025-10-24T17:53:06.440341] [INFO ] [REMOTE    ] CEPU: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T17:53:06.547710] [INFO ] [REMOTE    ] CEE: Fetching primary data for 2025-08.
[2025-10-24T17:53:07.261232] [INFO ] [REMOTE    ] CEE: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T17:53:07.347676] [INFO ] [REMOTE    ] CEPU: Fetching primary data for 2025-07.
[2025-10-24T17:53:08.147624] [INFO ] [REMOTE    ] CE: Fetching primary data for 2025-03.
[2025-10-24T17:53:08.463486] [INFO ] [REMOTE    ] CEPU: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T17:53:08.947638] [INFO ] [REMOTE    ] CEPU: Fetching primary data for 2025-08.
[2025-10-24T17:53:09.747629] [INFO ] [REMOTE    ] CEE: Fetching primary data for 2025-09.
[2025-10-24T17:53:09.785366] [INFO ] [REMOTE    ] CE: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T17:53:09.832100] [INFO ] [REMOTE    ] CEPU: Incremental fetch complete for 2025-08 (0.88 seconds).
[2025-10-24T17:53:10.387586] [INFO ] [REMOTE    ] CEE: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T17:53:10.547633] [INFO ] [REMOTE    ] CEE: Fetching primary data for 2025-10.
[2025-10-24T17:53:11.175302] [INFO ] [REMOTE    ] CEE: Incremental fetch complete for 2025-10 (0.63 seconds).
[2025-10-24T17:53:11.176464] [INFO ] [REMOTE    ] CEE: Full fetch complete (10140 records).
[2025-10-24T17:53:11.176533] [DEBUG] [VALIDATOR ] CEE: Validating primary data.
[2025-10-24T17:53:11.351613] [INFO ] [REMOTE    ] CE: Fetching primary data for 2025-04.
[2025-10-24T17:53:11.547387] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present.
[2025-10-24T17:53:11.547464] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed.
[2025-10-24T17:53:11.547744] [INFO ] [MAIN      ] CEE: Fetched primary data is valid.
[2025-10-24T17:53:11.547804] [DEBUG] [LOCAL     ] CEE: Saving primary data.
[2025-10-24T17:53:11.548011] [FATAL] [LOCAL     ] CEE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:53:11.548094] [FATAL] [MAIN      ] CEE: Failed to save primary data.
[2025-10-24T17:53:11.548135] [WARN ] [MAIN      ] CEE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:53:11.548203] [INFO ] [LOCAL     ] CEE: Starting deletion of primary data.
[2025-10-24T17:53:11.548259] [DEBUG] [LOCAL     ] CEE: No primary data file found to delete.
[2025-10-24T17:53:11.548296] [INFO ] [LOCAL     ] CEE: Starting deletion of derivative data.
[2025-10-24T17:53:11.548415] [DEBUG] [LOCAL     ] CEE: Deleted derivative data file.
[2025-10-24T17:53:11.548480] [INFO ] [MAIN      ] Update Progress: 426/2366 symbols completed. CEE took 23.4s. Estimated remaining: 4h 2m 1s. Rate: 8.0 symbols/min
[2025-10-24T17:53:11.717826] [INFO ] [MAIN      ] CFG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:53:11.769101] [DEBUG] [LOCAL     ] CFG: Loaded 54013 existing records from primary storage.
[2025-10-24T17:53:11.769440] [INFO ] [MAIN      ] CFG: Loaded 54013 existing records.
[2025-10-24T17:53:11.943201] [WARN ] [MAIN      ] CFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:53:11.943425] [INFO ] [MAIN      ] CFG: Wiping existing primary data before full refresh.
[2025-10-24T17:53:11.943470] [INFO ] [LOCAL     ] CFG: Starting deletion of primary data.
[2025-10-24T17:53:11.943733] [DEBUG] [LOCAL     ] CFG: Deleted primary data file.
[2025-10-24T17:53:11.943789] [INFO ] [MAIN      ] CFG: Starting full primary refresh.
[2025-10-24T17:53:12.152764] [INFO ] [REMOTE    ] CEPU: Fetching primary data for 2025-09.
[2025-10-24T17:53:12.292783] [INFO ] [REMOTE    ] CFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:53:12.947754] [INFO ] [REMOTE    ] CFG: Fetching primary data for 2025-01.
[2025-10-24T17:53:13.186811] [INFO ] [REMOTE    ] CE: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T17:53:13.584433] [INFO ] [REMOTE    ] CEPU: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T17:53:13.747709] [INFO ] [REMOTE    ] CEPU: Fetching primary data for 2025-10.
[2025-10-24T17:53:14.478575] [INFO ] [REMOTE    ] CFG: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T17:53:14.547705] [INFO ] [REMOTE    ] CFG: Fetching primary data for 2025-02.
[2025-10-24T17:53:15.347685] [INFO ] [REMOTE    ] CF: Fetching primary data for 2025-02.
[2025-10-24T17:53:15.374242] [INFO ] [REMOTE    ] CEPU: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T17:53:15.380816] [INFO ] [REMOTE    ] CEPU: Full fetch complete (39655 records).
[2025-10-24T17:53:15.380957] [DEBUG] [VALIDATOR ] CEPU: Validating primary data.
[2025-10-24T17:53:15.749593] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present.
[2025-10-24T17:53:15.749698] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed.
[2025-10-24T17:53:15.750241] [INFO ] [MAIN      ] CEPU: Fetched primary data is valid.
[2025-10-24T17:53:15.750281] [DEBUG] [LOCAL     ] CEPU: Saving primary data.
[2025-10-24T17:53:15.750606] [FATAL] [LOCAL     ] CEPU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:53:15.750708] [FATAL] [MAIN      ] CEPU: Failed to save primary data.
[2025-10-24T17:53:15.750750] [WARN ] [MAIN      ] CEPU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:53:15.750783] [INFO ] [LOCAL     ] CEPU: Starting deletion of primary data.
[2025-10-24T17:53:15.750831] [DEBUG] [LOCAL     ] CEPU: No primary data file found to delete.
[2025-10-24T17:53:15.750868] [INFO ] [LOCAL     ] CEPU: Starting deletion of derivative data.
[2025-10-24T17:53:15.751012] [DEBUG] [LOCAL     ] CEPU: Deleted derivative data file.
[2025-10-24T17:53:15.751097] [INFO ] [MAIN      ] Update Progress: 427/2366 symbols completed. CEPU took 24.9s. Estimated remaining: 4h 1m 39s. Rate: 8.0 symbols/min
[2025-10-24T17:53:15.923359] [INFO ] [MAIN      ] CFND: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:53:15.923552] [DEBUG] [LOCAL     ] CFND: No existing data file found in primary storage.
[2025-10-24T17:53:15.923589] [WARN ] [MAIN      ] CFND: No existing data found, performing full refresh instead.
[2025-10-24T17:53:15.923724] [INFO ] [MAIN      ] CFND: Wiping existing primary data before full refresh.
[2025-10-24T17:53:15.923770] [INFO ] [LOCAL     ] CFND: Starting deletion of primary data.
[2025-10-24T17:53:15.923811] [DEBUG] [LOCAL     ] CFND: No primary data file found to delete.
[2025-10-24T17:53:15.923842] [INFO ] [MAIN      ] CFND: Starting full primary refresh.
[2025-10-24T17:53:16.151328] [INFO ] [REMOTE    ] CE: Fetching primary data for 2025-05.
[2025-10-24T17:53:16.292767] [INFO ] [REMOTE    ] CFND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:53:16.323438] [INFO ] [REMOTE    ] CFG: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T17:53:16.947693] [INFO ] [REMOTE    ] CFND: Fetching primary data for 2025-01.
[2025-10-24T17:53:17.143395] [DEBUG] [REMOTE    ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:53:17.143744] [WARN ] [REMOTE    ] CFND: No data returned for month 2025-01
[2025-10-24T17:53:17.143846] [FATAL] [REMOTE    ] CFND: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:53:17.143896] [FATAL] [MAIN      ] CFND: Failed to fetch primary data.
[2025-10-24T17:53:17.143929] [WARN ] [MAIN      ] CFND: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:53:17.143966] [INFO ] [LOCAL     ] CFND: Starting deletion of primary data.
[2025-10-24T17:53:17.144019] [DEBUG] [LOCAL     ] CFND: No primary data file found to delete.
[2025-10-24T17:53:17.144053] [INFO ] [LOCAL     ] CFND: Starting deletion of derivative data.
[2025-10-24T17:53:17.144091] [DEBUG] [LOCAL     ] CFND: No derivative data file found to delete.
[2025-10-24T17:53:17.144135] [INFO ] [MAIN      ] Update Progress: 428/2366 symbols completed. CFND took 1.4s. Estimated remaining: 4h 1m 4s. Rate: 8.0 symbols/min
[2025-10-24T17:53:17.317106] [INFO ] [MAIN      ] CFR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:53:17.344672] [INFO ] [REMOTE    ] CF: Incremental fetch complete for 2025-02 (2.00 seconds).
[2025-10-24T17:53:17.386925] [DEBUG] [LOCAL     ] CFR: Loaded 32608 existing records from primary storage.
[2025-10-24T17:53:17.387250] [INFO ] [MAIN      ] CFR: Loaded 32608 existing records.
[2025-10-24T17:53:17.566052] [WARN ] [MAIN      ] CFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:53:17.566254] [INFO ] [MAIN      ] CFR: Wiping existing primary data before full refresh.
[2025-10-24T17:53:17.566300] [INFO ] [LOCAL     ] CFR: Starting deletion of primary data.
[2025-10-24T17:53:17.566630] [DEBUG] [LOCAL     ] CFR: Deleted primary data file.
[2025-10-24T17:53:17.566721] [INFO ] [MAIN      ] CFR: Starting full primary refresh.
[2025-10-24T17:53:17.758085] [INFO ] [REMOTE    ] CF: Fetching primary data for 2025-03.
[2025-10-24T17:53:17.926958] [INFO ] [REMOTE    ] CFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:53:18.522867] [INFO ] [REMOTE    ] CE: Incremental fetch complete for 2025-05 (2.37 seconds).
[2025-10-24T17:53:18.547723] [INFO ] [REMOTE    ] CFG: Fetching primary data for 2025-03.
[2025-10-24T17:53:19.347741] [INFO ] [REMOTE    ] CFR: Fetching primary data for 2025-01.
[2025-10-24T17:53:19.509593] [INFO ] [REMOTE    ] CF: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T17:53:20.147738] [INFO ] [REMOTE    ] CE: Fetching primary data for 2025-06.
[2025-10-24T17:53:20.215283] [INFO ] [REMOTE    ] CFG: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T17:53:20.870612] [INFO ] [REMOTE    ] CFR: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T17:53:20.947736] [INFO ] [REMOTE    ] CF: Fetching primary data for 2025-04.
[2025-10-24T17:53:21.513107] [INFO ] [REMOTE    ] CE: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T17:53:21.747715] [INFO ] [REMOTE    ] CFR: Fetching primary data for 2025-02.
[2025-10-24T17:53:22.547724] [INFO ] [REMOTE    ] CFG: Fetching primary data for 2025-04.
[2025-10-24T17:53:22.774343] [INFO ] [REMOTE    ] CF: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T17:53:22.805179] [INFO ] [REMOTE    ] CFR: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T17:53:23.347715] [INFO ] [REMOTE    ] CF: Fetching primary data for 2025-05.
[2025-10-24T17:53:23.912924] [INFO ] [REMOTE    ] CFG: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T17:53:24.147679] [INFO ] [REMOTE    ] CFG: Fetching primary data for 2025-05.
[2025-10-24T17:53:24.856454] [INFO ] [REMOTE    ] CF: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T17:53:24.947712] [INFO ] [REMOTE    ] CF: Fetching primary data for 2025-06.
[2025-10-24T17:53:25.747636] [INFO ] [REMOTE    ] CFR: Fetching primary data for 2025-03.
[2025-10-24T17:53:25.851728] [INFO ] [REMOTE    ] CFG: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T17:53:26.547683] [INFO ] [REMOTE    ] CFG: Fetching primary data for 2025-06.
[2025-10-24T17:53:26.687416] [INFO ] [REMOTE    ] CF: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T17:53:27.347697] [INFO ] [REMOTE    ] CF: Fetching primary data for 2025-07.
[2025-10-24T17:53:27.419586] [INFO ] [REMOTE    ] CFR: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T17:53:28.147674] [INFO ] [REMOTE    ] CE: Fetching primary data for 2025-07.
[2025-10-24T17:53:28.239032] [INFO ] [REMOTE    ] CFG: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T17:53:28.869111] [INFO ] [REMOTE    ] CF: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T17:53:28.947618] [INFO ] [REMOTE    ] CF: Fetching primary data for 2025-08.
[2025-10-24T17:53:29.747626] [INFO ] [REMOTE    ] CFR: Fetching primary data for 2025-04.
[2025-10-24T17:53:29.978812] [INFO ] [REMOTE    ] CE: Incremental fetch complete for 2025-07 (1.83 seconds).
[2025-10-24T17:53:30.332176] [INFO ] [REMOTE    ] CF: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T17:53:30.547637] [INFO ] [REMOTE    ] CF: Fetching primary data for 2025-09.
[2025-10-24T17:53:31.130360] [INFO ] [REMOTE    ] CFR: Incremental fetch complete for 2025-04 (1.38 seconds).
[2025-10-24T17:53:31.347705] [INFO ] [REMOTE    ] CE: Fetching primary data for 2025-08.
[2025-10-24T17:53:31.944933] [INFO ] [REMOTE    ] CF: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T17:53:32.147638] [INFO ] [REMOTE    ] CF: Fetching primary data for 2025-10.
[2025-10-24T17:53:32.947636] [INFO ] [REMOTE    ] CFG: Fetching primary data for 2025-07.
[2025-10-24T17:53:33.162703] [INFO ] [REMOTE    ] CE: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T17:53:33.747697] [INFO ] [REMOTE    ] CFR: Fetching primary data for 2025-05.
[2025-10-24T17:53:33.799262] [INFO ] [REMOTE    ] CF: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T17:53:33.809917] [INFO ] [REMOTE    ] CF: Full fetch complete (75564 records).
[2025-10-24T17:53:33.810126] [DEBUG] [VALIDATOR ] CF: Validating primary data.
[2025-10-24T17:53:34.208116] [DEBUG] [VALIDATOR ] CF: All expected trading days are present.
[2025-10-24T17:53:34.208195] [DEBUG] [VALIDATOR ] CF: Primary data validation passed.
[2025-10-24T17:53:34.209140] [INFO ] [MAIN      ] CF: Fetched primary data is valid.
[2025-10-24T17:53:34.209204] [DEBUG] [LOCAL     ] CF: Saving primary data.
[2025-10-24T17:53:34.209788] [FATAL] [LOCAL     ] CF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:53:34.209894] [FATAL] [MAIN      ] CF: Failed to save primary data.
[2025-10-24T17:53:34.209937] [WARN ] [MAIN      ] CF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:53:34.209975] [INFO ] [LOCAL     ] CF: Starting deletion of primary data.
[2025-10-24T17:53:34.210029] [DEBUG] [LOCAL     ] CF: No primary data file found to delete.
[2025-10-24T17:53:34.210065] [INFO ] [LOCAL     ] CF: Starting deletion of derivative data.
[2025-10-24T17:53:34.210199] [DEBUG] [LOCAL     ] CF: Deleted derivative data file.
[2025-10-24T17:53:34.210576] [INFO ] [MAIN      ] Update Progress: 429/2366 symbols completed. CF took 30.8s. Estimated remaining: 4h 1m 40s. Rate: 8.0 symbols/min
[2025-10-24T17:53:34.380431] [INFO ] [MAIN      ] CGAU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:53:34.419890] [DEBUG] [LOCAL     ] CGAU: Loaded 44258 existing records from primary storage.
[2025-10-24T17:53:34.420177] [INFO ] [MAIN      ] CGAU: Loaded 44258 existing records.
[2025-10-24T17:53:34.552865] [INFO ] [REMOTE    ] CE: Fetching primary data for 2025-09.
[2025-10-24T17:53:34.603616] [WARN ] [MAIN      ] CGAU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:53:34.604956] [INFO ] [MAIN      ] CGAU: Wiping existing primary data before full refresh.
[2025-10-24T17:53:34.605020] [INFO ] [LOCAL     ] CGAU: Starting deletion of primary data.
[2025-10-24T17:53:34.605393] [DEBUG] [LOCAL     ] CGAU: Deleted primary data file.
[2025-10-24T17:53:34.605437] [INFO ] [MAIN      ] CGAU: Starting full primary refresh.
[2025-10-24T17:53:34.966347] [INFO ] [REMOTE    ] CGAU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:53:34.999382] [INFO ] [REMOTE    ] CFG: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T17:53:35.031015] [INFO ] [REMOTE    ] CFR: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T17:53:35.347674] [INFO ] [REMOTE    ] CGAU: Fetching primary data for 2025-01.
[2025-10-24T17:53:36.147626] [INFO ] [REMOTE    ] CFG: Fetching primary data for 2025-08.
[2025-10-24T17:53:36.236106] [INFO ] [REMOTE    ] CE: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T17:53:36.370394] [INFO ] [REMOTE    ] CGAU: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T17:53:36.947666] [INFO ] [REMOTE    ] CE: Fetching primary data for 2025-10.
[2025-10-24T17:53:37.540333] [INFO ] [REMOTE    ] CFG: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T17:53:37.747675] [INFO ] [REMOTE    ] CGAU: Fetching primary data for 2025-02.
[2025-10-24T17:53:38.470250] [INFO ] [REMOTE    ] CE: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T17:53:38.479611] [INFO ] [REMOTE    ] CE: Full fetch complete (74409 records).
[2025-10-24T17:53:38.479804] [DEBUG] [VALIDATOR ] CE: Validating primary data.
[2025-10-24T17:53:38.481063] [FATAL] [VALIDATOR ] CE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:53:38.481158] [FATAL] [MAIN      ] CE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:53:38.481201] [WARN ] [MAIN      ] CE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:53:38.481245] [INFO ] [LOCAL     ] CE: Starting deletion of primary data.
[2025-10-24T17:53:38.481308] [DEBUG] [LOCAL     ] CE: No primary data file found to delete.
[2025-10-24T17:53:38.481346] [INFO ] [LOCAL     ] CE: Starting deletion of derivative data.
[2025-10-24T17:53:38.481603] [DEBUG] [LOCAL     ] CE: Deleted derivative data file.
[2025-10-24T17:53:38.482072] [INFO ] [MAIN      ] Update Progress: 430/2366 symbols completed. CE took 51.7s. Estimated remaining: 4h 1m 18s. Rate: 8.0 symbols/min
[2025-10-24T17:53:38.552770] [INFO ] [REMOTE    ] CFG: Fetching primary data for 2025-09.
[2025-10-24T17:53:38.658961] [INFO ] [MAIN      ] CGV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:53:38.662316] [DEBUG] [LOCAL     ] CGV: Loaded 1368 existing records from primary storage.
[2025-10-24T17:53:38.662470] [INFO ] [MAIN      ] CGV: Loaded 1368 existing records.
[2025-10-24T17:53:38.857147] [WARN ] [MAIN      ] CGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:53:38.857887] [INFO ] [MAIN      ] CGV: Wiping existing primary data before full refresh.
[2025-10-24T17:53:38.857980] [INFO ] [LOCAL     ] CGV: Starting deletion of primary data.
[2025-10-24T17:53:38.866751] [DEBUG] [LOCAL     ] CGV: Deleted primary data file.
[2025-10-24T17:53:38.879399] [INFO ] [MAIN      ] CGV: Starting full primary refresh.
[2025-10-24T17:53:38.886076] [INFO ] [REMOTE    ] CGAU: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T17:53:39.278020] [INFO ] [REMOTE    ] CGV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:53:39.347604] [INFO ] [REMOTE    ] CGV: Fetching primary data for 2025-01.
[2025-10-24T17:53:39.974595] [INFO ] [REMOTE    ] CGV: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T17:53:40.147696] [INFO ] [REMOTE    ] CGAU: Fetching primary data for 2025-03.
[2025-10-24T17:53:40.402265] [INFO ] [REMOTE    ] CFG: Incremental fetch complete for 2025-09 (1.85 seconds).
[2025-10-24T17:53:40.947700] [INFO ] [REMOTE    ] CGV: Fetching primary data for 2025-02.
[2025-10-24T17:53:41.265520] [INFO ] [REMOTE    ] CGAU: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T17:53:41.348372] [INFO ] [REMOTE    ] CGV: Incremental fetch complete for 2025-02 (0.40 seconds).
[2025-10-24T17:53:41.747734] [INFO ] [REMOTE    ] CGAU: Fetching primary data for 2025-04.
[2025-10-24T17:53:42.547718] [INFO ] [REMOTE    ] CFR: Fetching primary data for 2025-06.
[2025-10-24T17:53:43.318789] [INFO ] [REMOTE    ] CGAU: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T17:53:43.347614] [INFO ] [REMOTE    ] CGAU: Fetching primary data for 2025-05.
[2025-10-24T17:53:43.752145] [INFO ] [REMOTE    ] CFR: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T17:53:44.147708] [INFO ] [REMOTE    ] CGV: Fetching primary data for 2025-03.
[2025-10-24T17:53:44.443890] [INFO ] [REMOTE    ] CGAU: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T17:53:44.608952] [INFO ] [REMOTE    ] CGV: Incremental fetch complete for 2025-03 (0.46 seconds).
[2025-10-24T17:53:44.947679] [INFO ] [REMOTE    ] CGAU: Fetching primary data for 2025-06.
[2025-10-24T17:53:45.747637] [INFO ] [REMOTE    ] CFG: Fetching primary data for 2025-10.
[2025-10-24T17:53:46.189971] [INFO ] [REMOTE    ] CGAU: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T17:53:46.547685] [INFO ] [REMOTE    ] CGAU: Fetching primary data for 2025-07.
[2025-10-24T17:53:47.347738] [INFO ] [REMOTE    ] CGV: Fetching primary data for 2025-04.
[2025-10-24T17:53:47.401127] [INFO ] [REMOTE    ] CFG: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T17:53:47.411012] [INFO ] [REMOTE    ] CFG: Full fetch complete (77777 records).
[2025-10-24T17:53:47.411156] [DEBUG] [VALIDATOR ] CFG: Validating primary data.
[2025-10-24T17:53:47.749757] [INFO ] [REMOTE    ] CGV: Incremental fetch complete for 2025-04 (0.40 seconds).
[2025-10-24T17:53:47.860435] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present.
[2025-10-24T17:53:47.860526] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed.
[2025-10-24T17:53:47.861477] [INFO ] [MAIN      ] CFG: Fetched primary data is valid.
[2025-10-24T17:53:47.861554] [DEBUG] [LOCAL     ] CFG: Saving primary data.
[2025-10-24T17:53:47.862190] [FATAL] [LOCAL     ] CFG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:53:47.862295] [FATAL] [MAIN      ] CFG: Failed to save primary data.
[2025-10-24T17:53:47.862338] [WARN ] [MAIN      ] CFG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:53:47.862381] [INFO ] [LOCAL     ] CFG: Starting deletion of primary data.
[2025-10-24T17:53:47.862451] [DEBUG] [LOCAL     ] CFG: No primary data file found to delete.
[2025-10-24T17:53:47.862490] [INFO ] [LOCAL     ] CFG: Starting deletion of derivative data.
[2025-10-24T17:53:47.862711] [DEBUG] [LOCAL     ] CFG: Deleted derivative data file.
[2025-10-24T17:53:47.863059] [INFO ] [MAIN      ] Update Progress: 431/2366 symbols completed. CFG took 36.3s. Estimated remaining: 4h 1m 19s. Rate: 8.0 symbols/min
[2025-10-24T17:53:48.038834] [INFO ] [MAIN      ] CHCT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:53:48.065096] [DEBUG] [LOCAL     ] CHCT: Loaded 24374 existing records from primary storage.
[2025-10-24T17:53:48.065504] [INFO ] [MAIN      ] CHCT: Loaded 24374 existing records.
[2025-10-24T17:53:48.148300] [INFO ] [REMOTE    ] CGV: Fetching primary data for 2025-05.
[2025-10-24T17:53:48.258204] [WARN ] [MAIN      ] CHCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:53:48.258629] [INFO ] [MAIN      ] CHCT: Wiping existing primary data before full refresh.
[2025-10-24T17:53:48.258771] [INFO ] [LOCAL     ] CHCT: Starting deletion of primary data.
[2025-10-24T17:53:48.259298] [DEBUG] [LOCAL     ] CHCT: Deleted primary data file.
[2025-10-24T17:53:48.259360] [INFO ] [MAIN      ] CHCT: Starting full primary refresh.
[2025-10-24T17:53:48.601379] [INFO ] [REMOTE    ] CGV: Incremental fetch complete for 2025-05 (0.45 seconds).
[2025-10-24T17:53:48.624279] [INFO ] [REMOTE    ] CGAU: Incremental fetch complete for 2025-07 (2.08 seconds).
[2025-10-24T17:53:48.672995] [INFO ] [REMOTE    ] CHCT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:53:48.947693] [INFO ] [REMOTE    ] CGAU: Fetching primary data for 2025-08.
[2025-10-24T17:53:49.747702] [INFO ] [REMOTE    ] CFR: Fetching primary data for 2025-07.
[2025-10-24T17:53:50.306841] [INFO ] [REMOTE    ] CGAU: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T17:53:50.547748] [INFO ] [REMOTE    ] CGAU: Fetching primary data for 2025-09.
[2025-10-24T17:53:50.599762] [INFO ] [REMOTE    ] CFR: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T17:53:51.347711] [INFO ] [REMOTE    ] CFR: Fetching primary data for 2025-08.
[2025-10-24T17:53:52.147675] [INFO ] [REMOTE    ] CHCT: Fetching primary data for 2025-01.
[2025-10-24T17:53:52.196750] [INFO ] [REMOTE    ] CGAU: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T17:53:52.880506] [INFO ] [REMOTE    ] CFR: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T17:53:52.947636] [INFO ] [REMOTE    ] CGAU: Fetching primary data for 2025-10.
[2025-10-24T17:53:53.085790] [INFO ] [REMOTE    ] CHCT: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T17:53:53.747699] [INFO ] [REMOTE    ] CGV: Fetching primary data for 2025-06.
[2025-10-24T17:53:54.260227] [INFO ] [REMOTE    ] CGV: Incremental fetch complete for 2025-06 (0.51 seconds).
[2025-10-24T17:53:54.478116] [INFO ] [REMOTE    ] CGAU: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T17:53:54.487260] [INFO ] [REMOTE    ] CGAU: Full fetch complete (62224 records).
[2025-10-24T17:53:54.487374] [DEBUG] [VALIDATOR ] CGAU: Validating primary data.
[2025-10-24T17:53:54.552836] [INFO ] [REMOTE    ] CGV: Fetching primary data for 2025-07.
[2025-10-24T17:53:54.875711] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present.
[2025-10-24T17:53:54.875792] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed.
[2025-10-24T17:53:54.876502] [INFO ] [MAIN      ] CGAU: Fetched primary data is valid.
[2025-10-24T17:53:54.876542] [DEBUG] [LOCAL     ] CGAU: Saving primary data.
[2025-10-24T17:53:54.877049] [FATAL] [LOCAL     ] CGAU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:53:54.877136] [FATAL] [MAIN      ] CGAU: Failed to save primary data.
[2025-10-24T17:53:54.877177] [WARN ] [MAIN      ] CGAU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:53:54.877246] [INFO ] [LOCAL     ] CGAU: Starting deletion of primary data.
[2025-10-24T17:53:54.877341] [DEBUG] [LOCAL     ] CGAU: No primary data file found to delete.
[2025-10-24T17:53:54.877399] [INFO ] [LOCAL     ] CGAU: Starting deletion of derivative data.
[2025-10-24T17:53:54.877589] [DEBUG] [LOCAL     ] CGAU: Deleted derivative data file.
[2025-10-24T17:53:54.878046] [INFO ] [MAIN      ] Update Progress: 432/2366 symbols completed. CGAU took 20.7s. Estimated remaining: 4h 1m 9s. Rate: 8.0 symbols/min
[2025-10-24T17:53:55.055239] [INFO ] [MAIN      ] CHD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:53:55.107635] [INFO ] [REMOTE    ] CGV: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T17:53:55.108599] [DEBUG] [LOCAL     ] CHD: Loaded 52693 existing records from primary storage.
[2025-10-24T17:53:55.110210] [INFO ] [MAIN      ] CHD: Loaded 52693 existing records.
[2025-10-24T17:53:55.287295] [WARN ] [MAIN      ] CHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:53:55.287628] [INFO ] [MAIN      ] CHD: Wiping existing primary data before full refresh.
[2025-10-24T17:53:55.287710] [INFO ] [LOCAL     ] CHD: Starting deletion of primary data.
[2025-10-24T17:53:55.288473] [DEBUG] [LOCAL     ] CHD: Deleted primary data file.
[2025-10-24T17:53:55.288529] [INFO ] [MAIN      ] CHD: Starting full primary refresh.
[2025-10-24T17:53:55.352858] [INFO ] [REMOTE    ] CHCT: Fetching primary data for 2025-02.
[2025-10-24T17:53:55.637525] [INFO ] [REMOTE    ] CHD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:53:56.147614] [INFO ] [REMOTE    ] CFR: Fetching primary data for 2025-09.
[2025-10-24T17:53:56.463964] [INFO ] [REMOTE    ] CHCT: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T17:53:56.947678] [INFO ] [REMOTE    ] CGV: Fetching primary data for 2025-08.
[2025-10-24T17:53:57.299705] [INFO ] [REMOTE    ] CGV: Incremental fetch complete for 2025-08 (0.35 seconds).
[2025-10-24T17:53:57.441771] [INFO ] [REMOTE    ] CFR: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T17:53:57.747683] [INFO ] [REMOTE    ] CFR: Fetching primary data for 2025-10.
[2025-10-24T17:53:58.547705] [INFO ] [REMOTE    ] CHCT: Fetching primary data for 2025-03.
[2025-10-24T17:53:58.912800] [INFO ] [REMOTE    ] CFR: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T17:53:58.918441] [INFO ] [REMOTE    ] CFR: Full fetch complete (48673 records).
[2025-10-24T17:53:58.918530] [DEBUG] [VALIDATOR ] CFR: Validating primary data.
[2025-10-24T17:53:59.291394] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present.
[2025-10-24T17:53:59.291471] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed.
[2025-10-24T17:53:59.292349] [INFO ] [MAIN      ] CFR: Fetched primary data is valid.
[2025-10-24T17:53:59.292412] [DEBUG] [LOCAL     ] CFR: Saving primary data.
[2025-10-24T17:53:59.292847] [FATAL] [LOCAL     ] CFR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:53:59.292931] [FATAL] [MAIN      ] CFR: Failed to save primary data.
[2025-10-24T17:53:59.292972] [WARN ] [MAIN      ] CFR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:53:59.293006] [INFO ] [LOCAL     ] CFR: Starting deletion of primary data.
[2025-10-24T17:53:59.293056] [DEBUG] [LOCAL     ] CFR: No primary data file found to delete.
[2025-10-24T17:53:59.293091] [INFO ] [LOCAL     ] CFR: Starting deletion of derivative data.
[2025-10-24T17:53:59.293251] [DEBUG] [LOCAL     ] CFR: Deleted derivative data file.
[2025-10-24T17:53:59.293343] [INFO ] [MAIN      ] Update Progress: 433/2366 symbols completed. CFR took 42.1s. Estimated remaining: 4h 0m 48s. Rate: 8.0 symbols/min
[2025-10-24T17:53:59.357289] [INFO ] [REMOTE    ] CHD: Fetching primary data for 2025-01.
[2025-10-24T17:53:59.495067] [INFO ] [MAIN      ] CHE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:53:59.510302] [INFO ] [REMOTE    ] CHCT: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T17:53:59.528404] [DEBUG] [LOCAL     ] CHE: Loaded 15444 existing records from primary storage.
[2025-10-24T17:53:59.528680] [INFO ] [MAIN      ] CHE: Loaded 15444 existing records.
[2025-10-24T17:53:59.701144] [WARN ] [MAIN      ] CHE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:53:59.701351] [INFO ] [MAIN      ] CHE: Wiping existing primary data before full refresh.
[2025-10-24T17:53:59.701397] [INFO ] [LOCAL     ] CHE: Starting deletion of primary data.
[2025-10-24T17:53:59.701574] [DEBUG] [LOCAL     ] CHE: Deleted primary data file.
[2025-10-24T17:53:59.701613] [INFO ] [MAIN      ] CHE: Starting full primary refresh.
[2025-10-24T17:54:00.047828] [INFO ] [REMOTE    ] CHE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:54:00.147600] [INFO ] [REMOTE    ] CHE: Fetching primary data for 2025-01.
[2025-10-24T17:54:00.947732] [INFO ] [REMOTE    ] CGV: Fetching primary data for 2025-09.
[2025-10-24T17:54:01.541628] [INFO ] [REMOTE    ] CHE: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T17:54:01.747746] [INFO ] [REMOTE    ] CHCT: Fetching primary data for 2025-04.
[2025-10-24T17:54:01.831332] [INFO ] [REMOTE    ] CGV: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T17:54:02.056282] [INFO ] [REMOTE    ] CHD: Incremental fetch complete for 2025-01 (2.70 seconds).
[2025-10-24T17:54:02.547702] [INFO ] [REMOTE    ] CHD: Fetching primary data for 2025-02.
[2025-10-24T17:54:03.299911] [INFO ] [REMOTE    ] CHCT: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T17:54:03.347722] [INFO ] [REMOTE    ] CHE: Fetching primary data for 2025-02.
[2025-10-24T17:54:04.147616] [INFO ] [REMOTE    ] CGV: Fetching primary data for 2025-10.
[2025-10-24T17:54:04.347541] [INFO ] [REMOTE    ] CHE: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T17:54:04.677985] [INFO ] [REMOTE    ] CHD: Incremental fetch complete for 2025-02 (2.13 seconds).
[2025-10-24T17:54:04.947709] [INFO ] [REMOTE    ] CHCT: Fetching primary data for 2025-05.
[2025-10-24T17:54:05.028272] [INFO ] [REMOTE    ] CGV: Incremental fetch complete for 2025-10 (0.88 seconds).
[2025-10-24T17:54:05.029111] [INFO ] [REMOTE    ] CGV: Full fetch complete (2210 records).
[2025-10-24T17:54:05.029180] [DEBUG] [VALIDATOR ] CGV: Validating primary data.
[2025-10-24T17:54:05.381485] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present.
[2025-10-24T17:54:05.381557] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed.
[2025-10-24T17:54:05.381669] [INFO ] [MAIN      ] CGV: Fetched primary data is valid.
[2025-10-24T17:54:05.381746] [DEBUG] [LOCAL     ] CGV: Saving primary data.
[2025-10-24T17:54:05.381950] [FATAL] [LOCAL     ] CGV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:54:05.382030] [FATAL] [MAIN      ] CGV: Failed to save primary data.
[2025-10-24T17:54:05.382073] [WARN ] [MAIN      ] CGV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:54:05.382109] [INFO ] [LOCAL     ] CGV: Starting deletion of primary data.
[2025-10-24T17:54:05.382159] [DEBUG] [LOCAL     ] CGV: No primary data file found to delete.
[2025-10-24T17:54:05.382194] [INFO ] [LOCAL     ] CGV: Starting deletion of derivative data.
[2025-10-24T17:54:05.382331] [DEBUG] [LOCAL     ] CGV: Deleted derivative data file.
[2025-10-24T17:54:05.382417] [INFO ] [MAIN      ] Update Progress: 434/2366 symbols completed. CGV took 26.9s. Estimated remaining: 4h 0m 34s. Rate: 8.0 symbols/min
[2025-10-24T17:54:05.574198] [INFO ] [MAIN      ] CHGG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:54:05.618223] [DEBUG] [LOCAL     ] CHGG: Loaded 47817 existing records from primary storage.
[2025-10-24T17:54:05.618508] [INFO ] [MAIN      ] CHGG: Loaded 47817 existing records.
[2025-10-24T17:54:05.752690] [INFO ] [REMOTE    ] CHD: Fetching primary data for 2025-03.
[2025-10-24T17:54:05.818081] [WARN ] [MAIN      ] CHGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:54:05.818262] [INFO ] [MAIN      ] CHGG: Wiping existing primary data before full refresh.
[2025-10-24T17:54:05.818310] [INFO ] [LOCAL     ] CHGG: Starting deletion of primary data.
[2025-10-24T17:54:05.819029] [DEBUG] [LOCAL     ] CHGG: Deleted primary data file.
[2025-10-24T17:54:05.819086] [INFO ] [MAIN      ] CHGG: Starting full primary refresh.
[2025-10-24T17:54:06.210276] [INFO ] [REMOTE    ] CHGG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:54:06.224526] [INFO ] [REMOTE    ] CHCT: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T17:54:06.547717] [INFO ] [REMOTE    ] CHE: Fetching primary data for 2025-03.
[2025-10-24T17:54:07.347614] [INFO ] [REMOTE    ] CHCT: Fetching primary data for 2025-06.
[2025-10-24T17:54:07.490440] [INFO ] [REMOTE    ] CHE: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T17:54:07.625699] [INFO ] [REMOTE    ] CHD: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T17:54:08.147728] [INFO ] [REMOTE    ] CHD: Fetching primary data for 2025-04.
[2025-10-24T17:54:08.650716] [INFO ] [REMOTE    ] CHCT: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T17:54:08.947677] [INFO ] [REMOTE    ] CHCT: Fetching primary data for 2025-07.
[2025-10-24T17:54:09.747620] [INFO ] [REMOTE    ] CHGG: Fetching primary data for 2025-01.
[2025-10-24T17:54:09.945851] [INFO ] [REMOTE    ] CHD: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T17:54:10.339913] [INFO ] [REMOTE    ] CHCT: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T17:54:10.547738] [INFO ] [REMOTE    ] CHCT: Fetching primary data for 2025-08.
[2025-10-24T17:54:11.350369] [INFO ] [REMOTE    ] CHE: Fetching primary data for 2025-04.
[2025-10-24T17:54:11.374631] [INFO ] [REMOTE    ] CHGG: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T17:54:11.596576] [INFO ] [REMOTE    ] CHCT: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T17:54:12.147684] [INFO ] [REMOTE    ] CHCT: Fetching primary data for 2025-09.
[2025-10-24T17:54:12.557086] [INFO ] [REMOTE    ] CHE: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T17:54:12.947674] [INFO ] [REMOTE    ] CHE: Fetching primary data for 2025-05.
[2025-10-24T17:54:13.206230] [INFO ] [REMOTE    ] CHCT: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T17:54:13.747692] [INFO ] [REMOTE    ] CHCT: Fetching primary data for 2025-10.
[2025-10-24T17:54:13.836456] [INFO ] [REMOTE    ] CHE: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T17:54:14.547682] [INFO ] [REMOTE    ] CHE: Fetching primary data for 2025-06.
[2025-10-24T17:54:14.849380] [INFO ] [REMOTE    ] CHCT: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T17:54:14.853930] [INFO ] [REMOTE    ] CHCT: Full fetch complete (34695 records).
[2025-10-24T17:54:14.854004] [DEBUG] [VALIDATOR ] CHCT: Validating primary data.
[2025-10-24T17:54:15.218990] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present.
[2025-10-24T17:54:15.219060] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed.
[2025-10-24T17:54:15.219513] [INFO ] [MAIN      ] CHCT: Fetched primary data is valid.
[2025-10-24T17:54:15.219554] [DEBUG] [LOCAL     ] CHCT: Saving primary data.
[2025-10-24T17:54:15.219886] [FATAL] [LOCAL     ] CHCT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:54:15.219970] [FATAL] [MAIN      ] CHCT: Failed to save primary data.
[2025-10-24T17:54:15.220011] [WARN ] [MAIN      ] CHCT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:54:15.220045] [INFO ] [LOCAL     ] CHCT: Starting deletion of primary data.
[2025-10-24T17:54:15.220117] [DEBUG] [LOCAL     ] CHCT: No primary data file found to delete.
[2025-10-24T17:54:15.220173] [INFO ] [LOCAL     ] CHCT: Starting deletion of derivative data.
[2025-10-24T17:54:15.220340] [DEBUG] [LOCAL     ] CHCT: Deleted derivative data file.
[2025-10-24T17:54:15.220432] [INFO ] [MAIN      ] Update Progress: 435/2366 symbols completed. CHCT took 27.4s. Estimated remaining: 4h 0m 37s. Rate: 8.0 symbols/min
[2025-10-24T17:54:15.352795] [INFO ] [REMOTE    ] CHD: Fetching primary data for 2025-05.
[2025-10-24T17:54:15.397488] [INFO ] [MAIN      ] CHH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:54:15.409621] [INFO ] [REMOTE    ] CHE: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T17:54:15.442270] [DEBUG] [LOCAL     ] CHH: Loaded 32509 existing records from primary storage.
[2025-10-24T17:54:15.442523] [INFO ] [MAIN      ] CHH: Loaded 32509 existing records.
[2025-10-24T17:54:15.615959] [WARN ] [MAIN      ] CHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:54:15.616126] [INFO ] [MAIN      ] CHH: Wiping existing primary data before full refresh.
[2025-10-24T17:54:15.616173] [INFO ] [LOCAL     ] CHH: Starting deletion of primary data.
[2025-10-24T17:54:15.616880] [DEBUG] [LOCAL     ] CHH: Deleted primary data file.
[2025-10-24T17:54:15.616939] [INFO ] [MAIN      ] CHH: Starting full primary refresh.
[2025-10-24T17:54:15.963545] [INFO ] [REMOTE    ] CHH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:54:16.147668] [INFO ] [REMOTE    ] CHH: Fetching primary data for 2025-01.
[2025-10-24T17:54:16.947609] [INFO ] [REMOTE    ] CHGG: Fetching primary data for 2025-02.
[2025-10-24T17:54:17.227327] [INFO ] [REMOTE    ] CHD: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T17:54:17.483379] [INFO ] [REMOTE    ] CHH: Incremental fetch complete for 2025-01 (1.34 seconds).
[2025-10-24T17:54:17.747615] [INFO ] [REMOTE    ] CHH: Fetching primary data for 2025-02.
[2025-10-24T17:54:18.547624] [INFO ] [REMOTE    ] CHE: Fetching primary data for 2025-07.
[2025-10-24T17:54:18.595209] [INFO ] [REMOTE    ] CHGG: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T17:54:18.702846] [INFO ] [REMOTE    ] CHH: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T17:54:19.347674] [INFO ] [REMOTE    ] CHH: Fetching primary data for 2025-03.
[2025-10-24T17:54:19.559138] [INFO ] [REMOTE    ] CHE: Incremental fetch complete for 2025-07 (1.01 seconds).
[2025-10-24T17:54:20.147634] [INFO ] [REMOTE    ] CHGG: Fetching primary data for 2025-03.
[2025-10-24T17:54:20.405470] [INFO ] [REMOTE    ] CHH: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T17:54:20.947700] [INFO ] [REMOTE    ] CHE: Fetching primary data for 2025-08.
[2025-10-24T17:54:21.691096] [INFO ] [REMOTE    ] CHGG: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T17:54:21.747606] [INFO ] [REMOTE    ] CHGG: Fetching primary data for 2025-04.
[2025-10-24T17:54:21.985856] [INFO ] [REMOTE    ] CHE: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T17:54:22.547679] [INFO ] [REMOTE    ] CHH: Fetching primary data for 2025-04.
[2025-10-24T17:54:23.098341] [INFO ] [REMOTE    ] CHGG: Incremental fetch complete for 2025-04 (1.35 seconds).
[2025-10-24T17:54:23.347733] [INFO ] [REMOTE    ] CHD: Fetching primary data for 2025-06.
[2025-10-24T17:54:23.853739] [INFO ] [REMOTE    ] CHH: Incremental fetch complete for 2025-04 (1.31 seconds).
[2025-10-24T17:54:24.147718] [INFO ] [REMOTE    ] CHH: Fetching primary data for 2025-05.
[2025-10-24T17:54:24.924373] [INFO ] [REMOTE    ] CHD: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T17:54:24.947603] [INFO ] [REMOTE    ] CHD: Fetching primary data for 2025-07.
[2025-10-24T17:54:25.398161] [INFO ] [REMOTE    ] CHH: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T17:54:25.747716] [INFO ] [REMOTE    ] CHE: Fetching primary data for 2025-09.
[2025-10-24T17:54:26.547609] [INFO ] [REMOTE    ] CHH: Fetching primary data for 2025-06.
[2025-10-24T17:54:26.801999] [INFO ] [REMOTE    ] CHD: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T17:54:26.825753] [INFO ] [REMOTE    ] CHE: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T17:54:27.347698] [INFO ] [REMOTE    ] CHD: Fetching primary data for 2025-08.
[2025-10-24T17:54:27.891035] [INFO ] [REMOTE    ] CHH: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T17:54:28.147702] [INFO ] [REMOTE    ] CHGG: Fetching primary data for 2025-05.
[2025-10-24T17:54:28.947666] [INFO ] [REMOTE    ] CHE: Fetching primary data for 2025-10.
[2025-10-24T17:54:29.003582] [INFO ] [REMOTE    ] CHD: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T17:54:29.728906] [INFO ] [REMOTE    ] CHGG: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T17:54:29.747604] [INFO ] [REMOTE    ] CHGG: Fetching primary data for 2025-06.
[2025-10-24T17:54:29.777048] [INFO ] [REMOTE    ] CHE: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T17:54:29.780523] [INFO ] [REMOTE    ] CHE: Full fetch complete (20612 records).
[2025-10-24T17:54:29.780595] [DEBUG] [VALIDATOR ] CHE: Validating primary data.
[2025-10-24T17:54:30.144459] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present.
[2025-10-24T17:54:30.144537] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed.
[2025-10-24T17:54:30.144988] [INFO ] [MAIN      ] CHE: Fetched primary data is valid.
[2025-10-24T17:54:30.145051] [DEBUG] [LOCAL     ] CHE: Saving primary data.
[2025-10-24T17:54:30.145308] [FATAL] [LOCAL     ] CHE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:54:30.145392] [FATAL] [MAIN      ] CHE: Failed to save primary data.
[2025-10-24T17:54:30.145434] [WARN ] [MAIN      ] CHE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:54:30.145496] [INFO ] [LOCAL     ] CHE: Starting deletion of primary data.
[2025-10-24T17:54:30.145555] [DEBUG] [LOCAL     ] CHE: No primary data file found to delete.
[2025-10-24T17:54:30.145594] [INFO ] [LOCAL     ] CHE: Starting deletion of derivative data.
[2025-10-24T17:54:30.145769] [DEBUG] [LOCAL     ] CHE: Deleted derivative data file.
[2025-10-24T17:54:30.145856] [INFO ] [MAIN      ] Update Progress: 436/2366 symbols completed. CHE took 30.9s. Estimated remaining: 4h 1m 3s. Rate: 8.0 symbols/min
[2025-10-24T17:54:30.317860] [INFO ] [MAIN      ] CHMI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:54:30.337010] [DEBUG] [LOCAL     ] CHMI: Loaded 21277 existing records from primary storage.
[2025-10-24T17:54:30.337284] [INFO ] [MAIN      ] CHMI: Loaded 21277 existing records.
[2025-10-24T17:54:30.516697] [WARN ] [MAIN      ] CHMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:54:30.516896] [INFO ] [MAIN      ] CHMI: Wiping existing primary data before full refresh.
[2025-10-24T17:54:30.516941] [INFO ] [LOCAL     ] CHMI: Starting deletion of primary data.
[2025-10-24T17:54:30.517155] [DEBUG] [LOCAL     ] CHMI: Deleted primary data file.
[2025-10-24T17:54:30.517232] [INFO ] [MAIN      ] CHMI: Starting full primary refresh.
[2025-10-24T17:54:30.552801] [INFO ] [REMOTE    ] CHH: Fetching primary data for 2025-07.
[2025-10-24T17:54:30.873209] [INFO ] [REMOTE    ] CHMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:54:31.347614] [INFO ] [REMOTE    ] CHMI: Fetching primary data for 2025-01.
[2025-10-24T17:54:31.549786] [INFO ] [REMOTE    ] CHGG: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T17:54:31.882853] [INFO ] [REMOTE    ] CHH: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T17:54:32.147636] [INFO ] [REMOTE    ] CHH: Fetching primary data for 2025-08.
[2025-10-24T17:54:32.249119] [INFO ] [REMOTE    ] CHMI: Incremental fetch complete for 2025-01 (0.90 seconds).
[2025-10-24T17:54:32.947622] [INFO ] [REMOTE    ] CHGG: Fetching primary data for 2025-07.
[2025-10-24T17:54:33.185214] [INFO ] [REMOTE    ] CHH: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T17:54:33.747723] [INFO ] [REMOTE    ] CHH: Fetching primary data for 2025-09.
[2025-10-24T17:54:34.547722] [INFO ] [REMOTE    ] CHD: Fetching primary data for 2025-09.
[2025-10-24T17:54:34.723880] [INFO ] [REMOTE    ] CHGG: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T17:54:35.098572] [INFO ] [REMOTE    ] CHH: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T17:54:35.347666] [INFO ] [REMOTE    ] CHH: Fetching primary data for 2025-10.
[2025-10-24T17:54:35.896488] [INFO ] [REMOTE    ] CHD: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T17:54:36.147668] [INFO ] [REMOTE    ] CHMI: Fetching primary data for 2025-02.
[2025-10-24T17:54:36.909541] [INFO ] [REMOTE    ] CHH: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T17:54:36.916512] [INFO ] [REMOTE    ] CHH: Full fetch complete (47357 records).
[2025-10-24T17:54:36.916629] [DEBUG] [VALIDATOR ] CHH: Validating primary data.
[2025-10-24T17:54:36.922842] [FATAL] [VALIDATOR ] CHH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:54:36.927166] [FATAL] [MAIN      ] CHH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:54:36.927446] [WARN ] [MAIN      ] CHH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:54:36.928342] [INFO ] [REMOTE    ] CHMI: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T17:54:36.927988] [INFO ] [LOCAL     ] CHH: Starting deletion of primary data.
[2025-10-24T17:54:36.932208] [DEBUG] [LOCAL     ] CHH: No primary data file found to delete.
[2025-10-24T17:54:36.932889] [INFO ] [LOCAL     ] CHH: Starting deletion of derivative data.
[2025-10-24T17:54:36.933054] [DEBUG] [LOCAL     ] CHH: Deleted derivative data file.
[2025-10-24T17:54:36.933137] [INFO ] [MAIN      ] Update Progress: 437/2366 symbols completed. CHH took 21.7s. Estimated remaining: 4h 0m 52s. Rate: 8.0 symbols/min
[2025-10-24T17:54:36.947588] [INFO ] [REMOTE    ] CHMI: Fetching primary data for 2025-03.
[2025-10-24T17:54:37.747619] [INFO ] [REMOTE    ] CHGG: Fetching primary data for 2025-08.
[2025-10-24T17:54:37.991703] [INFO ] [REMOTE    ] CHMI: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T17:54:38.547678] [INFO ] [REMOTE    ] CHMI: Fetching primary data for 2025-04.
[2025-10-24T17:54:39.347713] [INFO ] [REMOTE    ] CHD: Fetching primary data for 2025-10.
[2025-10-24T17:54:39.690102] [INFO ] [REMOTE    ] CHGG: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T17:54:40.147720] [INFO ] [REMOTE    ] CHGG: Fetching primary data for 2025-09.
[2025-10-24T17:54:40.196719] [INFO ] [REMOTE    ] CHMI: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T17:54:40.947761] [INFO ] [REMOTE    ] CHMI: Fetching primary data for 2025-05.
[2025-10-24T17:54:41.369343] [INFO ] [REMOTE    ] CHD: Incremental fetch complete for 2025-10 (2.02 seconds).
[2025-10-24T17:54:41.379192] [INFO ] [REMOTE    ] CHD: Full fetch complete (75000 records).
[2025-10-24T17:54:41.379312] [DEBUG] [VALIDATOR ] CHD: Validating primary data.
[2025-10-24T17:54:41.815284] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present.
[2025-10-24T17:54:41.815469] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed.
[2025-10-24T17:54:41.816494] [INFO ] [MAIN      ] CHD: Fetched primary data is valid.
[2025-10-24T17:54:41.816630] [DEBUG] [LOCAL     ] CHD: Saving primary data.
[2025-10-24T17:54:41.817374] [FATAL] [LOCAL     ] CHD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:54:41.820358] [INFO ] [REMOTE    ] CHGG: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T17:54:41.817579] [FATAL] [MAIN      ] CHD: Failed to save primary data.
[2025-10-24T17:54:41.830085] [WARN ] [MAIN      ] CHD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:54:41.830924] [INFO ] [LOCAL     ] CHD: Starting deletion of primary data.
[2025-10-24T17:54:41.831408] [DEBUG] [LOCAL     ] CHD: No primary data file found to delete.
[2025-10-24T17:54:41.831539] [INFO ] [LOCAL     ] CHD: Starting deletion of derivative data.
[2025-10-24T17:54:41.831995] [DEBUG] [LOCAL     ] CHD: Deleted derivative data file.
[2025-10-24T17:54:41.832471] [INFO ] [MAIN      ] Update Progress: 438/2366 symbols completed. CHD took 47.0s. Estimated remaining: 4h 0m 33s. Rate: 8.0 symbols/min
[2025-10-24T17:54:41.833040] [INFO ] [REMOTE    ] CHGG: Fetching primary data for 2025-10.
[2025-10-24T17:54:41.848328] [INFO ] [REMOTE    ] CHMI: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T17:54:42.547744] [INFO ] [REMOTE    ] CHMI: Fetching primary data for 2025-06.
[2025-10-24T17:54:43.628100] [INFO ] [REMOTE    ] CHGG: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T17:54:43.636455] [INFO ] [REMOTE    ] CHGG: Full fetch complete (69799 records).
[2025-10-24T17:54:43.636574] [DEBUG] [VALIDATOR ] CHGG: Validating primary data.
[2025-10-24T17:54:43.977109] [INFO ] [REMOTE    ] CHMI: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T17:54:44.028900] [INFO ] [REMOTE    ] CHMI: Fetching primary data for 2025-07.
[2025-10-24T17:54:44.051453] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present.
[2025-10-24T17:54:44.051684] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed.
[2025-10-24T17:54:44.052623] [INFO ] [MAIN      ] CHGG: Fetched primary data is valid.
[2025-10-24T17:54:44.052710] [DEBUG] [LOCAL     ] CHGG: Saving primary data.
[2025-10-24T17:54:44.053324] [FATAL] [LOCAL     ] CHGG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:54:44.053557] [FATAL] [MAIN      ] CHGG: Failed to save primary data.
[2025-10-24T17:54:44.053624] [WARN ] [MAIN      ] CHGG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:54:44.053712] [INFO ] [LOCAL     ] CHGG: Starting deletion of primary data.
[2025-10-24T17:54:44.053789] [DEBUG] [LOCAL     ] CHGG: No primary data file found to delete.
[2025-10-24T17:54:44.053827] [INFO ] [LOCAL     ] CHGG: Starting deletion of derivative data.
[2025-10-24T17:54:44.053970] [DEBUG] [LOCAL     ] CHGG: Deleted derivative data file.
[2025-10-24T17:54:44.054465] [INFO ] [MAIN      ] Update Progress: 439/2366 symbols completed. CHGG took 38.7s. Estimated remaining: 4h 0m 3s. Rate: 8.0 symbols/min
[2025-10-24T17:54:45.076242] [INFO ] [REMOTE    ] CHMI: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T17:54:45.081090] [INFO ] [REMOTE    ] CHMI: Fetching primary data for 2025-08.
[2025-10-24T17:54:46.203461] [INFO ] [REMOTE    ] CHMI: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T17:54:46.212631] [INFO ] [REMOTE    ] CHMI: Fetching primary data for 2025-09.
[2025-10-24T17:54:47.107929] [INFO ] [REMOTE    ] CHMI: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T17:54:47.113164] [INFO ] [REMOTE    ] CHMI: Fetching primary data for 2025-10.
[2025-10-24T17:54:48.237698] [INFO ] [REMOTE    ] CHMI: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T17:54:48.241679] [INFO ] [REMOTE    ] CHMI: Full fetch complete (31230 records).
[2025-10-24T17:54:48.241765] [DEBUG] [VALIDATOR ] CHMI: Validating primary data.
[2025-10-24T17:54:48.646297] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present.
[2025-10-24T17:54:48.646389] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed.
[2025-10-24T17:54:48.646942] [INFO ] [MAIN      ] CHMI: Fetched primary data is valid.
[2025-10-24T17:54:48.647006] [DEBUG] [LOCAL     ] CHMI: Saving primary data.
[2025-10-24T17:54:48.647370] [FATAL] [LOCAL     ] CHMI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:54:48.647456] [FATAL] [MAIN      ] CHMI: Failed to save primary data.
[2025-10-24T17:54:48.647500] [WARN ] [MAIN      ] CHMI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:54:48.647539] [INFO ] [LOCAL     ] CHMI: Starting deletion of primary data.
[2025-10-24T17:54:48.647593] [DEBUG] [LOCAL     ] CHMI: No primary data file found to delete.
[2025-10-24T17:54:48.647662] [INFO ] [LOCAL     ] CHMI: Starting deletion of derivative data.
[2025-10-24T17:54:48.647827] [DEBUG] [LOCAL     ] CHMI: Deleted derivative data file.
[2025-10-24T17:54:48.647906] [INFO ] [MAIN      ] Update Progress: 440/2366 symbols completed. CHMI took 18.5s. Estimated remaining: 3h 59m 43s. Rate: 8.0 symbols/min
[2025-10-24T17:54:49.236915] [INFO ] [MAIN      ] CHPT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:54:49.266448] [INFO ] [MAIN      ] CHT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:54:49.300868] [INFO ] [MAIN      ] CHWY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:54:49.306622] [DEBUG] [LOCAL     ] CHWY: No existing data file found in primary storage.
[2025-10-24T17:54:49.331104] [WARN ] [MAIN      ] CHWY: No existing data found, performing full refresh instead.
[2025-10-24T17:54:49.354744] [INFO ] [MAIN      ] CHWY: Wiping existing primary data before full refresh.
[2025-10-24T17:54:49.357575] [INFO ] [MAIN      ] CHN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:54:49.357922] [INFO ] [LOCAL     ] CHWY: Starting deletion of primary data.
[2025-10-24T17:54:49.364002] [DEBUG] [LOCAL     ] CHWY: No primary data file found to delete.
[2025-10-24T17:54:49.364148] [INFO ] [MAIN      ] CHWY: Starting full primary refresh.
[2025-10-24T17:54:49.449186] [DEBUG] [LOCAL     ] CHN: Loaded 5027 existing records from primary storage.
[2025-10-24T17:54:49.491692] [INFO ] [MAIN      ] CHN: Loaded 5027 existing records.
[2025-10-24T17:54:49.472916] [DEBUG] [LOCAL     ] CHT: Loaded 19339 existing records from primary storage.
[2025-10-24T17:54:49.528251] [INFO ] [MAIN      ] CHT: Loaded 19339 existing records.
[2025-10-24T17:54:49.895056] [DEBUG] [LOCAL     ] CHPT: Loaded 47199 existing records from primary storage.
[2025-10-24T17:54:49.920616] [INFO ] [MAIN      ] CHPT: Loaded 47199 existing records.
[2025-10-24T17:54:50.119370] [WARN ] [MAIN      ] CHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:54:50.148968] [WARN ] [MAIN      ] CHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:54:50.206720] [INFO ] [MAIN      ] CHN: Wiping existing primary data before full refresh.
[2025-10-24T17:54:50.206921] [INFO ] [MAIN      ] CHT: Wiping existing primary data before full refresh.
[2025-10-24T17:54:50.225171] [INFO ] [LOCAL     ] CHT: Starting deletion of primary data.
[2025-10-24T17:54:50.235929] [INFO ] [REMOTE    ] CHWY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:54:50.241554] [INFO ] [REMOTE    ] CHWY: Fetching primary data for 2025-01.
[2025-10-24T17:54:50.241212] [INFO ] [LOCAL     ] CHN: Starting deletion of primary data.
[2025-10-24T17:54:50.242190] [DEBUG] [LOCAL     ] CHT: Deleted primary data file.
[2025-10-24T17:54:50.242266] [DEBUG] [LOCAL     ] CHN: Deleted primary data file.
[2025-10-24T17:54:50.247607] [INFO ] [MAIN      ] CHN: Starting full primary refresh.
[2025-10-24T17:54:50.242326] [INFO ] [MAIN      ] CHT: Starting full primary refresh.
[2025-10-24T17:54:50.563194] [WARN ] [MAIN      ] CHPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:54:50.607781] [INFO ] [MAIN      ] CHPT: Wiping existing primary data before full refresh.
[2025-10-24T17:54:50.618173] [INFO ] [LOCAL     ] CHPT: Starting deletion of primary data.
[2025-10-24T17:54:50.713726] [DEBUG] [LOCAL     ] CHPT: Deleted primary data file.
[2025-10-24T17:54:50.746681] [INFO ] [MAIN      ] CHPT: Starting full primary refresh.
[2025-10-24T17:54:51.126592] [INFO ] [REMOTE    ] CHN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:54:51.202032] [INFO ] [REMOTE    ] CHN: Fetching primary data for 2025-01.
[2025-10-24T17:54:51.313597] [INFO ] [REMOTE    ] CHT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:54:51.341610] [INFO ] [REMOTE    ] CHT: Fetching primary data for 2025-01.
[2025-10-24T17:54:51.428931] [INFO ] [REMOTE    ] CHPT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:54:51.429258] [INFO ] [REMOTE    ] CHPT: Fetching primary data for 2025-01.
[2025-10-24T17:54:51.984317] [INFO ] [REMOTE    ] CHN: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T17:54:51.986281] [INFO ] [REMOTE    ] CHN: Fetching primary data for 2025-02.
[2025-10-24T17:54:52.374352] [INFO ] [REMOTE    ] CHWY: Incremental fetch complete for 2025-01 (2.13 seconds).
[2025-10-24T17:54:52.385063] [INFO ] [REMOTE    ] CHWY: Fetching primary data for 2025-02.
[2025-10-24T17:54:52.395734] [INFO ] [REMOTE    ] CHT: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T17:54:52.399540] [INFO ] [REMOTE    ] CHT: Fetching primary data for 2025-02.
[2025-10-24T17:54:52.620778] [INFO ] [REMOTE    ] CHN: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T17:54:52.622615] [INFO ] [REMOTE    ] CHN: Fetching primary data for 2025-03.
[2025-10-24T17:54:53.357122] [INFO ] [REMOTE    ] CHT: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T17:54:53.361561] [INFO ] [REMOTE    ] CHT: Fetching primary data for 2025-03.
[2025-10-24T17:54:53.366503] [INFO ] [REMOTE    ] CHN: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T17:54:53.456538] [INFO ] [REMOTE    ] CHPT: Incremental fetch complete for 2025-01 (2.03 seconds).
[2025-10-24T17:54:53.747592] [INFO ] [REMOTE    ] CHPT: Fetching primary data for 2025-02.
[2025-10-24T17:54:54.228205] [INFO ] [REMOTE    ] CHT: Incremental fetch complete for 2025-03 (0.87 seconds).
[2025-10-24T17:54:54.266837] [INFO ] [REMOTE    ] CHWY: Incremental fetch complete for 2025-02 (1.88 seconds).
[2025-10-24T17:54:54.547698] [INFO ] [REMOTE    ] CHWY: Fetching primary data for 2025-03.
[2025-10-24T17:54:55.347683] [INFO ] [REMOTE    ] CHT: Fetching primary data for 2025-04.
[2025-10-24T17:54:55.677875] [INFO ] [REMOTE    ] CHPT: Incremental fetch complete for 2025-02 (1.93 seconds).
[2025-10-24T17:54:56.147623] [INFO ] [REMOTE    ] CHN: Fetching primary data for 2025-04.
[2025-10-24T17:54:56.258967] [INFO ] [REMOTE    ] CHT: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T17:54:56.385152] [INFO ] [REMOTE    ] CHWY: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T17:54:56.759699] [INFO ] [REMOTE    ] CHN: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T17:54:56.947669] [INFO ] [REMOTE    ] CHWY: Fetching primary data for 2025-04.
[2025-10-24T17:54:57.747719] [INFO ] [REMOTE    ] CHPT: Fetching primary data for 2025-03.
[2025-10-24T17:54:58.556312] [INFO ] [REMOTE    ] CHT: Fetching primary data for 2025-05.
[2025-10-24T17:54:58.566809] [INFO ] [REMOTE    ] CHWY: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T17:54:59.347627] [INFO ] [REMOTE    ] CHWY: Fetching primary data for 2025-05.
[2025-10-24T17:54:59.562433] [INFO ] [REMOTE    ] CHPT: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T17:54:59.668725] [INFO ] [REMOTE    ] CHT: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T17:55:00.147671] [INFO ] [REMOTE    ] CHPT: Fetching primary data for 2025-04.
[2025-10-24T17:55:00.947707] [INFO ] [REMOTE    ] CHN: Fetching primary data for 2025-05.
[2025-10-24T17:55:01.060017] [INFO ] [REMOTE    ] CHWY: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T17:55:01.634637] [INFO ] [REMOTE    ] CHN: Incremental fetch complete for 2025-05 (0.69 seconds).
[2025-10-24T17:55:01.747679] [INFO ] [REMOTE    ] CHN: Fetching primary data for 2025-06.
[2025-10-24T17:55:02.446584] [INFO ] [REMOTE    ] CHPT: Incremental fetch complete for 2025-04 (2.30 seconds).
[2025-10-24T17:55:02.547637] [INFO ] [REMOTE    ] CHT: Fetching primary data for 2025-06.
[2025-10-24T17:55:02.918199] [INFO ] [REMOTE    ] CHN: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T17:55:03.347686] [INFO ] [REMOTE    ] CHN: Fetching primary data for 2025-07.
[2025-10-24T17:55:04.073086] [INFO ] [REMOTE    ] CHT: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T17:55:04.108811] [INFO ] [REMOTE    ] CHN: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T17:55:04.147625] [INFO ] [REMOTE    ] CHN: Fetching primary data for 2025-08.
[2025-10-24T17:55:04.794740] [INFO ] [REMOTE    ] CHN: Incremental fetch complete for 2025-08 (0.65 seconds).
[2025-10-24T17:55:04.947679] [INFO ] [REMOTE    ] CHN: Fetching primary data for 2025-09.
[2025-10-24T17:55:05.567111] [INFO ] [REMOTE    ] CHN: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T17:55:05.747713] [INFO ] [REMOTE    ] CHN: Fetching primary data for 2025-10.
[2025-10-24T17:55:06.382998] [INFO ] [REMOTE    ] CHN: Incremental fetch complete for 2025-10 (0.64 seconds).
[2025-10-24T17:55:06.384570] [INFO ] [REMOTE    ] CHN: Full fetch complete (7583 records).
[2025-10-24T17:55:06.384685] [DEBUG] [VALIDATOR ] CHN: Validating primary data.
[2025-10-24T17:55:06.565850] [INFO ] [REMOTE    ] CHT: Fetching primary data for 2025-07.
[2025-10-24T17:55:06.754318] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present.
[2025-10-24T17:55:06.754403] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed.
[2025-10-24T17:55:06.754614] [INFO ] [MAIN      ] CHN: Fetched primary data is valid.
[2025-10-24T17:55:06.754680] [DEBUG] [LOCAL     ] CHN: Saving primary data.
[2025-10-24T17:55:06.754896] [FATAL] [LOCAL     ] CHN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:55:06.754997] [FATAL] [MAIN      ] CHN: Failed to save primary data.
[2025-10-24T17:55:06.755041] [WARN ] [MAIN      ] CHN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:55:06.755077] [INFO ] [LOCAL     ] CHN: Starting deletion of primary data.
[2025-10-24T17:55:06.755127] [DEBUG] [LOCAL     ] CHN: No primary data file found to delete.
[2025-10-24T17:55:06.755162] [INFO ] [LOCAL     ] CHN: Starting deletion of derivative data.
[2025-10-24T17:55:06.755290] [DEBUG] [LOCAL     ] CHN: Deleted derivative data file.
[2025-10-24T17:55:06.755359] [INFO ] [MAIN      ] Update Progress: 441/2366 symbols completed. CHN took 18.1s. Estimated remaining: 4h 0m 22s. Rate: 8.0 symbols/min
[2025-10-24T17:55:06.921334] [INFO ] [MAIN      ] CI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:55:06.966365] [DEBUG] [LOCAL     ] CI: Loaded 49907 existing records from primary storage.
[2025-10-24T17:55:06.966682] [INFO ] [MAIN      ] CI: Loaded 49907 existing records.
[2025-10-24T17:55:07.142841] [WARN ] [MAIN      ] CI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:55:07.143043] [INFO ] [MAIN      ] CI: Wiping existing primary data before full refresh.
[2025-10-24T17:55:07.143090] [INFO ] [LOCAL     ] CI: Starting deletion of primary data.
[2025-10-24T17:55:07.144086] [DEBUG] [LOCAL     ] CI: Deleted primary data file.
[2025-10-24T17:55:07.144143] [INFO ] [MAIN      ] CI: Starting full primary refresh.
[2025-10-24T17:55:07.357813] [INFO ] [REMOTE    ] CHPT: Fetching primary data for 2025-05.
[2025-10-24T17:55:07.561487] [INFO ] [REMOTE    ] CI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:55:07.867510] [INFO ] [REMOTE    ] CHT: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T17:55:08.147681] [INFO ] [REMOTE    ] CI: Fetching primary data for 2025-01.
[2025-10-24T17:55:08.947699] [INFO ] [REMOTE    ] CHWY: Fetching primary data for 2025-06.
[2025-10-24T17:55:09.617760] [INFO ] [REMOTE    ] CI: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T17:55:09.656301] [INFO ] [REMOTE    ] CHPT: Incremental fetch complete for 2025-05 (2.30 seconds).
[2025-10-24T17:55:09.747677] [INFO ] [REMOTE    ] CHPT: Fetching primary data for 2025-06.
[2025-10-24T17:55:10.547701] [INFO ] [REMOTE    ] CI: Fetching primary data for 2025-02.
[2025-10-24T17:55:10.674501] [INFO ] [REMOTE    ] CHWY: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T17:55:11.347623] [INFO ] [REMOTE    ] CHWY: Fetching primary data for 2025-07.
[2025-10-24T17:55:11.460710] [INFO ] [REMOTE    ] CHPT: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T17:55:12.147622] [INFO ] [REMOTE    ] CHPT: Fetching primary data for 2025-07.
[2025-10-24T17:55:12.275924] [INFO ] [REMOTE    ] CI: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T17:55:12.947625] [INFO ] [REMOTE    ] CI: Fetching primary data for 2025-03.
[2025-10-24T17:55:13.493794] [INFO ] [REMOTE    ] CHWY: Incremental fetch complete for 2025-07 (2.15 seconds).
[2025-10-24T17:55:13.747685] [INFO ] [REMOTE    ] CHT: Fetching primary data for 2025-08.
[2025-10-24T17:55:14.313166] [INFO ] [REMOTE    ] CHPT: Incremental fetch complete for 2025-07 (2.17 seconds).
[2025-10-24T17:55:14.388967] [INFO ] [REMOTE    ] CI: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T17:55:14.547635] [INFO ] [REMOTE    ] CHPT: Fetching primary data for 2025-08.
[2025-10-24T17:55:14.867775] [INFO ] [REMOTE    ] CHT: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T17:55:15.347673] [INFO ] [REMOTE    ] CHT: Fetching primary data for 2025-09.
[2025-10-24T17:55:16.147748] [INFO ] [REMOTE    ] CI: Fetching primary data for 2025-04.
[2025-10-24T17:55:16.300911] [INFO ] [REMOTE    ] CHPT: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T17:55:16.352929] [INFO ] [REMOTE    ] CHT: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T17:55:16.947715] [INFO ] [REMOTE    ] CHWY: Fetching primary data for 2025-08.
[2025-10-24T17:55:17.747631] [INFO ] [REMOTE    ] CHPT: Fetching primary data for 2025-09.
[2025-10-24T17:55:17.887541] [INFO ] [REMOTE    ] CI: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T17:55:18.466134] [INFO ] [REMOTE    ] CHWY: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T17:55:18.547616] [INFO ] [REMOTE    ] CHWY: Fetching primary data for 2025-09.
[2025-10-24T17:55:19.087954] [INFO ] [REMOTE    ] CHPT: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T17:55:19.347723] [INFO ] [REMOTE    ] CHT: Fetching primary data for 2025-10.
[2025-10-24T17:55:20.147693] [INFO ] [REMOTE    ] CI: Fetching primary data for 2025-05.
[2025-10-24T17:55:20.254341] [INFO ] [REMOTE    ] CHWY: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T17:55:20.463733] [INFO ] [REMOTE    ] CHT: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T17:55:20.467409] [INFO ] [REMOTE    ] CHT: Full fetch complete (27615 records).
[2025-10-24T17:55:20.467486] [DEBUG] [VALIDATOR ] CHT: Validating primary data.
[2025-10-24T17:55:20.823861] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present.
[2025-10-24T17:55:20.823936] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed.
[2025-10-24T17:55:20.824356] [INFO ] [MAIN      ] CHT: Fetched primary data is valid.
[2025-10-24T17:55:20.824396] [DEBUG] [LOCAL     ] CHT: Saving primary data.
[2025-10-24T17:55:20.824713] [FATAL] [LOCAL     ] CHT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:55:20.824816] [FATAL] [MAIN      ] CHT: Failed to save primary data.
[2025-10-24T17:55:20.824891] [WARN ] [MAIN      ] CHT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:55:20.824980] [INFO ] [LOCAL     ] CHT: Starting deletion of primary data.
[2025-10-24T17:55:20.825057] [DEBUG] [LOCAL     ] CHT: No primary data file found to delete.
[2025-10-24T17:55:20.825095] [INFO ] [LOCAL     ] CHT: Starting deletion of derivative data.
[2025-10-24T17:55:20.825223] [DEBUG] [LOCAL     ] CHT: Deleted derivative data file.
[2025-10-24T17:55:20.825294] [INFO ] [MAIN      ] Update Progress: 442/2366 symbols completed. CHT took 32.2s. Estimated remaining: 4h 0m 43s. Rate: 8.0 symbols/min
[2025-10-24T17:55:20.961123] [INFO ] [REMOTE    ] CHWY: Fetching primary data for 2025-10.
[2025-10-24T17:55:20.991950] [INFO ] [MAIN      ] CIA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:55:21.008239] [DEBUG] [LOCAL     ] CIA: Loaded 16554 existing records from primary storage.
[2025-10-24T17:55:21.008474] [INFO ] [MAIN      ] CIA: Loaded 16554 existing records.
[2025-10-24T17:55:21.180500] [WARN ] [MAIN      ] CIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:55:21.180714] [INFO ] [MAIN      ] CIA: Wiping existing primary data before full refresh.
[2025-10-24T17:55:21.180767] [INFO ] [LOCAL     ] CIA: Starting deletion of primary data.
[2025-10-24T17:55:21.181141] [DEBUG] [LOCAL     ] CIA: Deleted primary data file.
[2025-10-24T17:55:21.181198] [INFO ] [MAIN      ] CIA: Starting full primary refresh.
[2025-10-24T17:55:21.531453] [INFO ] [REMOTE    ] CIA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:55:21.747635] [INFO ] [REMOTE    ] CIA: Fetching primary data for 2025-01.
[2025-10-24T17:55:21.837563] [INFO ] [REMOTE    ] CI: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T17:55:22.547727] [INFO ] [REMOTE    ] CHPT: Fetching primary data for 2025-10.
[2025-10-24T17:55:22.810365] [INFO ] [REMOTE    ] CIA: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T17:55:23.241054] [INFO ] [REMOTE    ] CHWY: Incremental fetch complete for 2025-10 (2.28 seconds).
[2025-10-24T17:55:23.250897] [INFO ] [REMOTE    ] CHWY: Full fetch complete (77779 records).
[2025-10-24T17:55:23.251016] [DEBUG] [VALIDATOR ] CHWY: Validating primary data.
[2025-10-24T17:55:23.351895] [INFO ] [REMOTE    ] CI: Fetching primary data for 2025-06.
[2025-10-24T17:55:23.636768] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present.
[2025-10-24T17:55:23.636848] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed.
[2025-10-24T17:55:23.637699] [INFO ] [MAIN      ] CHWY: Fetched primary data is valid.
[2025-10-24T17:55:23.637761] [DEBUG] [LOCAL     ] CHWY: Saving primary data.
[2025-10-24T17:55:23.638369] [FATAL] [LOCAL     ] CHWY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:55:23.638471] [FATAL] [MAIN      ] CHWY: Failed to save primary data.
[2025-10-24T17:55:23.638513] [WARN ] [MAIN      ] CHWY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:55:23.638547] [INFO ] [LOCAL     ] CHWY: Starting deletion of primary data.
[2025-10-24T17:55:23.638597] [DEBUG] [LOCAL     ] CHWY: No primary data file found to delete.
[2025-10-24T17:55:23.638636] [INFO ] [LOCAL     ] CHWY: Starting deletion of derivative data.
[2025-10-24T17:55:23.638722] [DEBUG] [LOCAL     ] CHWY: No derivative data file found to delete.
[2025-10-24T17:55:23.638790] [INFO ] [MAIN      ] Update Progress: 443/2366 symbols completed. CHWY took 35.0s. Estimated remaining: 4h 0m 15s. Rate: 8.0 symbols/min
[2025-10-24T17:55:23.804325] [INFO ] [MAIN      ] CIB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:55:23.833197] [DEBUG] [LOCAL     ] CIB: Loaded 30473 existing records from primary storage.
[2025-10-24T17:55:23.833450] [INFO ] [MAIN      ] CIB: Loaded 30473 existing records.
[2025-10-24T17:55:24.016951] [WARN ] [MAIN      ] CIB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:55:24.017287] [INFO ] [MAIN      ] CIB: Wiping existing primary data before full refresh.
[2025-10-24T17:55:24.017420] [INFO ] [LOCAL     ] CIB: Starting deletion of primary data.
[2025-10-24T17:55:24.024299] [DEBUG] [LOCAL     ] CIB: Deleted primary data file.
[2025-10-24T17:55:24.034907] [INFO ] [MAIN      ] CIB: Starting full primary refresh.
[2025-10-24T17:55:24.067414] [INFO ] [REMOTE    ] CHPT: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T17:55:24.143950] [INFO ] [REMOTE    ] CHPT: Full fetch complete (70754 records).
[2025-10-24T17:55:24.154867] [DEBUG] [VALIDATOR ] CHPT: Validating primary data.
[2025-10-24T17:55:24.165224] [INFO ] [REMOTE    ] CIA: Fetching primary data for 2025-02.
[2025-10-24T17:55:24.632933] [INFO ] [REMOTE    ] CIB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:55:24.798718] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present.
[2025-10-24T17:55:24.798857] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed.
[2025-10-24T17:55:24.799585] [INFO ] [MAIN      ] CHPT: Fetched primary data is valid.
[2025-10-24T17:55:24.799732] [DEBUG] [LOCAL     ] CHPT: Saving primary data.
[2025-10-24T17:55:24.800336] [FATAL] [LOCAL     ] CHPT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:55:24.800420] [FATAL] [MAIN      ] CHPT: Failed to save primary data.
[2025-10-24T17:55:24.800463] [WARN ] [MAIN      ] CHPT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:55:24.800525] [INFO ] [LOCAL     ] CHPT: Starting deletion of primary data.
[2025-10-24T17:55:24.800584] [DEBUG] [LOCAL     ] CHPT: No primary data file found to delete.
[2025-10-24T17:55:24.800619] [INFO ] [LOCAL     ] CHPT: Starting deletion of derivative data.
[2025-10-24T17:55:24.800778] [DEBUG] [LOCAL     ] CHPT: Deleted derivative data file.
[2025-10-24T17:55:24.801421] [INFO ] [MAIN      ] Update Progress: 444/2366 symbols completed. CHPT took 36.1s. Estimated remaining: 3h 59m 40s. Rate: 8.0 symbols/min
[2025-10-24T17:55:24.959590] [INFO ] [REMOTE    ] CIB: Fetching primary data for 2025-01.
[2025-10-24T17:55:24.979522] [INFO ] [MAIN      ] CICB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:55:24.980575] [DEBUG] [LOCAL     ] CICB: No existing data file found in primary storage.
[2025-10-24T17:55:24.980683] [WARN ] [MAIN      ] CICB: No existing data found, performing full refresh instead.
[2025-10-24T17:55:24.980879] [INFO ] [MAIN      ] CICB: Wiping existing primary data before full refresh.
[2025-10-24T17:55:24.980983] [INFO ] [LOCAL     ] CICB: Starting deletion of primary data.
[2025-10-24T17:55:24.981096] [DEBUG] [LOCAL     ] CICB: No primary data file found to delete.
[2025-10-24T17:55:24.981266] [INFO ] [MAIN      ] CICB: Starting full primary refresh.
[2025-10-24T17:55:25.093859] [INFO ] [REMOTE    ] CIA: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T17:55:25.171733] [INFO ] [REMOTE    ] CI: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T17:55:25.382137] [INFO ] [REMOTE    ] CICB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:55:25.747627] [INFO ] [REMOTE    ] CIA: Fetching primary data for 2025-03.
[2025-10-24T17:55:26.312290] [INFO ] [REMOTE    ] CIB: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T17:55:26.527510] [INFO ] [REMOTE    ] CIA: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T17:55:26.547604] [INFO ] [REMOTE    ] CI: Fetching primary data for 2025-07.
[2025-10-24T17:55:27.347681] [INFO ] [REMOTE    ] CIA: Fetching primary data for 2025-04.
[2025-10-24T17:55:28.147724] [INFO ] [REMOTE    ] CIB: Fetching primary data for 2025-02.
[2025-10-24T17:55:28.384229] [INFO ] [REMOTE    ] CI: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T17:55:28.424993] [INFO ] [REMOTE    ] CIA: Incremental fetch complete for 2025-04 (1.08 seconds).
[2025-10-24T17:55:28.947639] [INFO ] [REMOTE    ] CIA: Fetching primary data for 2025-05.
[2025-10-24T17:55:29.482038] [INFO ] [REMOTE    ] CIB: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T17:55:29.747722] [INFO ] [REMOTE    ] CI: Fetching primary data for 2025-08.
[2025-10-24T17:55:29.973426] [INFO ] [REMOTE    ] CIA: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T17:55:30.547705] [INFO ] [REMOTE    ] CIB: Fetching primary data for 2025-03.
[2025-10-24T17:55:31.347707] [INFO ] [REMOTE    ] CIA: Fetching primary data for 2025-06.
[2025-10-24T17:55:31.572416] [INFO ] [REMOTE    ] CI: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T17:55:31.917967] [INFO ] [REMOTE    ] CIB: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T17:55:32.147687] [INFO ] [REMOTE    ] CIB: Fetching primary data for 2025-04.
[2025-10-24T17:55:32.409176] [INFO ] [REMOTE    ] CIA: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T17:55:32.947719] [INFO ] [REMOTE    ] CI: Fetching primary data for 2025-09.
[2025-10-24T17:55:33.489061] [INFO ] [REMOTE    ] CIB: Incremental fetch complete for 2025-04 (1.34 seconds).
[2025-10-24T17:55:33.747682] [INFO ] [REMOTE    ] CIB: Fetching primary data for 2025-05.
[2025-10-24T17:55:34.547746] [INFO ] [REMOTE    ] CIA: Fetching primary data for 2025-07.
[2025-10-24T17:55:34.747681] [INFO ] [REMOTE    ] CI: Incremental fetch complete for 2025-09 (1.80 seconds).
[2025-10-24T17:55:35.103293] [INFO ] [REMOTE    ] CIB: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T17:55:35.347704] [INFO ] [REMOTE    ] CIB: Fetching primary data for 2025-06.
[2025-10-24T17:55:35.606682] [INFO ] [REMOTE    ] CIA: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T17:55:36.147678] [INFO ] [REMOTE    ] CIA: Fetching primary data for 2025-08.
[2025-10-24T17:55:36.670840] [INFO ] [REMOTE    ] CIB: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T17:55:36.947627] [INFO ] [REMOTE    ] CICB: Fetching primary data for 2025-01.
[2025-10-24T17:55:37.164937] [INFO ] [REMOTE    ] CIA: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T17:55:37.463207] [INFO ] [REMOTE    ] CICB: Incremental fetch complete for 2025-01 (0.52 seconds).
[2025-10-24T17:55:37.747626] [INFO ] [REMOTE    ] CICB: Fetching primary data for 2025-02.
[2025-10-24T17:55:38.065092] [INFO ] [REMOTE    ] CICB: Incremental fetch complete for 2025-02 (0.32 seconds).
[2025-10-24T17:55:38.547697] [INFO ] [REMOTE    ] CIA: Fetching primary data for 2025-09.
[2025-10-24T17:55:39.347687] [INFO ] [REMOTE    ] CIB: Fetching primary data for 2025-07.
[2025-10-24T17:55:39.449924] [INFO ] [REMOTE    ] CIA: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T17:55:40.147621] [INFO ] [REMOTE    ] CIA: Fetching primary data for 2025-10.
[2025-10-24T17:55:40.466089] [INFO ] [REMOTE    ] CIB: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T17:55:40.947636] [INFO ] [REMOTE    ] CI: Fetching primary data for 2025-10.
[2025-10-24T17:55:41.208794] [INFO ] [REMOTE    ] CIA: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T17:55:41.211841] [INFO ] [REMOTE    ] CIA: Full fetch complete (23153 records).
[2025-10-24T17:55:41.211929] [DEBUG] [VALIDATOR ] CIA: Validating primary data.
[2025-10-24T17:55:41.643300] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present.
[2025-10-24T17:55:41.643394] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed.
[2025-10-24T17:55:41.644070] [INFO ] [MAIN      ] CIA: Fetched primary data is valid.
[2025-10-24T17:55:41.644146] [DEBUG] [LOCAL     ] CIA: Saving primary data.
[2025-10-24T17:55:41.644536] [FATAL] [LOCAL     ] CIA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:55:41.644617] [FATAL] [MAIN      ] CIA: Failed to save primary data.
[2025-10-24T17:55:41.644704] [WARN ] [MAIN      ] CIA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:55:41.644773] [INFO ] [LOCAL     ] CIA: Starting deletion of primary data.
[2025-10-24T17:55:41.644835] [DEBUG] [LOCAL     ] CIA: No primary data file found to delete.
[2025-10-24T17:55:41.644872] [INFO ] [LOCAL     ] CIA: Starting deletion of derivative data.
[2025-10-24T17:55:41.644997] [DEBUG] [LOCAL     ] CIA: Deleted derivative data file.
[2025-10-24T17:55:41.645074] [INFO ] [MAIN      ] Update Progress: 445/2366 symbols completed. CIA took 20.8s. Estimated remaining: 4h 0m 13s. Rate: 8.0 symbols/min
[2025-10-24T17:55:41.752831] [INFO ] [REMOTE    ] CICB: Fetching primary data for 2025-03.
[2025-10-24T17:55:41.844226] [INFO ] [MAIN      ] CIEN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:55:41.895242] [DEBUG] [LOCAL     ] CIEN: Loaded 52498 existing records from primary storage.
[2025-10-24T17:55:41.895559] [INFO ] [MAIN      ] CIEN: Loaded 52498 existing records.
[2025-10-24T17:55:42.074115] [WARN ] [MAIN      ] CIEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:55:42.074324] [INFO ] [MAIN      ] CIEN: Wiping existing primary data before full refresh.
[2025-10-24T17:55:42.074386] [INFO ] [LOCAL     ] CIEN: Starting deletion of primary data.
[2025-10-24T17:55:42.075197] [DEBUG] [LOCAL     ] CIEN: Deleted primary data file.
[2025-10-24T17:55:42.075255] [INFO ] [MAIN      ] CIEN: Starting full primary refresh.
[2025-10-24T17:55:42.180807] [INFO ] [REMOTE    ] CICB: Incremental fetch complete for 2025-03 (0.43 seconds).
[2025-10-24T17:55:42.429973] [INFO ] [REMOTE    ] CIEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:55:42.547638] [INFO ] [REMOTE    ] CICB: Fetching primary data for 2025-04.
[2025-10-24T17:55:42.916833] [INFO ] [REMOTE    ] CICB: Incremental fetch complete for 2025-04 (0.37 seconds).
[2025-10-24T17:55:42.993596] [INFO ] [REMOTE    ] CI: Incremental fetch complete for 2025-10 (2.05 seconds).
[2025-10-24T17:55:43.003983] [INFO ] [REMOTE    ] CI: Full fetch complete (72022 records).
[2025-10-24T17:55:43.004141] [DEBUG] [VALIDATOR ] CI: Validating primary data.
[2025-10-24T17:55:43.352533] [INFO ] [REMOTE    ] CICB: Fetching primary data for 2025-05.
[2025-10-24T17:55:43.396758] [DEBUG] [VALIDATOR ] CI: All expected trading days are present.
[2025-10-24T17:55:43.396832] [DEBUG] [VALIDATOR ] CI: Primary data validation passed.
[2025-10-24T17:55:43.397689] [INFO ] [MAIN      ] CI: Fetched primary data is valid.
[2025-10-24T17:55:43.397750] [DEBUG] [LOCAL     ] CI: Saving primary data.
[2025-10-24T17:55:43.398317] [FATAL] [LOCAL     ] CI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:55:43.398400] [FATAL] [MAIN      ] CI: Failed to save primary data.
[2025-10-24T17:55:43.398467] [WARN ] [MAIN      ] CI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:55:43.398535] [INFO ] [LOCAL     ] CI: Starting deletion of primary data.
[2025-10-24T17:55:43.398593] [DEBUG] [LOCAL     ] CI: No primary data file found to delete.
[2025-10-24T17:55:43.398776] [INFO ] [LOCAL     ] CI: Starting deletion of derivative data.
[2025-10-24T17:55:43.398991] [DEBUG] [LOCAL     ] CI: Deleted derivative data file.
[2025-10-24T17:55:43.399426] [INFO ] [MAIN      ] Update Progress: 446/2366 symbols completed. CI took 36.6s. Estimated remaining: 3h 59m 41s. Rate: 8.0 symbols/min
[2025-10-24T17:55:43.565554] [INFO ] [MAIN      ] CIF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:55:43.572318] [DEBUG] [LOCAL     ] CIF: Loaded 3992 existing records from primary storage.
[2025-10-24T17:55:43.572521] [INFO ] [MAIN      ] CIF: Loaded 3992 existing records.
[2025-10-24T17:55:43.749032] [WARN ] [MAIN      ] CIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:55:43.751731] [INFO ] [REMOTE    ] CICB: Incremental fetch complete for 2025-05 (0.40 seconds).
[2025-10-24T17:55:43.753088] [INFO ] [MAIN      ] CIF: Wiping existing primary data before full refresh.
[2025-10-24T17:55:43.753145] [INFO ] [LOCAL     ] CIF: Starting deletion of primary data.
[2025-10-24T17:55:43.753360] [DEBUG] [LOCAL     ] CIF: Deleted primary data file.
[2025-10-24T17:55:43.753417] [INFO ] [MAIN      ] CIF: Starting full primary refresh.
[2025-10-24T17:55:44.107315] [INFO ] [REMOTE    ] CIF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:55:44.147598] [INFO ] [REMOTE    ] CIF: Fetching primary data for 2025-01.
[2025-10-24T17:55:44.794600] [INFO ] [REMOTE    ] CIF: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T17:55:44.947663] [INFO ] [REMOTE    ] CIF: Fetching primary data for 2025-02.
[2025-10-24T17:55:45.580565] [INFO ] [REMOTE    ] CIF: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T17:55:45.747679] [INFO ] [REMOTE    ] CIF: Fetching primary data for 2025-03.
[2025-10-24T17:55:46.491436] [INFO ] [REMOTE    ] CIF: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T17:55:46.547689] [INFO ] [REMOTE    ] CIEN: Fetching primary data for 2025-01.
[2025-10-24T17:55:47.347683] [INFO ] [REMOTE    ] CIF: Fetching primary data for 2025-04.
[2025-10-24T17:55:48.024777] [INFO ] [REMOTE    ] CIF: Incremental fetch complete for 2025-04 (0.68 seconds).
[2025-10-24T17:55:48.119011] [INFO ] [REMOTE    ] CIEN: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T17:55:48.147602] [INFO ] [REMOTE    ] CIB: Fetching primary data for 2025-08.
[2025-10-24T17:55:48.947674] [INFO ] [REMOTE    ] CIF: Fetching primary data for 2025-05.
[2025-10-24T17:55:49.509686] [INFO ] [REMOTE    ] CIB: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T17:55:49.521242] [INFO ] [REMOTE    ] CIF: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T17:55:49.747684] [INFO ] [REMOTE    ] CIB: Fetching primary data for 2025-09.
[2025-10-24T17:55:50.547684] [INFO ] [REMOTE    ] CIEN: Fetching primary data for 2025-02.
[2025-10-24T17:55:51.052730] [INFO ] [REMOTE    ] CIB: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T17:55:51.347670] [INFO ] [REMOTE    ] CIB: Fetching primary data for 2025-10.
[2025-10-24T17:55:52.124837] [INFO ] [REMOTE    ] CIEN: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T17:55:52.147620] [INFO ] [REMOTE    ] CIEN: Fetching primary data for 2025-03.
[2025-10-24T17:55:52.434895] [INFO ] [REMOTE    ] CIB: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T17:55:52.443409] [INFO ] [REMOTE    ] CIB: Full fetch complete (45482 records).
[2025-10-24T17:55:52.443565] [DEBUG] [VALIDATOR ] CIB: Validating primary data.
[2025-10-24T17:55:52.852459] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present.
[2025-10-24T17:55:52.852549] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed.
[2025-10-24T17:55:52.853239] [INFO ] [MAIN      ] CIB: Fetched primary data is valid.
[2025-10-24T17:55:52.853310] [DEBUG] [LOCAL     ] CIB: Saving primary data.
[2025-10-24T17:55:52.853855] [FATAL] [LOCAL     ] CIB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:55:52.853949] [FATAL] [MAIN      ] CIB: Failed to save primary data.
[2025-10-24T17:55:52.853992] [WARN ] [MAIN      ] CIB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:55:52.854032] [INFO ] [LOCAL     ] CIB: Starting deletion of primary data.
[2025-10-24T17:55:52.854087] [DEBUG] [LOCAL     ] CIB: No primary data file found to delete.
[2025-10-24T17:55:52.854125] [INFO ] [LOCAL     ] CIB: Starting deletion of derivative data.
[2025-10-24T17:55:52.854253] [DEBUG] [LOCAL     ] CIB: Deleted derivative data file.
[2025-10-24T17:55:52.854360] [INFO ] [MAIN      ] Update Progress: 447/2366 symbols completed. CIB took 29.2s. Estimated remaining: 3h 59m 42s. Rate: 8.0 symbols/min
[2025-10-24T17:55:52.956016] [INFO ] [REMOTE    ] CICB: Fetching primary data for 2025-06.
[2025-10-24T17:55:53.042760] [INFO ] [MAIN      ] CIG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:55:53.085893] [DEBUG] [LOCAL     ] CIG: Loaded 44791 existing records from primary storage.
[2025-10-24T17:55:53.086253] [INFO ] [MAIN      ] CIG: Loaded 44791 existing records.
[2025-10-24T17:55:53.263805] [WARN ] [MAIN      ] CIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:55:53.263999] [INFO ] [MAIN      ] CIG: Wiping existing primary data before full refresh.
[2025-10-24T17:55:53.264045] [INFO ] [LOCAL     ] CIG: Starting deletion of primary data.
[2025-10-24T17:55:53.264807] [DEBUG] [LOCAL     ] CIG: Deleted primary data file.
[2025-10-24T17:55:53.264864] [INFO ] [MAIN      ] CIG: Starting full primary refresh.
[2025-10-24T17:55:53.550510] [INFO ] [REMOTE    ] CICB: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T17:55:53.635191] [INFO ] [REMOTE    ] CIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:55:53.694822] [INFO ] [REMOTE    ] CIEN: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T17:55:53.747613] [INFO ] [REMOTE    ] CIG: Fetching primary data for 2025-01.
[2025-10-24T17:55:54.547637] [INFO ] [REMOTE    ] CICB: Fetching primary data for 2025-07.
[2025-10-24T17:55:55.223299] [INFO ] [REMOTE    ] CIG: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T17:55:55.225505] [INFO ] [REMOTE    ] CICB: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T17:55:55.347759] [INFO ] [REMOTE    ] CICB: Fetching primary data for 2025-08.
[2025-10-24T17:55:55.674321] [INFO ] [REMOTE    ] CICB: Incremental fetch complete for 2025-08 (0.33 seconds).
[2025-10-24T17:55:56.147683] [INFO ] [REMOTE    ] CICB: Fetching primary data for 2025-09.
[2025-10-24T17:55:56.447173] [INFO ] [REMOTE    ] CICB: Incremental fetch complete for 2025-09 (0.30 seconds).
[2025-10-24T17:55:56.947707] [INFO ] [REMOTE    ] CIG: Fetching primary data for 2025-02.
[2025-10-24T17:55:57.747702] [INFO ] [REMOTE    ] CIF: Fetching primary data for 2025-06.
[2025-10-24T17:55:58.315603] [INFO ] [REMOTE    ] CIF: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T17:55:58.339206] [INFO ] [REMOTE    ] CIG: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T17:55:58.547637] [INFO ] [REMOTE    ] CIG: Fetching primary data for 2025-03.
[2025-10-24T17:55:59.347728] [INFO ] [REMOTE    ] CIF: Fetching primary data for 2025-07.
[2025-10-24T17:55:59.867821] [INFO ] [REMOTE    ] CIF: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T17:56:00.052609] [INFO ] [REMOTE    ] CIG: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T17:56:00.147611] [INFO ] [REMOTE    ] CIF: Fetching primary data for 2025-08.
[2025-10-24T17:56:00.947692] [INFO ] [REMOTE    ] CIG: Fetching primary data for 2025-04.
[2025-10-24T17:56:01.169993] [INFO ] [REMOTE    ] CIF: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T17:56:01.747721] [INFO ] [REMOTE    ] CIF: Fetching primary data for 2025-09.
[2025-10-24T17:56:02.547759] [INFO ] [REMOTE    ] CICB: Fetching primary data for 2025-10.
[2025-10-24T17:56:03.077562] [INFO ] [REMOTE    ] CICB: Incremental fetch complete for 2025-10 (0.53 seconds).
[2025-10-24T17:56:03.078339] [INFO ] [REMOTE    ] CICB: Full fetch complete (1912 records).
[2025-10-24T17:56:03.078408] [DEBUG] [VALIDATOR ] CICB: Validating primary data.
[2025-10-24T17:56:03.078832] [FATAL] [VALIDATOR ] CICB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:56:03.078914] [FATAL] [MAIN      ] CICB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:56:03.078956] [WARN ] [MAIN      ] CICB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:56:03.079039] [INFO ] [LOCAL     ] CICB: Starting deletion of primary data.
[2025-10-24T17:56:03.079099] [DEBUG] [LOCAL     ] CICB: No primary data file found to delete.
[2025-10-24T17:56:03.079134] [INFO ] [LOCAL     ] CICB: Starting deletion of derivative data.
[2025-10-24T17:56:03.079186] [DEBUG] [LOCAL     ] CICB: No derivative data file found to delete.
[2025-10-24T17:56:03.079260] [INFO ] [MAIN      ] Update Progress: 448/2366 symbols completed. CICB took 38.3s. Estimated remaining: 3h 59m 46s. Rate: 8.0 symbols/min
[2025-10-24T17:56:03.264396] [INFO ] [MAIN      ] CII: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:56:03.280682] [DEBUG] [LOCAL     ] CII: Loaded 15213 existing records from primary storage.
[2025-10-24T17:56:03.280910] [INFO ] [MAIN      ] CII: Loaded 15213 existing records.
[2025-10-24T17:56:03.349607] [INFO ] [REMOTE    ] CIEN: Fetching primary data for 2025-04.
[2025-10-24T17:56:03.385276] [INFO ] [REMOTE    ] CIF: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T17:56:03.429781] [INFO ] [REMOTE    ] CIG: Incremental fetch complete for 2025-04 (2.48 seconds).
[2025-10-24T17:56:03.499261] [WARN ] [MAIN      ] CII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:56:03.499472] [INFO ] [MAIN      ] CII: Wiping existing primary data before full refresh.
[2025-10-24T17:56:03.499540] [INFO ] [LOCAL     ] CII: Starting deletion of primary data.
[2025-10-24T17:56:03.499981] [DEBUG] [LOCAL     ] CII: Deleted primary data file.
[2025-10-24T17:56:03.500041] [INFO ] [MAIN      ] CII: Starting full primary refresh.
[2025-10-24T17:56:03.858091] [INFO ] [REMOTE    ] CII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:56:04.147680] [INFO ] [REMOTE    ] CIG: Fetching primary data for 2025-05.
[2025-10-24T17:56:04.947693] [INFO ] [REMOTE    ] CII: Fetching primary data for 2025-01.
[2025-10-24T17:56:05.274192] [INFO ] [REMOTE    ] CIEN: Incremental fetch complete for 2025-04 (1.92 seconds).
[2025-10-24T17:56:05.747616] [INFO ] [REMOTE    ] CIF: Fetching primary data for 2025-10.
[2025-10-24T17:56:05.978145] [INFO ] [REMOTE    ] CIG: Incremental fetch complete for 2025-05 (1.83 seconds).
[2025-10-24T17:56:06.138068] [INFO ] [REMOTE    ] CII: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T17:56:06.200480] [INFO ] [REMOTE    ] CIF: Incremental fetch complete for 2025-10 (0.45 seconds).
[2025-10-24T17:56:06.201715] [INFO ] [REMOTE    ] CIF: Full fetch complete (6556 records).
[2025-10-24T17:56:06.201786] [DEBUG] [VALIDATOR ] CIF: Validating primary data.
[2025-10-24T17:56:06.552895] [INFO ] [REMOTE    ] CIEN: Fetching primary data for 2025-05.
[2025-10-24T17:56:06.642397] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present.
[2025-10-24T17:56:06.642513] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed.
[2025-10-24T17:56:06.642934] [INFO ] [MAIN      ] CIF: Fetched primary data is valid.
[2025-10-24T17:56:06.643011] [DEBUG] [LOCAL     ] CIF: Saving primary data.
[2025-10-24T17:56:06.643412] [FATAL] [LOCAL     ] CIF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:56:06.643560] [FATAL] [MAIN      ] CIF: Failed to save primary data.
[2025-10-24T17:56:06.643640] [WARN ] [MAIN      ] CIF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:56:06.643740] [INFO ] [LOCAL     ] CIF: Starting deletion of primary data.
[2025-10-24T17:56:06.644230] [DEBUG] [LOCAL     ] CIF: No primary data file found to delete.
[2025-10-24T17:56:06.644441] [INFO ] [LOCAL     ] CIF: Starting deletion of derivative data.
[2025-10-24T17:56:06.644729] [DEBUG] [LOCAL     ] CIF: Deleted derivative data file.
[2025-10-24T17:56:06.644856] [INFO ] [MAIN      ] Update Progress: 449/2366 symbols completed. CIF took 23.2s. Estimated remaining: 3h 59m 21s. Rate: 8.0 symbols/min
[2025-10-24T17:56:06.888770] [INFO ] [MAIN      ] CIM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:56:06.947170] [DEBUG] [LOCAL     ] CIM: Loaded 37666 existing records from primary storage.
[2025-10-24T17:56:06.947747] [INFO ] [MAIN      ] CIM: Loaded 37666 existing records.
[2025-10-24T17:56:07.214620] [WARN ] [MAIN      ] CIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:56:07.214915] [INFO ] [MAIN      ] CIM: Wiping existing primary data before full refresh.
[2025-10-24T17:56:07.214986] [INFO ] [LOCAL     ] CIM: Starting deletion of primary data.
[2025-10-24T17:56:07.215719] [DEBUG] [LOCAL     ] CIM: Deleted primary data file.
[2025-10-24T17:56:07.215781] [INFO ] [MAIN      ] CIM: Starting full primary refresh.
[2025-10-24T17:56:07.352981] [INFO ] [REMOTE    ] CII: Fetching primary data for 2025-02.
[2025-10-24T17:56:07.633264] [INFO ] [REMOTE    ] CIM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:56:08.016448] [INFO ] [REMOTE    ] CII: Incremental fetch complete for 2025-02 (0.66 seconds).
[2025-10-24T17:56:08.113606] [INFO ] [REMOTE    ] CIEN: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T17:56:08.147675] [INFO ] [REMOTE    ] CIG: Fetching primary data for 2025-06.
[2025-10-24T17:56:08.947681] [INFO ] [REMOTE    ] CII: Fetching primary data for 2025-03.
[2025-10-24T17:56:09.346982] [INFO ] [REMOTE    ] CIG: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T17:56:09.565685] [INFO ] [REMOTE    ] CII: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T17:56:09.747677] [INFO ] [REMOTE    ] CII: Fetching primary data for 2025-04.
[2025-10-24T17:56:10.547679] [INFO ] [REMOTE    ] CIG: Fetching primary data for 2025-07.
[2025-10-24T17:56:10.898811] [INFO ] [REMOTE    ] CII: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T17:56:11.347754] [INFO ] [REMOTE    ] CIEN: Fetching primary data for 2025-06.
[2025-10-24T17:56:12.147620] [INFO ] [REMOTE    ] CIM: Fetching primary data for 2025-01.
[2025-10-24T17:56:12.253718] [INFO ] [REMOTE    ] CIG: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T17:56:12.947738] [INFO ] [REMOTE    ] CII: Fetching primary data for 2025-05.
[2025-10-24T17:56:13.306057] [INFO ] [REMOTE    ] CIEN: Incremental fetch complete for 2025-06 (1.96 seconds).
[2025-10-24T17:56:13.706905] [INFO ] [REMOTE    ] CIM: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T17:56:13.747601] [INFO ] [REMOTE    ] CIM: Fetching primary data for 2025-02.
[2025-10-24T17:56:13.956474] [INFO ] [REMOTE    ] CII: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T17:56:14.547681] [INFO ] [REMOTE    ] CIEN: Fetching primary data for 2025-07.
[2025-10-24T17:56:14.724798] [INFO ] [REMOTE    ] CIM: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T17:56:15.347706] [INFO ] [REMOTE    ] CIM: Fetching primary data for 2025-03.
[2025-10-24T17:56:16.147638] [INFO ] [REMOTE    ] CIG: Fetching primary data for 2025-08.
[2025-10-24T17:56:16.205148] [INFO ] [REMOTE    ] CIEN: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T17:56:16.648425] [INFO ] [REMOTE    ] CIM: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T17:56:16.947686] [INFO ] [REMOTE    ] CIEN: Fetching primary data for 2025-08.
[2025-10-24T17:56:17.747634] [INFO ] [REMOTE    ] CIM: Fetching primary data for 2025-04.
[2025-10-24T17:56:17.786543] [INFO ] [REMOTE    ] CIG: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T17:56:18.547706] [INFO ] [REMOTE    ] CIG: Fetching primary data for 2025-09.
[2025-10-24T17:56:18.771277] [INFO ] [REMOTE    ] CIEN: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T17:56:19.276568] [INFO ] [REMOTE    ] CIM: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T17:56:19.347636] [INFO ] [REMOTE    ] CIM: Fetching primary data for 2025-05.
[2025-10-24T17:56:19.966873] [INFO ] [REMOTE    ] CIG: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T17:56:20.147626] [INFO ] [REMOTE    ] CIEN: Fetching primary data for 2025-09.
[2025-10-24T17:56:20.947619] [INFO ] [REMOTE    ] CIG: Fetching primary data for 2025-10.
[2025-10-24T17:56:20.974973] [INFO ] [REMOTE    ] CIM: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T17:56:21.747632] [INFO ] [REMOTE    ] CII: Fetching primary data for 2025-06.
[2025-10-24T17:56:22.007601] [INFO ] [REMOTE    ] CIEN: Incremental fetch complete for 2025-09 (1.86 seconds).
[2025-10-24T17:56:22.363582] [INFO ] [REMOTE    ] CII: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T17:56:22.557694] [INFO ] [REMOTE    ] CII: Fetching primary data for 2025-07.
[2025-10-24T17:56:22.562859] [INFO ] [REMOTE    ] CIG: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T17:56:22.572091] [INFO ] [REMOTE    ] CIG: Full fetch complete (62759 records).
[2025-10-24T17:56:22.572190] [DEBUG] [VALIDATOR ] CIG: Validating primary data.
[2025-10-24T17:56:22.980812] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present.
[2025-10-24T17:56:22.980892] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed.
[2025-10-24T17:56:22.981664] [INFO ] [MAIN      ] CIG: Fetched primary data is valid.
[2025-10-24T17:56:22.981727] [DEBUG] [LOCAL     ] CIG: Saving primary data.
[2025-10-24T17:56:22.982221] [FATAL] [LOCAL     ] CIG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:56:22.982308] [FATAL] [MAIN      ] CIG: Failed to save primary data.
[2025-10-24T17:56:22.982350] [WARN ] [MAIN      ] CIG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:56:22.982385] [INFO ] [LOCAL     ] CIG: Starting deletion of primary data.
[2025-10-24T17:56:22.982437] [DEBUG] [LOCAL     ] CIG: No primary data file found to delete.
[2025-10-24T17:56:22.982476] [INFO ] [LOCAL     ] CIG: Starting deletion of derivative data.
[2025-10-24T17:56:22.982689] [DEBUG] [LOCAL     ] CIG: Deleted derivative data file.
[2025-10-24T17:56:22.982803] [INFO ] [MAIN      ] Update Progress: 450/2366 symbols completed. CIG took 30.1s. Estimated remaining: 3h 59m 52s. Rate: 8.0 symbols/min
[2025-10-24T17:56:23.174519] [INFO ] [MAIN      ] CIMN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:56:23.178629] [DEBUG] [LOCAL     ] CIMN: Loaded 2715 existing records from primary storage.
[2025-10-24T17:56:23.178812] [INFO ] [MAIN      ] CIMN: Loaded 2715 existing records.
[2025-10-24T17:56:23.352850] [INFO ] [REMOTE    ] CIEN: Fetching primary data for 2025-10.
[2025-10-24T17:56:23.357459] [WARN ] [MAIN      ] CIMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:56:23.358310] [INFO ] [MAIN      ] CIMN: Wiping existing primary data before full refresh.
[2025-10-24T17:56:23.358359] [INFO ] [LOCAL     ] CIMN: Starting deletion of primary data.
[2025-10-24T17:56:23.358527] [DEBUG] [LOCAL     ] CIMN: Deleted primary data file.
[2025-10-24T17:56:23.358585] [INFO ] [MAIN      ] CIMN: Starting full primary refresh.
[2025-10-24T17:56:23.658727] [INFO ] [REMOTE    ] CII: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T17:56:23.726902] [INFO ] [REMOTE    ] CIMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:56:24.147697] [INFO ] [REMOTE    ] CII: Fetching primary data for 2025-08.
[2025-10-24T17:56:24.947678] [INFO ] [REMOTE    ] CIM: Fetching primary data for 2025-06.
[2025-10-24T17:56:24.993475] [INFO ] [REMOTE    ] CII: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T17:56:25.368191] [INFO ] [REMOTE    ] CIEN: Incremental fetch complete for 2025-10 (2.02 seconds).
[2025-10-24T17:56:25.377953] [INFO ] [REMOTE    ] CIEN: Full fetch complete (75836 records).
[2025-10-24T17:56:25.378112] [DEBUG] [VALIDATOR ] CIEN: Validating primary data.
[2025-10-24T17:56:25.759326] [INFO ] [REMOTE    ] CIMN: Fetching primary data for 2025-01.
[2025-10-24T17:56:25.782759] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present.
[2025-10-24T17:56:25.782826] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed.
[2025-10-24T17:56:25.783636] [INFO ] [MAIN      ] CIEN: Fetched primary data is valid.
[2025-10-24T17:56:25.783727] [DEBUG] [LOCAL     ] CIEN: Saving primary data.
[2025-10-24T17:56:25.784266] [FATAL] [LOCAL     ] CIEN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:56:25.784346] [FATAL] [MAIN      ] CIEN: Failed to save primary data.
[2025-10-24T17:56:25.784387] [WARN ] [MAIN      ] CIEN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:56:25.784421] [INFO ] [LOCAL     ] CIEN: Starting deletion of primary data.
[2025-10-24T17:56:25.784470] [DEBUG] [LOCAL     ] CIEN: No primary data file found to delete.
[2025-10-24T17:56:25.784505] [INFO ] [LOCAL     ] CIEN: Starting deletion of derivative data.
[2025-10-24T17:56:25.784688] [DEBUG] [LOCAL     ] CIEN: Deleted derivative data file.
[2025-10-24T17:56:25.785216] [INFO ] [MAIN      ] Update Progress: 451/2366 symbols completed. CIEN took 44.1s. Estimated remaining: 3h 59m 24s. Rate: 8.0 symbols/min
[2025-10-24T17:56:25.954637] [INFO ] [MAIN      ] CIMO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:56:25.954854] [DEBUG] [LOCAL     ] CIMO: No existing data file found in primary storage.
[2025-10-24T17:56:25.954988] [WARN ] [MAIN      ] CIMO: No existing data found, performing full refresh instead.
[2025-10-24T17:56:25.955095] [INFO ] [MAIN      ] CIMO: Wiping existing primary data before full refresh.
[2025-10-24T17:56:25.955136] [INFO ] [LOCAL     ] CIMO: Starting deletion of primary data.
[2025-10-24T17:56:25.955176] [DEBUG] [LOCAL     ] CIMO: No primary data file found to delete.
[2025-10-24T17:56:25.955207] [INFO ] [MAIN      ] CIMO: Starting full primary refresh.
[2025-10-24T17:56:26.315861] [INFO ] [REMOTE    ] CIMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:56:26.335408] [INFO ] [REMOTE    ] CIM: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T17:56:26.547621] [INFO ] [REMOTE    ] CII: Fetching primary data for 2025-09.
[2025-10-24T17:56:26.809536] [INFO ] [REMOTE    ] CIMN: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T17:56:27.150595] [INFO ] [REMOTE    ] CII: Incremental fetch complete for 2025-09 (0.60 seconds).
[2025-10-24T17:56:27.347683] [INFO ] [REMOTE    ] CIMO: Fetching primary data for 2025-01.
[2025-10-24T17:56:27.731511] [INFO ] [REMOTE    ] CIMO: Incremental fetch complete for 2025-01 (0.38 seconds).
[2025-10-24T17:56:28.147749] [INFO ] [REMOTE    ] CIMO: Fetching primary data for 2025-02.
[2025-10-24T17:56:28.593852] [INFO ] [REMOTE    ] CIMO: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T17:56:28.947691] [INFO ] [REMOTE    ] CIMN: Fetching primary data for 2025-02.
[2025-10-24T17:56:29.384080] [INFO ] [REMOTE    ] CIMN: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T17:56:29.747629] [INFO ] [REMOTE    ] CIMN: Fetching primary data for 2025-03.
[2025-10-24T17:56:30.213461] [INFO ] [REMOTE    ] CIMN: Incremental fetch complete for 2025-03 (0.47 seconds).
[2025-10-24T17:56:30.547689] [INFO ] [REMOTE    ] CIM: Fetching primary data for 2025-07.
[2025-10-24T17:56:31.347678] [INFO ] [REMOTE    ] CII: Fetching primary data for 2025-10.
[2025-10-24T17:56:31.901398] [INFO ] [REMOTE    ] CIM: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T17:56:32.147664] [INFO ] [REMOTE    ] CIM: Fetching primary data for 2025-08.
[2025-10-24T17:56:32.403801] [INFO ] [REMOTE    ] CII: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T17:56:32.407300] [INFO ] [REMOTE    ] CII: Full fetch complete (22819 records).
[2025-10-24T17:56:32.407373] [DEBUG] [VALIDATOR ] CII: Validating primary data.
[2025-10-24T17:56:32.781688] [DEBUG] [VALIDATOR ] CII: All expected trading days are present.
[2025-10-24T17:56:32.781774] [DEBUG] [VALIDATOR ] CII: Primary data validation passed.
[2025-10-24T17:56:32.782183] [INFO ] [MAIN      ] CII: Fetched primary data is valid.
[2025-10-24T17:56:32.782223] [DEBUG] [LOCAL     ] CII: Saving primary data.
[2025-10-24T17:56:32.782502] [FATAL] [LOCAL     ] CII: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:56:32.782583] [FATAL] [MAIN      ] CII: Failed to save primary data.
[2025-10-24T17:56:32.782624] [WARN ] [MAIN      ] CII: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:56:32.782694] [INFO ] [LOCAL     ] CII: Starting deletion of primary data.
[2025-10-24T17:56:32.782755] [DEBUG] [LOCAL     ] CII: No primary data file found to delete.
[2025-10-24T17:56:32.782790] [INFO ] [LOCAL     ] CII: Starting deletion of derivative data.
[2025-10-24T17:56:32.782940] [DEBUG] [LOCAL     ] CII: Deleted derivative data file.
[2025-10-24T17:56:32.783028] [INFO ] [MAIN      ] Update Progress: 452/2366 symbols completed. CII took 29.7s. Estimated remaining: 3h 59m 15s. Rate: 8.0 symbols/min
[2025-10-24T17:56:32.959317] [INFO ] [REMOTE    ] CIMO: Fetching primary data for 2025-03.
[2025-10-24T17:56:32.964635] [INFO ] [MAIN      ] CIMP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:56:32.964844] [DEBUG] [LOCAL     ] CIMP: No existing data file found in primary storage.
[2025-10-24T17:56:32.964890] [WARN ] [MAIN      ] CIMP: No existing data found, performing full refresh instead.
[2025-10-24T17:56:32.965037] [INFO ] [MAIN      ] CIMP: Wiping existing primary data before full refresh.
[2025-10-24T17:56:32.965093] [INFO ] [LOCAL     ] CIMP: Starting deletion of primary data.
[2025-10-24T17:56:32.965137] [DEBUG] [LOCAL     ] CIMP: No primary data file found to delete.
[2025-10-24T17:56:32.965170] [INFO ] [MAIN      ] CIMP: Starting full primary refresh.
[2025-10-24T17:56:33.339434] [INFO ] [REMOTE    ] CIMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:56:33.514209] [INFO ] [REMOTE    ] CIM: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T17:56:33.642865] [INFO ] [REMOTE    ] CIMO: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T17:56:33.747631] [INFO ] [REMOTE    ] CIMP: Fetching primary data for 2025-01.
[2025-10-24T17:56:33.933947] [DEBUG] [REMOTE    ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:56:33.934295] [WARN ] [REMOTE    ] CIMP: No data returned for month 2025-01
[2025-10-24T17:56:33.934396] [FATAL] [REMOTE    ] CIMP: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:56:33.934469] [FATAL] [MAIN      ] CIMP: Failed to fetch primary data.
[2025-10-24T17:56:33.934540] [WARN ] [MAIN      ] CIMP: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:56:33.934630] [INFO ] [LOCAL     ] CIMP: Starting deletion of primary data.
[2025-10-24T17:56:33.934735] [DEBUG] [LOCAL     ] CIMP: No primary data file found to delete.
[2025-10-24T17:56:33.934781] [INFO ] [LOCAL     ] CIMP: Starting deletion of derivative data.
[2025-10-24T17:56:33.934824] [DEBUG] [LOCAL     ] CIMP: No derivative data file found to delete.
[2025-10-24T17:56:33.934870] [INFO ] [MAIN      ] Update Progress: 453/2366 symbols completed. CIMP took 1.2s. Estimated remaining: 3h 58m 40s. Rate: 8.0 symbols/min
[2025-10-24T17:56:34.119568] [INFO ] [MAIN      ] CINT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:56:34.140002] [DEBUG] [LOCAL     ] CINT: Loaded 20616 existing records from primary storage.
[2025-10-24T17:56:34.140254] [INFO ] [MAIN      ] CINT: Loaded 20616 existing records.
[2025-10-24T17:56:34.313987] [WARN ] [MAIN      ] CINT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:56:34.314239] [INFO ] [MAIN      ] CINT: Wiping existing primary data before full refresh.
[2025-10-24T17:56:34.314303] [INFO ] [LOCAL     ] CINT: Starting deletion of primary data.
[2025-10-24T17:56:34.314741] [DEBUG] [LOCAL     ] CINT: Deleted primary data file.
[2025-10-24T17:56:34.314801] [INFO ] [MAIN      ] CINT: Starting full primary refresh.
[2025-10-24T17:56:34.552733] [INFO ] [REMOTE    ] CIMO: Fetching primary data for 2025-04.
[2025-10-24T17:56:34.666373] [INFO ] [REMOTE    ] CINT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:56:35.190433] [INFO ] [REMOTE    ] CIMO: Incremental fetch complete for 2025-04 (0.64 seconds).
[2025-10-24T17:56:35.347632] [INFO ] [REMOTE    ] CIMN: Fetching primary data for 2025-04.
[2025-10-24T17:56:35.943557] [INFO ] [REMOTE    ] CIMN: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T17:56:36.147674] [INFO ] [REMOTE    ] CINT: Fetching primary data for 2025-01.
[2025-10-24T17:56:36.947698] [INFO ] [REMOTE    ] CIMO: Fetching primary data for 2025-05.
[2025-10-24T17:56:37.012416] [INFO ] [REMOTE    ] CINT: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T17:56:37.348616] [INFO ] [REMOTE    ] CIMO: Incremental fetch complete for 2025-05 (0.40 seconds).
[2025-10-24T17:56:37.747701] [INFO ] [REMOTE    ] CIM: Fetching primary data for 2025-09.
[2025-10-24T17:56:38.547638] [INFO ] [REMOTE    ] CIMN: Fetching primary data for 2025-05.
[2025-10-24T17:56:39.193257] [INFO ] [REMOTE    ] CIMN: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T17:56:39.347618] [INFO ] [REMOTE    ] CINT: Fetching primary data for 2025-02.
[2025-10-24T17:56:39.399892] [INFO ] [REMOTE    ] CIM: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T17:56:40.147701] [INFO ] [REMOTE    ] CIMN: Fetching primary data for 2025-06.
[2025-10-24T17:56:40.363295] [INFO ] [REMOTE    ] CINT: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T17:56:40.600778] [INFO ] [REMOTE    ] CIMN: Incremental fetch complete for 2025-06 (0.45 seconds).
[2025-10-24T17:56:40.947624] [INFO ] [REMOTE    ] CINT: Fetching primary data for 2025-03.
[2025-10-24T17:56:41.747712] [INFO ] [REMOTE    ] CIM: Fetching primary data for 2025-10.
[2025-10-24T17:56:41.787743] [INFO ] [REMOTE    ] CINT: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T17:56:42.547715] [INFO ] [REMOTE    ] CINT: Fetching primary data for 2025-04.
[2025-10-24T17:56:43.302295] [INFO ] [REMOTE    ] CIM: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T17:56:43.309900] [INFO ] [REMOTE    ] CIM: Full fetch complete (54805 records).
[2025-10-24T17:56:43.320066] [DEBUG] [VALIDATOR ] CIM: Validating primary data.
[2025-10-24T17:56:43.321093] [INFO ] [REMOTE    ] CINT: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T17:56:43.347714] [INFO ] [REMOTE    ] CIMN: Fetching primary data for 2025-07.
[2025-10-24T17:56:43.710337] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present.
[2025-10-24T17:56:43.710419] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed.
[2025-10-24T17:56:43.711301] [INFO ] [MAIN      ] CIM: Fetched primary data is valid.
[2025-10-24T17:56:43.711365] [DEBUG] [LOCAL     ] CIM: Saving primary data.
[2025-10-24T17:56:43.711854] [FATAL] [LOCAL     ] CIM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:56:43.711938] [FATAL] [MAIN      ] CIM: Failed to save primary data.
[2025-10-24T17:56:43.711980] [WARN ] [MAIN      ] CIM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:56:43.712042] [INFO ] [LOCAL     ] CIM: Starting deletion of primary data.
[2025-10-24T17:56:43.712123] [DEBUG] [LOCAL     ] CIM: No primary data file found to delete.
[2025-10-24T17:56:43.712178] [INFO ] [LOCAL     ] CIM: Starting deletion of derivative data.
[2025-10-24T17:56:43.712330] [DEBUG] [LOCAL     ] CIM: Deleted derivative data file.
[2025-10-24T17:56:43.712767] [INFO ] [MAIN      ] Update Progress: 454/2366 symbols completed. CIM took 37.1s. Estimated remaining: 3h 58m 42s. Rate: 8.0 symbols/min
[2025-10-24T17:56:43.869218] [INFO ] [REMOTE    ] CIMN: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T17:56:43.890022] [INFO ] [MAIN      ] CIO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:56:43.913376] [DEBUG] [LOCAL     ] CIO: Loaded 21445 existing records from primary storage.
[2025-10-24T17:56:43.913674] [INFO ] [MAIN      ] CIO: Loaded 21445 existing records.
[2025-10-24T17:56:44.092481] [WARN ] [MAIN      ] CIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:56:44.092748] [INFO ] [MAIN      ] CIO: Wiping existing primary data before full refresh.
[2025-10-24T17:56:44.092802] [INFO ] [LOCAL     ] CIO: Starting deletion of primary data.
[2025-10-24T17:56:44.093275] [DEBUG] [LOCAL     ] CIO: Deleted primary data file.
[2025-10-24T17:56:44.093332] [INFO ] [MAIN      ] CIO: Starting full primary refresh.
[2025-10-24T17:56:44.147751] [INFO ] [REMOTE    ] CINT: Fetching primary data for 2025-05.
[2025-10-24T17:56:44.448354] [INFO ] [REMOTE    ] CIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:56:44.888252] [INFO ] [REMOTE    ] CINT: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T17:56:44.947673] [INFO ] [REMOTE    ] CIMN: Fetching primary data for 2025-08.
[2025-10-24T17:56:45.381917] [INFO ] [REMOTE    ] CIMN: Incremental fetch complete for 2025-08 (0.43 seconds).
[2025-10-24T17:56:45.747676] [INFO ] [REMOTE    ] CIMN: Fetching primary data for 2025-09.
[2025-10-24T17:56:46.157061] [INFO ] [REMOTE    ] CIMN: Incremental fetch complete for 2025-09 (0.41 seconds).
[2025-10-24T17:56:46.547686] [INFO ] [REMOTE    ] CIMO: Fetching primary data for 2025-06.
[2025-10-24T17:56:46.968292] [INFO ] [REMOTE    ] CIMO: Incremental fetch complete for 2025-06 (0.42 seconds).
[2025-10-24T17:56:47.347683] [INFO ] [REMOTE    ] CIMN: Fetching primary data for 2025-10.
[2025-10-24T17:56:47.974940] [INFO ] [REMOTE    ] CIMN: Incremental fetch complete for 2025-10 (0.63 seconds).
[2025-10-24T17:56:47.975981] [INFO ] [REMOTE    ] CIMN: Full fetch complete (3887 records).
[2025-10-24T17:56:47.976049] [DEBUG] [VALIDATOR ] CIMN: Validating primary data.
[2025-10-24T17:56:48.152817] [INFO ] [REMOTE    ] CIMO: Fetching primary data for 2025-07.
[2025-10-24T17:56:48.328343] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present.
[2025-10-24T17:56:48.328417] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed.
[2025-10-24T17:56:48.328542] [INFO ] [MAIN      ] CIMN: Fetched primary data is valid.
[2025-10-24T17:56:48.328580] [DEBUG] [LOCAL     ] CIMN: Saving primary data.
[2025-10-24T17:56:48.328777] [FATAL] [LOCAL     ] CIMN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:56:48.328858] [FATAL] [MAIN      ] CIMN: Failed to save primary data.
[2025-10-24T17:56:48.328899] [WARN ] [MAIN      ] CIMN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:56:48.328935] [INFO ] [LOCAL     ] CIMN: Starting deletion of primary data.
[2025-10-24T17:56:48.328982] [DEBUG] [LOCAL     ] CIMN: No primary data file found to delete.
[2025-10-24T17:56:48.329016] [INFO ] [LOCAL     ] CIMN: Starting deletion of derivative data.
[2025-10-24T17:56:48.329141] [DEBUG] [LOCAL     ] CIMN: Deleted derivative data file.
[2025-10-24T17:56:48.329207] [INFO ] [MAIN      ] Update Progress: 455/2366 symbols completed. CIMN took 25.3s. Estimated remaining: 3h 58m 23s. Rate: 8.0 symbols/min
[2025-10-24T17:56:48.500070] [INFO ] [MAIN      ] CION: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:56:48.526767] [DEBUG] [LOCAL     ] CION: Loaded 28261 existing records from primary storage.
[2025-10-24T17:56:48.527027] [INFO ] [MAIN      ] CION: Loaded 28261 existing records.
[2025-10-24T17:56:48.688852] [INFO ] [REMOTE    ] CIMO: Incremental fetch complete for 2025-07 (0.54 seconds).
[2025-10-24T17:56:48.708537] [WARN ] [MAIN      ] CION: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:56:48.710297] [INFO ] [MAIN      ] CION: Wiping existing primary data before full refresh.
[2025-10-24T17:56:48.710345] [INFO ] [LOCAL     ] CION: Starting deletion of primary data.
[2025-10-24T17:56:48.710552] [DEBUG] [LOCAL     ] CION: Deleted primary data file.
[2025-10-24T17:56:48.710590] [INFO ] [MAIN      ] CION: Starting full primary refresh.
[2025-10-24T17:56:48.952803] [INFO ] [REMOTE    ] CIO: Fetching primary data for 2025-01.
[2025-10-24T17:56:49.066143] [INFO ] [REMOTE    ] CION: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:56:49.747635] [INFO ] [REMOTE    ] CINT: Fetching primary data for 2025-06.
[2025-10-24T17:56:50.188824] [INFO ] [REMOTE    ] CIO: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T17:56:50.471252] [INFO ] [REMOTE    ] CINT: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T17:56:50.547716] [INFO ] [REMOTE    ] CIMO: Fetching primary data for 2025-08.
[2025-10-24T17:56:51.121749] [INFO ] [REMOTE    ] CIMO: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T17:56:51.347698] [INFO ] [REMOTE    ] CINT: Fetching primary data for 2025-07.
[2025-10-24T17:56:52.147627] [INFO ] [REMOTE    ] CIMO: Fetching primary data for 2025-09.
[2025-10-24T17:56:52.280493] [INFO ] [REMOTE    ] CINT: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T17:56:52.832582] [INFO ] [REMOTE    ] CIMO: Incremental fetch complete for 2025-09 (0.68 seconds).
[2025-10-24T17:56:52.947673] [INFO ] [REMOTE    ] CIO: Fetching primary data for 2025-02.
[2025-10-24T17:56:53.747712] [INFO ] [REMOTE    ] CINT: Fetching primary data for 2025-08.
[2025-10-24T17:56:53.978413] [INFO ] [REMOTE    ] CIO: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T17:56:54.547726] [INFO ] [REMOTE    ] CIMO: Fetching primary data for 2025-10.
[2025-10-24T17:56:54.821455] [INFO ] [REMOTE    ] CINT: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T17:56:55.155554] [INFO ] [REMOTE    ] CIMO: Incremental fetch complete for 2025-10 (0.61 seconds).
[2025-10-24T17:56:55.156826] [INFO ] [REMOTE    ] CIMO: Full fetch complete (4538 records).
[2025-10-24T17:56:55.156899] [DEBUG] [VALIDATOR ] CIMO: Validating primary data.
[2025-10-24T17:56:55.340803] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T17:56:55.341072] [FATAL] [MAIN      ] CIMO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:56:55.341160] [WARN ] [MAIN      ] CIMO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:56:55.341252] [INFO ] [LOCAL     ] CIMO: Starting deletion of primary data.
[2025-10-24T17:56:55.341335] [DEBUG] [LOCAL     ] CIMO: No primary data file found to delete.
[2025-10-24T17:56:55.341372] [INFO ] [LOCAL     ] CIMO: Starting deletion of derivative data.
[2025-10-24T17:56:55.341414] [DEBUG] [LOCAL     ] CIMO: No derivative data file found to delete.
[2025-10-24T17:56:55.341472] [INFO ] [MAIN      ] Update Progress: 456/2366 symbols completed. CIMO took 29.6s. Estimated remaining: 3h 58m 13s. Rate: 8.0 symbols/min
[2025-10-24T17:56:55.352797] [INFO ] [REMOTE    ] CION: Fetching primary data for 2025-01.
[2025-10-24T17:56:55.516428] [INFO ] [MAIN      ] CIVI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:56:55.568103] [DEBUG] [LOCAL     ] CIVI: Loaded 53109 existing records from primary storage.
[2025-10-24T17:56:55.568428] [INFO ] [MAIN      ] CIVI: Loaded 53109 existing records.
[2025-10-24T17:56:55.745946] [WARN ] [MAIN      ] CIVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:56:55.746175] [INFO ] [MAIN      ] CIVI: Wiping existing primary data before full refresh.
[2025-10-24T17:56:55.746221] [INFO ] [LOCAL     ] CIVI: Starting deletion of primary data.
[2025-10-24T17:56:55.746410] [DEBUG] [LOCAL     ] CIVI: Deleted primary data file.
[2025-10-24T17:56:55.746447] [INFO ] [MAIN      ] CIVI: Starting full primary refresh.
[2025-10-24T17:56:56.095074] [INFO ] [REMOTE    ] CIVI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:56:56.147617] [INFO ] [REMOTE    ] CIVI: Fetching primary data for 2025-01.
[2025-10-24T17:56:56.770301] [INFO ] [REMOTE    ] CION: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T17:56:56.947683] [INFO ] [REMOTE    ] CINT: Fetching primary data for 2025-09.
[2025-10-24T17:56:57.747625] [INFO ] [REMOTE    ] CIO: Fetching primary data for 2025-03.
[2025-10-24T17:56:57.848444] [INFO ] [REMOTE    ] CIVI: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T17:56:57.894003] [INFO ] [REMOTE    ] CINT: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T17:56:58.550784] [INFO ] [REMOTE    ] CINT: Fetching primary data for 2025-10.
[2025-10-24T17:56:58.552471] [INFO ] [REMOTE    ] CIO: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T17:56:59.347615] [INFO ] [REMOTE    ] CION: Fetching primary data for 2025-02.
[2025-10-24T17:56:59.797593] [INFO ] [REMOTE    ] CINT: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T17:56:59.803302] [INFO ] [REMOTE    ] CINT: Full fetch complete (28723 records).
[2025-10-24T17:56:59.803382] [DEBUG] [VALIDATOR ] CINT: Validating primary data.
[2025-10-24T17:57:00.149681] [INFO ] [REMOTE    ] CIO: Fetching primary data for 2025-04.
[2025-10-24T17:57:00.187081] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present.
[2025-10-24T17:57:00.187284] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed.
[2025-10-24T17:57:00.188037] [INFO ] [MAIN      ] CINT: Fetched primary data is valid.
[2025-10-24T17:57:00.188215] [DEBUG] [LOCAL     ] CINT: Saving primary data.
[2025-10-24T17:57:00.194079] [FATAL] [LOCAL     ] CINT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:57:00.203138] [INFO ] [REMOTE    ] CION: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T17:57:00.202603] [FATAL] [MAIN      ] CINT: Failed to save primary data.
[2025-10-24T17:57:00.208504] [WARN ] [MAIN      ] CINT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:57:00.208596] [INFO ] [LOCAL     ] CINT: Starting deletion of primary data.
[2025-10-24T17:57:00.208707] [DEBUG] [LOCAL     ] CINT: No primary data file found to delete.
[2025-10-24T17:57:00.208759] [INFO ] [LOCAL     ] CINT: Starting deletion of derivative data.
[2025-10-24T17:57:00.208892] [DEBUG] [LOCAL     ] CINT: Deleted derivative data file.
[2025-10-24T17:57:00.208967] [INFO ] [MAIN      ] Update Progress: 457/2366 symbols completed. CINT took 26.3s. Estimated remaining: 3h 57m 55s. Rate: 8.0 symbols/min
[2025-10-24T17:57:00.386548] [INFO ] [MAIN      ] CL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:57:00.440499] [DEBUG] [LOCAL     ] CL: Loaded 54039 existing records from primary storage.
[2025-10-24T17:57:00.440997] [INFO ] [MAIN      ] CL: Loaded 54039 existing records.
[2025-10-24T17:57:00.621806] [WARN ] [MAIN      ] CL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:57:00.622008] [INFO ] [MAIN      ] CL: Wiping existing primary data before full refresh.
[2025-10-24T17:57:00.622064] [INFO ] [LOCAL     ] CL: Starting deletion of primary data.
[2025-10-24T17:57:00.622453] [DEBUG] [LOCAL     ] CL: Deleted primary data file.
[2025-10-24T17:57:00.622492] [INFO ] [MAIN      ] CL: Starting full primary refresh.
[2025-10-24T17:57:00.956324] [INFO ] [REMOTE    ] CIVI: Fetching primary data for 2025-02.
[2025-10-24T17:57:00.986089] [INFO ] [REMOTE    ] CL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:57:01.747633] [INFO ] [REMOTE    ] CION: Fetching primary data for 2025-03.
[2025-10-24T17:57:01.789389] [INFO ] [REMOTE    ] CIO: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T17:57:02.547700] [INFO ] [REMOTE    ] CL: Fetching primary data for 2025-01.
[2025-10-24T17:57:03.347755] [INFO ] [REMOTE    ] CIO: Fetching primary data for 2025-05.
[2025-10-24T17:57:03.918798] [INFO ] [REMOTE    ] CION: Incremental fetch complete for 2025-03 (2.17 seconds).
[2025-10-24T17:57:04.154567] [INFO ] [REMOTE    ] CION: Fetching primary data for 2025-04.
[2025-10-24T17:57:04.184089] [INFO ] [REMOTE    ] CIVI: Incremental fetch complete for 2025-02 (3.23 seconds).
[2025-10-24T17:57:04.818588] [INFO ] [REMOTE    ] CIO: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T17:57:04.947626] [INFO ] [REMOTE    ] CIVI: Fetching primary data for 2025-03.
[2025-10-24T17:57:05.021575] [INFO ] [REMOTE    ] CL: Incremental fetch complete for 2025-01 (2.47 seconds).
[2025-10-24T17:57:05.571190] [INFO ] [REMOTE    ] CION: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T17:57:05.747737] [INFO ] [REMOTE    ] CL: Fetching primary data for 2025-02.
[2025-10-24T17:57:06.457660] [INFO ] [REMOTE    ] CIVI: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T17:57:06.547629] [INFO ] [REMOTE    ] CIVI: Fetching primary data for 2025-04.
[2025-10-24T17:57:07.347635] [INFO ] [REMOTE    ] CION: Fetching primary data for 2025-05.
[2025-10-24T17:57:07.578017] [INFO ] [REMOTE    ] CL: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T17:57:08.105912] [INFO ] [REMOTE    ] CIVI: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T17:57:08.147615] [INFO ] [REMOTE    ] CL: Fetching primary data for 2025-03.
[2025-10-24T17:57:08.252373] [INFO ] [REMOTE    ] CION: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T17:57:08.947693] [INFO ] [REMOTE    ] CIVI: Fetching primary data for 2025-05.
[2025-10-24T17:57:09.747720] [INFO ] [REMOTE    ] CION: Fetching primary data for 2025-06.
[2025-10-24T17:57:09.966921] [INFO ] [REMOTE    ] CL: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T17:57:10.508834] [INFO ] [REMOTE    ] CIVI: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T17:57:10.536208] [INFO ] [REMOTE    ] CION: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T17:57:10.547599] [INFO ] [REMOTE    ] CION: Fetching primary data for 2025-07.
[2025-10-24T17:57:11.347673] [INFO ] [REMOTE    ] CIO: Fetching primary data for 2025-06.
[2025-10-24T17:57:11.543015] [INFO ] [REMOTE    ] CION: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T17:57:12.034122] [INFO ] [REMOTE    ] CIO: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T17:57:12.147609] [INFO ] [REMOTE    ] CION: Fetching primary data for 2025-08.
[2025-10-24T17:57:12.947690] [INFO ] [REMOTE    ] CIVI: Fetching primary data for 2025-06.
[2025-10-24T17:57:13.317376] [INFO ] [REMOTE    ] CION: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T17:57:13.747673] [INFO ] [REMOTE    ] CIO: Fetching primary data for 2025-07.
[2025-10-24T17:57:14.547616] [INFO ] [REMOTE    ] CION: Fetching primary data for 2025-09.
[2025-10-24T17:57:14.739122] [INFO ] [REMOTE    ] CIVI: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T17:57:14.923300] [INFO ] [REMOTE    ] CIO: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T17:57:15.347714] [INFO ] [REMOTE    ] CIO: Fetching primary data for 2025-08.
[2025-10-24T17:57:15.469871] [INFO ] [REMOTE    ] CION: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T17:57:16.147686] [INFO ] [REMOTE    ] CIVI: Fetching primary data for 2025-07.
[2025-10-24T17:57:16.431351] [INFO ] [REMOTE    ] CIO: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T17:57:16.947679] [INFO ] [REMOTE    ] CIO: Fetching primary data for 2025-09.
[2025-10-24T17:57:17.747694] [INFO ] [REMOTE    ] CL: Fetching primary data for 2025-04.
[2025-10-24T17:57:18.059556] [INFO ] [REMOTE    ] CIVI: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T17:57:18.072574] [INFO ] [REMOTE    ] CIO: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T17:57:18.547727] [INFO ] [REMOTE    ] CION: Fetching primary data for 2025-10.
[2025-10-24T17:57:19.347623] [INFO ] [REMOTE    ] CIO: Fetching primary data for 2025-10.
[2025-10-24T17:57:19.478286] [INFO ] [REMOTE    ] CL: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T17:57:19.965242] [INFO ] [REMOTE    ] CION: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T17:57:19.972727] [INFO ] [REMOTE    ] CION: Full fetch complete (40552 records).
[2025-10-24T17:57:19.972886] [DEBUG] [VALIDATOR ] CION: Validating primary data.
[2025-10-24T17:57:20.160008] [INFO ] [REMOTE    ] CIVI: Fetching primary data for 2025-08.
[2025-10-24T17:57:20.350019] [DEBUG] [VALIDATOR ] CION: All expected trading days are present.
[2025-10-24T17:57:20.350107] [DEBUG] [VALIDATOR ] CION: Primary data validation passed.
[2025-10-24T17:57:20.350668] [INFO ] [MAIN      ] CION: Fetched primary data is valid.
[2025-10-24T17:57:20.350731] [DEBUG] [LOCAL     ] CION: Saving primary data.
[2025-10-24T17:57:20.351090] [FATAL] [LOCAL     ] CION: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:57:20.351198] [FATAL] [MAIN      ] CION: Failed to save primary data.
[2025-10-24T17:57:20.351239] [WARN ] [MAIN      ] CION: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:57:20.351272] [INFO ] [LOCAL     ] CION: Starting deletion of primary data.
[2025-10-24T17:57:20.351320] [DEBUG] [LOCAL     ] CION: No primary data file found to delete.
[2025-10-24T17:57:20.351374] [INFO ] [LOCAL     ] CION: Starting deletion of derivative data.
[2025-10-24T17:57:20.351534] [DEBUG] [LOCAL     ] CION: Deleted derivative data file.
[2025-10-24T17:57:20.351623] [INFO ] [MAIN      ] Update Progress: 458/2366 symbols completed. CION took 32.0s. Estimated remaining: 3h 58m 40s. Rate: 8.0 symbols/min
[2025-10-24T17:57:20.522943] [INFO ] [MAIN      ] CLB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:57:20.558167] [DEBUG] [LOCAL     ] CLB: Loaded 33810 existing records from primary storage.
[2025-10-24T17:57:20.558435] [INFO ] [MAIN      ] CLB: Loaded 33810 existing records.
[2025-10-24T17:57:20.706200] [INFO ] [REMOTE    ] CIO: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T17:57:20.765660] [INFO ] [REMOTE    ] CIO: Full fetch complete (29881 records).
[2025-10-24T17:57:20.765880] [DEBUG] [VALIDATOR ] CIO: Validating primary data.
[2025-10-24T17:57:20.765456] [WARN ] [MAIN      ] CLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:57:20.766286] [INFO ] [MAIN      ] CLB: Wiping existing primary data before full refresh.
[2025-10-24T17:57:20.766355] [INFO ] [LOCAL     ] CLB: Starting deletion of primary data.
[2025-10-24T17:57:20.798528] [DEBUG] [LOCAL     ] CLB: Deleted primary data file.
[2025-10-24T17:57:20.837697] [INFO ] [MAIN      ] CLB: Starting full primary refresh.
[2025-10-24T17:57:20.966898] [INFO ] [REMOTE    ] CL: Fetching primary data for 2025-05.
[2025-10-24T17:57:21.550497] [INFO ] [REMOTE    ] CLB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:57:21.552518] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present.
[2025-10-24T17:57:21.552886] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed.
[2025-10-24T17:57:21.553391] [INFO ] [MAIN      ] CIO: Fetched primary data is valid.
[2025-10-24T17:57:21.553434] [DEBUG] [LOCAL     ] CIO: Saving primary data.
[2025-10-24T17:57:21.553812] [FATAL] [LOCAL     ] CIO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:57:21.553894] [FATAL] [MAIN      ] CIO: Failed to save primary data.
[2025-10-24T17:57:21.553936] [WARN ] [MAIN      ] CIO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:57:21.553970] [INFO ] [LOCAL     ] CIO: Starting deletion of primary data.
[2025-10-24T17:57:21.554019] [DEBUG] [LOCAL     ] CIO: No primary data file found to delete.
[2025-10-24T17:57:21.554053] [INFO ] [LOCAL     ] CIO: Starting deletion of derivative data.
[2025-10-24T17:57:21.554180] [DEBUG] [LOCAL     ] CIO: Deleted derivative data file.
[2025-10-24T17:57:21.554254] [INFO ] [MAIN      ] Update Progress: 459/2366 symbols completed. CIO took 37.8s. Estimated remaining: 3h 58m 7s. Rate: 8.0 symbols/min
[2025-10-24T17:57:21.726210] [INFO ] [MAIN      ] CLCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:57:21.740832] [DEBUG] [LOCAL     ] CLCO: Loaded 13277 existing records from primary storage.
[2025-10-24T17:57:21.741067] [INFO ] [MAIN      ] CLCO: Loaded 13277 existing records.
[2025-10-24T17:57:21.772224] [INFO ] [REMOTE    ] CLB: Fetching primary data for 2025-01.
[2025-10-24T17:57:21.951273] [INFO ] [REMOTE    ] CIVI: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T17:57:21.954969] [WARN ] [MAIN      ] CLCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:57:21.965998] [INFO ] [MAIN      ] CLCO: Wiping existing primary data before full refresh.
[2025-10-24T17:57:21.966213] [INFO ] [LOCAL     ] CLCO: Starting deletion of primary data.
[2025-10-24T17:57:21.966759] [DEBUG] [LOCAL     ] CLCO: Deleted primary data file.
[2025-10-24T17:57:21.966823] [INFO ] [MAIN      ] CLCO: Starting full primary refresh.
[2025-10-24T17:57:22.317814] [INFO ] [REMOTE    ] CLCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:57:22.547632] [INFO ] [REMOTE    ] CLCO: Fetching primary data for 2025-01.
[2025-10-24T17:57:22.926495] [INFO ] [REMOTE    ] CL: Incremental fetch complete for 2025-05 (1.96 seconds).
[2025-10-24T17:57:23.040119] [INFO ] [REMOTE    ] CLB: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T17:57:23.347734] [INFO ] [REMOTE    ] CL: Fetching primary data for 2025-06.
[2025-10-24T17:57:23.371833] [INFO ] [REMOTE    ] CLCO: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T17:57:24.147723] [INFO ] [REMOTE    ] CLCO: Fetching primary data for 2025-02.
[2025-10-24T17:57:24.947671] [INFO ] [REMOTE    ] CIVI: Fetching primary data for 2025-09.
[2025-10-24T17:57:25.018437] [INFO ] [REMOTE    ] CL: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T17:57:25.107667] [INFO ] [REMOTE    ] CLCO: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T17:57:25.747749] [INFO ] [REMOTE    ] CL: Fetching primary data for 2025-07.
[2025-10-24T17:57:26.547624] [INFO ] [REMOTE    ] CLB: Fetching primary data for 2025-02.
[2025-10-24T17:57:26.638818] [INFO ] [REMOTE    ] CIVI: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T17:57:27.347707] [INFO ] [REMOTE    ] CLCO: Fetching primary data for 2025-03.
[2025-10-24T17:57:27.762969] [INFO ] [REMOTE    ] CL: Incremental fetch complete for 2025-07 (2.02 seconds).
[2025-10-24T17:57:27.763966] [INFO ] [REMOTE    ] CLB: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T17:57:28.147634] [INFO ] [REMOTE    ] CLB: Fetching primary data for 2025-03.
[2025-10-24T17:57:28.501589] [INFO ] [REMOTE    ] CLCO: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T17:57:28.947721] [INFO ] [REMOTE    ] CIVI: Fetching primary data for 2025-10.
[2025-10-24T17:57:29.488021] [INFO ] [REMOTE    ] CLB: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T17:57:29.747690] [INFO ] [REMOTE    ] CLCO: Fetching primary data for 2025-04.
[2025-10-24T17:57:30.547677] [INFO ] [REMOTE    ] CLB: Fetching primary data for 2025-04.
[2025-10-24T17:57:30.584072] [INFO ] [REMOTE    ] CLCO: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T17:57:30.831511] [INFO ] [REMOTE    ] CIVI: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T17:57:30.841443] [INFO ] [REMOTE    ] CIVI: Full fetch complete (76085 records).
[2025-10-24T17:57:30.841585] [DEBUG] [VALIDATOR ] CIVI: Validating primary data.
[2025-10-24T17:57:31.235361] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present.
[2025-10-24T17:57:31.235470] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed.
[2025-10-24T17:57:31.236387] [INFO ] [MAIN      ] CIVI: Fetched primary data is valid.
[2025-10-24T17:57:31.236450] [DEBUG] [LOCAL     ] CIVI: Saving primary data.
[2025-10-24T17:57:31.237129] [FATAL] [LOCAL     ] CIVI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:57:31.237242] [FATAL] [MAIN      ] CIVI: Failed to save primary data.
[2025-10-24T17:57:31.237290] [WARN ] [MAIN      ] CIVI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:57:31.237327] [INFO ] [LOCAL     ] CIVI: Starting deletion of primary data.
[2025-10-24T17:57:31.237381] [DEBUG] [LOCAL     ] CIVI: No primary data file found to delete.
[2025-10-24T17:57:31.237428] [INFO ] [LOCAL     ] CIVI: Starting deletion of derivative data.
[2025-10-24T17:57:31.237596] [DEBUG] [LOCAL     ] CIVI: Deleted derivative data file.
[2025-10-24T17:57:31.238162] [INFO ] [MAIN      ] Update Progress: 460/2366 symbols completed. CIVI took 35.9s. Estimated remaining: 3h 58m 8s. Rate: 8.0 symbols/min
[2025-10-24T17:57:31.352736] [INFO ] [REMOTE    ] CLCO: Fetching primary data for 2025-05.
[2025-10-24T17:57:31.410327] [INFO ] [MAIN      ] CLDT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:57:31.435029] [DEBUG] [LOCAL     ] CLDT: Loaded 25339 existing records from primary storage.
[2025-10-24T17:57:31.435280] [INFO ] [MAIN      ] CLDT: Loaded 25339 existing records.
[2025-10-24T17:57:31.619071] [WARN ] [MAIN      ] CLDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:57:31.619871] [INFO ] [MAIN      ] CLDT: Wiping existing primary data before full refresh.
[2025-10-24T17:57:31.619936] [INFO ] [LOCAL     ] CLDT: Starting deletion of primary data.
[2025-10-24T17:57:31.621018] [DEBUG] [LOCAL     ] CLDT: Deleted primary data file.
[2025-10-24T17:57:31.621091] [INFO ] [MAIN      ] CLDT: Starting full primary refresh.
[2025-10-24T17:57:32.003406] [INFO ] [REMOTE    ] CLDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:57:32.075138] [INFO ] [REMOTE    ] CLB: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T17:57:32.147631] [INFO ] [REMOTE    ] CL: Fetching primary data for 2025-08.
[2025-10-24T17:57:32.201958] [INFO ] [REMOTE    ] CLCO: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T17:57:32.947712] [INFO ] [REMOTE    ] CLCO: Fetching primary data for 2025-06.
[2025-10-24T17:57:33.747680] [INFO ] [REMOTE    ] CLB: Fetching primary data for 2025-05.
[2025-10-24T17:57:34.105574] [INFO ] [REMOTE    ] CL: Incremental fetch complete for 2025-08 (1.96 seconds).
[2025-10-24T17:57:34.127107] [INFO ] [REMOTE    ] CLCO: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T17:57:34.547693] [INFO ] [REMOTE    ] CL: Fetching primary data for 2025-09.
[2025-10-24T17:57:35.253820] [INFO ] [REMOTE    ] CLB: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T17:57:35.347613] [INFO ] [REMOTE    ] CLCO: Fetching primary data for 2025-07.
[2025-10-24T17:57:36.136944] [INFO ] [REMOTE    ] CLCO: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T17:57:36.138587] [INFO ] [REMOTE    ] CL: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T17:57:36.151530] [INFO ] [REMOTE    ] CLDT: Fetching primary data for 2025-01.
[2025-10-24T17:57:36.947602] [INFO ] [REMOTE    ] CL: Fetching primary data for 2025-10.
[2025-10-24T17:57:37.357758] [INFO ] [REMOTE    ] CLDT: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T17:57:37.747710] [INFO ] [REMOTE    ] CLB: Fetching primary data for 2025-06.
[2025-10-24T17:57:38.547613] [INFO ] [REMOTE    ] CLDT: Fetching primary data for 2025-02.
[2025-10-24T17:57:39.012946] [INFO ] [REMOTE    ] CLB: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T17:57:39.117395] [INFO ] [REMOTE    ] CL: Incremental fetch complete for 2025-10 (2.17 seconds).
[2025-10-24T17:57:39.128873] [INFO ] [REMOTE    ] CL: Full fetch complete (77818 records).
[2025-10-24T17:57:39.129063] [DEBUG] [VALIDATOR ] CL: Validating primary data.
[2025-10-24T17:57:39.357974] [INFO ] [REMOTE    ] CLCO: Fetching primary data for 2025-08.
[2025-10-24T17:57:39.525708] [DEBUG] [VALIDATOR ] CL: All expected trading days are present.
[2025-10-24T17:57:39.525798] [DEBUG] [VALIDATOR ] CL: Primary data validation passed.
[2025-10-24T17:57:39.526726] [INFO ] [MAIN      ] CL: Fetched primary data is valid.
[2025-10-24T17:57:39.526789] [DEBUG] [LOCAL     ] CL: Saving primary data.
[2025-10-24T17:57:39.527472] [FATAL] [LOCAL     ] CL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:57:39.527564] [FATAL] [MAIN      ] CL: Failed to save primary data.
[2025-10-24T17:57:39.527605] [WARN ] [MAIN      ] CL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:57:39.527690] [INFO ] [LOCAL     ] CL: Starting deletion of primary data.
[2025-10-24T17:57:39.527760] [DEBUG] [LOCAL     ] CL: No primary data file found to delete.
[2025-10-24T17:57:39.527795] [INFO ] [LOCAL     ] CL: Starting deletion of derivative data.
[2025-10-24T17:57:39.527964] [DEBUG] [LOCAL     ] CL: Deleted derivative data file.
[2025-10-24T17:57:39.528710] [INFO ] [MAIN      ] Update Progress: 461/2366 symbols completed. CL took 39.3s. Estimated remaining: 3h 58m 4s. Rate: 8.0 symbols/min
[2025-10-24T17:57:39.711918] [INFO ] [MAIN      ] CLF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:57:39.709729] [INFO ] [REMOTE    ] CLDT: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T17:57:39.767916] [DEBUG] [LOCAL     ] CLF: Loaded 54131 existing records from primary storage.
[2025-10-24T17:57:39.768224] [INFO ] [MAIN      ] CLF: Loaded 54131 existing records.
[2025-10-24T17:57:39.946140] [WARN ] [MAIN      ] CLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:57:39.946381] [INFO ] [MAIN      ] CLF: Wiping existing primary data before full refresh.
[2025-10-24T17:57:39.946431] [INFO ] [LOCAL     ] CLF: Starting deletion of primary data.
[2025-10-24T17:57:39.947014] [DEBUG] [LOCAL     ] CLF: Deleted primary data file.
[2025-10-24T17:57:39.947071] [INFO ] [MAIN      ] CLF: Starting full primary refresh.
[2025-10-24T17:57:40.086617] [INFO ] [REMOTE    ] CLCO: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T17:57:40.152758] [INFO ] [REMOTE    ] CLDT: Fetching primary data for 2025-03.
[2025-10-24T17:57:40.323115] [INFO ] [REMOTE    ] CLF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:57:40.947689] [INFO ] [REMOTE    ] CLB: Fetching primary data for 2025-07.
[2025-10-24T17:57:41.318703] [INFO ] [REMOTE    ] CLDT: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T17:57:41.747628] [INFO ] [REMOTE    ] CLDT: Fetching primary data for 2025-04.
[2025-10-24T17:57:42.348755] [INFO ] [REMOTE    ] CLB: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T17:57:42.547680] [INFO ] [REMOTE    ] CLCO: Fetching primary data for 2025-09.
[2025-10-24T17:57:42.784673] [INFO ] [REMOTE    ] CLDT: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T17:57:43.132488] [INFO ] [REMOTE    ] CLCO: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T17:57:43.347672] [INFO ] [REMOTE    ] CLDT: Fetching primary data for 2025-05.
[2025-10-24T17:57:44.147627] [INFO ] [REMOTE    ] CLF: Fetching primary data for 2025-01.
[2025-10-24T17:57:44.448511] [INFO ] [REMOTE    ] CLDT: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T17:57:44.947676] [INFO ] [REMOTE    ] CLCO: Fetching primary data for 2025-10.
[2025-10-24T17:57:45.747639] [INFO ] [REMOTE    ] CLB: Fetching primary data for 2025-08.
[2025-10-24T17:57:46.114635] [INFO ] [REMOTE    ] CLF: Incremental fetch complete for 2025-01 (1.97 seconds).
[2025-10-24T17:57:46.219705] [INFO ] [REMOTE    ] CLCO: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T17:57:46.227047] [INFO ] [REMOTE    ] CLCO: Full fetch complete (22769 records).
[2025-10-24T17:57:46.227268] [DEBUG] [VALIDATOR ] CLCO: Validating primary data.
[2025-10-24T17:57:46.556069] [INFO ] [REMOTE    ] CLDT: Fetching primary data for 2025-06.
[2025-10-24T17:57:46.737136] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present.
[2025-10-24T17:57:46.737271] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed.
[2025-10-24T17:57:46.737760] [INFO ] [MAIN      ] CLCO: Fetched primary data is valid.
[2025-10-24T17:57:46.737825] [DEBUG] [LOCAL     ] CLCO: Saving primary data.
[2025-10-24T17:57:46.738250] [FATAL] [LOCAL     ] CLCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:57:46.738337] [FATAL] [MAIN      ] CLCO: Failed to save primary data.
[2025-10-24T17:57:46.738384] [WARN ] [MAIN      ] CLCO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:57:46.738419] [INFO ] [LOCAL     ] CLCO: Starting deletion of primary data.
[2025-10-24T17:57:46.738474] [DEBUG] [LOCAL     ] CLCO: No primary data file found to delete.
[2025-10-24T17:57:46.738557] [INFO ] [LOCAL     ] CLCO: Starting deletion of derivative data.
[2025-10-24T17:57:46.738776] [DEBUG] [LOCAL     ] CLCO: Deleted derivative data file.
[2025-10-24T17:57:46.738892] [INFO ] [MAIN      ] Update Progress: 462/2366 symbols completed. CLCO took 25.2s. Estimated remaining: 3h 57m 55s. Rate: 8.0 symbols/min
[2025-10-24T17:57:46.964025] [INFO ] [MAIN      ] CLH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:57:46.993018] [DEBUG] [LOCAL     ] CLH: Loaded 27786 existing records from primary storage.
[2025-10-24T17:57:46.993362] [INFO ] [MAIN      ] CLH: Loaded 27786 existing records.
[2025-10-24T17:57:47.190327] [WARN ] [MAIN      ] CLH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:57:47.190910] [INFO ] [MAIN      ] CLH: Wiping existing primary data before full refresh.
[2025-10-24T17:57:47.191024] [INFO ] [LOCAL     ] CLH: Starting deletion of primary data.
[2025-10-24T17:57:47.191848] [DEBUG] [LOCAL     ] CLH: Deleted primary data file.
[2025-10-24T17:57:47.191914] [INFO ] [MAIN      ] CLH: Starting full primary refresh.
[2025-10-24T17:57:47.371563] [INFO ] [REMOTE    ] CLB: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T17:57:47.380121] [INFO ] [REMOTE    ] CLF: Fetching primary data for 2025-02.
[2025-10-24T17:57:47.595767] [INFO ] [REMOTE    ] CLH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:57:47.839739] [INFO ] [REMOTE    ] CLDT: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T17:57:48.147639] [INFO ] [REMOTE    ] CLB: Fetching primary data for 2025-09.
[2025-10-24T17:57:48.947635] [INFO ] [REMOTE    ] CLH: Fetching primary data for 2025-01.
[2025-10-24T17:57:49.292859] [INFO ] [REMOTE    ] CLB: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T17:57:49.596991] [INFO ] [REMOTE    ] CLF: Incremental fetch complete for 2025-02 (2.22 seconds).
[2025-10-24T17:57:49.747632] [INFO ] [REMOTE    ] CLF: Fetching primary data for 2025-03.
[2025-10-24T17:57:50.307162] [INFO ] [REMOTE    ] CLH: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T17:57:50.547752] [INFO ] [REMOTE    ] CLB: Fetching primary data for 2025-10.
[2025-10-24T17:57:51.347629] [INFO ] [REMOTE    ] CLH: Fetching primary data for 2025-02.
[2025-10-24T17:57:51.529768] [INFO ] [REMOTE    ] CLF: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T17:57:51.993355] [INFO ] [REMOTE    ] CLB: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T17:57:52.000114] [INFO ] [REMOTE    ] CLB: Full fetch complete (47526 records).
[2025-10-24T17:57:52.000207] [DEBUG] [VALIDATOR ] CLB: Validating primary data.
[2025-10-24T17:57:52.149739] [INFO ] [REMOTE    ] CLF: Fetching primary data for 2025-04.
[2025-10-24T17:57:52.375597] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present.
[2025-10-24T17:57:52.375702] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed.
[2025-10-24T17:57:52.376307] [INFO ] [MAIN      ] CLB: Fetched primary data is valid.
[2025-10-24T17:57:52.376347] [DEBUG] [LOCAL     ] CLB: Saving primary data.
[2025-10-24T17:57:52.376748] [FATAL] [LOCAL     ] CLB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:57:52.376829] [FATAL] [MAIN      ] CLB: Failed to save primary data.
[2025-10-24T17:57:52.376870] [WARN ] [MAIN      ] CLB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:57:52.376904] [INFO ] [LOCAL     ] CLB: Starting deletion of primary data.
[2025-10-24T17:57:52.376954] [DEBUG] [LOCAL     ] CLB: No primary data file found to delete.
[2025-10-24T17:57:52.376988] [INFO ] [LOCAL     ] CLB: Starting deletion of derivative data.
[2025-10-24T17:57:52.377119] [DEBUG] [LOCAL     ] CLB: Deleted derivative data file.
[2025-10-24T17:57:52.377209] [INFO ] [MAIN      ] Update Progress: 463/2366 symbols completed. CLB took 32.0s. Estimated remaining: 3h 57m 40s. Rate: 8.0 symbols/min
[2025-10-24T17:57:52.548559] [INFO ] [MAIN      ] CLPR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:57:52.559429] [DEBUG] [LOCAL     ] CLPR: Loaded 10044 existing records from primary storage.
[2025-10-24T17:57:52.559779] [INFO ] [MAIN      ] CLPR: Loaded 10044 existing records.
[2025-10-24T17:57:52.703860] [INFO ] [REMOTE    ] CLH: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T17:57:52.760361] [WARN ] [MAIN      ] CLPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:57:52.760540] [INFO ] [MAIN      ] CLPR: Wiping existing primary data before full refresh.
[2025-10-24T17:57:52.760586] [INFO ] [LOCAL     ] CLPR: Starting deletion of primary data.
[2025-10-24T17:57:52.760886] [DEBUG] [LOCAL     ] CLPR: Deleted primary data file.
[2025-10-24T17:57:52.760942] [INFO ] [MAIN      ] CLPR: Starting full primary refresh.
[2025-10-24T17:57:52.957545] [INFO ] [REMOTE    ] CLDT: Fetching primary data for 2025-07.
[2025-10-24T17:57:53.112708] [INFO ] [REMOTE    ] CLPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:57:53.747604] [INFO ] [REMOTE    ] CLPR: Fetching primary data for 2025-01.
[2025-10-24T17:57:53.976139] [INFO ] [REMOTE    ] CLDT: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T17:57:54.094246] [INFO ] [REMOTE    ] CLF: Incremental fetch complete for 2025-04 (1.94 seconds).
[2025-10-24T17:57:54.390706] [INFO ] [REMOTE    ] CLPR: Incremental fetch complete for 2025-01 (0.64 seconds).
[2025-10-24T17:57:54.547632] [INFO ] [REMOTE    ] CLDT: Fetching primary data for 2025-08.
[2025-10-24T17:57:55.347691] [INFO ] [REMOTE    ] CLF: Fetching primary data for 2025-05.
[2025-10-24T17:57:55.361682] [INFO ] [REMOTE    ] CLDT: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T17:57:56.147638] [INFO ] [REMOTE    ] CLPR: Fetching primary data for 2025-02.
[2025-10-24T17:57:56.725848] [INFO ] [REMOTE    ] CLPR: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T17:57:56.947636] [INFO ] [REMOTE    ] CLH: Fetching primary data for 2025-03.
[2025-10-24T17:57:57.497263] [INFO ] [REMOTE    ] CLF: Incremental fetch complete for 2025-05 (2.15 seconds).
[2025-10-24T17:57:57.747623] [INFO ] [REMOTE    ] CLF: Fetching primary data for 2025-06.
[2025-10-24T17:57:58.145184] [INFO ] [REMOTE    ] CLH: Incremental fetch complete for 2025-03 (1.20 seconds).
[2025-10-24T17:57:58.547631] [INFO ] [REMOTE    ] CLH: Fetching primary data for 2025-04.
[2025-10-24T17:57:59.347737] [INFO ] [REMOTE    ] CLPR: Fetching primary data for 2025-03.
[2025-10-24T17:57:59.788798] [INFO ] [REMOTE    ] CLF: Incremental fetch complete for 2025-06 (2.04 seconds).
[2025-10-24T17:57:59.863848] [INFO ] [REMOTE    ] CLH: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T17:58:00.040978] [INFO ] [REMOTE    ] CLPR: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T17:58:00.147694] [INFO ] [REMOTE    ] CLF: Fetching primary data for 2025-07.
[2025-10-24T17:58:00.947673] [INFO ] [REMOTE    ] CLPR: Fetching primary data for 2025-04.
[2025-10-24T17:58:01.747757] [INFO ] [REMOTE    ] CLH: Fetching primary data for 2025-05.
[2025-10-24T17:58:02.544672] [INFO ] [REMOTE    ] CLF: Incremental fetch complete for 2025-07 (2.40 seconds).
[2025-10-24T17:58:02.555881] [INFO ] [REMOTE    ] CLDT: Fetching primary data for 2025-09.
[2025-10-24T17:58:02.932534] [INFO ] [REMOTE    ] CLPR: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T17:58:03.347668] [INFO ] [REMOTE    ] CLPR: Fetching primary data for 2025-05.
[2025-10-24T17:58:03.721325] [INFO ] [REMOTE    ] CLDT: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T17:58:04.037594] [INFO ] [REMOTE    ] CLH: Incremental fetch complete for 2025-05 (2.29 seconds).
[2025-10-24T17:58:04.101463] [INFO ] [REMOTE    ] CLPR: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T17:58:04.147691] [INFO ] [REMOTE    ] CLF: Fetching primary data for 2025-08.
[2025-10-24T17:58:04.947676] [INFO ] [REMOTE    ] CLPR: Fetching primary data for 2025-06.
[2025-10-24T17:58:05.747723] [INFO ] [REMOTE    ] CLH: Fetching primary data for 2025-06.
[2025-10-24T17:58:06.006747] [INFO ] [REMOTE    ] CLPR: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T17:58:06.223784] [INFO ] [REMOTE    ] CLF: Incremental fetch complete for 2025-08 (2.08 seconds).
[2025-10-24T17:58:06.547629] [INFO ] [REMOTE    ] CLDT: Fetching primary data for 2025-10.
[2025-10-24T17:58:06.793955] [INFO ] [REMOTE    ] CLH: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T17:58:07.347666] [INFO ] [REMOTE    ] CLF: Fetching primary data for 2025-09.
[2025-10-24T17:58:07.771400] [INFO ] [REMOTE    ] CLDT: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T17:58:07.777046] [INFO ] [REMOTE    ] CLDT: Full fetch complete (37469 records).
[2025-10-24T17:58:07.777158] [DEBUG] [VALIDATOR ] CLDT: Validating primary data.
[2025-10-24T17:58:07.777792] [FATAL] [VALIDATOR ] CLDT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T17:58:07.777899] [FATAL] [MAIN      ] CLDT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T17:58:07.777980] [WARN ] [MAIN      ] CLDT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T17:58:07.778054] [INFO ] [LOCAL     ] CLDT: Starting deletion of primary data.
[2025-10-24T17:58:07.778120] [DEBUG] [LOCAL     ] CLDT: No primary data file found to delete.
[2025-10-24T17:58:07.778158] [INFO ] [LOCAL     ] CLDT: Starting deletion of derivative data.
[2025-10-24T17:58:07.778280] [DEBUG] [LOCAL     ] CLDT: Deleted derivative data file.
[2025-10-24T17:58:07.778363] [INFO ] [MAIN      ] Update Progress: 464/2366 symbols completed. CLDT took 36.5s. Estimated remaining: 3h 58m 5s. Rate: 8.0 symbols/min
[2025-10-24T17:58:07.955589] [INFO ] [MAIN      ] CLS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:58:07.955826] [DEBUG] [LOCAL     ] CLS: No existing data file found in primary storage.
[2025-10-24T17:58:07.955869] [WARN ] [MAIN      ] CLS: No existing data found, performing full refresh instead.
[2025-10-24T17:58:07.956002] [INFO ] [MAIN      ] CLS: Wiping existing primary data before full refresh.
[2025-10-24T17:58:07.956061] [INFO ] [LOCAL     ] CLS: Starting deletion of primary data.
[2025-10-24T17:58:07.956107] [DEBUG] [LOCAL     ] CLS: No primary data file found to delete.
[2025-10-24T17:58:07.956142] [INFO ] [MAIN      ] CLS: Starting full primary refresh.
[2025-10-24T17:58:08.155579] [INFO ] [REMOTE    ] CLH: Fetching primary data for 2025-07.
[2025-10-24T17:58:08.341050] [INFO ] [REMOTE    ] CLS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:58:08.947637] [INFO ] [REMOTE    ] CLPR: Fetching primary data for 2025-07.
[2025-10-24T17:58:09.027757] [INFO ] [REMOTE    ] CLF: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T17:58:09.451996] [INFO ] [REMOTE    ] CLH: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T17:58:09.486498] [INFO ] [REMOTE    ] CLPR: Incremental fetch complete for 2025-07 (0.54 seconds).
[2025-10-24T17:58:09.747749] [INFO ] [REMOTE    ] CLS: Fetching primary data for 2025-01.
[2025-10-24T17:58:10.547715] [INFO ] [REMOTE    ] CLPR: Fetching primary data for 2025-08.
[2025-10-24T17:58:11.166947] [INFO ] [REMOTE    ] CLPR: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T17:58:11.347667] [INFO ] [REMOTE    ] CLPR: Fetching primary data for 2025-09.
[2025-10-24T17:58:11.943899] [INFO ] [REMOTE    ] CLPR: Incremental fetch complete for 2025-09 (0.60 seconds).
[2025-10-24T17:58:12.110344] [INFO ] [REMOTE    ] CLS: Incremental fetch complete for 2025-01 (2.36 seconds).
[2025-10-24T17:58:12.147619] [INFO ] [REMOTE    ] CLS: Fetching primary data for 2025-02.
[2025-10-24T17:58:12.947708] [INFO ] [REMOTE    ] CLF: Fetching primary data for 2025-10.
[2025-10-24T17:58:13.747710] [INFO ] [REMOTE    ] CLH: Fetching primary data for 2025-08.
[2025-10-24T17:58:14.162920] [INFO ] [REMOTE    ] CLS: Incremental fetch complete for 2025-02 (2.02 seconds).
[2025-10-24T17:58:14.547691] [INFO ] [REMOTE    ] CLS: Fetching primary data for 2025-03.
[2025-10-24T17:58:14.942323] [INFO ] [REMOTE    ] CLH: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T17:58:15.132798] [INFO ] [REMOTE    ] CLF: Incremental fetch complete for 2025-10 (2.19 seconds).
[2025-10-24T17:58:15.142750] [INFO ] [REMOTE    ] CLF: Full fetch complete (77918 records).
[2025-10-24T17:58:15.142916] [DEBUG] [VALIDATOR ] CLF: Validating primary data.
[2025-10-24T17:58:15.353400] [INFO ] [REMOTE    ] CLH: Fetching primary data for 2025-09.
[2025-10-24T17:58:15.536703] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present.
[2025-10-24T17:58:15.536806] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed.
[2025-10-24T17:58:15.537725] [INFO ] [MAIN      ] CLF: Fetched primary data is valid.
[2025-10-24T17:58:15.537799] [DEBUG] [LOCAL     ] CLF: Saving primary data.
[2025-10-24T17:58:15.538505] [FATAL] [LOCAL     ] CLF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:58:15.538601] [FATAL] [MAIN      ] CLF: Failed to save primary data.
[2025-10-24T17:58:15.538666] [WARN ] [MAIN      ] CLF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:58:15.538729] [INFO ] [LOCAL     ] CLF: Starting deletion of primary data.
[2025-10-24T17:58:15.538787] [DEBUG] [LOCAL     ] CLF: No primary data file found to delete.
[2025-10-24T17:58:15.538822] [INFO ] [LOCAL     ] CLF: Starting deletion of derivative data.
[2025-10-24T17:58:15.538965] [DEBUG] [LOCAL     ] CLF: Deleted derivative data file.
[2025-10-24T17:58:15.539280] [INFO ] [MAIN      ] Update Progress: 465/2366 symbols completed. CLF took 36.0s. Estimated remaining: 3h 57m 59s. Rate: 8.0 symbols/min
[2025-10-24T17:58:15.713634] [INFO ] [MAIN      ] CLVT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:58:15.760774] [DEBUG] [LOCAL     ] CLVT: Loaded 52276 existing records from primary storage.
[2025-10-24T17:58:15.761084] [INFO ] [MAIN      ] CLVT: Loaded 52276 existing records.
[2025-10-24T17:58:15.940013] [WARN ] [MAIN      ] CLVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:58:15.940276] [INFO ] [MAIN      ] CLVT: Wiping existing primary data before full refresh.
[2025-10-24T17:58:15.940329] [INFO ] [LOCAL     ] CLVT: Starting deletion of primary data.
[2025-10-24T17:58:15.940638] [DEBUG] [LOCAL     ] CLVT: Deleted primary data file.
[2025-10-24T17:58:15.940750] [INFO ] [MAIN      ] CLVT: Starting full primary refresh.
[2025-10-24T17:58:16.153444] [INFO ] [REMOTE    ] CLPR: Fetching primary data for 2025-10.
[2025-10-24T17:58:16.308993] [INFO ] [REMOTE    ] CLVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:58:16.392601] [INFO ] [REMOTE    ] CLH: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T17:58:16.920749] [INFO ] [REMOTE    ] CLS: Incremental fetch complete for 2025-03 (2.37 seconds).
[2025-10-24T17:58:16.947626] [INFO ] [REMOTE    ] CLVT: Fetching primary data for 2025-01.
[2025-10-24T17:58:17.253377] [INFO ] [REMOTE    ] CLPR: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T17:58:17.255353] [INFO ] [REMOTE    ] CLPR: Full fetch complete (15774 records).
[2025-10-24T17:58:17.255431] [DEBUG] [VALIDATOR ] CLPR: Validating primary data.
[2025-10-24T17:58:17.645140] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present.
[2025-10-24T17:58:17.645220] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed.
[2025-10-24T17:58:17.645554] [INFO ] [MAIN      ] CLPR: Fetched primary data is valid.
[2025-10-24T17:58:17.645612] [DEBUG] [LOCAL     ] CLPR: Saving primary data.
[2025-10-24T17:58:17.645883] [FATAL] [LOCAL     ] CLPR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:58:17.645964] [FATAL] [MAIN      ] CLPR: Failed to save primary data.
[2025-10-24T17:58:17.646005] [WARN ] [MAIN      ] CLPR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:58:17.646039] [INFO ] [LOCAL     ] CLPR: Starting deletion of primary data.
[2025-10-24T17:58:17.646087] [DEBUG] [LOCAL     ] CLPR: No primary data file found to delete.
[2025-10-24T17:58:17.646125] [INFO ] [LOCAL     ] CLPR: Starting deletion of derivative data.
[2025-10-24T17:58:17.646276] [DEBUG] [LOCAL     ] CLPR: Deleted derivative data file.
[2025-10-24T17:58:17.646360] [INFO ] [MAIN      ] Update Progress: 466/2366 symbols completed. CLPR took 25.3s. Estimated remaining: 3h 57m 29s. Rate: 8.0 symbols/min
[2025-10-24T17:58:17.749136] [INFO ] [REMOTE    ] CLS: Fetching primary data for 2025-04.
[2025-10-24T17:58:17.820006] [INFO ] [MAIN      ] CLW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:58:17.840171] [DEBUG] [LOCAL     ] CLW: Loaded 21377 existing records from primary storage.
[2025-10-24T17:58:17.840411] [INFO ] [MAIN      ] CLW: Loaded 21377 existing records.
[2025-10-24T17:58:18.023412] [WARN ] [MAIN      ] CLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:58:18.023664] [INFO ] [MAIN      ] CLW: Wiping existing primary data before full refresh.
[2025-10-24T17:58:18.023726] [INFO ] [LOCAL     ] CLW: Starting deletion of primary data.
[2025-10-24T17:58:18.024138] [DEBUG] [LOCAL     ] CLW: Deleted primary data file.
[2025-10-24T17:58:18.024195] [INFO ] [MAIN      ] CLW: Starting full primary refresh.
[2025-10-24T17:58:18.395774] [INFO ] [REMOTE    ] CLW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:58:18.547683] [INFO ] [REMOTE    ] CLW: Fetching primary data for 2025-01.
[2025-10-24T17:58:18.596948] [INFO ] [REMOTE    ] CLVT: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T17:58:19.347705] [INFO ] [REMOTE    ] CLVT: Fetching primary data for 2025-02.
[2025-10-24T17:58:19.853933] [INFO ] [REMOTE    ] CLW: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T17:58:19.893055] [INFO ] [REMOTE    ] CLS: Incremental fetch complete for 2025-04 (2.14 seconds).
[2025-10-24T17:58:20.147713] [INFO ] [REMOTE    ] CLS: Fetching primary data for 2025-05.
[2025-10-24T17:58:20.781683] [INFO ] [REMOTE    ] CLVT: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T17:58:20.947627] [INFO ] [REMOTE    ] CLVT: Fetching primary data for 2025-03.
[2025-10-24T17:58:21.747679] [INFO ] [REMOTE    ] CLH: Fetching primary data for 2025-10.
[2025-10-24T17:58:22.363637] [INFO ] [REMOTE    ] CLS: Incremental fetch complete for 2025-05 (2.22 seconds).
[2025-10-24T17:58:22.547611] [INFO ] [REMOTE    ] CLS: Fetching primary data for 2025-06.
[2025-10-24T17:58:22.638460] [INFO ] [REMOTE    ] CLVT: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T17:58:23.240383] [INFO ] [REMOTE    ] CLH: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T17:58:23.246276] [INFO ] [REMOTE    ] CLH: Full fetch complete (42253 records).
[2025-10-24T17:58:23.246409] [DEBUG] [VALIDATOR ] CLH: Validating primary data.
[2025-10-24T17:58:23.348544] [INFO ] [REMOTE    ] CLW: Fetching primary data for 2025-02.
[2025-10-24T17:58:23.621607] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present.
[2025-10-24T17:58:23.621715] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed.
[2025-10-24T17:58:23.622277] [INFO ] [MAIN      ] CLH: Fetched primary data is valid.
[2025-10-24T17:58:23.622316] [DEBUG] [LOCAL     ] CLH: Saving primary data.
[2025-10-24T17:58:23.622721] [FATAL] [LOCAL     ] CLH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:58:23.622823] [FATAL] [MAIN      ] CLH: Failed to save primary data.
[2025-10-24T17:58:23.622867] [WARN ] [MAIN      ] CLH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:58:23.622926] [INFO ] [LOCAL     ] CLH: Starting deletion of primary data.
[2025-10-24T17:58:23.622982] [DEBUG] [LOCAL     ] CLH: No primary data file found to delete.
[2025-10-24T17:58:23.623016] [INFO ] [LOCAL     ] CLH: Starting deletion of derivative data.
[2025-10-24T17:58:23.623138] [DEBUG] [LOCAL     ] CLH: Deleted derivative data file.
[2025-10-24T17:58:23.623212] [INFO ] [MAIN      ] Update Progress: 467/2366 symbols completed. CLH took 36.9s. Estimated remaining: 3h 57m 15s. Rate: 8.0 symbols/min
[2025-10-24T17:58:23.792583] [INFO ] [MAIN      ] CLX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:58:23.843447] [DEBUG] [LOCAL     ] CLX: Loaded 52189 existing records from primary storage.
[2025-10-24T17:58:23.843813] [INFO ] [MAIN      ] CLX: Loaded 52189 existing records.
[2025-10-24T17:58:24.024065] [WARN ] [MAIN      ] CLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:58:24.024333] [INFO ] [MAIN      ] CLX: Wiping existing primary data before full refresh.
[2025-10-24T17:58:24.024388] [INFO ] [LOCAL     ] CLX: Starting deletion of primary data.
[2025-10-24T17:58:24.024720] [DEBUG] [LOCAL     ] CLX: Deleted primary data file.
[2025-10-24T17:58:24.024776] [INFO ] [MAIN      ] CLX: Starting full primary refresh.
[2025-10-24T17:58:24.166491] [INFO ] [REMOTE    ] CLVT: Fetching primary data for 2025-04.
[2025-10-24T17:58:24.397478] [INFO ] [REMOTE    ] CLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:58:24.547491] [INFO ] [REMOTE    ] CLW: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T17:58:24.628050] [INFO ] [REMOTE    ] CLS: Incremental fetch complete for 2025-06 (2.08 seconds).
[2025-10-24T17:58:24.947680] [INFO ] [REMOTE    ] CLS: Fetching primary data for 2025-07.
[2025-10-24T17:58:25.744846] [INFO ] [REMOTE    ] CLVT: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T17:58:25.754845] [INFO ] [REMOTE    ] CLW: Fetching primary data for 2025-03.
[2025-10-24T17:58:26.547624] [INFO ] [REMOTE    ] CLX: Fetching primary data for 2025-01.
[2025-10-24T17:58:26.830405] [INFO ] [REMOTE    ] CLW: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T17:58:27.346415] [INFO ] [REMOTE    ] CLS: Incremental fetch complete for 2025-07 (2.40 seconds).
[2025-10-24T17:58:27.357213] [INFO ] [REMOTE    ] CLVT: Fetching primary data for 2025-05.
[2025-10-24T17:58:28.147716] [INFO ] [REMOTE    ] CLS: Fetching primary data for 2025-08.
[2025-10-24T17:58:28.224284] [INFO ] [REMOTE    ] CLX: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T17:58:28.947635] [INFO ] [REMOTE    ] CLX: Fetching primary data for 2025-02.
[2025-10-24T17:58:29.195104] [INFO ] [REMOTE    ] CLVT: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T17:58:29.747636] [INFO ] [REMOTE    ] CLW: Fetching primary data for 2025-04.
[2025-10-24T17:58:30.471473] [INFO ] [REMOTE    ] CLS: Incremental fetch complete for 2025-08 (2.32 seconds).
[2025-10-24T17:58:30.508423] [INFO ] [REMOTE    ] CLX: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T17:58:30.547603] [INFO ] [REMOTE    ] CLX: Fetching primary data for 2025-03.
[2025-10-24T17:58:30.699120] [INFO ] [REMOTE    ] CLW: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T17:58:31.347672] [INFO ] [REMOTE    ] CLVT: Fetching primary data for 2025-06.
[2025-10-24T17:58:32.147621] [INFO ] [REMOTE    ] CLS: Fetching primary data for 2025-09.
[2025-10-24T17:58:32.226291] [INFO ] [REMOTE    ] CLX: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T17:58:32.947629] [INFO ] [REMOTE    ] CLX: Fetching primary data for 2025-04.
[2025-10-24T17:58:33.101444] [INFO ] [REMOTE    ] CLVT: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T17:58:33.747760] [INFO ] [REMOTE    ] CLVT: Fetching primary data for 2025-07.
[2025-10-24T17:58:34.547926] [INFO ] [REMOTE    ] CLW: Fetching primary data for 2025-05.
[2025-10-24T17:58:34.684593] [INFO ] [REMOTE    ] CLX: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T17:58:34.725927] [INFO ] [REMOTE    ] CLS: Incremental fetch complete for 2025-09 (2.58 seconds).
[2025-10-24T17:58:35.127010] [INFO ] [REMOTE    ] CLVT: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T17:58:35.317706] [INFO ] [REMOTE    ] CLW: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T17:58:35.347696] [INFO ] [REMOTE    ] CLW: Fetching primary data for 2025-06.
[2025-10-24T17:58:36.147623] [INFO ] [REMOTE    ] CLX: Fetching primary data for 2025-05.
[2025-10-24T17:58:36.387054] [INFO ] [REMOTE    ] CLW: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T17:58:36.947677] [INFO ] [REMOTE    ] CLVT: Fetching primary data for 2025-08.
[2025-10-24T17:58:37.747618] [INFO ] [REMOTE    ] CLS: Fetching primary data for 2025-10.
[2025-10-24T17:58:37.879085] [INFO ] [REMOTE    ] CLX: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T17:58:38.547618] [INFO ] [REMOTE    ] CLW: Fetching primary data for 2025-07.
[2025-10-24T17:58:38.708284] [INFO ] [REMOTE    ] CLVT: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T17:58:39.203612] [INFO ] [REMOTE    ] CLW: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T17:58:39.347675] [INFO ] [REMOTE    ] CLX: Fetching primary data for 2025-06.
[2025-10-24T17:58:40.056249] [INFO ] [REMOTE    ] CLS: Incremental fetch complete for 2025-10 (2.31 seconds).
[2025-10-24T17:58:40.065840] [INFO ] [REMOTE    ] CLS: Full fetch complete (77702 records).
[2025-10-24T17:58:40.065966] [DEBUG] [VALIDATOR ] CLS: Validating primary data.
[2025-10-24T17:58:40.152858] [INFO ] [REMOTE    ] CLW: Fetching primary data for 2025-08.
[2025-10-24T17:58:40.461332] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present.
[2025-10-24T17:58:40.461434] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed.
[2025-10-24T17:58:40.462309] [INFO ] [MAIN      ] CLS: Fetched primary data is valid.
[2025-10-24T17:58:40.462372] [DEBUG] [LOCAL     ] CLS: Saving primary data.
[2025-10-24T17:58:40.463071] [FATAL] [LOCAL     ] CLS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:58:40.463165] [FATAL] [MAIN      ] CLS: Failed to save primary data.
[2025-10-24T17:58:40.463207] [WARN ] [MAIN      ] CLS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:58:40.463241] [INFO ] [LOCAL     ] CLS: Starting deletion of primary data.
[2025-10-24T17:58:40.463293] [DEBUG] [LOCAL     ] CLS: No primary data file found to delete.
[2025-10-24T17:58:40.463329] [INFO ] [LOCAL     ] CLS: Starting deletion of derivative data.
[2025-10-24T17:58:40.463368] [DEBUG] [LOCAL     ] CLS: No derivative data file found to delete.
[2025-10-24T17:58:40.463938] [INFO ] [MAIN      ] Update Progress: 468/2366 symbols completed. CLS took 32.7s. Estimated remaining: 3h 57m 46s. Rate: 8.0 symbols/min
[2025-10-24T17:58:40.636094] [INFO ] [MAIN      ] CM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:58:40.682559] [DEBUG] [LOCAL     ] CM: Loaded 48681 existing records from primary storage.
[2025-10-24T17:58:40.682932] [INFO ] [MAIN      ] CM: Loaded 48681 existing records.
[2025-10-24T17:58:40.867547] [WARN ] [MAIN      ] CM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:58:40.867905] [INFO ] [MAIN      ] CM: Wiping existing primary data before full refresh.
[2025-10-24T17:58:40.867974] [INFO ] [LOCAL     ] CM: Starting deletion of primary data.
[2025-10-24T17:58:40.868496] [DEBUG] [LOCAL     ] CM: Deleted primary data file.
[2025-10-24T17:58:40.868566] [INFO ] [MAIN      ] CM: Starting full primary refresh.
[2025-10-24T17:58:40.950861] [INFO ] [REMOTE    ] CLVT: Fetching primary data for 2025-09.
[2025-10-24T17:58:41.269022] [INFO ] [REMOTE    ] CM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:58:41.276031] [INFO ] [REMOTE    ] CLX: Incremental fetch complete for 2025-06 (1.93 seconds).
[2025-10-24T17:58:41.293758] [INFO ] [REMOTE    ] CLW: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T17:58:41.747687] [INFO ] [REMOTE    ] CM: Fetching primary data for 2025-01.
[2025-10-24T17:58:42.547685] [INFO ] [REMOTE    ] CLW: Fetching primary data for 2025-09.
[2025-10-24T17:58:42.625635] [INFO ] [REMOTE    ] CLVT: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T17:58:43.193111] [INFO ] [REMOTE    ] CM: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T17:58:43.347609] [INFO ] [REMOTE    ] CM: Fetching primary data for 2025-02.
[2025-10-24T17:58:43.466975] [INFO ] [REMOTE    ] CLW: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T17:58:44.147640] [INFO ] [REMOTE    ] CLX: Fetching primary data for 2025-07.
[2025-10-24T17:58:44.608892] [INFO ] [REMOTE    ] CM: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T17:58:44.947681] [INFO ] [REMOTE    ] CM: Fetching primary data for 2025-03.
[2025-10-24T17:58:45.747709] [INFO ] [REMOTE    ] CLW: Fetching primary data for 2025-10.
[2025-10-24T17:58:46.076514] [INFO ] [REMOTE    ] CLX: Incremental fetch complete for 2025-07 (1.93 seconds).
[2025-10-24T17:58:46.180096] [INFO ] [REMOTE    ] CM: Incremental fetch complete for 2025-03 (1.23 seconds).
[2025-10-24T17:58:46.547711] [INFO ] [REMOTE    ] CM: Fetching primary data for 2025-04.
[2025-10-24T17:58:46.868621] [INFO ] [REMOTE    ] CLW: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T17:58:46.872692] [INFO ] [REMOTE    ] CLW: Full fetch complete (33529 records).
[2025-10-24T17:58:46.872780] [DEBUG] [VALIDATOR ] CLW: Validating primary data.
[2025-10-24T17:58:47.259470] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present.
[2025-10-24T17:58:47.259573] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed.
[2025-10-24T17:58:47.260195] [INFO ] [MAIN      ] CLW: Fetched primary data is valid.
[2025-10-24T17:58:47.260259] [DEBUG] [LOCAL     ] CLW: Saving primary data.
[2025-10-24T17:58:47.260634] [FATAL] [LOCAL     ] CLW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:58:47.260748] [FATAL] [MAIN      ] CLW: Failed to save primary data.
[2025-10-24T17:58:47.260813] [WARN ] [MAIN      ] CLW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:58:47.260898] [INFO ] [LOCAL     ] CLW: Starting deletion of primary data.
[2025-10-24T17:58:47.260998] [DEBUG] [LOCAL     ] CLW: No primary data file found to delete.
[2025-10-24T17:58:47.261047] [INFO ] [LOCAL     ] CLW: Starting deletion of derivative data.
[2025-10-24T17:58:47.261204] [DEBUG] [LOCAL     ] CLW: Deleted derivative data file.
[2025-10-24T17:58:47.261296] [INFO ] [MAIN      ] Update Progress: 469/2366 symbols completed. CLW took 29.6s. Estimated remaining: 3h 57m 35s. Rate: 8.0 symbols/min
[2025-10-24T17:58:47.352901] [INFO ] [REMOTE    ] CLX: Fetching primary data for 2025-08.
[2025-10-24T17:58:47.454375] [INFO ] [MAIN      ] CMA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:58:47.505704] [DEBUG] [LOCAL     ] CMA: Loaded 50557 existing records from primary storage.
[2025-10-24T17:58:47.506016] [INFO ] [MAIN      ] CMA: Loaded 50557 existing records.
[2025-10-24T17:58:47.701505] [WARN ] [MAIN      ] CMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:58:47.701785] [INFO ] [MAIN      ] CMA: Wiping existing primary data before full refresh.
[2025-10-24T17:58:47.701869] [INFO ] [LOCAL     ] CMA: Starting deletion of primary data.
[2025-10-24T17:58:47.702352] [DEBUG] [LOCAL     ] CMA: Deleted primary data file.
[2025-10-24T17:58:47.702410] [INFO ] [MAIN      ] CMA: Starting full primary refresh.
[2025-10-24T17:58:48.070965] [INFO ] [REMOTE    ] CMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:58:48.111240] [INFO ] [REMOTE    ] CM: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T17:58:48.147604] [INFO ] [REMOTE    ] CLVT: Fetching primary data for 2025-10.
[2025-10-24T17:58:48.698946] [INFO ] [REMOTE    ] CLX: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T17:58:48.947676] [INFO ] [REMOTE    ] CMA: Fetching primary data for 2025-01.
[2025-10-24T17:58:49.747625] [INFO ] [REMOTE    ] CLX: Fetching primary data for 2025-09.
[2025-10-24T17:58:49.984339] [INFO ] [REMOTE    ] CLVT: Incremental fetch complete for 2025-10 (1.84 seconds).
[2025-10-24T17:58:49.995175] [INFO ] [REMOTE    ] CLVT: Full fetch complete (75369 records).
[2025-10-24T17:58:49.995355] [DEBUG] [VALIDATOR ] CLVT: Validating primary data.
[2025-10-24T17:58:50.411934] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present.
[2025-10-24T17:58:50.412042] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed.
[2025-10-24T17:58:50.412990] [INFO ] [MAIN      ] CLVT: Fetched primary data is valid.
[2025-10-24T17:58:50.413059] [DEBUG] [LOCAL     ] CLVT: Saving primary data.
[2025-10-24T17:58:50.413751] [FATAL] [LOCAL     ] CLVT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:58:50.413848] [FATAL] [MAIN      ] CLVT: Failed to save primary data.
[2025-10-24T17:58:50.413890] [WARN ] [MAIN      ] CLVT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:58:50.413926] [INFO ] [LOCAL     ] CLVT: Starting deletion of primary data.
[2025-10-24T17:58:50.413981] [DEBUG] [LOCAL     ] CLVT: No primary data file found to delete.
[2025-10-24T17:58:50.414016] [INFO ] [LOCAL     ] CLVT: Starting deletion of derivative data.
[2025-10-24T17:58:50.414229] [DEBUG] [LOCAL     ] CLVT: Deleted derivative data file.
[2025-10-24T17:58:50.414764] [INFO ] [MAIN      ] Update Progress: 470/2366 symbols completed. CLVT took 34.9s. Estimated remaining: 3h 57m 10s. Rate: 8.0 symbols/min
[2025-10-24T17:58:50.557371] [INFO ] [REMOTE    ] CM: Fetching primary data for 2025-05.
[2025-10-24T17:58:50.589261] [INFO ] [MAIN      ] CMBT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:58:50.643719] [DEBUG] [LOCAL     ] CMBT: Loaded 27899 existing records from primary storage.
[2025-10-24T17:58:50.646156] [INFO ] [REMOTE    ] CMA: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T17:58:50.644603] [INFO ] [MAIN      ] CMBT: Loaded 27899 existing records.
[2025-10-24T17:58:50.833154] [WARN ] [MAIN      ] CMBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:58:50.833365] [INFO ] [MAIN      ] CMBT: Wiping existing primary data before full refresh.
[2025-10-24T17:58:50.833420] [INFO ] [LOCAL     ] CMBT: Starting deletion of primary data.
[2025-10-24T17:58:50.833675] [DEBUG] [LOCAL     ] CMBT: Deleted primary data file.
[2025-10-24T17:58:50.833733] [INFO ] [MAIN      ] CMBT: Starting full primary refresh.
[2025-10-24T17:58:51.190444] [INFO ] [REMOTE    ] CMBT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:58:51.347735] [INFO ] [REMOTE    ] CMA: Fetching primary data for 2025-02.
[2025-10-24T17:58:51.724329] [INFO ] [REMOTE    ] CLX: Incremental fetch complete for 2025-09 (1.98 seconds).
[2025-10-24T17:58:52.147635] [INFO ] [REMOTE    ] CMBT: Fetching primary data for 2025-01.
[2025-10-24T17:58:52.230541] [INFO ] [REMOTE    ] CM: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T17:58:52.604478] [INFO ] [REMOTE    ] CMA: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T17:58:52.947676] [INFO ] [REMOTE    ] CM: Fetching primary data for 2025-06.
[2025-10-24T17:58:53.208300] [INFO ] [REMOTE    ] CMBT: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T17:58:53.747688] [INFO ] [REMOTE    ] CMBT: Fetching primary data for 2025-02.
[2025-10-24T17:58:54.509101] [INFO ] [REMOTE    ] CM: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T17:58:54.547682] [INFO ] [REMOTE    ] CLX: Fetching primary data for 2025-10.
[2025-10-24T17:58:54.608803] [INFO ] [REMOTE    ] CMBT: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T17:58:55.347678] [INFO ] [REMOTE    ] CMA: Fetching primary data for 2025-03.
[2025-10-24T17:58:56.147684] [INFO ] [REMOTE    ] CM: Fetching primary data for 2025-07.
[2025-10-24T17:58:56.592930] [INFO ] [REMOTE    ] CLX: Incremental fetch complete for 2025-10 (2.05 seconds).
[2025-10-24T17:58:56.602910] [INFO ] [REMOTE    ] CLX: Full fetch complete (73909 records).
[2025-10-24T17:58:56.603059] [DEBUG] [VALIDATOR ] CLX: Validating primary data.
[2025-10-24T17:58:56.951609] [INFO ] [REMOTE    ] CMBT: Fetching primary data for 2025-03.
[2025-10-24T17:58:57.011235] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present.
[2025-10-24T17:58:57.011410] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed.
[2025-10-24T17:58:57.012415] [INFO ] [MAIN      ] CLX: Fetched primary data is valid.
[2025-10-24T17:58:57.012582] [DEBUG] [LOCAL     ] CLX: Saving primary data.
[2025-10-24T17:58:57.013439] [FATAL] [LOCAL     ] CLX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:58:57.013549] [FATAL] [MAIN      ] CLX: Failed to save primary data.
[2025-10-24T17:58:57.013770] [WARN ] [MAIN      ] CLX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:58:57.013888] [INFO ] [LOCAL     ] CLX: Starting deletion of primary data.
[2025-10-24T17:58:57.013991] [DEBUG] [LOCAL     ] CLX: No primary data file found to delete.
[2025-10-24T17:58:57.014154] [INFO ] [LOCAL     ] CLX: Starting deletion of derivative data.
[2025-10-24T17:58:57.014390] [DEBUG] [LOCAL     ] CLX: Deleted derivative data file.
[2025-10-24T17:58:57.014894] [INFO ] [MAIN      ] Update Progress: 471/2366 symbols completed. CLX took 33.4s. Estimated remaining: 3h 56m 59s. Rate: 8.0 symbols/min
[2025-10-24T17:58:57.222274] [INFO ] [MAIN      ] CMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:58:57.224287] [INFO ] [REMOTE    ] CMA: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T17:58:57.275077] [DEBUG] [LOCAL     ] CMC: Loaded 45922 existing records from primary storage.
[2025-10-24T17:58:57.275358] [INFO ] [MAIN      ] CMC: Loaded 45922 existing records.
[2025-10-24T17:58:57.452142] [WARN ] [MAIN      ] CMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:58:57.452337] [INFO ] [MAIN      ] CMC: Wiping existing primary data before full refresh.
[2025-10-24T17:58:57.452385] [INFO ] [LOCAL     ] CMC: Starting deletion of primary data.
[2025-10-24T17:58:57.452759] [DEBUG] [LOCAL     ] CMC: Deleted primary data file.
[2025-10-24T17:58:57.452817] [INFO ] [MAIN      ] CMC: Starting full primary refresh.
[2025-10-24T17:58:57.765573] [INFO ] [REMOTE    ] CMA: Fetching primary data for 2025-04.
[2025-10-24T17:58:57.817694] [INFO ] [REMOTE    ] CMBT: Incremental fetch complete for 2025-03 (0.87 seconds).
[2025-10-24T17:58:57.853973] [INFO ] [REMOTE    ] CMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:58:57.899495] [INFO ] [REMOTE    ] CM: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T17:58:58.547676] [INFO ] [REMOTE    ] CMBT: Fetching primary data for 2025-04.
[2025-10-24T17:58:59.299295] [INFO ] [REMOTE    ] CMA: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T17:58:59.347609] [INFO ] [REMOTE    ] CMA: Fetching primary data for 2025-05.
[2025-10-24T17:58:59.599376] [INFO ] [REMOTE    ] CMBT: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T17:59:00.147713] [INFO ] [REMOTE    ] CM: Fetching primary data for 2025-08.
[2025-10-24T17:59:00.947636] [INFO ] [REMOTE    ] CMC: Fetching primary data for 2025-01.
[2025-10-24T17:59:01.747718] [INFO ] [REMOTE    ] CMBT: Fetching primary data for 2025-05.
[2025-10-24T17:59:01.783919] [INFO ] [REMOTE    ] CMA: Incremental fetch complete for 2025-05 (2.44 seconds).
[2025-10-24T17:59:02.180638] [INFO ] [REMOTE    ] CM: Incremental fetch complete for 2025-08 (2.03 seconds).
[2025-10-24T17:59:02.547725] [INFO ] [REMOTE    ] CMA: Fetching primary data for 2025-06.
[2025-10-24T17:59:03.034424] [INFO ] [REMOTE    ] CMBT: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T17:59:03.347668] [INFO ] [REMOTE    ] CMBT: Fetching primary data for 2025-06.
[2025-10-24T17:59:03.954968] [INFO ] [REMOTE    ] CMA: Incremental fetch complete for 2025-06 (1.41 seconds).
[2025-10-24T17:59:04.147672] [INFO ] [REMOTE    ] CM: Fetching primary data for 2025-09.
[2025-10-24T17:59:04.278082] [INFO ] [REMOTE    ] CMC: Incremental fetch complete for 2025-01 (3.33 seconds).
[2025-10-24T17:59:04.296341] [INFO ] [REMOTE    ] CMBT: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T17:59:04.947622] [INFO ] [REMOTE    ] CMC: Fetching primary data for 2025-02.
[2025-10-24T17:59:05.747614] [INFO ] [REMOTE    ] CMA: Fetching primary data for 2025-07.
[2025-10-24T17:59:06.015198] [INFO ] [REMOTE    ] CM: Incremental fetch complete for 2025-09 (1.87 seconds).
[2025-10-24T17:59:06.547639] [INFO ] [REMOTE    ] CM: Fetching primary data for 2025-10.
[2025-10-24T17:59:06.608412] [INFO ] [REMOTE    ] CMC: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T17:59:07.125884] [INFO ] [REMOTE    ] CMA: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T17:59:07.347638] [INFO ] [REMOTE    ] CMA: Fetching primary data for 2025-08.
[2025-10-24T17:59:08.147683] [INFO ] [REMOTE    ] CMC: Fetching primary data for 2025-03.
[2025-10-24T17:59:08.296380] [INFO ] [REMOTE    ] CM: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T17:59:08.304981] [INFO ] [REMOTE    ] CM: Full fetch complete (69753 records).
[2025-10-24T17:59:08.305128] [DEBUG] [VALIDATOR ] CM: Validating primary data.
[2025-10-24T17:59:08.695436] [DEBUG] [VALIDATOR ] CM: All expected trading days are present.
[2025-10-24T17:59:08.695592] [DEBUG] [VALIDATOR ] CM: Primary data validation passed.
[2025-10-24T17:59:08.696402] [INFO ] [MAIN      ] CM: Fetched primary data is valid.
[2025-10-24T17:59:08.696480] [DEBUG] [LOCAL     ] CM: Saving primary data.
[2025-10-24T17:59:08.697059] [FATAL] [LOCAL     ] CM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:59:08.697143] [FATAL] [MAIN      ] CM: Failed to save primary data.
[2025-10-24T17:59:08.697231] [WARN ] [MAIN      ] CM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:59:08.697318] [INFO ] [LOCAL     ] CM: Starting deletion of primary data.
[2025-10-24T17:59:08.697392] [DEBUG] [LOCAL     ] CM: No primary data file found to delete.
[2025-10-24T17:59:08.697440] [INFO ] [LOCAL     ] CM: Starting deletion of derivative data.
[2025-10-24T17:59:08.697621] [DEBUG] [LOCAL     ] CM: Deleted derivative data file.
[2025-10-24T17:59:08.698158] [INFO ] [MAIN      ] Update Progress: 472/2366 symbols completed. CM took 28.2s. Estimated remaining: 3h 57m 8s. Rate: 8.0 symbols/min
[2025-10-24T17:59:08.867776] [INFO ] [MAIN      ] CMCM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:59:08.897495] [DEBUG] [LOCAL     ] CMCM: Loaded 4858 existing records from primary storage.
[2025-10-24T17:59:08.900249] [INFO ] [MAIN      ] CMCM: Loaded 4858 existing records.
[2025-10-24T17:59:08.934354] [INFO ] [REMOTE    ] CMA: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T17:59:08.957327] [INFO ] [REMOTE    ] CMBT: Fetching primary data for 2025-07.
[2025-10-24T17:59:09.092974] [WARN ] [MAIN      ] CMCM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:59:09.093222] [INFO ] [MAIN      ] CMCM: Wiping existing primary data before full refresh.
[2025-10-24T17:59:09.093285] [INFO ] [LOCAL     ] CMCM: Starting deletion of primary data.
[2025-10-24T17:59:09.093464] [DEBUG] [LOCAL     ] CMCM: Deleted primary data file.
[2025-10-24T17:59:09.093520] [INFO ] [MAIN      ] CMCM: Starting full primary refresh.
[2025-10-24T17:59:09.455929] [INFO ] [REMOTE    ] CMCM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:59:09.747701] [INFO ] [REMOTE    ] CMA: Fetching primary data for 2025-09.
[2025-10-24T17:59:09.831166] [INFO ] [REMOTE    ] CMC: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T17:59:10.033536] [INFO ] [REMOTE    ] CMBT: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T17:59:10.547713] [INFO ] [REMOTE    ] CMC: Fetching primary data for 2025-04.
[2025-10-24T17:59:11.124380] [INFO ] [REMOTE    ] CMA: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T17:59:11.347677] [INFO ] [REMOTE    ] CMBT: Fetching primary data for 2025-08.
[2025-10-24T17:59:12.147614] [INFO ] [REMOTE    ] CMCM: Fetching primary data for 2025-01.
[2025-10-24T17:59:12.268209] [INFO ] [REMOTE    ] CMC: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T17:59:12.321044] [INFO ] [REMOTE    ] CMBT: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T17:59:12.714366] [INFO ] [REMOTE    ] CMCM: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T17:59:12.947709] [INFO ] [REMOTE    ] CMBT: Fetching primary data for 2025-09.
[2025-10-24T17:59:13.747687] [INFO ] [REMOTE    ] CMC: Fetching primary data for 2025-05.
[2025-10-24T17:59:14.547627] [INFO ] [REMOTE    ] CMA: Fetching primary data for 2025-10.
[2025-10-24T17:59:14.686464] [INFO ] [REMOTE    ] CMBT: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T17:59:15.149185] [INFO ] [REMOTE    ] CMC: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T17:59:15.347638] [INFO ] [REMOTE    ] CMC: Fetching primary data for 2025-06.
[2025-10-24T17:59:16.147684] [INFO ] [REMOTE    ] CMCM: Fetching primary data for 2025-02.
[2025-10-24T17:59:16.481991] [INFO ] [REMOTE    ] CMA: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T17:59:16.491942] [INFO ] [REMOTE    ] CMA: Full fetch complete (73535 records).
[2025-10-24T17:59:16.492078] [DEBUG] [VALIDATOR ] CMA: Validating primary data.
[2025-10-24T17:59:16.883276] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present.
[2025-10-24T17:59:16.883388] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed.
[2025-10-24T17:59:16.884297] [INFO ] [MAIN      ] CMA: Fetched primary data is valid.
[2025-10-24T17:59:16.884410] [DEBUG] [LOCAL     ] CMA: Saving primary data.
[2025-10-24T17:59:16.885083] [FATAL] [LOCAL     ] CMA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:59:16.885270] [FATAL] [MAIN      ] CMA: Failed to save primary data.
[2025-10-24T17:59:16.885374] [WARN ] [MAIN      ] CMA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:59:16.885455] [INFO ] [LOCAL     ] CMA: Starting deletion of primary data.
[2025-10-24T17:59:16.885545] [DEBUG] [LOCAL     ] CMA: No primary data file found to delete.
[2025-10-24T17:59:16.885615] [INFO ] [LOCAL     ] CMA: Starting deletion of derivative data.
[2025-10-24T17:59:16.885857] [DEBUG] [LOCAL     ] CMA: Deleted derivative data file.
[2025-10-24T17:59:16.886175] [INFO ] [MAIN      ] Update Progress: 473/2366 symbols completed. CMA took 29.6s. Estimated remaining: 3h 57m 3s. Rate: 8.0 symbols/min
[2025-10-24T17:59:16.961466] [INFO ] [REMOTE    ] CMBT: Fetching primary data for 2025-10.
[2025-10-24T17:59:17.020959] [INFO ] [REMOTE    ] CMCM: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T17:59:17.100397] [INFO ] [MAIN      ] CMDB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:59:17.100678] [DEBUG] [LOCAL     ] CMDB: No existing data file found in primary storage.
[2025-10-24T17:59:17.100948] [WARN ] [MAIN      ] CMDB: No existing data found, performing full refresh instead.
[2025-10-24T17:59:17.102695] [INFO ] [MAIN      ] CMDB: Wiping existing primary data before full refresh.
[2025-10-24T17:59:17.102594] [INFO ] [REMOTE    ] CMC: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T17:59:17.102803] [INFO ] [LOCAL     ] CMDB: Starting deletion of primary data.
[2025-10-24T17:59:17.112255] [DEBUG] [LOCAL     ] CMDB: No primary data file found to delete.
[2025-10-24T17:59:17.112468] [INFO ] [MAIN      ] CMDB: Starting full primary refresh.
[2025-10-24T17:59:17.462747] [INFO ] [REMOTE    ] CMDB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:59:17.747726] [INFO ] [REMOTE    ] CMCM: Fetching primary data for 2025-03.
[2025-10-24T17:59:18.367281] [INFO ] [REMOTE    ] CMCM: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T17:59:18.547717] [INFO ] [REMOTE    ] CMCM: Fetching primary data for 2025-04.
[2025-10-24T17:59:18.945738] [INFO ] [REMOTE    ] CMCM: Incremental fetch complete for 2025-04 (0.40 seconds).
[2025-10-24T17:59:19.130715] [INFO ] [REMOTE    ] CMBT: Incremental fetch complete for 2025-10 (2.17 seconds).
[2025-10-24T17:59:19.140006] [INFO ] [REMOTE    ] CMBT: Full fetch complete (34461 records).
[2025-10-24T17:59:19.140137] [DEBUG] [VALIDATOR ] CMBT: Validating primary data.
[2025-10-24T17:59:19.354678] [INFO ] [REMOTE    ] CMCM: Fetching primary data for 2025-05.
[2025-10-24T17:59:19.513494] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present.
[2025-10-24T17:59:19.513568] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed.
[2025-10-24T17:59:19.514078] [INFO ] [MAIN      ] CMBT: Fetched primary data is valid.
[2025-10-24T17:59:19.514138] [DEBUG] [LOCAL     ] CMBT: Saving primary data.
[2025-10-24T17:59:19.514467] [FATAL] [LOCAL     ] CMBT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:59:19.514549] [FATAL] [MAIN      ] CMBT: Failed to save primary data.
[2025-10-24T17:59:19.514589] [WARN ] [MAIN      ] CMBT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:59:19.514622] [INFO ] [LOCAL     ] CMBT: Starting deletion of primary data.
[2025-10-24T17:59:19.514705] [DEBUG] [LOCAL     ] CMBT: No primary data file found to delete.
[2025-10-24T17:59:19.514752] [INFO ] [LOCAL     ] CMBT: Starting deletion of derivative data.
[2025-10-24T17:59:19.514888] [DEBUG] [LOCAL     ] CMBT: Deleted derivative data file.
[2025-10-24T17:59:19.514960] [INFO ] [MAIN      ] Update Progress: 474/2366 symbols completed. CMBT took 29.1s. Estimated remaining: 3h 56m 36s. Rate: 8.0 symbols/min
[2025-10-24T17:59:19.689454] [INFO ] [MAIN      ] CMG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:59:19.742157] [DEBUG] [LOCAL     ] CMG: Loaded 54112 existing records from primary storage.
[2025-10-24T17:59:19.742454] [INFO ] [MAIN      ] CMG: Loaded 54112 existing records.
[2025-10-24T17:59:19.917753] [INFO ] [REMOTE    ] CMCM: Incremental fetch complete for 2025-05 (0.56 seconds).
[2025-10-24T17:59:19.922962] [WARN ] [MAIN      ] CMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:59:19.923175] [INFO ] [MAIN      ] CMG: Wiping existing primary data before full refresh.
[2025-10-24T17:59:19.924503] [INFO ] [LOCAL     ] CMG: Starting deletion of primary data.
[2025-10-24T17:59:19.925101] [DEBUG] [LOCAL     ] CMG: Deleted primary data file.
[2025-10-24T17:59:19.925157] [INFO ] [MAIN      ] CMG: Starting full primary refresh.
[2025-10-24T17:59:20.155492] [INFO ] [REMOTE    ] CMDB: Fetching primary data for 2025-01.
[2025-10-24T17:59:20.286190] [INFO ] [REMOTE    ] CMG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:59:20.405560] [DEBUG] [REMOTE    ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T17:59:20.405888] [WARN ] [REMOTE    ] CMDB: No data returned for month 2025-01
[2025-10-24T17:59:20.405993] [FATAL] [REMOTE    ] CMDB: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T17:59:20.406089] [FATAL] [MAIN      ] CMDB: Failed to fetch primary data.
[2025-10-24T17:59:20.406171] [WARN ] [MAIN      ] CMDB: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T17:59:20.406264] [INFO ] [LOCAL     ] CMDB: Starting deletion of primary data.
[2025-10-24T17:59:20.406349] [DEBUG] [LOCAL     ] CMDB: No primary data file found to delete.
[2025-10-24T17:59:20.406389] [INFO ] [LOCAL     ] CMDB: Starting deletion of derivative data.
[2025-10-24T17:59:20.406431] [DEBUG] [LOCAL     ] CMDB: No derivative data file found to delete.
[2025-10-24T17:59:20.406478] [INFO ] [MAIN      ] Update Progress: 475/2366 symbols completed. CMDB took 3.5s. Estimated remaining: 3h 56m 3s. Rate: 8.0 symbols/min
[2025-10-24T17:59:20.574660] [INFO ] [MAIN      ] CMI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:59:20.613149] [DEBUG] [LOCAL     ] CMI: Loaded 41922 existing records from primary storage.
[2025-10-24T17:59:20.613419] [INFO ] [MAIN      ] CMI: Loaded 41922 existing records.
[2025-10-24T17:59:20.788972] [WARN ] [MAIN      ] CMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:59:20.789211] [INFO ] [MAIN      ] CMI: Wiping existing primary data before full refresh.
[2025-10-24T17:59:20.789263] [INFO ] [LOCAL     ] CMI: Starting deletion of primary data.
[2025-10-24T17:59:20.789787] [DEBUG] [LOCAL     ] CMI: Deleted primary data file.
[2025-10-24T17:59:20.789842] [INFO ] [MAIN      ] CMI: Starting full primary refresh.
[2025-10-24T17:59:20.959781] [INFO ] [REMOTE    ] CMG: Fetching primary data for 2025-01.
[2025-10-24T17:59:21.140440] [INFO ] [REMOTE    ] CMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:59:21.747630] [INFO ] [REMOTE    ] CMI: Fetching primary data for 2025-01.
[2025-10-24T17:59:22.547723] [INFO ] [REMOTE    ] CMCM: Fetching primary data for 2025-06.
[2025-10-24T17:59:22.937737] [INFO ] [REMOTE    ] CMG: Incremental fetch complete for 2025-01 (1.98 seconds).
[2025-10-24T17:59:23.201944] [INFO ] [REMOTE    ] CMCM: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T17:59:23.347636] [INFO ] [REMOTE    ] CMCM: Fetching primary data for 2025-07.
[2025-10-24T17:59:23.830152] [INFO ] [REMOTE    ] CMI: Incremental fetch complete for 2025-01 (2.08 seconds).
[2025-10-24T17:59:23.964781] [INFO ] [REMOTE    ] CMCM: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T17:59:24.147668] [INFO ] [REMOTE    ] CMC: Fetching primary data for 2025-07.
[2025-10-24T17:59:24.947695] [INFO ] [REMOTE    ] CMI: Fetching primary data for 2025-02.
[2025-10-24T17:59:25.752757] [INFO ] [REMOTE    ] CMG: Fetching primary data for 2025-02.
[2025-10-24T17:59:25.766178] [INFO ] [REMOTE    ] CMC: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T17:59:26.430814] [INFO ] [REMOTE    ] CMI: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T17:59:26.547681] [INFO ] [REMOTE    ] CMI: Fetching primary data for 2025-03.
[2025-10-24T17:59:27.347609] [INFO ] [REMOTE    ] CMC: Fetching primary data for 2025-08.
[2025-10-24T17:59:27.768781] [INFO ] [REMOTE    ] CMI: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T17:59:27.848959] [INFO ] [REMOTE    ] CMG: Incremental fetch complete for 2025-02 (2.10 seconds).
[2025-10-24T17:59:28.147673] [INFO ] [REMOTE    ] CMG: Fetching primary data for 2025-03.
[2025-10-24T17:59:28.477769] [INFO ] [REMOTE    ] CMC: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T17:59:28.947725] [INFO ] [REMOTE    ] CMCM: Fetching primary data for 2025-08.
[2025-10-24T17:59:29.520086] [INFO ] [REMOTE    ] CMCM: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T17:59:29.747713] [INFO ] [REMOTE    ] CMCM: Fetching primary data for 2025-09.
[2025-10-24T17:59:30.273772] [INFO ] [REMOTE    ] CMG: Incremental fetch complete for 2025-03 (2.13 seconds).
[2025-10-24T17:59:30.406262] [INFO ] [REMOTE    ] CMCM: Incremental fetch complete for 2025-09 (0.66 seconds).
[2025-10-24T17:59:30.547692] [INFO ] [REMOTE    ] CMCM: Fetching primary data for 2025-10.
[2025-10-24T17:59:31.228619] [INFO ] [REMOTE    ] CMCM: Incremental fetch complete for 2025-10 (0.68 seconds).
[2025-10-24T17:59:31.230216] [INFO ] [REMOTE    ] CMCM: Full fetch complete (7089 records).
[2025-10-24T17:59:31.230286] [DEBUG] [VALIDATOR ] CMCM: Validating primary data.
[2025-10-24T17:59:31.352781] [INFO ] [REMOTE    ] CMG: Fetching primary data for 2025-04.
[2025-10-24T17:59:31.598046] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present.
[2025-10-24T17:59:31.598125] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed.
[2025-10-24T17:59:31.598341] [INFO ] [MAIN      ] CMCM: Fetched primary data is valid.
[2025-10-24T17:59:31.598380] [DEBUG] [LOCAL     ] CMCM: Saving primary data.
[2025-10-24T17:59:31.598575] [FATAL] [LOCAL     ] CMCM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:59:31.598680] [FATAL] [MAIN      ] CMCM: Failed to save primary data.
[2025-10-24T17:59:31.598732] [WARN ] [MAIN      ] CMCM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:59:31.598769] [INFO ] [LOCAL     ] CMCM: Starting deletion of primary data.
[2025-10-24T17:59:31.598825] [DEBUG] [LOCAL     ] CMCM: No primary data file found to delete.
[2025-10-24T17:59:31.598868] [INFO ] [LOCAL     ] CMCM: Starting deletion of derivative data.
[2025-10-24T17:59:31.599009] [DEBUG] [LOCAL     ] CMCM: Deleted derivative data file.
[2025-10-24T17:59:31.599077] [INFO ] [MAIN      ] Update Progress: 476/2366 symbols completed. CMCM took 22.9s. Estimated remaining: 3h 56m 10s. Rate: 8.0 symbols/min
[2025-10-24T17:59:31.784358] [INFO ] [MAIN      ] CMP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:59:31.819354] [DEBUG] [LOCAL     ] CMP: Loaded 35825 existing records from primary storage.
[2025-10-24T17:59:31.819610] [INFO ] [MAIN      ] CMP: Loaded 35825 existing records.
[2025-10-24T17:59:31.994417] [WARN ] [MAIN      ] CMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:59:31.994692] [INFO ] [MAIN      ] CMP: Wiping existing primary data before full refresh.
[2025-10-24T17:59:31.994751] [INFO ] [LOCAL     ] CMP: Starting deletion of primary data.
[2025-10-24T17:59:31.995013] [DEBUG] [LOCAL     ] CMP: Deleted primary data file.
[2025-10-24T17:59:31.995072] [INFO ] [MAIN      ] CMP: Starting full primary refresh.
[2025-10-24T17:59:32.153357] [INFO ] [REMOTE    ] CMI: Fetching primary data for 2025-04.
[2025-10-24T17:59:32.366559] [INFO ] [REMOTE    ] CMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:59:32.947730] [INFO ] [REMOTE    ] CMP: Fetching primary data for 2025-01.
[2025-10-24T17:59:33.588038] [INFO ] [REMOTE    ] CMG: Incremental fetch complete for 2025-04 (2.24 seconds).
[2025-10-24T17:59:33.747601] [INFO ] [REMOTE    ] CMG: Fetching primary data for 2025-05.
[2025-10-24T17:59:33.903186] [INFO ] [REMOTE    ] CMI: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T17:59:34.122374] [INFO ] [REMOTE    ] CMP: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T17:59:34.547728] [INFO ] [REMOTE    ] CMC: Fetching primary data for 2025-09.
[2025-10-24T17:59:35.342284] [INFO ] [REMOTE    ] CMG: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T17:59:35.352699] [INFO ] [REMOTE    ] CMI: Fetching primary data for 2025-05.
[2025-10-24T17:59:35.803826] [INFO ] [REMOTE    ] CMC: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T17:59:36.147695] [INFO ] [REMOTE    ] CMP: Fetching primary data for 2025-02.
[2025-10-24T17:59:36.735883] [INFO ] [REMOTE    ] CMI: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T17:59:36.947728] [INFO ] [REMOTE    ] CMC: Fetching primary data for 2025-10.
[2025-10-24T17:59:37.235337] [INFO ] [REMOTE    ] CMP: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T17:59:37.747717] [INFO ] [REMOTE    ] CMI: Fetching primary data for 2025-06.
[2025-10-24T17:59:38.547626] [INFO ] [REMOTE    ] CMG: Fetching primary data for 2025-06.
[2025-10-24T17:59:38.857254] [INFO ] [REMOTE    ] CMC: Incremental fetch complete for 2025-10 (1.91 seconds).
[2025-10-24T17:59:38.866293] [INFO ] [REMOTE    ] CMC: Full fetch complete (67219 records).
[2025-10-24T17:59:38.866440] [DEBUG] [VALIDATOR ] CMC: Validating primary data.
[2025-10-24T17:59:39.262528] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present.
[2025-10-24T17:59:39.262627] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed.
[2025-10-24T17:59:39.263431] [INFO ] [MAIN      ] CMC: Fetched primary data is valid.
[2025-10-24T17:59:39.263508] [DEBUG] [LOCAL     ] CMC: Saving primary data.
[2025-10-24T17:59:39.264114] [FATAL] [LOCAL     ] CMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:59:39.264261] [FATAL] [MAIN      ] CMC: Failed to save primary data.
[2025-10-24T17:59:39.264419] [WARN ] [MAIN      ] CMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:59:39.264515] [INFO ] [LOCAL     ] CMC: Starting deletion of primary data.
[2025-10-24T17:59:39.281540] [DEBUG] [LOCAL     ] CMC: No primary data file found to delete.
[2025-10-24T17:59:39.283811] [INFO ] [LOCAL     ] CMC: Starting deletion of derivative data.
[2025-10-24T17:59:39.284026] [DEBUG] [LOCAL     ] CMC: Deleted derivative data file.
[2025-10-24T17:59:39.284596] [INFO ] [MAIN      ] Update Progress: 477/2366 symbols completed. CMC took 42.3s. Estimated remaining: 3h 56m 3s. Rate: 8.0 symbols/min
[2025-10-24T17:59:39.285251] [INFO ] [REMOTE    ] CMI: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T17:59:39.347637] [INFO ] [REMOTE    ] CMI: Fetching primary data for 2025-07.
[2025-10-24T17:59:40.147708] [INFO ] [REMOTE    ] CMP: Fetching primary data for 2025-03.
[2025-10-24T17:59:40.341915] [INFO ] [REMOTE    ] CMG: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T17:59:40.724104] [INFO ] [REMOTE    ] CMI: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T17:59:40.947681] [INFO ] [REMOTE    ] CMG: Fetching primary data for 2025-07.
[2025-10-24T17:59:41.577636] [INFO ] [REMOTE    ] CMP: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T17:59:41.747718] [INFO ] [REMOTE    ] CMP: Fetching primary data for 2025-04.
[2025-10-24T17:59:42.547754] [INFO ] [REMOTE    ] CMI: Fetching primary data for 2025-08.
[2025-10-24T17:59:42.966340] [INFO ] [REMOTE    ] CMP: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T17:59:43.191229] [INFO ] [REMOTE    ] CMG: Incremental fetch complete for 2025-07 (2.24 seconds).
[2025-10-24T17:59:43.347711] [INFO ] [REMOTE    ] CMP: Fetching primary data for 2025-05.
[2025-10-24T17:59:44.147671] [INFO ] [REMOTE    ] CMG: Fetching primary data for 2025-08.
[2025-10-24T17:59:44.185580] [INFO ] [REMOTE    ] CMI: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T17:59:44.662934] [INFO ] [REMOTE    ] CMP: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T17:59:44.947699] [INFO ] [REMOTE    ] CMI: Fetching primary data for 2025-09.
[2025-10-24T17:59:45.747701] [INFO ] [REMOTE    ] CMP: Fetching primary data for 2025-06.
[2025-10-24T17:59:46.176618] [INFO ] [REMOTE    ] CMG: Incremental fetch complete for 2025-08 (2.03 seconds).
[2025-10-24T17:59:46.508277] [INFO ] [REMOTE    ] CMI: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T17:59:46.547617] [INFO ] [REMOTE    ] CMI: Fetching primary data for 2025-10.
[2025-10-24T17:59:47.037457] [INFO ] [REMOTE    ] CMP: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T17:59:47.347688] [INFO ] [REMOTE    ] CMG: Fetching primary data for 2025-09.
[2025-10-24T17:59:48.147619] [INFO ] [REMOTE    ] CMP: Fetching primary data for 2025-07.
[2025-10-24T17:59:48.169057] [INFO ] [REMOTE    ] CMI: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T17:59:48.177135] [INFO ] [REMOTE    ] CMI: Full fetch complete (61140 records).
[2025-10-24T17:59:48.177269] [DEBUG] [VALIDATOR ] CMI: Validating primary data.
[2025-10-24T17:59:48.561741] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present.
[2025-10-24T17:59:48.561875] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed.
[2025-10-24T17:59:48.562616] [INFO ] [MAIN      ] CMI: Fetched primary data is valid.
[2025-10-24T17:59:48.562705] [DEBUG] [LOCAL     ] CMI: Saving primary data.
[2025-10-24T17:59:48.563214] [FATAL] [LOCAL     ] CMI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:59:48.563292] [FATAL] [MAIN      ] CMI: Failed to save primary data.
[2025-10-24T17:59:48.563358] [WARN ] [MAIN      ] CMI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:59:48.563427] [INFO ] [LOCAL     ] CMI: Starting deletion of primary data.
[2025-10-24T17:59:48.563488] [DEBUG] [LOCAL     ] CMI: No primary data file found to delete.
[2025-10-24T17:59:48.563524] [INFO ] [LOCAL     ] CMI: Starting deletion of derivative data.
[2025-10-24T17:59:48.563676] [DEBUG] [LOCAL     ] CMI: Deleted derivative data file.
[2025-10-24T17:59:48.563871] [INFO ] [MAIN      ] Update Progress: 478/2366 symbols completed. CMI took 28.2s. Estimated remaining: 3h 56m 3s. Rate: 8.0 symbols/min
[2025-10-24T17:59:49.726585] [INFO ] [REMOTE    ] CMG: Incremental fetch complete for 2025-09 (2.38 seconds).
[2025-10-24T17:59:49.740339] [INFO ] [REMOTE    ] CMG: Fetching primary data for 2025-10.
[2025-10-24T17:59:49.872291] [INFO ] [REMOTE    ] CMP: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T17:59:49.880958] [INFO ] [REMOTE    ] CMP: Fetching primary data for 2025-08.
[2025-10-24T17:59:51.225607] [INFO ] [REMOTE    ] CMP: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T17:59:51.232832] [INFO ] [REMOTE    ] CMP: Fetching primary data for 2025-09.
[2025-10-24T17:59:51.797966] [INFO ] [REMOTE    ] CMG: Incremental fetch complete for 2025-10 (2.06 seconds).
[2025-10-24T17:59:51.809539] [INFO ] [REMOTE    ] CMG: Full fetch complete (77893 records).
[2025-10-24T17:59:51.809806] [DEBUG] [VALIDATOR ] CMG: Validating primary data.
[2025-10-24T17:59:52.231204] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present.
[2025-10-24T17:59:52.231529] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed.
[2025-10-24T17:59:52.232465] [INFO ] [MAIN      ] CMG: Fetched primary data is valid.
[2025-10-24T17:59:52.232531] [DEBUG] [LOCAL     ] CMG: Saving primary data.
[2025-10-24T17:59:52.233215] [FATAL] [LOCAL     ] CMG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:59:52.233356] [FATAL] [MAIN      ] CMG: Failed to save primary data.
[2025-10-24T17:59:52.233397] [WARN ] [MAIN      ] CMG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:59:52.233432] [INFO ] [LOCAL     ] CMG: Starting deletion of primary data.
[2025-10-24T17:59:52.233499] [DEBUG] [LOCAL     ] CMG: No primary data file found to delete.
[2025-10-24T17:59:52.233554] [INFO ] [LOCAL     ] CMG: Starting deletion of derivative data.
[2025-10-24T17:59:52.234193] [DEBUG] [LOCAL     ] CMG: Deleted derivative data file.
[2025-10-24T17:59:52.234707] [INFO ] [MAIN      ] Update Progress: 479/2366 symbols completed. CMG took 32.7s. Estimated remaining: 3h 55m 40s. Rate: 8.0 symbols/min
[2025-10-24T17:59:52.381935] [INFO ] [REMOTE    ] CMP: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T17:59:52.388353] [INFO ] [REMOTE    ] CMP: Fetching primary data for 2025-10.
[2025-10-24T17:59:53.482826] [INFO ] [REMOTE    ] CMP: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T17:59:53.490794] [INFO ] [REMOTE    ] CMP: Full fetch complete (51450 records).
[2025-10-24T17:59:53.490905] [DEBUG] [VALIDATOR ] CMP: Validating primary data.
[2025-10-24T17:59:53.871238] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present.
[2025-10-24T17:59:53.871313] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed.
[2025-10-24T17:59:53.871984] [INFO ] [MAIN      ] CMP: Fetched primary data is valid.
[2025-10-24T17:59:53.872045] [DEBUG] [LOCAL     ] CMP: Saving primary data.
[2025-10-24T17:59:53.872503] [FATAL] [LOCAL     ] CMP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T17:59:53.872589] [FATAL] [MAIN      ] CMP: Failed to save primary data.
[2025-10-24T17:59:53.872631] [WARN ] [MAIN      ] CMP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T17:59:53.872716] [INFO ] [LOCAL     ] CMP: Starting deletion of primary data.
[2025-10-24T17:59:53.872774] [DEBUG] [LOCAL     ] CMP: No primary data file found to delete.
[2025-10-24T17:59:53.872809] [INFO ] [LOCAL     ] CMP: Starting deletion of derivative data.
[2025-10-24T17:59:53.872982] [DEBUG] [LOCAL     ] CMP: Deleted derivative data file.
[2025-10-24T17:59:53.873216] [INFO ] [MAIN      ] Update Progress: 480/2366 symbols completed. CMP took 22.3s. Estimated remaining: 3h 55m 10s. Rate: 8.0 symbols/min
[2025-10-24T17:59:54.534795] [INFO ] [MAIN      ] CMPO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:59:54.537978] [INFO ] [MAIN      ] CMRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:59:54.533984] [INFO ] [MAIN      ] CMS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:59:54.603823] [INFO ] [MAIN      ] CMSA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T17:59:54.613806] [DEBUG] [LOCAL     ] CMSA: Loaded 3498 existing records from primary storage.
[2025-10-24T17:59:54.614238] [INFO ] [MAIN      ] CMSA: Loaded 3498 existing records.
[2025-10-24T17:59:54.767739] [DEBUG] [LOCAL     ] CMRE: Loaded 35849 existing records from primary storage.
[2025-10-24T17:59:54.803504] [INFO ] [MAIN      ] CMRE: Loaded 35849 existing records.
[2025-10-24T17:59:54.852318] [DEBUG] [LOCAL     ] CMS: Loaded 52913 existing records from primary storage.
[2025-10-24T17:59:54.907375] [INFO ] [MAIN      ] CMS: Loaded 52913 existing records.
[2025-10-24T17:59:54.911133] [WARN ] [MAIN      ] CMSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:59:54.908055] [DEBUG] [LOCAL     ] CMPO: Loaded 38603 existing records from primary storage.
[2025-10-24T17:59:54.984203] [INFO ] [MAIN      ] CMPO: Loaded 38603 existing records.
[2025-10-24T17:59:54.994949] [INFO ] [MAIN      ] CMSA: Wiping existing primary data before full refresh.
[2025-10-24T17:59:55.030744] [INFO ] [LOCAL     ] CMSA: Starting deletion of primary data.
[2025-10-24T17:59:55.058666] [DEBUG] [LOCAL     ] CMSA: Deleted primary data file.
[2025-10-24T17:59:55.090198] [INFO ] [MAIN      ] CMSA: Starting full primary refresh.
[2025-10-24T17:59:55.484265] [WARN ] [MAIN      ] CMRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:59:55.505673] [INFO ] [MAIN      ] CMRE: Wiping existing primary data before full refresh.
[2025-10-24T17:59:55.511040] [INFO ] [LOCAL     ] CMRE: Starting deletion of primary data.
[2025-10-24T17:59:55.555141] [WARN ] [MAIN      ] CMPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:59:55.580429] [WARN ] [MAIN      ] CMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T17:59:55.575161] [DEBUG] [LOCAL     ] CMRE: Deleted primary data file.
[2025-10-24T17:59:55.614158] [INFO ] [MAIN      ] CMPO: Wiping existing primary data before full refresh.
[2025-10-24T17:59:55.634640] [INFO ] [LOCAL     ] CMPO: Starting deletion of primary data.
[2025-10-24T17:59:55.631367] [INFO ] [MAIN      ] CMRE: Starting full primary refresh.
[2025-10-24T17:59:55.634802] [INFO ] [MAIN      ] CMS: Wiping existing primary data before full refresh.
[2025-10-24T17:59:55.646328] [INFO ] [LOCAL     ] CMS: Starting deletion of primary data.
[2025-10-24T17:59:55.698625] [DEBUG] [LOCAL     ] CMPO: Deleted primary data file.
[2025-10-24T17:59:55.703923] [INFO ] [MAIN      ] CMPO: Starting full primary refresh.
[2025-10-24T17:59:55.712306] [DEBUG] [LOCAL     ] CMS: Deleted primary data file.
[2025-10-24T17:59:55.735259] [INFO ] [MAIN      ] CMS: Starting full primary refresh.
[2025-10-24T17:59:56.604702] [INFO ] [REMOTE    ] CMSA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:59:56.729354] [INFO ] [REMOTE    ] CMSA: Fetching primary data for 2025-01.
[2025-10-24T17:59:56.816675] [INFO ] [REMOTE    ] CMRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:59:56.838094] [INFO ] [REMOTE    ] CMRE: Fetching primary data for 2025-01.
[2025-10-24T17:59:56.966772] [INFO ] [REMOTE    ] CMPO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:59:56.969424] [INFO ] [REMOTE    ] CMPO: Fetching primary data for 2025-01.
[2025-10-24T17:59:56.993015] [INFO ] [REMOTE    ] CMS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T17:59:56.995130] [INFO ] [REMOTE    ] CMS: Fetching primary data for 2025-01.
[2025-10-24T17:59:57.385813] [INFO ] [REMOTE    ] CMSA: Incremental fetch complete for 2025-01 (0.66 seconds).
[2025-10-24T17:59:57.387293] [INFO ] [REMOTE    ] CMSA: Fetching primary data for 2025-02.
[2025-10-24T17:59:57.892802] [INFO ] [REMOTE    ] CMSA: Incremental fetch complete for 2025-02 (0.51 seconds).
[2025-10-24T17:59:57.894070] [INFO ] [REMOTE    ] CMSA: Fetching primary data for 2025-03.
[2025-10-24T17:59:58.034533] [INFO ] [REMOTE    ] CMRE: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T17:59:58.040861] [INFO ] [REMOTE    ] CMRE: Fetching primary data for 2025-02.
[2025-10-24T17:59:58.205463] [INFO ] [REMOTE    ] CMPO: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T17:59:58.214154] [INFO ] [REMOTE    ] CMPO: Fetching primary data for 2025-02.
[2025-10-24T17:59:58.360151] [INFO ] [REMOTE    ] CMSA: Incremental fetch complete for 2025-03 (0.47 seconds).
[2025-10-24T17:59:58.487868] [INFO ] [REMOTE    ] CMS: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T17:59:58.547742] [INFO ] [REMOTE    ] CMSA: Fetching primary data for 2025-04.
[2025-10-24T17:59:58.872556] [INFO ] [REMOTE    ] CMSA: Incremental fetch complete for 2025-04 (0.32 seconds).
[2025-10-24T17:59:58.974787] [INFO ] [REMOTE    ] CMRE: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T17:59:59.347682] [INFO ] [REMOTE    ] CMSA: Fetching primary data for 2025-05.
[2025-10-24T17:59:59.648798] [INFO ] [REMOTE    ] CMPO: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T17:59:59.695160] [INFO ] [REMOTE    ] CMSA: Incremental fetch complete for 2025-05 (0.35 seconds).
[2025-10-24T18:00:00.147707] [INFO ] [REMOTE    ] CMSA: Fetching primary data for 2025-06.
[2025-10-24T18:00:00.844864] [INFO ] [REMOTE    ] CMSA: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T18:00:00.947606] [INFO ] [REMOTE    ] CMSA: Fetching primary data for 2025-07.
[2025-10-24T18:00:01.747674] [INFO ] [REMOTE    ] CMRE: Fetching primary data for 2025-03.
[2025-10-24T18:00:01.889713] [INFO ] [REMOTE    ] CMSA: Incremental fetch complete for 2025-07 (0.94 seconds).
[2025-10-24T18:00:02.547717] [INFO ] [REMOTE    ] CMPO: Fetching primary data for 2025-03.
[2025-10-24T18:00:03.347697] [INFO ] [REMOTE    ] CMS: Fetching primary data for 2025-02.
[2025-10-24T18:00:04.042022] [INFO ] [REMOTE    ] CMRE: Incremental fetch complete for 2025-03 (2.29 seconds).
[2025-10-24T18:00:04.147717] [INFO ] [REMOTE    ] CMRE: Fetching primary data for 2025-04.
[2025-10-24T18:00:04.800454] [INFO ] [REMOTE    ] CMPO: Incremental fetch complete for 2025-03 (2.25 seconds).
[2025-10-24T18:00:04.947612] [INFO ] [REMOTE    ] CMPO: Fetching primary data for 2025-04.
[2025-10-24T18:00:05.419228] [INFO ] [REMOTE    ] CMS: Incremental fetch complete for 2025-02 (2.07 seconds).
[2025-10-24T18:00:05.747741] [INFO ] [REMOTE    ] CMSA: Fetching primary data for 2025-08.
[2025-10-24T18:00:06.547680] [INFO ] [REMOTE    ] CMS: Fetching primary data for 2025-03.
[2025-10-24T18:00:06.724124] [INFO ] [REMOTE    ] CMSA: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T18:00:07.198101] [INFO ] [REMOTE    ] CMRE: Incremental fetch complete for 2025-04 (3.05 seconds).
[2025-10-24T18:00:07.347727] [INFO ] [REMOTE    ] CMRE: Fetching primary data for 2025-05.
[2025-10-24T18:00:07.556952] [INFO ] [REMOTE    ] CMPO: Incremental fetch complete for 2025-04 (2.61 seconds).
[2025-10-24T18:00:08.147707] [INFO ] [REMOTE    ] CMPO: Fetching primary data for 2025-05.
[2025-10-24T18:00:08.411024] [INFO ] [REMOTE    ] CMS: Incremental fetch complete for 2025-03 (1.86 seconds).
[2025-10-24T18:00:08.947687] [INFO ] [REMOTE    ] CMSA: Fetching primary data for 2025-09.
[2025-10-24T18:00:09.495901] [INFO ] [REMOTE    ] CMRE: Incremental fetch complete for 2025-05 (2.15 seconds).
[2025-10-24T18:00:09.525804] [INFO ] [REMOTE    ] CMPO: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T18:00:09.613333] [INFO ] [REMOTE    ] CMSA: Incremental fetch complete for 2025-09 (0.67 seconds).
[2025-10-24T18:00:09.747630] [INFO ] [REMOTE    ] CMS: Fetching primary data for 2025-04.
[2025-10-24T18:00:10.547673] [INFO ] [REMOTE    ] CMPO: Fetching primary data for 2025-06.
[2025-10-24T18:00:11.347736] [INFO ] [REMOTE    ] CMSA: Fetching primary data for 2025-10.
[2025-10-24T18:00:11.657299] [INFO ] [REMOTE    ] CMS: Incremental fetch complete for 2025-04 (1.91 seconds).
[2025-10-24T18:00:11.697727] [INFO ] [REMOTE    ] CMPO: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T18:00:11.816580] [INFO ] [REMOTE    ] CMSA: Incremental fetch complete for 2025-10 (0.47 seconds).
[2025-10-24T18:00:11.818495] [INFO ] [REMOTE    ] CMSA: Full fetch complete (4808 records).
[2025-10-24T18:00:11.818604] [DEBUG] [VALIDATOR ] CMSA: Validating primary data.
[2025-10-24T18:00:12.152819] [INFO ] [REMOTE    ] CMS: Fetching primary data for 2025-05.
[2025-10-24T18:00:12.200100] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present.
[2025-10-24T18:00:12.200192] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed.
[2025-10-24T18:00:12.200407] [INFO ] [MAIN      ] CMSA: Fetched primary data is valid.
[2025-10-24T18:00:12.200449] [DEBUG] [LOCAL     ] CMSA: Saving primary data.
[2025-10-24T18:00:12.200677] [FATAL] [LOCAL     ] CMSA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:00:12.200760] [FATAL] [MAIN      ] CMSA: Failed to save primary data.
[2025-10-24T18:00:12.200803] [WARN ] [MAIN      ] CMSA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:00:12.200866] [INFO ] [LOCAL     ] CMSA: Starting deletion of primary data.
[2025-10-24T18:00:12.200926] [DEBUG] [LOCAL     ] CMSA: No primary data file found to delete.
[2025-10-24T18:00:12.200963] [INFO ] [LOCAL     ] CMSA: Starting deletion of derivative data.
[2025-10-24T18:00:12.201127] [DEBUG] [LOCAL     ] CMSA: Deleted derivative data file.
[2025-10-24T18:00:12.201229] [INFO ] [MAIN      ] Update Progress: 481/2366 symbols completed. CMSA took 18.3s. Estimated remaining: 3h 55m 45s. Rate: 8.0 symbols/min
[2025-10-24T18:00:12.391151] [INFO ] [MAIN      ] CMSC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:00:12.398918] [DEBUG] [LOCAL     ] CMSC: Loaded 4826 existing records from primary storage.
[2025-10-24T18:00:12.399177] [INFO ] [MAIN      ] CMSC: Loaded 4826 existing records.
[2025-10-24T18:00:12.586239] [WARN ] [MAIN      ] CMSC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:00:12.586468] [INFO ] [MAIN      ] CMSC: Wiping existing primary data before full refresh.
[2025-10-24T18:00:12.586515] [INFO ] [LOCAL     ] CMSC: Starting deletion of primary data.
[2025-10-24T18:00:12.586710] [DEBUG] [LOCAL     ] CMSC: Deleted primary data file.
[2025-10-24T18:00:12.586766] [INFO ] [MAIN      ] CMSC: Starting full primary refresh.
[2025-10-24T18:00:12.944985] [INFO ] [REMOTE    ] CMSC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:00:12.947679] [INFO ] [REMOTE    ] CMSC: Fetching primary data for 2025-01.
[2025-10-24T18:00:13.747689] [INFO ] [REMOTE    ] CMPO: Fetching primary data for 2025-07.
[2025-10-24T18:00:13.839211] [INFO ] [REMOTE    ] CMS: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T18:00:14.465934] [INFO ] [REMOTE    ] CMSC: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T18:00:14.547611] [INFO ] [REMOTE    ] CMSC: Fetching primary data for 2025-02.
[2025-10-24T18:00:15.118774] [INFO ] [REMOTE    ] CMSC: Incremental fetch complete for 2025-02 (0.57 seconds).
[2025-10-24T18:00:15.122108] [INFO ] [REMOTE    ] CMPO: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T18:00:15.347666] [INFO ] [REMOTE    ] CMSC: Fetching primary data for 2025-03.
[2025-10-24T18:00:15.868434] [INFO ] [REMOTE    ] CMSC: Incremental fetch complete for 2025-03 (0.52 seconds).
[2025-10-24T18:00:16.147674] [INFO ] [REMOTE    ] CMSC: Fetching primary data for 2025-04.
[2025-10-24T18:00:16.947726] [INFO ] [REMOTE    ] CMRE: Fetching primary data for 2025-06.
[2025-10-24T18:00:17.712590] [INFO ] [REMOTE    ] CMSC: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T18:00:17.747618] [INFO ] [REMOTE    ] CMSC: Fetching primary data for 2025-05.
[2025-10-24T18:00:18.267094] [INFO ] [REMOTE    ] CMRE: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T18:00:18.547716] [INFO ] [REMOTE    ] CMS: Fetching primary data for 2025-06.
[2025-10-24T18:00:18.896805] [INFO ] [REMOTE    ] CMSC: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T18:00:19.347675] [INFO ] [REMOTE    ] CMSC: Fetching primary data for 2025-06.
[2025-10-24T18:00:20.010794] [INFO ] [REMOTE    ] CMSC: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T18:00:20.145151] [INFO ] [REMOTE    ] CMS: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T18:00:20.154866] [INFO ] [REMOTE    ] CMPO: Fetching primary data for 2025-08.
[2025-10-24T18:00:20.947688] [INFO ] [REMOTE    ] CMS: Fetching primary data for 2025-07.
[2025-10-24T18:00:21.747635] [INFO ] [REMOTE    ] CMRE: Fetching primary data for 2025-07.
[2025-10-24T18:00:21.828487] [INFO ] [REMOTE    ] CMPO: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T18:00:22.547735] [INFO ] [REMOTE    ] CMPO: Fetching primary data for 2025-09.
[2025-10-24T18:00:23.096502] [INFO ] [REMOTE    ] CMS: Incremental fetch complete for 2025-07 (2.15 seconds).
[2025-10-24T18:00:23.128409] [INFO ] [REMOTE    ] CMRE: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T18:00:23.347735] [INFO ] [REMOTE    ] CMS: Fetching primary data for 2025-08.
[2025-10-24T18:00:23.680178] [INFO ] [REMOTE    ] CMPO: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T18:00:24.147746] [INFO ] [REMOTE    ] CMPO: Fetching primary data for 2025-10.
[2025-10-24T18:00:24.947713] [INFO ] [REMOTE    ] CMRE: Fetching primary data for 2025-08.
[2025-10-24T18:00:25.152800] [INFO ] [REMOTE    ] CMS: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T18:00:25.522285] [INFO ] [REMOTE    ] CMPO: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T18:00:25.528235] [INFO ] [REMOTE    ] CMPO: Full fetch complete (57716 records).
[2025-10-24T18:00:25.528338] [DEBUG] [VALIDATOR ] CMPO: Validating primary data.
[2025-10-24T18:00:25.529158] [FATAL] [VALIDATOR ] CMPO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:00:25.529243] [FATAL] [MAIN      ] CMPO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:00:25.529285] [WARN ] [MAIN      ] CMPO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:00:25.529323] [INFO ] [LOCAL     ] CMPO: Starting deletion of primary data.
[2025-10-24T18:00:25.529376] [DEBUG] [LOCAL     ] CMPO: No primary data file found to delete.
[2025-10-24T18:00:25.529409] [INFO ] [LOCAL     ] CMPO: Starting deletion of derivative data.
[2025-10-24T18:00:25.529541] [DEBUG] [LOCAL     ] CMPO: Deleted derivative data file.
[2025-10-24T18:00:25.530133] [INFO ] [MAIN      ] Update Progress: 482/2366 symbols completed. CMPO took 31.7s. Estimated remaining: 3h 55m 60s. Rate: 8.0 symbols/min
[2025-10-24T18:00:25.702536] [INFO ] [MAIN      ] CMSD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:00:25.711896] [DEBUG] [LOCAL     ] CMSD: Loaded 7641 existing records from primary storage.
[2025-10-24T18:00:25.712142] [INFO ] [MAIN      ] CMSD: Loaded 7641 existing records.
[2025-10-24T18:00:25.753688] [INFO ] [REMOTE    ] CMS: Fetching primary data for 2025-09.
[2025-10-24T18:00:25.896169] [WARN ] [MAIN      ] CMSD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:00:25.896402] [INFO ] [MAIN      ] CMSD: Wiping existing primary data before full refresh.
[2025-10-24T18:00:25.896449] [INFO ] [LOCAL     ] CMSD: Starting deletion of primary data.
[2025-10-24T18:00:25.896687] [DEBUG] [LOCAL     ] CMSD: Deleted primary data file.
[2025-10-24T18:00:25.896748] [INFO ] [MAIN      ] CMSD: Starting full primary refresh.
[2025-10-24T18:00:26.238627] [INFO ] [REMOTE    ] CMRE: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T18:00:26.334551] [INFO ] [REMOTE    ] CMSD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:00:26.547673] [INFO ] [REMOTE    ] CMRE: Fetching primary data for 2025-09.
[2025-10-24T18:00:27.277479] [INFO ] [REMOTE    ] CMS: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T18:00:27.347610] [INFO ] [REMOTE    ] CMS: Fetching primary data for 2025-10.
[2025-10-24T18:00:27.685636] [INFO ] [REMOTE    ] CMRE: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T18:00:28.147730] [INFO ] [REMOTE    ] CMRE: Fetching primary data for 2025-10.
[2025-10-24T18:00:28.947616] [INFO ] [REMOTE    ] CMSD: Fetching primary data for 2025-01.
[2025-10-24T18:00:29.053189] [INFO ] [REMOTE    ] CMS: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T18:00:29.066883] [INFO ] [REMOTE    ] CMS: Full fetch complete (76272 records).
[2025-10-24T18:00:29.067094] [DEBUG] [VALIDATOR ] CMS: Validating primary data.
[2025-10-24T18:00:29.560329] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present.
[2025-10-24T18:00:29.560596] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed.
[2025-10-24T18:00:29.561995] [INFO ] [MAIN      ] CMS: Fetched primary data is valid.
[2025-10-24T18:00:29.562150] [DEBUG] [LOCAL     ] CMS: Saving primary data.
[2025-10-24T18:00:29.562967] [FATAL] [LOCAL     ] CMS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:00:29.563099] [FATAL] [MAIN      ] CMS: Failed to save primary data.
[2025-10-24T18:00:29.563153] [WARN ] [MAIN      ] CMS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:00:29.563203] [INFO ] [LOCAL     ] CMS: Starting deletion of primary data.
[2025-10-24T18:00:29.563281] [DEBUG] [LOCAL     ] CMS: No primary data file found to delete.
[2025-10-24T18:00:29.563351] [INFO ] [LOCAL     ] CMS: Starting deletion of derivative data.
[2025-10-24T18:00:29.563541] [DEBUG] [LOCAL     ] CMS: Deleted derivative data file.
[2025-10-24T18:00:29.564070] [INFO ] [MAIN      ] Update Progress: 483/2366 symbols completed. CMS took 35.7s. Estimated remaining: 3h 55m 39s. Rate: 8.0 symbols/min
[2025-10-24T18:00:29.758901] [INFO ] [REMOTE    ] CMRE: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T18:00:29.754565] [INFO ] [REMOTE    ] CMSC: Fetching primary data for 2025-07.
[2025-10-24T18:00:29.857296] [INFO ] [REMOTE    ] CMSD: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T18:00:29.862572] [INFO ] [MAIN      ] CMTG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:00:29.856413] [INFO ] [REMOTE    ] CMRE: Full fetch complete (50907 records).
[2025-10-24T18:00:29.867360] [DEBUG] [VALIDATOR ] CMRE: Validating primary data.
[2025-10-24T18:00:29.868730] [FATAL] [VALIDATOR ] CMRE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:00:29.868860] [FATAL] [MAIN      ] CMRE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:00:29.868942] [WARN ] [MAIN      ] CMRE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:00:29.869034] [INFO ] [LOCAL     ] CMRE: Starting deletion of primary data.
[2025-10-24T18:00:29.869126] [DEBUG] [LOCAL     ] CMRE: No primary data file found to delete.
[2025-10-24T18:00:29.869187] [INFO ] [LOCAL     ] CMRE: Starting deletion of derivative data.
[2025-10-24T18:00:29.869410] [DEBUG] [LOCAL     ] CMRE: Deleted derivative data file.
[2025-10-24T18:00:29.869809] [INFO ] [MAIN      ] Update Progress: 484/2366 symbols completed. CMRE took 36.0s. Estimated remaining: 3h 55m 3s. Rate: 8.0 symbols/min
[2025-10-24T18:00:30.081905] [INFO ] [MAIN      ] CMU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:00:30.082951] [DEBUG] [LOCAL     ] CMTG: Loaded 35366 existing records from primary storage.
[2025-10-24T18:00:30.083385] [INFO ] [MAIN      ] CMTG: Loaded 35366 existing records.
[2025-10-24T18:00:30.200492] [DEBUG] [LOCAL     ] CMU: Loaded 6355 existing records from primary storage.
[2025-10-24T18:00:30.206554] [INFO ] [MAIN      ] CMU: Loaded 6355 existing records.
[2025-10-24T18:00:30.389521] [WARN ] [MAIN      ] CMTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:00:30.390129] [INFO ] [MAIN      ] CMTG: Wiping existing primary data before full refresh.
[2025-10-24T18:00:30.405913] [INFO ] [LOCAL     ] CMTG: Starting deletion of primary data.
[2025-10-24T18:00:30.443160] [DEBUG] [LOCAL     ] CMTG: Deleted primary data file.
[2025-10-24T18:00:30.450359] [INFO ] [MAIN      ] CMTG: Starting full primary refresh.
[2025-10-24T18:00:30.493925] [WARN ] [MAIN      ] CMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:00:30.528579] [INFO ] [MAIN      ] CMU: Wiping existing primary data before full refresh.
[2025-10-24T18:00:30.538465] [INFO ] [LOCAL     ] CMU: Starting deletion of primary data.
[2025-10-24T18:00:30.555521] [INFO ] [REMOTE    ] CMSD: Fetching primary data for 2025-02.
[2025-10-24T18:00:30.575103] [DEBUG] [LOCAL     ] CMU: Deleted primary data file.
[2025-10-24T18:00:30.575297] [INFO ] [MAIN      ] CMU: Starting full primary refresh.
[2025-10-24T18:00:30.671223] [INFO ] [REMOTE    ] CMSC: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T18:00:31.151672] [INFO ] [REMOTE    ] CMTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:00:31.172929] [INFO ] [REMOTE    ] CMSD: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T18:00:31.230457] [INFO ] [REMOTE    ] CMU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:00:31.347696] [INFO ] [REMOTE    ] CMU: Fetching primary data for 2025-01.
[2025-10-24T18:00:32.115129] [INFO ] [REMOTE    ] CMU: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T18:00:32.147609] [INFO ] [REMOTE    ] CMTG: Fetching primary data for 2025-01.
[2025-10-24T18:00:32.947691] [INFO ] [REMOTE    ] CMSD: Fetching primary data for 2025-03.
[2025-10-24T18:00:33.690348] [INFO ] [REMOTE    ] CMTG: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T18:00:33.747596] [INFO ] [REMOTE    ] CMTG: Fetching primary data for 2025-02.
[2025-10-24T18:00:33.808950] [INFO ] [REMOTE    ] CMSD: Incremental fetch complete for 2025-03 (0.86 seconds).
[2025-10-24T18:00:34.547610] [INFO ] [REMOTE    ] CMSD: Fetching primary data for 2025-04.
[2025-10-24T18:00:34.953919] [INFO ] [REMOTE    ] CMTG: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T18:00:35.278133] [INFO ] [REMOTE    ] CMSD: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T18:00:35.347709] [INFO ] [REMOTE    ] CMSD: Fetching primary data for 2025-05.
[2025-10-24T18:00:36.085520] [INFO ] [REMOTE    ] CMSD: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T18:00:36.147686] [INFO ] [REMOTE    ] CMSC: Fetching primary data for 2025-08.
[2025-10-24T18:00:36.617907] [INFO ] [REMOTE    ] CMSC: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T18:00:36.947665] [INFO ] [REMOTE    ] CMTG: Fetching primary data for 2025-03.
[2025-10-24T18:00:37.747704] [INFO ] [REMOTE    ] CMSC: Fetching primary data for 2025-09.
[2025-10-24T18:00:38.408998] [INFO ] [REMOTE    ] CMTG: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T18:00:38.547609] [INFO ] [REMOTE    ] CMTG: Fetching primary data for 2025-04.
[2025-10-24T18:00:38.565483] [INFO ] [REMOTE    ] CMSC: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T18:00:39.347631] [INFO ] [REMOTE    ] CMU: Fetching primary data for 2025-02.
[2025-10-24T18:00:39.989936] [INFO ] [REMOTE    ] CMU: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T18:00:40.096376] [INFO ] [REMOTE    ] CMTG: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T18:00:40.147606] [INFO ] [REMOTE    ] CMTG: Fetching primary data for 2025-05.
[2025-10-24T18:00:40.947667] [INFO ] [REMOTE    ] CMU: Fetching primary data for 2025-03.
[2025-10-24T18:00:41.569580] [INFO ] [REMOTE    ] CMTG: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T18:00:41.734978] [INFO ] [REMOTE    ] CMU: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T18:00:41.747592] [INFO ] [REMOTE    ] CMU: Fetching primary data for 2025-04.
[2025-10-24T18:00:42.547622] [INFO ] [REMOTE    ] CMSD: Fetching primary data for 2025-06.
[2025-10-24T18:00:42.706577] [INFO ] [REMOTE    ] CMU: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T18:00:43.122781] [INFO ] [REMOTE    ] CMSD: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T18:00:43.347603] [INFO ] [REMOTE    ] CMSD: Fetching primary data for 2025-07.
[2025-10-24T18:00:43.925169] [INFO ] [REMOTE    ] CMSD: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T18:00:44.147686] [INFO ] [REMOTE    ] CMSD: Fetching primary data for 2025-08.
[2025-10-24T18:00:44.738330] [INFO ] [REMOTE    ] CMSD: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T18:00:44.947706] [INFO ] [REMOTE    ] CMU: Fetching primary data for 2025-05.
[2025-10-24T18:00:45.520103] [INFO ] [REMOTE    ] CMU: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T18:00:45.747675] [INFO ] [REMOTE    ] CMTG: Fetching primary data for 2025-06.
[2025-10-24T18:00:46.547667] [INFO ] [REMOTE    ] CMSD: Fetching primary data for 2025-09.
[2025-10-24T18:00:46.928911] [INFO ] [REMOTE    ] CMSD: Incremental fetch complete for 2025-09 (0.38 seconds).
[2025-10-24T18:00:47.271974] [INFO ] [REMOTE    ] CMTG: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T18:00:47.347638] [INFO ] [REMOTE    ] CMTG: Fetching primary data for 2025-07.
[2025-10-24T18:00:48.147669] [INFO ] [REMOTE    ] CMU: Fetching primary data for 2025-06.
[2025-10-24T18:00:48.604162] [INFO ] [REMOTE    ] CMU: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T18:00:48.699216] [INFO ] [REMOTE    ] CMTG: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T18:00:48.947631] [INFO ] [REMOTE    ] CMU: Fetching primary data for 2025-07.
[2025-10-24T18:00:49.747670] [INFO ] [REMOTE    ] CMTG: Fetching primary data for 2025-08.
[2025-10-24T18:00:49.786984] [INFO ] [REMOTE    ] CMU: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T18:00:50.547601] [INFO ] [REMOTE    ] CMSC: Fetching primary data for 2025-10.
[2025-10-24T18:00:51.031322] [INFO ] [REMOTE    ] CMTG: Incremental fetch complete for 2025-08 (1.28 seconds).
[2025-10-24T18:00:51.277491] [INFO ] [REMOTE    ] CMSC: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T18:00:51.279581] [INFO ] [REMOTE    ] CMSC: Full fetch complete (6875 records).
[2025-10-24T18:00:51.279720] [DEBUG] [VALIDATOR ] CMSC: Validating primary data.
[2025-10-24T18:00:51.280307] [FATAL] [VALIDATOR ] CMSC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:00:51.280414] [FATAL] [MAIN      ] CMSC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:00:51.280475] [WARN ] [MAIN      ] CMSC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:00:51.280524] [INFO ] [LOCAL     ] CMSC: Starting deletion of primary data.
[2025-10-24T18:00:51.280587] [DEBUG] [LOCAL     ] CMSC: No primary data file found to delete.
[2025-10-24T18:00:51.280712] [INFO ] [LOCAL     ] CMSC: Starting deletion of derivative data.
[2025-10-24T18:00:51.280875] [DEBUG] [LOCAL     ] CMSC: Deleted derivative data file.
[2025-10-24T18:00:51.280949] [INFO ] [MAIN      ] Update Progress: 485/2366 symbols completed. CMSC took 39.1s. Estimated remaining: 3h 55m 50s. Rate: 8.0 symbols/min
[2025-10-24T18:00:51.352936] [INFO ] [REMOTE    ] CMTG: Fetching primary data for 2025-09.
[2025-10-24T18:00:51.466373] [INFO ] [MAIN      ] CNA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:00:51.498460] [DEBUG] [LOCAL     ] CNA: Loaded 32677 existing records from primary storage.
[2025-10-24T18:00:51.498747] [INFO ] [MAIN      ] CNA: Loaded 32677 existing records.
[2025-10-24T18:00:51.672037] [WARN ] [MAIN      ] CNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:00:51.672208] [INFO ] [MAIN      ] CNA: Wiping existing primary data before full refresh.
[2025-10-24T18:00:51.672254] [INFO ] [LOCAL     ] CNA: Starting deletion of primary data.
[2025-10-24T18:00:51.672439] [DEBUG] [LOCAL     ] CNA: Deleted primary data file.
[2025-10-24T18:00:51.672477] [INFO ] [MAIN      ] CNA: Starting full primary refresh.
[2025-10-24T18:00:52.022531] [INFO ] [REMOTE    ] CNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:00:52.147597] [INFO ] [REMOTE    ] CNA: Fetching primary data for 2025-01.
[2025-10-24T18:00:52.584465] [INFO ] [REMOTE    ] CMTG: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T18:00:52.947702] [INFO ] [REMOTE    ] CMU: Fetching primary data for 2025-08.
[2025-10-24T18:00:53.337262] [INFO ] [REMOTE    ] CNA: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T18:00:53.670522] [INFO ] [REMOTE    ] CMU: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T18:00:53.747680] [INFO ] [REMOTE    ] CMSD: Fetching primary data for 2025-10.
[2025-10-24T18:00:54.547695] [INFO ] [REMOTE    ] CMU: Fetching primary data for 2025-09.
[2025-10-24T18:00:54.618490] [INFO ] [REMOTE    ] CMSD: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T18:00:54.620304] [INFO ] [REMOTE    ] CMSD: Full fetch complete (11419 records).
[2025-10-24T18:00:54.620377] [DEBUG] [VALIDATOR ] CMSD: Validating primary data.
[2025-10-24T18:00:55.022363] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present.
[2025-10-24T18:00:55.022438] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed.
[2025-10-24T18:00:55.022708] [INFO ] [MAIN      ] CMSD: Fetched primary data is valid.
[2025-10-24T18:00:55.022771] [DEBUG] [LOCAL     ] CMSD: Saving primary data.
[2025-10-24T18:00:55.022987] [FATAL] [LOCAL     ] CMSD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:00:55.023066] [FATAL] [MAIN      ] CMSD: Failed to save primary data.
[2025-10-24T18:00:55.023109] [WARN ] [MAIN      ] CMSD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:00:55.023143] [INFO ] [LOCAL     ] CMSD: Starting deletion of primary data.
[2025-10-24T18:00:55.023192] [DEBUG] [LOCAL     ] CMSD: No primary data file found to delete.
[2025-10-24T18:00:55.023226] [INFO ] [LOCAL     ] CMSD: Starting deletion of derivative data.
[2025-10-24T18:00:55.023395] [DEBUG] [LOCAL     ] CMSD: Deleted derivative data file.
[2025-10-24T18:00:55.023480] [INFO ] [MAIN      ] Update Progress: 486/2366 symbols completed. CMSD took 29.5s. Estimated remaining: 3h 55m 28s. Rate: 8.0 symbols/min
[2025-10-24T18:00:55.146098] [INFO ] [REMOTE    ] CMU: Incremental fetch complete for 2025-09 (0.60 seconds).
[2025-10-24T18:00:55.199872] [INFO ] [MAIN      ] CNC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:00:55.250744] [DEBUG] [LOCAL     ] CNC: Loaded 54169 existing records from primary storage.
[2025-10-24T18:00:55.251054] [INFO ] [MAIN      ] CNC: Loaded 54169 existing records.
[2025-10-24T18:00:55.350819] [INFO ] [REMOTE    ] CNA: Fetching primary data for 2025-02.
[2025-10-24T18:00:55.459317] [WARN ] [MAIN      ] CNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:00:55.459552] [INFO ] [MAIN      ] CNC: Wiping existing primary data before full refresh.
[2025-10-24T18:00:55.459600] [INFO ] [LOCAL     ] CNC: Starting deletion of primary data.
[2025-10-24T18:00:55.459815] [DEBUG] [LOCAL     ] CNC: Deleted primary data file.
[2025-10-24T18:00:55.459872] [INFO ] [MAIN      ] CNC: Starting full primary refresh.
[2025-10-24T18:00:55.856136] [INFO ] [REMOTE    ] CNC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:00:56.147691] [INFO ] [REMOTE    ] CNC: Fetching primary data for 2025-01.
[2025-10-24T18:00:56.773236] [INFO ] [REMOTE    ] CNA: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T18:00:56.947672] [INFO ] [REMOTE    ] CMU: Fetching primary data for 2025-10.
[2025-10-24T18:00:57.526668] [INFO ] [REMOTE    ] CMU: Incremental fetch complete for 2025-10 (0.58 seconds).
[2025-10-24T18:00:57.528543] [INFO ] [REMOTE    ] CMU: Full fetch complete (9468 records).
[2025-10-24T18:00:57.528740] [DEBUG] [VALIDATOR ] CMU: Validating primary data.
[2025-10-24T18:00:57.752804] [INFO ] [REMOTE    ] CMTG: Fetching primary data for 2025-10.
[2025-10-24T18:00:57.924519] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present.
[2025-10-24T18:00:57.924672] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed.
[2025-10-24T18:00:57.925209] [INFO ] [MAIN      ] CMU: Fetched primary data is valid.
[2025-10-24T18:00:57.925342] [DEBUG] [LOCAL     ] CMU: Saving primary data.
[2025-10-24T18:00:57.925872] [FATAL] [LOCAL     ] CMU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:00:57.941376] [FATAL] [MAIN      ] CMU: Failed to save primary data.
[2025-10-24T18:00:57.950606] [WARN ] [MAIN      ] CMU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:00:57.953538] [INFO ] [LOCAL     ] CMU: Starting deletion of primary data.
[2025-10-24T18:00:57.953746] [DEBUG] [LOCAL     ] CMU: No primary data file found to delete.
[2025-10-24T18:00:57.953800] [INFO ] [LOCAL     ] CMU: Starting deletion of derivative data.
[2025-10-24T18:00:57.954126] [DEBUG] [LOCAL     ] CMU: Deleted derivative data file.
[2025-10-24T18:00:57.954241] [INFO ] [MAIN      ] Update Progress: 487/2366 symbols completed. CMU took 28.1s. Estimated remaining: 3h 55m 2s. Rate: 8.0 symbols/min
[2025-10-24T18:00:57.961411] [INFO ] [REMOTE    ] CNC: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T18:00:58.140859] [INFO ] [MAIN      ] CNF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:00:58.152620] [DEBUG] [LOCAL     ] CNF: Loaded 10614 existing records from primary storage.
[2025-10-24T18:00:58.152877] [INFO ] [MAIN      ] CNF: Loaded 10614 existing records.
[2025-10-24T18:00:58.326994] [WARN ] [MAIN      ] CNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:00:58.327242] [INFO ] [MAIN      ] CNF: Wiping existing primary data before full refresh.
[2025-10-24T18:00:58.327299] [INFO ] [LOCAL     ] CNF: Starting deletion of primary data.
[2025-10-24T18:00:58.327485] [DEBUG] [LOCAL     ] CNF: Deleted primary data file.
[2025-10-24T18:00:58.327540] [INFO ] [MAIN      ] CNF: Starting full primary refresh.
[2025-10-24T18:00:58.552856] [INFO ] [REMOTE    ] CNC: Fetching primary data for 2025-02.
[2025-10-24T18:00:58.687987] [INFO ] [REMOTE    ] CNF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:00:59.291328] [INFO ] [REMOTE    ] CMTG: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T18:00:59.296771] [INFO ] [REMOTE    ] CMTG: Full fetch complete (52676 records).
[2025-10-24T18:00:59.296911] [DEBUG] [VALIDATOR ] CMTG: Validating primary data.
[2025-10-24T18:00:59.359857] [INFO ] [REMOTE    ] CNA: Fetching primary data for 2025-03.
[2025-10-24T18:00:59.673974] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present.
[2025-10-24T18:00:59.674068] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed.
[2025-10-24T18:00:59.675090] [INFO ] [MAIN      ] CMTG: Fetched primary data is valid.
[2025-10-24T18:00:59.675153] [DEBUG] [LOCAL     ] CMTG: Saving primary data.
[2025-10-24T18:00:59.675571] [FATAL] [LOCAL     ] CMTG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:00:59.675676] [FATAL] [MAIN      ] CMTG: Failed to save primary data.
[2025-10-24T18:00:59.675730] [WARN ] [MAIN      ] CMTG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:00:59.675766] [INFO ] [LOCAL     ] CMTG: Starting deletion of primary data.
[2025-10-24T18:00:59.675816] [DEBUG] [LOCAL     ] CMTG: No primary data file found to delete.
[2025-10-24T18:00:59.675849] [INFO ] [LOCAL     ] CMTG: Starting deletion of derivative data.
[2025-10-24T18:00:59.676003] [DEBUG] [LOCAL     ] CMTG: Deleted derivative data file.
[2025-10-24T18:00:59.676323] [INFO ] [MAIN      ] Update Progress: 488/2366 symbols completed. CMTG took 30.1s. Estimated remaining: 3h 54m 33s. Rate: 8.0 symbols/min
[2025-10-24T18:00:59.848896] [INFO ] [MAIN      ] CNH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:00:59.905972] [DEBUG] [LOCAL     ] CNH: Loaded 53936 existing records from primary storage.
[2025-10-24T18:00:59.906278] [INFO ] [MAIN      ] CNH: Loaded 53936 existing records.
[2025-10-24T18:01:00.085259] [WARN ] [MAIN      ] CNH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:01:00.085604] [INFO ] [MAIN      ] CNH: Wiping existing primary data before full refresh.
[2025-10-24T18:01:00.085690] [INFO ] [LOCAL     ] CNH: Starting deletion of primary data.
[2025-10-24T18:01:00.086178] [DEBUG] [LOCAL     ] CNH: Deleted primary data file.
[2025-10-24T18:01:00.086234] [INFO ] [MAIN      ] CNH: Starting full primary refresh.
[2025-10-24T18:01:00.155430] [INFO ] [REMOTE    ] CNF: Fetching primary data for 2025-01.
[2025-10-24T18:01:00.232535] [INFO ] [REMOTE    ] CNC: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T18:01:00.543847] [INFO ] [REMOTE    ] CNH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:01:00.719310] [INFO ] [REMOTE    ] CNA: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T18:01:00.947639] [INFO ] [REMOTE    ] CNA: Fetching primary data for 2025-04.
[2025-10-24T18:01:01.579534] [INFO ] [REMOTE    ] CNF: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T18:01:01.747709] [INFO ] [REMOTE    ] CNF: Fetching primary data for 2025-02.
[2025-10-24T18:01:02.547781] [INFO ] [REMOTE    ] CNH: Fetching primary data for 2025-01.
[2025-10-24T18:01:03.347691] [INFO ] [REMOTE    ] CNC: Fetching primary data for 2025-03.
[2025-10-24T18:01:03.478292] [INFO ] [REMOTE    ] CNA: Incremental fetch complete for 2025-04 (2.53 seconds).
[2025-10-24T18:01:03.628753] [INFO ] [REMOTE    ] CNF: Incremental fetch complete for 2025-02 (1.88 seconds).
[2025-10-24T18:01:04.147698] [INFO ] [REMOTE    ] CNA: Fetching primary data for 2025-05.
[2025-10-24T18:01:04.288830] [INFO ] [REMOTE    ] CNH: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T18:01:04.947730] [INFO ] [REMOTE    ] CNF: Fetching primary data for 2025-03.
[2025-10-24T18:01:05.678692] [INFO ] [REMOTE    ] CNA: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T18:01:05.731163] [INFO ] [REMOTE    ] CNF: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T18:01:05.747601] [INFO ] [REMOTE    ] CNF: Fetching primary data for 2025-04.
[2025-10-24T18:01:05.821510] [INFO ] [REMOTE    ] CNC: Incremental fetch complete for 2025-03 (2.47 seconds).
[2025-10-24T18:01:06.103950] [INFO ] [REMOTE    ] CNF: Incremental fetch complete for 2025-04 (0.36 seconds).
[2025-10-24T18:01:06.547678] [INFO ] [REMOTE    ] CNH: Fetching primary data for 2025-02.
[2025-10-24T18:01:07.347675] [INFO ] [REMOTE    ] CNA: Fetching primary data for 2025-06.
[2025-10-24T18:01:08.147631] [INFO ] [REMOTE    ] CNC: Fetching primary data for 2025-04.
[2025-10-24T18:01:08.385463] [INFO ] [REMOTE    ] CNH: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T18:01:08.694938] [INFO ] [REMOTE    ] CNA: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T18:01:08.947624] [INFO ] [REMOTE    ] CNH: Fetching primary data for 2025-03.
[2025-10-24T18:01:09.747623] [INFO ] [REMOTE    ] CNA: Fetching primary data for 2025-07.
[2025-10-24T18:01:09.959137] [INFO ] [REMOTE    ] CNC: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T18:01:10.359914] [INFO ] [REMOTE    ] CNH: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T18:01:10.547638] [INFO ] [REMOTE    ] CNH: Fetching primary data for 2025-04.
[2025-10-24T18:01:10.986227] [INFO ] [REMOTE    ] CNA: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T18:01:11.347704] [INFO ] [REMOTE    ] CNF: Fetching primary data for 2025-05.
[2025-10-24T18:01:12.147620] [INFO ] [REMOTE    ] CNC: Fetching primary data for 2025-05.
[2025-10-24T18:01:12.220719] [INFO ] [REMOTE    ] CNF: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T18:01:12.433631] [INFO ] [REMOTE    ] CNH: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T18:01:12.947673] [INFO ] [REMOTE    ] CNF: Fetching primary data for 2025-06.
[2025-10-24T18:01:13.747633] [INFO ] [REMOTE    ] CNA: Fetching primary data for 2025-08.
[2025-10-24T18:01:13.851321] [INFO ] [REMOTE    ] CNF: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T18:01:14.057460] [INFO ] [REMOTE    ] CNC: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T18:01:14.547696] [INFO ] [REMOTE    ] CNC: Fetching primary data for 2025-06.
[2025-10-24T18:01:15.092920] [INFO ] [REMOTE    ] CNA: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T18:01:15.347682] [INFO ] [REMOTE    ] CNH: Fetching primary data for 2025-05.
[2025-10-24T18:01:16.147607] [INFO ] [REMOTE    ] CNA: Fetching primary data for 2025-09.
[2025-10-24T18:01:16.260636] [INFO ] [REMOTE    ] CNC: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T18:01:16.947610] [INFO ] [REMOTE    ] CNF: Fetching primary data for 2025-07.
[2025-10-24T18:01:17.218429] [INFO ] [REMOTE    ] CNH: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T18:01:17.392754] [INFO ] [REMOTE    ] CNF: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T18:01:17.633952] [INFO ] [REMOTE    ] CNA: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T18:01:17.747675] [INFO ] [REMOTE    ] CNF: Fetching primary data for 2025-08.
[2025-10-24T18:01:18.547616] [INFO ] [REMOTE    ] CNH: Fetching primary data for 2025-06.
[2025-10-24T18:01:18.704358] [INFO ] [REMOTE    ] CNF: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T18:01:19.347635] [INFO ] [REMOTE    ] CNA: Fetching primary data for 2025-10.
[2025-10-24T18:01:20.086288] [INFO ] [REMOTE    ] CNH: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T18:01:20.147613] [INFO ] [REMOTE    ] CNC: Fetching primary data for 2025-07.
[2025-10-24T18:01:20.474572] [INFO ] [REMOTE    ] CNA: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T18:01:20.480133] [INFO ] [REMOTE    ] CNA: Full fetch complete (46111 records).
[2025-10-24T18:01:20.480225] [DEBUG] [VALIDATOR ] CNA: Validating primary data.
[2025-10-24T18:01:20.855167] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present.
[2025-10-24T18:01:20.855263] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed.
[2025-10-24T18:01:20.855948] [INFO ] [MAIN      ] CNA: Fetched primary data is valid.
[2025-10-24T18:01:20.856012] [DEBUG] [LOCAL     ] CNA: Saving primary data.
[2025-10-24T18:01:20.856512] [FATAL] [LOCAL     ] CNA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:01:20.856601] [FATAL] [MAIN      ] CNA: Failed to save primary data.
[2025-10-24T18:01:20.856823] [WARN ] [MAIN      ] CNA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:01:20.856895] [INFO ] [LOCAL     ] CNA: Starting deletion of primary data.
[2025-10-24T18:01:20.856955] [DEBUG] [LOCAL     ] CNA: No primary data file found to delete.
[2025-10-24T18:01:20.856991] [INFO ] [LOCAL     ] CNA: Starting deletion of derivative data.
[2025-10-24T18:01:20.857207] [DEBUG] [LOCAL     ] CNA: Deleted derivative data file.
[2025-10-24T18:01:20.857683] [INFO ] [MAIN      ] Update Progress: 489/2366 symbols completed. CNA took 29.6s. Estimated remaining: 3h 55m 18s. Rate: 8.0 symbols/min
[2025-10-24T18:01:20.954144] [INFO ] [REMOTE    ] CNH: Fetching primary data for 2025-07.
[2025-10-24T18:01:21.028300] [INFO ] [MAIN      ] CNI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:01:21.080257] [DEBUG] [LOCAL     ] CNI: Loaded 52019 existing records from primary storage.
[2025-10-24T18:01:21.080567] [INFO ] [MAIN      ] CNI: Loaded 52019 existing records.
[2025-10-24T18:01:21.254000] [WARN ] [MAIN      ] CNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:01:21.254243] [INFO ] [MAIN      ] CNI: Wiping existing primary data before full refresh.
[2025-10-24T18:01:21.254293] [INFO ] [LOCAL     ] CNI: Starting deletion of primary data.
[2025-10-24T18:01:21.254870] [DEBUG] [LOCAL     ] CNI: Deleted primary data file.
[2025-10-24T18:01:21.254950] [INFO ] [MAIN      ] CNI: Starting full primary refresh.
[2025-10-24T18:01:21.609502] [INFO ] [REMOTE    ] CNI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:01:21.747675] [INFO ] [REMOTE    ] CNF: Fetching primary data for 2025-09.
[2025-10-24T18:01:22.547734] [INFO ] [REMOTE    ] CNI: Fetching primary data for 2025-01.
[2025-10-24T18:01:22.603434] [INFO ] [REMOTE    ] CNC: Incremental fetch complete for 2025-07 (2.46 seconds).
[2025-10-24T18:01:22.684705] [INFO ] [REMOTE    ] CNH: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T18:01:22.781475] [INFO ] [REMOTE    ] CNF: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T18:01:23.347676] [INFO ] [REMOTE    ] CNF: Fetching primary data for 2025-10.
[2025-10-24T18:01:23.881187] [INFO ] [REMOTE    ] CNF: Incremental fetch complete for 2025-10 (0.53 seconds).
[2025-10-24T18:01:23.882838] [INFO ] [REMOTE    ] CNF: Full fetch complete (12987 records).
[2025-10-24T18:01:23.882910] [DEBUG] [VALIDATOR ] CNF: Validating primary data.
[2025-10-24T18:01:24.152809] [INFO ] [REMOTE    ] CNC: Fetching primary data for 2025-08.
[2025-10-24T18:01:24.291065] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present.
[2025-10-24T18:01:24.291255] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed.
[2025-10-24T18:01:24.291620] [INFO ] [MAIN      ] CNF: Fetched primary data is valid.
[2025-10-24T18:01:24.291713] [DEBUG] [LOCAL     ] CNF: Saving primary data.
[2025-10-24T18:01:24.292043] [FATAL] [LOCAL     ] CNF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:01:24.292122] [FATAL] [MAIN      ] CNF: Failed to save primary data.
[2025-10-24T18:01:24.292165] [WARN ] [MAIN      ] CNF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:01:24.292227] [INFO ] [LOCAL     ] CNF: Starting deletion of primary data.
[2025-10-24T18:01:24.292285] [DEBUG] [LOCAL     ] CNF: No primary data file found to delete.
[2025-10-24T18:01:24.292321] [INFO ] [LOCAL     ] CNF: Starting deletion of derivative data.
[2025-10-24T18:01:24.292452] [DEBUG] [LOCAL     ] CNF: Deleted derivative data file.
[2025-10-24T18:01:24.292546] [INFO ] [MAIN      ] Update Progress: 490/2366 symbols completed. CNF took 26.3s. Estimated remaining: 3h 54m 54s. Rate: 8.0 symbols/min
[2025-10-24T18:01:24.515228] [INFO ] [MAIN      ] CNK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:01:24.519479] [DEBUG] [LOCAL     ] CNK: No existing data file found in primary storage.
[2025-10-24T18:01:24.519552] [WARN ] [MAIN      ] CNK: No existing data found, performing full refresh instead.
[2025-10-24T18:01:24.519915] [INFO ] [MAIN      ] CNK: Wiping existing primary data before full refresh.
[2025-10-24T18:01:24.519983] [INFO ] [LOCAL     ] CNK: Starting deletion of primary data.
[2025-10-24T18:01:24.520224] [DEBUG] [LOCAL     ] CNK: No primary data file found to delete.
[2025-10-24T18:01:24.520293] [INFO ] [MAIN      ] CNK: Starting full primary refresh.
[2025-10-24T18:01:24.555962] [INFO ] [REMOTE    ] CNI: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T18:01:24.907388] [INFO ] [REMOTE    ] CNK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:01:24.947629] [INFO ] [REMOTE    ] CNK: Fetching primary data for 2025-01.
[2025-10-24T18:01:25.747675] [INFO ] [REMOTE    ] CNH: Fetching primary data for 2025-08.
[2025-10-24T18:01:26.503599] [INFO ] [REMOTE    ] CNC: Incremental fetch complete for 2025-08 (2.35 seconds).
[2025-10-24T18:01:26.543486] [INFO ] [REMOTE    ] CNK: Incremental fetch complete for 2025-01 (1.60 seconds).
[2025-10-24T18:01:26.552760] [INFO ] [REMOTE    ] CNC: Fetching primary data for 2025-09.
[2025-10-24T18:01:27.347680] [INFO ] [REMOTE    ] CNI: Fetching primary data for 2025-02.
[2025-10-24T18:01:27.574805] [INFO ] [REMOTE    ] CNH: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T18:01:28.147689] [INFO ] [REMOTE    ] CNH: Fetching primary data for 2025-09.
[2025-10-24T18:01:28.717170] [INFO ] [REMOTE    ] CNC: Incremental fetch complete for 2025-09 (2.16 seconds).
[2025-10-24T18:01:28.816288] [INFO ] [REMOTE    ] CNI: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T18:01:28.947668] [INFO ] [REMOTE    ] CNC: Fetching primary data for 2025-10.
[2025-10-24T18:01:29.747678] [INFO ] [REMOTE    ] CNK: Fetching primary data for 2025-02.
[2025-10-24T18:01:30.227327] [INFO ] [REMOTE    ] CNH: Incremental fetch complete for 2025-09 (2.08 seconds).
[2025-10-24T18:01:30.547744] [INFO ] [REMOTE    ] CNI: Fetching primary data for 2025-03.
[2025-10-24T18:01:31.022559] [INFO ] [REMOTE    ] CNK: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T18:01:31.344844] [INFO ] [REMOTE    ] CNC: Incremental fetch complete for 2025-10 (2.40 seconds).
[2025-10-24T18:01:31.353830] [INFO ] [REMOTE    ] CNK: Fetching primary data for 2025-03.
[2025-10-24T18:01:31.356097] [INFO ] [REMOTE    ] CNC: Full fetch complete (77864 records).
[2025-10-24T18:01:31.356233] [DEBUG] [VALIDATOR ] CNC: Validating primary data.
[2025-10-24T18:01:31.761754] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present.
[2025-10-24T18:01:31.761859] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed.
[2025-10-24T18:01:31.762807] [INFO ] [MAIN      ] CNC: Fetched primary data is valid.
[2025-10-24T18:01:31.762872] [DEBUG] [LOCAL     ] CNC: Saving primary data.
[2025-10-24T18:01:31.763528] [FATAL] [LOCAL     ] CNC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:01:31.763626] [FATAL] [MAIN      ] CNC: Failed to save primary data.
[2025-10-24T18:01:31.763720] [WARN ] [MAIN      ] CNC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:01:31.763778] [INFO ] [LOCAL     ] CNC: Starting deletion of primary data.
[2025-10-24T18:01:31.763842] [DEBUG] [LOCAL     ] CNC: No primary data file found to delete.
[2025-10-24T18:01:31.763881] [INFO ] [LOCAL     ] CNC: Starting deletion of derivative data.
[2025-10-24T18:01:31.764024] [DEBUG] [LOCAL     ] CNC: Deleted derivative data file.
[2025-10-24T18:01:31.764811] [INFO ] [MAIN      ] Update Progress: 491/2366 symbols completed. CNC took 36.7s. Estimated remaining: 3h 54m 47s. Rate: 8.0 symbols/min
[2025-10-24T18:01:31.938029] [INFO ] [MAIN      ] CNM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:01:31.987030] [DEBUG] [LOCAL     ] CNM: Loaded 51372 existing records from primary storage.
[2025-10-24T18:01:31.987367] [INFO ] [MAIN      ] CNM: Loaded 51372 existing records.
[2025-10-24T18:01:32.177635] [WARN ] [MAIN      ] CNM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:01:32.170941] [INFO ] [REMOTE    ] CNH: Fetching primary data for 2025-10.
[2025-10-24T18:01:32.178620] [INFO ] [MAIN      ] CNM: Wiping existing primary data before full refresh.
[2025-10-24T18:01:32.178727] [INFO ] [LOCAL     ] CNM: Starting deletion of primary data.
[2025-10-24T18:01:32.180081] [DEBUG] [LOCAL     ] CNM: Deleted primary data file.
[2025-10-24T18:01:32.180168] [INFO ] [MAIN      ] CNM: Starting full primary refresh.
[2025-10-24T18:01:32.548542] [INFO ] [REMOTE    ] CNM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:01:32.578833] [INFO ] [REMOTE    ] CNI: Incremental fetch complete for 2025-03 (2.03 seconds).
[2025-10-24T18:01:32.947691] [INFO ] [REMOTE    ] CNM: Fetching primary data for 2025-01.
[2025-10-24T18:01:33.282785] [INFO ] [REMOTE    ] CNK: Incremental fetch complete for 2025-03 (1.93 seconds).
[2025-10-24T18:01:33.747671] [INFO ] [REMOTE    ] CNI: Fetching primary data for 2025-04.
[2025-10-24T18:01:33.836286] [INFO ] [REMOTE    ] CNH: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T18:01:33.846180] [INFO ] [REMOTE    ] CNH: Full fetch complete (77703 records).
[2025-10-24T18:01:33.846339] [DEBUG] [VALIDATOR ] CNH: Validating primary data.
[2025-10-24T18:01:34.254280] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present.
[2025-10-24T18:01:34.254355] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed.
[2025-10-24T18:01:34.255266] [INFO ] [MAIN      ] CNH: Fetched primary data is valid.
[2025-10-24T18:01:34.255365] [DEBUG] [LOCAL     ] CNH: Saving primary data.
[2025-10-24T18:01:34.255999] [FATAL] [LOCAL     ] CNH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:01:34.256082] [FATAL] [MAIN      ] CNH: Failed to save primary data.
[2025-10-24T18:01:34.256148] [WARN ] [MAIN      ] CNH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:01:34.256218] [INFO ] [LOCAL     ] CNH: Starting deletion of primary data.
[2025-10-24T18:01:34.256280] [DEBUG] [LOCAL     ] CNH: No primary data file found to delete.
[2025-10-24T18:01:34.256317] [INFO ] [LOCAL     ] CNH: Starting deletion of derivative data.
[2025-10-24T18:01:34.256450] [DEBUG] [LOCAL     ] CNH: Deleted derivative data file.
[2025-10-24T18:01:34.257342] [INFO ] [MAIN      ] Update Progress: 492/2366 symbols completed. CNH took 34.6s. Estimated remaining: 3h 54m 20s. Rate: 8.0 symbols/min
[2025-10-24T18:01:34.427747] [INFO ] [MAIN      ] CNMD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:01:34.459542] [DEBUG] [LOCAL     ] CNMD: Loaded 32316 existing records from primary storage.
[2025-10-24T18:01:34.459847] [INFO ] [MAIN      ] CNMD: Loaded 32316 existing records.
[2025-10-24T18:01:34.552258] [INFO ] [REMOTE    ] CNK: Fetching primary data for 2025-04.
[2025-10-24T18:01:34.643613] [WARN ] [MAIN      ] CNMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:01:34.643991] [INFO ] [MAIN      ] CNMD: Wiping existing primary data before full refresh.
[2025-10-24T18:01:34.644235] [INFO ] [LOCAL     ] CNMD: Starting deletion of primary data.
[2025-10-24T18:01:34.644542] [DEBUG] [LOCAL     ] CNMD: Deleted primary data file.
[2025-10-24T18:01:34.644711] [INFO ] [MAIN      ] CNMD: Starting full primary refresh.
[2025-10-24T18:01:34.844447] [INFO ] [REMOTE    ] CNM: Incremental fetch complete for 2025-01 (1.90 seconds).
[2025-10-24T18:01:35.063028] [INFO ] [REMOTE    ] CNMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:01:35.335400] [INFO ] [REMOTE    ] CNI: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T18:01:35.347596] [INFO ] [REMOTE    ] CNI: Fetching primary data for 2025-05.
[2025-10-24T18:01:35.979734] [INFO ] [REMOTE    ] CNK: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T18:01:36.147687] [INFO ] [REMOTE    ] CNMD: Fetching primary data for 2025-01.
[2025-10-24T18:01:36.947614] [INFO ] [REMOTE    ] CNK: Fetching primary data for 2025-05.
[2025-10-24T18:01:37.110557] [INFO ] [REMOTE    ] CNI: Incremental fetch complete for 2025-05 (1.76 seconds).
[2025-10-24T18:01:37.605708] [INFO ] [REMOTE    ] CNMD: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T18:01:37.747629] [INFO ] [REMOTE    ] CNMD: Fetching primary data for 2025-02.
[2025-10-24T18:01:38.547634] [INFO ] [REMOTE    ] CNI: Fetching primary data for 2025-06.
[2025-10-24T18:01:38.698216] [INFO ] [REMOTE    ] CNK: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T18:01:39.347608] [INFO ] [REMOTE    ] CNM: Fetching primary data for 2025-02.
[2025-10-24T18:01:40.116773] [INFO ] [REMOTE    ] CNI: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T18:01:40.147635] [INFO ] [REMOTE    ] CNK: Fetching primary data for 2025-06.
[2025-10-24T18:01:40.920730] [INFO ] [REMOTE    ] CNM: Incremental fetch complete for 2025-02 (1.57 seconds).
[2025-10-24T18:01:40.947604] [INFO ] [REMOTE    ] CNM: Fetching primary data for 2025-03.
[2025-10-24T18:01:41.205462] [INFO ] [REMOTE    ] CNMD: Incremental fetch complete for 2025-02 (3.46 seconds).
[2025-10-24T18:01:41.747686] [INFO ] [REMOTE    ] CNMD: Fetching primary data for 2025-03.
[2025-10-24T18:01:41.797018] [INFO ] [REMOTE    ] CNK: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T18:01:42.547707] [INFO ] [REMOTE    ] CNI: Fetching primary data for 2025-07.
[2025-10-24T18:01:42.616628] [INFO ] [REMOTE    ] CNM: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T18:01:42.759015] [INFO ] [REMOTE    ] CNMD: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T18:01:43.347622] [INFO ] [REMOTE    ] CNM: Fetching primary data for 2025-04.
[2025-10-24T18:01:44.147613] [INFO ] [REMOTE    ] CNK: Fetching primary data for 2025-07.
[2025-10-24T18:01:44.429628] [INFO ] [REMOTE    ] CNI: Incremental fetch complete for 2025-07 (1.88 seconds).
[2025-10-24T18:01:44.947615] [INFO ] [REMOTE    ] CNMD: Fetching primary data for 2025-04.
[2025-10-24T18:01:45.152901] [INFO ] [REMOTE    ] CNM: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T18:01:45.752731] [INFO ] [REMOTE    ] CNM: Fetching primary data for 2025-05.
[2025-10-24T18:01:45.768220] [INFO ] [REMOTE    ] CNK: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T18:01:46.043792] [INFO ] [REMOTE    ] CNMD: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T18:01:46.547638] [INFO ] [REMOTE    ] CNK: Fetching primary data for 2025-08.
[2025-10-24T18:01:47.150599] [INFO ] [REMOTE    ] CNM: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T18:01:47.347636] [INFO ] [REMOTE    ] CNI: Fetching primary data for 2025-08.
[2025-10-24T18:01:48.147684] [INFO ] [REMOTE    ] CNMD: Fetching primary data for 2025-05.
[2025-10-24T18:01:48.456483] [INFO ] [REMOTE    ] CNK: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T18:01:48.947623] [INFO ] [REMOTE    ] CNM: Fetching primary data for 2025-06.
[2025-10-24T18:01:49.607787] [INFO ] [REMOTE    ] CNMD: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T18:01:49.747631] [INFO ] [REMOTE    ] CNMD: Fetching primary data for 2025-06.
[2025-10-24T18:01:50.068805] [INFO ] [REMOTE    ] CNM: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T18:01:50.547725] [INFO ] [REMOTE    ] CNK: Fetching primary data for 2025-09.
[2025-10-24T18:01:50.808821] [INFO ] [REMOTE    ] CNI: Incremental fetch complete for 2025-08 (3.46 seconds).
[2025-10-24T18:01:51.091286] [INFO ] [REMOTE    ] CNMD: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T18:01:51.347728] [INFO ] [REMOTE    ] CNMD: Fetching primary data for 2025-07.
[2025-10-24T18:01:52.147621] [INFO ] [REMOTE    ] CNM: Fetching primary data for 2025-07.
[2025-10-24T18:01:52.299520] [INFO ] [REMOTE    ] CNK: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T18:01:52.538296] [INFO ] [REMOTE    ] CNMD: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T18:01:52.947715] [INFO ] [REMOTE    ] CNI: Fetching primary data for 2025-09.
[2025-10-24T18:01:53.747681] [INFO ] [REMOTE    ] CNK: Fetching primary data for 2025-10.
[2025-10-24T18:01:53.835822] [INFO ] [REMOTE    ] CNM: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T18:01:54.547626] [INFO ] [REMOTE    ] CNMD: Fetching primary data for 2025-08.
[2025-10-24T18:01:54.584749] [INFO ] [REMOTE    ] CNI: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T18:01:55.347632] [INFO ] [REMOTE    ] CNM: Fetching primary data for 2025-08.
[2025-10-24T18:01:55.501236] [INFO ] [REMOTE    ] CNK: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T18:01:55.512377] [INFO ] [REMOTE    ] CNK: Full fetch complete (76297 records).
[2025-10-24T18:01:55.512698] [DEBUG] [VALIDATOR ] CNK: Validating primary data.
[2025-10-24T18:01:55.879810] [INFO ] [REMOTE    ] CNMD: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T18:01:56.033357] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present.
[2025-10-24T18:01:56.033454] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed.
[2025-10-24T18:01:56.034388] [INFO ] [MAIN      ] CNK: Fetched primary data is valid.
[2025-10-24T18:01:56.034457] [DEBUG] [LOCAL     ] CNK: Saving primary data.
[2025-10-24T18:01:56.035159] [FATAL] [LOCAL     ] CNK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:01:56.035257] [FATAL] [MAIN      ] CNK: Failed to save primary data.
[2025-10-24T18:01:56.035299] [WARN ] [MAIN      ] CNK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:01:56.035334] [INFO ] [LOCAL     ] CNK: Starting deletion of primary data.
[2025-10-24T18:01:56.035403] [DEBUG] [LOCAL     ] CNK: No primary data file found to delete.
[2025-10-24T18:01:56.035439] [INFO ] [LOCAL     ] CNK: Starting deletion of derivative data.
[2025-10-24T18:01:56.035478] [DEBUG] [LOCAL     ] CNK: No derivative data file found to delete.
[2025-10-24T18:01:56.035542] [INFO ] [MAIN      ] Update Progress: 493/2366 symbols completed. CNK took 31.7s. Estimated remaining: 3h 55m 7s. Rate: 8.0 symbols/min
[2025-10-24T18:01:56.154270] [INFO ] [REMOTE    ] CNI: Fetching primary data for 2025-10.
[2025-10-24T18:01:56.234192] [INFO ] [MAIN      ] CNNE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:01:56.280471] [DEBUG] [LOCAL     ] CNNE: Loaded 35966 existing records from primary storage.
[2025-10-24T18:01:56.280900] [INFO ] [MAIN      ] CNNE: Loaded 35966 existing records.
[2025-10-24T18:01:56.475602] [WARN ] [MAIN      ] CNNE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:01:56.475916] [INFO ] [MAIN      ] CNNE: Wiping existing primary data before full refresh.
[2025-10-24T18:01:56.475969] [INFO ] [LOCAL     ] CNNE: Starting deletion of primary data.
[2025-10-24T18:01:56.476218] [DEBUG] [LOCAL     ] CNNE: Deleted primary data file.
[2025-10-24T18:01:56.476262] [INFO ] [MAIN      ] CNNE: Starting full primary refresh.
[2025-10-24T18:01:56.867365] [INFO ] [REMOTE    ] CNNE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:01:56.947715] [INFO ] [REMOTE    ] CNMD: Fetching primary data for 2025-09.
[2025-10-24T18:01:57.021193] [INFO ] [REMOTE    ] CNM: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T18:01:57.747620] [INFO ] [REMOTE    ] CNM: Fetching primary data for 2025-09.
[2025-10-24T18:01:58.031196] [INFO ] [REMOTE    ] CNI: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T18:01:58.040793] [INFO ] [REMOTE    ] CNI: Full fetch complete (74826 records).
[2025-10-24T18:01:58.040925] [DEBUG] [VALIDATOR ] CNI: Validating primary data.
[2025-10-24T18:01:58.442867] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present.
[2025-10-24T18:01:58.448886] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed.
[2025-10-24T18:01:58.459862] [INFO ] [MAIN      ] CNI: Fetched primary data is valid.
[2025-10-24T18:01:58.460481] [DEBUG] [LOCAL     ] CNI: Saving primary data.
[2025-10-24T18:01:58.461919] [INFO ] [REMOTE    ] CNMD: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T18:01:58.462112] [FATAL] [LOCAL     ] CNI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:01:58.469244] [FATAL] [MAIN      ] CNI: Failed to save primary data.
[2025-10-24T18:01:58.469340] [WARN ] [MAIN      ] CNI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:01:58.469774] [INFO ] [LOCAL     ] CNI: Starting deletion of primary data.
[2025-10-24T18:01:58.469851] [DEBUG] [LOCAL     ] CNI: No primary data file found to delete.
[2025-10-24T18:01:58.469889] [INFO ] [LOCAL     ] CNI: Starting deletion of derivative data.
[2025-10-24T18:01:58.470027] [DEBUG] [LOCAL     ] CNI: Deleted derivative data file.
[2025-10-24T18:01:58.470462] [INFO ] [MAIN      ] Update Progress: 494/2366 symbols completed. CNI took 37.6s. Estimated remaining: 3h 54m 40s. Rate: 8.0 symbols/min
[2025-10-24T18:01:58.552825] [INFO ] [REMOTE    ] CNMD: Fetching primary data for 2025-10.
[2025-10-24T18:01:58.645431] [INFO ] [MAIN      ] CNO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:01:58.684340] [DEBUG] [LOCAL     ] CNO: Loaded 40585 existing records from primary storage.
[2025-10-24T18:01:58.684613] [INFO ] [MAIN      ] CNO: Loaded 40585 existing records.
[2025-10-24T18:01:58.859177] [WARN ] [MAIN      ] CNO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:01:58.859420] [INFO ] [MAIN      ] CNO: Wiping existing primary data before full refresh.
[2025-10-24T18:01:58.859476] [INFO ] [LOCAL     ] CNO: Starting deletion of primary data.
[2025-10-24T18:01:58.859716] [DEBUG] [LOCAL     ] CNO: Deleted primary data file.
[2025-10-24T18:01:58.859771] [INFO ] [MAIN      ] CNO: Starting full primary refresh.
[2025-10-24T18:01:59.213086] [INFO ] [REMOTE    ] CNO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:01:59.347622] [INFO ] [REMOTE    ] CNO: Fetching primary data for 2025-01.
[2025-10-24T18:01:59.406559] [INFO ] [REMOTE    ] CNM: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T18:02:00.147705] [INFO ] [REMOTE    ] CNM: Fetching primary data for 2025-10.
[2025-10-24T18:02:00.443017] [INFO ] [REMOTE    ] CNMD: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T18:02:00.451280] [INFO ] [REMOTE    ] CNMD: Full fetch complete (47431 records).
[2025-10-24T18:02:00.451427] [DEBUG] [VALIDATOR ] CNMD: Validating primary data.
[2025-10-24T18:02:00.864613] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present.
[2025-10-24T18:02:00.864776] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed.
[2025-10-24T18:02:00.865494] [INFO ] [MAIN      ] CNMD: Fetched primary data is valid.
[2025-10-24T18:02:00.865573] [DEBUG] [LOCAL     ] CNMD: Saving primary data.
[2025-10-24T18:02:00.866742] [FATAL] [LOCAL     ] CNMD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:02:00.866923] [FATAL] [MAIN      ] CNMD: Failed to save primary data.
[2025-10-24T18:02:00.867075] [WARN ] [MAIN      ] CNMD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:02:00.867253] [INFO ] [LOCAL     ] CNMD: Starting deletion of primary data.
[2025-10-24T18:02:00.867393] [DEBUG] [LOCAL     ] CNMD: No primary data file found to delete.
[2025-10-24T18:02:00.867447] [INFO ] [LOCAL     ] CNMD: Starting deletion of derivative data.
[2025-10-24T18:02:00.876052] [DEBUG] [LOCAL     ] CNMD: Deleted derivative data file.
[2025-10-24T18:02:00.890611] [INFO ] [MAIN      ] Update Progress: 495/2366 symbols completed. CNMD took 26.6s. Estimated remaining: 3h 54m 13s. Rate: 8.0 symbols/min
[2025-10-24T18:02:00.957024] [INFO ] [REMOTE    ] CNO: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T18:02:00.962325] [INFO ] [REMOTE    ] CNNE: Fetching primary data for 2025-01.
[2025-10-24T18:02:01.076306] [INFO ] [MAIN      ] CNP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:02:01.129971] [DEBUG] [LOCAL     ] CNP: Loaded 53865 existing records from primary storage.
[2025-10-24T18:02:01.130288] [INFO ] [MAIN      ] CNP: Loaded 53865 existing records.
[2025-10-24T18:02:01.310412] [WARN ] [MAIN      ] CNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:02:01.310851] [INFO ] [MAIN      ] CNP: Wiping existing primary data before full refresh.
[2025-10-24T18:02:01.310898] [INFO ] [LOCAL     ] CNP: Starting deletion of primary data.
[2025-10-24T18:02:01.311233] [DEBUG] [LOCAL     ] CNP: Deleted primary data file.
[2025-10-24T18:02:01.311289] [INFO ] [MAIN      ] CNP: Starting full primary refresh.
[2025-10-24T18:02:01.714722] [INFO ] [REMOTE    ] CNP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:02:01.747729] [INFO ] [REMOTE    ] CNO: Fetching primary data for 2025-02.
[2025-10-24T18:02:02.275556] [INFO ] [REMOTE    ] CNM: Incremental fetch complete for 2025-10 (2.13 seconds).
[2025-10-24T18:02:02.284846] [INFO ] [REMOTE    ] CNM: Full fetch complete (73393 records).
[2025-10-24T18:02:02.285013] [DEBUG] [VALIDATOR ] CNM: Validating primary data.
[2025-10-24T18:02:02.285798] [FATAL] [VALIDATOR ] CNM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:02:02.285895] [FATAL] [MAIN      ] CNM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:02:02.285938] [WARN ] [MAIN      ] CNM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:02:02.285983] [INFO ] [LOCAL     ] CNM: Starting deletion of primary data.
[2025-10-24T18:02:02.286040] [DEBUG] [LOCAL     ] CNM: No primary data file found to delete.
[2025-10-24T18:02:02.286075] [INFO ] [LOCAL     ] CNM: Starting deletion of derivative data.
[2025-10-24T18:02:02.286195] [DEBUG] [LOCAL     ] CNM: Deleted derivative data file.
[2025-10-24T18:02:02.286480] [INFO ] [MAIN      ] Update Progress: 496/2366 symbols completed. CNM took 30.5s. Estimated remaining: 3h 53m 43s. Rate: 8.0 symbols/min
[2025-10-24T18:02:02.460221] [INFO ] [MAIN      ] CNQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:02:02.520262] [DEBUG] [LOCAL     ] CNQ: Loaded 53972 existing records from primary storage.
[2025-10-24T18:02:02.521575] [INFO ] [MAIN      ] CNQ: Loaded 53972 existing records.
[2025-10-24T18:02:02.558969] [INFO ] [REMOTE    ] CNP: Fetching primary data for 2025-01.
[2025-10-24T18:02:02.741597] [WARN ] [MAIN      ] CNQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:02:02.741977] [INFO ] [MAIN      ] CNQ: Wiping existing primary data before full refresh.
[2025-10-24T18:02:02.742160] [INFO ] [LOCAL     ] CNQ: Starting deletion of primary data.
[2025-10-24T18:02:02.742808] [DEBUG] [LOCAL     ] CNQ: Deleted primary data file.
[2025-10-24T18:02:02.742877] [INFO ] [MAIN      ] CNQ: Starting full primary refresh.
[2025-10-24T18:02:03.003518] [INFO ] [REMOTE    ] CNNE: Incremental fetch complete for 2025-01 (2.04 seconds).
[2025-10-24T18:02:03.175521] [INFO ] [REMOTE    ] CNQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:02:03.347613] [INFO ] [REMOTE    ] CNNE: Fetching primary data for 2025-02.
[2025-10-24T18:02:03.614095] [INFO ] [REMOTE    ] CNO: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T18:02:04.147634] [INFO ] [REMOTE    ] CNQ: Fetching primary data for 2025-01.
[2025-10-24T18:02:04.733759] [INFO ] [REMOTE    ] CNNE: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T18:02:04.848666] [INFO ] [REMOTE    ] CNP: Incremental fetch complete for 2025-01 (2.29 seconds).
[2025-10-24T18:02:04.947615] [INFO ] [REMOTE    ] CNP: Fetching primary data for 2025-02.
[2025-10-24T18:02:05.747621] [INFO ] [REMOTE    ] CNO: Fetching primary data for 2025-03.
[2025-10-24T18:02:06.183880] [INFO ] [REMOTE    ] CNQ: Incremental fetch complete for 2025-01 (2.04 seconds).
[2025-10-24T18:02:06.547606] [INFO ] [REMOTE    ] CNQ: Fetching primary data for 2025-02.
[2025-10-24T18:02:06.624249] [INFO ] [REMOTE    ] CNP: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T18:02:07.352062] [INFO ] [REMOTE    ] CNP: Fetching primary data for 2025-03.
[2025-10-24T18:02:07.359292] [INFO ] [REMOTE    ] CNO: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T18:02:08.147750] [INFO ] [REMOTE    ] CNO: Fetching primary data for 2025-04.
[2025-10-24T18:02:08.947919] [INFO ] [REMOTE    ] CNNE: Fetching primary data for 2025-03.
[2025-10-24T18:02:09.173664] [INFO ] [REMOTE    ] CNP: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T18:02:09.311250] [INFO ] [REMOTE    ] CNQ: Incremental fetch complete for 2025-02 (2.76 seconds).
[2025-10-24T18:02:09.672915] [INFO ] [REMOTE    ] CNO: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T18:02:09.747720] [INFO ] [REMOTE    ] CNQ: Fetching primary data for 2025-03.
[2025-10-24T18:02:10.393373] [INFO ] [REMOTE    ] CNNE: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T18:02:10.547721] [INFO ] [REMOTE    ] CNO: Fetching primary data for 2025-05.
[2025-10-24T18:02:11.330041] [INFO ] [REMOTE    ] CNQ: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T18:02:11.347596] [INFO ] [REMOTE    ] CNQ: Fetching primary data for 2025-04.
[2025-10-24T18:02:11.590335] [INFO ] [REMOTE    ] CNO: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T18:02:12.147707] [INFO ] [REMOTE    ] CNNE: Fetching primary data for 2025-04.
[2025-10-24T18:02:12.947630] [INFO ] [REMOTE    ] CNP: Fetching primary data for 2025-04.
[2025-10-24T18:02:13.102005] [INFO ] [REMOTE    ] CNQ: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T18:02:13.662993] [INFO ] [REMOTE    ] CNNE: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T18:02:13.747701] [INFO ] [REMOTE    ] CNNE: Fetching primary data for 2025-05.
[2025-10-24T18:02:14.533570] [INFO ] [REMOTE    ] CNP: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T18:02:14.547599] [INFO ] [REMOTE    ] CNP: Fetching primary data for 2025-05.
[2025-10-24T18:02:14.893903] [INFO ] [REMOTE    ] CNNE: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T18:02:15.347725] [INFO ] [REMOTE    ] CNO: Fetching primary data for 2025-06.
[2025-10-24T18:02:16.001493] [INFO ] [REMOTE    ] CNP: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T18:02:16.147721] [INFO ] [REMOTE    ] CNP: Fetching primary data for 2025-06.
[2025-10-24T18:02:16.656898] [INFO ] [REMOTE    ] CNO: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T18:02:16.947682] [INFO ] [REMOTE    ] CNQ: Fetching primary data for 2025-05.
[2025-10-24T18:02:17.404802] [INFO ] [REMOTE    ] CNP: Incremental fetch complete for 2025-06 (1.26 seconds).
[2025-10-24T18:02:17.747632] [INFO ] [REMOTE    ] CNP: Fetching primary data for 2025-07.
[2025-10-24T18:02:18.547631] [INFO ] [REMOTE    ] CNO: Fetching primary data for 2025-07.
[2025-10-24T18:02:18.737235] [INFO ] [REMOTE    ] CNQ: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T18:02:19.347627] [INFO ] [REMOTE    ] CNQ: Fetching primary data for 2025-06.
[2025-10-24T18:02:19.537498] [INFO ] [REMOTE    ] CNP: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T18:02:20.095930] [INFO ] [REMOTE    ] CNO: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T18:02:20.147691] [INFO ] [REMOTE    ] CNNE: Fetching primary data for 2025-06.
[2025-10-24T18:02:20.947623] [INFO ] [REMOTE    ] CNP: Fetching primary data for 2025-08.
[2025-10-24T18:02:21.028985] [INFO ] [REMOTE    ] CNQ: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T18:02:21.489090] [INFO ] [REMOTE    ] CNNE: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T18:02:21.747671] [INFO ] [REMOTE    ] CNQ: Fetching primary data for 2025-07.
[2025-10-24T18:02:22.508679] [INFO ] [REMOTE    ] CNP: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T18:02:22.547699] [INFO ] [REMOTE    ] CNNE: Fetching primary data for 2025-07.
[2025-10-24T18:02:23.013199] [INFO ] [REMOTE    ] CNQ: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T18:02:23.347717] [INFO ] [REMOTE    ] CNP: Fetching primary data for 2025-09.
[2025-10-24T18:02:23.774744] [INFO ] [REMOTE    ] CNNE: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T18:02:24.147685] [INFO ] [REMOTE    ] CNNE: Fetching primary data for 2025-08.
[2025-10-24T18:02:24.947618] [INFO ] [REMOTE    ] CNQ: Fetching primary data for 2025-08.
[2025-10-24T18:02:25.076600] [INFO ] [REMOTE    ] CNP: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T18:02:25.533035] [INFO ] [REMOTE    ] CNNE: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T18:02:25.747633] [INFO ] [REMOTE    ] CNO: Fetching primary data for 2025-08.
[2025-10-24T18:02:26.547631] [INFO ] [REMOTE    ] CNP: Fetching primary data for 2025-10.
[2025-10-24T18:02:26.599703] [INFO ] [REMOTE    ] CNQ: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T18:02:27.163627] [INFO ] [REMOTE    ] CNO: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T18:02:27.347696] [INFO ] [REMOTE    ] CNO: Fetching primary data for 2025-09.
[2025-10-24T18:02:28.147688] [INFO ] [REMOTE    ] CNNE: Fetching primary data for 2025-09.
[2025-10-24T18:02:28.487818] [INFO ] [REMOTE    ] CNP: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T18:02:28.497849] [INFO ] [REMOTE    ] CNP: Full fetch complete (77555 records).
[2025-10-24T18:02:28.498035] [DEBUG] [VALIDATOR ] CNP: Validating primary data.
[2025-10-24T18:02:28.906901] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present.
[2025-10-24T18:02:28.907016] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed.
[2025-10-24T18:02:28.911525] [INFO ] [MAIN      ] CNP: Fetched primary data is valid.
[2025-10-24T18:02:28.911854] [DEBUG] [LOCAL     ] CNP: Saving primary data.
[2025-10-24T18:02:28.912970] [FATAL] [LOCAL     ] CNP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:02:28.926499] [FATAL] [MAIN      ] CNP: Failed to save primary data.
[2025-10-24T18:02:28.937951] [WARN ] [MAIN      ] CNP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:02:28.938149] [INFO ] [LOCAL     ] CNP: Starting deletion of primary data.
[2025-10-24T18:02:28.938430] [DEBUG] [LOCAL     ] CNP: No primary data file found to delete.
[2025-10-24T18:02:28.938574] [INFO ] [LOCAL     ] CNP: Starting deletion of derivative data.
[2025-10-24T18:02:28.938980] [DEBUG] [LOCAL     ] CNP: Deleted derivative data file.
[2025-10-24T18:02:28.939874] [INFO ] [MAIN      ] Update Progress: 497/2366 symbols completed. CNP took 28.0s. Estimated remaining: 3h 54m 47s. Rate: 8.0 symbols/min
[2025-10-24T18:02:28.941511] [INFO ] [REMOTE    ] CNO: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T18:02:28.955548] [INFO ] [REMOTE    ] CNQ: Fetching primary data for 2025-09.
[2025-10-24T18:02:29.131783] [INFO ] [MAIN      ] CNR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:02:29.131949] [DEBUG] [LOCAL     ] CNR: No existing data file found in primary storage.
[2025-10-24T18:02:29.131987] [WARN ] [MAIN      ] CNR: No existing data found, performing full refresh instead.
[2025-10-24T18:02:29.132103] [INFO ] [MAIN      ] CNR: Wiping existing primary data before full refresh.
[2025-10-24T18:02:29.132145] [INFO ] [LOCAL     ] CNR: Starting deletion of primary data.
[2025-10-24T18:02:29.132187] [DEBUG] [LOCAL     ] CNR: No primary data file found to delete.
[2025-10-24T18:02:29.132219] [INFO ] [MAIN      ] CNR: Starting full primary refresh.
[2025-10-24T18:02:29.499716] [INFO ] [REMOTE    ] CNR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:02:29.752738] [INFO ] [REMOTE    ] CNO: Fetching primary data for 2025-10.
[2025-10-24T18:02:29.767779] [INFO ] [REMOTE    ] CNNE: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T18:02:30.530013] [INFO ] [REMOTE    ] CNQ: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T18:02:30.547621] [INFO ] [REMOTE    ] CNQ: Fetching primary data for 2025-10.
[2025-10-24T18:02:31.234535] [INFO ] [REMOTE    ] CNO: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T18:02:31.241829] [INFO ] [REMOTE    ] CNO: Full fetch complete (60759 records).
[2025-10-24T18:02:31.241938] [DEBUG] [VALIDATOR ] CNO: Validating primary data.
[2025-10-24T18:02:31.349901] [INFO ] [REMOTE    ] CNR: Fetching primary data for 2025-01.
[2025-10-24T18:02:31.655742] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present.
[2025-10-24T18:02:31.655838] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed.
[2025-10-24T18:02:31.656573] [INFO ] [MAIN      ] CNO: Fetched primary data is valid.
[2025-10-24T18:02:31.656636] [DEBUG] [LOCAL     ] CNO: Saving primary data.
[2025-10-24T18:02:31.657293] [FATAL] [LOCAL     ] CNO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:02:31.657383] [FATAL] [MAIN      ] CNO: Failed to save primary data.
[2025-10-24T18:02:31.657434] [WARN ] [MAIN      ] CNO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:02:31.657471] [INFO ] [LOCAL     ] CNO: Starting deletion of primary data.
[2025-10-24T18:02:31.657528] [DEBUG] [LOCAL     ] CNO: No primary data file found to delete.
[2025-10-24T18:02:31.657564] [INFO ] [LOCAL     ] CNO: Starting deletion of derivative data.
[2025-10-24T18:02:31.657740] [DEBUG] [LOCAL     ] CNO: Deleted derivative data file.
[2025-10-24T18:02:31.658738] [INFO ] [MAIN      ] Update Progress: 498/2366 symbols completed. CNO took 33.2s. Estimated remaining: 3h 54m 22s. Rate: 8.0 symbols/min
[2025-10-24T18:02:31.840932] [INFO ] [MAIN      ] CNS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:02:31.863790] [DEBUG] [LOCAL     ] CNS: Loaded 21443 existing records from primary storage.
[2025-10-24T18:02:31.864050] [INFO ] [MAIN      ] CNS: Loaded 21443 existing records.
[2025-10-24T18:02:32.051428] [WARN ] [MAIN      ] CNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:02:32.051686] [INFO ] [MAIN      ] CNS: Wiping existing primary data before full refresh.
[2025-10-24T18:02:32.051743] [INFO ] [LOCAL     ] CNS: Starting deletion of primary data.
[2025-10-24T18:02:32.051913] [DEBUG] [LOCAL     ] CNS: Deleted primary data file.
[2025-10-24T18:02:32.051954] [INFO ] [MAIN      ] CNS: Starting full primary refresh.
[2025-10-24T18:02:32.148122] [INFO ] [REMOTE    ] CNNE: Fetching primary data for 2025-10.
[2025-10-24T18:02:32.437833] [INFO ] [REMOTE    ] CNS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:02:32.468161] [INFO ] [REMOTE    ] CNQ: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T18:02:32.478076] [INFO ] [REMOTE    ] CNQ: Full fetch complete (77742 records).
[2025-10-24T18:02:32.478250] [DEBUG] [VALIDATOR ] CNQ: Validating primary data.
[2025-10-24T18:02:32.870018] [INFO ] [REMOTE    ] CNR: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T18:02:32.922860] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present.
[2025-10-24T18:02:32.922966] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed.
[2025-10-24T18:02:32.924092] [INFO ] [MAIN      ] CNQ: Fetched primary data is valid.
[2025-10-24T18:02:32.924158] [DEBUG] [LOCAL     ] CNQ: Saving primary data.
[2025-10-24T18:02:32.924813] [FATAL] [LOCAL     ] CNQ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:02:32.924900] [FATAL] [MAIN      ] CNQ: Failed to save primary data.
[2025-10-24T18:02:32.924950] [WARN ] [MAIN      ] CNQ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:02:32.925015] [INFO ] [LOCAL     ] CNQ: Starting deletion of primary data.
[2025-10-24T18:02:32.925077] [DEBUG] [LOCAL     ] CNQ: No primary data file found to delete.
[2025-10-24T18:02:32.925116] [INFO ] [LOCAL     ] CNQ: Starting deletion of derivative data.
[2025-10-24T18:02:32.925274] [DEBUG] [LOCAL     ] CNQ: Deleted derivative data file.
[2025-10-24T18:02:32.925742] [INFO ] [MAIN      ] Update Progress: 499/2366 symbols completed. CNQ took 30.6s. Estimated remaining: 3h 53m 51s. Rate: 8.0 symbols/min
[2025-10-24T18:02:32.956948] [INFO ] [REMOTE    ] CNR: Fetching primary data for 2025-02.
[2025-10-24T18:02:33.102725] [INFO ] [MAIN      ] CNX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:02:33.151813] [DEBUG] [LOCAL     ] CNX: Loaded 51709 existing records from primary storage.
[2025-10-24T18:02:33.152125] [INFO ] [MAIN      ] CNX: Loaded 51709 existing records.
[2025-10-24T18:02:33.343440] [WARN ] [MAIN      ] CNX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:02:33.343729] [INFO ] [MAIN      ] CNX: Wiping existing primary data before full refresh.
[2025-10-24T18:02:33.343802] [INFO ] [LOCAL     ] CNX: Starting deletion of primary data.
[2025-10-24T18:02:33.343995] [DEBUG] [LOCAL     ] CNX: Deleted primary data file.
[2025-10-24T18:02:33.344097] [INFO ] [MAIN      ] CNX: Starting full primary refresh.
[2025-10-24T18:02:33.464206] [INFO ] [REMOTE    ] CNNE: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T18:02:33.481360] [INFO ] [REMOTE    ] CNNE: Full fetch complete (50632 records).
[2025-10-24T18:02:33.496858] [DEBUG] [VALIDATOR ] CNNE: Validating primary data.
[2025-10-24T18:02:33.763272] [INFO ] [REMOTE    ] CNS: Fetching primary data for 2025-01.
[2025-10-24T18:02:34.071763] [INFO ] [REMOTE    ] CNX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:02:34.151899] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present.
[2025-10-24T18:02:34.151996] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed.
[2025-10-24T18:02:34.152730] [INFO ] [MAIN      ] CNNE: Fetched primary data is valid.
[2025-10-24T18:02:34.152816] [DEBUG] [LOCAL     ] CNNE: Saving primary data.
[2025-10-24T18:02:34.153387] [FATAL] [LOCAL     ] CNNE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:02:34.153493] [FATAL] [MAIN      ] CNNE: Failed to save primary data.
[2025-10-24T18:02:34.153535] [WARN ] [MAIN      ] CNNE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:02:34.153601] [INFO ] [LOCAL     ] CNNE: Starting deletion of primary data.
[2025-10-24T18:02:34.153691] [DEBUG] [LOCAL     ] CNNE: No primary data file found to delete.
[2025-10-24T18:02:34.153747] [INFO ] [LOCAL     ] CNNE: Starting deletion of derivative data.
[2025-10-24T18:02:34.153878] [DEBUG] [LOCAL     ] CNNE: Deleted derivative data file.
[2025-10-24T18:02:34.153961] [INFO ] [MAIN      ] Update Progress: 500/2366 symbols completed. CNNE took 38.1s. Estimated remaining: 3h 53m 20s. Rate: 8.0 symbols/min
[2025-10-24T18:02:34.325930] [INFO ] [MAIN      ] CODI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:02:34.365512] [DEBUG] [LOCAL     ] CODI: Loaded 42256 existing records from primary storage.
[2025-10-24T18:02:34.365856] [INFO ] [MAIN      ] CODI: Loaded 42256 existing records.
[2025-10-24T18:02:34.551059] [INFO ] [REMOTE    ] CNX: Fetching primary data for 2025-01.
[2025-10-24T18:02:34.550964] [WARN ] [MAIN      ] CODI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:02:34.552100] [INFO ] [MAIN      ] CODI: Wiping existing primary data before full refresh.
[2025-10-24T18:02:34.552302] [INFO ] [LOCAL     ] CODI: Starting deletion of primary data.
[2025-10-24T18:02:34.552798] [DEBUG] [LOCAL     ] CODI: Deleted primary data file.
[2025-10-24T18:02:34.553067] [INFO ] [MAIN      ] CODI: Starting full primary refresh.
[2025-10-24T18:02:34.728400] [INFO ] [REMOTE    ] CNR: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T18:02:34.977757] [INFO ] [REMOTE    ] CODI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:02:35.021907] [INFO ] [REMOTE    ] CNS: Incremental fetch complete for 2025-01 (1.26 seconds).
[2025-10-24T18:02:35.347680] [INFO ] [REMOTE    ] CODI: Fetching primary data for 2025-01.
[2025-10-24T18:02:36.147691] [INFO ] [REMOTE    ] CNR: Fetching primary data for 2025-03.
[2025-10-24T18:02:36.393074] [INFO ] [REMOTE    ] CNX: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T18:02:36.593724] [INFO ] [REMOTE    ] CODI: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T18:02:36.947668] [INFO ] [REMOTE    ] CNX: Fetching primary data for 2025-02.
[2025-10-24T18:02:37.747620] [INFO ] [REMOTE    ] CNS: Fetching primary data for 2025-02.
[2025-10-24T18:02:37.835262] [INFO ] [REMOTE    ] CNR: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T18:02:38.297384] [INFO ] [REMOTE    ] CNX: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T18:02:38.547707] [INFO ] [REMOTE    ] CODI: Fetching primary data for 2025-02.
[2025-10-24T18:02:38.732455] [INFO ] [REMOTE    ] CNS: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T18:02:39.282365] [INFO ] [REMOTE    ] CODI: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T18:02:39.347636] [INFO ] [REMOTE    ] CODI: Fetching primary data for 2025-03.
[2025-10-24T18:02:40.147665] [INFO ] [REMOTE    ] CNX: Fetching primary data for 2025-03.
[2025-10-24T18:02:40.637484] [INFO ] [REMOTE    ] CODI: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T18:02:40.947692] [INFO ] [REMOTE    ] CNR: Fetching primary data for 2025-04.
[2025-10-24T18:02:41.747619] [INFO ] [REMOTE    ] CODI: Fetching primary data for 2025-04.
[2025-10-24T18:02:42.388539] [INFO ] [REMOTE    ] CNR: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T18:02:42.469517] [INFO ] [REMOTE    ] CNX: Incremental fetch complete for 2025-03 (2.32 seconds).
[2025-10-24T18:02:42.547598] [INFO ] [REMOTE    ] CNX: Fetching primary data for 2025-04.
[2025-10-24T18:02:43.166057] [INFO ] [REMOTE    ] CODI: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T18:02:43.347705] [INFO ] [REMOTE    ] CODI: Fetching primary data for 2025-05.
[2025-10-24T18:02:44.147634] [INFO ] [REMOTE    ] CNS: Fetching primary data for 2025-03.
[2025-10-24T18:02:44.249273] [INFO ] [REMOTE    ] CNX: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T18:02:44.947630] [INFO ] [REMOTE    ] CNX: Fetching primary data for 2025-05.
[2025-10-24T18:02:45.057758] [INFO ] [REMOTE    ] CODI: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T18:02:45.476846] [INFO ] [REMOTE    ] CNS: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T18:02:45.747619] [INFO ] [REMOTE    ] CNS: Fetching primary data for 2025-04.
[2025-10-24T18:02:46.547616] [INFO ] [REMOTE    ] CODI: Fetching primary data for 2025-06.
[2025-10-24T18:02:46.641444] [INFO ] [REMOTE    ] CNX: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T18:02:47.062603] [INFO ] [REMOTE    ] CNS: Incremental fetch complete for 2025-04 (1.31 seconds).
[2025-10-24T18:02:47.347669] [INFO ] [REMOTE    ] CNS: Fetching primary data for 2025-05.
[2025-10-24T18:02:48.075324] [INFO ] [REMOTE    ] CODI: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T18:02:48.147605] [INFO ] [REMOTE    ] CODI: Fetching primary data for 2025-07.
[2025-10-24T18:02:48.296872] [INFO ] [REMOTE    ] CNS: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T18:02:48.947718] [INFO ] [REMOTE    ] CNR: Fetching primary data for 2025-05.
[2025-10-24T18:02:49.747695] [INFO ] [REMOTE    ] CNS: Fetching primary data for 2025-06.
[2025-10-24T18:02:49.807490] [INFO ] [REMOTE    ] CODI: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T18:02:50.492961] [INFO ] [REMOTE    ] CNR: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T18:02:50.547609] [INFO ] [REMOTE    ] CNR: Fetching primary data for 2025-06.
[2025-10-24T18:02:50.708453] [INFO ] [REMOTE    ] CNS: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T18:02:51.347682] [INFO ] [REMOTE    ] CNX: Fetching primary data for 2025-06.
[2025-10-24T18:02:51.790898] [INFO ] [REMOTE    ] CNR: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T18:02:52.147753] [INFO ] [REMOTE    ] CNR: Fetching primary data for 2025-07.
[2025-10-24T18:02:52.919289] [INFO ] [REMOTE    ] CNX: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T18:02:52.947608] [INFO ] [REMOTE    ] CNX: Fetching primary data for 2025-07.
[2025-10-24T18:02:53.747621] [INFO ] [REMOTE    ] CODI: Fetching primary data for 2025-08.
[2025-10-24T18:02:53.813141] [INFO ] [REMOTE    ] CNR: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T18:02:54.440716] [INFO ] [REMOTE    ] CNX: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T18:02:54.547672] [INFO ] [REMOTE    ] CNS: Fetching primary data for 2025-07.
[2025-10-24T18:02:54.939482] [INFO ] [REMOTE    ] CODI: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T18:02:55.348056] [INFO ] [REMOTE    ] CODI: Fetching primary data for 2025-09.
[2025-10-24T18:02:55.752795] [INFO ] [REMOTE    ] CNS: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T18:02:56.147717] [INFO ] [REMOTE    ] CNS: Fetching primary data for 2025-08.
[2025-10-24T18:02:56.799802] [INFO ] [REMOTE    ] CODI: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T18:02:56.947687] [INFO ] [REMOTE    ] CODI: Fetching primary data for 2025-10.
[2025-10-24T18:02:57.174373] [INFO ] [REMOTE    ] CNS: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T18:02:57.747702] [INFO ] [REMOTE    ] CNX: Fetching primary data for 2025-08.
[2025-10-24T18:02:58.547693] [INFO ] [REMOTE    ] CNR: Fetching primary data for 2025-08.
[2025-10-24T18:02:58.803038] [INFO ] [REMOTE    ] CODI: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T18:02:58.811999] [INFO ] [REMOTE    ] CODI: Full fetch complete (54107 records).
[2025-10-24T18:02:58.812245] [DEBUG] [VALIDATOR ] CODI: Validating primary data.
[2025-10-24T18:02:59.286628] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present.
[2025-10-24T18:02:59.287496] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed.
[2025-10-24T18:02:59.289773] [INFO ] [MAIN      ] CODI: Fetched primary data is valid.
[2025-10-24T18:02:59.289877] [DEBUG] [LOCAL     ] CODI: Saving primary data.
[2025-10-24T18:02:59.288715] [INFO ] [REMOTE    ] CNX: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T18:02:59.300966] [FATAL] [LOCAL     ] CODI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:02:59.301594] [FATAL] [MAIN      ] CODI: Failed to save primary data.
[2025-10-24T18:02:59.301816] [WARN ] [MAIN      ] CODI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:02:59.301890] [INFO ] [LOCAL     ] CODI: Starting deletion of primary data.
[2025-10-24T18:02:59.301961] [DEBUG] [LOCAL     ] CODI: No primary data file found to delete.
[2025-10-24T18:02:59.301999] [INFO ] [LOCAL     ] CODI: Starting deletion of derivative data.
[2025-10-24T18:02:59.302417] [DEBUG] [LOCAL     ] CODI: Deleted derivative data file.
[2025-10-24T18:02:59.302884] [INFO ] [MAIN      ] Update Progress: 501/2366 symbols completed. CODI took 25.1s. Estimated remaining: 3h 54m 18s. Rate: 8.0 symbols/min
[2025-10-24T18:02:59.357709] [INFO ] [REMOTE    ] CNX: Fetching primary data for 2025-09.
[2025-10-24T18:02:59.477554] [INFO ] [MAIN      ] COF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:02:59.531067] [DEBUG] [LOCAL     ] COF: Loaded 54015 existing records from primary storage.
[2025-10-24T18:02:59.531458] [INFO ] [MAIN      ] COF: Loaded 54015 existing records.
[2025-10-24T18:02:59.713549] [WARN ] [MAIN      ] COF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:02:59.714006] [INFO ] [MAIN      ] COF: Wiping existing primary data before full refresh.
[2025-10-24T18:02:59.714070] [INFO ] [LOCAL     ] COF: Starting deletion of primary data.
[2025-10-24T18:02:59.715102] [DEBUG] [LOCAL     ] COF: Deleted primary data file.
[2025-10-24T18:02:59.715159] [INFO ] [MAIN      ] COF: Starting full primary refresh.
[2025-10-24T18:03:00.103034] [INFO ] [REMOTE    ] COF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:03:00.105569] [INFO ] [REMOTE    ] CNR: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T18:03:00.147626] [INFO ] [REMOTE    ] CNS: Fetching primary data for 2025-09.
[2025-10-24T18:03:00.947613] [INFO ] [REMOTE    ] CNR: Fetching primary data for 2025-09.
[2025-10-24T18:03:01.355912] [INFO ] [REMOTE    ] CNS: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T18:03:01.582296] [INFO ] [REMOTE    ] CNX: Incremental fetch complete for 2025-09 (2.22 seconds).
[2025-10-24T18:03:01.747701] [INFO ] [REMOTE    ] CNS: Fetching primary data for 2025-10.
[2025-10-24T18:03:02.414547] [INFO ] [REMOTE    ] CNR: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T18:03:02.547691] [INFO ] [REMOTE    ] CNR: Fetching primary data for 2025-10.
[2025-10-24T18:03:02.745857] [INFO ] [REMOTE    ] CNS: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T18:03:02.750792] [INFO ] [REMOTE    ] CNS: Full fetch complete (31322 records).
[2025-10-24T18:03:02.750892] [DEBUG] [VALIDATOR ] CNS: Validating primary data.
[2025-10-24T18:03:02.751433] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:03:02.751518] [FATAL] [MAIN      ] CNS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:03:02.751561] [WARN ] [MAIN      ] CNS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:03:02.751604] [INFO ] [LOCAL     ] CNS: Starting deletion of primary data.
[2025-10-24T18:03:02.751687] [DEBUG] [LOCAL     ] CNS: No primary data file found to delete.
[2025-10-24T18:03:02.751743] [INFO ] [LOCAL     ] CNS: Starting deletion of derivative data.
[2025-10-24T18:03:02.751873] [DEBUG] [LOCAL     ] CNS: Deleted derivative data file.
[2025-10-24T18:03:02.751940] [INFO ] [MAIN      ] Update Progress: 502/2366 symbols completed. CNS took 31.1s. Estimated remaining: 3h 53m 55s. Rate: 8.0 symbols/min
[2025-10-24T18:03:02.923303] [INFO ] [MAIN      ] COHR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:03:02.923491] [DEBUG] [LOCAL     ] COHR: No existing data file found in primary storage.
[2025-10-24T18:03:02.923528] [WARN ] [MAIN      ] COHR: No existing data found, performing full refresh instead.
[2025-10-24T18:03:02.923640] [INFO ] [MAIN      ] COHR: Wiping existing primary data before full refresh.
[2025-10-24T18:03:02.923717] [INFO ] [LOCAL     ] COHR: Starting deletion of primary data.
[2025-10-24T18:03:02.923763] [DEBUG] [LOCAL     ] COHR: No primary data file found to delete.
[2025-10-24T18:03:02.923796] [INFO ] [MAIN      ] COHR: Starting full primary refresh.
[2025-10-24T18:03:03.283278] [INFO ] [REMOTE    ] COHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:03:03.347626] [INFO ] [REMOTE    ] COHR: Fetching primary data for 2025-01.
[2025-10-24T18:03:04.063680] [INFO ] [REMOTE    ] CNR: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T18:03:04.072279] [INFO ] [REMOTE    ] CNR: Full fetch complete (63485 records).
[2025-10-24T18:03:04.072431] [DEBUG] [VALIDATOR ] CNR: Validating primary data.
[2025-10-24T18:03:04.152779] [INFO ] [REMOTE    ] CNX: Fetching primary data for 2025-10.
[2025-10-24T18:03:04.270965] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 196 unique days, need 200 days
[2025-10-24T18:03:04.271897] [FATAL] [MAIN      ] CNR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:03:04.271981] [WARN ] [MAIN      ] CNR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:03:04.272066] [INFO ] [LOCAL     ] CNR: Starting deletion of primary data.
[2025-10-24T18:03:04.272152] [DEBUG] [LOCAL     ] CNR: No primary data file found to delete.
[2025-10-24T18:03:04.272212] [INFO ] [LOCAL     ] CNR: Starting deletion of derivative data.
[2025-10-24T18:03:04.272255] [DEBUG] [LOCAL     ] CNR: No derivative data file found to delete.
[2025-10-24T18:03:04.272335] [INFO ] [MAIN      ] Update Progress: 503/2366 symbols completed. CNR took 35.3s. Estimated remaining: 3h 53m 25s. Rate: 8.0 symbols/min
[2025-10-24T18:03:04.439066] [INFO ] [MAIN      ] COLD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:03:04.489202] [DEBUG] [LOCAL     ] COLD: Loaded 52875 existing records from primary storage.
[2025-10-24T18:03:04.489490] [INFO ] [MAIN      ] COLD: Loaded 52875 existing records.
[2025-10-24T18:03:04.663526] [WARN ] [MAIN      ] COLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:03:04.663744] [INFO ] [MAIN      ] COLD: Wiping existing primary data before full refresh.
[2025-10-24T18:03:04.663794] [INFO ] [LOCAL     ] COLD: Starting deletion of primary data.
[2025-10-24T18:03:04.664696] [DEBUG] [LOCAL     ] COLD: Deleted primary data file.
[2025-10-24T18:03:04.664753] [INFO ] [MAIN      ] COLD: Starting full primary refresh.
[2025-10-24T18:03:04.952939] [INFO ] [REMOTE    ] COF: Fetching primary data for 2025-01.
[2025-10-24T18:03:05.012727] [INFO ] [REMOTE    ] COLD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:03:05.621011] [INFO ] [REMOTE    ] COHR: Incremental fetch complete for 2025-01 (2.27 seconds).
[2025-10-24T18:03:05.747614] [INFO ] [REMOTE    ] COLD: Fetching primary data for 2025-01.
[2025-10-24T18:03:05.895352] [INFO ] [REMOTE    ] CNX: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T18:03:05.904583] [INFO ] [REMOTE    ] CNX: Full fetch complete (74894 records).
[2025-10-24T18:03:05.904729] [DEBUG] [VALIDATOR ] CNX: Validating primary data.
[2025-10-24T18:03:06.286790] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present.
[2025-10-24T18:03:06.286886] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed.
[2025-10-24T18:03:06.287776] [INFO ] [MAIN      ] CNX: Fetched primary data is valid.
[2025-10-24T18:03:06.287845] [DEBUG] [LOCAL     ] CNX: Saving primary data.
[2025-10-24T18:03:06.288464] [FATAL] [LOCAL     ] CNX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:03:06.288563] [FATAL] [MAIN      ] CNX: Failed to save primary data.
[2025-10-24T18:03:06.288605] [WARN ] [MAIN      ] CNX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:03:06.288668] [INFO ] [LOCAL     ] CNX: Starting deletion of primary data.
[2025-10-24T18:03:06.288748] [DEBUG] [LOCAL     ] CNX: No primary data file found to delete.
[2025-10-24T18:03:06.288786] [INFO ] [LOCAL     ] CNX: Starting deletion of derivative data.
[2025-10-24T18:03:06.288910] [DEBUG] [LOCAL     ] CNX: Deleted derivative data file.
[2025-10-24T18:03:06.289145] [INFO ] [MAIN      ] Update Progress: 504/2366 symbols completed. CNX took 33.4s. Estimated remaining: 3h 52m 58s. Rate: 8.0 symbols/min
[2025-10-24T18:03:06.460578] [INFO ] [MAIN      ] COMP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:03:06.511177] [DEBUG] [LOCAL     ] COMP: Loaded 53793 existing records from primary storage.
[2025-10-24T18:03:06.511601] [INFO ] [MAIN      ] COMP: Loaded 53793 existing records.
[2025-10-24T18:03:06.553762] [INFO ] [REMOTE    ] COHR: Fetching primary data for 2025-02.
[2025-10-24T18:03:06.732379] [INFO ] [REMOTE    ] COF: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T18:03:06.730302] [WARN ] [MAIN      ] COMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:03:06.732710] [INFO ] [MAIN      ] COMP: Wiping existing primary data before full refresh.
[2025-10-24T18:03:06.748112] [INFO ] [LOCAL     ] COMP: Starting deletion of primary data.
[2025-10-24T18:03:06.749750] [DEBUG] [LOCAL     ] COMP: Deleted primary data file.
[2025-10-24T18:03:06.749814] [INFO ] [MAIN      ] COMP: Starting full primary refresh.
[2025-10-24T18:03:07.105623] [INFO ] [REMOTE    ] COMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:03:07.347668] [INFO ] [REMOTE    ] COMP: Fetching primary data for 2025-01.
[2025-10-24T18:03:07.489339] [INFO ] [REMOTE    ] COLD: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T18:03:08.147675] [INFO ] [REMOTE    ] COLD: Fetching primary data for 2025-02.
[2025-10-24T18:03:08.660777] [INFO ] [REMOTE    ] COHR: Incremental fetch complete for 2025-02 (2.11 seconds).
[2025-10-24T18:03:08.947688] [INFO ] [REMOTE    ] COHR: Fetching primary data for 2025-03.
[2025-10-24T18:03:08.988886] [INFO ] [REMOTE    ] COMP: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T18:03:09.627802] [INFO ] [REMOTE    ] COLD: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T18:03:09.747608] [INFO ] [REMOTE    ] COLD: Fetching primary data for 2025-03.
[2025-10-24T18:03:10.533862] [INFO ] [REMOTE    ] COHR: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T18:03:10.547591] [INFO ] [REMOTE    ] COHR: Fetching primary data for 2025-04.
[2025-10-24T18:03:11.347683] [INFO ] [REMOTE    ] COF: Fetching primary data for 2025-02.
[2025-10-24T18:03:11.532323] [INFO ] [REMOTE    ] COLD: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T18:03:12.147723] [INFO ] [REMOTE    ] COLD: Fetching primary data for 2025-04.
[2025-10-24T18:03:12.525587] [INFO ] [REMOTE    ] COHR: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T18:03:12.864459] [INFO ] [REMOTE    ] COF: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T18:03:12.947613] [INFO ] [REMOTE    ] COF: Fetching primary data for 2025-03.
[2025-10-24T18:03:13.747703] [INFO ] [REMOTE    ] COHR: Fetching primary data for 2025-05.
[2025-10-24T18:03:13.843230] [INFO ] [REMOTE    ] COLD: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T18:03:14.556352] [INFO ] [REMOTE    ] COMP: Fetching primary data for 2025-02.
[2025-10-24T18:03:14.562546] [INFO ] [REMOTE    ] COF: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T18:03:15.347685] [INFO ] [REMOTE    ] COF: Fetching primary data for 2025-04.
[2025-10-24T18:03:15.762609] [INFO ] [REMOTE    ] COHR: Incremental fetch complete for 2025-05 (2.01 seconds).
[2025-10-24T18:03:15.947299] [INFO ] [REMOTE    ] COMP: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T18:03:16.147636] [INFO ] [REMOTE    ] COMP: Fetching primary data for 2025-03.
[2025-10-24T18:03:16.947707] [INFO ] [REMOTE    ] COHR: Fetching primary data for 2025-06.
[2025-10-24T18:03:17.367373] [INFO ] [REMOTE    ] COF: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T18:03:17.439778] [INFO ] [REMOTE    ] COMP: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T18:03:17.747703] [INFO ] [REMOTE    ] COLD: Fetching primary data for 2025-05.
[2025-10-24T18:03:18.547724] [INFO ] [REMOTE    ] COMP: Fetching primary data for 2025-04.
[2025-10-24T18:03:18.610817] [INFO ] [REMOTE    ] COHR: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T18:03:19.347621] [INFO ] [REMOTE    ] COF: Fetching primary data for 2025-05.
[2025-10-24T18:03:19.643588] [INFO ] [REMOTE    ] COLD: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T18:03:20.147621] [INFO ] [REMOTE    ] COLD: Fetching primary data for 2025-06.
[2025-10-24T18:03:20.523227] [INFO ] [REMOTE    ] COMP: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T18:03:20.947716] [INFO ] [REMOTE    ] COHR: Fetching primary data for 2025-07.
[2025-10-24T18:03:21.300442] [INFO ] [REMOTE    ] COF: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T18:03:21.747692] [INFO ] [REMOTE    ] COF: Fetching primary data for 2025-06.
[2025-10-24T18:03:22.263220] [INFO ] [REMOTE    ] COLD: Incremental fetch complete for 2025-06 (2.12 seconds).
[2025-10-24T18:03:22.410693] [INFO ] [REMOTE    ] COHR: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T18:03:22.547623] [INFO ] [REMOTE    ] COHR: Fetching primary data for 2025-08.
[2025-10-24T18:03:23.347666] [INFO ] [REMOTE    ] COMP: Fetching primary data for 2025-05.
[2025-10-24T18:03:23.644728] [INFO ] [REMOTE    ] COF: Incremental fetch complete for 2025-06 (1.90 seconds).
[2025-10-24T18:03:24.147736] [INFO ] [REMOTE    ] COF: Fetching primary data for 2025-07.
[2025-10-24T18:03:24.807226] [INFO ] [REMOTE    ] COMP: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T18:03:24.873621] [INFO ] [REMOTE    ] COHR: Incremental fetch complete for 2025-08 (2.33 seconds).
[2025-10-24T18:03:24.947602] [INFO ] [REMOTE    ] COHR: Fetching primary data for 2025-09.
[2025-10-24T18:03:25.747621] [INFO ] [REMOTE    ] COMP: Fetching primary data for 2025-06.
[2025-10-24T18:03:26.413002] [INFO ] [REMOTE    ] COF: Incremental fetch complete for 2025-07 (2.27 seconds).
[2025-10-24T18:03:26.547757] [INFO ] [REMOTE    ] COLD: Fetching primary data for 2025-07.
[2025-10-24T18:03:26.789765] [INFO ] [REMOTE    ] COHR: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T18:03:27.347712] [INFO ] [REMOTE    ] COF: Fetching primary data for 2025-08.
[2025-10-24T18:03:27.503432] [INFO ] [REMOTE    ] COMP: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T18:03:28.132339] [INFO ] [REMOTE    ] COLD: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T18:03:28.147607] [INFO ] [REMOTE    ] COLD: Fetching primary data for 2025-08.
[2025-10-24T18:03:28.947625] [INFO ] [REMOTE    ] COMP: Fetching primary data for 2025-07.
[2025-10-24T18:03:29.205338] [INFO ] [REMOTE    ] COF: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T18:03:29.752969] [INFO ] [REMOTE    ] COHR: Fetching primary data for 2025-10.
[2025-10-24T18:03:29.773192] [INFO ] [REMOTE    ] COLD: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T18:03:30.516293] [INFO ] [REMOTE    ] COMP: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T18:03:30.547709] [INFO ] [REMOTE    ] COMP: Fetching primary data for 2025-08.
[2025-10-24T18:03:31.347736] [INFO ] [REMOTE    ] COLD: Fetching primary data for 2025-09.
[2025-10-24T18:03:32.029932] [INFO ] [REMOTE    ] COHR: Incremental fetch complete for 2025-10 (2.28 seconds).
[2025-10-24T18:03:32.039831] [INFO ] [REMOTE    ] COHR: Full fetch complete (77081 records).
[2025-10-24T18:03:32.039961] [DEBUG] [VALIDATOR ] COHR: Validating primary data.
[2025-10-24T18:03:32.040776] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:03:32.040865] [FATAL] [MAIN      ] COHR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:03:32.040907] [WARN ] [MAIN      ] COHR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:03:32.040947] [INFO ] [LOCAL     ] COHR: Starting deletion of primary data.
[2025-10-24T18:03:32.041001] [DEBUG] [LOCAL     ] COHR: No primary data file found to delete.
[2025-10-24T18:03:32.041037] [INFO ] [LOCAL     ] COHR: Starting deletion of derivative data.
[2025-10-24T18:03:32.041119] [DEBUG] [LOCAL     ] COHR: No derivative data file found to delete.
[2025-10-24T18:03:32.041919] [INFO ] [MAIN      ] Update Progress: 505/2366 symbols completed. COHR took 29.3s. Estimated remaining: 3h 53m 57s. Rate: 8.0 symbols/min
[2025-10-24T18:03:32.152755] [INFO ] [REMOTE    ] COF: Fetching primary data for 2025-09.
[2025-10-24T18:03:32.230315] [INFO ] [MAIN      ] CON: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:03:32.268532] [DEBUG] [LOCAL     ] CON: Loaded 39033 existing records from primary storage.
[2025-10-24T18:03:32.268829] [INFO ] [MAIN      ] CON: Loaded 39033 existing records.
[2025-10-24T18:03:32.476859] [WARN ] [MAIN      ] CON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:03:32.480124] [INFO ] [MAIN      ] CON: Wiping existing primary data before full refresh.
[2025-10-24T18:03:32.480204] [INFO ] [LOCAL     ] CON: Starting deletion of primary data.
[2025-10-24T18:03:32.481946] [INFO ] [REMOTE    ] COMP: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T18:03:32.481992] [DEBUG] [LOCAL     ] CON: Deleted primary data file.
[2025-10-24T18:03:32.492323] [INFO ] [MAIN      ] CON: Starting full primary refresh.
[2025-10-24T18:03:32.870371] [INFO ] [REMOTE    ] CON: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:03:32.947598] [INFO ] [REMOTE    ] CON: Fetching primary data for 2025-01.
[2025-10-24T18:03:33.007110] [INFO ] [REMOTE    ] COLD: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T18:03:33.747686] [INFO ] [REMOTE    ] COLD: Fetching primary data for 2025-10.
[2025-10-24T18:03:33.983342] [INFO ] [REMOTE    ] COF: Incremental fetch complete for 2025-09 (1.83 seconds).
[2025-10-24T18:03:34.313584] [INFO ] [REMOTE    ] CON: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T18:03:34.547667] [INFO ] [REMOTE    ] COMP: Fetching primary data for 2025-09.
[2025-10-24T18:03:35.347631] [INFO ] [REMOTE    ] COF: Fetching primary data for 2025-10.
[2025-10-24T18:03:35.712700] [INFO ] [REMOTE    ] COLD: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T18:03:35.722493] [INFO ] [REMOTE    ] COLD: Full fetch complete (74953 records).
[2025-10-24T18:03:35.722615] [DEBUG] [VALIDATOR ] COLD: Validating primary data.
[2025-10-24T18:03:36.124328] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present.
[2025-10-24T18:03:36.124576] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed.
[2025-10-24T18:03:36.125518] [INFO ] [MAIN      ] COLD: Fetched primary data is valid.
[2025-10-24T18:03:36.125701] [DEBUG] [LOCAL     ] COLD: Saving primary data.
[2025-10-24T18:03:36.126278] [FATAL] [LOCAL     ] COLD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:03:36.126361] [FATAL] [MAIN      ] COLD: Failed to save primary data.
[2025-10-24T18:03:36.126413] [WARN ] [MAIN      ] COLD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:03:36.126496] [INFO ] [LOCAL     ] COLD: Starting deletion of primary data.
[2025-10-24T18:03:36.126579] [DEBUG] [LOCAL     ] COLD: No primary data file found to delete.
[2025-10-24T18:03:36.126670] [INFO ] [LOCAL     ] COLD: Starting deletion of derivative data.
[2025-10-24T18:03:36.126908] [DEBUG] [LOCAL     ] COLD: Deleted derivative data file.
[2025-10-24T18:03:36.127215] [INFO ] [MAIN      ] Update Progress: 506/2366 symbols completed. COLD took 31.9s. Estimated remaining: 3h 53m 37s. Rate: 8.0 symbols/min
[2025-10-24T18:03:36.158853] [INFO ] [REMOTE    ] CON: Fetching primary data for 2025-02.
[2025-10-24T18:03:36.304696] [INFO ] [MAIN      ] COOK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:03:36.329123] [DEBUG] [LOCAL     ] COOK: Loaded 24994 existing records from primary storage.
[2025-10-24T18:03:36.329367] [INFO ] [MAIN      ] COOK: Loaded 24994 existing records.
[2025-10-24T18:03:36.471344] [INFO ] [REMOTE    ] COMP: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T18:03:36.547773] [WARN ] [MAIN      ] COOK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:03:36.547984] [INFO ] [MAIN      ] COOK: Wiping existing primary data before full refresh.
[2025-10-24T18:03:36.548030] [INFO ] [LOCAL     ] COOK: Starting deletion of primary data.
[2025-10-24T18:03:36.548434] [DEBUG] [LOCAL     ] COOK: Deleted primary data file.
[2025-10-24T18:03:36.548492] [INFO ] [MAIN      ] COOK: Starting full primary refresh.
[2025-10-24T18:03:36.912812] [INFO ] [REMOTE    ] COOK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:03:36.947612] [INFO ] [REMOTE    ] COOK: Fetching primary data for 2025-01.
[2025-10-24T18:03:37.169010] [INFO ] [REMOTE    ] CON: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T18:03:37.557771] [INFO ] [REMOTE    ] COF: Incremental fetch complete for 2025-10 (2.21 seconds).
[2025-10-24T18:03:37.567572] [INFO ] [REMOTE    ] COF: Full fetch complete (77714 records).
[2025-10-24T18:03:37.567744] [DEBUG] [VALIDATOR ] COF: Validating primary data.
[2025-10-24T18:03:37.752497] [INFO ] [REMOTE    ] CON: Fetching primary data for 2025-03.
[2025-10-24T18:03:37.972913] [DEBUG] [VALIDATOR ] COF: All expected trading days are present.
[2025-10-24T18:03:37.972989] [DEBUG] [VALIDATOR ] COF: Primary data validation passed.
[2025-10-24T18:03:37.973942] [INFO ] [MAIN      ] COF: Fetched primary data is valid.
[2025-10-24T18:03:37.974006] [DEBUG] [LOCAL     ] COF: Saving primary data.
[2025-10-24T18:03:37.974590] [FATAL] [LOCAL     ] COF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:03:37.974700] [FATAL] [MAIN      ] COF: Failed to save primary data.
[2025-10-24T18:03:37.974750] [WARN ] [MAIN      ] COF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:03:37.974815] [INFO ] [LOCAL     ] COF: Starting deletion of primary data.
[2025-10-24T18:03:37.974877] [DEBUG] [LOCAL     ] COF: No primary data file found to delete.
[2025-10-24T18:03:37.974914] [INFO ] [LOCAL     ] COF: Starting deletion of derivative data.
[2025-10-24T18:03:37.975072] [DEBUG] [LOCAL     ] COF: Deleted derivative data file.
[2025-10-24T18:03:37.975797] [INFO ] [MAIN      ] Update Progress: 507/2366 symbols completed. COF took 38.7s. Estimated remaining: 3h 53m 9s. Rate: 8.0 symbols/min
[2025-10-24T18:03:38.153430] [INFO ] [MAIN      ] COP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:03:38.204437] [DEBUG] [LOCAL     ] COP: Loaded 54117 existing records from primary storage.
[2025-10-24T18:03:38.204866] [INFO ] [MAIN      ] COP: Loaded 54117 existing records.
[2025-10-24T18:03:38.322621] [INFO ] [REMOTE    ] COOK: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T18:03:38.403956] [WARN ] [MAIN      ] COP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:03:38.404155] [INFO ] [MAIN      ] COP: Wiping existing primary data before full refresh.
[2025-10-24T18:03:38.404208] [INFO ] [LOCAL     ] COP: Starting deletion of primary data.
[2025-10-24T18:03:38.404442] [DEBUG] [LOCAL     ] COP: Deleted primary data file.
[2025-10-24T18:03:38.404501] [INFO ] [MAIN      ] COP: Starting full primary refresh.
[2025-10-24T18:03:38.552896] [INFO ] [REMOTE    ] COMP: Fetching primary data for 2025-10.
[2025-10-24T18:03:38.772971] [INFO ] [REMOTE    ] COP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:03:39.209366] [INFO ] [REMOTE    ] CON: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T18:03:39.347617] [INFO ] [REMOTE    ] CON: Fetching primary data for 2025-04.
[2025-10-24T18:03:40.147730] [INFO ] [REMOTE    ] COP: Fetching primary data for 2025-01.
[2025-10-24T18:03:40.673187] [INFO ] [REMOTE    ] COMP: Incremental fetch complete for 2025-10 (2.12 seconds).
[2025-10-24T18:03:40.683277] [INFO ] [REMOTE    ] COMP: Full fetch complete (77415 records).
[2025-10-24T18:03:40.683430] [DEBUG] [VALIDATOR ] COMP: Validating primary data.
[2025-10-24T18:03:40.949833] [INFO ] [REMOTE    ] COOK: Fetching primary data for 2025-02.
[2025-10-24T18:03:41.032222] [INFO ] [REMOTE    ] CON: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T18:03:41.121029] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present.
[2025-10-24T18:03:41.121145] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed.
[2025-10-24T18:03:41.122138] [INFO ] [MAIN      ] COMP: Fetched primary data is valid.
[2025-10-24T18:03:41.122208] [DEBUG] [LOCAL     ] COMP: Saving primary data.
[2025-10-24T18:03:41.122972] [FATAL] [LOCAL     ] COMP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:03:41.123068] [FATAL] [MAIN      ] COMP: Failed to save primary data.
[2025-10-24T18:03:41.123135] [WARN ] [MAIN      ] COMP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:03:41.123205] [INFO ] [LOCAL     ] COMP: Starting deletion of primary data.
[2025-10-24T18:03:41.123270] [DEBUG] [LOCAL     ] COMP: No primary data file found to delete.
[2025-10-24T18:03:41.123307] [INFO ] [LOCAL     ] COMP: Starting deletion of derivative data.
[2025-10-24T18:03:41.123440] [DEBUG] [LOCAL     ] COMP: Deleted derivative data file.
[2025-10-24T18:03:41.124044] [INFO ] [MAIN      ] Update Progress: 508/2366 symbols completed. COMP took 34.8s. Estimated remaining: 3h 52m 45s. Rate: 8.0 symbols/min
[2025-10-24T18:03:41.292762] [INFO ] [MAIN      ] COR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:03:41.292925] [DEBUG] [LOCAL     ] COR: No existing data file found in primary storage.
[2025-10-24T18:03:41.292962] [WARN ] [MAIN      ] COR: No existing data found, performing full refresh instead.
[2025-10-24T18:03:41.293071] [INFO ] [MAIN      ] COR: Wiping existing primary data before full refresh.
[2025-10-24T18:03:41.293112] [INFO ] [LOCAL     ] COR: Starting deletion of primary data.
[2025-10-24T18:03:41.293152] [DEBUG] [LOCAL     ] COR: No primary data file found to delete.
[2025-10-24T18:03:41.293183] [INFO ] [MAIN      ] COR: Starting full primary refresh.
[2025-10-24T18:03:41.643604] [INFO ] [REMOTE    ] COR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:03:41.747689] [INFO ] [REMOTE    ] CON: Fetching primary data for 2025-05.
[2025-10-24T18:03:41.806157] [INFO ] [REMOTE    ] COOK: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T18:03:41.868610] [INFO ] [REMOTE    ] COP: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T18:03:42.547710] [INFO ] [REMOTE    ] COOK: Fetching primary data for 2025-03.
[2025-10-24T18:03:43.156453] [INFO ] [REMOTE    ] CON: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T18:03:43.347632] [INFO ] [REMOTE    ] CON: Fetching primary data for 2025-06.
[2025-10-24T18:03:43.425044] [INFO ] [REMOTE    ] COOK: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T18:03:44.147611] [INFO ] [REMOTE    ] COP: Fetching primary data for 2025-02.
[2025-10-24T18:03:44.784358] [INFO ] [REMOTE    ] CON: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T18:03:44.947639] [INFO ] [REMOTE    ] COR: Fetching primary data for 2025-01.
[2025-10-24T18:03:45.747605] [INFO ] [REMOTE    ] COOK: Fetching primary data for 2025-04.
[2025-10-24T18:03:45.863016] [INFO ] [REMOTE    ] COP: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T18:03:46.478608] [INFO ] [REMOTE    ] COOK: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T18:03:46.547697] [INFO ] [REMOTE    ] COOK: Fetching primary data for 2025-05.
[2025-10-24T18:03:47.017473] [INFO ] [REMOTE    ] COR: Incremental fetch complete for 2025-01 (2.07 seconds).
[2025-10-24T18:03:47.347618] [INFO ] [REMOTE    ] COP: Fetching primary data for 2025-03.
[2025-10-24T18:03:47.725255] [INFO ] [REMOTE    ] COOK: Incremental fetch complete for 2025-05 (1.18 seconds).
[2025-10-24T18:03:48.147676] [INFO ] [REMOTE    ] COOK: Fetching primary data for 2025-06.
[2025-10-24T18:03:48.947622] [INFO ] [REMOTE    ] CON: Fetching primary data for 2025-07.
[2025-10-24T18:03:49.172088] [INFO ] [REMOTE    ] COP: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T18:03:49.238324] [INFO ] [REMOTE    ] COOK: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T18:03:49.747726] [INFO ] [REMOTE    ] COP: Fetching primary data for 2025-04.
[2025-10-24T18:03:50.238122] [INFO ] [REMOTE    ] CON: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T18:03:50.547725] [INFO ] [REMOTE    ] COOK: Fetching primary data for 2025-07.
[2025-10-24T18:03:51.347730] [INFO ] [REMOTE    ] CON: Fetching primary data for 2025-08.
[2025-10-24T18:03:51.639242] [INFO ] [REMOTE    ] COOK: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T18:03:51.938149] [INFO ] [REMOTE    ] COP: Incremental fetch complete for 2025-04 (2.19 seconds).
[2025-10-24T18:03:52.147615] [INFO ] [REMOTE    ] COOK: Fetching primary data for 2025-08.
[2025-10-24T18:03:52.691780] [INFO ] [REMOTE    ] CON: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T18:03:52.947619] [INFO ] [REMOTE    ] COP: Fetching primary data for 2025-05.
[2025-10-24T18:03:53.192111] [INFO ] [REMOTE    ] COOK: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T18:03:53.747708] [INFO ] [REMOTE    ] COOK: Fetching primary data for 2025-09.
[2025-10-24T18:03:54.547627] [INFO ] [REMOTE    ] COR: Fetching primary data for 2025-02.
[2025-10-24T18:03:54.874181] [INFO ] [REMOTE    ] COOK: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T18:03:55.029503] [INFO ] [REMOTE    ] COP: Incremental fetch complete for 2025-05 (2.08 seconds).
[2025-10-24T18:03:55.347632] [INFO ] [REMOTE    ] COP: Fetching primary data for 2025-06.
[2025-10-24T18:03:55.808744] [INFO ] [REMOTE    ] COR: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T18:03:56.147729] [INFO ] [REMOTE    ] CON: Fetching primary data for 2025-09.
[2025-10-24T18:03:56.947680] [INFO ] [REMOTE    ] COOK: Fetching primary data for 2025-10.
[2025-10-24T18:03:57.007983] [INFO ] [REMOTE    ] COP: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T18:03:57.747707] [INFO ] [REMOTE    ] COP: Fetching primary data for 2025-07.
[2025-10-24T18:03:57.802487] [INFO ] [REMOTE    ] CON: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T18:03:58.166205] [INFO ] [REMOTE    ] COOK: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T18:03:58.171016] [INFO ] [REMOTE    ] COOK: Full fetch complete (33098 records).
[2025-10-24T18:03:58.171114] [DEBUG] [VALIDATOR ] COOK: Validating primary data.
[2025-10-24T18:03:58.532110] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present.
[2025-10-24T18:03:58.532180] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed.
[2025-10-24T18:03:58.532632] [INFO ] [MAIN      ] COOK: Fetched primary data is valid.
[2025-10-24T18:03:58.532718] [DEBUG] [LOCAL     ] COOK: Saving primary data.
[2025-10-24T18:03:58.533037] [FATAL] [LOCAL     ] COOK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:03:58.533119] [FATAL] [MAIN      ] COOK: Failed to save primary data.
[2025-10-24T18:03:58.533161] [WARN ] [MAIN      ] COOK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:03:58.533195] [INFO ] [LOCAL     ] COOK: Starting deletion of primary data.
[2025-10-24T18:03:58.533246] [DEBUG] [LOCAL     ] COOK: No primary data file found to delete.
[2025-10-24T18:03:58.533281] [INFO ] [LOCAL     ] COOK: Starting deletion of derivative data.
[2025-10-24T18:03:58.533433] [DEBUG] [LOCAL     ] COOK: Deleted derivative data file.
[2025-10-24T18:03:58.533522] [INFO ] [MAIN      ] Update Progress: 509/2366 symbols completed. COOK took 22.4s. Estimated remaining: 3h 53m 14s. Rate: 8.0 symbols/min
[2025-10-24T18:03:58.554172] [INFO ] [REMOTE    ] CON: Fetching primary data for 2025-10.
[2025-10-24T18:03:58.702503] [INFO ] [MAIN      ] COTY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:03:58.754584] [DEBUG] [LOCAL     ] COTY: Loaded 53642 existing records from primary storage.
[2025-10-24T18:03:58.754914] [INFO ] [MAIN      ] COTY: Loaded 53642 existing records.
[2025-10-24T18:03:58.929164] [WARN ] [MAIN      ] COTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:03:58.929372] [INFO ] [MAIN      ] COTY: Wiping existing primary data before full refresh.
[2025-10-24T18:03:58.929420] [INFO ] [LOCAL     ] COTY: Starting deletion of primary data.
[2025-10-24T18:03:58.929824] [DEBUG] [LOCAL     ] COTY: Deleted primary data file.
[2025-10-24T18:03:58.929886] [INFO ] [MAIN      ] COTY: Starting full primary refresh.
[2025-10-24T18:03:59.279677] [INFO ] [REMOTE    ] COTY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:03:59.347606] [INFO ] [REMOTE    ] COR: Fetching primary data for 2025-03.
[2025-10-24T18:03:59.571598] [INFO ] [REMOTE    ] COP: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T18:04:00.147683] [INFO ] [REMOTE    ] COP: Fetching primary data for 2025-08.
[2025-10-24T18:04:00.171087] [INFO ] [REMOTE    ] CON: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T18:04:00.178131] [INFO ] [REMOTE    ] CON: Full fetch complete (56693 records).
[2025-10-24T18:04:00.178226] [DEBUG] [VALIDATOR ] CON: Validating primary data.
[2025-10-24T18:04:00.553190] [DEBUG] [VALIDATOR ] CON: All expected trading days are present.
[2025-10-24T18:04:00.553268] [DEBUG] [VALIDATOR ] CON: Primary data validation passed.
[2025-10-24T18:04:00.553938] [INFO ] [MAIN      ] CON: Fetched primary data is valid.
[2025-10-24T18:04:00.554000] [DEBUG] [LOCAL     ] CON: Saving primary data.
[2025-10-24T18:04:00.554430] [FATAL] [LOCAL     ] CON: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:04:00.554511] [FATAL] [MAIN      ] CON: Failed to save primary data.
[2025-10-24T18:04:00.554553] [WARN ] [MAIN      ] CON: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:04:00.554588] [INFO ] [LOCAL     ] CON: Starting deletion of primary data.
[2025-10-24T18:04:00.554638] [DEBUG] [LOCAL     ] CON: No primary data file found to delete.
[2025-10-24T18:04:00.554718] [INFO ] [LOCAL     ] CON: Starting deletion of derivative data.
[2025-10-24T18:04:00.554864] [DEBUG] [LOCAL     ] CON: Deleted derivative data file.
[2025-10-24T18:04:00.555286] [INFO ] [MAIN      ] Update Progress: 510/2366 symbols completed. CON took 28.5s. Estimated remaining: 3h 52m 46s. Rate: 8.0 symbols/min
[2025-10-24T18:04:00.721986] [INFO ] [MAIN      ] COUR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:04:00.768900] [DEBUG] [LOCAL     ] COUR: Loaded 49789 existing records from primary storage.
[2025-10-24T18:04:00.769195] [INFO ] [MAIN      ] COUR: Loaded 49789 existing records.
[2025-10-24T18:04:00.945179] [WARN ] [MAIN      ] COUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:04:00.945350] [INFO ] [MAIN      ] COUR: Wiping existing primary data before full refresh.
[2025-10-24T18:04:00.945394] [INFO ] [LOCAL     ] COUR: Starting deletion of primary data.
[2025-10-24T18:04:00.945579] [DEBUG] [LOCAL     ] COUR: Deleted primary data file.
[2025-10-24T18:04:00.945617] [INFO ] [MAIN      ] COUR: Starting full primary refresh.
[2025-10-24T18:04:00.952865] [INFO ] [REMOTE    ] COTY: Fetching primary data for 2025-01.
[2025-10-24T18:04:01.306289] [INFO ] [REMOTE    ] COUR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:04:01.402500] [INFO ] [REMOTE    ] COR: Incremental fetch complete for 2025-03 (2.05 seconds).
[2025-10-24T18:04:01.747704] [INFO ] [REMOTE    ] COR: Fetching primary data for 2025-04.
[2025-10-24T18:04:02.304057] [INFO ] [REMOTE    ] COP: Incremental fetch complete for 2025-08 (2.16 seconds).
[2025-10-24T18:04:02.547679] [INFO ] [REMOTE    ] COP: Fetching primary data for 2025-09.
[2025-10-24T18:04:02.852411] [INFO ] [REMOTE    ] COTY: Incremental fetch complete for 2025-01 (1.90 seconds).
[2025-10-24T18:04:03.347732] [INFO ] [REMOTE    ] COTY: Fetching primary data for 2025-02.
[2025-10-24T18:04:03.736148] [INFO ] [REMOTE    ] COR: Incremental fetch complete for 2025-04 (1.99 seconds).
[2025-10-24T18:04:04.147707] [INFO ] [REMOTE    ] COUR: Fetching primary data for 2025-01.
[2025-10-24T18:04:04.898725] [INFO ] [REMOTE    ] COP: Incremental fetch complete for 2025-09 (2.35 seconds).
[2025-10-24T18:04:04.960406] [INFO ] [REMOTE    ] COP: Fetching primary data for 2025-10.
[2025-10-24T18:04:04.985930] [INFO ] [REMOTE    ] COTY: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T18:04:05.747721] [INFO ] [REMOTE    ] COR: Fetching primary data for 2025-05.
[2025-10-24T18:04:05.802620] [INFO ] [REMOTE    ] COUR: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T18:04:06.547715] [INFO ] [REMOTE    ] COTY: Fetching primary data for 2025-03.
[2025-10-24T18:04:06.891429] [INFO ] [REMOTE    ] COP: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T18:04:06.900667] [INFO ] [REMOTE    ] COP: Full fetch complete (77516 records).
[2025-10-24T18:04:06.900810] [DEBUG] [VALIDATOR ] COP: Validating primary data.
[2025-10-24T18:04:06.902542] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:04:06.902633] [FATAL] [MAIN      ] COP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:04:06.902713] [WARN ] [MAIN      ] COP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:04:06.902760] [INFO ] [LOCAL     ] COP: Starting deletion of primary data.
[2025-10-24T18:04:06.902817] [DEBUG] [LOCAL     ] COP: No primary data file found to delete.
[2025-10-24T18:04:06.902854] [INFO ] [LOCAL     ] COP: Starting deletion of derivative data.
[2025-10-24T18:04:06.902983] [DEBUG] [LOCAL     ] COP: Deleted derivative data file.
[2025-10-24T18:04:06.903396] [INFO ] [MAIN      ] Update Progress: 511/2366 symbols completed. COP took 28.9s. Estimated remaining: 3h 52m 34s. Rate: 8.0 symbols/min
[2025-10-24T18:04:07.074616] [INFO ] [MAIN      ] CP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:04:07.125794] [DEBUG] [LOCAL     ] CP: Loaded 53617 existing records from primary storage.
[2025-10-24T18:04:07.126094] [INFO ] [MAIN      ] CP: Loaded 53617 existing records.
[2025-10-24T18:04:07.308409] [WARN ] [MAIN      ] CP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:04:07.308690] [INFO ] [MAIN      ] CP: Wiping existing primary data before full refresh.
[2025-10-24T18:04:07.308759] [INFO ] [LOCAL     ] CP: Starting deletion of primary data.
[2025-10-24T18:04:07.308995] [DEBUG] [LOCAL     ] CP: Deleted primary data file.
[2025-10-24T18:04:07.309067] [INFO ] [MAIN      ] CP: Starting full primary refresh.
[2025-10-24T18:04:07.352207] [INFO ] [REMOTE    ] COUR: Fetching primary data for 2025-02.
[2025-10-24T18:04:07.674844] [INFO ] [REMOTE    ] CP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:04:07.702116] [INFO ] [REMOTE    ] COR: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T18:04:08.147689] [INFO ] [REMOTE    ] CP: Fetching primary data for 2025-01.
[2025-10-24T18:04:08.264607] [INFO ] [REMOTE    ] COTY: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T18:04:08.893168] [INFO ] [REMOTE    ] COUR: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T18:04:08.947751] [INFO ] [REMOTE    ] COR: Fetching primary data for 2025-06.
[2025-10-24T18:04:09.434994] [INFO ] [REMOTE    ] CP: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T18:04:09.747757] [INFO ] [REMOTE    ] COUR: Fetching primary data for 2025-03.
[2025-10-24T18:04:10.411204] [INFO ] [REMOTE    ] COR: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T18:04:10.547673] [INFO ] [REMOTE    ] COR: Fetching primary data for 2025-07.
[2025-10-24T18:04:11.208461] [INFO ] [REMOTE    ] COUR: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T18:04:11.347614] [INFO ] [REMOTE    ] COTY: Fetching primary data for 2025-04.
[2025-10-24T18:04:12.147703] [INFO ] [REMOTE    ] CP: Fetching primary data for 2025-02.
[2025-10-24T18:04:12.202598] [INFO ] [REMOTE    ] COR: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T18:04:12.947686] [INFO ] [REMOTE    ] COR: Fetching primary data for 2025-08.
[2025-10-24T18:04:13.274994] [INFO ] [REMOTE    ] COTY: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T18:04:13.748663] [INFO ] [REMOTE    ] CP: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T18:04:13.748756] [INFO ] [REMOTE    ] COTY: Fetching primary data for 2025-05.
[2025-10-24T18:04:14.133992] [INFO ] [REMOTE    ] COR: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T18:04:14.547684] [INFO ] [REMOTE    ] CP: Fetching primary data for 2025-03.
[2025-10-24T18:04:15.347696] [INFO ] [REMOTE    ] COR: Fetching primary data for 2025-09.
[2025-10-24T18:04:15.389743] [INFO ] [REMOTE    ] COTY: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T18:04:16.147690] [INFO ] [REMOTE    ] COTY: Fetching primary data for 2025-06.
[2025-10-24T18:04:16.504330] [INFO ] [REMOTE    ] CP: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T18:04:16.944005] [INFO ] [REMOTE    ] COR: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T18:04:16.953002] [INFO ] [REMOTE    ] CP: Fetching primary data for 2025-04.
[2025-10-24T18:04:17.446713] [INFO ] [REMOTE    ] COTY: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T18:04:17.747682] [INFO ] [REMOTE    ] COR: Fetching primary data for 2025-10.
[2025-10-24T18:04:18.485420] [INFO ] [REMOTE    ] CP: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T18:04:18.547612] [INFO ] [REMOTE    ] CP: Fetching primary data for 2025-05.
[2025-10-24T18:04:19.347624] [INFO ] [REMOTE    ] COTY: Fetching primary data for 2025-07.
[2025-10-24T18:04:19.676331] [INFO ] [REMOTE    ] COR: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T18:04:19.684038] [INFO ] [REMOTE    ] COR: Full fetch complete (68034 records).
[2025-10-24T18:04:19.684187] [DEBUG] [VALIDATOR ] COR: Validating primary data.
[2025-10-24T18:04:19.684967] [FATAL] [VALIDATOR ] COR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:04:19.685055] [FATAL] [MAIN      ] COR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:04:19.685097] [WARN ] [MAIN      ] COR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:04:19.685169] [INFO ] [LOCAL     ] COR: Starting deletion of primary data.
[2025-10-24T18:04:19.685259] [DEBUG] [LOCAL     ] COR: No primary data file found to delete.
[2025-10-24T18:04:19.685315] [INFO ] [LOCAL     ] COR: Starting deletion of derivative data.
[2025-10-24T18:04:19.685357] [DEBUG] [LOCAL     ] COR: No derivative data file found to delete.
[2025-10-24T18:04:19.685728] [INFO ] [MAIN      ] Update Progress: 512/2366 symbols completed. COR took 38.6s. Estimated remaining: 3h 52m 46s. Rate: 8.0 symbols/min
[2025-10-24T18:04:19.853360] [INFO ] [MAIN      ] CPA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:04:19.881001] [DEBUG] [LOCAL     ] CPA: Loaded 27920 existing records from primary storage.
[2025-10-24T18:04:19.881253] [INFO ] [MAIN      ] CPA: Loaded 27920 existing records.
[2025-10-24T18:04:20.057955] [WARN ] [MAIN      ] CPA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:04:20.058214] [INFO ] [MAIN      ] CPA: Wiping existing primary data before full refresh.
[2025-10-24T18:04:20.058268] [INFO ] [LOCAL     ] CPA: Starting deletion of primary data.
[2025-10-24T18:04:20.058618] [DEBUG] [LOCAL     ] CPA: Deleted primary data file.
[2025-10-24T18:04:20.058737] [INFO ] [MAIN      ] CPA: Starting full primary refresh.
[2025-10-24T18:04:20.154716] [INFO ] [REMOTE    ] COUR: Fetching primary data for 2025-04.
[2025-10-24T18:04:20.421367] [INFO ] [REMOTE    ] CPA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:04:20.521929] [INFO ] [REMOTE    ] CP: Incremental fetch complete for 2025-05 (1.97 seconds).
[2025-10-24T18:04:20.789814] [INFO ] [REMOTE    ] COTY: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T18:04:20.947631] [INFO ] [REMOTE    ] CP: Fetching primary data for 2025-06.
[2025-10-24T18:04:21.752600] [INFO ] [REMOTE    ] COTY: Fetching primary data for 2025-08.
[2025-10-24T18:04:21.758219] [INFO ] [REMOTE    ] COUR: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T18:04:22.524767] [INFO ] [REMOTE    ] CP: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T18:04:22.547620] [INFO ] [REMOTE    ] CPA: Fetching primary data for 2025-01.
[2025-10-24T18:04:23.347695] [INFO ] [REMOTE    ] CP: Fetching primary data for 2025-07.
[2025-10-24T18:04:23.795510] [INFO ] [REMOTE    ] COTY: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T18:04:23.917909] [INFO ] [REMOTE    ] CPA: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T18:04:24.147638] [INFO ] [REMOTE    ] COTY: Fetching primary data for 2025-09.
[2025-10-24T18:04:24.606360] [INFO ] [REMOTE    ] CP: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T18:04:24.947670] [INFO ] [REMOTE    ] CPA: Fetching primary data for 2025-02.
[2025-10-24T18:04:25.747734] [INFO ] [REMOTE    ] COUR: Fetching primary data for 2025-05.
[2025-10-24T18:04:25.926818] [INFO ] [REMOTE    ] COTY: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T18:04:26.185791] [INFO ] [REMOTE    ] CPA: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T18:04:26.547629] [INFO ] [REMOTE    ] CP: Fetching primary data for 2025-08.
[2025-10-24T18:04:27.263554] [INFO ] [REMOTE    ] COUR: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T18:04:27.347608] [INFO ] [REMOTE    ] COUR: Fetching primary data for 2025-06.
[2025-10-24T18:04:28.075239] [INFO ] [REMOTE    ] CP: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T18:04:28.147605] [INFO ] [REMOTE    ] CP: Fetching primary data for 2025-09.
[2025-10-24T18:04:28.924952] [INFO ] [REMOTE    ] COUR: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T18:04:28.947604] [INFO ] [REMOTE    ] COUR: Fetching primary data for 2025-07.
[2025-10-24T18:04:29.747698] [INFO ] [REMOTE    ] CPA: Fetching primary data for 2025-03.
[2025-10-24T18:04:30.289529] [INFO ] [REMOTE    ] CP: Incremental fetch complete for 2025-09 (2.14 seconds).
[2025-10-24T18:04:30.547715] [INFO ] [REMOTE    ] COTY: Fetching primary data for 2025-10.
[2025-10-24T18:04:30.745381] [INFO ] [REMOTE    ] COUR: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T18:04:31.055534] [INFO ] [REMOTE    ] CPA: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T18:04:31.347638] [INFO ] [REMOTE    ] CPA: Fetching primary data for 2025-04.
[2025-10-24T18:04:32.147635] [INFO ] [REMOTE    ] CP: Fetching primary data for 2025-10.
[2025-10-24T18:04:32.534604] [INFO ] [REMOTE    ] COTY: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T18:04:32.564584] [INFO ] [REMOTE    ] COTY: Full fetch complete (77277 records).
[2025-10-24T18:04:32.565637] [DEBUG] [VALIDATOR ] COTY: Validating primary data.
[2025-10-24T18:04:32.566466] [INFO ] [REMOTE    ] CPA: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T18:04:32.954145] [INFO ] [REMOTE    ] COUR: Fetching primary data for 2025-08.
[2025-10-24T18:04:32.981525] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present.
[2025-10-24T18:04:32.981700] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed.
[2025-10-24T18:04:32.983186] [INFO ] [MAIN      ] COTY: Fetched primary data is valid.
[2025-10-24T18:04:32.983573] [DEBUG] [LOCAL     ] COTY: Saving primary data.
[2025-10-24T18:04:32.984745] [FATAL] [LOCAL     ] COTY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:04:32.984888] [FATAL] [MAIN      ] COTY: Failed to save primary data.
[2025-10-24T18:04:32.984967] [WARN ] [MAIN      ] COTY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:04:32.985051] [INFO ] [LOCAL     ] COTY: Starting deletion of primary data.
[2025-10-24T18:04:32.985140] [DEBUG] [LOCAL     ] COTY: No primary data file found to delete.
[2025-10-24T18:04:32.985190] [INFO ] [LOCAL     ] COTY: Starting deletion of derivative data.
[2025-10-24T18:04:32.985400] [DEBUG] [LOCAL     ] COTY: Deleted derivative data file.
[2025-10-24T18:04:32.986202] [INFO ] [MAIN      ] Update Progress: 513/2366 symbols completed. COTY took 34.5s. Estimated remaining: 3h 52m 59s. Rate: 8.0 symbols/min
[2025-10-24T18:04:33.166068] [INFO ] [MAIN      ] CPAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:04:33.166380] [DEBUG] [LOCAL     ] CPAC: No existing data file found in primary storage.
[2025-10-24T18:04:33.166441] [WARN ] [MAIN      ] CPAC: No existing data found, performing full refresh instead.
[2025-10-24T18:04:33.166540] [INFO ] [MAIN      ] CPAC: Wiping existing primary data before full refresh.
[2025-10-24T18:04:33.166588] [INFO ] [LOCAL     ] CPAC: Starting deletion of primary data.
[2025-10-24T18:04:33.166665] [DEBUG] [LOCAL     ] CPAC: No primary data file found to delete.
[2025-10-24T18:04:33.166735] [INFO ] [MAIN      ] CPAC: Starting full primary refresh.
[2025-10-24T18:04:33.535880] [INFO ] [REMOTE    ] CPAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:04:33.720910] [INFO ] [REMOTE    ] CP: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T18:04:33.730948] [INFO ] [REMOTE    ] CP: Full fetch complete (77289 records).
[2025-10-24T18:04:33.731102] [DEBUG] [VALIDATOR ] CP: Validating primary data.
[2025-10-24T18:04:33.753218] [INFO ] [REMOTE    ] CPA: Fetching primary data for 2025-05.
[2025-10-24T18:04:34.121823] [DEBUG] [VALIDATOR ] CP: All expected trading days are present.
[2025-10-24T18:04:34.121901] [DEBUG] [VALIDATOR ] CP: Primary data validation passed.
[2025-10-24T18:04:34.122779] [INFO ] [MAIN      ] CP: Fetched primary data is valid.
[2025-10-24T18:04:34.122842] [DEBUG] [LOCAL     ] CP: Saving primary data.
[2025-10-24T18:04:34.123441] [FATAL] [LOCAL     ] CP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:04:34.123549] [FATAL] [MAIN      ] CP: Failed to save primary data.
[2025-10-24T18:04:34.123619] [WARN ] [MAIN      ] CP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:04:34.123731] [INFO ] [LOCAL     ] CP: Starting deletion of primary data.
[2025-10-24T18:04:34.123813] [DEBUG] [LOCAL     ] CP: No primary data file found to delete.
[2025-10-24T18:04:34.123852] [INFO ] [LOCAL     ] CP: Starting deletion of derivative data.
[2025-10-24T18:04:34.124015] [DEBUG] [LOCAL     ] CP: Deleted derivative data file.
[2025-10-24T18:04:34.124568] [INFO ] [MAIN      ] Update Progress: 514/2366 symbols completed. CP took 27.2s. Estimated remaining: 3h 52m 28s. Rate: 8.0 symbols/min
[2025-10-24T18:04:34.298207] [INFO ] [MAIN      ] CPAY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:04:34.330111] [DEBUG] [LOCAL     ] CPAY: Loaded 30232 existing records from primary storage.
[2025-10-24T18:04:34.330371] [INFO ] [MAIN      ] CPAY: Loaded 30232 existing records.
[2025-10-24T18:04:34.511241] [WARN ] [MAIN      ] CPAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:04:34.511526] [INFO ] [MAIN      ] CPAY: Wiping existing primary data before full refresh.
[2025-10-24T18:04:34.511584] [INFO ] [LOCAL     ] CPAY: Starting deletion of primary data.
[2025-10-24T18:04:34.511831] [DEBUG] [LOCAL     ] CPAY: Deleted primary data file.
[2025-10-24T18:04:34.511888] [INFO ] [MAIN      ] CPAY: Starting full primary refresh.
[2025-10-24T18:04:34.555387] [INFO ] [REMOTE    ] CPAC: Fetching primary data for 2025-01.
[2025-10-24T18:04:34.894294] [INFO ] [REMOTE    ] COUR: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T18:04:34.933708] [INFO ] [REMOTE    ] CPAY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:04:34.996473] [INFO ] [REMOTE    ] CPAC: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T18:04:35.177101] [INFO ] [REMOTE    ] CPA: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T18:04:35.347689] [INFO ] [REMOTE    ] CPA: Fetching primary data for 2025-06.
[2025-10-24T18:04:36.147623] [INFO ] [REMOTE    ] COUR: Fetching primary data for 2025-09.
[2025-10-24T18:04:36.545225] [INFO ] [REMOTE    ] CPA: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T18:04:36.947682] [INFO ] [REMOTE    ] CPA: Fetching primary data for 2025-07.
[2025-10-24T18:04:37.733922] [INFO ] [REMOTE    ] COUR: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T18:04:37.747612] [INFO ] [REMOTE    ] COUR: Fetching primary data for 2025-10.
[2025-10-24T18:04:38.076898] [INFO ] [REMOTE    ] CPA: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T18:04:38.547634] [INFO ] [REMOTE    ] CPAC: Fetching primary data for 2025-02.
[2025-10-24T18:04:38.861834] [INFO ] [REMOTE    ] CPAC: Incremental fetch complete for 2025-02 (0.31 seconds).
[2025-10-24T18:04:39.347666] [INFO ] [REMOTE    ] CPAC: Fetching primary data for 2025-03.
[2025-10-24T18:04:39.613462] [INFO ] [REMOTE    ] COUR: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T18:04:39.623869] [INFO ] [REMOTE    ] COUR: Full fetch complete (71258 records).
[2025-10-24T18:04:39.624094] [DEBUG] [VALIDATOR ] COUR: Validating primary data.
[2025-10-24T18:04:39.738262] [INFO ] [REMOTE    ] CPAC: Incremental fetch complete for 2025-03 (0.39 seconds).
[2025-10-24T18:04:40.058190] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present.
[2025-10-24T18:04:40.058425] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed.
[2025-10-24T18:04:40.059852] [INFO ] [MAIN      ] COUR: Fetched primary data is valid.
[2025-10-24T18:04:40.059923] [DEBUG] [LOCAL     ] COUR: Saving primary data.
[2025-10-24T18:04:40.060858] [FATAL] [LOCAL     ] COUR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:04:40.061000] [FATAL] [MAIN      ] COUR: Failed to save primary data.
[2025-10-24T18:04:40.061046] [WARN ] [MAIN      ] COUR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:04:40.061101] [INFO ] [LOCAL     ] COUR: Starting deletion of primary data.
[2025-10-24T18:04:40.061183] [DEBUG] [LOCAL     ] COUR: No primary data file found to delete.
[2025-10-24T18:04:40.061223] [INFO ] [LOCAL     ] COUR: Starting deletion of derivative data.
[2025-10-24T18:04:40.061518] [DEBUG] [LOCAL     ] COUR: Deleted derivative data file.
[2025-10-24T18:04:40.062247] [INFO ] [MAIN      ] Update Progress: 515/2366 symbols completed. COUR took 39.5s. Estimated remaining: 3h 52m 15s. Rate: 8.0 symbols/min
[2025-10-24T18:04:40.152833] [INFO ] [REMOTE    ] CPA: Fetching primary data for 2025-08.
[2025-10-24T18:04:40.256072] [INFO ] [MAIN      ] CPF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:04:40.276071] [DEBUG] [LOCAL     ] CPF: Loaded 15267 existing records from primary storage.
[2025-10-24T18:04:40.276391] [INFO ] [MAIN      ] CPF: Loaded 15267 existing records.
[2025-10-24T18:04:40.469051] [WARN ] [MAIN      ] CPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:04:40.469361] [INFO ] [MAIN      ] CPF: Wiping existing primary data before full refresh.
[2025-10-24T18:04:40.469442] [INFO ] [LOCAL     ] CPF: Starting deletion of primary data.
[2025-10-24T18:04:40.469729] [DEBUG] [LOCAL     ] CPF: Deleted primary data file.
[2025-10-24T18:04:40.469787] [INFO ] [MAIN      ] CPF: Starting full primary refresh.
[2025-10-24T18:04:40.832236] [INFO ] [REMOTE    ] CPF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:04:40.947725] [INFO ] [REMOTE    ] CPAY: Fetching primary data for 2025-01.
[2025-10-24T18:04:41.561435] [INFO ] [REMOTE    ] CPA: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T18:04:41.747697] [INFO ] [REMOTE    ] CPA: Fetching primary data for 2025-09.
[2025-10-24T18:04:42.317465] [INFO ] [REMOTE    ] CPAY: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T18:04:42.547614] [INFO ] [REMOTE    ] CPAY: Fetching primary data for 2025-02.
[2025-10-24T18:04:42.778517] [INFO ] [REMOTE    ] CPA: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T18:04:43.347712] [INFO ] [REMOTE    ] CPAC: Fetching primary data for 2025-04.
[2025-10-24T18:04:43.796321] [INFO ] [REMOTE    ] CPAC: Incremental fetch complete for 2025-04 (0.45 seconds).
[2025-10-24T18:04:43.818620] [INFO ] [REMOTE    ] CPAY: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T18:04:44.147639] [INFO ] [REMOTE    ] CPF: Fetching primary data for 2025-01.
[2025-10-24T18:04:44.947675] [INFO ] [REMOTE    ] CPA: Fetching primary data for 2025-10.
[2025-10-24T18:04:45.612186] [INFO ] [REMOTE    ] CPF: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T18:04:45.747671] [INFO ] [REMOTE    ] CPAY: Fetching primary data for 2025-03.
[2025-10-24T18:04:46.547635] [INFO ] [REMOTE    ] CPAC: Fetching primary data for 2025-05.
[2025-10-24T18:04:46.785255] [INFO ] [REMOTE    ] CPA: Incremental fetch complete for 2025-10 (1.84 seconds).
[2025-10-24T18:04:46.790551] [INFO ] [REMOTE    ] CPA: Full fetch complete (40979 records).
[2025-10-24T18:04:46.790678] [DEBUG] [VALIDATOR ] CPA: Validating primary data.
[2025-10-24T18:04:47.018880] [INFO ] [REMOTE    ] CPAC: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T18:04:47.195331] [INFO ] [REMOTE    ] CPAY: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T18:04:47.253508] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present.
[2025-10-24T18:04:47.253606] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed.
[2025-10-24T18:04:47.254496] [INFO ] [MAIN      ] CPA: Fetched primary data is valid.
[2025-10-24T18:04:47.254578] [DEBUG] [LOCAL     ] CPA: Saving primary data.
[2025-10-24T18:04:47.255056] [FATAL] [LOCAL     ] CPA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:04:47.255143] [FATAL] [MAIN      ] CPA: Failed to save primary data.
[2025-10-24T18:04:47.255185] [WARN ] [MAIN      ] CPA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:04:47.255221] [INFO ] [LOCAL     ] CPA: Starting deletion of primary data.
[2025-10-24T18:04:47.255278] [DEBUG] [LOCAL     ] CPA: No primary data file found to delete.
[2025-10-24T18:04:47.255314] [INFO ] [LOCAL     ] CPA: Starting deletion of derivative data.
[2025-10-24T18:04:47.255483] [DEBUG] [LOCAL     ] CPA: Deleted derivative data file.
[2025-10-24T18:04:47.255583] [INFO ] [MAIN      ] Update Progress: 516/2366 symbols completed. CPA took 27.6s. Estimated remaining: 3h 52m 6s. Rate: 8.0 symbols/min
[2025-10-24T18:04:47.352856] [INFO ] [REMOTE    ] CPAC: Fetching primary data for 2025-06.
[2025-10-24T18:04:47.446047] [INFO ] [MAIN      ] CPK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:04:47.465385] [DEBUG] [LOCAL     ] CPK: Loaded 14004 existing records from primary storage.
[2025-10-24T18:04:47.465751] [INFO ] [MAIN      ] CPK: Loaded 14004 existing records.
[2025-10-24T18:04:47.662252] [WARN ] [MAIN      ] CPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:04:47.662508] [INFO ] [MAIN      ] CPK: Wiping existing primary data before full refresh.
[2025-10-24T18:04:47.662555] [INFO ] [LOCAL     ] CPK: Starting deletion of primary data.
[2025-10-24T18:04:47.662773] [DEBUG] [LOCAL     ] CPK: Deleted primary data file.
[2025-10-24T18:04:47.662829] [INFO ] [MAIN      ] CPK: Starting full primary refresh.
[2025-10-24T18:04:47.783915] [INFO ] [REMOTE    ] CPAC: Incremental fetch complete for 2025-06 (0.43 seconds).
[2025-10-24T18:04:48.068391] [INFO ] [REMOTE    ] CPK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:04:48.147633] [INFO ] [REMOTE    ] CPK: Fetching primary data for 2025-01.
[2025-10-24T18:04:48.947721] [INFO ] [REMOTE    ] CPAY: Fetching primary data for 2025-04.
[2025-10-24T18:04:49.113383] [INFO ] [REMOTE    ] CPK: Incremental fetch complete for 2025-01 (0.97 seconds).
[2025-10-24T18:04:49.747630] [INFO ] [REMOTE    ] CPK: Fetching primary data for 2025-02.
[2025-10-24T18:04:50.164921] [INFO ] [REMOTE    ] CPAY: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T18:04:50.538423] [INFO ] [REMOTE    ] CPK: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T18:04:50.547596] [INFO ] [REMOTE    ] CPK: Fetching primary data for 2025-03.
[2025-10-24T18:04:51.347633] [INFO ] [REMOTE    ] CPAC: Fetching primary data for 2025-07.
[2025-10-24T18:04:51.393982] [INFO ] [REMOTE    ] CPK: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T18:04:51.724026] [INFO ] [REMOTE    ] CPAC: Incremental fetch complete for 2025-07 (0.38 seconds).
[2025-10-24T18:04:52.147678] [INFO ] [REMOTE    ] CPK: Fetching primary data for 2025-04.
[2025-10-24T18:04:52.947681] [INFO ] [REMOTE    ] CPAC: Fetching primary data for 2025-08.
[2025-10-24T18:04:53.112571] [INFO ] [REMOTE    ] CPK: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T18:04:53.259428] [INFO ] [REMOTE    ] CPAC: Incremental fetch complete for 2025-08 (0.31 seconds).
[2025-10-24T18:04:53.747710] [INFO ] [REMOTE    ] CPAY: Fetching primary data for 2025-05.
[2025-10-24T18:04:54.547751] [INFO ] [REMOTE    ] CPF: Fetching primary data for 2025-02.
[2025-10-24T18:04:55.240284] [INFO ] [REMOTE    ] CPAY: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T18:04:55.347714] [INFO ] [REMOTE    ] CPAY: Fetching primary data for 2025-06.
[2025-10-24T18:04:55.583578] [INFO ] [REMOTE    ] CPF: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T18:04:56.147703] [INFO ] [REMOTE    ] CPK: Fetching primary data for 2025-05.
[2025-10-24T18:04:56.368792] [INFO ] [REMOTE    ] CPAY: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T18:04:56.947670] [INFO ] [REMOTE    ] CPF: Fetching primary data for 2025-03.
[2025-10-24T18:04:57.123576] [INFO ] [REMOTE    ] CPK: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T18:04:57.704622] [INFO ] [REMOTE    ] CPF: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T18:04:57.747700] [INFO ] [REMOTE    ] CPF: Fetching primary data for 2025-04.
[2025-10-24T18:04:58.547701] [INFO ] [REMOTE    ] CPAC: Fetching primary data for 2025-09.
[2025-10-24T18:04:58.621118] [INFO ] [REMOTE    ] CPF: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T18:04:59.082863] [INFO ] [REMOTE    ] CPAC: Incremental fetch complete for 2025-09 (0.54 seconds).
[2025-10-24T18:04:59.347638] [INFO ] [REMOTE    ] CPAC: Fetching primary data for 2025-10.
[2025-10-24T18:04:59.961065] [INFO ] [REMOTE    ] CPAC: Incremental fetch complete for 2025-10 (0.61 seconds).
[2025-10-24T18:04:59.961992] [INFO ] [REMOTE    ] CPAC: Full fetch complete (1792 records).
[2025-10-24T18:04:59.962066] [DEBUG] [VALIDATOR ] CPAC: Validating primary data.
[2025-10-24T18:05:00.140608] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T18:05:00.140791] [FATAL] [MAIN      ] CPAC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:05:00.140872] [WARN ] [MAIN      ] CPAC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:05:00.140941] [INFO ] [LOCAL     ] CPAC: Starting deletion of primary data.
[2025-10-24T18:05:00.141001] [DEBUG] [LOCAL     ] CPAC: No primary data file found to delete.
[2025-10-24T18:05:00.141043] [INFO ] [LOCAL     ] CPAC: Starting deletion of derivative data.
[2025-10-24T18:05:00.141082] [DEBUG] [LOCAL     ] CPAC: No derivative data file found to delete.
[2025-10-24T18:05:00.141133] [INFO ] [MAIN      ] Update Progress: 517/2366 symbols completed. CPAC took 27.2s. Estimated remaining: 3h 52m 18s. Rate: 8.0 symbols/min
[2025-10-24T18:05:00.147603] [INFO ] [REMOTE    ] CPF: Fetching primary data for 2025-05.
[2025-10-24T18:05:00.947617] [INFO ] [REMOTE    ] CPK: Fetching primary data for 2025-06.
[2025-10-24T18:05:01.162730] [INFO ] [REMOTE    ] CPF: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T18:05:01.747705] [INFO ] [REMOTE    ] CPF: Fetching primary data for 2025-06.
[2025-10-24T18:05:02.075678] [INFO ] [REMOTE    ] CPK: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T18:05:02.547688] [INFO ] [REMOTE    ] CPAY: Fetching primary data for 2025-07.
[2025-10-24T18:05:02.991360] [INFO ] [REMOTE    ] CPF: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T18:05:03.347712] [INFO ] [REMOTE    ] CPK: Fetching primary data for 2025-07.
[2025-10-24T18:05:04.147752] [INFO ] [REMOTE    ] CPF: Fetching primary data for 2025-07.
[2025-10-24T18:05:04.801569] [INFO ] [REMOTE    ] CPAY: Incremental fetch complete for 2025-07 (2.25 seconds).
[2025-10-24T18:05:04.876812] [INFO ] [REMOTE    ] CPK: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T18:05:04.947604] [INFO ] [REMOTE    ] CPAY: Fetching primary data for 2025-08.
[2025-10-24T18:05:05.747726] [INFO ] [REMOTE    ] CPK: Fetching primary data for 2025-08.
[2025-10-24T18:05:06.457067] [INFO ] [REMOTE    ] CPF: Incremental fetch complete for 2025-07 (2.31 seconds).
[2025-10-24T18:05:06.547632] [INFO ] [REMOTE    ] CPF: Fetching primary data for 2025-08.
[2025-10-24T18:05:06.728401] [INFO ] [REMOTE    ] CPAY: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T18:05:07.347684] [INFO ] [REMOTE    ] CPAY: Fetching primary data for 2025-09.
[2025-10-24T18:05:07.519029] [INFO ] [REMOTE    ] CPK: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T18:05:08.065782] [INFO ] [REMOTE    ] CPF: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T18:05:08.147723] [INFO ] [REMOTE    ] CPK: Fetching primary data for 2025-09.
[2025-10-24T18:05:08.647031] [INFO ] [REMOTE    ] CPAY: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T18:05:08.947732] [INFO ] [REMOTE    ] CPAY: Fetching primary data for 2025-10.
[2025-10-24T18:05:09.136170] [INFO ] [REMOTE    ] CPK: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T18:05:09.747677] [INFO ] [REMOTE    ] CPF: Fetching primary data for 2025-09.
[2025-10-24T18:05:10.207572] [INFO ] [REMOTE    ] CPAY: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T18:05:10.213232] [INFO ] [REMOTE    ] CPAY: Full fetch complete (44604 records).
[2025-10-24T18:05:10.213387] [DEBUG] [VALIDATOR ] CPAY: Validating primary data.
[2025-10-24T18:05:10.550000] [INFO ] [REMOTE    ] CPK: Fetching primary data for 2025-10.
[2025-10-24T18:05:10.587200] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present.
[2025-10-24T18:05:10.587310] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed.
[2025-10-24T18:05:10.588477] [INFO ] [MAIN      ] CPAY: Fetched primary data is valid.
[2025-10-24T18:05:10.588579] [DEBUG] [LOCAL     ] CPAY: Saving primary data.
[2025-10-24T18:05:10.589154] [FATAL] [LOCAL     ] CPAY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:05:10.589238] [FATAL] [MAIN      ] CPAY: Failed to save primary data.
[2025-10-24T18:05:10.589284] [WARN ] [MAIN      ] CPAY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:05:10.589369] [INFO ] [LOCAL     ] CPAY: Starting deletion of primary data.
[2025-10-24T18:05:10.589454] [DEBUG] [LOCAL     ] CPAY: No primary data file found to delete.
[2025-10-24T18:05:10.589511] [INFO ] [LOCAL     ] CPAY: Starting deletion of derivative data.
[2025-10-24T18:05:10.589827] [DEBUG] [LOCAL     ] CPAY: Deleted derivative data file.
[2025-10-24T18:05:10.589936] [INFO ] [MAIN      ] Update Progress: 518/2366 symbols completed. CPAY took 36.5s. Estimated remaining: 3h 52m 21s. Rate: 8.0 symbols/min
[2025-10-24T18:05:10.646494] [INFO ] [REMOTE    ] CPF: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T18:05:11.347683] [INFO ] [REMOTE    ] CPF: Fetching primary data for 2025-10.
[2025-10-24T18:05:11.655916] [INFO ] [REMOTE    ] CPK: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T18:05:11.659457] [INFO ] [REMOTE    ] CPK: Full fetch complete (18763 records).
[2025-10-24T18:05:11.659553] [DEBUG] [VALIDATOR ] CPK: Validating primary data.
[2025-10-24T18:05:11.660029] [FATAL] [VALIDATOR ] CPK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:05:11.660115] [FATAL] [MAIN      ] CPK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:05:11.660158] [WARN ] [MAIN      ] CPK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:05:11.660228] [INFO ] [LOCAL     ] CPK: Starting deletion of primary data.
[2025-10-24T18:05:11.660289] [DEBUG] [LOCAL     ] CPK: No primary data file found to delete.
[2025-10-24T18:05:11.660324] [INFO ] [LOCAL     ] CPK: Starting deletion of derivative data.
[2025-10-24T18:05:11.660453] [DEBUG] [LOCAL     ] CPK: Deleted derivative data file.
[2025-10-24T18:05:11.660521] [INFO ] [MAIN      ] Update Progress: 519/2366 symbols completed. CPK took 24.4s. Estimated remaining: 3h 51m 50s. Rate: 8.0 symbols/min
[2025-10-24T18:05:12.479240] [INFO ] [REMOTE    ] CPF: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T18:05:12.482617] [INFO ] [REMOTE    ] CPF: Full fetch complete (23166 records).
[2025-10-24T18:05:12.482731] [DEBUG] [VALIDATOR ] CPF: Validating primary data.
[2025-10-24T18:05:12.894021] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present.
[2025-10-24T18:05:12.894100] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed.
[2025-10-24T18:05:12.894587] [INFO ] [MAIN      ] CPF: Fetched primary data is valid.
[2025-10-24T18:05:12.894675] [DEBUG] [LOCAL     ] CPF: Saving primary data.
[2025-10-24T18:05:12.895048] [FATAL] [LOCAL     ] CPF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:05:12.895131] [FATAL] [MAIN      ] CPF: Failed to save primary data.
[2025-10-24T18:05:12.895172] [WARN ] [MAIN      ] CPF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:05:12.895206] [INFO ] [LOCAL     ] CPF: Starting deletion of primary data.
[2025-10-24T18:05:12.895255] [DEBUG] [LOCAL     ] CPF: No primary data file found to delete.
[2025-10-24T18:05:12.895289] [INFO ] [LOCAL     ] CPF: Starting deletion of derivative data.
[2025-10-24T18:05:12.895433] [DEBUG] [LOCAL     ] CPF: Deleted derivative data file.
[2025-10-24T18:05:12.895533] [INFO ] [MAIN      ] Update Progress: 520/2366 symbols completed. CPF took 32.8s. Estimated remaining: 3h 51m 20s. Rate: 8.0 symbols/min
[2025-10-24T18:05:13.527967] [INFO ] [MAIN      ] CPS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:05:13.589988] [INFO ] [MAIN      ] CPRI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:05:13.643422] [INFO ] [MAIN      ] CPT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:05:13.649133] [INFO ] [MAIN      ] CPNG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:05:13.673978] [DEBUG] [LOCAL     ] CPS: Loaded 25046 existing records from primary storage.
[2025-10-24T18:05:13.674358] [INFO ] [MAIN      ] CPS: Loaded 25046 existing records.
[2025-10-24T18:05:13.935925] [WARN ] [MAIN      ] CPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:05:13.949443] [INFO ] [MAIN      ] CPS: Wiping existing primary data before full refresh.
[2025-10-24T18:05:13.949260] [DEBUG] [LOCAL     ] CPRI: Loaded 52812 existing records from primary storage.
[2025-10-24T18:05:13.950389] [INFO ] [LOCAL     ] CPS: Starting deletion of primary data.
[2025-10-24T18:05:13.952235] [INFO ] [MAIN      ] CPRI: Loaded 52812 existing records.
[2025-10-24T18:05:13.957920] [DEBUG] [LOCAL     ] CPS: Deleted primary data file.
[2025-10-24T18:05:13.963694] [INFO ] [MAIN      ] CPS: Starting full primary refresh.
[2025-10-24T18:05:14.070779] [DEBUG] [LOCAL     ] CPT: Loaded 44826 existing records from primary storage.
[2025-10-24T18:05:14.108075] [DEBUG] [LOCAL     ] CPNG: Loaded 54069 existing records from primary storage.
[2025-10-24T18:05:14.151556] [INFO ] [MAIN      ] CPNG: Loaded 54069 existing records.
[2025-10-24T18:05:14.117509] [INFO ] [MAIN      ] CPT: Loaded 44826 existing records.
[2025-10-24T18:05:14.484836] [WARN ] [MAIN      ] CPRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:05:14.566371] [INFO ] [MAIN      ] CPRI: Wiping existing primary data before full refresh.
[2025-10-24T18:05:14.572088] [INFO ] [LOCAL     ] CPRI: Starting deletion of primary data.
[2025-10-24T18:05:14.729580] [WARN ] [MAIN      ] CPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:05:14.739970] [DEBUG] [LOCAL     ] CPRI: Deleted primary data file.
[2025-10-24T18:05:14.797711] [INFO ] [MAIN      ] CPRI: Starting full primary refresh.
[2025-10-24T18:05:14.829544] [INFO ] [MAIN      ] CPT: Wiping existing primary data before full refresh.
[2025-10-24T18:05:14.832790] [WARN ] [MAIN      ] CPNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:05:14.849963] [INFO ] [LOCAL     ] CPT: Starting deletion of primary data.
[2025-10-24T18:05:14.866271] [INFO ] [MAIN      ] CPNG: Wiping existing primary data before full refresh.
[2025-10-24T18:05:14.890611] [DEBUG] [LOCAL     ] CPT: Deleted primary data file.
[2025-10-24T18:05:14.880308] [INFO ] [LOCAL     ] CPNG: Starting deletion of primary data.
[2025-10-24T18:05:14.936382] [INFO ] [MAIN      ] CPT: Starting full primary refresh.
[2025-10-24T18:05:15.034996] [DEBUG] [LOCAL     ] CPNG: Deleted primary data file.
[2025-10-24T18:05:15.058866] [INFO ] [MAIN      ] CPNG: Starting full primary refresh.
[2025-10-24T18:05:15.058769] [INFO ] [REMOTE    ] CPS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:05:15.074709] [INFO ] [REMOTE    ] CPS: Fetching primary data for 2025-01.
[2025-10-24T18:05:15.889955] [INFO ] [REMOTE    ] CPRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:05:15.948547] [INFO ] [REMOTE    ] CPRI: Fetching primary data for 2025-01.
[2025-10-24T18:05:15.964056] [INFO ] [REMOTE    ] CPT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:05:15.982282] [INFO ] [REMOTE    ] CPT: Fetching primary data for 2025-01.
[2025-10-24T18:05:16.023055] [INFO ] [REMOTE    ] CPNG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:05:16.023847] [INFO ] [REMOTE    ] CPNG: Fetching primary data for 2025-01.
[2025-10-24T18:05:16.348531] [INFO ] [REMOTE    ] CPS: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T18:05:16.353141] [INFO ] [REMOTE    ] CPS: Fetching primary data for 2025-02.
[2025-10-24T18:05:17.288020] [INFO ] [REMOTE    ] CPS: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T18:05:17.293518] [INFO ] [REMOTE    ] CPS: Fetching primary data for 2025-03.
[2025-10-24T18:05:17.657707] [INFO ] [REMOTE    ] CPNG: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T18:05:17.668803] [INFO ] [REMOTE    ] CPNG: Fetching primary data for 2025-02.
[2025-10-24T18:05:17.761750] [INFO ] [REMOTE    ] CPT: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T18:05:17.770301] [INFO ] [REMOTE    ] CPT: Fetching primary data for 2025-02.
[2025-10-24T18:05:17.855184] [INFO ] [REMOTE    ] CPRI: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T18:05:18.469564] [INFO ] [REMOTE    ] CPS: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T18:05:18.547624] [INFO ] [REMOTE    ] CPRI: Fetching primary data for 2025-02.
[2025-10-24T18:05:19.171788] [INFO ] [REMOTE    ] CPT: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T18:05:19.347690] [INFO ] [REMOTE    ] CPS: Fetching primary data for 2025-04.
[2025-10-24T18:05:19.774188] [INFO ] [REMOTE    ] CPNG: Incremental fetch complete for 2025-02 (2.11 seconds).
[2025-10-24T18:05:19.936166] [INFO ] [REMOTE    ] CPRI: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T18:05:20.147673] [INFO ] [REMOTE    ] CPRI: Fetching primary data for 2025-03.
[2025-10-24T18:05:20.623275] [INFO ] [REMOTE    ] CPS: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T18:05:20.947683] [INFO ] [REMOTE    ] CPS: Fetching primary data for 2025-05.
[2025-10-24T18:05:21.747686] [INFO ] [REMOTE    ] CPNG: Fetching primary data for 2025-03.
[2025-10-24T18:05:22.020746] [INFO ] [REMOTE    ] CPRI: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T18:05:22.275509] [INFO ] [REMOTE    ] CPS: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T18:05:22.547756] [INFO ] [REMOTE    ] CPT: Fetching primary data for 2025-03.
[2025-10-24T18:05:23.347621] [INFO ] [REMOTE    ] CPRI: Fetching primary data for 2025-04.
[2025-10-24T18:05:23.399735] [INFO ] [REMOTE    ] CPNG: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T18:05:24.049506] [INFO ] [REMOTE    ] CPT: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T18:05:24.147629] [INFO ] [REMOTE    ] CPNG: Fetching primary data for 2025-04.
[2025-10-24T18:05:24.947768] [INFO ] [REMOTE    ] CPS: Fetching primary data for 2025-06.
[2025-10-24T18:05:25.177749] [INFO ] [REMOTE    ] CPRI: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T18:05:25.747629] [INFO ] [REMOTE    ] CPRI: Fetching primary data for 2025-05.
[2025-10-24T18:05:26.104054] [INFO ] [REMOTE    ] CPNG: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T18:05:26.130543] [INFO ] [REMOTE    ] CPS: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T18:05:26.547686] [INFO ] [REMOTE    ] CPS: Fetching primary data for 2025-07.
[2025-10-24T18:05:27.347620] [INFO ] [REMOTE    ] CPT: Fetching primary data for 2025-04.
[2025-10-24T18:05:27.514384] [INFO ] [REMOTE    ] CPRI: Incremental fetch complete for 2025-05 (1.77 seconds).
[2025-10-24T18:05:27.735811] [INFO ] [REMOTE    ] CPS: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T18:05:28.147638] [INFO ] [REMOTE    ] CPS: Fetching primary data for 2025-08.
[2025-10-24T18:05:28.947625] [INFO ] [REMOTE    ] CPRI: Fetching primary data for 2025-06.
[2025-10-24T18:05:29.100737] [INFO ] [REMOTE    ] CPT: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T18:05:29.264957] [INFO ] [REMOTE    ] CPS: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T18:05:29.747726] [INFO ] [REMOTE    ] CPNG: Fetching primary data for 2025-05.
[2025-10-24T18:05:30.547620] [INFO ] [REMOTE    ] CPS: Fetching primary data for 2025-09.
[2025-10-24T18:05:30.659837] [INFO ] [REMOTE    ] CPRI: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T18:05:31.347692] [INFO ] [REMOTE    ] CPRI: Fetching primary data for 2025-07.
[2025-10-24T18:05:31.441711] [INFO ] [REMOTE    ] CPS: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T18:05:32.147622] [INFO ] [REMOTE    ] CPT: Fetching primary data for 2025-05.
[2025-10-24T18:05:32.212673] [INFO ] [REMOTE    ] CPNG: Incremental fetch complete for 2025-05 (2.46 seconds).
[2025-10-24T18:05:32.947617] [INFO ] [REMOTE    ] CPNG: Fetching primary data for 2025-06.
[2025-10-24T18:05:33.103662] [INFO ] [REMOTE    ] CPRI: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T18:05:33.638107] [INFO ] [REMOTE    ] CPT: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T18:05:33.747677] [INFO ] [REMOTE    ] CPT: Fetching primary data for 2025-06.
[2025-10-24T18:05:34.547633] [INFO ] [REMOTE    ] CPS: Fetching primary data for 2025-10.
[2025-10-24T18:05:34.880153] [INFO ] [REMOTE    ] CPNG: Incremental fetch complete for 2025-06 (1.93 seconds).
[2025-10-24T18:05:35.122573] [INFO ] [REMOTE    ] CPT: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T18:05:35.347616] [INFO ] [REMOTE    ] CPRI: Fetching primary data for 2025-08.
[2025-10-24T18:05:35.365602] [INFO ] [REMOTE    ] CPS: Incremental fetch complete for 2025-10 (0.82 seconds).
[2025-10-24T18:05:35.369962] [INFO ] [REMOTE    ] CPS: Full fetch complete (36546 records).
[2025-10-24T18:05:35.370078] [DEBUG] [VALIDATOR ] CPS: Validating primary data.
[2025-10-24T18:05:35.746105] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present.
[2025-10-24T18:05:35.746199] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed.
[2025-10-24T18:05:35.746832] [INFO ] [MAIN      ] CPS: Fetched primary data is valid.
[2025-10-24T18:05:35.746895] [DEBUG] [LOCAL     ] CPS: Saving primary data.
[2025-10-24T18:05:35.747282] [FATAL] [LOCAL     ] CPS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:05:35.747367] [FATAL] [MAIN      ] CPS: Failed to save primary data.
[2025-10-24T18:05:35.747411] [WARN ] [MAIN      ] CPS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:05:35.747472] [INFO ] [LOCAL     ] CPS: Starting deletion of primary data.
[2025-10-24T18:05:35.747532] [DEBUG] [LOCAL     ] CPS: No primary data file found to delete.
[2025-10-24T18:05:35.747568] [INFO ] [LOCAL     ] CPS: Starting deletion of derivative data.
[2025-10-24T18:05:35.747731] [DEBUG] [LOCAL     ] CPS: Deleted derivative data file.
[2025-10-24T18:05:35.747820] [INFO ] [MAIN      ] Update Progress: 521/2366 symbols completed. CPS took 22.8s. Estimated remaining: 3h 52m 7s. Rate: 7.9 symbols/min
[2025-10-24T18:05:35.924701] [INFO ] [MAIN      ] CQP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:05:35.943032] [DEBUG] [LOCAL     ] CQP: Loaded 18778 existing records from primary storage.
[2025-10-24T18:05:35.943268] [INFO ] [MAIN      ] CQP: Loaded 18778 existing records.
[2025-10-24T18:05:36.117839] [WARN ] [MAIN      ] CQP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:05:36.118054] [INFO ] [MAIN      ] CQP: Wiping existing primary data before full refresh.
[2025-10-24T18:05:36.118101] [INFO ] [LOCAL     ] CQP: Starting deletion of primary data.
[2025-10-24T18:05:36.118322] [DEBUG] [LOCAL     ] CQP: Deleted primary data file.
[2025-10-24T18:05:36.118360] [INFO ] [MAIN      ] CQP: Starting full primary refresh.
[2025-10-24T18:05:36.152779] [INFO ] [REMOTE    ] CPT: Fetching primary data for 2025-07.
[2025-10-24T18:05:36.468565] [INFO ] [REMOTE    ] CQP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:05:36.947729] [INFO ] [REMOTE    ] CPNG: Fetching primary data for 2025-07.
[2025-10-24T18:05:37.128060] [INFO ] [REMOTE    ] CPRI: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T18:05:37.760620] [INFO ] [REMOTE    ] CQP: Fetching primary data for 2025-01.
[2025-10-24T18:05:37.762320] [INFO ] [REMOTE    ] CPT: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T18:05:38.547694] [INFO ] [REMOTE    ] CPT: Fetching primary data for 2025-08.
[2025-10-24T18:05:38.859774] [INFO ] [REMOTE    ] CPNG: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T18:05:38.985589] [INFO ] [REMOTE    ] CQP: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T18:05:39.347697] [INFO ] [REMOTE    ] CPNG: Fetching primary data for 2025-08.
[2025-10-24T18:05:39.886223] [INFO ] [REMOTE    ] CPT: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T18:05:40.147687] [INFO ] [REMOTE    ] CPT: Fetching primary data for 2025-09.
[2025-10-24T18:05:40.947615] [INFO ] [REMOTE    ] CPRI: Fetching primary data for 2025-09.
[2025-10-24T18:05:41.509605] [INFO ] [REMOTE    ] CPNG: Incremental fetch complete for 2025-08 (2.16 seconds).
[2025-10-24T18:05:41.670770] [INFO ] [REMOTE    ] CPT: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T18:05:41.747636] [INFO ] [REMOTE    ] CPNG: Fetching primary data for 2025-09.
[2025-10-24T18:05:42.444513] [INFO ] [REMOTE    ] CPRI: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T18:05:42.547684] [INFO ] [REMOTE    ] CPRI: Fetching primary data for 2025-10.
[2025-10-24T18:05:43.347681] [INFO ] [REMOTE    ] CQP: Fetching primary data for 2025-02.
[2025-10-24T18:05:43.968914] [INFO ] [REMOTE    ] CPNG: Incremental fetch complete for 2025-09 (2.22 seconds).
[2025-10-24T18:05:44.147637] [INFO ] [REMOTE    ] CPNG: Fetching primary data for 2025-10.
[2025-10-24T18:05:44.432749] [INFO ] [REMOTE    ] CPRI: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T18:05:44.444713] [INFO ] [REMOTE    ] CPRI: Full fetch complete (76189 records).
[2025-10-24T18:05:44.444956] [DEBUG] [VALIDATOR ] CPRI: Validating primary data.
[2025-10-24T18:05:44.669932] [INFO ] [REMOTE    ] CQP: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T18:05:44.885445] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present.
[2025-10-24T18:05:44.885541] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed.
[2025-10-24T18:05:44.886598] [INFO ] [MAIN      ] CPRI: Fetched primary data is valid.
[2025-10-24T18:05:44.886697] [DEBUG] [LOCAL     ] CPRI: Saving primary data.
[2025-10-24T18:05:44.887469] [FATAL] [LOCAL     ] CPRI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:05:44.887583] [FATAL] [MAIN      ] CPRI: Failed to save primary data.
[2025-10-24T18:05:44.887683] [WARN ] [MAIN      ] CPRI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:05:44.887780] [INFO ] [LOCAL     ] CPRI: Starting deletion of primary data.
[2025-10-24T18:05:44.887861] [DEBUG] [LOCAL     ] CPRI: No primary data file found to delete.
[2025-10-24T18:05:44.887901] [INFO ] [LOCAL     ] CPRI: Starting deletion of derivative data.
[2025-10-24T18:05:44.888055] [DEBUG] [LOCAL     ] CPRI: Deleted derivative data file.
[2025-10-24T18:05:44.888486] [INFO ] [MAIN      ] Update Progress: 522/2366 symbols completed. CPRI took 32.0s. Estimated remaining: 3h 52m 5s. Rate: 7.9 symbols/min
[2025-10-24T18:05:44.957606] [INFO ] [REMOTE    ] CPT: Fetching primary data for 2025-10.
[2025-10-24T18:05:45.086442] [INFO ] [MAIN      ] CR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:05:45.122624] [DEBUG] [LOCAL     ] CR: Loaded 24152 existing records from primary storage.
[2025-10-24T18:05:45.123043] [INFO ] [MAIN      ] CR: Loaded 24152 existing records.
[2025-10-24T18:05:45.418084] [WARN ] [MAIN      ] CR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:05:45.418343] [INFO ] [MAIN      ] CR: Wiping existing primary data before full refresh.
[2025-10-24T18:05:45.418393] [INFO ] [LOCAL     ] CR: Starting deletion of primary data.
[2025-10-24T18:05:45.418745] [DEBUG] [LOCAL     ] CR: Deleted primary data file.
[2025-10-24T18:05:45.418806] [INFO ] [MAIN      ] CR: Starting full primary refresh.
[2025-10-24T18:05:45.759448] [INFO ] [REMOTE    ] CQP: Fetching primary data for 2025-03.
[2025-10-24T18:05:45.945446] [INFO ] [REMOTE    ] CR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:05:46.547638] [INFO ] [REMOTE    ] CR: Fetching primary data for 2025-01.
[2025-10-24T18:05:46.616455] [INFO ] [REMOTE    ] CPT: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T18:05:46.650795] [INFO ] [REMOTE    ] CPT: Full fetch complete (64753 records).
[2025-10-24T18:05:46.651252] [DEBUG] [VALIDATOR ] CPT: Validating primary data.
[2025-10-24T18:05:46.653159] [INFO ] [REMOTE    ] CPNG: Incremental fetch complete for 2025-10 (2.51 seconds).
[2025-10-24T18:05:46.709187] [INFO ] [REMOTE    ] CPNG: Full fetch complete (77791 records).
[2025-10-24T18:05:46.744704] [DEBUG] [VALIDATOR ] CPNG: Validating primary data.
[2025-10-24T18:05:46.830506] [INFO ] [REMOTE    ] CQP: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T18:05:47.356859] [INFO ] [REMOTE    ] CQP: Fetching primary data for 2025-04.
[2025-10-24T18:05:47.412475] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present.
[2025-10-24T18:05:47.426721] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed.
[2025-10-24T18:05:47.427599] [INFO ] [MAIN      ] CPT: Fetched primary data is valid.
[2025-10-24T18:05:47.427714] [DEBUG] [LOCAL     ] CPT: Saving primary data.
[2025-10-24T18:05:47.428509] [FATAL] [LOCAL     ] CPT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:05:47.428707] [FATAL] [MAIN      ] CPT: Failed to save primary data.
[2025-10-24T18:05:47.428789] [WARN ] [MAIN      ] CPT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:05:47.428871] [INFO ] [LOCAL     ] CPT: Starting deletion of primary data.
[2025-10-24T18:05:47.428950] [DEBUG] [LOCAL     ] CPT: No primary data file found to delete.
[2025-10-24T18:05:47.428995] [INFO ] [LOCAL     ] CPT: Starting deletion of derivative data.
[2025-10-24T18:05:47.429124] [DEBUG] [LOCAL     ] CPT: Deleted derivative data file.
[2025-10-24T18:05:47.429317] [INFO ] [MAIN      ] Update Progress: 523/2366 symbols completed. CPT took 34.5s. Estimated remaining: 3h 51m 40s. Rate: 8.0 symbols/min
[2025-10-24T18:05:47.634622] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present.
[2025-10-24T18:05:47.638811] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed.
[2025-10-24T18:05:47.639763] [INFO ] [MAIN      ] CPNG: Fetched primary data is valid.
[2025-10-24T18:05:47.639938] [DEBUG] [LOCAL     ] CPNG: Saving primary data.
[2025-10-24T18:05:47.640800] [FATAL] [LOCAL     ] CPNG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:05:47.661707] [FATAL] [MAIN      ] CPNG: Failed to save primary data.
[2025-10-24T18:05:47.680729] [WARN ] [MAIN      ] CPNG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:05:47.713254] [INFO ] [LOCAL     ] CPNG: Starting deletion of primary data.
[2025-10-24T18:05:47.713192] [INFO ] [MAIN      ] CRBD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:05:47.713590] [DEBUG] [LOCAL     ] CPNG: No primary data file found to delete.
[2025-10-24T18:05:47.713694] [INFO ] [LOCAL     ] CPNG: Starting deletion of derivative data.
[2025-10-24T18:05:47.714117] [DEBUG] [LOCAL     ] CPNG: Deleted derivative data file.
[2025-10-24T18:05:47.714444] [INFO ] [MAIN      ] Update Progress: 524/2366 symbols completed. CPNG took 34.8s. Estimated remaining: 3h 51m 7s. Rate: 8.0 symbols/min
[2025-10-24T18:05:47.832271] [INFO ] [REMOTE    ] CR: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T18:05:47.845328] [DEBUG] [LOCAL     ] CRBD: Loaded 8790 existing records from primary storage.
[2025-10-24T18:05:47.845834] [INFO ] [MAIN      ] CRBD: Loaded 8790 existing records.
[2025-10-24T18:05:48.035124] [INFO ] [MAIN      ] CRBG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:05:48.125293] [WARN ] [MAIN      ] CRBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:05:48.126270] [INFO ] [MAIN      ] CRBD: Wiping existing primary data before full refresh.
[2025-10-24T18:05:48.126329] [INFO ] [LOCAL     ] CRBD: Starting deletion of primary data.
[2025-10-24T18:05:48.126470] [DEBUG] [LOCAL     ] CRBD: Deleted primary data file.
[2025-10-24T18:05:48.126511] [INFO ] [MAIN      ] CRBD: Starting full primary refresh.
[2025-10-24T18:05:48.156584] [INFO ] [REMOTE    ] CR: Fetching primary data for 2025-02.
[2025-10-24T18:05:48.466977] [INFO ] [REMOTE    ] CQP: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T18:05:48.472411] [DEBUG] [LOCAL     ] CRBG: Loaded 52974 existing records from primary storage.
[2025-10-24T18:05:48.478955] [INFO ] [MAIN      ] CRBG: Loaded 52974 existing records.
[2025-10-24T18:05:48.663834] [INFO ] [REMOTE    ] CRBD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:05:48.727427] [WARN ] [MAIN      ] CRBG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:05:48.727626] [INFO ] [MAIN      ] CRBG: Wiping existing primary data before full refresh.
[2025-10-24T18:05:48.727718] [INFO ] [LOCAL     ] CRBG: Starting deletion of primary data.
[2025-10-24T18:05:48.728105] [DEBUG] [LOCAL     ] CRBG: Deleted primary data file.
[2025-10-24T18:05:48.728161] [INFO ] [MAIN      ] CRBG: Starting full primary refresh.
[2025-10-24T18:05:48.957340] [INFO ] [REMOTE    ] CQP: Fetching primary data for 2025-05.
[2025-10-24T18:05:49.094434] [INFO ] [REMOTE    ] CRBG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:05:49.106914] [INFO ] [REMOTE    ] CR: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T18:05:49.747726] [INFO ] [REMOTE    ] CRBD: Fetching primary data for 2025-01.
[2025-10-24T18:05:50.042886] [INFO ] [REMOTE    ] CQP: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T18:05:50.547736] [INFO ] [REMOTE    ] CQP: Fetching primary data for 2025-06.
[2025-10-24T18:05:50.610410] [INFO ] [REMOTE    ] CRBD: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T18:05:51.347625] [INFO ] [REMOTE    ] CRBD: Fetching primary data for 2025-02.
[2025-10-24T18:05:51.663567] [INFO ] [REMOTE    ] CQP: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T18:05:52.079361] [INFO ] [REMOTE    ] CRBD: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T18:05:52.147603] [INFO ] [REMOTE    ] CRBD: Fetching primary data for 2025-03.
[2025-10-24T18:05:52.823889] [INFO ] [REMOTE    ] CRBD: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T18:05:52.947727] [INFO ] [REMOTE    ] CRBD: Fetching primary data for 2025-04.
[2025-10-24T18:05:53.673827] [INFO ] [REMOTE    ] CRBD: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T18:05:53.747674] [INFO ] [REMOTE    ] CRBD: Fetching primary data for 2025-05.
[2025-10-24T18:05:54.398242] [INFO ] [REMOTE    ] CRBD: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T18:05:54.547757] [INFO ] [REMOTE    ] CRBG: Fetching primary data for 2025-01.
[2025-10-24T18:05:55.347719] [INFO ] [REMOTE    ] CQP: Fetching primary data for 2025-07.
[2025-10-24T18:05:56.147620] [INFO ] [REMOTE    ] CR: Fetching primary data for 2025-03.
[2025-10-24T18:05:56.302354] [INFO ] [REMOTE    ] CRBG: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T18:05:56.478924] [INFO ] [REMOTE    ] CQP: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T18:05:56.947685] [INFO ] [REMOTE    ] CRBD: Fetching primary data for 2025-06.
[2025-10-24T18:05:57.327919] [INFO ] [REMOTE    ] CR: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T18:05:57.698694] [INFO ] [REMOTE    ] CRBD: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T18:05:57.747694] [INFO ] [REMOTE    ] CRBD: Fetching primary data for 2025-07.
[2025-10-24T18:05:58.443896] [INFO ] [REMOTE    ] CRBD: Incremental fetch complete for 2025-07 (0.70 seconds).
[2025-10-24T18:05:58.547687] [INFO ] [REMOTE    ] CQP: Fetching primary data for 2025-08.
[2025-10-24T18:05:59.277230] [INFO ] [REMOTE    ] CQP: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T18:05:59.347692] [INFO ] [REMOTE    ] CRBG: Fetching primary data for 2025-02.
[2025-10-24T18:06:00.147633] [INFO ] [REMOTE    ] CR: Fetching primary data for 2025-04.
[2025-10-24T18:06:00.947702] [INFO ] [REMOTE    ] CRBD: Fetching primary data for 2025-08.
[2025-10-24T18:06:01.747702] [INFO ] [REMOTE    ] CQP: Fetching primary data for 2025-09.
[2025-10-24T18:06:01.904075] [INFO ] [REMOTE    ] CRBG: Incremental fetch complete for 2025-02 (2.56 seconds).
[2025-10-24T18:06:02.170746] [INFO ] [REMOTE    ] CR: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T18:06:02.547759] [INFO ] [REMOTE    ] CRBG: Fetching primary data for 2025-03.
[2025-10-24T18:06:02.707562] [INFO ] [REMOTE    ] CRBD: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T18:06:03.347717] [INFO ] [REMOTE    ] CR: Fetching primary data for 2025-05.
[2025-10-24T18:06:03.454792] [INFO ] [REMOTE    ] CQP: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T18:06:04.147680] [INFO ] [REMOTE    ] CQP: Fetching primary data for 2025-10.
[2025-10-24T18:06:04.829873] [INFO ] [REMOTE    ] CRBG: Incremental fetch complete for 2025-03 (2.28 seconds).
[2025-10-24T18:06:04.947692] [INFO ] [REMOTE    ] CRBD: Fetching primary data for 2025-09.
[2025-10-24T18:06:05.154676] [INFO ] [REMOTE    ] CQP: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T18:06:05.157807] [INFO ] [REMOTE    ] CQP: Full fetch complete (29587 records).
[2025-10-24T18:06:05.157898] [DEBUG] [VALIDATOR ] CQP: Validating primary data.
[2025-10-24T18:06:05.557378] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present.
[2025-10-24T18:06:05.557474] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed.
[2025-10-24T18:06:05.558055] [INFO ] [MAIN      ] CQP: Fetched primary data is valid.
[2025-10-24T18:06:05.558116] [DEBUG] [LOCAL     ] CQP: Saving primary data.
[2025-10-24T18:06:05.558474] [FATAL] [LOCAL     ] CQP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:06:05.558565] [FATAL] [MAIN      ] CQP: Failed to save primary data.
[2025-10-24T18:06:05.558610] [WARN ] [MAIN      ] CQP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:06:05.558669] [INFO ] [LOCAL     ] CQP: Starting deletion of primary data.
[2025-10-24T18:06:05.558742] [DEBUG] [LOCAL     ] CQP: No primary data file found to delete.
[2025-10-24T18:06:05.558778] [INFO ] [LOCAL     ] CQP: Starting deletion of derivative data.
[2025-10-24T18:06:05.558940] [DEBUG] [LOCAL     ] CQP: Deleted derivative data file.
[2025-10-24T18:06:05.559031] [INFO ] [MAIN      ] Update Progress: 525/2366 symbols completed. CQP took 29.8s. Estimated remaining: 3h 51m 36s. Rate: 7.9 symbols/min
[2025-10-24T18:06:05.674977] [INFO ] [REMOTE    ] CRBD: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T18:06:05.740393] [INFO ] [MAIN      ] CRC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:06:05.747685] [INFO ] [REMOTE    ] CRBD: Fetching primary data for 2025-10.
[2025-10-24T18:06:05.781384] [DEBUG] [LOCAL     ] CRC: Loaded 44391 existing records from primary storage.
[2025-10-24T18:06:05.781721] [INFO ] [MAIN      ] CRC: Loaded 44391 existing records.
[2025-10-24T18:06:05.957450] [WARN ] [MAIN      ] CRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:06:05.957801] [INFO ] [MAIN      ] CRC: Wiping existing primary data before full refresh.
[2025-10-24T18:06:05.957959] [INFO ] [LOCAL     ] CRC: Starting deletion of primary data.
[2025-10-24T18:06:05.958323] [DEBUG] [LOCAL     ] CRC: Deleted primary data file.
[2025-10-24T18:06:05.958452] [INFO ] [MAIN      ] CRC: Starting full primary refresh.
[2025-10-24T18:06:06.059370] [INFO ] [REMOTE    ] CR: Incremental fetch complete for 2025-05 (2.71 seconds).
[2025-10-24T18:06:06.352612] [INFO ] [REMOTE    ] CRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:06:06.538697] [INFO ] [REMOTE    ] CRBD: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T18:06:06.541312] [INFO ] [REMOTE    ] CRBD: Full fetch complete (12839 records).
[2025-10-24T18:06:06.541448] [DEBUG] [VALIDATOR ] CRBD: Validating primary data.
[2025-10-24T18:06:06.542043] [FATAL] [VALIDATOR ] CRBD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:06:06.542167] [FATAL] [MAIN      ] CRBD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:06:06.542221] [WARN ] [MAIN      ] CRBD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:06:06.542306] [INFO ] [LOCAL     ] CRBD: Starting deletion of primary data.
[2025-10-24T18:06:06.542401] [DEBUG] [LOCAL     ] CRBD: No primary data file found to delete.
[2025-10-24T18:06:06.542449] [INFO ] [LOCAL     ] CRBD: Starting deletion of derivative data.
[2025-10-24T18:06:06.542630] [DEBUG] [LOCAL     ] CRBD: Deleted derivative data file.
[2025-10-24T18:06:06.542768] [INFO ] [MAIN      ] Update Progress: 526/2366 symbols completed. CRBD took 19.1s. Estimated remaining: 3h 51m 5s. Rate: 8.0 symbols/min
[2025-10-24T18:06:06.548213] [INFO ] [REMOTE    ] CR: Fetching primary data for 2025-06.
[2025-10-24T18:06:06.721598] [INFO ] [MAIN      ] CRCL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:06:06.721809] [DEBUG] [LOCAL     ] CRCL: No existing data file found in primary storage.
[2025-10-24T18:06:06.721851] [WARN ] [MAIN      ] CRCL: No existing data found, performing full refresh instead.
[2025-10-24T18:06:06.721957] [INFO ] [MAIN      ] CRCL: Wiping existing primary data before full refresh.
[2025-10-24T18:06:06.721998] [INFO ] [LOCAL     ] CRCL: Starting deletion of primary data.
[2025-10-24T18:06:06.722039] [DEBUG] [LOCAL     ] CRCL: No primary data file found to delete.
[2025-10-24T18:06:06.722070] [INFO ] [MAIN      ] CRCL: Starting full primary refresh.
[2025-10-24T18:06:07.071944] [INFO ] [REMOTE    ] CRCL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:06:07.347616] [INFO ] [REMOTE    ] CRBG: Fetching primary data for 2025-04.
[2025-10-24T18:06:07.723611] [INFO ] [REMOTE    ] CR: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T18:06:08.147738] [INFO ] [REMOTE    ] CRC: Fetching primary data for 2025-01.
[2025-10-24T18:06:08.947693] [INFO ] [REMOTE    ] CR: Fetching primary data for 2025-07.
[2025-10-24T18:06:09.077143] [INFO ] [REMOTE    ] CRBG: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T18:06:09.605440] [INFO ] [REMOTE    ] CRC: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T18:06:09.699534] [INFO ] [REMOTE    ] CR: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T18:06:09.747670] [INFO ] [REMOTE    ] CR: Fetching primary data for 2025-08.
[2025-10-24T18:06:10.547729] [INFO ] [REMOTE    ] CRC: Fetching primary data for 2025-02.
[2025-10-24T18:06:10.600109] [INFO ] [REMOTE    ] CR: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T18:06:11.347623] [INFO ] [REMOTE    ] CRCL: Fetching primary data for 2025-01.
[2025-10-24T18:06:11.536997] [DEBUG] [REMOTE    ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T18:06:11.537327] [WARN ] [REMOTE    ] CRCL: No data returned for month 2025-01
[2025-10-24T18:06:11.537434] [FATAL] [REMOTE    ] CRCL: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:06:11.537503] [FATAL] [MAIN      ] CRCL: Failed to fetch primary data.
[2025-10-24T18:06:11.537567] [WARN ] [MAIN      ] CRCL: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:06:11.537637] [INFO ] [LOCAL     ] CRCL: Starting deletion of primary data.
[2025-10-24T18:06:11.537740] [DEBUG] [LOCAL     ] CRCL: No primary data file found to delete.
[2025-10-24T18:06:11.537779] [INFO ] [LOCAL     ] CRCL: Starting deletion of derivative data.
[2025-10-24T18:06:11.537820] [DEBUG] [LOCAL     ] CRCL: No derivative data file found to delete.
[2025-10-24T18:06:11.537867] [INFO ] [MAIN      ] Update Progress: 527/2366 symbols completed. CRCL took 5.0s. Estimated remaining: 3h 50m 49s. Rate: 8.0 symbols/min
[2025-10-24T18:06:11.722688] [INFO ] [MAIN      ] CRGY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:06:11.772802] [DEBUG] [LOCAL     ] CRGY: Loaded 52885 existing records from primary storage.
[2025-10-24T18:06:11.773129] [INFO ] [MAIN      ] CRGY: Loaded 52885 existing records.
[2025-10-24T18:06:11.965325] [WARN ] [MAIN      ] CRGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:06:11.972915] [INFO ] [MAIN      ] CRGY: Wiping existing primary data before full refresh.
[2025-10-24T18:06:11.985131] [INFO ] [LOCAL     ] CRGY: Starting deletion of primary data.
[2025-10-24T18:06:11.986604] [INFO ] [REMOTE    ] CRC: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T18:06:11.986717] [DEBUG] [LOCAL     ] CRGY: Deleted primary data file.
[2025-10-24T18:06:11.986927] [INFO ] [MAIN      ] CRGY: Starting full primary refresh.
[2025-10-24T18:06:12.148723] [INFO ] [REMOTE    ] CRBG: Fetching primary data for 2025-05.
[2025-10-24T18:06:12.358132] [INFO ] [REMOTE    ] CRGY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:06:12.947707] [INFO ] [REMOTE    ] CR: Fetching primary data for 2025-09.
[2025-10-24T18:06:13.747632] [INFO ] [REMOTE    ] CRC: Fetching primary data for 2025-03.
[2025-10-24T18:06:13.937553] [INFO ] [REMOTE    ] CRBG: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T18:06:14.223536] [INFO ] [REMOTE    ] CR: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T18:06:14.547721] [INFO ] [REMOTE    ] CR: Fetching primary data for 2025-10.
[2025-10-24T18:06:15.228364] [INFO ] [REMOTE    ] CRC: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T18:06:15.347610] [INFO ] [REMOTE    ] CRBG: Fetching primary data for 2025-06.
[2025-10-24T18:06:15.560493] [INFO ] [REMOTE    ] CR: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T18:06:15.564998] [INFO ] [REMOTE    ] CR: Full fetch complete (34779 records).
[2025-10-24T18:06:15.565079] [DEBUG] [VALIDATOR ] CR: Validating primary data.
[2025-10-24T18:06:15.951532] [DEBUG] [VALIDATOR ] CR: All expected trading days are present.
[2025-10-24T18:06:15.951636] [DEBUG] [VALIDATOR ] CR: Primary data validation passed.
[2025-10-24T18:06:15.952455] [INFO ] [MAIN      ] CR: Fetched primary data is valid.
[2025-10-24T18:06:15.952507] [DEBUG] [LOCAL     ] CR: Saving primary data.
[2025-10-24T18:06:15.953043] [FATAL] [LOCAL     ] CR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:06:15.953135] [FATAL] [MAIN      ] CR: Failed to save primary data.
[2025-10-24T18:06:15.953177] [WARN ] [MAIN      ] CR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:06:15.953211] [INFO ] [LOCAL     ] CR: Starting deletion of primary data.
[2025-10-24T18:06:15.953266] [DEBUG] [LOCAL     ] CR: No primary data file found to delete.
[2025-10-24T18:06:15.953302] [INFO ] [LOCAL     ] CR: Starting deletion of derivative data.
[2025-10-24T18:06:15.953492] [DEBUG] [LOCAL     ] CR: Deleted derivative data file.
[2025-10-24T18:06:15.953582] [INFO ] [MAIN      ] Update Progress: 528/2366 symbols completed. CR took 31.1s. Estimated remaining: 3h 50m 30s. Rate: 8.0 symbols/min
[2025-10-24T18:06:16.127103] [INFO ] [MAIN      ] CRH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:06:16.147764] [INFO ] [REMOTE    ] CRC: Fetching primary data for 2025-04.
[2025-10-24T18:06:16.190475] [DEBUG] [LOCAL     ] CRH: Loaded 53784 existing records from primary storage.
[2025-10-24T18:06:16.190958] [INFO ] [MAIN      ] CRH: Loaded 53784 existing records.
[2025-10-24T18:06:16.373755] [WARN ] [MAIN      ] CRH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:06:16.374032] [INFO ] [MAIN      ] CRH: Wiping existing primary data before full refresh.
[2025-10-24T18:06:16.374083] [INFO ] [LOCAL     ] CRH: Starting deletion of primary data.
[2025-10-24T18:06:16.374360] [DEBUG] [LOCAL     ] CRH: Deleted primary data file.
[2025-10-24T18:06:16.374417] [INFO ] [MAIN      ] CRH: Starting full primary refresh.
[2025-10-24T18:06:16.738368] [INFO ] [REMOTE    ] CRH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:06:16.777533] [INFO ] [REMOTE    ] CRBG: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T18:06:16.947676] [INFO ] [REMOTE    ] CRBG: Fetching primary data for 2025-07.
[2025-10-24T18:06:17.716734] [INFO ] [REMOTE    ] CRC: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T18:06:17.747629] [INFO ] [REMOTE    ] CRC: Fetching primary data for 2025-05.
[2025-10-24T18:06:18.547704] [INFO ] [REMOTE    ] CRH: Fetching primary data for 2025-01.
[2025-10-24T18:06:18.623317] [INFO ] [REMOTE    ] CRBG: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T18:06:18.933085] [INFO ] [REMOTE    ] CRC: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T18:06:19.347735] [INFO ] [REMOTE    ] CRC: Fetching primary data for 2025-06.
[2025-10-24T18:06:20.154861] [INFO ] [REMOTE    ] CRGY: Fetching primary data for 2025-01.
[2025-10-24T18:06:20.175534] [INFO ] [REMOTE    ] CRH: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T18:06:20.947735] [INFO ] [REMOTE    ] CRBG: Fetching primary data for 2025-08.
[2025-10-24T18:06:21.042233] [INFO ] [REMOTE    ] CRC: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T18:06:21.747713] [INFO ] [REMOTE    ] CRH: Fetching primary data for 2025-02.
[2025-10-24T18:06:21.983139] [INFO ] [REMOTE    ] CRGY: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T18:06:22.547727] [INFO ] [REMOTE    ] CRC: Fetching primary data for 2025-07.
[2025-10-24T18:06:22.646316] [INFO ] [REMOTE    ] CRBG: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T18:06:23.140029] [INFO ] [REMOTE    ] CRH: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T18:06:23.347731] [INFO ] [REMOTE    ] CRBG: Fetching primary data for 2025-09.
[2025-10-24T18:06:23.754393] [INFO ] [REMOTE    ] CRC: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T18:06:24.147713] [INFO ] [REMOTE    ] CRC: Fetching primary data for 2025-08.
[2025-10-24T18:06:24.947623] [INFO ] [REMOTE    ] CRH: Fetching primary data for 2025-03.
[2025-10-24T18:06:24.983481] [INFO ] [REMOTE    ] CRBG: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T18:06:25.641698] [INFO ] [REMOTE    ] CRC: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T18:06:25.747676] [INFO ] [REMOTE    ] CRGY: Fetching primary data for 2025-02.
[2025-10-24T18:06:26.547619] [INFO ] [REMOTE    ] CRC: Fetching primary data for 2025-09.
[2025-10-24T18:06:26.824756] [INFO ] [REMOTE    ] CRH: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T18:06:27.233276] [INFO ] [REMOTE    ] CRGY: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T18:06:27.347685] [INFO ] [REMOTE    ] CRGY: Fetching primary data for 2025-03.
[2025-10-24T18:06:27.691947] [INFO ] [REMOTE    ] CRC: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T18:06:28.147717] [INFO ] [REMOTE    ] CRH: Fetching primary data for 2025-04.
[2025-10-24T18:06:28.784827] [INFO ] [REMOTE    ] CRGY: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T18:06:28.947639] [INFO ] [REMOTE    ] CRC: Fetching primary data for 2025-10.
[2025-10-24T18:06:29.747632] [INFO ] [REMOTE    ] CRGY: Fetching primary data for 2025-04.
[2025-10-24T18:06:29.905848] [INFO ] [REMOTE    ] CRH: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T18:06:30.446244] [INFO ] [REMOTE    ] CRC: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T18:06:30.454386] [INFO ] [REMOTE    ] CRC: Full fetch complete (62999 records).
[2025-10-24T18:06:30.454527] [DEBUG] [VALIDATOR ] CRC: Validating primary data.
[2025-10-24T18:06:30.552925] [INFO ] [REMOTE    ] CRH: Fetching primary data for 2025-05.
[2025-10-24T18:06:30.833036] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present.
[2025-10-24T18:06:30.833116] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed.
[2025-10-24T18:06:30.833870] [INFO ] [MAIN      ] CRC: Fetched primary data is valid.
[2025-10-24T18:06:30.833932] [DEBUG] [LOCAL     ] CRC: Saving primary data.
[2025-10-24T18:06:30.834446] [FATAL] [LOCAL     ] CRC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:06:30.834531] [FATAL] [MAIN      ] CRC: Failed to save primary data.
[2025-10-24T18:06:30.834573] [WARN ] [MAIN      ] CRC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:06:30.834607] [INFO ] [LOCAL     ] CRC: Starting deletion of primary data.
[2025-10-24T18:06:30.834683] [DEBUG] [LOCAL     ] CRC: No primary data file found to delete.
[2025-10-24T18:06:30.834739] [INFO ] [LOCAL     ] CRC: Starting deletion of derivative data.
[2025-10-24T18:06:30.834929] [DEBUG] [LOCAL     ] CRC: Deleted derivative data file.
[2025-10-24T18:06:30.835233] [INFO ] [MAIN      ] Update Progress: 529/2366 symbols completed. CRC took 25.3s. Estimated remaining: 3h 50m 48s. Rate: 8.0 symbols/min
[2025-10-24T18:06:31.001134] [INFO ] [MAIN      ] CRI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:06:31.045781] [DEBUG] [LOCAL     ] CRI: Loaded 49854 existing records from primary storage.
[2025-10-24T18:06:31.046108] [INFO ] [MAIN      ] CRI: Loaded 49854 existing records.
[2025-10-24T18:06:31.224452] [WARN ] [MAIN      ] CRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:06:31.224694] [INFO ] [MAIN      ] CRI: Wiping existing primary data before full refresh.
[2025-10-24T18:06:31.224845] [INFO ] [LOCAL     ] CRI: Starting deletion of primary data.
[2025-10-24T18:06:31.225616] [DEBUG] [LOCAL     ] CRI: Deleted primary data file.
[2025-10-24T18:06:31.225718] [INFO ] [MAIN      ] CRI: Starting full primary refresh.
[2025-10-24T18:06:31.365510] [INFO ] [REMOTE    ] CRBG: Fetching primary data for 2025-10.
[2025-10-24T18:06:31.584519] [INFO ] [REMOTE    ] CRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:06:31.613754] [INFO ] [REMOTE    ] CRGY: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T18:06:32.147701] [INFO ] [REMOTE    ] CRGY: Fetching primary data for 2025-05.
[2025-10-24T18:06:32.663225] [INFO ] [REMOTE    ] CRH: Incremental fetch complete for 2025-05 (2.11 seconds).
[2025-10-24T18:06:32.947679] [INFO ] [REMOTE    ] CRI: Fetching primary data for 2025-01.
[2025-10-24T18:06:33.375626] [INFO ] [REMOTE    ] CRBG: Incremental fetch complete for 2025-10 (2.01 seconds).
[2025-10-24T18:06:33.384833] [INFO ] [REMOTE    ] CRBG: Full fetch complete (75661 records).
[2025-10-24T18:06:33.384971] [DEBUG] [VALIDATOR ] CRBG: Validating primary data.
[2025-10-24T18:06:33.385769] [FATAL] [VALIDATOR ] CRBG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:06:33.385865] [FATAL] [MAIN      ] CRBG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:06:33.385909] [WARN ] [MAIN      ] CRBG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:06:33.385948] [INFO ] [LOCAL     ] CRBG: Starting deletion of primary data.
[2025-10-24T18:06:33.386003] [DEBUG] [LOCAL     ] CRBG: No primary data file found to delete.
[2025-10-24T18:06:33.386037] [INFO ] [LOCAL     ] CRBG: Starting deletion of derivative data.
[2025-10-24T18:06:33.386195] [DEBUG] [LOCAL     ] CRBG: Deleted derivative data file.
[2025-10-24T18:06:33.386484] [INFO ] [MAIN      ] Update Progress: 530/2366 symbols completed. CRBG took 45.7s. Estimated remaining: 3h 50m 24s. Rate: 8.0 symbols/min
[2025-10-24T18:06:33.553961] [INFO ] [MAIN      ] CRK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:06:33.604498] [DEBUG] [LOCAL     ] CRK: Loaded 52603 existing records from primary storage.
[2025-10-24T18:06:33.604859] [INFO ] [MAIN      ] CRK: Loaded 52603 existing records.
[2025-10-24T18:06:33.781782] [WARN ] [MAIN      ] CRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:06:33.752700] [INFO ] [REMOTE    ] CRH: Fetching primary data for 2025-06.
[2025-10-24T18:06:33.783175] [INFO ] [MAIN      ] CRK: Wiping existing primary data before full refresh.
[2025-10-24T18:06:33.783264] [INFO ] [LOCAL     ] CRK: Starting deletion of primary data.
[2025-10-24T18:06:33.784190] [DEBUG] [LOCAL     ] CRK: Deleted primary data file.
[2025-10-24T18:06:33.784252] [INFO ] [MAIN      ] CRK: Starting full primary refresh.
[2025-10-24T18:06:34.094864] [INFO ] [REMOTE    ] CRGY: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T18:06:34.181810] [INFO ] [REMOTE    ] CRK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:06:34.547692] [INFO ] [REMOTE    ] CRGY: Fetching primary data for 2025-06.
[2025-10-24T18:06:34.601540] [INFO ] [REMOTE    ] CRI: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T18:06:35.347719] [INFO ] [REMOTE    ] CRI: Fetching primary data for 2025-02.
[2025-10-24T18:06:35.511598] [INFO ] [REMOTE    ] CRH: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T18:06:35.724317] [INFO ] [REMOTE    ] CRGY: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T18:06:36.147669] [INFO ] [REMOTE    ] CRGY: Fetching primary data for 2025-07.
[2025-10-24T18:06:36.906070] [INFO ] [REMOTE    ] CRI: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T18:06:36.947638] [INFO ] [REMOTE    ] CRK: Fetching primary data for 2025-01.
[2025-10-24T18:06:37.747626] [INFO ] [REMOTE    ] CRH: Fetching primary data for 2025-07.
[2025-10-24T18:06:37.981091] [INFO ] [REMOTE    ] CRGY: Incremental fetch complete for 2025-07 (1.83 seconds).
[2025-10-24T18:06:38.547734] [INFO ] [REMOTE    ] CRI: Fetching primary data for 2025-03.
[2025-10-24T18:06:39.136761] [INFO ] [REMOTE    ] CRK: Incremental fetch complete for 2025-01 (2.19 seconds).
[2025-10-24T18:06:39.347689] [INFO ] [REMOTE    ] CRK: Fetching primary data for 2025-02.
[2025-10-24T18:06:39.760168] [INFO ] [REMOTE    ] CRH: Incremental fetch complete for 2025-07 (2.01 seconds).
[2025-10-24T18:06:39.818973] [INFO ] [REMOTE    ] CRI: Incremental fetch complete for 2025-03 (1.27 seconds).
[2025-10-24T18:06:40.147669] [INFO ] [REMOTE    ] CRGY: Fetching primary data for 2025-08.
[2025-10-24T18:06:40.947714] [INFO ] [REMOTE    ] CRH: Fetching primary data for 2025-08.
[2025-10-24T18:06:41.039262] [INFO ] [REMOTE    ] CRK: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T18:06:41.588054] [INFO ] [REMOTE    ] CRGY: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T18:06:41.747626] [INFO ] [REMOTE    ] CRK: Fetching primary data for 2025-03.
[2025-10-24T18:06:42.547615] [INFO ] [REMOTE    ] CRI: Fetching primary data for 2025-04.
[2025-10-24T18:06:42.781383] [INFO ] [REMOTE    ] CRH: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T18:06:43.081538] [INFO ] [REMOTE    ] CRK: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T18:06:43.347636] [INFO ] [REMOTE    ] CRK: Fetching primary data for 2025-04.
[2025-10-24T18:06:44.147702] [INFO ] [REMOTE    ] CRH: Fetching primary data for 2025-09.
[2025-10-24T18:06:44.393754] [INFO ] [REMOTE    ] CRI: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T18:06:44.947729] [INFO ] [REMOTE    ] CRI: Fetching primary data for 2025-05.
[2025-10-24T18:06:45.204634] [INFO ] [REMOTE    ] CRK: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T18:06:45.618821] [INFO ] [REMOTE    ] CRH: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T18:06:45.747706] [INFO ] [REMOTE    ] CRH: Fetching primary data for 2025-10.
[2025-10-24T18:06:46.545466] [INFO ] [REMOTE    ] CRI: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T18:06:46.549346] [INFO ] [REMOTE    ] CRGY: Fetching primary data for 2025-09.
[2025-10-24T18:06:47.347690] [INFO ] [REMOTE    ] CRI: Fetching primary data for 2025-06.
[2025-10-24T18:06:47.532176] [INFO ] [REMOTE    ] CRH: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T18:06:47.543193] [INFO ] [REMOTE    ] CRH: Full fetch complete (77512 records).
[2025-10-24T18:06:47.543339] [DEBUG] [VALIDATOR ] CRH: Validating primary data.
[2025-10-24T18:06:47.939567] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present.
[2025-10-24T18:06:47.939705] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed.
[2025-10-24T18:06:47.940572] [INFO ] [MAIN      ] CRH: Fetched primary data is valid.
[2025-10-24T18:06:47.940832] [DEBUG] [LOCAL     ] CRH: Saving primary data.
[2025-10-24T18:06:47.941455] [FATAL] [LOCAL     ] CRH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:06:47.941539] [FATAL] [MAIN      ] CRH: Failed to save primary data.
[2025-10-24T18:06:47.941582] [WARN ] [MAIN      ] CRH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:06:47.941666] [INFO ] [LOCAL     ] CRH: Starting deletion of primary data.
[2025-10-24T18:06:47.941744] [DEBUG] [LOCAL     ] CRH: No primary data file found to delete.
[2025-10-24T18:06:47.941781] [INFO ] [LOCAL     ] CRH: Starting deletion of derivative data.
[2025-10-24T18:06:47.941943] [DEBUG] [LOCAL     ] CRH: Deleted derivative data file.
[2025-10-24T18:06:47.942395] [INFO ] [MAIN      ] Update Progress: 531/2366 symbols completed. CRH took 32.0s. Estimated remaining: 3h 50m 40s. Rate: 8.0 symbols/min
[2025-10-24T18:06:48.118523] [INFO ] [MAIN      ] CRL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:06:48.148185] [INFO ] [REMOTE    ] CRK: Fetching primary data for 2025-05.
[2025-10-24T18:06:48.150355] [INFO ] [REMOTE    ] CRGY: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T18:06:48.202122] [DEBUG] [LOCAL     ] CRL: Loaded 42952 existing records from primary storage.
[2025-10-24T18:06:48.202403] [INFO ] [MAIN      ] CRL: Loaded 42952 existing records.
[2025-10-24T18:06:48.379592] [WARN ] [MAIN      ] CRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:06:48.379817] [INFO ] [MAIN      ] CRL: Wiping existing primary data before full refresh.
[2025-10-24T18:06:48.379864] [INFO ] [LOCAL     ] CRL: Starting deletion of primary data.
[2025-10-24T18:06:48.380552] [DEBUG] [LOCAL     ] CRL: Deleted primary data file.
[2025-10-24T18:06:48.380609] [INFO ] [MAIN      ] CRL: Starting full primary refresh.
[2025-10-24T18:06:48.753707] [INFO ] [REMOTE    ] CRL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:06:48.793299] [INFO ] [REMOTE    ] CRI: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T18:06:48.947682] [INFO ] [REMOTE    ] CRL: Fetching primary data for 2025-01.
[2025-10-24T18:06:49.436218] [INFO ] [REMOTE    ] CRK: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T18:06:49.747704] [INFO ] [REMOTE    ] CRK: Fetching primary data for 2025-06.
[2025-10-24T18:06:50.547657] [INFO ] [REMOTE    ] CRGY: Fetching primary data for 2025-10.
[2025-10-24T18:06:50.663892] [INFO ] [REMOTE    ] CRL: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T18:06:51.278174] [INFO ] [REMOTE    ] CRK: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T18:06:51.347632] [INFO ] [REMOTE    ] CRK: Fetching primary data for 2025-07.
[2025-10-24T18:06:52.147630] [INFO ] [REMOTE    ] CRI: Fetching primary data for 2025-07.
[2025-10-24T18:06:52.340171] [INFO ] [REMOTE    ] CRGY: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T18:06:52.350589] [INFO ] [REMOTE    ] CRGY: Full fetch complete (76165 records).
[2025-10-24T18:06:52.350869] [DEBUG] [VALIDATOR ] CRGY: Validating primary data.
[2025-10-24T18:06:52.764742] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present.
[2025-10-24T18:06:52.764863] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed.
[2025-10-24T18:06:52.766149] [INFO ] [MAIN      ] CRGY: Fetched primary data is valid.
[2025-10-24T18:06:52.766220] [DEBUG] [LOCAL     ] CRGY: Saving primary data.
[2025-10-24T18:06:52.767238] [FATAL] [LOCAL     ] CRGY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:06:52.767341] [FATAL] [MAIN      ] CRGY: Failed to save primary data.
[2025-10-24T18:06:52.767384] [WARN ] [MAIN      ] CRGY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:06:52.767431] [INFO ] [LOCAL     ] CRGY: Starting deletion of primary data.
[2025-10-24T18:06:52.767498] [DEBUG] [LOCAL     ] CRGY: No primary data file found to delete.
[2025-10-24T18:06:52.767538] [INFO ] [LOCAL     ] CRGY: Starting deletion of derivative data.
[2025-10-24T18:06:52.767749] [DEBUG] [LOCAL     ] CRGY: Deleted derivative data file.
[2025-10-24T18:06:52.768674] [INFO ] [MAIN      ] Update Progress: 532/2366 symbols completed. CRGY took 41.2s. Estimated remaining: 3h 50m 24s. Rate: 8.0 symbols/min
[2025-10-24T18:06:52.948413] [INFO ] [REMOTE    ] CRL: Fetching primary data for 2025-02.
[2025-10-24T18:06:52.948294] [INFO ] [MAIN      ] CRM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:06:53.006943] [DEBUG] [LOCAL     ] CRM: Loaded 54160 existing records from primary storage.
[2025-10-24T18:06:53.007490] [INFO ] [MAIN      ] CRM: Loaded 54160 existing records.
[2025-10-24T18:06:53.196750] [WARN ] [MAIN      ] CRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:06:53.197498] [INFO ] [MAIN      ] CRM: Wiping existing primary data before full refresh.
[2025-10-24T18:06:53.197638] [INFO ] [LOCAL     ] CRM: Starting deletion of primary data.
[2025-10-24T18:06:53.198327] [DEBUG] [LOCAL     ] CRM: Deleted primary data file.
[2025-10-24T18:06:53.198498] [INFO ] [MAIN      ] CRM: Starting full primary refresh.
[2025-10-24T18:06:53.342010] [INFO ] [REMOTE    ] CRK: Incremental fetch complete for 2025-07 (1.99 seconds).
[2025-10-24T18:06:53.617086] [INFO ] [REMOTE    ] CRM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:06:53.728893] [INFO ] [REMOTE    ] CRI: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T18:06:53.747730] [INFO ] [REMOTE    ] CRM: Fetching primary data for 2025-01.
[2025-10-24T18:06:54.547708] [INFO ] [REMOTE    ] CRK: Fetching primary data for 2025-08.
[2025-10-24T18:06:54.586978] [INFO ] [REMOTE    ] CRL: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T18:06:55.347738] [INFO ] [REMOTE    ] CRL: Fetching primary data for 2025-03.
[2025-10-24T18:06:55.966774] [INFO ] [REMOTE    ] CRM: Incremental fetch complete for 2025-01 (2.22 seconds).
[2025-10-24T18:06:56.147677] [INFO ] [REMOTE    ] CRM: Fetching primary data for 2025-02.
[2025-10-24T18:06:56.261932] [INFO ] [REMOTE    ] CRK: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T18:06:56.947718] [INFO ] [REMOTE    ] CRK: Fetching primary data for 2025-09.
[2025-10-24T18:06:57.070371] [INFO ] [REMOTE    ] CRL: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T18:06:57.747676] [INFO ] [REMOTE    ] CRI: Fetching primary data for 2025-08.
[2025-10-24T18:06:58.129630] [INFO ] [REMOTE    ] CRM: Incremental fetch complete for 2025-02 (1.98 seconds).
[2025-10-24T18:06:58.537099] [INFO ] [REMOTE    ] CRK: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T18:06:58.547858] [INFO ] [REMOTE    ] CRM: Fetching primary data for 2025-03.
[2025-10-24T18:06:59.347637] [INFO ] [REMOTE    ] CRK: Fetching primary data for 2025-10.
[2025-10-24T18:06:59.766800] [INFO ] [REMOTE    ] CRI: Incremental fetch complete for 2025-08 (2.02 seconds).
[2025-10-24T18:07:00.147717] [INFO ] [REMOTE    ] CRL: Fetching primary data for 2025-04.
[2025-10-24T18:07:00.947740] [INFO ] [REMOTE    ] CRI: Fetching primary data for 2025-09.
[2025-10-24T18:07:01.911099] [INFO ] [REMOTE    ] CRM: Incremental fetch complete for 2025-03 (3.36 seconds).
[2025-10-24T18:07:01.922279] [INFO ] [REMOTE    ] CRM: Fetching primary data for 2025-04.
[2025-10-24T18:07:02.037201] [INFO ] [REMOTE    ] CRK: Incremental fetch complete for 2025-10 (2.69 seconds).
[2025-10-24T18:07:02.047123] [INFO ] [REMOTE    ] CRK: Full fetch complete (75798 records).
[2025-10-24T18:07:02.047272] [DEBUG] [VALIDATOR ] CRK: Validating primary data.
[2025-10-24T18:07:02.447225] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present.
[2025-10-24T18:07:02.447309] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed.
[2025-10-24T18:07:02.448160] [INFO ] [MAIN      ] CRK: Fetched primary data is valid.
[2025-10-24T18:07:02.448221] [DEBUG] [LOCAL     ] CRK: Saving primary data.
[2025-10-24T18:07:02.448789] [FATAL] [LOCAL     ] CRK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:07:02.448881] [FATAL] [MAIN      ] CRK: Failed to save primary data.
[2025-10-24T18:07:02.448923] [WARN ] [MAIN      ] CRK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:07:02.448957] [INFO ] [LOCAL     ] CRK: Starting deletion of primary data.
[2025-10-24T18:07:02.449009] [DEBUG] [LOCAL     ] CRK: No primary data file found to delete.
[2025-10-24T18:07:02.449044] [INFO ] [LOCAL     ] CRK: Starting deletion of derivative data.
[2025-10-24T18:07:02.449175] [DEBUG] [LOCAL     ] CRK: Deleted derivative data file.
[2025-10-24T18:07:02.449514] [INFO ] [MAIN      ] Update Progress: 533/2366 symbols completed. CRK took 29.1s. Estimated remaining: 3h 50m 23s. Rate: 8.0 symbols/min
[2025-10-24T18:07:02.623786] [INFO ] [MAIN      ] CRS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:07:02.623907] [DEBUG] [LOCAL     ] CRS: No existing data file found in primary storage.
[2025-10-24T18:07:02.623946] [WARN ] [MAIN      ] CRS: No existing data found, performing full refresh instead.
[2025-10-24T18:07:02.624030] [INFO ] [MAIN      ] CRS: Wiping existing primary data before full refresh.
[2025-10-24T18:07:02.624068] [INFO ] [LOCAL     ] CRS: Starting deletion of primary data.
[2025-10-24T18:07:02.624110] [DEBUG] [LOCAL     ] CRS: No primary data file found to delete.
[2025-10-24T18:07:02.624144] [INFO ] [MAIN      ] CRS: Starting full primary refresh.
[2025-10-24T18:07:02.985108] [INFO ] [REMOTE    ] CRS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:07:02.985549] [INFO ] [REMOTE    ] CRS: Fetching primary data for 2025-01.
[2025-10-24T18:07:03.015458] [INFO ] [REMOTE    ] CRI: Incremental fetch complete for 2025-09 (2.07 seconds).
[2025-10-24T18:07:03.053456] [INFO ] [REMOTE    ] CRL: Incremental fetch complete for 2025-04 (2.91 seconds).
[2025-10-24T18:07:03.347708] [INFO ] [REMOTE    ] CRI: Fetching primary data for 2025-10.
[2025-10-24T18:07:04.147726] [INFO ] [REMOTE    ] CRL: Fetching primary data for 2025-05.
[2025-10-24T18:07:04.337219] [INFO ] [REMOTE    ] CRM: Incremental fetch complete for 2025-04 (2.41 seconds).
[2025-10-24T18:07:04.947706] [INFO ] [REMOTE    ] CRM: Fetching primary data for 2025-05.
[2025-10-24T18:07:05.538156] [INFO ] [REMOTE    ] CRS: Incremental fetch complete for 2025-01 (2.55 seconds).
[2025-10-24T18:07:05.701770] [INFO ] [REMOTE    ] CRI: Incremental fetch complete for 2025-10 (2.35 seconds).
[2025-10-24T18:07:05.710955] [INFO ] [REMOTE    ] CRI: Full fetch complete (71031 records).
[2025-10-24T18:07:05.711108] [DEBUG] [VALIDATOR ] CRI: Validating primary data.
[2025-10-24T18:07:05.754547] [INFO ] [REMOTE    ] CRS: Fetching primary data for 2025-02.
[2025-10-24T18:07:06.142866] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present.
[2025-10-24T18:07:06.143065] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed.
[2025-10-24T18:07:06.143960] [INFO ] [MAIN      ] CRI: Fetched primary data is valid.
[2025-10-24T18:07:06.144042] [DEBUG] [LOCAL     ] CRI: Saving primary data.
[2025-10-24T18:07:06.144825] [FATAL] [LOCAL     ] CRI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:07:06.167287] [FATAL] [MAIN      ] CRI: Failed to save primary data.
[2025-10-24T18:07:06.170164] [WARN ] [MAIN      ] CRI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:07:06.170264] [INFO ] [LOCAL     ] CRI: Starting deletion of primary data.
[2025-10-24T18:07:06.170998] [DEBUG] [LOCAL     ] CRI: No primary data file found to delete.
[2025-10-24T18:07:06.172166] [INFO ] [REMOTE    ] CRL: Incremental fetch complete for 2025-05 (2.02 seconds).
[2025-10-24T18:07:06.172252] [INFO ] [LOCAL     ] CRI: Starting deletion of derivative data.
[2025-10-24T18:07:06.182247] [DEBUG] [LOCAL     ] CRI: Deleted derivative data file.
[2025-10-24T18:07:06.182731] [INFO ] [MAIN      ] Update Progress: 534/2366 symbols completed. CRI took 35.3s. Estimated remaining: 3h 50m 3s. Rate: 8.0 symbols/min
[2025-10-24T18:07:06.351324] [INFO ] [MAIN      ] CRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:07:06.358034] [DEBUG] [LOCAL     ] CRT: Loaded 4832 existing records from primary storage.
[2025-10-24T18:07:06.358234] [INFO ] [MAIN      ] CRT: Loaded 4832 existing records.
[2025-10-24T18:07:06.534490] [WARN ] [MAIN      ] CRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:07:06.534747] [INFO ] [MAIN      ] CRT: Wiping existing primary data before full refresh.
[2025-10-24T18:07:06.534800] [INFO ] [LOCAL     ] CRT: Starting deletion of primary data.
[2025-10-24T18:07:06.534938] [DEBUG] [LOCAL     ] CRT: Deleted primary data file.
[2025-10-24T18:07:06.534978] [INFO ] [MAIN      ] CRT: Starting full primary refresh.
[2025-10-24T18:07:06.552700] [INFO ] [REMOTE    ] CRL: Fetching primary data for 2025-06.
[2025-10-24T18:07:06.919833] [INFO ] [REMOTE    ] CRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:07:07.311156] [INFO ] [REMOTE    ] CRS: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T18:07:07.349509] [INFO ] [REMOTE    ] CRS: Fetching primary data for 2025-03.
[2025-10-24T18:07:07.352564] [INFO ] [REMOTE    ] CRM: Incremental fetch complete for 2025-05 (2.40 seconds).
[2025-10-24T18:07:07.770208] [INFO ] [REMOTE    ] CRL: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T18:07:08.147625] [INFO ] [REMOTE    ] CRT: Fetching primary data for 2025-01.
[2025-10-24T18:07:08.934588] [INFO ] [REMOTE    ] CRT: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T18:07:08.947602] [INFO ] [REMOTE    ] CRM: Fetching primary data for 2025-06.
[2025-10-24T18:07:09.001037] [INFO ] [REMOTE    ] CRS: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T18:07:09.747628] [INFO ] [REMOTE    ] CRT: Fetching primary data for 2025-02.
[2025-10-24T18:07:10.387075] [INFO ] [REMOTE    ] CRT: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T18:07:10.547681] [INFO ] [REMOTE    ] CRT: Fetching primary data for 2025-03.
[2025-10-24T18:07:11.177139] [INFO ] [REMOTE    ] CRM: Incremental fetch complete for 2025-06 (2.23 seconds).
[2025-10-24T18:07:11.206168] [INFO ] [REMOTE    ] CRT: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T18:07:11.347619] [INFO ] [REMOTE    ] CRT: Fetching primary data for 2025-04.
[2025-10-24T18:07:11.994540] [INFO ] [REMOTE    ] CRT: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T18:07:12.147623] [INFO ] [REMOTE    ] CRM: Fetching primary data for 2025-07.
[2025-10-24T18:07:12.947637] [INFO ] [REMOTE    ] CRS: Fetching primary data for 2025-04.
[2025-10-24T18:07:13.747740] [INFO ] [REMOTE    ] CRL: Fetching primary data for 2025-07.
[2025-10-24T18:07:14.441785] [INFO ] [REMOTE    ] CRM: Incremental fetch complete for 2025-07 (2.29 seconds).
[2025-10-24T18:07:14.547611] [INFO ] [REMOTE    ] CRM: Fetching primary data for 2025-08.
[2025-10-24T18:07:14.635071] [INFO ] [REMOTE    ] CRS: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T18:07:14.860478] [INFO ] [REMOTE    ] CRL: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T18:07:15.347716] [INFO ] [REMOTE    ] CRT: Fetching primary data for 2025-05.
[2025-10-24T18:07:15.810618] [INFO ] [REMOTE    ] CRT: Incremental fetch complete for 2025-05 (0.46 seconds).
[2025-10-24T18:07:16.147701] [INFO ] [REMOTE    ] CRL: Fetching primary data for 2025-08.
[2025-10-24T18:07:16.947701] [INFO ] [REMOTE    ] CRS: Fetching primary data for 2025-05.
[2025-10-24T18:07:17.164955] [INFO ] [REMOTE    ] CRM: Incremental fetch complete for 2025-08 (2.62 seconds).
[2025-10-24T18:07:17.231123] [INFO ] [REMOTE    ] CRL: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T18:07:17.747628] [INFO ] [REMOTE    ] CRM: Fetching primary data for 2025-09.
[2025-10-24T18:07:18.547744] [INFO ] [REMOTE    ] CRT: Fetching primary data for 2025-06.
[2025-10-24T18:07:18.653150] [INFO ] [REMOTE    ] CRS: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T18:07:18.980695] [INFO ] [REMOTE    ] CRT: Incremental fetch complete for 2025-06 (0.43 seconds).
[2025-10-24T18:07:19.347737] [INFO ] [REMOTE    ] CRL: Fetching primary data for 2025-09.
[2025-10-24T18:07:20.147715] [INFO ] [REMOTE    ] CRT: Fetching primary data for 2025-07.
[2025-10-24T18:07:20.346217] [INFO ] [REMOTE    ] CRM: Incremental fetch complete for 2025-09 (2.60 seconds).
[2025-10-24T18:07:20.730565] [INFO ] [REMOTE    ] CRT: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T18:07:20.915069] [INFO ] [REMOTE    ] CRL: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T18:07:20.947637] [INFO ] [REMOTE    ] CRL: Fetching primary data for 2025-10.
[2025-10-24T18:07:21.747626] [INFO ] [REMOTE    ] CRM: Fetching primary data for 2025-10.
[2025-10-24T18:07:22.456274] [INFO ] [REMOTE    ] CRL: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T18:07:22.464205] [INFO ] [REMOTE    ] CRL: Full fetch complete (63668 records).
[2025-10-24T18:07:22.464354] [DEBUG] [VALIDATOR ] CRL: Validating primary data.
[2025-10-24T18:07:22.552848] [INFO ] [REMOTE    ] CRT: Fetching primary data for 2025-08.
[2025-10-24T18:07:22.878862] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present.
[2025-10-24T18:07:22.878970] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed.
[2025-10-24T18:07:22.880027] [INFO ] [MAIN      ] CRL: Fetched primary data is valid.
[2025-10-24T18:07:22.880096] [DEBUG] [LOCAL     ] CRL: Saving primary data.
[2025-10-24T18:07:22.880984] [FATAL] [LOCAL     ] CRL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:07:22.881182] [FATAL] [MAIN      ] CRL: Failed to save primary data.
[2025-10-24T18:07:22.881227] [WARN ] [MAIN      ] CRL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:07:22.881266] [INFO ] [LOCAL     ] CRL: Starting deletion of primary data.
[2025-10-24T18:07:22.881327] [DEBUG] [LOCAL     ] CRL: No primary data file found to delete.
[2025-10-24T18:07:22.881367] [INFO ] [LOCAL     ] CRL: Starting deletion of derivative data.
[2025-10-24T18:07:22.881540] [DEBUG] [LOCAL     ] CRL: Deleted derivative data file.
[2025-10-24T18:07:22.881636] [INFO ] [MAIN      ] Update Progress: 535/2366 symbols completed. CRL took 34.9s. Estimated remaining: 3h 50m 27s. Rate: 7.9 symbols/min
[2025-10-24T18:07:23.063278] [INFO ] [MAIN      ] CSAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:07:23.108626] [DEBUG] [LOCAL     ] CSAN: Loaded 42520 existing records from primary storage.
[2025-10-24T18:07:23.109036] [INFO ] [MAIN      ] CSAN: Loaded 42520 existing records.
[2025-10-24T18:07:23.221433] [INFO ] [REMOTE    ] CRT: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T18:07:23.306796] [WARN ] [MAIN      ] CSAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:07:23.307119] [INFO ] [MAIN      ] CSAN: Wiping existing primary data before full refresh.
[2025-10-24T18:07:23.307198] [INFO ] [LOCAL     ] CSAN: Starting deletion of primary data.
[2025-10-24T18:07:23.307603] [DEBUG] [LOCAL     ] CSAN: Deleted primary data file.
[2025-10-24T18:07:23.307702] [INFO ] [MAIN      ] CSAN: Starting full primary refresh.
[2025-10-24T18:07:23.352919] [INFO ] [REMOTE    ] CRS: Fetching primary data for 2025-06.
[2025-10-24T18:07:23.679865] [INFO ] [REMOTE    ] CSAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:07:24.147697] [INFO ] [REMOTE    ] CRT: Fetching primary data for 2025-09.
[2025-10-24T18:07:24.704165] [INFO ] [REMOTE    ] CRM: Incremental fetch complete for 2025-10 (2.96 seconds).
[2025-10-24T18:07:24.705056] [INFO ] [REMOTE    ] CRT: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T18:07:24.718011] [INFO ] [REMOTE    ] CRM: Full fetch complete (77947 records).
[2025-10-24T18:07:24.718148] [DEBUG] [VALIDATOR ] CRM: Validating primary data.
[2025-10-24T18:07:24.951091] [INFO ] [REMOTE    ] CSAN: Fetching primary data for 2025-01.
[2025-10-24T18:07:25.124737] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present.
[2025-10-24T18:07:25.124847] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed.
[2025-10-24T18:07:25.125922] [INFO ] [MAIN      ] CRM: Fetched primary data is valid.
[2025-10-24T18:07:25.126171] [DEBUG] [LOCAL     ] CRM: Saving primary data.
[2025-10-24T18:07:25.126946] [FATAL] [LOCAL     ] CRM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:07:25.127101] [FATAL] [MAIN      ] CRM: Failed to save primary data.
[2025-10-24T18:07:25.127196] [WARN ] [MAIN      ] CRM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:07:25.127367] [INFO ] [LOCAL     ] CRM: Starting deletion of primary data.
[2025-10-24T18:07:25.127615] [DEBUG] [LOCAL     ] CRM: No primary data file found to delete.
[2025-10-24T18:07:25.127703] [INFO ] [LOCAL     ] CRM: Starting deletion of derivative data.
[2025-10-24T18:07:25.140338] [DEBUG] [LOCAL     ] CRM: Deleted derivative data file.
[2025-10-24T18:07:25.156693] [INFO ] [MAIN      ] Update Progress: 536/2366 symbols completed. CRM took 32.4s. Estimated remaining: 3h 50m 1s. Rate: 8.0 symbols/min
[2025-10-24T18:07:25.231968] [INFO ] [REMOTE    ] CRS: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T18:07:25.346809] [INFO ] [MAIN      ] CSL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:07:25.381547] [DEBUG] [LOCAL     ] CSL: Loaded 31384 existing records from primary storage.
[2025-10-24T18:07:25.381928] [INFO ] [MAIN      ] CSL: Loaded 31384 existing records.
[2025-10-24T18:07:25.556670] [WARN ] [MAIN      ] CSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:07:25.556881] [INFO ] [MAIN      ] CSL: Wiping existing primary data before full refresh.
[2025-10-24T18:07:25.556929] [INFO ] [LOCAL     ] CSL: Starting deletion of primary data.
[2025-10-24T18:07:25.557112] [DEBUG] [LOCAL     ] CSL: Deleted primary data file.
[2025-10-24T18:07:25.557149] [INFO ] [MAIN      ] CSL: Starting full primary refresh.
[2025-10-24T18:07:25.752726] [INFO ] [REMOTE    ] CRT: Fetching primary data for 2025-10.
[2025-10-24T18:07:25.908638] [INFO ] [REMOTE    ] CSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:07:26.302533] [INFO ] [REMOTE    ] CSAN: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T18:07:26.547631] [INFO ] [REMOTE    ] CSAN: Fetching primary data for 2025-02.
[2025-10-24T18:07:26.759679] [INFO ] [REMOTE    ] CRT: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T18:07:26.761203] [INFO ] [REMOTE    ] CRT: Full fetch complete (7389 records).
[2025-10-24T18:07:26.761275] [DEBUG] [VALIDATOR ] CRT: Validating primary data.
[2025-10-24T18:07:27.124083] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present.
[2025-10-24T18:07:27.124151] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed.
[2025-10-24T18:07:27.124344] [INFO ] [MAIN      ] CRT: Fetched primary data is valid.
[2025-10-24T18:07:27.124381] [DEBUG] [LOCAL     ] CRT: Saving primary data.
[2025-10-24T18:07:27.124567] [FATAL] [LOCAL     ] CRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:07:27.124661] [FATAL] [MAIN      ] CRT: Failed to save primary data.
[2025-10-24T18:07:27.124719] [WARN ] [MAIN      ] CRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:07:27.124756] [INFO ] [LOCAL     ] CRT: Starting deletion of primary data.
[2025-10-24T18:07:27.124804] [DEBUG] [LOCAL     ] CRT: No primary data file found to delete.
[2025-10-24T18:07:27.124837] [INFO ] [LOCAL     ] CRT: Starting deletion of derivative data.
[2025-10-24T18:07:27.124996] [DEBUG] [LOCAL     ] CRT: Deleted derivative data file.
[2025-10-24T18:07:27.125082] [INFO ] [MAIN      ] Update Progress: 537/2366 symbols completed. CRT took 20.9s. Estimated remaining: 3h 49m 34s. Rate: 8.0 symbols/min
[2025-10-24T18:07:27.295463] [INFO ] [MAIN      ] CSR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:07:27.310985] [DEBUG] [LOCAL     ] CSR: Loaded 13476 existing records from primary storage.
[2025-10-24T18:07:27.311222] [INFO ] [MAIN      ] CSR: Loaded 13476 existing records.
[2025-10-24T18:07:27.353440] [INFO ] [REMOTE    ] CRS: Fetching primary data for 2025-07.
[2025-10-24T18:07:27.488635] [WARN ] [MAIN      ] CSR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:07:27.488846] [INFO ] [MAIN      ] CSR: Wiping existing primary data before full refresh.
[2025-10-24T18:07:27.488892] [INFO ] [LOCAL     ] CSR: Starting deletion of primary data.
[2025-10-24T18:07:27.489048] [DEBUG] [LOCAL     ] CSR: Deleted primary data file.
[2025-10-24T18:07:27.489086] [INFO ] [MAIN      ] CSR: Starting full primary refresh.
[2025-10-24T18:07:27.840538] [INFO ] [REMOTE    ] CSR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:07:28.046059] [INFO ] [REMOTE    ] CSAN: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T18:07:28.147630] [INFO ] [REMOTE    ] CSAN: Fetching primary data for 2025-03.
[2025-10-24T18:07:28.818692] [INFO ] [REMOTE    ] CRS: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T18:07:28.947601] [INFO ] [REMOTE    ] CRS: Fetching primary data for 2025-08.
[2025-10-24T18:07:29.031447] [INFO ] [REMOTE    ] CSAN: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T18:07:29.747736] [INFO ] [REMOTE    ] CSR: Fetching primary data for 2025-01.
[2025-10-24T18:07:30.496076] [INFO ] [REMOTE    ] CRS: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T18:07:30.547637] [INFO ] [REMOTE    ] CSL: Fetching primary data for 2025-01.
[2025-10-24T18:07:30.564154] [INFO ] [REMOTE    ] CSR: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T18:07:31.347700] [INFO ] [REMOTE    ] CSR: Fetching primary data for 2025-02.
[2025-10-24T18:07:31.988628] [INFO ] [REMOTE    ] CSL: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T18:07:32.097266] [INFO ] [REMOTE    ] CSR: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T18:07:32.147673] [INFO ] [REMOTE    ] CSAN: Fetching primary data for 2025-04.
[2025-10-24T18:07:32.947764] [INFO ] [REMOTE    ] CSR: Fetching primary data for 2025-03.
[2025-10-24T18:07:33.747669] [INFO ] [REMOTE    ] CRS: Fetching primary data for 2025-09.
[2025-10-24T18:07:33.855922] [INFO ] [REMOTE    ] CSAN: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T18:07:33.866937] [INFO ] [REMOTE    ] CSR: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T18:07:34.547713] [INFO ] [REMOTE    ] CSR: Fetching primary data for 2025-04.
[2025-10-24T18:07:35.335304] [INFO ] [REMOTE    ] CRS: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T18:07:35.347625] [INFO ] [REMOTE    ] CRS: Fetching primary data for 2025-10.
[2025-10-24T18:07:35.623789] [INFO ] [REMOTE    ] CSR: Incremental fetch complete for 2025-04 (1.08 seconds).
[2025-10-24T18:07:36.147730] [INFO ] [REMOTE    ] CSR: Fetching primary data for 2025-05.
[2025-10-24T18:07:36.947710] [INFO ] [REMOTE    ] CSAN: Fetching primary data for 2025-05.
[2025-10-24T18:07:36.981813] [INFO ] [REMOTE    ] CRS: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T18:07:36.994225] [INFO ] [REMOTE    ] CRS: Full fetch complete (62766 records).
[2025-10-24T18:07:36.998702] [DEBUG] [VALIDATOR ] CRS: Validating primary data.
[2025-10-24T18:07:36.998531] [INFO ] [REMOTE    ] CSR: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T18:07:37.381249] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present.
[2025-10-24T18:07:37.381353] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed.
[2025-10-24T18:07:37.382159] [INFO ] [MAIN      ] CRS: Fetched primary data is valid.
[2025-10-24T18:07:37.382221] [DEBUG] [LOCAL     ] CRS: Saving primary data.
[2025-10-24T18:07:37.382793] [FATAL] [LOCAL     ] CRS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:07:37.382885] [FATAL] [MAIN      ] CRS: Failed to save primary data.
[2025-10-24T18:07:37.382927] [WARN ] [MAIN      ] CRS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:07:37.382976] [INFO ] [LOCAL     ] CRS: Starting deletion of primary data.
[2025-10-24T18:07:37.383059] [DEBUG] [LOCAL     ] CRS: No primary data file found to delete.
[2025-10-24T18:07:37.383108] [INFO ] [LOCAL     ] CRS: Starting deletion of derivative data.
[2025-10-24T18:07:37.383186] [DEBUG] [LOCAL     ] CRS: No derivative data file found to delete.
[2025-10-24T18:07:37.383818] [INFO ] [MAIN      ] Update Progress: 538/2366 symbols completed. CRS took 34.9s. Estimated remaining: 3h 49m 36s. Rate: 8.0 symbols/min
[2025-10-24T18:07:37.549040] [INFO ] [MAIN      ] CSTM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:07:37.595443] [DEBUG] [LOCAL     ] CSTM: Loaded 47799 existing records from primary storage.
[2025-10-24T18:07:37.595769] [INFO ] [MAIN      ] CSTM: Loaded 47799 existing records.
[2025-10-24T18:07:37.749302] [INFO ] [REMOTE    ] CSR: Fetching primary data for 2025-06.
[2025-10-24T18:07:37.770800] [WARN ] [MAIN      ] CSTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:07:37.771693] [INFO ] [MAIN      ] CSTM: Wiping existing primary data before full refresh.
[2025-10-24T18:07:37.771762] [INFO ] [LOCAL     ] CSTM: Starting deletion of primary data.
[2025-10-24T18:07:37.772015] [DEBUG] [LOCAL     ] CSTM: Deleted primary data file.
[2025-10-24T18:07:37.772080] [INFO ] [MAIN      ] CSTM: Starting full primary refresh.
[2025-10-24T18:07:38.125723] [INFO ] [REMOTE    ] CSTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:07:38.304028] [INFO ] [REMOTE    ] CSAN: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T18:07:38.547614] [INFO ] [REMOTE    ] CSAN: Fetching primary data for 2025-06.
[2025-10-24T18:07:38.689469] [INFO ] [REMOTE    ] CSR: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T18:07:39.347664] [INFO ] [REMOTE    ] CSL: Fetching primary data for 2025-02.
[2025-10-24T18:07:39.885398] [INFO ] [REMOTE    ] CSAN: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T18:07:40.147682] [INFO ] [REMOTE    ] CSAN: Fetching primary data for 2025-07.
[2025-10-24T18:07:40.563268] [INFO ] [REMOTE    ] CSL: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T18:07:40.947637] [INFO ] [REMOTE    ] CSL: Fetching primary data for 2025-03.
[2025-10-24T18:07:41.747666] [INFO ] [REMOTE    ] CSR: Fetching primary data for 2025-07.
[2025-10-24T18:07:41.812093] [INFO ] [REMOTE    ] CSAN: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T18:07:41.853838] [DEBUG] [REMOTE    ] CSR: Error fetching primary data for 2025-07: 'API call returned an empty response.'
[2025-10-24T18:07:41.854136] [WARN ] [REMOTE    ] CSR: No data returned for month 2025-07
[2025-10-24T18:07:41.854244] [FATAL] [REMOTE    ] CSR: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:07:41.854348] [FATAL] [MAIN      ] CSR: Failed to fetch primary data.
[2025-10-24T18:07:41.854405] [WARN ] [MAIN      ] CSR: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:07:41.854454] [INFO ] [LOCAL     ] CSR: Starting deletion of primary data.
[2025-10-24T18:07:41.854525] [DEBUG] [LOCAL     ] CSR: No primary data file found to delete.
[2025-10-24T18:07:41.854579] [INFO ] [LOCAL     ] CSR: Starting deletion of derivative data.
[2025-10-24T18:07:41.854774] [DEBUG] [LOCAL     ] CSR: Deleted derivative data file.
[2025-10-24T18:07:41.854876] [INFO ] [MAIN      ] Update Progress: 539/2366 symbols completed. CSR took 14.7s. Estimated remaining: 3h 49m 18s. Rate: 8.0 symbols/min
[2025-10-24T18:07:42.037468] [INFO ] [MAIN      ] CSV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:07:42.052208] [DEBUG] [LOCAL     ] CSV: Loaded 12479 existing records from primary storage.
[2025-10-24T18:07:42.052433] [INFO ] [MAIN      ] CSV: Loaded 12479 existing records.
[2025-10-24T18:07:42.248796] [WARN ] [MAIN      ] CSV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:07:42.249038] [INFO ] [MAIN      ] CSV: Wiping existing primary data before full refresh.
[2025-10-24T18:07:42.249097] [INFO ] [LOCAL     ] CSV: Starting deletion of primary data.
[2025-10-24T18:07:42.249281] [DEBUG] [LOCAL     ] CSV: Deleted primary data file.
[2025-10-24T18:07:42.249335] [INFO ] [MAIN      ] CSV: Starting full primary refresh.
[2025-10-24T18:07:42.552963] [INFO ] [REMOTE    ] CSTM: Fetching primary data for 2025-01.
[2025-10-24T18:07:42.804309] [INFO ] [REMOTE    ] CSL: Incremental fetch complete for 2025-03 (1.86 seconds).
[2025-10-24T18:07:42.811530] [INFO ] [REMOTE    ] CSV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:07:43.347681] [INFO ] [REMOTE    ] CSAN: Fetching primary data for 2025-08.
[2025-10-24T18:07:44.147745] [INFO ] [REMOTE    ] CSV: Fetching primary data for 2025-01.
[2025-10-24T18:07:44.424748] [INFO ] [REMOTE    ] CSTM: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T18:07:44.746895] [INFO ] [REMOTE    ] CSAN: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T18:07:44.947684] [INFO ] [REMOTE    ] CSAN: Fetching primary data for 2025-09.
[2025-10-24T18:07:45.648373] [INFO ] [REMOTE    ] CSV: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T18:07:45.747697] [INFO ] [REMOTE    ] CSTM: Fetching primary data for 2025-02.
[2025-10-24T18:07:46.351562] [INFO ] [REMOTE    ] CSAN: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T18:07:46.547674] [INFO ] [REMOTE    ] CSAN: Fetching primary data for 2025-10.
[2025-10-24T18:07:47.352770] [INFO ] [REMOTE    ] CSL: Fetching primary data for 2025-04.
[2025-10-24T18:07:47.368911] [INFO ] [REMOTE    ] CSTM: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T18:07:47.987115] [INFO ] [REMOTE    ] CSAN: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T18:07:47.994534] [INFO ] [REMOTE    ] CSAN: Full fetch complete (60259 records).
[2025-10-24T18:07:47.994704] [DEBUG] [VALIDATOR ] CSAN: Validating primary data.
[2025-10-24T18:07:48.150594] [INFO ] [REMOTE    ] CSV: Fetching primary data for 2025-02.
[2025-10-24T18:07:48.385551] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present.
[2025-10-24T18:07:48.385674] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed.
[2025-10-24T18:07:48.386436] [INFO ] [MAIN      ] CSAN: Fetched primary data is valid.
[2025-10-24T18:07:48.386478] [DEBUG] [LOCAL     ] CSAN: Saving primary data.
[2025-10-24T18:07:48.386978] [FATAL] [LOCAL     ] CSAN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:07:48.387087] [FATAL] [MAIN      ] CSAN: Failed to save primary data.
[2025-10-24T18:07:48.387184] [WARN ] [MAIN      ] CSAN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:07:48.387265] [INFO ] [LOCAL     ] CSAN: Starting deletion of primary data.
[2025-10-24T18:07:48.387333] [DEBUG] [LOCAL     ] CSAN: No primary data file found to delete.
[2025-10-24T18:07:48.387369] [INFO ] [LOCAL     ] CSAN: Starting deletion of derivative data.
[2025-10-24T18:07:48.387505] [DEBUG] [LOCAL     ] CSAN: Deleted derivative data file.
[2025-10-24T18:07:48.387581] [INFO ] [MAIN      ] Update Progress: 540/2366 symbols completed. CSAN took 25.5s. Estimated remaining: 3h 49m 7s. Rate: 8.0 symbols/min
[2025-10-24T18:07:48.558026] [INFO ] [MAIN      ] CSW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:07:48.558190] [DEBUG] [LOCAL     ] CSW: No existing data file found in primary storage.
[2025-10-24T18:07:48.558226] [WARN ] [MAIN      ] CSW: No existing data found, performing full refresh instead.
[2025-10-24T18:07:48.558357] [INFO ] [MAIN      ] CSW: Wiping existing primary data before full refresh.
[2025-10-24T18:07:48.558435] [INFO ] [LOCAL     ] CSW: Starting deletion of primary data.
[2025-10-24T18:07:48.558537] [DEBUG] [LOCAL     ] CSW: No primary data file found to delete.
[2025-10-24T18:07:48.558623] [INFO ] [MAIN      ] CSW: Starting full primary refresh.
[2025-10-24T18:07:48.924737] [INFO ] [REMOTE    ] CSW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:07:48.947637] [INFO ] [REMOTE    ] CSTM: Fetching primary data for 2025-03.
[2025-10-24T18:07:48.989696] [INFO ] [REMOTE    ] CSL: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T18:07:49.075983] [INFO ] [REMOTE    ] CSV: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T18:07:49.747699] [INFO ] [REMOTE    ] CSL: Fetching primary data for 2025-05.
[2025-10-24T18:07:50.304014] [INFO ] [REMOTE    ] CSTM: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T18:07:50.547613] [INFO ] [REMOTE    ] CSTM: Fetching primary data for 2025-04.
[2025-10-24T18:07:50.787464] [INFO ] [REMOTE    ] CSL: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T18:07:51.347726] [INFO ] [REMOTE    ] CSL: Fetching primary data for 2025-06.
[2025-10-24T18:07:52.044029] [INFO ] [REMOTE    ] CSTM: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T18:07:52.147711] [INFO ] [REMOTE    ] CSV: Fetching primary data for 2025-03.
[2025-10-24T18:07:52.541632] [INFO ] [REMOTE    ] CSL: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T18:07:52.947692] [INFO ] [REMOTE    ] CSW: Fetching primary data for 2025-01.
[2025-10-24T18:07:53.095707] [INFO ] [REMOTE    ] CSV: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T18:07:53.166500] [DEBUG] [REMOTE    ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T18:07:53.166879] [WARN ] [REMOTE    ] CSW: No data returned for month 2025-01
[2025-10-24T18:07:53.166966] [FATAL] [REMOTE    ] CSW: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:07:53.167011] [FATAL] [MAIN      ] CSW: Failed to fetch primary data.
[2025-10-24T18:07:53.167070] [WARN ] [MAIN      ] CSW: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:07:53.167140] [INFO ] [LOCAL     ] CSW: Starting deletion of primary data.
[2025-10-24T18:07:53.167380] [DEBUG] [LOCAL     ] CSW: No primary data file found to delete.
[2025-10-24T18:07:53.167426] [INFO ] [LOCAL     ] CSW: Starting deletion of derivative data.
[2025-10-24T18:07:53.167468] [DEBUG] [LOCAL     ] CSW: No derivative data file found to delete.
[2025-10-24T18:07:53.167515] [INFO ] [MAIN      ] Update Progress: 541/2366 symbols completed. CSW took 4.8s. Estimated remaining: 3h 48m 51s. Rate: 8.0 symbols/min
[2025-10-24T18:07:53.340239] [INFO ] [MAIN      ] CTBB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:07:53.348560] [DEBUG] [LOCAL     ] CTBB: Loaded 6424 existing records from primary storage.
[2025-10-24T18:07:53.348793] [INFO ] [MAIN      ] CTBB: Loaded 6424 existing records.
[2025-10-24T18:07:53.538080] [WARN ] [MAIN      ] CTBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:07:53.538332] [INFO ] [MAIN      ] CTBB: Wiping existing primary data before full refresh.
[2025-10-24T18:07:53.538395] [INFO ] [LOCAL     ] CTBB: Starting deletion of primary data.
[2025-10-24T18:07:53.538717] [DEBUG] [LOCAL     ] CTBB: Deleted primary data file.
[2025-10-24T18:07:53.538774] [INFO ] [MAIN      ] CTBB: Starting full primary refresh.
[2025-10-24T18:07:53.755599] [INFO ] [REMOTE    ] CSV: Fetching primary data for 2025-04.
[2025-10-24T18:07:53.999624] [INFO ] [REMOTE    ] CTBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:07:54.547622] [INFO ] [REMOTE    ] CSTM: Fetching primary data for 2025-05.
[2025-10-24T18:07:54.906557] [INFO ] [REMOTE    ] CSV: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T18:07:55.347711] [INFO ] [REMOTE    ] CTBB: Fetching primary data for 2025-01.
[2025-10-24T18:07:55.956194] [INFO ] [REMOTE    ] CSTM: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T18:07:55.995463] [INFO ] [REMOTE    ] CTBB: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T18:07:56.147671] [INFO ] [REMOTE    ] CSTM: Fetching primary data for 2025-06.
[2025-10-24T18:07:56.947628] [INFO ] [REMOTE    ] CTBB: Fetching primary data for 2025-02.
[2025-10-24T18:07:57.481595] [INFO ] [REMOTE    ] CSTM: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T18:07:57.550884] [INFO ] [REMOTE    ] CTBB: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T18:07:57.747723] [INFO ] [REMOTE    ] CSL: Fetching primary data for 2025-07.
[2025-10-24T18:07:58.547718] [INFO ] [REMOTE    ] CSTM: Fetching primary data for 2025-07.
[2025-10-24T18:07:59.115081] [INFO ] [REMOTE    ] CSL: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T18:07:59.347728] [INFO ] [REMOTE    ] CSV: Fetching primary data for 2025-05.
[2025-10-24T18:08:00.036141] [INFO ] [REMOTE    ] CSTM: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T18:08:00.147634] [INFO ] [REMOTE    ] CSTM: Fetching primary data for 2025-08.
[2025-10-24T18:08:00.396257] [INFO ] [REMOTE    ] CSV: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T18:08:00.947612] [INFO ] [REMOTE    ] CSV: Fetching primary data for 2025-06.
[2025-10-24T18:08:01.747678] [INFO ] [REMOTE    ] CSL: Fetching primary data for 2025-08.
[2025-10-24T18:08:02.097800] [INFO ] [REMOTE    ] CSTM: Incremental fetch complete for 2025-08 (1.95 seconds).
[2025-10-24T18:08:02.193266] [INFO ] [REMOTE    ] CSV: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T18:08:02.547728] [INFO ] [REMOTE    ] CSTM: Fetching primary data for 2025-09.
[2025-10-24T18:08:03.347726] [INFO ] [REMOTE    ] CTBB: Fetching primary data for 2025-03.
[2025-10-24T18:08:04.147748] [INFO ] [REMOTE    ] CSV: Fetching primary data for 2025-07.
[2025-10-24T18:08:04.708986] [INFO ] [REMOTE    ] CTBB: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T18:08:04.947720] [INFO ] [REMOTE    ] CTBB: Fetching primary data for 2025-04.
[2025-10-24T18:08:04.981155] [INFO ] [REMOTE    ] CSL: Incremental fetch complete for 2025-08 (3.23 seconds).
[2025-10-24T18:08:05.239278] [INFO ] [REMOTE    ] CSTM: Incremental fetch complete for 2025-09 (2.69 seconds).
[2025-10-24T18:08:05.281450] [INFO ] [REMOTE    ] CSV: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T18:08:05.747708] [INFO ] [REMOTE    ] CSTM: Fetching primary data for 2025-10.
[2025-10-24T18:08:05.812545] [INFO ] [REMOTE    ] CTBB: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T18:08:06.547676] [INFO ] [REMOTE    ] CTBB: Fetching primary data for 2025-05.
[2025-10-24T18:08:07.229259] [INFO ] [REMOTE    ] CTBB: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T18:08:07.347616] [INFO ] [REMOTE    ] CSL: Fetching primary data for 2025-09.
[2025-10-24T18:08:07.518401] [INFO ] [REMOTE    ] CSTM: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T18:08:07.526466] [INFO ] [REMOTE    ] CSTM: Full fetch complete (69217 records).
[2025-10-24T18:08:07.526578] [DEBUG] [VALIDATOR ] CSTM: Validating primary data.
[2025-10-24T18:08:07.527337] [FATAL] [VALIDATOR ] CSTM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:08:07.527423] [FATAL] [MAIN      ] CSTM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:08:07.527465] [WARN ] [MAIN      ] CSTM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:08:07.527536] [INFO ] [LOCAL     ] CSTM: Starting deletion of primary data.
[2025-10-24T18:08:07.527598] [DEBUG] [LOCAL     ] CSTM: No primary data file found to delete.
[2025-10-24T18:08:07.527633] [INFO ] [LOCAL     ] CSTM: Starting deletion of derivative data.
[2025-10-24T18:08:07.527822] [DEBUG] [LOCAL     ] CSTM: Deleted derivative data file.
[2025-10-24T18:08:07.528224] [INFO ] [MAIN      ] Update Progress: 542/2366 symbols completed. CSTM took 30.1s. Estimated remaining: 3h 49m 6s. Rate: 8.0 symbols/min
[2025-10-24T18:08:07.695991] [INFO ] [MAIN      ] CTDD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:08:07.703679] [DEBUG] [LOCAL     ] CTDD: Loaded 5159 existing records from primary storage.
[2025-10-24T18:08:07.703960] [INFO ] [MAIN      ] CTDD: Loaded 5159 existing records.
[2025-10-24T18:08:07.896189] [WARN ] [MAIN      ] CTDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:08:07.896396] [INFO ] [MAIN      ] CTDD: Wiping existing primary data before full refresh.
[2025-10-24T18:08:07.896443] [INFO ] [LOCAL     ] CTDD: Starting deletion of primary data.
[2025-10-24T18:08:07.896686] [DEBUG] [LOCAL     ] CTDD: Deleted primary data file.
[2025-10-24T18:08:07.896768] [INFO ] [MAIN      ] CTDD: Starting full primary refresh.
[2025-10-24T18:08:08.154316] [INFO ] [REMOTE    ] CTBB: Fetching primary data for 2025-06.
[2025-10-24T18:08:08.275792] [INFO ] [REMOTE    ] CTDD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:08:08.433965] [INFO ] [REMOTE    ] CSL: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T18:08:08.883072] [INFO ] [REMOTE    ] CTBB: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T18:08:08.947628] [INFO ] [REMOTE    ] CTBB: Fetching primary data for 2025-07.
[2025-10-24T18:08:09.543636] [INFO ] [REMOTE    ] CTBB: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T18:08:09.747670] [INFO ] [REMOTE    ] CSL: Fetching primary data for 2025-10.
[2025-10-24T18:08:10.547667] [INFO ] [REMOTE    ] CSV: Fetching primary data for 2025-08.
[2025-10-24T18:08:11.146499] [INFO ] [REMOTE    ] CSL: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T18:08:11.152671] [INFO ] [REMOTE    ] CSL: Full fetch complete (45717 records).
[2025-10-24T18:08:11.152820] [DEBUG] [VALIDATOR ] CSL: Validating primary data.
[2025-10-24T18:08:11.349971] [INFO ] [REMOTE    ] CTDD: Fetching primary data for 2025-01.
[2025-10-24T18:08:11.542709] [INFO ] [REMOTE    ] CSV: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T18:08:11.560203] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present.
[2025-10-24T18:08:11.563292] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed.
[2025-10-24T18:08:11.564606] [INFO ] [MAIN      ] CSL: Fetched primary data is valid.
[2025-10-24T18:08:11.565044] [DEBUG] [LOCAL     ] CSL: Saving primary data.
[2025-10-24T18:08:11.565692] [FATAL] [LOCAL     ] CSL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:08:11.565796] [FATAL] [MAIN      ] CSL: Failed to save primary data.
[2025-10-24T18:08:11.565872] [WARN ] [MAIN      ] CSL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:08:11.565955] [INFO ] [LOCAL     ] CSL: Starting deletion of primary data.
[2025-10-24T18:08:11.566035] [DEBUG] [LOCAL     ] CSL: No primary data file found to delete.
[2025-10-24T18:08:11.566092] [INFO ] [LOCAL     ] CSL: Starting deletion of derivative data.
[2025-10-24T18:08:11.566279] [DEBUG] [LOCAL     ] CSL: Deleted derivative data file.
[2025-10-24T18:08:11.567289] [INFO ] [MAIN      ] Update Progress: 543/2366 symbols completed. CSL took 46.4s. Estimated remaining: 3h 48m 47s. Rate: 8.0 symbols/min
[2025-10-24T18:08:11.753616] [INFO ] [MAIN      ] CTEV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:08:11.753875] [DEBUG] [LOCAL     ] CTEV: No existing data file found in primary storage.
[2025-10-24T18:08:11.754615] [WARN ] [MAIN      ] CTEV: No existing data found, performing full refresh instead.
[2025-10-24T18:08:11.754786] [INFO ] [MAIN      ] CTEV: Wiping existing primary data before full refresh.
[2025-10-24T18:08:11.754841] [INFO ] [LOCAL     ] CTEV: Starting deletion of primary data.
[2025-10-24T18:08:11.754885] [DEBUG] [LOCAL     ] CTEV: No primary data file found to delete.
[2025-10-24T18:08:11.754917] [INFO ] [MAIN      ] CTEV: Starting full primary refresh.
[2025-10-24T18:08:12.135681] [INFO ] [REMOTE    ] CTEV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:08:12.142929] [INFO ] [REMOTE    ] CTDD: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T18:08:12.147622] [INFO ] [REMOTE    ] CTDD: Fetching primary data for 2025-02.
[2025-10-24T18:08:12.516667] [INFO ] [REMOTE    ] CTDD: Incremental fetch complete for 2025-02 (0.37 seconds).
[2025-10-24T18:08:12.947675] [INFO ] [REMOTE    ] CSV: Fetching primary data for 2025-09.
[2025-10-24T18:08:13.657058] [INFO ] [REMOTE    ] CSV: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T18:08:13.747679] [INFO ] [REMOTE    ] CTBB: Fetching primary data for 2025-08.
[2025-10-24T18:08:14.450322] [INFO ] [REMOTE    ] CTBB: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T18:08:14.547676] [INFO ] [REMOTE    ] CSV: Fetching primary data for 2025-10.
[2025-10-24T18:08:15.347712] [INFO ] [REMOTE    ] CTEV: Fetching primary data for 2025-01.
[2025-10-24T18:08:15.588664] [INFO ] [REMOTE    ] CSV: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T18:08:15.590961] [INFO ] [REMOTE    ] CSV: Full fetch complete (18934 records).
[2025-10-24T18:08:15.591035] [DEBUG] [VALIDATOR ] CSV: Validating primary data.
[2025-10-24T18:08:15.634811] [DEBUG] [REMOTE    ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T18:08:15.672548] [WARN ] [REMOTE    ] CTEV: No data returned for month 2025-01
[2025-10-24T18:08:15.694032] [FATAL] [REMOTE    ] CTEV: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:08:15.694190] [FATAL] [MAIN      ] CTEV: Failed to fetch primary data.
[2025-10-24T18:08:15.694542] [WARN ] [MAIN      ] CTEV: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:08:15.710268] [INFO ] [LOCAL     ] CTEV: Starting deletion of primary data.
[2025-10-24T18:08:15.733226] [DEBUG] [LOCAL     ] CTEV: No primary data file found to delete.
[2025-10-24T18:08:15.752022] [INFO ] [LOCAL     ] CTEV: Starting deletion of derivative data.
[2025-10-24T18:08:15.769471] [DEBUG] [LOCAL     ] CTEV: No derivative data file found to delete.
[2025-10-24T18:08:15.778396] [INFO ] [MAIN      ] Update Progress: 544/2366 symbols completed. CTEV took 4.2s. Estimated remaining: 3h 48m 28s. Rate: 8.0 symbols/min
[2025-10-24T18:08:16.127073] [INFO ] [MAIN      ] CTO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:08:16.152470] [INFO ] [REMOTE    ] CTDD: Fetching primary data for 2025-03.
[2025-10-24T18:08:16.153875] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present.
[2025-10-24T18:08:16.153988] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed.
[2025-10-24T18:08:16.154457] [INFO ] [MAIN      ] CSV: Fetched primary data is valid.
[2025-10-24T18:08:16.154533] [DEBUG] [LOCAL     ] CSV: Saving primary data.
[2025-10-24T18:08:16.155111] [FATAL] [LOCAL     ] CSV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:08:16.155219] [FATAL] [MAIN      ] CSV: Failed to save primary data.
[2025-10-24T18:08:16.155290] [WARN ] [MAIN      ] CSV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:08:16.155361] [INFO ] [LOCAL     ] CSV: Starting deletion of primary data.
[2025-10-24T18:08:16.155419] [DEBUG] [LOCAL     ] CSV: No primary data file found to delete.
[2025-10-24T18:08:16.155457] [INFO ] [LOCAL     ] CSV: Starting deletion of derivative data.
[2025-10-24T18:08:16.155584] [DEBUG] [LOCAL     ] CSV: Deleted derivative data file.
[2025-10-24T18:08:16.155734] [INFO ] [MAIN      ] Update Progress: 545/2366 symbols completed. CSV took 34.3s. Estimated remaining: 3h 47m 57s. Rate: 8.0 symbols/min
[2025-10-24T18:08:16.351512] [DEBUG] [LOCAL     ] CTO: Loaded 27572 existing records from primary storage.
[2025-10-24T18:08:16.369975] [INFO ] [MAIN      ] CTO: Loaded 27572 existing records.
[2025-10-24T18:08:16.369632] [INFO ] [MAIN      ] CTOS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:08:16.559803] [WARN ] [MAIN      ] CTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:08:16.560059] [INFO ] [MAIN      ] CTO: Wiping existing primary data before full refresh.
[2025-10-24T18:08:16.560106] [INFO ] [LOCAL     ] CTO: Starting deletion of primary data.
[2025-10-24T18:08:16.560689] [DEBUG] [LOCAL     ] CTO: Deleted primary data file.
[2025-10-24T18:08:16.560750] [INFO ] [MAIN      ] CTO: Starting full primary refresh.
[2025-10-24T18:08:16.674867] [DEBUG] [LOCAL     ] CTOS: Loaded 37510 existing records from primary storage.
[2025-10-24T18:08:16.686114] [INFO ] [MAIN      ] CTOS: Loaded 37510 existing records.
[2025-10-24T18:08:16.963239] [INFO ] [REMOTE    ] CTBB: Fetching primary data for 2025-09.
[2025-10-24T18:08:17.026783] [INFO ] [REMOTE    ] CTDD: Incremental fetch complete for 2025-03 (0.87 seconds).
[2025-10-24T18:08:17.052802] [WARN ] [MAIN      ] CTOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:08:17.059605] [INFO ] [MAIN      ] CTOS: Wiping existing primary data before full refresh.
[2025-10-24T18:08:17.070045] [INFO ] [LOCAL     ] CTOS: Starting deletion of primary data.
[2025-10-24T18:08:17.093970] [DEBUG] [LOCAL     ] CTOS: Deleted primary data file.
[2025-10-24T18:08:17.114112] [INFO ] [MAIN      ] CTOS: Starting full primary refresh.
[2025-10-24T18:08:17.133622] [INFO ] [REMOTE    ] CTO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:08:17.497968] [INFO ] [REMOTE    ] CTOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:08:17.747744] [INFO ] [REMOTE    ] CTO: Fetching primary data for 2025-01.
[2025-10-24T18:08:17.830429] [INFO ] [REMOTE    ] CTBB: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T18:08:18.547692] [INFO ] [REMOTE    ] CTOS: Fetching primary data for 2025-01.
[2025-10-24T18:08:18.987115] [INFO ] [REMOTE    ] CTO: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T18:08:19.347726] [INFO ] [REMOTE    ] CTO: Fetching primary data for 2025-02.
[2025-10-24T18:08:20.026330] [INFO ] [REMOTE    ] CTOS: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T18:08:20.147615] [INFO ] [REMOTE    ] CTOS: Fetching primary data for 2025-02.
[2025-10-24T18:08:20.610130] [INFO ] [REMOTE    ] CTO: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T18:08:20.947679] [INFO ] [REMOTE    ] CTDD: Fetching primary data for 2025-04.
[2025-10-24T18:08:21.209442] [INFO ] [REMOTE    ] CTOS: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T18:08:21.424124] [INFO ] [REMOTE    ] CTDD: Incremental fetch complete for 2025-04 (0.48 seconds).
[2025-10-24T18:08:21.747699] [INFO ] [REMOTE    ] CTO: Fetching primary data for 2025-03.
[2025-10-24T18:08:22.547707] [INFO ] [REMOTE    ] CTOS: Fetching primary data for 2025-03.
[2025-10-24T18:08:23.189132] [INFO ] [REMOTE    ] CTO: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T18:08:23.347610] [INFO ] [REMOTE    ] CTO: Fetching primary data for 2025-04.
[2025-10-24T18:08:23.921707] [INFO ] [REMOTE    ] CTOS: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T18:08:24.147685] [INFO ] [REMOTE    ] CTBB: Fetching primary data for 2025-10.
[2025-10-24T18:08:24.491128] [INFO ] [REMOTE    ] CTO: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T18:08:24.855938] [INFO ] [REMOTE    ] CTBB: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T18:08:24.857799] [INFO ] [REMOTE    ] CTBB: Full fetch complete (10055 records).
[2025-10-24T18:08:24.857886] [DEBUG] [VALIDATOR ] CTBB: Validating primary data.
[2025-10-24T18:08:24.953085] [INFO ] [REMOTE    ] CTOS: Fetching primary data for 2025-04.
[2025-10-24T18:08:25.222358] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present.
[2025-10-24T18:08:25.222433] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed.
[2025-10-24T18:08:25.222697] [INFO ] [MAIN      ] CTBB: Fetched primary data is valid.
[2025-10-24T18:08:25.222758] [DEBUG] [LOCAL     ] CTBB: Saving primary data.
[2025-10-24T18:08:25.222968] [FATAL] [LOCAL     ] CTBB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:08:25.223048] [FATAL] [MAIN      ] CTBB: Failed to save primary data.
[2025-10-24T18:08:25.223111] [WARN ] [MAIN      ] CTBB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:08:25.223148] [INFO ] [LOCAL     ] CTBB: Starting deletion of primary data.
[2025-10-24T18:08:25.223196] [DEBUG] [LOCAL     ] CTBB: No primary data file found to delete.
[2025-10-24T18:08:25.223239] [INFO ] [LOCAL     ] CTBB: Starting deletion of derivative data.
[2025-10-24T18:08:25.223366] [DEBUG] [LOCAL     ] CTBB: Deleted derivative data file.
[2025-10-24T18:08:25.223435] [INFO ] [MAIN      ] Update Progress: 546/2366 symbols completed. CTBB took 32.1s. Estimated remaining: 3h 47m 54s. Rate: 8.0 symbols/min
[2025-10-24T18:08:25.390678] [INFO ] [MAIN      ] CTRA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:08:25.442940] [DEBUG] [LOCAL     ] CTRA: Loaded 54037 existing records from primary storage.
[2025-10-24T18:08:25.443252] [INFO ] [MAIN      ] CTRA: Loaded 54037 existing records.
[2025-10-24T18:08:25.618220] [WARN ] [MAIN      ] CTRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:08:25.618422] [INFO ] [MAIN      ] CTRA: Wiping existing primary data before full refresh.
[2025-10-24T18:08:25.618480] [INFO ] [LOCAL     ] CTRA: Starting deletion of primary data.
[2025-10-24T18:08:25.618717] [DEBUG] [LOCAL     ] CTRA: Deleted primary data file.
[2025-10-24T18:08:25.618790] [INFO ] [MAIN      ] CTRA: Starting full primary refresh.
[2025-10-24T18:08:25.756219] [INFO ] [REMOTE    ] CTO: Fetching primary data for 2025-05.
[2025-10-24T18:08:25.975183] [INFO ] [REMOTE    ] CTRA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:08:26.547720] [INFO ] [REMOTE    ] CTRA: Fetching primary data for 2025-01.
[2025-10-24T18:08:26.585618] [INFO ] [REMOTE    ] CTOS: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T18:08:26.653909] [INFO ] [REMOTE    ] CTO: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T18:08:27.347684] [INFO ] [REMOTE    ] CTO: Fetching primary data for 2025-06.
[2025-10-24T18:08:28.147701] [INFO ] [REMOTE    ] CTOS: Fetching primary data for 2025-05.
[2025-10-24T18:08:28.582331] [INFO ] [REMOTE    ] CTRA: Incremental fetch complete for 2025-01 (2.03 seconds).
[2025-10-24T18:08:28.642843] [INFO ] [REMOTE    ] CTO: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T18:08:28.947720] [INFO ] [REMOTE    ] CTDD: Fetching primary data for 2025-05.
[2025-10-24T18:08:29.511366] [INFO ] [REMOTE    ] CTOS: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T18:08:29.630761] [INFO ] [REMOTE    ] CTDD: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T18:08:29.747725] [INFO ] [REMOTE    ] CTDD: Fetching primary data for 2025-06.
[2025-10-24T18:08:30.295188] [INFO ] [REMOTE    ] CTDD: Incremental fetch complete for 2025-06 (0.55 seconds).
[2025-10-24T18:08:30.547678] [INFO ] [REMOTE    ] CTO: Fetching primary data for 2025-07.
[2025-10-24T18:08:31.347745] [INFO ] [REMOTE    ] CTRA: Fetching primary data for 2025-02.
[2025-10-24T18:08:31.922555] [INFO ] [REMOTE    ] CTO: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T18:08:32.147682] [INFO ] [REMOTE    ] CTOS: Fetching primary data for 2025-06.
[2025-10-24T18:08:32.947678] [INFO ] [REMOTE    ] CTO: Fetching primary data for 2025-08.
[2025-10-24T18:08:33.115562] [INFO ] [REMOTE    ] CTRA: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T18:08:33.475904] [INFO ] [REMOTE    ] CTOS: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T18:08:33.719354] [INFO ] [REMOTE    ] CTO: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T18:08:33.747621] [INFO ] [REMOTE    ] CTO: Fetching primary data for 2025-09.
[2025-10-24T18:08:34.547682] [INFO ] [REMOTE    ] CTOS: Fetching primary data for 2025-07.
[2025-10-24T18:08:34.924929] [INFO ] [REMOTE    ] CTO: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T18:08:35.347731] [INFO ] [REMOTE    ] CTRA: Fetching primary data for 2025-03.
[2025-10-24T18:08:36.068438] [INFO ] [REMOTE    ] CTOS: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T18:08:36.147626] [INFO ] [REMOTE    ] CTOS: Fetching primary data for 2025-08.
[2025-10-24T18:08:36.947639] [INFO ] [REMOTE    ] CTO: Fetching primary data for 2025-10.
[2025-10-24T18:08:37.024452] [INFO ] [REMOTE    ] CTRA: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T18:08:37.447819] [INFO ] [REMOTE    ] CTOS: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T18:08:37.747639] [INFO ] [REMOTE    ] CTRA: Fetching primary data for 2025-04.
[2025-10-24T18:08:38.388110] [INFO ] [REMOTE    ] CTO: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T18:08:38.393946] [INFO ] [REMOTE    ] CTO: Full fetch complete (41382 records).
[2025-10-24T18:08:38.394046] [DEBUG] [VALIDATOR ] CTO: Validating primary data.
[2025-10-24T18:08:38.550619] [INFO ] [REMOTE    ] CTOS: Fetching primary data for 2025-09.
[2025-10-24T18:08:38.792726] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present.
[2025-10-24T18:08:38.792812] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed.
[2025-10-24T18:08:38.793447] [INFO ] [MAIN      ] CTO: Fetched primary data is valid.
[2025-10-24T18:08:38.793488] [DEBUG] [LOCAL     ] CTO: Saving primary data.
[2025-10-24T18:08:38.793906] [FATAL] [LOCAL     ] CTO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:08:38.793991] [FATAL] [MAIN      ] CTO: Failed to save primary data.
[2025-10-24T18:08:38.794034] [WARN ] [MAIN      ] CTO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:08:38.794105] [INFO ] [LOCAL     ] CTO: Starting deletion of primary data.
[2025-10-24T18:08:38.794164] [DEBUG] [LOCAL     ] CTO: No primary data file found to delete.
[2025-10-24T18:08:38.794200] [INFO ] [LOCAL     ] CTO: Starting deletion of derivative data.
[2025-10-24T18:08:38.794362] [DEBUG] [LOCAL     ] CTO: Deleted derivative data file.
[2025-10-24T18:08:38.794457] [INFO ] [MAIN      ] Update Progress: 547/2366 symbols completed. CTO took 23.0s. Estimated remaining: 3h 48m 7s. Rate: 8.0 symbols/min
[2025-10-24T18:08:38.972355] [INFO ] [MAIN      ] CTRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:08:39.021091] [DEBUG] [LOCAL     ] CTRE: Loaded 49781 existing records from primary storage.
[2025-10-24T18:08:39.021416] [INFO ] [MAIN      ] CTRE: Loaded 49781 existing records.
[2025-10-24T18:08:39.208159] [WARN ] [MAIN      ] CTRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:08:39.208405] [INFO ] [MAIN      ] CTRE: Wiping existing primary data before full refresh.
[2025-10-24T18:08:39.208452] [INFO ] [LOCAL     ] CTRE: Starting deletion of primary data.
[2025-10-24T18:08:39.209476] [DEBUG] [LOCAL     ] CTRE: Deleted primary data file.
[2025-10-24T18:08:39.209537] [INFO ] [MAIN      ] CTRE: Starting full primary refresh.
[2025-10-24T18:08:39.353700] [INFO ] [REMOTE    ] CTDD: Fetching primary data for 2025-07.
[2025-10-24T18:08:39.587745] [INFO ] [REMOTE    ] CTRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:08:39.627995] [INFO ] [REMOTE    ] CTRA: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T18:08:39.860863] [INFO ] [REMOTE    ] CTOS: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T18:08:40.147626] [INFO ] [REMOTE    ] CTRE: Fetching primary data for 2025-01.
[2025-10-24T18:08:40.189926] [INFO ] [REMOTE    ] CTDD: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T18:08:40.947709] [INFO ] [REMOTE    ] CTRA: Fetching primary data for 2025-05.
[2025-10-24T18:08:41.582015] [INFO ] [REMOTE    ] CTRE: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T18:08:41.747772] [INFO ] [REMOTE    ] CTOS: Fetching primary data for 2025-10.
[2025-10-24T18:08:42.547710] [INFO ] [REMOTE    ] CTDD: Fetching primary data for 2025-08.
[2025-10-24T18:08:42.873469] [INFO ] [REMOTE    ] CTRA: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T18:08:43.093283] [INFO ] [REMOTE    ] CTOS: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T18:08:43.100854] [INFO ] [REMOTE    ] CTOS: Full fetch complete (53978 records).
[2025-10-24T18:08:43.100963] [DEBUG] [VALIDATOR ] CTOS: Validating primary data.
[2025-10-24T18:08:43.282567] [INFO ] [REMOTE    ] CTDD: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T18:08:43.353728] [INFO ] [REMOTE    ] CTRE: Fetching primary data for 2025-02.
[2025-10-24T18:08:43.491684] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present.
[2025-10-24T18:08:43.491776] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed.
[2025-10-24T18:08:43.492514] [INFO ] [MAIN      ] CTOS: Fetched primary data is valid.
[2025-10-24T18:08:43.492555] [DEBUG] [LOCAL     ] CTOS: Saving primary data.
[2025-10-24T18:08:43.493038] [FATAL] [LOCAL     ] CTOS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:08:43.493128] [FATAL] [MAIN      ] CTOS: Failed to save primary data.
[2025-10-24T18:08:43.493169] [WARN ] [MAIN      ] CTOS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:08:43.493205] [INFO ] [LOCAL     ] CTOS: Starting deletion of primary data.
[2025-10-24T18:08:43.493256] [DEBUG] [LOCAL     ] CTOS: No primary data file found to delete.
[2025-10-24T18:08:43.493290] [INFO ] [LOCAL     ] CTOS: Starting deletion of derivative data.
[2025-10-24T18:08:43.493438] [DEBUG] [LOCAL     ] CTOS: Deleted derivative data file.
[2025-10-24T18:08:43.493870] [INFO ] [MAIN      ] Update Progress: 548/2366 symbols completed. CTOS took 27.3s. Estimated remaining: 3h 47m 50s. Rate: 8.0 symbols/min
[2025-10-24T18:08:43.664136] [INFO ] [MAIN      ] CTRI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:08:43.712415] [DEBUG] [LOCAL     ] CTRI: Loaded 41115 existing records from primary storage.
[2025-10-24T18:08:43.712793] [INFO ] [MAIN      ] CTRI: Loaded 41115 existing records.
[2025-10-24T18:08:43.920578] [WARN ] [MAIN      ] CTRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:08:43.920806] [INFO ] [MAIN      ] CTRI: Wiping existing primary data before full refresh.
[2025-10-24T18:08:43.920855] [INFO ] [LOCAL     ] CTRI: Starting deletion of primary data.
[2025-10-24T18:08:43.921045] [DEBUG] [LOCAL     ] CTRI: Deleted primary data file.
[2025-10-24T18:08:43.921084] [INFO ] [MAIN      ] CTRI: Starting full primary refresh.
[2025-10-24T18:08:44.152921] [INFO ] [REMOTE    ] CTDD: Fetching primary data for 2025-09.
[2025-10-24T18:08:44.290965] [INFO ] [REMOTE    ] CTRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:08:44.826341] [INFO ] [REMOTE    ] CTDD: Incremental fetch complete for 2025-09 (0.67 seconds).
[2025-10-24T18:08:44.953484] [INFO ] [REMOTE    ] CTRI: Fetching primary data for 2025-01.
[2025-10-24T18:08:44.958603] [INFO ] [REMOTE    ] CTRE: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T18:08:45.747706] [INFO ] [REMOTE    ] CTDD: Fetching primary data for 2025-10.
[2025-10-24T18:08:46.305595] [INFO ] [REMOTE    ] CTRI: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T18:08:46.460093] [INFO ] [REMOTE    ] CTDD: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T18:08:46.461257] [INFO ] [REMOTE    ] CTDD: Full fetch complete (7883 records).
[2025-10-24T18:08:46.461326] [DEBUG] [VALIDATOR ] CTDD: Validating primary data.
[2025-10-24T18:08:46.552834] [INFO ] [REMOTE    ] CTRE: Fetching primary data for 2025-03.
[2025-10-24T18:08:46.818451] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present.
[2025-10-24T18:08:46.818550] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed.
[2025-10-24T18:08:46.818776] [INFO ] [MAIN      ] CTDD: Fetched primary data is valid.
[2025-10-24T18:08:46.818838] [DEBUG] [LOCAL     ] CTDD: Saving primary data.
[2025-10-24T18:08:46.819031] [FATAL] [LOCAL     ] CTDD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:08:46.819111] [FATAL] [MAIN      ] CTDD: Failed to save primary data.
[2025-10-24T18:08:46.819153] [WARN ] [MAIN      ] CTDD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:08:46.819188] [INFO ] [LOCAL     ] CTDD: Starting deletion of primary data.
[2025-10-24T18:08:46.819238] [DEBUG] [LOCAL     ] CTDD: No primary data file found to delete.
[2025-10-24T18:08:46.819274] [INFO ] [LOCAL     ] CTDD: Starting deletion of derivative data.
[2025-10-24T18:08:46.819405] [DEBUG] [LOCAL     ] CTDD: Deleted derivative data file.
[2025-10-24T18:08:46.819474] [INFO ] [MAIN      ] Update Progress: 549/2366 symbols completed. CTDD took 39.3s. Estimated remaining: 3h 47m 29s. Rate: 8.0 symbols/min
[2025-10-24T18:08:46.986590] [INFO ] [MAIN      ] CTS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:08:47.006585] [DEBUG] [LOCAL     ] CTS: Loaded 19655 existing records from primary storage.
[2025-10-24T18:08:47.006895] [INFO ] [MAIN      ] CTS: Loaded 19655 existing records.
[2025-10-24T18:08:47.183342] [WARN ] [MAIN      ] CTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:08:47.183535] [INFO ] [MAIN      ] CTS: Wiping existing primary data before full refresh.
[2025-10-24T18:08:47.183579] [INFO ] [LOCAL     ] CTS: Starting deletion of primary data.
[2025-10-24T18:08:47.183784] [DEBUG] [LOCAL     ] CTS: Deleted primary data file.
[2025-10-24T18:08:47.183838] [INFO ] [MAIN      ] CTS: Starting full primary refresh.
[2025-10-24T18:08:47.355800] [INFO ] [REMOTE    ] CTRA: Fetching primary data for 2025-06.
[2025-10-24T18:08:47.538067] [INFO ] [REMOTE    ] CTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:08:48.147627] [INFO ] [REMOTE    ] CTRI: Fetching primary data for 2025-02.
[2025-10-24T18:08:48.234529] [INFO ] [REMOTE    ] CTRE: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T18:08:48.947711] [INFO ] [REMOTE    ] CTRE: Fetching primary data for 2025-04.
[2025-10-24T18:08:49.061884] [INFO ] [REMOTE    ] CTRI: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T18:08:49.309805] [INFO ] [REMOTE    ] CTRA: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T18:08:49.747723] [INFO ] [REMOTE    ] CTS: Fetching primary data for 2025-01.
[2025-10-24T18:08:50.547767] [INFO ] [REMOTE    ] CTRA: Fetching primary data for 2025-07.
[2025-10-24T18:08:50.665946] [INFO ] [REMOTE    ] CTRE: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T18:08:50.834346] [INFO ] [REMOTE    ] CTS: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T18:08:51.347629] [INFO ] [REMOTE    ] CTRE: Fetching primary data for 2025-05.
[2025-10-24T18:08:52.147717] [INFO ] [REMOTE    ] CTRI: Fetching primary data for 2025-03.
[2025-10-24T18:08:52.519068] [INFO ] [REMOTE    ] CTRA: Incremental fetch complete for 2025-07 (1.97 seconds).
[2025-10-24T18:08:52.901975] [INFO ] [REMOTE    ] CTRI: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T18:08:52.947606] [INFO ] [REMOTE    ] CTRI: Fetching primary data for 2025-04.
[2025-10-24T18:08:53.015908] [INFO ] [REMOTE    ] CTRE: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T18:08:53.747716] [INFO ] [REMOTE    ] CTRA: Fetching primary data for 2025-08.
[2025-10-24T18:08:54.302746] [INFO ] [REMOTE    ] CTRI: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T18:08:54.547716] [INFO ] [REMOTE    ] CTRI: Fetching primary data for 2025-05.
[2025-10-24T18:08:55.347694] [INFO ] [REMOTE    ] CTRE: Fetching primary data for 2025-06.
[2025-10-24T18:08:55.595493] [INFO ] [REMOTE    ] CTRA: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T18:08:55.664191] [INFO ] [REMOTE    ] CTRI: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T18:08:56.147673] [INFO ] [REMOTE    ] CTRI: Fetching primary data for 2025-06.
[2025-10-24T18:08:56.881354] [INFO ] [REMOTE    ] CTRE: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T18:08:56.947616] [INFO ] [REMOTE    ] CTRA: Fetching primary data for 2025-09.
[2025-10-24T18:08:57.584439] [INFO ] [REMOTE    ] CTRI: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T18:08:57.747725] [INFO ] [REMOTE    ] CTRI: Fetching primary data for 2025-07.
[2025-10-24T18:08:58.547728] [INFO ] [REMOTE    ] CTS: Fetching primary data for 2025-02.
[2025-10-24T18:08:58.634031] [INFO ] [REMOTE    ] CTRA: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T18:08:58.711403] [INFO ] [REMOTE    ] CTRI: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T18:08:59.094595] [INFO ] [REMOTE    ] CTS: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T18:08:59.347662] [INFO ] [REMOTE    ] CTRI: Fetching primary data for 2025-08.
[2025-10-24T18:09:00.147689] [INFO ] [REMOTE    ] CTRE: Fetching primary data for 2025-07.
[2025-10-24T18:09:00.947686] [INFO ] [REMOTE    ] CTRA: Fetching primary data for 2025-10.
[2025-10-24T18:09:01.594788] [INFO ] [REMOTE    ] CTRI: Incremental fetch complete for 2025-08 (2.25 seconds).
[2025-10-24T18:09:01.747726] [INFO ] [REMOTE    ] CTRI: Fetching primary data for 2025-09.
[2025-10-24T18:09:02.440996] [INFO ] [REMOTE    ] CTRE: Incremental fetch complete for 2025-07 (2.29 seconds).
[2025-10-24T18:09:02.547688] [INFO ] [REMOTE    ] CTRE: Fetching primary data for 2025-08.
[2025-10-24T18:09:03.347669] [INFO ] [REMOTE    ] CTS: Fetching primary data for 2025-03.
[2025-10-24T18:09:04.064958] [INFO ] [REMOTE    ] CTRA: Incremental fetch complete for 2025-10 (3.12 seconds).
[2025-10-24T18:09:04.076120] [INFO ] [REMOTE    ] CTRA: Full fetch complete (77820 records).
[2025-10-24T18:09:04.076353] [DEBUG] [VALIDATOR ] CTRA: Validating primary data.
[2025-10-24T18:09:04.521256] [INFO ] [REMOTE    ] CTRI: Incremental fetch complete for 2025-09 (2.77 seconds).
[2025-10-24T18:09:04.592934] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present.
[2025-10-24T18:09:04.593360] [INFO ] [REMOTE    ] CTRI: Fetching primary data for 2025-10.
[2025-10-24T18:09:04.594241] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed.
[2025-10-24T18:09:04.595211] [INFO ] [MAIN      ] CTRA: Fetched primary data is valid.
[2025-10-24T18:09:04.595275] [DEBUG] [LOCAL     ] CTRA: Saving primary data.
[2025-10-24T18:09:04.595862] [FATAL] [LOCAL     ] CTRA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:09:04.595949] [FATAL] [MAIN      ] CTRA: Failed to save primary data.
[2025-10-24T18:09:04.595990] [WARN ] [MAIN      ] CTRA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:09:04.596052] [INFO ] [LOCAL     ] CTRA: Starting deletion of primary data.
[2025-10-24T18:09:04.596133] [DEBUG] [LOCAL     ] CTRA: No primary data file found to delete.
[2025-10-24T18:09:04.596188] [INFO ] [LOCAL     ] CTRA: Starting deletion of derivative data.
[2025-10-24T18:09:04.596346] [DEBUG] [LOCAL     ] CTRA: Deleted derivative data file.
[2025-10-24T18:09:04.596926] [INFO ] [MAIN      ] Update Progress: 550/2366 symbols completed. CTRA took 39.4s. Estimated remaining: 3h 47m 55s. Rate: 8.0 symbols/min
[2025-10-24T18:09:04.783268] [INFO ] [MAIN      ] CTVA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:09:04.813091] [INFO ] [REMOTE    ] CTRE: Incremental fetch complete for 2025-08 (2.27 seconds).
[2025-10-24T18:09:04.871796] [DEBUG] [LOCAL     ] CTVA: Loaded 53693 existing records from primary storage.
[2025-10-24T18:09:04.872126] [INFO ] [MAIN      ] CTVA: Loaded 53693 existing records.
[2025-10-24T18:09:04.952776] [INFO ] [REMOTE    ] CTRE: Fetching primary data for 2025-09.
[2025-10-24T18:09:05.064326] [WARN ] [MAIN      ] CTVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:09:05.064684] [INFO ] [MAIN      ] CTVA: Wiping existing primary data before full refresh.
[2025-10-24T18:09:05.064790] [INFO ] [LOCAL     ] CTVA: Starting deletion of primary data.
[2025-10-24T18:09:05.065200] [DEBUG] [LOCAL     ] CTVA: Deleted primary data file.
[2025-10-24T18:09:05.065259] [INFO ] [MAIN      ] CTVA: Starting full primary refresh.
[2025-10-24T18:09:05.217464] [INFO ] [REMOTE    ] CTS: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T18:09:05.468068] [INFO ] [REMOTE    ] CTVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:09:05.747676] [INFO ] [REMOTE    ] CTS: Fetching primary data for 2025-04.
[2025-10-24T18:09:06.479736] [INFO ] [REMOTE    ] CTRE: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T18:09:06.547601] [INFO ] [REMOTE    ] CTRE: Fetching primary data for 2025-10.
[2025-10-24T18:09:06.857289] [INFO ] [REMOTE    ] CTS: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T18:09:07.032968] [INFO ] [REMOTE    ] CTRI: Incremental fetch complete for 2025-10 (2.44 seconds).
[2025-10-24T18:09:07.041677] [INFO ] [REMOTE    ] CTRI: Full fetch complete (54402 records).
[2025-10-24T18:09:07.041803] [DEBUG] [VALIDATOR ] CTRI: Validating primary data.
[2025-10-24T18:09:07.042443] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:09:07.042525] [FATAL] [MAIN      ] CTRI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:09:07.042569] [WARN ] [MAIN      ] CTRI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:09:07.042613] [INFO ] [LOCAL     ] CTRI: Starting deletion of primary data.
[2025-10-24T18:09:07.042718] [DEBUG] [LOCAL     ] CTRI: No primary data file found to delete.
[2025-10-24T18:09:07.042778] [INFO ] [LOCAL     ] CTRI: Starting deletion of derivative data.
[2025-10-24T18:09:07.042904] [DEBUG] [LOCAL     ] CTRI: Deleted derivative data file.
[2025-10-24T18:09:07.043758] [INFO ] [MAIN      ] Update Progress: 551/2366 symbols completed. CTRI took 23.5s. Estimated remaining: 3h 47m 31s. Rate: 8.0 symbols/min
[2025-10-24T18:09:07.216017] [INFO ] [MAIN      ] CUBB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:09:07.216179] [DEBUG] [LOCAL     ] CUBB: No existing data file found in primary storage.
[2025-10-24T18:09:07.216216] [WARN ] [MAIN      ] CUBB: No existing data found, performing full refresh instead.
[2025-10-24T18:09:07.216327] [INFO ] [MAIN      ] CUBB: Wiping existing primary data before full refresh.
[2025-10-24T18:09:07.216373] [INFO ] [LOCAL     ] CUBB: Starting deletion of primary data.
[2025-10-24T18:09:07.216414] [DEBUG] [LOCAL     ] CUBB: No primary data file found to delete.
[2025-10-24T18:09:07.216445] [INFO ] [MAIN      ] CUBB: Starting full primary refresh.
[2025-10-24T18:09:07.356405] [INFO ] [REMOTE    ] CTS: Fetching primary data for 2025-05.
[2025-10-24T18:09:07.582412] [INFO ] [REMOTE    ] CUBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:09:08.147734] [INFO ] [REMOTE    ] CTVA: Fetching primary data for 2025-01.
[2025-10-24T18:09:08.364464] [INFO ] [REMOTE    ] CTRE: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T18:09:08.373824] [INFO ] [REMOTE    ] CTRE: Full fetch complete (71337 records).
[2025-10-24T18:09:08.373974] [DEBUG] [VALIDATOR ] CTRE: Validating primary data.
[2025-10-24T18:09:08.686598] [INFO ] [REMOTE    ] CTS: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T18:09:08.783233] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present.
[2025-10-24T18:09:08.783340] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed.
[2025-10-24T18:09:08.784200] [INFO ] [MAIN      ] CTRE: Fetched primary data is valid.
[2025-10-24T18:09:08.784265] [DEBUG] [LOCAL     ] CTRE: Saving primary data.
[2025-10-24T18:09:08.784900] [FATAL] [LOCAL     ] CTRE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:09:08.784998] [FATAL] [MAIN      ] CTRE: Failed to save primary data.
[2025-10-24T18:09:08.785040] [WARN ] [MAIN      ] CTRE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:09:08.785075] [INFO ] [LOCAL     ] CTRE: Starting deletion of primary data.
[2025-10-24T18:09:08.785130] [DEBUG] [LOCAL     ] CTRE: No primary data file found to delete.
[2025-10-24T18:09:08.785164] [INFO ] [LOCAL     ] CTRE: Starting deletion of derivative data.
[2025-10-24T18:09:08.785294] [DEBUG] [LOCAL     ] CTRE: Deleted derivative data file.
[2025-10-24T18:09:08.785578] [INFO ] [MAIN      ] Update Progress: 552/2366 symbols completed. CTRE took 30.0s. Estimated remaining: 3h 47m 4s. Rate: 8.0 symbols/min
[2025-10-24T18:09:08.950614] [INFO ] [REMOTE    ] CUBB: Fetching primary data for 2025-01.
[2025-10-24T18:09:08.959147] [INFO ] [MAIN      ] CUBE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:09:09.008776] [DEBUG] [LOCAL     ] CUBE: Loaded 51249 existing records from primary storage.
[2025-10-24T18:09:09.009064] [INFO ] [MAIN      ] CUBE: Loaded 51249 existing records.
[2025-10-24T18:09:09.184930] [WARN ] [MAIN      ] CUBE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:09:09.185115] [INFO ] [MAIN      ] CUBE: Wiping existing primary data before full refresh.
[2025-10-24T18:09:09.185160] [INFO ] [LOCAL     ] CUBE: Starting deletion of primary data.
[2025-10-24T18:09:09.185368] [DEBUG] [LOCAL     ] CUBE: Deleted primary data file.
[2025-10-24T18:09:09.185427] [INFO ] [MAIN      ] CUBE: Starting full primary refresh.
[2025-10-24T18:09:09.442291] [INFO ] [REMOTE    ] CUBB: Incremental fetch complete for 2025-01 (0.49 seconds).
[2025-10-24T18:09:09.541620] [INFO ] [REMOTE    ] CUBE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:09:09.679935] [INFO ] [REMOTE    ] CTVA: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T18:09:09.747616] [INFO ] [REMOTE    ] CUBE: Fetching primary data for 2025-01.
[2025-10-24T18:09:10.547682] [INFO ] [REMOTE    ] CUBB: Fetching primary data for 2025-02.
[2025-10-24T18:09:10.910505] [INFO ] [REMOTE    ] CUBB: Incremental fetch complete for 2025-02 (0.36 seconds).
[2025-10-24T18:09:11.347631] [INFO ] [REMOTE    ] CTS: Fetching primary data for 2025-06.
[2025-10-24T18:09:11.629748] [INFO ] [REMOTE    ] CUBE: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T18:09:11.939522] [INFO ] [REMOTE    ] CTS: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T18:09:12.147633] [INFO ] [REMOTE    ] CTS: Fetching primary data for 2025-07.
[2025-10-24T18:09:12.947679] [INFO ] [REMOTE    ] CUBE: Fetching primary data for 2025-02.
[2025-10-24T18:09:13.031149] [INFO ] [REMOTE    ] CTS: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T18:09:13.747705] [INFO ] [REMOTE    ] CTS: Fetching primary data for 2025-08.
[2025-10-24T18:09:14.344921] [INFO ] [REMOTE    ] CUBE: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T18:09:14.547686] [INFO ] [REMOTE    ] CTVA: Fetching primary data for 2025-02.
[2025-10-24T18:09:14.620284] [INFO ] [REMOTE    ] CTS: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T18:09:15.347698] [INFO ] [REMOTE    ] CUBE: Fetching primary data for 2025-03.
[2025-10-24T18:09:15.709757] [INFO ] [REMOTE    ] CTVA: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T18:09:16.147679] [INFO ] [REMOTE    ] CTS: Fetching primary data for 2025-09.
[2025-10-24T18:09:16.947700] [INFO ] [REMOTE    ] CUBB: Fetching primary data for 2025-03.
[2025-10-24T18:09:17.176343] [INFO ] [REMOTE    ] CUBE: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T18:09:17.296354] [INFO ] [REMOTE    ] CUBB: Incremental fetch complete for 2025-03 (0.35 seconds).
[2025-10-24T18:09:17.488934] [INFO ] [REMOTE    ] CTS: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T18:09:17.747686] [INFO ] [REMOTE    ] CUBE: Fetching primary data for 2025-04.
[2025-10-24T18:09:18.547730] [INFO ] [REMOTE    ] CUBB: Fetching primary data for 2025-04.
[2025-10-24T18:09:18.905214] [INFO ] [REMOTE    ] CUBB: Incremental fetch complete for 2025-04 (0.36 seconds).
[2025-10-24T18:09:19.347708] [INFO ] [REMOTE    ] CUBB: Fetching primary data for 2025-05.
[2025-10-24T18:09:19.553259] [INFO ] [REMOTE    ] CUBE: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T18:09:19.760778] [INFO ] [REMOTE    ] CUBB: Incremental fetch complete for 2025-05 (0.41 seconds).
[2025-10-24T18:09:20.147692] [INFO ] [REMOTE    ] CTS: Fetching primary data for 2025-10.
[2025-10-24T18:09:20.947710] [INFO ] [REMOTE    ] CUBB: Fetching primary data for 2025-06.
[2025-10-24T18:09:21.178970] [INFO ] [REMOTE    ] CUBB: Incremental fetch complete for 2025-06 (0.23 seconds).
[2025-10-24T18:09:21.508570] [INFO ] [REMOTE    ] CTS: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T18:09:21.512976] [INFO ] [REMOTE    ] CTS: Full fetch complete (27407 records).
[2025-10-24T18:09:21.513092] [DEBUG] [VALIDATOR ] CTS: Validating primary data.
[2025-10-24T18:09:21.755373] [INFO ] [REMOTE    ] CTVA: Fetching primary data for 2025-03.
[2025-10-24T18:09:21.926193] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present.
[2025-10-24T18:09:21.926356] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed.
[2025-10-24T18:09:21.928310] [INFO ] [MAIN      ] CTS: Fetched primary data is valid.
[2025-10-24T18:09:21.928389] [DEBUG] [LOCAL     ] CTS: Saving primary data.
[2025-10-24T18:09:21.929108] [FATAL] [LOCAL     ] CTS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:09:21.929202] [FATAL] [MAIN      ] CTS: Failed to save primary data.
[2025-10-24T18:09:21.929248] [WARN ] [MAIN      ] CTS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:09:21.929299] [INFO ] [LOCAL     ] CTS: Starting deletion of primary data.
[2025-10-24T18:09:21.929362] [DEBUG] [LOCAL     ] CTS: No primary data file found to delete.
[2025-10-24T18:09:21.929402] [INFO ] [LOCAL     ] CTS: Starting deletion of derivative data.
[2025-10-24T18:09:21.929618] [DEBUG] [LOCAL     ] CTS: Deleted derivative data file.
[2025-10-24T18:09:21.929770] [INFO ] [MAIN      ] Update Progress: 553/2366 symbols completed. CTS took 35.1s. Estimated remaining: 3h 47m 15s. Rate: 8.0 symbols/min
[2025-10-24T18:09:22.115771] [INFO ] [MAIN      ] CUBI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:09:22.144259] [DEBUG] [LOCAL     ] CUBI: Loaded 27213 existing records from primary storage.
[2025-10-24T18:09:22.144576] [INFO ] [MAIN      ] CUBI: Loaded 27213 existing records.
[2025-10-24T18:09:22.397193] [WARN ] [MAIN      ] CUBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:09:22.397464] [INFO ] [MAIN      ] CUBI: Wiping existing primary data before full refresh.
[2025-10-24T18:09:22.397532] [INFO ] [LOCAL     ] CUBI: Starting deletion of primary data.
[2025-10-24T18:09:22.397847] [DEBUG] [LOCAL     ] CUBI: Deleted primary data file.
[2025-10-24T18:09:22.397905] [INFO ] [MAIN      ] CUBI: Starting full primary refresh.
[2025-10-24T18:09:22.552926] [INFO ] [REMOTE    ] CUBE: Fetching primary data for 2025-05.
[2025-10-24T18:09:22.870713] [INFO ] [REMOTE    ] CUBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:09:23.347728] [INFO ] [REMOTE    ] CUBI: Fetching primary data for 2025-01.
[2025-10-24T18:09:23.645575] [INFO ] [REMOTE    ] CTVA: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T18:09:24.147673] [INFO ] [REMOTE    ] CTVA: Fetching primary data for 2025-04.
[2025-10-24T18:09:24.458394] [INFO ] [REMOTE    ] CUBE: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T18:09:24.693343] [INFO ] [REMOTE    ] CUBI: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T18:09:24.947680] [INFO ] [REMOTE    ] CUBB: Fetching primary data for 2025-07.
[2025-10-24T18:09:25.280986] [INFO ] [REMOTE    ] CUBB: Incremental fetch complete for 2025-07 (0.33 seconds).
[2025-10-24T18:09:25.587036] [INFO ] [REMOTE    ] CTVA: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T18:09:25.747605] [INFO ] [REMOTE    ] CTVA: Fetching primary data for 2025-05.
[2025-10-24T18:09:26.547687] [INFO ] [REMOTE    ] CUBB: Fetching primary data for 2025-08.
[2025-10-24T18:09:26.885588] [INFO ] [REMOTE    ] CUBB: Incremental fetch complete for 2025-08 (0.34 seconds).
[2025-10-24T18:09:27.347715] [INFO ] [REMOTE    ] CUBB: Fetching primary data for 2025-09.
[2025-10-24T18:09:27.593803] [INFO ] [REMOTE    ] CUBB: Incremental fetch complete for 2025-09 (0.25 seconds).
[2025-10-24T18:09:27.648680] [INFO ] [REMOTE    ] CTVA: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T18:09:28.147677] [INFO ] [REMOTE    ] CUBB: Fetching primary data for 2025-10.
[2025-10-24T18:09:28.640356] [INFO ] [REMOTE    ] CUBB: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T18:09:28.641137] [INFO ] [REMOTE    ] CUBB: Full fetch complete (956 records).
[2025-10-24T18:09:28.641220] [DEBUG] [VALIDATOR ] CUBB: Validating primary data.
[2025-10-24T18:09:28.847007] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 183 unique days, need 200 days
[2025-10-24T18:09:28.847241] [FATAL] [MAIN      ] CUBB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:09:28.847315] [WARN ] [MAIN      ] CUBB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:09:28.847391] [INFO ] [LOCAL     ] CUBB: Starting deletion of primary data.
[2025-10-24T18:09:28.847453] [DEBUG] [LOCAL     ] CUBB: No primary data file found to delete.
[2025-10-24T18:09:28.847490] [INFO ] [LOCAL     ] CUBB: Starting deletion of derivative data.
[2025-10-24T18:09:28.847529] [DEBUG] [LOCAL     ] CUBB: No derivative data file found to delete.
[2025-10-24T18:09:28.847585] [INFO ] [MAIN      ] Update Progress: 554/2366 symbols completed. CUBB took 21.8s. Estimated remaining: 3h 47m 6s. Rate: 8.0 symbols/min
[2025-10-24T18:09:28.949483] [INFO ] [REMOTE    ] CUBE: Fetching primary data for 2025-06.
[2025-10-24T18:09:29.017786] [INFO ] [MAIN      ] CUK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:09:29.069472] [DEBUG] [LOCAL     ] CUK: Loaded 51440 existing records from primary storage.
[2025-10-24T18:09:29.069816] [INFO ] [MAIN      ] CUK: Loaded 51440 existing records.
[2025-10-24T18:09:29.244007] [WARN ] [MAIN      ] CUK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:09:29.244217] [INFO ] [MAIN      ] CUK: Wiping existing primary data before full refresh.
[2025-10-24T18:09:29.244264] [INFO ] [LOCAL     ] CUK: Starting deletion of primary data.
[2025-10-24T18:09:29.244547] [DEBUG] [LOCAL     ] CUK: Deleted primary data file.
[2025-10-24T18:09:29.244602] [INFO ] [MAIN      ] CUK: Starting full primary refresh.
[2025-10-24T18:09:29.619357] [INFO ] [REMOTE    ] CUK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:09:29.747707] [INFO ] [REMOTE    ] CUK: Fetching primary data for 2025-01.
[2025-10-24T18:09:30.434461] [INFO ] [REMOTE    ] CUBE: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T18:09:30.547618] [INFO ] [REMOTE    ] CUBI: Fetching primary data for 2025-02.
[2025-10-24T18:09:31.326876] [INFO ] [REMOTE    ] CUK: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T18:09:31.347599] [INFO ] [REMOTE    ] CTVA: Fetching primary data for 2025-06.
[2025-10-24T18:09:31.592156] [INFO ] [REMOTE    ] CUBI: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T18:09:32.147666] [INFO ] [REMOTE    ] CUBI: Fetching primary data for 2025-03.
[2025-10-24T18:09:32.769837] [INFO ] [REMOTE    ] CTVA: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T18:09:32.904628] [INFO ] [REMOTE    ] CUBI: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T18:09:32.947686] [INFO ] [REMOTE    ] CUBI: Fetching primary data for 2025-04.
[2025-10-24T18:09:33.747620] [INFO ] [REMOTE    ] CUBE: Fetching primary data for 2025-07.
[2025-10-24T18:09:33.975133] [INFO ] [REMOTE    ] CUBI: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T18:09:34.547691] [INFO ] [REMOTE    ] CUK: Fetching primary data for 2025-02.
[2025-10-24T18:09:35.347629] [INFO ] [REMOTE    ] CTVA: Fetching primary data for 2025-07.
[2025-10-24T18:09:35.656384] [INFO ] [REMOTE    ] CUBE: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T18:09:36.147701] [INFO ] [REMOTE    ] CUBE: Fetching primary data for 2025-08.
[2025-10-24T18:09:36.257289] [INFO ] [REMOTE    ] CUK: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T18:09:36.947697] [INFO ] [REMOTE    ] CUK: Fetching primary data for 2025-03.
[2025-10-24T18:09:37.032867] [INFO ] [REMOTE    ] CTVA: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T18:09:37.747686] [INFO ] [REMOTE    ] CTVA: Fetching primary data for 2025-08.
[2025-10-24T18:09:37.907783] [INFO ] [REMOTE    ] CUBE: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T18:09:38.547707] [INFO ] [REMOTE    ] CUBE: Fetching primary data for 2025-09.
[2025-10-24T18:09:38.905572] [INFO ] [REMOTE    ] CUK: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T18:09:39.214086] [INFO ] [REMOTE    ] CTVA: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T18:09:39.347690] [INFO ] [REMOTE    ] CUBI: Fetching primary data for 2025-05.
[2025-10-24T18:09:40.008845] [INFO ] [REMOTE    ] CUBE: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T18:09:40.086537] [INFO ] [REMOTE    ] CUBI: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T18:09:40.147608] [INFO ] [REMOTE    ] CUBI: Fetching primary data for 2025-06.
[2025-10-24T18:09:40.947725] [INFO ] [REMOTE    ] CUBE: Fetching primary data for 2025-10.
[2025-10-24T18:09:41.155024] [INFO ] [REMOTE    ] CUBI: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T18:09:41.747678] [INFO ] [REMOTE    ] CTVA: Fetching primary data for 2025-09.
[2025-10-24T18:09:42.547633] [INFO ] [REMOTE    ] CUBI: Fetching primary data for 2025-07.
[2025-10-24T18:09:42.871990] [INFO ] [REMOTE    ] CUBE: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T18:09:42.881505] [INFO ] [REMOTE    ] CUBE: Full fetch complete (73333 records).
[2025-10-24T18:09:42.881678] [DEBUG] [VALIDATOR ] CUBE: Validating primary data.
[2025-10-24T18:09:43.271320] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present.
[2025-10-24T18:09:43.271462] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed.
[2025-10-24T18:09:43.272358] [INFO ] [MAIN      ] CUBE: Fetched primary data is valid.
[2025-10-24T18:09:43.272515] [DEBUG] [LOCAL     ] CUBE: Saving primary data.
[2025-10-24T18:09:43.273223] [FATAL] [LOCAL     ] CUBE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:09:43.273421] [FATAL] [MAIN      ] CUBE: Failed to save primary data.
[2025-10-24T18:09:43.273501] [WARN ] [MAIN      ] CUBE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:09:43.273723] [INFO ] [LOCAL     ] CUBE: Starting deletion of primary data.
[2025-10-24T18:09:43.273854] [DEBUG] [LOCAL     ] CUBE: No primary data file found to delete.
[2025-10-24T18:09:43.273948] [INFO ] [LOCAL     ] CUBE: Starting deletion of derivative data.
[2025-10-24T18:09:43.274393] [DEBUG] [LOCAL     ] CUBE: Deleted derivative data file.
[2025-10-24T18:09:43.275218] [INFO ] [MAIN      ] Update Progress: 555/2366 symbols completed. CUBE took 34.5s. Estimated remaining: 3h 47m 21s. Rate: 8.0 symbols/min
[2025-10-24T18:09:43.351566] [INFO ] [REMOTE    ] CUK: Fetching primary data for 2025-04.
[2025-10-24T18:09:43.466187] [INFO ] [REMOTE    ] CTVA: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T18:09:43.503485] [INFO ] [MAIN      ] CULP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:09:43.509418] [DEBUG] [LOCAL     ] CULP: Loaded 2847 existing records from primary storage.
[2025-10-24T18:09:43.509637] [INFO ] [MAIN      ] CULP: Loaded 2847 existing records.
[2025-10-24T18:09:43.687734] [WARN ] [MAIN      ] CULP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:09:43.688209] [INFO ] [MAIN      ] CULP: Wiping existing primary data before full refresh.
[2025-10-24T18:09:43.688493] [INFO ] [LOCAL     ] CULP: Starting deletion of primary data.
[2025-10-24T18:09:43.688873] [DEBUG] [LOCAL     ] CULP: Deleted primary data file.
[2025-10-24T18:09:43.688933] [INFO ] [MAIN      ] CULP: Starting full primary refresh.
[2025-10-24T18:09:43.859095] [INFO ] [REMOTE    ] CUBI: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T18:09:44.071821] [INFO ] [REMOTE    ] CULP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:09:44.147631] [INFO ] [REMOTE    ] CULP: Fetching primary data for 2025-01.
[2025-10-24T18:09:44.853737] [INFO ] [REMOTE    ] CULP: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T18:09:44.947696] [INFO ] [REMOTE    ] CTVA: Fetching primary data for 2025-10.
[2025-10-24T18:09:45.579686] [INFO ] [REMOTE    ] CUK: Incremental fetch complete for 2025-04 (2.23 seconds).
[2025-10-24T18:09:45.747695] [INFO ] [REMOTE    ] CUBI: Fetching primary data for 2025-08.
[2025-10-24T18:09:46.547716] [INFO ] [REMOTE    ] CUK: Fetching primary data for 2025-05.
[2025-10-24T18:09:46.863558] [INFO ] [REMOTE    ] CTVA: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T18:09:46.873886] [INFO ] [REMOTE    ] CTVA: Full fetch complete (77234 records).
[2025-10-24T18:09:46.874305] [DEBUG] [VALIDATOR ] CTVA: Validating primary data.
[2025-10-24T18:09:46.899265] [INFO ] [REMOTE    ] CUBI: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T18:09:47.285115] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present.
[2025-10-24T18:09:47.285193] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed.
[2025-10-24T18:09:47.286029] [INFO ] [MAIN      ] CTVA: Fetched primary data is valid.
[2025-10-24T18:09:47.286092] [DEBUG] [LOCAL     ] CTVA: Saving primary data.
[2025-10-24T18:09:47.286702] [FATAL] [LOCAL     ] CTVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:09:47.286791] [FATAL] [MAIN      ] CTVA: Failed to save primary data.
[2025-10-24T18:09:47.286832] [WARN ] [MAIN      ] CTVA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:09:47.286867] [INFO ] [LOCAL     ] CTVA: Starting deletion of primary data.
[2025-10-24T18:09:47.286916] [DEBUG] [LOCAL     ] CTVA: No primary data file found to delete.
[2025-10-24T18:09:47.286951] [INFO ] [LOCAL     ] CTVA: Starting deletion of derivative data.
[2025-10-24T18:09:47.287092] [DEBUG] [LOCAL     ] CTVA: Deleted derivative data file.
[2025-10-24T18:09:47.287734] [INFO ] [MAIN      ] Update Progress: 556/2366 symbols completed. CTVA took 42.7s. Estimated remaining: 3h 47m 2s. Rate: 8.0 symbols/min
[2025-10-24T18:09:47.352983] [INFO ] [REMOTE    ] CUBI: Fetching primary data for 2025-09.
[2025-10-24T18:09:47.456095] [INFO ] [MAIN      ] CURB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:09:47.490301] [DEBUG] [LOCAL     ] CURB: Loaded 33062 existing records from primary storage.
[2025-10-24T18:09:47.490556] [INFO ] [MAIN      ] CURB: Loaded 33062 existing records.
[2025-10-24T18:09:47.665042] [WARN ] [MAIN      ] CURB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:09:47.665297] [INFO ] [MAIN      ] CURB: Wiping existing primary data before full refresh.
[2025-10-24T18:09:47.665344] [INFO ] [LOCAL     ] CURB: Starting deletion of primary data.
[2025-10-24T18:09:47.665725] [DEBUG] [LOCAL     ] CURB: Deleted primary data file.
[2025-10-24T18:09:47.665783] [INFO ] [MAIN      ] CURB: Starting full primary refresh.
[2025-10-24T18:09:48.011294] [INFO ] [REMOTE    ] CURB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:09:48.147635] [INFO ] [REMOTE    ] CURB: Fetching primary data for 2025-01.
[2025-10-24T18:09:48.323073] [INFO ] [REMOTE    ] CUK: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T18:09:48.438500] [INFO ] [REMOTE    ] CUBI: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T18:09:48.947720] [INFO ] [REMOTE    ] CULP: Fetching primary data for 2025-02.
[2025-10-24T18:09:49.238913] [INFO ] [REMOTE    ] CULP: Incremental fetch complete for 2025-02 (0.29 seconds).
[2025-10-24T18:09:49.606372] [INFO ] [REMOTE    ] CURB: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T18:09:49.747623] [INFO ] [REMOTE    ] CURB: Fetching primary data for 2025-02.
[2025-10-24T18:09:50.547719] [INFO ] [REMOTE    ] CUBI: Fetching primary data for 2025-10.
[2025-10-24T18:09:50.962405] [INFO ] [REMOTE    ] CURB: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T18:09:51.347718] [INFO ] [REMOTE    ] CULP: Fetching primary data for 2025-03.
[2025-10-24T18:09:51.931426] [INFO ] [REMOTE    ] CUBI: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T18:09:51.936544] [INFO ] [REMOTE    ] CUBI: Full fetch complete (39197 records).
[2025-10-24T18:09:51.936705] [DEBUG] [VALIDATOR ] CUBI: Validating primary data.
[2025-10-24T18:09:52.046589] [INFO ] [REMOTE    ] CULP: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T18:09:52.152895] [INFO ] [REMOTE    ] CURB: Fetching primary data for 2025-03.
[2025-10-24T18:09:52.334282] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present.
[2025-10-24T18:09:52.334358] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed.
[2025-10-24T18:09:52.334942] [INFO ] [MAIN      ] CUBI: Fetched primary data is valid.
[2025-10-24T18:09:52.335004] [DEBUG] [LOCAL     ] CUBI: Saving primary data.
[2025-10-24T18:09:52.335400] [FATAL] [LOCAL     ] CUBI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:09:52.335459] [FATAL] [MAIN      ] CUBI: Failed to save primary data.
[2025-10-24T18:09:52.335495] [WARN ] [MAIN      ] CUBI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:09:52.335569] [INFO ] [LOCAL     ] CUBI: Starting deletion of primary data.
[2025-10-24T18:09:52.335626] [DEBUG] [LOCAL     ] CUBI: No primary data file found to delete.
[2025-10-24T18:09:52.335698] [INFO ] [LOCAL     ] CUBI: Starting deletion of derivative data.
[2025-10-24T18:09:52.335840] [DEBUG] [LOCAL     ] CUBI: Deleted derivative data file.
[2025-10-24T18:09:52.335912] [INFO ] [MAIN      ] Update Progress: 557/2366 symbols completed. CUBI took 30.4s. Estimated remaining: 3h 46m 46s. Rate: 8.0 symbols/min
[2025-10-24T18:09:52.947634] [INFO ] [REMOTE    ] CULP: Fetching primary data for 2025-04.
[2025-10-24T18:09:53.512284] [INFO ] [REMOTE    ] CULP: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T18:09:53.655697] [INFO ] [REMOTE    ] CURB: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T18:09:53.747695] [INFO ] [REMOTE    ] CUK: Fetching primary data for 2025-06.
[2025-10-24T18:09:54.547722] [INFO ] [REMOTE    ] CULP: Fetching primary data for 2025-05.
[2025-10-24T18:09:55.347733] [INFO ] [REMOTE    ] CURB: Fetching primary data for 2025-04.
[2025-10-24T18:09:55.392958] [INFO ] [REMOTE    ] CUK: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T18:09:55.422140] [INFO ] [REMOTE    ] CULP: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T18:09:56.147679] [INFO ] [REMOTE    ] CULP: Fetching primary data for 2025-06.
[2025-10-24T18:09:56.629836] [INFO ] [REMOTE    ] CULP: Incremental fetch complete for 2025-06 (0.48 seconds).
[2025-10-24T18:09:56.752850] [INFO ] [REMOTE    ] CURB: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T18:09:56.947711] [INFO ] [REMOTE    ] CURB: Fetching primary data for 2025-05.
[2025-10-24T18:09:57.747678] [INFO ] [REMOTE    ] CUK: Fetching primary data for 2025-07.
[2025-10-24T18:09:58.135829] [INFO ] [REMOTE    ] CURB: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T18:09:58.547674] [INFO ] [REMOTE    ] CURB: Fetching primary data for 2025-06.
[2025-10-24T18:09:59.347621] [INFO ] [REMOTE    ] CULP: Fetching primary data for 2025-07.
[2025-10-24T18:09:59.403369] [INFO ] [REMOTE    ] CURB: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T18:09:59.750371] [INFO ] [REMOTE    ] CULP: Incremental fetch complete for 2025-07 (0.40 seconds).
[2025-10-24T18:09:59.753479] [INFO ] [REMOTE    ] CUK: Incremental fetch complete for 2025-07 (2.01 seconds).
[2025-10-24T18:10:00.147675] [INFO ] [REMOTE    ] CUK: Fetching primary data for 2025-08.
[2025-10-24T18:10:00.947633] [INFO ] [REMOTE    ] CULP: Fetching primary data for 2025-08.
[2025-10-24T18:10:01.487181] [INFO ] [REMOTE    ] CULP: Incremental fetch complete for 2025-08 (0.54 seconds).
[2025-10-24T18:10:01.747695] [INFO ] [REMOTE    ] CULP: Fetching primary data for 2025-09.
[2025-10-24T18:10:01.954036] [INFO ] [REMOTE    ] CUK: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T18:10:02.547728] [INFO ] [REMOTE    ] CURB: Fetching primary data for 2025-07.
[2025-10-24T18:10:02.742577] [INFO ] [REMOTE    ] CULP: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T18:10:03.347727] [INFO ] [REMOTE    ] CULP: Fetching primary data for 2025-10.
[2025-10-24T18:10:04.103087] [INFO ] [REMOTE    ] CURB: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T18:10:04.147626] [INFO ] [REMOTE    ] CURB: Fetching primary data for 2025-08.
[2025-10-24T18:10:04.276978] [INFO ] [REMOTE    ] CULP: Incremental fetch complete for 2025-10 (0.93 seconds).
[2025-10-24T18:10:04.278218] [INFO ] [REMOTE    ] CULP: Full fetch complete (4434 records).
[2025-10-24T18:10:04.278295] [DEBUG] [VALIDATOR ] CULP: Validating primary data.
[2025-10-24T18:10:04.278774] [FATAL] [VALIDATOR ] CULP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:10:04.278862] [FATAL] [MAIN      ] CULP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:10:04.278905] [WARN ] [MAIN      ] CULP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:10:04.278944] [INFO ] [LOCAL     ] CULP: Starting deletion of primary data.
[2025-10-24T18:10:04.279006] [DEBUG] [LOCAL     ] CULP: No primary data file found to delete.
[2025-10-24T18:10:04.279041] [INFO ] [LOCAL     ] CULP: Starting deletion of derivative data.
[2025-10-24T18:10:04.279202] [DEBUG] [LOCAL     ] CULP: Deleted derivative data file.
[2025-10-24T18:10:04.279296] [INFO ] [MAIN      ] Update Progress: 558/2366 symbols completed. CULP took 21.0s. Estimated remaining: 3h 46m 53s. Rate: 8.0 symbols/min
[2025-10-24T18:10:04.947725] [INFO ] [REMOTE    ] CUK: Fetching primary data for 2025-09.
[2025-10-24T18:10:05.912367] [INFO ] [REMOTE    ] CURB: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T18:10:05.920932] [INFO ] [REMOTE    ] CURB: Fetching primary data for 2025-09.
[2025-10-24T18:10:07.179346] [INFO ] [REMOTE    ] CURB: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T18:10:07.187530] [INFO ] [REMOTE    ] CURB: Fetching primary data for 2025-10.
[2025-10-24T18:10:07.246402] [INFO ] [REMOTE    ] CUK: Incremental fetch complete for 2025-09 (2.30 seconds).
[2025-10-24T18:10:07.347606] [INFO ] [REMOTE    ] CUK: Fetching primary data for 2025-10.
[2025-10-24T18:10:08.690475] [INFO ] [REMOTE    ] CURB: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T18:10:08.698691] [INFO ] [REMOTE    ] CURB: Full fetch complete (47646 records).
[2025-10-24T18:10:08.698914] [DEBUG] [VALIDATOR ] CURB: Validating primary data.
[2025-10-24T18:10:09.087248] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present.
[2025-10-24T18:10:09.087358] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed.
[2025-10-24T18:10:09.088062] [INFO ] [MAIN      ] CURB: Fetched primary data is valid.
[2025-10-24T18:10:09.088128] [DEBUG] [LOCAL     ] CURB: Saving primary data.
[2025-10-24T18:10:09.088751] [FATAL] [LOCAL     ] CURB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:10:09.088847] [FATAL] [MAIN      ] CURB: Failed to save primary data.
[2025-10-24T18:10:09.088906] [WARN ] [MAIN      ] CURB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:10:09.088964] [INFO ] [LOCAL     ] CURB: Starting deletion of primary data.
[2025-10-24T18:10:09.089017] [DEBUG] [LOCAL     ] CURB: No primary data file found to delete.
[2025-10-24T18:10:09.089052] [INFO ] [LOCAL     ] CURB: Starting deletion of derivative data.
[2025-10-24T18:10:09.089192] [DEBUG] [LOCAL     ] CURB: Deleted derivative data file.
[2025-10-24T18:10:09.089273] [INFO ] [MAIN      ] Update Progress: 559/2366 symbols completed. CURB took 21.8s. Estimated remaining: 3h 46m 37s. Rate: 8.0 symbols/min
[2025-10-24T18:10:09.227675] [INFO ] [REMOTE    ] CUK: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T18:10:09.239221] [INFO ] [REMOTE    ] CUK: Full fetch complete (74393 records).
[2025-10-24T18:10:09.239447] [DEBUG] [VALIDATOR ] CUK: Validating primary data.
[2025-10-24T18:10:09.653531] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present.
[2025-10-24T18:10:09.653677] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed.
[2025-10-24T18:10:09.655000] [INFO ] [MAIN      ] CUK: Fetched primary data is valid.
[2025-10-24T18:10:09.655069] [DEBUG] [LOCAL     ] CUK: Saving primary data.
[2025-10-24T18:10:09.655850] [FATAL] [LOCAL     ] CUK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:10:09.655947] [FATAL] [MAIN      ] CUK: Failed to save primary data.
[2025-10-24T18:10:09.656010] [WARN ] [MAIN      ] CUK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:10:09.656100] [INFO ] [LOCAL     ] CUK: Starting deletion of primary data.
[2025-10-24T18:10:09.656190] [DEBUG] [LOCAL     ] CUK: No primary data file found to delete.
[2025-10-24T18:10:09.656235] [INFO ] [LOCAL     ] CUK: Starting deletion of derivative data.
[2025-10-24T18:10:09.656407] [DEBUG] [LOCAL     ] CUK: Deleted derivative data file.
[2025-10-24T18:10:09.657209] [INFO ] [MAIN      ] Update Progress: 560/2366 symbols completed. CUK took 40.8s. Estimated remaining: 3h 46m 7s. Rate: 8.0 symbols/min
[2025-10-24T18:10:10.295632] [INFO ] [MAIN      ] CVE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:10:10.371433] [INFO ] [MAIN      ] CURV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:10:10.426574] [INFO ] [MAIN      ] CVEO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:10:10.406195] [INFO ] [MAIN      ] CUZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:10:10.451873] [DEBUG] [LOCAL     ] CVEO: Loaded 15266 existing records from primary storage.
[2025-10-24T18:10:10.452207] [INFO ] [MAIN      ] CVEO: Loaded 15266 existing records.
[2025-10-24T18:10:10.584129] [DEBUG] [LOCAL     ] CURV: Loaded 27396 existing records from primary storage.
[2025-10-24T18:10:10.584870] [INFO ] [MAIN      ] CURV: Loaded 27396 existing records.
[2025-10-24T18:10:10.804889] [DEBUG] [LOCAL     ] CVE: Loaded 53957 existing records from primary storage.
[2025-10-24T18:10:10.798340] [WARN ] [MAIN      ] CVEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:10:10.811675] [INFO ] [MAIN      ] CVE: Loaded 53957 existing records.
[2025-10-24T18:10:10.833040] [INFO ] [MAIN      ] CVEO: Wiping existing primary data before full refresh.
[2025-10-24T18:10:10.834077] [DEBUG] [LOCAL     ] CUZ: Loaded 49765 existing records from primary storage.
[2025-10-24T18:10:10.870666] [INFO ] [LOCAL     ] CVEO: Starting deletion of primary data.
[2025-10-24T18:10:10.891802] [INFO ] [MAIN      ] CUZ: Loaded 49765 existing records.
[2025-10-24T18:10:10.891623] [DEBUG] [LOCAL     ] CVEO: Deleted primary data file.
[2025-10-24T18:10:11.007260] [INFO ] [MAIN      ] CVEO: Starting full primary refresh.
[2025-10-24T18:10:11.088277] [WARN ] [MAIN      ] CURV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:10:11.261907] [INFO ] [MAIN      ] CURV: Wiping existing primary data before full refresh.
[2025-10-24T18:10:11.267340] [INFO ] [LOCAL     ] CURV: Starting deletion of primary data.
[2025-10-24T18:10:11.348328] [DEBUG] [LOCAL     ] CURV: Deleted primary data file.
[2025-10-24T18:10:11.401739] [WARN ] [MAIN      ] CVE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:10:11.415488] [INFO ] [MAIN      ] CURV: Starting full primary refresh.
[2025-10-24T18:10:11.453678] [INFO ] [MAIN      ] CVE: Wiping existing primary data before full refresh.
[2025-10-24T18:10:11.464748] [WARN ] [MAIN      ] CUZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:10:11.494606] [INFO ] [LOCAL     ] CVE: Starting deletion of primary data.
[2025-10-24T18:10:11.510683] [INFO ] [MAIN      ] CUZ: Wiping existing primary data before full refresh.
[2025-10-24T18:10:11.521386] [INFO ] [LOCAL     ] CUZ: Starting deletion of primary data.
[2025-10-24T18:10:11.521467] [DEBUG] [LOCAL     ] CVE: Deleted primary data file.
[2025-10-24T18:10:11.574688] [DEBUG] [LOCAL     ] CUZ: Deleted primary data file.
[2025-10-24T18:10:11.586766] [INFO ] [MAIN      ] CUZ: Starting full primary refresh.
[2025-10-24T18:10:11.615843] [INFO ] [MAIN      ] CVE: Starting full primary refresh.
[2025-10-24T18:10:12.388598] [INFO ] [REMOTE    ] CVEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:10:12.431177] [INFO ] [REMOTE    ] CVEO: Fetching primary data for 2025-01.
[2025-10-24T18:10:12.757680] [INFO ] [REMOTE    ] CURV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:10:12.766959] [INFO ] [REMOTE    ] CURV: Fetching primary data for 2025-01.
[2025-10-24T18:10:12.862844] [INFO ] [REMOTE    ] CVE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:10:12.873422] [INFO ] [REMOTE    ] CVE: Fetching primary data for 2025-01.
[2025-10-24T18:10:12.926451] [INFO ] [REMOTE    ] CUZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:10:12.926703] [INFO ] [REMOTE    ] CUZ: Fetching primary data for 2025-01.
[2025-10-24T18:10:13.703533] [INFO ] [REMOTE    ] CVEO: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T18:10:13.705946] [INFO ] [REMOTE    ] CVEO: Fetching primary data for 2025-02.
[2025-10-24T18:10:14.128475] [INFO ] [REMOTE    ] CURV: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T18:10:14.134103] [INFO ] [REMOTE    ] CURV: Fetching primary data for 2025-02.
[2025-10-24T18:10:14.388724] [INFO ] [REMOTE    ] CVEO: Incremental fetch complete for 2025-02 (0.68 seconds).
[2025-10-24T18:10:14.391693] [INFO ] [REMOTE    ] CVEO: Fetching primary data for 2025-03.
[2025-10-24T18:10:14.531930] [INFO ] [REMOTE    ] CUZ: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T18:10:14.542286] [INFO ] [REMOTE    ] CUZ: Fetching primary data for 2025-02.
[2025-10-24T18:10:14.891112] [INFO ] [REMOTE    ] CURV: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T18:10:14.896604] [INFO ] [REMOTE    ] CURV: Fetching primary data for 2025-03.
[2025-10-24T18:10:15.178246] [INFO ] [REMOTE    ] CVE: Incremental fetch complete for 2025-01 (2.30 seconds).
[2025-10-24T18:10:15.347616] [INFO ] [REMOTE    ] CVE: Fetching primary data for 2025-02.
[2025-10-24T18:10:15.410857] [INFO ] [REMOTE    ] CVEO: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T18:10:16.100756] [INFO ] [REMOTE    ] CUZ: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T18:10:16.147676] [INFO ] [REMOTE    ] CUZ: Fetching primary data for 2025-03.
[2025-10-24T18:10:16.166524] [INFO ] [REMOTE    ] CURV: Incremental fetch complete for 2025-03 (1.27 seconds).
[2025-10-24T18:10:16.822540] [INFO ] [REMOTE    ] CVE: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T18:10:16.947622] [INFO ] [REMOTE    ] CVE: Fetching primary data for 2025-03.
[2025-10-24T18:10:17.697268] [INFO ] [REMOTE    ] CUZ: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T18:10:17.747608] [INFO ] [REMOTE    ] CUZ: Fetching primary data for 2025-04.
[2025-10-24T18:10:18.389739] [INFO ] [REMOTE    ] CVE: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T18:10:18.547678] [INFO ] [REMOTE    ] CVEO: Fetching primary data for 2025-04.
[2025-10-24T18:10:18.836344] [INFO ] [REMOTE    ] CUZ: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T18:10:19.347699] [INFO ] [REMOTE    ] CVE: Fetching primary data for 2025-04.
[2025-10-24T18:10:20.147704] [INFO ] [REMOTE    ] CUZ: Fetching primary data for 2025-05.
[2025-10-24T18:10:20.805483] [INFO ] [REMOTE    ] CVEO: Incremental fetch complete for 2025-04 (2.26 seconds).
[2025-10-24T18:10:20.947630] [INFO ] [REMOTE    ] CVEO: Fetching primary data for 2025-05.
[2025-10-24T18:10:21.076171] [INFO ] [REMOTE    ] CVE: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T18:10:21.747627] [INFO ] [REMOTE    ] CVE: Fetching primary data for 2025-05.
[2025-10-24T18:10:21.924620] [INFO ] [REMOTE    ] CVEO: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T18:10:22.157629] [INFO ] [REMOTE    ] CUZ: Incremental fetch complete for 2025-05 (2.01 seconds).
[2025-10-24T18:10:22.547686] [INFO ] [REMOTE    ] CVEO: Fetching primary data for 2025-06.
[2025-10-24T18:10:23.156586] [INFO ] [REMOTE    ] CVE: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T18:10:23.347690] [INFO ] [REMOTE    ] CVE: Fetching primary data for 2025-06.
[2025-10-24T18:10:23.545517] [INFO ] [REMOTE    ] CVEO: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T18:10:24.147729] [INFO ] [REMOTE    ] CURV: Fetching primary data for 2025-04.
[2025-10-24T18:10:24.608033] [INFO ] [REMOTE    ] CVE: Incremental fetch complete for 2025-06 (1.26 seconds).
[2025-10-24T18:10:24.947625] [INFO ] [REMOTE    ] CUZ: Fetching primary data for 2025-06.
[2025-10-24T18:10:25.436022] [INFO ] [REMOTE    ] CURV: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T18:10:25.747740] [INFO ] [REMOTE    ] CVE: Fetching primary data for 2025-07.
[2025-10-24T18:10:26.547708] [INFO ] [REMOTE    ] CVEO: Fetching primary data for 2025-07.
[2025-10-24T18:10:26.604545] [INFO ] [REMOTE    ] CUZ: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T18:10:27.237976] [INFO ] [REMOTE    ] CVEO: Incremental fetch complete for 2025-07 (0.69 seconds).
[2025-10-24T18:10:27.347609] [INFO ] [REMOTE    ] CURV: Fetching primary data for 2025-05.
[2025-10-24T18:10:27.561217] [INFO ] [REMOTE    ] CVE: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T18:10:28.147624] [INFO ] [REMOTE    ] CUZ: Fetching primary data for 2025-07.
[2025-10-24T18:10:28.245048] [INFO ] [REMOTE    ] CURV: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T18:10:28.947677] [INFO ] [REMOTE    ] CURV: Fetching primary data for 2025-06.
[2025-10-24T18:10:29.700617] [INFO ] [REMOTE    ] CUZ: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T18:10:29.747745] [INFO ] [REMOTE    ] CVE: Fetching primary data for 2025-08.
[2025-10-24T18:10:30.029443] [INFO ] [REMOTE    ] CURV: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T18:10:30.547718] [INFO ] [REMOTE    ] CUZ: Fetching primary data for 2025-08.
[2025-10-24T18:10:31.347678] [INFO ] [REMOTE    ] CURV: Fetching primary data for 2025-07.
[2025-10-24T18:10:31.467174] [INFO ] [REMOTE    ] CVE: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T18:10:32.147637] [INFO ] [REMOTE    ] CVEO: Fetching primary data for 2025-08.
[2025-10-24T18:10:32.182192] [INFO ] [REMOTE    ] CUZ: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T18:10:32.649038] [INFO ] [REMOTE    ] CURV: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T18:10:32.947702] [INFO ] [REMOTE    ] CURV: Fetching primary data for 2025-08.
[2025-10-24T18:10:33.038945] [INFO ] [REMOTE    ] CVEO: Incremental fetch complete for 2025-08 (0.89 seconds).
[2025-10-24T18:10:33.747635] [INFO ] [REMOTE    ] CUZ: Fetching primary data for 2025-09.
[2025-10-24T18:10:34.163792] [INFO ] [REMOTE    ] CURV: Incremental fetch complete for 2025-08 (1.22 seconds).
[2025-10-24T18:10:34.547681] [INFO ] [REMOTE    ] CVEO: Fetching primary data for 2025-09.
[2025-10-24T18:10:35.248972] [INFO ] [REMOTE    ] CVEO: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T18:10:35.347701] [INFO ] [REMOTE    ] CVE: Fetching primary data for 2025-09.
[2025-10-24T18:10:35.443178] [INFO ] [REMOTE    ] CUZ: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T18:10:36.147672] [INFO ] [REMOTE    ] CURV: Fetching primary data for 2025-09.
[2025-10-24T18:10:36.751242] [INFO ] [REMOTE    ] CVE: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T18:10:36.947610] [INFO ] [REMOTE    ] CVE: Fetching primary data for 2025-10.
[2025-10-24T18:10:37.510489] [INFO ] [REMOTE    ] CURV: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T18:10:37.747670] [INFO ] [REMOTE    ] CUZ: Fetching primary data for 2025-10.
[2025-10-24T18:10:38.547720] [INFO ] [REMOTE    ] CVEO: Fetching primary data for 2025-10.
[2025-10-24T18:10:38.853284] [INFO ] [REMOTE    ] CVE: Incremental fetch complete for 2025-10 (1.91 seconds).
[2025-10-24T18:10:38.863161] [INFO ] [REMOTE    ] CVE: Full fetch complete (77718 records).
[2025-10-24T18:10:38.863283] [DEBUG] [VALIDATOR ] CVE: Validating primary data.
[2025-10-24T18:10:39.256720] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present.
[2025-10-24T18:10:39.256802] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed.
[2025-10-24T18:10:39.257971] [INFO ] [MAIN      ] CVE: Fetched primary data is valid.
[2025-10-24T18:10:39.258182] [DEBUG] [LOCAL     ] CVE: Saving primary data.
[2025-10-24T18:10:39.258914] [FATAL] [LOCAL     ] CVE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:10:39.259007] [FATAL] [MAIN      ] CVE: Failed to save primary data.
[2025-10-24T18:10:39.259049] [WARN ] [MAIN      ] CVE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:10:39.259111] [INFO ] [LOCAL     ] CVE: Starting deletion of primary data.
[2025-10-24T18:10:39.259176] [DEBUG] [LOCAL     ] CVE: No primary data file found to delete.
[2025-10-24T18:10:39.259213] [INFO ] [LOCAL     ] CVE: Starting deletion of derivative data.
[2025-10-24T18:10:39.259357] [DEBUG] [LOCAL     ] CVE: Deleted derivative data file.
[2025-10-24T18:10:39.259952] [INFO ] [MAIN      ] Update Progress: 561/2366 symbols completed. CVE took 29.6s. Estimated remaining: 3h 47m 10s. Rate: 7.9 symbols/min
[2025-10-24T18:10:39.350115] [INFO ] [REMOTE    ] CURV: Fetching primary data for 2025-10.
[2025-10-24T18:10:39.442550] [INFO ] [MAIN      ] CVI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:10:39.439190] [INFO ] [REMOTE    ] CVEO: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T18:10:39.446673] [INFO ] [REMOTE    ] CVEO: Full fetch complete (20959 records).
[2025-10-24T18:10:39.446776] [DEBUG] [VALIDATOR ] CVEO: Validating primary data.
[2025-10-24T18:10:39.638893] [INFO ] [REMOTE    ] CUZ: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T18:10:39.704231] [INFO ] [REMOTE    ] CUZ: Full fetch complete (70765 records).
[2025-10-24T18:10:39.714792] [DEBUG] [VALIDATOR ] CUZ: Validating primary data.
[2025-10-24T18:10:39.921773] [DEBUG] [LOCAL     ] CVI: Loaded 47049 existing records from primary storage.
[2025-10-24T18:10:39.963954] [INFO ] [MAIN      ] CVI: Loaded 47049 existing records.
[2025-10-24T18:10:40.154411] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present.
[2025-10-24T18:10:40.194847] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed.
[2025-10-24T18:10:40.231448] [INFO ] [MAIN      ] CVEO: Fetched primary data is valid.
[2025-10-24T18:10:40.266751] [DEBUG] [LOCAL     ] CVEO: Saving primary data.
[2025-10-24T18:10:40.287552] [FATAL] [LOCAL     ] CVEO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:10:40.298082] [FATAL] [MAIN      ] CVEO: Failed to save primary data.
[2025-10-24T18:10:40.332724] [WARN ] [MAIN      ] CVEO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:10:40.416160] [WARN ] [MAIN      ] CVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:10:40.359682] [INFO ] [LOCAL     ] CVEO: Starting deletion of primary data.
[2025-10-24T18:10:40.435200] [INFO ] [MAIN      ] CVI: Wiping existing primary data before full refresh.
[2025-10-24T18:10:40.445279] [DEBUG] [LOCAL     ] CVEO: No primary data file found to delete.
[2025-10-24T18:10:40.451603] [INFO ] [LOCAL     ] CVI: Starting deletion of primary data.
[2025-10-24T18:10:40.451719] [INFO ] [LOCAL     ] CVEO: Starting deletion of derivative data.
[2025-10-24T18:10:40.493110] [DEBUG] [LOCAL     ] CVI: Deleted primary data file.
[2025-10-24T18:10:40.493329] [INFO ] [MAIN      ] CVI: Starting full primary refresh.
[2025-10-24T18:10:40.493263] [DEBUG] [LOCAL     ] CVEO: Deleted derivative data file.
[2025-10-24T18:10:40.493069] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present.
[2025-10-24T18:10:40.493698] [INFO ] [MAIN      ] Update Progress: 562/2366 symbols completed. CVEO took 30.8s. Estimated remaining: 3h 46m 43s. Rate: 8.0 symbols/min
[2025-10-24T18:10:40.505408] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed.
[2025-10-24T18:10:40.506165] [INFO ] [MAIN      ] CUZ: Fetched primary data is valid.
[2025-10-24T18:10:40.526394] [DEBUG] [LOCAL     ] CUZ: Saving primary data.
[2025-10-24T18:10:40.575635] [FATAL] [LOCAL     ] CUZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:10:40.632920] [FATAL] [MAIN      ] CUZ: Failed to save primary data.
[2025-10-24T18:10:40.674029] [WARN ] [MAIN      ] CUZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:10:40.724316] [INFO ] [LOCAL     ] CUZ: Starting deletion of primary data.
[2025-10-24T18:10:40.745094] [DEBUG] [LOCAL     ] CUZ: No primary data file found to delete.
[2025-10-24T18:10:40.825699] [INFO ] [LOCAL     ] CUZ: Starting deletion of derivative data.
[2025-10-24T18:10:40.856830] [INFO ] [MAIN      ] CVLG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:10:40.887532] [DEBUG] [LOCAL     ] CUZ: Deleted derivative data file.
[2025-10-24T18:10:40.898949] [INFO ] [MAIN      ] Update Progress: 563/2366 symbols completed. CUZ took 31.2s. Estimated remaining: 3h 46m 12s. Rate: 8.0 symbols/min
[2025-10-24T18:10:40.923987] [INFO ] [REMOTE    ] CURV: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T18:10:40.996804] [INFO ] [REMOTE    ] CURV: Full fetch complete (38966 records).
[2025-10-24T18:10:41.052259] [DEBUG] [VALIDATOR ] CURV: Validating primary data.
[2025-10-24T18:10:41.152996] [DEBUG] [LOCAL     ] CVLG: Loaded 15392 existing records from primary storage.
[2025-10-24T18:10:41.199565] [INFO ] [MAIN      ] CVLG: Loaded 15392 existing records.
[2025-10-24T18:10:41.424049] [INFO ] [REMOTE    ] CVI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:10:41.463046] [INFO ] [REMOTE    ] CVI: Fetching primary data for 2025-01.
[2025-10-24T18:10:41.490464] [INFO ] [MAIN      ] CVNA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:10:41.534484] [DEBUG] [LOCAL     ] CVNA: No existing data file found in primary storage.
[2025-10-24T18:10:41.635996] [WARN ] [MAIN      ] CVNA: No existing data found, performing full refresh instead.
[2025-10-24T18:10:41.674551] [WARN ] [MAIN      ] CVLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:10:41.696262] [INFO ] [MAIN      ] CVNA: Wiping existing primary data before full refresh.
[2025-10-24T18:10:41.711681] [INFO ] [LOCAL     ] CVNA: Starting deletion of primary data.
[2025-10-24T18:10:41.740480] [INFO ] [MAIN      ] CVLG: Wiping existing primary data before full refresh.
[2025-10-24T18:10:41.740725] [DEBUG] [LOCAL     ] CVNA: No primary data file found to delete.
[2025-10-24T18:10:41.762002] [INFO ] [LOCAL     ] CVLG: Starting deletion of primary data.
[2025-10-24T18:10:41.762137] [INFO ] [MAIN      ] CVNA: Starting full primary refresh.
[2025-10-24T18:10:41.814341] [DEBUG] [LOCAL     ] CVLG: Deleted primary data file.
[2025-10-24T18:10:41.835508] [INFO ] [MAIN      ] CVLG: Starting full primary refresh.
[2025-10-24T18:10:42.097268] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present.
[2025-10-24T18:10:42.120821] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed.
[2025-10-24T18:10:42.151208] [INFO ] [MAIN      ] CURV: Fetched primary data is valid.
[2025-10-24T18:10:42.198477] [DEBUG] [LOCAL     ] CURV: Saving primary data.
[2025-10-24T18:10:42.218907] [FATAL] [LOCAL     ] CURV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:10:42.234372] [FATAL] [MAIN      ] CURV: Failed to save primary data.
[2025-10-24T18:10:42.273868] [WARN ] [MAIN      ] CURV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:10:42.335110] [INFO ] [LOCAL     ] CURV: Starting deletion of primary data.
[2025-10-24T18:10:42.407263] [DEBUG] [LOCAL     ] CURV: No primary data file found to delete.
[2025-10-24T18:10:42.488911] [INFO ] [LOCAL     ] CURV: Starting deletion of derivative data.
[2025-10-24T18:10:42.560573] [DEBUG] [LOCAL     ] CURV: Deleted derivative data file.
[2025-10-24T18:10:42.555207] [INFO ] [REMOTE    ] CVNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:10:42.570272] [INFO ] [MAIN      ] Update Progress: 564/2366 symbols completed. CURV took 32.9s. Estimated remaining: 3h 45m 46s. Rate: 8.0 symbols/min
[2025-10-24T18:10:42.575902] [INFO ] [REMOTE    ] CVNA: Fetching primary data for 2025-01.
[2025-10-24T18:10:42.815970] [INFO ] [REMOTE    ] CVLG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:10:42.835010] [INFO ] [REMOTE    ] CVLG: Fetching primary data for 2025-01.
[2025-10-24T18:10:42.867456] [INFO ] [MAIN      ] CVS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:10:42.917858] [DEBUG] [LOCAL     ] CVS: Loaded 54084 existing records from primary storage.
[2025-10-24T18:10:42.918208] [INFO ] [MAIN      ] CVS: Loaded 54084 existing records.
[2025-10-24T18:10:43.094427] [WARN ] [MAIN      ] CVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:10:43.094669] [INFO ] [MAIN      ] CVS: Wiping existing primary data before full refresh.
[2025-10-24T18:10:43.094729] [INFO ] [LOCAL     ] CVS: Starting deletion of primary data.
[2025-10-24T18:10:43.094934] [DEBUG] [LOCAL     ] CVS: Deleted primary data file.
[2025-10-24T18:10:43.094973] [INFO ] [MAIN      ] CVS: Starting full primary refresh.
[2025-10-24T18:10:43.448803] [INFO ] [REMOTE    ] CVS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:10:43.449111] [INFO ] [REMOTE    ] CVS: Fetching primary data for 2025-01.
[2025-10-24T18:10:43.740114] [INFO ] [REMOTE    ] CVI: Incremental fetch complete for 2025-01 (2.28 seconds).
[2025-10-24T18:10:43.749377] [INFO ] [REMOTE    ] CVI: Fetching primary data for 2025-02.
[2025-10-24T18:10:44.074934] [INFO ] [REMOTE    ] CVLG: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T18:10:44.147681] [INFO ] [REMOTE    ] CVLG: Fetching primary data for 2025-02.
[2025-10-24T18:10:44.717357] [INFO ] [REMOTE    ] CVNA: Incremental fetch complete for 2025-01 (2.14 seconds).
[2025-10-24T18:10:44.784428] [INFO ] [REMOTE    ] CVI: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T18:10:44.947713] [INFO ] [REMOTE    ] CVI: Fetching primary data for 2025-03.
[2025-10-24T18:10:44.978829] [INFO ] [REMOTE    ] CVLG: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T18:10:45.160598] [INFO ] [REMOTE    ] CVS: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T18:10:45.747743] [INFO ] [REMOTE    ] CVLG: Fetching primary data for 2025-03.
[2025-10-24T18:10:46.502192] [INFO ] [REMOTE    ] CVLG: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T18:10:46.547626] [INFO ] [REMOTE    ] CVLG: Fetching primary data for 2025-04.
[2025-10-24T18:10:46.603392] [INFO ] [REMOTE    ] CVI: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T18:10:47.347618] [INFO ] [REMOTE    ] CVI: Fetching primary data for 2025-04.
[2025-10-24T18:10:47.664511] [INFO ] [REMOTE    ] CVLG: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T18:10:48.147706] [INFO ] [REMOTE    ] CVLG: Fetching primary data for 2025-05.
[2025-10-24T18:10:48.639909] [INFO ] [REMOTE    ] CVI: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T18:10:48.947718] [INFO ] [REMOTE    ] CVI: Fetching primary data for 2025-05.
[2025-10-24T18:10:49.273388] [INFO ] [REMOTE    ] CVLG: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T18:10:49.747684] [INFO ] [REMOTE    ] CVLG: Fetching primary data for 2025-06.
[2025-10-24T18:10:50.547619] [INFO ] [REMOTE    ] CVS: Fetching primary data for 2025-02.
[2025-10-24T18:10:50.612888] [INFO ] [REMOTE    ] CVLG: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T18:10:50.783677] [INFO ] [REMOTE    ] CVI: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T18:10:51.347742] [INFO ] [REMOTE    ] CVNA: Fetching primary data for 2025-02.
[2025-10-24T18:10:52.147617] [INFO ] [REMOTE    ] CVI: Fetching primary data for 2025-06.
[2025-10-24T18:10:52.383317] [INFO ] [REMOTE    ] CVS: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T18:10:52.947667] [INFO ] [REMOTE    ] CVLG: Fetching primary data for 2025-07.
[2025-10-24T18:10:53.578372] [INFO ] [REMOTE    ] CVNA: Incremental fetch complete for 2025-02 (2.23 seconds).
[2025-10-24T18:10:53.617496] [INFO ] [REMOTE    ] CVI: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T18:10:53.747633] [INFO ] [REMOTE    ] CVNA: Fetching primary data for 2025-03.
[2025-10-24T18:10:53.765032] [INFO ] [REMOTE    ] CVLG: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T18:10:54.547728] [INFO ] [REMOTE    ] CVS: Fetching primary data for 2025-03.
[2025-10-24T18:10:55.347718] [INFO ] [REMOTE    ] CVI: Fetching primary data for 2025-07.
[2025-10-24T18:10:55.712053] [INFO ] [REMOTE    ] CVNA: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T18:10:56.136571] [INFO ] [REMOTE    ] CVS: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T18:10:56.147839] [INFO ] [REMOTE    ] CVS: Fetching primary data for 2025-04.
[2025-10-24T18:10:56.956299] [INFO ] [REMOTE    ] CVNA: Fetching primary data for 2025-04.
[2025-10-24T18:10:56.960543] [INFO ] [REMOTE    ] CVI: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T18:10:57.747675] [INFO ] [REMOTE    ] CVI: Fetching primary data for 2025-08.
[2025-10-24T18:10:58.018795] [INFO ] [REMOTE    ] CVS: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T18:10:58.547750] [INFO ] [REMOTE    ] CVLG: Fetching primary data for 2025-08.
[2025-10-24T18:10:58.848069] [INFO ] [REMOTE    ] CVNA: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T18:10:59.140457] [INFO ] [REMOTE    ] CVI: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T18:10:59.347720] [INFO ] [REMOTE    ] CVS: Fetching primary data for 2025-05.
[2025-10-24T18:10:59.443265] [INFO ] [REMOTE    ] CVLG: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T18:11:00.147686] [INFO ] [REMOTE    ] CVI: Fetching primary data for 2025-09.
[2025-10-24T18:11:00.947725] [INFO ] [REMOTE    ] CVLG: Fetching primary data for 2025-09.
[2025-10-24T18:11:01.747752] [INFO ] [REMOTE    ] CVNA: Fetching primary data for 2025-05.
[2025-10-24T18:11:02.000712] [INFO ] [REMOTE    ] CVS: Incremental fetch complete for 2025-05 (2.65 seconds).
[2025-10-24T18:11:02.087998] [INFO ] [REMOTE    ] CVI: Incremental fetch complete for 2025-09 (1.94 seconds).
[2025-10-24T18:11:02.547735] [INFO ] [REMOTE    ] CVI: Fetching primary data for 2025-10.
[2025-10-24T18:11:03.347619] [INFO ] [REMOTE    ] CVS: Fetching primary data for 2025-06.
[2025-10-24T18:11:03.498276] [INFO ] [REMOTE    ] CVLG: Incremental fetch complete for 2025-09 (2.55 seconds).
[2025-10-24T18:11:04.147745] [INFO ] [REMOTE    ] CVLG: Fetching primary data for 2025-10.
[2025-10-24T18:11:05.150965] [INFO ] [REMOTE    ] CVNA: Incremental fetch complete for 2025-05 (3.40 seconds).
[2025-10-24T18:11:05.169487] [INFO ] [REMOTE    ] CVNA: Fetching primary data for 2025-06.
[2025-10-24T18:11:05.170282] [INFO ] [REMOTE    ] CVLG: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T18:11:05.173883] [INFO ] [REMOTE    ] CVLG: Full fetch complete (21357 records).
[2025-10-24T18:11:05.173957] [DEBUG] [VALIDATOR ] CVLG: Validating primary data.
[2025-10-24T18:11:05.589111] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present.
[2025-10-24T18:11:05.589318] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed.
[2025-10-24T18:11:05.589900] [INFO ] [MAIN      ] CVLG: Fetched primary data is valid.
[2025-10-24T18:11:05.589988] [DEBUG] [LOCAL     ] CVLG: Saving primary data.
[2025-10-24T18:11:05.590292] [FATAL] [LOCAL     ] CVLG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:11:05.590385] [FATAL] [MAIN      ] CVLG: Failed to save primary data.
[2025-10-24T18:11:05.590522] [WARN ] [MAIN      ] CVLG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:11:05.590708] [INFO ] [LOCAL     ] CVLG: Starting deletion of primary data.
[2025-10-24T18:11:05.590835] [DEBUG] [LOCAL     ] CVLG: No primary data file found to delete.
[2025-10-24T18:11:05.590964] [INFO ] [LOCAL     ] CVLG: Starting deletion of derivative data.
[2025-10-24T18:11:05.591120] [DEBUG] [LOCAL     ] CVLG: Deleted derivative data file.
[2025-10-24T18:11:05.591367] [INFO ] [MAIN      ] Update Progress: 565/2366 symbols completed. CVLG took 25.1s. Estimated remaining: 3h 46m 28s. Rate: 8.0 symbols/min
[2025-10-24T18:11:05.702393] [INFO ] [REMOTE    ] CVI: Incremental fetch complete for 2025-10 (3.15 seconds).
[2025-10-24T18:11:05.800950] [INFO ] [REMOTE    ] CVI: Full fetch complete (67214 records).
[2025-10-24T18:11:05.800780] [INFO ] [MAIN      ] CVX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:11:05.801141] [DEBUG] [VALIDATOR ] CVI: Validating primary data.
[2025-10-24T18:11:05.801258] [DEBUG] [LOCAL     ] CVX: No existing data file found in primary storage.
[2025-10-24T18:11:05.801417] [WARN ] [MAIN      ] CVX: No existing data found, performing full refresh instead.
[2025-10-24T18:11:05.801764] [INFO ] [MAIN      ] CVX: Wiping existing primary data before full refresh.
[2025-10-24T18:11:05.801906] [INFO ] [LOCAL     ] CVX: Starting deletion of primary data.
[2025-10-24T18:11:05.833840] [DEBUG] [LOCAL     ] CVX: No primary data file found to delete.
[2025-10-24T18:11:05.872752] [INFO ] [MAIN      ] CVX: Starting full primary refresh.
[2025-10-24T18:11:06.159363] [INFO ] [REMOTE    ] CVS: Incremental fetch complete for 2025-06 (2.81 seconds).
[2025-10-24T18:11:06.306497] [INFO ] [REMOTE    ] CVS: Fetching primary data for 2025-07.
[2025-10-24T18:11:06.573933] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present.
[2025-10-24T18:11:06.584216] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed.
[2025-10-24T18:11:06.594167] [INFO ] [MAIN      ] CVI: Fetched primary data is valid.
[2025-10-24T18:11:06.595215] [DEBUG] [LOCAL     ] CVI: Saving primary data.
[2025-10-24T18:11:06.614746] [INFO ] [REMOTE    ] CVX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:11:06.615044] [INFO ] [REMOTE    ] CVX: Fetching primary data for 2025-01.
[2025-10-24T18:11:06.611116] [FATAL] [LOCAL     ] CVI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:11:06.615134] [FATAL] [MAIN      ] CVI: Failed to save primary data.
[2025-10-24T18:11:06.615905] [WARN ] [MAIN      ] CVI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:11:06.615976] [INFO ] [LOCAL     ] CVI: Starting deletion of primary data.
[2025-10-24T18:11:06.616034] [DEBUG] [LOCAL     ] CVI: No primary data file found to delete.
[2025-10-24T18:11:06.616070] [INFO ] [LOCAL     ] CVI: Starting deletion of derivative data.
[2025-10-24T18:11:06.616177] [DEBUG] [LOCAL     ] CVI: Deleted derivative data file.
[2025-10-24T18:11:06.616358] [INFO ] [MAIN      ] Update Progress: 566/2366 symbols completed. CVI took 27.4s. Estimated remaining: 3h 45m 60s. Rate: 8.0 symbols/min
[2025-10-24T18:11:06.790733] [INFO ] [MAIN      ] CW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:11:06.824869] [DEBUG] [LOCAL     ] CW: Loaded 22064 existing records from primary storage.
[2025-10-24T18:11:06.825215] [INFO ] [MAIN      ] CW: Loaded 22064 existing records.
[2025-10-24T18:11:07.004684] [WARN ] [MAIN      ] CW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:11:07.005029] [INFO ] [MAIN      ] CW: Wiping existing primary data before full refresh.
[2025-10-24T18:11:07.005100] [INFO ] [LOCAL     ] CW: Starting deletion of primary data.
[2025-10-24T18:11:07.005514] [DEBUG] [LOCAL     ] CW: Deleted primary data file.
[2025-10-24T18:11:07.005662] [INFO ] [MAIN      ] CW: Starting full primary refresh.
[2025-10-24T18:11:07.192414] [INFO ] [REMOTE    ] CVNA: Incremental fetch complete for 2025-06 (2.02 seconds).
[2025-10-24T18:11:07.352718] [INFO ] [REMOTE    ] CVNA: Fetching primary data for 2025-07.
[2025-10-24T18:11:07.413296] [INFO ] [REMOTE    ] CW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:11:08.147741] [INFO ] [REMOTE    ] CW: Fetching primary data for 2025-01.
[2025-10-24T18:11:08.583670] [INFO ] [REMOTE    ] CVS: Incremental fetch complete for 2025-07 (2.28 seconds).
[2025-10-24T18:11:08.722912] [INFO ] [REMOTE    ] CVX: Incremental fetch complete for 2025-01 (2.11 seconds).
[2025-10-24T18:11:08.947687] [INFO ] [REMOTE    ] CVX: Fetching primary data for 2025-02.
[2025-10-24T18:11:09.471422] [INFO ] [REMOTE    ] CW: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T18:11:09.647000] [INFO ] [REMOTE    ] CVNA: Incremental fetch complete for 2025-07 (2.29 seconds).
[2025-10-24T18:11:09.747713] [INFO ] [REMOTE    ] CVNA: Fetching primary data for 2025-08.
[2025-10-24T18:11:10.547613] [INFO ] [REMOTE    ] CW: Fetching primary data for 2025-02.
[2025-10-24T18:11:11.058044] [INFO ] [REMOTE    ] CVX: Incremental fetch complete for 2025-02 (2.11 seconds).
[2025-10-24T18:11:11.347616] [INFO ] [REMOTE    ] CVS: Fetching primary data for 2025-08.
[2025-10-24T18:11:11.836156] [INFO ] [REMOTE    ] CVNA: Incremental fetch complete for 2025-08 (2.09 seconds).
[2025-10-24T18:11:11.899298] [INFO ] [REMOTE    ] CW: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T18:11:12.147690] [INFO ] [REMOTE    ] CVNA: Fetching primary data for 2025-09.
[2025-10-24T18:11:12.947638] [INFO ] [REMOTE    ] CVX: Fetching primary data for 2025-03.
[2025-10-24T18:11:13.189405] [INFO ] [REMOTE    ] CVS: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T18:11:13.747677] [INFO ] [REMOTE    ] CW: Fetching primary data for 2025-03.
[2025-10-24T18:11:14.076738] [INFO ] [REMOTE    ] CVNA: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T18:11:14.547616] [INFO ] [REMOTE    ] CVS: Fetching primary data for 2025-09.
[2025-10-24T18:11:14.936047] [INFO ] [REMOTE    ] CVX: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T18:11:14.960332] [INFO ] [REMOTE    ] CW: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T18:11:15.347702] [INFO ] [REMOTE    ] CVX: Fetching primary data for 2025-04.
[2025-10-24T18:11:16.147604] [INFO ] [REMOTE    ] CVNA: Fetching primary data for 2025-10.
[2025-10-24T18:11:16.389673] [INFO ] [REMOTE    ] CVS: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T18:11:16.947730] [INFO ] [REMOTE    ] CW: Fetching primary data for 2025-04.
[2025-10-24T18:11:17.747638] [INFO ] [REMOTE    ] CVS: Fetching primary data for 2025-10.
[2025-10-24T18:11:17.916580] [INFO ] [REMOTE    ] CVX: Incremental fetch complete for 2025-04 (2.57 seconds).
[2025-10-24T18:11:18.082091] [INFO ] [REMOTE    ] CW: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T18:11:18.553023] [INFO ] [REMOTE    ] CVX: Fetching primary data for 2025-05.
[2025-10-24T18:11:18.575055] [INFO ] [REMOTE    ] CVNA: Incremental fetch complete for 2025-10 (2.43 seconds).
[2025-10-24T18:11:18.591891] [INFO ] [REMOTE    ] CVNA: Full fetch complete (76728 records).
[2025-10-24T18:11:18.592123] [DEBUG] [VALIDATOR ] CVNA: Validating primary data.
[2025-10-24T18:11:19.072577] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present.
[2025-10-24T18:11:19.072696] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed.
[2025-10-24T18:11:19.073598] [INFO ] [MAIN      ] CVNA: Fetched primary data is valid.
[2025-10-24T18:11:19.073668] [DEBUG] [LOCAL     ] CVNA: Saving primary data.
[2025-10-24T18:11:19.074334] [FATAL] [LOCAL     ] CVNA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:11:19.074427] [FATAL] [MAIN      ] CVNA: Failed to save primary data.
[2025-10-24T18:11:19.074469] [WARN ] [MAIN      ] CVNA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:11:19.074504] [INFO ] [LOCAL     ] CVNA: Starting deletion of primary data.
[2025-10-24T18:11:19.074559] [DEBUG] [LOCAL     ] CVNA: No primary data file found to delete.
[2025-10-24T18:11:19.074594] [INFO ] [LOCAL     ] CVNA: Starting deletion of derivative data.
[2025-10-24T18:11:19.074633] [DEBUG] [LOCAL     ] CVNA: No derivative data file found to delete.
[2025-10-24T18:11:19.074900] [INFO ] [MAIN      ] Update Progress: 567/2366 symbols completed. CVNA took 38.2s. Estimated remaining: 3h 46m 8s. Rate: 8.0 symbols/min
[2025-10-24T18:11:19.263186] [INFO ] [MAIN      ] CWAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:11:19.315586] [DEBUG] [LOCAL     ] CWAN: Loaded 53059 existing records from primary storage.
[2025-10-24T18:11:19.315973] [INFO ] [MAIN      ] CWAN: Loaded 53059 existing records.
[2025-10-24T18:11:19.359301] [INFO ] [REMOTE    ] CW: Fetching primary data for 2025-05.
[2025-10-24T18:11:19.503556] [WARN ] [MAIN      ] CWAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:11:19.504073] [INFO ] [MAIN      ] CWAN: Wiping existing primary data before full refresh.
[2025-10-24T18:11:19.504222] [INFO ] [LOCAL     ] CWAN: Starting deletion of primary data.
[2025-10-24T18:11:19.504623] [DEBUG] [LOCAL     ] CWAN: Deleted primary data file.
[2025-10-24T18:11:19.504716] [INFO ] [MAIN      ] CWAN: Starting full primary refresh.
[2025-10-24T18:11:19.889487] [INFO ] [REMOTE    ] CWAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:11:19.921840] [INFO ] [REMOTE    ] CVS: Incremental fetch complete for 2025-10 (2.17 seconds).
[2025-10-24T18:11:19.932982] [INFO ] [REMOTE    ] CVS: Full fetch complete (77484 records).
[2025-10-24T18:11:19.933150] [DEBUG] [VALIDATOR ] CVS: Validating primary data.
[2025-10-24T18:11:19.934101] [FATAL] [VALIDATOR ] CVS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:11:19.934196] [FATAL] [MAIN      ] CVS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:11:19.934239] [WARN ] [MAIN      ] CVS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:11:19.934304] [INFO ] [LOCAL     ] CVS: Starting deletion of primary data.
[2025-10-24T18:11:19.934368] [DEBUG] [LOCAL     ] CVS: No primary data file found to delete.
[2025-10-24T18:11:19.934404] [INFO ] [LOCAL     ] CVS: Starting deletion of derivative data.
[2025-10-24T18:11:19.934604] [DEBUG] [LOCAL     ] CVS: Deleted derivative data file.
[2025-10-24T18:11:19.935238] [INFO ] [MAIN      ] Update Progress: 568/2366 symbols completed. CVS took 37.3s. Estimated remaining: 3h 45m 39s. Rate: 8.0 symbols/min
[2025-10-24T18:11:20.105977] [INFO ] [MAIN      ] CWEN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:11:20.147611] [INFO ] [REMOTE    ] CWAN: Fetching primary data for 2025-01.
[2025-10-24T18:11:20.148415] [DEBUG] [LOCAL     ] CWEN: Loaded 45626 existing records from primary storage.
[2025-10-24T18:11:20.149417] [INFO ] [MAIN      ] CWEN: Loaded 45626 existing records.
[2025-10-24T18:11:20.330701] [WARN ] [MAIN      ] CWEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:11:20.330885] [INFO ] [MAIN      ] CWEN: Wiping existing primary data before full refresh.
[2025-10-24T18:11:20.330944] [INFO ] [LOCAL     ] CWEN: Starting deletion of primary data.
[2025-10-24T18:11:20.331157] [DEBUG] [LOCAL     ] CWEN: Deleted primary data file.
[2025-10-24T18:11:20.331198] [INFO ] [MAIN      ] CWEN: Starting full primary refresh.
[2025-10-24T18:11:20.704902] [INFO ] [REMOTE    ] CWEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:11:20.720996] [INFO ] [REMOTE    ] CW: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T18:11:20.947620] [INFO ] [REMOTE    ] CWEN: Fetching primary data for 2025-01.
[2025-10-24T18:11:21.077436] [INFO ] [REMOTE    ] CVX: Incremental fetch complete for 2025-05 (2.52 seconds).
[2025-10-24T18:11:21.747629] [INFO ] [REMOTE    ] CVX: Fetching primary data for 2025-06.
[2025-10-24T18:11:22.026330] [INFO ] [REMOTE    ] CWAN: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T18:11:22.107531] [INFO ] [REMOTE    ] CWEN: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T18:11:22.547675] [INFO ] [REMOTE    ] CWEN: Fetching primary data for 2025-02.
[2025-10-24T18:11:23.347618] [INFO ] [REMOTE    ] CW: Fetching primary data for 2025-06.
[2025-10-24T18:11:23.843226] [INFO ] [REMOTE    ] CVX: Incremental fetch complete for 2025-06 (2.10 seconds).
[2025-10-24T18:11:23.962680] [INFO ] [REMOTE    ] CWEN: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T18:11:24.147638] [INFO ] [REMOTE    ] CWEN: Fetching primary data for 2025-03.
[2025-10-24T18:11:24.580324] [INFO ] [REMOTE    ] CW: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T18:11:24.947689] [INFO ] [REMOTE    ] CWAN: Fetching primary data for 2025-02.
[2025-10-24T18:11:25.483233] [INFO ] [REMOTE    ] CWEN: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T18:11:25.747692] [INFO ] [REMOTE    ] CVX: Fetching primary data for 2025-07.
[2025-10-24T18:11:26.553315] [INFO ] [REMOTE    ] CWEN: Fetching primary data for 2025-04.
[2025-10-24T18:11:26.560629] [INFO ] [REMOTE    ] CWAN: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T18:11:27.347685] [INFO ] [REMOTE    ] CWAN: Fetching primary data for 2025-03.
[2025-10-24T18:11:27.697990] [INFO ] [REMOTE    ] CVX: Incremental fetch complete for 2025-07 (1.95 seconds).
[2025-10-24T18:11:28.102844] [INFO ] [REMOTE    ] CWEN: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T18:11:28.147705] [INFO ] [REMOTE    ] CWEN: Fetching primary data for 2025-05.
[2025-10-24T18:11:28.881605] [INFO ] [REMOTE    ] CWAN: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T18:11:28.947627] [INFO ] [REMOTE    ] CWAN: Fetching primary data for 2025-04.
[2025-10-24T18:11:29.690056] [INFO ] [REMOTE    ] CWEN: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T18:11:29.747597] [INFO ] [REMOTE    ] CWEN: Fetching primary data for 2025-06.
[2025-10-24T18:11:30.466466] [INFO ] [REMOTE    ] CWAN: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T18:11:30.547603] [INFO ] [REMOTE    ] CWAN: Fetching primary data for 2025-05.
[2025-10-24T18:11:31.331784] [INFO ] [REMOTE    ] CWEN: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T18:11:31.347570] [INFO ] [REMOTE    ] CW: Fetching primary data for 2025-07.
[2025-10-24T18:11:32.147677] [INFO ] [REMOTE    ] CWEN: Fetching primary data for 2025-07.
[2025-10-24T18:11:32.456192] [INFO ] [REMOTE    ] CWAN: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T18:11:32.479941] [INFO ] [REMOTE    ] CW: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T18:11:32.947705] [INFO ] [REMOTE    ] CW: Fetching primary data for 2025-08.
[2025-10-24T18:11:33.751703] [INFO ] [REMOTE    ] CVX: Fetching primary data for 2025-08.
[2025-10-24T18:11:33.757748] [INFO ] [REMOTE    ] CWEN: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T18:11:34.018347] [INFO ] [REMOTE    ] CW: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T18:11:34.547623] [INFO ] [REMOTE    ] CWAN: Fetching primary data for 2025-06.
[2025-10-24T18:11:35.347674] [INFO ] [REMOTE    ] CWEN: Fetching primary data for 2025-08.
[2025-10-24T18:11:35.922413] [INFO ] [REMOTE    ] CVX: Incremental fetch complete for 2025-08 (2.17 seconds).
[2025-10-24T18:11:36.152289] [INFO ] [REMOTE    ] CW: Fetching primary data for 2025-09.
[2025-10-24T18:11:36.157512] [INFO ] [REMOTE    ] CWAN: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T18:11:36.947750] [INFO ] [REMOTE    ] CVX: Fetching primary data for 2025-09.
[2025-10-24T18:11:36.992083] [INFO ] [REMOTE    ] CWEN: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T18:11:37.047507] [INFO ] [REMOTE    ] CW: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T18:11:37.747767] [INFO ] [REMOTE    ] CWAN: Fetching primary data for 2025-07.
[2025-10-24T18:11:38.547755] [INFO ] [REMOTE    ] CW: Fetching primary data for 2025-10.
[2025-10-24T18:11:39.221362] [INFO ] [REMOTE    ] CVX: Incremental fetch complete for 2025-09 (2.27 seconds).
[2025-10-24T18:11:39.347728] [INFO ] [REMOTE    ] CWEN: Fetching primary data for 2025-09.
[2025-10-24T18:11:39.416068] [INFO ] [REMOTE    ] CWAN: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T18:11:39.455703] [INFO ] [REMOTE    ] CW: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T18:11:39.460092] [INFO ] [REMOTE    ] CW: Full fetch complete (32859 records).
[2025-10-24T18:11:39.460262] [DEBUG] [VALIDATOR ] CW: Validating primary data.
[2025-10-24T18:11:39.842538] [DEBUG] [VALIDATOR ] CW: All expected trading days are present.
[2025-10-24T18:11:39.842635] [DEBUG] [VALIDATOR ] CW: Primary data validation passed.
[2025-10-24T18:11:39.843280] [INFO ] [MAIN      ] CW: Fetched primary data is valid.
[2025-10-24T18:11:39.843328] [DEBUG] [LOCAL     ] CW: Saving primary data.
[2025-10-24T18:11:39.843847] [FATAL] [LOCAL     ] CW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:11:39.843938] [FATAL] [MAIN      ] CW: Failed to save primary data.
[2025-10-24T18:11:39.843980] [WARN ] [MAIN      ] CW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:11:39.844014] [INFO ] [LOCAL     ] CW: Starting deletion of primary data.
[2025-10-24T18:11:39.844066] [DEBUG] [LOCAL     ] CW: No primary data file found to delete.
[2025-10-24T18:11:39.844102] [INFO ] [LOCAL     ] CW: Starting deletion of derivative data.
[2025-10-24T18:11:39.844239] [DEBUG] [LOCAL     ] CW: Deleted derivative data file.
[2025-10-24T18:11:39.844317] [INFO ] [MAIN      ] Update Progress: 569/2366 symbols completed. CW took 33.2s. Estimated remaining: 3h 46m 10s. Rate: 7.9 symbols/min
[2025-10-24T18:11:40.015846] [INFO ] [MAIN      ] CWH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:11:40.066225] [DEBUG] [LOCAL     ] CWH: Loaded 51624 existing records from primary storage.
[2025-10-24T18:11:40.066530] [INFO ] [MAIN      ] CWH: Loaded 51624 existing records.
[2025-10-24T18:11:40.155270] [INFO ] [REMOTE    ] CWAN: Fetching primary data for 2025-08.
[2025-10-24T18:11:40.243484] [WARN ] [MAIN      ] CWH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:11:40.243734] [INFO ] [MAIN      ] CWH: Wiping existing primary data before full refresh.
[2025-10-24T18:11:40.243790] [INFO ] [LOCAL     ] CWH: Starting deletion of primary data.
[2025-10-24T18:11:40.244255] [DEBUG] [LOCAL     ] CWH: Deleted primary data file.
[2025-10-24T18:11:40.244310] [INFO ] [MAIN      ] CWH: Starting full primary refresh.
[2025-10-24T18:11:40.608602] [INFO ] [REMOTE    ] CWH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:11:40.841166] [INFO ] [REMOTE    ] CWEN: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T18:11:40.947676] [INFO ] [REMOTE    ] CVX: Fetching primary data for 2025-10.
[2025-10-24T18:11:41.653414] [INFO ] [REMOTE    ] CWAN: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T18:11:41.747709] [INFO ] [REMOTE    ] CWH: Fetching primary data for 2025-01.
[2025-10-24T18:11:42.547714] [INFO ] [REMOTE    ] CWEN: Fetching primary data for 2025-10.
[2025-10-24T18:11:43.137341] [INFO ] [REMOTE    ] CWH: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T18:11:43.347623] [INFO ] [REMOTE    ] CWH: Fetching primary data for 2025-02.
[2025-10-24T18:11:43.451606] [INFO ] [REMOTE    ] CVX: Incremental fetch complete for 2025-10 (2.50 seconds).
[2025-10-24T18:11:43.461424] [INFO ] [REMOTE    ] CVX: Full fetch complete (77940 records).
[2025-10-24T18:11:43.461579] [DEBUG] [VALIDATOR ] CVX: Validating primary data.
[2025-10-24T18:11:43.855965] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present.
[2025-10-24T18:11:43.856046] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed.
[2025-10-24T18:11:43.856926] [INFO ] [MAIN      ] CVX: Fetched primary data is valid.
[2025-10-24T18:11:43.856987] [DEBUG] [LOCAL     ] CVX: Saving primary data.
[2025-10-24T18:11:43.857585] [FATAL] [LOCAL     ] CVX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:11:43.857722] [FATAL] [MAIN      ] CVX: Failed to save primary data.
[2025-10-24T18:11:43.857768] [WARN ] [MAIN      ] CVX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:11:43.857803] [INFO ] [LOCAL     ] CVX: Starting deletion of primary data.
[2025-10-24T18:11:43.857880] [DEBUG] [LOCAL     ] CVX: No primary data file found to delete.
[2025-10-24T18:11:43.857936] [INFO ] [LOCAL     ] CVX: Starting deletion of derivative data.
[2025-10-24T18:11:43.857980] [DEBUG] [LOCAL     ] CVX: No derivative data file found to delete.
[2025-10-24T18:11:43.858177] [INFO ] [MAIN      ] Update Progress: 570/2366 symbols completed. CVX took 38.3s. Estimated remaining: 3h 45m 52s. Rate: 8.0 symbols/min
[2025-10-24T18:11:44.030745] [INFO ] [MAIN      ] CWK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:11:44.063418] [INFO ] [REMOTE    ] CWEN: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T18:11:44.074888] [INFO ] [REMOTE    ] CWEN: Full fetch complete (65674 records).
[2025-10-24T18:11:44.075222] [DEBUG] [VALIDATOR ] CWEN: Validating primary data.
[2025-10-24T18:11:44.151445] [INFO ] [REMOTE    ] CWAN: Fetching primary data for 2025-09.
[2025-10-24T18:11:44.398241] [DEBUG] [LOCAL     ] CWK: Loaded 50023 existing records from primary storage.
[2025-10-24T18:11:44.409367] [INFO ] [MAIN      ] CWK: Loaded 50023 existing records.
[2025-10-24T18:11:44.686249] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present.
[2025-10-24T18:11:44.695122] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed.
[2025-10-24T18:11:44.696341] [INFO ] [MAIN      ] CWEN: Fetched primary data is valid.
[2025-10-24T18:11:44.718755] [WARN ] [MAIN      ] CWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:11:44.718871] [DEBUG] [LOCAL     ] CWEN: Saving primary data.
[2025-10-24T18:11:44.719466] [INFO ] [MAIN      ] CWK: Wiping existing primary data before full refresh.
[2025-10-24T18:11:44.719544] [INFO ] [LOCAL     ] CWK: Starting deletion of primary data.
[2025-10-24T18:11:44.719842] [FATAL] [LOCAL     ] CWEN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:11:44.720070] [DEBUG] [LOCAL     ] CWK: Deleted primary data file.
[2025-10-24T18:11:44.720222] [INFO ] [MAIN      ] CWK: Starting full primary refresh.
[2025-10-24T18:11:44.720133] [FATAL] [MAIN      ] CWEN: Failed to save primary data.
[2025-10-24T18:11:44.720339] [WARN ] [MAIN      ] CWEN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:11:44.756791] [INFO ] [LOCAL     ] CWEN: Starting deletion of primary data.
[2025-10-24T18:11:44.801378] [DEBUG] [LOCAL     ] CWEN: No primary data file found to delete.
[2025-10-24T18:11:44.811964] [INFO ] [LOCAL     ] CWEN: Starting deletion of derivative data.
[2025-10-24T18:11:44.819336] [DEBUG] [LOCAL     ] CWEN: Deleted derivative data file.
[2025-10-24T18:11:44.819594] [INFO ] [MAIN      ] Update Progress: 571/2366 symbols completed. CWEN took 24.9s. Estimated remaining: 3h 45m 24s. Rate: 8.0 symbols/min
[2025-10-24T18:11:44.965318] [INFO ] [REMOTE    ] CWH: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T18:11:45.028040] [INFO ] [REMOTE    ] CWH: Fetching primary data for 2025-03.
[2025-10-24T18:11:45.221837] [INFO ] [MAIN      ] CWT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:11:45.312487] [INFO ] [REMOTE    ] CWK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:11:45.324278] [DEBUG] [LOCAL     ] CWT: Loaded 28287 existing records from primary storage.
[2025-10-24T18:11:45.324510] [INFO ] [MAIN      ] CWT: Loaded 28287 existing records.
[2025-10-24T18:11:45.497962] [WARN ] [MAIN      ] CWT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:11:45.498193] [INFO ] [MAIN      ] CWT: Wiping existing primary data before full refresh.
[2025-10-24T18:11:45.498240] [INFO ] [LOCAL     ] CWT: Starting deletion of primary data.
[2025-10-24T18:11:45.498489] [DEBUG] [LOCAL     ] CWT: Deleted primary data file.
[2025-10-24T18:11:45.498528] [INFO ] [MAIN      ] CWT: Starting full primary refresh.
[2025-10-24T18:11:45.756626] [INFO ] [REMOTE    ] CWK: Fetching primary data for 2025-01.
[2025-10-24T18:11:45.855069] [INFO ] [REMOTE    ] CWT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:11:45.998531] [INFO ] [REMOTE    ] CWAN: Incremental fetch complete for 2025-09 (1.85 seconds).
[2025-10-24T18:11:46.373729] [INFO ] [REMOTE    ] CWH: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T18:11:46.547677] [INFO ] [REMOTE    ] CWT: Fetching primary data for 2025-01.
[2025-10-24T18:11:47.347751] [INFO ] [REMOTE    ] CWH: Fetching primary data for 2025-04.
[2025-10-24T18:11:47.383098] [INFO ] [REMOTE    ] CWK: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T18:11:47.856815] [INFO ] [REMOTE    ] CWT: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T18:11:48.147704] [INFO ] [REMOTE    ] CWAN: Fetching primary data for 2025-10.
[2025-10-24T18:11:48.947626] [INFO ] [REMOTE    ] CWK: Fetching primary data for 2025-02.
[2025-10-24T18:11:49.101498] [INFO ] [REMOTE    ] CWH: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T18:11:49.747620] [INFO ] [REMOTE    ] CWH: Fetching primary data for 2025-05.
[2025-10-24T18:11:50.086802] [INFO ] [REMOTE    ] CWAN: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T18:11:50.096426] [INFO ] [REMOTE    ] CWAN: Full fetch complete (75236 records).
[2025-10-24T18:11:50.096579] [DEBUG] [VALIDATOR ] CWAN: Validating primary data.
[2025-10-24T18:11:50.097428] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:11:50.097518] [FATAL] [MAIN      ] CWAN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:11:50.097560] [WARN ] [MAIN      ] CWAN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:11:50.097637] [INFO ] [LOCAL     ] CWAN: Starting deletion of primary data.
[2025-10-24T18:11:50.097757] [DEBUG] [LOCAL     ] CWAN: No primary data file found to delete.
[2025-10-24T18:11:50.097809] [INFO ] [LOCAL     ] CWAN: Starting deletion of derivative data.
[2025-10-24T18:11:50.098205] [DEBUG] [LOCAL     ] CWAN: Deleted derivative data file.
[2025-10-24T18:11:50.099119] [INFO ] [MAIN      ] Update Progress: 572/2366 symbols completed. CWAN took 31.0s. Estimated remaining: 3h 45m 9s. Rate: 8.0 symbols/min
[2025-10-24T18:11:50.286293] [INFO ] [MAIN      ] CX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:11:50.312826] [INFO ] [REMOTE    ] CWK: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T18:11:50.376046] [DEBUG] [LOCAL     ] CX: Loaded 53209 existing records from primary storage.
[2025-10-24T18:11:50.376484] [INFO ] [MAIN      ] CX: Loaded 53209 existing records.
[2025-10-24T18:11:50.553461] [INFO ] [REMOTE    ] CWT: Fetching primary data for 2025-02.
[2025-10-24T18:11:50.558778] [WARN ] [MAIN      ] CX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:11:50.560031] [INFO ] [MAIN      ] CX: Wiping existing primary data before full refresh.
[2025-10-24T18:11:50.560094] [INFO ] [LOCAL     ] CX: Starting deletion of primary data.
[2025-10-24T18:11:50.560344] [DEBUG] [LOCAL     ] CX: Deleted primary data file.
[2025-10-24T18:11:50.560388] [INFO ] [MAIN      ] CX: Starting full primary refresh.
[2025-10-24T18:11:50.927797] [INFO ] [REMOTE    ] CX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:11:51.100959] [INFO ] [REMOTE    ] CWH: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T18:11:51.347735] [INFO ] [REMOTE    ] CX: Fetching primary data for 2025-01.
[2025-10-24T18:11:51.912301] [INFO ] [REMOTE    ] CWT: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T18:11:52.147687] [INFO ] [REMOTE    ] CWT: Fetching primary data for 2025-03.
[2025-10-24T18:11:52.947732] [INFO ] [REMOTE    ] CWH: Fetching primary data for 2025-06.
[2025-10-24T18:11:53.161379] [INFO ] [REMOTE    ] CX: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T18:11:53.412209] [INFO ] [REMOTE    ] CWT: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T18:11:53.747686] [INFO ] [REMOTE    ] CWT: Fetching primary data for 2025-04.
[2025-10-24T18:11:54.436927] [INFO ] [REMOTE    ] CWH: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T18:11:54.547713] [INFO ] [REMOTE    ] CWH: Fetching primary data for 2025-07.
[2025-10-24T18:11:55.057915] [INFO ] [REMOTE    ] CWT: Incremental fetch complete for 2025-04 (1.31 seconds).
[2025-10-24T18:11:55.347714] [INFO ] [REMOTE    ] CX: Fetching primary data for 2025-02.
[2025-10-24T18:11:56.147632] [INFO ] [REMOTE    ] CWK: Fetching primary data for 2025-03.
[2025-10-24T18:11:56.282025] [INFO ] [REMOTE    ] CWH: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T18:11:56.947673] [INFO ] [REMOTE    ] CWH: Fetching primary data for 2025-08.
[2025-10-24T18:11:57.064492] [INFO ] [REMOTE    ] CX: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T18:11:57.547808] [INFO ] [REMOTE    ] CWK: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T18:11:57.747743] [INFO ] [REMOTE    ] CWT: Fetching primary data for 2025-05.
[2025-10-24T18:11:58.547615] [INFO ] [REMOTE    ] CWK: Fetching primary data for 2025-04.
[2025-10-24T18:11:58.822795] [INFO ] [REMOTE    ] CWH: Incremental fetch complete for 2025-08 (1.88 seconds).
[2025-10-24T18:11:59.318467] [INFO ] [REMOTE    ] CWT: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T18:11:59.347637] [INFO ] [REMOTE    ] CWT: Fetching primary data for 2025-06.
[2025-10-24T18:12:00.157421] [INFO ] [REMOTE    ] CX: Fetching primary data for 2025-03.
[2025-10-24T18:12:00.163336] [INFO ] [REMOTE    ] CWK: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T18:12:00.283230] [INFO ] [REMOTE    ] CWT: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T18:12:00.947723] [INFO ] [REMOTE    ] CWT: Fetching primary data for 2025-07.
[2025-10-24T18:12:01.747728] [INFO ] [REMOTE    ] CWH: Fetching primary data for 2025-09.
[2025-10-24T18:12:02.340880] [INFO ] [REMOTE    ] CX: Incremental fetch complete for 2025-03 (2.18 seconds).
[2025-10-24T18:12:02.547698] [INFO ] [REMOTE    ] CWK: Fetching primary data for 2025-05.
[2025-10-24T18:12:03.347750] [INFO ] [REMOTE    ] CX: Fetching primary data for 2025-04.
[2025-10-24T18:12:03.787493] [INFO ] [REMOTE    ] CWH: Incremental fetch complete for 2025-09 (2.04 seconds).
[2025-10-24T18:12:03.971100] [INFO ] [REMOTE    ] CWT: Incremental fetch complete for 2025-07 (3.02 seconds).
[2025-10-24T18:12:04.090515] [INFO ] [REMOTE    ] CWK: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T18:12:04.147731] [INFO ] [REMOTE    ] CWT: Fetching primary data for 2025-08.
[2025-10-24T18:12:04.947719] [INFO ] [REMOTE    ] CWK: Fetching primary data for 2025-06.
[2025-10-24T18:12:05.674845] [INFO ] [REMOTE    ] CX: Incremental fetch complete for 2025-04 (2.33 seconds).
[2025-10-24T18:12:05.747625] [INFO ] [REMOTE    ] CX: Fetching primary data for 2025-05.
[2025-10-24T18:12:05.791861] [INFO ] [REMOTE    ] CWT: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T18:12:06.547632] [INFO ] [REMOTE    ] CWT: Fetching primary data for 2025-09.
[2025-10-24T18:12:06.585422] [INFO ] [REMOTE    ] CWK: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T18:12:07.347703] [INFO ] [REMOTE    ] CWK: Fetching primary data for 2025-07.
[2025-10-24T18:12:07.844287] [INFO ] [REMOTE    ] CWT: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T18:12:08.147707] [INFO ] [REMOTE    ] CWT: Fetching primary data for 2025-10.
[2025-10-24T18:12:08.482150] [INFO ] [REMOTE    ] CX: Incremental fetch complete for 2025-05 (2.73 seconds).
[2025-10-24T18:12:08.947703] [INFO ] [REMOTE    ] CWH: Fetching primary data for 2025-10.
[2025-10-24T18:12:09.095774] [INFO ] [REMOTE    ] CWK: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T18:12:09.616460] [INFO ] [REMOTE    ] CWT: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T18:12:09.622047] [INFO ] [REMOTE    ] CWT: Full fetch complete (41357 records).
[2025-10-24T18:12:09.622133] [DEBUG] [VALIDATOR ] CWT: Validating primary data.
[2025-10-24T18:12:09.752740] [INFO ] [REMOTE    ] CWK: Fetching primary data for 2025-08.
[2025-10-24T18:12:10.048169] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present.
[2025-10-24T18:12:10.048257] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed.
[2025-10-24T18:12:10.049032] [INFO ] [MAIN      ] CWT: Fetched primary data is valid.
[2025-10-24T18:12:10.049096] [DEBUG] [LOCAL     ] CWT: Saving primary data.
[2025-10-24T18:12:10.049507] [FATAL] [LOCAL     ] CWT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:12:10.049628] [FATAL] [MAIN      ] CWT: Failed to save primary data.
[2025-10-24T18:12:10.049710] [WARN ] [MAIN      ] CWT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:12:10.049755] [INFO ] [LOCAL     ] CWT: Starting deletion of primary data.
[2025-10-24T18:12:10.049807] [DEBUG] [LOCAL     ] CWT: No primary data file found to delete.
[2025-10-24T18:12:10.049843] [INFO ] [LOCAL     ] CWT: Starting deletion of derivative data.
[2025-10-24T18:12:10.050055] [DEBUG] [LOCAL     ] CWT: Deleted derivative data file.
[2025-10-24T18:12:10.050149] [INFO ] [MAIN      ] Update Progress: 573/2366 symbols completed. CWT took 25.2s. Estimated remaining: 3h 45m 40s. Rate: 7.9 symbols/min
[2025-10-24T18:12:10.259715] [INFO ] [MAIN      ] CXE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:12:10.271150] [DEBUG] [LOCAL     ] CXE: Loaded 6427 existing records from primary storage.
[2025-10-24T18:12:10.271399] [INFO ] [MAIN      ] CXE: Loaded 6427 existing records.
[2025-10-24T18:12:10.487947] [INFO ] [REMOTE    ] CWH: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T18:12:10.532100] [WARN ] [MAIN      ] CXE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:12:10.532535] [INFO ] [MAIN      ] CXE: Wiping existing primary data before full refresh.
[2025-10-24T18:12:10.532588] [INFO ] [LOCAL     ] CXE: Starting deletion of primary data.
[2025-10-24T18:12:10.532811] [INFO ] [REMOTE    ] CWH: Full fetch complete (73237 records).
[2025-10-24T18:12:10.532890] [DEBUG] [LOCAL     ] CXE: Deleted primary data file.
[2025-10-24T18:12:10.533131] [DEBUG] [VALIDATOR ] CWH: Validating primary data.
[2025-10-24T18:12:10.533275] [INFO ] [MAIN      ] CXE: Starting full primary refresh.
[2025-10-24T18:12:10.557501] [INFO ] [REMOTE    ] CX: Fetching primary data for 2025-06.
[2025-10-24T18:12:11.454760] [INFO ] [REMOTE    ] CXE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:12:11.471153] [INFO ] [REMOTE    ] CXE: Fetching primary data for 2025-01.
[2025-10-24T18:12:11.568474] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present.
[2025-10-24T18:12:11.568587] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed.
[2025-10-24T18:12:11.569597] [INFO ] [MAIN      ] CWH: Fetched primary data is valid.
[2025-10-24T18:12:11.569704] [DEBUG] [LOCAL     ] CWH: Saving primary data.
[2025-10-24T18:12:11.570341] [FATAL] [LOCAL     ] CWH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:12:11.570444] [FATAL] [MAIN      ] CWH: Failed to save primary data.
[2025-10-24T18:12:11.570535] [WARN ] [MAIN      ] CWH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:12:11.570619] [INFO ] [LOCAL     ] CWH: Starting deletion of primary data.
[2025-10-24T18:12:11.570817] [DEBUG] [LOCAL     ] CWH: No primary data file found to delete.
[2025-10-24T18:12:11.570884] [INFO ] [LOCAL     ] CWH: Starting deletion of derivative data.
[2025-10-24T18:12:11.571054] [DEBUG] [LOCAL     ] CWH: Deleted derivative data file.
[2025-10-24T18:12:11.571444] [INFO ] [MAIN      ] Update Progress: 574/2366 symbols completed. CWH took 31.7s. Estimated remaining: 3h 45m 14s. Rate: 8.0 symbols/min
[2025-10-24T18:12:11.744837] [INFO ] [REMOTE    ] CWK: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T18:12:11.799925] [INFO ] [MAIN      ] CXH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:12:11.806472] [DEBUG] [LOCAL     ] CXH: Loaded 4401 existing records from primary storage.
[2025-10-24T18:12:11.806711] [INFO ] [MAIN      ] CXH: Loaded 4401 existing records.
[2025-10-24T18:12:11.984465] [WARN ] [MAIN      ] CXH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:12:11.984841] [INFO ] [MAIN      ] CXH: Wiping existing primary data before full refresh.
[2025-10-24T18:12:11.984950] [INFO ] [LOCAL     ] CXH: Starting deletion of primary data.
[2025-10-24T18:12:11.985229] [DEBUG] [LOCAL     ] CXH: Deleted primary data file.
[2025-10-24T18:12:11.985365] [INFO ] [MAIN      ] CXH: Starting full primary refresh.
[2025-10-24T18:12:12.160271] [INFO ] [REMOTE    ] CWK: Fetching primary data for 2025-09.
[2025-10-24T18:12:12.345476] [INFO ] [REMOTE    ] CX: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T18:12:12.387568] [INFO ] [REMOTE    ] CXH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:12:12.430253] [INFO ] [REMOTE    ] CXE: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T18:12:12.947722] [INFO ] [REMOTE    ] CXE: Fetching primary data for 2025-02.
[2025-10-24T18:12:13.682087] [INFO ] [REMOTE    ] CXE: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T18:12:13.747697] [INFO ] [REMOTE    ] CXH: Fetching primary data for 2025-01.
[2025-10-24T18:12:13.928829] [INFO ] [REMOTE    ] CWK: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T18:12:14.320726] [INFO ] [REMOTE    ] CXH: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T18:12:14.547679] [INFO ] [REMOTE    ] CXH: Fetching primary data for 2025-02.
[2025-10-24T18:12:15.011878] [INFO ] [REMOTE    ] CXH: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T18:12:15.347718] [INFO ] [REMOTE    ] CXE: Fetching primary data for 2025-03.
[2025-10-24T18:12:16.034241] [INFO ] [REMOTE    ] CXE: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T18:12:16.147629] [INFO ] [REMOTE    ] CXE: Fetching primary data for 2025-04.
[2025-10-24T18:12:16.874468] [INFO ] [REMOTE    ] CXE: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T18:12:16.947689] [INFO ] [REMOTE    ] CXE: Fetching primary data for 2025-05.
[2025-10-24T18:12:17.685912] [INFO ] [REMOTE    ] CXE: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T18:12:17.747624] [INFO ] [REMOTE    ] CXE: Fetching primary data for 2025-06.
[2025-10-24T18:12:18.368438] [INFO ] [REMOTE    ] CXE: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T18:12:18.547680] [INFO ] [REMOTE    ] CXH: Fetching primary data for 2025-03.
[2025-10-24T18:12:18.996785] [INFO ] [REMOTE    ] CXH: Incremental fetch complete for 2025-03 (0.45 seconds).
[2025-10-24T18:12:19.347693] [INFO ] [REMOTE    ] CXE: Fetching primary data for 2025-07.
[2025-10-24T18:12:19.979001] [INFO ] [REMOTE    ] CXE: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T18:12:20.147679] [INFO ] [REMOTE    ] CXH: Fetching primary data for 2025-04.
[2025-10-24T18:12:20.561193] [INFO ] [REMOTE    ] CXH: Incremental fetch complete for 2025-04 (0.41 seconds).
[2025-10-24T18:12:20.947688] [INFO ] [REMOTE    ] CXE: Fetching primary data for 2025-08.
[2025-10-24T18:12:21.570892] [INFO ] [REMOTE    ] CXE: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T18:12:21.747702] [INFO ] [REMOTE    ] CXH: Fetching primary data for 2025-05.
[2025-10-24T18:12:22.323717] [INFO ] [REMOTE    ] CXH: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T18:12:22.547710] [INFO ] [REMOTE    ] CWK: Fetching primary data for 2025-10.
[2025-10-24T18:12:23.347670] [INFO ] [REMOTE    ] CXE: Fetching primary data for 2025-09.
[2025-10-24T18:12:24.145427] [INFO ] [REMOTE    ] CXE: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T18:12:24.147686] [INFO ] [REMOTE    ] CX: Fetching primary data for 2025-07.
[2025-10-24T18:12:24.392820] [INFO ] [REMOTE    ] CWK: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T18:12:24.402180] [INFO ] [REMOTE    ] CWK: Full fetch complete (71419 records).
[2025-10-24T18:12:24.402329] [DEBUG] [VALIDATOR ] CWK: Validating primary data.
[2025-10-24T18:12:24.791537] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present.
[2025-10-24T18:12:24.791631] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed.
[2025-10-24T18:12:24.792561] [INFO ] [MAIN      ] CWK: Fetched primary data is valid.
[2025-10-24T18:12:24.792615] [DEBUG] [LOCAL     ] CWK: Saving primary data.
[2025-10-24T18:12:24.793417] [FATAL] [LOCAL     ] CWK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:12:24.793525] [FATAL] [MAIN      ] CWK: Failed to save primary data.
[2025-10-24T18:12:24.793567] [WARN ] [MAIN      ] CWK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:12:24.793603] [INFO ] [LOCAL     ] CWK: Starting deletion of primary data.
[2025-10-24T18:12:24.793683] [DEBUG] [LOCAL     ] CWK: No primary data file found to delete.
[2025-10-24T18:12:24.793752] [INFO ] [LOCAL     ] CWK: Starting deletion of derivative data.
[2025-10-24T18:12:24.793890] [DEBUG] [LOCAL     ] CWK: Deleted derivative data file.
[2025-10-24T18:12:24.794235] [INFO ] [MAIN      ] Update Progress: 575/2366 symbols completed. CWK took 40.9s. Estimated remaining: 3h 45m 24s. Rate: 7.9 symbols/min
[2025-10-24T18:12:24.970509] [INFO ] [MAIN      ] CXM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:12:24.967319] [INFO ] [REMOTE    ] CXE: Fetching primary data for 2025-10.
[2025-10-24T18:12:25.014845] [DEBUG] [LOCAL     ] CXM: Loaded 47703 existing records from primary storage.
[2025-10-24T18:12:25.015216] [INFO ] [MAIN      ] CXM: Loaded 47703 existing records.
[2025-10-24T18:12:25.191912] [WARN ] [MAIN      ] CXM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:12:25.192234] [INFO ] [MAIN      ] CXM: Wiping existing primary data before full refresh.
[2025-10-24T18:12:25.192293] [INFO ] [LOCAL     ] CXM: Starting deletion of primary data.
[2025-10-24T18:12:25.193064] [DEBUG] [LOCAL     ] CXM: Deleted primary data file.
[2025-10-24T18:12:25.193133] [INFO ] [MAIN      ] CXM: Starting full primary refresh.
[2025-10-24T18:12:25.548252] [INFO ] [REMOTE    ] CXM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:12:25.553841] [INFO ] [REMOTE    ] CXE: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T18:12:25.555750] [INFO ] [REMOTE    ] CXE: Full fetch complete (11140 records).
[2025-10-24T18:12:25.555823] [DEBUG] [VALIDATOR ] CXE: Validating primary data.
[2025-10-24T18:12:25.754486] [INFO ] [REMOTE    ] CXH: Fetching primary data for 2025-06.
[2025-10-24T18:12:25.951202] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present.
[2025-10-24T18:12:25.951306] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed.
[2025-10-24T18:12:25.951681] [INFO ] [MAIN      ] CXE: Fetched primary data is valid.
[2025-10-24T18:12:25.951787] [DEBUG] [LOCAL     ] CXE: Saving primary data.
[2025-10-24T18:12:25.952127] [FATAL] [LOCAL     ] CXE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:12:25.952224] [FATAL] [MAIN      ] CXE: Failed to save primary data.
[2025-10-24T18:12:25.952351] [WARN ] [MAIN      ] CXE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:12:25.952553] [INFO ] [LOCAL     ] CXE: Starting deletion of primary data.
[2025-10-24T18:12:25.952610] [DEBUG] [LOCAL     ] CXE: No primary data file found to delete.
[2025-10-24T18:12:25.952675] [INFO ] [LOCAL     ] CXE: Starting deletion of derivative data.
[2025-10-24T18:12:25.982543] [DEBUG] [LOCAL     ] CXE: Deleted derivative data file.
[2025-10-24T18:12:25.982804] [INFO ] [MAIN      ] Update Progress: 576/2366 symbols completed. CXE took 15.9s. Estimated remaining: 3h 44m 57s. Rate: 8.0 symbols/min
[2025-10-24T18:12:26.030956] [INFO ] [REMOTE    ] CX: Incremental fetch complete for 2025-07 (1.88 seconds).
[2025-10-24T18:12:26.181855] [INFO ] [MAIN      ] CXT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:12:26.211935] [DEBUG] [LOCAL     ] CXT: Loaded 30880 existing records from primary storage.
[2025-10-24T18:12:26.212212] [INFO ] [MAIN      ] CXT: Loaded 30880 existing records.
[2025-10-24T18:12:26.403092] [WARN ] [MAIN      ] CXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:12:26.403376] [INFO ] [MAIN      ] CXT: Wiping existing primary data before full refresh.
[2025-10-24T18:12:26.403433] [INFO ] [LOCAL     ] CXT: Starting deletion of primary data.
[2025-10-24T18:12:26.403637] [DEBUG] [LOCAL     ] CXT: Deleted primary data file.
[2025-10-24T18:12:26.403718] [INFO ] [MAIN      ] CXT: Starting full primary refresh.
[2025-10-24T18:12:26.494203] [INFO ] [REMOTE    ] CXH: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T18:12:26.552769] [INFO ] [REMOTE    ] CX: Fetching primary data for 2025-08.
[2025-10-24T18:12:26.795260] [INFO ] [REMOTE    ] CXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:12:27.347668] [INFO ] [REMOTE    ] CXH: Fetching primary data for 2025-07.
[2025-10-24T18:12:28.147619] [INFO ] [REMOTE    ] CXT: Fetching primary data for 2025-01.
[2025-10-24T18:12:28.158550] [INFO ] [REMOTE    ] CXH: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T18:12:28.250416] [INFO ] [REMOTE    ] CX: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T18:12:28.947717] [INFO ] [REMOTE    ] CX: Fetching primary data for 2025-09.
[2025-10-24T18:12:29.083504] [INFO ] [REMOTE    ] CXT: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T18:12:29.747736] [INFO ] [REMOTE    ] CXT: Fetching primary data for 2025-02.
[2025-10-24T18:12:30.552798] [INFO ] [REMOTE    ] CXM: Fetching primary data for 2025-01.
[2025-10-24T18:12:30.573187] [INFO ] [REMOTE    ] CX: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T18:12:31.056696] [INFO ] [REMOTE    ] CXT: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T18:12:31.347705] [INFO ] [REMOTE    ] CXH: Fetching primary data for 2025-08.
[2025-10-24T18:12:31.998026] [INFO ] [REMOTE    ] CXH: Incremental fetch complete for 2025-08 (0.65 seconds).
[2025-10-24T18:12:32.026240] [INFO ] [REMOTE    ] CXM: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T18:12:32.147696] [INFO ] [REMOTE    ] CXH: Fetching primary data for 2025-09.
[2025-10-24T18:12:32.723291] [INFO ] [REMOTE    ] CXH: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T18:12:32.947676] [INFO ] [REMOTE    ] CXM: Fetching primary data for 2025-02.
[2025-10-24T18:12:33.747705] [INFO ] [REMOTE    ] CX: Fetching primary data for 2025-10.
[2025-10-24T18:12:34.461186] [INFO ] [REMOTE    ] CXM: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T18:12:34.547682] [INFO ] [REMOTE    ] CXM: Fetching primary data for 2025-03.
[2025-10-24T18:12:35.338435] [INFO ] [REMOTE    ] CX: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T18:12:35.347718] [INFO ] [REMOTE    ] CXT: Fetching primary data for 2025-03.
[2025-10-24T18:12:35.349085] [INFO ] [REMOTE    ] CX: Full fetch complete (76573 records).
[2025-10-24T18:12:35.349305] [DEBUG] [VALIDATOR ] CX: Validating primary data.
[2025-10-24T18:12:35.748044] [DEBUG] [VALIDATOR ] CX: All expected trading days are present.
[2025-10-24T18:12:35.748123] [DEBUG] [VALIDATOR ] CX: Primary data validation passed.
[2025-10-24T18:12:35.749099] [INFO ] [MAIN      ] CX: Fetched primary data is valid.
[2025-10-24T18:12:35.749337] [DEBUG] [LOCAL     ] CX: Saving primary data.
[2025-10-24T18:12:35.750098] [FATAL] [LOCAL     ] CX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:12:35.750276] [FATAL] [MAIN      ] CX: Failed to save primary data.
[2025-10-24T18:12:35.750356] [WARN ] [MAIN      ] CX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:12:35.750437] [INFO ] [LOCAL     ] CX: Starting deletion of primary data.
[2025-10-24T18:12:35.750514] [DEBUG] [LOCAL     ] CX: No primary data file found to delete.
[2025-10-24T18:12:35.750564] [INFO ] [LOCAL     ] CX: Starting deletion of derivative data.
[2025-10-24T18:12:35.750752] [DEBUG] [LOCAL     ] CX: Deleted derivative data file.
[2025-10-24T18:12:35.751053] [INFO ] [MAIN      ] Update Progress: 577/2366 symbols completed. CX took 45.7s. Estimated remaining: 3h 44m 56s. Rate: 8.0 symbols/min
[2025-10-24T18:12:35.937741] [INFO ] [MAIN      ] CXW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:12:35.966862] [INFO ] [REMOTE    ] CXM: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T18:12:36.011854] [DEBUG] [LOCAL     ] CXW: Loaded 43910 existing records from primary storage.
[2025-10-24T18:12:36.012153] [INFO ] [MAIN      ] CXW: Loaded 43910 existing records.
[2025-10-24T18:12:36.152739] [INFO ] [REMOTE    ] CXH: Fetching primary data for 2025-10.
[2025-10-24T18:12:36.188196] [WARN ] [MAIN      ] CXW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:12:36.188385] [INFO ] [MAIN      ] CXW: Wiping existing primary data before full refresh.
[2025-10-24T18:12:36.188430] [INFO ] [LOCAL     ] CXW: Starting deletion of primary data.
[2025-10-24T18:12:36.188820] [DEBUG] [LOCAL     ] CXW: Deleted primary data file.
[2025-10-24T18:12:36.188876] [INFO ] [MAIN      ] CXW: Starting full primary refresh.
[2025-10-24T18:12:36.550306] [INFO ] [REMOTE    ] CXW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:12:36.570595] [INFO ] [REMOTE    ] CXT: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T18:12:36.887752] [INFO ] [REMOTE    ] CXH: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T18:12:36.888636] [INFO ] [REMOTE    ] CXH: Full fetch complete (5300 records).
[2025-10-24T18:12:36.888739] [DEBUG] [VALIDATOR ] CXH: Validating primary data.
[2025-10-24T18:12:36.952948] [INFO ] [REMOTE    ] CXT: Fetching primary data for 2025-04.
[2025-10-24T18:12:37.246980] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present.
[2025-10-24T18:12:37.247054] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed.
[2025-10-24T18:12:37.247230] [INFO ] [MAIN      ] CXH: Fetched primary data is valid.
[2025-10-24T18:12:37.247290] [DEBUG] [LOCAL     ] CXH: Saving primary data.
[2025-10-24T18:12:37.247469] [FATAL] [LOCAL     ] CXH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:12:37.247546] [FATAL] [MAIN      ] CXH: Failed to save primary data.
[2025-10-24T18:12:37.247587] [WARN ] [MAIN      ] CXH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:12:37.247667] [INFO ] [LOCAL     ] CXH: Starting deletion of primary data.
[2025-10-24T18:12:37.247753] [DEBUG] [LOCAL     ] CXH: No primary data file found to delete.
[2025-10-24T18:12:37.247800] [INFO ] [LOCAL     ] CXH: Starting deletion of derivative data.
[2025-10-24T18:12:37.247943] [DEBUG] [LOCAL     ] CXH: Deleted derivative data file.
[2025-10-24T18:12:37.248035] [INFO ] [MAIN      ] Update Progress: 578/2366 symbols completed. CXH took 25.7s. Estimated remaining: 3h 44m 30s. Rate: 8.0 symbols/min
[2025-10-24T18:12:37.419557] [INFO ] [MAIN      ] CYD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:12:37.446484] [DEBUG] [LOCAL     ] CYD: Loaded 27482 existing records from primary storage.
[2025-10-24T18:12:37.446785] [INFO ] [MAIN      ] CYD: Loaded 27482 existing records.
[2025-10-24T18:12:37.623292] [WARN ] [MAIN      ] CYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:12:37.623488] [INFO ] [MAIN      ] CYD: Wiping existing primary data before full refresh.
[2025-10-24T18:12:37.623569] [INFO ] [LOCAL     ] CYD: Starting deletion of primary data.
[2025-10-24T18:12:37.623966] [DEBUG] [LOCAL     ] CYD: Deleted primary data file.
[2025-10-24T18:12:37.624024] [INFO ] [MAIN      ] CYD: Starting full primary refresh.
[2025-10-24T18:12:37.762352] [INFO ] [REMOTE    ] CXW: Fetching primary data for 2025-01.
[2025-10-24T18:12:37.994031] [INFO ] [REMOTE    ] CYD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:12:38.449498] [INFO ] [REMOTE    ] CXT: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T18:12:38.547634] [INFO ] [REMOTE    ] CXT: Fetching primary data for 2025-05.
[2025-10-24T18:12:39.347621] [INFO ] [REMOTE    ] CXM: Fetching primary data for 2025-04.
[2025-10-24T18:12:39.681791] [INFO ] [REMOTE    ] CXW: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T18:12:39.729776] [INFO ] [REMOTE    ] CXT: Incremental fetch complete for 2025-05 (1.18 seconds).
[2025-10-24T18:12:40.147696] [INFO ] [REMOTE    ] CYD: Fetching primary data for 2025-01.
[2025-10-24T18:12:40.833814] [INFO ] [REMOTE    ] CXM: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T18:12:40.933589] [INFO ] [REMOTE    ] CYD: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T18:12:40.947591] [INFO ] [REMOTE    ] CYD: Fetching primary data for 2025-02.
[2025-10-24T18:12:41.747720] [INFO ] [REMOTE    ] CXW: Fetching primary data for 2025-02.
[2025-10-24T18:12:41.991621] [INFO ] [REMOTE    ] CYD: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T18:12:42.547682] [INFO ] [REMOTE    ] CYD: Fetching primary data for 2025-03.
[2025-10-24T18:12:43.053512] [INFO ] [REMOTE    ] CXW: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T18:12:43.347690] [INFO ] [REMOTE    ] CXW: Fetching primary data for 2025-03.
[2025-10-24T18:12:43.438573] [INFO ] [REMOTE    ] CYD: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T18:12:44.147691] [INFO ] [REMOTE    ] CXM: Fetching primary data for 2025-05.
[2025-10-24T18:12:44.947695] [INFO ] [REMOTE    ] CYD: Fetching primary data for 2025-04.
[2025-10-24T18:12:45.035452] [INFO ] [REMOTE    ] CXW: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T18:12:45.514334] [INFO ] [REMOTE    ] CXM: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T18:12:45.747722] [INFO ] [REMOTE    ] CXM: Fetching primary data for 2025-06.
[2025-10-24T18:12:45.908302] [INFO ] [REMOTE    ] CYD: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T18:12:46.547690] [INFO ] [REMOTE    ] CXW: Fetching primary data for 2025-04.
[2025-10-24T18:12:47.205119] [INFO ] [REMOTE    ] CXM: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T18:12:47.347622] [INFO ] [REMOTE    ] CXM: Fetching primary data for 2025-07.
[2025-10-24T18:12:48.147628] [INFO ] [REMOTE    ] CXT: Fetching primary data for 2025-06.
[2025-10-24T18:12:48.271294] [INFO ] [REMOTE    ] CXW: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T18:12:48.845277] [INFO ] [REMOTE    ] CXM: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T18:12:48.947669] [INFO ] [REMOTE    ] CXM: Fetching primary data for 2025-08.
[2025-10-24T18:12:49.747755] [INFO ] [REMOTE    ] CXW: Fetching primary data for 2025-05.
[2025-10-24T18:12:49.769192] [INFO ] [REMOTE    ] CXT: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T18:12:50.324775] [INFO ] [REMOTE    ] CXM: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T18:12:50.547696] [INFO ] [REMOTE    ] CXT: Fetching primary data for 2025-07.
[2025-10-24T18:12:51.251743] [INFO ] [REMOTE    ] CXW: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T18:12:51.335808] [INFO ] [REMOTE    ] CXT: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T18:12:51.347612] [INFO ] [REMOTE    ] CXT: Fetching primary data for 2025-08.
[2025-10-24T18:12:52.147718] [INFO ] [REMOTE    ] CYD: Fetching primary data for 2025-05.
[2025-10-24T18:12:52.648440] [INFO ] [REMOTE    ] CXT: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T18:12:52.947639] [INFO ] [REMOTE    ] CXM: Fetching primary data for 2025-09.
[2025-10-24T18:12:53.378872] [INFO ] [REMOTE    ] CYD: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T18:12:53.747712] [INFO ] [REMOTE    ] CYD: Fetching primary data for 2025-06.
[2025-10-24T18:12:54.547621] [INFO ] [REMOTE    ] CXW: Fetching primary data for 2025-06.
[2025-10-24T18:12:54.628136] [INFO ] [REMOTE    ] CXM: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T18:12:54.685565] [INFO ] [REMOTE    ] CYD: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T18:12:55.347677] [INFO ] [REMOTE    ] CYD: Fetching primary data for 2025-07.
[2025-10-24T18:12:55.794213] [INFO ] [REMOTE    ] CXW: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T18:12:56.147682] [INFO ] [REMOTE    ] CXW: Fetching primary data for 2025-07.
[2025-10-24T18:12:56.539686] [INFO ] [REMOTE    ] CYD: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T18:12:56.947638] [INFO ] [REMOTE    ] CYD: Fetching primary data for 2025-08.
[2025-10-24T18:12:57.469144] [INFO ] [REMOTE    ] CXW: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T18:12:57.747719] [INFO ] [REMOTE    ] CXT: Fetching primary data for 2025-09.
[2025-10-24T18:12:58.101875] [INFO ] [REMOTE    ] CYD: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T18:12:58.547724] [INFO ] [REMOTE    ] CXW: Fetching primary data for 2025-08.
[2025-10-24T18:12:58.874718] [INFO ] [REMOTE    ] CXT: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T18:12:59.347680] [INFO ] [REMOTE    ] CXT: Fetching primary data for 2025-10.
[2025-10-24T18:13:00.024509] [INFO ] [REMOTE    ] CXW: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T18:13:00.147758] [INFO ] [REMOTE    ] CYD: Fetching primary data for 2025-09.
[2025-10-24T18:13:00.947741] [INFO ] [REMOTE    ] CXM: Fetching primary data for 2025-10.
[2025-10-24T18:13:01.193156] [INFO ] [REMOTE    ] CXT: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T18:13:01.199977] [INFO ] [REMOTE    ] CXT: Full fetch complete (45587 records).
[2025-10-24T18:13:01.200224] [DEBUG] [VALIDATOR ] CXT: Validating primary data.
[2025-10-24T18:13:01.595630] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present.
[2025-10-24T18:13:01.595797] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed.
[2025-10-24T18:13:01.596793] [INFO ] [MAIN      ] CXT: Fetched primary data is valid.
[2025-10-24T18:13:01.596865] [DEBUG] [LOCAL     ] CXT: Saving primary data.
[2025-10-24T18:13:01.597552] [FATAL] [LOCAL     ] CXT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:13:01.597685] [FATAL] [MAIN      ] CXT: Failed to save primary data.
[2025-10-24T18:13:01.597798] [WARN ] [MAIN      ] CXT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:13:01.597870] [INFO ] [LOCAL     ] CXT: Starting deletion of primary data.
[2025-10-24T18:13:01.597937] [DEBUG] [LOCAL     ] CXT: No primary data file found to delete.
[2025-10-24T18:13:01.597974] [INFO ] [LOCAL     ] CXT: Starting deletion of derivative data.
[2025-10-24T18:13:01.598134] [DEBUG] [LOCAL     ] CXT: Deleted derivative data file.
[2025-10-24T18:13:01.598234] [INFO ] [MAIN      ] Update Progress: 579/2366 symbols completed. CXT took 35.6s. Estimated remaining: 3h 45m 14s. Rate: 7.9 symbols/min
[2025-10-24T18:13:01.749915] [INFO ] [REMOTE    ] CXW: Fetching primary data for 2025-09.
[2025-10-24T18:13:01.812399] [INFO ] [MAIN      ] CYH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:13:01.833637] [INFO ] [REMOTE    ] CYD: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T18:13:01.880216] [DEBUG] [LOCAL     ] CYH: Loaded 47987 existing records from primary storage.
[2025-10-24T18:13:01.880526] [INFO ] [MAIN      ] CYH: Loaded 47987 existing records.
[2025-10-24T18:13:02.064252] [WARN ] [MAIN      ] CYH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:13:02.064445] [INFO ] [MAIN      ] CYH: Wiping existing primary data before full refresh.
[2025-10-24T18:13:02.064492] [INFO ] [LOCAL     ] CYH: Starting deletion of primary data.
[2025-10-24T18:13:02.064895] [DEBUG] [LOCAL     ] CYH: Deleted primary data file.
[2025-10-24T18:13:02.064951] [INFO ] [MAIN      ] CYH: Starting full primary refresh.
[2025-10-24T18:13:02.415223] [INFO ] [REMOTE    ] CYH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:13:02.547675] [INFO ] [REMOTE    ] CYD: Fetching primary data for 2025-10.
[2025-10-24T18:13:03.347694] [INFO ] [REMOTE    ] CYH: Fetching primary data for 2025-01.
[2025-10-24T18:13:04.133568] [INFO ] [REMOTE    ] CXM: Incremental fetch complete for 2025-10 (3.19 seconds).
[2025-10-24T18:13:04.142575] [INFO ] [REMOTE    ] CXM: Full fetch complete (68440 records).
[2025-10-24T18:13:04.142759] [DEBUG] [VALIDATOR ] CXM: Validating primary data.
[2025-10-24T18:13:04.478617] [INFO ] [REMOTE    ] CXW: Incremental fetch complete for 2025-09 (2.73 seconds).
[2025-10-24T18:13:04.567493] [INFO ] [REMOTE    ] CYD: Incremental fetch complete for 2025-10 (2.02 seconds).
[2025-10-24T18:13:04.573309] [INFO ] [REMOTE    ] CXW: Fetching primary data for 2025-10.
[2025-10-24T18:13:04.657643] [INFO ] [REMOTE    ] CYD: Full fetch complete (36377 records).
[2025-10-24T18:13:04.658154] [DEBUG] [VALIDATOR ] CYD: Validating primary data.
[2025-10-24T18:13:04.658282] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present.
[2025-10-24T18:13:04.658586] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed.
[2025-10-24T18:13:04.659721] [INFO ] [MAIN      ] CXM: Fetched primary data is valid.
[2025-10-24T18:13:04.660243] [DEBUG] [LOCAL     ] CXM: Saving primary data.
[2025-10-24T18:13:04.707009] [FATAL] [LOCAL     ] CXM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:13:04.730352] [FATAL] [MAIN      ] CXM: Failed to save primary data.
[2025-10-24T18:13:04.755427] [WARN ] [MAIN      ] CXM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:13:04.777571] [INFO ] [LOCAL     ] CXM: Starting deletion of primary data.
[2025-10-24T18:13:04.777952] [DEBUG] [LOCAL     ] CXM: No primary data file found to delete.
[2025-10-24T18:13:04.778174] [INFO ] [LOCAL     ] CXM: Starting deletion of derivative data.
[2025-10-24T18:13:04.778557] [DEBUG] [LOCAL     ] CXM: Deleted derivative data file.
[2025-10-24T18:13:04.784477] [INFO ] [MAIN      ] Update Progress: 580/2366 symbols completed. CXM took 40.0s. Estimated remaining: 3h 44m 53s. Rate: 7.9 symbols/min
[2025-10-24T18:13:05.248317] [INFO ] [MAIN      ] D: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:13:05.331042] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present.
[2025-10-24T18:13:05.349096] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed.
[2025-10-24T18:13:05.363497] [INFO ] [MAIN      ] CYD: Fetched primary data is valid.
[2025-10-24T18:13:05.364067] [DEBUG] [LOCAL     ] CYD: Saving primary data.
[2025-10-24T18:13:05.365538] [INFO ] [REMOTE    ] CYH: Incremental fetch complete for 2025-01 (2.02 seconds).
[2025-10-24T18:13:05.376047] [INFO ] [REMOTE    ] CYH: Fetching primary data for 2025-02.
[2025-10-24T18:13:05.376247] [FATAL] [LOCAL     ] CYD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:13:05.377599] [FATAL] [MAIN      ] CYD: Failed to save primary data.
[2025-10-24T18:13:05.377728] [WARN ] [MAIN      ] CYD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:13:05.377790] [INFO ] [LOCAL     ] CYD: Starting deletion of primary data.
[2025-10-24T18:13:05.377846] [DEBUG] [LOCAL     ] CYD: No primary data file found to delete.
[2025-10-24T18:13:05.377882] [INFO ] [LOCAL     ] CYD: Starting deletion of derivative data.
[2025-10-24T18:13:05.378039] [DEBUG] [LOCAL     ] CYD: Deleted derivative data file.
[2025-10-24T18:13:05.378135] [INFO ] [MAIN      ] Update Progress: 581/2366 symbols completed. CYD took 28.1s. Estimated remaining: 3h 44m 24s. Rate: 8.0 symbols/min
[2025-10-24T18:13:05.582739] [INFO ] [MAIN      ] DAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:13:05.583049] [DEBUG] [LOCAL     ] DAC: No existing data file found in primary storage.
[2025-10-24T18:13:05.583097] [WARN ] [MAIN      ] DAC: No existing data found, performing full refresh instead.
[2025-10-24T18:13:05.583223] [INFO ] [MAIN      ] DAC: Wiping existing primary data before full refresh.
[2025-10-24T18:13:05.583266] [INFO ] [LOCAL     ] DAC: Starting deletion of primary data.
[2025-10-24T18:13:05.583312] [DEBUG] [LOCAL     ] DAC: No primary data file found to delete.
[2025-10-24T18:13:05.583350] [INFO ] [MAIN      ] DAC: Starting full primary refresh.
[2025-10-24T18:13:05.733805] [DEBUG] [LOCAL     ] D: Loaded 54039 existing records from primary storage.
[2025-10-24T18:13:05.779354] [INFO ] [MAIN      ] D: Loaded 54039 existing records.
[2025-10-24T18:13:06.154992] [INFO ] [REMOTE    ] DAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:13:06.190001] [INFO ] [REMOTE    ] DAC: Fetching primary data for 2025-01.
[2025-10-24T18:13:06.189638] [WARN ] [MAIN      ] D: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:13:06.191197] [INFO ] [MAIN      ] D: Wiping existing primary data before full refresh.
[2025-10-24T18:13:06.191385] [INFO ] [LOCAL     ] D: Starting deletion of primary data.
[2025-10-24T18:13:06.191744] [DEBUG] [LOCAL     ] D: Deleted primary data file.
[2025-10-24T18:13:06.191894] [INFO ] [MAIN      ] D: Starting full primary refresh.
[2025-10-24T18:13:06.387885] [INFO ] [REMOTE    ] CXW: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T18:13:06.434462] [INFO ] [REMOTE    ] CXW: Full fetch complete (64738 records).
[2025-10-24T18:13:06.466108] [DEBUG] [VALIDATOR ] CXW: Validating primary data.
[2025-10-24T18:13:06.825517] [INFO ] [REMOTE    ] D: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:13:06.847841] [INFO ] [REMOTE    ] D: Fetching primary data for 2025-01.
[2025-10-24T18:13:07.127103] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present.
[2025-10-24T18:13:07.126741] [INFO ] [REMOTE    ] CYH: Incremental fetch complete for 2025-02 (1.75 seconds).
[2025-10-24T18:13:07.127449] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed.
[2025-10-24T18:13:07.139057] [INFO ] [MAIN      ] CXW: Fetched primary data is valid.
[2025-10-24T18:13:07.139359] [DEBUG] [LOCAL     ] CXW: Saving primary data.
[2025-10-24T18:13:07.140475] [FATAL] [LOCAL     ] CXW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:13:07.141146] [FATAL] [MAIN      ] CXW: Failed to save primary data.
[2025-10-24T18:13:07.141231] [WARN ] [MAIN      ] CXW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:13:07.141312] [INFO ] [LOCAL     ] CXW: Starting deletion of primary data.
[2025-10-24T18:13:07.141389] [DEBUG] [LOCAL     ] CXW: No primary data file found to delete.
[2025-10-24T18:13:07.141431] [INFO ] [LOCAL     ] CXW: Starting deletion of derivative data.
[2025-10-24T18:13:07.141614] [DEBUG] [LOCAL     ] CXW: Deleted derivative data file.
[2025-10-24T18:13:07.142019] [INFO ] [MAIN      ] Update Progress: 582/2366 symbols completed. CXW took 31.4s. Estimated remaining: 3h 43m 59s. Rate: 8.0 symbols/min
[2025-10-24T18:13:07.330424] [INFO ] [MAIN      ] DAL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:13:07.330914] [DEBUG] [LOCAL     ] DAL: No existing data file found in primary storage.
[2025-10-24T18:13:07.330995] [WARN ] [MAIN      ] DAL: No existing data found, performing full refresh instead.
[2025-10-24T18:13:07.342875] [INFO ] [MAIN      ] DAL: Wiping existing primary data before full refresh.
[2025-10-24T18:13:07.343032] [INFO ] [LOCAL     ] DAL: Starting deletion of primary data.
[2025-10-24T18:13:07.343944] [DEBUG] [LOCAL     ] DAL: No primary data file found to delete.
[2025-10-24T18:13:07.344026] [INFO ] [MAIN      ] DAL: Starting full primary refresh.
[2025-10-24T18:13:07.344590] [INFO ] [REMOTE    ] DAC: Incremental fetch complete for 2025-01 (1.15 seconds).
[2025-10-24T18:13:07.357246] [INFO ] [REMOTE    ] CYH: Fetching primary data for 2025-03.
[2025-10-24T18:13:07.749729] [INFO ] [REMOTE    ] DAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:13:08.147694] [INFO ] [REMOTE    ] DAC: Fetching primary data for 2025-02.
[2025-10-24T18:13:08.536470] [INFO ] [REMOTE    ] D: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T18:13:08.616018] [INFO ] [REMOTE    ] CYH: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T18:13:08.947734] [INFO ] [REMOTE    ] D: Fetching primary data for 2025-02.
[2025-10-24T18:13:09.099221] [INFO ] [REMOTE    ] DAC: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T18:13:09.747639] [INFO ] [REMOTE    ] DAC: Fetching primary data for 2025-03.
[2025-10-24T18:13:10.484313] [INFO ] [REMOTE    ] D: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T18:13:10.547680] [INFO ] [REMOTE    ] D: Fetching primary data for 2025-03.
[2025-10-24T18:13:10.590511] [INFO ] [REMOTE    ] DAC: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T18:13:11.347685] [INFO ] [REMOTE    ] CYH: Fetching primary data for 2025-04.
[2025-10-24T18:13:12.147668] [INFO ] [REMOTE    ] DAL: Fetching primary data for 2025-01.
[2025-10-24T18:13:12.293127] [INFO ] [REMOTE    ] D: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T18:13:12.845931] [INFO ] [REMOTE    ] CYH: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T18:13:12.947670] [INFO ] [REMOTE    ] CYH: Fetching primary data for 2025-05.
[2025-10-24T18:13:13.752741] [INFO ] [REMOTE    ] D: Fetching primary data for 2025-04.
[2025-10-24T18:13:13.772415] [INFO ] [REMOTE    ] DAL: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T18:13:14.547664] [INFO ] [REMOTE    ] DAL: Fetching primary data for 2025-02.
[2025-10-24T18:13:14.658980] [INFO ] [REMOTE    ] CYH: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T18:13:15.249774] [INFO ] [REMOTE    ] D: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T18:13:15.347677] [INFO ] [REMOTE    ] CYH: Fetching primary data for 2025-06.
[2025-10-24T18:13:16.147617] [INFO ] [REMOTE    ] D: Fetching primary data for 2025-05.
[2025-10-24T18:13:16.656014] [INFO ] [REMOTE    ] DAL: Incremental fetch complete for 2025-02 (2.11 seconds).
[2025-10-24T18:13:16.947713] [INFO ] [REMOTE    ] DAC: Fetching primary data for 2025-04.
[2025-10-24T18:13:17.113291] [INFO ] [REMOTE    ] CYH: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T18:13:17.738006] [INFO ] [REMOTE    ] D: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T18:13:17.748407] [INFO ] [REMOTE    ] CYH: Fetching primary data for 2025-07.
[2025-10-24T18:13:18.046541] [INFO ] [REMOTE    ] DAC: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T18:13:18.547729] [INFO ] [REMOTE    ] DAC: Fetching primary data for 2025-05.
[2025-10-24T18:13:19.212173] [INFO ] [REMOTE    ] CYH: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T18:13:19.347696] [INFO ] [REMOTE    ] CYH: Fetching primary data for 2025-08.
[2025-10-24T18:13:19.347613] [INFO ] [REMOTE    ] DAC: Incremental fetch complete for 2025-05 (0.80 seconds).
[2025-10-24T18:13:20.147693] [INFO ] [REMOTE    ] D: Fetching primary data for 2025-06.
[2025-10-24T18:13:20.947679] [INFO ] [REMOTE    ] DAC: Fetching primary data for 2025-06.
[2025-10-24T18:13:21.007636] [INFO ] [REMOTE    ] CYH: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T18:13:21.747621] [INFO ] [REMOTE    ] DAL: Fetching primary data for 2025-03.
[2025-10-24T18:13:21.827614] [INFO ] [REMOTE    ] D: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T18:13:22.035478] [INFO ] [REMOTE    ] DAC: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T18:13:22.547727] [INFO ] [REMOTE    ] CYH: Fetching primary data for 2025-09.
[2025-10-24T18:13:23.347620] [INFO ] [REMOTE    ] D: Fetching primary data for 2025-07.
[2025-10-24T18:13:23.664206] [INFO ] [REMOTE    ] DAL: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T18:13:23.733093] [INFO ] [REMOTE    ] CYH: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T18:13:24.147636] [INFO ] [REMOTE    ] DAL: Fetching primary data for 2025-04.
[2025-10-24T18:13:24.947671] [INFO ] [REMOTE    ] CYH: Fetching primary data for 2025-10.
[2025-10-24T18:13:25.033302] [INFO ] [REMOTE    ] D: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T18:13:25.747736] [INFO ] [REMOTE    ] D: Fetching primary data for 2025-08.
[2025-10-24T18:13:26.255755] [INFO ] [REMOTE    ] DAL: Incremental fetch complete for 2025-04 (2.11 seconds).
[2025-10-24T18:13:26.547697] [INFO ] [REMOTE    ] DAC: Fetching primary data for 2025-07.
[2025-10-24T18:13:26.669942] [INFO ] [REMOTE    ] CYH: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T18:13:26.679391] [INFO ] [REMOTE    ] CYH: Full fetch complete (69820 records).
[2025-10-24T18:13:26.679566] [DEBUG] [VALIDATOR ] CYH: Validating primary data.
[2025-10-24T18:13:27.086626] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present.
[2025-10-24T18:13:27.086752] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed.
[2025-10-24T18:13:27.087693] [INFO ] [MAIN      ] CYH: Fetched primary data is valid.
[2025-10-24T18:13:27.087757] [DEBUG] [LOCAL     ] CYH: Saving primary data.
[2025-10-24T18:13:27.088358] [FATAL] [LOCAL     ] CYH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:13:27.088460] [FATAL] [MAIN      ] CYH: Failed to save primary data.
[2025-10-24T18:13:27.088552] [WARN ] [MAIN      ] CYH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:13:27.088630] [INFO ] [LOCAL     ] CYH: Starting deletion of primary data.
[2025-10-24T18:13:27.088732] [DEBUG] [LOCAL     ] CYH: No primary data file found to delete.
[2025-10-24T18:13:27.088775] [INFO ] [LOCAL     ] CYH: Starting deletion of derivative data.
[2025-10-24T18:13:27.088937] [DEBUG] [LOCAL     ] CYH: Deleted derivative data file.
[2025-10-24T18:13:27.089332] [INFO ] [MAIN      ] Update Progress: 583/2366 symbols completed. CYH took 25.5s. Estimated remaining: 3h 44m 29s. Rate: 7.9 symbols/min
[2025-10-24T18:13:27.263459] [INFO ] [MAIN      ] DAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:13:27.311836] [DEBUG] [LOCAL     ] DAN: Loaded 49732 existing records from primary storage.
[2025-10-24T18:13:27.312230] [INFO ] [MAIN      ] DAN: Loaded 49732 existing records.
[2025-10-24T18:13:27.354505] [INFO ] [REMOTE    ] DAL: Fetching primary data for 2025-05.
[2025-10-24T18:13:27.497273] [WARN ] [MAIN      ] DAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:13:27.498133] [INFO ] [MAIN      ] DAN: Wiping existing primary data before full refresh.
[2025-10-24T18:13:27.506473] [INFO ] [LOCAL     ] DAN: Starting deletion of primary data.
[2025-10-24T18:13:27.509546] [INFO ] [REMOTE    ] DAC: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T18:13:27.513867] [DEBUG] [LOCAL     ] DAN: Deleted primary data file.
[2025-10-24T18:13:27.515095] [INFO ] [MAIN      ] DAN: Starting full primary refresh.
[2025-10-24T18:13:27.894517] [INFO ] [REMOTE    ] D: Incremental fetch complete for 2025-08 (2.15 seconds).
[2025-10-24T18:13:27.984712] [INFO ] [REMOTE    ] DAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:13:28.147675] [INFO ] [REMOTE    ] DAN: Fetching primary data for 2025-01.
[2025-10-24T18:13:28.947748] [INFO ] [REMOTE    ] D: Fetching primary data for 2025-09.
[2025-10-24T18:13:29.751028] [INFO ] [REMOTE    ] DAC: Fetching primary data for 2025-08.
[2025-10-24T18:13:29.753747] [INFO ] [REMOTE    ] DAL: Incremental fetch complete for 2025-05 (2.40 seconds).
[2025-10-24T18:13:29.832987] [INFO ] [REMOTE    ] DAN: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T18:13:30.370174] [INFO ] [REMOTE    ] DAC: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T18:13:30.547610] [INFO ] [REMOTE    ] DAC: Fetching primary data for 2025-09.
[2025-10-24T18:13:30.865153] [INFO ] [REMOTE    ] D: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T18:13:31.347636] [INFO ] [REMOTE    ] DAL: Fetching primary data for 2025-06.
[2025-10-24T18:13:31.494443] [INFO ] [REMOTE    ] DAC: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T18:13:32.147635] [INFO ] [REMOTE    ] DAN: Fetching primary data for 2025-02.
[2025-10-24T18:13:32.947626] [INFO ] [REMOTE    ] D: Fetching primary data for 2025-10.
[2025-10-24T18:13:33.072977] [INFO ] [REMOTE    ] DAL: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T18:13:33.747678] [INFO ] [REMOTE    ] DAL: Fetching primary data for 2025-07.
[2025-10-24T18:13:33.788849] [INFO ] [REMOTE    ] DAN: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T18:13:34.547675] [INFO ] [REMOTE    ] DAN: Fetching primary data for 2025-03.
[2025-10-24T18:13:34.793676] [INFO ] [REMOTE    ] D: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T18:13:34.803465] [INFO ] [REMOTE    ] D: Full fetch complete (77812 records).
[2025-10-24T18:13:34.803619] [DEBUG] [VALIDATOR ] D: Validating primary data.
[2025-10-24T18:13:35.190943] [DEBUG] [VALIDATOR ] D: All expected trading days are present.
[2025-10-24T18:13:35.191030] [DEBUG] [VALIDATOR ] D: Primary data validation passed.
[2025-10-24T18:13:35.191934] [INFO ] [MAIN      ] D: Fetched primary data is valid.
[2025-10-24T18:13:35.191996] [DEBUG] [LOCAL     ] D: Saving primary data.
[2025-10-24T18:13:35.192591] [FATAL] [LOCAL     ] D: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:13:35.192705] [FATAL] [MAIN      ] D: Failed to save primary data.
[2025-10-24T18:13:35.192750] [WARN ] [MAIN      ] D: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:13:35.192813] [INFO ] [LOCAL     ] D: Starting deletion of primary data.
[2025-10-24T18:13:35.192874] [DEBUG] [LOCAL     ] D: No primary data file found to delete.
[2025-10-24T18:13:35.192909] [INFO ] [LOCAL     ] D: Starting deletion of derivative data.
[2025-10-24T18:13:35.193077] [DEBUG] [LOCAL     ] D: Deleted derivative data file.
[2025-10-24T18:13:35.193399] [INFO ] [MAIN      ] Update Progress: 584/2366 symbols completed. D took 30.4s. Estimated remaining: 3h 44m 24s. Rate: 7.9 symbols/min
[2025-10-24T18:13:35.365034] [INFO ] [MAIN      ] DAO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:13:35.361545] [INFO ] [REMOTE    ] DAC: Fetching primary data for 2025-10.
[2025-10-24T18:13:35.386469] [DEBUG] [LOCAL     ] DAO: Loaded 19946 existing records from primary storage.
[2025-10-24T18:13:35.386755] [INFO ] [MAIN      ] DAO: Loaded 19946 existing records.
[2025-10-24T18:13:35.571074] [WARN ] [MAIN      ] DAO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:13:35.571273] [INFO ] [MAIN      ] DAO: Wiping existing primary data before full refresh.
[2025-10-24T18:13:35.571321] [INFO ] [LOCAL     ] DAO: Starting deletion of primary data.
[2025-10-24T18:13:35.571497] [DEBUG] [LOCAL     ] DAO: Deleted primary data file.
[2025-10-24T18:13:35.571534] [INFO ] [MAIN      ] DAO: Starting full primary refresh.
[2025-10-24T18:13:35.934372] [INFO ] [REMOTE    ] DAO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:13:35.969766] [INFO ] [REMOTE    ] DAL: Incremental fetch complete for 2025-07 (2.22 seconds).
[2025-10-24T18:13:36.147621] [INFO ] [REMOTE    ] DAO: Fetching primary data for 2025-01.
[2025-10-24T18:13:36.295855] [INFO ] [REMOTE    ] DAN: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T18:13:36.403341] [INFO ] [REMOTE    ] DAC: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T18:13:36.406095] [INFO ] [REMOTE    ] DAC: Full fetch complete (19009 records).
[2025-10-24T18:13:36.406182] [DEBUG] [VALIDATOR ] DAC: Validating primary data.
[2025-10-24T18:13:36.818927] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present.
[2025-10-24T18:13:36.819009] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed.
[2025-10-24T18:13:36.819562] [INFO ] [MAIN      ] DAC: Fetched primary data is valid.
[2025-10-24T18:13:36.819627] [DEBUG] [LOCAL     ] DAC: Saving primary data.
[2025-10-24T18:13:36.820009] [FATAL] [LOCAL     ] DAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:13:36.820093] [FATAL] [MAIN      ] DAC: Failed to save primary data.
[2025-10-24T18:13:36.820137] [WARN ] [MAIN      ] DAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:13:36.820197] [INFO ] [LOCAL     ] DAC: Starting deletion of primary data.
[2025-10-24T18:13:36.820256] [DEBUG] [LOCAL     ] DAC: No primary data file found to delete.
[2025-10-24T18:13:36.820292] [INFO ] [LOCAL     ] DAC: Starting deletion of derivative data.
[2025-10-24T18:13:36.820332] [DEBUG] [LOCAL     ] DAC: No derivative data file found to delete.
[2025-10-24T18:13:36.820390] [INFO ] [MAIN      ] Update Progress: 585/2366 symbols completed. DAC took 31.4s. Estimated remaining: 3h 43m 58s. Rate: 8.0 symbols/min
[2025-10-24T18:13:36.952740] [INFO ] [REMOTE    ] DAL: Fetching primary data for 2025-08.
[2025-10-24T18:13:37.021572] [INFO ] [MAIN      ] DAR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:13:37.081029] [DEBUG] [LOCAL     ] DAR: Loaded 52387 existing records from primary storage.
[2025-10-24T18:13:37.081422] [INFO ] [MAIN      ] DAR: Loaded 52387 existing records.
[2025-10-24T18:13:37.229123] [INFO ] [REMOTE    ] DAO: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T18:13:37.305834] [WARN ] [MAIN      ] DAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:13:37.306073] [INFO ] [MAIN      ] DAR: Wiping existing primary data before full refresh.
[2025-10-24T18:13:37.306121] [INFO ] [LOCAL     ] DAR: Starting deletion of primary data.
[2025-10-24T18:13:37.306519] [DEBUG] [LOCAL     ] DAR: Deleted primary data file.
[2025-10-24T18:13:37.306561] [INFO ] [MAIN      ] DAR: Starting full primary refresh.
[2025-10-24T18:13:37.693011] [INFO ] [REMOTE    ] DAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:13:37.747611] [INFO ] [REMOTE    ] DAR: Fetching primary data for 2025-01.
[2025-10-24T18:13:38.547674] [INFO ] [REMOTE    ] DAO: Fetching primary data for 2025-02.
[2025-10-24T18:13:38.673582] [INFO ] [REMOTE    ] DAL: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T18:13:38.943943] [INFO ] [REMOTE    ] DAR: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T18:13:39.347607] [INFO ] [REMOTE    ] DAR: Fetching primary data for 2025-02.
[2025-10-24T18:13:39.689021] [INFO ] [REMOTE    ] DAO: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T18:13:40.147633] [INFO ] [REMOTE    ] DAL: Fetching primary data for 2025-09.
[2025-10-24T18:13:40.947690] [INFO ] [REMOTE    ] DAN: Fetching primary data for 2025-04.
[2025-10-24T18:13:41.031742] [INFO ] [REMOTE    ] DAR: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T18:13:41.747721] [INFO ] [REMOTE    ] DAR: Fetching primary data for 2025-03.
[2025-10-24T18:13:42.219321] [INFO ] [REMOTE    ] DAN: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T18:13:42.394389] [INFO ] [REMOTE    ] DAL: Incremental fetch complete for 2025-09 (2.25 seconds).
[2025-10-24T18:13:42.547726] [INFO ] [REMOTE    ] DAL: Fetching primary data for 2025-10.
[2025-10-24T18:13:43.286086] [INFO ] [REMOTE    ] DAR: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T18:13:43.347599] [INFO ] [REMOTE    ] DAR: Fetching primary data for 2025-04.
[2025-10-24T18:13:44.147619] [INFO ] [REMOTE    ] DAO: Fetching primary data for 2025-03.
[2025-10-24T18:13:44.506204] [INFO ] [REMOTE    ] DAL: Incremental fetch complete for 2025-10 (1.96 seconds).
[2025-10-24T18:13:44.515972] [INFO ] [REMOTE    ] DAL: Full fetch complete (77931 records).
[2025-10-24T18:13:44.516104] [DEBUG] [VALIDATOR ] DAL: Validating primary data.
[2025-10-24T18:13:44.926084] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present.
[2025-10-24T18:13:44.926208] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed.
[2025-10-24T18:13:44.930285] [INFO ] [MAIN      ] DAL: Fetched primary data is valid.
[2025-10-24T18:13:44.930562] [DEBUG] [LOCAL     ] DAL: Saving primary data.
[2025-10-24T18:13:44.931695] [FATAL] [LOCAL     ] DAL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:13:44.931784] [FATAL] [MAIN      ] DAL: Failed to save primary data.
[2025-10-24T18:13:44.931833] [WARN ] [MAIN      ] DAL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:13:44.931922] [INFO ] [LOCAL     ] DAL: Starting deletion of primary data.
[2025-10-24T18:13:44.932029] [DEBUG] [LOCAL     ] DAL: No primary data file found to delete.
[2025-10-24T18:13:44.932098] [INFO ] [LOCAL     ] DAL: Starting deletion of derivative data.
[2025-10-24T18:13:44.932165] [DEBUG] [LOCAL     ] DAL: No derivative data file found to delete.
[2025-10-24T18:13:44.933061] [INFO ] [MAIN      ] Update Progress: 586/2366 symbols completed. DAL took 37.8s. Estimated remaining: 3h 43m 52s. Rate: 8.0 symbols/min
[2025-10-24T18:13:44.967173] [INFO ] [REMOTE    ] DAN: Fetching primary data for 2025-05.
[2025-10-24T18:13:45.124618] [INFO ] [MAIN      ] DAVA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:13:45.154379] [INFO ] [REMOTE    ] DAR: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T18:13:45.201583] [DEBUG] [LOCAL     ] DAVA: Loaded 42219 existing records from primary storage.
[2025-10-24T18:13:45.201915] [INFO ] [MAIN      ] DAVA: Loaded 42219 existing records.
[2025-10-24T18:13:45.392266] [WARN ] [MAIN      ] DAVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:13:45.392671] [INFO ] [MAIN      ] DAVA: Wiping existing primary data before full refresh.
[2025-10-24T18:13:45.392893] [INFO ] [LOCAL     ] DAVA: Starting deletion of primary data.
[2025-10-24T18:13:45.404751] [DEBUG] [LOCAL     ] DAVA: Deleted primary data file.
[2025-10-24T18:13:45.411603] [INFO ] [MAIN      ] DAVA: Starting full primary refresh.
[2025-10-24T18:13:45.462361] [INFO ] [REMOTE    ] DAO: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T18:13:45.752945] [INFO ] [REMOTE    ] DAR: Fetching primary data for 2025-05.
[2025-10-24T18:13:45.824998] [INFO ] [REMOTE    ] DAVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:13:46.555213] [INFO ] [REMOTE    ] DAVA: Fetching primary data for 2025-01.
[2025-10-24T18:13:46.574083] [INFO ] [REMOTE    ] DAN: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T18:13:47.347669] [INFO ] [REMOTE    ] DAN: Fetching primary data for 2025-06.
[2025-10-24T18:13:47.419544] [INFO ] [REMOTE    ] DAR: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T18:13:47.655901] [INFO ] [REMOTE    ] DAVA: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T18:13:48.147687] [INFO ] [REMOTE    ] DAR: Fetching primary data for 2025-06.
[2025-10-24T18:13:48.947637] [INFO ] [REMOTE    ] DAO: Fetching primary data for 2025-04.
[2025-10-24T18:13:49.160125] [INFO ] [REMOTE    ] DAN: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T18:13:49.484570] [INFO ] [REMOTE    ] DAR: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T18:13:49.747711] [INFO ] [REMOTE    ] DAVA: Fetching primary data for 2025-02.
[2025-10-24T18:13:50.162006] [INFO ] [REMOTE    ] DAO: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T18:13:50.547618] [INFO ] [REMOTE    ] DAO: Fetching primary data for 2025-05.
[2025-10-24T18:13:51.005241] [INFO ] [REMOTE    ] DAVA: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T18:13:51.347685] [INFO ] [REMOTE    ] DAR: Fetching primary data for 2025-07.
[2025-10-24T18:13:51.582916] [INFO ] [REMOTE    ] DAO: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T18:13:52.147722] [INFO ] [REMOTE    ] DAO: Fetching primary data for 2025-06.
[2025-10-24T18:13:52.939025] [INFO ] [REMOTE    ] DAR: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T18:13:52.949608] [INFO ] [REMOTE    ] DAVA: Fetching primary data for 2025-03.
[2025-10-24T18:13:53.052427] [INFO ] [REMOTE    ] DAO: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T18:13:53.747668] [INFO ] [REMOTE    ] DAN: Fetching primary data for 2025-07.
[2025-10-24T18:13:54.318091] [INFO ] [REMOTE    ] DAVA: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T18:13:54.547684] [INFO ] [REMOTE    ] DAO: Fetching primary data for 2025-07.
[2025-10-24T18:13:55.362542] [INFO ] [REMOTE    ] DAVA: Fetching primary data for 2025-04.
[2025-10-24T18:13:55.385012] [INFO ] [REMOTE    ] DAN: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T18:13:55.412381] [INFO ] [REMOTE    ] DAO: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T18:13:56.147677] [INFO ] [REMOTE    ] DAO: Fetching primary data for 2025-08.
[2025-10-24T18:13:56.780321] [INFO ] [REMOTE    ] DAVA: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T18:13:56.947686] [INFO ] [REMOTE    ] DAVA: Fetching primary data for 2025-05.
[2025-10-24T18:13:57.217355] [INFO ] [REMOTE    ] DAO: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T18:13:57.747719] [INFO ] [REMOTE    ] DAO: Fetching primary data for 2025-09.
[2025-10-24T18:13:58.512535] [INFO ] [REMOTE    ] DAVA: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T18:13:58.547612] [INFO ] [REMOTE    ] DAVA: Fetching primary data for 2025-06.
[2025-10-24T18:13:58.714736] [INFO ] [REMOTE    ] DAO: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T18:13:59.347674] [INFO ] [REMOTE    ] DAN: Fetching primary data for 2025-08.
[2025-10-24T18:13:59.981348] [INFO ] [REMOTE    ] DAVA: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T18:14:00.147680] [INFO ] [REMOTE    ] DAVA: Fetching primary data for 2025-07.
[2025-10-24T18:14:00.773488] [INFO ] [REMOTE    ] DAN: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T18:14:00.947688] [INFO ] [REMOTE    ] DAR: Fetching primary data for 2025-08.
[2025-10-24T18:14:01.747714] [INFO ] [REMOTE    ] DAO: Fetching primary data for 2025-10.
[2025-10-24T18:14:01.948070] [INFO ] [REMOTE    ] DAVA: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T18:14:02.547744] [INFO ] [REMOTE    ] DAVA: Fetching primary data for 2025-08.
[2025-10-24T18:14:02.931520] [INFO ] [REMOTE    ] DAR: Incremental fetch complete for 2025-08 (1.98 seconds).
[2025-10-24T18:14:03.347733] [INFO ] [REMOTE    ] DAR: Fetching primary data for 2025-09.
[2025-10-24T18:14:03.676893] [INFO ] [REMOTE    ] DAO: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T18:14:03.681805] [INFO ] [REMOTE    ] DAO: Full fetch complete (32635 records).
[2025-10-24T18:14:03.681964] [DEBUG] [VALIDATOR ] DAO: Validating primary data.
[2025-10-24T18:14:04.093292] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present.
[2025-10-24T18:14:04.093406] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed.
[2025-10-24T18:14:04.094461] [INFO ] [MAIN      ] DAO: Fetched primary data is valid.
[2025-10-24T18:14:04.094528] [DEBUG] [LOCAL     ] DAO: Saving primary data.
[2025-10-24T18:14:04.095062] [FATAL] [LOCAL     ] DAO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:14:04.095156] [FATAL] [MAIN      ] DAO: Failed to save primary data.
[2025-10-24T18:14:04.095199] [WARN ] [MAIN      ] DAO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:14:04.095234] [INFO ] [LOCAL     ] DAO: Starting deletion of primary data.
[2025-10-24T18:14:04.095291] [DEBUG] [LOCAL     ] DAO: No primary data file found to delete.
[2025-10-24T18:14:04.095329] [INFO ] [LOCAL     ] DAO: Starting deletion of derivative data.
[2025-10-24T18:14:04.095550] [DEBUG] [LOCAL     ] DAO: Deleted derivative data file.
[2025-10-24T18:14:04.095693] [INFO ] [MAIN      ] Update Progress: 587/2366 symbols completed. DAO took 28.9s. Estimated remaining: 3h 44m 20s. Rate: 7.9 symbols/min
[2025-10-24T18:14:04.163724] [INFO ] [REMOTE    ] DAN: Fetching primary data for 2025-09.
[2025-10-24T18:14:04.278559] [INFO ] [MAIN      ] DAY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:14:04.330127] [DEBUG] [LOCAL     ] DAY: Loaded 49492 existing records from primary storage.
[2025-10-24T18:14:04.330537] [INFO ] [MAIN      ] DAY: Loaded 49492 existing records.
[2025-10-24T18:14:04.529892] [WARN ] [MAIN      ] DAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:14:04.530337] [INFO ] [MAIN      ] DAY: Wiping existing primary data before full refresh.
[2025-10-24T18:14:04.530457] [INFO ] [LOCAL     ] DAY: Starting deletion of primary data.
[2025-10-24T18:14:04.531181] [DEBUG] [LOCAL     ] DAY: Deleted primary data file.
[2025-10-24T18:14:04.531249] [INFO ] [MAIN      ] DAY: Starting full primary refresh.
[2025-10-24T18:14:04.656528] [INFO ] [REMOTE    ] DAVA: Incremental fetch complete for 2025-08 (2.11 seconds).
[2025-10-24T18:14:04.949610] [INFO ] [REMOTE    ] DAVA: Fetching primary data for 2025-09.
[2025-10-24T18:14:04.957227] [INFO ] [REMOTE    ] DAY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:14:05.043213] [INFO ] [REMOTE    ] DAR: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T18:14:05.747680] [INFO ] [REMOTE    ] DAY: Fetching primary data for 2025-01.
[2025-10-24T18:14:06.236590] [INFO ] [REMOTE    ] DAN: Incremental fetch complete for 2025-09 (2.07 seconds).
[2025-10-24T18:14:06.547777] [INFO ] [REMOTE    ] DAR: Fetching primary data for 2025-10.
[2025-10-24T18:14:06.831227] [INFO ] [REMOTE    ] DAVA: Incremental fetch complete for 2025-09 (1.88 seconds).
[2025-10-24T18:14:07.045559] [INFO ] [REMOTE    ] DAY: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T18:14:07.347754] [INFO ] [REMOTE    ] DAN: Fetching primary data for 2025-10.
[2025-10-24T18:14:08.147624] [INFO ] [REMOTE    ] DAVA: Fetching primary data for 2025-10.
[2025-10-24T18:14:08.321586] [INFO ] [REMOTE    ] DAR: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T18:14:08.331562] [INFO ] [REMOTE    ] DAR: Full fetch complete (75154 records).
[2025-10-24T18:14:08.331728] [DEBUG] [VALIDATOR ] DAR: Validating primary data.
[2025-10-24T18:14:08.801128] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present.
[2025-10-24T18:14:08.801270] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed.
[2025-10-24T18:14:08.802785] [INFO ] [MAIN      ] DAR: Fetched primary data is valid.
[2025-10-24T18:14:08.802875] [DEBUG] [LOCAL     ] DAR: Saving primary data.
[2025-10-24T18:14:08.814202] [FATAL] [LOCAL     ] DAR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:14:08.830074] [FATAL] [MAIN      ] DAR: Failed to save primary data.
[2025-10-24T18:14:08.830847] [WARN ] [MAIN      ] DAR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:14:08.830930] [INFO ] [LOCAL     ] DAR: Starting deletion of primary data.
[2025-10-24T18:14:08.832470] [INFO ] [REMOTE    ] DAN: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T18:14:08.841973] [DEBUG] [LOCAL     ] DAR: No primary data file found to delete.
[2025-10-24T18:14:08.842068] [INFO ] [LOCAL     ] DAR: Starting deletion of derivative data.
[2025-10-24T18:14:08.842409] [DEBUG] [LOCAL     ] DAR: Deleted derivative data file.
[2025-10-24T18:14:08.842857] [INFO ] [MAIN      ] Update Progress: 588/2366 symbols completed. DAR took 32.0s. Estimated remaining: 3h 44m 4s. Rate: 7.9 symbols/min
[2025-10-24T18:14:08.843012] [INFO ] [REMOTE    ] DAN: Full fetch complete (71393 records).
[2025-10-24T18:14:08.877876] [DEBUG] [VALIDATOR ] DAN: Validating primary data.
[2025-10-24T18:14:08.958549] [INFO ] [REMOTE    ] DAY: Fetching primary data for 2025-02.
[2025-10-24T18:14:09.253974] [INFO ] [MAIN      ] DB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:14:09.454164] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present.
[2025-10-24T18:14:09.454260] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed.
[2025-10-24T18:14:09.455128] [INFO ] [MAIN      ] DAN: Fetched primary data is valid.
[2025-10-24T18:14:09.455249] [DEBUG] [LOCAL     ] DAN: Saving primary data.
[2025-10-24T18:14:09.456042] [FATAL] [LOCAL     ] DAN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:14:09.456139] [FATAL] [MAIN      ] DAN: Failed to save primary data.
[2025-10-24T18:14:09.456181] [WARN ] [MAIN      ] DAN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:14:09.456217] [INFO ] [LOCAL     ] DAN: Starting deletion of primary data.
[2025-10-24T18:14:09.456272] [DEBUG] [LOCAL     ] DAN: No primary data file found to delete.
[2025-10-24T18:14:09.456308] [INFO ] [LOCAL     ] DAN: Starting deletion of derivative data.
[2025-10-24T18:14:09.456452] [DEBUG] [LOCAL     ] DAN: Deleted derivative data file.
[2025-10-24T18:14:09.456952] [INFO ] [MAIN      ] Update Progress: 589/2366 symbols completed. DAN took 42.4s. Estimated remaining: 3h 43m 35s. Rate: 7.9 symbols/min
[2025-10-24T18:14:09.641242] [DEBUG] [LOCAL     ] DB: Loaded 52840 existing records from primary storage.
[2025-10-24T18:14:09.658629] [INFO ] [MAIN      ] DB: Loaded 52840 existing records.
[2025-10-24T18:14:09.658409] [INFO ] [MAIN      ] DBD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:14:09.853627] [WARN ] [MAIN      ] DB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:14:09.854796] [INFO ] [MAIN      ] DB: Wiping existing primary data before full refresh.
[2025-10-24T18:14:09.854895] [INFO ] [LOCAL     ] DB: Starting deletion of primary data.
[2025-10-24T18:14:09.855602] [DEBUG] [LOCAL     ] DBD: Loaded 24706 existing records from primary storage.
[2025-10-24T18:14:09.855976] [INFO ] [MAIN      ] DBD: Loaded 24706 existing records.
[2025-10-24T18:14:09.876714] [DEBUG] [LOCAL     ] DB: Deleted primary data file.
[2025-10-24T18:14:09.887403] [INFO ] [MAIN      ] DB: Starting full primary refresh.
[2025-10-24T18:14:10.214384] [INFO ] [REMOTE    ] DAVA: Incremental fetch complete for 2025-10 (2.07 seconds).
[2025-10-24T18:14:10.271173] [WARN ] [MAIN      ] DBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:14:10.310781] [INFO ] [REMOTE    ] DAVA: Full fetch complete (57297 records).
[2025-10-24T18:14:10.318972] [INFO ] [MAIN      ] DBD: Wiping existing primary data before full refresh.
[2025-10-24T18:14:10.319056] [DEBUG] [VALIDATOR ] DAVA: Validating primary data.
[2025-10-24T18:14:10.329401] [INFO ] [LOCAL     ] DBD: Starting deletion of primary data.
[2025-10-24T18:14:10.373350] [DEBUG] [LOCAL     ] DBD: Deleted primary data file.
[2025-10-24T18:14:10.408493] [INFO ] [MAIN      ] DBD: Starting full primary refresh.
[2025-10-24T18:14:10.552241] [INFO ] [REMOTE    ] DB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:14:10.589174] [INFO ] [REMOTE    ] DB: Fetching primary data for 2025-01.
[2025-10-24T18:14:11.044664] [INFO ] [REMOTE    ] DAY: Incremental fetch complete for 2025-02 (2.09 seconds).
[2025-10-24T18:14:11.116255] [INFO ] [REMOTE    ] DAY: Fetching primary data for 2025-03.
[2025-10-24T18:14:11.174911] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present.
[2025-10-24T18:14:11.187620] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed.
[2025-10-24T18:14:11.188514] [INFO ] [MAIN      ] DAVA: Fetched primary data is valid.
[2025-10-24T18:14:11.193797] [DEBUG] [LOCAL     ] DAVA: Saving primary data.
[2025-10-24T18:14:11.229263] [INFO ] [REMOTE    ] DBD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:14:11.201618] [FATAL] [LOCAL     ] DAVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:14:11.229401] [FATAL] [MAIN      ] DAVA: Failed to save primary data.
[2025-10-24T18:14:11.229499] [WARN ] [MAIN      ] DAVA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:14:11.229840] [INFO ] [LOCAL     ] DAVA: Starting deletion of primary data.
[2025-10-24T18:14:11.229913] [DEBUG] [LOCAL     ] DAVA: No primary data file found to delete.
[2025-10-24T18:14:11.229950] [INFO ] [LOCAL     ] DAVA: Starting deletion of derivative data.
[2025-10-24T18:14:11.230099] [DEBUG] [LOCAL     ] DAVA: Deleted derivative data file.
[2025-10-24T18:14:11.230546] [INFO ] [MAIN      ] Update Progress: 590/2366 symbols completed. DAVA took 26.3s. Estimated remaining: 3h 43m 10s. Rate: 8.0 symbols/min
[2025-10-24T18:14:11.352708] [INFO ] [REMOTE    ] DBD: Fetching primary data for 2025-01.
[2025-10-24T18:14:11.397262] [INFO ] [MAIN      ] DBI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:14:11.436613] [DEBUG] [LOCAL     ] DBI: Loaded 43620 existing records from primary storage.
[2025-10-24T18:14:11.436922] [INFO ] [MAIN      ] DBI: Loaded 43620 existing records.
[2025-10-24T18:14:11.608528] [WARN ] [MAIN      ] DBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:14:11.608766] [INFO ] [MAIN      ] DBI: Wiping existing primary data before full refresh.
[2025-10-24T18:14:11.608818] [INFO ] [LOCAL     ] DBI: Starting deletion of primary data.
[2025-10-24T18:14:11.609117] [DEBUG] [LOCAL     ] DBI: Deleted primary data file.
[2025-10-24T18:14:11.609167] [INFO ] [MAIN      ] DBI: Starting full primary refresh.
[2025-10-24T18:14:11.957620] [INFO ] [REMOTE    ] DBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:14:12.147614] [INFO ] [REMOTE    ] DBI: Fetching primary data for 2025-01.
[2025-10-24T18:14:12.213931] [INFO ] [REMOTE    ] DBD: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T18:14:12.457066] [INFO ] [REMOTE    ] DB: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T18:14:12.789388] [INFO ] [REMOTE    ] DAY: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T18:14:12.947627] [INFO ] [REMOTE    ] DAY: Fetching primary data for 2025-04.
[2025-10-24T18:14:13.752738] [INFO ] [REMOTE    ] DBD: Fetching primary data for 2025-02.
[2025-10-24T18:14:13.772614] [INFO ] [REMOTE    ] DBI: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T18:14:14.473737] [INFO ] [REMOTE    ] DAY: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T18:14:14.500675] [INFO ] [REMOTE    ] DBD: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T18:14:14.547613] [INFO ] [REMOTE    ] DAY: Fetching primary data for 2025-05.
[2025-10-24T18:14:15.347683] [INFO ] [REMOTE    ] DBD: Fetching primary data for 2025-03.
[2025-10-24T18:14:16.071135] [INFO ] [REMOTE    ] DBD: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T18:14:16.147617] [INFO ] [REMOTE    ] DBD: Fetching primary data for 2025-04.
[2025-10-24T18:14:16.267770] [INFO ] [REMOTE    ] DAY: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T18:14:16.947699] [INFO ] [REMOTE    ] DBI: Fetching primary data for 2025-02.
[2025-10-24T18:14:17.153503] [INFO ] [REMOTE    ] DBD: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T18:14:17.747675] [INFO ] [REMOTE    ] DBD: Fetching primary data for 2025-05.
[2025-10-24T18:14:18.316635] [INFO ] [REMOTE    ] DBI: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T18:14:18.547560] [INFO ] [REMOTE    ] DAY: Fetching primary data for 2025-06.
[2025-10-24T18:14:18.578905] [INFO ] [REMOTE    ] DBD: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T18:14:19.347683] [INFO ] [REMOTE    ] DBI: Fetching primary data for 2025-03.
[2025-10-24T18:14:20.152727] [INFO ] [REMOTE    ] DBD: Fetching primary data for 2025-06.
[2025-10-24T18:14:20.168442] [INFO ] [REMOTE    ] DAY: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T18:14:20.879914] [INFO ] [REMOTE    ] DBI: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T18:14:20.947638] [INFO ] [REMOTE    ] DB: Fetching primary data for 2025-02.
[2025-10-24T18:14:21.192042] [INFO ] [REMOTE    ] DBD: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T18:14:21.747779] [INFO ] [REMOTE    ] DAY: Fetching primary data for 2025-07.
[2025-10-24T18:14:22.547699] [INFO ] [REMOTE    ] DBI: Fetching primary data for 2025-04.
[2025-10-24T18:14:22.753307] [INFO ] [REMOTE    ] DB: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T18:14:23.232480] [INFO ] [REMOTE    ] DAY: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T18:14:23.347638] [INFO ] [REMOTE    ] DB: Fetching primary data for 2025-03.
[2025-10-24T18:14:23.860518] [INFO ] [REMOTE    ] DBI: Incremental fetch complete for 2025-04 (1.31 seconds).
[2025-10-24T18:14:24.147638] [INFO ] [REMOTE    ] DBI: Fetching primary data for 2025-05.
[2025-10-24T18:14:24.947633] [INFO ] [REMOTE    ] DAY: Fetching primary data for 2025-08.
[2025-10-24T18:14:25.197466] [INFO ] [REMOTE    ] DB: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T18:14:25.627201] [INFO ] [REMOTE    ] DBI: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T18:14:25.747623] [INFO ] [REMOTE    ] DBI: Fetching primary data for 2025-06.
[2025-10-24T18:14:26.261398] [INFO ] [REMOTE    ] DAY: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T18:14:26.547679] [INFO ] [REMOTE    ] DBD: Fetching primary data for 2025-07.
[2025-10-24T18:14:27.250954] [INFO ] [REMOTE    ] DBI: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T18:14:27.347620] [INFO ] [REMOTE    ] DBI: Fetching primary data for 2025-07.
[2025-10-24T18:14:27.732916] [INFO ] [REMOTE    ] DBD: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T18:14:28.147637] [INFO ] [REMOTE    ] DB: Fetching primary data for 2025-04.
[2025-10-24T18:14:28.931813] [INFO ] [REMOTE    ] DBI: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T18:14:28.947620] [INFO ] [REMOTE    ] DAY: Fetching primary data for 2025-09.
[2025-10-24T18:14:29.665611] [INFO ] [REMOTE    ] DB: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T18:14:29.747626] [INFO ] [REMOTE    ] DB: Fetching primary data for 2025-05.
[2025-10-24T18:14:30.557603] [INFO ] [REMOTE    ] DBI: Fetching primary data for 2025-08.
[2025-10-24T18:14:30.587292] [INFO ] [REMOTE    ] DAY: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T18:14:31.347617] [INFO ] [REMOTE    ] DAY: Fetching primary data for 2025-10.
[2025-10-24T18:14:31.467862] [INFO ] [REMOTE    ] DB: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T18:14:31.963228] [INFO ] [REMOTE    ] DBI: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T18:14:32.147677] [INFO ] [REMOTE    ] DBI: Fetching primary data for 2025-09.
[2025-10-24T18:14:32.947716] [INFO ] [REMOTE    ] DBD: Fetching primary data for 2025-08.
[2025-10-24T18:14:33.260198] [INFO ] [REMOTE    ] DAY: Incremental fetch complete for 2025-10 (1.91 seconds).
[2025-10-24T18:14:33.268765] [INFO ] [REMOTE    ] DAY: Full fetch complete (71901 records).
[2025-10-24T18:14:33.268895] [DEBUG] [VALIDATOR ] DAY: Validating primary data.
[2025-10-24T18:14:33.674806] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present.
[2025-10-24T18:14:33.674938] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed.
[2025-10-24T18:14:33.676039] [INFO ] [MAIN      ] DAY: Fetched primary data is valid.
[2025-10-24T18:14:33.676248] [DEBUG] [LOCAL     ] DAY: Saving primary data.
[2025-10-24T18:14:33.677071] [FATAL] [LOCAL     ] DAY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:14:33.677214] [FATAL] [MAIN      ] DAY: Failed to save primary data.
[2025-10-24T18:14:33.677259] [WARN ] [MAIN      ] DAY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:14:33.677298] [INFO ] [LOCAL     ] DAY: Starting deletion of primary data.
[2025-10-24T18:14:33.677389] [DEBUG] [LOCAL     ] DAY: No primary data file found to delete.
[2025-10-24T18:14:33.677460] [INFO ] [LOCAL     ] DAY: Starting deletion of derivative data.
[2025-10-24T18:14:33.677636] [DEBUG] [LOCAL     ] DAY: Deleted derivative data file.
[2025-10-24T18:14:33.678014] [INFO ] [MAIN      ] Update Progress: 591/2366 symbols completed. DAY took 29.6s. Estimated remaining: 3h 43m 47s. Rate: 7.9 symbols/min
[2025-10-24T18:14:33.750687] [INFO ] [REMOTE    ] DB: Fetching primary data for 2025-06.
[2025-10-24T18:14:33.869299] [INFO ] [MAIN      ] DBL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:14:33.894333] [INFO ] [REMOTE    ] DBI: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T18:14:33.913904] [DEBUG] [LOCAL     ] DBL: Loaded 9423 existing records from primary storage.
[2025-10-24T18:14:33.914174] [INFO ] [MAIN      ] DBL: Loaded 9423 existing records.
[2025-10-24T18:14:34.072969] [INFO ] [REMOTE    ] DBD: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T18:14:34.118326] [WARN ] [MAIN      ] DBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:14:34.118951] [INFO ] [MAIN      ] DBL: Wiping existing primary data before full refresh.
[2025-10-24T18:14:34.119046] [INFO ] [LOCAL     ] DBL: Starting deletion of primary data.
[2025-10-24T18:14:34.119539] [DEBUG] [LOCAL     ] DBL: Deleted primary data file.
[2025-10-24T18:14:34.119596] [INFO ] [MAIN      ] DBL: Starting full primary refresh.
[2025-10-24T18:14:34.479754] [INFO ] [REMOTE    ] DBL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:14:34.547610] [INFO ] [REMOTE    ] DBL: Fetching primary data for 2025-01.
[2025-10-24T18:14:35.303148] [INFO ] [REMOTE    ] DBL: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T18:14:35.347696] [INFO ] [REMOTE    ] DBI: Fetching primary data for 2025-10.
[2025-10-24T18:14:35.576565] [INFO ] [REMOTE    ] DB: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T18:14:36.147675] [INFO ] [REMOTE    ] DBD: Fetching primary data for 2025-09.
[2025-10-24T18:14:36.741539] [INFO ] [REMOTE    ] DBI: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T18:14:36.748405] [INFO ] [REMOTE    ] DBI: Full fetch complete (64644 records).
[2025-10-24T18:14:36.748516] [DEBUG] [VALIDATOR ] DBI: Validating primary data.
[2025-10-24T18:14:36.953388] [INFO ] [REMOTE    ] DBL: Fetching primary data for 2025-02.
[2025-10-24T18:14:37.142376] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present.
[2025-10-24T18:14:37.142477] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed.
[2025-10-24T18:14:37.143434] [INFO ] [MAIN      ] DBI: Fetched primary data is valid.
[2025-10-24T18:14:37.143506] [DEBUG] [LOCAL     ] DBI: Saving primary data.
[2025-10-24T18:14:37.144056] [FATAL] [LOCAL     ] DBI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:14:37.144157] [FATAL] [MAIN      ] DBI: Failed to save primary data.
[2025-10-24T18:14:37.144208] [WARN ] [MAIN      ] DBI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:14:37.144252] [INFO ] [LOCAL     ] DBI: Starting deletion of primary data.
[2025-10-24T18:14:37.144333] [DEBUG] [LOCAL     ] DBI: No primary data file found to delete.
[2025-10-24T18:14:37.144386] [INFO ] [LOCAL     ] DBI: Starting deletion of derivative data.
[2025-10-24T18:14:37.144573] [DEBUG] [LOCAL     ] DBI: Deleted derivative data file.
[2025-10-24T18:14:37.145251] [INFO ] [MAIN      ] Update Progress: 592/2366 symbols completed. DBI took 25.9s. Estimated remaining: 3h 43m 28s. Rate: 7.9 symbols/min
[2025-10-24T18:14:37.335277] [INFO ] [REMOTE    ] DBD: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T18:14:37.338257] [INFO ] [MAIN      ] DBRG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:14:37.393265] [DEBUG] [LOCAL     ] DBRG: Loaded 50364 existing records from primary storage.
[2025-10-24T18:14:37.393607] [INFO ] [MAIN      ] DBRG: Loaded 50364 existing records.
[2025-10-24T18:14:37.570078] [WARN ] [MAIN      ] DBRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:14:37.570303] [INFO ] [MAIN      ] DBRG: Wiping existing primary data before full refresh.
[2025-10-24T18:14:37.570348] [INFO ] [LOCAL     ] DBRG: Starting deletion of primary data.
[2025-10-24T18:14:37.571028] [DEBUG] [LOCAL     ] DBRG: Deleted primary data file.
[2025-10-24T18:14:37.571085] [INFO ] [MAIN      ] DBRG: Starting full primary refresh.
[2025-10-24T18:14:37.755570] [INFO ] [REMOTE    ] DB: Fetching primary data for 2025-07.
[2025-10-24T18:14:37.784034] [INFO ] [REMOTE    ] DBL: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T18:14:37.930791] [INFO ] [REMOTE    ] DBRG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:14:38.547677] [INFO ] [REMOTE    ] DBL: Fetching primary data for 2025-03.
[2025-10-24T18:14:39.160845] [INFO ] [REMOTE    ] DBL: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T18:14:39.347636] [INFO ] [REMOTE    ] DBRG: Fetching primary data for 2025-01.
[2025-10-24T18:14:39.528944] [INFO ] [REMOTE    ] DB: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T18:14:40.147677] [INFO ] [REMOTE    ] DBL: Fetching primary data for 2025-04.
[2025-10-24T18:14:40.918621] [INFO ] [REMOTE    ] DBL: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T18:14:40.951348] [INFO ] [REMOTE    ] DBL: Fetching primary data for 2025-05.
[2025-10-24T18:14:40.956270] [INFO ] [REMOTE    ] DBRG: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T18:14:41.559204] [INFO ] [REMOTE    ] DBL: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T18:14:41.747636] [INFO ] [REMOTE    ] DB: Fetching primary data for 2025-08.
[2025-10-24T18:14:42.547735] [INFO ] [REMOTE    ] DBL: Fetching primary data for 2025-06.
[2025-10-24T18:14:43.347715] [INFO ] [REMOTE    ] DBD: Fetching primary data for 2025-10.
[2025-10-24T18:14:43.428270] [INFO ] [REMOTE    ] DB: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T18:14:43.458917] [INFO ] [REMOTE    ] DBL: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T18:14:44.147635] [INFO ] [REMOTE    ] DBL: Fetching primary data for 2025-07.
[2025-10-24T18:14:44.303395] [INFO ] [REMOTE    ] DBD: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T18:14:44.307968] [INFO ] [REMOTE    ] DBD: Full fetch complete (32029 records).
[2025-10-24T18:14:44.308048] [DEBUG] [VALIDATOR ] DBD: Validating primary data.
[2025-10-24T18:14:44.309058] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:14:44.309143] [FATAL] [MAIN      ] DBD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:14:44.309185] [WARN ] [MAIN      ] DBD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:14:44.309223] [INFO ] [LOCAL     ] DBD: Starting deletion of primary data.
[2025-10-24T18:14:44.309292] [DEBUG] [LOCAL     ] DBD: No primary data file found to delete.
[2025-10-24T18:14:44.309347] [INFO ] [LOCAL     ] DBD: Starting deletion of derivative data.
[2025-10-24T18:14:44.309679] [DEBUG] [LOCAL     ] DBD: Deleted derivative data file.
[2025-10-24T18:14:44.309765] [INFO ] [MAIN      ] Update Progress: 593/2366 symbols completed. DBD took 34.9s. Estimated remaining: 3h 43m 19s. Rate: 7.9 symbols/min
[2025-10-24T18:14:44.475930] [INFO ] [MAIN      ] DCI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:14:44.514128] [DEBUG] [LOCAL     ] DCI: Loaded 37136 existing records from primary storage.
[2025-10-24T18:14:44.514437] [INFO ] [MAIN      ] DCI: Loaded 37136 existing records.
[2025-10-24T18:14:44.718917] [WARN ] [MAIN      ] DCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:14:44.719195] [INFO ] [MAIN      ] DCI: Wiping existing primary data before full refresh.
[2025-10-24T18:14:44.719257] [INFO ] [LOCAL     ] DCI: Starting deletion of primary data.
[2025-10-24T18:14:44.719602] [DEBUG] [LOCAL     ] DCI: Deleted primary data file.
[2025-10-24T18:14:44.719695] [INFO ] [MAIN      ] DCI: Starting full primary refresh.
[2025-10-24T18:14:44.952752] [INFO ] [REMOTE    ] DB: Fetching primary data for 2025-09.
[2025-10-24T18:14:45.020915] [INFO ] [REMOTE    ] DBL: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T18:14:45.104697] [INFO ] [REMOTE    ] DCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:14:45.747625] [INFO ] [REMOTE    ] DBRG: Fetching primary data for 2025-02.
[2025-10-24T18:14:46.547755] [INFO ] [REMOTE    ] DCI: Fetching primary data for 2025-01.
[2025-10-24T18:14:46.962252] [INFO ] [REMOTE    ] DB: Incremental fetch complete for 2025-09 (2.01 seconds).
[2025-10-24T18:14:47.159213] [INFO ] [REMOTE    ] DBRG: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T18:14:47.347734] [INFO ] [REMOTE    ] DB: Fetching primary data for 2025-10.
[2025-10-24T18:14:48.152836] [INFO ] [REMOTE    ] DBL: Fetching primary data for 2025-08.
[2025-10-24T18:14:48.164669] [INFO ] [REMOTE    ] DCI: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T18:14:48.881427] [INFO ] [REMOTE    ] DBL: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T18:14:48.947723] [INFO ] [REMOTE    ] DBRG: Fetching primary data for 2025-03.
[2025-10-24T18:14:49.343757] [INFO ] [REMOTE    ] DB: Incremental fetch complete for 2025-10 (2.00 seconds).
[2025-10-24T18:14:49.353235] [INFO ] [REMOTE    ] DB: Full fetch complete (75680 records).
[2025-10-24T18:14:49.353367] [DEBUG] [VALIDATOR ] DB: Validating primary data.
[2025-10-24T18:14:49.736114] [DEBUG] [VALIDATOR ] DB: All expected trading days are present.
[2025-10-24T18:14:49.736195] [DEBUG] [VALIDATOR ] DB: Primary data validation passed.
[2025-10-24T18:14:49.737093] [INFO ] [MAIN      ] DB: Fetched primary data is valid.
[2025-10-24T18:14:49.737189] [DEBUG] [LOCAL     ] DB: Saving primary data.
[2025-10-24T18:14:49.737789] [FATAL] [LOCAL     ] DB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:14:49.737876] [FATAL] [MAIN      ] DB: Failed to save primary data.
[2025-10-24T18:14:49.737919] [WARN ] [MAIN      ] DB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:14:49.737954] [INFO ] [LOCAL     ] DB: Starting deletion of primary data.
[2025-10-24T18:14:49.738005] [DEBUG] [LOCAL     ] DB: No primary data file found to delete.
[2025-10-24T18:14:49.738039] [INFO ] [LOCAL     ] DB: Starting deletion of derivative data.
[2025-10-24T18:14:49.738189] [DEBUG] [LOCAL     ] DB: Deleted derivative data file.
[2025-10-24T18:14:49.738598] [INFO ] [MAIN      ] Update Progress: 594/2366 symbols completed. DB took 40.9s. Estimated remaining: 3h 43m 5s. Rate: 7.9 symbols/min
[2025-10-24T18:14:49.752946] [INFO ] [REMOTE    ] DCI: Fetching primary data for 2025-02.
[2025-10-24T18:14:49.913151] [INFO ] [MAIN      ] DCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:14:49.929505] [DEBUG] [LOCAL     ] DCO: Loaded 15051 existing records from primary storage.
[2025-10-24T18:14:49.929781] [INFO ] [MAIN      ] DCO: Loaded 15051 existing records.
[2025-10-24T18:14:50.108778] [WARN ] [MAIN      ] DCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:14:50.108977] [INFO ] [MAIN      ] DCO: Wiping existing primary data before full refresh.
[2025-10-24T18:14:50.109022] [INFO ] [LOCAL     ] DCO: Starting deletion of primary data.
[2025-10-24T18:14:50.109314] [DEBUG] [LOCAL     ] DCO: Deleted primary data file.
[2025-10-24T18:14:50.109352] [INFO ] [MAIN      ] DCO: Starting full primary refresh.
[2025-10-24T18:14:50.471275] [INFO ] [REMOTE    ] DCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:14:50.505060] [INFO ] [REMOTE    ] DBRG: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T18:14:50.547620] [INFO ] [REMOTE    ] DCO: Fetching primary data for 2025-01.
[2025-10-24T18:14:50.899581] [INFO ] [REMOTE    ] DCI: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T18:14:51.286349] [INFO ] [REMOTE    ] DCO: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T18:14:51.347694] [INFO ] [REMOTE    ] DCO: Fetching primary data for 2025-02.
[2025-10-24T18:14:52.148084] [INFO ] [REMOTE    ] DBL: Fetching primary data for 2025-09.
[2025-10-24T18:14:52.149957] [INFO ] [REMOTE    ] DCO: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T18:14:52.883882] [INFO ] [REMOTE    ] DBL: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T18:14:52.947668] [INFO ] [REMOTE    ] DBL: Fetching primary data for 2025-10.
[2025-10-24T18:14:53.747769] [INFO ] [REMOTE    ] DBRG: Fetching primary data for 2025-04.
[2025-10-24T18:14:53.802122] [INFO ] [REMOTE    ] DBL: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T18:14:53.805255] [INFO ] [REMOTE    ] DBL: Full fetch complete (12818 records).
[2025-10-24T18:14:53.805585] [DEBUG] [VALIDATOR ] DBL: Validating primary data.
[2025-10-24T18:14:54.245454] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present.
[2025-10-24T18:14:54.245535] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed.
[2025-10-24T18:14:54.245878] [INFO ] [MAIN      ] DBL: Fetched primary data is valid.
[2025-10-24T18:14:54.245939] [DEBUG] [LOCAL     ] DBL: Saving primary data.
[2025-10-24T18:14:54.246174] [FATAL] [LOCAL     ] DBL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:14:54.246259] [FATAL] [MAIN      ] DBL: Failed to save primary data.
[2025-10-24T18:14:54.246311] [WARN ] [MAIN      ] DBL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:14:54.246383] [INFO ] [LOCAL     ] DBL: Starting deletion of primary data.
[2025-10-24T18:14:54.246451] [DEBUG] [LOCAL     ] DBL: No primary data file found to delete.
[2025-10-24T18:14:54.246523] [INFO ] [LOCAL     ] DBL: Starting deletion of derivative data.
[2025-10-24T18:14:54.246723] [DEBUG] [LOCAL     ] DBL: Deleted derivative data file.
[2025-10-24T18:14:54.246829] [INFO ] [MAIN      ] Update Progress: 595/2366 symbols completed. DBL took 20.6s. Estimated remaining: 3h 42m 48s. Rate: 7.9 symbols/min
[2025-10-24T18:14:54.428386] [INFO ] [MAIN      ] DD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:14:54.480301] [DEBUG] [LOCAL     ] DD: Loaded 53305 existing records from primary storage.
[2025-10-24T18:14:54.480635] [INFO ] [MAIN      ] DD: Loaded 53305 existing records.
[2025-10-24T18:14:54.552853] [INFO ] [REMOTE    ] DCI: Fetching primary data for 2025-03.
[2025-10-24T18:14:54.670736] [WARN ] [MAIN      ] DD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:14:54.670970] [INFO ] [MAIN      ] DD: Wiping existing primary data before full refresh.
[2025-10-24T18:14:54.671018] [INFO ] [LOCAL     ] DD: Starting deletion of primary data.
[2025-10-24T18:14:54.671636] [DEBUG] [LOCAL     ] DD: Deleted primary data file.
[2025-10-24T18:14:54.671728] [INFO ] [MAIN      ] DD: Starting full primary refresh.
[2025-10-24T18:14:55.065484] [INFO ] [REMOTE    ] DD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:14:55.347625] [INFO ] [REMOTE    ] DD: Fetching primary data for 2025-01.
[2025-10-24T18:14:55.495754] [INFO ] [REMOTE    ] DBRG: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T18:14:55.944505] [INFO ] [REMOTE    ] DCI: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T18:14:56.147716] [INFO ] [REMOTE    ] DCO: Fetching primary data for 2025-03.
[2025-10-24T18:14:56.723522] [INFO ] [REMOTE    ] DD: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T18:14:56.832177] [INFO ] [REMOTE    ] DCO: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T18:14:56.947618] [INFO ] [REMOTE    ] DCI: Fetching primary data for 2025-04.
[2025-10-24T18:14:57.747681] [INFO ] [REMOTE    ] DBRG: Fetching primary data for 2025-05.
[2025-10-24T18:14:58.441670] [INFO ] [REMOTE    ] DCI: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T18:14:58.547685] [INFO ] [REMOTE    ] DCI: Fetching primary data for 2025-05.
[2025-10-24T18:14:59.337432] [INFO ] [REMOTE    ] DBRG: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T18:14:59.347713] [INFO ] [REMOTE    ] DCO: Fetching primary data for 2025-04.
[2025-10-24T18:14:59.802133] [INFO ] [REMOTE    ] DCI: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T18:15:00.147670] [INFO ] [REMOTE    ] DBRG: Fetching primary data for 2025-06.
[2025-10-24T18:15:00.278780] [INFO ] [REMOTE    ] DCO: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T18:15:00.947686] [INFO ] [REMOTE    ] DCI: Fetching primary data for 2025-06.
[2025-10-24T18:15:01.747735] [INFO ] [REMOTE    ] DD: Fetching primary data for 2025-02.
[2025-10-24T18:15:01.992812] [INFO ] [REMOTE    ] DBRG: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T18:15:02.547680] [INFO ] [REMOTE    ] DBRG: Fetching primary data for 2025-07.
[2025-10-24T18:15:02.823134] [INFO ] [REMOTE    ] DCI: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T18:15:03.347688] [INFO ] [REMOTE    ] DCI: Fetching primary data for 2025-07.
[2025-10-24T18:15:04.051977] [INFO ] [REMOTE    ] DD: Incremental fetch complete for 2025-02 (2.30 seconds).
[2025-10-24T18:15:04.147703] [INFO ] [REMOTE    ] DD: Fetching primary data for 2025-03.
[2025-10-24T18:15:04.358433] [INFO ] [REMOTE    ] DBRG: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T18:15:04.613610] [INFO ] [REMOTE    ] DCI: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T18:15:04.947675] [INFO ] [REMOTE    ] DCO: Fetching primary data for 2025-05.
[2025-10-24T18:15:05.747728] [INFO ] [REMOTE    ] DCI: Fetching primary data for 2025-08.
[2025-10-24T18:15:06.103198] [INFO ] [REMOTE    ] DD: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T18:15:06.275968] [INFO ] [REMOTE    ] DCO: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T18:15:06.547705] [INFO ] [REMOTE    ] DBRG: Fetching primary data for 2025-08.
[2025-10-24T18:15:07.347624] [INFO ] [REMOTE    ] DD: Fetching primary data for 2025-04.
[2025-10-24T18:15:07.822220] [INFO ] [REMOTE    ] DCI: Incremental fetch complete for 2025-08 (2.07 seconds).
[2025-10-24T18:15:08.149638] [INFO ] [REMOTE    ] DCO: Fetching primary data for 2025-06.
[2025-10-24T18:15:08.152261] [INFO ] [REMOTE    ] DBRG: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T18:15:08.947679] [INFO ] [REMOTE    ] DBRG: Fetching primary data for 2025-09.
[2025-10-24T18:15:09.059074] [INFO ] [REMOTE    ] DCO: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T18:15:09.468146] [INFO ] [REMOTE    ] DD: Incremental fetch complete for 2025-04 (2.12 seconds).
[2025-10-24T18:15:09.747673] [INFO ] [REMOTE    ] DD: Fetching primary data for 2025-05.
[2025-10-24T18:15:10.110487] [INFO ] [REMOTE    ] DBRG: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T18:15:10.547699] [INFO ] [REMOTE    ] DBRG: Fetching primary data for 2025-10.
[2025-10-24T18:15:11.359178] [INFO ] [REMOTE    ] DCI: Fetching primary data for 2025-09.
[2025-10-24T18:15:11.386687] [INFO ] [REMOTE    ] DD: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T18:15:12.147700] [INFO ] [REMOTE    ] DD: Fetching primary data for 2025-06.
[2025-10-24T18:15:12.335313] [INFO ] [REMOTE    ] DBRG: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T18:15:12.345807] [INFO ] [REMOTE    ] DBRG: Full fetch complete (72600 records).
[2025-10-24T18:15:12.346062] [DEBUG] [VALIDATOR ] DBRG: Validating primary data.
[2025-10-24T18:15:12.772395] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present.
[2025-10-24T18:15:12.772496] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed.
[2025-10-24T18:15:12.773451] [INFO ] [MAIN      ] DBRG: Fetched primary data is valid.
[2025-10-24T18:15:12.773517] [DEBUG] [LOCAL     ] DBRG: Saving primary data.
[2025-10-24T18:15:12.774182] [FATAL] [LOCAL     ] DBRG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:15:12.774279] [FATAL] [MAIN      ] DBRG: Failed to save primary data.
[2025-10-24T18:15:12.774322] [WARN ] [MAIN      ] DBRG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:15:12.774384] [INFO ] [LOCAL     ] DBRG: Starting deletion of primary data.
[2025-10-24T18:15:12.774447] [DEBUG] [LOCAL     ] DBRG: No primary data file found to delete.
[2025-10-24T18:15:12.774486] [INFO ] [LOCAL     ] DBRG: Starting deletion of derivative data.
[2025-10-24T18:15:12.774688] [DEBUG] [LOCAL     ] DBRG: Deleted derivative data file.
[2025-10-24T18:15:12.775171] [INFO ] [MAIN      ] Update Progress: 596/2366 symbols completed. DBRG took 35.6s. Estimated remaining: 3h 43m 13s. Rate: 7.9 symbols/min
[2025-10-24T18:15:12.949123] [INFO ] [REMOTE    ] DCO: Fetching primary data for 2025-07.
[2025-10-24T18:15:12.953919] [INFO ] [MAIN      ] DDD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:15:12.979491] [INFO ] [REMOTE    ] DCI: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T18:15:13.032375] [DEBUG] [LOCAL     ] DDD: Loaded 51313 existing records from primary storage.
[2025-10-24T18:15:13.032737] [INFO ] [MAIN      ] DDD: Loaded 51313 existing records.
[2025-10-24T18:15:13.214740] [WARN ] [MAIN      ] DDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:15:13.214969] [INFO ] [MAIN      ] DDD: Wiping existing primary data before full refresh.
[2025-10-24T18:15:13.215018] [INFO ] [LOCAL     ] DDD: Starting deletion of primary data.
[2025-10-24T18:15:13.215967] [DEBUG] [LOCAL     ] DDD: Deleted primary data file.
[2025-10-24T18:15:13.216038] [INFO ] [MAIN      ] DDD: Starting full primary refresh.
[2025-10-24T18:15:13.590520] [INFO ] [REMOTE    ] DDD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:15:13.751685] [INFO ] [REMOTE    ] DDD: Fetching primary data for 2025-01.
[2025-10-24T18:15:13.757921] [INFO ] [REMOTE    ] DD: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T18:15:14.165114] [INFO ] [REMOTE    ] DCO: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T18:15:14.547683] [INFO ] [REMOTE    ] DD: Fetching primary data for 2025-07.
[2025-10-24T18:15:15.343709] [INFO ] [REMOTE    ] DDD: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T18:15:15.353015] [INFO ] [REMOTE    ] DCI: Fetching primary data for 2025-10.
[2025-10-24T18:15:16.147722] [INFO ] [REMOTE    ] DDD: Fetching primary data for 2025-02.
[2025-10-24T18:15:16.203329] [INFO ] [REMOTE    ] DD: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T18:15:16.945781] [INFO ] [REMOTE    ] DCI: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T18:15:16.954925] [INFO ] [REMOTE    ] DCO: Fetching primary data for 2025-08.
[2025-10-24T18:15:16.957091] [INFO ] [REMOTE    ] DCI: Full fetch complete (53741 records).
[2025-10-24T18:15:16.957329] [DEBUG] [VALIDATOR ] DCI: Validating primary data.
[2025-10-24T18:15:17.362757] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present.
[2025-10-24T18:15:17.362868] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed.
[2025-10-24T18:15:17.363725] [INFO ] [MAIN      ] DCI: Fetched primary data is valid.
[2025-10-24T18:15:17.363801] [DEBUG] [LOCAL     ] DCI: Saving primary data.
[2025-10-24T18:15:17.364394] [FATAL] [LOCAL     ] DCI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:15:17.364491] [FATAL] [MAIN      ] DCI: Failed to save primary data.
[2025-10-24T18:15:17.364534] [WARN ] [MAIN      ] DCI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:15:17.364570] [INFO ] [LOCAL     ] DCI: Starting deletion of primary data.
[2025-10-24T18:15:17.364624] [DEBUG] [LOCAL     ] DCI: No primary data file found to delete.
[2025-10-24T18:15:17.364698] [INFO ] [LOCAL     ] DCI: Starting deletion of derivative data.
[2025-10-24T18:15:17.364875] [DEBUG] [LOCAL     ] DCI: Deleted derivative data file.
[2025-10-24T18:15:17.365415] [INFO ] [MAIN      ] Update Progress: 597/2366 symbols completed. DCI took 33.1s. Estimated remaining: 3h 42m 57s. Rate: 7.9 symbols/min
[2025-10-24T18:15:17.752841] [INFO ] [REMOTE    ] DD: Fetching primary data for 2025-08.
[2025-10-24T18:15:17.769233] [INFO ] [REMOTE    ] DDD: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T18:15:17.929355] [INFO ] [REMOTE    ] DCO: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T18:15:18.547632] [INFO ] [REMOTE    ] DDD: Fetching primary data for 2025-03.
[2025-10-24T18:15:19.347677] [INFO ] [REMOTE    ] DCO: Fetching primary data for 2025-09.
[2025-10-24T18:15:19.521916] [INFO ] [REMOTE    ] DD: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T18:15:20.147692] [INFO ] [REMOTE    ] DD: Fetching primary data for 2025-09.
[2025-10-24T18:15:20.193473] [INFO ] [REMOTE    ] DDD: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T18:15:20.308095] [INFO ] [REMOTE    ] DCO: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T18:15:20.947669] [INFO ] [REMOTE    ] DDD: Fetching primary data for 2025-04.
[2025-10-24T18:15:21.747621] [INFO ] [REMOTE    ] DCO: Fetching primary data for 2025-10.
[2025-10-24T18:15:21.946972] [INFO ] [REMOTE    ] DD: Incremental fetch complete for 2025-09 (1.80 seconds).
[2025-10-24T18:15:22.129701] [INFO ] [REMOTE    ] DDD: Incremental fetch complete for 2025-04 (1.18 seconds).
[2025-10-24T18:15:22.547692] [INFO ] [REMOTE    ] DD: Fetching primary data for 2025-10.
[2025-10-24T18:15:22.867225] [INFO ] [REMOTE    ] DCO: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T18:15:22.870763] [INFO ] [REMOTE    ] DCO: Full fetch complete (19646 records).
[2025-10-24T18:15:22.870832] [DEBUG] [VALIDATOR ] DCO: Validating primary data.
[2025-10-24T18:15:22.871250] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:15:22.871329] [FATAL] [MAIN      ] DCO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:15:22.871369] [WARN ] [MAIN      ] DCO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:15:22.871405] [INFO ] [LOCAL     ] DCO: Starting deletion of primary data.
[2025-10-24T18:15:22.871457] [DEBUG] [LOCAL     ] DCO: No primary data file found to delete.
[2025-10-24T18:15:22.871489] [INFO ] [LOCAL     ] DCO: Starting deletion of derivative data.
[2025-10-24T18:15:22.871613] [DEBUG] [LOCAL     ] DCO: Deleted derivative data file.
[2025-10-24T18:15:22.871715] [INFO ] [MAIN      ] Update Progress: 598/2366 symbols completed. DCO took 33.1s. Estimated remaining: 3h 42m 43s. Rate: 7.9 symbols/min
[2025-10-24T18:15:23.347706] [INFO ] [REMOTE    ] DDD: Fetching primary data for 2025-05.
[2025-10-24T18:15:24.441176] [INFO ] [REMOTE    ] DD: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T18:15:24.450690] [INFO ] [REMOTE    ] DD: Full fetch complete (76612 records).
[2025-10-24T18:15:24.450813] [DEBUG] [VALIDATOR ] DD: Validating primary data.
[2025-10-24T18:15:24.843673] [DEBUG] [VALIDATOR ] DD: All expected trading days are present.
[2025-10-24T18:15:24.843853] [DEBUG] [VALIDATOR ] DD: Primary data validation passed.
[2025-10-24T18:15:24.844931] [INFO ] [MAIN      ] DD: Fetched primary data is valid.
[2025-10-24T18:15:24.845094] [DEBUG] [LOCAL     ] DD: Saving primary data.
[2025-10-24T18:15:24.845833] [FATAL] [LOCAL     ] DD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:15:24.845930] [FATAL] [MAIN      ] DD: Failed to save primary data.
[2025-10-24T18:15:24.845972] [WARN ] [MAIN      ] DD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:15:24.846014] [INFO ] [LOCAL     ] DD: Starting deletion of primary data.
[2025-10-24T18:15:24.846067] [DEBUG] [LOCAL     ] DD: No primary data file found to delete.
[2025-10-24T18:15:24.846102] [INFO ] [LOCAL     ] DD: Starting deletion of derivative data.
[2025-10-24T18:15:24.846231] [DEBUG] [LOCAL     ] DD: Deleted derivative data file.
[2025-10-24T18:15:24.846696] [INFO ] [MAIN      ] Update Progress: 599/2366 symbols completed. DD took 30.6s. Estimated remaining: 3h 42m 19s. Rate: 7.9 symbols/min
[2025-10-24T18:15:25.014959] [INFO ] [REMOTE    ] DDD: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T18:15:25.025957] [INFO ] [REMOTE    ] DDD: Fetching primary data for 2025-06.
[2025-10-24T18:15:26.828275] [INFO ] [REMOTE    ] DDD: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T18:15:26.838851] [INFO ] [REMOTE    ] DDD: Fetching primary data for 2025-07.
[2025-10-24T18:15:28.620138] [INFO ] [REMOTE    ] DDD: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T18:15:28.631571] [INFO ] [REMOTE    ] DDD: Fetching primary data for 2025-08.
[2025-10-24T18:15:30.278798] [INFO ] [REMOTE    ] DDD: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T18:15:30.289828] [INFO ] [REMOTE    ] DDD: Fetching primary data for 2025-09.
[2025-10-24T18:15:31.872444] [INFO ] [REMOTE    ] DDD: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T18:15:31.884207] [INFO ] [REMOTE    ] DDD: Fetching primary data for 2025-10.
[2025-10-24T18:15:33.839247] [INFO ] [REMOTE    ] DDD: Incremental fetch complete for 2025-10 (1.96 seconds).
[2025-10-24T18:15:33.848698] [INFO ] [REMOTE    ] DDD: Full fetch complete (73616 records).
[2025-10-24T18:15:33.848863] [DEBUG] [VALIDATOR ] DDD: Validating primary data.
[2025-10-24T18:15:33.849724] [FATAL] [VALIDATOR ] DDD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:15:33.849837] [FATAL] [MAIN      ] DDD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:15:33.849880] [WARN ] [MAIN      ] DDD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:15:33.849917] [INFO ] [LOCAL     ] DDD: Starting deletion of primary data.
[2025-10-24T18:15:33.849973] [DEBUG] [LOCAL     ] DDD: No primary data file found to delete.
[2025-10-24T18:15:33.850008] [INFO ] [LOCAL     ] DDD: Starting deletion of derivative data.
[2025-10-24T18:15:33.850171] [DEBUG] [LOCAL     ] DDD: Deleted derivative data file.
[2025-10-24T18:15:33.850610] [INFO ] [MAIN      ] Update Progress: 600/2366 symbols completed. DDD took 21.1s. Estimated remaining: 3h 42m 16s. Rate: 7.9 symbols/min
[2025-10-24T18:15:34.541711] [INFO ] [MAIN      ] DDT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:15:34.543191] [INFO ] [MAIN      ] DDS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:15:34.557754] [INFO ] [MAIN      ] DE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:15:34.593632] [INFO ] [MAIN      ] DDL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:15:34.593814] [DEBUG] [LOCAL     ] DDT: Loaded 1876 existing records from primary storage.
[2025-10-24T18:15:34.597530] [INFO ] [MAIN      ] DDT: Loaded 1876 existing records.
[2025-10-24T18:15:34.709794] [DEBUG] [LOCAL     ] DDS: Loaded 12405 existing records from primary storage.
[2025-10-24T18:15:34.711044] [INFO ] [MAIN      ] DDS: Loaded 12405 existing records.
[2025-10-24T18:15:34.890959] [WARN ] [MAIN      ] DDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:15:34.918128] [INFO ] [MAIN      ] DDT: Wiping existing primary data before full refresh.
[2025-10-24T18:15:34.928161] [INFO ] [LOCAL     ] DDT: Starting deletion of primary data.
[2025-10-24T18:15:34.938574] [DEBUG] [LOCAL     ] DDL: Loaded 37424 existing records from primary storage.
[2025-10-24T18:15:34.938663] [DEBUG] [LOCAL     ] DDT: Deleted primary data file.
[2025-10-24T18:15:34.949973] [INFO ] [MAIN      ] DDT: Starting full primary refresh.
[2025-10-24T18:15:34.950181] [INFO ] [MAIN      ] DDL: Loaded 37424 existing records.
[2025-10-24T18:15:35.205562] [WARN ] [MAIN      ] DDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:15:35.237862] [DEBUG] [LOCAL     ] DE: Loaded 47878 existing records from primary storage.
[2025-10-24T18:15:35.246341] [INFO ] [MAIN      ] DDS: Wiping existing primary data before full refresh.
[2025-10-24T18:15:35.296252] [INFO ] [LOCAL     ] DDS: Starting deletion of primary data.
[2025-10-24T18:15:35.246612] [INFO ] [MAIN      ] DE: Loaded 47878 existing records.
[2025-10-24T18:15:35.349153] [DEBUG] [LOCAL     ] DDS: Deleted primary data file.
[2025-10-24T18:15:35.395004] [INFO ] [MAIN      ] DDS: Starting full primary refresh.
[2025-10-24T18:15:35.442339] [WARN ] [MAIN      ] DDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:15:35.554513] [INFO ] [MAIN      ] DDL: Wiping existing primary data before full refresh.
[2025-10-24T18:15:35.642057] [INFO ] [LOCAL     ] DDL: Starting deletion of primary data.
[2025-10-24T18:15:35.704980] [DEBUG] [LOCAL     ] DDL: Deleted primary data file.
[2025-10-24T18:15:35.843743] [WARN ] [MAIN      ] DE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:15:35.823178] [INFO ] [MAIN      ] DDL: Starting full primary refresh.
[2025-10-24T18:15:35.906925] [INFO ] [MAIN      ] DE: Wiping existing primary data before full refresh.
[2025-10-24T18:15:35.983768] [INFO ] [LOCAL     ] DE: Starting deletion of primary data.
[2025-10-24T18:15:36.030702] [INFO ] [REMOTE    ] DDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:15:36.063630] [DEBUG] [LOCAL     ] DE: Deleted primary data file.
[2025-10-24T18:15:36.079439] [INFO ] [REMOTE    ] DDT: Fetching primary data for 2025-01.
[2025-10-24T18:15:36.122528] [INFO ] [MAIN      ] DE: Starting full primary refresh.
[2025-10-24T18:15:36.413784] [INFO ] [REMOTE    ] DDS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:15:36.490448] [INFO ] [REMOTE    ] DDS: Fetching primary data for 2025-01.
[2025-10-24T18:15:36.802977] [INFO ] [REMOTE    ] DDL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:15:36.817710] [INFO ] [REMOTE    ] DDL: Fetching primary data for 2025-01.
[2025-10-24T18:15:36.818572] [INFO ] [REMOTE    ] DDT: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T18:15:36.830962] [INFO ] [REMOTE    ] DDT: Fetching primary data for 2025-02.
[2025-10-24T18:15:36.909089] [INFO ] [REMOTE    ] DE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:15:36.909405] [INFO ] [REMOTE    ] DE: Fetching primary data for 2025-01.
[2025-10-24T18:15:37.344925] [INFO ] [REMOTE    ] DDT: Incremental fetch complete for 2025-02 (0.51 seconds).
[2025-10-24T18:15:37.346054] [INFO ] [REMOTE    ] DDT: Fetching primary data for 2025-03.
[2025-10-24T18:15:37.676841] [INFO ] [REMOTE    ] DDS: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T18:15:37.683840] [INFO ] [REMOTE    ] DDS: Fetching primary data for 2025-02.
[2025-10-24T18:15:37.788021] [INFO ] [REMOTE    ] DDT: Incremental fetch complete for 2025-03 (0.44 seconds).
[2025-10-24T18:15:37.789148] [INFO ] [REMOTE    ] DDT: Fetching primary data for 2025-04.
[2025-10-24T18:15:38.292454] [INFO ] [REMOTE    ] DDL: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T18:15:38.299707] [INFO ] [REMOTE    ] DDL: Fetching primary data for 2025-02.
[2025-10-24T18:15:38.342537] [INFO ] [REMOTE    ] DDT: Incremental fetch complete for 2025-04 (0.55 seconds).
[2025-10-24T18:15:38.344030] [INFO ] [REMOTE    ] DDT: Fetching primary data for 2025-05.
[2025-10-24T18:15:38.597695] [INFO ] [REMOTE    ] DDS: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T18:15:38.600838] [INFO ] [REMOTE    ] DDS: Fetching primary data for 2025-03.
[2025-10-24T18:15:38.778215] [INFO ] [REMOTE    ] DE: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T18:15:38.788222] [INFO ] [REMOTE    ] DE: Fetching primary data for 2025-02.
[2025-10-24T18:15:38.872205] [INFO ] [REMOTE    ] DDT: Incremental fetch complete for 2025-05 (0.53 seconds).
[2025-10-24T18:15:38.873318] [INFO ] [REMOTE    ] DDT: Fetching primary data for 2025-06.
[2025-10-24T18:15:39.170572] [INFO ] [REMOTE    ] DDS: Incremental fetch complete for 2025-03 (0.57 seconds).
[2025-10-24T18:15:39.174431] [INFO ] [REMOTE    ] DDS: Fetching primary data for 2025-04.
[2025-10-24T18:15:39.318919] [INFO ] [REMOTE    ] DDT: Incremental fetch complete for 2025-06 (0.45 seconds).
[2025-10-24T18:15:39.347602] [INFO ] [REMOTE    ] DDT: Fetching primary data for 2025-07.
[2025-10-24T18:15:39.551037] [INFO ] [REMOTE    ] DDL: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T18:15:39.907909] [INFO ] [REMOTE    ] DDT: Incremental fetch complete for 2025-07 (0.56 seconds).
[2025-10-24T18:15:40.140181] [INFO ] [REMOTE    ] DDS: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T18:15:40.147609] [INFO ] [REMOTE    ] DDL: Fetching primary data for 2025-03.
[2025-10-24T18:15:40.199192] [INFO ] [REMOTE    ] DE: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T18:15:40.947677] [INFO ] [REMOTE    ] DDS: Fetching primary data for 2025-05.
[2025-10-24T18:15:41.534092] [INFO ] [REMOTE    ] DDL: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T18:15:41.569567] [INFO ] [REMOTE    ] DDS: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T18:15:41.747682] [INFO ] [REMOTE    ] DDS: Fetching primary data for 2025-06.
[2025-10-24T18:15:42.451530] [INFO ] [REMOTE    ] DDS: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T18:15:42.547639] [INFO ] [REMOTE    ] DDL: Fetching primary data for 2025-04.
[2025-10-24T18:15:43.347689] [INFO ] [REMOTE    ] DDS: Fetching primary data for 2025-07.
[2025-10-24T18:15:44.147622] [INFO ] [REMOTE    ] DDT: Fetching primary data for 2025-08.
[2025-10-24T18:15:44.263939] [INFO ] [REMOTE    ] DDS: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T18:15:44.263447] [INFO ] [REMOTE    ] DDL: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T18:15:44.588736] [INFO ] [REMOTE    ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T18:15:44.947701] [INFO ] [REMOTE    ] DDS: Fetching primary data for 2025-08.
[2025-10-24T18:15:45.747729] [INFO ] [REMOTE    ] DDL: Fetching primary data for 2025-05.
[2025-10-24T18:15:45.861148] [INFO ] [REMOTE    ] DDS: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T18:15:46.547774] [INFO ] [REMOTE    ] DE: Fetching primary data for 2025-03.
[2025-10-24T18:15:47.304806] [INFO ] [REMOTE    ] DDL: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T18:15:47.347728] [INFO ] [REMOTE    ] DDT: Fetching primary data for 2025-09.
[2025-10-24T18:15:48.147632] [INFO ] [REMOTE    ] DDL: Fetching primary data for 2025-06.
[2025-10-24T18:15:48.157287] [INFO ] [REMOTE    ] DDT: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T18:15:48.211229] [INFO ] [REMOTE    ] DE: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T18:15:48.947707] [INFO ] [REMOTE    ] DDS: Fetching primary data for 2025-09.
[2025-10-24T18:15:49.390238] [INFO ] [REMOTE    ] DDL: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T18:15:49.747665] [INFO ] [REMOTE    ] DDL: Fetching primary data for 2025-07.
[2025-10-24T18:15:49.802172] [INFO ] [REMOTE    ] DDS: Incremental fetch complete for 2025-09 (0.85 seconds).
[2025-10-24T18:15:50.547677] [INFO ] [REMOTE    ] DDT: Fetching primary data for 2025-10.
[2025-10-24T18:15:50.728864] [INFO ] [REMOTE    ] DDL: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T18:15:51.006164] [INFO ] [REMOTE    ] DDT: Incremental fetch complete for 2025-10 (0.46 seconds).
[2025-10-24T18:15:51.007055] [INFO ] [REMOTE    ] DDT: Full fetch complete (2810 records).
[2025-10-24T18:15:51.007121] [DEBUG] [VALIDATOR ] DDT: Validating primary data.
[2025-10-24T18:15:51.355696] [INFO ] [REMOTE    ] DDL: Fetching primary data for 2025-08.
[2025-10-24T18:15:51.362062] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present.
[2025-10-24T18:15:51.362138] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed.
[2025-10-24T18:15:51.362249] [INFO ] [MAIN      ] DDT: Fetched primary data is valid.
[2025-10-24T18:15:51.362308] [DEBUG] [LOCAL     ] DDT: Saving primary data.
[2025-10-24T18:15:51.362478] [FATAL] [LOCAL     ] DDT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:15:51.362554] [FATAL] [MAIN      ] DDT: Failed to save primary data.
[2025-10-24T18:15:51.362617] [WARN ] [MAIN      ] DDT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:15:51.362706] [INFO ] [LOCAL     ] DDT: Starting deletion of primary data.
[2025-10-24T18:15:51.362760] [DEBUG] [LOCAL     ] DDT: No primary data file found to delete.
[2025-10-24T18:15:51.362795] [INFO ] [LOCAL     ] DDT: Starting deletion of derivative data.
[2025-10-24T18:15:51.362920] [DEBUG] [LOCAL     ] DDT: Deleted derivative data file.
[2025-10-24T18:15:51.362985] [INFO ] [MAIN      ] Update Progress: 601/2366 symbols completed. DDT took 17.5s. Estimated remaining: 3h 42m 38s. Rate: 7.9 symbols/min
[2025-10-24T18:15:51.555891] [INFO ] [MAIN      ] DEA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:15:51.596141] [DEBUG] [LOCAL     ] DEA: Loaded 40311 existing records from primary storage.
[2025-10-24T18:15:51.596435] [INFO ] [MAIN      ] DEA: Loaded 40311 existing records.
[2025-10-24T18:15:51.778767] [WARN ] [MAIN      ] DEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:15:51.778980] [INFO ] [MAIN      ] DEA: Wiping existing primary data before full refresh.
[2025-10-24T18:15:51.779026] [INFO ] [LOCAL     ] DEA: Starting deletion of primary data.
[2025-10-24T18:15:51.779847] [DEBUG] [LOCAL     ] DEA: Deleted primary data file.
[2025-10-24T18:15:51.779909] [INFO ] [MAIN      ] DEA: Starting full primary refresh.
[2025-10-24T18:15:52.148129] [INFO ] [REMOTE    ] DEA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:15:52.148234] [INFO ] [REMOTE    ] DDS: Fetching primary data for 2025-10.
[2025-10-24T18:15:52.947730] [INFO ] [REMOTE    ] DEA: Fetching primary data for 2025-01.
[2025-10-24T18:15:52.963093] [INFO ] [REMOTE    ] DDS: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T18:15:52.965130] [INFO ] [REMOTE    ] DDS: Full fetch complete (18387 records).
[2025-10-24T18:15:52.965210] [DEBUG] [VALIDATOR ] DDS: Validating primary data.
[2025-10-24T18:15:53.359268] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present.
[2025-10-24T18:15:53.359361] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed.
[2025-10-24T18:15:53.359817] [INFO ] [MAIN      ] DDS: Fetched primary data is valid.
[2025-10-24T18:15:53.359880] [DEBUG] [LOCAL     ] DDS: Saving primary data.
[2025-10-24T18:15:53.360160] [FATAL] [LOCAL     ] DDS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:15:53.360272] [FATAL] [MAIN      ] DDS: Failed to save primary data.
[2025-10-24T18:15:53.360328] [WARN ] [MAIN      ] DDS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:15:53.360367] [INFO ] [LOCAL     ] DDS: Starting deletion of primary data.
[2025-10-24T18:15:53.360418] [DEBUG] [LOCAL     ] DDS: No primary data file found to delete.
[2025-10-24T18:15:53.360456] [INFO ] [LOCAL     ] DDS: Starting deletion of derivative data.
[2025-10-24T18:15:53.360617] [DEBUG] [LOCAL     ] DDS: Deleted derivative data file.
[2025-10-24T18:15:53.360752] [INFO ] [MAIN      ] Update Progress: 602/2366 symbols completed. DDS took 19.5s. Estimated remaining: 3h 42m 14s. Rate: 7.9 symbols/min
[2025-10-24T18:15:53.541484] [INFO ] [MAIN      ] DEC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:15:53.575214] [DEBUG] [LOCAL     ] DEC: Loaded 30427 existing records from primary storage.
[2025-10-24T18:15:53.575544] [INFO ] [MAIN      ] DEC: Loaded 30427 existing records.
[2025-10-24T18:15:53.751394] [WARN ] [MAIN      ] DEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:15:53.751528] [INFO ] [REMOTE    ] DE: Fetching primary data for 2025-04.
[2025-10-24T18:15:53.752744] [INFO ] [MAIN      ] DEC: Wiping existing primary data before full refresh.
[2025-10-24T18:15:53.752808] [INFO ] [LOCAL     ] DEC: Starting deletion of primary data.
[2025-10-24T18:15:53.753010] [DEBUG] [LOCAL     ] DEC: Deleted primary data file.
[2025-10-24T18:15:53.753067] [INFO ] [MAIN      ] DEC: Starting full primary refresh.
[2025-10-24T18:15:54.105112] [INFO ] [REMOTE    ] DEC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:15:54.547638] [INFO ] [REMOTE    ] DEC: Fetching primary data for 2025-01.
[2025-10-24T18:15:55.358746] [INFO ] [REMOTE    ] DDL: Incremental fetch complete for 2025-08 (4.00 seconds).
[2025-10-24T18:15:55.368134] [INFO ] [REMOTE    ] DDL: Fetching primary data for 2025-09.
[2025-10-24T18:15:55.751177] [INFO ] [REMOTE    ] DE: Incremental fetch complete for 2025-04 (2.00 seconds).
[2025-10-24T18:15:55.788048] [INFO ] [REMOTE    ] DEC: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T18:15:56.147741] [INFO ] [REMOTE    ] DE: Fetching primary data for 2025-05.
[2025-10-24T18:15:56.947726] [INFO ] [REMOTE    ] DEC: Fetching primary data for 2025-02.
[2025-10-24T18:15:57.108846] [INFO ] [REMOTE    ] DEA: Incremental fetch complete for 2025-01 (4.16 seconds).
[2025-10-24T18:15:57.748299] [INFO ] [REMOTE    ] DE: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T18:15:57.748451] [INFO ] [REMOTE    ] DEA: Fetching primary data for 2025-02.
[2025-10-24T18:15:58.193356] [INFO ] [REMOTE    ] DEC: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T18:15:58.433736] [INFO ] [REMOTE    ] DDL: Incremental fetch complete for 2025-09 (3.07 seconds).
[2025-10-24T18:15:58.547709] [INFO ] [REMOTE    ] DEC: Fetching primary data for 2025-03.
[2025-10-24T18:15:59.347621] [INFO ] [REMOTE    ] DE: Fetching primary data for 2025-06.
[2025-10-24T18:16:00.087670] [INFO ] [REMOTE    ] DEC: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T18:16:00.147679] [INFO ] [REMOTE    ] DEC: Fetching primary data for 2025-04.
[2025-10-24T18:16:00.199394] [INFO ] [REMOTE    ] DEA: Incremental fetch complete for 2025-02 (2.45 seconds).
[2025-10-24T18:16:00.947718] [INFO ] [REMOTE    ] DDL: Fetching primary data for 2025-10.
[2025-10-24T18:16:01.747629] [INFO ] [REMOTE    ] DEA: Fetching primary data for 2025-03.
[2025-10-24T18:16:01.774571] [INFO ] [REMOTE    ] DE: Incremental fetch complete for 2025-06 (2.43 seconds).
[2025-10-24T18:16:02.105947] [INFO ] [REMOTE    ] DEC: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T18:16:02.547698] [INFO ] [REMOTE    ] DE: Fetching primary data for 2025-07.
[2025-10-24T18:16:03.347764] [INFO ] [REMOTE    ] DEC: Fetching primary data for 2025-05.
[2025-10-24T18:16:03.567995] [INFO ] [REMOTE    ] DDL: Incremental fetch complete for 2025-10 (2.62 seconds).
[2025-10-24T18:16:03.576370] [INFO ] [REMOTE    ] DDL: Full fetch complete (53332 records).
[2025-10-24T18:16:03.576505] [DEBUG] [VALIDATOR ] DDL: Validating primary data.
[2025-10-24T18:16:03.577230] [FATAL] [VALIDATOR ] DDL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:16:03.577342] [FATAL] [MAIN      ] DDL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:16:03.577386] [WARN ] [MAIN      ] DDL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:16:03.577450] [INFO ] [LOCAL     ] DDL: Starting deletion of primary data.
[2025-10-24T18:16:03.577514] [DEBUG] [LOCAL     ] DDL: No primary data file found to delete.
[2025-10-24T18:16:03.577565] [INFO ] [LOCAL     ] DDL: Starting deletion of derivative data.
[2025-10-24T18:16:03.577724] [DEBUG] [LOCAL     ] DDL: Deleted derivative data file.
[2025-10-24T18:16:03.578140] [INFO ] [MAIN      ] Update Progress: 603/2366 symbols completed. DDL took 29.7s. Estimated remaining: 3h 42m 14s. Rate: 7.9 symbols/min
[2025-10-24T18:16:03.766253] [INFO ] [MAIN      ] DECK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:16:03.826630] [DEBUG] [LOCAL     ] DECK: Loaded 53691 existing records from primary storage.
[2025-10-24T18:16:03.826986] [INFO ] [MAIN      ] DECK: Loaded 53691 existing records.
[2025-10-24T18:16:04.001924] [WARN ] [MAIN      ] DECK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:16:04.002150] [INFO ] [MAIN      ] DECK: Wiping existing primary data before full refresh.
[2025-10-24T18:16:04.002197] [INFO ] [LOCAL     ] DECK: Starting deletion of primary data.
[2025-10-24T18:16:04.002677] [DEBUG] [LOCAL     ] DECK: Deleted primary data file.
[2025-10-24T18:16:04.002734] [INFO ] [MAIN      ] DECK: Starting full primary refresh.
[2025-10-24T18:16:04.366258] [INFO ] [REMOTE    ] DECK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:16:04.366577] [INFO ] [REMOTE    ] DECK: Fetching primary data for 2025-01.
[2025-10-24T18:16:04.813221] [INFO ] [REMOTE    ] DEA: Incremental fetch complete for 2025-03 (3.07 seconds).
[2025-10-24T18:16:04.885614] [INFO ] [REMOTE    ] DE: Incremental fetch complete for 2025-07 (2.34 seconds).
[2025-10-24T18:16:04.947674] [INFO ] [REMOTE    ] DE: Fetching primary data for 2025-08.
[2025-10-24T18:16:05.747759] [INFO ] [REMOTE    ] DEA: Fetching primary data for 2025-04.
[2025-10-24T18:16:05.975021] [INFO ] [REMOTE    ] DEC: Incremental fetch complete for 2025-05 (2.63 seconds).
[2025-10-24T18:16:06.547719] [INFO ] [REMOTE    ] DEC: Fetching primary data for 2025-06.
[2025-10-24T18:16:07.266691] [INFO ] [REMOTE    ] DE: Incremental fetch complete for 2025-08 (2.32 seconds).
[2025-10-24T18:16:07.351165] [INFO ] [REMOTE    ] DE: Fetching primary data for 2025-09.
[2025-10-24T18:16:07.356529] [INFO ] [REMOTE    ] DEA: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T18:16:07.465811] [INFO ] [REMOTE    ] DECK: Incremental fetch complete for 2025-01 (3.10 seconds).
[2025-10-24T18:16:07.784407] [INFO ] [REMOTE    ] DEC: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T18:16:08.147719] [INFO ] [REMOTE    ] DEC: Fetching primary data for 2025-07.
[2025-10-24T18:16:08.947706] [INFO ] [REMOTE    ] DEA: Fetching primary data for 2025-05.
[2025-10-24T18:16:09.044180] [INFO ] [REMOTE    ] DE: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T18:16:09.276301] [INFO ] [REMOTE    ] DEC: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T18:16:09.747745] [INFO ] [REMOTE    ] DEC: Fetching primary data for 2025-08.
[2025-10-24T18:16:10.161378] [INFO ] [REMOTE    ] DEA: Incremental fetch complete for 2025-05 (1.21 seconds).
[2025-10-24T18:16:10.547616] [INFO ] [REMOTE    ] DEA: Fetching primary data for 2025-06.
[2025-10-24T18:16:10.840850] [INFO ] [REMOTE    ] DEC: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T18:16:11.347692] [INFO ] [REMOTE    ] DE: Fetching primary data for 2025-10.
[2025-10-24T18:16:11.850849] [INFO ] [REMOTE    ] DEA: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T18:16:12.147638] [INFO ] [REMOTE    ] DECK: Fetching primary data for 2025-02.
[2025-10-24T18:16:12.947621] [INFO ] [REMOTE    ] DEC: Fetching primary data for 2025-09.
[2025-10-24T18:16:13.131815] [INFO ] [REMOTE    ] DE: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T18:16:13.140112] [INFO ] [REMOTE    ] DE: Full fetch complete (69591 records).
[2025-10-24T18:16:13.140238] [DEBUG] [VALIDATOR ] DE: Validating primary data.
[2025-10-24T18:16:13.140981] [FATAL] [VALIDATOR ] DE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:16:13.141081] [FATAL] [MAIN      ] DE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:16:13.141123] [WARN ] [MAIN      ] DE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:16:13.141189] [INFO ] [LOCAL     ] DE: Starting deletion of primary data.
[2025-10-24T18:16:13.141255] [DEBUG] [LOCAL     ] DE: No primary data file found to delete.
[2025-10-24T18:16:13.141291] [INFO ] [LOCAL     ] DE: Starting deletion of derivative data.
[2025-10-24T18:16:13.141417] [DEBUG] [LOCAL     ] DE: Deleted derivative data file.
[2025-10-24T18:16:13.141837] [INFO ] [MAIN      ] Update Progress: 604/2366 symbols completed. DE took 39.3s. Estimated remaining: 3h 42m 12s. Rate: 7.9 symbols/min
[2025-10-24T18:16:13.308867] [INFO ] [MAIN      ] DEI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:16:13.356966] [DEBUG] [LOCAL     ] DEI: Loaded 48643 existing records from primary storage.
[2025-10-24T18:16:13.357288] [INFO ] [MAIN      ] DEI: Loaded 48643 existing records.
[2025-10-24T18:16:13.540305] [WARN ] [MAIN      ] DEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:16:13.540576] [INFO ] [MAIN      ] DEI: Wiping existing primary data before full refresh.
[2025-10-24T18:16:13.540682] [INFO ] [LOCAL     ] DEI: Starting deletion of primary data.
[2025-10-24T18:16:13.541042] [DEBUG] [LOCAL     ] DEI: Deleted primary data file.
[2025-10-24T18:16:13.541097] [INFO ] [MAIN      ] DEI: Starting full primary refresh.
[2025-10-24T18:16:13.757504] [INFO ] [REMOTE    ] DEA: Fetching primary data for 2025-07.
[2025-10-24T18:16:13.902003] [INFO ] [REMOTE    ] DEI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:16:14.225189] [INFO ] [REMOTE    ] DEC: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T18:16:14.547732] [INFO ] [REMOTE    ] DEI: Fetching primary data for 2025-01.
[2025-10-24T18:16:14.759349] [INFO ] [REMOTE    ] DECK: Incremental fetch complete for 2025-02 (2.61 seconds).
[2025-10-24T18:16:15.207498] [INFO ] [REMOTE    ] DEA: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T18:16:15.347727] [INFO ] [REMOTE    ] DECK: Fetching primary data for 2025-03.
[2025-10-24T18:16:16.147693] [INFO ] [REMOTE    ] DEA: Fetching primary data for 2025-08.
[2025-10-24T18:16:16.313290] [INFO ] [REMOTE    ] DEI: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T18:16:16.947694] [INFO ] [REMOTE    ] DEC: Fetching primary data for 2025-10.
[2025-10-24T18:16:16.993357] [INFO ] [REMOTE    ] DECK: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T18:16:17.451425] [INFO ] [REMOTE    ] DEA: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T18:16:17.747725] [INFO ] [REMOTE    ] DEA: Fetching primary data for 2025-09.
[2025-10-24T18:16:18.435515] [INFO ] [REMOTE    ] DEC: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T18:16:18.441605] [INFO ] [REMOTE    ] DEC: Full fetch complete (44536 records).
[2025-10-24T18:16:18.441719] [DEBUG] [VALIDATOR ] DEC: Validating primary data.
[2025-10-24T18:16:18.552910] [INFO ] [REMOTE    ] DECK: Fetching primary data for 2025-04.
[2025-10-24T18:16:18.849385] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present.
[2025-10-24T18:16:18.849492] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed.
[2025-10-24T18:16:18.850622] [INFO ] [MAIN      ] DEC: Fetched primary data is valid.
[2025-10-24T18:16:18.850718] [DEBUG] [LOCAL     ] DEC: Saving primary data.
[2025-10-24T18:16:18.851468] [FATAL] [LOCAL     ] DEC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:16:18.851565] [FATAL] [MAIN      ] DEC: Failed to save primary data.
[2025-10-24T18:16:18.851610] [WARN ] [MAIN      ] DEC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:16:18.851737] [INFO ] [LOCAL     ] DEC: Starting deletion of primary data.
[2025-10-24T18:16:18.851818] [DEBUG] [LOCAL     ] DEC: No primary data file found to delete.
[2025-10-24T18:16:18.851856] [INFO ] [LOCAL     ] DEC: Starting deletion of derivative data.
[2025-10-24T18:16:18.852141] [DEBUG] [LOCAL     ] DEC: Deleted derivative data file.
[2025-10-24T18:16:18.852265] [INFO ] [MAIN      ] Update Progress: 605/2366 symbols completed. DEC took 25.5s. Estimated remaining: 3h 41m 59s. Rate: 7.9 symbols/min
[2025-10-24T18:16:19.029973] [INFO ] [MAIN      ] DELL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:16:19.030390] [DEBUG] [LOCAL     ] DELL: No existing data file found in primary storage.
[2025-10-24T18:16:19.030444] [WARN ] [MAIN      ] DELL: No existing data found, performing full refresh instead.
[2025-10-24T18:16:19.030564] [INFO ] [MAIN      ] DELL: Wiping existing primary data before full refresh.
[2025-10-24T18:16:19.030606] [INFO ] [LOCAL     ] DELL: Starting deletion of primary data.
[2025-10-24T18:16:19.030675] [DEBUG] [LOCAL     ] DELL: No primary data file found to delete.
[2025-10-24T18:16:19.030729] [INFO ] [MAIN      ] DELL: Starting full primary refresh.
[2025-10-24T18:16:19.350075] [INFO ] [REMOTE    ] DEI: Fetching primary data for 2025-02.
[2025-10-24T18:16:19.422987] [INFO ] [REMOTE    ] DEA: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T18:16:19.456925] [INFO ] [REMOTE    ] DELL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:16:20.147707] [INFO ] [REMOTE    ] DELL: Fetching primary data for 2025-01.
[2025-10-24T18:16:20.260181] [INFO ] [REMOTE    ] DECK: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T18:16:20.866020] [INFO ] [REMOTE    ] DEI: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T18:16:20.947600] [INFO ] [REMOTE    ] DEI: Fetching primary data for 2025-03.
[2025-10-24T18:16:21.747675] [INFO ] [REMOTE    ] DEA: Fetching primary data for 2025-10.
[2025-10-24T18:16:22.547632] [INFO ] [REMOTE    ] DECK: Fetching primary data for 2025-05.
[2025-10-24T18:16:22.647233] [INFO ] [REMOTE    ] DEI: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T18:16:22.698129] [INFO ] [REMOTE    ] DELL: Incremental fetch complete for 2025-01 (2.55 seconds).
[2025-10-24T18:16:23.101516] [INFO ] [REMOTE    ] DEA: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T18:16:23.109933] [INFO ] [REMOTE    ] DEA: Full fetch complete (61483 records).
[2025-10-24T18:16:23.110143] [DEBUG] [VALIDATOR ] DEA: Validating primary data.
[2025-10-24T18:16:23.356983] [INFO ] [REMOTE    ] DELL: Fetching primary data for 2025-02.
[2025-10-24T18:16:23.534510] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present.
[2025-10-24T18:16:23.534620] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed.
[2025-10-24T18:16:23.535841] [INFO ] [MAIN      ] DEA: Fetched primary data is valid.
[2025-10-24T18:16:23.535908] [DEBUG] [LOCAL     ] DEA: Saving primary data.
[2025-10-24T18:16:23.536701] [FATAL] [LOCAL     ] DEA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:16:23.536802] [FATAL] [MAIN      ] DEA: Failed to save primary data.
[2025-10-24T18:16:23.536846] [WARN ] [MAIN      ] DEA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:16:23.536883] [INFO ] [LOCAL     ] DEA: Starting deletion of primary data.
[2025-10-24T18:16:23.536946] [DEBUG] [LOCAL     ] DEA: No primary data file found to delete.
[2025-10-24T18:16:23.536983] [INFO ] [LOCAL     ] DEA: Starting deletion of derivative data.
[2025-10-24T18:16:23.537211] [DEBUG] [LOCAL     ] DEA: Deleted derivative data file.
[2025-10-24T18:16:23.537777] [INFO ] [MAIN      ] Update Progress: 606/2366 symbols completed. DEA took 32.2s. Estimated remaining: 3h 41m 44s. Rate: 7.9 symbols/min
[2025-10-24T18:16:23.710972] [INFO ] [MAIN      ] DEO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:16:23.765291] [DEBUG] [LOCAL     ] DEO: Loaded 49560 existing records from primary storage.
[2025-10-24T18:16:23.765688] [INFO ] [MAIN      ] DEO: Loaded 49560 existing records.
[2025-10-24T18:16:23.946294] [WARN ] [MAIN      ] DEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:16:23.946522] [INFO ] [MAIN      ] DEO: Wiping existing primary data before full refresh.
[2025-10-24T18:16:23.946581] [INFO ] [LOCAL     ] DEO: Starting deletion of primary data.
[2025-10-24T18:16:23.947571] [DEBUG] [LOCAL     ] DEO: Deleted primary data file.
[2025-10-24T18:16:23.947632] [INFO ] [MAIN      ] DEO: Starting full primary refresh.
[2025-10-24T18:16:24.162688] [INFO ] [REMOTE    ] DEI: Fetching primary data for 2025-04.
[2025-10-24T18:16:24.328430] [INFO ] [REMOTE    ] DEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:16:24.572828] [INFO ] [REMOTE    ] DECK: Incremental fetch complete for 2025-05 (2.03 seconds).
[2025-10-24T18:16:24.947694] [INFO ] [REMOTE    ] DECK: Fetching primary data for 2025-06.
[2025-10-24T18:16:25.582120] [INFO ] [REMOTE    ] DELL: Incremental fetch complete for 2025-02 (2.23 seconds).
[2025-10-24T18:16:25.748284] [INFO ] [REMOTE    ] DELL: Fetching primary data for 2025-03.
[2025-10-24T18:16:25.754110] [INFO ] [REMOTE    ] DEI: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T18:16:26.547637] [INFO ] [REMOTE    ] DEI: Fetching primary data for 2025-05.
[2025-10-24T18:16:26.916139] [INFO ] [REMOTE    ] DECK: Incremental fetch complete for 2025-06 (1.97 seconds).
[2025-10-24T18:16:27.347725] [INFO ] [REMOTE    ] DEO: Fetching primary data for 2025-01.
[2025-10-24T18:16:27.981697] [INFO ] [REMOTE    ] DELL: Incremental fetch complete for 2025-03 (2.23 seconds).
[2025-10-24T18:16:28.027068] [INFO ] [REMOTE    ] DEI: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T18:16:28.147689] [INFO ] [REMOTE    ] DEI: Fetching primary data for 2025-06.
[2025-10-24T18:16:28.947752] [INFO ] [REMOTE    ] DECK: Fetching primary data for 2025-07.
[2025-10-24T18:16:29.421890] [INFO ] [REMOTE    ] DEO: Incremental fetch complete for 2025-01 (2.07 seconds).
[2025-10-24T18:16:29.639562] [INFO ] [REMOTE    ] DEI: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T18:16:29.747682] [INFO ] [REMOTE    ] DEI: Fetching primary data for 2025-07.
[2025-10-24T18:16:30.547610] [INFO ] [REMOTE    ] DELL: Fetching primary data for 2025-04.
[2025-10-24T18:16:30.769472] [INFO ] [REMOTE    ] DECK: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T18:16:31.297907] [INFO ] [REMOTE    ] DEI: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T18:16:31.347600] [INFO ] [REMOTE    ] DEI: Fetching primary data for 2025-08.
[2025-10-24T18:16:32.147676] [INFO ] [REMOTE    ] DECK: Fetching primary data for 2025-08.
[2025-10-24T18:16:32.702332] [INFO ] [REMOTE    ] DEI: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T18:16:32.830592] [INFO ] [REMOTE    ] DELL: Incremental fetch complete for 2025-04 (2.28 seconds).
[2025-10-24T18:16:32.947686] [INFO ] [REMOTE    ] DELL: Fetching primary data for 2025-05.
[2025-10-24T18:16:33.747680] [INFO ] [REMOTE    ] DEI: Fetching primary data for 2025-09.
[2025-10-24T18:16:33.856168] [INFO ] [REMOTE    ] DECK: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T18:16:34.547637] [INFO ] [REMOTE    ] DECK: Fetching primary data for 2025-09.
[2025-10-24T18:16:35.154427] [INFO ] [REMOTE    ] DEI: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T18:16:35.170268] [INFO ] [REMOTE    ] DELL: Incremental fetch complete for 2025-05 (2.22 seconds).
[2025-10-24T18:16:35.347670] [INFO ] [REMOTE    ] DEI: Fetching primary data for 2025-10.
[2025-10-24T18:16:36.147703] [INFO ] [REMOTE    ] DELL: Fetching primary data for 2025-06.
[2025-10-24T18:16:36.466184] [INFO ] [REMOTE    ] DECK: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T18:16:36.947699] [INFO ] [REMOTE    ] DECK: Fetching primary data for 2025-10.
[2025-10-24T18:16:36.982121] [INFO ] [REMOTE    ] DEI: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T18:16:36.991557] [INFO ] [REMOTE    ] DEI: Full fetch complete (69940 records).
[2025-10-24T18:16:36.991760] [DEBUG] [VALIDATOR ] DEI: Validating primary data.
[2025-10-24T18:16:37.393377] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present.
[2025-10-24T18:16:37.393472] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed.
[2025-10-24T18:16:37.394322] [INFO ] [MAIN      ] DEI: Fetched primary data is valid.
[2025-10-24T18:16:37.394388] [DEBUG] [LOCAL     ] DEI: Saving primary data.
[2025-10-24T18:16:37.395063] [FATAL] [LOCAL     ] DEI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:16:37.395153] [FATAL] [MAIN      ] DEI: Failed to save primary data.
[2025-10-24T18:16:37.395195] [WARN ] [MAIN      ] DEI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:16:37.395231] [INFO ] [LOCAL     ] DEI: Starting deletion of primary data.
[2025-10-24T18:16:37.395309] [DEBUG] [LOCAL     ] DEI: No primary data file found to delete.
[2025-10-24T18:16:37.395364] [INFO ] [LOCAL     ] DEI: Starting deletion of derivative data.
[2025-10-24T18:16:37.395520] [DEBUG] [LOCAL     ] DEI: Deleted derivative data file.
[2025-10-24T18:16:37.395976] [INFO ] [MAIN      ] Update Progress: 607/2366 symbols completed. DEI took 24.3s. Estimated remaining: 3h 41m 54s. Rate: 7.9 symbols/min
[2025-10-24T18:16:37.578559] [INFO ] [MAIN      ] DFH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:16:37.610480] [DEBUG] [LOCAL     ] DFH: Loaded 31800 existing records from primary storage.
[2025-10-24T18:16:37.610827] [INFO ] [MAIN      ] DFH: Loaded 31800 existing records.
[2025-10-24T18:16:37.752753] [INFO ] [REMOTE    ] DEO: Fetching primary data for 2025-02.
[2025-10-24T18:16:37.790019] [WARN ] [MAIN      ] DFH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:16:37.790569] [INFO ] [MAIN      ] DFH: Wiping existing primary data before full refresh.
[2025-10-24T18:16:37.790706] [INFO ] [LOCAL     ] DFH: Starting deletion of primary data.
[2025-10-24T18:16:37.790967] [DEBUG] [LOCAL     ] DFH: Deleted primary data file.
[2025-10-24T18:16:37.791059] [INFO ] [MAIN      ] DFH: Starting full primary refresh.
[2025-10-24T18:16:38.211784] [INFO ] [REMOTE    ] DFH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:16:38.242179] [INFO ] [REMOTE    ] DELL: Incremental fetch complete for 2025-06 (2.09 seconds).
[2025-10-24T18:16:38.547710] [INFO ] [REMOTE    ] DFH: Fetching primary data for 2025-01.
[2025-10-24T18:16:38.908375] [INFO ] [REMOTE    ] DECK: Incremental fetch complete for 2025-10 (1.96 seconds).
[2025-10-24T18:16:38.918572] [INFO ] [REMOTE    ] DECK: Full fetch complete (77204 records).
[2025-10-24T18:16:38.918783] [DEBUG] [VALIDATOR ] DECK: Validating primary data.
[2025-10-24T18:16:39.342440] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present.
[2025-10-24T18:16:39.342580] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed.
[2025-10-24T18:16:39.343594] [INFO ] [MAIN      ] DECK: Fetched primary data is valid.
[2025-10-24T18:16:39.343700] [DEBUG] [LOCAL     ] DECK: Saving primary data.
[2025-10-24T18:16:39.353297] [FATAL] [LOCAL     ] DECK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:16:39.353402] [INFO ] [REMOTE    ] DELL: Fetching primary data for 2025-07.
[2025-10-24T18:16:39.359033] [FATAL] [MAIN      ] DECK: Failed to save primary data.
[2025-10-24T18:16:39.370168] [WARN ] [MAIN      ] DECK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:16:39.370531] [INFO ] [LOCAL     ] DECK: Starting deletion of primary data.
[2025-10-24T18:16:39.370717] [DEBUG] [LOCAL     ] DECK: No primary data file found to delete.
[2025-10-24T18:16:39.370974] [INFO ] [LOCAL     ] DECK: Starting deletion of derivative data.
[2025-10-24T18:16:39.372622] [INFO ] [REMOTE    ] DEO: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T18:16:39.376422] [DEBUG] [LOCAL     ] DECK: Deleted derivative data file.
[2025-10-24T18:16:39.383891] [INFO ] [MAIN      ] Update Progress: 608/2366 symbols completed. DECK took 35.8s. Estimated remaining: 3h 41m 30s. Rate: 7.9 symbols/min
[2025-10-24T18:16:39.571629] [INFO ] [MAIN      ] DFIN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:16:39.597006] [DEBUG] [LOCAL     ] DFIN: Loaded 22540 existing records from primary storage.
[2025-10-24T18:16:39.597388] [INFO ] [MAIN      ] DFIN: Loaded 22540 existing records.
[2025-10-24T18:16:39.795985] [WARN ] [MAIN      ] DFIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:16:39.796618] [INFO ] [MAIN      ] DFIN: Wiping existing primary data before full refresh.
[2025-10-24T18:16:39.806146] [INFO ] [LOCAL     ] DFIN: Starting deletion of primary data.
[2025-10-24T18:16:39.819996] [DEBUG] [LOCAL     ] DFIN: Deleted primary data file.
[2025-10-24T18:16:39.820087] [INFO ] [MAIN      ] DFIN: Starting full primary refresh.
[2025-10-24T18:16:39.821005] [INFO ] [REMOTE    ] DFH: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T18:16:40.152830] [INFO ] [REMOTE    ] DEO: Fetching primary data for 2025-03.
[2025-10-24T18:16:40.209112] [INFO ] [REMOTE    ] DFIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:16:40.947691] [INFO ] [REMOTE    ] DFH: Fetching primary data for 2025-02.
[2025-10-24T18:16:41.398903] [INFO ] [REMOTE    ] DELL: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T18:16:41.747692] [INFO ] [REMOTE    ] DELL: Fetching primary data for 2025-08.
[2025-10-24T18:16:42.002301] [INFO ] [REMOTE    ] DEO: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T18:16:42.182969] [INFO ] [REMOTE    ] DFH: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T18:16:42.547741] [INFO ] [REMOTE    ] DFIN: Fetching primary data for 2025-01.
[2025-10-24T18:16:43.347687] [INFO ] [REMOTE    ] DEO: Fetching primary data for 2025-04.
[2025-10-24T18:16:43.692128] [INFO ] [REMOTE    ] DFIN: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T18:16:44.147681] [INFO ] [REMOTE    ] DFIN: Fetching primary data for 2025-02.
[2025-10-24T18:16:44.316087] [INFO ] [REMOTE    ] DELL: Incremental fetch complete for 2025-08 (2.57 seconds).
[2025-10-24T18:16:44.947674] [INFO ] [REMOTE    ] DFH: Fetching primary data for 2025-03.
[2025-10-24T18:16:45.038036] [INFO ] [REMOTE    ] DEO: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T18:16:45.102538] [INFO ] [REMOTE    ] DFIN: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T18:16:45.747720] [INFO ] [REMOTE    ] DELL: Fetching primary data for 2025-09.
[2025-10-24T18:16:46.227217] [INFO ] [REMOTE    ] DFH: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T18:16:46.547724] [INFO ] [REMOTE    ] DFH: Fetching primary data for 2025-04.
[2025-10-24T18:16:47.347731] [INFO ] [REMOTE    ] DFIN: Fetching primary data for 2025-03.
[2025-10-24T18:16:48.051805] [INFO ] [REMOTE    ] DFH: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T18:16:48.103462] [INFO ] [REMOTE    ] DELL: Incremental fetch complete for 2025-09 (2.36 seconds).
[2025-10-24T18:16:48.147728] [INFO ] [REMOTE    ] DFH: Fetching primary data for 2025-05.
[2025-10-24T18:16:48.372748] [INFO ] [REMOTE    ] DFIN: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T18:16:48.947710] [INFO ] [REMOTE    ] DELL: Fetching primary data for 2025-10.
[2025-10-24T18:16:49.434358] [INFO ] [REMOTE    ] DFH: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T18:16:49.747731] [INFO ] [REMOTE    ] DFH: Fetching primary data for 2025-06.
[2025-10-24T18:16:50.547721] [INFO ] [REMOTE    ] DEO: Fetching primary data for 2025-05.
[2025-10-24T18:16:51.263449] [INFO ] [REMOTE    ] DFH: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T18:16:51.299998] [INFO ] [REMOTE    ] DELL: Incremental fetch complete for 2025-10 (2.35 seconds).
[2025-10-24T18:16:51.309829] [INFO ] [REMOTE    ] DELL: Full fetch complete (77915 records).
[2025-10-24T18:16:51.309961] [DEBUG] [VALIDATOR ] DELL: Validating primary data.
[2025-10-24T18:16:51.352737] [INFO ] [REMOTE    ] DFH: Fetching primary data for 2025-07.
[2025-10-24T18:16:51.701517] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present.
[2025-10-24T18:16:51.701591] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed.
[2025-10-24T18:16:51.702505] [INFO ] [MAIN      ] DELL: Fetched primary data is valid.
[2025-10-24T18:16:51.702568] [DEBUG] [LOCAL     ] DELL: Saving primary data.
[2025-10-24T18:16:51.703170] [FATAL] [LOCAL     ] DELL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:16:51.703312] [FATAL] [MAIN      ] DELL: Failed to save primary data.
[2025-10-24T18:16:51.703387] [WARN ] [MAIN      ] DELL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:16:51.703485] [INFO ] [LOCAL     ] DELL: Starting deletion of primary data.
[2025-10-24T18:16:51.703560] [DEBUG] [LOCAL     ] DELL: No primary data file found to delete.
[2025-10-24T18:16:51.703597] [INFO ] [LOCAL     ] DELL: Starting deletion of derivative data.
[2025-10-24T18:16:51.703635] [DEBUG] [LOCAL     ] DELL: No derivative data file found to delete.
[2025-10-24T18:16:51.703739] [INFO ] [MAIN      ] Update Progress: 609/2366 symbols completed. DELL took 32.9s. Estimated remaining: 3h 41m 37s. Rate: 7.9 symbols/min
[2025-10-24T18:16:51.869504] [INFO ] [MAIN      ] DFP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:16:51.881425] [DEBUG] [LOCAL     ] DFP: Loaded 11089 existing records from primary storage.
[2025-10-24T18:16:51.881680] [INFO ] [MAIN      ] DFP: Loaded 11089 existing records.
[2025-10-24T18:16:52.056253] [WARN ] [MAIN      ] DFP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:16:52.056496] [INFO ] [MAIN      ] DFP: Wiping existing primary data before full refresh.
[2025-10-24T18:16:52.056548] [INFO ] [LOCAL     ] DFP: Starting deletion of primary data.
[2025-10-24T18:16:52.056908] [DEBUG] [LOCAL     ] DFP: Deleted primary data file.
[2025-10-24T18:16:52.056965] [INFO ] [MAIN      ] DFP: Starting full primary refresh.
[2025-10-24T18:16:52.154814] [INFO ] [REMOTE    ] DFIN: Fetching primary data for 2025-04.
[2025-10-24T18:16:52.423374] [INFO ] [REMOTE    ] DFP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:16:52.486146] [INFO ] [REMOTE    ] DEO: Incremental fetch complete for 2025-05 (1.94 seconds).
[2025-10-24T18:16:52.524798] [INFO ] [REMOTE    ] DFH: Incremental fetch complete for 2025-07 (1.17 seconds).
[2025-10-24T18:16:52.947678] [INFO ] [REMOTE    ] DEO: Fetching primary data for 2025-06.
[2025-10-24T18:16:53.171776] [INFO ] [REMOTE    ] DFIN: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T18:16:53.747677] [INFO ] [REMOTE    ] DFH: Fetching primary data for 2025-08.
[2025-10-24T18:16:54.473610] [INFO ] [REMOTE    ] DEO: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T18:16:54.547625] [INFO ] [REMOTE    ] DEO: Fetching primary data for 2025-07.
[2025-10-24T18:16:54.946964] [INFO ] [REMOTE    ] DFH: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T18:16:55.347664] [INFO ] [REMOTE    ] DFH: Fetching primary data for 2025-09.
[2025-10-24T18:16:56.147618] [INFO ] [REMOTE    ] DFIN: Fetching primary data for 2025-05.
[2025-10-24T18:16:56.229274] [INFO ] [REMOTE    ] DEO: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T18:16:56.557095] [INFO ] [REMOTE    ] DFH: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T18:16:56.903597] [INFO ] [REMOTE    ] DFIN: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T18:16:56.947612] [INFO ] [REMOTE    ] DFP: Fetching primary data for 2025-01.
[2025-10-24T18:16:57.738294] [INFO ] [REMOTE    ] DFP: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T18:16:57.747604] [INFO ] [REMOTE    ] DFIN: Fetching primary data for 2025-06.
[2025-10-24T18:16:58.547689] [INFO ] [REMOTE    ] DFH: Fetching primary data for 2025-10.
[2025-10-24T18:16:58.741219] [INFO ] [REMOTE    ] DFIN: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T18:16:59.347743] [INFO ] [REMOTE    ] DFP: Fetching primary data for 2025-02.
[2025-10-24T18:16:59.755629] [INFO ] [REMOTE    ] DFH: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T18:16:59.761316] [INFO ] [REMOTE    ] DFH: Full fetch complete (47234 records).
[2025-10-24T18:16:59.761424] [DEBUG] [VALIDATOR ] DFH: Validating primary data.
[2025-10-24T18:17:00.140845] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present.
[2025-10-24T18:17:00.140948] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed.
[2025-10-24T18:17:00.141591] [INFO ] [MAIN      ] DFH: Fetched primary data is valid.
[2025-10-24T18:17:00.141633] [DEBUG] [LOCAL     ] DFH: Saving primary data.
[2025-10-24T18:17:00.142077] [FATAL] [LOCAL     ] DFH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:17:00.142165] [FATAL] [MAIN      ] DFH: Failed to save primary data.
[2025-10-24T18:17:00.142206] [WARN ] [MAIN      ] DFH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:17:00.142241] [INFO ] [LOCAL     ] DFH: Starting deletion of primary data.
[2025-10-24T18:17:00.142291] [DEBUG] [LOCAL     ] DFH: No primary data file found to delete.
[2025-10-24T18:17:00.142326] [INFO ] [LOCAL     ] DFH: Starting deletion of derivative data.
[2025-10-24T18:17:00.142469] [DEBUG] [LOCAL     ] DFH: Deleted derivative data file.
[2025-10-24T18:17:00.143194] [INFO ] [MAIN      ] Update Progress: 610/2366 symbols completed. DFH took 22.7s. Estimated remaining: 3h 41m 32s. Rate: 7.9 symbols/min
[2025-10-24T18:17:00.154495] [INFO ] [REMOTE    ] DFIN: Fetching primary data for 2025-07.
[2025-10-24T18:17:00.234917] [INFO ] [REMOTE    ] DFP: Incremental fetch complete for 2025-02 (0.89 seconds).
[2025-10-24T18:17:00.326187] [INFO ] [MAIN      ] DG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:17:00.379893] [DEBUG] [LOCAL     ] DG: Loaded 53630 existing records from primary storage.
[2025-10-24T18:17:00.380183] [INFO ] [MAIN      ] DG: Loaded 53630 existing records.
[2025-10-24T18:17:00.555967] [WARN ] [MAIN      ] DG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:17:00.556176] [INFO ] [MAIN      ] DG: Wiping existing primary data before full refresh.
[2025-10-24T18:17:00.556222] [INFO ] [LOCAL     ] DG: Starting deletion of primary data.
[2025-10-24T18:17:00.557431] [DEBUG] [LOCAL     ] DG: Deleted primary data file.
[2025-10-24T18:17:00.557489] [INFO ] [MAIN      ] DG: Starting full primary refresh.
[2025-10-24T18:17:00.916526] [INFO ] [REMOTE    ] DG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:17:00.947605] [INFO ] [REMOTE    ] DG: Fetching primary data for 2025-01.
[2025-10-24T18:17:01.747610] [INFO ] [REMOTE    ] DFP: Fetching primary data for 2025-03.
[2025-10-24T18:17:02.046874] [INFO ] [REMOTE    ] DFIN: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T18:17:02.547701] [INFO ] [REMOTE    ] DFIN: Fetching primary data for 2025-08.
[2025-10-24T18:17:03.006724] [INFO ] [REMOTE    ] DFP: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T18:17:03.347623] [INFO ] [REMOTE    ] DEO: Fetching primary data for 2025-08.
[2025-10-24T18:17:03.454619] [INFO ] [REMOTE    ] DFIN: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T18:17:04.147627] [INFO ] [REMOTE    ] DFP: Fetching primary data for 2025-04.
[2025-10-24T18:17:04.334838] [INFO ] [REMOTE    ] DG: Incremental fetch complete for 2025-01 (3.39 seconds).
[2025-10-24T18:17:04.947612] [INFO ] [REMOTE    ] DFIN: Fetching primary data for 2025-09.
[2025-10-24T18:17:04.980424] [INFO ] [REMOTE    ] DFP: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T18:17:05.118167] [INFO ] [REMOTE    ] DEO: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T18:17:05.747606] [INFO ] [REMOTE    ] DEO: Fetching primary data for 2025-09.
[2025-10-24T18:17:06.078597] [INFO ] [REMOTE    ] DFIN: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T18:17:06.547681] [INFO ] [REMOTE    ] DFP: Fetching primary data for 2025-05.
[2025-10-24T18:17:07.347631] [INFO ] [REMOTE    ] DG: Fetching primary data for 2025-02.
[2025-10-24T18:17:07.420342] [INFO ] [REMOTE    ] DFP: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T18:17:07.689345] [INFO ] [REMOTE    ] DEO: Incremental fetch complete for 2025-09 (1.94 seconds).
[2025-10-24T18:17:08.147677] [INFO ] [REMOTE    ] DEO: Fetching primary data for 2025-10.
[2025-10-24T18:17:08.947675] [INFO ] [REMOTE    ] DFIN: Fetching primary data for 2025-10.
[2025-10-24T18:17:09.022566] [INFO ] [REMOTE    ] DG: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T18:17:09.747616] [INFO ] [REMOTE    ] DFP: Fetching primary data for 2025-06.
[2025-10-24T18:17:09.811702] [INFO ] [REMOTE    ] DEO: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T18:17:09.820740] [INFO ] [REMOTE    ] DEO: Full fetch complete (71347 records).
[2025-10-24T18:17:09.820870] [DEBUG] [VALIDATOR ] DEO: Validating primary data.
[2025-10-24T18:17:09.822131] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:17:09.822216] [FATAL] [MAIN      ] DEO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:17:09.822259] [WARN ] [MAIN      ] DEO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:17:09.822299] [INFO ] [LOCAL     ] DEO: Starting deletion of primary data.
[2025-10-24T18:17:09.822374] [DEBUG] [LOCAL     ] DEO: No primary data file found to delete.
[2025-10-24T18:17:09.822429] [INFO ] [LOCAL     ] DEO: Starting deletion of derivative data.
[2025-10-24T18:17:09.822787] [DEBUG] [LOCAL     ] DEO: Deleted derivative data file.
[2025-10-24T18:17:09.823188] [INFO ] [MAIN      ] Update Progress: 611/2366 symbols completed. DEO took 46.3s. Estimated remaining: 3h 41m 30s. Rate: 7.9 symbols/min
[2025-10-24T18:17:09.993411] [INFO ] [MAIN      ] DGX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:17:10.038096] [DEBUG] [LOCAL     ] DGX: Loaded 44964 existing records from primary storage.
[2025-10-24T18:17:10.038379] [INFO ] [MAIN      ] DGX: Loaded 44964 existing records.
[2025-10-24T18:17:10.228935] [WARN ] [MAIN      ] DGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:17:10.230103] [INFO ] [REMOTE    ] DFIN: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T18:17:10.230184] [INFO ] [MAIN      ] DGX: Wiping existing primary data before full refresh.
[2025-10-24T18:17:10.234242] [INFO ] [LOCAL     ] DGX: Starting deletion of primary data.
[2025-10-24T18:17:10.234571] [INFO ] [REMOTE    ] DFIN: Full fetch complete (33413 records).
[2025-10-24T18:17:10.234660] [DEBUG] [VALIDATOR ] DFIN: Validating primary data.
[2025-10-24T18:17:10.240442] [DEBUG] [LOCAL     ] DGX: Deleted primary data file.
[2025-10-24T18:17:10.281095] [INFO ] [MAIN      ] DGX: Starting full primary refresh.
[2025-10-24T18:17:10.549471] [INFO ] [REMOTE    ] DG: Fetching primary data for 2025-03.
[2025-10-24T18:17:10.795898] [INFO ] [REMOTE    ] DFP: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T18:17:10.926050] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present.
[2025-10-24T18:17:10.931862] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed.
[2025-10-24T18:17:10.932462] [INFO ] [MAIN      ] DFIN: Fetched primary data is valid.
[2025-10-24T18:17:10.937715] [DEBUG] [LOCAL     ] DFIN: Saving primary data.
[2025-10-24T18:17:10.948425] [FATAL] [LOCAL     ] DFIN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:17:10.971775] [FATAL] [MAIN      ] DFIN: Failed to save primary data.
[2025-10-24T18:17:10.987922] [WARN ] [MAIN      ] DFIN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:17:11.009293] [INFO ] [REMOTE    ] DGX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:17:11.009456] [INFO ] [LOCAL     ] DFIN: Starting deletion of primary data.
[2025-10-24T18:17:11.009866] [DEBUG] [LOCAL     ] DFIN: No primary data file found to delete.
[2025-10-24T18:17:11.009919] [INFO ] [LOCAL     ] DFIN: Starting deletion of derivative data.
[2025-10-24T18:17:11.010080] [DEBUG] [LOCAL     ] DFIN: Deleted derivative data file.
[2025-10-24T18:17:11.010192] [INFO ] [MAIN      ] Update Progress: 612/2366 symbols completed. DFIN took 31.6s. Estimated remaining: 3h 41m 4s. Rate: 7.9 symbols/min
[2025-10-24T18:17:11.174112] [INFO ] [MAIN      ] DHF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:17:11.194353] [DEBUG] [LOCAL     ] DHF: Loaded 20928 existing records from primary storage.
[2025-10-24T18:17:11.194590] [INFO ] [MAIN      ] DHF: Loaded 20928 existing records.
[2025-10-24T18:17:11.348113] [INFO ] [REMOTE    ] DFP: Fetching primary data for 2025-07.
[2025-10-24T18:17:11.370844] [WARN ] [MAIN      ] DHF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:17:11.371153] [INFO ] [MAIN      ] DHF: Wiping existing primary data before full refresh.
[2025-10-24T18:17:11.371219] [INFO ] [LOCAL     ] DHF: Starting deletion of primary data.
[2025-10-24T18:17:11.371639] [DEBUG] [LOCAL     ] DHF: Deleted primary data file.
[2025-10-24T18:17:11.371735] [INFO ] [MAIN      ] DHF: Starting full primary refresh.
[2025-10-24T18:17:11.723439] [INFO ] [REMOTE    ] DHF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:17:12.143421] [INFO ] [REMOTE    ] DFP: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T18:17:12.147595] [INFO ] [REMOTE    ] DFP: Fetching primary data for 2025-08.
[2025-10-24T18:17:12.302398] [INFO ] [REMOTE    ] DG: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T18:17:12.947616] [INFO ] [REMOTE    ] DGX: Fetching primary data for 2025-01.
[2025-10-24T18:17:12.966397] [INFO ] [REMOTE    ] DFP: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T18:17:13.747723] [INFO ] [REMOTE    ] DHF: Fetching primary data for 2025-01.
[2025-10-24T18:17:14.547705] [INFO ] [REMOTE    ] DFP: Fetching primary data for 2025-09.
[2025-10-24T18:17:14.586088] [INFO ] [REMOTE    ] DGX: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T18:17:14.933205] [INFO ] [REMOTE    ] DHF: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T18:17:15.099119] [INFO ] [REMOTE    ] DFP: Incremental fetch complete for 2025-09 (0.55 seconds).
[2025-10-24T18:17:15.347672] [INFO ] [REMOTE    ] DHF: Fetching primary data for 2025-02.
[2025-10-24T18:17:16.147616] [INFO ] [REMOTE    ] DGX: Fetching primary data for 2025-02.
[2025-10-24T18:17:16.453368] [INFO ] [REMOTE    ] DHF: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T18:17:16.947633] [INFO ] [REMOTE    ] DFP: Fetching primary data for 2025-10.
[2025-10-24T18:17:17.734060] [INFO ] [REMOTE    ] DFP: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T18:17:17.736081] [INFO ] [REMOTE    ] DFP: Full fetch complete (15793 records).
[2025-10-24T18:17:17.736169] [DEBUG] [VALIDATOR ] DFP: Validating primary data.
[2025-10-24T18:17:17.757988] [INFO ] [REMOTE    ] DG: Fetching primary data for 2025-04.
[2025-10-24T18:17:18.054274] [INFO ] [REMOTE    ] DGX: Incremental fetch complete for 2025-02 (1.91 seconds).
[2025-10-24T18:17:18.153701] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present.
[2025-10-24T18:17:18.153796] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed.
[2025-10-24T18:17:18.154179] [INFO ] [MAIN      ] DFP: Fetched primary data is valid.
[2025-10-24T18:17:18.154219] [DEBUG] [LOCAL     ] DFP: Saving primary data.
[2025-10-24T18:17:18.154505] [FATAL] [LOCAL     ] DFP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:17:18.154588] [FATAL] [MAIN      ] DFP: Failed to save primary data.
[2025-10-24T18:17:18.154630] [WARN ] [MAIN      ] DFP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:17:18.154705] [INFO ] [LOCAL     ] DFP: Starting deletion of primary data.
[2025-10-24T18:17:18.154763] [DEBUG] [LOCAL     ] DFP: No primary data file found to delete.
[2025-10-24T18:17:18.154799] [INFO ] [LOCAL     ] DFP: Starting deletion of derivative data.
[2025-10-24T18:17:18.154927] [DEBUG] [LOCAL     ] DFP: Deleted derivative data file.
[2025-10-24T18:17:18.154999] [INFO ] [MAIN      ] Update Progress: 613/2366 symbols completed. DFP took 26.5s. Estimated remaining: 3h 40m 55s. Rate: 7.9 symbols/min
[2025-10-24T18:17:18.319225] [INFO ] [MAIN      ] DHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:17:18.370104] [DEBUG] [LOCAL     ] DHI: Loaded 53747 existing records from primary storage.
[2025-10-24T18:17:18.370417] [INFO ] [MAIN      ] DHI: Loaded 53747 existing records.
[2025-10-24T18:17:18.546712] [WARN ] [MAIN      ] DHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:17:18.546959] [INFO ] [MAIN      ] DHI: Wiping existing primary data before full refresh.
[2025-10-24T18:17:18.547013] [INFO ] [LOCAL     ] DHI: Starting deletion of primary data.
[2025-10-24T18:17:18.547920] [DEBUG] [LOCAL     ] DHI: Deleted primary data file.
[2025-10-24T18:17:18.547728] [INFO ] [REMOTE    ] DGX: Fetching primary data for 2025-03.
[2025-10-24T18:17:18.548106] [INFO ] [MAIN      ] DHI: Starting full primary refresh.
[2025-10-24T18:17:18.922684] [INFO ] [REMOTE    ] DHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:17:19.347719] [INFO ] [REMOTE    ] DHI: Fetching primary data for 2025-01.
[2025-10-24T18:17:19.784897] [INFO ] [REMOTE    ] DG: Incremental fetch complete for 2025-04 (2.03 seconds).
[2025-10-24T18:17:20.147695] [INFO ] [REMOTE    ] DG: Fetching primary data for 2025-05.
[2025-10-24T18:17:20.203077] [INFO ] [REMOTE    ] DGX: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T18:17:20.947696] [INFO ] [REMOTE    ] DGX: Fetching primary data for 2025-04.
[2025-10-24T18:17:21.373180] [INFO ] [REMOTE    ] DHI: Incremental fetch complete for 2025-01 (2.03 seconds).
[2025-10-24T18:17:21.747669] [INFO ] [REMOTE    ] DHF: Fetching primary data for 2025-03.
[2025-10-24T18:17:21.966238] [INFO ] [REMOTE    ] DG: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T18:17:22.399563] [INFO ] [REMOTE    ] DGX: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T18:17:22.547671] [INFO ] [REMOTE    ] DGX: Fetching primary data for 2025-05.
[2025-10-24T18:17:22.722932] [INFO ] [REMOTE    ] DHF: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T18:17:23.347667] [INFO ] [REMOTE    ] DHI: Fetching primary data for 2025-02.
[2025-10-24T18:17:23.943326] [INFO ] [REMOTE    ] DGX: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T18:17:24.147667] [INFO ] [REMOTE    ] DGX: Fetching primary data for 2025-06.
[2025-10-24T18:17:24.751154] [INFO ] [REMOTE    ] DHI: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T18:17:24.947612] [INFO ] [REMOTE    ] DHI: Fetching primary data for 2025-03.
[2025-10-24T18:17:25.747620] [INFO ] [REMOTE    ] DG: Fetching primary data for 2025-06.
[2025-10-24T18:17:25.846223] [INFO ] [REMOTE    ] DGX: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T18:17:26.547706] [INFO ] [REMOTE    ] DHF: Fetching primary data for 2025-04.
[2025-10-24T18:17:26.718498] [INFO ] [REMOTE    ] DHI: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T18:17:27.252509] [INFO ] [REMOTE    ] DG: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T18:17:27.347597] [INFO ] [REMOTE    ] DG: Fetching primary data for 2025-07.
[2025-10-24T18:17:27.437385] [INFO ] [REMOTE    ] DHF: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T18:17:28.147634] [INFO ] [REMOTE    ] DGX: Fetching primary data for 2025-07.
[2025-10-24T18:17:28.947636] [INFO ] [REMOTE    ] DHI: Fetching primary data for 2025-04.
[2025-10-24T18:17:29.284891] [INFO ] [REMOTE    ] DG: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T18:17:29.347674] [INFO ] [REMOTE    ] DGX: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T18:17:29.747718] [INFO ] [REMOTE    ] DHF: Fetching primary data for 2025-05.
[2025-10-24T18:17:30.547727] [INFO ] [REMOTE    ] DGX: Fetching primary data for 2025-08.
[2025-10-24T18:17:30.698898] [INFO ] [REMOTE    ] DHF: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T18:17:30.733186] [INFO ] [REMOTE    ] DHI: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T18:17:31.347670] [INFO ] [REMOTE    ] DHF: Fetching primary data for 2025-06.
[2025-10-24T18:17:31.916554] [INFO ] [REMOTE    ] DGX: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T18:17:32.147677] [INFO ] [REMOTE    ] DGX: Fetching primary data for 2025-09.
[2025-10-24T18:17:32.343018] [INFO ] [REMOTE    ] DHF: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T18:17:32.947708] [INFO ] [REMOTE    ] DHI: Fetching primary data for 2025-05.
[2025-10-24T18:17:33.363405] [INFO ] [REMOTE    ] DGX: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T18:17:33.747721] [INFO ] [REMOTE    ] DG: Fetching primary data for 2025-08.
[2025-10-24T18:17:34.547711] [INFO ] [REMOTE    ] DGX: Fetching primary data for 2025-10.
[2025-10-24T18:17:34.811686] [INFO ] [REMOTE    ] DHI: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T18:17:35.347607] [INFO ] [REMOTE    ] DHI: Fetching primary data for 2025-06.
[2025-10-24T18:17:35.477216] [INFO ] [REMOTE    ] DG: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T18:17:36.147729] [INFO ] [REMOTE    ] DG: Fetching primary data for 2025-09.
[2025-10-24T18:17:36.237122] [INFO ] [REMOTE    ] DGX: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T18:17:36.245599] [INFO ] [REMOTE    ] DGX: Full fetch complete (65702 records).
[2025-10-24T18:17:36.245787] [DEBUG] [VALIDATOR ] DGX: Validating primary data.
[2025-10-24T18:17:36.637816] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present.
[2025-10-24T18:17:36.637905] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed.
[2025-10-24T18:17:36.638780] [INFO ] [MAIN      ] DGX: Fetched primary data is valid.
[2025-10-24T18:17:36.638844] [DEBUG] [LOCAL     ] DGX: Saving primary data.
[2025-10-24T18:17:36.639425] [FATAL] [LOCAL     ] DGX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:17:36.639534] [FATAL] [MAIN      ] DGX: Failed to save primary data.
[2025-10-24T18:17:36.639581] [WARN ] [MAIN      ] DGX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:17:36.639720] [INFO ] [LOCAL     ] DGX: Starting deletion of primary data.
[2025-10-24T18:17:36.639805] [DEBUG] [LOCAL     ] DGX: No primary data file found to delete.
[2025-10-24T18:17:36.639857] [INFO ] [LOCAL     ] DGX: Starting deletion of derivative data.
[2025-10-24T18:17:36.640014] [DEBUG] [LOCAL     ] DGX: Deleted derivative data file.
[2025-10-24T18:17:36.640378] [INFO ] [MAIN      ] Update Progress: 614/2366 symbols completed. DGX took 26.8s. Estimated remaining: 3h 41m 19s. Rate: 7.9 symbols/min
[2025-10-24T18:17:36.819275] [INFO ] [MAIN      ] DHR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:17:36.874326] [DEBUG] [LOCAL     ] DHR: Loaded 53765 existing records from primary storage.
[2025-10-24T18:17:36.874680] [INFO ] [MAIN      ] DHR: Loaded 53765 existing records.
[2025-10-24T18:17:36.951154] [INFO ] [REMOTE    ] DHF: Fetching primary data for 2025-07.
[2025-10-24T18:17:37.058498] [WARN ] [MAIN      ] DHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:17:37.058820] [INFO ] [MAIN      ] DHR: Wiping existing primary data before full refresh.
[2025-10-24T18:17:37.059027] [INFO ] [LOCAL     ] DHR: Starting deletion of primary data.
[2025-10-24T18:17:37.068959] [DEBUG] [LOCAL     ] DHR: Deleted primary data file.
[2025-10-24T18:17:37.082520] [INFO ] [MAIN      ] DHR: Starting full primary refresh.
[2025-10-24T18:17:37.165404] [INFO ] [REMOTE    ] DHI: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T18:17:37.454185] [INFO ] [REMOTE    ] DHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:17:37.646668] [INFO ] [REMOTE    ] DG: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T18:17:37.747706] [INFO ] [REMOTE    ] DHR: Fetching primary data for 2025-01.
[2025-10-24T18:17:38.245979] [INFO ] [REMOTE    ] DHF: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T18:17:38.547695] [INFO ] [REMOTE    ] DHI: Fetching primary data for 2025-07.
[2025-10-24T18:17:39.347621] [INFO ] [REMOTE    ] DG: Fetching primary data for 2025-10.
[2025-10-24T18:17:39.618583] [INFO ] [REMOTE    ] DHR: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T18:17:40.147724] [INFO ] [REMOTE    ] DHR: Fetching primary data for 2025-02.
[2025-10-24T18:17:40.437068] [INFO ] [REMOTE    ] DHI: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T18:17:40.947702] [INFO ] [REMOTE    ] DHI: Fetching primary data for 2025-08.
[2025-10-24T18:17:41.010911] [INFO ] [REMOTE    ] DG: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T18:17:41.019939] [INFO ] [REMOTE    ] DG: Full fetch complete (76931 records).
[2025-10-24T18:17:41.020075] [DEBUG] [VALIDATOR ] DG: Validating primary data.
[2025-10-24T18:17:41.020868] [FATAL] [VALIDATOR ] DG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:17:41.020981] [FATAL] [MAIN      ] DG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:17:41.021065] [WARN ] [MAIN      ] DG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:17:41.021144] [INFO ] [LOCAL     ] DG: Starting deletion of primary data.
[2025-10-24T18:17:41.021209] [DEBUG] [LOCAL     ] DG: No primary data file found to delete.
[2025-10-24T18:17:41.021247] [INFO ] [LOCAL     ] DG: Starting deletion of derivative data.
[2025-10-24T18:17:41.021385] [DEBUG] [LOCAL     ] DG: Deleted derivative data file.
[2025-10-24T18:17:41.022123] [INFO ] [MAIN      ] Update Progress: 615/2366 symbols completed. DG took 40.9s. Estimated remaining: 3h 41m 2s. Rate: 7.9 symbols/min
[2025-10-24T18:17:41.188075] [INFO ] [MAIN      ] DHT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:17:41.232091] [DEBUG] [LOCAL     ] DHT: Loaded 48212 existing records from primary storage.
[2025-10-24T18:17:41.232421] [INFO ] [MAIN      ] DHT: Loaded 48212 existing records.
[2025-10-24T18:17:41.414853] [WARN ] [MAIN      ] DHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:17:41.415118] [INFO ] [MAIN      ] DHT: Wiping existing primary data before full refresh.
[2025-10-24T18:17:41.415233] [INFO ] [LOCAL     ] DHT: Starting deletion of primary data.
[2025-10-24T18:17:41.415755] [DEBUG] [LOCAL     ] DHT: Deleted primary data file.
[2025-10-24T18:17:41.415813] [INFO ] [MAIN      ] DHT: Starting full primary refresh.
[2025-10-24T18:17:41.752195] [INFO ] [REMOTE    ] DHF: Fetching primary data for 2025-08.
[2025-10-24T18:17:41.775342] [INFO ] [REMOTE    ] DHT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:17:41.806728] [INFO ] [REMOTE    ] DHR: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T18:17:42.547616] [INFO ] [REMOTE    ] DHR: Fetching primary data for 2025-03.
[2025-10-24T18:17:42.864750] [INFO ] [REMOTE    ] DHF: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T18:17:43.109438] [INFO ] [REMOTE    ] DHI: Incremental fetch complete for 2025-08 (2.16 seconds).
[2025-10-24T18:17:43.347718] [INFO ] [REMOTE    ] DHT: Fetching primary data for 2025-01.
[2025-10-24T18:17:44.147726] [INFO ] [REMOTE    ] DHF: Fetching primary data for 2025-09.
[2025-10-24T18:17:44.250589] [INFO ] [REMOTE    ] DHR: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T18:17:44.861875] [INFO ] [REMOTE    ] DHF: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T18:17:44.947745] [INFO ] [REMOTE    ] DHF: Fetching primary data for 2025-10.
[2025-10-24T18:17:45.076676] [INFO ] [REMOTE    ] DHT: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T18:17:45.747711] [INFO ] [REMOTE    ] DHR: Fetching primary data for 2025-04.
[2025-10-24T18:17:46.379427] [INFO ] [REMOTE    ] DHF: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T18:17:46.383183] [INFO ] [REMOTE    ] DHF: Full fetch complete (29917 records).
[2025-10-24T18:17:46.383314] [DEBUG] [VALIDATOR ] DHF: Validating primary data.
[2025-10-24T18:17:46.554721] [INFO ] [REMOTE    ] DHI: Fetching primary data for 2025-09.
[2025-10-24T18:17:46.771967] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present.
[2025-10-24T18:17:46.772058] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed.
[2025-10-24T18:17:46.772582] [INFO ] [MAIN      ] DHF: Fetched primary data is valid.
[2025-10-24T18:17:46.772625] [DEBUG] [LOCAL     ] DHF: Saving primary data.
[2025-10-24T18:17:46.773065] [FATAL] [LOCAL     ] DHF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:17:46.773153] [FATAL] [MAIN      ] DHF: Failed to save primary data.
[2025-10-24T18:17:46.773194] [WARN ] [MAIN      ] DHF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:17:46.773229] [INFO ] [LOCAL     ] DHF: Starting deletion of primary data.
[2025-10-24T18:17:46.773278] [DEBUG] [LOCAL     ] DHF: No primary data file found to delete.
[2025-10-24T18:17:46.773312] [INFO ] [LOCAL     ] DHF: Starting deletion of derivative data.
[2025-10-24T18:17:46.773451] [DEBUG] [LOCAL     ] DHF: Deleted derivative data file.
[2025-10-24T18:17:46.773547] [INFO ] [MAIN      ] Update Progress: 616/2366 symbols completed. DHF took 35.8s. Estimated remaining: 3h 40m 50s. Rate: 7.9 symbols/min
[2025-10-24T18:17:46.945296] [INFO ] [MAIN      ] DHX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:17:46.961337] [DEBUG] [LOCAL     ] DHX: Loaded 13333 existing records from primary storage.
[2025-10-24T18:17:46.961573] [INFO ] [MAIN      ] DHX: Loaded 13333 existing records.
[2025-10-24T18:17:47.140980] [WARN ] [MAIN      ] DHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:17:47.141190] [INFO ] [MAIN      ] DHX: Wiping existing primary data before full refresh.
[2025-10-24T18:17:47.141285] [INFO ] [LOCAL     ] DHX: Starting deletion of primary data.
[2025-10-24T18:17:47.141494] [DEBUG] [LOCAL     ] DHX: Deleted primary data file.
[2025-10-24T18:17:47.141547] [INFO ] [MAIN      ] DHX: Starting full primary refresh.
[2025-10-24T18:17:47.358588] [INFO ] [REMOTE    ] DHT: Fetching primary data for 2025-02.
[2025-10-24T18:17:47.526524] [INFO ] [REMOTE    ] DHX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:17:47.625709] [INFO ] [REMOTE    ] DHR: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T18:17:48.147749] [INFO ] [REMOTE    ] DHX: Fetching primary data for 2025-01.
[2025-10-24T18:17:48.607237] [INFO ] [REMOTE    ] DHI: Incremental fetch complete for 2025-09 (2.05 seconds).
[2025-10-24T18:17:48.647200] [INFO ] [REMOTE    ] DHT: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T18:17:48.947711] [INFO ] [REMOTE    ] DHI: Fetching primary data for 2025-10.
[2025-10-24T18:17:49.137974] [INFO ] [REMOTE    ] DHX: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T18:17:49.747738] [INFO ] [REMOTE    ] DHX: Fetching primary data for 2025-02.
[2025-10-24T18:17:50.547617] [INFO ] [REMOTE    ] DHR: Fetching primary data for 2025-05.
[2025-10-24T18:17:50.709789] [INFO ] [REMOTE    ] DHX: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T18:17:50.861296] [INFO ] [REMOTE    ] DHI: Incremental fetch complete for 2025-10 (1.91 seconds).
[2025-10-24T18:17:50.871458] [INFO ] [REMOTE    ] DHI: Full fetch complete (77404 records).
[2025-10-24T18:17:50.871621] [DEBUG] [VALIDATOR ] DHI: Validating primary data.
[2025-10-24T18:17:51.270472] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present.
[2025-10-24T18:17:51.270561] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed.
[2025-10-24T18:17:51.271594] [INFO ] [MAIN      ] DHI: Fetched primary data is valid.
[2025-10-24T18:17:51.271686] [DEBUG] [LOCAL     ] DHI: Saving primary data.
[2025-10-24T18:17:51.272362] [FATAL] [LOCAL     ] DHI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:17:51.272491] [FATAL] [MAIN      ] DHI: Failed to save primary data.
[2025-10-24T18:17:51.272564] [WARN ] [MAIN      ] DHI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:17:51.272679] [INFO ] [LOCAL     ] DHI: Starting deletion of primary data.
[2025-10-24T18:17:51.272769] [DEBUG] [LOCAL     ] DHI: No primary data file found to delete.
[2025-10-24T18:17:51.272816] [INFO ] [LOCAL     ] DHI: Starting deletion of derivative data.
[2025-10-24T18:17:51.272962] [DEBUG] [LOCAL     ] DHI: Deleted derivative data file.
[2025-10-24T18:17:51.273431] [INFO ] [MAIN      ] Update Progress: 617/2366 symbols completed. DHI took 33.1s. Estimated remaining: 3h 40m 33s. Rate: 7.9 symbols/min
[2025-10-24T18:17:51.352873] [INFO ] [REMOTE    ] DHX: Fetching primary data for 2025-03.
[2025-10-24T18:17:51.452291] [INFO ] [MAIN      ] DIAX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:17:51.469182] [DEBUG] [LOCAL     ] DIAX: Loaded 12784 existing records from primary storage.
[2025-10-24T18:17:51.469420] [INFO ] [MAIN      ] DIAX: Loaded 12784 existing records.
[2025-10-24T18:17:51.651087] [WARN ] [MAIN      ] DIAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:17:51.651338] [INFO ] [MAIN      ] DIAX: Wiping existing primary data before full refresh.
[2025-10-24T18:17:51.651404] [INFO ] [LOCAL     ] DIAX: Starting deletion of primary data.
[2025-10-24T18:17:51.651608] [DEBUG] [LOCAL     ] DIAX: Deleted primary data file.
[2025-10-24T18:17:51.651701] [INFO ] [MAIN      ] DIAX: Starting full primary refresh.
[2025-10-24T18:17:52.008991] [INFO ] [REMOTE    ] DIAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:17:52.148465] [INFO ] [REMOTE    ] DIAX: Fetching primary data for 2025-01.
[2025-10-24T18:17:52.150114] [INFO ] [REMOTE    ] DHX: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T18:17:52.386153] [INFO ] [REMOTE    ] DHR: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T18:17:52.761134] [INFO ] [REMOTE    ] DIAX: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T18:17:52.947625] [INFO ] [REMOTE    ] DHT: Fetching primary data for 2025-03.
[2025-10-24T18:17:53.747685] [INFO ] [REMOTE    ] DHX: Fetching primary data for 2025-04.
[2025-10-24T18:17:54.393675] [INFO ] [REMOTE    ] DHX: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T18:17:54.473431] [INFO ] [REMOTE    ] DHT: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T18:17:54.547610] [INFO ] [REMOTE    ] DHT: Fetching primary data for 2025-04.
[2025-10-24T18:17:55.347671] [INFO ] [REMOTE    ] DHR: Fetching primary data for 2025-06.
[2025-10-24T18:17:56.147712] [INFO ] [REMOTE    ] DIAX: Fetching primary data for 2025-02.
[2025-10-24T18:17:56.251500] [INFO ] [REMOTE    ] DHT: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T18:17:56.602416] [INFO ] [REMOTE    ] DIAX: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T18:17:56.665515] [INFO ] [REMOTE    ] DHR: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T18:17:56.947701] [INFO ] [REMOTE    ] DIAX: Fetching primary data for 2025-03.
[2025-10-24T18:17:57.738725] [INFO ] [REMOTE    ] DIAX: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T18:17:57.747601] [INFO ] [REMOTE    ] DIAX: Fetching primary data for 2025-04.
[2025-10-24T18:17:58.547708] [INFO ] [REMOTE    ] DHR: Fetching primary data for 2025-07.
[2025-10-24T18:17:58.622123] [INFO ] [REMOTE    ] DIAX: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T18:17:59.347706] [INFO ] [REMOTE    ] DHX: Fetching primary data for 2025-05.
[2025-10-24T18:18:00.147629] [INFO ] [REMOTE    ] DHT: Fetching primary data for 2025-05.
[2025-10-24T18:18:00.442074] [INFO ] [REMOTE    ] DHR: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T18:18:00.442839] [INFO ] [REMOTE    ] DHX: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T18:18:00.947679] [INFO ] [REMOTE    ] DHX: Fetching primary data for 2025-06.
[2025-10-24T18:18:01.747696] [INFO ] [REMOTE    ] DHR: Fetching primary data for 2025-08.
[2025-10-24T18:18:02.419721] [INFO ] [REMOTE    ] DHT: Incremental fetch complete for 2025-05 (2.27 seconds).
[2025-10-24T18:18:02.547707] [INFO ] [REMOTE    ] DIAX: Fetching primary data for 2025-05.
[2025-10-24T18:18:03.344900] [INFO ] [REMOTE    ] DHX: Incremental fetch complete for 2025-06 (2.40 seconds).
[2025-10-24T18:18:03.347621] [INFO ] [REMOTE    ] DHT: Fetching primary data for 2025-06.
[2025-10-24T18:18:04.147620] [INFO ] [REMOTE    ] DHX: Fetching primary data for 2025-07.
[2025-10-24T18:18:04.174621] [INFO ] [REMOTE    ] DIAX: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T18:18:04.511447] [INFO ] [REMOTE    ] DHR: Incremental fetch complete for 2025-08 (2.76 seconds).
[2025-10-24T18:18:04.862094] [INFO ] [REMOTE    ] DHX: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T18:18:04.947687] [INFO ] [REMOTE    ] DIAX: Fetching primary data for 2025-06.
[2025-10-24T18:18:05.650674] [INFO ] [REMOTE    ] DHT: Incremental fetch complete for 2025-06 (2.30 seconds).
[2025-10-24T18:18:05.747724] [INFO ] [REMOTE    ] DHX: Fetching primary data for 2025-08.
[2025-10-24T18:18:05.982908] [INFO ] [REMOTE    ] DIAX: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T18:18:06.547700] [INFO ] [REMOTE    ] DHT: Fetching primary data for 2025-07.
[2025-10-24T18:18:06.717483] [INFO ] [REMOTE    ] DHX: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T18:18:07.347719] [INFO ] [REMOTE    ] DIAX: Fetching primary data for 2025-07.
[2025-10-24T18:18:08.147731] [INFO ] [REMOTE    ] DHX: Fetching primary data for 2025-09.
[2025-10-24T18:18:08.296788] [INFO ] [REMOTE    ] DIAX: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T18:18:08.947638] [INFO ] [REMOTE    ] DIAX: Fetching primary data for 2025-08.
[2025-10-24T18:18:09.101007] [INFO ] [REMOTE    ] DHX: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T18:18:09.265703] [INFO ] [REMOTE    ] DHT: Incremental fetch complete for 2025-07 (2.72 seconds).
[2025-10-24T18:18:09.437219] [INFO ] [REMOTE    ] DIAX: Incremental fetch complete for 2025-08 (0.49 seconds).
[2025-10-24T18:18:09.747707] [INFO ] [REMOTE    ] DHT: Fetching primary data for 2025-08.
[2025-10-24T18:18:10.547709] [INFO ] [REMOTE    ] DIAX: Fetching primary data for 2025-09.
[2025-10-24T18:18:11.172806] [INFO ] [REMOTE    ] DHT: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T18:18:11.246743] [INFO ] [REMOTE    ] DIAX: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T18:18:11.347683] [INFO ] [REMOTE    ] DHR: Fetching primary data for 2025-09.
[2025-10-24T18:18:12.147701] [INFO ] [REMOTE    ] DIAX: Fetching primary data for 2025-10.
[2025-10-24T18:18:12.947679] [INFO ] [REMOTE    ] DHX: Fetching primary data for 2025-10.
[2025-10-24T18:18:13.143278] [INFO ] [REMOTE    ] DIAX: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T18:18:13.145807] [INFO ] [REMOTE    ] DIAX: Full fetch complete (17548 records).
[2025-10-24T18:18:13.145875] [DEBUG] [VALIDATOR ] DIAX: Validating primary data.
[2025-10-24T18:18:13.146258] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:18:13.146404] [FATAL] [MAIN      ] DIAX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:18:13.146490] [WARN ] [MAIN      ] DIAX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:18:13.146586] [INFO ] [LOCAL     ] DIAX: Starting deletion of primary data.
[2025-10-24T18:18:13.146672] [DEBUG] [LOCAL     ] DIAX: No primary data file found to delete.
[2025-10-24T18:18:13.146730] [INFO ] [LOCAL     ] DIAX: Starting deletion of derivative data.
[2025-10-24T18:18:13.146857] [DEBUG] [LOCAL     ] DIAX: Deleted derivative data file.
[2025-10-24T18:18:13.146921] [INFO ] [MAIN      ] Update Progress: 618/2366 symbols completed. DIAX took 21.9s. Estimated remaining: 3h 41m 6s. Rate: 7.9 symbols/min
[2025-10-24T18:18:13.321890] [INFO ] [MAIN      ] DIN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:18:13.355023] [INFO ] [REMOTE    ] DHR: Incremental fetch complete for 2025-09 (2.01 seconds).
[2025-10-24T18:18:13.394401] [DEBUG] [LOCAL     ] DIN: Loaded 36981 existing records from primary storage.
[2025-10-24T18:18:13.394721] [INFO ] [MAIN      ] DIN: Loaded 36981 existing records.
[2025-10-24T18:18:13.570622] [WARN ] [MAIN      ] DIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:18:13.570832] [INFO ] [MAIN      ] DIN: Wiping existing primary data before full refresh.
[2025-10-24T18:18:13.570878] [INFO ] [LOCAL     ] DIN: Starting deletion of primary data.
[2025-10-24T18:18:13.571477] [DEBUG] [LOCAL     ] DIN: Deleted primary data file.
[2025-10-24T18:18:13.571533] [INFO ] [MAIN      ] DIN: Starting full primary refresh.
[2025-10-24T18:18:13.757462] [INFO ] [REMOTE    ] DHT: Fetching primary data for 2025-09.
[2025-10-24T18:18:13.925455] [INFO ] [REMOTE    ] DIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:18:13.987197] [INFO ] [REMOTE    ] DHX: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T18:18:13.990803] [INFO ] [REMOTE    ] DHX: Full fetch complete (21607 records).
[2025-10-24T18:18:13.990879] [DEBUG] [VALIDATOR ] DHX: Validating primary data.
[2025-10-24T18:18:14.363920] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present.
[2025-10-24T18:18:14.364016] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed.
[2025-10-24T18:18:14.364505] [INFO ] [MAIN      ] DHX: Fetched primary data is valid.
[2025-10-24T18:18:14.364545] [DEBUG] [LOCAL     ] DHX: Saving primary data.
[2025-10-24T18:18:14.364836] [FATAL] [LOCAL     ] DHX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:18:14.364918] [FATAL] [MAIN      ] DHX: Failed to save primary data.
[2025-10-24T18:18:14.364960] [WARN ] [MAIN      ] DHX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:18:14.365020] [INFO ] [LOCAL     ] DHX: Starting deletion of primary data.
[2025-10-24T18:18:14.365078] [DEBUG] [LOCAL     ] DHX: No primary data file found to delete.
[2025-10-24T18:18:14.365114] [INFO ] [LOCAL     ] DHX: Starting deletion of derivative data.
[2025-10-24T18:18:14.365247] [DEBUG] [LOCAL     ] DHX: Deleted derivative data file.
[2025-10-24T18:18:14.365328] [INFO ] [MAIN      ] Update Progress: 619/2366 symbols completed. DHX took 27.6s. Estimated remaining: 3h 40m 41s. Rate: 7.9 symbols/min
[2025-10-24T18:18:14.540602] [INFO ] [MAIN      ] DINO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:18:14.547696] [INFO ] [REMOTE    ] DIN: Fetching primary data for 2025-01.
[2025-10-24T18:18:14.591834] [DEBUG] [LOCAL     ] DINO: Loaded 53214 existing records from primary storage.
[2025-10-24T18:18:14.592136] [INFO ] [MAIN      ] DINO: Loaded 53214 existing records.
[2025-10-24T18:18:14.779180] [WARN ] [MAIN      ] DINO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:18:14.779464] [INFO ] [MAIN      ] DINO: Wiping existing primary data before full refresh.
[2025-10-24T18:18:14.779535] [INFO ] [LOCAL     ] DINO: Starting deletion of primary data.
[2025-10-24T18:18:14.780418] [DEBUG] [LOCAL     ] DINO: Deleted primary data file.
[2025-10-24T18:18:14.780476] [INFO ] [MAIN      ] DINO: Starting full primary refresh.
[2025-10-24T18:18:15.140236] [INFO ] [REMOTE    ] DINO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:18:15.356179] [INFO ] [REMOTE    ] DINO: Fetching primary data for 2025-01.
[2025-10-24T18:18:15.373952] [INFO ] [REMOTE    ] DHT: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T18:18:16.147635] [INFO ] [REMOTE    ] DHR: Fetching primary data for 2025-10.
[2025-10-24T18:18:16.259687] [INFO ] [REMOTE    ] DIN: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T18:18:16.953760] [INFO ] [REMOTE    ] DIN: Fetching primary data for 2025-02.
[2025-10-24T18:18:16.969163] [INFO ] [REMOTE    ] DINO: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T18:18:17.747694] [INFO ] [REMOTE    ] DINO: Fetching primary data for 2025-02.
[2025-10-24T18:18:18.253427] [INFO ] [REMOTE    ] DIN: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T18:18:18.355480] [INFO ] [REMOTE    ] DHR: Incremental fetch complete for 2025-10 (2.21 seconds).
[2025-10-24T18:18:18.365472] [INFO ] [REMOTE    ] DHR: Full fetch complete (77441 records).
[2025-10-24T18:18:18.365705] [DEBUG] [VALIDATOR ] DHR: Validating primary data.
[2025-10-24T18:18:18.560233] [INFO ] [REMOTE    ] DHT: Fetching primary data for 2025-10.
[2025-10-24T18:18:18.760140] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present.
[2025-10-24T18:18:18.760234] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed.
[2025-10-24T18:18:18.761212] [INFO ] [MAIN      ] DHR: Fetched primary data is valid.
[2025-10-24T18:18:18.761277] [DEBUG] [LOCAL     ] DHR: Saving primary data.
[2025-10-24T18:18:18.761947] [FATAL] [LOCAL     ] DHR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:18:18.762041] [FATAL] [MAIN      ] DHR: Failed to save primary data.
[2025-10-24T18:18:18.762082] [WARN ] [MAIN      ] DHR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:18:18.762138] [INFO ] [LOCAL     ] DHR: Starting deletion of primary data.
[2025-10-24T18:18:18.762192] [DEBUG] [LOCAL     ] DHR: No primary data file found to delete.
[2025-10-24T18:18:18.762227] [INFO ] [LOCAL     ] DHR: Starting deletion of derivative data.
[2025-10-24T18:18:18.762411] [DEBUG] [LOCAL     ] DHR: Deleted derivative data file.
[2025-10-24T18:18:18.762938] [INFO ] [MAIN      ] Update Progress: 620/2366 symbols completed. DHR took 42.1s. Estimated remaining: 3h 40m 24s. Rate: 7.9 symbols/min
[2025-10-24T18:18:18.933034] [INFO ] [MAIN      ] DIS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:18:18.987742] [DEBUG] [LOCAL     ] DIS: Loaded 54178 existing records from primary storage.
[2025-10-24T18:18:18.988067] [INFO ] [MAIN      ] DIS: Loaded 54178 existing records.
[2025-10-24T18:18:19.197966] [WARN ] [MAIN      ] DIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:18:19.198340] [INFO ] [MAIN      ] DIS: Wiping existing primary data before full refresh.
[2025-10-24T18:18:19.198400] [INFO ] [LOCAL     ] DIS: Starting deletion of primary data.
[2025-10-24T18:18:19.199548] [DEBUG] [LOCAL     ] DIS: Deleted primary data file.
[2025-10-24T18:18:19.199616] [INFO ] [MAIN      ] DIS: Starting full primary refresh.
[2025-10-24T18:18:19.350073] [INFO ] [REMOTE    ] DIN: Fetching primary data for 2025-03.
[2025-10-24T18:18:19.599421] [INFO ] [REMOTE    ] DIS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:18:19.621766] [INFO ] [REMOTE    ] DINO: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T18:18:20.147622] [INFO ] [REMOTE    ] DINO: Fetching primary data for 2025-03.
[2025-10-24T18:18:20.482332] [INFO ] [REMOTE    ] DHT: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T18:18:20.491512] [INFO ] [REMOTE    ] DHT: Full fetch complete (70331 records).
[2025-10-24T18:18:20.491631] [DEBUG] [VALIDATOR ] DHT: Validating primary data.
[2025-10-24T18:18:20.850475] [INFO ] [REMOTE    ] DIN: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T18:18:20.908153] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present.
[2025-10-24T18:18:20.908225] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed.
[2025-10-24T18:18:20.909074] [INFO ] [MAIN      ] DHT: Fetched primary data is valid.
[2025-10-24T18:18:20.909135] [DEBUG] [LOCAL     ] DHT: Saving primary data.
[2025-10-24T18:18:20.909706] [FATAL] [LOCAL     ] DHT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:18:20.909794] [FATAL] [MAIN      ] DHT: Failed to save primary data.
[2025-10-24T18:18:20.909836] [WARN ] [MAIN      ] DHT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:18:20.909870] [INFO ] [LOCAL     ] DHT: Starting deletion of primary data.
[2025-10-24T18:18:20.909921] [DEBUG] [LOCAL     ] DHT: No primary data file found to delete.
[2025-10-24T18:18:20.909956] [INFO ] [LOCAL     ] DHT: Starting deletion of derivative data.
[2025-10-24T18:18:20.910105] [DEBUG] [LOCAL     ] DHT: Deleted derivative data file.
[2025-10-24T18:18:20.910425] [INFO ] [MAIN      ] Update Progress: 621/2366 symbols completed. DHT took 39.9s. Estimated remaining: 3h 40m 1s. Rate: 7.9 symbols/min
[2025-10-24T18:18:20.952712] [INFO ] [REMOTE    ] DIN: Fetching primary data for 2025-04.
[2025-10-24T18:18:21.077023] [INFO ] [MAIN      ] DIVY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:18:21.077228] [DEBUG] [LOCAL     ] DIVY: No existing data file found in primary storage.
[2025-10-24T18:18:21.077273] [WARN ] [MAIN      ] DIVY: No existing data found, performing full refresh instead.
[2025-10-24T18:18:21.077381] [INFO ] [MAIN      ] DIVY: Wiping existing primary data before full refresh.
[2025-10-24T18:18:21.077422] [INFO ] [LOCAL     ] DIVY: Starting deletion of primary data.
[2025-10-24T18:18:21.077480] [DEBUG] [LOCAL     ] DIVY: No primary data file found to delete.
[2025-10-24T18:18:21.077512] [INFO ] [MAIN      ] DIVY: Starting full primary refresh.
[2025-10-24T18:18:21.423457] [INFO ] [REMOTE    ] DIVY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:18:21.687903] [INFO ] [REMOTE    ] DINO: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T18:18:21.747617] [INFO ] [REMOTE    ] DINO: Fetching primary data for 2025-04.
[2025-10-24T18:18:22.404326] [INFO ] [REMOTE    ] DIN: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T18:18:22.547724] [INFO ] [REMOTE    ] DIVY: Fetching primary data for 2025-01.
[2025-10-24T18:18:23.115329] [INFO ] [REMOTE    ] DIVY: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T18:18:23.207537] [INFO ] [REMOTE    ] DINO: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T18:18:23.347670] [INFO ] [REMOTE    ] DIN: Fetching primary data for 2025-05.
[2025-10-24T18:18:24.147672] [INFO ] [REMOTE    ] DIVY: Fetching primary data for 2025-02.
[2025-10-24T18:18:24.481825] [INFO ] [REMOTE    ] DIVY: Incremental fetch complete for 2025-02 (0.33 seconds).
[2025-10-24T18:18:24.650346] [INFO ] [REMOTE    ] DIN: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T18:18:24.947636] [INFO ] [REMOTE    ] DIVY: Fetching primary data for 2025-03.
[2025-10-24T18:18:25.321118] [INFO ] [REMOTE    ] DIVY: Incremental fetch complete for 2025-03 (0.37 seconds).
[2025-10-24T18:18:25.747634] [INFO ] [REMOTE    ] DIN: Fetching primary data for 2025-06.
[2025-10-24T18:18:26.547736] [INFO ] [REMOTE    ] DINO: Fetching primary data for 2025-05.
[2025-10-24T18:18:27.091123] [INFO ] [REMOTE    ] DIN: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T18:18:27.347736] [INFO ] [REMOTE    ] DIVY: Fetching primary data for 2025-04.
[2025-10-24T18:18:27.764849] [INFO ] [REMOTE    ] DIVY: Incremental fetch complete for 2025-04 (0.42 seconds).
[2025-10-24T18:18:28.147624] [INFO ] [REMOTE    ] DIS: Fetching primary data for 2025-01.
[2025-10-24T18:18:28.384829] [INFO ] [REMOTE    ] DINO: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T18:18:28.947634] [INFO ] [REMOTE    ] DIVY: Fetching primary data for 2025-05.
[2025-10-24T18:18:29.280124] [INFO ] [REMOTE    ] DIVY: Incremental fetch complete for 2025-05 (0.33 seconds).
[2025-10-24T18:18:29.747704] [INFO ] [REMOTE    ] DIN: Fetching primary data for 2025-07.
[2025-10-24T18:18:30.314472] [INFO ] [REMOTE    ] DIS: Incremental fetch complete for 2025-01 (2.17 seconds).
[2025-10-24T18:18:30.547670] [INFO ] [REMOTE    ] DIS: Fetching primary data for 2025-02.
[2025-10-24T18:18:30.673560] [INFO ] [REMOTE    ] DIN: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T18:18:31.347727] [INFO ] [REMOTE    ] DIN: Fetching primary data for 2025-08.
[2025-10-24T18:18:32.147743] [INFO ] [REMOTE    ] DIVY: Fetching primary data for 2025-06.
[2025-10-24T18:18:32.474876] [INFO ] [REMOTE    ] DIVY: Incremental fetch complete for 2025-06 (0.33 seconds).
[2025-10-24T18:18:32.715844] [INFO ] [REMOTE    ] DIN: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T18:18:32.860053] [INFO ] [REMOTE    ] DIS: Incremental fetch complete for 2025-02 (2.31 seconds).
[2025-10-24T18:18:32.947613] [INFO ] [REMOTE    ] DIS: Fetching primary data for 2025-03.
[2025-10-24T18:18:33.747684] [INFO ] [REMOTE    ] DIVY: Fetching primary data for 2025-07.
[2025-10-24T18:18:34.176005] [INFO ] [REMOTE    ] DIVY: Incremental fetch complete for 2025-07 (0.43 seconds).
[2025-10-24T18:18:34.547711] [INFO ] [REMOTE    ] DIVY: Fetching primary data for 2025-08.
[2025-10-24T18:18:34.829279] [INFO ] [REMOTE    ] DIVY: Incremental fetch complete for 2025-08 (0.28 seconds).
[2025-10-24T18:18:35.058481] [INFO ] [REMOTE    ] DIS: Incremental fetch complete for 2025-03 (2.11 seconds).
[2025-10-24T18:18:35.347674] [INFO ] [REMOTE    ] DIS: Fetching primary data for 2025-04.
[2025-10-24T18:18:36.147673] [INFO ] [REMOTE    ] DIVY: Fetching primary data for 2025-09.
[2025-10-24T18:18:36.514790] [INFO ] [REMOTE    ] DIVY: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T18:18:36.947636] [INFO ] [REMOTE    ] DIVY: Fetching primary data for 2025-10.
[2025-10-24T18:18:37.478623] [INFO ] [REMOTE    ] DIVY: Incremental fetch complete for 2025-10 (0.53 seconds).
[2025-10-24T18:18:37.479532] [INFO ] [REMOTE    ] DIVY: Full fetch complete (1671 records).
[2025-10-24T18:18:37.479612] [DEBUG] [VALIDATOR ] DIVY: Validating primary data.
[2025-10-24T18:18:37.694631] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days
[2025-10-24T18:18:37.689343] [INFO ] [REMOTE    ] DIS: Incremental fetch complete for 2025-04 (2.34 seconds).
[2025-10-24T18:18:37.705156] [FATAL] [MAIN      ] DIVY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:18:37.705516] [WARN ] [MAIN      ] DIVY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:18:37.705594] [INFO ] [LOCAL     ] DIVY: Starting deletion of primary data.
[2025-10-24T18:18:37.705954] [DEBUG] [LOCAL     ] DIVY: No primary data file found to delete.
[2025-10-24T18:18:37.706038] [INFO ] [LOCAL     ] DIVY: Starting deletion of derivative data.
[2025-10-24T18:18:37.706090] [DEBUG] [LOCAL     ] DIVY: No derivative data file found to delete.
[2025-10-24T18:18:37.706144] [INFO ] [MAIN      ] Update Progress: 622/2366 symbols completed. DIVY took 16.8s. Estimated remaining: 3h 40m 20s. Rate: 7.9 symbols/min
[2025-10-24T18:18:37.752772] [INFO ] [REMOTE    ] DIN: Fetching primary data for 2025-09.
[2025-10-24T18:18:37.875152] [INFO ] [MAIN      ] DK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:18:37.921138] [DEBUG] [LOCAL     ] DK: Loaded 49598 existing records from primary storage.
[2025-10-24T18:18:37.921466] [INFO ] [MAIN      ] DK: Loaded 49598 existing records.
[2025-10-24T18:18:38.097990] [WARN ] [MAIN      ] DK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:18:38.098214] [INFO ] [MAIN      ] DK: Wiping existing primary data before full refresh.
[2025-10-24T18:18:38.098259] [INFO ] [LOCAL     ] DK: Starting deletion of primary data.
[2025-10-24T18:18:38.099229] [DEBUG] [LOCAL     ] DK: Deleted primary data file.
[2025-10-24T18:18:38.099286] [INFO ] [MAIN      ] DK: Starting full primary refresh.
[2025-10-24T18:18:38.445244] [INFO ] [REMOTE    ] DK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:18:38.547676] [INFO ] [REMOTE    ] DK: Fetching primary data for 2025-01.
[2025-10-24T18:18:39.247840] [INFO ] [REMOTE    ] DIN: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T18:18:39.347622] [INFO ] [REMOTE    ] DIN: Fetching primary data for 2025-10.
[2025-10-24T18:18:40.147670] [INFO ] [REMOTE    ] DINO: Fetching primary data for 2025-06.
[2025-10-24T18:18:40.310323] [INFO ] [REMOTE    ] DK: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T18:18:40.805465] [INFO ] [REMOTE    ] DIN: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T18:18:40.812306] [INFO ] [REMOTE    ] DIN: Full fetch complete (54607 records).
[2025-10-24T18:18:40.812440] [DEBUG] [VALIDATOR ] DIN: Validating primary data.
[2025-10-24T18:18:40.958563] [INFO ] [REMOTE    ] DIS: Fetching primary data for 2025-05.
[2025-10-24T18:18:41.204896] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present.
[2025-10-24T18:18:41.204976] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed.
[2025-10-24T18:18:41.205724] [INFO ] [MAIN      ] DIN: Fetched primary data is valid.
[2025-10-24T18:18:41.205785] [DEBUG] [LOCAL     ] DIN: Saving primary data.
[2025-10-24T18:18:41.206271] [FATAL] [LOCAL     ] DIN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:18:41.206358] [FATAL] [MAIN      ] DIN: Failed to save primary data.
[2025-10-24T18:18:41.206418] [WARN ] [MAIN      ] DIN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:18:41.206478] [INFO ] [LOCAL     ] DIN: Starting deletion of primary data.
[2025-10-24T18:18:41.206536] [DEBUG] [LOCAL     ] DIN: No primary data file found to delete.
[2025-10-24T18:18:41.206571] [INFO ] [LOCAL     ] DIN: Starting deletion of derivative data.
[2025-10-24T18:18:41.206738] [DEBUG] [LOCAL     ] DIN: Deleted derivative data file.
[2025-10-24T18:18:41.206833] [INFO ] [MAIN      ] Update Progress: 623/2366 symbols completed. DIN took 28.1s. Estimated remaining: 3h 40m 1s. Rate: 7.9 symbols/min
[2025-10-24T18:18:41.376629] [INFO ] [MAIN      ] DKL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:18:41.393062] [DEBUG] [LOCAL     ] DKL: Loaded 16921 existing records from primary storage.
[2025-10-24T18:18:41.393298] [INFO ] [MAIN      ] DKL: Loaded 16921 existing records.
[2025-10-24T18:18:41.572880] [WARN ] [MAIN      ] DKL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:18:41.573148] [INFO ] [MAIN      ] DKL: Wiping existing primary data before full refresh.
[2025-10-24T18:18:41.573197] [INFO ] [LOCAL     ] DKL: Starting deletion of primary data.
[2025-10-24T18:18:41.573583] [DEBUG] [LOCAL     ] DKL: Deleted primary data file.
[2025-10-24T18:18:41.573669] [INFO ] [MAIN      ] DKL: Starting full primary refresh.
[2025-10-24T18:18:41.754476] [INFO ] [REMOTE    ] DK: Fetching primary data for 2025-02.
[2025-10-24T18:18:41.966639] [INFO ] [REMOTE    ] DKL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:18:42.004959] [INFO ] [REMOTE    ] DINO: Incremental fetch complete for 2025-06 (1.86 seconds).
[2025-10-24T18:18:42.547677] [INFO ] [REMOTE    ] DINO: Fetching primary data for 2025-07.
[2025-10-24T18:18:43.357538] [INFO ] [REMOTE    ] DKL: Fetching primary data for 2025-01.
[2025-10-24T18:18:43.359793] [INFO ] [REMOTE    ] DK: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T18:18:43.403083] [INFO ] [REMOTE    ] DIS: Incremental fetch complete for 2025-05 (2.44 seconds).
[2025-10-24T18:18:43.686707] [INFO ] [REMOTE    ] DINO: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T18:18:44.147617] [INFO ] [REMOTE    ] DIS: Fetching primary data for 2025-06.
[2025-10-24T18:18:44.437998] [INFO ] [REMOTE    ] DKL: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T18:18:44.947630] [INFO ] [REMOTE    ] DK: Fetching primary data for 2025-03.
[2025-10-24T18:18:45.747723] [INFO ] [REMOTE    ] DINO: Fetching primary data for 2025-08.
[2025-10-24T18:18:46.214852] [INFO ] [REMOTE    ] DIS: Incremental fetch complete for 2025-06 (2.07 seconds).
[2025-10-24T18:18:46.439361] [INFO ] [REMOTE    ] DK: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T18:18:46.547671] [INFO ] [REMOTE    ] DIS: Fetching primary data for 2025-07.
[2025-10-24T18:18:47.238402] [INFO ] [REMOTE    ] DINO: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T18:18:47.347615] [INFO ] [REMOTE    ] DINO: Fetching primary data for 2025-09.
[2025-10-24T18:18:48.147693] [INFO ] [REMOTE    ] DKL: Fetching primary data for 2025-02.
[2025-10-24T18:18:48.884599] [INFO ] [REMOTE    ] DIS: Incremental fetch complete for 2025-07 (2.34 seconds).
[2025-10-24T18:18:48.933550] [INFO ] [REMOTE    ] DINO: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T18:18:48.947595] [INFO ] [REMOTE    ] DINO: Fetching primary data for 2025-10.
[2025-10-24T18:18:49.300107] [INFO ] [REMOTE    ] DKL: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T18:18:49.747665] [INFO ] [REMOTE    ] DIS: Fetching primary data for 2025-08.
[2025-10-24T18:18:50.547619] [INFO ] [REMOTE    ] DKL: Fetching primary data for 2025-03.
[2025-10-24T18:18:50.722203] [INFO ] [REMOTE    ] DINO: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T18:18:50.731667] [INFO ] [REMOTE    ] DINO: Full fetch complete (76709 records).
[2025-10-24T18:18:50.731807] [DEBUG] [VALIDATOR ] DINO: Validating primary data.
[2025-10-24T18:18:51.114556] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present.
[2025-10-24T18:18:51.114634] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed.
[2025-10-24T18:18:51.115546] [INFO ] [MAIN      ] DINO: Fetched primary data is valid.
[2025-10-24T18:18:51.115592] [DEBUG] [LOCAL     ] DINO: Saving primary data.
[2025-10-24T18:18:51.116177] [FATAL] [LOCAL     ] DINO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:18:51.116266] [FATAL] [MAIN      ] DINO: Failed to save primary data.
[2025-10-24T18:18:51.116307] [WARN ] [MAIN      ] DINO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:18:51.116342] [INFO ] [LOCAL     ] DINO: Starting deletion of primary data.
[2025-10-24T18:18:51.116393] [DEBUG] [LOCAL     ] DINO: No primary data file found to delete.
[2025-10-24T18:18:51.116428] [INFO ] [LOCAL     ] DINO: Starting deletion of derivative data.
[2025-10-24T18:18:51.116560] [DEBUG] [LOCAL     ] DINO: Deleted derivative data file.
[2025-10-24T18:18:51.116827] [INFO ] [MAIN      ] Update Progress: 624/2366 symbols completed. DINO took 36.8s. Estimated remaining: 3h 39m 60s. Rate: 7.9 symbols/min
[2025-10-24T18:18:51.287307] [INFO ] [MAIN      ] DKS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:18:51.350144] [INFO ] [REMOTE    ] DK: Fetching primary data for 2025-04.
[2025-10-24T18:18:51.352937] [DEBUG] [LOCAL     ] DKS: Loaded 49595 existing records from primary storage.
[2025-10-24T18:18:51.353356] [INFO ] [MAIN      ] DKS: Loaded 49595 existing records.
[2025-10-24T18:18:51.541363] [WARN ] [MAIN      ] DKS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:18:51.541699] [INFO ] [MAIN      ] DKS: Wiping existing primary data before full refresh.
[2025-10-24T18:18:51.541758] [INFO ] [LOCAL     ] DKS: Starting deletion of primary data.
[2025-10-24T18:18:51.542252] [DEBUG] [LOCAL     ] DKS: Deleted primary data file.
[2025-10-24T18:18:51.542306] [INFO ] [MAIN      ] DKS: Starting full primary refresh.
[2025-10-24T18:18:51.812434] [INFO ] [REMOTE    ] DKL: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T18:18:51.945923] [INFO ] [REMOTE    ] DKS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:18:51.985529] [INFO ] [REMOTE    ] DIS: Incremental fetch complete for 2025-08 (2.24 seconds).
[2025-10-24T18:18:52.147698] [INFO ] [REMOTE    ] DKS: Fetching primary data for 2025-01.
[2025-10-24T18:18:52.947620] [INFO ] [REMOTE    ] DIS: Fetching primary data for 2025-09.
[2025-10-24T18:18:53.062179] [INFO ] [REMOTE    ] DK: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T18:18:53.747630] [INFO ] [REMOTE    ] DKL: Fetching primary data for 2025-04.
[2025-10-24T18:18:53.783807] [INFO ] [REMOTE    ] DKS: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T18:18:54.547751] [INFO ] [REMOTE    ] DK: Fetching primary data for 2025-05.
[2025-10-24T18:18:55.267566] [INFO ] [REMOTE    ] DKL: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T18:18:55.347617] [INFO ] [REMOTE    ] DKL: Fetching primary data for 2025-05.
[2025-10-24T18:18:55.402031] [INFO ] [REMOTE    ] DIS: Incremental fetch complete for 2025-09 (2.45 seconds).
[2025-10-24T18:18:56.147671] [INFO ] [REMOTE    ] DIS: Fetching primary data for 2025-10.
[2025-10-24T18:18:56.304493] [INFO ] [REMOTE    ] DK: Incremental fetch complete for 2025-05 (1.76 seconds).
[2025-10-24T18:18:56.463500] [INFO ] [REMOTE    ] DKL: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T18:18:56.947634] [INFO ] [REMOTE    ] DKS: Fetching primary data for 2025-02.
[2025-10-24T18:18:57.747724] [INFO ] [REMOTE    ] DK: Fetching primary data for 2025-06.
[2025-10-24T18:18:58.381734] [INFO ] [REMOTE    ] DKS: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T18:18:58.547679] [INFO ] [REMOTE    ] DKL: Fetching primary data for 2025-06.
[2025-10-24T18:18:58.693368] [INFO ] [REMOTE    ] DIS: Incremental fetch complete for 2025-10 (2.55 seconds).
[2025-10-24T18:18:58.703145] [INFO ] [REMOTE    ] DIS: Full fetch complete (77967 records).
[2025-10-24T18:18:58.703268] [DEBUG] [VALIDATOR ] DIS: Validating primary data.
[2025-10-24T18:18:59.096275] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present.
[2025-10-24T18:18:59.096393] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed.
[2025-10-24T18:18:59.097446] [INFO ] [MAIN      ] DIS: Fetched primary data is valid.
[2025-10-24T18:18:59.097546] [DEBUG] [LOCAL     ] DIS: Saving primary data.
[2025-10-24T18:18:59.098392] [FATAL] [LOCAL     ] DIS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:18:59.098574] [FATAL] [MAIN      ] DIS: Failed to save primary data.
[2025-10-24T18:18:59.098740] [WARN ] [MAIN      ] DIS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:18:59.098868] [INFO ] [LOCAL     ] DIS: Starting deletion of primary data.
[2025-10-24T18:18:59.099031] [DEBUG] [LOCAL     ] DIS: No primary data file found to delete.
[2025-10-24T18:18:59.099094] [INFO ] [LOCAL     ] DIS: Starting deletion of derivative data.
[2025-10-24T18:18:59.099226] [DEBUG] [LOCAL     ] DIS: Deleted derivative data file.
[2025-10-24T18:18:59.099500] [INFO ] [MAIN      ] Update Progress: 625/2366 symbols completed. DIS took 40.3s. Estimated remaining: 3h 39m 53s. Rate: 7.9 symbols/min
[2025-10-24T18:18:59.309488] [INFO ] [MAIN      ] DLB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:18:59.311989] [INFO ] [REMOTE    ] DK: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T18:18:59.351679] [INFO ] [REMOTE    ] DKS: Fetching primary data for 2025-03.
[2025-10-24T18:18:59.353288] [DEBUG] [LOCAL     ] DLB: Loaded 32462 existing records from primary storage.
[2025-10-24T18:18:59.353568] [INFO ] [MAIN      ] DLB: Loaded 32462 existing records.
[2025-10-24T18:18:59.540350] [INFO ] [REMOTE    ] DKL: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T18:18:59.545290] [WARN ] [MAIN      ] DLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:18:59.549539] [INFO ] [MAIN      ] DLB: Wiping existing primary data before full refresh.
[2025-10-24T18:18:59.549981] [INFO ] [LOCAL     ] DLB: Starting deletion of primary data.
[2025-10-24T18:18:59.550238] [DEBUG] [LOCAL     ] DLB: Deleted primary data file.
[2025-10-24T18:18:59.550303] [INFO ] [MAIN      ] DLB: Starting full primary refresh.
[2025-10-24T18:18:59.920917] [INFO ] [REMOTE    ] DLB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:19:00.147740] [INFO ] [REMOTE    ] DLB: Fetching primary data for 2025-01.
[2025-10-24T18:19:00.947711] [INFO ] [REMOTE    ] DKL: Fetching primary data for 2025-07.
[2025-10-24T18:19:01.747747] [INFO ] [REMOTE    ] DK: Fetching primary data for 2025-07.
[2025-10-24T18:19:01.987513] [INFO ] [REMOTE    ] DKS: Incremental fetch complete for 2025-03 (2.64 seconds).
[2025-10-24T18:19:02.057357] [INFO ] [REMOTE    ] DLB: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T18:19:02.547709] [INFO ] [REMOTE    ] DLB: Fetching primary data for 2025-02.
[2025-10-24T18:19:03.347731] [INFO ] [REMOTE    ] DKS: Fetching primary data for 2025-04.
[2025-10-24T18:19:03.466953] [INFO ] [REMOTE    ] DKL: Incremental fetch complete for 2025-07 (2.52 seconds).
[2025-10-24T18:19:04.147682] [INFO ] [REMOTE    ] DKL: Fetching primary data for 2025-08.
[2025-10-24T18:19:04.315265] [INFO ] [REMOTE    ] DLB: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T18:19:04.842807] [INFO ] [REMOTE    ] DK: Incremental fetch complete for 2025-07 (3.10 seconds).
[2025-10-24T18:19:04.887983] [INFO ] [REMOTE    ] DKL: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T18:19:04.947691] [INFO ] [REMOTE    ] DLB: Fetching primary data for 2025-03.
[2025-10-24T18:19:05.339072] [INFO ] [REMOTE    ] DKS: Incremental fetch complete for 2025-04 (1.99 seconds).
[2025-10-24T18:19:05.747740] [INFO ] [REMOTE    ] DK: Fetching primary data for 2025-08.
[2025-10-24T18:19:06.140520] [INFO ] [REMOTE    ] DLB: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T18:19:06.547686] [INFO ] [REMOTE    ] DLB: Fetching primary data for 2025-04.
[2025-10-24T18:19:07.219992] [INFO ] [REMOTE    ] DK: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T18:19:07.347730] [INFO ] [REMOTE    ] DK: Fetching primary data for 2025-09.
[2025-10-24T18:19:08.034328] [INFO ] [REMOTE    ] DLB: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T18:19:08.147698] [INFO ] [REMOTE    ] DLB: Fetching primary data for 2025-05.
[2025-10-24T18:19:08.947687] [INFO ] [REMOTE    ] DKS: Fetching primary data for 2025-05.
[2025-10-24T18:19:09.025512] [INFO ] [REMOTE    ] DK: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T18:19:09.461749] [INFO ] [REMOTE    ] DLB: Incremental fetch complete for 2025-05 (1.31 seconds).
[2025-10-24T18:19:09.747687] [INFO ] [REMOTE    ] DLB: Fetching primary data for 2025-06.
[2025-10-24T18:19:10.547675] [INFO ] [REMOTE    ] DKL: Fetching primary data for 2025-09.
[2025-10-24T18:19:10.927022] [INFO ] [REMOTE    ] DKS: Incremental fetch complete for 2025-05 (1.98 seconds).
[2025-10-24T18:19:11.030568] [INFO ] [REMOTE    ] DLB: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T18:19:11.131579] [INFO ] [REMOTE    ] DKL: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T18:19:11.347673] [INFO ] [REMOTE    ] DKS: Fetching primary data for 2025-06.
[2025-10-24T18:19:12.147672] [INFO ] [REMOTE    ] DLB: Fetching primary data for 2025-07.
[2025-10-24T18:19:12.838784] [INFO ] [REMOTE    ] DKS: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T18:19:12.947621] [INFO ] [REMOTE    ] DKL: Fetching primary data for 2025-10.
[2025-10-24T18:19:13.471491] [INFO ] [REMOTE    ] DLB: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T18:19:13.551059] [INFO ] [REMOTE    ] DKL: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T18:19:13.553391] [INFO ] [REMOTE    ] DKL: Full fetch complete (27472 records).
[2025-10-24T18:19:13.553477] [DEBUG] [VALIDATOR ] DKL: Validating primary data.
[2025-10-24T18:19:13.752772] [INFO ] [REMOTE    ] DK: Fetching primary data for 2025-10.
[2025-10-24T18:19:13.925092] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present.
[2025-10-24T18:19:13.925173] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed.
[2025-10-24T18:19:13.925709] [INFO ] [MAIN      ] DKL: Fetched primary data is valid.
[2025-10-24T18:19:13.925771] [DEBUG] [LOCAL     ] DKL: Saving primary data.
[2025-10-24T18:19:13.926077] [FATAL] [LOCAL     ] DKL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:19:13.926167] [FATAL] [MAIN      ] DKL: Failed to save primary data.
[2025-10-24T18:19:13.926209] [WARN ] [MAIN      ] DKL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:19:13.926246] [INFO ] [LOCAL     ] DKL: Starting deletion of primary data.
[2025-10-24T18:19:13.926295] [DEBUG] [LOCAL     ] DKL: No primary data file found to delete.
[2025-10-24T18:19:13.926330] [INFO ] [LOCAL     ] DKL: Starting deletion of derivative data.
[2025-10-24T18:19:13.926484] [DEBUG] [LOCAL     ] DKL: Deleted derivative data file.
[2025-10-24T18:19:13.926574] [INFO ] [MAIN      ] Update Progress: 626/2366 symbols completed. DKL took 32.7s. Estimated remaining: 3h 40m 6s. Rate: 7.9 symbols/min
[2025-10-24T18:19:14.092561] [INFO ] [MAIN      ] DLNG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:19:14.092810] [DEBUG] [LOCAL     ] DLNG: No existing data file found in primary storage.
[2025-10-24T18:19:14.092860] [WARN ] [MAIN      ] DLNG: No existing data found, performing full refresh instead.
[2025-10-24T18:19:14.092970] [INFO ] [MAIN      ] DLNG: Wiping existing primary data before full refresh.
[2025-10-24T18:19:14.093012] [INFO ] [LOCAL     ] DLNG: Starting deletion of primary data.
[2025-10-24T18:19:14.093052] [DEBUG] [LOCAL     ] DLNG: No primary data file found to delete.
[2025-10-24T18:19:14.093082] [INFO ] [MAIN      ] DLNG: Starting full primary refresh.
[2025-10-24T18:19:14.447918] [INFO ] [REMOTE    ] DLNG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:19:14.547681] [INFO ] [REMOTE    ] DLNG: Fetching primary data for 2025-01.
[2025-10-24T18:19:15.347680] [INFO ] [REMOTE    ] DKS: Fetching primary data for 2025-07.
[2025-10-24T18:19:15.790132] [INFO ] [REMOTE    ] DLNG: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T18:19:15.845688] [INFO ] [REMOTE    ] DK: Incremental fetch complete for 2025-10 (2.09 seconds).
[2025-10-24T18:19:15.854277] [INFO ] [REMOTE    ] DK: Full fetch complete (70799 records).
[2025-10-24T18:19:15.854403] [DEBUG] [VALIDATOR ] DK: Validating primary data.
[2025-10-24T18:19:16.152741] [INFO ] [REMOTE    ] DLNG: Fetching primary data for 2025-02.
[2025-10-24T18:19:16.243596] [DEBUG] [VALIDATOR ] DK: All expected trading days are present.
[2025-10-24T18:19:16.243701] [DEBUG] [VALIDATOR ] DK: Primary data validation passed.
[2025-10-24T18:19:16.244578] [INFO ] [MAIN      ] DK: Fetched primary data is valid.
[2025-10-24T18:19:16.244638] [DEBUG] [LOCAL     ] DK: Saving primary data.
[2025-10-24T18:19:16.245269] [FATAL] [LOCAL     ] DK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:19:16.245360] [FATAL] [MAIN      ] DK: Failed to save primary data.
[2025-10-24T18:19:16.245401] [WARN ] [MAIN      ] DK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:19:16.245438] [INFO ] [LOCAL     ] DK: Starting deletion of primary data.
[2025-10-24T18:19:16.245507] [DEBUG] [LOCAL     ] DK: No primary data file found to delete.
[2025-10-24T18:19:16.245561] [INFO ] [LOCAL     ] DK: Starting deletion of derivative data.
[2025-10-24T18:19:16.246002] [DEBUG] [LOCAL     ] DK: Deleted derivative data file.
[2025-10-24T18:19:16.246609] [INFO ] [MAIN      ] Update Progress: 627/2366 symbols completed. DK took 38.5s. Estimated remaining: 3h 39m 44s. Rate: 7.9 symbols/min
[2025-10-24T18:19:16.412373] [INFO ] [MAIN      ] DLR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:19:16.463541] [DEBUG] [LOCAL     ] DLR: Loaded 50985 existing records from primary storage.
[2025-10-24T18:19:16.463883] [INFO ] [MAIN      ] DLR: Loaded 50985 existing records.
[2025-10-24T18:19:16.640383] [WARN ] [MAIN      ] DLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:19:16.640579] [INFO ] [MAIN      ] DLR: Wiping existing primary data before full refresh.
[2025-10-24T18:19:16.640625] [INFO ] [LOCAL     ] DLR: Starting deletion of primary data.
[2025-10-24T18:19:16.641072] [DEBUG] [LOCAL     ] DLR: Deleted primary data file.
[2025-10-24T18:19:16.641128] [INFO ] [MAIN      ] DLR: Starting full primary refresh.
[2025-10-24T18:19:16.959484] [INFO ] [REMOTE    ] DLB: Fetching primary data for 2025-08.
[2025-10-24T18:19:17.001186] [INFO ] [REMOTE    ] DLR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:19:17.015899] [INFO ] [REMOTE    ] DLNG: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T18:19:17.392984] [INFO ] [REMOTE    ] DKS: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T18:19:17.747625] [INFO ] [REMOTE    ] DLNG: Fetching primary data for 2025-03.
[2025-10-24T18:19:18.342341] [INFO ] [REMOTE    ] DLB: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T18:19:18.454118] [INFO ] [REMOTE    ] DLNG: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T18:19:18.547627] [INFO ] [REMOTE    ] DLNG: Fetching primary data for 2025-04.
[2025-10-24T18:19:19.230795] [INFO ] [REMOTE    ] DLNG: Incremental fetch complete for 2025-04 (0.68 seconds).
[2025-10-24T18:19:19.347618] [INFO ] [REMOTE    ] DLB: Fetching primary data for 2025-09.
[2025-10-24T18:19:20.147724] [INFO ] [REMOTE    ] DLR: Fetching primary data for 2025-01.
[2025-10-24T18:19:20.674591] [INFO ] [REMOTE    ] DLB: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T18:19:20.947628] [INFO ] [REMOTE    ] DLB: Fetching primary data for 2025-10.
[2025-10-24T18:19:21.747735] [INFO ] [REMOTE    ] DKS: Fetching primary data for 2025-08.
[2025-10-24T18:19:21.867401] [INFO ] [REMOTE    ] DLR: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T18:19:22.472914] [INFO ] [REMOTE    ] DLB: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T18:19:22.479062] [INFO ] [REMOTE    ] DLB: Full fetch complete (47289 records).
[2025-10-24T18:19:22.479220] [DEBUG] [VALIDATOR ] DLB: Validating primary data.
[2025-10-24T18:19:22.479954] [FATAL] [VALIDATOR ] DLB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:19:22.480044] [FATAL] [MAIN      ] DLB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:19:22.480086] [WARN ] [MAIN      ] DLB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:19:22.480124] [INFO ] [LOCAL     ] DLB: Starting deletion of primary data.
[2025-10-24T18:19:22.480178] [DEBUG] [LOCAL     ] DLB: No primary data file found to delete.
[2025-10-24T18:19:22.480213] [INFO ] [LOCAL     ] DLB: Starting deletion of derivative data.
[2025-10-24T18:19:22.480336] [DEBUG] [LOCAL     ] DLB: Deleted derivative data file.
[2025-10-24T18:19:22.480402] [INFO ] [MAIN      ] Update Progress: 628/2366 symbols completed. DLB took 23.4s. Estimated remaining: 3h 39m 32s. Rate: 7.9 symbols/min
[2025-10-24T18:19:22.556177] [INFO ] [REMOTE    ] DLNG: Fetching primary data for 2025-05.
[2025-10-24T18:19:22.654435] [INFO ] [MAIN      ] DLX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:19:22.684455] [DEBUG] [LOCAL     ] DLX: Loaded 28240 existing records from primary storage.
[2025-10-24T18:19:22.684770] [INFO ] [MAIN      ] DLX: Loaded 28240 existing records.
[2025-10-24T18:19:22.867198] [WARN ] [MAIN      ] DLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:19:22.867397] [INFO ] [MAIN      ] DLX: Wiping existing primary data before full refresh.
[2025-10-24T18:19:22.867444] [INFO ] [LOCAL     ] DLX: Starting deletion of primary data.
[2025-10-24T18:19:22.867763] [DEBUG] [LOCAL     ] DLX: Deleted primary data file.
[2025-10-24T18:19:22.867820] [INFO ] [MAIN      ] DLX: Starting full primary refresh.
[2025-10-24T18:19:23.225359] [INFO ] [REMOTE    ] DLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:19:23.347614] [INFO ] [REMOTE    ] DLX: Fetching primary data for 2025-01.
[2025-10-24T18:19:23.536210] [INFO ] [REMOTE    ] DKS: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T18:19:23.558027] [INFO ] [REMOTE    ] DLNG: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T18:19:24.147700] [INFO ] [REMOTE    ] DLR: Fetching primary data for 2025-02.
[2025-10-24T18:19:24.256043] [INFO ] [REMOTE    ] DLX: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T18:19:24.947736] [INFO ] [REMOTE    ] DKS: Fetching primary data for 2025-09.
[2025-10-24T18:19:25.747623] [INFO ] [REMOTE    ] DLNG: Fetching primary data for 2025-06.
[2025-10-24T18:19:25.790857] [INFO ] [REMOTE    ] DLR: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T18:19:26.547620] [INFO ] [REMOTE    ] DLX: Fetching primary data for 2025-02.
[2025-10-24T18:19:26.607832] [INFO ] [REMOTE    ] DLNG: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T18:19:26.671420] [INFO ] [REMOTE    ] DKS: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T18:19:27.347675] [INFO ] [REMOTE    ] DLR: Fetching primary data for 2025-03.
[2025-10-24T18:19:27.922366] [INFO ] [REMOTE    ] DLX: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T18:19:28.147675] [INFO ] [REMOTE    ] DLNG: Fetching primary data for 2025-07.
[2025-10-24T18:19:28.800076] [INFO ] [REMOTE    ] DLNG: Incremental fetch complete for 2025-07 (0.65 seconds).
[2025-10-24T18:19:28.947709] [INFO ] [REMOTE    ] DLNG: Fetching primary data for 2025-08.
[2025-10-24T18:19:29.316282] [INFO ] [REMOTE    ] DLR: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T18:19:29.527959] [INFO ] [REMOTE    ] DLNG: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T18:19:29.747623] [INFO ] [REMOTE    ] DLNG: Fetching primary data for 2025-09.
[2025-10-24T18:19:30.211567] [INFO ] [REMOTE    ] DLNG: Incremental fetch complete for 2025-09 (0.46 seconds).
[2025-10-24T18:19:30.547740] [INFO ] [REMOTE    ] DLX: Fetching primary data for 2025-03.
[2025-10-24T18:19:31.347732] [INFO ] [REMOTE    ] DKS: Fetching primary data for 2025-10.
[2025-10-24T18:19:31.786810] [INFO ] [REMOTE    ] DLX: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T18:19:32.147735] [INFO ] [REMOTE    ] DLNG: Fetching primary data for 2025-10.
[2025-10-24T18:19:32.897884] [INFO ] [REMOTE    ] DLNG: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T18:19:32.899474] [INFO ] [REMOTE    ] DLNG: Full fetch complete (11072 records).
[2025-10-24T18:19:32.899552] [DEBUG] [VALIDATOR ] DLNG: Validating primary data.
[2025-10-24T18:19:32.953742] [INFO ] [REMOTE    ] DLR: Fetching primary data for 2025-04.
[2025-10-24T18:19:33.258420] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present.
[2025-10-24T18:19:33.258492] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed.
[2025-10-24T18:19:33.258795] [INFO ] [MAIN      ] DLNG: Fetched primary data is valid.
[2025-10-24T18:19:33.258856] [DEBUG] [LOCAL     ] DLNG: Saving primary data.
[2025-10-24T18:19:33.259064] [FATAL] [LOCAL     ] DLNG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:19:33.259143] [FATAL] [MAIN      ] DLNG: Failed to save primary data.
[2025-10-24T18:19:33.259199] [WARN ] [MAIN      ] DLNG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:19:33.259279] [INFO ] [LOCAL     ] DLNG: Starting deletion of primary data.
[2025-10-24T18:19:33.259349] [DEBUG] [LOCAL     ] DLNG: No primary data file found to delete.
[2025-10-24T18:19:33.259396] [INFO ] [LOCAL     ] DLNG: Starting deletion of derivative data.
[2025-10-24T18:19:33.259451] [DEBUG] [LOCAL     ] DLNG: No derivative data file found to delete.
[2025-10-24T18:19:33.259522] [INFO ] [MAIN      ] Update Progress: 629/2366 symbols completed. DLNG took 19.3s. Estimated remaining: 3h 39m 33s. Rate: 7.9 symbols/min
[2025-10-24T18:19:33.434696] [INFO ] [MAIN      ] DLY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:19:33.454842] [DEBUG] [LOCAL     ] DLY: Loaded 20880 existing records from primary storage.
[2025-10-24T18:19:33.455090] [INFO ] [MAIN      ] DLY: Loaded 20880 existing records.
[2025-10-24T18:19:33.618480] [INFO ] [REMOTE    ] DKS: Incremental fetch complete for 2025-10 (2.27 seconds).
[2025-10-24T18:19:33.660372] [INFO ] [REMOTE    ] DKS: Full fetch complete (71145 records).
[2025-10-24T18:19:33.660248] [WARN ] [MAIN      ] DLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:19:33.660570] [INFO ] [MAIN      ] DLY: Wiping existing primary data before full refresh.
[2025-10-24T18:19:33.660637] [INFO ] [LOCAL     ] DLY: Starting deletion of primary data.
[2025-10-24T18:19:33.660754] [DEBUG] [VALIDATOR ] DKS: Validating primary data.
[2025-10-24T18:19:33.661158] [DEBUG] [LOCAL     ] DLY: Deleted primary data file.
[2025-10-24T18:19:33.661217] [INFO ] [MAIN      ] DLY: Starting full primary refresh.
[2025-10-24T18:19:33.684939] [FATAL] [VALIDATOR ] DKS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:19:33.692929] [FATAL] [MAIN      ] DKS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:19:33.725115] [WARN ] [MAIN      ] DKS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:19:33.736279] [INFO ] [LOCAL     ] DKS: Starting deletion of primary data.
[2025-10-24T18:19:33.751814] [DEBUG] [LOCAL     ] DKS: No primary data file found to delete.
[2025-10-24T18:19:33.751888] [INFO ] [REMOTE    ] DLX: Fetching primary data for 2025-04.
[2025-10-24T18:19:33.760302] [INFO ] [LOCAL     ] DKS: Starting deletion of derivative data.
[2025-10-24T18:19:33.763597] [DEBUG] [LOCAL     ] DKS: Deleted derivative data file.
[2025-10-24T18:19:33.764153] [INFO ] [MAIN      ] Update Progress: 630/2366 symbols completed. DKS took 42.6s. Estimated remaining: 3h 39m 6s. Rate: 7.9 symbols/min
[2025-10-24T18:19:34.134892] [INFO ] [MAIN      ] DMA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:19:34.195915] [INFO ] [REMOTE    ] DLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:19:34.192449] [DEBUG] [LOCAL     ] DMA: Loaded 4725 existing records from primary storage.
[2025-10-24T18:19:34.196318] [INFO ] [MAIN      ] DMA: Loaded 4725 existing records.
[2025-10-24T18:19:34.367424] [WARN ] [MAIN      ] DMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:19:34.367592] [INFO ] [MAIN      ] DMA: Wiping existing primary data before full refresh.
[2025-10-24T18:19:34.367639] [INFO ] [LOCAL     ] DMA: Starting deletion of primary data.
[2025-10-24T18:19:34.367826] [DEBUG] [LOCAL     ] DMA: Deleted primary data file.
[2025-10-24T18:19:34.367867] [INFO ] [MAIN      ] DMA: Starting full primary refresh.
[2025-10-24T18:19:34.565219] [INFO ] [REMOTE    ] DLY: Fetching primary data for 2025-01.
[2025-10-24T18:19:34.730421] [INFO ] [REMOTE    ] DMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:19:35.003624] [INFO ] [REMOTE    ] DLR: Incremental fetch complete for 2025-04 (2.05 seconds).
[2025-10-24T18:19:35.262533] [INFO ] [REMOTE    ] DLX: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T18:19:35.347595] [INFO ] [REMOTE    ] DLX: Fetching primary data for 2025-05.
[2025-10-24T18:19:35.453818] [INFO ] [REMOTE    ] DLY: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T18:19:36.147718] [INFO ] [REMOTE    ] DLR: Fetching primary data for 2025-05.
[2025-10-24T18:19:36.690713] [INFO ] [REMOTE    ] DLX: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T18:19:36.947708] [INFO ] [REMOTE    ] DMA: Fetching primary data for 2025-01.
[2025-10-24T18:19:37.730558] [INFO ] [REMOTE    ] DLR: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T18:19:37.745518] [INFO ] [REMOTE    ] DMA: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T18:19:37.747772] [INFO ] [REMOTE    ] DLR: Fetching primary data for 2025-06.
[2025-10-24T18:19:38.547738] [INFO ] [REMOTE    ] DMA: Fetching primary data for 2025-02.
[2025-10-24T18:19:39.138832] [INFO ] [REMOTE    ] DMA: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T18:19:39.355816] [INFO ] [REMOTE    ] DLY: Fetching primary data for 2025-02.
[2025-10-24T18:19:39.360890] [INFO ] [REMOTE    ] DLR: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T18:19:40.147708] [INFO ] [REMOTE    ] DMA: Fetching primary data for 2025-03.
[2025-10-24T18:19:40.235705] [INFO ] [REMOTE    ] DLY: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T18:19:40.464902] [INFO ] [REMOTE    ] DMA: Incremental fetch complete for 2025-03 (0.32 seconds).
[2025-10-24T18:19:40.947672] [INFO ] [REMOTE    ] DLX: Fetching primary data for 2025-06.
[2025-10-24T18:19:41.747609] [INFO ] [REMOTE    ] DLR: Fetching primary data for 2025-07.
[2025-10-24T18:19:42.084356] [INFO ] [REMOTE    ] DLX: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T18:19:42.547688] [INFO ] [REMOTE    ] DLY: Fetching primary data for 2025-03.
[2025-10-24T18:19:43.347698] [INFO ] [REMOTE    ] DLX: Fetching primary data for 2025-07.
[2025-10-24T18:19:43.506912] [INFO ] [REMOTE    ] DLY: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T18:19:43.638460] [INFO ] [REMOTE    ] DLR: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T18:19:44.147681] [INFO ] [REMOTE    ] DLY: Fetching primary data for 2025-04.
[2025-10-24T18:19:44.335955] [INFO ] [REMOTE    ] DLX: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T18:19:44.870509] [INFO ] [REMOTE    ] DLY: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T18:19:44.947605] [INFO ] [REMOTE    ] DLX: Fetching primary data for 2025-08.
[2025-10-24T18:19:45.747599] [INFO ] [REMOTE    ] DMA: Fetching primary data for 2025-04.
[2025-10-24T18:19:46.217345] [INFO ] [REMOTE    ] DLX: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T18:19:46.357825] [INFO ] [REMOTE    ] DMA: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T18:19:46.547693] [INFO ] [REMOTE    ] DLR: Fetching primary data for 2025-08.
[2025-10-24T18:19:47.347745] [INFO ] [REMOTE    ] DMA: Fetching primary data for 2025-05.
[2025-10-24T18:19:48.101816] [INFO ] [REMOTE    ] DMA: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T18:19:48.147682] [INFO ] [REMOTE    ] DMA: Fetching primary data for 2025-06.
[2025-10-24T18:19:48.252521] [INFO ] [REMOTE    ] DLR: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T18:19:48.611417] [INFO ] [REMOTE    ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T18:19:48.947675] [INFO ] [REMOTE    ] DMA: Fetching primary data for 2025-07.
[2025-10-24T18:19:49.501097] [INFO ] [REMOTE    ] DMA: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T18:19:49.747678] [INFO ] [REMOTE    ] DMA: Fetching primary data for 2025-08.
[2025-10-24T18:19:50.359206] [INFO ] [REMOTE    ] DMA: Incremental fetch complete for 2025-08 (0.61 seconds).
[2025-10-24T18:19:50.547737] [INFO ] [REMOTE    ] DLR: Fetching primary data for 2025-09.
[2025-10-24T18:19:51.347688] [INFO ] [REMOTE    ] DLX: Fetching primary data for 2025-09.
[2025-10-24T18:19:52.147627] [INFO ] [REMOTE    ] DLY: Fetching primary data for 2025-05.
[2025-10-24T18:19:52.424843] [INFO ] [REMOTE    ] DLR: Incremental fetch complete for 2025-09 (1.88 seconds).
[2025-10-24T18:19:52.605792] [INFO ] [REMOTE    ] DLX: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T18:19:52.813239] [INFO ] [REMOTE    ] DLY: Incremental fetch complete for 2025-05 (0.67 seconds).
[2025-10-24T18:19:52.947625] [INFO ] [REMOTE    ] DMA: Fetching primary data for 2025-09.
[2025-10-24T18:19:53.536695] [INFO ] [REMOTE    ] DMA: Incremental fetch complete for 2025-09 (0.59 seconds).
[2025-10-24T18:19:53.747709] [INFO ] [REMOTE    ] DMA: Fetching primary data for 2025-10.
[2025-10-24T18:19:54.293576] [INFO ] [REMOTE    ] DMA: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T18:19:54.294939] [INFO ] [REMOTE    ] DMA: Full fetch complete (6572 records).
[2025-10-24T18:19:54.295008] [DEBUG] [VALIDATOR ] DMA: Validating primary data.
[2025-10-24T18:19:54.557286] [INFO ] [REMOTE    ] DLR: Fetching primary data for 2025-10.
[2025-10-24T18:19:54.684249] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present.
[2025-10-24T18:19:54.684360] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed.
[2025-10-24T18:19:54.684598] [INFO ] [MAIN      ] DMA: Fetched primary data is valid.
[2025-10-24T18:19:54.684681] [DEBUG] [LOCAL     ] DMA: Saving primary data.
[2025-10-24T18:19:54.684926] [FATAL] [LOCAL     ] DMA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:19:54.685023] [FATAL] [MAIN      ] DMA: Failed to save primary data.
[2025-10-24T18:19:54.685065] [WARN ] [MAIN      ] DMA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:19:54.685138] [INFO ] [LOCAL     ] DMA: Starting deletion of primary data.
[2025-10-24T18:19:54.685195] [DEBUG] [LOCAL     ] DMA: No primary data file found to delete.
[2025-10-24T18:19:54.685233] [INFO ] [LOCAL     ] DMA: Starting deletion of derivative data.
[2025-10-24T18:19:54.685368] [DEBUG] [LOCAL     ] DMA: Deleted derivative data file.
[2025-10-24T18:19:54.685456] [INFO ] [MAIN      ] Update Progress: 631/2366 symbols completed. DMA took 20.9s. Estimated remaining: 3h 39m 36s. Rate: 7.9 symbols/min
[2025-10-24T18:19:54.854292] [INFO ] [MAIN      ] DMB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:19:54.867010] [DEBUG] [LOCAL     ] DMB: Loaded 10554 existing records from primary storage.
[2025-10-24T18:19:54.867250] [INFO ] [MAIN      ] DMB: Loaded 10554 existing records.
[2025-10-24T18:19:55.042978] [WARN ] [MAIN      ] DMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:19:55.043194] [INFO ] [MAIN      ] DMB: Wiping existing primary data before full refresh.
[2025-10-24T18:19:55.043248] [INFO ] [LOCAL     ] DMB: Starting deletion of primary data.
[2025-10-24T18:19:55.043424] [DEBUG] [LOCAL     ] DMB: Deleted primary data file.
[2025-10-24T18:19:55.043479] [INFO ] [MAIN      ] DMB: Starting full primary refresh.
[2025-10-24T18:19:55.361822] [INFO ] [REMOTE    ] DLX: Fetching primary data for 2025-10.
[2025-10-24T18:19:55.402702] [INFO ] [REMOTE    ] DMB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:19:56.147629] [INFO ] [REMOTE    ] DLY: Fetching primary data for 2025-06.
[2025-10-24T18:19:56.434095] [INFO ] [REMOTE    ] DLR: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T18:19:56.443202] [INFO ] [REMOTE    ] DLR: Full fetch complete (74186 records).
[2025-10-24T18:19:56.443348] [DEBUG] [VALIDATOR ] DLR: Validating primary data.
[2025-10-24T18:19:56.842265] [INFO ] [REMOTE    ] DLX: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T18:19:56.869067] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present.
[2025-10-24T18:19:56.869297] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed.
[2025-10-24T18:19:56.870375] [INFO ] [MAIN      ] DLR: Fetched primary data is valid.
[2025-10-24T18:19:56.870454] [DEBUG] [LOCAL     ] DLR: Saving primary data.
[2025-10-24T18:19:56.869224] [INFO ] [REMOTE    ] DLX: Full fetch complete (41377 records).
[2025-10-24T18:19:56.870760] [DEBUG] [VALIDATOR ] DLX: Validating primary data.
[2025-10-24T18:19:56.871148] [FATAL] [LOCAL     ] DLR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:19:56.871314] [FATAL] [MAIN      ] DLR: Failed to save primary data.
[2025-10-24T18:19:56.892583] [WARN ] [MAIN      ] DLR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:19:56.908291] [INFO ] [LOCAL     ] DLR: Starting deletion of primary data.
[2025-10-24T18:19:56.943817] [DEBUG] [LOCAL     ] DLR: No primary data file found to delete.
[2025-10-24T18:19:56.943993] [INFO ] [LOCAL     ] DLR: Starting deletion of derivative data.
[2025-10-24T18:19:56.966048] [DEBUG] [LOCAL     ] DLR: Deleted derivative data file.
[2025-10-24T18:19:56.950141] [INFO ] [REMOTE    ] DMB: Fetching primary data for 2025-01.
[2025-10-24T18:19:56.975876] [INFO ] [MAIN      ] Update Progress: 632/2366 symbols completed. DLR took 40.7s. Estimated remaining: 3h 39m 13s. Rate: 7.9 symbols/min
[2025-10-24T18:19:57.219964] [INFO ] [REMOTE    ] DLY: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T18:19:57.385212] [INFO ] [MAIN      ] DMO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:19:57.509008] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present.
[2025-10-24T18:19:57.509099] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed.
[2025-10-24T18:19:57.510038] [INFO ] [MAIN      ] DLX: Fetched primary data is valid.
[2025-10-24T18:19:57.510683] [DEBUG] [LOCAL     ] DLX: Saving primary data.
[2025-10-24T18:19:57.515023] [DEBUG] [LOCAL     ] DMO: Loaded 9835 existing records from primary storage.
[2025-10-24T18:19:57.515377] [INFO ] [MAIN      ] DMO: Loaded 9835 existing records.
[2025-10-24T18:19:57.515525] [FATAL] [LOCAL     ] DLX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:19:57.558302] [FATAL] [MAIN      ] DLX: Failed to save primary data.
[2025-10-24T18:19:57.595120] [WARN ] [MAIN      ] DLX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:19:57.612054] [INFO ] [LOCAL     ] DLX: Starting deletion of primary data.
[2025-10-24T18:19:57.624826] [DEBUG] [LOCAL     ] DLX: No primary data file found to delete.
[2025-10-24T18:19:57.630733] [INFO ] [LOCAL     ] DLX: Starting deletion of derivative data.
[2025-10-24T18:19:57.630916] [DEBUG] [LOCAL     ] DLX: Deleted derivative data file.
[2025-10-24T18:19:57.631030] [INFO ] [MAIN      ] Update Progress: 633/2366 symbols completed. DLX took 35.2s. Estimated remaining: 3h 38m 47s. Rate: 7.9 symbols/min
[2025-10-24T18:19:57.757122] [INFO ] [REMOTE    ] DLY: Fetching primary data for 2025-07.
[2025-10-24T18:19:57.819914] [WARN ] [MAIN      ] DMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:19:57.824290] [INFO ] [MAIN      ] DMO: Wiping existing primary data before full refresh.
[2025-10-24T18:19:57.824613] [INFO ] [LOCAL     ] DMO: Starting deletion of primary data.
[2025-10-24T18:19:57.831296] [DEBUG] [LOCAL     ] DMO: Deleted primary data file.
[2025-10-24T18:19:57.832980] [INFO ] [MAIN      ] DMO: Starting full primary refresh.
[2025-10-24T18:19:57.862082] [INFO ] [REMOTE    ] DMB: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T18:19:57.993054] [INFO ] [MAIN      ] DNA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:19:58.312072] [INFO ] [REMOTE    ] DMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:19:58.314370] [DEBUG] [LOCAL     ] DNA: Loaded 48871 existing records from primary storage.
[2025-10-24T18:19:58.314625] [INFO ] [MAIN      ] DNA: Loaded 48871 existing records.
[2025-10-24T18:19:58.490775] [WARN ] [MAIN      ] DNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:19:58.490997] [INFO ] [MAIN      ] DNA: Wiping existing primary data before full refresh.
[2025-10-24T18:19:58.491047] [INFO ] [LOCAL     ] DNA: Starting deletion of primary data.
[2025-10-24T18:19:58.491480] [DEBUG] [LOCAL     ] DNA: Deleted primary data file.
[2025-10-24T18:19:58.491546] [INFO ] [MAIN      ] DNA: Starting full primary refresh.
[2025-10-24T18:19:58.553319] [INFO ] [REMOTE    ] DMB: Fetching primary data for 2025-02.
[2025-10-24T18:19:58.887581] [INFO ] [REMOTE    ] DNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:19:59.027468] [INFO ] [REMOTE    ] DLY: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T18:19:59.280742] [INFO ] [REMOTE    ] DMB: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T18:19:59.347686] [INFO ] [REMOTE    ] DMB: Fetching primary data for 2025-03.
[2025-10-24T18:20:00.104258] [INFO ] [REMOTE    ] DMB: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T18:20:00.147606] [INFO ] [REMOTE    ] DMB: Fetching primary data for 2025-04.
[2025-10-24T18:20:00.947682] [INFO ] [REMOTE    ] DMO: Fetching primary data for 2025-01.
[2025-10-24T18:20:01.276013] [INFO ] [REMOTE    ] DMB: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T18:20:01.747630] [INFO ] [REMOTE    ] DNA: Fetching primary data for 2025-01.
[2025-10-24T18:20:02.051218] [INFO ] [REMOTE    ] DMO: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T18:20:02.547678] [INFO ] [REMOTE    ] DMB: Fetching primary data for 2025-05.
[2025-10-24T18:20:03.347700] [INFO ] [REMOTE    ] DMO: Fetching primary data for 2025-02.
[2025-10-24T18:20:03.534638] [INFO ] [REMOTE    ] DNA: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T18:20:03.551062] [INFO ] [REMOTE    ] DMB: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T18:20:04.147611] [INFO ] [REMOTE    ] DMB: Fetching primary data for 2025-06.
[2025-10-24T18:20:04.447113] [INFO ] [REMOTE    ] DMO: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T18:20:04.947712] [INFO ] [REMOTE    ] DNA: Fetching primary data for 2025-02.
[2025-10-24T18:20:05.747690] [INFO ] [REMOTE    ] DMB: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T18:20:05.747819] [INFO ] [REMOTE    ] DMO: Fetching primary data for 2025-03.
[2025-10-24T18:20:06.547712] [INFO ] [REMOTE    ] DLY: Fetching primary data for 2025-08.
[2025-10-24T18:20:06.725947] [INFO ] [REMOTE    ] DMO: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T18:20:07.347614] [INFO ] [REMOTE    ] DMO: Fetching primary data for 2025-04.
[2025-10-24T18:20:07.450079] [INFO ] [REMOTE    ] DLY: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T18:20:07.452000] [INFO ] [REMOTE    ] DNA: Incremental fetch complete for 2025-02 (2.50 seconds).
[2025-10-24T18:20:08.147677] [INFO ] [REMOTE    ] DLY: Fetching primary data for 2025-09.
[2025-10-24T18:20:08.790385] [INFO ] [REMOTE    ] DMO: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T18:20:08.947618] [INFO ] [REMOTE    ] DNA: Fetching primary data for 2025-03.
[2025-10-24T18:20:09.278115] [INFO ] [REMOTE    ] DLY: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T18:20:09.747732] [INFO ] [REMOTE    ] DLY: Fetching primary data for 2025-10.
[2025-10-24T18:20:10.547610] [INFO ] [REMOTE    ] DMB: Fetching primary data for 2025-07.
[2025-10-24T18:20:10.945051] [INFO ] [REMOTE    ] DNA: Incremental fetch complete for 2025-03 (2.00 seconds).
[2025-10-24T18:20:11.000281] [INFO ] [REMOTE    ] DLY: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T18:20:11.005586] [INFO ] [REMOTE    ] DLY: Full fetch complete (28779 records).
[2025-10-24T18:20:11.005692] [DEBUG] [VALIDATOR ] DLY: Validating primary data.
[2025-10-24T18:20:11.349426] [INFO ] [REMOTE    ] DNA: Fetching primary data for 2025-04.
[2025-10-24T18:20:11.401042] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present.
[2025-10-24T18:20:11.401206] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed.
[2025-10-24T18:20:11.401864] [INFO ] [MAIN      ] DLY: Fetched primary data is valid.
[2025-10-24T18:20:11.401934] [DEBUG] [LOCAL     ] DLY: Saving primary data.
[2025-10-24T18:20:11.402367] [FATAL] [LOCAL     ] DLY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:20:11.402457] [FATAL] [MAIN      ] DLY: Failed to save primary data.
[2025-10-24T18:20:11.402500] [WARN ] [MAIN      ] DLY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:20:11.402536] [INFO ] [LOCAL     ] DLY: Starting deletion of primary data.
[2025-10-24T18:20:11.402594] [DEBUG] [LOCAL     ] DLY: No primary data file found to delete.
[2025-10-24T18:20:11.402632] [INFO ] [LOCAL     ] DLY: Starting deletion of derivative data.
[2025-10-24T18:20:11.402826] [DEBUG] [LOCAL     ] DLY: Deleted derivative data file.
[2025-10-24T18:20:11.402913] [INFO ] [MAIN      ] Update Progress: 634/2366 symbols completed. DLY took 38.1s. Estimated remaining: 3h 38m 56s. Rate: 7.9 symbols/min
[2025-10-24T18:20:11.498232] [INFO ] [REMOTE    ] DMB: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T18:20:11.626955] [INFO ] [MAIN      ] DNOW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:20:11.680332] [DEBUG] [LOCAL     ] DNOW: Loaded 44058 existing records from primary storage.
[2025-10-24T18:20:11.680841] [INFO ] [MAIN      ] DNOW: Loaded 44058 existing records.
[2025-10-24T18:20:11.955949] [WARN ] [MAIN      ] DNOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:20:11.956247] [INFO ] [MAIN      ] DNOW: Wiping existing primary data before full refresh.
[2025-10-24T18:20:11.956317] [INFO ] [LOCAL     ] DNOW: Starting deletion of primary data.
[2025-10-24T18:20:11.956554] [DEBUG] [LOCAL     ] DNOW: Deleted primary data file.
[2025-10-24T18:20:11.956615] [INFO ] [MAIN      ] DNOW: Starting full primary refresh.
[2025-10-24T18:20:12.154315] [INFO ] [REMOTE    ] DMB: Fetching primary data for 2025-08.
[2025-10-24T18:20:12.415386] [INFO ] [REMOTE    ] DNOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:20:12.800175] [INFO ] [REMOTE    ] DNA: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T18:20:12.947691] [INFO ] [REMOTE    ] DMO: Fetching primary data for 2025-05.
[2025-10-24T18:20:13.089280] [INFO ] [REMOTE    ] DMB: Incremental fetch complete for 2025-08 (0.93 seconds).
[2025-10-24T18:20:13.559117] [INFO ] [REMOTE    ] DMO: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T18:20:13.747627] [INFO ] [REMOTE    ] DMO: Fetching primary data for 2025-06.
[2025-10-24T18:20:14.547671] [INFO ] [REMOTE    ] DNA: Fetching primary data for 2025-05.
[2025-10-24T18:20:15.285698] [INFO ] [REMOTE    ] DMO: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T18:20:15.347635] [INFO ] [REMOTE    ] DNOW: Fetching primary data for 2025-01.
[2025-10-24T18:20:16.147728] [INFO ] [REMOTE    ] DMO: Fetching primary data for 2025-07.
[2025-10-24T18:20:16.386521] [INFO ] [REMOTE    ] DNA: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T18:20:16.771150] [INFO ] [REMOTE    ] DNOW: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T18:20:16.887247] [INFO ] [REMOTE    ] DMO: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T18:20:16.947617] [INFO ] [REMOTE    ] DMO: Fetching primary data for 2025-08.
[2025-10-24T18:20:17.542452] [INFO ] [REMOTE    ] DMO: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T18:20:17.747669] [INFO ] [REMOTE    ] DNOW: Fetching primary data for 2025-02.
[2025-10-24T18:20:18.547678] [INFO ] [REMOTE    ] DMO: Fetching primary data for 2025-09.
[2025-10-24T18:20:18.971570] [INFO ] [REMOTE    ] DNOW: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T18:20:19.347694] [INFO ] [REMOTE    ] DMB: Fetching primary data for 2025-09.
[2025-10-24T18:20:20.114241] [INFO ] [REMOTE    ] DMB: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T18:20:20.147603] [INFO ] [REMOTE    ] DNA: Fetching primary data for 2025-06.
[2025-10-24T18:20:20.947684] [INFO ] [REMOTE    ] DMB: Fetching primary data for 2025-10.
[2025-10-24T18:20:21.593816] [INFO ] [REMOTE    ] DMO: Incremental fetch complete for 2025-09 (3.05 seconds).
[2025-10-24T18:20:21.747627] [INFO ] [REMOTE    ] DMO: Fetching primary data for 2025-10.
[2025-10-24T18:20:21.992874] [INFO ] [REMOTE    ] DNA: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T18:20:22.547594] [INFO ] [REMOTE    ] DNA: Fetching primary data for 2025-07.
[2025-10-24T18:20:22.621902] [INFO ] [REMOTE    ] DMO: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T18:20:22.623975] [INFO ] [REMOTE    ] DMO: Full fetch complete (14333 records).
[2025-10-24T18:20:22.624047] [DEBUG] [VALIDATOR ] DMO: Validating primary data.
[2025-10-24T18:20:22.751515] [INFO ] [REMOTE    ] DMB: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T18:20:22.778728] [INFO ] [REMOTE    ] DMB: Full fetch complete (14586 records).
[2025-10-24T18:20:22.800343] [DEBUG] [VALIDATOR ] DMB: Validating primary data.
[2025-10-24T18:20:23.275952] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present.
[2025-10-24T18:20:23.291936] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed.
[2025-10-24T18:20:23.300465] [INFO ] [MAIN      ] DMO: Fetched primary data is valid.
[2025-10-24T18:20:23.302993] [DEBUG] [LOCAL     ] DMO: Saving primary data.
[2025-10-24T18:20:23.303280] [FATAL] [LOCAL     ] DMO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:20:23.309130] [FATAL] [MAIN      ] DMO: Failed to save primary data.
[2025-10-24T18:20:23.319603] [WARN ] [MAIN      ] DMO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:20:23.353099] [INFO ] [LOCAL     ] DMO: Starting deletion of primary data.
[2025-10-24T18:20:23.378907] [INFO ] [REMOTE    ] DNOW: Fetching primary data for 2025-03.
[2025-10-24T18:20:23.388154] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present.
[2025-10-24T18:20:23.389062] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed.
[2025-10-24T18:20:23.389354] [INFO ] [MAIN      ] DMB: Fetched primary data is valid.
[2025-10-24T18:20:23.389444] [DEBUG] [LOCAL     ] DMB: Saving primary data.
[2025-10-24T18:20:23.388050] [DEBUG] [LOCAL     ] DMO: No primary data file found to delete.
[2025-10-24T18:20:23.389859] [INFO ] [LOCAL     ] DMO: Starting deletion of derivative data.
[2025-10-24T18:20:23.389784] [FATAL] [LOCAL     ] DMB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:20:23.390141] [DEBUG] [LOCAL     ] DMO: Deleted derivative data file.
[2025-10-24T18:20:23.390331] [INFO ] [MAIN      ] Update Progress: 635/2366 symbols completed. DMO took 26.4s. Estimated remaining: 3h 39m 1s. Rate: 7.9 symbols/min
[2025-10-24T18:20:23.390079] [FATAL] [MAIN      ] DMB: Failed to save primary data.
[2025-10-24T18:20:23.390554] [WARN ] [MAIN      ] DMB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:20:23.402355] [INFO ] [LOCAL     ] DMB: Starting deletion of primary data.
[2025-10-24T18:20:23.424060] [DEBUG] [LOCAL     ] DMB: No primary data file found to delete.
[2025-10-24T18:20:23.435737] [INFO ] [LOCAL     ] DMB: Starting deletion of derivative data.
[2025-10-24T18:20:23.468692] [DEBUG] [LOCAL     ] DMB: Deleted derivative data file.
[2025-10-24T18:20:23.473946] [INFO ] [MAIN      ] Update Progress: 636/2366 symbols completed. DMB took 28.8s. Estimated remaining: 3h 38m 33s. Rate: 7.9 symbols/min
[2025-10-24T18:20:23.721833] [INFO ] [MAIN      ] DNP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:20:23.747753] [INFO ] [MAIN      ] DOC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:20:23.781063] [DEBUG] [LOCAL     ] DNP: Loaded 33207 existing records from primary storage.
[2025-10-24T18:20:23.793483] [INFO ] [MAIN      ] DNP: Loaded 33207 existing records.
[2025-10-24T18:20:23.955231] [DEBUG] [LOCAL     ] DOC: Loaded 53944 existing records from primary storage.
[2025-10-24T18:20:23.987365] [INFO ] [MAIN      ] DOC: Loaded 53944 existing records.
[2025-10-24T18:20:24.011025] [WARN ] [MAIN      ] DNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:20:24.060035] [INFO ] [MAIN      ] DNP: Wiping existing primary data before full refresh.
[2025-10-24T18:20:24.073721] [INFO ] [LOCAL     ] DNP: Starting deletion of primary data.
[2025-10-24T18:20:24.100382] [DEBUG] [LOCAL     ] DNP: Deleted primary data file.
[2025-10-24T18:20:24.121137] [INFO ] [MAIN      ] DNP: Starting full primary refresh.
[2025-10-24T18:20:24.316483] [WARN ] [MAIN      ] DOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:20:24.342788] [INFO ] [MAIN      ] DOC: Wiping existing primary data before full refresh.
[2025-10-24T18:20:24.391600] [INFO ] [LOCAL     ] DOC: Starting deletion of primary data.
[2025-10-24T18:20:24.478541] [DEBUG] [LOCAL     ] DOC: Deleted primary data file.
[2025-10-24T18:20:24.497471] [INFO ] [MAIN      ] DOC: Starting full primary refresh.
[2025-10-24T18:20:24.671667] [INFO ] [REMOTE    ] DNP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:20:24.694378] [INFO ] [REMOTE    ] DNP: Fetching primary data for 2025-01.
[2025-10-24T18:20:24.954470] [INFO ] [REMOTE    ] DNA: Incremental fetch complete for 2025-07 (2.41 seconds).
[2025-10-24T18:20:25.005750] [INFO ] [REMOTE    ] DOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:20:25.007289] [INFO ] [REMOTE    ] DOC: Fetching primary data for 2025-01.
[2025-10-24T18:20:25.035928] [INFO ] [REMOTE    ] DNOW: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T18:20:25.747679] [INFO ] [REMOTE    ] DNOW: Fetching primary data for 2025-04.
[2025-10-24T18:20:26.460793] [INFO ] [REMOTE    ] DNP: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T18:20:26.547612] [INFO ] [REMOTE    ] DNP: Fetching primary data for 2025-02.
[2025-10-24T18:20:26.912141] [INFO ] [REMOTE    ] DOC: Incremental fetch complete for 2025-01 (1.90 seconds).
[2025-10-24T18:20:27.274521] [INFO ] [REMOTE    ] DNOW: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T18:20:27.347687] [INFO ] [REMOTE    ] DNOW: Fetching primary data for 2025-05.
[2025-10-24T18:20:27.615390] [INFO ] [REMOTE    ] DNP: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T18:20:28.147689] [INFO ] [REMOTE    ] DOC: Fetching primary data for 2025-02.
[2025-10-24T18:20:28.907959] [INFO ] [REMOTE    ] DNOW: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T18:20:28.947603] [INFO ] [REMOTE    ] DNOW: Fetching primary data for 2025-06.
[2025-10-24T18:20:29.747728] [INFO ] [REMOTE    ] DNA: Fetching primary data for 2025-08.
[2025-10-24T18:20:30.001140] [INFO ] [REMOTE    ] DOC: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T18:20:30.547624] [INFO ] [REMOTE    ] DNP: Fetching primary data for 2025-03.
[2025-10-24T18:20:30.620718] [INFO ] [REMOTE    ] DNOW: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T18:20:31.347728] [INFO ] [REMOTE    ] DNOW: Fetching primary data for 2025-07.
[2025-10-24T18:20:31.563577] [INFO ] [REMOTE    ] DNA: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T18:20:31.839254] [INFO ] [REMOTE    ] DNP: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T18:20:32.147626] [INFO ] [REMOTE    ] DNA: Fetching primary data for 2025-09.
[2025-10-24T18:20:32.947636] [INFO ] [REMOTE    ] DNP: Fetching primary data for 2025-04.
[2025-10-24T18:20:33.019554] [INFO ] [REMOTE    ] DNOW: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T18:20:33.753277] [INFO ] [REMOTE    ] DOC: Fetching primary data for 2025-03.
[2025-10-24T18:20:33.777260] [INFO ] [REMOTE    ] DNA: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T18:20:34.442839] [INFO ] [REMOTE    ] DNP: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T18:20:34.547709] [INFO ] [REMOTE    ] DNA: Fetching primary data for 2025-10.
[2025-10-24T18:20:35.347679] [INFO ] [REMOTE    ] DNP: Fetching primary data for 2025-05.
[2025-10-24T18:20:35.416992] [INFO ] [REMOTE    ] DOC: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T18:20:36.147724] [INFO ] [REMOTE    ] DOC: Fetching primary data for 2025-04.
[2025-10-24T18:20:36.555347] [INFO ] [REMOTE    ] DNA: Incremental fetch complete for 2025-10 (2.01 seconds).
[2025-10-24T18:20:36.564798] [INFO ] [REMOTE    ] DNA: Full fetch complete (71196 records).
[2025-10-24T18:20:36.564991] [DEBUG] [VALIDATOR ] DNA: Validating primary data.
[2025-10-24T18:20:36.959502] [INFO ] [REMOTE    ] DNOW: Fetching primary data for 2025-08.
[2025-10-24T18:20:36.981201] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present.
[2025-10-24T18:20:36.982003] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed.
[2025-10-24T18:20:36.982917] [INFO ] [MAIN      ] DNA: Fetched primary data is valid.
[2025-10-24T18:20:36.983134] [DEBUG] [LOCAL     ] DNA: Saving primary data.
[2025-10-24T18:20:37.000370] [FATAL] [LOCAL     ] DNA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:20:37.000573] [FATAL] [MAIN      ] DNA: Failed to save primary data.
[2025-10-24T18:20:37.000668] [WARN ] [MAIN      ] DNA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:20:37.000744] [INFO ] [LOCAL     ] DNA: Starting deletion of primary data.
[2025-10-24T18:20:37.003069] [DEBUG] [LOCAL     ] DNA: No primary data file found to delete.
[2025-10-24T18:20:37.003159] [INFO ] [LOCAL     ] DNA: Starting deletion of derivative data.
[2025-10-24T18:20:37.004397] [INFO ] [REMOTE    ] DNP: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T18:20:37.011732] [DEBUG] [LOCAL     ] DNA: Deleted derivative data file.
[2025-10-24T18:20:37.012706] [INFO ] [MAIN      ] Update Progress: 637/2366 symbols completed. DNA took 39.4s. Estimated remaining: 3h 38m 41s. Rate: 7.9 symbols/min
[2025-10-24T18:20:37.747611] [INFO ] [REMOTE    ] DNP: Fetching primary data for 2025-06.
[2025-10-24T18:20:37.957389] [INFO ] [REMOTE    ] DOC: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T18:20:38.547804] [INFO ] [REMOTE    ] DOC: Fetching primary data for 2025-05.
[2025-10-24T18:20:38.705094] [INFO ] [REMOTE    ] DNOW: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T18:20:38.827480] [INFO ] [REMOTE    ] DNP: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T18:20:39.347709] [INFO ] [REMOTE    ] DNP: Fetching primary data for 2025-07.
[2025-10-24T18:20:40.147701] [INFO ] [REMOTE    ] DNOW: Fetching primary data for 2025-09.
[2025-10-24T18:20:40.508161] [INFO ] [REMOTE    ] DOC: Incremental fetch complete for 2025-05 (1.96 seconds).
[2025-10-24T18:20:40.561672] [INFO ] [REMOTE    ] DNP: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T18:20:40.947681] [INFO ] [REMOTE    ] DOC: Fetching primary data for 2025-06.
[2025-10-24T18:20:41.460786] [INFO ] [REMOTE    ] DNOW: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T18:20:41.747633] [INFO ] [REMOTE    ] DNP: Fetching primary data for 2025-08.
[2025-10-24T18:20:42.547741] [INFO ] [REMOTE    ] DNOW: Fetching primary data for 2025-10.
[2025-10-24T18:20:42.775772] [INFO ] [REMOTE    ] DOC: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T18:20:43.110925] [INFO ] [REMOTE    ] DNP: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T18:20:43.347739] [INFO ] [REMOTE    ] DNP: Fetching primary data for 2025-09.
[2025-10-24T18:20:43.976620] [INFO ] [REMOTE    ] DNOW: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T18:20:43.985305] [INFO ] [REMOTE    ] DNOW: Full fetch complete (63747 records).
[2025-10-24T18:20:43.985460] [DEBUG] [VALIDATOR ] DNOW: Validating primary data.
[2025-10-24T18:20:44.161115] [INFO ] [REMOTE    ] DOC: Fetching primary data for 2025-07.
[2025-10-24T18:20:44.379043] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present.
[2025-10-24T18:20:44.379128] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed.
[2025-10-24T18:20:44.379998] [INFO ] [MAIN      ] DNOW: Fetched primary data is valid.
[2025-10-24T18:20:44.380062] [DEBUG] [LOCAL     ] DNOW: Saving primary data.
[2025-10-24T18:20:44.380612] [FATAL] [LOCAL     ] DNOW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:20:44.380721] [FATAL] [MAIN      ] DNOW: Failed to save primary data.
[2025-10-24T18:20:44.380796] [WARN ] [MAIN      ] DNOW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:20:44.380899] [INFO ] [LOCAL     ] DNOW: Starting deletion of primary data.
[2025-10-24T18:20:44.380972] [DEBUG] [LOCAL     ] DNOW: No primary data file found to delete.
[2025-10-24T18:20:44.381010] [INFO ] [LOCAL     ] DNOW: Starting deletion of derivative data.
[2025-10-24T18:20:44.381165] [DEBUG] [LOCAL     ] DNOW: Deleted derivative data file.
[2025-10-24T18:20:44.381262] [INFO ] [MAIN      ] Update Progress: 638/2366 symbols completed. DNOW took 33.0s. Estimated remaining: 3h 38m 33s. Rate: 7.9 symbols/min
[2025-10-24T18:20:44.650902] [INFO ] [REMOTE    ] DNP: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T18:20:44.947619] [INFO ] [REMOTE    ] DNP: Fetching primary data for 2025-10.
[2025-10-24T18:20:45.808639] [INFO ] [REMOTE    ] DOC: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T18:20:45.820525] [INFO ] [REMOTE    ] DOC: Fetching primary data for 2025-08.
[2025-10-24T18:20:46.266798] [INFO ] [REMOTE    ] DNP: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T18:20:46.272920] [INFO ] [REMOTE    ] DNP: Full fetch complete (48443 records).
[2025-10-24T18:20:46.273031] [DEBUG] [VALIDATOR ] DNP: Validating primary data.
[2025-10-24T18:20:46.643202] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present.
[2025-10-24T18:20:46.643280] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed.
[2025-10-24T18:20:46.643937] [INFO ] [MAIN      ] DNP: Fetched primary data is valid.
[2025-10-24T18:20:46.643998] [DEBUG] [LOCAL     ] DNP: Saving primary data.
[2025-10-24T18:20:46.644398] [FATAL] [LOCAL     ] DNP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:20:46.644498] [FATAL] [MAIN      ] DNP: Failed to save primary data.
[2025-10-24T18:20:46.644570] [WARN ] [MAIN      ] DNP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:20:46.644695] [INFO ] [LOCAL     ] DNP: Starting deletion of primary data.
[2025-10-24T18:20:46.644772] [DEBUG] [LOCAL     ] DNP: No primary data file found to delete.
[2025-10-24T18:20:46.644814] [INFO ] [LOCAL     ] DNP: Starting deletion of derivative data.
[2025-10-24T18:20:46.644966] [DEBUG] [LOCAL     ] DNP: Deleted derivative data file.
[2025-10-24T18:20:46.645716] [INFO ] [MAIN      ] Update Progress: 639/2366 symbols completed. DNP took 23.3s. Estimated remaining: 3h 38m 11s. Rate: 7.9 symbols/min
[2025-10-24T18:20:47.586850] [INFO ] [REMOTE    ] DOC: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T18:20:47.598421] [INFO ] [REMOTE    ] DOC: Fetching primary data for 2025-09.
[2025-10-24T18:20:49.524611] [INFO ] [REMOTE    ] DOC: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T18:20:49.536517] [INFO ] [REMOTE    ] DOC: Fetching primary data for 2025-10.
[2025-10-24T18:20:51.488307] [INFO ] [REMOTE    ] DOC: Incremental fetch complete for 2025-10 (1.95 seconds).
[2025-10-24T18:20:51.497698] [INFO ] [REMOTE    ] DOC: Full fetch complete (77207 records).
[2025-10-24T18:20:51.497821] [DEBUG] [VALIDATOR ] DOC: Validating primary data.
[2025-10-24T18:20:51.498540] [FATAL] [VALIDATOR ] DOC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:20:51.498624] [FATAL] [MAIN      ] DOC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:20:51.498704] [WARN ] [MAIN      ] DOC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:20:51.498776] [INFO ] [LOCAL     ] DOC: Starting deletion of primary data.
[2025-10-24T18:20:51.498839] [DEBUG] [LOCAL     ] DOC: No primary data file found to delete.
[2025-10-24T18:20:51.498874] [INFO ] [LOCAL     ] DOC: Starting deletion of derivative data.
[2025-10-24T18:20:51.499001] [DEBUG] [LOCAL     ] DOC: Deleted derivative data file.
[2025-10-24T18:20:51.499473] [INFO ] [MAIN      ] Update Progress: 640/2366 symbols completed. DOC took 28.0s. Estimated remaining: 3h 37m 56s. Rate: 7.9 symbols/min
[2025-10-24T18:20:52.022705] [INFO ] [MAIN      ] DOCN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:20:52.193920] [INFO ] [MAIN      ] DOCS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:20:52.221034] [INFO ] [MAIN      ] DOUG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:20:52.242525] [INFO ] [MAIN      ] DOLE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:20:52.288722] [DEBUG] [LOCAL     ] DOCN: Loaded 51493 existing records from primary storage.
[2025-10-24T18:20:52.302347] [INFO ] [MAIN      ] DOCN: Loaded 51493 existing records.
[2025-10-24T18:20:52.372758] [DEBUG] [LOCAL     ] DOUG: Loaded 33959 existing records from primary storage.
[2025-10-24T18:20:52.450001] [DEBUG] [LOCAL     ] DOCS: Loaded 50676 existing records from primary storage.
[2025-10-24T18:20:52.462591] [INFO ] [MAIN      ] DOCS: Loaded 50676 existing records.
[2025-10-24T18:20:52.462426] [DEBUG] [LOCAL     ] DOLE: Loaded 39389 existing records from primary storage.
[2025-10-24T18:20:52.412361] [INFO ] [MAIN      ] DOUG: Loaded 33959 existing records.
[2025-10-24T18:20:52.515205] [INFO ] [MAIN      ] DOLE: Loaded 39389 existing records.
[2025-10-24T18:20:52.951937] [WARN ] [MAIN      ] DOCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:20:53.014060] [WARN ] [MAIN      ] DOUG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:20:53.036310] [WARN ] [MAIN      ] DOCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:20:53.041908] [INFO ] [MAIN      ] DOUG: Wiping existing primary data before full refresh.
[2025-10-24T18:20:53.052383] [INFO ] [MAIN      ] DOCN: Wiping existing primary data before full refresh.
[2025-10-24T18:20:53.058011] [INFO ] [MAIN      ] DOCS: Wiping existing primary data before full refresh.
[2025-10-24T18:20:53.052634] [INFO ] [LOCAL     ] DOUG: Starting deletion of primary data.
[2025-10-24T18:20:53.058113] [INFO ] [LOCAL     ] DOCN: Starting deletion of primary data.
[2025-10-24T18:20:53.076182] [INFO ] [LOCAL     ] DOCS: Starting deletion of primary data.
[2025-10-24T18:20:53.095156] [DEBUG] [LOCAL     ] DOCS: Deleted primary data file.
[2025-10-24T18:20:53.086943] [DEBUG] [LOCAL     ] DOUG: Deleted primary data file.
[2025-10-24T18:20:53.097205] [INFO ] [MAIN      ] DOUG: Starting full primary refresh.
[2025-10-24T18:20:53.116704] [INFO ] [MAIN      ] DOCS: Starting full primary refresh.
[2025-10-24T18:20:53.116565] [WARN ] [MAIN      ] DOLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:20:53.117074] [INFO ] [MAIN      ] DOLE: Wiping existing primary data before full refresh.
[2025-10-24T18:20:53.096926] [DEBUG] [LOCAL     ] DOCN: Deleted primary data file.
[2025-10-24T18:20:53.122487] [INFO ] [LOCAL     ] DOLE: Starting deletion of primary data.
[2025-10-24T18:20:53.130765] [INFO ] [MAIN      ] DOCN: Starting full primary refresh.
[2025-10-24T18:20:53.212588] [DEBUG] [LOCAL     ] DOLE: Deleted primary data file.
[2025-10-24T18:20:53.256428] [INFO ] [MAIN      ] DOLE: Starting full primary refresh.
[2025-10-24T18:20:54.561896] [INFO ] [REMOTE    ] DOCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:20:54.604608] [INFO ] [REMOTE    ] DOCS: Fetching primary data for 2025-01.
[2025-10-24T18:20:54.626038] [INFO ] [REMOTE    ] DOUG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:20:54.653534] [INFO ] [REMOTE    ] DOUG: Fetching primary data for 2025-01.
[2025-10-24T18:20:54.759289] [INFO ] [REMOTE    ] DOCN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:20:54.754879] [INFO ] [REMOTE    ] DOLE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:20:54.760190] [INFO ] [REMOTE    ] DOCN: Fetching primary data for 2025-01.
[2025-10-24T18:20:54.760537] [INFO ] [REMOTE    ] DOLE: Fetching primary data for 2025-01.
[2025-10-24T18:20:56.133610] [INFO ] [REMOTE    ] DOLE: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T18:20:56.141080] [INFO ] [REMOTE    ] DOLE: Fetching primary data for 2025-02.
[2025-10-24T18:20:56.195087] [INFO ] [REMOTE    ] DOUG: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T18:20:56.202918] [INFO ] [REMOTE    ] DOUG: Fetching primary data for 2025-02.
[2025-10-24T18:20:56.303783] [INFO ] [REMOTE    ] DOCS: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T18:20:56.313595] [INFO ] [REMOTE    ] DOCS: Fetching primary data for 2025-02.
[2025-10-24T18:20:56.489480] [INFO ] [REMOTE    ] DOCN: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T18:20:56.498463] [INFO ] [REMOTE    ] DOCN: Fetching primary data for 2025-02.
[2025-10-24T18:20:57.079356] [INFO ] [REMOTE    ] DOUG: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T18:20:57.086732] [INFO ] [REMOTE    ] DOUG: Fetching primary data for 2025-03.
[2025-10-24T18:20:57.312941] [INFO ] [REMOTE    ] DOLE: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T18:20:57.319809] [INFO ] [REMOTE    ] DOLE: Fetching primary data for 2025-03.
[2025-10-24T18:20:58.080140] [INFO ] [REMOTE    ] DOCN: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T18:20:58.090029] [INFO ] [REMOTE    ] DOCN: Fetching primary data for 2025-03.
[2025-10-24T18:20:58.140069] [INFO ] [REMOTE    ] DOUG: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T18:20:58.148049] [INFO ] [REMOTE    ] DOUG: Fetching primary data for 2025-04.
[2025-10-24T18:20:58.292451] [INFO ] [REMOTE    ] DOCS: Incremental fetch complete for 2025-02 (1.98 seconds).
[2025-10-24T18:20:58.302747] [INFO ] [REMOTE    ] DOCS: Fetching primary data for 2025-03.
[2025-10-24T18:20:58.364143] [INFO ] [REMOTE    ] DOLE: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T18:20:58.547673] [INFO ] [REMOTE    ] DOLE: Fetching primary data for 2025-04.
[2025-10-24T18:20:59.526034] [INFO ] [REMOTE    ] DOUG: Incremental fetch complete for 2025-04 (1.38 seconds).
[2025-10-24T18:20:59.533432] [INFO ] [REMOTE    ] DOUG: Fetching primary data for 2025-05.
[2025-10-24T18:20:59.747178] [INFO ] [REMOTE    ] DOCN: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T18:20:59.932876] [INFO ] [REMOTE    ] DOLE: Incremental fetch complete for 2025-04 (1.39 seconds).
[2025-10-24T18:21:00.040251] [INFO ] [REMOTE    ] DOCS: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T18:21:00.147700] [INFO ] [REMOTE    ] DOLE: Fetching primary data for 2025-05.
[2025-10-24T18:21:00.947630] [INFO ] [REMOTE    ] DOCS: Fetching primary data for 2025-04.
[2025-10-24T18:21:01.582326] [INFO ] [REMOTE    ] DOUG: Incremental fetch complete for 2025-05 (2.05 seconds).
[2025-10-24T18:21:01.747729] [INFO ] [REMOTE    ] DOUG: Fetching primary data for 2025-06.
[2025-10-24T18:21:02.095529] [INFO ] [REMOTE    ] DOLE: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T18:21:02.547681] [INFO ] [REMOTE    ] DOCN: Fetching primary data for 2025-04.
[2025-10-24T18:21:03.347667] [INFO ] [REMOTE    ] DOLE: Fetching primary data for 2025-06.
[2025-10-24T18:21:03.891268] [INFO ] [REMOTE    ] DOCS: Incremental fetch complete for 2025-04 (2.94 seconds).
[2025-10-24T18:21:04.147726] [INFO ] [REMOTE    ] DOCS: Fetching primary data for 2025-05.
[2025-10-24T18:21:04.196097] [INFO ] [REMOTE    ] DOUG: Incremental fetch complete for 2025-06 (2.45 seconds).
[2025-10-24T18:21:04.646500] [INFO ] [REMOTE    ] DOCN: Incremental fetch complete for 2025-04 (2.10 seconds).
[2025-10-24T18:21:04.752160] [INFO ] [REMOTE    ] DOLE: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T18:21:04.947718] [INFO ] [REMOTE    ] DOCN: Fetching primary data for 2025-05.
[2025-10-24T18:21:05.747679] [INFO ] [REMOTE    ] DOLE: Fetching primary data for 2025-07.
[2025-10-24T18:21:06.340571] [INFO ] [REMOTE    ] DOCS: Incremental fetch complete for 2025-05 (2.19 seconds).
[2025-10-24T18:21:06.547690] [INFO ] [REMOTE    ] DOCS: Fetching primary data for 2025-06.
[2025-10-24T18:21:07.349956] [INFO ] [REMOTE    ] DOUG: Fetching primary data for 2025-07.
[2025-10-24T18:21:07.354352] [INFO ] [REMOTE    ] DOLE: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T18:21:07.827040] [INFO ] [REMOTE    ] DOCN: Incremental fetch complete for 2025-05 (2.88 seconds).
[2025-10-24T18:21:08.147676] [INFO ] [REMOTE    ] DOCN: Fetching primary data for 2025-06.
[2025-10-24T18:21:08.445195] [INFO ] [REMOTE    ] DOCS: Incremental fetch complete for 2025-06 (1.90 seconds).
[2025-10-24T18:21:08.947761] [INFO ] [REMOTE    ] DOLE: Fetching primary data for 2025-08.
[2025-10-24T18:21:08.984632] [INFO ] [REMOTE    ] DOUG: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T18:21:09.747754] [INFO ] [REMOTE    ] DOCS: Fetching primary data for 2025-07.
[2025-10-24T18:21:09.846155] [INFO ] [REMOTE    ] DOCN: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T18:21:10.533603] [INFO ] [REMOTE    ] DOLE: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T18:21:10.547598] [INFO ] [REMOTE    ] DOLE: Fetching primary data for 2025-09.
[2025-10-24T18:21:11.347734] [INFO ] [REMOTE    ] DOUG: Fetching primary data for 2025-08.
[2025-10-24T18:21:11.498495] [INFO ] [REMOTE    ] DOCS: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T18:21:11.991059] [INFO ] [REMOTE    ] DOLE: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T18:21:12.147703] [INFO ] [REMOTE    ] DOCS: Fetching primary data for 2025-08.
[2025-10-24T18:21:12.565583] [INFO ] [REMOTE    ] DOUG: Incremental fetch complete for 2025-08 (1.22 seconds).
[2025-10-24T18:21:12.947762] [INFO ] [REMOTE    ] DOLE: Fetching primary data for 2025-10.
[2025-10-24T18:21:13.747684] [INFO ] [REMOTE    ] DOUG: Fetching primary data for 2025-09.
[2025-10-24T18:21:13.895956] [INFO ] [REMOTE    ] DOCS: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T18:21:14.199212] [INFO ] [REMOTE    ] DOLE: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T18:21:14.208449] [INFO ] [REMOTE    ] DOLE: Full fetch complete (54630 records).
[2025-10-24T18:21:14.208605] [DEBUG] [VALIDATOR ] DOLE: Validating primary data.
[2025-10-24T18:21:14.552867] [INFO ] [REMOTE    ] DOCN: Fetching primary data for 2025-07.
[2025-10-24T18:21:14.640808] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present.
[2025-10-24T18:21:14.640968] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed.
[2025-10-24T18:21:14.641930] [INFO ] [MAIN      ] DOLE: Fetched primary data is valid.
[2025-10-24T18:21:14.641996] [DEBUG] [LOCAL     ] DOLE: Saving primary data.
[2025-10-24T18:21:14.642768] [FATAL] [LOCAL     ] DOLE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:21:14.642860] [FATAL] [MAIN      ] DOLE: Failed to save primary data.
[2025-10-24T18:21:14.642906] [WARN ] [MAIN      ] DOLE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:21:14.642948] [INFO ] [LOCAL     ] DOLE: Starting deletion of primary data.
[2025-10-24T18:21:14.643010] [DEBUG] [LOCAL     ] DOLE: No primary data file found to delete.
[2025-10-24T18:21:14.643052] [INFO ] [LOCAL     ] DOLE: Starting deletion of derivative data.
[2025-10-24T18:21:14.643235] [DEBUG] [LOCAL     ] DOLE: Deleted derivative data file.
[2025-10-24T18:21:14.643942] [INFO ] [MAIN      ] Update Progress: 641/2366 symbols completed. DOLE took 23.1s. Estimated remaining: 3h 38m 30s. Rate: 7.9 symbols/min
[2025-10-24T18:21:14.831439] [INFO ] [MAIN      ] DOV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:21:14.897929] [DEBUG] [LOCAL     ] DOV: Loaded 45957 existing records from primary storage.
[2025-10-24T18:21:14.898441] [INFO ] [MAIN      ] DOV: Loaded 45957 existing records.
[2025-10-24T18:21:15.085217] [WARN ] [MAIN      ] DOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:21:15.085465] [INFO ] [MAIN      ] DOV: Wiping existing primary data before full refresh.
[2025-10-24T18:21:15.085517] [INFO ] [LOCAL     ] DOV: Starting deletion of primary data.
[2025-10-24T18:21:15.085766] [DEBUG] [LOCAL     ] DOV: Deleted primary data file.
[2025-10-24T18:21:15.085821] [INFO ] [MAIN      ] DOV: Starting full primary refresh.
[2025-10-24T18:21:15.357517] [INFO ] [REMOTE    ] DOUG: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T18:21:15.357595] [INFO ] [REMOTE    ] DOCS: Fetching primary data for 2025-09.
[2025-10-24T18:21:15.481219] [INFO ] [REMOTE    ] DOV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:21:16.147668] [INFO ] [REMOTE    ] DOUG: Fetching primary data for 2025-10.
[2025-10-24T18:21:16.250042] [INFO ] [REMOTE    ] DOCN: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T18:21:16.947639] [INFO ] [REMOTE    ] DOCN: Fetching primary data for 2025-08.
[2025-10-24T18:21:17.071771] [INFO ] [REMOTE    ] DOCS: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T18:21:17.431563] [INFO ] [REMOTE    ] DOUG: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T18:21:17.437004] [INFO ] [REMOTE    ] DOUG: Full fetch complete (49727 records).
[2025-10-24T18:21:17.437109] [DEBUG] [VALIDATOR ] DOUG: Validating primary data.
[2025-10-24T18:21:17.750871] [INFO ] [REMOTE    ] DOCS: Fetching primary data for 2025-10.
[2025-10-24T18:21:17.838779] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present.
[2025-10-24T18:21:17.838854] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed.
[2025-10-24T18:21:17.839521] [INFO ] [MAIN      ] DOUG: Fetched primary data is valid.
[2025-10-24T18:21:17.839564] [DEBUG] [LOCAL     ] DOUG: Saving primary data.
[2025-10-24T18:21:17.840187] [FATAL] [LOCAL     ] DOUG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:21:17.840273] [FATAL] [MAIN      ] DOUG: Failed to save primary data.
[2025-10-24T18:21:17.840315] [WARN ] [MAIN      ] DOUG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:21:17.840374] [INFO ] [LOCAL     ] DOUG: Starting deletion of primary data.
[2025-10-24T18:21:17.840431] [DEBUG] [LOCAL     ] DOUG: No primary data file found to delete.
[2025-10-24T18:21:17.840466] [INFO ] [LOCAL     ] DOUG: Starting deletion of derivative data.
[2025-10-24T18:21:17.840863] [DEBUG] [LOCAL     ] DOUG: Deleted derivative data file.
[2025-10-24T18:21:17.841365] [INFO ] [MAIN      ] Update Progress: 642/2366 symbols completed. DOUG took 26.3s. Estimated remaining: 3h 38m 11s. Rate: 7.9 symbols/min
[2025-10-24T18:21:18.012515] [INFO ] [MAIN      ] DOW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:21:18.066731] [DEBUG] [LOCAL     ] DOW: Loaded 54123 existing records from primary storage.
[2025-10-24T18:21:18.067034] [INFO ] [MAIN      ] DOW: Loaded 54123 existing records.
[2025-10-24T18:21:18.241029] [WARN ] [MAIN      ] DOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:21:18.241245] [INFO ] [MAIN      ] DOW: Wiping existing primary data before full refresh.
[2025-10-24T18:21:18.241291] [INFO ] [LOCAL     ] DOW: Starting deletion of primary data.
[2025-10-24T18:21:18.241499] [DEBUG] [LOCAL     ] DOW: Deleted primary data file.
[2025-10-24T18:21:18.241535] [INFO ] [MAIN      ] DOW: Starting full primary refresh.
[2025-10-24T18:21:18.552009] [INFO ] [REMOTE    ] DOV: Fetching primary data for 2025-01.
[2025-10-24T18:21:18.590720] [INFO ] [REMOTE    ] DOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:21:18.881326] [INFO ] [REMOTE    ] DOCN: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T18:21:19.199934] [INFO ] [REMOTE    ] DOCS: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T18:21:19.208382] [INFO ] [REMOTE    ] DOCS: Full fetch complete (73619 records).
[2025-10-24T18:21:19.208503] [DEBUG] [VALIDATOR ] DOCS: Validating primary data.
[2025-10-24T18:21:19.351260] [INFO ] [REMOTE    ] DOCN: Fetching primary data for 2025-09.
[2025-10-24T18:21:19.595202] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present.
[2025-10-24T18:21:19.595278] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed.
[2025-10-24T18:21:19.596126] [INFO ] [MAIN      ] DOCS: Fetched primary data is valid.
[2025-10-24T18:21:19.596187] [DEBUG] [LOCAL     ] DOCS: Saving primary data.
[2025-10-24T18:21:19.596746] [FATAL] [LOCAL     ] DOCS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:21:19.596833] [FATAL] [MAIN      ] DOCS: Failed to save primary data.
[2025-10-24T18:21:19.596874] [WARN ] [MAIN      ] DOCS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:21:19.596907] [INFO ] [LOCAL     ] DOCS: Starting deletion of primary data.
[2025-10-24T18:21:19.596957] [DEBUG] [LOCAL     ] DOCS: No primary data file found to delete.
[2025-10-24T18:21:19.596991] [INFO ] [LOCAL     ] DOCS: Starting deletion of derivative data.
[2025-10-24T18:21:19.597142] [DEBUG] [LOCAL     ] DOCS: Deleted derivative data file.
[2025-10-24T18:21:19.597665] [INFO ] [MAIN      ] Update Progress: 643/2366 symbols completed. DOCS took 28.1s. Estimated remaining: 3h 37m 48s. Rate: 7.9 symbols/min
[2025-10-24T18:21:19.762506] [INFO ] [MAIN      ] DPG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:21:19.779049] [DEBUG] [LOCAL     ] DPG: Loaded 13421 existing records from primary storage.
[2025-10-24T18:21:19.779281] [INFO ] [MAIN      ] DPG: Loaded 13421 existing records.
[2025-10-24T18:21:19.951668] [WARN ] [MAIN      ] DPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:21:19.951885] [INFO ] [MAIN      ] DPG: Wiping existing primary data before full refresh.
[2025-10-24T18:21:19.951931] [INFO ] [LOCAL     ] DPG: Starting deletion of primary data.
[2025-10-24T18:21:19.952112] [DEBUG] [LOCAL     ] DPG: Deleted primary data file.
[2025-10-24T18:21:19.952173] [INFO ] [MAIN      ] DPG: Starting full primary refresh.
[2025-10-24T18:21:20.166556] [INFO ] [REMOTE    ] DOW: Fetching primary data for 2025-01.
[2025-10-24T18:21:20.307791] [INFO ] [REMOTE    ] DPG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:21:20.503898] [INFO ] [REMOTE    ] DOV: Incremental fetch complete for 2025-01 (1.95 seconds).
[2025-10-24T18:21:20.774605] [INFO ] [REMOTE    ] DOCN: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T18:21:20.947630] [INFO ] [REMOTE    ] DOCN: Fetching primary data for 2025-10.
[2025-10-24T18:21:21.747751] [INFO ] [REMOTE    ] DOV: Fetching primary data for 2025-02.
[2025-10-24T18:21:22.110839] [INFO ] [REMOTE    ] DOW: Incremental fetch complete for 2025-01 (1.94 seconds).
[2025-10-24T18:21:22.547634] [INFO ] [REMOTE    ] DOW: Fetching primary data for 2025-02.
[2025-10-24T18:21:22.876121] [INFO ] [REMOTE    ] DOCN: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T18:21:22.886250] [INFO ] [REMOTE    ] DOCN: Full fetch complete (73061 records).
[2025-10-24T18:21:22.886390] [DEBUG] [VALIDATOR ] DOCN: Validating primary data.
[2025-10-24T18:21:23.298345] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present.
[2025-10-24T18:21:23.309951] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed.
[2025-10-24T18:21:23.316251] [INFO ] [MAIN      ] DOCN: Fetched primary data is valid.
[2025-10-24T18:21:23.316348] [DEBUG] [LOCAL     ] DOCN: Saving primary data.
[2025-10-24T18:21:23.326920] [FATAL] [LOCAL     ] DOCN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:21:23.329696] [FATAL] [MAIN      ] DOCN: Failed to save primary data.
[2025-10-24T18:21:23.330393] [WARN ] [MAIN      ] DOCN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:21:23.331478] [INFO ] [LOCAL     ] DOCN: Starting deletion of primary data.
[2025-10-24T18:21:23.331375] [INFO ] [REMOTE    ] DOV: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T18:21:23.331714] [DEBUG] [LOCAL     ] DOCN: No primary data file found to delete.
[2025-10-24T18:21:23.339854] [INFO ] [LOCAL     ] DOCN: Starting deletion of derivative data.
[2025-10-24T18:21:23.340660] [DEBUG] [LOCAL     ] DOCN: Deleted derivative data file.
[2025-10-24T18:21:23.341337] [INFO ] [MAIN      ] Update Progress: 644/2366 symbols completed. DOCN took 31.8s. Estimated remaining: 3h 37m 30s. Rate: 7.9 symbols/min
[2025-10-24T18:21:23.352839] [INFO ] [REMOTE    ] DOV: Fetching primary data for 2025-03.
[2025-10-24T18:21:23.513485] [INFO ] [MAIN      ] DQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:21:23.555920] [DEBUG] [LOCAL     ] DQ: Loaded 44070 existing records from primary storage.
[2025-10-24T18:21:23.556212] [INFO ] [MAIN      ] DQ: Loaded 44070 existing records.
[2025-10-24T18:21:23.740974] [WARN ] [MAIN      ] DQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:21:23.742097] [INFO ] [MAIN      ] DQ: Wiping existing primary data before full refresh.
[2025-10-24T18:21:23.742158] [INFO ] [LOCAL     ] DQ: Starting deletion of primary data.
[2025-10-24T18:21:23.742980] [DEBUG] [LOCAL     ] DQ: Deleted primary data file.
[2025-10-24T18:21:23.743038] [INFO ] [MAIN      ] DQ: Starting full primary refresh.
[2025-10-24T18:21:24.107729] [INFO ] [REMOTE    ] DQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:21:24.147676] [INFO ] [REMOTE    ] DPG: Fetching primary data for 2025-01.
[2025-10-24T18:21:24.291873] [INFO ] [REMOTE    ] DOW: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T18:21:24.947690] [INFO ] [REMOTE    ] DOW: Fetching primary data for 2025-03.
[2025-10-24T18:21:25.029028] [INFO ] [REMOTE    ] DOV: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T18:21:25.047713] [INFO ] [REMOTE    ] DPG: Incremental fetch complete for 2025-01 (0.90 seconds).
[2025-10-24T18:21:25.747777] [INFO ] [REMOTE    ] DOV: Fetching primary data for 2025-04.
[2025-10-24T18:21:26.547614] [INFO ] [REMOTE    ] DQ: Fetching primary data for 2025-01.
[2025-10-24T18:21:26.965478] [INFO ] [REMOTE    ] DOW: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T18:21:27.347716] [INFO ] [REMOTE    ] DPG: Fetching primary data for 2025-02.
[2025-10-24T18:21:27.450934] [INFO ] [REMOTE    ] DOV: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T18:21:28.110533] [INFO ] [REMOTE    ] DQ: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T18:21:28.127098] [INFO ] [REMOTE    ] DPG: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T18:21:28.147617] [INFO ] [REMOTE    ] DPG: Fetching primary data for 2025-03.
[2025-10-24T18:21:28.947636] [INFO ] [REMOTE    ] DOV: Fetching primary data for 2025-05.
[2025-10-24T18:21:28.992972] [INFO ] [REMOTE    ] DPG: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T18:21:29.747703] [INFO ] [REMOTE    ] DOW: Fetching primary data for 2025-04.
[2025-10-24T18:21:30.547695] [INFO ] [REMOTE    ] DQ: Fetching primary data for 2025-02.
[2025-10-24T18:21:30.648971] [INFO ] [REMOTE    ] DOV: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T18:21:31.347725] [INFO ] [REMOTE    ] DPG: Fetching primary data for 2025-04.
[2025-10-24T18:21:31.814318] [INFO ] [REMOTE    ] DOW: Incremental fetch complete for 2025-04 (2.07 seconds).
[2025-10-24T18:21:32.147667] [INFO ] [REMOTE    ] DOW: Fetching primary data for 2025-05.
[2025-10-24T18:21:32.232923] [INFO ] [REMOTE    ] DQ: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T18:21:32.259079] [INFO ] [REMOTE    ] DPG: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T18:21:32.947671] [INFO ] [REMOTE    ] DOV: Fetching primary data for 2025-06.
[2025-10-24T18:21:33.747679] [INFO ] [REMOTE    ] DPG: Fetching primary data for 2025-05.
[2025-10-24T18:21:34.226494] [INFO ] [REMOTE    ] DOW: Incremental fetch complete for 2025-05 (2.08 seconds).
[2025-10-24T18:21:34.352543] [INFO ] [REMOTE    ] DOV: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T18:21:34.547674] [INFO ] [REMOTE    ] DOV: Fetching primary data for 2025-07.
[2025-10-24T18:21:34.613246] [INFO ] [REMOTE    ] DPG: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T18:21:35.347680] [INFO ] [REMOTE    ] DQ: Fetching primary data for 2025-03.
[2025-10-24T18:21:36.033252] [INFO ] [REMOTE    ] DOV: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T18:21:36.147713] [INFO ] [REMOTE    ] DOW: Fetching primary data for 2025-06.
[2025-10-24T18:21:36.835353] [INFO ] [REMOTE    ] DQ: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T18:21:36.947684] [INFO ] [REMOTE    ] DOV: Fetching primary data for 2025-08.
[2025-10-24T18:21:37.747669] [INFO ] [REMOTE    ] DPG: Fetching primary data for 2025-06.
[2025-10-24T18:21:38.155450] [INFO ] [REMOTE    ] DOW: Incremental fetch complete for 2025-06 (2.01 seconds).
[2025-10-24T18:21:38.225110] [INFO ] [REMOTE    ] DOV: Incremental fetch complete for 2025-08 (1.28 seconds).
[2025-10-24T18:21:38.547637] [INFO ] [REMOTE    ] DOV: Fetching primary data for 2025-09.
[2025-10-24T18:21:38.639278] [INFO ] [REMOTE    ] DPG: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T18:21:39.347705] [INFO ] [REMOTE    ] DOW: Fetching primary data for 2025-07.
[2025-10-24T18:21:40.005611] [INFO ] [REMOTE    ] DOV: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T18:21:40.147713] [INFO ] [REMOTE    ] DOV: Fetching primary data for 2025-10.
[2025-10-24T18:21:40.947713] [INFO ] [REMOTE    ] DQ: Fetching primary data for 2025-04.
[2025-10-24T18:21:41.295778] [INFO ] [REMOTE    ] DOW: Incremental fetch complete for 2025-07 (1.95 seconds).
[2025-10-24T18:21:41.747735] [INFO ] [REMOTE    ] DPG: Fetching primary data for 2025-07.
[2025-10-24T18:21:41.966285] [INFO ] [REMOTE    ] DOV: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T18:21:41.974903] [INFO ] [REMOTE    ] DOV: Full fetch complete (65914 records).
[2025-10-24T18:21:41.975032] [DEBUG] [VALIDATOR ] DOV: Validating primary data.
[2025-10-24T18:21:41.975788] [FATAL] [VALIDATOR ] DOV: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:21:41.975878] [FATAL] [MAIN      ] DOV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:21:41.975923] [WARN ] [MAIN      ] DOV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:21:41.975965] [INFO ] [LOCAL     ] DOV: Starting deletion of primary data.
[2025-10-24T18:21:41.976023] [DEBUG] [LOCAL     ] DOV: No primary data file found to delete.
[2025-10-24T18:21:41.976060] [INFO ] [LOCAL     ] DOV: Starting deletion of derivative data.
[2025-10-24T18:21:41.976188] [DEBUG] [LOCAL     ] DOV: Deleted derivative data file.
[2025-10-24T18:21:41.976589] [INFO ] [MAIN      ] Update Progress: 645/2366 symbols completed. DOV took 27.3s. Estimated remaining: 3h 37m 52s. Rate: 7.9 symbols/min
[2025-10-24T18:21:42.167534] [INFO ] [MAIN      ] DRD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:21:42.205556] [DEBUG] [LOCAL     ] DRD: Loaded 38203 existing records from primary storage.
[2025-10-24T18:21:42.205916] [INFO ] [MAIN      ] DRD: Loaded 38203 existing records.
[2025-10-24T18:21:42.384454] [WARN ] [MAIN      ] DRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:21:42.384620] [INFO ] [MAIN      ] DRD: Wiping existing primary data before full refresh.
[2025-10-24T18:21:42.384697] [INFO ] [LOCAL     ] DRD: Starting deletion of primary data.
[2025-10-24T18:21:42.384918] [DEBUG] [LOCAL     ] DRD: Deleted primary data file.
[2025-10-24T18:21:42.384981] [INFO ] [MAIN      ] DRD: Starting full primary refresh.
[2025-10-24T18:21:42.564053] [INFO ] [REMOTE    ] DOW: Fetching primary data for 2025-08.
[2025-10-24T18:21:42.709613] [INFO ] [REMOTE    ] DPG: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T18:21:42.791440] [INFO ] [REMOTE    ] DQ: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T18:21:42.813525] [INFO ] [REMOTE    ] DRD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:21:43.347685] [INFO ] [REMOTE    ] DQ: Fetching primary data for 2025-05.
[2025-10-24T18:21:44.147680] [INFO ] [REMOTE    ] DRD: Fetching primary data for 2025-01.
[2025-10-24T18:21:44.753951] [INFO ] [REMOTE    ] DQ: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T18:21:44.910897] [INFO ] [REMOTE    ] DOW: Incremental fetch complete for 2025-08 (2.35 seconds).
[2025-10-24T18:21:44.947662] [INFO ] [REMOTE    ] DOW: Fetching primary data for 2025-09.
[2025-10-24T18:21:45.374416] [INFO ] [REMOTE    ] DRD: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T18:21:45.747637] [INFO ] [REMOTE    ] DQ: Fetching primary data for 2025-06.
[2025-10-24T18:21:46.547700] [INFO ] [REMOTE    ] DRD: Fetching primary data for 2025-02.
[2025-10-24T18:21:47.059980] [INFO ] [REMOTE    ] DOW: Incremental fetch complete for 2025-09 (2.11 seconds).
[2025-10-24T18:21:47.126419] [INFO ] [REMOTE    ] DQ: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T18:21:47.347629] [INFO ] [REMOTE    ] DPG: Fetching primary data for 2025-08.
[2025-10-24T18:21:47.681252] [INFO ] [REMOTE    ] DRD: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T18:21:48.110853] [INFO ] [REMOTE    ] DPG: Incremental fetch complete for 2025-08 (0.76 seconds).
[2025-10-24T18:21:48.147673] [INFO ] [REMOTE    ] DQ: Fetching primary data for 2025-07.
[2025-10-24T18:21:48.947735] [INFO ] [REMOTE    ] DRD: Fetching primary data for 2025-03.
[2025-10-24T18:21:49.747723] [INFO ] [REMOTE    ] DOW: Fetching primary data for 2025-10.
[2025-10-24T18:21:49.846828] [INFO ] [REMOTE    ] DQ: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T18:21:50.546677] [INFO ] [REMOTE    ] DRD: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T18:21:50.554183] [INFO ] [REMOTE    ] DPG: Fetching primary data for 2025-09.
[2025-10-24T18:21:51.347619] [INFO ] [REMOTE    ] DRD: Fetching primary data for 2025-04.
[2025-10-24T18:21:51.468208] [INFO ] [REMOTE    ] DPG: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T18:21:52.133351] [INFO ] [REMOTE    ] DOW: Incremental fetch complete for 2025-10 (2.39 seconds).
[2025-10-24T18:21:52.143473] [INFO ] [REMOTE    ] DOW: Full fetch complete (77910 records).
[2025-10-24T18:21:52.143618] [DEBUG] [VALIDATOR ] DOW: Validating primary data.
[2025-10-24T18:21:52.156261] [INFO ] [REMOTE    ] DPG: Fetching primary data for 2025-10.
[2025-10-24T18:21:52.559335] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present.
[2025-10-24T18:21:52.559426] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed.
[2025-10-24T18:21:52.560381] [INFO ] [MAIN      ] DOW: Fetched primary data is valid.
[2025-10-24T18:21:52.560444] [DEBUG] [LOCAL     ] DOW: Saving primary data.
[2025-10-24T18:21:52.561076] [FATAL] [LOCAL     ] DOW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:21:52.561190] [FATAL] [MAIN      ] DOW: Failed to save primary data.
[2025-10-24T18:21:52.561234] [WARN ] [MAIN      ] DOW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:21:52.561296] [INFO ] [LOCAL     ] DOW: Starting deletion of primary data.
[2025-10-24T18:21:52.561356] [DEBUG] [LOCAL     ] DOW: No primary data file found to delete.
[2025-10-24T18:21:52.561391] [INFO ] [LOCAL     ] DOW: Starting deletion of derivative data.
[2025-10-24T18:21:52.561551] [DEBUG] [LOCAL     ] DOW: Deleted derivative data file.
[2025-10-24T18:21:52.562026] [INFO ] [MAIN      ] Update Progress: 646/2366 symbols completed. DOW took 34.7s. Estimated remaining: 3h 37m 52s. Rate: 7.9 symbols/min
[2025-10-24T18:21:52.730486] [INFO ] [MAIN      ] DRH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:21:52.777256] [DEBUG] [LOCAL     ] DRH: Loaded 50624 existing records from primary storage.
[2025-10-24T18:21:52.777808] [INFO ] [MAIN      ] DRH: Loaded 50624 existing records.
[2025-10-24T18:21:52.952291] [INFO ] [REMOTE    ] DQ: Fetching primary data for 2025-08.
[2025-10-24T18:21:52.973918] [WARN ] [MAIN      ] DRH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:21:52.980146] [INFO ] [MAIN      ] DRH: Wiping existing primary data before full refresh.
[2025-10-24T18:21:52.980221] [INFO ] [LOCAL     ] DRH: Starting deletion of primary data.
[2025-10-24T18:21:52.992089] [DEBUG] [LOCAL     ] DRH: Deleted primary data file.
[2025-10-24T18:21:52.994544] [INFO ] [REMOTE    ] DRD: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T18:21:52.992806] [INFO ] [MAIN      ] DRH: Starting full primary refresh.
[2025-10-24T18:21:53.217881] [INFO ] [REMOTE    ] DPG: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T18:21:53.298276] [INFO ] [REMOTE    ] DPG: Full fetch complete (19008 records).
[2025-10-24T18:21:53.317281] [DEBUG] [VALIDATOR ] DPG: Validating primary data.
[2025-10-24T18:21:53.559017] [INFO ] [REMOTE    ] DRH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:21:53.752765] [INFO ] [REMOTE    ] DRD: Fetching primary data for 2025-05.
[2025-10-24T18:21:53.826287] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present.
[2025-10-24T18:21:53.826373] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed.
[2025-10-24T18:21:53.826892] [INFO ] [MAIN      ] DPG: Fetched primary data is valid.
[2025-10-24T18:21:53.826955] [DEBUG] [LOCAL     ] DPG: Saving primary data.
[2025-10-24T18:21:53.827263] [FATAL] [LOCAL     ] DPG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:21:53.827354] [FATAL] [MAIN      ] DPG: Failed to save primary data.
[2025-10-24T18:21:53.827403] [WARN ] [MAIN      ] DPG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:21:53.827465] [INFO ] [LOCAL     ] DPG: Starting deletion of primary data.
[2025-10-24T18:21:53.827525] [DEBUG] [LOCAL     ] DPG: No primary data file found to delete.
[2025-10-24T18:21:53.827561] [INFO ] [LOCAL     ] DPG: Starting deletion of derivative data.
[2025-10-24T18:21:53.827730] [DEBUG] [LOCAL     ] DPG: Deleted derivative data file.
[2025-10-24T18:21:53.827824] [INFO ] [MAIN      ] Update Progress: 647/2366 symbols completed. DPG took 34.2s. Estimated remaining: 3h 37m 28s. Rate: 7.9 symbols/min
[2025-10-24T18:21:54.019780] [INFO ] [MAIN      ] DRI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:21:54.064685] [DEBUG] [LOCAL     ] DRI: Loaded 47825 existing records from primary storage.
[2025-10-24T18:21:54.064971] [INFO ] [MAIN      ] DRI: Loaded 47825 existing records.
[2025-10-24T18:21:54.261432] [WARN ] [MAIN      ] DRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:21:54.261637] [INFO ] [MAIN      ] DRI: Wiping existing primary data before full refresh.
[2025-10-24T18:21:54.261734] [INFO ] [LOCAL     ] DRI: Starting deletion of primary data.
[2025-10-24T18:21:54.261969] [DEBUG] [LOCAL     ] DRI: Deleted primary data file.
[2025-10-24T18:21:54.262007] [INFO ] [MAIN      ] DRI: Starting full primary refresh.
[2025-10-24T18:21:54.552806] [INFO ] [REMOTE    ] DRH: Fetching primary data for 2025-01.
[2025-10-24T18:21:54.624526] [INFO ] [REMOTE    ] DRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:21:54.690995] [INFO ] [REMOTE    ] DQ: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T18:21:55.010058] [INFO ] [REMOTE    ] DRD: Incremental fetch complete for 2025-05 (1.26 seconds).
[2025-10-24T18:21:55.347685] [INFO ] [REMOTE    ] DRD: Fetching primary data for 2025-06.
[2025-10-24T18:21:56.024340] [INFO ] [REMOTE    ] DRH: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T18:21:56.147720] [INFO ] [REMOTE    ] DQ: Fetching primary data for 2025-09.
[2025-10-24T18:21:56.868259] [INFO ] [REMOTE    ] DRD: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T18:21:56.947714] [INFO ] [REMOTE    ] DRD: Fetching primary data for 2025-07.
[2025-10-24T18:21:57.664061] [INFO ] [REMOTE    ] DQ: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T18:21:57.747689] [INFO ] [REMOTE    ] DRH: Fetching primary data for 2025-02.
[2025-10-24T18:21:58.352934] [INFO ] [REMOTE    ] DRD: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T18:21:58.547702] [INFO ] [REMOTE    ] DQ: Fetching primary data for 2025-10.
[2025-10-24T18:21:59.047520] [INFO ] [REMOTE    ] DRH: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T18:21:59.347673] [INFO ] [REMOTE    ] DRD: Fetching primary data for 2025-08.
[2025-10-24T18:22:00.140791] [INFO ] [REMOTE    ] DQ: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T18:22:00.148962] [INFO ] [REMOTE    ] DRI: Fetching primary data for 2025-01.
[2025-10-24T18:22:00.150479] [INFO ] [REMOTE    ] DQ: Full fetch complete (63621 records).
[2025-10-24T18:22:00.150572] [DEBUG] [VALIDATOR ] DQ: Validating primary data.
[2025-10-24T18:22:00.549858] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present.
[2025-10-24T18:22:00.549953] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed.
[2025-10-24T18:22:00.550763] [INFO ] [MAIN      ] DQ: Fetched primary data is valid.
[2025-10-24T18:22:00.550826] [DEBUG] [LOCAL     ] DQ: Saving primary data.
[2025-10-24T18:22:00.551416] [FATAL] [LOCAL     ] DQ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:22:00.551505] [FATAL] [MAIN      ] DQ: Failed to save primary data.
[2025-10-24T18:22:00.551546] [WARN ] [MAIN      ] DQ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:22:00.551581] [INFO ] [LOCAL     ] DQ: Starting deletion of primary data.
[2025-10-24T18:22:00.551634] [DEBUG] [LOCAL     ] DQ: No primary data file found to delete.
[2025-10-24T18:22:00.551731] [INFO ] [LOCAL     ] DQ: Starting deletion of derivative data.
[2025-10-24T18:22:00.551875] [DEBUG] [LOCAL     ] DQ: Deleted derivative data file.
[2025-10-24T18:22:00.552501] [INFO ] [MAIN      ] Update Progress: 648/2366 symbols completed. DQ took 37.2s. Estimated remaining: 3h 37m 18s. Rate: 7.9 symbols/min
[2025-10-24T18:22:00.723094] [INFO ] [MAIN      ] DRLL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:22:00.733542] [DEBUG] [LOCAL     ] DRLL: Loaded 8648 existing records from primary storage.
[2025-10-24T18:22:00.733788] [INFO ] [MAIN      ] DRLL: Loaded 8648 existing records.
[2025-10-24T18:22:00.907669] [INFO ] [REMOTE    ] DRD: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T18:22:00.948511] [INFO ] [REMOTE    ] DRH: Fetching primary data for 2025-03.
[2025-10-24T18:22:00.948410] [WARN ] [MAIN      ] DRLL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:22:00.950201] [INFO ] [MAIN      ] DRLL: Wiping existing primary data before full refresh.
[2025-10-24T18:22:00.950269] [INFO ] [LOCAL     ] DRLL: Starting deletion of primary data.
[2025-10-24T18:22:00.950441] [DEBUG] [LOCAL     ] DRLL: Deleted primary data file.
[2025-10-24T18:22:00.950542] [INFO ] [MAIN      ] DRLL: Starting full primary refresh.
[2025-10-24T18:22:01.319942] [INFO ] [REMOTE    ] DRLL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:22:01.747719] [INFO ] [REMOTE    ] DRD: Fetching primary data for 2025-09.
[2025-10-24T18:22:02.547634] [INFO ] [REMOTE    ] DRLL: Fetching primary data for 2025-01.
[2025-10-24T18:22:02.726286] [INFO ] [REMOTE    ] DRI: Incremental fetch complete for 2025-01 (2.58 seconds).
[2025-10-24T18:22:02.813400] [INFO ] [REMOTE    ] DRH: Incremental fetch complete for 2025-03 (1.86 seconds).
[2025-10-24T18:22:03.347710] [INFO ] [REMOTE    ] DRI: Fetching primary data for 2025-02.
[2025-10-24T18:22:03.544693] [INFO ] [REMOTE    ] DRD: Incremental fetch complete for 2025-09 (1.80 seconds).
[2025-10-24T18:22:03.587029] [INFO ] [REMOTE    ] DRLL: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T18:22:04.147730] [INFO ] [REMOTE    ] DRLL: Fetching primary data for 2025-02.
[2025-10-24T18:22:04.517019] [INFO ] [REMOTE    ] DRI: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T18:22:04.947635] [INFO ] [REMOTE    ] DRD: Fetching primary data for 2025-10.
[2025-10-24T18:22:05.099920] [INFO ] [REMOTE    ] DRLL: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T18:22:05.747638] [INFO ] [REMOTE    ] DRLL: Fetching primary data for 2025-03.
[2025-10-24T18:22:06.547671] [INFO ] [REMOTE    ] DRH: Fetching primary data for 2025-04.
[2025-10-24T18:22:06.756605] [INFO ] [REMOTE    ] DRLL: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T18:22:06.795060] [INFO ] [REMOTE    ] DRD: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T18:22:06.803464] [INFO ] [REMOTE    ] DRD: Full fetch complete (52405 records).
[2025-10-24T18:22:06.803564] [DEBUG] [VALIDATOR ] DRD: Validating primary data.
[2025-10-24T18:22:07.190516] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present.
[2025-10-24T18:22:07.190611] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed.
[2025-10-24T18:22:07.191326] [INFO ] [MAIN      ] DRD: Fetched primary data is valid.
[2025-10-24T18:22:07.191389] [DEBUG] [LOCAL     ] DRD: Saving primary data.
[2025-10-24T18:22:07.191857] [FATAL] [LOCAL     ] DRD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:22:07.191952] [FATAL] [MAIN      ] DRD: Failed to save primary data.
[2025-10-24T18:22:07.191994] [WARN ] [MAIN      ] DRD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:22:07.192028] [INFO ] [LOCAL     ] DRD: Starting deletion of primary data.
[2025-10-24T18:22:07.192078] [DEBUG] [LOCAL     ] DRD: No primary data file found to delete.
[2025-10-24T18:22:07.192113] [INFO ] [LOCAL     ] DRD: Starting deletion of derivative data.
[2025-10-24T18:22:07.192267] [DEBUG] [LOCAL     ] DRD: Deleted derivative data file.
[2025-10-24T18:22:07.193082] [INFO ] [MAIN      ] Update Progress: 649/2366 symbols completed. DRD took 25.2s. Estimated remaining: 3h 37m 8s. Rate: 7.9 symbols/min
[2025-10-24T18:22:07.349844] [INFO ] [REMOTE    ] DRI: Fetching primary data for 2025-03.
[2025-10-24T18:22:07.359977] [INFO ] [MAIN      ] DSL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:22:07.390424] [DEBUG] [LOCAL     ] DSL: Loaded 29120 existing records from primary storage.
[2025-10-24T18:22:07.390705] [INFO ] [MAIN      ] DSL: Loaded 29120 existing records.
[2025-10-24T18:22:07.564097] [WARN ] [MAIN      ] DSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:22:07.564383] [INFO ] [MAIN      ] DSL: Wiping existing primary data before full refresh.
[2025-10-24T18:22:07.564436] [INFO ] [LOCAL     ] DSL: Starting deletion of primary data.
[2025-10-24T18:22:07.564689] [DEBUG] [LOCAL     ] DSL: Deleted primary data file.
[2025-10-24T18:22:07.564750] [INFO ] [MAIN      ] DSL: Starting full primary refresh.
[2025-10-24T18:22:07.918719] [INFO ] [REMOTE    ] DSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:22:08.079098] [INFO ] [REMOTE    ] DRH: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T18:22:08.147670] [INFO ] [REMOTE    ] DRLL: Fetching primary data for 2025-04.
[2025-10-24T18:22:08.930367] [INFO ] [REMOTE    ] DRLL: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T18:22:08.947739] [INFO ] [REMOTE    ] DRLL: Fetching primary data for 2025-05.
[2025-10-24T18:22:09.074739] [INFO ] [REMOTE    ] DRI: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T18:22:09.695942] [INFO ] [REMOTE    ] DRLL: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T18:22:09.747703] [INFO ] [REMOTE    ] DRH: Fetching primary data for 2025-05.
[2025-10-24T18:22:10.547722] [INFO ] [REMOTE    ] DRLL: Fetching primary data for 2025-06.
[2025-10-24T18:22:11.347619] [INFO ] [REMOTE    ] DRI: Fetching primary data for 2025-04.
[2025-10-24T18:22:11.454718] [INFO ] [REMOTE    ] DRH: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T18:22:11.500628] [INFO ] [REMOTE    ] DRLL: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T18:22:12.147667] [INFO ] [REMOTE    ] DRLL: Fetching primary data for 2025-07.
[2025-10-24T18:22:12.870848] [INFO ] [REMOTE    ] DRLL: Incremental fetch complete for 2025-07 (0.72 seconds).
[2025-10-24T18:22:12.947615] [INFO ] [REMOTE    ] DRLL: Fetching primary data for 2025-08.
[2025-10-24T18:22:13.129978] [INFO ] [REMOTE    ] DRI: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T18:22:13.473120] [INFO ] [REMOTE    ] DRLL: Incremental fetch complete for 2025-08 (0.53 seconds).
[2025-10-24T18:22:13.747631] [INFO ] [REMOTE    ] DRLL: Fetching primary data for 2025-09.
[2025-10-24T18:22:14.528066] [INFO ] [REMOTE    ] DRLL: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T18:22:14.547601] [INFO ] [REMOTE    ] DRLL: Fetching primary data for 2025-10.
[2025-10-24T18:22:15.347679] [INFO ] [REMOTE    ] DRI: Fetching primary data for 2025-05.
[2025-10-24T18:22:15.363311] [INFO ] [REMOTE    ] DRLL: Incremental fetch complete for 2025-10 (0.82 seconds).
[2025-10-24T18:22:15.365954] [INFO ] [REMOTE    ] DRLL: Full fetch complete (14447 records).
[2025-10-24T18:22:15.366131] [DEBUG] [VALIDATOR ] DRLL: Validating primary data.
[2025-10-24T18:22:15.750285] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present.
[2025-10-24T18:22:15.750364] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed.
[2025-10-24T18:22:15.750715] [INFO ] [MAIN      ] DRLL: Fetched primary data is valid.
[2025-10-24T18:22:15.750778] [DEBUG] [LOCAL     ] DRLL: Saving primary data.
[2025-10-24T18:22:15.751144] [FATAL] [LOCAL     ] DRLL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:22:15.751219] [FATAL] [MAIN      ] DRLL: Failed to save primary data.
[2025-10-24T18:22:15.751293] [WARN ] [MAIN      ] DRLL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:22:15.751378] [INFO ] [LOCAL     ] DRLL: Starting deletion of primary data.
[2025-10-24T18:22:15.751455] [DEBUG] [LOCAL     ] DRLL: No primary data file found to delete.
[2025-10-24T18:22:15.751510] [INFO ] [LOCAL     ] DRLL: Starting deletion of derivative data.
[2025-10-24T18:22:15.751733] [DEBUG] [LOCAL     ] DRLL: Deleted derivative data file.
[2025-10-24T18:22:15.751862] [INFO ] [MAIN      ] Update Progress: 650/2366 symbols completed. DRLL took 15.2s. Estimated remaining: 3h 37m 3s. Rate: 7.9 symbols/min
[2025-10-24T18:22:15.939101] [INFO ] [MAIN      ] DSM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:22:15.956191] [DEBUG] [LOCAL     ] DSM: Loaded 14223 existing records from primary storage.
[2025-10-24T18:22:15.956391] [INFO ] [MAIN      ] DSM: Loaded 14223 existing records.
[2025-10-24T18:22:16.152911] [INFO ] [REMOTE    ] DRH: Fetching primary data for 2025-06.
[2025-10-24T18:22:16.170346] [WARN ] [MAIN      ] DSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:22:16.170679] [INFO ] [MAIN      ] DSM: Wiping existing primary data before full refresh.
[2025-10-24T18:22:16.170745] [INFO ] [LOCAL     ] DSM: Starting deletion of primary data.
[2025-10-24T18:22:16.170923] [DEBUG] [LOCAL     ] DSM: Deleted primary data file.
[2025-10-24T18:22:16.170967] [INFO ] [MAIN      ] DSM: Starting full primary refresh.
[2025-10-24T18:22:16.539106] [INFO ] [REMOTE    ] DSM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:22:16.947633] [INFO ] [REMOTE    ] DSM: Fetching primary data for 2025-01.
[2025-10-24T18:22:17.051971] [INFO ] [REMOTE    ] DRI: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T18:22:17.638016] [INFO ] [REMOTE    ] DRH: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T18:22:17.747600] [INFO ] [REMOTE    ] DRI: Fetching primary data for 2025-06.
[2025-10-24T18:22:18.164021] [INFO ] [REMOTE    ] DSM: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T18:22:18.547609] [INFO ] [REMOTE    ] DSM: Fetching primary data for 2025-02.
[2025-10-24T18:22:19.347719] [INFO ] [REMOTE    ] DSL: Fetching primary data for 2025-01.
[2025-10-24T18:22:19.492949] [INFO ] [REMOTE    ] DRI: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T18:22:19.667520] [INFO ] [REMOTE    ] DSM: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T18:22:20.147725] [INFO ] [REMOTE    ] DRH: Fetching primary data for 2025-07.
[2025-10-24T18:22:20.583021] [INFO ] [REMOTE    ] DSL: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T18:22:20.947720] [INFO ] [REMOTE    ] DRI: Fetching primary data for 2025-07.
[2025-10-24T18:22:21.711105] [INFO ] [REMOTE    ] DRH: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T18:22:21.747702] [INFO ] [REMOTE    ] DSM: Fetching primary data for 2025-03.
[2025-10-24T18:22:22.412816] [INFO ] [REMOTE    ] DRI: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T18:22:22.547727] [INFO ] [REMOTE    ] DRI: Fetching primary data for 2025-08.
[2025-10-24T18:22:22.880808] [INFO ] [REMOTE    ] DSM: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T18:22:23.347806] [INFO ] [REMOTE    ] DRH: Fetching primary data for 2025-08.
[2025-10-24T18:22:24.093205] [INFO ] [REMOTE    ] DRI: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T18:22:24.147686] [INFO ] [REMOTE    ] DRI: Fetching primary data for 2025-09.
[2025-10-24T18:22:24.911570] [INFO ] [REMOTE    ] DRH: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T18:22:24.947631] [INFO ] [REMOTE    ] DRH: Fetching primary data for 2025-09.
[2025-10-24T18:22:25.404428] [INFO ] [REMOTE    ] DRI: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T18:22:25.747724] [INFO ] [REMOTE    ] DSM: Fetching primary data for 2025-04.
[2025-10-24T18:22:26.547618] [INFO ] [REMOTE    ] DSL: Fetching primary data for 2025-02.
[2025-10-24T18:22:26.551052] [INFO ] [REMOTE    ] DRH: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T18:22:26.766869] [INFO ] [REMOTE    ] DSM: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T18:22:27.347710] [INFO ] [REMOTE    ] DSM: Fetching primary data for 2025-05.
[2025-10-24T18:22:27.738320] [INFO ] [REMOTE    ] DSL: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T18:22:28.147730] [INFO ] [REMOTE    ] DSL: Fetching primary data for 2025-03.
[2025-10-24T18:22:28.263523] [INFO ] [REMOTE    ] DSM: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T18:22:28.947728] [INFO ] [REMOTE    ] DRI: Fetching primary data for 2025-10.
[2025-10-24T18:22:29.134565] [INFO ] [REMOTE    ] DSL: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T18:22:29.747745] [INFO ] [REMOTE    ] DSL: Fetching primary data for 2025-04.
[2025-10-24T18:22:30.547757] [INFO ] [REMOTE    ] DRH: Fetching primary data for 2025-10.
[2025-10-24T18:22:30.906341] [INFO ] [REMOTE    ] DRI: Incremental fetch complete for 2025-10 (1.96 seconds).
[2025-10-24T18:22:30.915298] [INFO ] [REMOTE    ] DRI: Full fetch complete (69425 records).
[2025-10-24T18:22:30.915422] [DEBUG] [VALIDATOR ] DRI: Validating primary data.
[2025-10-24T18:22:31.331718] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present.
[2025-10-24T18:22:31.331814] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed.
[2025-10-24T18:22:31.332965] [INFO ] [MAIN      ] DRI: Fetched primary data is valid.
[2025-10-24T18:22:31.333141] [DEBUG] [LOCAL     ] DRI: Saving primary data.
[2025-10-24T18:22:31.350668] [INFO ] [REMOTE    ] DSM: Fetching primary data for 2025-06.
[2025-10-24T18:22:31.340816] [FATAL] [LOCAL     ] DRI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:22:31.353018] [FATAL] [MAIN      ] DRI: Failed to save primary data.
[2025-10-24T18:22:31.355868] [INFO ] [REMOTE    ] DSL: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T18:22:31.354491] [WARN ] [MAIN      ] DRI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:22:31.363303] [INFO ] [LOCAL     ] DRI: Starting deletion of primary data.
[2025-10-24T18:22:31.364200] [DEBUG] [LOCAL     ] DRI: No primary data file found to delete.
[2025-10-24T18:22:31.364798] [INFO ] [LOCAL     ] DRI: Starting deletion of derivative data.
[2025-10-24T18:22:31.364942] [DEBUG] [LOCAL     ] DRI: Deleted derivative data file.
[2025-10-24T18:22:31.365236] [INFO ] [MAIN      ] Update Progress: 651/2366 symbols completed. DRI took 37.5s. Estimated remaining: 3h 37m 16s. Rate: 7.9 symbols/min
[2025-10-24T18:22:31.535689] [INFO ] [MAIN      ] DSMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:22:31.540678] [DEBUG] [LOCAL     ] DSMC: Loaded 1780 existing records from primary storage.
[2025-10-24T18:22:31.540871] [INFO ] [MAIN      ] DSMC: Loaded 1780 existing records.
[2025-10-24T18:22:31.717112] [WARN ] [MAIN      ] DSMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:22:31.717380] [INFO ] [MAIN      ] DSMC: Wiping existing primary data before full refresh.
[2025-10-24T18:22:31.717438] [INFO ] [LOCAL     ] DSMC: Starting deletion of primary data.
[2025-10-24T18:22:31.717596] [DEBUG] [LOCAL     ] DSMC: Deleted primary data file.
[2025-10-24T18:22:31.717635] [INFO ] [MAIN      ] DSMC: Starting full primary refresh.
[2025-10-24T18:22:32.076802] [INFO ] [REMOTE    ] DSMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:22:32.147620] [INFO ] [REMOTE    ] DSMC: Fetching primary data for 2025-01.
[2025-10-24T18:22:32.187382] [INFO ] [REMOTE    ] DRH: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T18:22:32.197790] [INFO ] [REMOTE    ] DRH: Full fetch complete (71926 records).
[2025-10-24T18:22:32.197999] [DEBUG] [VALIDATOR ] DRH: Validating primary data.
[2025-10-24T18:22:32.443033] [INFO ] [REMOTE    ] DSM: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T18:22:32.647572] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present.
[2025-10-24T18:22:32.647690] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed.
[2025-10-24T18:22:32.648666] [INFO ] [MAIN      ] DRH: Fetched primary data is valid.
[2025-10-24T18:22:32.648732] [DEBUG] [LOCAL     ] DRH: Saving primary data.
[2025-10-24T18:22:32.649358] [FATAL] [LOCAL     ] DRH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:22:32.649485] [FATAL] [MAIN      ] DRH: Failed to save primary data.
[2025-10-24T18:22:32.649553] [WARN ] [MAIN      ] DRH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:22:32.649626] [INFO ] [LOCAL     ] DRH: Starting deletion of primary data.
[2025-10-24T18:22:32.649742] [DEBUG] [LOCAL     ] DRH: No primary data file found to delete.
[2025-10-24T18:22:32.649792] [INFO ] [LOCAL     ] DRH: Starting deletion of derivative data.
[2025-10-24T18:22:32.649941] [DEBUG] [LOCAL     ] DRH: Deleted derivative data file.
[2025-10-24T18:22:32.650161] [INFO ] [MAIN      ] Update Progress: 652/2366 symbols completed. DRH took 40.1s. Estimated remaining: 3h 36m 52s. Rate: 7.9 symbols/min
[2025-10-24T18:22:32.749946] [INFO ] [REMOTE    ] DSMC: Incremental fetch complete for 2025-01 (0.60 seconds).
[2025-10-24T18:22:32.846529] [INFO ] [MAIN      ] DSU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:22:32.870582] [DEBUG] [LOCAL     ] DSU: Loaded 22973 existing records from primary storage.
[2025-10-24T18:22:32.870857] [INFO ] [MAIN      ] DSU: Loaded 22973 existing records.
[2025-10-24T18:22:32.953501] [INFO ] [REMOTE    ] DSM: Fetching primary data for 2025-07.
[2025-10-24T18:22:33.052009] [WARN ] [MAIN      ] DSU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:22:33.052265] [INFO ] [MAIN      ] DSU: Wiping existing primary data before full refresh.
[2025-10-24T18:22:33.052313] [INFO ] [LOCAL     ] DSU: Starting deletion of primary data.
[2025-10-24T18:22:33.052503] [DEBUG] [LOCAL     ] DSU: Deleted primary data file.
[2025-10-24T18:22:33.052558] [INFO ] [MAIN      ] DSU: Starting full primary refresh.
[2025-10-24T18:22:33.447044] [INFO ] [REMOTE    ] DSU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:22:33.747693] [INFO ] [REMOTE    ] DSL: Fetching primary data for 2025-05.
[2025-10-24T18:22:33.798975] [INFO ] [REMOTE    ] DSM: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T18:22:34.547688] [INFO ] [REMOTE    ] DSU: Fetching primary data for 2025-01.
[2025-10-24T18:22:34.815490] [INFO ] [REMOTE    ] DSL: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T18:22:35.347682] [INFO ] [REMOTE    ] DSMC: Fetching primary data for 2025-02.
[2025-10-24T18:22:35.439704] [INFO ] [REMOTE    ] DSU: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T18:22:35.771099] [INFO ] [REMOTE    ] DSMC: Incremental fetch complete for 2025-02 (0.42 seconds).
[2025-10-24T18:22:36.147722] [INFO ] [REMOTE    ] DSU: Fetching primary data for 2025-02.
[2025-10-24T18:22:36.947618] [INFO ] [REMOTE    ] DSM: Fetching primary data for 2025-08.
[2025-10-24T18:22:37.114171] [INFO ] [REMOTE    ] DSU: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T18:22:37.747624] [INFO ] [REMOTE    ] DSL: Fetching primary data for 2025-06.
[2025-10-24T18:22:37.773676] [INFO ] [REMOTE    ] DSM: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T18:22:38.547618] [INFO ] [REMOTE    ] DSU: Fetching primary data for 2025-03.
[2025-10-24T18:22:38.858214] [INFO ] [REMOTE    ] DSL: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T18:22:39.347754] [INFO ] [REMOTE    ] DSMC: Fetching primary data for 2025-03.
[2025-10-24T18:22:39.615400] [INFO ] [REMOTE    ] DSU: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T18:22:39.649211] [INFO ] [REMOTE    ] DSMC: Incremental fetch complete for 2025-03 (0.30 seconds).
[2025-10-24T18:22:40.147635] [INFO ] [REMOTE    ] DSU: Fetching primary data for 2025-04.
[2025-10-24T18:22:40.947633] [INFO ] [REMOTE    ] DSL: Fetching primary data for 2025-07.
[2025-10-24T18:22:41.190192] [INFO ] [REMOTE    ] DSU: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T18:22:41.747671] [INFO ] [REMOTE    ] DSM: Fetching primary data for 2025-09.
[2025-10-24T18:22:42.547620] [INFO ] [REMOTE    ] DSMC: Fetching primary data for 2025-04.
[2025-10-24T18:22:42.654737] [INFO ] [REMOTE    ] DSM: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T18:22:42.798471] [INFO ] [REMOTE    ] DSL: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T18:22:43.108997] [INFO ] [REMOTE    ] DSMC: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T18:22:43.347720] [INFO ] [REMOTE    ] DSMC: Fetching primary data for 2025-05.
[2025-10-24T18:22:43.788056] [INFO ] [REMOTE    ] DSMC: Incremental fetch complete for 2025-05 (0.44 seconds).
[2025-10-24T18:22:44.147707] [INFO ] [REMOTE    ] DSM: Fetching primary data for 2025-10.
[2025-10-24T18:22:44.947717] [INFO ] [REMOTE    ] DSU: Fetching primary data for 2025-05.
[2025-10-24T18:22:45.145286] [INFO ] [REMOTE    ] DSM: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T18:22:45.148481] [INFO ] [REMOTE    ] DSM: Full fetch complete (23903 records).
[2025-10-24T18:22:45.148605] [DEBUG] [VALIDATOR ] DSM: Validating primary data.
[2025-10-24T18:22:45.524930] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present.
[2025-10-24T18:22:45.525012] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed.
[2025-10-24T18:22:45.525476] [INFO ] [MAIN      ] DSM: Fetched primary data is valid.
[2025-10-24T18:22:45.525515] [DEBUG] [LOCAL     ] DSM: Saving primary data.
[2025-10-24T18:22:45.525818] [FATAL] [LOCAL     ] DSM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:22:45.525905] [FATAL] [MAIN      ] DSM: Failed to save primary data.
[2025-10-24T18:22:45.525948] [WARN ] [MAIN      ] DSM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:22:45.525983] [INFO ] [LOCAL     ] DSM: Starting deletion of primary data.
[2025-10-24T18:22:45.526031] [DEBUG] [LOCAL     ] DSM: No primary data file found to delete.
[2025-10-24T18:22:45.526068] [INFO ] [LOCAL     ] DSM: Starting deletion of derivative data.
[2025-10-24T18:22:45.526190] [DEBUG] [LOCAL     ] DSM: Deleted derivative data file.
[2025-10-24T18:22:45.526259] [INFO ] [MAIN      ] Update Progress: 653/2366 symbols completed. DSM took 29.8s. Estimated remaining: 3h 36m 58s. Rate: 7.9 symbols/min
[2025-10-24T18:22:45.699531] [INFO ] [MAIN      ] DSX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:22:45.723055] [DEBUG] [LOCAL     ] DSX: Loaded 23599 existing records from primary storage.
[2025-10-24T18:22:45.723298] [INFO ] [MAIN      ] DSX: Loaded 23599 existing records.
[2025-10-24T18:22:45.757254] [INFO ] [REMOTE    ] DSMC: Fetching primary data for 2025-06.
[2025-10-24T18:22:45.909569] [WARN ] [MAIN      ] DSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:22:45.910021] [INFO ] [MAIN      ] DSX: Wiping existing primary data before full refresh.
[2025-10-24T18:22:45.910070] [INFO ] [LOCAL     ] DSX: Starting deletion of primary data.
[2025-10-24T18:22:45.910249] [DEBUG] [LOCAL     ] DSX: Deleted primary data file.
[2025-10-24T18:22:45.910289] [INFO ] [MAIN      ] DSX: Starting full primary refresh.
[2025-10-24T18:22:46.219994] [INFO ] [REMOTE    ] DSMC: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T18:22:46.285611] [INFO ] [REMOTE    ] DSU: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T18:22:46.316619] [INFO ] [REMOTE    ] DSX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:22:46.547703] [INFO ] [REMOTE    ] DSU: Fetching primary data for 2025-06.
[2025-10-24T18:22:47.347671] [INFO ] [REMOTE    ] DSL: Fetching primary data for 2025-08.
[2025-10-24T18:22:47.586314] [INFO ] [REMOTE    ] DSU: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T18:22:48.147672] [INFO ] [REMOTE    ] DSX: Fetching primary data for 2025-01.
[2025-10-24T18:22:48.435418] [INFO ] [REMOTE    ] DSL: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T18:22:48.947714] [INFO ] [REMOTE    ] DSL: Fetching primary data for 2025-09.
[2025-10-24T18:22:49.325976] [INFO ] [REMOTE    ] DSX: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T18:22:49.747676] [INFO ] [REMOTE    ] DSU: Fetching primary data for 2025-07.
[2025-10-24T18:22:49.944611] [INFO ] [REMOTE    ] DSL: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T18:22:50.547699] [INFO ] [REMOTE    ] DSX: Fetching primary data for 2025-02.
[2025-10-24T18:22:50.825689] [INFO ] [REMOTE    ] DSU: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T18:22:51.347701] [INFO ] [REMOTE    ] DSMC: Fetching primary data for 2025-07.
[2025-10-24T18:22:51.650941] [INFO ] [REMOTE    ] DSMC: Incremental fetch complete for 2025-07 (0.30 seconds).
[2025-10-24T18:22:51.817975] [INFO ] [REMOTE    ] DSX: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T18:22:52.147706] [INFO ] [REMOTE    ] DSMC: Fetching primary data for 2025-08.
[2025-10-24T18:22:52.575300] [INFO ] [REMOTE    ] DSMC: Incremental fetch complete for 2025-08 (0.43 seconds).
[2025-10-24T18:22:52.947684] [INFO ] [REMOTE    ] DSU: Fetching primary data for 2025-08.
[2025-10-24T18:22:53.747720] [INFO ] [REMOTE    ] DSX: Fetching primary data for 2025-03.
[2025-10-24T18:22:53.940895] [INFO ] [REMOTE    ] DSU: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T18:22:54.547665] [INFO ] [REMOTE    ] DSMC: Fetching primary data for 2025-09.
[2025-10-24T18:22:54.893057] [INFO ] [REMOTE    ] DSX: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T18:22:55.326964] [INFO ] [REMOTE    ] DSMC: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T18:22:55.347602] [INFO ] [REMOTE    ] DSU: Fetching primary data for 2025-09.
[2025-10-24T18:22:56.147699] [INFO ] [REMOTE    ] DSL: Fetching primary data for 2025-10.
[2025-10-24T18:22:56.649744] [INFO ] [REMOTE    ] DSU: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T18:22:56.947676] [INFO ] [REMOTE    ] DSU: Fetching primary data for 2025-10.
[2025-10-24T18:22:57.650384] [INFO ] [REMOTE    ] DSL: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T18:22:57.656887] [INFO ] [REMOTE    ] DSL: Full fetch complete (41843 records).
[2025-10-24T18:22:57.656999] [DEBUG] [VALIDATOR ] DSL: Validating primary data.
[2025-10-24T18:22:57.752764] [INFO ] [REMOTE    ] DSMC: Fetching primary data for 2025-10.
[2025-10-24T18:22:58.047770] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present.
[2025-10-24T18:22:58.047940] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed.
[2025-10-24T18:22:58.048693] [INFO ] [MAIN      ] DSL: Fetched primary data is valid.
[2025-10-24T18:22:58.053932] [DEBUG] [LOCAL     ] DSL: Saving primary data.
[2025-10-24T18:22:58.059889] [FATAL] [LOCAL     ] DSL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:22:58.060498] [FATAL] [MAIN      ] DSL: Failed to save primary data.
[2025-10-24T18:22:58.060948] [INFO ] [REMOTE    ] DSU: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T18:22:58.065181] [WARN ] [MAIN      ] DSL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:22:58.065633] [INFO ] [LOCAL     ] DSL: Starting deletion of primary data.
[2025-10-24T18:22:58.065767] [INFO ] [REMOTE    ] DSU: Full fetch complete (33031 records).
[2025-10-24T18:22:58.065835] [DEBUG] [LOCAL     ] DSL: No primary data file found to delete.
[2025-10-24T18:22:58.065985] [DEBUG] [VALIDATOR ] DSU: Validating primary data.
[2025-10-24T18:22:58.065939] [INFO ] [LOCAL     ] DSL: Starting deletion of derivative data.
[2025-10-24T18:22:58.097906] [DEBUG] [LOCAL     ] DSL: Deleted derivative data file.
[2025-10-24T18:22:58.129609] [INFO ] [MAIN      ] Update Progress: 654/2366 symbols completed. DSL took 50.9s. Estimated remaining: 3h 37m 4s. Rate: 7.9 symbols/min
[2025-10-24T18:22:58.436094] [INFO ] [REMOTE    ] DSMC: Incremental fetch complete for 2025-10 (0.68 seconds).
[2025-10-24T18:22:58.474753] [INFO ] [REMOTE    ] DSMC: Full fetch complete (2880 records).
[2025-10-24T18:22:58.521012] [DEBUG] [VALIDATOR ] DSMC: Validating primary data.
[2025-10-24T18:22:58.508711] [INFO ] [MAIN      ] DT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:22:58.553028] [INFO ] [REMOTE    ] DSX: Fetching primary data for 2025-04.
[2025-10-24T18:22:58.820980] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present.
[2025-10-24T18:22:58.889613] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed.
[2025-10-24T18:22:58.905327] [INFO ] [MAIN      ] DSU: Fetched primary data is valid.
[2025-10-24T18:22:58.918940] [DEBUG] [LOCAL     ] DSU: Saving primary data.
[2025-10-24T18:22:58.933903] [FATAL] [LOCAL     ] DSU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:22:58.958338] [FATAL] [MAIN      ] DSU: Failed to save primary data.
[2025-10-24T18:22:58.984235] [WARN ] [MAIN      ] DSU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:22:58.984539] [INFO ] [LOCAL     ] DSU: Starting deletion of primary data.
[2025-10-24T18:22:58.985510] [DEBUG] [LOCAL     ] DT: Loaded 53332 existing records from primary storage.
[2025-10-24T18:22:58.996732] [INFO ] [MAIN      ] DT: Loaded 53332 existing records.
[2025-10-24T18:22:58.996615] [DEBUG] [LOCAL     ] DSU: No primary data file found to delete.
[2025-10-24T18:22:59.056147] [INFO ] [LOCAL     ] DSU: Starting deletion of derivative data.
[2025-10-24T18:22:59.117889] [DEBUG] [LOCAL     ] DSU: Deleted derivative data file.
[2025-10-24T18:22:59.139013] [INFO ] [MAIN      ] Update Progress: 655/2366 symbols completed. DSU took 26.5s. Estimated remaining: 3h 36m 39s. Rate: 7.9 symbols/min
[2025-10-24T18:22:59.151840] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present.
[2025-10-24T18:22:59.163122] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed.
[2025-10-24T18:22:59.207807] [INFO ] [MAIN      ] DSMC: Fetched primary data is valid.
[2025-10-24T18:22:59.214995] [DEBUG] [LOCAL     ] DSMC: Saving primary data.
[2025-10-24T18:22:59.232917] [FATAL] [LOCAL     ] DSMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:22:59.260486] [FATAL] [MAIN      ] DSMC: Failed to save primary data.
[2025-10-24T18:22:59.287362] [WARN ] [MAIN      ] DSMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:22:59.328681] [INFO ] [LOCAL     ] DSMC: Starting deletion of primary data.
[2025-10-24T18:22:59.365609] [DEBUG] [LOCAL     ] DSMC: No primary data file found to delete.
[2025-10-24T18:22:59.385787] [INFO ] [LOCAL     ] DSMC: Starting deletion of derivative data.
[2025-10-24T18:22:59.438803] [INFO ] [MAIN      ] DTB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:22:59.418406] [WARN ] [MAIN      ] DT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:22:59.439600] [DEBUG] [LOCAL     ] DSMC: Deleted derivative data file.
[2025-10-24T18:22:59.439752] [INFO ] [MAIN      ] DT: Wiping existing primary data before full refresh.
[2025-10-24T18:22:59.439989] [INFO ] [MAIN      ] Update Progress: 656/2366 symbols completed. DSMC took 28.1s. Estimated remaining: 3h 36m 12s. Rate: 7.9 symbols/min
[2025-10-24T18:22:59.439896] [INFO ] [LOCAL     ] DT: Starting deletion of primary data.
[2025-10-24T18:22:59.473462] [DEBUG] [LOCAL     ] DT: Deleted primary data file.
[2025-10-24T18:22:59.508228] [INFO ] [MAIN      ] DT: Starting full primary refresh.
[2025-10-24T18:22:59.589246] [DEBUG] [LOCAL     ] DTB: Loaded 4918 existing records from primary storage.
[2025-10-24T18:22:59.599918] [INFO ] [MAIN      ] DTB: Loaded 4918 existing records.
[2025-10-24T18:22:59.924814] [INFO ] [MAIN      ] DTE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:23:00.150984] [WARN ] [MAIN      ] DTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:23:00.164129] [INFO ] [MAIN      ] DTB: Wiping existing primary data before full refresh.
[2025-10-24T18:23:00.164037] [INFO ] [REMOTE    ] DSX: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T18:23:00.174958] [INFO ] [LOCAL     ] DTB: Starting deletion of primary data.
[2025-10-24T18:23:00.224401] [INFO ] [REMOTE    ] DSX: Fetching primary data for 2025-05.
[2025-10-24T18:23:00.246099] [INFO ] [REMOTE    ] DT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:23:00.246434] [INFO ] [REMOTE    ] DT: Fetching primary data for 2025-01.
[2025-10-24T18:23:00.246495] [DEBUG] [LOCAL     ] DTB: Deleted primary data file.
[2025-10-24T18:23:00.248031] [INFO ] [MAIN      ] DTB: Starting full primary refresh.
[2025-10-24T18:23:00.412102] [DEBUG] [LOCAL     ] DTE: Loaded 47417 existing records from primary storage.
[2025-10-24T18:23:00.412695] [INFO ] [MAIN      ] DTE: Loaded 47417 existing records.
[2025-10-24T18:23:00.786719] [WARN ] [MAIN      ] DTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:23:00.836841] [INFO ] [MAIN      ] DTE: Wiping existing primary data before full refresh.
[2025-10-24T18:23:00.856902] [INFO ] [LOCAL     ] DTE: Starting deletion of primary data.
[2025-10-24T18:23:00.899421] [INFO ] [REMOTE    ] DTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:23:00.899981] [DEBUG] [LOCAL     ] DTE: Deleted primary data file.
[2025-10-24T18:23:00.900049] [INFO ] [MAIN      ] DTE: Starting full primary refresh.
[2025-10-24T18:23:00.963629] [INFO ] [REMOTE    ] DTB: Fetching primary data for 2025-01.
[2025-10-24T18:23:01.445269] [INFO ] [REMOTE    ] DTE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:23:01.747695] [INFO ] [REMOTE    ] DTE: Fetching primary data for 2025-01.
[2025-10-24T18:23:07.481546] [INFO ] [REMOTE    ] DTB: Incremental fetch complete for 2025-01 (6.52 seconds).
[2025-10-24T18:23:07.483067] [INFO ] [REMOTE    ] DTB: Fetching primary data for 2025-02.
[2025-10-24T18:23:08.012475] [INFO ] [REMOTE    ] DSX: Incremental fetch complete for 2025-05 (7.79 seconds).
[2025-10-24T18:23:08.017587] [INFO ] [REMOTE    ] DSX: Fetching primary data for 2025-06.
[2025-10-24T18:23:08.243389] [INFO ] [REMOTE    ] DT: Incremental fetch complete for 2025-01 (8.00 seconds).
[2025-10-24T18:23:08.253857] [INFO ] [REMOTE    ] DT: Fetching primary data for 2025-02.
[2025-10-24T18:23:08.604482] [INFO ] [REMOTE    ] DTB: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T18:23:08.605850] [INFO ] [REMOTE    ] DTB: Fetching primary data for 2025-03.
[2025-10-24T18:23:08.858354] [INFO ] [REMOTE    ] DTE: Incremental fetch complete for 2025-01 (7.11 seconds).
[2025-10-24T18:23:08.868012] [INFO ] [REMOTE    ] DTE: Fetching primary data for 2025-02.
[2025-10-24T18:23:09.192170] [INFO ] [REMOTE    ] DSX: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T18:23:09.197896] [INFO ] [REMOTE    ] DSX: Fetching primary data for 2025-07.
[2025-10-24T18:23:10.019181] [INFO ] [REMOTE    ] DT: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T18:23:10.030905] [INFO ] [REMOTE    ] DT: Fetching primary data for 2025-03.
[2025-10-24T18:23:10.281624] [INFO ] [REMOTE    ] DTB: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T18:23:10.283252] [INFO ] [REMOTE    ] DTB: Fetching primary data for 2025-04.
[2025-10-24T18:23:10.403775] [INFO ] [REMOTE    ] DTE: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T18:23:10.413334] [INFO ] [REMOTE    ] DTE: Fetching primary data for 2025-03.
[2025-10-24T18:23:10.461533] [INFO ] [REMOTE    ] DSX: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T18:23:10.467783] [INFO ] [REMOTE    ] DSX: Fetching primary data for 2025-08.
[2025-10-24T18:23:10.846433] [INFO ] [REMOTE    ] DTB: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T18:23:10.848013] [INFO ] [REMOTE    ] DTB: Fetching primary data for 2025-05.
[2025-10-24T18:23:11.183703] [INFO ] [REMOTE    ] DTB: Incremental fetch complete for 2025-05 (0.34 seconds).
[2025-10-24T18:23:11.344131] [INFO ] [REMOTE    ] DT: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T18:23:11.348035] [INFO ] [REMOTE    ] DTB: Fetching primary data for 2025-06.
[2025-10-24T18:23:11.431244] [INFO ] [REMOTE    ] DSX: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T18:23:11.788824] [INFO ] [REMOTE    ] DTE: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T18:23:11.940524] [INFO ] [REMOTE    ] DTB: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T18:23:12.147687] [INFO ] [REMOTE    ] DTB: Fetching primary data for 2025-07.
[2025-10-24T18:23:12.767715] [INFO ] [REMOTE    ] DTB: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T18:23:12.947671] [INFO ] [REMOTE    ] DTB: Fetching primary data for 2025-08.
[2025-10-24T18:23:13.392595] [INFO ] [REMOTE    ] DTB: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T18:23:13.747704] [INFO ] [REMOTE    ] DSX: Fetching primary data for 2025-09.
[2025-10-24T18:23:14.547723] [INFO ] [REMOTE    ] DTE: Fetching primary data for 2025-04.
[2025-10-24T18:23:14.902676] [INFO ] [REMOTE    ] DSX: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T18:23:15.347627] [INFO ] [REMOTE    ] DT: Fetching primary data for 2025-04.
[2025-10-24T18:23:16.147735] [INFO ] [REMOTE    ] DSX: Fetching primary data for 2025-10.
[2025-10-24T18:23:16.327331] [INFO ] [REMOTE    ] DTE: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T18:23:16.947696] [INFO ] [REMOTE    ] DTB: Fetching primary data for 2025-09.
[2025-10-24T18:23:17.214257] [INFO ] [REMOTE    ] DT: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T18:23:17.252298] [INFO ] [REMOTE    ] DSX: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T18:23:17.256916] [INFO ] [REMOTE    ] DSX: Full fetch complete (35320 records).
[2025-10-24T18:23:17.257049] [DEBUG] [VALIDATOR ] DSX: Validating primary data.
[2025-10-24T18:23:17.641961] [INFO ] [REMOTE    ] DTB: Incremental fetch complete for 2025-09 (0.69 seconds).
[2025-10-24T18:23:17.642110] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present.
[2025-10-24T18:23:17.644395] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed.
[2025-10-24T18:23:17.645049] [INFO ] [MAIN      ] DSX: Fetched primary data is valid.
[2025-10-24T18:23:17.645113] [DEBUG] [LOCAL     ] DSX: Saving primary data.
[2025-10-24T18:23:17.645433] [FATAL] [LOCAL     ] DSX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:23:17.645512] [FATAL] [MAIN      ] DSX: Failed to save primary data.
[2025-10-24T18:23:17.645583] [WARN ] [MAIN      ] DSX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:23:17.645676] [INFO ] [LOCAL     ] DSX: Starting deletion of primary data.
[2025-10-24T18:23:17.645747] [DEBUG] [LOCAL     ] DSX: No primary data file found to delete.
[2025-10-24T18:23:17.645785] [INFO ] [LOCAL     ] DSX: Starting deletion of derivative data.
[2025-10-24T18:23:17.645934] [DEBUG] [LOCAL     ] DSX: Deleted derivative data file.
[2025-10-24T18:23:17.646025] [INFO ] [MAIN      ] Update Progress: 657/2366 symbols completed. DSX took 32.1s. Estimated remaining: 3h 36m 32s. Rate: 7.9 symbols/min
[2025-10-24T18:23:17.749350] [INFO ] [REMOTE    ] DTB: Fetching primary data for 2025-10.
[2025-10-24T18:23:17.819090] [INFO ] [MAIN      ] DTF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:23:17.819242] [DEBUG] [LOCAL     ] DTF: No existing data file found in primary storage.
[2025-10-24T18:23:17.819281] [WARN ] [MAIN      ] DTF: No existing data found, performing full refresh instead.
[2025-10-24T18:23:17.819413] [INFO ] [MAIN      ] DTF: Wiping existing primary data before full refresh.
[2025-10-24T18:23:17.819455] [INFO ] [LOCAL     ] DTF: Starting deletion of primary data.
[2025-10-24T18:23:17.819497] [DEBUG] [LOCAL     ] DTF: No primary data file found to delete.
[2025-10-24T18:23:17.819529] [INFO ] [MAIN      ] DTF: Starting full primary refresh.
[2025-10-24T18:23:18.196666] [INFO ] [REMOTE    ] DTF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:23:18.547629] [INFO ] [REMOTE    ] DTF: Fetching primary data for 2025-01.
[2025-10-24T18:23:18.559828] [INFO ] [REMOTE    ] DTB: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T18:23:18.561200] [INFO ] [REMOTE    ] DTB: Full fetch complete (6488 records).
[2025-10-24T18:23:18.561338] [DEBUG] [VALIDATOR ] DTB: Validating primary data.
[2025-10-24T18:23:18.561740] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:23:18.561819] [FATAL] [MAIN      ] DTB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:23:18.561861] [WARN ] [MAIN      ] DTB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:23:18.561898] [INFO ] [LOCAL     ] DTB: Starting deletion of primary data.
[2025-10-24T18:23:18.561949] [DEBUG] [LOCAL     ] DTB: No primary data file found to delete.
[2025-10-24T18:23:18.561983] [INFO ] [LOCAL     ] DTB: Starting deletion of derivative data.
[2025-10-24T18:23:18.562101] [DEBUG] [LOCAL     ] DTB: Deleted derivative data file.
[2025-10-24T18:23:18.562163] [INFO ] [MAIN      ] Update Progress: 658/2366 symbols completed. DTB took 19.4s. Estimated remaining: 3h 36m 7s. Rate: 7.9 symbols/min
[2025-10-24T18:23:18.730038] [INFO ] [MAIN      ] DTG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:23:18.739421] [DEBUG] [LOCAL     ] DTG: Loaded 5709 existing records from primary storage.
[2025-10-24T18:23:18.739634] [INFO ] [MAIN      ] DTG: Loaded 5709 existing records.
[2025-10-24T18:23:18.915630] [WARN ] [MAIN      ] DTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:23:18.915880] [INFO ] [MAIN      ] DTG: Wiping existing primary data before full refresh.
[2025-10-24T18:23:18.915928] [INFO ] [LOCAL     ] DTG: Starting deletion of primary data.
[2025-10-24T18:23:18.916086] [DEBUG] [LOCAL     ] DTG: Deleted primary data file.
[2025-10-24T18:23:18.916142] [INFO ] [MAIN      ] DTG: Starting full primary refresh.
[2025-10-24T18:23:19.090724] [INFO ] [REMOTE    ] DTF: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T18:23:19.272849] [INFO ] [REMOTE    ] DTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:23:19.347612] [INFO ] [REMOTE    ] DTG: Fetching primary data for 2025-01.
[2025-10-24T18:23:20.115806] [INFO ] [REMOTE    ] DTG: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T18:23:20.147604] [INFO ] [REMOTE    ] DTG: Fetching primary data for 2025-02.
[2025-10-24T18:23:20.847382] [INFO ] [REMOTE    ] DTG: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T18:23:20.947614] [INFO ] [REMOTE    ] DTE: Fetching primary data for 2025-05.
[2025-10-24T18:23:21.747670] [INFO ] [REMOTE    ] DTG: Fetching primary data for 2025-03.
[2025-10-24T18:23:22.425173] [INFO ] [REMOTE    ] DTG: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T18:23:22.547682] [INFO ] [REMOTE    ] DTG: Fetching primary data for 2025-04.
[2025-10-24T18:23:23.347636] [INFO ] [REMOTE    ] DT: Fetching primary data for 2025-05.
[2025-10-24T18:23:23.835282] [INFO ] [REMOTE    ] DTE: Incremental fetch complete for 2025-05 (2.89 seconds).
[2025-10-24T18:23:23.963746] [INFO ] [REMOTE    ] DTG: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T18:23:24.147611] [INFO ] [REMOTE    ] DTF: Fetching primary data for 2025-02.
[2025-10-24T18:23:24.499172] [INFO ] [REMOTE    ] DTF: Incremental fetch complete for 2025-02 (0.35 seconds).
[2025-10-24T18:23:24.947621] [INFO ] [REMOTE    ] DTF: Fetching primary data for 2025-03.
[2025-10-24T18:23:25.021433] [INFO ] [REMOTE    ] DT: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T18:23:25.573973] [INFO ] [REMOTE    ] DTF: Incremental fetch complete for 2025-03 (0.63 seconds).
[2025-10-24T18:23:25.747672] [INFO ] [REMOTE    ] DTF: Fetching primary data for 2025-04.
[2025-10-24T18:23:26.179910] [INFO ] [REMOTE    ] DTF: Incremental fetch complete for 2025-04 (0.43 seconds).
[2025-10-24T18:23:26.547639] [INFO ] [REMOTE    ] DTG: Fetching primary data for 2025-05.
[2025-10-24T18:23:27.174911] [INFO ] [REMOTE    ] DTG: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T18:23:27.347667] [INFO ] [REMOTE    ] DT: Fetching primary data for 2025-06.
[2025-10-24T18:23:28.147694] [INFO ] [REMOTE    ] DTF: Fetching primary data for 2025-05.
[2025-10-24T18:23:28.641714] [INFO ] [REMOTE    ] DTF: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T18:23:28.947663] [INFO ] [REMOTE    ] DTE: Fetching primary data for 2025-06.
[2025-10-24T18:23:29.747690] [INFO ] [REMOTE    ] DTG: Fetching primary data for 2025-06.
[2025-10-24T18:23:29.946019] [INFO ] [REMOTE    ] DT: Incremental fetch complete for 2025-06 (2.60 seconds).
[2025-10-24T18:23:30.441474] [INFO ] [REMOTE    ] DTG: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T18:23:30.474381] [INFO ] [REMOTE    ] DTE: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T18:23:30.547704] [INFO ] [REMOTE    ] DTG: Fetching primary data for 2025-07.
[2025-10-24T18:23:31.177727] [INFO ] [REMOTE    ] DTG: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T18:23:31.347732] [INFO ] [REMOTE    ] DTE: Fetching primary data for 2025-07.
[2025-10-24T18:23:32.147695] [INFO ] [REMOTE    ] DTF: Fetching primary data for 2025-06.
[2025-10-24T18:23:32.575057] [INFO ] [REMOTE    ] DTF: Incremental fetch complete for 2025-06 (0.43 seconds).
[2025-10-24T18:23:32.947619] [INFO ] [REMOTE    ] DTF: Fetching primary data for 2025-07.
[2025-10-24T18:23:33.143069] [INFO ] [REMOTE    ] DTE: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T18:23:33.221816] [INFO ] [REMOTE    ] DTF: Incremental fetch complete for 2025-07 (0.27 seconds).
[2025-10-24T18:23:33.747672] [INFO ] [REMOTE    ] DTE: Fetching primary data for 2025-08.
[2025-10-24T18:23:34.547699] [INFO ] [REMOTE    ] DT: Fetching primary data for 2025-07.
[2025-10-24T18:23:35.347634] [INFO ] [REMOTE    ] DTF: Fetching primary data for 2025-08.
[2025-10-24T18:23:35.389892] [INFO ] [REMOTE    ] DTE: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T18:23:35.728301] [INFO ] [REMOTE    ] DTF: Incremental fetch complete for 2025-08 (0.38 seconds).
[2025-10-24T18:23:36.147709] [INFO ] [REMOTE    ] DTE: Fetching primary data for 2025-09.
[2025-10-24T18:23:36.559606] [INFO ] [REMOTE    ] DT: Incremental fetch complete for 2025-07 (2.01 seconds).
[2025-10-24T18:23:36.947759] [INFO ] [REMOTE    ] DTF: Fetching primary data for 2025-09.
[2025-10-24T18:23:37.313195] [INFO ] [REMOTE    ] DTE: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T18:23:37.437570] [INFO ] [REMOTE    ] DTF: Incremental fetch complete for 2025-09 (0.49 seconds).
[2025-10-24T18:23:37.747705] [INFO ] [REMOTE    ] DTF: Fetching primary data for 2025-10.
[2025-10-24T18:23:38.194514] [INFO ] [REMOTE    ] DTF: Incremental fetch complete for 2025-10 (0.45 seconds).
[2025-10-24T18:23:38.195316] [INFO ] [REMOTE    ] DTF: Full fetch complete (1733 records).
[2025-10-24T18:23:38.195385] [DEBUG] [VALIDATOR ] DTF: Validating primary data.
[2025-10-24T18:23:38.375814] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days
[2025-10-24T18:23:38.376023] [FATAL] [MAIN      ] DTF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:23:38.376112] [WARN ] [MAIN      ] DTF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:23:38.376187] [INFO ] [LOCAL     ] DTF: Starting deletion of primary data.
[2025-10-24T18:23:38.376272] [DEBUG] [LOCAL     ] DTF: No primary data file found to delete.
[2025-10-24T18:23:38.376317] [INFO ] [LOCAL     ] DTF: Starting deletion of derivative data.
[2025-10-24T18:23:38.376361] [DEBUG] [LOCAL     ] DTF: No derivative data file found to delete.
[2025-10-24T18:23:38.376419] [INFO ] [MAIN      ] Update Progress: 659/2366 symbols completed. DTF took 20.7s. Estimated remaining: 3h 36m 32s. Rate: 7.9 symbols/min
[2025-10-24T18:23:38.549278] [INFO ] [MAIN      ] DTK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:23:38.548179] [INFO ] [REMOTE    ] DTE: Fetching primary data for 2025-10.
[2025-10-24T18:23:38.550135] [DEBUG] [LOCAL     ] DTK: No existing data file found in primary storage.
[2025-10-24T18:23:38.550216] [WARN ] [MAIN      ] DTK: No existing data found, performing full refresh instead.
[2025-10-24T18:23:38.550296] [INFO ] [MAIN      ] DTK: Wiping existing primary data before full refresh.
[2025-10-24T18:23:38.550332] [INFO ] [LOCAL     ] DTK: Starting deletion of primary data.
[2025-10-24T18:23:38.550372] [DEBUG] [LOCAL     ] DTK: No primary data file found to delete.
[2025-10-24T18:23:38.550403] [INFO ] [MAIN      ] DTK: Starting full primary refresh.
[2025-10-24T18:23:38.914065] [INFO ] [REMOTE    ] DTK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:23:39.347636] [INFO ] [REMOTE    ] DT: Fetching primary data for 2025-08.
[2025-10-24T18:23:40.147633] [INFO ] [REMOTE    ] DTK: Fetching primary data for 2025-01.
[2025-10-24T18:23:40.625972] [DEBUG] [REMOTE    ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T18:23:40.626274] [WARN ] [REMOTE    ] DTK: No data returned for month 2025-01
[2025-10-24T18:23:40.626363] [FATAL] [REMOTE    ] DTK: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:23:40.626445] [FATAL] [MAIN      ] DTK: Failed to fetch primary data.
[2025-10-24T18:23:40.626587] [WARN ] [MAIN      ] DTK: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:23:40.626709] [INFO ] [LOCAL     ] DTK: Starting deletion of primary data.
[2025-10-24T18:23:40.626926] [DEBUG] [LOCAL     ] DTK: No primary data file found to delete.
[2025-10-24T18:23:40.626995] [INFO ] [LOCAL     ] DTK: Starting deletion of derivative data.
[2025-10-24T18:23:40.646004] [DEBUG] [LOCAL     ] DTK: No derivative data file found to delete.
[2025-10-24T18:23:40.646169] [INFO ] [MAIN      ] Update Progress: 660/2366 symbols completed. DTK took 2.3s. Estimated remaining: 3h 36m 10s. Rate: 7.9 symbols/min
[2025-10-24T18:23:40.691091] [INFO ] [REMOTE    ] DTE: Incremental fetch complete for 2025-10 (2.14 seconds).
[2025-10-24T18:23:40.768670] [INFO ] [REMOTE    ] DTE: Full fetch complete (68527 records).
[2025-10-24T18:23:40.779002] [DEBUG] [VALIDATOR ] DTE: Validating primary data.
[2025-10-24T18:23:40.829818] [INFO ] [MAIN      ] DTM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:23:40.827292] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:23:40.829958] [FATAL] [MAIN      ] DTE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:23:40.830327] [WARN ] [MAIN      ] DTE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:23:40.830417] [INFO ] [LOCAL     ] DTE: Starting deletion of primary data.
[2025-10-24T18:23:40.830501] [DEBUG] [LOCAL     ] DTE: No primary data file found to delete.
[2025-10-24T18:23:40.830561] [INFO ] [LOCAL     ] DTE: Starting deletion of derivative data.
[2025-10-24T18:23:40.830737] [DEBUG] [LOCAL     ] DTE: Deleted derivative data file.
[2025-10-24T18:23:40.831141] [INFO ] [MAIN      ] Update Progress: 661/2366 symbols completed. DTE took 41.4s. Estimated remaining: 3h 35m 43s. Rate: 7.9 symbols/min
[2025-10-24T18:23:40.952368] [INFO ] [REMOTE    ] DTG: Fetching primary data for 2025-08.
[2025-10-24T18:23:41.009736] [INFO ] [MAIN      ] DTW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:23:41.028325] [DEBUG] [LOCAL     ] DTW: Loaded 4737 existing records from primary storage.
[2025-10-24T18:23:41.028599] [INFO ] [MAIN      ] DTW: Loaded 4737 existing records.
[2025-10-24T18:23:41.154260] [DEBUG] [LOCAL     ] DTM: Loaded 44045 existing records from primary storage.
[2025-10-24T18:23:41.165467] [INFO ] [MAIN      ] DTM: Loaded 44045 existing records.
[2025-10-24T18:23:41.289976] [WARN ] [MAIN      ] DTW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:23:41.304268] [INFO ] [MAIN      ] DTW: Wiping existing primary data before full refresh.
[2025-10-24T18:23:41.321403] [INFO ] [LOCAL     ] DTW: Starting deletion of primary data.
[2025-10-24T18:23:41.338235] [DEBUG] [LOCAL     ] DTW: Deleted primary data file.
[2025-10-24T18:23:41.343866] [INFO ] [MAIN      ] DTW: Starting full primary refresh.
[2025-10-24T18:23:41.472710] [WARN ] [MAIN      ] DTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:23:41.486806] [INFO ] [MAIN      ] DTM: Wiping existing primary data before full refresh.
[2025-10-24T18:23:41.486892] [INFO ] [LOCAL     ] DTM: Starting deletion of primary data.
[2025-10-24T18:23:41.547597] [DEBUG] [LOCAL     ] DTM: Deleted primary data file.
[2025-10-24T18:23:41.547834] [INFO ] [MAIN      ] DTM: Starting full primary refresh.
[2025-10-24T18:23:41.640304] [INFO ] [REMOTE    ] DT: Incremental fetch complete for 2025-08 (2.29 seconds).
[2025-10-24T18:23:41.755511] [INFO ] [REMOTE    ] DT: Fetching primary data for 2025-09.
[2025-10-24T18:23:41.918508] [INFO ] [REMOTE    ] DTG: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T18:23:42.126604] [INFO ] [REMOTE    ] DTW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:23:42.201494] [INFO ] [REMOTE    ] DTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:23:42.547685] [INFO ] [REMOTE    ] DTW: Fetching primary data for 2025-01.
[2025-10-24T18:23:43.310201] [INFO ] [REMOTE    ] DTW: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T18:23:43.347736] [INFO ] [REMOTE    ] DTW: Fetching primary data for 2025-02.
[2025-10-24T18:23:43.410018] [INFO ] [REMOTE    ] DT: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T18:23:43.981912] [INFO ] [REMOTE    ] DTW: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T18:23:44.147706] [INFO ] [REMOTE    ] DT: Fetching primary data for 2025-10.
[2025-10-24T18:23:44.947735] [INFO ] [REMOTE    ] DTG: Fetching primary data for 2025-09.
[2025-10-24T18:23:45.606584] [INFO ] [REMOTE    ] DTG: Incremental fetch complete for 2025-09 (0.66 seconds).
[2025-10-24T18:23:45.747701] [INFO ] [REMOTE    ] DTW: Fetching primary data for 2025-03.
[2025-10-24T18:23:45.892368] [INFO ] [REMOTE    ] DT: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T18:23:45.902056] [INFO ] [REMOTE    ] DT: Full fetch complete (76891 records).
[2025-10-24T18:23:45.902175] [DEBUG] [VALIDATOR ] DT: Validating primary data.
[2025-10-24T18:23:46.293453] [DEBUG] [VALIDATOR ] DT: All expected trading days are present.
[2025-10-24T18:23:46.293564] [DEBUG] [VALIDATOR ] DT: Primary data validation passed.
[2025-10-24T18:23:46.294522] [INFO ] [MAIN      ] DT: Fetched primary data is valid.
[2025-10-24T18:23:46.294681] [DEBUG] [LOCAL     ] DT: Saving primary data.
[2025-10-24T18:23:46.295263] [FATAL] [LOCAL     ] DT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:23:46.295344] [FATAL] [MAIN      ] DT: Failed to save primary data.
[2025-10-24T18:23:46.295386] [WARN ] [MAIN      ] DT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:23:46.295421] [INFO ] [LOCAL     ] DT: Starting deletion of primary data.
[2025-10-24T18:23:46.295473] [DEBUG] [LOCAL     ] DT: No primary data file found to delete.
[2025-10-24T18:23:46.295508] [INFO ] [LOCAL     ] DT: Starting deletion of derivative data.
[2025-10-24T18:23:46.295633] [DEBUG] [LOCAL     ] DT: Deleted derivative data file.
[2025-10-24T18:23:46.295910] [INFO ] [MAIN      ] Update Progress: 662/2366 symbols completed. DT took 48.1s. Estimated remaining: 3h 35m 30s. Rate: 7.9 symbols/min
[2025-10-24T18:23:46.401869] [INFO ] [REMOTE    ] DTW: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T18:23:46.470127] [INFO ] [MAIN      ] DUK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:23:46.523537] [DEBUG] [LOCAL     ] DUK: Loaded 53818 existing records from primary storage.
[2025-10-24T18:23:46.523868] [INFO ] [MAIN      ] DUK: Loaded 53818 existing records.
[2025-10-24T18:23:46.552998] [INFO ] [REMOTE    ] DTG: Fetching primary data for 2025-10.
[2025-10-24T18:23:46.702420] [WARN ] [MAIN      ] DUK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:23:46.702633] [INFO ] [MAIN      ] DUK: Wiping existing primary data before full refresh.
[2025-10-24T18:23:46.702712] [INFO ] [LOCAL     ] DUK: Starting deletion of primary data.
[2025-10-24T18:23:46.703054] [DEBUG] [LOCAL     ] DUK: Deleted primary data file.
[2025-10-24T18:23:46.703096] [INFO ] [MAIN      ] DUK: Starting full primary refresh.
[2025-10-24T18:23:47.056702] [INFO ] [REMOTE    ] DUK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:23:47.347674] [INFO ] [REMOTE    ] DTW: Fetching primary data for 2025-04.
[2025-10-24T18:23:47.388893] [INFO ] [REMOTE    ] DTG: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T18:23:47.390557] [INFO ] [REMOTE    ] DTG: Full fetch complete (8516 records).
[2025-10-24T18:23:47.390625] [DEBUG] [VALIDATOR ] DTG: Validating primary data.
[2025-10-24T18:23:47.750517] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present.
[2025-10-24T18:23:47.750594] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed.
[2025-10-24T18:23:47.750823] [INFO ] [MAIN      ] DTG: Fetched primary data is valid.
[2025-10-24T18:23:47.750883] [DEBUG] [LOCAL     ] DTG: Saving primary data.
[2025-10-24T18:23:47.751101] [FATAL] [LOCAL     ] DTG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:23:47.751185] [FATAL] [MAIN      ] DTG: Failed to save primary data.
[2025-10-24T18:23:47.751228] [WARN ] [MAIN      ] DTG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:23:47.751299] [INFO ] [LOCAL     ] DTG: Starting deletion of primary data.
[2025-10-24T18:23:47.751387] [DEBUG] [LOCAL     ] DTG: No primary data file found to delete.
[2025-10-24T18:23:47.751434] [INFO ] [LOCAL     ] DTG: Starting deletion of derivative data.
[2025-10-24T18:23:47.751678] [DEBUG] [LOCAL     ] DTG: Deleted derivative data file.
[2025-10-24T18:23:47.751769] [INFO ] [MAIN      ] Update Progress: 663/2366 symbols completed. DTG took 29.2s. Estimated remaining: 3h 35m 7s. Rate: 7.9 symbols/min
[2025-10-24T18:23:47.864887] [INFO ] [REMOTE    ] DTW: Incremental fetch complete for 2025-04 (0.52 seconds).
[2025-10-24T18:23:47.940087] [INFO ] [MAIN      ] DUKB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:23:47.948352] [DEBUG] [LOCAL     ] DUKB: Loaded 6161 existing records from primary storage.
[2025-10-24T18:23:47.948603] [INFO ] [MAIN      ] DUKB: Loaded 6161 existing records.
[2025-10-24T18:23:48.154372] [INFO ] [REMOTE    ] DUK: Fetching primary data for 2025-01.
[2025-10-24T18:23:48.162076] [WARN ] [MAIN      ] DUKB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:23:48.162383] [INFO ] [MAIN      ] DUKB: Wiping existing primary data before full refresh.
[2025-10-24T18:23:48.162478] [INFO ] [LOCAL     ] DUKB: Starting deletion of primary data.
[2025-10-24T18:23:48.163578] [DEBUG] [LOCAL     ] DUKB: Deleted primary data file.
[2025-10-24T18:23:48.163698] [INFO ] [MAIN      ] DUKB: Starting full primary refresh.
[2025-10-24T18:23:48.686279] [INFO ] [REMOTE    ] DUKB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:23:48.947705] [INFO ] [REMOTE    ] DTW: Fetching primary data for 2025-05.
[2025-10-24T18:23:49.563703] [INFO ] [REMOTE    ] DTW: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T18:23:49.747623] [INFO ] [REMOTE    ] DTM: Fetching primary data for 2025-01.
[2025-10-24T18:23:50.144767] [INFO ] [REMOTE    ] DUK: Incremental fetch complete for 2025-01 (1.99 seconds).
[2025-10-24T18:23:50.547721] [INFO ] [REMOTE    ] DUK: Fetching primary data for 2025-02.
[2025-10-24T18:23:51.089670] [INFO ] [REMOTE    ] DTM: Incremental fetch complete for 2025-01 (1.34 seconds).
[2025-10-24T18:23:51.347705] [INFO ] [REMOTE    ] DTW: Fetching primary data for 2025-06.
[2025-10-24T18:23:52.147709] [INFO ] [REMOTE    ] DUKB: Fetching primary data for 2025-01.
[2025-10-24T18:23:52.183108] [INFO ] [REMOTE    ] DUK: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T18:23:52.217680] [INFO ] [REMOTE    ] DTW: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T18:23:52.947678] [INFO ] [REMOTE    ] DTM: Fetching primary data for 2025-02.
[2025-10-24T18:23:52.970351] [INFO ] [REMOTE    ] DUKB: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T18:23:53.747688] [INFO ] [REMOTE    ] DUK: Fetching primary data for 2025-03.
[2025-10-24T18:23:54.547630] [INFO ] [REMOTE    ] DUKB: Fetching primary data for 2025-02.
[2025-10-24T18:23:54.635392] [INFO ] [REMOTE    ] DTM: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T18:23:55.124321] [INFO ] [REMOTE    ] DUKB: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T18:23:55.347637] [INFO ] [REMOTE    ] DTW: Fetching primary data for 2025-07.
[2025-10-24T18:23:55.639167] [INFO ] [REMOTE    ] DUK: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T18:23:56.008288] [INFO ] [REMOTE    ] DTW: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T18:23:56.147706] [INFO ] [REMOTE    ] DTW: Fetching primary data for 2025-08.
[2025-10-24T18:23:56.724984] [INFO ] [REMOTE    ] DTW: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T18:23:56.947640] [INFO ] [REMOTE    ] DUKB: Fetching primary data for 2025-03.
[2025-10-24T18:23:57.530716] [INFO ] [REMOTE    ] DUKB: Incremental fetch complete for 2025-03 (0.58 seconds).
[2025-10-24T18:23:57.747686] [INFO ] [REMOTE    ] DUKB: Fetching primary data for 2025-04.
[2025-10-24T18:23:58.455567] [INFO ] [REMOTE    ] DUKB: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T18:23:58.547739] [INFO ] [REMOTE    ] DUKB: Fetching primary data for 2025-05.
[2025-10-24T18:23:59.184484] [INFO ] [REMOTE    ] DUKB: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T18:23:59.347671] [INFO ] [REMOTE    ] DUKB: Fetching primary data for 2025-06.
[2025-10-24T18:24:00.034397] [INFO ] [REMOTE    ] DUKB: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T18:24:00.147677] [INFO ] [REMOTE    ] DTM: Fetching primary data for 2025-03.
[2025-10-24T18:24:00.947719] [INFO ] [REMOTE    ] DUK: Fetching primary data for 2025-04.
[2025-10-24T18:24:01.747852] [INFO ] [REMOTE    ] DUKB: Fetching primary data for 2025-07.
[2025-10-24T18:24:02.304510] [INFO ] [REMOTE    ] DTM: Incremental fetch complete for 2025-03 (2.16 seconds).
[2025-10-24T18:24:02.547725] [INFO ] [REMOTE    ] DTW: Fetching primary data for 2025-09.
[2025-10-24T18:24:03.347757] [INFO ] [REMOTE    ] DTM: Fetching primary data for 2025-04.
[2025-10-24T18:24:03.357665] [INFO ] [REMOTE    ] DUKB: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T18:24:04.077757] [INFO ] [REMOTE    ] DTW: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T18:24:04.147689] [INFO ] [REMOTE    ] DUKB: Fetching primary data for 2025-08.
[2025-10-24T18:24:04.655464] [INFO ] [REMOTE    ] DUK: Incremental fetch complete for 2025-04 (3.71 seconds).
[2025-10-24T18:24:04.863379] [INFO ] [REMOTE    ] DUKB: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T18:24:04.947634] [INFO ] [REMOTE    ] DTW: Fetching primary data for 2025-10.
[2025-10-24T18:24:05.236621] [INFO ] [REMOTE    ] DTM: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T18:24:05.741903] [INFO ] [REMOTE    ] DTW: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T18:24:05.743391] [INFO ] [REMOTE    ] DTW: Full fetch complete (6920 records).
[2025-10-24T18:24:05.743470] [DEBUG] [VALIDATOR ] DTW: Validating primary data.
[2025-10-24T18:24:05.755037] [INFO ] [REMOTE    ] DTM: Fetching primary data for 2025-05.
[2025-10-24T18:24:06.117581] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present.
[2025-10-24T18:24:06.117684] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed.
[2025-10-24T18:24:06.117900] [INFO ] [MAIN      ] DTW: Fetched primary data is valid.
[2025-10-24T18:24:06.117939] [DEBUG] [LOCAL     ] DTW: Saving primary data.
[2025-10-24T18:24:06.118126] [FATAL] [LOCAL     ] DTW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:24:06.118207] [FATAL] [MAIN      ] DTW: Failed to save primary data.
[2025-10-24T18:24:06.118249] [WARN ] [MAIN      ] DTW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:24:06.118282] [INFO ] [LOCAL     ] DTW: Starting deletion of primary data.
[2025-10-24T18:24:06.118330] [DEBUG] [LOCAL     ] DTW: No primary data file found to delete.
[2025-10-24T18:24:06.118369] [INFO ] [LOCAL     ] DTW: Starting deletion of derivative data.
[2025-10-24T18:24:06.118525] [DEBUG] [LOCAL     ] DTW: Deleted derivative data file.
[2025-10-24T18:24:06.118612] [INFO ] [MAIN      ] Update Progress: 664/2366 symbols completed. DTW took 25.3s. Estimated remaining: 3h 35m 27s. Rate: 7.9 symbols/min
[2025-10-24T18:24:06.288352] [INFO ] [MAIN      ] DV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:24:06.340044] [DEBUG] [LOCAL     ] DV: Loaded 51625 existing records from primary storage.
[2025-10-24T18:24:06.340351] [INFO ] [MAIN      ] DV: Loaded 51625 existing records.
[2025-10-24T18:24:06.520290] [WARN ] [MAIN      ] DV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:24:06.520614] [INFO ] [MAIN      ] DV: Wiping existing primary data before full refresh.
[2025-10-24T18:24:06.520696] [INFO ] [LOCAL     ] DV: Starting deletion of primary data.
[2025-10-24T18:24:06.521832] [DEBUG] [LOCAL     ] DV: Deleted primary data file.
[2025-10-24T18:24:06.521890] [INFO ] [MAIN      ] DV: Starting full primary refresh.
[2025-10-24T18:24:06.552792] [INFO ] [REMOTE    ] DUK: Fetching primary data for 2025-05.
[2025-10-24T18:24:06.880956] [INFO ] [REMOTE    ] DV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:24:07.347637] [INFO ] [REMOTE    ] DUKB: Fetching primary data for 2025-09.
[2025-10-24T18:24:07.439701] [INFO ] [REMOTE    ] DTM: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T18:24:07.781964] [INFO ] [REMOTE    ] DUKB: Incremental fetch complete for 2025-09 (0.43 seconds).
[2025-10-24T18:24:08.147625] [INFO ] [REMOTE    ] DUKB: Fetching primary data for 2025-10.
[2025-10-24T18:24:08.303548] [INFO ] [REMOTE    ] DUK: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T18:24:08.936430] [INFO ] [REMOTE    ] DUKB: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T18:24:08.941063] [INFO ] [REMOTE    ] DUKB: Full fetch complete (8953 records).
[2025-10-24T18:24:08.941192] [DEBUG] [VALIDATOR ] DUKB: Validating primary data.
[2025-10-24T18:24:08.952817] [INFO ] [REMOTE    ] DTM: Fetching primary data for 2025-06.
[2025-10-24T18:24:09.328856] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present.
[2025-10-24T18:24:09.328936] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed.
[2025-10-24T18:24:09.329149] [INFO ] [MAIN      ] DUKB: Fetched primary data is valid.
[2025-10-24T18:24:09.329185] [DEBUG] [LOCAL     ] DUKB: Saving primary data.
[2025-10-24T18:24:09.329399] [FATAL] [LOCAL     ] DUKB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:24:09.329483] [FATAL] [MAIN      ] DUKB: Failed to save primary data.
[2025-10-24T18:24:09.329525] [WARN ] [MAIN      ] DUKB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:24:09.329565] [INFO ] [LOCAL     ] DUKB: Starting deletion of primary data.
[2025-10-24T18:24:09.329680] [DEBUG] [LOCAL     ] DUKB: No primary data file found to delete.
[2025-10-24T18:24:09.329745] [INFO ] [LOCAL     ] DUKB: Starting deletion of derivative data.
[2025-10-24T18:24:09.329959] [DEBUG] [LOCAL     ] DUKB: Deleted derivative data file.
[2025-10-24T18:24:09.330077] [INFO ] [MAIN      ] Update Progress: 665/2366 symbols completed. DUKB took 21.6s. Estimated remaining: 3h 35m 8s. Rate: 7.9 symbols/min
[2025-10-24T18:24:09.512096] [INFO ] [MAIN      ] DVA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:24:09.553520] [DEBUG] [LOCAL     ] DVA: Loaded 40950 existing records from primary storage.
[2025-10-24T18:24:09.553865] [INFO ] [MAIN      ] DVA: Loaded 40950 existing records.
[2025-10-24T18:24:09.752880] [INFO ] [REMOTE    ] DUK: Fetching primary data for 2025-06.
[2025-10-24T18:24:09.758496] [WARN ] [MAIN      ] DVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:24:09.758796] [INFO ] [MAIN      ] DVA: Wiping existing primary data before full refresh.
[2025-10-24T18:24:09.758842] [INFO ] [LOCAL     ] DVA: Starting deletion of primary data.
[2025-10-24T18:24:09.759515] [DEBUG] [LOCAL     ] DVA: Deleted primary data file.
[2025-10-24T18:24:09.759572] [INFO ] [MAIN      ] DVA: Starting full primary refresh.
[2025-10-24T18:24:10.137387] [INFO ] [REMOTE    ] DVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:24:10.547626] [INFO ] [REMOTE    ] DVA: Fetching primary data for 2025-01.
[2025-10-24T18:24:11.088952] [INFO ] [REMOTE    ] DTM: Incremental fetch complete for 2025-06 (2.14 seconds).
[2025-10-24T18:24:11.347622] [INFO ] [REMOTE    ] DTM: Fetching primary data for 2025-07.
[2025-10-24T18:24:11.535441] [INFO ] [REMOTE    ] DUK: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T18:24:12.147723] [INFO ] [REMOTE    ] DV: Fetching primary data for 2025-01.
[2025-10-24T18:24:12.215339] [INFO ] [REMOTE    ] DVA: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T18:24:12.605474] [INFO ] [REMOTE    ] DTM: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T18:24:12.947734] [INFO ] [REMOTE    ] DUK: Fetching primary data for 2025-07.
[2025-10-24T18:24:13.747696] [INFO ] [REMOTE    ] DVA: Fetching primary data for 2025-02.
[2025-10-24T18:24:13.804348] [INFO ] [REMOTE    ] DV: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T18:24:14.547725] [INFO ] [REMOTE    ] DTM: Fetching primary data for 2025-08.
[2025-10-24T18:24:14.715675] [INFO ] [REMOTE    ] DUK: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T18:24:14.911251] [INFO ] [REMOTE    ] DVA: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T18:24:15.347716] [INFO ] [REMOTE    ] DUK: Fetching primary data for 2025-08.
[2025-10-24T18:24:15.773167] [INFO ] [REMOTE    ] DTM: Incremental fetch complete for 2025-08 (1.23 seconds).
[2025-10-24T18:24:16.147740] [INFO ] [REMOTE    ] DV: Fetching primary data for 2025-02.
[2025-10-24T18:24:16.947726] [INFO ] [REMOTE    ] DTM: Fetching primary data for 2025-09.
[2025-10-24T18:24:17.252058] [INFO ] [REMOTE    ] DUK: Incremental fetch complete for 2025-08 (1.90 seconds).
[2025-10-24T18:24:17.635723] [INFO ] [REMOTE    ] DV: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T18:24:17.747608] [INFO ] [REMOTE    ] DV: Fetching primary data for 2025-03.
[2025-10-24T18:24:18.197447] [INFO ] [REMOTE    ] DTM: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T18:24:18.547726] [INFO ] [REMOTE    ] DUK: Fetching primary data for 2025-09.
[2025-10-24T18:24:19.347689] [INFO ] [REMOTE    ] DVA: Fetching primary data for 2025-03.
[2025-10-24T18:24:20.024683] [INFO ] [REMOTE    ] DV: Incremental fetch complete for 2025-03 (2.28 seconds).
[2025-10-24T18:24:20.147617] [INFO ] [REMOTE    ] DV: Fetching primary data for 2025-04.
[2025-10-24T18:24:20.266417] [INFO ] [REMOTE    ] DUK: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T18:24:20.947618] [INFO ] [REMOTE    ] DTM: Fetching primary data for 2025-10.
[2025-10-24T18:24:21.103933] [INFO ] [REMOTE    ] DVA: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T18:24:21.733539] [INFO ] [REMOTE    ] DV: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T18:24:21.747604] [INFO ] [REMOTE    ] DV: Fetching primary data for 2025-05.
[2025-10-24T18:24:22.464351] [INFO ] [REMOTE    ] DTM: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T18:24:22.472903] [INFO ] [REMOTE    ] DTM: Full fetch complete (64923 records).
[2025-10-24T18:24:22.473030] [DEBUG] [VALIDATOR ] DTM: Validating primary data.
[2025-10-24T18:24:22.473824] [FATAL] [VALIDATOR ] DTM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:24:22.473929] [FATAL] [MAIN      ] DTM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:24:22.474004] [WARN ] [MAIN      ] DTM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:24:22.474098] [INFO ] [LOCAL     ] DTM: Starting deletion of primary data.
[2025-10-24T18:24:22.474175] [DEBUG] [LOCAL     ] DTM: No primary data file found to delete.
[2025-10-24T18:24:22.474214] [INFO ] [LOCAL     ] DTM: Starting deletion of derivative data.
[2025-10-24T18:24:22.474343] [DEBUG] [LOCAL     ] DTM: Deleted derivative data file.
[2025-10-24T18:24:22.474587] [INFO ] [MAIN      ] Update Progress: 666/2366 symbols completed. DTM took 41.8s. Estimated remaining: 3h 35m 15s. Rate: 7.9 symbols/min
[2025-10-24T18:24:22.557209] [INFO ] [REMOTE    ] DVA: Fetching primary data for 2025-04.
[2025-10-24T18:24:22.658783] [INFO ] [MAIN      ] DVN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:24:22.710818] [DEBUG] [LOCAL     ] DVN: Loaded 54089 existing records from primary storage.
[2025-10-24T18:24:22.711332] [INFO ] [MAIN      ] DVN: Loaded 54089 existing records.
[2025-10-24T18:24:22.916834] [WARN ] [MAIN      ] DVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:24:22.917062] [INFO ] [MAIN      ] DVN: Wiping existing primary data before full refresh.
[2025-10-24T18:24:22.917152] [INFO ] [LOCAL     ] DVN: Starting deletion of primary data.
[2025-10-24T18:24:22.918299] [DEBUG] [LOCAL     ] DVN: Deleted primary data file.
[2025-10-24T18:24:22.918360] [INFO ] [MAIN      ] DVN: Starting full primary refresh.
[2025-10-24T18:24:23.332586] [INFO ] [REMOTE    ] DVN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:24:23.356432] [INFO ] [REMOTE    ] DVN: Fetching primary data for 2025-01.
[2025-10-24T18:24:23.361637] [INFO ] [REMOTE    ] DV: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T18:24:24.147713] [INFO ] [REMOTE    ] DV: Fetching primary data for 2025-06.
[2025-10-24T18:24:24.352236] [INFO ] [REMOTE    ] DVA: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T18:24:24.947674] [INFO ] [REMOTE    ] DVA: Fetching primary data for 2025-05.
[2025-10-24T18:24:25.291494] [INFO ] [REMOTE    ] DVN: Incremental fetch complete for 2025-01 (1.94 seconds).
[2025-10-24T18:24:25.747724] [INFO ] [REMOTE    ] DUK: Fetching primary data for 2025-10.
[2025-10-24T18:24:25.792893] [INFO ] [REMOTE    ] DV: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T18:24:26.409536] [INFO ] [REMOTE    ] DVA: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T18:24:26.547625] [INFO ] [REMOTE    ] DVA: Fetching primary data for 2025-06.
[2025-10-24T18:24:27.347612] [INFO ] [REMOTE    ] DV: Fetching primary data for 2025-07.
[2025-10-24T18:24:27.798710] [INFO ] [REMOTE    ] DUK: Incremental fetch complete for 2025-10 (2.05 seconds).
[2025-10-24T18:24:27.808772] [INFO ] [REMOTE    ] DUK: Full fetch complete (77560 records).
[2025-10-24T18:24:27.808906] [DEBUG] [VALIDATOR ] DUK: Validating primary data.
[2025-10-24T18:24:28.167769] [INFO ] [REMOTE    ] DVN: Fetching primary data for 2025-02.
[2025-10-24T18:24:28.217395] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present.
[2025-10-24T18:24:28.217627] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed.
[2025-10-24T18:24:28.218661] [INFO ] [MAIN      ] DUK: Fetched primary data is valid.
[2025-10-24T18:24:28.218809] [DEBUG] [LOCAL     ] DUK: Saving primary data.
[2025-10-24T18:24:28.227257] [FATAL] [LOCAL     ] DUK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:24:28.238720] [FATAL] [MAIN      ] DUK: Failed to save primary data.
[2025-10-24T18:24:28.241125] [WARN ] [MAIN      ] DUK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:24:28.241225] [INFO ] [LOCAL     ] DUK: Starting deletion of primary data.
[2025-10-24T18:24:28.241304] [DEBUG] [LOCAL     ] DUK: No primary data file found to delete.
[2025-10-24T18:24:28.242677] [INFO ] [REMOTE    ] DVA: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T18:24:28.241925] [INFO ] [LOCAL     ] DUK: Starting deletion of derivative data.
[2025-10-24T18:24:28.250868] [DEBUG] [LOCAL     ] DUK: Deleted derivative data file.
[2025-10-24T18:24:28.251154] [INFO ] [MAIN      ] Update Progress: 667/2366 symbols completed. DUK took 42.0s. Estimated remaining: 3h 35m 3s. Rate: 7.9 symbols/min
[2025-10-24T18:24:28.425979] [INFO ] [MAIN      ] DX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:24:28.490003] [DEBUG] [LOCAL     ] DX: Loaded 52920 existing records from primary storage.
[2025-10-24T18:24:28.490337] [INFO ] [MAIN      ] DX: Loaded 52920 existing records.
[2025-10-24T18:24:28.702403] [WARN ] [MAIN      ] DX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:24:28.702666] [INFO ] [MAIN      ] DX: Wiping existing primary data before full refresh.
[2025-10-24T18:24:28.702736] [INFO ] [LOCAL     ] DX: Starting deletion of primary data.
[2025-10-24T18:24:28.702935] [DEBUG] [LOCAL     ] DX: Deleted primary data file.
[2025-10-24T18:24:28.702974] [INFO ] [MAIN      ] DX: Starting full primary refresh.
[2025-10-24T18:24:28.966047] [INFO ] [REMOTE    ] DVA: Fetching primary data for 2025-07.
[2025-10-24T18:24:29.100823] [INFO ] [REMOTE    ] DX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:24:29.102929] [INFO ] [REMOTE    ] DV: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T18:24:29.747615] [INFO ] [REMOTE    ] DX: Fetching primary data for 2025-01.
[2025-10-24T18:24:29.985724] [INFO ] [REMOTE    ] DVN: Incremental fetch complete for 2025-02 (1.82 seconds).
[2025-10-24T18:24:30.527269] [INFO ] [REMOTE    ] DVA: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T18:24:30.547631] [INFO ] [REMOTE    ] DVA: Fetching primary data for 2025-08.
[2025-10-24T18:24:31.347617] [INFO ] [REMOTE    ] DV: Fetching primary data for 2025-08.
[2025-10-24T18:24:32.079591] [INFO ] [REMOTE    ] DVA: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T18:24:32.144552] [INFO ] [REMOTE    ] DX: Incremental fetch complete for 2025-01 (2.40 seconds).
[2025-10-24T18:24:32.154452] [INFO ] [REMOTE    ] DVA: Fetching primary data for 2025-09.
[2025-10-24T18:24:32.947710] [INFO ] [REMOTE    ] DVN: Fetching primary data for 2025-03.
[2025-10-24T18:24:33.022738] [INFO ] [REMOTE    ] DV: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T18:24:33.594104] [INFO ] [REMOTE    ] DVA: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T18:24:33.747623] [INFO ] [REMOTE    ] DVA: Fetching primary data for 2025-10.
[2025-10-24T18:24:34.438993] [INFO ] [REMOTE    ] DVN: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T18:24:34.547712] [INFO ] [REMOTE    ] DVN: Fetching primary data for 2025-04.
[2025-10-24T18:24:35.347711] [INFO ] [REMOTE    ] DX: Fetching primary data for 2025-02.
[2025-10-24T18:24:35.526174] [INFO ] [REMOTE    ] DVA: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T18:24:35.533924] [INFO ] [REMOTE    ] DVA: Full fetch complete (59599 records).
[2025-10-24T18:24:35.534112] [DEBUG] [VALIDATOR ] DVA: Validating primary data.
[2025-10-24T18:24:35.941592] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present.
[2025-10-24T18:24:35.941744] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed.
[2025-10-24T18:24:35.942854] [INFO ] [MAIN      ] DVA: Fetched primary data is valid.
[2025-10-24T18:24:35.942923] [DEBUG] [LOCAL     ] DVA: Saving primary data.
[2025-10-24T18:24:35.943846] [FATAL] [LOCAL     ] DVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:24:35.943947] [FATAL] [MAIN      ] DVA: Failed to save primary data.
[2025-10-24T18:24:35.943990] [WARN ] [MAIN      ] DVA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:24:35.944029] [INFO ] [LOCAL     ] DVA: Starting deletion of primary data.
[2025-10-24T18:24:35.944091] [DEBUG] [LOCAL     ] DVA: No primary data file found to delete.
[2025-10-24T18:24:35.944130] [INFO ] [LOCAL     ] DVA: Starting deletion of derivative data.
[2025-10-24T18:24:35.944348] [DEBUG] [LOCAL     ] DVA: Deleted derivative data file.
[2025-10-24T18:24:35.944626] [INFO ] [MAIN      ] Update Progress: 668/2366 symbols completed. DVA took 26.6s. Estimated remaining: 3h 34m 55s. Rate: 7.9 symbols/min
[2025-10-24T18:24:36.153334] [INFO ] [REMOTE    ] DV: Fetching primary data for 2025-09.
[2025-10-24T18:24:36.156947] [INFO ] [MAIN      ] DXC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:24:36.220692] [DEBUG] [LOCAL     ] DXC: Loaded 50264 existing records from primary storage.
[2025-10-24T18:24:36.221215] [INFO ] [MAIN      ] DXC: Loaded 50264 existing records.
[2025-10-24T18:24:36.429421] [WARN ] [MAIN      ] DXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:24:36.429818] [INFO ] [MAIN      ] DXC: Wiping existing primary data before full refresh.
[2025-10-24T18:24:36.429896] [INFO ] [LOCAL     ] DXC: Starting deletion of primary data.
[2025-10-24T18:24:36.430863] [DEBUG] [LOCAL     ] DXC: Deleted primary data file.
[2025-10-24T18:24:36.430926] [INFO ] [MAIN      ] DXC: Starting full primary refresh.
[2025-10-24T18:24:36.849421] [INFO ] [REMOTE    ] DXC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:24:36.877854] [INFO ] [REMOTE    ] DX: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T18:24:36.917760] [INFO ] [REMOTE    ] DVN: Incremental fetch complete for 2025-04 (2.37 seconds).
[2025-10-24T18:24:36.947628] [INFO ] [REMOTE    ] DX: Fetching primary data for 2025-03.
[2025-10-24T18:24:37.747630] [INFO ] [REMOTE    ] DXC: Fetching primary data for 2025-01.
[2025-10-24T18:24:37.777952] [INFO ] [REMOTE    ] DV: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T18:24:38.547728] [INFO ] [REMOTE    ] DV: Fetching primary data for 2025-10.
[2025-10-24T18:24:38.639413] [INFO ] [REMOTE    ] DX: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T18:24:39.352760] [INFO ] [REMOTE    ] DVN: Fetching primary data for 2025-05.
[2025-10-24T18:24:39.365425] [INFO ] [REMOTE    ] DXC: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T18:24:40.147702] [INFO ] [REMOTE    ] DXC: Fetching primary data for 2025-02.
[2025-10-24T18:24:40.351364] [INFO ] [REMOTE    ] DV: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T18:24:40.360751] [INFO ] [REMOTE    ] DV: Full fetch complete (73904 records).
[2025-10-24T18:24:40.360878] [DEBUG] [VALIDATOR ] DV: Validating primary data.
[2025-10-24T18:24:40.757173] [DEBUG] [VALIDATOR ] DV: All expected trading days are present.
[2025-10-24T18:24:40.757280] [DEBUG] [VALIDATOR ] DV: Primary data validation passed.
[2025-10-24T18:24:40.758214] [INFO ] [MAIN      ] DV: Fetched primary data is valid.
[2025-10-24T18:24:40.758293] [DEBUG] [LOCAL     ] DV: Saving primary data.
[2025-10-24T18:24:40.758965] [FATAL] [LOCAL     ] DV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:24:40.759061] [FATAL] [MAIN      ] DV: Failed to save primary data.
[2025-10-24T18:24:40.759103] [WARN ] [MAIN      ] DV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:24:40.759138] [INFO ] [LOCAL     ] DV: Starting deletion of primary data.
[2025-10-24T18:24:40.759191] [DEBUG] [LOCAL     ] DV: No primary data file found to delete.
[2025-10-24T18:24:40.759227] [INFO ] [LOCAL     ] DV: Starting deletion of derivative data.
[2025-10-24T18:24:40.759354] [DEBUG] [LOCAL     ] DV: Deleted derivative data file.
[2025-10-24T18:24:40.759830] [INFO ] [MAIN      ] Update Progress: 669/2366 symbols completed. DV took 34.6s. Estimated remaining: 3h 34m 41s. Rate: 7.9 symbols/min
[2025-10-24T18:24:40.932577] [INFO ] [MAIN      ] DXYZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:24:40.954064] [INFO ] [REMOTE    ] DX: Fetching primary data for 2025-04.
[2025-10-24T18:24:40.973752] [DEBUG] [LOCAL     ] DXYZ: Loaded 37304 existing records from primary storage.
[2025-10-24T18:24:40.974045] [INFO ] [MAIN      ] DXYZ: Loaded 37304 existing records.
[2025-10-24T18:24:41.158904] [WARN ] [MAIN      ] DXYZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:24:41.159246] [INFO ] [MAIN      ] DXYZ: Wiping existing primary data before full refresh.
[2025-10-24T18:24:41.159329] [INFO ] [LOCAL     ] DXYZ: Starting deletion of primary data.
[2025-10-24T18:24:41.159827] [DEBUG] [LOCAL     ] DXYZ: Deleted primary data file.
[2025-10-24T18:24:41.159887] [INFO ] [MAIN      ] DXYZ: Starting full primary refresh.
[2025-10-24T18:24:41.530494] [INFO ] [REMOTE    ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:24:41.560421] [INFO ] [REMOTE    ] DVN: Incremental fetch complete for 2025-05 (2.21 seconds).
[2025-10-24T18:24:41.688370] [INFO ] [REMOTE    ] DXC: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T18:24:41.747601] [INFO ] [REMOTE    ] DXC: Fetching primary data for 2025-03.
[2025-10-24T18:24:42.547618] [INFO ] [REMOTE    ] DVN: Fetching primary data for 2025-06.
[2025-10-24T18:24:42.756213] [INFO ] [REMOTE    ] DX: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T18:24:42.859777] [INFO ] [REMOTE    ] DXC: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T18:24:43.347723] [INFO ] [REMOTE    ] DXYZ: Fetching primary data for 2025-01.
[2025-10-24T18:24:44.147623] [INFO ] [REMOTE    ] DX: Fetching primary data for 2025-05.
[2025-10-24T18:24:44.315380] [INFO ] [REMOTE    ] DVN: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T18:24:44.947730] [INFO ] [REMOTE    ] DXC: Fetching primary data for 2025-04.
[2025-10-24T18:24:45.519798] [INFO ] [REMOTE    ] DXYZ: Incremental fetch complete for 2025-01 (2.17 seconds).
[2025-10-24T18:24:45.747698] [INFO ] [REMOTE    ] DXYZ: Fetching primary data for 2025-02.
[2025-10-24T18:24:45.847164] [INFO ] [REMOTE    ] DX: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T18:24:46.273105] [INFO ] [REMOTE    ] DXC: Incremental fetch complete for 2025-04 (1.33 seconds).
[2025-10-24T18:24:46.547741] [INFO ] [REMOTE    ] DX: Fetching primary data for 2025-06.
[2025-10-24T18:24:47.347735] [INFO ] [REMOTE    ] DXC: Fetching primary data for 2025-05.
[2025-10-24T18:24:47.466394] [INFO ] [REMOTE    ] DXYZ: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T18:24:48.147716] [INFO ] [REMOTE    ] DVN: Fetching primary data for 2025-07.
[2025-10-24T18:24:48.273247] [INFO ] [REMOTE    ] DX: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T18:24:48.585694] [INFO ] [REMOTE    ] DXC: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T18:24:48.947626] [INFO ] [REMOTE    ] DXC: Fetching primary data for 2025-06.
[2025-10-24T18:24:49.747733] [INFO ] [REMOTE    ] DXYZ: Fetching primary data for 2025-03.
[2025-10-24T18:24:50.326014] [INFO ] [REMOTE    ] DVN: Incremental fetch complete for 2025-07 (2.18 seconds).
[2025-10-24T18:24:50.547618] [INFO ] [REMOTE    ] DVN: Fetching primary data for 2025-08.
[2025-10-24T18:24:50.642609] [INFO ] [REMOTE    ] DXC: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T18:24:51.286836] [INFO ] [REMOTE    ] DXYZ: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T18:24:51.347608] [INFO ] [REMOTE    ] DX: Fetching primary data for 2025-07.
[2025-10-24T18:24:52.147710] [INFO ] [REMOTE    ] DXC: Fetching primary data for 2025-07.
[2025-10-24T18:24:52.328965] [INFO ] [REMOTE    ] DVN: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T18:24:52.947729] [INFO ] [REMOTE    ] DXYZ: Fetching primary data for 2025-04.
[2025-10-24T18:24:53.439766] [INFO ] [REMOTE    ] DXC: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T18:24:53.483162] [INFO ] [REMOTE    ] DX: Incremental fetch complete for 2025-07 (2.14 seconds).
[2025-10-24T18:24:53.747719] [INFO ] [REMOTE    ] DXC: Fetching primary data for 2025-08.
[2025-10-24T18:24:54.547625] [INFO ] [REMOTE    ] DX: Fetching primary data for 2025-08.
[2025-10-24T18:24:54.621334] [INFO ] [REMOTE    ] DXYZ: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T18:24:55.328992] [INFO ] [REMOTE    ] DXC: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T18:24:55.347600] [INFO ] [REMOTE    ] DXC: Fetching primary data for 2025-09.
[2025-10-24T18:24:56.045925] [INFO ] [REMOTE    ] DX: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T18:24:56.147633] [INFO ] [REMOTE    ] DX: Fetching primary data for 2025-09.
[2025-10-24T18:24:56.958896] [INFO ] [REMOTE    ] DVN: Fetching primary data for 2025-09.
[2025-10-24T18:24:56.961723] [INFO ] [REMOTE    ] DXC: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T18:24:57.747628] [INFO ] [REMOTE    ] DXYZ: Fetching primary data for 2025-05.
[2025-10-24T18:24:57.912087] [INFO ] [REMOTE    ] DX: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T18:24:58.547743] [INFO ] [REMOTE    ] DX: Fetching primary data for 2025-10.
[2025-10-24T18:24:58.825160] [INFO ] [REMOTE    ] DVN: Incremental fetch complete for 2025-09 (1.87 seconds).
[2025-10-24T18:24:59.347689] [INFO ] [REMOTE    ] DXC: Fetching primary data for 2025-10.
[2025-10-24T18:24:59.652857] [INFO ] [REMOTE    ] DXYZ: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T18:25:00.147722] [INFO ] [REMOTE    ] DXYZ: Fetching primary data for 2025-06.
[2025-10-24T18:25:00.436886] [INFO ] [REMOTE    ] DX: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T18:25:00.446500] [INFO ] [REMOTE    ] DX: Full fetch complete (75917 records).
[2025-10-24T18:25:00.446636] [DEBUG] [VALIDATOR ] DX: Validating primary data.
[2025-10-24T18:25:00.828331] [DEBUG] [VALIDATOR ] DX: All expected trading days are present.
[2025-10-24T18:25:00.828443] [DEBUG] [VALIDATOR ] DX: Primary data validation passed.
[2025-10-24T18:25:00.829362] [INFO ] [MAIN      ] DX: Fetched primary data is valid.
[2025-10-24T18:25:00.829426] [DEBUG] [LOCAL     ] DX: Saving primary data.
[2025-10-24T18:25:00.830089] [FATAL] [LOCAL     ] DX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:25:00.830176] [FATAL] [MAIN      ] DX: Failed to save primary data.
[2025-10-24T18:25:00.830219] [WARN ] [MAIN      ] DX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:25:00.830255] [INFO ] [LOCAL     ] DX: Starting deletion of primary data.
[2025-10-24T18:25:00.830308] [DEBUG] [LOCAL     ] DX: No primary data file found to delete.
[2025-10-24T18:25:00.830344] [INFO ] [LOCAL     ] DX: Starting deletion of derivative data.
[2025-10-24T18:25:00.830493] [DEBUG] [LOCAL     ] DX: Deleted derivative data file.
[2025-10-24T18:25:00.830808] [INFO ] [MAIN      ] Update Progress: 670/2366 symbols completed. DX took 32.6s. Estimated remaining: 3h 35m 5s. Rate: 7.9 symbols/min
[2025-10-24T18:25:00.952930] [INFO ] [REMOTE    ] DVN: Fetching primary data for 2025-10.
[2025-10-24T18:25:00.999008] [INFO ] [MAIN      ] DY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:25:01.027696] [DEBUG] [LOCAL     ] DY: Loaded 28151 existing records from primary storage.
[2025-10-24T18:25:01.027958] [INFO ] [MAIN      ] DY: Loaded 28151 existing records.
[2025-10-24T18:25:01.206201] [WARN ] [MAIN      ] DY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:25:01.206480] [INFO ] [MAIN      ] DY: Wiping existing primary data before full refresh.
[2025-10-24T18:25:01.206570] [INFO ] [LOCAL     ] DY: Starting deletion of primary data.
[2025-10-24T18:25:01.206888] [DEBUG] [LOCAL     ] DY: Deleted primary data file.
[2025-10-24T18:25:01.206935] [INFO ] [MAIN      ] DY: Starting full primary refresh.
[2025-10-24T18:25:01.582288] [INFO ] [REMOTE    ] DY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:25:01.605482] [INFO ] [REMOTE    ] DXC: Incremental fetch complete for 2025-10 (2.26 seconds).
[2025-10-24T18:25:01.614435] [INFO ] [REMOTE    ] DXC: Full fetch complete (70407 records).
[2025-10-24T18:25:01.614553] [DEBUG] [VALIDATOR ] DXC: Validating primary data.
[2025-10-24T18:25:01.755348] [INFO ] [REMOTE    ] DY: Fetching primary data for 2025-01.
[2025-10-24T18:25:02.043379] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present.
[2025-10-24T18:25:02.043471] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed.
[2025-10-24T18:25:02.044413] [INFO ] [MAIN      ] DXC: Fetched primary data is valid.
[2025-10-24T18:25:02.044479] [DEBUG] [LOCAL     ] DXC: Saving primary data.
[2025-10-24T18:25:02.045353] [FATAL] [LOCAL     ] DXC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:25:02.045459] [FATAL] [MAIN      ] DXC: Failed to save primary data.
[2025-10-24T18:25:02.045532] [WARN ] [MAIN      ] DXC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:25:02.045619] [INFO ] [LOCAL     ] DXC: Starting deletion of primary data.
[2025-10-24T18:25:02.045734] [DEBUG] [LOCAL     ] DXC: No primary data file found to delete.
[2025-10-24T18:25:02.045786] [INFO ] [LOCAL     ] DXC: Starting deletion of derivative data.
[2025-10-24T18:25:02.045920] [DEBUG] [LOCAL     ] DXC: Deleted derivative data file.
[2025-10-24T18:25:02.046555] [INFO ] [MAIN      ] Update Progress: 671/2366 symbols completed. DXC took 26.1s. Estimated remaining: 3h 34m 41s. Rate: 7.9 symbols/min
[2025-10-24T18:25:02.238195] [INFO ] [MAIN      ] E: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:25:02.272748] [DEBUG] [LOCAL     ] E: Loaded 33399 existing records from primary storage.
[2025-10-24T18:25:02.273035] [INFO ] [MAIN      ] E: Loaded 33399 existing records.
[2025-10-24T18:25:02.466847] [WARN ] [MAIN      ] E: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:25:02.467265] [INFO ] [MAIN      ] E: Wiping existing primary data before full refresh.
[2025-10-24T18:25:02.467340] [INFO ] [LOCAL     ] E: Starting deletion of primary data.
[2025-10-24T18:25:02.467868] [DEBUG] [LOCAL     ] E: Deleted primary data file.
[2025-10-24T18:25:02.467929] [INFO ] [MAIN      ] E: Starting full primary refresh.
[2025-10-24T18:25:02.623625] [INFO ] [REMOTE    ] DXYZ: Incremental fetch complete for 2025-06 (2.48 seconds).
[2025-10-24T18:25:02.684681] [INFO ] [REMOTE    ] DXYZ: Fetching primary data for 2025-07.
[2025-10-24T18:25:02.870994] [INFO ] [REMOTE    ] E: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:25:03.347667] [INFO ] [REMOTE    ] E: Fetching primary data for 2025-01.
[2025-10-24T18:25:03.901590] [INFO ] [REMOTE    ] DY: Incremental fetch complete for 2025-01 (2.15 seconds).
[2025-10-24T18:25:04.147676] [INFO ] [REMOTE    ] DY: Fetching primary data for 2025-02.
[2025-10-24T18:25:04.306868] [INFO ] [REMOTE    ] DVN: Incremental fetch complete for 2025-10 (3.35 seconds).
[2025-10-24T18:25:04.319560] [INFO ] [REMOTE    ] DVN: Full fetch complete (77879 records).
[2025-10-24T18:25:04.319795] [DEBUG] [VALIDATOR ] DVN: Validating primary data.
[2025-10-24T18:25:04.752376] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present.
[2025-10-24T18:25:04.752498] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed.
[2025-10-24T18:25:04.753732] [INFO ] [MAIN      ] DVN: Fetched primary data is valid.
[2025-10-24T18:25:04.753810] [DEBUG] [LOCAL     ] DVN: Saving primary data.
[2025-10-24T18:25:04.754526] [FATAL] [LOCAL     ] DVN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:25:04.754674] [FATAL] [MAIN      ] DVN: Failed to save primary data.
[2025-10-24T18:25:04.754749] [WARN ] [MAIN      ] DVN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:25:04.754833] [INFO ] [LOCAL     ] DVN: Starting deletion of primary data.
[2025-10-24T18:25:04.754919] [DEBUG] [LOCAL     ] DVN: No primary data file found to delete.
[2025-10-24T18:25:04.754968] [INFO ] [LOCAL     ] DVN: Starting deletion of derivative data.
[2025-10-24T18:25:04.755133] [DEBUG] [LOCAL     ] DVN: Deleted derivative data file.
[2025-10-24T18:25:04.755754] [INFO ] [MAIN      ] Update Progress: 672/2366 symbols completed. DVN took 42.3s. Estimated remaining: 3h 34m 21s. Rate: 7.9 symbols/min
[2025-10-24T18:25:04.950262] [INFO ] [MAIN      ] EAF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:25:04.990370] [DEBUG] [LOCAL     ] EAF: Loaded 41113 existing records from primary storage.
[2025-10-24T18:25:04.990767] [INFO ] [MAIN      ] EAF: Loaded 41113 existing records.
[2025-10-24T18:25:05.198440] [WARN ] [MAIN      ] EAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:25:05.198988] [INFO ] [MAIN      ] EAF: Wiping existing primary data before full refresh.
[2025-10-24T18:25:05.219670] [INFO ] [LOCAL     ] EAF: Starting deletion of primary data.
[2025-10-24T18:25:05.221364] [INFO ] [REMOTE    ] DXYZ: Incremental fetch complete for 2025-07 (2.54 seconds).
[2025-10-24T18:25:05.229369] [DEBUG] [LOCAL     ] EAF: Deleted primary data file.
[2025-10-24T18:25:05.230390] [INFO ] [REMOTE    ] DXYZ: Fetching primary data for 2025-08.
[2025-10-24T18:25:05.230520] [INFO ] [MAIN      ] EAF: Starting full primary refresh.
[2025-10-24T18:25:05.302885] [INFO ] [REMOTE    ] E: Incremental fetch complete for 2025-01 (1.96 seconds).
[2025-10-24T18:25:05.635021] [INFO ] [REMOTE    ] EAF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:25:05.747623] [INFO ] [REMOTE    ] E: Fetching primary data for 2025-02.
[2025-10-24T18:25:05.781699] [INFO ] [REMOTE    ] DY: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T18:25:06.547637] [INFO ] [REMOTE    ] DY: Fetching primary data for 2025-03.
[2025-10-24T18:25:07.161398] [INFO ] [REMOTE    ] E: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T18:25:07.265393] [INFO ] [REMOTE    ] DXYZ: Incremental fetch complete for 2025-08 (2.03 seconds).
[2025-10-24T18:25:07.347678] [INFO ] [REMOTE    ] DXYZ: Fetching primary data for 2025-09.
[2025-10-24T18:25:07.610785] [INFO ] [REMOTE    ] DY: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T18:25:08.147676] [INFO ] [REMOTE    ] E: Fetching primary data for 2025-03.
[2025-10-24T18:25:08.947690] [INFO ] [REMOTE    ] EAF: Fetching primary data for 2025-01.
[2025-10-24T18:25:09.080046] [INFO ] [REMOTE    ] DXYZ: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T18:25:09.469879] [INFO ] [REMOTE    ] E: Incremental fetch complete for 2025-03 (1.32 seconds).
[2025-10-24T18:25:09.747672] [INFO ] [REMOTE    ] E: Fetching primary data for 2025-04.
[2025-10-24T18:25:10.547634] [INFO ] [REMOTE    ] DY: Fetching primary data for 2025-04.
[2025-10-24T18:25:10.620417] [INFO ] [REMOTE    ] EAF: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T18:25:11.347672] [INFO ] [REMOTE    ] EAF: Fetching primary data for 2025-02.
[2025-10-24T18:25:11.423894] [INFO ] [REMOTE    ] E: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T18:25:11.896626] [INFO ] [REMOTE    ] DY: Incremental fetch complete for 2025-04 (1.35 seconds).
[2025-10-24T18:25:12.147636] [INFO ] [REMOTE    ] E: Fetching primary data for 2025-05.
[2025-10-24T18:25:12.781328] [INFO ] [REMOTE    ] EAF: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T18:25:12.947707] [INFO ] [REMOTE    ] DXYZ: Fetching primary data for 2025-10.
[2025-10-24T18:25:13.198831] [INFO ] [REMOTE    ] E: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T18:25:13.747687] [INFO ] [REMOTE    ] EAF: Fetching primary data for 2025-03.
[2025-10-24T18:25:14.547690] [INFO ] [REMOTE    ] DY: Fetching primary data for 2025-05.
[2025-10-24T18:25:15.307742] [INFO ] [REMOTE    ] DXYZ: Incremental fetch complete for 2025-10 (2.36 seconds).
[2025-10-24T18:25:15.315486] [INFO ] [REMOTE    ] DXYZ: Full fetch complete (56273 records).
[2025-10-24T18:25:15.315606] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data.
[2025-10-24T18:25:15.316434] [FATAL] [VALIDATOR ] DXYZ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:25:15.316532] [FATAL] [MAIN      ] DXYZ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:25:15.316591] [WARN ] [MAIN      ] DXYZ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:25:15.316689] [INFO ] [LOCAL     ] DXYZ: Starting deletion of primary data.
[2025-10-24T18:25:15.316763] [DEBUG] [LOCAL     ] DXYZ: No primary data file found to delete.
[2025-10-24T18:25:15.316802] [INFO ] [LOCAL     ] DXYZ: Starting deletion of derivative data.
[2025-10-24T18:25:15.316924] [DEBUG] [LOCAL     ] DXYZ: Deleted derivative data file.
[2025-10-24T18:25:15.317216] [INFO ] [MAIN      ] Update Progress: 673/2366 symbols completed. DXYZ took 34.6s. Estimated remaining: 3h 34m 21s. Rate: 7.9 symbols/min
[2025-10-24T18:25:15.357503] [INFO ] [REMOTE    ] E: Fetching primary data for 2025-06.
[2025-10-24T18:25:15.514237] [INFO ] [MAIN      ] EAI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:25:15.548035] [DEBUG] [LOCAL     ] EAI: Loaded 3938 existing records from primary storage.
[2025-10-24T18:25:15.547725] [INFO ] [REMOTE    ] EAF: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T18:25:15.548279] [INFO ] [MAIN      ] EAI: Loaded 3938 existing records.
[2025-10-24T18:25:15.761022] [WARN ] [MAIN      ] EAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:25:15.761263] [INFO ] [MAIN      ] EAI: Wiping existing primary data before full refresh.
[2025-10-24T18:25:15.761310] [INFO ] [LOCAL     ] EAI: Starting deletion of primary data.
[2025-10-24T18:25:15.761494] [DEBUG] [LOCAL     ] EAI: Deleted primary data file.
[2025-10-24T18:25:15.761532] [INFO ] [MAIN      ] EAI: Starting full primary refresh.
[2025-10-24T18:25:16.147687] [INFO ] [REMOTE    ] EAF: Fetching primary data for 2025-04.
[2025-10-24T18:25:16.149803] [INFO ] [REMOTE    ] DY: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T18:25:16.201006] [INFO ] [REMOTE    ] EAI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:25:16.947633] [INFO ] [REMOTE    ] DY: Fetching primary data for 2025-06.
[2025-10-24T18:25:17.162205] [INFO ] [REMOTE    ] E: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T18:25:17.747624] [INFO ] [REMOTE    ] E: Fetching primary data for 2025-07.
[2025-10-24T18:25:17.809242] [INFO ] [REMOTE    ] EAF: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T18:25:17.878383] [INFO ] [REMOTE    ] DY: Incremental fetch complete for 2025-06 (0.93 seconds).
[2025-10-24T18:25:18.547679] [INFO ] [REMOTE    ] EAF: Fetching primary data for 2025-05.
[2025-10-24T18:25:18.779393] [INFO ] [REMOTE    ] E: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T18:25:19.347637] [INFO ] [REMOTE    ] E: Fetching primary data for 2025-08.
[2025-10-24T18:25:20.031399] [INFO ] [REMOTE    ] EAF: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T18:25:20.147709] [INFO ] [REMOTE    ] EAF: Fetching primary data for 2025-06.
[2025-10-24T18:25:20.554134] [INFO ] [REMOTE    ] E: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T18:25:20.947684] [INFO ] [REMOTE    ] DY: Fetching primary data for 2025-07.
[2025-10-24T18:25:21.747623] [INFO ] [REMOTE    ] E: Fetching primary data for 2025-09.
[2025-10-24T18:25:22.011701] [INFO ] [REMOTE    ] EAF: Incremental fetch complete for 2025-06 (1.86 seconds).
[2025-10-24T18:25:22.251910] [INFO ] [REMOTE    ] DY: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T18:25:22.547717] [INFO ] [REMOTE    ] DY: Fetching primary data for 2025-08.
[2025-10-24T18:25:22.769040] [INFO ] [REMOTE    ] E: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T18:25:23.347702] [INFO ] [REMOTE    ] E: Fetching primary data for 2025-10.
[2025-10-24T18:25:23.848699] [INFO ] [REMOTE    ] DY: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T18:25:24.147687] [INFO ] [REMOTE    ] EAF: Fetching primary data for 2025-07.
[2025-10-24T18:25:24.633176] [INFO ] [REMOTE    ] E: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T18:25:24.639182] [INFO ] [REMOTE    ] E: Full fetch complete (47623 records).
[2025-10-24T18:25:24.639286] [DEBUG] [VALIDATOR ] E: Validating primary data.
[2025-10-24T18:25:24.952886] [INFO ] [REMOTE    ] EAI: Fetching primary data for 2025-01.
[2025-10-24T18:25:25.021832] [DEBUG] [VALIDATOR ] E: All expected trading days are present.
[2025-10-24T18:25:25.021935] [DEBUG] [VALIDATOR ] E: Primary data validation passed.
[2025-10-24T18:25:25.022610] [INFO ] [MAIN      ] E: Fetched primary data is valid.
[2025-10-24T18:25:25.022705] [DEBUG] [LOCAL     ] E: Saving primary data.
[2025-10-24T18:25:25.023193] [FATAL] [LOCAL     ] E: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:25:25.023317] [FATAL] [MAIN      ] E: Failed to save primary data.
[2025-10-24T18:25:25.023389] [WARN ] [MAIN      ] E: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:25:25.023457] [INFO ] [LOCAL     ] E: Starting deletion of primary data.
[2025-10-24T18:25:25.023517] [DEBUG] [LOCAL     ] E: No primary data file found to delete.
[2025-10-24T18:25:25.023554] [INFO ] [LOCAL     ] E: Starting deletion of derivative data.
[2025-10-24T18:25:25.023787] [DEBUG] [LOCAL     ] E: Deleted derivative data file.
[2025-10-24T18:25:25.023880] [INFO ] [MAIN      ] Update Progress: 674/2366 symbols completed. E took 23.0s. Estimated remaining: 3h 34m 19s. Rate: 7.9 symbols/min
[2025-10-24T18:25:25.192812] [INFO ] [MAIN      ] EARN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:25:25.219292] [DEBUG] [LOCAL     ] EARN: Loaded 27875 existing records from primary storage.
[2025-10-24T18:25:25.219548] [INFO ] [MAIN      ] EARN: Loaded 27875 existing records.
[2025-10-24T18:25:25.395011] [WARN ] [MAIN      ] EARN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:25:25.395514] [INFO ] [MAIN      ] EARN: Wiping existing primary data before full refresh.
[2025-10-24T18:25:25.395564] [INFO ] [LOCAL     ] EARN: Starting deletion of primary data.
[2025-10-24T18:25:25.396100] [DEBUG] [LOCAL     ] EARN: Deleted primary data file.
[2025-10-24T18:25:25.396159] [INFO ] [MAIN      ] EARN: Starting full primary refresh.
[2025-10-24T18:25:25.680029] [INFO ] [REMOTE    ] EAI: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T18:25:25.754883] [INFO ] [REMOTE    ] DY: Fetching primary data for 2025-09.
[2025-10-24T18:25:25.785430] [INFO ] [REMOTE    ] EARN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:25:25.899047] [INFO ] [REMOTE    ] EAF: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T18:25:26.547720] [INFO ] [REMOTE    ] EAI: Fetching primary data for 2025-02.
[2025-10-24T18:25:27.135225] [INFO ] [REMOTE    ] EAI: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T18:25:27.265760] [INFO ] [REMOTE    ] DY: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T18:25:27.347708] [INFO ] [REMOTE    ] EARN: Fetching primary data for 2025-01.
[2025-10-24T18:25:28.147725] [INFO ] [REMOTE    ] EAI: Fetching primary data for 2025-03.
[2025-10-24T18:25:28.756859] [INFO ] [REMOTE    ] EAI: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T18:25:28.896021] [INFO ] [REMOTE    ] EARN: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T18:25:28.947669] [INFO ] [REMOTE    ] EARN: Fetching primary data for 2025-02.
[2025-10-24T18:25:29.747699] [INFO ] [REMOTE    ] EAF: Fetching primary data for 2025-08.
[2025-10-24T18:25:30.419226] [INFO ] [REMOTE    ] EARN: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T18:25:30.547686] [INFO ] [REMOTE    ] EARN: Fetching primary data for 2025-03.
[2025-10-24T18:25:31.090779] [INFO ] [REMOTE    ] EAF: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T18:25:31.347671] [INFO ] [REMOTE    ] EAF: Fetching primary data for 2025-09.
[2025-10-24T18:25:32.147618] [INFO ] [REMOTE    ] DY: Fetching primary data for 2025-10.
[2025-10-24T18:25:32.281324] [INFO ] [REMOTE    ] EARN: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T18:25:32.600220] [INFO ] [REMOTE    ] EAF: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T18:25:32.947711] [INFO ] [REMOTE    ] EAI: Fetching primary data for 2025-04.
[2025-10-24T18:25:33.426545] [INFO ] [REMOTE    ] DY: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T18:25:33.431061] [INFO ] [REMOTE    ] DY: Full fetch complete (43146 records).
[2025-10-24T18:25:33.431183] [DEBUG] [VALIDATOR ] DY: Validating primary data.
[2025-10-24T18:25:33.749470] [INFO ] [REMOTE    ] EAF: Fetching primary data for 2025-10.
[2025-10-24T18:25:33.821231] [DEBUG] [VALIDATOR ] DY: All expected trading days are present.
[2025-10-24T18:25:33.821412] [DEBUG] [VALIDATOR ] DY: Primary data validation passed.
[2025-10-24T18:25:33.820958] [INFO ] [REMOTE    ] EAI: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T18:25:33.822544] [INFO ] [MAIN      ] DY: Fetched primary data is valid.
[2025-10-24T18:25:33.822677] [DEBUG] [LOCAL     ] DY: Saving primary data.
[2025-10-24T18:25:33.826035] [FATAL] [LOCAL     ] DY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:25:33.826128] [FATAL] [MAIN      ] DY: Failed to save primary data.
[2025-10-24T18:25:33.826172] [WARN ] [MAIN      ] DY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:25:33.826237] [INFO ] [LOCAL     ] DY: Starting deletion of primary data.
[2025-10-24T18:25:33.826302] [DEBUG] [LOCAL     ] DY: No primary data file found to delete.
[2025-10-24T18:25:33.826339] [INFO ] [LOCAL     ] DY: Starting deletion of derivative data.
[2025-10-24T18:25:33.826505] [DEBUG] [LOCAL     ] DY: Deleted derivative data file.
[2025-10-24T18:25:33.826664] [INFO ] [MAIN      ] Update Progress: 675/2366 symbols completed. DY took 33.0s. Estimated remaining: 3h 34m 14s. Rate: 7.9 symbols/min
[2025-10-24T18:25:34.007574] [INFO ] [MAIN      ] EAT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:25:34.054593] [DEBUG] [LOCAL     ] EAT: Loaded 50090 existing records from primary storage.
[2025-10-24T18:25:34.054957] [INFO ] [MAIN      ] EAT: Loaded 50090 existing records.
[2025-10-24T18:25:34.236205] [WARN ] [MAIN      ] EAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:25:34.236437] [INFO ] [MAIN      ] EAT: Wiping existing primary data before full refresh.
[2025-10-24T18:25:34.236486] [INFO ] [LOCAL     ] EAT: Starting deletion of primary data.
[2025-10-24T18:25:34.237471] [DEBUG] [LOCAL     ] EAT: Deleted primary data file.
[2025-10-24T18:25:34.237531] [INFO ] [MAIN      ] EAT: Starting full primary refresh.
[2025-10-24T18:25:34.552832] [INFO ] [REMOTE    ] EARN: Fetching primary data for 2025-04.
[2025-10-24T18:25:34.610879] [INFO ] [REMOTE    ] EAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:25:35.231760] [INFO ] [REMOTE    ] EAF: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T18:25:35.237188] [INFO ] [REMOTE    ] EAF: Full fetch complete (61522 records).
[2025-10-24T18:25:35.237300] [DEBUG] [VALIDATOR ] EAF: Validating primary data.
[2025-10-24T18:25:35.238213] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:25:35.238301] [FATAL] [MAIN      ] EAF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:25:35.238346] [WARN ] [MAIN      ] EAF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:25:35.238388] [INFO ] [LOCAL     ] EAF: Starting deletion of primary data.
[2025-10-24T18:25:35.238445] [DEBUG] [LOCAL     ] EAF: No primary data file found to delete.
[2025-10-24T18:25:35.238482] [INFO ] [LOCAL     ] EAF: Starting deletion of derivative data.
[2025-10-24T18:25:35.238600] [DEBUG] [LOCAL     ] EAF: Deleted derivative data file.
[2025-10-24T18:25:35.239107] [INFO ] [MAIN      ] Update Progress: 676/2366 symbols completed. EAF took 30.5s. Estimated remaining: 3h 33m 51s. Rate: 7.9 symbols/min
[2025-10-24T18:25:35.352722] [INFO ] [REMOTE    ] EAI: Fetching primary data for 2025-05.
[2025-10-24T18:25:35.416968] [INFO ] [MAIN      ] EB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:25:35.451605] [DEBUG] [LOCAL     ] EB: Loaded 36426 existing records from primary storage.
[2025-10-24T18:25:35.451903] [INFO ] [MAIN      ] EB: Loaded 36426 existing records.
[2025-10-24T18:25:35.631087] [WARN ] [MAIN      ] EB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:25:35.631301] [INFO ] [MAIN      ] EB: Wiping existing primary data before full refresh.
[2025-10-24T18:25:35.631362] [INFO ] [LOCAL     ] EB: Starting deletion of primary data.
[2025-10-24T18:25:35.631574] [DEBUG] [LOCAL     ] EB: Deleted primary data file.
[2025-10-24T18:25:35.631632] [INFO ] [MAIN      ] EB: Starting full primary refresh.
[2025-10-24T18:25:36.020539] [INFO ] [REMOTE    ] EAI: Incremental fetch complete for 2025-05 (0.67 seconds).
[2025-10-24T18:25:36.047766] [INFO ] [REMOTE    ] EB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:25:36.147627] [INFO ] [REMOTE    ] EAI: Fetching primary data for 2025-06.
[2025-10-24T18:25:36.338289] [INFO ] [REMOTE    ] EARN: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T18:25:36.725722] [INFO ] [REMOTE    ] EAI: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T18:25:36.947714] [INFO ] [REMOTE    ] EAI: Fetching primary data for 2025-07.
[2025-10-24T18:25:37.531875] [INFO ] [REMOTE    ] EAI: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T18:25:37.747706] [INFO ] [REMOTE    ] EAI: Fetching primary data for 2025-08.
[2025-10-24T18:25:38.325013] [INFO ] [REMOTE    ] EAI: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T18:25:38.547716] [INFO ] [REMOTE    ] EAT: Fetching primary data for 2025-01.
[2025-10-24T18:25:39.347725] [INFO ] [REMOTE    ] EAI: Fetching primary data for 2025-09.
[2025-10-24T18:25:39.992049] [INFO ] [REMOTE    ] EAI: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T18:25:40.147632] [INFO ] [REMOTE    ] EAI: Fetching primary data for 2025-10.
[2025-10-24T18:25:40.427439] [INFO ] [REMOTE    ] EAT: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T18:25:40.947629] [INFO ] [REMOTE    ] EB: Fetching primary data for 2025-01.
[2025-10-24T18:25:40.994854] [INFO ] [REMOTE    ] EAI: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T18:25:40.996018] [INFO ] [REMOTE    ] EAI: Full fetch complete (5812 records).
[2025-10-24T18:25:40.996084] [DEBUG] [VALIDATOR ] EAI: Validating primary data.
[2025-10-24T18:25:41.357342] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present.
[2025-10-24T18:25:41.357418] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed.
[2025-10-24T18:25:41.357566] [INFO ] [MAIN      ] EAI: Fetched primary data is valid.
[2025-10-24T18:25:41.357604] [DEBUG] [LOCAL     ] EAI: Saving primary data.
[2025-10-24T18:25:41.357808] [FATAL] [LOCAL     ] EAI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:25:41.357890] [FATAL] [MAIN      ] EAI: Failed to save primary data.
[2025-10-24T18:25:41.357931] [WARN ] [MAIN      ] EAI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:25:41.357965] [INFO ] [LOCAL     ] EAI: Starting deletion of primary data.
[2025-10-24T18:25:41.358038] [DEBUG] [LOCAL     ] EAI: No primary data file found to delete.
[2025-10-24T18:25:41.358092] [INFO ] [LOCAL     ] EAI: Starting deletion of derivative data.
[2025-10-24T18:25:41.358234] [DEBUG] [LOCAL     ] EAI: Deleted derivative data file.
[2025-10-24T18:25:41.358317] [INFO ] [MAIN      ] Update Progress: 677/2366 symbols completed. EAI took 26.0s. Estimated remaining: 3h 33m 40s. Rate: 7.9 symbols/min
[2025-10-24T18:25:41.747682] [INFO ] [REMOTE    ] EAT: Fetching primary data for 2025-02.
[2025-10-24T18:25:42.498313] [INFO ] [REMOTE    ] EB: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T18:25:42.547617] [INFO ] [REMOTE    ] EB: Fetching primary data for 2025-02.
[2025-10-24T18:25:43.347632] [INFO ] [REMOTE    ] EARN: Fetching primary data for 2025-05.
[2025-10-24T18:25:43.562576] [INFO ] [REMOTE    ] EAT: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T18:25:43.624672] [INFO ] [REMOTE    ] EB: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T18:25:44.147716] [INFO ] [REMOTE    ] EB: Fetching primary data for 2025-03.
[2025-10-24T18:25:44.710605] [INFO ] [REMOTE    ] EARN: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T18:25:44.947713] [INFO ] [REMOTE    ] EARN: Fetching primary data for 2025-06.
[2025-10-24T18:25:45.747714] [INFO ] [REMOTE    ] EAT: Fetching primary data for 2025-03.
[2025-10-24T18:25:45.863522] [INFO ] [REMOTE    ] EB: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T18:25:46.085530] [INFO ] [REMOTE    ] EARN: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T18:25:46.547725] [INFO ] [REMOTE    ] EARN: Fetching primary data for 2025-07.
[2025-10-24T18:25:47.347732] [INFO ] [REMOTE    ] EB: Fetching primary data for 2025-04.
[2025-10-24T18:25:47.851530] [INFO ] [REMOTE    ] EAT: Incremental fetch complete for 2025-03 (2.10 seconds).
[2025-10-24T18:25:47.880418] [INFO ] [REMOTE    ] EARN: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T18:25:48.147731] [INFO ] [REMOTE    ] EARN: Fetching primary data for 2025-08.
[2025-10-24T18:25:48.846035] [INFO ] [REMOTE    ] EB: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T18:25:48.947687] [INFO ] [REMOTE    ] EB: Fetching primary data for 2025-05.
[2025-10-24T18:25:49.051445] [DEBUG] [REMOTE    ] EB: Error fetching primary data for 2025-05: 'API call returned an empty response.'
[2025-10-24T18:25:49.051707] [WARN ] [REMOTE    ] EB: No data returned for month 2025-05
[2025-10-24T18:25:49.051809] [FATAL] [REMOTE    ] EB: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:25:49.051903] [FATAL] [MAIN      ] EB: Failed to fetch primary data.
[2025-10-24T18:25:49.051967] [WARN ] [MAIN      ] EB: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:25:49.052043] [INFO ] [LOCAL     ] EB: Starting deletion of primary data.
[2025-10-24T18:25:49.052106] [DEBUG] [LOCAL     ] EB: No primary data file found to delete.
[2025-10-24T18:25:49.052144] [INFO ] [LOCAL     ] EB: Starting deletion of derivative data.
[2025-10-24T18:25:49.052298] [DEBUG] [LOCAL     ] EB: Deleted derivative data file.
[2025-10-24T18:25:49.052378] [INFO ] [MAIN      ] Update Progress: 678/2366 symbols completed. EB took 13.8s. Estimated remaining: 3h 33m 32s. Rate: 7.9 symbols/min
[2025-10-24T18:25:49.229316] [INFO ] [REMOTE    ] EARN: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T18:25:49.747729] [INFO ] [REMOTE    ] EAT: Fetching primary data for 2025-04.
[2025-10-24T18:25:50.547634] [INFO ] [REMOTE    ] EARN: Fetching primary data for 2025-09.
[2025-10-24T18:25:51.578704] [INFO ] [REMOTE    ] EARN: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T18:25:51.583992] [INFO ] [REMOTE    ] EARN: Fetching primary data for 2025-10.
[2025-10-24T18:25:51.728507] [INFO ] [REMOTE    ] EAT: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T18:25:52.147691] [INFO ] [REMOTE    ] EAT: Fetching primary data for 2025-05.
[2025-10-24T18:25:52.924089] [INFO ] [REMOTE    ] EARN: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T18:25:52.930414] [INFO ] [REMOTE    ] EARN: Full fetch complete (45076 records).
[2025-10-24T18:25:52.930543] [DEBUG] [VALIDATOR ] EARN: Validating primary data.
[2025-10-24T18:25:53.356373] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present.
[2025-10-24T18:25:53.356466] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed.
[2025-10-24T18:25:53.357238] [INFO ] [MAIN      ] EARN: Fetched primary data is valid.
[2025-10-24T18:25:53.357305] [DEBUG] [LOCAL     ] EARN: Saving primary data.
[2025-10-24T18:25:53.357818] [FATAL] [LOCAL     ] EARN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:25:53.357919] [FATAL] [MAIN      ] EARN: Failed to save primary data.
[2025-10-24T18:25:53.357963] [WARN ] [MAIN      ] EARN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:25:53.358020] [INFO ] [LOCAL     ] EARN: Starting deletion of primary data.
[2025-10-24T18:25:53.358072] [DEBUG] [LOCAL     ] EARN: No primary data file found to delete.
[2025-10-24T18:25:53.358108] [INFO ] [LOCAL     ] EARN: Starting deletion of derivative data.
[2025-10-24T18:25:53.358218] [DEBUG] [LOCAL     ] EARN: Deleted derivative data file.
[2025-10-24T18:25:53.358295] [INFO ] [MAIN      ] Update Progress: 679/2366 symbols completed. EARN took 28.3s. Estimated remaining: 3h 33m 17s. Rate: 7.9 symbols/min
[2025-10-24T18:25:53.796071] [INFO ] [REMOTE    ] EAT: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T18:25:53.806735] [INFO ] [REMOTE    ] EAT: Fetching primary data for 2025-06.
[2025-10-24T18:25:55.455200] [INFO ] [REMOTE    ] EAT: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T18:25:55.466533] [INFO ] [REMOTE    ] EAT: Fetching primary data for 2025-07.
[2025-10-24T18:25:57.285760] [INFO ] [REMOTE    ] EAT: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T18:25:57.296672] [INFO ] [REMOTE    ] EAT: Fetching primary data for 2025-08.
[2025-10-24T18:25:58.934610] [INFO ] [REMOTE    ] EAT: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T18:25:58.945100] [INFO ] [REMOTE    ] EAT: Fetching primary data for 2025-09.
[2025-10-24T18:26:00.672310] [INFO ] [REMOTE    ] EAT: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T18:26:00.683165] [INFO ] [REMOTE    ] EAT: Fetching primary data for 2025-10.
[2025-10-24T18:26:04.388739] [INFO ] [REMOTE    ] EAT: Incremental fetch complete for 2025-10 (3.71 seconds).
[2025-10-24T18:26:04.397685] [INFO ] [REMOTE    ] EAT: Full fetch complete (72430 records).
[2025-10-24T18:26:04.397823] [DEBUG] [VALIDATOR ] EAT: Validating primary data.
[2025-10-24T18:26:04.815147] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present.
[2025-10-24T18:26:04.815225] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed.
[2025-10-24T18:26:04.816095] [INFO ] [MAIN      ] EAT: Fetched primary data is valid.
[2025-10-24T18:26:04.816156] [DEBUG] [LOCAL     ] EAT: Saving primary data.
[2025-10-24T18:26:04.816713] [FATAL] [LOCAL     ] EAT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:26:04.816801] [FATAL] [MAIN      ] EAT: Failed to save primary data.
[2025-10-24T18:26:04.816842] [WARN ] [MAIN      ] EAT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:26:04.816876] [INFO ] [LOCAL     ] EAT: Starting deletion of primary data.
[2025-10-24T18:26:04.816928] [DEBUG] [LOCAL     ] EAT: No primary data file found to delete.
[2025-10-24T18:26:04.816962] [INFO ] [LOCAL     ] EAT: Starting deletion of derivative data.
[2025-10-24T18:26:04.817090] [DEBUG] [LOCAL     ] EAT: Deleted derivative data file.
[2025-10-24T18:26:04.817432] [INFO ] [MAIN      ] Update Progress: 680/2366 symbols completed. EAT took 31.0s. Estimated remaining: 3h 33m 19s. Rate: 7.9 symbols/min
[2025-10-24T18:26:05.381773] [INFO ] [MAIN      ] EBF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:26:05.486443] [INFO ] [MAIN      ] EBR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:26:05.508744] [INFO ] [MAIN      ] EC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:26:05.526951] [INFO ] [MAIN      ] EBS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:26:05.566584] [DEBUG] [LOCAL     ] EBF: Loaded 19413 existing records from primary storage.
[2025-10-24T18:26:05.576851] [INFO ] [MAIN      ] EBF: Loaded 19413 existing records.
[2025-10-24T18:26:05.710029] [DEBUG] [LOCAL     ] EC: Loaded 49210 existing records from primary storage.
[2025-10-24T18:26:05.760562] [INFO ] [MAIN      ] EC: Loaded 49210 existing records.
[2025-10-24T18:26:05.766902] [DEBUG] [LOCAL     ] EBR: Loaded 43686 existing records from primary storage.
[2025-10-24T18:26:05.785712] [DEBUG] [LOCAL     ] EBS: Loaded 46902 existing records from primary storage.
[2025-10-24T18:26:05.816275] [INFO ] [MAIN      ] EBS: Loaded 46902 existing records.
[2025-10-24T18:26:05.810376] [INFO ] [MAIN      ] EBR: Loaded 43686 existing records.
[2025-10-24T18:26:05.896108] [WARN ] [MAIN      ] EBF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:26:05.942638] [INFO ] [MAIN      ] EBF: Wiping existing primary data before full refresh.
[2025-10-24T18:26:05.986371] [INFO ] [LOCAL     ] EBF: Starting deletion of primary data.
[2025-10-24T18:26:06.041062] [DEBUG] [LOCAL     ] EBF: Deleted primary data file.
[2025-10-24T18:26:06.105270] [INFO ] [MAIN      ] EBF: Starting full primary refresh.
[2025-10-24T18:26:06.409503] [WARN ] [MAIN      ] EBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:26:06.478991] [INFO ] [MAIN      ] EBS: Wiping existing primary data before full refresh.
[2025-10-24T18:26:06.561013] [INFO ] [LOCAL     ] EBS: Starting deletion of primary data.
[2025-10-24T18:26:06.646630] [WARN ] [MAIN      ] EBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:26:06.657507] [DEBUG] [LOCAL     ] EBS: Deleted primary data file.
[2025-10-24T18:26:06.652308] [INFO ] [MAIN      ] EBR: Wiping existing primary data before full refresh.
[2025-10-24T18:26:06.611692] [WARN ] [MAIN      ] EC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:26:06.662982] [INFO ] [LOCAL     ] EBR: Starting deletion of primary data.
[2025-10-24T18:26:06.683624] [INFO ] [MAIN      ] EC: Wiping existing primary data before full refresh.
[2025-10-24T18:26:06.683847] [INFO ] [LOCAL     ] EC: Starting deletion of primary data.
[2025-10-24T18:26:06.683956] [DEBUG] [LOCAL     ] EBR: Deleted primary data file.
[2025-10-24T18:26:06.694457] [INFO ] [MAIN      ] EBR: Starting full primary refresh.
[2025-10-24T18:26:06.678312] [INFO ] [MAIN      ] EBS: Starting full primary refresh.
[2025-10-24T18:26:06.694392] [DEBUG] [LOCAL     ] EC: Deleted primary data file.
[2025-10-24T18:26:06.715205] [INFO ] [MAIN      ] EC: Starting full primary refresh.
[2025-10-24T18:26:07.179678] [INFO ] [REMOTE    ] EBF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:26:07.314357] [INFO ] [REMOTE    ] EBF: Fetching primary data for 2025-01.
[2025-10-24T18:26:07.800998] [INFO ] [REMOTE    ] EBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:26:07.832972] [INFO ] [REMOTE    ] EBR: Fetching primary data for 2025-01.
[2025-10-24T18:26:07.920181] [INFO ] [REMOTE    ] EC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:26:07.950777] [INFO ] [REMOTE    ] EC: Fetching primary data for 2025-01.
[2025-10-24T18:26:07.950504] [INFO ] [REMOTE    ] EBS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:26:07.951816] [INFO ] [REMOTE    ] EBS: Fetching primary data for 2025-01.
[2025-10-24T18:26:08.796849] [INFO ] [REMOTE    ] EBF: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T18:26:08.800527] [INFO ] [REMOTE    ] EBF: Fetching primary data for 2025-02.
[2025-10-24T18:26:09.577463] [INFO ] [REMOTE    ] EBF: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T18:26:09.582117] [INFO ] [REMOTE    ] EBF: Fetching primary data for 2025-03.
[2025-10-24T18:26:09.607269] [INFO ] [REMOTE    ] EBS: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T18:26:09.616363] [INFO ] [REMOTE    ] EBS: Fetching primary data for 2025-02.
[2025-10-24T18:26:09.748247] [INFO ] [REMOTE    ] EC: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T18:26:09.759394] [INFO ] [REMOTE    ] EC: Fetching primary data for 2025-02.
[2025-10-24T18:26:09.958205] [INFO ] [REMOTE    ] EBR: Incremental fetch complete for 2025-01 (2.13 seconds).
[2025-10-24T18:26:09.967480] [INFO ] [REMOTE    ] EBR: Fetching primary data for 2025-02.
[2025-10-24T18:26:10.582595] [INFO ] [REMOTE    ] EBF: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T18:26:10.588807] [INFO ] [REMOTE    ] EBF: Fetching primary data for 2025-04.
[2025-10-24T18:26:11.203941] [INFO ] [REMOTE    ] EC: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T18:26:11.215233] [INFO ] [REMOTE    ] EC: Fetching primary data for 2025-03.
[2025-10-24T18:26:11.243397] [INFO ] [REMOTE    ] EBS: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T18:26:11.253022] [INFO ] [REMOTE    ] EBS: Fetching primary data for 2025-03.
[2025-10-24T18:26:11.345295] [INFO ] [REMOTE    ] EBF: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T18:26:11.350869] [INFO ] [REMOTE    ] EBF: Fetching primary data for 2025-05.
[2025-10-24T18:26:11.390334] [INFO ] [REMOTE    ] EBR: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T18:26:11.398382] [INFO ] [REMOTE    ] EBR: Fetching primary data for 2025-03.
[2025-10-24T18:26:12.323818] [INFO ] [REMOTE    ] EBF: Incremental fetch complete for 2025-05 (0.97 seconds).
[2025-10-24T18:26:12.328937] [INFO ] [REMOTE    ] EBF: Fetching primary data for 2025-06.
[2025-10-24T18:26:12.609859] [INFO ] [REMOTE    ] EBR: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T18:26:12.619877] [INFO ] [REMOTE    ] EBR: Fetching primary data for 2025-04.
[2025-10-24T18:26:12.656613] [INFO ] [REMOTE    ] EBS: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T18:26:12.666453] [INFO ] [REMOTE    ] EBS: Fetching primary data for 2025-04.
[2025-10-24T18:26:13.013595] [INFO ] [REMOTE    ] EC: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T18:26:13.025001] [INFO ] [REMOTE    ] EC: Fetching primary data for 2025-04.
[2025-10-24T18:26:13.371933] [INFO ] [REMOTE    ] EBF: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T18:26:13.376493] [INFO ] [REMOTE    ] EBF: Fetching primary data for 2025-07.
[2025-10-24T18:26:13.714931] [INFO ] [REMOTE    ] EBR: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T18:26:13.725561] [INFO ] [REMOTE    ] EBR: Fetching primary data for 2025-05.
[2025-10-24T18:26:14.188145] [INFO ] [REMOTE    ] EBS: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T18:26:14.198760] [INFO ] [REMOTE    ] EBS: Fetching primary data for 2025-05.
[2025-10-24T18:26:14.448707] [INFO ] [REMOTE    ] EBF: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T18:26:14.454590] [INFO ] [REMOTE    ] EBF: Fetching primary data for 2025-08.
[2025-10-24T18:26:14.786395] [INFO ] [REMOTE    ] EBR: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T18:26:14.797354] [INFO ] [REMOTE    ] EBR: Fetching primary data for 2025-06.
[2025-10-24T18:26:15.030100] [INFO ] [REMOTE    ] EC: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T18:26:15.347735] [INFO ] [REMOTE    ] EC: Fetching primary data for 2025-05.
[2025-10-24T18:26:15.514450] [INFO ] [REMOTE    ] EBF: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T18:26:15.991610] [INFO ] [REMOTE    ] EBS: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T18:26:16.149998] [INFO ] [REMOTE    ] EBF: Fetching primary data for 2025-09.
[2025-10-24T18:26:16.156098] [INFO ] [REMOTE    ] EBR: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T18:26:16.947748] [INFO ] [REMOTE    ] EBS: Fetching primary data for 2025-06.
[2025-10-24T18:26:16.999424] [INFO ] [REMOTE    ] EBF: Incremental fetch complete for 2025-09 (0.85 seconds).
[2025-10-24T18:26:17.335944] [INFO ] [REMOTE    ] EC: Incremental fetch complete for 2025-05 (1.99 seconds).
[2025-10-24T18:26:17.747735] [INFO ] [REMOTE    ] EBF: Fetching primary data for 2025-10.
[2025-10-24T18:26:18.475898] [INFO ] [REMOTE    ] EBS: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T18:26:18.547606] [INFO ] [REMOTE    ] EBS: Fetching primary data for 2025-07.
[2025-10-24T18:26:19.016279] [INFO ] [REMOTE    ] EBF: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T18:26:19.021330] [INFO ] [REMOTE    ] EBF: Full fetch complete (28407 records).
[2025-10-24T18:26:19.021459] [DEBUG] [VALIDATOR ] EBF: Validating primary data.
[2025-10-24T18:26:19.352871] [INFO ] [REMOTE    ] EC: Fetching primary data for 2025-06.
[2025-10-24T18:26:19.416383] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present.
[2025-10-24T18:26:19.416459] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed.
[2025-10-24T18:26:19.416987] [INFO ] [MAIN      ] EBF: Fetched primary data is valid.
[2025-10-24T18:26:19.417046] [DEBUG] [LOCAL     ] EBF: Saving primary data.
[2025-10-24T18:26:19.417368] [FATAL] [LOCAL     ] EBF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:26:19.417447] [FATAL] [MAIN      ] EBF: Failed to save primary data.
[2025-10-24T18:26:19.417489] [WARN ] [MAIN      ] EBF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:26:19.417523] [INFO ] [LOCAL     ] EBF: Starting deletion of primary data.
[2025-10-24T18:26:19.417572] [DEBUG] [LOCAL     ] EBF: No primary data file found to delete.
[2025-10-24T18:26:19.417606] [INFO ] [LOCAL     ] EBF: Starting deletion of derivative data.
[2025-10-24T18:26:19.417802] [DEBUG] [LOCAL     ] EBF: Deleted derivative data file.
[2025-10-24T18:26:19.417890] [INFO ] [MAIN      ] Update Progress: 681/2366 symbols completed. EBF took 14.6s. Estimated remaining: 3h 33m 28s. Rate: 7.9 symbols/min
[2025-10-24T18:26:19.597988] [INFO ] [MAIN      ] ECAT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:26:19.629485] [DEBUG] [LOCAL     ] ECAT: Loaded 29317 existing records from primary storage.
[2025-10-24T18:26:19.629794] [INFO ] [MAIN      ] ECAT: Loaded 29317 existing records.
[2025-10-24T18:26:19.822585] [WARN ] [MAIN      ] ECAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:26:19.822833] [INFO ] [MAIN      ] ECAT: Wiping existing primary data before full refresh.
[2025-10-24T18:26:19.822898] [INFO ] [LOCAL     ] ECAT: Starting deletion of primary data.
[2025-10-24T18:26:19.823249] [DEBUG] [LOCAL     ] ECAT: Deleted primary data file.
[2025-10-24T18:26:19.823305] [INFO ] [MAIN      ] ECAT: Starting full primary refresh.
[2025-10-24T18:26:20.152386] [INFO ] [REMOTE    ] EBR: Fetching primary data for 2025-07.
[2025-10-24T18:26:20.248273] [INFO ] [REMOTE    ] EBS: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T18:26:20.252157] [INFO ] [REMOTE    ] ECAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:26:20.947616] [INFO ] [REMOTE    ] ECAT: Fetching primary data for 2025-01.
[2025-10-24T18:26:21.249800] [INFO ] [REMOTE    ] EC: Incremental fetch complete for 2025-06 (1.90 seconds).
[2025-10-24T18:26:21.747765] [INFO ] [REMOTE    ] EBS: Fetching primary data for 2025-08.
[2025-10-24T18:26:21.927089] [INFO ] [REMOTE    ] EBR: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T18:26:22.323489] [INFO ] [REMOTE    ] ECAT: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T18:26:22.547688] [INFO ] [REMOTE    ] EC: Fetching primary data for 2025-07.
[2025-10-24T18:26:23.347635] [INFO ] [REMOTE    ] ECAT: Fetching primary data for 2025-02.
[2025-10-24T18:26:23.451409] [INFO ] [REMOTE    ] EBS: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T18:26:24.109423] [INFO ] [REMOTE    ] EC: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T18:26:24.147619] [INFO ] [REMOTE    ] EBS: Fetching primary data for 2025-09.
[2025-10-24T18:26:24.760401] [INFO ] [REMOTE    ] ECAT: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T18:26:24.947687] [INFO ] [REMOTE    ] EC: Fetching primary data for 2025-08.
[2025-10-24T18:26:25.747710] [INFO ] [REMOTE    ] ECAT: Fetching primary data for 2025-03.
[2025-10-24T18:26:26.087343] [INFO ] [REMOTE    ] EBS: Incremental fetch complete for 2025-09 (1.94 seconds).
[2025-10-24T18:26:26.547695] [INFO ] [REMOTE    ] EBR: Fetching primary data for 2025-08.
[2025-10-24T18:26:26.841707] [INFO ] [REMOTE    ] EC: Incremental fetch complete for 2025-08 (1.89 seconds).
[2025-10-24T18:26:27.060502] [INFO ] [REMOTE    ] ECAT: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T18:26:27.347689] [INFO ] [REMOTE    ] EC: Fetching primary data for 2025-09.
[2025-10-24T18:26:28.147721] [INFO ] [REMOTE    ] EBS: Fetching primary data for 2025-10.
[2025-10-24T18:26:28.228255] [INFO ] [REMOTE    ] EBR: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T18:26:28.947637] [INFO ] [REMOTE    ] ECAT: Fetching primary data for 2025-04.
[2025-10-24T18:26:29.314442] [INFO ] [REMOTE    ] EC: Incremental fetch complete for 2025-09 (1.97 seconds).
[2025-10-24T18:26:29.459196] [INFO ] [REMOTE    ] EBS: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T18:26:29.467462] [INFO ] [REMOTE    ] EBS: Full fetch complete (67398 records).
[2025-10-24T18:26:29.467597] [DEBUG] [VALIDATOR ] EBS: Validating primary data.
[2025-10-24T18:26:29.755256] [INFO ] [REMOTE    ] EC: Fetching primary data for 2025-10.
[2025-10-24T18:26:29.863512] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present.
[2025-10-24T18:26:29.863593] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed.
[2025-10-24T18:26:29.864521] [INFO ] [MAIN      ] EBS: Fetched primary data is valid.
[2025-10-24T18:26:29.864587] [DEBUG] [LOCAL     ] EBS: Saving primary data.
[2025-10-24T18:26:29.865185] [FATAL] [LOCAL     ] EBS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:26:29.865306] [FATAL] [MAIN      ] EBS: Failed to save primary data.
[2025-10-24T18:26:29.865354] [WARN ] [MAIN      ] EBS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:26:29.865417] [INFO ] [LOCAL     ] EBS: Starting deletion of primary data.
[2025-10-24T18:26:29.865481] [DEBUG] [LOCAL     ] EBS: No primary data file found to delete.
[2025-10-24T18:26:29.865519] [INFO ] [LOCAL     ] EBS: Starting deletion of derivative data.
[2025-10-24T18:26:29.865800] [DEBUG] [LOCAL     ] EBS: Deleted derivative data file.
[2025-10-24T18:26:29.866219] [INFO ] [MAIN      ] Update Progress: 682/2366 symbols completed. EBS took 25.0s. Estimated remaining: 3h 33m 28s. Rate: 7.9 symbols/min
[2025-10-24T18:26:30.047786] [INFO ] [MAIN      ] ECC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:26:30.088963] [DEBUG] [LOCAL     ] ECC: Loaded 43660 existing records from primary storage.
[2025-10-24T18:26:30.089280] [INFO ] [MAIN      ] ECC: Loaded 43660 existing records.
[2025-10-24T18:26:30.220181] [INFO ] [REMOTE    ] ECAT: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T18:26:30.296697] [WARN ] [MAIN      ] ECC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:26:30.296921] [INFO ] [MAIN      ] ECC: Wiping existing primary data before full refresh.
[2025-10-24T18:26:30.296967] [INFO ] [LOCAL     ] ECC: Starting deletion of primary data.
[2025-10-24T18:26:30.297191] [DEBUG] [LOCAL     ] ECC: Deleted primary data file.
[2025-10-24T18:26:30.297247] [INFO ] [MAIN      ] ECC: Starting full primary refresh.
[2025-10-24T18:26:30.552905] [INFO ] [REMOTE    ] ECAT: Fetching primary data for 2025-05.
[2025-10-24T18:26:30.656253] [INFO ] [REMOTE    ] ECC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:26:31.347684] [INFO ] [REMOTE    ] ECC: Fetching primary data for 2025-01.
[2025-10-24T18:26:31.871179] [INFO ] [REMOTE    ] EC: Incremental fetch complete for 2025-10 (2.12 seconds).
[2025-10-24T18:26:31.880163] [INFO ] [REMOTE    ] EC: Full fetch complete (71500 records).
[2025-10-24T18:26:31.880313] [DEBUG] [VALIDATOR ] EC: Validating primary data.
[2025-10-24T18:26:31.881084] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:26:31.881171] [FATAL] [MAIN      ] EC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:26:31.881234] [WARN ] [MAIN      ] EC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:26:31.881304] [INFO ] [LOCAL     ] EC: Starting deletion of primary data.
[2025-10-24T18:26:31.881367] [DEBUG] [LOCAL     ] EC: No primary data file found to delete.
[2025-10-24T18:26:31.881402] [INFO ] [LOCAL     ] EC: Starting deletion of derivative data.
[2025-10-24T18:26:31.881543] [DEBUG] [LOCAL     ] EC: Deleted derivative data file.
[2025-10-24T18:26:31.881968] [INFO ] [MAIN      ] Update Progress: 683/2366 symbols completed. EC took 27.1s. Estimated remaining: 3h 33m 6s. Rate: 7.9 symbols/min
[2025-10-24T18:26:32.004930] [INFO ] [REMOTE    ] ECAT: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T18:26:32.079224] [INFO ] [MAIN      ] ECCC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:26:32.079422] [DEBUG] [LOCAL     ] ECCC: No existing data file found in primary storage.
[2025-10-24T18:26:32.079460] [WARN ] [MAIN      ] ECCC: No existing data found, performing full refresh instead.
[2025-10-24T18:26:32.079568] [INFO ] [MAIN      ] ECCC: Wiping existing primary data before full refresh.
[2025-10-24T18:26:32.079609] [INFO ] [LOCAL     ] ECCC: Starting deletion of primary data.
[2025-10-24T18:26:32.079678] [DEBUG] [LOCAL     ] ECCC: No primary data file found to delete.
[2025-10-24T18:26:32.079730] [INFO ] [MAIN      ] ECCC: Starting full primary refresh.
[2025-10-24T18:26:32.153406] [INFO ] [REMOTE    ] EBR: Fetching primary data for 2025-09.
[2025-10-24T18:26:32.480842] [INFO ] [REMOTE    ] ECCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:26:32.947713] [INFO ] [REMOTE    ] ECAT: Fetching primary data for 2025-06.
[2025-10-24T18:26:33.239465] [INFO ] [REMOTE    ] ECC: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T18:26:33.553335] [INFO ] [REMOTE    ] EBR: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T18:26:33.747631] [INFO ] [REMOTE    ] EBR: Fetching primary data for 2025-10.
[2025-10-24T18:26:34.389494] [INFO ] [REMOTE    ] ECAT: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T18:26:34.547701] [INFO ] [REMOTE    ] ECC: Fetching primary data for 2025-02.
[2025-10-24T18:26:35.347733] [INFO ] [REMOTE    ] ECCC: Fetching primary data for 2025-01.
[2025-10-24T18:26:35.536342] [INFO ] [REMOTE    ] EBR: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T18:26:35.544894] [INFO ] [REMOTE    ] EBR: Full fetch complete (62440 records).
[2025-10-24T18:26:35.545047] [DEBUG] [VALIDATOR ] EBR: Validating primary data.
[2025-10-24T18:26:35.820492] [INFO ] [REMOTE    ] ECCC: Incremental fetch complete for 2025-01 (0.47 seconds).
[2025-10-24T18:26:35.947668] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present.
[2025-10-24T18:26:35.947770] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed.
[2025-10-24T18:26:35.948765] [INFO ] [MAIN      ] EBR: Fetched primary data is valid.
[2025-10-24T18:26:35.948845] [DEBUG] [LOCAL     ] EBR: Saving primary data.
[2025-10-24T18:26:35.949363] [FATAL] [LOCAL     ] EBR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:26:35.949445] [FATAL] [MAIN      ] EBR: Failed to save primary data.
[2025-10-24T18:26:35.949487] [WARN ] [MAIN      ] EBR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:26:35.949541] [INFO ] [LOCAL     ] EBR: Starting deletion of primary data.
[2025-10-24T18:26:35.949593] [DEBUG] [LOCAL     ] EBR: No primary data file found to delete.
[2025-10-24T18:26:35.949628] [INFO ] [LOCAL     ] EBR: Starting deletion of derivative data.
[2025-10-24T18:26:35.949815] [DEBUG] [LOCAL     ] EBR: Deleted derivative data file.
[2025-10-24T18:26:35.950097] [INFO ] [MAIN      ] Update Progress: 684/2366 symbols completed. EBR took 31.1s. Estimated remaining: 3h 32m 50s. Rate: 7.9 symbols/min
[2025-10-24T18:26:36.137793] [INFO ] [MAIN      ] ECCU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:26:36.135625] [INFO ] [REMOTE    ] ECC: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T18:26:36.147839] [INFO ] [REMOTE    ] ECC: Fetching primary data for 2025-03.
[2025-10-24T18:26:36.150755] [DEBUG] [LOCAL     ] ECCU: Loaded 2156 existing records from primary storage.
[2025-10-24T18:26:36.150947] [INFO ] [MAIN      ] ECCU: Loaded 2156 existing records.
[2025-10-24T18:26:36.325701] [WARN ] [MAIN      ] ECCU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:26:36.325912] [INFO ] [MAIN      ] ECCU: Wiping existing primary data before full refresh.
[2025-10-24T18:26:36.325958] [INFO ] [LOCAL     ] ECCU: Starting deletion of primary data.
[2025-10-24T18:26:36.326116] [DEBUG] [LOCAL     ] ECCU: Deleted primary data file.
[2025-10-24T18:26:36.326175] [INFO ] [MAIN      ] ECCU: Starting full primary refresh.
[2025-10-24T18:26:36.673761] [INFO ] [REMOTE    ] ECCU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:26:36.947681] [INFO ] [REMOTE    ] ECCU: Fetching primary data for 2025-01.
[2025-10-24T18:26:37.727554] [INFO ] [REMOTE    ] ECCU: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T18:26:37.747697] [INFO ] [REMOTE    ] ECCU: Fetching primary data for 2025-02.
[2025-10-24T18:26:37.910588] [INFO ] [REMOTE    ] ECC: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T18:26:38.365976] [INFO ] [REMOTE    ] ECCU: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T18:26:38.547740] [INFO ] [REMOTE    ] ECAT: Fetching primary data for 2025-07.
[2025-10-24T18:26:39.347764] [INFO ] [REMOTE    ] ECCC: Fetching primary data for 2025-02.
[2025-10-24T18:26:39.700874] [INFO ] [REMOTE    ] ECCC: Incremental fetch complete for 2025-02 (0.35 seconds).
[2025-10-24T18:26:39.917876] [INFO ] [REMOTE    ] ECAT: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T18:26:40.147714] [INFO ] [REMOTE    ] ECC: Fetching primary data for 2025-04.
[2025-10-24T18:26:40.947725] [INFO ] [REMOTE    ] ECAT: Fetching primary data for 2025-08.
[2025-10-24T18:26:41.747696] [INFO ] [REMOTE    ] ECCC: Fetching primary data for 2025-03.
[2025-10-24T18:26:41.781166] [INFO ] [REMOTE    ] ECC: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T18:26:41.908904] [INFO ] [REMOTE    ] ECAT: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T18:26:42.080259] [INFO ] [REMOTE    ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds).
[2025-10-24T18:26:42.547672] [INFO ] [REMOTE    ] ECCC: Fetching primary data for 2025-04.
[2025-10-24T18:26:42.900487] [INFO ] [REMOTE    ] ECCC: Incremental fetch complete for 2025-04 (0.35 seconds).
[2025-10-24T18:26:43.347680] [INFO ] [REMOTE    ] ECAT: Fetching primary data for 2025-09.
[2025-10-24T18:26:44.147708] [INFO ] [REMOTE    ] ECCC: Fetching primary data for 2025-05.
[2025-10-24T18:26:44.598733] [INFO ] [REMOTE    ] ECCC: Incremental fetch complete for 2025-05 (0.45 seconds).
[2025-10-24T18:26:44.927876] [INFO ] [REMOTE    ] ECAT: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T18:26:44.947611] [INFO ] [REMOTE    ] ECAT: Fetching primary data for 2025-10.
[2025-10-24T18:26:45.747687] [INFO ] [REMOTE    ] ECCU: Fetching primary data for 2025-03.
[2025-10-24T18:26:46.282981] [INFO ] [REMOTE    ] ECAT: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T18:26:46.289192] [INFO ] [REMOTE    ] ECAT: Full fetch complete (42877 records).
[2025-10-24T18:26:46.289335] [DEBUG] [VALIDATOR ] ECAT: Validating primary data.
[2025-10-24T18:26:46.395758] [INFO ] [REMOTE    ] ECCU: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T18:26:46.552790] [INFO ] [REMOTE    ] ECCC: Fetching primary data for 2025-06.
[2025-10-24T18:26:46.685967] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present.
[2025-10-24T18:26:46.686087] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed.
[2025-10-24T18:26:46.686806] [INFO ] [MAIN      ] ECAT: Fetched primary data is valid.
[2025-10-24T18:26:46.686879] [DEBUG] [LOCAL     ] ECAT: Saving primary data.
[2025-10-24T18:26:46.687363] [FATAL] [LOCAL     ] ECAT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:26:46.687460] [FATAL] [MAIN      ] ECAT: Failed to save primary data.
[2025-10-24T18:26:46.687503] [WARN ] [MAIN      ] ECAT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:26:46.687575] [INFO ] [LOCAL     ] ECAT: Starting deletion of primary data.
[2025-10-24T18:26:46.687698] [DEBUG] [LOCAL     ] ECAT: No primary data file found to delete.
[2025-10-24T18:26:46.687769] [INFO ] [LOCAL     ] ECAT: Starting deletion of derivative data.
[2025-10-24T18:26:46.688006] [DEBUG] [LOCAL     ] ECAT: Deleted derivative data file.
[2025-10-24T18:26:46.688152] [INFO ] [MAIN      ] Update Progress: 685/2366 symbols completed. ECAT took 27.3s. Estimated remaining: 3h 32m 50s. Rate: 7.9 symbols/min
[2025-10-24T18:26:46.866331] [INFO ] [MAIN      ] ECCW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:26:46.866514] [DEBUG] [LOCAL     ] ECCW: No existing data file found in primary storage.
[2025-10-24T18:26:46.866551] [WARN ] [MAIN      ] ECCW: No existing data found, performing full refresh instead.
[2025-10-24T18:26:46.866688] [INFO ] [MAIN      ] ECCW: Wiping existing primary data before full refresh.
[2025-10-24T18:26:46.866742] [INFO ] [LOCAL     ] ECCW: Starting deletion of primary data.
[2025-10-24T18:26:46.866784] [DEBUG] [LOCAL     ] ECCW: No primary data file found to delete.
[2025-10-24T18:26:46.866815] [INFO ] [MAIN      ] ECCW: Starting full primary refresh.
[2025-10-24T18:26:47.063576] [INFO ] [REMOTE    ] ECCC: Incremental fetch complete for 2025-06 (0.51 seconds).
[2025-10-24T18:26:47.244898] [INFO ] [REMOTE    ] ECCW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:26:47.347639] [INFO ] [REMOTE    ] ECCW: Fetching primary data for 2025-01.
[2025-10-24T18:26:47.788754] [INFO ] [REMOTE    ] ECCW: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T18:26:48.147660] [INFO ] [REMOTE    ] ECCU: Fetching primary data for 2025-04.
[2025-10-24T18:26:48.795604] [INFO ] [REMOTE    ] ECCU: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T18:26:48.947638] [INFO ] [REMOTE    ] ECCW: Fetching primary data for 2025-02.
[2025-10-24T18:26:49.313874] [INFO ] [REMOTE    ] ECCW: Incremental fetch complete for 2025-02 (0.37 seconds).
[2025-10-24T18:26:49.747630] [INFO ] [REMOTE    ] ECCU: Fetching primary data for 2025-05.
[2025-10-24T18:26:50.210593] [INFO ] [REMOTE    ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds).
[2025-10-24T18:26:50.547675] [INFO ] [REMOTE    ] ECCU: Fetching primary data for 2025-06.
[2025-10-24T18:26:50.974709] [INFO ] [REMOTE    ] ECCU: Incremental fetch complete for 2025-06 (0.43 seconds).
[2025-10-24T18:26:51.347636] [INFO ] [REMOTE    ] ECCW: Fetching primary data for 2025-03.
[2025-10-24T18:26:51.670033] [INFO ] [REMOTE    ] ECCW: Incremental fetch complete for 2025-03 (0.32 seconds).
[2025-10-24T18:26:52.147712] [INFO ] [REMOTE    ] ECCW: Fetching primary data for 2025-04.
[2025-10-24T18:26:52.555402] [INFO ] [REMOTE    ] ECCW: Incremental fetch complete for 2025-04 (0.41 seconds).
[2025-10-24T18:26:52.947687] [INFO ] [REMOTE    ] ECCW: Fetching primary data for 2025-05.
[2025-10-24T18:26:53.373945] [INFO ] [REMOTE    ] ECCW: Incremental fetch complete for 2025-05 (0.43 seconds).
[2025-10-24T18:26:53.747696] [INFO ] [REMOTE    ] ECCU: Fetching primary data for 2025-07.
[2025-10-24T18:26:54.190219] [INFO ] [REMOTE    ] ECCU: Incremental fetch complete for 2025-07 (0.44 seconds).
[2025-10-24T18:26:54.547675] [INFO ] [REMOTE    ] ECCW: Fetching primary data for 2025-06.
[2025-10-24T18:26:54.877692] [INFO ] [REMOTE    ] ECCW: Incremental fetch complete for 2025-06 (0.33 seconds).
[2025-10-24T18:26:55.347672] [INFO ] [REMOTE    ] ECCU: Fetching primary data for 2025-08.
[2025-10-24T18:26:55.804662] [INFO ] [REMOTE    ] ECCU: Incremental fetch complete for 2025-08 (0.46 seconds).
[2025-10-24T18:26:56.147703] [INFO ] [REMOTE    ] ECCU: Fetching primary data for 2025-09.
[2025-10-24T18:26:56.576956] [INFO ] [REMOTE    ] ECCU: Incremental fetch complete for 2025-09 (0.43 seconds).
[2025-10-24T18:26:56.947676] [INFO ] [REMOTE    ] ECCU: Fetching primary data for 2025-10.
[2025-10-24T18:26:57.470947] [INFO ] [REMOTE    ] ECCU: Incremental fetch complete for 2025-10 (0.52 seconds).
[2025-10-24T18:26:57.472013] [INFO ] [REMOTE    ] ECCU: Full fetch complete (4076 records).
[2025-10-24T18:26:57.472092] [DEBUG] [VALIDATOR ] ECCU: Validating primary data.
[2025-10-24T18:26:57.753378] [INFO ] [REMOTE    ] ECCW: Fetching primary data for 2025-07.
[2025-10-24T18:26:57.832552] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present.
[2025-10-24T18:26:57.832638] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed.
[2025-10-24T18:26:57.832844] [INFO ] [MAIN      ] ECCU: Fetched primary data is valid.
[2025-10-24T18:26:57.832887] [DEBUG] [LOCAL     ] ECCU: Saving primary data.
[2025-10-24T18:26:57.833099] [FATAL] [LOCAL     ] ECCU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:26:57.833184] [FATAL] [MAIN      ] ECCU: Failed to save primary data.
[2025-10-24T18:26:57.833226] [WARN ] [MAIN      ] ECCU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:26:57.833261] [INFO ] [LOCAL     ] ECCU: Starting deletion of primary data.
[2025-10-24T18:26:57.833311] [DEBUG] [LOCAL     ] ECCU: No primary data file found to delete.
[2025-10-24T18:26:57.833347] [INFO ] [LOCAL     ] ECCU: Starting deletion of derivative data.
[2025-10-24T18:26:57.833530] [DEBUG] [LOCAL     ] ECCU: Deleted derivative data file.
[2025-10-24T18:26:57.833629] [INFO ] [MAIN      ] Update Progress: 686/2366 symbols completed. ECCU took 21.9s. Estimated remaining: 3h 32m 51s. Rate: 7.9 symbols/min
[2025-10-24T18:26:57.997966] [INFO ] [MAIN      ] ECCX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:26:57.998145] [DEBUG] [LOCAL     ] ECCX: No existing data file found in primary storage.
[2025-10-24T18:26:57.998183] [WARN ] [MAIN      ] ECCX: No existing data found, performing full refresh instead.
[2025-10-24T18:26:57.998326] [INFO ] [MAIN      ] ECCX: Wiping existing primary data before full refresh.
[2025-10-24T18:26:57.998371] [INFO ] [LOCAL     ] ECCX: Starting deletion of primary data.
[2025-10-24T18:26:57.998411] [DEBUG] [LOCAL     ] ECCX: No primary data file found to delete.
[2025-10-24T18:26:57.998443] [INFO ] [MAIN      ] ECCX: Starting full primary refresh.
[2025-10-24T18:26:58.273834] [INFO ] [REMOTE    ] ECCW: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T18:26:58.350410] [INFO ] [REMOTE    ] ECCX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:26:58.547675] [INFO ] [REMOTE    ] ECCW: Fetching primary data for 2025-08.
[2025-10-24T18:26:58.894881] [INFO ] [REMOTE    ] ECCW: Incremental fetch complete for 2025-08 (0.35 seconds).
[2025-10-24T18:26:59.347708] [INFO ] [REMOTE    ] ECCC: Fetching primary data for 2025-07.
[2025-10-24T18:26:59.701952] [INFO ] [REMOTE    ] ECCC: Incremental fetch complete for 2025-07 (0.35 seconds).
[2025-10-24T18:27:00.147725] [INFO ] [REMOTE    ] ECCC: Fetching primary data for 2025-08.
[2025-10-24T18:27:00.947702] [INFO ] [REMOTE    ] ECCX: Fetching primary data for 2025-01.
[2025-10-24T18:27:01.007672] [INFO ] [REMOTE    ] ECCC: Incremental fetch complete for 2025-08 (0.86 seconds).
[2025-10-24T18:27:01.747694] [INFO ] [REMOTE    ] ECCW: Fetching primary data for 2025-09.
[2025-10-24T18:27:02.547712] [INFO ] [REMOTE    ] ECC: Fetching primary data for 2025-05.
[2025-10-24T18:27:02.897052] [INFO ] [REMOTE    ] ECCW: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T18:27:02.907465] [INFO ] [REMOTE    ] ECCX: Incremental fetch complete for 2025-01 (1.96 seconds).
[2025-10-24T18:27:03.347689] [INFO ] [REMOTE    ] ECCX: Fetching primary data for 2025-02.
[2025-10-24T18:27:04.147682] [INFO ] [REMOTE    ] ECCW: Fetching primary data for 2025-10.
[2025-10-24T18:27:04.435752] [INFO ] [REMOTE    ] ECCX: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T18:27:04.947679] [INFO ] [REMOTE    ] ECCX: Fetching primary data for 2025-03.
[2025-10-24T18:27:04.961497] [INFO ] [REMOTE    ] ECCW: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T18:27:04.962361] [INFO ] [REMOTE    ] ECCW: Full fetch complete (1424 records).
[2025-10-24T18:27:04.962431] [DEBUG] [VALIDATOR ] ECCW: Validating primary data.
[2025-10-24T18:27:05.170402] [INFO ] [REMOTE    ] ECC: Incremental fetch complete for 2025-05 (2.62 seconds).
[2025-10-24T18:27:05.175222] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days
[2025-10-24T18:27:05.184204] [FATAL] [MAIN      ] ECCW: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:27:05.184599] [WARN ] [MAIN      ] ECCW: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:27:05.184804] [INFO ] [LOCAL     ] ECCW: Starting deletion of primary data.
[2025-10-24T18:27:05.184873] [DEBUG] [LOCAL     ] ECCW: No primary data file found to delete.
[2025-10-24T18:27:05.184911] [INFO ] [LOCAL     ] ECCW: Starting deletion of derivative data.
[2025-10-24T18:27:05.185271] [DEBUG] [LOCAL     ] ECCW: No derivative data file found to delete.
[2025-10-24T18:27:05.185356] [INFO ] [MAIN      ] Update Progress: 687/2366 symbols completed. ECCW took 18.5s. Estimated remaining: 3h 32m 43s. Rate: 7.9 symbols/min
[2025-10-24T18:27:05.351346] [INFO ] [MAIN      ] ECG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:27:05.383820] [DEBUG] [LOCAL     ] ECG: Loaded 32971 existing records from primary storage.
[2025-10-24T18:27:05.384082] [INFO ] [MAIN      ] ECG: Loaded 32971 existing records.
[2025-10-24T18:27:05.569437] [WARN ] [MAIN      ] ECG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:27:05.569615] [INFO ] [MAIN      ] ECG: Wiping existing primary data before full refresh.
[2025-10-24T18:27:05.569689] [INFO ] [LOCAL     ] ECG: Starting deletion of primary data.
[2025-10-24T18:27:05.569897] [DEBUG] [LOCAL     ] ECG: Deleted primary data file.
[2025-10-24T18:27:05.569951] [INFO ] [MAIN      ] ECG: Starting full primary refresh.
[2025-10-24T18:27:05.755540] [INFO ] [REMOTE    ] ECCC: Fetching primary data for 2025-09.
[2025-10-24T18:27:05.956010] [INFO ] [REMOTE    ] ECG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:27:06.208966] [INFO ] [REMOTE    ] ECCC: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T18:27:06.280996] [INFO ] [REMOTE    ] ECCX: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T18:27:06.547683] [INFO ] [REMOTE    ] ECCC: Fetching primary data for 2025-10.
[2025-10-24T18:27:07.347633] [INFO ] [REMOTE    ] ECC: Fetching primary data for 2025-06.
[2025-10-24T18:27:07.548070] [INFO ] [REMOTE    ] ECCC: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T18:27:07.548901] [INFO ] [REMOTE    ] ECCC: Full fetch complete (1303 records).
[2025-10-24T18:27:07.548970] [DEBUG] [VALIDATOR ] ECCC: Validating primary data.
[2025-10-24T18:27:07.549307] [FATAL] [VALIDATOR ] ECCC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:27:07.549403] [FATAL] [MAIN      ] ECCC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:27:07.549474] [WARN ] [MAIN      ] ECCC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:27:07.549547] [INFO ] [LOCAL     ] ECCC: Starting deletion of primary data.
[2025-10-24T18:27:07.549608] [DEBUG] [LOCAL     ] ECCC: No primary data file found to delete.
[2025-10-24T18:27:07.549675] [INFO ] [LOCAL     ] ECCC: Starting deletion of derivative data.
[2025-10-24T18:27:07.549743] [DEBUG] [LOCAL     ] ECCC: No derivative data file found to delete.
[2025-10-24T18:27:07.549798] [INFO ] [MAIN      ] Update Progress: 688/2366 symbols completed. ECCC took 35.7s. Estimated remaining: 3h 32m 23s. Rate: 7.9 symbols/min
[2025-10-24T18:27:07.735323] [INFO ] [MAIN      ] ECL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:27:07.781876] [DEBUG] [LOCAL     ] ECL: Loaded 47048 existing records from primary storage.
[2025-10-24T18:27:07.782192] [INFO ] [MAIN      ] ECL: Loaded 47048 existing records.
[2025-10-24T18:27:07.991994] [WARN ] [MAIN      ] ECL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:27:07.992219] [INFO ] [MAIN      ] ECL: Wiping existing primary data before full refresh.
[2025-10-24T18:27:07.992298] [INFO ] [LOCAL     ] ECL: Starting deletion of primary data.
[2025-10-24T18:27:07.992751] [DEBUG] [LOCAL     ] ECL: Deleted primary data file.
[2025-10-24T18:27:07.992807] [INFO ] [MAIN      ] ECL: Starting full primary refresh.
[2025-10-24T18:27:08.154608] [INFO ] [REMOTE    ] ECG: Fetching primary data for 2025-01.
[2025-10-24T18:27:08.379769] [INFO ] [REMOTE    ] ECL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:27:08.947621] [INFO ] [REMOTE    ] ECL: Fetching primary data for 2025-01.
[2025-10-24T18:27:09.043761] [INFO ] [REMOTE    ] ECC: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T18:27:09.747679] [INFO ] [REMOTE    ] ECCX: Fetching primary data for 2025-04.
[2025-10-24T18:27:09.786256] [INFO ] [REMOTE    ] ECG: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T18:27:10.078212] [INFO ] [REMOTE    ] ECCX: Incremental fetch complete for 2025-04 (0.33 seconds).
[2025-10-24T18:27:10.331120] [INFO ] [REMOTE    ] ECL: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T18:27:10.547632] [INFO ] [REMOTE    ] ECL: Fetching primary data for 2025-02.
[2025-10-24T18:27:11.347686] [INFO ] [REMOTE    ] ECC: Fetching primary data for 2025-07.
[2025-10-24T18:27:12.071088] [INFO ] [REMOTE    ] ECL: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T18:27:12.147636] [INFO ] [REMOTE    ] ECG: Fetching primary data for 2025-02.
[2025-10-24T18:27:12.947632] [INFO ] [REMOTE    ] ECCX: Fetching primary data for 2025-05.
[2025-10-24T18:27:13.286169] [INFO ] [REMOTE    ] ECC: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T18:27:13.338849] [INFO ] [REMOTE    ] ECG: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T18:27:13.617749] [INFO ] [REMOTE    ] ECCX: Incremental fetch complete for 2025-05 (0.67 seconds).
[2025-10-24T18:27:13.747682] [INFO ] [REMOTE    ] ECG: Fetching primary data for 2025-03.
[2025-10-24T18:27:14.547633] [INFO ] [REMOTE    ] ECL: Fetching primary data for 2025-03.
[2025-10-24T18:27:15.213244] [INFO ] [REMOTE    ] ECG: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T18:27:15.347618] [INFO ] [REMOTE    ] ECG: Fetching primary data for 2025-04.
[2025-10-24T18:27:15.964410] [INFO ] [REMOTE    ] ECL: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T18:27:16.147637] [INFO ] [REMOTE    ] ECL: Fetching primary data for 2025-04.
[2025-10-24T18:27:16.759990] [INFO ] [REMOTE    ] ECG: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T18:27:16.947635] [INFO ] [REMOTE    ] ECC: Fetching primary data for 2025-08.
[2025-10-24T18:27:17.635916] [INFO ] [REMOTE    ] ECL: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T18:27:17.747622] [INFO ] [REMOTE    ] ECL: Fetching primary data for 2025-05.
[2025-10-24T18:27:18.245117] [INFO ] [REMOTE    ] ECC: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T18:27:18.547681] [INFO ] [REMOTE    ] ECC: Fetching primary data for 2025-09.
[2025-10-24T18:27:19.075899] [INFO ] [REMOTE    ] ECL: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T18:27:19.347638] [INFO ] [REMOTE    ] ECL: Fetching primary data for 2025-06.
[2025-10-24T18:27:19.914780] [INFO ] [REMOTE    ] ECC: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T18:27:20.147742] [INFO ] [REMOTE    ] ECG: Fetching primary data for 2025-05.
[2025-10-24T18:27:20.834249] [INFO ] [REMOTE    ] ECL: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T18:27:20.947674] [INFO ] [REMOTE    ] ECC: Fetching primary data for 2025-10.
[2025-10-24T18:27:21.747723] [INFO ] [REMOTE    ] ECCX: Fetching primary data for 2025-06.
[2025-10-24T18:27:21.790729] [INFO ] [REMOTE    ] ECG: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T18:27:22.027135] [INFO ] [REMOTE    ] ECCX: Incremental fetch complete for 2025-06 (0.28 seconds).
[2025-10-24T18:27:22.547694] [INFO ] [REMOTE    ] ECCX: Fetching primary data for 2025-07.
[2025-10-24T18:27:22.670789] [INFO ] [REMOTE    ] ECC: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T18:27:22.678611] [INFO ] [REMOTE    ] ECC: Full fetch complete (61329 records).
[2025-10-24T18:27:22.678779] [DEBUG] [VALIDATOR ] ECC: Validating primary data.
[2025-10-24T18:27:22.679428] [FATAL] [VALIDATOR ] ECC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:27:22.679509] [FATAL] [MAIN      ] ECC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:27:22.679552] [WARN ] [MAIN      ] ECC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:27:22.679602] [INFO ] [LOCAL     ] ECC: Starting deletion of primary data.
[2025-10-24T18:27:22.679710] [DEBUG] [LOCAL     ] ECC: No primary data file found to delete.
[2025-10-24T18:27:22.679758] [INFO ] [LOCAL     ] ECC: Starting deletion of derivative data.
[2025-10-24T18:27:22.679912] [DEBUG] [LOCAL     ] ECC: Deleted derivative data file.
[2025-10-24T18:27:22.680382] [INFO ] [MAIN      ] Update Progress: 689/2366 symbols completed. ECC took 52.8s. Estimated remaining: 3h 32m 33s. Rate: 7.9 symbols/min
[2025-10-24T18:27:22.849589] [INFO ] [MAIN      ] ECO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:27:22.868138] [DEBUG] [LOCAL     ] ECO: Loaded 18178 existing records from primary storage.
[2025-10-24T18:27:22.868374] [INFO ] [MAIN      ] ECO: Loaded 18178 existing records.
[2025-10-24T18:27:23.011282] [INFO ] [REMOTE    ] ECCX: Incremental fetch complete for 2025-07 (0.46 seconds).
[2025-10-24T18:27:23.051724] [WARN ] [MAIN      ] ECO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:27:23.051916] [INFO ] [MAIN      ] ECO: Wiping existing primary data before full refresh.
[2025-10-24T18:27:23.051972] [INFO ] [LOCAL     ] ECO: Starting deletion of primary data.
[2025-10-24T18:27:23.052216] [DEBUG] [LOCAL     ] ECO: Deleted primary data file.
[2025-10-24T18:27:23.052255] [INFO ] [MAIN      ] ECO: Starting full primary refresh.
[2025-10-24T18:27:23.362280] [INFO ] [REMOTE    ] ECCX: Fetching primary data for 2025-08.
[2025-10-24T18:27:23.402064] [INFO ] [REMOTE    ] ECO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:27:23.828911] [INFO ] [REMOTE    ] ECCX: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T18:27:24.147619] [INFO ] [REMOTE    ] ECCX: Fetching primary data for 2025-09.
[2025-10-24T18:27:24.570200] [INFO ] [REMOTE    ] ECCX: Incremental fetch complete for 2025-09 (0.42 seconds).
[2025-10-24T18:27:24.947717] [INFO ] [REMOTE    ] ECO: Fetching primary data for 2025-01.
[2025-10-24T18:27:25.747724] [INFO ] [REMOTE    ] ECCX: Fetching primary data for 2025-10.
[2025-10-24T18:27:26.196931] [INFO ] [REMOTE    ] ECCX: Incremental fetch complete for 2025-10 (0.45 seconds).
[2025-10-24T18:27:26.198082] [INFO ] [REMOTE    ] ECCX: Full fetch complete (1456 records).
[2025-10-24T18:27:26.198245] [DEBUG] [VALIDATOR ] ECCX: Validating primary data.
[2025-10-24T18:27:26.344453] [INFO ] [REMOTE    ] ECO: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T18:27:26.410153] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days
[2025-10-24T18:27:26.410312] [FATAL] [MAIN      ] ECCX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:27:26.410357] [WARN ] [MAIN      ] ECCX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:27:26.410397] [INFO ] [LOCAL     ] ECCX: Starting deletion of primary data.
[2025-10-24T18:27:26.410451] [DEBUG] [LOCAL     ] ECCX: No primary data file found to delete.
[2025-10-24T18:27:26.410487] [INFO ] [LOCAL     ] ECCX: Starting deletion of derivative data.
[2025-10-24T18:27:26.410526] [DEBUG] [LOCAL     ] ECCX: No derivative data file found to delete.
[2025-10-24T18:27:26.410579] [INFO ] [MAIN      ] Update Progress: 690/2366 symbols completed. ECCX took 28.6s. Estimated remaining: 3h 32m 16s. Rate: 7.9 symbols/min
[2025-10-24T18:27:26.556508] [INFO ] [REMOTE    ] ECG: Fetching primary data for 2025-06.
[2025-10-24T18:27:26.589121] [INFO ] [MAIN      ] ECVT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:27:26.631771] [DEBUG] [LOCAL     ] ECVT: Loaded 43397 existing records from primary storage.
[2025-10-24T18:27:26.632059] [INFO ] [MAIN      ] ECVT: Loaded 43397 existing records.
[2025-10-24T18:27:26.808132] [WARN ] [MAIN      ] ECVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:27:26.808357] [INFO ] [MAIN      ] ECVT: Wiping existing primary data before full refresh.
[2025-10-24T18:27:26.808405] [INFO ] [LOCAL     ] ECVT: Starting deletion of primary data.
[2025-10-24T18:27:26.808726] [DEBUG] [LOCAL     ] ECVT: Deleted primary data file.
[2025-10-24T18:27:26.808783] [INFO ] [MAIN      ] ECVT: Starting full primary refresh.
[2025-10-24T18:27:27.163112] [INFO ] [REMOTE    ] ECVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:27:27.347614] [INFO ] [REMOTE    ] ECO: Fetching primary data for 2025-02.
[2025-10-24T18:27:27.815125] [INFO ] [REMOTE    ] ECG: Incremental fetch complete for 2025-06 (1.26 seconds).
[2025-10-24T18:27:28.147677] [INFO ] [REMOTE    ] ECG: Fetching primary data for 2025-07.
[2025-10-24T18:27:28.452263] [INFO ] [REMOTE    ] ECO: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T18:27:28.947612] [INFO ] [REMOTE    ] ECVT: Fetching primary data for 2025-01.
[2025-10-24T18:27:29.401540] [INFO ] [REMOTE    ] ECG: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T18:27:29.747679] [INFO ] [REMOTE    ] ECL: Fetching primary data for 2025-07.
[2025-10-24T18:27:30.322307] [INFO ] [REMOTE    ] ECVT: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T18:27:30.547728] [INFO ] [REMOTE    ] ECG: Fetching primary data for 2025-08.
[2025-10-24T18:27:31.347720] [INFO ] [REMOTE    ] ECO: Fetching primary data for 2025-03.
[2025-10-24T18:27:31.427454] [INFO ] [REMOTE    ] ECL: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T18:27:32.078037] [INFO ] [REMOTE    ] ECG: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T18:27:32.144148] [INFO ] [REMOTE    ] ECO: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T18:27:32.148799] [INFO ] [REMOTE    ] ECG: Fetching primary data for 2025-09.
[2025-10-24T18:27:32.947618] [INFO ] [REMOTE    ] ECVT: Fetching primary data for 2025-02.
[2025-10-24T18:27:33.323405] [INFO ] [REMOTE    ] ECG: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T18:27:33.747702] [INFO ] [REMOTE    ] ECG: Fetching primary data for 2025-10.
[2025-10-24T18:27:34.552859] [INFO ] [REMOTE    ] ECL: Fetching primary data for 2025-08.
[2025-10-24T18:27:34.569524] [INFO ] [REMOTE    ] ECVT: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T18:27:35.028907] [INFO ] [REMOTE    ] ECG: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T18:27:35.035080] [INFO ] [REMOTE    ] ECG: Full fetch complete (50806 records).
[2025-10-24T18:27:35.035210] [DEBUG] [VALIDATOR ] ECG: Validating primary data.
[2025-10-24T18:27:35.352833] [INFO ] [REMOTE    ] ECO: Fetching primary data for 2025-04.
[2025-10-24T18:27:35.450509] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present.
[2025-10-24T18:27:35.450586] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed.
[2025-10-24T18:27:35.451282] [INFO ] [MAIN      ] ECG: Fetched primary data is valid.
[2025-10-24T18:27:35.451343] [DEBUG] [LOCAL     ] ECG: Saving primary data.
[2025-10-24T18:27:35.451851] [FATAL] [LOCAL     ] ECG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:27:35.451938] [FATAL] [MAIN      ] ECG: Failed to save primary data.
[2025-10-24T18:27:35.451979] [WARN ] [MAIN      ] ECG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:27:35.452042] [INFO ] [LOCAL     ] ECG: Starting deletion of primary data.
[2025-10-24T18:27:35.452099] [DEBUG] [LOCAL     ] ECG: No primary data file found to delete.
[2025-10-24T18:27:35.452155] [INFO ] [LOCAL     ] ECG: Starting deletion of derivative data.
[2025-10-24T18:27:35.452309] [DEBUG] [LOCAL     ] ECG: Deleted derivative data file.
[2025-10-24T18:27:35.452406] [INFO ] [MAIN      ] Update Progress: 691/2366 symbols completed. ECG took 30.3s. Estimated remaining: 3h 32m 12s. Rate: 7.9 symbols/min
[2025-10-24T18:27:35.629761] [INFO ] [MAIN      ] ED: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:27:35.629910] [DEBUG] [LOCAL     ] ED: No existing data file found in primary storage.
[2025-10-24T18:27:35.629947] [WARN ] [MAIN      ] ED: No existing data found, performing full refresh instead.
[2025-10-24T18:27:35.630057] [INFO ] [MAIN      ] ED: Wiping existing primary data before full refresh.
[2025-10-24T18:27:35.630099] [INFO ] [LOCAL     ] ED: Starting deletion of primary data.
[2025-10-24T18:27:35.630145] [DEBUG] [LOCAL     ] ED: No primary data file found to delete.
[2025-10-24T18:27:35.630179] [INFO ] [MAIN      ] ED: Starting full primary refresh.
[2025-10-24T18:27:36.019493] [INFO ] [REMOTE    ] ED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:27:36.147616] [INFO ] [REMOTE    ] ED: Fetching primary data for 2025-01.
[2025-10-24T18:27:36.242854] [INFO ] [REMOTE    ] ECL: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T18:27:36.292563] [INFO ] [REMOTE    ] ECO: Incremental fetch complete for 2025-04 (0.94 seconds).
[2025-10-24T18:27:36.947686] [INFO ] [REMOTE    ] ECO: Fetching primary data for 2025-05.
[2025-10-24T18:27:37.677444] [INFO ] [REMOTE    ] ED: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T18:27:37.747619] [INFO ] [REMOTE    ] ED: Fetching primary data for 2025-02.
[2025-10-24T18:27:37.970487] [INFO ] [REMOTE    ] ECO: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T18:27:38.547673] [INFO ] [REMOTE    ] ECL: Fetching primary data for 2025-09.
[2025-10-24T18:27:39.347620] [INFO ] [REMOTE    ] ECO: Fetching primary data for 2025-06.
[2025-10-24T18:27:39.594487] [INFO ] [REMOTE    ] ED: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T18:27:39.966377] [INFO ] [REMOTE    ] ECL: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T18:27:40.147635] [INFO ] [REMOTE    ] ECL: Fetching primary data for 2025-10.
[2025-10-24T18:27:40.445810] [INFO ] [REMOTE    ] ECO: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T18:27:40.947722] [INFO ] [REMOTE    ] ED: Fetching primary data for 2025-03.
[2025-10-24T18:27:41.747705] [INFO ] [REMOTE    ] ECVT: Fetching primary data for 2025-03.
[2025-10-24T18:27:42.039072] [INFO ] [REMOTE    ] ECL: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T18:27:42.047397] [INFO ] [REMOTE    ] ECL: Full fetch complete (68062 records).
[2025-10-24T18:27:42.047512] [DEBUG] [VALIDATOR ] ECL: Validating primary data.
[2025-10-24T18:27:42.049040] [FATAL] [VALIDATOR ] ECL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:27:42.049124] [FATAL] [MAIN      ] ECL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:27:42.049176] [WARN ] [MAIN      ] ECL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:27:42.049261] [INFO ] [LOCAL     ] ECL: Starting deletion of primary data.
[2025-10-24T18:27:42.049344] [DEBUG] [LOCAL     ] ECL: No primary data file found to delete.
[2025-10-24T18:27:42.049392] [INFO ] [LOCAL     ] ECL: Starting deletion of derivative data.
[2025-10-24T18:27:42.049576] [DEBUG] [LOCAL     ] ECL: Deleted derivative data file.
[2025-10-24T18:27:42.050055] [INFO ] [MAIN      ] Update Progress: 692/2366 symbols completed. ECL took 34.5s. Estimated remaining: 3h 32m 2s. Rate: 7.9 symbols/min
[2025-10-24T18:27:42.217676] [INFO ] [MAIN      ] EDD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:27:42.244854] [DEBUG] [LOCAL     ] EDD: Loaded 27448 existing records from primary storage.
[2025-10-24T18:27:42.245099] [INFO ] [MAIN      ] EDD: Loaded 27448 existing records.
[2025-10-24T18:27:42.448807] [WARN ] [MAIN      ] EDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:27:42.450850] [INFO ] [REMOTE    ] ED: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T18:27:42.449470] [INFO ] [MAIN      ] EDD: Wiping existing primary data before full refresh.
[2025-10-24T18:27:42.461246] [INFO ] [LOCAL     ] EDD: Starting deletion of primary data.
[2025-10-24T18:27:42.462050] [DEBUG] [LOCAL     ] EDD: Deleted primary data file.
[2025-10-24T18:27:42.462107] [INFO ] [MAIN      ] EDD: Starting full primary refresh.
[2025-10-24T18:27:42.557941] [INFO ] [REMOTE    ] ECO: Fetching primary data for 2025-07.
[2025-10-24T18:27:42.809044] [INFO ] [REMOTE    ] EDD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:27:43.308680] [INFO ] [REMOTE    ] ECVT: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T18:27:43.347619] [INFO ] [REMOTE    ] ECVT: Fetching primary data for 2025-04.
[2025-10-24T18:27:43.663751] [INFO ] [REMOTE    ] ECO: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T18:27:44.147667] [INFO ] [REMOTE    ] ECO: Fetching primary data for 2025-08.
[2025-10-24T18:27:44.879308] [INFO ] [REMOTE    ] ECVT: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T18:27:44.947639] [INFO ] [REMOTE    ] ECVT: Fetching primary data for 2025-05.
[2025-10-24T18:27:45.060442] [INFO ] [REMOTE    ] ECO: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T18:27:45.747640] [INFO ] [REMOTE    ] ECO: Fetching primary data for 2025-09.
[2025-10-24T18:27:46.375342] [INFO ] [REMOTE    ] ECVT: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T18:27:46.547625] [INFO ] [REMOTE    ] EDD: Fetching primary data for 2025-01.
[2025-10-24T18:27:46.850905] [INFO ] [REMOTE    ] ECO: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T18:27:47.347742] [INFO ] [REMOTE    ] ED: Fetching primary data for 2025-04.
[2025-10-24T18:27:47.760682] [INFO ] [REMOTE    ] EDD: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T18:27:48.147718] [INFO ] [REMOTE    ] ECVT: Fetching primary data for 2025-06.
[2025-10-24T18:27:48.947704] [INFO ] [REMOTE    ] ECO: Fetching primary data for 2025-10.
[2025-10-24T18:27:49.365600] [INFO ] [REMOTE    ] ED: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T18:27:49.716554] [INFO ] [REMOTE    ] ECVT: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T18:27:49.747612] [INFO ] [REMOTE    ] ECVT: Fetching primary data for 2025-07.
[2025-10-24T18:27:50.109988] [INFO ] [REMOTE    ] ECO: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T18:27:50.113829] [INFO ] [REMOTE    ] ECO: Full fetch complete (28334 records).
[2025-10-24T18:27:50.113936] [DEBUG] [VALIDATOR ] ECO: Validating primary data.
[2025-10-24T18:27:50.478877] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present.
[2025-10-24T18:27:50.478952] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed.
[2025-10-24T18:27:50.479489] [INFO ] [MAIN      ] ECO: Fetched primary data is valid.
[2025-10-24T18:27:50.479528] [DEBUG] [LOCAL     ] ECO: Saving primary data.
[2025-10-24T18:27:50.479858] [FATAL] [LOCAL     ] ECO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:27:50.479947] [FATAL] [MAIN      ] ECO: Failed to save primary data.
[2025-10-24T18:27:50.479990] [WARN ] [MAIN      ] ECO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:27:50.480024] [INFO ] [LOCAL     ] ECO: Starting deletion of primary data.
[2025-10-24T18:27:50.480073] [DEBUG] [LOCAL     ] ECO: No primary data file found to delete.
[2025-10-24T18:27:50.480110] [INFO ] [LOCAL     ] ECO: Starting deletion of derivative data.
[2025-10-24T18:27:50.480266] [DEBUG] [LOCAL     ] ECO: Deleted derivative data file.
[2025-10-24T18:27:50.480358] [INFO ] [MAIN      ] Update Progress: 693/2366 symbols completed. ECO took 27.8s. Estimated remaining: 3h 31m 57s. Rate: 7.9 symbols/min
[2025-10-24T18:27:50.553468] [INFO ] [REMOTE    ] ED: Fetching primary data for 2025-05.
[2025-10-24T18:27:50.656891] [INFO ] [MAIN      ] EDF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:27:50.672242] [DEBUG] [LOCAL     ] EDF: Loaded 12885 existing records from primary storage.
[2025-10-24T18:27:50.672479] [INFO ] [MAIN      ] EDF: Loaded 12885 existing records.
[2025-10-24T18:27:50.850460] [WARN ] [MAIN      ] EDF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:27:50.850688] [INFO ] [MAIN      ] EDF: Wiping existing primary data before full refresh.
[2025-10-24T18:27:50.850748] [INFO ] [LOCAL     ] EDF: Starting deletion of primary data.
[2025-10-24T18:27:50.850946] [DEBUG] [LOCAL     ] EDF: Deleted primary data file.
[2025-10-24T18:27:50.851001] [INFO ] [MAIN      ] EDF: Starting full primary refresh.
[2025-10-24T18:27:51.210183] [INFO ] [REMOTE    ] EDF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:27:51.346342] [INFO ] [REMOTE    ] ECVT: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T18:27:51.355380] [INFO ] [REMOTE    ] EDD: Fetching primary data for 2025-02.
[2025-10-24T18:27:52.147695] [INFO ] [REMOTE    ] ECVT: Fetching primary data for 2025-08.
[2025-10-24T18:27:52.490235] [INFO ] [REMOTE    ] ED: Incremental fetch complete for 2025-05 (1.94 seconds).
[2025-10-24T18:27:52.610857] [INFO ] [REMOTE    ] EDD: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T18:27:52.947676] [INFO ] [REMOTE    ] ED: Fetching primary data for 2025-06.
[2025-10-24T18:27:53.453570] [INFO ] [REMOTE    ] ECVT: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T18:27:53.747683] [INFO ] [REMOTE    ] ECVT: Fetching primary data for 2025-09.
[2025-10-24T18:27:54.547692] [INFO ] [REMOTE    ] EDF: Fetching primary data for 2025-01.
[2025-10-24T18:27:54.737319] [INFO ] [REMOTE    ] ED: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T18:27:55.347621] [INFO ] [REMOTE    ] ED: Fetching primary data for 2025-07.
[2025-10-24T18:27:55.388847] [INFO ] [REMOTE    ] ECVT: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T18:27:55.615973] [INFO ] [REMOTE    ] EDF: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T18:27:56.147729] [INFO ] [REMOTE    ] ECVT: Fetching primary data for 2025-10.
[2025-10-24T18:27:56.947701] [INFO ] [REMOTE    ] EDF: Fetching primary data for 2025-02.
[2025-10-24T18:27:57.048357] [INFO ] [REMOTE    ] ED: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T18:27:57.707526] [INFO ] [REMOTE    ] ECVT: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T18:27:57.714974] [INFO ] [REMOTE    ] ECVT: Full fetch complete (60344 records).
[2025-10-24T18:27:57.715076] [DEBUG] [VALIDATOR ] ECVT: Validating primary data.
[2025-10-24T18:27:57.752743] [INFO ] [REMOTE    ] EDD: Fetching primary data for 2025-03.
[2025-10-24T18:27:58.110624] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present.
[2025-10-24T18:27:58.110740] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed.
[2025-10-24T18:27:58.111663] [INFO ] [MAIN      ] ECVT: Fetched primary data is valid.
[2025-10-24T18:27:58.111727] [DEBUG] [LOCAL     ] ECVT: Saving primary data.
[2025-10-24T18:27:58.112243] [FATAL] [LOCAL     ] ECVT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:27:58.112331] [FATAL] [MAIN      ] ECVT: Failed to save primary data.
[2025-10-24T18:27:58.112374] [WARN ] [MAIN      ] ECVT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:27:58.112412] [INFO ] [LOCAL     ] ECVT: Starting deletion of primary data.
[2025-10-24T18:27:58.112464] [DEBUG] [LOCAL     ] ECVT: No primary data file found to delete.
[2025-10-24T18:27:58.112500] [INFO ] [LOCAL     ] ECVT: Starting deletion of derivative data.
[2025-10-24T18:27:58.112687] [DEBUG] [LOCAL     ] ECVT: Deleted derivative data file.
[2025-10-24T18:27:58.113240] [INFO ] [MAIN      ] Update Progress: 694/2366 symbols completed. ECVT took 31.7s. Estimated remaining: 3h 31m 49s. Rate: 7.9 symbols/min
[2025-10-24T18:27:58.228890] [INFO ] [REMOTE    ] EDF: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T18:27:58.304301] [INFO ] [MAIN      ] EDN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:27:58.324933] [DEBUG] [LOCAL     ] EDN: Loaded 19477 existing records from primary storage.
[2025-10-24T18:27:58.325210] [INFO ] [MAIN      ] EDN: Loaded 19477 existing records.
[2025-10-24T18:27:58.501561] [WARN ] [MAIN      ] EDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:27:58.501838] [INFO ] [MAIN      ] EDN: Wiping existing primary data before full refresh.
[2025-10-24T18:27:58.501898] [INFO ] [LOCAL     ] EDN: Starting deletion of primary data.
[2025-10-24T18:27:58.502240] [DEBUG] [LOCAL     ] EDN: Deleted primary data file.
[2025-10-24T18:27:58.502298] [INFO ] [MAIN      ] EDN: Starting full primary refresh.
[2025-10-24T18:27:58.556380] [INFO ] [REMOTE    ] EDF: Fetching primary data for 2025-03.
[2025-10-24T18:27:58.872950] [INFO ] [REMOTE    ] EDN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:27:59.196289] [INFO ] [REMOTE    ] EDD: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T18:27:59.347631] [INFO ] [REMOTE    ] ED: Fetching primary data for 2025-08.
[2025-10-24T18:27:59.561604] [INFO ] [REMOTE    ] EDF: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T18:28:00.147638] [INFO ] [REMOTE    ] EDD: Fetching primary data for 2025-04.
[2025-10-24T18:28:00.947689] [INFO ] [REMOTE    ] EDF: Fetching primary data for 2025-04.
[2025-10-24T18:28:01.663610] [INFO ] [REMOTE    ] EDD: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T18:28:01.747750] [INFO ] [REMOTE    ] EDN: Fetching primary data for 2025-01.
[2025-10-24T18:28:01.794380] [INFO ] [REMOTE    ] ED: Incremental fetch complete for 2025-08 (2.45 seconds).
[2025-10-24T18:28:02.547698] [INFO ] [REMOTE    ] EDD: Fetching primary data for 2025-05.
[2025-10-24T18:28:03.347689] [INFO ] [REMOTE    ] ED: Fetching primary data for 2025-09.
[2025-10-24T18:28:03.642905] [INFO ] [REMOTE    ] EDF: Incremental fetch complete for 2025-04 (2.70 seconds).
[2025-10-24T18:28:04.073463] [INFO ] [REMOTE    ] EDN: Incremental fetch complete for 2025-01 (2.33 seconds).
[2025-10-24T18:28:04.094129] [INFO ] [REMOTE    ] EDD: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T18:28:04.147596] [INFO ] [REMOTE    ] EDD: Fetching primary data for 2025-06.
[2025-10-24T18:28:04.947671] [INFO ] [REMOTE    ] EDF: Fetching primary data for 2025-05.
[2025-10-24T18:28:05.747632] [INFO ] [REMOTE    ] EDN: Fetching primary data for 2025-02.
[2025-10-24T18:28:05.973510] [INFO ] [REMOTE    ] ED: Incremental fetch complete for 2025-09 (2.63 seconds).
[2025-10-24T18:28:05.997326] [INFO ] [REMOTE    ] EDF: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T18:28:06.071919] [INFO ] [REMOTE    ] EDD: Incremental fetch complete for 2025-06 (1.92 seconds).
[2025-10-24T18:28:06.547618] [INFO ] [REMOTE    ] EDD: Fetching primary data for 2025-07.
[2025-10-24T18:28:07.236900] [INFO ] [REMOTE    ] EDN: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T18:28:07.347628] [INFO ] [REMOTE    ] EDF: Fetching primary data for 2025-06.
[2025-10-24T18:28:08.147613] [INFO ] [REMOTE    ] EDN: Fetching primary data for 2025-03.
[2025-10-24T18:28:08.429356] [INFO ] [REMOTE    ] EDF: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T18:28:08.940904] [INFO ] [REMOTE    ] EDD: Incremental fetch complete for 2025-07 (2.39 seconds).
[2025-10-24T18:28:08.947919] [INFO ] [REMOTE    ] ED: Fetching primary data for 2025-10.
[2025-10-24T18:28:09.114471] [INFO ] [REMOTE    ] EDN: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T18:28:09.747703] [INFO ] [REMOTE    ] EDF: Fetching primary data for 2025-07.
[2025-10-24T18:28:10.511877] [INFO ] [REMOTE    ] EDF: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T18:28:10.547601] [INFO ] [REMOTE    ] EDF: Fetching primary data for 2025-08.
[2025-10-24T18:28:10.707062] [INFO ] [REMOTE    ] ED: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T18:28:10.716671] [INFO ] [REMOTE    ] ED: Full fetch complete (76319 records).
[2025-10-24T18:28:10.716818] [DEBUG] [VALIDATOR ] ED: Validating primary data.
[2025-10-24T18:28:11.103632] [DEBUG] [VALIDATOR ] ED: All expected trading days are present.
[2025-10-24T18:28:11.103749] [DEBUG] [VALIDATOR ] ED: Primary data validation passed.
[2025-10-24T18:28:11.104631] [INFO ] [MAIN      ] ED: Fetched primary data is valid.
[2025-10-24T18:28:11.104710] [DEBUG] [LOCAL     ] ED: Saving primary data.
[2025-10-24T18:28:11.105322] [FATAL] [LOCAL     ] ED: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:28:11.105417] [FATAL] [MAIN      ] ED: Failed to save primary data.
[2025-10-24T18:28:11.105460] [WARN ] [MAIN      ] ED: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:28:11.105495] [INFO ] [LOCAL     ] ED: Starting deletion of primary data.
[2025-10-24T18:28:11.105547] [DEBUG] [LOCAL     ] ED: No primary data file found to delete.
[2025-10-24T18:28:11.105582] [INFO ] [LOCAL     ] ED: Starting deletion of derivative data.
[2025-10-24T18:28:11.105620] [DEBUG] [LOCAL     ] ED: No derivative data file found to delete.
[2025-10-24T18:28:11.105749] [INFO ] [MAIN      ] Update Progress: 695/2366 symbols completed. ED took 35.7s. Estimated remaining: 3h 31m 55s. Rate: 7.9 symbols/min
[2025-10-24T18:28:11.277016] [INFO ] [MAIN      ] EDU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:28:11.317633] [DEBUG] [LOCAL     ] EDU: Loaded 45102 existing records from primary storage.
[2025-10-24T18:28:11.317950] [INFO ] [MAIN      ] EDU: Loaded 45102 existing records.
[2025-10-24T18:28:11.352740] [INFO ] [REMOTE    ] EDN: Fetching primary data for 2025-04.
[2025-10-24T18:28:11.436408] [INFO ] [REMOTE    ] EDF: Incremental fetch complete for 2025-08 (0.89 seconds).
[2025-10-24T18:28:11.516560] [WARN ] [MAIN      ] EDU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:28:11.516807] [INFO ] [MAIN      ] EDU: Wiping existing primary data before full refresh.
[2025-10-24T18:28:11.516862] [INFO ] [LOCAL     ] EDU: Starting deletion of primary data.
[2025-10-24T18:28:11.517062] [DEBUG] [LOCAL     ] EDU: Deleted primary data file.
[2025-10-24T18:28:11.517101] [INFO ] [MAIN      ] EDU: Starting full primary refresh.
[2025-10-24T18:28:11.879182] [INFO ] [REMOTE    ] EDU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:28:12.147668] [INFO ] [REMOTE    ] EDF: Fetching primary data for 2025-09.
[2025-10-24T18:28:12.486150] [INFO ] [REMOTE    ] EDN: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T18:28:12.713668] [INFO ] [REMOTE    ] EDF: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T18:28:12.947685] [INFO ] [REMOTE    ] EDD: Fetching primary data for 2025-08.
[2025-10-24T18:28:13.747722] [INFO ] [REMOTE    ] EDF: Fetching primary data for 2025-10.
[2025-10-24T18:28:14.013577] [INFO ] [REMOTE    ] EDD: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T18:28:14.547718] [INFO ] [REMOTE    ] EDU: Fetching primary data for 2025-01.
[2025-10-24T18:28:14.600381] [INFO ] [REMOTE    ] EDF: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T18:28:14.602724] [INFO ] [REMOTE    ] EDF: Full fetch complete (19922 records).
[2025-10-24T18:28:14.602886] [DEBUG] [VALIDATOR ] EDF: Validating primary data.
[2025-10-24T18:28:14.983770] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present.
[2025-10-24T18:28:14.983846] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed.
[2025-10-24T18:28:14.984312] [INFO ] [MAIN      ] EDF: Fetched primary data is valid.
[2025-10-24T18:28:14.984360] [DEBUG] [LOCAL     ] EDF: Saving primary data.
[2025-10-24T18:28:14.984623] [FATAL] [LOCAL     ] EDF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:28:14.984727] [FATAL] [MAIN      ] EDF: Failed to save primary data.
[2025-10-24T18:28:14.984770] [WARN ] [MAIN      ] EDF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:28:14.984805] [INFO ] [LOCAL     ] EDF: Starting deletion of primary data.
[2025-10-24T18:28:14.984855] [DEBUG] [LOCAL     ] EDF: No primary data file found to delete.
[2025-10-24T18:28:14.984892] [INFO ] [LOCAL     ] EDF: Starting deletion of derivative data.
[2025-10-24T18:28:14.985022] [DEBUG] [LOCAL     ] EDF: Deleted derivative data file.
[2025-10-24T18:28:14.985093] [INFO ] [MAIN      ] Update Progress: 696/2366 symbols completed. EDF took 24.5s. Estimated remaining: 3h 31m 38s. Rate: 7.9 symbols/min
[2025-10-24T18:28:15.164240] [INFO ] [MAIN      ] EE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:28:15.197067] [DEBUG] [LOCAL     ] EE: Loaded 32747 existing records from primary storage.
[2025-10-24T18:28:15.197349] [INFO ] [MAIN      ] EE: Loaded 32747 existing records.
[2025-10-24T18:28:15.353145] [INFO ] [REMOTE    ] EDN: Fetching primary data for 2025-05.
[2025-10-24T18:28:15.383536] [WARN ] [MAIN      ] EE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:28:15.383857] [INFO ] [MAIN      ] EE: Wiping existing primary data before full refresh.
[2025-10-24T18:28:15.383942] [INFO ] [LOCAL     ] EE: Starting deletion of primary data.
[2025-10-24T18:28:15.384250] [DEBUG] [LOCAL     ] EE: Deleted primary data file.
[2025-10-24T18:28:15.384346] [INFO ] [MAIN      ] EE: Starting full primary refresh.
[2025-10-24T18:28:15.755845] [INFO ] [REMOTE    ] EE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:28:16.147730] [INFO ] [REMOTE    ] EDD: Fetching primary data for 2025-09.
[2025-10-24T18:28:16.513148] [INFO ] [REMOTE    ] EDU: Incremental fetch complete for 2025-01 (1.97 seconds).
[2025-10-24T18:28:16.583388] [INFO ] [REMOTE    ] EDN: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T18:28:16.947717] [INFO ] [REMOTE    ] EDU: Fetching primary data for 2025-02.
[2025-10-24T18:28:17.089532] [INFO ] [REMOTE    ] EDD: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T18:28:17.747718] [INFO ] [REMOTE    ] EDD: Fetching primary data for 2025-10.
[2025-10-24T18:28:18.547636] [INFO ] [REMOTE    ] EDN: Fetching primary data for 2025-06.
[2025-10-24T18:28:18.652065] [INFO ] [REMOTE    ] EDU: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T18:28:18.771125] [INFO ] [REMOTE    ] EDD: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T18:28:18.776422] [INFO ] [REMOTE    ] EDD: Full fetch complete (38971 records).
[2025-10-24T18:28:18.776552] [DEBUG] [VALIDATOR ] EDD: Validating primary data.
[2025-10-24T18:28:18.777230] [FATAL] [VALIDATOR ] EDD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:28:18.777322] [FATAL] [MAIN      ] EDD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:28:18.777363] [WARN ] [MAIN      ] EDD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:28:18.777401] [INFO ] [LOCAL     ] EDD: Starting deletion of primary data.
[2025-10-24T18:28:18.777455] [DEBUG] [LOCAL     ] EDD: No primary data file found to delete.
[2025-10-24T18:28:18.777530] [INFO ] [LOCAL     ] EDD: Starting deletion of derivative data.
[2025-10-24T18:28:18.777737] [DEBUG] [LOCAL     ] EDD: Deleted derivative data file.
[2025-10-24T18:28:18.777827] [INFO ] [MAIN      ] Update Progress: 697/2366 symbols completed. EDD took 36.7s. Estimated remaining: 3h 31m 21s. Rate: 7.9 symbols/min
[2025-10-24T18:28:18.944588] [INFO ] [MAIN      ] EEA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:28:18.944791] [DEBUG] [LOCAL     ] EEA: No existing data file found in primary storage.
[2025-10-24T18:28:18.944834] [WARN ] [MAIN      ] EEA: No existing data found, performing full refresh instead.
[2025-10-24T18:28:18.944964] [INFO ] [MAIN      ] EEA: Wiping existing primary data before full refresh.
[2025-10-24T18:28:18.945015] [INFO ] [LOCAL     ] EEA: Starting deletion of primary data.
[2025-10-24T18:28:18.945058] [DEBUG] [LOCAL     ] EEA: No primary data file found to delete.
[2025-10-24T18:28:18.945091] [INFO ] [MAIN      ] EEA: Starting full primary refresh.
[2025-10-24T18:28:19.295140] [INFO ] [REMOTE    ] EEA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:28:19.347606] [INFO ] [REMOTE    ] EEA: Fetching primary data for 2025-01.
[2025-10-24T18:28:19.451072] [INFO ] [REMOTE    ] EDN: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T18:28:20.010933] [INFO ] [REMOTE    ] EEA: Incremental fetch complete for 2025-01 (0.66 seconds).
[2025-10-24T18:28:20.147695] [INFO ] [REMOTE    ] EEA: Fetching primary data for 2025-02.
[2025-10-24T18:28:20.587161] [INFO ] [REMOTE    ] EEA: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T18:28:20.947684] [INFO ] [REMOTE    ] EE: Fetching primary data for 2025-01.
[2025-10-24T18:28:21.747733] [INFO ] [REMOTE    ] EDU: Fetching primary data for 2025-03.
[2025-10-24T18:28:22.110795] [INFO ] [REMOTE    ] EE: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T18:28:22.547678] [INFO ] [REMOTE    ] EE: Fetching primary data for 2025-02.
[2025-10-24T18:28:23.347678] [INFO ] [REMOTE    ] EDN: Fetching primary data for 2025-07.
[2025-10-24T18:28:23.421773] [INFO ] [REMOTE    ] EDU: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T18:28:23.707382] [INFO ] [REMOTE    ] EE: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T18:28:24.147638] [INFO ] [REMOTE    ] EEA: Fetching primary data for 2025-03.
[2025-10-24T18:28:24.383594] [INFO ] [REMOTE    ] EDN: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T18:28:24.808234] [INFO ] [REMOTE    ] EEA: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T18:28:24.947696] [INFO ] [REMOTE    ] EE: Fetching primary data for 2025-03.
[2025-10-24T18:28:25.747611] [INFO ] [REMOTE    ] EDN: Fetching primary data for 2025-08.
[2025-10-24T18:28:26.223444] [INFO ] [REMOTE    ] EE: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T18:28:26.547629] [INFO ] [REMOTE    ] EE: Fetching primary data for 2025-04.
[2025-10-24T18:28:26.846341] [INFO ] [REMOTE    ] EDN: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T18:28:27.347691] [INFO ] [REMOTE    ] EEA: Fetching primary data for 2025-04.
[2025-10-24T18:28:27.940096] [INFO ] [REMOTE    ] EE: Incremental fetch complete for 2025-04 (1.39 seconds).
[2025-10-24T18:28:27.958925] [INFO ] [REMOTE    ] EEA: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T18:28:28.147724] [INFO ] [REMOTE    ] EDU: Fetching primary data for 2025-04.
[2025-10-24T18:28:28.947701] [INFO ] [REMOTE    ] EDN: Fetching primary data for 2025-09.
[2025-10-24T18:28:29.638102] [INFO ] [REMOTE    ] EDU: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T18:28:29.747625] [INFO ] [REMOTE    ] EDU: Fetching primary data for 2025-05.
[2025-10-24T18:28:30.182152] [INFO ] [REMOTE    ] EDN: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T18:28:30.547674] [INFO ] [REMOTE    ] EDN: Fetching primary data for 2025-10.
[2025-10-24T18:28:31.023152] [INFO ] [REMOTE    ] EDU: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T18:28:31.347670] [INFO ] [REMOTE    ] EDU: Fetching primary data for 2025-06.
[2025-10-24T18:28:31.966321] [INFO ] [REMOTE    ] EDN: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T18:28:31.971185] [INFO ] [REMOTE    ] EDN: Full fetch complete (29475 records).
[2025-10-24T18:28:31.971274] [DEBUG] [VALIDATOR ] EDN: Validating primary data.
[2025-10-24T18:28:31.971930] [FATAL] [VALIDATOR ] EDN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:28:31.972011] [FATAL] [MAIN      ] EDN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:28:31.972054] [WARN ] [MAIN      ] EDN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:28:31.972121] [INFO ] [LOCAL     ] EDN: Starting deletion of primary data.
[2025-10-24T18:28:31.972183] [DEBUG] [LOCAL     ] EDN: No primary data file found to delete.
[2025-10-24T18:28:31.972219] [INFO ] [LOCAL     ] EDN: Starting deletion of derivative data.
[2025-10-24T18:28:31.972343] [DEBUG] [LOCAL     ] EDN: Deleted derivative data file.
[2025-10-24T18:28:31.972408] [INFO ] [MAIN      ] Update Progress: 698/2366 symbols completed. EDN took 33.9s. Estimated remaining: 3h 31m 27s. Rate: 7.9 symbols/min
[2025-10-24T18:28:32.139633] [INFO ] [MAIN      ] EEX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:28:32.147684] [INFO ] [REMOTE    ] EEA: Fetching primary data for 2025-05.
[2025-10-24T18:28:32.153293] [DEBUG] [LOCAL     ] EEX: Loaded 9883 existing records from primary storage.
[2025-10-24T18:28:32.153528] [INFO ] [MAIN      ] EEX: Loaded 9883 existing records.
[2025-10-24T18:28:32.331465] [WARN ] [MAIN      ] EEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:28:32.331731] [INFO ] [MAIN      ] EEX: Wiping existing primary data before full refresh.
[2025-10-24T18:28:32.331786] [INFO ] [LOCAL     ] EEX: Starting deletion of primary data.
[2025-10-24T18:28:32.331934] [DEBUG] [LOCAL     ] EEX: Deleted primary data file.
[2025-10-24T18:28:32.331989] [INFO ] [MAIN      ] EEX: Starting full primary refresh.
[2025-10-24T18:28:32.680970] [INFO ] [REMOTE    ] EEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:28:32.820897] [INFO ] [REMOTE    ] EEA: Incremental fetch complete for 2025-05 (0.67 seconds).
[2025-10-24T18:28:32.947622] [INFO ] [REMOTE    ] EEX: Fetching primary data for 2025-01.
[2025-10-24T18:28:33.018080] [INFO ] [REMOTE    ] EDU: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T18:28:33.747734] [INFO ] [REMOTE    ] EEA: Fetching primary data for 2025-06.
[2025-10-24T18:28:34.053170] [INFO ] [REMOTE    ] EEX: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T18:28:34.247436] [INFO ] [REMOTE    ] EEA: Incremental fetch complete for 2025-06 (0.50 seconds).
[2025-10-24T18:28:34.547735] [INFO ] [REMOTE    ] EEX: Fetching primary data for 2025-02.
[2025-10-24T18:28:35.347685] [INFO ] [REMOTE    ] EE: Fetching primary data for 2025-05.
[2025-10-24T18:28:35.663166] [INFO ] [REMOTE    ] EEX: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T18:28:36.147696] [INFO ] [REMOTE    ] EEA: Fetching primary data for 2025-07.
[2025-10-24T18:28:36.782725] [INFO ] [REMOTE    ] EEA: Incremental fetch complete for 2025-07 (0.64 seconds).
[2025-10-24T18:28:36.846457] [INFO ] [REMOTE    ] EE: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T18:28:36.947636] [INFO ] [REMOTE    ] EEX: Fetching primary data for 2025-03.
[2025-10-24T18:28:37.747675] [INFO ] [REMOTE    ] EEA: Fetching primary data for 2025-08.
[2025-10-24T18:28:37.999401] [INFO ] [REMOTE    ] EEX: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T18:28:38.077993] [INFO ] [REMOTE    ] EEA: Incremental fetch complete for 2025-08 (0.33 seconds).
[2025-10-24T18:28:38.547615] [INFO ] [REMOTE    ] EEA: Fetching primary data for 2025-09.
[2025-10-24T18:28:38.987958] [INFO ] [REMOTE    ] EEA: Incremental fetch complete for 2025-09 (0.44 seconds).
[2025-10-24T18:28:39.347636] [INFO ] [REMOTE    ] EEX: Fetching primary data for 2025-04.
[2025-10-24T18:28:40.147712] [INFO ] [REMOTE    ] EEA: Fetching primary data for 2025-10.
[2025-10-24T18:28:40.361827] [INFO ] [REMOTE    ] EEX: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T18:28:40.517351] [INFO ] [REMOTE    ] EEA: Incremental fetch complete for 2025-10 (0.37 seconds).
[2025-10-24T18:28:40.518180] [INFO ] [REMOTE    ] EEA: Full fetch complete (3692 records).
[2025-10-24T18:28:40.518248] [DEBUG] [VALIDATOR ] EEA: Validating primary data.
[2025-10-24T18:28:40.701773] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T18:28:40.703102] [FATAL] [MAIN      ] EEA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:28:40.703189] [WARN ] [MAIN      ] EEA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:28:40.703281] [INFO ] [LOCAL     ] EEA: Starting deletion of primary data.
[2025-10-24T18:28:40.703374] [DEBUG] [LOCAL     ] EEA: No primary data file found to delete.
[2025-10-24T18:28:40.703429] [INFO ] [LOCAL     ] EEA: Starting deletion of derivative data.
[2025-10-24T18:28:40.703475] [DEBUG] [LOCAL     ] EEA: No derivative data file found to delete.
[2025-10-24T18:28:40.703542] [INFO ] [MAIN      ] Update Progress: 699/2366 symbols completed. EEA took 21.9s. Estimated remaining: 3h 31m 22s. Rate: 7.9 symbols/min
[2025-10-24T18:28:40.874959] [INFO ] [MAIN      ] EFC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:28:40.919808] [DEBUG] [LOCAL     ] EFC: Loaded 46626 existing records from primary storage.
[2025-10-24T18:28:40.920121] [INFO ] [MAIN      ] EFC: Loaded 46626 existing records.
[2025-10-24T18:28:40.952810] [INFO ] [REMOTE    ] EE: Fetching primary data for 2025-06.
[2025-10-24T18:28:41.103676] [WARN ] [MAIN      ] EFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:28:41.103861] [INFO ] [MAIN      ] EFC: Wiping existing primary data before full refresh.
[2025-10-24T18:28:41.103914] [INFO ] [LOCAL     ] EFC: Starting deletion of primary data.
[2025-10-24T18:28:41.104440] [DEBUG] [LOCAL     ] EFC: Deleted primary data file.
[2025-10-24T18:28:41.104497] [INFO ] [MAIN      ] EFC: Starting full primary refresh.
[2025-10-24T18:28:41.453231] [INFO ] [REMOTE    ] EFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:28:41.747629] [INFO ] [REMOTE    ] EFC: Fetching primary data for 2025-01.
[2025-10-24T18:28:42.350997] [INFO ] [REMOTE    ] EE: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T18:28:42.547700] [INFO ] [REMOTE    ] EDU: Fetching primary data for 2025-07.
[2025-10-24T18:28:43.347677] [INFO ] [REMOTE    ] EEX: Fetching primary data for 2025-05.
[2025-10-24T18:28:43.557548] [INFO ] [REMOTE    ] EFC: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T18:28:44.147634] [INFO ] [REMOTE    ] EE: Fetching primary data for 2025-07.
[2025-10-24T18:28:44.333534] [INFO ] [REMOTE    ] EEX: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T18:28:44.366847] [INFO ] [REMOTE    ] EDU: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T18:28:44.947667] [INFO ] [REMOTE    ] EDU: Fetching primary data for 2025-08.
[2025-10-24T18:28:45.398411] [INFO ] [REMOTE    ] EE: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T18:28:45.747686] [INFO ] [REMOTE    ] EFC: Fetching primary data for 2025-02.
[2025-10-24T18:28:46.547638] [INFO ] [REMOTE    ] EEX: Fetching primary data for 2025-06.
[2025-10-24T18:28:46.617143] [INFO ] [REMOTE    ] EDU: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T18:28:47.347698] [INFO ] [REMOTE    ] EDU: Fetching primary data for 2025-09.
[2025-10-24T18:28:47.417687] [INFO ] [REMOTE    ] EEX: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T18:28:47.435235] [INFO ] [REMOTE    ] EFC: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T18:28:48.147677] [INFO ] [REMOTE    ] EFC: Fetching primary data for 2025-03.
[2025-10-24T18:28:48.840813] [INFO ] [REMOTE    ] EDU: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T18:28:48.947711] [INFO ] [REMOTE    ] EDU: Fetching primary data for 2025-10.
[2025-10-24T18:28:49.747724] [INFO ] [REMOTE    ] EEX: Fetching primary data for 2025-07.
[2025-10-24T18:28:49.833524] [INFO ] [REMOTE    ] EFC: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T18:28:50.488532] [INFO ] [REMOTE    ] EEX: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T18:28:50.547678] [INFO ] [REMOTE    ] EEX: Fetching primary data for 2025-08.
[2025-10-24T18:28:50.758257] [INFO ] [REMOTE    ] EDU: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T18:28:50.771570] [INFO ] [REMOTE    ] EDU: Full fetch complete (67142 records).
[2025-10-24T18:28:50.771802] [DEBUG] [VALIDATOR ] EDU: Validating primary data.
[2025-10-24T18:28:51.181382] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present.
[2025-10-24T18:28:51.181457] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed.
[2025-10-24T18:28:51.182279] [INFO ] [MAIN      ] EDU: Fetched primary data is valid.
[2025-10-24T18:28:51.182344] [DEBUG] [LOCAL     ] EDU: Saving primary data.
[2025-10-24T18:28:51.182875] [FATAL] [LOCAL     ] EDU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:28:51.182999] [FATAL] [MAIN      ] EDU: Failed to save primary data.
[2025-10-24T18:28:51.183053] [WARN ] [MAIN      ] EDU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:28:51.183116] [INFO ] [LOCAL     ] EDU: Starting deletion of primary data.
[2025-10-24T18:28:51.183176] [DEBUG] [LOCAL     ] EDU: No primary data file found to delete.
[2025-10-24T18:28:51.183216] [INFO ] [LOCAL     ] EDU: Starting deletion of derivative data.
[2025-10-24T18:28:51.183348] [DEBUG] [LOCAL     ] EDU: Deleted derivative data file.
[2025-10-24T18:28:51.183906] [INFO ] [MAIN      ] Update Progress: 700/2366 symbols completed. EDU took 40.1s. Estimated remaining: 3h 31m 21s. Rate: 7.9 symbols/min
[2025-10-24T18:28:51.296735] [INFO ] [REMOTE    ] EEX: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T18:28:51.351329] [INFO ] [REMOTE    ] EFC: Fetching primary data for 2025-04.
[2025-10-24T18:28:51.371062] [INFO ] [MAIN      ] EFR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:28:51.388285] [DEBUG] [LOCAL     ] EFR: Loaded 15160 existing records from primary storage.
[2025-10-24T18:28:51.388509] [INFO ] [MAIN      ] EFR: Loaded 15160 existing records.
[2025-10-24T18:28:51.562246] [WARN ] [MAIN      ] EFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:28:51.562463] [INFO ] [MAIN      ] EFR: Wiping existing primary data before full refresh.
[2025-10-24T18:28:51.562519] [INFO ] [LOCAL     ] EFR: Starting deletion of primary data.
[2025-10-24T18:28:51.562715] [DEBUG] [LOCAL     ] EFR: Deleted primary data file.
[2025-10-24T18:28:51.562771] [INFO ] [MAIN      ] EFR: Starting full primary refresh.
[2025-10-24T18:28:51.919091] [INFO ] [REMOTE    ] EFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:28:52.147622] [INFO ] [REMOTE    ] EE: Fetching primary data for 2025-08.
[2025-10-24T18:28:52.947686] [INFO ] [REMOTE    ] EFR: Fetching primary data for 2025-01.
[2025-10-24T18:28:53.259162] [INFO ] [REMOTE    ] EFC: Incremental fetch complete for 2025-04 (1.91 seconds).
[2025-10-24T18:28:53.734330] [INFO ] [REMOTE    ] EE: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T18:28:53.747592] [INFO ] [REMOTE    ] EE: Fetching primary data for 2025-09.
[2025-10-24T18:28:54.017774] [INFO ] [REMOTE    ] EFR: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T18:28:54.547621] [INFO ] [REMOTE    ] EFR: Fetching primary data for 2025-02.
[2025-10-24T18:28:55.059973] [INFO ] [REMOTE    ] EE: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T18:28:55.280622] [INFO ] [REMOTE    ] EFR: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T18:28:55.347623] [INFO ] [REMOTE    ] EEX: Fetching primary data for 2025-09.
[2025-10-24T18:28:56.148029] [INFO ] [REMOTE    ] EEX: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T18:28:56.147770] [INFO ] [REMOTE    ] EE: Fetching primary data for 2025-10.
[2025-10-24T18:28:56.947673] [INFO ] [REMOTE    ] EEX: Fetching primary data for 2025-10.
[2025-10-24T18:28:57.636603] [INFO ] [REMOTE    ] EE: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T18:28:57.642905] [INFO ] [REMOTE    ] EE: Full fetch complete (44571 records).
[2025-10-24T18:28:57.642996] [DEBUG] [VALIDATOR ] EE: Validating primary data.
[2025-10-24T18:28:57.752713] [INFO ] [REMOTE    ] EFC: Fetching primary data for 2025-05.
[2025-10-24T18:28:57.843792] [INFO ] [REMOTE    ] EEX: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T18:28:57.895261] [INFO ] [REMOTE    ] EEX: Full fetch complete (18226 records).
[2025-10-24T18:28:57.918698] [DEBUG] [VALIDATOR ] EEX: Validating primary data.
[2025-10-24T18:28:58.220399] [DEBUG] [VALIDATOR ] EE: All expected trading days are present.
[2025-10-24T18:28:58.270359] [DEBUG] [VALIDATOR ] EE: Primary data validation passed.
[2025-10-24T18:28:58.297262] [INFO ] [MAIN      ] EE: Fetched primary data is valid.
[2025-10-24T18:28:58.319086] [DEBUG] [LOCAL     ] EE: Saving primary data.
[2025-10-24T18:28:58.329829] [FATAL] [LOCAL     ] EE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:28:58.329942] [FATAL] [MAIN      ] EE: Failed to save primary data.
[2025-10-24T18:28:58.329986] [WARN ] [MAIN      ] EE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:28:58.330302] [INFO ] [LOCAL     ] EE: Starting deletion of primary data.
[2025-10-24T18:28:58.345982] [DEBUG] [LOCAL     ] EE: No primary data file found to delete.
[2025-10-24T18:28:58.356251] [INFO ] [LOCAL     ] EE: Starting deletion of derivative data.
[2025-10-24T18:28:58.378306] [DEBUG] [LOCAL     ] EE: Deleted derivative data file.
[2025-10-24T18:28:58.402593] [INFO ] [MAIN      ] Update Progress: 701/2366 symbols completed. EE took 43.4s. Estimated remaining: 3h 31m 13s. Rate: 7.9 symbols/min
[2025-10-24T18:28:58.444181] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present.
[2025-10-24T18:28:58.444271] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed.
[2025-10-24T18:28:58.469119] [INFO ] [MAIN      ] EEX: Fetched primary data is valid.
[2025-10-24T18:28:58.478039] [DEBUG] [LOCAL     ] EEX: Saving primary data.
[2025-10-24T18:28:58.495854] [FATAL] [LOCAL     ] EEX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:28:58.508234] [FATAL] [MAIN      ] EEX: Failed to save primary data.
[2025-10-24T18:28:58.517068] [WARN ] [MAIN      ] EEX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:28:58.520043] [INFO ] [LOCAL     ] EEX: Starting deletion of primary data.
[2025-10-24T18:28:58.520115] [DEBUG] [LOCAL     ] EEX: No primary data file found to delete.
[2025-10-24T18:28:58.525721] [INFO ] [LOCAL     ] EEX: Starting deletion of derivative data.
[2025-10-24T18:28:58.541217] [DEBUG] [LOCAL     ] EEX: Deleted derivative data file.
[2025-10-24T18:28:58.546425] [INFO ] [MAIN      ] Update Progress: 702/2366 symbols completed. EEX took 26.6s. Estimated remaining: 3h 30m 47s. Rate: 7.9 symbols/min
[2025-10-24T18:28:58.567685] [INFO ] [REMOTE    ] EFR: Fetching primary data for 2025-03.
[2025-10-24T18:28:58.594659] [INFO ] [MAIN      ] EFT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:28:58.758862] [DEBUG] [LOCAL     ] EFT: Loaded 12971 existing records from primary storage.
[2025-10-24T18:28:58.777907] [INFO ] [MAIN      ] EFX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:28:58.778364] [INFO ] [MAIN      ] EFT: Loaded 12971 existing records.
[2025-10-24T18:28:58.979612] [WARN ] [MAIN      ] EFT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:28:58.979882] [INFO ] [MAIN      ] EFT: Wiping existing primary data before full refresh.
[2025-10-24T18:28:58.979956] [INFO ] [LOCAL     ] EFT: Starting deletion of primary data.
[2025-10-24T18:28:58.980155] [DEBUG] [LOCAL     ] EFT: Deleted primary data file.
[2025-10-24T18:28:58.980214] [INFO ] [MAIN      ] EFT: Starting full primary refresh.
[2025-10-24T18:28:59.100936] [DEBUG] [LOCAL     ] EFX: Loaded 45066 existing records from primary storage.
[2025-10-24T18:28:59.111898] [INFO ] [MAIN      ] EFX: Loaded 45066 existing records.
[2025-10-24T18:28:59.475586] [WARN ] [MAIN      ] EFX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:28:59.481761] [INFO ] [MAIN      ] EFX: Wiping existing primary data before full refresh.
[2025-10-24T18:28:59.486979] [INFO ] [LOCAL     ] EFX: Starting deletion of primary data.
[2025-10-24T18:28:59.521372] [DEBUG] [LOCAL     ] EFX: Deleted primary data file.
[2025-10-24T18:28:59.541687] [INFO ] [MAIN      ] EFX: Starting full primary refresh.
[2025-10-24T18:28:59.562252] [INFO ] [REMOTE    ] EFR: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T18:28:59.561668] [INFO ] [REMOTE    ] EFT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:28:59.570497] [INFO ] [REMOTE    ] EFR: Fetching primary data for 2025-04.
[2025-10-24T18:28:59.962823] [INFO ] [REMOTE    ] EFC: Incremental fetch complete for 2025-05 (2.21 seconds).
[2025-10-24T18:28:59.995442] [INFO ] [REMOTE    ] EFX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:29:00.147632] [INFO ] [REMOTE    ] EFX: Fetching primary data for 2025-01.
[2025-10-24T18:29:00.947705] [INFO ] [REMOTE    ] EFC: Fetching primary data for 2025-06.
[2025-10-24T18:29:01.095071] [INFO ] [REMOTE    ] EFR: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T18:29:01.747696] [INFO ] [REMOTE    ] EFR: Fetching primary data for 2025-05.
[2025-10-24T18:29:02.547617] [INFO ] [REMOTE    ] EFT: Fetching primary data for 2025-01.
[2025-10-24T18:29:02.649116] [INFO ] [REMOTE    ] EFX: Incremental fetch complete for 2025-01 (2.50 seconds).
[2025-10-24T18:29:03.020427] [INFO ] [REMOTE    ] EFR: Incremental fetch complete for 2025-05 (1.27 seconds).
[2025-10-24T18:29:03.347695] [INFO ] [REMOTE    ] EFX: Fetching primary data for 2025-02.
[2025-10-24T18:29:03.379210] [INFO ] [REMOTE    ] EFT: Incremental fetch complete for 2025-01 (0.83 seconds).
[2025-10-24T18:29:03.556394] [INFO ] [REMOTE    ] EFC: Incremental fetch complete for 2025-06 (2.61 seconds).
[2025-10-24T18:29:04.147670] [INFO ] [REMOTE    ] EFT: Fetching primary data for 2025-02.
[2025-10-24T18:29:04.947723] [INFO ] [REMOTE    ] EFC: Fetching primary data for 2025-07.
[2025-10-24T18:29:04.984229] [INFO ] [REMOTE    ] EFT: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T18:29:05.747636] [INFO ] [REMOTE    ] EFT: Fetching primary data for 2025-03.
[2025-10-24T18:29:05.783483] [INFO ] [REMOTE    ] EFX: Incremental fetch complete for 2025-02 (2.44 seconds).
[2025-10-24T18:29:06.495076] [INFO ] [REMOTE    ] EFT: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T18:29:06.547601] [INFO ] [REMOTE    ] EFT: Fetching primary data for 2025-04.
[2025-10-24T18:29:06.763477] [INFO ] [REMOTE    ] EFC: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T18:29:07.278317] [INFO ] [REMOTE    ] EFT: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T18:29:07.347672] [INFO ] [REMOTE    ] EFT: Fetching primary data for 2025-05.
[2025-10-24T18:29:08.147684] [INFO ] [REMOTE    ] EFC: Fetching primary data for 2025-08.
[2025-10-24T18:29:08.277466] [INFO ] [REMOTE    ] EFT: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T18:29:08.947779] [INFO ] [REMOTE    ] EFR: Fetching primary data for 2025-06.
[2025-10-24T18:29:09.747632] [INFO ] [REMOTE    ] EFX: Fetching primary data for 2025-03.
[2025-10-24T18:29:10.050480] [INFO ] [REMOTE    ] EFR: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T18:29:10.148343] [INFO ] [REMOTE    ] EFC: Incremental fetch complete for 2025-08 (2.00 seconds).
[2025-10-24T18:29:10.547682] [INFO ] [REMOTE    ] EFR: Fetching primary data for 2025-07.
[2025-10-24T18:29:11.090582] [INFO ] [REMOTE    ] EFX: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T18:29:11.347634] [INFO ] [REMOTE    ] EFX: Fetching primary data for 2025-04.
[2025-10-24T18:29:11.474372] [INFO ] [REMOTE    ] EFR: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T18:29:12.147699] [INFO ] [REMOTE    ] EFR: Fetching primary data for 2025-08.
[2025-10-24T18:29:12.947695] [INFO ] [REMOTE    ] EFC: Fetching primary data for 2025-09.
[2025-10-24T18:29:13.166944] [INFO ] [REMOTE    ] EFR: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T18:29:13.275680] [INFO ] [REMOTE    ] EFX: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T18:29:13.747679] [INFO ] [REMOTE    ] EFR: Fetching primary data for 2025-09.
[2025-10-24T18:29:14.547679] [INFO ] [REMOTE    ] EFX: Fetching primary data for 2025-05.
[2025-10-24T18:29:14.723018] [INFO ] [REMOTE    ] EFR: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T18:29:14.759092] [INFO ] [REMOTE    ] EFC: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T18:29:15.347718] [INFO ] [REMOTE    ] EFR: Fetching primary data for 2025-10.
[2025-10-24T18:29:16.138907] [INFO ] [REMOTE    ] EFX: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T18:29:16.147817] [INFO ] [REMOTE    ] EFT: Fetching primary data for 2025-06.
[2025-10-24T18:29:16.483721] [INFO ] [REMOTE    ] EFR: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T18:29:16.487302] [INFO ] [REMOTE    ] EFR: Full fetch complete (19762 records).
[2025-10-24T18:29:16.487408] [DEBUG] [VALIDATOR ] EFR: Validating primary data.
[2025-10-24T18:29:16.889998] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present.
[2025-10-24T18:29:16.890077] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed.
[2025-10-24T18:29:16.890498] [INFO ] [MAIN      ] EFR: Fetched primary data is valid.
[2025-10-24T18:29:16.890537] [DEBUG] [LOCAL     ] EFR: Saving primary data.
[2025-10-24T18:29:16.890861] [FATAL] [LOCAL     ] EFR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:29:16.890942] [FATAL] [MAIN      ] EFR: Failed to save primary data.
[2025-10-24T18:29:16.890983] [WARN ] [MAIN      ] EFR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:29:16.891024] [INFO ] [LOCAL     ] EFR: Starting deletion of primary data.
[2025-10-24T18:29:16.891075] [DEBUG] [LOCAL     ] EFR: No primary data file found to delete.
[2025-10-24T18:29:16.891109] [INFO ] [LOCAL     ] EFR: Starting deletion of derivative data.
[2025-10-24T18:29:16.891243] [DEBUG] [LOCAL     ] EFR: Deleted derivative data file.
[2025-10-24T18:29:16.891313] [INFO ] [MAIN      ] Update Progress: 703/2366 symbols completed. EFR took 25.7s. Estimated remaining: 3h 31m 5s. Rate: 7.9 symbols/min
[2025-10-24T18:29:16.953507] [INFO ] [REMOTE    ] EFC: Fetching primary data for 2025-10.
[2025-10-24T18:29:17.070484] [INFO ] [MAIN      ] EFXT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:29:17.101364] [DEBUG] [LOCAL     ] EFXT: Loaded 29741 existing records from primary storage.
[2025-10-24T18:29:17.101702] [INFO ] [MAIN      ] EFXT: Loaded 29741 existing records.
[2025-10-24T18:29:17.279118] [WARN ] [MAIN      ] EFXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:29:17.279420] [INFO ] [MAIN      ] EFXT: Wiping existing primary data before full refresh.
[2025-10-24T18:29:17.279473] [INFO ] [LOCAL     ] EFXT: Starting deletion of primary data.
[2025-10-24T18:29:17.279838] [DEBUG] [LOCAL     ] EFXT: Deleted primary data file.
[2025-10-24T18:29:17.279895] [INFO ] [MAIN      ] EFXT: Starting full primary refresh.
[2025-10-24T18:29:17.441832] [INFO ] [REMOTE    ] EFT: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T18:29:17.654029] [INFO ] [REMOTE    ] EFXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:29:17.747622] [INFO ] [REMOTE    ] EFX: Fetching primary data for 2025-06.
[2025-10-24T18:29:18.547617] [INFO ] [REMOTE    ] EFXT: Fetching primary data for 2025-01.
[2025-10-24T18:29:18.950473] [INFO ] [REMOTE    ] EFC: Incremental fetch complete for 2025-10 (2.00 seconds).
[2025-10-24T18:29:18.959184] [INFO ] [REMOTE    ] EFC: Full fetch complete (66728 records).
[2025-10-24T18:29:18.959343] [DEBUG] [VALIDATOR ] EFC: Validating primary data.
[2025-10-24T18:29:19.355591] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present.
[2025-10-24T18:29:19.355861] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed.
[2025-10-24T18:29:19.352113] [INFO ] [REMOTE    ] EFT: Fetching primary data for 2025-07.
[2025-10-24T18:29:19.356958] [INFO ] [MAIN      ] EFC: Fetched primary data is valid.
[2025-10-24T18:29:19.357938] [DEBUG] [LOCAL     ] EFC: Saving primary data.
[2025-10-24T18:29:19.358597] [FATAL] [LOCAL     ] EFC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:29:19.358847] [FATAL] [MAIN      ] EFC: Failed to save primary data.
[2025-10-24T18:29:19.359072] [WARN ] [MAIN      ] EFC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:29:19.359168] [INFO ] [LOCAL     ] EFC: Starting deletion of primary data.
[2025-10-24T18:29:19.359349] [DEBUG] [LOCAL     ] EFC: No primary data file found to delete.
[2025-10-24T18:29:19.359512] [INFO ] [LOCAL     ] EFC: Starting deletion of derivative data.
[2025-10-24T18:29:19.359733] [DEBUG] [LOCAL     ] EFC: Deleted derivative data file.
[2025-10-24T18:29:19.360062] [INFO ] [MAIN      ] Update Progress: 704/2366 symbols completed. EFC took 38.7s. Estimated remaining: 3h 30m 46s. Rate: 7.9 symbols/min
[2025-10-24T18:29:19.538797] [INFO ] [MAIN      ] EG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:29:19.565380] [INFO ] [REMOTE    ] EFX: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T18:29:19.597026] [DEBUG] [LOCAL     ] EG: Loaded 27639 existing records from primary storage.
[2025-10-24T18:29:19.597317] [INFO ] [MAIN      ] EG: Loaded 27639 existing records.
[2025-10-24T18:29:19.780801] [WARN ] [MAIN      ] EG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:29:19.781104] [INFO ] [MAIN      ] EG: Wiping existing primary data before full refresh.
[2025-10-24T18:29:19.781258] [INFO ] [LOCAL     ] EG: Starting deletion of primary data.
[2025-10-24T18:29:19.781479] [DEBUG] [LOCAL     ] EG: Deleted primary data file.
[2025-10-24T18:29:19.781534] [INFO ] [MAIN      ] EG: Starting full primary refresh.
[2025-10-24T18:29:20.181694] [INFO ] [REMOTE    ] EG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:29:20.147633] [INFO ] [REMOTE    ] EFX: Fetching primary data for 2025-07.
[2025-10-24T18:29:20.183589] [INFO ] [REMOTE    ] EFXT: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T18:29:20.247292] [INFO ] [REMOTE    ] EFT: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T18:29:20.947681] [INFO ] [REMOTE    ] EG: Fetching primary data for 2025-01.
[2025-10-24T18:29:21.747728] [INFO ] [REMOTE    ] EFXT: Fetching primary data for 2025-02.
[2025-10-24T18:29:21.912951] [INFO ] [REMOTE    ] EFX: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T18:29:22.546506] [INFO ] [REMOTE    ] EG: Incremental fetch complete for 2025-01 (1.60 seconds).
[2025-10-24T18:29:22.549449] [INFO ] [REMOTE    ] EFT: Fetching primary data for 2025-08.
[2025-10-24T18:29:22.939776] [INFO ] [REMOTE    ] EFXT: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T18:29:23.082284] [INFO ] [REMOTE    ] EFT: Incremental fetch complete for 2025-08 (0.53 seconds).
[2025-10-24T18:29:23.347727] [INFO ] [REMOTE    ] EFT: Fetching primary data for 2025-09.
[2025-10-24T18:29:24.147734] [INFO ] [REMOTE    ] EFX: Fetching primary data for 2025-08.
[2025-10-24T18:29:24.182171] [INFO ] [REMOTE    ] EFT: Incremental fetch complete for 2025-09 (0.83 seconds).
[2025-10-24T18:29:24.947723] [INFO ] [REMOTE    ] EFXT: Fetching primary data for 2025-03.
[2025-10-24T18:29:25.747712] [INFO ] [REMOTE    ] EG: Fetching primary data for 2025-02.
[2025-10-24T18:29:25.879782] [INFO ] [REMOTE    ] EFX: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T18:29:26.246946] [INFO ] [REMOTE    ] EFXT: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T18:29:26.547754] [INFO ] [REMOTE    ] EFX: Fetching primary data for 2025-09.
[2025-10-24T18:29:27.051773] [INFO ] [REMOTE    ] EG: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T18:29:27.347682] [INFO ] [REMOTE    ] EFXT: Fetching primary data for 2025-04.
[2025-10-24T18:29:27.833011] [INFO ] [REMOTE    ] EFX: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T18:29:28.147723] [INFO ] [REMOTE    ] EFX: Fetching primary data for 2025-10.
[2025-10-24T18:29:28.393860] [INFO ] [REMOTE    ] EFXT: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T18:29:28.947713] [INFO ] [REMOTE    ] EG: Fetching primary data for 2025-03.
[2025-10-24T18:29:29.747627] [INFO ] [REMOTE    ] EFXT: Fetching primary data for 2025-05.
[2025-10-24T18:29:30.048225] [INFO ] [REMOTE    ] EFX: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T18:29:30.056962] [INFO ] [REMOTE    ] EFX: Full fetch complete (65091 records).
[2025-10-24T18:29:30.057098] [DEBUG] [VALIDATOR ] EFX: Validating primary data.
[2025-10-24T18:29:30.458514] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present.
[2025-10-24T18:29:30.458723] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed.
[2025-10-24T18:29:30.459609] [INFO ] [MAIN      ] EFX: Fetched primary data is valid.
[2025-10-24T18:29:30.459760] [DEBUG] [LOCAL     ] EFX: Saving primary data.
[2025-10-24T18:29:30.466528] [FATAL] [LOCAL     ] EFX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:29:30.477493] [FATAL] [MAIN      ] EFX: Failed to save primary data.
[2025-10-24T18:29:30.478595] [INFO ] [REMOTE    ] EG: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T18:29:30.478052] [WARN ] [MAIN      ] EFX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:29:30.485553] [INFO ] [LOCAL     ] EFX: Starting deletion of primary data.
[2025-10-24T18:29:30.485912] [DEBUG] [LOCAL     ] EFX: No primary data file found to delete.
[2025-10-24T18:29:30.485959] [INFO ] [LOCAL     ] EFX: Starting deletion of derivative data.
[2025-10-24T18:29:30.486096] [DEBUG] [LOCAL     ] EFX: Deleted derivative data file.
[2025-10-24T18:29:30.486480] [INFO ] [MAIN      ] Update Progress: 705/2366 symbols completed. EFX took 31.9s. Estimated remaining: 3h 30m 46s. Rate: 7.9 symbols/min
[2025-10-24T18:29:30.552866] [INFO ] [REMOTE    ] EFT: Fetching primary data for 2025-10.
[2025-10-24T18:29:30.656353] [INFO ] [MAIN      ] EGO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:29:30.707272] [DEBUG] [LOCAL     ] EGO: Loaded 52112 existing records from primary storage.
[2025-10-24T18:29:30.707565] [INFO ] [MAIN      ] EGO: Loaded 52112 existing records.
[2025-10-24T18:29:30.883287] [WARN ] [MAIN      ] EGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:29:30.883474] [INFO ] [MAIN      ] EGO: Wiping existing primary data before full refresh.
[2025-10-24T18:29:30.883520] [INFO ] [LOCAL     ] EGO: Starting deletion of primary data.
[2025-10-24T18:29:30.884038] [DEBUG] [LOCAL     ] EGO: Deleted primary data file.
[2025-10-24T18:29:30.884094] [INFO ] [MAIN      ] EGO: Starting full primary refresh.
[2025-10-24T18:29:31.182838] [INFO ] [REMOTE    ] EFXT: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T18:29:31.263918] [INFO ] [REMOTE    ] EGO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:29:31.347601] [INFO ] [REMOTE    ] EFXT: Fetching primary data for 2025-06.
[2025-10-24T18:29:31.741559] [INFO ] [REMOTE    ] EFT: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T18:29:31.744623] [INFO ] [REMOTE    ] EFT: Full fetch complete (17718 records).
[2025-10-24T18:29:31.744731] [DEBUG] [VALIDATOR ] EFT: Validating primary data.
[2025-10-24T18:29:32.102816] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present.
[2025-10-24T18:29:32.102895] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed.
[2025-10-24T18:29:32.103235] [INFO ] [MAIN      ] EFT: Fetched primary data is valid.
[2025-10-24T18:29:32.103275] [DEBUG] [LOCAL     ] EFT: Saving primary data.
[2025-10-24T18:29:32.103526] [FATAL] [LOCAL     ] EFT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:29:32.103608] [FATAL] [MAIN      ] EFT: Failed to save primary data.
[2025-10-24T18:29:32.103677] [WARN ] [MAIN      ] EFT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:29:32.103745] [INFO ] [LOCAL     ] EFT: Starting deletion of primary data.
[2025-10-24T18:29:32.103802] [DEBUG] [LOCAL     ] EFT: No primary data file found to delete.
[2025-10-24T18:29:32.103837] [INFO ] [LOCAL     ] EFT: Starting deletion of derivative data.
[2025-10-24T18:29:32.103990] [DEBUG] [LOCAL     ] EFT: Deleted derivative data file.
[2025-10-24T18:29:32.104081] [INFO ] [MAIN      ] Update Progress: 706/2366 symbols completed. EFT took 33.7s. Estimated remaining: 3h 30m 24s. Rate: 7.9 symbols/min
[2025-10-24T18:29:32.166436] [INFO ] [REMOTE    ] EGO: Fetching primary data for 2025-01.
[2025-10-24T18:29:32.303176] [INFO ] [MAIN      ] EGP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:29:32.318902] [INFO ] [REMOTE    ] EFXT: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T18:29:32.358511] [DEBUG] [LOCAL     ] EGP: Loaded 30434 existing records from primary storage.
[2025-10-24T18:29:32.358788] [INFO ] [MAIN      ] EGP: Loaded 30434 existing records.
[2025-10-24T18:29:32.537559] [WARN ] [MAIN      ] EGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:29:32.537835] [INFO ] [MAIN      ] EGP: Wiping existing primary data before full refresh.
[2025-10-24T18:29:32.537890] [INFO ] [LOCAL     ] EGP: Starting deletion of primary data.
[2025-10-24T18:29:32.538102] [DEBUG] [LOCAL     ] EGP: Deleted primary data file.
[2025-10-24T18:29:32.538161] [INFO ] [MAIN      ] EGP: Starting full primary refresh.
[2025-10-24T18:29:32.886739] [INFO ] [REMOTE    ] EGP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:29:32.947635] [INFO ] [REMOTE    ] EFXT: Fetching primary data for 2025-07.
[2025-10-24T18:29:33.747633] [INFO ] [REMOTE    ] EG: Fetching primary data for 2025-04.
[2025-10-24T18:29:33.928831] [INFO ] [REMOTE    ] EGO: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T18:29:34.180606] [INFO ] [REMOTE    ] EFXT: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T18:29:34.547669] [INFO ] [REMOTE    ] EGP: Fetching primary data for 2025-01.
[2025-10-24T18:29:35.280051] [INFO ] [REMOTE    ] EG: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T18:29:35.347714] [INFO ] [REMOTE    ] EG: Fetching primary data for 2025-05.
[2025-10-24T18:29:36.041775] [INFO ] [REMOTE    ] EGP: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T18:29:36.147683] [INFO ] [REMOTE    ] EFXT: Fetching primary data for 2025-08.
[2025-10-24T18:29:36.936823] [INFO ] [REMOTE    ] EG: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T18:29:36.947597] [INFO ] [REMOTE    ] EG: Fetching primary data for 2025-06.
[2025-10-24T18:29:37.494252] [INFO ] [REMOTE    ] EFXT: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T18:29:37.747677] [INFO ] [REMOTE    ] EGP: Fetching primary data for 2025-02.
[2025-10-24T18:29:38.246882] [INFO ] [REMOTE    ] EG: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T18:29:38.547691] [INFO ] [REMOTE    ] EFXT: Fetching primary data for 2025-09.
[2025-10-24T18:29:39.071601] [INFO ] [REMOTE    ] EGP: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T18:29:39.347731] [INFO ] [REMOTE    ] EGP: Fetching primary data for 2025-03.
[2025-10-24T18:29:39.862129] [INFO ] [REMOTE    ] EFXT: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T18:29:40.147639] [INFO ] [REMOTE    ] EGO: Fetching primary data for 2025-02.
[2025-10-24T18:29:40.731566] [INFO ] [REMOTE    ] EGP: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T18:29:40.947722] [INFO ] [REMOTE    ] EG: Fetching primary data for 2025-07.
[2025-10-24T18:29:41.747674] [INFO ] [REMOTE    ] EFXT: Fetching primary data for 2025-10.
[2025-10-24T18:29:41.794439] [INFO ] [REMOTE    ] EGO: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T18:29:42.260599] [INFO ] [REMOTE    ] EG: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T18:29:42.547630] [INFO ] [REMOTE    ] EGO: Fetching primary data for 2025-03.
[2025-10-24T18:29:43.098931] [INFO ] [REMOTE    ] EFXT: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T18:29:43.105436] [INFO ] [REMOTE    ] EFXT: Full fetch complete (44311 records).
[2025-10-24T18:29:43.105542] [DEBUG] [VALIDATOR ] EFXT: Validating primary data.
[2025-10-24T18:29:43.354495] [INFO ] [REMOTE    ] EGP: Fetching primary data for 2025-04.
[2025-10-24T18:29:43.494631] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present.
[2025-10-24T18:29:43.494740] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed.
[2025-10-24T18:29:43.495444] [INFO ] [MAIN      ] EFXT: Fetched primary data is valid.
[2025-10-24T18:29:43.495507] [DEBUG] [LOCAL     ] EFXT: Saving primary data.
[2025-10-24T18:29:43.495966] [FATAL] [LOCAL     ] EFXT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:29:43.496056] [FATAL] [MAIN      ] EFXT: Failed to save primary data.
[2025-10-24T18:29:43.496100] [WARN ] [MAIN      ] EFXT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:29:43.496135] [INFO ] [LOCAL     ] EFXT: Starting deletion of primary data.
[2025-10-24T18:29:43.496187] [DEBUG] [LOCAL     ] EFXT: No primary data file found to delete.
[2025-10-24T18:29:43.496224] [INFO ] [LOCAL     ] EFXT: Starting deletion of derivative data.
[2025-10-24T18:29:43.496365] [DEBUG] [LOCAL     ] EFXT: Deleted derivative data file.
[2025-10-24T18:29:43.496459] [INFO ] [MAIN      ] Update Progress: 707/2366 symbols completed. EFXT took 26.6s. Estimated remaining: 3h 30m 26s. Rate: 7.9 symbols/min
[2025-10-24T18:29:43.669733] [INFO ] [MAIN      ] EGY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:29:43.710137] [DEBUG] [LOCAL     ] EGY: Loaded 41489 existing records from primary storage.
[2025-10-24T18:29:43.710422] [INFO ] [MAIN      ] EGY: Loaded 41489 existing records.
[2025-10-24T18:29:43.889611] [WARN ] [MAIN      ] EGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:29:43.889911] [INFO ] [MAIN      ] EGY: Wiping existing primary data before full refresh.
[2025-10-24T18:29:43.889981] [INFO ] [LOCAL     ] EGY: Starting deletion of primary data.
[2025-10-24T18:29:43.890498] [DEBUG] [LOCAL     ] EGY: Deleted primary data file.
[2025-10-24T18:29:43.890553] [INFO ] [MAIN      ] EGY: Starting full primary refresh.
[2025-10-24T18:29:44.152161] [INFO ] [REMOTE    ] EG: Fetching primary data for 2025-08.
[2025-10-24T18:29:44.253056] [INFO ] [REMOTE    ] EGY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:29:44.280558] [INFO ] [REMOTE    ] EGO: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T18:29:44.953245] [INFO ] [REMOTE    ] EGO: Fetching primary data for 2025-04.
[2025-10-24T18:29:44.957888] [INFO ] [REMOTE    ] EGP: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T18:29:45.472128] [INFO ] [REMOTE    ] EG: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T18:29:45.747740] [INFO ] [REMOTE    ] EGP: Fetching primary data for 2025-05.
[2025-10-24T18:29:46.547690] [INFO ] [REMOTE    ] EG: Fetching primary data for 2025-09.
[2025-10-24T18:29:46.740844] [INFO ] [REMOTE    ] EGO: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T18:29:47.109896] [INFO ] [REMOTE    ] EGP: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T18:29:47.347732] [INFO ] [REMOTE    ] EGO: Fetching primary data for 2025-05.
[2025-10-24T18:29:47.785428] [INFO ] [REMOTE    ] EG: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T18:29:48.147630] [INFO ] [REMOTE    ] EG: Fetching primary data for 2025-10.
[2025-10-24T18:29:48.947689] [INFO ] [REMOTE    ] EGY: Fetching primary data for 2025-01.
[2025-10-24T18:29:49.064054] [INFO ] [REMOTE    ] EGO: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T18:29:49.525707] [INFO ] [REMOTE    ] EG: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T18:29:49.530035] [INFO ] [REMOTE    ] EG: Full fetch complete (42615 records).
[2025-10-24T18:29:49.530112] [DEBUG] [VALIDATOR ] EG: Validating primary data.
[2025-10-24T18:29:49.755128] [INFO ] [REMOTE    ] EGO: Fetching primary data for 2025-06.
[2025-10-24T18:29:49.904005] [DEBUG] [VALIDATOR ] EG: All expected trading days are present.
[2025-10-24T18:29:49.904081] [DEBUG] [VALIDATOR ] EG: Primary data validation passed.
[2025-10-24T18:29:49.904775] [INFO ] [MAIN      ] EG: Fetched primary data is valid.
[2025-10-24T18:29:49.904848] [DEBUG] [LOCAL     ] EG: Saving primary data.
[2025-10-24T18:29:49.905222] [FATAL] [LOCAL     ] EG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:29:49.905309] [FATAL] [MAIN      ] EG: Failed to save primary data.
[2025-10-24T18:29:49.905351] [WARN ] [MAIN      ] EG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:29:49.905385] [INFO ] [LOCAL     ] EG: Starting deletion of primary data.
[2025-10-24T18:29:49.905435] [DEBUG] [LOCAL     ] EG: No primary data file found to delete.
[2025-10-24T18:29:49.905473] [INFO ] [LOCAL     ] EG: Starting deletion of derivative data.
[2025-10-24T18:29:49.905622] [DEBUG] [LOCAL     ] EG: Deleted derivative data file.
[2025-10-24T18:29:49.905758] [INFO ] [MAIN      ] Update Progress: 708/2366 symbols completed. EG took 30.5s. Estimated remaining: 3h 30m 15s. Rate: 7.9 symbols/min
[2025-10-24T18:29:50.070159] [INFO ] [MAIN      ] EHAB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:29:50.098450] [DEBUG] [LOCAL     ] EHAB: Loaded 29510 existing records from primary storage.
[2025-10-24T18:29:50.098741] [INFO ] [MAIN      ] EHAB: Loaded 29510 existing records.
[2025-10-24T18:29:50.273457] [WARN ] [MAIN      ] EHAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:29:50.273726] [INFO ] [MAIN      ] EHAB: Wiping existing primary data before full refresh.
[2025-10-24T18:29:50.273778] [INFO ] [LOCAL     ] EHAB: Starting deletion of primary data.
[2025-10-24T18:29:50.274099] [DEBUG] [LOCAL     ] EHAB: Deleted primary data file.
[2025-10-24T18:29:50.274137] [INFO ] [MAIN      ] EHAB: Starting full primary refresh.
[2025-10-24T18:29:50.548978] [INFO ] [REMOTE    ] EGP: Fetching primary data for 2025-06.
[2025-10-24T18:29:50.637566] [INFO ] [REMOTE    ] EHAB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:29:50.660991] [INFO ] [REMOTE    ] EGY: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T18:29:51.347716] [INFO ] [REMOTE    ] EGY: Fetching primary data for 2025-02.
[2025-10-24T18:29:51.483817] [INFO ] [REMOTE    ] EGO: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T18:29:51.542599] [INFO ] [REMOTE    ] EGP: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T18:29:52.147692] [INFO ] [REMOTE    ] EGO: Fetching primary data for 2025-07.
[2025-10-24T18:29:52.769760] [INFO ] [REMOTE    ] EGY: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T18:29:52.947700] [INFO ] [REMOTE    ] EGY: Fetching primary data for 2025-03.
[2025-10-24T18:29:53.748330] [INFO ] [REMOTE    ] EGP: Fetching primary data for 2025-07.
[2025-10-24T18:29:53.754890] [INFO ] [REMOTE    ] EGO: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T18:29:54.547678] [INFO ] [REMOTE    ] EHAB: Fetching primary data for 2025-01.
[2025-10-24T18:29:54.707311] [INFO ] [REMOTE    ] EGY: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T18:29:55.208366] [INFO ] [REMOTE    ] EGP: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T18:29:55.347603] [INFO ] [REMOTE    ] EGP: Fetching primary data for 2025-08.
[2025-10-24T18:29:55.727292] [INFO ] [REMOTE    ] EHAB: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T18:29:56.147685] [INFO ] [REMOTE    ] EGY: Fetching primary data for 2025-04.
[2025-10-24T18:29:56.782235] [INFO ] [REMOTE    ] EGP: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T18:29:56.947717] [INFO ] [REMOTE    ] EGO: Fetching primary data for 2025-08.
[2025-10-24T18:29:57.747694] [INFO ] [REMOTE    ] EGP: Fetching primary data for 2025-09.
[2025-10-24T18:29:57.781882] [INFO ] [REMOTE    ] EGY: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T18:29:58.547682] [INFO ] [REMOTE    ] EGY: Fetching primary data for 2025-05.
[2025-10-24T18:29:58.790032] [INFO ] [REMOTE    ] EGO: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T18:29:58.864301] [INFO ] [REMOTE    ] EGP: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T18:29:59.347722] [INFO ] [REMOTE    ] EHAB: Fetching primary data for 2025-02.
[2025-10-24T18:30:00.147617] [INFO ] [REMOTE    ] EGP: Fetching primary data for 2025-10.
[2025-10-24T18:30:00.176911] [INFO ] [REMOTE    ] EGY: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T18:30:00.391141] [INFO ] [REMOTE    ] EHAB: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T18:30:00.947680] [INFO ] [REMOTE    ] EHAB: Fetching primary data for 2025-03.
[2025-10-24T18:30:01.747746] [INFO ] [REMOTE    ] EGY: Fetching primary data for 2025-06.
[2025-10-24T18:30:01.798011] [INFO ] [REMOTE    ] EGP: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T18:30:01.806370] [INFO ] [REMOTE    ] EGP: Full fetch complete (45614 records).
[2025-10-24T18:30:01.806562] [DEBUG] [VALIDATOR ] EGP: Validating primary data.
[2025-10-24T18:30:02.236983] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present.
[2025-10-24T18:30:02.237078] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed.
[2025-10-24T18:30:02.237927] [INFO ] [MAIN      ] EGP: Fetched primary data is valid.
[2025-10-24T18:30:02.237994] [DEBUG] [LOCAL     ] EGP: Saving primary data.
[2025-10-24T18:30:02.238510] [FATAL] [LOCAL     ] EGP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:30:02.238605] [FATAL] [MAIN      ] EGP: Failed to save primary data.
[2025-10-24T18:30:02.238677] [WARN ] [MAIN      ] EGP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:30:02.238742] [INFO ] [LOCAL     ] EGP: Starting deletion of primary data.
[2025-10-24T18:30:02.238799] [DEBUG] [LOCAL     ] EGP: No primary data file found to delete.
[2025-10-24T18:30:02.238838] [INFO ] [LOCAL     ] EGP: Starting deletion of derivative data.
[2025-10-24T18:30:02.238980] [DEBUG] [LOCAL     ] EGP: Deleted derivative data file.
[2025-10-24T18:30:02.239081] [INFO ] [MAIN      ] Update Progress: 709/2366 symbols completed. EGP took 30.1s. Estimated remaining: 3h 30m 19s. Rate: 7.9 symbols/min
[2025-10-24T18:30:02.420499] [INFO ] [MAIN      ] EHC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:30:02.468738] [DEBUG] [LOCAL     ] EHC: Loaded 41202 existing records from primary storage.
[2025-10-24T18:30:02.469105] [INFO ] [MAIN      ] EHC: Loaded 41202 existing records.
[2025-10-24T18:30:02.553678] [INFO ] [REMOTE    ] EGO: Fetching primary data for 2025-09.
[2025-10-24T18:30:02.665523] [WARN ] [MAIN      ] EHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:30:02.665808] [INFO ] [MAIN      ] EHC: Wiping existing primary data before full refresh.
[2025-10-24T18:30:02.665861] [INFO ] [LOCAL     ] EHC: Starting deletion of primary data.
[2025-10-24T18:30:02.666242] [DEBUG] [LOCAL     ] EHC: Deleted primary data file.
[2025-10-24T18:30:02.666300] [INFO ] [MAIN      ] EHC: Starting full primary refresh.
[2025-10-24T18:30:03.042333] [INFO ] [REMOTE    ] EHAB: Incremental fetch complete for 2025-03 (2.09 seconds).
[2025-10-24T18:30:03.082940] [INFO ] [REMOTE    ] EHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:30:03.347677] [INFO ] [REMOTE    ] EHC: Fetching primary data for 2025-01.
[2025-10-24T18:30:04.147632] [INFO ] [REMOTE    ] EHAB: Fetching primary data for 2025-04.
[2025-10-24T18:30:04.479192] [INFO ] [REMOTE    ] EGY: Incremental fetch complete for 2025-06 (2.73 seconds).
[2025-10-24T18:30:04.947617] [INFO ] [REMOTE    ] EGY: Fetching primary data for 2025-07.
[2025-10-24T18:30:05.122754] [INFO ] [REMOTE    ] EGO: Incremental fetch complete for 2025-09 (2.57 seconds).
[2025-10-24T18:30:05.352926] [INFO ] [REMOTE    ] EHC: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T18:30:05.747713] [INFO ] [REMOTE    ] EHC: Fetching primary data for 2025-02.
[2025-10-24T18:30:06.193838] [INFO ] [REMOTE    ] EHAB: Incremental fetch complete for 2025-04 (2.05 seconds).
[2025-10-24T18:30:06.547721] [INFO ] [REMOTE    ] EHAB: Fetching primary data for 2025-05.
[2025-10-24T18:30:06.874844] [INFO ] [REMOTE    ] EGY: Incremental fetch complete for 2025-07 (1.93 seconds).
[2025-10-24T18:30:07.347616] [INFO ] [REMOTE    ] EGO: Fetching primary data for 2025-10.
[2025-10-24T18:30:07.445025] [INFO ] [REMOTE    ] EHC: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T18:30:08.147628] [INFO ] [REMOTE    ] EGY: Fetching primary data for 2025-08.
[2025-10-24T18:30:08.393493] [INFO ] [REMOTE    ] EHAB: Incremental fetch complete for 2025-05 (1.85 seconds).
[2025-10-24T18:30:08.947695] [INFO ] [REMOTE    ] EHC: Fetching primary data for 2025-03.
[2025-10-24T18:30:09.747677] [INFO ] [REMOTE    ] EHAB: Fetching primary data for 2025-06.
[2025-10-24T18:30:09.935516] [INFO ] [REMOTE    ] EGY: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T18:30:10.411902] [INFO ] [REMOTE    ] EHC: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T18:30:10.551504] [INFO ] [REMOTE    ] EGY: Fetching primary data for 2025-09.
[2025-10-24T18:30:10.553445] [INFO ] [REMOTE    ] EHAB: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T18:30:10.858866] [INFO ] [REMOTE    ] EGO: Incremental fetch complete for 2025-10 (3.51 seconds).
[2025-10-24T18:30:10.869059] [INFO ] [REMOTE    ] EGO: Full fetch complete (74675 records).
[2025-10-24T18:30:10.869234] [DEBUG] [VALIDATOR ] EGO: Validating primary data.
[2025-10-24T18:30:11.252527] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present.
[2025-10-24T18:30:11.252608] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed.
[2025-10-24T18:30:11.253596] [INFO ] [MAIN      ] EGO: Fetched primary data is valid.
[2025-10-24T18:30:11.253686] [DEBUG] [LOCAL     ] EGO: Saving primary data.
[2025-10-24T18:30:11.254294] [FATAL] [LOCAL     ] EGO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:30:11.254386] [FATAL] [MAIN      ] EGO: Failed to save primary data.
[2025-10-24T18:30:11.254431] [WARN ] [MAIN      ] EGO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:30:11.254466] [INFO ] [LOCAL     ] EGO: Starting deletion of primary data.
[2025-10-24T18:30:11.254518] [DEBUG] [LOCAL     ] EGO: No primary data file found to delete.
[2025-10-24T18:30:11.254554] [INFO ] [LOCAL     ] EGO: Starting deletion of derivative data.
[2025-10-24T18:30:11.254723] [DEBUG] [LOCAL     ] EGO: Deleted derivative data file.
[2025-10-24T18:30:11.255323] [INFO ] [MAIN      ] Update Progress: 710/2366 symbols completed. EGO took 40.8s. Estimated remaining: 3h 30m 14s. Rate: 7.9 symbols/min
[2025-10-24T18:30:11.352720] [INFO ] [REMOTE    ] EHC: Fetching primary data for 2025-04.
[2025-10-24T18:30:11.428244] [INFO ] [MAIN      ] EHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:30:11.441964] [DEBUG] [LOCAL     ] EHI: Loaded 10593 existing records from primary storage.
[2025-10-24T18:30:11.442198] [INFO ] [MAIN      ] EHI: Loaded 10593 existing records.
[2025-10-24T18:30:11.631251] [WARN ] [MAIN      ] EHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:30:11.631466] [INFO ] [MAIN      ] EHI: Wiping existing primary data before full refresh.
[2025-10-24T18:30:11.631513] [INFO ] [LOCAL     ] EHI: Starting deletion of primary data.
[2025-10-24T18:30:11.631755] [DEBUG] [LOCAL     ] EHI: Deleted primary data file.
[2025-10-24T18:30:11.631811] [INFO ] [MAIN      ] EHI: Starting full primary refresh.
[2025-10-24T18:30:12.001446] [INFO ] [REMOTE    ] EHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:30:12.156819] [INFO ] [REMOTE    ] EHI: Fetching primary data for 2025-01.
[2025-10-24T18:30:12.161631] [INFO ] [REMOTE    ] EGY: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T18:30:12.673962] [INFO ] [REMOTE    ] EHC: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T18:30:12.947683] [INFO ] [REMOTE    ] EHC: Fetching primary data for 2025-05.
[2025-10-24T18:30:12.976430] [INFO ] [REMOTE    ] EHI: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T18:30:13.747721] [INFO ] [REMOTE    ] EGY: Fetching primary data for 2025-10.
[2025-10-24T18:30:14.185286] [INFO ] [REMOTE    ] EHC: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T18:30:14.547694] [INFO ] [REMOTE    ] EHC: Fetching primary data for 2025-06.
[2025-10-24T18:30:15.347673] [INFO ] [REMOTE    ] EHAB: Fetching primary data for 2025-07.
[2025-10-24T18:30:15.666174] [INFO ] [REMOTE    ] EGY: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T18:30:15.673139] [INFO ] [REMOTE    ] EGY: Full fetch complete (60371 records).
[2025-10-24T18:30:15.673259] [DEBUG] [VALIDATOR ] EGY: Validating primary data.
[2025-10-24T18:30:15.673911] [FATAL] [VALIDATOR ] EGY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:30:15.673995] [FATAL] [MAIN      ] EGY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:30:15.674037] [WARN ] [MAIN      ] EGY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:30:15.674102] [INFO ] [LOCAL     ] EGY: Starting deletion of primary data.
[2025-10-24T18:30:15.674162] [DEBUG] [LOCAL     ] EGY: No primary data file found to delete.
[2025-10-24T18:30:15.674197] [INFO ] [LOCAL     ] EGY: Starting deletion of derivative data.
[2025-10-24T18:30:15.674325] [DEBUG] [LOCAL     ] EGY: Deleted derivative data file.
[2025-10-24T18:30:15.674391] [INFO ] [MAIN      ] Update Progress: 711/2366 symbols completed. EGY took 32.2s. Estimated remaining: 3h 29m 59s. Rate: 7.9 symbols/min
[2025-10-24T18:30:15.843472] [INFO ] [MAIN      ] EIC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:30:15.865881] [DEBUG] [LOCAL     ] EIC: Loaded 22532 existing records from primary storage.
[2025-10-24T18:30:15.866106] [INFO ] [MAIN      ] EIC: Loaded 22532 existing records.
[2025-10-24T18:30:16.049633] [WARN ] [MAIN      ] EIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:30:16.049930] [INFO ] [MAIN      ] EIC: Wiping existing primary data before full refresh.
[2025-10-24T18:30:16.050068] [INFO ] [LOCAL     ] EIC: Starting deletion of primary data.
[2025-10-24T18:30:16.050394] [DEBUG] [LOCAL     ] EIC: Deleted primary data file.
[2025-10-24T18:30:16.050482] [INFO ] [MAIN      ] EIC: Starting full primary refresh.
[2025-10-24T18:30:16.151110] [INFO ] [REMOTE    ] EHI: Fetching primary data for 2025-02.
[2025-10-24T18:30:16.326222] [INFO ] [REMOTE    ] EHC: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T18:30:16.446226] [INFO ] [REMOTE    ] EIC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:30:16.947682] [INFO ] [REMOTE    ] EHC: Fetching primary data for 2025-07.
[2025-10-24T18:30:17.010694] [INFO ] [REMOTE    ] EHAB: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T18:30:17.198006] [INFO ] [REMOTE    ] EHI: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T18:30:17.747719] [INFO ] [REMOTE    ] EHAB: Fetching primary data for 2025-08.
[2025-10-24T18:30:18.318348] [INFO ] [REMOTE    ] EHC: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T18:30:18.547680] [INFO ] [REMOTE    ] EIC: Fetching primary data for 2025-01.
[2025-10-24T18:30:19.221916] [INFO ] [REMOTE    ] EHAB: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T18:30:19.347617] [INFO ] [REMOTE    ] EHI: Fetching primary data for 2025-03.
[2025-10-24T18:30:19.743853] [INFO ] [REMOTE    ] EIC: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T18:30:20.054391] [INFO ] [REMOTE    ] EHI: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T18:30:20.147688] [INFO ] [REMOTE    ] EHI: Fetching primary data for 2025-04.
[2025-10-24T18:30:20.947688] [INFO ] [REMOTE    ] EIC: Fetching primary data for 2025-02.
[2025-10-24T18:30:20.964501] [INFO ] [REMOTE    ] EHI: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T18:30:21.747727] [INFO ] [REMOTE    ] EHC: Fetching primary data for 2025-08.
[2025-10-24T18:30:22.167293] [INFO ] [REMOTE    ] EIC: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T18:30:22.547688] [INFO ] [REMOTE    ] EIC: Fetching primary data for 2025-03.
[2025-10-24T18:30:22.989306] [INFO ] [REMOTE    ] EHC: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T18:30:23.347676] [INFO ] [REMOTE    ] EHC: Fetching primary data for 2025-09.
[2025-10-24T18:30:23.937903] [INFO ] [REMOTE    ] EIC: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T18:30:24.147719] [INFO ] [REMOTE    ] EIC: Fetching primary data for 2025-04.
[2025-10-24T18:30:24.941024] [INFO ] [REMOTE    ] EHC: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T18:30:24.948610] [INFO ] [REMOTE    ] EHAB: Fetching primary data for 2025-09.
[2025-10-24T18:30:25.074357] [INFO ] [REMOTE    ] EIC: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T18:30:25.747691] [INFO ] [REMOTE    ] EIC: Fetching primary data for 2025-05.
[2025-10-24T18:30:26.011634] [INFO ] [REMOTE    ] EHAB: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T18:30:26.547738] [INFO ] [REMOTE    ] EHC: Fetching primary data for 2025-10.
[2025-10-24T18:30:27.007524] [INFO ] [REMOTE    ] EIC: Incremental fetch complete for 2025-05 (1.26 seconds).
[2025-10-24T18:30:27.347744] [INFO ] [REMOTE    ] EHI: Fetching primary data for 2025-05.
[2025-10-24T18:30:28.125967] [INFO ] [REMOTE    ] EHC: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T18:30:28.133206] [INFO ] [REMOTE    ] EHC: Full fetch complete (58727 records).
[2025-10-24T18:30:28.133387] [DEBUG] [VALIDATOR ] EHC: Validating primary data.
[2025-10-24T18:30:28.154542] [INFO ] [REMOTE    ] EIC: Fetching primary data for 2025-06.
[2025-10-24T18:30:28.440171] [INFO ] [REMOTE    ] EHI: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T18:30:28.564075] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present.
[2025-10-24T18:30:28.564151] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed.
[2025-10-24T18:30:28.564907] [INFO ] [MAIN      ] EHC: Fetched primary data is valid.
[2025-10-24T18:30:28.564970] [DEBUG] [LOCAL     ] EHC: Saving primary data.
[2025-10-24T18:30:28.565412] [FATAL] [LOCAL     ] EHC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:30:28.565498] [FATAL] [MAIN      ] EHC: Failed to save primary data.
[2025-10-24T18:30:28.565558] [WARN ] [MAIN      ] EHC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:30:28.565619] [INFO ] [LOCAL     ] EHC: Starting deletion of primary data.
[2025-10-24T18:30:28.565715] [DEBUG] [LOCAL     ] EHC: No primary data file found to delete.
[2025-10-24T18:30:28.565761] [INFO ] [LOCAL     ] EHC: Starting deletion of derivative data.
[2025-10-24T18:30:28.565896] [DEBUG] [LOCAL     ] EHC: Deleted derivative data file.
[2025-10-24T18:30:28.565970] [INFO ] [MAIN      ] Update Progress: 712/2366 symbols completed. EHC took 26.3s. Estimated remaining: 3h 30m 4s. Rate: 7.9 symbols/min
[2025-10-24T18:30:28.732478] [INFO ] [MAIN      ] EICA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:30:28.732610] [DEBUG] [LOCAL     ] EICA: No existing data file found in primary storage.
[2025-10-24T18:30:28.732669] [WARN ] [MAIN      ] EICA: No existing data found, performing full refresh instead.
[2025-10-24T18:30:28.732778] [INFO ] [MAIN      ] EICA: Wiping existing primary data before full refresh.
[2025-10-24T18:30:28.732818] [INFO ] [LOCAL     ] EICA: Starting deletion of primary data.
[2025-10-24T18:30:28.732860] [DEBUG] [LOCAL     ] EICA: No primary data file found to delete.
[2025-10-24T18:30:28.732905] [INFO ] [MAIN      ] EICA: Starting full primary refresh.
[2025-10-24T18:30:28.952961] [INFO ] [REMOTE    ] EHAB: Fetching primary data for 2025-10.
[2025-10-24T18:30:29.090008] [INFO ] [REMOTE    ] EICA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:30:29.476462] [INFO ] [REMOTE    ] EIC: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T18:30:29.747694] [INFO ] [REMOTE    ] EHI: Fetching primary data for 2025-06.
[2025-10-24T18:30:30.369856] [INFO ] [REMOTE    ] EHAB: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T18:30:30.374469] [INFO ] [REMOTE    ] EHAB: Full fetch complete (41029 records).
[2025-10-24T18:30:30.374552] [DEBUG] [VALIDATOR ] EHAB: Validating primary data.
[2025-10-24T18:30:30.375091] [FATAL] [VALIDATOR ] EHAB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:30:30.375174] [FATAL] [MAIN      ] EHAB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:30:30.375215] [WARN ] [MAIN      ] EHAB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:30:30.375278] [INFO ] [LOCAL     ] EHAB: Starting deletion of primary data.
[2025-10-24T18:30:30.375343] [DEBUG] [LOCAL     ] EHAB: No primary data file found to delete.
[2025-10-24T18:30:30.375378] [INFO ] [LOCAL     ] EHAB: Starting deletion of derivative data.
[2025-10-24T18:30:30.375515] [DEBUG] [LOCAL     ] EHAB: Deleted derivative data file.
[2025-10-24T18:30:30.375591] [INFO ] [MAIN      ] Update Progress: 713/2366 symbols completed. EHAB took 40.5s. Estimated remaining: 3h 29m 43s. Rate: 7.9 symbols/min
[2025-10-24T18:30:30.546348] [INFO ] [MAIN      ] EICB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:30:30.546527] [DEBUG] [LOCAL     ] EICB: No existing data file found in primary storage.
[2025-10-24T18:30:30.546568] [WARN ] [MAIN      ] EICB: No existing data found, performing full refresh instead.
[2025-10-24T18:30:30.546698] [INFO ] [MAIN      ] EICB: Wiping existing primary data before full refresh.
[2025-10-24T18:30:30.546750] [INFO ] [LOCAL     ] EICB: Starting deletion of primary data.
[2025-10-24T18:30:30.546793] [DEBUG] [LOCAL     ] EICB: No primary data file found to delete.
[2025-10-24T18:30:30.546824] [INFO ] [MAIN      ] EICB: Starting full primary refresh.
[2025-10-24T18:30:30.558173] [INFO ] [REMOTE    ] EICA: Fetching primary data for 2025-01.
[2025-10-24T18:30:30.781965] [INFO ] [REMOTE    ] EHI: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T18:30:30.918931] [INFO ] [REMOTE    ] EICB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:30:31.190919] [INFO ] [REMOTE    ] EICA: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T18:30:31.347722] [INFO ] [REMOTE    ] EIC: Fetching primary data for 2025-07.
[2025-10-24T18:30:32.147712] [INFO ] [REMOTE    ] EICB: Fetching primary data for 2025-01.
[2025-10-24T18:30:32.821257] [INFO ] [REMOTE    ] EIC: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T18:30:32.821378] [INFO ] [REMOTE    ] EICB: Incremental fetch complete for 2025-01 (0.67 seconds).
[2025-10-24T18:30:32.947704] [INFO ] [REMOTE    ] EIC: Fetching primary data for 2025-08.
[2025-10-24T18:30:33.747679] [INFO ] [REMOTE    ] EICA: Fetching primary data for 2025-02.
[2025-10-24T18:30:34.040919] [INFO ] [REMOTE    ] EIC: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T18:30:34.099992] [INFO ] [REMOTE    ] EICA: Incremental fetch complete for 2025-02 (0.35 seconds).
[2025-10-24T18:30:34.547695] [INFO ] [REMOTE    ] EIC: Fetching primary data for 2025-09.
[2025-10-24T18:30:35.347626] [INFO ] [REMOTE    ] EICA: Fetching primary data for 2025-03.
[2025-10-24T18:30:35.571710] [INFO ] [REMOTE    ] EIC: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T18:30:35.703629] [INFO ] [REMOTE    ] EICA: Incremental fetch complete for 2025-03 (0.36 seconds).
[2025-10-24T18:30:36.147685] [INFO ] [REMOTE    ] EHI: Fetching primary data for 2025-07.
[2025-10-24T18:30:36.947686] [INFO ] [REMOTE    ] EICB: Fetching primary data for 2025-02.
[2025-10-24T18:30:37.007834] [INFO ] [REMOTE    ] EHI: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T18:30:37.392769] [INFO ] [REMOTE    ] EICB: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T18:30:37.747723] [INFO ] [REMOTE    ] EIC: Fetching primary data for 2025-10.
[2025-10-24T18:30:38.547746] [INFO ] [REMOTE    ] EHI: Fetching primary data for 2025-08.
[2025-10-24T18:30:39.004480] [INFO ] [REMOTE    ] EIC: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T18:30:39.008197] [INFO ] [REMOTE    ] EIC: Full fetch complete (33997 records).
[2025-10-24T18:30:39.008283] [DEBUG] [VALIDATOR ] EIC: Validating primary data.
[2025-10-24T18:30:39.359181] [INFO ] [REMOTE    ] EICA: Fetching primary data for 2025-04.
[2025-10-24T18:30:39.373000] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present.
[2025-10-24T18:30:39.373063] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed.
[2025-10-24T18:30:39.373609] [INFO ] [MAIN      ] EIC: Fetched primary data is valid.
[2025-10-24T18:30:39.373684] [DEBUG] [LOCAL     ] EIC: Saving primary data.
[2025-10-24T18:30:39.374048] [FATAL] [LOCAL     ] EIC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:30:39.374128] [FATAL] [MAIN      ] EIC: Failed to save primary data.
[2025-10-24T18:30:39.374209] [WARN ] [MAIN      ] EIC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:30:39.374290] [INFO ] [LOCAL     ] EIC: Starting deletion of primary data.
[2025-10-24T18:30:39.374362] [DEBUG] [LOCAL     ] EIC: No primary data file found to delete.
[2025-10-24T18:30:39.374412] [INFO ] [LOCAL     ] EIC: Starting deletion of derivative data.
[2025-10-24T18:30:39.374559] [DEBUG] [LOCAL     ] EIC: Deleted derivative data file.
[2025-10-24T18:30:39.374682] [INFO ] [MAIN      ] Update Progress: 714/2366 symbols completed. EIC took 23.7s. Estimated remaining: 3h 29m 39s. Rate: 7.9 symbols/min
[2025-10-24T18:30:39.496625] [INFO ] [REMOTE    ] EHI: Incremental fetch complete for 2025-08 (0.95 seconds).
[2025-10-24T18:30:39.562767] [INFO ] [MAIN      ] EICC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:30:39.571535] [DEBUG] [LOCAL     ] EICC: Loaded 6220 existing records from primary storage.
[2025-10-24T18:30:39.571765] [INFO ] [MAIN      ] EICC: Loaded 6220 existing records.
[2025-10-24T18:30:39.792562] [WARN ] [MAIN      ] EICC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:30:39.794846] [INFO ] [REMOTE    ] EICA: Incremental fetch complete for 2025-04 (0.44 seconds).
[2025-10-24T18:30:39.795955] [INFO ] [MAIN      ] EICC: Wiping existing primary data before full refresh.
[2025-10-24T18:30:39.796009] [INFO ] [LOCAL     ] EICC: Starting deletion of primary data.
[2025-10-24T18:30:39.796189] [DEBUG] [LOCAL     ] EICC: Deleted primary data file.
[2025-10-24T18:30:39.796243] [INFO ] [MAIN      ] EICC: Starting full primary refresh.
[2025-10-24T18:30:40.150363] [INFO ] [REMOTE    ] EICB: Fetching primary data for 2025-03.
[2025-10-24T18:30:40.150294] [INFO ] [REMOTE    ] EICC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:30:40.582306] [INFO ] [REMOTE    ] EICB: Incremental fetch complete for 2025-03 (0.43 seconds).
[2025-10-24T18:30:40.947702] [INFO ] [REMOTE    ] EHI: Fetching primary data for 2025-09.
[2025-10-24T18:30:41.747754] [INFO ] [REMOTE    ] EICA: Fetching primary data for 2025-05.
[2025-10-24T18:30:41.767300] [INFO ] [REMOTE    ] EHI: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T18:30:42.250682] [INFO ] [REMOTE    ] EICA: Incremental fetch complete for 2025-05 (0.50 seconds).
[2025-10-24T18:30:42.547692] [INFO ] [REMOTE    ] EICB: Fetching primary data for 2025-04.
[2025-10-24T18:30:43.004334] [INFO ] [REMOTE    ] EICB: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T18:30:43.347696] [INFO ] [REMOTE    ] EICC: Fetching primary data for 2025-01.
[2025-10-24T18:30:43.845086] [INFO ] [REMOTE    ] EICC: Incremental fetch complete for 2025-01 (0.50 seconds).
[2025-10-24T18:30:44.147678] [INFO ] [REMOTE    ] EICC: Fetching primary data for 2025-02.
[2025-10-24T18:30:44.739839] [INFO ] [REMOTE    ] EICC: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T18:30:44.947678] [INFO ] [REMOTE    ] EICA: Fetching primary data for 2025-06.
[2025-10-24T18:30:45.268687] [INFO ] [REMOTE    ] EICA: Incremental fetch complete for 2025-06 (0.32 seconds).
[2025-10-24T18:30:45.747681] [INFO ] [REMOTE    ] EICC: Fetching primary data for 2025-03.
[2025-10-24T18:30:46.357807] [INFO ] [REMOTE    ] EICC: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T18:30:46.547616] [INFO ] [REMOTE    ] EHI: Fetching primary data for 2025-10.
[2025-10-24T18:30:47.347627] [INFO ] [REMOTE    ] EICB: Fetching primary data for 2025-05.
[2025-10-24T18:30:47.423592] [INFO ] [REMOTE    ] EHI: Incremental fetch complete for 2025-10 (0.88 seconds).
[2025-10-24T18:30:47.426072] [INFO ] [REMOTE    ] EHI: Full fetch complete (15665 records).
[2025-10-24T18:30:47.426151] [DEBUG] [VALIDATOR ] EHI: Validating primary data.
[2025-10-24T18:30:47.426801] [FATAL] [VALIDATOR ] EHI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:30:47.426883] [FATAL] [MAIN      ] EHI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:30:47.426926] [WARN ] [MAIN      ] EHI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:30:47.426992] [INFO ] [LOCAL     ] EHI: Starting deletion of primary data.
[2025-10-24T18:30:47.427054] [DEBUG] [LOCAL     ] EHI: No primary data file found to delete.
[2025-10-24T18:30:47.427092] [INFO ] [LOCAL     ] EHI: Starting deletion of derivative data.
[2025-10-24T18:30:47.427279] [DEBUG] [LOCAL     ] EHI: Deleted derivative data file.
[2025-10-24T18:30:47.427366] [INFO ] [MAIN      ] Update Progress: 715/2366 symbols completed. EHI took 36.2s. Estimated remaining: 3h 29m 32s. Rate: 7.9 symbols/min
[2025-10-24T18:30:47.610614] [INFO ] [MAIN      ] EIG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:30:47.632524] [DEBUG] [LOCAL     ] EIG: Loaded 20163 existing records from primary storage.
[2025-10-24T18:30:47.632796] [INFO ] [MAIN      ] EIG: Loaded 20163 existing records.
[2025-10-24T18:30:47.823114] [INFO ] [REMOTE    ] EICB: Incremental fetch complete for 2025-05 (0.48 seconds).
[2025-10-24T18:30:47.835576] [WARN ] [MAIN      ] EIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:30:47.836960] [INFO ] [MAIN      ] EIG: Wiping existing primary data before full refresh.
[2025-10-24T18:30:47.837095] [INFO ] [LOCAL     ] EIG: Starting deletion of primary data.
[2025-10-24T18:30:47.837334] [DEBUG] [LOCAL     ] EIG: Deleted primary data file.
[2025-10-24T18:30:47.837392] [INFO ] [MAIN      ] EIG: Starting full primary refresh.
[2025-10-24T18:30:48.152755] [INFO ] [REMOTE    ] EICC: Fetching primary data for 2025-04.
[2025-10-24T18:30:48.205525] [INFO ] [REMOTE    ] EIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:30:48.830990] [INFO ] [REMOTE    ] EICC: Incremental fetch complete for 2025-04 (0.68 seconds).
[2025-10-24T18:30:48.947692] [INFO ] [REMOTE    ] EICB: Fetching primary data for 2025-06.
[2025-10-24T18:30:49.359813] [INFO ] [REMOTE    ] EICB: Incremental fetch complete for 2025-06 (0.41 seconds).
[2025-10-24T18:30:49.747714] [INFO ] [REMOTE    ] EIG: Fetching primary data for 2025-01.
[2025-10-24T18:30:50.547723] [INFO ] [REMOTE    ] EICB: Fetching primary data for 2025-07.
[2025-10-24T18:30:50.626431] [INFO ] [REMOTE    ] EIG: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T18:30:50.943190] [INFO ] [REMOTE    ] EICB: Incremental fetch complete for 2025-07 (0.40 seconds).
[2025-10-24T18:30:51.347733] [INFO ] [REMOTE    ] EIG: Fetching primary data for 2025-02.
[2025-10-24T18:30:52.147734] [INFO ] [REMOTE    ] EICC: Fetching primary data for 2025-05.
[2025-10-24T18:30:52.438244] [INFO ] [REMOTE    ] EIG: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T18:30:52.502748] [INFO ] [REMOTE    ] EICC: Incremental fetch complete for 2025-05 (0.36 seconds).
[2025-10-24T18:30:52.947731] [INFO ] [REMOTE    ] EIG: Fetching primary data for 2025-03.
[2025-10-24T18:30:53.747683] [INFO ] [REMOTE    ] EICC: Fetching primary data for 2025-06.
[2025-10-24T18:30:53.912883] [INFO ] [REMOTE    ] EIG: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T18:30:54.405132] [INFO ] [REMOTE    ] EICC: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T18:30:54.547684] [INFO ] [REMOTE    ] EICC: Fetching primary data for 2025-07.
[2025-10-24T18:30:55.267899] [INFO ] [REMOTE    ] EICC: Incremental fetch complete for 2025-07 (0.72 seconds).
[2025-10-24T18:30:55.347673] [INFO ] [REMOTE    ] EIG: Fetching primary data for 2025-04.
[2025-10-24T18:30:56.147621] [INFO ] [REMOTE    ] EICA: Fetching primary data for 2025-07.
[2025-10-24T18:30:56.408506] [INFO ] [REMOTE    ] EIG: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T18:30:56.732937] [INFO ] [REMOTE    ] EICA: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T18:30:56.947680] [INFO ] [REMOTE    ] EICC: Fetching primary data for 2025-08.
[2025-10-24T18:30:57.693336] [INFO ] [REMOTE    ] EICC: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T18:30:57.747663] [INFO ] [REMOTE    ] EICB: Fetching primary data for 2025-08.
[2025-10-24T18:30:58.346141] [INFO ] [REMOTE    ] EICB: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T18:30:58.547717] [INFO ] [REMOTE    ] EICC: Fetching primary data for 2025-09.
[2025-10-24T18:30:59.325372] [INFO ] [REMOTE    ] EICC: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T18:30:59.347730] [INFO ] [REMOTE    ] EICB: Fetching primary data for 2025-09.
[2025-10-24T18:30:59.790134] [INFO ] [REMOTE    ] EICB: Incremental fetch complete for 2025-09 (0.44 seconds).
[2025-10-24T18:31:00.147708] [INFO ] [REMOTE    ] EICB: Fetching primary data for 2025-10.
[2025-10-24T18:31:00.947691] [INFO ] [REMOTE    ] EICC: Fetching primary data for 2025-10.
[2025-10-24T18:31:01.363813] [INFO ] [REMOTE    ] EICB: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T18:31:01.365110] [INFO ] [REMOTE    ] EICB: Full fetch complete (2631 records).
[2025-10-24T18:31:01.365196] [DEBUG] [VALIDATOR ] EICB: Validating primary data.
[2025-10-24T18:31:01.648474] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days
[2025-10-24T18:31:01.648736] [FATAL] [MAIN      ] EICB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:31:01.648812] [WARN ] [MAIN      ] EICB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:31:01.648899] [INFO ] [LOCAL     ] EICB: Starting deletion of primary data.
[2025-10-24T18:31:01.649007] [DEBUG] [LOCAL     ] EICB: No primary data file found to delete.
[2025-10-24T18:31:01.649088] [INFO ] [LOCAL     ] EICB: Starting deletion of derivative data.
[2025-10-24T18:31:01.649186] [DEBUG] [LOCAL     ] EICB: No derivative data file found to delete.
[2025-10-24T18:31:01.649307] [INFO ] [MAIN      ] Update Progress: 716/2366 symbols completed. EICB took 31.3s. Estimated remaining: 3h 29m 40s. Rate: 7.9 symbols/min
[2025-10-24T18:31:01.752965] [INFO ] [REMOTE    ] EIG: Fetching primary data for 2025-05.
[2025-10-24T18:31:01.884164] [INFO ] [MAIN      ] EIX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:31:01.937557] [DEBUG] [LOCAL     ] EIX: Loaded 53737 existing records from primary storage.
[2025-10-24T18:31:01.937965] [INFO ] [MAIN      ] EIX: Loaded 53737 existing records.
[2025-10-24T18:31:02.134762] [WARN ] [MAIN      ] EIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:31:02.134983] [INFO ] [MAIN      ] EIX: Wiping existing primary data before full refresh.
[2025-10-24T18:31:02.135032] [INFO ] [LOCAL     ] EIX: Starting deletion of primary data.
[2025-10-24T18:31:02.135434] [DEBUG] [LOCAL     ] EIX: Deleted primary data file.
[2025-10-24T18:31:02.135494] [INFO ] [MAIN      ] EIX: Starting full primary refresh.
[2025-10-24T18:31:02.484997] [INFO ] [REMOTE    ] EIX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:31:02.547606] [INFO ] [REMOTE    ] EIX: Fetching primary data for 2025-01.
[2025-10-24T18:31:02.778699] [INFO ] [REMOTE    ] EICC: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T18:31:02.780346] [INFO ] [REMOTE    ] EICC: Full fetch complete (8428 records).
[2025-10-24T18:31:02.780416] [DEBUG] [VALIDATOR ] EICC: Validating primary data.
[2025-10-24T18:31:02.780808] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:31:02.780889] [FATAL] [MAIN      ] EICC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:31:02.780931] [WARN ] [MAIN      ] EICC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:31:02.780969] [INFO ] [LOCAL     ] EICC: Starting deletion of primary data.
[2025-10-24T18:31:02.781022] [DEBUG] [LOCAL     ] EICC: No primary data file found to delete.
[2025-10-24T18:31:02.781057] [INFO ] [LOCAL     ] EICC: Starting deletion of derivative data.
[2025-10-24T18:31:02.781180] [DEBUG] [LOCAL     ] EICC: Deleted derivative data file.
[2025-10-24T18:31:02.781248] [INFO ] [MAIN      ] Update Progress: 717/2366 symbols completed. EICC took 23.4s. Estimated remaining: 3h 29m 17s. Rate: 7.9 symbols/min
[2025-10-24T18:31:03.347715] [INFO ] [REMOTE    ] EICA: Fetching primary data for 2025-08.
[2025-10-24T18:31:03.908219] [INFO ] [REMOTE    ] EICA: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T18:31:04.036258] [INFO ] [REMOTE    ] EIG: Incremental fetch complete for 2025-05 (2.28 seconds).
[2025-10-24T18:31:04.147697] [INFO ] [REMOTE    ] EICA: Fetching primary data for 2025-09.
[2025-10-24T18:31:04.947702] [INFO ] [REMOTE    ] EIG: Fetching primary data for 2025-06.
[2025-10-24T18:31:05.174457] [INFO ] [REMOTE    ] EICA: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T18:31:05.356361] [INFO ] [REMOTE    ] EIX: Incremental fetch complete for 2025-01 (2.81 seconds).
[2025-10-24T18:31:05.747744] [INFO ] [REMOTE    ] EICA: Fetching primary data for 2025-10.
[2025-10-24T18:31:06.241049] [INFO ] [REMOTE    ] EICA: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T18:31:06.242055] [INFO ] [REMOTE    ] EICA: Full fetch complete (1190 records).
[2025-10-24T18:31:06.242140] [DEBUG] [VALIDATOR ] EICA: Validating primary data.
[2025-10-24T18:31:06.242605] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:31:06.242729] [FATAL] [MAIN      ] EICA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:31:06.242810] [WARN ] [MAIN      ] EICA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:31:06.242898] [INFO ] [LOCAL     ] EICA: Starting deletion of primary data.
[2025-10-24T18:31:06.242975] [DEBUG] [LOCAL     ] EICA: No primary data file found to delete.
[2025-10-24T18:31:06.243028] [INFO ] [LOCAL     ] EICA: Starting deletion of derivative data.
[2025-10-24T18:31:06.243086] [DEBUG] [LOCAL     ] EICA: No derivative data file found to delete.
[2025-10-24T18:31:06.243157] [INFO ] [MAIN      ] Update Progress: 718/2366 symbols completed. EICA took 37.7s. Estimated remaining: 3h 28m 60s. Rate: 7.9 symbols/min
[2025-10-24T18:31:06.265375] [INFO ] [REMOTE    ] EIG: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T18:31:06.547717] [INFO ] [REMOTE    ] EIX: Fetching primary data for 2025-02.
[2025-10-24T18:31:07.347743] [INFO ] [REMOTE    ] EIG: Fetching primary data for 2025-07.
[2025-10-24T18:31:08.443846] [INFO ] [REMOTE    ] EIX: Incremental fetch complete for 2025-02 (1.90 seconds).
[2025-10-24T18:31:08.454070] [INFO ] [REMOTE    ] EIX: Fetching primary data for 2025-03.
[2025-10-24T18:31:08.492312] [INFO ] [REMOTE    ] EIG: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T18:31:08.947834] [INFO ] [REMOTE    ] EIG: Fetching primary data for 2025-08.
[2025-10-24T18:31:10.392458] [INFO ] [REMOTE    ] EIG: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T18:31:10.398373] [INFO ] [REMOTE    ] EIG: Fetching primary data for 2025-09.
[2025-10-24T18:31:10.616577] [INFO ] [REMOTE    ] EIX: Incremental fetch complete for 2025-03 (2.16 seconds).
[2025-10-24T18:31:10.628176] [INFO ] [REMOTE    ] EIX: Fetching primary data for 2025-04.
[2025-10-24T18:31:11.493177] [INFO ] [REMOTE    ] EIG: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T18:31:11.498093] [INFO ] [REMOTE    ] EIG: Fetching primary data for 2025-10.
[2025-10-24T18:31:12.549518] [INFO ] [REMOTE    ] EIX: Incremental fetch complete for 2025-04 (1.92 seconds).
[2025-10-24T18:31:12.568516] [INFO ] [REMOTE    ] EIX: Fetching primary data for 2025-05.
[2025-10-24T18:31:12.569345] [INFO ] [REMOTE    ] EIG: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T18:31:12.573479] [INFO ] [REMOTE    ] EIG: Full fetch complete (27321 records).
[2025-10-24T18:31:12.573555] [DEBUG] [VALIDATOR ] EIG: Validating primary data.
[2025-10-24T18:31:12.951455] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present.
[2025-10-24T18:31:12.951562] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed.
[2025-10-24T18:31:12.952092] [INFO ] [MAIN      ] EIG: Fetched primary data is valid.
[2025-10-24T18:31:12.952151] [DEBUG] [LOCAL     ] EIG: Saving primary data.
[2025-10-24T18:31:12.952454] [FATAL] [LOCAL     ] EIG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:31:12.952546] [FATAL] [MAIN      ] EIG: Failed to save primary data.
[2025-10-24T18:31:12.952588] [WARN ] [MAIN      ] EIG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:31:12.952623] [INFO ] [LOCAL     ] EIG: Starting deletion of primary data.
[2025-10-24T18:31:12.952729] [DEBUG] [LOCAL     ] EIG: No primary data file found to delete.
[2025-10-24T18:31:12.952776] [INFO ] [LOCAL     ] EIG: Starting deletion of derivative data.
[2025-10-24T18:31:12.953094] [DEBUG] [LOCAL     ] EIG: Deleted derivative data file.
[2025-10-24T18:31:12.953173] [INFO ] [MAIN      ] Update Progress: 719/2366 symbols completed. EIG took 25.5s. Estimated remaining: 3h 28m 50s. Rate: 7.9 symbols/min
[2025-10-24T18:31:14.580285] [INFO ] [REMOTE    ] EIX: Incremental fetch complete for 2025-05 (2.01 seconds).
[2025-10-24T18:31:14.591450] [INFO ] [REMOTE    ] EIX: Fetching primary data for 2025-06.
[2025-10-24T18:31:16.532285] [INFO ] [REMOTE    ] EIX: Incremental fetch complete for 2025-06 (1.94 seconds).
[2025-10-24T18:31:16.543400] [INFO ] [REMOTE    ] EIX: Fetching primary data for 2025-07.
[2025-10-24T18:31:18.599531] [INFO ] [REMOTE    ] EIX: Incremental fetch complete for 2025-07 (2.06 seconds).
[2025-10-24T18:31:18.611638] [INFO ] [REMOTE    ] EIX: Fetching primary data for 2025-08.
[2025-10-24T18:31:20.620602] [INFO ] [REMOTE    ] EIX: Incremental fetch complete for 2025-08 (2.01 seconds).
[2025-10-24T18:31:20.631891] [INFO ] [REMOTE    ] EIX: Fetching primary data for 2025-09.
[2025-10-24T18:31:22.387571] [INFO ] [REMOTE    ] EIX: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T18:31:22.398871] [INFO ] [REMOTE    ] EIX: Fetching primary data for 2025-10.
[2025-10-24T18:31:24.037136] [INFO ] [REMOTE    ] EIX: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T18:31:24.048392] [INFO ] [REMOTE    ] EIX: Full fetch complete (77450 records).
[2025-10-24T18:31:24.048563] [DEBUG] [VALIDATOR ] EIX: Validating primary data.
[2025-10-24T18:31:24.470154] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present.
[2025-10-24T18:31:24.470302] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed.
[2025-10-24T18:31:24.471270] [INFO ] [MAIN      ] EIX: Fetched primary data is valid.
[2025-10-24T18:31:24.471338] [DEBUG] [LOCAL     ] EIX: Saving primary data.
[2025-10-24T18:31:24.472031] [FATAL] [LOCAL     ] EIX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:31:24.472177] [FATAL] [MAIN      ] EIX: Failed to save primary data.
[2025-10-24T18:31:24.472219] [WARN ] [MAIN      ] EIX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:31:24.472255] [INFO ] [LOCAL     ] EIX: Starting deletion of primary data.
[2025-10-24T18:31:24.472309] [DEBUG] [LOCAL     ] EIX: No primary data file found to delete.
[2025-10-24T18:31:24.472344] [INFO ] [LOCAL     ] EIX: Starting deletion of derivative data.
[2025-10-24T18:31:24.472630] [DEBUG] [LOCAL     ] EIX: Deleted derivative data file.
[2025-10-24T18:31:24.473181] [INFO ] [MAIN      ] Update Progress: 720/2366 symbols completed. EIX took 22.8s. Estimated remaining: 3h 28m 51s. Rate: 7.9 symbols/min
[2025-10-24T18:31:25.193429] [INFO ] [MAIN      ] ELF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:31:25.209178] [INFO ] [MAIN      ] EL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:31:25.255078] [INFO ] [MAIN      ] ELAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:31:25.283023] [INFO ] [MAIN      ] ELC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:31:25.289774] [DEBUG] [LOCAL     ] ELC: Loaded 3459 existing records from primary storage.
[2025-10-24T18:31:25.290180] [INFO ] [MAIN      ] ELC: Loaded 3459 existing records.
[2025-10-24T18:31:25.494687] [WARN ] [MAIN      ] ELC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:31:25.507439] [INFO ] [MAIN      ] ELC: Wiping existing primary data before full refresh.
[2025-10-24T18:31:25.507503] [INFO ] [LOCAL     ] ELC: Starting deletion of primary data.
[2025-10-24T18:31:25.507709] [DEBUG] [LOCAL     ] ELC: Deleted primary data file.
[2025-10-24T18:31:25.507793] [INFO ] [MAIN      ] ELC: Starting full primary refresh.
[2025-10-24T18:31:25.650090] [DEBUG] [LOCAL     ] EL: Loaded 53769 existing records from primary storage.
[2025-10-24T18:31:25.695197] [INFO ] [MAIN      ] EL: Loaded 53769 existing records.
[2025-10-24T18:31:25.770943] [DEBUG] [LOCAL     ] ELAN: Loaded 53699 existing records from primary storage.
[2025-10-24T18:31:25.811334] [DEBUG] [LOCAL     ] ELF: Loaded 52226 existing records from primary storage.
[2025-10-24T18:31:25.807998] [INFO ] [MAIN      ] ELAN: Loaded 53699 existing records.
[2025-10-24T18:31:25.838507] [INFO ] [MAIN      ] ELF: Loaded 52226 existing records.
[2025-10-24T18:31:26.297071] [WARN ] [MAIN      ] EL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:31:26.436957] [INFO ] [MAIN      ] EL: Wiping existing primary data before full refresh.
[2025-10-24T18:31:26.433570] [WARN ] [MAIN      ] ELAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:31:26.463090] [INFO ] [LOCAL     ] EL: Starting deletion of primary data.
[2025-10-24T18:31:26.482951] [INFO ] [REMOTE    ] ELC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:31:26.494260] [INFO ] [REMOTE    ] ELC: Fetching primary data for 2025-01.
[2025-10-24T18:31:26.521427] [DEBUG] [LOCAL     ] EL: Deleted primary data file.
[2025-10-24T18:31:26.521775] [INFO ] [MAIN      ] ELAN: Wiping existing primary data before full refresh.
[2025-10-24T18:31:26.522758] [INFO ] [MAIN      ] EL: Starting full primary refresh.
[2025-10-24T18:31:26.523446] [INFO ] [LOCAL     ] ELAN: Starting deletion of primary data.
[2025-10-24T18:31:26.526379] [WARN ] [MAIN      ] ELF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:31:26.562748] [DEBUG] [LOCAL     ] ELAN: Deleted primary data file.
[2025-10-24T18:31:26.571629] [INFO ] [MAIN      ] ELF: Wiping existing primary data before full refresh.
[2025-10-24T18:31:26.590816] [INFO ] [MAIN      ] ELAN: Starting full primary refresh.
[2025-10-24T18:31:26.596880] [INFO ] [LOCAL     ] ELF: Starting deletion of primary data.
[2025-10-24T18:31:26.631891] [DEBUG] [LOCAL     ] ELF: Deleted primary data file.
[2025-10-24T18:31:26.653318] [INFO ] [MAIN      ] ELF: Starting full primary refresh.
[2025-10-24T18:31:27.318451] [INFO ] [REMOTE    ] ELC: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T18:31:27.348588] [INFO ] [REMOTE    ] ELC: Fetching primary data for 2025-02.
[2025-10-24T18:31:27.544334] [INFO ] [REMOTE    ] EL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:31:27.563441] [INFO ] [REMOTE    ] EL: Fetching primary data for 2025-01.
[2025-10-24T18:31:27.709382] [INFO ] [REMOTE    ] ELF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:31:27.725779] [INFO ] [REMOTE    ] ELF: Fetching primary data for 2025-01.
[2025-10-24T18:31:27.730188] [INFO ] [REMOTE    ] ELAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:31:27.730566] [INFO ] [REMOTE    ] ELAN: Fetching primary data for 2025-01.
[2025-10-24T18:31:27.978416] [INFO ] [REMOTE    ] ELC: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T18:31:27.980439] [INFO ] [REMOTE    ] ELC: Fetching primary data for 2025-03.
[2025-10-24T18:31:28.537217] [INFO ] [REMOTE    ] ELC: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T18:31:28.538552] [INFO ] [REMOTE    ] ELC: Fetching primary data for 2025-04.
[2025-10-24T18:31:29.127251] [INFO ] [REMOTE    ] ELC: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T18:31:29.128791] [INFO ] [REMOTE    ] ELC: Fetching primary data for 2025-05.
[2025-10-24T18:31:29.432710] [INFO ] [REMOTE    ] EL: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T18:31:29.443403] [INFO ] [REMOTE    ] EL: Fetching primary data for 2025-02.
[2025-10-24T18:31:29.563061] [INFO ] [REMOTE    ] ELAN: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T18:31:29.573439] [INFO ] [REMOTE    ] ELAN: Fetching primary data for 2025-02.
[2025-10-24T18:31:29.637887] [INFO ] [REMOTE    ] ELF: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T18:31:29.647899] [INFO ] [REMOTE    ] ELF: Fetching primary data for 2025-02.
[2025-10-24T18:31:29.708746] [INFO ] [REMOTE    ] ELC: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T18:31:29.710270] [INFO ] [REMOTE    ] ELC: Fetching primary data for 2025-06.
[2025-10-24T18:31:30.334815] [INFO ] [REMOTE    ] ELC: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T18:31:30.336305] [INFO ] [REMOTE    ] ELC: Fetching primary data for 2025-07.
[2025-10-24T18:31:30.883754] [INFO ] [REMOTE    ] ELC: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T18:31:30.885415] [INFO ] [REMOTE    ] ELC: Fetching primary data for 2025-08.
[2025-10-24T18:31:31.128103] [INFO ] [REMOTE    ] ELAN: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T18:31:31.138352] [INFO ] [REMOTE    ] ELAN: Fetching primary data for 2025-03.
[2025-10-24T18:31:31.311812] [INFO ] [REMOTE    ] ELC: Incremental fetch complete for 2025-08 (0.43 seconds).
[2025-10-24T18:31:31.313342] [INFO ] [REMOTE    ] ELC: Fetching primary data for 2025-09.
[2025-10-24T18:31:31.504747] [INFO ] [REMOTE    ] EL: Incremental fetch complete for 2025-02 (2.06 seconds).
[2025-10-24T18:31:31.515471] [INFO ] [REMOTE    ] EL: Fetching primary data for 2025-03.
[2025-10-24T18:31:31.550012] [INFO ] [REMOTE    ] ELF: Incremental fetch complete for 2025-02 (1.90 seconds).
[2025-10-24T18:31:31.560533] [INFO ] [REMOTE    ] ELF: Fetching primary data for 2025-03.
[2025-10-24T18:31:31.875288] [INFO ] [REMOTE    ] ELC: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T18:31:31.876719] [INFO ] [REMOTE    ] ELC: Fetching primary data for 2025-10.
[2025-10-24T18:31:32.399079] [INFO ] [REMOTE    ] ELC: Incremental fetch complete for 2025-10 (0.52 seconds).
[2025-10-24T18:31:32.400209] [INFO ] [REMOTE    ] ELC: Full fetch complete (4917 records).
[2025-10-24T18:31:32.400301] [DEBUG] [VALIDATOR ] ELC: Validating primary data.
[2025-10-24T18:31:32.608346] [INFO ] [REMOTE    ] ELAN: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T18:31:32.715843] [INFO ] [REMOTE    ] ELAN: Fetching primary data for 2025-04.
[2025-10-24T18:31:32.802776] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present.
[2025-10-24T18:31:32.802845] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed.
[2025-10-24T18:31:32.802987] [INFO ] [MAIN      ] ELC: Fetched primary data is valid.
[2025-10-24T18:31:32.803024] [DEBUG] [LOCAL     ] ELC: Saving primary data.
[2025-10-24T18:31:32.803197] [FATAL] [LOCAL     ] ELC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:31:32.803272] [FATAL] [MAIN      ] ELC: Failed to save primary data.
[2025-10-24T18:31:32.803312] [WARN ] [MAIN      ] ELC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:31:32.803375] [INFO ] [LOCAL     ] ELC: Starting deletion of primary data.
[2025-10-24T18:31:32.803449] [DEBUG] [LOCAL     ] ELC: No primary data file found to delete.
[2025-10-24T18:31:32.803503] [INFO ] [LOCAL     ] ELC: Starting deletion of derivative data.
[2025-10-24T18:31:32.803933] [DEBUG] [LOCAL     ] ELC: Deleted derivative data file.
[2025-10-24T18:31:32.804041] [INFO ] [MAIN      ] Update Progress: 721/2366 symbols completed. ELC took 8.3s. Estimated remaining: 3h 28m 46s. Rate: 7.9 symbols/min
[2025-10-24T18:31:32.970125] [INFO ] [MAIN      ] ELME: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:31:33.012011] [DEBUG] [LOCAL     ] ELME: Loaded 39574 existing records from primary storage.
[2025-10-24T18:31:33.012295] [INFO ] [MAIN      ] ELME: Loaded 39574 existing records.
[2025-10-24T18:31:33.188143] [WARN ] [MAIN      ] ELME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:31:33.188321] [INFO ] [MAIN      ] ELME: Wiping existing primary data before full refresh.
[2025-10-24T18:31:33.188368] [INFO ] [LOCAL     ] ELME: Starting deletion of primary data.
[2025-10-24T18:31:33.188631] [DEBUG] [LOCAL     ] ELME: Deleted primary data file.
[2025-10-24T18:31:33.188718] [INFO ] [MAIN      ] ELME: Starting full primary refresh.
[2025-10-24T18:31:33.550574] [INFO ] [REMOTE    ] ELME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:31:33.551324] [INFO ] [REMOTE    ] ELME: Fetching primary data for 2025-01.
[2025-10-24T18:31:33.610579] [INFO ] [REMOTE    ] EL: Incremental fetch complete for 2025-03 (2.10 seconds).
[2025-10-24T18:31:33.748592] [INFO ] [REMOTE    ] ELF: Incremental fetch complete for 2025-03 (2.19 seconds).
[2025-10-24T18:31:33.748707] [INFO ] [REMOTE    ] EL: Fetching primary data for 2025-04.
[2025-10-24T18:31:34.055323] [INFO ] [REMOTE    ] ELAN: Incremental fetch complete for 2025-04 (1.34 seconds).
[2025-10-24T18:31:34.547632] [INFO ] [REMOTE    ] ELAN: Fetching primary data for 2025-05.
[2025-10-24T18:31:34.909494] [INFO ] [REMOTE    ] ELME: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T18:31:35.347697] [INFO ] [REMOTE    ] ELME: Fetching primary data for 2025-02.
[2025-10-24T18:31:35.590177] [INFO ] [REMOTE    ] EL: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T18:31:35.944676] [INFO ] [REMOTE    ] ELAN: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T18:31:36.147692] [INFO ] [REMOTE    ] ELF: Fetching primary data for 2025-04.
[2025-10-24T18:31:36.602846] [INFO ] [REMOTE    ] ELME: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T18:31:36.947684] [INFO ] [REMOTE    ] ELME: Fetching primary data for 2025-03.
[2025-10-24T18:31:37.747683] [INFO ] [REMOTE    ] EL: Fetching primary data for 2025-05.
[2025-10-24T18:31:38.426009] [INFO ] [REMOTE    ] ELME: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T18:31:38.453589] [INFO ] [REMOTE    ] ELF: Incremental fetch complete for 2025-04 (2.31 seconds).
[2025-10-24T18:31:38.547603] [INFO ] [REMOTE    ] ELF: Fetching primary data for 2025-05.
[2025-10-24T18:31:39.347612] [INFO ] [REMOTE    ] ELAN: Fetching primary data for 2025-06.
[2025-10-24T18:31:39.877428] [INFO ] [REMOTE    ] EL: Incremental fetch complete for 2025-05 (2.13 seconds).
[2025-10-24T18:31:40.147710] [INFO ] [REMOTE    ] EL: Fetching primary data for 2025-06.
[2025-10-24T18:31:40.644027] [INFO ] [REMOTE    ] ELF: Incremental fetch complete for 2025-05 (2.10 seconds).
[2025-10-24T18:31:40.947700] [INFO ] [REMOTE    ] ELME: Fetching primary data for 2025-04.
[2025-10-24T18:31:41.029334] [INFO ] [REMOTE    ] ELAN: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T18:31:41.747696] [INFO ] [REMOTE    ] ELAN: Fetching primary data for 2025-07.
[2025-10-24T18:31:42.008828] [INFO ] [REMOTE    ] EL: Incremental fetch complete for 2025-06 (1.86 seconds).
[2025-10-24T18:31:42.453179] [INFO ] [REMOTE    ] ELME: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T18:31:42.547699] [INFO ] [REMOTE    ] ELME: Fetching primary data for 2025-05.
[2025-10-24T18:31:43.319168] [INFO ] [REMOTE    ] ELAN: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T18:31:43.347610] [INFO ] [REMOTE    ] ELAN: Fetching primary data for 2025-08.
[2025-10-24T18:31:43.928444] [INFO ] [REMOTE    ] ELME: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T18:31:44.147670] [INFO ] [REMOTE    ] ELME: Fetching primary data for 2025-06.
[2025-10-24T18:31:44.947695] [INFO ] [REMOTE    ] EL: Fetching primary data for 2025-07.
[2025-10-24T18:31:45.121900] [INFO ] [REMOTE    ] ELAN: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T18:31:45.619877] [INFO ] [REMOTE    ] ELME: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T18:31:45.747636] [INFO ] [REMOTE    ] ELF: Fetching primary data for 2025-06.
[2025-10-24T18:31:46.547683] [INFO ] [REMOTE    ] ELME: Fetching primary data for 2025-07.
[2025-10-24T18:31:46.815805] [INFO ] [REMOTE    ] EL: Incremental fetch complete for 2025-07 (1.87 seconds).
[2025-10-24T18:31:47.347626] [INFO ] [REMOTE    ] EL: Fetching primary data for 2025-08.
[2025-10-24T18:31:47.798662] [INFO ] [REMOTE    ] ELF: Incremental fetch complete for 2025-06 (2.05 seconds).
[2025-10-24T18:31:47.833708] [INFO ] [REMOTE    ] ELME: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T18:31:48.147672] [INFO ] [REMOTE    ] ELF: Fetching primary data for 2025-07.
[2025-10-24T18:31:48.947638] [INFO ] [REMOTE    ] ELAN: Fetching primary data for 2025-09.
[2025-10-24T18:31:49.196373] [INFO ] [REMOTE    ] EL: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T18:31:49.747677] [INFO ] [REMOTE    ] ELME: Fetching primary data for 2025-08.
[2025-10-24T18:31:50.030616] [INFO ] [REMOTE    ] ELF: Incremental fetch complete for 2025-07 (1.88 seconds).
[2025-10-24T18:31:50.212535] [INFO ] [REMOTE    ] ELAN: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T18:31:50.547672] [INFO ] [REMOTE    ] ELF: Fetching primary data for 2025-08.
[2025-10-24T18:31:51.259037] [INFO ] [REMOTE    ] ELME: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T18:31:51.347701] [INFO ] [REMOTE    ] EL: Fetching primary data for 2025-09.
[2025-10-24T18:31:52.147624] [INFO ] [REMOTE    ] ELAN: Fetching primary data for 2025-10.
[2025-10-24T18:31:52.477081] [INFO ] [REMOTE    ] ELF: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T18:31:52.947681] [INFO ] [REMOTE    ] ELME: Fetching primary data for 2025-09.
[2025-10-24T18:31:53.105353] [INFO ] [REMOTE    ] EL: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T18:31:53.747722] [INFO ] [REMOTE    ] EL: Fetching primary data for 2025-10.
[2025-10-24T18:31:53.995986] [INFO ] [REMOTE    ] ELAN: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T18:31:54.009278] [INFO ] [REMOTE    ] ELAN: Full fetch complete (76704 records).
[2025-10-24T18:31:54.009452] [DEBUG] [VALIDATOR ] ELAN: Validating primary data.
[2025-10-24T18:31:54.010463] [FATAL] [VALIDATOR ] ELAN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:31:54.010593] [FATAL] [MAIN      ] ELAN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:31:54.010687] [WARN ] [MAIN      ] ELAN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:31:54.010766] [INFO ] [LOCAL     ] ELAN: Starting deletion of primary data.
[2025-10-24T18:31:54.010871] [DEBUG] [LOCAL     ] ELAN: No primary data file found to delete.
[2025-10-24T18:31:54.010946] [INFO ] [LOCAL     ] ELAN: Starting deletion of derivative data.
[2025-10-24T18:31:54.011212] [DEBUG] [LOCAL     ] ELAN: Deleted derivative data file.
[2025-10-24T18:31:54.011834] [INFO ] [MAIN      ] Update Progress: 722/2366 symbols completed. ELAN took 29.5s. Estimated remaining: 3h 29m 9s. Rate: 7.9 symbols/min
[2025-10-24T18:31:54.203737] [INFO ] [MAIN      ] ELP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:31:54.234686] [DEBUG] [LOCAL     ] ELP: Loaded 25729 existing records from primary storage.
[2025-10-24T18:31:54.234994] [INFO ] [MAIN      ] ELP: Loaded 25729 existing records.
[2025-10-24T18:31:54.425028] [WARN ] [MAIN      ] ELP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:31:54.425338] [INFO ] [MAIN      ] ELP: Wiping existing primary data before full refresh.
[2025-10-24T18:31:54.425491] [INFO ] [LOCAL     ] ELP: Starting deletion of primary data.
[2025-10-24T18:31:54.425905] [DEBUG] [LOCAL     ] ELP: Deleted primary data file.
[2025-10-24T18:31:54.426038] [INFO ] [MAIN      ] ELP: Starting full primary refresh.
[2025-10-24T18:31:54.551914] [INFO ] [REMOTE    ] ELF: Fetching primary data for 2025-09.
[2025-10-24T18:31:54.565440] [INFO ] [REMOTE    ] ELME: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T18:31:54.843450] [INFO ] [REMOTE    ] ELP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:31:55.347635] [INFO ] [REMOTE    ] ELME: Fetching primary data for 2025-10.
[2025-10-24T18:31:55.567242] [INFO ] [REMOTE    ] EL: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T18:31:55.577979] [INFO ] [REMOTE    ] EL: Full fetch complete (77429 records).
[2025-10-24T18:31:55.578143] [DEBUG] [VALIDATOR ] EL: Validating primary data.
[2025-10-24T18:31:55.978171] [DEBUG] [VALIDATOR ] EL: All expected trading days are present.
[2025-10-24T18:31:55.978268] [DEBUG] [VALIDATOR ] EL: Primary data validation passed.
[2025-10-24T18:31:55.979269] [INFO ] [MAIN      ] EL: Fetched primary data is valid.
[2025-10-24T18:31:55.979332] [DEBUG] [LOCAL     ] EL: Saving primary data.
[2025-10-24T18:31:55.980059] [FATAL] [LOCAL     ] EL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:31:55.980155] [FATAL] [MAIN      ] EL: Failed to save primary data.
[2025-10-24T18:31:55.980197] [WARN ] [MAIN      ] EL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:31:55.980233] [INFO ] [LOCAL     ] EL: Starting deletion of primary data.
[2025-10-24T18:31:55.980290] [DEBUG] [LOCAL     ] EL: No primary data file found to delete.
[2025-10-24T18:31:55.980325] [INFO ] [LOCAL     ] EL: Starting deletion of derivative data.
[2025-10-24T18:31:55.980456] [DEBUG] [LOCAL     ] EL: Deleted derivative data file.
[2025-10-24T18:31:55.980926] [INFO ] [MAIN      ] Update Progress: 723/2366 symbols completed. EL took 31.5s. Estimated remaining: 3h 28m 48s. Rate: 7.9 symbols/min
[2025-10-24T18:31:56.154139] [INFO ] [REMOTE    ] ELP: Fetching primary data for 2025-01.
[2025-10-24T18:31:56.154075] [INFO ] [MAIN      ] ELPC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:31:56.154326] [DEBUG] [LOCAL     ] ELPC: No existing data file found in primary storage.
[2025-10-24T18:31:56.154397] [WARN ] [MAIN      ] ELPC: No existing data found, performing full refresh instead.
[2025-10-24T18:31:56.155251] [INFO ] [MAIN      ] ELPC: Wiping existing primary data before full refresh.
[2025-10-24T18:31:56.155301] [INFO ] [LOCAL     ] ELPC: Starting deletion of primary data.
[2025-10-24T18:31:56.155346] [DEBUG] [LOCAL     ] ELPC: No primary data file found to delete.
[2025-10-24T18:31:56.155378] [INFO ] [MAIN      ] ELPC: Starting full primary refresh.
[2025-10-24T18:31:56.522756] [INFO ] [REMOTE    ] ELPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:31:56.556612] [INFO ] [REMOTE    ] ELF: Incremental fetch complete for 2025-09 (2.00 seconds).
[2025-10-24T18:31:56.588769] [INFO ] [REMOTE    ] ELME: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T18:31:56.596556] [INFO ] [REMOTE    ] ELME: Full fetch complete (56119 records).
[2025-10-24T18:31:56.596782] [DEBUG] [VALIDATOR ] ELME: Validating primary data.
[2025-10-24T18:31:56.955626] [INFO ] [REMOTE    ] ELPC: Fetching primary data for 2025-01.
[2025-10-24T18:31:56.975517] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present.
[2025-10-24T18:31:56.975586] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed.
[2025-10-24T18:31:56.976323] [INFO ] [MAIN      ] ELME: Fetched primary data is valid.
[2025-10-24T18:31:56.976384] [DEBUG] [LOCAL     ] ELME: Saving primary data.
[2025-10-24T18:31:56.976900] [FATAL] [LOCAL     ] ELME: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:31:56.977010] [FATAL] [MAIN      ] ELME: Failed to save primary data.
[2025-10-24T18:31:56.977078] [WARN ] [MAIN      ] ELME: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:31:56.977167] [INFO ] [LOCAL     ] ELME: Starting deletion of primary data.
[2025-10-24T18:31:56.977226] [DEBUG] [LOCAL     ] ELME: No primary data file found to delete.
[2025-10-24T18:31:56.977262] [INFO ] [LOCAL     ] ELME: Starting deletion of derivative data.
[2025-10-24T18:31:56.977382] [DEBUG] [LOCAL     ] ELME: Deleted derivative data file.
[2025-10-24T18:31:56.977851] [INFO ] [MAIN      ] Update Progress: 724/2366 symbols completed. ELME took 24.2s. Estimated remaining: 3h 28m 26s. Rate: 7.9 symbols/min
[2025-10-24T18:31:57.150857] [INFO ] [MAIN      ] ELS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:31:57.210263] [INFO ] [REMOTE    ] ELP: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T18:31:57.217085] [DEBUG] [LOCAL     ] ELS: Loaded 50237 existing records from primary storage.
[2025-10-24T18:31:57.217358] [INFO ] [MAIN      ] ELS: Loaded 50237 existing records.
[2025-10-24T18:31:57.392859] [WARN ] [MAIN      ] ELS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:31:57.393041] [INFO ] [MAIN      ] ELS: Wiping existing primary data before full refresh.
[2025-10-24T18:31:57.393086] [INFO ] [LOCAL     ] ELS: Starting deletion of primary data.
[2025-10-24T18:31:57.393603] [DEBUG] [LOCAL     ] ELS: Deleted primary data file.
[2025-10-24T18:31:57.393672] [INFO ] [MAIN      ] ELS: Starting full primary refresh.
[2025-10-24T18:31:57.748993] [INFO ] [REMOTE    ] ELP: Fetching primary data for 2025-02.
[2025-10-24T18:31:57.732788] [INFO ] [REMOTE    ] ELPC: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T18:31:57.755133] [INFO ] [REMOTE    ] ELS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:31:58.547676] [INFO ] [REMOTE    ] ELS: Fetching primary data for 2025-01.
[2025-10-24T18:31:58.794234] [INFO ] [REMOTE    ] ELP: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T18:31:59.347626] [INFO ] [REMOTE    ] ELPC: Fetching primary data for 2025-02.
[2025-10-24T18:31:59.684965] [INFO ] [REMOTE    ] ELPC: Incremental fetch complete for 2025-02 (0.34 seconds).
[2025-10-24T18:32:00.107043] [INFO ] [REMOTE    ] ELS: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T18:32:00.147601] [INFO ] [REMOTE    ] ELS: Fetching primary data for 2025-02.
[2025-10-24T18:32:00.947727] [INFO ] [REMOTE    ] ELPC: Fetching primary data for 2025-03.
[2025-10-24T18:32:01.747616] [INFO ] [REMOTE    ] ELP: Fetching primary data for 2025-03.
[2025-10-24T18:32:01.769165] [INFO ] [REMOTE    ] ELPC: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T18:32:02.229705] [INFO ] [REMOTE    ] ELS: Incremental fetch complete for 2025-02 (2.08 seconds).
[2025-10-24T18:32:02.547632] [INFO ] [REMOTE    ] ELPC: Fetching primary data for 2025-04.
[2025-10-24T18:32:03.006444] [INFO ] [REMOTE    ] ELPC: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T18:32:03.347676] [INFO ] [REMOTE    ] ELS: Fetching primary data for 2025-03.
[2025-10-24T18:32:04.154226] [INFO ] [REMOTE    ] ELF: Fetching primary data for 2025-10.
[2025-10-24T18:32:04.157705] [INFO ] [REMOTE    ] ELP: Incremental fetch complete for 2025-03 (2.41 seconds).
[2025-10-24T18:32:04.947693] [INFO ] [REMOTE    ] ELP: Fetching primary data for 2025-04.
[2025-10-24T18:32:05.747701] [INFO ] [REMOTE    ] ELPC: Fetching primary data for 2025-05.
[2025-10-24T18:32:06.274588] [INFO ] [REMOTE    ] ELPC: Incremental fetch complete for 2025-05 (0.53 seconds).
[2025-10-24T18:32:06.445683] [INFO ] [REMOTE    ] ELF: Incremental fetch complete for 2025-10 (2.29 seconds).
[2025-10-24T18:32:06.454614] [INFO ] [REMOTE    ] ELF: Full fetch complete (75463 records).
[2025-10-24T18:32:06.454776] [DEBUG] [VALIDATOR ] ELF: Validating primary data.
[2025-10-24T18:32:06.553764] [INFO ] [REMOTE    ] ELPC: Fetching primary data for 2025-06.
[2025-10-24T18:32:06.737757] [INFO ] [REMOTE    ] ELS: Incremental fetch complete for 2025-03 (3.39 seconds).
[2025-10-24T18:32:06.896121] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present.
[2025-10-24T18:32:06.896212] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed.
[2025-10-24T18:32:06.897133] [INFO ] [MAIN      ] ELF: Fetched primary data is valid.
[2025-10-24T18:32:06.897214] [DEBUG] [LOCAL     ] ELF: Saving primary data.
[2025-10-24T18:32:06.903201] [FATAL] [LOCAL     ] ELF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:32:06.912739] [FATAL] [MAIN      ] ELF: Failed to save primary data.
[2025-10-24T18:32:06.913254] [INFO ] [REMOTE    ] ELP: Incremental fetch complete for 2025-04 (1.97 seconds).
[2025-10-24T18:32:06.919004] [WARN ] [MAIN      ] ELF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:32:06.921184] [INFO ] [REMOTE    ] ELPC: Incremental fetch complete for 2025-06 (0.37 seconds).
[2025-10-24T18:32:06.921105] [INFO ] [LOCAL     ] ELF: Starting deletion of primary data.
[2025-10-24T18:32:06.921467] [DEBUG] [LOCAL     ] ELF: No primary data file found to delete.
[2025-10-24T18:32:06.922612] [INFO ] [LOCAL     ] ELF: Starting deletion of derivative data.
[2025-10-24T18:32:06.922803] [DEBUG] [LOCAL     ] ELF: Deleted derivative data file.
[2025-10-24T18:32:06.923269] [INFO ] [MAIN      ] Update Progress: 725/2366 symbols completed. ELF took 42.4s. Estimated remaining: 3h 28m 23s. Rate: 7.9 symbols/min
[2025-10-24T18:32:07.091068] [INFO ] [MAIN      ] ELV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:32:07.141386] [DEBUG] [LOCAL     ] ELV: Loaded 51124 existing records from primary storage.
[2025-10-24T18:32:07.141704] [INFO ] [MAIN      ] ELV: Loaded 51124 existing records.
[2025-10-24T18:32:07.315862] [WARN ] [MAIN      ] ELV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:32:07.316058] [INFO ] [MAIN      ] ELV: Wiping existing primary data before full refresh.
[2025-10-24T18:32:07.316105] [INFO ] [LOCAL     ] ELV: Starting deletion of primary data.
[2025-10-24T18:32:07.316764] [DEBUG] [LOCAL     ] ELV: Deleted primary data file.
[2025-10-24T18:32:07.316822] [INFO ] [MAIN      ] ELV: Starting full primary refresh.
[2025-10-24T18:32:07.352810] [INFO ] [REMOTE    ] ELPC: Fetching primary data for 2025-07.
[2025-10-24T18:32:07.675754] [INFO ] [REMOTE    ] ELV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:32:07.803713] [INFO ] [REMOTE    ] ELPC: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T18:32:08.147670] [INFO ] [REMOTE    ] ELPC: Fetching primary data for 2025-08.
[2025-10-24T18:32:08.506879] [INFO ] [REMOTE    ] ELPC: Incremental fetch complete for 2025-08 (0.36 seconds).
[2025-10-24T18:32:08.947668] [INFO ] [REMOTE    ] ELV: Fetching primary data for 2025-01.
[2025-10-24T18:32:09.747731] [INFO ] [REMOTE    ] ELS: Fetching primary data for 2025-04.
[2025-10-24T18:32:10.547700] [INFO ] [REMOTE    ] ELPC: Fetching primary data for 2025-09.
[2025-10-24T18:32:10.649595] [INFO ] [REMOTE    ] ELV: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T18:32:10.975044] [INFO ] [REMOTE    ] ELPC: Incremental fetch complete for 2025-09 (0.43 seconds).
[2025-10-24T18:32:11.347705] [INFO ] [REMOTE    ] ELP: Fetching primary data for 2025-05.
[2025-10-24T18:32:11.403411] [INFO ] [REMOTE    ] ELS: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T18:32:12.147675] [INFO ] [REMOTE    ] ELPC: Fetching primary data for 2025-10.
[2025-10-24T18:32:12.455679] [INFO ] [REMOTE    ] ELP: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T18:32:12.666499] [INFO ] [REMOTE    ] ELPC: Incremental fetch complete for 2025-10 (0.52 seconds).
[2025-10-24T18:32:12.667268] [INFO ] [REMOTE    ] ELPC: Full fetch complete (1304 records).
[2025-10-24T18:32:12.667336] [DEBUG] [VALIDATOR ] ELPC: Validating primary data.
[2025-10-24T18:32:12.667691] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:32:12.667772] [FATAL] [MAIN      ] ELPC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:32:12.667813] [WARN ] [MAIN      ] ELPC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:32:12.667882] [INFO ] [LOCAL     ] ELPC: Starting deletion of primary data.
[2025-10-24T18:32:12.667975] [DEBUG] [LOCAL     ] ELPC: No primary data file found to delete.
[2025-10-24T18:32:12.668022] [INFO ] [LOCAL     ] ELPC: Starting deletion of derivative data.
[2025-10-24T18:32:12.668064] [DEBUG] [LOCAL     ] ELPC: No derivative data file found to delete.
[2025-10-24T18:32:12.668114] [INFO ] [MAIN      ] Update Progress: 726/2366 symbols completed. ELPC took 16.7s. Estimated remaining: 3h 28m 11s. Rate: 7.9 symbols/min
[2025-10-24T18:32:12.850916] [INFO ] [MAIN      ] EMA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:32:12.851122] [DEBUG] [LOCAL     ] EMA: No existing data file found in primary storage.
[2025-10-24T18:32:12.851171] [WARN ] [MAIN      ] EMA: No existing data found, performing full refresh instead.
[2025-10-24T18:32:12.851286] [INFO ] [MAIN      ] EMA: Wiping existing primary data before full refresh.
[2025-10-24T18:32:12.851329] [INFO ] [LOCAL     ] EMA: Starting deletion of primary data.
[2025-10-24T18:32:12.851372] [DEBUG] [LOCAL     ] EMA: No primary data file found to delete.
[2025-10-24T18:32:12.851414] [INFO ] [MAIN      ] EMA: Starting full primary refresh.
[2025-10-24T18:32:12.952835] [INFO ] [REMOTE    ] ELP: Fetching primary data for 2025-06.
[2025-10-24T18:32:13.215480] [INFO ] [REMOTE    ] EMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:32:13.747689] [INFO ] [REMOTE    ] ELV: Fetching primary data for 2025-02.
[2025-10-24T18:32:14.236270] [INFO ] [REMOTE    ] ELP: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T18:32:14.547738] [INFO ] [REMOTE    ] ELP: Fetching primary data for 2025-07.
[2025-10-24T18:32:15.347675] [INFO ] [REMOTE    ] EMA: Fetching primary data for 2025-01.
[2025-10-24T18:32:15.584514] [DEBUG] [REMOTE    ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T18:32:15.584901] [WARN ] [REMOTE    ] EMA: No data returned for month 2025-01
[2025-10-24T18:32:15.585019] [FATAL] [REMOTE    ] EMA: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:32:15.585104] [FATAL] [MAIN      ] EMA: Failed to fetch primary data.
[2025-10-24T18:32:15.585187] [WARN ] [MAIN      ] EMA: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:32:15.585275] [INFO ] [LOCAL     ] EMA: Starting deletion of primary data.
[2025-10-24T18:32:15.585364] [DEBUG] [LOCAL     ] EMA: No primary data file found to delete.
[2025-10-24T18:32:15.585438] [INFO ] [LOCAL     ] EMA: Starting deletion of derivative data.
[2025-10-24T18:32:15.585536] [DEBUG] [LOCAL     ] EMA: No derivative data file found to delete.
[2025-10-24T18:32:15.585629] [INFO ] [MAIN      ] Update Progress: 727/2366 symbols completed. EMA took 2.9s. Estimated remaining: 3h 27m 53s. Rate: 7.9 symbols/min
[2025-10-24T18:32:15.788348] [INFO ] [MAIN      ] EMD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:32:15.816067] [INFO ] [REMOTE    ] ELV: Incremental fetch complete for 2025-02 (2.07 seconds).
[2025-10-24T18:32:15.843394] [DEBUG] [LOCAL     ] EMD: Loaded 20887 existing records from primary storage.
[2025-10-24T18:32:15.843778] [INFO ] [MAIN      ] EMD: Loaded 20887 existing records.
[2025-10-24T18:32:16.052366] [WARN ] [MAIN      ] EMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:32:16.052782] [INFO ] [MAIN      ] EMD: Wiping existing primary data before full refresh.
[2025-10-24T18:32:16.052879] [INFO ] [LOCAL     ] EMD: Starting deletion of primary data.
[2025-10-24T18:32:16.053185] [DEBUG] [LOCAL     ] EMD: Deleted primary data file.
[2025-10-24T18:32:16.053234] [INFO ] [MAIN      ] EMD: Starting full primary refresh.
[2025-10-24T18:32:16.158909] [INFO ] [REMOTE    ] ELV: Fetching primary data for 2025-03.
[2025-10-24T18:32:16.215443] [INFO ] [REMOTE    ] ELP: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T18:32:16.540163] [INFO ] [REMOTE    ] EMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:32:16.947715] [INFO ] [REMOTE    ] EMD: Fetching primary data for 2025-01.
[2025-10-24T18:32:17.747761] [INFO ] [REMOTE    ] ELP: Fetching primary data for 2025-08.
[2025-10-24T18:32:18.059246] [INFO ] [REMOTE    ] ELV: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T18:32:18.108916] [INFO ] [REMOTE    ] EMD: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T18:32:18.547764] [INFO ] [REMOTE    ] EMD: Fetching primary data for 2025-02.
[2025-10-24T18:32:18.899762] [INFO ] [REMOTE    ] ELP: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T18:32:19.347627] [INFO ] [REMOTE    ] ELS: Fetching primary data for 2025-05.
[2025-10-24T18:32:19.365963] [INFO ] [REMOTE    ] EMD: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T18:32:20.147728] [INFO ] [REMOTE    ] EMD: Fetching primary data for 2025-03.
[2025-10-24T18:32:20.938725] [INFO ] [REMOTE    ] ELS: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T18:32:20.951853] [INFO ] [REMOTE    ] ELV: Fetching primary data for 2025-04.
[2025-10-24T18:32:21.382793] [INFO ] [REMOTE    ] EMD: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T18:32:21.747684] [INFO ] [REMOTE    ] ELP: Fetching primary data for 2025-09.
[2025-10-24T18:32:22.547697] [INFO ] [REMOTE    ] EMD: Fetching primary data for 2025-04.
[2025-10-24T18:32:22.671616] [INFO ] [REMOTE    ] ELP: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T18:32:22.798759] [INFO ] [REMOTE    ] ELV: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T18:32:23.336333] [INFO ] [REMOTE    ] EMD: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T18:32:23.347606] [INFO ] [REMOTE    ] EMD: Fetching primary data for 2025-05.
[2025-10-24T18:32:24.147623] [INFO ] [REMOTE    ] ELV: Fetching primary data for 2025-05.
[2025-10-24T18:32:24.388799] [INFO ] [REMOTE    ] EMD: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T18:32:24.947689] [INFO ] [REMOTE    ] EMD: Fetching primary data for 2025-06.
[2025-10-24T18:32:25.747703] [INFO ] [REMOTE    ] ELP: Fetching primary data for 2025-10.
[2025-10-24T18:32:26.023715] [INFO ] [REMOTE    ] EMD: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T18:32:26.226727] [INFO ] [REMOTE    ] ELV: Incremental fetch complete for 2025-05 (2.08 seconds).
[2025-10-24T18:32:26.547697] [INFO ] [REMOTE    ] EMD: Fetching primary data for 2025-07.
[2025-10-24T18:32:26.846489] [INFO ] [REMOTE    ] ELP: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T18:32:26.851075] [INFO ] [REMOTE    ] ELP: Full fetch complete (36715 records).
[2025-10-24T18:32:26.851163] [DEBUG] [VALIDATOR ] ELP: Validating primary data.
[2025-10-24T18:32:27.219737] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present.
[2025-10-24T18:32:27.219827] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed.
[2025-10-24T18:32:27.220425] [INFO ] [MAIN      ] ELP: Fetched primary data is valid.
[2025-10-24T18:32:27.220466] [DEBUG] [LOCAL     ] ELP: Saving primary data.
[2025-10-24T18:32:27.220915] [FATAL] [LOCAL     ] ELP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:32:27.221027] [FATAL] [MAIN      ] ELP: Failed to save primary data.
[2025-10-24T18:32:27.221069] [WARN ] [MAIN      ] ELP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:32:27.221103] [INFO ] [LOCAL     ] ELP: Starting deletion of primary data.
[2025-10-24T18:32:27.221151] [DEBUG] [LOCAL     ] ELP: No primary data file found to delete.
[2025-10-24T18:32:27.221186] [INFO ] [LOCAL     ] ELP: Starting deletion of derivative data.
[2025-10-24T18:32:27.221324] [DEBUG] [LOCAL     ] ELP: Deleted derivative data file.
[2025-10-24T18:32:27.221424] [INFO ] [MAIN      ] Update Progress: 728/2366 symbols completed. ELP took 33.2s. Estimated remaining: 3h 27m 55s. Rate: 7.9 symbols/min
[2025-10-24T18:32:27.360093] [INFO ] [REMOTE    ] ELS: Fetching primary data for 2025-06.
[2025-10-24T18:32:27.391113] [INFO ] [MAIN      ] EME: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:32:27.422834] [DEBUG] [LOCAL     ] EME: Loaded 30969 existing records from primary storage.
[2025-10-24T18:32:27.423089] [INFO ] [MAIN      ] EME: Loaded 30969 existing records.
[2025-10-24T18:32:27.600818] [WARN ] [MAIN      ] EME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:32:27.601049] [INFO ] [MAIN      ] EME: Wiping existing primary data before full refresh.
[2025-10-24T18:32:27.601115] [INFO ] [LOCAL     ] EME: Starting deletion of primary data.
[2025-10-24T18:32:27.601581] [DEBUG] [LOCAL     ] EME: Deleted primary data file.
[2025-10-24T18:32:27.601628] [INFO ] [MAIN      ] EME: Starting full primary refresh.
[2025-10-24T18:32:27.729949] [INFO ] [REMOTE    ] EMD: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T18:32:27.974061] [INFO ] [REMOTE    ] EME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:32:28.147634] [INFO ] [REMOTE    ] EME: Fetching primary data for 2025-01.
[2025-10-24T18:32:28.947630] [INFO ] [REMOTE    ] ELV: Fetching primary data for 2025-06.
[2025-10-24T18:32:29.050709] [INFO ] [REMOTE    ] ELS: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T18:32:29.616128] [INFO ] [REMOTE    ] EME: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T18:32:29.747600] [INFO ] [REMOTE    ] EME: Fetching primary data for 2025-02.
[2025-10-24T18:32:30.245373] [INFO ] [REMOTE    ] ELV: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T18:32:30.547682] [INFO ] [REMOTE    ] ELV: Fetching primary data for 2025-07.
[2025-10-24T18:32:30.768183] [INFO ] [REMOTE    ] EME: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T18:32:31.347619] [INFO ] [REMOTE    ] EME: Fetching primary data for 2025-03.
[2025-10-24T18:32:32.147637] [INFO ] [REMOTE    ] ELS: Fetching primary data for 2025-07.
[2025-10-24T18:32:32.808982] [INFO ] [REMOTE    ] ELV: Incremental fetch complete for 2025-07 (2.26 seconds).
[2025-10-24T18:32:32.947684] [INFO ] [REMOTE    ] EMD: Fetching primary data for 2025-08.
[2025-10-24T18:32:32.993175] [INFO ] [REMOTE    ] EME: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T18:32:33.747619] [INFO ] [REMOTE    ] ELV: Fetching primary data for 2025-08.
[2025-10-24T18:32:33.971895] [INFO ] [REMOTE    ] ELS: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T18:32:34.434118] [INFO ] [REMOTE    ] EMD: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T18:32:34.547677] [INFO ] [REMOTE    ] EMD: Fetching primary data for 2025-09.
[2025-10-24T18:32:35.347615] [INFO ] [REMOTE    ] EME: Fetching primary data for 2025-04.
[2025-10-24T18:32:35.558440] [INFO ] [REMOTE    ] EMD: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T18:32:35.722165] [INFO ] [REMOTE    ] ELV: Incremental fetch complete for 2025-08 (1.97 seconds).
[2025-10-24T18:32:36.147703] [INFO ] [REMOTE    ] EMD: Fetching primary data for 2025-10.
[2025-10-24T18:32:36.855954] [INFO ] [REMOTE    ] EME: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T18:32:36.947674] [INFO ] [REMOTE    ] ELS: Fetching primary data for 2025-08.
[2025-10-24T18:32:37.231836] [INFO ] [REMOTE    ] EMD: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T18:32:37.235839] [INFO ] [REMOTE    ] EMD: Full fetch complete (31801 records).
[2025-10-24T18:32:37.235933] [DEBUG] [VALIDATOR ] EMD: Validating primary data.
[2025-10-24T18:32:37.610629] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present.
[2025-10-24T18:32:37.610751] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed.
[2025-10-24T18:32:37.611374] [INFO ] [MAIN      ] EMD: Fetched primary data is valid.
[2025-10-24T18:32:37.611418] [DEBUG] [LOCAL     ] EMD: Saving primary data.
[2025-10-24T18:32:37.611891] [FATAL] [LOCAL     ] EMD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:32:37.611981] [FATAL] [MAIN      ] EMD: Failed to save primary data.
[2025-10-24T18:32:37.612027] [WARN ] [MAIN      ] EMD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:32:37.612064] [INFO ] [LOCAL     ] EMD: Starting deletion of primary data.
[2025-10-24T18:32:37.612121] [DEBUG] [LOCAL     ] EMD: No primary data file found to delete.
[2025-10-24T18:32:37.612159] [INFO ] [LOCAL     ] EMD: Starting deletion of derivative data.
[2025-10-24T18:32:37.612323] [DEBUG] [LOCAL     ] EMD: Deleted derivative data file.
[2025-10-24T18:32:37.612445] [INFO ] [MAIN      ] Update Progress: 729/2366 symbols completed. EMD took 22.0s. Estimated remaining: 3h 27m 53s. Rate: 7.9 symbols/min
[2025-10-24T18:32:37.754176] [INFO ] [REMOTE    ] ELV: Fetching primary data for 2025-09.
[2025-10-24T18:32:37.786022] [INFO ] [MAIN      ] EMF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:32:37.791601] [DEBUG] [LOCAL     ] EMF: Loaded 3111 existing records from primary storage.
[2025-10-24T18:32:37.792234] [INFO ] [MAIN      ] EMF: Loaded 3111 existing records.
[2025-10-24T18:32:37.975027] [WARN ] [MAIN      ] EMF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:32:37.975286] [INFO ] [MAIN      ] EMF: Wiping existing primary data before full refresh.
[2025-10-24T18:32:37.975338] [INFO ] [LOCAL     ] EMF: Starting deletion of primary data.
[2025-10-24T18:32:37.975548] [DEBUG] [LOCAL     ] EMF: Deleted primary data file.
[2025-10-24T18:32:37.975614] [INFO ] [MAIN      ] EMF: Starting full primary refresh.
[2025-10-24T18:32:38.356035] [INFO ] [REMOTE    ] EMF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:32:38.547624] [INFO ] [REMOTE    ] EMF: Fetching primary data for 2025-01.
[2025-10-24T18:32:38.663267] [INFO ] [REMOTE    ] ELS: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T18:32:39.347622] [INFO ] [REMOTE    ] ELS: Fetching primary data for 2025-09.
[2025-10-24T18:32:39.532440] [INFO ] [REMOTE    ] EMF: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T18:32:39.802721] [INFO ] [REMOTE    ] ELV: Incremental fetch complete for 2025-09 (2.05 seconds).
[2025-10-24T18:32:40.147680] [INFO ] [REMOTE    ] EMF: Fetching primary data for 2025-02.
[2025-10-24T18:32:40.796910] [INFO ] [REMOTE    ] EMF: Incremental fetch complete for 2025-02 (0.65 seconds).
[2025-10-24T18:32:40.947687] [INFO ] [REMOTE    ] ELV: Fetching primary data for 2025-10.
[2025-10-24T18:32:41.067710] [INFO ] [REMOTE    ] ELS: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T18:32:41.747683] [INFO ] [REMOTE    ] ELS: Fetching primary data for 2025-10.
[2025-10-24T18:32:42.547696] [INFO ] [REMOTE    ] EME: Fetching primary data for 2025-05.
[2025-10-24T18:32:42.946671] [INFO ] [REMOTE    ] ELV: Incremental fetch complete for 2025-10 (2.00 seconds).
[2025-10-24T18:32:42.957431] [INFO ] [REMOTE    ] ELV: Full fetch complete (73349 records).
[2025-10-24T18:32:42.957724] [DEBUG] [VALIDATOR ] ELV: Validating primary data.
[2025-10-24T18:32:43.352421] [INFO ] [REMOTE    ] EMF: Fetching primary data for 2025-03.
[2025-10-24T18:32:43.375173] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present.
[2025-10-24T18:32:43.375283] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed.
[2025-10-24T18:32:43.376250] [INFO ] [MAIN      ] ELV: Fetched primary data is valid.
[2025-10-24T18:32:43.376484] [DEBUG] [LOCAL     ] ELV: Saving primary data.
[2025-10-24T18:32:43.377328] [FATAL] [LOCAL     ] ELV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:32:43.377418] [FATAL] [MAIN      ] ELV: Failed to save primary data.
[2025-10-24T18:32:43.377489] [WARN ] [MAIN      ] ELV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:32:43.377574] [INFO ] [LOCAL     ] ELV: Starting deletion of primary data.
[2025-10-24T18:32:43.377704] [DEBUG] [LOCAL     ] ELV: No primary data file found to delete.
[2025-10-24T18:32:43.377759] [INFO ] [LOCAL     ] ELV: Starting deletion of derivative data.
[2025-10-24T18:32:43.377937] [DEBUG] [LOCAL     ] ELV: Deleted derivative data file.
[2025-10-24T18:32:43.378614] [INFO ] [MAIN      ] Update Progress: 730/2366 symbols completed. ELV took 36.5s. Estimated remaining: 3h 27m 42s. Rate: 7.9 symbols/min
[2025-10-24T18:32:43.562915] [INFO ] [MAIN      ] EMN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:32:43.581559] [INFO ] [REMOTE    ] ELS: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T18:32:43.591534] [INFO ] [REMOTE    ] ELS: Full fetch complete (71376 records).
[2025-10-24T18:32:43.591796] [DEBUG] [VALIDATOR ] ELS: Validating primary data.
[2025-10-24T18:32:43.968610] [DEBUG] [LOCAL     ] EMN: Loaded 51204 existing records from primary storage.
[2025-10-24T18:32:44.007782] [INFO ] [MAIN      ] EMN: Loaded 51204 existing records.
[2025-10-24T18:32:44.078859] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present.
[2025-10-24T18:32:44.111282] [INFO ] [REMOTE    ] EMF: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T18:32:44.111378] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed.
[2025-10-24T18:32:44.166549] [INFO ] [REMOTE    ] EMF: Fetching primary data for 2025-04.
[2025-10-24T18:32:44.165690] [INFO ] [MAIN      ] ELS: Fetched primary data is valid.
[2025-10-24T18:32:44.172061] [DEBUG] [LOCAL     ] ELS: Saving primary data.
[2025-10-24T18:32:44.178055] [FATAL] [LOCAL     ] ELS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:32:44.199143] [FATAL] [MAIN      ] ELS: Failed to save primary data.
[2025-10-24T18:32:44.222709] [WARN ] [MAIN      ] ELS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:32:44.234200] [INFO ] [LOCAL     ] ELS: Starting deletion of primary data.
[2025-10-24T18:32:44.255785] [WARN ] [MAIN      ] EMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:32:44.256241] [INFO ] [MAIN      ] EMN: Wiping existing primary data before full refresh.
[2025-10-24T18:32:44.255876] [DEBUG] [LOCAL     ] ELS: No primary data file found to delete.
[2025-10-24T18:32:44.256351] [INFO ] [LOCAL     ] EMN: Starting deletion of primary data.
[2025-10-24T18:32:44.256532] [INFO ] [LOCAL     ] ELS: Starting deletion of derivative data.
[2025-10-24T18:32:44.275328] [DEBUG] [LOCAL     ] EMN: Deleted primary data file.
[2025-10-24T18:32:44.275529] [INFO ] [MAIN      ] EMN: Starting full primary refresh.
[2025-10-24T18:32:44.275847] [DEBUG] [LOCAL     ] ELS: Deleted derivative data file.
[2025-10-24T18:32:44.281803] [INFO ] [MAIN      ] Update Progress: 731/2366 symbols completed. ELS took 47.3s. Estimated remaining: 3h 27m 19s. Rate: 7.9 symbols/min
[2025-10-24T18:32:44.321167] [INFO ] [REMOTE    ] EME: Incremental fetch complete for 2025-05 (1.77 seconds).
[2025-10-24T18:32:44.666996] [INFO ] [MAIN      ] EMO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:32:44.813166] [DEBUG] [LOCAL     ] EMO: Loaded 13427 existing records from primary storage.
[2025-10-24T18:32:44.853438] [INFO ] [REMOTE    ] EMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:32:44.858038] [INFO ] [MAIN      ] EMO: Loaded 13427 existing records.
[2025-10-24T18:32:44.859182] [INFO ] [REMOTE    ] EMF: Incremental fetch complete for 2025-04 (0.69 seconds).
[2025-10-24T18:32:44.952735] [INFO ] [REMOTE    ] EMN: Fetching primary data for 2025-01.
[2025-10-24T18:32:45.041451] [WARN ] [MAIN      ] EMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:32:45.041689] [INFO ] [MAIN      ] EMO: Wiping existing primary data before full refresh.
[2025-10-24T18:32:45.041766] [INFO ] [LOCAL     ] EMO: Starting deletion of primary data.
[2025-10-24T18:32:45.042007] [DEBUG] [LOCAL     ] EMO: Deleted primary data file.
[2025-10-24T18:32:45.042078] [INFO ] [MAIN      ] EMO: Starting full primary refresh.
[2025-10-24T18:32:45.409557] [INFO ] [REMOTE    ] EMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:32:45.747685] [INFO ] [REMOTE    ] EMO: Fetching primary data for 2025-01.
[2025-10-24T18:32:46.547622] [INFO ] [REMOTE    ] EMF: Fetching primary data for 2025-05.
[2025-10-24T18:32:46.626445] [INFO ] [REMOTE    ] EMO: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T18:32:46.741063] [INFO ] [REMOTE    ] EMN: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T18:32:46.927852] [INFO ] [REMOTE    ] EMF: Incremental fetch complete for 2025-05 (0.38 seconds).
[2025-10-24T18:32:47.347726] [INFO ] [REMOTE    ] EMF: Fetching primary data for 2025-06.
[2025-10-24T18:32:47.850730] [INFO ] [REMOTE    ] EMF: Incremental fetch complete for 2025-06 (0.50 seconds).
[2025-10-24T18:32:48.147684] [INFO ] [REMOTE    ] EME: Fetching primary data for 2025-06.
[2025-10-24T18:32:48.947709] [INFO ] [REMOTE    ] EMN: Fetching primary data for 2025-02.
[2025-10-24T18:32:49.754893] [INFO ] [REMOTE    ] EMO: Fetching primary data for 2025-02.
[2025-10-24T18:32:49.770015] [INFO ] [REMOTE    ] EME: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T18:32:50.547712] [INFO ] [REMOTE    ] EMF: Fetching primary data for 2025-07.
[2025-10-24T18:32:50.892484] [INFO ] [REMOTE    ] EMO: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T18:32:51.347613] [INFO ] [REMOTE    ] EMO: Fetching primary data for 2025-03.
[2025-10-24T18:32:51.532435] [INFO ] [REMOTE    ] EMN: Incremental fetch complete for 2025-02 (2.58 seconds).
[2025-10-24T18:32:52.147671] [INFO ] [REMOTE    ] EMN: Fetching primary data for 2025-03.
[2025-10-24T18:32:52.881742] [INFO ] [REMOTE    ] EMF: Incremental fetch complete for 2025-07 (2.33 seconds).
[2025-10-24T18:32:52.947674] [INFO ] [REMOTE    ] EMF: Fetching primary data for 2025-08.
[2025-10-24T18:32:53.059929] [DEBUG] [REMOTE    ] EMF: Error fetching primary data for 2025-08: 'API call returned an empty response.'
[2025-10-24T18:32:53.060125] [WARN ] [REMOTE    ] EMF: No data returned for month 2025-08
[2025-10-24T18:32:53.060229] [FATAL] [REMOTE    ] EMF: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:32:53.060348] [FATAL] [MAIN      ] EMF: Failed to fetch primary data.
[2025-10-24T18:32:53.060432] [WARN ] [MAIN      ] EMF: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:32:53.060525] [INFO ] [LOCAL     ] EMF: Starting deletion of primary data.
[2025-10-24T18:32:53.060603] [DEBUG] [LOCAL     ] EMF: No primary data file found to delete.
[2025-10-24T18:32:53.060666] [INFO ] [LOCAL     ] EMF: Starting deletion of derivative data.
[2025-10-24T18:32:53.060838] [DEBUG] [LOCAL     ] EMF: Deleted derivative data file.
[2025-10-24T18:32:53.060948] [INFO ] [MAIN      ] Update Progress: 732/2366 symbols completed. EMF took 15.4s. Estimated remaining: 3h 27m 14s. Rate: 7.9 symbols/min
[2025-10-24T18:32:53.232311] [INFO ] [MAIN      ] EMP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:32:53.237595] [DEBUG] [LOCAL     ] EMP: Loaded 2894 existing records from primary storage.
[2025-10-24T18:32:53.237828] [INFO ] [MAIN      ] EMP: Loaded 2894 existing records.
[2025-10-24T18:32:53.415341] [WARN ] [MAIN      ] EMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:32:53.415517] [INFO ] [MAIN      ] EMP: Wiping existing primary data before full refresh.
[2025-10-24T18:32:53.415587] [INFO ] [LOCAL     ] EMP: Starting deletion of primary data.
[2025-10-24T18:32:53.415821] [DEBUG] [LOCAL     ] EMP: Deleted primary data file.
[2025-10-24T18:32:53.415894] [INFO ] [MAIN      ] EMP: Starting full primary refresh.
[2025-10-24T18:32:53.775265] [INFO ] [REMOTE    ] EME: Fetching primary data for 2025-07.
[2025-10-24T18:32:53.782378] [INFO ] [REMOTE    ] EMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:32:53.858937] [INFO ] [REMOTE    ] EMO: Incremental fetch complete for 2025-03 (2.51 seconds).
[2025-10-24T18:32:54.404462] [INFO ] [REMOTE    ] EMN: Incremental fetch complete for 2025-03 (2.26 seconds).
[2025-10-24T18:32:54.547611] [INFO ] [REMOTE    ] EMN: Fetching primary data for 2025-04.
[2025-10-24T18:32:55.347629] [INFO ] [REMOTE    ] EMO: Fetching primary data for 2025-04.
[2025-10-24T18:32:55.421975] [INFO ] [REMOTE    ] EME: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T18:32:56.004360] [INFO ] [REMOTE    ] EMN: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T18:32:56.147607] [INFO ] [REMOTE    ] EMN: Fetching primary data for 2025-05.
[2025-10-24T18:32:56.250285] [INFO ] [REMOTE    ] EMO: Incremental fetch complete for 2025-04 (0.90 seconds).
[2025-10-24T18:32:56.947898] [INFO ] [REMOTE    ] EMP: Fetching primary data for 2025-01.
[2025-10-24T18:32:57.726234] [INFO ] [REMOTE    ] EMN: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T18:32:57.747670] [INFO ] [REMOTE    ] EME: Fetching primary data for 2025-08.
[2025-10-24T18:32:58.547622] [INFO ] [REMOTE    ] EMN: Fetching primary data for 2025-06.
[2025-10-24T18:32:58.784966] [INFO ] [REMOTE    ] EMP: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T18:32:58.804032] [INFO ] [REMOTE    ] EME: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T18:32:59.347668] [INFO ] [REMOTE    ] EMO: Fetching primary data for 2025-05.
[2025-10-24T18:33:00.095000] [INFO ] [REMOTE    ] EMN: Incremental fetch complete for 2025-06 (1.55 seconds).
[2025-10-24T18:33:00.147617] [INFO ] [REMOTE    ] EMP: Fetching primary data for 2025-02.
[2025-10-24T18:33:00.222290] [INFO ] [REMOTE    ] EMO: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T18:33:00.947675] [INFO ] [REMOTE    ] EMN: Fetching primary data for 2025-07.
[2025-10-24T18:33:01.063289] [INFO ] [REMOTE    ] EMP: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T18:33:01.747693] [INFO ] [REMOTE    ] EMP: Fetching primary data for 2025-03.
[2025-10-24T18:33:02.547625] [INFO ] [REMOTE    ] EMO: Fetching primary data for 2025-06.
[2025-10-24T18:33:02.697506] [INFO ] [REMOTE    ] EMP: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T18:33:03.347619] [INFO ] [REMOTE    ] EME: Fetching primary data for 2025-09.
[2025-10-24T18:33:03.457632] [INFO ] [REMOTE    ] EMN: Incremental fetch complete for 2025-07 (2.51 seconds).
[2025-10-24T18:33:04.026155] [INFO ] [REMOTE    ] EMO: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T18:33:04.147723] [INFO ] [REMOTE    ] EMN: Fetching primary data for 2025-08.
[2025-10-24T18:33:04.833434] [INFO ] [REMOTE    ] EME: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T18:33:04.947722] [INFO ] [REMOTE    ] EMO: Fetching primary data for 2025-07.
[2025-10-24T18:33:05.747737] [INFO ] [REMOTE    ] EMP: Fetching primary data for 2025-04.
[2025-10-24T18:33:06.068132] [INFO ] [REMOTE    ] EMP: Incremental fetch complete for 2025-04 (0.32 seconds).
[2025-10-24T18:33:06.268014] [INFO ] [REMOTE    ] EMO: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T18:33:06.341287] [INFO ] [REMOTE    ] EMN: Incremental fetch complete for 2025-08 (2.19 seconds).
[2025-10-24T18:33:06.547693] [INFO ] [REMOTE    ] EMP: Fetching primary data for 2025-05.
[2025-10-24T18:33:07.113676] [INFO ] [REMOTE    ] EMP: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T18:33:07.347697] [INFO ] [REMOTE    ] EMN: Fetching primary data for 2025-09.
[2025-10-24T18:33:08.147679] [INFO ] [REMOTE    ] EMO: Fetching primary data for 2025-08.
[2025-10-24T18:33:08.896472] [INFO ] [REMOTE    ] EMO: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T18:33:08.947631] [INFO ] [REMOTE    ] EMO: Fetching primary data for 2025-09.
[2025-10-24T18:33:09.092395] [INFO ] [REMOTE    ] EMN: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T18:33:09.578620] [INFO ] [REMOTE    ] EMO: Incremental fetch complete for 2025-09 (0.63 seconds).
[2025-10-24T18:33:09.747635] [INFO ] [REMOTE    ] EMP: Fetching primary data for 2025-06.
[2025-10-24T18:33:10.361050] [INFO ] [REMOTE    ] EMP: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T18:33:10.547715] [INFO ] [REMOTE    ] EMN: Fetching primary data for 2025-10.
[2025-10-24T18:33:11.347723] [INFO ] [REMOTE    ] EME: Fetching primary data for 2025-10.
[2025-10-24T18:33:12.147696] [INFO ] [REMOTE    ] EMP: Fetching primary data for 2025-07.
[2025-10-24T18:33:12.618277] [INFO ] [REMOTE    ] EME: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T18:33:12.625852] [INFO ] [REMOTE    ] EME: Full fetch complete (47067 records).
[2025-10-24T18:33:12.626091] [DEBUG] [VALIDATOR ] EME: Validating primary data.
[2025-10-24T18:33:12.811945] [INFO ] [REMOTE    ] EMP: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T18:33:12.957801] [INFO ] [REMOTE    ] EMP: Fetching primary data for 2025-08.
[2025-10-24T18:33:13.050531] [INFO ] [REMOTE    ] EMN: Incremental fetch complete for 2025-10 (2.50 seconds).
[2025-10-24T18:33:13.104948] [INFO ] [REMOTE    ] EMN: Full fetch complete (72449 records).
[2025-10-24T18:33:13.116794] [DEBUG] [VALIDATOR ] EMN: Validating primary data.
[2025-10-24T18:33:13.117330] [DEBUG] [VALIDATOR ] EME: All expected trading days are present.
[2025-10-24T18:33:13.117567] [DEBUG] [VALIDATOR ] EME: Primary data validation passed.
[2025-10-24T18:33:13.118622] [INFO ] [MAIN      ] EME: Fetched primary data is valid.
[2025-10-24T18:33:13.118741] [DEBUG] [LOCAL     ] EME: Saving primary data.
[2025-10-24T18:33:13.151830] [FATAL] [LOCAL     ] EME: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:33:13.196071] [FATAL] [MAIN      ] EME: Failed to save primary data.
[2025-10-24T18:33:13.211899] [WARN ] [MAIN      ] EME: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:33:13.222527] [INFO ] [LOCAL     ] EME: Starting deletion of primary data.
[2025-10-24T18:33:13.222747] [DEBUG] [LOCAL     ] EME: No primary data file found to delete.
[2025-10-24T18:33:13.223153] [INFO ] [LOCAL     ] EME: Starting deletion of derivative data.
[2025-10-24T18:33:13.234017] [DEBUG] [LOCAL     ] EME: Deleted derivative data file.
[2025-10-24T18:33:13.244606] [INFO ] [MAIN      ] Update Progress: 733/2366 symbols completed. EME took 46.0s. Estimated remaining: 3h 27m 34s. Rate: 7.9 symbols/min
[2025-10-24T18:33:13.518521] [INFO ] [REMOTE    ] EMP: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T18:33:13.637674] [INFO ] [MAIN      ] EMR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:33:13.721056] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present.
[2025-10-24T18:33:13.721228] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed.
[2025-10-24T18:33:13.722241] [INFO ] [MAIN      ] EMN: Fetched primary data is valid.
[2025-10-24T18:33:13.722320] [DEBUG] [LOCAL     ] EMN: Saving primary data.
[2025-10-24T18:33:13.722987] [FATAL] [LOCAL     ] EMN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:33:13.723077] [FATAL] [MAIN      ] EMN: Failed to save primary data.
[2025-10-24T18:33:13.723119] [WARN ] [MAIN      ] EMN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:33:13.723153] [INFO ] [LOCAL     ] EMN: Starting deletion of primary data.
[2025-10-24T18:33:13.723209] [DEBUG] [LOCAL     ] EMN: No primary data file found to delete.
[2025-10-24T18:33:13.723245] [INFO ] [LOCAL     ] EMN: Starting deletion of derivative data.
[2025-10-24T18:33:13.723392] [DEBUG] [LOCAL     ] EMN: Deleted derivative data file.
[2025-10-24T18:33:13.723938] [INFO ] [MAIN      ] Update Progress: 734/2366 symbols completed. EMN took 30.3s. Estimated remaining: 3h 27m 11s. Rate: 7.9 symbols/min
[2025-10-24T18:33:13.754190] [INFO ] [REMOTE    ] EMP: Fetching primary data for 2025-09.
[2025-10-24T18:33:13.925414] [INFO ] [MAIN      ] ENB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:33:13.944184] [DEBUG] [LOCAL     ] EMR: Loaded 53551 existing records from primary storage.
[2025-10-24T18:33:13.944703] [INFO ] [MAIN      ] EMR: Loaded 53551 existing records.
[2025-10-24T18:33:14.141965] [WARN ] [MAIN      ] EMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:33:14.156245] [INFO ] [MAIN      ] EMR: Wiping existing primary data before full refresh.
[2025-10-24T18:33:14.156339] [INFO ] [LOCAL     ] EMR: Starting deletion of primary data.
[2025-10-24T18:33:14.156982] [DEBUG] [LOCAL     ] EMR: Deleted primary data file.
[2025-10-24T18:33:14.157040] [INFO ] [MAIN      ] EMR: Starting full primary refresh.
[2025-10-24T18:33:14.298491] [DEBUG] [LOCAL     ] ENB: Loaded 53901 existing records from primary storage.
[2025-10-24T18:33:14.322579] [INFO ] [MAIN      ] ENB: Loaded 53901 existing records.
[2025-10-24T18:33:14.439591] [INFO ] [REMOTE    ] EMP: Incremental fetch complete for 2025-09 (0.69 seconds).
[2025-10-24T18:33:14.551454] [INFO ] [REMOTE    ] EMO: Fetching primary data for 2025-10.
[2025-10-24T18:33:14.759378] [WARN ] [MAIN      ] ENB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:33:14.766023] [INFO ] [MAIN      ] ENB: Wiping existing primary data before full refresh.
[2025-10-24T18:33:14.765844] [INFO ] [REMOTE    ] EMR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:33:14.766218] [INFO ] [LOCAL     ] ENB: Starting deletion of primary data.
[2025-10-24T18:33:14.767215] [DEBUG] [LOCAL     ] ENB: Deleted primary data file.
[2025-10-24T18:33:14.767278] [INFO ] [MAIN      ] ENB: Starting full primary refresh.
[2025-10-24T18:33:15.141620] [INFO ] [REMOTE    ] ENB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:33:15.347699] [INFO ] [REMOTE    ] EMP: Fetching primary data for 2025-10.
[2025-10-24T18:33:15.829547] [INFO ] [REMOTE    ] EMO: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T18:33:15.834904] [INFO ] [REMOTE    ] EMO: Full fetch complete (17825 records).
[2025-10-24T18:33:15.835019] [DEBUG] [VALIDATOR ] EMO: Validating primary data.
[2025-10-24T18:33:15.939695] [INFO ] [REMOTE    ] EMP: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T18:33:15.952802] [INFO ] [REMOTE    ] EMP: Full fetch complete (4039 records).
[2025-10-24T18:33:15.958511] [DEBUG] [VALIDATOR ] EMP: Validating primary data.
[2025-10-24T18:33:15.974465] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:33:15.999049] [FATAL] [MAIN      ] EMP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:33:16.008267] [WARN ] [MAIN      ] EMP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:33:16.033457] [INFO ] [LOCAL     ] EMP: Starting deletion of primary data.
[2025-10-24T18:33:16.102699] [DEBUG] [LOCAL     ] EMP: No primary data file found to delete.
[2025-10-24T18:33:16.123110] [INFO ] [LOCAL     ] EMP: Starting deletion of derivative data.
[2025-10-24T18:33:16.152474] [DEBUG] [LOCAL     ] EMP: Deleted derivative data file.
[2025-10-24T18:33:16.152634] [INFO ] [REMOTE    ] EMR: Fetching primary data for 2025-01.
[2025-10-24T18:33:16.156593] [INFO ] [MAIN      ] Update Progress: 735/2366 symbols completed. EMP took 23.1s. Estimated remaining: 3h 26m 52s. Rate: 7.9 symbols/min
[2025-10-24T18:33:16.365576] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present.
[2025-10-24T18:33:16.370814] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed.
[2025-10-24T18:33:16.371307] [INFO ] [MAIN      ] EMO: Fetched primary data is valid.
[2025-10-24T18:33:16.376503] [DEBUG] [LOCAL     ] EMO: Saving primary data.
[2025-10-24T18:33:16.392258] [FATAL] [LOCAL     ] EMO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:33:16.402611] [FATAL] [MAIN      ] EMO: Failed to save primary data.
[2025-10-24T18:33:16.419116] [WARN ] [MAIN      ] EMO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:33:16.428268] [INFO ] [LOCAL     ] EMO: Starting deletion of primary data.
[2025-10-24T18:33:16.433802] [DEBUG] [LOCAL     ] EMO: No primary data file found to delete.
[2025-10-24T18:33:16.433882] [INFO ] [LOCAL     ] EMO: Starting deletion of derivative data.
[2025-10-24T18:33:16.434372] [DEBUG] [LOCAL     ] EMO: Deleted derivative data file.
[2025-10-24T18:33:16.449452] [INFO ] [MAIN      ] Update Progress: 736/2366 symbols completed. EMO took 32.2s. Estimated remaining: 3h 26m 28s. Rate: 7.9 symbols/min
[2025-10-24T18:33:16.453424] [INFO ] [MAIN      ] ENIC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:33:16.497183] [DEBUG] [LOCAL     ] ENIC: No existing data file found in primary storage.
[2025-10-24T18:33:16.529178] [WARN ] [MAIN      ] ENIC: No existing data found, performing full refresh instead.
[2025-10-24T18:33:16.556088] [INFO ] [MAIN      ] ENIC: Wiping existing primary data before full refresh.
[2025-10-24T18:33:16.556252] [INFO ] [LOCAL     ] ENIC: Starting deletion of primary data.
[2025-10-24T18:33:16.556391] [DEBUG] [LOCAL     ] ENIC: No primary data file found to delete.
[2025-10-24T18:33:16.556722] [INFO ] [MAIN      ] ENIC: Starting full primary refresh.
[2025-10-24T18:33:16.724487] [INFO ] [MAIN      ] ENO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:33:16.782719] [DEBUG] [LOCAL     ] ENO: Loaded 1746 existing records from primary storage.
[2025-10-24T18:33:16.794794] [INFO ] [MAIN      ] ENO: Loaded 1746 existing records.
[2025-10-24T18:33:16.964995] [INFO ] [REMOTE    ] ENB: Fetching primary data for 2025-01.
[2025-10-24T18:33:17.152776] [WARN ] [MAIN      ] ENO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:33:17.158973] [INFO ] [MAIN      ] ENO: Wiping existing primary data before full refresh.
[2025-10-24T18:33:17.185190] [INFO ] [LOCAL     ] ENO: Starting deletion of primary data.
[2025-10-24T18:33:17.191911] [INFO ] [REMOTE    ] ENIC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:33:17.192481] [DEBUG] [LOCAL     ] ENO: Deleted primary data file.
[2025-10-24T18:33:17.192562] [INFO ] [MAIN      ] ENO: Starting full primary refresh.
[2025-10-24T18:33:17.546501] [INFO ] [REMOTE    ] ENO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:33:17.747611] [INFO ] [REMOTE    ] ENO: Fetching primary data for 2025-01.
[2025-10-24T18:33:17.932596] [INFO ] [REMOTE    ] EMR: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T18:33:18.275727] [INFO ] [REMOTE    ] ENO: Incremental fetch complete for 2025-01 (0.53 seconds).
[2025-10-24T18:33:18.547638] [INFO ] [REMOTE    ] ENIC: Fetching primary data for 2025-01.
[2025-10-24T18:33:18.669693] [INFO ] [REMOTE    ] ENB: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T18:33:19.347747] [INFO ] [REMOTE    ] ENB: Fetching primary data for 2025-02.
[2025-10-24T18:33:20.068389] [INFO ] [REMOTE    ] ENIC: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T18:33:20.147594] [INFO ] [REMOTE    ] ENIC: Fetching primary data for 2025-02.
[2025-10-24T18:33:20.947623] [INFO ] [REMOTE    ] EMR: Fetching primary data for 2025-02.
[2025-10-24T18:33:21.301434] [INFO ] [REMOTE    ] ENB: Incremental fetch complete for 2025-02 (1.95 seconds).
[2025-10-24T18:33:21.350604] [INFO ] [REMOTE    ] ENIC: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T18:33:21.747711] [INFO ] [REMOTE    ] ENO: Fetching primary data for 2025-02.
[2025-10-24T18:33:22.097936] [INFO ] [REMOTE    ] ENO: Incremental fetch complete for 2025-02 (0.35 seconds).
[2025-10-24T18:33:22.267389] [INFO ] [REMOTE    ] EMR: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T18:33:22.547695] [INFO ] [REMOTE    ] EMR: Fetching primary data for 2025-03.
[2025-10-24T18:33:23.347743] [INFO ] [REMOTE    ] ENB: Fetching primary data for 2025-03.
[2025-10-24T18:33:24.005534] [INFO ] [REMOTE    ] EMR: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T18:33:24.147704] [INFO ] [REMOTE    ] ENIC: Fetching primary data for 2025-03.
[2025-10-24T18:33:24.947692] [INFO ] [REMOTE    ] EMR: Fetching primary data for 2025-04.
[2025-10-24T18:33:25.101124] [INFO ] [REMOTE    ] ENB: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T18:33:25.457070] [INFO ] [REMOTE    ] ENIC: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T18:33:25.747618] [INFO ] [REMOTE    ] ENO: Fetching primary data for 2025-03.
[2025-10-24T18:33:26.178867] [INFO ] [REMOTE    ] ENO: Incremental fetch complete for 2025-03 (0.43 seconds).
[2025-10-24T18:33:26.547635] [INFO ] [REMOTE    ] ENIC: Fetching primary data for 2025-04.
[2025-10-24T18:33:26.697578] [INFO ] [REMOTE    ] EMR: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T18:33:27.347727] [INFO ] [REMOTE    ] ENO: Fetching primary data for 2025-04.
[2025-10-24T18:33:27.910220] [INFO ] [REMOTE    ] ENO: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T18:33:27.962153] [INFO ] [REMOTE    ] ENIC: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T18:33:28.147708] [INFO ] [REMOTE    ] ENB: Fetching primary data for 2025-04.
[2025-10-24T18:33:28.947720] [INFO ] [REMOTE    ] EMR: Fetching primary data for 2025-05.
[2025-10-24T18:33:29.747706] [INFO ] [REMOTE    ] ENO: Fetching primary data for 2025-05.
[2025-10-24T18:33:30.104425] [INFO ] [REMOTE    ] ENB: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T18:33:30.129001] [INFO ] [REMOTE    ] ENO: Incremental fetch complete for 2025-05 (0.38 seconds).
[2025-10-24T18:33:30.547677] [INFO ] [REMOTE    ] ENO: Fetching primary data for 2025-06.
[2025-10-24T18:33:30.915432] [INFO ] [REMOTE    ] EMR: Incremental fetch complete for 2025-05 (1.97 seconds).
[2025-10-24T18:33:31.008045] [INFO ] [REMOTE    ] ENO: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T18:33:31.347671] [INFO ] [REMOTE    ] ENB: Fetching primary data for 2025-05.
[2025-10-24T18:33:32.147683] [INFO ] [REMOTE    ] ENIC: Fetching primary data for 2025-05.
[2025-10-24T18:33:32.947621] [INFO ] [REMOTE    ] EMR: Fetching primary data for 2025-06.
[2025-10-24T18:33:33.056713] [INFO ] [REMOTE    ] ENB: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T18:33:33.717388] [INFO ] [REMOTE    ] ENIC: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T18:33:33.747605] [INFO ] [REMOTE    ] ENIC: Fetching primary data for 2025-06.
[2025-10-24T18:33:34.547701] [INFO ] [REMOTE    ] ENO: Fetching primary data for 2025-07.
[2025-10-24T18:33:35.291486] [INFO ] [REMOTE    ] ENO: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T18:33:35.356834] [INFO ] [REMOTE    ] ENB: Fetching primary data for 2025-06.
[2025-10-24T18:33:35.346377] [INFO ] [REMOTE    ] EMR: Incremental fetch complete for 2025-06 (2.40 seconds).
[2025-10-24T18:33:35.372722] [INFO ] [REMOTE    ] ENIC: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T18:33:36.147743] [INFO ] [REMOTE    ] EMR: Fetching primary data for 2025-07.
[2025-10-24T18:33:36.947697] [INFO ] [REMOTE    ] ENIC: Fetching primary data for 2025-07.
[2025-10-24T18:33:37.494847] [INFO ] [REMOTE    ] ENB: Incremental fetch complete for 2025-06 (2.14 seconds).
[2025-10-24T18:33:37.642817] [INFO ] [REMOTE    ] EMR: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T18:33:37.747711] [INFO ] [REMOTE    ] EMR: Fetching primary data for 2025-08.
[2025-10-24T18:33:38.332539] [INFO ] [REMOTE    ] ENIC: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T18:33:38.547699] [INFO ] [REMOTE    ] ENB: Fetching primary data for 2025-07.
[2025-10-24T18:33:39.347713] [INFO ] [REMOTE    ] ENO: Fetching primary data for 2025-08.
[2025-10-24T18:33:39.418075] [INFO ] [REMOTE    ] EMR: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T18:33:39.687142] [INFO ] [REMOTE    ] ENO: Incremental fetch complete for 2025-08 (0.34 seconds).
[2025-10-24T18:33:40.147688] [INFO ] [REMOTE    ] EMR: Fetching primary data for 2025-09.
[2025-10-24T18:33:40.631801] [INFO ] [REMOTE    ] ENB: Incremental fetch complete for 2025-07 (2.08 seconds).
[2025-10-24T18:33:40.947668] [INFO ] [REMOTE    ] ENO: Fetching primary data for 2025-09.
[2025-10-24T18:33:41.495091] [INFO ] [REMOTE    ] ENO: Incremental fetch complete for 2025-09 (0.55 seconds).
[2025-10-24T18:33:41.566530] [INFO ] [REMOTE    ] EMR: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T18:33:41.747697] [INFO ] [REMOTE    ] EMR: Fetching primary data for 2025-10.
[2025-10-24T18:33:42.547674] [INFO ] [REMOTE    ] ENO: Fetching primary data for 2025-10.
[2025-10-24T18:33:42.878365] [INFO ] [REMOTE    ] ENO: Incremental fetch complete for 2025-10 (0.33 seconds).
[2025-10-24T18:33:42.879189] [INFO ] [REMOTE    ] ENO: Full fetch complete (2981 records).
[2025-10-24T18:33:42.879257] [DEBUG] [VALIDATOR ] ENO: Validating primary data.
[2025-10-24T18:33:43.228366] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present.
[2025-10-24T18:33:43.228443] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed.
[2025-10-24T18:33:43.228743] [INFO ] [MAIN      ] ENO: Fetched primary data is valid.
[2025-10-24T18:33:43.228835] [DEBUG] [LOCAL     ] ENO: Saving primary data.
[2025-10-24T18:33:43.229245] [FATAL] [LOCAL     ] ENO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:33:43.229392] [FATAL] [MAIN      ] ENO: Failed to save primary data.
[2025-10-24T18:33:43.229497] [WARN ] [MAIN      ] ENO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:33:43.229584] [INFO ] [LOCAL     ] ENO: Starting deletion of primary data.
[2025-10-24T18:33:43.229686] [DEBUG] [LOCAL     ] ENO: No primary data file found to delete.
[2025-10-24T18:33:43.229818] [INFO ] [LOCAL     ] ENO: Starting deletion of derivative data.
[2025-10-24T18:33:43.229973] [DEBUG] [LOCAL     ] ENO: Deleted derivative data file.
[2025-10-24T18:33:43.230045] [INFO ] [MAIN      ] Update Progress: 737/2366 symbols completed. ENO took 26.8s. Estimated remaining: 3h 27m 3s. Rate: 7.9 symbols/min
[2025-10-24T18:33:43.352862] [INFO ] [REMOTE    ] ENB: Fetching primary data for 2025-08.
[2025-10-24T18:33:43.413375] [INFO ] [MAIN      ] ENOV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:33:43.464000] [DEBUG] [LOCAL     ] ENOV: Loaded 44895 existing records from primary storage.
[2025-10-24T18:33:43.464430] [INFO ] [MAIN      ] ENOV: Loaded 44895 existing records.
[2025-10-24T18:33:43.660871] [WARN ] [MAIN      ] ENOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:33:43.661427] [INFO ] [MAIN      ] ENOV: Wiping existing primary data before full refresh.
[2025-10-24T18:33:43.661538] [INFO ] [LOCAL     ] ENOV: Starting deletion of primary data.
[2025-10-24T18:33:43.662165] [DEBUG] [LOCAL     ] ENOV: Deleted primary data file.
[2025-10-24T18:33:43.662226] [INFO ] [MAIN      ] ENOV: Starting full primary refresh.
[2025-10-24T18:33:43.840500] [INFO ] [REMOTE    ] EMR: Incremental fetch complete for 2025-10 (2.09 seconds).
[2025-10-24T18:33:43.962396] [INFO ] [REMOTE    ] EMR: Full fetch complete (77181 records).
[2025-10-24T18:33:43.980008] [DEBUG] [VALIDATOR ] EMR: Validating primary data.
[2025-10-24T18:33:44.153471] [INFO ] [REMOTE    ] ENIC: Fetching primary data for 2025-08.
[2025-10-24T18:33:44.249711] [INFO ] [REMOTE    ] ENOV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:33:44.567538] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present.
[2025-10-24T18:33:44.567706] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed.
[2025-10-24T18:33:44.568849] [INFO ] [MAIN      ] EMR: Fetched primary data is valid.
[2025-10-24T18:33:44.568919] [DEBUG] [LOCAL     ] EMR: Saving primary data.
[2025-10-24T18:33:44.569574] [FATAL] [LOCAL     ] EMR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:33:44.569730] [FATAL] [MAIN      ] EMR: Failed to save primary data.
[2025-10-24T18:33:44.569775] [WARN ] [MAIN      ] EMR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:33:44.569811] [INFO ] [LOCAL     ] EMR: Starting deletion of primary data.
[2025-10-24T18:33:44.569866] [DEBUG] [LOCAL     ] EMR: No primary data file found to delete.
[2025-10-24T18:33:44.569902] [INFO ] [LOCAL     ] EMR: Starting deletion of derivative data.
[2025-10-24T18:33:44.570189] [DEBUG] [LOCAL     ] EMR: Deleted derivative data file.
[2025-10-24T18:33:44.570614] [INFO ] [MAIN      ] Update Progress: 738/2366 symbols completed. EMR took 31.3s. Estimated remaining: 3h 26m 41s. Rate: 7.9 symbols/min
[2025-10-24T18:33:44.768214] [INFO ] [MAIN      ] ENR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:33:44.810867] [DEBUG] [LOCAL     ] ENR: Loaded 44097 existing records from primary storage.
[2025-10-24T18:33:44.811192] [INFO ] [MAIN      ] ENR: Loaded 44097 existing records.
[2025-10-24T18:33:44.951750] [INFO ] [REMOTE    ] ENOV: Fetching primary data for 2025-01.
[2025-10-24T18:33:44.994583] [WARN ] [MAIN      ] ENR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:33:45.006407] [INFO ] [MAIN      ] ENR: Wiping existing primary data before full refresh.
[2025-10-24T18:33:45.022079] [INFO ] [LOCAL     ] ENR: Starting deletion of primary data.
[2025-10-24T18:33:45.025504] [DEBUG] [LOCAL     ] ENR: Deleted primary data file.
[2025-10-24T18:33:45.025624] [INFO ] [MAIN      ] ENR: Starting full primary refresh.
[2025-10-24T18:33:45.091479] [INFO ] [REMOTE    ] ENB: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T18:33:45.440920] [INFO ] [REMOTE    ] ENR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:33:45.499332] [INFO ] [REMOTE    ] ENIC: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T18:33:45.747682] [INFO ] [REMOTE    ] ENIC: Fetching primary data for 2025-09.
[2025-10-24T18:33:46.547698] [INFO ] [REMOTE    ] ENR: Fetching primary data for 2025-01.
[2025-10-24T18:33:47.065254] [INFO ] [REMOTE    ] ENOV: Incremental fetch complete for 2025-01 (2.11 seconds).
[2025-10-24T18:33:47.337912] [INFO ] [REMOTE    ] ENIC: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T18:33:47.347597] [INFO ] [REMOTE    ] ENIC: Fetching primary data for 2025-10.
[2025-10-24T18:33:48.147712] [INFO ] [REMOTE    ] ENOV: Fetching primary data for 2025-02.
[2025-10-24T18:33:48.261259] [INFO ] [REMOTE    ] ENR: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T18:33:48.624603] [INFO ] [REMOTE    ] ENIC: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T18:33:48.631000] [INFO ] [REMOTE    ] ENIC: Full fetch complete (51307 records).
[2025-10-24T18:33:48.631090] [DEBUG] [VALIDATOR ] ENIC: Validating primary data.
[2025-10-24T18:33:48.952865] [INFO ] [REMOTE    ] ENB: Fetching primary data for 2025-09.
[2025-10-24T18:33:49.035180] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present.
[2025-10-24T18:33:49.035300] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed.
[2025-10-24T18:33:49.036077] [INFO ] [MAIN      ] ENIC: Fetched primary data is valid.
[2025-10-24T18:33:49.036139] [DEBUG] [LOCAL     ] ENIC: Saving primary data.
[2025-10-24T18:33:49.036597] [FATAL] [LOCAL     ] ENIC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:33:49.036701] [FATAL] [MAIN      ] ENIC: Failed to save primary data.
[2025-10-24T18:33:49.036749] [WARN ] [MAIN      ] ENIC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:33:49.036814] [INFO ] [LOCAL     ] ENIC: Starting deletion of primary data.
[2025-10-24T18:33:49.036872] [DEBUG] [LOCAL     ] ENIC: No primary data file found to delete.
[2025-10-24T18:33:49.036908] [INFO ] [LOCAL     ] ENIC: Starting deletion of derivative data.
[2025-10-24T18:33:49.036948] [DEBUG] [LOCAL     ] ENIC: No derivative data file found to delete.
[2025-10-24T18:33:49.037007] [INFO ] [MAIN      ] Update Progress: 739/2366 symbols completed. ENIC took 32.9s. Estimated remaining: 3h 26m 27s. Rate: 7.9 symbols/min
[2025-10-24T18:33:49.214037] [INFO ] [MAIN      ] ENS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:33:49.236872] [INFO ] [REMOTE    ] ENOV: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T18:33:49.267844] [DEBUG] [LOCAL     ] ENS: Loaded 29875 existing records from primary storage.
[2025-10-24T18:33:49.268103] [INFO ] [MAIN      ] ENS: Loaded 29875 existing records.
[2025-10-24T18:33:49.447039] [WARN ] [MAIN      ] ENS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:33:49.447257] [INFO ] [MAIN      ] ENS: Wiping existing primary data before full refresh.
[2025-10-24T18:33:49.447311] [INFO ] [LOCAL     ] ENS: Starting deletion of primary data.
[2025-10-24T18:33:49.447686] [DEBUG] [LOCAL     ] ENS: Deleted primary data file.
[2025-10-24T18:33:49.447742] [INFO ] [MAIN      ] ENS: Starting full primary refresh.
[2025-10-24T18:33:49.762849] [INFO ] [REMOTE    ] ENOV: Fetching primary data for 2025-03.
[2025-10-24T18:33:49.802039] [INFO ] [REMOTE    ] ENS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:33:50.547719] [INFO ] [REMOTE    ] ENS: Fetching primary data for 2025-01.
[2025-10-24T18:33:51.179353] [INFO ] [REMOTE    ] ENB: Incremental fetch complete for 2025-09 (2.23 seconds).
[2025-10-24T18:33:51.301639] [INFO ] [REMOTE    ] ENOV: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T18:33:51.347680] [INFO ] [REMOTE    ] ENR: Fetching primary data for 2025-02.
[2025-10-24T18:33:52.063981] [INFO ] [REMOTE    ] ENS: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T18:33:52.147677] [INFO ] [REMOTE    ] ENS: Fetching primary data for 2025-02.
[2025-10-24T18:33:52.821431] [INFO ] [REMOTE    ] ENR: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T18:33:52.947625] [INFO ] [REMOTE    ] ENB: Fetching primary data for 2025-10.
[2025-10-24T18:33:53.464307] [INFO ] [REMOTE    ] ENS: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T18:33:53.747683] [INFO ] [REMOTE    ] ENOV: Fetching primary data for 2025-04.
[2025-10-24T18:33:54.547633] [INFO ] [REMOTE    ] ENS: Fetching primary data for 2025-03.
[2025-10-24T18:33:54.874751] [INFO ] [REMOTE    ] ENB: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T18:33:54.884954] [INFO ] [REMOTE    ] ENB: Full fetch complete (77273 records).
[2025-10-24T18:33:54.885124] [DEBUG] [VALIDATOR ] ENB: Validating primary data.
[2025-10-24T18:33:54.885962] [FATAL] [VALIDATOR ] ENB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:33:54.886055] [FATAL] [MAIN      ] ENB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:33:54.886098] [WARN ] [MAIN      ] ENB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:33:54.886163] [INFO ] [LOCAL     ] ENB: Starting deletion of primary data.
[2025-10-24T18:33:54.886255] [DEBUG] [LOCAL     ] ENB: No primary data file found to delete.
[2025-10-24T18:33:54.886318] [INFO ] [LOCAL     ] ENB: Starting deletion of derivative data.
[2025-10-24T18:33:54.886763] [DEBUG] [LOCAL     ] ENB: Deleted derivative data file.
[2025-10-24T18:33:54.887248] [INFO ] [MAIN      ] Update Progress: 740/2366 symbols completed. ENB took 41.2s. Estimated remaining: 3h 26m 15s. Rate: 7.9 symbols/min
[2025-10-24T18:33:55.060153] [INFO ] [MAIN      ] ENVA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:33:55.087740] [DEBUG] [LOCAL     ] ENVA: Loaded 25451 existing records from primary storage.
[2025-10-24T18:33:55.087991] [INFO ] [MAIN      ] ENVA: Loaded 25451 existing records.
[2025-10-24T18:33:55.268151] [WARN ] [MAIN      ] ENVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:33:55.268534] [INFO ] [MAIN      ] ENVA: Wiping existing primary data before full refresh.
[2025-10-24T18:33:55.268590] [INFO ] [LOCAL     ] ENVA: Starting deletion of primary data.
[2025-10-24T18:33:55.269081] [DEBUG] [LOCAL     ] ENVA: Deleted primary data file.
[2025-10-24T18:33:55.269146] [INFO ] [MAIN      ] ENVA: Starting full primary refresh.
[2025-10-24T18:33:55.359429] [INFO ] [REMOTE    ] ENR: Fetching primary data for 2025-03.
[2025-10-24T18:33:55.403001] [INFO ] [REMOTE    ] ENOV: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T18:33:55.674847] [INFO ] [REMOTE    ] ENVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:33:55.829768] [INFO ] [REMOTE    ] ENS: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T18:33:56.147674] [INFO ] [REMOTE    ] ENOV: Fetching primary data for 2025-05.
[2025-10-24T18:33:56.465917] [INFO ] [REMOTE    ] ENR: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T18:33:56.947701] [INFO ] [REMOTE    ] ENR: Fetching primary data for 2025-04.
[2025-10-24T18:33:57.747622] [INFO ] [REMOTE    ] ENS: Fetching primary data for 2025-04.
[2025-10-24T18:33:57.779629] [INFO ] [REMOTE    ] ENOV: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T18:33:58.550001] [INFO ] [REMOTE    ] ENOV: Fetching primary data for 2025-06.
[2025-10-24T18:33:58.552669] [INFO ] [REMOTE    ] ENR: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T18:33:59.121289] [INFO ] [REMOTE    ] ENS: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T18:33:59.347668] [INFO ] [REMOTE    ] ENR: Fetching primary data for 2025-05.
[2025-10-24T18:33:59.878840] [INFO ] [REMOTE    ] ENOV: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T18:34:00.147713] [INFO ] [REMOTE    ] ENOV: Fetching primary data for 2025-07.
[2025-10-24T18:34:00.863909] [INFO ] [REMOTE    ] ENR: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T18:34:00.947603] [INFO ] [REMOTE    ] ENR: Fetching primary data for 2025-06.
[2025-10-24T18:34:01.747723] [INFO ] [REMOTE    ] ENS: Fetching primary data for 2025-05.
[2025-10-24T18:34:02.448184] [INFO ] [REMOTE    ] ENOV: Incremental fetch complete for 2025-07 (2.30 seconds).
[2025-10-24T18:34:02.547747] [INFO ] [REMOTE    ] ENOV: Fetching primary data for 2025-08.
[2025-10-24T18:34:02.681776] [INFO ] [REMOTE    ] ENR: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T18:34:03.347686] [INFO ] [REMOTE    ] ENR: Fetching primary data for 2025-07.
[2025-10-24T18:34:04.147703] [INFO ] [REMOTE    ] ENVA: Fetching primary data for 2025-01.
[2025-10-24T18:34:04.256269] [INFO ] [REMOTE    ] ENS: Incremental fetch complete for 2025-05 (2.51 seconds).
[2025-10-24T18:34:04.947728] [INFO ] [REMOTE    ] ENS: Fetching primary data for 2025-06.
[2025-10-24T18:34:05.610728] [INFO ] [REMOTE    ] ENOV: Incremental fetch complete for 2025-08 (3.06 seconds).
[2025-10-24T18:34:05.750856] [INFO ] [REMOTE    ] ENOV: Fetching primary data for 2025-09.
[2025-10-24T18:34:05.762619] [INFO ] [REMOTE    ] ENR: Incremental fetch complete for 2025-07 (2.41 seconds).
[2025-10-24T18:34:05.862231] [INFO ] [REMOTE    ] ENVA: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T18:34:06.547727] [INFO ] [REMOTE    ] ENR: Fetching primary data for 2025-08.
[2025-10-24T18:34:06.749462] [INFO ] [REMOTE    ] ENS: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T18:34:07.347729] [INFO ] [REMOTE    ] ENVA: Fetching primary data for 2025-02.
[2025-10-24T18:34:07.663843] [INFO ] [REMOTE    ] ENOV: Incremental fetch complete for 2025-09 (1.91 seconds).
[2025-10-24T18:34:07.883772] [INFO ] [REMOTE    ] ENR: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T18:34:08.147682] [INFO ] [REMOTE    ] ENR: Fetching primary data for 2025-09.
[2025-10-24T18:34:08.438445] [INFO ] [REMOTE    ] ENVA: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T18:34:08.947620] [INFO ] [REMOTE    ] ENVA: Fetching primary data for 2025-03.
[2025-10-24T18:34:09.729447] [INFO ] [REMOTE    ] ENR: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T18:34:09.747607] [INFO ] [REMOTE    ] ENR: Fetching primary data for 2025-10.
[2025-10-24T18:34:10.179623] [INFO ] [REMOTE    ] ENVA: Incremental fetch complete for 2025-03 (1.23 seconds).
[2025-10-24T18:34:10.547640] [INFO ] [REMOTE    ] ENS: Fetching primary data for 2025-07.
[2025-10-24T18:34:11.347709] [INFO ] [REMOTE    ] ENVA: Fetching primary data for 2025-04.
[2025-10-24T18:34:11.483140] [INFO ] [REMOTE    ] ENR: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T18:34:11.490696] [INFO ] [REMOTE    ] ENR: Full fetch complete (59436 records).
[2025-10-24T18:34:11.490828] [DEBUG] [VALIDATOR ] ENR: Validating primary data.
[2025-10-24T18:34:11.491581] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:34:11.491694] [FATAL] [MAIN      ] ENR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:34:11.491746] [WARN ] [MAIN      ] ENR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:34:11.491813] [INFO ] [LOCAL     ] ENR: Starting deletion of primary data.
[2025-10-24T18:34:11.491879] [DEBUG] [LOCAL     ] ENR: No primary data file found to delete.
[2025-10-24T18:34:11.491917] [INFO ] [LOCAL     ] ENR: Starting deletion of derivative data.
[2025-10-24T18:34:11.492075] [DEBUG] [LOCAL     ] ENR: Deleted derivative data file.
[2025-10-24T18:34:11.492426] [INFO ] [MAIN      ] Update Progress: 741/2366 symbols completed. ENR took 26.9s. Estimated remaining: 3h 26m 27s. Rate: 7.9 symbols/min
[2025-10-24T18:34:11.666543] [INFO ] [MAIN      ] EOD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:34:11.686530] [DEBUG] [LOCAL     ] EOD: Loaded 14980 existing records from primary storage.
[2025-10-24T18:34:11.686827] [INFO ] [MAIN      ] EOD: Loaded 14980 existing records.
[2025-10-24T18:34:11.870971] [WARN ] [MAIN      ] EOD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:34:11.871342] [INFO ] [MAIN      ] EOD: Wiping existing primary data before full refresh.
[2025-10-24T18:34:11.871449] [INFO ] [LOCAL     ] EOD: Starting deletion of primary data.
[2025-10-24T18:34:11.871675] [DEBUG] [LOCAL     ] EOD: Deleted primary data file.
[2025-10-24T18:34:11.871766] [INFO ] [MAIN      ] EOD: Starting full primary refresh.
[2025-10-24T18:34:11.990756] [INFO ] [REMOTE    ] ENS: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T18:34:12.152930] [INFO ] [REMOTE    ] ENOV: Fetching primary data for 2025-10.
[2025-10-24T18:34:12.251016] [INFO ] [REMOTE    ] EOD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:34:12.756712] [INFO ] [REMOTE    ] ENVA: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T18:34:12.947687] [INFO ] [REMOTE    ] ENVA: Fetching primary data for 2025-05.
[2025-10-24T18:34:13.747616] [INFO ] [REMOTE    ] ENS: Fetching primary data for 2025-08.
[2025-10-24T18:34:13.773262] [INFO ] [REMOTE    ] ENOV: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T18:34:13.780288] [INFO ] [REMOTE    ] ENOV: Full fetch complete (63051 records).
[2025-10-24T18:34:13.780428] [DEBUG] [VALIDATOR ] ENOV: Validating primary data.
[2025-10-24T18:34:13.781148] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:34:13.781245] [FATAL] [MAIN      ] ENOV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:34:13.781318] [WARN ] [MAIN      ] ENOV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:34:13.781409] [INFO ] [LOCAL     ] ENOV: Starting deletion of primary data.
[2025-10-24T18:34:13.781489] [DEBUG] [LOCAL     ] ENOV: No primary data file found to delete.
[2025-10-24T18:34:13.781526] [INFO ] [LOCAL     ] ENOV: Starting deletion of derivative data.
[2025-10-24T18:34:13.781712] [DEBUG] [LOCAL     ] ENOV: Deleted derivative data file.
[2025-10-24T18:34:13.781925] [INFO ] [MAIN      ] Update Progress: 742/2366 symbols completed. ENOV took 30.6s. Estimated remaining: 3h 26m 8s. Rate: 7.9 symbols/min
[2025-10-24T18:34:13.956188] [INFO ] [MAIN      ] EOG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:34:13.973145] [INFO ] [REMOTE    ] ENVA: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T18:34:14.029172] [DEBUG] [LOCAL     ] EOG: Loaded 53780 existing records from primary storage.
[2025-10-24T18:34:14.029485] [INFO ] [MAIN      ] EOG: Loaded 53780 existing records.
[2025-10-24T18:34:14.212186] [WARN ] [MAIN      ] EOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:34:14.212373] [INFO ] [MAIN      ] EOG: Wiping existing primary data before full refresh.
[2025-10-24T18:34:14.212441] [INFO ] [LOCAL     ] EOG: Starting deletion of primary data.
[2025-10-24T18:34:14.212846] [DEBUG] [LOCAL     ] EOG: Deleted primary data file.
[2025-10-24T18:34:14.212918] [INFO ] [MAIN      ] EOG: Starting full primary refresh.
[2025-10-24T18:34:14.552872] [INFO ] [REMOTE    ] ENVA: Fetching primary data for 2025-06.
[2025-10-24T18:34:14.566254] [INFO ] [REMOTE    ] EOG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:34:15.106097] [INFO ] [REMOTE    ] ENS: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T18:34:15.347713] [INFO ] [REMOTE    ] EOD: Fetching primary data for 2025-01.
[2025-10-24T18:34:15.819267] [INFO ] [REMOTE    ] ENVA: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T18:34:16.147744] [INFO ] [REMOTE    ] EOG: Fetching primary data for 2025-01.
[2025-10-24T18:34:16.710754] [INFO ] [REMOTE    ] EOD: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T18:34:16.947762] [INFO ] [REMOTE    ] ENS: Fetching primary data for 2025-09.
[2025-10-24T18:34:17.747621] [INFO ] [REMOTE    ] EOD: Fetching primary data for 2025-02.
[2025-10-24T18:34:18.099115] [INFO ] [REMOTE    ] EOG: Incremental fetch complete for 2025-01 (1.95 seconds).
[2025-10-24T18:34:18.293274] [INFO ] [REMOTE    ] ENS: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T18:34:18.502491] [INFO ] [REMOTE    ] EOD: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T18:34:18.547680] [INFO ] [REMOTE    ] EOD: Fetching primary data for 2025-03.
[2025-10-24T18:34:19.347708] [INFO ] [REMOTE    ] ENVA: Fetching primary data for 2025-07.
[2025-10-24T18:34:19.387398] [INFO ] [REMOTE    ] EOD: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T18:34:20.147706] [INFO ] [REMOTE    ] EOG: Fetching primary data for 2025-02.
[2025-10-24T18:34:20.677355] [INFO ] [REMOTE    ] ENVA: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T18:34:20.947736] [INFO ] [REMOTE    ] EOD: Fetching primary data for 2025-04.
[2025-10-24T18:34:21.747774] [INFO ] [REMOTE    ] ENS: Fetching primary data for 2025-10.
[2025-10-24T18:34:21.768322] [INFO ] [REMOTE    ] EOD: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T18:34:21.903087] [INFO ] [REMOTE    ] EOG: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T18:34:22.547637] [INFO ] [REMOTE    ] EOG: Fetching primary data for 2025-03.
[2025-10-24T18:34:23.347627] [INFO ] [REMOTE    ] ENVA: Fetching primary data for 2025-08.
[2025-10-24T18:34:23.418402] [INFO ] [REMOTE    ] ENS: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T18:34:23.424374] [INFO ] [REMOTE    ] ENS: Full fetch complete (42811 records).
[2025-10-24T18:34:23.424462] [DEBUG] [VALIDATOR ] ENS: Validating primary data.
[2025-10-24T18:34:23.874279] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present.
[2025-10-24T18:34:23.874361] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed.
[2025-10-24T18:34:23.875128] [INFO ] [MAIN      ] ENS: Fetched primary data is valid.
[2025-10-24T18:34:23.875192] [DEBUG] [LOCAL     ] ENS: Saving primary data.
[2025-10-24T18:34:23.875603] [FATAL] [LOCAL     ] ENS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:34:23.875726] [FATAL] [MAIN      ] ENS: Failed to save primary data.
[2025-10-24T18:34:23.875814] [WARN ] [MAIN      ] ENS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:34:23.875885] [INFO ] [LOCAL     ] ENS: Starting deletion of primary data.
[2025-10-24T18:34:23.875950] [DEBUG] [LOCAL     ] ENS: No primary data file found to delete.
[2025-10-24T18:34:23.876024] [INFO ] [LOCAL     ] ENS: Starting deletion of derivative data.
[2025-10-24T18:34:23.876224] [DEBUG] [LOCAL     ] ENS: Deleted derivative data file.
[2025-10-24T18:34:23.876318] [INFO ] [MAIN      ] Update Progress: 743/2366 symbols completed. ENS took 34.8s. Estimated remaining: 3h 26m 6s. Rate: 7.9 symbols/min
[2025-10-24T18:34:24.071137] [INFO ] [MAIN      ] EOI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:34:24.084352] [DEBUG] [LOCAL     ] EOI: Loaded 10479 existing records from primary storage.
[2025-10-24T18:34:24.084595] [INFO ] [MAIN      ] EOI: Loaded 10479 existing records.
[2025-10-24T18:34:24.154266] [INFO ] [REMOTE    ] EOD: Fetching primary data for 2025-05.
[2025-10-24T18:34:24.273562] [WARN ] [MAIN      ] EOI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:34:24.274344] [INFO ] [MAIN      ] EOI: Wiping existing primary data before full refresh.
[2025-10-24T18:34:24.274445] [INFO ] [LOCAL     ] EOI: Starting deletion of primary data.
[2025-10-24T18:34:24.274912] [DEBUG] [LOCAL     ] EOI: Deleted primary data file.
[2025-10-24T18:34:24.275138] [INFO ] [MAIN      ] EOI: Starting full primary refresh.
[2025-10-24T18:34:24.516155] [INFO ] [REMOTE    ] ENVA: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T18:34:24.585384] [INFO ] [REMOTE    ] EOG: Incremental fetch complete for 2025-03 (2.04 seconds).
[2025-10-24T18:34:24.693172] [INFO ] [REMOTE    ] EOI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:34:24.883297] [INFO ] [REMOTE    ] EOD: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T18:34:24.947666] [INFO ] [REMOTE    ] EOI: Fetching primary data for 2025-01.
[2025-10-24T18:34:25.747729] [INFO ] [REMOTE    ] ENVA: Fetching primary data for 2025-09.
[2025-10-24T18:34:26.282921] [INFO ] [REMOTE    ] EOI: Incremental fetch complete for 2025-01 (1.34 seconds).
[2025-10-24T18:34:26.547705] [INFO ] [REMOTE    ] EOI: Fetching primary data for 2025-02.
[2025-10-24T18:34:26.950800] [INFO ] [REMOTE    ] ENVA: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T18:34:27.178089] [INFO ] [REMOTE    ] EOI: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T18:34:27.347727] [INFO ] [REMOTE    ] EOG: Fetching primary data for 2025-04.
[2025-10-24T18:34:28.147742] [INFO ] [REMOTE    ] EOD: Fetching primary data for 2025-06.
[2025-10-24T18:34:28.947730] [INFO ] [REMOTE    ] ENVA: Fetching primary data for 2025-10.
[2025-10-24T18:34:29.248553] [INFO ] [REMOTE    ] EOD: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T18:34:29.374900] [INFO ] [REMOTE    ] EOG: Incremental fetch complete for 2025-04 (2.03 seconds).
[2025-10-24T18:34:29.747684] [INFO ] [REMOTE    ] EOI: Fetching primary data for 2025-03.
[2025-10-24T18:34:30.301248] [INFO ] [REMOTE    ] ENVA: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T18:34:30.305845] [INFO ] [REMOTE    ] ENVA: Full fetch complete (36770 records).
[2025-10-24T18:34:30.305931] [DEBUG] [VALIDATOR ] ENVA: Validating primary data.
[2025-10-24T18:34:30.431847] [INFO ] [REMOTE    ] EOI: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T18:34:30.555761] [INFO ] [REMOTE    ] EOD: Fetching primary data for 2025-07.
[2025-10-24T18:34:30.689369] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present.
[2025-10-24T18:34:30.689440] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed.
[2025-10-24T18:34:30.690018] [INFO ] [MAIN      ] ENVA: Fetched primary data is valid.
[2025-10-24T18:34:30.690078] [DEBUG] [LOCAL     ] ENVA: Saving primary data.
[2025-10-24T18:34:30.690410] [FATAL] [LOCAL     ] ENVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:34:30.690496] [FATAL] [MAIN      ] ENVA: Failed to save primary data.
[2025-10-24T18:34:30.690537] [WARN ] [MAIN      ] ENVA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:34:30.690572] [INFO ] [LOCAL     ] ENVA: Starting deletion of primary data.
[2025-10-24T18:34:30.690620] [DEBUG] [LOCAL     ] ENVA: No primary data file found to delete.
[2025-10-24T18:34:30.690691] [INFO ] [LOCAL     ] ENVA: Starting deletion of derivative data.
[2025-10-24T18:34:30.690848] [DEBUG] [LOCAL     ] ENVA: Deleted derivative data file.
[2025-10-24T18:34:30.690920] [INFO ] [MAIN      ] Update Progress: 744/2366 symbols completed. ENVA took 35.8s. Estimated remaining: 3h 25m 56s. Rate: 7.9 symbols/min
[2025-10-24T18:34:30.863035] [INFO ] [MAIN      ] EOS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:34:30.879679] [DEBUG] [LOCAL     ] EOS: Loaded 14754 existing records from primary storage.
[2025-10-24T18:34:30.879909] [INFO ] [MAIN      ] EOS: Loaded 14754 existing records.
[2025-10-24T18:34:31.059763] [WARN ] [MAIN      ] EOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:34:31.059989] [INFO ] [MAIN      ] EOS: Wiping existing primary data before full refresh.
[2025-10-24T18:34:31.060067] [INFO ] [LOCAL     ] EOS: Starting deletion of primary data.
[2025-10-24T18:34:31.060250] [DEBUG] [LOCAL     ] EOS: Deleted primary data file.
[2025-10-24T18:34:31.060305] [INFO ] [MAIN      ] EOS: Starting full primary refresh.
[2025-10-24T18:34:31.352731] [INFO ] [REMOTE    ] EOI: Fetching primary data for 2025-04.
[2025-10-24T18:34:31.412121] [INFO ] [REMOTE    ] EOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:34:31.708817] [INFO ] [REMOTE    ] EOD: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T18:34:32.147702] [INFO ] [REMOTE    ] EOG: Fetching primary data for 2025-05.
[2025-10-24T18:34:32.435243] [INFO ] [REMOTE    ] EOI: Incremental fetch complete for 2025-04 (1.08 seconds).
[2025-10-24T18:34:32.947661] [INFO ] [REMOTE    ] EOI: Fetching primary data for 2025-05.
[2025-10-24T18:34:33.747628] [INFO ] [REMOTE    ] EOD: Fetching primary data for 2025-08.
[2025-10-24T18:34:33.806308] [INFO ] [REMOTE    ] EOI: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T18:34:33.862745] [INFO ] [REMOTE    ] EOG: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T18:34:34.518354] [INFO ] [REMOTE    ] EOD: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T18:34:34.547682] [INFO ] [REMOTE    ] EOI: Fetching primary data for 2025-06.
[2025-10-24T18:34:35.272013] [INFO ] [REMOTE    ] EOI: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T18:34:35.347617] [INFO ] [REMOTE    ] EOD: Fetching primary data for 2025-09.
[2025-10-24T18:34:36.147626] [INFO ] [REMOTE    ] EOS: Fetching primary data for 2025-01.
[2025-10-24T18:34:36.258155] [INFO ] [REMOTE    ] EOD: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T18:34:36.947681] [INFO ] [REMOTE    ] EOG: Fetching primary data for 2025-06.
[2025-10-24T18:34:37.452385] [INFO ] [REMOTE    ] EOS: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T18:34:37.747726] [INFO ] [REMOTE    ] EOS: Fetching primary data for 2025-02.
[2025-10-24T18:34:38.547750] [INFO ] [REMOTE    ] EOD: Fetching primary data for 2025-10.
[2025-10-24T18:34:38.673391] [INFO ] [REMOTE    ] EOS: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T18:34:38.856940] [INFO ] [REMOTE    ] EOG: Incremental fetch complete for 2025-06 (1.91 seconds).
[2025-10-24T18:34:39.347736] [INFO ] [REMOTE    ] EOI: Fetching primary data for 2025-07.
[2025-10-24T18:34:39.626338] [INFO ] [REMOTE    ] EOD: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T18:34:39.629540] [INFO ] [REMOTE    ] EOD: Full fetch complete (20758 records).
[2025-10-24T18:34:39.629613] [DEBUG] [VALIDATOR ] EOD: Validating primary data.
[2025-10-24T18:34:39.994037] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present.
[2025-10-24T18:34:39.994112] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed.
[2025-10-24T18:34:39.994537] [INFO ] [MAIN      ] EOD: Fetched primary data is valid.
[2025-10-24T18:34:39.994576] [DEBUG] [LOCAL     ] EOD: Saving primary data.
[2025-10-24T18:34:39.994848] [FATAL] [LOCAL     ] EOD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:34:39.994933] [FATAL] [MAIN      ] EOD: Failed to save primary data.
[2025-10-24T18:34:39.994975] [WARN ] [MAIN      ] EOD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:34:39.995009] [INFO ] [LOCAL     ] EOD: Starting deletion of primary data.
[2025-10-24T18:34:39.995059] [DEBUG] [LOCAL     ] EOD: No primary data file found to delete.
[2025-10-24T18:34:39.995094] [INFO ] [LOCAL     ] EOD: Starting deletion of derivative data.
[2025-10-24T18:34:39.995227] [DEBUG] [LOCAL     ] EOD: Deleted derivative data file.
[2025-10-24T18:34:39.995296] [INFO ] [MAIN      ] Update Progress: 745/2366 symbols completed. EOD took 28.5s. Estimated remaining: 3h 25m 52s. Rate: 7.9 symbols/min
[2025-10-24T18:34:40.104511] [INFO ] [REMOTE    ] EOI: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T18:34:40.152897] [INFO ] [REMOTE    ] EOS: Fetching primary data for 2025-03.
[2025-10-24T18:34:40.177451] [INFO ] [MAIN      ] EOT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:34:40.186595] [DEBUG] [LOCAL     ] EOT: Loaded 7087 existing records from primary storage.
[2025-10-24T18:34:40.186837] [INFO ] [MAIN      ] EOT: Loaded 7087 existing records.
[2025-10-24T18:34:40.367431] [WARN ] [MAIN      ] EOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:34:40.367698] [INFO ] [MAIN      ] EOT: Wiping existing primary data before full refresh.
[2025-10-24T18:34:40.367756] [INFO ] [LOCAL     ] EOT: Starting deletion of primary data.
[2025-10-24T18:34:40.367904] [DEBUG] [LOCAL     ] EOT: Deleted primary data file.
[2025-10-24T18:34:40.367963] [INFO ] [MAIN      ] EOT: Starting full primary refresh.
[2025-10-24T18:34:40.718921] [INFO ] [REMOTE    ] EOT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:34:40.947613] [INFO ] [REMOTE    ] EOT: Fetching primary data for 2025-01.
[2025-10-24T18:34:41.333047] [INFO ] [REMOTE    ] EOS: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T18:34:41.747677] [INFO ] [REMOTE    ] EOI: Fetching primary data for 2025-08.
[2025-10-24T18:34:42.063422] [INFO ] [REMOTE    ] EOT: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T18:34:42.362176] [INFO ] [REMOTE    ] EOI: Incremental fetch complete for 2025-08 (0.61 seconds).
[2025-10-24T18:34:42.547677] [INFO ] [REMOTE    ] EOI: Fetching primary data for 2025-09.
[2025-10-24T18:34:43.294717] [INFO ] [REMOTE    ] EOI: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T18:34:43.347602] [INFO ] [REMOTE    ] EOI: Fetching primary data for 2025-10.
[2025-10-24T18:34:44.147624] [INFO ] [REMOTE    ] EOG: Fetching primary data for 2025-07.
[2025-10-24T18:34:44.249444] [INFO ] [REMOTE    ] EOI: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T18:34:44.251973] [INFO ] [REMOTE    ] EOI: Full fetch complete (15941 records).
[2025-10-24T18:34:44.252046] [DEBUG] [VALIDATOR ] EOI: Validating primary data.
[2025-10-24T18:34:44.619345] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present.
[2025-10-24T18:34:44.619419] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed.
[2025-10-24T18:34:44.619778] [INFO ] [MAIN      ] EOI: Fetched primary data is valid.
[2025-10-24T18:34:44.619839] [DEBUG] [LOCAL     ] EOI: Saving primary data.
[2025-10-24T18:34:44.620063] [FATAL] [LOCAL     ] EOI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:34:44.620140] [FATAL] [MAIN      ] EOI: Failed to save primary data.
[2025-10-24T18:34:44.620181] [WARN ] [MAIN      ] EOI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:34:44.620215] [INFO ] [LOCAL     ] EOI: Starting deletion of primary data.
[2025-10-24T18:34:44.620262] [DEBUG] [LOCAL     ] EOI: No primary data file found to delete.
[2025-10-24T18:34:44.620295] [INFO ] [LOCAL     ] EOI: Starting deletion of derivative data.
[2025-10-24T18:34:44.620457] [DEBUG] [LOCAL     ] EOI: Deleted derivative data file.
[2025-10-24T18:34:44.620558] [INFO ] [MAIN      ] Update Progress: 746/2366 symbols completed. EOI took 20.7s. Estimated remaining: 3h 25m 38s. Rate: 7.9 symbols/min
[2025-10-24T18:34:44.787857] [INFO ] [MAIN      ] EPAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:34:44.814340] [DEBUG] [LOCAL     ] EPAC: Loaded 26571 existing records from primary storage.
[2025-10-24T18:34:44.814633] [INFO ] [MAIN      ] EPAC: Loaded 26571 existing records.
[2025-10-24T18:34:44.956728] [INFO ] [REMOTE    ] EOS: Fetching primary data for 2025-04.
[2025-10-24T18:34:44.997209] [WARN ] [MAIN      ] EPAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:34:44.997433] [INFO ] [MAIN      ] EPAC: Wiping existing primary data before full refresh.
[2025-10-24T18:34:44.997480] [INFO ] [LOCAL     ] EPAC: Starting deletion of primary data.
[2025-10-24T18:34:44.997680] [DEBUG] [LOCAL     ] EPAC: Deleted primary data file.
[2025-10-24T18:34:44.997736] [INFO ] [MAIN      ] EPAC: Starting full primary refresh.
[2025-10-24T18:34:45.375145] [INFO ] [REMOTE    ] EPAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:34:45.747614] [INFO ] [REMOTE    ] EPAC: Fetching primary data for 2025-01.
[2025-10-24T18:34:46.117694] [INFO ] [REMOTE    ] EOG: Incremental fetch complete for 2025-07 (1.97 seconds).
[2025-10-24T18:34:46.148834] [INFO ] [REMOTE    ] EOS: Incremental fetch complete for 2025-04 (1.19 seconds).
[2025-10-24T18:34:46.547674] [INFO ] [REMOTE    ] EOG: Fetching primary data for 2025-08.
[2025-10-24T18:34:47.202608] [INFO ] [REMOTE    ] EPAC: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T18:34:47.347690] [INFO ] [REMOTE    ] EPAC: Fetching primary data for 2025-02.
[2025-10-24T18:34:48.147631] [INFO ] [REMOTE    ] EOT: Fetching primary data for 2025-02.
[2025-10-24T18:34:48.400936] [INFO ] [REMOTE    ] EOG: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T18:34:48.438342] [INFO ] [REMOTE    ] EPAC: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T18:34:48.681003] [INFO ] [REMOTE    ] EOT: Incremental fetch complete for 2025-02 (0.53 seconds).
[2025-10-24T18:34:48.947702] [INFO ] [REMOTE    ] EOS: Fetching primary data for 2025-05.
[2025-10-24T18:34:49.747716] [INFO ] [REMOTE    ] EOT: Fetching primary data for 2025-03.
[2025-10-24T18:34:49.957393] [INFO ] [REMOTE    ] EOS: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T18:34:50.218453] [INFO ] [REMOTE    ] EOT: Incremental fetch complete for 2025-03 (0.47 seconds).
[2025-10-24T18:34:50.547671] [INFO ] [REMOTE    ] EOS: Fetching primary data for 2025-06.
[2025-10-24T18:34:51.347634] [INFO ] [REMOTE    ] EOT: Fetching primary data for 2025-04.
[2025-10-24T18:34:51.515081] [INFO ] [REMOTE    ] EOS: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T18:34:52.130242] [INFO ] [REMOTE    ] EOT: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T18:34:52.147611] [INFO ] [REMOTE    ] EOT: Fetching primary data for 2025-05.
[2025-10-24T18:34:52.790470] [INFO ] [REMOTE    ] EOT: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T18:34:52.947634] [INFO ] [REMOTE    ] EOS: Fetching primary data for 2025-07.
[2025-10-24T18:34:53.747618] [INFO ] [REMOTE    ] EOG: Fetching primary data for 2025-09.
[2025-10-24T18:34:54.014572] [INFO ] [REMOTE    ] EOS: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T18:34:54.547718] [INFO ] [REMOTE    ] EOS: Fetching primary data for 2025-08.
[2025-10-24T18:34:55.347729] [INFO ] [REMOTE    ] EOT: Fetching primary data for 2025-06.
[2025-10-24T18:34:55.413674] [INFO ] [REMOTE    ] EOS: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T18:34:55.534615] [INFO ] [REMOTE    ] EOG: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T18:34:55.963209] [INFO ] [REMOTE    ] EOT: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T18:34:56.147669] [INFO ] [REMOTE    ] EOG: Fetching primary data for 2025-10.
[2025-10-24T18:34:56.947707] [INFO ] [REMOTE    ] EOT: Fetching primary data for 2025-07.
[2025-10-24T18:34:57.691066] [INFO ] [REMOTE    ] EOT: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T18:34:57.747717] [INFO ] [REMOTE    ] EOT: Fetching primary data for 2025-08.
[2025-10-24T18:34:57.952893] [INFO ] [REMOTE    ] EOG: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T18:34:57.962844] [INFO ] [REMOTE    ] EOG: Full fetch complete (77469 records).
[2025-10-24T18:34:57.962997] [DEBUG] [VALIDATOR ] EOG: Validating primary data.
[2025-10-24T18:34:58.361494] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present.
[2025-10-24T18:34:58.361621] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed.
[2025-10-24T18:34:58.362595] [INFO ] [MAIN      ] EOG: Fetched primary data is valid.
[2025-10-24T18:34:58.362683] [DEBUG] [LOCAL     ] EOG: Saving primary data.
[2025-10-24T18:34:58.363264] [FATAL] [LOCAL     ] EOG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:34:58.363377] [FATAL] [MAIN      ] EOG: Failed to save primary data.
[2025-10-24T18:34:58.363465] [WARN ] [MAIN      ] EOG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:34:58.363554] [INFO ] [LOCAL     ] EOG: Starting deletion of primary data.
[2025-10-24T18:34:58.363631] [DEBUG] [LOCAL     ] EOG: No primary data file found to delete.
[2025-10-24T18:34:58.363716] [INFO ] [LOCAL     ] EOG: Starting deletion of derivative data.
[2025-10-24T18:34:58.363894] [DEBUG] [LOCAL     ] EOG: Deleted derivative data file.
[2025-10-24T18:34:58.364466] [INFO ] [MAIN      ] Update Progress: 747/2366 symbols completed. EOG took 44.6s. Estimated remaining: 3h 25m 44s. Rate: 7.9 symbols/min
[2025-10-24T18:34:58.475593] [INFO ] [REMOTE    ] EOT: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T18:34:58.545243] [INFO ] [MAIN      ] EPAM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:34:58.547684] [INFO ] [REMOTE    ] EOT: Fetching primary data for 2025-09.
[2025-10-24T18:34:58.588370] [DEBUG] [LOCAL     ] EPAM: Loaded 39611 existing records from primary storage.
[2025-10-24T18:34:58.588670] [INFO ] [MAIN      ] EPAM: Loaded 39611 existing records.
[2025-10-24T18:34:58.763018] [WARN ] [MAIN      ] EPAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:34:58.763227] [INFO ] [MAIN      ] EPAM: Wiping existing primary data before full refresh.
[2025-10-24T18:34:58.763322] [INFO ] [LOCAL     ] EPAM: Starting deletion of primary data.
[2025-10-24T18:34:58.763743] [DEBUG] [LOCAL     ] EPAM: Deleted primary data file.
[2025-10-24T18:34:58.763800] [INFO ] [MAIN      ] EPAM: Starting full primary refresh.
[2025-10-24T18:34:59.115128] [INFO ] [REMOTE    ] EPAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:34:59.347609] [INFO ] [REMOTE    ] EPAM: Fetching primary data for 2025-01.
[2025-10-24T18:34:59.356684] [INFO ] [REMOTE    ] EOT: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T18:35:00.147715] [INFO ] [REMOTE    ] EPAC: Fetching primary data for 2025-03.
[2025-10-24T18:35:00.947694] [INFO ] [REMOTE    ] EOT: Fetching primary data for 2025-10.
[2025-10-24T18:35:01.475150] [INFO ] [REMOTE    ] EPAM: Incremental fetch complete for 2025-01 (2.13 seconds).
[2025-10-24T18:35:01.747629] [INFO ] [REMOTE    ] EOS: Fetching primary data for 2025-09.
[2025-10-24T18:35:01.826264] [INFO ] [REMOTE    ] EPAC: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T18:35:02.547712] [INFO ] [REMOTE    ] EPAC: Fetching primary data for 2025-04.
[2025-10-24T18:35:03.000891] [INFO ] [REMOTE    ] EOT: Incremental fetch complete for 2025-10 (2.05 seconds).
[2025-10-24T18:35:03.003843] [INFO ] [REMOTE    ] EOT: Full fetch complete (10680 records).
[2025-10-24T18:35:03.003966] [DEBUG] [VALIDATOR ] EOT: Validating primary data.
[2025-10-24T18:35:03.351403] [INFO ] [REMOTE    ] EPAM: Fetching primary data for 2025-02.
[2025-10-24T18:35:03.399293] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present.
[2025-10-24T18:35:03.399497] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed.
[2025-10-24T18:35:03.400026] [INFO ] [MAIN      ] EOT: Fetched primary data is valid.
[2025-10-24T18:35:03.400218] [DEBUG] [LOCAL     ] EOT: Saving primary data.
[2025-10-24T18:35:03.400527] [FATAL] [LOCAL     ] EOT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:35:03.400613] [FATAL] [MAIN      ] EOT: Failed to save primary data.
[2025-10-24T18:35:03.400720] [WARN ] [MAIN      ] EOT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:35:03.400793] [INFO ] [LOCAL     ] EOT: Starting deletion of primary data.
[2025-10-24T18:35:03.400856] [DEBUG] [LOCAL     ] EOT: No primary data file found to delete.
[2025-10-24T18:35:03.400893] [INFO ] [LOCAL     ] EOT: Starting deletion of derivative data.
[2025-10-24T18:35:03.401047] [DEBUG] [LOCAL     ] EOT: Deleted derivative data file.
[2025-10-24T18:35:03.401147] [INFO ] [MAIN      ] Update Progress: 748/2366 symbols completed. EOT took 23.4s. Estimated remaining: 3h 25m 31s. Rate: 7.9 symbols/min
[2025-10-24T18:35:03.541361] [INFO ] [REMOTE    ] EOS: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T18:35:03.595171] [INFO ] [MAIN      ] EPC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:35:03.638351] [DEBUG] [LOCAL     ] EPC: Loaded 40003 existing records from primary storage.
[2025-10-24T18:35:03.638778] [INFO ] [MAIN      ] EPC: Loaded 40003 existing records.
[2025-10-24T18:35:03.821309] [WARN ] [MAIN      ] EPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:35:03.821696] [INFO ] [MAIN      ] EPC: Wiping existing primary data before full refresh.
[2025-10-24T18:35:03.821773] [INFO ] [LOCAL     ] EPC: Starting deletion of primary data.
[2025-10-24T18:35:03.822089] [DEBUG] [LOCAL     ] EPC: Deleted primary data file.
[2025-10-24T18:35:03.822134] [INFO ] [MAIN      ] EPC: Starting full primary refresh.
[2025-10-24T18:35:04.152970] [INFO ] [REMOTE    ] EOS: Fetching primary data for 2025-10.
[2025-10-24T18:35:04.197786] [INFO ] [REMOTE    ] EPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:35:04.942609] [INFO ] [REMOTE    ] EPAC: Incremental fetch complete for 2025-04 (2.39 seconds).
[2025-10-24T18:35:04.948862] [INFO ] [REMOTE    ] EPC: Fetching primary data for 2025-01.
[2025-10-24T18:35:05.473061] [INFO ] [REMOTE    ] EPAM: Incremental fetch complete for 2025-02 (2.12 seconds).
[2025-10-24T18:35:05.747625] [INFO ] [REMOTE    ] EPAC: Fetching primary data for 2025-05.
[2025-10-24T18:35:06.053821] [INFO ] [REMOTE    ] EOS: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T18:35:06.057140] [INFO ] [REMOTE    ] EOS: Full fetch complete (22767 records).
[2025-10-24T18:35:06.057225] [DEBUG] [VALIDATOR ] EOS: Validating primary data.
[2025-10-24T18:35:06.425869] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present.
[2025-10-24T18:35:06.425946] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed.
[2025-10-24T18:35:06.426423] [INFO ] [MAIN      ] EOS: Fetched primary data is valid.
[2025-10-24T18:35:06.426463] [DEBUG] [LOCAL     ] EOS: Saving primary data.
[2025-10-24T18:35:06.426734] [FATAL] [LOCAL     ] EOS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:35:06.426819] [FATAL] [MAIN      ] EOS: Failed to save primary data.
[2025-10-24T18:35:06.426860] [WARN ] [MAIN      ] EOS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:35:06.426895] [INFO ] [LOCAL     ] EOS: Starting deletion of primary data.
[2025-10-24T18:35:06.426945] [DEBUG] [LOCAL     ] EOS: No primary data file found to delete.
[2025-10-24T18:35:06.426980] [INFO ] [LOCAL     ] EOS: Starting deletion of derivative data.
[2025-10-24T18:35:06.427131] [DEBUG] [LOCAL     ] EOS: Deleted derivative data file.
[2025-10-24T18:35:06.427226] [INFO ] [MAIN      ] Update Progress: 749/2366 symbols completed. EOS took 35.7s. Estimated remaining: 3h 25m 13s. Rate: 7.9 symbols/min
[2025-10-24T18:35:06.549595] [INFO ] [REMOTE    ] EPAM: Fetching primary data for 2025-03.
[2025-10-24T18:35:06.601059] [INFO ] [MAIN      ] EPD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:35:06.665891] [DEBUG] [LOCAL     ] EPD: Loaded 53998 existing records from primary storage.
[2025-10-24T18:35:06.666480] [INFO ] [REMOTE    ] EPAC: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T18:35:06.671311] [INFO ] [MAIN      ] EPD: Loaded 53998 existing records.
[2025-10-24T18:35:06.868264] [INFO ] [REMOTE    ] EPC: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T18:35:06.888456] [WARN ] [MAIN      ] EPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:35:06.889601] [INFO ] [MAIN      ] EPD: Wiping existing primary data before full refresh.
[2025-10-24T18:35:06.889684] [INFO ] [LOCAL     ] EPD: Starting deletion of primary data.
[2025-10-24T18:35:06.890018] [DEBUG] [LOCAL     ] EPD: Deleted primary data file.
[2025-10-24T18:35:06.890075] [INFO ] [MAIN      ] EPD: Starting full primary refresh.
[2025-10-24T18:35:07.251522] [INFO ] [REMOTE    ] EPD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:35:07.347696] [INFO ] [REMOTE    ] EPAC: Fetching primary data for 2025-06.
[2025-10-24T18:35:08.147622] [INFO ] [REMOTE    ] EPD: Fetching primary data for 2025-01.
[2025-10-24T18:35:08.353709] [INFO ] [REMOTE    ] EPAM: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T18:35:08.463918] [INFO ] [REMOTE    ] EPAC: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T18:35:08.947704] [INFO ] [REMOTE    ] EPAC: Fetching primary data for 2025-07.
[2025-10-24T18:35:09.747738] [INFO ] [REMOTE    ] EPC: Fetching primary data for 2025-02.
[2025-10-24T18:35:10.187956] [INFO ] [REMOTE    ] EPD: Incremental fetch complete for 2025-01 (2.04 seconds).
[2025-10-24T18:35:10.243528] [INFO ] [REMOTE    ] EPAC: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T18:35:10.547685] [INFO ] [REMOTE    ] EPD: Fetching primary data for 2025-02.
[2025-10-24T18:35:11.195084] [INFO ] [REMOTE    ] EPC: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T18:35:11.347687] [INFO ] [REMOTE    ] EPAM: Fetching primary data for 2025-04.
[2025-10-24T18:35:12.147635] [INFO ] [REMOTE    ] EPC: Fetching primary data for 2025-03.
[2025-10-24T18:35:12.353305] [INFO ] [REMOTE    ] EPD: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T18:35:12.947669] [INFO ] [REMOTE    ] EPD: Fetching primary data for 2025-03.
[2025-10-24T18:35:13.171948] [INFO ] [REMOTE    ] EPAM: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T18:35:13.254928] [INFO ] [REMOTE    ] EPC: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T18:35:13.747679] [INFO ] [REMOTE    ] EPC: Fetching primary data for 2025-04.
[2025-10-24T18:35:14.547701] [INFO ] [REMOTE    ] EPAC: Fetching primary data for 2025-08.
[2025-10-24T18:35:14.873335] [INFO ] [REMOTE    ] EPD: Incremental fetch complete for 2025-03 (1.93 seconds).
[2025-10-24T18:35:15.192893] [INFO ] [REMOTE    ] EPC: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T18:35:15.347694] [INFO ] [REMOTE    ] EPAM: Fetching primary data for 2025-05.
[2025-10-24T18:35:16.072117] [INFO ] [REMOTE    ] EPAC: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T18:35:16.147722] [INFO ] [REMOTE    ] EPC: Fetching primary data for 2025-05.
[2025-10-24T18:35:16.725549] [INFO ] [REMOTE    ] EPAM: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T18:35:16.947699] [INFO ] [REMOTE    ] EPD: Fetching primary data for 2025-04.
[2025-10-24T18:35:17.513903] [INFO ] [REMOTE    ] EPC: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T18:35:17.747721] [INFO ] [REMOTE    ] EPC: Fetching primary data for 2025-06.
[2025-10-24T18:35:18.547718] [INFO ] [REMOTE    ] EPAC: Fetching primary data for 2025-09.
[2025-10-24T18:35:18.887491] [INFO ] [REMOTE    ] EPD: Incremental fetch complete for 2025-04 (1.94 seconds).
[2025-10-24T18:35:19.143407] [INFO ] [REMOTE    ] EPC: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T18:35:19.347709] [INFO ] [REMOTE    ] EPC: Fetching primary data for 2025-07.
[2025-10-24T18:35:19.511609] [INFO ] [REMOTE    ] EPAC: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T18:35:20.147712] [INFO ] [REMOTE    ] EPAC: Fetching primary data for 2025-10.
[2025-10-24T18:35:20.593112] [INFO ] [REMOTE    ] EPC: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T18:35:20.947638] [INFO ] [REMOTE    ] EPC: Fetching primary data for 2025-08.
[2025-10-24T18:35:21.437268] [INFO ] [REMOTE    ] EPAC: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T18:35:21.442559] [INFO ] [REMOTE    ] EPAC: Full fetch complete (38851 records).
[2025-10-24T18:35:21.442717] [DEBUG] [VALIDATOR ] EPAC: Validating primary data.
[2025-10-24T18:35:21.752942] [INFO ] [REMOTE    ] EPD: Fetching primary data for 2025-05.
[2025-10-24T18:35:21.827407] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present.
[2025-10-24T18:35:21.827488] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed.
[2025-10-24T18:35:21.828100] [INFO ] [MAIN      ] EPAC: Fetched primary data is valid.
[2025-10-24T18:35:21.828162] [DEBUG] [LOCAL     ] EPAC: Saving primary data.
[2025-10-24T18:35:21.828515] [FATAL] [LOCAL     ] EPAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:35:21.828593] [FATAL] [MAIN      ] EPAC: Failed to save primary data.
[2025-10-24T18:35:21.828634] [WARN ] [MAIN      ] EPAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:35:21.828710] [INFO ] [LOCAL     ] EPAC: Starting deletion of primary data.
[2025-10-24T18:35:21.828767] [DEBUG] [LOCAL     ] EPAC: No primary data file found to delete.
[2025-10-24T18:35:21.828802] [INFO ] [LOCAL     ] EPAC: Starting deletion of derivative data.
[2025-10-24T18:35:21.828988] [DEBUG] [LOCAL     ] EPAC: Deleted derivative data file.
[2025-10-24T18:35:21.829078] [INFO ] [MAIN      ] Update Progress: 750/2366 symbols completed. EPAC took 37.2s. Estimated remaining: 3h 25m 22s. Rate: 7.9 symbols/min
[2025-10-24T18:35:22.001868] [INFO ] [MAIN      ] EPR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:35:22.002041] [DEBUG] [LOCAL     ] EPR: No existing data file found in primary storage.
[2025-10-24T18:35:22.002078] [WARN ] [MAIN      ] EPR: No existing data found, performing full refresh instead.
[2025-10-24T18:35:22.002190] [INFO ] [MAIN      ] EPR: Wiping existing primary data before full refresh.
[2025-10-24T18:35:22.002232] [INFO ] [LOCAL     ] EPR: Starting deletion of primary data.
[2025-10-24T18:35:22.002275] [DEBUG] [LOCAL     ] EPR: No primary data file found to delete.
[2025-10-24T18:35:22.002308] [INFO ] [MAIN      ] EPR: Starting full primary refresh.
[2025-10-24T18:35:22.366431] [INFO ] [REMOTE    ] EPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:35:22.392169] [INFO ] [REMOTE    ] EPC: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T18:35:22.547699] [INFO ] [REMOTE    ] EPR: Fetching primary data for 2025-01.
[2025-10-24T18:35:23.347696] [INFO ] [REMOTE    ] EPAM: Fetching primary data for 2025-06.
[2025-10-24T18:35:23.903045] [INFO ] [REMOTE    ] EPD: Incremental fetch complete for 2025-05 (2.15 seconds).
[2025-10-24T18:35:24.147730] [INFO ] [REMOTE    ] EPD: Fetching primary data for 2025-06.
[2025-10-24T18:35:24.368063] [INFO ] [REMOTE    ] EPR: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T18:35:24.947621] [INFO ] [REMOTE    ] EPR: Fetching primary data for 2025-02.
[2025-10-24T18:35:25.012432] [INFO ] [REMOTE    ] EPAM: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T18:35:25.671763] [INFO ] [REMOTE    ] EPD: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T18:35:25.747617] [INFO ] [REMOTE    ] EPC: Fetching primary data for 2025-09.
[2025-10-24T18:35:26.365972] [INFO ] [REMOTE    ] EPR: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T18:35:26.547693] [INFO ] [REMOTE    ] EPAM: Fetching primary data for 2025-07.
[2025-10-24T18:35:27.213256] [INFO ] [REMOTE    ] EPC: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T18:35:27.347607] [INFO ] [REMOTE    ] EPC: Fetching primary data for 2025-10.
[2025-10-24T18:35:28.032432] [INFO ] [REMOTE    ] EPAM: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T18:35:28.147627] [INFO ] [REMOTE    ] EPD: Fetching primary data for 2025-07.
[2025-10-24T18:35:28.626492] [INFO ] [REMOTE    ] EPC: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T18:35:28.633773] [INFO ] [REMOTE    ] EPC: Full fetch complete (57332 records).
[2025-10-24T18:35:28.633986] [DEBUG] [VALIDATOR ] EPC: Validating primary data.
[2025-10-24T18:35:28.953398] [INFO ] [REMOTE    ] EPAM: Fetching primary data for 2025-08.
[2025-10-24T18:35:29.051043] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present.
[2025-10-24T18:35:29.051127] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed.
[2025-10-24T18:35:29.051901] [INFO ] [MAIN      ] EPC: Fetched primary data is valid.
[2025-10-24T18:35:29.051969] [DEBUG] [LOCAL     ] EPC: Saving primary data.
[2025-10-24T18:35:29.052464] [FATAL] [LOCAL     ] EPC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:35:29.052554] [FATAL] [MAIN      ] EPC: Failed to save primary data.
[2025-10-24T18:35:29.052596] [WARN ] [MAIN      ] EPC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:35:29.052631] [INFO ] [LOCAL     ] EPC: Starting deletion of primary data.
[2025-10-24T18:35:29.052724] [DEBUG] [LOCAL     ] EPC: No primary data file found to delete.
[2025-10-24T18:35:29.052768] [INFO ] [LOCAL     ] EPC: Starting deletion of derivative data.
[2025-10-24T18:35:29.052905] [DEBUG] [LOCAL     ] EPC: Deleted derivative data file.
[2025-10-24T18:35:29.053135] [INFO ] [MAIN      ] Update Progress: 751/2366 symbols completed. EPC took 25.7s. Estimated remaining: 3h 25m 14s. Rate: 7.9 symbols/min
[2025-10-24T18:35:29.234746] [INFO ] [MAIN      ] EPRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:35:29.282206] [DEBUG] [LOCAL     ] EPRT: Loaded 48861 existing records from primary storage.
[2025-10-24T18:35:29.282501] [INFO ] [MAIN      ] EPRT: Loaded 48861 existing records.
[2025-10-24T18:35:29.467628] [WARN ] [MAIN      ] EPRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:35:29.467851] [INFO ] [MAIN      ] EPRT: Wiping existing primary data before full refresh.
[2025-10-24T18:35:29.467900] [INFO ] [LOCAL     ] EPRT: Starting deletion of primary data.
[2025-10-24T18:35:29.468284] [DEBUG] [LOCAL     ] EPRT: Deleted primary data file.
[2025-10-24T18:35:29.468364] [INFO ] [MAIN      ] EPRT: Starting full primary refresh.
[2025-10-24T18:35:29.752788] [INFO ] [REMOTE    ] EPR: Fetching primary data for 2025-03.
[2025-10-24T18:35:29.860043] [INFO ] [REMOTE    ] EPRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:35:30.203670] [INFO ] [REMOTE    ] EPD: Incremental fetch complete for 2025-07 (2.06 seconds).
[2025-10-24T18:35:30.547675] [INFO ] [REMOTE    ] EPD: Fetching primary data for 2025-08.
[2025-10-24T18:35:30.571796] [INFO ] [REMOTE    ] EPAM: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T18:35:31.091216] [INFO ] [REMOTE    ] EPR: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T18:35:31.347725] [INFO ] [REMOTE    ] EPRT: Fetching primary data for 2025-01.
[2025-10-24T18:35:32.102918] [INFO ] [REMOTE    ] EPD: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T18:35:32.147673] [INFO ] [REMOTE    ] EPR: Fetching primary data for 2025-04.
[2025-10-24T18:35:32.947628] [INFO ] [REMOTE    ] EPD: Fetching primary data for 2025-09.
[2025-10-24T18:35:33.071137] [INFO ] [REMOTE    ] EPRT: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T18:35:33.657250] [INFO ] [REMOTE    ] EPR: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T18:35:33.747625] [INFO ] [REMOTE    ] EPR: Fetching primary data for 2025-05.
[2025-10-24T18:35:34.547610] [INFO ] [REMOTE    ] EPRT: Fetching primary data for 2025-02.
[2025-10-24T18:35:34.944606] [INFO ] [REMOTE    ] EPD: Incremental fetch complete for 2025-09 (2.00 seconds).
[2025-10-24T18:35:35.353353] [INFO ] [REMOTE    ] EPAM: Fetching primary data for 2025-09.
[2025-10-24T18:35:35.366350] [INFO ] [REMOTE    ] EPR: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T18:35:35.834554] [INFO ] [REMOTE    ] EPRT: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T18:35:36.147677] [INFO ] [REMOTE    ] EPRT: Fetching primary data for 2025-03.
[2025-10-24T18:35:36.947700] [INFO ] [REMOTE    ] EPD: Fetching primary data for 2025-10.
[2025-10-24T18:35:37.075862] [INFO ] [REMOTE    ] EPAM: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T18:35:37.399496] [INFO ] [REMOTE    ] EPRT: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T18:35:37.747682] [INFO ] [REMOTE    ] EPR: Fetching primary data for 2025-06.
[2025-10-24T18:35:38.547738] [INFO ] [REMOTE    ] EPRT: Fetching primary data for 2025-04.
[2025-10-24T18:35:38.834164] [INFO ] [REMOTE    ] EPD: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T18:35:38.849165] [INFO ] [REMOTE    ] EPD: Full fetch complete (77776 records).
[2025-10-24T18:35:38.849357] [DEBUG] [VALIDATOR ] EPD: Validating primary data.
[2025-10-24T18:35:39.247228] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present.
[2025-10-24T18:35:39.247338] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed.
[2025-10-24T18:35:39.248319] [INFO ] [MAIN      ] EPD: Fetched primary data is valid.
[2025-10-24T18:35:39.248401] [DEBUG] [LOCAL     ] EPD: Saving primary data.
[2025-10-24T18:35:39.249130] [FATAL] [LOCAL     ] EPD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:35:39.249302] [FATAL] [MAIN      ] EPD: Failed to save primary data.
[2025-10-24T18:35:39.249368] [WARN ] [MAIN      ] EPD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:35:39.249435] [INFO ] [LOCAL     ] EPD: Starting deletion of primary data.
[2025-10-24T18:35:39.249495] [DEBUG] [LOCAL     ] EPD: No primary data file found to delete.
[2025-10-24T18:35:39.249531] [INFO ] [LOCAL     ] EPD: Starting deletion of derivative data.
[2025-10-24T18:35:39.249730] [DEBUG] [LOCAL     ] EPD: Deleted derivative data file.
[2025-10-24T18:35:39.250096] [INFO ] [MAIN      ] Update Progress: 752/2366 symbols completed. EPD took 32.8s. Estimated remaining: 3h 25m 12s. Rate: 7.9 symbols/min
[2025-10-24T18:35:39.351578] [INFO ] [REMOTE    ] EPAM: Fetching primary data for 2025-10.
[2025-10-24T18:35:39.450862] [INFO ] [MAIN      ] EQBK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:35:39.451914] [INFO ] [REMOTE    ] EPR: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T18:35:39.472900] [DEBUG] [LOCAL     ] EQBK: Loaded 11385 existing records from primary storage.
[2025-10-24T18:35:39.473128] [INFO ] [MAIN      ] EQBK: Loaded 11385 existing records.
[2025-10-24T18:35:39.650307] [WARN ] [MAIN      ] EQBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:35:39.650508] [INFO ] [MAIN      ] EQBK: Wiping existing primary data before full refresh.
[2025-10-24T18:35:39.650553] [INFO ] [LOCAL     ] EQBK: Starting deletion of primary data.
[2025-10-24T18:35:39.650810] [DEBUG] [LOCAL     ] EQBK: Deleted primary data file.
[2025-10-24T18:35:39.650865] [INFO ] [MAIN      ] EQBK: Starting full primary refresh.
[2025-10-24T18:35:40.009224] [INFO ] [REMOTE    ] EQBK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:35:40.066187] [INFO ] [REMOTE    ] EPRT: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T18:35:40.147611] [INFO ] [REMOTE    ] EPRT: Fetching primary data for 2025-05.
[2025-10-24T18:35:40.947707] [INFO ] [REMOTE    ] EPR: Fetching primary data for 2025-07.
[2025-10-24T18:35:41.103748] [INFO ] [REMOTE    ] EPAM: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T18:35:41.110731] [INFO ] [REMOTE    ] EPAM: Full fetch complete (56682 records).
[2025-10-24T18:35:41.110846] [DEBUG] [VALIDATOR ] EPAM: Validating primary data.
[2025-10-24T18:35:41.497889] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present.
[2025-10-24T18:35:41.498122] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed.
[2025-10-24T18:35:41.498962] [INFO ] [MAIN      ] EPAM: Fetched primary data is valid.
[2025-10-24T18:35:41.499044] [DEBUG] [LOCAL     ] EPAM: Saving primary data.
[2025-10-24T18:35:41.499571] [FATAL] [LOCAL     ] EPAM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:35:41.499678] [FATAL] [MAIN      ] EPAM: Failed to save primary data.
[2025-10-24T18:35:41.499733] [WARN ] [MAIN      ] EPAM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:35:41.499797] [INFO ] [LOCAL     ] EPAM: Starting deletion of primary data.
[2025-10-24T18:35:41.499882] [DEBUG] [LOCAL     ] EPAM: No primary data file found to delete.
[2025-10-24T18:35:41.499940] [INFO ] [LOCAL     ] EPAM: Starting deletion of derivative data.
[2025-10-24T18:35:41.500119] [DEBUG] [LOCAL     ] EPAM: Deleted derivative data file.
[2025-10-24T18:35:41.500726] [INFO ] [MAIN      ] Update Progress: 753/2366 symbols completed. EPAM took 43.1s. Estimated remaining: 3h 24m 53s. Rate: 7.9 symbols/min
[2025-10-24T18:35:41.674670] [INFO ] [MAIN      ] EQH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:35:41.703391] [INFO ] [REMOTE    ] EPRT: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T18:35:41.748552] [INFO ] [REMOTE    ] EQBK: Fetching primary data for 2025-01.
[2025-10-24T18:35:41.766264] [DEBUG] [LOCAL     ] EQH: Loaded 53065 existing records from primary storage.
[2025-10-24T18:35:41.766697] [INFO ] [MAIN      ] EQH: Loaded 53065 existing records.
[2025-10-24T18:35:41.955505] [WARN ] [MAIN      ] EQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:35:41.955744] [INFO ] [MAIN      ] EQH: Wiping existing primary data before full refresh.
[2025-10-24T18:35:41.955798] [INFO ] [LOCAL     ] EQH: Starting deletion of primary data.
[2025-10-24T18:35:41.956134] [DEBUG] [LOCAL     ] EQH: Deleted primary data file.
[2025-10-24T18:35:41.956173] [INFO ] [MAIN      ] EQH: Starting full primary refresh.
[2025-10-24T18:35:42.306764] [INFO ] [REMOTE    ] EQH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:35:42.479853] [INFO ] [REMOTE    ] EPR: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T18:35:42.547702] [INFO ] [REMOTE    ] EPR: Fetching primary data for 2025-08.
[2025-10-24T18:35:42.571722] [INFO ] [REMOTE    ] EQBK: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T18:35:43.347681] [INFO ] [REMOTE    ] EPRT: Fetching primary data for 2025-06.
[2025-10-24T18:35:43.939491] [INFO ] [REMOTE    ] EPR: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T18:35:44.147628] [INFO ] [REMOTE    ] EQH: Fetching primary data for 2025-01.
[2025-10-24T18:35:44.947626] [INFO ] [REMOTE    ] EQBK: Fetching primary data for 2025-02.
[2025-10-24T18:35:44.988447] [INFO ] [REMOTE    ] EPRT: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T18:35:45.392248] [INFO ] [REMOTE    ] EQBK: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T18:35:45.609567] [INFO ] [REMOTE    ] EQH: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T18:35:45.747693] [INFO ] [REMOTE    ] EQBK: Fetching primary data for 2025-03.
[2025-10-24T18:35:46.500946] [INFO ] [REMOTE    ] EQBK: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T18:35:46.547685] [INFO ] [REMOTE    ] EQH: Fetching primary data for 2025-02.
[2025-10-24T18:35:47.347745] [INFO ] [REMOTE    ] EPR: Fetching primary data for 2025-09.
[2025-10-24T18:35:48.147720] [INFO ] [REMOTE    ] EQBK: Fetching primary data for 2025-04.
[2025-10-24T18:35:48.214477] [INFO ] [REMOTE    ] EQH: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T18:35:48.947675] [INFO ] [REMOTE    ] EQH: Fetching primary data for 2025-03.
[2025-10-24T18:35:49.104941] [INFO ] [REMOTE    ] EPR: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T18:35:49.141860] [INFO ] [REMOTE    ] EQBK: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T18:35:49.747672] [INFO ] [REMOTE    ] EPRT: Fetching primary data for 2025-07.
[2025-10-24T18:35:50.372544] [INFO ] [REMOTE    ] EQH: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T18:35:50.547638] [INFO ] [REMOTE    ] EPR: Fetching primary data for 2025-10.
[2025-10-24T18:35:51.347689] [INFO ] [REMOTE    ] EQH: Fetching primary data for 2025-04.
[2025-10-24T18:35:51.523939] [INFO ] [REMOTE    ] EPRT: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T18:35:52.147691] [INFO ] [REMOTE    ] EPRT: Fetching primary data for 2025-08.
[2025-10-24T18:35:52.193992] [INFO ] [REMOTE    ] EPR: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T18:35:52.201932] [INFO ] [REMOTE    ] EPR: Full fetch complete (63275 records).
[2025-10-24T18:35:52.202059] [DEBUG] [VALIDATOR ] EPR: Validating primary data.
[2025-10-24T18:35:52.596940] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present.
[2025-10-24T18:35:52.597056] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed.
[2025-10-24T18:35:52.597911] [INFO ] [MAIN      ] EPR: Fetched primary data is valid.
[2025-10-24T18:35:52.597976] [DEBUG] [LOCAL     ] EPR: Saving primary data.
[2025-10-24T18:35:52.598568] [FATAL] [LOCAL     ] EPR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:35:52.598700] [FATAL] [MAIN      ] EPR: Failed to save primary data.
[2025-10-24T18:35:52.598783] [WARN ] [MAIN      ] EPR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:35:52.598869] [INFO ] [LOCAL     ] EPR: Starting deletion of primary data.
[2025-10-24T18:35:52.598945] [DEBUG] [LOCAL     ] EPR: No primary data file found to delete.
[2025-10-24T18:35:52.598992] [INFO ] [LOCAL     ] EPR: Starting deletion of derivative data.
[2025-10-24T18:35:52.599049] [DEBUG] [LOCAL     ] EPR: No derivative data file found to delete.
[2025-10-24T18:35:52.599131] [INFO ] [MAIN      ] Update Progress: 754/2366 symbols completed. EPR took 30.8s. Estimated remaining: 3h 24m 52s. Rate: 7.9 symbols/min
[2025-10-24T18:35:52.775138] [INFO ] [MAIN      ] EQNR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:35:52.826168] [DEBUG] [LOCAL     ] EQNR: Loaded 53437 existing records from primary storage.
[2025-10-24T18:35:52.826491] [INFO ] [MAIN      ] EQNR: Loaded 53437 existing records.
[2025-10-24T18:35:52.952673] [INFO ] [REMOTE    ] EQBK: Fetching primary data for 2025-05.
[2025-10-24T18:35:53.013547] [WARN ] [MAIN      ] EQNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:35:53.014096] [INFO ] [MAIN      ] EQNR: Wiping existing primary data before full refresh.
[2025-10-24T18:35:53.014170] [INFO ] [LOCAL     ] EQNR: Starting deletion of primary data.
[2025-10-24T18:35:53.015160] [DEBUG] [LOCAL     ] EQNR: Deleted primary data file.
[2025-10-24T18:35:53.015227] [INFO ] [MAIN      ] EQNR: Starting full primary refresh.
[2025-10-24T18:35:53.350420] [INFO ] [REMOTE    ] EQH: Incremental fetch complete for 2025-04 (2.00 seconds).
[2025-10-24T18:35:53.452363] [INFO ] [REMOTE    ] EQNR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:35:53.635787] [INFO ] [REMOTE    ] EPRT: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T18:35:53.747616] [INFO ] [REMOTE    ] EPRT: Fetching primary data for 2025-09.
[2025-10-24T18:35:53.872028] [INFO ] [REMOTE    ] EQBK: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T18:35:54.547681] [INFO ] [REMOTE    ] EQNR: Fetching primary data for 2025-01.
[2025-10-24T18:35:55.347633] [INFO ] [REMOTE    ] EQH: Fetching primary data for 2025-05.
[2025-10-24T18:35:55.531630] [INFO ] [REMOTE    ] EPRT: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T18:35:56.147631] [INFO ] [REMOTE    ] EPRT: Fetching primary data for 2025-10.
[2025-10-24T18:35:56.797081] [INFO ] [REMOTE    ] EQNR: Incremental fetch complete for 2025-01 (2.25 seconds).
[2025-10-24T18:35:56.947618] [INFO ] [REMOTE    ] EQNR: Fetching primary data for 2025-02.
[2025-10-24T18:35:57.166484] [INFO ] [REMOTE    ] EQH: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T18:35:57.748126] [INFO ] [REMOTE    ] EQBK: Fetching primary data for 2025-06.
[2025-10-24T18:35:57.748030] [INFO ] [REMOTE    ] EPRT: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T18:35:57.759098] [INFO ] [REMOTE    ] EPRT: Full fetch complete (69612 records).
[2025-10-24T18:35:57.759261] [DEBUG] [VALIDATOR ] EPRT: Validating primary data.
[2025-10-24T18:35:58.187011] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present.
[2025-10-24T18:35:58.187153] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed.
[2025-10-24T18:35:58.188214] [INFO ] [MAIN      ] EPRT: Fetched primary data is valid.
[2025-10-24T18:35:58.188279] [DEBUG] [LOCAL     ] EPRT: Saving primary data.
[2025-10-24T18:35:58.188900] [FATAL] [LOCAL     ] EPRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:35:58.189001] [FATAL] [MAIN      ] EPRT: Failed to save primary data.
[2025-10-24T18:35:58.189043] [WARN ] [MAIN      ] EPRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:35:58.189082] [INFO ] [LOCAL     ] EPRT: Starting deletion of primary data.
[2025-10-24T18:35:58.189155] [DEBUG] [LOCAL     ] EPRT: No primary data file found to delete.
[2025-10-24T18:35:58.189223] [INFO ] [LOCAL     ] EPRT: Starting deletion of derivative data.
[2025-10-24T18:35:58.189456] [DEBUG] [LOCAL     ] EPRT: Deleted derivative data file.
[2025-10-24T18:35:58.189917] [INFO ] [MAIN      ] Update Progress: 755/2366 symbols completed. EPRT took 29.1s. Estimated remaining: 3h 24m 40s. Rate: 7.9 symbols/min
[2025-10-24T18:35:58.386411] [INFO ] [MAIN      ] EQR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:35:58.439829] [DEBUG] [LOCAL     ] EQR: Loaded 52192 existing records from primary storage.
[2025-10-24T18:35:58.440139] [INFO ] [MAIN      ] EQR: Loaded 52192 existing records.
[2025-10-24T18:35:58.557210] [INFO ] [REMOTE    ] EQH: Fetching primary data for 2025-06.
[2025-10-24T18:35:58.644004] [WARN ] [MAIN      ] EQR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:35:58.644242] [INFO ] [MAIN      ] EQR: Wiping existing primary data before full refresh.
[2025-10-24T18:35:58.644371] [INFO ] [LOCAL     ] EQR: Starting deletion of primary data.
[2025-10-24T18:35:58.645437] [INFO ] [REMOTE    ] EQBK: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T18:35:58.658831] [DEBUG] [LOCAL     ] EQR: Deleted primary data file.
[2025-10-24T18:35:58.672982] [INFO ] [MAIN      ] EQR: Starting full primary refresh.
[2025-10-24T18:35:58.747727] [INFO ] [REMOTE    ] EQNR: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T18:35:59.042096] [INFO ] [REMOTE    ] EQR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:35:59.347686] [INFO ] [REMOTE    ] EQNR: Fetching primary data for 2025-03.
[2025-10-24T18:36:00.155777] [INFO ] [REMOTE    ] EQBK: Fetching primary data for 2025-07.
[2025-10-24T18:36:00.163953] [INFO ] [REMOTE    ] EQH: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T18:36:00.947730] [INFO ] [REMOTE    ] EQH: Fetching primary data for 2025-07.
[2025-10-24T18:36:01.747708] [INFO ] [REMOTE    ] EQR: Fetching primary data for 2025-01.
[2025-10-24T18:36:01.864103] [INFO ] [REMOTE    ] EQBK: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T18:36:02.160442] [INFO ] [REMOTE    ] EQNR: Incremental fetch complete for 2025-03 (2.81 seconds).
[2025-10-24T18:36:02.547673] [INFO ] [REMOTE    ] EQNR: Fetching primary data for 2025-04.
[2025-10-24T18:36:03.347734] [INFO ] [REMOTE    ] EQBK: Fetching primary data for 2025-08.
[2025-10-24T18:36:04.930295] [INFO ] [REMOTE    ] EQH: Incremental fetch complete for 2025-07 (3.98 seconds).
[2025-10-24T18:36:04.941638] [INFO ] [REMOTE    ] EQH: Fetching primary data for 2025-08.
[2025-10-24T18:36:05.016102] [INFO ] [REMOTE    ] EQBK: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T18:36:05.019504] [INFO ] [REMOTE    ] EQBK: Fetching primary data for 2025-09.
[2025-10-24T18:36:05.420077] [INFO ] [REMOTE    ] EQR: Incremental fetch complete for 2025-01 (3.67 seconds).
[2025-10-24T18:36:05.531357] [INFO ] [REMOTE    ] EQNR: Incremental fetch complete for 2025-04 (2.98 seconds).
[2025-10-24T18:36:05.747636] [INFO ] [REMOTE    ] EQNR: Fetching primary data for 2025-05.
[2025-10-24T18:36:06.176954] [INFO ] [REMOTE    ] EQBK: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T18:36:06.440064] [INFO ] [REMOTE    ] EQH: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T18:36:06.547676] [INFO ] [REMOTE    ] EQBK: Fetching primary data for 2025-10.
[2025-10-24T18:36:07.347733] [INFO ] [REMOTE    ] EQH: Fetching primary data for 2025-09.
[2025-10-24T18:36:07.515073] [INFO ] [REMOTE    ] EQBK: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T18:36:07.517988] [INFO ] [REMOTE    ] EQBK: Full fetch complete (15566 records).
[2025-10-24T18:36:07.518091] [DEBUG] [VALIDATOR ] EQBK: Validating primary data.
[2025-10-24T18:36:07.518563] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:36:07.518670] [FATAL] [MAIN      ] EQBK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:36:07.518753] [WARN ] [MAIN      ] EQBK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:36:07.518841] [INFO ] [LOCAL     ] EQBK: Starting deletion of primary data.
[2025-10-24T18:36:07.518938] [DEBUG] [LOCAL     ] EQBK: No primary data file found to delete.
[2025-10-24T18:36:07.518994] [INFO ] [LOCAL     ] EQBK: Starting deletion of derivative data.
[2025-10-24T18:36:07.519376] [DEBUG] [LOCAL     ] EQBK: Deleted derivative data file.
[2025-10-24T18:36:07.519468] [INFO ] [MAIN      ] Update Progress: 756/2366 symbols completed. EQBK took 28.3s. Estimated remaining: 3h 24m 37s. Rate: 7.9 symbols/min
[2025-10-24T18:36:07.695855] [INFO ] [MAIN      ] EQS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:36:07.696023] [DEBUG] [LOCAL     ] EQS: No existing data file found in primary storage.
[2025-10-24T18:36:07.696061] [WARN ] [MAIN      ] EQS: No existing data found, performing full refresh instead.
[2025-10-24T18:36:07.696168] [INFO ] [MAIN      ] EQS: Wiping existing primary data before full refresh.
[2025-10-24T18:36:07.696210] [INFO ] [LOCAL     ] EQS: Starting deletion of primary data.
[2025-10-24T18:36:07.696251] [DEBUG] [LOCAL     ] EQS: No primary data file found to delete.
[2025-10-24T18:36:07.696284] [INFO ] [MAIN      ] EQS: Starting full primary refresh.
[2025-10-24T18:36:08.058992] [INFO ] [REMOTE    ] EQS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:36:08.094817] [INFO ] [REMOTE    ] EQNR: Incremental fetch complete for 2025-05 (2.35 seconds).
[2025-10-24T18:36:08.147631] [INFO ] [REMOTE    ] EQS: Fetching primary data for 2025-01.
[2025-10-24T18:36:08.947673] [INFO ] [REMOTE    ] EQNR: Fetching primary data for 2025-06.
[2025-10-24T18:36:08.959505] [INFO ] [REMOTE    ] EQS: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T18:36:09.238834] [INFO ] [REMOTE    ] EQH: Incremental fetch complete for 2025-09 (1.89 seconds).
[2025-10-24T18:36:09.747726] [INFO ] [REMOTE    ] EQR: Fetching primary data for 2025-02.
[2025-10-24T18:36:10.547679] [INFO ] [REMOTE    ] EQS: Fetching primary data for 2025-02.
[2025-10-24T18:36:10.820313] [INFO ] [REMOTE    ] EQS: Incremental fetch complete for 2025-02 (0.27 seconds).
[2025-10-24T18:36:11.296103] [INFO ] [REMOTE    ] EQNR: Incremental fetch complete for 2025-06 (2.35 seconds).
[2025-10-24T18:36:11.347701] [INFO ] [REMOTE    ] EQH: Fetching primary data for 2025-10.
[2025-10-24T18:36:11.522493] [INFO ] [REMOTE    ] EQR: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T18:36:12.147741] [INFO ] [REMOTE    ] EQS: Fetching primary data for 2025-03.
[2025-10-24T18:36:12.518619] [INFO ] [REMOTE    ] EQS: Incremental fetch complete for 2025-03 (0.37 seconds).
[2025-10-24T18:36:12.947703] [INFO ] [REMOTE    ] EQNR: Fetching primary data for 2025-07.
[2025-10-24T18:36:13.182837] [INFO ] [REMOTE    ] EQH: Incremental fetch complete for 2025-10 (1.84 seconds).
[2025-10-24T18:36:13.191910] [INFO ] [REMOTE    ] EQH: Full fetch complete (76234 records).
[2025-10-24T18:36:13.192052] [DEBUG] [VALIDATOR ] EQH: Validating primary data.
[2025-10-24T18:36:13.192832] [FATAL] [VALIDATOR ] EQH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:36:13.192921] [FATAL] [MAIN      ] EQH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:36:13.192965] [WARN ] [MAIN      ] EQH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:36:13.193005] [INFO ] [LOCAL     ] EQH: Starting deletion of primary data.
[2025-10-24T18:36:13.193060] [DEBUG] [LOCAL     ] EQH: No primary data file found to delete.
[2025-10-24T18:36:13.193096] [INFO ] [LOCAL     ] EQH: Starting deletion of derivative data.
[2025-10-24T18:36:13.193241] [DEBUG] [LOCAL     ] EQH: Deleted derivative data file.
[2025-10-24T18:36:13.193499] [INFO ] [MAIN      ] Update Progress: 757/2366 symbols completed. EQH took 31.7s. Estimated remaining: 3h 24m 25s. Rate: 7.9 symbols/min
[2025-10-24T18:36:13.747687] [INFO ] [REMOTE    ] EQS: Fetching primary data for 2025-04.
[2025-10-24T18:36:14.067785] [INFO ] [REMOTE    ] EQS: Incremental fetch complete for 2025-04 (0.32 seconds).
[2025-10-24T18:36:14.547690] [INFO ] [REMOTE    ] EQR: Fetching primary data for 2025-03.
[2025-10-24T18:36:14.944014] [INFO ] [REMOTE    ] EQNR: Incremental fetch complete for 2025-07 (2.00 seconds).
[2025-10-24T18:36:15.347697] [INFO ] [REMOTE    ] EQNR: Fetching primary data for 2025-08.
[2025-10-24T18:36:16.147686] [INFO ] [REMOTE    ] EQS: Fetching primary data for 2025-05.
[2025-10-24T18:36:16.503193] [INFO ] [REMOTE    ] EQR: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T18:36:16.543328] [INFO ] [REMOTE    ] EQS: Incremental fetch complete for 2025-05 (0.40 seconds).
[2025-10-24T18:36:16.947735] [INFO ] [REMOTE    ] EQR: Fetching primary data for 2025-04.
[2025-10-24T18:36:17.198909] [INFO ] [REMOTE    ] EQNR: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T18:36:17.747732] [INFO ] [REMOTE    ] EQNR: Fetching primary data for 2025-09.
[2025-10-24T18:36:18.547726] [INFO ] [REMOTE    ] EQS: Fetching primary data for 2025-06.
[2025-10-24T18:36:18.810068] [INFO ] [REMOTE    ] EQR: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T18:36:19.192729] [INFO ] [REMOTE    ] EQS: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T18:36:19.347604] [INFO ] [REMOTE    ] EQR: Fetching primary data for 2025-05.
[2025-10-24T18:36:19.650010] [INFO ] [REMOTE    ] EQNR: Incremental fetch complete for 2025-09 (1.90 seconds).
[2025-10-24T18:36:20.147737] [INFO ] [REMOTE    ] EQS: Fetching primary data for 2025-07.
[2025-10-24T18:36:20.644132] [INFO ] [REMOTE    ] EQS: Incremental fetch complete for 2025-07 (0.50 seconds).
[2025-10-24T18:36:20.947721] [INFO ] [REMOTE    ] EQS: Fetching primary data for 2025-08.
[2025-10-24T18:36:20.987987] [INFO ] [REMOTE    ] EQR: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T18:36:21.586105] [INFO ] [REMOTE    ] EQS: Incremental fetch complete for 2025-08 (0.64 seconds).
[2025-10-24T18:36:21.747679] [INFO ] [REMOTE    ] EQNR: Fetching primary data for 2025-10.
[2025-10-24T18:36:22.547722] [INFO ] [REMOTE    ] EQR: Fetching primary data for 2025-06.
[2025-10-24T18:36:23.347638] [INFO ] [REMOTE    ] EQS: Fetching primary data for 2025-09.
[2025-10-24T18:36:24.002895] [INFO ] [REMOTE    ] EQS: Incremental fetch complete for 2025-09 (0.66 seconds).
[2025-10-24T18:36:24.007856] [INFO ] [REMOTE    ] EQNR: Incremental fetch complete for 2025-10 (2.26 seconds).
[2025-10-24T18:36:24.017682] [INFO ] [REMOTE    ] EQNR: Full fetch complete (77017 records).
[2025-10-24T18:36:24.017830] [DEBUG] [VALIDATOR ] EQNR: Validating primary data.
[2025-10-24T18:36:24.147818] [INFO ] [REMOTE    ] EQS: Fetching primary data for 2025-10.
[2025-10-24T18:36:24.424495] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present.
[2025-10-24T18:36:24.424670] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed.
[2025-10-24T18:36:24.425575] [INFO ] [MAIN      ] EQNR: Fetched primary data is valid.
[2025-10-24T18:36:24.425702] [DEBUG] [LOCAL     ] EQNR: Saving primary data.
[2025-10-24T18:36:24.426391] [FATAL] [LOCAL     ] EQNR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:36:24.435990] [FATAL] [MAIN      ] EQNR: Failed to save primary data.
[2025-10-24T18:36:24.442545] [WARN ] [MAIN      ] EQNR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:36:24.451769] [INFO ] [LOCAL     ] EQNR: Starting deletion of primary data.
[2025-10-24T18:36:24.451929] [DEBUG] [LOCAL     ] EQNR: No primary data file found to delete.
[2025-10-24T18:36:24.451995] [INFO ] [LOCAL     ] EQNR: Starting deletion of derivative data.
[2025-10-24T18:36:24.453376] [INFO ] [REMOTE    ] EQR: Incremental fetch complete for 2025-06 (1.91 seconds).
[2025-10-24T18:36:24.453418] [DEBUG] [LOCAL     ] EQNR: Deleted derivative data file.
[2025-10-24T18:36:24.463595] [INFO ] [MAIN      ] Update Progress: 758/2366 symbols completed. EQNR took 31.9s. Estimated remaining: 3h 24m 25s. Rate: 7.9 symbols/min
[2025-10-24T18:36:24.840060] [INFO ] [REMOTE    ] EQS: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T18:36:24.840926] [INFO ] [REMOTE    ] EQS: Full fetch complete (2367 records).
[2025-10-24T18:36:24.840995] [DEBUG] [VALIDATOR ] EQS: Validating primary data.
[2025-10-24T18:36:24.952806] [INFO ] [REMOTE    ] EQR: Fetching primary data for 2025-07.
[2025-10-24T18:36:25.029166] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days
[2025-10-24T18:36:25.029441] [FATAL] [MAIN      ] EQS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:36:25.029510] [WARN ] [MAIN      ] EQS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:36:25.029583] [INFO ] [LOCAL     ] EQS: Starting deletion of primary data.
[2025-10-24T18:36:25.029677] [DEBUG] [LOCAL     ] EQS: No primary data file found to delete.
[2025-10-24T18:36:25.029735] [INFO ] [LOCAL     ] EQS: Starting deletion of derivative data.
[2025-10-24T18:36:25.029781] [DEBUG] [LOCAL     ] EQS: No derivative data file found to delete.
[2025-10-24T18:36:25.029839] [INFO ] [MAIN      ] Update Progress: 759/2366 symbols completed. EQS took 17.5s. Estimated remaining: 3h 24m 2s. Rate: 7.9 symbols/min
[2025-10-24T18:36:26.872197] [INFO ] [REMOTE    ] EQR: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T18:36:26.883689] [INFO ] [REMOTE    ] EQR: Fetching primary data for 2025-08.
[2025-10-24T18:36:28.432757] [INFO ] [REMOTE    ] EQR: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T18:36:28.443720] [INFO ] [REMOTE    ] EQR: Fetching primary data for 2025-09.
[2025-10-24T18:36:30.241255] [INFO ] [REMOTE    ] EQR: Incremental fetch complete for 2025-09 (1.80 seconds).
[2025-10-24T18:36:30.252766] [INFO ] [REMOTE    ] EQR: Fetching primary data for 2025-10.
[2025-10-24T18:36:32.054615] [INFO ] [REMOTE    ] EQR: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T18:36:32.063875] [INFO ] [REMOTE    ] EQR: Full fetch complete (74257 records).
[2025-10-24T18:36:32.064009] [DEBUG] [VALIDATOR ] EQR: Validating primary data.
[2025-10-24T18:36:32.064760] [FATAL] [VALIDATOR ] EQR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:36:32.064846] [FATAL] [MAIN      ] EQR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:36:32.064889] [WARN ] [MAIN      ] EQR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:36:32.064956] [INFO ] [LOCAL     ] EQR: Starting deletion of primary data.
[2025-10-24T18:36:32.065020] [DEBUG] [LOCAL     ] EQR: No primary data file found to delete.
[2025-10-24T18:36:32.065056] [INFO ] [LOCAL     ] EQR: Starting deletion of derivative data.
[2025-10-24T18:36:32.065199] [DEBUG] [LOCAL     ] EQR: Deleted derivative data file.
[2025-10-24T18:36:32.065587] [INFO ] [MAIN      ] Update Progress: 760/2366 symbols completed. EQR took 33.9s. Estimated remaining: 3h 23m 53s. Rate: 7.9 symbols/min
[2025-10-24T18:36:32.636224] [INFO ] [MAIN      ] EQT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:36:32.690031] [INFO ] [MAIN      ] ERJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:36:32.773084] [INFO ] [MAIN      ] ERO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:36:32.770133] [INFO ] [MAIN      ] EQV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:36:32.782035] [DEBUG] [LOCAL     ] EQV: Loaded 2771 existing records from primary storage.
[2025-10-24T18:36:32.782613] [INFO ] [MAIN      ] EQV: Loaded 2771 existing records.
[2025-10-24T18:36:33.005934] [WARN ] [MAIN      ] EQV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:36:33.018940] [INFO ] [MAIN      ] EQV: Wiping existing primary data before full refresh.
[2025-10-24T18:36:33.034233] [INFO ] [LOCAL     ] EQV: Starting deletion of primary data.
[2025-10-24T18:36:33.048229] [DEBUG] [LOCAL     ] ERO: Loaded 42461 existing records from primary storage.
[2025-10-24T18:36:33.050095] [DEBUG] [LOCAL     ] EQT: Loaded 54075 existing records from primary storage.
[2025-10-24T18:36:33.051187] [DEBUG] [LOCAL     ] ERJ: Loaded 50666 existing records from primary storage.
[2025-10-24T18:36:33.048706] [DEBUG] [LOCAL     ] EQV: Deleted primary data file.
[2025-10-24T18:36:33.050349] [INFO ] [MAIN      ] ERO: Loaded 42461 existing records.
[2025-10-24T18:36:33.056737] [INFO ] [MAIN      ] EQV: Starting full primary refresh.
[2025-10-24T18:36:33.062188] [INFO ] [MAIN      ] EQT: Loaded 54075 existing records.
[2025-10-24T18:36:33.105965] [INFO ] [MAIN      ] ERJ: Loaded 50666 existing records.
[2025-10-24T18:36:33.624353] [WARN ] [MAIN      ] EQT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:36:33.685411] [INFO ] [MAIN      ] EQT: Wiping existing primary data before full refresh.
[2025-10-24T18:36:33.755423] [INFO ] [LOCAL     ] EQT: Starting deletion of primary data.
[2025-10-24T18:36:33.754569] [WARN ] [MAIN      ] ERO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:36:33.764467] [INFO ] [MAIN      ] ERO: Wiping existing primary data before full refresh.
[2025-10-24T18:36:33.781358] [DEBUG] [LOCAL     ] EQT: Deleted primary data file.
[2025-10-24T18:36:33.795792] [INFO ] [MAIN      ] EQT: Starting full primary refresh.
[2025-10-24T18:36:33.832560] [WARN ] [MAIN      ] ERJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:36:33.870931] [INFO ] [LOCAL     ] ERO: Starting deletion of primary data.
[2025-10-24T18:36:33.905394] [INFO ] [MAIN      ] ERJ: Wiping existing primary data before full refresh.
[2025-10-24T18:36:33.942367] [INFO ] [LOCAL     ] ERJ: Starting deletion of primary data.
[2025-10-24T18:36:33.942272] [DEBUG] [LOCAL     ] ERO: Deleted primary data file.
[2025-10-24T18:36:33.979287] [INFO ] [MAIN      ] ERO: Starting full primary refresh.
[2025-10-24T18:36:33.987830] [DEBUG] [LOCAL     ] ERJ: Deleted primary data file.
[2025-10-24T18:36:34.026186] [INFO ] [MAIN      ] ERJ: Starting full primary refresh.
[2025-10-24T18:36:34.352076] [INFO ] [REMOTE    ] EQV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:36:34.387719] [INFO ] [REMOTE    ] EQV: Fetching primary data for 2025-01.
[2025-10-24T18:36:35.025898] [INFO ] [REMOTE    ] EQT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:36:35.064179] [INFO ] [REMOTE    ] EQT: Fetching primary data for 2025-01.
[2025-10-24T18:36:35.159402] [INFO ] [REMOTE    ] ERO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:36:35.160193] [INFO ] [REMOTE    ] ERO: Fetching primary data for 2025-01.
[2025-10-24T18:36:35.284809] [INFO ] [REMOTE    ] ERJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:36:35.285265] [INFO ] [REMOTE    ] ERJ: Fetching primary data for 2025-01.
[2025-10-24T18:36:35.718872] [INFO ] [REMOTE    ] EQV: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T18:36:35.721725] [INFO ] [REMOTE    ] EQV: Fetching primary data for 2025-02.
[2025-10-24T18:36:36.305391] [INFO ] [REMOTE    ] EQV: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T18:36:36.307171] [INFO ] [REMOTE    ] EQV: Fetching primary data for 2025-03.
[2025-10-24T18:36:36.641793] [INFO ] [REMOTE    ] ERO: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T18:36:36.649690] [INFO ] [REMOTE    ] ERO: Fetching primary data for 2025-02.
[2025-10-24T18:36:36.848328] [INFO ] [REMOTE    ] EQV: Incremental fetch complete for 2025-03 (0.54 seconds).
[2025-10-24T18:36:36.849797] [INFO ] [REMOTE    ] EQV: Fetching primary data for 2025-04.
[2025-10-24T18:36:37.014250] [INFO ] [REMOTE    ] EQT: Incremental fetch complete for 2025-01 (1.95 seconds).
[2025-10-24T18:36:37.024829] [INFO ] [REMOTE    ] EQT: Fetching primary data for 2025-02.
[2025-10-24T18:36:37.174744] [INFO ] [REMOTE    ] ERJ: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T18:36:37.184277] [INFO ] [REMOTE    ] ERJ: Fetching primary data for 2025-02.
[2025-10-24T18:36:37.296480] [INFO ] [REMOTE    ] EQV: Incremental fetch complete for 2025-04 (0.45 seconds).
[2025-10-24T18:36:37.297849] [INFO ] [REMOTE    ] EQV: Fetching primary data for 2025-05.
[2025-10-24T18:36:37.763768] [INFO ] [REMOTE    ] EQV: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T18:36:37.767022] [INFO ] [REMOTE    ] EQV: Fetching primary data for 2025-06.
[2025-10-24T18:36:37.768391] [INFO ] [REMOTE    ] ERO: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T18:36:37.778780] [INFO ] [REMOTE    ] ERO: Fetching primary data for 2025-03.
[2025-10-24T18:36:38.121701] [INFO ] [REMOTE    ] EQV: Incremental fetch complete for 2025-06 (0.35 seconds).
[2025-10-24T18:36:38.547696] [INFO ] [REMOTE    ] EQV: Fetching primary data for 2025-07.
[2025-10-24T18:36:38.602129] [INFO ] [REMOTE    ] ERJ: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T18:36:38.864690] [INFO ] [REMOTE    ] EQT: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T18:36:39.046080] [INFO ] [REMOTE    ] EQV: Incremental fetch complete for 2025-07 (0.50 seconds).
[2025-10-24T18:36:39.269866] [INFO ] [REMOTE    ] ERO: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T18:36:39.347685] [INFO ] [REMOTE    ] EQT: Fetching primary data for 2025-03.
[2025-10-24T18:36:40.147669] [INFO ] [REMOTE    ] EQV: Fetching primary data for 2025-08.
[2025-10-24T18:36:40.716235] [INFO ] [REMOTE    ] EQV: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T18:36:40.947622] [INFO ] [REMOTE    ] ERO: Fetching primary data for 2025-04.
[2025-10-24T18:36:41.364152] [INFO ] [REMOTE    ] EQT: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T18:36:41.747690] [INFO ] [REMOTE    ] ERJ: Fetching primary data for 2025-03.
[2025-10-24T18:36:42.547698] [INFO ] [REMOTE    ] EQV: Fetching primary data for 2025-09.
[2025-10-24T18:36:42.758872] [INFO ] [REMOTE    ] ERO: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T18:36:42.969416] [INFO ] [REMOTE    ] EQV: Incremental fetch complete for 2025-09 (0.42 seconds).
[2025-10-24T18:36:43.340721] [INFO ] [REMOTE    ] ERJ: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T18:36:43.351601] [INFO ] [REMOTE    ] EQV: Fetching primary data for 2025-10.
[2025-10-24T18:36:43.917291] [INFO ] [REMOTE    ] EQV: Incremental fetch complete for 2025-10 (0.57 seconds).
[2025-10-24T18:36:43.918401] [INFO ] [REMOTE    ] EQV: Full fetch complete (4831 records).
[2025-10-24T18:36:43.918468] [DEBUG] [VALIDATOR ] EQV: Validating primary data.
[2025-10-24T18:36:44.152873] [INFO ] [REMOTE    ] ERO: Fetching primary data for 2025-05.
[2025-10-24T18:36:44.277801] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present.
[2025-10-24T18:36:44.277873] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed.
[2025-10-24T18:36:44.278051] [INFO ] [MAIN      ] EQV: Fetched primary data is valid.
[2025-10-24T18:36:44.278090] [DEBUG] [LOCAL     ] EQV: Saving primary data.
[2025-10-24T18:36:44.278265] [FATAL] [LOCAL     ] EQV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:36:44.278345] [FATAL] [MAIN      ] EQV: Failed to save primary data.
[2025-10-24T18:36:44.278393] [WARN ] [MAIN      ] EQV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:36:44.278428] [INFO ] [LOCAL     ] EQV: Starting deletion of primary data.
[2025-10-24T18:36:44.278477] [DEBUG] [LOCAL     ] EQV: No primary data file found to delete.
[2025-10-24T18:36:44.278511] [INFO ] [LOCAL     ] EQV: Starting deletion of derivative data.
[2025-10-24T18:36:44.278633] [DEBUG] [LOCAL     ] EQV: Deleted derivative data file.
[2025-10-24T18:36:44.278752] [INFO ] [MAIN      ] Update Progress: 761/2366 symbols completed. EQV took 12.2s. Estimated remaining: 3h 23m 56s. Rate: 7.9 symbols/min
[2025-10-24T18:36:44.451075] [INFO ] [MAIN      ] ES: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:36:44.451281] [DEBUG] [LOCAL     ] ES: No existing data file found in primary storage.
[2025-10-24T18:36:44.451324] [WARN ] [MAIN      ] ES: No existing data found, performing full refresh instead.
[2025-10-24T18:36:44.451440] [INFO ] [MAIN      ] ES: Wiping existing primary data before full refresh.
[2025-10-24T18:36:44.451498] [INFO ] [LOCAL     ] ES: Starting deletion of primary data.
[2025-10-24T18:36:44.451543] [DEBUG] [LOCAL     ] ES: No primary data file found to delete.
[2025-10-24T18:36:44.451577] [INFO ] [MAIN      ] ES: Starting full primary refresh.
[2025-10-24T18:36:44.801581] [INFO ] [REMOTE    ] ES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:36:44.947610] [INFO ] [REMOTE    ] ES: Fetching primary data for 2025-01.
[2025-10-24T18:36:45.734918] [INFO ] [REMOTE    ] ERO: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T18:36:45.747594] [INFO ] [REMOTE    ] ERO: Fetching primary data for 2025-06.
[2025-10-24T18:36:46.547712] [INFO ] [REMOTE    ] ERJ: Fetching primary data for 2025-04.
[2025-10-24T18:36:46.724526] [INFO ] [REMOTE    ] ES: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T18:36:47.236586] [INFO ] [REMOTE    ] ERO: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T18:36:47.347612] [INFO ] [REMOTE    ] ERO: Fetching primary data for 2025-07.
[2025-10-24T18:36:48.147629] [INFO ] [REMOTE    ] ES: Fetching primary data for 2025-02.
[2025-10-24T18:36:48.842149] [INFO ] [REMOTE    ] ERJ: Incremental fetch complete for 2025-04 (2.29 seconds).
[2025-10-24T18:36:48.947680] [INFO ] [REMOTE    ] ERJ: Fetching primary data for 2025-05.
[2025-10-24T18:36:49.021675] [INFO ] [REMOTE    ] ERO: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T18:36:49.709404] [INFO ] [REMOTE    ] ES: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T18:36:49.747607] [INFO ] [REMOTE    ] ES: Fetching primary data for 2025-03.
[2025-10-24T18:36:50.169831] [INFO ] [REMOTE    ] ERJ: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T18:36:50.547705] [INFO ] [REMOTE    ] ERJ: Fetching primary data for 2025-06.
[2025-10-24T18:36:51.347677] [INFO ] [REMOTE    ] EQT: Fetching primary data for 2025-04.
[2025-10-24T18:36:51.503497] [INFO ] [REMOTE    ] ES: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T18:36:52.147741] [INFO ] [REMOTE    ] ERO: Fetching primary data for 2025-08.
[2025-10-24T18:36:52.219400] [INFO ] [REMOTE    ] ERJ: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T18:36:52.947730] [INFO ] [REMOTE    ] ES: Fetching primary data for 2025-04.
[2025-10-24T18:36:53.262815] [INFO ] [REMOTE    ] EQT: Incremental fetch complete for 2025-04 (1.92 seconds).
[2025-10-24T18:36:53.481171] [INFO ] [REMOTE    ] ERO: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T18:36:53.747771] [INFO ] [REMOTE    ] EQT: Fetching primary data for 2025-05.
[2025-10-24T18:36:54.547751] [INFO ] [REMOTE    ] ERO: Fetching primary data for 2025-09.
[2025-10-24T18:36:54.728370] [INFO ] [REMOTE    ] ES: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T18:36:55.347677] [INFO ] [REMOTE    ] ERJ: Fetching primary data for 2025-07.
[2025-10-24T18:36:55.717745] [INFO ] [REMOTE    ] ERO: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T18:36:55.764998] [INFO ] [REMOTE    ] EQT: Incremental fetch complete for 2025-05 (2.02 seconds).
[2025-10-24T18:36:56.147710] [INFO ] [REMOTE    ] ERO: Fetching primary data for 2025-10.
[2025-10-24T18:36:56.947679] [INFO ] [REMOTE    ] EQT: Fetching primary data for 2025-06.
[2025-10-24T18:36:57.270246] [INFO ] [REMOTE    ] ERJ: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T18:36:57.747633] [INFO ] [REMOTE    ] ES: Fetching primary data for 2025-05.
[2025-10-24T18:36:58.005706] [INFO ] [REMOTE    ] ERO: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T18:36:58.016088] [INFO ] [REMOTE    ] ERO: Full fetch complete (60727 records).
[2025-10-24T18:36:58.016273] [DEBUG] [VALIDATOR ] ERO: Validating primary data.
[2025-10-24T18:36:58.442943] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present.
[2025-10-24T18:36:58.443093] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed.
[2025-10-24T18:36:58.444245] [INFO ] [MAIN      ] ERO: Fetched primary data is valid.
[2025-10-24T18:36:58.444314] [DEBUG] [LOCAL     ] ERO: Saving primary data.
[2025-10-24T18:36:58.445262] [FATAL] [LOCAL     ] ERO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:36:58.445359] [FATAL] [MAIN      ] ERO: Failed to save primary data.
[2025-10-24T18:36:58.445402] [WARN ] [MAIN      ] ERO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:36:58.445505] [INFO ] [LOCAL     ] ERO: Starting deletion of primary data.
[2025-10-24T18:36:58.445624] [DEBUG] [LOCAL     ] ERO: No primary data file found to delete.
[2025-10-24T18:36:58.445708] [INFO ] [LOCAL     ] ERO: Starting deletion of derivative data.
[2025-10-24T18:36:58.445890] [DEBUG] [LOCAL     ] ERO: Deleted derivative data file.
[2025-10-24T18:36:58.446763] [INFO ] [MAIN      ] Update Progress: 762/2366 symbols completed. ERO took 26.4s. Estimated remaining: 3h 24m 2s. Rate: 7.9 symbols/min
[2025-10-24T18:36:58.553591] [INFO ] [REMOTE    ] ERJ: Fetching primary data for 2025-08.
[2025-10-24T18:36:58.653584] [INFO ] [MAIN      ] ESAB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:36:58.689955] [DEBUG] [LOCAL     ] ESAB: Loaded 26116 existing records from primary storage.
[2025-10-24T18:36:58.690311] [INFO ] [MAIN      ] ESAB: Loaded 26116 existing records.
[2025-10-24T18:36:58.878284] [WARN ] [MAIN      ] ESAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:36:58.878909] [INFO ] [MAIN      ] ESAB: Wiping existing primary data before full refresh.
[2025-10-24T18:36:58.879077] [INFO ] [LOCAL     ] ESAB: Starting deletion of primary data.
[2025-10-24T18:36:58.879418] [DEBUG] [LOCAL     ] ESAB: Deleted primary data file.
[2025-10-24T18:36:58.879479] [INFO ] [MAIN      ] ESAB: Starting full primary refresh.
[2025-10-24T18:36:59.270766] [INFO ] [REMOTE    ] ESAB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:36:59.305916] [INFO ] [REMOTE    ] EQT: Incremental fetch complete for 2025-06 (2.36 seconds).
[2025-10-24T18:36:59.347688] [INFO ] [REMOTE    ] EQT: Fetching primary data for 2025-07.
[2025-10-24T18:36:59.699684] [INFO ] [REMOTE    ] ES: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T18:37:00.147742] [INFO ] [REMOTE    ] ES: Fetching primary data for 2025-06.
[2025-10-24T18:37:00.947750] [INFO ] [REMOTE    ] ESAB: Fetching primary data for 2025-01.
[2025-10-24T18:37:02.120431] [INFO ] [REMOTE    ] EQT: Incremental fetch complete for 2025-07 (2.77 seconds).
[2025-10-24T18:37:02.133000] [INFO ] [REMOTE    ] EQT: Fetching primary data for 2025-08.
[2025-10-24T18:37:02.256385] [INFO ] [REMOTE    ] ES: Incremental fetch complete for 2025-06 (2.11 seconds).
[2025-10-24T18:37:02.547788] [INFO ] [REMOTE    ] ES: Fetching primary data for 2025-07.
[2025-10-24T18:37:03.857082] [INFO ] [REMOTE    ] ERJ: Incremental fetch complete for 2025-08 (5.30 seconds).
[2025-10-24T18:37:03.870115] [INFO ] [REMOTE    ] ERJ: Fetching primary data for 2025-09.
[2025-10-24T18:37:04.655137] [INFO ] [REMOTE    ] ESAB: Incremental fetch complete for 2025-01 (3.71 seconds).
[2025-10-24T18:37:04.659531] [INFO ] [REMOTE    ] ESAB: Fetching primary data for 2025-02.
[2025-10-24T18:37:05.646165] [INFO ] [REMOTE    ] ES: Incremental fetch complete for 2025-07 (3.10 seconds).
[2025-10-24T18:37:05.658614] [INFO ] [REMOTE    ] ES: Fetching primary data for 2025-08.
[2025-10-24T18:37:05.693445] [INFO ] [REMOTE    ] ESAB: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T18:37:05.747712] [INFO ] [REMOTE    ] ESAB: Fetching primary data for 2025-03.
[2025-10-24T18:37:06.624294] [INFO ] [REMOTE    ] EQT: Incremental fetch complete for 2025-08 (4.49 seconds).
[2025-10-24T18:37:06.636638] [INFO ] [REMOTE    ] EQT: Fetching primary data for 2025-09.
[2025-10-24T18:37:07.105274] [INFO ] [REMOTE    ] ESAB: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T18:37:07.209265] [INFO ] [REMOTE    ] ES: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T18:37:07.347704] [INFO ] [REMOTE    ] ES: Fetching primary data for 2025-09.
[2025-10-24T18:37:08.029141] [INFO ] [REMOTE    ] ERJ: Incremental fetch complete for 2025-09 (4.16 seconds).
[2025-10-24T18:37:08.147679] [INFO ] [REMOTE    ] ERJ: Fetching primary data for 2025-10.
[2025-10-24T18:37:08.460038] [INFO ] [REMOTE    ] EQT: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T18:37:08.947688] [INFO ] [REMOTE    ] ESAB: Fetching primary data for 2025-04.
[2025-10-24T18:37:09.531738] [INFO ] [REMOTE    ] ES: Incremental fetch complete for 2025-09 (2.18 seconds).
[2025-10-24T18:37:09.747714] [INFO ] [REMOTE    ] EQT: Fetching primary data for 2025-10.
[2025-10-24T18:37:09.857044] [INFO ] [REMOTE    ] ERJ: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T18:37:09.865718] [INFO ] [REMOTE    ] ERJ: Full fetch complete (72741 records).
[2025-10-24T18:37:09.865851] [DEBUG] [VALIDATOR ] ERJ: Validating primary data.
[2025-10-24T18:37:09.866542] [FATAL] [VALIDATOR ] ERJ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:37:09.866630] [FATAL] [MAIN      ] ERJ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:37:09.866711] [WARN ] [MAIN      ] ERJ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:37:09.866782] [INFO ] [LOCAL     ] ERJ: Starting deletion of primary data.
[2025-10-24T18:37:09.866848] [DEBUG] [LOCAL     ] ERJ: No primary data file found to delete.
[2025-10-24T18:37:09.866889] [INFO ] [LOCAL     ] ERJ: Starting deletion of derivative data.
[2025-10-24T18:37:09.867027] [DEBUG] [LOCAL     ] ERJ: Deleted derivative data file.
[2025-10-24T18:37:09.867407] [INFO ] [MAIN      ] Update Progress: 763/2366 symbols completed. ERJ took 37.8s. Estimated remaining: 3h 24m 2s. Rate: 7.9 symbols/min
[2025-10-24T18:37:10.040087] [INFO ] [MAIN      ] ESE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:37:10.059192] [DEBUG] [LOCAL     ] ESE: Loaded 16534 existing records from primary storage.
[2025-10-24T18:37:10.059431] [INFO ] [MAIN      ] ESE: Loaded 16534 existing records.
[2025-10-24T18:37:10.243681] [WARN ] [MAIN      ] ESE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:37:10.243910] [INFO ] [MAIN      ] ESE: Wiping existing primary data before full refresh.
[2025-10-24T18:37:10.244060] [INFO ] [LOCAL     ] ESE: Starting deletion of primary data.
[2025-10-24T18:37:10.244389] [DEBUG] [LOCAL     ] ESE: Deleted primary data file.
[2025-10-24T18:37:10.244541] [INFO ] [MAIN      ] ESE: Starting full primary refresh.
[2025-10-24T18:37:10.353576] [INFO ] [REMOTE    ] ESAB: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T18:37:10.548065] [INFO ] [REMOTE    ] ES: Fetching primary data for 2025-10.
[2025-10-24T18:37:10.628610] [INFO ] [REMOTE    ] ESE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:37:11.347747] [INFO ] [REMOTE    ] ESE: Fetching primary data for 2025-01.
[2025-10-24T18:37:11.902512] [INFO ] [REMOTE    ] EQT: Incremental fetch complete for 2025-10 (2.15 seconds).
[2025-10-24T18:37:11.912391] [INFO ] [REMOTE    ] EQT: Full fetch complete (77859 records).
[2025-10-24T18:37:11.912537] [DEBUG] [VALIDATOR ] EQT: Validating primary data.
[2025-10-24T18:37:12.152490] [INFO ] [REMOTE    ] ESAB: Fetching primary data for 2025-05.
[2025-10-24T18:37:12.332893] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present.
[2025-10-24T18:37:12.333044] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed.
[2025-10-24T18:37:12.334064] [INFO ] [MAIN      ] EQT: Fetched primary data is valid.
[2025-10-24T18:37:12.334145] [DEBUG] [LOCAL     ] EQT: Saving primary data.
[2025-10-24T18:37:12.344089] [FATAL] [LOCAL     ] EQT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:37:12.358904] [FATAL] [MAIN      ] EQT: Failed to save primary data.
[2025-10-24T18:37:12.359045] [WARN ] [MAIN      ] EQT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:37:12.359156] [INFO ] [LOCAL     ] EQT: Starting deletion of primary data.
[2025-10-24T18:37:12.359266] [DEBUG] [LOCAL     ] EQT: No primary data file found to delete.
[2025-10-24T18:37:12.359918] [INFO ] [LOCAL     ] EQT: Starting deletion of derivative data.
[2025-10-24T18:37:12.360982] [INFO ] [REMOTE    ] ES: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T18:37:12.370811] [DEBUG] [LOCAL     ] EQT: Deleted derivative data file.
[2025-10-24T18:37:12.371632] [INFO ] [MAIN      ] Update Progress: 764/2366 symbols completed. EQT took 40.3s. Estimated remaining: 3h 23m 44s. Rate: 7.9 symbols/min
[2025-10-24T18:37:12.383368] [INFO ] [REMOTE    ] ES: Full fetch complete (76479 records).
[2025-10-24T18:37:12.410541] [DEBUG] [VALIDATOR ] ES: Validating primary data.
[2025-10-24T18:37:12.714800] [INFO ] [MAIN      ] ESI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:37:12.782155] [INFO ] [REMOTE    ] ESE: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T18:37:12.970740] [INFO ] [REMOTE    ] ESE: Fetching primary data for 2025-02.
[2025-10-24T18:37:13.004793] [DEBUG] [VALIDATOR ] ES: All expected trading days are present.
[2025-10-24T18:37:13.005015] [DEBUG] [VALIDATOR ] ES: Primary data validation passed.
[2025-10-24T18:37:13.006301] [INFO ] [MAIN      ] ES: Fetched primary data is valid.
[2025-10-24T18:37:13.006477] [DEBUG] [LOCAL     ] ES: Saving primary data.
[2025-10-24T18:37:13.007988] [FATAL] [LOCAL     ] ES: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:37:13.008373] [FATAL] [MAIN      ] ES: Failed to save primary data.
[2025-10-24T18:37:13.008444] [WARN ] [MAIN      ] ES: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:37:13.008501] [INFO ] [LOCAL     ] ES: Starting deletion of primary data.
[2025-10-24T18:37:13.008580] [DEBUG] [LOCAL     ] ES: No primary data file found to delete.
[2025-10-24T18:37:13.008621] [INFO ] [LOCAL     ] ES: Starting deletion of derivative data.
[2025-10-24T18:37:13.008740] [DEBUG] [LOCAL     ] ES: No derivative data file found to delete.
[2025-10-24T18:37:13.008879] [INFO ] [MAIN      ] Update Progress: 765/2366 symbols completed. ES took 28.7s. Estimated remaining: 3h 23m 21s. Rate: 7.9 symbols/min
[2025-10-24T18:37:13.117508] [DEBUG] [LOCAL     ] ESI: Loaded 51006 existing records from primary storage.
[2025-10-24T18:37:13.141406] [INFO ] [MAIN      ] ESI: Loaded 51006 existing records.
[2025-10-24T18:37:13.333348] [INFO ] [MAIN      ] ESNT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:37:13.419504] [WARN ] [MAIN      ] ESI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:37:13.420010] [INFO ] [MAIN      ] ESI: Wiping existing primary data before full refresh.
[2025-10-24T18:37:13.420108] [INFO ] [LOCAL     ] ESI: Starting deletion of primary data.
[2025-10-24T18:37:13.420429] [DEBUG] [LOCAL     ] ESI: Deleted primary data file.
[2025-10-24T18:37:13.420549] [INFO ] [MAIN      ] ESI: Starting full primary refresh.
[2025-10-24T18:37:13.442889] [INFO ] [REMOTE    ] ESAB: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T18:37:13.735414] [DEBUG] [LOCAL     ] ESNT: Loaded 38188 existing records from primary storage.
[2025-10-24T18:37:13.747874] [INFO ] [MAIN      ] ESNT: Loaded 38188 existing records.
[2025-10-24T18:37:13.747968] [INFO ] [REMOTE    ] ESAB: Fetching primary data for 2025-06.
[2025-10-24T18:37:14.034182] [INFO ] [REMOTE    ] ESI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:37:14.117571] [INFO ] [REMOTE    ] ESE: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T18:37:14.122065] [WARN ] [MAIN      ] ESNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:37:14.126759] [INFO ] [MAIN      ] ESNT: Wiping existing primary data before full refresh.
[2025-10-24T18:37:14.126822] [INFO ] [LOCAL     ] ESNT: Starting deletion of primary data.
[2025-10-24T18:37:14.127755] [DEBUG] [LOCAL     ] ESNT: Deleted primary data file.
[2025-10-24T18:37:14.127836] [INFO ] [MAIN      ] ESNT: Starting full primary refresh.
[2025-10-24T18:37:14.497235] [INFO ] [REMOTE    ] ESNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:37:14.547639] [INFO ] [REMOTE    ] ESE: Fetching primary data for 2025-03.
[2025-10-24T18:37:14.903794] [INFO ] [REMOTE    ] ESAB: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T18:37:15.347619] [INFO ] [REMOTE    ] ESAB: Fetching primary data for 2025-07.
[2025-10-24T18:37:15.635505] [INFO ] [REMOTE    ] ESE: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T18:37:16.147612] [INFO ] [REMOTE    ] ESE: Fetching primary data for 2025-04.
[2025-10-24T18:37:16.561997] [INFO ] [REMOTE    ] ESAB: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T18:37:16.947633] [INFO ] [REMOTE    ] ESAB: Fetching primary data for 2025-08.
[2025-10-24T18:37:17.123605] [INFO ] [REMOTE    ] ESE: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T18:37:17.747609] [INFO ] [REMOTE    ] ESNT: Fetching primary data for 2025-01.
[2025-10-24T18:37:18.131060] [INFO ] [REMOTE    ] ESAB: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T18:37:18.547711] [INFO ] [REMOTE    ] ESI: Fetching primary data for 2025-01.
[2025-10-24T18:37:19.282997] [INFO ] [REMOTE    ] ESNT: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T18:37:19.347628] [INFO ] [REMOTE    ] ESE: Fetching primary data for 2025-05.
[2025-10-24T18:37:20.147611] [INFO ] [REMOTE    ] ESNT: Fetching primary data for 2025-02.
[2025-10-24T18:37:20.308038] [INFO ] [REMOTE    ] ESI: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T18:37:20.506986] [INFO ] [REMOTE    ] ESE: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T18:37:20.947728] [INFO ] [REMOTE    ] ESE: Fetching primary data for 2025-06.
[2025-10-24T18:37:21.579066] [INFO ] [REMOTE    ] ESNT: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T18:37:21.747689] [INFO ] [REMOTE    ] ESNT: Fetching primary data for 2025-03.
[2025-10-24T18:37:21.901300] [INFO ] [REMOTE    ] ESE: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T18:37:22.547703] [INFO ] [REMOTE    ] ESI: Fetching primary data for 2025-02.
[2025-10-24T18:37:22.875635] [INFO ] [REMOTE    ] ESNT: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T18:37:23.347691] [INFO ] [REMOTE    ] ESAB: Fetching primary data for 2025-09.
[2025-10-24T18:37:23.974940] [INFO ] [REMOTE    ] ESI: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T18:37:24.147636] [INFO ] [REMOTE    ] ESI: Fetching primary data for 2025-03.
[2025-10-24T18:37:24.721011] [INFO ] [REMOTE    ] ESAB: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T18:37:24.947710] [INFO ] [REMOTE    ] ESNT: Fetching primary data for 2025-04.
[2025-10-24T18:37:25.613973] [INFO ] [REMOTE    ] ESI: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T18:37:25.747628] [INFO ] [REMOTE    ] ESI: Fetching primary data for 2025-04.
[2025-10-24T18:37:26.447386] [INFO ] [REMOTE    ] ESNT: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T18:37:26.547619] [INFO ] [REMOTE    ] ESNT: Fetching primary data for 2025-05.
[2025-10-24T18:37:27.303604] [INFO ] [REMOTE    ] ESI: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T18:37:27.347664] [INFO ] [REMOTE    ] ESAB: Fetching primary data for 2025-10.
[2025-10-24T18:37:27.937059] [INFO ] [REMOTE    ] ESNT: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T18:37:28.147742] [INFO ] [REMOTE    ] ESI: Fetching primary data for 2025-05.
[2025-10-24T18:37:28.297770] [INFO ] [REMOTE    ] ESAB: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T18:37:28.307466] [INFO ] [REMOTE    ] ESAB: Full fetch complete (36493 records).
[2025-10-24T18:37:28.307773] [DEBUG] [VALIDATOR ] ESAB: Validating primary data.
[2025-10-24T18:37:28.779522] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present.
[2025-10-24T18:37:28.779602] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed.
[2025-10-24T18:37:28.780191] [INFO ] [MAIN      ] ESAB: Fetched primary data is valid.
[2025-10-24T18:37:28.780251] [DEBUG] [LOCAL     ] ESAB: Saving primary data.
[2025-10-24T18:37:28.780600] [FATAL] [LOCAL     ] ESAB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:37:28.780703] [FATAL] [MAIN      ] ESAB: Failed to save primary data.
[2025-10-24T18:37:28.780746] [WARN ] [MAIN      ] ESAB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:37:28.780804] [INFO ] [LOCAL     ] ESAB: Starting deletion of primary data.
[2025-10-24T18:37:28.780861] [DEBUG] [LOCAL     ] ESAB: No primary data file found to delete.
[2025-10-24T18:37:28.780896] [INFO ] [LOCAL     ] ESAB: Starting deletion of derivative data.
[2025-10-24T18:37:28.781025] [DEBUG] [LOCAL     ] ESAB: Deleted derivative data file.
[2025-10-24T18:37:28.781096] [INFO ] [MAIN      ] Update Progress: 766/2366 symbols completed. ESAB took 30.3s. Estimated remaining: 3h 23m 31s. Rate: 7.9 symbols/min
[2025-10-24T18:37:28.958764] [INFO ] [REMOTE    ] ESE: Fetching primary data for 2025-07.
[2025-10-24T18:37:28.962259] [INFO ] [MAIN      ] ESRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:37:29.005476] [DEBUG] [LOCAL     ] ESRT: Loaded 46911 existing records from primary storage.
[2025-10-24T18:37:29.005813] [INFO ] [MAIN      ] ESRT: Loaded 46911 existing records.
[2025-10-24T18:37:29.186093] [WARN ] [MAIN      ] ESRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:37:29.186327] [INFO ] [MAIN      ] ESRT: Wiping existing primary data before full refresh.
[2025-10-24T18:37:29.186373] [INFO ] [LOCAL     ] ESRT: Starting deletion of primary data.
[2025-10-24T18:37:29.186735] [DEBUG] [LOCAL     ] ESRT: Deleted primary data file.
[2025-10-24T18:37:29.186791] [INFO ] [MAIN      ] ESRT: Starting full primary refresh.
[2025-10-24T18:37:29.576016] [INFO ] [REMOTE    ] ESRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:37:29.728249] [INFO ] [REMOTE    ] ESI: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T18:37:29.747602] [INFO ] [REMOTE    ] ESI: Fetching primary data for 2025-06.
[2025-10-24T18:37:30.014412] [INFO ] [REMOTE    ] ESE: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T18:37:30.547617] [INFO ] [REMOTE    ] ESRT: Fetching primary data for 2025-01.
[2025-10-24T18:37:31.347718] [INFO ] [REMOTE    ] ESNT: Fetching primary data for 2025-06.
[2025-10-24T18:37:31.487590] [INFO ] [REMOTE    ] ESI: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T18:37:32.147738] [INFO ] [REMOTE    ] ESI: Fetching primary data for 2025-07.
[2025-10-24T18:37:32.337374] [INFO ] [REMOTE    ] ESRT: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T18:37:32.693969] [INFO ] [REMOTE    ] ESNT: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T18:37:32.947676] [INFO ] [REMOTE    ] ESE: Fetching primary data for 2025-08.
[2025-10-24T18:37:33.747682] [INFO ] [REMOTE    ] ESRT: Fetching primary data for 2025-02.
[2025-10-24T18:37:33.889990] [INFO ] [REMOTE    ] ESI: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T18:37:33.918525] [INFO ] [REMOTE    ] ESE: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T18:37:34.547672] [INFO ] [REMOTE    ] ESI: Fetching primary data for 2025-08.
[2025-10-24T18:37:35.129568] [INFO ] [REMOTE    ] ESRT: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T18:37:35.347634] [INFO ] [REMOTE    ] ESE: Fetching primary data for 2025-09.
[2025-10-24T18:37:36.147638] [INFO ] [REMOTE    ] ESNT: Fetching primary data for 2025-07.
[2025-10-24T18:37:36.212119] [INFO ] [REMOTE    ] ESI: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T18:37:36.367593] [INFO ] [REMOTE    ] ESE: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T18:37:36.947635] [INFO ] [REMOTE    ] ESI: Fetching primary data for 2025-09.
[2025-10-24T18:37:37.350034] [INFO ] [REMOTE    ] ESNT: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T18:37:37.747674] [INFO ] [REMOTE    ] ESE: Fetching primary data for 2025-10.
[2025-10-24T18:37:38.493256] [INFO ] [REMOTE    ] ESI: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T18:37:38.547700] [INFO ] [REMOTE    ] ESRT: Fetching primary data for 2025-03.
[2025-10-24T18:37:38.783729] [INFO ] [REMOTE    ] ESE: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T18:37:38.787029] [INFO ] [REMOTE    ] ESE: Full fetch complete (22959 records).
[2025-10-24T18:37:38.787138] [DEBUG] [VALIDATOR ] ESE: Validating primary data.
[2025-10-24T18:37:39.161532] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present.
[2025-10-24T18:37:39.161609] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed.
[2025-10-24T18:37:39.162130] [INFO ] [MAIN      ] ESE: Fetched primary data is valid.
[2025-10-24T18:37:39.162190] [DEBUG] [LOCAL     ] ESE: Saving primary data.
[2025-10-24T18:37:39.162453] [FATAL] [LOCAL     ] ESE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:37:39.162535] [FATAL] [MAIN      ] ESE: Failed to save primary data.
[2025-10-24T18:37:39.162576] [WARN ] [MAIN      ] ESE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:37:39.162612] [INFO ] [LOCAL     ] ESE: Starting deletion of primary data.
[2025-10-24T18:37:39.162686] [DEBUG] [LOCAL     ] ESE: No primary data file found to delete.
[2025-10-24T18:37:39.162739] [INFO ] [LOCAL     ] ESE: Starting deletion of derivative data.
[2025-10-24T18:37:39.162931] [DEBUG] [LOCAL     ] ESE: Deleted derivative data file.
[2025-10-24T18:37:39.163021] [INFO ] [MAIN      ] Update Progress: 767/2366 symbols completed. ESE took 29.3s. Estimated remaining: 3h 23m 29s. Rate: 7.9 symbols/min
[2025-10-24T18:37:39.338478] [INFO ] [MAIN      ] ESS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:37:39.347695] [INFO ] [REMOTE    ] ESI: Fetching primary data for 2025-10.
[2025-10-24T18:37:39.369624] [DEBUG] [LOCAL     ] ESS: Loaded 30386 existing records from primary storage.
[2025-10-24T18:37:39.369942] [INFO ] [MAIN      ] ESS: Loaded 30386 existing records.
[2025-10-24T18:37:39.548065] [WARN ] [MAIN      ] ESS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:37:39.548318] [INFO ] [MAIN      ] ESS: Wiping existing primary data before full refresh.
[2025-10-24T18:37:39.548365] [INFO ] [LOCAL     ] ESS: Starting deletion of primary data.
[2025-10-24T18:37:39.548979] [DEBUG] [LOCAL     ] ESS: Deleted primary data file.
[2025-10-24T18:37:39.549036] [INFO ] [MAIN      ] ESS: Starting full primary refresh.
[2025-10-24T18:37:39.920585] [INFO ] [REMOTE    ] ESS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:37:39.985940] [INFO ] [REMOTE    ] ESRT: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T18:37:40.147689] [INFO ] [REMOTE    ] ESS: Fetching primary data for 2025-01.
[2025-10-24T18:37:40.790029] [INFO ] [REMOTE    ] ESI: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T18:37:40.799751] [INFO ] [REMOTE    ] ESI: Full fetch complete (73273 records).
[2025-10-24T18:37:40.799880] [DEBUG] [VALIDATOR ] ESI: Validating primary data.
[2025-10-24T18:37:40.952777] [INFO ] [REMOTE    ] ESNT: Fetching primary data for 2025-08.
[2025-10-24T18:37:41.231939] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present.
[2025-10-24T18:37:41.232201] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed.
[2025-10-24T18:37:41.233327] [INFO ] [MAIN      ] ESI: Fetched primary data is valid.
[2025-10-24T18:37:41.233428] [DEBUG] [LOCAL     ] ESI: Saving primary data.
[2025-10-24T18:37:41.234169] [FATAL] [LOCAL     ] ESI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:37:41.234278] [FATAL] [MAIN      ] ESI: Failed to save primary data.
[2025-10-24T18:37:41.234632] [WARN ] [MAIN      ] ESI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:37:41.234932] [INFO ] [LOCAL     ] ESI: Starting deletion of primary data.
[2025-10-24T18:37:41.235225] [DEBUG] [LOCAL     ] ESI: No primary data file found to delete.
[2025-10-24T18:37:41.235311] [INFO ] [LOCAL     ] ESI: Starting deletion of derivative data.
[2025-10-24T18:37:41.242019] [DEBUG] [LOCAL     ] ESI: Deleted derivative data file.
[2025-10-24T18:37:41.253434] [INFO ] [MAIN      ] Update Progress: 768/2366 symbols completed. ESI took 28.9s. Estimated remaining: 3h 23m 10s. Rate: 7.9 symbols/min
[2025-10-24T18:37:41.254531] [INFO ] [REMOTE    ] ESS: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T18:37:41.449507] [INFO ] [MAIN      ] ESTC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:37:41.508605] [DEBUG] [LOCAL     ] ESTC: Loaded 50579 existing records from primary storage.
[2025-10-24T18:37:41.509111] [INFO ] [MAIN      ] ESTC: Loaded 50579 existing records.
[2025-10-24T18:37:41.712319] [WARN ] [MAIN      ] ESTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:37:41.712999] [INFO ] [MAIN      ] ESTC: Wiping existing primary data before full refresh.
[2025-10-24T18:37:41.713091] [INFO ] [LOCAL     ] ESTC: Starting deletion of primary data.
[2025-10-24T18:37:41.714035] [DEBUG] [LOCAL     ] ESTC: Deleted primary data file.
[2025-10-24T18:37:41.714095] [INFO ] [MAIN      ] ESTC: Starting full primary refresh.
[2025-10-24T18:37:41.752837] [INFO ] [REMOTE    ] ESRT: Fetching primary data for 2025-04.
[2025-10-24T18:37:42.094773] [INFO ] [REMOTE    ] ESTC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:37:42.490540] [INFO ] [REMOTE    ] ESNT: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T18:37:42.547706] [INFO ] [REMOTE    ] ESTC: Fetching primary data for 2025-01.
[2025-10-24T18:37:43.347774] [INFO ] [REMOTE    ] ESS: Fetching primary data for 2025-02.
[2025-10-24T18:37:43.487593] [INFO ] [REMOTE    ] ESRT: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T18:37:44.147683] [INFO ] [REMOTE    ] ESRT: Fetching primary data for 2025-05.
[2025-10-24T18:37:44.252028] [INFO ] [REMOTE    ] ESTC: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T18:37:44.581954] [INFO ] [REMOTE    ] ESS: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T18:37:44.947703] [INFO ] [REMOTE    ] ESS: Fetching primary data for 2025-03.
[2025-10-24T18:37:45.663313] [INFO ] [REMOTE    ] ESRT: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T18:37:45.747699] [INFO ] [REMOTE    ] ESRT: Fetching primary data for 2025-06.
[2025-10-24T18:37:45.973479] [INFO ] [REMOTE    ] ESS: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T18:37:46.547678] [INFO ] [REMOTE    ] ESS: Fetching primary data for 2025-04.
[2025-10-24T18:37:46.840062] [INFO ] [REMOTE    ] ESRT: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T18:37:47.347674] [INFO ] [REMOTE    ] ESRT: Fetching primary data for 2025-07.
[2025-10-24T18:37:47.598321] [INFO ] [REMOTE    ] ESS: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T18:37:48.147714] [INFO ] [REMOTE    ] ESTC: Fetching primary data for 2025-02.
[2025-10-24T18:37:48.883296] [INFO ] [REMOTE    ] ESRT: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T18:37:48.947595] [INFO ] [REMOTE    ] ESRT: Fetching primary data for 2025-08.
[2025-10-24T18:37:49.633987] [INFO ] [REMOTE    ] ESTC: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T18:37:49.747639] [INFO ] [REMOTE    ] ESTC: Fetching primary data for 2025-03.
[2025-10-24T18:37:50.444856] [INFO ] [REMOTE    ] ESRT: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T18:37:50.547677] [INFO ] [REMOTE    ] ESRT: Fetching primary data for 2025-09.
[2025-10-24T18:37:51.290828] [INFO ] [REMOTE    ] ESTC: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T18:37:51.347600] [INFO ] [REMOTE    ] ESTC: Fetching primary data for 2025-04.
[2025-10-24T18:37:52.147705] [INFO ] [REMOTE    ] ESNT: Fetching primary data for 2025-09.
[2025-10-24T18:37:52.240388] [INFO ] [REMOTE    ] ESRT: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T18:37:52.893045] [INFO ] [REMOTE    ] ESTC: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T18:37:52.947620] [INFO ] [REMOTE    ] ESTC: Fetching primary data for 2025-05.
[2025-10-24T18:37:53.590131] [INFO ] [REMOTE    ] ESNT: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T18:37:53.747614] [INFO ] [REMOTE    ] ESS: Fetching primary data for 2025-05.
[2025-10-24T18:37:54.547683] [INFO ] [REMOTE    ] ESNT: Fetching primary data for 2025-10.
[2025-10-24T18:37:54.756113] [INFO ] [REMOTE    ] ESTC: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T18:37:55.217531] [INFO ] [REMOTE    ] ESS: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T18:37:55.347671] [INFO ] [REMOTE    ] ESS: Fetching primary data for 2025-06.
[2025-10-24T18:37:55.810420] [INFO ] [REMOTE    ] ESNT: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T18:37:55.820271] [INFO ] [REMOTE    ] ESNT: Full fetch complete (57045 records).
[2025-10-24T18:37:55.820383] [DEBUG] [VALIDATOR ] ESNT: Validating primary data.
[2025-10-24T18:37:56.149825] [INFO ] [REMOTE    ] ESRT: Fetching primary data for 2025-10.
[2025-10-24T18:37:56.203433] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present.
[2025-10-24T18:37:56.203568] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed.
[2025-10-24T18:37:56.204420] [INFO ] [MAIN      ] ESNT: Fetched primary data is valid.
[2025-10-24T18:37:56.204499] [DEBUG] [LOCAL     ] ESNT: Saving primary data.
[2025-10-24T18:37:56.205055] [FATAL] [LOCAL     ] ESNT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:37:56.205192] [FATAL] [MAIN      ] ESNT: Failed to save primary data.
[2025-10-24T18:37:56.205769] [WARN ] [MAIN      ] ESNT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:37:56.205892] [INFO ] [LOCAL     ] ESNT: Starting deletion of primary data.
[2025-10-24T18:37:56.205987] [DEBUG] [LOCAL     ] ESNT: No primary data file found to delete.
[2025-10-24T18:37:56.206031] [INFO ] [LOCAL     ] ESNT: Starting deletion of derivative data.
[2025-10-24T18:37:56.206188] [DEBUG] [LOCAL     ] ESNT: Deleted derivative data file.
[2025-10-24T18:37:56.206281] [INFO ] [MAIN      ] Update Progress: 769/2366 symbols completed. ESNT took 43.2s. Estimated remaining: 3h 23m 17s. Rate: 7.9 symbols/min
[2025-10-24T18:37:56.346741] [INFO ] [REMOTE    ] ESS: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T18:37:56.401343] [INFO ] [MAIN      ] ET: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:37:56.452075] [DEBUG] [LOCAL     ] ET: Loaded 54179 existing records from primary storage.
[2025-10-24T18:37:56.452380] [INFO ] [MAIN      ] ET: Loaded 54179 existing records.
[2025-10-24T18:37:56.630127] [WARN ] [MAIN      ] ET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:37:56.630307] [INFO ] [MAIN      ] ET: Wiping existing primary data before full refresh.
[2025-10-24T18:37:56.630352] [INFO ] [LOCAL     ] ET: Starting deletion of primary data.
[2025-10-24T18:37:56.631281] [DEBUG] [LOCAL     ] ET: Deleted primary data file.
[2025-10-24T18:37:56.631337] [INFO ] [MAIN      ] ET: Starting full primary refresh.
[2025-10-24T18:37:56.949308] [INFO ] [REMOTE    ] ESS: Fetching primary data for 2025-07.
[2025-10-24T18:37:56.983586] [INFO ] [REMOTE    ] ET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:37:57.747612] [INFO ] [REMOTE    ] ESTC: Fetching primary data for 2025-06.
[2025-10-24T18:37:57.989855] [INFO ] [REMOTE    ] ESRT: Incremental fetch complete for 2025-10 (1.84 seconds).
[2025-10-24T18:37:57.998835] [INFO ] [REMOTE    ] ESRT: Full fetch complete (66771 records).
[2025-10-24T18:37:57.999030] [DEBUG] [VALIDATOR ] ESRT: Validating primary data.
[2025-10-24T18:37:58.208771] [INFO ] [REMOTE    ] ESS: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T18:37:58.426124] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present.
[2025-10-24T18:37:58.426220] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed.
[2025-10-24T18:37:58.427079] [INFO ] [MAIN      ] ESRT: Fetched primary data is valid.
[2025-10-24T18:37:58.427172] [DEBUG] [LOCAL     ] ESRT: Saving primary data.
[2025-10-24T18:37:58.427824] [FATAL] [LOCAL     ] ESRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:37:58.427919] [FATAL] [MAIN      ] ESRT: Failed to save primary data.
[2025-10-24T18:37:58.427962] [WARN ] [MAIN      ] ESRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:37:58.428011] [INFO ] [LOCAL     ] ESRT: Starting deletion of primary data.
[2025-10-24T18:37:58.428075] [DEBUG] [LOCAL     ] ESRT: No primary data file found to delete.
[2025-10-24T18:37:58.428116] [INFO ] [LOCAL     ] ESRT: Starting deletion of derivative data.
[2025-10-24T18:37:58.428258] [DEBUG] [LOCAL     ] ESRT: Deleted derivative data file.
[2025-10-24T18:37:58.428770] [INFO ] [MAIN      ] Update Progress: 770/2366 symbols completed. ESRT took 29.6s. Estimated remaining: 3h 22m 58s. Rate: 7.9 symbols/min
[2025-10-24T18:37:58.552818] [INFO ] [REMOTE    ] ESS: Fetching primary data for 2025-08.
[2025-10-24T18:37:58.609616] [INFO ] [MAIN      ] ETB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:37:58.624718] [DEBUG] [LOCAL     ] ETB: Loaded 11826 existing records from primary storage.
[2025-10-24T18:37:58.625028] [INFO ] [MAIN      ] ETB: Loaded 11826 existing records.
[2025-10-24T18:37:58.820878] [WARN ] [MAIN      ] ETB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:37:58.821092] [INFO ] [MAIN      ] ETB: Wiping existing primary data before full refresh.
[2025-10-24T18:37:58.821141] [INFO ] [LOCAL     ] ETB: Starting deletion of primary data.
[2025-10-24T18:37:58.821480] [DEBUG] [LOCAL     ] ETB: Deleted primary data file.
[2025-10-24T18:37:58.821538] [INFO ] [MAIN      ] ETB: Starting full primary refresh.
[2025-10-24T18:37:59.224985] [INFO ] [REMOTE    ] ETB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:37:59.347624] [INFO ] [REMOTE    ] ET: Fetching primary data for 2025-01.
[2025-10-24T18:37:59.389803] [INFO ] [REMOTE    ] ESTC: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T18:38:00.020519] [INFO ] [REMOTE    ] ESS: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T18:38:00.147618] [INFO ] [REMOTE    ] ESS: Fetching primary data for 2025-09.
[2025-10-24T18:38:00.947680] [INFO ] [REMOTE    ] ESTC: Fetching primary data for 2025-07.
[2025-10-24T18:38:01.508609] [INFO ] [REMOTE    ] ESS: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T18:38:01.616179] [INFO ] [REMOTE    ] ET: Incremental fetch complete for 2025-01 (2.27 seconds).
[2025-10-24T18:38:01.747700] [INFO ] [REMOTE    ] ET: Fetching primary data for 2025-02.
[2025-10-24T18:38:02.415384] [INFO ] [REMOTE    ] ESTC: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T18:38:02.547690] [INFO ] [REMOTE    ] ESS: Fetching primary data for 2025-10.
[2025-10-24T18:38:03.347709] [INFO ] [REMOTE    ] ESTC: Fetching primary data for 2025-08.
[2025-10-24T18:38:03.908713] [INFO ] [REMOTE    ] ET: Incremental fetch complete for 2025-02 (2.16 seconds).
[2025-10-24T18:38:03.950489] [INFO ] [REMOTE    ] ESS: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T18:38:03.956185] [INFO ] [REMOTE    ] ESS: Full fetch complete (43893 records).
[2025-10-24T18:38:03.956297] [DEBUG] [VALIDATOR ] ESS: Validating primary data.
[2025-10-24T18:38:04.157970] [INFO ] [REMOTE    ] ET: Fetching primary data for 2025-03.
[2025-10-24T18:38:04.392449] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present.
[2025-10-24T18:38:04.392541] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed.
[2025-10-24T18:38:04.393249] [INFO ] [MAIN      ] ESS: Fetched primary data is valid.
[2025-10-24T18:38:04.393310] [DEBUG] [LOCAL     ] ESS: Saving primary data.
[2025-10-24T18:38:04.393826] [FATAL] [LOCAL     ] ESS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:38:04.393911] [FATAL] [MAIN      ] ESS: Failed to save primary data.
[2025-10-24T18:38:04.393953] [WARN ] [MAIN      ] ESS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:38:04.393988] [INFO ] [LOCAL     ] ESS: Starting deletion of primary data.
[2025-10-24T18:38:04.394039] [DEBUG] [LOCAL     ] ESS: No primary data file found to delete.
[2025-10-24T18:38:04.394073] [INFO ] [LOCAL     ] ESS: Starting deletion of derivative data.
[2025-10-24T18:38:04.394212] [DEBUG] [LOCAL     ] ESS: Deleted derivative data file.
[2025-10-24T18:38:04.394289] [INFO ] [MAIN      ] Update Progress: 771/2366 symbols completed. ESS took 25.2s. Estimated remaining: 3h 22m 47s. Rate: 7.9 symbols/min
[2025-10-24T18:38:04.564295] [INFO ] [MAIN      ] ETD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:38:04.593328] [DEBUG] [LOCAL     ] ETD: Loaded 27262 existing records from primary storage.
[2025-10-24T18:38:04.593605] [INFO ] [MAIN      ] ETD: Loaded 27262 existing records.
[2025-10-24T18:38:04.772666] [WARN ] [MAIN      ] ETD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:38:04.772853] [INFO ] [MAIN      ] ETD: Wiping existing primary data before full refresh.
[2025-10-24T18:38:04.772897] [INFO ] [LOCAL     ] ETD: Starting deletion of primary data.
[2025-10-24T18:38:04.773229] [DEBUG] [LOCAL     ] ETD: Deleted primary data file.
[2025-10-24T18:38:04.773267] [INFO ] [MAIN      ] ETD: Starting full primary refresh.
[2025-10-24T18:38:04.954533] [INFO ] [REMOTE    ] ETB: Fetching primary data for 2025-01.
[2025-10-24T18:38:05.133034] [INFO ] [REMOTE    ] ETD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:38:05.160393] [INFO ] [REMOTE    ] ESTC: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T18:38:05.747611] [INFO ] [REMOTE    ] ETD: Fetching primary data for 2025-01.
[2025-10-24T18:38:06.045912] [INFO ] [REMOTE    ] ETB: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T18:38:06.294556] [INFO ] [REMOTE    ] ET: Incremental fetch complete for 2025-03 (2.14 seconds).
[2025-10-24T18:38:06.547675] [INFO ] [REMOTE    ] ETB: Fetching primary data for 2025-02.
[2025-10-24T18:38:07.151085] [INFO ] [REMOTE    ] ETD: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T18:38:07.347693] [INFO ] [REMOTE    ] ESTC: Fetching primary data for 2025-09.
[2025-10-24T18:38:07.572149] [INFO ] [REMOTE    ] ETB: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T18:38:08.147666] [INFO ] [REMOTE    ] ETB: Fetching primary data for 2025-03.
[2025-10-24T18:38:08.947624] [INFO ] [REMOTE    ] ETD: Fetching primary data for 2025-02.
[2025-10-24T18:38:09.118897] [INFO ] [REMOTE    ] ESTC: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T18:38:09.154082] [INFO ] [REMOTE    ] ETB: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T18:38:09.747632] [INFO ] [REMOTE    ] ETB: Fetching primary data for 2025-04.
[2025-10-24T18:38:10.048825] [INFO ] [REMOTE    ] ETD: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T18:38:10.436441] [INFO ] [REMOTE    ] ETB: Incremental fetch complete for 2025-04 (0.69 seconds).
[2025-10-24T18:38:10.547673] [INFO ] [REMOTE    ] ETB: Fetching primary data for 2025-05.
[2025-10-24T18:38:11.347705] [INFO ] [REMOTE    ] ETD: Fetching primary data for 2025-03.
[2025-10-24T18:38:11.439035] [INFO ] [REMOTE    ] ETB: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T18:38:12.147627] [INFO ] [REMOTE    ] ET: Fetching primary data for 2025-04.
[2025-10-24T18:38:12.465420] [INFO ] [REMOTE    ] ETD: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T18:38:12.947733] [INFO ] [REMOTE    ] ESTC: Fetching primary data for 2025-10.
[2025-10-24T18:38:13.747688] [INFO ] [REMOTE    ] ETB: Fetching primary data for 2025-06.
[2025-10-24T18:38:14.455559] [INFO ] [REMOTE    ] ET: Incremental fetch complete for 2025-04 (2.31 seconds).
[2025-10-24T18:38:14.535281] [INFO ] [REMOTE    ] ETB: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T18:38:14.547592] [INFO ] [REMOTE    ] ETB: Fetching primary data for 2025-07.
[2025-10-24T18:38:14.748106] [INFO ] [REMOTE    ] ESTC: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T18:38:14.757665] [INFO ] [REMOTE    ] ESTC: Full fetch complete (72496 records).
[2025-10-24T18:38:14.757825] [DEBUG] [VALIDATOR ] ESTC: Validating primary data.
[2025-10-24T18:38:15.165732] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present.
[2025-10-24T18:38:15.165836] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed.
[2025-10-24T18:38:15.166971] [INFO ] [MAIN      ] ESTC: Fetched primary data is valid.
[2025-10-24T18:38:15.167036] [DEBUG] [LOCAL     ] ESTC: Saving primary data.
[2025-10-24T18:38:15.167725] [FATAL] [LOCAL     ] ESTC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:38:15.167816] [FATAL] [MAIN      ] ESTC: Failed to save primary data.
[2025-10-24T18:38:15.167857] [WARN ] [MAIN      ] ESTC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:38:15.167893] [INFO ] [LOCAL     ] ESTC: Starting deletion of primary data.
[2025-10-24T18:38:15.167947] [DEBUG] [LOCAL     ] ESTC: No primary data file found to delete.
[2025-10-24T18:38:15.167981] [INFO ] [LOCAL     ] ESTC: Starting deletion of derivative data.
[2025-10-24T18:38:15.168303] [DEBUG] [LOCAL     ] ESTC: Deleted derivative data file.
[2025-10-24T18:38:15.168772] [INFO ] [MAIN      ] Update Progress: 772/2366 symbols completed. ESTC took 33.9s. Estimated remaining: 3h 22m 46s. Rate: 7.9 symbols/min
[2025-10-24T18:38:15.348530] [INFO ] [REMOTE    ] ET: Fetching primary data for 2025-05.
[2025-10-24T18:38:15.384467] [INFO ] [MAIN      ] ETG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:38:15.396238] [INFO ] [REMOTE    ] ETB: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T18:38:15.418821] [DEBUG] [LOCAL     ] ETG: Loaded 16587 existing records from primary storage.
[2025-10-24T18:38:15.419133] [INFO ] [MAIN      ] ETG: Loaded 16587 existing records.
[2025-10-24T18:38:15.684042] [WARN ] [MAIN      ] ETG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:38:15.684356] [INFO ] [MAIN      ] ETG: Wiping existing primary data before full refresh.
[2025-10-24T18:38:15.684427] [INFO ] [LOCAL     ] ETG: Starting deletion of primary data.
[2025-10-24T18:38:15.684718] [DEBUG] [LOCAL     ] ETG: Deleted primary data file.
[2025-10-24T18:38:15.684790] [INFO ] [MAIN      ] ETG: Starting full primary refresh.
[2025-10-24T18:38:16.121846] [INFO ] [REMOTE    ] ETG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:38:16.147719] [INFO ] [REMOTE    ] ETG: Fetching primary data for 2025-01.
[2025-10-24T18:38:16.947695] [INFO ] [REMOTE    ] ETD: Fetching primary data for 2025-04.
[2025-10-24T18:38:17.159983] [INFO ] [REMOTE    ] ETG: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T18:38:17.748322] [INFO ] [REMOTE    ] ETB: Fetching primary data for 2025-08.
[2025-10-24T18:38:17.751289] [INFO ] [REMOTE    ] ET: Incremental fetch complete for 2025-05 (2.40 seconds).
[2025-10-24T18:38:18.248872] [INFO ] [REMOTE    ] ETD: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T18:38:18.547740] [INFO ] [REMOTE    ] ETG: Fetching primary data for 2025-02.
[2025-10-24T18:38:18.651039] [INFO ] [REMOTE    ] ETB: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T18:38:19.347672] [INFO ] [REMOTE    ] ETD: Fetching primary data for 2025-05.
[2025-10-24T18:38:19.549263] [INFO ] [REMOTE    ] ETG: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T18:38:20.147615] [INFO ] [REMOTE    ] ET: Fetching primary data for 2025-06.
[2025-10-24T18:38:20.583551] [INFO ] [REMOTE    ] ETD: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T18:38:20.947674] [INFO ] [REMOTE    ] ETB: Fetching primary data for 2025-09.
[2025-10-24T18:38:21.747673] [INFO ] [REMOTE    ] ETG: Fetching primary data for 2025-03.
[2025-10-24T18:38:21.852317] [INFO ] [REMOTE    ] ETB: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T18:38:22.033761] [INFO ] [REMOTE    ] ET: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T18:38:22.547741] [INFO ] [REMOTE    ] ETB: Fetching primary data for 2025-10.
[2025-10-24T18:38:22.733672] [INFO ] [REMOTE    ] ETG: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T18:38:23.347634] [INFO ] [REMOTE    ] ETG: Fetching primary data for 2025-04.
[2025-10-24T18:38:23.580790] [INFO ] [REMOTE    ] ETB: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T18:38:23.583797] [INFO ] [REMOTE    ] ETB: Full fetch complete (18466 records).
[2025-10-24T18:38:23.583883] [DEBUG] [VALIDATOR ] ETB: Validating primary data.
[2025-10-24T18:38:23.958530] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present.
[2025-10-24T18:38:23.958613] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed.
[2025-10-24T18:38:23.959047] [INFO ] [MAIN      ] ETB: Fetched primary data is valid.
[2025-10-24T18:38:23.959105] [DEBUG] [LOCAL     ] ETB: Saving primary data.
[2025-10-24T18:38:23.959355] [FATAL] [LOCAL     ] ETB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:38:23.959440] [FATAL] [MAIN      ] ETB: Failed to save primary data.
[2025-10-24T18:38:23.959482] [WARN ] [MAIN      ] ETB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:38:23.959516] [INFO ] [LOCAL     ] ETB: Starting deletion of primary data.
[2025-10-24T18:38:23.959566] [DEBUG] [LOCAL     ] ETB: No primary data file found to delete.
[2025-10-24T18:38:23.959601] [INFO ] [LOCAL     ] ETB: Starting deletion of derivative data.
[2025-10-24T18:38:23.959760] [DEBUG] [LOCAL     ] ETB: Deleted derivative data file.
[2025-10-24T18:38:23.959846] [INFO ] [MAIN      ] Update Progress: 773/2366 symbols completed. ETB took 25.5s. Estimated remaining: 3h 22m 41s. Rate: 7.9 symbols/min
[2025-10-24T18:38:24.134708] [INFO ] [MAIN      ] ETJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:38:24.147675] [INFO ] [REMOTE    ] ETD: Fetching primary data for 2025-06.
[2025-10-24T18:38:24.155389] [DEBUG] [LOCAL     ] ETJ: Loaded 16510 existing records from primary storage.
[2025-10-24T18:38:24.155626] [INFO ] [MAIN      ] ETJ: Loaded 16510 existing records.
[2025-10-24T18:38:24.334801] [WARN ] [MAIN      ] ETJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:38:24.335003] [INFO ] [MAIN      ] ETJ: Wiping existing primary data before full refresh.
[2025-10-24T18:38:24.335051] [INFO ] [LOCAL     ] ETJ: Starting deletion of primary data.
[2025-10-24T18:38:24.335286] [DEBUG] [LOCAL     ] ETJ: Deleted primary data file.
[2025-10-24T18:38:24.335341] [INFO ] [MAIN      ] ETJ: Starting full primary refresh.
[2025-10-24T18:38:24.497767] [INFO ] [REMOTE    ] ETG: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T18:38:24.712415] [INFO ] [REMOTE    ] ETJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:38:24.947735] [INFO ] [REMOTE    ] ETG: Fetching primary data for 2025-05.
[2025-10-24T18:38:25.147964] [INFO ] [REMOTE    ] ETD: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T18:38:25.718854] [INFO ] [REMOTE    ] ETG: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T18:38:25.747743] [INFO ] [REMOTE    ] ETG: Fetching primary data for 2025-06.
[2025-10-24T18:38:26.547695] [INFO ] [REMOTE    ] ETD: Fetching primary data for 2025-07.
[2025-10-24T18:38:26.730029] [INFO ] [REMOTE    ] ETG: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T18:38:27.347615] [INFO ] [REMOTE    ] ETJ: Fetching primary data for 2025-01.
[2025-10-24T18:38:27.746529] [INFO ] [REMOTE    ] ETD: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T18:38:28.147737] [INFO ] [REMOTE    ] ETG: Fetching primary data for 2025-07.
[2025-10-24T18:38:28.432281] [INFO ] [REMOTE    ] ETJ: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T18:38:28.947688] [INFO ] [REMOTE    ] ETD: Fetching primary data for 2025-08.
[2025-10-24T18:38:29.240857] [INFO ] [REMOTE    ] ETG: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T18:38:29.747726] [INFO ] [REMOTE    ] ETG: Fetching primary data for 2025-08.
[2025-10-24T18:38:30.442938] [INFO ] [REMOTE    ] ETD: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T18:38:30.547624] [INFO ] [REMOTE    ] ET: Fetching primary data for 2025-07.
[2025-10-24T18:38:30.736560] [INFO ] [REMOTE    ] ETG: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T18:38:31.347733] [INFO ] [REMOTE    ] ETG: Fetching primary data for 2025-09.
[2025-10-24T18:38:32.147705] [INFO ] [REMOTE    ] ETJ: Fetching primary data for 2025-02.
[2025-10-24T18:38:32.233424] [INFO ] [REMOTE    ] ETG: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T18:38:32.715410] [INFO ] [REMOTE    ] ET: Incremental fetch complete for 2025-07 (2.17 seconds).
[2025-10-24T18:38:32.947710] [INFO ] [REMOTE    ] ETD: Fetching primary data for 2025-09.
[2025-10-24T18:38:33.072469] [INFO ] [REMOTE    ] ETJ: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T18:38:33.747720] [INFO ] [REMOTE    ] ET: Fetching primary data for 2025-08.
[2025-10-24T18:38:34.034320] [INFO ] [REMOTE    ] ETD: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T18:38:34.547718] [INFO ] [REMOTE    ] ETG: Fetching primary data for 2025-10.
[2025-10-24T18:38:35.347716] [INFO ] [REMOTE    ] ETD: Fetching primary data for 2025-10.
[2025-10-24T18:38:35.538685] [INFO ] [REMOTE    ] ETG: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T18:38:35.544004] [INFO ] [REMOTE    ] ETG: Full fetch complete (24537 records).
[2025-10-24T18:38:35.544090] [DEBUG] [VALIDATOR ] ETG: Validating primary data.
[2025-10-24T18:38:35.947992] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present.
[2025-10-24T18:38:35.948129] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed.
[2025-10-24T18:38:35.949068] [INFO ] [MAIN      ] ETG: Fetched primary data is valid.
[2025-10-24T18:38:35.949183] [DEBUG] [LOCAL     ] ETG: Saving primary data.
[2025-10-24T18:38:35.949917] [FATAL] [LOCAL     ] ETG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:38:35.950215] [FATAL] [MAIN      ] ETG: Failed to save primary data.
[2025-10-24T18:38:35.950358] [WARN ] [MAIN      ] ETG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:38:35.950482] [INFO ] [LOCAL     ] ETG: Starting deletion of primary data.
[2025-10-24T18:38:35.950928] [DEBUG] [LOCAL     ] ETG: No primary data file found to delete.
[2025-10-24T18:38:35.951140] [INFO ] [LOCAL     ] ETG: Starting deletion of derivative data.
[2025-10-24T18:38:35.965054] [DEBUG] [LOCAL     ] ETG: Deleted derivative data file.
[2025-10-24T18:38:35.980894] [INFO ] [MAIN      ] Update Progress: 774/2366 symbols completed. ETG took 20.8s. Estimated remaining: 3h 22m 42s. Rate: 7.9 symbols/min
[2025-10-24T18:38:36.072253] [INFO ] [REMOTE    ] ET: Incremental fetch complete for 2025-08 (2.32 seconds).
[2025-10-24T18:38:36.153277] [INFO ] [REMOTE    ] ET: Fetching primary data for 2025-09.
[2025-10-24T18:38:36.191304] [INFO ] [MAIN      ] ETN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:38:36.252338] [DEBUG] [LOCAL     ] ETN: Loaded 52954 existing records from primary storage.
[2025-10-24T18:38:36.252930] [INFO ] [MAIN      ] ETN: Loaded 52954 existing records.
[2025-10-24T18:38:36.468487] [WARN ] [MAIN      ] ETN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:38:36.468804] [INFO ] [MAIN      ] ETN: Wiping existing primary data before full refresh.
[2025-10-24T18:38:36.468864] [INFO ] [LOCAL     ] ETN: Starting deletion of primary data.
[2025-10-24T18:38:36.469212] [DEBUG] [LOCAL     ] ETN: Deleted primary data file.
[2025-10-24T18:38:36.469272] [INFO ] [MAIN      ] ETN: Starting full primary refresh.
[2025-10-24T18:38:36.832820] [INFO ] [REMOTE    ] ETD: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T18:38:36.853205] [INFO ] [REMOTE    ] ETD: Full fetch complete (38464 records).
[2025-10-24T18:38:36.884711] [DEBUG] [VALIDATOR ] ETD: Validating primary data.
[2025-10-24T18:38:36.955562] [INFO ] [REMOTE    ] ETJ: Fetching primary data for 2025-03.
[2025-10-24T18:38:36.973572] [INFO ] [REMOTE    ] ETN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:38:37.371872] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present.
[2025-10-24T18:38:37.371971] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed.
[2025-10-24T18:38:37.372833] [INFO ] [MAIN      ] ETD: Fetched primary data is valid.
[2025-10-24T18:38:37.372900] [DEBUG] [LOCAL     ] ETD: Saving primary data.
[2025-10-24T18:38:37.373564] [FATAL] [LOCAL     ] ETD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:38:37.373683] [FATAL] [MAIN      ] ETD: Failed to save primary data.
[2025-10-24T18:38:37.373735] [WARN ] [MAIN      ] ETD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:38:37.373772] [INFO ] [LOCAL     ] ETD: Starting deletion of primary data.
[2025-10-24T18:38:37.373830] [DEBUG] [LOCAL     ] ETD: No primary data file found to delete.
[2025-10-24T18:38:37.373865] [INFO ] [LOCAL     ] ETD: Starting deletion of derivative data.
[2025-10-24T18:38:37.374031] [DEBUG] [LOCAL     ] ETD: Deleted derivative data file.
[2025-10-24T18:38:37.374140] [INFO ] [MAIN      ] Update Progress: 775/2366 symbols completed. ETD took 33.0s. Estimated remaining: 3h 22m 22s. Rate: 7.9 symbols/min
[2025-10-24T18:38:37.560985] [INFO ] [MAIN      ] ETO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:38:37.573413] [DEBUG] [LOCAL     ] ETO: Loaded 6917 existing records from primary storage.
[2025-10-24T18:38:37.573768] [INFO ] [MAIN      ] ETO: Loaded 6917 existing records.
[2025-10-24T18:38:37.754111] [INFO ] [REMOTE    ] ETN: Fetching primary data for 2025-01.
[2025-10-24T18:38:37.759702] [WARN ] [MAIN      ] ETO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:38:37.760950] [INFO ] [MAIN      ] ETO: Wiping existing primary data before full refresh.
[2025-10-24T18:38:37.761015] [INFO ] [LOCAL     ] ETO: Starting deletion of primary data.
[2025-10-24T18:38:37.761194] [DEBUG] [LOCAL     ] ETO: Deleted primary data file.
[2025-10-24T18:38:37.761275] [INFO ] [MAIN      ] ETO: Starting full primary refresh.
[2025-10-24T18:38:38.190294] [INFO ] [REMOTE    ] ETO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:38:38.192545] [INFO ] [REMOTE    ] ETJ: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T18:38:38.376024] [INFO ] [REMOTE    ] ET: Incremental fetch complete for 2025-09 (2.22 seconds).
[2025-10-24T18:38:38.547819] [INFO ] [REMOTE    ] ET: Fetching primary data for 2025-10.
[2025-10-24T18:38:39.347632] [INFO ] [REMOTE    ] ETO: Fetching primary data for 2025-01.
[2025-10-24T18:38:39.785728] [INFO ] [REMOTE    ] ETN: Incremental fetch complete for 2025-01 (2.03 seconds).
[2025-10-24T18:38:39.904960] [INFO ] [REMOTE    ] ETO: Incremental fetch complete for 2025-01 (0.56 seconds).
[2025-10-24T18:38:40.147718] [INFO ] [REMOTE    ] ETJ: Fetching primary data for 2025-04.
[2025-10-24T18:38:40.519146] [INFO ] [REMOTE    ] ET: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T18:38:40.528991] [INFO ] [REMOTE    ] ET: Full fetch complete (77969 records).
[2025-10-24T18:38:40.529134] [DEBUG] [VALIDATOR ] ET: Validating primary data.
[2025-10-24T18:38:40.926830] [DEBUG] [VALIDATOR ] ET: All expected trading days are present.
[2025-10-24T18:38:40.926930] [DEBUG] [VALIDATOR ] ET: Primary data validation passed.
[2025-10-24T18:38:40.927905] [INFO ] [MAIN      ] ET: Fetched primary data is valid.
[2025-10-24T18:38:40.927978] [DEBUG] [LOCAL     ] ET: Saving primary data.
[2025-10-24T18:38:40.928625] [FATAL] [LOCAL     ] ET: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:38:40.928744] [FATAL] [MAIN      ] ET: Failed to save primary data.
[2025-10-24T18:38:40.928786] [WARN ] [MAIN      ] ET: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:38:40.928823] [INFO ] [LOCAL     ] ET: Starting deletion of primary data.
[2025-10-24T18:38:40.928877] [DEBUG] [LOCAL     ] ET: No primary data file found to delete.
[2025-10-24T18:38:40.928912] [INFO ] [LOCAL     ] ET: Starting deletion of derivative data.
[2025-10-24T18:38:40.929074] [DEBUG] [LOCAL     ] ET: Deleted derivative data file.
[2025-10-24T18:38:40.929547] [INFO ] [MAIN      ] Update Progress: 776/2366 symbols completed. ET took 44.7s. Estimated remaining: 3h 22m 6s. Rate: 7.9 symbols/min
[2025-10-24T18:38:40.952812] [INFO ] [REMOTE    ] ETN: Fetching primary data for 2025-02.
[2025-10-24T18:38:41.110955] [INFO ] [MAIN      ] ETR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:38:41.125409] [INFO ] [REMOTE    ] ETJ: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T18:38:41.180793] [DEBUG] [LOCAL     ] ETR: Loaded 53572 existing records from primary storage.
[2025-10-24T18:38:41.181129] [INFO ] [MAIN      ] ETR: Loaded 53572 existing records.
[2025-10-24T18:38:41.358789] [WARN ] [MAIN      ] ETR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:38:41.359003] [INFO ] [MAIN      ] ETR: Wiping existing primary data before full refresh.
[2025-10-24T18:38:41.359052] [INFO ] [LOCAL     ] ETR: Starting deletion of primary data.
[2025-10-24T18:38:41.359262] [DEBUG] [LOCAL     ] ETR: Deleted primary data file.
[2025-10-24T18:38:41.359299] [INFO ] [MAIN      ] ETR: Starting full primary refresh.
[2025-10-24T18:38:41.707479] [INFO ] [REMOTE    ] ETR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:38:41.747601] [INFO ] [REMOTE    ] ETR: Fetching primary data for 2025-01.
[2025-10-24T18:38:42.547685] [INFO ] [REMOTE    ] ETO: Fetching primary data for 2025-02.
[2025-10-24T18:38:42.755582] [INFO ] [REMOTE    ] ETN: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T18:38:43.149789] [INFO ] [REMOTE    ] ETO: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T18:38:43.149611] [INFO ] [REMOTE    ] ETR: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T18:38:43.347607] [INFO ] [REMOTE    ] ETR: Fetching primary data for 2025-02.
[2025-10-24T18:38:44.147675] [INFO ] [REMOTE    ] ETO: Fetching primary data for 2025-03.
[2025-10-24T18:38:44.754615] [INFO ] [REMOTE    ] ETO: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T18:38:44.947609] [INFO ] [REMOTE    ] ETO: Fetching primary data for 2025-04.
[2025-10-24T18:38:45.047230] [INFO ] [REMOTE    ] ETR: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T18:38:45.643162] [INFO ] [REMOTE    ] ETO: Incremental fetch complete for 2025-04 (0.70 seconds).
[2025-10-24T18:38:45.747622] [INFO ] [REMOTE    ] ETO: Fetching primary data for 2025-05.
[2025-10-24T18:38:46.540878] [INFO ] [REMOTE    ] ETO: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T18:38:46.547593] [INFO ] [REMOTE    ] ETO: Fetching primary data for 2025-06.
[2025-10-24T18:38:47.347666] [INFO ] [REMOTE    ] ETJ: Fetching primary data for 2025-05.
[2025-10-24T18:38:47.486745] [INFO ] [REMOTE    ] ETO: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T18:38:48.147713] [INFO ] [REMOTE    ] ETO: Fetching primary data for 2025-07.
[2025-10-24T18:38:48.201945] [INFO ] [REMOTE    ] ETJ: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T18:38:48.633182] [INFO ] [REMOTE    ] ETO: Incremental fetch complete for 2025-07 (0.49 seconds).
[2025-10-24T18:38:48.947715] [INFO ] [REMOTE    ] ETJ: Fetching primary data for 2025-06.
[2025-10-24T18:38:49.747719] [INFO ] [REMOTE    ] ETR: Fetching primary data for 2025-03.
[2025-10-24T18:38:49.966965] [INFO ] [REMOTE    ] ETJ: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T18:38:50.547702] [INFO ] [REMOTE    ] ETJ: Fetching primary data for 2025-07.
[2025-10-24T18:38:51.347672] [INFO ] [REMOTE    ] ETN: Fetching primary data for 2025-03.
[2025-10-24T18:38:51.576596] [INFO ] [REMOTE    ] ETR: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T18:38:51.588525] [INFO ] [REMOTE    ] ETJ: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T18:38:52.147630] [INFO ] [REMOTE    ] ETJ: Fetching primary data for 2025-08.
[2025-10-24T18:38:52.947636] [INFO ] [REMOTE    ] ETR: Fetching primary data for 2025-04.
[2025-10-24T18:38:53.319698] [INFO ] [REMOTE    ] ETJ: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T18:38:53.326702] [INFO ] [REMOTE    ] ETN: Incremental fetch complete for 2025-03 (1.98 seconds).
[2025-10-24T18:38:53.747664] [INFO ] [REMOTE    ] ETO: Fetching primary data for 2025-08.
[2025-10-24T18:38:54.487589] [INFO ] [REMOTE    ] ETO: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T18:38:54.547676] [INFO ] [REMOTE    ] ETJ: Fetching primary data for 2025-09.
[2025-10-24T18:38:54.649418] [DEBUG] [REMOTE    ] ETJ: Error fetching primary data for 2025-09: 'API call returned an empty response.'
[2025-10-24T18:38:54.649743] [WARN ] [REMOTE    ] ETJ: No data returned for month 2025-09
[2025-10-24T18:38:54.649831] [FATAL] [REMOTE    ] ETJ: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:38:54.649907] [FATAL] [MAIN      ] ETJ: Failed to fetch primary data.
[2025-10-24T18:38:54.649945] [WARN ] [MAIN      ] ETJ: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:38:54.649982] [INFO ] [LOCAL     ] ETJ: Starting deletion of primary data.
[2025-10-24T18:38:54.650034] [DEBUG] [LOCAL     ] ETJ: No primary data file found to delete.
[2025-10-24T18:38:54.650068] [INFO ] [LOCAL     ] ETJ: Starting deletion of derivative data.
[2025-10-24T18:38:54.650220] [DEBUG] [LOCAL     ] ETJ: Deleted derivative data file.
[2025-10-24T18:38:54.650302] [INFO ] [MAIN      ] Update Progress: 777/2366 symbols completed. ETJ took 30.7s. Estimated remaining: 3h 22m 11s. Rate: 7.9 symbols/min
[2025-10-24T18:38:54.822048] [INFO ] [MAIN      ] ETSY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:38:54.853183] [INFO ] [REMOTE    ] ETR: Incremental fetch complete for 2025-04 (1.91 seconds).
[2025-10-24T18:38:54.910213] [DEBUG] [LOCAL     ] ETSY: Loaded 53952 existing records from primary storage.
[2025-10-24T18:38:54.910518] [INFO ] [MAIN      ] ETSY: Loaded 53952 existing records.
[2025-10-24T18:38:55.084225] [WARN ] [MAIN      ] ETSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:38:55.084438] [INFO ] [MAIN      ] ETSY: Wiping existing primary data before full refresh.
[2025-10-24T18:38:55.084493] [INFO ] [LOCAL     ] ETSY: Starting deletion of primary data.
[2025-10-24T18:38:55.084826] [DEBUG] [LOCAL     ] ETSY: Deleted primary data file.
[2025-10-24T18:38:55.084889] [INFO ] [MAIN      ] ETSY: Starting full primary refresh.
[2025-10-24T18:38:55.352720] [INFO ] [REMOTE    ] ETR: Fetching primary data for 2025-05.
[2025-10-24T18:38:55.439229] [INFO ] [REMOTE    ] ETSY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:38:56.147747] [INFO ] [REMOTE    ] ETSY: Fetching primary data for 2025-01.
[2025-10-24T18:38:56.947760] [INFO ] [REMOTE    ] ETO: Fetching primary data for 2025-09.
[2025-10-24T18:38:57.069862] [INFO ] [REMOTE    ] ETR: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T18:38:57.583208] [INFO ] [REMOTE    ] ETO: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T18:38:57.747683] [INFO ] [REMOTE    ] ETR: Fetching primary data for 2025-06.
[2025-10-24T18:38:58.039182] [INFO ] [REMOTE    ] ETSY: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T18:38:58.547678] [INFO ] [REMOTE    ] ETSY: Fetching primary data for 2025-02.
[2025-10-24T18:38:59.347624] [INFO ] [REMOTE    ] ETN: Fetching primary data for 2025-04.
[2025-10-24T18:38:59.724017] [INFO ] [REMOTE    ] ETR: Incremental fetch complete for 2025-06 (1.98 seconds).
[2025-10-24T18:39:00.147639] [INFO ] [REMOTE    ] ETR: Fetching primary data for 2025-07.
[2025-10-24T18:39:00.417374] [INFO ] [REMOTE    ] ETSY: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T18:39:00.947637] [INFO ] [REMOTE    ] ETSY: Fetching primary data for 2025-03.
[2025-10-24T18:39:01.747707] [INFO ] [REMOTE    ] ETO: Fetching primary data for 2025-10.
[2025-10-24T18:39:01.959797] [INFO ] [REMOTE    ] ETN: Incremental fetch complete for 2025-04 (2.61 seconds).
[2025-10-24T18:39:02.099114] [INFO ] [REMOTE    ] ETR: Incremental fetch complete for 2025-07 (1.95 seconds).
[2025-10-24T18:39:02.547725] [INFO ] [REMOTE    ] ETR: Fetching primary data for 2025-08.
[2025-10-24T18:39:03.347726] [INFO ] [REMOTE    ] ETN: Fetching primary data for 2025-05.
[2025-10-24T18:39:03.528482] [INFO ] [REMOTE    ] ETO: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T18:39:03.530482] [INFO ] [REMOTE    ] ETO: Full fetch complete (9635 records).
[2025-10-24T18:39:03.530554] [DEBUG] [VALIDATOR ] ETO: Validating primary data.
[2025-10-24T18:39:03.530995] [FATAL] [VALIDATOR ] ETO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:39:03.531082] [FATAL] [MAIN      ] ETO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:39:03.531152] [WARN ] [MAIN      ] ETO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:39:03.531262] [INFO ] [LOCAL     ] ETO: Starting deletion of primary data.
[2025-10-24T18:39:03.531342] [DEBUG] [LOCAL     ] ETO: No primary data file found to delete.
[2025-10-24T18:39:03.531391] [INFO ] [LOCAL     ] ETO: Starting deletion of derivative data.
[2025-10-24T18:39:03.531555] [DEBUG] [LOCAL     ] ETO: Deleted derivative data file.
[2025-10-24T18:39:03.531677] [INFO ] [MAIN      ] Update Progress: 778/2366 symbols completed. ETO took 26.2s. Estimated remaining: 3h 22m 6s. Rate: 7.9 symbols/min
[2025-10-24T18:39:03.702819] [INFO ] [MAIN      ] ETV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:39:03.725264] [DEBUG] [LOCAL     ] ETV: Loaded 21947 existing records from primary storage.
[2025-10-24T18:39:03.725502] [INFO ] [MAIN      ] ETV: Loaded 21947 existing records.
[2025-10-24T18:39:03.919529] [WARN ] [MAIN      ] ETV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:39:03.919871] [INFO ] [MAIN      ] ETV: Wiping existing primary data before full refresh.
[2025-10-24T18:39:03.919941] [INFO ] [LOCAL     ] ETV: Starting deletion of primary data.
[2025-10-24T18:39:03.920245] [DEBUG] [LOCAL     ] ETV: Deleted primary data file.
[2025-10-24T18:39:03.920317] [INFO ] [MAIN      ] ETV: Starting full primary refresh.
[2025-10-24T18:39:04.098127] [INFO ] [REMOTE    ] ETSY: Incremental fetch complete for 2025-03 (3.15 seconds).
[2025-10-24T18:39:04.163926] [INFO ] [REMOTE    ] ETSY: Fetching primary data for 2025-04.
[2025-10-24T18:39:04.344971] [INFO ] [REMOTE    ] ETV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:39:04.629256] [INFO ] [REMOTE    ] ETR: Incremental fetch complete for 2025-08 (2.08 seconds).
[2025-10-24T18:39:04.947619] [INFO ] [REMOTE    ] ETR: Fetching primary data for 2025-09.
[2025-10-24T18:39:05.437033] [INFO ] [REMOTE    ] ETN: Incremental fetch complete for 2025-05 (2.09 seconds).
[2025-10-24T18:39:05.747672] [INFO ] [REMOTE    ] ETN: Fetching primary data for 2025-06.
[2025-10-24T18:39:06.547667] [INFO ] [REMOTE    ] ETV: Fetching primary data for 2025-01.
[2025-10-24T18:39:06.765313] [INFO ] [REMOTE    ] ETSY: Incremental fetch complete for 2025-04 (2.60 seconds).
[2025-10-24T18:39:07.347686] [INFO ] [REMOTE    ] ETSY: Fetching primary data for 2025-05.
[2025-10-24T18:39:07.387007] [INFO ] [REMOTE    ] ETR: Incremental fetch complete for 2025-09 (2.44 seconds).
[2025-10-24T18:39:07.522836] [INFO ] [REMOTE    ] ETN: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T18:39:08.147638] [INFO ] [REMOTE    ] ETN: Fetching primary data for 2025-07.
[2025-10-24T18:39:08.405844] [INFO ] [REMOTE    ] ETV: Incremental fetch complete for 2025-01 (1.86 seconds).
[2025-10-24T18:39:08.947700] [INFO ] [REMOTE    ] ETR: Fetching primary data for 2025-10.
[2025-10-24T18:39:09.298601] [INFO ] [REMOTE    ] ETSY: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T18:39:09.752862] [INFO ] [REMOTE    ] ETSY: Fetching primary data for 2025-06.
[2025-10-24T18:39:09.771157] [INFO ] [REMOTE    ] ETN: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T18:39:10.547631] [INFO ] [REMOTE    ] ETN: Fetching primary data for 2025-08.
[2025-10-24T18:39:11.009499] [INFO ] [REMOTE    ] ETR: Incremental fetch complete for 2025-10 (2.06 seconds).
[2025-10-24T18:39:11.019320] [INFO ] [REMOTE    ] ETR: Full fetch complete (77262 records).
[2025-10-24T18:39:11.019480] [DEBUG] [VALIDATOR ] ETR: Validating primary data.
[2025-10-24T18:39:11.359557] [INFO ] [REMOTE    ] ETV: Fetching primary data for 2025-02.
[2025-10-24T18:39:11.422471] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present.
[2025-10-24T18:39:11.422790] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed.
[2025-10-24T18:39:11.423913] [INFO ] [MAIN      ] ETR: Fetched primary data is valid.
[2025-10-24T18:39:11.424048] [DEBUG] [LOCAL     ] ETR: Saving primary data.
[2025-10-24T18:39:11.425016] [FATAL] [LOCAL     ] ETR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:39:11.425160] [FATAL] [MAIN      ] ETR: Failed to save primary data.
[2025-10-24T18:39:11.425227] [WARN ] [MAIN      ] ETR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:39:11.425293] [INFO ] [LOCAL     ] ETR: Starting deletion of primary data.
[2025-10-24T18:39:11.425355] [DEBUG] [LOCAL     ] ETR: No primary data file found to delete.
[2025-10-24T18:39:11.425390] [INFO ] [LOCAL     ] ETR: Starting deletion of derivative data.
[2025-10-24T18:39:11.425588] [DEBUG] [LOCAL     ] ETR: Deleted derivative data file.
[2025-10-24T18:39:11.426030] [INFO ] [MAIN      ] Update Progress: 779/2366 symbols completed. ETR took 30.5s. Estimated remaining: 3h 21m 59s. Rate: 7.9 symbols/min
[2025-10-24T18:39:11.599919] [INFO ] [MAIN      ] ETW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:39:11.633381] [INFO ] [REMOTE    ] ETSY: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T18:39:11.662972] [DEBUG] [LOCAL     ] ETW: Loaded 25243 existing records from primary storage.
[2025-10-24T18:39:11.663233] [INFO ] [MAIN      ] ETW: Loaded 25243 existing records.
[2025-10-24T18:39:11.837050] [WARN ] [MAIN      ] ETW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:39:11.837283] [INFO ] [MAIN      ] ETW: Wiping existing primary data before full refresh.
[2025-10-24T18:39:11.837344] [INFO ] [LOCAL     ] ETW: Starting deletion of primary data.
[2025-10-24T18:39:11.837545] [DEBUG] [LOCAL     ] ETW: Deleted primary data file.
[2025-10-24T18:39:11.837593] [INFO ] [MAIN      ] ETW: Starting full primary refresh.
[2025-10-24T18:39:12.171959] [INFO ] [REMOTE    ] ETSY: Fetching primary data for 2025-07.
[2025-10-24T18:39:12.195495] [INFO ] [REMOTE    ] ETW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:39:12.229037] [INFO ] [REMOTE    ] ETV: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T18:39:12.781794] [INFO ] [REMOTE    ] ETN: Incremental fetch complete for 2025-08 (2.23 seconds).
[2025-10-24T18:39:12.947633] [INFO ] [REMOTE    ] ETV: Fetching primary data for 2025-03.
[2025-10-24T18:39:13.747797] [INFO ] [REMOTE    ] ETN: Fetching primary data for 2025-09.
[2025-10-24T18:39:14.035734] [INFO ] [REMOTE    ] ETSY: Incremental fetch complete for 2025-07 (1.86 seconds).
[2025-10-24T18:39:14.060855] [INFO ] [REMOTE    ] ETV: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T18:39:14.547744] [INFO ] [REMOTE    ] ETSY: Fetching primary data for 2025-08.
[2025-10-24T18:39:15.347725] [INFO ] [REMOTE    ] ETW: Fetching primary data for 2025-01.
[2025-10-24T18:39:15.742734] [INFO ] [REMOTE    ] ETN: Incremental fetch complete for 2025-09 (1.99 seconds).
[2025-10-24T18:39:16.147702] [INFO ] [REMOTE    ] ETN: Fetching primary data for 2025-10.
[2025-10-24T18:39:16.356624] [INFO ] [REMOTE    ] ETSY: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T18:39:16.782154] [INFO ] [REMOTE    ] ETW: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T18:39:16.947726] [INFO ] [REMOTE    ] ETSY: Fetching primary data for 2025-09.
[2025-10-24T18:39:17.747753] [INFO ] [REMOTE    ] ETW: Fetching primary data for 2025-02.
[2025-10-24T18:39:18.546366] [INFO ] [REMOTE    ] ETN: Incremental fetch complete for 2025-10 (2.40 seconds).
[2025-10-24T18:39:18.555937] [INFO ] [REMOTE    ] ETV: Fetching primary data for 2025-04.
[2025-10-24T18:39:18.558400] [INFO ] [REMOTE    ] ETN: Full fetch complete (76617 records).
[2025-10-24T18:39:18.558694] [DEBUG] [VALIDATOR ] ETN: Validating primary data.
[2025-10-24T18:39:18.890243] [INFO ] [REMOTE    ] ETW: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T18:39:19.027592] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present.
[2025-10-24T18:39:19.027757] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed.
[2025-10-24T18:39:19.028754] [INFO ] [MAIN      ] ETN: Fetched primary data is valid.
[2025-10-24T18:39:19.028837] [DEBUG] [LOCAL     ] ETN: Saving primary data.
[2025-10-24T18:39:19.031831] [INFO ] [REMOTE    ] ETSY: Incremental fetch complete for 2025-09 (2.08 seconds).
[2025-10-24T18:39:19.029795] [FATAL] [LOCAL     ] ETN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:39:19.032001] [FATAL] [MAIN      ] ETN: Failed to save primary data.
[2025-10-24T18:39:19.042885] [WARN ] [MAIN      ] ETN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:39:19.042966] [INFO ] [LOCAL     ] ETN: Starting deletion of primary data.
[2025-10-24T18:39:19.043155] [DEBUG] [LOCAL     ] ETN: No primary data file found to delete.
[2025-10-24T18:39:19.043212] [INFO ] [LOCAL     ] ETN: Starting deletion of derivative data.
[2025-10-24T18:39:19.043361] [DEBUG] [LOCAL     ] ETN: Deleted derivative data file.
[2025-10-24T18:39:19.043762] [INFO ] [MAIN      ] Update Progress: 780/2366 symbols completed. ETN took 43.1s. Estimated remaining: 3h 21m 51s. Rate: 7.9 symbols/min
[2025-10-24T18:39:19.208578] [INFO ] [MAIN      ] ETX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:39:19.216690] [DEBUG] [LOCAL     ] ETX: Loaded 5361 existing records from primary storage.
[2025-10-24T18:39:19.216913] [INFO ] [MAIN      ] ETX: Loaded 5361 existing records.
[2025-10-24T18:39:19.362386] [INFO ] [REMOTE    ] ETSY: Fetching primary data for 2025-10.
[2025-10-24T18:39:19.403132] [WARN ] [MAIN      ] ETX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:39:19.403386] [INFO ] [MAIN      ] ETX: Wiping existing primary data before full refresh.
[2025-10-24T18:39:19.403438] [INFO ] [LOCAL     ] ETX: Starting deletion of primary data.
[2025-10-24T18:39:19.403580] [DEBUG] [LOCAL     ] ETX: Deleted primary data file.
[2025-10-24T18:39:19.403620] [INFO ] [MAIN      ] ETX: Starting full primary refresh.
[2025-10-24T18:39:19.786793] [INFO ] [REMOTE    ] ETX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:39:19.788577] [INFO ] [REMOTE    ] ETV: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T18:39:20.147622] [INFO ] [REMOTE    ] ETX: Fetching primary data for 2025-01.
[2025-10-24T18:39:20.865420] [INFO ] [REMOTE    ] ETX: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T18:39:20.947705] [INFO ] [REMOTE    ] ETX: Fetching primary data for 2025-02.
[2025-10-24T18:39:21.432292] [INFO ] [REMOTE    ] ETX: Incremental fetch complete for 2025-02 (0.48 seconds).
[2025-10-24T18:39:21.466503] [INFO ] [REMOTE    ] ETSY: Incremental fetch complete for 2025-10 (2.10 seconds).
[2025-10-24T18:39:21.475884] [INFO ] [REMOTE    ] ETSY: Full fetch complete (77271 records).
[2025-10-24T18:39:21.476041] [DEBUG] [VALIDATOR ] ETSY: Validating primary data.
[2025-10-24T18:39:21.476942] [FATAL] [VALIDATOR ] ETSY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:39:21.477039] [FATAL] [MAIN      ] ETSY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:39:21.477084] [WARN ] [MAIN      ] ETSY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:39:21.477154] [INFO ] [LOCAL     ] ETSY: Starting deletion of primary data.
[2025-10-24T18:39:21.477230] [DEBUG] [LOCAL     ] ETSY: No primary data file found to delete.
[2025-10-24T18:39:21.477269] [INFO ] [LOCAL     ] ETSY: Starting deletion of derivative data.
[2025-10-24T18:39:21.477438] [DEBUG] [LOCAL     ] ETSY: Deleted derivative data file.
[2025-10-24T18:39:21.477883] [INFO ] [MAIN      ] Update Progress: 781/2366 symbols completed. ETSY took 26.8s. Estimated remaining: 3h 21m 33s. Rate: 7.9 symbols/min
[2025-10-24T18:39:21.654421] [INFO ] [MAIN      ] ETY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:39:21.678717] [DEBUG] [LOCAL     ] ETY: Loaded 22481 existing records from primary storage.
[2025-10-24T18:39:21.679002] [INFO ] [MAIN      ] ETY: Loaded 22481 existing records.
[2025-10-24T18:39:21.752997] [INFO ] [REMOTE    ] ETV: Fetching primary data for 2025-05.
[2025-10-24T18:39:21.865965] [WARN ] [MAIN      ] ETY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:39:21.866230] [INFO ] [MAIN      ] ETY: Wiping existing primary data before full refresh.
[2025-10-24T18:39:21.866279] [INFO ] [LOCAL     ] ETY: Starting deletion of primary data.
[2025-10-24T18:39:21.866465] [DEBUG] [LOCAL     ] ETY: Deleted primary data file.
[2025-10-24T18:39:21.866505] [INFO ] [MAIN      ] ETY: Starting full primary refresh.
[2025-10-24T18:39:22.236802] [INFO ] [REMOTE    ] ETY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:39:22.547636] [INFO ] [REMOTE    ] ETX: Fetching primary data for 2025-03.
[2025-10-24T18:39:22.823378] [INFO ] [REMOTE    ] ETV: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T18:39:22.901243] [INFO ] [REMOTE    ] ETX: Incremental fetch complete for 2025-03 (0.35 seconds).
[2025-10-24T18:39:23.347725] [INFO ] [REMOTE    ] ETV: Fetching primary data for 2025-06.
[2025-10-24T18:39:24.147637] [INFO ] [REMOTE    ] ETW: Fetching primary data for 2025-03.
[2025-10-24T18:39:24.375401] [INFO ] [REMOTE    ] ETV: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T18:39:24.947684] [INFO ] [REMOTE    ] ETY: Fetching primary data for 2025-01.
[2025-10-24T18:39:25.238166] [INFO ] [REMOTE    ] ETW: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T18:39:25.747724] [INFO ] [REMOTE    ] ETW: Fetching primary data for 2025-04.
[2025-10-24T18:39:26.363733] [INFO ] [REMOTE    ] ETY: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T18:39:26.547692] [INFO ] [REMOTE    ] ETX: Fetching primary data for 2025-04.
[2025-10-24T18:39:26.743580] [INFO ] [REMOTE    ] ETW: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T18:39:27.105321] [INFO ] [REMOTE    ] ETX: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T18:39:27.347745] [INFO ] [REMOTE    ] ETY: Fetching primary data for 2025-02.
[2025-10-24T18:39:28.147621] [INFO ] [REMOTE    ] ETV: Fetching primary data for 2025-07.
[2025-10-24T18:39:28.464396] [INFO ] [REMOTE    ] ETY: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T18:39:28.947616] [INFO ] [REMOTE    ] ETY: Fetching primary data for 2025-03.
[2025-10-24T18:39:29.198674] [INFO ] [REMOTE    ] ETV: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T18:39:29.747623] [INFO ] [REMOTE    ] ETW: Fetching primary data for 2025-05.
[2025-10-24T18:39:30.064384] [INFO ] [REMOTE    ] ETY: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T18:39:30.547622] [INFO ] [REMOTE    ] ETY: Fetching primary data for 2025-04.
[2025-10-24T18:39:30.792590] [INFO ] [REMOTE    ] ETW: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T18:39:31.347626] [INFO ] [REMOTE    ] ETX: Fetching primary data for 2025-05.
[2025-10-24T18:39:31.657380] [INFO ] [REMOTE    ] ETY: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T18:39:31.998409] [INFO ] [REMOTE    ] ETX: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T18:39:32.147628] [INFO ] [REMOTE    ] ETW: Fetching primary data for 2025-06.
[2025-10-24T18:39:32.947681] [INFO ] [REMOTE    ] ETX: Fetching primary data for 2025-06.
[2025-10-24T18:39:33.266527] [INFO ] [REMOTE    ] ETW: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T18:39:33.704394] [INFO ] [REMOTE    ] ETX: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T18:39:33.747635] [INFO ] [REMOTE    ] ETV: Fetching primary data for 2025-08.
[2025-10-24T18:39:34.547624] [INFO ] [REMOTE    ] ETX: Fetching primary data for 2025-07.
[2025-10-24T18:39:34.822024] [INFO ] [REMOTE    ] ETV: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T18:39:35.127167] [INFO ] [REMOTE    ] ETX: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T18:39:35.347698] [INFO ] [REMOTE    ] ETX: Fetching primary data for 2025-08.
[2025-10-24T18:39:35.916386] [INFO ] [REMOTE    ] ETX: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T18:39:36.147635] [INFO ] [REMOTE    ] ETV: Fetching primary data for 2025-09.
[2025-10-24T18:39:36.947627] [INFO ] [REMOTE    ] ETW: Fetching primary data for 2025-07.
[2025-10-24T18:39:37.215180] [INFO ] [REMOTE    ] ETV: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T18:39:37.747685] [INFO ] [REMOTE    ] ETY: Fetching primary data for 2025-05.
[2025-10-24T18:39:38.291375] [INFO ] [REMOTE    ] ETW: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T18:39:38.547701] [INFO ] [REMOTE    ] ETW: Fetching primary data for 2025-08.
[2025-10-24T18:39:39.005639] [INFO ] [REMOTE    ] ETY: Incremental fetch complete for 2025-05 (1.26 seconds).
[2025-10-24T18:39:39.347730] [INFO ] [REMOTE    ] ETV: Fetching primary data for 2025-10.
[2025-10-24T18:39:39.632090] [INFO ] [REMOTE    ] ETW: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T18:39:40.147623] [INFO ] [REMOTE    ] ETX: Fetching primary data for 2025-09.
[2025-10-24T18:39:40.202065] [INFO ] [REMOTE    ] ETV: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T18:39:40.206850] [INFO ] [REMOTE    ] ETV: Full fetch complete (32151 records).
[2025-10-24T18:39:40.206986] [DEBUG] [VALIDATOR ] ETV: Validating primary data.
[2025-10-24T18:39:40.580805] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present.
[2025-10-24T18:39:40.580873] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed.
[2025-10-24T18:39:40.581490] [INFO ] [MAIN      ] ETV: Fetched primary data is valid.
[2025-10-24T18:39:40.581531] [DEBUG] [LOCAL     ] ETV: Saving primary data.
[2025-10-24T18:39:40.581990] [FATAL] [LOCAL     ] ETV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:39:40.582084] [FATAL] [MAIN      ] ETV: Failed to save primary data.
[2025-10-24T18:39:40.582169] [WARN ] [MAIN      ] ETV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:39:40.582252] [INFO ] [LOCAL     ] ETV: Starting deletion of primary data.
[2025-10-24T18:39:40.582322] [DEBUG] [LOCAL     ] ETV: No primary data file found to delete.
[2025-10-24T18:39:40.582360] [INFO ] [LOCAL     ] ETV: Starting deletion of derivative data.
[2025-10-24T18:39:40.582528] [DEBUG] [LOCAL     ] ETV: Deleted derivative data file.
[2025-10-24T18:39:40.582622] [INFO ] [MAIN      ] Update Progress: 782/2366 symbols completed. ETV took 37.1s. Estimated remaining: 3h 21m 48s. Rate: 7.8 symbols/min
[2025-10-24T18:39:40.752473] [INFO ] [MAIN      ] EVC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:39:40.757906] [INFO ] [REMOTE    ] ETX: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T18:39:40.776263] [DEBUG] [LOCAL     ] EVC: Loaded 17929 existing records from primary storage.
[2025-10-24T18:39:40.776503] [INFO ] [MAIN      ] EVC: Loaded 17929 existing records.
[2025-10-24T18:39:40.950748] [INFO ] [REMOTE    ] ETY: Fetching primary data for 2025-06.
[2025-10-24T18:39:40.954548] [WARN ] [MAIN      ] EVC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:39:40.955572] [INFO ] [MAIN      ] EVC: Wiping existing primary data before full refresh.
[2025-10-24T18:39:40.955635] [INFO ] [LOCAL     ] EVC: Starting deletion of primary data.
[2025-10-24T18:39:40.955957] [DEBUG] [LOCAL     ] EVC: Deleted primary data file.
[2025-10-24T18:39:40.956022] [INFO ] [MAIN      ] EVC: Starting full primary refresh.
[2025-10-24T18:39:41.308008] [INFO ] [REMOTE    ] EVC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:39:41.747608] [INFO ] [REMOTE    ] EVC: Fetching primary data for 2025-01.
[2025-10-24T18:39:42.135606] [INFO ] [REMOTE    ] ETY: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T18:39:42.547742] [INFO ] [REMOTE    ] ETY: Fetching primary data for 2025-07.
[2025-10-24T18:39:42.999360] [INFO ] [REMOTE    ] EVC: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T18:39:43.347714] [INFO ] [REMOTE    ] EVC: Fetching primary data for 2025-02.
[2025-10-24T18:39:43.617063] [INFO ] [REMOTE    ] ETY: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T18:39:44.147616] [INFO ] [REMOTE    ] ETY: Fetching primary data for 2025-08.
[2025-10-24T18:39:44.406936] [INFO ] [REMOTE    ] EVC: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T18:39:44.947611] [INFO ] [REMOTE    ] ETX: Fetching primary data for 2025-10.
[2025-10-24T18:39:45.184878] [INFO ] [REMOTE    ] ETY: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T18:39:45.747623] [INFO ] [REMOTE    ] ETY: Fetching primary data for 2025-09.
[2025-10-24T18:39:45.786902] [INFO ] [REMOTE    ] ETX: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T18:39:45.788989] [INFO ] [REMOTE    ] ETX: Full fetch complete (6773 records).
[2025-10-24T18:39:45.789071] [DEBUG] [VALIDATOR ] ETX: Validating primary data.
[2025-10-24T18:39:46.168133] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present.
[2025-10-24T18:39:46.168207] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed.
[2025-10-24T18:39:46.168396] [INFO ] [MAIN      ] ETX: Fetched primary data is valid.
[2025-10-24T18:39:46.168441] [DEBUG] [LOCAL     ] ETX: Saving primary data.
[2025-10-24T18:39:46.168629] [FATAL] [LOCAL     ] ETX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:39:46.168729] [FATAL] [MAIN      ] ETX: Failed to save primary data.
[2025-10-24T18:39:46.168770] [WARN ] [MAIN      ] ETX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:39:46.168807] [INFO ] [LOCAL     ] ETX: Starting deletion of primary data.
[2025-10-24T18:39:46.168856] [DEBUG] [LOCAL     ] ETX: No primary data file found to delete.
[2025-10-24T18:39:46.168935] [INFO ] [LOCAL     ] ETX: Starting deletion of derivative data.
[2025-10-24T18:39:46.169100] [DEBUG] [LOCAL     ] ETX: Deleted derivative data file.
[2025-10-24T18:39:46.169183] [INFO ] [MAIN      ] Update Progress: 783/2366 symbols completed. ETX took 27.1s. Estimated remaining: 3h 21m 36s. Rate: 7.9 symbols/min
[2025-10-24T18:39:46.336612] [INFO ] [MAIN      ] EVEX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:39:46.367484] [DEBUG] [LOCAL     ] EVEX: Loaded 33354 existing records from primary storage.
[2025-10-24T18:39:46.367775] [INFO ] [MAIN      ] EVEX: Loaded 33354 existing records.
[2025-10-24T18:39:46.545710] [WARN ] [MAIN      ] EVEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:39:46.545977] [INFO ] [MAIN      ] EVEX: Wiping existing primary data before full refresh.
[2025-10-24T18:39:46.546028] [INFO ] [LOCAL     ] EVEX: Starting deletion of primary data.
[2025-10-24T18:39:46.546232] [DEBUG] [LOCAL     ] EVEX: Deleted primary data file.
[2025-10-24T18:39:46.546272] [INFO ] [MAIN      ] EVEX: Starting full primary refresh.
[2025-10-24T18:39:46.557364] [INFO ] [REMOTE    ] ETW: Fetching primary data for 2025-09.
[2025-10-24T18:39:46.919609] [INFO ] [REMOTE    ] ETY: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T18:39:46.946178] [INFO ] [REMOTE    ] EVEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:39:47.347623] [INFO ] [REMOTE    ] EVEX: Fetching primary data for 2025-01.
[2025-10-24T18:39:47.770414] [INFO ] [REMOTE    ] ETW: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T18:39:48.147606] [INFO ] [REMOTE    ] ETW: Fetching primary data for 2025-10.
[2025-10-24T18:39:48.541795] [INFO ] [REMOTE    ] EVEX: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T18:39:48.947693] [INFO ] [REMOTE    ] ETY: Fetching primary data for 2025-10.
[2025-10-24T18:39:49.576933] [INFO ] [REMOTE    ] ETW: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T18:39:49.581897] [INFO ] [REMOTE    ] ETW: Full fetch complete (36468 records).
[2025-10-24T18:39:49.582006] [DEBUG] [VALIDATOR ] ETW: Validating primary data.
[2025-10-24T18:39:49.752801] [INFO ] [REMOTE    ] EVC: Fetching primary data for 2025-03.
[2025-10-24T18:39:49.953375] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present.
[2025-10-24T18:39:49.953470] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed.
[2025-10-24T18:39:49.954199] [INFO ] [MAIN      ] ETW: Fetched primary data is valid.
[2025-10-24T18:39:49.954282] [DEBUG] [LOCAL     ] ETW: Saving primary data.
[2025-10-24T18:39:49.954771] [FATAL] [LOCAL     ] ETW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:39:49.954863] [FATAL] [MAIN      ] ETW: Failed to save primary data.
[2025-10-24T18:39:49.954907] [WARN ] [MAIN      ] ETW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:39:49.954976] [INFO ] [LOCAL     ] ETW: Starting deletion of primary data.
[2025-10-24T18:39:49.955038] [DEBUG] [LOCAL     ] ETW: No primary data file found to delete.
[2025-10-24T18:39:49.955075] [INFO ] [LOCAL     ] ETW: Starting deletion of derivative data.
[2025-10-24T18:39:49.955248] [DEBUG] [LOCAL     ] ETW: Deleted derivative data file.
[2025-10-24T18:39:49.955363] [INFO ] [MAIN      ] Update Progress: 784/2366 symbols completed. ETW took 38.5s. Estimated remaining: 3h 21m 21s. Rate: 7.9 symbols/min
[2025-10-24T18:39:50.159263] [INFO ] [MAIN      ] EVF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:39:50.171615] [DEBUG] [LOCAL     ] EVF: Loaded 9771 existing records from primary storage.
[2025-10-24T18:39:50.171868] [INFO ] [MAIN      ] EVF: Loaded 9771 existing records.
[2025-10-24T18:39:50.312471] [INFO ] [REMOTE    ] ETY: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T18:39:50.373582] [INFO ] [REMOTE    ] ETY: Full fetch complete (33677 records).
[2025-10-24T18:39:50.379771] [DEBUG] [VALIDATOR ] ETY: Validating primary data.
[2025-10-24T18:39:50.379586] [WARN ] [MAIN      ] EVF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:39:50.380128] [INFO ] [MAIN      ] EVF: Wiping existing primary data before full refresh.
[2025-10-24T18:39:50.380263] [INFO ] [LOCAL     ] EVF: Starting deletion of primary data.
[2025-10-24T18:39:50.380787] [DEBUG] [LOCAL     ] EVF: Deleted primary data file.
[2025-10-24T18:39:50.380908] [INFO ] [MAIN      ] EVF: Starting full primary refresh.
[2025-10-24T18:39:50.380748] [FATAL] [VALIDATOR ] ETY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:39:50.381054] [FATAL] [MAIN      ] ETY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:39:50.434377] [WARN ] [MAIN      ] ETY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:39:50.466734] [INFO ] [LOCAL     ] ETY: Starting deletion of primary data.
[2025-10-24T18:39:50.482575] [DEBUG] [LOCAL     ] ETY: No primary data file found to delete.
[2025-10-24T18:39:50.490635] [INFO ] [LOCAL     ] ETY: Starting deletion of derivative data.
[2025-10-24T18:39:50.493550] [DEBUG] [LOCAL     ] ETY: Deleted derivative data file.
[2025-10-24T18:39:50.493938] [INFO ] [MAIN      ] Update Progress: 785/2366 symbols completed. ETY took 29.0s. Estimated remaining: 3h 20m 59s. Rate: 7.9 symbols/min
[2025-10-24T18:39:50.552674] [INFO ] [REMOTE    ] EVEX: Fetching primary data for 2025-02.
[2025-10-24T18:39:50.926130] [INFO ] [MAIN      ] EVG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:39:50.947967] [INFO ] [REMOTE    ] EVF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:39:50.953912] [DEBUG] [LOCAL     ] EVG: Loaded 5779 existing records from primary storage.
[2025-10-24T18:39:50.954093] [INFO ] [MAIN      ] EVG: Loaded 5779 existing records.
[2025-10-24T18:39:51.078796] [INFO ] [REMOTE    ] EVC: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T18:39:51.164707] [WARN ] [MAIN      ] EVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:39:51.164933] [INFO ] [MAIN      ] EVG: Wiping existing primary data before full refresh.
[2025-10-24T18:39:51.164982] [INFO ] [LOCAL     ] EVG: Starting deletion of primary data.
[2025-10-24T18:39:51.165170] [DEBUG] [LOCAL     ] EVG: Deleted primary data file.
[2025-10-24T18:39:51.165211] [INFO ] [MAIN      ] EVG: Starting full primary refresh.
[2025-10-24T18:39:51.357765] [INFO ] [REMOTE    ] EVF: Fetching primary data for 2025-01.
[2025-10-24T18:39:51.514428] [INFO ] [REMOTE    ] EVG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:39:51.842786] [INFO ] [REMOTE    ] EVEX: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T18:39:52.147636] [INFO ] [REMOTE    ] EVG: Fetching primary data for 2025-01.
[2025-10-24T18:39:52.179600] [INFO ] [REMOTE    ] EVF: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T18:39:52.947627] [INFO ] [REMOTE    ] EVC: Fetching primary data for 2025-04.
[2025-10-24T18:39:53.077757] [INFO ] [REMOTE    ] EVG: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T18:39:53.747628] [INFO ] [REMOTE    ] EVEX: Fetching primary data for 2025-03.
[2025-10-24T18:39:54.145697] [INFO ] [REMOTE    ] EVC: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T18:39:54.554714] [INFO ] [REMOTE    ] EVG: Fetching primary data for 2025-02.
[2025-10-24T18:39:54.556908] [INFO ] [REMOTE    ] EVEX: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T18:39:55.149255] [INFO ] [REMOTE    ] EVG: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T18:39:55.347639] [INFO ] [REMOTE    ] EVG: Fetching primary data for 2025-03.
[2025-10-24T18:39:55.934824] [INFO ] [REMOTE    ] EVG: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T18:39:56.147717] [INFO ] [REMOTE    ] EVG: Fetching primary data for 2025-04.
[2025-10-24T18:39:56.767879] [INFO ] [REMOTE    ] EVG: Incremental fetch complete for 2025-04 (0.62 seconds).
[2025-10-24T18:39:56.947639] [INFO ] [REMOTE    ] EVEX: Fetching primary data for 2025-04.
[2025-10-24T18:39:57.747629] [INFO ] [REMOTE    ] EVG: Fetching primary data for 2025-05.
[2025-10-24T18:39:57.947219] [INFO ] [REMOTE    ] EVEX: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T18:39:58.233309] [INFO ] [REMOTE    ] EVG: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T18:39:58.547668] [INFO ] [REMOTE    ] EVEX: Fetching primary data for 2025-05.
[2025-10-24T18:39:59.347628] [INFO ] [REMOTE    ] EVG: Fetching primary data for 2025-06.
[2025-10-24T18:39:59.681066] [INFO ] [REMOTE    ] EVEX: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T18:39:59.967483] [INFO ] [REMOTE    ] EVG: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T18:40:00.147627] [INFO ] [REMOTE    ] EVEX: Fetching primary data for 2025-06.
[2025-10-24T18:40:00.947746] [INFO ] [REMOTE    ] EVF: Fetching primary data for 2025-02.
[2025-10-24T18:40:01.416960] [INFO ] [REMOTE    ] EVEX: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T18:40:01.747722] [INFO ] [REMOTE    ] EVG: Fetching primary data for 2025-07.
[2025-10-24T18:40:01.997954] [INFO ] [REMOTE    ] EVF: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T18:40:02.547765] [INFO ] [REMOTE    ] EVF: Fetching primary data for 2025-03.
[2025-10-24T18:40:02.776832] [INFO ] [REMOTE    ] EVG: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T18:40:03.347742] [INFO ] [REMOTE    ] EVG: Fetching primary data for 2025-08.
[2025-10-24T18:40:04.147678] [INFO ] [REMOTE    ] EVC: Fetching primary data for 2025-05.
[2025-10-24T18:40:04.551131] [INFO ] [REMOTE    ] EVF: Incremental fetch complete for 2025-03 (2.00 seconds).
[2025-10-24T18:40:04.947713] [INFO ] [REMOTE    ] EVEX: Fetching primary data for 2025-07.
[2025-10-24T18:40:05.747625] [INFO ] [REMOTE    ] EVF: Fetching primary data for 2025-04.
[2025-10-24T18:40:05.784735] [INFO ] [REMOTE    ] EVG: Incremental fetch complete for 2025-08 (2.44 seconds).
[2025-10-24T18:40:06.547756] [INFO ] [REMOTE    ] EVG: Fetching primary data for 2025-09.
[2025-10-24T18:40:06.584946] [INFO ] [REMOTE    ] EVC: Incremental fetch complete for 2025-05 (2.44 seconds).
[2025-10-24T18:40:07.045386] [INFO ] [REMOTE    ] EVF: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T18:40:07.347676] [INFO ] [REMOTE    ] EVF: Fetching primary data for 2025-05.
[2025-10-24T18:40:07.776534] [INFO ] [REMOTE    ] EVEX: Incremental fetch complete for 2025-07 (2.83 seconds).
[2025-10-24T18:40:07.959893] [INFO ] [REMOTE    ] EVG: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T18:40:07.987982] [INFO ] [REMOTE    ] EVF: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T18:40:08.147717] [INFO ] [REMOTE    ] EVEX: Fetching primary data for 2025-08.
[2025-10-24T18:40:08.947749] [INFO ] [REMOTE    ] EVF: Fetching primary data for 2025-06.
[2025-10-24T18:40:09.685389] [INFO ] [REMOTE    ] EVEX: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T18:40:09.716751] [INFO ] [REMOTE    ] EVF: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T18:40:09.747697] [INFO ] [REMOTE    ] EVG: Fetching primary data for 2025-10.
[2025-10-24T18:40:10.282737] [INFO ] [REMOTE    ] EVG: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T18:40:10.284311] [INFO ] [REMOTE    ] EVG: Full fetch complete (8090 records).
[2025-10-24T18:40:10.284386] [DEBUG] [VALIDATOR ] EVG: Validating primary data.
[2025-10-24T18:40:10.555324] [INFO ] [REMOTE    ] EVC: Fetching primary data for 2025-06.
[2025-10-24T18:40:10.637961] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present.
[2025-10-24T18:40:10.638039] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed.
[2025-10-24T18:40:10.638266] [INFO ] [MAIN      ] EVG: Fetched primary data is valid.
[2025-10-24T18:40:10.638304] [DEBUG] [LOCAL     ] EVG: Saving primary data.
[2025-10-24T18:40:10.638497] [FATAL] [LOCAL     ] EVG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:40:10.638574] [FATAL] [MAIN      ] EVG: Failed to save primary data.
[2025-10-24T18:40:10.638615] [WARN ] [MAIN      ] EVG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:40:10.638681] [INFO ] [LOCAL     ] EVG: Starting deletion of primary data.
[2025-10-24T18:40:10.638770] [DEBUG] [LOCAL     ] EVG: No primary data file found to delete.
[2025-10-24T18:40:10.638826] [INFO ] [LOCAL     ] EVG: Starting deletion of derivative data.
[2025-10-24T18:40:10.638989] [DEBUG] [LOCAL     ] EVG: Deleted derivative data file.
[2025-10-24T18:40:10.639074] [INFO ] [MAIN      ] Update Progress: 786/2366 symbols completed. EVG took 20.1s. Estimated remaining: 3h 21m 17s. Rate: 7.8 symbols/min
[2025-10-24T18:40:10.803927] [INFO ] [MAIN      ] EVH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:40:10.850345] [DEBUG] [LOCAL     ] EVH: Loaded 49979 existing records from primary storage.
[2025-10-24T18:40:10.850674] [INFO ] [MAIN      ] EVH: Loaded 49979 existing records.
[2025-10-24T18:40:11.033799] [WARN ] [MAIN      ] EVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:40:11.034043] [INFO ] [MAIN      ] EVH: Wiping existing primary data before full refresh.
[2025-10-24T18:40:11.034090] [INFO ] [LOCAL     ] EVH: Starting deletion of primary data.
[2025-10-24T18:40:11.034326] [DEBUG] [LOCAL     ] EVH: Deleted primary data file.
[2025-10-24T18:40:11.034366] [INFO ] [MAIN      ] EVH: Starting full primary refresh.
[2025-10-24T18:40:11.352948] [INFO ] [REMOTE    ] EVF: Fetching primary data for 2025-07.
[2025-10-24T18:40:11.587685] [INFO ] [REMOTE    ] EVH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:40:11.698040] [INFO ] [REMOTE    ] EVC: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T18:40:12.116359] [INFO ] [REMOTE    ] EVF: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T18:40:12.147711] [INFO ] [REMOTE    ] EVEX: Fetching primary data for 2025-09.
[2025-10-24T18:40:12.947688] [INFO ] [REMOTE    ] EVC: Fetching primary data for 2025-07.
[2025-10-24T18:40:13.747710] [INFO ] [REMOTE    ] EVH: Fetching primary data for 2025-01.
[2025-10-24T18:40:13.902285] [INFO ] [REMOTE    ] EVC: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T18:40:13.956910] [INFO ] [REMOTE    ] EVEX: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T18:40:14.547633] [INFO ] [REMOTE    ] EVEX: Fetching primary data for 2025-10.
[2025-10-24T18:40:15.347636] [INFO ] [REMOTE    ] EVF: Fetching primary data for 2025-08.
[2025-10-24T18:40:16.147740] [INFO ] [REMOTE    ] EVC: Fetching primary data for 2025-08.
[2025-10-24T18:40:16.274812] [INFO ] [REMOTE    ] EVF: Incremental fetch complete for 2025-08 (0.93 seconds).
[2025-10-24T18:40:16.524740] [INFO ] [REMOTE    ] EVEX: Incremental fetch complete for 2025-10 (1.98 seconds).
[2025-10-24T18:40:16.533137] [INFO ] [REMOTE    ] EVEX: Full fetch complete (44278 records).
[2025-10-24T18:40:16.533251] [DEBUG] [VALIDATOR ] EVEX: Validating primary data.
[2025-10-24T18:40:16.921009] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present.
[2025-10-24T18:40:16.921282] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed.
[2025-10-24T18:40:16.922087] [INFO ] [MAIN      ] EVEX: Fetched primary data is valid.
[2025-10-24T18:40:16.922148] [DEBUG] [LOCAL     ] EVEX: Saving primary data.
[2025-10-24T18:40:16.922518] [FATAL] [LOCAL     ] EVEX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:40:16.922599] [FATAL] [MAIN      ] EVEX: Failed to save primary data.
[2025-10-24T18:40:16.922661] [WARN ] [MAIN      ] EVEX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:40:16.922732] [INFO ] [LOCAL     ] EVEX: Starting deletion of primary data.
[2025-10-24T18:40:16.922790] [DEBUG] [LOCAL     ] EVEX: No primary data file found to delete.
[2025-10-24T18:40:16.922825] [INFO ] [LOCAL     ] EVEX: Starting deletion of derivative data.
[2025-10-24T18:40:16.922965] [DEBUG] [LOCAL     ] EVEX: Deleted derivative data file.
[2025-10-24T18:40:16.923038] [INFO ] [MAIN      ] Update Progress: 787/2366 symbols completed. EVEX took 30.8s. Estimated remaining: 3h 21m 6s. Rate: 7.9 symbols/min
[2025-10-24T18:40:16.954355] [INFO ] [REMOTE    ] EVF: Fetching primary data for 2025-09.
[2025-10-24T18:40:17.041406] [INFO ] [REMOTE    ] EVC: Incremental fetch complete for 2025-08 (0.89 seconds).
[2025-10-24T18:40:17.111483] [INFO ] [MAIN      ] EVN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:40:17.124471] [DEBUG] [LOCAL     ] EVN: Loaded 10894 existing records from primary storage.
[2025-10-24T18:40:17.124718] [INFO ] [MAIN      ] EVN: Loaded 10894 existing records.
[2025-10-24T18:40:17.312451] [WARN ] [MAIN      ] EVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:40:17.312825] [INFO ] [MAIN      ] EVN: Wiping existing primary data before full refresh.
[2025-10-24T18:40:17.312889] [INFO ] [LOCAL     ] EVN: Starting deletion of primary data.
[2025-10-24T18:40:17.313200] [DEBUG] [LOCAL     ] EVN: Deleted primary data file.
[2025-10-24T18:40:17.313323] [INFO ] [MAIN      ] EVN: Starting full primary refresh.
[2025-10-24T18:40:17.487496] [INFO ] [REMOTE    ] EVH: Incremental fetch complete for 2025-01 (3.74 seconds).
[2025-10-24T18:40:17.711837] [INFO ] [REMOTE    ] EVN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:40:17.747598] [INFO ] [REMOTE    ] EVN: Fetching primary data for 2025-01.
[2025-10-24T18:40:17.874929] [INFO ] [REMOTE    ] EVF: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T18:40:18.547636] [INFO ] [REMOTE    ] EVC: Fetching primary data for 2025-09.
[2025-10-24T18:40:18.886426] [INFO ] [REMOTE    ] EVN: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T18:40:19.347708] [INFO ] [REMOTE    ] EVH: Fetching primary data for 2025-02.
[2025-10-24T18:40:19.543437] [INFO ] [REMOTE    ] EVC: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T18:40:20.147742] [INFO ] [REMOTE    ] EVN: Fetching primary data for 2025-02.
[2025-10-24T18:40:20.640420] [INFO ] [REMOTE    ] EVH: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T18:40:20.682361] [INFO ] [REMOTE    ] EVN: Incremental fetch complete for 2025-02 (0.53 seconds).
[2025-10-24T18:40:20.947662] [INFO ] [REMOTE    ] EVF: Fetching primary data for 2025-10.
[2025-10-24T18:40:21.747630] [INFO ] [REMOTE    ] EVH: Fetching primary data for 2025-03.
[2025-10-24T18:40:21.971552] [INFO ] [REMOTE    ] EVF: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T18:40:21.974120] [INFO ] [REMOTE    ] EVF: Full fetch complete (12879 records).
[2025-10-24T18:40:21.974191] [DEBUG] [VALIDATOR ] EVF: Validating primary data.
[2025-10-24T18:40:22.348268] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present.
[2025-10-24T18:40:22.348343] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed.
[2025-10-24T18:40:22.348631] [INFO ] [MAIN      ] EVF: Fetched primary data is valid.
[2025-10-24T18:40:22.348708] [DEBUG] [LOCAL     ] EVF: Saving primary data.
[2025-10-24T18:40:22.348928] [FATAL] [LOCAL     ] EVF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:40:22.349008] [FATAL] [MAIN      ] EVF: Failed to save primary data.
[2025-10-24T18:40:22.349049] [WARN ] [MAIN      ] EVF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:40:22.349084] [INFO ] [LOCAL     ] EVF: Starting deletion of primary data.
[2025-10-24T18:40:22.349132] [DEBUG] [LOCAL     ] EVF: No primary data file found to delete.
[2025-10-24T18:40:22.349166] [INFO ] [LOCAL     ] EVF: Starting deletion of derivative data.
[2025-10-24T18:40:22.349295] [DEBUG] [LOCAL     ] EVF: Deleted derivative data file.
[2025-10-24T18:40:22.349362] [INFO ] [MAIN      ] Update Progress: 788/2366 symbols completed. EVF took 32.4s. Estimated remaining: 3h 20m 54s. Rate: 7.9 symbols/min
[2025-10-24T18:40:22.515077] [INFO ] [MAIN      ] EVR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:40:22.548357] [INFO ] [REMOTE    ] EVC: Fetching primary data for 2025-10.
[2025-10-24T18:40:22.549837] [DEBUG] [LOCAL     ] EVR: Loaded 33793 existing records from primary storage.
[2025-10-24T18:40:22.550058] [INFO ] [MAIN      ] EVR: Loaded 33793 existing records.
[2025-10-24T18:40:22.724773] [WARN ] [MAIN      ] EVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:40:22.725000] [INFO ] [MAIN      ] EVR: Wiping existing primary data before full refresh.
[2025-10-24T18:40:22.725046] [INFO ] [LOCAL     ] EVR: Starting deletion of primary data.
[2025-10-24T18:40:22.725341] [DEBUG] [LOCAL     ] EVR: Deleted primary data file.
[2025-10-24T18:40:22.725380] [INFO ] [MAIN      ] EVR: Starting full primary refresh.
[2025-10-24T18:40:23.076433] [INFO ] [REMOTE    ] EVR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:40:23.266343] [INFO ] [REMOTE    ] EVH: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T18:40:23.347603] [INFO ] [REMOTE    ] EVH: Fetching primary data for 2025-04.
[2025-10-24T18:40:23.666218] [INFO ] [REMOTE    ] EVC: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T18:40:23.669921] [INFO ] [REMOTE    ] EVC: Full fetch complete (28611 records).
[2025-10-24T18:40:23.670053] [DEBUG] [VALIDATOR ] EVC: Validating primary data.
[2025-10-24T18:40:24.096586] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present.
[2025-10-24T18:40:24.096711] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed.
[2025-10-24T18:40:24.097381] [INFO ] [MAIN      ] EVC: Fetched primary data is valid.
[2025-10-24T18:40:24.097447] [DEBUG] [LOCAL     ] EVC: Saving primary data.
[2025-10-24T18:40:24.097881] [FATAL] [LOCAL     ] EVC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:40:24.097971] [FATAL] [MAIN      ] EVC: Failed to save primary data.
[2025-10-24T18:40:24.098014] [WARN ] [MAIN      ] EVC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:40:24.098048] [INFO ] [LOCAL     ] EVC: Starting deletion of primary data.
[2025-10-24T18:40:24.098099] [DEBUG] [LOCAL     ] EVC: No primary data file found to delete.
[2025-10-24T18:40:24.098135] [INFO ] [LOCAL     ] EVC: Starting deletion of derivative data.
[2025-10-24T18:40:24.098288] [DEBUG] [LOCAL     ] EVC: Deleted derivative data file.
[2025-10-24T18:40:24.098367] [INFO ] [MAIN      ] Update Progress: 789/2366 symbols completed. EVC took 43.5s. Estimated remaining: 3h 20m 35s. Rate: 7.9 symbols/min
[2025-10-24T18:40:24.152996] [INFO ] [REMOTE    ] EVR: Fetching primary data for 2025-01.
[2025-10-24T18:40:24.276054] [INFO ] [MAIN      ] EVT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:40:24.293560] [DEBUG] [LOCAL     ] EVT: Loaded 16606 existing records from primary storage.
[2025-10-24T18:40:24.293830] [INFO ] [MAIN      ] EVT: Loaded 16606 existing records.
[2025-10-24T18:40:24.476846] [WARN ] [MAIN      ] EVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:40:24.477086] [INFO ] [MAIN      ] EVT: Wiping existing primary data before full refresh.
[2025-10-24T18:40:24.477168] [INFO ] [LOCAL     ] EVT: Starting deletion of primary data.
[2025-10-24T18:40:24.477456] [DEBUG] [LOCAL     ] EVT: Deleted primary data file.
[2025-10-24T18:40:24.477513] [INFO ] [MAIN      ] EVT: Starting full primary refresh.
[2025-10-24T18:40:24.840394] [INFO ] [REMOTE    ] EVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:40:24.868557] [INFO ] [REMOTE    ] EVH: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T18:40:24.947612] [INFO ] [REMOTE    ] EVH: Fetching primary data for 2025-05.
[2025-10-24T18:40:25.501830] [INFO ] [REMOTE    ] EVR: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T18:40:25.747719] [INFO ] [REMOTE    ] EVT: Fetching primary data for 2025-01.
[2025-10-24T18:40:26.131590] [INFO ] [REMOTE    ] EVH: Incremental fetch complete for 2025-05 (1.18 seconds).
[2025-10-24T18:40:26.547669] [INFO ] [REMOTE    ] EVR: Fetching primary data for 2025-02.
[2025-10-24T18:40:26.901477] [INFO ] [REMOTE    ] EVT: Incremental fetch complete for 2025-01 (1.15 seconds).
[2025-10-24T18:40:27.347675] [INFO ] [REMOTE    ] EVN: Fetching primary data for 2025-03.
[2025-10-24T18:40:28.147617] [INFO ] [REMOTE    ] EVT: Fetching primary data for 2025-02.
[2025-10-24T18:40:28.183291] [INFO ] [REMOTE    ] EVN: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T18:40:28.233264] [INFO ] [REMOTE    ] EVR: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T18:40:28.947689] [INFO ] [REMOTE    ] EVH: Fetching primary data for 2025-06.
[2025-10-24T18:40:29.127397] [INFO ] [REMOTE    ] EVT: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T18:40:29.747634] [INFO ] [REMOTE    ] EVT: Fetching primary data for 2025-03.
[2025-10-24T18:40:30.547636] [INFO ] [REMOTE    ] EVR: Fetching primary data for 2025-03.
[2025-10-24T18:40:30.798294] [INFO ] [REMOTE    ] EVT: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T18:40:30.831260] [INFO ] [REMOTE    ] EVH: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T18:40:31.347685] [INFO ] [REMOTE    ] EVT: Fetching primary data for 2025-04.
[2025-10-24T18:40:32.093050] [INFO ] [REMOTE    ] EVR: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T18:40:32.147623] [INFO ] [REMOTE    ] EVR: Fetching primary data for 2025-04.
[2025-10-24T18:40:32.396266] [INFO ] [REMOTE    ] EVT: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T18:40:32.947694] [INFO ] [REMOTE    ] EVN: Fetching primary data for 2025-04.
[2025-10-24T18:40:33.725815] [INFO ] [REMOTE    ] EVR: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T18:40:33.747608] [INFO ] [REMOTE    ] EVT: Fetching primary data for 2025-05.
[2025-10-24T18:40:33.913005] [INFO ] [REMOTE    ] EVN: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T18:40:34.547691] [INFO ] [REMOTE    ] EVN: Fetching primary data for 2025-05.
[2025-10-24T18:40:34.777425] [INFO ] [REMOTE    ] EVT: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T18:40:35.347695] [INFO ] [REMOTE    ] EVT: Fetching primary data for 2025-06.
[2025-10-24T18:40:35.362500] [INFO ] [REMOTE    ] EVN: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T18:40:36.147717] [INFO ] [REMOTE    ] EVN: Fetching primary data for 2025-06.
[2025-10-24T18:40:36.327421] [INFO ] [REMOTE    ] EVT: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T18:40:36.892408] [INFO ] [REMOTE    ] EVN: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T18:40:36.947711] [INFO ] [REMOTE    ] EVT: Fetching primary data for 2025-07.
[2025-10-24T18:40:37.747681] [INFO ] [REMOTE    ] EVR: Fetching primary data for 2025-05.
[2025-10-24T18:40:38.028607] [INFO ] [REMOTE    ] EVT: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T18:40:38.547733] [INFO ] [REMOTE    ] EVN: Fetching primary data for 2025-07.
[2025-10-24T18:40:39.265627] [INFO ] [REMOTE    ] EVR: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T18:40:39.347607] [INFO ] [REMOTE    ] EVR: Fetching primary data for 2025-06.
[2025-10-24T18:40:39.411200] [INFO ] [REMOTE    ] EVN: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T18:40:40.147635] [INFO ] [REMOTE    ] EVN: Fetching primary data for 2025-08.
[2025-10-24T18:40:40.777918] [INFO ] [REMOTE    ] EVR: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T18:40:40.838632] [INFO ] [REMOTE    ] EVN: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T18:40:40.947681] [INFO ] [REMOTE    ] EVR: Fetching primary data for 2025-07.
[2025-10-24T18:40:41.747676] [INFO ] [REMOTE    ] EVH: Fetching primary data for 2025-07.
[2025-10-24T18:40:42.475019] [INFO ] [REMOTE    ] EVR: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T18:40:42.547675] [INFO ] [REMOTE    ] EVR: Fetching primary data for 2025-08.
[2025-10-24T18:40:43.347606] [INFO ] [REMOTE    ] EVT: Fetching primary data for 2025-08.
[2025-10-24T18:40:43.545188] [INFO ] [REMOTE    ] EVH: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T18:40:43.747263] [INFO ] [REMOTE    ] EVR: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T18:40:44.147615] [INFO ] [REMOTE    ] EVN: Fetching primary data for 2025-09.
[2025-10-24T18:40:44.354520] [INFO ] [REMOTE    ] EVT: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T18:40:44.947671] [INFO ] [REMOTE    ] EVH: Fetching primary data for 2025-08.
[2025-10-24T18:40:45.199368] [INFO ] [REMOTE    ] EVN: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T18:40:45.747639] [INFO ] [REMOTE    ] EVR: Fetching primary data for 2025-09.
[2025-10-24T18:40:46.465294] [INFO ] [REMOTE    ] EVH: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T18:40:46.547619] [INFO ] [REMOTE    ] EVH: Fetching primary data for 2025-09.
[2025-10-24T18:40:47.023681] [INFO ] [REMOTE    ] EVR: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T18:40:47.347663] [INFO ] [REMOTE    ] EVR: Fetching primary data for 2025-10.
[2025-10-24T18:40:48.159083] [INFO ] [REMOTE    ] EVN: Fetching primary data for 2025-10.
[2025-10-24T18:40:48.162092] [INFO ] [REMOTE    ] EVH: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T18:40:48.675102] [INFO ] [REMOTE    ] EVR: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T18:40:48.681530] [INFO ] [REMOTE    ] EVR: Full fetch complete (50450 records).
[2025-10-24T18:40:48.681769] [DEBUG] [VALIDATOR ] EVR: Validating primary data.
[2025-10-24T18:40:48.950525] [INFO ] [REMOTE    ] EVT: Fetching primary data for 2025-09.
[2025-10-24T18:40:49.068430] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present.
[2025-10-24T18:40:49.068519] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed.
[2025-10-24T18:40:49.069321] [INFO ] [MAIN      ] EVR: Fetched primary data is valid.
[2025-10-24T18:40:49.069386] [DEBUG] [LOCAL     ] EVR: Saving primary data.
[2025-10-24T18:40:49.069907] [FATAL] [LOCAL     ] EVR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:40:49.070025] [FATAL] [MAIN      ] EVR: Failed to save primary data.
[2025-10-24T18:40:49.070067] [WARN ] [MAIN      ] EVR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:40:49.070103] [INFO ] [LOCAL     ] EVR: Starting deletion of primary data.
[2025-10-24T18:40:49.070155] [DEBUG] [LOCAL     ] EVR: No primary data file found to delete.
[2025-10-24T18:40:49.070191] [INFO ] [LOCAL     ] EVR: Starting deletion of derivative data.
[2025-10-24T18:40:49.070358] [DEBUG] [LOCAL     ] EVR: Deleted derivative data file.
[2025-10-24T18:40:49.070457] [INFO ] [MAIN      ] Update Progress: 790/2366 symbols completed. EVR took 26.7s. Estimated remaining: 3h 21m 2s. Rate: 7.8 symbols/min
[2025-10-24T18:40:49.181733] [INFO ] [REMOTE    ] EVN: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T18:40:49.205950] [INFO ] [REMOTE    ] EVN: Full fetch complete (16915 records).
[2025-10-24T18:40:49.231525] [DEBUG] [VALIDATOR ] EVN: Validating primary data.
[2025-10-24T18:40:49.255843] [FATAL] [VALIDATOR ] EVN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:40:49.257584] [INFO ] [MAIN      ] EVTC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:40:49.257711] [FATAL] [MAIN      ] EVN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:40:49.258233] [WARN ] [MAIN      ] EVN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:40:49.258323] [INFO ] [LOCAL     ] EVN: Starting deletion of primary data.
[2025-10-24T18:40:49.258424] [DEBUG] [LOCAL     ] EVN: No primary data file found to delete.
[2025-10-24T18:40:49.258482] [INFO ] [LOCAL     ] EVN: Starting deletion of derivative data.
[2025-10-24T18:40:49.258711] [DEBUG] [LOCAL     ] EVN: Deleted derivative data file.
[2025-10-24T18:40:49.258818] [INFO ] [MAIN      ] Update Progress: 791/2366 symbols completed. EVN took 32.3s. Estimated remaining: 3h 20m 39s. Rate: 7.8 symbols/min
[2025-10-24T18:40:49.457354] [INFO ] [MAIN      ] EVTL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:40:49.459365] [DEBUG] [LOCAL     ] EVTC: Loaded 26985 existing records from primary storage.
[2025-10-24T18:40:49.459771] [INFO ] [MAIN      ] EVTC: Loaded 26985 existing records.
[2025-10-24T18:40:49.658835] [WARN ] [MAIN      ] EVTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:40:49.659925] [INFO ] [MAIN      ] EVTC: Wiping existing primary data before full refresh.
[2025-10-24T18:40:49.660024] [INFO ] [LOCAL     ] EVTC: Starting deletion of primary data.
[2025-10-24T18:40:49.660765] [DEBUG] [LOCAL     ] EVTC: Deleted primary data file.
[2025-10-24T18:40:49.660822] [INFO ] [MAIN      ] EVTC: Starting full primary refresh.
[2025-10-24T18:40:49.753191] [INFO ] [REMOTE    ] EVH: Fetching primary data for 2025-10.
[2025-10-24T18:40:49.793529] [INFO ] [REMOTE    ] EVT: Incremental fetch complete for 2025-09 (0.84 seconds).
[2025-10-24T18:40:49.814212] [DEBUG] [LOCAL     ] EVTL: Loaded 41735 existing records from primary storage.
[2025-10-24T18:40:49.850781] [INFO ] [MAIN      ] EVTL: Loaded 41735 existing records.
[2025-10-24T18:40:50.297596] [INFO ] [REMOTE    ] EVTC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:40:50.301746] [WARN ] [MAIN      ] EVTL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:40:50.302388] [INFO ] [MAIN      ] EVTL: Wiping existing primary data before full refresh.
[2025-10-24T18:40:50.302445] [INFO ] [LOCAL     ] EVTL: Starting deletion of primary data.
[2025-10-24T18:40:50.302759] [DEBUG] [LOCAL     ] EVTL: Deleted primary data file.
[2025-10-24T18:40:50.302815] [INFO ] [MAIN      ] EVTL: Starting full primary refresh.
[2025-10-24T18:40:50.552715] [INFO ] [REMOTE    ] EVTC: Fetching primary data for 2025-01.
[2025-10-24T18:40:50.669388] [INFO ] [REMOTE    ] EVTL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:40:51.347728] [INFO ] [REMOTE    ] EVT: Fetching primary data for 2025-10.
[2025-10-24T18:40:51.582041] [INFO ] [REMOTE    ] EVH: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T18:40:51.591236] [INFO ] [REMOTE    ] EVH: Full fetch complete (71557 records).
[2025-10-24T18:40:51.591402] [DEBUG] [VALIDATOR ] EVH: Validating primary data.
[2025-10-24T18:40:51.592144] [FATAL] [VALIDATOR ] EVH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:40:51.592241] [FATAL] [MAIN      ] EVH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:40:51.592284] [WARN ] [MAIN      ] EVH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:40:51.592323] [INFO ] [LOCAL     ] EVH: Starting deletion of primary data.
[2025-10-24T18:40:51.592378] [DEBUG] [LOCAL     ] EVH: No primary data file found to delete.
[2025-10-24T18:40:51.592412] [INFO ] [LOCAL     ] EVH: Starting deletion of derivative data.
[2025-10-24T18:40:51.592566] [DEBUG] [LOCAL     ] EVH: Deleted derivative data file.
[2025-10-24T18:40:51.593098] [INFO ] [MAIN      ] Update Progress: 792/2366 symbols completed. EVH took 41.0s. Estimated remaining: 3h 20m 21s. Rate: 7.9 symbols/min
[2025-10-24T18:40:51.801755] [INFO ] [MAIN      ] EVTR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:40:51.830197] [DEBUG] [LOCAL     ] EVTR: Loaded 25689 existing records from primary storage.
[2025-10-24T18:40:51.830460] [INFO ] [MAIN      ] EVTR: Loaded 25689 existing records.
[2025-10-24T18:40:52.010171] [INFO ] [REMOTE    ] EVTC: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T18:40:52.045347] [WARN ] [MAIN      ] EVTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:40:52.045539] [INFO ] [MAIN      ] EVTR: Wiping existing primary data before full refresh.
[2025-10-24T18:40:52.045586] [INFO ] [LOCAL     ] EVTR: Starting deletion of primary data.
[2025-10-24T18:40:52.045835] [DEBUG] [LOCAL     ] EVTR: Deleted primary data file.
[2025-10-24T18:40:52.045903] [INFO ] [MAIN      ] EVTR: Starting full primary refresh.
[2025-10-24T18:40:52.150918] [INFO ] [REMOTE    ] EVTL: Fetching primary data for 2025-01.
[2025-10-24T18:40:52.388924] [INFO ] [REMOTE    ] EVT: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T18:40:52.427292] [INFO ] [REMOTE    ] EVT: Full fetch complete (24897 records).
[2025-10-24T18:40:52.427196] [INFO ] [REMOTE    ] EVTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:40:52.427696] [DEBUG] [VALIDATOR ] EVT: Validating primary data.
[2025-10-24T18:40:52.812301] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present.
[2025-10-24T18:40:52.812372] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed.
[2025-10-24T18:40:52.812886] [INFO ] [MAIN      ] EVT: Fetched primary data is valid.
[2025-10-24T18:40:52.812947] [DEBUG] [LOCAL     ] EVT: Saving primary data.
[2025-10-24T18:40:52.813221] [FATAL] [LOCAL     ] EVT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:40:52.813303] [FATAL] [MAIN      ] EVT: Failed to save primary data.
[2025-10-24T18:40:52.813346] [WARN ] [MAIN      ] EVT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:40:52.813381] [INFO ] [LOCAL     ] EVT: Starting deletion of primary data.
[2025-10-24T18:40:52.813432] [DEBUG] [LOCAL     ] EVT: No primary data file found to delete.
[2025-10-24T18:40:52.813467] [INFO ] [LOCAL     ] EVT: Starting deletion of derivative data.
[2025-10-24T18:40:52.813604] [DEBUG] [LOCAL     ] EVT: Deleted derivative data file.
[2025-10-24T18:40:52.813707] [INFO ] [MAIN      ] Update Progress: 793/2366 symbols completed. EVT took 28.7s. Estimated remaining: 3h 20m 1s. Rate: 7.9 symbols/min
[2025-10-24T18:40:52.954729] [INFO ] [REMOTE    ] EVTR: Fetching primary data for 2025-01.
[2025-10-24T18:40:52.986118] [INFO ] [MAIN      ] EW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:40:53.037241] [DEBUG] [LOCAL     ] EW: Loaded 53780 existing records from primary storage.
[2025-10-24T18:40:53.037585] [INFO ] [MAIN      ] EW: Loaded 53780 existing records.
[2025-10-24T18:40:53.212191] [WARN ] [MAIN      ] EW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:40:53.212422] [INFO ] [MAIN      ] EW: Wiping existing primary data before full refresh.
[2025-10-24T18:40:53.212469] [INFO ] [LOCAL     ] EW: Starting deletion of primary data.
[2025-10-24T18:40:53.212693] [DEBUG] [LOCAL     ] EW: Deleted primary data file.
[2025-10-24T18:40:53.212750] [INFO ] [MAIN      ] EW: Starting full primary refresh.
[2025-10-24T18:40:53.570803] [INFO ] [REMOTE    ] EW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:40:53.641447] [INFO ] [REMOTE    ] EVTL: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T18:40:53.747721] [INFO ] [REMOTE    ] EW: Fetching primary data for 2025-01.
[2025-10-24T18:40:54.208452] [INFO ] [REMOTE    ] EVTR: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T18:40:54.547727] [INFO ] [REMOTE    ] EVTC: Fetching primary data for 2025-02.
[2025-10-24T18:40:55.347684] [INFO ] [REMOTE    ] EVTL: Fetching primary data for 2025-02.
[2025-10-24T18:40:55.566488] [INFO ] [REMOTE    ] EW: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T18:40:55.696833] [INFO ] [REMOTE    ] EVTC: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T18:40:56.147699] [INFO ] [REMOTE    ] EVTC: Fetching primary data for 2025-03.
[2025-10-24T18:40:56.475683] [INFO ] [REMOTE    ] EVTL: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T18:40:56.947720] [INFO ] [REMOTE    ] EW: Fetching primary data for 2025-02.
[2025-10-24T18:40:57.372177] [INFO ] [REMOTE    ] EVTC: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T18:40:57.747679] [INFO ] [REMOTE    ] EVTL: Fetching primary data for 2025-03.
[2025-10-24T18:40:58.547722] [INFO ] [REMOTE    ] EVTR: Fetching primary data for 2025-02.
[2025-10-24T18:40:58.652796] [INFO ] [REMOTE    ] EW: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T18:40:58.698122] [INFO ] [REMOTE    ] EVTL: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T18:40:59.241860] [INFO ] [REMOTE    ] EVTR: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T18:40:59.347707] [INFO ] [REMOTE    ] EVTL: Fetching primary data for 2025-04.
[2025-10-24T18:41:00.147687] [INFO ] [REMOTE    ] EVTC: Fetching primary data for 2025-04.
[2025-10-24T18:41:00.457527] [INFO ] [REMOTE    ] EVTL: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T18:41:00.947712] [INFO ] [REMOTE    ] EW: Fetching primary data for 2025-03.
[2025-10-24T18:41:01.747699] [INFO ] [REMOTE    ] EVTL: Fetching primary data for 2025-05.
[2025-10-24T18:41:01.816984] [INFO ] [REMOTE    ] EVTC: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T18:41:02.547729] [INFO ] [REMOTE    ] EVTC: Fetching primary data for 2025-05.
[2025-10-24T18:41:03.347735] [INFO ] [REMOTE    ] EVTR: Fetching primary data for 2025-03.
[2025-10-24T18:41:03.569722] [INFO ] [REMOTE    ] EW: Incremental fetch complete for 2025-03 (2.62 seconds).
[2025-10-24T18:41:04.125169] [INFO ] [REMOTE    ] EVTL: Incremental fetch complete for 2025-05 (2.38 seconds).
[2025-10-24T18:41:04.147731] [INFO ] [REMOTE    ] EVTL: Fetching primary data for 2025-06.
[2025-10-24T18:41:04.767911] [INFO ] [REMOTE    ] EVTC: Incremental fetch complete for 2025-05 (2.22 seconds).
[2025-10-24T18:41:04.898897] [INFO ] [REMOTE    ] EVTR: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T18:41:04.947716] [INFO ] [REMOTE    ] EVTR: Fetching primary data for 2025-04.
[2025-10-24T18:41:05.747703] [INFO ] [REMOTE    ] EVTC: Fetching primary data for 2025-06.
[2025-10-24T18:41:05.931839] [INFO ] [REMOTE    ] EVTL: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T18:41:06.237283] [INFO ] [REMOTE    ] EVTR: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T18:41:06.547706] [INFO ] [REMOTE    ] EVTL: Fetching primary data for 2025-07.
[2025-10-24T18:41:06.782507] [INFO ] [REMOTE    ] EVTC: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T18:41:07.347706] [INFO ] [REMOTE    ] EVTC: Fetching primary data for 2025-07.
[2025-10-24T18:41:08.147617] [INFO ] [REMOTE    ] EVTR: Fetching primary data for 2025-05.
[2025-10-24T18:41:08.574145] [INFO ] [REMOTE    ] EVTL: Incremental fetch complete for 2025-07 (2.03 seconds).
[2025-10-24T18:41:08.610372] [INFO ] [REMOTE    ] EVTC: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T18:41:08.947691] [INFO ] [REMOTE    ] EVTL: Fetching primary data for 2025-08.
[2025-10-24T18:41:09.257751] [INFO ] [REMOTE    ] EVTR: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T18:41:09.747709] [INFO ] [REMOTE    ] EW: Fetching primary data for 2025-04.
[2025-10-24T18:41:10.547786] [INFO ] [REMOTE    ] EVTR: Fetching primary data for 2025-06.
[2025-10-24T18:41:10.574863] [INFO ] [REMOTE    ] EVTL: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T18:41:11.347613] [INFO ] [REMOTE    ] EVTL: Fetching primary data for 2025-09.
[2025-10-24T18:41:11.608305] [INFO ] [REMOTE    ] EVTR: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T18:41:11.787268] [INFO ] [REMOTE    ] EW: Incremental fetch complete for 2025-04 (2.04 seconds).
[2025-10-24T18:41:12.147637] [INFO ] [REMOTE    ] EW: Fetching primary data for 2025-05.
[2025-10-24T18:41:12.947625] [INFO ] [REMOTE    ] EVTC: Fetching primary data for 2025-08.
[2025-10-24T18:41:13.268987] [INFO ] [REMOTE    ] EVTL: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T18:41:13.747610] [INFO ] [REMOTE    ] EVTL: Fetching primary data for 2025-10.
[2025-10-24T18:41:13.931693] [INFO ] [REMOTE    ] EW: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T18:41:14.114985] [INFO ] [REMOTE    ] EVTC: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T18:41:14.547636] [INFO ] [REMOTE    ] EW: Fetching primary data for 2025-06.
[2025-10-24T18:41:15.347640] [INFO ] [REMOTE    ] EVTR: Fetching primary data for 2025-07.
[2025-10-24T18:41:16.013528] [INFO ] [REMOTE    ] EVTL: Incremental fetch complete for 2025-10 (2.27 seconds).
[2025-10-24T18:41:16.022893] [INFO ] [REMOTE    ] EVTL: Full fetch complete (54745 records).
[2025-10-24T18:41:16.023058] [DEBUG] [VALIDATOR ] EVTL: Validating primary data.
[2025-10-24T18:41:16.023798] [FATAL] [VALIDATOR ] EVTL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:41:16.023891] [FATAL] [MAIN      ] EVTL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:41:16.023934] [WARN ] [MAIN      ] EVTL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:41:16.023974] [INFO ] [LOCAL     ] EVTL: Starting deletion of primary data.
[2025-10-24T18:41:16.024030] [DEBUG] [LOCAL     ] EVTL: No primary data file found to delete.
[2025-10-24T18:41:16.024067] [INFO ] [LOCAL     ] EVTL: Starting deletion of derivative data.
[2025-10-24T18:41:16.024209] [DEBUG] [LOCAL     ] EVTL: Deleted derivative data file.
[2025-10-24T18:41:16.024556] [INFO ] [MAIN      ] Update Progress: 794/2366 symbols completed. EVTL took 26.8s. Estimated remaining: 3h 20m 24s. Rate: 7.8 symbols/min
[2025-10-24T18:41:16.156583] [INFO ] [REMOTE    ] EVTC: Fetching primary data for 2025-09.
[2025-10-24T18:41:16.201067] [INFO ] [MAIN      ] EXG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:41:16.237220] [INFO ] [REMOTE    ] EW: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T18:41:16.280530] [DEBUG] [LOCAL     ] EXG: Loaded 33832 existing records from primary storage.
[2025-10-24T18:41:16.280872] [INFO ] [MAIN      ] EXG: Loaded 33832 existing records.
[2025-10-24T18:41:16.459097] [WARN ] [MAIN      ] EXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:41:16.459431] [INFO ] [MAIN      ] EXG: Wiping existing primary data before full refresh.
[2025-10-24T18:41:16.459591] [INFO ] [LOCAL     ] EXG: Starting deletion of primary data.
[2025-10-24T18:41:16.459948] [DEBUG] [LOCAL     ] EXG: Deleted primary data file.
[2025-10-24T18:41:16.465226] [INFO ] [MAIN      ] EXG: Starting full primary refresh.
[2025-10-24T18:41:16.478349] [INFO ] [REMOTE    ] EVTR: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T18:41:16.836568] [INFO ] [REMOTE    ] EXG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:41:16.947635] [INFO ] [REMOTE    ] EVTR: Fetching primary data for 2025-08.
[2025-10-24T18:41:17.385416] [INFO ] [REMOTE    ] EVTC: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T18:41:17.747699] [INFO ] [REMOTE    ] EVTC: Fetching primary data for 2025-10.
[2025-10-24T18:41:18.066795] [INFO ] [REMOTE    ] EVTR: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T18:41:18.547634] [INFO ] [REMOTE    ] EW: Fetching primary data for 2025-07.
[2025-10-24T18:41:18.927212] [INFO ] [REMOTE    ] EVTC: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T18:41:18.932971] [INFO ] [REMOTE    ] EVTC: Full fetch complete (38524 records).
[2025-10-24T18:41:18.933072] [DEBUG] [VALIDATOR ] EVTC: Validating primary data.
[2025-10-24T18:41:19.294490] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present.
[2025-10-24T18:41:19.294564] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed.
[2025-10-24T18:41:19.295176] [INFO ] [MAIN      ] EVTC: Fetched primary data is valid.
[2025-10-24T18:41:19.295239] [DEBUG] [LOCAL     ] EVTC: Saving primary data.
[2025-10-24T18:41:19.295589] [FATAL] [LOCAL     ] EVTC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:41:19.295696] [FATAL] [MAIN      ] EVTC: Failed to save primary data.
[2025-10-24T18:41:19.295743] [WARN ] [MAIN      ] EVTC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:41:19.295779] [INFO ] [LOCAL     ] EVTC: Starting deletion of primary data.
[2025-10-24T18:41:19.295829] [DEBUG] [LOCAL     ] EVTC: No primary data file found to delete.
[2025-10-24T18:41:19.295864] [INFO ] [LOCAL     ] EVTC: Starting deletion of derivative data.
[2025-10-24T18:41:19.296000] [DEBUG] [LOCAL     ] EVTC: Deleted derivative data file.
[2025-10-24T18:41:19.296085] [INFO ] [MAIN      ] Update Progress: 795/2366 symbols completed. EVTC took 30.2s. Estimated remaining: 3h 20m 8s. Rate: 7.9 symbols/min
[2025-10-24T18:41:19.358250] [INFO ] [REMOTE    ] EVTR: Fetching primary data for 2025-09.
[2025-10-24T18:41:19.468508] [INFO ] [MAIN      ] EXK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:41:19.518406] [DEBUG] [LOCAL     ] EXK: Loaded 53575 existing records from primary storage.
[2025-10-24T18:41:19.518786] [INFO ] [MAIN      ] EXK: Loaded 53575 existing records.
[2025-10-24T18:41:19.693632] [WARN ] [MAIN      ] EXK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:41:19.693901] [INFO ] [MAIN      ] EXK: Wiping existing primary data before full refresh.
[2025-10-24T18:41:19.693967] [INFO ] [LOCAL     ] EXK: Starting deletion of primary data.
[2025-10-24T18:41:19.694433] [DEBUG] [LOCAL     ] EXK: Deleted primary data file.
[2025-10-24T18:41:19.694474] [INFO ] [MAIN      ] EXK: Starting full primary refresh.
[2025-10-24T18:41:20.051026] [INFO ] [REMOTE    ] EXK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:41:20.147609] [INFO ] [REMOTE    ] EXK: Fetching primary data for 2025-01.
[2025-10-24T18:41:20.235316] [INFO ] [REMOTE    ] EW: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T18:41:20.726411] [INFO ] [REMOTE    ] EVTR: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T18:41:20.947636] [INFO ] [REMOTE    ] EVTR: Fetching primary data for 2025-10.
[2025-10-24T18:41:21.747629] [INFO ] [REMOTE    ] EXG: Fetching primary data for 2025-01.
[2025-10-24T18:41:21.964490] [INFO ] [REMOTE    ] EXK: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T18:41:22.488750] [INFO ] [REMOTE    ] EVTR: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T18:41:22.495040] [INFO ] [REMOTE    ] EVTR: Full fetch complete (34003 records).
[2025-10-24T18:41:22.495147] [DEBUG] [VALIDATOR ] EVTR: Validating primary data.
[2025-10-24T18:41:22.495681] [FATAL] [VALIDATOR ] EVTR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:41:22.495777] [FATAL] [MAIN      ] EVTR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:41:22.495856] [WARN ] [MAIN      ] EVTR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:41:22.495945] [INFO ] [LOCAL     ] EVTR: Starting deletion of primary data.
[2025-10-24T18:41:22.496019] [DEBUG] [LOCAL     ] EVTR: No primary data file found to delete.
[2025-10-24T18:41:22.496055] [INFO ] [LOCAL     ] EVTR: Starting deletion of derivative data.
[2025-10-24T18:41:22.496190] [DEBUG] [LOCAL     ] EVTR: Deleted derivative data file.
[2025-10-24T18:41:22.496259] [INFO ] [MAIN      ] Update Progress: 796/2366 symbols completed. EVTR took 30.9s. Estimated remaining: 3h 19m 51s. Rate: 7.9 symbols/min
[2025-10-24T18:41:22.552940] [INFO ] [REMOTE    ] EW: Fetching primary data for 2025-08.
[2025-10-24T18:41:22.674876] [INFO ] [MAIN      ] EXP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:41:22.706703] [DEBUG] [LOCAL     ] EXP: Loaded 29302 existing records from primary storage.
[2025-10-24T18:41:22.706963] [INFO ] [MAIN      ] EXP: Loaded 29302 existing records.
[2025-10-24T18:41:22.888840] [WARN ] [MAIN      ] EXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:41:22.889978] [INFO ] [MAIN      ] EXP: Wiping existing primary data before full refresh.
[2025-10-24T18:41:22.890043] [INFO ] [LOCAL     ] EXP: Starting deletion of primary data.
[2025-10-24T18:41:22.890369] [DEBUG] [LOCAL     ] EXP: Deleted primary data file.
[2025-10-24T18:41:22.890426] [INFO ] [MAIN      ] EXP: Starting full primary refresh.
[2025-10-24T18:41:23.268484] [INFO ] [REMOTE    ] EXP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:41:23.347689] [INFO ] [REMOTE    ] EXP: Fetching primary data for 2025-01.
[2025-10-24T18:41:23.373082] [INFO ] [REMOTE    ] EXG: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T18:41:24.147721] [INFO ] [REMOTE    ] EXG: Fetching primary data for 2025-02.
[2025-10-24T18:41:24.438003] [INFO ] [REMOTE    ] EW: Incremental fetch complete for 2025-08 (1.89 seconds).
[2025-10-24T18:41:24.785176] [INFO ] [REMOTE    ] EXP: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T18:41:24.947610] [INFO ] [REMOTE    ] EXP: Fetching primary data for 2025-02.
[2025-10-24T18:41:25.325683] [INFO ] [REMOTE    ] EXG: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T18:41:25.747721] [INFO ] [REMOTE    ] EXK: Fetching primary data for 2025-02.
[2025-10-24T18:41:26.269969] [INFO ] [REMOTE    ] EXP: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T18:41:26.547671] [INFO ] [REMOTE    ] EW: Fetching primary data for 2025-09.
[2025-10-24T18:41:27.347621] [INFO ] [REMOTE    ] EXP: Fetching primary data for 2025-03.
[2025-10-24T18:41:27.457693] [INFO ] [REMOTE    ] EXK: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T18:41:28.147694] [INFO ] [REMOTE    ] EXK: Fetching primary data for 2025-03.
[2025-10-24T18:41:28.273572] [INFO ] [REMOTE    ] EW: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T18:41:28.703157] [INFO ] [REMOTE    ] EXP: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T18:41:28.947702] [INFO ] [REMOTE    ] EXP: Fetching primary data for 2025-04.
[2025-10-24T18:41:29.747694] [INFO ] [REMOTE    ] EW: Fetching primary data for 2025-10.
[2025-10-24T18:41:29.841075] [INFO ] [REMOTE    ] EXK: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T18:41:30.271160] [INFO ] [REMOTE    ] EXP: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T18:41:30.547636] [INFO ] [REMOTE    ] EXK: Fetching primary data for 2025-04.
[2025-10-24T18:41:31.347718] [INFO ] [REMOTE    ] EXP: Fetching primary data for 2025-05.
[2025-10-24T18:41:31.617348] [INFO ] [REMOTE    ] EW: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T18:41:31.627753] [INFO ] [REMOTE    ] EW: Full fetch complete (77502 records).
[2025-10-24T18:41:31.627909] [DEBUG] [VALIDATOR ] EW: Validating primary data.
[2025-10-24T18:41:32.012902] [DEBUG] [VALIDATOR ] EW: All expected trading days are present.
[2025-10-24T18:41:32.012977] [DEBUG] [VALIDATOR ] EW: Primary data validation passed.
[2025-10-24T18:41:32.013872] [INFO ] [MAIN      ] EW: Fetched primary data is valid.
[2025-10-24T18:41:32.013939] [DEBUG] [LOCAL     ] EW: Saving primary data.
[2025-10-24T18:41:32.014472] [FATAL] [LOCAL     ] EW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:41:32.014561] [FATAL] [MAIN      ] EW: Failed to save primary data.
[2025-10-24T18:41:32.014604] [WARN ] [MAIN      ] EW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:41:32.014687] [INFO ] [LOCAL     ] EW: Starting deletion of primary data.
[2025-10-24T18:41:32.014756] [DEBUG] [LOCAL     ] EW: No primary data file found to delete.
[2025-10-24T18:41:32.014793] [INFO ] [LOCAL     ] EW: Starting deletion of derivative data.
[2025-10-24T18:41:32.014955] [DEBUG] [LOCAL     ] EW: Deleted derivative data file.
[2025-10-24T18:41:32.015759] [INFO ] [MAIN      ] Update Progress: 797/2366 symbols completed. EW took 39.2s. Estimated remaining: 3h 19m 47s. Rate: 7.9 symbols/min
[2025-10-24T18:41:32.147606] [INFO ] [REMOTE    ] EXG: Fetching primary data for 2025-03.
[2025-10-24T18:41:32.580727] [INFO ] [REMOTE    ] EXK: Incremental fetch complete for 2025-04 (2.03 seconds).
[2025-10-24T18:41:32.601995] [INFO ] [REMOTE    ] EXP: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T18:41:32.947702] [INFO ] [REMOTE    ] EXK: Fetching primary data for 2025-05.
[2025-10-24T18:41:33.547782] [INFO ] [REMOTE    ] EXG: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T18:41:33.747699] [INFO ] [REMOTE    ] EXG: Fetching primary data for 2025-04.
[2025-10-24T18:41:34.547795] [INFO ] [REMOTE    ] EXP: Fetching primary data for 2025-06.
[2025-10-24T18:41:34.682410] [INFO ] [REMOTE    ] EXK: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T18:41:35.347616] [INFO ] [REMOTE    ] EXK: Fetching primary data for 2025-06.
[2025-10-24T18:41:35.523615] [INFO ] [REMOTE    ] EXG: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T18:41:35.963513] [INFO ] [REMOTE    ] EXP: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T18:41:36.147636] [INFO ] [REMOTE    ] EXG: Fetching primary data for 2025-05.
[2025-10-24T18:41:36.947711] [INFO ] [REMOTE    ] EXP: Fetching primary data for 2025-07.
[2025-10-24T18:41:36.992351] [INFO ] [REMOTE    ] EXK: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T18:41:37.528898] [INFO ] [REMOTE    ] EXG: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T18:41:37.747713] [INFO ] [REMOTE    ] EXG: Fetching primary data for 2025-06.
[2025-10-24T18:41:38.046007] [INFO ] [REMOTE    ] EXP: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T18:41:38.547714] [INFO ] [REMOTE    ] EXP: Fetching primary data for 2025-08.
[2025-10-24T18:41:38.844061] [INFO ] [REMOTE    ] EXG: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T18:41:39.347667] [INFO ] [REMOTE    ] EXK: Fetching primary data for 2025-07.
[2025-10-24T18:41:39.893038] [INFO ] [REMOTE    ] EXP: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T18:41:40.147635] [INFO ] [REMOTE    ] EXP: Fetching primary data for 2025-09.
[2025-10-24T18:41:40.947671] [INFO ] [REMOTE    ] EXG: Fetching primary data for 2025-07.
[2025-10-24T18:41:41.176196] [INFO ] [REMOTE    ] EXK: Incremental fetch complete for 2025-07 (1.83 seconds).
[2025-10-24T18:41:41.209766] [INFO ] [REMOTE    ] EXP: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T18:41:41.747673] [INFO ] [REMOTE    ] EXP: Fetching primary data for 2025-10.
[2025-10-24T18:41:42.233802] [INFO ] [REMOTE    ] EXG: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T18:41:42.547688] [INFO ] [REMOTE    ] EXK: Fetching primary data for 2025-08.
[2025-10-24T18:41:43.037033] [INFO ] [REMOTE    ] EXP: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T18:41:43.044751] [INFO ] [REMOTE    ] EXP: Full fetch complete (42803 records).
[2025-10-24T18:41:43.044911] [DEBUG] [VALIDATOR ] EXP: Validating primary data.
[2025-10-24T18:41:43.352796] [INFO ] [REMOTE    ] EXG: Fetching primary data for 2025-08.
[2025-10-24T18:41:43.433221] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present.
[2025-10-24T18:41:43.433339] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed.
[2025-10-24T18:41:43.434331] [INFO ] [MAIN      ] EXP: Fetched primary data is valid.
[2025-10-24T18:41:43.434396] [DEBUG] [LOCAL     ] EXP: Saving primary data.
[2025-10-24T18:41:43.435038] [FATAL] [LOCAL     ] EXP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:41:43.435126] [FATAL] [MAIN      ] EXP: Failed to save primary data.
[2025-10-24T18:41:43.435173] [WARN ] [MAIN      ] EXP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:41:43.435261] [INFO ] [LOCAL     ] EXP: Starting deletion of primary data.
[2025-10-24T18:41:43.435374] [DEBUG] [LOCAL     ] EXP: No primary data file found to delete.
[2025-10-24T18:41:43.435434] [INFO ] [LOCAL     ] EXP: Starting deletion of derivative data.
[2025-10-24T18:41:43.435623] [DEBUG] [LOCAL     ] EXP: Deleted derivative data file.
[2025-10-24T18:41:43.435778] [INFO ] [MAIN      ] Update Progress: 798/2366 symbols completed. EXP took 20.9s. Estimated remaining: 3h 19m 47s. Rate: 7.8 symbols/min
[2025-10-24T18:41:44.217257] [INFO ] [REMOTE    ] EXK: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T18:41:44.228550] [INFO ] [REMOTE    ] EXK: Fetching primary data for 2025-09.
[2025-10-24T18:41:44.610371] [INFO ] [REMOTE    ] EXG: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T18:41:44.947711] [INFO ] [REMOTE    ] EXG: Fetching primary data for 2025-09.
[2025-10-24T18:41:46.115843] [INFO ] [REMOTE    ] EXK: Incremental fetch complete for 2025-09 (1.89 seconds).
[2025-10-24T18:41:46.116837] [INFO ] [REMOTE    ] EXG: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T18:41:46.134871] [INFO ] [REMOTE    ] EXG: Fetching primary data for 2025-10.
[2025-10-24T18:41:46.547765] [INFO ] [REMOTE    ] EXK: Fetching primary data for 2025-10.
[2025-10-24T18:41:47.432486] [INFO ] [REMOTE    ] EXG: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T18:41:47.438507] [INFO ] [REMOTE    ] EXG: Full fetch complete (49392 records).
[2025-10-24T18:41:47.438624] [DEBUG] [VALIDATOR ] EXG: Validating primary data.
[2025-10-24T18:41:47.821711] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present.
[2025-10-24T18:41:47.821791] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed.
[2025-10-24T18:41:47.822469] [INFO ] [MAIN      ] EXG: Fetched primary data is valid.
[2025-10-24T18:41:47.822508] [DEBUG] [LOCAL     ] EXG: Saving primary data.
[2025-10-24T18:41:47.822927] [FATAL] [LOCAL     ] EXG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:41:47.823009] [FATAL] [MAIN      ] EXG: Failed to save primary data.
[2025-10-24T18:41:47.823050] [WARN ] [MAIN      ] EXG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:41:47.823084] [INFO ] [LOCAL     ] EXG: Starting deletion of primary data.
[2025-10-24T18:41:47.823133] [DEBUG] [LOCAL     ] EXG: No primary data file found to delete.
[2025-10-24T18:41:47.823166] [INFO ] [LOCAL     ] EXG: Starting deletion of derivative data.
[2025-10-24T18:41:47.823308] [DEBUG] [LOCAL     ] EXG: Deleted derivative data file.
[2025-10-24T18:41:47.823715] [INFO ] [MAIN      ] Update Progress: 799/2366 symbols completed. EXG took 31.8s. Estimated remaining: 3h 19m 33s. Rate: 7.9 symbols/min
[2025-10-24T18:41:48.566077] [INFO ] [REMOTE    ] EXK: Incremental fetch complete for 2025-10 (2.02 seconds).
[2025-10-24T18:41:48.575725] [INFO ] [REMOTE    ] EXK: Full fetch complete (76879 records).
[2025-10-24T18:41:48.575847] [DEBUG] [VALIDATOR ] EXK: Validating primary data.
[2025-10-24T18:41:48.962074] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present.
[2025-10-24T18:41:48.962165] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed.
[2025-10-24T18:41:48.963098] [INFO ] [MAIN      ] EXK: Fetched primary data is valid.
[2025-10-24T18:41:48.963159] [DEBUG] [LOCAL     ] EXK: Saving primary data.
[2025-10-24T18:41:48.963730] [FATAL] [LOCAL     ] EXK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:41:48.963831] [FATAL] [MAIN      ] EXK: Failed to save primary data.
[2025-10-24T18:41:48.963872] [WARN ] [MAIN      ] EXK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:41:48.963907] [INFO ] [LOCAL     ] EXK: Starting deletion of primary data.
[2025-10-24T18:41:48.963958] [DEBUG] [LOCAL     ] EXK: No primary data file found to delete.
[2025-10-24T18:41:48.963993] [INFO ] [LOCAL     ] EXK: Starting deletion of derivative data.
[2025-10-24T18:41:48.964166] [DEBUG] [LOCAL     ] EXK: Deleted derivative data file.
[2025-10-24T18:41:48.964768] [INFO ] [MAIN      ] Update Progress: 800/2366 symbols completed. EXK took 29.7s. Estimated remaining: 3h 19m 13s. Rate: 7.9 symbols/min
[2025-10-24T18:41:49.574751] [INFO ] [MAIN      ] EXPD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:41:49.630898] [INFO ] [MAIN      ] EXR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:41:49.651707] [INFO ] [MAIN      ] FAF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:41:49.649318] [INFO ] [MAIN      ] F: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:41:49.716866] [DEBUG] [LOCAL     ] FAF: Loaded 41784 existing records from primary storage.
[2025-10-24T18:41:49.733894] [INFO ] [MAIN      ] FAF: Loaded 41784 existing records.
[2025-10-24T18:41:49.752181] [DEBUG] [LOCAL     ] EXPD: Loaded 48043 existing records from primary storage.
[2025-10-24T18:41:49.818461] [INFO ] [MAIN      ] EXPD: Loaded 48043 existing records.
[2025-10-24T18:41:49.907101] [DEBUG] [LOCAL     ] EXR: Loaded 45770 existing records from primary storage.
[2025-10-24T18:41:50.021939] [INFO ] [MAIN      ] EXR: Loaded 45770 existing records.
[2025-10-24T18:41:50.039452] [DEBUG] [LOCAL     ] F: Loaded 54210 existing records from primary storage.
[2025-10-24T18:41:50.087669] [WARN ] [MAIN      ] FAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:41:50.072360] [INFO ] [MAIN      ] F: Loaded 54210 existing records.
[2025-10-24T18:41:50.174313] [INFO ] [MAIN      ] FAF: Wiping existing primary data before full refresh.
[2025-10-24T18:41:50.255301] [INFO ] [LOCAL     ] FAF: Starting deletion of primary data.
[2025-10-24T18:41:50.293681] [WARN ] [MAIN      ] EXPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:41:50.349447] [INFO ] [MAIN      ] EXPD: Wiping existing primary data before full refresh.
[2025-10-24T18:41:50.353016] [DEBUG] [LOCAL     ] FAF: Deleted primary data file.
[2025-10-24T18:41:50.352935] [INFO ] [LOCAL     ] EXPD: Starting deletion of primary data.
[2025-10-24T18:41:50.358569] [INFO ] [MAIN      ] FAF: Starting full primary refresh.
[2025-10-24T18:41:50.374359] [DEBUG] [LOCAL     ] EXPD: Deleted primary data file.
[2025-10-24T18:41:50.435012] [INFO ] [MAIN      ] EXPD: Starting full primary refresh.
[2025-10-24T18:41:50.528264] [WARN ] [MAIN      ] EXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:41:50.630855] [WARN ] [MAIN      ] F: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:41:50.657989] [INFO ] [MAIN      ] F: Wiping existing primary data before full refresh.
[2025-10-24T18:41:50.631165] [INFO ] [MAIN      ] EXR: Wiping existing primary data before full refresh.
[2025-10-24T18:41:50.688491] [INFO ] [LOCAL     ] F: Starting deletion of primary data.
[2025-10-24T18:41:50.720476] [INFO ] [LOCAL     ] EXR: Starting deletion of primary data.
[2025-10-24T18:41:50.733902] [DEBUG] [LOCAL     ] F: Deleted primary data file.
[2025-10-24T18:41:50.745553] [INFO ] [MAIN      ] F: Starting full primary refresh.
[2025-10-24T18:41:50.751208] [DEBUG] [LOCAL     ] EXR: Deleted primary data file.
[2025-10-24T18:41:50.793940] [INFO ] [MAIN      ] EXR: Starting full primary refresh.
[2025-10-24T18:41:51.874570] [INFO ] [REMOTE    ] FAF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:41:51.892520] [INFO ] [REMOTE    ] FAF: Fetching primary data for 2025-01.
[2025-10-24T18:41:52.131004] [INFO ] [REMOTE    ] EXPD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:41:52.154027] [INFO ] [REMOTE    ] EXPD: Fetching primary data for 2025-01.
[2025-10-24T18:41:52.330664] [INFO ] [REMOTE    ] F: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:41:52.331820] [INFO ] [REMOTE    ] F: Fetching primary data for 2025-01.
[2025-10-24T18:41:52.351743] [INFO ] [REMOTE    ] EXR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:41:52.352128] [INFO ] [REMOTE    ] EXR: Fetching primary data for 2025-01.
[2025-10-24T18:41:53.577704] [INFO ] [REMOTE    ] FAF: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T18:41:53.584738] [INFO ] [REMOTE    ] FAF: Fetching primary data for 2025-02.
[2025-10-24T18:41:53.694431] [INFO ] [REMOTE    ] EXPD: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T18:41:53.704166] [INFO ] [REMOTE    ] EXPD: Fetching primary data for 2025-02.
[2025-10-24T18:41:54.074956] [INFO ] [REMOTE    ] EXR: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T18:41:54.084827] [INFO ] [REMOTE    ] EXR: Fetching primary data for 2025-02.
[2025-10-24T18:41:54.554273] [INFO ] [REMOTE    ] F: Incremental fetch complete for 2025-01 (2.22 seconds).
[2025-10-24T18:41:54.564580] [INFO ] [REMOTE    ] F: Fetching primary data for 2025-02.
[2025-10-24T18:41:54.922770] [INFO ] [REMOTE    ] FAF: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T18:41:54.929681] [INFO ] [REMOTE    ] FAF: Fetching primary data for 2025-03.
[2025-10-24T18:41:54.964526] [INFO ] [REMOTE    ] EXPD: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T18:41:54.973673] [INFO ] [REMOTE    ] EXPD: Fetching primary data for 2025-03.
[2025-10-24T18:41:55.555471] [INFO ] [REMOTE    ] EXR: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T18:41:55.563988] [INFO ] [REMOTE    ] EXR: Fetching primary data for 2025-03.
[2025-10-24T18:41:56.280669] [INFO ] [REMOTE    ] EXPD: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T18:41:56.291263] [INFO ] [REMOTE    ] EXPD: Fetching primary data for 2025-04.
[2025-10-24T18:41:56.316549] [INFO ] [REMOTE    ] FAF: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T18:41:56.947614] [INFO ] [REMOTE    ] FAF: Fetching primary data for 2025-04.
[2025-10-24T18:41:57.053299] [INFO ] [REMOTE    ] F: Incremental fetch complete for 2025-02 (2.49 seconds).
[2025-10-24T18:41:57.089482] [INFO ] [REMOTE    ] EXR: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T18:41:57.747710] [INFO ] [REMOTE    ] EXR: Fetching primary data for 2025-04.
[2025-10-24T18:41:58.058797] [INFO ] [REMOTE    ] EXPD: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T18:41:58.440192] [INFO ] [REMOTE    ] FAF: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T18:41:58.547712] [INFO ] [REMOTE    ] F: Fetching primary data for 2025-03.
[2025-10-24T18:41:59.282305] [INFO ] [REMOTE    ] EXR: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T18:41:59.347730] [INFO ] [REMOTE    ] EXPD: Fetching primary data for 2025-05.
[2025-10-24T18:42:00.147666] [INFO ] [REMOTE    ] FAF: Fetching primary data for 2025-05.
[2025-10-24T18:42:00.947621] [INFO ] [REMOTE    ] EXR: Fetching primary data for 2025-05.
[2025-10-24T18:42:01.427521] [INFO ] [REMOTE    ] EXPD: Incremental fetch complete for 2025-05 (2.08 seconds).
[2025-10-24T18:42:01.544845] [INFO ] [REMOTE    ] F: Incremental fetch complete for 2025-03 (3.00 seconds).
[2025-10-24T18:42:01.591327] [INFO ] [REMOTE    ] FAF: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T18:42:01.747689] [INFO ] [REMOTE    ] F: Fetching primary data for 2025-04.
[2025-10-24T18:42:02.547701] [INFO ] [REMOTE    ] EXPD: Fetching primary data for 2025-06.
[2025-10-24T18:42:02.998622] [INFO ] [REMOTE    ] EXR: Incremental fetch complete for 2025-05 (2.05 seconds).
[2025-10-24T18:42:03.347733] [INFO ] [REMOTE    ] EXR: Fetching primary data for 2025-06.
[2025-10-24T18:42:04.147609] [INFO ] [REMOTE    ] FAF: Fetching primary data for 2025-06.
[2025-10-24T18:42:04.561970] [INFO ] [REMOTE    ] EXPD: Incremental fetch complete for 2025-06 (2.01 seconds).
[2025-10-24T18:42:04.947699] [INFO ] [REMOTE    ] EXPD: Fetching primary data for 2025-07.
[2025-10-24T18:42:05.014142] [INFO ] [REMOTE    ] EXR: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T18:42:05.316047] [INFO ] [REMOTE    ] F: Incremental fetch complete for 2025-04 (3.57 seconds).
[2025-10-24T18:42:05.747623] [INFO ] [REMOTE    ] EXR: Fetching primary data for 2025-07.
[2025-10-24T18:42:06.212143] [INFO ] [REMOTE    ] FAF: Incremental fetch complete for 2025-06 (2.06 seconds).
[2025-10-24T18:42:06.454471] [INFO ] [REMOTE    ] EXPD: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T18:42:06.547718] [INFO ] [REMOTE    ] FAF: Fetching primary data for 2025-07.
[2025-10-24T18:42:07.148518] [INFO ] [REMOTE    ] EXR: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T18:42:07.347711] [INFO ] [REMOTE    ] F: Fetching primary data for 2025-05.
[2025-10-24T18:42:08.147620] [INFO ] [REMOTE    ] EXR: Fetching primary data for 2025-08.
[2025-10-24T18:42:08.257980] [INFO ] [REMOTE    ] FAF: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T18:42:08.947675] [INFO ] [REMOTE    ] FAF: Fetching primary data for 2025-08.
[2025-10-24T18:42:09.539137] [INFO ] [REMOTE    ] EXR: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T18:42:09.747728] [INFO ] [REMOTE    ] EXPD: Fetching primary data for 2025-08.
[2025-10-24T18:42:10.161463] [INFO ] [REMOTE    ] F: Incremental fetch complete for 2025-05 (2.81 seconds).
[2025-10-24T18:42:10.496064] [INFO ] [REMOTE    ] FAF: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T18:42:10.547671] [INFO ] [REMOTE    ] FAF: Fetching primary data for 2025-09.
[2025-10-24T18:42:11.036168] [INFO ] [REMOTE    ] EXPD: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T18:42:11.347708] [INFO ] [REMOTE    ] EXR: Fetching primary data for 2025-09.
[2025-10-24T18:42:11.485576] [INFO ] [REMOTE    ] FAF: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T18:42:12.147693] [INFO ] [REMOTE    ] F: Fetching primary data for 2025-06.
[2025-10-24T18:42:12.925359] [INFO ] [REMOTE    ] EXR: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T18:42:12.947604] [INFO ] [REMOTE    ] EXR: Fetching primary data for 2025-10.
[2025-10-24T18:42:13.747746] [INFO ] [REMOTE    ] FAF: Fetching primary data for 2025-10.
[2025-10-24T18:42:14.547719] [INFO ] [REMOTE    ] EXPD: Fetching primary data for 2025-09.
[2025-10-24T18:42:14.863008] [INFO ] [REMOTE    ] F: Incremental fetch complete for 2025-06 (2.72 seconds).
[2025-10-24T18:42:15.002422] [INFO ] [REMOTE    ] EXR: Incremental fetch complete for 2025-10 (2.05 seconds).
[2025-10-24T18:42:15.010914] [INFO ] [REMOTE    ] EXR: Full fetch complete (66117 records).
[2025-10-24T18:42:15.011072] [DEBUG] [VALIDATOR ] EXR: Validating primary data.
[2025-10-24T18:42:15.353499] [INFO ] [REMOTE    ] F: Fetching primary data for 2025-07.
[2025-10-24T18:42:15.410738] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present.
[2025-10-24T18:42:15.410841] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed.
[2025-10-24T18:42:15.411717] [INFO ] [MAIN      ] EXR: Fetched primary data is valid.
[2025-10-24T18:42:15.411900] [DEBUG] [LOCAL     ] EXR: Saving primary data.
[2025-10-24T18:42:15.412574] [FATAL] [LOCAL     ] EXR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:42:15.412701] [FATAL] [MAIN      ] EXR: Failed to save primary data.
[2025-10-24T18:42:15.412777] [WARN ] [MAIN      ] EXR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:42:15.412863] [INFO ] [LOCAL     ] EXR: Starting deletion of primary data.
[2025-10-24T18:42:15.412943] [DEBUG] [LOCAL     ] EXR: No primary data file found to delete.
[2025-10-24T18:42:15.412981] [INFO ] [LOCAL     ] EXR: Starting deletion of derivative data.
[2025-10-24T18:42:15.413144] [DEBUG] [LOCAL     ] EXR: Deleted derivative data file.
[2025-10-24T18:42:15.413668] [INFO ] [MAIN      ] Update Progress: 801/2366 symbols completed. EXR took 26.4s. Estimated remaining: 3h 19m 42s. Rate: 7.8 symbols/min
[2025-10-24T18:42:15.603696] [INFO ] [MAIN      ] FBIN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:42:15.617272] [INFO ] [REMOTE    ] FAF: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T18:42:15.624860] [INFO ] [REMOTE    ] FAF: Full fetch complete (58436 records).
[2025-10-24T18:42:15.625091] [DEBUG] [VALIDATOR ] FAF: Validating primary data.
[2025-10-24T18:42:15.974236] [DEBUG] [LOCAL     ] FBIN: Loaded 50736 existing records from primary storage.
[2025-10-24T18:42:15.990051] [INFO ] [MAIN      ] FBIN: Loaded 50736 existing records.
[2025-10-24T18:42:16.164565] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present.
[2025-10-24T18:42:16.164981] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed.
[2025-10-24T18:42:16.165847] [INFO ] [MAIN      ] FAF: Fetched primary data is valid.
[2025-10-24T18:42:16.165926] [DEBUG] [LOCAL     ] FAF: Saving primary data.
[2025-10-24T18:42:16.177153] [FATAL] [LOCAL     ] FAF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:42:16.192700] [FATAL] [MAIN      ] FAF: Failed to save primary data.
[2025-10-24T18:42:16.205504] [WARN ] [MAIN      ] FAF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:42:16.216507] [INFO ] [LOCAL     ] FAF: Starting deletion of primary data.
[2025-10-24T18:42:16.227179] [DEBUG] [LOCAL     ] FAF: No primary data file found to delete.
[2025-10-24T18:42:16.227282] [INFO ] [LOCAL     ] FAF: Starting deletion of derivative data.
[2025-10-24T18:42:16.242980] [DEBUG] [LOCAL     ] FAF: Deleted derivative data file.
[2025-10-24T18:42:16.243844] [INFO ] [MAIN      ] Update Progress: 802/2366 symbols completed. FAF took 27.3s. Estimated remaining: 3h 19m 21s. Rate: 7.8 symbols/min
[2025-10-24T18:42:16.246843] [WARN ] [MAIN      ] FBIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:42:16.291436] [INFO ] [MAIN      ] FBIN: Wiping existing primary data before full refresh.
[2025-10-24T18:42:16.332682] [INFO ] [LOCAL     ] FBIN: Starting deletion of primary data.
[2025-10-24T18:42:16.355453] [DEBUG] [LOCAL     ] FBIN: Deleted primary data file.
[2025-10-24T18:42:16.371416] [INFO ] [MAIN      ] FBIN: Starting full primary refresh.
[2025-10-24T18:42:16.482803] [INFO ] [MAIN      ] FBK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:42:16.684558] [DEBUG] [LOCAL     ] FBK: Loaded 27617 existing records from primary storage.
[2025-10-24T18:42:16.720756] [INFO ] [MAIN      ] FBK: Loaded 27617 existing records.
[2025-10-24T18:42:17.000370] [INFO ] [REMOTE    ] FBIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:42:17.067040] [WARN ] [MAIN      ] FBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:42:17.067565] [INFO ] [REMOTE    ] FBIN: Fetching primary data for 2025-01.
[2025-10-24T18:42:17.068976] [INFO ] [MAIN      ] FBK: Wiping existing primary data before full refresh.
[2025-10-24T18:42:17.078249] [INFO ] [LOCAL     ] FBK: Starting deletion of primary data.
[2025-10-24T18:42:17.093762] [DEBUG] [LOCAL     ] FBK: Deleted primary data file.
[2025-10-24T18:42:17.094065] [INFO ] [MAIN      ] FBK: Starting full primary refresh.
[2025-10-24T18:42:17.100920] [INFO ] [REMOTE    ] EXPD: Incremental fetch complete for 2025-09 (2.55 seconds).
[2025-10-24T18:42:17.189156] [INFO ] [REMOTE    ] EXPD: Fetching primary data for 2025-10.
[2025-10-24T18:42:17.473182] [INFO ] [REMOTE    ] FBK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:42:17.628747] [INFO ] [REMOTE    ] F: Incremental fetch complete for 2025-07 (2.28 seconds).
[2025-10-24T18:42:17.747618] [INFO ] [REMOTE    ] F: Fetching primary data for 2025-08.
[2025-10-24T18:42:18.536726] [INFO ] [REMOTE    ] EXPD: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T18:42:18.545748] [INFO ] [REMOTE    ] EXPD: Full fetch complete (69368 records).
[2025-10-24T18:42:18.545912] [DEBUG] [VALIDATOR ] EXPD: Validating primary data.
[2025-10-24T18:42:18.572222] [INFO ] [REMOTE    ] FBK: Fetching primary data for 2025-01.
[2025-10-24T18:42:18.980074] [INFO ] [REMOTE    ] FBIN: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T18:42:19.012351] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present.
[2025-10-24T18:42:19.013041] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed.
[2025-10-24T18:42:19.014050] [INFO ] [MAIN      ] EXPD: Fetched primary data is valid.
[2025-10-24T18:42:19.014115] [DEBUG] [LOCAL     ] EXPD: Saving primary data.
[2025-10-24T18:42:19.014731] [FATAL] [LOCAL     ] EXPD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:42:19.014824] [FATAL] [MAIN      ] EXPD: Failed to save primary data.
[2025-10-24T18:42:19.014867] [WARN ] [MAIN      ] EXPD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:42:19.014902] [INFO ] [LOCAL     ] EXPD: Starting deletion of primary data.
[2025-10-24T18:42:19.014955] [DEBUG] [LOCAL     ] EXPD: No primary data file found to delete.
[2025-10-24T18:42:19.014990] [INFO ] [LOCAL     ] EXPD: Starting deletion of derivative data.
[2025-10-24T18:42:19.015175] [DEBUG] [LOCAL     ] EXPD: Deleted derivative data file.
[2025-10-24T18:42:19.015761] [INFO ] [MAIN      ] Update Progress: 803/2366 symbols completed. EXPD took 30.1s. Estimated remaining: 3h 19m 4s. Rate: 7.9 symbols/min
[2025-10-24T18:42:19.182475] [INFO ] [MAIN      ] FBP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:42:19.226185] [DEBUG] [LOCAL     ] FBP: Loaded 45946 existing records from primary storage.
[2025-10-24T18:42:19.226478] [INFO ] [MAIN      ] FBP: Loaded 45946 existing records.
[2025-10-24T18:42:19.352861] [INFO ] [REMOTE    ] FBIN: Fetching primary data for 2025-02.
[2025-10-24T18:42:19.409169] [WARN ] [MAIN      ] FBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:42:19.409344] [INFO ] [MAIN      ] FBP: Wiping existing primary data before full refresh.
[2025-10-24T18:42:19.409389] [INFO ] [LOCAL     ] FBP: Starting deletion of primary data.
[2025-10-24T18:42:19.409671] [DEBUG] [LOCAL     ] FBP: Deleted primary data file.
[2025-10-24T18:42:19.409727] [INFO ] [MAIN      ] FBP: Starting full primary refresh.
[2025-10-24T18:42:19.790985] [INFO ] [REMOTE    ] FBP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:42:19.777745] [INFO ] [REMOTE    ] FBK: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T18:42:20.007952] [INFO ] [REMOTE    ] F: Incremental fetch complete for 2025-08 (2.26 seconds).
[2025-10-24T18:42:20.147683] [INFO ] [REMOTE    ] FBK: Fetching primary data for 2025-02.
[2025-10-24T18:42:20.947637] [INFO ] [REMOTE    ] F: Fetching primary data for 2025-09.
[2025-10-24T18:42:21.016131] [INFO ] [REMOTE    ] FBIN: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T18:42:21.116072] [INFO ] [REMOTE    ] FBK: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T18:42:21.747675] [INFO ] [REMOTE    ] FBK: Fetching primary data for 2025-03.
[2025-10-24T18:42:22.547629] [INFO ] [REMOTE    ] FBP: Fetching primary data for 2025-01.
[2025-10-24T18:42:22.854356] [INFO ] [REMOTE    ] FBK: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T18:42:23.326451] [INFO ] [REMOTE    ] F: Incremental fetch complete for 2025-09 (2.38 seconds).
[2025-10-24T18:42:23.347613] [INFO ] [REMOTE    ] FBK: Fetching primary data for 2025-04.
[2025-10-24T18:42:23.851187] [INFO ] [REMOTE    ] FBP: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T18:42:24.147727] [INFO ] [REMOTE    ] F: Fetching primary data for 2025-10.
[2025-10-24T18:42:24.701029] [INFO ] [REMOTE    ] FBK: Incremental fetch complete for 2025-04 (1.35 seconds).
[2025-10-24T18:42:24.947715] [INFO ] [REMOTE    ] FBIN: Fetching primary data for 2025-03.
[2025-10-24T18:42:25.747671] [INFO ] [REMOTE    ] FBP: Fetching primary data for 2025-02.
[2025-10-24T18:42:26.409625] [INFO ] [REMOTE    ] F: Incremental fetch complete for 2025-10 (2.26 seconds).
[2025-10-24T18:42:26.419591] [INFO ] [REMOTE    ] F: Full fetch complete (78000 records).
[2025-10-24T18:42:26.419758] [DEBUG] [VALIDATOR ] F: Validating primary data.
[2025-10-24T18:42:26.553168] [INFO ] [REMOTE    ] FBK: Fetching primary data for 2025-05.
[2025-10-24T18:42:26.853209] [DEBUG] [VALIDATOR ] F: All expected trading days are present.
[2025-10-24T18:42:26.855587] [INFO ] [REMOTE    ] FBIN: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T18:42:26.855663] [DEBUG] [VALIDATOR ] F: Primary data validation passed.
[2025-10-24T18:42:26.856775] [INFO ] [MAIN      ] F: Fetched primary data is valid.
[2025-10-24T18:42:26.867146] [DEBUG] [LOCAL     ] F: Saving primary data.
[2025-10-24T18:42:26.868067] [FATAL] [LOCAL     ] F: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:42:26.868247] [FATAL] [MAIN      ] F: Failed to save primary data.
[2025-10-24T18:42:26.868358] [WARN ] [MAIN      ] F: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:42:26.868527] [INFO ] [LOCAL     ] F: Starting deletion of primary data.
[2025-10-24T18:42:26.868794] [DEBUG] [LOCAL     ] F: No primary data file found to delete.
[2025-10-24T18:42:26.868859] [INFO ] [LOCAL     ] F: Starting deletion of derivative data.
[2025-10-24T18:42:26.890084] [DEBUG] [LOCAL     ] F: Deleted derivative data file.
[2025-10-24T18:42:26.891129] [INFO ] [MAIN      ] Update Progress: 804/2366 symbols completed. F took 37.9s. Estimated remaining: 3h 18m 56s. Rate: 7.9 symbols/min
[2025-10-24T18:42:26.892390] [INFO ] [REMOTE    ] FBP: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T18:42:27.078815] [INFO ] [MAIN      ] FBRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:42:27.115407] [DEBUG] [LOCAL     ] FBRT: Loaded 35460 existing records from primary storage.
[2025-10-24T18:42:27.115705] [INFO ] [MAIN      ] FBRT: Loaded 35460 existing records.
[2025-10-24T18:42:27.294163] [WARN ] [MAIN      ] FBRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:42:27.294387] [INFO ] [MAIN      ] FBRT: Wiping existing primary data before full refresh.
[2025-10-24T18:42:27.294434] [INFO ] [LOCAL     ] FBRT: Starting deletion of primary data.
[2025-10-24T18:42:27.294636] [DEBUG] [LOCAL     ] FBRT: Deleted primary data file.
[2025-10-24T18:42:27.294729] [INFO ] [MAIN      ] FBRT: Starting full primary refresh.
[2025-10-24T18:42:27.356469] [INFO ] [REMOTE    ] FBP: Fetching primary data for 2025-03.
[2025-10-24T18:42:27.661014] [INFO ] [REMOTE    ] FBRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:42:27.755385] [INFO ] [REMOTE    ] FBK: Incremental fetch complete for 2025-05 (1.20 seconds).
[2025-10-24T18:42:28.147741] [INFO ] [REMOTE    ] FBIN: Fetching primary data for 2025-04.
[2025-10-24T18:42:28.955353] [INFO ] [REMOTE    ] FBRT: Fetching primary data for 2025-01.
[2025-10-24T18:42:28.957987] [INFO ] [REMOTE    ] FBP: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T18:42:29.489097] [INFO ] [REMOTE    ] FBIN: Incremental fetch complete for 2025-04 (1.34 seconds).
[2025-10-24T18:42:29.747627] [INFO ] [REMOTE    ] FBP: Fetching primary data for 2025-04.
[2025-10-24T18:42:30.169052] [INFO ] [REMOTE    ] FBRT: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T18:42:30.547694] [INFO ] [REMOTE    ] FBK: Fetching primary data for 2025-06.
[2025-10-24T18:42:31.347704] [INFO ] [REMOTE    ] FBIN: Fetching primary data for 2025-05.
[2025-10-24T18:42:31.403016] [INFO ] [REMOTE    ] FBP: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T18:42:31.645774] [INFO ] [REMOTE    ] FBK: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T18:42:32.147700] [INFO ] [REMOTE    ] FBP: Fetching primary data for 2025-05.
[2025-10-24T18:42:32.877087] [INFO ] [REMOTE    ] FBIN: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T18:42:32.947603] [INFO ] [REMOTE    ] FBIN: Fetching primary data for 2025-06.
[2025-10-24T18:42:33.576794] [INFO ] [REMOTE    ] FBP: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T18:42:33.747601] [INFO ] [REMOTE    ] FBP: Fetching primary data for 2025-06.
[2025-10-24T18:42:34.484954] [INFO ] [REMOTE    ] FBIN: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T18:42:34.547636] [INFO ] [REMOTE    ] FBRT: Fetching primary data for 2025-02.
[2025-10-24T18:42:35.347626] [INFO ] [REMOTE    ] FBIN: Fetching primary data for 2025-07.
[2025-10-24T18:42:35.454495] [INFO ] [REMOTE    ] FBP: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T18:42:35.829357] [INFO ] [REMOTE    ] FBRT: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T18:42:36.147700] [INFO ] [REMOTE    ] FBK: Fetching primary data for 2025-07.
[2025-10-24T18:42:36.906345] [INFO ] [REMOTE    ] FBIN: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T18:42:36.947605] [INFO ] [REMOTE    ] FBRT: Fetching primary data for 2025-03.
[2025-10-24T18:42:37.622218] [INFO ] [REMOTE    ] FBK: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T18:42:37.747675] [INFO ] [REMOTE    ] FBK: Fetching primary data for 2025-08.
[2025-10-24T18:42:38.246370] [INFO ] [REMOTE    ] FBRT: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T18:42:38.547636] [INFO ] [REMOTE    ] FBRT: Fetching primary data for 2025-04.
[2025-10-24T18:42:39.066956] [INFO ] [REMOTE    ] FBK: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T18:42:39.347668] [INFO ] [REMOTE    ] FBIN: Fetching primary data for 2025-08.
[2025-10-24T18:42:40.091874] [INFO ] [REMOTE    ] FBRT: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T18:42:40.147673] [INFO ] [REMOTE    ] FBP: Fetching primary data for 2025-07.
[2025-10-24T18:42:40.947619] [INFO ] [REMOTE    ] FBRT: Fetching primary data for 2025-05.
[2025-10-24T18:42:41.114705] [INFO ] [REMOTE    ] FBIN: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T18:42:41.606901] [INFO ] [REMOTE    ] FBP: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T18:42:41.747664] [INFO ] [REMOTE    ] FBIN: Fetching primary data for 2025-09.
[2025-10-24T18:42:42.385026] [INFO ] [REMOTE    ] FBRT: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T18:42:42.547631] [INFO ] [REMOTE    ] FBRT: Fetching primary data for 2025-06.
[2025-10-24T18:42:43.254702] [INFO ] [REMOTE    ] FBIN: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T18:42:43.347610] [INFO ] [REMOTE    ] FBIN: Fetching primary data for 2025-10.
[2025-10-24T18:42:43.613091] [INFO ] [REMOTE    ] FBRT: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T18:42:44.147722] [INFO ] [REMOTE    ] FBK: Fetching primary data for 2025-09.
[2025-10-24T18:42:44.947730] [INFO ] [REMOTE    ] FBRT: Fetching primary data for 2025-07.
[2025-10-24T18:42:45.002523] [INFO ] [REMOTE    ] FBIN: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T18:42:45.011488] [INFO ] [REMOTE    ] FBIN: Full fetch complete (72985 records).
[2025-10-24T18:42:45.011622] [DEBUG] [VALIDATOR ] FBIN: Validating primary data.
[2025-10-24T18:42:45.400498] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present.
[2025-10-24T18:42:45.400623] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed.
[2025-10-24T18:42:45.401674] [INFO ] [MAIN      ] FBIN: Fetched primary data is valid.
[2025-10-24T18:42:45.401779] [DEBUG] [LOCAL     ] FBIN: Saving primary data.
[2025-10-24T18:42:45.407565] [FATAL] [LOCAL     ] FBIN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:42:45.415763] [FATAL] [MAIN      ] FBIN: Failed to save primary data.
[2025-10-24T18:42:45.416268] [WARN ] [MAIN      ] FBIN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:42:45.416212] [INFO ] [REMOTE    ] FBK: Incremental fetch complete for 2025-09 (1.27 seconds).
[2025-10-24T18:42:45.421192] [INFO ] [LOCAL     ] FBIN: Starting deletion of primary data.
[2025-10-24T18:42:45.421690] [DEBUG] [LOCAL     ] FBIN: No primary data file found to delete.
[2025-10-24T18:42:45.422016] [INFO ] [LOCAL     ] FBIN: Starting deletion of derivative data.
[2025-10-24T18:42:45.422172] [DEBUG] [LOCAL     ] FBIN: Deleted derivative data file.
[2025-10-24T18:42:45.422623] [INFO ] [MAIN      ] Update Progress: 805/2366 symbols completed. FBIN took 30.0s. Estimated remaining: 3h 19m 10s. Rate: 7.8 symbols/min
[2025-10-24T18:42:45.589154] [INFO ] [MAIN      ] FC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:42:45.605276] [DEBUG] [LOCAL     ] FC: Loaded 14390 existing records from primary storage.
[2025-10-24T18:42:45.605497] [INFO ] [MAIN      ] FC: Loaded 14390 existing records.
[2025-10-24T18:42:45.755904] [INFO ] [REMOTE    ] FBK: Fetching primary data for 2025-10.
[2025-10-24T18:42:45.787182] [WARN ] [MAIN      ] FC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:42:45.787536] [INFO ] [MAIN      ] FC: Wiping existing primary data before full refresh.
[2025-10-24T18:42:45.787587] [INFO ] [LOCAL     ] FC: Starting deletion of primary data.
[2025-10-24T18:42:45.787782] [DEBUG] [LOCAL     ] FC: Deleted primary data file.
[2025-10-24T18:42:45.787837] [INFO ] [MAIN      ] FC: Starting full primary refresh.
[2025-10-24T18:42:46.145710] [INFO ] [REMOTE    ] FC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:42:46.349054] [INFO ] [REMOTE    ] FBRT: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T18:42:46.547720] [INFO ] [REMOTE    ] FBRT: Fetching primary data for 2025-08.
[2025-10-24T18:42:47.250489] [INFO ] [REMOTE    ] FBK: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T18:42:47.256486] [INFO ] [REMOTE    ] FBK: Full fetch complete (35609 records).
[2025-10-24T18:42:47.256566] [DEBUG] [VALIDATOR ] FBK: Validating primary data.
[2025-10-24T18:42:47.352765] [INFO ] [REMOTE    ] FC: Fetching primary data for 2025-01.
[2025-10-24T18:42:47.635065] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present.
[2025-10-24T18:42:47.635162] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed.
[2025-10-24T18:42:47.635772] [INFO ] [MAIN      ] FBK: Fetched primary data is valid.
[2025-10-24T18:42:47.635837] [DEBUG] [LOCAL     ] FBK: Saving primary data.
[2025-10-24T18:42:47.636161] [FATAL] [LOCAL     ] FBK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:42:47.636241] [FATAL] [MAIN      ] FBK: Failed to save primary data.
[2025-10-24T18:42:47.636282] [WARN ] [MAIN      ] FBK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:42:47.636316] [INFO ] [LOCAL     ] FBK: Starting deletion of primary data.
[2025-10-24T18:42:47.636366] [DEBUG] [LOCAL     ] FBK: No primary data file found to delete.
[2025-10-24T18:42:47.636400] [INFO ] [LOCAL     ] FBK: Starting deletion of derivative data.
[2025-10-24T18:42:47.636535] [DEBUG] [LOCAL     ] FBK: Deleted derivative data file.
[2025-10-24T18:42:47.636604] [INFO ] [MAIN      ] Update Progress: 806/2366 symbols completed. FBK took 31.4s. Estimated remaining: 3h 18m 52s. Rate: 7.8 symbols/min
[2025-10-24T18:42:47.830696] [INFO ] [MAIN      ] FCF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:42:47.850068] [INFO ] [REMOTE    ] FBRT: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T18:42:47.891139] [DEBUG] [LOCAL     ] FCF: Loaded 39380 existing records from primary storage.
[2025-10-24T18:42:47.891404] [INFO ] [MAIN      ] FCF: Loaded 39380 existing records.
[2025-10-24T18:42:48.067937] [WARN ] [MAIN      ] FCF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:42:48.068154] [INFO ] [MAIN      ] FCF: Wiping existing primary data before full refresh.
[2025-10-24T18:42:48.068201] [INFO ] [LOCAL     ] FCF: Starting deletion of primary data.
[2025-10-24T18:42:48.068797] [DEBUG] [LOCAL     ] FCF: Deleted primary data file.
[2025-10-24T18:42:48.068860] [INFO ] [MAIN      ] FCF: Starting full primary refresh.
[2025-10-24T18:42:48.149877] [INFO ] [REMOTE    ] FBRT: Fetching primary data for 2025-09.
[2025-10-24T18:42:48.410183] [INFO ] [REMOTE    ] FC: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T18:42:48.453310] [INFO ] [REMOTE    ] FCF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:42:48.947690] [INFO ] [REMOTE    ] FBP: Fetching primary data for 2025-08.
[2025-10-24T18:42:49.531947] [INFO ] [REMOTE    ] FBRT: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T18:42:49.747717] [INFO ] [REMOTE    ] FBRT: Fetching primary data for 2025-10.
[2025-10-24T18:42:50.547716] [INFO ] [REMOTE    ] FC: Fetching primary data for 2025-02.
[2025-10-24T18:42:50.613170] [INFO ] [REMOTE    ] FBP: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T18:42:51.097558] [INFO ] [REMOTE    ] FBRT: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T18:42:51.105014] [INFO ] [REMOTE    ] FBRT: Full fetch complete (49546 records).
[2025-10-24T18:42:51.105198] [DEBUG] [VALIDATOR ] FBRT: Validating primary data.
[2025-10-24T18:42:51.357817] [INFO ] [REMOTE    ] FBP: Fetching primary data for 2025-09.
[2025-10-24T18:42:51.487894] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present.
[2025-10-24T18:42:51.487993] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed.
[2025-10-24T18:42:51.488761] [INFO ] [MAIN      ] FBRT: Fetched primary data is valid.
[2025-10-24T18:42:51.488837] [DEBUG] [LOCAL     ] FBRT: Saving primary data.
[2025-10-24T18:42:51.489355] [FATAL] [LOCAL     ] FBRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:42:51.489453] [FATAL] [MAIN      ] FBRT: Failed to save primary data.
[2025-10-24T18:42:51.489496] [WARN ] [MAIN      ] FBRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:42:51.489530] [INFO ] [LOCAL     ] FBRT: Starting deletion of primary data.
[2025-10-24T18:42:51.489580] [DEBUG] [LOCAL     ] FBRT: No primary data file found to delete.
[2025-10-24T18:42:51.489615] [INFO ] [LOCAL     ] FBRT: Starting deletion of derivative data.
[2025-10-24T18:42:51.489864] [DEBUG] [LOCAL     ] FBRT: Deleted derivative data file.
[2025-10-24T18:42:51.490382] [INFO ] [MAIN      ] Update Progress: 807/2366 symbols completed. FBRT took 24.6s. Estimated remaining: 3h 18m 37s. Rate: 7.8 symbols/min
[2025-10-24T18:42:51.597878] [INFO ] [REMOTE    ] FC: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T18:42:51.670718] [INFO ] [MAIN      ] FCN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:42:51.698829] [DEBUG] [LOCAL     ] FCN: Loaded 26198 existing records from primary storage.
[2025-10-24T18:42:51.699084] [INFO ] [MAIN      ] FCN: Loaded 26198 existing records.
[2025-10-24T18:42:51.873665] [WARN ] [MAIN      ] FCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:42:51.873836] [INFO ] [MAIN      ] FCN: Wiping existing primary data before full refresh.
[2025-10-24T18:42:51.873900] [INFO ] [LOCAL     ] FCN: Starting deletion of primary data.
[2025-10-24T18:42:51.874427] [DEBUG] [LOCAL     ] FCN: Deleted primary data file.
[2025-10-24T18:42:51.874484] [INFO ] [MAIN      ] FCN: Starting full primary refresh.
[2025-10-24T18:42:52.150818] [INFO ] [REMOTE    ] FCF: Fetching primary data for 2025-01.
[2025-10-24T18:42:52.229170] [INFO ] [REMOTE    ] FCN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:42:52.947721] [INFO ] [REMOTE    ] FCN: Fetching primary data for 2025-01.
[2025-10-24T18:42:53.070346] [INFO ] [REMOTE    ] FBP: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T18:42:53.747679] [INFO ] [REMOTE    ] FC: Fetching primary data for 2025-03.
[2025-10-24T18:42:53.778254] [INFO ] [REMOTE    ] FCF: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T18:42:54.187949] [INFO ] [REMOTE    ] FCN: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T18:42:54.547634] [INFO ] [REMOTE    ] FBP: Fetching primary data for 2025-10.
[2025-10-24T18:42:54.709360] [INFO ] [REMOTE    ] FC: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T18:42:55.347704] [INFO ] [REMOTE    ] FC: Fetching primary data for 2025-04.
[2025-10-24T18:42:55.737474] [INFO ] [REMOTE    ] FBP: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T18:42:55.745895] [INFO ] [REMOTE    ] FBP: Full fetch complete (66793 records).
[2025-10-24T18:42:55.746013] [DEBUG] [VALIDATOR ] FBP: Validating primary data.
[2025-10-24T18:42:56.142944] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present.
[2025-10-24T18:42:56.143033] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed.
[2025-10-24T18:42:56.143900] [INFO ] [MAIN      ] FBP: Fetched primary data is valid.
[2025-10-24T18:42:56.143964] [DEBUG] [LOCAL     ] FBP: Saving primary data.
[2025-10-24T18:42:56.144538] [FATAL] [LOCAL     ] FBP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:42:56.144627] [FATAL] [MAIN      ] FBP: Failed to save primary data.
[2025-10-24T18:42:56.144706] [WARN ] [MAIN      ] FBP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:42:56.144751] [INFO ] [LOCAL     ] FBP: Starting deletion of primary data.
[2025-10-24T18:42:56.144805] [DEBUG] [LOCAL     ] FBP: No primary data file found to delete.
[2025-10-24T18:42:56.144839] [INFO ] [LOCAL     ] FBP: Starting deletion of derivative data.
[2025-10-24T18:42:56.145023] [DEBUG] [LOCAL     ] FBP: Deleted derivative data file.
[2025-10-24T18:42:56.145359] [INFO ] [MAIN      ] Update Progress: 808/2366 symbols completed. FBP took 37.1s. Estimated remaining: 3h 18m 23s. Rate: 7.9 symbols/min
[2025-10-24T18:42:56.156837] [INFO ] [REMOTE    ] FCF: Fetching primary data for 2025-02.
[2025-10-24T18:42:56.321413] [INFO ] [MAIN      ] FCPT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:42:56.340956] [INFO ] [REMOTE    ] FC: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T18:42:56.384303] [DEBUG] [LOCAL     ] FCPT: Loaded 37208 existing records from primary storage.
[2025-10-24T18:42:56.384589] [INFO ] [MAIN      ] FCPT: Loaded 37208 existing records.
[2025-10-24T18:42:56.566757] [WARN ] [MAIN      ] FCPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:42:56.568152] [INFO ] [MAIN      ] FCPT: Wiping existing primary data before full refresh.
[2025-10-24T18:42:56.568214] [INFO ] [LOCAL     ] FCPT: Starting deletion of primary data.
[2025-10-24T18:42:56.569401] [DEBUG] [LOCAL     ] FCPT: Deleted primary data file.
[2025-10-24T18:42:56.569460] [INFO ] [MAIN      ] FCPT: Starting full primary refresh.
[2025-10-24T18:42:56.929020] [INFO ] [REMOTE    ] FCPT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:42:56.947599] [INFO ] [REMOTE    ] FCPT: Fetching primary data for 2025-01.
[2025-10-24T18:42:57.747685] [INFO ] [REMOTE    ] FC: Fetching primary data for 2025-05.
[2025-10-24T18:42:58.547680] [INFO ] [REMOTE    ] FCN: Fetching primary data for 2025-02.
[2025-10-24T18:42:58.613569] [INFO ] [REMOTE    ] FCF: Incremental fetch complete for 2025-02 (2.46 seconds).
[2025-10-24T18:42:58.682180] [INFO ] [REMOTE    ] FC: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T18:42:59.347610] [INFO ] [REMOTE    ] FC: Fetching primary data for 2025-06.
[2025-10-24T18:42:59.556272] [INFO ] [REMOTE    ] FCN: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T18:42:59.812997] [INFO ] [REMOTE    ] FCPT: Incremental fetch complete for 2025-01 (2.87 seconds).
[2025-10-24T18:43:00.100987] [INFO ] [REMOTE    ] FC: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T18:43:00.147610] [INFO ] [REMOTE    ] FC: Fetching primary data for 2025-07.
[2025-10-24T18:43:00.947709] [INFO ] [REMOTE    ] FCN: Fetching primary data for 2025-03.
[2025-10-24T18:43:01.706060] [INFO ] [REMOTE    ] FC: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T18:43:01.747717] [INFO ] [REMOTE    ] FC: Fetching primary data for 2025-08.
[2025-10-24T18:43:02.547700] [INFO ] [REMOTE    ] FCF: Fetching primary data for 2025-03.
[2025-10-24T18:43:02.737505] [INFO ] [REMOTE    ] FCN: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T18:43:03.347724] [INFO ] [REMOTE    ] FCPT: Fetching primary data for 2025-02.
[2025-10-24T18:43:03.658625] [INFO ] [REMOTE    ] FC: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T18:43:04.147728] [INFO ] [REMOTE    ] FC: Fetching primary data for 2025-09.
[2025-10-24T18:43:04.895735] [INFO ] [REMOTE    ] FCPT: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T18:43:04.948516] [INFO ] [REMOTE    ] FCPT: Fetching primary data for 2025-03.
[2025-10-24T18:43:04.950013] [INFO ] [REMOTE    ] FCF: Incremental fetch complete for 2025-03 (2.40 seconds).
[2025-10-24T18:43:05.345685] [INFO ] [REMOTE    ] FC: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T18:43:05.747715] [INFO ] [REMOTE    ] FC: Fetching primary data for 2025-10.
[2025-10-24T18:43:06.517413] [INFO ] [REMOTE    ] FCPT: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T18:43:06.547598] [INFO ] [REMOTE    ] FCPT: Fetching primary data for 2025-04.
[2025-10-24T18:43:06.738102] [INFO ] [REMOTE    ] FC: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T18:43:06.740884] [INFO ] [REMOTE    ] FC: Full fetch complete (21903 records).
[2025-10-24T18:43:06.740954] [DEBUG] [VALIDATOR ] FC: Validating primary data.
[2025-10-24T18:43:07.129067] [DEBUG] [VALIDATOR ] FC: All expected trading days are present.
[2025-10-24T18:43:07.129141] [DEBUG] [VALIDATOR ] FC: Primary data validation passed.
[2025-10-24T18:43:07.129581] [INFO ] [MAIN      ] FC: Fetched primary data is valid.
[2025-10-24T18:43:07.129619] [DEBUG] [LOCAL     ] FC: Saving primary data.
[2025-10-24T18:43:07.129942] [FATAL] [LOCAL     ] FC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:43:07.130024] [FATAL] [MAIN      ] FC: Failed to save primary data.
[2025-10-24T18:43:07.130079] [WARN ] [MAIN      ] FC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:43:07.130161] [INFO ] [LOCAL     ] FC: Starting deletion of primary data.
[2025-10-24T18:43:07.130235] [DEBUG] [LOCAL     ] FC: No primary data file found to delete.
[2025-10-24T18:43:07.130282] [INFO ] [LOCAL     ] FC: Starting deletion of derivative data.
[2025-10-24T18:43:07.130441] [DEBUG] [LOCAL     ] FC: Deleted derivative data file.
[2025-10-24T18:43:07.130534] [INFO ] [MAIN      ] Update Progress: 809/2366 symbols completed. FC took 21.7s. Estimated remaining: 3h 18m 22s. Rate: 7.8 symbols/min
[2025-10-24T18:43:07.308316] [INFO ] [MAIN      ] FCRX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:43:07.308468] [DEBUG] [LOCAL     ] FCRX: No existing data file found in primary storage.
[2025-10-24T18:43:07.308505] [WARN ] [MAIN      ] FCRX: No existing data found, performing full refresh instead.
[2025-10-24T18:43:07.308608] [INFO ] [MAIN      ] FCRX: Wiping existing primary data before full refresh.
[2025-10-24T18:43:07.308677] [INFO ] [LOCAL     ] FCRX: Starting deletion of primary data.
[2025-10-24T18:43:07.308774] [DEBUG] [LOCAL     ] FCRX: No primary data file found to delete.
[2025-10-24T18:43:07.308814] [INFO ] [MAIN      ] FCRX: Starting full primary refresh.
[2025-10-24T18:43:07.352756] [INFO ] [REMOTE    ] FCF: Fetching primary data for 2025-04.
[2025-10-24T18:43:07.671798] [INFO ] [REMOTE    ] FCRX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:43:07.791708] [INFO ] [REMOTE    ] FCPT: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T18:43:08.147710] [INFO ] [REMOTE    ] FCRX: Fetching primary data for 2025-01.
[2025-10-24T18:43:08.715729] [INFO ] [REMOTE    ] FCRX: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T18:43:08.870355] [INFO ] [REMOTE    ] FCF: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T18:43:08.947627] [INFO ] [REMOTE    ] FCPT: Fetching primary data for 2025-05.
[2025-10-24T18:43:09.747687] [INFO ] [REMOTE    ] FCRX: Fetching primary data for 2025-02.
[2025-10-24T18:43:10.155246] [INFO ] [REMOTE    ] FCRX: Incremental fetch complete for 2025-02 (0.41 seconds).
[2025-10-24T18:43:10.370896] [INFO ] [REMOTE    ] FCPT: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T18:43:10.547691] [INFO ] [REMOTE    ] FCN: Fetching primary data for 2025-04.
[2025-10-24T18:43:11.347757] [INFO ] [REMOTE    ] FCF: Fetching primary data for 2025-05.
[2025-10-24T18:43:12.046081] [INFO ] [REMOTE    ] FCN: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T18:43:12.147628] [INFO ] [REMOTE    ] FCN: Fetching primary data for 2025-05.
[2025-10-24T18:43:12.947671] [INFO ] [REMOTE    ] FCPT: Fetching primary data for 2025-06.
[2025-10-24T18:43:13.437996] [INFO ] [REMOTE    ] FCN: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T18:43:13.453383] [INFO ] [REMOTE    ] FCF: Incremental fetch complete for 2025-05 (2.11 seconds).
[2025-10-24T18:43:13.747640] [INFO ] [REMOTE    ] FCRX: Fetching primary data for 2025-03.
[2025-10-24T18:43:14.141864] [INFO ] [REMOTE    ] FCRX: Incremental fetch complete for 2025-03 (0.39 seconds).
[2025-10-24T18:43:14.547639] [INFO ] [REMOTE    ] FCRX: Fetching primary data for 2025-04.
[2025-10-24T18:43:14.726371] [INFO ] [REMOTE    ] FCPT: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T18:43:14.895699] [INFO ] [REMOTE    ] FCRX: Incremental fetch complete for 2025-04 (0.35 seconds).
[2025-10-24T18:43:15.347701] [INFO ] [REMOTE    ] FCRX: Fetching primary data for 2025-05.
[2025-10-24T18:43:15.677849] [INFO ] [REMOTE    ] FCRX: Incremental fetch complete for 2025-05 (0.33 seconds).
[2025-10-24T18:43:16.147638] [INFO ] [REMOTE    ] FCF: Fetching primary data for 2025-06.
[2025-10-24T18:43:16.947672] [INFO ] [REMOTE    ] FCN: Fetching primary data for 2025-06.
[2025-10-24T18:43:17.563440] [INFO ] [REMOTE    ] FCF: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T18:43:17.747688] [INFO ] [REMOTE    ] FCF: Fetching primary data for 2025-07.
[2025-10-24T18:43:18.015015] [INFO ] [REMOTE    ] FCN: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T18:43:18.547675] [INFO ] [REMOTE    ] FCRX: Fetching primary data for 2025-06.
[2025-10-24T18:43:19.094597] [INFO ] [REMOTE    ] FCRX: Incremental fetch complete for 2025-06 (0.55 seconds).
[2025-10-24T18:43:19.347628] [INFO ] [REMOTE    ] FCN: Fetching primary data for 2025-07.
[2025-10-24T18:43:19.989440] [INFO ] [REMOTE    ] FCF: Incremental fetch complete for 2025-07 (2.24 seconds).
[2025-10-24T18:43:20.147624] [INFO ] [REMOTE    ] FCRX: Fetching primary data for 2025-07.
[2025-10-24T18:43:20.493002] [INFO ] [REMOTE    ] FCRX: Incremental fetch complete for 2025-07 (0.35 seconds).
[2025-10-24T18:43:20.540398] [INFO ] [REMOTE    ] FCN: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T18:43:20.947684] [INFO ] [REMOTE    ] FCN: Fetching primary data for 2025-08.
[2025-10-24T18:43:21.747627] [INFO ] [REMOTE    ] FCRX: Fetching primary data for 2025-08.
[2025-10-24T18:43:22.068888] [INFO ] [REMOTE    ] FCRX: Incremental fetch complete for 2025-08 (0.32 seconds).
[2025-10-24T18:43:22.125586] [INFO ] [REMOTE    ] FCN: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T18:43:22.547670] [INFO ] [REMOTE    ] FCRX: Fetching primary data for 2025-09.
[2025-10-24T18:43:22.972785] [INFO ] [REMOTE    ] FCRX: Incremental fetch complete for 2025-09 (0.43 seconds).
[2025-10-24T18:43:23.347688] [INFO ] [REMOTE    ] FCPT: Fetching primary data for 2025-07.
[2025-10-24T18:43:24.147623] [INFO ] [REMOTE    ] FCRX: Fetching primary data for 2025-10.
[2025-10-24T18:43:24.947701] [INFO ] [REMOTE    ] FCF: Fetching primary data for 2025-08.
[2025-10-24T18:43:25.426219] [INFO ] [REMOTE    ] FCRX: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T18:43:25.428046] [INFO ] [REMOTE    ] FCPT: Incremental fetch complete for 2025-07 (2.08 seconds).
[2025-10-24T18:43:25.428898] [INFO ] [REMOTE    ] FCRX: Full fetch complete (1626 records).
[2025-10-24T18:43:25.429208] [DEBUG] [VALIDATOR ] FCRX: Validating primary data.
[2025-10-24T18:43:25.437923] [FATAL] [VALIDATOR ] FCRX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:43:25.438195] [FATAL] [MAIN      ] FCRX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:43:25.438535] [WARN ] [MAIN      ] FCRX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:43:25.438630] [INFO ] [LOCAL     ] FCRX: Starting deletion of primary data.
[2025-10-24T18:43:25.438754] [DEBUG] [LOCAL     ] FCRX: No primary data file found to delete.
[2025-10-24T18:43:25.438816] [INFO ] [LOCAL     ] FCRX: Starting deletion of derivative data.
[2025-10-24T18:43:25.438886] [DEBUG] [LOCAL     ] FCRX: No derivative data file found to delete.
[2025-10-24T18:43:25.438985] [INFO ] [MAIN      ] Update Progress: 810/2366 symbols completed. FCRX took 18.3s. Estimated remaining: 3h 18m 35s. Rate: 7.8 symbols/min
[2025-10-24T18:43:25.621940] [INFO ] [MAIN      ] FCT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:43:25.638083] [DEBUG] [LOCAL     ] FCT: Loaded 14945 existing records from primary storage.
[2025-10-24T18:43:25.638321] [INFO ] [MAIN      ] FCT: Loaded 14945 existing records.
[2025-10-24T18:43:25.752708] [INFO ] [REMOTE    ] FCPT: Fetching primary data for 2025-08.
[2025-10-24T18:43:25.816480] [WARN ] [MAIN      ] FCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:43:25.816682] [INFO ] [MAIN      ] FCT: Wiping existing primary data before full refresh.
[2025-10-24T18:43:25.816738] [INFO ] [LOCAL     ] FCT: Starting deletion of primary data.
[2025-10-24T18:43:25.817049] [DEBUG] [LOCAL     ] FCT: Deleted primary data file.
[2025-10-24T18:43:25.817104] [INFO ] [MAIN      ] FCT: Starting full primary refresh.
[2025-10-24T18:43:26.170243] [INFO ] [REMOTE    ] FCT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:43:26.214593] [INFO ] [REMOTE    ] FCF: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T18:43:26.547698] [INFO ] [REMOTE    ] FCT: Fetching primary data for 2025-01.
[2025-10-24T18:43:27.347617] [INFO ] [REMOTE    ] FCN: Fetching primary data for 2025-09.
[2025-10-24T18:43:27.431850] [INFO ] [REMOTE    ] FCPT: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T18:43:27.850964] [INFO ] [REMOTE    ] FCT: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T18:43:28.147688] [INFO ] [REMOTE    ] FCF: Fetching primary data for 2025-09.
[2025-10-24T18:43:28.297955] [INFO ] [REMOTE    ] FCN: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T18:43:28.947667] [INFO ] [REMOTE    ] FCPT: Fetching primary data for 2025-09.
[2025-10-24T18:43:29.554870] [INFO ] [REMOTE    ] FCF: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T18:43:29.747720] [INFO ] [REMOTE    ] FCT: Fetching primary data for 2025-02.
[2025-10-24T18:43:30.380418] [INFO ] [REMOTE    ] FCPT: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T18:43:30.507156] [INFO ] [REMOTE    ] FCT: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T18:43:30.547610] [INFO ] [REMOTE    ] FCT: Fetching primary data for 2025-03.
[2025-10-24T18:43:31.347719] [INFO ] [REMOTE    ] FCN: Fetching primary data for 2025-10.
[2025-10-24T18:43:31.425161] [INFO ] [REMOTE    ] FCT: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T18:43:32.147701] [INFO ] [REMOTE    ] FCT: Fetching primary data for 2025-04.
[2025-10-24T18:43:32.685108] [INFO ] [REMOTE    ] FCN: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T18:43:32.689965] [INFO ] [REMOTE    ] FCN: Full fetch complete (36392 records).
[2025-10-24T18:43:32.690047] [DEBUG] [VALIDATOR ] FCN: Validating primary data.
[2025-10-24T18:43:32.690568] [FATAL] [VALIDATOR ] FCN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:43:32.690682] [FATAL] [MAIN      ] FCN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:43:32.690736] [WARN ] [MAIN      ] FCN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:43:32.690807] [INFO ] [LOCAL     ] FCN: Starting deletion of primary data.
[2025-10-24T18:43:32.690867] [DEBUG] [LOCAL     ] FCN: No primary data file found to delete.
[2025-10-24T18:43:32.690907] [INFO ] [LOCAL     ] FCN: Starting deletion of derivative data.
[2025-10-24T18:43:32.691044] [DEBUG] [LOCAL     ] FCN: Deleted derivative data file.
[2025-10-24T18:43:32.691108] [INFO ] [MAIN      ] Update Progress: 811/2366 symbols completed. FCN took 41.2s. Estimated remaining: 3h 18m 27s. Rate: 7.8 symbols/min
[2025-10-24T18:43:32.859092] [INFO ] [MAIN      ] FCX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:43:32.908838] [DEBUG] [LOCAL     ] FCX: Loaded 54091 existing records from primary storage.
[2025-10-24T18:43:32.909156] [INFO ] [MAIN      ] FCX: Loaded 54091 existing records.
[2025-10-24T18:43:32.952229] [INFO ] [REMOTE    ] FCPT: Fetching primary data for 2025-10.
[2025-10-24T18:43:33.097367] [WARN ] [MAIN      ] FCX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:43:33.097602] [INFO ] [MAIN      ] FCX: Wiping existing primary data before full refresh.
[2025-10-24T18:43:33.097674] [INFO ] [LOCAL     ] FCX: Starting deletion of primary data.
[2025-10-24T18:43:33.098741] [DEBUG] [LOCAL     ] FCX: Deleted primary data file.
[2025-10-24T18:43:33.098798] [INFO ] [MAIN      ] FCX: Starting full primary refresh.
[2025-10-24T18:43:33.231682] [INFO ] [REMOTE    ] FCT: Incremental fetch complete for 2025-04 (1.08 seconds).
[2025-10-24T18:43:33.502951] [INFO ] [REMOTE    ] FCX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:43:33.747693] [INFO ] [REMOTE    ] FCF: Fetching primary data for 2025-10.
[2025-10-24T18:43:34.552748] [INFO ] [REMOTE    ] FCT: Fetching primary data for 2025-05.
[2025-10-24T18:43:34.565222] [INFO ] [REMOTE    ] FCPT: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T18:43:34.572887] [INFO ] [REMOTE    ] FCPT: Full fetch complete (53768 records).
[2025-10-24T18:43:34.573007] [DEBUG] [VALIDATOR ] FCPT: Validating primary data.
[2025-10-24T18:43:34.994680] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present.
[2025-10-24T18:43:34.994783] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed.
[2025-10-24T18:43:34.995624] [INFO ] [MAIN      ] FCPT: Fetched primary data is valid.
[2025-10-24T18:43:34.995726] [DEBUG] [LOCAL     ] FCPT: Saving primary data.
[2025-10-24T18:43:34.996336] [FATAL] [LOCAL     ] FCPT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:43:34.996437] [FATAL] [MAIN      ] FCPT: Failed to save primary data.
[2025-10-24T18:43:34.996492] [WARN ] [MAIN      ] FCPT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:43:34.996698] [INFO ] [LOCAL     ] FCPT: Starting deletion of primary data.
[2025-10-24T18:43:34.996801] [DEBUG] [LOCAL     ] FCPT: No primary data file found to delete.
[2025-10-24T18:43:34.996920] [INFO ] [LOCAL     ] FCPT: Starting deletion of derivative data.
[2025-10-24T18:43:34.997186] [DEBUG] [LOCAL     ] FCPT: Deleted derivative data file.
[2025-10-24T18:43:34.997287] [INFO ] [MAIN      ] Update Progress: 812/2366 symbols completed. FCPT took 38.9s. Estimated remaining: 3h 18m 9s. Rate: 7.8 symbols/min
[2025-10-24T18:43:35.179536] [INFO ] [MAIN      ] FDP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:43:35.208483] [DEBUG] [LOCAL     ] FDP: Loaded 29865 existing records from primary storage.
[2025-10-24T18:43:35.208775] [INFO ] [MAIN      ] FDP: Loaded 29865 existing records.
[2025-10-24T18:43:35.356348] [INFO ] [REMOTE    ] FCX: Fetching primary data for 2025-01.
[2025-10-24T18:43:35.407077] [WARN ] [MAIN      ] FDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:43:35.408421] [INFO ] [REMOTE    ] FCT: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T18:43:35.430419] [INFO ] [MAIN      ] FDP: Wiping existing primary data before full refresh.
[2025-10-24T18:43:35.431254] [INFO ] [LOCAL     ] FDP: Starting deletion of primary data.
[2025-10-24T18:43:35.432935] [INFO ] [REMOTE    ] FCF: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T18:43:35.439794] [DEBUG] [LOCAL     ] FDP: Deleted primary data file.
[2025-10-24T18:43:35.439944] [INFO ] [MAIN      ] FDP: Starting full primary refresh.
[2025-10-24T18:43:35.503835] [INFO ] [REMOTE    ] FCF: Full fetch complete (58084 records).
[2025-10-24T18:43:35.515353] [DEBUG] [VALIDATOR ] FCF: Validating primary data.
[2025-10-24T18:43:36.120891] [INFO ] [REMOTE    ] FDP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:43:36.148675] [INFO ] [REMOTE    ] FDP: Fetching primary data for 2025-01.
[2025-10-24T18:43:36.197292] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present.
[2025-10-24T18:43:36.197375] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed.
[2025-10-24T18:43:36.198228] [INFO ] [MAIN      ] FCF: Fetched primary data is valid.
[2025-10-24T18:43:36.198290] [DEBUG] [LOCAL     ] FCF: Saving primary data.
[2025-10-24T18:43:36.198790] [FATAL] [LOCAL     ] FCF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:43:36.198885] [FATAL] [MAIN      ] FCF: Failed to save primary data.
[2025-10-24T18:43:36.198927] [WARN ] [MAIN      ] FCF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:43:36.198961] [INFO ] [LOCAL     ] FCF: Starting deletion of primary data.
[2025-10-24T18:43:36.199011] [DEBUG] [LOCAL     ] FCF: No primary data file found to delete.
[2025-10-24T18:43:36.199045] [INFO ] [LOCAL     ] FCF: Starting deletion of derivative data.
[2025-10-24T18:43:36.199188] [DEBUG] [LOCAL     ] FCF: Deleted derivative data file.
[2025-10-24T18:43:36.199293] [INFO ] [MAIN      ] Update Progress: 813/2366 symbols completed. FCF took 48.6s. Estimated remaining: 3h 17m 49s. Rate: 7.9 symbols/min
[2025-10-24T18:43:36.364370] [INFO ] [MAIN      ] FDS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:43:36.390487] [DEBUG] [LOCAL     ] FDS: Loaded 28305 existing records from primary storage.
[2025-10-24T18:43:36.390794] [INFO ] [MAIN      ] FDS: Loaded 28305 existing records.
[2025-10-24T18:43:36.562982] [WARN ] [MAIN      ] FDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:43:36.563213] [INFO ] [MAIN      ] FDS: Wiping existing primary data before full refresh.
[2025-10-24T18:43:36.563260] [INFO ] [LOCAL     ] FDS: Starting deletion of primary data.
[2025-10-24T18:43:36.563996] [DEBUG] [LOCAL     ] FDS: Deleted primary data file.
[2025-10-24T18:43:36.564052] [INFO ] [MAIN      ] FDS: Starting full primary refresh.
[2025-10-24T18:43:36.911282] [INFO ] [REMOTE    ] FDS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:43:36.947600] [INFO ] [REMOTE    ] FDS: Fetching primary data for 2025-01.
[2025-10-24T18:43:37.268937] [INFO ] [REMOTE    ] FDP: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T18:43:37.562779] [INFO ] [REMOTE    ] FCX: Incremental fetch complete for 2025-01 (2.21 seconds).
[2025-10-24T18:43:37.747639] [INFO ] [REMOTE    ] FCX: Fetching primary data for 2025-02.
[2025-10-24T18:43:38.078784] [INFO ] [REMOTE    ] FDS: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T18:43:38.547679] [INFO ] [REMOTE    ] FCT: Fetching primary data for 2025-06.
[2025-10-24T18:43:39.347614] [INFO ] [REMOTE    ] FDP: Fetching primary data for 2025-02.
[2025-10-24T18:43:39.506225] [INFO ] [REMOTE    ] FCT: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T18:43:39.540299] [INFO ] [REMOTE    ] FCX: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T18:43:40.147614] [INFO ] [REMOTE    ] FCT: Fetching primary data for 2025-07.
[2025-10-24T18:43:40.478680] [INFO ] [REMOTE    ] FDP: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T18:43:40.831674] [INFO ] [REMOTE    ] FCT: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T18:43:40.947634] [INFO ] [REMOTE    ] FCT: Fetching primary data for 2025-08.
[2025-10-24T18:43:41.747680] [INFO ] [REMOTE    ] FCX: Fetching primary data for 2025-03.
[2025-10-24T18:43:41.798932] [INFO ] [REMOTE    ] FCT: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T18:43:42.547730] [INFO ] [REMOTE    ] FCT: Fetching primary data for 2025-09.
[2025-10-24T18:43:43.347619] [INFO ] [REMOTE    ] FDS: Fetching primary data for 2025-02.
[2025-10-24T18:43:43.505905] [INFO ] [REMOTE    ] FCT: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T18:43:43.939995] [INFO ] [REMOTE    ] FCX: Incremental fetch complete for 2025-03 (2.19 seconds).
[2025-10-24T18:43:44.147698] [INFO ] [REMOTE    ] FDP: Fetching primary data for 2025-03.
[2025-10-24T18:43:44.320387] [INFO ] [REMOTE    ] FDS: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T18:43:44.947685] [INFO ] [REMOTE    ] FCT: Fetching primary data for 2025-10.
[2025-10-24T18:43:45.516717] [INFO ] [REMOTE    ] FDP: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T18:43:45.747620] [INFO ] [REMOTE    ] FDS: Fetching primary data for 2025-03.
[2025-10-24T18:43:46.051474] [INFO ] [REMOTE    ] FCT: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T18:43:46.055223] [INFO ] [REMOTE    ] FCT: Full fetch complete (21482 records).
[2025-10-24T18:43:46.055298] [DEBUG] [VALIDATOR ] FCT: Validating primary data.
[2025-10-24T18:43:46.416322] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present.
[2025-10-24T18:43:46.416393] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed.
[2025-10-24T18:43:46.416838] [INFO ] [MAIN      ] FCT: Fetched primary data is valid.
[2025-10-24T18:43:46.416898] [DEBUG] [LOCAL     ] FCT: Saving primary data.
[2025-10-24T18:43:46.417179] [FATAL] [LOCAL     ] FCT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:43:46.417283] [FATAL] [MAIN      ] FCT: Failed to save primary data.
[2025-10-24T18:43:46.417351] [WARN ] [MAIN      ] FCT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:43:46.417439] [INFO ] [LOCAL     ] FCT: Starting deletion of primary data.
[2025-10-24T18:43:46.417511] [DEBUG] [LOCAL     ] FCT: No primary data file found to delete.
[2025-10-24T18:43:46.417548] [INFO ] [LOCAL     ] FCT: Starting deletion of derivative data.
[2025-10-24T18:43:46.417721] [DEBUG] [LOCAL     ] FCT: Deleted derivative data file.
[2025-10-24T18:43:46.417852] [INFO ] [MAIN      ] Update Progress: 814/2366 symbols completed. FCT took 21.0s. Estimated remaining: 3h 17m 46s. Rate: 7.8 symbols/min
[2025-10-24T18:43:46.552724] [INFO ] [REMOTE    ] FCX: Fetching primary data for 2025-04.
[2025-10-24T18:43:46.599994] [INFO ] [MAIN      ] FDX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:43:46.652388] [DEBUG] [LOCAL     ] FDX: Loaded 51522 existing records from primary storage.
[2025-10-24T18:43:46.652774] [INFO ] [MAIN      ] FDX: Loaded 51522 existing records.
[2025-10-24T18:43:46.827957] [WARN ] [MAIN      ] FDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:43:46.828237] [INFO ] [MAIN      ] FDX: Wiping existing primary data before full refresh.
[2025-10-24T18:43:46.828356] [INFO ] [LOCAL     ] FDX: Starting deletion of primary data.
[2025-10-24T18:43:46.828844] [DEBUG] [LOCAL     ] FDX: Deleted primary data file.
[2025-10-24T18:43:46.828900] [INFO ] [MAIN      ] FDX: Starting full primary refresh.
[2025-10-24T18:43:47.088195] [INFO ] [REMOTE    ] FDS: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T18:43:47.207568] [INFO ] [REMOTE    ] FDX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:43:47.347618] [INFO ] [REMOTE    ] FDX: Fetching primary data for 2025-01.
[2025-10-24T18:43:48.147617] [INFO ] [REMOTE    ] FDP: Fetching primary data for 2025-04.
[2025-10-24T18:43:48.637319] [INFO ] [REMOTE    ] FCX: Incremental fetch complete for 2025-04 (2.08 seconds).
[2025-10-24T18:43:48.947685] [INFO ] [REMOTE    ] FCX: Fetching primary data for 2025-05.
[2025-10-24T18:43:49.157036] [INFO ] [REMOTE    ] FDX: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T18:43:49.711210] [INFO ] [REMOTE    ] FDP: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T18:43:49.747717] [INFO ] [REMOTE    ] FDX: Fetching primary data for 2025-02.
[2025-10-24T18:43:50.547717] [INFO ] [REMOTE    ] FDP: Fetching primary data for 2025-05.
[2025-10-24T18:43:50.986149] [INFO ] [REMOTE    ] FCX: Incremental fetch complete for 2025-05 (2.04 seconds).
[2025-10-24T18:43:51.354279] [INFO ] [REMOTE    ] FCX: Fetching primary data for 2025-06.
[2025-10-24T18:43:51.374886] [INFO ] [REMOTE    ] FDX: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T18:43:51.894489] [INFO ] [REMOTE    ] FDP: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T18:43:52.147736] [INFO ] [REMOTE    ] FDX: Fetching primary data for 2025-03.
[2025-10-24T18:43:52.947723] [INFO ] [REMOTE    ] FDP: Fetching primary data for 2025-06.
[2025-10-24T18:43:53.317170] [INFO ] [REMOTE    ] FCX: Incremental fetch complete for 2025-06 (1.96 seconds).
[2025-10-24T18:43:53.747632] [INFO ] [REMOTE    ] FDS: Fetching primary data for 2025-04.
[2025-10-24T18:43:54.248165] [INFO ] [REMOTE    ] FDP: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T18:43:54.283275] [INFO ] [REMOTE    ] FDX: Incremental fetch complete for 2025-03 (2.14 seconds).
[2025-10-24T18:43:54.547608] [INFO ] [REMOTE    ] FDP: Fetching primary data for 2025-07.
[2025-10-24T18:43:54.902507] [INFO ] [REMOTE    ] FDS: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T18:43:55.347683] [INFO ] [REMOTE    ] FCX: Fetching primary data for 2025-07.
[2025-10-24T18:43:55.895932] [INFO ] [REMOTE    ] FDP: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T18:43:56.147692] [INFO ] [REMOTE    ] FDX: Fetching primary data for 2025-04.
[2025-10-24T18:43:56.947811] [INFO ] [REMOTE    ] FDS: Fetching primary data for 2025-05.
[2025-10-24T18:43:57.403088] [INFO ] [REMOTE    ] FCX: Incremental fetch complete for 2025-07 (2.06 seconds).
[2025-10-24T18:43:57.747623] [INFO ] [REMOTE    ] FCX: Fetching primary data for 2025-08.
[2025-10-24T18:43:58.069937] [INFO ] [REMOTE    ] FDS: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T18:43:58.130375] [INFO ] [REMOTE    ] FDX: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T18:43:58.547724] [INFO ] [REMOTE    ] FDX: Fetching primary data for 2025-05.
[2025-10-24T18:43:59.347624] [INFO ] [REMOTE    ] FDS: Fetching primary data for 2025-06.
[2025-10-24T18:43:59.823735] [INFO ] [REMOTE    ] FCX: Incremental fetch complete for 2025-08 (2.08 seconds).
[2025-10-24T18:44:00.117443] [INFO ] [REMOTE    ] FDS: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T18:44:00.147616] [INFO ] [REMOTE    ] FDS: Fetching primary data for 2025-07.
[2025-10-24T18:44:00.519030] [INFO ] [REMOTE    ] FDX: Incremental fetch complete for 2025-05 (1.97 seconds).
[2025-10-24T18:44:00.947728] [INFO ] [REMOTE    ] FCX: Fetching primary data for 2025-09.
[2025-10-24T18:44:01.747691] [INFO ] [REMOTE    ] FDP: Fetching primary data for 2025-08.
[2025-10-24T18:44:01.780192] [INFO ] [REMOTE    ] FDS: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T18:44:02.547742] [INFO ] [REMOTE    ] FDS: Fetching primary data for 2025-08.
[2025-10-24T18:44:03.347671] [INFO ] [REMOTE    ] FDX: Fetching primary data for 2025-06.
[2025-10-24T18:44:04.461550] [INFO ] [REMOTE    ] FDP: Incremental fetch complete for 2025-08 (2.71 seconds).
[2025-10-24T18:44:04.468376] [INFO ] [REMOTE    ] FDP: Fetching primary data for 2025-09.
[2025-10-24T18:44:04.533912] [INFO ] [REMOTE    ] FDS: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T18:44:04.947725] [INFO ] [REMOTE    ] FDS: Fetching primary data for 2025-09.
[2025-10-24T18:44:05.504892] [INFO ] [REMOTE    ] FCX: Incremental fetch complete for 2025-09 (4.56 seconds).
[2025-10-24T18:44:05.659880] [INFO ] [REMOTE    ] FDP: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T18:44:05.747603] [INFO ] [REMOTE    ] FDP: Fetching primary data for 2025-10.
[2025-10-24T18:44:06.507181] [INFO ] [REMOTE    ] FDX: Incremental fetch complete for 2025-06 (3.16 seconds).
[2025-10-24T18:44:06.547602] [INFO ] [REMOTE    ] FDX: Fetching primary data for 2025-07.
[2025-10-24T18:44:06.876256] [INFO ] [REMOTE    ] FDS: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T18:44:07.254793] [INFO ] [REMOTE    ] FDP: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T18:44:07.260104] [INFO ] [REMOTE    ] FDP: Full fetch complete (42864 records).
[2025-10-24T18:44:07.260260] [DEBUG] [VALIDATOR ] FDP: Validating primary data.
[2025-10-24T18:44:07.356730] [INFO ] [REMOTE    ] FDS: Fetching primary data for 2025-10.
[2025-10-24T18:44:07.628765] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present.
[2025-10-24T18:44:07.628844] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed.
[2025-10-24T18:44:07.629482] [INFO ] [MAIN      ] FDP: Fetched primary data is valid.
[2025-10-24T18:44:07.629523] [DEBUG] [LOCAL     ] FDP: Saving primary data.
[2025-10-24T18:44:07.629921] [FATAL] [LOCAL     ] FDP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:44:07.630022] [FATAL] [MAIN      ] FDP: Failed to save primary data.
[2025-10-24T18:44:07.630094] [WARN ] [MAIN      ] FDP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:44:07.630191] [INFO ] [LOCAL     ] FDP: Starting deletion of primary data.
[2025-10-24T18:44:07.630274] [DEBUG] [LOCAL     ] FDP: No primary data file found to delete.
[2025-10-24T18:44:07.630314] [INFO ] [LOCAL     ] FDP: Starting deletion of derivative data.
[2025-10-24T18:44:07.630454] [DEBUG] [LOCAL     ] FDP: Deleted derivative data file.
[2025-10-24T18:44:07.630533] [INFO ] [MAIN      ] Update Progress: 815/2366 symbols completed. FDP took 32.6s. Estimated remaining: 3h 18m 4s. Rate: 7.8 symbols/min
[2025-10-24T18:44:07.794145] [INFO ] [MAIN      ] FE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:44:07.842772] [DEBUG] [LOCAL     ] FE: Loaded 53821 existing records from primary storage.
[2025-10-24T18:44:07.843071] [INFO ] [MAIN      ] FE: Loaded 53821 existing records.
[2025-10-24T18:44:08.016286] [WARN ] [MAIN      ] FE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:44:08.016533] [INFO ] [MAIN      ] FE: Wiping existing primary data before full refresh.
[2025-10-24T18:44:08.016588] [INFO ] [LOCAL     ] FE: Starting deletion of primary data.
[2025-10-24T18:44:08.016883] [DEBUG] [LOCAL     ] FE: Deleted primary data file.
[2025-10-24T18:44:08.016940] [INFO ] [MAIN      ] FE: Starting full primary refresh.
[2025-10-24T18:44:08.152872] [INFO ] [REMOTE    ] FCX: Fetching primary data for 2025-10.
[2025-10-24T18:44:08.399158] [INFO ] [REMOTE    ] FE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:44:08.545783] [INFO ] [REMOTE    ] FDX: Incremental fetch complete for 2025-07 (2.00 seconds).
[2025-10-24T18:44:08.947724] [INFO ] [REMOTE    ] FE: Fetching primary data for 2025-01.
[2025-10-24T18:44:09.095015] [INFO ] [REMOTE    ] FDS: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T18:44:09.102598] [INFO ] [REMOTE    ] FDS: Full fetch complete (39633 records).
[2025-10-24T18:44:09.102746] [DEBUG] [VALIDATOR ] FDS: Validating primary data.
[2025-10-24T18:44:09.497428] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present.
[2025-10-24T18:44:09.497506] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed.
[2025-10-24T18:44:09.498130] [INFO ] [MAIN      ] FDS: Fetched primary data is valid.
[2025-10-24T18:44:09.498192] [DEBUG] [LOCAL     ] FDS: Saving primary data.
[2025-10-24T18:44:09.498597] [FATAL] [LOCAL     ] FDS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:44:09.498698] [FATAL] [MAIN      ] FDS: Failed to save primary data.
[2025-10-24T18:44:09.498745] [WARN ] [MAIN      ] FDS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:44:09.498812] [INFO ] [LOCAL     ] FDS: Starting deletion of primary data.
[2025-10-24T18:44:09.498873] [DEBUG] [LOCAL     ] FDS: No primary data file found to delete.
[2025-10-24T18:44:09.498909] [INFO ] [LOCAL     ] FDS: Starting deletion of derivative data.
[2025-10-24T18:44:09.499078] [DEBUG] [LOCAL     ] FDS: Deleted derivative data file.
[2025-10-24T18:44:09.499172] [INFO ] [MAIN      ] Update Progress: 816/2366 symbols completed. FDS took 33.3s. Estimated remaining: 3h 17m 45s. Rate: 7.8 symbols/min
[2025-10-24T18:44:09.666118] [INFO ] [MAIN      ] FENG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:44:09.666306] [DEBUG] [LOCAL     ] FENG: No existing data file found in primary storage.
[2025-10-24T18:44:09.666359] [WARN ] [MAIN      ] FENG: No existing data found, performing full refresh instead.
[2025-10-24T18:44:09.666475] [INFO ] [MAIN      ] FENG: Wiping existing primary data before full refresh.
[2025-10-24T18:44:09.666516] [INFO ] [LOCAL     ] FENG: Starting deletion of primary data.
[2025-10-24T18:44:09.666562] [DEBUG] [LOCAL     ] FENG: No primary data file found to delete.
[2025-10-24T18:44:09.666593] [INFO ] [MAIN      ] FENG: Starting full primary refresh.
[2025-10-24T18:44:09.756474] [INFO ] [REMOTE    ] FDX: Fetching primary data for 2025-08.
[2025-10-24T18:44:10.024062] [INFO ] [REMOTE    ] FENG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:44:10.547720] [INFO ] [REMOTE    ] FENG: Fetching primary data for 2025-01.
[2025-10-24T18:44:10.695796] [INFO ] [REMOTE    ] FCX: Incremental fetch complete for 2025-10 (2.54 seconds).
[2025-10-24T18:44:10.705727] [INFO ] [REMOTE    ] FCX: Full fetch complete (77488 records).
[2025-10-24T18:44:10.705858] [DEBUG] [VALIDATOR ] FCX: Validating primary data.
[2025-10-24T18:44:10.706626] [FATAL] [VALIDATOR ] FCX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:44:10.706739] [FATAL] [MAIN      ] FCX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:44:10.706796] [WARN ] [MAIN      ] FCX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:44:10.706836] [INFO ] [LOCAL     ] FCX: Starting deletion of primary data.
[2025-10-24T18:44:10.706890] [DEBUG] [LOCAL     ] FCX: No primary data file found to delete.
[2025-10-24T18:44:10.706926] [INFO ] [LOCAL     ] FCX: Starting deletion of derivative data.
[2025-10-24T18:44:10.707088] [DEBUG] [LOCAL     ] FCX: Deleted derivative data file.
[2025-10-24T18:44:10.707638] [INFO ] [MAIN      ] Update Progress: 817/2366 symbols completed. FCX took 38.0s. Estimated remaining: 3h 17m 26s. Rate: 7.8 symbols/min
[2025-10-24T18:44:10.880418] [INFO ] [MAIN      ] FERG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:44:10.926543] [DEBUG] [LOCAL     ] FERG: Loaded 49080 existing records from primary storage.
[2025-10-24T18:44:10.926874] [INFO ] [MAIN      ] FERG: Loaded 49080 existing records.
[2025-10-24T18:44:11.104291] [INFO ] [REMOTE    ] FE: Incremental fetch complete for 2025-01 (2.16 seconds).
[2025-10-24T18:44:11.133351] [INFO ] [REMOTE    ] FENG: Incremental fetch complete for 2025-01 (0.59 seconds).
[2025-10-24T18:44:11.145680] [WARN ] [MAIN      ] FERG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:44:11.147872] [INFO ] [MAIN      ] FERG: Wiping existing primary data before full refresh.
[2025-10-24T18:44:11.148291] [INFO ] [LOCAL     ] FERG: Starting deletion of primary data.
[2025-10-24T18:44:11.149250] [DEBUG] [LOCAL     ] FERG: Deleted primary data file.
[2025-10-24T18:44:11.149308] [INFO ] [MAIN      ] FERG: Starting full primary refresh.
[2025-10-24T18:44:11.355760] [INFO ] [REMOTE    ] FENG: Fetching primary data for 2025-02.
[2025-10-24T18:44:11.511044] [INFO ] [REMOTE    ] FERG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:44:11.743798] [INFO ] [REMOTE    ] FDX: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T18:44:11.856301] [INFO ] [REMOTE    ] FENG: Incremental fetch complete for 2025-02 (0.50 seconds).
[2025-10-24T18:44:12.147618] [INFO ] [REMOTE    ] FENG: Fetching primary data for 2025-03.
[2025-10-24T18:44:12.947723] [INFO ] [REMOTE    ] FERG: Fetching primary data for 2025-01.
[2025-10-24T18:44:13.432107] [INFO ] [REMOTE    ] FENG: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T18:44:13.747689] [INFO ] [REMOTE    ] FENG: Fetching primary data for 2025-04.
[2025-10-24T18:44:14.236997] [INFO ] [REMOTE    ] FENG: Incremental fetch complete for 2025-04 (0.49 seconds).
[2025-10-24T18:44:14.547637] [INFO ] [REMOTE    ] FE: Fetching primary data for 2025-02.
[2025-10-24T18:44:15.347637] [INFO ] [REMOTE    ] FENG: Fetching primary data for 2025-05.
[2025-10-24T18:44:15.804717] [INFO ] [REMOTE    ] FENG: Incremental fetch complete for 2025-05 (0.46 seconds).
[2025-10-24T18:44:15.835676] [INFO ] [REMOTE    ] FERG: Incremental fetch complete for 2025-01 (2.89 seconds).
[2025-10-24T18:44:16.147627] [INFO ] [REMOTE    ] FENG: Fetching primary data for 2025-06.
[2025-10-24T18:44:16.371061] [INFO ] [REMOTE    ] FE: Incremental fetch complete for 2025-02 (1.82 seconds).
[2025-10-24T18:44:16.534731] [INFO ] [REMOTE    ] FENG: Incremental fetch complete for 2025-06 (0.39 seconds).
[2025-10-24T18:44:16.947694] [INFO ] [REMOTE    ] FERG: Fetching primary data for 2025-02.
[2025-10-24T18:44:17.747677] [INFO ] [REMOTE    ] FE: Fetching primary data for 2025-03.
[2025-10-24T18:44:18.547624] [INFO ] [REMOTE    ] FDX: Fetching primary data for 2025-09.
[2025-10-24T18:44:18.643836] [INFO ] [REMOTE    ] FERG: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T18:44:19.347745] [INFO ] [REMOTE    ] FENG: Fetching primary data for 2025-07.
[2025-10-24T18:44:19.670465] [INFO ] [REMOTE    ] FE: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T18:44:19.705414] [INFO ] [REMOTE    ] FENG: Incremental fetch complete for 2025-07 (0.36 seconds).
[2025-10-24T18:44:20.147684] [INFO ] [REMOTE    ] FERG: Fetching primary data for 2025-03.
[2025-10-24T18:44:20.947618] [INFO ] [REMOTE    ] FE: Fetching primary data for 2025-04.
[2025-10-24T18:44:20.991850] [INFO ] [REMOTE    ] FDX: Incremental fetch complete for 2025-09 (2.44 seconds).
[2025-10-24T18:44:21.747624] [INFO ] [REMOTE    ] FDX: Fetching primary data for 2025-10.
[2025-10-24T18:44:21.891126] [INFO ] [REMOTE    ] FERG: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T18:44:22.547618] [INFO ] [REMOTE    ] FERG: Fetching primary data for 2025-04.
[2025-10-24T18:44:22.879842] [INFO ] [REMOTE    ] FE: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T18:44:23.347622] [INFO ] [REMOTE    ] FE: Fetching primary data for 2025-05.
[2025-10-24T18:44:23.764257] [INFO ] [REMOTE    ] FDX: Incremental fetch complete for 2025-10 (2.02 seconds).
[2025-10-24T18:44:23.774070] [INFO ] [REMOTE    ] FDX: Full fetch complete (74146 records).
[2025-10-24T18:44:23.774237] [DEBUG] [VALIDATOR ] FDX: Validating primary data.
[2025-10-24T18:44:24.152883] [INFO ] [REMOTE    ] FENG: Fetching primary data for 2025-08.
[2025-10-24T18:44:24.200585] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present.
[2025-10-24T18:44:24.200818] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed.
[2025-10-24T18:44:24.201826] [INFO ] [MAIN      ] FDX: Fetched primary data is valid.
[2025-10-24T18:44:24.201932] [DEBUG] [LOCAL     ] FDX: Saving primary data.
[2025-10-24T18:44:24.202947] [FATAL] [LOCAL     ] FDX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:44:24.203119] [FATAL] [MAIN      ] FDX: Failed to save primary data.
[2025-10-24T18:44:24.203186] [WARN ] [MAIN      ] FDX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:44:24.203255] [INFO ] [LOCAL     ] FDX: Starting deletion of primary data.
[2025-10-24T18:44:24.203319] [DEBUG] [LOCAL     ] FDX: No primary data file found to delete.
[2025-10-24T18:44:24.203356] [INFO ] [LOCAL     ] FDX: Starting deletion of derivative data.
[2025-10-24T18:44:24.203523] [DEBUG] [LOCAL     ] FDX: Deleted derivative data file.
[2025-10-24T18:44:24.203963] [INFO ] [MAIN      ] Update Progress: 818/2366 symbols completed. FDX took 37.8s. Estimated remaining: 3h 17m 29s. Rate: 7.8 symbols/min
[2025-10-24T18:44:24.377939] [INFO ] [MAIN      ] FET: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:44:24.378275] [DEBUG] [LOCAL     ] FET: No existing data file found in primary storage.
[2025-10-24T18:44:24.378330] [WARN ] [MAIN      ] FET: No existing data found, performing full refresh instead.
[2025-10-24T18:44:24.378446] [INFO ] [MAIN      ] FET: Wiping existing primary data before full refresh.
[2025-10-24T18:44:24.378487] [INFO ] [LOCAL     ] FET: Starting deletion of primary data.
[2025-10-24T18:44:24.378527] [DEBUG] [LOCAL     ] FET: No primary data file found to delete.
[2025-10-24T18:44:24.378557] [INFO ] [MAIN      ] FET: Starting full primary refresh.
[2025-10-24T18:44:24.683277] [INFO ] [REMOTE    ] FENG: Incremental fetch complete for 2025-08 (0.53 seconds).
[2025-10-24T18:44:24.696874] [INFO ] [REMOTE    ] FERG: Incremental fetch complete for 2025-04 (2.15 seconds).
[2025-10-24T18:44:24.786231] [INFO ] [REMOTE    ] FET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:44:24.947681] [INFO ] [REMOTE    ] FET: Fetching primary data for 2025-01.
[2025-10-24T18:44:25.211762] [INFO ] [REMOTE    ] FE: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T18:44:25.747623] [INFO ] [REMOTE    ] FE: Fetching primary data for 2025-06.
[2025-10-24T18:44:25.972147] [INFO ] [REMOTE    ] FET: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T18:44:26.547712] [INFO ] [REMOTE    ] FERG: Fetching primary data for 2025-05.
[2025-10-24T18:44:27.347668] [INFO ] [REMOTE    ] FET: Fetching primary data for 2025-02.
[2025-10-24T18:44:27.392759] [INFO ] [REMOTE    ] FE: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T18:44:28.145211] [INFO ] [REMOTE    ] FET: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T18:44:28.148333] [INFO ] [REMOTE    ] FET: Fetching primary data for 2025-03.
[2025-10-24T18:44:28.370603] [INFO ] [REMOTE    ] FERG: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T18:44:28.947692] [INFO ] [REMOTE    ] FENG: Fetching primary data for 2025-09.
[2025-10-24T18:44:29.020504] [INFO ] [REMOTE    ] FET: Incremental fetch complete for 2025-03 (0.87 seconds).
[2025-10-24T18:44:29.288883] [INFO ] [REMOTE    ] FENG: Incremental fetch complete for 2025-09 (0.34 seconds).
[2025-10-24T18:44:29.747639] [INFO ] [REMOTE    ] FERG: Fetching primary data for 2025-06.
[2025-10-24T18:44:30.547730] [INFO ] [REMOTE    ] FET: Fetching primary data for 2025-04.
[2025-10-24T18:44:31.332152] [INFO ] [REMOTE    ] FERG: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T18:44:31.347663] [INFO ] [REMOTE    ] FENG: Fetching primary data for 2025-10.
[2025-10-24T18:44:31.480225] [INFO ] [REMOTE    ] FET: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T18:44:31.822928] [INFO ] [REMOTE    ] FENG: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T18:44:31.823773] [INFO ] [REMOTE    ] FENG: Full fetch complete (2265 records).
[2025-10-24T18:44:31.823843] [DEBUG] [VALIDATOR ] FENG: Validating primary data.
[2025-10-24T18:44:32.000703] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T18:44:32.000946] [FATAL] [MAIN      ] FENG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:44:32.000996] [WARN ] [MAIN      ] FENG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:44:32.001036] [INFO ] [LOCAL     ] FENG: Starting deletion of primary data.
[2025-10-24T18:44:32.001105] [DEBUG] [LOCAL     ] FENG: No primary data file found to delete.
[2025-10-24T18:44:32.001141] [INFO ] [LOCAL     ] FENG: Starting deletion of derivative data.
[2025-10-24T18:44:32.001181] [DEBUG] [LOCAL     ] FENG: No derivative data file found to delete.
[2025-10-24T18:44:32.001237] [INFO ] [MAIN      ] Update Progress: 819/2366 symbols completed. FENG took 22.5s. Estimated remaining: 3h 17m 22s. Rate: 7.8 symbols/min
[2025-10-24T18:44:32.152889] [INFO ] [REMOTE    ] FE: Fetching primary data for 2025-07.
[2025-10-24T18:44:32.173147] [INFO ] [MAIN      ] FF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:44:32.196664] [DEBUG] [LOCAL     ] FF: Loaded 23773 existing records from primary storage.
[2025-10-24T18:44:32.196932] [INFO ] [MAIN      ] FF: Loaded 23773 existing records.
[2025-10-24T18:44:32.397748] [WARN ] [MAIN      ] FF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:44:32.397980] [INFO ] [MAIN      ] FF: Wiping existing primary data before full refresh.
[2025-10-24T18:44:32.398030] [INFO ] [LOCAL     ] FF: Starting deletion of primary data.
[2025-10-24T18:44:32.398251] [DEBUG] [LOCAL     ] FF: Deleted primary data file.
[2025-10-24T18:44:32.398331] [INFO ] [MAIN      ] FF: Starting full primary refresh.
[2025-10-24T18:44:32.813995] [INFO ] [REMOTE    ] FF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:44:32.947639] [INFO ] [REMOTE    ] FF: Fetching primary data for 2025-01.
[2025-10-24T18:44:33.747627] [INFO ] [REMOTE    ] FERG: Fetching primary data for 2025-07.
[2025-10-24T18:44:34.015096] [INFO ] [REMOTE    ] FE: Incremental fetch complete for 2025-07 (1.86 seconds).
[2025-10-24T18:44:34.040843] [INFO ] [REMOTE    ] FF: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T18:44:34.547668] [INFO ] [REMOTE    ] FET: Fetching primary data for 2025-05.
[2025-10-24T18:44:35.317631] [INFO ] [REMOTE    ] FET: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T18:44:35.347596] [INFO ] [REMOTE    ] FET: Fetching primary data for 2025-06.
[2025-10-24T18:44:35.473057] [INFO ] [REMOTE    ] FERG: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T18:44:36.147674] [INFO ] [REMOTE    ] FE: Fetching primary data for 2025-08.
[2025-10-24T18:44:36.358720] [INFO ] [REMOTE    ] FET: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T18:44:36.947637] [INFO ] [REMOTE    ] FET: Fetching primary data for 2025-07.
[2025-10-24T18:44:37.747610] [INFO ] [REMOTE    ] FF: Fetching primary data for 2025-02.
[2025-10-24T18:44:37.896761] [INFO ] [REMOTE    ] FET: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T18:44:37.933737] [INFO ] [REMOTE    ] FE: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T18:44:38.533276] [INFO ] [REMOTE    ] FF: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T18:44:38.547608] [INFO ] [REMOTE    ] FF: Fetching primary data for 2025-03.
[2025-10-24T18:44:39.347683] [INFO ] [REMOTE    ] FET: Fetching primary data for 2025-08.
[2025-10-24T18:44:39.917375] [INFO ] [REMOTE    ] FF: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T18:44:39.934165] [INFO ] [REMOTE    ] FET: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T18:44:40.147677] [INFO ] [REMOTE    ] FERG: Fetching primary data for 2025-08.
[2025-10-24T18:44:40.947632] [INFO ] [REMOTE    ] FET: Fetching primary data for 2025-09.
[2025-10-24T18:44:41.747701] [INFO ] [REMOTE    ] FF: Fetching primary data for 2025-04.
[2025-10-24T18:44:41.864369] [INFO ] [REMOTE    ] FERG: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T18:44:41.932046] [INFO ] [REMOTE    ] FET: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T18:44:42.547740] [INFO ] [REMOTE    ] FE: Fetching primary data for 2025-09.
[2025-10-24T18:44:43.144182] [INFO ] [REMOTE    ] FF: Incremental fetch complete for 2025-04 (1.40 seconds).
[2025-10-24T18:44:43.347620] [INFO ] [REMOTE    ] FERG: Fetching primary data for 2025-09.
[2025-10-24T18:44:44.147676] [INFO ] [REMOTE    ] FET: Fetching primary data for 2025-10.
[2025-10-24T18:44:44.357330] [INFO ] [REMOTE    ] FE: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T18:44:44.947614] [INFO ] [REMOTE    ] FF: Fetching primary data for 2025-05.
[2025-10-24T18:44:45.252171] [INFO ] [REMOTE    ] FET: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T18:44:45.255282] [INFO ] [REMOTE    ] FET: Full fetch complete (18562 records).
[2025-10-24T18:44:45.255355] [DEBUG] [VALIDATOR ] FET: Validating primary data.
[2025-10-24T18:44:45.640510] [INFO ] [REMOTE    ] FERG: Incremental fetch complete for 2025-09 (2.29 seconds).
[2025-10-24T18:44:45.649771] [DEBUG] [VALIDATOR ] FET: All expected trading days are present.
[2025-10-24T18:44:45.649844] [DEBUG] [VALIDATOR ] FET: Primary data validation passed.
[2025-10-24T18:44:45.659991] [INFO ] [MAIN      ] FET: Fetched primary data is valid.
[2025-10-24T18:44:45.660262] [DEBUG] [LOCAL     ] FET: Saving primary data.
[2025-10-24T18:44:45.660700] [FATAL] [LOCAL     ] FET: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:44:45.660805] [FATAL] [MAIN      ] FET: Failed to save primary data.
[2025-10-24T18:44:45.660889] [WARN ] [MAIN      ] FET: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:44:45.661211] [INFO ] [LOCAL     ] FET: Starting deletion of primary data.
[2025-10-24T18:44:45.661274] [DEBUG] [LOCAL     ] FET: No primary data file found to delete.
[2025-10-24T18:44:45.661310] [INFO ] [LOCAL     ] FET: Starting deletion of derivative data.
[2025-10-24T18:44:45.661350] [DEBUG] [LOCAL     ] FET: No derivative data file found to delete.
[2025-10-24T18:44:45.661406] [INFO ] [MAIN      ] Update Progress: 820/2366 symbols completed. FET took 21.5s. Estimated remaining: 3h 17m 25s. Rate: 7.8 symbols/min
[2025-10-24T18:44:45.760813] [INFO ] [REMOTE    ] FERG: Fetching primary data for 2025-10.
[2025-10-24T18:44:45.836399] [INFO ] [MAIN      ] FFA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:44:45.852058] [INFO ] [REMOTE    ] FF: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T18:44:45.862661] [DEBUG] [LOCAL     ] FFA: Loaded 5602 existing records from primary storage.
[2025-10-24T18:44:45.862880] [INFO ] [MAIN      ] FFA: Loaded 5602 existing records.
[2025-10-24T18:44:46.037048] [WARN ] [MAIN      ] FFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:44:46.037274] [INFO ] [MAIN      ] FFA: Wiping existing primary data before full refresh.
[2025-10-24T18:44:46.037321] [INFO ] [LOCAL     ] FFA: Starting deletion of primary data.
[2025-10-24T18:44:46.037514] [DEBUG] [LOCAL     ] FFA: Deleted primary data file.
[2025-10-24T18:44:46.037570] [INFO ] [MAIN      ] FFA: Starting full primary refresh.
[2025-10-24T18:44:46.391364] [INFO ] [REMOTE    ] FFA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:44:46.547704] [INFO ] [REMOTE    ] FFA: Fetching primary data for 2025-01.
[2025-10-24T18:44:47.054689] [INFO ] [REMOTE    ] FFA: Incremental fetch complete for 2025-01 (0.51 seconds).
[2025-10-24T18:44:47.347715] [INFO ] [REMOTE    ] FE: Fetching primary data for 2025-10.
[2025-10-24T18:44:47.447733] [INFO ] [REMOTE    ] FERG: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T18:44:47.456628] [INFO ] [REMOTE    ] FERG: Full fetch complete (71243 records).
[2025-10-24T18:44:47.456780] [DEBUG] [VALIDATOR ] FERG: Validating primary data.
[2025-10-24T18:44:47.854622] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present.
[2025-10-24T18:44:47.854727] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed.
[2025-10-24T18:44:47.855585] [INFO ] [MAIN      ] FERG: Fetched primary data is valid.
[2025-10-24T18:44:47.855625] [DEBUG] [LOCAL     ] FERG: Saving primary data.
[2025-10-24T18:44:47.856266] [FATAL] [LOCAL     ] FERG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:44:47.856368] [FATAL] [MAIN      ] FERG: Failed to save primary data.
[2025-10-24T18:44:47.856453] [WARN ] [MAIN      ] FERG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:44:47.856544] [INFO ] [LOCAL     ] FERG: Starting deletion of primary data.
[2025-10-24T18:44:47.856633] [DEBUG] [LOCAL     ] FERG: No primary data file found to delete.
[2025-10-24T18:44:47.856722] [INFO ] [LOCAL     ] FERG: Starting deletion of derivative data.
[2025-10-24T18:44:47.856880] [DEBUG] [LOCAL     ] FERG: Deleted derivative data file.
[2025-10-24T18:44:47.857222] [INFO ] [MAIN      ] Update Progress: 821/2366 symbols completed. FERG took 37.1s. Estimated remaining: 3h 17m 7s. Rate: 7.8 symbols/min
[2025-10-24T18:44:48.025824] [INFO ] [MAIN      ] FFC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:44:48.044157] [DEBUG] [LOCAL     ] FFC: Loaded 16737 existing records from primary storage.
[2025-10-24T18:44:48.044382] [INFO ] [MAIN      ] FFC: Loaded 16737 existing records.
[2025-10-24T18:44:48.152722] [INFO ] [REMOTE    ] FFA: Fetching primary data for 2025-02.
[2025-10-24T18:44:48.226766] [WARN ] [MAIN      ] FFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:44:48.227012] [INFO ] [MAIN      ] FFC: Wiping existing primary data before full refresh.
[2025-10-24T18:44:48.227062] [INFO ] [LOCAL     ] FFC: Starting deletion of primary data.
[2025-10-24T18:44:48.227284] [DEBUG] [LOCAL     ] FFC: Deleted primary data file.
[2025-10-24T18:44:48.227341] [INFO ] [MAIN      ] FFC: Starting full primary refresh.
[2025-10-24T18:44:48.586561] [INFO ] [REMOTE    ] FFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:44:48.799288] [INFO ] [REMOTE    ] FFA: Incremental fetch complete for 2025-02 (0.65 seconds).
[2025-10-24T18:44:48.947732] [INFO ] [REMOTE    ] FFA: Fetching primary data for 2025-03.
[2025-10-24T18:44:49.377874] [INFO ] [REMOTE    ] FE: Incremental fetch complete for 2025-10 (2.03 seconds).
[2025-10-24T18:44:49.388426] [INFO ] [REMOTE    ] FE: Full fetch complete (77493 records).
[2025-10-24T18:44:49.388547] [DEBUG] [VALIDATOR ] FE: Validating primary data.
[2025-10-24T18:44:49.704318] [INFO ] [REMOTE    ] FFA: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T18:44:49.751231] [INFO ] [REMOTE    ] FF: Fetching primary data for 2025-06.
[2025-10-24T18:44:49.791155] [DEBUG] [VALIDATOR ] FE: All expected trading days are present.
[2025-10-24T18:44:49.791220] [DEBUG] [VALIDATOR ] FE: Primary data validation passed.
[2025-10-24T18:44:49.792182] [INFO ] [MAIN      ] FE: Fetched primary data is valid.
[2025-10-24T18:44:49.792245] [DEBUG] [LOCAL     ] FE: Saving primary data.
[2025-10-24T18:44:49.792859] [FATAL] [LOCAL     ] FE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:44:49.792945] [FATAL] [MAIN      ] FE: Failed to save primary data.
[2025-10-24T18:44:49.793011] [WARN ] [MAIN      ] FE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:44:49.793082] [INFO ] [LOCAL     ] FE: Starting deletion of primary data.
[2025-10-24T18:44:49.793141] [DEBUG] [LOCAL     ] FE: No primary data file found to delete.
[2025-10-24T18:44:49.793336] [INFO ] [LOCAL     ] FE: Starting deletion of derivative data.
[2025-10-24T18:44:49.793482] [DEBUG] [LOCAL     ] FE: Deleted derivative data file.
[2025-10-24T18:44:49.793931] [INFO ] [MAIN      ] Update Progress: 822/2366 symbols completed. FE took 42.2s. Estimated remaining: 3h 16m 49s. Rate: 7.8 symbols/min
[2025-10-24T18:44:49.965840] [INFO ] [MAIN      ] FFWM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:44:50.002776] [DEBUG] [LOCAL     ] FFWM: Loaded 35895 existing records from primary storage.
[2025-10-24T18:44:50.003064] [INFO ] [MAIN      ] FFWM: Loaded 35895 existing records.
[2025-10-24T18:44:50.192940] [WARN ] [MAIN      ] FFWM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:44:50.193159] [INFO ] [MAIN      ] FFWM: Wiping existing primary data before full refresh.
[2025-10-24T18:44:50.193203] [INFO ] [LOCAL     ] FFWM: Starting deletion of primary data.
[2025-10-24T18:44:50.193396] [DEBUG] [LOCAL     ] FFWM: Deleted primary data file.
[2025-10-24T18:44:50.193450] [INFO ] [MAIN      ] FFWM: Starting full primary refresh.
[2025-10-24T18:44:50.541960] [INFO ] [REMOTE    ] FFWM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:44:50.547599] [INFO ] [REMOTE    ] FFWM: Fetching primary data for 2025-01.
[2025-10-24T18:44:51.079814] [INFO ] [REMOTE    ] FF: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T18:44:51.347625] [INFO ] [REMOTE    ] FF: Fetching primary data for 2025-07.
[2025-10-24T18:44:51.634381] [INFO ] [REMOTE    ] FFWM: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T18:44:52.100874] [INFO ] [REMOTE    ] FF: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T18:44:52.147690] [INFO ] [REMOTE    ] FF: Fetching primary data for 2025-08.
[2025-10-24T18:44:52.947622] [INFO ] [REMOTE    ] FFC: Fetching primary data for 2025-01.
[2025-10-24T18:44:53.210936] [INFO ] [REMOTE    ] FF: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T18:44:53.747637] [INFO ] [REMOTE    ] FFWM: Fetching primary data for 2025-02.
[2025-10-24T18:44:54.022835] [INFO ] [REMOTE    ] FFC: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T18:44:54.547672] [INFO ] [REMOTE    ] FF: Fetching primary data for 2025-09.
[2025-10-24T18:44:55.067976] [INFO ] [REMOTE    ] FFWM: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T18:44:55.199443] [INFO ] [REMOTE    ] FF: Incremental fetch complete for 2025-09 (0.65 seconds).
[2025-10-24T18:44:55.347701] [INFO ] [REMOTE    ] FF: Fetching primary data for 2025-10.
[2025-10-24T18:44:56.147696] [INFO ] [REMOTE    ] FFWM: Fetching primary data for 2025-03.
[2025-10-24T18:44:56.812296] [INFO ] [REMOTE    ] FF: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T18:44:56.818202] [INFO ] [REMOTE    ] FF: Full fetch complete (36293 records).
[2025-10-24T18:44:56.818335] [DEBUG] [VALIDATOR ] FF: Validating primary data.
[2025-10-24T18:44:56.961905] [INFO ] [REMOTE    ] FFA: Fetching primary data for 2025-04.
[2025-10-24T18:44:57.206388] [DEBUG] [VALIDATOR ] FF: All expected trading days are present.
[2025-10-24T18:44:57.206464] [DEBUG] [VALIDATOR ] FF: Primary data validation passed.
[2025-10-24T18:44:57.207073] [INFO ] [MAIN      ] FF: Fetched primary data is valid.
[2025-10-24T18:44:57.207163] [DEBUG] [LOCAL     ] FF: Saving primary data.
[2025-10-24T18:44:57.207508] [FATAL] [LOCAL     ] FF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:44:57.207591] [FATAL] [MAIN      ] FF: Failed to save primary data.
[2025-10-24T18:44:57.207634] [WARN ] [MAIN      ] FF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:44:57.207713] [INFO ] [LOCAL     ] FF: Starting deletion of primary data.
[2025-10-24T18:44:57.207776] [DEBUG] [LOCAL     ] FF: No primary data file found to delete.
[2025-10-24T18:44:57.207814] [INFO ] [LOCAL     ] FF: Starting deletion of derivative data.
[2025-10-24T18:44:57.207982] [DEBUG] [LOCAL     ] FF: Deleted derivative data file.
[2025-10-24T18:44:57.208072] [INFO ] [MAIN      ] Update Progress: 823/2366 symbols completed. FF took 25.2s. Estimated remaining: 3h 16m 41s. Rate: 7.8 symbols/min
[2025-10-24T18:44:57.378506] [INFO ] [MAIN      ] FG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:44:57.397990] [DEBUG] [LOCAL     ] FG: Loaded 21445 existing records from primary storage.
[2025-10-24T18:44:57.398235] [INFO ] [MAIN      ] FG: Loaded 21445 existing records.
[2025-10-24T18:44:57.579982] [WARN ] [MAIN      ] FG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:44:57.580340] [INFO ] [MAIN      ] FG: Wiping existing primary data before full refresh.
[2025-10-24T18:44:57.580413] [INFO ] [LOCAL     ] FG: Starting deletion of primary data.
[2025-10-24T18:44:57.580819] [DEBUG] [LOCAL     ] FG: Deleted primary data file.
[2025-10-24T18:44:57.580881] [INFO ] [MAIN      ] FG: Starting full primary refresh.
[2025-10-24T18:44:57.771406] [INFO ] [REMOTE    ] FFC: Fetching primary data for 2025-02.
[2025-10-24T18:44:57.884072] [INFO ] [REMOTE    ] FFWM: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T18:44:57.980867] [INFO ] [REMOTE    ] FG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:44:58.015220] [INFO ] [REMOTE    ] FFA: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T18:44:58.547633] [INFO ] [REMOTE    ] FFA: Fetching primary data for 2025-05.
[2025-10-24T18:44:58.649960] [DEBUG] [REMOTE    ] FFA: Error fetching primary data for 2025-05: 'API call returned an empty response.'
[2025-10-24T18:44:58.650298] [WARN ] [REMOTE    ] FFA: No data returned for month 2025-05
[2025-10-24T18:44:58.650388] [FATAL] [REMOTE    ] FFA: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:44:58.650469] [FATAL] [MAIN      ] FFA: Failed to fetch primary data.
[2025-10-24T18:44:58.650530] [WARN ] [MAIN      ] FFA: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:44:58.650600] [INFO ] [LOCAL     ] FFA: Starting deletion of primary data.
[2025-10-24T18:44:58.650688] [DEBUG] [LOCAL     ] FFA: No primary data file found to delete.
[2025-10-24T18:44:58.650743] [INFO ] [LOCAL     ] FFA: Starting deletion of derivative data.
[2025-10-24T18:44:58.650881] [DEBUG] [LOCAL     ] FFA: Deleted derivative data file.
[2025-10-24T18:44:58.650945] [INFO ] [MAIN      ] Update Progress: 824/2366 symbols completed. FFA took 13.0s. Estimated remaining: 3h 16m 22s. Rate: 7.9 symbols/min
[2025-10-24T18:44:58.823161] [INFO ] [MAIN      ] FGN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:44:58.839317] [INFO ] [REMOTE    ] FFC: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T18:44:58.849608] [DEBUG] [LOCAL     ] FGN: Loaded 3575 existing records from primary storage.
[2025-10-24T18:44:58.849860] [INFO ] [MAIN      ] FGN: Loaded 3575 existing records.
[2025-10-24T18:44:59.035414] [WARN ] [MAIN      ] FGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:44:59.035999] [INFO ] [MAIN      ] FGN: Wiping existing primary data before full refresh.
[2025-10-24T18:44:59.036076] [INFO ] [LOCAL     ] FGN: Starting deletion of primary data.
[2025-10-24T18:44:59.036398] [DEBUG] [LOCAL     ] FGN: Deleted primary data file.
[2025-10-24T18:44:59.036456] [INFO ] [MAIN      ] FGN: Starting full primary refresh.
[2025-10-24T18:44:59.357747] [INFO ] [REMOTE    ] FFWM: Fetching primary data for 2025-04.
[2025-10-24T18:44:59.398443] [INFO ] [REMOTE    ] FGN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:45:00.147710] [INFO ] [REMOTE    ] FG: Fetching primary data for 2025-01.
[2025-10-24T18:45:00.804408] [INFO ] [REMOTE    ] FFWM: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T18:45:00.947612] [INFO ] [REMOTE    ] FGN: Fetching primary data for 2025-01.
[2025-10-24T18:45:01.254273] [INFO ] [REMOTE    ] FG: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T18:45:01.747705] [INFO ] [REMOTE    ] FFC: Fetching primary data for 2025-03.
[2025-10-24T18:45:02.373763] [INFO ] [REMOTE    ] FGN: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T18:45:02.547693] [INFO ] [REMOTE    ] FGN: Fetching primary data for 2025-02.
[2025-10-24T18:45:03.070351] [INFO ] [REMOTE    ] FFC: Incremental fetch complete for 2025-03 (1.32 seconds).
[2025-10-24T18:45:03.113064] [INFO ] [REMOTE    ] FGN: Incremental fetch complete for 2025-02 (0.57 seconds).
[2025-10-24T18:45:03.347682] [INFO ] [REMOTE    ] FFC: Fetching primary data for 2025-04.
[2025-10-24T18:45:04.147639] [INFO ] [REMOTE    ] FGN: Fetching primary data for 2025-03.
[2025-10-24T18:45:04.886374] [INFO ] [REMOTE    ] FGN: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T18:45:04.947614] [INFO ] [REMOTE    ] FG: Fetching primary data for 2025-02.
[2025-10-24T18:45:05.410247] [INFO ] [REMOTE    ] FFC: Incremental fetch complete for 2025-04 (2.06 seconds).
[2025-10-24T18:45:05.747754] [INFO ] [REMOTE    ] FFC: Fetching primary data for 2025-05.
[2025-10-24T18:45:06.196446] [INFO ] [REMOTE    ] FG: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T18:45:06.547673] [INFO ] [REMOTE    ] FG: Fetching primary data for 2025-03.
[2025-10-24T18:45:07.131455] [INFO ] [REMOTE    ] FFC: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T18:45:07.347680] [INFO ] [REMOTE    ] FGN: Fetching primary data for 2025-04.
[2025-10-24T18:45:07.944004] [INFO ] [REMOTE    ] FGN: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T18:45:08.147717] [INFO ] [REMOTE    ] FFWM: Fetching primary data for 2025-05.
[2025-10-24T18:45:08.947725] [INFO ] [REMOTE    ] FFC: Fetching primary data for 2025-06.
[2025-10-24T18:45:09.211201] [INFO ] [REMOTE    ] FG: Incremental fetch complete for 2025-03 (2.66 seconds).
[2025-10-24T18:45:09.714722] [INFO ] [REMOTE    ] FFWM: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T18:45:09.747667] [INFO ] [REMOTE    ] FFWM: Fetching primary data for 2025-06.
[2025-10-24T18:45:09.996490] [INFO ] [REMOTE    ] FFC: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T18:45:10.547613] [INFO ] [REMOTE    ] FG: Fetching primary data for 2025-04.
[2025-10-24T18:45:11.092895] [INFO ] [REMOTE    ] FFWM: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T18:45:11.347722] [INFO ] [REMOTE    ] FGN: Fetching primary data for 2025-05.
[2025-10-24T18:45:11.894087] [INFO ] [REMOTE    ] FGN: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T18:45:12.147689] [INFO ] [REMOTE    ] FFWM: Fetching primary data for 2025-07.
[2025-10-24T18:45:12.321986] [INFO ] [REMOTE    ] FG: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T18:45:12.947693] [INFO ] [REMOTE    ] FGN: Fetching primary data for 2025-06.
[2025-10-24T18:45:13.508518] [INFO ] [REMOTE    ] FFWM: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T18:45:13.751402] [INFO ] [REMOTE    ] FFWM: Fetching primary data for 2025-08.
[2025-10-24T18:45:13.753000] [INFO ] [REMOTE    ] FGN: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T18:45:14.547737] [INFO ] [REMOTE    ] FG: Fetching primary data for 2025-05.
[2025-10-24T18:45:15.163054] [INFO ] [REMOTE    ] FFWM: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T18:45:15.347669] [INFO ] [REMOTE    ] FFWM: Fetching primary data for 2025-09.
[2025-10-24T18:45:15.851411] [INFO ] [REMOTE    ] FG: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T18:45:16.147682] [INFO ] [REMOTE    ] FFC: Fetching primary data for 2025-07.
[2025-10-24T18:45:16.727895] [INFO ] [REMOTE    ] FFWM: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T18:45:16.947674] [INFO ] [REMOTE    ] FFWM: Fetching primary data for 2025-10.
[2025-10-24T18:45:17.242690] [INFO ] [REMOTE    ] FFC: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T18:45:17.747696] [INFO ] [REMOTE    ] FFC: Fetching primary data for 2025-08.
[2025-10-24T18:45:18.547631] [INFO ] [REMOTE    ] FG: Fetching primary data for 2025-06.
[2025-10-24T18:45:18.573795] [INFO ] [REMOTE    ] FFWM: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T18:45:18.594085] [INFO ] [REMOTE    ] FFWM: Full fetch complete (51882 records).
[2025-10-24T18:45:18.595691] [DEBUG] [VALIDATOR ] FFWM: Validating primary data.
[2025-10-24T18:45:18.595522] [INFO ] [REMOTE    ] FFC: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T18:45:18.991984] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present.
[2025-10-24T18:45:18.992081] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed.
[2025-10-24T18:45:18.992885] [INFO ] [MAIN      ] FFWM: Fetched primary data is valid.
[2025-10-24T18:45:18.992980] [DEBUG] [LOCAL     ] FFWM: Saving primary data.
[2025-10-24T18:45:18.993553] [FATAL] [LOCAL     ] FFWM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:45:18.993666] [FATAL] [MAIN      ] FFWM: Failed to save primary data.
[2025-10-24T18:45:18.993726] [WARN ] [MAIN      ] FFWM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:45:18.993763] [INFO ] [LOCAL     ] FFWM: Starting deletion of primary data.
[2025-10-24T18:45:18.993816] [DEBUG] [LOCAL     ] FFWM: No primary data file found to delete.
[2025-10-24T18:45:18.993854] [INFO ] [LOCAL     ] FFWM: Starting deletion of derivative data.
[2025-10-24T18:45:18.994026] [DEBUG] [LOCAL     ] FFWM: Deleted derivative data file.
[2025-10-24T18:45:18.994153] [INFO ] [MAIN      ] Update Progress: 825/2366 symbols completed. FFWM took 29.2s. Estimated remaining: 3h 16m 38s. Rate: 7.8 symbols/min
[2025-10-24T18:45:19.167075] [INFO ] [MAIN      ] FGSN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:45:19.167278] [DEBUG] [LOCAL     ] FGSN: No existing data file found in primary storage.
[2025-10-24T18:45:19.167324] [WARN ] [MAIN      ] FGSN: No existing data found, performing full refresh instead.
[2025-10-24T18:45:19.167433] [INFO ] [MAIN      ] FGSN: Wiping existing primary data before full refresh.
[2025-10-24T18:45:19.167495] [INFO ] [LOCAL     ] FGSN: Starting deletion of primary data.
[2025-10-24T18:45:19.167537] [DEBUG] [LOCAL     ] FGSN: No primary data file found to delete.
[2025-10-24T18:45:19.167568] [INFO ] [MAIN      ] FGSN: Starting full primary refresh.
[2025-10-24T18:45:19.357605] [INFO ] [REMOTE    ] FFC: Fetching primary data for 2025-09.
[2025-10-24T18:45:19.558771] [INFO ] [REMOTE    ] FGSN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:45:19.738201] [INFO ] [REMOTE    ] FG: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T18:45:20.147624] [INFO ] [REMOTE    ] FG: Fetching primary data for 2025-07.
[2025-10-24T18:45:20.445941] [INFO ] [REMOTE    ] FFC: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T18:45:20.947622] [INFO ] [REMOTE    ] FGN: Fetching primary data for 2025-07.
[2025-10-24T18:45:21.233553] [INFO ] [REMOTE    ] FG: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T18:45:21.575842] [INFO ] [REMOTE    ] FGN: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T18:45:21.747712] [INFO ] [REMOTE    ] FGSN: Fetching primary data for 2025-01.
[2025-10-24T18:45:22.547622] [INFO ] [REMOTE    ] FG: Fetching primary data for 2025-08.
[2025-10-24T18:45:22.707946] [INFO ] [REMOTE    ] FGSN: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T18:45:23.347736] [INFO ] [REMOTE    ] FGN: Fetching primary data for 2025-08.
[2025-10-24T18:45:23.753784] [INFO ] [REMOTE    ] FG: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T18:45:24.065619] [INFO ] [REMOTE    ] FGN: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T18:45:24.147697] [INFO ] [REMOTE    ] FGN: Fetching primary data for 2025-09.
[2025-10-24T18:45:24.647051] [INFO ] [REMOTE    ] FGN: Incremental fetch complete for 2025-09 (0.50 seconds).
[2025-10-24T18:45:24.947629] [INFO ] [REMOTE    ] FFC: Fetching primary data for 2025-10.
[2025-10-24T18:45:25.747677] [INFO ] [REMOTE    ] FGN: Fetching primary data for 2025-10.
[2025-10-24T18:45:26.053829] [INFO ] [REMOTE    ] FFC: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T18:45:26.057325] [INFO ] [REMOTE    ] FFC: Full fetch complete (24505 records).
[2025-10-24T18:45:26.057413] [DEBUG] [VALIDATOR ] FFC: Validating primary data.
[2025-10-24T18:45:26.352609] [INFO ] [REMOTE    ] FGN: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T18:45:26.369615] [INFO ] [REMOTE    ] FGN: Full fetch complete (5440 records).
[2025-10-24T18:45:26.375003] [DEBUG] [VALIDATOR ] FGN: Validating primary data.
[2025-10-24T18:45:26.552781] [INFO ] [REMOTE    ] FG: Fetching primary data for 2025-09.
[2025-10-24T18:45:26.553256] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present.
[2025-10-24T18:45:26.557102] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed.
[2025-10-24T18:45:26.558199] [INFO ] [MAIN      ] FFC: Fetched primary data is valid.
[2025-10-24T18:45:26.568956] [DEBUG] [LOCAL     ] FFC: Saving primary data.
[2025-10-24T18:45:26.610433] [FATAL] [LOCAL     ] FFC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:45:26.636445] [FATAL] [MAIN      ] FFC: Failed to save primary data.
[2025-10-24T18:45:26.699324] [WARN ] [MAIN      ] FFC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:45:26.738366] [INFO ] [LOCAL     ] FFC: Starting deletion of primary data.
[2025-10-24T18:45:26.749596] [DEBUG] [LOCAL     ] FFC: No primary data file found to delete.
[2025-10-24T18:45:26.749731] [INFO ] [LOCAL     ] FFC: Starting deletion of derivative data.
[2025-10-24T18:45:26.761283] [DEBUG] [LOCAL     ] FFC: Deleted derivative data file.
[2025-10-24T18:45:26.769921] [INFO ] [MAIN      ] Update Progress: 826/2366 symbols completed. FFC took 38.9s. Estimated remaining: 3h 16m 30s. Rate: 7.8 symbols/min
[2025-10-24T18:45:26.984188] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present.
[2025-10-24T18:45:27.011004] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed.
[2025-10-24T18:45:27.033432] [INFO ] [MAIN      ] FHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:45:27.033773] [INFO ] [MAIN      ] FGN: Fetched primary data is valid.
[2025-10-24T18:45:27.033874] [DEBUG] [LOCAL     ] FGN: Saving primary data.
[2025-10-24T18:45:27.034222] [FATAL] [LOCAL     ] FGN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:45:27.034675] [FATAL] [MAIN      ] FGN: Failed to save primary data.
[2025-10-24T18:45:27.034772] [WARN ] [MAIN      ] FGN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:45:27.034860] [INFO ] [LOCAL     ] FGN: Starting deletion of primary data.
[2025-10-24T18:45:27.035050] [DEBUG] [LOCAL     ] FGN: No primary data file found to delete.
[2025-10-24T18:45:27.035761] [INFO ] [LOCAL     ] FGN: Starting deletion of derivative data.
[2025-10-24T18:45:27.035963] [DEBUG] [LOCAL     ] FGN: Deleted derivative data file.
[2025-10-24T18:45:27.036095] [INFO ] [MAIN      ] Update Progress: 827/2366 symbols completed. FGN took 28.4s. Estimated remaining: 3h 16m 9s. Rate: 7.8 symbols/min
[2025-10-24T18:45:27.228594] [INFO ] [MAIN      ] FHN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:45:27.241823] [DEBUG] [LOCAL     ] FHI: Loaded 39641 existing records from primary storage.
[2025-10-24T18:45:27.242056] [INFO ] [MAIN      ] FHI: Loaded 39641 existing records.
[2025-10-24T18:45:27.351973] [INFO ] [REMOTE    ] FGSN: Fetching primary data for 2025-02.
[2025-10-24T18:45:27.427406] [WARN ] [MAIN      ] FHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:45:27.427678] [INFO ] [MAIN      ] FHI: Wiping existing primary data before full refresh.
[2025-10-24T18:45:27.427735] [INFO ] [LOCAL     ] FHI: Starting deletion of primary data.
[2025-10-24T18:45:27.428346] [DEBUG] [LOCAL     ] FHI: Deleted primary data file.
[2025-10-24T18:45:27.428402] [INFO ] [MAIN      ] FHI: Starting full primary refresh.
[2025-10-24T18:45:27.586369] [DEBUG] [LOCAL     ] FHN: Loaded 53789 existing records from primary storage.
[2025-10-24T18:45:27.651620] [INFO ] [MAIN      ] FHN: Loaded 53789 existing records.
[2025-10-24T18:45:27.941912] [INFO ] [REMOTE    ] FG: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T18:45:28.021288] [WARN ] [MAIN      ] FHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:45:28.045615] [INFO ] [REMOTE    ] FHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:45:28.045749] [INFO ] [MAIN      ] FHN: Wiping existing primary data before full refresh.
[2025-10-24T18:45:28.046619] [INFO ] [LOCAL     ] FHN: Starting deletion of primary data.
[2025-10-24T18:45:28.046879] [INFO ] [REMOTE    ] FGSN: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T18:45:28.049485] [DEBUG] [LOCAL     ] FHN: Deleted primary data file.
[2025-10-24T18:45:28.049548] [INFO ] [MAIN      ] FHN: Starting full primary refresh.
[2025-10-24T18:45:28.150456] [INFO ] [REMOTE    ] FHI: Fetching primary data for 2025-01.
[2025-10-24T18:45:28.407031] [INFO ] [REMOTE    ] FHN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:45:28.947732] [INFO ] [REMOTE    ] FGSN: Fetching primary data for 2025-03.
[2025-10-24T18:45:29.747733] [INFO ] [REMOTE    ] FHN: Fetching primary data for 2025-01.
[2025-10-24T18:45:29.953482] [INFO ] [REMOTE    ] FHI: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T18:45:29.972902] [INFO ] [REMOTE    ] FGSN: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T18:45:30.547687] [INFO ] [REMOTE    ] FGSN: Fetching primary data for 2025-04.
[2025-10-24T18:45:31.323150] [INFO ] [REMOTE    ] FGSN: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T18:45:31.347684] [INFO ] [REMOTE    ] FGSN: Fetching primary data for 2025-05.
[2025-10-24T18:45:31.993309] [INFO ] [REMOTE    ] FHN: Incremental fetch complete for 2025-01 (2.25 seconds).
[2025-10-24T18:45:32.006883] [INFO ] [REMOTE    ] FGSN: Incremental fetch complete for 2025-05 (0.66 seconds).
[2025-10-24T18:45:32.147699] [INFO ] [REMOTE    ] FGSN: Fetching primary data for 2025-06.
[2025-10-24T18:45:32.825909] [INFO ] [REMOTE    ] FGSN: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T18:45:32.947699] [INFO ] [REMOTE    ] FHN: Fetching primary data for 2025-02.
[2025-10-24T18:45:33.747719] [INFO ] [REMOTE    ] FG: Fetching primary data for 2025-10.
[2025-10-24T18:45:34.547617] [INFO ] [REMOTE    ] FGSN: Fetching primary data for 2025-07.
[2025-10-24T18:45:34.636951] [INFO ] [REMOTE    ] FHN: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T18:45:34.950099] [INFO ] [REMOTE    ] FGSN: Incremental fetch complete for 2025-07 (0.40 seconds).
[2025-10-24T18:45:35.097219] [INFO ] [REMOTE    ] FG: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T18:45:35.101687] [INFO ] [REMOTE    ] FG: Full fetch complete (28969 records).
[2025-10-24T18:45:35.101869] [DEBUG] [VALIDATOR ] FG: Validating primary data.
[2025-10-24T18:45:35.352899] [INFO ] [REMOTE    ] FHI: Fetching primary data for 2025-02.
[2025-10-24T18:45:35.482236] [DEBUG] [VALIDATOR ] FG: All expected trading days are present.
[2025-10-24T18:45:35.482313] [DEBUG] [VALIDATOR ] FG: Primary data validation passed.
[2025-10-24T18:45:35.482937] [INFO ] [MAIN      ] FG: Fetched primary data is valid.
[2025-10-24T18:45:35.483000] [DEBUG] [LOCAL     ] FG: Saving primary data.
[2025-10-24T18:45:35.483293] [FATAL] [LOCAL     ] FG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:45:35.483376] [FATAL] [MAIN      ] FG: Failed to save primary data.
[2025-10-24T18:45:35.483420] [WARN ] [MAIN      ] FG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:45:35.483457] [INFO ] [LOCAL     ] FG: Starting deletion of primary data.
[2025-10-24T18:45:35.483508] [DEBUG] [LOCAL     ] FG: No primary data file found to delete.
[2025-10-24T18:45:35.483545] [INFO ] [LOCAL     ] FG: Starting deletion of derivative data.
[2025-10-24T18:45:35.483732] [DEBUG] [LOCAL     ] FG: Deleted derivative data file.
[2025-10-24T18:45:35.483837] [INFO ] [MAIN      ] Update Progress: 828/2366 symbols completed. FG took 38.3s. Estimated remaining: 3h 16m 3s. Rate: 7.8 symbols/min
[2025-10-24T18:45:35.658828] [INFO ] [MAIN      ] FI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:45:35.713924] [DEBUG] [LOCAL     ] FI: Loaded 53968 existing records from primary storage.
[2025-10-24T18:45:35.714263] [INFO ] [MAIN      ] FI: Loaded 53968 existing records.
[2025-10-24T18:45:35.894265] [WARN ] [MAIN      ] FI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:45:35.894492] [INFO ] [MAIN      ] FI: Wiping existing primary data before full refresh.
[2025-10-24T18:45:35.894551] [INFO ] [LOCAL     ] FI: Starting deletion of primary data.
[2025-10-24T18:45:35.895408] [DEBUG] [LOCAL     ] FI: Deleted primary data file.
[2025-10-24T18:45:35.895468] [INFO ] [MAIN      ] FI: Starting full primary refresh.
[2025-10-24T18:45:36.152795] [INFO ] [REMOTE    ] FGSN: Fetching primary data for 2025-08.
[2025-10-24T18:45:36.251087] [INFO ] [REMOTE    ] FI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:45:36.713205] [INFO ] [REMOTE    ] FGSN: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T18:45:36.854416] [INFO ] [REMOTE    ] FHI: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T18:45:36.947676] [INFO ] [REMOTE    ] FI: Fetching primary data for 2025-01.
[2025-10-24T18:45:37.747617] [INFO ] [REMOTE    ] FHI: Fetching primary data for 2025-03.
[2025-10-24T18:45:38.547617] [INFO ] [REMOTE    ] FGSN: Fetching primary data for 2025-09.
[2025-10-24T18:45:38.778236] [INFO ] [REMOTE    ] FI: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T18:45:39.109897] [INFO ] [REMOTE    ] FGSN: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T18:45:39.239585] [INFO ] [REMOTE    ] FHI: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T18:45:39.347632] [INFO ] [REMOTE    ] FHI: Fetching primary data for 2025-04.
[2025-10-24T18:45:40.147629] [INFO ] [REMOTE    ] FHN: Fetching primary data for 2025-03.
[2025-10-24T18:45:40.952772] [INFO ] [REMOTE    ] FI: Fetching primary data for 2025-02.
[2025-10-24T18:45:40.967745] [INFO ] [REMOTE    ] FHI: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T18:45:41.747629] [INFO ] [REMOTE    ] FHI: Fetching primary data for 2025-05.
[2025-10-24T18:45:42.069713] [INFO ] [REMOTE    ] FHN: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T18:45:42.547687] [INFO ] [REMOTE    ] FHN: Fetching primary data for 2025-04.
[2025-10-24T18:45:43.115389] [INFO ] [REMOTE    ] FI: Incremental fetch complete for 2025-02 (2.16 seconds).
[2025-10-24T18:45:43.333036] [INFO ] [REMOTE    ] FHI: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T18:45:43.347607] [INFO ] [REMOTE    ] FHI: Fetching primary data for 2025-06.
[2025-10-24T18:45:44.147677] [INFO ] [REMOTE    ] FGSN: Fetching primary data for 2025-10.
[2025-10-24T18:45:44.470095] [INFO ] [REMOTE    ] FHN: Incremental fetch complete for 2025-04 (1.92 seconds).
[2025-10-24T18:45:44.804583] [INFO ] [REMOTE    ] FHI: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T18:45:44.947715] [INFO ] [REMOTE    ] FHI: Fetching primary data for 2025-07.
[2025-10-24T18:45:44.995503] [INFO ] [REMOTE    ] FGSN: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T18:45:44.996833] [INFO ] [REMOTE    ] FGSN: Full fetch complete (8124 records).
[2025-10-24T18:45:44.996912] [DEBUG] [VALIDATOR ] FGSN: Validating primary data.
[2025-10-24T18:45:45.199503] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 193 unique days, need 200 days
[2025-10-24T18:45:45.199786] [FATAL] [MAIN      ] FGSN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:45:45.199858] [WARN ] [MAIN      ] FGSN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:45:45.199931] [INFO ] [LOCAL     ] FGSN: Starting deletion of primary data.
[2025-10-24T18:45:45.199999] [DEBUG] [LOCAL     ] FGSN: No primary data file found to delete.
[2025-10-24T18:45:45.200039] [INFO ] [LOCAL     ] FGSN: Starting deletion of derivative data.
[2025-10-24T18:45:45.200082] [DEBUG] [LOCAL     ] FGSN: No derivative data file found to delete.
[2025-10-24T18:45:45.200145] [INFO ] [MAIN      ] Update Progress: 829/2366 symbols completed. FGSN took 26.2s. Estimated remaining: 3h 15m 59s. Rate: 7.8 symbols/min
[2025-10-24T18:45:45.383295] [INFO ] [MAIN      ] FICO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:45:45.406059] [DEBUG] [LOCAL     ] FICO: Loaded 22189 existing records from primary storage.
[2025-10-24T18:45:45.406304] [INFO ] [MAIN      ] FICO: Loaded 22189 existing records.
[2025-10-24T18:45:45.589418] [WARN ] [MAIN      ] FICO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:45:45.589614] [INFO ] [MAIN      ] FICO: Wiping existing primary data before full refresh.
[2025-10-24T18:45:45.589688] [INFO ] [LOCAL     ] FICO: Starting deletion of primary data.
[2025-10-24T18:45:45.590172] [DEBUG] [LOCAL     ] FICO: Deleted primary data file.
[2025-10-24T18:45:45.590230] [INFO ] [MAIN      ] FICO: Starting full primary refresh.
[2025-10-24T18:45:45.752374] [INFO ] [REMOTE    ] FHN: Fetching primary data for 2025-05.
[2025-10-24T18:45:45.957332] [INFO ] [REMOTE    ] FICO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:45:46.464555] [INFO ] [REMOTE    ] FHI: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T18:45:46.547683] [INFO ] [REMOTE    ] FI: Fetching primary data for 2025-03.
[2025-10-24T18:45:47.347723] [INFO ] [REMOTE    ] FICO: Fetching primary data for 2025-01.
[2025-10-24T18:45:47.463493] [INFO ] [REMOTE    ] FHN: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T18:45:48.147638] [INFO ] [REMOTE    ] FHN: Fetching primary data for 2025-06.
[2025-10-24T18:45:48.243374] [INFO ] [REMOTE    ] FI: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T18:45:48.272357] [INFO ] [REMOTE    ] FICO: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T18:45:48.947678] [INFO ] [REMOTE    ] FHI: Fetching primary data for 2025-08.
[2025-10-24T18:45:49.747708] [INFO ] [REMOTE    ] FI: Fetching primary data for 2025-04.
[2025-10-24T18:45:49.920295] [INFO ] [REMOTE    ] FHN: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T18:45:50.313915] [INFO ] [REMOTE    ] FHI: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T18:45:50.547692] [INFO ] [REMOTE    ] FHI: Fetching primary data for 2025-09.
[2025-10-24T18:45:51.347677] [INFO ] [REMOTE    ] FHN: Fetching primary data for 2025-07.
[2025-10-24T18:45:51.600464] [INFO ] [REMOTE    ] FI: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T18:45:51.972445] [INFO ] [REMOTE    ] FHI: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T18:45:52.147614] [INFO ] [REMOTE    ] FI: Fetching primary data for 2025-05.
[2025-10-24T18:45:52.877686] [INFO ] [REMOTE    ] FHN: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T18:45:52.947701] [INFO ] [REMOTE    ] FHI: Fetching primary data for 2025-10.
[2025-10-24T18:45:53.747629] [INFO ] [REMOTE    ] FHN: Fetching primary data for 2025-08.
[2025-10-24T18:45:54.027608] [INFO ] [REMOTE    ] FI: Incremental fetch complete for 2025-05 (1.88 seconds).
[2025-10-24T18:45:54.459985] [INFO ] [REMOTE    ] FHI: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T18:45:54.466084] [INFO ] [REMOTE    ] FHI: Full fetch complete (57033 records).
[2025-10-24T18:45:54.466200] [DEBUG] [VALIDATOR ] FHI: Validating primary data.
[2025-10-24T18:45:54.466881] [FATAL] [VALIDATOR ] FHI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T18:45:54.466967] [FATAL] [MAIN      ] FHI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:45:54.467009] [WARN ] [MAIN      ] FHI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:45:54.467082] [INFO ] [LOCAL     ] FHI: Starting deletion of primary data.
[2025-10-24T18:45:54.467170] [DEBUG] [LOCAL     ] FHI: No primary data file found to delete.
[2025-10-24T18:45:54.467224] [INFO ] [LOCAL     ] FHI: Starting deletion of derivative data.
[2025-10-24T18:45:54.467364] [DEBUG] [LOCAL     ] FHI: Deleted derivative data file.
[2025-10-24T18:45:54.467587] [INFO ] [MAIN      ] Update Progress: 830/2366 symbols completed. FHI took 27.7s. Estimated remaining: 3h 15m 54s. Rate: 7.8 symbols/min
[2025-10-24T18:45:54.552727] [INFO ] [REMOTE    ] FI: Fetching primary data for 2025-06.
[2025-10-24T18:45:54.646603] [INFO ] [MAIN      ] FIG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:45:54.646793] [DEBUG] [LOCAL     ] FIG: No existing data file found in primary storage.
[2025-10-24T18:45:54.646838] [WARN ] [MAIN      ] FIG: No existing data found, performing full refresh instead.
[2025-10-24T18:45:54.646952] [INFO ] [MAIN      ] FIG: Wiping existing primary data before full refresh.
[2025-10-24T18:45:54.646994] [INFO ] [LOCAL     ] FIG: Starting deletion of primary data.
[2025-10-24T18:45:54.647037] [DEBUG] [LOCAL     ] FIG: No primary data file found to delete.
[2025-10-24T18:45:54.647070] [INFO ] [MAIN      ] FIG: Starting full primary refresh.
[2025-10-24T18:45:55.035926] [INFO ] [REMOTE    ] FIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:45:55.347632] [INFO ] [REMOTE    ] FIG: Fetching primary data for 2025-01.
[2025-10-24T18:45:55.520938] [INFO ] [REMOTE    ] FHN: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T18:45:55.706333] [INFO ] [REMOTE    ] FIG: Incremental fetch complete for 2025-01 (0.36 seconds).
[2025-10-24T18:45:56.147693] [INFO ] [REMOTE    ] FHN: Fetching primary data for 2025-09.
[2025-10-24T18:45:56.537663] [INFO ] [REMOTE    ] FI: Incremental fetch complete for 2025-06 (1.98 seconds).
[2025-10-24T18:45:56.947684] [INFO ] [REMOTE    ] FI: Fetching primary data for 2025-07.
[2025-10-24T18:45:57.747620] [INFO ] [REMOTE    ] FIG: Fetching primary data for 2025-02.
[2025-10-24T18:45:57.975512] [INFO ] [REMOTE    ] FHN: Incremental fetch complete for 2025-09 (1.83 seconds).
[2025-10-24T18:45:58.062706] [INFO ] [REMOTE    ] FIG: Incremental fetch complete for 2025-02 (0.32 seconds).
[2025-10-24T18:45:58.547611] [INFO ] [REMOTE    ] FIG: Fetching primary data for 2025-03.
[2025-10-24T18:45:58.733437] [INFO ] [REMOTE    ] FI: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T18:45:58.873525] [INFO ] [REMOTE    ] FIG: Incremental fetch complete for 2025-03 (0.33 seconds).
[2025-10-24T18:45:59.347667] [INFO ] [REMOTE    ] FI: Fetching primary data for 2025-08.
[2025-10-24T18:46:00.147735] [INFO ] [REMOTE    ] FICO: Fetching primary data for 2025-02.
[2025-10-24T18:46:00.947627] [INFO ] [REMOTE    ] FHN: Fetching primary data for 2025-10.
[2025-10-24T18:46:01.081987] [INFO ] [REMOTE    ] FI: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T18:46:01.249992] [INFO ] [REMOTE    ] FICO: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T18:46:01.747685] [INFO ] [REMOTE    ] FIG: Fetching primary data for 2025-04.
[2025-10-24T18:46:02.083394] [INFO ] [REMOTE    ] FIG: Incremental fetch complete for 2025-04 (0.34 seconds).
[2025-10-24T18:46:02.547674] [INFO ] [REMOTE    ] FICO: Fetching primary data for 2025-03.
[2025-10-24T18:46:02.850706] [INFO ] [REMOTE    ] FHN: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T18:46:02.860498] [INFO ] [REMOTE    ] FHN: Full fetch complete (77479 records).
[2025-10-24T18:46:02.860638] [DEBUG] [VALIDATOR ] FHN: Validating primary data.
[2025-10-24T18:46:03.261458] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present.
[2025-10-24T18:46:03.261547] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed.
[2025-10-24T18:46:03.262477] [INFO ] [MAIN      ] FHN: Fetched primary data is valid.
[2025-10-24T18:46:03.262542] [DEBUG] [LOCAL     ] FHN: Saving primary data.
[2025-10-24T18:46:03.263196] [FATAL] [LOCAL     ] FHN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:46:03.263291] [FATAL] [MAIN      ] FHN: Failed to save primary data.
[2025-10-24T18:46:03.263333] [WARN ] [MAIN      ] FHN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:46:03.263402] [INFO ] [LOCAL     ] FHN: Starting deletion of primary data.
[2025-10-24T18:46:03.263462] [DEBUG] [LOCAL     ] FHN: No primary data file found to delete.
[2025-10-24T18:46:03.263497] [INFO ] [LOCAL     ] FHN: Starting deletion of derivative data.
[2025-10-24T18:46:03.263693] [DEBUG] [LOCAL     ] FHN: Deleted derivative data file.
[2025-10-24T18:46:03.264205] [INFO ] [MAIN      ] Update Progress: 831/2366 symbols completed. FHN took 36.2s. Estimated remaining: 3h 15m 49s. Rate: 7.8 symbols/min
[2025-10-24T18:46:03.352738] [INFO ] [REMOTE    ] FI: Fetching primary data for 2025-09.
[2025-10-24T18:46:03.439238] [INFO ] [MAIN      ] FIGS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:46:03.481750] [DEBUG] [LOCAL     ] FIGS: Loaded 48846 existing records from primary storage.
[2025-10-24T18:46:03.482038] [INFO ] [MAIN      ] FIGS: Loaded 48846 existing records.
[2025-10-24T18:46:03.677759] [INFO ] [REMOTE    ] FICO: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T18:46:03.681436] [WARN ] [MAIN      ] FIGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:46:03.685187] [INFO ] [MAIN      ] FIGS: Wiping existing primary data before full refresh.
[2025-10-24T18:46:03.685507] [INFO ] [LOCAL     ] FIGS: Starting deletion of primary data.
[2025-10-24T18:46:03.686228] [DEBUG] [LOCAL     ] FIGS: Deleted primary data file.
[2025-10-24T18:46:03.686286] [INFO ] [MAIN      ] FIGS: Starting full primary refresh.
[2025-10-24T18:46:04.035062] [INFO ] [REMOTE    ] FIGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:46:04.147666] [INFO ] [REMOTE    ] FICO: Fetching primary data for 2025-04.
[2025-10-24T18:46:04.947608] [INFO ] [REMOTE    ] FIGS: Fetching primary data for 2025-01.
[2025-10-24T18:46:05.207254] [INFO ] [REMOTE    ] FICO: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T18:46:05.285756] [INFO ] [REMOTE    ] FI: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T18:46:05.747685] [INFO ] [REMOTE    ] FIG: Fetching primary data for 2025-05.
[2025-10-24T18:46:06.085543] [INFO ] [REMOTE    ] FIG: Incremental fetch complete for 2025-05 (0.34 seconds).
[2025-10-24T18:46:06.133038] [INFO ] [REMOTE    ] FIGS: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T18:46:06.547692] [INFO ] [REMOTE    ] FICO: Fetching primary data for 2025-05.
[2025-10-24T18:46:07.347673] [INFO ] [REMOTE    ] FIG: Fetching primary data for 2025-06.
[2025-10-24T18:46:07.460023] [INFO ] [REMOTE    ] FICO: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T18:46:07.539273] [DEBUG] [REMOTE    ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T18:46:07.539780] [WARN ] [REMOTE    ] FIG: No data returned for month 2025-06
[2025-10-24T18:46:07.539888] [FATAL] [REMOTE    ] FIG: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:46:07.539991] [FATAL] [MAIN      ] FIG: Failed to fetch primary data.
[2025-10-24T18:46:07.540058] [WARN ] [MAIN      ] FIG: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:46:07.540138] [INFO ] [LOCAL     ] FIG: Starting deletion of primary data.
[2025-10-24T18:46:07.540214] [DEBUG] [LOCAL     ] FIG: No primary data file found to delete.
[2025-10-24T18:46:07.540254] [INFO ] [LOCAL     ] FIG: Starting deletion of derivative data.
[2025-10-24T18:46:07.540297] [DEBUG] [LOCAL     ] FIG: No derivative data file found to delete.
[2025-10-24T18:46:07.540355] [INFO ] [MAIN      ] Update Progress: 832/2366 symbols completed. FIG took 13.1s. Estimated remaining: 3h 15m 35s. Rate: 7.8 symbols/min
[2025-10-24T18:46:07.725154] [INFO ] [MAIN      ] FIHL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:46:07.763405] [DEBUG] [LOCAL     ] FIHL: Loaded 39341 existing records from primary storage.
[2025-10-24T18:46:07.763726] [INFO ] [MAIN      ] FIHL: Loaded 39341 existing records.
[2025-10-24T18:46:07.942447] [WARN ] [MAIN      ] FIHL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:46:07.942685] [INFO ] [MAIN      ] FIHL: Wiping existing primary data before full refresh.
[2025-10-24T18:46:07.942744] [INFO ] [LOCAL     ] FIHL: Starting deletion of primary data.
[2025-10-24T18:46:07.943402] [DEBUG] [LOCAL     ] FIHL: Deleted primary data file.
[2025-10-24T18:46:07.943459] [INFO ] [MAIN      ] FIHL: Starting full primary refresh.
[2025-10-24T18:46:08.152798] [INFO ] [REMOTE    ] FI: Fetching primary data for 2025-10.
[2025-10-24T18:46:08.293495] [INFO ] [REMOTE    ] FIHL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:46:08.947672] [INFO ] [REMOTE    ] FIHL: Fetching primary data for 2025-01.
[2025-10-24T18:46:09.747700] [INFO ] [REMOTE    ] FIGS: Fetching primary data for 2025-02.
[2025-10-24T18:46:10.255500] [INFO ] [REMOTE    ] FI: Incremental fetch complete for 2025-10 (2.10 seconds).
[2025-10-24T18:46:10.282677] [INFO ] [REMOTE    ] FI: Full fetch complete (77493 records).
[2025-10-24T18:46:10.283856] [INFO ] [REMOTE    ] FIHL: Incremental fetch complete for 2025-01 (1.34 seconds).
[2025-10-24T18:46:10.283998] [DEBUG] [VALIDATOR ] FI: Validating primary data.
[2025-10-24T18:46:10.556246] [INFO ] [REMOTE    ] FICO: Fetching primary data for 2025-06.
[2025-10-24T18:46:10.696909] [DEBUG] [VALIDATOR ] FI: All expected trading days are present.
[2025-10-24T18:46:10.697015] [DEBUG] [VALIDATOR ] FI: Primary data validation passed.
[2025-10-24T18:46:10.698261] [INFO ] [MAIN      ] FI: Fetched primary data is valid.
[2025-10-24T18:46:10.698378] [DEBUG] [LOCAL     ] FI: Saving primary data.
[2025-10-24T18:46:10.699120] [FATAL] [LOCAL     ] FI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:46:10.699220] [FATAL] [MAIN      ] FI: Failed to save primary data.
[2025-10-24T18:46:10.699262] [WARN ] [MAIN      ] FI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:46:10.699297] [INFO ] [LOCAL     ] FI: Starting deletion of primary data.
[2025-10-24T18:46:10.699349] [DEBUG] [LOCAL     ] FI: No primary data file found to delete.
[2025-10-24T18:46:10.699385] [INFO ] [LOCAL     ] FI: Starting deletion of derivative data.
[2025-10-24T18:46:10.699576] [DEBUG] [LOCAL     ] FI: Deleted derivative data file.
[2025-10-24T18:46:10.699924] [INFO ] [MAIN      ] Update Progress: 833/2366 symbols completed. FI took 35.2s. Estimated remaining: 3h 15m 19s. Rate: 7.8 symbols/min
[2025-10-24T18:46:10.886937] [INFO ] [MAIN      ] FINS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:46:10.911861] [INFO ] [REMOTE    ] FIGS: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T18:46:10.928351] [DEBUG] [LOCAL     ] FINS: Loaded 8300 existing records from primary storage.
[2025-10-24T18:46:10.928616] [INFO ] [MAIN      ] FINS: Loaded 8300 existing records.
[2025-10-24T18:46:11.100661] [WARN ] [MAIN      ] FINS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:46:11.100897] [INFO ] [MAIN      ] FINS: Wiping existing primary data before full refresh.
[2025-10-24T18:46:11.100945] [INFO ] [LOCAL     ] FINS: Starting deletion of primary data.
[2025-10-24T18:46:11.101182] [DEBUG] [LOCAL     ] FINS: Deleted primary data file.
[2025-10-24T18:46:11.101223] [INFO ] [MAIN      ] FINS: Starting full primary refresh.
[2025-10-24T18:46:11.351808] [INFO ] [REMOTE    ] FIGS: Fetching primary data for 2025-03.
[2025-10-24T18:46:11.457551] [INFO ] [REMOTE    ] FINS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:46:11.674034] [INFO ] [REMOTE    ] FICO: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T18:46:12.147694] [INFO ] [REMOTE    ] FINS: Fetching primary data for 2025-01.
[2025-10-24T18:46:12.765105] [INFO ] [REMOTE    ] FIGS: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T18:46:12.869927] [INFO ] [REMOTE    ] FINS: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T18:46:12.947611] [INFO ] [REMOTE    ] FINS: Fetching primary data for 2025-02.
[2025-10-24T18:46:13.639118] [INFO ] [REMOTE    ] FINS: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T18:46:13.747615] [INFO ] [REMOTE    ] FICO: Fetching primary data for 2025-07.
[2025-10-24T18:46:14.547680] [INFO ] [REMOTE    ] FIGS: Fetching primary data for 2025-04.
[2025-10-24T18:46:15.120312] [INFO ] [REMOTE    ] FICO: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T18:46:15.347638] [INFO ] [REMOTE    ] FICO: Fetching primary data for 2025-08.
[2025-10-24T18:46:16.150159] [INFO ] [REMOTE    ] FINS: Fetching primary data for 2025-03.
[2025-10-24T18:46:16.153580] [INFO ] [REMOTE    ] FIGS: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T18:46:16.753519] [INFO ] [REMOTE    ] FINS: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T18:46:16.771743] [INFO ] [REMOTE    ] FICO: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T18:46:16.947628] [INFO ] [REMOTE    ] FICO: Fetching primary data for 2025-09.
[2025-10-24T18:46:17.747671] [INFO ] [REMOTE    ] FINS: Fetching primary data for 2025-04.
[2025-10-24T18:46:18.068046] [INFO ] [REMOTE    ] FICO: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T18:46:18.461779] [INFO ] [REMOTE    ] FINS: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T18:46:18.547618] [INFO ] [REMOTE    ] FIHL: Fetching primary data for 2025-02.
[2025-10-24T18:46:19.347625] [INFO ] [REMOTE    ] FIGS: Fetching primary data for 2025-05.
[2025-10-24T18:46:19.842488] [INFO ] [REMOTE    ] FIHL: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T18:46:20.147632] [INFO ] [REMOTE    ] FIHL: Fetching primary data for 2025-03.
[2025-10-24T18:46:20.880174] [INFO ] [REMOTE    ] FIGS: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T18:46:20.947612] [INFO ] [REMOTE    ] FIGS: Fetching primary data for 2025-06.
[2025-10-24T18:46:21.649390] [INFO ] [REMOTE    ] FIHL: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T18:46:21.747639] [INFO ] [REMOTE    ] FIHL: Fetching primary data for 2025-04.
[2025-10-24T18:46:22.416753] [INFO ] [REMOTE    ] FIGS: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T18:46:22.547636] [INFO ] [REMOTE    ] FIGS: Fetching primary data for 2025-07.
[2025-10-24T18:46:23.278685] [INFO ] [REMOTE    ] FIHL: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T18:46:23.347621] [INFO ] [REMOTE    ] FIHL: Fetching primary data for 2025-05.
[2025-10-24T18:46:23.927602] [INFO ] [REMOTE    ] FIGS: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T18:46:24.147707] [INFO ] [REMOTE    ] FINS: Fetching primary data for 2025-05.
[2025-10-24T18:46:24.749932] [INFO ] [REMOTE    ] FIHL: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T18:46:24.947618] [INFO ] [REMOTE    ] FICO: Fetching primary data for 2025-10.
[2025-10-24T18:46:24.956169] [INFO ] [REMOTE    ] FINS: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T18:46:25.747709] [INFO ] [REMOTE    ] FIHL: Fetching primary data for 2025-06.
[2025-10-24T18:46:26.450829] [INFO ] [REMOTE    ] FICO: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T18:46:26.456009] [INFO ] [REMOTE    ] FICO: Full fetch complete (30140 records).
[2025-10-24T18:46:26.456087] [DEBUG] [VALIDATOR ] FICO: Validating primary data.
[2025-10-24T18:46:26.555630] [INFO ] [REMOTE    ] FIGS: Fetching primary data for 2025-08.
[2025-10-24T18:46:26.827982] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present.
[2025-10-24T18:46:26.828138] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed.
[2025-10-24T18:46:26.828811] [INFO ] [MAIN      ] FICO: Fetched primary data is valid.
[2025-10-24T18:46:26.828873] [DEBUG] [LOCAL     ] FICO: Saving primary data.
[2025-10-24T18:46:26.829184] [FATAL] [LOCAL     ] FICO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:46:26.829273] [FATAL] [MAIN      ] FICO: Failed to save primary data.
[2025-10-24T18:46:26.829358] [WARN ] [MAIN      ] FICO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:46:26.829444] [INFO ] [LOCAL     ] FICO: Starting deletion of primary data.
[2025-10-24T18:46:26.829519] [DEBUG] [LOCAL     ] FICO: No primary data file found to delete.
[2025-10-24T18:46:26.829556] [INFO ] [LOCAL     ] FICO: Starting deletion of derivative data.
[2025-10-24T18:46:26.829724] [DEBUG] [LOCAL     ] FICO: Deleted derivative data file.
[2025-10-24T18:46:26.829823] [INFO ] [MAIN      ] Update Progress: 834/2366 symbols completed. FICO took 41.6s. Estimated remaining: 3h 15m 27s. Rate: 7.8 symbols/min
[2025-10-24T18:46:27.003208] [INFO ] [MAIN      ] FINV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:46:27.043033] [DEBUG] [LOCAL     ] FINV: Loaded 45555 existing records from primary storage.
[2025-10-24T18:46:27.043316] [INFO ] [MAIN      ] FINV: Loaded 45555 existing records.
[2025-10-24T18:46:27.222479] [WARN ] [MAIN      ] FINV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:46:27.222748] [INFO ] [MAIN      ] FINV: Wiping existing primary data before full refresh.
[2025-10-24T18:46:27.222881] [INFO ] [LOCAL     ] FINV: Starting deletion of primary data.
[2025-10-24T18:46:27.230604] [DEBUG] [LOCAL     ] FINV: Deleted primary data file.
[2025-10-24T18:46:27.242919] [INFO ] [MAIN      ] FINV: Starting full primary refresh.
[2025-10-24T18:46:27.313890] [INFO ] [REMOTE    ] FIHL: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T18:46:27.351582] [INFO ] [REMOTE    ] FINS: Fetching primary data for 2025-06.
[2025-10-24T18:46:27.609808] [INFO ] [REMOTE    ] FINV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:46:28.134310] [INFO ] [REMOTE    ] FIGS: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T18:46:28.147592] [INFO ] [REMOTE    ] FIGS: Fetching primary data for 2025-09.
[2025-10-24T18:46:28.190993] [INFO ] [REMOTE    ] FINS: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T18:46:28.947728] [INFO ] [REMOTE    ] FINS: Fetching primary data for 2025-07.
[2025-10-24T18:46:29.433152] [INFO ] [REMOTE    ] FINS: Incremental fetch complete for 2025-07 (0.49 seconds).
[2025-10-24T18:46:29.599142] [INFO ] [REMOTE    ] FIGS: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T18:46:29.747621] [INFO ] [REMOTE    ] FIGS: Fetching primary data for 2025-10.
[2025-10-24T18:46:30.547665] [INFO ] [REMOTE    ] FINV: Fetching primary data for 2025-01.
[2025-10-24T18:46:31.347668] [INFO ] [REMOTE    ] FINS: Fetching primary data for 2025-08.
[2025-10-24T18:46:31.475100] [INFO ] [REMOTE    ] FIGS: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T18:46:31.483725] [INFO ] [REMOTE    ] FIGS: Full fetch complete (70738 records).
[2025-10-24T18:46:31.483863] [DEBUG] [VALIDATOR ] FIGS: Validating primary data.
[2025-10-24T18:46:31.875009] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present.
[2025-10-24T18:46:31.875159] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed.
[2025-10-24T18:46:31.876312] [INFO ] [MAIN      ] FIGS: Fetched primary data is valid.
[2025-10-24T18:46:31.876390] [DEBUG] [LOCAL     ] FIGS: Saving primary data.
[2025-10-24T18:46:31.877056] [FATAL] [LOCAL     ] FIGS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:46:31.877165] [FATAL] [MAIN      ] FIGS: Failed to save primary data.
[2025-10-24T18:46:31.877241] [WARN ] [MAIN      ] FIGS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:46:31.877311] [INFO ] [LOCAL     ] FIGS: Starting deletion of primary data.
[2025-10-24T18:46:31.877374] [DEBUG] [LOCAL     ] FIGS: No primary data file found to delete.
[2025-10-24T18:46:31.877412] [INFO ] [LOCAL     ] FIGS: Starting deletion of derivative data.
[2025-10-24T18:46:31.877578] [DEBUG] [LOCAL     ] FIGS: Deleted derivative data file.
[2025-10-24T18:46:31.877822] [INFO ] [MAIN      ] Update Progress: 835/2366 symbols completed. FIGS took 28.6s. Estimated remaining: 3h 15m 14s. Rate: 7.8 symbols/min
[2025-10-24T18:46:32.056963] [INFO ] [MAIN      ] FIS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:46:32.063458] [INFO ] [REMOTE    ] FINS: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T18:46:32.090455] [INFO ] [REMOTE    ] FINV: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T18:46:32.152713] [INFO ] [REMOTE    ] FIHL: Fetching primary data for 2025-07.
[2025-10-24T18:46:32.158037] [DEBUG] [LOCAL     ] FIS: Loaded 53715 existing records from primary storage.
[2025-10-24T18:46:32.158595] [INFO ] [MAIN      ] FIS: Loaded 53715 existing records.
[2025-10-24T18:46:32.355409] [WARN ] [MAIN      ] FIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:46:32.355634] [INFO ] [MAIN      ] FIS: Wiping existing primary data before full refresh.
[2025-10-24T18:46:32.355720] [INFO ] [LOCAL     ] FIS: Starting deletion of primary data.
[2025-10-24T18:46:32.356892] [DEBUG] [LOCAL     ] FIS: Deleted primary data file.
[2025-10-24T18:46:32.356952] [INFO ] [MAIN      ] FIS: Starting full primary refresh.
[2025-10-24T18:46:32.712733] [INFO ] [REMOTE    ] FIS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:46:32.947668] [INFO ] [REMOTE    ] FINS: Fetching primary data for 2025-09.
[2025-10-24T18:46:33.555623] [INFO ] [REMOTE    ] FIHL: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T18:46:33.584950] [INFO ] [REMOTE    ] FINS: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T18:46:33.747676] [INFO ] [REMOTE    ] FIHL: Fetching primary data for 2025-08.
[2025-10-24T18:46:34.547714] [INFO ] [REMOTE    ] FINS: Fetching primary data for 2025-10.
[2025-10-24T18:46:35.030128] [INFO ] [REMOTE    ] FIHL: Incremental fetch complete for 2025-08 (1.28 seconds).
[2025-10-24T18:46:35.287539] [INFO ] [REMOTE    ] FINS: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T18:46:35.289243] [INFO ] [REMOTE    ] FINS: Full fetch complete (11581 records).
[2025-10-24T18:46:35.289318] [DEBUG] [VALIDATOR ] FINS: Validating primary data.
[2025-10-24T18:46:35.355853] [INFO ] [REMOTE    ] FINV: Fetching primary data for 2025-02.
[2025-10-24T18:46:35.657483] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present.
[2025-10-24T18:46:35.657561] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed.
[2025-10-24T18:46:35.657825] [INFO ] [MAIN      ] FINS: Fetched primary data is valid.
[2025-10-24T18:46:35.657885] [DEBUG] [LOCAL     ] FINS: Saving primary data.
[2025-10-24T18:46:35.658087] [FATAL] [LOCAL     ] FINS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:46:35.658168] [FATAL] [MAIN      ] FINS: Failed to save primary data.
[2025-10-24T18:46:35.658212] [WARN ] [MAIN      ] FINS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:46:35.658253] [INFO ] [LOCAL     ] FINS: Starting deletion of primary data.
[2025-10-24T18:46:35.658300] [DEBUG] [LOCAL     ] FINS: No primary data file found to delete.
[2025-10-24T18:46:35.658334] [INFO ] [LOCAL     ] FINS: Starting deletion of derivative data.
[2025-10-24T18:46:35.658580] [DEBUG] [LOCAL     ] FINS: Deleted derivative data file.
[2025-10-24T18:46:35.658701] [INFO ] [MAIN      ] Update Progress: 836/2366 symbols completed. FINS took 25.0s. Estimated remaining: 3h 14m 60s. Rate: 7.8 symbols/min
[2025-10-24T18:46:35.830051] [INFO ] [MAIN      ] FIX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:46:35.859042] [DEBUG] [LOCAL     ] FIX: Loaded 28670 existing records from primary storage.
[2025-10-24T18:46:35.859298] [INFO ] [MAIN      ] FIX: Loaded 28670 existing records.
[2025-10-24T18:46:36.051150] [WARN ] [MAIN      ] FIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:46:36.051406] [INFO ] [MAIN      ] FIX: Wiping existing primary data before full refresh.
[2025-10-24T18:46:36.051457] [INFO ] [LOCAL     ] FIX: Starting deletion of primary data.
[2025-10-24T18:46:36.052091] [DEBUG] [LOCAL     ] FIX: Deleted primary data file.
[2025-10-24T18:46:36.052169] [INFO ] [MAIN      ] FIX: Starting full primary refresh.
[2025-10-24T18:46:36.152715] [INFO ] [REMOTE    ] FIHL: Fetching primary data for 2025-09.
[2025-10-24T18:46:36.412471] [INFO ] [REMOTE    ] FIX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:46:36.948947] [INFO ] [REMOTE    ] FIS: Fetching primary data for 2025-01.
[2025-10-24T18:46:36.954071] [INFO ] [REMOTE    ] FINV: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T18:46:37.628316] [INFO ] [REMOTE    ] FIHL: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T18:46:37.747723] [INFO ] [REMOTE    ] FIX: Fetching primary data for 2025-01.
[2025-10-24T18:46:38.515536] [INFO ] [REMOTE    ] FIS: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T18:46:38.547624] [INFO ] [REMOTE    ] FIS: Fetching primary data for 2025-02.
[2025-10-24T18:46:39.210967] [INFO ] [REMOTE    ] FIX: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T18:46:39.347636] [INFO ] [REMOTE    ] FIHL: Fetching primary data for 2025-10.
[2025-10-24T18:46:40.147635] [INFO ] [REMOTE    ] FIX: Fetching primary data for 2025-02.
[2025-10-24T18:46:40.266238] [INFO ] [REMOTE    ] FIS: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T18:46:40.743384] [INFO ] [REMOTE    ] FIHL: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T18:46:40.751132] [INFO ] [REMOTE    ] FIHL: Full fetch complete (56367 records).
[2025-10-24T18:46:40.751253] [DEBUG] [VALIDATOR ] FIHL: Validating primary data.
[2025-10-24T18:46:40.961511] [INFO ] [REMOTE    ] FIS: Fetching primary data for 2025-03.
[2025-10-24T18:46:41.216172] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present.
[2025-10-24T18:46:41.216252] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed.
[2025-10-24T18:46:41.217095] [INFO ] [MAIN      ] FIHL: Fetched primary data is valid.
[2025-10-24T18:46:41.217184] [DEBUG] [LOCAL     ] FIHL: Saving primary data.
[2025-10-24T18:46:41.217737] [FATAL] [LOCAL     ] FIHL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:46:41.217823] [FATAL] [MAIN      ] FIHL: Failed to save primary data.
[2025-10-24T18:46:41.217864] [WARN ] [MAIN      ] FIHL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:46:41.217923] [INFO ] [LOCAL     ] FIHL: Starting deletion of primary data.
[2025-10-24T18:46:41.217982] [DEBUG] [LOCAL     ] FIHL: No primary data file found to delete.
[2025-10-24T18:46:41.218017] [INFO ] [LOCAL     ] FIHL: Starting deletion of derivative data.
[2025-10-24T18:46:41.218184] [DEBUG] [LOCAL     ] FIHL: Deleted derivative data file.
[2025-10-24T18:46:41.218405] [INFO ] [MAIN      ] Update Progress: 837/2366 symbols completed. FIHL took 33.7s. Estimated remaining: 3h 14m 48s. Rate: 7.8 symbols/min
[2025-10-24T18:46:41.747733] [INFO ] [REMOTE    ] FINV: Fetching primary data for 2025-03.
[2025-10-24T18:46:41.784155] [INFO ] [REMOTE    ] FIX: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T18:46:42.547692] [INFO ] [REMOTE    ] FIX: Fetching primary data for 2025-03.
[2025-10-24T18:46:42.937847] [INFO ] [REMOTE    ] FIS: Incremental fetch complete for 2025-03 (1.98 seconds).
[2025-10-24T18:46:43.332013] [INFO ] [REMOTE    ] FINV: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T18:46:43.347604] [INFO ] [REMOTE    ] FINV: Fetching primary data for 2025-04.
[2025-10-24T18:46:44.147715] [INFO ] [REMOTE    ] FIS: Fetching primary data for 2025-04.
[2025-10-24T18:46:44.202694] [INFO ] [REMOTE    ] FIX: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T18:46:44.953065] [INFO ] [REMOTE    ] FIX: Fetching primary data for 2025-04.
[2025-10-24T18:46:44.955376] [INFO ] [REMOTE    ] FINV: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T18:46:45.747725] [INFO ] [REMOTE    ] FINV: Fetching primary data for 2025-05.
[2025-10-24T18:46:46.099879] [INFO ] [REMOTE    ] FIS: Incremental fetch complete for 2025-04 (1.95 seconds).
[2025-10-24T18:46:46.150288] [INFO ] [REMOTE    ] FIX: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T18:46:46.547632] [INFO ] [REMOTE    ] FIS: Fetching primary data for 2025-05.
[2025-10-24T18:46:47.145109] [INFO ] [REMOTE    ] FINV: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T18:46:47.347639] [INFO ] [REMOTE    ] FIX: Fetching primary data for 2025-05.
[2025-10-24T18:46:48.011147] [INFO ] [REMOTE    ] FIS: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T18:46:48.147615] [INFO ] [REMOTE    ] FIS: Fetching primary data for 2025-06.
[2025-10-24T18:46:48.820062] [INFO ] [REMOTE    ] FIX: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T18:46:48.947616] [INFO ] [REMOTE    ] FIX: Fetching primary data for 2025-06.
[2025-10-24T18:46:49.747628] [INFO ] [REMOTE    ] FINV: Fetching primary data for 2025-06.
[2025-10-24T18:46:49.849409] [INFO ] [REMOTE    ] FIS: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T18:46:50.235540] [INFO ] [REMOTE    ] FIX: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T18:46:50.547702] [INFO ] [REMOTE    ] FIS: Fetching primary data for 2025-07.
[2025-10-24T18:46:51.241555] [INFO ] [REMOTE    ] FINV: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T18:46:51.347690] [INFO ] [REMOTE    ] FIX: Fetching primary data for 2025-07.
[2025-10-24T18:46:52.147623] [INFO ] [REMOTE    ] FINV: Fetching primary data for 2025-07.
[2025-10-24T18:46:52.303276] [INFO ] [REMOTE    ] FIS: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T18:46:52.704711] [INFO ] [REMOTE    ] FIX: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T18:46:52.947674] [INFO ] [REMOTE    ] FIX: Fetching primary data for 2025-08.
[2025-10-24T18:46:53.747670] [INFO ] [REMOTE    ] FIS: Fetching primary data for 2025-08.
[2025-10-24T18:46:53.899614] [INFO ] [REMOTE    ] FINV: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T18:46:54.146117] [INFO ] [REMOTE    ] FIX: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T18:46:54.547714] [INFO ] [REMOTE    ] FINV: Fetching primary data for 2025-08.
[2025-10-24T18:46:55.343837] [INFO ] [REMOTE    ] FIS: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T18:46:55.354350] [INFO ] [REMOTE    ] FIX: Fetching primary data for 2025-09.
[2025-10-24T18:46:56.147623] [INFO ] [REMOTE    ] FIS: Fetching primary data for 2025-09.
[2025-10-24T18:46:56.306159] [INFO ] [REMOTE    ] FINV: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T18:46:56.742418] [INFO ] [REMOTE    ] FIX: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T18:46:56.947702] [INFO ] [REMOTE    ] FINV: Fetching primary data for 2025-09.
[2025-10-24T18:46:57.747696] [INFO ] [REMOTE    ] FIX: Fetching primary data for 2025-10.
[2025-10-24T18:46:57.784955] [INFO ] [REMOTE    ] FIS: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T18:46:58.547689] [INFO ] [REMOTE    ] FIS: Fetching primary data for 2025-10.
[2025-10-24T18:46:58.626011] [INFO ] [REMOTE    ] FINV: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T18:46:59.240394] [INFO ] [REMOTE    ] FIX: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T18:46:59.245627] [INFO ] [REMOTE    ] FIX: Full fetch complete (45688 records).
[2025-10-24T18:46:59.245739] [DEBUG] [VALIDATOR ] FIX: Validating primary data.
[2025-10-24T18:46:59.352759] [INFO ] [REMOTE    ] FINV: Fetching primary data for 2025-10.
[2025-10-24T18:46:59.619612] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present.
[2025-10-24T18:46:59.619721] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed.
[2025-10-24T18:46:59.620443] [INFO ] [MAIN      ] FIX: Fetched primary data is valid.
[2025-10-24T18:46:59.620485] [DEBUG] [LOCAL     ] FIX: Saving primary data.
[2025-10-24T18:46:59.620959] [FATAL] [LOCAL     ] FIX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:46:59.621069] [FATAL] [MAIN      ] FIX: Failed to save primary data.
[2025-10-24T18:46:59.621112] [WARN ] [MAIN      ] FIX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:46:59.621171] [INFO ] [LOCAL     ] FIX: Starting deletion of primary data.
[2025-10-24T18:46:59.621229] [DEBUG] [LOCAL     ] FIX: No primary data file found to delete.
[2025-10-24T18:46:59.621264] [INFO ] [LOCAL     ] FIX: Starting deletion of derivative data.
[2025-10-24T18:46:59.621394] [DEBUG] [LOCAL     ] FIX: Deleted derivative data file.
[2025-10-24T18:46:59.621466] [INFO ] [MAIN      ] Update Progress: 838/2366 symbols completed. FIX took 24.0s. Estimated remaining: 3h 15m 0s. Rate: 7.8 symbols/min
[2025-10-24T18:47:00.468601] [INFO ] [REMOTE    ] FIS: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T18:47:00.478403] [INFO ] [REMOTE    ] FIS: Full fetch complete (77394 records).
[2025-10-24T18:47:00.478553] [DEBUG] [VALIDATOR ] FIS: Validating primary data.
[2025-10-24T18:47:00.868353] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present.
[2025-10-24T18:47:00.868436] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed.
[2025-10-24T18:47:00.869400] [INFO ] [MAIN      ] FIS: Fetched primary data is valid.
[2025-10-24T18:47:00.869471] [DEBUG] [LOCAL     ] FIS: Saving primary data.
[2025-10-24T18:47:00.870157] [FATAL] [LOCAL     ] FIS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:47:00.870265] [FATAL] [MAIN      ] FIS: Failed to save primary data.
[2025-10-24T18:47:00.870307] [WARN ] [MAIN      ] FIS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:47:00.870341] [INFO ] [LOCAL     ] FIS: Starting deletion of primary data.
[2025-10-24T18:47:00.870394] [DEBUG] [LOCAL     ] FIS: No primary data file found to delete.
[2025-10-24T18:47:00.870428] [INFO ] [LOCAL     ] FIS: Starting deletion of derivative data.
[2025-10-24T18:47:00.870590] [DEBUG] [LOCAL     ] FIS: Deleted derivative data file.
[2025-10-24T18:47:00.870959] [INFO ] [MAIN      ] Update Progress: 839/2366 symbols completed. FIS took 29.0s. Estimated remaining: 3h 14m 41s. Rate: 7.8 symbols/min
[2025-10-24T18:47:01.107090] [INFO ] [REMOTE    ] FINV: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T18:47:01.115931] [INFO ] [REMOTE    ] FINV: Full fetch complete (64991 records).
[2025-10-24T18:47:01.116080] [DEBUG] [VALIDATOR ] FINV: Validating primary data.
[2025-10-24T18:47:01.499502] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present.
[2025-10-24T18:47:01.499595] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed.
[2025-10-24T18:47:01.500465] [INFO ] [MAIN      ] FINV: Fetched primary data is valid.
[2025-10-24T18:47:01.500534] [DEBUG] [LOCAL     ] FINV: Saving primary data.
[2025-10-24T18:47:01.501144] [FATAL] [LOCAL     ] FINV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:47:01.501242] [FATAL] [MAIN      ] FINV: Failed to save primary data.
[2025-10-24T18:47:01.501283] [WARN ] [MAIN      ] FINV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:47:01.501317] [INFO ] [LOCAL     ] FINV: Starting deletion of primary data.
[2025-10-24T18:47:01.501370] [DEBUG] [LOCAL     ] FINV: No primary data file found to delete.
[2025-10-24T18:47:01.501405] [INFO ] [LOCAL     ] FINV: Starting deletion of derivative data.
[2025-10-24T18:47:01.501543] [DEBUG] [LOCAL     ] FINV: Deleted derivative data file.
[2025-10-24T18:47:01.501879] [INFO ] [MAIN      ] Update Progress: 840/2366 symbols completed. FINV took 34.7s. Estimated remaining: 3h 14m 20s. Rate: 7.9 symbols/min
[2025-10-24T18:47:02.205870] [INFO ] [MAIN      ] FLNG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:47:02.254043] [INFO ] [MAIN      ] FLC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:47:02.233586] [INFO ] [MAIN      ] FLG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:47:02.256165] [INFO ] [MAIN      ] FIXT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:47:02.257205] [DEBUG] [LOCAL     ] FIXT: No existing data file found in primary storage.
[2025-10-24T18:47:02.257259] [WARN ] [MAIN      ] FIXT: No existing data found, performing full refresh instead.
[2025-10-24T18:47:02.257372] [INFO ] [MAIN      ] FIXT: Wiping existing primary data before full refresh.
[2025-10-24T18:47:02.257416] [INFO ] [LOCAL     ] FIXT: Starting deletion of primary data.
[2025-10-24T18:47:02.257458] [DEBUG] [LOCAL     ] FIXT: No primary data file found to delete.
[2025-10-24T18:47:02.257492] [INFO ] [MAIN      ] FIXT: Starting full primary refresh.
[2025-10-24T18:47:02.316187] [DEBUG] [LOCAL     ] FLC: Loaded 5444 existing records from primary storage.
[2025-10-24T18:47:02.316606] [INFO ] [MAIN      ] FLC: Loaded 5444 existing records.
[2025-10-24T18:47:02.566992] [DEBUG] [LOCAL     ] FLNG: Loaded 33502 existing records from primary storage.
[2025-10-24T18:47:02.645093] [INFO ] [MAIN      ] FLNG: Loaded 33502 existing records.
[2025-10-24T18:47:02.679226] [DEBUG] [LOCAL     ] FLG: Loaded 53708 existing records from primary storage.
[2025-10-24T18:47:02.833976] [INFO ] [MAIN      ] FLG: Loaded 53708 existing records.
[2025-10-24T18:47:02.840510] [WARN ] [MAIN      ] FLC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:47:02.860766] [INFO ] [MAIN      ] FLC: Wiping existing primary data before full refresh.
[2025-10-24T18:47:02.906166] [INFO ] [LOCAL     ] FLC: Starting deletion of primary data.
[2025-10-24T18:47:02.970110] [DEBUG] [LOCAL     ] FLC: Deleted primary data file.
[2025-10-24T18:47:02.975471] [INFO ] [MAIN      ] FLC: Starting full primary refresh.
[2025-10-24T18:47:03.313793] [WARN ] [MAIN      ] FLNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:47:03.341304] [INFO ] [MAIN      ] FLNG: Wiping existing primary data before full refresh.
[2025-10-24T18:47:03.410567] [INFO ] [LOCAL     ] FLNG: Starting deletion of primary data.
[2025-10-24T18:47:03.427350] [INFO ] [REMOTE    ] FIXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:47:03.493022] [DEBUG] [LOCAL     ] FLNG: Deleted primary data file.
[2025-10-24T18:47:03.479500] [WARN ] [MAIN      ] FLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:47:03.493396] [INFO ] [REMOTE    ] FIXT: Fetching primary data for 2025-01.
[2025-10-24T18:47:03.493745] [INFO ] [MAIN      ] FLNG: Starting full primary refresh.
[2025-10-24T18:47:03.493677] [INFO ] [MAIN      ] FLG: Wiping existing primary data before full refresh.
[2025-10-24T18:47:03.553009] [INFO ] [LOCAL     ] FLG: Starting deletion of primary data.
[2025-10-24T18:47:03.694628] [DEBUG] [LOCAL     ] FLG: Deleted primary data file.
[2025-10-24T18:47:03.746040] [INFO ] [MAIN      ] FLG: Starting full primary refresh.
[2025-10-24T18:47:03.925715] [DEBUG] [REMOTE    ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T18:47:03.974055] [WARN ] [REMOTE    ] FIXT: No data returned for month 2025-01
[2025-10-24T18:47:04.016353] [FATAL] [REMOTE    ] FIXT: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:47:04.037529] [INFO ] [REMOTE    ] FLC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:47:04.041536] [INFO ] [REMOTE    ] FLC: Fetching primary data for 2025-01.
[2025-10-24T18:47:04.037620] [FATAL] [MAIN      ] FIXT: Failed to fetch primary data.
[2025-10-24T18:47:04.055634] [WARN ] [MAIN      ] FIXT: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:47:04.095798] [INFO ] [LOCAL     ] FIXT: Starting deletion of primary data.
[2025-10-24T18:47:04.187126] [DEBUG] [LOCAL     ] FIXT: No primary data file found to delete.
[2025-10-24T18:47:04.187285] [INFO ] [LOCAL     ] FIXT: Starting deletion of derivative data.
[2025-10-24T18:47:04.232257] [DEBUG] [LOCAL     ] FIXT: No derivative data file found to delete.
[2025-10-24T18:47:04.306867] [INFO ] [MAIN      ] Update Progress: 841/2366 symbols completed. FIXT took 2.8s. Estimated remaining: 3h 14m 4s. Rate: 7.9 symbols/min
[2025-10-24T18:47:04.411472] [INFO ] [REMOTE    ] FLNG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:47:04.438230] [INFO ] [REMOTE    ] FLNG: Fetching primary data for 2025-01.
[2025-10-24T18:47:04.636100] [INFO ] [REMOTE    ] FLG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:47:04.641618] [INFO ] [REMOTE    ] FLG: Fetching primary data for 2025-01.
[2025-10-24T18:47:04.688801] [INFO ] [MAIN      ] FLO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:47:04.740746] [DEBUG] [LOCAL     ] FLO: Loaded 52445 existing records from primary storage.
[2025-10-24T18:47:04.741049] [INFO ] [MAIN      ] FLO: Loaded 52445 existing records.
[2025-10-24T18:47:04.924939] [WARN ] [MAIN      ] FLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:47:04.925250] [INFO ] [MAIN      ] FLO: Wiping existing primary data before full refresh.
[2025-10-24T18:47:04.925298] [INFO ] [LOCAL     ] FLO: Starting deletion of primary data.
[2025-10-24T18:47:04.925749] [DEBUG] [LOCAL     ] FLO: Deleted primary data file.
[2025-10-24T18:47:04.925809] [INFO ] [MAIN      ] FLO: Starting full primary refresh.
[2025-10-24T18:47:05.098623] [INFO ] [REMOTE    ] FLC: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T18:47:05.183309] [INFO ] [REMOTE    ] FLC: Fetching primary data for 2025-02.
[2025-10-24T18:47:05.323265] [INFO ] [REMOTE    ] FLO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:47:05.323618] [INFO ] [REMOTE    ] FLO: Fetching primary data for 2025-01.
[2025-10-24T18:47:05.781766] [INFO ] [REMOTE    ] FLC: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T18:47:05.783359] [INFO ] [REMOTE    ] FLC: Fetching primary data for 2025-03.
[2025-10-24T18:47:05.812464] [INFO ] [REMOTE    ] FLNG: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T18:47:05.819616] [INFO ] [REMOTE    ] FLNG: Fetching primary data for 2025-02.
[2025-10-24T18:47:06.404240] [INFO ] [REMOTE    ] FLG: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T18:47:06.402776] [INFO ] [REMOTE    ] FLC: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T18:47:06.547689] [INFO ] [REMOTE    ] FLG: Fetching primary data for 2025-02.
[2025-10-24T18:47:06.824422] [INFO ] [REMOTE    ] FLO: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T18:47:06.855717] [INFO ] [REMOTE    ] FLNG: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T18:47:07.347709] [INFO ] [REMOTE    ] FLC: Fetching primary data for 2025-04.
[2025-10-24T18:47:08.088167] [INFO ] [REMOTE    ] FLC: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T18:47:08.091900] [INFO ] [REMOTE    ] FLG: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T18:47:08.147679] [INFO ] [REMOTE    ] FLG: Fetching primary data for 2025-03.
[2025-10-24T18:47:08.947679] [INFO ] [REMOTE    ] FLNG: Fetching primary data for 2025-03.
[2025-10-24T18:47:09.747634] [INFO ] [REMOTE    ] FLC: Fetching primary data for 2025-05.
[2025-10-24T18:47:09.921445] [INFO ] [REMOTE    ] FLG: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T18:47:10.235892] [INFO ] [REMOTE    ] FLNG: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T18:47:10.308392] [INFO ] [REMOTE    ] FLC: Incremental fetch complete for 2025-05 (0.56 seconds).
[2025-10-24T18:47:10.547637] [INFO ] [REMOTE    ] FLG: Fetching primary data for 2025-04.
[2025-10-24T18:47:11.347713] [INFO ] [REMOTE    ] FLNG: Fetching primary data for 2025-04.
[2025-10-24T18:47:12.147623] [INFO ] [REMOTE    ] FLO: Fetching primary data for 2025-02.
[2025-10-24T18:47:12.345963] [INFO ] [REMOTE    ] FLG: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T18:47:12.738150] [INFO ] [REMOTE    ] FLNG: Incremental fetch complete for 2025-04 (1.39 seconds).
[2025-10-24T18:47:12.947669] [INFO ] [REMOTE    ] FLC: Fetching primary data for 2025-06.
[2025-10-24T18:47:13.332793] [INFO ] [REMOTE    ] FLC: Incremental fetch complete for 2025-06 (0.39 seconds).
[2025-10-24T18:47:13.361781] [INFO ] [REMOTE    ] FLO: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T18:47:13.747663] [INFO ] [REMOTE    ] FLC: Fetching primary data for 2025-07.
[2025-10-24T18:47:14.345385] [INFO ] [REMOTE    ] FLC: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T18:47:14.547664] [INFO ] [REMOTE    ] FLO: Fetching primary data for 2025-03.
[2025-10-24T18:47:15.347636] [INFO ] [REMOTE    ] FLC: Fetching primary data for 2025-08.
[2025-10-24T18:47:16.075076] [INFO ] [REMOTE    ] FLC: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T18:47:16.147602] [INFO ] [REMOTE    ] FLC: Fetching primary data for 2025-09.
[2025-10-24T18:47:16.471903] [INFO ] [REMOTE    ] FLO: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T18:47:16.753040] [INFO ] [REMOTE    ] FLC: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T18:47:16.947694] [INFO ] [REMOTE    ] FLC: Fetching primary data for 2025-10.
[2025-10-24T18:47:17.662465] [INFO ] [REMOTE    ] FLC: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T18:47:17.663856] [INFO ] [REMOTE    ] FLC: Full fetch complete (7801 records).
[2025-10-24T18:47:17.663924] [DEBUG] [VALIDATOR ] FLC: Validating primary data.
[2025-10-24T18:47:17.752886] [INFO ] [REMOTE    ] FLG: Fetching primary data for 2025-05.
[2025-10-24T18:47:18.037162] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present.
[2025-10-24T18:47:18.037275] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed.
[2025-10-24T18:47:18.037685] [INFO ] [MAIN      ] FLC: Fetched primary data is valid.
[2025-10-24T18:47:18.037762] [DEBUG] [LOCAL     ] FLC: Saving primary data.
[2025-10-24T18:47:18.038053] [FATAL] [LOCAL     ] FLC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:47:18.038193] [FATAL] [MAIN      ] FLC: Failed to save primary data.
[2025-10-24T18:47:18.038266] [WARN ] [MAIN      ] FLC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:47:18.038345] [INFO ] [LOCAL     ] FLC: Starting deletion of primary data.
[2025-10-24T18:47:18.038468] [DEBUG] [LOCAL     ] FLC: No primary data file found to delete.
[2025-10-24T18:47:18.038538] [INFO ] [LOCAL     ] FLC: Starting deletion of derivative data.
[2025-10-24T18:47:18.038769] [DEBUG] [LOCAL     ] FLC: Deleted derivative data file.
[2025-10-24T18:47:18.038886] [INFO ] [MAIN      ] Update Progress: 842/2366 symbols completed. FLC took 16.5s. Estimated remaining: 3h 14m 7s. Rate: 7.9 symbols/min
[2025-10-24T18:47:18.212546] [INFO ] [MAIN      ] FLOC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:47:18.212842] [DEBUG] [LOCAL     ] FLOC: No existing data file found in primary storage.
[2025-10-24T18:47:18.212886] [WARN ] [MAIN      ] FLOC: No existing data found, performing full refresh instead.
[2025-10-24T18:47:18.212959] [INFO ] [MAIN      ] FLOC: Wiping existing primary data before full refresh.
[2025-10-24T18:47:18.212997] [INFO ] [LOCAL     ] FLOC: Starting deletion of primary data.
[2025-10-24T18:47:18.213038] [DEBUG] [LOCAL     ] FLOC: No primary data file found to delete.
[2025-10-24T18:47:18.213088] [INFO ] [MAIN      ] FLOC: Starting full primary refresh.
[2025-10-24T18:47:18.557044] [INFO ] [REMOTE    ] FLNG: Fetching primary data for 2025-05.
[2025-10-24T18:47:18.561741] [INFO ] [REMOTE    ] FLOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:47:19.347717] [INFO ] [REMOTE    ] FLO: Fetching primary data for 2025-04.
[2025-10-24T18:47:19.530974] [INFO ] [REMOTE    ] FLG: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T18:47:19.859787] [INFO ] [REMOTE    ] FLNG: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T18:47:20.147702] [INFO ] [REMOTE    ] FLNG: Fetching primary data for 2025-06.
[2025-10-24T18:47:20.947635] [INFO ] [REMOTE    ] FLG: Fetching primary data for 2025-06.
[2025-10-24T18:47:21.113323] [INFO ] [REMOTE    ] FLO: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T18:47:21.586415] [INFO ] [REMOTE    ] FLNG: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T18:47:21.747635] [INFO ] [REMOTE    ] FLO: Fetching primary data for 2025-05.
[2025-10-24T18:47:22.547611] [INFO ] [REMOTE    ] FLOC: Fetching primary data for 2025-01.
[2025-10-24T18:47:22.893659] [INFO ] [REMOTE    ] FLG: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T18:47:23.347730] [INFO ] [REMOTE    ] FLNG: Fetching primary data for 2025-07.
[2025-10-24T18:47:23.523138] [INFO ] [REMOTE    ] FLO: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T18:47:23.570625] [INFO ] [REMOTE    ] FLOC: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T18:47:24.147639] [INFO ] [REMOTE    ] FLO: Fetching primary data for 2025-06.
[2025-10-24T18:47:24.851356] [INFO ] [REMOTE    ] FLNG: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T18:47:24.947708] [INFO ] [REMOTE    ] FLNG: Fetching primary data for 2025-08.
[2025-10-24T18:47:25.728474] [INFO ] [REMOTE    ] FLO: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T18:47:25.747635] [INFO ] [REMOTE    ] FLOC: Fetching primary data for 2025-02.
[2025-10-24T18:47:26.034977] [INFO ] [REMOTE    ] FLNG: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T18:47:26.547637] [INFO ] [REMOTE    ] FLNG: Fetching primary data for 2025-09.
[2025-10-24T18:47:27.041743] [INFO ] [REMOTE    ] FLOC: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T18:47:27.347725] [INFO ] [REMOTE    ] FLOC: Fetching primary data for 2025-03.
[2025-10-24T18:47:28.082698] [INFO ] [REMOTE    ] FLNG: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T18:47:28.147631] [INFO ] [REMOTE    ] FLO: Fetching primary data for 2025-07.
[2025-10-24T18:47:28.776494] [INFO ] [REMOTE    ] FLOC: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T18:47:28.947618] [INFO ] [REMOTE    ] FLOC: Fetching primary data for 2025-04.
[2025-10-24T18:47:29.747682] [INFO ] [REMOTE    ] FLG: Fetching primary data for 2025-07.
[2025-10-24T18:47:30.012927] [INFO ] [REMOTE    ] FLO: Incremental fetch complete for 2025-07 (1.87 seconds).
[2025-10-24T18:47:30.118579] [INFO ] [REMOTE    ] FLOC: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T18:47:30.547695] [INFO ] [REMOTE    ] FLOC: Fetching primary data for 2025-05.
[2025-10-24T18:47:31.347725] [INFO ] [REMOTE    ] FLNG: Fetching primary data for 2025-10.
[2025-10-24T18:47:31.543472] [INFO ] [REMOTE    ] FLG: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T18:47:31.579539] [INFO ] [REMOTE    ] FLOC: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T18:47:32.147732] [INFO ] [REMOTE    ] FLG: Fetching primary data for 2025-08.
[2025-10-24T18:47:32.774410] [INFO ] [REMOTE    ] FLNG: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T18:47:32.780822] [INFO ] [REMOTE    ] FLNG: Full fetch complete (49706 records).
[2025-10-24T18:47:32.781011] [DEBUG] [VALIDATOR ] FLNG: Validating primary data.
[2025-10-24T18:47:32.954896] [INFO ] [REMOTE    ] FLO: Fetching primary data for 2025-08.
[2025-10-24T18:47:33.163066] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present.
[2025-10-24T18:47:33.163148] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed.
[2025-10-24T18:47:33.163971] [INFO ] [MAIN      ] FLNG: Fetched primary data is valid.
[2025-10-24T18:47:33.164033] [DEBUG] [LOCAL     ] FLNG: Saving primary data.
[2025-10-24T18:47:33.164467] [FATAL] [LOCAL     ] FLNG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:47:33.164550] [FATAL] [MAIN      ] FLNG: Failed to save primary data.
[2025-10-24T18:47:33.164593] [WARN ] [MAIN      ] FLNG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:47:33.164631] [INFO ] [LOCAL     ] FLNG: Starting deletion of primary data.
[2025-10-24T18:47:33.164725] [DEBUG] [LOCAL     ] FLNG: No primary data file found to delete.
[2025-10-24T18:47:33.164769] [INFO ] [LOCAL     ] FLNG: Starting deletion of derivative data.
[2025-10-24T18:47:33.165145] [DEBUG] [LOCAL     ] FLNG: Deleted derivative data file.
[2025-10-24T18:47:33.165245] [INFO ] [MAIN      ] Update Progress: 843/2366 symbols completed. FLNG took 31.7s. Estimated remaining: 3h 14m 13s. Rate: 7.8 symbols/min
[2025-10-24T18:47:33.337709] [INFO ] [MAIN      ] FLR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:47:33.389625] [DEBUG] [LOCAL     ] FLR: Loaded 53643 existing records from primary storage.
[2025-10-24T18:47:33.390008] [INFO ] [MAIN      ] FLR: Loaded 53643 existing records.
[2025-10-24T18:47:33.565301] [WARN ] [MAIN      ] FLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:47:33.565480] [INFO ] [MAIN      ] FLR: Wiping existing primary data before full refresh.
[2025-10-24T18:47:33.565525] [INFO ] [LOCAL     ] FLR: Starting deletion of primary data.
[2025-10-24T18:47:33.566574] [DEBUG] [LOCAL     ] FLR: Deleted primary data file.
[2025-10-24T18:47:33.566631] [INFO ] [MAIN      ] FLR: Starting full primary refresh.
[2025-10-24T18:47:33.749137] [INFO ] [REMOTE    ] FLOC: Fetching primary data for 2025-06.
[2025-10-24T18:47:33.937595] [INFO ] [REMOTE    ] FLR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:47:34.016802] [INFO ] [REMOTE    ] FLG: Incremental fetch complete for 2025-08 (1.87 seconds).
[2025-10-24T18:47:34.195068] [INFO ] [REMOTE    ] FLO: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T18:47:34.547669] [INFO ] [REMOTE    ] FLG: Fetching primary data for 2025-09.
[2025-10-24T18:47:34.965686] [INFO ] [REMOTE    ] FLOC: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T18:47:35.347664] [INFO ] [REMOTE    ] FLO: Fetching primary data for 2025-09.
[2025-10-24T18:47:36.147626] [INFO ] [REMOTE    ] FLOC: Fetching primary data for 2025-07.
[2025-10-24T18:47:36.403950] [INFO ] [REMOTE    ] FLG: Incremental fetch complete for 2025-09 (1.86 seconds).
[2025-10-24T18:47:36.947613] [INFO ] [REMOTE    ] FLR: Fetching primary data for 2025-01.
[2025-10-24T18:47:37.051679] [INFO ] [REMOTE    ] FLO: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T18:47:37.304679] [INFO ] [REMOTE    ] FLOC: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T18:47:37.747631] [INFO ] [REMOTE    ] FLOC: Fetching primary data for 2025-08.
[2025-10-24T18:47:38.529437] [INFO ] [REMOTE    ] FLR: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T18:47:38.547612] [INFO ] [REMOTE    ] FLG: Fetching primary data for 2025-10.
[2025-10-24T18:47:38.994617] [INFO ] [REMOTE    ] FLOC: Incremental fetch complete for 2025-08 (1.25 seconds).
[2025-10-24T18:47:39.347635] [INFO ] [REMOTE    ] FLO: Fetching primary data for 2025-10.
[2025-10-24T18:47:40.147617] [INFO ] [REMOTE    ] FLOC: Fetching primary data for 2025-09.
[2025-10-24T18:47:40.554326] [INFO ] [REMOTE    ] FLG: Incremental fetch complete for 2025-10 (2.01 seconds).
[2025-10-24T18:47:40.564824] [INFO ] [REMOTE    ] FLG: Full fetch complete (77426 records).
[2025-10-24T18:47:40.564983] [DEBUG] [VALIDATOR ] FLG: Validating primary data.
[2025-10-24T18:47:40.950323] [INFO ] [REMOTE    ] FLR: Fetching primary data for 2025-02.
[2025-10-24T18:47:41.039860] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present.
[2025-10-24T18:47:41.040206] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed.
[2025-10-24T18:47:41.041807] [INFO ] [MAIN      ] FLG: Fetched primary data is valid.
[2025-10-24T18:47:41.041966] [DEBUG] [LOCAL     ] FLG: Saving primary data.
[2025-10-24T18:47:41.048571] [FATAL] [LOCAL     ] FLG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:47:41.059213] [INFO ] [REMOTE    ] FLOC: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T18:47:41.058031] [FATAL] [MAIN      ] FLG: Failed to save primary data.
[2025-10-24T18:47:41.064916] [WARN ] [MAIN      ] FLG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:47:41.065599] [INFO ] [LOCAL     ] FLG: Starting deletion of primary data.
[2025-10-24T18:47:41.066312] [DEBUG] [LOCAL     ] FLG: No primary data file found to delete.
[2025-10-24T18:47:41.066408] [INFO ] [LOCAL     ] FLG: Starting deletion of derivative data.
[2025-10-24T18:47:41.066789] [DEBUG] [LOCAL     ] FLG: Deleted derivative data file.
[2025-10-24T18:47:41.067154] [INFO ] [MAIN      ] Update Progress: 844/2366 symbols completed. FLG took 39.6s. Estimated remaining: 3h 14m 6s. Rate: 7.8 symbols/min
[2025-10-24T18:47:41.206861] [INFO ] [REMOTE    ] FLO: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T18:47:41.244926] [INFO ] [REMOTE    ] FLO: Full fetch complete (75403 records).
[2025-10-24T18:47:41.264174] [DEBUG] [VALIDATOR ] FLO: Validating primary data.
[2025-10-24T18:47:41.322966] [INFO ] [MAIN      ] FLS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:47:41.707776] [DEBUG] [LOCAL     ] FLS: Loaded 50773 existing records from primary storage.
[2025-10-24T18:47:41.731059] [INFO ] [MAIN      ] FLS: Loaded 50773 existing records.
[2025-10-24T18:47:41.774495] [INFO ] [REMOTE    ] FLOC: Fetching primary data for 2025-10.
[2025-10-24T18:47:41.774681] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present.
[2025-10-24T18:47:41.787188] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed.
[2025-10-24T18:47:41.829396] [INFO ] [MAIN      ] FLO: Fetched primary data is valid.
[2025-10-24T18:47:41.841358] [DEBUG] [LOCAL     ] FLO: Saving primary data.
[2025-10-24T18:47:41.852831] [FATAL] [LOCAL     ] FLO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:47:41.863243] [FATAL] [MAIN      ] FLO: Failed to save primary data.
[2025-10-24T18:47:41.868453] [WARN ] [MAIN      ] FLO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:47:41.899327] [INFO ] [LOCAL     ] FLO: Starting deletion of primary data.
[2025-10-24T18:47:41.919488] [WARN ] [MAIN      ] FLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:47:41.919712] [DEBUG] [LOCAL     ] FLO: No primary data file found to delete.
[2025-10-24T18:47:41.919795] [INFO ] [MAIN      ] FLS: Wiping existing primary data before full refresh.
[2025-10-24T18:47:41.919864] [INFO ] [LOCAL     ] FLS: Starting deletion of primary data.
[2025-10-24T18:47:41.919922] [INFO ] [LOCAL     ] FLO: Starting deletion of derivative data.
[2025-10-24T18:47:41.920135] [DEBUG] [LOCAL     ] FLO: Deleted derivative data file.
[2025-10-24T18:47:41.920605] [INFO ] [MAIN      ] Update Progress: 845/2366 symbols completed. FLO took 37.6s. Estimated remaining: 3h 13m 46s. Rate: 7.8 symbols/min
[2025-10-24T18:47:41.952820] [DEBUG] [LOCAL     ] FLS: Deleted primary data file.
[2025-10-24T18:47:41.989719] [INFO ] [MAIN      ] FLS: Starting full primary refresh.
[2025-10-24T18:47:42.238069] [INFO ] [MAIN      ] FLUT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:47:42.474502] [INFO ] [REMOTE    ] FLS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:47:42.519583] [DEBUG] [LOCAL     ] FLUT: Loaded 51016 existing records from primary storage.
[2025-10-24T18:47:42.520102] [INFO ] [MAIN      ] FLUT: Loaded 51016 existing records.
[2025-10-24T18:47:42.552821] [INFO ] [REMOTE    ] FLS: Fetching primary data for 2025-01.
[2025-10-24T18:47:42.713695] [WARN ] [MAIN      ] FLUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:47:42.714338] [INFO ] [MAIN      ] FLUT: Wiping existing primary data before full refresh.
[2025-10-24T18:47:42.714452] [INFO ] [LOCAL     ] FLUT: Starting deletion of primary data.
[2025-10-24T18:47:42.715580] [DEBUG] [LOCAL     ] FLUT: Deleted primary data file.
[2025-10-24T18:47:42.715712] [INFO ] [MAIN      ] FLUT: Starting full primary refresh.
[2025-10-24T18:47:42.890980] [INFO ] [REMOTE    ] FLR: Incremental fetch complete for 2025-02 (1.94 seconds).
[2025-10-24T18:47:43.089743] [INFO ] [REMOTE    ] FLOC: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T18:47:43.119404] [INFO ] [REMOTE    ] FLOC: Full fetch complete (41297 records).
[2025-10-24T18:47:43.130219] [DEBUG] [VALIDATOR ] FLOC: Validating primary data.
[2025-10-24T18:47:43.311619] [INFO ] [REMOTE    ] FLUT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:47:43.352856] [INFO ] [REMOTE    ] FLUT: Fetching primary data for 2025-01.
[2025-10-24T18:47:43.436883] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days
[2025-10-24T18:47:43.437380] [FATAL] [MAIN      ] FLOC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:47:43.437453] [WARN ] [MAIN      ] FLOC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:47:43.437529] [INFO ] [LOCAL     ] FLOC: Starting deletion of primary data.
[2025-10-24T18:47:43.437601] [DEBUG] [LOCAL     ] FLOC: No primary data file found to delete.
[2025-10-24T18:47:43.437638] [INFO ] [LOCAL     ] FLOC: Starting deletion of derivative data.
[2025-10-24T18:47:43.437727] [DEBUG] [LOCAL     ] FLOC: No derivative data file found to delete.
[2025-10-24T18:47:43.437791] [INFO ] [MAIN      ] Update Progress: 846/2366 symbols completed. FLOC took 25.4s. Estimated remaining: 3h 13m 28s. Rate: 7.9 symbols/min
[2025-10-24T18:47:43.603663] [INFO ] [MAIN      ] FLXR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:47:43.624857] [DEBUG] [LOCAL     ] FLXR: Loaded 21596 existing records from primary storage.
[2025-10-24T18:47:43.625118] [INFO ] [MAIN      ] FLXR: Loaded 21596 existing records.
[2025-10-24T18:47:43.802079] [WARN ] [MAIN      ] FLXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:47:43.802455] [INFO ] [MAIN      ] FLXR: Wiping existing primary data before full refresh.
[2025-10-24T18:47:43.802564] [INFO ] [LOCAL     ] FLXR: Starting deletion of primary data.
[2025-10-24T18:47:43.803283] [DEBUG] [LOCAL     ] FLXR: Deleted primary data file.
[2025-10-24T18:47:43.803351] [INFO ] [MAIN      ] FLXR: Starting full primary refresh.
[2025-10-24T18:47:43.943249] [INFO ] [REMOTE    ] FLS: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T18:47:44.156813] [INFO ] [REMOTE    ] FLR: Fetching primary data for 2025-03.
[2025-10-24T18:47:44.249465] [INFO ] [REMOTE    ] FLXR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:47:44.955283] [INFO ] [REMOTE    ] FLXR: Fetching primary data for 2025-01.
[2025-10-24T18:47:44.962433] [INFO ] [REMOTE    ] FLUT: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T18:47:45.747631] [INFO ] [REMOTE    ] FLUT: Fetching primary data for 2025-02.
[2025-10-24T18:47:45.811887] [INFO ] [REMOTE    ] FLR: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T18:47:45.897017] [INFO ] [REMOTE    ] FLXR: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T18:47:46.547749] [INFO ] [REMOTE    ] FLXR: Fetching primary data for 2025-02.
[2025-10-24T18:47:47.232192] [INFO ] [REMOTE    ] FLUT: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T18:47:47.334441] [INFO ] [REMOTE    ] FLXR: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T18:47:47.347616] [INFO ] [REMOTE    ] FLXR: Fetching primary data for 2025-03.
[2025-10-24T18:47:48.147679] [INFO ] [REMOTE    ] FLUT: Fetching primary data for 2025-03.
[2025-10-24T18:47:48.244165] [INFO ] [REMOTE    ] FLXR: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T18:47:48.947737] [INFO ] [REMOTE    ] FLS: Fetching primary data for 2025-02.
[2025-10-24T18:47:49.747663] [INFO ] [REMOTE    ] FLR: Fetching primary data for 2025-04.
[2025-10-24T18:47:49.992108] [INFO ] [REMOTE    ] FLUT: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T18:47:50.032726] [INFO ] [REMOTE    ] FLS: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T18:47:50.547728] [INFO ] [REMOTE    ] FLXR: Fetching primary data for 2025-04.
[2025-10-24T18:47:51.347613] [INFO ] [REMOTE    ] FLUT: Fetching primary data for 2025-04.
[2025-10-24T18:47:51.386023] [INFO ] [REMOTE    ] FLXR: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T18:47:51.534426] [INFO ] [REMOTE    ] FLR: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T18:47:52.147758] [INFO ] [REMOTE    ] FLS: Fetching primary data for 2025-03.
[2025-10-24T18:47:52.947634] [INFO ] [REMOTE    ] FLR: Fetching primary data for 2025-05.
[2025-10-24T18:47:52.983045] [INFO ] [REMOTE    ] FLUT: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T18:47:53.399986] [INFO ] [REMOTE    ] FLS: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T18:47:53.747629] [INFO ] [REMOTE    ] FLS: Fetching primary data for 2025-04.
[2025-10-24T18:47:54.547720] [INFO ] [REMOTE    ] FLXR: Fetching primary data for 2025-05.
[2025-10-24T18:47:54.907104] [INFO ] [REMOTE    ] FLR: Incremental fetch complete for 2025-05 (1.96 seconds).
[2025-10-24T18:47:54.980852] [INFO ] [REMOTE    ] FLS: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T18:47:55.347700] [INFO ] [REMOTE    ] FLS: Fetching primary data for 2025-05.
[2025-10-24T18:47:55.533459] [INFO ] [REMOTE    ] FLXR: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T18:47:56.147692] [INFO ] [REMOTE    ] FLXR: Fetching primary data for 2025-06.
[2025-10-24T18:47:56.603258] [INFO ] [REMOTE    ] FLS: Incremental fetch complete for 2025-05 (1.26 seconds).
[2025-10-24T18:47:56.947686] [INFO ] [REMOTE    ] FLR: Fetching primary data for 2025-06.
[2025-10-24T18:47:57.140870] [INFO ] [REMOTE    ] FLXR: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T18:47:57.747701] [INFO ] [REMOTE    ] FLS: Fetching primary data for 2025-06.
[2025-10-24T18:47:58.547722] [INFO ] [REMOTE    ] FLUT: Fetching primary data for 2025-05.
[2025-10-24T18:47:58.743110] [INFO ] [REMOTE    ] FLR: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T18:47:58.995414] [INFO ] [REMOTE    ] FLS: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T18:47:59.347739] [INFO ] [REMOTE    ] FLS: Fetching primary data for 2025-07.
[2025-10-24T18:48:00.147628] [INFO ] [REMOTE    ] FLXR: Fetching primary data for 2025-07.
[2025-10-24T18:48:00.326189] [INFO ] [REMOTE    ] FLUT: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T18:48:00.947611] [INFO ] [REMOTE    ] FLUT: Fetching primary data for 2025-06.
[2025-10-24T18:48:01.245894] [INFO ] [REMOTE    ] FLS: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T18:48:01.270574] [INFO ] [REMOTE    ] FLXR: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T18:48:01.747676] [INFO ] [REMOTE    ] FLR: Fetching primary data for 2025-07.
[2025-10-24T18:48:02.547619] [INFO ] [REMOTE    ] FLXR: Fetching primary data for 2025-08.
[2025-10-24T18:48:02.791703] [INFO ] [REMOTE    ] FLUT: Incremental fetch complete for 2025-06 (1.84 seconds).
[2025-10-24T18:48:03.347612] [INFO ] [REMOTE    ] FLUT: Fetching primary data for 2025-07.
[2025-10-24T18:48:03.589776] [INFO ] [REMOTE    ] FLXR: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T18:48:03.673941] [INFO ] [REMOTE    ] FLR: Incremental fetch complete for 2025-07 (1.93 seconds).
[2025-10-24T18:48:04.147670] [INFO ] [REMOTE    ] FLR: Fetching primary data for 2025-08.
[2025-10-24T18:48:04.947724] [INFO ] [REMOTE    ] FLS: Fetching primary data for 2025-08.
[2025-10-24T18:48:05.251915] [INFO ] [REMOTE    ] FLUT: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T18:48:05.747624] [INFO ] [REMOTE    ] FLXR: Fetching primary data for 2025-09.
[2025-10-24T18:48:06.184136] [INFO ] [REMOTE    ] FLR: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T18:48:06.547602] [INFO ] [REMOTE    ] FLUT: Fetching primary data for 2025-08.
[2025-10-24T18:48:06.941422] [INFO ] [REMOTE    ] FLXR: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T18:48:07.339005] [INFO ] [REMOTE    ] FLS: Incremental fetch complete for 2025-08 (2.39 seconds).
[2025-10-24T18:48:07.348537] [INFO ] [REMOTE    ] FLR: Fetching primary data for 2025-09.
[2025-10-24T18:48:08.147633] [INFO ] [REMOTE    ] FLS: Fetching primary data for 2025-09.
[2025-10-24T18:48:08.195093] [INFO ] [REMOTE    ] FLUT: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T18:48:08.947638] [INFO ] [REMOTE    ] FLUT: Fetching primary data for 2025-09.
[2025-10-24T18:48:09.061048] [INFO ] [REMOTE    ] FLR: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T18:48:09.720951] [INFO ] [REMOTE    ] FLS: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T18:48:09.747607] [INFO ] [REMOTE    ] FLS: Fetching primary data for 2025-10.
[2025-10-24T18:48:10.547617] [INFO ] [REMOTE    ] FLR: Fetching primary data for 2025-10.
[2025-10-24T18:48:10.901851] [INFO ] [REMOTE    ] FLUT: Incremental fetch complete for 2025-09 (1.95 seconds).
[2025-10-24T18:48:11.347621] [INFO ] [REMOTE    ] FLUT: Fetching primary data for 2025-10.
[2025-10-24T18:48:11.496318] [INFO ] [REMOTE    ] FLS: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T18:48:11.505682] [INFO ] [REMOTE    ] FLS: Full fetch complete (72545 records).
[2025-10-24T18:48:11.505818] [DEBUG] [VALIDATOR ] FLS: Validating primary data.
[2025-10-24T18:48:11.888043] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present.
[2025-10-24T18:48:11.888131] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed.
[2025-10-24T18:48:11.889041] [INFO ] [MAIN      ] FLS: Fetched primary data is valid.
[2025-10-24T18:48:11.889105] [DEBUG] [LOCAL     ] FLS: Saving primary data.
[2025-10-24T18:48:11.889732] [FATAL] [LOCAL     ] FLS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:48:11.889822] [FATAL] [MAIN      ] FLS: Failed to save primary data.
[2025-10-24T18:48:11.889864] [WARN ] [MAIN      ] FLS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:48:11.889927] [INFO ] [LOCAL     ] FLS: Starting deletion of primary data.
[2025-10-24T18:48:11.889988] [DEBUG] [LOCAL     ] FLS: No primary data file found to delete.
[2025-10-24T18:48:11.890024] [INFO ] [LOCAL     ] FLS: Starting deletion of derivative data.
[2025-10-24T18:48:11.890165] [DEBUG] [LOCAL     ] FLS: Deleted derivative data file.
[2025-10-24T18:48:11.890631] [INFO ] [MAIN      ] Update Progress: 847/2366 symbols completed. FLS took 30.8s. Estimated remaining: 3h 13m 57s. Rate: 7.8 symbols/min
[2025-10-24T18:48:12.061184] [INFO ] [MAIN      ] FMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:48:12.111012] [DEBUG] [LOCAL     ] FMC: Loaded 52264 existing records from primary storage.
[2025-10-24T18:48:12.111362] [INFO ] [MAIN      ] FMC: Loaded 52264 existing records.
[2025-10-24T18:48:12.154118] [INFO ] [REMOTE    ] FLXR: Fetching primary data for 2025-10.
[2025-10-24T18:48:12.290135] [WARN ] [MAIN      ] FMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:48:12.290363] [INFO ] [MAIN      ] FMC: Wiping existing primary data before full refresh.
[2025-10-24T18:48:12.290410] [INFO ] [LOCAL     ] FMC: Starting deletion of primary data.
[2025-10-24T18:48:12.291441] [DEBUG] [LOCAL     ] FMC: Deleted primary data file.
[2025-10-24T18:48:12.291497] [INFO ] [MAIN      ] FMC: Starting full primary refresh.
[2025-10-24T18:48:12.646263] [INFO ] [REMOTE    ] FMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:48:12.680205] [INFO ] [REMOTE    ] FLR: Incremental fetch complete for 2025-10 (2.13 seconds).
[2025-10-24T18:48:12.690322] [INFO ] [REMOTE    ] FLR: Full fetch complete (76910 records).
[2025-10-24T18:48:12.690459] [DEBUG] [VALIDATOR ] FLR: Validating primary data.
[2025-10-24T18:48:12.957698] [INFO ] [REMOTE    ] FMC: Fetching primary data for 2025-01.
[2025-10-24T18:48:13.087394] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present.
[2025-10-24T18:48:13.087493] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed.
[2025-10-24T18:48:13.088834] [INFO ] [MAIN      ] FLR: Fetched primary data is valid.
[2025-10-24T18:48:13.089154] [DEBUG] [LOCAL     ] FLR: Saving primary data.
[2025-10-24T18:48:13.089883] [FATAL] [LOCAL     ] FLR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:48:13.089970] [FATAL] [MAIN      ] FLR: Failed to save primary data.
[2025-10-24T18:48:13.090040] [WARN ] [MAIN      ] FLR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:48:13.090124] [INFO ] [LOCAL     ] FLR: Starting deletion of primary data.
[2025-10-24T18:48:13.090209] [DEBUG] [LOCAL     ] FLR: No primary data file found to delete.
[2025-10-24T18:48:13.090251] [INFO ] [LOCAL     ] FLR: Starting deletion of derivative data.
[2025-10-24T18:48:13.090391] [DEBUG] [LOCAL     ] FLR: Deleted derivative data file.
[2025-10-24T18:48:13.090968] [INFO ] [MAIN      ] Update Progress: 848/2366 symbols completed. FLR took 39.9s. Estimated remaining: 3h 13m 38s. Rate: 7.8 symbols/min
[2025-10-24T18:48:13.263824] [INFO ] [MAIN      ] FMN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:48:13.293685] [INFO ] [REMOTE    ] FLUT: Incremental fetch complete for 2025-10 (1.95 seconds).
[2025-10-24T18:48:13.307262] [INFO ] [REMOTE    ] FLUT: Full fetch complete (73395 records).
[2025-10-24T18:48:13.307582] [DEBUG] [LOCAL     ] FMN: Loaded 5496 existing records from primary storage.
[2025-10-24T18:48:13.308214] [INFO ] [MAIN      ] FMN: Loaded 5496 existing records.
[2025-10-24T18:48:13.307975] [DEBUG] [VALIDATOR ] FLUT: Validating primary data.
[2025-10-24T18:48:13.597497] [INFO ] [REMOTE    ] FLXR: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T18:48:13.635448] [WARN ] [MAIN      ] FMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:48:13.656630] [INFO ] [MAIN      ] FMN: Wiping existing primary data before full refresh.
[2025-10-24T18:48:13.684861] [INFO ] [LOCAL     ] FMN: Starting deletion of primary data.
[2025-10-24T18:48:13.729415] [INFO ] [REMOTE    ] FLXR: Full fetch complete (27850 records).
[2025-10-24T18:48:13.734831] [DEBUG] [LOCAL     ] FMN: Deleted primary data file.
[2025-10-24T18:48:13.734788] [DEBUG] [VALIDATOR ] FLXR: Validating primary data.
[2025-10-24T18:48:13.768539] [INFO ] [MAIN      ] FMN: Starting full primary refresh.
[2025-10-24T18:48:14.368923] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present.
[2025-10-24T18:48:14.369112] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed.
[2025-10-24T18:48:14.422174] [INFO ] [MAIN      ] FLUT: Fetched primary data is valid.
[2025-10-24T18:48:14.457057] [DEBUG] [LOCAL     ] FLUT: Saving primary data.
[2025-10-24T18:48:14.507220] [FATAL] [LOCAL     ] FLUT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:48:14.512635] [FATAL] [MAIN      ] FLUT: Failed to save primary data.
[2025-10-24T18:48:14.523268] [WARN ] [MAIN      ] FLUT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:48:14.561100] [INFO ] [LOCAL     ] FLUT: Starting deletion of primary data.
[2025-10-24T18:48:14.715909] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present.
[2025-10-24T18:48:14.715579] [INFO ] [REMOTE    ] FMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:48:14.715694] [DEBUG] [LOCAL     ] FLUT: No primary data file found to delete.
[2025-10-24T18:48:14.716254] [INFO ] [LOCAL     ] FLUT: Starting deletion of derivative data.
[2025-10-24T18:48:14.716509] [INFO ] [REMOTE    ] FMN: Fetching primary data for 2025-01.
[2025-10-24T18:48:14.716719] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed.
[2025-10-24T18:48:14.718124] [INFO ] [MAIN      ] FLXR: Fetched primary data is valid.
[2025-10-24T18:48:14.718235] [DEBUG] [LOCAL     ] FLXR: Saving primary data.
[2025-10-24T18:48:14.718778] [DEBUG] [LOCAL     ] FLUT: Deleted derivative data file.
[2025-10-24T18:48:14.719265] [INFO ] [MAIN      ] Update Progress: 849/2366 symbols completed. FLUT took 32.8s. Estimated remaining: 3h 13m 20s. Rate: 7.8 symbols/min
[2025-10-24T18:48:14.718616] [FATAL] [LOCAL     ] FLXR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:48:14.740805] [FATAL] [MAIN      ] FLXR: Failed to save primary data.
[2025-10-24T18:48:14.763200] [WARN ] [MAIN      ] FLXR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:48:14.775119] [INFO ] [LOCAL     ] FLXR: Starting deletion of primary data.
[2025-10-24T18:48:14.795682] [DEBUG] [LOCAL     ] FLXR: No primary data file found to delete.
[2025-10-24T18:48:14.801056] [INFO ] [LOCAL     ] FLXR: Starting deletion of derivative data.
[2025-10-24T18:48:14.812143] [DEBUG] [LOCAL     ] FLXR: Deleted derivative data file.
[2025-10-24T18:48:14.822902] [INFO ] [MAIN      ] Update Progress: 850/2366 symbols completed. FLXR took 31.4s. Estimated remaining: 3h 12m 59s. Rate: 7.9 symbols/min
[2025-10-24T18:48:14.976910] [INFO ] [MAIN      ] FMS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:48:15.030765] [INFO ] [REMOTE    ] FMC: Incremental fetch complete for 2025-01 (2.07 seconds).
[2025-10-24T18:48:15.081908] [INFO ] [REMOTE    ] FMC: Fetching primary data for 2025-02.
[2025-10-24T18:48:15.115018] [INFO ] [MAIN      ] FMX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:48:15.137941] [DEBUG] [LOCAL     ] FMS: Loaded 30525 existing records from primary storage.
[2025-10-24T18:48:15.138233] [INFO ] [MAIN      ] FMS: Loaded 30525 existing records.
[2025-10-24T18:48:15.328158] [WARN ] [MAIN      ] FMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:48:15.328489] [INFO ] [MAIN      ] FMS: Wiping existing primary data before full refresh.
[2025-10-24T18:48:15.328615] [INFO ] [LOCAL     ] FMS: Starting deletion of primary data.
[2025-10-24T18:48:15.341505] [DEBUG] [LOCAL     ] FMS: Deleted primary data file.
[2025-10-24T18:48:15.341599] [INFO ] [MAIN      ] FMS: Starting full primary refresh.
[2025-10-24T18:48:15.421150] [DEBUG] [LOCAL     ] FMX: Loaded 40643 existing records from primary storage.
[2025-10-24T18:48:15.446211] [INFO ] [MAIN      ] FMX: Loaded 40643 existing records.
[2025-10-24T18:48:15.801577] [WARN ] [MAIN      ] FMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:48:15.841355] [INFO ] [MAIN      ] FMX: Wiping existing primary data before full refresh.
[2025-10-24T18:48:15.841749] [INFO ] [REMOTE    ] FMN: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T18:48:15.852506] [INFO ] [LOCAL     ] FMX: Starting deletion of primary data.
[2025-10-24T18:48:15.861588] [INFO ] [REMOTE    ] FMN: Fetching primary data for 2025-02.
[2025-10-24T18:48:15.867011] [DEBUG] [LOCAL     ] FMX: Deleted primary data file.
[2025-10-24T18:48:15.867150] [INFO ] [MAIN      ] FMX: Starting full primary refresh.
[2025-10-24T18:48:16.013184] [INFO ] [REMOTE    ] FMS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:48:16.153069] [INFO ] [REMOTE    ] FMS: Fetching primary data for 2025-01.
[2025-10-24T18:48:16.302443] [INFO ] [REMOTE    ] FMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:48:16.947708] [INFO ] [REMOTE    ] FMX: Fetching primary data for 2025-01.
[2025-10-24T18:48:17.118635] [INFO ] [REMOTE    ] FMC: Incremental fetch complete for 2025-02 (2.04 seconds).
[2025-10-24T18:48:17.152125] [INFO ] [REMOTE    ] FMN: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T18:48:17.425789] [INFO ] [REMOTE    ] FMS: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T18:48:17.747754] [INFO ] [REMOTE    ] FMN: Fetching primary data for 2025-03.
[2025-10-24T18:48:18.237182] [INFO ] [REMOTE    ] FMX: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T18:48:18.540015] [INFO ] [REMOTE    ] FMN: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T18:48:18.547607] [INFO ] [REMOTE    ] FMX: Fetching primary data for 2025-02.
[2025-10-24T18:48:19.347720] [INFO ] [REMOTE    ] FMC: Fetching primary data for 2025-03.
[2025-10-24T18:48:20.135469] [INFO ] [REMOTE    ] FMX: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T18:48:20.147607] [INFO ] [REMOTE    ] FMX: Fetching primary data for 2025-03.
[2025-10-24T18:48:20.947683] [INFO ] [REMOTE    ] FMN: Fetching primary data for 2025-04.
[2025-10-24T18:48:21.358208] [INFO ] [REMOTE    ] FMC: Incremental fetch complete for 2025-03 (2.01 seconds).
[2025-10-24T18:48:21.549274] [INFO ] [REMOTE    ] FMX: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T18:48:21.698961] [INFO ] [REMOTE    ] FMN: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T18:48:21.747613] [INFO ] [REMOTE    ] FMN: Fetching primary data for 2025-05.
[2025-10-24T18:48:22.311035] [INFO ] [REMOTE    ] FMN: Incremental fetch complete for 2025-05 (0.56 seconds).
[2025-10-24T18:48:22.547680] [INFO ] [REMOTE    ] FMN: Fetching primary data for 2025-06.
[2025-10-24T18:48:23.347672] [INFO ] [REMOTE    ] FMX: Fetching primary data for 2025-04.
[2025-10-24T18:48:23.413115] [INFO ] [REMOTE    ] FMN: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T18:48:24.147737] [INFO ] [REMOTE    ] FMC: Fetching primary data for 2025-04.
[2025-10-24T18:48:24.804786] [INFO ] [REMOTE    ] FMX: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T18:48:24.947632] [INFO ] [REMOTE    ] FMX: Fetching primary data for 2025-05.
[2025-10-24T18:48:25.743509] [INFO ] [REMOTE    ] FMC: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T18:48:25.753464] [INFO ] [REMOTE    ] FMS: Fetching primary data for 2025-02.
[2025-10-24T18:48:26.395233] [INFO ] [REMOTE    ] FMX: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T18:48:26.547615] [INFO ] [REMOTE    ] FMX: Fetching primary data for 2025-06.
[2025-10-24T18:48:26.873438] [INFO ] [REMOTE    ] FMS: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T18:48:27.347701] [INFO ] [REMOTE    ] FMC: Fetching primary data for 2025-05.
[2025-10-24T18:48:27.705172] [INFO ] [REMOTE    ] FMX: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T18:48:28.147706] [INFO ] [REMOTE    ] FMX: Fetching primary data for 2025-07.
[2025-10-24T18:48:28.947619] [INFO ] [REMOTE    ] FMN: Fetching primary data for 2025-07.
[2025-10-24T18:48:29.273927] [INFO ] [REMOTE    ] FMC: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T18:48:29.551547] [INFO ] [REMOTE    ] FMN: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T18:48:29.747666] [INFO ] [REMOTE    ] FMN: Fetching primary data for 2025-08.
[2025-10-24T18:48:29.855204] [INFO ] [REMOTE    ] FMX: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T18:48:30.153047] [INFO ] [REMOTE    ] FMN: Incremental fetch complete for 2025-08 (0.41 seconds).
[2025-10-24T18:48:30.547680] [INFO ] [REMOTE    ] FMN: Fetching primary data for 2025-09.
[2025-10-24T18:48:31.131070] [INFO ] [REMOTE    ] FMN: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T18:48:31.347664] [INFO ] [REMOTE    ] FMN: Fetching primary data for 2025-10.
[2025-10-24T18:48:32.076976] [INFO ] [REMOTE    ] FMN: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T18:48:32.078865] [INFO ] [REMOTE    ] FMN: Full fetch complete (9790 records).
[2025-10-24T18:48:32.078942] [DEBUG] [VALIDATOR ] FMN: Validating primary data.
[2025-10-24T18:48:32.152913] [INFO ] [REMOTE    ] FMX: Fetching primary data for 2025-08.
[2025-10-24T18:48:32.447852] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present.
[2025-10-24T18:48:32.447927] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed.
[2025-10-24T18:48:32.448143] [INFO ] [MAIN      ] FMN: Fetched primary data is valid.
[2025-10-24T18:48:32.448181] [DEBUG] [LOCAL     ] FMN: Saving primary data.
[2025-10-24T18:48:32.448377] [FATAL] [LOCAL     ] FMN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:48:32.448457] [FATAL] [MAIN      ] FMN: Failed to save primary data.
[2025-10-24T18:48:32.448498] [WARN ] [MAIN      ] FMN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:48:32.448555] [INFO ] [LOCAL     ] FMN: Starting deletion of primary data.
[2025-10-24T18:48:32.448611] [DEBUG] [LOCAL     ] FMN: No primary data file found to delete.
[2025-10-24T18:48:32.448669] [INFO ] [LOCAL     ] FMN: Starting deletion of derivative data.
[2025-10-24T18:48:32.448825] [DEBUG] [LOCAL     ] FMN: Deleted derivative data file.
[2025-10-24T18:48:32.448891] [INFO ] [MAIN      ] Update Progress: 851/2366 symbols completed. FMN took 19.4s. Estimated remaining: 3h 13m 9s. Rate: 7.8 symbols/min
[2025-10-24T18:48:32.618845] [INFO ] [MAIN      ] FMY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:48:32.621835] [DEBUG] [LOCAL     ] FMY: Loaded 1365 existing records from primary storage.
[2025-10-24T18:48:32.621995] [INFO ] [MAIN      ] FMY: Loaded 1365 existing records.
[2025-10-24T18:48:32.794753] [WARN ] [MAIN      ] FMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:48:32.794950] [INFO ] [MAIN      ] FMY: Wiping existing primary data before full refresh.
[2025-10-24T18:48:32.794997] [INFO ] [LOCAL     ] FMY: Starting deletion of primary data.
[2025-10-24T18:48:32.795140] [DEBUG] [LOCAL     ] FMY: Deleted primary data file.
[2025-10-24T18:48:32.795179] [INFO ] [MAIN      ] FMY: Starting full primary refresh.
[2025-10-24T18:48:32.948328] [INFO ] [REMOTE    ] FMS: Fetching primary data for 2025-03.
[2025-10-24T18:48:33.147563] [INFO ] [REMOTE    ] FMY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:48:33.623589] [INFO ] [REMOTE    ] FMX: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T18:48:33.747629] [INFO ] [REMOTE    ] FMX: Fetching primary data for 2025-09.
[2025-10-24T18:48:34.347349] [INFO ] [REMOTE    ] FMS: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T18:48:34.547669] [INFO ] [REMOTE    ] FMS: Fetching primary data for 2025-04.
[2025-10-24T18:48:35.216158] [INFO ] [REMOTE    ] FMX: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T18:48:35.347618] [INFO ] [REMOTE    ] FMC: Fetching primary data for 2025-06.
[2025-10-24T18:48:35.953952] [INFO ] [REMOTE    ] FMS: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T18:48:36.147631] [INFO ] [REMOTE    ] FMY: Fetching primary data for 2025-01.
[2025-10-24T18:48:36.555793] [INFO ] [REMOTE    ] FMY: Incremental fetch complete for 2025-01 (0.41 seconds).
[2025-10-24T18:48:36.947692] [INFO ] [REMOTE    ] FMS: Fetching primary data for 2025-05.
[2025-10-24T18:48:37.090324] [INFO ] [REMOTE    ] FMC: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T18:48:37.747671] [INFO ] [REMOTE    ] FMC: Fetching primary data for 2025-07.
[2025-10-24T18:48:38.355722] [INFO ] [REMOTE    ] FMS: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T18:48:38.547678] [INFO ] [REMOTE    ] FMS: Fetching primary data for 2025-06.
[2025-10-24T18:48:39.347633] [INFO ] [REMOTE    ] FMY: Fetching primary data for 2025-02.
[2025-10-24T18:48:39.395225] [INFO ] [REMOTE    ] FMC: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T18:48:39.774267] [INFO ] [REMOTE    ] FMY: Incremental fetch complete for 2025-02 (0.43 seconds).
[2025-10-24T18:48:39.823516] [INFO ] [REMOTE    ] FMS: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T18:48:40.147693] [INFO ] [REMOTE    ] FMX: Fetching primary data for 2025-10.
[2025-10-24T18:48:40.947733] [INFO ] [REMOTE    ] FMS: Fetching primary data for 2025-07.
[2025-10-24T18:48:41.684087] [INFO ] [REMOTE    ] FMX: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T18:48:41.691028] [INFO ] [REMOTE    ] FMX: Full fetch complete (57816 records).
[2025-10-24T18:48:41.691208] [DEBUG] [VALIDATOR ] FMX: Validating primary data.
[2025-10-24T18:48:41.753959] [INFO ] [REMOTE    ] FMY: Fetching primary data for 2025-03.
[2025-10-24T18:48:42.079147] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present.
[2025-10-24T18:48:42.079229] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed.
[2025-10-24T18:48:42.080005] [INFO ] [MAIN      ] FMX: Fetched primary data is valid.
[2025-10-24T18:48:42.080067] [DEBUG] [LOCAL     ] FMX: Saving primary data.
[2025-10-24T18:48:42.080549] [FATAL] [LOCAL     ] FMX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:48:42.080630] [FATAL] [MAIN      ] FMX: Failed to save primary data.
[2025-10-24T18:48:42.080709] [WARN ] [MAIN      ] FMX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:48:42.080753] [INFO ] [LOCAL     ] FMX: Starting deletion of primary data.
[2025-10-24T18:48:42.080805] [DEBUG] [LOCAL     ] FMX: No primary data file found to delete.
[2025-10-24T18:48:42.080841] [INFO ] [LOCAL     ] FMX: Starting deletion of derivative data.
[2025-10-24T18:48:42.081039] [DEBUG] [LOCAL     ] FMX: Deleted derivative data file.
[2025-10-24T18:48:42.081267] [INFO ] [MAIN      ] Update Progress: 852/2366 symbols completed. FMX took 27.3s. Estimated remaining: 3h 13m 5s. Rate: 7.8 symbols/min
[2025-10-24T18:48:42.174501] [INFO ] [REMOTE    ] FMY: Incremental fetch complete for 2025-03 (0.42 seconds).
[2025-10-24T18:48:42.254213] [INFO ] [MAIN      ] FN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:48:42.291364] [DEBUG] [LOCAL     ] FN: Loaded 37580 existing records from primary storage.
[2025-10-24T18:48:42.291631] [INFO ] [MAIN      ] FN: Loaded 37580 existing records.
[2025-10-24T18:48:42.413917] [INFO ] [REMOTE    ] FMS: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T18:48:42.497954] [WARN ] [MAIN      ] FN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:48:42.498165] [INFO ] [MAIN      ] FN: Wiping existing primary data before full refresh.
[2025-10-24T18:48:42.498216] [INFO ] [LOCAL     ] FN: Starting deletion of primary data.
[2025-10-24T18:48:42.498926] [DEBUG] [LOCAL     ] FN: Deleted primary data file.
[2025-10-24T18:48:42.498983] [INFO ] [MAIN      ] FN: Starting full primary refresh.
[2025-10-24T18:48:42.553891] [INFO ] [REMOTE    ] FMC: Fetching primary data for 2025-08.
[2025-10-24T18:48:42.870340] [INFO ] [REMOTE    ] FN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:48:43.347625] [INFO ] [REMOTE    ] FMS: Fetching primary data for 2025-08.
[2025-10-24T18:48:44.147612] [INFO ] [REMOTE    ] FMY: Fetching primary data for 2025-04.
[2025-10-24T18:48:44.276780] [INFO ] [REMOTE    ] FMC: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T18:48:44.577256] [INFO ] [REMOTE    ] FMS: Incremental fetch complete for 2025-08 (1.23 seconds).
[2025-10-24T18:48:44.577841] [INFO ] [REMOTE    ] FMY: Incremental fetch complete for 2025-04 (0.43 seconds).
[2025-10-24T18:48:44.947720] [INFO ] [REMOTE    ] FN: Fetching primary data for 2025-01.
[2025-10-24T18:48:45.747681] [INFO ] [REMOTE    ] FMS: Fetching primary data for 2025-09.
[2025-10-24T18:48:46.164723] [INFO ] [REMOTE    ] FN: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T18:48:46.547695] [INFO ] [REMOTE    ] FMY: Fetching primary data for 2025-05.
[2025-10-24T18:48:46.925310] [INFO ] [REMOTE    ] FMY: Incremental fetch complete for 2025-05 (0.38 seconds).
[2025-10-24T18:48:46.994837] [INFO ] [REMOTE    ] FMS: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T18:48:47.347638] [INFO ] [REMOTE    ] FMY: Fetching primary data for 2025-06.
[2025-10-24T18:48:47.703021] [INFO ] [REMOTE    ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds).
[2025-10-24T18:48:48.147744] [INFO ] [REMOTE    ] FN: Fetching primary data for 2025-02.
[2025-10-24T18:48:48.947699] [INFO ] [REMOTE    ] FMC: Fetching primary data for 2025-09.
[2025-10-24T18:48:49.635539] [INFO ] [REMOTE    ] FN: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T18:48:49.747711] [INFO ] [REMOTE    ] FN: Fetching primary data for 2025-03.
[2025-10-24T18:48:50.238313] [INFO ] [REMOTE    ] FMC: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T18:48:50.547704] [INFO ] [REMOTE    ] FMY: Fetching primary data for 2025-07.
[2025-10-24T18:48:50.995584] [INFO ] [REMOTE    ] FMY: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T18:48:51.310418] [INFO ] [REMOTE    ] FN: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T18:48:51.347603] [INFO ] [REMOTE    ] FN: Fetching primary data for 2025-04.
[2025-10-24T18:48:52.147668] [INFO ] [REMOTE    ] FMC: Fetching primary data for 2025-10.
[2025-10-24T18:48:52.882614] [INFO ] [REMOTE    ] FN: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T18:48:52.947610] [INFO ] [REMOTE    ] FN: Fetching primary data for 2025-05.
[2025-10-24T18:48:53.747735] [INFO ] [REMOTE    ] FMS: Fetching primary data for 2025-10.
[2025-10-24T18:48:54.069852] [INFO ] [REMOTE    ] FMC: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T18:48:54.080489] [INFO ] [REMOTE    ] FMC: Full fetch complete (75423 records).
[2025-10-24T18:48:54.080611] [DEBUG] [VALIDATOR ] FMC: Validating primary data.
[2025-10-24T18:48:54.496117] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present.
[2025-10-24T18:48:54.496233] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed.
[2025-10-24T18:48:54.497217] [INFO ] [MAIN      ] FMC: Fetched primary data is valid.
[2025-10-24T18:48:54.497297] [DEBUG] [LOCAL     ] FMC: Saving primary data.
[2025-10-24T18:48:54.498082] [FATAL] [LOCAL     ] FMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:48:54.516266] [FATAL] [MAIN      ] FMC: Failed to save primary data.
[2025-10-24T18:48:54.518759] [WARN ] [MAIN      ] FMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:48:54.520166] [INFO ] [REMOTE    ] FN: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T18:48:54.520296] [INFO ] [LOCAL     ] FMC: Starting deletion of primary data.
[2025-10-24T18:48:54.528804] [DEBUG] [LOCAL     ] FMC: No primary data file found to delete.
[2025-10-24T18:48:54.528883] [INFO ] [LOCAL     ] FMC: Starting deletion of derivative data.
[2025-10-24T18:48:54.529357] [DEBUG] [LOCAL     ] FMC: Deleted derivative data file.
[2025-10-24T18:48:54.529798] [INFO ] [MAIN      ] Update Progress: 853/2366 symbols completed. FMC took 42.6s. Estimated remaining: 3h 13m 5s. Rate: 7.8 symbols/min
[2025-10-24T18:48:54.552725] [INFO ] [REMOTE    ] FMY: Fetching primary data for 2025-08.
[2025-10-24T18:48:54.698423] [INFO ] [MAIN      ] FNB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:48:54.750272] [DEBUG] [LOCAL     ] FNB: Loaded 52992 existing records from primary storage.
[2025-10-24T18:48:54.750594] [INFO ] [MAIN      ] FNB: Loaded 52992 existing records.
[2025-10-24T18:48:54.941959] [INFO ] [REMOTE    ] FMS: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T18:48:54.946453] [WARN ] [MAIN      ] FNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:48:54.952935] [INFO ] [MAIN      ] FNB: Wiping existing primary data before full refresh.
[2025-10-24T18:48:54.953260] [INFO ] [LOCAL     ] FNB: Starting deletion of primary data.
[2025-10-24T18:48:54.956495] [INFO ] [REMOTE    ] FMY: Incremental fetch complete for 2025-08 (0.40 seconds).
[2025-10-24T18:48:54.958096] [DEBUG] [LOCAL     ] FNB: Deleted primary data file.
[2025-10-24T18:48:54.958179] [INFO ] [MAIN      ] FNB: Starting full primary refresh.
[2025-10-24T18:48:54.992053] [INFO ] [REMOTE    ] FMS: Full fetch complete (43140 records).
[2025-10-24T18:48:55.029281] [DEBUG] [VALIDATOR ] FMS: Validating primary data.
[2025-10-24T18:48:55.363857] [INFO ] [REMOTE    ] FMY: Fetching primary data for 2025-09.
[2025-10-24T18:48:55.679578] [INFO ] [REMOTE    ] FNB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:48:55.713514] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present.
[2025-10-24T18:48:55.713589] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed.
[2025-10-24T18:48:55.714401] [INFO ] [MAIN      ] FMS: Fetched primary data is valid.
[2025-10-24T18:48:55.714471] [DEBUG] [LOCAL     ] FMS: Saving primary data.
[2025-10-24T18:48:55.714938] [FATAL] [LOCAL     ] FMS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:48:55.715022] [FATAL] [MAIN      ] FMS: Failed to save primary data.
[2025-10-24T18:48:55.715064] [WARN ] [MAIN      ] FMS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:48:55.715105] [INFO ] [LOCAL     ] FMS: Starting deletion of primary data.
[2025-10-24T18:48:55.715155] [DEBUG] [LOCAL     ] FMS: No primary data file found to delete.
[2025-10-24T18:48:55.715190] [INFO ] [LOCAL     ] FMS: Starting deletion of derivative data.
[2025-10-24T18:48:55.715358] [DEBUG] [LOCAL     ] FMS: Deleted derivative data file.
[2025-10-24T18:48:55.715469] [INFO ] [MAIN      ] Update Progress: 854/2366 symbols completed. FMS took 41.0s. Estimated remaining: 3h 12m 46s. Rate: 7.8 symbols/min
[2025-10-24T18:48:55.898976] [INFO ] [MAIN      ] FND: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:48:55.949198] [DEBUG] [LOCAL     ] FND: Loaded 52447 existing records from primary storage.
[2025-10-24T18:48:55.949496] [INFO ] [MAIN      ] FND: Loaded 52447 existing records.
[2025-10-24T18:48:56.024980] [INFO ] [REMOTE    ] FMY: Incremental fetch complete for 2025-09 (0.66 seconds).
[2025-10-24T18:48:56.132271] [WARN ] [MAIN      ] FND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:48:56.132475] [INFO ] [MAIN      ] FND: Wiping existing primary data before full refresh.
[2025-10-24T18:48:56.132520] [INFO ] [LOCAL     ] FND: Starting deletion of primary data.
[2025-10-24T18:48:56.132860] [DEBUG] [LOCAL     ] FND: Deleted primary data file.
[2025-10-24T18:48:56.132917] [INFO ] [MAIN      ] FND: Starting full primary refresh.
[2025-10-24T18:48:56.152775] [INFO ] [REMOTE    ] FNB: Fetching primary data for 2025-01.
[2025-10-24T18:48:56.510070] [INFO ] [REMOTE    ] FND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:48:56.947729] [INFO ] [REMOTE    ] FN: Fetching primary data for 2025-06.
[2025-10-24T18:48:57.725751] [INFO ] [REMOTE    ] FNB: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T18:48:57.747700] [INFO ] [REMOTE    ] FNB: Fetching primary data for 2025-02.
[2025-10-24T18:48:58.286891] [INFO ] [REMOTE    ] FN: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T18:48:58.547672] [INFO ] [REMOTE    ] FMY: Fetching primary data for 2025-10.
[2025-10-24T18:48:58.972177] [INFO ] [REMOTE    ] FMY: Incremental fetch complete for 2025-10 (0.42 seconds).
[2025-10-24T18:48:58.973093] [INFO ] [REMOTE    ] FMY: Full fetch complete (1943 records).
[2025-10-24T18:48:58.973164] [DEBUG] [VALIDATOR ] FMY: Validating primary data.
[2025-10-24T18:48:59.350797] [INFO ] [REMOTE    ] FN: Fetching primary data for 2025-07.
[2025-10-24T18:48:59.375513] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present.
[2025-10-24T18:48:59.375902] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed.
[2025-10-24T18:48:59.376626] [INFO ] [MAIN      ] FMY: Fetched primary data is valid.
[2025-10-24T18:48:59.377756] [INFO ] [REMOTE    ] FNB: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T18:48:59.377991] [DEBUG] [LOCAL     ] FMY: Saving primary data.
[2025-10-24T18:48:59.388843] [FATAL] [LOCAL     ] FMY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:48:59.389832] [FATAL] [MAIN      ] FMY: Failed to save primary data.
[2025-10-24T18:48:59.389920] [WARN ] [MAIN      ] FMY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:48:59.389991] [INFO ] [LOCAL     ] FMY: Starting deletion of primary data.
[2025-10-24T18:48:59.390057] [DEBUG] [LOCAL     ] FMY: No primary data file found to delete.
[2025-10-24T18:48:59.390096] [INFO ] [LOCAL     ] FMY: Starting deletion of derivative data.
[2025-10-24T18:48:59.390226] [DEBUG] [LOCAL     ] FMY: Deleted derivative data file.
[2025-10-24T18:48:59.390303] [INFO ] [MAIN      ] Update Progress: 855/2366 symbols completed. FMY took 26.9s. Estimated remaining: 3h 12m 32s. Rate: 7.8 symbols/min
[2025-10-24T18:48:59.569484] [INFO ] [MAIN      ] FNF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:48:59.615597] [DEBUG] [LOCAL     ] FNF: Loaded 49061 existing records from primary storage.
[2025-10-24T18:48:59.615929] [INFO ] [MAIN      ] FNF: Loaded 49061 existing records.
[2025-10-24T18:48:59.792589] [WARN ] [MAIN      ] FNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:48:59.792826] [INFO ] [MAIN      ] FNF: Wiping existing primary data before full refresh.
[2025-10-24T18:48:59.792881] [INFO ] [LOCAL     ] FNF: Starting deletion of primary data.
[2025-10-24T18:48:59.793225] [DEBUG] [LOCAL     ] FNF: Deleted primary data file.
[2025-10-24T18:48:59.793281] [INFO ] [MAIN      ] FNF: Starting full primary refresh.
[2025-10-24T18:49:00.150370] [INFO ] [REMOTE    ] FND: Fetching primary data for 2025-01.
[2025-10-24T18:49:00.150301] [INFO ] [REMOTE    ] FNF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:49:00.670988] [INFO ] [REMOTE    ] FN: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T18:49:00.947674] [INFO ] [REMOTE    ] FN: Fetching primary data for 2025-08.
[2025-10-24T18:49:01.748581] [INFO ] [REMOTE    ] FNB: Fetching primary data for 2025-03.
[2025-10-24T18:49:01.758380] [INFO ] [REMOTE    ] FND: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T18:49:02.538135] [INFO ] [REMOTE    ] FN: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T18:49:02.547756] [INFO ] [REMOTE    ] FNF: Fetching primary data for 2025-01.
[2025-10-24T18:49:03.347676] [INFO ] [REMOTE    ] FND: Fetching primary data for 2025-02.
[2025-10-24T18:49:03.410407] [INFO ] [REMOTE    ] FNB: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T18:49:03.995063] [INFO ] [REMOTE    ] FNF: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T18:49:04.147634] [INFO ] [REMOTE    ] FN: Fetching primary data for 2025-09.
[2025-10-24T18:49:04.889927] [INFO ] [REMOTE    ] FND: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T18:49:04.947726] [INFO ] [REMOTE    ] FNF: Fetching primary data for 2025-02.
[2025-10-24T18:49:05.480726] [INFO ] [REMOTE    ] FN: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T18:49:05.747723] [INFO ] [REMOTE    ] FND: Fetching primary data for 2025-03.
[2025-10-24T18:49:06.140173] [INFO ] [REMOTE    ] FNF: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T18:49:06.547674] [INFO ] [REMOTE    ] FNB: Fetching primary data for 2025-04.
[2025-10-24T18:49:07.311779] [INFO ] [REMOTE    ] FND: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T18:49:07.347625] [INFO ] [REMOTE    ] FND: Fetching primary data for 2025-04.
[2025-10-24T18:49:08.147718] [INFO ] [REMOTE    ] FN: Fetching primary data for 2025-10.
[2025-10-24T18:49:08.291709] [INFO ] [REMOTE    ] FNB: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T18:49:08.947708] [INFO ] [REMOTE    ] FNB: Fetching primary data for 2025-05.
[2025-10-24T18:49:09.041152] [INFO ] [REMOTE    ] FND: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T18:49:09.583596] [INFO ] [REMOTE    ] FN: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T18:49:09.589788] [INFO ] [REMOTE    ] FN: Full fetch complete (56497 records).
[2025-10-24T18:49:09.589898] [DEBUG] [VALIDATOR ] FN: Validating primary data.
[2025-10-24T18:49:09.749831] [INFO ] [REMOTE    ] FNF: Fetching primary data for 2025-03.
[2025-10-24T18:49:09.975163] [DEBUG] [VALIDATOR ] FN: All expected trading days are present.
[2025-10-24T18:49:09.975245] [DEBUG] [VALIDATOR ] FN: Primary data validation passed.
[2025-10-24T18:49:09.976006] [INFO ] [MAIN      ] FN: Fetched primary data is valid.
[2025-10-24T18:49:09.976069] [DEBUG] [LOCAL     ] FN: Saving primary data.
[2025-10-24T18:49:09.976572] [FATAL] [LOCAL     ] FN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:49:09.976701] [FATAL] [MAIN      ] FN: Failed to save primary data.
[2025-10-24T18:49:09.976757] [WARN ] [MAIN      ] FN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:49:09.976828] [INFO ] [LOCAL     ] FN: Starting deletion of primary data.
[2025-10-24T18:49:09.976887] [DEBUG] [LOCAL     ] FN: No primary data file found to delete.
[2025-10-24T18:49:09.976922] [INFO ] [LOCAL     ] FN: Starting deletion of derivative data.
[2025-10-24T18:49:09.977060] [DEBUG] [LOCAL     ] FN: Deleted derivative data file.
[2025-10-24T18:49:09.977152] [INFO ] [MAIN      ] Update Progress: 856/2366 symbols completed. FN took 27.9s. Estimated remaining: 3h 12m 29s. Rate: 7.8 symbols/min
[2025-10-24T18:49:10.145696] [INFO ] [MAIN      ] FNV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:49:10.192298] [DEBUG] [LOCAL     ] FNV: Loaded 46446 existing records from primary storage.
[2025-10-24T18:49:10.192595] [INFO ] [MAIN      ] FNV: Loaded 46446 existing records.
[2025-10-24T18:49:10.373437] [WARN ] [MAIN      ] FNV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:49:10.373629] [INFO ] [MAIN      ] FNV: Wiping existing primary data before full refresh.
[2025-10-24T18:49:10.373711] [INFO ] [LOCAL     ] FNV: Starting deletion of primary data.
[2025-10-24T18:49:10.374015] [DEBUG] [LOCAL     ] FNV: Deleted primary data file.
[2025-10-24T18:49:10.374070] [INFO ] [MAIN      ] FNV: Starting full primary refresh.
[2025-10-24T18:49:10.552770] [INFO ] [REMOTE    ] FND: Fetching primary data for 2025-05.
[2025-10-24T18:49:10.737356] [INFO ] [REMOTE    ] FNV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:49:10.765983] [INFO ] [REMOTE    ] FNB: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T18:49:11.347613] [INFO ] [REMOTE    ] FNB: Fetching primary data for 2025-06.
[2025-10-24T18:49:11.472243] [INFO ] [REMOTE    ] FNF: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T18:49:12.147678] [INFO ] [REMOTE    ] FNF: Fetching primary data for 2025-04.
[2025-10-24T18:49:12.301781] [INFO ] [REMOTE    ] FND: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T18:49:12.947674] [INFO ] [REMOTE    ] FNV: Fetching primary data for 2025-01.
[2025-10-24T18:49:13.260090] [INFO ] [REMOTE    ] FNB: Incremental fetch complete for 2025-06 (1.91 seconds).
[2025-10-24T18:49:13.470530] [INFO ] [REMOTE    ] FNF: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T18:49:13.747668] [INFO ] [REMOTE    ] FNF: Fetching primary data for 2025-05.
[2025-10-24T18:49:14.555066] [INFO ] [REMOTE    ] FNB: Fetching primary data for 2025-07.
[2025-10-24T18:49:14.560055] [INFO ] [REMOTE    ] FNV: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T18:49:15.347633] [INFO ] [REMOTE    ] FNV: Fetching primary data for 2025-02.
[2025-10-24T18:49:15.463039] [INFO ] [REMOTE    ] FNF: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T18:49:16.147630] [INFO ] [REMOTE    ] FND: Fetching primary data for 2025-06.
[2025-10-24T18:49:16.391197] [INFO ] [REMOTE    ] FNB: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T18:49:16.508152] [INFO ] [REMOTE    ] FNV: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T18:49:16.947758] [INFO ] [REMOTE    ] FNB: Fetching primary data for 2025-08.
[2025-10-24T18:49:17.747685] [INFO ] [REMOTE    ] FNF: Fetching primary data for 2025-06.
[2025-10-24T18:49:17.783151] [INFO ] [REMOTE    ] FND: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T18:49:18.547666] [INFO ] [REMOTE    ] FND: Fetching primary data for 2025-07.
[2025-10-24T18:49:18.643357] [INFO ] [REMOTE    ] FNB: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T18:49:19.347686] [INFO ] [REMOTE    ] FNV: Fetching primary data for 2025-03.
[2025-10-24T18:49:19.902827] [INFO ] [REMOTE    ] FNF: Incremental fetch complete for 2025-06 (2.16 seconds).
[2025-10-24T18:49:20.147698] [INFO ] [REMOTE    ] FNF: Fetching primary data for 2025-07.
[2025-10-24T18:49:20.361012] [INFO ] [REMOTE    ] FND: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T18:49:20.947707] [INFO ] [REMOTE    ] FND: Fetching primary data for 2025-08.
[2025-10-24T18:49:21.010726] [INFO ] [REMOTE    ] FNV: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T18:49:21.747974] [INFO ] [REMOTE    ] FNV: Fetching primary data for 2025-04.
[2025-10-24T18:49:21.747909] [INFO ] [REMOTE    ] FNF: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T18:49:22.547728] [INFO ] [REMOTE    ] FNF: Fetching primary data for 2025-08.
[2025-10-24T18:49:22.627311] [INFO ] [REMOTE    ] FND: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T18:49:23.328697] [INFO ] [REMOTE    ] FNV: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T18:49:23.347604] [INFO ] [REMOTE    ] FNV: Fetching primary data for 2025-05.
[2025-10-24T18:49:24.152824] [INFO ] [REMOTE    ] FNB: Fetching primary data for 2025-09.
[2025-10-24T18:49:24.167634] [INFO ] [REMOTE    ] FNF: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T18:49:24.947689] [INFO ] [REMOTE    ] FND: Fetching primary data for 2025-09.
[2025-10-24T18:49:25.096097] [INFO ] [REMOTE    ] FNV: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T18:49:25.359471] [INFO ] [REMOTE    ] FNB: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T18:49:25.747712] [INFO ] [REMOTE    ] FNF: Fetching primary data for 2025-09.
[2025-10-24T18:49:26.547676] [INFO ] [REMOTE    ] FNB: Fetching primary data for 2025-10.
[2025-10-24T18:49:26.631443] [INFO ] [REMOTE    ] FND: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T18:49:27.323379] [INFO ] [REMOTE    ] FNF: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T18:49:27.347602] [INFO ] [REMOTE    ] FNF: Fetching primary data for 2025-10.
[2025-10-24T18:49:28.096151] [INFO ] [REMOTE    ] FNB: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T18:49:28.106159] [INFO ] [REMOTE    ] FNB: Full fetch complete (76241 records).
[2025-10-24T18:49:28.106323] [DEBUG] [VALIDATOR ] FNB: Validating primary data.
[2025-10-24T18:49:28.152755] [INFO ] [REMOTE    ] FND: Fetching primary data for 2025-10.
[2025-10-24T18:49:28.530566] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present.
[2025-10-24T18:49:28.530733] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed.
[2025-10-24T18:49:28.531706] [INFO ] [MAIN      ] FNB: Fetched primary data is valid.
[2025-10-24T18:49:28.531795] [DEBUG] [LOCAL     ] FNB: Saving primary data.
[2025-10-24T18:49:28.532479] [FATAL] [LOCAL     ] FNB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:49:28.532616] [FATAL] [MAIN      ] FNB: Failed to save primary data.
[2025-10-24T18:49:28.532701] [WARN ] [MAIN      ] FNB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:49:28.532750] [INFO ] [LOCAL     ] FNB: Starting deletion of primary data.
[2025-10-24T18:49:28.532805] [DEBUG] [LOCAL     ] FNB: No primary data file found to delete.
[2025-10-24T18:49:28.532840] [INFO ] [LOCAL     ] FNB: Starting deletion of derivative data.
[2025-10-24T18:49:28.533060] [DEBUG] [LOCAL     ] FNB: Deleted derivative data file.
[2025-10-24T18:49:28.533567] [INFO ] [MAIN      ] Update Progress: 857/2366 symbols completed. FNB took 34.0s. Estimated remaining: 3h 12m 41s. Rate: 7.8 symbols/min
[2025-10-24T18:49:28.703127] [INFO ] [MAIN      ] FOA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:49:28.727725] [INFO ] [REMOTE    ] FNF: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T18:49:28.739539] [INFO ] [REMOTE    ] FNF: Full fetch complete (69977 records).
[2025-10-24T18:49:28.739722] [DEBUG] [VALIDATOR ] FNF: Validating primary data.
[2025-10-24T18:49:28.805066] [DEBUG] [LOCAL     ] FOA: Loaded 13094 existing records from primary storage.
[2025-10-24T18:49:28.822529] [INFO ] [MAIN      ] FOA: Loaded 13094 existing records.
[2025-10-24T18:49:28.951848] [INFO ] [REMOTE    ] FNV: Fetching primary data for 2025-06.
[2025-10-24T18:49:29.229443] [WARN ] [MAIN      ] FOA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:49:29.243379] [INFO ] [MAIN      ] FOA: Wiping existing primary data before full refresh.
[2025-10-24T18:49:29.248592] [INFO ] [LOCAL     ] FOA: Starting deletion of primary data.
[2025-10-24T18:49:29.260219] [DEBUG] [LOCAL     ] FOA: Deleted primary data file.
[2025-10-24T18:49:29.268418] [INFO ] [MAIN      ] FOA: Starting full primary refresh.
[2025-10-24T18:49:29.552391] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present.
[2025-10-24T18:49:29.568929] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed.
[2025-10-24T18:49:29.616111] [INFO ] [MAIN      ] FNF: Fetched primary data is valid.
[2025-10-24T18:49:29.637768] [DEBUG] [LOCAL     ] FNF: Saving primary data.
[2025-10-24T18:49:29.656440] [FATAL] [LOCAL     ] FNF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:49:29.674990] [FATAL] [MAIN      ] FNF: Failed to save primary data.
[2025-10-24T18:49:29.677435] [WARN ] [MAIN      ] FNF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:49:29.683259] [INFO ] [LOCAL     ] FNF: Starting deletion of primary data.
[2025-10-24T18:49:29.688501] [DEBUG] [LOCAL     ] FNF: No primary data file found to delete.
[2025-10-24T18:49:29.693718] [INFO ] [LOCAL     ] FNF: Starting deletion of derivative data.
[2025-10-24T18:49:29.727077] [DEBUG] [LOCAL     ] FNF: Deleted derivative data file.
[2025-10-24T18:49:29.737804] [INFO ] [MAIN      ] Update Progress: 858/2366 symbols completed. FNF took 30.3s. Estimated remaining: 3h 12m 22s. Rate: 7.8 symbols/min
[2025-10-24T18:49:29.763417] [INFO ] [REMOTE    ] FOA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:49:29.794210] [INFO ] [REMOTE    ] FOA: Fetching primary data for 2025-01.
[2025-10-24T18:49:29.944270] [INFO ] [MAIN      ] FOF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:49:29.956388] [DEBUG] [LOCAL     ] FOF: Loaded 8451 existing records from primary storage.
[2025-10-24T18:49:29.956667] [INFO ] [MAIN      ] FOF: Loaded 8451 existing records.
[2025-10-24T18:49:30.145863] [WARN ] [MAIN      ] FOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:49:30.146738] [INFO ] [MAIN      ] FOF: Wiping existing primary data before full refresh.
[2025-10-24T18:49:30.146958] [INFO ] [LOCAL     ] FOF: Starting deletion of primary data.
[2025-10-24T18:49:30.147397] [DEBUG] [LOCAL     ] FOF: Deleted primary data file.
[2025-10-24T18:49:30.147455] [INFO ] [MAIN      ] FOF: Starting full primary refresh.
[2025-10-24T18:49:30.366380] [INFO ] [REMOTE    ] FND: Incremental fetch complete for 2025-10 (2.21 seconds).
[2025-10-24T18:49:30.462724] [INFO ] [REMOTE    ] FND: Full fetch complete (75091 records).
[2025-10-24T18:49:30.481615] [DEBUG] [VALIDATOR ] FND: Validating primary data.
[2025-10-24T18:49:30.650848] [INFO ] [REMOTE    ] FOF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:49:30.674016] [INFO ] [REMOTE    ] FOF: Fetching primary data for 2025-01.
[2025-10-24T18:49:30.975967] [DEBUG] [VALIDATOR ] FND: All expected trading days are present.
[2025-10-24T18:49:30.984859] [DEBUG] [VALIDATOR ] FND: Primary data validation passed.
[2025-10-24T18:49:31.000461] [INFO ] [MAIN      ] FND: Fetched primary data is valid.
[2025-10-24T18:49:31.000625] [DEBUG] [LOCAL     ] FND: Saving primary data.
[2025-10-24T18:49:31.002822] [FATAL] [LOCAL     ] FND: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:49:31.002476] [INFO ] [REMOTE    ] FNV: Incremental fetch complete for 2025-06 (2.05 seconds).
[2025-10-24T18:49:31.011446] [FATAL] [MAIN      ] FND: Failed to save primary data.
[2025-10-24T18:49:31.012534] [WARN ] [MAIN      ] FND: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:49:31.012991] [INFO ] [LOCAL     ] FND: Starting deletion of primary data.
[2025-10-24T18:49:31.013069] [DEBUG] [LOCAL     ] FND: No primary data file found to delete.
[2025-10-24T18:49:31.013139] [INFO ] [LOCAL     ] FND: Starting deletion of derivative data.
[2025-10-24T18:49:31.013302] [DEBUG] [LOCAL     ] FND: Deleted derivative data file.
[2025-10-24T18:49:31.013693] [INFO ] [MAIN      ] Update Progress: 859/2366 symbols completed. FND took 35.3s. Estimated remaining: 3h 12m 3s. Rate: 7.8 symbols/min
[2025-10-24T18:49:31.203499] [INFO ] [MAIN      ] FOR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:49:31.210244] [INFO ] [REMOTE    ] FOA: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T18:49:31.217719] [INFO ] [REMOTE    ] FOF: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T18:49:31.241379] [DEBUG] [LOCAL     ] FOR: Loaded 19591 existing records from primary storage.
[2025-10-24T18:49:31.241633] [INFO ] [MAIN      ] FOR: Loaded 19591 existing records.
[2025-10-24T18:49:31.352898] [INFO ] [REMOTE    ] FNV: Fetching primary data for 2025-07.
[2025-10-24T18:49:31.428259] [WARN ] [MAIN      ] FOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:49:31.428492] [INFO ] [MAIN      ] FOR: Wiping existing primary data before full refresh.
[2025-10-24T18:49:31.428544] [INFO ] [LOCAL     ] FOR: Starting deletion of primary data.
[2025-10-24T18:49:31.428802] [DEBUG] [LOCAL     ] FOR: Deleted primary data file.
[2025-10-24T18:49:31.428860] [INFO ] [MAIN      ] FOR: Starting full primary refresh.
[2025-10-24T18:49:31.796947] [INFO ] [REMOTE    ] FOR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:49:32.147697] [INFO ] [REMOTE    ] FOA: Fetching primary data for 2025-02.
[2025-10-24T18:49:32.947631] [INFO ] [REMOTE    ] FOR: Fetching primary data for 2025-01.
[2025-10-24T18:49:32.986092] [INFO ] [REMOTE    ] FNV: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T18:49:33.055753] [INFO ] [REMOTE    ] FOA: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T18:49:33.747692] [INFO ] [REMOTE    ] FOA: Fetching primary data for 2025-03.
[2025-10-24T18:49:34.081710] [INFO ] [REMOTE    ] FOR: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T18:49:34.547615] [INFO ] [REMOTE    ] FNV: Fetching primary data for 2025-08.
[2025-10-24T18:49:34.616768] [INFO ] [REMOTE    ] FOA: Incremental fetch complete for 2025-03 (0.87 seconds).
[2025-10-24T18:49:35.347671] [INFO ] [REMOTE    ] FOR: Fetching primary data for 2025-02.
[2025-10-24T18:49:36.147617] [INFO ] [REMOTE    ] FOA: Fetching primary data for 2025-04.
[2025-10-24T18:49:36.227221] [INFO ] [REMOTE    ] FNV: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T18:49:36.444869] [INFO ] [REMOTE    ] FOR: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T18:49:36.947706] [INFO ] [REMOTE    ] FOF: Fetching primary data for 2025-02.
[2025-10-24T18:49:36.990493] [INFO ] [REMOTE    ] FOA: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T18:49:37.747731] [INFO ] [REMOTE    ] FOA: Fetching primary data for 2025-05.
[2025-10-24T18:49:37.762007] [INFO ] [REMOTE    ] FOF: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T18:49:38.533052] [INFO ] [REMOTE    ] FOA: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T18:49:38.547677] [INFO ] [REMOTE    ] FOA: Fetching primary data for 2025-06.
[2025-10-24T18:49:39.333533] [INFO ] [REMOTE    ] FOA: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T18:49:39.347600] [INFO ] [REMOTE    ] FOA: Fetching primary data for 2025-07.
[2025-10-24T18:49:40.147618] [INFO ] [REMOTE    ] FOR: Fetching primary data for 2025-03.
[2025-10-24T18:49:40.218323] [INFO ] [REMOTE    ] FOA: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T18:49:40.947608] [INFO ] [REMOTE    ] FOA: Fetching primary data for 2025-08.
[2025-10-24T18:49:41.171339] [INFO ] [REMOTE    ] FOR: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T18:49:41.456738] [INFO ] [REMOTE    ] FOA: Incremental fetch complete for 2025-08 (0.51 seconds).
[2025-10-24T18:49:41.747618] [INFO ] [REMOTE    ] FOF: Fetching primary data for 2025-03.
[2025-10-24T18:49:42.424830] [INFO ] [REMOTE    ] FOF: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T18:49:42.547718] [INFO ] [REMOTE    ] FOR: Fetching primary data for 2025-04.
[2025-10-24T18:49:43.347712] [INFO ] [REMOTE    ] FNV: Fetching primary data for 2025-09.
[2025-10-24T18:49:43.850666] [INFO ] [REMOTE    ] FOR: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T18:49:44.147767] [INFO ] [REMOTE    ] FOA: Fetching primary data for 2025-09.
[2025-10-24T18:49:44.861164] [INFO ] [REMOTE    ] FNV: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T18:49:44.908142] [INFO ] [REMOTE    ] FOA: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T18:49:44.947617] [INFO ] [REMOTE    ] FOA: Fetching primary data for 2025-10.
[2025-10-24T18:49:45.747867] [INFO ] [REMOTE    ] FOR: Fetching primary data for 2025-05.
[2025-10-24T18:49:46.013518] [INFO ] [REMOTE    ] FOA: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T18:49:46.018395] [INFO ] [REMOTE    ] FOA: Full fetch complete (20843 records).
[2025-10-24T18:49:46.018601] [DEBUG] [VALIDATOR ] FOA: Validating primary data.
[2025-10-24T18:49:46.403682] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present.
[2025-10-24T18:49:46.403793] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed.
[2025-10-24T18:49:46.404545] [INFO ] [MAIN      ] FOA: Fetched primary data is valid.
[2025-10-24T18:49:46.404588] [DEBUG] [LOCAL     ] FOA: Saving primary data.
[2025-10-24T18:49:46.404969] [FATAL] [LOCAL     ] FOA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:49:46.405091] [FATAL] [MAIN      ] FOA: Failed to save primary data.
[2025-10-24T18:49:46.405133] [WARN ] [MAIN      ] FOA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:49:46.405173] [INFO ] [LOCAL     ] FOA: Starting deletion of primary data.
[2025-10-24T18:49:46.405271] [DEBUG] [LOCAL     ] FOA: No primary data file found to delete.
[2025-10-24T18:49:46.405343] [INFO ] [LOCAL     ] FOA: Starting deletion of derivative data.
[2025-10-24T18:49:46.406054] [DEBUG] [LOCAL     ] FOA: Deleted derivative data file.
[2025-10-24T18:49:46.406194] [INFO ] [MAIN      ] Update Progress: 860/2366 symbols completed. FOA took 17.9s. Estimated remaining: 3h 12m 9s. Rate: 7.8 symbols/min
[2025-10-24T18:49:46.552738] [INFO ] [REMOTE    ] FNV: Fetching primary data for 2025-10.
[2025-10-24T18:49:46.579277] [INFO ] [MAIN      ] FOUR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:49:46.632581] [DEBUG] [LOCAL     ] FOUR: Loaded 50041 existing records from primary storage.
[2025-10-24T18:49:46.633015] [INFO ] [MAIN      ] FOUR: Loaded 50041 existing records.
[2025-10-24T18:49:46.817951] [WARN ] [MAIN      ] FOUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:49:46.818386] [INFO ] [MAIN      ] FOUR: Wiping existing primary data before full refresh.
[2025-10-24T18:49:46.818552] [INFO ] [LOCAL     ] FOUR: Starting deletion of primary data.
[2025-10-24T18:49:46.819343] [DEBUG] [LOCAL     ] FOUR: Deleted primary data file.
[2025-10-24T18:49:46.819399] [INFO ] [MAIN      ] FOUR: Starting full primary refresh.
[2025-10-24T18:49:46.998713] [INFO ] [REMOTE    ] FOR: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T18:49:47.211348] [INFO ] [REMOTE    ] FOUR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:49:47.347699] [INFO ] [REMOTE    ] FOF: Fetching primary data for 2025-04.
[2025-10-24T18:49:48.143368] [INFO ] [REMOTE    ] FOF: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T18:49:48.147596] [INFO ] [REMOTE    ] FOF: Fetching primary data for 2025-05.
[2025-10-24T18:49:48.720507] [INFO ] [REMOTE    ] FNV: Incremental fetch complete for 2025-10 (2.17 seconds).
[2025-10-24T18:49:48.730329] [INFO ] [REMOTE    ] FNV: Full fetch complete (66970 records).
[2025-10-24T18:49:48.730488] [DEBUG] [VALIDATOR ] FNV: Validating primary data.
[2025-10-24T18:49:48.907013] [INFO ] [REMOTE    ] FOF: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T18:49:48.951739] [INFO ] [REMOTE    ] FOR: Fetching primary data for 2025-06.
[2025-10-24T18:49:49.160861] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present.
[2025-10-24T18:49:49.160986] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed.
[2025-10-24T18:49:49.162502] [INFO ] [MAIN      ] FNV: Fetched primary data is valid.
[2025-10-24T18:49:49.162581] [DEBUG] [LOCAL     ] FNV: Saving primary data.
[2025-10-24T18:49:49.163526] [FATAL] [LOCAL     ] FNV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:49:49.163617] [FATAL] [MAIN      ] FNV: Failed to save primary data.
[2025-10-24T18:49:49.163696] [WARN ] [MAIN      ] FNV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:49:49.163747] [INFO ] [LOCAL     ] FNV: Starting deletion of primary data.
[2025-10-24T18:49:49.163807] [DEBUG] [LOCAL     ] FNV: No primary data file found to delete.
[2025-10-24T18:49:49.163844] [INFO ] [LOCAL     ] FNV: Starting deletion of derivative data.
[2025-10-24T18:49:49.164015] [DEBUG] [LOCAL     ] FNV: Deleted derivative data file.
[2025-10-24T18:49:49.164598] [INFO ] [MAIN      ] Update Progress: 861/2366 symbols completed. FNV took 39.2s. Estimated remaining: 3h 11m 53s. Rate: 7.8 symbols/min
[2025-10-24T18:49:49.356694] [INFO ] [MAIN      ] FPF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:49:49.381150] [DEBUG] [LOCAL     ] FPF: Loaded 18898 existing records from primary storage.
[2025-10-24T18:49:49.381504] [INFO ] [MAIN      ] FPF: Loaded 18898 existing records.
[2025-10-24T18:49:49.572156] [WARN ] [MAIN      ] FPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:49:49.572426] [INFO ] [MAIN      ] FPF: Wiping existing primary data before full refresh.
[2025-10-24T18:49:49.572478] [INFO ] [LOCAL     ] FPF: Starting deletion of primary data.
[2025-10-24T18:49:49.572730] [DEBUG] [LOCAL     ] FPF: Deleted primary data file.
[2025-10-24T18:49:49.572790] [INFO ] [MAIN      ] FPF: Starting full primary refresh.
[2025-10-24T18:49:49.755009] [INFO ] [REMOTE    ] FOUR: Fetching primary data for 2025-01.
[2025-10-24T18:49:49.961436] [INFO ] [REMOTE    ] FPF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:49:49.976241] [INFO ] [REMOTE    ] FOR: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T18:49:50.547671] [INFO ] [REMOTE    ] FPF: Fetching primary data for 2025-01.
[2025-10-24T18:49:51.347690] [INFO ] [REMOTE    ] FOF: Fetching primary data for 2025-06.
[2025-10-24T18:49:51.447944] [INFO ] [REMOTE    ] FOUR: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T18:49:51.543158] [INFO ] [REMOTE    ] FPF: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T18:49:51.798982] [INFO ] [REMOTE    ] FOF: Incremental fetch complete for 2025-06 (0.45 seconds).
[2025-10-24T18:49:52.147681] [INFO ] [REMOTE    ] FOF: Fetching primary data for 2025-07.
[2025-10-24T18:49:52.917235] [INFO ] [REMOTE    ] FOF: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T18:49:52.947637] [INFO ] [REMOTE    ] FOF: Fetching primary data for 2025-08.
[2025-10-24T18:49:53.677860] [INFO ] [REMOTE    ] FOF: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T18:49:53.747731] [INFO ] [REMOTE    ] FOUR: Fetching primary data for 2025-02.
[2025-10-24T18:49:54.547628] [INFO ] [REMOTE    ] FOF: Fetching primary data for 2025-09.
[2025-10-24T18:49:55.320041] [INFO ] [REMOTE    ] FOF: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T18:49:55.347596] [INFO ] [REMOTE    ] FOF: Fetching primary data for 2025-10.
[2025-10-24T18:49:55.571495] [INFO ] [REMOTE    ] FOUR: Incremental fetch complete for 2025-02 (1.82 seconds).
[2025-10-24T18:49:56.147716] [INFO ] [REMOTE    ] FOR: Fetching primary data for 2025-07.
[2025-10-24T18:49:56.241248] [INFO ] [REMOTE    ] FOF: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T18:49:56.243200] [INFO ] [REMOTE    ] FOF: Full fetch complete (11889 records).
[2025-10-24T18:49:56.243269] [DEBUG] [VALIDATOR ] FOF: Validating primary data.
[2025-10-24T18:49:56.597165] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present.
[2025-10-24T18:49:56.597249] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed.
[2025-10-24T18:49:56.597517] [INFO ] [MAIN      ] FOF: Fetched primary data is valid.
[2025-10-24T18:49:56.597576] [DEBUG] [LOCAL     ] FOF: Saving primary data.
[2025-10-24T18:49:56.597818] [FATAL] [LOCAL     ] FOF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:49:56.597902] [FATAL] [MAIN      ] FOF: Failed to save primary data.
[2025-10-24T18:49:56.597944] [WARN ] [MAIN      ] FOF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:49:56.598013] [INFO ] [LOCAL     ] FOF: Starting deletion of primary data.
[2025-10-24T18:49:56.598088] [DEBUG] [LOCAL     ] FOF: No primary data file found to delete.
[2025-10-24T18:49:56.598135] [INFO ] [LOCAL     ] FOF: Starting deletion of derivative data.
[2025-10-24T18:49:56.598318] [DEBUG] [LOCAL     ] FOF: Deleted derivative data file.
[2025-10-24T18:49:56.598417] [INFO ] [MAIN      ] Update Progress: 862/2366 symbols completed. FOF took 26.8s. Estimated remaining: 3h 11m 45s. Rate: 7.8 symbols/min
[2025-10-24T18:49:56.763139] [INFO ] [MAIN      ] FPH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:49:56.782727] [DEBUG] [LOCAL     ] FPH: Loaded 19347 existing records from primary storage.
[2025-10-24T18:49:56.782965] [INFO ] [MAIN      ] FPH: Loaded 19347 existing records.
[2025-10-24T18:49:56.961852] [INFO ] [REMOTE    ] FPF: Fetching primary data for 2025-02.
[2025-10-24T18:49:56.966437] [WARN ] [MAIN      ] FPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:49:56.967447] [INFO ] [MAIN      ] FPH: Wiping existing primary data before full refresh.
[2025-10-24T18:49:56.967556] [INFO ] [LOCAL     ] FPH: Starting deletion of primary data.
[2025-10-24T18:49:56.967864] [DEBUG] [LOCAL     ] FPH: Deleted primary data file.
[2025-10-24T18:49:56.967929] [INFO ] [MAIN      ] FPH: Starting full primary refresh.
[2025-10-24T18:49:57.268538] [INFO ] [REMOTE    ] FOR: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T18:49:57.343914] [INFO ] [REMOTE    ] FPH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:49:57.747634] [INFO ] [REMOTE    ] FOUR: Fetching primary data for 2025-03.
[2025-10-24T18:49:57.965049] [INFO ] [REMOTE    ] FPF: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T18:49:58.547717] [INFO ] [REMOTE    ] FPH: Fetching primary data for 2025-01.
[2025-10-24T18:49:59.347716] [INFO ] [REMOTE    ] FOR: Fetching primary data for 2025-08.
[2025-10-24T18:49:59.534800] [INFO ] [REMOTE    ] FOUR: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T18:49:59.783322] [INFO ] [REMOTE    ] FPH: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T18:50:00.147626] [INFO ] [REMOTE    ] FPF: Fetching primary data for 2025-03.
[2025-10-24T18:50:00.362387] [INFO ] [REMOTE    ] FOR: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T18:50:00.947602] [INFO ] [REMOTE    ] FPH: Fetching primary data for 2025-02.
[2025-10-24T18:50:01.335873] [INFO ] [REMOTE    ] FPF: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T18:50:01.747717] [INFO ] [REMOTE    ] FOR: Fetching primary data for 2025-09.
[2025-10-24T18:50:02.552796] [INFO ] [REMOTE    ] FPF: Fetching primary data for 2025-04.
[2025-10-24T18:50:02.566692] [INFO ] [REMOTE    ] FPH: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T18:50:03.347698] [INFO ] [REMOTE    ] FOUR: Fetching primary data for 2025-04.
[2025-10-24T18:50:03.962999] [INFO ] [REMOTE    ] FOR: Incremental fetch complete for 2025-09 (2.22 seconds).
[2025-10-24T18:50:04.147705] [INFO ] [REMOTE    ] FOR: Fetching primary data for 2025-10.
[2025-10-24T18:50:04.214725] [INFO ] [REMOTE    ] FPF: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T18:50:04.947715] [INFO ] [REMOTE    ] FPH: Fetching primary data for 2025-03.
[2025-10-24T18:50:05.392767] [INFO ] [REMOTE    ] FOR: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T18:50:05.396039] [INFO ] [REMOTE    ] FOR: Full fetch complete (29509 records).
[2025-10-24T18:50:05.396132] [DEBUG] [VALIDATOR ] FOR: Validating primary data.
[2025-10-24T18:50:05.748621] [INFO ] [REMOTE    ] FPF: Fetching primary data for 2025-05.
[2025-10-24T18:50:05.800617] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present.
[2025-10-24T18:50:05.800758] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed.
[2025-10-24T18:50:05.801410] [INFO ] [MAIN      ] FOR: Fetched primary data is valid.
[2025-10-24T18:50:05.801585] [DEBUG] [LOCAL     ] FOR: Saving primary data.
[2025-10-24T18:50:05.802208] [FATAL] [LOCAL     ] FOR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:50:05.802326] [FATAL] [MAIN      ] FOR: Failed to save primary data.
[2025-10-24T18:50:05.802376] [WARN ] [MAIN      ] FOR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:50:05.802439] [INFO ] [LOCAL     ] FOR: Starting deletion of primary data.
[2025-10-24T18:50:05.802501] [DEBUG] [LOCAL     ] FOR: No primary data file found to delete.
[2025-10-24T18:50:05.802537] [INFO ] [LOCAL     ] FOR: Starting deletion of derivative data.
[2025-10-24T18:50:05.802706] [DEBUG] [LOCAL     ] FOR: Deleted derivative data file.
[2025-10-24T18:50:05.802807] [INFO ] [MAIN      ] Update Progress: 863/2366 symbols completed. FOR took 34.8s. Estimated remaining: 3h 11m 40s. Rate: 7.8 symbols/min
[2025-10-24T18:50:05.980070] [INFO ] [MAIN      ] FPI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:50:06.009873] [INFO ] [REMOTE    ] FOUR: Incremental fetch complete for 2025-04 (2.66 seconds).
[2025-10-24T18:50:06.047108] [DEBUG] [LOCAL     ] FPI: Loaded 31560 existing records from primary storage.
[2025-10-24T18:50:06.047441] [INFO ] [MAIN      ] FPI: Loaded 31560 existing records.
[2025-10-24T18:50:06.245683] [INFO ] [REMOTE    ] FPH: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T18:50:06.249578] [WARN ] [MAIN      ] FPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:50:06.254156] [INFO ] [MAIN      ] FPI: Wiping existing primary data before full refresh.
[2025-10-24T18:50:06.255000] [INFO ] [LOCAL     ] FPI: Starting deletion of primary data.
[2025-10-24T18:50:06.255341] [DEBUG] [LOCAL     ] FPI: Deleted primary data file.
[2025-10-24T18:50:06.255384] [INFO ] [MAIN      ] FPI: Starting full primary refresh.
[2025-10-24T18:50:06.552873] [INFO ] [REMOTE    ] FPH: Fetching primary data for 2025-04.
[2025-10-24T18:50:06.626483] [INFO ] [REMOTE    ] FPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:50:07.318890] [INFO ] [REMOTE    ] FPF: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T18:50:07.347612] [INFO ] [REMOTE    ] FPF: Fetching primary data for 2025-06.
[2025-10-24T18:50:07.686353] [INFO ] [REMOTE    ] FPH: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T18:50:08.147710] [INFO ] [REMOTE    ] FPI: Fetching primary data for 2025-01.
[2025-10-24T18:50:08.401896] [INFO ] [REMOTE    ] FPF: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T18:50:08.947615] [INFO ] [REMOTE    ] FPF: Fetching primary data for 2025-07.
[2025-10-24T18:50:09.312750] [INFO ] [REMOTE    ] FPI: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T18:50:09.747614] [INFO ] [REMOTE    ] FPI: Fetching primary data for 2025-02.
[2025-10-24T18:50:09.882604] [INFO ] [REMOTE    ] FPF: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T18:50:10.547748] [INFO ] [REMOTE    ] FPH: Fetching primary data for 2025-05.
[2025-10-24T18:50:10.854563] [INFO ] [REMOTE    ] FPI: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T18:50:11.115730] [INFO ] [REMOTE    ] FPH: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T18:50:11.347636] [INFO ] [REMOTE    ] FOUR: Fetching primary data for 2025-05.
[2025-10-24T18:50:12.147633] [INFO ] [REMOTE    ] FPH: Fetching primary data for 2025-06.
[2025-10-24T18:50:12.951046] [INFO ] [REMOTE    ] FPI: Fetching primary data for 2025-03.
[2025-10-24T18:50:12.966862] [INFO ] [REMOTE    ] FOUR: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T18:50:13.094946] [INFO ] [REMOTE    ] FPH: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T18:50:13.747722] [INFO ] [REMOTE    ] FPF: Fetching primary data for 2025-08.
[2025-10-24T18:50:14.234554] [INFO ] [REMOTE    ] FPI: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T18:50:14.547737] [INFO ] [REMOTE    ] FPH: Fetching primary data for 2025-07.
[2025-10-24T18:50:14.819446] [INFO ] [REMOTE    ] FPF: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T18:50:15.347605] [INFO ] [REMOTE    ] FPF: Fetching primary data for 2025-09.
[2025-10-24T18:50:15.597574] [INFO ] [REMOTE    ] FPH: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T18:50:16.147616] [INFO ] [REMOTE    ] FOUR: Fetching primary data for 2025-06.
[2025-10-24T18:50:16.311153] [INFO ] [REMOTE    ] FPF: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T18:50:16.947699] [INFO ] [REMOTE    ] FPF: Fetching primary data for 2025-10.
[2025-10-24T18:50:17.605691] [INFO ] [REMOTE    ] FOUR: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T18:50:17.747633] [INFO ] [REMOTE    ] FOUR: Fetching primary data for 2025-07.
[2025-10-24T18:50:17.862308] [INFO ] [REMOTE    ] FPF: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T18:50:17.869672] [INFO ] [REMOTE    ] FPF: Full fetch complete (26578 records).
[2025-10-24T18:50:17.869783] [DEBUG] [VALIDATOR ] FPF: Validating primary data.
[2025-10-24T18:50:18.241557] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present.
[2025-10-24T18:50:18.241672] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed.
[2025-10-24T18:50:18.242252] [INFO ] [MAIN      ] FPF: Fetched primary data is valid.
[2025-10-24T18:50:18.242314] [DEBUG] [LOCAL     ] FPF: Saving primary data.
[2025-10-24T18:50:18.242723] [FATAL] [LOCAL     ] FPF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:50:18.242803] [FATAL] [MAIN      ] FPF: Failed to save primary data.
[2025-10-24T18:50:18.242846] [WARN ] [MAIN      ] FPF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:50:18.242883] [INFO ] [LOCAL     ] FPF: Starting deletion of primary data.
[2025-10-24T18:50:18.242936] [DEBUG] [LOCAL     ] FPF: No primary data file found to delete.
[2025-10-24T18:50:18.242970] [INFO ] [LOCAL     ] FPF: Starting deletion of derivative data.
[2025-10-24T18:50:18.243109] [DEBUG] [LOCAL     ] FPF: Deleted derivative data file.
[2025-10-24T18:50:18.243221] [INFO ] [MAIN      ] Update Progress: 864/2366 symbols completed. FPF took 29.1s. Estimated remaining: 3h 11m 40s. Rate: 7.8 symbols/min
[2025-10-24T18:50:18.411721] [INFO ] [MAIN      ] FR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:50:18.457007] [DEBUG] [LOCAL     ] FR: Loaded 46973 existing records from primary storage.
[2025-10-24T18:50:18.457382] [INFO ] [MAIN      ] FR: Loaded 46973 existing records.
[2025-10-24T18:50:18.553716] [INFO ] [REMOTE    ] FPH: Fetching primary data for 2025-08.
[2025-10-24T18:50:18.637073] [WARN ] [MAIN      ] FR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:50:18.637359] [INFO ] [MAIN      ] FR: Wiping existing primary data before full refresh.
[2025-10-24T18:50:18.637423] [INFO ] [LOCAL     ] FR: Starting deletion of primary data.
[2025-10-24T18:50:18.637839] [DEBUG] [LOCAL     ] FR: Deleted primary data file.
[2025-10-24T18:50:18.637897] [INFO ] [MAIN      ] FR: Starting full primary refresh.
[2025-10-24T18:50:19.014815] [INFO ] [REMOTE    ] FR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:50:19.345759] [INFO ] [REMOTE    ] FOUR: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T18:50:19.354867] [INFO ] [REMOTE    ] FR: Fetching primary data for 2025-01.
[2025-10-24T18:50:19.561230] [INFO ] [REMOTE    ] FPH: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T18:50:20.147668] [INFO ] [REMOTE    ] FOUR: Fetching primary data for 2025-08.
[2025-10-24T18:50:20.782905] [INFO ] [REMOTE    ] FR: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T18:50:20.947669] [INFO ] [REMOTE    ] FPI: Fetching primary data for 2025-04.
[2025-10-24T18:50:21.747628] [INFO ] [REMOTE    ] FR: Fetching primary data for 2025-02.
[2025-10-24T18:50:22.009989] [INFO ] [REMOTE    ] FOUR: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T18:50:22.236718] [INFO ] [REMOTE    ] FPI: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T18:50:22.547640] [INFO ] [REMOTE    ] FPI: Fetching primary data for 2025-05.
[2025-10-24T18:50:22.838066] [INFO ] [REMOTE    ] FR: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T18:50:23.347672] [INFO ] [REMOTE    ] FR: Fetching primary data for 2025-03.
[2025-10-24T18:50:23.868183] [INFO ] [REMOTE    ] FPI: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T18:50:24.147639] [INFO ] [REMOTE    ] FPH: Fetching primary data for 2025-09.
[2025-10-24T18:50:24.947614] [INFO ] [REMOTE    ] FPI: Fetching primary data for 2025-06.
[2025-10-24T18:50:24.986123] [INFO ] [REMOTE    ] FR: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T18:50:25.099129] [INFO ] [REMOTE    ] FPH: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T18:50:25.747636] [INFO ] [REMOTE    ] FOUR: Fetching primary data for 2025-09.
[2025-10-24T18:50:25.940087] [INFO ] [REMOTE    ] FPI: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T18:50:26.547697] [INFO ] [REMOTE    ] FPI: Fetching primary data for 2025-07.
[2025-10-24T18:50:27.056064] [INFO ] [REMOTE    ] FOUR: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T18:50:27.347670] [INFO ] [REMOTE    ] FOUR: Fetching primary data for 2025-10.
[2025-10-24T18:50:27.456598] [INFO ] [REMOTE    ] FPI: Incremental fetch complete for 2025-07 (0.91 seconds).
[2025-10-24T18:50:28.147638] [INFO ] [REMOTE    ] FPH: Fetching primary data for 2025-10.
[2025-10-24T18:50:28.947626] [INFO ] [REMOTE    ] FR: Fetching primary data for 2025-04.
[2025-10-24T18:50:29.210797] [INFO ] [REMOTE    ] FPH: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T18:50:29.214711] [INFO ] [REMOTE    ] FPH: Full fetch complete (30819 records).
[2025-10-24T18:50:29.214802] [DEBUG] [VALIDATOR ] FPH: Validating primary data.
[2025-10-24T18:50:29.549779] [INFO ] [REMOTE    ] FOUR: Incremental fetch complete for 2025-10 (2.20 seconds).
[2025-10-24T18:50:29.612684] [INFO ] [REMOTE    ] FOUR: Full fetch complete (72224 records).
[2025-10-24T18:50:29.630001] [DEBUG] [VALIDATOR ] FOUR: Validating primary data.
[2025-10-24T18:50:29.644128] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present.
[2025-10-24T18:50:29.687730] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed.
[2025-10-24T18:50:29.724280] [INFO ] [MAIN      ] FPH: Fetched primary data is valid.
[2025-10-24T18:50:29.751411] [INFO ] [REMOTE    ] FPI: Fetching primary data for 2025-08.
[2025-10-24T18:50:29.751585] [DEBUG] [LOCAL     ] FPH: Saving primary data.
[2025-10-24T18:50:29.759227] [FATAL] [LOCAL     ] FPH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:50:29.774882] [FATAL] [MAIN      ] FPH: Failed to save primary data.
[2025-10-24T18:50:29.774991] [WARN ] [MAIN      ] FPH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:50:29.799076] [INFO ] [LOCAL     ] FPH: Starting deletion of primary data.
[2025-10-24T18:50:29.808287] [DEBUG] [LOCAL     ] FPH: No primary data file found to delete.
[2025-10-24T18:50:29.814572] [INFO ] [LOCAL     ] FPH: Starting deletion of derivative data.
[2025-10-24T18:50:29.831747] [DEBUG] [LOCAL     ] FPH: Deleted derivative data file.
[2025-10-24T18:50:29.831886] [INFO ] [MAIN      ] Update Progress: 865/2366 symbols completed. FPH took 33.2s. Estimated remaining: 3h 11m 39s. Rate: 7.8 symbols/min
[2025-10-24T18:50:30.185662] [INFO ] [MAIN      ] FRA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:50:30.238156] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present.
[2025-10-24T18:50:30.238316] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed.
[2025-10-24T18:50:30.239458] [INFO ] [MAIN      ] FOUR: Fetched primary data is valid.
[2025-10-24T18:50:30.239570] [DEBUG] [LOCAL     ] FOUR: Saving primary data.
[2025-10-24T18:50:30.240280] [FATAL] [LOCAL     ] FOUR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:50:30.240369] [FATAL] [MAIN      ] FOUR: Failed to save primary data.
[2025-10-24T18:50:30.240415] [WARN ] [MAIN      ] FOUR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:50:30.240452] [INFO ] [LOCAL     ] FOUR: Starting deletion of primary data.
[2025-10-24T18:50:30.240505] [DEBUG] [LOCAL     ] FOUR: No primary data file found to delete.
[2025-10-24T18:50:30.240543] [INFO ] [LOCAL     ] FOUR: Starting deletion of derivative data.
[2025-10-24T18:50:30.244680] [DEBUG] [LOCAL     ] FOUR: Deleted derivative data file.
[2025-10-24T18:50:30.245172] [INFO ] [MAIN      ] Update Progress: 866/2366 symbols completed. FOUR took 43.8s. Estimated remaining: 3h 11m 19s. Rate: 7.8 symbols/min
[2025-10-24T18:50:30.304580] [DEBUG] [LOCAL     ] FRA: Loaded 14116 existing records from primary storage.
[2025-10-24T18:50:30.326214] [INFO ] [MAIN      ] FRA: Loaded 14116 existing records.
[2025-10-24T18:50:30.588192] [INFO ] [MAIN      ] FRGE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:50:30.651141] [WARN ] [MAIN      ] FRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:50:30.652068] [INFO ] [MAIN      ] FRA: Wiping existing primary data before full refresh.
[2025-10-24T18:50:30.652229] [INFO ] [LOCAL     ] FRA: Starting deletion of primary data.
[2025-10-24T18:50:30.652533] [DEBUG] [LOCAL     ] FRA: Deleted primary data file.
[2025-10-24T18:50:30.652669] [INFO ] [MAIN      ] FRA: Starting full primary refresh.
[2025-10-24T18:50:30.845227] [DEBUG] [LOCAL     ] FRGE: Loaded 15605 existing records from primary storage.
[2025-10-24T18:50:30.794871] [INFO ] [REMOTE    ] FPI: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T18:50:30.877872] [INFO ] [MAIN      ] FRGE: Loaded 15605 existing records.
[2025-10-24T18:50:30.933264] [INFO ] [REMOTE    ] FPI: Fetching primary data for 2025-09.
[2025-10-24T18:50:30.963090] [INFO ] [REMOTE    ] FR: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T18:50:31.311624] [WARN ] [MAIN      ] FRGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:50:31.333492] [INFO ] [MAIN      ] FRGE: Wiping existing primary data before full refresh.
[2025-10-24T18:50:31.341452] [INFO ] [LOCAL     ] FRGE: Starting deletion of primary data.
[2025-10-24T18:50:31.341329] [INFO ] [REMOTE    ] FRA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:50:31.341872] [DEBUG] [LOCAL     ] FRGE: Deleted primary data file.
[2025-10-24T18:50:31.341937] [INFO ] [MAIN      ] FRGE: Starting full primary refresh.
[2025-10-24T18:50:31.353194] [INFO ] [REMOTE    ] FRA: Fetching primary data for 2025-01.
[2025-10-24T18:50:31.720489] [INFO ] [REMOTE    ] FRGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:50:32.147621] [INFO ] [REMOTE    ] FRGE: Fetching primary data for 2025-01.
[2025-10-24T18:50:32.237946] [INFO ] [REMOTE    ] FPI: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T18:50:32.562622] [INFO ] [REMOTE    ] FRA: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T18:50:32.947685] [INFO ] [REMOTE    ] FR: Fetching primary data for 2025-05.
[2025-10-24T18:50:33.500238] [INFO ] [REMOTE    ] FRGE: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T18:50:33.747639] [INFO ] [REMOTE    ] FPI: Fetching primary data for 2025-10.
[2025-10-24T18:50:34.384628] [INFO ] [REMOTE    ] FR: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T18:50:34.547611] [INFO ] [REMOTE    ] FR: Fetching primary data for 2025-06.
[2025-10-24T18:50:34.792991] [INFO ] [REMOTE    ] FPI: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T18:50:34.798606] [INFO ] [REMOTE    ] FPI: Full fetch complete (43711 records).
[2025-10-24T18:50:34.798729] [DEBUG] [VALIDATOR ] FPI: Validating primary data.
[2025-10-24T18:50:35.174407] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present.
[2025-10-24T18:50:35.174481] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed.
[2025-10-24T18:50:35.175164] [INFO ] [MAIN      ] FPI: Fetched primary data is valid.
[2025-10-24T18:50:35.175227] [DEBUG] [LOCAL     ] FPI: Saving primary data.
[2025-10-24T18:50:35.175627] [FATAL] [LOCAL     ] FPI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:50:35.175738] [FATAL] [MAIN      ] FPI: Failed to save primary data.
[2025-10-24T18:50:35.175779] [WARN ] [MAIN      ] FPI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:50:35.175828] [INFO ] [LOCAL     ] FPI: Starting deletion of primary data.
[2025-10-24T18:50:35.175902] [DEBUG] [LOCAL     ] FPI: No primary data file found to delete.
[2025-10-24T18:50:35.175938] [INFO ] [LOCAL     ] FPI: Starting deletion of derivative data.
[2025-10-24T18:50:35.176065] [DEBUG] [LOCAL     ] FPI: Deleted derivative data file.
[2025-10-24T18:50:35.176134] [INFO ] [MAIN      ] Update Progress: 867/2366 symbols completed. FPI took 29.4s. Estimated remaining: 3h 11m 7s. Rate: 7.8 symbols/min
[2025-10-24T18:50:35.343694] [INFO ] [MAIN      ] FRO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:50:35.347672] [INFO ] [REMOTE    ] FRGE: Fetching primary data for 2025-02.
[2025-10-24T18:50:35.394629] [DEBUG] [LOCAL     ] FRO: Loaded 52061 existing records from primary storage.
[2025-10-24T18:50:35.394953] [INFO ] [MAIN      ] FRO: Loaded 52061 existing records.
[2025-10-24T18:50:35.574610] [WARN ] [MAIN      ] FRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:50:35.575021] [INFO ] [MAIN      ] FRO: Wiping existing primary data before full refresh.
[2025-10-24T18:50:35.575110] [INFO ] [LOCAL     ] FRO: Starting deletion of primary data.
[2025-10-24T18:50:35.575531] [DEBUG] [LOCAL     ] FRO: Deleted primary data file.
[2025-10-24T18:50:35.575590] [INFO ] [MAIN      ] FRO: Starting full primary refresh.
[2025-10-24T18:50:35.896010] [INFO ] [REMOTE    ] FR: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T18:50:35.981791] [INFO ] [REMOTE    ] FRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:50:36.147609] [INFO ] [REMOTE    ] FRO: Fetching primary data for 2025-01.
[2025-10-24T18:50:36.609691] [INFO ] [REMOTE    ] FRGE: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T18:50:36.947666] [INFO ] [REMOTE    ] FRA: Fetching primary data for 2025-02.
[2025-10-24T18:50:37.747615] [INFO ] [REMOTE    ] FR: Fetching primary data for 2025-07.
[2025-10-24T18:50:37.881133] [INFO ] [REMOTE    ] FRO: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T18:50:37.956016] [INFO ] [REMOTE    ] FRA: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T18:50:38.547627] [INFO ] [REMOTE    ] FRO: Fetching primary data for 2025-02.
[2025-10-24T18:50:39.347703] [INFO ] [REMOTE    ] FRGE: Fetching primary data for 2025-03.
[2025-10-24T18:50:39.385308] [INFO ] [REMOTE    ] FR: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T18:50:40.156071] [INFO ] [REMOTE    ] FR: Fetching primary data for 2025-08.
[2025-10-24T18:50:40.161322] [INFO ] [REMOTE    ] FRO: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T18:50:40.583502] [INFO ] [REMOTE    ] FRGE: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T18:50:40.947637] [INFO ] [REMOTE    ] FRA: Fetching primary data for 2025-03.
[2025-10-24T18:50:41.710335] [INFO ] [REMOTE    ] FR: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T18:50:41.747611] [INFO ] [REMOTE    ] FR: Fetching primary data for 2025-09.
[2025-10-24T18:50:41.922624] [INFO ] [REMOTE    ] FRA: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T18:50:42.547700] [INFO ] [REMOTE    ] FRGE: Fetching primary data for 2025-04.
[2025-10-24T18:50:43.303562] [INFO ] [REMOTE    ] FR: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T18:50:43.347602] [INFO ] [REMOTE    ] FR: Fetching primary data for 2025-10.
[2025-10-24T18:50:43.769271] [INFO ] [REMOTE    ] FRGE: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T18:50:44.147713] [INFO ] [REMOTE    ] FRA: Fetching primary data for 2025-04.
[2025-10-24T18:50:44.947632] [INFO ] [REMOTE    ] FRGE: Fetching primary data for 2025-05.
[2025-10-24T18:50:45.047115] [INFO ] [REMOTE    ] FR: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T18:50:45.055784] [INFO ] [REMOTE    ] FR: Full fetch complete (67327 records).
[2025-10-24T18:50:45.055907] [DEBUG] [VALIDATOR ] FR: Validating primary data.
[2025-10-24T18:50:45.263097] [INFO ] [REMOTE    ] FRA: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T18:50:45.475536] [DEBUG] [VALIDATOR ] FR: All expected trading days are present.
[2025-10-24T18:50:45.475611] [DEBUG] [VALIDATOR ] FR: Primary data validation passed.
[2025-10-24T18:50:45.476467] [INFO ] [MAIN      ] FR: Fetched primary data is valid.
[2025-10-24T18:50:45.476528] [DEBUG] [LOCAL     ] FR: Saving primary data.
[2025-10-24T18:50:45.477092] [FATAL] [LOCAL     ] FR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:50:45.477196] [FATAL] [MAIN      ] FR: Failed to save primary data.
[2025-10-24T18:50:45.477247] [WARN ] [MAIN      ] FR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:50:45.477328] [INFO ] [LOCAL     ] FR: Starting deletion of primary data.
[2025-10-24T18:50:45.477401] [DEBUG] [LOCAL     ] FR: No primary data file found to delete.
[2025-10-24T18:50:45.477449] [INFO ] [LOCAL     ] FR: Starting deletion of derivative data.
[2025-10-24T18:50:45.477615] [DEBUG] [LOCAL     ] FR: Deleted derivative data file.
[2025-10-24T18:50:45.477986] [INFO ] [MAIN      ] Update Progress: 868/2366 symbols completed. FR took 27.2s. Estimated remaining: 3h 11m 4s. Rate: 7.8 symbols/min
[2025-10-24T18:50:45.646062] [INFO ] [MAIN      ] FRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:50:45.684352] [DEBUG] [LOCAL     ] FRT: Loaded 41727 existing records from primary storage.
[2025-10-24T18:50:45.684629] [INFO ] [MAIN      ] FRT: Loaded 41727 existing records.
[2025-10-24T18:50:45.752834] [INFO ] [REMOTE    ] FRA: Fetching primary data for 2025-05.
[2025-10-24T18:50:45.876208] [WARN ] [MAIN      ] FRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:50:45.876483] [INFO ] [MAIN      ] FRT: Wiping existing primary data before full refresh.
[2025-10-24T18:50:45.876555] [INFO ] [LOCAL     ] FRT: Starting deletion of primary data.
[2025-10-24T18:50:45.876979] [DEBUG] [LOCAL     ] FRT: Deleted primary data file.
[2025-10-24T18:50:45.877037] [INFO ] [MAIN      ] FRT: Starting full primary refresh.
[2025-10-24T18:50:45.999133] [INFO ] [REMOTE    ] FRGE: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T18:50:46.247693] [INFO ] [REMOTE    ] FRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:50:46.377683] [INFO ] [REMOTE    ] FRA: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T18:50:46.547635] [INFO ] [REMOTE    ] FRT: Fetching primary data for 2025-01.
[2025-10-24T18:50:47.347746] [INFO ] [REMOTE    ] FRO: Fetching primary data for 2025-03.
[2025-10-24T18:50:47.920835] [INFO ] [REMOTE    ] FRT: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T18:50:48.147631] [INFO ] [REMOTE    ] FRA: Fetching primary data for 2025-06.
[2025-10-24T18:50:48.947630] [INFO ] [REMOTE    ] FRT: Fetching primary data for 2025-02.
[2025-10-24T18:50:49.105082] [INFO ] [REMOTE    ] FRA: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T18:50:49.144993] [INFO ] [REMOTE    ] FRO: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T18:50:49.747669] [INFO ] [REMOTE    ] FRGE: Fetching primary data for 2025-06.
[2025-10-24T18:50:50.006998] [INFO ] [REMOTE    ] FRT: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T18:50:50.252365] [INFO ] [REMOTE    ] FRGE: Incremental fetch complete for 2025-06 (0.50 seconds).
[2025-10-24T18:50:50.547697] [INFO ] [REMOTE    ] FRT: Fetching primary data for 2025-03.
[2025-10-24T18:50:51.347639] [INFO ] [REMOTE    ] FRA: Fetching primary data for 2025-07.
[2025-10-24T18:50:52.138147] [INFO ] [REMOTE    ] FRT: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T18:50:52.147615] [INFO ] [REMOTE    ] FRT: Fetching primary data for 2025-04.
[2025-10-24T18:50:52.364768] [INFO ] [REMOTE    ] FRA: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T18:50:52.947670] [INFO ] [REMOTE    ] FRO: Fetching primary data for 2025-04.
[2025-10-24T18:50:53.747717] [INFO ] [REMOTE    ] FRA: Fetching primary data for 2025-08.
[2025-10-24T18:50:53.807695] [INFO ] [REMOTE    ] FRT: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T18:50:54.547728] [INFO ] [REMOTE    ] FRGE: Fetching primary data for 2025-07.
[2025-10-24T18:50:54.562204] [INFO ] [REMOTE    ] FRA: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T18:50:54.925354] [INFO ] [REMOTE    ] FRO: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T18:50:55.347703] [INFO ] [REMOTE    ] FRT: Fetching primary data for 2025-05.
[2025-10-24T18:50:55.479349] [INFO ] [REMOTE    ] FRGE: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T18:50:56.147727] [INFO ] [REMOTE    ] FRGE: Fetching primary data for 2025-08.
[2025-10-24T18:50:56.937409] [INFO ] [REMOTE    ] FRT: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T18:50:56.947605] [INFO ] [REMOTE    ] FRO: Fetching primary data for 2025-05.
[2025-10-24T18:50:57.118184] [INFO ] [REMOTE    ] FRGE: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T18:50:57.747711] [INFO ] [REMOTE    ] FRA: Fetching primary data for 2025-09.
[2025-10-24T18:50:58.547639] [INFO ] [REMOTE    ] FRT: Fetching primary data for 2025-06.
[2025-10-24T18:50:58.705149] [INFO ] [REMOTE    ] FRA: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T18:50:58.807819] [INFO ] [REMOTE    ] FRO: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T18:50:59.347671] [INFO ] [REMOTE    ] FRA: Fetching primary data for 2025-10.
[2025-10-24T18:50:59.860274] [INFO ] [REMOTE    ] FRT: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T18:51:00.046605] [INFO ] [REMOTE    ] FRA: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T18:51:00.049623] [INFO ] [REMOTE    ] FRA: Full fetch complete (23161 records).
[2025-10-24T18:51:00.049733] [DEBUG] [VALIDATOR ] FRA: Validating primary data.
[2025-10-24T18:51:00.152997] [INFO ] [REMOTE    ] FRGE: Fetching primary data for 2025-09.
[2025-10-24T18:51:00.523717] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present.
[2025-10-24T18:51:00.523953] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed.
[2025-10-24T18:51:00.525236] [INFO ] [MAIN      ] FRA: Fetched primary data is valid.
[2025-10-24T18:51:00.525321] [DEBUG] [LOCAL     ] FRA: Saving primary data.
[2025-10-24T18:51:00.525863] [FATAL] [LOCAL     ] FRA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:51:00.525980] [FATAL] [MAIN      ] FRA: Failed to save primary data.
[2025-10-24T18:51:00.526042] [WARN ] [MAIN      ] FRA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:51:00.526100] [INFO ] [LOCAL     ] FRA: Starting deletion of primary data.
[2025-10-24T18:51:00.526184] [DEBUG] [LOCAL     ] FRA: No primary data file found to delete.
[2025-10-24T18:51:00.526245] [INFO ] [LOCAL     ] FRA: Starting deletion of derivative data.
[2025-10-24T18:51:00.526601] [DEBUG] [LOCAL     ] FRA: Deleted derivative data file.
[2025-10-24T18:51:00.526790] [INFO ] [MAIN      ] Update Progress: 869/2366 symbols completed. FRA took 30.7s. Estimated remaining: 3h 11m 9s. Rate: 7.8 symbols/min
[2025-10-24T18:51:00.793697] [INFO ] [MAIN      ] FSCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:51:00.852303] [DEBUG] [LOCAL     ] FSCO: Loaded 38800 existing records from primary storage.
[2025-10-24T18:51:00.852778] [INFO ] [MAIN      ] FSCO: Loaded 38800 existing records.
[2025-10-24T18:51:00.952850] [INFO ] [REMOTE    ] FRO: Fetching primary data for 2025-06.
[2025-10-24T18:51:01.087273] [WARN ] [MAIN      ] FSCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:51:01.087519] [INFO ] [MAIN      ] FSCO: Wiping existing primary data before full refresh.
[2025-10-24T18:51:01.087569] [INFO ] [LOCAL     ] FSCO: Starting deletion of primary data.
[2025-10-24T18:51:01.087960] [DEBUG] [LOCAL     ] FSCO: Deleted primary data file.
[2025-10-24T18:51:01.088018] [INFO ] [MAIN      ] FSCO: Starting full primary refresh.
[2025-10-24T18:51:01.501252] [INFO ] [REMOTE    ] FSCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:51:01.747696] [INFO ] [REMOTE    ] FRT: Fetching primary data for 2025-07.
[2025-10-24T18:51:02.104974] [INFO ] [REMOTE    ] FRGE: Incremental fetch complete for 2025-09 (1.95 seconds).
[2025-10-24T18:51:02.547725] [INFO ] [REMOTE    ] FRGE: Fetching primary data for 2025-10.
[2025-10-24T18:51:03.347754] [INFO ] [REMOTE    ] FSCO: Fetching primary data for 2025-01.
[2025-10-24T18:51:03.803376] [INFO ] [REMOTE    ] FRGE: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T18:51:03.805989] [INFO ] [REMOTE    ] FRGE: Full fetch complete (29768 records).
[2025-10-24T18:51:03.806080] [DEBUG] [VALIDATOR ] FRGE: Validating primary data.
[2025-10-24T18:51:04.216808] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present.
[2025-10-24T18:51:04.216937] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed.
[2025-10-24T18:51:04.217719] [INFO ] [MAIN      ] FRGE: Fetched primary data is valid.
[2025-10-24T18:51:04.217907] [DEBUG] [LOCAL     ] FRGE: Saving primary data.
[2025-10-24T18:51:04.218578] [FATAL] [LOCAL     ] FRGE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:51:04.219098] [FATAL] [MAIN      ] FRGE: Failed to save primary data.
[2025-10-24T18:51:04.219196] [WARN ] [MAIN      ] FRGE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:51:04.219281] [INFO ] [LOCAL     ] FRGE: Starting deletion of primary data.
[2025-10-24T18:51:04.219453] [DEBUG] [LOCAL     ] FRGE: No primary data file found to delete.
[2025-10-24T18:51:04.219587] [INFO ] [LOCAL     ] FRGE: Starting deletion of derivative data.
[2025-10-24T18:51:04.219835] [DEBUG] [LOCAL     ] FRGE: Deleted derivative data file.
[2025-10-24T18:51:04.219939] [INFO ] [MAIN      ] Update Progress: 870/2366 symbols completed. FRGE took 34.0s. Estimated remaining: 3h 10m 54s. Rate: 7.8 symbols/min
[2025-10-24T18:51:04.391264] [INFO ] [REMOTE    ] FRT: Incremental fetch complete for 2025-07 (2.64 seconds).
[2025-10-24T18:51:04.432152] [INFO ] [MAIN      ] FSK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:51:04.434105] [INFO ] [REMOTE    ] FRT: Fetching primary data for 2025-08.
[2025-10-24T18:51:04.469069] [INFO ] [REMOTE    ] FRO: Incremental fetch complete for 2025-06 (3.52 seconds).
[2025-10-24T18:51:04.521673] [DEBUG] [LOCAL     ] FSK: Loaded 49831 existing records from primary storage.
[2025-10-24T18:51:04.521989] [INFO ] [MAIN      ] FSK: Loaded 49831 existing records.
[2025-10-24T18:51:04.694617] [WARN ] [MAIN      ] FSK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:51:04.694882] [INFO ] [MAIN      ] FSK: Wiping existing primary data before full refresh.
[2025-10-24T18:51:04.694929] [INFO ] [LOCAL     ] FSK: Starting deletion of primary data.
[2025-10-24T18:51:04.695127] [DEBUG] [LOCAL     ] FSK: Deleted primary data file.
[2025-10-24T18:51:04.695165] [INFO ] [MAIN      ] FSK: Starting full primary refresh.
[2025-10-24T18:51:04.957982] [INFO ] [REMOTE    ] FRO: Fetching primary data for 2025-07.
[2025-10-24T18:51:05.050826] [INFO ] [REMOTE    ] FSK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:51:05.263267] [INFO ] [REMOTE    ] FSCO: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T18:51:05.747668] [INFO ] [REMOTE    ] FSCO: Fetching primary data for 2025-02.
[2025-10-24T18:51:06.547753] [INFO ] [REMOTE    ] FSK: Fetching primary data for 2025-01.
[2025-10-24T18:51:06.607451] [INFO ] [REMOTE    ] FRT: Incremental fetch complete for 2025-08 (2.17 seconds).
[2025-10-24T18:51:07.321075] [INFO ] [REMOTE    ] FSCO: Incremental fetch complete for 2025-02 (1.57 seconds).
[2025-10-24T18:51:07.347619] [INFO ] [REMOTE    ] FSCO: Fetching primary data for 2025-03.
[2025-10-24T18:51:07.469450] [INFO ] [REMOTE    ] FRO: Incremental fetch complete for 2025-07 (2.51 seconds).
[2025-10-24T18:51:08.147684] [INFO ] [REMOTE    ] FRO: Fetching primary data for 2025-08.
[2025-10-24T18:51:08.263468] [INFO ] [REMOTE    ] FSK: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T18:51:08.794486] [INFO ] [REMOTE    ] FSCO: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T18:51:08.947730] [INFO ] [REMOTE    ] FRT: Fetching primary data for 2025-09.
[2025-10-24T18:51:09.747620] [INFO ] [REMOTE    ] FSK: Fetching primary data for 2025-02.
[2025-10-24T18:51:09.800200] [INFO ] [REMOTE    ] FRO: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T18:51:10.547635] [INFO ] [REMOTE    ] FSCO: Fetching primary data for 2025-04.
[2025-10-24T18:51:10.657321] [INFO ] [REMOTE    ] FRT: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T18:51:10.907592] [INFO ] [REMOTE    ] FSK: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T18:51:11.347683] [INFO ] [REMOTE    ] FRT: Fetching primary data for 2025-10.
[2025-10-24T18:51:11.601243] [INFO ] [REMOTE    ] FSCO: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T18:51:12.147674] [INFO ] [REMOTE    ] FSCO: Fetching primary data for 2025-05.
[2025-10-24T18:51:12.922485] [INFO ] [REMOTE    ] FRT: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T18:51:12.929583] [INFO ] [REMOTE    ] FRT: Full fetch complete (60421 records).
[2025-10-24T18:51:12.929729] [DEBUG] [VALIDATOR ] FRT: Validating primary data.
[2025-10-24T18:51:12.952816] [INFO ] [REMOTE    ] FRO: Fetching primary data for 2025-09.
[2025-10-24T18:51:13.328705] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present.
[2025-10-24T18:51:13.328862] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed.
[2025-10-24T18:51:13.329709] [INFO ] [MAIN      ] FRT: Fetched primary data is valid.
[2025-10-24T18:51:13.329813] [DEBUG] [LOCAL     ] FRT: Saving primary data.
[2025-10-24T18:51:13.330458] [FATAL] [LOCAL     ] FRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:51:13.330542] [FATAL] [MAIN      ] FRT: Failed to save primary data.
[2025-10-24T18:51:13.330585] [WARN ] [MAIN      ] FRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:51:13.330620] [INFO ] [LOCAL     ] FRT: Starting deletion of primary data.
[2025-10-24T18:51:13.330707] [DEBUG] [LOCAL     ] FRT: No primary data file found to delete.
[2025-10-24T18:51:13.330756] [INFO ] [LOCAL     ] FRT: Starting deletion of derivative data.
[2025-10-24T18:51:13.330880] [DEBUG] [LOCAL     ] FRT: Deleted derivative data file.
[2025-10-24T18:51:13.330954] [INFO ] [MAIN      ] Update Progress: 871/2366 symbols completed. FRT took 27.9s. Estimated remaining: 3h 10m 49s. Rate: 7.8 symbols/min
[2025-10-24T18:51:13.505148] [INFO ] [MAIN      ] FSLY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:51:13.527113] [INFO ] [REMOTE    ] FSCO: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T18:51:13.577793] [DEBUG] [LOCAL     ] FSLY: Loaded 51652 existing records from primary storage.
[2025-10-24T18:51:13.578105] [INFO ] [MAIN      ] FSLY: Loaded 51652 existing records.
[2025-10-24T18:51:13.752917] [INFO ] [REMOTE    ] FSK: Fetching primary data for 2025-03.
[2025-10-24T18:51:13.757152] [WARN ] [MAIN      ] FSLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:51:13.758135] [INFO ] [MAIN      ] FSLY: Wiping existing primary data before full refresh.
[2025-10-24T18:51:13.758184] [INFO ] [LOCAL     ] FSLY: Starting deletion of primary data.
[2025-10-24T18:51:13.758365] [DEBUG] [LOCAL     ] FSLY: Deleted primary data file.
[2025-10-24T18:51:13.758403] [INFO ] [MAIN      ] FSLY: Starting full primary refresh.
[2025-10-24T18:51:14.124772] [INFO ] [REMOTE    ] FSLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:51:14.547740] [INFO ] [REMOTE    ] FSCO: Fetching primary data for 2025-06.
[2025-10-24T18:51:14.838515] [INFO ] [REMOTE    ] FRO: Incremental fetch complete for 2025-09 (1.89 seconds).
[2025-10-24T18:51:15.052983] [INFO ] [REMOTE    ] FSK: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T18:51:15.347619] [INFO ] [REMOTE    ] FSLY: Fetching primary data for 2025-01.
[2025-10-24T18:51:15.770743] [INFO ] [REMOTE    ] FSCO: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T18:51:16.147703] [INFO ] [REMOTE    ] FSCO: Fetching primary data for 2025-07.
[2025-10-24T18:51:16.947618] [INFO ] [REMOTE    ] FSK: Fetching primary data for 2025-04.
[2025-10-24T18:51:16.982621] [INFO ] [REMOTE    ] FSLY: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T18:51:17.179390] [INFO ] [REMOTE    ] FSCO: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T18:51:17.747743] [INFO ] [REMOTE    ] FRO: Fetching primary data for 2025-10.
[2025-10-24T18:51:18.547619] [INFO ] [REMOTE    ] FSLY: Fetching primary data for 2025-02.
[2025-10-24T18:51:18.799888] [INFO ] [REMOTE    ] FSK: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T18:51:19.347719] [INFO ] [REMOTE    ] FSCO: Fetching primary data for 2025-08.
[2025-10-24T18:51:19.531309] [INFO ] [REMOTE    ] FRO: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T18:51:19.541276] [INFO ] [REMOTE    ] FRO: Full fetch complete (75384 records).
[2025-10-24T18:51:19.541433] [DEBUG] [VALIDATOR ] FRO: Validating primary data.
[2025-10-24T18:51:19.934945] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present.
[2025-10-24T18:51:19.935056] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed.
[2025-10-24T18:51:19.936015] [INFO ] [MAIN      ] FRO: Fetched primary data is valid.
[2025-10-24T18:51:19.936165] [DEBUG] [LOCAL     ] FRO: Saving primary data.
[2025-10-24T18:51:19.936947] [FATAL] [LOCAL     ] FRO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:51:19.937064] [FATAL] [MAIN      ] FRO: Failed to save primary data.
[2025-10-24T18:51:19.937186] [WARN ] [MAIN      ] FRO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:51:19.937357] [INFO ] [LOCAL     ] FRO: Starting deletion of primary data.
[2025-10-24T18:51:19.937578] [DEBUG] [LOCAL     ] FRO: No primary data file found to delete.
[2025-10-24T18:51:19.937679] [INFO ] [LOCAL     ] FRO: Starting deletion of derivative data.
[2025-10-24T18:51:19.937933] [DEBUG] [LOCAL     ] FRO: Deleted derivative data file.
[2025-10-24T18:51:19.938511] [INFO ] [MAIN      ] Update Progress: 872/2366 symbols completed. FRO took 44.8s. Estimated remaining: 3h 10m 40s. Rate: 7.8 symbols/min
[2025-10-24T18:51:20.052590] [INFO ] [REMOTE    ] FSLY: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T18:51:20.168474] [INFO ] [REMOTE    ] FSLY: Fetching primary data for 2025-03.
[2025-10-24T18:51:20.172103] [INFO ] [MAIN      ] FSM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:51:20.224866] [DEBUG] [LOCAL     ] FSM: Loaded 53690 existing records from primary storage.
[2025-10-24T18:51:20.225173] [INFO ] [MAIN      ] FSM: Loaded 53690 existing records.
[2025-10-24T18:51:20.416962] [WARN ] [MAIN      ] FSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:51:20.417295] [INFO ] [MAIN      ] FSM: Wiping existing primary data before full refresh.
[2025-10-24T18:51:20.417354] [INFO ] [LOCAL     ] FSM: Starting deletion of primary data.
[2025-10-24T18:51:20.417632] [DEBUG] [LOCAL     ] FSM: Deleted primary data file.
[2025-10-24T18:51:20.417714] [INFO ] [MAIN      ] FSM: Starting full primary refresh.
[2025-10-24T18:51:20.799389] [INFO ] [REMOTE    ] FSM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:51:20.823040] [INFO ] [REMOTE    ] FSCO: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T18:51:20.947638] [INFO ] [REMOTE    ] FSM: Fetching primary data for 2025-01.
[2025-10-24T18:51:21.747674] [INFO ] [REMOTE    ] FSK: Fetching primary data for 2025-05.
[2025-10-24T18:51:21.955083] [INFO ] [REMOTE    ] FSLY: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T18:51:22.547708] [INFO ] [REMOTE    ] FSLY: Fetching primary data for 2025-04.
[2025-10-24T18:51:22.642545] [INFO ] [REMOTE    ] FSM: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T18:51:23.284895] [INFO ] [REMOTE    ] FSK: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T18:51:23.347606] [INFO ] [REMOTE    ] FSK: Fetching primary data for 2025-06.
[2025-10-24T18:51:24.095039] [INFO ] [REMOTE    ] FSLY: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T18:51:24.147599] [INFO ] [REMOTE    ] FSLY: Fetching primary data for 2025-05.
[2025-10-24T18:51:24.832498] [INFO ] [REMOTE    ] FSK: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T18:51:24.947670] [INFO ] [REMOTE    ] FSCO: Fetching primary data for 2025-09.
[2025-10-24T18:51:25.696594] [INFO ] [REMOTE    ] FSLY: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T18:51:25.747609] [INFO ] [REMOTE    ] FSM: Fetching primary data for 2025-02.
[2025-10-24T18:51:26.394886] [INFO ] [REMOTE    ] FSCO: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T18:51:26.547634] [INFO ] [REMOTE    ] FSCO: Fetching primary data for 2025-10.
[2025-10-24T18:51:27.271411] [INFO ] [REMOTE    ] FSM: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T18:51:27.347704] [INFO ] [REMOTE    ] FSM: Fetching primary data for 2025-03.
[2025-10-24T18:51:28.121159] [INFO ] [REMOTE    ] FSCO: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T18:51:28.130595] [INFO ] [REMOTE    ] FSCO: Full fetch complete (55293 records).
[2025-10-24T18:51:28.130812] [DEBUG] [VALIDATOR ] FSCO: Validating primary data.
[2025-10-24T18:51:28.155879] [INFO ] [REMOTE    ] FSK: Fetching primary data for 2025-07.
[2025-10-24T18:51:28.528690] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present.
[2025-10-24T18:51:28.528772] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed.
[2025-10-24T18:51:28.529516] [INFO ] [MAIN      ] FSCO: Fetched primary data is valid.
[2025-10-24T18:51:28.529555] [DEBUG] [LOCAL     ] FSCO: Saving primary data.
[2025-10-24T18:51:28.530010] [FATAL] [LOCAL     ] FSCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:51:28.530093] [FATAL] [MAIN      ] FSCO: Failed to save primary data.
[2025-10-24T18:51:28.530135] [WARN ] [MAIN      ] FSCO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:51:28.530170] [INFO ] [LOCAL     ] FSCO: Starting deletion of primary data.
[2025-10-24T18:51:28.530219] [DEBUG] [LOCAL     ] FSCO: No primary data file found to delete.
[2025-10-24T18:51:28.530253] [INFO ] [LOCAL     ] FSCO: Starting deletion of derivative data.
[2025-10-24T18:51:28.530397] [DEBUG] [LOCAL     ] FSCO: Deleted derivative data file.
[2025-10-24T18:51:28.530468] [INFO ] [MAIN      ] Update Progress: 873/2366 symbols completed. FSCO took 28.0s. Estimated remaining: 3h 10m 34s. Rate: 7.8 symbols/min
[2025-10-24T18:51:28.703407] [INFO ] [MAIN      ] FSS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:51:28.737535] [DEBUG] [LOCAL     ] FSS: Loaded 33299 existing records from primary storage.
[2025-10-24T18:51:28.737856] [INFO ] [MAIN      ] FSS: Loaded 33299 existing records.
[2025-10-24T18:51:28.923976] [WARN ] [MAIN      ] FSS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:51:28.924177] [INFO ] [MAIN      ] FSS: Wiping existing primary data before full refresh.
[2025-10-24T18:51:28.924264] [INFO ] [LOCAL     ] FSS: Starting deletion of primary data.
[2025-10-24T18:51:28.924486] [DEBUG] [LOCAL     ] FSS: Deleted primary data file.
[2025-10-24T18:51:28.924527] [INFO ] [MAIN      ] FSS: Starting full primary refresh.
[2025-10-24T18:51:28.957237] [INFO ] [REMOTE    ] FSLY: Fetching primary data for 2025-06.
[2025-10-24T18:51:29.302163] [INFO ] [REMOTE    ] FSS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:51:29.332039] [INFO ] [REMOTE    ] FSM: Incremental fetch complete for 2025-03 (1.98 seconds).
[2025-10-24T18:51:29.585793] [INFO ] [REMOTE    ] FSK: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T18:51:29.747629] [INFO ] [REMOTE    ] FSK: Fetching primary data for 2025-08.
[2025-10-24T18:51:30.295283] [INFO ] [REMOTE    ] FSLY: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T18:51:30.547693] [INFO ] [REMOTE    ] FSS: Fetching primary data for 2025-01.
[2025-10-24T18:51:31.347702] [INFO ] [REMOTE    ] FSM: Fetching primary data for 2025-04.
[2025-10-24T18:51:31.462579] [INFO ] [REMOTE    ] FSK: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T18:51:31.871263] [INFO ] [REMOTE    ] FSS: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T18:51:32.147673] [INFO ] [REMOTE    ] FSS: Fetching primary data for 2025-02.
[2025-10-24T18:51:32.923506] [INFO ] [REMOTE    ] FSM: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T18:51:32.947616] [INFO ] [REMOTE    ] FSM: Fetching primary data for 2025-05.
[2025-10-24T18:51:33.518420] [INFO ] [REMOTE    ] FSS: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T18:51:33.747681] [INFO ] [REMOTE    ] FSLY: Fetching primary data for 2025-07.
[2025-10-24T18:51:34.547621] [INFO ] [REMOTE    ] FSS: Fetching primary data for 2025-03.
[2025-10-24T18:51:34.901070] [INFO ] [REMOTE    ] FSM: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T18:51:35.347618] [INFO ] [REMOTE    ] FSM: Fetching primary data for 2025-06.
[2025-10-24T18:51:35.467307] [INFO ] [REMOTE    ] FSLY: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T18:51:35.922423] [INFO ] [REMOTE    ] FSS: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T18:51:36.147746] [INFO ] [REMOTE    ] FSS: Fetching primary data for 2025-04.
[2025-10-24T18:51:36.952795] [INFO ] [REMOTE    ] FSLY: Fetching primary data for 2025-08.
[2025-10-24T18:51:36.955621] [INFO ] [REMOTE    ] FSM: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T18:51:37.747613] [INFO ] [REMOTE    ] FSK: Fetching primary data for 2025-09.
[2025-10-24T18:51:37.771000] [INFO ] [REMOTE    ] FSS: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T18:51:38.287159] [INFO ] [REMOTE    ] FSLY: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T18:51:38.547613] [INFO ] [REMOTE    ] FSM: Fetching primary data for 2025-07.
[2025-10-24T18:51:39.347620] [INFO ] [REMOTE    ] FSLY: Fetching primary data for 2025-09.
[2025-10-24T18:51:39.624683] [INFO ] [REMOTE    ] FSK: Incremental fetch complete for 2025-09 (1.88 seconds).
[2025-10-24T18:51:40.147670] [INFO ] [REMOTE    ] FSS: Fetching primary data for 2025-05.
[2025-10-24T18:51:40.264403] [INFO ] [REMOTE    ] FSM: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T18:51:40.506740] [INFO ] [REMOTE    ] FSLY: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T18:51:40.947607] [INFO ] [REMOTE    ] FSLY: Fetching primary data for 2025-10.
[2025-10-24T18:51:41.398184] [INFO ] [REMOTE    ] FSS: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T18:51:41.747638] [INFO ] [REMOTE    ] FSK: Fetching primary data for 2025-10.
[2025-10-24T18:51:42.547611] [INFO ] [REMOTE    ] FSS: Fetching primary data for 2025-06.
[2025-10-24T18:51:42.707574] [INFO ] [REMOTE    ] FSLY: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T18:51:42.717023] [INFO ] [REMOTE    ] FSLY: Full fetch complete (74889 records).
[2025-10-24T18:51:42.717188] [DEBUG] [VALIDATOR ] FSLY: Validating primary data.
[2025-10-24T18:51:43.125894] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present.
[2025-10-24T18:51:43.126021] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed.
[2025-10-24T18:51:43.126955] [INFO ] [MAIN      ] FSLY: Fetched primary data is valid.
[2025-10-24T18:51:43.127017] [DEBUG] [LOCAL     ] FSLY: Saving primary data.
[2025-10-24T18:51:43.127581] [FATAL] [LOCAL     ] FSLY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:51:43.127733] [FATAL] [MAIN      ] FSLY: Failed to save primary data.
[2025-10-24T18:51:43.127777] [WARN ] [MAIN      ] FSLY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:51:43.127812] [INFO ] [LOCAL     ] FSLY: Starting deletion of primary data.
[2025-10-24T18:51:43.127875] [DEBUG] [LOCAL     ] FSLY: No primary data file found to delete.
[2025-10-24T18:51:43.127930] [INFO ] [LOCAL     ] FSLY: Starting deletion of derivative data.
[2025-10-24T18:51:43.128187] [DEBUG] [LOCAL     ] FSLY: Deleted derivative data file.
[2025-10-24T18:51:43.128584] [INFO ] [MAIN      ] Update Progress: 874/2366 symbols completed. FSLY took 29.8s. Estimated remaining: 3h 10m 38s. Rate: 7.8 symbols/min
[2025-10-24T18:51:43.307507] [INFO ] [MAIN      ] FT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:51:43.317578] [DEBUG] [LOCAL     ] FT: Loaded 6885 existing records from primary storage.
[2025-10-24T18:51:43.317821] [INFO ] [MAIN      ] FT: Loaded 6885 existing records.
[2025-10-24T18:51:43.359895] [INFO ] [REMOTE    ] FSM: Fetching primary data for 2025-08.
[2025-10-24T18:51:43.505317] [WARN ] [MAIN      ] FT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:51:43.505779] [INFO ] [MAIN      ] FT: Wiping existing primary data before full refresh.
[2025-10-24T18:51:43.505891] [INFO ] [LOCAL     ] FT: Starting deletion of primary data.
[2025-10-24T18:51:43.506128] [DEBUG] [LOCAL     ] FT: Deleted primary data file.
[2025-10-24T18:51:43.506188] [INFO ] [MAIN      ] FT: Starting full primary refresh.
[2025-10-24T18:51:43.881441] [INFO ] [REMOTE    ] FT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:51:43.948194] [INFO ] [REMOTE    ] FSS: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T18:51:43.957237] [INFO ] [REMOTE    ] FSK: Incremental fetch complete for 2025-10 (2.21 seconds).
[2025-10-24T18:51:43.966813] [INFO ] [REMOTE    ] FSK: Full fetch complete (72116 records).
[2025-10-24T18:51:43.966933] [DEBUG] [VALIDATOR ] FSK: Validating primary data.
[2025-10-24T18:51:44.161519] [INFO ] [REMOTE    ] FSS: Fetching primary data for 2025-07.
[2025-10-24T18:51:44.362798] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present.
[2025-10-24T18:51:44.362882] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed.
[2025-10-24T18:51:44.364045] [INFO ] [MAIN      ] FSK: Fetched primary data is valid.
[2025-10-24T18:51:44.364108] [DEBUG] [LOCAL     ] FSK: Saving primary data.
[2025-10-24T18:51:44.364707] [FATAL] [LOCAL     ] FSK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:51:44.364794] [FATAL] [MAIN      ] FSK: Failed to save primary data.
[2025-10-24T18:51:44.364836] [WARN ] [MAIN      ] FSK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:51:44.364871] [INFO ] [LOCAL     ] FSK: Starting deletion of primary data.
[2025-10-24T18:51:44.364923] [DEBUG] [LOCAL     ] FSK: No primary data file found to delete.
[2025-10-24T18:51:44.364957] [INFO ] [LOCAL     ] FSK: Starting deletion of derivative data.
[2025-10-24T18:51:44.365103] [DEBUG] [LOCAL     ] FSK: Deleted derivative data file.
[2025-10-24T18:51:44.365607] [INFO ] [MAIN      ] Update Progress: 875/2366 symbols completed. FSK took 40.1s. Estimated remaining: 3h 10m 19s. Rate: 7.8 symbols/min
[2025-10-24T18:51:44.536475] [INFO ] [MAIN      ] FTHY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:51:44.551267] [DEBUG] [LOCAL     ] FTHY: Loaded 12371 existing records from primary storage.
[2025-10-24T18:51:44.551524] [INFO ] [MAIN      ] FTHY: Loaded 12371 existing records.
[2025-10-24T18:51:44.729741] [WARN ] [MAIN      ] FTHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:51:44.729952] [INFO ] [MAIN      ] FTHY: Wiping existing primary data before full refresh.
[2025-10-24T18:51:44.729998] [INFO ] [LOCAL     ] FTHY: Starting deletion of primary data.
[2025-10-24T18:51:44.730163] [DEBUG] [LOCAL     ] FTHY: Deleted primary data file.
[2025-10-24T18:51:44.730201] [INFO ] [MAIN      ] FTHY: Starting full primary refresh.
[2025-10-24T18:51:44.965035] [INFO ] [REMOTE    ] FT: Fetching primary data for 2025-01.
[2025-10-24T18:51:45.094039] [INFO ] [REMOTE    ] FTHY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:51:45.212599] [INFO ] [REMOTE    ] FSM: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T18:51:45.654846] [INFO ] [REMOTE    ] FT: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T18:51:45.697576] [INFO ] [REMOTE    ] FSS: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T18:51:45.747608] [INFO ] [REMOTE    ] FSS: Fetching primary data for 2025-08.
[2025-10-24T18:51:46.547690] [INFO ] [REMOTE    ] FSM: Fetching primary data for 2025-09.
[2025-10-24T18:51:47.031683] [INFO ] [REMOTE    ] FSS: Incremental fetch complete for 2025-08 (1.28 seconds).
[2025-10-24T18:51:47.347689] [INFO ] [REMOTE    ] FTHY: Fetching primary data for 2025-01.
[2025-10-24T18:51:48.147728] [INFO ] [REMOTE    ] FT: Fetching primary data for 2025-02.
[2025-10-24T18:51:48.199246] [INFO ] [REMOTE    ] FTHY: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T18:51:48.386757] [INFO ] [REMOTE    ] FSM: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T18:51:48.523436] [INFO ] [REMOTE    ] FT: Incremental fetch complete for 2025-02 (0.38 seconds).
[2025-10-24T18:51:48.947671] [INFO ] [REMOTE    ] FSM: Fetching primary data for 2025-10.
[2025-10-24T18:51:49.747675] [INFO ] [REMOTE    ] FSS: Fetching primary data for 2025-09.
[2025-10-24T18:51:50.547624] [INFO ] [REMOTE    ] FT: Fetching primary data for 2025-03.
[2025-10-24T18:51:50.805723] [INFO ] [REMOTE    ] FSM: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T18:51:50.815599] [INFO ] [REMOTE    ] FSM: Full fetch complete (77180 records).
[2025-10-24T18:51:50.815747] [DEBUG] [VALIDATOR ] FSM: Validating primary data.
[2025-10-24T18:51:51.123505] [INFO ] [REMOTE    ] FSS: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T18:51:51.150378] [INFO ] [REMOTE    ] FT: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T18:51:51.245533] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present.
[2025-10-24T18:51:51.245631] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed.
[2025-10-24T18:51:51.246590] [INFO ] [MAIN      ] FSM: Fetched primary data is valid.
[2025-10-24T18:51:51.246671] [DEBUG] [LOCAL     ] FSM: Saving primary data.
[2025-10-24T18:51:51.247285] [FATAL] [LOCAL     ] FSM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:51:51.247375] [FATAL] [MAIN      ] FSM: Failed to save primary data.
[2025-10-24T18:51:51.247418] [WARN ] [MAIN      ] FSM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:51:51.247452] [INFO ] [LOCAL     ] FSM: Starting deletion of primary data.
[2025-10-24T18:51:51.247505] [DEBUG] [LOCAL     ] FSM: No primary data file found to delete.
[2025-10-24T18:51:51.247547] [INFO ] [LOCAL     ] FSM: Starting deletion of derivative data.
[2025-10-24T18:51:51.247756] [DEBUG] [LOCAL     ] FSM: Deleted derivative data file.
[2025-10-24T18:51:51.248056] [INFO ] [MAIN      ] Update Progress: 876/2366 symbols completed. FSM took 31.3s. Estimated remaining: 3h 10m 10s. Rate: 7.8 symbols/min
[2025-10-24T18:51:51.350386] [INFO ] [REMOTE    ] FT: Fetching primary data for 2025-04.
[2025-10-24T18:51:51.421161] [INFO ] [MAIN      ] FTI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:51:51.471417] [DEBUG] [LOCAL     ] FTI: Loaded 53683 existing records from primary storage.
[2025-10-24T18:51:51.471790] [INFO ] [MAIN      ] FTI: Loaded 53683 existing records.
[2025-10-24T18:51:51.649704] [WARN ] [MAIN      ] FTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:51:51.649904] [INFO ] [MAIN      ] FTI: Wiping existing primary data before full refresh.
[2025-10-24T18:51:51.649948] [INFO ] [LOCAL     ] FTI: Starting deletion of primary data.
[2025-10-24T18:51:51.650205] [DEBUG] [LOCAL     ] FTI: Deleted primary data file.
[2025-10-24T18:51:51.650260] [INFO ] [MAIN      ] FTI: Starting full primary refresh.
[2025-10-24T18:51:52.003901] [INFO ] [REMOTE    ] FTI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:51:52.114482] [INFO ] [REMOTE    ] FT: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T18:51:52.147626] [INFO ] [REMOTE    ] FTI: Fetching primary data for 2025-01.
[2025-10-24T18:51:52.947706] [INFO ] [REMOTE    ] FSS: Fetching primary data for 2025-10.
[2025-10-24T18:51:53.747730] [INFO ] [REMOTE    ] FT: Fetching primary data for 2025-05.
[2025-10-24T18:51:53.921597] [INFO ] [REMOTE    ] FTI: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T18:51:54.368435] [INFO ] [REMOTE    ] FSS: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T18:51:54.373817] [INFO ] [REMOTE    ] FSS: Full fetch complete (48333 records).
[2025-10-24T18:51:54.373914] [DEBUG] [VALIDATOR ] FSS: Validating primary data.
[2025-10-24T18:51:54.524793] [INFO ] [REMOTE    ] FT: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T18:51:54.547633] [INFO ] [REMOTE    ] FT: Fetching primary data for 2025-06.
[2025-10-24T18:51:54.800958] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present.
[2025-10-24T18:51:54.801276] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed.
[2025-10-24T18:51:54.802022] [INFO ] [MAIN      ] FSS: Fetched primary data is valid.
[2025-10-24T18:51:54.802084] [DEBUG] [LOCAL     ] FSS: Saving primary data.
[2025-10-24T18:51:54.802561] [FATAL] [LOCAL     ] FSS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:51:54.802705] [FATAL] [MAIN      ] FSS: Failed to save primary data.
[2025-10-24T18:51:54.802748] [WARN ] [MAIN      ] FSS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:51:54.802783] [INFO ] [LOCAL     ] FSS: Starting deletion of primary data.
[2025-10-24T18:51:54.802846] [DEBUG] [LOCAL     ] FSS: No primary data file found to delete.
[2025-10-24T18:51:54.802902] [INFO ] [LOCAL     ] FSS: Starting deletion of derivative data.
[2025-10-24T18:51:54.803697] [DEBUG] [LOCAL     ] FSS: Deleted derivative data file.
[2025-10-24T18:51:54.803803] [INFO ] [MAIN      ] Update Progress: 877/2366 symbols completed. FSS took 26.3s. Estimated remaining: 3h 9m 56s. Rate: 7.8 symbols/min
[2025-10-24T18:51:55.192458] [INFO ] [REMOTE    ] FT: Incremental fetch complete for 2025-06 (0.64 seconds).
[2025-10-24T18:51:55.347680] [INFO ] [REMOTE    ] FT: Fetching primary data for 2025-07.
[2025-10-24T18:51:56.043724] [INFO ] [REMOTE    ] FT: Incremental fetch complete for 2025-07 (0.70 seconds).
[2025-10-24T18:51:56.147682] [INFO ] [REMOTE    ] FTI: Fetching primary data for 2025-02.
[2025-10-24T18:51:56.947761] [INFO ] [REMOTE    ] FTHY: Fetching primary data for 2025-02.
[2025-10-24T18:51:57.704027] [INFO ] [REMOTE    ] FTI: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T18:51:57.747631] [INFO ] [REMOTE    ] FTI: Fetching primary data for 2025-03.
[2025-10-24T18:51:57.760155] [INFO ] [REMOTE    ] FTHY: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T18:51:58.547732] [INFO ] [REMOTE    ] FTHY: Fetching primary data for 2025-03.
[2025-10-24T18:51:59.258375] [INFO ] [REMOTE    ] FTHY: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T18:51:59.358424] [INFO ] [REMOTE    ] FT: Fetching primary data for 2025-08.
[2025-10-24T18:51:59.363864] [INFO ] [REMOTE    ] FTI: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T18:52:00.103115] [INFO ] [REMOTE    ] FT: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T18:52:00.147741] [INFO ] [REMOTE    ] FTHY: Fetching primary data for 2025-04.
[2025-10-24T18:52:00.947748] [INFO ] [REMOTE    ] FTI: Fetching primary data for 2025-04.
[2025-10-24T18:52:01.084389] [INFO ] [REMOTE    ] FTHY: Incremental fetch complete for 2025-04 (0.94 seconds).
[2025-10-24T18:52:01.747726] [INFO ] [REMOTE    ] FTHY: Fetching primary data for 2025-05.
[2025-10-24T18:52:02.486625] [INFO ] [REMOTE    ] FTHY: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T18:52:02.547679] [INFO ] [REMOTE    ] FT: Fetching primary data for 2025-09.
[2025-10-24T18:52:02.672048] [INFO ] [REMOTE    ] FTI: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T18:52:03.012045] [INFO ] [REMOTE    ] FT: Incremental fetch complete for 2025-09 (0.46 seconds).
[2025-10-24T18:52:03.347719] [INFO ] [REMOTE    ] FT: Fetching primary data for 2025-10.
[2025-10-24T18:52:04.148042] [INFO ] [REMOTE    ] FTI: Fetching primary data for 2025-05.
[2025-10-24T18:52:04.149236] [INFO ] [REMOTE    ] FT: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T18:52:04.152797] [INFO ] [REMOTE    ] FT: Full fetch complete (9327 records).
[2025-10-24T18:52:04.152886] [DEBUG] [VALIDATOR ] FT: Validating primary data.
[2025-10-24T18:52:04.527928] [DEBUG] [VALIDATOR ] FT: All expected trading days are present.
[2025-10-24T18:52:04.528019] [DEBUG] [VALIDATOR ] FT: Primary data validation passed.
[2025-10-24T18:52:04.528344] [INFO ] [MAIN      ] FT: Fetched primary data is valid.
[2025-10-24T18:52:04.528387] [DEBUG] [LOCAL     ] FT: Saving primary data.
[2025-10-24T18:52:04.528595] [FATAL] [LOCAL     ] FT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:52:04.528701] [FATAL] [MAIN      ] FT: Failed to save primary data.
[2025-10-24T18:52:04.528766] [WARN ] [MAIN      ] FT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:52:04.528843] [INFO ] [LOCAL     ] FT: Starting deletion of primary data.
[2025-10-24T18:52:04.528904] [DEBUG] [LOCAL     ] FT: No primary data file found to delete.
[2025-10-24T18:52:04.528941] [INFO ] [LOCAL     ] FT: Starting deletion of derivative data.
[2025-10-24T18:52:04.529357] [DEBUG] [LOCAL     ] FT: Deleted derivative data file.
[2025-10-24T18:52:04.529757] [INFO ] [MAIN      ] Update Progress: 878/2366 symbols completed. FT took 21.4s. Estimated remaining: 3h 9m 52s. Rate: 7.8 symbols/min
[2025-10-24T18:52:04.947739] [INFO ] [REMOTE    ] FTHY: Fetching primary data for 2025-06.
[2025-10-24T18:52:05.758180] [INFO ] [REMOTE    ] FTHY: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T18:52:05.760972] [INFO ] [REMOTE    ] FTHY: Fetching primary data for 2025-07.
[2025-10-24T18:52:05.798622] [INFO ] [REMOTE    ] FTI: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T18:52:06.547736] [INFO ] [REMOTE    ] FTI: Fetching primary data for 2025-06.
[2025-10-24T18:52:06.570986] [INFO ] [REMOTE    ] FTHY: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T18:52:07.347741] [INFO ] [REMOTE    ] FTHY: Fetching primary data for 2025-08.
[2025-10-24T18:52:08.211161] [INFO ] [REMOTE    ] FTHY: Incremental fetch complete for 2025-08 (0.86 seconds).
[2025-10-24T18:52:08.214342] [INFO ] [REMOTE    ] FTHY: Fetching primary data for 2025-09.
[2025-10-24T18:52:08.369524] [INFO ] [REMOTE    ] FTI: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T18:52:08.947618] [INFO ] [REMOTE    ] FTI: Fetching primary data for 2025-07.
[2025-10-24T18:52:09.036636] [INFO ] [REMOTE    ] FTHY: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T18:52:09.747737] [INFO ] [REMOTE    ] FTHY: Fetching primary data for 2025-10.
[2025-10-24T18:52:10.753910] [INFO ] [REMOTE    ] FTHY: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T18:52:10.756837] [INFO ] [REMOTE    ] FTHY: Full fetch complete (17263 records).
[2025-10-24T18:52:10.756906] [DEBUG] [VALIDATOR ] FTHY: Validating primary data.
[2025-10-24T18:52:10.922282] [INFO ] [REMOTE    ] FTI: Incremental fetch complete for 2025-07 (1.97 seconds).
[2025-10-24T18:52:11.000504] [INFO ] [REMOTE    ] FTI: Fetching primary data for 2025-08.
[2025-10-24T18:52:11.182574] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present.
[2025-10-24T18:52:11.182673] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed.
[2025-10-24T18:52:11.183091] [INFO ] [MAIN      ] FTHY: Fetched primary data is valid.
[2025-10-24T18:52:11.183132] [DEBUG] [LOCAL     ] FTHY: Saving primary data.
[2025-10-24T18:52:11.183366] [FATAL] [LOCAL     ] FTHY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:52:11.183448] [FATAL] [MAIN      ] FTHY: Failed to save primary data.
[2025-10-24T18:52:11.183489] [WARN ] [MAIN      ] FTHY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:52:11.183522] [INFO ] [LOCAL     ] FTHY: Starting deletion of primary data.
[2025-10-24T18:52:11.183569] [DEBUG] [LOCAL     ] FTHY: No primary data file found to delete.
[2025-10-24T18:52:11.183603] [INFO ] [LOCAL     ] FTHY: Starting deletion of derivative data.
[2025-10-24T18:52:11.183770] [DEBUG] [LOCAL     ] FTHY: Deleted derivative data file.
[2025-10-24T18:52:11.183857] [INFO ] [MAIN      ] Update Progress: 879/2366 symbols completed. FTHY took 26.8s. Estimated remaining: 3h 9m 42s. Rate: 7.8 symbols/min
[2025-10-24T18:52:12.921990] [INFO ] [REMOTE    ] FTI: Incremental fetch complete for 2025-08 (1.92 seconds).
[2025-10-24T18:52:12.934187] [INFO ] [REMOTE    ] FTI: Fetching primary data for 2025-09.
[2025-10-24T18:52:14.760776] [INFO ] [REMOTE    ] FTI: Incremental fetch complete for 2025-09 (1.83 seconds).
[2025-10-24T18:52:14.773560] [INFO ] [REMOTE    ] FTI: Fetching primary data for 2025-10.
[2025-10-24T18:52:16.636322] [INFO ] [REMOTE    ] FTI: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T18:52:16.646204] [INFO ] [REMOTE    ] FTI: Full fetch complete (77334 records).
[2025-10-24T18:52:16.646351] [DEBUG] [VALIDATOR ] FTI: Validating primary data.
[2025-10-24T18:52:17.081956] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present.
[2025-10-24T18:52:17.082095] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed.
[2025-10-24T18:52:17.083778] [INFO ] [MAIN      ] FTI: Fetched primary data is valid.
[2025-10-24T18:52:17.083852] [DEBUG] [LOCAL     ] FTI: Saving primary data.
[2025-10-24T18:52:17.084913] [FATAL] [LOCAL     ] FTI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:52:17.085034] [FATAL] [MAIN      ] FTI: Failed to save primary data.
[2025-10-24T18:52:17.085092] [WARN ] [MAIN      ] FTI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:52:17.085134] [INFO ] [LOCAL     ] FTI: Starting deletion of primary data.
[2025-10-24T18:52:17.085199] [DEBUG] [LOCAL     ] FTI: No primary data file found to delete.
[2025-10-24T18:52:17.085239] [INFO ] [LOCAL     ] FTI: Starting deletion of derivative data.
[2025-10-24T18:52:17.085448] [DEBUG] [LOCAL     ] FTI: Deleted derivative data file.
[2025-10-24T18:52:17.086039] [INFO ] [MAIN      ] Update Progress: 880/2366 symbols completed. FTI took 25.8s. Estimated remaining: 3h 9m 32s. Rate: 7.8 symbols/min
[2025-10-24T18:52:17.683873] [INFO ] [MAIN      ] FTWO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:52:17.742088] [INFO ] [MAIN      ] FTS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:52:17.821096] [INFO ] [MAIN      ] FTV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:52:17.843404] [INFO ] [MAIN      ] FTK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:52:17.853910] [DEBUG] [LOCAL     ] FTWO: Loaded 1966 existing records from primary storage.
[2025-10-24T18:52:17.854336] [INFO ] [MAIN      ] FTWO: Loaded 1966 existing records.
[2025-10-24T18:52:18.057187] [DEBUG] [LOCAL     ] FTS: Loaded 42787 existing records from primary storage.
[2025-10-24T18:52:18.149168] [WARN ] [MAIN      ] FTWO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:52:18.145054] [INFO ] [MAIN      ] FTS: Loaded 42787 existing records.
[2025-10-24T18:52:18.166325] [INFO ] [MAIN      ] FTWO: Wiping existing primary data before full refresh.
[2025-10-24T18:52:18.151462] [DEBUG] [LOCAL     ] FTK: Loaded 33227 existing records from primary storage.
[2025-10-24T18:52:18.183580] [INFO ] [LOCAL     ] FTWO: Starting deletion of primary data.
[2025-10-24T18:52:18.190043] [DEBUG] [LOCAL     ] FTV: Loaded 53399 existing records from primary storage.
[2025-10-24T18:52:18.208455] [INFO ] [MAIN      ] FTK: Loaded 33227 existing records.
[2025-10-24T18:52:18.226892] [DEBUG] [LOCAL     ] FTWO: Deleted primary data file.
[2025-10-24T18:52:18.213930] [INFO ] [MAIN      ] FTV: Loaded 53399 existing records.
[2025-10-24T18:52:18.269012] [INFO ] [MAIN      ] FTWO: Starting full primary refresh.
[2025-10-24T18:52:18.872637] [WARN ] [MAIN      ] FTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:52:18.995066] [INFO ] [MAIN      ] FTS: Wiping existing primary data before full refresh.
[2025-10-24T18:52:19.022904] [INFO ] [LOCAL     ] FTS: Starting deletion of primary data.
[2025-10-24T18:52:19.047087] [DEBUG] [LOCAL     ] FTS: Deleted primary data file.
[2025-10-24T18:52:19.046979] [WARN ] [MAIN      ] FTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:52:19.097419] [INFO ] [MAIN      ] FTK: Wiping existing primary data before full refresh.
[2025-10-24T18:52:19.097118] [INFO ] [MAIN      ] FTS: Starting full primary refresh.
[2025-10-24T18:52:19.101688] [INFO ] [LOCAL     ] FTK: Starting deletion of primary data.
[2025-10-24T18:52:19.101406] [WARN ] [MAIN      ] FTV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:52:19.161075] [INFO ] [MAIN      ] FTV: Wiping existing primary data before full refresh.
[2025-10-24T18:52:19.170863] [INFO ] [LOCAL     ] FTV: Starting deletion of primary data.
[2025-10-24T18:52:19.176173] [DEBUG] [LOCAL     ] FTK: Deleted primary data file.
[2025-10-24T18:52:19.218521] [DEBUG] [LOCAL     ] FTV: Deleted primary data file.
[2025-10-24T18:52:19.218746] [INFO ] [MAIN      ] FTV: Starting full primary refresh.
[2025-10-24T18:52:19.218426] [INFO ] [MAIN      ] FTK: Starting full primary refresh.
[2025-10-24T18:52:19.765344] [INFO ] [REMOTE    ] FTWO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:52:19.825363] [INFO ] [REMOTE    ] FTWO: Fetching primary data for 2025-01.
[2025-10-24T18:52:20.288447] [INFO ] [REMOTE    ] FTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:52:20.296781] [INFO ] [REMOTE    ] FTS: Fetching primary data for 2025-01.
[2025-10-24T18:52:20.473748] [INFO ] [REMOTE    ] FTK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:52:20.479175] [INFO ] [REMOTE    ] FTV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:52:20.480347] [INFO ] [REMOTE    ] FTV: Fetching primary data for 2025-01.
[2025-10-24T18:52:20.480024] [INFO ] [REMOTE    ] FTK: Fetching primary data for 2025-01.
[2025-10-24T18:52:20.553072] [INFO ] [REMOTE    ] FTWO: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T18:52:20.554938] [INFO ] [REMOTE    ] FTWO: Fetching primary data for 2025-02.
[2025-10-24T18:52:21.014422] [INFO ] [REMOTE    ] FTWO: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T18:52:21.016316] [INFO ] [REMOTE    ] FTWO: Fetching primary data for 2025-03.
[2025-10-24T18:52:21.292868] [INFO ] [REMOTE    ] FTWO: Incremental fetch complete for 2025-03 (0.28 seconds).
[2025-10-24T18:52:21.294017] [INFO ] [REMOTE    ] FTWO: Fetching primary data for 2025-04.
[2025-10-24T18:52:21.530038] [INFO ] [REMOTE    ] FTK: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T18:52:21.535460] [INFO ] [REMOTE    ] FTK: Fetching primary data for 2025-02.
[2025-10-24T18:52:21.661941] [INFO ] [REMOTE    ] FTWO: Incremental fetch complete for 2025-04 (0.37 seconds).
[2025-10-24T18:52:21.663276] [INFO ] [REMOTE    ] FTWO: Fetching primary data for 2025-05.
[2025-10-24T18:52:21.836995] [INFO ] [REMOTE    ] FTS: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T18:52:21.847153] [INFO ] [REMOTE    ] FTS: Fetching primary data for 2025-02.
[2025-10-24T18:52:22.030405] [INFO ] [REMOTE    ] FTWO: Incremental fetch complete for 2025-05 (0.37 seconds).
[2025-10-24T18:52:22.031414] [INFO ] [REMOTE    ] FTWO: Fetching primary data for 2025-06.
[2025-10-24T18:52:22.241777] [INFO ] [REMOTE    ] FTV: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T18:52:22.251981] [INFO ] [REMOTE    ] FTV: Fetching primary data for 2025-02.
[2025-10-24T18:52:22.315226] [INFO ] [REMOTE    ] FTWO: Incremental fetch complete for 2025-06 (0.28 seconds).
[2025-10-24T18:52:22.354830] [INFO ] [REMOTE    ] FTK: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T18:52:22.547617] [INFO ] [REMOTE    ] FTK: Fetching primary data for 2025-03.
[2025-10-24T18:52:22.952370] [INFO ] [REMOTE    ] FTS: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T18:52:23.347687] [INFO ] [REMOTE    ] FTWO: Fetching primary data for 2025-07.
[2025-10-24T18:52:23.380683] [INFO ] [REMOTE    ] FTK: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T18:52:23.641472] [INFO ] [REMOTE    ] FTWO: Incremental fetch complete for 2025-07 (0.29 seconds).
[2025-10-24T18:52:23.971874] [INFO ] [REMOTE    ] FTV: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T18:52:24.147699] [INFO ] [REMOTE    ] FTV: Fetching primary data for 2025-03.
[2025-10-24T18:52:24.947673] [INFO ] [REMOTE    ] FTS: Fetching primary data for 2025-03.
[2025-10-24T18:52:25.747699] [INFO ] [REMOTE    ] FTWO: Fetching primary data for 2025-08.
[2025-10-24T18:52:25.842386] [INFO ] [REMOTE    ] FTV: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T18:52:26.193388] [INFO ] [REMOTE    ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T18:52:26.323763] [INFO ] [REMOTE    ] FTS: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T18:52:26.547667] [INFO ] [REMOTE    ] FTV: Fetching primary data for 2025-04.
[2025-10-24T18:52:27.347712] [INFO ] [REMOTE    ] FTK: Fetching primary data for 2025-04.
[2025-10-24T18:52:28.149253] [INFO ] [REMOTE    ] FTWO: Fetching primary data for 2025-09.
[2025-10-24T18:52:28.151914] [INFO ] [REMOTE    ] FTV: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T18:52:28.505415] [INFO ] [REMOTE    ] FTK: Incremental fetch complete for 2025-04 (1.16 seconds).
[2025-10-24T18:52:28.514354] [INFO ] [REMOTE    ] FTWO: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T18:52:28.947679] [INFO ] [REMOTE    ] FTK: Fetching primary data for 2025-05.
[2025-10-24T18:52:29.747630] [INFO ] [REMOTE    ] FTV: Fetching primary data for 2025-05.
[2025-10-24T18:52:30.003542] [INFO ] [REMOTE    ] FTK: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T18:52:30.547734] [INFO ] [REMOTE    ] FTWO: Fetching primary data for 2025-10.
[2025-10-24T18:52:31.117353] [INFO ] [REMOTE    ] FTV: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T18:52:31.203625] [INFO ] [REMOTE    ] FTWO: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T18:52:31.204720] [INFO ] [REMOTE    ] FTWO: Full fetch complete (3318 records).
[2025-10-24T18:52:31.204788] [DEBUG] [VALIDATOR ] FTWO: Validating primary data.
[2025-10-24T18:52:31.357410] [INFO ] [REMOTE    ] FTK: Fetching primary data for 2025-06.
[2025-10-24T18:52:31.570118] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present.
[2025-10-24T18:52:31.570219] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed.
[2025-10-24T18:52:31.570374] [INFO ] [MAIN      ] FTWO: Fetched primary data is valid.
[2025-10-24T18:52:31.570452] [DEBUG] [LOCAL     ] FTWO: Saving primary data.
[2025-10-24T18:52:31.570693] [FATAL] [LOCAL     ] FTWO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:52:31.570782] [FATAL] [MAIN      ] FTWO: Failed to save primary data.
[2025-10-24T18:52:31.570828] [WARN ] [MAIN      ] FTWO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:52:31.570904] [INFO ] [LOCAL     ] FTWO: Starting deletion of primary data.
[2025-10-24T18:52:31.571370] [DEBUG] [LOCAL     ] FTWO: No primary data file found to delete.
[2025-10-24T18:52:31.571435] [INFO ] [LOCAL     ] FTWO: Starting deletion of derivative data.
[2025-10-24T18:52:31.571635] [DEBUG] [LOCAL     ] FTWO: Deleted derivative data file.
[2025-10-24T18:52:31.571771] [INFO ] [MAIN      ] Update Progress: 881/2366 symbols completed. FTWO took 14.5s. Estimated remaining: 3h 9m 35s. Rate: 7.8 symbols/min
[2025-10-24T18:52:31.745630] [INFO ] [MAIN      ] FUBO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:52:31.798560] [DEBUG] [LOCAL     ] FUBO: Loaded 54106 existing records from primary storage.
[2025-10-24T18:52:31.798919] [INFO ] [MAIN      ] FUBO: Loaded 54106 existing records.
[2025-10-24T18:52:31.973559] [WARN ] [MAIN      ] FUBO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:52:31.973812] [INFO ] [MAIN      ] FUBO: Wiping existing primary data before full refresh.
[2025-10-24T18:52:31.973887] [INFO ] [LOCAL     ] FUBO: Starting deletion of primary data.
[2025-10-24T18:52:31.974249] [DEBUG] [LOCAL     ] FUBO: Deleted primary data file.
[2025-10-24T18:52:31.974306] [INFO ] [MAIN      ] FUBO: Starting full primary refresh.
[2025-10-24T18:52:32.152766] [INFO ] [REMOTE    ] FTV: Fetching primary data for 2025-06.
[2025-10-24T18:52:32.334444] [INFO ] [REMOTE    ] FUBO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:52:32.938724] [INFO ] [REMOTE    ] FTK: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T18:52:32.947589] [INFO ] [REMOTE    ] FTK: Fetching primary data for 2025-07.
[2025-10-24T18:52:33.502933] [INFO ] [REMOTE    ] FTV: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T18:52:33.747638] [INFO ] [REMOTE    ] FTS: Fetching primary data for 2025-04.
[2025-10-24T18:52:34.349874] [INFO ] [REMOTE    ] FTK: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T18:52:34.547671] [INFO ] [REMOTE    ] FUBO: Fetching primary data for 2025-01.
[2025-10-24T18:52:35.355266] [INFO ] [REMOTE    ] FTK: Fetching primary data for 2025-08.
[2025-10-24T18:52:35.358104] [INFO ] [REMOTE    ] FTS: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T18:52:36.147690] [INFO ] [REMOTE    ] FTV: Fetching primary data for 2025-07.
[2025-10-24T18:52:36.594086] [INFO ] [REMOTE    ] FTK: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T18:52:36.947670] [INFO ] [REMOTE    ] FTK: Fetching primary data for 2025-09.
[2025-10-24T18:52:37.012986] [INFO ] [REMOTE    ] FUBO: Incremental fetch complete for 2025-01 (2.47 seconds).
[2025-10-24T18:52:37.747759] [INFO ] [REMOTE    ] FTS: Fetching primary data for 2025-05.
[2025-10-24T18:52:37.831269] [INFO ] [REMOTE    ] FTV: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T18:52:38.344897] [INFO ] [REMOTE    ] FTK: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T18:52:38.547728] [INFO ] [REMOTE    ] FUBO: Fetching primary data for 2025-02.
[2025-10-24T18:52:39.272535] [INFO ] [REMOTE    ] FTS: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T18:52:39.347672] [INFO ] [REMOTE    ] FTS: Fetching primary data for 2025-06.
[2025-10-24T18:52:40.147743] [INFO ] [REMOTE    ] FTV: Fetching primary data for 2025-08.
[2025-10-24T18:52:40.781115] [INFO ] [REMOTE    ] FUBO: Incremental fetch complete for 2025-02 (2.23 seconds).
[2025-10-24T18:52:40.838936] [INFO ] [REMOTE    ] FTS: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T18:52:40.947715] [INFO ] [REMOTE    ] FTK: Fetching primary data for 2025-10.
[2025-10-24T18:52:41.747686] [INFO ] [REMOTE    ] FUBO: Fetching primary data for 2025-03.
[2025-10-24T18:52:41.948726] [INFO ] [REMOTE    ] FTV: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T18:52:42.422549] [INFO ] [REMOTE    ] FTK: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T18:52:42.428739] [INFO ] [REMOTE    ] FTK: Full fetch complete (44191 records).
[2025-10-24T18:52:42.428823] [DEBUG] [VALIDATOR ] FTK: Validating primary data.
[2025-10-24T18:52:42.552865] [INFO ] [REMOTE    ] FTS: Fetching primary data for 2025-07.
[2025-10-24T18:52:42.841636] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present.
[2025-10-24T18:52:42.841763] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed.
[2025-10-24T18:52:42.842668] [INFO ] [MAIN      ] FTK: Fetched primary data is valid.
[2025-10-24T18:52:42.842738] [DEBUG] [LOCAL     ] FTK: Saving primary data.
[2025-10-24T18:52:42.843274] [FATAL] [LOCAL     ] FTK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:52:42.843364] [FATAL] [MAIN      ] FTK: Failed to save primary data.
[2025-10-24T18:52:42.843406] [WARN ] [MAIN      ] FTK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:52:42.843451] [INFO ] [LOCAL     ] FTK: Starting deletion of primary data.
[2025-10-24T18:52:42.843523] [DEBUG] [LOCAL     ] FTK: No primary data file found to delete.
[2025-10-24T18:52:42.843587] [INFO ] [LOCAL     ] FTK: Starting deletion of derivative data.
[2025-10-24T18:52:42.843768] [DEBUG] [LOCAL     ] FTK: Deleted derivative data file.
[2025-10-24T18:52:42.843867] [INFO ] [MAIN      ] Update Progress: 882/2366 symbols completed. FTK took 25.8s. Estimated remaining: 3h 9m 34s. Rate: 7.8 symbols/min
[2025-10-24T18:52:43.020763] [INFO ] [MAIN      ] FUL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:52:43.051045] [DEBUG] [LOCAL     ] FUL: Loaded 32220 existing records from primary storage.
[2025-10-24T18:52:43.051327] [INFO ] [MAIN      ] FUL: Loaded 32220 existing records.
[2025-10-24T18:52:43.232967] [WARN ] [MAIN      ] FUL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:52:43.233245] [INFO ] [MAIN      ] FUL: Wiping existing primary data before full refresh.
[2025-10-24T18:52:43.233296] [INFO ] [LOCAL     ] FUL: Starting deletion of primary data.
[2025-10-24T18:52:43.233684] [DEBUG] [LOCAL     ] FUL: Deleted primary data file.
[2025-10-24T18:52:43.233742] [INFO ] [MAIN      ] FUL: Starting full primary refresh.
[2025-10-24T18:52:43.352784] [INFO ] [REMOTE    ] FTV: Fetching primary data for 2025-09.
[2025-10-24T18:52:43.596717] [INFO ] [REMOTE    ] FUL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:52:43.661157] [INFO ] [REMOTE    ] FUBO: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T18:52:43.793603] [INFO ] [REMOTE    ] FTS: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T18:52:44.147679] [INFO ] [REMOTE    ] FTS: Fetching primary data for 2025-08.
[2025-10-24T18:52:44.947704] [INFO ] [REMOTE    ] FUL: Fetching primary data for 2025-01.
[2025-10-24T18:52:45.085970] [INFO ] [REMOTE    ] FTV: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T18:52:45.499003] [INFO ] [REMOTE    ] FTS: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T18:52:45.747720] [INFO ] [REMOTE    ] FTV: Fetching primary data for 2025-10.
[2025-10-24T18:52:46.312697] [INFO ] [REMOTE    ] FUL: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T18:52:46.547687] [INFO ] [REMOTE    ] FTS: Fetching primary data for 2025-09.
[2025-10-24T18:52:47.347724] [INFO ] [REMOTE    ] FUBO: Fetching primary data for 2025-04.
[2025-10-24T18:52:47.652955] [INFO ] [REMOTE    ] FTV: Incremental fetch complete for 2025-10 (1.91 seconds).
[2025-10-24T18:52:47.662978] [INFO ] [REMOTE    ] FTV: Full fetch complete (76614 records).
[2025-10-24T18:52:47.663148] [DEBUG] [VALIDATOR ] FTV: Validating primary data.
[2025-10-24T18:52:48.072968] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present.
[2025-10-24T18:52:48.080767] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed.
[2025-10-24T18:52:48.094536] [INFO ] [MAIN      ] FTV: Fetched primary data is valid.
[2025-10-24T18:52:48.094758] [DEBUG] [LOCAL     ] FTV: Saving primary data.
[2025-10-24T18:52:48.096849] [INFO ] [REMOTE    ] FTS: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T18:52:48.095564] [FATAL] [LOCAL     ] FTV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:52:48.105505] [FATAL] [MAIN      ] FTV: Failed to save primary data.
[2025-10-24T18:52:48.105578] [WARN ] [MAIN      ] FTV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:52:48.105667] [INFO ] [LOCAL     ] FTV: Starting deletion of primary data.
[2025-10-24T18:52:48.106070] [DEBUG] [LOCAL     ] FTV: No primary data file found to delete.
[2025-10-24T18:52:48.106123] [INFO ] [LOCAL     ] FTV: Starting deletion of derivative data.
[2025-10-24T18:52:48.106254] [DEBUG] [LOCAL     ] FTV: Deleted derivative data file.
[2025-10-24T18:52:48.106636] [INFO ] [MAIN      ] Update Progress: 883/2366 symbols completed. FTV took 31.0s. Estimated remaining: 3h 9m 22s. Rate: 7.8 symbols/min
[2025-10-24T18:52:48.152744] [INFO ] [REMOTE    ] FUL: Fetching primary data for 2025-02.
[2025-10-24T18:52:48.277142] [INFO ] [MAIN      ] FUN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:52:48.326054] [DEBUG] [LOCAL     ] FUN: Loaded 52412 existing records from primary storage.
[2025-10-24T18:52:48.326349] [INFO ] [MAIN      ] FUN: Loaded 52412 existing records.
[2025-10-24T18:52:48.499572] [WARN ] [MAIN      ] FUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:52:48.499801] [INFO ] [MAIN      ] FUN: Wiping existing primary data before full refresh.
[2025-10-24T18:52:48.499849] [INFO ] [LOCAL     ] FUN: Starting deletion of primary data.
[2025-10-24T18:52:48.500026] [DEBUG] [LOCAL     ] FUN: Deleted primary data file.
[2025-10-24T18:52:48.500062] [INFO ] [MAIN      ] FUN: Starting full primary refresh.
[2025-10-24T18:52:48.850382] [INFO ] [REMOTE    ] FUN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:52:48.947616] [INFO ] [REMOTE    ] FUN: Fetching primary data for 2025-01.
[2025-10-24T18:52:49.242106] [INFO ] [REMOTE    ] FUBO: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T18:52:49.442239] [INFO ] [REMOTE    ] FUL: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T18:52:49.747677] [INFO ] [REMOTE    ] FUL: Fetching primary data for 2025-03.
[2025-10-24T18:52:50.295776] [INFO ] [REMOTE    ] FUN: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T18:52:50.547735] [INFO ] [REMOTE    ] FUBO: Fetching primary data for 2025-05.
[2025-10-24T18:52:51.197353] [INFO ] [REMOTE    ] FUL: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T18:52:51.347675] [INFO ] [REMOTE    ] FTS: Fetching primary data for 2025-10.
[2025-10-24T18:52:52.147718] [INFO ] [REMOTE    ] FUN: Fetching primary data for 2025-02.
[2025-10-24T18:52:52.452576] [INFO ] [REMOTE    ] FUBO: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T18:52:52.947718] [INFO ] [REMOTE    ] FUL: Fetching primary data for 2025-04.
[2025-10-24T18:52:53.052952] [INFO ] [REMOTE    ] FTS: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T18:52:53.061104] [INFO ] [REMOTE    ] FTS: Full fetch complete (60866 records).
[2025-10-24T18:52:53.061240] [DEBUG] [VALIDATOR ] FTS: Validating primary data.
[2025-10-24T18:52:53.448319] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present.
[2025-10-24T18:52:53.448398] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed.
[2025-10-24T18:52:53.449218] [INFO ] [MAIN      ] FTS: Fetched primary data is valid.
[2025-10-24T18:52:53.449282] [DEBUG] [LOCAL     ] FTS: Saving primary data.
[2025-10-24T18:52:53.449767] [FATAL] [LOCAL     ] FTS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:52:53.449872] [FATAL] [MAIN      ] FTS: Failed to save primary data.
[2025-10-24T18:52:53.449915] [WARN ] [MAIN      ] FTS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:52:53.449950] [INFO ] [LOCAL     ] FTS: Starting deletion of primary data.
[2025-10-24T18:52:53.450003] [DEBUG] [LOCAL     ] FTS: No primary data file found to delete.
[2025-10-24T18:52:53.450039] [INFO ] [LOCAL     ] FTS: Starting deletion of derivative data.
[2025-10-24T18:52:53.450198] [DEBUG] [LOCAL     ] FTS: Deleted derivative data file.
[2025-10-24T18:52:53.450292] [INFO ] [MAIN      ] Update Progress: 884/2366 symbols completed. FTS took 36.4s. Estimated remaining: 3h 9m 11s. Rate: 7.8 symbols/min
[2025-10-24T18:52:53.623524] [INFO ] [MAIN      ] FVR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:52:53.658327] [INFO ] [REMOTE    ] FUN: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T18:52:53.674346] [DEBUG] [LOCAL     ] FVR: Loaded 20893 existing records from primary storage.
[2025-10-24T18:52:53.675293] [INFO ] [MAIN      ] FVR: Loaded 20893 existing records.
[2025-10-24T18:52:53.752749] [INFO ] [REMOTE    ] FUN: Fetching primary data for 2025-03.
[2025-10-24T18:52:53.858299] [WARN ] [MAIN      ] FVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:52:53.858520] [INFO ] [MAIN      ] FVR: Wiping existing primary data before full refresh.
[2025-10-24T18:52:53.858589] [INFO ] [LOCAL     ] FVR: Starting deletion of primary data.
[2025-10-24T18:52:53.858805] [DEBUG] [LOCAL     ] FVR: Deleted primary data file.
[2025-10-24T18:52:53.858859] [INFO ] [MAIN      ] FVR: Starting full primary refresh.
[2025-10-24T18:52:54.206217] [INFO ] [REMOTE    ] FVR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:52:54.547709] [INFO ] [REMOTE    ] FVR: Fetching primary data for 2025-01.
[2025-10-24T18:52:54.588999] [INFO ] [REMOTE    ] FUL: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T18:52:55.347678] [INFO ] [REMOTE    ] FUBO: Fetching primary data for 2025-06.
[2025-10-24T18:52:55.404268] [INFO ] [REMOTE    ] FUN: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T18:52:55.453859] [INFO ] [REMOTE    ] FVR: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T18:52:56.147685] [INFO ] [REMOTE    ] FUL: Fetching primary data for 2025-05.
[2025-10-24T18:52:56.947684] [INFO ] [REMOTE    ] FUN: Fetching primary data for 2025-04.
[2025-10-24T18:52:57.236001] [INFO ] [REMOTE    ] FUBO: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T18:52:57.294176] [INFO ] [REMOTE    ] FUL: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T18:52:57.747687] [INFO ] [REMOTE    ] FUBO: Fetching primary data for 2025-07.
[2025-10-24T18:52:58.515412] [INFO ] [REMOTE    ] FUN: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T18:52:58.547607] [INFO ] [REMOTE    ] FUN: Fetching primary data for 2025-05.
[2025-10-24T18:52:59.347736] [INFO ] [REMOTE    ] FVR: Fetching primary data for 2025-02.
[2025-10-24T18:53:00.067322] [INFO ] [REMOTE    ] FUBO: Incremental fetch complete for 2025-07 (2.32 seconds).
[2025-10-24T18:53:00.110540] [INFO ] [REMOTE    ] FUN: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T18:53:00.147685] [INFO ] [REMOTE    ] FUBO: Fetching primary data for 2025-08.
[2025-10-24T18:53:00.233557] [INFO ] [REMOTE    ] FVR: Incremental fetch complete for 2025-02 (0.89 seconds).
[2025-10-24T18:53:00.947719] [INFO ] [REMOTE    ] FVR: Fetching primary data for 2025-03.
[2025-10-24T18:53:01.747738] [INFO ] [REMOTE    ] FUL: Fetching primary data for 2025-06.
[2025-10-24T18:53:02.547714] [INFO ] [REMOTE    ] FUN: Fetching primary data for 2025-06.
[2025-10-24T18:53:02.566350] [INFO ] [REMOTE    ] FVR: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T18:53:02.647893] [INFO ] [REMOTE    ] FUBO: Incremental fetch complete for 2025-08 (2.50 seconds).
[2025-10-24T18:53:02.884775] [INFO ] [REMOTE    ] FUL: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T18:53:03.347715] [INFO ] [REMOTE    ] FUL: Fetching primary data for 2025-07.
[2025-10-24T18:53:04.147606] [INFO ] [REMOTE    ] FVR: Fetching primary data for 2025-04.
[2025-10-24T18:53:04.287844] [INFO ] [REMOTE    ] FUN: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T18:53:04.624755] [INFO ] [REMOTE    ] FUL: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T18:53:04.947731] [INFO ] [REMOTE    ] FUL: Fetching primary data for 2025-08.
[2025-10-24T18:53:04.983990] [INFO ] [REMOTE    ] FVR: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T18:53:05.747721] [INFO ] [REMOTE    ] FUBO: Fetching primary data for 2025-09.
[2025-10-24T18:53:06.172267] [INFO ] [REMOTE    ] FUL: Incremental fetch complete for 2025-08 (1.22 seconds).
[2025-10-24T18:53:06.547732] [INFO ] [REMOTE    ] FUN: Fetching primary data for 2025-07.
[2025-10-24T18:53:07.347636] [INFO ] [REMOTE    ] FVR: Fetching primary data for 2025-05.
[2025-10-24T18:53:07.982779] [INFO ] [REMOTE    ] FUBO: Incremental fetch complete for 2025-09 (2.24 seconds).
[2025-10-24T18:53:08.152864] [INFO ] [REMOTE    ] FUL: Fetching primary data for 2025-09.
[2025-10-24T18:53:08.165666] [INFO ] [REMOTE    ] FUN: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T18:53:08.424224] [INFO ] [REMOTE    ] FVR: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T18:53:08.947620] [INFO ] [REMOTE    ] FVR: Fetching primary data for 2025-06.
[2025-10-24T18:53:09.747699] [INFO ] [REMOTE    ] FUN: Fetching primary data for 2025-08.
[2025-10-24T18:53:09.812256] [INFO ] [REMOTE    ] FUL: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T18:53:10.175724] [INFO ] [REMOTE    ] FVR: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T18:53:10.547661] [INFO ] [REMOTE    ] FVR: Fetching primary data for 2025-07.
[2025-10-24T18:53:11.340779] [INFO ] [REMOTE    ] FUN: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T18:53:11.351060] [INFO ] [REMOTE    ] FUL: Fetching primary data for 2025-10.
[2025-10-24T18:53:11.599736] [INFO ] [REMOTE    ] FVR: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T18:53:12.147717] [INFO ] [REMOTE    ] FUN: Fetching primary data for 2025-09.
[2025-10-24T18:53:12.670678] [INFO ] [REMOTE    ] FUL: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T18:53:12.676512] [INFO ] [REMOTE    ] FUL: Full fetch complete (47809 records).
[2025-10-24T18:53:12.676615] [DEBUG] [VALIDATOR ] FUL: Validating primary data.
[2025-10-24T18:53:12.952993] [INFO ] [REMOTE    ] FUBO: Fetching primary data for 2025-10.
[2025-10-24T18:53:13.063373] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present.
[2025-10-24T18:53:13.063444] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed.
[2025-10-24T18:53:13.064154] [INFO ] [MAIN      ] FUL: Fetched primary data is valid.
[2025-10-24T18:53:13.064216] [DEBUG] [LOCAL     ] FUL: Saving primary data.
[2025-10-24T18:53:13.064626] [FATAL] [LOCAL     ] FUL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:53:13.064727] [FATAL] [MAIN      ] FUL: Failed to save primary data.
[2025-10-24T18:53:13.064769] [WARN ] [MAIN      ] FUL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:53:13.064833] [INFO ] [LOCAL     ] FUL: Starting deletion of primary data.
[2025-10-24T18:53:13.064891] [DEBUG] [LOCAL     ] FUL: No primary data file found to delete.
[2025-10-24T18:53:13.064926] [INFO ] [LOCAL     ] FUL: Starting deletion of derivative data.
[2025-10-24T18:53:13.065060] [DEBUG] [LOCAL     ] FUL: Deleted derivative data file.
[2025-10-24T18:53:13.065136] [INFO ] [MAIN      ] Update Progress: 885/2366 symbols completed. FUL took 30.2s. Estimated remaining: 3h 9m 23s. Rate: 7.8 symbols/min
[2025-10-24T18:53:13.235890] [INFO ] [MAIN      ] FVRR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:53:13.273803] [DEBUG] [LOCAL     ] FVRR: Loaded 40750 existing records from primary storage.
[2025-10-24T18:53:13.274086] [INFO ] [MAIN      ] FVRR: Loaded 40750 existing records.
[2025-10-24T18:53:13.458282] [WARN ] [MAIN      ] FVRR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:53:13.458556] [INFO ] [MAIN      ] FVRR: Wiping existing primary data before full refresh.
[2025-10-24T18:53:13.458621] [INFO ] [LOCAL     ] FVRR: Starting deletion of primary data.
[2025-10-24T18:53:13.458881] [DEBUG] [LOCAL     ] FVRR: Deleted primary data file.
[2025-10-24T18:53:13.458938] [INFO ] [MAIN      ] FVRR: Starting full primary refresh.
[2025-10-24T18:53:13.753248] [INFO ] [REMOTE    ] FVR: Fetching primary data for 2025-08.
[2025-10-24T18:53:13.832481] [INFO ] [REMOTE    ] FVRR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:53:13.989744] [INFO ] [REMOTE    ] FUN: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T18:53:14.484559] [INFO ] [REMOTE    ] FVR: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T18:53:14.547623] [INFO ] [REMOTE    ] FVR: Fetching primary data for 2025-09.
[2025-10-24T18:53:15.349923] [INFO ] [REMOTE    ] FVRR: Fetching primary data for 2025-01.
[2025-10-24T18:53:15.355080] [INFO ] [REMOTE    ] FUBO: Incremental fetch complete for 2025-10 (2.40 seconds).
[2025-10-24T18:53:15.365771] [INFO ] [REMOTE    ] FUBO: Full fetch complete (77865 records).
[2025-10-24T18:53:15.365940] [DEBUG] [VALIDATOR ] FUBO: Validating primary data.
[2025-10-24T18:53:15.661681] [INFO ] [REMOTE    ] FVR: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T18:53:15.797101] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present.
[2025-10-24T18:53:15.797213] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed.
[2025-10-24T18:53:15.798444] [INFO ] [MAIN      ] FUBO: Fetched primary data is valid.
[2025-10-24T18:53:15.798513] [DEBUG] [LOCAL     ] FUBO: Saving primary data.
[2025-10-24T18:53:15.799207] [FATAL] [LOCAL     ] FUBO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:53:15.799303] [FATAL] [MAIN      ] FUBO: Failed to save primary data.
[2025-10-24T18:53:15.799345] [WARN ] [MAIN      ] FUBO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:53:15.799382] [INFO ] [LOCAL     ] FUBO: Starting deletion of primary data.
[2025-10-24T18:53:15.799436] [DEBUG] [LOCAL     ] FUBO: No primary data file found to delete.
[2025-10-24T18:53:15.799471] [INFO ] [LOCAL     ] FUBO: Starting deletion of derivative data.
[2025-10-24T18:53:15.799676] [DEBUG] [LOCAL     ] FUBO: Deleted derivative data file.
[2025-10-24T18:53:15.800115] [INFO ] [MAIN      ] Update Progress: 886/2366 symbols completed. FUBO took 44.2s. Estimated remaining: 3h 9m 7s. Rate: 7.8 symbols/min
[2025-10-24T18:53:15.970039] [INFO ] [MAIN      ] FXED: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:53:15.972905] [DEBUG] [LOCAL     ] FXED: Loaded 1237 existing records from primary storage.
[2025-10-24T18:53:15.973039] [INFO ] [MAIN      ] FXED: Loaded 1237 existing records.
[2025-10-24T18:53:16.150809] [INFO ] [REMOTE    ] FUN: Fetching primary data for 2025-10.
[2025-10-24T18:53:16.150631] [WARN ] [MAIN      ] FXED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:53:16.152253] [INFO ] [MAIN      ] FXED: Wiping existing primary data before full refresh.
[2025-10-24T18:53:16.152317] [INFO ] [LOCAL     ] FXED: Starting deletion of primary data.
[2025-10-24T18:53:16.152463] [DEBUG] [LOCAL     ] FXED: Deleted primary data file.
[2025-10-24T18:53:16.152504] [INFO ] [MAIN      ] FXED: Starting full primary refresh.
[2025-10-24T18:53:16.516760] [INFO ] [REMOTE    ] FXED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:53:16.878597] [INFO ] [REMOTE    ] FVRR: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T18:53:16.947672] [INFO ] [REMOTE    ] FXED: Fetching primary data for 2025-01.
[2025-10-24T18:53:17.475202] [INFO ] [REMOTE    ] FXED: Incremental fetch complete for 2025-01 (0.53 seconds).
[2025-10-24T18:53:17.747680] [INFO ] [REMOTE    ] FVRR: Fetching primary data for 2025-02.
[2025-10-24T18:53:18.212822] [INFO ] [REMOTE    ] FUN: Incremental fetch complete for 2025-10 (2.06 seconds).
[2025-10-24T18:53:18.222637] [INFO ] [REMOTE    ] FUN: Full fetch complete (73599 records).
[2025-10-24T18:53:18.222786] [DEBUG] [VALIDATOR ] FUN: Validating primary data.
[2025-10-24T18:53:18.557956] [INFO ] [REMOTE    ] FVR: Fetching primary data for 2025-10.
[2025-10-24T18:53:18.618189] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present.
[2025-10-24T18:53:18.618286] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed.
[2025-10-24T18:53:18.619278] [INFO ] [MAIN      ] FUN: Fetched primary data is valid.
[2025-10-24T18:53:18.619342] [DEBUG] [LOCAL     ] FUN: Saving primary data.
[2025-10-24T18:53:18.620071] [FATAL] [LOCAL     ] FUN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:53:18.620162] [FATAL] [MAIN      ] FUN: Failed to save primary data.
[2025-10-24T18:53:18.620204] [WARN ] [MAIN      ] FUN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:53:18.620264] [INFO ] [LOCAL     ] FUN: Starting deletion of primary data.
[2025-10-24T18:53:18.620327] [DEBUG] [LOCAL     ] FUN: No primary data file found to delete.
[2025-10-24T18:53:18.620364] [INFO ] [LOCAL     ] FUN: Starting deletion of derivative data.
[2025-10-24T18:53:18.620537] [DEBUG] [LOCAL     ] FUN: Deleted derivative data file.
[2025-10-24T18:53:18.620925] [INFO ] [MAIN      ] Update Progress: 887/2366 symbols completed. FUN took 30.5s. Estimated remaining: 3h 8m 51s. Rate: 7.8 symbols/min
[2025-10-24T18:53:18.797697] [INFO ] [MAIN      ] G: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:53:18.844261] [DEBUG] [LOCAL     ] G: Loaded 50463 existing records from primary storage.
[2025-10-24T18:53:18.844562] [INFO ] [MAIN      ] G: Loaded 50463 existing records.
[2025-10-24T18:53:19.026407] [WARN ] [MAIN      ] G: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:53:19.026724] [INFO ] [MAIN      ] G: Wiping existing primary data before full refresh.
[2025-10-24T18:53:19.026801] [INFO ] [LOCAL     ] G: Starting deletion of primary data.
[2025-10-24T18:53:19.027059] [DEBUG] [LOCAL     ] G: Deleted primary data file.
[2025-10-24T18:53:19.027122] [INFO ] [MAIN      ] G: Starting full primary refresh.
[2025-10-24T18:53:19.361804] [INFO ] [REMOTE    ] FXED: Fetching primary data for 2025-02.
[2025-10-24T18:53:19.420856] [INFO ] [REMOTE    ] G: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:53:19.426578] [INFO ] [REMOTE    ] FVRR: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T18:53:19.723165] [INFO ] [REMOTE    ] FVR: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T18:53:19.727985] [INFO ] [REMOTE    ] FVR: Full fetch complete (29220 records).
[2025-10-24T18:53:19.728224] [DEBUG] [VALIDATOR ] FVR: Validating primary data.
[2025-10-24T18:53:19.815859] [INFO ] [REMOTE    ] FXED: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T18:53:20.101633] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present.
[2025-10-24T18:53:20.101742] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed.
[2025-10-24T18:53:20.102313] [INFO ] [MAIN      ] FVR: Fetched primary data is valid.
[2025-10-24T18:53:20.102352] [DEBUG] [LOCAL     ] FVR: Saving primary data.
[2025-10-24T18:53:20.102636] [FATAL] [LOCAL     ] FVR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:53:20.102738] [FATAL] [MAIN      ] FVR: Failed to save primary data.
[2025-10-24T18:53:20.102779] [WARN ] [MAIN      ] FVR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:53:20.102813] [INFO ] [LOCAL     ] FVR: Starting deletion of primary data.
[2025-10-24T18:53:20.102863] [DEBUG] [LOCAL     ] FVR: No primary data file found to delete.
[2025-10-24T18:53:20.102896] [INFO ] [LOCAL     ] FVR: Starting deletion of derivative data.
[2025-10-24T18:53:20.103052] [DEBUG] [LOCAL     ] FVR: Deleted derivative data file.
[2025-10-24T18:53:20.103121] [INFO ] [MAIN      ] Update Progress: 888/2366 symbols completed. FVR took 26.7s. Estimated remaining: 3h 8m 33s. Rate: 7.8 symbols/min
[2025-10-24T18:53:20.155242] [INFO ] [REMOTE    ] G: Fetching primary data for 2025-01.
[2025-10-24T18:53:20.273686] [INFO ] [MAIN      ] GAB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:53:20.303499] [DEBUG] [LOCAL     ] GAB: Loaded 27609 existing records from primary storage.
[2025-10-24T18:53:20.303827] [INFO ] [MAIN      ] GAB: Loaded 27609 existing records.
[2025-10-24T18:53:20.478469] [WARN ] [MAIN      ] GAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:53:20.478713] [INFO ] [MAIN      ] GAB: Wiping existing primary data before full refresh.
[2025-10-24T18:53:20.478768] [INFO ] [LOCAL     ] GAB: Starting deletion of primary data.
[2025-10-24T18:53:20.478945] [DEBUG] [LOCAL     ] GAB: Deleted primary data file.
[2025-10-24T18:53:20.478984] [INFO ] [MAIN      ] GAB: Starting full primary refresh.
[2025-10-24T18:53:20.824550] [INFO ] [REMOTE    ] GAB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:53:20.947617] [INFO ] [REMOTE    ] GAB: Fetching primary data for 2025-01.
[2025-10-24T18:53:21.747739] [INFO ] [REMOTE    ] FVRR: Fetching primary data for 2025-03.
[2025-10-24T18:53:22.102732] [INFO ] [REMOTE    ] G: Incremental fetch complete for 2025-01 (1.95 seconds).
[2025-10-24T18:53:22.383863] [INFO ] [REMOTE    ] GAB: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T18:53:22.547702] [INFO ] [REMOTE    ] FXED: Fetching primary data for 2025-03.
[2025-10-24T18:53:22.902727] [INFO ] [REMOTE    ] FXED: Incremental fetch complete for 2025-03 (0.36 seconds).
[2025-10-24T18:53:23.203696] [INFO ] [REMOTE    ] FVRR: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T18:53:23.347708] [INFO ] [REMOTE    ] FVRR: Fetching primary data for 2025-04.
[2025-10-24T18:53:24.147715] [INFO ] [REMOTE    ] G: Fetching primary data for 2025-02.
[2025-10-24T18:53:24.947702] [INFO ] [REMOTE    ] FXED: Fetching primary data for 2025-04.
[2025-10-24T18:53:25.091196] [INFO ] [REMOTE    ] FVRR: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T18:53:25.222265] [INFO ] [REMOTE    ] FXED: Incremental fetch complete for 2025-04 (0.27 seconds).
[2025-10-24T18:53:25.439958] [INFO ] [REMOTE    ] G: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T18:53:25.747670] [INFO ] [REMOTE    ] FVRR: Fetching primary data for 2025-05.
[2025-10-24T18:53:26.547677] [INFO ] [REMOTE    ] GAB: Fetching primary data for 2025-02.
[2025-10-24T18:53:27.210315] [INFO ] [REMOTE    ] FVRR: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T18:53:27.347713] [INFO ] [REMOTE    ] G: Fetching primary data for 2025-03.
[2025-10-24T18:53:27.584368] [INFO ] [REMOTE    ] GAB: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T18:53:28.147710] [INFO ] [REMOTE    ] FXED: Fetching primary data for 2025-05.
[2025-10-24T18:53:28.487334] [INFO ] [REMOTE    ] FXED: Incremental fetch complete for 2025-05 (0.34 seconds).
[2025-10-24T18:53:28.947706] [INFO ] [REMOTE    ] FXED: Fetching primary data for 2025-06.
[2025-10-24T18:53:29.035046] [INFO ] [REMOTE    ] G: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T18:53:29.276035] [INFO ] [REMOTE    ] FXED: Incremental fetch complete for 2025-06 (0.33 seconds).
[2025-10-24T18:53:29.747687] [INFO ] [REMOTE    ] GAB: Fetching primary data for 2025-03.
[2025-10-24T18:53:30.547699] [INFO ] [REMOTE    ] FXED: Fetching primary data for 2025-07.
[2025-10-24T18:53:31.035404] [INFO ] [REMOTE    ] GAB: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T18:53:31.063367] [INFO ] [REMOTE    ] FXED: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T18:53:31.347728] [INFO ] [REMOTE    ] FXED: Fetching primary data for 2025-08.
[2025-10-24T18:53:31.948705] [INFO ] [REMOTE    ] FXED: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T18:53:32.147703] [INFO ] [REMOTE    ] FXED: Fetching primary data for 2025-09.
[2025-10-24T18:53:32.579201] [INFO ] [REMOTE    ] FXED: Incremental fetch complete for 2025-09 (0.43 seconds).
[2025-10-24T18:53:32.947682] [INFO ] [REMOTE    ] FXED: Fetching primary data for 2025-10.
[2025-10-24T18:53:33.438231] [INFO ] [REMOTE    ] FXED: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T18:53:33.439105] [INFO ] [REMOTE    ] FXED: Full fetch complete (1791 records).
[2025-10-24T18:53:33.439172] [DEBUG] [VALIDATOR ] FXED: Validating primary data.
[2025-10-24T18:53:33.753456] [INFO ] [REMOTE    ] FVRR: Fetching primary data for 2025-06.
[2025-10-24T18:53:33.797459] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present.
[2025-10-24T18:53:33.797542] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed.
[2025-10-24T18:53:33.797706] [INFO ] [MAIN      ] FXED: Fetched primary data is valid.
[2025-10-24T18:53:33.797775] [DEBUG] [LOCAL     ] FXED: Saving primary data.
[2025-10-24T18:53:33.798013] [FATAL] [LOCAL     ] FXED: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:53:33.798111] [FATAL] [MAIN      ] FXED: Failed to save primary data.
[2025-10-24T18:53:33.798187] [WARN ] [MAIN      ] FXED: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:53:33.798362] [INFO ] [LOCAL     ] FXED: Starting deletion of primary data.
[2025-10-24T18:53:33.798449] [DEBUG] [LOCAL     ] FXED: No primary data file found to delete.
[2025-10-24T18:53:33.798505] [INFO ] [LOCAL     ] FXED: Starting deletion of derivative data.
[2025-10-24T18:53:33.798692] [DEBUG] [LOCAL     ] FXED: Deleted derivative data file.
[2025-10-24T18:53:33.798793] [INFO ] [MAIN      ] Update Progress: 889/2366 symbols completed. FXED took 18.0s. Estimated remaining: 3h 8m 36s. Rate: 7.8 symbols/min
[2025-10-24T18:53:33.977539] [INFO ] [MAIN      ] GAM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:53:33.987267] [DEBUG] [LOCAL     ] GAM: Loaded 3836 existing records from primary storage.
[2025-10-24T18:53:33.987554] [INFO ] [MAIN      ] GAM: Loaded 3836 existing records.
[2025-10-24T18:53:34.170661] [WARN ] [MAIN      ] GAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:53:34.170887] [INFO ] [MAIN      ] GAM: Wiping existing primary data before full refresh.
[2025-10-24T18:53:34.170936] [INFO ] [LOCAL     ] GAM: Starting deletion of primary data.
[2025-10-24T18:53:34.171126] [DEBUG] [LOCAL     ] GAM: Deleted primary data file.
[2025-10-24T18:53:34.171182] [INFO ] [MAIN      ] GAM: Starting full primary refresh.
[2025-10-24T18:53:34.539444] [INFO ] [REMOTE    ] GAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:53:34.547599] [INFO ] [REMOTE    ] GAM: Fetching primary data for 2025-01.
[2025-10-24T18:53:35.298999] [INFO ] [REMOTE    ] GAM: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T18:53:35.347629] [INFO ] [REMOTE    ] GAB: Fetching primary data for 2025-04.
[2025-10-24T18:53:35.400325] [INFO ] [REMOTE    ] FVRR: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T18:53:36.147688] [INFO ] [REMOTE    ] FVRR: Fetching primary data for 2025-07.
[2025-10-24T18:53:36.748621] [INFO ] [REMOTE    ] GAB: Incremental fetch complete for 2025-04 (1.40 seconds).
[2025-10-24T18:53:36.947633] [INFO ] [REMOTE    ] GAB: Fetching primary data for 2025-05.
[2025-10-24T18:53:37.747712] [INFO ] [REMOTE    ] GAM: Fetching primary data for 2025-02.
[2025-10-24T18:53:38.170445] [INFO ] [REMOTE    ] FVRR: Incremental fetch complete for 2025-07 (2.02 seconds).
[2025-10-24T18:53:38.232301] [INFO ] [REMOTE    ] GAB: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T18:53:38.429864] [INFO ] [REMOTE    ] GAM: Incremental fetch complete for 2025-02 (0.68 seconds).
[2025-10-24T18:53:38.547635] [INFO ] [REMOTE    ] GAB: Fetching primary data for 2025-06.
[2025-10-24T18:53:39.347682] [INFO ] [REMOTE    ] GAM: Fetching primary data for 2025-03.
[2025-10-24T18:53:39.740265] [INFO ] [REMOTE    ] GAB: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T18:53:39.765529] [INFO ] [REMOTE    ] GAM: Incremental fetch complete for 2025-03 (0.42 seconds).
[2025-10-24T18:53:40.147709] [INFO ] [REMOTE    ] GAM: Fetching primary data for 2025-04.
[2025-10-24T18:53:40.833817] [INFO ] [REMOTE    ] GAM: Incremental fetch complete for 2025-04 (0.69 seconds).
[2025-10-24T18:53:40.947718] [INFO ] [REMOTE    ] G: Fetching primary data for 2025-04.
[2025-10-24T18:53:41.747746] [INFO ] [REMOTE    ] GAB: Fetching primary data for 2025-07.
[2025-10-24T18:53:42.547716] [INFO ] [REMOTE    ] GAM: Fetching primary data for 2025-05.
[2025-10-24T18:53:42.621347] [INFO ] [REMOTE    ] G: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T18:53:42.956925] [INFO ] [REMOTE    ] GAB: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T18:53:43.013058] [INFO ] [REMOTE    ] GAM: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T18:53:43.347707] [INFO ] [REMOTE    ] GAM: Fetching primary data for 2025-06.
[2025-10-24T18:53:43.922280] [INFO ] [REMOTE    ] GAM: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T18:53:44.147624] [INFO ] [REMOTE    ] FVRR: Fetching primary data for 2025-08.
[2025-10-24T18:53:44.947721] [INFO ] [REMOTE    ] GAB: Fetching primary data for 2025-08.
[2025-10-24T18:53:45.719274] [INFO ] [REMOTE    ] FVRR: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T18:53:45.747610] [INFO ] [REMOTE    ] FVRR: Fetching primary data for 2025-09.
[2025-10-24T18:53:46.008357] [INFO ] [REMOTE    ] GAB: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T18:53:46.547629] [INFO ] [REMOTE    ] GAM: Fetching primary data for 2025-07.
[2025-10-24T18:53:47.251570] [INFO ] [REMOTE    ] FVRR: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T18:53:47.261329] [INFO ] [REMOTE    ] GAM: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T18:53:47.347692] [INFO ] [REMOTE    ] GAM: Fetching primary data for 2025-08.
[2025-10-24T18:53:47.916485] [INFO ] [REMOTE    ] GAM: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T18:53:48.147681] [INFO ] [REMOTE    ] FVRR: Fetching primary data for 2025-10.
[2025-10-24T18:53:48.947735] [INFO ] [REMOTE    ] G: Fetching primary data for 2025-05.
[2025-10-24T18:53:49.747681] [INFO ] [REMOTE    ] GAB: Fetching primary data for 2025-09.
[2025-10-24T18:53:49.889771] [INFO ] [REMOTE    ] FVRR: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T18:53:49.898368] [INFO ] [REMOTE    ] FVRR: Full fetch complete (59203 records).
[2025-10-24T18:53:49.898537] [DEBUG] [VALIDATOR ] FVRR: Validating primary data.
[2025-10-24T18:53:50.294478] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present.
[2025-10-24T18:53:50.294580] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed.
[2025-10-24T18:53:50.295417] [INFO ] [MAIN      ] FVRR: Fetched primary data is valid.
[2025-10-24T18:53:50.295539] [DEBUG] [LOCAL     ] FVRR: Saving primary data.
[2025-10-24T18:53:50.296226] [FATAL] [LOCAL     ] FVRR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:53:50.296414] [FATAL] [MAIN      ] FVRR: Failed to save primary data.
[2025-10-24T18:53:50.296542] [WARN ] [MAIN      ] FVRR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:53:50.296699] [INFO ] [LOCAL     ] FVRR: Starting deletion of primary data.
[2025-10-24T18:53:50.296800] [DEBUG] [LOCAL     ] FVRR: No primary data file found to delete.
[2025-10-24T18:53:50.296943] [INFO ] [LOCAL     ] FVRR: Starting deletion of derivative data.
[2025-10-24T18:53:50.297281] [DEBUG] [LOCAL     ] FVRR: Deleted derivative data file.
[2025-10-24T18:53:50.297749] [INFO ] [MAIN      ] Update Progress: 890/2366 symbols completed. FVRR took 37.2s. Estimated remaining: 3h 8m 43s. Rate: 7.8 symbols/min
[2025-10-24T18:53:50.454511] [INFO ] [REMOTE    ] G: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T18:53:50.508201] [INFO ] [MAIN      ] GAP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:53:50.557976] [INFO ] [REMOTE    ] G: Fetching primary data for 2025-06.
[2025-10-24T18:53:50.560964] [DEBUG] [LOCAL     ] GAP: Loaded 54043 existing records from primary storage.
[2025-10-24T18:53:50.561401] [INFO ] [MAIN      ] GAP: Loaded 54043 existing records.
[2025-10-24T18:53:50.744589] [WARN ] [MAIN      ] GAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:53:50.761203] [INFO ] [MAIN      ] GAP: Wiping existing primary data before full refresh.
[2025-10-24T18:53:50.761864] [INFO ] [LOCAL     ] GAP: Starting deletion of primary data.
[2025-10-24T18:53:50.762457] [INFO ] [REMOTE    ] GAB: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T18:53:50.769015] [DEBUG] [LOCAL     ] GAP: Deleted primary data file.
[2025-10-24T18:53:50.769431] [INFO ] [MAIN      ] GAP: Starting full primary refresh.
[2025-10-24T18:53:51.121976] [INFO ] [REMOTE    ] GAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:53:51.347673] [INFO ] [REMOTE    ] GAP: Fetching primary data for 2025-01.
[2025-10-24T18:53:52.147625] [INFO ] [REMOTE    ] GAM: Fetching primary data for 2025-09.
[2025-10-24T18:53:52.242143] [INFO ] [REMOTE    ] G: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T18:53:52.651884] [INFO ] [REMOTE    ] GAM: Incremental fetch complete for 2025-09 (0.50 seconds).
[2025-10-24T18:53:52.947688] [INFO ] [REMOTE    ] GAB: Fetching primary data for 2025-10.
[2025-10-24T18:53:53.124794] [INFO ] [REMOTE    ] GAP: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T18:53:53.747720] [INFO ] [REMOTE    ] GAP: Fetching primary data for 2025-02.
[2025-10-24T18:53:54.282248] [INFO ] [REMOTE    ] GAB: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T18:53:54.287268] [INFO ] [REMOTE    ] GAB: Full fetch complete (39344 records).
[2025-10-24T18:53:54.287353] [DEBUG] [VALIDATOR ] GAB: Validating primary data.
[2025-10-24T18:53:54.552920] [INFO ] [REMOTE    ] G: Fetching primary data for 2025-07.
[2025-10-24T18:53:54.660077] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present.
[2025-10-24T18:53:54.660159] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed.
[2025-10-24T18:53:54.660815] [INFO ] [MAIN      ] GAB: Fetched primary data is valid.
[2025-10-24T18:53:54.660877] [DEBUG] [LOCAL     ] GAB: Saving primary data.
[2025-10-24T18:53:54.661335] [FATAL] [LOCAL     ] GAB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:53:54.661423] [FATAL] [MAIN      ] GAB: Failed to save primary data.
[2025-10-24T18:53:54.661465] [WARN ] [MAIN      ] GAB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:53:54.661500] [INFO ] [LOCAL     ] GAB: Starting deletion of primary data.
[2025-10-24T18:53:54.661549] [DEBUG] [LOCAL     ] GAB: No primary data file found to delete.
[2025-10-24T18:53:54.661586] [INFO ] [LOCAL     ] GAB: Starting deletion of derivative data.
[2025-10-24T18:53:54.661742] [DEBUG] [LOCAL     ] GAB: Deleted derivative data file.
[2025-10-24T18:53:54.661834] [INFO ] [MAIN      ] Update Progress: 891/2366 symbols completed. GAB took 34.6s. Estimated remaining: 3h 8m 30s. Rate: 7.8 symbols/min
[2025-10-24T18:53:54.854294] [INFO ] [MAIN      ] GATX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:53:54.874704] [DEBUG] [LOCAL     ] GATX: Loaded 18194 existing records from primary storage.
[2025-10-24T18:53:54.874945] [INFO ] [MAIN      ] GATX: Loaded 18194 existing records.
[2025-10-24T18:53:55.054601] [WARN ] [MAIN      ] GATX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:53:55.055106] [INFO ] [MAIN      ] GATX: Wiping existing primary data before full refresh.
[2025-10-24T18:53:55.055155] [INFO ] [LOCAL     ] GATX: Starting deletion of primary data.
[2025-10-24T18:53:55.055322] [DEBUG] [LOCAL     ] GATX: Deleted primary data file.
[2025-10-24T18:53:55.055360] [INFO ] [MAIN      ] GATX: Starting full primary refresh.
[2025-10-24T18:53:55.352831] [INFO ] [REMOTE    ] GAM: Fetching primary data for 2025-10.
[2025-10-24T18:53:55.410144] [INFO ] [REMOTE    ] GATX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:53:55.473089] [INFO ] [REMOTE    ] GAP: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T18:53:56.084768] [INFO ] [REMOTE    ] GAM: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T18:53:56.086024] [INFO ] [REMOTE    ] GAM: Full fetch complete (6439 records).
[2025-10-24T18:53:56.086093] [DEBUG] [VALIDATOR ] GAM: Validating primary data.
[2025-10-24T18:53:56.149354] [INFO ] [REMOTE    ] GATX: Fetching primary data for 2025-01.
[2025-10-24T18:53:56.447937] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present.
[2025-10-24T18:53:56.448036] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed.
[2025-10-24T18:53:56.448266] [INFO ] [MAIN      ] GAM: Fetched primary data is valid.
[2025-10-24T18:53:56.448395] [DEBUG] [LOCAL     ] GAM: Saving primary data.
[2025-10-24T18:53:56.448723] [FATAL] [LOCAL     ] GAM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:53:56.448821] [FATAL] [MAIN      ] GAM: Failed to save primary data.
[2025-10-24T18:53:56.448916] [WARN ] [MAIN      ] GAM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:53:56.449071] [INFO ] [LOCAL     ] GAM: Starting deletion of primary data.
[2025-10-24T18:53:56.449142] [DEBUG] [LOCAL     ] GAM: No primary data file found to delete.
[2025-10-24T18:53:56.449181] [INFO ] [LOCAL     ] GAM: Starting deletion of derivative data.
[2025-10-24T18:53:56.464446] [DEBUG] [LOCAL     ] GAM: Deleted derivative data file.
[2025-10-24T18:53:56.474460] [INFO ] [MAIN      ] Update Progress: 892/2366 symbols completed. GAM took 22.7s. Estimated remaining: 3h 8m 12s. Rate: 7.8 symbols/min
[2025-10-24T18:53:56.476401] [INFO ] [REMOTE    ] G: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T18:53:56.657382] [INFO ] [MAIN      ] GBAB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:53:56.673146] [DEBUG] [LOCAL     ] GBAB: Loaded 12790 existing records from primary storage.
[2025-10-24T18:53:56.673387] [INFO ] [MAIN      ] GBAB: Loaded 12790 existing records.
[2025-10-24T18:53:56.851681] [WARN ] [MAIN      ] GBAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:53:56.852333] [INFO ] [MAIN      ] GBAB: Wiping existing primary data before full refresh.
[2025-10-24T18:53:56.852528] [INFO ] [LOCAL     ] GBAB: Starting deletion of primary data.
[2025-10-24T18:53:56.852744] [DEBUG] [LOCAL     ] GBAB: Deleted primary data file.
[2025-10-24T18:53:56.852801] [INFO ] [MAIN      ] GBAB: Starting full primary refresh.
[2025-10-24T18:53:56.950200] [INFO ] [REMOTE    ] GAP: Fetching primary data for 2025-03.
[2025-10-24T18:53:57.144585] [INFO ] [REMOTE    ] GATX: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T18:53:57.254886] [INFO ] [REMOTE    ] GBAB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:53:57.747690] [INFO ] [REMOTE    ] GBAB: Fetching primary data for 2025-01.
[2025-10-24T18:53:58.547614] [INFO ] [REMOTE    ] G: Fetching primary data for 2025-08.
[2025-10-24T18:53:58.654344] [INFO ] [REMOTE    ] GBAB: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T18:53:58.891505] [INFO ] [REMOTE    ] GAP: Incremental fetch complete for 2025-03 (1.94 seconds).
[2025-10-24T18:53:59.347694] [INFO ] [REMOTE    ] GBAB: Fetching primary data for 2025-02.
[2025-10-24T18:54:00.148422] [INFO ] [REMOTE    ] G: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T18:54:00.148529] [INFO ] [REMOTE    ] GAP: Fetching primary data for 2025-04.
[2025-10-24T18:54:00.244978] [INFO ] [REMOTE    ] GBAB: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T18:54:00.947705] [INFO ] [REMOTE    ] GATX: Fetching primary data for 2025-02.
[2025-10-24T18:54:01.747735] [INFO ] [REMOTE    ] G: Fetching primary data for 2025-09.
[2025-10-24T18:54:01.921032] [INFO ] [REMOTE    ] GATX: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T18:54:02.168488] [INFO ] [REMOTE    ] GAP: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T18:54:02.547690] [INFO ] [REMOTE    ] GAP: Fetching primary data for 2025-05.
[2025-10-24T18:54:03.347724] [INFO ] [REMOTE    ] GBAB: Fetching primary data for 2025-03.
[2025-10-24T18:54:03.399098] [INFO ] [REMOTE    ] G: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T18:54:04.153744] [INFO ] [REMOTE    ] GATX: Fetching primary data for 2025-03.
[2025-10-24T18:54:04.155250] [INFO ] [REMOTE    ] GBAB: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T18:54:04.419309] [INFO ] [REMOTE    ] GAP: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T18:54:04.947702] [INFO ] [REMOTE    ] GAP: Fetching primary data for 2025-06.
[2025-10-24T18:54:05.227380] [INFO ] [REMOTE    ] GATX: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T18:54:05.747742] [INFO ] [REMOTE    ] GBAB: Fetching primary data for 2025-04.
[2025-10-24T18:54:06.547710] [INFO ] [REMOTE    ] G: Fetching primary data for 2025-10.
[2025-10-24T18:54:06.668974] [INFO ] [REMOTE    ] GBAB: Incremental fetch complete for 2025-04 (0.92 seconds).
[2025-10-24T18:54:07.024760] [INFO ] [REMOTE    ] GAP: Incremental fetch complete for 2025-06 (2.08 seconds).
[2025-10-24T18:54:07.347687] [INFO ] [REMOTE    ] GAP: Fetching primary data for 2025-07.
[2025-10-24T18:54:08.147698] [INFO ] [REMOTE    ] GBAB: Fetching primary data for 2025-05.
[2025-10-24T18:54:08.381255] [INFO ] [REMOTE    ] G: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T18:54:08.390605] [INFO ] [REMOTE    ] G: Full fetch complete (72331 records).
[2025-10-24T18:54:08.390766] [DEBUG] [VALIDATOR ] G: Validating primary data.
[2025-10-24T18:54:08.777040] [DEBUG] [VALIDATOR ] G: All expected trading days are present.
[2025-10-24T18:54:08.777159] [DEBUG] [VALIDATOR ] G: Primary data validation passed.
[2025-10-24T18:54:08.778153] [INFO ] [MAIN      ] G: Fetched primary data is valid.
[2025-10-24T18:54:08.778214] [DEBUG] [LOCAL     ] G: Saving primary data.
[2025-10-24T18:54:08.778782] [FATAL] [LOCAL     ] G: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:54:08.778864] [FATAL] [MAIN      ] G: Failed to save primary data.
[2025-10-24T18:54:08.778906] [WARN ] [MAIN      ] G: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:54:08.778979] [INFO ] [LOCAL     ] G: Starting deletion of primary data.
[2025-10-24T18:54:08.779058] [DEBUG] [LOCAL     ] G: No primary data file found to delete.
[2025-10-24T18:54:08.779107] [INFO ] [LOCAL     ] G: Starting deletion of derivative data.
[2025-10-24T18:54:08.779264] [DEBUG] [LOCAL     ] G: Deleted derivative data file.
[2025-10-24T18:54:08.779707] [INFO ] [MAIN      ] Update Progress: 893/2366 symbols completed. G took 50.2s. Estimated remaining: 3h 8m 12s. Rate: 7.8 symbols/min
[2025-10-24T18:54:08.951425] [INFO ] [REMOTE    ] GATX: Fetching primary data for 2025-04.
[2025-10-24T18:54:08.951351] [INFO ] [MAIN      ] GBCI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:54:08.960186] [INFO ] [REMOTE    ] GBAB: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T18:54:09.001169] [DEBUG] [LOCAL     ] GBCI: Loaded 41514 existing records from primary storage.
[2025-10-24T18:54:09.001445] [INFO ] [MAIN      ] GBCI: Loaded 41514 existing records.
[2025-10-24T18:54:09.179806] [WARN ] [MAIN      ] GBCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:54:09.179983] [INFO ] [MAIN      ] GBCI: Wiping existing primary data before full refresh.
[2025-10-24T18:54:09.180028] [INFO ] [LOCAL     ] GBCI: Starting deletion of primary data.
[2025-10-24T18:54:09.180207] [DEBUG] [LOCAL     ] GBCI: Deleted primary data file.
[2025-10-24T18:54:09.180247] [INFO ] [MAIN      ] GBCI: Starting full primary refresh.
[2025-10-24T18:54:09.544516] [INFO ] [REMOTE    ] GBCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:54:09.574356] [INFO ] [REMOTE    ] GAP: Incremental fetch complete for 2025-07 (2.23 seconds).
[2025-10-24T18:54:09.747603] [INFO ] [REMOTE    ] GAP: Fetching primary data for 2025-08.
[2025-10-24T18:54:10.132074] [INFO ] [REMOTE    ] GATX: Incremental fetch complete for 2025-04 (1.18 seconds).
[2025-10-24T18:54:10.547672] [INFO ] [REMOTE    ] GBAB: Fetching primary data for 2025-06.
[2025-10-24T18:54:11.347617] [INFO ] [REMOTE    ] GATX: Fetching primary data for 2025-05.
[2025-10-24T18:54:11.498424] [INFO ] [REMOTE    ] GBAB: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T18:54:11.807185] [INFO ] [REMOTE    ] GAP: Incremental fetch complete for 2025-08 (2.06 seconds).
[2025-10-24T18:54:12.147616] [INFO ] [REMOTE    ] GBAB: Fetching primary data for 2025-07.
[2025-10-24T18:54:12.451240] [INFO ] [REMOTE    ] GATX: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T18:54:12.947685] [INFO ] [REMOTE    ] GATX: Fetching primary data for 2025-06.
[2025-10-24T18:54:13.153631] [INFO ] [REMOTE    ] GBAB: Incremental fetch complete for 2025-07 (1.01 seconds).
[2025-10-24T18:54:13.747696] [INFO ] [REMOTE    ] GBCI: Fetching primary data for 2025-01.
[2025-10-24T18:54:13.928346] [INFO ] [REMOTE    ] GATX: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T18:54:14.547691] [INFO ] [REMOTE    ] GATX: Fetching primary data for 2025-07.
[2025-10-24T18:54:15.259218] [INFO ] [REMOTE    ] GBCI: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T18:54:15.347719] [INFO ] [REMOTE    ] GAP: Fetching primary data for 2025-09.
[2025-10-24T18:54:15.538059] [INFO ] [REMOTE    ] GATX: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T18:54:16.147689] [INFO ] [REMOTE    ] GBAB: Fetching primary data for 2025-08.
[2025-10-24T18:54:16.947696] [INFO ] [REMOTE    ] GBCI: Fetching primary data for 2025-02.
[2025-10-24T18:54:17.001894] [INFO ] [REMOTE    ] GBAB: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T18:54:17.321659] [INFO ] [REMOTE    ] GAP: Incremental fetch complete for 2025-09 (1.97 seconds).
[2025-10-24T18:54:17.747740] [INFO ] [REMOTE    ] GBAB: Fetching primary data for 2025-09.
[2025-10-24T18:54:18.193060] [INFO ] [REMOTE    ] GBCI: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T18:54:18.547635] [INFO ] [REMOTE    ] GATX: Fetching primary data for 2025-08.
[2025-10-24T18:54:18.562541] [INFO ] [REMOTE    ] GBAB: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T18:54:19.347618] [INFO ] [REMOTE    ] GAP: Fetching primary data for 2025-10.
[2025-10-24T18:54:19.509565] [INFO ] [REMOTE    ] GATX: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T18:54:20.147746] [INFO ] [REMOTE    ] GBCI: Fetching primary data for 2025-03.
[2025-10-24T18:54:20.947715] [INFO ] [REMOTE    ] GBAB: Fetching primary data for 2025-10.
[2025-10-24T18:54:21.473856] [INFO ] [REMOTE    ] GAP: Incremental fetch complete for 2025-10 (2.13 seconds).
[2025-10-24T18:54:21.484589] [INFO ] [REMOTE    ] GAP: Full fetch complete (77814 records).
[2025-10-24T18:54:21.484780] [DEBUG] [VALIDATOR ] GAP: Validating primary data.
[2025-10-24T18:54:21.652951] [INFO ] [REMOTE    ] GBAB: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T18:54:21.750246] [INFO ] [REMOTE    ] GATX: Fetching primary data for 2025-09.
[2025-10-24T18:54:21.750024] [INFO ] [REMOTE    ] GBAB: Full fetch complete (18575 records).
[2025-10-24T18:54:21.768830] [DEBUG] [VALIDATOR ] GBAB: Validating primary data.
[2025-10-24T18:54:21.845297] [INFO ] [REMOTE    ] GBCI: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T18:54:22.095343] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present.
[2025-10-24T18:54:22.095762] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed.
[2025-10-24T18:54:22.096795] [INFO ] [MAIN      ] GAP: Fetched primary data is valid.
[2025-10-24T18:54:22.102503] [DEBUG] [LOCAL     ] GAP: Saving primary data.
[2025-10-24T18:54:22.113428] [FATAL] [LOCAL     ] GAP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:54:22.123844] [FATAL] [MAIN      ] GAP: Failed to save primary data.
[2025-10-24T18:54:22.123933] [WARN ] [MAIN      ] GAP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:54:22.142083] [INFO ] [LOCAL     ] GAP: Starting deletion of primary data.
[2025-10-24T18:54:22.156507] [DEBUG] [LOCAL     ] GAP: No primary data file found to delete.
[2025-10-24T18:54:22.157679] [INFO ] [LOCAL     ] GAP: Starting deletion of derivative data.
[2025-10-24T18:54:22.212352] [DEBUG] [LOCAL     ] GAP: Deleted derivative data file.
[2025-10-24T18:54:22.245021] [INFO ] [MAIN      ] Update Progress: 894/2366 symbols completed. GAP took 31.9s. Estimated remaining: 3h 8m 14s. Rate: 7.8 symbols/min
[2025-10-24T18:54:22.520566] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present.
[2025-10-24T18:54:22.535433] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed.
[2025-10-24T18:54:22.537723] [INFO ] [MAIN      ] GBLI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:54:22.538219] [INFO ] [MAIN      ] GBAB: Fetched primary data is valid.
[2025-10-24T18:54:22.538296] [DEBUG] [LOCAL     ] GBAB: Saving primary data.
[2025-10-24T18:54:22.538476] [DEBUG] [LOCAL     ] GBLI: No existing data file found in primary storage.
[2025-10-24T18:54:22.538529] [WARN ] [MAIN      ] GBLI: No existing data found, performing full refresh instead.
[2025-10-24T18:54:22.538688] [INFO ] [MAIN      ] GBLI: Wiping existing primary data before full refresh.
[2025-10-24T18:54:22.538754] [INFO ] [LOCAL     ] GBLI: Starting deletion of primary data.
[2025-10-24T18:54:22.538843] [DEBUG] [LOCAL     ] GBLI: No primary data file found to delete.
[2025-10-24T18:54:22.538975] [FATAL] [LOCAL     ] GBAB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:54:22.539111] [FATAL] [MAIN      ] GBAB: Failed to save primary data.
[2025-10-24T18:54:22.539221] [INFO ] [MAIN      ] GBLI: Starting full primary refresh.
[2025-10-24T18:54:22.559730] [INFO ] [REMOTE    ] GBCI: Fetching primary data for 2025-04.
[2025-10-24T18:54:22.569739] [WARN ] [MAIN      ] GBAB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:54:22.575021] [INFO ] [LOCAL     ] GBAB: Starting deletion of primary data.
[2025-10-24T18:54:22.603265] [DEBUG] [LOCAL     ] GBAB: No primary data file found to delete.
[2025-10-24T18:54:22.632456] [INFO ] [LOCAL     ] GBAB: Starting deletion of derivative data.
[2025-10-24T18:54:22.644689] [DEBUG] [LOCAL     ] GBAB: Deleted derivative data file.
[2025-10-24T18:54:22.660732] [INFO ] [MAIN      ] Update Progress: 895/2366 symbols completed. GBAB took 26.2s. Estimated remaining: 3h 7m 55s. Rate: 7.8 symbols/min
[2025-10-24T18:54:23.087177] [INFO ] [REMOTE    ] GBLI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:54:23.057801] [INFO ] [MAIN      ] GBTG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:54:23.103972] [INFO ] [REMOTE    ] GATX: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T18:54:23.144833] [DEBUG] [LOCAL     ] GBTG: Loaded 40489 existing records from primary storage.
[2025-10-24T18:54:23.145136] [INFO ] [MAIN      ] GBTG: Loaded 40489 existing records.
[2025-10-24T18:54:23.318479] [WARN ] [MAIN      ] GBTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:54:23.318724] [INFO ] [MAIN      ] GBTG: Wiping existing primary data before full refresh.
[2025-10-24T18:54:23.318780] [INFO ] [LOCAL     ] GBTG: Starting deletion of primary data.
[2025-10-24T18:54:23.319126] [DEBUG] [LOCAL     ] GBTG: Deleted primary data file.
[2025-10-24T18:54:23.319181] [INFO ] [MAIN      ] GBTG: Starting full primary refresh.
[2025-10-24T18:54:23.352834] [INFO ] [REMOTE    ] GBLI: Fetching primary data for 2025-01.
[2025-10-24T18:54:23.673250] [INFO ] [REMOTE    ] GBTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:54:23.785891] [INFO ] [REMOTE    ] GBLI: Incremental fetch complete for 2025-01 (0.43 seconds).
[2025-10-24T18:54:24.147633] [INFO ] [REMOTE    ] GBLI: Fetching primary data for 2025-02.
[2025-10-24T18:54:24.218515] [INFO ] [REMOTE    ] GBCI: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T18:54:24.386196] [INFO ] [REMOTE    ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds).
[2025-10-24T18:54:24.947686] [INFO ] [REMOTE    ] GATX: Fetching primary data for 2025-10.
[2025-10-24T18:54:25.747682] [INFO ] [REMOTE    ] GBTG: Fetching primary data for 2025-01.
[2025-10-24T18:54:25.988502] [INFO ] [REMOTE    ] GATX: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T18:54:25.993510] [INFO ] [REMOTE    ] GATX: Full fetch complete (25080 records).
[2025-10-24T18:54:25.993671] [DEBUG] [VALIDATOR ] GATX: Validating primary data.
[2025-10-24T18:54:26.370225] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present.
[2025-10-24T18:54:26.370383] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed.
[2025-10-24T18:54:26.370926] [INFO ] [MAIN      ] GATX: Fetched primary data is valid.
[2025-10-24T18:54:26.370986] [DEBUG] [LOCAL     ] GATX: Saving primary data.
[2025-10-24T18:54:26.371267] [FATAL] [LOCAL     ] GATX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:54:26.371390] [FATAL] [MAIN      ] GATX: Failed to save primary data.
[2025-10-24T18:54:26.371432] [WARN ] [MAIN      ] GATX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:54:26.371466] [INFO ] [LOCAL     ] GATX: Starting deletion of primary data.
[2025-10-24T18:54:26.371525] [DEBUG] [LOCAL     ] GATX: No primary data file found to delete.
[2025-10-24T18:54:26.371579] [INFO ] [LOCAL     ] GATX: Starting deletion of derivative data.
[2025-10-24T18:54:26.372218] [DEBUG] [LOCAL     ] GATX: Deleted derivative data file.
[2025-10-24T18:54:26.372309] [INFO ] [MAIN      ] Update Progress: 896/2366 symbols completed. GATX took 31.7s. Estimated remaining: 3h 7m 40s. Rate: 7.8 symbols/min
[2025-10-24T18:54:26.540088] [INFO ] [MAIN      ] GBX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:54:26.547720] [INFO ] [REMOTE    ] GBCI: Fetching primary data for 2025-05.
[2025-10-24T18:54:26.568565] [DEBUG] [LOCAL     ] GBX: Loaded 28356 existing records from primary storage.
[2025-10-24T18:54:26.568923] [INFO ] [MAIN      ] GBX: Loaded 28356 existing records.
[2025-10-24T18:54:26.744881] [WARN ] [MAIN      ] GBX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:54:26.745060] [INFO ] [MAIN      ] GBX: Wiping existing primary data before full refresh.
[2025-10-24T18:54:26.745105] [INFO ] [LOCAL     ] GBX: Starting deletion of primary data.
[2025-10-24T18:54:26.745321] [DEBUG] [LOCAL     ] GBX: Deleted primary data file.
[2025-10-24T18:54:26.745389] [INFO ] [MAIN      ] GBX: Starting full primary refresh.
[2025-10-24T18:54:27.124444] [INFO ] [REMOTE    ] GBTG: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T18:54:27.123366] [INFO ] [REMOTE    ] GBX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:54:27.347622] [INFO ] [REMOTE    ] GBX: Fetching primary data for 2025-01.
[2025-10-24T18:54:28.155391] [INFO ] [REMOTE    ] GBLI: Fetching primary data for 2025-03.
[2025-10-24T18:54:28.158104] [INFO ] [REMOTE    ] GBCI: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T18:54:28.514447] [INFO ] [REMOTE    ] GBLI: Incremental fetch complete for 2025-03 (0.36 seconds).
[2025-10-24T18:54:28.828867] [INFO ] [REMOTE    ] GBX: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T18:54:28.947626] [INFO ] [REMOTE    ] GBX: Fetching primary data for 2025-02.
[2025-10-24T18:54:29.747684] [INFO ] [REMOTE    ] GBCI: Fetching primary data for 2025-06.
[2025-10-24T18:54:30.173558] [INFO ] [REMOTE    ] GBX: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T18:54:30.547635] [INFO ] [REMOTE    ] GBX: Fetching primary data for 2025-03.
[2025-10-24T18:54:31.141249] [INFO ] [REMOTE    ] GBCI: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T18:54:31.347629] [INFO ] [REMOTE    ] GBCI: Fetching primary data for 2025-07.
[2025-10-24T18:54:31.855869] [INFO ] [REMOTE    ] GBX: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T18:54:32.147718] [INFO ] [REMOTE    ] GBLI: Fetching primary data for 2025-04.
[2025-10-24T18:54:32.590722] [INFO ] [REMOTE    ] GBLI: Incremental fetch complete for 2025-04 (0.44 seconds).
[2025-10-24T18:54:32.947692] [INFO ] [REMOTE    ] GBX: Fetching primary data for 2025-04.
[2025-10-24T18:54:32.990196] [INFO ] [REMOTE    ] GBCI: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T18:54:33.747672] [INFO ] [REMOTE    ] GBTG: Fetching primary data for 2025-02.
[2025-10-24T18:54:34.520948] [INFO ] [REMOTE    ] GBX: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T18:54:34.547611] [INFO ] [REMOTE    ] GBLI: Fetching primary data for 2025-05.
[2025-10-24T18:54:34.911170] [INFO ] [REMOTE    ] GBLI: Incremental fetch complete for 2025-05 (0.36 seconds).
[2025-10-24T18:54:35.095180] [INFO ] [REMOTE    ] GBTG: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T18:54:35.347676] [INFO ] [REMOTE    ] GBLI: Fetching primary data for 2025-06.
[2025-10-24T18:54:35.594796] [INFO ] [REMOTE    ] GBLI: Incremental fetch complete for 2025-06 (0.25 seconds).
[2025-10-24T18:54:36.147739] [INFO ] [REMOTE    ] GBX: Fetching primary data for 2025-05.
[2025-10-24T18:54:36.947730] [INFO ] [REMOTE    ] GBTG: Fetching primary data for 2025-03.
[2025-10-24T18:54:37.389005] [INFO ] [REMOTE    ] GBX: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T18:54:37.747667] [INFO ] [REMOTE    ] GBLI: Fetching primary data for 2025-07.
[2025-10-24T18:54:37.995472] [INFO ] [REMOTE    ] GBLI: Incremental fetch complete for 2025-07 (0.25 seconds).
[2025-10-24T18:54:38.430624] [INFO ] [REMOTE    ] GBTG: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T18:54:38.547631] [INFO ] [REMOTE    ] GBLI: Fetching primary data for 2025-08.
[2025-10-24T18:54:38.994731] [INFO ] [REMOTE    ] GBLI: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T18:54:39.347714] [INFO ] [REMOTE    ] GBLI: Fetching primary data for 2025-09.
[2025-10-24T18:54:39.694414] [INFO ] [REMOTE    ] GBLI: Incremental fetch complete for 2025-09 (0.35 seconds).
[2025-10-24T18:54:40.147674] [INFO ] [REMOTE    ] GBLI: Fetching primary data for 2025-10.
[2025-10-24T18:54:40.618425] [INFO ] [REMOTE    ] GBLI: Incremental fetch complete for 2025-10 (0.47 seconds).
[2025-10-24T18:54:40.619162] [INFO ] [REMOTE    ] GBLI: Full fetch complete (1290 records).
[2025-10-24T18:54:40.619250] [DEBUG] [VALIDATOR ] GBLI: Validating primary data.
[2025-10-24T18:54:40.800981] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days
[2025-10-24T18:54:40.801131] [FATAL] [MAIN      ] GBLI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T18:54:40.801200] [WARN ] [MAIN      ] GBLI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T18:54:40.801269] [INFO ] [LOCAL     ] GBLI: Starting deletion of primary data.
[2025-10-24T18:54:40.801329] [DEBUG] [LOCAL     ] GBLI: No primary data file found to delete.
[2025-10-24T18:54:40.801364] [INFO ] [LOCAL     ] GBLI: Starting deletion of derivative data.
[2025-10-24T18:54:40.801403] [DEBUG] [LOCAL     ] GBLI: No derivative data file found to delete.
[2025-10-24T18:54:40.801476] [INFO ] [MAIN      ] Update Progress: 897/2366 symbols completed. GBLI took 18.6s. Estimated remaining: 3h 7m 44s. Rate: 7.8 symbols/min
[2025-10-24T18:54:40.967871] [INFO ] [REMOTE    ] GBTG: Fetching primary data for 2025-04.
[2025-10-24T18:54:40.972341] [INFO ] [MAIN      ] GCI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:54:41.013777] [DEBUG] [LOCAL     ] GCI: Loaded 43883 existing records from primary storage.
[2025-10-24T18:54:41.014052] [INFO ] [MAIN      ] GCI: Loaded 43883 existing records.
[2025-10-24T18:54:41.187775] [WARN ] [MAIN      ] GCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:54:41.187979] [INFO ] [MAIN      ] GCI: Wiping existing primary data before full refresh.
[2025-10-24T18:54:41.188025] [INFO ] [LOCAL     ] GCI: Starting deletion of primary data.
[2025-10-24T18:54:41.188225] [DEBUG] [LOCAL     ] GCI: Deleted primary data file.
[2025-10-24T18:54:41.188262] [INFO ] [MAIN      ] GCI: Starting full primary refresh.
[2025-10-24T18:54:41.543557] [INFO ] [REMOTE    ] GCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:54:41.747686] [INFO ] [REMOTE    ] GBCI: Fetching primary data for 2025-08.
[2025-10-24T18:54:42.514255] [INFO ] [REMOTE    ] GBTG: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T18:54:42.547663] [INFO ] [REMOTE    ] GBTG: Fetching primary data for 2025-05.
[2025-10-24T18:54:43.352806] [INFO ] [REMOTE    ] GBX: Fetching primary data for 2025-06.
[2025-10-24T18:54:43.366842] [INFO ] [REMOTE    ] GBCI: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T18:54:44.031842] [INFO ] [REMOTE    ] GBTG: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T18:54:44.147671] [INFO ] [REMOTE    ] GBCI: Fetching primary data for 2025-09.
[2025-10-24T18:54:44.401754] [INFO ] [REMOTE    ] GBX: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T18:54:44.947718] [INFO ] [REMOTE    ] GCI: Fetching primary data for 2025-01.
[2025-10-24T18:54:45.699202] [INFO ] [REMOTE    ] GBCI: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T18:54:45.747605] [INFO ] [REMOTE    ] GBCI: Fetching primary data for 2025-10.
[2025-10-24T18:54:46.547718] [INFO ] [REMOTE    ] GBX: Fetching primary data for 2025-07.
[2025-10-24T18:54:46.655232] [INFO ] [REMOTE    ] GCI: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T18:54:47.347695] [INFO ] [REMOTE    ] GBTG: Fetching primary data for 2025-06.
[2025-10-24T18:54:47.667361] [INFO ] [REMOTE    ] GBCI: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T18:54:47.676098] [INFO ] [REMOTE    ] GBCI: Full fetch complete (59531 records).
[2025-10-24T18:54:47.676208] [DEBUG] [VALIDATOR ] GBCI: Validating primary data.
[2025-10-24T18:54:48.093009] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present.
[2025-10-24T18:54:48.093188] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed.
[2025-10-24T18:54:48.094011] [INFO ] [MAIN      ] GBCI: Fetched primary data is valid.
[2025-10-24T18:54:48.094093] [DEBUG] [LOCAL     ] GBCI: Saving primary data.
[2025-10-24T18:54:48.094767] [FATAL] [LOCAL     ] GBCI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:54:48.114052] [FATAL] [MAIN      ] GBCI: Failed to save primary data.
[2025-10-24T18:54:48.114341] [WARN ] [MAIN      ] GBCI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:54:48.115519] [INFO ] [REMOTE    ] GBX: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T18:54:48.114835] [INFO ] [LOCAL     ] GBCI: Starting deletion of primary data.
[2025-10-24T18:54:48.123369] [DEBUG] [LOCAL     ] GBCI: No primary data file found to delete.
[2025-10-24T18:54:48.123529] [INFO ] [LOCAL     ] GBCI: Starting deletion of derivative data.
[2025-10-24T18:54:48.123911] [DEBUG] [LOCAL     ] GBCI: Deleted derivative data file.
[2025-10-24T18:54:48.124328] [INFO ] [MAIN      ] Update Progress: 898/2366 symbols completed. GBCI took 39.3s. Estimated remaining: 3h 7m 36s. Rate: 7.8 symbols/min
[2025-10-24T18:54:48.156227] [INFO ] [REMOTE    ] GCI: Fetching primary data for 2025-02.
[2025-10-24T18:54:48.308263] [INFO ] [MAIN      ] GCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:54:48.329567] [DEBUG] [LOCAL     ] GCO: Loaded 22941 existing records from primary storage.
[2025-10-24T18:54:48.329844] [INFO ] [MAIN      ] GCO: Loaded 22941 existing records.
[2025-10-24T18:54:48.525282] [WARN ] [MAIN      ] GCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:54:48.525497] [INFO ] [MAIN      ] GCO: Wiping existing primary data before full refresh.
[2025-10-24T18:54:48.525552] [INFO ] [LOCAL     ] GCO: Starting deletion of primary data.
[2025-10-24T18:54:48.525763] [DEBUG] [LOCAL     ] GCO: Deleted primary data file.
[2025-10-24T18:54:48.525819] [INFO ] [MAIN      ] GCO: Starting full primary refresh.
[2025-10-24T18:54:48.940447] [INFO ] [REMOTE    ] GCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:54:48.952726] [INFO ] [REMOTE    ] GCO: Fetching primary data for 2025-01.
[2025-10-24T18:54:48.965353] [INFO ] [REMOTE    ] GBTG: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T18:54:49.747605] [INFO ] [REMOTE    ] GBTG: Fetching primary data for 2025-07.
[2025-10-24T18:54:49.804448] [INFO ] [REMOTE    ] GCI: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T18:54:50.136748] [INFO ] [REMOTE    ] GCO: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T18:54:50.547631] [INFO ] [REMOTE    ] GCO: Fetching primary data for 2025-02.
[2025-10-24T18:54:51.143199] [INFO ] [REMOTE    ] GBTG: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T18:54:51.347621] [INFO ] [REMOTE    ] GCI: Fetching primary data for 2025-03.
[2025-10-24T18:54:51.617353] [INFO ] [REMOTE    ] GCO: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T18:54:52.147733] [INFO ] [REMOTE    ] GCO: Fetching primary data for 2025-03.
[2025-10-24T18:54:52.906824] [INFO ] [REMOTE    ] GCI: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T18:54:52.947602] [INFO ] [REMOTE    ] GCI: Fetching primary data for 2025-04.
[2025-10-24T18:54:53.478369] [INFO ] [REMOTE    ] GCO: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T18:54:53.747675] [INFO ] [REMOTE    ] GBTG: Fetching primary data for 2025-08.
[2025-10-24T18:54:54.515739] [INFO ] [REMOTE    ] GCI: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T18:54:54.547613] [INFO ] [REMOTE    ] GCI: Fetching primary data for 2025-05.
[2025-10-24T18:54:55.213264] [INFO ] [REMOTE    ] GBTG: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T18:54:55.347678] [INFO ] [REMOTE    ] GBTG: Fetching primary data for 2025-09.
[2025-10-24T18:54:56.147681] [INFO ] [REMOTE    ] GCO: Fetching primary data for 2025-04.
[2025-10-24T18:54:56.193837] [INFO ] [REMOTE    ] GCI: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T18:54:56.828526] [INFO ] [REMOTE    ] GBTG: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T18:54:56.947623] [INFO ] [REMOTE    ] GCI: Fetching primary data for 2025-06.
[2025-10-24T18:54:57.586386] [INFO ] [REMOTE    ] GCO: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T18:54:57.747620] [INFO ] [REMOTE    ] GBTG: Fetching primary data for 2025-10.
[2025-10-24T18:54:58.547720] [INFO ] [REMOTE    ] GBX: Fetching primary data for 2025-08.
[2025-10-24T18:54:58.601304] [INFO ] [REMOTE    ] GCI: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T18:54:59.347689] [INFO ] [REMOTE    ] GCO: Fetching primary data for 2025-05.
[2025-10-24T18:54:59.432529] [INFO ] [REMOTE    ] GBTG: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T18:54:59.441368] [INFO ] [REMOTE    ] GBTG: Full fetch complete (56882 records).
[2025-10-24T18:54:59.441569] [DEBUG] [VALIDATOR ] GBTG: Validating primary data.
[2025-10-24T18:54:59.569499] [INFO ] [REMOTE    ] GBX: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T18:54:59.870722] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present.
[2025-10-24T18:54:59.870818] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed.
[2025-10-24T18:54:59.871746] [INFO ] [MAIN      ] GBTG: Fetched primary data is valid.
[2025-10-24T18:54:59.871810] [DEBUG] [LOCAL     ] GBTG: Saving primary data.
[2025-10-24T18:54:59.872369] [FATAL] [LOCAL     ] GBTG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:54:59.872480] [FATAL] [MAIN      ] GBTG: Failed to save primary data.
[2025-10-24T18:54:59.872522] [WARN ] [MAIN      ] GBTG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:54:59.872557] [INFO ] [LOCAL     ] GBTG: Starting deletion of primary data.
[2025-10-24T18:54:59.872612] [DEBUG] [LOCAL     ] GBTG: No primary data file found to delete.
[2025-10-24T18:54:59.872692] [INFO ] [LOCAL     ] GBTG: Starting deletion of derivative data.
[2025-10-24T18:54:59.872884] [DEBUG] [LOCAL     ] GBTG: Deleted derivative data file.
[2025-10-24T18:54:59.873219] [INFO ] [MAIN      ] Update Progress: 899/2366 symbols completed. GBTG took 37.2s. Estimated remaining: 3h 7m 35s. Rate: 7.8 symbols/min
[2025-10-24T18:55:00.052124] [INFO ] [MAIN      ] GCTS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:55:00.073943] [DEBUG] [LOCAL     ] GCTS: Loaded 20365 existing records from primary storage.
[2025-10-24T18:55:00.074195] [INFO ] [MAIN      ] GCTS: Loaded 20365 existing records.
[2025-10-24T18:55:00.153381] [INFO ] [REMOTE    ] GBX: Fetching primary data for 2025-09.
[2025-10-24T18:55:00.262618] [WARN ] [MAIN      ] GCTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:55:00.262883] [INFO ] [MAIN      ] GCTS: Wiping existing primary data before full refresh.
[2025-10-24T18:55:00.262943] [INFO ] [LOCAL     ] GCTS: Starting deletion of primary data.
[2025-10-24T18:55:00.263137] [DEBUG] [LOCAL     ] GCTS: Deleted primary data file.
[2025-10-24T18:55:00.263193] [INFO ] [MAIN      ] GCTS: Starting full primary refresh.
[2025-10-24T18:55:00.630159] [INFO ] [REMOTE    ] GCO: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T18:55:00.634625] [INFO ] [REMOTE    ] GCTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:55:00.947675] [INFO ] [REMOTE    ] GCO: Fetching primary data for 2025-06.
[2025-10-24T18:55:01.751844] [INFO ] [REMOTE    ] GCI: Fetching primary data for 2025-07.
[2025-10-24T18:55:01.755596] [INFO ] [REMOTE    ] GBX: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T18:55:02.547677] [INFO ] [REMOTE    ] GCTS: Fetching primary data for 2025-01.
[2025-10-24T18:55:02.899169] [INFO ] [REMOTE    ] GCO: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T18:55:03.347741] [INFO ] [REMOTE    ] GBX: Fetching primary data for 2025-10.
[2025-10-24T18:55:03.811901] [INFO ] [REMOTE    ] GCI: Incremental fetch complete for 2025-07 (2.06 seconds).
[2025-10-24T18:55:04.147681] [INFO ] [REMOTE    ] GCI: Fetching primary data for 2025-08.
[2025-10-24T18:55:04.179375] [INFO ] [REMOTE    ] GCTS: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T18:55:04.628892] [INFO ] [REMOTE    ] GBX: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T18:55:04.633550] [INFO ] [REMOTE    ] GBX: Full fetch complete (42584 records).
[2025-10-24T18:55:04.633628] [DEBUG] [VALIDATOR ] GBX: Validating primary data.
[2025-10-24T18:55:04.954473] [INFO ] [REMOTE    ] GCTS: Fetching primary data for 2025-02.
[2025-10-24T18:55:05.003800] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present.
[2025-10-24T18:55:05.003873] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed.
[2025-10-24T18:55:05.004518] [INFO ] [MAIN      ] GBX: Fetched primary data is valid.
[2025-10-24T18:55:05.004557] [DEBUG] [LOCAL     ] GBX: Saving primary data.
[2025-10-24T18:55:05.004973] [FATAL] [LOCAL     ] GBX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:55:05.005053] [FATAL] [MAIN      ] GBX: Failed to save primary data.
[2025-10-24T18:55:05.005094] [WARN ] [MAIN      ] GBX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:55:05.005155] [INFO ] [LOCAL     ] GBX: Starting deletion of primary data.
[2025-10-24T18:55:05.005265] [DEBUG] [LOCAL     ] GBX: No primary data file found to delete.
[2025-10-24T18:55:05.005312] [INFO ] [LOCAL     ] GBX: Starting deletion of derivative data.
[2025-10-24T18:55:05.005471] [DEBUG] [LOCAL     ] GBX: Deleted derivative data file.
[2025-10-24T18:55:05.005560] [INFO ] [MAIN      ] Update Progress: 900/2366 symbols completed. GBX took 38.6s. Estimated remaining: 3h 7m 23s. Rate: 7.8 symbols/min
[2025-10-24T18:55:05.175441] [INFO ] [MAIN      ] GCV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:55:05.184990] [DEBUG] [LOCAL     ] GCV: Loaded 7854 existing records from primary storage.
[2025-10-24T18:55:05.185193] [INFO ] [MAIN      ] GCV: Loaded 7854 existing records.
[2025-10-24T18:55:05.358613] [WARN ] [MAIN      ] GCV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:55:05.358849] [INFO ] [MAIN      ] GCV: Wiping existing primary data before full refresh.
[2025-10-24T18:55:05.358895] [INFO ] [LOCAL     ] GCV: Starting deletion of primary data.
[2025-10-24T18:55:05.359045] [DEBUG] [LOCAL     ] GCV: Deleted primary data file.
[2025-10-24T18:55:05.359100] [INFO ] [MAIN      ] GCV: Starting full primary refresh.
[2025-10-24T18:55:05.707441] [INFO ] [REMOTE    ] GCV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:55:05.747604] [INFO ] [REMOTE    ] GCO: Fetching primary data for 2025-07.
[2025-10-24T18:55:05.900247] [INFO ] [REMOTE    ] GCI: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T18:55:06.134391] [INFO ] [REMOTE    ] GCTS: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T18:55:06.517735] [INFO ] [REMOTE    ] GCO: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T18:55:06.547604] [INFO ] [REMOTE    ] GCO: Fetching primary data for 2025-08.
[2025-10-24T18:55:07.347696] [INFO ] [REMOTE    ] GCV: Fetching primary data for 2025-01.
[2025-10-24T18:55:07.673756] [INFO ] [REMOTE    ] GCO: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T18:55:07.973163] [INFO ] [REMOTE    ] GCV: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T18:55:08.147627] [INFO ] [REMOTE    ] GCV: Fetching primary data for 2025-02.
[2025-10-24T18:55:08.738964] [INFO ] [REMOTE    ] GCV: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T18:55:08.947696] [INFO ] [REMOTE    ] GCI: Fetching primary data for 2025-09.
[2025-10-24T18:55:09.747670] [INFO ] [REMOTE    ] GCV: Fetching primary data for 2025-03.
[2025-10-24T18:55:10.370284] [INFO ] [REMOTE    ] GCV: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T18:55:10.518511] [INFO ] [REMOTE    ] GCI: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T18:55:10.547622] [INFO ] [REMOTE    ] GCI: Fetching primary data for 2025-10.
[2025-10-24T18:55:11.347686] [INFO ] [REMOTE    ] GCV: Fetching primary data for 2025-04.
[2025-10-24T18:55:12.113923] [INFO ] [REMOTE    ] GCV: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T18:55:12.147621] [INFO ] [REMOTE    ] GCV: Fetching primary data for 2025-05.
[2025-10-24T18:55:12.281063] [INFO ] [REMOTE    ] GCI: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T18:55:12.288842] [INFO ] [REMOTE    ] GCI: Full fetch complete (63299 records).
[2025-10-24T18:55:12.288949] [DEBUG] [VALIDATOR ] GCI: Validating primary data.
[2025-10-24T18:55:12.662901] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present.
[2025-10-24T18:55:12.662976] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed.
[2025-10-24T18:55:12.663809] [INFO ] [MAIN      ] GCI: Fetched primary data is valid.
[2025-10-24T18:55:12.663869] [DEBUG] [LOCAL     ] GCI: Saving primary data.
[2025-10-24T18:55:12.664333] [FATAL] [LOCAL     ] GCI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:55:12.664420] [FATAL] [MAIN      ] GCI: Failed to save primary data.
[2025-10-24T18:55:12.664462] [WARN ] [MAIN      ] GCI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:55:12.664495] [INFO ] [LOCAL     ] GCI: Starting deletion of primary data.
[2025-10-24T18:55:12.664546] [DEBUG] [LOCAL     ] GCI: No primary data file found to delete.
[2025-10-24T18:55:12.664580] [INFO ] [LOCAL     ] GCI: Starting deletion of derivative data.
[2025-10-24T18:55:12.664748] [DEBUG] [LOCAL     ] GCI: Deleted derivative data file.
[2025-10-24T18:55:12.665298] [INFO ] [MAIN      ] Update Progress: 901/2366 symbols completed. GCI took 31.9s. Estimated remaining: 3h 7m 15s. Rate: 7.8 symbols/min
[2025-10-24T18:55:12.836889] [INFO ] [MAIN      ] GD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:55:12.880723] [DEBUG] [LOCAL     ] GD: Loaded 46837 existing records from primary storage.
[2025-10-24T18:55:12.881004] [INFO ] [MAIN      ] GD: Loaded 46837 existing records.
[2025-10-24T18:55:12.952838] [INFO ] [REMOTE    ] GCO: Fetching primary data for 2025-09.
[2025-10-24T18:55:13.026768] [INFO ] [REMOTE    ] GCV: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T18:55:13.066597] [WARN ] [MAIN      ] GD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:55:13.066760] [INFO ] [MAIN      ] GD: Wiping existing primary data before full refresh.
[2025-10-24T18:55:13.066806] [INFO ] [LOCAL     ] GD: Starting deletion of primary data.
[2025-10-24T18:55:13.067569] [DEBUG] [LOCAL     ] GD: Deleted primary data file.
[2025-10-24T18:55:13.067625] [INFO ] [MAIN      ] GD: Starting full primary refresh.
[2025-10-24T18:55:13.415146] [INFO ] [REMOTE    ] GD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:55:13.747719] [INFO ] [REMOTE    ] GCTS: Fetching primary data for 2025-03.
[2025-10-24T18:55:14.121414] [INFO ] [REMOTE    ] GCO: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T18:55:14.389204] [INFO ] [REMOTE    ] GCTS: Incremental fetch complete for 2025-03 (0.64 seconds).
[2025-10-24T18:55:14.547746] [INFO ] [REMOTE    ] GD: Fetching primary data for 2025-01.
[2025-10-24T18:55:15.347778] [INFO ] [REMOTE    ] GCV: Fetching primary data for 2025-06.
[2025-10-24T18:55:15.995952] [INFO ] [REMOTE    ] GCV: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T18:55:16.147676] [INFO ] [REMOTE    ] GCTS: Fetching primary data for 2025-04.
[2025-10-24T18:55:16.292041] [INFO ] [REMOTE    ] GD: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T18:55:16.947611] [INFO ] [REMOTE    ] GCV: Fetching primary data for 2025-07.
[2025-10-24T18:55:17.185766] [INFO ] [REMOTE    ] GCTS: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T18:55:17.690829] [INFO ] [REMOTE    ] GCV: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T18:55:17.747625] [INFO ] [REMOTE    ] GCV: Fetching primary data for 2025-08.
[2025-10-24T18:55:18.434003] [INFO ] [REMOTE    ] GCV: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T18:55:18.547719] [INFO ] [REMOTE    ] GCO: Fetching primary data for 2025-10.
[2025-10-24T18:55:19.347614] [INFO ] [REMOTE    ] GD: Fetching primary data for 2025-02.
[2025-10-24T18:55:19.503822] [INFO ] [REMOTE    ] GCO: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T18:55:19.507712] [INFO ] [REMOTE    ] GCO: Full fetch complete (34578 records).
[2025-10-24T18:55:19.507844] [DEBUG] [VALIDATOR ] GCO: Validating primary data.
[2025-10-24T18:55:19.878799] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present.
[2025-10-24T18:55:19.878877] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed.
[2025-10-24T18:55:19.879475] [INFO ] [MAIN      ] GCO: Fetched primary data is valid.
[2025-10-24T18:55:19.879515] [DEBUG] [LOCAL     ] GCO: Saving primary data.
[2025-10-24T18:55:19.879870] [FATAL] [LOCAL     ] GCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:55:19.879955] [FATAL] [MAIN      ] GCO: Failed to save primary data.
[2025-10-24T18:55:19.879998] [WARN ] [MAIN      ] GCO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:55:19.880033] [INFO ] [LOCAL     ] GCO: Starting deletion of primary data.
[2025-10-24T18:55:19.880082] [DEBUG] [LOCAL     ] GCO: No primary data file found to delete.
[2025-10-24T18:55:19.880117] [INFO ] [LOCAL     ] GCO: Starting deletion of derivative data.
[2025-10-24T18:55:19.880252] [DEBUG] [LOCAL     ] GCO: Deleted derivative data file.
[2025-10-24T18:55:19.880321] [INFO ] [MAIN      ] Update Progress: 902/2366 symbols completed. GCO took 31.8s. Estimated remaining: 3h 7m 7s. Rate: 7.8 symbols/min
[2025-10-24T18:55:20.048203] [INFO ] [MAIN      ] GDDY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:55:20.094334] [DEBUG] [LOCAL     ] GDDY: Loaded 49956 existing records from primary storage.
[2025-10-24T18:55:20.094626] [INFO ] [MAIN      ] GDDY: Loaded 49956 existing records.
[2025-10-24T18:55:20.152889] [INFO ] [REMOTE    ] GCV: Fetching primary data for 2025-09.
[2025-10-24T18:55:20.281833] [WARN ] [MAIN      ] GDDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:55:20.282099] [INFO ] [MAIN      ] GDDY: Wiping existing primary data before full refresh.
[2025-10-24T18:55:20.282161] [INFO ] [LOCAL     ] GDDY: Starting deletion of primary data.
[2025-10-24T18:55:20.282821] [DEBUG] [LOCAL     ] GDDY: Deleted primary data file.
[2025-10-24T18:55:20.282880] [INFO ] [MAIN      ] GDDY: Starting full primary refresh.
[2025-10-24T18:55:20.633039] [INFO ] [REMOTE    ] GDDY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:55:20.947616] [INFO ] [REMOTE    ] GCTS: Fetching primary data for 2025-05.
[2025-10-24T18:55:21.008551] [INFO ] [REMOTE    ] GCV: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T18:55:21.142584] [INFO ] [REMOTE    ] GD: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T18:55:21.747609] [INFO ] [REMOTE    ] GD: Fetching primary data for 2025-03.
[2025-10-24T18:55:22.132911] [INFO ] [REMOTE    ] GCTS: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T18:55:22.547692] [INFO ] [REMOTE    ] GCV: Fetching primary data for 2025-10.
[2025-10-24T18:55:23.347679] [INFO ] [REMOTE    ] GCTS: Fetching primary data for 2025-06.
[2025-10-24T18:55:23.526946] [INFO ] [REMOTE    ] GD: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T18:55:23.545264] [INFO ] [REMOTE    ] GCV: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T18:55:23.547949] [INFO ] [REMOTE    ] GCV: Full fetch complete (10080 records).
[2025-10-24T18:55:23.548066] [DEBUG] [VALIDATOR ] GCV: Validating primary data.
[2025-10-24T18:55:23.922988] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present.
[2025-10-24T18:55:23.923059] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed.
[2025-10-24T18:55:23.923294] [INFO ] [MAIN      ] GCV: Fetched primary data is valid.
[2025-10-24T18:55:23.923331] [DEBUG] [LOCAL     ] GCV: Saving primary data.
[2025-10-24T18:55:23.923527] [FATAL] [LOCAL     ] GCV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:55:23.923607] [FATAL] [MAIN      ] GCV: Failed to save primary data.
[2025-10-24T18:55:23.923681] [WARN ] [MAIN      ] GCV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:55:23.923732] [INFO ] [LOCAL     ] GCV: Starting deletion of primary data.
[2025-10-24T18:55:23.923781] [DEBUG] [LOCAL     ] GCV: No primary data file found to delete.
[2025-10-24T18:55:23.923815] [INFO ] [LOCAL     ] GCV: Starting deletion of derivative data.
[2025-10-24T18:55:23.923945] [DEBUG] [LOCAL     ] GCV: Deleted derivative data file.
[2025-10-24T18:55:23.924011] [INFO ] [MAIN      ] Update Progress: 903/2366 symbols completed. GCV took 18.9s. Estimated remaining: 3h 6m 53s. Rate: 7.8 symbols/min
[2025-10-24T18:55:24.093534] [INFO ] [MAIN      ] GDIV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:55:24.099847] [DEBUG] [LOCAL     ] GDIV: Loaded 3522 existing records from primary storage.
[2025-10-24T18:55:24.100036] [INFO ] [MAIN      ] GDIV: Loaded 3522 existing records.
[2025-10-24T18:55:24.157762] [INFO ] [REMOTE    ] GDDY: Fetching primary data for 2025-01.
[2025-10-24T18:55:24.284218] [WARN ] [MAIN      ] GDIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:55:24.284435] [INFO ] [MAIN      ] GDIV: Wiping existing primary data before full refresh.
[2025-10-24T18:55:24.284482] [INFO ] [LOCAL     ] GDIV: Starting deletion of primary data.
[2025-10-24T18:55:24.284636] [DEBUG] [LOCAL     ] GDIV: Deleted primary data file.
[2025-10-24T18:55:24.284721] [INFO ] [MAIN      ] GDIV: Starting full primary refresh.
[2025-10-24T18:55:24.640786] [INFO ] [REMOTE    ] GDIV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:55:24.666980] [INFO ] [REMOTE    ] GCTS: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T18:55:24.947708] [INFO ] [REMOTE    ] GDIV: Fetching primary data for 2025-01.
[2025-10-24T18:55:25.524221] [INFO ] [REMOTE    ] GDIV: Incremental fetch complete for 2025-01 (0.58 seconds).
[2025-10-24T18:55:25.747726] [INFO ] [REMOTE    ] GCTS: Fetching primary data for 2025-07.
[2025-10-24T18:55:25.828312] [INFO ] [REMOTE    ] GDDY: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T18:55:26.547692] [INFO ] [REMOTE    ] GDIV: Fetching primary data for 2025-02.
[2025-10-24T18:55:26.884539] [INFO ] [REMOTE    ] GCTS: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T18:55:27.110844] [INFO ] [REMOTE    ] GDIV: Incremental fetch complete for 2025-02 (0.56 seconds).
[2025-10-24T18:55:27.347632] [INFO ] [REMOTE    ] GCTS: Fetching primary data for 2025-08.
[2025-10-24T18:55:28.147704] [INFO ] [REMOTE    ] GDIV: Fetching primary data for 2025-03.
[2025-10-24T18:55:28.395004] [INFO ] [REMOTE    ] GCTS: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T18:55:28.739004] [INFO ] [REMOTE    ] GDIV: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T18:55:28.947734] [INFO ] [REMOTE    ] GDDY: Fetching primary data for 2025-02.
[2025-10-24T18:55:29.747678] [INFO ] [REMOTE    ] GD: Fetching primary data for 2025-04.
[2025-10-24T18:55:30.547705] [INFO ] [REMOTE    ] GDIV: Fetching primary data for 2025-04.
[2025-10-24T18:55:30.669127] [INFO ] [REMOTE    ] GDDY: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T18:55:30.937809] [INFO ] [REMOTE    ] GDIV: Incremental fetch complete for 2025-04 (0.39 seconds).
[2025-10-24T18:55:31.347676] [INFO ] [REMOTE    ] GCTS: Fetching primary data for 2025-09.
[2025-10-24T18:55:31.635855] [INFO ] [REMOTE    ] GD: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T18:55:32.147608] [INFO ] [REMOTE    ] GDIV: Fetching primary data for 2025-05.
[2025-10-24T18:55:32.535036] [INFO ] [REMOTE    ] GCTS: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T18:55:32.764485] [INFO ] [REMOTE    ] GDIV: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T18:55:32.947675] [INFO ] [REMOTE    ] GD: Fetching primary data for 2025-05.
[2025-10-24T18:55:33.747685] [INFO ] [REMOTE    ] GDDY: Fetching primary data for 2025-03.
[2025-10-24T18:55:34.547685] [INFO ] [REMOTE    ] GCTS: Fetching primary data for 2025-10.
[2025-10-24T18:55:34.680828] [INFO ] [REMOTE    ] GD: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T18:55:35.347633] [INFO ] [REMOTE    ] GD: Fetching primary data for 2025-06.
[2025-10-24T18:55:35.537798] [INFO ] [REMOTE    ] GDDY: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T18:55:35.699007] [INFO ] [REMOTE    ] GCTS: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T18:55:35.702876] [INFO ] [REMOTE    ] GCTS: Full fetch complete (26649 records).
[2025-10-24T18:55:35.702993] [DEBUG] [VALIDATOR ] GCTS: Validating primary data.
[2025-10-24T18:55:36.084566] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present.
[2025-10-24T18:55:36.084743] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed.
[2025-10-24T18:55:36.085334] [INFO ] [MAIN      ] GCTS: Fetched primary data is valid.
[2025-10-24T18:55:36.085376] [DEBUG] [LOCAL     ] GCTS: Saving primary data.
[2025-10-24T18:55:36.085721] [FATAL] [LOCAL     ] GCTS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:55:36.085822] [FATAL] [MAIN      ] GCTS: Failed to save primary data.
[2025-10-24T18:55:36.085901] [WARN ] [MAIN      ] GCTS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:55:36.085982] [INFO ] [LOCAL     ] GCTS: Starting deletion of primary data.
[2025-10-24T18:55:36.086052] [DEBUG] [LOCAL     ] GCTS: No primary data file found to delete.
[2025-10-24T18:55:36.086089] [INFO ] [LOCAL     ] GCTS: Starting deletion of derivative data.
[2025-10-24T18:55:36.086246] [DEBUG] [LOCAL     ] GCTS: Deleted derivative data file.
[2025-10-24T18:55:36.086337] [INFO ] [MAIN      ] Update Progress: 904/2366 symbols completed. GCTS took 36.2s. Estimated remaining: 3h 6m 53s. Rate: 7.8 symbols/min
[2025-10-24T18:55:36.152729] [INFO ] [REMOTE    ] GDIV: Fetching primary data for 2025-06.
[2025-10-24T18:55:36.262312] [INFO ] [MAIN      ] GDL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:55:36.262478] [DEBUG] [LOCAL     ] GDL: No existing data file found in primary storage.
[2025-10-24T18:55:36.262515] [WARN ] [MAIN      ] GDL: No existing data found, performing full refresh instead.
[2025-10-24T18:55:36.262667] [INFO ] [MAIN      ] GDL: Wiping existing primary data before full refresh.
[2025-10-24T18:55:36.262725] [INFO ] [LOCAL     ] GDL: Starting deletion of primary data.
[2025-10-24T18:55:36.262772] [DEBUG] [LOCAL     ] GDL: No primary data file found to delete.
[2025-10-24T18:55:36.262805] [INFO ] [MAIN      ] GDL: Starting full primary refresh.
[2025-10-24T18:55:36.613374] [INFO ] [REMOTE    ] GDL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:55:36.759235] [INFO ] [REMOTE    ] GDIV: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T18:55:36.947607] [INFO ] [REMOTE    ] GDDY: Fetching primary data for 2025-04.
[2025-10-24T18:55:37.213108] [INFO ] [REMOTE    ] GD: Incremental fetch complete for 2025-06 (1.87 seconds).
[2025-10-24T18:55:37.747717] [INFO ] [REMOTE    ] GD: Fetching primary data for 2025-07.
[2025-10-24T18:55:38.547708] [INFO ] [REMOTE    ] GDIV: Fetching primary data for 2025-07.
[2025-10-24T18:55:38.620719] [INFO ] [REMOTE    ] GDDY: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T18:55:39.102984] [INFO ] [REMOTE    ] GDIV: Incremental fetch complete for 2025-07 (0.56 seconds).
[2025-10-24T18:55:39.333166] [INFO ] [REMOTE    ] GD: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T18:55:39.347614] [INFO ] [REMOTE    ] GD: Fetching primary data for 2025-08.
[2025-10-24T18:55:40.147686] [INFO ] [REMOTE    ] GDIV: Fetching primary data for 2025-08.
[2025-10-24T18:55:40.622101] [INFO ] [REMOTE    ] GDIV: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T18:55:40.947746] [INFO ] [REMOTE    ] GDDY: Fetching primary data for 2025-05.
[2025-10-24T18:55:41.072089] [INFO ] [REMOTE    ] GD: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T18:55:41.747678] [INFO ] [REMOTE    ] GDIV: Fetching primary data for 2025-09.
[2025-10-24T18:55:42.220049] [INFO ] [REMOTE    ] GDIV: Incremental fetch complete for 2025-09 (0.47 seconds).
[2025-10-24T18:55:42.336082] [INFO ] [REMOTE    ] GDDY: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T18:55:42.547686] [INFO ] [REMOTE    ] GDIV: Fetching primary data for 2025-10.
[2025-10-24T18:55:43.102679] [INFO ] [REMOTE    ] GDIV: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T18:55:43.103778] [INFO ] [REMOTE    ] GDIV: Full fetch complete (5427 records).
[2025-10-24T18:55:43.103847] [DEBUG] [VALIDATOR ] GDIV: Validating primary data.
[2025-10-24T18:55:43.352953] [INFO ] [REMOTE    ] GD: Fetching primary data for 2025-09.
[2025-10-24T18:55:43.460283] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present.
[2025-10-24T18:55:43.460359] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed.
[2025-10-24T18:55:43.460529] [INFO ] [MAIN      ] GDIV: Fetched primary data is valid.
[2025-10-24T18:55:43.460571] [DEBUG] [LOCAL     ] GDIV: Saving primary data.
[2025-10-24T18:55:43.460817] [FATAL] [LOCAL     ] GDIV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:55:43.460917] [FATAL] [MAIN      ] GDIV: Failed to save primary data.
[2025-10-24T18:55:43.460987] [WARN ] [MAIN      ] GDIV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:55:43.461068] [INFO ] [LOCAL     ] GDIV: Starting deletion of primary data.
[2025-10-24T18:55:43.461140] [DEBUG] [LOCAL     ] GDIV: No primary data file found to delete.
[2025-10-24T18:55:43.461178] [INFO ] [LOCAL     ] GDIV: Starting deletion of derivative data.
[2025-10-24T18:55:43.461338] [DEBUG] [LOCAL     ] GDIV: Deleted derivative data file.
[2025-10-24T18:55:43.461429] [INFO ] [MAIN      ] Update Progress: 905/2366 symbols completed. GDIV took 19.5s. Estimated remaining: 3h 6m 45s. Rate: 7.8 symbols/min
[2025-10-24T18:55:43.632084] [INFO ] [MAIN      ] GDO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:55:43.639720] [DEBUG] [LOCAL     ] GDO: Loaded 5905 existing records from primary storage.
[2025-10-24T18:55:43.639907] [INFO ] [MAIN      ] GDO: Loaded 5905 existing records.
[2025-10-24T18:55:43.812155] [WARN ] [MAIN      ] GDO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:55:43.812358] [INFO ] [MAIN      ] GDO: Wiping existing primary data before full refresh.
[2025-10-24T18:55:43.812403] [INFO ] [LOCAL     ] GDO: Starting deletion of primary data.
[2025-10-24T18:55:43.812674] [DEBUG] [LOCAL     ] GDO: Deleted primary data file.
[2025-10-24T18:55:43.812732] [INFO ] [MAIN      ] GDO: Starting full primary refresh.
[2025-10-24T18:55:44.156063] [INFO ] [REMOTE    ] GDDY: Fetching primary data for 2025-06.
[2025-10-24T18:55:44.160458] [INFO ] [REMOTE    ] GDO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:55:44.947611] [INFO ] [REMOTE    ] GDO: Fetching primary data for 2025-01.
[2025-10-24T18:55:45.116744] [INFO ] [REMOTE    ] GD: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T18:55:45.460743] [INFO ] [REMOTE    ] GDO: Incremental fetch complete for 2025-01 (0.51 seconds).
[2025-10-24T18:55:45.747605] [INFO ] [REMOTE    ] GDO: Fetching primary data for 2025-02.
[2025-10-24T18:55:45.823016] [INFO ] [REMOTE    ] GDDY: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T18:55:46.327402] [INFO ] [REMOTE    ] GDO: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T18:55:46.547711] [INFO ] [REMOTE    ] GD: Fetching primary data for 2025-10.
[2025-10-24T18:55:47.347722] [INFO ] [REMOTE    ] GDDY: Fetching primary data for 2025-07.
[2025-10-24T18:55:48.147728] [INFO ] [REMOTE    ] GDO: Fetching primary data for 2025-03.
[2025-10-24T18:55:48.356932] [INFO ] [REMOTE    ] GD: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T18:55:48.365166] [INFO ] [REMOTE    ] GD: Full fetch complete (69634 records).
[2025-10-24T18:55:48.365284] [DEBUG] [VALIDATOR ] GD: Validating primary data.
[2025-10-24T18:55:48.751227] [DEBUG] [VALIDATOR ] GD: All expected trading days are present.
[2025-10-24T18:55:48.751329] [DEBUG] [VALIDATOR ] GD: Primary data validation passed.
[2025-10-24T18:55:48.752298] [INFO ] [MAIN      ] GD: Fetched primary data is valid.
[2025-10-24T18:55:48.752404] [DEBUG] [LOCAL     ] GD: Saving primary data.
[2025-10-24T18:55:48.753114] [FATAL] [LOCAL     ] GD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:55:48.753203] [FATAL] [MAIN      ] GD: Failed to save primary data.
[2025-10-24T18:55:48.753251] [WARN ] [MAIN      ] GD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:55:48.753316] [INFO ] [LOCAL     ] GD: Starting deletion of primary data.
[2025-10-24T18:55:48.753386] [DEBUG] [LOCAL     ] GD: No primary data file found to delete.
[2025-10-24T18:55:48.753424] [INFO ] [LOCAL     ] GD: Starting deletion of derivative data.
[2025-10-24T18:55:48.753554] [DEBUG] [LOCAL     ] GD: Deleted derivative data file.
[2025-10-24T18:55:48.753979] [INFO ] [MAIN      ] Update Progress: 906/2366 symbols completed. GD took 36.1s. Estimated remaining: 3h 6m 33s. Rate: 7.8 symbols/min
[2025-10-24T18:55:48.926003] [INFO ] [MAIN      ] GDOT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:55:48.931833] [INFO ] [REMOTE    ] GDO: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T18:55:48.950788] [INFO ] [REMOTE    ] GDO: Fetching primary data for 2025-04.
[2025-10-24T18:55:48.967408] [DEBUG] [LOCAL     ] GDOT: Loaded 37911 existing records from primary storage.
[2025-10-24T18:55:48.968097] [INFO ] [MAIN      ] GDOT: Loaded 37911 existing records.
[2025-10-24T18:55:49.175061] [WARN ] [MAIN      ] GDOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:55:49.175608] [INFO ] [MAIN      ] GDOT: Wiping existing primary data before full refresh.
[2025-10-24T18:55:49.177096] [INFO ] [REMOTE    ] GDDY: Incremental fetch complete for 2025-07 (1.83 seconds).
[2025-10-24T18:55:49.175703] [INFO ] [LOCAL     ] GDOT: Starting deletion of primary data.
[2025-10-24T18:55:49.187710] [DEBUG] [LOCAL     ] GDOT: Deleted primary data file.
[2025-10-24T18:55:49.187769] [INFO ] [MAIN      ] GDOT: Starting full primary refresh.
[2025-10-24T18:55:49.537226] [INFO ] [REMOTE    ] GDOT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:55:49.643886] [INFO ] [REMOTE    ] GDO: Incremental fetch complete for 2025-04 (0.69 seconds).
[2025-10-24T18:55:49.747625] [INFO ] [REMOTE    ] GDOT: Fetching primary data for 2025-01.
[2025-10-24T18:55:50.547724] [INFO ] [REMOTE    ] GDO: Fetching primary data for 2025-05.
[2025-10-24T18:55:50.972681] [INFO ] [REMOTE    ] GDOT: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T18:55:50.973517] [INFO ] [REMOTE    ] GDO: Incremental fetch complete for 2025-05 (0.43 seconds).
[2025-10-24T18:55:51.347725] [INFO ] [REMOTE    ] GDL: Fetching primary data for 2025-01.
[2025-10-24T18:55:51.916861] [INFO ] [REMOTE    ] GDL: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T18:55:52.147677] [INFO ] [REMOTE    ] GDL: Fetching primary data for 2025-02.
[2025-10-24T18:55:52.517611] [INFO ] [REMOTE    ] GDL: Incremental fetch complete for 2025-02 (0.37 seconds).
[2025-10-24T18:55:52.947694] [INFO ] [REMOTE    ] GDDY: Fetching primary data for 2025-08.
[2025-10-24T18:55:53.747722] [INFO ] [REMOTE    ] GDO: Fetching primary data for 2025-06.
[2025-10-24T18:55:54.380884] [INFO ] [REMOTE    ] GDO: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T18:55:54.547624] [INFO ] [REMOTE    ] GDL: Fetching primary data for 2025-03.
[2025-10-24T18:55:54.719909] [INFO ] [REMOTE    ] GDDY: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T18:55:55.043795] [INFO ] [REMOTE    ] GDL: Incremental fetch complete for 2025-03 (0.50 seconds).
[2025-10-24T18:55:55.347665] [INFO ] [REMOTE    ] GDO: Fetching primary data for 2025-07.
[2025-10-24T18:55:55.974620] [INFO ] [REMOTE    ] GDO: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T18:55:56.147667] [INFO ] [REMOTE    ] GDO: Fetching primary data for 2025-08.
[2025-10-24T18:55:56.851591] [INFO ] [REMOTE    ] GDO: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T18:55:56.947686] [INFO ] [REMOTE    ] GDDY: Fetching primary data for 2025-09.
[2025-10-24T18:55:57.747706] [INFO ] [REMOTE    ] GDO: Fetching primary data for 2025-09.
[2025-10-24T18:55:58.366111] [INFO ] [REMOTE    ] GDO: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T18:55:58.547623] [INFO ] [REMOTE    ] GDOT: Fetching primary data for 2025-02.
[2025-10-24T18:55:58.783597] [INFO ] [REMOTE    ] GDDY: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T18:55:59.347627] [INFO ] [REMOTE    ] GDO: Fetching primary data for 2025-10.
[2025-10-24T18:55:59.692561] [INFO ] [REMOTE    ] GDOT: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T18:55:59.968458] [INFO ] [REMOTE    ] GDO: Incremental fetch complete for 2025-10 (0.62 seconds).
[2025-10-24T18:55:59.969916] [INFO ] [REMOTE    ] GDO: Full fetch complete (8437 records).
[2025-10-24T18:55:59.969987] [DEBUG] [VALIDATOR ] GDO: Validating primary data.
[2025-10-24T18:56:00.148666] [INFO ] [REMOTE    ] GDL: Fetching primary data for 2025-04.
[2025-10-24T18:56:00.345511] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present.
[2025-10-24T18:56:00.345585] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed.
[2025-10-24T18:56:00.345823] [INFO ] [MAIN      ] GDO: Fetched primary data is valid.
[2025-10-24T18:56:00.345885] [DEBUG] [LOCAL     ] GDO: Saving primary data.
[2025-10-24T18:56:00.346084] [FATAL] [LOCAL     ] GDO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:56:00.346167] [FATAL] [MAIN      ] GDO: Failed to save primary data.
[2025-10-24T18:56:00.346211] [WARN ] [MAIN      ] GDO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:56:00.346249] [INFO ] [LOCAL     ] GDO: Starting deletion of primary data.
[2025-10-24T18:56:00.346325] [DEBUG] [LOCAL     ] GDO: No primary data file found to delete.
[2025-10-24T18:56:00.346382] [INFO ] [LOCAL     ] GDO: Starting deletion of derivative data.
[2025-10-24T18:56:00.346511] [DEBUG] [LOCAL     ] GDO: Deleted derivative data file.
[2025-10-24T18:56:00.346583] [INFO ] [MAIN      ] Update Progress: 907/2366 symbols completed. GDO took 16.9s. Estimated remaining: 3h 6m 32s. Rate: 7.8 symbols/min
[2025-10-24T18:56:00.528367] [INFO ] [MAIN      ] GDV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:56:00.547774] [DEBUG] [LOCAL     ] GDV: Loaded 19241 existing records from primary storage.
[2025-10-24T18:56:00.548004] [INFO ] [MAIN      ] GDV: Loaded 19241 existing records.
[2025-10-24T18:56:00.748526] [WARN ] [MAIN      ] GDV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:56:00.748809] [INFO ] [MAIN      ] GDV: Wiping existing primary data before full refresh.
[2025-10-24T18:56:00.748887] [INFO ] [LOCAL     ] GDV: Starting deletion of primary data.
[2025-10-24T18:56:00.749106] [DEBUG] [LOCAL     ] GDV: Deleted primary data file.
[2025-10-24T18:56:00.749168] [INFO ] [MAIN      ] GDV: Starting full primary refresh.
[2025-10-24T18:56:00.955214] [INFO ] [REMOTE    ] GDDY: Fetching primary data for 2025-10.
[2025-10-24T18:56:01.066152] [INFO ] [REMOTE    ] GDL: Incremental fetch complete for 2025-04 (0.92 seconds).
[2025-10-24T18:56:01.148404] [INFO ] [REMOTE    ] GDV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:56:01.747671] [INFO ] [REMOTE    ] GDL: Fetching primary data for 2025-05.
[2025-10-24T18:56:02.547692] [INFO ] [REMOTE    ] GDOT: Fetching primary data for 2025-03.
[2025-10-24T18:56:02.590892] [INFO ] [REMOTE    ] GDL: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T18:56:03.347676] [INFO ] [REMOTE    ] GDV: Fetching primary data for 2025-01.
[2025-10-24T18:56:03.681043] [INFO ] [REMOTE    ] GDDY: Incremental fetch complete for 2025-10 (2.73 seconds).
[2025-10-24T18:56:03.690136] [INFO ] [REMOTE    ] GDDY: Full fetch complete (72089 records).
[2025-10-24T18:56:03.690290] [DEBUG] [VALIDATOR ] GDDY: Validating primary data.
[2025-10-24T18:56:04.091003] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present.
[2025-10-24T18:56:04.091089] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed.
[2025-10-24T18:56:04.092103] [INFO ] [MAIN      ] GDDY: Fetched primary data is valid.
[2025-10-24T18:56:04.092175] [DEBUG] [LOCAL     ] GDDY: Saving primary data.
[2025-10-24T18:56:04.092846] [FATAL] [LOCAL     ] GDDY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:56:04.092950] [FATAL] [MAIN      ] GDDY: Failed to save primary data.
[2025-10-24T18:56:04.092994] [WARN ] [MAIN      ] GDDY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:56:04.093033] [INFO ] [LOCAL     ] GDDY: Starting deletion of primary data.
[2025-10-24T18:56:04.093092] [DEBUG] [LOCAL     ] GDDY: No primary data file found to delete.
[2025-10-24T18:56:04.093128] [INFO ] [LOCAL     ] GDDY: Starting deletion of derivative data.
[2025-10-24T18:56:04.093281] [DEBUG] [LOCAL     ] GDDY: Deleted derivative data file.
[2025-10-24T18:56:04.093929] [INFO ] [MAIN      ] Update Progress: 908/2366 symbols completed. GDDY took 44.2s. Estimated remaining: 3h 6m 18s. Rate: 7.8 symbols/min
[2025-10-24T18:56:04.153195] [INFO ] [REMOTE    ] GDL: Fetching primary data for 2025-06.
[2025-10-24T18:56:04.298229] [INFO ] [MAIN      ] GE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:56:04.351417] [DEBUG] [LOCAL     ] GE: Loaded 54083 existing records from primary storage.
[2025-10-24T18:56:04.351869] [INFO ] [MAIN      ] GE: Loaded 54083 existing records.
[2025-10-24T18:56:04.544019] [INFO ] [REMOTE    ] GDOT: Incremental fetch complete for 2025-03 (2.00 seconds).
[2025-10-24T18:56:04.567332] [WARN ] [MAIN      ] GE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:56:04.564170] [INFO ] [REMOTE    ] GDL: Incremental fetch complete for 2025-06 (0.41 seconds).
[2025-10-24T18:56:04.591240] [INFO ] [REMOTE    ] GDV: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T18:56:04.591465] [INFO ] [MAIN      ] GE: Wiping existing primary data before full refresh.
[2025-10-24T18:56:04.596779] [INFO ] [LOCAL     ] GE: Starting deletion of primary data.
[2025-10-24T18:56:04.597045] [DEBUG] [LOCAL     ] GE: Deleted primary data file.
[2025-10-24T18:56:04.597104] [INFO ] [MAIN      ] GE: Starting full primary refresh.
[2025-10-24T18:56:04.945795] [INFO ] [REMOTE    ] GE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:56:04.947599] [INFO ] [REMOTE    ] GE: Fetching primary data for 2025-01.
[2025-10-24T18:56:05.747671] [INFO ] [REMOTE    ] GDOT: Fetching primary data for 2025-04.
[2025-10-24T18:56:06.547722] [INFO ] [REMOTE    ] GDV: Fetching primary data for 2025-02.
[2025-10-24T18:56:07.124808] [INFO ] [REMOTE    ] GE: Incremental fetch complete for 2025-01 (2.18 seconds).
[2025-10-24T18:56:07.244568] [INFO ] [REMOTE    ] GDOT: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T18:56:07.347622] [INFO ] [REMOTE    ] GDOT: Fetching primary data for 2025-05.
[2025-10-24T18:56:07.546593] [INFO ] [REMOTE    ] GDV: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T18:56:08.147667] [INFO ] [REMOTE    ] GE: Fetching primary data for 2025-02.
[2025-10-24T18:56:08.775374] [INFO ] [REMOTE    ] GDOT: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T18:56:08.947714] [INFO ] [REMOTE    ] GDOT: Fetching primary data for 2025-06.
[2025-10-24T18:56:09.747675] [INFO ] [REMOTE    ] GDV: Fetching primary data for 2025-03.
[2025-10-24T18:56:10.186842] [INFO ] [REMOTE    ] GE: Incremental fetch complete for 2025-02 (2.04 seconds).
[2025-10-24T18:56:10.326103] [INFO ] [REMOTE    ] GDOT: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T18:56:10.459877] [INFO ] [REMOTE    ] GDV: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T18:56:10.547710] [INFO ] [REMOTE    ] GDL: Fetching primary data for 2025-07.
[2025-10-24T18:56:11.027817] [INFO ] [REMOTE    ] GDL: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T18:56:11.347667] [INFO ] [REMOTE    ] GDL: Fetching primary data for 2025-08.
[2025-10-24T18:56:11.874799] [INFO ] [REMOTE    ] GDL: Incremental fetch complete for 2025-08 (0.53 seconds).
[2025-10-24T18:56:12.147621] [INFO ] [REMOTE    ] GDV: Fetching primary data for 2025-04.
[2025-10-24T18:56:12.947616] [INFO ] [REMOTE    ] GE: Fetching primary data for 2025-03.
[2025-10-24T18:56:13.276838] [INFO ] [REMOTE    ] GDV: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T18:56:13.747667] [INFO ] [REMOTE    ] GDV: Fetching primary data for 2025-05.
[2025-10-24T18:56:14.547618] [INFO ] [REMOTE    ] GDL: Fetching primary data for 2025-09.
[2025-10-24T18:56:14.644935] [INFO ] [REMOTE    ] GE: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T18:56:14.779999] [INFO ] [REMOTE    ] GDV: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T18:56:15.126956] [INFO ] [REMOTE    ] GDL: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T18:56:15.347634] [INFO ] [REMOTE    ] GDL: Fetching primary data for 2025-10.
[2025-10-24T18:56:15.937402] [INFO ] [REMOTE    ] GDL: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T18:56:15.938444] [INFO ] [REMOTE    ] GDL: Full fetch complete (3444 records).
[2025-10-24T18:56:15.938515] [DEBUG] [VALIDATOR ] GDL: Validating primary data.
[2025-10-24T18:56:16.151584] [INFO ] [REMOTE    ] GDV: Fetching primary data for 2025-06.
[2025-10-24T18:56:16.448819] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present.
[2025-10-24T18:56:16.448973] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed.
[2025-10-24T18:56:16.449150] [INFO ] [MAIN      ] GDL: Fetched primary data is valid.
[2025-10-24T18:56:16.449197] [DEBUG] [LOCAL     ] GDL: Saving primary data.
[2025-10-24T18:56:16.449543] [FATAL] [LOCAL     ] GDL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:56:16.449699] [FATAL] [MAIN      ] GDL: Failed to save primary data.
[2025-10-24T18:56:16.449748] [WARN ] [MAIN      ] GDL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:56:16.449824] [INFO ] [LOCAL     ] GDL: Starting deletion of primary data.
[2025-10-24T18:56:16.449897] [DEBUG] [LOCAL     ] GDL: No primary data file found to delete.
[2025-10-24T18:56:16.449934] [INFO ] [LOCAL     ] GDL: Starting deletion of derivative data.
[2025-10-24T18:56:16.449974] [DEBUG] [LOCAL     ] GDL: No derivative data file found to delete.
[2025-10-24T18:56:16.450036] [INFO ] [MAIN      ] Update Progress: 909/2366 symbols completed. GDL took 40.4s. Estimated remaining: 3h 6m 18s. Rate: 7.8 symbols/min
[2025-10-24T18:56:16.692270] [INFO ] [MAIN      ] GEF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:56:16.716347] [DEBUG] [LOCAL     ] GEF: Loaded 20824 existing records from primary storage.
[2025-10-24T18:56:16.716689] [INFO ] [MAIN      ] GEF: Loaded 20824 existing records.
[2025-10-24T18:56:16.915221] [WARN ] [MAIN      ] GEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:56:16.915469] [INFO ] [MAIN      ] GEF: Wiping existing primary data before full refresh.
[2025-10-24T18:56:16.915519] [INFO ] [LOCAL     ] GEF: Starting deletion of primary data.
[2025-10-24T18:56:16.915800] [DEBUG] [LOCAL     ] GEF: Deleted primary data file.
[2025-10-24T18:56:16.915860] [INFO ] [MAIN      ] GEF: Starting full primary refresh.
[2025-10-24T18:56:16.952890] [INFO ] [REMOTE    ] GE: Fetching primary data for 2025-04.
[2025-10-24T18:56:17.284001] [INFO ] [REMOTE    ] GDV: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T18:56:17.332071] [INFO ] [REMOTE    ] GEF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:56:17.747719] [INFO ] [REMOTE    ] GDV: Fetching primary data for 2025-07.
[2025-10-24T18:56:18.547690] [INFO ] [REMOTE    ] GEF: Fetching primary data for 2025-01.
[2025-10-24T18:56:18.815248] [INFO ] [REMOTE    ] GDV: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T18:56:19.241870] [INFO ] [REMOTE    ] GE: Incremental fetch complete for 2025-04 (2.29 seconds).
[2025-10-24T18:56:19.347743] [INFO ] [REMOTE    ] GE: Fetching primary data for 2025-05.
[2025-10-24T18:56:19.580236] [INFO ] [REMOTE    ] GEF: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T18:56:20.147727] [INFO ] [REMOTE    ] GDV: Fetching primary data for 2025-08.
[2025-10-24T18:56:20.947717] [INFO ] [REMOTE    ] GDOT: Fetching primary data for 2025-07.
[2025-10-24T18:56:21.204202] [INFO ] [REMOTE    ] GDV: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T18:56:21.575629] [INFO ] [REMOTE    ] GE: Incremental fetch complete for 2025-05 (2.23 seconds).
[2025-10-24T18:56:21.747707] [INFO ] [REMOTE    ] GEF: Fetching primary data for 2025-02.
[2025-10-24T18:56:22.470957] [INFO ] [REMOTE    ] GDOT: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T18:56:22.547603] [INFO ] [REMOTE    ] GDOT: Fetching primary data for 2025-08.
[2025-10-24T18:56:22.749313] [INFO ] [REMOTE    ] GEF: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T18:56:23.347638] [INFO ] [REMOTE    ] GEF: Fetching primary data for 2025-03.
[2025-10-24T18:56:24.014084] [INFO ] [REMOTE    ] GDOT: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T18:56:24.147625] [INFO ] [REMOTE    ] GE: Fetching primary data for 2025-06.
[2025-10-24T18:56:24.519276] [INFO ] [REMOTE    ] GEF: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T18:56:24.947683] [INFO ] [REMOTE    ] GDV: Fetching primary data for 2025-09.
[2025-10-24T18:56:25.747671] [INFO ] [REMOTE    ] GEF: Fetching primary data for 2025-04.
[2025-10-24T18:56:25.951446] [INFO ] [REMOTE    ] GDV: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T18:56:26.133618] [INFO ] [REMOTE    ] GE: Incremental fetch complete for 2025-06 (1.99 seconds).
[2025-10-24T18:56:26.547671] [INFO ] [REMOTE    ] GDV: Fetching primary data for 2025-10.
[2025-10-24T18:56:26.875062] [INFO ] [REMOTE    ] GEF: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T18:56:27.347683] [INFO ] [REMOTE    ] GE: Fetching primary data for 2025-07.
[2025-10-24T18:56:27.745363] [INFO ] [REMOTE    ] GDV: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T18:56:27.748900] [INFO ] [REMOTE    ] GDV: Full fetch complete (28167 records).
[2025-10-24T18:56:27.748974] [DEBUG] [VALIDATOR ] GDV: Validating primary data.
[2025-10-24T18:56:28.124873] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present.
[2025-10-24T18:56:28.124972] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed.
[2025-10-24T18:56:28.125515] [INFO ] [MAIN      ] GDV: Fetched primary data is valid.
[2025-10-24T18:56:28.125557] [DEBUG] [LOCAL     ] GDV: Saving primary data.
[2025-10-24T18:56:28.125924] [FATAL] [LOCAL     ] GDV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:56:28.125986] [FATAL] [MAIN      ] GDV: Failed to save primary data.
[2025-10-24T18:56:28.126023] [WARN ] [MAIN      ] GDV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:56:28.126058] [INFO ] [LOCAL     ] GDV: Starting deletion of primary data.
[2025-10-24T18:56:28.126109] [DEBUG] [LOCAL     ] GDV: No primary data file found to delete.
[2025-10-24T18:56:28.126144] [INFO ] [LOCAL     ] GDV: Starting deletion of derivative data.
[2025-10-24T18:56:28.126323] [DEBUG] [LOCAL     ] GDV: Deleted derivative data file.
[2025-10-24T18:56:28.126409] [INFO ] [MAIN      ] Update Progress: 910/2366 symbols completed. GDV took 27.8s. Estimated remaining: 3h 6m 16s. Rate: 7.8 symbols/min
[2025-10-24T18:56:28.156308] [INFO ] [REMOTE    ] GEF: Fetching primary data for 2025-05.
[2025-10-24T18:56:28.298829] [INFO ] [MAIN      ] GEL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:56:28.330271] [DEBUG] [LOCAL     ] GEL: Loaded 31358 existing records from primary storage.
[2025-10-24T18:56:28.330534] [INFO ] [MAIN      ] GEL: Loaded 31358 existing records.
[2025-10-24T18:56:28.506493] [WARN ] [MAIN      ] GEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:56:28.506724] [INFO ] [MAIN      ] GEL: Wiping existing primary data before full refresh.
[2025-10-24T18:56:28.506779] [INFO ] [LOCAL     ] GEL: Starting deletion of primary data.
[2025-10-24T18:56:28.507385] [DEBUG] [LOCAL     ] GEL: Deleted primary data file.
[2025-10-24T18:56:28.507445] [INFO ] [MAIN      ] GEL: Starting full primary refresh.
[2025-10-24T18:56:28.857734] [INFO ] [REMOTE    ] GEL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:56:28.947616] [INFO ] [REMOTE    ] GDOT: Fetching primary data for 2025-09.
[2025-10-24T18:56:29.220503] [INFO ] [REMOTE    ] GEF: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T18:56:29.651783] [INFO ] [REMOTE    ] GE: Incremental fetch complete for 2025-07 (2.30 seconds).
[2025-10-24T18:56:29.747637] [INFO ] [REMOTE    ] GE: Fetching primary data for 2025-08.
[2025-10-24T18:56:30.378790] [INFO ] [REMOTE    ] GDOT: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T18:56:30.547699] [INFO ] [REMOTE    ] GDOT: Fetching primary data for 2025-10.
[2025-10-24T18:56:31.347628] [INFO ] [REMOTE    ] GEL: Fetching primary data for 2025-01.
[2025-10-24T18:56:32.074963] [INFO ] [REMOTE    ] GE: Incremental fetch complete for 2025-08 (2.33 seconds).
[2025-10-24T18:56:32.147608] [INFO ] [REMOTE    ] GE: Fetching primary data for 2025-09.
[2025-10-24T18:56:32.175684] [INFO ] [REMOTE    ] GDOT: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T18:56:32.183016] [INFO ] [REMOTE    ] GDOT: Full fetch complete (53729 records).
[2025-10-24T18:56:32.183145] [DEBUG] [VALIDATOR ] GDOT: Validating primary data.
[2025-10-24T18:56:32.565621] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present.
[2025-10-24T18:56:32.565743] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed.
[2025-10-24T18:56:32.566509] [INFO ] [MAIN      ] GDOT: Fetched primary data is valid.
[2025-10-24T18:56:32.566569] [DEBUG] [LOCAL     ] GDOT: Saving primary data.
[2025-10-24T18:56:32.567051] [FATAL] [LOCAL     ] GDOT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:56:32.567159] [FATAL] [MAIN      ] GDOT: Failed to save primary data.
[2025-10-24T18:56:32.567222] [WARN ] [MAIN      ] GDOT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:56:32.567259] [INFO ] [LOCAL     ] GDOT: Starting deletion of primary data.
[2025-10-24T18:56:32.567310] [DEBUG] [LOCAL     ] GDOT: No primary data file found to delete.
[2025-10-24T18:56:32.567345] [INFO ] [LOCAL     ] GDOT: Starting deletion of derivative data.
[2025-10-24T18:56:32.567503] [DEBUG] [LOCAL     ] GDOT: Deleted derivative data file.
[2025-10-24T18:56:32.567591] [INFO ] [MAIN      ] Update Progress: 911/2366 symbols completed. GDOT took 43.8s. Estimated remaining: 3h 6m 4s. Rate: 7.8 symbols/min
[2025-10-24T18:56:32.736936] [INFO ] [MAIN      ] GENI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:56:32.787191] [DEBUG] [LOCAL     ] GENI: Loaded 53310 existing records from primary storage.
[2025-10-24T18:56:32.787493] [INFO ] [MAIN      ] GENI: Loaded 53310 existing records.
[2025-10-24T18:56:32.950891] [INFO ] [REMOTE    ] GEF: Fetching primary data for 2025-06.
[2025-10-24T18:56:32.952719] [INFO ] [REMOTE    ] GEL: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T18:56:32.995639] [WARN ] [MAIN      ] GENI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:56:32.995864] [INFO ] [MAIN      ] GENI: Wiping existing primary data before full refresh.
[2025-10-24T18:56:32.995911] [INFO ] [LOCAL     ] GENI: Starting deletion of primary data.
[2025-10-24T18:56:32.996426] [DEBUG] [LOCAL     ] GENI: Deleted primary data file.
[2025-10-24T18:56:32.996465] [INFO ] [MAIN      ] GENI: Starting full primary refresh.
[2025-10-24T18:56:33.346095] [INFO ] [REMOTE    ] GENI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:56:33.747675] [INFO ] [REMOTE    ] GEL: Fetching primary data for 2025-02.
[2025-10-24T18:56:34.243736] [INFO ] [REMOTE    ] GEF: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T18:56:34.393138] [INFO ] [REMOTE    ] GE: Incremental fetch complete for 2025-09 (2.25 seconds).
[2025-10-24T18:56:34.547681] [INFO ] [REMOTE    ] GE: Fetching primary data for 2025-10.
[2025-10-24T18:56:35.120027] [INFO ] [REMOTE    ] GEL: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T18:56:35.347694] [INFO ] [REMOTE    ] GEF: Fetching primary data for 2025-07.
[2025-10-24T18:56:36.147720] [INFO ] [REMOTE    ] GENI: Fetching primary data for 2025-01.
[2025-10-24T18:56:36.463977] [INFO ] [REMOTE    ] GEF: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T18:56:36.875165] [INFO ] [REMOTE    ] GE: Incremental fetch complete for 2025-10 (2.33 seconds).
[2025-10-24T18:56:36.885108] [INFO ] [REMOTE    ] GE: Full fetch complete (77861 records).
[2025-10-24T18:56:36.885239] [DEBUG] [VALIDATOR ] GE: Validating primary data.
[2025-10-24T18:56:36.952776] [INFO ] [REMOTE    ] GEL: Fetching primary data for 2025-03.
[2025-10-24T18:56:37.296973] [DEBUG] [VALIDATOR ] GE: All expected trading days are present.
[2025-10-24T18:56:37.297060] [DEBUG] [VALIDATOR ] GE: Primary data validation passed.
[2025-10-24T18:56:37.298132] [INFO ] [MAIN      ] GE: Fetched primary data is valid.
[2025-10-24T18:56:37.298209] [DEBUG] [LOCAL     ] GE: Saving primary data.
[2025-10-24T18:56:37.298906] [FATAL] [LOCAL     ] GE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:56:37.299009] [FATAL] [MAIN      ] GE: Failed to save primary data.
[2025-10-24T18:56:37.299090] [WARN ] [MAIN      ] GE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:56:37.299160] [INFO ] [LOCAL     ] GE: Starting deletion of primary data.
[2025-10-24T18:56:37.299223] [DEBUG] [LOCAL     ] GE: No primary data file found to delete.
[2025-10-24T18:56:37.299258] [INFO ] [LOCAL     ] GE: Starting deletion of derivative data.
[2025-10-24T18:56:37.299612] [DEBUG] [LOCAL     ] GE: Deleted derivative data file.
[2025-10-24T18:56:37.300231] [INFO ] [MAIN      ] Update Progress: 912/2366 symbols completed. GE took 33.2s. Estimated remaining: 3h 5m 51s. Rate: 7.8 symbols/min
[2025-10-24T18:56:37.479994] [INFO ] [MAIN      ] GEO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:56:37.512505] [INFO ] [REMOTE    ] GENI: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T18:56:37.565486] [DEBUG] [LOCAL     ] GEO: Loaded 52037 existing records from primary storage.
[2025-10-24T18:56:37.565815] [INFO ] [MAIN      ] GEO: Loaded 52037 existing records.
[2025-10-24T18:56:37.742945] [WARN ] [MAIN      ] GEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:56:37.743165] [INFO ] [MAIN      ] GEO: Wiping existing primary data before full refresh.
[2025-10-24T18:56:37.743212] [INFO ] [LOCAL     ] GEO: Starting deletion of primary data.
[2025-10-24T18:56:37.744160] [DEBUG] [LOCAL     ] GEO: Deleted primary data file.
[2025-10-24T18:56:37.744217] [INFO ] [MAIN      ] GEO: Starting full primary refresh.
[2025-10-24T18:56:37.755358] [INFO ] [REMOTE    ] GEF: Fetching primary data for 2025-08.
[2025-10-24T18:56:38.131554] [INFO ] [REMOTE    ] GEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:56:38.436789] [INFO ] [REMOTE    ] GEL: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T18:56:38.547678] [INFO ] [REMOTE    ] GEL: Fetching primary data for 2025-04.
[2025-10-24T18:56:38.863130] [INFO ] [REMOTE    ] GEF: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T18:56:39.347636] [INFO ] [REMOTE    ] GENI: Fetching primary data for 2025-02.
[2025-10-24T18:56:39.892827] [INFO ] [REMOTE    ] GEL: Incremental fetch complete for 2025-04 (1.35 seconds).
[2025-10-24T18:56:40.147679] [INFO ] [REMOTE    ] GEO: Fetching primary data for 2025-01.
[2025-10-24T18:56:40.836521] [INFO ] [REMOTE    ] GENI: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T18:56:40.947612] [INFO ] [REMOTE    ] GENI: Fetching primary data for 2025-03.
[2025-10-24T18:56:41.747623] [INFO ] [REMOTE    ] GEF: Fetching primary data for 2025-09.
[2025-10-24T18:56:42.096849] [INFO ] [REMOTE    ] GEO: Incremental fetch complete for 2025-01 (1.95 seconds).
[2025-10-24T18:56:42.547631] [INFO ] [REMOTE    ] GEL: Fetching primary data for 2025-05.
[2025-10-24T18:56:42.738983] [INFO ] [REMOTE    ] GENI: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T18:56:42.778255] [INFO ] [REMOTE    ] GEF: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T18:56:43.347684] [INFO ] [REMOTE    ] GEF: Fetching primary data for 2025-10.
[2025-10-24T18:56:43.539099] [INFO ] [REMOTE    ] GEL: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T18:56:44.147610] [INFO ] [REMOTE    ] GENI: Fetching primary data for 2025-04.
[2025-10-24T18:56:44.223033] [INFO ] [REMOTE    ] GEF: Incremental fetch complete for 2025-10 (0.88 seconds).
[2025-10-24T18:56:44.227275] [INFO ] [REMOTE    ] GEF: Full fetch complete (29280 records).
[2025-10-24T18:56:44.227385] [DEBUG] [VALIDATOR ] GEF: Validating primary data.
[2025-10-24T18:56:44.642856] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present.
[2025-10-24T18:56:44.642962] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed.
[2025-10-24T18:56:44.643624] [INFO ] [MAIN      ] GEF: Fetched primary data is valid.
[2025-10-24T18:56:44.643711] [DEBUG] [LOCAL     ] GEF: Saving primary data.
[2025-10-24T18:56:44.644152] [FATAL] [LOCAL     ] GEF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:56:44.644243] [FATAL] [MAIN      ] GEF: Failed to save primary data.
[2025-10-24T18:56:44.644289] [WARN ] [MAIN      ] GEF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:56:44.644327] [INFO ] [LOCAL     ] GEF: Starting deletion of primary data.
[2025-10-24T18:56:44.644381] [DEBUG] [LOCAL     ] GEF: No primary data file found to delete.
[2025-10-24T18:56:44.644425] [INFO ] [LOCAL     ] GEF: Starting deletion of derivative data.
[2025-10-24T18:56:44.644580] [DEBUG] [LOCAL     ] GEF: Deleted derivative data file.
[2025-10-24T18:56:44.644686] [INFO ] [MAIN      ] Update Progress: 913/2366 symbols completed. GEF took 28.2s. Estimated remaining: 3h 5m 43s. Rate: 7.8 symbols/min
[2025-10-24T18:56:44.838290] [INFO ] [MAIN      ] GES: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:56:44.876522] [DEBUG] [LOCAL     ] GES: Loaded 38089 existing records from primary storage.
[2025-10-24T18:56:44.876878] [INFO ] [MAIN      ] GES: Loaded 38089 existing records.
[2025-10-24T18:56:44.952774] [INFO ] [REMOTE    ] GEO: Fetching primary data for 2025-02.
[2025-10-24T18:56:45.070972] [WARN ] [MAIN      ] GES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:56:45.071179] [INFO ] [MAIN      ] GES: Wiping existing primary data before full refresh.
[2025-10-24T18:56:45.071224] [INFO ] [LOCAL     ] GES: Starting deletion of primary data.
[2025-10-24T18:56:45.071987] [DEBUG] [LOCAL     ] GES: Deleted primary data file.
[2025-10-24T18:56:45.072044] [INFO ] [MAIN      ] GES: Starting full primary refresh.
[2025-10-24T18:56:45.440958] [INFO ] [REMOTE    ] GES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:56:45.747628] [INFO ] [REMOTE    ] GEL: Fetching primary data for 2025-06.
[2025-10-24T18:56:45.825400] [INFO ] [REMOTE    ] GENI: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T18:56:46.547677] [INFO ] [REMOTE    ] GES: Fetching primary data for 2025-01.
[2025-10-24T18:56:46.707108] [INFO ] [REMOTE    ] GEO: Incremental fetch complete for 2025-02 (1.75 seconds).
[2025-10-24T18:56:47.176371] [INFO ] [REMOTE    ] GEL: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T18:56:47.347633] [INFO ] [REMOTE    ] GENI: Fetching primary data for 2025-05.
[2025-10-24T18:56:47.801743] [INFO ] [REMOTE    ] GES: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T18:56:48.147675] [INFO ] [REMOTE    ] GEL: Fetching primary data for 2025-07.
[2025-10-24T18:56:48.874012] [INFO ] [REMOTE    ] GENI: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T18:56:48.947676] [INFO ] [REMOTE    ] GENI: Fetching primary data for 2025-06.
[2025-10-24T18:56:49.613364] [INFO ] [REMOTE    ] GEL: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T18:56:49.747673] [INFO ] [REMOTE    ] GEO: Fetching primary data for 2025-03.
[2025-10-24T18:56:50.547682] [INFO ] [REMOTE    ] GES: Fetching primary data for 2025-02.
[2025-10-24T18:56:50.625705] [INFO ] [REMOTE    ] GENI: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T18:56:51.185541] [INFO ] [REMOTE    ] GEO: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T18:56:51.347622] [INFO ] [REMOTE    ] GEO: Fetching primary data for 2025-04.
[2025-10-24T18:56:52.037269] [INFO ] [REMOTE    ] GES: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T18:56:52.147638] [INFO ] [REMOTE    ] GES: Fetching primary data for 2025-03.
[2025-10-24T18:56:52.947627] [INFO ] [REMOTE    ] GEL: Fetching primary data for 2025-08.
[2025-10-24T18:56:53.246030] [INFO ] [REMOTE    ] GEO: Incremental fetch complete for 2025-04 (1.90 seconds).
[2025-10-24T18:56:53.479297] [INFO ] [REMOTE    ] GES: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T18:56:53.747710] [INFO ] [REMOTE    ] GEO: Fetching primary data for 2025-05.
[2025-10-24T18:56:54.407196] [INFO ] [REMOTE    ] GEL: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T18:56:54.547627] [INFO ] [REMOTE    ] GEL: Fetching primary data for 2025-09.
[2025-10-24T18:56:55.347722] [INFO ] [REMOTE    ] GES: Fetching primary data for 2025-04.
[2025-10-24T18:56:55.565801] [INFO ] [REMOTE    ] GEO: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T18:56:55.641855] [INFO ] [REMOTE    ] GEL: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T18:56:56.147638] [INFO ] [REMOTE    ] GEO: Fetching primary data for 2025-06.
[2025-10-24T18:56:56.947625] [INFO ] [REMOTE    ] GENI: Fetching primary data for 2025-07.
[2025-10-24T18:56:57.392852] [INFO ] [REMOTE    ] GES: Incremental fetch complete for 2025-04 (2.05 seconds).
[2025-10-24T18:56:57.747677] [INFO ] [REMOTE    ] GEL: Fetching primary data for 2025-10.
[2025-10-24T18:56:58.036193] [INFO ] [REMOTE    ] GEO: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T18:56:58.547633] [INFO ] [REMOTE    ] GES: Fetching primary data for 2025-05.
[2025-10-24T18:56:58.820802] [INFO ] [REMOTE    ] GENI: Incremental fetch complete for 2025-07 (1.87 seconds).
[2025-10-24T18:56:58.862859] [INFO ] [REMOTE    ] GEL: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T18:56:58.867188] [INFO ] [REMOTE    ] GEL: Full fetch complete (47802 records).
[2025-10-24T18:56:58.867296] [DEBUG] [VALIDATOR ] GEL: Validating primary data.
[2025-10-24T18:56:59.240633] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present.
[2025-10-24T18:56:59.240762] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed.
[2025-10-24T18:56:59.241706] [INFO ] [MAIN      ] GEL: Fetched primary data is valid.
[2025-10-24T18:56:59.241779] [DEBUG] [LOCAL     ] GEL: Saving primary data.
[2025-10-24T18:56:59.242414] [FATAL] [LOCAL     ] GEL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:56:59.242501] [FATAL] [MAIN      ] GEL: Failed to save primary data.
[2025-10-24T18:56:59.242568] [WARN ] [MAIN      ] GEL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:56:59.242636] [INFO ] [LOCAL     ] GEL: Starting deletion of primary data.
[2025-10-24T18:56:59.242751] [DEBUG] [LOCAL     ] GEL: No primary data file found to delete.
[2025-10-24T18:56:59.242799] [INFO ] [LOCAL     ] GEL: Starting deletion of derivative data.
[2025-10-24T18:56:59.242957] [DEBUG] [LOCAL     ] GEL: Deleted derivative data file.
[2025-10-24T18:56:59.243048] [INFO ] [MAIN      ] Update Progress: 914/2366 symbols completed. GEL took 31.1s. Estimated remaining: 3h 5m 46s. Rate: 7.8 symbols/min
[2025-10-24T18:56:59.352746] [INFO ] [REMOTE    ] GENI: Fetching primary data for 2025-08.
[2025-10-24T18:56:59.411471] [INFO ] [MAIN      ] GETY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:56:59.444199] [DEBUG] [LOCAL     ] GETY: Loaded 35534 existing records from primary storage.
[2025-10-24T18:56:59.444474] [INFO ] [MAIN      ] GETY: Loaded 35534 existing records.
[2025-10-24T18:56:59.618103] [WARN ] [MAIN      ] GETY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:56:59.618283] [INFO ] [MAIN      ] GETY: Wiping existing primary data before full refresh.
[2025-10-24T18:56:59.618330] [INFO ] [LOCAL     ] GETY: Starting deletion of primary data.
[2025-10-24T18:56:59.619135] [DEBUG] [LOCAL     ] GETY: Deleted primary data file.
[2025-10-24T18:56:59.619192] [INFO ] [MAIN      ] GETY: Starting full primary refresh.
[2025-10-24T18:56:59.968481] [INFO ] [REMOTE    ] GETY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:57:00.132822] [INFO ] [REMOTE    ] GES: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T18:57:00.147606] [INFO ] [REMOTE    ] GES: Fetching primary data for 2025-06.
[2025-10-24T18:57:00.947674] [INFO ] [REMOTE    ] GEO: Fetching primary data for 2025-07.
[2025-10-24T18:57:01.748470] [INFO ] [REMOTE    ] GETY: Fetching primary data for 2025-01.
[2025-10-24T18:57:01.779427] [INFO ] [REMOTE    ] GENI: Incremental fetch complete for 2025-08 (2.43 seconds).
[2025-10-24T18:57:02.238034] [INFO ] [REMOTE    ] GES: Incremental fetch complete for 2025-06 (2.09 seconds).
[2025-10-24T18:57:02.547679] [INFO ] [REMOTE    ] GENI: Fetching primary data for 2025-09.
[2025-10-24T18:57:03.347703] [INFO ] [REMOTE    ] GES: Fetching primary data for 2025-07.
[2025-10-24T18:57:04.674055] [INFO ] [REMOTE    ] GETY: Incremental fetch complete for 2025-01 (2.93 seconds).
[2025-10-24T18:57:04.684085] [INFO ] [REMOTE    ] GETY: Fetching primary data for 2025-02.
[2025-10-24T18:57:04.823069] [INFO ] [REMOTE    ] GEO: Incremental fetch complete for 2025-07 (3.88 seconds).
[2025-10-24T18:57:04.947638] [INFO ] [REMOTE    ] GEO: Fetching primary data for 2025-08.
[2025-10-24T18:57:05.275681] [INFO ] [REMOTE    ] GES: Incremental fetch complete for 2025-07 (1.93 seconds).
[2025-10-24T18:57:05.620359] [INFO ] [REMOTE    ] GENI: Incremental fetch complete for 2025-09 (3.07 seconds).
[2025-10-24T18:57:05.747686] [INFO ] [REMOTE    ] GENI: Fetching primary data for 2025-10.
[2025-10-24T18:57:06.313733] [INFO ] [REMOTE    ] GETY: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T18:57:06.547671] [INFO ] [REMOTE    ] GETY: Fetching primary data for 2025-03.
[2025-10-24T18:57:06.758101] [INFO ] [REMOTE    ] GEO: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T18:57:07.347621] [INFO ] [REMOTE    ] GEO: Fetching primary data for 2025-09.
[2025-10-24T18:57:07.462786] [DEBUG] [REMOTE    ] GEO: Error fetching primary data for 2025-09: 'API call returned an empty response.'
[2025-10-24T18:57:07.463109] [WARN ] [REMOTE    ] GEO: No data returned for month 2025-09
[2025-10-24T18:57:07.463229] [FATAL] [REMOTE    ] GEO: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T18:57:07.463340] [FATAL] [MAIN      ] GEO: Failed to fetch primary data.
[2025-10-24T18:57:07.463411] [WARN ] [MAIN      ] GEO: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T18:57:07.463459] [INFO ] [LOCAL     ] GEO: Starting deletion of primary data.
[2025-10-24T18:57:07.463515] [DEBUG] [LOCAL     ] GEO: No primary data file found to delete.
[2025-10-24T18:57:07.463550] [INFO ] [LOCAL     ] GEO: Starting deletion of derivative data.
[2025-10-24T18:57:07.463717] [DEBUG] [LOCAL     ] GEO: Deleted derivative data file.
[2025-10-24T18:57:07.464182] [INFO ] [MAIN      ] Update Progress: 915/2366 symbols completed. GEO took 30.2s. Estimated remaining: 3h 5m 40s. Rate: 7.8 symbols/min
[2025-10-24T18:57:07.639061] [INFO ] [MAIN      ] GEV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:57:07.666544] [INFO ] [REMOTE    ] GENI: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T18:57:07.677208] [INFO ] [REMOTE    ] GENI: Full fetch complete (76060 records).
[2025-10-24T18:57:07.677489] [DEBUG] [VALIDATOR ] GENI: Validating primary data.
[2025-10-24T18:57:08.025374] [DEBUG] [LOCAL     ] GEV: Loaded 53379 existing records from primary storage.
[2025-10-24T18:57:08.029923] [INFO ] [MAIN      ] GEV: Loaded 53379 existing records.
[2025-10-24T18:57:08.159933] [INFO ] [REMOTE    ] GES: Fetching primary data for 2025-08.
[2025-10-24T18:57:08.232795] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present.
[2025-10-24T18:57:08.233167] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed.
[2025-10-24T18:57:08.239591] [INFO ] [MAIN      ] GENI: Fetched primary data is valid.
[2025-10-24T18:57:08.334159] [WARN ] [MAIN      ] GEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:57:08.311635] [DEBUG] [LOCAL     ] GENI: Saving primary data.
[2025-10-24T18:57:08.334603] [INFO ] [MAIN      ] GEV: Wiping existing primary data before full refresh.
[2025-10-24T18:57:08.334709] [INFO ] [LOCAL     ] GEV: Starting deletion of primary data.
[2025-10-24T18:57:08.334964] [FATAL] [LOCAL     ] GENI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:57:08.335045] [FATAL] [MAIN      ] GENI: Failed to save primary data.
[2025-10-24T18:57:08.335110] [WARN ] [MAIN      ] GENI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:57:08.335177] [INFO ] [LOCAL     ] GENI: Starting deletion of primary data.
[2025-10-24T18:57:08.335231] [DEBUG] [LOCAL     ] GENI: No primary data file found to delete.
[2025-10-24T18:57:08.335267] [INFO ] [LOCAL     ] GENI: Starting deletion of derivative data.
[2025-10-24T18:57:08.335574] [DEBUG] [LOCAL     ] GENI: Deleted derivative data file.
[2025-10-24T18:57:08.336850] [INFO ] [MAIN      ] Update Progress: 916/2366 symbols completed. GENI took 35.8s. Estimated remaining: 3h 5m 21s. Rate: 7.8 symbols/min
[2025-10-24T18:57:08.336017] [DEBUG] [LOCAL     ] GEV: Deleted primary data file.
[2025-10-24T18:57:08.339630] [INFO ] [MAIN      ] GEV: Starting full primary refresh.
[2025-10-24T18:57:08.339512] [INFO ] [REMOTE    ] GETY: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T18:57:08.679822] [INFO ] [MAIN      ] GF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:57:08.802491] [DEBUG] [LOCAL     ] GF: Loaded 2643 existing records from primary storage.
[2025-10-24T18:57:08.808263] [INFO ] [MAIN      ] GF: Loaded 2643 existing records.
[2025-10-24T18:57:08.954951] [INFO ] [REMOTE    ] GETY: Fetching primary data for 2025-04.
[2025-10-24T18:57:08.984754] [INFO ] [REMOTE    ] GEV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:57:09.085575] [WARN ] [MAIN      ] GF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:57:09.085813] [INFO ] [MAIN      ] GF: Wiping existing primary data before full refresh.
[2025-10-24T18:57:09.085860] [INFO ] [LOCAL     ] GF: Starting deletion of primary data.
[2025-10-24T18:57:09.086008] [DEBUG] [LOCAL     ] GF: Deleted primary data file.
[2025-10-24T18:57:09.086046] [INFO ] [MAIN      ] GF: Starting full primary refresh.
[2025-10-24T18:57:09.441449] [INFO ] [REMOTE    ] GF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:57:09.747631] [INFO ] [REMOTE    ] GEV: Fetching primary data for 2025-01.
[2025-10-24T18:57:09.836276] [INFO ] [REMOTE    ] GES: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T18:57:10.481021] [INFO ] [REMOTE    ] GETY: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T18:57:10.547632] [INFO ] [REMOTE    ] GES: Fetching primary data for 2025-09.
[2025-10-24T18:57:11.347638] [INFO ] [REMOTE    ] GETY: Fetching primary data for 2025-05.
[2025-10-24T18:57:11.921073] [INFO ] [REMOTE    ] GES: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T18:57:12.147607] [INFO ] [REMOTE    ] GES: Fetching primary data for 2025-10.
[2025-10-24T18:57:12.236749] [INFO ] [REMOTE    ] GEV: Incremental fetch complete for 2025-01 (2.49 seconds).
[2025-10-24T18:57:12.644260] [INFO ] [REMOTE    ] GETY: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T18:57:12.947671] [INFO ] [REMOTE    ] GETY: Fetching primary data for 2025-06.
[2025-10-24T18:57:13.747637] [INFO ] [REMOTE    ] GEV: Fetching primary data for 2025-02.
[2025-10-24T18:57:13.868931] [INFO ] [REMOTE    ] GES: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T18:57:13.875324] [INFO ] [REMOTE    ] GES: Full fetch complete (58230 records).
[2025-10-24T18:57:13.875457] [DEBUG] [VALIDATOR ] GES: Validating primary data.
[2025-10-24T18:57:14.254886] [DEBUG] [VALIDATOR ] GES: All expected trading days are present.
[2025-10-24T18:57:14.254973] [DEBUG] [VALIDATOR ] GES: Primary data validation passed.
[2025-10-24T18:57:14.255866] [INFO ] [MAIN      ] GES: Fetched primary data is valid.
[2025-10-24T18:57:14.255930] [DEBUG] [LOCAL     ] GES: Saving primary data.
[2025-10-24T18:57:14.256432] [FATAL] [LOCAL     ] GES: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:57:14.256517] [FATAL] [MAIN      ] GES: Failed to save primary data.
[2025-10-24T18:57:14.256558] [WARN ] [MAIN      ] GES: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:57:14.256592] [INFO ] [LOCAL     ] GES: Starting deletion of primary data.
[2025-10-24T18:57:14.256668] [DEBUG] [LOCAL     ] GES: No primary data file found to delete.
[2025-10-24T18:57:14.256726] [INFO ] [LOCAL     ] GES: Starting deletion of derivative data.
[2025-10-24T18:57:14.256864] [DEBUG] [LOCAL     ] GES: Deleted derivative data file.
[2025-10-24T18:57:14.257042] [INFO ] [MAIN      ] Update Progress: 917/2366 symbols completed. GES took 29.6s. Estimated remaining: 3h 5m 11s. Rate: 7.8 symbols/min
[2025-10-24T18:57:14.547979] [INFO ] [REMOTE    ] GF: Fetching primary data for 2025-01.
[2025-10-24T18:57:14.551467] [INFO ] [REMOTE    ] GETY: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T18:57:15.132109] [INFO ] [REMOTE    ] GF: Incremental fetch complete for 2025-01 (0.58 seconds).
[2025-10-24T18:57:15.347601] [INFO ] [REMOTE    ] GF: Fetching primary data for 2025-02.
[2025-10-24T18:57:16.147740] [INFO ] [REMOTE    ] GETY: Fetching primary data for 2025-07.
[2025-10-24T18:57:16.227762] [INFO ] [REMOTE    ] GEV: Incremental fetch complete for 2025-02 (2.48 seconds).
[2025-10-24T18:57:16.254047] [INFO ] [REMOTE    ] GF: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T18:57:16.947706] [INFO ] [REMOTE    ] GEV: Fetching primary data for 2025-03.
[2025-10-24T18:57:17.487023] [INFO ] [REMOTE    ] GETY: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T18:57:17.747615] [INFO ] [REMOTE    ] GF: Fetching primary data for 2025-03.
[2025-10-24T18:57:18.398082] [INFO ] [REMOTE    ] GF: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T18:57:18.547616] [INFO ] [REMOTE    ] GETY: Fetching primary data for 2025-08.
[2025-10-24T18:57:18.970848] [INFO ] [REMOTE    ] GEV: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T18:57:19.347721] [INFO ] [REMOTE    ] GEV: Fetching primary data for 2025-04.
[2025-10-24T18:57:19.548420] [INFO ] [REMOTE    ] GETY: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T18:57:20.147721] [INFO ] [REMOTE    ] GETY: Fetching primary data for 2025-09.
[2025-10-24T18:57:20.947724] [INFO ] [REMOTE    ] GF: Fetching primary data for 2025-04.
[2025-10-24T18:57:21.644613] [INFO ] [REMOTE    ] GETY: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T18:57:21.645468] [INFO ] [REMOTE    ] GF: Incremental fetch complete for 2025-04 (0.70 seconds).
[2025-10-24T18:57:21.687012] [INFO ] [REMOTE    ] GEV: Incremental fetch complete for 2025-04 (2.34 seconds).
[2025-10-24T18:57:21.747679] [INFO ] [REMOTE    ] GEV: Fetching primary data for 2025-05.
[2025-10-24T18:57:22.547727] [INFO ] [REMOTE    ] GF: Fetching primary data for 2025-05.
[2025-10-24T18:57:23.152766] [INFO ] [REMOTE    ] GF: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T18:57:23.347687] [INFO ] [REMOTE    ] GETY: Fetching primary data for 2025-10.
[2025-10-24T18:57:24.147626] [INFO ] [REMOTE    ] GF: Fetching primary data for 2025-06.
[2025-10-24T18:57:24.204255] [INFO ] [REMOTE    ] GEV: Incremental fetch complete for 2025-05 (2.46 seconds).
[2025-10-24T18:57:24.718119] [INFO ] [REMOTE    ] GF: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T18:57:24.925700] [INFO ] [REMOTE    ] GETY: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T18:57:24.938838] [INFO ] [REMOTE    ] GETY: Full fetch complete (55457 records).
[2025-10-24T18:57:24.939121] [DEBUG] [VALIDATOR ] GETY: Validating primary data.
[2025-10-24T18:57:24.956680] [INFO ] [REMOTE    ] GF: Fetching primary data for 2025-07.
[2025-10-24T18:57:25.445011] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present.
[2025-10-24T18:57:25.445119] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed.
[2025-10-24T18:57:25.445987] [INFO ] [MAIN      ] GETY: Fetched primary data is valid.
[2025-10-24T18:57:25.446053] [DEBUG] [LOCAL     ] GETY: Saving primary data.
[2025-10-24T18:57:25.446719] [FATAL] [LOCAL     ] GETY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:57:25.446822] [FATAL] [MAIN      ] GETY: Failed to save primary data.
[2025-10-24T18:57:25.446864] [WARN ] [MAIN      ] GETY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:57:25.446899] [INFO ] [LOCAL     ] GETY: Starting deletion of primary data.
[2025-10-24T18:57:25.446951] [DEBUG] [LOCAL     ] GETY: No primary data file found to delete.
[2025-10-24T18:57:25.446987] [INFO ] [LOCAL     ] GETY: Starting deletion of derivative data.
[2025-10-24T18:57:25.447179] [DEBUG] [LOCAL     ] GETY: Deleted derivative data file.
[2025-10-24T18:57:25.447281] [INFO ] [MAIN      ] Update Progress: 918/2366 symbols completed. GETY took 26.2s. Estimated remaining: 3h 5m 9s. Rate: 7.8 symbols/min
[2025-10-24T18:57:25.479947] [INFO ] [REMOTE    ] GF: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T18:57:25.747693] [INFO ] [REMOTE    ] GF: Fetching primary data for 2025-08.
[2025-10-24T18:57:26.220908] [INFO ] [REMOTE    ] GF: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T18:57:26.547700] [INFO ] [REMOTE    ] GF: Fetching primary data for 2025-09.
[2025-10-24T18:57:26.914588] [INFO ] [REMOTE    ] GF: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T18:57:27.347678] [INFO ] [REMOTE    ] GEV: Fetching primary data for 2025-06.
[2025-10-24T18:57:28.147695] [INFO ] [REMOTE    ] GF: Fetching primary data for 2025-10.
[2025-10-24T18:57:28.661512] [INFO ] [REMOTE    ] GF: Incremental fetch complete for 2025-10 (0.51 seconds).
[2025-10-24T18:57:28.662365] [INFO ] [REMOTE    ] GF: Full fetch complete (4795 records).
[2025-10-24T18:57:28.662433] [DEBUG] [VALIDATOR ] GF: Validating primary data.
[2025-10-24T18:57:29.018719] [DEBUG] [VALIDATOR ] GF: All expected trading days are present.
[2025-10-24T18:57:29.018799] [DEBUG] [VALIDATOR ] GF: Primary data validation passed.
[2025-10-24T18:57:29.018951] [INFO ] [MAIN      ] GF: Fetched primary data is valid.
[2025-10-24T18:57:29.019011] [DEBUG] [LOCAL     ] GF: Saving primary data.
[2025-10-24T18:57:29.019191] [FATAL] [LOCAL     ] GF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:57:29.019273] [FATAL] [MAIN      ] GF: Failed to save primary data.
[2025-10-24T18:57:29.019314] [WARN ] [MAIN      ] GF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:57:29.019348] [INFO ] [LOCAL     ] GF: Starting deletion of primary data.
[2025-10-24T18:57:29.019396] [DEBUG] [LOCAL     ] GF: No primary data file found to delete.
[2025-10-24T18:57:29.019430] [INFO ] [LOCAL     ] GF: Starting deletion of derivative data.
[2025-10-24T18:57:29.019625] [DEBUG] [LOCAL     ] GF: Deleted derivative data file.
[2025-10-24T18:57:29.019737] [INFO ] [MAIN      ] Update Progress: 919/2366 symbols completed. GF took 20.7s. Estimated remaining: 3h 4m 54s. Rate: 7.8 symbols/min
[2025-10-24T18:57:29.579844] [INFO ] [REMOTE    ] GEV: Incremental fetch complete for 2025-06 (2.23 seconds).
[2025-10-24T18:57:29.590627] [INFO ] [REMOTE    ] GEV: Fetching primary data for 2025-07.
[2025-10-24T18:57:32.152039] [INFO ] [REMOTE    ] GEV: Incremental fetch complete for 2025-07 (2.56 seconds).
[2025-10-24T18:57:32.163460] [INFO ] [REMOTE    ] GEV: Fetching primary data for 2025-08.
[2025-10-24T18:57:34.565412] [INFO ] [REMOTE    ] GEV: Incremental fetch complete for 2025-08 (2.40 seconds).
[2025-10-24T18:57:34.576665] [INFO ] [REMOTE    ] GEV: Fetching primary data for 2025-09.
[2025-10-24T18:57:37.158250] [INFO ] [REMOTE    ] GEV: Incremental fetch complete for 2025-09 (2.58 seconds).
[2025-10-24T18:57:37.169874] [INFO ] [REMOTE    ] GEV: Fetching primary data for 2025-10.
[2025-10-24T18:57:39.932208] [INFO ] [REMOTE    ] GEV: Incremental fetch complete for 2025-10 (2.76 seconds).
[2025-10-24T18:57:39.942073] [INFO ] [REMOTE    ] GEV: Full fetch complete (77059 records).
[2025-10-24T18:57:39.942230] [DEBUG] [VALIDATOR ] GEV: Validating primary data.
[2025-10-24T18:57:40.364397] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present.
[2025-10-24T18:57:40.364513] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed.
[2025-10-24T18:57:40.365550] [INFO ] [MAIN      ] GEV: Fetched primary data is valid.
[2025-10-24T18:57:40.365614] [DEBUG] [LOCAL     ] GEV: Saving primary data.
[2025-10-24T18:57:40.366396] [FATAL] [LOCAL     ] GEV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:57:40.366484] [FATAL] [MAIN      ] GEV: Failed to save primary data.
[2025-10-24T18:57:40.366526] [WARN ] [MAIN      ] GEV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:57:40.366567] [INFO ] [LOCAL     ] GEV: Starting deletion of primary data.
[2025-10-24T18:57:40.366620] [DEBUG] [LOCAL     ] GEV: No primary data file found to delete.
[2025-10-24T18:57:40.366683] [INFO ] [LOCAL     ] GEV: Starting deletion of derivative data.
[2025-10-24T18:57:40.366852] [DEBUG] [LOCAL     ] GEV: Deleted derivative data file.
[2025-10-24T18:57:40.367214] [INFO ] [MAIN      ] Update Progress: 920/2366 symbols completed. GEV took 32.9s. Estimated remaining: 3h 4m 52s. Rate: 7.8 symbols/min
[2025-10-24T18:57:41.036031] [INFO ] [MAIN      ] GFL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:57:41.097219] [INFO ] [MAIN      ] GFF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:57:41.109575] [INFO ] [MAIN      ] GFI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:57:41.133159] [INFO ] [MAIN      ] GFR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:57:41.146346] [DEBUG] [LOCAL     ] GFR: Loaded 7396 existing records from primary storage.
[2025-10-24T18:57:41.146786] [INFO ] [MAIN      ] GFR: Loaded 7396 existing records.
[2025-10-24T18:57:41.260873] [DEBUG] [LOCAL     ] GFF: Loaded 29553 existing records from primary storage.
[2025-10-24T18:57:41.272611] [INFO ] [MAIN      ] GFF: Loaded 29553 existing records.
[2025-10-24T18:57:41.530434] [WARN ] [MAIN      ] GFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:57:41.536152] [INFO ] [MAIN      ] GFR: Wiping existing primary data before full refresh.
[2025-10-24T18:57:41.538574] [DEBUG] [LOCAL     ] GFL: Loaded 47819 existing records from primary storage.
[2025-10-24T18:57:41.537529] [DEBUG] [LOCAL     ] GFI: Loaded 53505 existing records from primary storage.
[2025-10-24T18:57:41.568454] [INFO ] [MAIN      ] GFI: Loaded 53505 existing records.
[2025-10-24T18:57:41.568280] [INFO ] [MAIN      ] GFL: Loaded 47819 existing records.
[2025-10-24T18:57:41.554598] [INFO ] [LOCAL     ] GFR: Starting deletion of primary data.
[2025-10-24T18:57:41.646352] [WARN ] [MAIN      ] GFF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:57:41.721017] [INFO ] [MAIN      ] GFF: Wiping existing primary data before full refresh.
[2025-10-24T18:57:41.733771] [INFO ] [LOCAL     ] GFF: Starting deletion of primary data.
[2025-10-24T18:57:41.749554] [DEBUG] [LOCAL     ] GFF: Deleted primary data file.
[2025-10-24T18:57:41.744387] [DEBUG] [LOCAL     ] GFR: Deleted primary data file.
[2025-10-24T18:57:41.765209] [INFO ] [MAIN      ] GFF: Starting full primary refresh.
[2025-10-24T18:57:41.790966] [INFO ] [MAIN      ] GFR: Starting full primary refresh.
[2025-10-24T18:57:42.154426] [WARN ] [MAIN      ] GFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:57:42.241862] [WARN ] [MAIN      ] GFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:57:42.227241] [INFO ] [MAIN      ] GFI: Wiping existing primary data before full refresh.
[2025-10-24T18:57:42.319199] [INFO ] [MAIN      ] GFL: Wiping existing primary data before full refresh.
[2025-10-24T18:57:42.295270] [INFO ] [LOCAL     ] GFI: Starting deletion of primary data.
[2025-10-24T18:57:42.319344] [INFO ] [LOCAL     ] GFL: Starting deletion of primary data.
[2025-10-24T18:57:42.346903] [DEBUG] [LOCAL     ] GFI: Deleted primary data file.
[2025-10-24T18:57:42.402496] [INFO ] [MAIN      ] GFI: Starting full primary refresh.
[2025-10-24T18:57:42.382276] [DEBUG] [LOCAL     ] GFL: Deleted primary data file.
[2025-10-24T18:57:42.444160] [INFO ] [MAIN      ] GFL: Starting full primary refresh.
[2025-10-24T18:57:42.880415] [INFO ] [REMOTE    ] GFF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:57:42.961691] [INFO ] [REMOTE    ] GFF: Fetching primary data for 2025-01.
[2025-10-24T18:57:43.111811] [INFO ] [REMOTE    ] GFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:57:43.149960] [INFO ] [REMOTE    ] GFR: Fetching primary data for 2025-01.
[2025-10-24T18:57:43.431959] [INFO ] [REMOTE    ] GFI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:57:43.445612] [INFO ] [REMOTE    ] GFI: Fetching primary data for 2025-01.
[2025-10-24T18:57:43.466322] [INFO ] [REMOTE    ] GFL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:57:43.466588] [INFO ] [REMOTE    ] GFL: Fetching primary data for 2025-01.
[2025-10-24T18:57:43.945812] [INFO ] [REMOTE    ] GFR: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T18:57:43.948366] [INFO ] [REMOTE    ] GFR: Fetching primary data for 2025-02.
[2025-10-24T18:57:44.471255] [INFO ] [REMOTE    ] GFF: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T18:57:44.477567] [INFO ] [REMOTE    ] GFF: Fetching primary data for 2025-02.
[2025-10-24T18:57:44.645858] [INFO ] [REMOTE    ] GFR: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T18:57:44.649274] [INFO ] [REMOTE    ] GFR: Fetching primary data for 2025-03.
[2025-10-24T18:57:45.158620] [INFO ] [REMOTE    ] GFL: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T18:57:45.167899] [INFO ] [REMOTE    ] GFL: Fetching primary data for 2025-02.
[2025-10-24T18:57:45.202043] [INFO ] [REMOTE    ] GFR: Incremental fetch complete for 2025-03 (0.55 seconds).
[2025-10-24T18:57:45.205029] [INFO ] [REMOTE    ] GFR: Fetching primary data for 2025-04.
[2025-10-24T18:57:45.526416] [INFO ] [REMOTE    ] GFI: Incremental fetch complete for 2025-01 (2.08 seconds).
[2025-10-24T18:57:45.536400] [INFO ] [REMOTE    ] GFI: Fetching primary data for 2025-02.
[2025-10-24T18:57:45.814505] [INFO ] [REMOTE    ] GFF: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T18:57:45.820896] [INFO ] [REMOTE    ] GFF: Fetching primary data for 2025-03.
[2025-10-24T18:57:45.876523] [INFO ] [REMOTE    ] GFR: Incremental fetch complete for 2025-04 (0.67 seconds).
[2025-10-24T18:57:45.879927] [INFO ] [REMOTE    ] GFR: Fetching primary data for 2025-05.
[2025-10-24T18:57:46.349241] [INFO ] [REMOTE    ] GFL: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T18:57:46.358634] [INFO ] [REMOTE    ] GFL: Fetching primary data for 2025-03.
[2025-10-24T18:57:46.368619] [INFO ] [REMOTE    ] GFR: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T18:57:46.371504] [INFO ] [REMOTE    ] GFR: Fetching primary data for 2025-06.
[2025-10-24T18:57:47.047469] [INFO ] [REMOTE    ] GFR: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T18:57:47.051014] [INFO ] [REMOTE    ] GFI: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T18:57:47.051795] [INFO ] [REMOTE    ] GFR: Fetching primary data for 2025-07.
[2025-10-24T18:57:47.062356] [INFO ] [REMOTE    ] GFI: Fetching primary data for 2025-03.
[2025-10-24T18:57:47.176682] [INFO ] [REMOTE    ] GFF: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T18:57:47.183974] [INFO ] [REMOTE    ] GFF: Fetching primary data for 2025-04.
[2025-10-24T18:57:47.714981] [INFO ] [REMOTE    ] GFR: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T18:57:47.716886] [INFO ] [REMOTE    ] GFR: Fetching primary data for 2025-08.
[2025-10-24T18:57:48.046521] [INFO ] [REMOTE    ] GFL: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T18:57:48.057359] [INFO ] [REMOTE    ] GFL: Fetching primary data for 2025-04.
[2025-10-24T18:57:48.130112] [INFO ] [REMOTE    ] GFR: Incremental fetch complete for 2025-08 (0.41 seconds).
[2025-10-24T18:57:48.131906] [INFO ] [REMOTE    ] GFR: Fetching primary data for 2025-09.
[2025-10-24T18:57:48.240827] [INFO ] [REMOTE    ] GFF: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T18:57:48.248918] [INFO ] [REMOTE    ] GFF: Fetching primary data for 2025-05.
[2025-10-24T18:57:48.778957] [INFO ] [REMOTE    ] GFI: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T18:57:48.837389] [INFO ] [REMOTE    ] GFR: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T18:57:48.947636] [INFO ] [REMOTE    ] GFI: Fetching primary data for 2025-04.
[2025-10-24T18:57:49.326962] [INFO ] [REMOTE    ] GFL: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T18:57:49.660111] [INFO ] [REMOTE    ] GFF: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T18:57:49.747624] [INFO ] [REMOTE    ] GFR: Fetching primary data for 2025-10.
[2025-10-24T18:57:50.547705] [INFO ] [REMOTE    ] GFF: Fetching primary data for 2025-06.
[2025-10-24T18:57:50.558139] [INFO ] [REMOTE    ] GFR: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T18:57:50.559798] [INFO ] [REMOTE    ] GFR: Full fetch complete (11921 records).
[2025-10-24T18:57:50.559890] [DEBUG] [VALIDATOR ] GFR: Validating primary data.
[2025-10-24T18:57:50.935110] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present.
[2025-10-24T18:57:50.935219] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed.
[2025-10-24T18:57:50.935542] [INFO ] [MAIN      ] GFR: Fetched primary data is valid.
[2025-10-24T18:57:50.935740] [DEBUG] [LOCAL     ] GFR: Saving primary data.
[2025-10-24T18:57:50.936076] [FATAL] [LOCAL     ] GFR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:57:50.936176] [FATAL] [MAIN      ] GFR: Failed to save primary data.
[2025-10-24T18:57:50.936241] [WARN ] [MAIN      ] GFR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:57:50.936367] [INFO ] [LOCAL     ] GFR: Starting deletion of primary data.
[2025-10-24T18:57:50.936426] [DEBUG] [LOCAL     ] GFR: No primary data file found to delete.
[2025-10-24T18:57:50.936461] [INFO ] [LOCAL     ] GFR: Starting deletion of derivative data.
[2025-10-24T18:57:50.936629] [DEBUG] [LOCAL     ] GFR: Deleted derivative data file.
[2025-10-24T18:57:50.936767] [INFO ] [MAIN      ] Update Progress: 921/2366 symbols completed. GFR took 10.5s. Estimated remaining: 3h 4m 49s. Rate: 7.8 symbols/min
[2025-10-24T18:57:51.134929] [INFO ] [MAIN      ] GGB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:57:51.147998] [INFO ] [REMOTE    ] GFI: Incremental fetch complete for 2025-04 (2.20 seconds).
[2025-10-24T18:57:51.206053] [DEBUG] [LOCAL     ] GGB: Loaded 51938 existing records from primary storage.
[2025-10-24T18:57:51.206345] [INFO ] [MAIN      ] GGB: Loaded 51938 existing records.
[2025-10-24T18:57:51.358019] [INFO ] [REMOTE    ] GFL: Fetching primary data for 2025-05.
[2025-10-24T18:57:51.394135] [WARN ] [MAIN      ] GGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:57:51.394369] [INFO ] [MAIN      ] GGB: Wiping existing primary data before full refresh.
[2025-10-24T18:57:51.394417] [INFO ] [LOCAL     ] GGB: Starting deletion of primary data.
[2025-10-24T18:57:51.395210] [DEBUG] [LOCAL     ] GGB: Deleted primary data file.
[2025-10-24T18:57:51.395268] [INFO ] [MAIN      ] GGB: Starting full primary refresh.
[2025-10-24T18:57:51.757811] [INFO ] [REMOTE    ] GGB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:57:51.772214] [INFO ] [REMOTE    ] GFF: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T18:57:52.147722] [INFO ] [REMOTE    ] GFI: Fetching primary data for 2025-05.
[2025-10-24T18:57:52.947673] [INFO ] [REMOTE    ] GFF: Fetching primary data for 2025-07.
[2025-10-24T18:57:53.025811] [INFO ] [REMOTE    ] GFL: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T18:57:53.747690] [INFO ] [REMOTE    ] GGB: Fetching primary data for 2025-01.
[2025-10-24T18:57:53.883517] [INFO ] [REMOTE    ] GFI: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T18:57:54.302804] [INFO ] [REMOTE    ] GFF: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T18:57:54.547664] [INFO ] [REMOTE    ] GFI: Fetching primary data for 2025-06.
[2025-10-24T18:57:55.306593] [INFO ] [REMOTE    ] GGB: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T18:57:55.347622] [INFO ] [REMOTE    ] GGB: Fetching primary data for 2025-02.
[2025-10-24T18:57:56.147676] [INFO ] [REMOTE    ] GFF: Fetching primary data for 2025-08.
[2025-10-24T18:57:56.305770] [INFO ] [REMOTE    ] GFI: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T18:57:56.839172] [INFO ] [REMOTE    ] GGB: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T18:57:56.947694] [INFO ] [REMOTE    ] GFI: Fetching primary data for 2025-07.
[2025-10-24T18:57:57.071944] [INFO ] [REMOTE    ] GFF: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T18:57:57.747730] [INFO ] [REMOTE    ] GFF: Fetching primary data for 2025-09.
[2025-10-24T18:57:58.547632] [INFO ] [REMOTE    ] GFL: Fetching primary data for 2025-06.
[2025-10-24T18:57:58.857091] [INFO ] [REMOTE    ] GFI: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T18:57:58.883518] [INFO ] [REMOTE    ] GFF: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T18:57:59.347638] [INFO ] [REMOTE    ] GFI: Fetching primary data for 2025-08.
[2025-10-24T18:58:00.088538] [INFO ] [REMOTE    ] GFL: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T18:58:00.147602] [INFO ] [REMOTE    ] GFL: Fetching primary data for 2025-07.
[2025-10-24T18:58:00.947633] [INFO ] [REMOTE    ] GGB: Fetching primary data for 2025-03.
[2025-10-24T18:58:01.747715] [INFO ] [REMOTE    ] GFF: Fetching primary data for 2025-10.
[2025-10-24T18:58:02.533926] [INFO ] [REMOTE    ] GFI: Incremental fetch complete for 2025-08 (3.19 seconds).
[2025-10-24T18:58:02.547594] [INFO ] [REMOTE    ] GFI: Fetching primary data for 2025-09.
[2025-10-24T18:58:02.598477] [INFO ] [REMOTE    ] GFL: Incremental fetch complete for 2025-07 (2.45 seconds).
[2025-10-24T18:58:03.347675] [INFO ] [REMOTE    ] GFL: Fetching primary data for 2025-08.
[2025-10-24T18:58:04.959865] [INFO ] [REMOTE    ] GFF: Incremental fetch complete for 2025-10 (3.21 seconds).
[2025-10-24T18:58:04.964968] [INFO ] [REMOTE    ] GFF: Full fetch complete (43512 records).
[2025-10-24T18:58:04.965102] [DEBUG] [VALIDATOR ] GFF: Validating primary data.
[2025-10-24T18:58:05.338278] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present.
[2025-10-24T18:58:05.338378] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed.
[2025-10-24T18:58:05.339210] [INFO ] [MAIN      ] GFF: Fetched primary data is valid.
[2025-10-24T18:58:05.339292] [DEBUG] [LOCAL     ] GFF: Saving primary data.
[2025-10-24T18:58:05.339807] [FATAL] [LOCAL     ] GFF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:58:05.339907] [FATAL] [MAIN      ] GFF: Failed to save primary data.
[2025-10-24T18:58:05.339958] [WARN ] [MAIN      ] GFF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:58:05.340109] [INFO ] [LOCAL     ] GFF: Starting deletion of primary data.
[2025-10-24T18:58:05.340173] [DEBUG] [LOCAL     ] GFF: No primary data file found to delete.
[2025-10-24T18:58:05.340281] [INFO ] [LOCAL     ] GFF: Starting deletion of derivative data.
[2025-10-24T18:58:05.340500] [DEBUG] [LOCAL     ] GFF: Deleted derivative data file.
[2025-10-24T18:58:05.340597] [INFO ] [MAIN      ] Update Progress: 922/2366 symbols completed. GFF took 25.0s. Estimated remaining: 3h 4m 52s. Rate: 7.8 symbols/min
[2025-10-24T18:58:05.463910] [INFO ] [REMOTE    ] GGB: Incremental fetch complete for 2025-03 (4.52 seconds).
[2025-10-24T18:58:05.487125] [INFO ] [REMOTE    ] GGB: Fetching primary data for 2025-04.
[2025-10-24T18:58:05.560463] [INFO ] [MAIN      ] GGG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:58:05.599621] [DEBUG] [LOCAL     ] GGG: Loaded 40930 existing records from primary storage.
[2025-10-24T18:58:05.599951] [INFO ] [MAIN      ] GGG: Loaded 40930 existing records.
[2025-10-24T18:58:05.774428] [WARN ] [MAIN      ] GGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:58:05.774687] [INFO ] [MAIN      ] GGG: Wiping existing primary data before full refresh.
[2025-10-24T18:58:05.774756] [INFO ] [LOCAL     ] GGG: Starting deletion of primary data.
[2025-10-24T18:58:05.774991] [DEBUG] [LOCAL     ] GGG: Deleted primary data file.
[2025-10-24T18:58:05.775051] [INFO ] [MAIN      ] GGG: Starting full primary refresh.
[2025-10-24T18:58:06.133297] [INFO ] [REMOTE    ] GGG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:58:06.133701] [INFO ] [REMOTE    ] GGG: Fetching primary data for 2025-01.
[2025-10-24T18:58:06.192420] [INFO ] [REMOTE    ] GFI: Incremental fetch complete for 2025-09 (3.64 seconds).
[2025-10-24T18:58:06.203673] [INFO ] [REMOTE    ] GFI: Fetching primary data for 2025-10.
[2025-10-24T18:58:06.659918] [INFO ] [REMOTE    ] GFL: Incremental fetch complete for 2025-08 (3.31 seconds).
[2025-10-24T18:58:06.669905] [INFO ] [REMOTE    ] GFL: Fetching primary data for 2025-09.
[2025-10-24T18:58:07.735794] [INFO ] [REMOTE    ] GGB: Incremental fetch complete for 2025-04 (2.25 seconds).
[2025-10-24T18:58:07.747500] [INFO ] [REMOTE    ] GGB: Fetching primary data for 2025-05.
[2025-10-24T18:58:08.137811] [INFO ] [REMOTE    ] GFL: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T18:58:08.148749] [INFO ] [REMOTE    ] GFL: Fetching primary data for 2025-10.
[2025-10-24T18:58:08.251362] [INFO ] [REMOTE    ] GGG: Incremental fetch complete for 2025-01 (2.12 seconds).
[2025-10-24T18:58:08.629901] [INFO ] [REMOTE    ] GFI: Incremental fetch complete for 2025-10 (2.43 seconds).
[2025-10-24T18:58:08.639469] [INFO ] [REMOTE    ] GFI: Full fetch complete (77000 records).
[2025-10-24T18:58:08.639589] [DEBUG] [VALIDATOR ] GFI: Validating primary data.
[2025-10-24T18:58:08.952790] [INFO ] [REMOTE    ] GGG: Fetching primary data for 2025-02.
[2025-10-24T18:58:09.031776] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present.
[2025-10-24T18:58:09.031862] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed.
[2025-10-24T18:58:09.032832] [INFO ] [MAIN      ] GFI: Fetched primary data is valid.
[2025-10-24T18:58:09.032896] [DEBUG] [LOCAL     ] GFI: Saving primary data.
[2025-10-24T18:58:09.033446] [FATAL] [LOCAL     ] GFI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:58:09.033530] [FATAL] [MAIN      ] GFI: Failed to save primary data.
[2025-10-24T18:58:09.033572] [WARN ] [MAIN      ] GFI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:58:09.033627] [INFO ] [LOCAL     ] GFI: Starting deletion of primary data.
[2025-10-24T18:58:09.033716] [DEBUG] [LOCAL     ] GFI: No primary data file found to delete.
[2025-10-24T18:58:09.033760] [INFO ] [LOCAL     ] GFI: Starting deletion of derivative data.
[2025-10-24T18:58:09.033886] [DEBUG] [LOCAL     ] GFI: Deleted derivative data file.
[2025-10-24T18:58:09.034254] [INFO ] [MAIN      ] Update Progress: 923/2366 symbols completed. GFI took 28.7s. Estimated remaining: 3h 4m 38s. Rate: 7.8 symbols/min
[2025-10-24T18:58:09.210383] [INFO ] [MAIN      ] GGT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:58:09.226523] [DEBUG] [LOCAL     ] GGT: Loaded 14575 existing records from primary storage.
[2025-10-24T18:58:09.226767] [INFO ] [MAIN      ] GGT: Loaded 14575 existing records.
[2025-10-24T18:58:09.437505] [WARN ] [MAIN      ] GGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:58:09.440678] [INFO ] [MAIN      ] GGT: Wiping existing primary data before full refresh.
[2025-10-24T18:58:09.440872] [INFO ] [LOCAL     ] GGT: Starting deletion of primary data.
[2025-10-24T18:58:09.442404] [DEBUG] [LOCAL     ] GGT: Deleted primary data file.
[2025-10-24T18:58:09.442342] [INFO ] [REMOTE    ] GGB: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T18:58:09.442529] [INFO ] [MAIN      ] GGT: Starting full primary refresh.
[2025-10-24T18:58:09.752746] [INFO ] [REMOTE    ] GGB: Fetching primary data for 2025-06.
[2025-10-24T18:58:09.829446] [INFO ] [REMOTE    ] GGT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:58:09.889489] [INFO ] [REMOTE    ] GFL: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T18:58:09.898127] [INFO ] [REMOTE    ] GFL: Full fetch complete (69623 records).
[2025-10-24T18:58:09.898246] [DEBUG] [VALIDATOR ] GFL: Validating primary data.
[2025-10-24T18:58:10.317579] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present.
[2025-10-24T18:58:10.317773] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed.
[2025-10-24T18:58:10.318711] [INFO ] [MAIN      ] GFL: Fetched primary data is valid.
[2025-10-24T18:58:10.318772] [DEBUG] [LOCAL     ] GFL: Saving primary data.
[2025-10-24T18:58:10.319338] [FATAL] [LOCAL     ] GFL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:58:10.319422] [FATAL] [MAIN      ] GFL: Failed to save primary data.
[2025-10-24T18:58:10.319464] [WARN ] [MAIN      ] GFL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:58:10.319527] [INFO ] [LOCAL     ] GFL: Starting deletion of primary data.
[2025-10-24T18:58:10.319587] [DEBUG] [LOCAL     ] GFL: No primary data file found to delete.
[2025-10-24T18:58:10.319622] [INFO ] [LOCAL     ] GFL: Starting deletion of derivative data.
[2025-10-24T18:58:10.319800] [DEBUG] [LOCAL     ] GFL: Deleted derivative data file.
[2025-10-24T18:58:10.320356] [INFO ] [MAIN      ] Update Progress: 924/2366 symbols completed. GFL took 29.9s. Estimated remaining: 3h 4m 21s. Rate: 7.8 symbols/min
[2025-10-24T18:58:10.489937] [INFO ] [MAIN      ] GGZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:58:10.494316] [DEBUG] [LOCAL     ] GGZ: Loaded 2357 existing records from primary storage.
[2025-10-24T18:58:10.494489] [INFO ] [MAIN      ] GGZ: Loaded 2357 existing records.
[2025-10-24T18:58:10.556404] [INFO ] [REMOTE    ] GGT: Fetching primary data for 2025-01.
[2025-10-24T18:58:10.680282] [INFO ] [REMOTE    ] GGG: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T18:58:10.701438] [WARN ] [MAIN      ] GGZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:58:10.709052] [INFO ] [MAIN      ] GGZ: Wiping existing primary data before full refresh.
[2025-10-24T18:58:10.709521] [INFO ] [LOCAL     ] GGZ: Starting deletion of primary data.
[2025-10-24T18:58:10.710035] [DEBUG] [LOCAL     ] GGZ: Deleted primary data file.
[2025-10-24T18:58:10.710088] [INFO ] [MAIN      ] GGZ: Starting full primary refresh.
[2025-10-24T18:58:11.061367] [INFO ] [REMOTE    ] GGZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:58:11.347701] [INFO ] [REMOTE    ] GGG: Fetching primary data for 2025-03.
[2025-10-24T18:58:11.486357] [INFO ] [REMOTE    ] GGT: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T18:58:11.744056] [INFO ] [REMOTE    ] GGB: Incremental fetch complete for 2025-06 (1.99 seconds).
[2025-10-24T18:58:12.147724] [INFO ] [REMOTE    ] GGB: Fetching primary data for 2025-07.
[2025-10-24T18:58:12.826276] [INFO ] [REMOTE    ] GGG: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T18:58:12.947673] [INFO ] [REMOTE    ] GGG: Fetching primary data for 2025-04.
[2025-10-24T18:58:13.747755] [INFO ] [REMOTE    ] GGT: Fetching primary data for 2025-02.
[2025-10-24T18:58:14.030121] [INFO ] [REMOTE    ] GGB: Incremental fetch complete for 2025-07 (1.88 seconds).
[2025-10-24T18:58:14.547725] [INFO ] [REMOTE    ] GGZ: Fetching primary data for 2025-01.
[2025-10-24T18:58:14.590115] [INFO ] [REMOTE    ] GGT: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T18:58:14.693576] [INFO ] [REMOTE    ] GGG: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T18:58:14.992322] [INFO ] [REMOTE    ] GGZ: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T18:58:15.347631] [INFO ] [REMOTE    ] GGG: Fetching primary data for 2025-05.
[2025-10-24T18:58:16.147682] [INFO ] [REMOTE    ] GGT: Fetching primary data for 2025-03.
[2025-10-24T18:58:16.891719] [INFO ] [REMOTE    ] GGG: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T18:58:16.938873] [INFO ] [REMOTE    ] GGT: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T18:58:16.947605] [INFO ] [REMOTE    ] GGZ: Fetching primary data for 2025-02.
[2025-10-24T18:58:17.385606] [INFO ] [REMOTE    ] GGZ: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T18:58:17.747703] [INFO ] [REMOTE    ] GGZ: Fetching primary data for 2025-03.
[2025-10-24T18:58:18.285339] [INFO ] [REMOTE    ] GGZ: Incremental fetch complete for 2025-03 (0.54 seconds).
[2025-10-24T18:58:18.547677] [INFO ] [REMOTE    ] GGB: Fetching primary data for 2025-08.
[2025-10-24T18:58:19.347686] [INFO ] [REMOTE    ] GGT: Fetching primary data for 2025-04.
[2025-10-24T18:58:20.152796] [INFO ] [REMOTE    ] GGZ: Fetching primary data for 2025-04.
[2025-10-24T18:58:20.169670] [INFO ] [REMOTE    ] GGB: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T18:58:20.192091] [INFO ] [REMOTE    ] GGT: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T18:58:20.813014] [INFO ] [REMOTE    ] GGZ: Incremental fetch complete for 2025-04 (0.66 seconds).
[2025-10-24T18:58:20.947638] [INFO ] [REMOTE    ] GGZ: Fetching primary data for 2025-05.
[2025-10-24T18:58:21.596420] [INFO ] [REMOTE    ] GGZ: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T18:58:21.747667] [INFO ] [REMOTE    ] GGZ: Fetching primary data for 2025-06.
[2025-10-24T18:58:22.192614] [INFO ] [REMOTE    ] GGZ: Incremental fetch complete for 2025-06 (0.44 seconds).
[2025-10-24T18:58:22.547729] [INFO ] [REMOTE    ] GGZ: Fetching primary data for 2025-07.
[2025-10-24T18:58:23.060449] [INFO ] [REMOTE    ] GGZ: Incremental fetch complete for 2025-07 (0.51 seconds).
[2025-10-24T18:58:23.347692] [INFO ] [REMOTE    ] GGB: Fetching primary data for 2025-09.
[2025-10-24T18:58:24.147712] [INFO ] [REMOTE    ] GGG: Fetching primary data for 2025-06.
[2025-10-24T18:58:24.945204] [INFO ] [REMOTE    ] GGB: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T18:58:24.956192] [INFO ] [REMOTE    ] GGZ: Fetching primary data for 2025-08.
[2025-10-24T18:58:25.397705] [INFO ] [REMOTE    ] GGZ: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T18:58:25.469469] [INFO ] [REMOTE    ] GGG: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T18:58:25.747686] [INFO ] [REMOTE    ] GGG: Fetching primary data for 2025-07.
[2025-10-24T18:58:26.547634] [INFO ] [REMOTE    ] GGT: Fetching primary data for 2025-05.
[2025-10-24T18:58:27.109896] [INFO ] [REMOTE    ] GGG: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T18:58:27.347626] [INFO ] [REMOTE    ] GGB: Fetching primary data for 2025-10.
[2025-10-24T18:58:27.564510] [INFO ] [REMOTE    ] GGT: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T18:58:28.147640] [INFO ] [REMOTE    ] GGT: Fetching primary data for 2025-06.
[2025-10-24T18:58:28.947620] [INFO ] [REMOTE    ] GGZ: Fetching primary data for 2025-09.
[2025-10-24T18:58:29.250571] [INFO ] [REMOTE    ] GGT: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T18:58:29.422176] [INFO ] [REMOTE    ] GGB: Incremental fetch complete for 2025-10 (2.07 seconds).
[2025-10-24T18:58:29.431715] [INFO ] [REMOTE    ] GGB: Full fetch complete (74397 records).
[2025-10-24T18:58:29.431838] [DEBUG] [VALIDATOR ] GGB: Validating primary data.
[2025-10-24T18:58:29.531112] [INFO ] [REMOTE    ] GGZ: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T18:58:29.752756] [INFO ] [REMOTE    ] GGT: Fetching primary data for 2025-07.
[2025-10-24T18:58:29.840269] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present.
[2025-10-24T18:58:29.840342] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed.
[2025-10-24T18:58:29.841280] [INFO ] [MAIN      ] GGB: Fetched primary data is valid.
[2025-10-24T18:58:29.841342] [DEBUG] [LOCAL     ] GGB: Saving primary data.
[2025-10-24T18:58:29.841907] [FATAL] [LOCAL     ] GGB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:58:29.841992] [FATAL] [MAIN      ] GGB: Failed to save primary data.
[2025-10-24T18:58:29.842034] [WARN ] [MAIN      ] GGB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:58:29.842069] [INFO ] [LOCAL     ] GGB: Starting deletion of primary data.
[2025-10-24T18:58:29.842119] [DEBUG] [LOCAL     ] GGB: No primary data file found to delete.
[2025-10-24T18:58:29.842153] [INFO ] [LOCAL     ] GGB: Starting deletion of derivative data.
[2025-10-24T18:58:29.842286] [DEBUG] [LOCAL     ] GGB: Deleted derivative data file.
[2025-10-24T18:58:29.842515] [INFO ] [MAIN      ] Update Progress: 925/2366 symbols completed. GGB took 38.9s. Estimated remaining: 3h 4m 31s. Rate: 7.8 symbols/min
[2025-10-24T18:58:30.018860] [INFO ] [MAIN      ] GHC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:58:30.023715] [DEBUG] [LOCAL     ] GHC: Loaded 2978 existing records from primary storage.
[2025-10-24T18:58:30.023903] [INFO ] [MAIN      ] GHC: Loaded 2978 existing records.
[2025-10-24T18:58:30.202905] [WARN ] [MAIN      ] GHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:58:30.203092] [INFO ] [MAIN      ] GHC: Wiping existing primary data before full refresh.
[2025-10-24T18:58:30.203138] [INFO ] [LOCAL     ] GHC: Starting deletion of primary data.
[2025-10-24T18:58:30.203291] [DEBUG] [LOCAL     ] GHC: Deleted primary data file.
[2025-10-24T18:58:30.203345] [INFO ] [MAIN      ] GHC: Starting full primary refresh.
[2025-10-24T18:58:30.551734] [INFO ] [REMOTE    ] GGZ: Fetching primary data for 2025-10.
[2025-10-24T18:58:30.582989] [INFO ] [REMOTE    ] GHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:58:30.672433] [INFO ] [REMOTE    ] GGT: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T18:58:31.195885] [INFO ] [REMOTE    ] GGZ: Incremental fetch complete for 2025-10 (0.64 seconds).
[2025-10-24T18:58:31.196939] [INFO ] [REMOTE    ] GGZ: Full fetch complete (3792 records).
[2025-10-24T18:58:31.197009] [DEBUG] [VALIDATOR ] GGZ: Validating primary data.
[2025-10-24T18:58:31.352954] [INFO ] [REMOTE    ] GGT: Fetching primary data for 2025-08.
[2025-10-24T18:58:31.572661] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present.
[2025-10-24T18:58:31.572765] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed.
[2025-10-24T18:58:31.572955] [INFO ] [MAIN      ] GGZ: Fetched primary data is valid.
[2025-10-24T18:58:31.573002] [DEBUG] [LOCAL     ] GGZ: Saving primary data.
[2025-10-24T18:58:31.573177] [FATAL] [LOCAL     ] GGZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:58:31.573251] [FATAL] [MAIN      ] GGZ: Failed to save primary data.
[2025-10-24T18:58:31.573317] [WARN ] [MAIN      ] GGZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:58:31.573382] [INFO ] [LOCAL     ] GGZ: Starting deletion of primary data.
[2025-10-24T18:58:31.573438] [DEBUG] [LOCAL     ] GGZ: No primary data file found to delete.
[2025-10-24T18:58:31.573474] [INFO ] [LOCAL     ] GGZ: Starting deletion of derivative data.
[2025-10-24T18:58:31.573592] [DEBUG] [LOCAL     ] GGZ: Deleted derivative data file.
[2025-10-24T18:58:31.573690] [INFO ] [MAIN      ] Update Progress: 926/2366 symbols completed. GGZ took 21.3s. Estimated remaining: 3h 4m 15s. Rate: 7.8 symbols/min
[2025-10-24T18:58:31.748717] [INFO ] [MAIN      ] GHG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:58:31.753910] [DEBUG] [LOCAL     ] GHG: Loaded 3296 existing records from primary storage.
[2025-10-24T18:58:31.754136] [INFO ] [MAIN      ] GHG: Loaded 3296 existing records.
[2025-10-24T18:58:31.936708] [WARN ] [MAIN      ] GHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:58:31.936957] [INFO ] [MAIN      ] GHG: Wiping existing primary data before full refresh.
[2025-10-24T18:58:31.937011] [INFO ] [LOCAL     ] GHG: Starting deletion of primary data.
[2025-10-24T18:58:31.937203] [DEBUG] [LOCAL     ] GHG: Deleted primary data file.
[2025-10-24T18:58:31.937268] [INFO ] [MAIN      ] GHG: Starting full primary refresh.
[2025-10-24T18:58:32.152808] [INFO ] [REMOTE    ] GGG: Fetching primary data for 2025-08.
[2025-10-24T18:58:32.311185] [INFO ] [REMOTE    ] GHG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:58:32.325852] [INFO ] [REMOTE    ] GGT: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T18:58:32.947699] [INFO ] [REMOTE    ] GHC: Fetching primary data for 2025-01.
[2025-10-24T18:58:33.596747] [INFO ] [REMOTE    ] GHC: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T18:58:33.619101] [INFO ] [REMOTE    ] GGG: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T18:58:33.747710] [INFO ] [REMOTE    ] GGT: Fetching primary data for 2025-09.
[2025-10-24T18:58:34.547700] [INFO ] [REMOTE    ] GHC: Fetching primary data for 2025-02.
[2025-10-24T18:58:34.680602] [INFO ] [REMOTE    ] GGT: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T18:58:34.983952] [INFO ] [REMOTE    ] GHC: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T18:58:35.347692] [INFO ] [REMOTE    ] GHG: Fetching primary data for 2025-01.
[2025-10-24T18:58:35.792231] [INFO ] [REMOTE    ] GHG: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T18:58:36.147689] [INFO ] [REMOTE    ] GGT: Fetching primary data for 2025-10.
[2025-10-24T18:58:36.947626] [INFO ] [REMOTE    ] GGG: Fetching primary data for 2025-09.
[2025-10-24T18:58:37.256105] [INFO ] [REMOTE    ] GGT: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T18:58:37.259327] [INFO ] [REMOTE    ] GGT: Full fetch complete (19131 records).
[2025-10-24T18:58:37.259401] [DEBUG] [VALIDATOR ] GGT: Validating primary data.
[2025-10-24T18:58:37.625085] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present.
[2025-10-24T18:58:37.625162] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed.
[2025-10-24T18:58:37.625667] [INFO ] [MAIN      ] GGT: Fetched primary data is valid.
[2025-10-24T18:58:37.625731] [DEBUG] [LOCAL     ] GGT: Saving primary data.
[2025-10-24T18:58:37.625980] [FATAL] [LOCAL     ] GGT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:58:37.626090] [FATAL] [MAIN      ] GGT: Failed to save primary data.
[2025-10-24T18:58:37.626134] [WARN ] [MAIN      ] GGT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:58:37.626168] [INFO ] [LOCAL     ] GGT: Starting deletion of primary data.
[2025-10-24T18:58:37.626219] [DEBUG] [LOCAL     ] GGT: No primary data file found to delete.
[2025-10-24T18:58:37.626256] [INFO ] [LOCAL     ] GGT: Starting deletion of derivative data.
[2025-10-24T18:58:37.626499] [DEBUG] [LOCAL     ] GGT: Deleted derivative data file.
[2025-10-24T18:58:37.626590] [INFO ] [MAIN      ] Update Progress: 927/2366 symbols completed. GGT took 28.6s. Estimated remaining: 3h 4m 4s. Rate: 7.8 symbols/min
[2025-10-24T18:58:37.752873] [INFO ] [REMOTE    ] GHG: Fetching primary data for 2025-02.
[2025-10-24T18:58:37.819841] [INFO ] [MAIN      ] GHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:58:37.830869] [DEBUG] [LOCAL     ] GHI: Loaded 7953 existing records from primary storage.
[2025-10-24T18:58:37.831118] [INFO ] [MAIN      ] GHI: Loaded 7953 existing records.
[2025-10-24T18:58:38.040004] [WARN ] [MAIN      ] GHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:58:38.040222] [INFO ] [MAIN      ] GHI: Wiping existing primary data before full refresh.
[2025-10-24T18:58:38.040306] [INFO ] [LOCAL     ] GHI: Starting deletion of primary data.
[2025-10-24T18:58:38.040568] [DEBUG] [LOCAL     ] GHI: Deleted primary data file.
[2025-10-24T18:58:38.040685] [INFO ] [MAIN      ] GHI: Starting full primary refresh.
[2025-10-24T18:58:38.253092] [INFO ] [REMOTE    ] GHG: Incremental fetch complete for 2025-02 (0.50 seconds).
[2025-10-24T18:58:38.421459] [INFO ] [REMOTE    ] GHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:58:38.443285] [INFO ] [REMOTE    ] GGG: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T18:58:38.547609] [INFO ] [REMOTE    ] GHI: Fetching primary data for 2025-01.
[2025-10-24T18:58:39.332966] [INFO ] [REMOTE    ] GHI: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T18:58:39.347681] [INFO ] [REMOTE    ] GHC: Fetching primary data for 2025-03.
[2025-10-24T18:58:39.906606] [INFO ] [REMOTE    ] GHC: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T18:58:40.147613] [INFO ] [REMOTE    ] GHI: Fetching primary data for 2025-02.
[2025-10-24T18:58:40.747817] [INFO ] [REMOTE    ] GHI: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T18:58:40.947721] [INFO ] [REMOTE    ] GHC: Fetching primary data for 2025-04.
[2025-10-24T18:58:41.503789] [INFO ] [REMOTE    ] GHC: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T18:58:41.747666] [INFO ] [REMOTE    ] GGG: Fetching primary data for 2025-10.
[2025-10-24T18:58:42.547614] [INFO ] [REMOTE    ] GHG: Fetching primary data for 2025-03.
[2025-10-24T18:58:43.008845] [INFO ] [REMOTE    ] GHG: Incremental fetch complete for 2025-03 (0.46 seconds).
[2025-10-24T18:58:43.283449] [INFO ] [REMOTE    ] GGG: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T18:58:43.290958] [INFO ] [REMOTE    ] GGG: Full fetch complete (59606 records).
[2025-10-24T18:58:43.291069] [DEBUG] [VALIDATOR ] GGG: Validating primary data.
[2025-10-24T18:58:43.356085] [INFO ] [REMOTE    ] GHI: Fetching primary data for 2025-03.
[2025-10-24T18:58:43.688094] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present.
[2025-10-24T18:58:43.688174] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed.
[2025-10-24T18:58:43.689079] [INFO ] [MAIN      ] GGG: Fetched primary data is valid.
[2025-10-24T18:58:43.689166] [DEBUG] [LOCAL     ] GGG: Saving primary data.
[2025-10-24T18:58:43.689665] [FATAL] [LOCAL     ] GGG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:58:43.689757] [FATAL] [MAIN      ] GGG: Failed to save primary data.
[2025-10-24T18:58:43.689821] [WARN ] [MAIN      ] GGG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:58:43.689889] [INFO ] [LOCAL     ] GGG: Starting deletion of primary data.
[2025-10-24T18:58:43.689950] [DEBUG] [LOCAL     ] GGG: No primary data file found to delete.
[2025-10-24T18:58:43.689988] [INFO ] [LOCAL     ] GGG: Starting deletion of derivative data.
[2025-10-24T18:58:43.690151] [DEBUG] [LOCAL     ] GGG: Deleted derivative data file.
[2025-10-24T18:58:43.690387] [INFO ] [MAIN      ] Update Progress: 928/2366 symbols completed. GGG took 38.3s. Estimated remaining: 3h 3m 54s. Rate: 7.8 symbols/min
[2025-10-24T18:58:43.868122] [INFO ] [MAIN      ] GHLD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:58:43.874957] [DEBUG] [LOCAL     ] GHLD: Loaded 4346 existing records from primary storage.
[2025-10-24T18:58:43.875159] [INFO ] [MAIN      ] GHLD: Loaded 4346 existing records.
[2025-10-24T18:58:44.065058] [WARN ] [MAIN      ] GHLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:58:44.065374] [INFO ] [MAIN      ] GHLD: Wiping existing primary data before full refresh.
[2025-10-24T18:58:44.065426] [INFO ] [LOCAL     ] GHLD: Starting deletion of primary data.
[2025-10-24T18:58:44.065615] [DEBUG] [LOCAL     ] GHLD: Deleted primary data file.
[2025-10-24T18:58:44.065695] [INFO ] [MAIN      ] GHLD: Starting full primary refresh.
[2025-10-24T18:58:44.155708] [INFO ] [REMOTE    ] GHC: Fetching primary data for 2025-05.
[2025-10-24T18:58:44.234359] [INFO ] [REMOTE    ] GHI: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T18:58:44.439944] [INFO ] [REMOTE    ] GHLD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:58:44.685815] [INFO ] [REMOTE    ] GHC: Incremental fetch complete for 2025-05 (0.53 seconds).
[2025-10-24T18:58:44.947681] [INFO ] [REMOTE    ] GHLD: Fetching primary data for 2025-01.
[2025-10-24T18:58:45.388413] [INFO ] [REMOTE    ] GHLD: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T18:58:45.747713] [INFO ] [REMOTE    ] GHLD: Fetching primary data for 2025-02.
[2025-10-24T18:58:46.144134] [INFO ] [REMOTE    ] GHLD: Incremental fetch complete for 2025-02 (0.40 seconds).
[2025-10-24T18:58:46.547674] [INFO ] [REMOTE    ] GHC: Fetching primary data for 2025-06.
[2025-10-24T18:58:47.143043] [INFO ] [REMOTE    ] GHC: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T18:58:47.347678] [INFO ] [REMOTE    ] GHI: Fetching primary data for 2025-04.
[2025-10-24T18:58:48.147722] [INFO ] [REMOTE    ] GHC: Fetching primary data for 2025-07.
[2025-10-24T18:58:48.167769] [INFO ] [REMOTE    ] GHI: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T18:58:48.717496] [INFO ] [REMOTE    ] GHC: Incremental fetch complete for 2025-07 (0.57 seconds).
[2025-10-24T18:58:48.947690] [INFO ] [REMOTE    ] GHLD: Fetching primary data for 2025-03.
[2025-10-24T18:58:49.442704] [INFO ] [REMOTE    ] GHLD: Incremental fetch complete for 2025-03 (0.50 seconds).
[2025-10-24T18:58:49.747790] [INFO ] [REMOTE    ] GHLD: Fetching primary data for 2025-04.
[2025-10-24T18:58:50.288102] [INFO ] [REMOTE    ] GHLD: Incremental fetch complete for 2025-04 (0.54 seconds).
[2025-10-24T18:58:50.547669] [INFO ] [REMOTE    ] GHG: Fetching primary data for 2025-04.
[2025-10-24T18:58:51.079714] [INFO ] [REMOTE    ] GHG: Incremental fetch complete for 2025-04 (0.53 seconds).
[2025-10-24T18:58:51.347637] [INFO ] [REMOTE    ] GHG: Fetching primary data for 2025-05.
[2025-10-24T18:58:51.894089] [INFO ] [REMOTE    ] GHG: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T18:58:52.147630] [INFO ] [REMOTE    ] GHG: Fetching primary data for 2025-06.
[2025-10-24T18:58:52.627240] [INFO ] [REMOTE    ] GHG: Incremental fetch complete for 2025-06 (0.48 seconds).
[2025-10-24T18:58:52.947671] [INFO ] [REMOTE    ] GHG: Fetching primary data for 2025-07.
[2025-10-24T18:58:53.568728] [INFO ] [REMOTE    ] GHG: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T18:58:53.747668] [INFO ] [REMOTE    ] GHC: Fetching primary data for 2025-08.
[2025-10-24T18:58:54.310840] [INFO ] [REMOTE    ] GHC: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T18:58:54.547685] [INFO ] [REMOTE    ] GHC: Fetching primary data for 2025-09.
[2025-10-24T18:58:55.065686] [INFO ] [REMOTE    ] GHC: Incremental fetch complete for 2025-09 (0.52 seconds).
[2025-10-24T18:58:55.347633] [INFO ] [REMOTE    ] GHI: Fetching primary data for 2025-05.
[2025-10-24T18:58:56.022279] [INFO ] [REMOTE    ] GHI: Incremental fetch complete for 2025-05 (0.67 seconds).
[2025-10-24T18:58:56.147613] [INFO ] [REMOTE    ] GHLD: Fetching primary data for 2025-05.
[2025-10-24T18:58:56.569958] [INFO ] [REMOTE    ] GHLD: Incremental fetch complete for 2025-05 (0.42 seconds).
[2025-10-24T18:58:56.947674] [INFO ] [REMOTE    ] GHLD: Fetching primary data for 2025-06.
[2025-10-24T18:58:57.560246] [INFO ] [REMOTE    ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T18:58:57.747681] [INFO ] [REMOTE    ] GHLD: Fetching primary data for 2025-07.
[2025-10-24T18:58:58.329563] [INFO ] [REMOTE    ] GHLD: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T18:58:58.547728] [INFO ] [REMOTE    ] GHI: Fetching primary data for 2025-06.
[2025-10-24T18:58:59.226790] [INFO ] [REMOTE    ] GHI: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T18:58:59.347675] [INFO ] [REMOTE    ] GHLD: Fetching primary data for 2025-08.
[2025-10-24T18:59:00.034441] [INFO ] [REMOTE    ] GHLD: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T18:59:00.147673] [INFO ] [REMOTE    ] GHG: Fetching primary data for 2025-08.
[2025-10-24T18:59:00.720675] [INFO ] [REMOTE    ] GHG: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T18:59:00.947629] [INFO ] [REMOTE    ] GHLD: Fetching primary data for 2025-09.
[2025-10-24T18:59:01.747728] [INFO ] [REMOTE    ] GHI: Fetching primary data for 2025-07.
[2025-10-24T18:59:02.322612] [INFO ] [REMOTE    ] GHLD: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T18:59:02.547717] [INFO ] [REMOTE    ] GHC: Fetching primary data for 2025-10.
[2025-10-24T18:59:03.288469] [INFO ] [REMOTE    ] GHI: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T18:59:03.294219] [INFO ] [REMOTE    ] GHC: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T18:59:03.296705] [INFO ] [REMOTE    ] GHC: Full fetch complete (3703 records).
[2025-10-24T18:59:03.296796] [DEBUG] [VALIDATOR ] GHC: Validating primary data.
[2025-10-24T18:59:03.357269] [INFO ] [REMOTE    ] GHI: Fetching primary data for 2025-08.
[2025-10-24T18:59:03.645805] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present.
[2025-10-24T18:59:03.645880] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed.
[2025-10-24T18:59:03.645999] [INFO ] [MAIN      ] GHC: Fetched primary data is valid.
[2025-10-24T18:59:03.646037] [DEBUG] [LOCAL     ] GHC: Saving primary data.
[2025-10-24T18:59:03.646203] [FATAL] [LOCAL     ] GHC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:59:03.646281] [FATAL] [MAIN      ] GHC: Failed to save primary data.
[2025-10-24T18:59:03.646325] [WARN ] [MAIN      ] GHC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:59:03.646360] [INFO ] [LOCAL     ] GHC: Starting deletion of primary data.
[2025-10-24T18:59:03.646434] [DEBUG] [LOCAL     ] GHC: No primary data file found to delete.
[2025-10-24T18:59:03.646489] [INFO ] [LOCAL     ] GHC: Starting deletion of derivative data.
[2025-10-24T18:59:03.646819] [DEBUG] [LOCAL     ] GHC: Deleted derivative data file.
[2025-10-24T18:59:03.646905] [INFO ] [MAIN      ] Update Progress: 929/2366 symbols completed. GHC took 33.8s. Estimated remaining: 3h 4m 5s. Rate: 7.8 symbols/min
[2025-10-24T18:59:03.815363] [INFO ] [MAIN      ] GHM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:59:03.831251] [DEBUG] [LOCAL     ] GHM: Loaded 14417 existing records from primary storage.
[2025-10-24T18:59:03.831474] [INFO ] [MAIN      ] GHM: Loaded 14417 existing records.
[2025-10-24T18:59:04.015489] [WARN ] [MAIN      ] GHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:59:04.015889] [INFO ] [MAIN      ] GHM: Wiping existing primary data before full refresh.
[2025-10-24T18:59:04.015961] [INFO ] [LOCAL     ] GHM: Starting deletion of primary data.
[2025-10-24T18:59:04.016345] [DEBUG] [LOCAL     ] GHM: Deleted primary data file.
[2025-10-24T18:59:04.016422] [INFO ] [MAIN      ] GHM: Starting full primary refresh.
[2025-10-24T18:59:04.158408] [INFO ] [REMOTE    ] GHG: Fetching primary data for 2025-09.
[2025-10-24T18:59:04.227580] [INFO ] [REMOTE    ] GHI: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T18:59:04.510550] [INFO ] [REMOTE    ] GHM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:59:04.899270] [INFO ] [REMOTE    ] GHG: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T18:59:04.947722] [INFO ] [REMOTE    ] GHM: Fetching primary data for 2025-01.
[2025-10-24T18:59:05.747637] [INFO ] [REMOTE    ] GHG: Fetching primary data for 2025-10.
[2025-10-24T18:59:05.833398] [INFO ] [REMOTE    ] GHM: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T18:59:06.419011] [INFO ] [REMOTE    ] GHG: Incremental fetch complete for 2025-10 (0.67 seconds).
[2025-10-24T18:59:06.420179] [INFO ] [REMOTE    ] GHG: Full fetch complete (4213 records).
[2025-10-24T18:59:06.420246] [DEBUG] [VALIDATOR ] GHG: Validating primary data.
[2025-10-24T18:59:06.561001] [INFO ] [REMOTE    ] GHM: Fetching primary data for 2025-02.
[2025-10-24T18:59:06.789487] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present.
[2025-10-24T18:59:06.789555] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed.
[2025-10-24T18:59:06.789698] [INFO ] [MAIN      ] GHG: Fetched primary data is valid.
[2025-10-24T18:59:06.789757] [DEBUG] [LOCAL     ] GHG: Saving primary data.
[2025-10-24T18:59:06.789929] [FATAL] [LOCAL     ] GHG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:59:06.790008] [FATAL] [MAIN      ] GHG: Failed to save primary data.
[2025-10-24T18:59:06.790048] [WARN ] [MAIN      ] GHG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:59:06.790082] [INFO ] [LOCAL     ] GHG: Starting deletion of primary data.
[2025-10-24T18:59:06.790149] [DEBUG] [LOCAL     ] GHG: No primary data file found to delete.
[2025-10-24T18:59:06.790210] [INFO ] [LOCAL     ] GHG: Starting deletion of derivative data.
[2025-10-24T18:59:06.790370] [DEBUG] [LOCAL     ] GHG: Deleted derivative data file.
[2025-10-24T18:59:06.790456] [INFO ] [MAIN      ] Update Progress: 930/2366 symbols completed. GHG took 35.2s. Estimated remaining: 3h 3m 51s. Rate: 7.8 symbols/min
[2025-10-24T18:59:06.958781] [INFO ] [MAIN      ] GHY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:59:06.980001] [DEBUG] [LOCAL     ] GHY: Loaded 21009 existing records from primary storage.
[2025-10-24T18:59:06.980253] [INFO ] [MAIN      ] GHY: Loaded 21009 existing records.
[2025-10-24T18:59:07.157133] [WARN ] [MAIN      ] GHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:59:07.157359] [INFO ] [MAIN      ] GHY: Wiping existing primary data before full refresh.
[2025-10-24T18:59:07.157426] [INFO ] [LOCAL     ] GHY: Starting deletion of primary data.
[2025-10-24T18:59:07.157745] [DEBUG] [LOCAL     ] GHY: Deleted primary data file.
[2025-10-24T18:59:07.157834] [INFO ] [MAIN      ] GHY: Starting full primary refresh.
[2025-10-24T18:59:07.355957] [INFO ] [REMOTE    ] GHI: Fetching primary data for 2025-09.
[2025-10-24T18:59:07.531284] [INFO ] [REMOTE    ] GHY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:59:07.830703] [INFO ] [REMOTE    ] GHM: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T18:59:08.142843] [INFO ] [REMOTE    ] GHI: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T18:59:08.147605] [INFO ] [REMOTE    ] GHI: Fetching primary data for 2025-10.
[2025-10-24T18:59:08.947622] [INFO ] [REMOTE    ] GHM: Fetching primary data for 2025-03.
[2025-10-24T18:59:09.051932] [INFO ] [REMOTE    ] GHI: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T18:59:09.054876] [INFO ] [REMOTE    ] GHI: Full fetch complete (11399 records).
[2025-10-24T18:59:09.054945] [DEBUG] [VALIDATOR ] GHI: Validating primary data.
[2025-10-24T18:59:09.442098] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present.
[2025-10-24T18:59:09.442199] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed.
[2025-10-24T18:59:09.442502] [INFO ] [MAIN      ] GHI: Fetched primary data is valid.
[2025-10-24T18:59:09.442546] [DEBUG] [LOCAL     ] GHI: Saving primary data.
[2025-10-24T18:59:09.442800] [FATAL] [LOCAL     ] GHI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:59:09.442892] [FATAL] [MAIN      ] GHI: Failed to save primary data.
[2025-10-24T18:59:09.442937] [WARN ] [MAIN      ] GHI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:59:09.442975] [INFO ] [LOCAL     ] GHI: Starting deletion of primary data.
[2025-10-24T18:59:09.443027] [DEBUG] [LOCAL     ] GHI: No primary data file found to delete.
[2025-10-24T18:59:09.443064] [INFO ] [LOCAL     ] GHI: Starting deletion of derivative data.
[2025-10-24T18:59:09.443196] [DEBUG] [LOCAL     ] GHI: Deleted derivative data file.
[2025-10-24T18:59:09.443266] [INFO ] [MAIN      ] Update Progress: 931/2366 symbols completed. GHI took 31.8s. Estimated remaining: 3h 3m 35s. Rate: 7.8 symbols/min
[2025-10-24T18:59:09.620939] [INFO ] [MAIN      ] GIB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:59:09.651869] [DEBUG] [LOCAL     ] GIB: Loaded 31579 existing records from primary storage.
[2025-10-24T18:59:09.652288] [INFO ] [MAIN      ] GIB: Loaded 31579 existing records.
[2025-10-24T18:59:09.749842] [INFO ] [REMOTE    ] GHLD: Fetching primary data for 2025-10.
[2025-10-24T18:59:09.841972] [WARN ] [MAIN      ] GIB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:59:09.842179] [INFO ] [MAIN      ] GIB: Wiping existing primary data before full refresh.
[2025-10-24T18:59:09.842310] [INFO ] [LOCAL     ] GIB: Starting deletion of primary data.
[2025-10-24T18:59:09.843159] [DEBUG] [LOCAL     ] GIB: Deleted primary data file.
[2025-10-24T18:59:09.843219] [INFO ] [MAIN      ] GIB: Starting full primary refresh.
[2025-10-24T18:59:09.972259] [INFO ] [REMOTE    ] GHM: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T18:59:10.231517] [INFO ] [REMOTE    ] GIB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:59:10.481226] [INFO ] [REMOTE    ] GHLD: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T18:59:10.482548] [INFO ] [REMOTE    ] GHLD: Full fetch complete (5149 records).
[2025-10-24T18:59:10.482616] [DEBUG] [VALIDATOR ] GHLD: Validating primary data.
[2025-10-24T18:59:10.552792] [INFO ] [REMOTE    ] GHY: Fetching primary data for 2025-01.
[2025-10-24T18:59:10.849556] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present.
[2025-10-24T18:59:10.849671] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed.
[2025-10-24T18:59:10.849822] [INFO ] [MAIN      ] GHLD: Fetched primary data is valid.
[2025-10-24T18:59:10.849862] [DEBUG] [LOCAL     ] GHLD: Saving primary data.
[2025-10-24T18:59:10.850037] [FATAL] [LOCAL     ] GHLD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:59:10.850114] [FATAL] [MAIN      ] GHLD: Failed to save primary data.
[2025-10-24T18:59:10.850156] [WARN ] [MAIN      ] GHLD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:59:10.850189] [INFO ] [LOCAL     ] GHLD: Starting deletion of primary data.
[2025-10-24T18:59:10.850237] [DEBUG] [LOCAL     ] GHLD: No primary data file found to delete.
[2025-10-24T18:59:10.850272] [INFO ] [LOCAL     ] GHLD: Starting deletion of derivative data.
[2025-10-24T18:59:10.850404] [DEBUG] [LOCAL     ] GHLD: Deleted derivative data file.
[2025-10-24T18:59:10.850487] [INFO ] [MAIN      ] Update Progress: 932/2366 symbols completed. GHLD took 27.2s. Estimated remaining: 3h 3m 18s. Rate: 7.8 symbols/min
[2025-10-24T18:59:11.027061] [INFO ] [MAIN      ] GIC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:59:11.042583] [DEBUG] [LOCAL     ] GIC: Loaded 13240 existing records from primary storage.
[2025-10-24T18:59:11.042840] [INFO ] [MAIN      ] GIC: Loaded 13240 existing records.
[2025-10-24T18:59:11.234234] [WARN ] [MAIN      ] GIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:59:11.234480] [INFO ] [MAIN      ] GIC: Wiping existing primary data before full refresh.
[2025-10-24T18:59:11.234558] [INFO ] [LOCAL     ] GIC: Starting deletion of primary data.
[2025-10-24T18:59:11.234792] [DEBUG] [LOCAL     ] GIC: Deleted primary data file.
[2025-10-24T18:59:11.234848] [INFO ] [MAIN      ] GIC: Starting full primary refresh.
[2025-10-24T18:59:11.352876] [INFO ] [REMOTE    ] GHM: Fetching primary data for 2025-04.
[2025-10-24T18:59:11.605733] [INFO ] [REMOTE    ] GIC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:59:12.035382] [INFO ] [REMOTE    ] GHY: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T18:59:12.147607] [INFO ] [REMOTE    ] GHY: Fetching primary data for 2025-02.
[2025-10-24T18:59:12.226483] [INFO ] [REMOTE    ] GHM: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T18:59:12.947716] [INFO ] [REMOTE    ] GHM: Fetching primary data for 2025-05.
[2025-10-24T18:59:13.123544] [INFO ] [REMOTE    ] GHY: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T18:59:13.747802] [INFO ] [REMOTE    ] GIC: Fetching primary data for 2025-01.
[2025-10-24T18:59:13.782699] [INFO ] [REMOTE    ] GHM: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T18:59:14.547729] [INFO ] [REMOTE    ] GHM: Fetching primary data for 2025-06.
[2025-10-24T18:59:14.714302] [INFO ] [REMOTE    ] GIC: Incremental fetch complete for 2025-01 (0.97 seconds).
[2025-10-24T18:59:15.347701] [INFO ] [REMOTE    ] GHY: Fetching primary data for 2025-03.
[2025-10-24T18:59:15.552809] [INFO ] [REMOTE    ] GHM: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T18:59:16.147669] [INFO ] [REMOTE    ] GIB: Fetching primary data for 2025-01.
[2025-10-24T18:59:16.458197] [INFO ] [REMOTE    ] GHY: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T18:59:16.947729] [INFO ] [REMOTE    ] GHM: Fetching primary data for 2025-07.
[2025-10-24T18:59:17.369051] [INFO ] [REMOTE    ] GIB: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T18:59:17.611420] [INFO ] [REMOTE    ] GHM: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T18:59:17.747635] [INFO ] [REMOTE    ] GHY: Fetching primary data for 2025-04.
[2025-10-24T18:59:18.547739] [INFO ] [REMOTE    ] GHM: Fetching primary data for 2025-08.
[2025-10-24T18:59:19.032248] [INFO ] [REMOTE    ] GHY: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T18:59:19.347744] [INFO ] [REMOTE    ] GHY: Fetching primary data for 2025-05.
[2025-10-24T18:59:19.532243] [INFO ] [REMOTE    ] GHM: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T18:59:20.147635] [INFO ] [REMOTE    ] GIC: Fetching primary data for 2025-02.
[2025-10-24T18:59:20.229250] [INFO ] [REMOTE    ] GHY: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T18:59:20.947613] [INFO ] [REMOTE    ] GHM: Fetching primary data for 2025-09.
[2025-10-24T18:59:20.997106] [INFO ] [REMOTE    ] GIC: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T18:59:21.747696] [INFO ] [REMOTE    ] GHY: Fetching primary data for 2025-06.
[2025-10-24T18:59:21.929496] [INFO ] [REMOTE    ] GHM: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T18:59:22.547701] [INFO ] [REMOTE    ] GHM: Fetching primary data for 2025-10.
[2025-10-24T18:59:22.712157] [INFO ] [REMOTE    ] GHY: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T18:59:23.347612] [INFO ] [REMOTE    ] GHY: Fetching primary data for 2025-07.
[2025-10-24T18:59:23.727548] [INFO ] [REMOTE    ] GHM: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T18:59:23.731719] [INFO ] [REMOTE    ] GHM: Full fetch complete (21867 records).
[2025-10-24T18:59:23.731887] [DEBUG] [VALIDATOR ] GHM: Validating primary data.
[2025-10-24T18:59:24.105322] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present.
[2025-10-24T18:59:24.105452] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed.
[2025-10-24T18:59:24.105962] [INFO ] [MAIN      ] GHM: Fetched primary data is valid.
[2025-10-24T18:59:24.106032] [DEBUG] [LOCAL     ] GHM: Saving primary data.
[2025-10-24T18:59:24.106323] [FATAL] [LOCAL     ] GHM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:59:24.106409] [FATAL] [MAIN      ] GHM: Failed to save primary data.
[2025-10-24T18:59:24.106451] [WARN ] [MAIN      ] GHM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:59:24.106486] [INFO ] [LOCAL     ] GHM: Starting deletion of primary data.
[2025-10-24T18:59:24.106535] [DEBUG] [LOCAL     ] GHM: No primary data file found to delete.
[2025-10-24T18:59:24.106569] [INFO ] [LOCAL     ] GHM: Starting deletion of derivative data.
[2025-10-24T18:59:24.106746] [DEBUG] [LOCAL     ] GHM: Deleted derivative data file.
[2025-10-24T18:59:24.106832] [INFO ] [MAIN      ] Update Progress: 933/2366 symbols completed. GHM took 20.5s. Estimated remaining: 3h 3m 19s. Rate: 7.8 symbols/min
[2025-10-24T18:59:24.152761] [INFO ] [REMOTE    ] GIC: Fetching primary data for 2025-03.
[2025-10-24T18:59:24.297943] [INFO ] [MAIN      ] GIL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:59:24.342692] [DEBUG] [LOCAL     ] GIL: Loaded 44321 existing records from primary storage.
[2025-10-24T18:59:24.343016] [INFO ] [MAIN      ] GIL: Loaded 44321 existing records.
[2025-10-24T18:59:24.535076] [WARN ] [MAIN      ] GIL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:59:24.535367] [INFO ] [MAIN      ] GIL: Wiping existing primary data before full refresh.
[2025-10-24T18:59:24.535441] [INFO ] [LOCAL     ] GIL: Starting deletion of primary data.
[2025-10-24T18:59:24.549563] [DEBUG] [LOCAL     ] GIL: Deleted primary data file.
[2025-10-24T18:59:24.549683] [INFO ] [MAIN      ] GIL: Starting full primary refresh.
[2025-10-24T18:59:24.582759] [INFO ] [REMOTE    ] GHY: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T18:59:24.927510] [INFO ] [REMOTE    ] GIL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:59:24.947602] [INFO ] [REMOTE    ] GIL: Fetching primary data for 2025-01.
[2025-10-24T18:59:25.093454] [INFO ] [REMOTE    ] GIC: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T18:59:25.747681] [INFO ] [REMOTE    ] GIB: Fetching primary data for 2025-02.
[2025-10-24T18:59:26.250876] [INFO ] [REMOTE    ] GIL: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T18:59:26.547686] [INFO ] [REMOTE    ] GHY: Fetching primary data for 2025-08.
[2025-10-24T18:59:27.289454] [INFO ] [REMOTE    ] GIB: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T18:59:27.347707] [INFO ] [REMOTE    ] GIB: Fetching primary data for 2025-03.
[2025-10-24T18:59:27.572867] [INFO ] [REMOTE    ] GHY: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T18:59:28.147726] [INFO ] [REMOTE    ] GHY: Fetching primary data for 2025-09.
[2025-10-24T18:59:28.538391] [INFO ] [REMOTE    ] GIB: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T18:59:28.947635] [INFO ] [REMOTE    ] GIL: Fetching primary data for 2025-02.
[2025-10-24T18:59:29.162105] [INFO ] [REMOTE    ] GHY: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T18:59:29.747636] [INFO ] [REMOTE    ] GIB: Fetching primary data for 2025-04.
[2025-10-24T18:59:30.422058] [INFO ] [REMOTE    ] GIL: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T18:59:30.547674] [INFO ] [REMOTE    ] GIL: Fetching primary data for 2025-03.
[2025-10-24T18:59:30.911742] [INFO ] [REMOTE    ] GIB: Incremental fetch complete for 2025-04 (1.16 seconds).
[2025-10-24T18:59:31.347636] [INFO ] [REMOTE    ] GIC: Fetching primary data for 2025-04.
[2025-10-24T18:59:31.732179] [INFO ] [REMOTE    ] GIL: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T18:59:32.147681] [INFO ] [REMOTE    ] GIL: Fetching primary data for 2025-04.
[2025-10-24T18:59:32.365250] [INFO ] [REMOTE    ] GIC: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T18:59:32.947679] [INFO ] [REMOTE    ] GIC: Fetching primary data for 2025-05.
[2025-10-24T18:59:33.747622] [INFO ] [REMOTE    ] GHY: Fetching primary data for 2025-10.
[2025-10-24T18:59:33.750196] [INFO ] [REMOTE    ] GIL: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T18:59:33.769325] [INFO ] [REMOTE    ] GIC: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T18:59:34.547628] [INFO ] [REMOTE    ] GIL: Fetching primary data for 2025-05.
[2025-10-24T18:59:35.021196] [INFO ] [REMOTE    ] GHY: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T18:59:35.027923] [INFO ] [REMOTE    ] GHY: Full fetch complete (32210 records).
[2025-10-24T18:59:35.028042] [DEBUG] [VALIDATOR ] GHY: Validating primary data.
[2025-10-24T18:59:35.357327] [INFO ] [REMOTE    ] GIB: Fetching primary data for 2025-05.
[2025-10-24T18:59:35.395756] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present.
[2025-10-24T18:59:35.395843] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed.
[2025-10-24T18:59:35.396575] [INFO ] [MAIN      ] GHY: Fetched primary data is valid.
[2025-10-24T18:59:35.396616] [DEBUG] [LOCAL     ] GHY: Saving primary data.
[2025-10-24T18:59:35.396968] [FATAL] [LOCAL     ] GHY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:59:35.397049] [FATAL] [MAIN      ] GHY: Failed to save primary data.
[2025-10-24T18:59:35.397091] [WARN ] [MAIN      ] GHY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:59:35.397126] [INFO ] [LOCAL     ] GHY: Starting deletion of primary data.
[2025-10-24T18:59:35.397204] [DEBUG] [LOCAL     ] GHY: No primary data file found to delete.
[2025-10-24T18:59:35.397264] [INFO ] [LOCAL     ] GHY: Starting deletion of derivative data.
[2025-10-24T18:59:35.397423] [DEBUG] [LOCAL     ] GHY: Deleted derivative data file.
[2025-10-24T18:59:35.397515] [INFO ] [MAIN      ] Update Progress: 934/2366 symbols completed. GHY took 28.6s. Estimated remaining: 3h 3m 17s. Rate: 7.8 symbols/min
[2025-10-24T18:59:35.569319] [INFO ] [MAIN      ] GIS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:59:35.619546] [DEBUG] [LOCAL     ] GIS: Loaded 54065 existing records from primary storage.
[2025-10-24T18:59:35.619904] [INFO ] [MAIN      ] GIS: Loaded 54065 existing records.
[2025-10-24T18:59:35.806755] [WARN ] [MAIN      ] GIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:59:35.806958] [INFO ] [MAIN      ] GIS: Wiping existing primary data before full refresh.
[2025-10-24T18:59:35.807004] [INFO ] [LOCAL     ] GIS: Starting deletion of primary data.
[2025-10-24T18:59:35.807238] [DEBUG] [LOCAL     ] GIS: Deleted primary data file.
[2025-10-24T18:59:35.807293] [INFO ] [MAIN      ] GIS: Starting full primary refresh.
[2025-10-24T18:59:36.152958] [INFO ] [REMOTE    ] GIC: Fetching primary data for 2025-06.
[2025-10-24T18:59:36.165860] [INFO ] [REMOTE    ] GIS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:59:36.210703] [INFO ] [REMOTE    ] GIL: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T18:59:36.211414] [INFO ] [REMOTE    ] GIB: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T18:59:36.947629] [INFO ] [REMOTE    ] GIB: Fetching primary data for 2025-06.
[2025-10-24T18:59:36.961867] [INFO ] [REMOTE    ] GIC: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T18:59:37.747630] [INFO ] [REMOTE    ] GIC: Fetching primary data for 2025-07.
[2025-10-24T18:59:38.193953] [INFO ] [REMOTE    ] GIB: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T18:59:38.547719] [INFO ] [REMOTE    ] GIB: Fetching primary data for 2025-07.
[2025-10-24T18:59:38.568273] [INFO ] [REMOTE    ] GIC: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T18:59:39.347707] [INFO ] [REMOTE    ] GIS: Fetching primary data for 2025-01.
[2025-10-24T18:59:40.147629] [INFO ] [REMOTE    ] GIL: Fetching primary data for 2025-06.
[2025-10-24T18:59:40.275754] [INFO ] [REMOTE    ] GIB: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T18:59:40.947624] [INFO ] [REMOTE    ] GIB: Fetching primary data for 2025-08.
[2025-10-24T18:59:41.205195] [INFO ] [REMOTE    ] GIS: Incremental fetch complete for 2025-01 (1.86 seconds).
[2025-10-24T18:59:41.557235] [INFO ] [REMOTE    ] GIL: Incremental fetch complete for 2025-06 (1.41 seconds).
[2025-10-24T18:59:41.747687] [INFO ] [REMOTE    ] GIS: Fetching primary data for 2025-02.
[2025-10-24T18:59:41.979379] [INFO ] [REMOTE    ] GIB: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T18:59:42.547687] [INFO ] [REMOTE    ] GIC: Fetching primary data for 2025-08.
[2025-10-24T18:59:43.347638] [INFO ] [REMOTE    ] GIL: Fetching primary data for 2025-07.
[2025-10-24T18:59:43.503790] [INFO ] [REMOTE    ] GIS: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T18:59:43.597225] [INFO ] [REMOTE    ] GIC: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T18:59:44.147681] [INFO ] [REMOTE    ] GIS: Fetching primary data for 2025-03.
[2025-10-24T18:59:44.941572] [INFO ] [REMOTE    ] GIL: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T18:59:44.949672] [INFO ] [REMOTE    ] GIB: Fetching primary data for 2025-09.
[2025-10-24T18:59:45.747610] [INFO ] [REMOTE    ] GIL: Fetching primary data for 2025-08.
[2025-10-24T18:59:45.894131] [INFO ] [REMOTE    ] GIS: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T18:59:46.193298] [INFO ] [REMOTE    ] GIB: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T18:59:46.547712] [INFO ] [REMOTE    ] GIC: Fetching primary data for 2025-09.
[2025-10-24T18:59:47.253940] [INFO ] [REMOTE    ] GIL: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T18:59:47.347619] [INFO ] [REMOTE    ] GIS: Fetching primary data for 2025-04.
[2025-10-24T18:59:47.428796] [INFO ] [REMOTE    ] GIC: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T18:59:48.147678] [INFO ] [REMOTE    ] GIC: Fetching primary data for 2025-10.
[2025-10-24T18:59:48.947611] [INFO ] [REMOTE    ] GIL: Fetching primary data for 2025-09.
[2025-10-24T18:59:48.985909] [INFO ] [REMOTE    ] GIC: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T18:59:48.988729] [INFO ] [REMOTE    ] GIC: Full fetch complete (19639 records).
[2025-10-24T18:59:48.988804] [DEBUG] [VALIDATOR ] GIC: Validating primary data.
[2025-10-24T18:59:49.377789] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present.
[2025-10-24T18:59:49.377894] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed.
[2025-10-24T18:59:49.378410] [INFO ] [MAIN      ] GIC: Fetched primary data is valid.
[2025-10-24T18:59:49.378490] [DEBUG] [LOCAL     ] GIC: Saving primary data.
[2025-10-24T18:59:49.378923] [FATAL] [LOCAL     ] GIC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:59:49.379156] [FATAL] [MAIN      ] GIC: Failed to save primary data.
[2025-10-24T18:59:49.379225] [WARN ] [MAIN      ] GIC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:59:49.394826] [INFO ] [LOCAL     ] GIC: Starting deletion of primary data.
[2025-10-24T18:59:49.404463] [DEBUG] [LOCAL     ] GIC: No primary data file found to delete.
[2025-10-24T18:59:49.408155] [INFO ] [LOCAL     ] GIC: Starting deletion of derivative data.
[2025-10-24T18:59:49.408376] [DEBUG] [LOCAL     ] GIC: Deleted derivative data file.
[2025-10-24T18:59:49.408481] [INFO ] [MAIN      ] Update Progress: 935/2366 symbols completed. GIC took 38.6s. Estimated remaining: 3h 3m 19s. Rate: 7.8 symbols/min
[2025-10-24T18:59:49.443623] [INFO ] [REMOTE    ] GIS: Incremental fetch complete for 2025-04 (2.10 seconds).
[2025-10-24T18:59:49.597317] [INFO ] [MAIN      ] GKOS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:59:49.638379] [DEBUG] [LOCAL     ] GKOS: Loaded 42738 existing records from primary storage.
[2025-10-24T18:59:49.638712] [INFO ] [MAIN      ] GKOS: Loaded 42738 existing records.
[2025-10-24T18:59:49.752763] [INFO ] [REMOTE    ] GIB: Fetching primary data for 2025-10.
[2025-10-24T18:59:49.823314] [WARN ] [MAIN      ] GKOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:59:49.823522] [INFO ] [MAIN      ] GKOS: Wiping existing primary data before full refresh.
[2025-10-24T18:59:49.823569] [INFO ] [LOCAL     ] GKOS: Starting deletion of primary data.
[2025-10-24T18:59:49.823789] [DEBUG] [LOCAL     ] GKOS: Deleted primary data file.
[2025-10-24T18:59:49.823847] [INFO ] [MAIN      ] GKOS: Starting full primary refresh.
[2025-10-24T18:59:50.180096] [INFO ] [REMOTE    ] GKOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:59:50.378841] [INFO ] [REMOTE    ] GIL: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T18:59:50.547610] [INFO ] [REMOTE    ] GIL: Fetching primary data for 2025-10.
[2025-10-24T18:59:50.953506] [INFO ] [REMOTE    ] GIB: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T18:59:50.959405] [INFO ] [REMOTE    ] GIB: Full fetch complete (46455 records).
[2025-10-24T18:59:50.959530] [DEBUG] [VALIDATOR ] GIB: Validating primary data.
[2025-10-24T18:59:51.353557] [INFO ] [REMOTE    ] GIS: Fetching primary data for 2025-05.
[2025-10-24T18:59:51.380080] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present.
[2025-10-24T18:59:51.380162] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed.
[2025-10-24T18:59:51.380998] [INFO ] [MAIN      ] GIB: Fetched primary data is valid.
[2025-10-24T18:59:51.381150] [DEBUG] [LOCAL     ] GIB: Saving primary data.
[2025-10-24T18:59:51.381742] [FATAL] [LOCAL     ] GIB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:59:51.381837] [FATAL] [MAIN      ] GIB: Failed to save primary data.
[2025-10-24T18:59:51.381902] [WARN ] [MAIN      ] GIB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:59:51.381980] [INFO ] [LOCAL     ] GIB: Starting deletion of primary data.
[2025-10-24T18:59:51.382056] [DEBUG] [LOCAL     ] GIB: No primary data file found to delete.
[2025-10-24T18:59:51.382112] [INFO ] [LOCAL     ] GIB: Starting deletion of derivative data.
[2025-10-24T18:59:51.382276] [DEBUG] [LOCAL     ] GIB: Deleted derivative data file.
[2025-10-24T18:59:51.382372] [INFO ] [MAIN      ] Update Progress: 936/2366 symbols completed. GIB took 41.9s. Estimated remaining: 3h 3m 2s. Rate: 7.8 symbols/min
[2025-10-24T18:59:51.636390] [INFO ] [MAIN      ] GL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:59:51.697426] [DEBUG] [LOCAL     ] GL: Loaded 37689 existing records from primary storage.
[2025-10-24T18:59:51.697900] [INFO ] [MAIN      ] GL: Loaded 37689 existing records.
[2025-10-24T18:59:52.001188] [WARN ] [MAIN      ] GL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:59:52.001622] [INFO ] [MAIN      ] GL: Wiping existing primary data before full refresh.
[2025-10-24T18:59:52.001739] [INFO ] [LOCAL     ] GL: Starting deletion of primary data.
[2025-10-24T18:59:52.002148] [DEBUG] [LOCAL     ] GL: Deleted primary data file.
[2025-10-24T18:59:52.002284] [INFO ] [MAIN      ] GL: Starting full primary refresh.
[2025-10-24T18:59:52.154962] [INFO ] [REMOTE    ] GKOS: Fetching primary data for 2025-01.
[2025-10-24T18:59:52.227789] [INFO ] [REMOTE    ] GIL: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T18:59:52.338984] [INFO ] [REMOTE    ] GIL: Full fetch complete (62715 records).
[2025-10-24T18:59:52.358273] [DEBUG] [VALIDATOR ] GIL: Validating primary data.
[2025-10-24T18:59:52.595460] [INFO ] [REMOTE    ] GL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:59:52.855210] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present.
[2025-10-24T18:59:52.855291] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed.
[2025-10-24T18:59:52.856156] [INFO ] [MAIN      ] GIL: Fetched primary data is valid.
[2025-10-24T18:59:52.856220] [DEBUG] [LOCAL     ] GIL: Saving primary data.
[2025-10-24T18:59:52.856792] [FATAL] [LOCAL     ] GIL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T18:59:52.856882] [FATAL] [MAIN      ] GIL: Failed to save primary data.
[2025-10-24T18:59:52.856923] [WARN ] [MAIN      ] GIL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T18:59:52.856957] [INFO ] [LOCAL     ] GIL: Starting deletion of primary data.
[2025-10-24T18:59:52.857011] [DEBUG] [LOCAL     ] GIL: No primary data file found to delete.
[2025-10-24T18:59:52.857046] [INFO ] [LOCAL     ] GIL: Starting deletion of derivative data.
[2025-10-24T18:59:52.857222] [DEBUG] [LOCAL     ] GIL: Deleted derivative data file.
[2025-10-24T18:59:52.857822] [INFO ] [MAIN      ] Update Progress: 937/2366 symbols completed. GIL took 28.8s. Estimated remaining: 3h 2m 45s. Rate: 7.8 symbols/min
[2025-10-24T18:59:52.949108] [INFO ] [REMOTE    ] GL: Fetching primary data for 2025-01.
[2025-10-24T18:59:53.033194] [INFO ] [MAIN      ] GLOB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T18:59:53.079870] [DEBUG] [LOCAL     ] GLOB: Loaded 48426 existing records from primary storage.
[2025-10-24T18:59:53.080178] [INFO ] [MAIN      ] GLOB: Loaded 48426 existing records.
[2025-10-24T18:59:53.265763] [WARN ] [MAIN      ] GLOB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T18:59:53.266177] [INFO ] [MAIN      ] GLOB: Wiping existing primary data before full refresh.
[2025-10-24T18:59:53.266484] [INFO ] [LOCAL     ] GLOB: Starting deletion of primary data.
[2025-10-24T18:59:53.266862] [DEBUG] [LOCAL     ] GLOB: Deleted primary data file.
[2025-10-24T18:59:53.267019] [INFO ] [MAIN      ] GLOB: Starting full primary refresh.
[2025-10-24T18:59:53.497201] [INFO ] [REMOTE    ] GIS: Incremental fetch complete for 2025-05 (2.14 seconds).
[2025-10-24T18:59:53.641396] [INFO ] [REMOTE    ] GKOS: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T18:59:53.725666] [INFO ] [REMOTE    ] GLOB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T18:59:53.747608] [INFO ] [REMOTE    ] GLOB: Fetching primary data for 2025-01.
[2025-10-24T18:59:54.424076] [INFO ] [REMOTE    ] GL: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T18:59:54.547625] [INFO ] [REMOTE    ] GL: Fetching primary data for 2025-02.
[2025-10-24T18:59:54.732848] [INFO ] [REMOTE    ] GLOB: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T18:59:55.347731] [INFO ] [REMOTE    ] GLOB: Fetching primary data for 2025-02.
[2025-10-24T18:59:55.983327] [INFO ] [REMOTE    ] GL: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T18:59:56.147672] [INFO ] [REMOTE    ] GL: Fetching primary data for 2025-03.
[2025-10-24T18:59:56.327174] [INFO ] [REMOTE    ] GLOB: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T18:59:56.947669] [INFO ] [REMOTE    ] GLOB: Fetching primary data for 2025-03.
[2025-10-24T18:59:57.550397] [INFO ] [REMOTE    ] GL: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T18:59:57.747718] [INFO ] [REMOTE    ] GKOS: Fetching primary data for 2025-02.
[2025-10-24T18:59:58.547626] [INFO ] [REMOTE    ] GL: Fetching primary data for 2025-04.
[2025-10-24T18:59:58.597366] [INFO ] [REMOTE    ] GLOB: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T18:59:59.272980] [INFO ] [REMOTE    ] GKOS: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T18:59:59.347612] [INFO ] [REMOTE    ] GKOS: Fetching primary data for 2025-03.
[2025-10-24T18:59:59.937810] [INFO ] [REMOTE    ] GL: Incremental fetch complete for 2025-04 (1.39 seconds).
[2025-10-24T19:00:00.147687] [INFO ] [REMOTE    ] GLOB: Fetching primary data for 2025-04.
[2025-10-24T19:00:00.539313] [INFO ] [REMOTE    ] GKOS: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T19:00:00.947677] [INFO ] [REMOTE    ] GL: Fetching primary data for 2025-05.
[2025-10-24T19:00:01.747636] [INFO ] [REMOTE    ] GKOS: Fetching primary data for 2025-04.
[2025-10-24T19:00:02.003225] [INFO ] [REMOTE    ] GLOB: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T19:00:02.547723] [INFO ] [REMOTE    ] GLOB: Fetching primary data for 2025-05.
[2025-10-24T19:00:02.680199] [INFO ] [REMOTE    ] GL: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T19:00:03.347697] [INFO ] [REMOTE    ] GIS: Fetching primary data for 2025-06.
[2025-10-24T19:00:03.396859] [INFO ] [REMOTE    ] GKOS: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T19:00:04.147684] [INFO ] [REMOTE    ] GKOS: Fetching primary data for 2025-05.
[2025-10-24T19:00:04.318252] [INFO ] [REMOTE    ] GLOB: Incremental fetch complete for 2025-05 (1.77 seconds).
[2025-10-24T19:00:04.947719] [INFO ] [REMOTE    ] GL: Fetching primary data for 2025-06.
[2025-10-24T19:00:05.628762] [INFO ] [REMOTE    ] GIS: Incremental fetch complete for 2025-06 (2.28 seconds).
[2025-10-24T19:00:05.747694] [INFO ] [REMOTE    ] GIS: Fetching primary data for 2025-07.
[2025-10-24T19:00:06.071443] [INFO ] [REMOTE    ] GKOS: Incremental fetch complete for 2025-05 (1.92 seconds).
[2025-10-24T19:00:06.547690] [INFO ] [REMOTE    ] GLOB: Fetching primary data for 2025-06.
[2025-10-24T19:00:06.737531] [INFO ] [REMOTE    ] GL: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T19:00:07.347699] [INFO ] [REMOTE    ] GL: Fetching primary data for 2025-07.
[2025-10-24T19:00:08.091668] [INFO ] [REMOTE    ] GIS: Incremental fetch complete for 2025-07 (2.34 seconds).
[2025-10-24T19:00:08.147638] [INFO ] [REMOTE    ] GIS: Fetching primary data for 2025-08.
[2025-10-24T19:00:08.341236] [INFO ] [REMOTE    ] GLOB: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T19:00:08.816483] [INFO ] [REMOTE    ] GL: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T19:00:08.947636] [INFO ] [REMOTE    ] GL: Fetching primary data for 2025-08.
[2025-10-24T19:00:09.747634] [INFO ] [REMOTE    ] GKOS: Fetching primary data for 2025-06.
[2025-10-24T19:00:09.785316] [INFO ] [REMOTE    ] GIS: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T19:00:10.279880] [INFO ] [REMOTE    ] GL: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T19:00:10.547626] [INFO ] [REMOTE    ] GL: Fetching primary data for 2025-09.
[2025-10-24T19:00:11.096307] [INFO ] [REMOTE    ] GKOS: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T19:00:11.347710] [INFO ] [REMOTE    ] GLOB: Fetching primary data for 2025-07.
[2025-10-24T19:00:12.043063] [INFO ] [REMOTE    ] GL: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T19:00:12.147689] [INFO ] [REMOTE    ] GIS: Fetching primary data for 2025-09.
[2025-10-24T19:00:12.838342] [INFO ] [REMOTE    ] GLOB: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T19:00:12.947734] [INFO ] [REMOTE    ] GLOB: Fetching primary data for 2025-08.
[2025-10-24T19:00:13.747727] [INFO ] [REMOTE    ] GL: Fetching primary data for 2025-10.
[2025-10-24T19:00:14.189872] [INFO ] [REMOTE    ] GIS: Incremental fetch complete for 2025-09 (2.04 seconds).
[2025-10-24T19:00:14.252568] [INFO ] [REMOTE    ] GLOB: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T19:00:14.547692] [INFO ] [REMOTE    ] GIS: Fetching primary data for 2025-10.
[2025-10-24T19:00:15.353755] [INFO ] [REMOTE    ] GKOS: Fetching primary data for 2025-07.
[2025-10-24T19:00:15.356559] [INFO ] [REMOTE    ] GL: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T19:00:15.364368] [INFO ] [REMOTE    ] GL: Full fetch complete (54969 records).
[2025-10-24T19:00:15.364524] [DEBUG] [VALIDATOR ] GL: Validating primary data.
[2025-10-24T19:00:15.754421] [DEBUG] [VALIDATOR ] GL: All expected trading days are present.
[2025-10-24T19:00:15.754504] [DEBUG] [VALIDATOR ] GL: Primary data validation passed.
[2025-10-24T19:00:15.755265] [INFO ] [MAIN      ] GL: Fetched primary data is valid.
[2025-10-24T19:00:15.755327] [DEBUG] [LOCAL     ] GL: Saving primary data.
[2025-10-24T19:00:15.755876] [FATAL] [LOCAL     ] GL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:00:15.755979] [FATAL] [MAIN      ] GL: Failed to save primary data.
[2025-10-24T19:00:15.756048] [WARN ] [MAIN      ] GL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:00:15.756139] [INFO ] [LOCAL     ] GL: Starting deletion of primary data.
[2025-10-24T19:00:15.756215] [DEBUG] [LOCAL     ] GL: No primary data file found to delete.
[2025-10-24T19:00:15.756252] [INFO ] [LOCAL     ] GL: Starting deletion of derivative data.
[2025-10-24T19:00:15.756417] [DEBUG] [LOCAL     ] GL: Deleted derivative data file.
[2025-10-24T19:00:15.756749] [INFO ] [MAIN      ] Update Progress: 938/2366 symbols completed. GL took 24.4s. Estimated remaining: 3h 3m 1s. Rate: 7.8 symbols/min
[2025-10-24T19:00:15.930273] [INFO ] [MAIN      ] GLP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:00:15.943381] [DEBUG] [LOCAL     ] GLP: Loaded 9259 existing records from primary storage.
[2025-10-24T19:00:15.943604] [INFO ] [MAIN      ] GLP: Loaded 9259 existing records.
[2025-10-24T19:00:16.155022] [WARN ] [MAIN      ] GLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:00:16.155140] [INFO ] [REMOTE    ] GLOB: Fetching primary data for 2025-09.
[2025-10-24T19:00:16.156393] [INFO ] [MAIN      ] GLP: Wiping existing primary data before full refresh.
[2025-10-24T19:00:16.156472] [INFO ] [LOCAL     ] GLP: Starting deletion of primary data.
[2025-10-24T19:00:16.156715] [DEBUG] [LOCAL     ] GLP: Deleted primary data file.
[2025-10-24T19:00:16.156775] [INFO ] [MAIN      ] GLP: Starting full primary refresh.
[2025-10-24T19:00:16.511176] [INFO ] [REMOTE    ] GLP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:00:16.948429] [INFO ] [REMOTE    ] GLP: Fetching primary data for 2025-01.
[2025-10-24T19:00:16.960017] [INFO ] [REMOTE    ] GKOS: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T19:00:17.375156] [INFO ] [REMOTE    ] GIS: Incremental fetch complete for 2025-10 (2.83 seconds).
[2025-10-24T19:00:17.386227] [INFO ] [REMOTE    ] GIS: Full fetch complete (77844 records).
[2025-10-24T19:00:17.386379] [DEBUG] [VALIDATOR ] GIS: Validating primary data.
[2025-10-24T19:00:17.757439] [INFO ] [REMOTE    ] GKOS: Fetching primary data for 2025-08.
[2025-10-24T19:00:17.782395] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present.
[2025-10-24T19:00:17.782668] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed.
[2025-10-24T19:00:17.783918] [INFO ] [MAIN      ] GIS: Fetched primary data is valid.
[2025-10-24T19:00:17.784361] [DEBUG] [LOCAL     ] GIS: Saving primary data.
[2025-10-24T19:00:17.793237] [FATAL] [LOCAL     ] GIS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:00:17.795102] [FATAL] [MAIN      ] GIS: Failed to save primary data.
[2025-10-24T19:00:17.795747] [WARN ] [MAIN      ] GIS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:00:17.796206] [INFO ] [LOCAL     ] GIS: Starting deletion of primary data.
[2025-10-24T19:00:17.796138] [INFO ] [REMOTE    ] GLP: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T19:00:17.796332] [DEBUG] [LOCAL     ] GIS: No primary data file found to delete.
[2025-10-24T19:00:17.796443] [INFO ] [LOCAL     ] GIS: Starting deletion of derivative data.
[2025-10-24T19:00:17.801351] [DEBUG] [LOCAL     ] GIS: Deleted derivative data file.
[2025-10-24T19:00:17.801732] [INFO ] [MAIN      ] Update Progress: 939/2366 symbols completed. GIS took 42.4s. Estimated remaining: 3h 2m 45s. Rate: 7.8 symbols/min
[2025-10-24T19:00:17.980714] [INFO ] [MAIN      ] GLW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:00:18.043865] [DEBUG] [LOCAL     ] GLW: Loaded 54025 existing records from primary storage.
[2025-10-24T19:00:18.044213] [INFO ] [MAIN      ] GLW: Loaded 54025 existing records.
[2025-10-24T19:00:18.259314] [WARN ] [MAIN      ] GLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:00:18.262387] [INFO ] [MAIN      ] GLW: Wiping existing primary data before full refresh.
[2025-10-24T19:00:18.262505] [INFO ] [LOCAL     ] GLW: Starting deletion of primary data.
[2025-10-24T19:00:18.263217] [DEBUG] [LOCAL     ] GLW: Deleted primary data file.
[2025-10-24T19:00:18.263283] [INFO ] [MAIN      ] GLW: Starting full primary refresh.
[2025-10-24T19:00:18.264492] [INFO ] [REMOTE    ] GLOB: Incremental fetch complete for 2025-09 (2.11 seconds).
[2025-10-24T19:00:18.552938] [INFO ] [REMOTE    ] GLOB: Fetching primary data for 2025-10.
[2025-10-24T19:00:18.641819] [INFO ] [REMOTE    ] GLW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:00:19.346191] [INFO ] [REMOTE    ] GKOS: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T19:00:19.354224] [INFO ] [REMOTE    ] GLW: Fetching primary data for 2025-01.
[2025-10-24T19:00:20.147681] [INFO ] [REMOTE    ] GKOS: Fetching primary data for 2025-09.
[2025-10-24T19:00:20.443284] [INFO ] [REMOTE    ] GLOB: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T19:00:20.453720] [INFO ] [REMOTE    ] GLOB: Full fetch complete (66429 records).
[2025-10-24T19:00:20.453869] [DEBUG] [VALIDATOR ] GLOB: Validating primary data.
[2025-10-24T19:00:20.849914] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present.
[2025-10-24T19:00:20.849996] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed.
[2025-10-24T19:00:20.850889] [INFO ] [MAIN      ] GLOB: Fetched primary data is valid.
[2025-10-24T19:00:20.850950] [DEBUG] [LOCAL     ] GLOB: Saving primary data.
[2025-10-24T19:00:20.851560] [FATAL] [LOCAL     ] GLOB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:00:20.851682] [FATAL] [MAIN      ] GLOB: Failed to save primary data.
[2025-10-24T19:00:20.851735] [WARN ] [MAIN      ] GLOB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:00:20.851785] [INFO ] [LOCAL     ] GLOB: Starting deletion of primary data.
[2025-10-24T19:00:20.851879] [DEBUG] [LOCAL     ] GLOB: No primary data file found to delete.
[2025-10-24T19:00:20.851929] [INFO ] [LOCAL     ] GLOB: Starting deletion of derivative data.
[2025-10-24T19:00:20.852097] [DEBUG] [LOCAL     ] GLOB: Deleted derivative data file.
[2025-10-24T19:00:20.852677] [INFO ] [MAIN      ] Update Progress: 940/2366 symbols completed. GLOB took 28.0s. Estimated remaining: 3h 2m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:00:20.953281] [INFO ] [REMOTE    ] GLP: Fetching primary data for 2025-02.
[2025-10-24T19:00:21.029962] [INFO ] [MAIN      ] GM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:00:21.085017] [DEBUG] [LOCAL     ] GM: Loaded 54119 existing records from primary storage.
[2025-10-24T19:00:21.085334] [INFO ] [MAIN      ] GM: Loaded 54119 existing records.
[2025-10-24T19:00:21.270465] [WARN ] [MAIN      ] GM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:00:21.270995] [INFO ] [MAIN      ] GM: Wiping existing primary data before full refresh.
[2025-10-24T19:00:21.271197] [INFO ] [LOCAL     ] GM: Starting deletion of primary data.
[2025-10-24T19:00:21.271682] [DEBUG] [LOCAL     ] GM: Deleted primary data file.
[2025-10-24T19:00:21.271744] [INFO ] [MAIN      ] GM: Starting full primary refresh.
[2025-10-24T19:00:21.398819] [INFO ] [REMOTE    ] GLW: Incremental fetch complete for 2025-01 (2.04 seconds).
[2025-10-24T19:00:21.678896] [INFO ] [REMOTE    ] GM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:00:21.704850] [INFO ] [REMOTE    ] GKOS: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T19:00:21.747609] [INFO ] [REMOTE    ] GM: Fetching primary data for 2025-01.
[2025-10-24T19:00:21.765360] [INFO ] [REMOTE    ] GLP: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T19:00:22.547670] [INFO ] [REMOTE    ] GKOS: Fetching primary data for 2025-10.
[2025-10-24T19:00:23.347715] [INFO ] [REMOTE    ] GLW: Fetching primary data for 2025-02.
[2025-10-24T19:00:23.977991] [INFO ] [REMOTE    ] GM: Incremental fetch complete for 2025-01 (2.23 seconds).
[2025-10-24T19:00:24.115478] [INFO ] [REMOTE    ] GKOS: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T19:00:24.123235] [INFO ] [REMOTE    ] GKOS: Full fetch complete (60701 records).
[2025-10-24T19:00:24.123340] [DEBUG] [VALIDATOR ] GKOS: Validating primary data.
[2025-10-24T19:00:24.155422] [INFO ] [REMOTE    ] GLP: Fetching primary data for 2025-03.
[2025-10-24T19:00:24.527992] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present.
[2025-10-24T19:00:24.528080] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed.
[2025-10-24T19:00:24.528904] [INFO ] [MAIN      ] GKOS: Fetched primary data is valid.
[2025-10-24T19:00:24.528967] [DEBUG] [LOCAL     ] GKOS: Saving primary data.
[2025-10-24T19:00:24.529515] [FATAL] [LOCAL     ] GKOS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:00:24.529606] [FATAL] [MAIN      ] GKOS: Failed to save primary data.
[2025-10-24T19:00:24.529679] [WARN ] [MAIN      ] GKOS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:00:24.529735] [INFO ] [LOCAL     ] GKOS: Starting deletion of primary data.
[2025-10-24T19:00:24.529790] [DEBUG] [LOCAL     ] GKOS: No primary data file found to delete.
[2025-10-24T19:00:24.529825] [INFO ] [LOCAL     ] GKOS: Starting deletion of derivative data.
[2025-10-24T19:00:24.529953] [DEBUG] [LOCAL     ] GKOS: Deleted derivative data file.
[2025-10-24T19:00:24.530163] [INFO ] [MAIN      ] Update Progress: 941/2366 symbols completed. GKOS took 35.1s. Estimated remaining: 3h 2m 16s. Rate: 7.8 symbols/min
[2025-10-24T19:00:24.706538] [INFO ] [MAIN      ] GME: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:00:24.759055] [DEBUG] [LOCAL     ] GME: Loaded 54171 existing records from primary storage.
[2025-10-24T19:00:24.759379] [INFO ] [MAIN      ] GME: Loaded 54171 existing records.
[2025-10-24T19:00:24.939668] [WARN ] [MAIN      ] GME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:00:24.940321] [INFO ] [MAIN      ] GME: Wiping existing primary data before full refresh.
[2025-10-24T19:00:24.940424] [INFO ] [LOCAL     ] GME: Starting deletion of primary data.
[2025-10-24T19:00:24.940836] [DEBUG] [LOCAL     ] GME: Deleted primary data file.
[2025-10-24T19:00:24.940929] [INFO ] [MAIN      ] GME: Starting full primary refresh.
[2025-10-24T19:00:24.953801] [INFO ] [REMOTE    ] GM: Fetching primary data for 2025-02.
[2025-10-24T19:00:25.088580] [INFO ] [REMOTE    ] GLP: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T19:00:25.082790] [INFO ] [REMOTE    ] GLW: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T19:00:25.352360] [INFO ] [REMOTE    ] GME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:00:25.747635] [INFO ] [REMOTE    ] GLW: Fetching primary data for 2025-03.
[2025-10-24T19:00:26.547719] [INFO ] [REMOTE    ] GME: Fetching primary data for 2025-01.
[2025-10-24T19:00:27.080398] [INFO ] [REMOTE    ] GM: Incremental fetch complete for 2025-02 (2.13 seconds).
[2025-10-24T19:00:27.347724] [INFO ] [REMOTE    ] GLP: Fetching primary data for 2025-04.
[2025-10-24T19:00:27.761888] [INFO ] [REMOTE    ] GLW: Incremental fetch complete for 2025-03 (2.01 seconds).
[2025-10-24T19:00:28.115968] [INFO ] [REMOTE    ] GLP: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T19:00:28.147617] [INFO ] [REMOTE    ] GLP: Fetching primary data for 2025-05.
[2025-10-24T19:00:28.782541] [INFO ] [REMOTE    ] GME: Incremental fetch complete for 2025-01 (2.23 seconds).
[2025-10-24T19:00:28.947609] [INFO ] [REMOTE    ] GLW: Fetching primary data for 2025-04.
[2025-10-24T19:00:29.023638] [INFO ] [REMOTE    ] GLP: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T19:00:29.747689] [INFO ] [REMOTE    ] GME: Fetching primary data for 2025-02.
[2025-10-24T19:00:30.547674] [INFO ] [REMOTE    ] GLP: Fetching primary data for 2025-06.
[2025-10-24T19:00:30.582439] [INFO ] [REMOTE    ] GLW: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T19:00:31.308470] [INFO ] [REMOTE    ] GLP: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T19:00:31.347605] [INFO ] [REMOTE    ] GLP: Fetching primary data for 2025-07.
[2025-10-24T19:00:32.147633] [INFO ] [REMOTE    ] GLW: Fetching primary data for 2025-05.
[2025-10-24T19:00:32.176535] [INFO ] [REMOTE    ] GME: Incremental fetch complete for 2025-02 (2.43 seconds).
[2025-10-24T19:00:32.195670] [INFO ] [REMOTE    ] GLP: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T19:00:32.947668] [INFO ] [REMOTE    ] GM: Fetching primary data for 2025-03.
[2025-10-24T19:00:33.747728] [INFO ] [REMOTE    ] GLP: Fetching primary data for 2025-08.
[2025-10-24T19:00:34.093508] [INFO ] [REMOTE    ] GLW: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T19:00:34.490955] [INFO ] [REMOTE    ] GLP: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T19:00:34.547609] [INFO ] [REMOTE    ] GLP: Fetching primary data for 2025-09.
[2025-10-24T19:00:34.860628] [INFO ] [REMOTE    ] GM: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T19:00:35.347628] [INFO ] [REMOTE    ] GLW: Fetching primary data for 2025-06.
[2025-10-24T19:00:35.384115] [INFO ] [REMOTE    ] GLP: Incremental fetch complete for 2025-09 (0.84 seconds).
[2025-10-24T19:00:36.147689] [INFO ] [REMOTE    ] GME: Fetching primary data for 2025-03.
[2025-10-24T19:00:36.947678] [INFO ] [REMOTE    ] GM: Fetching primary data for 2025-04.
[2025-10-24T19:00:37.189052] [INFO ] [REMOTE    ] GLW: Incremental fetch complete for 2025-06 (1.84 seconds).
[2025-10-24T19:00:37.747632] [INFO ] [REMOTE    ] GLW: Fetching primary data for 2025-07.
[2025-10-24T19:00:38.547613] [INFO ] [REMOTE    ] GLP: Fetching primary data for 2025-10.
[2025-10-24T19:00:38.623874] [INFO ] [REMOTE    ] GME: Incremental fetch complete for 2025-03 (2.48 seconds).
[2025-10-24T19:00:39.215797] [INFO ] [REMOTE    ] GM: Incremental fetch complete for 2025-04 (2.27 seconds).
[2025-10-24T19:00:39.221006] [INFO ] [REMOTE    ] GLP: Incremental fetch complete for 2025-10 (0.67 seconds).
[2025-10-24T19:00:39.234328] [INFO ] [REMOTE    ] GLP: Full fetch complete (14221 records).
[2025-10-24T19:00:39.234697] [DEBUG] [VALIDATOR ] GLP: Validating primary data.
[2025-10-24T19:00:39.348207] [INFO ] [REMOTE    ] GM: Fetching primary data for 2025-05.
[2025-10-24T19:00:39.607067] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present.
[2025-10-24T19:00:39.607233] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed.
[2025-10-24T19:00:39.607599] [INFO ] [MAIN      ] GLP: Fetched primary data is valid.
[2025-10-24T19:00:39.607695] [DEBUG] [LOCAL     ] GLP: Saving primary data.
[2025-10-24T19:00:39.607992] [FATAL] [LOCAL     ] GLP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:00:39.608071] [FATAL] [MAIN      ] GLP: Failed to save primary data.
[2025-10-24T19:00:39.608115] [WARN ] [MAIN      ] GLP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:00:39.608178] [INFO ] [LOCAL     ] GLP: Starting deletion of primary data.
[2025-10-24T19:00:39.608237] [DEBUG] [LOCAL     ] GLP: No primary data file found to delete.
[2025-10-24T19:00:39.608272] [INFO ] [LOCAL     ] GLP: Starting deletion of derivative data.
[2025-10-24T19:00:39.608397] [DEBUG] [LOCAL     ] GLP: Deleted derivative data file.
[2025-10-24T19:00:39.608466] [INFO ] [MAIN      ] Update Progress: 942/2366 symbols completed. GLP took 23.9s. Estimated remaining: 3h 2m 20s. Rate: 7.8 symbols/min
[2025-10-24T19:00:39.804274] [INFO ] [MAIN      ] GMED: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:00:39.809129] [INFO ] [REMOTE    ] GLW: Incremental fetch complete for 2025-07 (2.06 seconds).
[2025-10-24T19:00:39.863906] [DEBUG] [LOCAL     ] GMED: Loaded 48462 existing records from primary storage.
[2025-10-24T19:00:39.864214] [INFO ] [MAIN      ] GMED: Loaded 48462 existing records.
[2025-10-24T19:00:40.060073] [WARN ] [MAIN      ] GMED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:00:40.060345] [INFO ] [MAIN      ] GMED: Wiping existing primary data before full refresh.
[2025-10-24T19:00:40.060405] [INFO ] [LOCAL     ] GMED: Starting deletion of primary data.
[2025-10-24T19:00:40.060745] [DEBUG] [LOCAL     ] GMED: Deleted primary data file.
[2025-10-24T19:00:40.060802] [INFO ] [MAIN      ] GMED: Starting full primary refresh.
[2025-10-24T19:00:40.154133] [INFO ] [REMOTE    ] GLW: Fetching primary data for 2025-08.
[2025-10-24T19:00:40.432989] [INFO ] [REMOTE    ] GMED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:00:40.947724] [INFO ] [REMOTE    ] GME: Fetching primary data for 2025-04.
[2025-10-24T19:00:41.534908] [INFO ] [REMOTE    ] GM: Incremental fetch complete for 2025-05 (2.19 seconds).
[2025-10-24T19:00:41.652227] [INFO ] [REMOTE    ] GLW: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T19:00:41.747678] [INFO ] [REMOTE    ] GLW: Fetching primary data for 2025-09.
[2025-10-24T19:00:42.547745] [INFO ] [REMOTE    ] GM: Fetching primary data for 2025-06.
[2025-10-24T19:00:43.347626] [INFO ] [REMOTE    ] GMED: Fetching primary data for 2025-01.
[2025-10-24T19:00:43.549546] [INFO ] [REMOTE    ] GME: Incremental fetch complete for 2025-04 (2.60 seconds).
[2025-10-24T19:00:43.773603] [INFO ] [REMOTE    ] GLW: Incremental fetch complete for 2025-09 (2.03 seconds).
[2025-10-24T19:00:44.147671] [INFO ] [REMOTE    ] GLW: Fetching primary data for 2025-10.
[2025-10-24T19:00:44.469294] [INFO ] [REMOTE    ] GM: Incremental fetch complete for 2025-06 (1.92 seconds).
[2025-10-24T19:00:44.517847] [INFO ] [REMOTE    ] GMED: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T19:00:44.947755] [INFO ] [REMOTE    ] GM: Fetching primary data for 2025-07.
[2025-10-24T19:00:45.747730] [INFO ] [REMOTE    ] GME: Fetching primary data for 2025-05.
[2025-10-24T19:00:46.547735] [INFO ] [REMOTE    ] GMED: Fetching primary data for 2025-02.
[2025-10-24T19:00:46.636923] [INFO ] [REMOTE    ] GLW: Incremental fetch complete for 2025-10 (2.49 seconds).
[2025-10-24T19:00:46.648558] [INFO ] [REMOTE    ] GLW: Full fetch complete (77798 records).
[2025-10-24T19:00:46.648822] [DEBUG] [VALIDATOR ] GLW: Validating primary data.
[2025-10-24T19:00:47.098366] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present.
[2025-10-24T19:00:47.098609] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed.
[2025-10-24T19:00:47.099698] [INFO ] [MAIN      ] GLW: Fetched primary data is valid.
[2025-10-24T19:00:47.099764] [DEBUG] [LOCAL     ] GLW: Saving primary data.
[2025-10-24T19:00:47.100432] [FATAL] [LOCAL     ] GLW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:00:47.100627] [FATAL] [MAIN      ] GLW: Failed to save primary data.
[2025-10-24T19:00:47.100809] [WARN ] [MAIN      ] GLW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:00:47.101027] [INFO ] [LOCAL     ] GLW: Starting deletion of primary data.
[2025-10-24T19:00:47.101110] [DEBUG] [LOCAL     ] GLW: No primary data file found to delete.
[2025-10-24T19:00:47.101221] [INFO ] [LOCAL     ] GLW: Starting deletion of derivative data.
[2025-10-24T19:00:47.101580] [DEBUG] [LOCAL     ] GLW: Deleted derivative data file.
[2025-10-24T19:00:47.102014] [INFO ] [MAIN      ] Update Progress: 943/2366 symbols completed. GLW took 29.3s. Estimated remaining: 3h 2m 12s. Rate: 7.8 symbols/min
[2025-10-24T19:00:47.233412] [INFO ] [REMOTE    ] GM: Incremental fetch complete for 2025-07 (2.29 seconds).
[2025-10-24T19:00:47.325338] [INFO ] [MAIN      ] GMRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:00:47.347768] [INFO ] [REMOTE    ] GM: Fetching primary data for 2025-08.
[2025-10-24T19:00:47.362820] [DEBUG] [LOCAL     ] GMRE: Loaded 36569 existing records from primary storage.
[2025-10-24T19:00:47.363119] [INFO ] [MAIN      ] GMRE: Loaded 36569 existing records.
[2025-10-24T19:00:47.543715] [WARN ] [MAIN      ] GMRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:00:47.543940] [INFO ] [MAIN      ] GMRE: Wiping existing primary data before full refresh.
[2025-10-24T19:00:47.543986] [INFO ] [LOCAL     ] GMRE: Starting deletion of primary data.
[2025-10-24T19:00:47.544304] [DEBUG] [LOCAL     ] GMRE: Deleted primary data file.
[2025-10-24T19:00:47.544341] [INFO ] [MAIN      ] GMRE: Starting full primary refresh.
[2025-10-24T19:00:47.907525] [INFO ] [REMOTE    ] GMRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:00:47.987619] [INFO ] [REMOTE    ] GME: Incremental fetch complete for 2025-05 (2.24 seconds).
[2025-10-24T19:00:48.147840] [INFO ] [REMOTE    ] GMRE: Fetching primary data for 2025-01.
[2025-10-24T19:00:48.152289] [INFO ] [REMOTE    ] GMED: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T19:00:48.947746] [INFO ] [REMOTE    ] GME: Fetching primary data for 2025-06.
[2025-10-24T19:00:49.282047] [INFO ] [REMOTE    ] GM: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T19:00:49.325746] [INFO ] [REMOTE    ] GMRE: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T19:00:49.747689] [INFO ] [REMOTE    ] GMRE: Fetching primary data for 2025-02.
[2025-10-24T19:00:50.547619] [INFO ] [REMOTE    ] GM: Fetching primary data for 2025-09.
[2025-10-24T19:00:51.019412] [INFO ] [REMOTE    ] GMRE: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T19:00:51.203434] [INFO ] [REMOTE    ] GME: Incremental fetch complete for 2025-06 (2.26 seconds).
[2025-10-24T19:00:51.347720] [INFO ] [REMOTE    ] GMRE: Fetching primary data for 2025-03.
[2025-10-24T19:00:52.147622] [INFO ] [REMOTE    ] GME: Fetching primary data for 2025-07.
[2025-10-24T19:00:52.639074] [INFO ] [REMOTE    ] GMRE: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T19:00:52.695577] [INFO ] [REMOTE    ] GM: Incremental fetch complete for 2025-09 (2.15 seconds).
[2025-10-24T19:00:52.947636] [INFO ] [REMOTE    ] GM: Fetching primary data for 2025-10.
[2025-10-24T19:00:53.747685] [INFO ] [REMOTE    ] GMED: Fetching primary data for 2025-03.
[2025-10-24T19:00:54.547611] [INFO ] [REMOTE    ] GMRE: Fetching primary data for 2025-04.
[2025-10-24T19:00:54.836479] [INFO ] [REMOTE    ] GME: Incremental fetch complete for 2025-07 (2.69 seconds).
[2025-10-24T19:00:55.025310] [INFO ] [REMOTE    ] GM: Incremental fetch complete for 2025-10 (2.08 seconds).
[2025-10-24T19:00:55.035070] [INFO ] [REMOTE    ] GM: Full fetch complete (77907 records).
[2025-10-24T19:00:55.035202] [DEBUG] [VALIDATOR ] GM: Validating primary data.
[2025-10-24T19:00:55.350848] [INFO ] [REMOTE    ] GME: Fetching primary data for 2025-08.
[2025-10-24T19:00:55.465538] [DEBUG] [VALIDATOR ] GM: All expected trading days are present.
[2025-10-24T19:00:55.465637] [DEBUG] [VALIDATOR ] GM: Primary data validation passed.
[2025-10-24T19:00:55.466724] [INFO ] [MAIN      ] GM: Fetched primary data is valid.
[2025-10-24T19:00:55.466804] [DEBUG] [LOCAL     ] GM: Saving primary data.
[2025-10-24T19:00:55.467741] [FATAL] [LOCAL     ] GM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:00:55.468051] [FATAL] [MAIN      ] GM: Failed to save primary data.
[2025-10-24T19:00:55.468149] [WARN ] [MAIN      ] GM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:00:55.468222] [INFO ] [LOCAL     ] GM: Starting deletion of primary data.
[2025-10-24T19:00:55.468290] [DEBUG] [LOCAL     ] GM: No primary data file found to delete.
[2025-10-24T19:00:55.468328] [INFO ] [LOCAL     ] GM: Starting deletion of derivative data.
[2025-10-24T19:00:55.468506] [DEBUG] [LOCAL     ] GM: Deleted derivative data file.
[2025-10-24T19:00:55.468954] [INFO ] [MAIN      ] Update Progress: 944/2366 symbols completed. GM took 34.6s. Estimated remaining: 3h 2m 5s. Rate: 7.8 symbols/min
[2025-10-24T19:00:55.660172] [INFO ] [REMOTE    ] GMED: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T19:00:55.679552] [INFO ] [MAIN      ] GNE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:00:55.713807] [INFO ] [REMOTE    ] GMRE: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T19:00:55.737855] [DEBUG] [LOCAL     ] GNE: Loaded 18205 existing records from primary storage.
[2025-10-24T19:00:55.738110] [INFO ] [MAIN      ] GNE: Loaded 18205 existing records.
[2025-10-24T19:00:55.945900] [WARN ] [MAIN      ] GNE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:00:55.946149] [INFO ] [MAIN      ] GNE: Wiping existing primary data before full refresh.
[2025-10-24T19:00:55.946198] [INFO ] [LOCAL     ] GNE: Starting deletion of primary data.
[2025-10-24T19:00:55.946440] [DEBUG] [LOCAL     ] GNE: Deleted primary data file.
[2025-10-24T19:00:55.946496] [INFO ] [MAIN      ] GNE: Starting full primary refresh.
[2025-10-24T19:00:56.149330] [INFO ] [REMOTE    ] GMRE: Fetching primary data for 2025-05.
[2025-10-24T19:00:56.366090] [INFO ] [REMOTE    ] GNE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:00:56.947730] [INFO ] [REMOTE    ] GMED: Fetching primary data for 2025-04.
[2025-10-24T19:00:57.570887] [INFO ] [REMOTE    ] GMRE: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T19:00:57.747627] [INFO ] [REMOTE    ] GMRE: Fetching primary data for 2025-06.
[2025-10-24T19:00:57.943564] [INFO ] [REMOTE    ] GME: Incremental fetch complete for 2025-08 (2.59 seconds).
[2025-10-24T19:00:58.056992] [INFO ] [REMOTE    ] GMED: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T19:00:58.547720] [INFO ] [REMOTE    ] GME: Fetching primary data for 2025-09.
[2025-10-24T19:00:59.242176] [INFO ] [REMOTE    ] GMRE: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T19:00:59.347678] [INFO ] [REMOTE    ] GMRE: Fetching primary data for 2025-07.
[2025-10-24T19:01:00.147717] [INFO ] [REMOTE    ] GMED: Fetching primary data for 2025-05.
[2025-10-24T19:01:00.856105] [INFO ] [REMOTE    ] GMRE: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T19:01:00.958524] [INFO ] [REMOTE    ] GNE: Fetching primary data for 2025-01.
[2025-10-24T19:01:00.981093] [INFO ] [REMOTE    ] GME: Incremental fetch complete for 2025-09 (2.43 seconds).
[2025-10-24T19:01:01.747737] [INFO ] [REMOTE    ] GME: Fetching primary data for 2025-10.
[2025-10-24T19:01:02.007526] [INFO ] [REMOTE    ] GNE: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T19:01:02.013388] [INFO ] [REMOTE    ] GMED: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T19:01:02.547728] [INFO ] [REMOTE    ] GMED: Fetching primary data for 2025-06.
[2025-10-24T19:01:03.347701] [INFO ] [REMOTE    ] GNE: Fetching primary data for 2025-02.
[2025-10-24T19:01:04.144297] [INFO ] [REMOTE    ] GNE: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T19:01:04.147595] [INFO ] [REMOTE    ] GNE: Fetching primary data for 2025-03.
[2025-10-24T19:01:04.290697] [INFO ] [REMOTE    ] GMED: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T19:01:04.489285] [INFO ] [REMOTE    ] GME: Incremental fetch complete for 2025-10 (2.74 seconds).
[2025-10-24T19:01:04.503012] [INFO ] [REMOTE    ] GME: Full fetch complete (77919 records).
[2025-10-24T19:01:04.503232] [DEBUG] [VALIDATOR ] GME: Validating primary data.
[2025-10-24T19:01:04.919986] [DEBUG] [VALIDATOR ] GME: All expected trading days are present.
[2025-10-24T19:01:04.920212] [DEBUG] [VALIDATOR ] GME: Primary data validation passed.
[2025-10-24T19:01:04.921797] [INFO ] [MAIN      ] GME: Fetched primary data is valid.
[2025-10-24T19:01:04.921877] [DEBUG] [LOCAL     ] GME: Saving primary data.
[2025-10-24T19:01:04.922967] [FATAL] [LOCAL     ] GME: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:01:04.923317] [FATAL] [MAIN      ] GME: Failed to save primary data.
[2025-10-24T19:01:04.923402] [WARN ] [MAIN      ] GME: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:01:04.923489] [INFO ] [LOCAL     ] GME: Starting deletion of primary data.
[2025-10-24T19:01:04.923583] [DEBUG] [LOCAL     ] GME: No primary data file found to delete.
[2025-10-24T19:01:04.923671] [INFO ] [LOCAL     ] GME: Starting deletion of derivative data.
[2025-10-24T19:01:04.924875] [DEBUG] [LOCAL     ] GME: Deleted derivative data file.
[2025-10-24T19:01:04.925632] [INFO ] [MAIN      ] Update Progress: 945/2366 symbols completed. GME took 40.4s. Estimated remaining: 3h 1m 60s. Rate: 7.8 symbols/min
[2025-10-24T19:01:04.952755] [INFO ] [REMOTE    ] GMRE: Fetching primary data for 2025-08.
[2025-10-24T19:01:05.057636] [INFO ] [REMOTE    ] GNE: Incremental fetch complete for 2025-03 (0.91 seconds).
[2025-10-24T19:01:05.164093] [INFO ] [MAIN      ] GNK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:01:05.221128] [DEBUG] [LOCAL     ] GNK: Loaded 39706 existing records from primary storage.
[2025-10-24T19:01:05.221520] [INFO ] [MAIN      ] GNK: Loaded 39706 existing records.
[2025-10-24T19:01:05.421798] [WARN ] [MAIN      ] GNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:01:05.422155] [INFO ] [MAIN      ] GNK: Wiping existing primary data before full refresh.
[2025-10-24T19:01:05.422207] [INFO ] [LOCAL     ] GNK: Starting deletion of primary data.
[2025-10-24T19:01:05.422510] [DEBUG] [LOCAL     ] GNK: Deleted primary data file.
[2025-10-24T19:01:05.422568] [INFO ] [MAIN      ] GNK: Starting full primary refresh.
[2025-10-24T19:01:05.752839] [INFO ] [REMOTE    ] GNE: Fetching primary data for 2025-04.
[2025-10-24T19:01:05.810532] [INFO ] [REMOTE    ] GNK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:01:06.359327] [INFO ] [REMOTE    ] GMRE: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T19:01:06.547668] [INFO ] [REMOTE    ] GMRE: Fetching primary data for 2025-09.
[2025-10-24T19:01:06.598146] [INFO ] [REMOTE    ] GNE: Incremental fetch complete for 2025-04 (0.85 seconds).
[2025-10-24T19:01:07.347723] [INFO ] [REMOTE    ] GNK: Fetching primary data for 2025-01.
[2025-10-24T19:01:08.136938] [INFO ] [REMOTE    ] GMRE: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T19:01:08.147598] [INFO ] [REMOTE    ] GMRE: Fetching primary data for 2025-10.
[2025-10-24T19:01:08.738529] [INFO ] [REMOTE    ] GNK: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T19:01:08.947724] [INFO ] [REMOTE    ] GNK: Fetching primary data for 2025-02.
[2025-10-24T19:01:09.409606] [INFO ] [REMOTE    ] GMRE: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T19:01:09.414584] [INFO ] [REMOTE    ] GMRE: Full fetch complete (51624 records).
[2025-10-24T19:01:09.414769] [DEBUG] [VALIDATOR ] GMRE: Validating primary data.
[2025-10-24T19:01:09.752761] [INFO ] [REMOTE    ] GMED: Fetching primary data for 2025-07.
[2025-10-24T19:01:09.818730] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present.
[2025-10-24T19:01:09.818825] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed.
[2025-10-24T19:01:09.819605] [INFO ] [MAIN      ] GMRE: Fetched primary data is valid.
[2025-10-24T19:01:09.819677] [DEBUG] [LOCAL     ] GMRE: Saving primary data.
[2025-10-24T19:01:09.820171] [FATAL] [LOCAL     ] GMRE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:01:09.820260] [FATAL] [MAIN      ] GMRE: Failed to save primary data.
[2025-10-24T19:01:09.820307] [WARN ] [MAIN      ] GMRE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:01:09.820372] [INFO ] [LOCAL     ] GMRE: Starting deletion of primary data.
[2025-10-24T19:01:09.820432] [DEBUG] [LOCAL     ] GMRE: No primary data file found to delete.
[2025-10-24T19:01:09.820470] [INFO ] [LOCAL     ] GMRE: Starting deletion of derivative data.
[2025-10-24T19:01:09.820590] [DEBUG] [LOCAL     ] GMRE: Deleted derivative data file.
[2025-10-24T19:01:09.820691] [INFO ] [MAIN      ] Update Progress: 946/2366 symbols completed. GMRE took 22.7s. Estimated remaining: 3h 1m 48s. Rate: 7.8 symbols/min
[2025-10-24T19:01:10.005049] [INFO ] [MAIN      ] GNL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:01:10.036485] [INFO ] [REMOTE    ] GNK: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T19:01:10.082730] [DEBUG] [LOCAL     ] GNL: Loaded 46808 existing records from primary storage.
[2025-10-24T19:01:10.083039] [INFO ] [MAIN      ] GNL: Loaded 46808 existing records.
[2025-10-24T19:01:10.264088] [WARN ] [MAIN      ] GNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:01:10.264317] [INFO ] [MAIN      ] GNL: Wiping existing primary data before full refresh.
[2025-10-24T19:01:10.264365] [INFO ] [LOCAL     ] GNL: Starting deletion of primary data.
[2025-10-24T19:01:10.264605] [DEBUG] [LOCAL     ] GNL: Deleted primary data file.
[2025-10-24T19:01:10.264717] [INFO ] [MAIN      ] GNL: Starting full primary refresh.
[2025-10-24T19:01:10.552724] [INFO ] [REMOTE    ] GNE: Fetching primary data for 2025-05.
[2025-10-24T19:01:10.623620] [INFO ] [REMOTE    ] GNL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:01:11.347627] [INFO ] [REMOTE    ] GNK: Fetching primary data for 2025-03.
[2025-10-24T19:01:11.415114] [INFO ] [REMOTE    ] GMED: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T19:01:11.541839] [INFO ] [REMOTE    ] GNE: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T19:01:12.147754] [INFO ] [REMOTE    ] GNE: Fetching primary data for 2025-06.
[2025-10-24T19:01:12.947690] [INFO ] [REMOTE    ] GMED: Fetching primary data for 2025-08.
[2025-10-24T19:01:12.988027] [INFO ] [REMOTE    ] GNK: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T19:01:13.235344] [INFO ] [REMOTE    ] GNE: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T19:01:13.747691] [INFO ] [REMOTE    ] GNK: Fetching primary data for 2025-04.
[2025-10-24T19:01:14.157974] [INFO ] [REMOTE    ] GMED: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T19:01:14.547671] [INFO ] [REMOTE    ] GNL: Fetching primary data for 2025-01.
[2025-10-24T19:01:15.229920] [INFO ] [REMOTE    ] GNK: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T19:01:15.347619] [INFO ] [REMOTE    ] GNK: Fetching primary data for 2025-05.
[2025-10-24T19:01:16.147621] [INFO ] [REMOTE    ] GNE: Fetching primary data for 2025-07.
[2025-10-24T19:01:16.219534] [INFO ] [REMOTE    ] GNL: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T19:01:16.923373] [INFO ] [REMOTE    ] GNK: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T19:01:16.947638] [INFO ] [REMOTE    ] GNK: Fetching primary data for 2025-06.
[2025-10-24T19:01:17.265530] [INFO ] [REMOTE    ] GNE: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T19:01:17.747674] [INFO ] [REMOTE    ] GNE: Fetching primary data for 2025-08.
[2025-10-24T19:01:18.344240] [INFO ] [REMOTE    ] GNK: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T19:01:18.413009] [INFO ] [REMOTE    ] GNE: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T19:01:18.547670] [INFO ] [REMOTE    ] GNE: Fetching primary data for 2025-09.
[2025-10-24T19:01:19.347620] [INFO ] [REMOTE    ] GNK: Fetching primary data for 2025-07.
[2025-10-24T19:01:19.581114] [INFO ] [REMOTE    ] GNE: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T19:01:20.147680] [INFO ] [REMOTE    ] GMED: Fetching primary data for 2025-09.
[2025-10-24T19:01:20.815555] [INFO ] [REMOTE    ] GNK: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T19:01:20.947679] [INFO ] [REMOTE    ] GNL: Fetching primary data for 2025-02.
[2025-10-24T19:01:21.576860] [INFO ] [REMOTE    ] GMED: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T19:01:21.747693] [INFO ] [REMOTE    ] GNE: Fetching primary data for 2025-10.
[2025-10-24T19:01:22.387673] [INFO ] [REMOTE    ] GNE: Incremental fetch complete for 2025-10 (0.64 seconds).
[2025-10-24T19:01:22.391533] [INFO ] [REMOTE    ] GNE: Full fetch complete (22652 records).
[2025-10-24T19:01:22.391736] [DEBUG] [VALIDATOR ] GNE: Validating primary data.
[2025-10-24T19:01:22.491728] [INFO ] [REMOTE    ] GNL: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T19:01:22.552709] [INFO ] [REMOTE    ] GMED: Fetching primary data for 2025-10.
[2025-10-24T19:01:22.795055] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present.
[2025-10-24T19:01:22.795132] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed.
[2025-10-24T19:01:22.795678] [INFO ] [MAIN      ] GNE: Fetched primary data is valid.
[2025-10-24T19:01:22.795755] [DEBUG] [LOCAL     ] GNE: Saving primary data.
[2025-10-24T19:01:22.796074] [FATAL] [LOCAL     ] GNE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:01:22.796183] [FATAL] [MAIN      ] GNE: Failed to save primary data.
[2025-10-24T19:01:22.796226] [WARN ] [MAIN      ] GNE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:01:22.796286] [INFO ] [LOCAL     ] GNE: Starting deletion of primary data.
[2025-10-24T19:01:22.796341] [DEBUG] [LOCAL     ] GNE: No primary data file found to delete.
[2025-10-24T19:01:22.796376] [INFO ] [LOCAL     ] GNE: Starting deletion of derivative data.
[2025-10-24T19:01:22.796548] [DEBUG] [LOCAL     ] GNE: Deleted derivative data file.
[2025-10-24T19:01:22.796637] [INFO ] [MAIN      ] Update Progress: 947/2366 symbols completed. GNE took 27.3s. Estimated remaining: 3h 1m 48s. Rate: 7.8 symbols/min
[2025-10-24T19:01:22.971101] [INFO ] [MAIN      ] GNRC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:01:23.014268] [DEBUG] [LOCAL     ] GNRC: Loaded 45673 existing records from primary storage.
[2025-10-24T19:01:23.014558] [INFO ] [MAIN      ] GNRC: Loaded 45673 existing records.
[2025-10-24T19:01:23.190753] [WARN ] [MAIN      ] GNRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:01:23.190976] [INFO ] [MAIN      ] GNRC: Wiping existing primary data before full refresh.
[2025-10-24T19:01:23.191021] [INFO ] [LOCAL     ] GNRC: Starting deletion of primary data.
[2025-10-24T19:01:23.191447] [DEBUG] [LOCAL     ] GNRC: Deleted primary data file.
[2025-10-24T19:01:23.191484] [INFO ] [MAIN      ] GNRC: Starting full primary refresh.
[2025-10-24T19:01:23.359563] [INFO ] [REMOTE    ] GNK: Fetching primary data for 2025-08.
[2025-10-24T19:01:23.559952] [INFO ] [REMOTE    ] GNRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:01:24.147627] [INFO ] [REMOTE    ] GNL: Fetching primary data for 2025-03.
[2025-10-24T19:01:24.315327] [INFO ] [REMOTE    ] GMED: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T19:01:24.326000] [INFO ] [REMOTE    ] GMED: Full fetch complete (70183 records).
[2025-10-24T19:01:24.326237] [DEBUG] [VALIDATOR ] GMED: Validating primary data.
[2025-10-24T19:01:24.759628] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present.
[2025-10-24T19:01:24.759796] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed.
[2025-10-24T19:01:24.761304] [INFO ] [MAIN      ] GMED: Fetched primary data is valid.
[2025-10-24T19:01:24.761396] [DEBUG] [LOCAL     ] GMED: Saving primary data.
[2025-10-24T19:01:24.762466] [FATAL] [LOCAL     ] GMED: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:01:24.762585] [FATAL] [MAIN      ] GMED: Failed to save primary data.
[2025-10-24T19:01:24.762630] [WARN ] [MAIN      ] GMED: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:01:24.762728] [INFO ] [LOCAL     ] GMED: Starting deletion of primary data.
[2025-10-24T19:01:24.762805] [DEBUG] [LOCAL     ] GMED: No primary data file found to delete.
[2025-10-24T19:01:24.762847] [INFO ] [LOCAL     ] GMED: Starting deletion of derivative data.
[2025-10-24T19:01:24.763014] [DEBUG] [LOCAL     ] GMED: Deleted derivative data file.
[2025-10-24T19:01:24.763532] [INFO ] [MAIN      ] Update Progress: 948/2366 symbols completed. GMED took 45.2s. Estimated remaining: 3h 1m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:01:24.954184] [INFO ] [MAIN      ] GNT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:01:24.949118] [INFO ] [REMOTE    ] GNRC: Fetching primary data for 2025-01.
[2025-10-24T19:01:24.988896] [INFO ] [REMOTE    ] GNK: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T19:01:25.005767] [DEBUG] [LOCAL     ] GNT: Loaded 8683 existing records from primary storage.
[2025-10-24T19:01:25.007055] [INFO ] [MAIN      ] GNT: Loaded 8683 existing records.
[2025-10-24T19:01:25.209219] [WARN ] [MAIN      ] GNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:01:25.209541] [INFO ] [MAIN      ] GNT: Wiping existing primary data before full refresh.
[2025-10-24T19:01:25.209591] [INFO ] [LOCAL     ] GNT: Starting deletion of primary data.
[2025-10-24T19:01:25.209790] [DEBUG] [LOCAL     ] GNT: Deleted primary data file.
[2025-10-24T19:01:25.209846] [INFO ] [MAIN      ] GNT: Starting full primary refresh.
[2025-10-24T19:01:25.638782] [INFO ] [REMOTE    ] GNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:01:25.642717] [INFO ] [REMOTE    ] GNL: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T19:01:25.747712] [INFO ] [REMOTE    ] GNL: Fetching primary data for 2025-04.
[2025-10-24T19:01:26.556521] [INFO ] [REMOTE    ] GNK: Fetching primary data for 2025-09.
[2025-10-24T19:01:26.562296] [INFO ] [REMOTE    ] GNRC: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T19:01:27.347635] [INFO ] [REMOTE    ] GNRC: Fetching primary data for 2025-02.
[2025-10-24T19:01:27.406733] [INFO ] [REMOTE    ] GNL: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T19:01:27.916333] [INFO ] [REMOTE    ] GNK: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T19:01:28.147768] [INFO ] [REMOTE    ] GNT: Fetching primary data for 2025-01.
[2025-10-24T19:01:28.693559] [INFO ] [REMOTE    ] GNT: Incremental fetch complete for 2025-01 (0.55 seconds).
[2025-10-24T19:01:28.891056] [INFO ] [REMOTE    ] GNRC: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T19:01:28.947743] [INFO ] [REMOTE    ] GNT: Fetching primary data for 2025-02.
[2025-10-24T19:01:29.526265] [INFO ] [REMOTE    ] GNT: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T19:01:29.747685] [INFO ] [REMOTE    ] GNK: Fetching primary data for 2025-10.
[2025-10-24T19:01:30.547680] [INFO ] [REMOTE    ] GNT: Fetching primary data for 2025-03.
[2025-10-24T19:01:31.244245] [INFO ] [REMOTE    ] GNT: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T19:01:31.347697] [INFO ] [REMOTE    ] GNL: Fetching primary data for 2025-05.
[2025-10-24T19:01:31.372852] [INFO ] [REMOTE    ] GNK: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T19:01:31.379811] [INFO ] [REMOTE    ] GNK: Full fetch complete (57157 records).
[2025-10-24T19:01:31.379965] [DEBUG] [VALIDATOR ] GNK: Validating primary data.
[2025-10-24T19:01:31.761500] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present.
[2025-10-24T19:01:31.761600] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed.
[2025-10-24T19:01:31.762490] [INFO ] [MAIN      ] GNK: Fetched primary data is valid.
[2025-10-24T19:01:31.762562] [DEBUG] [LOCAL     ] GNK: Saving primary data.
[2025-10-24T19:01:31.763119] [FATAL] [LOCAL     ] GNK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:01:31.763228] [FATAL] [MAIN      ] GNK: Failed to save primary data.
[2025-10-24T19:01:31.763303] [WARN ] [MAIN      ] GNK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:01:31.763391] [INFO ] [LOCAL     ] GNK: Starting deletion of primary data.
[2025-10-24T19:01:31.763461] [DEBUG] [LOCAL     ] GNK: No primary data file found to delete.
[2025-10-24T19:01:31.763508] [INFO ] [LOCAL     ] GNK: Starting deletion of derivative data.
[2025-10-24T19:01:31.763675] [DEBUG] [LOCAL     ] GNK: Deleted derivative data file.
[2025-10-24T19:01:31.763952] [INFO ] [MAIN      ] Update Progress: 949/2366 symbols completed. GNK took 26.8s. Estimated remaining: 3h 1m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:01:31.931745] [INFO ] [MAIN      ] GNW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:01:31.980960] [DEBUG] [LOCAL     ] GNW: Loaded 51738 existing records from primary storage.
[2025-10-24T19:01:31.981264] [INFO ] [MAIN      ] GNW: Loaded 51738 existing records.
[2025-10-24T19:01:32.153677] [INFO ] [REMOTE    ] GNT: Fetching primary data for 2025-04.
[2025-10-24T19:01:32.159144] [WARN ] [MAIN      ] GNW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:01:32.160207] [INFO ] [MAIN      ] GNW: Wiping existing primary data before full refresh.
[2025-10-24T19:01:32.160256] [INFO ] [LOCAL     ] GNW: Starting deletion of primary data.
[2025-10-24T19:01:32.160435] [DEBUG] [LOCAL     ] GNW: Deleted primary data file.
[2025-10-24T19:01:32.160474] [INFO ] [MAIN      ] GNW: Starting full primary refresh.
[2025-10-24T19:01:32.521427] [INFO ] [REMOTE    ] GNW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:01:32.948570] [INFO ] [REMOTE    ] GNRC: Fetching primary data for 2025-03.
[2025-10-24T19:01:32.951377] [INFO ] [REMOTE    ] GNL: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T19:01:32.992403] [INFO ] [REMOTE    ] GNT: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T19:01:33.747722] [INFO ] [REMOTE    ] GNT: Fetching primary data for 2025-05.
[2025-10-24T19:01:34.483499] [INFO ] [REMOTE    ] GNT: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T19:01:34.547702] [INFO ] [REMOTE    ] GNT: Fetching primary data for 2025-06.
[2025-10-24T19:01:34.609822] [INFO ] [REMOTE    ] GNRC: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T19:01:35.208556] [INFO ] [REMOTE    ] GNT: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T19:01:35.347706] [INFO ] [REMOTE    ] GNT: Fetching primary data for 2025-07.
[2025-10-24T19:01:36.133348] [INFO ] [REMOTE    ] GNT: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T19:01:36.147601] [INFO ] [REMOTE    ] GNT: Fetching primary data for 2025-08.
[2025-10-24T19:01:36.794842] [INFO ] [REMOTE    ] GNT: Incremental fetch complete for 2025-08 (0.65 seconds).
[2025-10-24T19:01:36.947695] [INFO ] [REMOTE    ] GNT: Fetching primary data for 2025-09.
[2025-10-24T19:01:37.747672] [INFO ] [REMOTE    ] GNW: Fetching primary data for 2025-01.
[2025-10-24T19:01:37.863379] [INFO ] [REMOTE    ] GNT: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T19:01:38.547729] [INFO ] [REMOTE    ] GNL: Fetching primary data for 2025-06.
[2025-10-24T19:01:39.069248] [INFO ] [REMOTE    ] GNW: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T19:01:39.347669] [INFO ] [REMOTE    ] GNRC: Fetching primary data for 2025-04.
[2025-10-24T19:01:40.154191] [INFO ] [REMOTE    ] GNT: Fetching primary data for 2025-10.
[2025-10-24T19:01:40.180104] [INFO ] [REMOTE    ] GNL: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T19:01:40.947690] [INFO ] [REMOTE    ] GNL: Fetching primary data for 2025-07.
[2025-10-24T19:01:41.046737] [INFO ] [REMOTE    ] GNRC: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T19:01:41.137282] [INFO ] [REMOTE    ] GNT: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T19:01:41.139812] [INFO ] [REMOTE    ] GNT: Full fetch complete (11469 records).
[2025-10-24T19:01:41.139884] [DEBUG] [VALIDATOR ] GNT: Validating primary data.
[2025-10-24T19:01:41.507610] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present.
[2025-10-24T19:01:41.507723] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed.
[2025-10-24T19:01:41.508020] [INFO ] [MAIN      ] GNT: Fetched primary data is valid.
[2025-10-24T19:01:41.508061] [DEBUG] [LOCAL     ] GNT: Saving primary data.
[2025-10-24T19:01:41.508305] [FATAL] [LOCAL     ] GNT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:01:41.508387] [FATAL] [MAIN      ] GNT: Failed to save primary data.
[2025-10-24T19:01:41.508429] [WARN ] [MAIN      ] GNT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:01:41.508508] [INFO ] [LOCAL     ] GNT: Starting deletion of primary data.
[2025-10-24T19:01:41.508566] [DEBUG] [LOCAL     ] GNT: No primary data file found to delete.
[2025-10-24T19:01:41.508624] [INFO ] [LOCAL     ] GNT: Starting deletion of derivative data.
[2025-10-24T19:01:41.508808] [DEBUG] [LOCAL     ] GNT: Deleted derivative data file.
[2025-10-24T19:01:41.508895] [INFO ] [MAIN      ] Update Progress: 950/2366 symbols completed. GNT took 16.7s. Estimated remaining: 3h 1m 19s. Rate: 7.8 symbols/min
[2025-10-24T19:01:41.676851] [INFO ] [MAIN      ] GOF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:01:41.720815] [DEBUG] [LOCAL     ] GOF: Loaded 43072 existing records from primary storage.
[2025-10-24T19:01:41.721127] [INFO ] [MAIN      ] GOF: Loaded 43072 existing records.
[2025-10-24T19:01:41.752872] [INFO ] [REMOTE    ] GNW: Fetching primary data for 2025-02.
[2025-10-24T19:01:41.903467] [WARN ] [MAIN      ] GOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:01:41.903708] [INFO ] [MAIN      ] GOF: Wiping existing primary data before full refresh.
[2025-10-24T19:01:41.903768] [INFO ] [LOCAL     ] GOF: Starting deletion of primary data.
[2025-10-24T19:01:41.904060] [DEBUG] [LOCAL     ] GOF: Deleted primary data file.
[2025-10-24T19:01:41.904099] [INFO ] [MAIN      ] GOF: Starting full primary refresh.
[2025-10-24T19:01:42.287622] [INFO ] [REMOTE    ] GOF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:01:42.511422] [INFO ] [REMOTE    ] GNL: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T19:01:42.547604] [INFO ] [REMOTE    ] GNL: Fetching primary data for 2025-08.
[2025-10-24T19:01:43.031723] [INFO ] [REMOTE    ] GNW: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T19:01:43.347676] [INFO ] [REMOTE    ] GNW: Fetching primary data for 2025-03.
[2025-10-24T19:01:44.066289] [INFO ] [REMOTE    ] GNL: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T19:01:44.147610] [INFO ] [REMOTE    ] GNL: Fetching primary data for 2025-09.
[2025-10-24T19:01:44.552298] [INFO ] [REMOTE    ] GNW: Incremental fetch complete for 2025-03 (1.20 seconds).
[2025-10-24T19:01:44.947736] [INFO ] [REMOTE    ] GNW: Fetching primary data for 2025-04.
[2025-10-24T19:01:45.697713] [INFO ] [REMOTE    ] GNL: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T19:01:45.747722] [INFO ] [REMOTE    ] GOF: Fetching primary data for 2025-01.
[2025-10-24T19:01:46.365469] [INFO ] [REMOTE    ] GNW: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T19:01:46.547719] [INFO ] [REMOTE    ] GNRC: Fetching primary data for 2025-05.
[2025-10-24T19:01:47.289106] [INFO ] [REMOTE    ] GOF: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T19:01:47.347594] [INFO ] [REMOTE    ] GOF: Fetching primary data for 2025-02.
[2025-10-24T19:01:48.147618] [INFO ] [REMOTE    ] GNW: Fetching primary data for 2025-05.
[2025-10-24T19:01:48.229015] [INFO ] [REMOTE    ] GNRC: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T19:01:48.947698] [INFO ] [REMOTE    ] GNRC: Fetching primary data for 2025-06.
[2025-10-24T19:01:49.060563] [INFO ] [REMOTE    ] GOF: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T19:01:49.747625] [INFO ] [REMOTE    ] GOF: Fetching primary data for 2025-03.
[2025-10-24T19:01:49.913088] [INFO ] [REMOTE    ] GNW: Incremental fetch complete for 2025-05 (1.77 seconds).
[2025-10-24T19:01:50.547683] [INFO ] [REMOTE    ] GNL: Fetching primary data for 2025-10.
[2025-10-24T19:01:50.619671] [INFO ] [REMOTE    ] GNRC: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T19:01:51.347637] [INFO ] [REMOTE    ] GNW: Fetching primary data for 2025-06.
[2025-10-24T19:01:51.422767] [INFO ] [REMOTE    ] GOF: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T19:01:52.147622] [INFO ] [REMOTE    ] GNRC: Fetching primary data for 2025-07.
[2025-10-24T19:01:52.241626] [INFO ] [REMOTE    ] GNL: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T19:01:52.250160] [INFO ] [REMOTE    ] GNL: Full fetch complete (68013 records).
[2025-10-24T19:01:52.250274] [DEBUG] [VALIDATOR ] GNL: Validating primary data.
[2025-10-24T19:01:52.670229] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present.
[2025-10-24T19:01:52.670328] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed.
[2025-10-24T19:01:52.671263] [INFO ] [MAIN      ] GNL: Fetched primary data is valid.
[2025-10-24T19:01:52.671373] [DEBUG] [LOCAL     ] GNL: Saving primary data.
[2025-10-24T19:01:52.671969] [FATAL] [LOCAL     ] GNL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:01:52.672050] [FATAL] [MAIN      ] GNL: Failed to save primary data.
[2025-10-24T19:01:52.672092] [WARN ] [MAIN      ] GNL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:01:52.672128] [INFO ] [LOCAL     ] GNL: Starting deletion of primary data.
[2025-10-24T19:01:52.672178] [DEBUG] [LOCAL     ] GNL: No primary data file found to delete.
[2025-10-24T19:01:52.672213] [INFO ] [LOCAL     ] GNL: Starting deletion of derivative data.
[2025-10-24T19:01:52.672331] [DEBUG] [LOCAL     ] GNL: Deleted derivative data file.
[2025-10-24T19:01:52.672685] [INFO ] [MAIN      ] Update Progress: 951/2366 symbols completed. GNL took 42.9s. Estimated remaining: 3h 1m 16s. Rate: 7.8 symbols/min
[2025-10-24T19:01:52.857435] [INFO ] [MAIN      ] GOLF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:01:52.887772] [DEBUG] [LOCAL     ] GOLF: Loaded 30411 existing records from primary storage.
[2025-10-24T19:01:52.888027] [INFO ] [MAIN      ] GOLF: Loaded 30411 existing records.
[2025-10-24T19:01:52.959954] [INFO ] [REMOTE    ] GOF: Fetching primary data for 2025-04.
[2025-10-24T19:01:53.082508] [WARN ] [MAIN      ] GOLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:01:53.082873] [INFO ] [MAIN      ] GOLF: Wiping existing primary data before full refresh.
[2025-10-24T19:01:53.083115] [INFO ] [LOCAL     ] GOLF: Starting deletion of primary data.
[2025-10-24T19:01:53.092935] [DEBUG] [LOCAL     ] GOLF: Deleted primary data file.
[2025-10-24T19:01:53.108613] [INFO ] [MAIN      ] GOLF: Starting full primary refresh.
[2025-10-24T19:01:53.176788] [INFO ] [REMOTE    ] GNW: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T19:01:53.486584] [INFO ] [REMOTE    ] GOLF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:01:53.747693] [INFO ] [REMOTE    ] GOLF: Fetching primary data for 2025-01.
[2025-10-24T19:01:53.956293] [INFO ] [REMOTE    ] GNRC: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T19:01:54.547629] [INFO ] [REMOTE    ] GNRC: Fetching primary data for 2025-08.
[2025-10-24T19:01:54.732727] [INFO ] [REMOTE    ] GOF: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T19:01:54.943231] [INFO ] [REMOTE    ] GOLF: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T19:01:55.347692] [INFO ] [REMOTE    ] GOLF: Fetching primary data for 2025-02.
[2025-10-24T19:01:56.143495] [INFO ] [REMOTE    ] GNRC: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T19:01:56.152388] [INFO ] [REMOTE    ] GOF: Fetching primary data for 2025-05.
[2025-10-24T19:01:56.728620] [INFO ] [REMOTE    ] GOLF: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T19:01:56.947714] [INFO ] [REMOTE    ] GNRC: Fetching primary data for 2025-09.
[2025-10-24T19:01:57.754106] [INFO ] [REMOTE    ] GNW: Fetching primary data for 2025-07.
[2025-10-24T19:01:57.756633] [INFO ] [REMOTE    ] GOF: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T19:01:58.547707] [INFO ] [REMOTE    ] GOF: Fetching primary data for 2025-06.
[2025-10-24T19:01:58.753047] [INFO ] [REMOTE    ] GNRC: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T19:01:59.347728] [INFO ] [REMOTE    ] GOLF: Fetching primary data for 2025-03.
[2025-10-24T19:01:59.530061] [INFO ] [REMOTE    ] GNW: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T19:02:00.041198] [INFO ] [REMOTE    ] GOF: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T19:02:00.147636] [INFO ] [REMOTE    ] GOF: Fetching primary data for 2025-07.
[2025-10-24T19:02:00.424995] [INFO ] [REMOTE    ] GOLF: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T19:02:00.947710] [INFO ] [REMOTE    ] GNRC: Fetching primary data for 2025-10.
[2025-10-24T19:02:01.532241] [INFO ] [REMOTE    ] GOF: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T19:02:01.747696] [INFO ] [REMOTE    ] GNW: Fetching primary data for 2025-08.
[2025-10-24T19:02:02.547702] [INFO ] [REMOTE    ] GOLF: Fetching primary data for 2025-04.
[2025-10-24T19:02:02.903890] [INFO ] [REMOTE    ] GNRC: Incremental fetch complete for 2025-10 (1.96 seconds).
[2025-10-24T19:02:02.913542] [INFO ] [REMOTE    ] GNRC: Full fetch complete (65727 records).
[2025-10-24T19:02:02.913732] [DEBUG] [VALIDATOR ] GNRC: Validating primary data.
[2025-10-24T19:02:03.347944] [INFO ] [REMOTE    ] GOF: Fetching primary data for 2025-08.
[2025-10-24T19:02:03.349090] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present.
[2025-10-24T19:02:03.349208] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed.
[2025-10-24T19:02:03.350287] [INFO ] [MAIN      ] GNRC: Fetched primary data is valid.
[2025-10-24T19:02:03.350461] [DEBUG] [LOCAL     ] GNRC: Saving primary data.
[2025-10-24T19:02:03.351140] [FATAL] [LOCAL     ] GNRC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:02:03.351231] [FATAL] [MAIN      ] GNRC: Failed to save primary data.
[2025-10-24T19:02:03.351295] [WARN ] [MAIN      ] GNRC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:02:03.351361] [INFO ] [LOCAL     ] GNRC: Starting deletion of primary data.
[2025-10-24T19:02:03.351423] [DEBUG] [LOCAL     ] GNRC: No primary data file found to delete.
[2025-10-24T19:02:03.351461] [INFO ] [LOCAL     ] GNRC: Starting deletion of derivative data.
[2025-10-24T19:02:03.351596] [DEBUG] [LOCAL     ] GNRC: Deleted derivative data file.
[2025-10-24T19:02:03.351981] [INFO ] [MAIN      ] Update Progress: 952/2366 symbols completed. GNRC took 40.6s. Estimated remaining: 3h 1m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:02:03.534043] [INFO ] [MAIN      ] GOOS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:02:03.567365] [INFO ] [REMOTE    ] GNW: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T19:02:03.619332] [DEBUG] [LOCAL     ] GOOS: Loaded 44323 existing records from primary storage.
[2025-10-24T19:02:03.619635] [INFO ] [MAIN      ] GOOS: Loaded 44323 existing records.
[2025-10-24T19:02:03.807429] [WARN ] [MAIN      ] GOOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:02:03.807625] [INFO ] [MAIN      ] GOOS: Wiping existing primary data before full refresh.
[2025-10-24T19:02:03.807704] [INFO ] [LOCAL     ] GOOS: Starting deletion of primary data.
[2025-10-24T19:02:03.808112] [DEBUG] [LOCAL     ] GOOS: Deleted primary data file.
[2025-10-24T19:02:03.808150] [INFO ] [MAIN      ] GOOS: Starting full primary refresh.
[2025-10-24T19:02:04.148003] [INFO ] [REMOTE    ] GNW: Fetching primary data for 2025-09.
[2025-10-24T19:02:04.167386] [INFO ] [REMOTE    ] GOOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:02:04.210259] [INFO ] [REMOTE    ] GOLF: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T19:02:04.947719] [INFO ] [REMOTE    ] GOLF: Fetching primary data for 2025-05.
[2025-10-24T19:02:05.074864] [INFO ] [REMOTE    ] GOF: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T19:02:05.459253] [INFO ] [REMOTE    ] GNW: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T19:02:05.747737] [INFO ] [REMOTE    ] GOF: Fetching primary data for 2025-09.
[2025-10-24T19:02:06.320442] [INFO ] [REMOTE    ] GOLF: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T19:02:06.547715] [INFO ] [REMOTE    ] GOOS: Fetching primary data for 2025-01.
[2025-10-24T19:02:07.347705] [INFO ] [REMOTE    ] GOLF: Fetching primary data for 2025-06.
[2025-10-24T19:02:07.466976] [INFO ] [REMOTE    ] GOF: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T19:02:08.043501] [INFO ] [REMOTE    ] GOOS: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T19:02:08.144762] [INFO ] [REMOTE    ] GOLF: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T19:02:08.150791] [INFO ] [REMOTE    ] GOF: Fetching primary data for 2025-10.
[2025-10-24T19:02:08.947687] [INFO ] [REMOTE    ] GOOS: Fetching primary data for 2025-02.
[2025-10-24T19:02:09.747682] [INFO ] [REMOTE    ] GOLF: Fetching primary data for 2025-07.
[2025-10-24T19:02:10.020341] [INFO ] [REMOTE    ] GOF: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T19:02:10.029295] [INFO ] [REMOTE    ] GOF: Full fetch complete (62736 records).
[2025-10-24T19:02:10.029451] [DEBUG] [VALIDATOR ] GOF: Validating primary data.
[2025-10-24T19:02:10.355213] [INFO ] [REMOTE    ] GOOS: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T19:02:10.465411] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present.
[2025-10-24T19:02:10.465499] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed.
[2025-10-24T19:02:10.466369] [INFO ] [MAIN      ] GOF: Fetched primary data is valid.
[2025-10-24T19:02:10.466443] [DEBUG] [LOCAL     ] GOF: Saving primary data.
[2025-10-24T19:02:10.467055] [FATAL] [LOCAL     ] GOF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:02:10.467182] [FATAL] [MAIN      ] GOF: Failed to save primary data.
[2025-10-24T19:02:10.467237] [WARN ] [MAIN      ] GOF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:02:10.467276] [INFO ] [LOCAL     ] GOF: Starting deletion of primary data.
[2025-10-24T19:02:10.467331] [DEBUG] [LOCAL     ] GOF: No primary data file found to delete.
[2025-10-24T19:02:10.467368] [INFO ] [LOCAL     ] GOF: Starting deletion of derivative data.
[2025-10-24T19:02:10.467549] [DEBUG] [LOCAL     ] GOF: Deleted derivative data file.
[2025-10-24T19:02:10.467819] [INFO ] [MAIN      ] Update Progress: 953/2366 symbols completed. GOF took 29.0s. Estimated remaining: 3h 1m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:02:10.557397] [INFO ] [REMOTE    ] GNW: Fetching primary data for 2025-10.
[2025-10-24T19:02:10.638287] [INFO ] [MAIN      ] GOTU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:02:10.672466] [DEBUG] [LOCAL     ] GOTU: Loaded 37025 existing records from primary storage.
[2025-10-24T19:02:10.672774] [INFO ] [MAIN      ] GOTU: Loaded 37025 existing records.
[2025-10-24T19:02:10.849490] [WARN ] [MAIN      ] GOTU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:02:10.849705] [INFO ] [MAIN      ] GOTU: Wiping existing primary data before full refresh.
[2025-10-24T19:02:10.849761] [INFO ] [LOCAL     ] GOTU: Starting deletion of primary data.
[2025-10-24T19:02:10.850095] [DEBUG] [LOCAL     ] GOTU: Deleted primary data file.
[2025-10-24T19:02:10.850133] [INFO ] [MAIN      ] GOTU: Starting full primary refresh.
[2025-10-24T19:02:11.226896] [INFO ] [REMOTE    ] GOTU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:02:11.227839] [INFO ] [REMOTE    ] GOLF: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T19:02:11.347598] [INFO ] [REMOTE    ] GOTU: Fetching primary data for 2025-01.
[2025-10-24T19:02:11.991934] [INFO ] [REMOTE    ] GNW: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T19:02:12.001458] [INFO ] [REMOTE    ] GNW: Full fetch complete (73909 records).
[2025-10-24T19:02:12.001603] [DEBUG] [VALIDATOR ] GNW: Validating primary data.
[2025-10-24T19:02:12.154979] [INFO ] [REMOTE    ] GOLF: Fetching primary data for 2025-08.
[2025-10-24T19:02:12.387953] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present.
[2025-10-24T19:02:12.388030] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed.
[2025-10-24T19:02:12.388978] [INFO ] [MAIN      ] GNW: Fetched primary data is valid.
[2025-10-24T19:02:12.389042] [DEBUG] [LOCAL     ] GNW: Saving primary data.
[2025-10-24T19:02:12.389604] [FATAL] [LOCAL     ] GNW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:02:12.389718] [FATAL] [MAIN      ] GNW: Failed to save primary data.
[2025-10-24T19:02:12.389959] [WARN ] [MAIN      ] GNW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:02:12.390090] [INFO ] [LOCAL     ] GNW: Starting deletion of primary data.
[2025-10-24T19:02:12.390153] [DEBUG] [LOCAL     ] GNW: No primary data file found to delete.
[2025-10-24T19:02:12.390222] [INFO ] [LOCAL     ] GNW: Starting deletion of derivative data.
[2025-10-24T19:02:12.390372] [DEBUG] [LOCAL     ] GNW: Deleted derivative data file.
[2025-10-24T19:02:12.390607] [INFO ] [MAIN      ] Update Progress: 954/2366 symbols completed. GNW took 40.6s. Estimated remaining: 3h 0m 48s. Rate: 7.8 symbols/min
[2025-10-24T19:02:12.569142] [INFO ] [MAIN      ] GPC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:02:12.620611] [DEBUG] [LOCAL     ] GPC: Loaded 46263 existing records from primary storage.
[2025-10-24T19:02:12.620978] [INFO ] [MAIN      ] GPC: Loaded 46263 existing records.
[2025-10-24T19:02:12.807441] [WARN ] [MAIN      ] GPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:02:12.807746] [INFO ] [MAIN      ] GPC: Wiping existing primary data before full refresh.
[2025-10-24T19:02:12.807829] [INFO ] [LOCAL     ] GPC: Starting deletion of primary data.
[2025-10-24T19:02:12.816950] [DEBUG] [LOCAL     ] GPC: Deleted primary data file.
[2025-10-24T19:02:12.829310] [INFO ] [MAIN      ] GPC: Starting full primary refresh.
[2025-10-24T19:02:12.901959] [INFO ] [REMOTE    ] GOTU: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T19:02:12.952720] [INFO ] [REMOTE    ] GOOS: Fetching primary data for 2025-03.
[2025-10-24T19:02:13.192432] [INFO ] [REMOTE    ] GPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:02:13.307043] [INFO ] [REMOTE    ] GOLF: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T19:02:13.747676] [INFO ] [REMOTE    ] GOTU: Fetching primary data for 2025-02.
[2025-10-24T19:02:14.547723] [INFO ] [REMOTE    ] GOLF: Fetching primary data for 2025-09.
[2025-10-24T19:02:14.840225] [INFO ] [REMOTE    ] GOOS: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T19:02:14.956322] [INFO ] [REMOTE    ] GOTU: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T19:02:15.347726] [INFO ] [REMOTE    ] GOOS: Fetching primary data for 2025-04.
[2025-10-24T19:02:15.714537] [INFO ] [REMOTE    ] GOLF: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T19:02:16.147722] [INFO ] [REMOTE    ] GOTU: Fetching primary data for 2025-03.
[2025-10-24T19:02:16.947618] [INFO ] [REMOTE    ] GOLF: Fetching primary data for 2025-10.
[2025-10-24T19:02:17.061001] [INFO ] [REMOTE    ] GOOS: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T19:02:17.747704] [INFO ] [REMOTE    ] GPC: Fetching primary data for 2025-01.
[2025-10-24T19:02:17.973971] [INFO ] [REMOTE    ] GOTU: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T19:02:18.028638] [INFO ] [REMOTE    ] GOLF: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T19:02:18.033607] [INFO ] [REMOTE    ] GOLF: Full fetch complete (45309 records).
[2025-10-24T19:02:18.033768] [DEBUG] [VALIDATOR ] GOLF: Validating primary data.
[2025-10-24T19:02:18.434611] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present.
[2025-10-24T19:02:18.434729] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed.
[2025-10-24T19:02:18.435462] [INFO ] [MAIN      ] GOLF: Fetched primary data is valid.
[2025-10-24T19:02:18.435508] [DEBUG] [LOCAL     ] GOLF: Saving primary data.
[2025-10-24T19:02:18.435925] [FATAL] [LOCAL     ] GOLF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:02:18.436008] [FATAL] [MAIN      ] GOLF: Failed to save primary data.
[2025-10-24T19:02:18.436049] [WARN ] [MAIN      ] GOLF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:02:18.436089] [INFO ] [LOCAL     ] GOLF: Starting deletion of primary data.
[2025-10-24T19:02:18.436195] [DEBUG] [LOCAL     ] GOLF: No primary data file found to delete.
[2025-10-24T19:02:18.436273] [INFO ] [LOCAL     ] GOLF: Starting deletion of derivative data.
[2025-10-24T19:02:18.436479] [DEBUG] [LOCAL     ] GOLF: Deleted derivative data file.
[2025-10-24T19:02:18.436592] [INFO ] [MAIN      ] Update Progress: 955/2366 symbols completed. GOLF took 25.8s. Estimated remaining: 3h 0m 38s. Rate: 7.8 symbols/min
[2025-10-24T19:02:18.552745] [INFO ] [REMOTE    ] GOOS: Fetching primary data for 2025-05.
[2025-10-24T19:02:18.608233] [INFO ] [MAIN      ] GPI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:02:18.625514] [DEBUG] [LOCAL     ] GPI: Loaded 14863 existing records from primary storage.
[2025-10-24T19:02:18.625766] [INFO ] [MAIN      ] GPI: Loaded 14863 existing records.
[2025-10-24T19:02:18.799639] [WARN ] [MAIN      ] GPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:02:18.799852] [INFO ] [MAIN      ] GPI: Wiping existing primary data before full refresh.
[2025-10-24T19:02:18.799921] [INFO ] [LOCAL     ] GPI: Starting deletion of primary data.
[2025-10-24T19:02:18.800194] [DEBUG] [LOCAL     ] GPI: Deleted primary data file.
[2025-10-24T19:02:18.800252] [INFO ] [MAIN      ] GPI: Starting full primary refresh.
[2025-10-24T19:02:19.152917] [INFO ] [REMOTE    ] GPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:02:19.347682] [INFO ] [REMOTE    ] GOTU: Fetching primary data for 2025-04.
[2025-10-24T19:02:19.470893] [INFO ] [REMOTE    ] GPC: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T19:02:20.147690] [INFO ] [REMOTE    ] GPC: Fetching primary data for 2025-02.
[2025-10-24T19:02:20.191463] [INFO ] [REMOTE    ] GOOS: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T19:02:20.808802] [INFO ] [REMOTE    ] GOTU: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T19:02:20.947671] [INFO ] [REMOTE    ] GOOS: Fetching primary data for 2025-06.
[2025-10-24T19:02:21.747633] [INFO ] [REMOTE    ] GPI: Fetching primary data for 2025-01.
[2025-10-24T19:02:21.826503] [INFO ] [REMOTE    ] GPC: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T19:02:22.495829] [INFO ] [REMOTE    ] GOOS: Incremental fetch complete for 2025-06 (1.55 seconds).
[2025-10-24T19:02:22.548869] [INFO ] [REMOTE    ] GPC: Fetching primary data for 2025-03.
[2025-10-24T19:02:22.552244] [INFO ] [REMOTE    ] GPI: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T19:02:23.347718] [INFO ] [REMOTE    ] GOOS: Fetching primary data for 2025-07.
[2025-10-24T19:02:24.147686] [INFO ] [REMOTE    ] GOTU: Fetching primary data for 2025-05.
[2025-10-24T19:02:24.274136] [INFO ] [REMOTE    ] GPC: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T19:02:24.947623] [INFO ] [REMOTE    ] GPC: Fetching primary data for 2025-04.
[2025-10-24T19:02:25.221961] [INFO ] [REMOTE    ] GOOS: Incremental fetch complete for 2025-07 (1.87 seconds).
[2025-10-24T19:02:25.575333] [INFO ] [REMOTE    ] GOTU: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T19:02:25.747682] [INFO ] [REMOTE    ] GPI: Fetching primary data for 2025-02.
[2025-10-24T19:02:26.547718] [INFO ] [REMOTE    ] GOOS: Fetching primary data for 2025-08.
[2025-10-24T19:02:26.593448] [INFO ] [REMOTE    ] GPI: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T19:02:26.697310] [INFO ] [REMOTE    ] GPC: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T19:02:27.347754] [INFO ] [REMOTE    ] GOTU: Fetching primary data for 2025-06.
[2025-10-24T19:02:28.081969] [INFO ] [REMOTE    ] GOOS: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T19:02:28.147634] [INFO ] [REMOTE    ] GOOS: Fetching primary data for 2025-09.
[2025-10-24T19:02:28.700205] [INFO ] [REMOTE    ] GOTU: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T19:02:28.947714] [INFO ] [REMOTE    ] GPC: Fetching primary data for 2025-05.
[2025-10-24T19:02:29.152958] [INFO ] [REMOTE    ] GOOS: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T19:02:29.747722] [INFO ] [REMOTE    ] GPI: Fetching primary data for 2025-03.
[2025-10-24T19:02:30.562453] [INFO ] [REMOTE    ] GOOS: Fetching primary data for 2025-10.
[2025-10-24T19:02:30.565709] [INFO ] [REMOTE    ] GPC: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T19:02:30.885752] [INFO ] [REMOTE    ] GPI: Incremental fetch complete for 2025-03 (1.14 seconds).
[2025-10-24T19:02:31.347694] [INFO ] [REMOTE    ] GPI: Fetching primary data for 2025-04.
[2025-10-24T19:02:32.147688] [INFO ] [REMOTE    ] GPC: Fetching primary data for 2025-06.
[2025-10-24T19:02:32.186345] [INFO ] [REMOTE    ] GOOS: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T19:02:32.193817] [INFO ] [REMOTE    ] GOOS: Full fetch complete (64580 records).
[2025-10-24T19:02:32.194124] [DEBUG] [VALIDATOR ] GOOS: Validating primary data.
[2025-10-24T19:02:32.316357] [INFO ] [REMOTE    ] GPI: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T19:02:32.682833] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present.
[2025-10-24T19:02:32.682918] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed.
[2025-10-24T19:02:32.683768] [INFO ] [MAIN      ] GOOS: Fetched primary data is valid.
[2025-10-24T19:02:32.683831] [DEBUG] [LOCAL     ] GOOS: Saving primary data.
[2025-10-24T19:02:32.684419] [FATAL] [LOCAL     ] GOOS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:02:32.684516] [FATAL] [MAIN      ] GOOS: Failed to save primary data.
[2025-10-24T19:02:32.684558] [WARN ] [MAIN      ] GOOS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:02:32.684592] [INFO ] [LOCAL     ] GOOS: Starting deletion of primary data.
[2025-10-24T19:02:32.684671] [DEBUG] [LOCAL     ] GOOS: No primary data file found to delete.
[2025-10-24T19:02:32.684729] [INFO ] [LOCAL     ] GOOS: Starting deletion of derivative data.
[2025-10-24T19:02:32.684894] [DEBUG] [LOCAL     ] GOOS: Deleted derivative data file.
[2025-10-24T19:02:32.685446] [INFO ] [MAIN      ] Update Progress: 956/2366 symbols completed. GOOS took 29.3s. Estimated remaining: 3h 0m 40s. Rate: 7.8 symbols/min
[2025-10-24T19:02:32.858157] [INFO ] [MAIN      ] GPJA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:02:32.865283] [DEBUG] [LOCAL     ] GPJA: Loaded 4128 existing records from primary storage.
[2025-10-24T19:02:32.865490] [INFO ] [MAIN      ] GPJA: Loaded 4128 existing records.
[2025-10-24T19:02:32.955140] [INFO ] [REMOTE    ] GPI: Fetching primary data for 2025-05.
[2025-10-24T19:02:33.044825] [WARN ] [MAIN      ] GPJA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:02:33.045027] [INFO ] [MAIN      ] GPJA: Wiping existing primary data before full refresh.
[2025-10-24T19:02:33.045072] [INFO ] [LOCAL     ] GPJA: Starting deletion of primary data.
[2025-10-24T19:02:33.045248] [DEBUG] [LOCAL     ] GPJA: Deleted primary data file.
[2025-10-24T19:02:33.045315] [INFO ] [MAIN      ] GPJA: Starting full primary refresh.
[2025-10-24T19:02:33.395490] [INFO ] [REMOTE    ] GPJA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:02:33.747624] [INFO ] [REMOTE    ] GPJA: Fetching primary data for 2025-01.
[2025-10-24T19:02:33.788943] [INFO ] [REMOTE    ] GPC: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T19:02:33.869092] [INFO ] [REMOTE    ] GPI: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T19:02:34.526890] [INFO ] [REMOTE    ] GPJA: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T19:02:34.547681] [INFO ] [REMOTE    ] GOTU: Fetching primary data for 2025-07.
[2025-10-24T19:02:35.347686] [INFO ] [REMOTE    ] GPI: Fetching primary data for 2025-06.
[2025-10-24T19:02:35.829146] [INFO ] [REMOTE    ] GOTU: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T19:02:36.147715] [INFO ] [REMOTE    ] GOTU: Fetching primary data for 2025-08.
[2025-10-24T19:02:36.345210] [INFO ] [REMOTE    ] GPI: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T19:02:36.947735] [INFO ] [REMOTE    ] GPJA: Fetching primary data for 2025-02.
[2025-10-24T19:02:37.520755] [INFO ] [REMOTE    ] GPJA: Incremental fetch complete for 2025-02 (0.57 seconds).
[2025-10-24T19:02:37.521894] [INFO ] [REMOTE    ] GOTU: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T19:02:37.747709] [INFO ] [REMOTE    ] GPC: Fetching primary data for 2025-07.
[2025-10-24T19:02:38.547726] [INFO ] [REMOTE    ] GOTU: Fetching primary data for 2025-09.
[2025-10-24T19:02:39.347702] [INFO ] [REMOTE    ] GPI: Fetching primary data for 2025-07.
[2025-10-24T19:02:39.411110] [INFO ] [REMOTE    ] GPC: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T19:02:39.970873] [INFO ] [REMOTE    ] GOTU: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T19:02:40.008580] [INFO ] [REMOTE    ] GPI: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T19:02:40.147674] [INFO ] [REMOTE    ] GPI: Fetching primary data for 2025-08.
[2025-10-24T19:02:40.945233] [INFO ] [REMOTE    ] GPI: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T19:02:40.949176] [INFO ] [REMOTE    ] GPJA: Fetching primary data for 2025-03.
[2025-10-24T19:02:41.489450] [INFO ] [REMOTE    ] GPJA: Incremental fetch complete for 2025-03 (0.54 seconds).
[2025-10-24T19:02:41.747728] [INFO ] [REMOTE    ] GPJA: Fetching primary data for 2025-04.
[2025-10-24T19:02:42.381897] [INFO ] [REMOTE    ] GPJA: Incremental fetch complete for 2025-04 (0.63 seconds).
[2025-10-24T19:02:42.547705] [INFO ] [REMOTE    ] GPC: Fetching primary data for 2025-08.
[2025-10-24T19:02:43.347704] [INFO ] [REMOTE    ] GOTU: Fetching primary data for 2025-10.
[2025-10-24T19:02:43.910875] [INFO ] [REMOTE    ] GPC: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T19:02:44.147685] [INFO ] [REMOTE    ] GPJA: Fetching primary data for 2025-05.
[2025-10-24T19:02:44.703894] [INFO ] [REMOTE    ] GOTU: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T19:02:44.710372] [INFO ] [REMOTE    ] GOTU: Full fetch complete (57963 records).
[2025-10-24T19:02:44.710539] [DEBUG] [VALIDATOR ] GOTU: Validating primary data.
[2025-10-24T19:02:44.828769] [INFO ] [REMOTE    ] GPJA: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T19:02:44.952803] [INFO ] [REMOTE    ] GPC: Fetching primary data for 2025-09.
[2025-10-24T19:02:45.184612] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present.
[2025-10-24T19:02:45.184754] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed.
[2025-10-24T19:02:45.185559] [INFO ] [MAIN      ] GOTU: Fetched primary data is valid.
[2025-10-24T19:02:45.185609] [DEBUG] [LOCAL     ] GOTU: Saving primary data.
[2025-10-24T19:02:45.186271] [FATAL] [LOCAL     ] GOTU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:02:45.186383] [FATAL] [MAIN      ] GOTU: Failed to save primary data.
[2025-10-24T19:02:45.186448] [WARN ] [MAIN      ] GOTU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:02:45.186512] [INFO ] [LOCAL     ] GOTU: Starting deletion of primary data.
[2025-10-24T19:02:45.186576] [DEBUG] [LOCAL     ] GOTU: No primary data file found to delete.
[2025-10-24T19:02:45.186612] [INFO ] [LOCAL     ] GOTU: Starting deletion of derivative data.
[2025-10-24T19:02:45.186777] [DEBUG] [LOCAL     ] GOTU: Deleted derivative data file.
[2025-10-24T19:02:45.186878] [INFO ] [MAIN      ] Update Progress: 957/2366 symbols completed. GOTU took 34.7s. Estimated remaining: 3h 0m 40s. Rate: 7.8 symbols/min
[2025-10-24T19:02:45.747721] [INFO ] [REMOTE    ] GPI: Fetching primary data for 2025-09.
[2025-10-24T19:02:46.547678] [INFO ] [REMOTE    ] GPJA: Fetching primary data for 2025-06.
[2025-10-24T19:02:46.697208] [INFO ] [REMOTE    ] GPC: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T19:02:46.697558] [INFO ] [REMOTE    ] GPI: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T19:02:46.923461] [INFO ] [REMOTE    ] GPJA: Incremental fetch complete for 2025-06 (0.38 seconds).
[2025-10-24T19:02:47.347749] [INFO ] [REMOTE    ] GPJA: Fetching primary data for 2025-07.
[2025-10-24T19:02:47.985157] [INFO ] [REMOTE    ] GPJA: Incremental fetch complete for 2025-07 (0.64 seconds).
[2025-10-24T19:02:48.147721] [INFO ] [REMOTE    ] GPC: Fetching primary data for 2025-10.
[2025-10-24T19:02:48.947722] [INFO ] [REMOTE    ] GPI: Fetching primary data for 2025-10.
[2025-10-24T19:02:49.747711] [INFO ] [REMOTE    ] GPJA: Fetching primary data for 2025-08.
[2025-10-24T19:02:49.958885] [INFO ] [REMOTE    ] GPC: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T19:02:49.967537] [INFO ] [REMOTE    ] GPC: Full fetch complete (68680 records).
[2025-10-24T19:02:49.967726] [DEBUG] [VALIDATOR ] GPC: Validating primary data.
[2025-10-24T19:02:50.350295] [INFO ] [REMOTE    ] GPI: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T19:02:50.396554] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present.
[2025-10-24T19:02:50.396931] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed.
[2025-10-24T19:02:50.396780] [INFO ] [REMOTE    ] GPI: Full fetch complete (21935 records).
[2025-10-24T19:02:50.403386] [INFO ] [MAIN      ] GPC: Fetched primary data is valid.
[2025-10-24T19:02:50.403550] [DEBUG] [VALIDATOR ] GPI: Validating primary data.
[2025-10-24T19:02:50.403855] [INFO ] [REMOTE    ] GPJA: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T19:02:50.428857] [DEBUG] [LOCAL     ] GPC: Saving primary data.
[2025-10-24T19:02:50.475031] [FATAL] [LOCAL     ] GPC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:02:50.511518] [FATAL] [MAIN      ] GPC: Failed to save primary data.
[2025-10-24T19:02:50.514050] [WARN ] [MAIN      ] GPC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:02:50.514153] [INFO ] [LOCAL     ] GPC: Starting deletion of primary data.
[2025-10-24T19:02:50.514258] [DEBUG] [LOCAL     ] GPC: No primary data file found to delete.
[2025-10-24T19:02:50.519975] [INFO ] [LOCAL     ] GPC: Starting deletion of derivative data.
[2025-10-24T19:02:50.530406] [DEBUG] [LOCAL     ] GPC: Deleted derivative data file.
[2025-10-24T19:02:50.530730] [INFO ] [MAIN      ] Update Progress: 958/2366 symbols completed. GPC took 38.1s. Estimated remaining: 3h 0m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:02:50.554740] [INFO ] [REMOTE    ] GPJA: Fetching primary data for 2025-09.
[2025-10-24T19:02:50.789532] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present.
[2025-10-24T19:02:50.789611] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed.
[2025-10-24T19:02:50.790143] [INFO ] [MAIN      ] GPI: Fetched primary data is valid.
[2025-10-24T19:02:50.790203] [DEBUG] [LOCAL     ] GPI: Saving primary data.
[2025-10-24T19:02:50.790482] [FATAL] [LOCAL     ] GPI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:02:50.790589] [FATAL] [MAIN      ] GPI: Failed to save primary data.
[2025-10-24T19:02:50.790639] [WARN ] [MAIN      ] GPI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:02:50.790746] [INFO ] [LOCAL     ] GPI: Starting deletion of primary data.
[2025-10-24T19:02:50.790821] [DEBUG] [LOCAL     ] GPI: No primary data file found to delete.
[2025-10-24T19:02:50.790867] [INFO ] [LOCAL     ] GPI: Starting deletion of derivative data.
[2025-10-24T19:02:50.791043] [DEBUG] [LOCAL     ] GPI: Deleted derivative data file.
[2025-10-24T19:02:50.791152] [INFO ] [MAIN      ] Update Progress: 959/2366 symbols completed. GPI took 32.4s. Estimated remaining: 3h 0m 10s. Rate: 7.8 symbols/min
[2025-10-24T19:02:51.155353] [INFO ] [REMOTE    ] GPJA: Incremental fetch complete for 2025-09 (0.60 seconds).
[2025-10-24T19:02:51.347699] [INFO ] [REMOTE    ] GPJA: Fetching primary data for 2025-10.
[2025-10-24T19:02:51.951553] [INFO ] [REMOTE    ] GPJA: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T19:02:51.952761] [INFO ] [REMOTE    ] GPJA: Full fetch complete (6787 records).
[2025-10-24T19:02:51.952840] [DEBUG] [VALIDATOR ] GPJA: Validating primary data.
[2025-10-24T19:02:52.319099] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present.
[2025-10-24T19:02:52.319198] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed.
[2025-10-24T19:02:52.319389] [INFO ] [MAIN      ] GPJA: Fetched primary data is valid.
[2025-10-24T19:02:52.319468] [DEBUG] [LOCAL     ] GPJA: Saving primary data.
[2025-10-24T19:02:52.319748] [FATAL] [LOCAL     ] GPJA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:02:52.319838] [FATAL] [MAIN      ] GPJA: Failed to save primary data.
[2025-10-24T19:02:52.319880] [WARN ] [MAIN      ] GPJA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:02:52.319914] [INFO ] [LOCAL     ] GPJA: Starting deletion of primary data.
[2025-10-24T19:02:52.319968] [DEBUG] [LOCAL     ] GPJA: No primary data file found to delete.
[2025-10-24T19:02:52.320047] [INFO ] [LOCAL     ] GPJA: Starting deletion of derivative data.
[2025-10-24T19:02:52.320199] [DEBUG] [LOCAL     ] GPJA: Deleted derivative data file.
[2025-10-24T19:02:52.320296] [INFO ] [MAIN      ] Update Progress: 960/2366 symbols completed. GPJA took 19.6s. Estimated remaining: 2h 59m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:02:52.847940] [INFO ] [MAIN      ] GPN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:02:53.018413] [INFO ] [MAIN      ] GPMT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:02:53.027615] [INFO ] [MAIN      ] GPK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:02:53.047717] [INFO ] [MAIN      ] GPOR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:02:53.073992] [DEBUG] [LOCAL     ] GPMT: Loaded 26058 existing records from primary storage.
[2025-10-24T19:02:53.086898] [INFO ] [MAIN      ] GPMT: Loaded 26058 existing records.
[2025-10-24T19:02:53.219959] [DEBUG] [LOCAL     ] GPOR: Loaded 23577 existing records from primary storage.
[2025-10-24T19:02:53.223736] [INFO ] [MAIN      ] GPOR: Loaded 23577 existing records.
[2025-10-24T19:02:53.225288] [DEBUG] [LOCAL     ] GPN: Loaded 52198 existing records from primary storage.
[2025-10-24T19:02:53.322229] [INFO ] [MAIN      ] GPN: Loaded 52198 existing records.
[2025-10-24T19:02:53.444353] [WARN ] [MAIN      ] GPMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:02:53.481843] [INFO ] [MAIN      ] GPMT: Wiping existing primary data before full refresh.
[2025-10-24T19:02:53.498234] [DEBUG] [LOCAL     ] GPK: Loaded 53166 existing records from primary storage.
[2025-10-24T19:02:53.498525] [INFO ] [LOCAL     ] GPMT: Starting deletion of primary data.
[2025-10-24T19:02:53.523416] [INFO ] [MAIN      ] GPK: Loaded 53166 existing records.
[2025-10-24T19:02:53.599007] [DEBUG] [LOCAL     ] GPMT: Deleted primary data file.
[2025-10-24T19:02:53.599173] [INFO ] [MAIN      ] GPMT: Starting full primary refresh.
[2025-10-24T19:02:53.698035] [WARN ] [MAIN      ] GPOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:02:53.708662] [INFO ] [MAIN      ] GPOR: Wiping existing primary data before full refresh.
[2025-10-24T19:02:53.719313] [INFO ] [LOCAL     ] GPOR: Starting deletion of primary data.
[2025-10-24T19:02:53.751715] [DEBUG] [LOCAL     ] GPOR: Deleted primary data file.
[2025-10-24T19:02:53.760860] [INFO ] [MAIN      ] GPOR: Starting full primary refresh.
[2025-10-24T19:02:54.023636] [WARN ] [MAIN      ] GPN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:02:54.163977] [INFO ] [MAIN      ] GPN: Wiping existing primary data before full refresh.
[2025-10-24T19:02:54.237080] [INFO ] [LOCAL     ] GPN: Starting deletion of primary data.
[2025-10-24T19:02:54.267452] [WARN ] [MAIN      ] GPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:02:54.299441] [INFO ] [MAIN      ] GPK: Wiping existing primary data before full refresh.
[2025-10-24T19:02:54.304828] [DEBUG] [LOCAL     ] GPN: Deleted primary data file.
[2025-10-24T19:02:54.305060] [INFO ] [LOCAL     ] GPK: Starting deletion of primary data.
[2025-10-24T19:02:54.331102] [INFO ] [MAIN      ] GPN: Starting full primary refresh.
[2025-10-24T19:02:54.359425] [DEBUG] [LOCAL     ] GPK: Deleted primary data file.
[2025-10-24T19:02:54.438221] [INFO ] [MAIN      ] GPK: Starting full primary refresh.
[2025-10-24T19:02:55.040593] [INFO ] [REMOTE    ] GPMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:02:55.102838] [INFO ] [REMOTE    ] GPMT: Fetching primary data for 2025-01.
[2025-10-24T19:02:55.127935] [INFO ] [REMOTE    ] GPOR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:02:55.195982] [INFO ] [REMOTE    ] GPOR: Fetching primary data for 2025-01.
[2025-10-24T19:02:55.408926] [INFO ] [REMOTE    ] GPN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:02:55.433736] [INFO ] [REMOTE    ] GPN: Fetching primary data for 2025-01.
[2025-10-24T19:02:55.460541] [INFO ] [REMOTE    ] GPK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:02:55.460866] [INFO ] [REMOTE    ] GPK: Fetching primary data for 2025-01.
[2025-10-24T19:02:56.244181] [INFO ] [REMOTE    ] GPMT: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T19:02:56.249243] [INFO ] [REMOTE    ] GPMT: Fetching primary data for 2025-02.
[2025-10-24T19:02:56.353815] [INFO ] [REMOTE    ] GPOR: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T19:02:56.362871] [INFO ] [REMOTE    ] GPOR: Fetching primary data for 2025-02.
[2025-10-24T19:02:56.894152] [INFO ] [REMOTE    ] GPK: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T19:02:56.947607] [INFO ] [REMOTE    ] GPK: Fetching primary data for 2025-02.
[2025-10-24T19:02:56.998081] [INFO ] [REMOTE    ] GPN: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T19:02:57.063955] [INFO ] [REMOTE    ] GPMT: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T19:02:57.470640] [INFO ] [REMOTE    ] GPOR: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T19:02:57.747694] [INFO ] [REMOTE    ] GPMT: Fetching primary data for 2025-03.
[2025-10-24T19:02:58.429451] [INFO ] [REMOTE    ] GPK: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T19:02:58.547679] [INFO ] [REMOTE    ] GPK: Fetching primary data for 2025-03.
[2025-10-24T19:02:58.930454] [INFO ] [REMOTE    ] GPMT: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T19:02:59.347686] [INFO ] [REMOTE    ] GPMT: Fetching primary data for 2025-04.
[2025-10-24T19:03:00.147678] [INFO ] [REMOTE    ] GPOR: Fetching primary data for 2025-03.
[2025-10-24T19:03:00.318515] [INFO ] [REMOTE    ] GPK: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T19:03:00.768391] [INFO ] [REMOTE    ] GPMT: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T19:03:00.947687] [INFO ] [REMOTE    ] GPN: Fetching primary data for 2025-02.
[2025-10-24T19:03:00.974501] [INFO ] [REMOTE    ] GPOR: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T19:03:01.747719] [INFO ] [REMOTE    ] GPOR: Fetching primary data for 2025-04.
[2025-10-24T19:03:02.547714] [INFO ] [REMOTE    ] GPK: Fetching primary data for 2025-04.
[2025-10-24T19:03:02.600616] [INFO ] [REMOTE    ] GPN: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T19:03:02.891535] [INFO ] [REMOTE    ] GPOR: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T19:03:03.347742] [INFO ] [REMOTE    ] GPN: Fetching primary data for 2025-03.
[2025-10-24T19:03:04.147636] [INFO ] [REMOTE    ] GPOR: Fetching primary data for 2025-05.
[2025-10-24T19:03:04.263968] [INFO ] [REMOTE    ] GPK: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T19:03:04.947767] [INFO ] [REMOTE    ] GPK: Fetching primary data for 2025-05.
[2025-10-24T19:03:05.170210] [INFO ] [REMOTE    ] GPN: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T19:03:05.233588] [INFO ] [REMOTE    ] GPOR: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T19:03:05.747707] [INFO ] [REMOTE    ] GPOR: Fetching primary data for 2025-06.
[2025-10-24T19:03:06.492955] [INFO ] [REMOTE    ] GPK: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T19:03:06.547604] [INFO ] [REMOTE    ] GPK: Fetching primary data for 2025-06.
[2025-10-24T19:03:06.810314] [INFO ] [REMOTE    ] GPOR: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T19:03:07.347728] [INFO ] [REMOTE    ] GPN: Fetching primary data for 2025-04.
[2025-10-24T19:03:08.147725] [INFO ] [REMOTE    ] GPOR: Fetching primary data for 2025-07.
[2025-10-24T19:03:08.276200] [INFO ] [REMOTE    ] GPK: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T19:03:08.947718] [INFO ] [REMOTE    ] GPMT: Fetching primary data for 2025-05.
[2025-10-24T19:03:09.262067] [INFO ] [REMOTE    ] GPN: Incremental fetch complete for 2025-04 (1.91 seconds).
[2025-10-24T19:03:09.289553] [INFO ] [REMOTE    ] GPOR: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T19:03:09.747749] [INFO ] [REMOTE    ] GPOR: Fetching primary data for 2025-08.
[2025-10-24T19:03:10.273237] [INFO ] [REMOTE    ] GPMT: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T19:03:10.547626] [INFO ] [REMOTE    ] GPN: Fetching primary data for 2025-05.
[2025-10-24T19:03:10.874106] [INFO ] [REMOTE    ] GPOR: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T19:03:11.347637] [INFO ] [REMOTE    ] GPMT: Fetching primary data for 2025-06.
[2025-10-24T19:03:12.147622] [INFO ] [REMOTE    ] GPOR: Fetching primary data for 2025-09.
[2025-10-24T19:03:12.483675] [INFO ] [REMOTE    ] GPN: Incremental fetch complete for 2025-05 (1.94 seconds).
[2025-10-24T19:03:12.530130] [INFO ] [REMOTE    ] GPMT: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T19:03:12.947615] [INFO ] [REMOTE    ] GPK: Fetching primary data for 2025-07.
[2025-10-24T19:03:13.414215] [INFO ] [REMOTE    ] GPOR: Incremental fetch complete for 2025-09 (1.27 seconds).
[2025-10-24T19:03:13.747636] [INFO ] [REMOTE    ] GPMT: Fetching primary data for 2025-07.
[2025-10-24T19:03:14.547621] [INFO ] [REMOTE    ] GPOR: Fetching primary data for 2025-10.
[2025-10-24T19:03:14.599461] [INFO ] [REMOTE    ] GPK: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T19:03:14.652727] [INFO ] [REMOTE    ] GPMT: Incremental fetch complete for 2025-07 (0.91 seconds).
[2025-10-24T19:03:15.347636] [INFO ] [REMOTE    ] GPK: Fetching primary data for 2025-08.
[2025-10-24T19:03:15.953551] [INFO ] [REMOTE    ] GPOR: Incremental fetch complete for 2025-10 (1.41 seconds).
[2025-10-24T19:03:15.958923] [INFO ] [REMOTE    ] GPOR: Full fetch complete (34857 records).
[2025-10-24T19:03:15.959017] [DEBUG] [VALIDATOR ] GPOR: Validating primary data.
[2025-10-24T19:03:16.155877] [INFO ] [REMOTE    ] GPN: Fetching primary data for 2025-06.
[2025-10-24T19:03:16.353359] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present.
[2025-10-24T19:03:16.353432] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed.
[2025-10-24T19:03:16.354042] [INFO ] [MAIN      ] GPOR: Fetched primary data is valid.
[2025-10-24T19:03:16.354103] [DEBUG] [LOCAL     ] GPOR: Saving primary data.
[2025-10-24T19:03:16.354419] [FATAL] [LOCAL     ] GPOR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:03:16.354501] [FATAL] [MAIN      ] GPOR: Failed to save primary data.
[2025-10-24T19:03:16.354542] [WARN ] [MAIN      ] GPOR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:03:16.354575] [INFO ] [LOCAL     ] GPOR: Starting deletion of primary data.
[2025-10-24T19:03:16.354624] [DEBUG] [LOCAL     ] GPOR: No primary data file found to delete.
[2025-10-24T19:03:16.354689] [INFO ] [LOCAL     ] GPOR: Starting deletion of derivative data.
[2025-10-24T19:03:16.355021] [DEBUG] [LOCAL     ] GPOR: Deleted derivative data file.
[2025-10-24T19:03:16.355734] [INFO ] [MAIN      ] Update Progress: 961/2366 symbols completed. GPOR took 24.0s. Estimated remaining: 3h 0m 9s. Rate: 7.8 symbols/min
[2025-10-24T19:03:16.528142] [INFO ] [MAIN      ] GPRK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:03:16.569212] [DEBUG] [LOCAL     ] GPRK: Loaded 40214 existing records from primary storage.
[2025-10-24T19:03:16.569480] [INFO ] [MAIN      ] GPRK: Loaded 40214 existing records.
[2025-10-24T19:03:16.745582] [WARN ] [MAIN      ] GPRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:03:16.745861] [INFO ] [MAIN      ] GPRK: Wiping existing primary data before full refresh.
[2025-10-24T19:03:16.745917] [INFO ] [LOCAL     ] GPRK: Starting deletion of primary data.
[2025-10-24T19:03:16.746601] [DEBUG] [LOCAL     ] GPRK: Deleted primary data file.
[2025-10-24T19:03:16.746689] [INFO ] [MAIN      ] GPRK: Starting full primary refresh.
[2025-10-24T19:03:16.957874] [INFO ] [REMOTE    ] GPMT: Fetching primary data for 2025-08.
[2025-10-24T19:03:17.111154] [INFO ] [REMOTE    ] GPRK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:03:17.188437] [INFO ] [REMOTE    ] GPK: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T19:03:17.747613] [INFO ] [REMOTE    ] GPK: Fetching primary data for 2025-09.
[2025-10-24T19:03:18.027304] [INFO ] [REMOTE    ] GPN: Incremental fetch complete for 2025-06 (1.87 seconds).
[2025-10-24T19:03:18.099214] [INFO ] [REMOTE    ] GPMT: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T19:03:18.547677] [INFO ] [REMOTE    ] GPN: Fetching primary data for 2025-07.
[2025-10-24T19:03:19.347680] [INFO ] [REMOTE    ] GPMT: Fetching primary data for 2025-09.
[2025-10-24T19:03:19.530440] [INFO ] [REMOTE    ] GPK: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T19:03:19.920118] [INFO ] [REMOTE    ] GPMT: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T19:03:20.147671] [INFO ] [REMOTE    ] GPRK: Fetching primary data for 2025-01.
[2025-10-24T19:03:20.376486] [INFO ] [REMOTE    ] GPN: Incremental fetch complete for 2025-07 (1.83 seconds).
[2025-10-24T19:03:20.947635] [INFO ] [REMOTE    ] GPMT: Fetching primary data for 2025-10.
[2025-10-24T19:03:21.534465] [INFO ] [REMOTE    ] GPRK: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T19:03:21.747640] [INFO ] [REMOTE    ] GPN: Fetching primary data for 2025-08.
[2025-10-24T19:03:22.219062] [INFO ] [REMOTE    ] GPMT: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T19:03:22.222889] [INFO ] [REMOTE    ] GPMT: Full fetch complete (36162 records).
[2025-10-24T19:03:22.222970] [DEBUG] [VALIDATOR ] GPMT: Validating primary data.
[2025-10-24T19:03:22.556544] [INFO ] [REMOTE    ] GPK: Fetching primary data for 2025-10.
[2025-10-24T19:03:22.612403] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present.
[2025-10-24T19:03:22.612500] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed.
[2025-10-24T19:03:22.613184] [INFO ] [MAIN      ] GPMT: Fetched primary data is valid.
[2025-10-24T19:03:22.613361] [DEBUG] [LOCAL     ] GPMT: Saving primary data.
[2025-10-24T19:03:22.613867] [FATAL] [LOCAL     ] GPMT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:03:22.613949] [FATAL] [MAIN      ] GPMT: Failed to save primary data.
[2025-10-24T19:03:22.614016] [WARN ] [MAIN      ] GPMT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:03:22.614084] [INFO ] [LOCAL     ] GPMT: Starting deletion of primary data.
[2025-10-24T19:03:22.614145] [DEBUG] [LOCAL     ] GPMT: No primary data file found to delete.
[2025-10-24T19:03:22.614181] [INFO ] [LOCAL     ] GPMT: Starting deletion of derivative data.
[2025-10-24T19:03:22.614337] [DEBUG] [LOCAL     ] GPMT: Deleted derivative data file.
[2025-10-24T19:03:22.614432] [INFO ] [MAIN      ] Update Progress: 962/2366 symbols completed. GPMT took 30.3s. Estimated remaining: 2h 59m 60s. Rate: 7.8 symbols/min
[2025-10-24T19:03:22.784570] [INFO ] [MAIN      ] GRBK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:03:22.811914] [DEBUG] [LOCAL     ] GRBK: Loaded 26788 existing records from primary storage.
[2025-10-24T19:03:22.812182] [INFO ] [MAIN      ] GRBK: Loaded 26788 existing records.
[2025-10-24T19:03:22.994711] [WARN ] [MAIN      ] GRBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:03:22.994953] [INFO ] [MAIN      ] GRBK: Wiping existing primary data before full refresh.
[2025-10-24T19:03:22.995003] [INFO ] [LOCAL     ] GRBK: Starting deletion of primary data.
[2025-10-24T19:03:22.995289] [DEBUG] [LOCAL     ] GRBK: Deleted primary data file.
[2025-10-24T19:03:22.995329] [INFO ] [MAIN      ] GRBK: Starting full primary refresh.
[2025-10-24T19:03:23.356255] [INFO ] [REMOTE    ] GRBK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:03:23.351572] [INFO ] [REMOTE    ] GPRK: Fetching primary data for 2025-02.
[2025-10-24T19:03:23.531300] [INFO ] [REMOTE    ] GPN: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T19:03:24.147619] [INFO ] [REMOTE    ] GPN: Fetching primary data for 2025-09.
[2025-10-24T19:03:24.292573] [INFO ] [REMOTE    ] GPK: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T19:03:24.302274] [INFO ] [REMOTE    ] GPK: Full fetch complete (76096 records).
[2025-10-24T19:03:24.302429] [DEBUG] [VALIDATOR ] GPK: Validating primary data.
[2025-10-24T19:03:24.700934] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present.
[2025-10-24T19:03:24.701041] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed.
[2025-10-24T19:03:24.702106] [INFO ] [MAIN      ] GPK: Fetched primary data is valid.
[2025-10-24T19:03:24.702198] [DEBUG] [LOCAL     ] GPK: Saving primary data.
[2025-10-24T19:03:24.702902] [FATAL] [LOCAL     ] GPK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:03:24.703002] [FATAL] [MAIN      ] GPK: Failed to save primary data.
[2025-10-24T19:03:24.703077] [WARN ] [MAIN      ] GPK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:03:24.703171] [INFO ] [LOCAL     ] GPK: Starting deletion of primary data.
[2025-10-24T19:03:24.703265] [DEBUG] [LOCAL     ] GPK: No primary data file found to delete.
[2025-10-24T19:03:24.703305] [INFO ] [LOCAL     ] GPK: Starting deletion of derivative data.
[2025-10-24T19:03:24.703433] [DEBUG] [LOCAL     ] GPK: Deleted derivative data file.
[2025-10-24T19:03:24.703982] [INFO ] [MAIN      ] Update Progress: 963/2366 symbols completed. GPK took 32.4s. Estimated remaining: 2h 59m 44s. Rate: 7.8 symbols/min
[2025-10-24T19:03:24.864167] [INFO ] [REMOTE    ] GPRK: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T19:03:24.901961] [INFO ] [MAIN      ] GRC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:03:24.913818] [DEBUG] [LOCAL     ] GRC: Loaded 9356 existing records from primary storage.
[2025-10-24T19:03:24.914034] [INFO ] [MAIN      ] GRC: Loaded 9356 existing records.
[2025-10-24T19:03:24.955851] [INFO ] [REMOTE    ] GPRK: Fetching primary data for 2025-03.
[2025-10-24T19:03:25.092168] [WARN ] [MAIN      ] GRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:03:25.092417] [INFO ] [MAIN      ] GRC: Wiping existing primary data before full refresh.
[2025-10-24T19:03:25.092480] [INFO ] [LOCAL     ] GRC: Starting deletion of primary data.
[2025-10-24T19:03:25.092693] [DEBUG] [LOCAL     ] GRC: Deleted primary data file.
[2025-10-24T19:03:25.092767] [INFO ] [MAIN      ] GRC: Starting full primary refresh.
[2025-10-24T19:03:25.446725] [INFO ] [REMOTE    ] GRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:03:25.747757] [INFO ] [REMOTE    ] GRC: Fetching primary data for 2025-01.
[2025-10-24T19:03:25.881869] [INFO ] [REMOTE    ] GPN: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T19:03:26.357223] [INFO ] [REMOTE    ] GPRK: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T19:03:26.547708] [INFO ] [REMOTE    ] GRBK: Fetching primary data for 2025-01.
[2025-10-24T19:03:26.585532] [INFO ] [REMOTE    ] GRC: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T19:03:27.347700] [INFO ] [REMOTE    ] GPRK: Fetching primary data for 2025-04.
[2025-10-24T19:03:27.778463] [INFO ] [REMOTE    ] GRBK: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T19:03:28.147728] [INFO ] [REMOTE    ] GPN: Fetching primary data for 2025-10.
[2025-10-24T19:03:28.588133] [INFO ] [REMOTE    ] GPRK: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T19:03:28.947718] [INFO ] [REMOTE    ] GRC: Fetching primary data for 2025-02.
[2025-10-24T19:03:29.716587] [INFO ] [REMOTE    ] GRC: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T19:03:29.747700] [INFO ] [REMOTE    ] GRC: Fetching primary data for 2025-03.
[2025-10-24T19:03:29.951331] [INFO ] [REMOTE    ] GPN: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T19:03:29.961615] [INFO ] [REMOTE    ] GPN: Full fetch complete (74992 records).
[2025-10-24T19:03:29.961832] [DEBUG] [VALIDATOR ] GPN: Validating primary data.
[2025-10-24T19:03:30.352771] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present.
[2025-10-24T19:03:30.352867] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed.
[2025-10-24T19:03:30.353845] [INFO ] [MAIN      ] GPN: Fetched primary data is valid.
[2025-10-24T19:03:30.353911] [DEBUG] [LOCAL     ] GPN: Saving primary data.
[2025-10-24T19:03:30.354594] [FATAL] [LOCAL     ] GPN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:03:30.354716] [FATAL] [MAIN      ] GPN: Failed to save primary data.
[2025-10-24T19:03:30.354760] [WARN ] [MAIN      ] GPN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:03:30.354796] [INFO ] [LOCAL     ] GPN: Starting deletion of primary data.
[2025-10-24T19:03:30.354850] [DEBUG] [LOCAL     ] GPN: No primary data file found to delete.
[2025-10-24T19:03:30.354886] [INFO ] [LOCAL     ] GPN: Starting deletion of derivative data.
[2025-10-24T19:03:30.355067] [DEBUG] [LOCAL     ] GPN: Deleted derivative data file.
[2025-10-24T19:03:30.355742] [INFO ] [MAIN      ] Update Progress: 964/2366 symbols completed. GPN took 38.0s. Estimated remaining: 2h 59m 33s. Rate: 7.8 symbols/min
[2025-10-24T19:03:30.534745] [INFO ] [MAIN      ] GRDN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:03:30.535099] [DEBUG] [LOCAL     ] GRDN: No existing data file found in primary storage.
[2025-10-24T19:03:30.535207] [WARN ] [MAIN      ] GRDN: No existing data found, performing full refresh instead.
[2025-10-24T19:03:30.535397] [INFO ] [MAIN      ] GRDN: Wiping existing primary data before full refresh.
[2025-10-24T19:03:30.535463] [INFO ] [LOCAL     ] GRDN: Starting deletion of primary data.
[2025-10-24T19:03:30.541901] [DEBUG] [LOCAL     ] GRDN: No primary data file found to delete.
[2025-10-24T19:03:30.542500] [INFO ] [MAIN      ] GRDN: Starting full primary refresh.
[2025-10-24T19:03:30.542873] [INFO ] [REMOTE    ] GRC: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T19:03:30.553893] [INFO ] [REMOTE    ] GRBK: Fetching primary data for 2025-02.
[2025-10-24T19:03:30.896537] [INFO ] [REMOTE    ] GRDN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:03:31.347679] [INFO ] [REMOTE    ] GPRK: Fetching primary data for 2025-05.
[2025-10-24T19:03:32.009979] [INFO ] [REMOTE    ] GRBK: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T19:03:32.147616] [INFO ] [REMOTE    ] GRBK: Fetching primary data for 2025-03.
[2025-10-24T19:03:32.853161] [INFO ] [REMOTE    ] GPRK: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T19:03:32.947614] [INFO ] [REMOTE    ] GPRK: Fetching primary data for 2025-06.
[2025-10-24T19:03:33.314365] [INFO ] [REMOTE    ] GRBK: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T19:03:33.747755] [INFO ] [REMOTE    ] GRDN: Fetching primary data for 2025-01.
[2025-10-24T19:03:34.427694] [INFO ] [REMOTE    ] GPRK: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T19:03:34.520414] [INFO ] [REMOTE    ] GRDN: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T19:03:34.547632] [INFO ] [REMOTE    ] GRDN: Fetching primary data for 2025-02.
[2025-10-24T19:03:35.188926] [INFO ] [REMOTE    ] GRDN: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T19:03:35.347697] [INFO ] [REMOTE    ] GRC: Fetching primary data for 2025-04.
[2025-10-24T19:03:36.132326] [INFO ] [REMOTE    ] GRC: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T19:03:36.147595] [INFO ] [REMOTE    ] GRC: Fetching primary data for 2025-05.
[2025-10-24T19:03:36.907572] [INFO ] [REMOTE    ] GRC: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T19:03:36.947669] [INFO ] [REMOTE    ] GRC: Fetching primary data for 2025-06.
[2025-10-24T19:03:37.659957] [INFO ] [REMOTE    ] GRC: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T19:03:37.747725] [INFO ] [REMOTE    ] GRDN: Fetching primary data for 2025-03.
[2025-10-24T19:03:38.547629] [INFO ] [REMOTE    ] GRBK: Fetching primary data for 2025-04.
[2025-10-24T19:03:38.713499] [INFO ] [REMOTE    ] GRDN: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T19:03:39.347622] [INFO ] [REMOTE    ] GRDN: Fetching primary data for 2025-04.
[2025-10-24T19:03:39.841816] [INFO ] [REMOTE    ] GRBK: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T19:03:40.147639] [INFO ] [REMOTE    ] GPRK: Fetching primary data for 2025-07.
[2025-10-24T19:03:40.274135] [INFO ] [REMOTE    ] GRDN: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T19:03:40.947715] [INFO ] [REMOTE    ] GRDN: Fetching primary data for 2025-05.
[2025-10-24T19:03:41.638552] [INFO ] [REMOTE    ] GPRK: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T19:03:41.695415] [INFO ] [REMOTE    ] GRDN: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T19:03:41.747666] [INFO ] [REMOTE    ] GRBK: Fetching primary data for 2025-05.
[2025-10-24T19:03:42.547728] [INFO ] [REMOTE    ] GRDN: Fetching primary data for 2025-06.
[2025-10-24T19:03:42.997378] [INFO ] [REMOTE    ] GRBK: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T19:03:43.347699] [INFO ] [REMOTE    ] GPRK: Fetching primary data for 2025-08.
[2025-10-24T19:03:43.567402] [INFO ] [REMOTE    ] GRDN: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T19:03:44.147720] [INFO ] [REMOTE    ] GRBK: Fetching primary data for 2025-06.
[2025-10-24T19:03:44.810895] [INFO ] [REMOTE    ] GPRK: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T19:03:44.947627] [INFO ] [REMOTE    ] GPRK: Fetching primary data for 2025-09.
[2025-10-24T19:03:45.231377] [INFO ] [REMOTE    ] GRBK: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T19:03:45.747676] [INFO ] [REMOTE    ] GRC: Fetching primary data for 2025-07.
[2025-10-24T19:03:46.347246] [INFO ] [REMOTE    ] GPRK: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T19:03:46.490556] [INFO ] [REMOTE    ] GRC: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T19:03:46.547624] [INFO ] [REMOTE    ] GRC: Fetching primary data for 2025-08.
[2025-10-24T19:03:47.347681] [INFO ] [REMOTE    ] GPRK: Fetching primary data for 2025-10.
[2025-10-24T19:03:47.393773] [INFO ] [REMOTE    ] GRC: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T19:03:48.147732] [INFO ] [REMOTE    ] GRC: Fetching primary data for 2025-09.
[2025-10-24T19:03:48.911268] [INFO ] [REMOTE    ] GRC: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T19:03:48.941075] [INFO ] [REMOTE    ] GPRK: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T19:03:48.948599] [INFO ] [REMOTE    ] GRDN: Fetching primary data for 2025-07.
[2025-10-24T19:03:48.950243] [INFO ] [REMOTE    ] GPRK: Full fetch complete (58567 records).
[2025-10-24T19:03:48.950346] [DEBUG] [VALIDATOR ] GPRK: Validating primary data.
[2025-10-24T19:03:49.331444] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present.
[2025-10-24T19:03:49.331522] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed.
[2025-10-24T19:03:49.332325] [INFO ] [MAIN      ] GPRK: Fetched primary data is valid.
[2025-10-24T19:03:49.332387] [DEBUG] [LOCAL     ] GPRK: Saving primary data.
[2025-10-24T19:03:49.332880] [FATAL] [LOCAL     ] GPRK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:03:49.332980] [FATAL] [MAIN      ] GPRK: Failed to save primary data.
[2025-10-24T19:03:49.333052] [WARN ] [MAIN      ] GPRK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:03:49.333144] [INFO ] [LOCAL     ] GPRK: Starting deletion of primary data.
[2025-10-24T19:03:49.333219] [DEBUG] [LOCAL     ] GPRK: No primary data file found to delete.
[2025-10-24T19:03:49.333256] [INFO ] [LOCAL     ] GPRK: Starting deletion of derivative data.
[2025-10-24T19:03:49.333501] [DEBUG] [LOCAL     ] GPRK: Deleted derivative data file.
[2025-10-24T19:03:49.333886] [INFO ] [MAIN      ] Update Progress: 965/2366 symbols completed. GPRK took 33.0s. Estimated remaining: 2h 59m 42s. Rate: 7.8 symbols/min
[2025-10-24T19:03:49.507363] [INFO ] [MAIN      ] GRMN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:03:49.548146] [DEBUG] [LOCAL     ] GRMN: Loaded 40017 existing records from primary storage.
[2025-10-24T19:03:49.548446] [INFO ] [MAIN      ] GRMN: Loaded 40017 existing records.
[2025-10-24T19:03:49.731155] [WARN ] [MAIN      ] GRMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:03:49.731392] [INFO ] [MAIN      ] GRMN: Wiping existing primary data before full refresh.
[2025-10-24T19:03:49.731440] [INFO ] [LOCAL     ] GRMN: Starting deletion of primary data.
[2025-10-24T19:03:49.731900] [DEBUG] [LOCAL     ] GRMN: Deleted primary data file.
[2025-10-24T19:03:49.731988] [INFO ] [MAIN      ] GRMN: Starting full primary refresh.
[2025-10-24T19:03:49.752803] [INFO ] [REMOTE    ] GRBK: Fetching primary data for 2025-07.
[2025-10-24T19:03:50.130444] [INFO ] [REMOTE    ] GRDN: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T19:03:50.129757] [INFO ] [REMOTE    ] GRMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:03:50.547740] [INFO ] [REMOTE    ] GRDN: Fetching primary data for 2025-08.
[2025-10-24T19:03:51.046854] [INFO ] [REMOTE    ] GRBK: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T19:03:51.347674] [INFO ] [REMOTE    ] GRC: Fetching primary data for 2025-10.
[2025-10-24T19:03:51.581843] [INFO ] [REMOTE    ] GRDN: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T19:03:52.147639] [INFO ] [REMOTE    ] GRMN: Fetching primary data for 2025-01.
[2025-10-24T19:03:52.386497] [INFO ] [REMOTE    ] GRC: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T19:03:52.389314] [INFO ] [REMOTE    ] GRC: Full fetch complete (13539 records).
[2025-10-24T19:03:52.389400] [DEBUG] [VALIDATOR ] GRC: Validating primary data.
[2025-10-24T19:03:52.752324] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present.
[2025-10-24T19:03:52.752399] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed.
[2025-10-24T19:03:52.752745] [INFO ] [MAIN      ] GRC: Fetched primary data is valid.
[2025-10-24T19:03:52.752807] [DEBUG] [LOCAL     ] GRC: Saving primary data.
[2025-10-24T19:03:52.753043] [FATAL] [LOCAL     ] GRC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:03:52.753126] [FATAL] [MAIN      ] GRC: Failed to save primary data.
[2025-10-24T19:03:52.753167] [WARN ] [MAIN      ] GRC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:03:52.753208] [INFO ] [LOCAL     ] GRC: Starting deletion of primary data.
[2025-10-24T19:03:52.753268] [DEBUG] [LOCAL     ] GRC: No primary data file found to delete.
[2025-10-24T19:03:52.753332] [INFO ] [LOCAL     ] GRC: Starting deletion of derivative data.
[2025-10-24T19:03:52.753583] [DEBUG] [LOCAL     ] GRC: Deleted derivative data file.
[2025-10-24T19:03:52.753733] [INFO ] [MAIN      ] Update Progress: 966/2366 symbols completed. GRC took 28.0s. Estimated remaining: 2h 59m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:03:52.922063] [INFO ] [MAIN      ] GRND: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:03:52.948594] [INFO ] [REMOTE    ] GRBK: Fetching primary data for 2025-08.
[2025-10-24T19:03:52.970846] [DEBUG] [LOCAL     ] GRND: Loaded 50545 existing records from primary storage.
[2025-10-24T19:03:52.971145] [INFO ] [MAIN      ] GRND: Loaded 50545 existing records.
[2025-10-24T19:03:53.144889] [WARN ] [MAIN      ] GRND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:03:53.145086] [INFO ] [MAIN      ] GRND: Wiping existing primary data before full refresh.
[2025-10-24T19:03:53.145132] [INFO ] [LOCAL     ] GRND: Starting deletion of primary data.
[2025-10-24T19:03:53.145589] [DEBUG] [LOCAL     ] GRND: Deleted primary data file.
[2025-10-24T19:03:53.145675] [INFO ] [MAIN      ] GRND: Starting full primary refresh.
[2025-10-24T19:03:53.505189] [INFO ] [REMOTE    ] GRND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:03:53.653937] [INFO ] [REMOTE    ] GRMN: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T19:03:53.747721] [INFO ] [REMOTE    ] GRND: Fetching primary data for 2025-01.
[2025-10-24T19:03:54.222789] [INFO ] [REMOTE    ] GRBK: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T19:03:54.547627] [INFO ] [REMOTE    ] GRBK: Fetching primary data for 2025-09.
[2025-10-24T19:03:54.978982] [INFO ] [REMOTE    ] GRND: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T19:03:55.347689] [INFO ] [REMOTE    ] GRMN: Fetching primary data for 2025-02.
[2025-10-24T19:03:55.735381] [INFO ] [REMOTE    ] GRBK: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T19:03:56.147737] [INFO ] [REMOTE    ] GRND: Fetching primary data for 2025-02.
[2025-10-24T19:03:56.839025] [INFO ] [REMOTE    ] GRMN: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T19:03:56.947672] [INFO ] [REMOTE    ] GRDN: Fetching primary data for 2025-09.
[2025-10-24T19:03:57.720501] [INFO ] [REMOTE    ] GRND: Incremental fetch complete for 2025-02 (1.57 seconds).
[2025-10-24T19:03:57.747628] [INFO ] [REMOTE    ] GRBK: Fetching primary data for 2025-10.
[2025-10-24T19:03:58.203856] [INFO ] [REMOTE    ] GRDN: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T19:03:58.547639] [INFO ] [REMOTE    ] GRND: Fetching primary data for 2025-03.
[2025-10-24T19:03:59.059973] [INFO ] [REMOTE    ] GRBK: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T19:03:59.064885] [INFO ] [REMOTE    ] GRBK: Full fetch complete (39816 records).
[2025-10-24T19:03:59.065024] [DEBUG] [VALIDATOR ] GRBK: Validating primary data.
[2025-10-24T19:03:59.352911] [INFO ] [REMOTE    ] GRMN: Fetching primary data for 2025-03.
[2025-10-24T19:03:59.443426] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present.
[2025-10-24T19:03:59.443501] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed.
[2025-10-24T19:03:59.444174] [INFO ] [MAIN      ] GRBK: Fetched primary data is valid.
[2025-10-24T19:03:59.444234] [DEBUG] [LOCAL     ] GRBK: Saving primary data.
[2025-10-24T19:03:59.444618] [FATAL] [LOCAL     ] GRBK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:03:59.444742] [FATAL] [MAIN      ] GRBK: Failed to save primary data.
[2025-10-24T19:03:59.444789] [WARN ] [MAIN      ] GRBK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:03:59.444823] [INFO ] [LOCAL     ] GRBK: Starting deletion of primary data.
[2025-10-24T19:03:59.444872] [DEBUG] [LOCAL     ] GRBK: No primary data file found to delete.
[2025-10-24T19:03:59.444905] [INFO ] [LOCAL     ] GRBK: Starting deletion of derivative data.
[2025-10-24T19:03:59.445120] [DEBUG] [LOCAL     ] GRBK: Deleted derivative data file.
[2025-10-24T19:03:59.445194] [INFO ] [MAIN      ] Update Progress: 967/2366 symbols completed. GRBK took 36.8s. Estimated remaining: 2h 59m 19s. Rate: 7.8 symbols/min
[2025-10-24T19:03:59.616190] [INFO ] [MAIN      ] GRNT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:03:59.649347] [DEBUG] [LOCAL     ] GRNT: Loaded 34218 existing records from primary storage.
[2025-10-24T19:03:59.649597] [INFO ] [MAIN      ] GRNT: Loaded 34218 existing records.
[2025-10-24T19:03:59.832187] [WARN ] [MAIN      ] GRNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:03:59.832602] [INFO ] [MAIN      ] GRNT: Wiping existing primary data before full refresh.
[2025-10-24T19:03:59.832957] [INFO ] [LOCAL     ] GRNT: Starting deletion of primary data.
[2025-10-24T19:03:59.833389] [DEBUG] [LOCAL     ] GRNT: Deleted primary data file.
[2025-10-24T19:03:59.833447] [INFO ] [MAIN      ] GRNT: Starting full primary refresh.
[2025-10-24T19:04:00.150920] [INFO ] [REMOTE    ] GRDN: Fetching primary data for 2025-10.
[2025-10-24T19:04:00.207316] [INFO ] [REMOTE    ] GRNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:04:00.237534] [INFO ] [REMOTE    ] GRND: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T19:04:00.947712] [INFO ] [REMOTE    ] GRNT: Fetching primary data for 2025-01.
[2025-10-24T19:04:01.323905] [INFO ] [REMOTE    ] GRMN: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T19:04:01.595006] [INFO ] [REMOTE    ] GRDN: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T19:04:01.599884] [INFO ] [REMOTE    ] GRDN: Full fetch complete (26801 records).
[2025-10-24T19:04:01.599975] [DEBUG] [VALIDATOR ] GRDN: Validating primary data.
[2025-10-24T19:04:01.755625] [INFO ] [REMOTE    ] GRMN: Fetching primary data for 2025-04.
[2025-10-24T19:04:01.975719] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present.
[2025-10-24T19:04:01.975819] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed.
[2025-10-24T19:04:01.976519] [INFO ] [MAIN      ] GRDN: Fetched primary data is valid.
[2025-10-24T19:04:01.976597] [DEBUG] [LOCAL     ] GRDN: Saving primary data.
[2025-10-24T19:04:01.982900] [FATAL] [LOCAL     ] GRDN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:04:01.994248] [INFO ] [REMOTE    ] GRNT: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T19:04:01.993609] [FATAL] [MAIN      ] GRDN: Failed to save primary data.
[2025-10-24T19:04:01.994406] [WARN ] [MAIN      ] GRDN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:04:02.001144] [INFO ] [LOCAL     ] GRDN: Starting deletion of primary data.
[2025-10-24T19:04:02.001221] [DEBUG] [LOCAL     ] GRDN: No primary data file found to delete.
[2025-10-24T19:04:02.001259] [INFO ] [LOCAL     ] GRDN: Starting deletion of derivative data.
[2025-10-24T19:04:02.001297] [DEBUG] [LOCAL     ] GRDN: No derivative data file found to delete.
[2025-10-24T19:04:02.001355] [INFO ] [MAIN      ] Update Progress: 968/2366 symbols completed. GRDN took 31.6s. Estimated remaining: 2h 59m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:04:02.168833] [INFO ] [MAIN      ] GROV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:04:02.180410] [DEBUG] [LOCAL     ] GROV: Loaded 8639 existing records from primary storage.
[2025-10-24T19:04:02.180637] [INFO ] [MAIN      ] GROV: Loaded 8639 existing records.
[2025-10-24T19:04:02.359803] [WARN ] [MAIN      ] GROV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:04:02.360056] [INFO ] [MAIN      ] GROV: Wiping existing primary data before full refresh.
[2025-10-24T19:04:02.360111] [INFO ] [LOCAL     ] GROV: Starting deletion of primary data.
[2025-10-24T19:04:02.360290] [DEBUG] [LOCAL     ] GROV: Deleted primary data file.
[2025-10-24T19:04:02.360346] [INFO ] [MAIN      ] GROV: Starting full primary refresh.
[2025-10-24T19:04:02.554600] [INFO ] [REMOTE    ] GRND: Fetching primary data for 2025-04.
[2025-10-24T19:04:02.719583] [INFO ] [REMOTE    ] GROV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:04:03.347722] [INFO ] [REMOTE    ] GRNT: Fetching primary data for 2025-02.
[2025-10-24T19:04:03.645223] [INFO ] [REMOTE    ] GRMN: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T19:04:04.147708] [INFO ] [REMOTE    ] GROV: Fetching primary data for 2025-01.
[2025-10-24T19:04:04.356500] [INFO ] [REMOTE    ] GRND: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T19:04:04.529735] [INFO ] [REMOTE    ] GRNT: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T19:04:04.686338] [INFO ] [REMOTE    ] GROV: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T19:04:04.947707] [INFO ] [REMOTE    ] GRNT: Fetching primary data for 2025-03.
[2025-10-24T19:04:05.747619] [INFO ] [REMOTE    ] GROV: Fetching primary data for 2025-02.
[2025-10-24T19:04:06.309609] [INFO ] [REMOTE    ] GRNT: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T19:04:06.547629] [INFO ] [REMOTE    ] GRND: Fetching primary data for 2025-05.
[2025-10-24T19:04:06.555751] [INFO ] [REMOTE    ] GROV: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T19:04:07.347675] [INFO ] [REMOTE    ] GRMN: Fetching primary data for 2025-05.
[2025-10-24T19:04:08.152839] [INFO ] [REMOTE    ] GRNT: Fetching primary data for 2025-04.
[2025-10-24T19:04:08.170722] [INFO ] [REMOTE    ] GRND: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T19:04:08.814112] [INFO ] [REMOTE    ] GRMN: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T19:04:08.947723] [INFO ] [REMOTE    ] GRMN: Fetching primary data for 2025-06.
[2025-10-24T19:04:09.508685] [INFO ] [REMOTE    ] GRNT: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T19:04:09.747722] [INFO ] [REMOTE    ] GROV: Fetching primary data for 2025-03.
[2025-10-24T19:04:10.452472] [INFO ] [REMOTE    ] GRMN: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T19:04:10.551755] [INFO ] [REMOTE    ] GRND: Fetching primary data for 2025-06.
[2025-10-24T19:04:10.553880] [INFO ] [REMOTE    ] GROV: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T19:04:11.347722] [INFO ] [REMOTE    ] GRMN: Fetching primary data for 2025-07.
[2025-10-24T19:04:11.451154] [DEBUG] [REMOTE    ] GRMN: Error fetching primary data for 2025-07: 'API call returned an empty response.'
[2025-10-24T19:04:11.451378] [WARN ] [REMOTE    ] GRMN: No data returned for month 2025-07
[2025-10-24T19:04:11.451464] [FATAL] [REMOTE    ] GRMN: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:04:11.451538] [FATAL] [MAIN      ] GRMN: Failed to fetch primary data.
[2025-10-24T19:04:11.451600] [WARN ] [MAIN      ] GRMN: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:04:11.451694] [INFO ] [LOCAL     ] GRMN: Starting deletion of primary data.
[2025-10-24T19:04:11.451766] [DEBUG] [LOCAL     ] GRMN: No primary data file found to delete.
[2025-10-24T19:04:11.451800] [INFO ] [LOCAL     ] GRMN: Starting deletion of derivative data.
[2025-10-24T19:04:11.451956] [DEBUG] [LOCAL     ] GRMN: Deleted derivative data file.
[2025-10-24T19:04:11.452322] [INFO ] [MAIN      ] Update Progress: 969/2366 symbols completed. GRMN took 22.1s. Estimated remaining: 2h 58m 59s. Rate: 7.8 symbols/min
[2025-10-24T19:04:11.631348] [INFO ] [MAIN      ] GRX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:04:11.639826] [DEBUG] [LOCAL     ] GRX: Loaded 4873 existing records from primary storage.
[2025-10-24T19:04:11.640037] [INFO ] [MAIN      ] GRX: Loaded 4873 existing records.
[2025-10-24T19:04:11.830626] [WARN ] [MAIN      ] GRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:04:11.830942] [INFO ] [MAIN      ] GRX: Wiping existing primary data before full refresh.
[2025-10-24T19:04:11.831085] [INFO ] [LOCAL     ] GRX: Starting deletion of primary data.
[2025-10-24T19:04:11.831331] [DEBUG] [LOCAL     ] GRX: Deleted primary data file.
[2025-10-24T19:04:11.831385] [INFO ] [MAIN      ] GRX: Starting full primary refresh.
[2025-10-24T19:04:12.152249] [INFO ] [REMOTE    ] GROV: Fetching primary data for 2025-04.
[2025-10-24T19:04:12.166336] [INFO ] [REMOTE    ] GRND: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T19:04:12.249040] [INFO ] [REMOTE    ] GRX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:04:12.947669] [INFO ] [REMOTE    ] GRX: Fetching primary data for 2025-01.
[2025-10-24T19:04:13.036444] [INFO ] [REMOTE    ] GROV: Incremental fetch complete for 2025-04 (0.88 seconds).
[2025-10-24T19:04:13.300823] [INFO ] [REMOTE    ] GRX: Incremental fetch complete for 2025-01 (0.35 seconds).
[2025-10-24T19:04:13.747685] [INFO ] [REMOTE    ] GRNT: Fetching primary data for 2025-05.
[2025-10-24T19:04:14.547716] [INFO ] [REMOTE    ] GRND: Fetching primary data for 2025-07.
[2025-10-24T19:04:14.612083] [INFO ] [REMOTE    ] GRNT: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T19:04:15.347807] [INFO ] [REMOTE    ] GRX: Fetching primary data for 2025-02.
[2025-10-24T19:04:15.891750] [INFO ] [REMOTE    ] GRX: Incremental fetch complete for 2025-02 (0.54 seconds).
[2025-10-24T19:04:16.147713] [INFO ] [REMOTE    ] GROV: Fetching primary data for 2025-05.
[2025-10-24T19:04:16.328261] [INFO ] [REMOTE    ] GRND: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T19:04:16.932800] [INFO ] [REMOTE    ] GROV: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T19:04:16.947621] [INFO ] [REMOTE    ] GROV: Fetching primary data for 2025-06.
[2025-10-24T19:04:17.747619] [INFO ] [REMOTE    ] GRX: Fetching primary data for 2025-03.
[2025-10-24T19:04:17.760034] [INFO ] [REMOTE    ] GROV: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T19:04:18.338626] [INFO ] [REMOTE    ] GRX: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T19:04:18.547616] [INFO ] [REMOTE    ] GRNT: Fetching primary data for 2025-06.
[2025-10-24T19:04:19.347674] [INFO ] [REMOTE    ] GROV: Fetching primary data for 2025-07.
[2025-10-24T19:04:20.015909] [INFO ] [REMOTE    ] GRNT: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T19:04:20.147619] [INFO ] [REMOTE    ] GRNT: Fetching primary data for 2025-07.
[2025-10-24T19:04:20.347353] [INFO ] [REMOTE    ] GROV: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T19:04:20.947638] [INFO ] [REMOTE    ] GROV: Fetching primary data for 2025-08.
[2025-10-24T19:04:21.557028] [INFO ] [REMOTE    ] GRNT: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T19:04:21.734317] [INFO ] [REMOTE    ] GROV: Incremental fetch complete for 2025-08 (0.79 seconds).
[2025-10-24T19:04:21.747606] [INFO ] [REMOTE    ] GROV: Fetching primary data for 2025-09.
[2025-10-24T19:04:22.468832] [INFO ] [REMOTE    ] GROV: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T19:04:22.547718] [INFO ] [REMOTE    ] GRX: Fetching primary data for 2025-04.
[2025-10-24T19:04:23.127001] [INFO ] [REMOTE    ] GRX: Incremental fetch complete for 2025-04 (0.58 seconds).
[2025-10-24T19:04:23.347667] [INFO ] [REMOTE    ] GRNT: Fetching primary data for 2025-08.
[2025-10-24T19:04:24.147680] [INFO ] [REMOTE    ] GRX: Fetching primary data for 2025-05.
[2025-10-24T19:04:24.772816] [INFO ] [REMOTE    ] GRX: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T19:04:24.816410] [INFO ] [REMOTE    ] GRNT: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T19:04:24.947704] [INFO ] [REMOTE    ] GRX: Fetching primary data for 2025-06.
[2025-10-24T19:04:25.502943] [INFO ] [REMOTE    ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds).
[2025-10-24T19:04:25.747672] [INFO ] [REMOTE    ] GRX: Fetching primary data for 2025-07.
[2025-10-24T19:04:26.396887] [INFO ] [REMOTE    ] GRX: Incremental fetch complete for 2025-07 (0.65 seconds).
[2025-10-24T19:04:26.547689] [INFO ] [REMOTE    ] GRX: Fetching primary data for 2025-08.
[2025-10-24T19:04:27.219178] [INFO ] [REMOTE    ] GRX: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T19:04:27.347690] [INFO ] [REMOTE    ] GRNT: Fetching primary data for 2025-09.
[2025-10-24T19:04:28.147739] [INFO ] [REMOTE    ] GRX: Fetching primary data for 2025-09.
[2025-10-24T19:04:28.781815] [INFO ] [REMOTE    ] GRNT: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T19:04:28.947713] [INFO ] [REMOTE    ] GROV: Fetching primary data for 2025-10.
[2025-10-24T19:04:28.965778] [INFO ] [REMOTE    ] GRX: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T19:04:29.536974] [INFO ] [REMOTE    ] GROV: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T19:04:29.539240] [INFO ] [REMOTE    ] GROV: Full fetch complete (13547 records).
[2025-10-24T19:04:29.539430] [DEBUG] [VALIDATOR ] GROV: Validating primary data.
[2025-10-24T19:04:29.752924] [INFO ] [REMOTE    ] GRX: Fetching primary data for 2025-10.
[2025-10-24T19:04:29.907002] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present.
[2025-10-24T19:04:29.907079] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed.
[2025-10-24T19:04:29.907444] [INFO ] [MAIN      ] GROV: Fetched primary data is valid.
[2025-10-24T19:04:29.907507] [DEBUG] [LOCAL     ] GROV: Saving primary data.
[2025-10-24T19:04:29.907787] [FATAL] [LOCAL     ] GROV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:04:29.907892] [FATAL] [MAIN      ] GROV: Failed to save primary data.
[2025-10-24T19:04:29.907959] [WARN ] [MAIN      ] GROV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:04:29.908029] [INFO ] [LOCAL     ] GROV: Starting deletion of primary data.
[2025-10-24T19:04:29.908087] [DEBUG] [LOCAL     ] GROV: No primary data file found to delete.
[2025-10-24T19:04:29.908123] [INFO ] [LOCAL     ] GROV: Starting deletion of derivative data.
[2025-10-24T19:04:29.908304] [DEBUG] [LOCAL     ] GROV: Deleted derivative data file.
[2025-10-24T19:04:29.908396] [INFO ] [MAIN      ] Update Progress: 970/2366 symbols completed. GROV took 27.9s. Estimated remaining: 2h 59m 6s. Rate: 7.8 symbols/min
[2025-10-24T19:04:30.077105] [INFO ] [MAIN      ] GS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:04:30.132003] [DEBUG] [LOCAL     ] GS: Loaded 52152 existing records from primary storage.
[2025-10-24T19:04:30.132418] [INFO ] [MAIN      ] GS: Loaded 52152 existing records.
[2025-10-24T19:04:30.306535] [WARN ] [MAIN      ] GS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:04:30.306774] [INFO ] [MAIN      ] GS: Wiping existing primary data before full refresh.
[2025-10-24T19:04:30.306823] [INFO ] [LOCAL     ] GS: Starting deletion of primary data.
[2025-10-24T19:04:30.307031] [DEBUG] [LOCAL     ] GS: Deleted primary data file.
[2025-10-24T19:04:30.307085] [INFO ] [MAIN      ] GS: Starting full primary refresh.
[2025-10-24T19:04:30.551351] [INFO ] [REMOTE    ] GRNT: Fetching primary data for 2025-10.
[2025-10-24T19:04:30.675334] [INFO ] [REMOTE    ] GS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:04:30.670050] [INFO ] [REMOTE    ] GRX: Incremental fetch complete for 2025-10 (0.92 seconds).
[2025-10-24T19:04:30.678436] [INFO ] [REMOTE    ] GRX: Full fetch complete (6561 records).
[2025-10-24T19:04:30.678599] [DEBUG] [VALIDATOR ] GRX: Validating primary data.
[2025-10-24T19:04:31.063820] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present.
[2025-10-24T19:04:31.063921] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed.
[2025-10-24T19:04:31.064150] [INFO ] [MAIN      ] GRX: Fetched primary data is valid.
[2025-10-24T19:04:31.064191] [DEBUG] [LOCAL     ] GRX: Saving primary data.
[2025-10-24T19:04:31.064402] [FATAL] [LOCAL     ] GRX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:04:31.064482] [FATAL] [MAIN      ] GRX: Failed to save primary data.
[2025-10-24T19:04:31.064523] [WARN ] [MAIN      ] GRX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:04:31.064557] [INFO ] [LOCAL     ] GRX: Starting deletion of primary data.
[2025-10-24T19:04:31.064605] [DEBUG] [LOCAL     ] GRX: No primary data file found to delete.
[2025-10-24T19:04:31.064639] [INFO ] [LOCAL     ] GRX: Starting deletion of derivative data.
[2025-10-24T19:04:31.064981] [DEBUG] [LOCAL     ] GRX: Deleted derivative data file.
[2025-10-24T19:04:31.065076] [INFO ] [MAIN      ] Update Progress: 971/2366 symbols completed. GRX took 19.6s. Estimated remaining: 2h 58m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:04:31.230027] [INFO ] [MAIN      ] GSBD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:04:31.269263] [DEBUG] [LOCAL     ] GSBD: Loaded 39823 existing records from primary storage.
[2025-10-24T19:04:31.269530] [INFO ] [MAIN      ] GSBD: Loaded 39823 existing records.
[2025-10-24T19:04:31.353027] [INFO ] [REMOTE    ] GRND: Fetching primary data for 2025-08.
[2025-10-24T19:04:31.450525] [WARN ] [MAIN      ] GSBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:04:31.450746] [INFO ] [MAIN      ] GSBD: Wiping existing primary data before full refresh.
[2025-10-24T19:04:31.450821] [INFO ] [LOCAL     ] GSBD: Starting deletion of primary data.
[2025-10-24T19:04:31.451207] [DEBUG] [LOCAL     ] GSBD: Deleted primary data file.
[2025-10-24T19:04:31.451247] [INFO ] [MAIN      ] GSBD: Starting full primary refresh.
[2025-10-24T19:04:31.810938] [INFO ] [REMOTE    ] GSBD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:04:32.147681] [INFO ] [REMOTE    ] GS: Fetching primary data for 2025-01.
[2025-10-24T19:04:32.200227] [INFO ] [REMOTE    ] GRNT: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T19:04:32.206372] [INFO ] [REMOTE    ] GRNT: Full fetch complete (48380 records).
[2025-10-24T19:04:32.206471] [DEBUG] [VALIDATOR ] GRNT: Validating primary data.
[2025-10-24T19:04:32.577011] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present.
[2025-10-24T19:04:32.577092] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed.
[2025-10-24T19:04:32.577834] [INFO ] [MAIN      ] GRNT: Fetched primary data is valid.
[2025-10-24T19:04:32.577896] [DEBUG] [LOCAL     ] GRNT: Saving primary data.
[2025-10-24T19:04:32.578290] [FATAL] [LOCAL     ] GRNT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:04:32.578372] [FATAL] [MAIN      ] GRNT: Failed to save primary data.
[2025-10-24T19:04:32.578413] [WARN ] [MAIN      ] GRNT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:04:32.578447] [INFO ] [LOCAL     ] GRNT: Starting deletion of primary data.
[2025-10-24T19:04:32.578496] [DEBUG] [LOCAL     ] GRNT: No primary data file found to delete.
[2025-10-24T19:04:32.578529] [INFO ] [LOCAL     ] GRNT: Starting deletion of derivative data.
[2025-10-24T19:04:32.578780] [DEBUG] [LOCAL     ] GRNT: Deleted derivative data file.
[2025-10-24T19:04:32.578872] [INFO ] [MAIN      ] Update Progress: 972/2366 symbols completed. GRNT took 33.1s. Estimated remaining: 2h 58m 33s. Rate: 7.8 symbols/min
[2025-10-24T19:04:32.747809] [INFO ] [MAIN      ] GSK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:04:32.800190] [DEBUG] [LOCAL     ] GSK: Loaded 53900 existing records from primary storage.
[2025-10-24T19:04:32.800511] [INFO ] [MAIN      ] GSK: Loaded 53900 existing records.
[2025-10-24T19:04:32.949403] [INFO ] [REMOTE    ] GSBD: Fetching primary data for 2025-01.
[2025-10-24T19:04:32.985707] [WARN ] [MAIN      ] GSK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:04:32.986156] [INFO ] [MAIN      ] GSK: Wiping existing primary data before full refresh.
[2025-10-24T19:04:32.986279] [INFO ] [LOCAL     ] GSK: Starting deletion of primary data.
[2025-10-24T19:04:32.986517] [DEBUG] [LOCAL     ] GSK: Deleted primary data file.
[2025-10-24T19:04:32.986574] [INFO ] [MAIN      ] GSK: Starting full primary refresh.
[2025-10-24T19:04:33.356378] [INFO ] [REMOTE    ] GRND: Incremental fetch complete for 2025-08 (2.00 seconds).
[2025-10-24T19:04:33.376130] [INFO ] [REMOTE    ] GSK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:04:33.747733] [INFO ] [REMOTE    ] GSK: Fetching primary data for 2025-01.
[2025-10-24T19:04:34.376186] [INFO ] [REMOTE    ] GS: Incremental fetch complete for 2025-01 (2.23 seconds).
[2025-10-24T19:04:34.547668] [INFO ] [REMOTE    ] GS: Fetching primary data for 2025-02.
[2025-10-24T19:04:34.667970] [INFO ] [REMOTE    ] GSBD: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T19:04:35.347714] [INFO ] [REMOTE    ] GSBD: Fetching primary data for 2025-02.
[2025-10-24T19:04:35.837818] [INFO ] [REMOTE    ] GSK: Incremental fetch complete for 2025-01 (2.09 seconds).
[2025-10-24T19:04:36.147695] [INFO ] [REMOTE    ] GSK: Fetching primary data for 2025-02.
[2025-10-24T19:04:36.646609] [INFO ] [REMOTE    ] GS: Incremental fetch complete for 2025-02 (2.10 seconds).
[2025-10-24T19:04:36.825186] [INFO ] [REMOTE    ] GSBD: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T19:04:36.947895] [INFO ] [REMOTE    ] GS: Fetching primary data for 2025-03.
[2025-10-24T19:04:37.596181] [INFO ] [REMOTE    ] GSK: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T19:04:37.747621] [INFO ] [REMOTE    ] GSK: Fetching primary data for 2025-03.
[2025-10-24T19:04:38.547719] [INFO ] [REMOTE    ] GSBD: Fetching primary data for 2025-03.
[2025-10-24T19:04:39.254405] [INFO ] [REMOTE    ] GS: Incremental fetch complete for 2025-03 (2.31 seconds).
[2025-10-24T19:04:39.347636] [INFO ] [REMOTE    ] GRND: Fetching primary data for 2025-09.
[2025-10-24T19:04:39.716446] [INFO ] [REMOTE    ] GSK: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T19:04:40.061855] [INFO ] [REMOTE    ] GSBD: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T19:04:40.147635] [INFO ] [REMOTE    ] GSBD: Fetching primary data for 2025-04.
[2025-10-24T19:04:40.947724] [INFO ] [REMOTE    ] GSK: Fetching primary data for 2025-04.
[2025-10-24T19:04:41.070909] [INFO ] [REMOTE    ] GRND: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T19:04:41.343551] [INFO ] [REMOTE    ] GSBD: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T19:04:41.747673] [INFO ] [REMOTE    ] GRND: Fetching primary data for 2025-10.
[2025-10-24T19:04:42.547705] [INFO ] [REMOTE    ] GS: Fetching primary data for 2025-04.
[2025-10-24T19:04:42.876432] [INFO ] [REMOTE    ] GSK: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T19:04:43.347632] [INFO ] [REMOTE    ] GSK: Fetching primary data for 2025-05.
[2025-10-24T19:04:43.825549] [INFO ] [REMOTE    ] GRND: Incremental fetch complete for 2025-10 (2.08 seconds).
[2025-10-24T19:04:43.835126] [INFO ] [REMOTE    ] GRND: Full fetch complete (71914 records).
[2025-10-24T19:04:43.835274] [DEBUG] [VALIDATOR ] GRND: Validating primary data.
[2025-10-24T19:04:44.152786] [INFO ] [REMOTE    ] GSBD: Fetching primary data for 2025-05.
[2025-10-24T19:04:44.244522] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present.
[2025-10-24T19:04:44.244606] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed.
[2025-10-24T19:04:44.245599] [INFO ] [MAIN      ] GRND: Fetched primary data is valid.
[2025-10-24T19:04:44.245720] [DEBUG] [LOCAL     ] GRND: Saving primary data.
[2025-10-24T19:04:44.246305] [FATAL] [LOCAL     ] GRND: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:04:44.246387] [FATAL] [MAIN      ] GRND: Failed to save primary data.
[2025-10-24T19:04:44.246454] [WARN ] [MAIN      ] GRND: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:04:44.246523] [INFO ] [LOCAL     ] GRND: Starting deletion of primary data.
[2025-10-24T19:04:44.246597] [DEBUG] [LOCAL     ] GRND: No primary data file found to delete.
[2025-10-24T19:04:44.246678] [INFO ] [LOCAL     ] GRND: Starting deletion of derivative data.
[2025-10-24T19:04:44.246845] [DEBUG] [LOCAL     ] GRND: Deleted derivative data file.
[2025-10-24T19:04:44.247232] [INFO ] [MAIN      ] Update Progress: 973/2366 symbols completed. GRND took 51.5s. Estimated remaining: 2h 58m 31s. Rate: 7.8 symbols/min
[2025-10-24T19:04:44.423134] [INFO ] [MAIN      ] GSL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:04:44.455966] [DEBUG] [LOCAL     ] GSL: Loaded 33099 existing records from primary storage.
[2025-10-24T19:04:44.456228] [INFO ] [MAIN      ] GSL: Loaded 33099 existing records.
[2025-10-24T19:04:44.638938] [WARN ] [MAIN      ] GSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:04:44.639216] [INFO ] [MAIN      ] GSL: Wiping existing primary data before full refresh.
[2025-10-24T19:04:44.639267] [INFO ] [LOCAL     ] GSL: Starting deletion of primary data.
[2025-10-24T19:04:44.639450] [DEBUG] [LOCAL     ] GSL: Deleted primary data file.
[2025-10-24T19:04:44.639489] [INFO ] [MAIN      ] GSL: Starting full primary refresh.
[2025-10-24T19:04:45.020047] [INFO ] [REMOTE    ] GSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:04:45.035217] [INFO ] [REMOTE    ] GSL: Fetching primary data for 2025-01.
[2025-10-24T19:04:45.040839] [INFO ] [REMOTE    ] GS: Incremental fetch complete for 2025-04 (2.49 seconds).
[2025-10-24T19:04:45.165373] [INFO ] [REMOTE    ] GSK: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T19:04:45.341801] [INFO ] [REMOTE    ] GSBD: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T19:04:45.747611] [INFO ] [REMOTE    ] GSK: Fetching primary data for 2025-06.
[2025-10-24T19:04:46.357314] [INFO ] [REMOTE    ] GSL: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T19:04:46.547733] [INFO ] [REMOTE    ] GSBD: Fetching primary data for 2025-06.
[2025-10-24T19:04:47.347699] [INFO ] [REMOTE    ] GS: Fetching primary data for 2025-05.
[2025-10-24T19:04:47.658848] [INFO ] [REMOTE    ] GSK: Incremental fetch complete for 2025-06 (1.91 seconds).
[2025-10-24T19:04:48.052836] [INFO ] [REMOTE    ] GSBD: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T19:04:48.147637] [INFO ] [REMOTE    ] GSL: Fetching primary data for 2025-02.
[2025-10-24T19:04:48.947724] [INFO ] [REMOTE    ] GSBD: Fetching primary data for 2025-07.
[2025-10-24T19:04:49.479038] [INFO ] [REMOTE    ] GSL: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T19:04:49.517048] [INFO ] [REMOTE    ] GS: Incremental fetch complete for 2025-05 (2.17 seconds).
[2025-10-24T19:04:49.747636] [INFO ] [REMOTE    ] GSK: Fetching primary data for 2025-07.
[2025-10-24T19:04:50.489395] [INFO ] [REMOTE    ] GSBD: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T19:04:50.547671] [INFO ] [REMOTE    ] GSBD: Fetching primary data for 2025-08.
[2025-10-24T19:04:51.347615] [INFO ] [REMOTE    ] GSL: Fetching primary data for 2025-03.
[2025-10-24T19:04:51.741370] [INFO ] [REMOTE    ] GSK: Incremental fetch complete for 2025-07 (1.99 seconds).
[2025-10-24T19:04:51.805346] [INFO ] [REMOTE    ] GSBD: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T19:04:52.147671] [INFO ] [REMOTE    ] GS: Fetching primary data for 2025-06.
[2025-10-24T19:04:52.945732] [INFO ] [REMOTE    ] GSL: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T19:04:52.953189] [INFO ] [REMOTE    ] GSK: Fetching primary data for 2025-08.
[2025-10-24T19:04:53.747612] [INFO ] [REMOTE    ] GSBD: Fetching primary data for 2025-09.
[2025-10-24T19:04:54.254883] [INFO ] [REMOTE    ] GS: Incremental fetch complete for 2025-06 (2.11 seconds).
[2025-10-24T19:04:54.547711] [INFO ] [REMOTE    ] GS: Fetching primary data for 2025-07.
[2025-10-24T19:04:54.959966] [INFO ] [REMOTE    ] GSK: Incremental fetch complete for 2025-08 (2.01 seconds).
[2025-10-24T19:04:55.238805] [INFO ] [REMOTE    ] GSBD: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T19:04:55.347603] [INFO ] [REMOTE    ] GSBD: Fetching primary data for 2025-10.
[2025-10-24T19:04:56.147704] [INFO ] [REMOTE    ] GSL: Fetching primary data for 2025-04.
[2025-10-24T19:04:56.651978] [INFO ] [REMOTE    ] GS: Incremental fetch complete for 2025-07 (2.10 seconds).
[2025-10-24T19:04:56.947627] [INFO ] [REMOTE    ] GS: Fetching primary data for 2025-08.
[2025-10-24T19:04:57.199496] [INFO ] [REMOTE    ] GSBD: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T19:04:57.207541] [INFO ] [REMOTE    ] GSBD: Full fetch complete (58439 records).
[2025-10-24T19:04:57.207683] [DEBUG] [VALIDATOR ] GSBD: Validating primary data.
[2025-10-24T19:04:57.629013] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present.
[2025-10-24T19:04:57.629102] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed.
[2025-10-24T19:04:57.629985] [INFO ] [MAIN      ] GSBD: Fetched primary data is valid.
[2025-10-24T19:04:57.630158] [DEBUG] [LOCAL     ] GSBD: Saving primary data.
[2025-10-24T19:04:57.630804] [FATAL] [LOCAL     ] GSBD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:04:57.630988] [FATAL] [MAIN      ] GSBD: Failed to save primary data.
[2025-10-24T19:04:57.631053] [WARN ] [MAIN      ] GSBD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:04:57.631100] [INFO ] [LOCAL     ] GSBD: Starting deletion of primary data.
[2025-10-24T19:04:57.631155] [DEBUG] [LOCAL     ] GSBD: No primary data file found to delete.
[2025-10-24T19:04:57.631195] [INFO ] [LOCAL     ] GSBD: Starting deletion of derivative data.
[2025-10-24T19:04:57.631339] [DEBUG] [LOCAL     ] GSBD: Deleted derivative data file.
[2025-10-24T19:04:57.632063] [INFO ] [MAIN      ] Update Progress: 974/2366 symbols completed. GSBD took 26.6s. Estimated remaining: 2h 58m 31s. Rate: 7.8 symbols/min
[2025-10-24T19:04:57.786770] [INFO ] [REMOTE    ] GSL: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T19:04:57.780470] [INFO ] [REMOTE    ] GSK: Fetching primary data for 2025-09.
[2025-10-24T19:04:57.845583] [INFO ] [MAIN      ] GTES: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:04:57.895958] [DEBUG] [LOCAL     ] GTES: Loaded 50654 existing records from primary storage.
[2025-10-24T19:04:57.896245] [INFO ] [MAIN      ] GTES: Loaded 50654 existing records.
[2025-10-24T19:04:58.086618] [WARN ] [MAIN      ] GTES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:04:58.086833] [INFO ] [MAIN      ] GTES: Wiping existing primary data before full refresh.
[2025-10-24T19:04:58.086907] [INFO ] [LOCAL     ] GTES: Starting deletion of primary data.
[2025-10-24T19:04:58.087128] [DEBUG] [LOCAL     ] GTES: Deleted primary data file.
[2025-10-24T19:04:58.087209] [INFO ] [MAIN      ] GTES: Starting full primary refresh.
[2025-10-24T19:04:58.464218] [INFO ] [REMOTE    ] GTES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:04:58.547607] [INFO ] [REMOTE    ] GTES: Fetching primary data for 2025-01.
[2025-10-24T19:04:58.980745] [INFO ] [REMOTE    ] GS: Incremental fetch complete for 2025-08 (2.03 seconds).
[2025-10-24T19:04:59.347709] [INFO ] [REMOTE    ] GSL: Fetching primary data for 2025-05.
[2025-10-24T19:04:59.836351] [INFO ] [REMOTE    ] GTES: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T19:04:59.881062] [INFO ] [REMOTE    ] GSK: Incremental fetch complete for 2025-09 (2.10 seconds).
[2025-10-24T19:05:00.147739] [INFO ] [REMOTE    ] GSK: Fetching primary data for 2025-10.
[2025-10-24T19:05:00.332959] [INFO ] [REMOTE    ] GSL: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T19:05:00.947704] [INFO ] [REMOTE    ] GSL: Fetching primary data for 2025-06.
[2025-10-24T19:05:01.747732] [INFO ] [REMOTE    ] GTES: Fetching primary data for 2025-02.
[2025-10-24T19:05:02.333057] [INFO ] [REMOTE    ] GSL: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T19:05:02.448953] [INFO ] [REMOTE    ] GSK: Incremental fetch complete for 2025-10 (2.30 seconds).
[2025-10-24T19:05:02.459368] [INFO ] [REMOTE    ] GSK: Full fetch complete (77635 records).
[2025-10-24T19:05:02.459569] [DEBUG] [VALIDATOR ] GSK: Validating primary data.
[2025-10-24T19:05:02.552778] [INFO ] [REMOTE    ] GS: Fetching primary data for 2025-09.
[2025-10-24T19:05:02.886719] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present.
[2025-10-24T19:05:02.886800] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed.
[2025-10-24T19:05:02.887779] [INFO ] [MAIN      ] GSK: Fetched primary data is valid.
[2025-10-24T19:05:02.887840] [DEBUG] [LOCAL     ] GSK: Saving primary data.
[2025-10-24T19:05:02.888396] [FATAL] [LOCAL     ] GSK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:05:02.888483] [FATAL] [MAIN      ] GSK: Failed to save primary data.
[2025-10-24T19:05:02.888526] [WARN ] [MAIN      ] GSK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:05:02.888581] [INFO ] [LOCAL     ] GSK: Starting deletion of primary data.
[2025-10-24T19:05:02.888634] [DEBUG] [LOCAL     ] GSK: No primary data file found to delete.
[2025-10-24T19:05:02.888711] [INFO ] [LOCAL     ] GSK: Starting deletion of derivative data.
[2025-10-24T19:05:02.888947] [DEBUG] [LOCAL     ] GSK: Deleted derivative data file.
[2025-10-24T19:05:02.889356] [INFO ] [MAIN      ] Update Progress: 975/2366 symbols completed. GSK took 30.3s. Estimated remaining: 2h 58m 20s. Rate: 7.8 symbols/min
[2025-10-24T19:05:03.057935] [INFO ] [MAIN      ] GTLS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:05:03.099324] [DEBUG] [LOCAL     ] GTLS: Loaded 43429 existing records from primary storage.
[2025-10-24T19:05:03.099600] [INFO ] [MAIN      ] GTLS: Loaded 43429 existing records.
[2025-10-24T19:05:03.290068] [WARN ] [MAIN      ] GTLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:05:03.290424] [INFO ] [MAIN      ] GTLS: Wiping existing primary data before full refresh.
[2025-10-24T19:05:03.290552] [INFO ] [LOCAL     ] GTLS: Starting deletion of primary data.
[2025-10-24T19:05:03.290971] [DEBUG] [LOCAL     ] GTLS: Deleted primary data file.
[2025-10-24T19:05:03.291126] [INFO ] [MAIN      ] GTLS: Starting full primary refresh.
[2025-10-24T19:05:03.356172] [INFO ] [REMOTE    ] GSL: Fetching primary data for 2025-07.
[2025-10-24T19:05:03.478147] [INFO ] [REMOTE    ] GTES: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T19:05:03.713030] [INFO ] [REMOTE    ] GTLS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:05:04.147622] [INFO ] [REMOTE    ] GTLS: Fetching primary data for 2025-01.
[2025-10-24T19:05:04.559297] [INFO ] [REMOTE    ] GS: Incremental fetch complete for 2025-09 (2.01 seconds).
[2025-10-24T19:05:04.821714] [INFO ] [REMOTE    ] GSL: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T19:05:04.947676] [INFO ] [REMOTE    ] GSL: Fetching primary data for 2025-08.
[2025-10-24T19:05:05.752879] [INFO ] [REMOTE    ] GTES: Fetching primary data for 2025-03.
[2025-10-24T19:05:05.770700] [INFO ] [REMOTE    ] GTLS: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T19:05:06.387823] [INFO ] [REMOTE    ] GSL: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T19:05:06.547706] [INFO ] [REMOTE    ] GS: Fetching primary data for 2025-10.
[2025-10-24T19:05:07.340524] [INFO ] [REMOTE    ] GTES: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T19:05:07.350702] [INFO ] [REMOTE    ] GTLS: Fetching primary data for 2025-02.
[2025-10-24T19:05:08.147710] [INFO ] [REMOTE    ] GSL: Fetching primary data for 2025-09.
[2025-10-24T19:05:08.861067] [INFO ] [REMOTE    ] GTLS: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T19:05:08.957760] [INFO ] [REMOTE    ] GTLS: Fetching primary data for 2025-03.
[2025-10-24T19:05:08.962507] [INFO ] [REMOTE    ] GS: Incremental fetch complete for 2025-10 (2.41 seconds).
[2025-10-24T19:05:08.972874] [INFO ] [REMOTE    ] GS: Full fetch complete (75838 records).
[2025-10-24T19:05:08.972994] [DEBUG] [VALIDATOR ] GS: Validating primary data.
[2025-10-24T19:05:09.383544] [DEBUG] [VALIDATOR ] GS: All expected trading days are present.
[2025-10-24T19:05:09.383632] [DEBUG] [VALIDATOR ] GS: Primary data validation passed.
[2025-10-24T19:05:09.384607] [INFO ] [MAIN      ] GS: Fetched primary data is valid.
[2025-10-24T19:05:09.384695] [DEBUG] [LOCAL     ] GS: Saving primary data.
[2025-10-24T19:05:09.385263] [FATAL] [LOCAL     ] GS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:05:09.385382] [FATAL] [MAIN      ] GS: Failed to save primary data.
[2025-10-24T19:05:09.385423] [WARN ] [MAIN      ] GS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:05:09.385489] [INFO ] [LOCAL     ] GS: Starting deletion of primary data.
[2025-10-24T19:05:09.385570] [DEBUG] [LOCAL     ] GS: No primary data file found to delete.
[2025-10-24T19:05:09.385606] [INFO ] [LOCAL     ] GS: Starting deletion of derivative data.
[2025-10-24T19:05:09.385817] [DEBUG] [LOCAL     ] GS: Deleted derivative data file.
[2025-10-24T19:05:09.386293] [INFO ] [MAIN      ] Update Progress: 976/2366 symbols completed. GS took 39.5s. Estimated remaining: 2h 58m 11s. Rate: 7.8 symbols/min
[2025-10-24T19:05:09.571250] [INFO ] [MAIN      ] GTN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:05:09.574493] [INFO ] [REMOTE    ] GSL: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T19:05:09.621896] [DEBUG] [LOCAL     ] GTN: Loaded 45076 existing records from primary storage.
[2025-10-24T19:05:09.622210] [INFO ] [MAIN      ] GTN: Loaded 45076 existing records.
[2025-10-24T19:05:09.752873] [INFO ] [REMOTE    ] GTES: Fetching primary data for 2025-04.
[2025-10-24T19:05:09.814224] [WARN ] [MAIN      ] GTN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:05:09.814472] [INFO ] [MAIN      ] GTN: Wiping existing primary data before full refresh.
[2025-10-24T19:05:09.814524] [INFO ] [LOCAL     ] GTN: Starting deletion of primary data.
[2025-10-24T19:05:09.814767] [DEBUG] [LOCAL     ] GTN: Deleted primary data file.
[2025-10-24T19:05:09.814826] [INFO ] [MAIN      ] GTN: Starting full primary refresh.
[2025-10-24T19:05:10.191542] [INFO ] [REMOTE    ] GTN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:05:10.547681] [INFO ] [REMOTE    ] GTN: Fetching primary data for 2025-01.
[2025-10-24T19:05:10.645701] [INFO ] [REMOTE    ] GTLS: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T19:05:11.210000] [INFO ] [REMOTE    ] GTES: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T19:05:11.347631] [INFO ] [REMOTE    ] GTES: Fetching primary data for 2025-05.
[2025-10-24T19:05:12.147677] [INFO ] [REMOTE    ] GTLS: Fetching primary data for 2025-04.
[2025-10-24T19:05:12.192946] [INFO ] [REMOTE    ] GTN: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T19:05:12.892144] [INFO ] [REMOTE    ] GTES: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T19:05:12.947623] [INFO ] [REMOTE    ] GTES: Fetching primary data for 2025-06.
[2025-10-24T19:05:13.747723] [INFO ] [REMOTE    ] GSL: Fetching primary data for 2025-10.
[2025-10-24T19:05:13.891369] [INFO ] [REMOTE    ] GTLS: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T19:05:14.440757] [INFO ] [REMOTE    ] GTES: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T19:05:14.547631] [INFO ] [REMOTE    ] GTES: Fetching primary data for 2025-07.
[2025-10-24T19:05:15.108456] [INFO ] [REMOTE    ] GSL: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T19:05:15.114382] [INFO ] [REMOTE    ] GSL: Full fetch complete (48211 records).
[2025-10-24T19:05:15.114482] [DEBUG] [VALIDATOR ] GSL: Validating primary data.
[2025-10-24T19:05:15.352792] [INFO ] [REMOTE    ] GTN: Fetching primary data for 2025-02.
[2025-10-24T19:05:15.499753] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present.
[2025-10-24T19:05:15.499853] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed.
[2025-10-24T19:05:15.500585] [INFO ] [MAIN      ] GSL: Fetched primary data is valid.
[2025-10-24T19:05:15.500628] [DEBUG] [LOCAL     ] GSL: Saving primary data.
[2025-10-24T19:05:15.501059] [FATAL] [LOCAL     ] GSL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:05:15.501148] [FATAL] [MAIN      ] GSL: Failed to save primary data.
[2025-10-24T19:05:15.501190] [WARN ] [MAIN      ] GSL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:05:15.501226] [INFO ] [LOCAL     ] GSL: Starting deletion of primary data.
[2025-10-24T19:05:15.501317] [DEBUG] [LOCAL     ] GSL: No primary data file found to delete.
[2025-10-24T19:05:15.501367] [INFO ] [LOCAL     ] GSL: Starting deletion of derivative data.
[2025-10-24T19:05:15.501517] [DEBUG] [LOCAL     ] GSL: Deleted derivative data file.
[2025-10-24T19:05:15.501606] [INFO ] [MAIN      ] Update Progress: 977/2366 symbols completed. GSL took 31.3s. Estimated remaining: 2h 58m 1s. Rate: 7.8 symbols/min
[2025-10-24T19:05:15.669182] [INFO ] [MAIN      ] GTY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:05:15.699489] [DEBUG] [LOCAL     ] GTY: Loaded 30273 existing records from primary storage.
[2025-10-24T19:05:15.699792] [INFO ] [MAIN      ] GTY: Loaded 30273 existing records.
[2025-10-24T19:05:15.877066] [WARN ] [MAIN      ] GTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:05:15.877407] [INFO ] [MAIN      ] GTY: Wiping existing primary data before full refresh.
[2025-10-24T19:05:15.877503] [INFO ] [LOCAL     ] GTY: Starting deletion of primary data.
[2025-10-24T19:05:15.877884] [DEBUG] [LOCAL     ] GTY: Deleted primary data file.
[2025-10-24T19:05:15.878021] [INFO ] [MAIN      ] GTY: Starting full primary refresh.
[2025-10-24T19:05:16.152889] [INFO ] [REMOTE    ] GTLS: Fetching primary data for 2025-05.
[2025-10-24T19:05:16.276864] [INFO ] [REMOTE    ] GTY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:05:16.281136] [INFO ] [REMOTE    ] GTES: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T19:05:16.878988] [INFO ] [REMOTE    ] GTN: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T19:05:16.947635] [INFO ] [REMOTE    ] GTES: Fetching primary data for 2025-08.
[2025-10-24T19:05:17.716094] [INFO ] [REMOTE    ] GTLS: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T19:05:17.747701] [INFO ] [REMOTE    ] GTN: Fetching primary data for 2025-03.
[2025-10-24T19:05:18.547694] [INFO ] [REMOTE    ] GTY: Fetching primary data for 2025-01.
[2025-10-24T19:05:18.634986] [INFO ] [REMOTE    ] GTES: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T19:05:19.347726] [INFO ] [REMOTE    ] GTLS: Fetching primary data for 2025-06.
[2025-10-24T19:05:19.475950] [INFO ] [REMOTE    ] GTN: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T19:05:19.545423] [INFO ] [REMOTE    ] GTY: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T19:05:20.147709] [INFO ] [REMOTE    ] GTY: Fetching primary data for 2025-02.
[2025-10-24T19:05:20.947128] [INFO ] [REMOTE    ] GTLS: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T19:05:20.955845] [INFO ] [REMOTE    ] GTN: Fetching primary data for 2025-04.
[2025-10-24T19:05:21.254854] [INFO ] [REMOTE    ] GTY: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T19:05:21.747682] [INFO ] [REMOTE    ] GTLS: Fetching primary data for 2025-07.
[2025-10-24T19:05:22.547686] [INFO ] [REMOTE    ] GTES: Fetching primary data for 2025-09.
[2025-10-24T19:05:22.577286] [INFO ] [REMOTE    ] GTN: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T19:05:23.296711] [INFO ] [REMOTE    ] GTLS: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T19:05:23.347599] [INFO ] [REMOTE    ] GTLS: Fetching primary data for 2025-08.
[2025-10-24T19:05:23.910740] [INFO ] [REMOTE    ] GTES: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T19:05:24.147717] [INFO ] [REMOTE    ] GTY: Fetching primary data for 2025-03.
[2025-10-24T19:05:24.947708] [INFO ] [REMOTE    ] GTES: Fetching primary data for 2025-10.
[2025-10-24T19:05:25.279226] [INFO ] [REMOTE    ] GTLS: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T19:05:25.516406] [INFO ] [REMOTE    ] GTY: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T19:05:25.747715] [INFO ] [REMOTE    ] GTLS: Fetching primary data for 2025-09.
[2025-10-24T19:05:26.547711] [INFO ] [REMOTE    ] GTN: Fetching primary data for 2025-05.
[2025-10-24T19:05:26.878185] [INFO ] [REMOTE    ] GTES: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T19:05:26.888992] [INFO ] [REMOTE    ] GTES: Full fetch complete (73849 records).
[2025-10-24T19:05:26.889168] [DEBUG] [VALIDATOR ] GTES: Validating primary data.
[2025-10-24T19:05:27.293069] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present.
[2025-10-24T19:05:27.293230] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed.
[2025-10-24T19:05:27.294916] [INFO ] [MAIN      ] GTES: Fetched primary data is valid.
[2025-10-24T19:05:27.294999] [DEBUG] [LOCAL     ] GTES: Saving primary data.
[2025-10-24T19:05:27.295792] [FATAL] [LOCAL     ] GTES: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:05:27.295965] [FATAL] [MAIN      ] GTES: Failed to save primary data.
[2025-10-24T19:05:27.296044] [WARN ] [MAIN      ] GTES: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:05:27.296123] [INFO ] [LOCAL     ] GTES: Starting deletion of primary data.
[2025-10-24T19:05:27.296292] [DEBUG] [LOCAL     ] GTES: No primary data file found to delete.
[2025-10-24T19:05:27.296422] [INFO ] [LOCAL     ] GTES: Starting deletion of derivative data.
[2025-10-24T19:05:27.296935] [DEBUG] [LOCAL     ] GTES: Deleted derivative data file.
[2025-10-24T19:05:27.297853] [INFO ] [MAIN      ] Update Progress: 978/2366 symbols completed. GTES took 29.7s. Estimated remaining: 2h 57m 59s. Rate: 7.8 symbols/min
[2025-10-24T19:05:27.378336] [INFO ] [REMOTE    ] GTY: Fetching primary data for 2025-04.
[2025-10-24T19:05:27.431157] [INFO ] [REMOTE    ] GTLS: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T19:05:27.517898] [INFO ] [MAIN      ] GUG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:05:27.534213] [DEBUG] [LOCAL     ] GUG: Loaded 12223 existing records from primary storage.
[2025-10-24T19:05:27.534484] [INFO ] [MAIN      ] GUG: Loaded 12223 existing records.
[2025-10-24T19:05:27.715969] [WARN ] [MAIN      ] GUG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:05:27.716185] [INFO ] [MAIN      ] GUG: Wiping existing primary data before full refresh.
[2025-10-24T19:05:27.716232] [INFO ] [LOCAL     ] GUG: Starting deletion of primary data.
[2025-10-24T19:05:27.716409] [DEBUG] [LOCAL     ] GUG: Deleted primary data file.
[2025-10-24T19:05:27.716463] [INFO ] [MAIN      ] GUG: Starting full primary refresh.
[2025-10-24T19:05:28.073538] [INFO ] [REMOTE    ] GUG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:05:28.147619] [INFO ] [REMOTE    ] GUG: Fetching primary data for 2025-01.
[2025-10-24T19:05:28.196947] [INFO ] [REMOTE    ] GTN: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T19:05:28.844580] [INFO ] [REMOTE    ] GTY: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T19:05:28.947613] [INFO ] [REMOTE    ] GTN: Fetching primary data for 2025-06.
[2025-10-24T19:05:29.189257] [INFO ] [REMOTE    ] GUG: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T19:05:29.747726] [INFO ] [REMOTE    ] GTY: Fetching primary data for 2025-05.
[2025-10-24T19:05:30.437677] [INFO ] [REMOTE    ] GTN: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T19:05:30.547681] [INFO ] [REMOTE    ] GTLS: Fetching primary data for 2025-10.
[2025-10-24T19:05:31.061959] [INFO ] [REMOTE    ] GTY: Incremental fetch complete for 2025-05 (1.31 seconds).
[2025-10-24T19:05:31.347682] [INFO ] [REMOTE    ] GUG: Fetching primary data for 2025-02.
[2025-10-24T19:05:32.147749] [INFO ] [REMOTE    ] GTY: Fetching primary data for 2025-06.
[2025-10-24T19:05:32.274048] [INFO ] [REMOTE    ] GUG: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T19:05:32.337384] [INFO ] [REMOTE    ] GTLS: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T19:05:32.345783] [INFO ] [REMOTE    ] GTLS: Full fetch complete (61484 records).
[2025-10-24T19:05:32.345965] [DEBUG] [VALIDATOR ] GTLS: Validating primary data.
[2025-10-24T19:05:32.751127] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present.
[2025-10-24T19:05:32.751253] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed.
[2025-10-24T19:05:32.752755] [INFO ] [MAIN      ] GTLS: Fetched primary data is valid.
[2025-10-24T19:05:32.752835] [DEBUG] [LOCAL     ] GTLS: Saving primary data.
[2025-10-24T19:05:32.753767] [FATAL] [LOCAL     ] GTLS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:05:32.753869] [FATAL] [MAIN      ] GTLS: Failed to save primary data.
[2025-10-24T19:05:32.753915] [WARN ] [MAIN      ] GTLS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:05:32.753955] [INFO ] [LOCAL     ] GTLS: Starting deletion of primary data.
[2025-10-24T19:05:32.754020] [DEBUG] [LOCAL     ] GTLS: No primary data file found to delete.
[2025-10-24T19:05:32.754060] [INFO ] [LOCAL     ] GTLS: Starting deletion of derivative data.
[2025-10-24T19:05:32.754451] [DEBUG] [LOCAL     ] GTLS: Deleted derivative data file.
[2025-10-24T19:05:32.755142] [INFO ] [MAIN      ] Update Progress: 979/2366 symbols completed. GTLS took 29.9s. Estimated remaining: 2h 57m 48s. Rate: 7.8 symbols/min
[2025-10-24T19:05:32.928793] [INFO ] [MAIN      ] GUT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:05:32.946188] [DEBUG] [LOCAL     ] GUT: Loaded 15608 existing records from primary storage.
[2025-10-24T19:05:32.946437] [INFO ] [MAIN      ] GUT: Loaded 15608 existing records.
[2025-10-24T19:05:32.958281] [INFO ] [REMOTE    ] GTN: Fetching primary data for 2025-07.
[2025-10-24T19:05:33.128622] [WARN ] [MAIN      ] GUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:05:33.128843] [INFO ] [MAIN      ] GUT: Wiping existing primary data before full refresh.
[2025-10-24T19:05:33.128890] [INFO ] [LOCAL     ] GUT: Starting deletion of primary data.
[2025-10-24T19:05:33.129086] [DEBUG] [LOCAL     ] GUT: Deleted primary data file.
[2025-10-24T19:05:33.129142] [INFO ] [MAIN      ] GUT: Starting full primary refresh.
[2025-10-24T19:05:33.491420] [INFO ] [REMOTE    ] GUT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:05:33.508605] [INFO ] [REMOTE    ] GTY: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T19:05:33.747769] [INFO ] [REMOTE    ] GUT: Fetching primary data for 2025-01.
[2025-10-24T19:05:34.547680] [INFO ] [REMOTE    ] GUG: Fetching primary data for 2025-03.
[2025-10-24T19:05:34.731919] [INFO ] [REMOTE    ] GTN: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T19:05:34.765317] [INFO ] [REMOTE    ] GUT: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T19:05:35.183269] [INFO ] [REMOTE    ] GUG: Incremental fetch complete for 2025-03 (0.64 seconds).
[2025-10-24T19:05:35.347710] [INFO ] [REMOTE    ] GUT: Fetching primary data for 2025-02.
[2025-10-24T19:05:36.147713] [INFO ] [REMOTE    ] GTY: Fetching primary data for 2025-07.
[2025-10-24T19:05:36.177047] [INFO ] [REMOTE    ] GUT: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T19:05:36.947719] [INFO ] [REMOTE    ] GTN: Fetching primary data for 2025-08.
[2025-10-24T19:05:37.623918] [INFO ] [REMOTE    ] GTY: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T19:05:37.747674] [INFO ] [REMOTE    ] GTY: Fetching primary data for 2025-08.
[2025-10-24T19:05:38.236045] [INFO ] [REMOTE    ] GTN: Incremental fetch complete for 2025-08 (1.29 seconds).
[2025-10-24T19:05:38.547723] [INFO ] [REMOTE    ] GUT: Fetching primary data for 2025-03.
[2025-10-24T19:05:39.065222] [INFO ] [REMOTE    ] GTY: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T19:05:39.347722] [INFO ] [REMOTE    ] GTN: Fetching primary data for 2025-09.
[2025-10-24T19:05:39.466401] [INFO ] [REMOTE    ] GUT: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T19:05:40.147630] [INFO ] [REMOTE    ] GUT: Fetching primary data for 2025-04.
[2025-10-24T19:05:40.940190] [INFO ] [REMOTE    ] GTN: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T19:05:40.949072] [INFO ] [REMOTE    ] GTY: Fetching primary data for 2025-09.
[2025-10-24T19:05:41.141185] [INFO ] [REMOTE    ] GUT: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T19:05:41.747729] [INFO ] [REMOTE    ] GUG: Fetching primary data for 2025-04.
[2025-10-24T19:05:42.339390] [INFO ] [REMOTE    ] GTY: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T19:05:42.547616] [INFO ] [REMOTE    ] GTY: Fetching primary data for 2025-10.
[2025-10-24T19:05:42.708964] [INFO ] [REMOTE    ] GUG: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T19:05:43.347747] [INFO ] [REMOTE    ] GUT: Fetching primary data for 2025-05.
[2025-10-24T19:05:44.043178] [INFO ] [REMOTE    ] GTY: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T19:05:44.049291] [INFO ] [REMOTE    ] GTY: Full fetch complete (43890 records).
[2025-10-24T19:05:44.049424] [DEBUG] [VALIDATOR ] GTY: Validating primary data.
[2025-10-24T19:05:44.149491] [INFO ] [REMOTE    ] GTN: Fetching primary data for 2025-10.
[2025-10-24T19:05:44.352501] [INFO ] [REMOTE    ] GUT: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T19:05:44.441539] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present.
[2025-10-24T19:05:44.441611] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed.
[2025-10-24T19:05:44.442382] [INFO ] [MAIN      ] GTY: Fetched primary data is valid.
[2025-10-24T19:05:44.442440] [DEBUG] [LOCAL     ] GTY: Saving primary data.
[2025-10-24T19:05:44.442833] [FATAL] [LOCAL     ] GTY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:05:44.442918] [FATAL] [MAIN      ] GTY: Failed to save primary data.
[2025-10-24T19:05:44.442962] [WARN ] [MAIN      ] GTY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:05:44.443025] [INFO ] [LOCAL     ] GTY: Starting deletion of primary data.
[2025-10-24T19:05:44.443085] [DEBUG] [LOCAL     ] GTY: No primary data file found to delete.
[2025-10-24T19:05:44.443119] [INFO ] [LOCAL     ] GTY: Starting deletion of derivative data.
[2025-10-24T19:05:44.443270] [DEBUG] [LOCAL     ] GTY: Deleted derivative data file.
[2025-10-24T19:05:44.443362] [INFO ] [MAIN      ] Update Progress: 980/2366 symbols completed. GTY took 28.9s. Estimated remaining: 2h 57m 46s. Rate: 7.8 symbols/min
[2025-10-24T19:05:44.612689] [INFO ] [MAIN      ] GVA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:05:44.648578] [DEBUG] [LOCAL     ] GVA: Loaded 32845 existing records from primary storage.
[2025-10-24T19:05:44.648899] [INFO ] [MAIN      ] GVA: Loaded 32845 existing records.
[2025-10-24T19:05:44.826686] [WARN ] [MAIN      ] GVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:05:44.826911] [INFO ] [MAIN      ] GVA: Wiping existing primary data before full refresh.
[2025-10-24T19:05:44.826965] [INFO ] [LOCAL     ] GVA: Starting deletion of primary data.
[2025-10-24T19:05:44.827196] [DEBUG] [LOCAL     ] GVA: Deleted primary data file.
[2025-10-24T19:05:44.827256] [INFO ] [MAIN      ] GVA: Starting full primary refresh.
[2025-10-24T19:05:44.952759] [INFO ] [REMOTE    ] GUG: Fetching primary data for 2025-05.
[2025-10-24T19:05:45.184529] [INFO ] [REMOTE    ] GVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:05:45.747613] [INFO ] [REMOTE    ] GVA: Fetching primary data for 2025-01.
[2025-10-24T19:05:45.842919] [INFO ] [REMOTE    ] GTN: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T19:05:45.841703] [INFO ] [REMOTE    ] GUG: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T19:05:45.853614] [INFO ] [REMOTE    ] GTN: Full fetch complete (65624 records).
[2025-10-24T19:05:45.853762] [DEBUG] [VALIDATOR ] GTN: Validating primary data.
[2025-10-24T19:05:46.241229] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present.
[2025-10-24T19:05:46.241303] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed.
[2025-10-24T19:05:46.242189] [INFO ] [MAIN      ] GTN: Fetched primary data is valid.
[2025-10-24T19:05:46.242249] [DEBUG] [LOCAL     ] GTN: Saving primary data.
[2025-10-24T19:05:46.242772] [FATAL] [LOCAL     ] GTN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:05:46.242860] [FATAL] [MAIN      ] GTN: Failed to save primary data.
[2025-10-24T19:05:46.242902] [WARN ] [MAIN      ] GTN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:05:46.242936] [INFO ] [LOCAL     ] GTN: Starting deletion of primary data.
[2025-10-24T19:05:46.242986] [DEBUG] [LOCAL     ] GTN: No primary data file found to delete.
[2025-10-24T19:05:46.243021] [INFO ] [LOCAL     ] GTN: Starting deletion of derivative data.
[2025-10-24T19:05:46.243154] [DEBUG] [LOCAL     ] GTN: Deleted derivative data file.
[2025-10-24T19:05:46.243501] [INFO ] [MAIN      ] Update Progress: 981/2366 symbols completed. GTN took 36.9s. Estimated remaining: 2h 57m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:05:46.430310] [INFO ] [MAIN      ] GWH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:05:46.451450] [DEBUG] [LOCAL     ] GWH: Loaded 20423 existing records from primary storage.
[2025-10-24T19:05:46.451708] [INFO ] [MAIN      ] GWH: Loaded 20423 existing records.
[2025-10-24T19:05:46.552956] [INFO ] [REMOTE    ] GUT: Fetching primary data for 2025-06.
[2025-10-24T19:05:46.633472] [WARN ] [MAIN      ] GWH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:05:46.633692] [INFO ] [MAIN      ] GWH: Wiping existing primary data before full refresh.
[2025-10-24T19:05:46.633749] [INFO ] [LOCAL     ] GWH: Starting deletion of primary data.
[2025-10-24T19:05:46.633970] [DEBUG] [LOCAL     ] GWH: Deleted primary data file.
[2025-10-24T19:05:46.634025] [INFO ] [MAIN      ] GWH: Starting full primary refresh.
[2025-10-24T19:05:46.987186] [INFO ] [REMOTE    ] GWH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:05:47.114833] [INFO ] [REMOTE    ] GVA: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T19:05:47.228374] [INFO ] [REMOTE    ] GUT: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T19:05:47.347640] [INFO ] [REMOTE    ] GWH: Fetching primary data for 2025-01.
[2025-10-24T19:05:48.147744] [INFO ] [REMOTE    ] GVA: Fetching primary data for 2025-02.
[2025-10-24T19:05:48.312545] [INFO ] [REMOTE    ] GWH: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T19:05:48.947735] [INFO ] [REMOTE    ] GUT: Fetching primary data for 2025-07.
[2025-10-24T19:05:49.333181] [INFO ] [REMOTE    ] GVA: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T19:05:49.747714] [INFO ] [REMOTE    ] GUG: Fetching primary data for 2025-06.
[2025-10-24T19:05:49.976230] [INFO ] [REMOTE    ] GUT: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T19:05:50.547767] [INFO ] [REMOTE    ] GVA: Fetching primary data for 2025-03.
[2025-10-24T19:05:50.611907] [INFO ] [REMOTE    ] GUG: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T19:05:51.347696] [INFO ] [REMOTE    ] GWH: Fetching primary data for 2025-02.
[2025-10-24T19:05:52.071198] [INFO ] [REMOTE    ] GVA: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T19:05:52.147608] [INFO ] [REMOTE    ] GVA: Fetching primary data for 2025-04.
[2025-10-24T19:05:52.215589] [INFO ] [REMOTE    ] GWH: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T19:05:52.947702] [INFO ] [REMOTE    ] GWH: Fetching primary data for 2025-03.
[2025-10-24T19:05:53.747681] [INFO ] [REMOTE    ] GUG: Fetching primary data for 2025-07.
[2025-10-24T19:05:53.754893] [INFO ] [REMOTE    ] GWH: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T19:05:53.828693] [INFO ] [REMOTE    ] GVA: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T19:05:54.547613] [INFO ] [REMOTE    ] GWH: Fetching primary data for 2025-04.
[2025-10-24T19:05:54.703774] [INFO ] [REMOTE    ] GUG: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T19:05:55.347621] [INFO ] [REMOTE    ] GVA: Fetching primary data for 2025-05.
[2025-10-24T19:05:55.405081] [INFO ] [REMOTE    ] GWH: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T19:05:56.147717] [INFO ] [REMOTE    ] GUT: Fetching primary data for 2025-08.
[2025-10-24T19:05:56.788442] [INFO ] [REMOTE    ] GVA: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T19:05:56.947675] [INFO ] [REMOTE    ] GVA: Fetching primary data for 2025-06.
[2025-10-24T19:05:57.118818] [INFO ] [REMOTE    ] GUT: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T19:05:57.747672] [INFO ] [REMOTE    ] GUT: Fetching primary data for 2025-09.
[2025-10-24T19:05:58.329343] [INFO ] [REMOTE    ] GVA: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T19:05:58.547632] [INFO ] [REMOTE    ] GVA: Fetching primary data for 2025-07.
[2025-10-24T19:05:58.679846] [INFO ] [REMOTE    ] GUT: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T19:05:59.347728] [INFO ] [REMOTE    ] GWH: Fetching primary data for 2025-05.
[2025-10-24T19:05:59.957559] [INFO ] [REMOTE    ] GVA: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T19:06:00.147710] [INFO ] [REMOTE    ] GUT: Fetching primary data for 2025-10.
[2025-10-24T19:06:00.476484] [INFO ] [REMOTE    ] GWH: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T19:06:00.947720] [INFO ] [REMOTE    ] GVA: Fetching primary data for 2025-08.
[2025-10-24T19:06:01.740109] [INFO ] [REMOTE    ] GUT: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T19:06:01.743909] [INFO ] [REMOTE    ] GUT: Full fetch complete (22538 records).
[2025-10-24T19:06:01.743981] [DEBUG] [VALIDATOR ] GUT: Validating primary data.
[2025-10-24T19:06:01.755728] [INFO ] [REMOTE    ] GUG: Fetching primary data for 2025-08.
[2025-10-24T19:06:02.114695] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present.
[2025-10-24T19:06:02.114776] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed.
[2025-10-24T19:06:02.115277] [INFO ] [MAIN      ] GUT: Fetched primary data is valid.
[2025-10-24T19:06:02.115318] [DEBUG] [LOCAL     ] GUT: Saving primary data.
[2025-10-24T19:06:02.115581] [FATAL] [LOCAL     ] GUT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:06:02.115687] [FATAL] [MAIN      ] GUT: Failed to save primary data.
[2025-10-24T19:06:02.115739] [WARN ] [MAIN      ] GUT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:06:02.115800] [INFO ] [LOCAL     ] GUT: Starting deletion of primary data.
[2025-10-24T19:06:02.115857] [DEBUG] [LOCAL     ] GUT: No primary data file found to delete.
[2025-10-24T19:06:02.115893] [INFO ] [LOCAL     ] GUT: Starting deletion of derivative data.
[2025-10-24T19:06:02.116046] [DEBUG] [LOCAL     ] GUT: Deleted derivative data file.
[2025-10-24T19:06:02.116134] [INFO ] [MAIN      ] Update Progress: 982/2366 symbols completed. GUT took 29.4s. Estimated remaining: 2h 57m 34s. Rate: 7.8 symbols/min
[2025-10-24T19:06:02.286128] [INFO ] [MAIN      ] GWRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:06:02.324447] [DEBUG] [LOCAL     ] GWRE: Loaded 39790 existing records from primary storage.
[2025-10-24T19:06:02.324755] [INFO ] [MAIN      ] GWRE: Loaded 39790 existing records.
[2025-10-24T19:06:02.511037] [WARN ] [MAIN      ] GWRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:06:02.517801] [INFO ] [MAIN      ] GWRE: Wiping existing primary data before full refresh.
[2025-10-24T19:06:02.529042] [INFO ] [LOCAL     ] GWRE: Starting deletion of primary data.
[2025-10-24T19:06:02.530306] [INFO ] [REMOTE    ] GVA: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T19:06:02.529630] [DEBUG] [LOCAL     ] GWRE: Deleted primary data file.
[2025-10-24T19:06:02.537204] [INFO ] [MAIN      ] GWRE: Starting full primary refresh.
[2025-10-24T19:06:02.557977] [INFO ] [REMOTE    ] GWH: Fetching primary data for 2025-06.
[2025-10-24T19:06:02.694826] [INFO ] [REMOTE    ] GUG: Incremental fetch complete for 2025-08 (0.94 seconds).
[2025-10-24T19:06:02.905867] [INFO ] [REMOTE    ] GWRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:06:03.347680] [INFO ] [REMOTE    ] GWRE: Fetching primary data for 2025-01.
[2025-10-24T19:06:03.784304] [INFO ] [REMOTE    ] GWH: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T19:06:04.147682] [INFO ] [REMOTE    ] GWH: Fetching primary data for 2025-07.
[2025-10-24T19:06:04.849159] [INFO ] [REMOTE    ] GWRE: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T19:06:04.947600] [INFO ] [REMOTE    ] GWRE: Fetching primary data for 2025-02.
[2025-10-24T19:06:05.422833] [INFO ] [REMOTE    ] GWH: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T19:06:05.747678] [INFO ] [REMOTE    ] GUG: Fetching primary data for 2025-09.
[2025-10-24T19:06:06.446635] [INFO ] [REMOTE    ] GWRE: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T19:06:06.547609] [INFO ] [REMOTE    ] GVA: Fetching primary data for 2025-09.
[2025-10-24T19:06:06.633906] [INFO ] [REMOTE    ] GUG: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T19:06:07.347625] [INFO ] [REMOTE    ] GWRE: Fetching primary data for 2025-03.
[2025-10-24T19:06:07.939692] [INFO ] [REMOTE    ] GVA: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T19:06:08.147634] [INFO ] [REMOTE    ] GWH: Fetching primary data for 2025-08.
[2025-10-24T19:06:08.947700] [INFO ] [REMOTE    ] GUG: Fetching primary data for 2025-10.
[2025-10-24T19:06:09.090489] [INFO ] [REMOTE    ] GWRE: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T19:06:09.225151] [INFO ] [REMOTE    ] GWH: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T19:06:09.652101] [INFO ] [REMOTE    ] GUG: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T19:06:09.654412] [INFO ] [REMOTE    ] GUG: Full fetch complete (18717 records).
[2025-10-24T19:06:09.654481] [DEBUG] [VALIDATOR ] GUG: Validating primary data.
[2025-10-24T19:06:09.752746] [INFO ] [REMOTE    ] GWRE: Fetching primary data for 2025-04.
[2025-10-24T19:06:10.012944] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present.
[2025-10-24T19:06:10.013013] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed.
[2025-10-24T19:06:10.013354] [INFO ] [MAIN      ] GUG: Fetched primary data is valid.
[2025-10-24T19:06:10.013391] [DEBUG] [LOCAL     ] GUG: Saving primary data.
[2025-10-24T19:06:10.013619] [FATAL] [LOCAL     ] GUG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:06:10.013724] [FATAL] [MAIN      ] GUG: Failed to save primary data.
[2025-10-24T19:06:10.013765] [WARN ] [MAIN      ] GUG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:06:10.013799] [INFO ] [LOCAL     ] GUG: Starting deletion of primary data.
[2025-10-24T19:06:10.013845] [DEBUG] [LOCAL     ] GUG: No primary data file found to delete.
[2025-10-24T19:06:10.013879] [INFO ] [LOCAL     ] GUG: Starting deletion of derivative data.
[2025-10-24T19:06:10.014018] [DEBUG] [LOCAL     ] GUG: Deleted derivative data file.
[2025-10-24T19:06:10.014083] [INFO ] [MAIN      ] Update Progress: 983/2366 symbols completed. GUG took 42.7s. Estimated remaining: 2h 57m 26s. Rate: 7.8 symbols/min
[2025-10-24T19:06:10.179561] [INFO ] [MAIN      ] GWW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:06:10.200183] [DEBUG] [LOCAL     ] GWW: Loaded 19343 existing records from primary storage.
[2025-10-24T19:06:10.200403] [INFO ] [MAIN      ] GWW: Loaded 19343 existing records.
[2025-10-24T19:06:10.379749] [WARN ] [MAIN      ] GWW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:06:10.379934] [INFO ] [MAIN      ] GWW: Wiping existing primary data before full refresh.
[2025-10-24T19:06:10.379985] [INFO ] [LOCAL     ] GWW: Starting deletion of primary data.
[2025-10-24T19:06:10.380158] [DEBUG] [LOCAL     ] GWW: Deleted primary data file.
[2025-10-24T19:06:10.380203] [INFO ] [MAIN      ] GWW: Starting full primary refresh.
[2025-10-24T19:06:10.550328] [INFO ] [REMOTE    ] GVA: Fetching primary data for 2025-10.
[2025-10-24T19:06:10.730268] [INFO ] [REMOTE    ] GWW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:06:11.358805] [INFO ] [REMOTE    ] GWW: Fetching primary data for 2025-01.
[2025-10-24T19:06:11.361737] [INFO ] [REMOTE    ] GWRE: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T19:06:11.794834] [INFO ] [REMOTE    ] GVA: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T19:06:11.800770] [INFO ] [REMOTE    ] GVA: Full fetch complete (48465 records).
[2025-10-24T19:06:11.800861] [DEBUG] [VALIDATOR ] GVA: Validating primary data.
[2025-10-24T19:06:12.158194] [INFO ] [REMOTE    ] GWH: Fetching primary data for 2025-09.
[2025-10-24T19:06:12.175697] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present.
[2025-10-24T19:06:12.175856] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed.
[2025-10-24T19:06:12.176600] [INFO ] [MAIN      ] GVA: Fetched primary data is valid.
[2025-10-24T19:06:12.176690] [DEBUG] [LOCAL     ] GVA: Saving primary data.
[2025-10-24T19:06:12.177125] [FATAL] [LOCAL     ] GVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:06:12.177223] [FATAL] [MAIN      ] GVA: Failed to save primary data.
[2025-10-24T19:06:12.177289] [WARN ] [MAIN      ] GVA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:06:12.177356] [INFO ] [LOCAL     ] GVA: Starting deletion of primary data.
[2025-10-24T19:06:12.177416] [DEBUG] [LOCAL     ] GVA: No primary data file found to delete.
[2025-10-24T19:06:12.177453] [INFO ] [LOCAL     ] GVA: Starting deletion of derivative data.
[2025-10-24T19:06:12.177578] [DEBUG] [LOCAL     ] GVA: Deleted derivative data file.
[2025-10-24T19:06:12.177671] [INFO ] [MAIN      ] Update Progress: 984/2366 symbols completed. GVA took 27.7s. Estimated remaining: 2h 57m 11s. Rate: 7.8 symbols/min
[2025-10-24T19:06:12.351496] [INFO ] [MAIN      ] GXO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:06:12.366587] [INFO ] [REMOTE    ] GWW: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T19:06:12.408777] [DEBUG] [LOCAL     ] GXO: Loaded 46753 existing records from primary storage.
[2025-10-24T19:06:12.409102] [INFO ] [MAIN      ] GXO: Loaded 46753 existing records.
[2025-10-24T19:06:12.580436] [WARN ] [MAIN      ] GXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:06:12.580615] [INFO ] [MAIN      ] GXO: Wiping existing primary data before full refresh.
[2025-10-24T19:06:12.580696] [INFO ] [LOCAL     ] GXO: Starting deletion of primary data.
[2025-10-24T19:06:12.580898] [DEBUG] [LOCAL     ] GXO: Deleted primary data file.
[2025-10-24T19:06:12.580937] [INFO ] [MAIN      ] GXO: Starting full primary refresh.
[2025-10-24T19:06:12.929102] [INFO ] [REMOTE    ] GXO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:06:12.947598] [INFO ] [REMOTE    ] GXO: Fetching primary data for 2025-01.
[2025-10-24T19:06:13.049534] [DEBUG] [REMOTE    ] GXO: Error fetching primary data for 2025-01: 'API call returned an empty response.'
[2025-10-24T19:06:13.049950] [WARN ] [REMOTE    ] GXO: No data returned for month 2025-01
[2025-10-24T19:06:13.050256] [FATAL] [REMOTE    ] GXO: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:06:13.050315] [FATAL] [MAIN      ] GXO: Failed to fetch primary data.
[2025-10-24T19:06:13.050382] [WARN ] [MAIN      ] GXO: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:06:13.050453] [INFO ] [LOCAL     ] GXO: Starting deletion of primary data.
[2025-10-24T19:06:13.050517] [DEBUG] [LOCAL     ] GXO: No primary data file found to delete.
[2025-10-24T19:06:13.050553] [INFO ] [LOCAL     ] GXO: Starting deletion of derivative data.
[2025-10-24T19:06:13.050726] [DEBUG] [LOCAL     ] GXO: Deleted derivative data file.
[2025-10-24T19:06:13.050819] [INFO ] [MAIN      ] Update Progress: 985/2366 symbols completed. GXO took 0.9s. Estimated remaining: 2h 56m 54s. Rate: 7.8 symbols/min
[2025-10-24T19:06:13.218700] [INFO ] [MAIN      ] GYLD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:06:13.222740] [DEBUG] [LOCAL     ] GYLD: Loaded 1537 existing records from primary storage.
[2025-10-24T19:06:13.222930] [INFO ] [MAIN      ] GYLD: Loaded 1537 existing records.
[2025-10-24T19:06:13.355433] [INFO ] [REMOTE    ] GWH: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T19:06:13.415582] [WARN ] [MAIN      ] GYLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:06:13.415814] [INFO ] [MAIN      ] GYLD: Wiping existing primary data before full refresh.
[2025-10-24T19:06:13.415861] [INFO ] [LOCAL     ] GYLD: Starting deletion of primary data.
[2025-10-24T19:06:13.415981] [DEBUG] [LOCAL     ] GYLD: Deleted primary data file.
[2025-10-24T19:06:13.416018] [INFO ] [MAIN      ] GYLD: Starting full primary refresh.
[2025-10-24T19:06:13.754432] [INFO ] [REMOTE    ] GWRE: Fetching primary data for 2025-05.
[2025-10-24T19:06:13.762523] [INFO ] [REMOTE    ] GYLD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:06:14.547636] [INFO ] [REMOTE    ] GYLD: Fetching primary data for 2025-01.
[2025-10-24T19:06:14.892082] [INFO ] [REMOTE    ] GYLD: Incremental fetch complete for 2025-01 (0.34 seconds).
[2025-10-24T19:06:15.352793] [INFO ] [REMOTE    ] GWH: Fetching primary data for 2025-10.
[2025-10-24T19:06:15.363373] [INFO ] [REMOTE    ] GWRE: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T19:06:16.147699] [INFO ] [REMOTE    ] GYLD: Fetching primary data for 2025-02.
[2025-10-24T19:06:16.511689] [INFO ] [REMOTE    ] GYLD: Incremental fetch complete for 2025-02 (0.36 seconds).
[2025-10-24T19:06:16.947726] [INFO ] [REMOTE    ] GWW: Fetching primary data for 2025-02.
[2025-10-24T19:06:17.453742] [INFO ] [REMOTE    ] GWH: Incremental fetch complete for 2025-10 (2.10 seconds).
[2025-10-24T19:06:17.461603] [INFO ] [REMOTE    ] GWH: Full fetch complete (25097 records).
[2025-10-24T19:06:17.461768] [DEBUG] [VALIDATOR ] GWH: Validating primary data.
[2025-10-24T19:06:17.752790] [INFO ] [REMOTE    ] GYLD: Fetching primary data for 2025-03.
[2025-10-24T19:06:17.878439] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present.
[2025-10-24T19:06:17.878600] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed.
[2025-10-24T19:06:17.879218] [INFO ] [MAIN      ] GWH: Fetched primary data is valid.
[2025-10-24T19:06:17.879275] [DEBUG] [LOCAL     ] GWH: Saving primary data.
[2025-10-24T19:06:17.879593] [FATAL] [LOCAL     ] GWH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:06:17.879696] [FATAL] [MAIN      ] GWH: Failed to save primary data.
[2025-10-24T19:06:17.879744] [WARN ] [MAIN      ] GWH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:06:17.879826] [INFO ] [LOCAL     ] GWH: Starting deletion of primary data.
[2025-10-24T19:06:17.879906] [DEBUG] [LOCAL     ] GWH: No primary data file found to delete.
[2025-10-24T19:06:17.879943] [INFO ] [LOCAL     ] GWH: Starting deletion of derivative data.
[2025-10-24T19:06:17.880084] [DEBUG] [LOCAL     ] GWH: Deleted derivative data file.
[2025-10-24T19:06:17.880176] [INFO ] [MAIN      ] Update Progress: 986/2366 symbols completed. GWH took 31.6s. Estimated remaining: 2h 56m 42s. Rate: 7.8 symbols/min
[2025-10-24T19:06:18.066140] [INFO ] [MAIN      ] H: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:06:18.079460] [INFO ] [REMOTE    ] GWW: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T19:06:18.126814] [DEBUG] [LOCAL     ] H: Loaded 44693 existing records from primary storage.
[2025-10-24T19:06:18.127266] [INFO ] [MAIN      ] H: Loaded 44693 existing records.
[2025-10-24T19:06:18.263603] [INFO ] [REMOTE    ] GYLD: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T19:06:18.319691] [WARN ] [MAIN      ] H: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:06:18.319903] [INFO ] [MAIN      ] H: Wiping existing primary data before full refresh.
[2025-10-24T19:06:18.319952] [INFO ] [LOCAL     ] H: Starting deletion of primary data.
[2025-10-24T19:06:18.320157] [DEBUG] [LOCAL     ] H: Deleted primary data file.
[2025-10-24T19:06:18.320197] [INFO ] [MAIN      ] H: Starting full primary refresh.
[2025-10-24T19:06:18.554097] [INFO ] [REMOTE    ] GYLD: Fetching primary data for 2025-04.
[2025-10-24T19:06:18.694854] [INFO ] [REMOTE    ] H: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:06:19.006609] [INFO ] [REMOTE    ] GYLD: Incremental fetch complete for 2025-04 (0.45 seconds).
[2025-10-24T19:06:19.347674] [INFO ] [REMOTE    ] H: Fetching primary data for 2025-01.
[2025-10-24T19:06:20.147744] [INFO ] [REMOTE    ] GWRE: Fetching primary data for 2025-06.
[2025-10-24T19:06:20.828904] [INFO ] [REMOTE    ] H: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T19:06:20.947622] [INFO ] [REMOTE    ] H: Fetching primary data for 2025-02.
[2025-10-24T19:06:21.747724] [INFO ] [REMOTE    ] GWW: Fetching primary data for 2025-03.
[2025-10-24T19:06:21.884103] [INFO ] [REMOTE    ] GWRE: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T19:06:22.441359] [INFO ] [REMOTE    ] H: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T19:06:22.547612] [INFO ] [REMOTE    ] H: Fetching primary data for 2025-03.
[2025-10-24T19:06:22.880140] [INFO ] [REMOTE    ] GWW: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T19:06:23.347668] [INFO ] [REMOTE    ] GWRE: Fetching primary data for 2025-07.
[2025-10-24T19:06:24.147736] [INFO ] [REMOTE    ] GYLD: Fetching primary data for 2025-05.
[2025-10-24T19:06:24.259828] [INFO ] [REMOTE    ] H: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T19:06:24.614306] [INFO ] [REMOTE    ] GYLD: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T19:06:24.802198] [INFO ] [REMOTE    ] GWRE: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T19:06:24.947669] [INFO ] [REMOTE    ] GYLD: Fetching primary data for 2025-06.
[2025-10-24T19:06:25.386338] [INFO ] [REMOTE    ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds).
[2025-10-24T19:06:25.747696] [INFO ] [REMOTE    ] GYLD: Fetching primary data for 2025-07.
[2025-10-24T19:06:26.204565] [INFO ] [REMOTE    ] GYLD: Incremental fetch complete for 2025-07 (0.46 seconds).
[2025-10-24T19:06:26.547669] [INFO ] [REMOTE    ] GYLD: Fetching primary data for 2025-08.
[2025-10-24T19:06:26.989974] [INFO ] [REMOTE    ] GYLD: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T19:06:27.347695] [INFO ] [REMOTE    ] GWRE: Fetching primary data for 2025-08.
[2025-10-24T19:06:28.147717] [INFO ] [REMOTE    ] GWW: Fetching primary data for 2025-04.
[2025-10-24T19:06:28.915218] [INFO ] [REMOTE    ] GWRE: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T19:06:28.947615] [INFO ] [REMOTE    ] GWRE: Fetching primary data for 2025-09.
[2025-10-24T19:06:29.390977] [INFO ] [REMOTE    ] GWW: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T19:06:29.747727] [INFO ] [REMOTE    ] H: Fetching primary data for 2025-04.
[2025-10-24T19:06:30.306545] [INFO ] [REMOTE    ] GWRE: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T19:06:30.547712] [INFO ] [REMOTE    ] GYLD: Fetching primary data for 2025-09.
[2025-10-24T19:06:31.009742] [INFO ] [REMOTE    ] GYLD: Incremental fetch complete for 2025-09 (0.46 seconds).
[2025-10-24T19:06:31.355087] [INFO ] [REMOTE    ] GWW: Fetching primary data for 2025-05.
[2025-10-24T19:06:31.360164] [INFO ] [REMOTE    ] H: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T19:06:32.147621] [INFO ] [REMOTE    ] GWRE: Fetching primary data for 2025-10.
[2025-10-24T19:06:32.427888] [INFO ] [REMOTE    ] GWW: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T19:06:32.947673] [INFO ] [REMOTE    ] GWW: Fetching primary data for 2025-06.
[2025-10-24T19:06:33.678499] [INFO ] [REMOTE    ] GWRE: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T19:06:33.685844] [INFO ] [REMOTE    ] GWRE: Full fetch complete (59884 records).
[2025-10-24T19:06:33.685988] [DEBUG] [VALIDATOR ] GWRE: Validating primary data.
[2025-10-24T19:06:33.750355] [INFO ] [REMOTE    ] H: Fetching primary data for 2025-05.
[2025-10-24T19:06:34.045281] [INFO ] [REMOTE    ] GWW: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T19:06:34.152308] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present.
[2025-10-24T19:06:34.152396] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed.
[2025-10-24T19:06:34.153374] [INFO ] [MAIN      ] GWRE: Fetched primary data is valid.
[2025-10-24T19:06:34.153441] [DEBUG] [LOCAL     ] GWRE: Saving primary data.
[2025-10-24T19:06:34.154009] [FATAL] [LOCAL     ] GWRE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:06:34.154098] [FATAL] [MAIN      ] GWRE: Failed to save primary data.
[2025-10-24T19:06:34.154154] [WARN ] [MAIN      ] GWRE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:06:34.154227] [INFO ] [LOCAL     ] GWRE: Starting deletion of primary data.
[2025-10-24T19:06:34.154289] [DEBUG] [LOCAL     ] GWRE: No primary data file found to delete.
[2025-10-24T19:06:34.154327] [INFO ] [LOCAL     ] GWRE: Starting deletion of derivative data.
[2025-10-24T19:06:34.154488] [DEBUG] [LOCAL     ] GWRE: Deleted derivative data file.
[2025-10-24T19:06:34.155132] [INFO ] [MAIN      ] Update Progress: 987/2366 symbols completed. GWRE took 32.0s. Estimated remaining: 2h 56m 46s. Rate: 7.8 symbols/min
[2025-10-24T19:06:34.332628] [INFO ] [MAIN      ] HAE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:06:34.372325] [DEBUG] [LOCAL     ] HAE: Loaded 39587 existing records from primary storage.
[2025-10-24T19:06:34.372631] [INFO ] [MAIN      ] HAE: Loaded 39587 existing records.
[2025-10-24T19:06:34.553685] [INFO ] [REMOTE    ] GYLD: Fetching primary data for 2025-10.
[2025-10-24T19:06:34.559463] [WARN ] [MAIN      ] HAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:06:34.560610] [INFO ] [MAIN      ] HAE: Wiping existing primary data before full refresh.
[2025-10-24T19:06:34.560695] [INFO ] [LOCAL     ] HAE: Starting deletion of primary data.
[2025-10-24T19:06:34.560946] [DEBUG] [LOCAL     ] HAE: Deleted primary data file.
[2025-10-24T19:06:34.560989] [INFO ] [MAIN      ] HAE: Starting full primary refresh.
[2025-10-24T19:06:34.940917] [INFO ] [REMOTE    ] HAE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:06:35.101346] [INFO ] [REMOTE    ] GYLD: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T19:06:35.102306] [INFO ] [REMOTE    ] GYLD: Full fetch complete (2090 records).
[2025-10-24T19:06:35.102387] [DEBUG] [VALIDATOR ] GYLD: Validating primary data.
[2025-10-24T19:06:35.350272] [INFO ] [REMOTE    ] HAE: Fetching primary data for 2025-01.
[2025-10-24T19:06:35.463056] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present.
[2025-10-24T19:06:35.463185] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed.
[2025-10-24T19:06:35.463309] [INFO ] [MAIN      ] GYLD: Fetched primary data is valid.
[2025-10-24T19:06:35.463381] [DEBUG] [LOCAL     ] GYLD: Saving primary data.
[2025-10-24T19:06:35.463706] [FATAL] [LOCAL     ] GYLD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:06:35.463803] [FATAL] [MAIN      ] GYLD: Failed to save primary data.
[2025-10-24T19:06:35.463979] [WARN ] [MAIN      ] GYLD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:06:35.464055] [INFO ] [LOCAL     ] GYLD: Starting deletion of primary data.
[2025-10-24T19:06:35.464144] [DEBUG] [LOCAL     ] GYLD: No primary data file found to delete.
[2025-10-24T19:06:35.464194] [INFO ] [LOCAL     ] GYLD: Starting deletion of derivative data.
[2025-10-24T19:06:35.464508] [DEBUG] [LOCAL     ] GYLD: Deleted derivative data file.
[2025-10-24T19:06:35.464597] [INFO ] [MAIN      ] Update Progress: 988/2366 symbols completed. GYLD took 22.4s. Estimated remaining: 2h 56m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:06:35.660769] [INFO ] [MAIN      ] HAFN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:06:35.658494] [INFO ] [REMOTE    ] H: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T19:06:35.712145] [DEBUG] [LOCAL     ] HAFN: Loaded 42951 existing records from primary storage.
[2025-10-24T19:06:35.712449] [INFO ] [MAIN      ] HAFN: Loaded 42951 existing records.
[2025-10-24T19:06:35.887053] [WARN ] [MAIN      ] HAFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:06:35.887282] [INFO ] [MAIN      ] HAFN: Wiping existing primary data before full refresh.
[2025-10-24T19:06:35.887333] [INFO ] [LOCAL     ] HAFN: Starting deletion of primary data.
[2025-10-24T19:06:35.887542] [DEBUG] [LOCAL     ] HAFN: Deleted primary data file.
[2025-10-24T19:06:35.887598] [INFO ] [MAIN      ] HAFN: Starting full primary refresh.
[2025-10-24T19:06:36.152859] [INFO ] [REMOTE    ] H: Fetching primary data for 2025-06.
[2025-10-24T19:06:36.256716] [INFO ] [REMOTE    ] HAFN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:06:36.869625] [INFO ] [REMOTE    ] HAE: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T19:06:36.947722] [INFO ] [REMOTE    ] HAFN: Fetching primary data for 2025-01.
[2025-10-24T19:06:37.366390] [INFO ] [REMOTE    ] H: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T19:06:37.747729] [INFO ] [REMOTE    ] HAE: Fetching primary data for 2025-02.
[2025-10-24T19:06:38.547704] [INFO ] [REMOTE    ] GWW: Fetching primary data for 2025-07.
[2025-10-24T19:06:38.846039] [INFO ] [REMOTE    ] HAFN: Incremental fetch complete for 2025-01 (1.90 seconds).
[2025-10-24T19:06:39.347673] [INFO ] [REMOTE    ] HAFN: Fetching primary data for 2025-02.
[2025-10-24T19:06:39.417138] [INFO ] [REMOTE    ] HAE: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T19:06:39.751827] [INFO ] [REMOTE    ] GWW: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T19:06:40.147746] [INFO ] [REMOTE    ] GWW: Fetching primary data for 2025-08.
[2025-10-24T19:06:40.862381] [INFO ] [REMOTE    ] HAFN: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T19:06:40.947700] [INFO ] [REMOTE    ] HAFN: Fetching primary data for 2025-03.
[2025-10-24T19:06:41.341690] [INFO ] [REMOTE    ] GWW: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T19:06:41.747708] [INFO ] [REMOTE    ] GWW: Fetching primary data for 2025-09.
[2025-10-24T19:06:42.547733] [INFO ] [REMOTE    ] HAE: Fetching primary data for 2025-03.
[2025-10-24T19:06:42.674905] [INFO ] [REMOTE    ] HAFN: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T19:06:42.858974] [INFO ] [REMOTE    ] GWW: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T19:06:43.347673] [INFO ] [REMOTE    ] GWW: Fetching primary data for 2025-10.
[2025-10-24T19:06:44.037055] [INFO ] [REMOTE    ] HAE: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T19:06:44.147677] [INFO ] [REMOTE    ] HAFN: Fetching primary data for 2025-04.
[2025-10-24T19:06:44.503230] [INFO ] [REMOTE    ] GWW: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T19:06:44.506979] [INFO ] [REMOTE    ] GWW: Full fetch complete (29074 records).
[2025-10-24T19:06:44.507060] [DEBUG] [VALIDATOR ] GWW: Validating primary data.
[2025-10-24T19:06:44.880247] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present.
[2025-10-24T19:06:44.880327] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed.
[2025-10-24T19:06:44.881015] [INFO ] [MAIN      ] GWW: Fetched primary data is valid.
[2025-10-24T19:06:44.881088] [DEBUG] [LOCAL     ] GWW: Saving primary data.
[2025-10-24T19:06:44.881418] [FATAL] [LOCAL     ] GWW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:06:44.881504] [FATAL] [MAIN      ] GWW: Failed to save primary data.
[2025-10-24T19:06:44.881546] [WARN ] [MAIN      ] GWW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:06:44.881582] [INFO ] [LOCAL     ] GWW: Starting deletion of primary data.
[2025-10-24T19:06:44.881634] [DEBUG] [LOCAL     ] GWW: No primary data file found to delete.
[2025-10-24T19:06:44.881714] [INFO ] [LOCAL     ] GWW: Starting deletion of derivative data.
[2025-10-24T19:06:44.881924] [DEBUG] [LOCAL     ] GWW: Deleted derivative data file.
[2025-10-24T19:06:44.882014] [INFO ] [MAIN      ] Update Progress: 989/2366 symbols completed. GWW took 34.9s. Estimated remaining: 2h 56m 24s. Rate: 7.8 symbols/min
[2025-10-24T19:06:44.952733] [INFO ] [REMOTE    ] H: Fetching primary data for 2025-07.
[2025-10-24T19:06:45.066967] [INFO ] [MAIN      ] HAL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:06:45.119164] [DEBUG] [LOCAL     ] HAL: Loaded 54108 existing records from primary storage.
[2025-10-24T19:06:45.119456] [INFO ] [MAIN      ] HAL: Loaded 54108 existing records.
[2025-10-24T19:06:45.298122] [WARN ] [MAIN      ] HAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:06:45.298341] [INFO ] [MAIN      ] HAL: Wiping existing primary data before full refresh.
[2025-10-24T19:06:45.298386] [INFO ] [LOCAL     ] HAL: Starting deletion of primary data.
[2025-10-24T19:06:45.298942] [DEBUG] [LOCAL     ] HAL: Deleted primary data file.
[2025-10-24T19:06:45.298999] [INFO ] [MAIN      ] HAL: Starting full primary refresh.
[2025-10-24T19:06:45.663511] [INFO ] [REMOTE    ] HAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:06:45.747623] [INFO ] [REMOTE    ] HAL: Fetching primary data for 2025-01.
[2025-10-24T19:06:45.967479] [INFO ] [REMOTE    ] HAFN: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T19:06:46.547677] [INFO ] [REMOTE    ] HAE: Fetching primary data for 2025-04.
[2025-10-24T19:06:46.628148] [INFO ] [REMOTE    ] H: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T19:06:47.347728] [INFO ] [REMOTE    ] H: Fetching primary data for 2025-08.
[2025-10-24T19:06:47.393528] [INFO ] [REMOTE    ] HAL: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T19:06:48.084630] [INFO ] [REMOTE    ] HAE: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T19:06:48.147611] [INFO ] [REMOTE    ] HAE: Fetching primary data for 2025-05.
[2025-10-24T19:06:48.947667] [INFO ] [REMOTE    ] HAL: Fetching primary data for 2025-02.
[2025-10-24T19:06:49.035871] [INFO ] [REMOTE    ] H: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T19:06:49.133486] [INFO ] [REMOTE    ] HAE: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T19:06:49.747627] [INFO ] [REMOTE    ] H: Fetching primary data for 2025-09.
[2025-10-24T19:06:50.547617] [INFO ] [REMOTE    ] HAE: Fetching primary data for 2025-06.
[2025-10-24T19:06:50.818909] [INFO ] [REMOTE    ] HAL: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T19:06:50.922061] [INFO ] [REMOTE    ] H: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T19:06:51.347721] [INFO ] [REMOTE    ] HAFN: Fetching primary data for 2025-05.
[2025-10-24T19:06:51.879866] [INFO ] [REMOTE    ] HAE: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T19:06:52.147681] [INFO ] [REMOTE    ] HAL: Fetching primary data for 2025-03.
[2025-10-24T19:06:52.947619] [INFO ] [REMOTE    ] HAE: Fetching primary data for 2025-07.
[2025-10-24T19:06:53.020919] [INFO ] [REMOTE    ] HAFN: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T19:06:53.747618] [INFO ] [REMOTE    ] HAFN: Fetching primary data for 2025-06.
[2025-10-24T19:06:54.032701] [INFO ] [REMOTE    ] HAL: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T19:06:54.322774] [INFO ] [REMOTE    ] HAE: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T19:06:54.547737] [INFO ] [REMOTE    ] HAE: Fetching primary data for 2025-08.
[2025-10-24T19:06:55.071736] [INFO ] [REMOTE    ] HAFN: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T19:06:55.347719] [INFO ] [REMOTE    ] HAL: Fetching primary data for 2025-04.
[2025-10-24T19:06:56.059034] [INFO ] [REMOTE    ] HAE: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T19:06:56.147629] [INFO ] [REMOTE    ] HAFN: Fetching primary data for 2025-07.
[2025-10-24T19:06:56.947784] [INFO ] [REMOTE    ] HAE: Fetching primary data for 2025-09.
[2025-10-24T19:06:57.228549] [INFO ] [REMOTE    ] HAL: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T19:06:57.747702] [INFO ] [REMOTE    ] H: Fetching primary data for 2025-10.
[2025-10-24T19:06:57.773967] [INFO ] [REMOTE    ] HAFN: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T19:06:58.558002] [INFO ] [REMOTE    ] HAFN: Fetching primary data for 2025-08.
[2025-10-24T19:06:58.563577] [INFO ] [REMOTE    ] HAE: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T19:06:59.347756] [INFO ] [REMOTE    ] HAE: Fetching primary data for 2025-10.
[2025-10-24T19:06:59.552321] [INFO ] [REMOTE    ] H: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T19:06:59.560349] [INFO ] [REMOTE    ] H: Full fetch complete (63540 records).
[2025-10-24T19:06:59.560460] [DEBUG] [VALIDATOR ] H: Validating primary data.
[2025-10-24T19:06:59.948381] [DEBUG] [VALIDATOR ] H: All expected trading days are present.
[2025-10-24T19:06:59.948478] [DEBUG] [VALIDATOR ] H: Primary data validation passed.
[2025-10-24T19:06:59.949352] [INFO ] [MAIN      ] H: Fetched primary data is valid.
[2025-10-24T19:06:59.949455] [DEBUG] [LOCAL     ] H: Saving primary data.
[2025-10-24T19:06:59.950138] [FATAL] [LOCAL     ] H: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:06:59.950220] [FATAL] [MAIN      ] H: Failed to save primary data.
[2025-10-24T19:06:59.950261] [WARN ] [MAIN      ] H: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:06:59.950299] [INFO ] [LOCAL     ] H: Starting deletion of primary data.
[2025-10-24T19:06:59.950352] [DEBUG] [LOCAL     ] H: No primary data file found to delete.
[2025-10-24T19:06:59.950387] [INFO ] [LOCAL     ] H: Starting deletion of derivative data.
[2025-10-24T19:06:59.950510] [DEBUG] [LOCAL     ] H: Deleted derivative data file.
[2025-10-24T19:06:59.950920] [INFO ] [MAIN      ] Update Progress: 990/2366 symbols completed. H took 42.1s. Estimated remaining: 2h 56m 27s. Rate: 7.8 symbols/min
[2025-10-24T19:07:00.144780] [INFO ] [REMOTE    ] HAFN: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T19:07:00.143458] [INFO ] [MAIN      ] HASI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:07:00.153540] [INFO ] [REMOTE    ] HAL: Fetching primary data for 2025-05.
[2025-10-24T19:07:00.197012] [DEBUG] [LOCAL     ] HASI: Loaded 48038 existing records from primary storage.
[2025-10-24T19:07:00.197338] [INFO ] [MAIN      ] HASI: Loaded 48038 existing records.
[2025-10-24T19:07:00.373826] [WARN ] [MAIN      ] HASI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:07:00.374034] [INFO ] [MAIN      ] HASI: Wiping existing primary data before full refresh.
[2025-10-24T19:07:00.374080] [INFO ] [LOCAL     ] HASI: Starting deletion of primary data.
[2025-10-24T19:07:00.374289] [DEBUG] [LOCAL     ] HASI: Deleted primary data file.
[2025-10-24T19:07:00.374328] [INFO ] [MAIN      ] HASI: Starting full primary refresh.
[2025-10-24T19:07:00.734497] [INFO ] [REMOTE    ] HASI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:07:00.947688] [INFO ] [REMOTE    ] HASI: Fetching primary data for 2025-01.
[2025-10-24T19:07:01.024824] [INFO ] [REMOTE    ] HAE: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T19:07:01.033828] [INFO ] [REMOTE    ] HAE: Full fetch complete (59293 records).
[2025-10-24T19:07:01.034049] [DEBUG] [VALIDATOR ] HAE: Validating primary data.
[2025-10-24T19:07:01.442837] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present.
[2025-10-24T19:07:01.442957] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed.
[2025-10-24T19:07:01.444489] [INFO ] [MAIN      ] HAE: Fetched primary data is valid.
[2025-10-24T19:07:01.444592] [DEBUG] [LOCAL     ] HAE: Saving primary data.
[2025-10-24T19:07:01.445576] [FATAL] [LOCAL     ] HAE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:07:01.445700] [FATAL] [MAIN      ] HAE: Failed to save primary data.
[2025-10-24T19:07:01.445754] [WARN ] [MAIN      ] HAE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:07:01.445796] [INFO ] [LOCAL     ] HAE: Starting deletion of primary data.
[2025-10-24T19:07:01.445861] [DEBUG] [LOCAL     ] HAE: No primary data file found to delete.
[2025-10-24T19:07:01.445900] [INFO ] [LOCAL     ] HAE: Starting deletion of derivative data.
[2025-10-24T19:07:01.446128] [DEBUG] [LOCAL     ] HAE: Deleted derivative data file.
[2025-10-24T19:07:01.446369] [INFO ] [MAIN      ] Update Progress: 991/2366 symbols completed. HAE took 27.3s. Estimated remaining: 2h 56m 11s. Rate: 7.8 symbols/min
[2025-10-24T19:07:01.625291] [INFO ] [MAIN      ] HAYW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:07:01.683746] [DEBUG] [LOCAL     ] HAYW: Loaded 49174 existing records from primary storage.
[2025-10-24T19:07:01.684176] [INFO ] [MAIN      ] HAYW: Loaded 49174 existing records.
[2025-10-24T19:07:01.756446] [INFO ] [REMOTE    ] HAFN: Fetching primary data for 2025-09.
[2025-10-24T19:07:01.889604] [WARN ] [MAIN      ] HAYW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:07:01.889981] [INFO ] [MAIN      ] HAYW: Wiping existing primary data before full refresh.
[2025-10-24T19:07:01.890044] [INFO ] [LOCAL     ] HAYW: Starting deletion of primary data.
[2025-10-24T19:07:01.890315] [DEBUG] [LOCAL     ] HAYW: Deleted primary data file.
[2025-10-24T19:07:01.890374] [INFO ] [MAIN      ] HAYW: Starting full primary refresh.
[2025-10-24T19:07:02.289905] [INFO ] [REMOTE    ] HAYW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:07:02.327750] [INFO ] [REMOTE    ] HAL: Incremental fetch complete for 2025-05 (2.17 seconds).
[2025-10-24T19:07:02.547711] [INFO ] [REMOTE    ] HAYW: Fetching primary data for 2025-01.
[2025-10-24T19:07:02.632875] [INFO ] [REMOTE    ] HASI: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T19:07:03.036795] [INFO ] [REMOTE    ] HAFN: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T19:07:03.347735] [INFO ] [REMOTE    ] HAFN: Fetching primary data for 2025-10.
[2025-10-24T19:07:04.139567] [INFO ] [REMOTE    ] HAYW: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T19:07:04.153293] [INFO ] [REMOTE    ] HAL: Fetching primary data for 2025-06.
[2025-10-24T19:07:04.947679] [INFO ] [REMOTE    ] HAYW: Fetching primary data for 2025-02.
[2025-10-24T19:07:05.105958] [INFO ] [REMOTE    ] HAFN: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T19:07:05.113724] [INFO ] [REMOTE    ] HAFN: Full fetch complete (64597 records).
[2025-10-24T19:07:05.113902] [DEBUG] [VALIDATOR ] HAFN: Validating primary data.
[2025-10-24T19:07:05.495315] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present.
[2025-10-24T19:07:05.495393] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed.
[2025-10-24T19:07:05.496260] [INFO ] [MAIN      ] HAFN: Fetched primary data is valid.
[2025-10-24T19:07:05.496322] [DEBUG] [LOCAL     ] HAFN: Saving primary data.
[2025-10-24T19:07:05.496842] [FATAL] [LOCAL     ] HAFN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:07:05.496931] [FATAL] [MAIN      ] HAFN: Failed to save primary data.
[2025-10-24T19:07:05.496974] [WARN ] [MAIN      ] HAFN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:07:05.497008] [INFO ] [LOCAL     ] HAFN: Starting deletion of primary data.
[2025-10-24T19:07:05.497061] [DEBUG] [LOCAL     ] HAFN: No primary data file found to delete.
[2025-10-24T19:07:05.497097] [INFO ] [LOCAL     ] HAFN: Starting deletion of derivative data.
[2025-10-24T19:07:05.497272] [DEBUG] [LOCAL     ] HAFN: Deleted derivative data file.
[2025-10-24T19:07:05.497699] [INFO ] [MAIN      ] Update Progress: 992/2366 symbols completed. HAFN took 30.0s. Estimated remaining: 2h 55m 58s. Rate: 7.8 symbols/min
[2025-10-24T19:07:05.665337] [INFO ] [MAIN      ] HBB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:07:05.676726] [DEBUG] [LOCAL     ] HBB: Loaded 6322 existing records from primary storage.
[2025-10-24T19:07:05.676938] [INFO ] [MAIN      ] HBB: Loaded 6322 existing records.
[2025-10-24T19:07:05.752855] [INFO ] [REMOTE    ] HASI: Fetching primary data for 2025-02.
[2025-10-24T19:07:05.854495] [WARN ] [MAIN      ] HBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:07:05.854749] [INFO ] [MAIN      ] HBB: Wiping existing primary data before full refresh.
[2025-10-24T19:07:05.854951] [INFO ] [LOCAL     ] HBB: Starting deletion of primary data.
[2025-10-24T19:07:05.855190] [DEBUG] [LOCAL     ] HBB: Deleted primary data file.
[2025-10-24T19:07:05.855309] [INFO ] [MAIN      ] HBB: Starting full primary refresh.
[2025-10-24T19:07:06.219720] [INFO ] [REMOTE    ] HBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:07:06.261010] [INFO ] [REMOTE    ] HAL: Incremental fetch complete for 2025-06 (2.11 seconds).
[2025-10-24T19:07:06.295920] [INFO ] [REMOTE    ] HAYW: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T19:07:06.547621] [INFO ] [REMOTE    ] HAL: Fetching primary data for 2025-07.
[2025-10-24T19:07:06.998615] [INFO ] [REMOTE    ] HASI: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T19:07:07.347639] [INFO ] [REMOTE    ] HBB: Fetching primary data for 2025-01.
[2025-10-24T19:07:08.012159] [INFO ] [REMOTE    ] HBB: Incremental fetch complete for 2025-01 (0.66 seconds).
[2025-10-24T19:07:08.147639] [INFO ] [REMOTE    ] HASI: Fetching primary data for 2025-03.
[2025-10-24T19:07:08.727766] [INFO ] [REMOTE    ] HAL: Incremental fetch complete for 2025-07 (2.18 seconds).
[2025-10-24T19:07:08.947668] [INFO ] [REMOTE    ] HBB: Fetching primary data for 2025-02.
[2025-10-24T19:07:09.706581] [INFO ] [REMOTE    ] HBB: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T19:07:09.735637] [INFO ] [REMOTE    ] HASI: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T19:07:09.747598] [INFO ] [REMOTE    ] HASI: Fetching primary data for 2025-04.
[2025-10-24T19:07:10.547706] [INFO ] [REMOTE    ] HAL: Fetching primary data for 2025-08.
[2025-10-24T19:07:11.347621] [INFO ] [REMOTE    ] HBB: Fetching primary data for 2025-03.
[2025-10-24T19:07:11.501377] [INFO ] [REMOTE    ] HASI: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T19:07:12.063015] [INFO ] [REMOTE    ] HBB: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T19:07:12.147636] [INFO ] [REMOTE    ] HBB: Fetching primary data for 2025-04.
[2025-10-24T19:07:12.534378] [INFO ] [REMOTE    ] HAL: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T19:07:12.947731] [INFO ] [REMOTE    ] HAYW: Fetching primary data for 2025-03.
[2025-10-24T19:07:12.984166] [INFO ] [REMOTE    ] HBB: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T19:07:13.747727] [INFO ] [REMOTE    ] HBB: Fetching primary data for 2025-05.
[2025-10-24T19:07:14.427936] [INFO ] [REMOTE    ] HBB: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T19:07:14.547616] [INFO ] [REMOTE    ] HBB: Fetching primary data for 2025-06.
[2025-10-24T19:07:14.698327] [INFO ] [REMOTE    ] HAYW: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T19:07:15.111778] [INFO ] [REMOTE    ] HBB: Incremental fetch complete for 2025-06 (0.56 seconds).
[2025-10-24T19:07:15.347670] [INFO ] [REMOTE    ] HAYW: Fetching primary data for 2025-04.
[2025-10-24T19:07:16.147693] [INFO ] [REMOTE    ] HAL: Fetching primary data for 2025-09.
[2025-10-24T19:07:16.947694] [INFO ] [REMOTE    ] HASI: Fetching primary data for 2025-05.
[2025-10-24T19:07:16.993424] [INFO ] [REMOTE    ] HAYW: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T19:07:17.747695] [INFO ] [REMOTE    ] HAYW: Fetching primary data for 2025-05.
[2025-10-24T19:07:18.168626] [INFO ] [REMOTE    ] HAL: Incremental fetch complete for 2025-09 (2.02 seconds).
[2025-10-24T19:07:18.256034] [INFO ] [REMOTE    ] HASI: Incremental fetch complete for 2025-05 (1.31 seconds).
[2025-10-24T19:07:18.547634] [INFO ] [REMOTE    ] HASI: Fetching primary data for 2025-06.
[2025-10-24T19:07:19.312982] [INFO ] [REMOTE    ] HAYW: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T19:07:19.347599] [INFO ] [REMOTE    ] HAYW: Fetching primary data for 2025-06.
[2025-10-24T19:07:20.147711] [INFO ] [REMOTE    ] HAL: Fetching primary data for 2025-10.
[2025-10-24T19:07:20.212155] [INFO ] [REMOTE    ] HASI: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T19:07:20.924258] [INFO ] [REMOTE    ] HAYW: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T19:07:20.947614] [INFO ] [REMOTE    ] HAYW: Fetching primary data for 2025-07.
[2025-10-24T19:07:21.747742] [INFO ] [REMOTE    ] HASI: Fetching primary data for 2025-07.
[2025-10-24T19:07:22.547735] [INFO ] [REMOTE    ] HBB: Fetching primary data for 2025-07.
[2025-10-24T19:07:22.595068] [INFO ] [REMOTE    ] HAYW: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T19:07:22.800351] [INFO ] [REMOTE    ] HAL: Incremental fetch complete for 2025-10 (2.65 seconds).
[2025-10-24T19:07:22.810396] [INFO ] [REMOTE    ] HAL: Full fetch complete (77897 records).
[2025-10-24T19:07:22.810562] [DEBUG] [VALIDATOR ] HAL: Validating primary data.
[2025-10-24T19:07:23.218517] [INFO ] [REMOTE    ] HBB: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T19:07:23.218791] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present.
[2025-10-24T19:07:23.218890] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed.
[2025-10-24T19:07:23.222152] [INFO ] [MAIN      ] HAL: Fetched primary data is valid.
[2025-10-24T19:07:23.222306] [DEBUG] [LOCAL     ] HAL: Saving primary data.
[2025-10-24T19:07:23.223224] [FATAL] [LOCAL     ] HAL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:07:23.223419] [FATAL] [MAIN      ] HAL: Failed to save primary data.
[2025-10-24T19:07:23.223496] [WARN ] [MAIN      ] HAL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:07:23.223661] [INFO ] [LOCAL     ] HAL: Starting deletion of primary data.
[2025-10-24T19:07:23.223790] [DEBUG] [LOCAL     ] HAL: No primary data file found to delete.
[2025-10-24T19:07:23.223861] [INFO ] [LOCAL     ] HAL: Starting deletion of derivative data.
[2025-10-24T19:07:23.233443] [DEBUG] [LOCAL     ] HAL: Deleted derivative data file.
[2025-10-24T19:07:23.249451] [INFO ] [MAIN      ] Update Progress: 993/2366 symbols completed. HAL took 38.4s. Estimated remaining: 2h 56m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:07:23.324572] [INFO ] [REMOTE    ] HASI: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T19:07:23.352764] [INFO ] [REMOTE    ] HBB: Fetching primary data for 2025-08.
[2025-10-24T19:07:23.455105] [INFO ] [MAIN      ] HBI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:07:23.503601] [DEBUG] [LOCAL     ] HBI: Loaded 53296 existing records from primary storage.
[2025-10-24T19:07:23.503942] [INFO ] [MAIN      ] HBI: Loaded 53296 existing records.
[2025-10-24T19:07:23.685622] [WARN ] [MAIN      ] HBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:07:23.685857] [INFO ] [MAIN      ] HBI: Wiping existing primary data before full refresh.
[2025-10-24T19:07:23.685911] [INFO ] [LOCAL     ] HBI: Starting deletion of primary data.
[2025-10-24T19:07:23.686118] [DEBUG] [LOCAL     ] HBI: Deleted primary data file.
[2025-10-24T19:07:23.686159] [INFO ] [MAIN      ] HBI: Starting full primary refresh.
[2025-10-24T19:07:24.048481] [INFO ] [REMOTE    ] HBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:07:24.147693] [INFO ] [REMOTE    ] HBI: Fetching primary data for 2025-01.
[2025-10-24T19:07:24.196301] [INFO ] [REMOTE    ] HBB: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T19:07:24.947686] [INFO ] [REMOTE    ] HAYW: Fetching primary data for 2025-08.
[2025-10-24T19:07:25.747709] [INFO ] [REMOTE    ] HBB: Fetching primary data for 2025-09.
[2025-10-24T19:07:25.936979] [INFO ] [REMOTE    ] HBI: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T19:07:26.385531] [INFO ] [REMOTE    ] HBB: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T19:07:26.522447] [INFO ] [REMOTE    ] HAYW: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T19:07:26.547609] [INFO ] [REMOTE    ] HAYW: Fetching primary data for 2025-09.
[2025-10-24T19:07:27.347733] [INFO ] [REMOTE    ] HBB: Fetching primary data for 2025-10.
[2025-10-24T19:07:28.061749] [INFO ] [REMOTE    ] HBB: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T19:07:28.063041] [INFO ] [REMOTE    ] HBB: Full fetch complete (9176 records).
[2025-10-24T19:07:28.063114] [DEBUG] [VALIDATOR ] HBB: Validating primary data.
[2025-10-24T19:07:28.151203] [INFO ] [REMOTE    ] HASI: Fetching primary data for 2025-08.
[2025-10-24T19:07:28.477413] [INFO ] [REMOTE    ] HAYW: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T19:07:28.483779] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present.
[2025-10-24T19:07:28.493411] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed.
[2025-10-24T19:07:28.493803] [INFO ] [MAIN      ] HBB: Fetched primary data is valid.
[2025-10-24T19:07:28.493880] [DEBUG] [LOCAL     ] HBB: Saving primary data.
[2025-10-24T19:07:28.494311] [FATAL] [LOCAL     ] HBB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:07:28.494562] [FATAL] [MAIN      ] HBB: Failed to save primary data.
[2025-10-24T19:07:28.494630] [WARN ] [MAIN      ] HBB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:07:28.494711] [INFO ] [LOCAL     ] HBB: Starting deletion of primary data.
[2025-10-24T19:07:28.494781] [DEBUG] [LOCAL     ] HBB: No primary data file found to delete.
[2025-10-24T19:07:28.495082] [INFO ] [LOCAL     ] HBB: Starting deletion of derivative data.
[2025-10-24T19:07:28.495258] [DEBUG] [LOCAL     ] HBB: Deleted derivative data file.
[2025-10-24T19:07:28.495347] [INFO ] [MAIN      ] Update Progress: 994/2366 symbols completed. HBB took 23.0s. Estimated remaining: 2h 55m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:07:28.664204] [INFO ] [MAIN      ] HBM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:07:28.713966] [DEBUG] [LOCAL     ] HBM: Loaded 53369 existing records from primary storage.
[2025-10-24T19:07:28.714257] [INFO ] [MAIN      ] HBM: Loaded 53369 existing records.
[2025-10-24T19:07:28.891286] [WARN ] [MAIN      ] HBM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:07:28.891488] [INFO ] [MAIN      ] HBM: Wiping existing primary data before full refresh.
[2025-10-24T19:07:28.891536] [INFO ] [LOCAL     ] HBM: Starting deletion of primary data.
[2025-10-24T19:07:28.892375] [DEBUG] [LOCAL     ] HBM: Deleted primary data file.
[2025-10-24T19:07:28.892431] [INFO ] [MAIN      ] HBM: Starting full primary refresh.
[2025-10-24T19:07:28.954454] [INFO ] [REMOTE    ] HBI: Fetching primary data for 2025-02.
[2025-10-24T19:07:29.240828] [INFO ] [REMOTE    ] HBM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:07:29.747622] [INFO ] [REMOTE    ] HAYW: Fetching primary data for 2025-10.
[2025-10-24T19:07:29.865069] [INFO ] [REMOTE    ] HASI: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T19:07:30.547668] [INFO ] [REMOTE    ] HASI: Fetching primary data for 2025-09.
[2025-10-24T19:07:30.685141] [INFO ] [REMOTE    ] HBI: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T19:07:31.009228] [INFO ] [REMOTE    ] HAYW: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T19:07:31.018132] [INFO ] [REMOTE    ] HAYW: Full fetch complete (70919 records).
[2025-10-24T19:07:31.018244] [DEBUG] [VALIDATOR ] HAYW: Validating primary data.
[2025-10-24T19:07:31.356925] [INFO ] [REMOTE    ] HBM: Fetching primary data for 2025-01.
[2025-10-24T19:07:31.415576] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present.
[2025-10-24T19:07:31.415677] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed.
[2025-10-24T19:07:31.416579] [INFO ] [MAIN      ] HAYW: Fetched primary data is valid.
[2025-10-24T19:07:31.416621] [DEBUG] [LOCAL     ] HAYW: Saving primary data.
[2025-10-24T19:07:31.417268] [FATAL] [LOCAL     ] HAYW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:07:31.417354] [FATAL] [MAIN      ] HAYW: Failed to save primary data.
[2025-10-24T19:07:31.417396] [WARN ] [MAIN      ] HAYW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:07:31.417429] [INFO ] [LOCAL     ] HAYW: Starting deletion of primary data.
[2025-10-24T19:07:31.417479] [DEBUG] [LOCAL     ] HAYW: No primary data file found to delete.
[2025-10-24T19:07:31.417568] [INFO ] [LOCAL     ] HAYW: Starting deletion of derivative data.
[2025-10-24T19:07:31.417746] [DEBUG] [LOCAL     ] HAYW: Deleted derivative data file.
[2025-10-24T19:07:31.418349] [INFO ] [MAIN      ] Update Progress: 995/2366 symbols completed. HAYW took 30.0s. Estimated remaining: 2h 55m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:07:31.584497] [INFO ] [MAIN      ] HCA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:07:31.627519] [DEBUG] [LOCAL     ] HCA: Loaded 47254 existing records from primary storage.
[2025-10-24T19:07:31.627836] [INFO ] [MAIN      ] HCA: Loaded 47254 existing records.
[2025-10-24T19:07:31.803346] [WARN ] [MAIN      ] HCA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:07:31.803542] [INFO ] [MAIN      ] HCA: Wiping existing primary data before full refresh.
[2025-10-24T19:07:31.803588] [INFO ] [LOCAL     ] HCA: Starting deletion of primary data.
[2025-10-24T19:07:31.804471] [DEBUG] [LOCAL     ] HCA: Deleted primary data file.
[2025-10-24T19:07:31.804527] [INFO ] [MAIN      ] HCA: Starting full primary refresh.
[2025-10-24T19:07:32.152560] [INFO ] [REMOTE    ] HBI: Fetching primary data for 2025-03.
[2025-10-24T19:07:32.165168] [INFO ] [REMOTE    ] HCA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:07:32.278216] [INFO ] [REMOTE    ] HASI: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T19:07:32.947619] [INFO ] [REMOTE    ] HASI: Fetching primary data for 2025-10.
[2025-10-24T19:07:33.024167] [INFO ] [REMOTE    ] HBM: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T19:07:33.747758] [INFO ] [REMOTE    ] HCA: Fetching primary data for 2025-01.
[2025-10-24T19:07:33.908378] [INFO ] [REMOTE    ] HBI: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T19:07:34.547686] [INFO ] [REMOTE    ] HBI: Fetching primary data for 2025-04.
[2025-10-24T19:07:34.668834] [INFO ] [REMOTE    ] HASI: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T19:07:34.677427] [INFO ] [REMOTE    ] HASI: Full fetch complete (68322 records).
[2025-10-24T19:07:34.677576] [DEBUG] [VALIDATOR ] HASI: Validating primary data.
[2025-10-24T19:07:35.100781] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present.
[2025-10-24T19:07:35.100894] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed.
[2025-10-24T19:07:35.102257] [INFO ] [MAIN      ] HASI: Fetched primary data is valid.
[2025-10-24T19:07:35.102324] [DEBUG] [LOCAL     ] HASI: Saving primary data.
[2025-10-24T19:07:35.103198] [FATAL] [LOCAL     ] HASI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:07:35.103292] [FATAL] [MAIN      ] HASI: Failed to save primary data.
[2025-10-24T19:07:35.103335] [WARN ] [MAIN      ] HASI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:07:35.103371] [INFO ] [LOCAL     ] HASI: Starting deletion of primary data.
[2025-10-24T19:07:35.103447] [DEBUG] [LOCAL     ] HASI: No primary data file found to delete.
[2025-10-24T19:07:35.103505] [INFO ] [LOCAL     ] HASI: Starting deletion of derivative data.
[2025-10-24T19:07:35.104053] [DEBUG] [LOCAL     ] HASI: Deleted derivative data file.
[2025-10-24T19:07:35.104517] [INFO ] [MAIN      ] Update Progress: 996/2366 symbols completed. HASI took 35.2s. Estimated remaining: 2h 55m 26s. Rate: 7.8 symbols/min
[2025-10-24T19:07:35.280842] [INFO ] [MAIN      ] HCC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:07:35.331345] [DEBUG] [LOCAL     ] HCC: Loaded 45253 existing records from primary storage.
[2025-10-24T19:07:35.331807] [INFO ] [MAIN      ] HCC: Loaded 45253 existing records.
[2025-10-24T19:07:35.364171] [INFO ] [REMOTE    ] HBM: Fetching primary data for 2025-02.
[2025-10-24T19:07:35.523678] [WARN ] [MAIN      ] HCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:07:35.524081] [INFO ] [MAIN      ] HCC: Wiping existing primary data before full refresh.
[2025-10-24T19:07:35.524208] [INFO ] [LOCAL     ] HCC: Starting deletion of primary data.
[2025-10-24T19:07:35.524974] [DEBUG] [LOCAL     ] HCC: Deleted primary data file.
[2025-10-24T19:07:35.525036] [INFO ] [MAIN      ] HCC: Starting full primary refresh.
[2025-10-24T19:07:35.658092] [INFO ] [REMOTE    ] HCA: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T19:07:35.927454] [INFO ] [REMOTE    ] HCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:07:35.960494] [INFO ] [REMOTE    ] HBI: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T19:07:36.147674] [INFO ] [REMOTE    ] HBI: Fetching primary data for 2025-05.
[2025-10-24T19:07:36.947710] [INFO ] [REMOTE    ] HCC: Fetching primary data for 2025-01.
[2025-10-24T19:07:36.992962] [INFO ] [REMOTE    ] HBM: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T19:07:37.747678] [INFO ] [REMOTE    ] HBM: Fetching primary data for 2025-03.
[2025-10-24T19:07:37.892536] [INFO ] [REMOTE    ] HBI: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T19:07:38.023371] [INFO ] [REMOTE    ] HCC: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T19:07:38.547671] [INFO ] [REMOTE    ] HCA: Fetching primary data for 2025-02.
[2025-10-24T19:07:39.347681] [INFO ] [REMOTE    ] HBI: Fetching primary data for 2025-06.
[2025-10-24T19:07:39.641188] [INFO ] [REMOTE    ] HBM: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T19:07:40.147683] [INFO ] [REMOTE    ] HCC: Fetching primary data for 2025-02.
[2025-10-24T19:07:40.312046] [INFO ] [REMOTE    ] HCA: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T19:07:40.568513] [INFO ] [REMOTE    ] HBI: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T19:07:40.947619] [INFO ] [REMOTE    ] HCA: Fetching primary data for 2025-03.
[2025-10-24T19:07:41.725574] [INFO ] [REMOTE    ] HCC: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T19:07:41.747600] [INFO ] [REMOTE    ] HCC: Fetching primary data for 2025-03.
[2025-10-24T19:07:42.547673] [INFO ] [REMOTE    ] HBM: Fetching primary data for 2025-04.
[2025-10-24T19:07:42.870272] [INFO ] [REMOTE    ] HCA: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T19:07:42.968204] [INFO ] [REMOTE    ] HCC: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T19:07:43.347629] [INFO ] [REMOTE    ] HCA: Fetching primary data for 2025-04.
[2025-10-24T19:07:44.147675] [INFO ] [REMOTE    ] HBI: Fetching primary data for 2025-07.
[2025-10-24T19:07:44.276554] [INFO ] [REMOTE    ] HBM: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T19:07:44.947597] [INFO ] [REMOTE    ] HBM: Fetching primary data for 2025-05.
[2025-10-24T19:07:45.291052] [INFO ] [REMOTE    ] HCA: Incremental fetch complete for 2025-04 (1.94 seconds).
[2025-10-24T19:07:45.747728] [INFO ] [REMOTE    ] HCA: Fetching primary data for 2025-05.
[2025-10-24T19:07:45.883732] [INFO ] [REMOTE    ] HBI: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T19:07:46.335433] [INFO ] [REMOTE    ] HBM: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T19:07:46.547726] [INFO ] [REMOTE    ] HBM: Fetching primary data for 2025-06.
[2025-10-24T19:07:47.347719] [INFO ] [REMOTE    ] HBI: Fetching primary data for 2025-08.
[2025-10-24T19:07:47.425597] [INFO ] [REMOTE    ] HCA: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T19:07:48.147694] [INFO ] [REMOTE    ] HCC: Fetching primary data for 2025-04.
[2025-10-24T19:07:48.332257] [INFO ] [REMOTE    ] HBM: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T19:07:48.947674] [INFO ] [REMOTE    ] HCA: Fetching primary data for 2025-06.
[2025-10-24T19:07:49.033487] [INFO ] [REMOTE    ] HBI: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T19:07:49.757601] [INFO ] [REMOTE    ] HBM: Fetching primary data for 2025-07.
[2025-10-24T19:07:49.776681] [INFO ] [REMOTE    ] HCC: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T19:07:50.536552] [INFO ] [REMOTE    ] HCA: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T19:07:50.547606] [INFO ] [REMOTE    ] HCA: Fetching primary data for 2025-07.
[2025-10-24T19:07:51.347704] [INFO ] [REMOTE    ] HCC: Fetching primary data for 2025-05.
[2025-10-24T19:07:51.716083] [INFO ] [REMOTE    ] HBM: Incremental fetch complete for 2025-07 (1.96 seconds).
[2025-10-24T19:07:52.147634] [INFO ] [REMOTE    ] HBM: Fetching primary data for 2025-08.
[2025-10-24T19:07:52.212543] [INFO ] [REMOTE    ] HCA: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T19:07:52.947678] [INFO ] [REMOTE    ] HCA: Fetching primary data for 2025-08.
[2025-10-24T19:07:53.021860] [INFO ] [REMOTE    ] HCC: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T19:07:53.747697] [INFO ] [REMOTE    ] HBI: Fetching primary data for 2025-09.
[2025-10-24T19:07:53.994737] [INFO ] [REMOTE    ] HBM: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T19:07:54.137541] [INFO ] [REMOTE    ] HCA: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T19:07:54.547632] [INFO ] [REMOTE    ] HBM: Fetching primary data for 2025-09.
[2025-10-24T19:07:55.242191] [INFO ] [REMOTE    ] HBI: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T19:07:55.347617] [INFO ] [REMOTE    ] HCC: Fetching primary data for 2025-06.
[2025-10-24T19:07:56.147636] [INFO ] [REMOTE    ] HBI: Fetching primary data for 2025-10.
[2025-10-24T19:07:56.358422] [INFO ] [REMOTE    ] HBM: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T19:07:56.934893] [INFO ] [REMOTE    ] HCC: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T19:07:56.947609] [INFO ] [REMOTE    ] HBM: Fetching primary data for 2025-10.
[2025-10-24T19:07:57.592712] [INFO ] [REMOTE    ] HBI: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T19:07:57.602194] [INFO ] [REMOTE    ] HBI: Full fetch complete (76967 records).
[2025-10-24T19:07:57.602338] [DEBUG] [VALIDATOR ] HBI: Validating primary data.
[2025-10-24T19:07:57.752544] [INFO ] [REMOTE    ] HCC: Fetching primary data for 2025-07.
[2025-10-24T19:07:57.992239] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present.
[2025-10-24T19:07:57.992329] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed.
[2025-10-24T19:07:57.993453] [INFO ] [MAIN      ] HBI: Fetched primary data is valid.
[2025-10-24T19:07:57.993524] [DEBUG] [LOCAL     ] HBI: Saving primary data.
[2025-10-24T19:07:57.994180] [FATAL] [LOCAL     ] HBI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:07:57.994282] [FATAL] [MAIN      ] HBI: Failed to save primary data.
[2025-10-24T19:07:57.994323] [WARN ] [MAIN      ] HBI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:07:57.994358] [INFO ] [LOCAL     ] HBI: Starting deletion of primary data.
[2025-10-24T19:07:57.994412] [DEBUG] [LOCAL     ] HBI: No primary data file found to delete.
[2025-10-24T19:07:57.994446] [INFO ] [LOCAL     ] HBI: Starting deletion of derivative data.
[2025-10-24T19:07:57.994583] [DEBUG] [LOCAL     ] HBI: Deleted derivative data file.
[2025-10-24T19:07:57.994877] [INFO ] [MAIN      ] Update Progress: 997/2366 symbols completed. HBI took 34.7s. Estimated remaining: 2h 55m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:07:58.547720] [INFO ] [REMOTE    ] HCA: Fetching primary data for 2025-09.
[2025-10-24T19:07:59.066013] [INFO ] [REMOTE    ] HBM: Incremental fetch complete for 2025-10 (2.12 seconds).
[2025-10-24T19:07:59.075699] [INFO ] [REMOTE    ] HBM: Full fetch complete (76752 records).
[2025-10-24T19:07:59.075822] [DEBUG] [VALIDATOR ] HBM: Validating primary data.
[2025-10-24T19:07:59.498732] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present.
[2025-10-24T19:07:59.498882] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed.
[2025-10-24T19:07:59.499990] [INFO ] [MAIN      ] HBM: Fetched primary data is valid.
[2025-10-24T19:07:59.500075] [DEBUG] [LOCAL     ] HBM: Saving primary data.
[2025-10-24T19:07:59.500742] [FATAL] [LOCAL     ] HBM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:07:59.500854] [FATAL] [MAIN      ] HBM: Failed to save primary data.
[2025-10-24T19:07:59.501063] [WARN ] [MAIN      ] HBM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:07:59.501166] [INFO ] [LOCAL     ] HBM: Starting deletion of primary data.
[2025-10-24T19:07:59.515884] [DEBUG] [LOCAL     ] HBM: No primary data file found to delete.
[2025-10-24T19:07:59.525897] [INFO ] [LOCAL     ] HBM: Starting deletion of derivative data.
[2025-10-24T19:07:59.526427] [DEBUG] [LOCAL     ] HBM: Deleted derivative data file.
[2025-10-24T19:07:59.527053] [INFO ] [MAIN      ] Update Progress: 998/2366 symbols completed. HBM took 31.0s. Estimated remaining: 2h 55m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:07:59.528205] [INFO ] [REMOTE    ] HCC: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T19:07:59.538803] [INFO ] [REMOTE    ] HCC: Fetching primary data for 2025-08.
[2025-10-24T19:08:00.238787] [INFO ] [REMOTE    ] HCA: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T19:08:00.248524] [INFO ] [REMOTE    ] HCA: Fetching primary data for 2025-10.
[2025-10-24T19:08:01.306125] [INFO ] [REMOTE    ] HCC: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T19:08:01.316159] [INFO ] [REMOTE    ] HCC: Fetching primary data for 2025-09.
[2025-10-24T19:08:01.701325] [INFO ] [REMOTE    ] HCA: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T19:08:01.710172] [INFO ] [REMOTE    ] HCA: Full fetch complete (68942 records).
[2025-10-24T19:08:01.710335] [DEBUG] [VALIDATOR ] HCA: Validating primary data.
[2025-10-24T19:08:02.121970] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present.
[2025-10-24T19:08:02.122059] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed.
[2025-10-24T19:08:02.122976] [INFO ] [MAIN      ] HCA: Fetched primary data is valid.
[2025-10-24T19:08:02.123038] [DEBUG] [LOCAL     ] HCA: Saving primary data.
[2025-10-24T19:08:02.123624] [FATAL] [LOCAL     ] HCA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:08:02.123733] [FATAL] [MAIN      ] HCA: Failed to save primary data.
[2025-10-24T19:08:02.123774] [WARN ] [MAIN      ] HCA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:08:02.123835] [INFO ] [LOCAL     ] HCA: Starting deletion of primary data.
[2025-10-24T19:08:02.123894] [DEBUG] [LOCAL     ] HCA: No primary data file found to delete.
[2025-10-24T19:08:02.123929] [INFO ] [LOCAL     ] HCA: Starting deletion of derivative data.
[2025-10-24T19:08:02.124076] [DEBUG] [LOCAL     ] HCA: Deleted derivative data file.
[2025-10-24T19:08:02.124395] [INFO ] [MAIN      ] Update Progress: 999/2366 symbols completed. HCA took 30.7s. Estimated remaining: 2h 55m 8s. Rate: 7.8 symbols/min
[2025-10-24T19:08:02.545968] [INFO ] [REMOTE    ] HCC: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T19:08:02.555475] [INFO ] [REMOTE    ] HCC: Fetching primary data for 2025-10.
[2025-10-24T19:08:04.287376] [INFO ] [REMOTE    ] HCC: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T19:08:04.295954] [INFO ] [REMOTE    ] HCC: Full fetch complete (64820 records).
[2025-10-24T19:08:04.296119] [DEBUG] [VALIDATOR ] HCC: Validating primary data.
[2025-10-24T19:08:04.699043] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present.
[2025-10-24T19:08:04.699146] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed.
[2025-10-24T19:08:04.700275] [INFO ] [MAIN      ] HCC: Fetched primary data is valid.
[2025-10-24T19:08:04.700340] [DEBUG] [LOCAL     ] HCC: Saving primary data.
[2025-10-24T19:08:04.701196] [FATAL] [LOCAL     ] HCC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:08:04.701291] [FATAL] [MAIN      ] HCC: Failed to save primary data.
[2025-10-24T19:08:04.701333] [WARN ] [MAIN      ] HCC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:08:04.701377] [INFO ] [LOCAL     ] HCC: Starting deletion of primary data.
[2025-10-24T19:08:04.701443] [DEBUG] [LOCAL     ] HCC: No primary data file found to delete.
[2025-10-24T19:08:04.701484] [INFO ] [LOCAL     ] HCC: Starting deletion of derivative data.
[2025-10-24T19:08:04.701716] [DEBUG] [LOCAL     ] HCC: Deleted derivative data file.
[2025-10-24T19:08:04.702183] [INFO ] [MAIN      ] Update Progress: 1000/2366 symbols completed. HCC took 29.6s. Estimated remaining: 2h 54m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:08:05.276313] [INFO ] [MAIN      ] HDB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:08:05.354604] [INFO ] [MAIN      ] HCI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:08:05.415312] [INFO ] [MAIN      ] HCXY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:08:05.441572] [DEBUG] [LOCAL     ] HCXY: No existing data file found in primary storage.
[2025-10-24T19:08:05.441349] [INFO ] [MAIN      ] HD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:08:05.442377] [WARN ] [MAIN      ] HCXY: No existing data found, performing full refresh instead.
[2025-10-24T19:08:05.442534] [INFO ] [MAIN      ] HCXY: Wiping existing primary data before full refresh.
[2025-10-24T19:08:05.442616] [INFO ] [LOCAL     ] HCXY: Starting deletion of primary data.
[2025-10-24T19:08:05.442829] [DEBUG] [LOCAL     ] HCXY: No primary data file found to delete.
[2025-10-24T19:08:05.443006] [INFO ] [MAIN      ] HCXY: Starting full primary refresh.
[2025-10-24T19:08:05.568725] [DEBUG] [LOCAL     ] HCI: Loaded 14149 existing records from primary storage.
[2025-10-24T19:08:05.689019] [INFO ] [MAIN      ] HCI: Loaded 14149 existing records.
[2025-10-24T19:08:05.934456] [DEBUG] [LOCAL     ] HDB: Loaded 52296 existing records from primary storage.
[2025-10-24T19:08:05.945179] [INFO ] [MAIN      ] HDB: Loaded 52296 existing records.
[2025-10-24T19:08:06.002475] [DEBUG] [LOCAL     ] HD: Loaded 53854 existing records from primary storage.
[2025-10-24T19:08:06.068171] [INFO ] [MAIN      ] HD: Loaded 53854 existing records.
[2025-10-24T19:08:06.093695] [INFO ] [REMOTE    ] HCXY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:08:06.113908] [INFO ] [REMOTE    ] HCXY: Fetching primary data for 2025-01.
[2025-10-24T19:08:06.337871] [WARN ] [MAIN      ] HCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:08:06.352466] [INFO ] [MAIN      ] HCI: Wiping existing primary data before full refresh.
[2025-10-24T19:08:06.368106] [INFO ] [LOCAL     ] HCI: Starting deletion of primary data.
[2025-10-24T19:08:06.467666] [DEBUG] [LOCAL     ] HCI: Deleted primary data file.
[2025-10-24T19:08:06.474427] [WARN ] [MAIN      ] HDB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:08:06.488079] [INFO ] [REMOTE    ] HCXY: Incremental fetch complete for 2025-01 (0.37 seconds).
[2025-10-24T19:08:06.508123] [WARN ] [MAIN      ] HD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:08:06.509162] [INFO ] [MAIN      ] HCI: Starting full primary refresh.
[2025-10-24T19:08:06.509481] [INFO ] [MAIN      ] HDB: Wiping existing primary data before full refresh.
[2025-10-24T19:08:06.509031] [INFO ] [REMOTE    ] HCXY: Fetching primary data for 2025-02.
[2025-10-24T19:08:06.531577] [INFO ] [MAIN      ] HD: Wiping existing primary data before full refresh.
[2025-10-24T19:08:06.531729] [INFO ] [LOCAL     ] HDB: Starting deletion of primary data.
[2025-10-24T19:08:06.546874] [INFO ] [LOCAL     ] HD: Starting deletion of primary data.
[2025-10-24T19:08:06.555953] [DEBUG] [LOCAL     ] HD: Deleted primary data file.
[2025-10-24T19:08:06.556188] [INFO ] [MAIN      ] HD: Starting full primary refresh.
[2025-10-24T19:08:06.568185] [DEBUG] [LOCAL     ] HDB: Deleted primary data file.
[2025-10-24T19:08:06.625535] [INFO ] [MAIN      ] HDB: Starting full primary refresh.
[2025-10-24T19:08:06.961719] [INFO ] [REMOTE    ] HCXY: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T19:08:06.998896] [INFO ] [REMOTE    ] HCXY: Fetching primary data for 2025-03.
[2025-10-24T19:08:07.480345] [INFO ] [REMOTE    ] HCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:08:07.528637] [INFO ] [REMOTE    ] HCXY: Incremental fetch complete for 2025-03 (0.53 seconds).
[2025-10-24T19:08:07.539344] [INFO ] [REMOTE    ] HCI: Fetching primary data for 2025-01.
[2025-10-24T19:08:07.540234] [INFO ] [REMOTE    ] HCXY: Fetching primary data for 2025-04.
[2025-10-24T19:08:07.584632] [INFO ] [REMOTE    ] HD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:08:07.590617] [INFO ] [REMOTE    ] HD: Fetching primary data for 2025-01.
[2025-10-24T19:08:07.656423] [INFO ] [REMOTE    ] HDB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:08:07.656752] [INFO ] [REMOTE    ] HDB: Fetching primary data for 2025-01.
[2025-10-24T19:08:07.838498] [INFO ] [REMOTE    ] HCXY: Incremental fetch complete for 2025-04 (0.30 seconds).
[2025-10-24T19:08:08.147664] [INFO ] [REMOTE    ] HCXY: Fetching primary data for 2025-05.
[2025-10-24T19:08:08.398839] [INFO ] [REMOTE    ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds).
[2025-10-24T19:08:08.499600] [INFO ] [REMOTE    ] HCI: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T19:08:08.947612] [INFO ] [REMOTE    ] HCXY: Fetching primary data for 2025-06.
[2025-10-24T19:08:09.206872] [INFO ] [REMOTE    ] HCXY: Incremental fetch complete for 2025-06 (0.26 seconds).
[2025-10-24T19:08:09.344834] [INFO ] [REMOTE    ] HDB: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T19:08:09.719970] [INFO ] [REMOTE    ] HD: Incremental fetch complete for 2025-01 (2.13 seconds).
[2025-10-24T19:08:09.747602] [INFO ] [REMOTE    ] HDB: Fetching primary data for 2025-02.
[2025-10-24T19:08:10.547634] [INFO ] [REMOTE    ] HD: Fetching primary data for 2025-02.
[2025-10-24T19:08:11.246219] [INFO ] [REMOTE    ] HDB: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T19:08:11.347608] [INFO ] [REMOTE    ] HDB: Fetching primary data for 2025-03.
[2025-10-24T19:08:12.147708] [INFO ] [REMOTE    ] HCI: Fetching primary data for 2025-02.
[2025-10-24T19:08:12.632761] [INFO ] [REMOTE    ] HD: Incremental fetch complete for 2025-02 (2.09 seconds).
[2025-10-24T19:08:12.947886] [INFO ] [REMOTE    ] HCXY: Fetching primary data for 2025-07.
[2025-10-24T19:08:12.995387] [INFO ] [REMOTE    ] HCI: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T19:08:13.242936] [INFO ] [REMOTE    ] HCXY: Incremental fetch complete for 2025-07 (0.30 seconds).
[2025-10-24T19:08:13.277406] [INFO ] [REMOTE    ] HDB: Incremental fetch complete for 2025-03 (1.93 seconds).
[2025-10-24T19:08:13.747704] [INFO ] [REMOTE    ] HD: Fetching primary data for 2025-03.
[2025-10-24T19:08:14.547698] [INFO ] [REMOTE    ] HCXY: Fetching primary data for 2025-08.
[2025-10-24T19:08:14.847080] [INFO ] [REMOTE    ] HCXY: Incremental fetch complete for 2025-08 (0.30 seconds).
[2025-10-24T19:08:15.347732] [INFO ] [REMOTE    ] HCI: Fetching primary data for 2025-03.
[2025-10-24T19:08:15.905932] [INFO ] [REMOTE    ] HD: Incremental fetch complete for 2025-03 (2.16 seconds).
[2025-10-24T19:08:16.147671] [INFO ] [REMOTE    ] HDB: Fetching primary data for 2025-04.
[2025-10-24T19:08:16.441441] [INFO ] [REMOTE    ] HCI: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T19:08:16.947728] [INFO ] [REMOTE    ] HCI: Fetching primary data for 2025-04.
[2025-10-24T19:08:17.589688] [INFO ] [REMOTE    ] HDB: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T19:08:17.747708] [INFO ] [REMOTE    ] HD: Fetching primary data for 2025-04.
[2025-10-24T19:08:17.909670] [INFO ] [REMOTE    ] HCI: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T19:08:18.547624] [INFO ] [REMOTE    ] HCI: Fetching primary data for 2025-05.
[2025-10-24T19:08:19.347733] [INFO ] [REMOTE    ] HDB: Fetching primary data for 2025-05.
[2025-10-24T19:08:19.479340] [INFO ] [REMOTE    ] HCI: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T19:08:20.006682] [INFO ] [REMOTE    ] HD: Incremental fetch complete for 2025-04 (2.26 seconds).
[2025-10-24T19:08:20.147741] [INFO ] [REMOTE    ] HD: Fetching primary data for 2025-05.
[2025-10-24T19:08:20.793483] [INFO ] [REMOTE    ] HDB: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T19:08:20.947696] [INFO ] [REMOTE    ] HCI: Fetching primary data for 2025-06.
[2025-10-24T19:08:21.747669] [INFO ] [REMOTE    ] HCXY: Fetching primary data for 2025-09.
[2025-10-24T19:08:21.931876] [INFO ] [REMOTE    ] HCI: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T19:08:21.987330] [INFO ] [REMOTE    ] HCXY: Incremental fetch complete for 2025-09 (0.24 seconds).
[2025-10-24T19:08:22.356411] [INFO ] [REMOTE    ] HD: Incremental fetch complete for 2025-05 (2.21 seconds).
[2025-10-24T19:08:22.547691] [INFO ] [REMOTE    ] HCI: Fetching primary data for 2025-07.
[2025-10-24T19:08:23.347694] [INFO ] [REMOTE    ] HDB: Fetching primary data for 2025-06.
[2025-10-24T19:08:23.516603] [INFO ] [REMOTE    ] HCI: Incremental fetch complete for 2025-07 (0.97 seconds).
[2025-10-24T19:08:24.147720] [INFO ] [REMOTE    ] HCXY: Fetching primary data for 2025-10.
[2025-10-24T19:08:24.494218] [INFO ] [REMOTE    ] HCXY: Incremental fetch complete for 2025-10 (0.35 seconds).
[2025-10-24T19:08:24.495168] [INFO ] [REMOTE    ] HCXY: Full fetch complete (514 records).
[2025-10-24T19:08:24.495243] [DEBUG] [VALIDATOR ] HCXY: Validating primary data.
[2025-10-24T19:08:24.678901] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days
[2025-10-24T19:08:24.679145] [FATAL] [MAIN      ] HCXY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:08:24.679217] [WARN ] [MAIN      ] HCXY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:08:24.679297] [INFO ] [LOCAL     ] HCXY: Starting deletion of primary data.
[2025-10-24T19:08:24.679368] [DEBUG] [LOCAL     ] HCXY: No primary data file found to delete.
[2025-10-24T19:08:24.679409] [INFO ] [LOCAL     ] HCXY: Starting deletion of derivative data.
[2025-10-24T19:08:24.679449] [DEBUG] [LOCAL     ] HCXY: No derivative data file found to delete.
[2025-10-24T19:08:24.679515] [INFO ] [MAIN      ] Update Progress: 1001/2366 symbols completed. HCXY took 20.0s. Estimated remaining: 2h 55m 2s. Rate: 7.8 symbols/min
[2025-10-24T19:08:24.855239] [INFO ] [MAIN      ] HE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:08:24.909366] [DEBUG] [LOCAL     ] HE: Loaded 49115 existing records from primary storage.
[2025-10-24T19:08:24.909819] [INFO ] [MAIN      ] HE: Loaded 49115 existing records.
[2025-10-24T19:08:24.952855] [INFO ] [REMOTE    ] HCI: Fetching primary data for 2025-08.
[2025-10-24T19:08:25.154724] [INFO ] [REMOTE    ] HDB: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T19:08:25.152365] [WARN ] [MAIN      ] HE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:08:25.165837] [INFO ] [MAIN      ] HE: Wiping existing primary data before full refresh.
[2025-10-24T19:08:25.166115] [INFO ] [LOCAL     ] HE: Starting deletion of primary data.
[2025-10-24T19:08:25.166616] [DEBUG] [LOCAL     ] HE: Deleted primary data file.
[2025-10-24T19:08:25.166737] [INFO ] [MAIN      ] HE: Starting full primary refresh.
[2025-10-24T19:08:25.549268] [INFO ] [REMOTE    ] HE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:08:25.747630] [INFO ] [REMOTE    ] HDB: Fetching primary data for 2025-07.
[2025-10-24T19:08:25.899840] [INFO ] [REMOTE    ] HCI: Incremental fetch complete for 2025-08 (0.95 seconds).
[2025-10-24T19:08:26.547747] [INFO ] [REMOTE    ] HE: Fetching primary data for 2025-01.
[2025-10-24T19:08:27.347726] [INFO ] [REMOTE    ] HCI: Fetching primary data for 2025-09.
[2025-10-24T19:08:27.524812] [INFO ] [REMOTE    ] HDB: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T19:08:28.147735] [INFO ] [REMOTE    ] HDB: Fetching primary data for 2025-08.
[2025-10-24T19:08:28.268618] [INFO ] [REMOTE    ] HCI: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T19:08:28.451254] [INFO ] [REMOTE    ] HE: Incremental fetch complete for 2025-01 (1.90 seconds).
[2025-10-24T19:08:28.947724] [INFO ] [REMOTE    ] HE: Fetching primary data for 2025-02.
[2025-10-24T19:08:29.749689] [INFO ] [REMOTE    ] HCI: Fetching primary data for 2025-10.
[2025-10-24T19:08:29.755707] [INFO ] [REMOTE    ] HDB: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T19:08:30.547712] [INFO ] [REMOTE    ] HD: Fetching primary data for 2025-06.
[2025-10-24T19:08:30.703509] [INFO ] [REMOTE    ] HE: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T19:08:30.999182] [INFO ] [REMOTE    ] HCI: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T19:08:31.002197] [INFO ] [REMOTE    ] HCI: Full fetch complete (19538 records).
[2025-10-24T19:08:31.002265] [DEBUG] [VALIDATOR ] HCI: Validating primary data.
[2025-10-24T19:08:31.349789] [INFO ] [REMOTE    ] HDB: Fetching primary data for 2025-09.
[2025-10-24T19:08:31.369148] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present.
[2025-10-24T19:08:31.369223] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed.
[2025-10-24T19:08:31.369639] [INFO ] [MAIN      ] HCI: Fetched primary data is valid.
[2025-10-24T19:08:31.369726] [DEBUG] [LOCAL     ] HCI: Saving primary data.
[2025-10-24T19:08:31.370011] [FATAL] [LOCAL     ] HCI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:08:31.370097] [FATAL] [MAIN      ] HCI: Failed to save primary data.
[2025-10-24T19:08:31.370138] [WARN ] [MAIN      ] HCI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:08:31.370175] [INFO ] [LOCAL     ] HCI: Starting deletion of primary data.
[2025-10-24T19:08:31.370222] [DEBUG] [LOCAL     ] HCI: No primary data file found to delete.
[2025-10-24T19:08:31.370255] [INFO ] [LOCAL     ] HCI: Starting deletion of derivative data.
[2025-10-24T19:08:31.370412] [DEBUG] [LOCAL     ] HCI: Deleted derivative data file.
[2025-10-24T19:08:31.370516] [INFO ] [MAIN      ] Update Progress: 1002/2366 symbols completed. HCI took 26.7s. Estimated remaining: 2h 54m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:08:31.540202] [INFO ] [MAIN      ] HEI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:08:31.570913] [DEBUG] [LOCAL     ] HEI: Loaded 30697 existing records from primary storage.
[2025-10-24T19:08:31.571167] [INFO ] [MAIN      ] HEI: Loaded 30697 existing records.
[2025-10-24T19:08:31.751373] [WARN ] [MAIN      ] HEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:08:31.751581] [INFO ] [MAIN      ] HEI: Wiping existing primary data before full refresh.
[2025-10-24T19:08:31.751629] [INFO ] [LOCAL     ] HEI: Starting deletion of primary data.
[2025-10-24T19:08:31.751916] [DEBUG] [LOCAL     ] HEI: Deleted primary data file.
[2025-10-24T19:08:31.751973] [INFO ] [MAIN      ] HEI: Starting full primary refresh.
[2025-10-24T19:08:32.113596] [INFO ] [REMOTE    ] HEI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:08:32.147624] [INFO ] [REMOTE    ] HEI: Fetching primary data for 2025-01.
[2025-10-24T19:08:32.456969] [INFO ] [REMOTE    ] HD: Incremental fetch complete for 2025-06 (1.91 seconds).
[2025-10-24T19:08:32.947681] [INFO ] [REMOTE    ] HE: Fetching primary data for 2025-03.
[2025-10-24T19:08:33.082479] [INFO ] [REMOTE    ] HDB: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T19:08:33.659230] [INFO ] [REMOTE    ] HEI: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T19:08:33.747612] [INFO ] [REMOTE    ] HEI: Fetching primary data for 2025-02.
[2025-10-24T19:08:34.524144] [INFO ] [REMOTE    ] HE: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T19:08:34.547621] [INFO ] [REMOTE    ] HE: Fetching primary data for 2025-04.
[2025-10-24T19:08:35.275575] [INFO ] [REMOTE    ] HEI: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T19:08:35.347610] [INFO ] [REMOTE    ] HD: Fetching primary data for 2025-07.
[2025-10-24T19:08:36.147669] [INFO ] [REMOTE    ] HEI: Fetching primary data for 2025-03.
[2025-10-24T19:08:36.291804] [INFO ] [REMOTE    ] HE: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T19:08:36.947739] [INFO ] [REMOTE    ] HDB: Fetching primary data for 2025-10.
[2025-10-24T19:08:37.579211] [INFO ] [REMOTE    ] HD: Incremental fetch complete for 2025-07 (2.23 seconds).
[2025-10-24T19:08:37.747676] [INFO ] [REMOTE    ] HE: Fetching primary data for 2025-05.
[2025-10-24T19:08:37.816551] [INFO ] [REMOTE    ] HEI: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T19:08:38.539768] [INFO ] [REMOTE    ] HDB: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T19:08:38.548741] [INFO ] [REMOTE    ] HEI: Fetching primary data for 2025-04.
[2025-10-24T19:08:38.551284] [INFO ] [REMOTE    ] HDB: Full fetch complete (75661 records).
[2025-10-24T19:08:38.551403] [DEBUG] [VALIDATOR ] HDB: Validating primary data.
[2025-10-24T19:08:38.970508] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present.
[2025-10-24T19:08:38.970583] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed.
[2025-10-24T19:08:38.971534] [INFO ] [MAIN      ] HDB: Fetched primary data is valid.
[2025-10-24T19:08:38.971596] [DEBUG] [LOCAL     ] HDB: Saving primary data.
[2025-10-24T19:08:38.972157] [FATAL] [LOCAL     ] HDB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:08:38.972266] [FATAL] [MAIN      ] HDB: Failed to save primary data.
[2025-10-24T19:08:38.972335] [WARN ] [MAIN      ] HDB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:08:38.972415] [INFO ] [LOCAL     ] HDB: Starting deletion of primary data.
[2025-10-24T19:08:38.972487] [DEBUG] [LOCAL     ] HDB: No primary data file found to delete.
[2025-10-24T19:08:38.972523] [INFO ] [LOCAL     ] HDB: Starting deletion of derivative data.
[2025-10-24T19:08:38.972718] [DEBUG] [LOCAL     ] HDB: Deleted derivative data file.
[2025-10-24T19:08:38.973157] [INFO ] [MAIN      ] Update Progress: 1003/2366 symbols completed. HDB took 34.3s. Estimated remaining: 2h 54m 46s. Rate: 7.8 symbols/min
[2025-10-24T19:08:39.143256] [INFO ] [MAIN      ] HEQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:08:39.153234] [DEBUG] [LOCAL     ] HEQ: Loaded 6802 existing records from primary storage.
[2025-10-24T19:08:39.153449] [INFO ] [MAIN      ] HEQ: Loaded 6802 existing records.
[2025-10-24T19:08:39.332489] [WARN ] [MAIN      ] HEQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:08:39.332774] [INFO ] [MAIN      ] HEQ: Wiping existing primary data before full refresh.
[2025-10-24T19:08:39.332905] [INFO ] [LOCAL     ] HEQ: Starting deletion of primary data.
[2025-10-24T19:08:39.333183] [DEBUG] [LOCAL     ] HEQ: Deleted primary data file.
[2025-10-24T19:08:39.333281] [INFO ] [MAIN      ] HEQ: Starting full primary refresh.
[2025-10-24T19:08:39.353662] [INFO ] [REMOTE    ] HD: Fetching primary data for 2025-08.
[2025-10-24T19:08:39.473814] [INFO ] [REMOTE    ] HE: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T19:08:39.726667] [INFO ] [REMOTE    ] HEQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:08:40.147688] [INFO ] [REMOTE    ] HE: Fetching primary data for 2025-06.
[2025-10-24T19:08:40.231331] [INFO ] [REMOTE    ] HEI: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T19:08:40.947690] [INFO ] [REMOTE    ] HEI: Fetching primary data for 2025-05.
[2025-10-24T19:08:41.612309] [INFO ] [REMOTE    ] HD: Incremental fetch complete for 2025-08 (2.26 seconds).
[2025-10-24T19:08:41.652003] [INFO ] [REMOTE    ] HE: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T19:08:41.747625] [INFO ] [REMOTE    ] HE: Fetching primary data for 2025-07.
[2025-10-24T19:08:42.482886] [INFO ] [REMOTE    ] HEI: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T19:08:42.547720] [INFO ] [REMOTE    ] HEI: Fetching primary data for 2025-06.
[2025-10-24T19:08:43.327498] [INFO ] [REMOTE    ] HE: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T19:08:43.347611] [INFO ] [REMOTE    ] HE: Fetching primary data for 2025-08.
[2025-10-24T19:08:43.964716] [INFO ] [REMOTE    ] HEI: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T19:08:44.147684] [INFO ] [REMOTE    ] HEQ: Fetching primary data for 2025-01.
[2025-10-24T19:08:44.756763] [INFO ] [REMOTE    ] HEQ: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T19:08:44.839517] [INFO ] [REMOTE    ] HE: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T19:08:44.947630] [INFO ] [REMOTE    ] HE: Fetching primary data for 2025-09.
[2025-10-24T19:08:45.747726] [INFO ] [REMOTE    ] HEQ: Fetching primary data for 2025-02.
[2025-10-24T19:08:46.350427] [INFO ] [REMOTE    ] HEQ: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T19:08:46.547673] [INFO ] [REMOTE    ] HEQ: Fetching primary data for 2025-03.
[2025-10-24T19:08:46.687703] [INFO ] [REMOTE    ] HE: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T19:08:47.216010] [INFO ] [REMOTE    ] HEQ: Incremental fetch complete for 2025-03 (0.67 seconds).
[2025-10-24T19:08:47.347673] [INFO ] [REMOTE    ] HEI: Fetching primary data for 2025-07.
[2025-10-24T19:08:48.147727] [INFO ] [REMOTE    ] HE: Fetching primary data for 2025-10.
[2025-10-24T19:08:48.644482] [INFO ] [REMOTE    ] HEI: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T19:08:48.947718] [INFO ] [REMOTE    ] HEQ: Fetching primary data for 2025-04.
[2025-10-24T19:08:49.747629] [INFO ] [REMOTE    ] HD: Fetching primary data for 2025-09.
[2025-10-24T19:08:49.846063] [INFO ] [REMOTE    ] HEQ: Incremental fetch complete for 2025-04 (0.90 seconds).
[2025-10-24T19:08:49.871397] [INFO ] [REMOTE    ] HE: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T19:08:49.880272] [INFO ] [REMOTE    ] HE: Full fetch complete (71961 records).
[2025-10-24T19:08:49.880410] [DEBUG] [VALIDATOR ] HE: Validating primary data.
[2025-10-24T19:08:50.271138] [DEBUG] [VALIDATOR ] HE: All expected trading days are present.
[2025-10-24T19:08:50.271246] [DEBUG] [VALIDATOR ] HE: Primary data validation passed.
[2025-10-24T19:08:50.272215] [INFO ] [MAIN      ] HE: Fetched primary data is valid.
[2025-10-24T19:08:50.272278] [DEBUG] [LOCAL     ] HE: Saving primary data.
[2025-10-24T19:08:50.272929] [FATAL] [LOCAL     ] HE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:08:50.273039] [FATAL] [MAIN      ] HE: Failed to save primary data.
[2025-10-24T19:08:50.273119] [WARN ] [MAIN      ] HE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:08:50.273211] [INFO ] [LOCAL     ] HE: Starting deletion of primary data.
[2025-10-24T19:08:50.273305] [DEBUG] [LOCAL     ] HE: No primary data file found to delete.
[2025-10-24T19:08:50.273369] [INFO ] [LOCAL     ] HE: Starting deletion of derivative data.
[2025-10-24T19:08:50.273538] [DEBUG] [LOCAL     ] HE: Deleted derivative data file.
[2025-10-24T19:08:50.273947] [INFO ] [MAIN      ] Update Progress: 1004/2366 symbols completed. HE took 25.6s. Estimated remaining: 2h 54m 43s. Rate: 7.8 symbols/min
[2025-10-24T19:08:50.452104] [INFO ] [MAIN      ] HESM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:08:50.497033] [DEBUG] [LOCAL     ] HESM: Loaded 48963 existing records from primary storage.
[2025-10-24T19:08:50.497355] [INFO ] [MAIN      ] HESM: Loaded 48963 existing records.
[2025-10-24T19:08:50.559101] [INFO ] [REMOTE    ] HEQ: Fetching primary data for 2025-05.
[2025-10-24T19:08:50.675998] [WARN ] [MAIN      ] HESM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:08:50.676211] [INFO ] [MAIN      ] HESM: Wiping existing primary data before full refresh.
[2025-10-24T19:08:50.676260] [INFO ] [LOCAL     ] HESM: Starting deletion of primary data.
[2025-10-24T19:08:50.676684] [DEBUG] [LOCAL     ] HESM: Deleted primary data file.
[2025-10-24T19:08:50.676743] [INFO ] [MAIN      ] HESM: Starting full primary refresh.
[2025-10-24T19:08:51.038602] [INFO ] [REMOTE    ] HESM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:08:51.240883] [INFO ] [REMOTE    ] HEQ: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T19:08:51.347605] [INFO ] [REMOTE    ] HEQ: Fetching primary data for 2025-06.
[2025-10-24T19:08:51.737993] [INFO ] [REMOTE    ] HD: Incremental fetch complete for 2025-09 (1.99 seconds).
[2025-10-24T19:08:51.917150] [INFO ] [REMOTE    ] HEQ: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T19:08:52.147639] [INFO ] [REMOTE    ] HD: Fetching primary data for 2025-10.
[2025-10-24T19:08:52.947684] [INFO ] [REMOTE    ] HESM: Fetching primary data for 2025-01.
[2025-10-24T19:08:53.747683] [INFO ] [REMOTE    ] HEI: Fetching primary data for 2025-08.
[2025-10-24T19:08:54.303172] [INFO ] [REMOTE    ] HD: Incremental fetch complete for 2025-10 (2.16 seconds).
[2025-10-24T19:08:54.312860] [INFO ] [REMOTE    ] HD: Full fetch complete (77544 records).
[2025-10-24T19:08:54.312988] [DEBUG] [VALIDATOR ] HD: Validating primary data.
[2025-10-24T19:08:54.554238] [INFO ] [REMOTE    ] HEQ: Fetching primary data for 2025-07.
[2025-10-24T19:08:54.667404] [INFO ] [REMOTE    ] HESM: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T19:08:54.757562] [DEBUG] [VALIDATOR ] HD: All expected trading days are present.
[2025-10-24T19:08:54.757681] [DEBUG] [VALIDATOR ] HD: Primary data validation passed.
[2025-10-24T19:08:54.758679] [INFO ] [MAIN      ] HD: Fetched primary data is valid.
[2025-10-24T19:08:54.758742] [DEBUG] [LOCAL     ] HD: Saving primary data.
[2025-10-24T19:08:54.759370] [FATAL] [LOCAL     ] HD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:08:54.759462] [FATAL] [MAIN      ] HD: Failed to save primary data.
[2025-10-24T19:08:54.759505] [WARN ] [MAIN      ] HD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:08:54.759542] [INFO ] [LOCAL     ] HD: Starting deletion of primary data.
[2025-10-24T19:08:54.759613] [DEBUG] [LOCAL     ] HD: No primary data file found to delete.
[2025-10-24T19:08:54.759716] [INFO ] [LOCAL     ] HD: Starting deletion of derivative data.
[2025-10-24T19:08:54.760109] [DEBUG] [LOCAL     ] HD: Deleted derivative data file.
[2025-10-24T19:08:54.760471] [INFO ] [MAIN      ] Update Progress: 1005/2366 symbols completed. HD took 50.0s. Estimated remaining: 2h 54m 31s. Rate: 7.8 symbols/min
[2025-10-24T19:08:54.929965] [INFO ] [MAIN      ] HF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:08:54.930129] [DEBUG] [LOCAL     ] HF: No existing data file found in primary storage.
[2025-10-24T19:08:54.930168] [WARN ] [MAIN      ] HF: No existing data found, performing full refresh instead.
[2025-10-24T19:08:54.930285] [INFO ] [MAIN      ] HF: Wiping existing primary data before full refresh.
[2025-10-24T19:08:54.930349] [INFO ] [LOCAL     ] HF: Starting deletion of primary data.
[2025-10-24T19:08:54.930417] [DEBUG] [LOCAL     ] HF: No primary data file found to delete.
[2025-10-24T19:08:54.930462] [INFO ] [MAIN      ] HF: Starting full primary refresh.
[2025-10-24T19:08:55.305594] [INFO ] [REMOTE    ] HF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:08:55.328864] [INFO ] [REMOTE    ] HEQ: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T19:08:55.331581] [INFO ] [REMOTE    ] HEI: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T19:08:55.347600] [INFO ] [REMOTE    ] HEQ: Fetching primary data for 2025-08.
[2025-10-24T19:08:55.937461] [INFO ] [REMOTE    ] HEQ: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T19:08:56.147638] [INFO ] [REMOTE    ] HEI: Fetching primary data for 2025-09.
[2025-10-24T19:08:56.947719] [INFO ] [REMOTE    ] HESM: Fetching primary data for 2025-02.
[2025-10-24T19:08:57.465608] [INFO ] [REMOTE    ] HEI: Incremental fetch complete for 2025-09 (1.32 seconds).
[2025-10-24T19:08:57.747620] [INFO ] [REMOTE    ] HEI: Fetching primary data for 2025-10.
[2025-10-24T19:08:58.481013] [INFO ] [REMOTE    ] HESM: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T19:08:58.547599] [INFO ] [REMOTE    ] HESM: Fetching primary data for 2025-03.
[2025-10-24T19:08:59.024584] [INFO ] [REMOTE    ] HEI: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T19:08:59.029421] [INFO ] [REMOTE    ] HEI: Full fetch complete (46973 records).
[2025-10-24T19:08:59.029552] [DEBUG] [VALIDATOR ] HEI: Validating primary data.
[2025-10-24T19:08:59.352836] [INFO ] [REMOTE    ] HF: Fetching primary data for 2025-01.
[2025-10-24T19:08:59.468465] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present.
[2025-10-24T19:08:59.468558] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed.
[2025-10-24T19:08:59.469517] [INFO ] [MAIN      ] HEI: Fetched primary data is valid.
[2025-10-24T19:08:59.469586] [DEBUG] [LOCAL     ] HEI: Saving primary data.
[2025-10-24T19:08:59.470160] [FATAL] [LOCAL     ] HEI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:08:59.470264] [FATAL] [MAIN      ] HEI: Failed to save primary data.
[2025-10-24T19:08:59.470314] [WARN ] [MAIN      ] HEI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:08:59.470355] [INFO ] [LOCAL     ] HEI: Starting deletion of primary data.
[2025-10-24T19:08:59.470417] [DEBUG] [LOCAL     ] HEI: No primary data file found to delete.
[2025-10-24T19:08:59.470463] [INFO ] [LOCAL     ] HEI: Starting deletion of derivative data.
[2025-10-24T19:08:59.470691] [DEBUG] [LOCAL     ] HEI: Deleted derivative data file.
[2025-10-24T19:08:59.471206] [INFO ] [MAIN      ] Update Progress: 1006/2366 symbols completed. HEI took 28.1s. Estimated remaining: 2h 54m 19s. Rate: 7.8 symbols/min
[2025-10-24T19:08:59.696096] [INFO ] [MAIN      ] HFND: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:08:59.696315] [DEBUG] [LOCAL     ] HFND: No existing data file found in primary storage.
[2025-10-24T19:08:59.696375] [WARN ] [MAIN      ] HFND: No existing data found, performing full refresh instead.
[2025-10-24T19:08:59.696525] [INFO ] [MAIN      ] HFND: Wiping existing primary data before full refresh.
[2025-10-24T19:08:59.696585] [INFO ] [LOCAL     ] HFND: Starting deletion of primary data.
[2025-10-24T19:08:59.696683] [DEBUG] [LOCAL     ] HFND: No primary data file found to delete.
[2025-10-24T19:08:59.696752] [INFO ] [MAIN      ] HFND: Starting full primary refresh.
[2025-10-24T19:08:59.753302] [INFO ] [REMOTE    ] HF: Incremental fetch complete for 2025-01 (0.40 seconds).
[2025-10-24T19:09:00.151621] [INFO ] [REMOTE    ] HEQ: Fetching primary data for 2025-09.
[2025-10-24T19:09:00.174515] [INFO ] [REMOTE    ] HFND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:09:00.255612] [INFO ] [REMOTE    ] HESM: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T19:09:00.947696] [INFO ] [REMOTE    ] HF: Fetching primary data for 2025-02.
[2025-10-24T19:09:01.081859] [INFO ] [REMOTE    ] HEQ: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T19:09:01.285302] [INFO ] [REMOTE    ] HF: Incremental fetch complete for 2025-02 (0.34 seconds).
[2025-10-24T19:09:01.747636] [INFO ] [REMOTE    ] HF: Fetching primary data for 2025-03.
[2025-10-24T19:09:02.092625] [INFO ] [REMOTE    ] HF: Incremental fetch complete for 2025-03 (0.34 seconds).
[2025-10-24T19:09:02.550206] [INFO ] [REMOTE    ] HEQ: Fetching primary data for 2025-10.
[2025-10-24T19:09:03.347630] [INFO ] [REMOTE    ] HFND: Fetching primary data for 2025-01.
[2025-10-24T19:09:03.462498] [INFO ] [REMOTE    ] HEQ: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T19:09:03.464812] [INFO ] [REMOTE    ] HEQ: Full fetch complete (9605 records).
[2025-10-24T19:09:03.464885] [DEBUG] [VALIDATOR ] HEQ: Validating primary data.
[2025-10-24T19:09:03.742180] [INFO ] [REMOTE    ] HFND: Incremental fetch complete for 2025-01 (0.39 seconds).
[2025-10-24T19:09:03.845855] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present.
[2025-10-24T19:09:03.845935] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed.
[2025-10-24T19:09:03.846210] [INFO ] [MAIN      ] HEQ: Fetched primary data is valid.
[2025-10-24T19:09:03.846250] [DEBUG] [LOCAL     ] HEQ: Saving primary data.
[2025-10-24T19:09:03.846462] [FATAL] [LOCAL     ] HEQ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:09:03.846541] [FATAL] [MAIN      ] HEQ: Failed to save primary data.
[2025-10-24T19:09:03.846582] [WARN ] [MAIN      ] HEQ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:09:03.846615] [INFO ] [LOCAL     ] HEQ: Starting deletion of primary data.
[2025-10-24T19:09:03.846693] [DEBUG] [LOCAL     ] HEQ: No primary data file found to delete.
[2025-10-24T19:09:03.846765] [INFO ] [LOCAL     ] HEQ: Starting deletion of derivative data.
[2025-10-24T19:09:03.846940] [DEBUG] [LOCAL     ] HEQ: Deleted derivative data file.
[2025-10-24T19:09:03.847028] [INFO ] [MAIN      ] Update Progress: 1007/2366 symbols completed. HEQ took 24.9s. Estimated remaining: 2h 54m 7s. Rate: 7.8 symbols/min
[2025-10-24T19:09:04.012757] [INFO ] [MAIN      ] HFRO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:09:04.030573] [DEBUG] [LOCAL     ] HFRO: Loaded 16411 existing records from primary storage.
[2025-10-24T19:09:04.030843] [INFO ] [MAIN      ] HFRO: Loaded 16411 existing records.
[2025-10-24T19:09:04.152819] [INFO ] [REMOTE    ] HESM: Fetching primary data for 2025-04.
[2025-10-24T19:09:04.214828] [WARN ] [MAIN      ] HFRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:09:04.215023] [INFO ] [MAIN      ] HFRO: Wiping existing primary data before full refresh.
[2025-10-24T19:09:04.215069] [INFO ] [LOCAL     ] HFRO: Starting deletion of primary data.
[2025-10-24T19:09:04.215297] [DEBUG] [LOCAL     ] HFRO: Deleted primary data file.
[2025-10-24T19:09:04.215352] [INFO ] [MAIN      ] HFRO: Starting full primary refresh.
[2025-10-24T19:09:04.577144] [INFO ] [REMOTE    ] HFRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:09:04.947678] [INFO ] [REMOTE    ] HF: Fetching primary data for 2025-04.
[2025-10-24T19:09:05.197427] [INFO ] [REMOTE    ] HF: Incremental fetch complete for 2025-04 (0.25 seconds).
[2025-10-24T19:09:05.747688] [INFO ] [REMOTE    ] HF: Fetching primary data for 2025-05.
[2025-10-24T19:09:05.961317] [INFO ] [REMOTE    ] HESM: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T19:09:05.973814] [INFO ] [REMOTE    ] HF: Incremental fetch complete for 2025-05 (0.23 seconds).
[2025-10-24T19:09:06.547639] [INFO ] [REMOTE    ] HFND: Fetching primary data for 2025-02.
[2025-10-24T19:09:06.974176] [INFO ] [REMOTE    ] HFND: Incremental fetch complete for 2025-02 (0.43 seconds).
[2025-10-24T19:09:07.347697] [INFO ] [REMOTE    ] HFND: Fetching primary data for 2025-03.
[2025-10-24T19:09:07.769854] [INFO ] [REMOTE    ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds).
[2025-10-24T19:09:08.147681] [INFO ] [REMOTE    ] HFND: Fetching primary data for 2025-04.
[2025-10-24T19:09:08.560545] [INFO ] [REMOTE    ] HFND: Incremental fetch complete for 2025-04 (0.41 seconds).
[2025-10-24T19:09:08.947668] [INFO ] [REMOTE    ] HFND: Fetching primary data for 2025-05.
[2025-10-24T19:09:09.267816] [INFO ] [REMOTE    ] HFND: Incremental fetch complete for 2025-05 (0.32 seconds).
[2025-10-24T19:09:09.747620] [INFO ] [REMOTE    ] HESM: Fetching primary data for 2025-05.
[2025-10-24T19:09:10.547761] [INFO ] [REMOTE    ] HF: Fetching primary data for 2025-06.
[2025-10-24T19:09:10.796951] [INFO ] [REMOTE    ] HF: Incremental fetch complete for 2025-06 (0.25 seconds).
[2025-10-24T19:09:11.351690] [INFO ] [REMOTE    ] HFND: Fetching primary data for 2025-06.
[2025-10-24T19:09:11.354680] [INFO ] [REMOTE    ] HESM: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T19:09:11.685210] [INFO ] [REMOTE    ] HFND: Incremental fetch complete for 2025-06 (0.33 seconds).
[2025-10-24T19:09:12.147680] [INFO ] [REMOTE    ] HESM: Fetching primary data for 2025-06.
[2025-10-24T19:09:12.947686] [INFO ] [REMOTE    ] HFRO: Fetching primary data for 2025-01.
[2025-10-24T19:09:13.747677] [INFO ] [REMOTE    ] HFND: Fetching primary data for 2025-07.
[2025-10-24T19:09:13.870592] [INFO ] [REMOTE    ] HESM: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T19:09:14.017697] [INFO ] [REMOTE    ] HFND: Incremental fetch complete for 2025-07 (0.27 seconds).
[2025-10-24T19:09:14.103433] [INFO ] [REMOTE    ] HFRO: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T19:09:14.547639] [INFO ] [REMOTE    ] HFND: Fetching primary data for 2025-08.
[2025-10-24T19:09:14.969385] [INFO ] [REMOTE    ] HFND: Incremental fetch complete for 2025-08 (0.42 seconds).
[2025-10-24T19:09:15.347667] [INFO ] [REMOTE    ] HESM: Fetching primary data for 2025-07.
[2025-10-24T19:09:16.147728] [INFO ] [REMOTE    ] HFRO: Fetching primary data for 2025-02.
[2025-10-24T19:09:16.947626] [INFO ] [REMOTE    ] HFND: Fetching primary data for 2025-09.
[2025-10-24T19:09:17.146121] [INFO ] [REMOTE    ] HESM: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T19:09:17.187336] [INFO ] [REMOTE    ] HFRO: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T19:09:17.243923] [INFO ] [REMOTE    ] HFND: Incremental fetch complete for 2025-09 (0.30 seconds).
[2025-10-24T19:09:17.747676] [INFO ] [REMOTE    ] HFND: Fetching primary data for 2025-10.
[2025-10-24T19:09:18.232144] [INFO ] [REMOTE    ] HFND: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T19:09:18.232978] [INFO ] [REMOTE    ] HFND: Full fetch complete (1767 records).
[2025-10-24T19:09:18.233050] [DEBUG] [VALIDATOR ] HFND: Validating primary data.
[2025-10-24T19:09:18.423163] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days
[2025-10-24T19:09:18.423377] [FATAL] [MAIN      ] HFND: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:09:18.423449] [WARN ] [MAIN      ] HFND: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:09:18.423525] [INFO ] [LOCAL     ] HFND: Starting deletion of primary data.
[2025-10-24T19:09:18.423594] [DEBUG] [LOCAL     ] HFND: No primary data file found to delete.
[2025-10-24T19:09:18.423633] [INFO ] [LOCAL     ] HFND: Starting deletion of derivative data.
[2025-10-24T19:09:18.423719] [DEBUG] [LOCAL     ] HFND: No derivative data file found to delete.
[2025-10-24T19:09:18.423785] [INFO ] [MAIN      ] Update Progress: 1008/2366 symbols completed. HFND took 19.0s. Estimated remaining: 2h 54m 8s. Rate: 7.8 symbols/min
[2025-10-24T19:09:18.552748] [INFO ] [REMOTE    ] HFRO: Fetching primary data for 2025-03.
[2025-10-24T19:09:18.607224] [INFO ] [MAIN      ] HGER: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:09:18.624885] [DEBUG] [LOCAL     ] HGER: Loaded 15736 existing records from primary storage.
[2025-10-24T19:09:18.625135] [INFO ] [MAIN      ] HGER: Loaded 15736 existing records.
[2025-10-24T19:09:18.797962] [WARN ] [MAIN      ] HGER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:09:18.798185] [INFO ] [MAIN      ] HGER: Wiping existing primary data before full refresh.
[2025-10-24T19:09:18.798233] [INFO ] [LOCAL     ] HGER: Starting deletion of primary data.
[2025-10-24T19:09:18.798395] [DEBUG] [LOCAL     ] HGER: Deleted primary data file.
[2025-10-24T19:09:18.798434] [INFO ] [MAIN      ] HGER: Starting full primary refresh.
[2025-10-24T19:09:19.141938] [INFO ] [REMOTE    ] HGER: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:09:19.347620] [INFO ] [REMOTE    ] HGER: Fetching primary data for 2025-01.
[2025-10-24T19:09:19.683463] [INFO ] [REMOTE    ] HFRO: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T19:09:20.138463] [INFO ] [REMOTE    ] HGER: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T19:09:20.147609] [INFO ] [REMOTE    ] HGER: Fetching primary data for 2025-02.
[2025-10-24T19:09:20.752428] [INFO ] [REMOTE    ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T19:09:20.947686] [INFO ] [REMOTE    ] HESM: Fetching primary data for 2025-08.
[2025-10-24T19:09:21.747715] [INFO ] [REMOTE    ] HGER: Fetching primary data for 2025-03.
[2025-10-24T19:09:22.544073] [INFO ] [REMOTE    ] HGER: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T19:09:22.547639] [INFO ] [REMOTE    ] HGER: Fetching primary data for 2025-04.
[2025-10-24T19:09:22.667481] [INFO ] [REMOTE    ] HESM: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T19:09:23.326230] [INFO ] [REMOTE    ] HGER: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T19:09:23.347597] [INFO ] [REMOTE    ] HGER: Fetching primary data for 2025-05.
[2025-10-24T19:09:24.147726] [INFO ] [REMOTE    ] HF: Fetching primary data for 2025-07.
[2025-10-24T19:09:24.168964] [INFO ] [REMOTE    ] HGER: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T19:09:24.554502] [INFO ] [REMOTE    ] HF: Incremental fetch complete for 2025-07 (0.41 seconds).
[2025-10-24T19:09:24.947687] [INFO ] [REMOTE    ] HESM: Fetching primary data for 2025-09.
[2025-10-24T19:09:25.747690] [INFO ] [REMOTE    ] HFRO: Fetching primary data for 2025-04.
[2025-10-24T19:09:26.523483] [INFO ] [REMOTE    ] HESM: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T19:09:26.547594] [INFO ] [REMOTE    ] HESM: Fetching primary data for 2025-10.
[2025-10-24T19:09:26.881050] [INFO ] [REMOTE    ] HFRO: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T19:09:27.347632] [INFO ] [REMOTE    ] HFRO: Fetching primary data for 2025-05.
[2025-10-24T19:09:28.147695] [INFO ] [REMOTE    ] HF: Fetching primary data for 2025-08.
[2025-10-24T19:09:28.238850] [INFO ] [REMOTE    ] HESM: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T19:09:28.249317] [INFO ] [REMOTE    ] HESM: Full fetch complete (70000 records).
[2025-10-24T19:09:28.249507] [DEBUG] [VALIDATOR ] HESM: Validating primary data.
[2025-10-24T19:09:28.383285] [INFO ] [REMOTE    ] HF: Incremental fetch complete for 2025-08 (0.24 seconds).
[2025-10-24T19:09:28.433416] [INFO ] [REMOTE    ] HFRO: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T19:09:28.709835] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present.
[2025-10-24T19:09:28.709920] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed.
[2025-10-24T19:09:28.710966] [INFO ] [MAIN      ] HESM: Fetched primary data is valid.
[2025-10-24T19:09:28.711034] [DEBUG] [LOCAL     ] HESM: Saving primary data.
[2025-10-24T19:09:28.711677] [FATAL] [LOCAL     ] HESM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:09:28.711770] [FATAL] [MAIN      ] HESM: Failed to save primary data.
[2025-10-24T19:09:28.711837] [WARN ] [MAIN      ] HESM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:09:28.711874] [INFO ] [LOCAL     ] HESM: Starting deletion of primary data.
[2025-10-24T19:09:28.711929] [DEBUG] [LOCAL     ] HESM: No primary data file found to delete.
[2025-10-24T19:09:28.711964] [INFO ] [LOCAL     ] HESM: Starting deletion of derivative data.
[2025-10-24T19:09:28.712343] [DEBUG] [LOCAL     ] HESM: Deleted derivative data file.
[2025-10-24T19:09:28.712821] [INFO ] [MAIN      ] Update Progress: 1009/2366 symbols completed. HESM took 38.4s. Estimated remaining: 2h 54m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:09:28.905157] [INFO ] [MAIN      ] HGLB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:09:28.917181] [DEBUG] [LOCAL     ] HGLB: Loaded 9671 existing records from primary storage.
[2025-10-24T19:09:28.917380] [INFO ] [MAIN      ] HGLB: Loaded 9671 existing records.
[2025-10-24T19:09:28.952785] [INFO ] [REMOTE    ] HF: Fetching primary data for 2025-09.
[2025-10-24T19:09:29.108156] [WARN ] [MAIN      ] HGLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:09:29.108352] [INFO ] [MAIN      ] HGLB: Wiping existing primary data before full refresh.
[2025-10-24T19:09:29.108397] [INFO ] [LOCAL     ] HGLB: Starting deletion of primary data.
[2025-10-24T19:09:29.108553] [DEBUG] [LOCAL     ] HGLB: Deleted primary data file.
[2025-10-24T19:09:29.108590] [INFO ] [MAIN      ] HGLB: Starting full primary refresh.
[2025-10-24T19:09:29.317860] [INFO ] [REMOTE    ] HF: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T19:09:29.460694] [INFO ] [REMOTE    ] HGLB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:09:29.747614] [INFO ] [REMOTE    ] HGLB: Fetching primary data for 2025-01.
[2025-10-24T19:09:30.463093] [INFO ] [REMOTE    ] HGLB: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T19:09:30.547708] [INFO ] [REMOTE    ] HGER: Fetching primary data for 2025-06.
[2025-10-24T19:09:31.281775] [INFO ] [REMOTE    ] HGER: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T19:09:31.347747] [INFO ] [REMOTE    ] HF: Fetching primary data for 2025-10.
[2025-10-24T19:09:31.727553] [INFO ] [REMOTE    ] HF: Incremental fetch complete for 2025-10 (0.38 seconds).
[2025-10-24T19:09:31.728231] [INFO ] [REMOTE    ] HF: Full fetch complete (421 records).
[2025-10-24T19:09:31.728298] [DEBUG] [VALIDATOR ] HF: Validating primary data.
[2025-10-24T19:09:31.900362] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days
[2025-10-24T19:09:31.900585] [FATAL] [MAIN      ] HF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:09:31.900701] [WARN ] [MAIN      ] HF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:09:31.900794] [INFO ] [LOCAL     ] HF: Starting deletion of primary data.
[2025-10-24T19:09:31.900873] [DEBUG] [LOCAL     ] HF: No primary data file found to delete.
[2025-10-24T19:09:31.900911] [INFO ] [LOCAL     ] HF: Starting deletion of derivative data.
[2025-10-24T19:09:31.900952] [DEBUG] [LOCAL     ] HF: No derivative data file found to delete.
[2025-10-24T19:09:31.901007] [INFO ] [MAIN      ] Update Progress: 1010/2366 symbols completed. HF took 37.1s. Estimated remaining: 2h 53m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:09:32.086798] [INFO ] [MAIN      ] HGTY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:09:32.103435] [DEBUG] [LOCAL     ] HGTY: Loaded 13442 existing records from primary storage.
[2025-10-24T19:09:32.103697] [INFO ] [MAIN      ] HGTY: Loaded 13442 existing records.
[2025-10-24T19:09:32.152879] [INFO ] [REMOTE    ] HFRO: Fetching primary data for 2025-06.
[2025-10-24T19:09:32.306696] [WARN ] [MAIN      ] HGTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:09:32.306984] [INFO ] [MAIN      ] HGTY: Wiping existing primary data before full refresh.
[2025-10-24T19:09:32.307038] [INFO ] [LOCAL     ] HGTY: Starting deletion of primary data.
[2025-10-24T19:09:32.307250] [DEBUG] [LOCAL     ] HGTY: Deleted primary data file.
[2025-10-24T19:09:32.307306] [INFO ] [MAIN      ] HGTY: Starting full primary refresh.
[2025-10-24T19:09:32.681379] [INFO ] [REMOTE    ] HGTY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:09:32.947630] [INFO ] [REMOTE    ] HGTY: Fetching primary data for 2025-01.
[2025-10-24T19:09:33.237968] [INFO ] [REMOTE    ] HFRO: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T19:09:33.678107] [INFO ] [REMOTE    ] HGTY: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T19:09:33.747638] [INFO ] [REMOTE    ] HGTY: Fetching primary data for 2025-02.
[2025-10-24T19:09:34.453860] [INFO ] [REMOTE    ] HGTY: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T19:09:34.547695] [INFO ] [REMOTE    ] HGER: Fetching primary data for 2025-07.
[2025-10-24T19:09:35.347631] [INFO ] [REMOTE    ] HGLB: Fetching primary data for 2025-02.
[2025-10-24T19:09:35.467708] [INFO ] [REMOTE    ] HGER: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T19:09:36.147627] [INFO ] [REMOTE    ] HGTY: Fetching primary data for 2025-03.
[2025-10-24T19:09:36.184829] [INFO ] [REMOTE    ] HGLB: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T19:09:36.874618] [INFO ] [REMOTE    ] HGTY: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T19:09:36.947691] [INFO ] [REMOTE    ] HGLB: Fetching primary data for 2025-03.
[2025-10-24T19:09:37.751001] [INFO ] [REMOTE    ] HGER: Fetching primary data for 2025-08.
[2025-10-24T19:09:37.752935] [INFO ] [REMOTE    ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T19:09:38.547672] [INFO ] [REMOTE    ] HFRO: Fetching primary data for 2025-07.
[2025-10-24T19:09:38.669781] [INFO ] [REMOTE    ] HGER: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T19:09:39.347612] [INFO ] [REMOTE    ] HGTY: Fetching primary data for 2025-04.
[2025-10-24T19:09:39.584716] [INFO ] [REMOTE    ] HFRO: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T19:09:40.137293] [INFO ] [REMOTE    ] HGTY: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T19:09:40.147609] [INFO ] [REMOTE    ] HGTY: Fetching primary data for 2025-05.
[2025-10-24T19:09:40.918328] [INFO ] [REMOTE    ] HGTY: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T19:09:40.947618] [INFO ] [REMOTE    ] HGER: Fetching primary data for 2025-09.
[2025-10-24T19:09:41.747701] [INFO ] [REMOTE    ] HGLB: Fetching primary data for 2025-04.
[2025-10-24T19:09:42.044815] [INFO ] [REMOTE    ] HGER: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T19:09:42.547684] [INFO ] [REMOTE    ] HGER: Fetching primary data for 2025-10.
[2025-10-24T19:09:42.646296] [INFO ] [REMOTE    ] HGLB: Incremental fetch complete for 2025-04 (0.90 seconds).
[2025-10-24T19:09:43.347678] [INFO ] [REMOTE    ] HGTY: Fetching primary data for 2025-06.
[2025-10-24T19:09:43.887836] [INFO ] [REMOTE    ] HGER: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T19:09:43.892906] [INFO ] [REMOTE    ] HGER: Full fetch complete (19323 records).
[2025-10-24T19:09:43.892990] [DEBUG] [VALIDATOR ] HGER: Validating primary data.
[2025-10-24T19:09:44.149073] [INFO ] [REMOTE    ] HFRO: Fetching primary data for 2025-08.
[2025-10-24T19:09:44.186762] [INFO ] [REMOTE    ] HGTY: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T19:09:44.282084] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present.
[2025-10-24T19:09:44.282157] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed.
[2025-10-24T19:09:44.282548] [INFO ] [MAIN      ] HGER: Fetched primary data is valid.
[2025-10-24T19:09:44.282607] [DEBUG] [LOCAL     ] HGER: Saving primary data.
[2025-10-24T19:09:44.282876] [FATAL] [LOCAL     ] HGER: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:09:44.282957] [FATAL] [MAIN      ] HGER: Failed to save primary data.
[2025-10-24T19:09:44.282999] [WARN ] [MAIN      ] HGER: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:09:44.283032] [INFO ] [LOCAL     ] HGER: Starting deletion of primary data.
[2025-10-24T19:09:44.283081] [DEBUG] [LOCAL     ] HGER: No primary data file found to delete.
[2025-10-24T19:09:44.283114] [INFO ] [LOCAL     ] HGER: Starting deletion of derivative data.
[2025-10-24T19:09:44.283221] [DEBUG] [LOCAL     ] HGER: Deleted derivative data file.
[2025-10-24T19:09:44.283287] [INFO ] [MAIN      ] Update Progress: 1011/2366 symbols completed. HGER took 25.9s. Estimated remaining: 2h 53m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:09:44.452259] [INFO ] [MAIN      ] HGV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:09:44.494205] [DEBUG] [LOCAL     ] HGV: Loaded 46371 existing records from primary storage.
[2025-10-24T19:09:44.494487] [INFO ] [MAIN      ] HGV: Loaded 46371 existing records.
[2025-10-24T19:09:44.672600] [WARN ] [MAIN      ] HGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:09:44.673047] [INFO ] [MAIN      ] HGV: Wiping existing primary data before full refresh.
[2025-10-24T19:09:44.673100] [INFO ] [LOCAL     ] HGV: Starting deletion of primary data.
[2025-10-24T19:09:44.673540] [DEBUG] [LOCAL     ] HGV: Deleted primary data file.
[2025-10-24T19:09:44.673596] [INFO ] [MAIN      ] HGV: Starting full primary refresh.
[2025-10-24T19:09:44.950525] [INFO ] [REMOTE    ] HGTY: Fetching primary data for 2025-07.
[2025-10-24T19:09:45.036240] [INFO ] [REMOTE    ] HGV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:09:45.255508] [INFO ] [REMOTE    ] HFRO: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T19:09:45.747697] [INFO ] [REMOTE    ] HGLB: Fetching primary data for 2025-05.
[2025-10-24T19:09:45.766408] [INFO ] [REMOTE    ] HGTY: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T19:09:46.460236] [INFO ] [REMOTE    ] HGLB: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T19:09:46.547677] [INFO ] [REMOTE    ] HGLB: Fetching primary data for 2025-06.
[2025-10-24T19:09:47.233540] [INFO ] [REMOTE    ] HGLB: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T19:09:47.347689] [INFO ] [REMOTE    ] HGV: Fetching primary data for 2025-01.
[2025-10-24T19:09:48.147709] [INFO ] [REMOTE    ] HFRO: Fetching primary data for 2025-09.
[2025-10-24T19:09:48.733696] [INFO ] [REMOTE    ] HGV: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T19:09:48.947688] [INFO ] [REMOTE    ] HGTY: Fetching primary data for 2025-08.
[2025-10-24T19:09:49.123079] [INFO ] [REMOTE    ] HFRO: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T19:09:49.747677] [INFO ] [REMOTE    ] HFRO: Fetching primary data for 2025-10.
[2025-10-24T19:09:50.046479] [INFO ] [REMOTE    ] HGTY: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T19:09:50.547616] [INFO ] [REMOTE    ] HGV: Fetching primary data for 2025-02.
[2025-10-24T19:09:50.794871] [INFO ] [REMOTE    ] HFRO: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T19:09:50.797470] [INFO ] [REMOTE    ] HFRO: Full fetch complete (26592 records).
[2025-10-24T19:09:50.797545] [DEBUG] [VALIDATOR ] HFRO: Validating primary data.
[2025-10-24T19:09:51.155852] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present.
[2025-10-24T19:09:51.155933] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed.
[2025-10-24T19:09:51.156455] [INFO ] [MAIN      ] HFRO: Fetched primary data is valid.
[2025-10-24T19:09:51.156494] [DEBUG] [LOCAL     ] HFRO: Saving primary data.
[2025-10-24T19:09:51.156855] [FATAL] [LOCAL     ] HFRO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:09:51.156949] [FATAL] [MAIN      ] HFRO: Failed to save primary data.
[2025-10-24T19:09:51.156991] [WARN ] [MAIN      ] HFRO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:09:51.157025] [INFO ] [LOCAL     ] HFRO: Starting deletion of primary data.
[2025-10-24T19:09:51.157077] [DEBUG] [LOCAL     ] HFRO: No primary data file found to delete.
[2025-10-24T19:09:51.157111] [INFO ] [LOCAL     ] HFRO: Starting deletion of derivative data.
[2025-10-24T19:09:51.157300] [DEBUG] [LOCAL     ] HFRO: Deleted derivative data file.
[2025-10-24T19:09:51.157389] [INFO ] [MAIN      ] Update Progress: 1012/2366 symbols completed. HFRO took 47.3s. Estimated remaining: 2h 53m 40s. Rate: 7.8 symbols/min
[2025-10-24T19:09:51.325559] [INFO ] [MAIN      ] HHH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:09:51.348304] [INFO ] [REMOTE    ] HGTY: Fetching primary data for 2025-09.
[2025-10-24T19:09:51.359266] [DEBUG] [LOCAL     ] HHH: Loaded 33222 existing records from primary storage.
[2025-10-24T19:09:51.359541] [INFO ] [MAIN      ] HHH: Loaded 33222 existing records.
[2025-10-24T19:09:51.536950] [WARN ] [MAIN      ] HHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:09:51.537201] [INFO ] [MAIN      ] HHH: Wiping existing primary data before full refresh.
[2025-10-24T19:09:51.537260] [INFO ] [LOCAL     ] HHH: Starting deletion of primary data.
[2025-10-24T19:09:51.537616] [DEBUG] [LOCAL     ] HHH: Deleted primary data file.
[2025-10-24T19:09:51.537709] [INFO ] [MAIN      ] HHH: Starting full primary refresh.
[2025-10-24T19:09:51.901710] [INFO ] [REMOTE    ] HHH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:09:51.930896] [INFO ] [REMOTE    ] HGV: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T19:09:52.147723] [INFO ] [REMOTE    ] HGV: Fetching primary data for 2025-03.
[2025-10-24T19:09:52.388531] [INFO ] [REMOTE    ] HGTY: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T19:09:52.947714] [INFO ] [REMOTE    ] HHH: Fetching primary data for 2025-01.
[2025-10-24T19:09:53.577700] [INFO ] [REMOTE    ] HGV: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T19:09:53.747636] [INFO ] [REMOTE    ] HGV: Fetching primary data for 2025-04.
[2025-10-24T19:09:53.775518] [INFO ] [REMOTE    ] HHH: Incremental fetch complete for 2025-01 (0.83 seconds).
[2025-10-24T19:09:54.547679] [INFO ] [REMOTE    ] HGTY: Fetching primary data for 2025-10.
[2025-10-24T19:09:55.336349] [INFO ] [REMOTE    ] HGV: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T19:09:55.347769] [INFO ] [REMOTE    ] HGV: Fetching primary data for 2025-05.
[2025-10-24T19:09:55.522875] [INFO ] [REMOTE    ] HGTY: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T19:09:55.527037] [INFO ] [REMOTE    ] HGTY: Full fetch complete (17609 records).
[2025-10-24T19:09:55.527189] [DEBUG] [VALIDATOR ] HGTY: Validating primary data.
[2025-10-24T19:09:55.894830] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present.
[2025-10-24T19:09:55.894904] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed.
[2025-10-24T19:09:55.895264] [INFO ] [MAIN      ] HGTY: Fetched primary data is valid.
[2025-10-24T19:09:55.895303] [DEBUG] [LOCAL     ] HGTY: Saving primary data.
[2025-10-24T19:09:55.895533] [FATAL] [LOCAL     ] HGTY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:09:55.895666] [FATAL] [MAIN      ] HGTY: Failed to save primary data.
[2025-10-24T19:09:55.895724] [WARN ] [MAIN      ] HGTY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:09:55.895762] [INFO ] [LOCAL     ] HGTY: Starting deletion of primary data.
[2025-10-24T19:09:55.895903] [DEBUG] [LOCAL     ] HGTY: No primary data file found to delete.
[2025-10-24T19:09:55.895958] [INFO ] [LOCAL     ] HGTY: Starting deletion of derivative data.
[2025-10-24T19:09:55.896441] [DEBUG] [LOCAL     ] HGTY: Deleted derivative data file.
[2025-10-24T19:09:55.896528] [INFO ] [MAIN      ] Update Progress: 1013/2366 symbols completed. HGTY took 24.0s. Estimated remaining: 2h 53m 29s. Rate: 7.8 symbols/min
[2025-10-24T19:09:56.062986] [INFO ] [MAIN      ] HI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:09:56.098712] [DEBUG] [LOCAL     ] HI: Loaded 36466 existing records from primary storage.
[2025-10-24T19:09:56.098984] [INFO ] [MAIN      ] HI: Loaded 36466 existing records.
[2025-10-24T19:09:56.158234] [INFO ] [REMOTE    ] HGLB: Fetching primary data for 2025-07.
[2025-10-24T19:09:56.284677] [WARN ] [MAIN      ] HI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:09:56.284868] [INFO ] [MAIN      ] HI: Wiping existing primary data before full refresh.
[2025-10-24T19:09:56.284913] [INFO ] [LOCAL     ] HI: Starting deletion of primary data.
[2025-10-24T19:09:56.285204] [DEBUG] [LOCAL     ] HI: Deleted primary data file.
[2025-10-24T19:09:56.285259] [INFO ] [MAIN      ] HI: Starting full primary refresh.
[2025-10-24T19:09:56.641947] [INFO ] [REMOTE    ] HI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:09:56.940565] [INFO ] [REMOTE    ] HGV: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T19:09:56.955550] [INFO ] [REMOTE    ] HHH: Fetching primary data for 2025-02.
[2025-10-24T19:09:56.957733] [INFO ] [REMOTE    ] HGLB: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T19:09:57.747676] [INFO ] [REMOTE    ] HGLB: Fetching primary data for 2025-08.
[2025-10-24T19:09:58.250843] [INFO ] [REMOTE    ] HHH: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T19:09:58.448355] [INFO ] [REMOTE    ] HGLB: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T19:09:58.547619] [INFO ] [REMOTE    ] HGLB: Fetching primary data for 2025-09.
[2025-10-24T19:09:59.296747] [INFO ] [REMOTE    ] HGLB: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T19:09:59.347673] [INFO ] [REMOTE    ] HGLB: Fetching primary data for 2025-10.
[2025-10-24T19:10:00.147707] [INFO ] [REMOTE    ] HGV: Fetching primary data for 2025-06.
[2025-10-24T19:10:00.351254] [INFO ] [REMOTE    ] HGLB: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T19:10:00.353909] [INFO ] [REMOTE    ] HGLB: Full fetch complete (14368 records).
[2025-10-24T19:10:00.353995] [DEBUG] [VALIDATOR ] HGLB: Validating primary data.
[2025-10-24T19:10:00.715413] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present.
[2025-10-24T19:10:00.715484] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed.
[2025-10-24T19:10:00.715854] [INFO ] [MAIN      ] HGLB: Fetched primary data is valid.
[2025-10-24T19:10:00.715915] [DEBUG] [LOCAL     ] HGLB: Saving primary data.
[2025-10-24T19:10:00.716142] [FATAL] [LOCAL     ] HGLB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:10:00.716223] [FATAL] [MAIN      ] HGLB: Failed to save primary data.
[2025-10-24T19:10:00.716266] [WARN ] [MAIN      ] HGLB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:10:00.716300] [INFO ] [LOCAL     ] HGLB: Starting deletion of primary data.
[2025-10-24T19:10:00.716350] [DEBUG] [LOCAL     ] HGLB: No primary data file found to delete.
[2025-10-24T19:10:00.716384] [INFO ] [LOCAL     ] HGLB: Starting deletion of derivative data.
[2025-10-24T19:10:00.716530] [DEBUG] [LOCAL     ] HGLB: Deleted derivative data file.
[2025-10-24T19:10:00.716598] [INFO ] [MAIN      ] Update Progress: 1014/2366 symbols completed. HGLB took 32.0s. Estimated remaining: 2h 53m 17s. Rate: 7.8 symbols/min
[2025-10-24T19:10:00.887053] [INFO ] [MAIN      ] HIG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:10:00.943517] [DEBUG] [LOCAL     ] HIG: Loaded 51458 existing records from primary storage.
[2025-10-24T19:10:00.943886] [INFO ] [MAIN      ] HIG: Loaded 51458 existing records.
[2025-10-24T19:10:00.955152] [INFO ] [REMOTE    ] HHH: Fetching primary data for 2025-03.
[2025-10-24T19:10:01.127966] [WARN ] [MAIN      ] HIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:10:01.128301] [INFO ] [MAIN      ] HIG: Wiping existing primary data before full refresh.
[2025-10-24T19:10:01.128371] [INFO ] [LOCAL     ] HIG: Starting deletion of primary data.
[2025-10-24T19:10:01.129066] [DEBUG] [LOCAL     ] HIG: Deleted primary data file.
[2025-10-24T19:10:01.129146] [INFO ] [MAIN      ] HIG: Starting full primary refresh.
[2025-10-24T19:10:01.571941] [INFO ] [REMOTE    ] HIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:10:01.598327] [INFO ] [REMOTE    ] HGV: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T19:10:01.747736] [INFO ] [REMOTE    ] HGV: Fetching primary data for 2025-07.
[2025-10-24T19:10:02.006845] [INFO ] [REMOTE    ] HHH: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T19:10:02.547692] [INFO ] [REMOTE    ] HHH: Fetching primary data for 2025-04.
[2025-10-24T19:10:03.347629] [INFO ] [REMOTE    ] HIG: Fetching primary data for 2025-01.
[2025-10-24T19:10:03.711395] [INFO ] [REMOTE    ] HGV: Incremental fetch complete for 2025-07 (1.96 seconds).
[2025-10-24T19:10:03.751490] [INFO ] [REMOTE    ] HHH: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T19:10:04.147674] [INFO ] [REMOTE    ] HGV: Fetching primary data for 2025-08.
[2025-10-24T19:10:04.947697] [INFO ] [REMOTE    ] HI: Fetching primary data for 2025-01.
[2025-10-24T19:10:05.092787] [INFO ] [REMOTE    ] HIG: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T19:10:05.457678] [INFO ] [REMOTE    ] HGV: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T19:10:05.747731] [INFO ] [REMOTE    ] HGV: Fetching primary data for 2025-09.
[2025-10-24T19:10:06.282107] [INFO ] [REMOTE    ] HI: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T19:10:06.547673] [INFO ] [REMOTE    ] HI: Fetching primary data for 2025-02.
[2025-10-24T19:10:06.916830] [INFO ] [REMOTE    ] HGV: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T19:10:07.347673] [INFO ] [REMOTE    ] HGV: Fetching primary data for 2025-10.
[2025-10-24T19:10:07.994478] [INFO ] [REMOTE    ] HI: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T19:10:08.147667] [INFO ] [REMOTE    ] HI: Fetching primary data for 2025-03.
[2025-10-24T19:10:08.840143] [INFO ] [REMOTE    ] HGV: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T19:10:08.848060] [INFO ] [REMOTE    ] HGV: Full fetch complete (65895 records).
[2025-10-24T19:10:08.848194] [DEBUG] [VALIDATOR ] HGV: Validating primary data.
[2025-10-24T19:10:08.952741] [INFO ] [REMOTE    ] HHH: Fetching primary data for 2025-05.
[2025-10-24T19:10:09.242911] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present.
[2025-10-24T19:10:09.243016] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed.
[2025-10-24T19:10:09.244149] [INFO ] [MAIN      ] HGV: Fetched primary data is valid.
[2025-10-24T19:10:09.244248] [DEBUG] [LOCAL     ] HGV: Saving primary data.
[2025-10-24T19:10:09.244867] [FATAL] [LOCAL     ] HGV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:10:09.244951] [FATAL] [MAIN      ] HGV: Failed to save primary data.
[2025-10-24T19:10:09.244994] [WARN ] [MAIN      ] HGV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:10:09.245030] [INFO ] [LOCAL     ] HGV: Starting deletion of primary data.
[2025-10-24T19:10:09.245100] [DEBUG] [LOCAL     ] HGV: No primary data file found to delete.
[2025-10-24T19:10:09.245137] [INFO ] [LOCAL     ] HGV: Starting deletion of derivative data.
[2025-10-24T19:10:09.245286] [DEBUG] [LOCAL     ] HGV: Deleted derivative data file.
[2025-10-24T19:10:09.245499] [INFO ] [MAIN      ] Update Progress: 1015/2366 symbols completed. HGV took 25.0s. Estimated remaining: 2h 53m 11s. Rate: 7.8 symbols/min
[2025-10-24T19:10:09.411017] [INFO ] [MAIN      ] HII: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:10:09.444769] [DEBUG] [LOCAL     ] HII: Loaded 33565 existing records from primary storage.
[2025-10-24T19:10:09.445032] [INFO ] [MAIN      ] HII: Loaded 33565 existing records.
[2025-10-24T19:10:09.566626] [INFO ] [REMOTE    ] HI: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T19:10:09.649010] [WARN ] [MAIN      ] HII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:10:09.649200] [INFO ] [MAIN      ] HII: Wiping existing primary data before full refresh.
[2025-10-24T19:10:09.649247] [INFO ] [LOCAL     ] HII: Starting deletion of primary data.
[2025-10-24T19:10:09.649470] [DEBUG] [LOCAL     ] HII: Deleted primary data file.
[2025-10-24T19:10:09.649508] [INFO ] [MAIN      ] HII: Starting full primary refresh.
[2025-10-24T19:10:09.747713] [INFO ] [REMOTE    ] HI: Fetching primary data for 2025-04.
[2025-10-24T19:10:09.999137] [INFO ] [REMOTE    ] HII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:10:10.473104] [INFO ] [REMOTE    ] HHH: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T19:10:10.547683] [INFO ] [REMOTE    ] HHH: Fetching primary data for 2025-06.
[2025-10-24T19:10:11.228586] [INFO ] [REMOTE    ] HI: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T19:10:11.347675] [INFO ] [REMOTE    ] HII: Fetching primary data for 2025-01.
[2025-10-24T19:10:12.018426] [INFO ] [REMOTE    ] HHH: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T19:10:12.147625] [INFO ] [REMOTE    ] HHH: Fetching primary data for 2025-07.
[2025-10-24T19:10:12.416086] [INFO ] [REMOTE    ] HII: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T19:10:12.947733] [INFO ] [REMOTE    ] HI: Fetching primary data for 2025-05.
[2025-10-24T19:10:13.063203] [INFO ] [REMOTE    ] HHH: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T19:10:13.747716] [INFO ] [REMOTE    ] HIG: Fetching primary data for 2025-02.
[2025-10-24T19:10:14.335138] [INFO ] [REMOTE    ] HI: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T19:10:14.547615] [INFO ] [REMOTE    ] HII: Fetching primary data for 2025-02.
[2025-10-24T19:10:15.347715] [INFO ] [REMOTE    ] HHH: Fetching primary data for 2025-08.
[2025-10-24T19:10:15.591822] [INFO ] [REMOTE    ] HIG: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T19:10:16.035162] [INFO ] [REMOTE    ] HII: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T19:10:16.147607] [INFO ] [REMOTE    ] HIG: Fetching primary data for 2025-03.
[2025-10-24T19:10:16.726261] [INFO ] [REMOTE    ] HHH: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T19:10:16.947681] [INFO ] [REMOTE    ] HHH: Fetching primary data for 2025-09.
[2025-10-24T19:10:17.586231] [INFO ] [REMOTE    ] HIG: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T19:10:17.747726] [INFO ] [REMOTE    ] HIG: Fetching primary data for 2025-04.
[2025-10-24T19:10:18.547736] [INFO ] [REMOTE    ] HII: Fetching primary data for 2025-03.
[2025-10-24T19:10:19.347689] [INFO ] [REMOTE    ] HI: Fetching primary data for 2025-06.
[2025-10-24T19:10:19.545743] [INFO ] [REMOTE    ] HIG: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T19:10:20.147733] [INFO ] [REMOTE    ] HIG: Fetching primary data for 2025-05.
[2025-10-24T19:10:20.377058] [INFO ] [REMOTE    ] HII: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T19:10:20.682560] [INFO ] [REMOTE    ] HI: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T19:10:20.947731] [INFO ] [REMOTE    ] HI: Fetching primary data for 2025-07.
[2025-10-24T19:10:21.449454] [INFO ] [REMOTE    ] HIG: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T19:10:21.747735] [INFO ] [REMOTE    ] HIG: Fetching primary data for 2025-06.
[2025-10-24T19:10:21.942770] [INFO ] [REMOTE    ] HHH: Incremental fetch complete for 2025-09 (5.00 seconds).
[2025-10-24T19:10:22.301677] [INFO ] [REMOTE    ] HI: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T19:10:22.547731] [INFO ] [REMOTE    ] HI: Fetching primary data for 2025-08.
[2025-10-24T19:10:23.347711] [INFO ] [REMOTE    ] HII: Fetching primary data for 2025-04.
[2025-10-24T19:10:23.384118] [INFO ] [REMOTE    ] HIG: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T19:10:24.010990] [INFO ] [REMOTE    ] HI: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T19:10:24.147619] [INFO ] [REMOTE    ] HI: Fetching primary data for 2025-09.
[2025-10-24T19:10:24.947757] [INFO ] [REMOTE    ] HIG: Fetching primary data for 2025-07.
[2025-10-24T19:10:25.040268] [INFO ] [REMOTE    ] HII: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T19:10:25.484203] [INFO ] [REMOTE    ] HI: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T19:10:25.747737] [INFO ] [REMOTE    ] HII: Fetching primary data for 2025-05.
[2025-10-24T19:10:26.547713] [INFO ] [REMOTE    ] HI: Fetching primary data for 2025-10.
[2025-10-24T19:10:26.752161] [INFO ] [REMOTE    ] HIG: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T19:10:27.248420] [INFO ] [REMOTE    ] HII: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T19:10:27.347604] [INFO ] [REMOTE    ] HII: Fetching primary data for 2025-06.
[2025-10-24T19:10:28.147701] [INFO ] [REMOTE    ] HIG: Fetching primary data for 2025-08.
[2025-10-24T19:10:28.197418] [INFO ] [REMOTE    ] HI: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T19:10:28.205109] [INFO ] [REMOTE    ] HI: Full fetch complete (51475 records).
[2025-10-24T19:10:28.205202] [DEBUG] [VALIDATOR ] HI: Validating primary data.
[2025-10-24T19:10:28.578600] [DEBUG] [VALIDATOR ] HI: All expected trading days are present.
[2025-10-24T19:10:28.578746] [DEBUG] [VALIDATOR ] HI: Primary data validation passed.
[2025-10-24T19:10:28.579602] [INFO ] [MAIN      ] HI: Fetched primary data is valid.
[2025-10-24T19:10:28.579708] [DEBUG] [LOCAL     ] HI: Saving primary data.
[2025-10-24T19:10:28.580207] [FATAL] [LOCAL     ] HI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:10:28.580289] [FATAL] [MAIN      ] HI: Failed to save primary data.
[2025-10-24T19:10:28.580357] [WARN ] [MAIN      ] HI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:10:28.580427] [INFO ] [LOCAL     ] HI: Starting deletion of primary data.
[2025-10-24T19:10:28.580486] [DEBUG] [LOCAL     ] HI: No primary data file found to delete.
[2025-10-24T19:10:28.580524] [INFO ] [LOCAL     ] HI: Starting deletion of derivative data.
[2025-10-24T19:10:28.580679] [DEBUG] [LOCAL     ] HI: Deleted derivative data file.
[2025-10-24T19:10:28.580872] [INFO ] [MAIN      ] Update Progress: 1016/2366 symbols completed. HI took 32.7s. Estimated remaining: 2h 53m 18s. Rate: 7.8 symbols/min
[2025-10-24T19:10:28.751000] [INFO ] [MAIN      ] HIMS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:10:28.804462] [DEBUG] [LOCAL     ] HIMS: Loaded 54207 existing records from primary storage.
[2025-10-24T19:10:28.804797] [INFO ] [MAIN      ] HIMS: Loaded 54207 existing records.
[2025-10-24T19:10:28.951016] [INFO ] [REMOTE    ] HHH: Fetching primary data for 2025-10.
[2025-10-24T19:10:28.952413] [INFO ] [REMOTE    ] HII: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T19:10:29.017317] [WARN ] [MAIN      ] HIMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:10:29.017904] [INFO ] [MAIN      ] HIMS: Wiping existing primary data before full refresh.
[2025-10-24T19:10:29.018127] [INFO ] [LOCAL     ] HIMS: Starting deletion of primary data.
[2025-10-24T19:10:29.018570] [DEBUG] [LOCAL     ] HIMS: Deleted primary data file.
[2025-10-24T19:10:29.018631] [INFO ] [MAIN      ] HIMS: Starting full primary refresh.
[2025-10-24T19:10:29.372361] [INFO ] [REMOTE    ] HIMS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:10:29.747734] [INFO ] [REMOTE    ] HIMS: Fetching primary data for 2025-01.
[2025-10-24T19:10:29.900690] [INFO ] [REMOTE    ] HIG: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T19:10:30.033688] [INFO ] [REMOTE    ] HHH: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T19:10:30.039963] [INFO ] [REMOTE    ] HHH: Full fetch complete (46205 records).
[2025-10-24T19:10:30.040071] [DEBUG] [VALIDATOR ] HHH: Validating primary data.
[2025-10-24T19:10:30.434751] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present.
[2025-10-24T19:10:30.434830] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed.
[2025-10-24T19:10:30.435545] [INFO ] [MAIN      ] HHH: Fetched primary data is valid.
[2025-10-24T19:10:30.435588] [DEBUG] [LOCAL     ] HHH: Saving primary data.
[2025-10-24T19:10:30.436035] [FATAL] [LOCAL     ] HHH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:10:30.436118] [FATAL] [MAIN      ] HHH: Failed to save primary data.
[2025-10-24T19:10:30.436160] [WARN ] [MAIN      ] HHH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:10:30.436193] [INFO ] [LOCAL     ] HHH: Starting deletion of primary data.
[2025-10-24T19:10:30.436242] [DEBUG] [LOCAL     ] HHH: No primary data file found to delete.
[2025-10-24T19:10:30.436276] [INFO ] [LOCAL     ] HHH: Starting deletion of derivative data.
[2025-10-24T19:10:30.436428] [DEBUG] [LOCAL     ] HHH: Deleted derivative data file.
[2025-10-24T19:10:30.436518] [INFO ] [MAIN      ] Update Progress: 1017/2366 symbols completed. HHH took 39.3s. Estimated remaining: 2h 53m 3s. Rate: 7.8 symbols/min
[2025-10-24T19:10:30.552757] [INFO ] [REMOTE    ] HII: Fetching primary data for 2025-07.
[2025-10-24T19:10:30.614325] [INFO ] [MAIN      ] HIO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:10:30.639553] [DEBUG] [LOCAL     ] HIO: Loaded 24111 existing records from primary storage.
[2025-10-24T19:10:30.639849] [INFO ] [MAIN      ] HIO: Loaded 24111 existing records.
[2025-10-24T19:10:30.827102] [WARN ] [MAIN      ] HIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:10:30.827392] [INFO ] [MAIN      ] HIO: Wiping existing primary data before full refresh.
[2025-10-24T19:10:30.827443] [INFO ] [LOCAL     ] HIO: Starting deletion of primary data.
[2025-10-24T19:10:30.827630] [DEBUG] [LOCAL     ] HIO: Deleted primary data file.
[2025-10-24T19:10:30.827724] [INFO ] [MAIN      ] HIO: Starting full primary refresh.
[2025-10-24T19:10:31.222278] [INFO ] [REMOTE    ] HIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:10:31.347682] [INFO ] [REMOTE    ] HIG: Fetching primary data for 2025-09.
[2025-10-24T19:10:31.919511] [INFO ] [REMOTE    ] HIMS: Incremental fetch complete for 2025-01 (2.17 seconds).
[2025-10-24T19:10:32.029467] [INFO ] [REMOTE    ] HII: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T19:10:32.147624] [INFO ] [REMOTE    ] HII: Fetching primary data for 2025-08.
[2025-10-24T19:10:32.635233] [INFO ] [REMOTE    ] HIG: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T19:10:32.947691] [INFO ] [REMOTE    ] HIO: Fetching primary data for 2025-01.
[2025-10-24T19:10:33.648593] [INFO ] [REMOTE    ] HII: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T19:10:33.747621] [INFO ] [REMOTE    ] HII: Fetching primary data for 2025-09.
[2025-10-24T19:10:34.095353] [INFO ] [REMOTE    ] HIO: Incremental fetch complete for 2025-01 (1.15 seconds).
[2025-10-24T19:10:34.547672] [INFO ] [REMOTE    ] HIO: Fetching primary data for 2025-02.
[2025-10-24T19:10:35.229195] [INFO ] [REMOTE    ] HII: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T19:10:35.347635] [INFO ] [REMOTE    ] HIMS: Fetching primary data for 2025-02.
[2025-10-24T19:10:35.681821] [INFO ] [REMOTE    ] HIO: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T19:10:36.147672] [INFO ] [REMOTE    ] HII: Fetching primary data for 2025-10.
[2025-10-24T19:10:36.947670] [INFO ] [REMOTE    ] HIG: Fetching primary data for 2025-10.
[2025-10-24T19:10:37.683615] [INFO ] [REMOTE    ] HII: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T19:10:37.689863] [INFO ] [REMOTE    ] HII: Full fetch complete (52230 records).
[2025-10-24T19:10:37.690030] [DEBUG] [VALIDATOR ] HII: Validating primary data.
[2025-10-24T19:10:37.755541] [INFO ] [REMOTE    ] HIO: Fetching primary data for 2025-03.
[2025-10-24T19:10:38.040967] [INFO ] [REMOTE    ] HIMS: Incremental fetch complete for 2025-02 (2.69 seconds).
[2025-10-24T19:10:38.132858] [DEBUG] [VALIDATOR ] HII: All expected trading days are present.
[2025-10-24T19:10:38.132940] [DEBUG] [VALIDATOR ] HII: Primary data validation passed.
[2025-10-24T19:10:38.133760] [INFO ] [MAIN      ] HII: Fetched primary data is valid.
[2025-10-24T19:10:38.133820] [DEBUG] [LOCAL     ] HII: Saving primary data.
[2025-10-24T19:10:38.134266] [FATAL] [LOCAL     ] HII: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:10:38.134358] [FATAL] [MAIN      ] HII: Failed to save primary data.
[2025-10-24T19:10:38.134400] [WARN ] [MAIN      ] HII: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:10:38.134469] [INFO ] [LOCAL     ] HII: Starting deletion of primary data.
[2025-10-24T19:10:38.134526] [DEBUG] [LOCAL     ] HII: No primary data file found to delete.
[2025-10-24T19:10:38.134561] [INFO ] [LOCAL     ] HII: Starting deletion of derivative data.
[2025-10-24T19:10:38.134746] [DEBUG] [LOCAL     ] HII: Deleted derivative data file.
[2025-10-24T19:10:38.135228] [INFO ] [MAIN      ] Update Progress: 1018/2366 symbols completed. HII took 28.9s. Estimated remaining: 2h 52m 55s. Rate: 7.8 symbols/min
[2025-10-24T19:10:38.300859] [INFO ] [MAIN      ] HIPO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:10:38.323793] [DEBUG] [LOCAL     ] HIPO: Loaded 21492 existing records from primary storage.
[2025-10-24T19:10:38.324041] [INFO ] [MAIN      ] HIPO: Loaded 21492 existing records.
[2025-10-24T19:10:38.500829] [WARN ] [MAIN      ] HIPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:10:38.501021] [INFO ] [MAIN      ] HIPO: Wiping existing primary data before full refresh.
[2025-10-24T19:10:38.501067] [INFO ] [LOCAL     ] HIPO: Starting deletion of primary data.
[2025-10-24T19:10:38.501239] [DEBUG] [LOCAL     ] HIPO: Deleted primary data file.
[2025-10-24T19:10:38.501276] [INFO ] [MAIN      ] HIPO: Starting full primary refresh.
[2025-10-24T19:10:38.555381] [INFO ] [REMOTE    ] HIMS: Fetching primary data for 2025-03.
[2025-10-24T19:10:38.878931] [INFO ] [REMOTE    ] HIPO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:10:38.903701] [INFO ] [REMOTE    ] HIG: Incremental fetch complete for 2025-10 (1.96 seconds).
[2025-10-24T19:10:38.912954] [INFO ] [REMOTE    ] HIG: Full fetch complete (73695 records).
[2025-10-24T19:10:38.913098] [DEBUG] [VALIDATOR ] HIG: Validating primary data.
[2025-10-24T19:10:39.347752] [INFO ] [REMOTE    ] HIPO: Fetching primary data for 2025-01.
[2025-10-24T19:10:39.347595] [INFO ] [REMOTE    ] HIO: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T19:10:39.422000] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present.
[2025-10-24T19:10:39.422126] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed.
[2025-10-24T19:10:39.424023] [INFO ] [MAIN      ] HIG: Fetched primary data is valid.
[2025-10-24T19:10:39.424117] [DEBUG] [LOCAL     ] HIG: Saving primary data.
[2025-10-24T19:10:39.424899] [FATAL] [LOCAL     ] HIG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:10:39.425697] [FATAL] [MAIN      ] HIG: Failed to save primary data.
[2025-10-24T19:10:39.425783] [WARN ] [MAIN      ] HIG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:10:39.425872] [INFO ] [LOCAL     ] HIG: Starting deletion of primary data.
[2025-10-24T19:10:39.425962] [DEBUG] [LOCAL     ] HIG: No primary data file found to delete.
[2025-10-24T19:10:39.426028] [INFO ] [LOCAL     ] HIG: Starting deletion of derivative data.
[2025-10-24T19:10:39.426211] [DEBUG] [LOCAL     ] HIG: Deleted derivative data file.
[2025-10-24T19:10:39.426669] [INFO ] [MAIN      ] Update Progress: 1019/2366 symbols completed. HIG took 38.7s. Estimated remaining: 2h 52m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:10:39.710586] [INFO ] [MAIN      ] HIW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:10:39.767584] [DEBUG] [LOCAL     ] HIW: Loaded 44737 existing records from primary storage.
[2025-10-24T19:10:39.768038] [INFO ] [MAIN      ] HIW: Loaded 44737 existing records.
[2025-10-24T19:10:40.004636] [WARN ] [MAIN      ] HIW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:10:40.004936] [INFO ] [MAIN      ] HIW: Wiping existing primary data before full refresh.
[2025-10-24T19:10:40.005003] [INFO ] [LOCAL     ] HIW: Starting deletion of primary data.
[2025-10-24T19:10:40.005330] [DEBUG] [LOCAL     ] HIW: Deleted primary data file.
[2025-10-24T19:10:40.005403] [INFO ] [MAIN      ] HIW: Starting full primary refresh.
[2025-10-24T19:10:40.152868] [INFO ] [REMOTE    ] HIO: Fetching primary data for 2025-04.
[2025-10-24T19:10:40.462000] [INFO ] [REMOTE    ] HIW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:10:40.474126] [INFO ] [REMOTE    ] HIPO: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T19:10:40.947704] [INFO ] [REMOTE    ] HIPO: Fetching primary data for 2025-02.
[2025-10-24T19:10:41.314671] [INFO ] [REMOTE    ] HIMS: Incremental fetch complete for 2025-03 (2.76 seconds).
[2025-10-24T19:10:41.394633] [INFO ] [REMOTE    ] HIO: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T19:10:41.574828] [INFO ] [REMOTE    ] HIPO: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T19:10:41.747721] [INFO ] [REMOTE    ] HIW: Fetching primary data for 2025-01.
[2025-10-24T19:10:42.547704] [INFO ] [REMOTE    ] HIMS: Fetching primary data for 2025-04.
[2025-10-24T19:10:43.226063] [INFO ] [REMOTE    ] HIW: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T19:10:43.347708] [INFO ] [REMOTE    ] HIW: Fetching primary data for 2025-02.
[2025-10-24T19:10:44.147758] [INFO ] [REMOTE    ] HIO: Fetching primary data for 2025-05.
[2025-10-24T19:10:44.947613] [INFO ] [REMOTE    ] HIPO: Fetching primary data for 2025-03.
[2025-10-24T19:10:44.981110] [INFO ] [REMOTE    ] HIW: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T19:10:45.036141] [INFO ] [REMOTE    ] HIO: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T19:10:45.172720] [INFO ] [REMOTE    ] HIMS: Incremental fetch complete for 2025-04 (2.63 seconds).
[2025-10-24T19:10:45.747683] [INFO ] [REMOTE    ] HIMS: Fetching primary data for 2025-05.
[2025-10-24T19:10:46.033017] [INFO ] [REMOTE    ] HIPO: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T19:10:46.547694] [INFO ] [REMOTE    ] HIO: Fetching primary data for 2025-06.
[2025-10-24T19:10:47.347667] [INFO ] [REMOTE    ] HIPO: Fetching primary data for 2025-04.
[2025-10-24T19:10:47.528591] [INFO ] [REMOTE    ] HIO: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T19:10:48.147632] [INFO ] [REMOTE    ] HIO: Fetching primary data for 2025-07.
[2025-10-24T19:10:48.489661] [INFO ] [REMOTE    ] HIMS: Incremental fetch complete for 2025-05 (2.74 seconds).
[2025-10-24T19:10:48.514051] [INFO ] [REMOTE    ] HIPO: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T19:10:48.947620] [INFO ] [REMOTE    ] HIPO: Fetching primary data for 2025-05.
[2025-10-24T19:10:49.219821] [INFO ] [REMOTE    ] HIO: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T19:10:49.747667] [INFO ] [REMOTE    ] HIMS: Fetching primary data for 2025-06.
[2025-10-24T19:10:50.027325] [INFO ] [REMOTE    ] HIPO: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T19:10:50.547728] [INFO ] [REMOTE    ] HIO: Fetching primary data for 2025-08.
[2025-10-24T19:10:51.347695] [INFO ] [REMOTE    ] HIPO: Fetching primary data for 2025-06.
[2025-10-24T19:10:51.699007] [INFO ] [REMOTE    ] HIO: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T19:10:52.147630] [INFO ] [REMOTE    ] HIO: Fetching primary data for 2025-09.
[2025-10-24T19:10:52.270606] [INFO ] [REMOTE    ] HIMS: Incremental fetch complete for 2025-06 (2.52 seconds).
[2025-10-24T19:10:52.317538] [INFO ] [REMOTE    ] HIPO: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T19:10:52.947633] [INFO ] [REMOTE    ] HIPO: Fetching primary data for 2025-07.
[2025-10-24T19:10:53.345284] [INFO ] [REMOTE    ] HIO: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T19:10:53.747620] [INFO ] [REMOTE    ] HIO: Fetching primary data for 2025-10.
[2025-10-24T19:10:53.952098] [INFO ] [REMOTE    ] HIPO: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T19:10:54.547700] [INFO ] [REMOTE    ] HIPO: Fetching primary data for 2025-08.
[2025-10-24T19:10:54.870119] [INFO ] [REMOTE    ] HIO: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T19:10:54.876398] [INFO ] [REMOTE    ] HIO: Full fetch complete (38251 records).
[2025-10-24T19:10:54.876518] [DEBUG] [VALIDATOR ] HIO: Validating primary data.
[2025-10-24T19:10:55.248773] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present.
[2025-10-24T19:10:55.248872] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed.
[2025-10-24T19:10:55.249595] [INFO ] [MAIN      ] HIO: Fetched primary data is valid.
[2025-10-24T19:10:55.249730] [DEBUG] [LOCAL     ] HIO: Saving primary data.
[2025-10-24T19:10:55.250166] [FATAL] [LOCAL     ] HIO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:10:55.250276] [FATAL] [MAIN      ] HIO: Failed to save primary data.
[2025-10-24T19:10:55.250371] [WARN ] [MAIN      ] HIO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:10:55.250483] [INFO ] [LOCAL     ] HIO: Starting deletion of primary data.
[2025-10-24T19:10:55.250620] [DEBUG] [LOCAL     ] HIO: No primary data file found to delete.
[2025-10-24T19:10:55.250707] [INFO ] [LOCAL     ] HIO: Starting deletion of derivative data.
[2025-10-24T19:10:55.250863] [DEBUG] [LOCAL     ] HIO: Deleted derivative data file.
[2025-10-24T19:10:55.250967] [INFO ] [MAIN      ] Update Progress: 1020/2366 symbols completed. HIO took 24.8s. Estimated remaining: 2h 52m 42s. Rate: 7.8 symbols/min
[2025-10-24T19:10:55.348790] [INFO ] [REMOTE    ] HIMS: Fetching primary data for 2025-07.
[2025-10-24T19:10:55.386572] [INFO ] [REMOTE    ] HIPO: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T19:10:55.440275] [INFO ] [MAIN      ] HIX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:10:55.461431] [DEBUG] [LOCAL     ] HIX: Loaded 20615 existing records from primary storage.
[2025-10-24T19:10:55.461692] [INFO ] [MAIN      ] HIX: Loaded 20615 existing records.
[2025-10-24T19:10:55.639456] [WARN ] [MAIN      ] HIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:10:55.639677] [INFO ] [MAIN      ] HIX: Wiping existing primary data before full refresh.
[2025-10-24T19:10:55.639736] [INFO ] [LOCAL     ] HIX: Starting deletion of primary data.
[2025-10-24T19:10:55.639898] [DEBUG] [LOCAL     ] HIX: Deleted primary data file.
[2025-10-24T19:10:55.639976] [INFO ] [MAIN      ] HIX: Starting full primary refresh.
[2025-10-24T19:10:56.012554] [INFO ] [REMOTE    ] HIX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:10:56.147660] [INFO ] [REMOTE    ] HIX: Fetching primary data for 2025-01.
[2025-10-24T19:10:56.947694] [INFO ] [REMOTE    ] HIW: Fetching primary data for 2025-03.
[2025-10-24T19:10:57.225392] [INFO ] [REMOTE    ] HIX: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T19:10:57.747694] [INFO ] [REMOTE    ] HIX: Fetching primary data for 2025-02.
[2025-10-24T19:10:57.819534] [INFO ] [REMOTE    ] HIMS: Incremental fetch complete for 2025-07 (2.47 seconds).
[2025-10-24T19:10:58.084459] [INFO ] [REMOTE    ] HIW: Incremental fetch complete for 2025-03 (1.14 seconds).
[2025-10-24T19:10:58.547637] [INFO ] [REMOTE    ] HIW: Fetching primary data for 2025-04.
[2025-10-24T19:10:58.841763] [INFO ] [REMOTE    ] HIX: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T19:10:59.347669] [INFO ] [REMOTE    ] HIX: Fetching primary data for 2025-03.
[2025-10-24T19:10:59.896846] [INFO ] [REMOTE    ] HIW: Incremental fetch complete for 2025-04 (1.35 seconds).
[2025-10-24T19:11:00.147673] [INFO ] [REMOTE    ] HIW: Fetching primary data for 2025-05.
[2025-10-24T19:11:00.495237] [INFO ] [REMOTE    ] HIX: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T19:11:00.947682] [INFO ] [REMOTE    ] HIMS: Fetching primary data for 2025-08.
[2025-10-24T19:11:01.747618] [INFO ] [REMOTE    ] HIPO: Fetching primary data for 2025-09.
[2025-10-24T19:11:01.877405] [INFO ] [REMOTE    ] HIW: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T19:11:02.547639] [INFO ] [REMOTE    ] HIX: Fetching primary data for 2025-04.
[2025-10-24T19:11:02.850080] [INFO ] [REMOTE    ] HIPO: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T19:11:03.342995] [INFO ] [REMOTE    ] HIMS: Incremental fetch complete for 2025-08 (2.40 seconds).
[2025-10-24T19:11:03.353387] [INFO ] [REMOTE    ] HIW: Fetching primary data for 2025-06.
[2025-10-24T19:11:03.438021] [INFO ] [REMOTE    ] HIX: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T19:11:04.147690] [INFO ] [REMOTE    ] HIMS: Fetching primary data for 2025-09.
[2025-10-24T19:11:04.878404] [INFO ] [REMOTE    ] HIW: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T19:11:04.947677] [INFO ] [REMOTE    ] HIW: Fetching primary data for 2025-07.
[2025-10-24T19:11:05.747686] [INFO ] [REMOTE    ] HIPO: Fetching primary data for 2025-10.
[2025-10-24T19:11:06.493713] [INFO ] [REMOTE    ] HIW: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T19:11:06.547638] [INFO ] [REMOTE    ] HIW: Fetching primary data for 2025-08.
[2025-10-24T19:11:06.736608] [INFO ] [REMOTE    ] HIMS: Incremental fetch complete for 2025-09 (2.59 seconds).
[2025-10-24T19:11:06.757030] [INFO ] [REMOTE    ] HIPO: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T19:11:06.760431] [INFO ] [REMOTE    ] HIPO: Full fetch complete (30985 records).
[2025-10-24T19:11:06.760558] [DEBUG] [VALIDATOR ] HIPO: Validating primary data.
[2025-10-24T19:11:07.202567] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present.
[2025-10-24T19:11:07.202697] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed.
[2025-10-24T19:11:07.203422] [INFO ] [MAIN      ] HIPO: Fetched primary data is valid.
[2025-10-24T19:11:07.203489] [DEBUG] [LOCAL     ] HIPO: Saving primary data.
[2025-10-24T19:11:07.203882] [FATAL] [LOCAL     ] HIPO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:11:07.204010] [FATAL] [MAIN      ] HIPO: Failed to save primary data.
[2025-10-24T19:11:07.204057] [WARN ] [MAIN      ] HIPO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:11:07.204093] [INFO ] [LOCAL     ] HIPO: Starting deletion of primary data.
[2025-10-24T19:11:07.204143] [DEBUG] [LOCAL     ] HIPO: No primary data file found to delete.
[2025-10-24T19:11:07.204181] [INFO ] [LOCAL     ] HIPO: Starting deletion of derivative data.
[2025-10-24T19:11:07.204358] [DEBUG] [LOCAL     ] HIPO: Deleted derivative data file.
[2025-10-24T19:11:07.204452] [INFO ] [MAIN      ] Update Progress: 1021/2366 symbols completed. HIPO took 29.1s. Estimated remaining: 2h 52m 40s. Rate: 7.8 symbols/min
[2025-10-24T19:11:07.349805] [INFO ] [REMOTE    ] HIMS: Fetching primary data for 2025-10.
[2025-10-24T19:11:07.432206] [INFO ] [MAIN      ] HKD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:11:07.465541] [DEBUG] [LOCAL     ] HKD: Loaded 18788 existing records from primary storage.
[2025-10-24T19:11:07.465809] [INFO ] [MAIN      ] HKD: Loaded 18788 existing records.
[2025-10-24T19:11:07.648152] [WARN ] [MAIN      ] HKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:11:07.648355] [INFO ] [MAIN      ] HKD: Wiping existing primary data before full refresh.
[2025-10-24T19:11:07.648427] [INFO ] [LOCAL     ] HKD: Starting deletion of primary data.
[2025-10-24T19:11:07.648634] [DEBUG] [LOCAL     ] HKD: Deleted primary data file.
[2025-10-24T19:11:07.648730] [INFO ] [MAIN      ] HKD: Starting full primary refresh.
[2025-10-24T19:11:08.018519] [INFO ] [REMOTE    ] HKD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:11:08.047365] [INFO ] [REMOTE    ] HIW: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T19:11:08.147638] [INFO ] [REMOTE    ] HKD: Fetching primary data for 2025-01.
[2025-10-24T19:11:08.947722] [INFO ] [REMOTE    ] HIW: Fetching primary data for 2025-09.
[2025-10-24T19:11:09.350878] [INFO ] [REMOTE    ] HKD: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T19:11:09.747678] [INFO ] [REMOTE    ] HKD: Fetching primary data for 2025-02.
[2025-10-24T19:11:10.373387] [INFO ] [REMOTE    ] HIMS: Incremental fetch complete for 2025-10 (3.02 seconds).
[2025-10-24T19:11:10.383378] [INFO ] [REMOTE    ] HIMS: Full fetch complete (77996 records).
[2025-10-24T19:11:10.383527] [DEBUG] [VALIDATOR ] HIMS: Validating primary data.
[2025-10-24T19:11:10.562566] [INFO ] [REMOTE    ] HIX: Fetching primary data for 2025-05.
[2025-10-24T19:11:10.785334] [INFO ] [REMOTE    ] HIW: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T19:11:10.834679] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present.
[2025-10-24T19:11:10.834775] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed.
[2025-10-24T19:11:10.836220] [INFO ] [MAIN      ] HIMS: Fetched primary data is valid.
[2025-10-24T19:11:10.836284] [DEBUG] [LOCAL     ] HIMS: Saving primary data.
[2025-10-24T19:11:10.836937] [FATAL] [LOCAL     ] HIMS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:11:10.837022] [FATAL] [MAIN      ] HIMS: Failed to save primary data.
[2025-10-24T19:11:10.837063] [WARN ] [MAIN      ] HIMS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:11:10.837101] [INFO ] [LOCAL     ] HIMS: Starting deletion of primary data.
[2025-10-24T19:11:10.837154] [DEBUG] [LOCAL     ] HIMS: No primary data file found to delete.
[2025-10-24T19:11:10.837234] [INFO ] [LOCAL     ] HIMS: Starting deletion of derivative data.
[2025-10-24T19:11:10.837503] [DEBUG] [LOCAL     ] HIMS: Deleted derivative data file.
[2025-10-24T19:11:10.837844] [INFO ] [MAIN      ] Update Progress: 1022/2366 symbols completed. HIMS took 42.3s. Estimated remaining: 2h 52m 27s. Rate: 7.8 symbols/min
[2025-10-24T19:11:11.009028] [INFO ] [MAIN      ] HL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:11:11.023867] [INFO ] [REMOTE    ] HKD: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T19:11:11.082937] [DEBUG] [LOCAL     ] HL: Loaded 54066 existing records from primary storage.
[2025-10-24T19:11:11.083261] [INFO ] [MAIN      ] HL: Loaded 54066 existing records.
[2025-10-24T19:11:11.256167] [WARN ] [MAIN      ] HL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:11:11.256366] [INFO ] [MAIN      ] HL: Wiping existing primary data before full refresh.
[2025-10-24T19:11:11.256414] [INFO ] [LOCAL     ] HL: Starting deletion of primary data.
[2025-10-24T19:11:11.256866] [DEBUG] [LOCAL     ] HL: Deleted primary data file.
[2025-10-24T19:11:11.256923] [INFO ] [MAIN      ] HL: Starting full primary refresh.
[2025-10-24T19:11:11.354129] [INFO ] [REMOTE    ] HKD: Fetching primary data for 2025-03.
[2025-10-24T19:11:11.577071] [INFO ] [REMOTE    ] HIX: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T19:11:11.658984] [INFO ] [REMOTE    ] HL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:11:12.147722] [INFO ] [REMOTE    ] HIW: Fetching primary data for 2025-10.
[2025-10-24T19:11:12.358391] [INFO ] [REMOTE    ] HKD: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T19:11:12.947635] [INFO ] [REMOTE    ] HL: Fetching primary data for 2025-01.
[2025-10-24T19:11:13.747702] [INFO ] [REMOTE    ] HKD: Fetching primary data for 2025-04.
[2025-10-24T19:11:13.878260] [INFO ] [REMOTE    ] HIW: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T19:11:13.886229] [INFO ] [REMOTE    ] HIW: Full fetch complete (64914 records).
[2025-10-24T19:11:13.886338] [DEBUG] [VALIDATOR ] HIW: Validating primary data.
[2025-10-24T19:11:14.271237] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present.
[2025-10-24T19:11:14.271319] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed.
[2025-10-24T19:11:14.272213] [INFO ] [MAIN      ] HIW: Fetched primary data is valid.
[2025-10-24T19:11:14.272275] [DEBUG] [LOCAL     ] HIW: Saving primary data.
[2025-10-24T19:11:14.272839] [FATAL] [LOCAL     ] HIW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:11:14.272933] [FATAL] [MAIN      ] HIW: Failed to save primary data.
[2025-10-24T19:11:14.273005] [WARN ] [MAIN      ] HIW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:11:14.273056] [INFO ] [LOCAL     ] HIW: Starting deletion of primary data.
[2025-10-24T19:11:14.273135] [DEBUG] [LOCAL     ] HIW: No primary data file found to delete.
[2025-10-24T19:11:14.273190] [INFO ] [LOCAL     ] HIW: Starting deletion of derivative data.
[2025-10-24T19:11:14.273354] [DEBUG] [LOCAL     ] HIW: Deleted derivative data file.
[2025-10-24T19:11:14.273707] [INFO ] [MAIN      ] Update Progress: 1023/2366 symbols completed. HIW took 34.8s. Estimated remaining: 2h 52m 14s. Rate: 7.8 symbols/min
[2025-10-24T19:11:14.451317] [INFO ] [MAIN      ] HLF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:11:14.463796] [INFO ] [REMOTE    ] HKD: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T19:11:14.499091] [INFO ] [REMOTE    ] HL: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T19:11:14.546824] [DEBUG] [LOCAL     ] HLF: Loaded 48722 existing records from primary storage.
[2025-10-24T19:11:14.547186] [INFO ] [MAIN      ] HLF: Loaded 48722 existing records.
[2025-10-24T19:11:14.552998] [INFO ] [REMOTE    ] HIX: Fetching primary data for 2025-06.
[2025-10-24T19:11:14.742690] [WARN ] [MAIN      ] HLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:11:14.742872] [INFO ] [MAIN      ] HLF: Wiping existing primary data before full refresh.
[2025-10-24T19:11:14.742964] [INFO ] [LOCAL     ] HLF: Starting deletion of primary data.
[2025-10-24T19:11:14.743392] [DEBUG] [LOCAL     ] HLF: Deleted primary data file.
[2025-10-24T19:11:14.743435] [INFO ] [MAIN      ] HLF: Starting full primary refresh.
[2025-10-24T19:11:15.092895] [INFO ] [REMOTE    ] HLF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:11:15.347674] [INFO ] [REMOTE    ] HKD: Fetching primary data for 2025-05.
[2025-10-24T19:11:15.705818] [INFO ] [REMOTE    ] HIX: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T19:11:16.147677] [INFO ] [REMOTE    ] HLF: Fetching primary data for 2025-01.
[2025-10-24T19:11:16.231435] [INFO ] [REMOTE    ] HKD: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T19:11:16.947664] [INFO ] [REMOTE    ] HL: Fetching primary data for 2025-02.
[2025-10-24T19:11:17.747638] [INFO ] [REMOTE    ] HKD: Fetching primary data for 2025-06.
[2025-10-24T19:11:18.268765] [INFO ] [REMOTE    ] HLF: Incremental fetch complete for 2025-01 (2.12 seconds).
[2025-10-24T19:11:18.547635] [INFO ] [REMOTE    ] HLF: Fetching primary data for 2025-02.
[2025-10-24T19:11:18.658833] [INFO ] [REMOTE    ] HL: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T19:11:19.125710] [INFO ] [REMOTE    ] HKD: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T19:11:19.347677] [INFO ] [REMOTE    ] HL: Fetching primary data for 2025-03.
[2025-10-24T19:11:19.952939] [INFO ] [REMOTE    ] HLF: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T19:11:20.147663] [INFO ] [REMOTE    ] HLF: Fetching primary data for 2025-03.
[2025-10-24T19:11:20.947626] [INFO ] [REMOTE    ] HKD: Fetching primary data for 2025-07.
[2025-10-24T19:11:21.451729] [INFO ] [REMOTE    ] HL: Incremental fetch complete for 2025-03 (2.10 seconds).
[2025-10-24T19:11:21.747628] [INFO ] [REMOTE    ] HL: Fetching primary data for 2025-04.
[2025-10-24T19:11:21.795338] [INFO ] [REMOTE    ] HLF: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T19:11:21.862286] [INFO ] [REMOTE    ] HKD: Incremental fetch complete for 2025-07 (0.91 seconds).
[2025-10-24T19:11:22.547711] [INFO ] [REMOTE    ] HLF: Fetching primary data for 2025-04.
[2025-10-24T19:11:23.347720] [INFO ] [REMOTE    ] HKD: Fetching primary data for 2025-08.
[2025-10-24T19:11:23.733557] [INFO ] [REMOTE    ] HL: Incremental fetch complete for 2025-04 (1.99 seconds).
[2025-10-24T19:11:23.939933] [INFO ] [REMOTE    ] HKD: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T19:11:24.147622] [INFO ] [REMOTE    ] HIX: Fetching primary data for 2025-07.
[2025-10-24T19:11:24.353331] [INFO ] [REMOTE    ] HLF: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T19:11:24.947716] [INFO ] [REMOTE    ] HL: Fetching primary data for 2025-05.
[2025-10-24T19:11:25.307879] [INFO ] [REMOTE    ] HIX: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T19:11:25.747689] [INFO ] [REMOTE    ] HKD: Fetching primary data for 2025-09.
[2025-10-24T19:11:26.549000] [INFO ] [REMOTE    ] HIX: Fetching primary data for 2025-08.
[2025-10-24T19:11:26.555165] [INFO ] [REMOTE    ] HL: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T19:11:26.907796] [INFO ] [REMOTE    ] HKD: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T19:11:27.347631] [INFO ] [REMOTE    ] HLF: Fetching primary data for 2025-05.
[2025-10-24T19:11:27.660937] [INFO ] [REMOTE    ] HIX: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T19:11:28.147754] [INFO ] [REMOTE    ] HIX: Fetching primary data for 2025-09.
[2025-10-24T19:11:28.859137] [INFO ] [REMOTE    ] HLF: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T19:11:28.947601] [INFO ] [REMOTE    ] HLF: Fetching primary data for 2025-06.
[2025-10-24T19:11:29.219351] [INFO ] [REMOTE    ] HIX: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T19:11:29.747674] [INFO ] [REMOTE    ] HIX: Fetching primary data for 2025-10.
[2025-10-24T19:11:30.328310] [INFO ] [REMOTE    ] HLF: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T19:11:30.547665] [INFO ] [REMOTE    ] HKD: Fetching primary data for 2025-10.
[2025-10-24T19:11:30.901622] [INFO ] [REMOTE    ] HIX: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T19:11:30.905793] [INFO ] [REMOTE    ] HIX: Full fetch complete (30074 records).
[2025-10-24T19:11:30.905872] [DEBUG] [VALIDATOR ] HIX: Validating primary data.
[2025-10-24T19:11:31.267636] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present.
[2025-10-24T19:11:31.267741] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed.
[2025-10-24T19:11:31.268392] [INFO ] [MAIN      ] HIX: Fetched primary data is valid.
[2025-10-24T19:11:31.268439] [DEBUG] [LOCAL     ] HIX: Saving primary data.
[2025-10-24T19:11:31.268779] [FATAL] [LOCAL     ] HIX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:11:31.268855] [FATAL] [MAIN      ] HIX: Failed to save primary data.
[2025-10-24T19:11:31.268920] [WARN ] [MAIN      ] HIX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:11:31.268986] [INFO ] [LOCAL     ] HIX: Starting deletion of primary data.
[2025-10-24T19:11:31.269043] [DEBUG] [LOCAL     ] HIX: No primary data file found to delete.
[2025-10-24T19:11:31.269078] [INFO ] [LOCAL     ] HIX: Starting deletion of derivative data.
[2025-10-24T19:11:31.269209] [DEBUG] [LOCAL     ] HIX: Deleted derivative data file.
[2025-10-24T19:11:31.269296] [INFO ] [MAIN      ] Update Progress: 1024/2366 symbols completed. HIX took 36.0s. Estimated remaining: 2h 52m 18s. Rate: 7.8 symbols/min
[2025-10-24T19:11:31.352719] [INFO ] [REMOTE    ] HL: Fetching primary data for 2025-06.
[2025-10-24T19:11:31.438913] [INFO ] [MAIN      ] HLI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:11:31.439145] [DEBUG] [LOCAL     ] HLI: No existing data file found in primary storage.
[2025-10-24T19:11:31.439324] [WARN ] [MAIN      ] HLI: No existing data found, performing full refresh instead.
[2025-10-24T19:11:31.439506] [INFO ] [MAIN      ] HLI: Wiping existing primary data before full refresh.
[2025-10-24T19:11:31.439549] [INFO ] [LOCAL     ] HLI: Starting deletion of primary data.
[2025-10-24T19:11:31.439591] [DEBUG] [LOCAL     ] HLI: No primary data file found to delete.
[2025-10-24T19:11:31.439622] [INFO ] [MAIN      ] HLI: Starting full primary refresh.
[2025-10-24T19:11:31.560170] [INFO ] [REMOTE    ] HKD: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T19:11:31.608082] [INFO ] [REMOTE    ] HKD: Full fetch complete (27819 records).
[2025-10-24T19:11:31.626736] [DEBUG] [VALIDATOR ] HKD: Validating primary data.
[2025-10-24T19:11:31.970754] [INFO ] [REMOTE    ] HLI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:11:32.152767] [INFO ] [REMOTE    ] HLI: Fetching primary data for 2025-01.
[2025-10-24T19:11:32.201576] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present.
[2025-10-24T19:11:32.201683] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed.
[2025-10-24T19:11:32.202325] [INFO ] [MAIN      ] HKD: Fetched primary data is valid.
[2025-10-24T19:11:32.202368] [DEBUG] [LOCAL     ] HKD: Saving primary data.
[2025-10-24T19:11:32.202787] [FATAL] [LOCAL     ] HKD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:11:32.202869] [FATAL] [MAIN      ] HKD: Failed to save primary data.
[2025-10-24T19:11:32.202912] [WARN ] [MAIN      ] HKD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:11:32.202977] [INFO ] [LOCAL     ] HKD: Starting deletion of primary data.
[2025-10-24T19:11:32.203034] [DEBUG] [LOCAL     ] HKD: No primary data file found to delete.
[2025-10-24T19:11:32.203071] [INFO ] [LOCAL     ] HKD: Starting deletion of derivative data.
[2025-10-24T19:11:32.203277] [DEBUG] [LOCAL     ] HKD: Deleted derivative data file.
[2025-10-24T19:11:32.203466] [INFO ] [MAIN      ] Update Progress: 1025/2366 symbols completed. HKD took 25.0s. Estimated remaining: 2h 52m 2s. Rate: 7.8 symbols/min
[2025-10-24T19:11:32.378134] [INFO ] [MAIN      ] HLIO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:11:32.407257] [DEBUG] [LOCAL     ] HLIO: Loaded 28229 existing records from primary storage.
[2025-10-24T19:11:32.407516] [INFO ] [MAIN      ] HLIO: Loaded 28229 existing records.
[2025-10-24T19:11:32.591108] [WARN ] [MAIN      ] HLIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:11:32.591330] [INFO ] [MAIN      ] HLIO: Wiping existing primary data before full refresh.
[2025-10-24T19:11:32.591378] [INFO ] [LOCAL     ] HLIO: Starting deletion of primary data.
[2025-10-24T19:11:32.591744] [DEBUG] [LOCAL     ] HLIO: Deleted primary data file.
[2025-10-24T19:11:32.591801] [INFO ] [MAIN      ] HLIO: Starting full primary refresh.
[2025-10-24T19:11:32.952563] [INFO ] [REMOTE    ] HLF: Fetching primary data for 2025-07.
[2025-10-24T19:11:32.974679] [INFO ] [REMOTE    ] HLIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:11:33.288849] [INFO ] [REMOTE    ] HL: Incremental fetch complete for 2025-06 (1.94 seconds).
[2025-10-24T19:11:33.376362] [INFO ] [REMOTE    ] HLI: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T19:11:33.747686] [INFO ] [REMOTE    ] HLIO: Fetching primary data for 2025-01.
[2025-10-24T19:11:34.547678] [INFO ] [REMOTE    ] HL: Fetching primary data for 2025-07.
[2025-10-24T19:11:34.738931] [INFO ] [REMOTE    ] HLF: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T19:11:34.749892] [INFO ] [REMOTE    ] HLIO: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T19:11:35.347674] [INFO ] [REMOTE    ] HLIO: Fetching primary data for 2025-02.
[2025-10-24T19:11:36.147614] [INFO ] [REMOTE    ] HLI: Fetching primary data for 2025-02.
[2025-10-24T19:11:36.308108] [INFO ] [REMOTE    ] HLIO: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T19:11:36.646191] [INFO ] [REMOTE    ] HL: Incremental fetch complete for 2025-07 (2.10 seconds).
[2025-10-24T19:11:36.947672] [INFO ] [REMOTE    ] HLIO: Fetching primary data for 2025-03.
[2025-10-24T19:11:37.480771] [INFO ] [REMOTE    ] HLI: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T19:11:37.747689] [INFO ] [REMOTE    ] HLI: Fetching primary data for 2025-03.
[2025-10-24T19:11:38.056232] [INFO ] [REMOTE    ] HLIO: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T19:11:38.547637] [INFO ] [REMOTE    ] HLF: Fetching primary data for 2025-08.
[2025-10-24T19:11:39.162943] [INFO ] [REMOTE    ] HLI: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T19:11:39.347682] [INFO ] [REMOTE    ] HL: Fetching primary data for 2025-08.
[2025-10-24T19:11:40.147746] [INFO ] [REMOTE    ] HLI: Fetching primary data for 2025-04.
[2025-10-24T19:11:40.285080] [INFO ] [REMOTE    ] HLF: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T19:11:40.947624] [INFO ] [REMOTE    ] HLIO: Fetching primary data for 2025-04.
[2025-10-24T19:11:41.353110] [INFO ] [REMOTE    ] HL: Incremental fetch complete for 2025-08 (2.01 seconds).
[2025-10-24T19:11:41.449397] [INFO ] [REMOTE    ] HLI: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T19:11:41.747682] [INFO ] [REMOTE    ] HL: Fetching primary data for 2025-09.
[2025-10-24T19:11:42.230917] [INFO ] [REMOTE    ] HLIO: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T19:11:42.547634] [INFO ] [REMOTE    ] HLF: Fetching primary data for 2025-09.
[2025-10-24T19:11:43.347723] [INFO ] [REMOTE    ] HLIO: Fetching primary data for 2025-05.
[2025-10-24T19:11:43.918732] [INFO ] [REMOTE    ] HL: Incremental fetch complete for 2025-09 (2.17 seconds).
[2025-10-24T19:11:44.151498] [INFO ] [REMOTE    ] HL: Fetching primary data for 2025-10.
[2025-10-24T19:11:44.154277] [INFO ] [REMOTE    ] HLF: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T19:11:44.300678] [INFO ] [REMOTE    ] HLIO: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T19:11:44.947621] [INFO ] [REMOTE    ] HLIO: Fetching primary data for 2025-06.
[2025-10-24T19:11:45.747690] [INFO ] [REMOTE    ] HLF: Fetching primary data for 2025-10.
[2025-10-24T19:11:46.318669] [INFO ] [REMOTE    ] HLIO: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T19:11:46.547619] [INFO ] [REMOTE    ] HLIO: Fetching primary data for 2025-07.
[2025-10-24T19:11:46.624969] [INFO ] [REMOTE    ] HL: Incremental fetch complete for 2025-10 (2.47 seconds).
[2025-10-24T19:11:46.634829] [INFO ] [REMOTE    ] HL: Full fetch complete (77827 records).
[2025-10-24T19:11:46.634957] [DEBUG] [VALIDATOR ] HL: Validating primary data.
[2025-10-24T19:11:47.028023] [DEBUG] [VALIDATOR ] HL: All expected trading days are present.
[2025-10-24T19:11:47.028128] [DEBUG] [VALIDATOR ] HL: Primary data validation passed.
[2025-10-24T19:11:47.029189] [INFO ] [MAIN      ] HL: Fetched primary data is valid.
[2025-10-24T19:11:47.029253] [DEBUG] [LOCAL     ] HL: Saving primary data.
[2025-10-24T19:11:47.029900] [FATAL] [LOCAL     ] HL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:11:47.029981] [FATAL] [MAIN      ] HL: Failed to save primary data.
[2025-10-24T19:11:47.030025] [WARN ] [MAIN      ] HL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:11:47.030088] [INFO ] [LOCAL     ] HL: Starting deletion of primary data.
[2025-10-24T19:11:47.030152] [DEBUG] [LOCAL     ] HL: No primary data file found to delete.
[2025-10-24T19:11:47.030188] [INFO ] [LOCAL     ] HL: Starting deletion of derivative data.
[2025-10-24T19:11:47.030310] [DEBUG] [LOCAL     ] HL: Deleted derivative data file.
[2025-10-24T19:11:47.030586] [INFO ] [MAIN      ] Update Progress: 1026/2366 symbols completed. HL took 36.2s. Estimated remaining: 2h 52m 3s. Rate: 7.8 symbols/min
[2025-10-24T19:11:47.202363] [INFO ] [MAIN      ] HLLY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:11:47.235899] [DEBUG] [LOCAL     ] HLLY: Loaded 33526 existing records from primary storage.
[2025-10-24T19:11:47.236185] [INFO ] [MAIN      ] HLLY: Loaded 33526 existing records.
[2025-10-24T19:11:47.351567] [INFO ] [REMOTE    ] HLI: Fetching primary data for 2025-05.
[2025-10-24T19:11:47.443592] [WARN ] [MAIN      ] HLLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:11:47.457744] [INFO ] [MAIN      ] HLLY: Wiping existing primary data before full refresh.
[2025-10-24T19:11:47.466197] [INFO ] [LOCAL     ] HLLY: Starting deletion of primary data.
[2025-10-24T19:11:47.468035] [INFO ] [REMOTE    ] HLF: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T19:11:47.471040] [DEBUG] [LOCAL     ] HLLY: Deleted primary data file.
[2025-10-24T19:11:47.476428] [INFO ] [MAIN      ] HLLY: Starting full primary refresh.
[2025-10-24T19:11:47.490578] [INFO ] [REMOTE    ] HLF: Full fetch complete (70748 records).
[2025-10-24T19:11:47.513050] [DEBUG] [VALIDATOR ] HLF: Validating primary data.
[2025-10-24T19:11:48.481938] [INFO ] [REMOTE    ] HLIO: Incremental fetch complete for 2025-07 (1.93 seconds).
[2025-10-24T19:11:48.573973] [INFO ] [REMOTE    ] HLIO: Fetching primary data for 2025-08.
[2025-10-24T19:11:48.573357] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present.
[2025-10-24T19:11:48.597524] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed.
[2025-10-24T19:11:48.608773] [INFO ] [MAIN      ] HLF: Fetched primary data is valid.
[2025-10-24T19:11:48.609091] [DEBUG] [LOCAL     ] HLF: Saving primary data.
[2025-10-24T19:11:48.630995] [INFO ] [REMOTE    ] HLLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:11:48.610493] [FATAL] [LOCAL     ] HLF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:11:48.631454] [FATAL] [MAIN      ] HLF: Failed to save primary data.
[2025-10-24T19:11:48.631542] [WARN ] [MAIN      ] HLF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:11:48.631632] [INFO ] [LOCAL     ] HLF: Starting deletion of primary data.
[2025-10-24T19:11:48.631742] [DEBUG] [LOCAL     ] HLF: No primary data file found to delete.
[2025-10-24T19:11:48.631788] [INFO ] [LOCAL     ] HLF: Starting deletion of derivative data.
[2025-10-24T19:11:48.632072] [DEBUG] [LOCAL     ] HLF: Deleted derivative data file.
[2025-10-24T19:11:48.632337] [INFO ] [MAIN      ] Update Progress: 1027/2366 symbols completed. HLF took 34.4s. Estimated remaining: 2h 51m 47s. Rate: 7.8 symbols/min
[2025-10-24T19:11:48.830599] [INFO ] [MAIN      ] HLN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:11:48.851296] [INFO ] [REMOTE    ] HLI: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T19:11:48.907594] [DEBUG] [LOCAL     ] HLN: Loaded 53505 existing records from primary storage.
[2025-10-24T19:11:48.907949] [INFO ] [MAIN      ] HLN: Loaded 53505 existing records.
[2025-10-24T19:11:48.952847] [INFO ] [REMOTE    ] HLLY: Fetching primary data for 2025-01.
[2025-10-24T19:11:49.095879] [WARN ] [MAIN      ] HLN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:11:49.096102] [INFO ] [MAIN      ] HLN: Wiping existing primary data before full refresh.
[2025-10-24T19:11:49.096153] [INFO ] [LOCAL     ] HLN: Starting deletion of primary data.
[2025-10-24T19:11:49.096381] [DEBUG] [LOCAL     ] HLN: Deleted primary data file.
[2025-10-24T19:11:49.096441] [INFO ] [MAIN      ] HLN: Starting full primary refresh.
[2025-10-24T19:11:49.443609] [INFO ] [REMOTE    ] HLN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:11:49.747719] [INFO ] [REMOTE    ] HLI: Fetching primary data for 2025-06.
[2025-10-24T19:11:49.960274] [INFO ] [REMOTE    ] HLIO: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T19:11:50.143104] [INFO ] [REMOTE    ] HLLY: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T19:11:50.547692] [INFO ] [REMOTE    ] HLN: Fetching primary data for 2025-01.
[2025-10-24T19:11:50.982174] [INFO ] [REMOTE    ] HLI: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T19:11:51.347661] [INFO ] [REMOTE    ] HLLY: Fetching primary data for 2025-02.
[2025-10-24T19:11:52.035100] [INFO ] [REMOTE    ] HLN: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T19:11:52.147610] [INFO ] [REMOTE    ] HLI: Fetching primary data for 2025-07.
[2025-10-24T19:11:52.374906] [INFO ] [REMOTE    ] HLLY: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T19:11:52.947726] [INFO ] [REMOTE    ] HLIO: Fetching primary data for 2025-09.
[2025-10-24T19:11:53.612465] [INFO ] [REMOTE    ] HLI: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T19:11:53.747639] [INFO ] [REMOTE    ] HLLY: Fetching primary data for 2025-03.
[2025-10-24T19:11:54.261158] [INFO ] [REMOTE    ] HLIO: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T19:11:54.547712] [INFO ] [REMOTE    ] HLI: Fetching primary data for 2025-08.
[2025-10-24T19:11:55.115050] [INFO ] [REMOTE    ] HLLY: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T19:11:55.347723] [INFO ] [REMOTE    ] HLIO: Fetching primary data for 2025-10.
[2025-10-24T19:11:55.551363] [INFO ] [REMOTE    ] HLI: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T19:11:56.147667] [INFO ] [REMOTE    ] HLLY: Fetching primary data for 2025-04.
[2025-10-24T19:11:56.251868] [INFO ] [REMOTE    ] HLIO: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T19:11:56.256752] [INFO ] [REMOTE    ] HLIO: Full fetch complete (37200 records).
[2025-10-24T19:11:56.256887] [DEBUG] [VALIDATOR ] HLIO: Validating primary data.
[2025-10-24T19:11:56.616360] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present.
[2025-10-24T19:11:56.616437] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed.
[2025-10-24T19:11:56.617112] [INFO ] [MAIN      ] HLIO: Fetched primary data is valid.
[2025-10-24T19:11:56.617197] [DEBUG] [LOCAL     ] HLIO: Saving primary data.
[2025-10-24T19:11:56.617570] [FATAL] [LOCAL     ] HLIO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:11:56.617682] [FATAL] [MAIN      ] HLIO: Failed to save primary data.
[2025-10-24T19:11:56.617734] [WARN ] [MAIN      ] HLIO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:11:56.617801] [INFO ] [LOCAL     ] HLIO: Starting deletion of primary data.
[2025-10-24T19:11:56.617864] [DEBUG] [LOCAL     ] HLIO: No primary data file found to delete.
[2025-10-24T19:11:56.617899] [INFO ] [LOCAL     ] HLIO: Starting deletion of derivative data.
[2025-10-24T19:11:56.618057] [DEBUG] [LOCAL     ] HLIO: Deleted derivative data file.
[2025-10-24T19:11:56.618147] [INFO ] [MAIN      ] Update Progress: 1028/2366 symbols completed. HLIO took 24.4s. Estimated remaining: 2h 51m 40s. Rate: 7.8 symbols/min
[2025-10-24T19:11:56.786014] [INFO ] [MAIN      ] HLT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:11:56.859182] [DEBUG] [LOCAL     ] HLT: Loaded 50826 existing records from primary storage.
[2025-10-24T19:11:56.859475] [INFO ] [MAIN      ] HLT: Loaded 50826 existing records.
[2025-10-24T19:11:56.954840] [INFO ] [REMOTE    ] HLI: Fetching primary data for 2025-09.
[2025-10-24T19:11:57.037622] [WARN ] [MAIN      ] HLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:11:57.037820] [INFO ] [MAIN      ] HLT: Wiping existing primary data before full refresh.
[2025-10-24T19:11:57.037895] [INFO ] [LOCAL     ] HLT: Starting deletion of primary data.
[2025-10-24T19:11:57.038521] [DEBUG] [LOCAL     ] HLT: Deleted primary data file.
[2025-10-24T19:11:57.038589] [INFO ] [MAIN      ] HLT: Starting full primary refresh.
[2025-10-24T19:11:57.389976] [INFO ] [REMOTE    ] HLT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:11:57.528168] [INFO ] [REMOTE    ] HLLY: Incremental fetch complete for 2025-04 (1.38 seconds).
[2025-10-24T19:11:57.747616] [INFO ] [REMOTE    ] HLN: Fetching primary data for 2025-02.
[2025-10-24T19:11:58.257429] [INFO ] [REMOTE    ] HLI: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T19:11:58.547633] [INFO ] [REMOTE    ] HLI: Fetching primary data for 2025-10.
[2025-10-24T19:11:59.347695] [INFO ] [REMOTE    ] HLT: Fetching primary data for 2025-01.
[2025-10-24T19:11:59.387234] [INFO ] [REMOTE    ] HLN: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T19:11:59.911061] [INFO ] [REMOTE    ] HLI: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T19:11:59.916918] [INFO ] [REMOTE    ] HLI: Full fetch complete (45483 records).
[2025-10-24T19:11:59.917011] [DEBUG] [VALIDATOR ] HLI: Validating primary data.
[2025-10-24T19:12:00.154439] [INFO ] [REMOTE    ] HLLY: Fetching primary data for 2025-05.
[2025-10-24T19:12:00.318862] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present.
[2025-10-24T19:12:00.318941] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed.
[2025-10-24T19:12:00.319701] [INFO ] [MAIN      ] HLI: Fetched primary data is valid.
[2025-10-24T19:12:00.319762] [DEBUG] [LOCAL     ] HLI: Saving primary data.
[2025-10-24T19:12:00.320142] [FATAL] [LOCAL     ] HLI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:12:00.320255] [FATAL] [MAIN      ] HLI: Failed to save primary data.
[2025-10-24T19:12:00.320297] [WARN ] [MAIN      ] HLI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:12:00.320486] [INFO ] [LOCAL     ] HLI: Starting deletion of primary data.
[2025-10-24T19:12:00.320609] [DEBUG] [LOCAL     ] HLI: No primary data file found to delete.
[2025-10-24T19:12:00.320730] [INFO ] [LOCAL     ] HLI: Starting deletion of derivative data.
[2025-10-24T19:12:00.320834] [DEBUG] [LOCAL     ] HLI: No derivative data file found to delete.
[2025-10-24T19:12:00.320953] [INFO ] [MAIN      ] Update Progress: 1029/2366 symbols completed. HLI took 29.1s. Estimated remaining: 2h 51m 27s. Rate: 7.8 symbols/min
[2025-10-24T19:12:00.500283] [INFO ] [MAIN      ] HLX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:12:00.544859] [DEBUG] [LOCAL     ] HLX: Loaded 47701 existing records from primary storage.
[2025-10-24T19:12:00.545173] [INFO ] [MAIN      ] HLX: Loaded 47701 existing records.
[2025-10-24T19:12:00.716683] [WARN ] [MAIN      ] HLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:12:00.716910] [INFO ] [MAIN      ] HLX: Wiping existing primary data before full refresh.
[2025-10-24T19:12:00.716958] [INFO ] [LOCAL     ] HLX: Starting deletion of primary data.
[2025-10-24T19:12:00.717592] [DEBUG] [LOCAL     ] HLX: Deleted primary data file.
[2025-10-24T19:12:00.717683] [INFO ] [MAIN      ] HLX: Starting full primary refresh.
[2025-10-24T19:12:00.957118] [INFO ] [REMOTE    ] HLN: Fetching primary data for 2025-03.
[2025-10-24T19:12:01.073268] [INFO ] [REMOTE    ] HLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:12:01.319951] [INFO ] [REMOTE    ] HLT: Incremental fetch complete for 2025-01 (1.97 seconds).
[2025-10-24T19:12:01.638877] [INFO ] [REMOTE    ] HLLY: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T19:12:01.747710] [INFO ] [REMOTE    ] HLX: Fetching primary data for 2025-01.
[2025-10-24T19:12:02.547616] [INFO ] [REMOTE    ] HLLY: Fetching primary data for 2025-06.
[2025-10-24T19:12:02.980374] [INFO ] [REMOTE    ] HLN: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T19:12:03.347707] [INFO ] [REMOTE    ] HLT: Fetching primary data for 2025-02.
[2025-10-24T19:12:03.385527] [INFO ] [REMOTE    ] HLX: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T19:12:03.672797] [INFO ] [REMOTE    ] HLLY: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T19:12:04.147688] [INFO ] [REMOTE    ] HLN: Fetching primary data for 2025-04.
[2025-10-24T19:12:04.947726] [INFO ] [REMOTE    ] HLX: Fetching primary data for 2025-02.
[2025-10-24T19:12:05.068240] [INFO ] [REMOTE    ] HLT: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T19:12:05.546878] [INFO ] [REMOTE    ] HLN: Incremental fetch complete for 2025-04 (1.40 seconds).
[2025-10-24T19:12:05.747686] [INFO ] [REMOTE    ] HLLY: Fetching primary data for 2025-07.
[2025-10-24T19:12:06.443820] [INFO ] [REMOTE    ] HLX: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T19:12:06.547608] [INFO ] [REMOTE    ] HLX: Fetching primary data for 2025-03.
[2025-10-24T19:12:06.999631] [INFO ] [REMOTE    ] HLLY: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T19:12:07.347699] [INFO ] [REMOTE    ] HLLY: Fetching primary data for 2025-08.
[2025-10-24T19:12:08.089086] [INFO ] [REMOTE    ] HLX: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T19:12:08.147603] [INFO ] [REMOTE    ] HLX: Fetching primary data for 2025-04.
[2025-10-24T19:12:08.857872] [INFO ] [REMOTE    ] HLLY: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T19:12:08.947677] [INFO ] [REMOTE    ] HLLY: Fetching primary data for 2025-09.
[2025-10-24T19:12:09.747745] [INFO ] [REMOTE    ] HLT: Fetching primary data for 2025-03.
[2025-10-24T19:12:09.892101] [INFO ] [REMOTE    ] HLX: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T19:12:10.377296] [INFO ] [REMOTE    ] HLLY: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T19:12:10.547609] [INFO ] [REMOTE    ] HLLY: Fetching primary data for 2025-10.
[2025-10-24T19:12:11.283702] [INFO ] [REMOTE    ] HLT: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T19:12:11.347603] [INFO ] [REMOTE    ] HLT: Fetching primary data for 2025-04.
[2025-10-24T19:12:11.525400] [INFO ] [REMOTE    ] HLLY: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T19:12:11.531308] [INFO ] [REMOTE    ] HLLY: Full fetch complete (46071 records).
[2025-10-24T19:12:11.531415] [DEBUG] [VALIDATOR ] HLLY: Validating primary data.
[2025-10-24T19:12:11.896397] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present.
[2025-10-24T19:12:11.896472] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed.
[2025-10-24T19:12:11.897231] [INFO ] [MAIN      ] HLLY: Fetched primary data is valid.
[2025-10-24T19:12:11.897296] [DEBUG] [LOCAL     ] HLLY: Saving primary data.
[2025-10-24T19:12:11.897695] [FATAL] [LOCAL     ] HLLY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:12:11.897782] [FATAL] [MAIN      ] HLLY: Failed to save primary data.
[2025-10-24T19:12:11.897823] [WARN ] [MAIN      ] HLLY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:12:11.897857] [INFO ] [LOCAL     ] HLLY: Starting deletion of primary data.
[2025-10-24T19:12:11.897904] [DEBUG] [LOCAL     ] HLLY: No primary data file found to delete.
[2025-10-24T19:12:11.897942] [INFO ] [LOCAL     ] HLLY: Starting deletion of derivative data.
[2025-10-24T19:12:11.898070] [DEBUG] [LOCAL     ] HLLY: Deleted derivative data file.
[2025-10-24T19:12:11.898547] [INFO ] [MAIN      ] Update Progress: 1030/2366 symbols completed. HLLY took 24.9s. Estimated remaining: 2h 51m 25s. Rate: 7.8 symbols/min
[2025-10-24T19:12:12.068726] [INFO ] [MAIN      ] HMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:12:12.113845] [DEBUG] [LOCAL     ] HMC: Loaded 46564 existing records from primary storage.
[2025-10-24T19:12:12.114139] [INFO ] [MAIN      ] HMC: Loaded 46564 existing records.
[2025-10-24T19:12:12.156040] [INFO ] [REMOTE    ] HLX: Fetching primary data for 2025-05.
[2025-10-24T19:12:12.313401] [WARN ] [MAIN      ] HMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:12:12.313606] [INFO ] [MAIN      ] HMC: Wiping existing primary data before full refresh.
[2025-10-24T19:12:12.313707] [INFO ] [LOCAL     ] HMC: Starting deletion of primary data.
[2025-10-24T19:12:12.314056] [DEBUG] [LOCAL     ] HMC: Deleted primary data file.
[2025-10-24T19:12:12.314111] [INFO ] [MAIN      ] HMC: Starting full primary refresh.
[2025-10-24T19:12:12.656772] [INFO ] [REMOTE    ] HMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:12:12.947613] [INFO ] [REMOTE    ] HMC: Fetching primary data for 2025-01.
[2025-10-24T19:12:13.255132] [INFO ] [REMOTE    ] HLT: Incremental fetch complete for 2025-04 (1.91 seconds).
[2025-10-24T19:12:13.747683] [INFO ] [REMOTE    ] HLN: Fetching primary data for 2025-05.
[2025-10-24T19:12:13.853869] [INFO ] [REMOTE    ] HLX: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T19:12:14.547624] [INFO ] [REMOTE    ] HLT: Fetching primary data for 2025-05.
[2025-10-24T19:12:14.777801] [INFO ] [REMOTE    ] HMC: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T19:12:15.347692] [INFO ] [REMOTE    ] HMC: Fetching primary data for 2025-02.
[2025-10-24T19:12:15.408209] [INFO ] [REMOTE    ] HLN: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T19:12:16.033501] [INFO ] [REMOTE    ] HLT: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T19:12:16.147631] [INFO ] [REMOTE    ] HLT: Fetching primary data for 2025-06.
[2025-10-24T19:12:16.947709] [INFO ] [REMOTE    ] HLN: Fetching primary data for 2025-06.
[2025-10-24T19:12:17.166623] [INFO ] [REMOTE    ] HMC: Incremental fetch complete for 2025-02 (1.82 seconds).
[2025-10-24T19:12:17.576512] [INFO ] [REMOTE    ] HLT: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T19:12:17.747737] [INFO ] [REMOTE    ] HLX: Fetching primary data for 2025-06.
[2025-10-24T19:12:18.363605] [INFO ] [REMOTE    ] HLN: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T19:12:18.547713] [INFO ] [REMOTE    ] HLT: Fetching primary data for 2025-07.
[2025-10-24T19:12:19.330730] [INFO ] [REMOTE    ] HLX: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T19:12:19.347597] [INFO ] [REMOTE    ] HLX: Fetching primary data for 2025-07.
[2025-10-24T19:12:19.917063] [INFO ] [REMOTE    ] HLT: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T19:12:20.147746] [INFO ] [REMOTE    ] HLN: Fetching primary data for 2025-07.
[2025-10-24T19:12:20.736845] [INFO ] [REMOTE    ] HLX: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T19:12:20.947734] [INFO ] [REMOTE    ] HMC: Fetching primary data for 2025-03.
[2025-10-24T19:12:21.747850] [INFO ] [REMOTE    ] HLT: Fetching primary data for 2025-08.
[2025-10-24T19:12:21.907407] [INFO ] [REMOTE    ] HLN: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T19:12:22.547619] [INFO ] [REMOTE    ] HLX: Fetching primary data for 2025-08.
[2025-10-24T19:12:22.737739] [INFO ] [REMOTE    ] HMC: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T19:12:23.347680] [INFO ] [REMOTE    ] HMC: Fetching primary data for 2025-04.
[2025-10-24T19:12:23.693426] [INFO ] [REMOTE    ] HLT: Incremental fetch complete for 2025-08 (1.95 seconds).
[2025-10-24T19:12:24.147707] [INFO ] [REMOTE    ] HLT: Fetching primary data for 2025-09.
[2025-10-24T19:12:24.269866] [INFO ] [REMOTE    ] HLX: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T19:12:24.957342] [INFO ] [REMOTE    ] HLN: Fetching primary data for 2025-08.
[2025-10-24T19:12:24.976921] [INFO ] [REMOTE    ] HMC: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T19:12:25.752776] [INFO ] [REMOTE    ] HMC: Fetching primary data for 2025-05.
[2025-10-24T19:12:25.767189] [INFO ] [REMOTE    ] HLT: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T19:12:26.547632] [INFO ] [REMOTE    ] HLT: Fetching primary data for 2025-10.
[2025-10-24T19:12:26.805016] [INFO ] [REMOTE    ] HLN: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T19:12:27.347680] [INFO ] [REMOTE    ] HLX: Fetching primary data for 2025-09.
[2025-10-24T19:12:27.400277] [INFO ] [REMOTE    ] HMC: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T19:12:28.147698] [INFO ] [REMOTE    ] HMC: Fetching primary data for 2025-06.
[2025-10-24T19:12:28.673324] [INFO ] [REMOTE    ] HLT: Incremental fetch complete for 2025-10 (2.13 seconds).
[2025-10-24T19:12:28.683784] [INFO ] [REMOTE    ] HLT: Full fetch complete (73656 records).
[2025-10-24T19:12:28.683969] [DEBUG] [VALIDATOR ] HLT: Validating primary data.
[2025-10-24T19:12:28.952748] [INFO ] [REMOTE    ] HLN: Fetching primary data for 2025-09.
[2025-10-24T19:12:29.125413] [INFO ] [REMOTE    ] HLX: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T19:12:29.201388] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present.
[2025-10-24T19:12:29.201496] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed.
[2025-10-24T19:12:29.202733] [INFO ] [MAIN      ] HLT: Fetched primary data is valid.
[2025-10-24T19:12:29.202812] [DEBUG] [LOCAL     ] HLT: Saving primary data.
[2025-10-24T19:12:29.203600] [FATAL] [LOCAL     ] HLT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:12:29.203719] [FATAL] [MAIN      ] HLT: Failed to save primary data.
[2025-10-24T19:12:29.203766] [WARN ] [MAIN      ] HLT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:12:29.203847] [INFO ] [LOCAL     ] HLT: Starting deletion of primary data.
[2025-10-24T19:12:29.203936] [DEBUG] [LOCAL     ] HLT: No primary data file found to delete.
[2025-10-24T19:12:29.204051] [INFO ] [LOCAL     ] HLT: Starting deletion of derivative data.
[2025-10-24T19:12:29.204276] [DEBUG] [LOCAL     ] HLT: Deleted derivative data file.
[2025-10-24T19:12:29.205093] [INFO ] [MAIN      ] Update Progress: 1031/2366 symbols completed. HLT took 32.6s. Estimated remaining: 2h 51m 29s. Rate: 7.8 symbols/min
[2025-10-24T19:12:29.406789] [INFO ] [MAIN      ] HMN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:12:29.432379] [DEBUG] [LOCAL     ] HMN: Loaded 23364 existing records from primary storage.
[2025-10-24T19:12:29.432850] [INFO ] [MAIN      ] HMN: Loaded 23364 existing records.
[2025-10-24T19:12:29.635171] [WARN ] [MAIN      ] HMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:12:29.635377] [INFO ] [MAIN      ] HMN: Wiping existing primary data before full refresh.
[2025-10-24T19:12:29.635428] [INFO ] [LOCAL     ] HMN: Starting deletion of primary data.
[2025-10-24T19:12:29.635715] [DEBUG] [LOCAL     ] HMN: Deleted primary data file.
[2025-10-24T19:12:29.635771] [INFO ] [MAIN      ] HMN: Starting full primary refresh.
[2025-10-24T19:12:29.752392] [INFO ] [REMOTE    ] HLX: Fetching primary data for 2025-10.
[2025-10-24T19:12:30.019519] [INFO ] [REMOTE    ] HMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:12:30.014517] [INFO ] [REMOTE    ] HMC: Incremental fetch complete for 2025-06 (1.87 seconds).
[2025-10-24T19:12:30.547623] [INFO ] [REMOTE    ] HMC: Fetching primary data for 2025-07.
[2025-10-24T19:12:30.719393] [INFO ] [REMOTE    ] HLN: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T19:12:31.347677] [INFO ] [REMOTE    ] HMN: Fetching primary data for 2025-01.
[2025-10-24T19:12:31.669286] [INFO ] [REMOTE    ] HLX: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T19:12:31.677548] [INFO ] [REMOTE    ] HLX: Full fetch complete (69000 records).
[2025-10-24T19:12:31.677725] [DEBUG] [VALIDATOR ] HLX: Validating primary data.
[2025-10-24T19:12:32.073798] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present.
[2025-10-24T19:12:32.073903] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed.
[2025-10-24T19:12:32.074916] [INFO ] [MAIN      ] HLX: Fetched primary data is valid.
[2025-10-24T19:12:32.075109] [DEBUG] [LOCAL     ] HLX: Saving primary data.
[2025-10-24T19:12:32.075836] [FATAL] [LOCAL     ] HLX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:12:32.075922] [FATAL] [MAIN      ] HLX: Failed to save primary data.
[2025-10-24T19:12:32.075990] [WARN ] [MAIN      ] HLX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:12:32.076058] [INFO ] [LOCAL     ] HLX: Starting deletion of primary data.
[2025-10-24T19:12:32.076122] [DEBUG] [LOCAL     ] HLX: No primary data file found to delete.
[2025-10-24T19:12:32.076159] [INFO ] [LOCAL     ] HLX: Starting deletion of derivative data.
[2025-10-24T19:12:32.076330] [DEBUG] [LOCAL     ] HLX: Deleted derivative data file.
[2025-10-24T19:12:32.076550] [INFO ] [MAIN      ] Update Progress: 1032/2366 symbols completed. HLX took 31.8s. Estimated remaining: 2h 51m 15s. Rate: 7.8 symbols/min
[2025-10-24T19:12:32.150526] [INFO ] [REMOTE    ] HLN: Fetching primary data for 2025-10.
[2025-10-24T19:12:32.288984] [INFO ] [MAIN      ] HMY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:12:32.285889] [INFO ] [REMOTE    ] HMC: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T19:12:32.352477] [DEBUG] [LOCAL     ] HMY: Loaded 53556 existing records from primary storage.
[2025-10-24T19:12:32.352863] [INFO ] [MAIN      ] HMY: Loaded 53556 existing records.
[2025-10-24T19:12:32.535423] [WARN ] [MAIN      ] HMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:12:32.535682] [INFO ] [MAIN      ] HMY: Wiping existing primary data before full refresh.
[2025-10-24T19:12:32.535794] [INFO ] [LOCAL     ] HMY: Starting deletion of primary data.
[2025-10-24T19:12:32.536212] [DEBUG] [LOCAL     ] HMY: Deleted primary data file.
[2025-10-24T19:12:32.536269] [INFO ] [MAIN      ] HMY: Starting full primary refresh.
[2025-10-24T19:12:32.646968] [INFO ] [REMOTE    ] HMN: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T19:12:32.918379] [INFO ] [REMOTE    ] HMY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:12:32.947633] [INFO ] [REMOTE    ] HMC: Fetching primary data for 2025-08.
[2025-10-24T19:12:33.747724] [INFO ] [REMOTE    ] HMY: Fetching primary data for 2025-01.
[2025-10-24T19:12:34.199087] [INFO ] [REMOTE    ] HLN: Incremental fetch complete for 2025-10 (2.05 seconds).
[2025-10-24T19:12:34.209811] [INFO ] [REMOTE    ] HLN: Full fetch complete (77035 records).
[2025-10-24T19:12:34.210010] [DEBUG] [VALIDATOR ] HLN: Validating primary data.
[2025-10-24T19:12:34.550556] [INFO ] [REMOTE    ] HMN: Fetching primary data for 2025-02.
[2025-10-24T19:12:34.732018] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present.
[2025-10-24T19:12:34.757358] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed.
[2025-10-24T19:12:34.761775] [INFO ] [MAIN      ] HLN: Fetched primary data is valid.
[2025-10-24T19:12:34.764299] [INFO ] [REMOTE    ] HMC: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T19:12:34.762638] [DEBUG] [LOCAL     ] HLN: Saving primary data.
[2025-10-24T19:12:34.774995] [FATAL] [LOCAL     ] HLN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:12:34.775531] [FATAL] [MAIN      ] HLN: Failed to save primary data.
[2025-10-24T19:12:34.775602] [WARN ] [MAIN      ] HLN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:12:34.775703] [INFO ] [LOCAL     ] HLN: Starting deletion of primary data.
[2025-10-24T19:12:34.775779] [DEBUG] [LOCAL     ] HLN: No primary data file found to delete.
[2025-10-24T19:12:34.775818] [INFO ] [LOCAL     ] HLN: Starting deletion of derivative data.
[2025-10-24T19:12:34.776019] [DEBUG] [LOCAL     ] HLN: Deleted derivative data file.
[2025-10-24T19:12:34.776684] [INFO ] [MAIN      ] Update Progress: 1033/2366 symbols completed. HLN took 46.1s. Estimated remaining: 2h 51m 1s. Rate: 7.8 symbols/min
[2025-10-24T19:12:35.033805] [INFO ] [MAIN      ] HNGE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:12:35.034054] [DEBUG] [LOCAL     ] HNGE: No existing data file found in primary storage.
[2025-10-24T19:12:35.034114] [WARN ] [MAIN      ] HNGE: No existing data found, performing full refresh instead.
[2025-10-24T19:12:35.034263] [INFO ] [MAIN      ] HNGE: Wiping existing primary data before full refresh.
[2025-10-24T19:12:35.034325] [INFO ] [LOCAL     ] HNGE: Starting deletion of primary data.
[2025-10-24T19:12:35.034395] [DEBUG] [LOCAL     ] HNGE: No primary data file found to delete.
[2025-10-24T19:12:35.034452] [INFO ] [MAIN      ] HNGE: Starting full primary refresh.
[2025-10-24T19:12:35.350388] [INFO ] [REMOTE    ] HMC: Fetching primary data for 2025-09.
[2025-10-24T19:12:35.595814] [INFO ] [REMOTE    ] HNGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:12:35.630282] [INFO ] [REMOTE    ] HMY: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T19:12:35.660367] [INFO ] [REMOTE    ] HMN: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T19:12:36.147716] [INFO ] [REMOTE    ] HMY: Fetching primary data for 2025-02.
[2025-10-24T19:12:36.947709] [INFO ] [REMOTE    ] HMN: Fetching primary data for 2025-03.
[2025-10-24T19:12:37.025213] [INFO ] [REMOTE    ] HMC: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T19:12:37.747687] [INFO ] [REMOTE    ] HMC: Fetching primary data for 2025-10.
[2025-10-24T19:12:37.971227] [INFO ] [REMOTE    ] HMN: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T19:12:38.064813] [INFO ] [REMOTE    ] HMY: Incremental fetch complete for 2025-02 (1.92 seconds).
[2025-10-24T19:12:38.547716] [INFO ] [REMOTE    ] HMN: Fetching primary data for 2025-04.
[2025-10-24T19:12:39.347614] [INFO ] [REMOTE    ] HNGE: Fetching primary data for 2025-01.
[2025-10-24T19:12:39.558582] [INFO ] [REMOTE    ] HMC: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T19:12:39.567136] [INFO ] [REMOTE    ] HMC: Full fetch complete (68484 records).
[2025-10-24T19:12:39.567283] [DEBUG] [VALIDATOR ] HMC: Validating primary data.
[2025-10-24T19:12:39.884868] [INFO ] [REMOTE    ] HMN: Incremental fetch complete for 2025-04 (1.34 seconds).
[2025-10-24T19:12:39.911276] [DEBUG] [REMOTE    ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:12:39.911900] [WARN ] [REMOTE    ] HNGE: No data returned for month 2025-01
[2025-10-24T19:12:39.917428] [FATAL] [REMOTE    ] HNGE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:12:39.942694] [FATAL] [MAIN      ] HNGE: Failed to fetch primary data.
[2025-10-24T19:12:39.950930] [WARN ] [MAIN      ] HNGE: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:12:39.951040] [INFO ] [LOCAL     ] HNGE: Starting deletion of primary data.
[2025-10-24T19:12:39.985114] [DEBUG] [LOCAL     ] HNGE: No primary data file found to delete.
[2025-10-24T19:12:39.988704] [INFO ] [LOCAL     ] HNGE: Starting deletion of derivative data.
[2025-10-24T19:12:39.988909] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present.
[2025-10-24T19:12:39.988987] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed.
[2025-10-24T19:12:39.988835] [DEBUG] [LOCAL     ] HNGE: No derivative data file found to delete.
[2025-10-24T19:12:39.989097] [INFO ] [MAIN      ] Update Progress: 1034/2366 symbols completed. HNGE took 5.2s. Estimated remaining: 2h 50m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:12:39.990106] [INFO ] [MAIN      ] HMC: Fetched primary data is valid.
[2025-10-24T19:12:39.990360] [DEBUG] [LOCAL     ] HMC: Saving primary data.
[2025-10-24T19:12:40.057494] [FATAL] [LOCAL     ] HMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:12:40.074551] [FATAL] [MAIN      ] HMC: Failed to save primary data.
[2025-10-24T19:12:40.101391] [WARN ] [MAIN      ] HMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:12:40.101608] [INFO ] [LOCAL     ] HMC: Starting deletion of primary data.
[2025-10-24T19:12:40.107439] [DEBUG] [LOCAL     ] HMC: No primary data file found to delete.
[2025-10-24T19:12:40.112675] [INFO ] [LOCAL     ] HMC: Starting deletion of derivative data.
[2025-10-24T19:12:40.117971] [DEBUG] [LOCAL     ] HMC: Deleted derivative data file.
[2025-10-24T19:12:40.139004] [INFO ] [MAIN      ] Update Progress: 1035/2366 symbols completed. HMC took 28.2s. Estimated remaining: 2h 50m 33s. Rate: 7.8 symbols/min
[2025-10-24T19:12:40.155401] [INFO ] [REMOTE    ] HMN: Fetching primary data for 2025-05.
[2025-10-24T19:12:40.223745] [INFO ] [MAIN      ] HNI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:12:40.377683] [INFO ] [MAIN      ] HOG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:12:40.389271] [DEBUG] [LOCAL     ] HNI: Loaded 29986 existing records from primary storage.
[2025-10-24T19:12:40.389775] [INFO ] [MAIN      ] HNI: Loaded 29986 existing records.
[2025-10-24T19:12:40.585549] [WARN ] [MAIN      ] HNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:12:40.585833] [INFO ] [MAIN      ] HNI: Wiping existing primary data before full refresh.
[2025-10-24T19:12:40.585887] [INFO ] [LOCAL     ] HNI: Starting deletion of primary data.
[2025-10-24T19:12:40.586294] [DEBUG] [LOCAL     ] HNI: Deleted primary data file.
[2025-10-24T19:12:40.586333] [INFO ] [MAIN      ] HNI: Starting full primary refresh.
[2025-10-24T19:12:40.726475] [DEBUG] [LOCAL     ] HOG: Loaded 50975 existing records from primary storage.
[2025-10-24T19:12:40.749422] [INFO ] [MAIN      ] HOG: Loaded 50975 existing records.
[2025-10-24T19:12:40.959318] [INFO ] [REMOTE    ] HMY: Fetching primary data for 2025-03.
[2025-10-24T19:12:41.052545] [WARN ] [MAIN      ] HOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:12:41.068580] [INFO ] [MAIN      ] HOG: Wiping existing primary data before full refresh.
[2025-10-24T19:12:41.071848] [INFO ] [LOCAL     ] HOG: Starting deletion of primary data.
[2025-10-24T19:12:41.077564] [DEBUG] [LOCAL     ] HOG: Deleted primary data file.
[2025-10-24T19:12:41.088134] [INFO ] [MAIN      ] HOG: Starting full primary refresh.
[2025-10-24T19:12:41.215461] [INFO ] [REMOTE    ] HNI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:12:41.510416] [INFO ] [REMOTE    ] HOG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:12:41.526371] [INFO ] [REMOTE    ] HMN: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T19:12:41.747671] [INFO ] [REMOTE    ] HMN: Fetching primary data for 2025-06.
[2025-10-24T19:12:42.547704] [INFO ] [REMOTE    ] HOG: Fetching primary data for 2025-01.
[2025-10-24T19:12:42.879755] [INFO ] [REMOTE    ] HMN: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T19:12:42.985920] [INFO ] [REMOTE    ] HMY: Incremental fetch complete for 2025-03 (2.03 seconds).
[2025-10-24T19:12:43.347716] [INFO ] [REMOTE    ] HNI: Fetching primary data for 2025-01.
[2025-10-24T19:12:43.814164] [INFO ] [REMOTE    ] HOG: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T19:12:44.063310] [INFO ] [REMOTE    ] HNI: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T19:12:44.147610] [INFO ] [REMOTE    ] HNI: Fetching primary data for 2025-02.
[2025-10-24T19:12:44.947713] [INFO ] [REMOTE    ] HMY: Fetching primary data for 2025-04.
[2025-10-24T19:12:45.289509] [INFO ] [REMOTE    ] HNI: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T19:12:45.747677] [INFO ] [REMOTE    ] HMN: Fetching primary data for 2025-07.
[2025-10-24T19:12:46.547693] [INFO ] [REMOTE    ] HOG: Fetching primary data for 2025-02.
[2025-10-24T19:12:46.828679] [INFO ] [REMOTE    ] HMN: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T19:12:47.059197] [INFO ] [REMOTE    ] HMY: Incremental fetch complete for 2025-04 (2.11 seconds).
[2025-10-24T19:12:47.347688] [INFO ] [REMOTE    ] HMN: Fetching primary data for 2025-08.
[2025-10-24T19:12:48.064559] [INFO ] [REMOTE    ] HOG: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T19:12:48.147608] [INFO ] [REMOTE    ] HOG: Fetching primary data for 2025-03.
[2025-10-24T19:12:48.238626] [INFO ] [REMOTE    ] HMN: Incremental fetch complete for 2025-08 (0.89 seconds).
[2025-10-24T19:12:48.947727] [INFO ] [REMOTE    ] HNI: Fetching primary data for 2025-03.
[2025-10-24T19:12:49.747714] [INFO ] [REMOTE    ] HMN: Fetching primary data for 2025-09.
[2025-10-24T19:12:49.854928] [INFO ] [REMOTE    ] HOG: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T19:12:50.255586] [INFO ] [REMOTE    ] HNI: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T19:12:50.547745] [INFO ] [REMOTE    ] HOG: Fetching primary data for 2025-04.
[2025-10-24T19:12:50.830431] [INFO ] [REMOTE    ] HMN: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T19:12:51.347675] [INFO ] [REMOTE    ] HMY: Fetching primary data for 2025-05.
[2025-10-24T19:12:52.147620] [INFO ] [REMOTE    ] HMN: Fetching primary data for 2025-10.
[2025-10-24T19:12:52.255220] [INFO ] [REMOTE    ] HOG: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T19:12:52.947700] [INFO ] [REMOTE    ] HOG: Fetching primary data for 2025-05.
[2025-10-24T19:12:52.966339] [INFO ] [REMOTE    ] HMN: Incremental fetch complete for 2025-10 (0.82 seconds).
[2025-10-24T19:12:52.969968] [INFO ] [REMOTE    ] HMN: Full fetch complete (31616 records).
[2025-10-24T19:12:52.970045] [DEBUG] [VALIDATOR ] HMN: Validating primary data.
[2025-10-24T19:12:53.348015] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present.
[2025-10-24T19:12:53.348210] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed.
[2025-10-24T19:12:53.349088] [INFO ] [MAIN      ] HMN: Fetched primary data is valid.
[2025-10-24T19:12:53.349175] [DEBUG] [LOCAL     ] HMN: Saving primary data.
[2025-10-24T19:12:53.349828] [FATAL] [LOCAL     ] HMN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:12:53.349960] [FATAL] [MAIN      ] HMN: Failed to save primary data.
[2025-10-24T19:12:53.350172] [WARN ] [MAIN      ] HMN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:12:53.350243] [INFO ] [LOCAL     ] HMN: Starting deletion of primary data.
[2025-10-24T19:12:53.350301] [DEBUG] [LOCAL     ] HMN: No primary data file found to delete.
[2025-10-24T19:12:53.350337] [INFO ] [LOCAL     ] HMN: Starting deletion of derivative data.
[2025-10-24T19:12:53.350492] [DEBUG] [LOCAL     ] HMN: Deleted derivative data file.
[2025-10-24T19:12:53.350594] [INFO ] [MAIN      ] Update Progress: 1036/2366 symbols completed. HMN took 24.1s. Estimated remaining: 2h 50m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:12:53.528507] [INFO ] [MAIN      ] HOMB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:12:53.561152] [INFO ] [REMOTE    ] HMY: Incremental fetch complete for 2025-05 (2.21 seconds).
[2025-10-24T19:12:53.610837] [DEBUG] [LOCAL     ] HOMB: Loaded 44007 existing records from primary storage.
[2025-10-24T19:12:53.611152] [INFO ] [MAIN      ] HOMB: Loaded 44007 existing records.
[2025-10-24T19:12:53.756369] [INFO ] [REMOTE    ] HMY: Fetching primary data for 2025-06.
[2025-10-24T19:12:53.798079] [WARN ] [MAIN      ] HOMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:12:53.798374] [INFO ] [MAIN      ] HOMB: Wiping existing primary data before full refresh.
[2025-10-24T19:12:53.798422] [INFO ] [LOCAL     ] HOMB: Starting deletion of primary data.
[2025-10-24T19:12:53.798813] [DEBUG] [LOCAL     ] HOMB: Deleted primary data file.
[2025-10-24T19:12:53.798868] [INFO ] [MAIN      ] HOMB: Starting full primary refresh.
[2025-10-24T19:12:54.152829] [INFO ] [REMOTE    ] HOMB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:12:54.547711] [INFO ] [REMOTE    ] HOMB: Fetching primary data for 2025-01.
[2025-10-24T19:12:54.724741] [INFO ] [REMOTE    ] HOG: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T19:12:55.347722] [INFO ] [REMOTE    ] HOG: Fetching primary data for 2025-06.
[2025-10-24T19:12:55.765068] [INFO ] [REMOTE    ] HMY: Incremental fetch complete for 2025-06 (2.01 seconds).
[2025-10-24T19:12:56.055758] [INFO ] [REMOTE    ] HOMB: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T19:12:56.147617] [INFO ] [REMOTE    ] HOMB: Fetching primary data for 2025-02.
[2025-10-24T19:12:56.650321] [INFO ] [REMOTE    ] HOG: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T19:12:56.947640] [INFO ] [REMOTE    ] HOG: Fetching primary data for 2025-07.
[2025-10-24T19:12:57.233004] [INFO ] [REMOTE    ] HOMB: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T19:12:57.747668] [INFO ] [REMOTE    ] HMY: Fetching primary data for 2025-07.
[2025-10-24T19:12:58.198930] [INFO ] [REMOTE    ] HOG: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T19:12:58.547722] [INFO ] [REMOTE    ] HOMB: Fetching primary data for 2025-03.
[2025-10-24T19:12:59.347686] [INFO ] [REMOTE    ] HOG: Fetching primary data for 2025-08.
[2025-10-24T19:12:59.736233] [INFO ] [REMOTE    ] HMY: Incremental fetch complete for 2025-07 (1.99 seconds).
[2025-10-24T19:13:00.054366] [INFO ] [REMOTE    ] HOMB: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T19:13:00.147686] [INFO ] [REMOTE    ] HNI: Fetching primary data for 2025-04.
[2025-10-24T19:13:00.947612] [INFO ] [REMOTE    ] HOMB: Fetching primary data for 2025-04.
[2025-10-24T19:13:01.205445] [INFO ] [REMOTE    ] HOG: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T19:13:01.357691] [INFO ] [REMOTE    ] HNI: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T19:13:01.747639] [INFO ] [REMOTE    ] HNI: Fetching primary data for 2025-05.
[2025-10-24T19:13:02.547623] [INFO ] [REMOTE    ] HOG: Fetching primary data for 2025-09.
[2025-10-24T19:13:02.603963] [INFO ] [REMOTE    ] HOMB: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T19:13:02.796627] [INFO ] [REMOTE    ] HNI: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T19:13:03.347700] [INFO ] [REMOTE    ] HNI: Fetching primary data for 2025-06.
[2025-10-24T19:13:04.147696] [INFO ] [REMOTE    ] HMY: Fetching primary data for 2025-08.
[2025-10-24T19:13:04.268331] [INFO ] [REMOTE    ] HOG: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T19:13:04.456423] [INFO ] [REMOTE    ] HNI: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T19:13:04.947639] [INFO ] [REMOTE    ] HNI: Fetching primary data for 2025-07.
[2025-10-24T19:13:05.747681] [INFO ] [REMOTE    ] HOG: Fetching primary data for 2025-10.
[2025-10-24T19:13:06.135783] [INFO ] [REMOTE    ] HNI: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T19:13:06.171064] [INFO ] [REMOTE    ] HMY: Incremental fetch complete for 2025-08 (2.02 seconds).
[2025-10-24T19:13:06.547673] [INFO ] [REMOTE    ] HMY: Fetching primary data for 2025-09.
[2025-10-24T19:13:07.274355] [INFO ] [REMOTE    ] HOG: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T19:13:07.283730] [INFO ] [REMOTE    ] HOG: Full fetch complete (74235 records).
[2025-10-24T19:13:07.283899] [DEBUG] [VALIDATOR ] HOG: Validating primary data.
[2025-10-24T19:13:07.352796] [INFO ] [REMOTE    ] HNI: Fetching primary data for 2025-08.
[2025-10-24T19:13:07.674481] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present.
[2025-10-24T19:13:07.674568] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed.
[2025-10-24T19:13:07.675573] [INFO ] [MAIN      ] HOG: Fetched primary data is valid.
[2025-10-24T19:13:07.675665] [DEBUG] [LOCAL     ] HOG: Saving primary data.
[2025-10-24T19:13:07.676288] [FATAL] [LOCAL     ] HOG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:13:07.676379] [FATAL] [MAIN      ] HOG: Failed to save primary data.
[2025-10-24T19:13:07.676422] [WARN ] [MAIN      ] HOG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:13:07.676464] [INFO ] [LOCAL     ] HOG: Starting deletion of primary data.
[2025-10-24T19:13:07.676529] [DEBUG] [LOCAL     ] HOG: No primary data file found to delete.
[2025-10-24T19:13:07.676573] [INFO ] [LOCAL     ] HOG: Starting deletion of derivative data.
[2025-10-24T19:13:07.676737] [DEBUG] [LOCAL     ] HOG: Deleted derivative data file.
[2025-10-24T19:13:07.677050] [INFO ] [MAIN      ] Update Progress: 1037/2366 symbols completed. HOG took 27.5s. Estimated remaining: 2h 50m 33s. Rate: 7.8 symbols/min
[2025-10-24T19:13:08.075325] [INFO ] [REMOTE    ] HMY: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T19:13:08.147709] [INFO ] [REMOTE    ] HMY: Fetching primary data for 2025-10.
[2025-10-24T19:13:08.581076] [INFO ] [REMOTE    ] HNI: Incremental fetch complete for 2025-08 (1.23 seconds).
[2025-10-24T19:13:08.947677] [INFO ] [REMOTE    ] HNI: Fetching primary data for 2025-09.
[2025-10-24T19:13:09.747727] [INFO ] [REMOTE    ] HOMB: Fetching primary data for 2025-05.
[2025-10-24T19:13:10.436462] [INFO ] [REMOTE    ] HNI: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T19:13:10.470069] [INFO ] [REMOTE    ] HMY: Incremental fetch complete for 2025-10 (2.32 seconds).
[2025-10-24T19:13:10.480145] [INFO ] [REMOTE    ] HMY: Full fetch complete (77158 records).
[2025-10-24T19:13:10.480263] [DEBUG] [VALIDATOR ] HMY: Validating primary data.
[2025-10-24T19:13:10.557304] [INFO ] [REMOTE    ] HNI: Fetching primary data for 2025-10.
[2025-10-24T19:13:10.891354] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present.
[2025-10-24T19:13:10.891530] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed.
[2025-10-24T19:13:10.892679] [INFO ] [MAIN      ] HMY: Fetched primary data is valid.
[2025-10-24T19:13:10.892904] [DEBUG] [LOCAL     ] HMY: Saving primary data.
[2025-10-24T19:13:10.893737] [FATAL] [LOCAL     ] HMY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:13:10.893856] [FATAL] [MAIN      ] HMY: Failed to save primary data.
[2025-10-24T19:13:10.894053] [WARN ] [MAIN      ] HMY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:13:10.894157] [INFO ] [LOCAL     ] HMY: Starting deletion of primary data.
[2025-10-24T19:13:10.894368] [DEBUG] [LOCAL     ] HMY: No primary data file found to delete.
[2025-10-24T19:13:10.894421] [INFO ] [LOCAL     ] HMY: Starting deletion of derivative data.
[2025-10-24T19:13:10.901988] [DEBUG] [LOCAL     ] HMY: Deleted derivative data file.
[2025-10-24T19:13:10.914639] [INFO ] [MAIN      ] Update Progress: 1038/2366 symbols completed. HMY took 38.8s. Estimated remaining: 2h 50m 20s. Rate: 7.8 symbols/min
[2025-10-24T19:13:10.916026] [INFO ] [REMOTE    ] HOMB: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T19:13:11.347682] [INFO ] [REMOTE    ] HOMB: Fetching primary data for 2025-06.
[2025-10-24T19:13:12.160122] [INFO ] [REMOTE    ] HNI: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T19:13:12.166035] [INFO ] [REMOTE    ] HNI: Full fetch complete (42230 records).
[2025-10-24T19:13:12.166119] [DEBUG] [VALIDATOR ] HNI: Validating primary data.
[2025-10-24T19:13:12.556087] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present.
[2025-10-24T19:13:12.556180] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed.
[2025-10-24T19:13:12.556922] [INFO ] [MAIN      ] HNI: Fetched primary data is valid.
[2025-10-24T19:13:12.556981] [DEBUG] [LOCAL     ] HNI: Saving primary data.
[2025-10-24T19:13:12.557371] [FATAL] [LOCAL     ] HNI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:13:12.557452] [FATAL] [MAIN      ] HNI: Failed to save primary data.
[2025-10-24T19:13:12.557494] [WARN ] [MAIN      ] HNI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:13:12.557529] [INFO ] [LOCAL     ] HNI: Starting deletion of primary data.
[2025-10-24T19:13:12.557578] [DEBUG] [LOCAL     ] HNI: No primary data file found to delete.
[2025-10-24T19:13:12.557612] [INFO ] [LOCAL     ] HNI: Starting deletion of derivative data.
[2025-10-24T19:13:12.557782] [DEBUG] [LOCAL     ] HNI: Deleted derivative data file.
[2025-10-24T19:13:12.557871] [INFO ] [MAIN      ] Update Progress: 1039/2366 symbols completed. HNI took 32.6s. Estimated remaining: 2h 50m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:13:12.765262] [INFO ] [REMOTE    ] HOMB: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T19:13:12.773824] [INFO ] [REMOTE    ] HOMB: Fetching primary data for 2025-07.
[2025-10-24T19:13:14.435245] [INFO ] [REMOTE    ] HOMB: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T19:13:14.445827] [INFO ] [REMOTE    ] HOMB: Fetching primary data for 2025-08.
[2025-10-24T19:13:15.953941] [INFO ] [REMOTE    ] HOMB: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T19:13:15.963282] [INFO ] [REMOTE    ] HOMB: Fetching primary data for 2025-09.
[2025-10-24T19:13:17.556214] [INFO ] [REMOTE    ] HOMB: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T19:13:17.566247] [INFO ] [REMOTE    ] HOMB: Fetching primary data for 2025-10.
[2025-10-24T19:13:19.200480] [INFO ] [REMOTE    ] HOMB: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T19:13:19.209404] [INFO ] [REMOTE    ] HOMB: Full fetch complete (64493 records).
[2025-10-24T19:13:19.209547] [DEBUG] [VALIDATOR ] HOMB: Validating primary data.
[2025-10-24T19:13:19.609803] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present.
[2025-10-24T19:13:19.609888] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed.
[2025-10-24T19:13:19.610788] [INFO ] [MAIN      ] HOMB: Fetched primary data is valid.
[2025-10-24T19:13:19.610859] [DEBUG] [LOCAL     ] HOMB: Saving primary data.
[2025-10-24T19:13:19.611349] [FATAL] [LOCAL     ] HOMB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:13:19.611432] [FATAL] [MAIN      ] HOMB: Failed to save primary data.
[2025-10-24T19:13:19.611473] [WARN ] [MAIN      ] HOMB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:13:19.611508] [INFO ] [LOCAL     ] HOMB: Starting deletion of primary data.
[2025-10-24T19:13:19.611557] [DEBUG] [LOCAL     ] HOMB: No primary data file found to delete.
[2025-10-24T19:13:19.611591] [INFO ] [LOCAL     ] HOMB: Starting deletion of derivative data.
[2025-10-24T19:13:19.611820] [DEBUG] [LOCAL     ] HOMB: Deleted derivative data file.
[2025-10-24T19:13:19.612256] [INFO ] [MAIN      ] Update Progress: 1040/2366 symbols completed. HOMB took 26.3s. Estimated remaining: 2h 49m 56s. Rate: 7.8 symbols/min
[2025-10-24T19:13:20.257688] [INFO ] [MAIN      ] HOUS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:13:20.294106] [INFO ] [MAIN      ] HOV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:13:20.316520] [INFO ] [MAIN      ] HP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:13:20.320788] [INFO ] [MAIN      ] HPE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:13:20.338569] [DEBUG] [LOCAL     ] HOV: Loaded 13847 existing records from primary storage.
[2025-10-24T19:13:20.338946] [INFO ] [MAIN      ] HOV: Loaded 13847 existing records.
[2025-10-24T19:13:20.549251] [WARN ] [MAIN      ] HOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:13:20.562119] [INFO ] [MAIN      ] HOV: Wiping existing primary data before full refresh.
[2025-10-24T19:13:20.562270] [INFO ] [LOCAL     ] HOV: Starting deletion of primary data.
[2025-10-24T19:13:20.562513] [DEBUG] [LOCAL     ] HOV: Deleted primary data file.
[2025-10-24T19:13:20.562583] [INFO ] [MAIN      ] HOV: Starting full primary refresh.
[2025-10-24T19:13:20.647077] [DEBUG] [LOCAL     ] HP: Loaded 51767 existing records from primary storage.
[2025-10-24T19:13:20.688984] [INFO ] [MAIN      ] HP: Loaded 51767 existing records.
[2025-10-24T19:13:20.688762] [DEBUG] [LOCAL     ] HOUS: Loaded 46115 existing records from primary storage.
[2025-10-24T19:13:20.765518] [INFO ] [MAIN      ] HOUS: Loaded 46115 existing records.
[2025-10-24T19:13:20.743051] [DEBUG] [LOCAL     ] HPE: Loaded 54087 existing records from primary storage.
[2025-10-24T19:13:20.795751] [INFO ] [MAIN      ] HPE: Loaded 54087 existing records.
[2025-10-24T19:13:21.395580] [WARN ] [MAIN      ] HOUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:13:21.349229] [WARN ] [MAIN      ] HPE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:13:21.439860] [WARN ] [MAIN      ] HP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:13:21.459427] [INFO ] [MAIN      ] HPE: Wiping existing primary data before full refresh.
[2025-10-24T19:13:21.454156] [INFO ] [MAIN      ] HOUS: Wiping existing primary data before full refresh.
[2025-10-24T19:13:21.473432] [INFO ] [LOCAL     ] HOUS: Starting deletion of primary data.
[2025-10-24T19:13:21.482298] [INFO ] [MAIN      ] HP: Wiping existing primary data before full refresh.
[2025-10-24T19:13:21.487598] [INFO ] [LOCAL     ] HPE: Starting deletion of primary data.
[2025-10-24T19:13:21.513811] [DEBUG] [LOCAL     ] HOUS: Deleted primary data file.
[2025-10-24T19:13:21.513714] [INFO ] [LOCAL     ] HP: Starting deletion of primary data.
[2025-10-24T19:13:21.523816] [DEBUG] [LOCAL     ] HPE: Deleted primary data file.
[2025-10-24T19:13:21.524091] [DEBUG] [LOCAL     ] HP: Deleted primary data file.
[2025-10-24T19:13:21.523910] [INFO ] [MAIN      ] HOUS: Starting full primary refresh.
[2025-10-24T19:13:21.524366] [INFO ] [MAIN      ] HP: Starting full primary refresh.
[2025-10-24T19:13:21.524029] [INFO ] [MAIN      ] HPE: Starting full primary refresh.
[2025-10-24T19:13:21.827047] [INFO ] [REMOTE    ] HOV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:13:21.863318] [INFO ] [REMOTE    ] HOV: Fetching primary data for 2025-01.
[2025-10-24T19:13:22.601956] [INFO ] [REMOTE    ] HOUS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:13:22.617710] [INFO ] [REMOTE    ] HOUS: Fetching primary data for 2025-01.
[2025-10-24T19:13:22.718440] [INFO ] [REMOTE    ] HPE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:13:22.743704] [INFO ] [REMOTE    ] HP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:13:22.737954] [INFO ] [REMOTE    ] HPE: Fetching primary data for 2025-01.
[2025-10-24T19:13:22.745041] [INFO ] [REMOTE    ] HP: Fetching primary data for 2025-01.
[2025-10-24T19:13:22.873511] [INFO ] [REMOTE    ] HOV: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T19:13:22.876525] [INFO ] [REMOTE    ] HOV: Fetching primary data for 2025-02.
[2025-10-24T19:13:23.758998] [INFO ] [REMOTE    ] HOV: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T19:13:23.762023] [INFO ] [REMOTE    ] HOV: Fetching primary data for 2025-03.
[2025-10-24T19:13:24.090989] [INFO ] [REMOTE    ] HOUS: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T19:13:24.099605] [INFO ] [REMOTE    ] HOUS: Fetching primary data for 2025-02.
[2025-10-24T19:13:24.237863] [INFO ] [REMOTE    ] HPE: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T19:13:24.248398] [INFO ] [REMOTE    ] HPE: Fetching primary data for 2025-02.
[2025-10-24T19:13:24.400169] [INFO ] [REMOTE    ] HP: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T19:13:24.409625] [INFO ] [REMOTE    ] HP: Fetching primary data for 2025-02.
[2025-10-24T19:13:24.663407] [INFO ] [REMOTE    ] HOV: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T19:13:24.666528] [INFO ] [REMOTE    ] HOV: Fetching primary data for 2025-04.
[2025-10-24T19:13:25.059176] [INFO ] [REMOTE    ] HOUS: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T19:13:25.067836] [INFO ] [REMOTE    ] HOUS: Fetching primary data for 2025-03.
[2025-10-24T19:13:25.290517] [INFO ] [REMOTE    ] HOV: Incremental fetch complete for 2025-04 (0.62 seconds).
[2025-10-24T19:13:25.295217] [INFO ] [REMOTE    ] HOV: Fetching primary data for 2025-05.
[2025-10-24T19:13:25.886171] [INFO ] [REMOTE    ] HPE: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T19:13:25.896832] [INFO ] [REMOTE    ] HPE: Fetching primary data for 2025-03.
[2025-10-24T19:13:26.074672] [INFO ] [REMOTE    ] HP: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T19:13:26.084786] [INFO ] [REMOTE    ] HP: Fetching primary data for 2025-03.
[2025-10-24T19:13:26.106605] [INFO ] [REMOTE    ] HOV: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T19:13:26.404185] [INFO ] [REMOTE    ] HOUS: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T19:13:26.547743] [INFO ] [REMOTE    ] HOV: Fetching primary data for 2025-06.
[2025-10-24T19:13:27.347750] [INFO ] [REMOTE    ] HOUS: Fetching primary data for 2025-04.
[2025-10-24T19:13:27.553276] [INFO ] [REMOTE    ] HOV: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T19:13:27.741031] [INFO ] [REMOTE    ] HP: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T19:13:27.795633] [INFO ] [REMOTE    ] HPE: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T19:13:28.147690] [INFO ] [REMOTE    ] HPE: Fetching primary data for 2025-04.
[2025-10-24T19:13:28.854558] [INFO ] [REMOTE    ] HOUS: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T19:13:28.947726] [INFO ] [REMOTE    ] HOV: Fetching primary data for 2025-07.
[2025-10-24T19:13:29.747695] [INFO ] [REMOTE    ] HOUS: Fetching primary data for 2025-05.
[2025-10-24T19:13:29.946022] [INFO ] [REMOTE    ] HOV: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T19:13:30.009817] [INFO ] [REMOTE    ] HPE: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T19:13:30.547632] [INFO ] [REMOTE    ] HPE: Fetching primary data for 2025-05.
[2025-10-24T19:13:31.198603] [INFO ] [REMOTE    ] HOUS: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T19:13:31.347607] [INFO ] [REMOTE    ] HOUS: Fetching primary data for 2025-06.
[2025-10-24T19:13:32.145569] [INFO ] [REMOTE    ] HPE: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T19:13:32.155900] [INFO ] [REMOTE    ] HP: Fetching primary data for 2025-04.
[2025-10-24T19:13:32.882791] [INFO ] [REMOTE    ] HOUS: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T19:13:32.947619] [INFO ] [REMOTE    ] HOUS: Fetching primary data for 2025-07.
[2025-10-24T19:13:33.747627] [INFO ] [REMOTE    ] HOV: Fetching primary data for 2025-08.
[2025-10-24T19:13:33.981086] [INFO ] [REMOTE    ] HP: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T19:13:34.051083] [INFO ] [REMOTE    ] HOUS: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T19:13:34.547620] [INFO ] [REMOTE    ] HOUS: Fetching primary data for 2025-08.
[2025-10-24T19:13:34.788295] [INFO ] [REMOTE    ] HOV: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T19:13:35.347636] [INFO ] [REMOTE    ] HOV: Fetching primary data for 2025-09.
[2025-10-24T19:13:35.992721] [INFO ] [REMOTE    ] HOUS: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T19:13:36.035142] [INFO ] [REMOTE    ] HOV: Incremental fetch complete for 2025-09 (0.69 seconds).
[2025-10-24T19:13:36.147692] [INFO ] [REMOTE    ] HP: Fetching primary data for 2025-05.
[2025-10-24T19:13:36.947669] [INFO ] [REMOTE    ] HPE: Fetching primary data for 2025-06.
[2025-10-24T19:13:37.747619] [INFO ] [REMOTE    ] HOUS: Fetching primary data for 2025-09.
[2025-10-24T19:13:37.810229] [INFO ] [REMOTE    ] HP: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T19:13:38.547613] [INFO ] [REMOTE    ] HOV: Fetching primary data for 2025-10.
[2025-10-24T19:13:38.993298] [INFO ] [REMOTE    ] HPE: Incremental fetch complete for 2025-06 (2.05 seconds).
[2025-10-24T19:13:39.075716] [INFO ] [REMOTE    ] HOUS: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T19:13:39.347675] [INFO ] [REMOTE    ] HP: Fetching primary data for 2025-06.
[2025-10-24T19:13:39.449850] [INFO ] [REMOTE    ] HOV: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T19:13:39.452307] [INFO ] [REMOTE    ] HOV: Full fetch complete (18887 records).
[2025-10-24T19:13:39.452406] [DEBUG] [VALIDATOR ] HOV: Validating primary data.
[2025-10-24T19:13:39.811950] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present.
[2025-10-24T19:13:39.812024] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed.
[2025-10-24T19:13:39.812434] [INFO ] [MAIN      ] HOV: Fetched primary data is valid.
[2025-10-24T19:13:39.812474] [DEBUG] [LOCAL     ] HOV: Saving primary data.
[2025-10-24T19:13:39.812773] [FATAL] [LOCAL     ] HOV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:13:39.812853] [FATAL] [MAIN      ] HOV: Failed to save primary data.
[2025-10-24T19:13:39.812894] [WARN ] [MAIN      ] HOV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:13:39.812963] [INFO ] [LOCAL     ] HOV: Starting deletion of primary data.
[2025-10-24T19:13:39.813019] [DEBUG] [LOCAL     ] HOV: No primary data file found to delete.
[2025-10-24T19:13:39.813055] [INFO ] [LOCAL     ] HOV: Starting deletion of derivative data.
[2025-10-24T19:13:39.813207] [DEBUG] [LOCAL     ] HOV: Deleted derivative data file.
[2025-10-24T19:13:39.813299] [INFO ] [MAIN      ] Update Progress: 1041/2366 symbols completed. HOV took 20.2s. Estimated remaining: 2h 50m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:13:39.978491] [INFO ] [MAIN      ] HPF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:13:39.991662] [DEBUG] [LOCAL     ] HPF: Loaded 7523 existing records from primary storage.
[2025-10-24T19:13:39.991886] [INFO ] [MAIN      ] HPF: Loaded 7523 existing records.
[2025-10-24T19:13:40.150617] [INFO ] [REMOTE    ] HPE: Fetching primary data for 2025-07.
[2025-10-24T19:13:40.172287] [WARN ] [MAIN      ] HPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:13:40.172587] [INFO ] [MAIN      ] HPF: Wiping existing primary data before full refresh.
[2025-10-24T19:13:40.172680] [INFO ] [LOCAL     ] HPF: Starting deletion of primary data.
[2025-10-24T19:13:40.172862] [DEBUG] [LOCAL     ] HPF: Deleted primary data file.
[2025-10-24T19:13:40.172917] [INFO ] [MAIN      ] HPF: Starting full primary refresh.
[2025-10-24T19:13:40.526320] [INFO ] [REMOTE    ] HPF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:13:40.947634] [INFO ] [REMOTE    ] HOUS: Fetching primary data for 2025-10.
[2025-10-24T19:13:40.982242] [INFO ] [REMOTE    ] HP: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T19:13:41.747693] [INFO ] [REMOTE    ] HPF: Fetching primary data for 2025-01.
[2025-10-24T19:13:42.054685] [INFO ] [REMOTE    ] HPE: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T19:13:42.317003] [INFO ] [REMOTE    ] HOUS: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T19:13:42.326773] [INFO ] [REMOTE    ] HOUS: Full fetch complete (64803 records).
[2025-10-24T19:13:42.326885] [DEBUG] [VALIDATOR ] HOUS: Validating primary data.
[2025-10-24T19:13:42.514949] [INFO ] [REMOTE    ] HPF: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T19:13:42.552794] [INFO ] [REMOTE    ] HPE: Fetching primary data for 2025-08.
[2025-10-24T19:13:42.733462] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present.
[2025-10-24T19:13:42.733538] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed.
[2025-10-24T19:13:42.734502] [INFO ] [MAIN      ] HOUS: Fetched primary data is valid.
[2025-10-24T19:13:42.734565] [DEBUG] [LOCAL     ] HOUS: Saving primary data.
[2025-10-24T19:13:42.735077] [FATAL] [LOCAL     ] HOUS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:13:42.735164] [FATAL] [MAIN      ] HOUS: Failed to save primary data.
[2025-10-24T19:13:42.735205] [WARN ] [MAIN      ] HOUS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:13:42.735241] [INFO ] [LOCAL     ] HOUS: Starting deletion of primary data.
[2025-10-24T19:13:42.735295] [DEBUG] [LOCAL     ] HOUS: No primary data file found to delete.
[2025-10-24T19:13:42.735330] [INFO ] [LOCAL     ] HOUS: Starting deletion of derivative data.
[2025-10-24T19:13:42.735468] [DEBUG] [LOCAL     ] HOUS: Deleted derivative data file.
[2025-10-24T19:13:42.735835] [INFO ] [MAIN      ] Update Progress: 1042/2366 symbols completed. HOUS took 23.1s. Estimated remaining: 2h 49m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:13:42.902348] [INFO ] [MAIN      ] HPI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:13:42.915685] [DEBUG] [LOCAL     ] HPI: Loaded 10768 existing records from primary storage.
[2025-10-24T19:13:42.915911] [INFO ] [MAIN      ] HPI: Loaded 10768 existing records.
[2025-10-24T19:13:43.090934] [WARN ] [MAIN      ] HPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:13:43.091129] [INFO ] [MAIN      ] HPI: Wiping existing primary data before full refresh.
[2025-10-24T19:13:43.091173] [INFO ] [LOCAL     ] HPI: Starting deletion of primary data.
[2025-10-24T19:13:43.091328] [DEBUG] [LOCAL     ] HPI: Deleted primary data file.
[2025-10-24T19:13:43.091367] [INFO ] [MAIN      ] HPI: Starting full primary refresh.
[2025-10-24T19:13:43.354465] [INFO ] [REMOTE    ] HP: Fetching primary data for 2025-07.
[2025-10-24T19:13:43.442822] [INFO ] [REMOTE    ] HPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:13:44.147612] [INFO ] [REMOTE    ] HPF: Fetching primary data for 2025-02.
[2025-10-24T19:13:44.468703] [INFO ] [REMOTE    ] HPE: Incremental fetch complete for 2025-08 (1.92 seconds).
[2025-10-24T19:13:44.947626] [INFO ] [REMOTE    ] HPE: Fetching primary data for 2025-09.
[2025-10-24T19:13:45.091413] [INFO ] [REMOTE    ] HPF: Incremental fetch complete for 2025-02 (0.94 seconds).
[2025-10-24T19:13:45.091234] [INFO ] [REMOTE    ] HP: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T19:13:45.747673] [INFO ] [REMOTE    ] HPI: Fetching primary data for 2025-01.
[2025-10-24T19:13:46.466261] [INFO ] [REMOTE    ] HPI: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T19:13:46.547612] [INFO ] [REMOTE    ] HPI: Fetching primary data for 2025-02.
[2025-10-24T19:13:46.855085] [INFO ] [REMOTE    ] HPE: Incremental fetch complete for 2025-09 (1.91 seconds).
[2025-10-24T19:13:47.122615] [INFO ] [REMOTE    ] HPI: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T19:13:47.347636] [INFO ] [REMOTE    ] HPF: Fetching primary data for 2025-03.
[2025-10-24T19:13:47.950140] [INFO ] [REMOTE    ] HPF: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T19:13:48.147677] [INFO ] [REMOTE    ] HPI: Fetching primary data for 2025-03.
[2025-10-24T19:13:48.938060] [INFO ] [REMOTE    ] HPI: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T19:13:48.947600] [INFO ] [REMOTE    ] HPI: Fetching primary data for 2025-04.
[2025-10-24T19:13:49.669361] [INFO ] [REMOTE    ] HPI: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T19:13:49.747598] [INFO ] [REMOTE    ] HPI: Fetching primary data for 2025-05.
[2025-10-24T19:13:50.449955] [INFO ] [REMOTE    ] HPI: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T19:13:50.547619] [INFO ] [REMOTE    ] HP: Fetching primary data for 2025-08.
[2025-10-24T19:13:51.347638] [INFO ] [REMOTE    ] HPI: Fetching primary data for 2025-06.
[2025-10-24T19:13:52.126563] [INFO ] [REMOTE    ] HP: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T19:13:52.147619] [INFO ] [REMOTE    ] HPF: Fetching primary data for 2025-04.
[2025-10-24T19:13:52.157194] [INFO ] [REMOTE    ] HPI: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T19:13:52.947727] [INFO ] [REMOTE    ] HP: Fetching primary data for 2025-09.
[2025-10-24T19:13:53.056847] [INFO ] [REMOTE    ] HPF: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T19:13:53.747708] [INFO ] [REMOTE    ] HPI: Fetching primary data for 2025-07.
[2025-10-24T19:13:54.547661] [INFO ] [REMOTE    ] HPE: Fetching primary data for 2025-10.
[2025-10-24T19:13:54.709993] [INFO ] [REMOTE    ] HP: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T19:13:54.726378] [INFO ] [REMOTE    ] HPI: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T19:13:55.347676] [INFO ] [REMOTE    ] HP: Fetching primary data for 2025-10.
[2025-10-24T19:13:56.147674] [INFO ] [REMOTE    ] HPI: Fetching primary data for 2025-08.
[2025-10-24T19:13:56.730871] [INFO ] [REMOTE    ] HPE: Incremental fetch complete for 2025-10 (2.18 seconds).
[2025-10-24T19:13:56.740715] [INFO ] [REMOTE    ] HPE: Full fetch complete (77876 records).
[2025-10-24T19:13:56.740846] [DEBUG] [VALIDATOR ] HPE: Validating primary data.
[2025-10-24T19:13:56.950062] [INFO ] [REMOTE    ] HPF: Fetching primary data for 2025-05.
[2025-10-24T19:13:56.995067] [INFO ] [REMOTE    ] HPI: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T19:13:57.163303] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present.
[2025-10-24T19:13:57.168838] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed.
[2025-10-24T19:13:57.169974] [INFO ] [MAIN      ] HPE: Fetched primary data is valid.
[2025-10-24T19:13:57.170063] [DEBUG] [LOCAL     ] HPE: Saving primary data.
[2025-10-24T19:13:57.176821] [FATAL] [LOCAL     ] HPE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:13:57.180953] [INFO ] [REMOTE    ] HP: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T19:13:57.180022] [FATAL] [MAIN      ] HPE: Failed to save primary data.
[2025-10-24T19:13:57.189522] [WARN ] [MAIN      ] HPE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:13:57.189725] [INFO ] [LOCAL     ] HPE: Starting deletion of primary data.
[2025-10-24T19:13:57.189797] [DEBUG] [LOCAL     ] HPE: No primary data file found to delete.
[2025-10-24T19:13:57.189837] [INFO ] [LOCAL     ] HPE: Starting deletion of derivative data.
[2025-10-24T19:13:57.190025] [INFO ] [REMOTE    ] HP: Full fetch complete (74189 records).
[2025-10-24T19:13:57.190076] [DEBUG] [LOCAL     ] HPE: Deleted derivative data file.
[2025-10-24T19:13:57.190162] [DEBUG] [VALIDATOR ] HP: Validating primary data.
[2025-10-24T19:13:57.190417] [INFO ] [MAIN      ] Update Progress: 1043/2366 symbols completed. HPE took 37.6s. Estimated remaining: 2h 49m 51s. Rate: 7.8 symbols/min
[2025-10-24T19:13:57.590415] [INFO ] [MAIN      ] HPP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:13:57.725991] [INFO ] [REMOTE    ] HPF: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T19:13:57.748806] [INFO ] [REMOTE    ] HPI: Fetching primary data for 2025-09.
[2025-10-24T19:13:57.827452] [DEBUG] [VALIDATOR ] HP: All expected trading days are present.
[2025-10-24T19:13:57.827621] [DEBUG] [VALIDATOR ] HP: Primary data validation passed.
[2025-10-24T19:13:57.828781] [INFO ] [MAIN      ] HP: Fetched primary data is valid.
[2025-10-24T19:13:57.829035] [DEBUG] [LOCAL     ] HP: Saving primary data.
[2025-10-24T19:13:57.844350] [FATAL] [LOCAL     ] HP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:13:57.844534] [FATAL] [MAIN      ] HP: Failed to save primary data.
[2025-10-24T19:13:57.844581] [WARN ] [MAIN      ] HP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:13:57.844679] [INFO ] [LOCAL     ] HP: Starting deletion of primary data.
[2025-10-24T19:13:57.844768] [DEBUG] [LOCAL     ] HP: No primary data file found to delete.
[2025-10-24T19:13:57.844809] [INFO ] [LOCAL     ] HP: Starting deletion of derivative data.
[2025-10-24T19:13:57.844950] [DEBUG] [LOCAL     ] HP: Deleted derivative data file.
[2025-10-24T19:13:57.845329] [INFO ] [MAIN      ] Update Progress: 1044/2366 symbols completed. HP took 38.2s. Estimated remaining: 2h 49m 35s. Rate: 7.8 symbols/min
[2025-10-24T19:13:57.973556] [DEBUG] [LOCAL     ] HPP: Loaded 51560 existing records from primary storage.
[2025-10-24T19:13:57.990095] [INFO ] [MAIN      ] HPP: Loaded 51560 existing records.
[2025-10-24T19:13:58.178775] [INFO ] [MAIN      ] HPQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:13:58.269635] [WARN ] [MAIN      ] HPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:13:58.270129] [INFO ] [MAIN      ] HPP: Wiping existing primary data before full refresh.
[2025-10-24T19:13:58.270191] [INFO ] [LOCAL     ] HPP: Starting deletion of primary data.
[2025-10-24T19:13:58.270817] [DEBUG] [LOCAL     ] HPP: Deleted primary data file.
[2025-10-24T19:13:58.270876] [INFO ] [MAIN      ] HPP: Starting full primary refresh.
[2025-10-24T19:13:58.564415] [INFO ] [REMOTE    ] HPF: Fetching primary data for 2025-06.
[2025-10-24T19:13:58.591912] [DEBUG] [LOCAL     ] HPQ: Loaded 54059 existing records from primary storage.
[2025-10-24T19:13:58.615053] [INFO ] [MAIN      ] HPQ: Loaded 54059 existing records.
[2025-10-24T19:13:58.779788] [INFO ] [REMOTE    ] HPP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:13:58.838140] [INFO ] [REMOTE    ] HPI: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T19:13:58.897921] [WARN ] [MAIN      ] HPQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:13:58.898118] [INFO ] [MAIN      ] HPQ: Wiping existing primary data before full refresh.
[2025-10-24T19:13:58.898187] [INFO ] [LOCAL     ] HPQ: Starting deletion of primary data.
[2025-10-24T19:13:58.898398] [DEBUG] [LOCAL     ] HPQ: Deleted primary data file.
[2025-10-24T19:13:58.898486] [INFO ] [MAIN      ] HPQ: Starting full primary refresh.
[2025-10-24T19:13:59.196597] [INFO ] [REMOTE    ] HPF: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T19:13:59.291251] [INFO ] [REMOTE    ] HPQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:13:59.347614] [INFO ] [REMOTE    ] HPF: Fetching primary data for 2025-07.
[2025-10-24T19:14:00.093523] [INFO ] [REMOTE    ] HPF: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T19:14:00.147687] [INFO ] [REMOTE    ] HPI: Fetching primary data for 2025-10.
[2025-10-24T19:14:00.947678] [INFO ] [REMOTE    ] HPF: Fetching primary data for 2025-08.
[2025-10-24T19:14:01.222590] [INFO ] [REMOTE    ] HPI: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T19:14:01.224871] [INFO ] [REMOTE    ] HPI: Full fetch complete (13849 records).
[2025-10-24T19:14:01.224940] [DEBUG] [VALIDATOR ] HPI: Validating primary data.
[2025-10-24T19:14:01.587775] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present.
[2025-10-24T19:14:01.587845] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed.
[2025-10-24T19:14:01.588195] [INFO ] [MAIN      ] HPI: Fetched primary data is valid.
[2025-10-24T19:14:01.588234] [DEBUG] [LOCAL     ] HPI: Saving primary data.
[2025-10-24T19:14:01.588474] [FATAL] [LOCAL     ] HPI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:14:01.588557] [FATAL] [MAIN      ] HPI: Failed to save primary data.
[2025-10-24T19:14:01.588621] [WARN ] [MAIN      ] HPI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:14:01.588708] [INFO ] [LOCAL     ] HPI: Starting deletion of primary data.
[2025-10-24T19:14:01.588765] [DEBUG] [LOCAL     ] HPI: No primary data file found to delete.
[2025-10-24T19:14:01.588801] [INFO ] [LOCAL     ] HPI: Starting deletion of derivative data.
[2025-10-24T19:14:01.588950] [DEBUG] [LOCAL     ] HPI: Deleted derivative data file.
[2025-10-24T19:14:01.589038] [INFO ] [MAIN      ] Update Progress: 1045/2366 symbols completed. HPI took 18.9s. Estimated remaining: 2h 49m 22s. Rate: 7.8 symbols/min
[2025-10-24T19:14:01.755057] [INFO ] [REMOTE    ] HPP: Fetching primary data for 2025-01.
[2025-10-24T19:14:01.747192] [INFO ] [REMOTE    ] HPF: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T19:14:01.780892] [INFO ] [MAIN      ] HPS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:14:01.800181] [DEBUG] [LOCAL     ] HPS: Loaded 10382 existing records from primary storage.
[2025-10-24T19:14:01.800486] [INFO ] [MAIN      ] HPS: Loaded 10382 existing records.
[2025-10-24T19:14:01.984568] [WARN ] [MAIN      ] HPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:14:01.984838] [INFO ] [MAIN      ] HPS: Wiping existing primary data before full refresh.
[2025-10-24T19:14:01.984885] [INFO ] [LOCAL     ] HPS: Starting deletion of primary data.
[2025-10-24T19:14:01.985047] [DEBUG] [LOCAL     ] HPS: Deleted primary data file.
[2025-10-24T19:14:01.985085] [INFO ] [MAIN      ] HPS: Starting full primary refresh.
[2025-10-24T19:14:02.333839] [INFO ] [REMOTE    ] HPS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:14:02.547618] [INFO ] [REMOTE    ] HPS: Fetching primary data for 2025-01.
[2025-10-24T19:14:03.352849] [INFO ] [REMOTE    ] HPF: Fetching primary data for 2025-09.
[2025-10-24T19:14:03.369536] [INFO ] [REMOTE    ] HPP: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T19:14:03.404054] [INFO ] [REMOTE    ] HPS: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T19:14:04.081465] [INFO ] [REMOTE    ] HPF: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T19:14:04.147605] [INFO ] [REMOTE    ] HPF: Fetching primary data for 2025-10.
[2025-10-24T19:14:04.891457] [INFO ] [REMOTE    ] HPF: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T19:14:04.893218] [INFO ] [REMOTE    ] HPF: Full fetch complete (10477 records).
[2025-10-24T19:14:04.893293] [DEBUG] [VALIDATOR ] HPF: Validating primary data.
[2025-10-24T19:14:04.957218] [INFO ] [REMOTE    ] HPS: Fetching primary data for 2025-02.
[2025-10-24T19:14:05.270178] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present.
[2025-10-24T19:14:05.270264] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed.
[2025-10-24T19:14:05.270547] [INFO ] [MAIN      ] HPF: Fetched primary data is valid.
[2025-10-24T19:14:05.270590] [DEBUG] [LOCAL     ] HPF: Saving primary data.
[2025-10-24T19:14:05.270934] [FATAL] [LOCAL     ] HPF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:14:05.271044] [FATAL] [MAIN      ] HPF: Failed to save primary data.
[2025-10-24T19:14:05.271126] [WARN ] [MAIN      ] HPF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:14:05.271223] [INFO ] [LOCAL     ] HPF: Starting deletion of primary data.
[2025-10-24T19:14:05.271299] [DEBUG] [LOCAL     ] HPF: No primary data file found to delete.
[2025-10-24T19:14:05.271338] [INFO ] [LOCAL     ] HPF: Starting deletion of derivative data.
[2025-10-24T19:14:05.271472] [DEBUG] [LOCAL     ] HPF: Deleted derivative data file.
[2025-10-24T19:14:05.271549] [INFO ] [MAIN      ] Update Progress: 1046/2366 symbols completed. HPF took 25.5s. Estimated remaining: 2h 49m 9s. Rate: 7.8 symbols/min
[2025-10-24T19:14:05.446166] [INFO ] [MAIN      ] HQH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:14:05.474242] [DEBUG] [LOCAL     ] HQH: Loaded 25921 existing records from primary storage.
[2025-10-24T19:14:05.474510] [INFO ] [MAIN      ] HQH: Loaded 25921 existing records.
[2025-10-24T19:14:05.691607] [WARN ] [MAIN      ] HQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:14:05.691866] [INFO ] [MAIN      ] HQH: Wiping existing primary data before full refresh.
[2025-10-24T19:14:05.691928] [INFO ] [LOCAL     ] HQH: Starting deletion of primary data.
[2025-10-24T19:14:05.692104] [DEBUG] [LOCAL     ] HQH: Deleted primary data file.
[2025-10-24T19:14:05.692165] [INFO ] [MAIN      ] HQH: Starting full primary refresh.
[2025-10-24T19:14:05.759380] [INFO ] [REMOTE    ] HPQ: Fetching primary data for 2025-01.
[2025-10-24T19:14:05.870846] [INFO ] [REMOTE    ] HPS: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T19:14:06.108966] [INFO ] [REMOTE    ] HQH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:14:06.547706] [INFO ] [REMOTE    ] HPS: Fetching primary data for 2025-03.
[2025-10-24T19:14:07.347618] [INFO ] [REMOTE    ] HQH: Fetching primary data for 2025-01.
[2025-10-24T19:14:07.391403] [INFO ] [REMOTE    ] HPS: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T19:14:07.490122] [INFO ] [REMOTE    ] HPQ: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T19:14:08.147736] [INFO ] [REMOTE    ] HPP: Fetching primary data for 2025-02.
[2025-10-24T19:14:08.263982] [INFO ] [REMOTE    ] HQH: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T19:14:08.947758] [INFO ] [REMOTE    ] HQH: Fetching primary data for 2025-02.
[2025-10-24T19:14:09.645969] [INFO ] [REMOTE    ] HPP: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T19:14:09.747604] [INFO ] [REMOTE    ] HPS: Fetching primary data for 2025-04.
[2025-10-24T19:14:10.134272] [INFO ] [REMOTE    ] HQH: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T19:14:10.547726] [INFO ] [REMOTE    ] HQH: Fetching primary data for 2025-03.
[2025-10-24T19:14:10.600152] [INFO ] [REMOTE    ] HPS: Incremental fetch complete for 2025-04 (0.85 seconds).
[2025-10-24T19:14:11.347727] [INFO ] [REMOTE    ] HPS: Fetching primary data for 2025-05.
[2025-10-24T19:14:11.632279] [INFO ] [REMOTE    ] HQH: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T19:14:12.147666] [INFO ] [REMOTE    ] HQH: Fetching primary data for 2025-04.
[2025-10-24T19:14:12.231434] [INFO ] [REMOTE    ] HPS: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T19:14:12.947622] [INFO ] [REMOTE    ] HPS: Fetching primary data for 2025-06.
[2025-10-24T19:14:13.203174] [INFO ] [REMOTE    ] HQH: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T19:14:13.750347] [INFO ] [REMOTE    ] HPQ: Fetching primary data for 2025-02.
[2025-10-24T19:14:13.751955] [INFO ] [REMOTE    ] HPS: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T19:14:14.547751] [INFO ] [REMOTE    ] HPP: Fetching primary data for 2025-03.
[2025-10-24T19:14:15.335758] [INFO ] [REMOTE    ] HPQ: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T19:14:15.347610] [INFO ] [REMOTE    ] HPQ: Fetching primary data for 2025-03.
[2025-10-24T19:14:16.121550] [INFO ] [REMOTE    ] HPP: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T19:14:16.147596] [INFO ] [REMOTE    ] HPP: Fetching primary data for 2025-04.
[2025-10-24T19:14:16.825941] [INFO ] [REMOTE    ] HPQ: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T19:14:16.947603] [INFO ] [REMOTE    ] HPQ: Fetching primary data for 2025-04.
[2025-10-24T19:14:17.699386] [INFO ] [REMOTE    ] HPP: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T19:14:17.747673] [INFO ] [REMOTE    ] HPP: Fetching primary data for 2025-05.
[2025-10-24T19:14:18.547672] [INFO ] [REMOTE    ] HPS: Fetching primary data for 2025-07.
[2025-10-24T19:14:18.783914] [INFO ] [REMOTE    ] HPQ: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T19:14:19.119623] [INFO ] [REMOTE    ] HPS: Incremental fetch complete for 2025-07 (0.57 seconds).
[2025-10-24T19:14:19.231270] [INFO ] [REMOTE    ] HPP: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T19:14:19.347671] [INFO ] [REMOTE    ] HPP: Fetching primary data for 2025-06.
[2025-10-24T19:14:20.147718] [INFO ] [REMOTE    ] HPQ: Fetching primary data for 2025-05.
[2025-10-24T19:14:20.755617] [INFO ] [REMOTE    ] HPP: Incremental fetch complete for 2025-06 (1.41 seconds).
[2025-10-24T19:14:20.947694] [INFO ] [REMOTE    ] HPP: Fetching primary data for 2025-07.
[2025-10-24T19:14:21.747739] [INFO ] [REMOTE    ] HPS: Fetching primary data for 2025-08.
[2025-10-24T19:14:22.081795] [INFO ] [REMOTE    ] HPQ: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T19:14:22.555097] [INFO ] [REMOTE    ] HPQ: Fetching primary data for 2025-06.
[2025-10-24T19:14:22.566473] [INFO ] [REMOTE    ] HPP: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T19:14:22.598251] [INFO ] [REMOTE    ] HPS: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T19:14:23.347755] [INFO ] [REMOTE    ] HPP: Fetching primary data for 2025-08.
[2025-10-24T19:14:24.147663] [INFO ] [REMOTE    ] HQH: Fetching primary data for 2025-05.
[2025-10-24T19:14:24.416940] [INFO ] [REMOTE    ] HPQ: Incremental fetch complete for 2025-06 (1.86 seconds).
[2025-10-24T19:14:24.870950] [INFO ] [REMOTE    ] HPP: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T19:14:24.947730] [INFO ] [REMOTE    ] HPS: Fetching primary data for 2025-09.
[2025-10-24T19:14:25.279515] [INFO ] [REMOTE    ] HQH: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T19:14:25.713771] [INFO ] [REMOTE    ] HPS: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T19:14:25.747626] [INFO ] [REMOTE    ] HPS: Fetching primary data for 2025-10.
[2025-10-24T19:14:26.547750] [INFO ] [REMOTE    ] HQH: Fetching primary data for 2025-06.
[2025-10-24T19:14:26.831972] [INFO ] [REMOTE    ] HPS: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T19:14:26.834317] [INFO ] [REMOTE    ] HPS: Full fetch complete (15037 records).
[2025-10-24T19:14:26.834419] [DEBUG] [VALIDATOR ] HPS: Validating primary data.
[2025-10-24T19:14:27.209752] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present.
[2025-10-24T19:14:27.209834] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed.
[2025-10-24T19:14:27.210167] [INFO ] [MAIN      ] HPS: Fetched primary data is valid.
[2025-10-24T19:14:27.210206] [DEBUG] [LOCAL     ] HPS: Saving primary data.
[2025-10-24T19:14:27.210463] [FATAL] [LOCAL     ] HPS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:14:27.210550] [FATAL] [MAIN      ] HPS: Failed to save primary data.
[2025-10-24T19:14:27.210593] [WARN ] [MAIN      ] HPS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:14:27.210701] [INFO ] [LOCAL     ] HPS: Starting deletion of primary data.
[2025-10-24T19:14:27.210778] [DEBUG] [LOCAL     ] HPS: No primary data file found to delete.
[2025-10-24T19:14:27.210826] [INFO ] [LOCAL     ] HPS: Starting deletion of derivative data.
[2025-10-24T19:14:27.211012] [DEBUG] [LOCAL     ] HPS: Deleted derivative data file.
[2025-10-24T19:14:27.211123] [INFO ] [MAIN      ] Update Progress: 1047/2366 symbols completed. HPS took 25.6s. Estimated remaining: 2h 49m 19s. Rate: 7.8 symbols/min
[2025-10-24T19:14:27.362809] [INFO ] [REMOTE    ] HPQ: Fetching primary data for 2025-07.
[2025-10-24T19:14:27.397370] [INFO ] [MAIN      ] HQL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:14:27.417329] [DEBUG] [LOCAL     ] HQL: Loaded 17005 existing records from primary storage.
[2025-10-24T19:14:27.417579] [INFO ] [MAIN      ] HQL: Loaded 17005 existing records.
[2025-10-24T19:14:27.600999] [WARN ] [MAIN      ] HQL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:14:27.601328] [INFO ] [MAIN      ] HQL: Wiping existing primary data before full refresh.
[2025-10-24T19:14:27.601393] [INFO ] [LOCAL     ] HQL: Starting deletion of primary data.
[2025-10-24T19:14:27.614574] [DEBUG] [LOCAL     ] HQL: Deleted primary data file.
[2025-10-24T19:14:27.615175] [INFO ] [MAIN      ] HQL: Starting full primary refresh.
[2025-10-24T19:14:27.615110] [INFO ] [REMOTE    ] HQH: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T19:14:27.979289] [INFO ] [REMOTE    ] HQL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:14:28.147630] [INFO ] [REMOTE    ] HQH: Fetching primary data for 2025-07.
[2025-10-24T19:14:28.947708] [INFO ] [REMOTE    ] HQL: Fetching primary data for 2025-01.
[2025-10-24T19:14:29.282353] [INFO ] [REMOTE    ] HPQ: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T19:14:29.343277] [INFO ] [REMOTE    ] HQH: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T19:14:29.545325] [INFO ] [REMOTE    ] HQL: Incremental fetch complete for 2025-01 (0.60 seconds).
[2025-10-24T19:14:29.747747] [INFO ] [REMOTE    ] HPQ: Fetching primary data for 2025-08.
[2025-10-24T19:14:30.547724] [INFO ] [REMOTE    ] HQL: Fetching primary data for 2025-02.
[2025-10-24T19:14:31.347754] [INFO ] [REMOTE    ] HQH: Fetching primary data for 2025-08.
[2025-10-24T19:14:31.544391] [INFO ] [REMOTE    ] HQL: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T19:14:31.716078] [INFO ] [REMOTE    ] HPQ: Incremental fetch complete for 2025-08 (1.97 seconds).
[2025-10-24T19:14:32.147704] [INFO ] [REMOTE    ] HQL: Fetching primary data for 2025-03.
[2025-10-24T19:14:32.490553] [INFO ] [REMOTE    ] HQH: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T19:14:32.850560] [INFO ] [REMOTE    ] HQL: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T19:14:32.947710] [INFO ] [REMOTE    ] HQH: Fetching primary data for 2025-09.
[2025-10-24T19:14:33.747616] [INFO ] [REMOTE    ] HPP: Fetching primary data for 2025-09.
[2025-10-24T19:14:34.111893] [INFO ] [REMOTE    ] HQH: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T19:14:34.547669] [INFO ] [REMOTE    ] HQH: Fetching primary data for 2025-10.
[2025-10-24T19:14:35.347676] [INFO ] [REMOTE    ] HQL: Fetching primary data for 2025-04.
[2025-10-24T19:14:35.432705] [INFO ] [REMOTE    ] HPP: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T19:14:35.995583] [INFO ] [REMOTE    ] HQH: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T19:14:36.003994] [INFO ] [REMOTE    ] HQH: Full fetch complete (36898 records).
[2025-10-24T19:14:36.004177] [DEBUG] [VALIDATOR ] HQH: Validating primary data.
[2025-10-24T19:14:36.121144] [INFO ] [REMOTE    ] HQL: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T19:14:36.152696] [INFO ] [REMOTE    ] HPQ: Fetching primary data for 2025-09.
[2025-10-24T19:14:36.397212] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present.
[2025-10-24T19:14:36.397294] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed.
[2025-10-24T19:14:36.397981] [INFO ] [MAIN      ] HQH: Fetched primary data is valid.
[2025-10-24T19:14:36.398041] [DEBUG] [LOCAL     ] HQH: Saving primary data.
[2025-10-24T19:14:36.398374] [FATAL] [LOCAL     ] HQH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:14:36.398453] [FATAL] [MAIN      ] HQH: Failed to save primary data.
[2025-10-24T19:14:36.398496] [WARN ] [MAIN      ] HQH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:14:36.398572] [INFO ] [LOCAL     ] HQH: Starting deletion of primary data.
[2025-10-24T19:14:36.398667] [DEBUG] [LOCAL     ] HQH: No primary data file found to delete.
[2025-10-24T19:14:36.398734] [INFO ] [LOCAL     ] HQH: Starting deletion of derivative data.
[2025-10-24T19:14:36.398876] [DEBUG] [LOCAL     ] HQH: Deleted derivative data file.
[2025-10-24T19:14:36.398950] [INFO ] [MAIN      ] Update Progress: 1048/2366 symbols completed. HQH took 31.1s. Estimated remaining: 2h 49m 14s. Rate: 7.8 symbols/min
[2025-10-24T19:14:36.564638] [INFO ] [MAIN      ] HR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:14:36.615172] [DEBUG] [LOCAL     ] HR: Loaded 52495 existing records from primary storage.
[2025-10-24T19:14:36.615470] [INFO ] [MAIN      ] HR: Loaded 52495 existing records.
[2025-10-24T19:14:36.794959] [WARN ] [MAIN      ] HR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:14:36.795169] [INFO ] [MAIN      ] HR: Wiping existing primary data before full refresh.
[2025-10-24T19:14:36.795220] [INFO ] [LOCAL     ] HR: Starting deletion of primary data.
[2025-10-24T19:14:36.795585] [DEBUG] [LOCAL     ] HR: Deleted primary data file.
[2025-10-24T19:14:36.795702] [INFO ] [MAIN      ] HR: Starting full primary refresh.
[2025-10-24T19:14:36.950763] [INFO ] [REMOTE    ] HQL: Fetching primary data for 2025-05.
[2025-10-24T19:14:37.155106] [INFO ] [REMOTE    ] HR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:14:37.747637] [INFO ] [REMOTE    ] HR: Fetching primary data for 2025-01.
[2025-10-24T19:14:37.790031] [INFO ] [REMOTE    ] HQL: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T19:14:37.865056] [INFO ] [REMOTE    ] HPQ: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T19:14:38.547631] [INFO ] [REMOTE    ] HQL: Fetching primary data for 2025-06.
[2025-10-24T19:14:39.095868] [INFO ] [REMOTE    ] HR: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T19:14:39.347667] [INFO ] [REMOTE    ] HR: Fetching primary data for 2025-02.
[2025-10-24T19:14:39.420526] [INFO ] [REMOTE    ] HQL: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T19:14:40.147716] [INFO ] [REMOTE    ] HQL: Fetching primary data for 2025-07.
[2025-10-24T19:14:40.947726] [INFO ] [REMOTE    ] HPP: Fetching primary data for 2025-10.
[2025-10-24T19:14:40.987810] [INFO ] [REMOTE    ] HR: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T19:14:41.226171] [INFO ] [REMOTE    ] HQL: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T19:14:41.747733] [INFO ] [REMOTE    ] HPQ: Fetching primary data for 2025-10.
[2025-10-24T19:14:42.547710] [INFO ] [REMOTE    ] HQL: Fetching primary data for 2025-08.
[2025-10-24T19:14:42.632071] [INFO ] [REMOTE    ] HPP: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T19:14:42.642452] [INFO ] [REMOTE    ] HPP: Full fetch complete (73314 records).
[2025-10-24T19:14:42.642587] [DEBUG] [VALIDATOR ] HPP: Validating primary data.
[2025-10-24T19:14:43.027949] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present.
[2025-10-24T19:14:43.028049] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed.
[2025-10-24T19:14:43.029030] [INFO ] [MAIN      ] HPP: Fetched primary data is valid.
[2025-10-24T19:14:43.029092] [DEBUG] [LOCAL     ] HPP: Saving primary data.
[2025-10-24T19:14:43.029729] [FATAL] [LOCAL     ] HPP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:14:43.029819] [FATAL] [MAIN      ] HPP: Failed to save primary data.
[2025-10-24T19:14:43.029861] [WARN ] [MAIN      ] HPP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:14:43.029896] [INFO ] [LOCAL     ] HPP: Starting deletion of primary data.
[2025-10-24T19:14:43.029947] [DEBUG] [LOCAL     ] HPP: No primary data file found to delete.
[2025-10-24T19:14:43.029982] [INFO ] [LOCAL     ] HPP: Starting deletion of derivative data.
[2025-10-24T19:14:43.030205] [DEBUG] [LOCAL     ] HPP: Deleted derivative data file.
[2025-10-24T19:14:43.030706] [INFO ] [MAIN      ] Update Progress: 1049/2366 symbols completed. HPP took 45.8s. Estimated remaining: 2h 49m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:14:43.209905] [INFO ] [REMOTE    ] HQL: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T19:14:43.213311] [INFO ] [MAIN      ] HRB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:14:43.263189] [DEBUG] [LOCAL     ] HRB: Loaded 48553 existing records from primary storage.
[2025-10-24T19:14:43.263528] [INFO ] [MAIN      ] HRB: Loaded 48553 existing records.
[2025-10-24T19:14:43.355469] [INFO ] [REMOTE    ] HR: Fetching primary data for 2025-03.
[2025-10-24T19:14:43.448112] [WARN ] [MAIN      ] HRB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:14:43.448316] [INFO ] [MAIN      ] HRB: Wiping existing primary data before full refresh.
[2025-10-24T19:14:43.448361] [INFO ] [LOCAL     ] HRB: Starting deletion of primary data.
[2025-10-24T19:14:43.448791] [DEBUG] [LOCAL     ] HRB: Deleted primary data file.
[2025-10-24T19:14:43.448861] [INFO ] [MAIN      ] HRB: Starting full primary refresh.
[2025-10-24T19:14:43.806847] [INFO ] [REMOTE    ] HRB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:14:43.832967] [INFO ] [REMOTE    ] HPQ: Incremental fetch complete for 2025-10 (2.09 seconds).
[2025-10-24T19:14:43.842936] [INFO ] [REMOTE    ] HPQ: Full fetch complete (77842 records).
[2025-10-24T19:14:43.843101] [DEBUG] [VALIDATOR ] HPQ: Validating primary data.
[2025-10-24T19:14:44.152883] [INFO ] [REMOTE    ] HQL: Fetching primary data for 2025-09.
[2025-10-24T19:14:44.228108] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present.
[2025-10-24T19:14:44.228191] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed.
[2025-10-24T19:14:44.229214] [INFO ] [MAIN      ] HPQ: Fetched primary data is valid.
[2025-10-24T19:14:44.229281] [DEBUG] [LOCAL     ] HPQ: Saving primary data.
[2025-10-24T19:14:44.230119] [FATAL] [LOCAL     ] HPQ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:14:44.230295] [FATAL] [MAIN      ] HPQ: Failed to save primary data.
[2025-10-24T19:14:44.230342] [WARN ] [MAIN      ] HPQ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:14:44.230403] [INFO ] [LOCAL     ] HPQ: Starting deletion of primary data.
[2025-10-24T19:14:44.230462] [DEBUG] [LOCAL     ] HPQ: No primary data file found to delete.
[2025-10-24T19:14:44.230496] [INFO ] [LOCAL     ] HPQ: Starting deletion of derivative data.
[2025-10-24T19:14:44.230685] [DEBUG] [LOCAL     ] HPQ: Deleted derivative data file.
[2025-10-24T19:14:44.231129] [INFO ] [MAIN      ] Update Progress: 1050/2366 symbols completed. HPQ took 46.4s. Estimated remaining: 2h 48m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:14:44.398138] [INFO ] [MAIN      ] HRI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:14:44.436240] [DEBUG] [LOCAL     ] HRI: Loaded 32395 existing records from primary storage.
[2025-10-24T19:14:44.436724] [INFO ] [MAIN      ] HRI: Loaded 32395 existing records.
[2025-10-24T19:14:44.642061] [WARN ] [MAIN      ] HRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:14:44.642432] [INFO ] [MAIN      ] HRI: Wiping existing primary data before full refresh.
[2025-10-24T19:14:44.642582] [INFO ] [LOCAL     ] HRI: Starting deletion of primary data.
[2025-10-24T19:14:44.642890] [DEBUG] [LOCAL     ] HRI: Deleted primary data file.
[2025-10-24T19:14:44.643030] [INFO ] [MAIN      ] HRI: Starting full primary refresh.
[2025-10-24T19:14:44.850662] [INFO ] [REMOTE    ] HR: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T19:14:44.951205] [INFO ] [REMOTE    ] HR: Fetching primary data for 2025-04.
[2025-10-24T19:14:45.081380] [INFO ] [REMOTE    ] HRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:14:45.210016] [INFO ] [REMOTE    ] HQL: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T19:14:45.747734] [INFO ] [REMOTE    ] HRB: Fetching primary data for 2025-01.
[2025-10-24T19:14:46.459178] [INFO ] [REMOTE    ] HR: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T19:14:46.547691] [INFO ] [REMOTE    ] HRI: Fetching primary data for 2025-01.
[2025-10-24T19:14:47.023814] [INFO ] [REMOTE    ] HRB: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T19:14:47.347715] [INFO ] [REMOTE    ] HRB: Fetching primary data for 2025-02.
[2025-10-24T19:14:47.859111] [INFO ] [REMOTE    ] HRI: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T19:14:48.147701] [INFO ] [REMOTE    ] HRI: Fetching primary data for 2025-02.
[2025-10-24T19:14:48.905243] [INFO ] [REMOTE    ] HRB: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T19:14:48.947624] [INFO ] [REMOTE    ] HR: Fetching primary data for 2025-05.
[2025-10-24T19:14:49.055327] [INFO ] [REMOTE    ] HRI: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T19:14:49.747676] [INFO ] [REMOTE    ] HRB: Fetching primary data for 2025-03.
[2025-10-24T19:14:50.557140] [INFO ] [REMOTE    ] HRI: Fetching primary data for 2025-03.
[2025-10-24T19:14:50.576562] [INFO ] [REMOTE    ] HR: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T19:14:51.222406] [INFO ] [REMOTE    ] HRB: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T19:14:51.347682] [INFO ] [REMOTE    ] HQL: Fetching primary data for 2025-10.
[2025-10-24T19:14:51.585041] [INFO ] [REMOTE    ] HRI: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T19:14:52.147712] [INFO ] [REMOTE    ] HRB: Fetching primary data for 2025-04.
[2025-10-24T19:14:52.433676] [INFO ] [REMOTE    ] HQL: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T19:14:52.438344] [INFO ] [REMOTE    ] HQL: Full fetch complete (25328 records).
[2025-10-24T19:14:52.438420] [DEBUG] [VALIDATOR ] HQL: Validating primary data.
[2025-10-24T19:14:52.803370] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present.
[2025-10-24T19:14:52.803444] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed.
[2025-10-24T19:14:52.803979] [INFO ] [MAIN      ] HQL: Fetched primary data is valid.
[2025-10-24T19:14:52.804040] [DEBUG] [LOCAL     ] HQL: Saving primary data.
[2025-10-24T19:14:52.804329] [FATAL] [LOCAL     ] HQL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:14:52.804408] [FATAL] [MAIN      ] HQL: Failed to save primary data.
[2025-10-24T19:14:52.804448] [WARN ] [MAIN      ] HQL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:14:52.804483] [INFO ] [LOCAL     ] HQL: Starting deletion of primary data.
[2025-10-24T19:14:52.804537] [DEBUG] [LOCAL     ] HQL: No primary data file found to delete.
[2025-10-24T19:14:52.804574] [INFO ] [LOCAL     ] HQL: Starting deletion of derivative data.
[2025-10-24T19:14:52.804743] [DEBUG] [LOCAL     ] HQL: Deleted derivative data file.
[2025-10-24T19:14:52.804833] [INFO ] [MAIN      ] Update Progress: 1051/2366 symbols completed. HQL took 25.6s. Estimated remaining: 2h 48m 42s. Rate: 7.8 symbols/min
[2025-10-24T19:14:52.952396] [INFO ] [REMOTE    ] HR: Fetching primary data for 2025-06.
[2025-10-24T19:14:52.975745] [INFO ] [MAIN      ] HRL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:14:53.027380] [DEBUG] [LOCAL     ] HRL: Loaded 53511 existing records from primary storage.
[2025-10-24T19:14:53.027742] [INFO ] [MAIN      ] HRL: Loaded 53511 existing records.
[2025-10-24T19:14:53.206719] [WARN ] [MAIN      ] HRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:14:53.206957] [INFO ] [MAIN      ] HRL: Wiping existing primary data before full refresh.
[2025-10-24T19:14:53.207028] [INFO ] [LOCAL     ] HRL: Starting deletion of primary data.
[2025-10-24T19:14:53.207594] [DEBUG] [LOCAL     ] HRL: Deleted primary data file.
[2025-10-24T19:14:53.207692] [INFO ] [MAIN      ] HRL: Starting full primary refresh.
[2025-10-24T19:14:53.565972] [INFO ] [REMOTE    ] HRL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:14:53.601585] [INFO ] [REMOTE    ] HRB: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T19:14:53.747695] [INFO ] [REMOTE    ] HRB: Fetching primary data for 2025-05.
[2025-10-24T19:14:54.530092] [INFO ] [REMOTE    ] HR: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T19:14:54.547612] [INFO ] [REMOTE    ] HR: Fetching primary data for 2025-07.
[2025-10-24T19:14:55.236620] [INFO ] [REMOTE    ] HRB: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T19:14:55.347613] [INFO ] [REMOTE    ] HRI: Fetching primary data for 2025-04.
[2025-10-24T19:14:56.077218] [INFO ] [REMOTE    ] HR: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T19:14:56.147599] [INFO ] [REMOTE    ] HR: Fetching primary data for 2025-08.
[2025-10-24T19:14:56.759898] [INFO ] [REMOTE    ] HRI: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T19:14:56.947639] [INFO ] [REMOTE    ] HRL: Fetching primary data for 2025-01.
[2025-10-24T19:14:57.637733] [INFO ] [REMOTE    ] HR: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T19:14:57.747610] [INFO ] [REMOTE    ] HR: Fetching primary data for 2025-09.
[2025-10-24T19:14:58.556704] [INFO ] [REMOTE    ] HRB: Fetching primary data for 2025-06.
[2025-10-24T19:14:58.576253] [INFO ] [REMOTE    ] HRL: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T19:14:59.347673] [INFO ] [REMOTE    ] HRI: Fetching primary data for 2025-05.
[2025-10-24T19:14:59.490906] [INFO ] [REMOTE    ] HR: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T19:15:00.121227] [INFO ] [REMOTE    ] HRB: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T19:15:00.147608] [INFO ] [REMOTE    ] HRB: Fetching primary data for 2025-07.
[2025-10-24T19:15:00.342947] [INFO ] [REMOTE    ] HRI: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T19:15:00.947635] [INFO ] [REMOTE    ] HRI: Fetching primary data for 2025-06.
[2025-10-24T19:15:01.747626] [INFO ] [REMOTE    ] HRL: Fetching primary data for 2025-02.
[2025-10-24T19:15:01.917778] [INFO ] [REMOTE    ] HRB: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T19:15:02.013005] [INFO ] [REMOTE    ] HRI: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T19:15:02.547693] [INFO ] [REMOTE    ] HRB: Fetching primary data for 2025-08.
[2025-10-24T19:15:03.347617] [INFO ] [REMOTE    ] HRI: Fetching primary data for 2025-07.
[2025-10-24T19:15:03.546153] [INFO ] [REMOTE    ] HRL: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T19:15:04.147628] [INFO ] [REMOTE    ] HRL: Fetching primary data for 2025-03.
[2025-10-24T19:15:04.340807] [INFO ] [REMOTE    ] HRB: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T19:15:04.669459] [INFO ] [REMOTE    ] HRI: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T19:15:04.947674] [INFO ] [REMOTE    ] HRI: Fetching primary data for 2025-08.
[2025-10-24T19:15:05.747579] [INFO ] [REMOTE    ] HRB: Fetching primary data for 2025-09.
[2025-10-24T19:15:05.785241] [INFO ] [REMOTE    ] HRL: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T19:15:05.838323] [INFO ] [REMOTE    ] HRI: Incremental fetch complete for 2025-08 (0.89 seconds).
[2025-10-24T19:15:06.547694] [INFO ] [REMOTE    ] HRL: Fetching primary data for 2025-04.
[2025-10-24T19:15:07.347690] [INFO ] [REMOTE    ] HRI: Fetching primary data for 2025-09.
[2025-10-24T19:15:07.508783] [INFO ] [REMOTE    ] HRB: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T19:15:08.147629] [INFO ] [REMOTE    ] HR: Fetching primary data for 2025-10.
[2025-10-24T19:15:08.306534] [INFO ] [REMOTE    ] HRL: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T19:15:08.789412] [INFO ] [REMOTE    ] HRI: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T19:15:08.947626] [INFO ] [REMOTE    ] HRL: Fetching primary data for 2025-05.
[2025-10-24T19:15:09.747693] [INFO ] [REMOTE    ] HRB: Fetching primary data for 2025-10.
[2025-10-24T19:15:09.978113] [INFO ] [REMOTE    ] HR: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T19:15:09.991054] [INFO ] [REMOTE    ] HR: Full fetch complete (75083 records).
[2025-10-24T19:15:09.991361] [DEBUG] [VALIDATOR ] HR: Validating primary data.
[2025-10-24T19:15:10.389072] [DEBUG] [VALIDATOR ] HR: All expected trading days are present.
[2025-10-24T19:15:10.389169] [DEBUG] [VALIDATOR ] HR: Primary data validation passed.
[2025-10-24T19:15:10.390268] [INFO ] [MAIN      ] HR: Fetched primary data is valid.
[2025-10-24T19:15:10.390333] [DEBUG] [LOCAL     ] HR: Saving primary data.
[2025-10-24T19:15:10.390906] [FATAL] [LOCAL     ] HR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:15:10.391034] [FATAL] [MAIN      ] HR: Failed to save primary data.
[2025-10-24T19:15:10.391090] [WARN ] [MAIN      ] HR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:15:10.391128] [INFO ] [LOCAL     ] HR: Starting deletion of primary data.
[2025-10-24T19:15:10.391182] [DEBUG] [LOCAL     ] HR: No primary data file found to delete.
[2025-10-24T19:15:10.391219] [INFO ] [LOCAL     ] HR: Starting deletion of derivative data.
[2025-10-24T19:15:10.391418] [DEBUG] [LOCAL     ] HR: Deleted derivative data file.
[2025-10-24T19:15:10.391781] [INFO ] [MAIN      ] Update Progress: 1052/2366 symbols completed. HR took 34.0s. Estimated remaining: 2h 48m 47s. Rate: 7.8 symbols/min
[2025-10-24T19:15:10.568200] [INFO ] [MAIN      ] HRTG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:15:10.564935] [INFO ] [REMOTE    ] HRI: Fetching primary data for 2025-10.
[2025-10-24T19:15:10.615860] [INFO ] [REMOTE    ] HRL: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T19:15:10.638735] [DEBUG] [LOCAL     ] HRTG: Loaded 34749 existing records from primary storage.
[2025-10-24T19:15:10.638987] [INFO ] [MAIN      ] HRTG: Loaded 34749 existing records.
[2025-10-24T19:15:10.817945] [WARN ] [MAIN      ] HRTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:15:10.818265] [INFO ] [MAIN      ] HRTG: Wiping existing primary data before full refresh.
[2025-10-24T19:15:10.818322] [INFO ] [LOCAL     ] HRTG: Starting deletion of primary data.
[2025-10-24T19:15:10.818851] [DEBUG] [LOCAL     ] HRTG: Deleted primary data file.
[2025-10-24T19:15:10.818910] [INFO ] [MAIN      ] HRTG: Starting full primary refresh.
[2025-10-24T19:15:11.178627] [INFO ] [REMOTE    ] HRTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:15:11.347606] [INFO ] [REMOTE    ] HRTG: Fetching primary data for 2025-01.
[2025-10-24T19:15:11.628280] [INFO ] [REMOTE    ] HRB: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T19:15:11.636706] [INFO ] [REMOTE    ] HRB: Full fetch complete (69904 records).
[2025-10-24T19:15:11.636820] [DEBUG] [VALIDATOR ] HRB: Validating primary data.
[2025-10-24T19:15:12.024241] [INFO ] [REMOTE    ] HRI: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T19:15:12.050446] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present.
[2025-10-24T19:15:12.050756] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed.
[2025-10-24T19:15:12.051746] [INFO ] [MAIN      ] HRB: Fetched primary data is valid.
[2025-10-24T19:15:12.051827] [DEBUG] [LOCAL     ] HRB: Saving primary data.
[2025-10-24T19:15:12.052250] [INFO ] [REMOTE    ] HRI: Full fetch complete (46793 records).
[2025-10-24T19:15:12.052332] [DEBUG] [VALIDATOR ] HRI: Validating primary data.
[2025-10-24T19:15:12.052583] [FATAL] [LOCAL     ] HRB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:15:12.052756] [FATAL] [MAIN      ] HRB: Failed to save primary data.
[2025-10-24T19:15:12.052835] [WARN ] [MAIN      ] HRB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:15:12.085359] [INFO ] [LOCAL     ] HRB: Starting deletion of primary data.
[2025-10-24T19:15:12.096889] [DEBUG] [LOCAL     ] HRB: No primary data file found to delete.
[2025-10-24T19:15:12.109143] [INFO ] [LOCAL     ] HRB: Starting deletion of derivative data.
[2025-10-24T19:15:12.124418] [DEBUG] [LOCAL     ] HRB: Deleted derivative data file.
[2025-10-24T19:15:12.131459] [INFO ] [MAIN      ] Update Progress: 1053/2366 symbols completed. HRB took 29.1s. Estimated remaining: 2h 48m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:15:12.167805] [INFO ] [REMOTE    ] HRL: Fetching primary data for 2025-06.
[2025-10-24T19:15:12.487199] [INFO ] [MAIN      ] HSBC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:15:12.548413] [INFO ] [REMOTE    ] HRTG: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T19:15:12.640998] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present.
[2025-10-24T19:15:12.655286] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed.
[2025-10-24T19:15:12.656197] [INFO ] [MAIN      ] HRI: Fetched primary data is valid.
[2025-10-24T19:15:12.656258] [DEBUG] [LOCAL     ] HRI: Saving primary data.
[2025-10-24T19:15:12.656670] [FATAL] [LOCAL     ] HRI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:15:12.656752] [FATAL] [MAIN      ] HRI: Failed to save primary data.
[2025-10-24T19:15:12.656794] [WARN ] [MAIN      ] HRI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:15:12.656858] [INFO ] [LOCAL     ] HRI: Starting deletion of primary data.
[2025-10-24T19:15:12.656917] [DEBUG] [LOCAL     ] HRI: No primary data file found to delete.
[2025-10-24T19:15:12.656952] [INFO ] [LOCAL     ] HRI: Starting deletion of derivative data.
[2025-10-24T19:15:12.657113] [DEBUG] [LOCAL     ] HRI: Deleted derivative data file.
[2025-10-24T19:15:12.657221] [INFO ] [MAIN      ] Update Progress: 1054/2366 symbols completed. HRI took 28.4s. Estimated remaining: 2h 48m 15s. Rate: 7.8 symbols/min
[2025-10-24T19:15:12.796802] [DEBUG] [LOCAL     ] HSBC: Loaded 51359 existing records from primary storage.
[2025-10-24T19:15:12.820521] [INFO ] [MAIN      ] HSBC: Loaded 51359 existing records.
[2025-10-24T19:15:12.914239] [INFO ] [MAIN      ] HSHP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:15:12.947707] [INFO ] [REMOTE    ] HRTG: Fetching primary data for 2025-02.
[2025-10-24T19:15:13.032902] [WARN ] [MAIN      ] HSBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:15:13.033192] [INFO ] [MAIN      ] HSBC: Wiping existing primary data before full refresh.
[2025-10-24T19:15:13.033241] [INFO ] [LOCAL     ] HSBC: Starting deletion of primary data.
[2025-10-24T19:15:13.033756] [DEBUG] [LOCAL     ] HSBC: Deleted primary data file.
[2025-10-24T19:15:13.033812] [INFO ] [MAIN      ] HSBC: Starting full primary refresh.
[2025-10-24T19:15:13.139915] [DEBUG] [LOCAL     ] HSHP: Loaded 14520 existing records from primary storage.
[2025-10-24T19:15:13.142685] [INFO ] [MAIN      ] HSHP: Loaded 14520 existing records.
[2025-10-24T19:15:13.500201] [WARN ] [MAIN      ] HSHP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:15:13.510675] [INFO ] [MAIN      ] HSHP: Wiping existing primary data before full refresh.
[2025-10-24T19:15:13.510761] [INFO ] [LOCAL     ] HSHP: Starting deletion of primary data.
[2025-10-24T19:15:13.511149] [DEBUG] [LOCAL     ] HSHP: Deleted primary data file.
[2025-10-24T19:15:13.516634] [INFO ] [MAIN      ] HSHP: Starting full primary refresh.
[2025-10-24T19:15:13.699958] [INFO ] [REMOTE    ] HSBC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:15:13.752903] [INFO ] [REMOTE    ] HSBC: Fetching primary data for 2025-01.
[2025-10-24T19:15:13.995119] [INFO ] [REMOTE    ] HSHP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:15:14.012352] [INFO ] [REMOTE    ] HRTG: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T19:15:14.191788] [INFO ] [REMOTE    ] HRL: Incremental fetch complete for 2025-06 (2.02 seconds).
[2025-10-24T19:15:14.547674] [INFO ] [REMOTE    ] HSHP: Fetching primary data for 2025-01.
[2025-10-24T19:15:15.347612] [INFO ] [REMOTE    ] HRL: Fetching primary data for 2025-07.
[2025-10-24T19:15:15.516211] [INFO ] [REMOTE    ] HSBC: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T19:15:15.535008] [INFO ] [REMOTE    ] HSHP: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T19:15:16.147637] [INFO ] [REMOTE    ] HRTG: Fetching primary data for 2025-03.
[2025-10-24T19:15:16.947633] [INFO ] [REMOTE    ] HSBC: Fetching primary data for 2025-02.
[2025-10-24T19:15:17.168887] [INFO ] [REMOTE    ] HRL: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T19:15:17.194699] [INFO ] [REMOTE    ] HRTG: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T19:15:17.747690] [INFO ] [REMOTE    ] HSHP: Fetching primary data for 2025-02.
[2025-10-24T19:15:18.547692] [INFO ] [REMOTE    ] HRL: Fetching primary data for 2025-08.
[2025-10-24T19:15:18.772788] [INFO ] [REMOTE    ] HSBC: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T19:15:18.828114] [INFO ] [REMOTE    ] HSHP: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T19:15:19.347693] [INFO ] [REMOTE    ] HSBC: Fetching primary data for 2025-03.
[2025-10-24T19:15:20.147623] [INFO ] [REMOTE    ] HRTG: Fetching primary data for 2025-04.
[2025-10-24T19:15:20.255526] [INFO ] [REMOTE    ] HRL: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T19:15:20.947700] [INFO ] [REMOTE    ] HSHP: Fetching primary data for 2025-03.
[2025-10-24T19:15:21.290262] [INFO ] [REMOTE    ] HSBC: Incremental fetch complete for 2025-03 (1.94 seconds).
[2025-10-24T19:15:21.472607] [INFO ] [REMOTE    ] HRTG: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T19:15:21.747698] [INFO ] [REMOTE    ] HRTG: Fetching primary data for 2025-05.
[2025-10-24T19:15:22.049511] [INFO ] [REMOTE    ] HSHP: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T19:15:22.547628] [INFO ] [REMOTE    ] HRL: Fetching primary data for 2025-09.
[2025-10-24T19:15:23.102562] [INFO ] [REMOTE    ] HRTG: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T19:15:23.347727] [INFO ] [REMOTE    ] HSHP: Fetching primary data for 2025-04.
[2025-10-24T19:15:24.147628] [INFO ] [REMOTE    ] HSBC: Fetching primary data for 2025-04.
[2025-10-24T19:15:24.503735] [INFO ] [REMOTE    ] HRL: Incremental fetch complete for 2025-09 (1.96 seconds).
[2025-10-24T19:15:24.529728] [INFO ] [REMOTE    ] HSHP: Incremental fetch complete for 2025-04 (1.18 seconds).
[2025-10-24T19:15:24.947709] [INFO ] [REMOTE    ] HRL: Fetching primary data for 2025-10.
[2025-10-24T19:15:25.747623] [INFO ] [REMOTE    ] HRTG: Fetching primary data for 2025-06.
[2025-10-24T19:15:26.073025] [INFO ] [REMOTE    ] HSBC: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T19:15:26.547604] [INFO ] [REMOTE    ] HSHP: Fetching primary data for 2025-05.
[2025-10-24T19:15:26.639536] [INFO ] [REMOTE    ] HRL: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T19:15:26.649165] [INFO ] [REMOTE    ] HRL: Full fetch complete (77029 records).
[2025-10-24T19:15:26.649285] [DEBUG] [VALIDATOR ] HRL: Validating primary data.
[2025-10-24T19:15:26.994203] [INFO ] [REMOTE    ] HRTG: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T19:15:27.095719] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present.
[2025-10-24T19:15:27.095798] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed.
[2025-10-24T19:15:27.096809] [INFO ] [MAIN      ] HRL: Fetched primary data is valid.
[2025-10-24T19:15:27.096870] [DEBUG] [LOCAL     ] HRL: Saving primary data.
[2025-10-24T19:15:27.097432] [FATAL] [LOCAL     ] HRL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:15:27.097521] [FATAL] [MAIN      ] HRL: Failed to save primary data.
[2025-10-24T19:15:27.097563] [WARN ] [MAIN      ] HRL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:15:27.097598] [INFO ] [LOCAL     ] HRL: Starting deletion of primary data.
[2025-10-24T19:15:27.097698] [DEBUG] [LOCAL     ] HRL: No primary data file found to delete.
[2025-10-24T19:15:27.097774] [INFO ] [LOCAL     ] HRL: Starting deletion of derivative data.
[2025-10-24T19:15:27.097941] [DEBUG] [LOCAL     ] HRL: Deleted derivative data file.
[2025-10-24T19:15:27.098423] [INFO ] [MAIN      ] Update Progress: 1055/2366 symbols completed. HRL took 34.3s. Estimated remaining: 2h 48m 16s. Rate: 7.8 symbols/min
[2025-10-24T19:15:27.270179] [INFO ] [MAIN      ] HSY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:15:27.321434] [DEBUG] [LOCAL     ] HSY: Loaded 50734 existing records from primary storage.
[2025-10-24T19:15:27.321777] [INFO ] [MAIN      ] HSY: Loaded 50734 existing records.
[2025-10-24T19:15:27.352863] [INFO ] [REMOTE    ] HSBC: Fetching primary data for 2025-05.
[2025-10-24T19:15:27.445403] [INFO ] [REMOTE    ] HSHP: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T19:15:27.514060] [WARN ] [MAIN      ] HSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:15:27.514236] [INFO ] [MAIN      ] HSY: Wiping existing primary data before full refresh.
[2025-10-24T19:15:27.514281] [INFO ] [LOCAL     ] HSY: Starting deletion of primary data.
[2025-10-24T19:15:27.515307] [DEBUG] [LOCAL     ] HSY: Deleted primary data file.
[2025-10-24T19:15:27.515365] [INFO ] [MAIN      ] HSY: Starting full primary refresh.
[2025-10-24T19:15:27.873012] [INFO ] [REMOTE    ] HSY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:15:28.147701] [INFO ] [REMOTE    ] HSHP: Fetching primary data for 2025-06.
[2025-10-24T19:15:28.947617] [INFO ] [REMOTE    ] HRTG: Fetching primary data for 2025-07.
[2025-10-24T19:15:29.088363] [INFO ] [REMOTE    ] HSHP: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T19:15:29.227324] [INFO ] [REMOTE    ] HSBC: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T19:15:29.747732] [INFO ] [REMOTE    ] HSBC: Fetching primary data for 2025-06.
[2025-10-24T19:15:30.260887] [INFO ] [REMOTE    ] HRTG: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T19:15:30.547681] [INFO ] [REMOTE    ] HSHP: Fetching primary data for 2025-07.
[2025-10-24T19:15:31.347628] [INFO ] [REMOTE    ] HRTG: Fetching primary data for 2025-08.
[2025-10-24T19:15:31.495279] [INFO ] [REMOTE    ] HSHP: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T19:15:31.530774] [INFO ] [REMOTE    ] HSBC: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T19:15:32.147689] [INFO ] [REMOTE    ] HSHP: Fetching primary data for 2025-08.
[2025-10-24T19:15:32.230173] [INFO ] [REMOTE    ] HRTG: Incremental fetch complete for 2025-08 (0.88 seconds).
[2025-10-24T19:15:32.944138] [INFO ] [REMOTE    ] HSHP: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T19:15:32.947590] [INFO ] [REMOTE    ] HSHP: Fetching primary data for 2025-09.
[2025-10-24T19:15:33.711940] [INFO ] [REMOTE    ] HSHP: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T19:15:33.747604] [INFO ] [REMOTE    ] HSHP: Fetching primary data for 2025-10.
[2025-10-24T19:15:34.547622] [INFO ] [REMOTE    ] HRTG: Fetching primary data for 2025-09.
[2025-10-24T19:15:34.636432] [INFO ] [REMOTE    ] HSHP: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T19:15:34.639492] [INFO ] [REMOTE    ] HSHP: Full fetch complete (23058 records).
[2025-10-24T19:15:34.639581] [DEBUG] [VALIDATOR ] HSHP: Validating primary data.
[2025-10-24T19:15:35.063792] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present.
[2025-10-24T19:15:35.063873] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed.
[2025-10-24T19:15:35.064488] [INFO ] [MAIN      ] HSHP: Fetched primary data is valid.
[2025-10-24T19:15:35.064553] [DEBUG] [LOCAL     ] HSHP: Saving primary data.
[2025-10-24T19:15:35.064907] [FATAL] [LOCAL     ] HSHP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:15:35.064993] [FATAL] [MAIN      ] HSHP: Failed to save primary data.
[2025-10-24T19:15:35.065060] [WARN ] [MAIN      ] HSHP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:15:35.065130] [INFO ] [LOCAL     ] HSHP: Starting deletion of primary data.
[2025-10-24T19:15:35.065208] [DEBUG] [LOCAL     ] HSHP: No primary data file found to delete.
[2025-10-24T19:15:35.065246] [INFO ] [LOCAL     ] HSHP: Starting deletion of derivative data.
[2025-10-24T19:15:35.065385] [DEBUG] [LOCAL     ] HSHP: Deleted derivative data file.
[2025-10-24T19:15:35.065470] [INFO ] [MAIN      ] Update Progress: 1056/2366 symbols completed. HSHP took 22.4s. Estimated remaining: 2h 48m 8s. Rate: 7.8 symbols/min
[2025-10-24T19:15:35.279169] [INFO ] [MAIN      ] HTB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:15:35.279427] [DEBUG] [LOCAL     ] HTB: No existing data file found in primary storage.
[2025-10-24T19:15:35.279503] [WARN ] [MAIN      ] HTB: No existing data found, performing full refresh instead.
[2025-10-24T19:15:35.279685] [INFO ] [MAIN      ] HTB: Wiping existing primary data before full refresh.
[2025-10-24T19:15:35.279745] [INFO ] [LOCAL     ] HTB: Starting deletion of primary data.
[2025-10-24T19:15:35.279793] [DEBUG] [LOCAL     ] HTB: No primary data file found to delete.
[2025-10-24T19:15:35.279827] [INFO ] [MAIN      ] HTB: Starting full primary refresh.
[2025-10-24T19:15:35.357348] [INFO ] [REMOTE    ] HSBC: Fetching primary data for 2025-07.
[2025-10-24T19:15:35.680548] [INFO ] [REMOTE    ] HTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:15:35.880304] [INFO ] [REMOTE    ] HRTG: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T19:15:36.147678] [INFO ] [REMOTE    ] HRTG: Fetching primary data for 2025-10.
[2025-10-24T19:15:36.947638] [INFO ] [REMOTE    ] HSY: Fetching primary data for 2025-01.
[2025-10-24T19:15:37.137715] [INFO ] [REMOTE    ] HSBC: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T19:15:37.569265] [INFO ] [REMOTE    ] HRTG: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T19:15:37.575713] [INFO ] [REMOTE    ] HRTG: Full fetch complete (44501 records).
[2025-10-24T19:15:37.575809] [DEBUG] [VALIDATOR ] HRTG: Validating primary data.
[2025-10-24T19:15:37.761932] [INFO ] [REMOTE    ] HSBC: Fetching primary data for 2025-08.
[2025-10-24T19:15:37.974078] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present.
[2025-10-24T19:15:37.974162] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed.
[2025-10-24T19:15:37.974929] [INFO ] [MAIN      ] HRTG: Fetched primary data is valid.
[2025-10-24T19:15:37.974991] [DEBUG] [LOCAL     ] HRTG: Saving primary data.
[2025-10-24T19:15:37.975482] [FATAL] [LOCAL     ] HRTG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:15:37.975588] [FATAL] [MAIN      ] HRTG: Failed to save primary data.
[2025-10-24T19:15:37.975707] [WARN ] [MAIN      ] HRTG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:15:37.975805] [INFO ] [LOCAL     ] HRTG: Starting deletion of primary data.
[2025-10-24T19:15:37.975889] [DEBUG] [LOCAL     ] HRTG: No primary data file found to delete.
[2025-10-24T19:15:37.975928] [INFO ] [LOCAL     ] HRTG: Starting deletion of derivative data.
[2025-10-24T19:15:37.976075] [DEBUG] [LOCAL     ] HRTG: Deleted derivative data file.
[2025-10-24T19:15:37.976471] [INFO ] [MAIN      ] Update Progress: 1057/2366 symbols completed. HRTG took 27.6s. Estimated remaining: 2h 47m 55s. Rate: 7.8 symbols/min
[2025-10-24T19:15:38.151347] [INFO ] [MAIN      ] HTD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:15:38.168458] [DEBUG] [LOCAL     ] HTD: Loaded 14322 existing records from primary storage.
[2025-10-24T19:15:38.168748] [INFO ] [MAIN      ] HTD: Loaded 14322 existing records.
[2025-10-24T19:15:38.355262] [WARN ] [MAIN      ] HTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:15:38.355692] [INFO ] [MAIN      ] HTD: Wiping existing primary data before full refresh.
[2025-10-24T19:15:38.355764] [INFO ] [LOCAL     ] HTD: Starting deletion of primary data.
[2025-10-24T19:15:38.356083] [DEBUG] [LOCAL     ] HTD: Deleted primary data file.
[2025-10-24T19:15:38.356149] [INFO ] [MAIN      ] HTD: Starting full primary refresh.
[2025-10-24T19:15:38.558340] [INFO ] [REMOTE    ] HTB: Fetching primary data for 2025-01.
[2025-10-24T19:15:38.645685] [INFO ] [REMOTE    ] HSY: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T19:15:38.796885] [INFO ] [REMOTE    ] HTD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:15:38.879695] [DEBUG] [REMOTE    ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:15:38.879927] [WARN ] [REMOTE    ] HTB: No data returned for month 2025-01
[2025-10-24T19:15:38.880031] [FATAL] [REMOTE    ] HTB: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:15:38.880086] [FATAL] [MAIN      ] HTB: Failed to fetch primary data.
[2025-10-24T19:15:38.880164] [WARN ] [MAIN      ] HTB: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:15:38.880242] [INFO ] [LOCAL     ] HTB: Starting deletion of primary data.
[2025-10-24T19:15:38.880303] [DEBUG] [LOCAL     ] HTB: No primary data file found to delete.
[2025-10-24T19:15:38.880339] [INFO ] [LOCAL     ] HTB: Starting deletion of derivative data.
[2025-10-24T19:15:38.880379] [DEBUG] [LOCAL     ] HTB: No derivative data file found to delete.
[2025-10-24T19:15:38.880422] [INFO ] [MAIN      ] Update Progress: 1058/2366 symbols completed. HTB took 3.8s. Estimated remaining: 2h 47m 38s. Rate: 7.8 symbols/min
[2025-10-24T19:15:39.047344] [INFO ] [MAIN      ] HTFC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:15:39.047551] [DEBUG] [LOCAL     ] HTFC: No existing data file found in primary storage.
[2025-10-24T19:15:39.047605] [WARN ] [MAIN      ] HTFC: No existing data found, performing full refresh instead.
[2025-10-24T19:15:39.047738] [INFO ] [MAIN      ] HTFC: Wiping existing primary data before full refresh.
[2025-10-24T19:15:39.047780] [INFO ] [LOCAL     ] HTFC: Starting deletion of primary data.
[2025-10-24T19:15:39.047821] [DEBUG] [LOCAL     ] HTFC: No primary data file found to delete.
[2025-10-24T19:15:39.047859] [INFO ] [MAIN      ] HTFC: Starting full primary refresh.
[2025-10-24T19:15:39.353710] [INFO ] [REMOTE    ] HSY: Fetching primary data for 2025-02.
[2025-10-24T19:15:39.414475] [INFO ] [REMOTE    ] HTFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:15:39.492074] [INFO ] [REMOTE    ] HSBC: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T19:15:40.147714] [INFO ] [REMOTE    ] HSBC: Fetching primary data for 2025-09.
[2025-10-24T19:15:40.947776] [INFO ] [REMOTE    ] HTFC: Fetching primary data for 2025-01.
[2025-10-24T19:15:41.266694] [INFO ] [REMOTE    ] HTFC: Incremental fetch complete for 2025-01 (0.32 seconds).
[2025-10-24T19:15:41.269766] [INFO ] [REMOTE    ] HSY: Incremental fetch complete for 2025-02 (1.92 seconds).
[2025-10-24T19:15:41.359616] [INFO ] [REMOTE    ] HSBC: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T19:15:41.747731] [INFO ] [REMOTE    ] HSY: Fetching primary data for 2025-03.
[2025-10-24T19:15:42.547677] [INFO ] [REMOTE    ] HSBC: Fetching primary data for 2025-10.
[2025-10-24T19:15:43.347682] [INFO ] [REMOTE    ] HTFC: Fetching primary data for 2025-02.
[2025-10-24T19:15:43.678670] [INFO ] [REMOTE    ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds).
[2025-10-24T19:15:43.737873] [INFO ] [REMOTE    ] HSY: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T19:15:44.147755] [INFO ] [REMOTE    ] HTD: Fetching primary data for 2025-01.
[2025-10-24T19:15:44.335360] [INFO ] [REMOTE    ] HSBC: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T19:15:44.344686] [INFO ] [REMOTE    ] HSBC: Full fetch complete (74245 records).
[2025-10-24T19:15:44.344831] [DEBUG] [VALIDATOR ] HSBC: Validating primary data.
[2025-10-24T19:15:44.737579] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present.
[2025-10-24T19:15:44.737683] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed.
[2025-10-24T19:15:44.738855] [INFO ] [MAIN      ] HSBC: Fetched primary data is valid.
[2025-10-24T19:15:44.738946] [DEBUG] [LOCAL     ] HSBC: Saving primary data.
[2025-10-24T19:15:44.739559] [FATAL] [LOCAL     ] HSBC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:15:44.739672] [FATAL] [MAIN      ] HSBC: Failed to save primary data.
[2025-10-24T19:15:44.739743] [WARN ] [MAIN      ] HSBC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:15:44.739813] [INFO ] [LOCAL     ] HSBC: Starting deletion of primary data.
[2025-10-24T19:15:44.739875] [DEBUG] [LOCAL     ] HSBC: No primary data file found to delete.
[2025-10-24T19:15:44.739912] [INFO ] [LOCAL     ] HSBC: Starting deletion of derivative data.
[2025-10-24T19:15:44.740140] [DEBUG] [LOCAL     ] HSBC: Deleted derivative data file.
[2025-10-24T19:15:44.740844] [INFO ] [MAIN      ] Update Progress: 1059/2366 symbols completed. HSBC took 32.6s. Estimated remaining: 2h 47m 29s. Rate: 7.8 symbols/min
[2025-10-24T19:15:44.884581] [INFO ] [REMOTE    ] HTD: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T19:15:44.931326] [INFO ] [MAIN      ] HTGC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:15:44.956996] [INFO ] [REMOTE    ] HTFC: Fetching primary data for 2025-03.
[2025-10-24T19:15:44.979755] [DEBUG] [LOCAL     ] HTGC: Loaded 48027 existing records from primary storage.
[2025-10-24T19:15:44.980076] [INFO ] [MAIN      ] HTGC: Loaded 48027 existing records.
[2025-10-24T19:15:45.159407] [WARN ] [MAIN      ] HTGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:15:45.159636] [INFO ] [MAIN      ] HTGC: Wiping existing primary data before full refresh.
[2025-10-24T19:15:45.159716] [INFO ] [LOCAL     ] HTGC: Starting deletion of primary data.
[2025-10-24T19:15:45.160019] [DEBUG] [LOCAL     ] HTGC: Deleted primary data file.
[2025-10-24T19:15:45.160075] [INFO ] [MAIN      ] HTGC: Starting full primary refresh.
[2025-10-24T19:15:45.335177] [INFO ] [REMOTE    ] HTFC: Incremental fetch complete for 2025-03 (0.38 seconds).
[2025-10-24T19:15:45.515112] [INFO ] [REMOTE    ] HTGC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:15:45.747667] [INFO ] [REMOTE    ] HTGC: Fetching primary data for 2025-01.
[2025-10-24T19:15:46.547634] [INFO ] [REMOTE    ] HTFC: Fetching primary data for 2025-04.
[2025-10-24T19:15:46.943810] [INFO ] [REMOTE    ] HTFC: Incremental fetch complete for 2025-04 (0.40 seconds).
[2025-10-24T19:15:47.184952] [INFO ] [REMOTE    ] HTGC: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T19:15:47.347622] [INFO ] [REMOTE    ] HTGC: Fetching primary data for 2025-02.
[2025-10-24T19:15:48.147680] [INFO ] [REMOTE    ] HSY: Fetching primary data for 2025-04.
[2025-10-24T19:15:48.848999] [INFO ] [REMOTE    ] HTGC: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T19:15:48.947616] [INFO ] [REMOTE    ] HTGC: Fetching primary data for 2025-03.
[2025-10-24T19:15:49.747674] [INFO ] [REMOTE    ] HTD: Fetching primary data for 2025-02.
[2025-10-24T19:15:49.966318] [INFO ] [REMOTE    ] HSY: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T19:15:50.163350] [INFO ] [REMOTE    ] HTGC: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T19:15:50.547623] [INFO ] [REMOTE    ] HTGC: Fetching primary data for 2025-04.
[2025-10-24T19:15:50.569536] [INFO ] [REMOTE    ] HTD: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T19:15:51.347637] [INFO ] [REMOTE    ] HTD: Fetching primary data for 2025-03.
[2025-10-24T19:15:52.147620] [INFO ] [REMOTE    ] HSY: Fetching primary data for 2025-05.
[2025-10-24T19:15:52.188223] [INFO ] [REMOTE    ] HTD: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T19:15:52.259922] [INFO ] [REMOTE    ] HTGC: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T19:15:52.947689] [INFO ] [REMOTE    ] HTD: Fetching primary data for 2025-04.
[2025-10-24T19:15:53.747625] [INFO ] [REMOTE    ] HTGC: Fetching primary data for 2025-05.
[2025-10-24T19:15:53.761790] [INFO ] [REMOTE    ] HTD: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T19:15:54.124462] [INFO ] [REMOTE    ] HSY: Incremental fetch complete for 2025-05 (1.98 seconds).
[2025-10-24T19:15:54.547679] [INFO ] [REMOTE    ] HTFC: Fetching primary data for 2025-05.
[2025-10-24T19:15:55.034628] [INFO ] [REMOTE    ] HTFC: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T19:15:55.305120] [INFO ] [REMOTE    ] HTGC: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T19:15:55.347632] [INFO ] [REMOTE    ] HTGC: Fetching primary data for 2025-06.
[2025-10-24T19:15:56.147694] [INFO ] [REMOTE    ] HSY: Fetching primary data for 2025-06.
[2025-10-24T19:15:56.808892] [INFO ] [REMOTE    ] HTGC: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T19:15:56.947694] [INFO ] [REMOTE    ] HTD: Fetching primary data for 2025-05.
[2025-10-24T19:15:57.738189] [INFO ] [REMOTE    ] HTD: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T19:15:57.747596] [INFO ] [REMOTE    ] HTD: Fetching primary data for 2025-06.
[2025-10-24T19:15:57.858199] [INFO ] [REMOTE    ] HSY: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T19:15:58.555185] [INFO ] [REMOTE    ] HSY: Fetching primary data for 2025-07.
[2025-10-24T19:15:58.556979] [INFO ] [REMOTE    ] HTD: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T19:15:59.347676] [INFO ] [REMOTE    ] HTGC: Fetching primary data for 2025-07.
[2025-10-24T19:16:00.147629] [INFO ] [REMOTE    ] HTD: Fetching primary data for 2025-07.
[2025-10-24T19:16:00.422881] [INFO ] [REMOTE    ] HSY: Incremental fetch complete for 2025-07 (1.87 seconds).
[2025-10-24T19:16:00.947625] [INFO ] [REMOTE    ] HTFC: Fetching primary data for 2025-06.
[2025-10-24T19:16:01.176731] [INFO ] [REMOTE    ] HTD: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T19:16:01.196728] [INFO ] [REMOTE    ] HTFC: Incremental fetch complete for 2025-06 (0.25 seconds).
[2025-10-24T19:16:01.245985] [INFO ] [REMOTE    ] HTGC: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T19:16:01.747638] [INFO ] [REMOTE    ] HTD: Fetching primary data for 2025-08.
[2025-10-24T19:16:02.547632] [INFO ] [REMOTE    ] HTFC: Fetching primary data for 2025-07.
[2025-10-24T19:16:02.593445] [INFO ] [REMOTE    ] HTD: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T19:16:02.782340] [INFO ] [REMOTE    ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds).
[2025-10-24T19:16:03.347680] [INFO ] [REMOTE    ] HTFC: Fetching primary data for 2025-08.
[2025-10-24T19:16:03.658509] [INFO ] [REMOTE    ] HTFC: Incremental fetch complete for 2025-08 (0.31 seconds).
[2025-10-24T19:16:04.147635] [INFO ] [REMOTE    ] HTFC: Fetching primary data for 2025-09.
[2025-10-24T19:16:04.477822] [INFO ] [REMOTE    ] HTFC: Incremental fetch complete for 2025-09 (0.33 seconds).
[2025-10-24T19:16:04.947635] [INFO ] [REMOTE    ] HTFC: Fetching primary data for 2025-10.
[2025-10-24T19:16:05.380519] [INFO ] [REMOTE    ] HTFC: Incremental fetch complete for 2025-10 (0.43 seconds).
[2025-10-24T19:16:05.381236] [INFO ] [REMOTE    ] HTFC: Full fetch complete (815 records).
[2025-10-24T19:16:05.381317] [DEBUG] [VALIDATOR ] HTFC: Validating primary data.
[2025-10-24T19:16:05.569137] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days
[2025-10-24T19:16:05.569321] [FATAL] [MAIN      ] HTFC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:16:05.569401] [WARN ] [MAIN      ] HTFC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:16:05.569468] [INFO ] [LOCAL     ] HTFC: Starting deletion of primary data.
[2025-10-24T19:16:05.569557] [DEBUG] [LOCAL     ] HTFC: No primary data file found to delete.
[2025-10-24T19:16:05.569612] [INFO ] [LOCAL     ] HTFC: Starting deletion of derivative data.
[2025-10-24T19:16:05.569684] [DEBUG] [LOCAL     ] HTFC: No derivative data file found to delete.
[2025-10-24T19:16:05.569762] [INFO ] [MAIN      ] Update Progress: 1060/2366 symbols completed. HTFC took 26.7s. Estimated remaining: 2h 47m 37s. Rate: 7.8 symbols/min
[2025-10-24T19:16:05.741950] [INFO ] [MAIN      ] HTH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:16:05.747721] [INFO ] [REMOTE    ] HSY: Fetching primary data for 2025-08.
[2025-10-24T19:16:05.774787] [DEBUG] [LOCAL     ] HTH: Loaded 32621 existing records from primary storage.
[2025-10-24T19:16:05.775071] [INFO ] [MAIN      ] HTH: Loaded 32621 existing records.
[2025-10-24T19:16:05.952562] [WARN ] [MAIN      ] HTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:16:05.952824] [INFO ] [MAIN      ] HTH: Wiping existing primary data before full refresh.
[2025-10-24T19:16:05.952872] [INFO ] [LOCAL     ] HTH: Starting deletion of primary data.
[2025-10-24T19:16:05.953292] [DEBUG] [LOCAL     ] HTH: Deleted primary data file.
[2025-10-24T19:16:05.953349] [INFO ] [MAIN      ] HTH: Starting full primary refresh.
[2025-10-24T19:16:06.321810] [INFO ] [REMOTE    ] HTH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:16:06.547639] [INFO ] [REMOTE    ] HTH: Fetching primary data for 2025-01.
[2025-10-24T19:16:07.347710] [INFO ] [REMOTE    ] HTD: Fetching primary data for 2025-09.
[2025-10-24T19:16:07.506701] [INFO ] [REMOTE    ] HSY: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T19:16:07.712158] [INFO ] [REMOTE    ] HTH: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T19:16:08.147683] [INFO ] [REMOTE    ] HTGC: Fetching primary data for 2025-08.
[2025-10-24T19:16:08.260118] [INFO ] [REMOTE    ] HTD: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T19:16:08.947674] [INFO ] [REMOTE    ] HSY: Fetching primary data for 2025-09.
[2025-10-24T19:16:09.747710] [INFO ] [REMOTE    ] HTH: Fetching primary data for 2025-02.
[2025-10-24T19:16:09.775261] [INFO ] [REMOTE    ] HTGC: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T19:16:10.349309] [INFO ] [REMOTE    ] HSY: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T19:16:10.547713] [INFO ] [REMOTE    ] HSY: Fetching primary data for 2025-10.
[2025-10-24T19:16:11.149580] [INFO ] [REMOTE    ] HTH: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T19:16:11.347697] [INFO ] [REMOTE    ] HTGC: Fetching primary data for 2025-09.
[2025-10-24T19:16:12.147729] [INFO ] [REMOTE    ] HTD: Fetching primary data for 2025-10.
[2025-10-24T19:16:12.457764] [INFO ] [REMOTE    ] HSY: Incremental fetch complete for 2025-10 (1.91 seconds).
[2025-10-24T19:16:12.466761] [INFO ] [REMOTE    ] HSY: Full fetch complete (73593 records).
[2025-10-24T19:16:12.466883] [DEBUG] [VALIDATOR ] HSY: Validating primary data.
[2025-10-24T19:16:12.874330] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present.
[2025-10-24T19:16:12.874555] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed.
[2025-10-24T19:16:12.875618] [INFO ] [MAIN      ] HSY: Fetched primary data is valid.
[2025-10-24T19:16:12.875783] [DEBUG] [LOCAL     ] HSY: Saving primary data.
[2025-10-24T19:16:12.876483] [FATAL] [LOCAL     ] HSY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:16:12.890950] [FATAL] [MAIN      ] HSY: Failed to save primary data.
[2025-10-24T19:16:12.903048] [WARN ] [MAIN      ] HSY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:16:12.903264] [INFO ] [LOCAL     ] HSY: Starting deletion of primary data.
[2025-10-24T19:16:12.904126] [DEBUG] [LOCAL     ] HSY: No primary data file found to delete.
[2025-10-24T19:16:12.905572] [INFO ] [LOCAL     ] HSY: Starting deletion of derivative data.
[2025-10-24T19:16:12.905465] [INFO ] [REMOTE    ] HTGC: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T19:16:12.915721] [DEBUG] [LOCAL     ] HSY: Deleted derivative data file.
[2025-10-24T19:16:12.916352] [INFO ] [MAIN      ] Update Progress: 1061/2366 symbols completed. HSY took 45.8s. Estimated remaining: 2h 47m 29s. Rate: 7.8 symbols/min
[2025-10-24T19:16:12.949711] [INFO ] [REMOTE    ] HTGC: Fetching primary data for 2025-10.
[2025-10-24T19:16:13.051187] [INFO ] [REMOTE    ] HTD: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T19:16:13.108477] [INFO ] [MAIN      ] HUBB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:16:13.106084] [INFO ] [REMOTE    ] HTD: Full fetch complete (19583 records).
[2025-10-24T19:16:13.108695] [DEBUG] [VALIDATOR ] HTD: Validating primary data.
[2025-10-24T19:16:13.422732] [DEBUG] [LOCAL     ] HUBB: Loaded 36236 existing records from primary storage.
[2025-10-24T19:16:13.438915] [INFO ] [MAIN      ] HUBB: Loaded 36236 existing records.
[2025-10-24T19:16:13.637448] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present.
[2025-10-24T19:16:13.637879] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed.
[2025-10-24T19:16:13.649054] [INFO ] [MAIN      ] HTD: Fetched primary data is valid.
[2025-10-24T19:16:13.654258] [DEBUG] [LOCAL     ] HTD: Saving primary data.
[2025-10-24T19:16:13.659787] [FATAL] [LOCAL     ] HTD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:16:13.679311] [FATAL] [MAIN      ] HTD: Failed to save primary data.
[2025-10-24T19:16:13.684559] [WARN ] [MAIN      ] HTD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:16:13.691164] [INFO ] [LOCAL     ] HTD: Starting deletion of primary data.
[2025-10-24T19:16:13.696434] [DEBUG] [LOCAL     ] HTD: No primary data file found to delete.
[2025-10-24T19:16:13.696514] [INFO ] [LOCAL     ] HTD: Starting deletion of derivative data.
[2025-10-24T19:16:13.716355] [DEBUG] [LOCAL     ] HTD: Deleted derivative data file.
[2025-10-24T19:16:13.716521] [INFO ] [MAIN      ] Update Progress: 1062/2366 symbols completed. HTD took 35.7s. Estimated remaining: 2h 47m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:16:13.738234] [WARN ] [MAIN      ] HUBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:16:13.752891] [INFO ] [REMOTE    ] HTH: Fetching primary data for 2025-03.
[2025-10-24T19:16:13.753190] [INFO ] [MAIN      ] HUBB: Wiping existing primary data before full refresh.
[2025-10-24T19:16:13.796926] [INFO ] [LOCAL     ] HUBB: Starting deletion of primary data.
[2025-10-24T19:16:13.824637] [DEBUG] [LOCAL     ] HUBB: Deleted primary data file.
[2025-10-24T19:16:13.844411] [INFO ] [MAIN      ] HUBB: Starting full primary refresh.
[2025-10-24T19:16:14.035431] [INFO ] [MAIN      ] HUBS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:16:14.302363] [INFO ] [REMOTE    ] HUBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:16:14.314946] [DEBUG] [LOCAL     ] HUBS: Loaded 40156 existing records from primary storage.
[2025-10-24T19:16:14.315244] [INFO ] [MAIN      ] HUBS: Loaded 40156 existing records.
[2025-10-24T19:16:14.491766] [WARN ] [MAIN      ] HUBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:16:14.491916] [INFO ] [MAIN      ] HUBS: Wiping existing primary data before full refresh.
[2025-10-24T19:16:14.491963] [INFO ] [LOCAL     ] HUBS: Starting deletion of primary data.
[2025-10-24T19:16:14.492589] [DEBUG] [LOCAL     ] HUBS: Deleted primary data file.
[2025-10-24T19:16:14.492669] [INFO ] [MAIN      ] HUBS: Starting full primary refresh.
[2025-10-24T19:16:14.554722] [INFO ] [REMOTE    ] HUBB: Fetching primary data for 2025-01.
[2025-10-24T19:16:14.855104] [INFO ] [REMOTE    ] HUBS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:16:14.872824] [INFO ] [REMOTE    ] HTH: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T19:16:14.903701] [INFO ] [REMOTE    ] HTGC: Incremental fetch complete for 2025-10 (1.95 seconds).
[2025-10-24T19:16:14.912988] [INFO ] [REMOTE    ] HTGC: Full fetch complete (68880 records).
[2025-10-24T19:16:14.913106] [DEBUG] [VALIDATOR ] HTGC: Validating primary data.
[2025-10-24T19:16:15.299280] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present.
[2025-10-24T19:16:15.299356] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed.
[2025-10-24T19:16:15.300389] [INFO ] [MAIN      ] HTGC: Fetched primary data is valid.
[2025-10-24T19:16:15.300452] [DEBUG] [LOCAL     ] HTGC: Saving primary data.
[2025-10-24T19:16:15.301004] [FATAL] [LOCAL     ] HTGC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:16:15.301092] [FATAL] [MAIN      ] HTGC: Failed to save primary data.
[2025-10-24T19:16:15.301135] [WARN ] [MAIN      ] HTGC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:16:15.301169] [INFO ] [LOCAL     ] HTGC: Starting deletion of primary data.
[2025-10-24T19:16:15.301238] [DEBUG] [LOCAL     ] HTGC: No primary data file found to delete.
[2025-10-24T19:16:15.301277] [INFO ] [LOCAL     ] HTGC: Starting deletion of derivative data.
[2025-10-24T19:16:15.301405] [DEBUG] [LOCAL     ] HTGC: Deleted derivative data file.
[2025-10-24T19:16:15.301719] [INFO ] [MAIN      ] Update Progress: 1063/2366 symbols completed. HTGC took 30.6s. Estimated remaining: 2h 46m 58s. Rate: 7.8 symbols/min
[2025-10-24T19:16:15.357058] [INFO ] [REMOTE    ] HUBS: Fetching primary data for 2025-01.
[2025-10-24T19:16:15.473673] [INFO ] [MAIN      ] HUM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:16:15.519558] [DEBUG] [LOCAL     ] HUM: Loaded 49574 existing records from primary storage.
[2025-10-24T19:16:15.519890] [INFO ] [MAIN      ] HUM: Loaded 49574 existing records.
[2025-10-24T19:16:15.703205] [WARN ] [MAIN      ] HUM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:16:15.703383] [INFO ] [MAIN      ] HUM: Wiping existing primary data before full refresh.
[2025-10-24T19:16:15.703438] [INFO ] [LOCAL     ] HUM: Starting deletion of primary data.
[2025-10-24T19:16:15.703773] [DEBUG] [LOCAL     ] HUM: Deleted primary data file.
[2025-10-24T19:16:15.703835] [INFO ] [MAIN      ] HUM: Starting full primary refresh.
[2025-10-24T19:16:16.070289] [INFO ] [REMOTE    ] HUM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:16:16.093184] [INFO ] [REMOTE    ] HUBB: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T19:16:16.147604] [INFO ] [REMOTE    ] HUM: Fetching primary data for 2025-01.
[2025-10-24T19:16:16.838143] [INFO ] [REMOTE    ] HUBS: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T19:16:16.947690] [INFO ] [REMOTE    ] HTH: Fetching primary data for 2025-04.
[2025-10-24T19:16:17.747729] [INFO ] [REMOTE    ] HUBS: Fetching primary data for 2025-02.
[2025-10-24T19:16:17.920816] [INFO ] [REMOTE    ] HUM: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T19:16:18.362114] [INFO ] [REMOTE    ] HTH: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T19:16:18.547600] [INFO ] [REMOTE    ] HUBB: Fetching primary data for 2025-02.
[2025-10-24T19:16:19.202857] [INFO ] [REMOTE    ] HUBS: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T19:16:19.347758] [INFO ] [REMOTE    ] HUM: Fetching primary data for 2025-02.
[2025-10-24T19:16:20.147746] [INFO ] [REMOTE    ] HTH: Fetching primary data for 2025-05.
[2025-10-24T19:16:20.222782] [INFO ] [REMOTE    ] HUBB: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T19:16:20.947716] [INFO ] [REMOTE    ] HUBS: Fetching primary data for 2025-03.
[2025-10-24T19:16:21.220021] [INFO ] [REMOTE    ] HUM: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T19:16:21.495341] [INFO ] [REMOTE    ] HTH: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T19:16:21.747744] [INFO ] [REMOTE    ] HUBB: Fetching primary data for 2025-03.
[2025-10-24T19:16:22.547616] [INFO ] [REMOTE    ] HUM: Fetching primary data for 2025-03.
[2025-10-24T19:16:22.617805] [INFO ] [REMOTE    ] HUBS: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T19:16:23.347622] [INFO ] [REMOTE    ] HUBS: Fetching primary data for 2025-04.
[2025-10-24T19:16:23.379752] [INFO ] [REMOTE    ] HUBB: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T19:16:24.147702] [INFO ] [REMOTE    ] HUBB: Fetching primary data for 2025-04.
[2025-10-24T19:16:24.197821] [INFO ] [REMOTE    ] HUM: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T19:16:24.948521] [INFO ] [REMOTE    ] HTH: Fetching primary data for 2025-06.
[2025-10-24T19:16:24.955249] [INFO ] [REMOTE    ] HUBS: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T19:16:25.389225] [INFO ] [REMOTE    ] HUBB: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T19:16:25.747704] [INFO ] [REMOTE    ] HUM: Fetching primary data for 2025-04.
[2025-10-24T19:16:26.217209] [INFO ] [REMOTE    ] HTH: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T19:16:26.547609] [INFO ] [REMOTE    ] HTH: Fetching primary data for 2025-07.
[2025-10-24T19:16:27.347612] [INFO ] [REMOTE    ] HUBB: Fetching primary data for 2025-05.
[2025-10-24T19:16:27.551674] [INFO ] [REMOTE    ] HUM: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T19:16:27.802888] [INFO ] [REMOTE    ] HTH: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T19:16:28.147632] [INFO ] [REMOTE    ] HUBS: Fetching primary data for 2025-05.
[2025-10-24T19:16:28.840238] [INFO ] [REMOTE    ] HUBB: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T19:16:28.947618] [INFO ] [REMOTE    ] HTH: Fetching primary data for 2025-08.
[2025-10-24T19:16:29.684620] [INFO ] [REMOTE    ] HUBS: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T19:16:29.747678] [INFO ] [REMOTE    ] HUBS: Fetching primary data for 2025-06.
[2025-10-24T19:16:30.540124] [INFO ] [REMOTE    ] HTH: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T19:16:30.549005] [INFO ] [REMOTE    ] HUBB: Fetching primary data for 2025-06.
[2025-10-24T19:16:31.178962] [INFO ] [REMOTE    ] HUBS: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T19:16:31.347735] [INFO ] [REMOTE    ] HTH: Fetching primary data for 2025-09.
[2025-10-24T19:16:31.892772] [INFO ] [REMOTE    ] HUBB: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T19:16:32.147680] [INFO ] [REMOTE    ] HUM: Fetching primary data for 2025-05.
[2025-10-24T19:16:32.594802] [INFO ] [REMOTE    ] HTH: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T19:16:32.947707] [INFO ] [REMOTE    ] HTH: Fetching primary data for 2025-10.
[2025-10-24T19:16:33.747700] [INFO ] [REMOTE    ] HUBB: Fetching primary data for 2025-07.
[2025-10-24T19:16:34.075933] [INFO ] [REMOTE    ] HUM: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T19:16:34.126120] [INFO ] [REMOTE    ] HTH: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T19:16:34.131521] [INFO ] [REMOTE    ] HTH: Full fetch complete (46852 records).
[2025-10-24T19:16:34.131619] [DEBUG] [VALIDATOR ] HTH: Validating primary data.
[2025-10-24T19:16:34.533332] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present.
[2025-10-24T19:16:34.533433] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed.
[2025-10-24T19:16:34.534292] [INFO ] [MAIN      ] HTH: Fetched primary data is valid.
[2025-10-24T19:16:34.534356] [DEBUG] [LOCAL     ] HTH: Saving primary data.
[2025-10-24T19:16:34.534772] [FATAL] [LOCAL     ] HTH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:16:34.534860] [FATAL] [MAIN      ] HTH: Failed to save primary data.
[2025-10-24T19:16:34.534902] [WARN ] [MAIN      ] HTH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:16:34.534939] [INFO ] [LOCAL     ] HTH: Starting deletion of primary data.
[2025-10-24T19:16:34.534991] [DEBUG] [LOCAL     ] HTH: No primary data file found to delete.
[2025-10-24T19:16:34.535027] [INFO ] [LOCAL     ] HTH: Starting deletion of derivative data.
[2025-10-24T19:16:34.535266] [DEBUG] [LOCAL     ] HTH: Deleted derivative data file.
[2025-10-24T19:16:34.535341] [INFO ] [MAIN      ] Update Progress: 1064/2366 symbols completed. HTH took 29.0s. Estimated remaining: 2h 47m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:16:34.556923] [INFO ] [REMOTE    ] HUBS: Fetching primary data for 2025-07.
[2025-10-24T19:16:34.715683] [INFO ] [MAIN      ] HUN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:16:34.768046] [DEBUG] [LOCAL     ] HUN: Loaded 53600 existing records from primary storage.
[2025-10-24T19:16:34.768355] [INFO ] [MAIN      ] HUN: Loaded 53600 existing records.
[2025-10-24T19:16:34.947249] [WARN ] [MAIN      ] HUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:16:34.947449] [INFO ] [MAIN      ] HUN: Wiping existing primary data before full refresh.
[2025-10-24T19:16:34.947494] [INFO ] [LOCAL     ] HUN: Starting deletion of primary data.
[2025-10-24T19:16:34.947776] [DEBUG] [LOCAL     ] HUN: Deleted primary data file.
[2025-10-24T19:16:34.947833] [INFO ] [MAIN      ] HUN: Starting full primary refresh.
[2025-10-24T19:16:35.323799] [INFO ] [REMOTE    ] HUN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:16:35.347662] [INFO ] [REMOTE    ] HUN: Fetching primary data for 2025-01.
[2025-10-24T19:16:35.349919] [INFO ] [REMOTE    ] HUBB: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T19:16:36.115630] [INFO ] [REMOTE    ] HUBS: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T19:16:36.147601] [INFO ] [REMOTE    ] HUBS: Fetching primary data for 2025-08.
[2025-10-24T19:16:36.952782] [INFO ] [REMOTE    ] HUM: Fetching primary data for 2025-06.
[2025-10-24T19:16:36.966960] [INFO ] [REMOTE    ] HUN: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T19:16:37.747734] [INFO ] [REMOTE    ] HUBB: Fetching primary data for 2025-08.
[2025-10-24T19:16:37.950734] [INFO ] [REMOTE    ] HUBS: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T19:16:38.547752] [INFO ] [REMOTE    ] HUBS: Fetching primary data for 2025-09.
[2025-10-24T19:16:38.629279] [INFO ] [REMOTE    ] HUM: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T19:16:39.172337] [INFO ] [REMOTE    ] HUBB: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T19:16:39.347684] [INFO ] [REMOTE    ] HUM: Fetching primary data for 2025-07.
[2025-10-24T19:16:40.147729] [INFO ] [REMOTE    ] HUN: Fetching primary data for 2025-02.
[2025-10-24T19:16:40.186708] [INFO ] [REMOTE    ] HUBS: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T19:16:40.947753] [INFO ] [REMOTE    ] HUBS: Fetching primary data for 2025-10.
[2025-10-24T19:16:41.279148] [INFO ] [REMOTE    ] HUM: Incremental fetch complete for 2025-07 (1.93 seconds).
[2025-10-24T19:16:41.747738] [INFO ] [REMOTE    ] HUBB: Fetching primary data for 2025-09.
[2025-10-24T19:16:41.881959] [INFO ] [REMOTE    ] HUN: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T19:16:42.462329] [INFO ] [REMOTE    ] HUBS: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T19:16:42.470724] [INFO ] [REMOTE    ] HUBS: Full fetch complete (57063 records).
[2025-10-24T19:16:42.470842] [DEBUG] [VALIDATOR ] HUBS: Validating primary data.
[2025-10-24T19:16:42.552815] [INFO ] [REMOTE    ] HUN: Fetching primary data for 2025-03.
[2025-10-24T19:16:42.863259] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present.
[2025-10-24T19:16:42.863334] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed.
[2025-10-24T19:16:42.864284] [INFO ] [MAIN      ] HUBS: Fetched primary data is valid.
[2025-10-24T19:16:42.864346] [DEBUG] [LOCAL     ] HUBS: Saving primary data.
[2025-10-24T19:16:42.864844] [FATAL] [LOCAL     ] HUBS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:16:42.864949] [FATAL] [MAIN      ] HUBS: Failed to save primary data.
[2025-10-24T19:16:42.864996] [WARN ] [MAIN      ] HUBS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:16:42.865057] [INFO ] [LOCAL     ] HUBS: Starting deletion of primary data.
[2025-10-24T19:16:42.865116] [DEBUG] [LOCAL     ] HUBS: No primary data file found to delete.
[2025-10-24T19:16:42.865151] [INFO ] [LOCAL     ] HUBS: Starting deletion of derivative data.
[2025-10-24T19:16:42.865279] [DEBUG] [LOCAL     ] HUBS: Deleted derivative data file.
[2025-10-24T19:16:42.865360] [INFO ] [MAIN      ] Update Progress: 1065/2366 symbols completed. HUBS took 29.1s. Estimated remaining: 2h 46m 57s. Rate: 7.8 symbols/min
[2025-10-24T19:16:43.045156] [INFO ] [MAIN      ] HUYA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:16:43.085187] [DEBUG] [LOCAL     ] HUYA: Loaded 43945 existing records from primary storage.
[2025-10-24T19:16:43.085475] [INFO ] [MAIN      ] HUYA: Loaded 43945 existing records.
[2025-10-24T19:16:43.235462] [INFO ] [REMOTE    ] HUBB: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T19:16:43.296223] [WARN ] [MAIN      ] HUYA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:16:43.296435] [INFO ] [MAIN      ] HUYA: Wiping existing primary data before full refresh.
[2025-10-24T19:16:43.296482] [INFO ] [LOCAL     ] HUYA: Starting deletion of primary data.
[2025-10-24T19:16:43.296688] [DEBUG] [LOCAL     ] HUYA: Deleted primary data file.
[2025-10-24T19:16:43.296745] [INFO ] [MAIN      ] HUYA: Starting full primary refresh.
[2025-10-24T19:16:43.352776] [INFO ] [REMOTE    ] HUM: Fetching primary data for 2025-08.
[2025-10-24T19:16:43.661426] [INFO ] [REMOTE    ] HUYA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:16:44.147638] [INFO ] [REMOTE    ] HUBB: Fetching primary data for 2025-10.
[2025-10-24T19:16:44.184673] [INFO ] [REMOTE    ] HUN: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T19:16:44.947674] [INFO ] [REMOTE    ] HUN: Fetching primary data for 2025-04.
[2025-10-24T19:16:45.145754] [INFO ] [REMOTE    ] HUM: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T19:16:45.610173] [INFO ] [REMOTE    ] HUBB: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T19:16:45.616156] [INFO ] [REMOTE    ] HUBB: Full fetch complete (54177 records).
[2025-10-24T19:16:45.616253] [DEBUG] [VALIDATOR ] HUBB: Validating primary data.
[2025-10-24T19:16:45.753491] [INFO ] [REMOTE    ] HUYA: Fetching primary data for 2025-01.
[2025-10-24T19:16:45.998207] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present.
[2025-10-24T19:16:45.998303] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed.
[2025-10-24T19:16:45.999126] [INFO ] [MAIN      ] HUBB: Fetched primary data is valid.
[2025-10-24T19:16:45.999187] [DEBUG] [LOCAL     ] HUBB: Saving primary data.
[2025-10-24T19:16:45.999605] [FATAL] [LOCAL     ] HUBB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:16:45.999709] [FATAL] [MAIN      ] HUBB: Failed to save primary data.
[2025-10-24T19:16:45.999772] [WARN ] [MAIN      ] HUBB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:16:45.999836] [INFO ] [LOCAL     ] HUBB: Starting deletion of primary data.
[2025-10-24T19:16:45.999894] [DEBUG] [LOCAL     ] HUBB: No primary data file found to delete.
[2025-10-24T19:16:45.999928] [INFO ] [LOCAL     ] HUBB: Starting deletion of derivative data.
[2025-10-24T19:16:46.000083] [DEBUG] [LOCAL     ] HUBB: Deleted derivative data file.
[2025-10-24T19:16:46.000424] [INFO ] [MAIN      ] Update Progress: 1066/2366 symbols completed. HUBB took 33.1s. Estimated remaining: 2h 46m 44s. Rate: 7.8 symbols/min
[2025-10-24T19:16:46.165892] [INFO ] [MAIN      ] HVT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:16:46.181733] [DEBUG] [LOCAL     ] HVT: Loaded 14832 existing records from primary storage.
[2025-10-24T19:16:46.181957] [INFO ] [MAIN      ] HVT: Loaded 14832 existing records.
[2025-10-24T19:16:46.357009] [WARN ] [MAIN      ] HVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:16:46.357217] [INFO ] [MAIN      ] HVT: Wiping existing primary data before full refresh.
[2025-10-24T19:16:46.357273] [INFO ] [LOCAL     ] HVT: Starting deletion of primary data.
[2025-10-24T19:16:46.357509] [DEBUG] [LOCAL     ] HVT: Deleted primary data file.
[2025-10-24T19:16:46.357546] [INFO ] [MAIN      ] HVT: Starting full primary refresh.
[2025-10-24T19:16:46.552716] [INFO ] [REMOTE    ] HUM: Fetching primary data for 2025-09.
[2025-10-24T19:16:46.721473] [INFO ] [REMOTE    ] HVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:16:46.755287] [INFO ] [REMOTE    ] HUN: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T19:16:47.347637] [INFO ] [REMOTE    ] HVT: Fetching primary data for 2025-01.
[2025-10-24T19:16:47.408273] [INFO ] [REMOTE    ] HUYA: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T19:16:48.147636] [INFO ] [REMOTE    ] HUYA: Fetching primary data for 2025-02.
[2025-10-24T19:16:48.290763] [INFO ] [REMOTE    ] HVT: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T19:16:48.493858] [INFO ] [REMOTE    ] HUM: Incremental fetch complete for 2025-09 (1.94 seconds).
[2025-10-24T19:16:48.947683] [INFO ] [REMOTE    ] HUM: Fetching primary data for 2025-10.
[2025-10-24T19:16:49.461715] [INFO ] [REMOTE    ] HUYA: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T19:16:49.747727] [INFO ] [REMOTE    ] HVT: Fetching primary data for 2025-02.
[2025-10-24T19:16:50.547639] [INFO ] [REMOTE    ] HUN: Fetching primary data for 2025-05.
[2025-10-24T19:16:50.835362] [INFO ] [REMOTE    ] HVT: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T19:16:50.836980] [INFO ] [REMOTE    ] HUM: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T19:16:50.850163] [INFO ] [REMOTE    ] HUM: Full fetch complete (71087 records).
[2025-10-24T19:16:50.850286] [DEBUG] [VALIDATOR ] HUM: Validating primary data.
[2025-10-24T19:16:51.273332] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present.
[2025-10-24T19:16:51.273412] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed.
[2025-10-24T19:16:51.274370] [INFO ] [MAIN      ] HUM: Fetched primary data is valid.
[2025-10-24T19:16:51.274433] [DEBUG] [LOCAL     ] HUM: Saving primary data.
[2025-10-24T19:16:51.275020] [FATAL] [LOCAL     ] HUM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:16:51.275109] [FATAL] [MAIN      ] HUM: Failed to save primary data.
[2025-10-24T19:16:51.275151] [WARN ] [MAIN      ] HUM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:16:51.275185] [INFO ] [LOCAL     ] HUM: Starting deletion of primary data.
[2025-10-24T19:16:51.275237] [DEBUG] [LOCAL     ] HUM: No primary data file found to delete.
[2025-10-24T19:16:51.275292] [INFO ] [LOCAL     ] HUM: Starting deletion of derivative data.
[2025-10-24T19:16:51.275420] [DEBUG] [LOCAL     ] HUM: Deleted derivative data file.
[2025-10-24T19:16:51.275819] [INFO ] [MAIN      ] Update Progress: 1067/2366 symbols completed. HUM took 36.0s. Estimated remaining: 2h 46m 33s. Rate: 7.8 symbols/min
[2025-10-24T19:16:51.352733] [INFO ] [REMOTE    ] HVT: Fetching primary data for 2025-03.
[2025-10-24T19:16:51.457603] [INFO ] [MAIN      ] HWM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:16:51.513166] [DEBUG] [LOCAL     ] HWM: Loaded 53083 existing records from primary storage.
[2025-10-24T19:16:51.513501] [INFO ] [MAIN      ] HWM: Loaded 53083 existing records.
[2025-10-24T19:16:51.694706] [WARN ] [MAIN      ] HWM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:16:51.694916] [INFO ] [MAIN      ] HWM: Wiping existing primary data before full refresh.
[2025-10-24T19:16:51.694974] [INFO ] [LOCAL     ] HWM: Starting deletion of primary data.
[2025-10-24T19:16:51.695475] [DEBUG] [LOCAL     ] HWM: Deleted primary data file.
[2025-10-24T19:16:51.695531] [INFO ] [MAIN      ] HWM: Starting full primary refresh.
[2025-10-24T19:16:52.080008] [INFO ] [REMOTE    ] HWM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:16:52.147637] [INFO ] [REMOTE    ] HWM: Fetching primary data for 2025-01.
[2025-10-24T19:16:52.212022] [INFO ] [REMOTE    ] HUN: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T19:16:52.516732] [INFO ] [REMOTE    ] HVT: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T19:16:52.947688] [INFO ] [REMOTE    ] HUYA: Fetching primary data for 2025-03.
[2025-10-24T19:16:53.747617] [INFO ] [REMOTE    ] HVT: Fetching primary data for 2025-04.
[2025-10-24T19:16:53.913920] [INFO ] [REMOTE    ] HWM: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T19:16:54.547607] [INFO ] [REMOTE    ] HUN: Fetching primary data for 2025-06.
[2025-10-24T19:16:54.662122] [INFO ] [REMOTE    ] HUYA: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T19:16:54.779551] [INFO ] [REMOTE    ] HVT: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T19:16:55.347682] [INFO ] [REMOTE    ] HVT: Fetching primary data for 2025-05.
[2025-10-24T19:16:56.052427] [INFO ] [REMOTE    ] HUN: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T19:16:56.147676] [INFO ] [REMOTE    ] HWM: Fetching primary data for 2025-02.
[2025-10-24T19:16:56.333854] [INFO ] [REMOTE    ] HVT: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T19:16:56.947680] [INFO ] [REMOTE    ] HUN: Fetching primary data for 2025-07.
[2025-10-24T19:16:57.747618] [INFO ] [REMOTE    ] HUYA: Fetching primary data for 2025-04.
[2025-10-24T19:16:57.828679] [INFO ] [REMOTE    ] HWM: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T19:16:58.464819] [INFO ] [REMOTE    ] HUN: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T19:16:58.547632] [INFO ] [REMOTE    ] HVT: Fetching primary data for 2025-06.
[2025-10-24T19:16:59.330614] [INFO ] [REMOTE    ] HUYA: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T19:16:59.347592] [INFO ] [REMOTE    ] HUYA: Fetching primary data for 2025-05.
[2025-10-24T19:16:59.498855] [INFO ] [REMOTE    ] HVT: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T19:17:00.147676] [INFO ] [REMOTE    ] HUN: Fetching primary data for 2025-08.
[2025-10-24T19:17:00.579245] [INFO ] [REMOTE    ] HUYA: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T19:17:00.947667] [INFO ] [REMOTE    ] HWM: Fetching primary data for 2025-03.
[2025-10-24T19:17:01.747635] [INFO ] [REMOTE    ] HVT: Fetching primary data for 2025-07.
[2025-10-24T19:17:01.843789] [INFO ] [REMOTE    ] HUN: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T19:17:02.547700] [INFO ] [REMOTE    ] HUN: Fetching primary data for 2025-09.
[2025-10-24T19:17:02.719011] [INFO ] [REMOTE    ] HWM: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T19:17:02.749544] [INFO ] [REMOTE    ] HVT: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T19:17:03.347693] [INFO ] [REMOTE    ] HWM: Fetching primary data for 2025-04.
[2025-10-24T19:17:04.043716] [INFO ] [REMOTE    ] HUN: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T19:17:04.147629] [INFO ] [REMOTE    ] HUN: Fetching primary data for 2025-10.
[2025-10-24T19:17:04.947702] [INFO ] [REMOTE    ] HVT: Fetching primary data for 2025-08.
[2025-10-24T19:17:05.013269] [INFO ] [REMOTE    ] HWM: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T19:17:05.747702] [INFO ] [REMOTE    ] HWM: Fetching primary data for 2025-05.
[2025-10-24T19:17:05.861605] [INFO ] [REMOTE    ] HVT: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T19:17:06.100694] [INFO ] [REMOTE    ] HUN: Incremental fetch complete for 2025-10 (1.95 seconds).
[2025-10-24T19:17:06.110764] [INFO ] [REMOTE    ] HUN: Full fetch complete (77034 records).
[2025-10-24T19:17:06.110929] [DEBUG] [VALIDATOR ] HUN: Validating primary data.
[2025-10-24T19:17:06.524030] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present.
[2025-10-24T19:17:06.524164] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed.
[2025-10-24T19:17:06.525217] [INFO ] [MAIN      ] HUN: Fetched primary data is valid.
[2025-10-24T19:17:06.525290] [DEBUG] [LOCAL     ] HUN: Saving primary data.
[2025-10-24T19:17:06.525976] [FATAL] [LOCAL     ] HUN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:17:06.526081] [FATAL] [MAIN      ] HUN: Failed to save primary data.
[2025-10-24T19:17:06.526125] [WARN ] [MAIN      ] HUN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:17:06.526204] [INFO ] [LOCAL     ] HUN: Starting deletion of primary data.
[2025-10-24T19:17:06.526289] [DEBUG] [LOCAL     ] HUN: No primary data file found to delete.
[2025-10-24T19:17:06.526334] [INFO ] [LOCAL     ] HUN: Starting deletion of derivative data.
[2025-10-24T19:17:06.526509] [DEBUG] [LOCAL     ] HUN: Deleted derivative data file.
[2025-10-24T19:17:06.526985] [INFO ] [MAIN      ] Update Progress: 1068/2366 symbols completed. HUN took 32.0s. Estimated remaining: 2h 46m 35s. Rate: 7.8 symbols/min
[2025-10-24T19:17:06.547632] [INFO ] [REMOTE    ] HVT: Fetching primary data for 2025-09.
[2025-10-24T19:17:06.700578] [INFO ] [MAIN      ] HXL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:17:06.741764] [DEBUG] [LOCAL     ] HXL: Loaded 46178 existing records from primary storage.
[2025-10-24T19:17:06.742041] [INFO ] [MAIN      ] HXL: Loaded 46178 existing records.
[2025-10-24T19:17:06.922532] [WARN ] [MAIN      ] HXL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:17:06.922799] [INFO ] [MAIN      ] HXL: Wiping existing primary data before full refresh.
[2025-10-24T19:17:06.922851] [INFO ] [LOCAL     ] HXL: Starting deletion of primary data.
[2025-10-24T19:17:06.923697] [DEBUG] [LOCAL     ] HXL: Deleted primary data file.
[2025-10-24T19:17:06.923753] [INFO ] [MAIN      ] HXL: Starting full primary refresh.
[2025-10-24T19:17:07.298518] [INFO ] [REMOTE    ] HXL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:17:07.347598] [INFO ] [REMOTE    ] HXL: Fetching primary data for 2025-01.
[2025-10-24T19:17:07.421180] [INFO ] [REMOTE    ] HVT: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T19:17:07.561687] [INFO ] [REMOTE    ] HWM: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T19:17:08.147681] [INFO ] [REMOTE    ] HVT: Fetching primary data for 2025-10.
[2025-10-24T19:17:08.633680] [INFO ] [REMOTE    ] HXL: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T19:17:08.947637] [INFO ] [REMOTE    ] HXL: Fetching primary data for 2025-02.
[2025-10-24T19:17:09.149965] [INFO ] [REMOTE    ] HVT: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T19:17:09.152978] [INFO ] [REMOTE    ] HVT: Full fetch complete (22988 records).
[2025-10-24T19:17:09.153089] [DEBUG] [VALIDATOR ] HVT: Validating primary data.
[2025-10-24T19:17:09.536708] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present.
[2025-10-24T19:17:09.536806] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed.
[2025-10-24T19:17:09.537339] [INFO ] [MAIN      ] HVT: Fetched primary data is valid.
[2025-10-24T19:17:09.537401] [DEBUG] [LOCAL     ] HVT: Saving primary data.
[2025-10-24T19:17:09.537787] [FATAL] [LOCAL     ] HVT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:17:09.537873] [FATAL] [MAIN      ] HVT: Failed to save primary data.
[2025-10-24T19:17:09.537925] [WARN ] [MAIN      ] HVT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:17:09.537989] [INFO ] [LOCAL     ] HVT: Starting deletion of primary data.
[2025-10-24T19:17:09.538084] [DEBUG] [LOCAL     ] HVT: No primary data file found to delete.
[2025-10-24T19:17:09.538157] [INFO ] [LOCAL     ] HVT: Starting deletion of derivative data.
[2025-10-24T19:17:09.538367] [DEBUG] [LOCAL     ] HVT: Deleted derivative data file.
[2025-10-24T19:17:09.538485] [INFO ] [MAIN      ] Update Progress: 1069/2366 symbols completed. HVT took 23.5s. Estimated remaining: 2h 46m 21s. Rate: 7.8 symbols/min
[2025-10-24T19:17:09.714944] [INFO ] [MAIN      ] HY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:17:09.726061] [DEBUG] [LOCAL     ] HY: Loaded 9894 existing records from primary storage.
[2025-10-24T19:17:09.726276] [INFO ] [MAIN      ] HY: Loaded 9894 existing records.
[2025-10-24T19:17:09.758970] [INFO ] [REMOTE    ] HWM: Fetching primary data for 2025-06.
[2025-10-24T19:17:09.918023] [WARN ] [MAIN      ] HY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:17:09.918250] [INFO ] [MAIN      ] HY: Wiping existing primary data before full refresh.
[2025-10-24T19:17:09.918313] [INFO ] [LOCAL     ] HY: Starting deletion of primary data.
[2025-10-24T19:17:09.918586] [DEBUG] [LOCAL     ] HY: Deleted primary data file.
[2025-10-24T19:17:09.918672] [INFO ] [MAIN      ] HY: Starting full primary refresh.
[2025-10-24T19:17:10.299661] [INFO ] [REMOTE    ] HY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:17:10.480188] [INFO ] [REMOTE    ] HXL: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T19:17:10.547607] [INFO ] [REMOTE    ] HUYA: Fetching primary data for 2025-06.
[2025-10-24T19:17:11.291021] [INFO ] [REMOTE    ] HWM: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T19:17:11.347634] [INFO ] [REMOTE    ] HWM: Fetching primary data for 2025-07.
[2025-10-24T19:17:12.070305] [INFO ] [REMOTE    ] HUYA: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T19:17:12.147681] [INFO ] [REMOTE    ] HUYA: Fetching primary data for 2025-07.
[2025-10-24T19:17:12.947614] [INFO ] [REMOTE    ] HXL: Fetching primary data for 2025-03.
[2025-10-24T19:17:13.108716] [INFO ] [REMOTE    ] HWM: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T19:17:13.747685] [INFO ] [REMOTE    ] HWM: Fetching primary data for 2025-08.
[2025-10-24T19:17:13.871728] [INFO ] [REMOTE    ] HUYA: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T19:17:14.313183] [INFO ] [REMOTE    ] HXL: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T19:17:14.547716] [INFO ] [REMOTE    ] HXL: Fetching primary data for 2025-04.
[2025-10-24T19:17:15.347716] [INFO ] [REMOTE    ] HUYA: Fetching primary data for 2025-08.
[2025-10-24T19:17:15.655058] [INFO ] [REMOTE    ] HWM: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T19:17:16.147630] [INFO ] [REMOTE    ] HWM: Fetching primary data for 2025-09.
[2025-10-24T19:17:16.265311] [INFO ] [REMOTE    ] HXL: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T19:17:16.917055] [INFO ] [REMOTE    ] HUYA: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T19:17:16.947601] [INFO ] [REMOTE    ] HUYA: Fetching primary data for 2025-09.
[2025-10-24T19:17:17.747703] [INFO ] [REMOTE    ] HXL: Fetching primary data for 2025-05.
[2025-10-24T19:17:18.051710] [INFO ] [REMOTE    ] HWM: Incremental fetch complete for 2025-09 (1.90 seconds).
[2025-10-24T19:17:18.128609] [INFO ] [REMOTE    ] HUYA: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T19:17:18.547708] [INFO ] [REMOTE    ] HWM: Fetching primary data for 2025-10.
[2025-10-24T19:17:19.347695] [INFO ] [REMOTE    ] HY: Fetching primary data for 2025-01.
[2025-10-24T19:17:19.381284] [INFO ] [REMOTE    ] HXL: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T19:17:20.101535] [INFO ] [REMOTE    ] HY: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T19:17:20.147598] [INFO ] [REMOTE    ] HY: Fetching primary data for 2025-02.
[2025-10-24T19:17:20.350804] [INFO ] [REMOTE    ] HWM: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T19:17:20.359992] [INFO ] [REMOTE    ] HWM: Full fetch complete (76617 records).
[2025-10-24T19:17:20.360123] [DEBUG] [VALIDATOR ] HWM: Validating primary data.
[2025-10-24T19:17:20.749040] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present.
[2025-10-24T19:17:20.749114] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed.
[2025-10-24T19:17:20.750113] [INFO ] [MAIN      ] HWM: Fetched primary data is valid.
[2025-10-24T19:17:20.750175] [DEBUG] [LOCAL     ] HWM: Saving primary data.
[2025-10-24T19:17:20.750758] [FATAL] [LOCAL     ] HWM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:17:20.750849] [FATAL] [MAIN      ] HWM: Failed to save primary data.
[2025-10-24T19:17:20.750890] [WARN ] [MAIN      ] HWM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:17:20.750948] [INFO ] [LOCAL     ] HWM: Starting deletion of primary data.
[2025-10-24T19:17:20.751007] [DEBUG] [LOCAL     ] HWM: No primary data file found to delete.
[2025-10-24T19:17:20.751041] [INFO ] [LOCAL     ] HWM: Starting deletion of derivative data.
[2025-10-24T19:17:20.751228] [DEBUG] [LOCAL     ] HWM: Deleted derivative data file.
[2025-10-24T19:17:20.751683] [INFO ] [MAIN      ] Update Progress: 1070/2366 symbols completed. HWM took 29.5s. Estimated remaining: 2h 46m 18s. Rate: 7.8 symbols/min
[2025-10-24T19:17:20.920539] [INFO ] [MAIN      ] HYAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:17:20.920724] [DEBUG] [LOCAL     ] HYAC: No existing data file found in primary storage.
[2025-10-24T19:17:20.920856] [WARN ] [MAIN      ] HYAC: No existing data found, performing full refresh instead.
[2025-10-24T19:17:20.920938] [INFO ] [MAIN      ] HYAC: Wiping existing primary data before full refresh.
[2025-10-24T19:17:20.920974] [INFO ] [LOCAL     ] HYAC: Starting deletion of primary data.
[2025-10-24T19:17:20.921015] [DEBUG] [LOCAL     ] HYAC: No primary data file found to delete.
[2025-10-24T19:17:20.921047] [INFO ] [MAIN      ] HYAC: Starting full primary refresh.
[2025-10-24T19:17:20.952788] [INFO ] [REMOTE    ] HXL: Fetching primary data for 2025-06.
[2025-10-24T19:17:21.044055] [INFO ] [REMOTE    ] HY: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T19:17:21.289117] [INFO ] [REMOTE    ] HYAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:17:21.747734] [INFO ] [REMOTE    ] HYAC: Fetching primary data for 2025-01.
[2025-10-24T19:17:22.070976] [INFO ] [REMOTE    ] HYAC: Incremental fetch complete for 2025-01 (0.32 seconds).
[2025-10-24T19:17:22.460498] [INFO ] [REMOTE    ] HXL: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T19:17:22.547620] [INFO ] [REMOTE    ] HXL: Fetching primary data for 2025-07.
[2025-10-24T19:17:23.347630] [INFO ] [REMOTE    ] HY: Fetching primary data for 2025-03.
[2025-10-24T19:17:24.147623] [INFO ] [REMOTE    ] HUYA: Fetching primary data for 2025-10.
[2025-10-24T19:17:24.215357] [INFO ] [REMOTE    ] HXL: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T19:17:24.233353] [INFO ] [REMOTE    ] HY: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T19:17:24.947718] [INFO ] [REMOTE    ] HYAC: Fetching primary data for 2025-02.
[2025-10-24T19:17:25.295597] [INFO ] [REMOTE    ] HYAC: Incremental fetch complete for 2025-02 (0.35 seconds).
[2025-10-24T19:17:25.747735] [INFO ] [REMOTE    ] HXL: Fetching primary data for 2025-08.
[2025-10-24T19:17:25.802024] [INFO ] [REMOTE    ] HUYA: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T19:17:25.810329] [INFO ] [REMOTE    ] HUYA: Full fetch complete (64003 records).
[2025-10-24T19:17:25.810466] [DEBUG] [VALIDATOR ] HUYA: Validating primary data.
[2025-10-24T19:17:26.197890] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present.
[2025-10-24T19:17:26.197964] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed.
[2025-10-24T19:17:26.198941] [INFO ] [MAIN      ] HUYA: Fetched primary data is valid.
[2025-10-24T19:17:26.199004] [DEBUG] [LOCAL     ] HUYA: Saving primary data.
[2025-10-24T19:17:26.199511] [FATAL] [LOCAL     ] HUYA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:17:26.199615] [FATAL] [MAIN      ] HUYA: Failed to save primary data.
[2025-10-24T19:17:26.199706] [WARN ] [MAIN      ] HUYA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:17:26.199779] [INFO ] [LOCAL     ] HUYA: Starting deletion of primary data.
[2025-10-24T19:17:26.199841] [DEBUG] [LOCAL     ] HUYA: No primary data file found to delete.
[2025-10-24T19:17:26.199876] [INFO ] [LOCAL     ] HUYA: Starting deletion of derivative data.
[2025-10-24T19:17:26.200123] [DEBUG] [LOCAL     ] HUYA: Deleted derivative data file.
[2025-10-24T19:17:26.200214] [INFO ] [MAIN      ] Update Progress: 1071/2366 symbols completed. HUYA took 43.3s. Estimated remaining: 2h 46m 7s. Rate: 7.8 symbols/min
[2025-10-24T19:17:26.369441] [INFO ] [MAIN      ] HYBX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:17:26.369617] [DEBUG] [LOCAL     ] HYBX: No existing data file found in primary storage.
[2025-10-24T19:17:26.369684] [WARN ] [MAIN      ] HYBX: No existing data found, performing full refresh instead.
[2025-10-24T19:17:26.369797] [INFO ] [MAIN      ] HYBX: Wiping existing primary data before full refresh.
[2025-10-24T19:17:26.369838] [INFO ] [LOCAL     ] HYBX: Starting deletion of primary data.
[2025-10-24T19:17:26.369879] [DEBUG] [LOCAL     ] HYBX: No primary data file found to delete.
[2025-10-24T19:17:26.369910] [INFO ] [MAIN      ] HYBX: Starting full primary refresh.
[2025-10-24T19:17:26.555695] [INFO ] [REMOTE    ] HY: Fetching primary data for 2025-04.
[2025-10-24T19:17:26.734229] [INFO ] [REMOTE    ] HYBX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:17:27.281791] [INFO ] [REMOTE    ] HXL: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T19:17:27.347608] [INFO ] [REMOTE    ] HXL: Fetching primary data for 2025-09.
[2025-10-24T19:17:27.536425] [INFO ] [REMOTE    ] HY: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T19:17:28.147638] [INFO ] [REMOTE    ] HYAC: Fetching primary data for 2025-03.
[2025-10-24T19:17:28.455036] [INFO ] [REMOTE    ] HYAC: Incremental fetch complete for 2025-03 (0.31 seconds).
[2025-10-24T19:17:28.930099] [INFO ] [REMOTE    ] HXL: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T19:17:28.947598] [INFO ] [REMOTE    ] HXL: Fetching primary data for 2025-10.
[2025-10-24T19:17:29.747729] [INFO ] [REMOTE    ] HYBX: Fetching primary data for 2025-01.
[2025-10-24T19:17:30.108822] [INFO ] [REMOTE    ] HYBX: Incremental fetch complete for 2025-01 (0.36 seconds).
[2025-10-24T19:17:30.547618] [INFO ] [REMOTE    ] HYAC: Fetching primary data for 2025-04.
[2025-10-24T19:17:30.746993] [INFO ] [REMOTE    ] HXL: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T19:17:30.755498] [INFO ] [REMOTE    ] HXL: Full fetch complete (66740 records).
[2025-10-24T19:17:30.755631] [DEBUG] [VALIDATOR ] HXL: Validating primary data.
[2025-10-24T19:17:30.866761] [INFO ] [REMOTE    ] HYAC: Incremental fetch complete for 2025-04 (0.32 seconds).
[2025-10-24T19:17:31.153570] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present.
[2025-10-24T19:17:31.153670] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed.
[2025-10-24T19:17:31.154589] [INFO ] [MAIN      ] HXL: Fetched primary data is valid.
[2025-10-24T19:17:31.154632] [DEBUG] [LOCAL     ] HXL: Saving primary data.
[2025-10-24T19:17:31.155204] [FATAL] [LOCAL     ] HXL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:17:31.155294] [FATAL] [MAIN      ] HXL: Failed to save primary data.
[2025-10-24T19:17:31.155335] [WARN ] [MAIN      ] HXL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:17:31.155369] [INFO ] [LOCAL     ] HXL: Starting deletion of primary data.
[2025-10-24T19:17:31.155420] [DEBUG] [LOCAL     ] HXL: No primary data file found to delete.
[2025-10-24T19:17:31.155453] [INFO ] [LOCAL     ] HXL: Starting deletion of derivative data.
[2025-10-24T19:17:31.155624] [DEBUG] [LOCAL     ] HXL: Deleted derivative data file.
[2025-10-24T19:17:31.156052] [INFO ] [MAIN      ] Update Progress: 1072/2366 symbols completed. HXL took 24.6s. Estimated remaining: 2h 45m 56s. Rate: 7.8 symbols/min
[2025-10-24T19:17:31.340518] [INFO ] [MAIN      ] HYI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:17:31.352084] [DEBUG] [LOCAL     ] HYI: Loaded 9666 existing records from primary storage.
[2025-10-24T19:17:31.351637] [INFO ] [REMOTE    ] HYBX: Fetching primary data for 2025-02.
[2025-10-24T19:17:31.352342] [INFO ] [MAIN      ] HYI: Loaded 9666 existing records.
[2025-10-24T19:17:31.532036] [WARN ] [MAIN      ] HYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:17:31.532263] [INFO ] [MAIN      ] HYI: Wiping existing primary data before full refresh.
[2025-10-24T19:17:31.532309] [INFO ] [LOCAL     ] HYI: Starting deletion of primary data.
[2025-10-24T19:17:31.532605] [DEBUG] [LOCAL     ] HYI: Deleted primary data file.
[2025-10-24T19:17:31.532696] [INFO ] [MAIN      ] HYI: Starting full primary refresh.
[2025-10-24T19:17:31.691364] [INFO ] [REMOTE    ] HYBX: Incremental fetch complete for 2025-02 (0.34 seconds).
[2025-10-24T19:17:31.885015] [INFO ] [REMOTE    ] HYI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:17:32.147702] [INFO ] [REMOTE    ] HY: Fetching primary data for 2025-05.
[2025-10-24T19:17:32.951405] [INFO ] [REMOTE    ] HYBX: Fetching primary data for 2025-03.
[2025-10-24T19:17:32.955261] [INFO ] [REMOTE    ] HY: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T19:17:33.233130] [INFO ] [REMOTE    ] HYBX: Incremental fetch complete for 2025-03 (0.28 seconds).
[2025-10-24T19:17:33.747705] [INFO ] [REMOTE    ] HYAC: Fetching primary data for 2025-05.
[2025-10-24T19:17:34.303427] [INFO ] [REMOTE    ] HYAC: Incremental fetch complete for 2025-05 (0.56 seconds).
[2025-10-24T19:17:34.547714] [INFO ] [REMOTE    ] HY: Fetching primary data for 2025-06.
[2025-10-24T19:17:35.347606] [INFO ] [REMOTE    ] HYBX: Fetching primary data for 2025-04.
[2025-10-24T19:17:35.504283] [INFO ] [REMOTE    ] HY: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T19:17:35.621779] [INFO ] [REMOTE    ] HYBX: Incremental fetch complete for 2025-04 (0.27 seconds).
[2025-10-24T19:17:36.147690] [INFO ] [REMOTE    ] HYAC: Fetching primary data for 2025-06.
[2025-10-24T19:17:36.478402] [INFO ] [REMOTE    ] HYAC: Incremental fetch complete for 2025-06 (0.33 seconds).
[2025-10-24T19:17:36.947675] [INFO ] [REMOTE    ] HYAC: Fetching primary data for 2025-07.
[2025-10-24T19:17:37.371830] [INFO ] [REMOTE    ] HYAC: Incremental fetch complete for 2025-07 (0.42 seconds).
[2025-10-24T19:17:37.747704] [INFO ] [REMOTE    ] HY: Fetching primary data for 2025-07.
[2025-10-24T19:17:38.471488] [INFO ] [REMOTE    ] HY: Incremental fetch complete for 2025-07 (0.72 seconds).
[2025-10-24T19:17:38.547739] [INFO ] [REMOTE    ] HYI: Fetching primary data for 2025-01.
[2025-10-24T19:17:39.314124] [INFO ] [REMOTE    ] HYI: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T19:17:39.347612] [INFO ] [REMOTE    ] HYBX: Fetching primary data for 2025-05.
[2025-10-24T19:17:39.670898] [INFO ] [REMOTE    ] HYBX: Incremental fetch complete for 2025-05 (0.32 seconds).
[2025-10-24T19:17:40.147686] [INFO ] [REMOTE    ] HYI: Fetching primary data for 2025-02.
[2025-10-24T19:17:40.913757] [INFO ] [REMOTE    ] HYI: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T19:17:40.947763] [INFO ] [REMOTE    ] HYBX: Fetching primary data for 2025-06.
[2025-10-24T19:17:41.266565] [INFO ] [REMOTE    ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds).
[2025-10-24T19:17:41.747638] [INFO ] [REMOTE    ] HYBX: Fetching primary data for 2025-07.
[2025-10-24T19:17:42.078218] [INFO ] [REMOTE    ] HYBX: Incremental fetch complete for 2025-07 (0.33 seconds).
[2025-10-24T19:17:42.547710] [INFO ] [REMOTE    ] HY: Fetching primary data for 2025-08.
[2025-10-24T19:17:43.347630] [INFO ] [REMOTE    ] HYI: Fetching primary data for 2025-03.
[2025-10-24T19:17:43.502804] [INFO ] [REMOTE    ] HY: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T19:17:44.090757] [INFO ] [REMOTE    ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T19:17:44.147600] [INFO ] [REMOTE    ] HYI: Fetching primary data for 2025-04.
[2025-10-24T19:17:44.947707] [INFO ] [REMOTE    ] HY: Fetching primary data for 2025-09.
[2025-10-24T19:17:45.008701] [INFO ] [REMOTE    ] HYI: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T19:17:45.532546] [INFO ] [REMOTE    ] HY: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T19:17:45.747637] [INFO ] [REMOTE    ] HYI: Fetching primary data for 2025-05.
[2025-10-24T19:17:46.472841] [INFO ] [REMOTE    ] HYI: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T19:17:46.547606] [INFO ] [REMOTE    ] HY: Fetching primary data for 2025-10.
[2025-10-24T19:17:47.347727] [INFO ] [REMOTE    ] HYAC: Fetching primary data for 2025-08.
[2025-10-24T19:17:47.471757] [INFO ] [REMOTE    ] HY: Incremental fetch complete for 2025-10 (0.92 seconds).
[2025-10-24T19:17:47.473921] [INFO ] [REMOTE    ] HY: Full fetch complete (14825 records).
[2025-10-24T19:17:47.473991] [DEBUG] [VALIDATOR ] HY: Validating primary data.
[2025-10-24T19:17:47.615019] [INFO ] [REMOTE    ] HYAC: Incremental fetch complete for 2025-08 (0.27 seconds).
[2025-10-24T19:17:47.840259] [DEBUG] [VALIDATOR ] HY: All expected trading days are present.
[2025-10-24T19:17:47.840342] [DEBUG] [VALIDATOR ] HY: Primary data validation passed.
[2025-10-24T19:17:47.840699] [INFO ] [MAIN      ] HY: Fetched primary data is valid.
[2025-10-24T19:17:47.840761] [DEBUG] [LOCAL     ] HY: Saving primary data.
[2025-10-24T19:17:47.840990] [FATAL] [LOCAL     ] HY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:17:47.841072] [FATAL] [MAIN      ] HY: Failed to save primary data.
[2025-10-24T19:17:47.841114] [WARN ] [MAIN      ] HY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:17:47.841149] [INFO ] [LOCAL     ] HY: Starting deletion of primary data.
[2025-10-24T19:17:47.841197] [DEBUG] [LOCAL     ] HY: No primary data file found to delete.
[2025-10-24T19:17:47.841232] [INFO ] [LOCAL     ] HY: Starting deletion of derivative data.
[2025-10-24T19:17:47.841397] [DEBUG] [LOCAL     ] HY: Deleted derivative data file.
[2025-10-24T19:17:47.841499] [INFO ] [MAIN      ] Update Progress: 1073/2366 symbols completed. HY took 38.3s. Estimated remaining: 2h 45m 60s. Rate: 7.8 symbols/min
[2025-10-24T19:17:48.009151] [INFO ] [MAIN      ] HYT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:17:48.042714] [DEBUG] [LOCAL     ] HYT: Loaded 33782 existing records from primary storage.
[2025-10-24T19:17:48.042977] [INFO ] [MAIN      ] HYT: Loaded 33782 existing records.
[2025-10-24T19:17:48.152735] [INFO ] [REMOTE    ] HYI: Fetching primary data for 2025-06.
[2025-10-24T19:17:48.218100] [WARN ] [MAIN      ] HYT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:17:48.218295] [INFO ] [MAIN      ] HYT: Wiping existing primary data before full refresh.
[2025-10-24T19:17:48.218341] [INFO ] [LOCAL     ] HYT: Starting deletion of primary data.
[2025-10-24T19:17:48.218606] [DEBUG] [LOCAL     ] HYT: Deleted primary data file.
[2025-10-24T19:17:48.218684] [INFO ] [MAIN      ] HYT: Starting full primary refresh.
[2025-10-24T19:17:48.569018] [INFO ] [REMOTE    ] HYT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:17:48.923393] [INFO ] [REMOTE    ] HYI: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T19:17:48.947697] [INFO ] [REMOTE    ] HYBX: Fetching primary data for 2025-08.
[2025-10-24T19:17:49.281621] [INFO ] [REMOTE    ] HYBX: Incremental fetch complete for 2025-08 (0.33 seconds).
[2025-10-24T19:17:49.747681] [INFO ] [REMOTE    ] HYI: Fetching primary data for 2025-07.
[2025-10-24T19:17:50.547729] [INFO ] [REMOTE    ] HYAC: Fetching primary data for 2025-09.
[2025-10-24T19:17:50.570893] [INFO ] [REMOTE    ] HYI: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T19:17:50.778309] [INFO ] [REMOTE    ] HYAC: Incremental fetch complete for 2025-09 (0.23 seconds).
[2025-10-24T19:17:51.347691] [INFO ] [REMOTE    ] HYBX: Fetching primary data for 2025-09.
[2025-10-24T19:17:51.605979] [INFO ] [REMOTE    ] HYBX: Incremental fetch complete for 2025-09 (0.26 seconds).
[2025-10-24T19:17:52.147668] [INFO ] [REMOTE    ] HYT: Fetching primary data for 2025-01.
[2025-10-24T19:17:52.947682] [INFO ] [REMOTE    ] HYAC: Fetching primary data for 2025-10.
[2025-10-24T19:17:53.435824] [INFO ] [REMOTE    ] HYAC: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T19:17:53.436681] [INFO ] [REMOTE    ] HYAC: Full fetch complete (918 records).
[2025-10-24T19:17:53.436752] [DEBUG] [VALIDATOR ] HYAC: Validating primary data.
[2025-10-24T19:17:53.553955] [INFO ] [REMOTE    ] HYT: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T19:17:53.659755] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days
[2025-10-24T19:17:53.659964] [FATAL] [MAIN      ] HYAC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:17:53.660010] [WARN ] [MAIN      ] HYAC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:17:53.660076] [INFO ] [LOCAL     ] HYAC: Starting deletion of primary data.
[2025-10-24T19:17:53.660138] [DEBUG] [LOCAL     ] HYAC: No primary data file found to delete.
[2025-10-24T19:17:53.660173] [INFO ] [LOCAL     ] HYAC: Starting deletion of derivative data.
[2025-10-24T19:17:53.660215] [DEBUG] [LOCAL     ] HYAC: No derivative data file found to delete.
[2025-10-24T19:17:53.660272] [INFO ] [MAIN      ] Update Progress: 1074/2366 symbols completed. HYAC took 32.9s. Estimated remaining: 2h 45m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:17:53.755861] [INFO ] [REMOTE    ] HYT: Fetching primary data for 2025-02.
[2025-10-24T19:17:53.830902] [INFO ] [MAIN      ] HYTR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:17:53.836868] [DEBUG] [LOCAL     ] HYTR: Loaded 3121 existing records from primary storage.
[2025-10-24T19:17:53.837059] [INFO ] [MAIN      ] HYTR: Loaded 3121 existing records.
[2025-10-24T19:17:54.009476] [WARN ] [MAIN      ] HYTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:17:54.009720] [INFO ] [MAIN      ] HYTR: Wiping existing primary data before full refresh.
[2025-10-24T19:17:54.009777] [INFO ] [LOCAL     ] HYTR: Starting deletion of primary data.
[2025-10-24T19:17:54.009910] [DEBUG] [LOCAL     ] HYTR: Deleted primary data file.
[2025-10-24T19:17:54.009946] [INFO ] [MAIN      ] HYTR: Starting full primary refresh.
[2025-10-24T19:17:54.367585] [INFO ] [REMOTE    ] HYTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:17:54.547606] [INFO ] [REMOTE    ] HYTR: Fetching primary data for 2025-01.
[2025-10-24T19:17:55.024199] [INFO ] [REMOTE    ] HYTR: Incremental fetch complete for 2025-01 (0.48 seconds).
[2025-10-24T19:17:55.080419] [INFO ] [REMOTE    ] HYT: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T19:17:55.347668] [INFO ] [REMOTE    ] HYBX: Fetching primary data for 2025-10.
[2025-10-24T19:17:55.769807] [INFO ] [REMOTE    ] HYBX: Incremental fetch complete for 2025-10 (0.42 seconds).
[2025-10-24T19:17:55.770474] [INFO ] [REMOTE    ] HYBX: Full fetch complete (698 records).
[2025-10-24T19:17:55.770539] [DEBUG] [VALIDATOR ] HYBX: Validating primary data.
[2025-10-24T19:17:55.968959] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days
[2025-10-24T19:17:55.969166] [FATAL] [MAIN      ] HYBX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:17:55.969235] [WARN ] [MAIN      ] HYBX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:17:55.969303] [INFO ] [LOCAL     ] HYBX: Starting deletion of primary data.
[2025-10-24T19:17:55.969363] [DEBUG] [LOCAL     ] HYBX: No primary data file found to delete.
[2025-10-24T19:17:55.969398] [INFO ] [LOCAL     ] HYBX: Starting deletion of derivative data.
[2025-10-24T19:17:55.969437] [DEBUG] [LOCAL     ] HYBX: No derivative data file found to delete.
[2025-10-24T19:17:55.969488] [INFO ] [MAIN      ] Update Progress: 1075/2366 symbols completed. HYBX took 29.8s. Estimated remaining: 2h 45m 35s. Rate: 7.8 symbols/min
[2025-10-24T19:17:56.135331] [INFO ] [MAIN      ] HZO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:17:56.151089] [INFO ] [REMOTE    ] HYT: Fetching primary data for 2025-03.
[2025-10-24T19:17:56.164797] [DEBUG] [LOCAL     ] HZO: Loaded 28679 existing records from primary storage.
[2025-10-24T19:17:56.165028] [INFO ] [MAIN      ] HZO: Loaded 28679 existing records.
[2025-10-24T19:17:56.341247] [WARN ] [MAIN      ] HZO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:17:56.341483] [INFO ] [MAIN      ] HZO: Wiping existing primary data before full refresh.
[2025-10-24T19:17:56.341531] [INFO ] [LOCAL     ] HZO: Starting deletion of primary data.
[2025-10-24T19:17:56.341736] [DEBUG] [LOCAL     ] HZO: Deleted primary data file.
[2025-10-24T19:17:56.341792] [INFO ] [MAIN      ] HZO: Starting full primary refresh.
[2025-10-24T19:17:56.714369] [INFO ] [REMOTE    ] HZO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:17:56.947608] [INFO ] [REMOTE    ] HZO: Fetching primary data for 2025-01.
[2025-10-24T19:17:57.469936] [INFO ] [REMOTE    ] HYT: Incremental fetch complete for 2025-03 (1.32 seconds).
[2025-10-24T19:17:57.747609] [INFO ] [REMOTE    ] HYTR: Fetching primary data for 2025-02.
[2025-10-24T19:17:58.222617] [INFO ] [REMOTE    ] HZO: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T19:17:58.290006] [INFO ] [REMOTE    ] HYTR: Incremental fetch complete for 2025-02 (0.54 seconds).
[2025-10-24T19:17:58.547676] [INFO ] [REMOTE    ] HYI: Fetching primary data for 2025-08.
[2025-10-24T19:17:59.309059] [INFO ] [REMOTE    ] HYI: Incremental fetch complete for 2025-08 (0.76 seconds).
[2025-10-24T19:17:59.347636] [INFO ] [REMOTE    ] HYTR: Fetching primary data for 2025-03.
[2025-10-24T19:17:59.900565] [INFO ] [REMOTE    ] HYTR: Incremental fetch complete for 2025-03 (0.55 seconds).
[2025-10-24T19:18:00.147695] [INFO ] [REMOTE    ] HZO: Fetching primary data for 2025-02.
[2025-10-24T19:18:00.947732] [INFO ] [REMOTE    ] HYI: Fetching primary data for 2025-09.
[2025-10-24T19:18:01.436017] [INFO ] [REMOTE    ] HZO: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T19:18:01.674388] [INFO ] [REMOTE    ] HYI: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T19:18:01.747734] [INFO ] [REMOTE    ] HYT: Fetching primary data for 2025-04.
[2025-10-24T19:18:02.547610] [INFO ] [REMOTE    ] HZO: Fetching primary data for 2025-03.
[2025-10-24T19:18:03.273963] [INFO ] [REMOTE    ] HYT: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T19:18:03.347627] [INFO ] [REMOTE    ] HYT: Fetching primary data for 2025-05.
[2025-10-24T19:18:03.439134] [INFO ] [REMOTE    ] HZO: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T19:18:04.147729] [INFO ] [REMOTE    ] HZO: Fetching primary data for 2025-04.
[2025-10-24T19:18:04.746208] [INFO ] [REMOTE    ] HYT: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T19:18:04.947719] [INFO ] [REMOTE    ] HYI: Fetching primary data for 2025-10.
[2025-10-24T19:18:05.676875] [INFO ] [REMOTE    ] HZO: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T19:18:05.747615] [INFO ] [REMOTE    ] HZO: Fetching primary data for 2025-05.
[2025-10-24T19:18:05.996155] [INFO ] [REMOTE    ] HYI: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T19:18:05.998854] [INFO ] [REMOTE    ] HYI: Full fetch complete (14028 records).
[2025-10-24T19:18:05.998927] [DEBUG] [VALIDATOR ] HYI: Validating primary data.
[2025-10-24T19:18:06.368950] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present.
[2025-10-24T19:18:06.369029] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed.
[2025-10-24T19:18:06.369352] [INFO ] [MAIN      ] HYI: Fetched primary data is valid.
[2025-10-24T19:18:06.369392] [DEBUG] [LOCAL     ] HYI: Saving primary data.
[2025-10-24T19:18:06.369634] [FATAL] [LOCAL     ] HYI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:18:06.369752] [FATAL] [MAIN      ] HYI: Failed to save primary data.
[2025-10-24T19:18:06.369793] [WARN ] [MAIN      ] HYI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:18:06.369827] [INFO ] [LOCAL     ] HYI: Starting deletion of primary data.
[2025-10-24T19:18:06.369875] [DEBUG] [LOCAL     ] HYI: No primary data file found to delete.
[2025-10-24T19:18:06.369909] [INFO ] [LOCAL     ] HYI: Starting deletion of derivative data.
[2025-10-24T19:18:06.370128] [DEBUG] [LOCAL     ] HYI: Deleted derivative data file.
[2025-10-24T19:18:06.370238] [INFO ] [MAIN      ] Update Progress: 1076/2366 symbols completed. HYI took 35.2s. Estimated remaining: 2h 45m 31s. Rate: 7.8 symbols/min
[2025-10-24T19:18:06.541730] [INFO ] [MAIN      ] IAE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:18:06.547628] [INFO ] [REMOTE    ] HYTR: Fetching primary data for 2025-04.
[2025-10-24T19:18:06.552744] [DEBUG] [LOCAL     ] IAE: Loaded 6361 existing records from primary storage.
[2025-10-24T19:18:06.552994] [INFO ] [MAIN      ] IAE: Loaded 6361 existing records.
[2025-10-24T19:18:06.741516] [WARN ] [MAIN      ] IAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:18:06.741842] [INFO ] [MAIN      ] IAE: Wiping existing primary data before full refresh.
[2025-10-24T19:18:06.742033] [INFO ] [LOCAL     ] IAE: Starting deletion of primary data.
[2025-10-24T19:18:06.747748] [DEBUG] [LOCAL     ] IAE: Deleted primary data file.
[2025-10-24T19:18:06.747836] [INFO ] [MAIN      ] IAE: Starting full primary refresh.
[2025-10-24T19:18:06.823131] [INFO ] [REMOTE    ] HZO: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T19:18:07.134614] [INFO ] [REMOTE    ] IAE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:18:07.184776] [INFO ] [REMOTE    ] HYTR: Incremental fetch complete for 2025-04 (0.64 seconds).
[2025-10-24T19:18:07.347670] [INFO ] [REMOTE    ] IAE: Fetching primary data for 2025-01.
[2025-10-24T19:18:08.021474] [INFO ] [REMOTE    ] IAE: Incremental fetch complete for 2025-01 (0.67 seconds).
[2025-10-24T19:18:08.147670] [INFO ] [REMOTE    ] HZO: Fetching primary data for 2025-06.
[2025-10-24T19:18:08.947633] [INFO ] [REMOTE    ] IAE: Fetching primary data for 2025-02.
[2025-10-24T19:18:09.283276] [INFO ] [REMOTE    ] HZO: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T19:18:09.578549] [INFO ] [REMOTE    ] IAE: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T19:18:09.747711] [INFO ] [REMOTE    ] HYT: Fetching primary data for 2025-06.
[2025-10-24T19:18:10.547692] [INFO ] [REMOTE    ] HZO: Fetching primary data for 2025-07.
[2025-10-24T19:18:11.110250] [INFO ] [REMOTE    ] HYT: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T19:18:11.347696] [INFO ] [REMOTE    ] HYTR: Fetching primary data for 2025-05.
[2025-10-24T19:18:11.834935] [INFO ] [REMOTE    ] HYTR: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T19:18:11.834788] [INFO ] [REMOTE    ] HZO: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T19:18:12.147725] [INFO ] [REMOTE    ] HZO: Fetching primary data for 2025-08.
[2025-10-24T19:18:12.947730] [INFO ] [REMOTE    ] IAE: Fetching primary data for 2025-03.
[2025-10-24T19:18:13.347352] [INFO ] [REMOTE    ] HZO: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T19:18:13.590143] [INFO ] [REMOTE    ] IAE: Incremental fetch complete for 2025-03 (0.64 seconds).
[2025-10-24T19:18:13.747732] [INFO ] [REMOTE    ] HZO: Fetching primary data for 2025-09.
[2025-10-24T19:18:14.547617] [INFO ] [REMOTE    ] IAE: Fetching primary data for 2025-04.
[2025-10-24T19:18:14.986749] [INFO ] [REMOTE    ] HZO: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T19:18:15.012489] [INFO ] [REMOTE    ] IAE: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T19:18:15.347678] [INFO ] [REMOTE    ] IAE: Fetching primary data for 2025-05.
[2025-10-24T19:18:15.981135] [INFO ] [REMOTE    ] IAE: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T19:18:16.147715] [INFO ] [REMOTE    ] HYTR: Fetching primary data for 2025-06.
[2025-10-24T19:18:16.646482] [INFO ] [REMOTE    ] HYTR: Incremental fetch complete for 2025-06 (0.50 seconds).
[2025-10-24T19:18:16.947677] [INFO ] [REMOTE    ] IAE: Fetching primary data for 2025-06.
[2025-10-24T19:18:17.593940] [INFO ] [REMOTE    ] IAE: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T19:18:17.747634] [INFO ] [REMOTE    ] HZO: Fetching primary data for 2025-10.
[2025-10-24T19:18:18.547695] [INFO ] [REMOTE    ] HYT: Fetching primary data for 2025-07.
[2025-10-24T19:18:18.979460] [INFO ] [REMOTE    ] HZO: Incremental fetch complete for 2025-10 (1.23 seconds).
[2025-10-24T19:18:18.984553] [INFO ] [REMOTE    ] HZO: Full fetch complete (41265 records).
[2025-10-24T19:18:18.984635] [DEBUG] [VALIDATOR ] HZO: Validating primary data.
[2025-10-24T19:18:19.353486] [INFO ] [REMOTE    ] HYTR: Fetching primary data for 2025-07.
[2025-10-24T19:18:19.354469] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present.
[2025-10-24T19:18:19.355228] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed.
[2025-10-24T19:18:19.356000] [INFO ] [MAIN      ] HZO: Fetched primary data is valid.
[2025-10-24T19:18:19.356064] [DEBUG] [LOCAL     ] HZO: Saving primary data.
[2025-10-24T19:18:19.356520] [FATAL] [LOCAL     ] HZO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:18:19.356620] [FATAL] [MAIN      ] HZO: Failed to save primary data.
[2025-10-24T19:18:19.356711] [WARN ] [MAIN      ] HZO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:18:19.356780] [INFO ] [LOCAL     ] HZO: Starting deletion of primary data.
[2025-10-24T19:18:19.356841] [DEBUG] [LOCAL     ] HZO: No primary data file found to delete.
[2025-10-24T19:18:19.356877] [INFO ] [LOCAL     ] HZO: Starting deletion of derivative data.
[2025-10-24T19:18:19.357263] [DEBUG] [LOCAL     ] HZO: Deleted derivative data file.
[2025-10-24T19:18:19.357354] [INFO ] [MAIN      ] Update Progress: 1077/2366 symbols completed. HZO took 23.4s. Estimated remaining: 2h 45m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:18:19.829293] [INFO ] [REMOTE    ] HYTR: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T19:18:19.937145] [INFO ] [REMOTE    ] HYT: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T19:18:20.147732] [INFO ] [REMOTE    ] HYTR: Fetching primary data for 2025-08.
[2025-10-24T19:18:20.588617] [INFO ] [REMOTE    ] HYTR: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T19:18:20.947724] [INFO ] [REMOTE    ] HYT: Fetching primary data for 2025-08.
[2025-10-24T19:18:21.747722] [INFO ] [REMOTE    ] HYTR: Fetching primary data for 2025-09.
[2025-10-24T19:18:22.273481] [INFO ] [REMOTE    ] HYTR: Incremental fetch complete for 2025-09 (0.53 seconds).
[2025-10-24T19:18:22.486823] [INFO ] [REMOTE    ] HYT: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T19:18:22.547634] [INFO ] [REMOTE    ] HYT: Fetching primary data for 2025-09.
[2025-10-24T19:18:23.347702] [INFO ] [REMOTE    ] HYTR: Fetching primary data for 2025-10.
[2025-10-24T19:18:23.938214] [INFO ] [REMOTE    ] HYTR: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T19:18:23.939431] [INFO ] [REMOTE    ] HYTR: Full fetch complete (4726 records).
[2025-10-24T19:18:23.939514] [DEBUG] [VALIDATOR ] HYTR: Validating primary data.
[2025-10-24T19:18:24.115742] [INFO ] [REMOTE    ] HYT: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T19:18:24.156259] [INFO ] [REMOTE    ] IAE: Fetching primary data for 2025-07.
[2025-10-24T19:18:24.328509] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present.
[2025-10-24T19:18:24.328579] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed.
[2025-10-24T19:18:24.328748] [INFO ] [MAIN      ] HYTR: Fetched primary data is valid.
[2025-10-24T19:18:24.328811] [DEBUG] [LOCAL     ] HYTR: Saving primary data.
[2025-10-24T19:18:24.328994] [FATAL] [LOCAL     ] HYTR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:18:24.329074] [FATAL] [MAIN      ] HYTR: Failed to save primary data.
[2025-10-24T19:18:24.329115] [WARN ] [MAIN      ] HYTR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:18:24.329149] [INFO ] [LOCAL     ] HYTR: Starting deletion of primary data.
[2025-10-24T19:18:24.329196] [DEBUG] [LOCAL     ] HYTR: No primary data file found to delete.
[2025-10-24T19:18:24.329229] [INFO ] [LOCAL     ] HYTR: Starting deletion of derivative data.
[2025-10-24T19:18:24.329392] [DEBUG] [LOCAL     ] HYTR: Deleted derivative data file.
[2025-10-24T19:18:24.329474] [INFO ] [MAIN      ] Update Progress: 1078/2366 symbols completed. HYTR took 30.7s. Estimated remaining: 2h 45m 19s. Rate: 7.8 symbols/min
[2025-10-24T19:18:24.908399] [INFO ] [REMOTE    ] IAE: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T19:18:24.947726] [INFO ] [REMOTE    ] HYT: Fetching primary data for 2025-10.
[2025-10-24T19:18:25.747765] [INFO ] [REMOTE    ] IAE: Fetching primary data for 2025-08.
[2025-10-24T19:18:26.353413] [INFO ] [REMOTE    ] HYT: Incremental fetch complete for 2025-10 (1.41 seconds).
[2025-10-24T19:18:26.368507] [INFO ] [REMOTE    ] HYT: Full fetch complete (47836 records).
[2025-10-24T19:18:26.369157] [DEBUG] [VALIDATOR ] HYT: Validating primary data.
[2025-10-24T19:18:26.369350] [INFO ] [REMOTE    ] IAE: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T19:18:26.560028] [INFO ] [REMOTE    ] IAE: Fetching primary data for 2025-09.
[2025-10-24T19:18:26.800309] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present.
[2025-10-24T19:18:26.800394] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed.
[2025-10-24T19:18:26.801274] [INFO ] [MAIN      ] HYT: Fetched primary data is valid.
[2025-10-24T19:18:26.801373] [DEBUG] [LOCAL     ] HYT: Saving primary data.
[2025-10-24T19:18:26.801869] [FATAL] [LOCAL     ] HYT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:18:26.801948] [FATAL] [MAIN      ] HYT: Failed to save primary data.
[2025-10-24T19:18:26.802015] [WARN ] [MAIN      ] HYT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:18:26.802082] [INFO ] [LOCAL     ] HYT: Starting deletion of primary data.
[2025-10-24T19:18:26.802143] [DEBUG] [LOCAL     ] HYT: No primary data file found to delete.
[2025-10-24T19:18:26.802180] [INFO ] [LOCAL     ] HYT: Starting deletion of derivative data.
[2025-10-24T19:18:26.802309] [DEBUG] [LOCAL     ] HYT: Deleted derivative data file.
[2025-10-24T19:18:26.802841] [INFO ] [MAIN      ] Update Progress: 1079/2366 symbols completed. HYT took 39.0s. Estimated remaining: 2h 45m 5s. Rate: 7.8 symbols/min
[2025-10-24T19:18:27.368711] [INFO ] [REMOTE    ] IAE: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T19:18:27.371075] [INFO ] [REMOTE    ] IAE: Fetching primary data for 2025-10.
[2025-10-24T19:18:28.292499] [INFO ] [REMOTE    ] IAE: Incremental fetch complete for 2025-10 (0.92 seconds).
[2025-10-24T19:18:28.294715] [INFO ] [REMOTE    ] IAE: Full fetch complete (9085 records).
[2025-10-24T19:18:28.294785] [DEBUG] [VALIDATOR ] IAE: Validating primary data.
[2025-10-24T19:18:28.707827] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present.
[2025-10-24T19:18:28.707978] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed.
[2025-10-24T19:18:28.708326] [INFO ] [MAIN      ] IAE: Fetched primary data is valid.
[2025-10-24T19:18:28.709027] [DEBUG] [LOCAL     ] IAE: Saving primary data.
[2025-10-24T19:18:28.709338] [FATAL] [LOCAL     ] IAE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:18:28.709436] [FATAL] [MAIN      ] IAE: Failed to save primary data.
[2025-10-24T19:18:28.709511] [WARN ] [MAIN      ] IAE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:18:28.709595] [INFO ] [LOCAL     ] IAE: Starting deletion of primary data.
[2025-10-24T19:18:28.709686] [DEBUG] [LOCAL     ] IAE: No primary data file found to delete.
[2025-10-24T19:18:28.709741] [INFO ] [LOCAL     ] IAE: Starting deletion of derivative data.
[2025-10-24T19:18:28.709864] [DEBUG] [LOCAL     ] IAE: Deleted derivative data file.
[2025-10-24T19:18:28.709939] [INFO ] [MAIN      ] Update Progress: 1080/2366 symbols completed. IAE took 22.3s. Estimated remaining: 2h 44m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:18:29.363856] [INFO ] [MAIN      ] IAG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:18:29.348495] [INFO ] [MAIN      ] IBN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:18:29.406825] [INFO ] [MAIN      ] IBP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:18:29.435960] [INFO ] [MAIN      ] IBM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:18:29.504424] [DEBUG] [LOCAL     ] IBP: Loaded 28822 existing records from primary storage.
[2025-10-24T19:18:29.504839] [INFO ] [MAIN      ] IBP: Loaded 28822 existing records.
[2025-10-24T19:18:29.611308] [DEBUG] [LOCAL     ] IAG: Loaded 53882 existing records from primary storage.
[2025-10-24T19:18:29.648018] [INFO ] [MAIN      ] IAG: Loaded 53882 existing records.
[2025-10-24T19:18:29.669634] [DEBUG] [LOCAL     ] IBN: Loaded 53220 existing records from primary storage.
[2025-10-24T19:18:29.697087] [INFO ] [MAIN      ] IBN: Loaded 53220 existing records.
[2025-10-24T19:18:29.854681] [DEBUG] [LOCAL     ] IBM: Loaded 54018 existing records from primary storage.
[2025-10-24T19:18:29.973166] [WARN ] [MAIN      ] IBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:18:29.979387] [INFO ] [MAIN      ] IBM: Loaded 54018 existing records.
[2025-10-24T19:18:29.993670] [INFO ] [MAIN      ] IBP: Wiping existing primary data before full refresh.
[2025-10-24T19:18:30.004087] [INFO ] [LOCAL     ] IBP: Starting deletion of primary data.
[2025-10-24T19:18:30.078732] [DEBUG] [LOCAL     ] IBP: Deleted primary data file.
[2025-10-24T19:18:30.120091] [INFO ] [MAIN      ] IBP: Starting full primary refresh.
[2025-10-24T19:18:30.199026] [WARN ] [MAIN      ] IAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:18:30.235214] [INFO ] [MAIN      ] IAG: Wiping existing primary data before full refresh.
[2025-10-24T19:18:30.316119] [INFO ] [LOCAL     ] IAG: Starting deletion of primary data.
[2025-10-24T19:18:30.319191] [WARN ] [MAIN      ] IBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:18:30.355534] [DEBUG] [LOCAL     ] IAG: Deleted primary data file.
[2025-10-24T19:18:30.375141] [INFO ] [MAIN      ] IAG: Starting full primary refresh.
[2025-10-24T19:18:30.361385] [INFO ] [MAIN      ] IBN: Wiping existing primary data before full refresh.
[2025-10-24T19:18:30.431850] [INFO ] [LOCAL     ] IBN: Starting deletion of primary data.
[2025-10-24T19:18:30.469426] [DEBUG] [LOCAL     ] IBN: Deleted primary data file.
[2025-10-24T19:18:30.485143] [WARN ] [MAIN      ] IBM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:18:30.513402] [INFO ] [MAIN      ] IBN: Starting full primary refresh.
[2025-10-24T19:18:30.599998] [INFO ] [MAIN      ] IBM: Wiping existing primary data before full refresh.
[2025-10-24T19:18:30.647812] [INFO ] [LOCAL     ] IBM: Starting deletion of primary data.
[2025-10-24T19:18:30.661865] [DEBUG] [LOCAL     ] IBM: Deleted primary data file.
[2025-10-24T19:18:30.787227] [INFO ] [MAIN      ] IBM: Starting full primary refresh.
[2025-10-24T19:18:31.369309] [INFO ] [REMOTE    ] IBP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:18:31.447412] [INFO ] [REMOTE    ] IBP: Fetching primary data for 2025-01.
[2025-10-24T19:18:31.567530] [INFO ] [REMOTE    ] IAG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:18:31.634121] [INFO ] [REMOTE    ] IAG: Fetching primary data for 2025-01.
[2025-10-24T19:18:31.734354] [INFO ] [REMOTE    ] IBN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:18:31.739888] [INFO ] [REMOTE    ] IBN: Fetching primary data for 2025-01.
[2025-10-24T19:18:31.792131] [INFO ] [REMOTE    ] IBM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:18:31.792453] [INFO ] [REMOTE    ] IBM: Fetching primary data for 2025-01.
[2025-10-24T19:18:32.708998] [INFO ] [REMOTE    ] IBP: Incremental fetch complete for 2025-01 (1.26 seconds).
[2025-10-24T19:18:32.714521] [INFO ] [REMOTE    ] IBP: Fetching primary data for 2025-02.
[2025-10-24T19:18:33.425850] [INFO ] [REMOTE    ] IBN: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T19:18:33.436559] [INFO ] [REMOTE    ] IBN: Fetching primary data for 2025-02.
[2025-10-24T19:18:33.510319] [INFO ] [REMOTE    ] IAG: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T19:18:33.520861] [INFO ] [REMOTE    ] IAG: Fetching primary data for 2025-02.
[2025-10-24T19:18:33.928826] [INFO ] [REMOTE    ] IBM: Incremental fetch complete for 2025-01 (2.14 seconds).
[2025-10-24T19:18:33.941257] [INFO ] [REMOTE    ] IBM: Fetching primary data for 2025-02.
[2025-10-24T19:18:33.974214] [INFO ] [REMOTE    ] IBP: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T19:18:34.547611] [INFO ] [REMOTE    ] IBP: Fetching primary data for 2025-03.
[2025-10-24T19:18:35.040871] [INFO ] [REMOTE    ] IBN: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T19:18:35.348304] [INFO ] [REMOTE    ] IBN: Fetching primary data for 2025-03.
[2025-10-24T19:18:35.351014] [INFO ] [REMOTE    ] IAG: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T19:18:36.012281] [INFO ] [REMOTE    ] IBM: Incremental fetch complete for 2025-02 (2.07 seconds).
[2025-10-24T19:18:36.073178] [INFO ] [REMOTE    ] IBP: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T19:18:36.147620] [INFO ] [REMOTE    ] IBP: Fetching primary data for 2025-04.
[2025-10-24T19:18:36.947624] [INFO ] [REMOTE    ] IBM: Fetching primary data for 2025-03.
[2025-10-24T19:18:37.142140] [INFO ] [REMOTE    ] IBN: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T19:18:37.519696] [INFO ] [REMOTE    ] IBP: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T19:18:37.747735] [INFO ] [REMOTE    ] IBN: Fetching primary data for 2025-04.
[2025-10-24T19:18:38.547729] [INFO ] [REMOTE    ] IBP: Fetching primary data for 2025-05.
[2025-10-24T19:18:39.094960] [INFO ] [REMOTE    ] IBM: Incremental fetch complete for 2025-03 (2.15 seconds).
[2025-10-24T19:18:39.347678] [INFO ] [REMOTE    ] IAG: Fetching primary data for 2025-03.
[2025-10-24T19:18:39.532233] [INFO ] [REMOTE    ] IBN: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T19:18:39.766959] [INFO ] [REMOTE    ] IBP: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T19:18:40.147703] [INFO ] [REMOTE    ] IBP: Fetching primary data for 2025-06.
[2025-10-24T19:18:40.947705] [INFO ] [REMOTE    ] IBM: Fetching primary data for 2025-04.
[2025-10-24T19:18:41.243216] [INFO ] [REMOTE    ] IAG: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T19:18:41.410368] [INFO ] [REMOTE    ] IBP: Incremental fetch complete for 2025-06 (1.26 seconds).
[2025-10-24T19:18:41.747737] [INFO ] [REMOTE    ] IAG: Fetching primary data for 2025-04.
[2025-10-24T19:18:42.547681] [INFO ] [REMOTE    ] IBN: Fetching primary data for 2025-05.
[2025-10-24T19:18:42.878449] [INFO ] [REMOTE    ] IBM: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T19:18:43.347719] [INFO ] [REMOTE    ] IBM: Fetching primary data for 2025-05.
[2025-10-24T19:18:43.786808] [INFO ] [REMOTE    ] IAG: Incremental fetch complete for 2025-04 (2.04 seconds).
[2025-10-24T19:18:44.147630] [INFO ] [REMOTE    ] IAG: Fetching primary data for 2025-05.
[2025-10-24T19:18:44.436550] [INFO ] [REMOTE    ] IBN: Incremental fetch complete for 2025-05 (1.89 seconds).
[2025-10-24T19:18:44.947617] [INFO ] [REMOTE    ] IBP: Fetching primary data for 2025-07.
[2025-10-24T19:18:45.451336] [INFO ] [REMOTE    ] IBM: Incremental fetch complete for 2025-05 (2.10 seconds).
[2025-10-24T19:18:45.724030] [INFO ] [REMOTE    ] IAG: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T19:18:45.747610] [INFO ] [REMOTE    ] IBN: Fetching primary data for 2025-06.
[2025-10-24T19:18:45.828829] [INFO ] [REMOTE    ] IBP: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T19:18:46.547736] [INFO ] [REMOTE    ] IBP: Fetching primary data for 2025-08.
[2025-10-24T19:18:47.350628] [INFO ] [REMOTE    ] IAG: Fetching primary data for 2025-06.
[2025-10-24T19:18:47.353511] [INFO ] [REMOTE    ] IBN: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T19:18:47.989880] [INFO ] [REMOTE    ] IBP: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T19:18:48.147624] [INFO ] [REMOTE    ] IBN: Fetching primary data for 2025-07.
[2025-10-24T19:18:48.947719] [INFO ] [REMOTE    ] IBP: Fetching primary data for 2025-09.
[2025-10-24T19:18:49.157043] [INFO ] [REMOTE    ] IAG: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T19:18:49.457314] [INFO ] [REMOTE    ] IBN: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T19:18:49.747612] [INFO ] [REMOTE    ] IBN: Fetching primary data for 2025-08.
[2025-10-24T19:18:50.127029] [INFO ] [REMOTE    ] IBP: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T19:18:50.547619] [INFO ] [REMOTE    ] IAG: Fetching primary data for 2025-07.
[2025-10-24T19:18:51.259031] [INFO ] [REMOTE    ] IBN: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T19:18:51.347601] [INFO ] [REMOTE    ] IBN: Fetching primary data for 2025-09.
[2025-10-24T19:18:52.147637] [INFO ] [REMOTE    ] IBM: Fetching primary data for 2025-06.
[2025-10-24T19:18:52.512534] [INFO ] [REMOTE    ] IAG: Incremental fetch complete for 2025-07 (1.96 seconds).
[2025-10-24T19:18:52.947666] [INFO ] [REMOTE    ] IAG: Fetching primary data for 2025-08.
[2025-10-24T19:18:53.011134] [INFO ] [REMOTE    ] IBN: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T19:18:53.748472] [INFO ] [REMOTE    ] IBP: Fetching primary data for 2025-10.
[2025-10-24T19:18:53.750912] [INFO ] [REMOTE    ] IBM: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T19:18:54.547694] [INFO ] [REMOTE    ] IBM: Fetching primary data for 2025-07.
[2025-10-24T19:18:54.851110] [INFO ] [REMOTE    ] IAG: Incremental fetch complete for 2025-08 (1.90 seconds).
[2025-10-24T19:18:54.973408] [INFO ] [REMOTE    ] IBP: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T19:18:54.978310] [INFO ] [REMOTE    ] IBP: Full fetch complete (41184 records).
[2025-10-24T19:18:54.978391] [DEBUG] [VALIDATOR ] IBP: Validating primary data.
[2025-10-24T19:18:55.349919] [INFO ] [REMOTE    ] IBN: Fetching primary data for 2025-10.
[2025-10-24T19:18:55.351069] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present.
[2025-10-24T19:18:55.351147] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed.
[2025-10-24T19:18:55.351978] [INFO ] [MAIN      ] IBP: Fetched primary data is valid.
[2025-10-24T19:18:55.352159] [DEBUG] [LOCAL     ] IBP: Saving primary data.
[2025-10-24T19:18:55.352638] [FATAL] [LOCAL     ] IBP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:18:55.352790] [FATAL] [MAIN      ] IBP: Failed to save primary data.
[2025-10-24T19:18:55.352878] [WARN ] [MAIN      ] IBP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:18:55.352961] [INFO ] [LOCAL     ] IBP: Starting deletion of primary data.
[2025-10-24T19:18:55.353032] [DEBUG] [LOCAL     ] IBP: No primary data file found to delete.
[2025-10-24T19:18:55.353071] [INFO ] [LOCAL     ] IBP: Starting deletion of derivative data.
[2025-10-24T19:18:55.353195] [DEBUG] [LOCAL     ] IBP: Deleted derivative data file.
[2025-10-24T19:18:55.353283] [INFO ] [MAIN      ] Update Progress: 1081/2366 symbols completed. IBP took 26.6s. Estimated remaining: 2h 45m 5s. Rate: 7.8 symbols/min
[2025-10-24T19:18:55.524320] [INFO ] [MAIN      ] IBTA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:18:55.559814] [DEBUG] [LOCAL     ] IBTA: Loaded 36287 existing records from primary storage.
[2025-10-24T19:18:55.560072] [INFO ] [MAIN      ] IBTA: Loaded 36287 existing records.
[2025-10-24T19:18:55.733811] [WARN ] [MAIN      ] IBTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:18:55.734024] [INFO ] [MAIN      ] IBTA: Wiping existing primary data before full refresh.
[2025-10-24T19:18:55.734080] [INFO ] [LOCAL     ] IBTA: Starting deletion of primary data.
[2025-10-24T19:18:55.734268] [DEBUG] [LOCAL     ] IBTA: Deleted primary data file.
[2025-10-24T19:18:55.734313] [INFO ] [MAIN      ] IBTA: Starting full primary refresh.
[2025-10-24T19:18:56.090278] [INFO ] [REMOTE    ] IBTA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:18:56.147602] [INFO ] [REMOTE    ] IBTA: Fetching primary data for 2025-01.
[2025-10-24T19:18:56.949271] [INFO ] [REMOTE    ] IBM: Incremental fetch complete for 2025-07 (2.40 seconds).
[2025-10-24T19:18:56.948059] [INFO ] [REMOTE    ] IAG: Fetching primary data for 2025-09.
[2025-10-24T19:18:57.007558] [INFO ] [REMOTE    ] IBN: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T19:18:57.017948] [INFO ] [REMOTE    ] IBN: Full fetch complete (76660 records).
[2025-10-24T19:18:57.018138] [DEBUG] [VALIDATOR ] IBN: Validating primary data.
[2025-10-24T19:18:57.112054] [INFO ] [REMOTE    ] IBTA: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T19:18:57.442858] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present.
[2025-10-24T19:18:57.442953] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed.
[2025-10-24T19:18:57.443997] [INFO ] [MAIN      ] IBN: Fetched primary data is valid.
[2025-10-24T19:18:57.444060] [DEBUG] [LOCAL     ] IBN: Saving primary data.
[2025-10-24T19:18:57.444628] [FATAL] [LOCAL     ] IBN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:18:57.444737] [FATAL] [MAIN      ] IBN: Failed to save primary data.
[2025-10-24T19:18:57.444779] [WARN ] [MAIN      ] IBN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:18:57.444814] [INFO ] [LOCAL     ] IBN: Starting deletion of primary data.
[2025-10-24T19:18:57.444864] [DEBUG] [LOCAL     ] IBN: No primary data file found to delete.
[2025-10-24T19:18:57.444937] [INFO ] [LOCAL     ] IBN: Starting deletion of derivative data.
[2025-10-24T19:18:57.445078] [DEBUG] [LOCAL     ] IBN: Deleted derivative data file.
[2025-10-24T19:18:57.445678] [INFO ] [MAIN      ] Update Progress: 1082/2366 symbols completed. IBN took 28.7s. Estimated remaining: 2h 44m 51s. Rate: 7.8 symbols/min
[2025-10-24T19:18:57.611889] [INFO ] [MAIN      ] ICE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:18:57.665242] [DEBUG] [LOCAL     ] ICE: Loaded 53399 existing records from primary storage.
[2025-10-24T19:18:57.665529] [INFO ] [MAIN      ] ICE: Loaded 53399 existing records.
[2025-10-24T19:18:57.755519] [INFO ] [REMOTE    ] IBTA: Fetching primary data for 2025-02.
[2025-10-24T19:18:57.843736] [WARN ] [MAIN      ] ICE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:18:57.843914] [INFO ] [MAIN      ] ICE: Wiping existing primary data before full refresh.
[2025-10-24T19:18:57.843960] [INFO ] [LOCAL     ] ICE: Starting deletion of primary data.
[2025-10-24T19:18:57.844268] [DEBUG] [LOCAL     ] ICE: Deleted primary data file.
[2025-10-24T19:18:57.844323] [INFO ] [MAIN      ] ICE: Starting full primary refresh.
[2025-10-24T19:18:58.196829] [INFO ] [REMOTE    ] ICE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:18:58.547697] [INFO ] [REMOTE    ] IBM: Fetching primary data for 2025-08.
[2025-10-24T19:18:58.849998] [INFO ] [REMOTE    ] IBTA: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T19:18:58.919448] [INFO ] [REMOTE    ] IAG: Incremental fetch complete for 2025-09 (1.97 seconds).
[2025-10-24T19:18:59.347724] [INFO ] [REMOTE    ] IBTA: Fetching primary data for 2025-03.
[2025-10-24T19:19:00.147740] [INFO ] [REMOTE    ] ICE: Fetching primary data for 2025-01.
[2025-10-24T19:19:00.947733] [INFO ] [REMOTE    ] IAG: Fetching primary data for 2025-10.
[2025-10-24T19:19:01.334403] [INFO ] [REMOTE    ] IBTA: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T19:19:01.466105] [INFO ] [REMOTE    ] IBM: Incremental fetch complete for 2025-08 (2.92 seconds).
[2025-10-24T19:19:01.675544] [INFO ] [REMOTE    ] ICE: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T19:19:01.747680] [INFO ] [REMOTE    ] ICE: Fetching primary data for 2025-02.
[2025-10-24T19:19:02.547698] [INFO ] [REMOTE    ] IBTA: Fetching primary data for 2025-04.
[2025-10-24T19:19:02.891962] [INFO ] [REMOTE    ] IAG: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T19:19:02.903028] [INFO ] [REMOTE    ] IAG: Full fetch complete (77517 records).
[2025-10-24T19:19:02.903193] [DEBUG] [VALIDATOR ] IAG: Validating primary data.
[2025-10-24T19:19:03.342124] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present.
[2025-10-24T19:19:03.342329] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed.
[2025-10-24T19:19:03.343986] [INFO ] [MAIN      ] IAG: Fetched primary data is valid.
[2025-10-24T19:19:03.344158] [DEBUG] [LOCAL     ] IAG: Saving primary data.
[2025-10-24T19:19:03.345105] [FATAL] [LOCAL     ] IAG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:19:03.345199] [FATAL] [MAIN      ] IAG: Failed to save primary data.
[2025-10-24T19:19:03.345244] [WARN ] [MAIN      ] IAG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:19:03.345282] [INFO ] [LOCAL     ] IAG: Starting deletion of primary data.
[2025-10-24T19:19:03.345338] [DEBUG] [LOCAL     ] IAG: No primary data file found to delete.
[2025-10-24T19:19:03.345376] [INFO ] [LOCAL     ] IAG: Starting deletion of derivative data.
[2025-10-24T19:19:03.345535] [DEBUG] [LOCAL     ] IAG: Deleted derivative data file.
[2025-10-24T19:19:03.346110] [INFO ] [MAIN      ] Update Progress: 1083/2366 symbols completed. IAG took 34.6s. Estimated remaining: 2h 44m 41s. Rate: 7.8 symbols/min
[2025-10-24T19:19:03.351604] [INFO ] [REMOTE    ] IBM: Fetching primary data for 2025-09.
[2025-10-24T19:19:03.543816] [INFO ] [MAIN      ] ICL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:19:03.571838] [INFO ] [REMOTE    ] ICE: Incremental fetch complete for 2025-02 (1.82 seconds).
[2025-10-24T19:19:03.618100] [DEBUG] [LOCAL     ] ICL: Loaded 38354 existing records from primary storage.
[2025-10-24T19:19:03.618417] [INFO ] [MAIN      ] ICL: Loaded 38354 existing records.
[2025-10-24T19:19:03.826693] [WARN ] [MAIN      ] ICL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:19:03.826997] [INFO ] [MAIN      ] ICL: Wiping existing primary data before full refresh.
[2025-10-24T19:19:03.827290] [INFO ] [LOCAL     ] ICL: Starting deletion of primary data.
[2025-10-24T19:19:03.827824] [DEBUG] [LOCAL     ] ICL: Deleted primary data file.
[2025-10-24T19:19:03.827901] [INFO ] [MAIN      ] ICL: Starting full primary refresh.
[2025-10-24T19:19:04.160518] [INFO ] [REMOTE    ] IBTA: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T19:19:04.156765] [INFO ] [REMOTE    ] ICE: Fetching primary data for 2025-03.
[2025-10-24T19:19:04.298169] [INFO ] [REMOTE    ] ICL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:19:04.947717] [INFO ] [REMOTE    ] IBTA: Fetching primary data for 2025-05.
[2025-10-24T19:19:05.747672] [INFO ] [REMOTE    ] ICL: Fetching primary data for 2025-01.
[2025-10-24T19:19:05.853711] [INFO ] [REMOTE    ] ICE: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T19:19:06.010819] [INFO ] [REMOTE    ] IBM: Incremental fetch complete for 2025-09 (2.66 seconds).
[2025-10-24T19:19:06.078071] [INFO ] [REMOTE    ] IBTA: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T19:19:06.547737] [INFO ] [REMOTE    ] IBTA: Fetching primary data for 2025-06.
[2025-10-24T19:19:06.852904] [INFO ] [REMOTE    ] ICL: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T19:19:07.310190] [INFO ] [REMOTE    ] IBTA: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T19:19:07.347602] [INFO ] [REMOTE    ] IBTA: Fetching primary data for 2025-07.
[2025-10-24T19:19:08.147621] [INFO ] [REMOTE    ] ICE: Fetching primary data for 2025-04.
[2025-10-24T19:19:08.594465] [INFO ] [REMOTE    ] IBTA: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T19:19:08.947706] [INFO ] [REMOTE    ] ICL: Fetching primary data for 2025-02.
[2025-10-24T19:19:09.445625] [INFO ] [REMOTE    ] ICE: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T19:19:09.747702] [INFO ] [REMOTE    ] ICE: Fetching primary data for 2025-05.
[2025-10-24T19:19:10.397042] [INFO ] [REMOTE    ] ICL: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T19:19:10.547689] [INFO ] [REMOTE    ] IBM: Fetching primary data for 2025-10.
[2025-10-24T19:19:11.347702] [INFO ] [REMOTE    ] ICL: Fetching primary data for 2025-03.
[2025-10-24T19:19:11.441731] [INFO ] [REMOTE    ] ICE: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T19:19:12.147728] [INFO ] [REMOTE    ] IBTA: Fetching primary data for 2025-08.
[2025-10-24T19:19:12.761508] [INFO ] [REMOTE    ] ICL: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T19:19:12.947624] [INFO ] [REMOTE    ] ICE: Fetching primary data for 2025-06.
[2025-10-24T19:19:13.217269] [INFO ] [REMOTE    ] IBM: Incremental fetch complete for 2025-10 (2.67 seconds).
[2025-10-24T19:19:13.227130] [INFO ] [REMOTE    ] IBM: Full fetch complete (77743 records).
[2025-10-24T19:19:13.227308] [DEBUG] [VALIDATOR ] IBM: Validating primary data.
[2025-10-24T19:19:13.617497] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present.
[2025-10-24T19:19:13.617587] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed.
[2025-10-24T19:19:13.618788] [INFO ] [MAIN      ] IBM: Fetched primary data is valid.
[2025-10-24T19:19:13.618858] [DEBUG] [LOCAL     ] IBM: Saving primary data.
[2025-10-24T19:19:13.619482] [FATAL] [LOCAL     ] IBM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:19:13.619577] [FATAL] [MAIN      ] IBM: Failed to save primary data.
[2025-10-24T19:19:13.619619] [WARN ] [MAIN      ] IBM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:19:13.619690] [INFO ] [LOCAL     ] IBM: Starting deletion of primary data.
[2025-10-24T19:19:13.619802] [DEBUG] [LOCAL     ] IBM: No primary data file found to delete.
[2025-10-24T19:19:13.619845] [INFO ] [LOCAL     ] IBM: Starting deletion of derivative data.
[2025-10-24T19:19:13.619987] [DEBUG] [LOCAL     ] IBM: Deleted derivative data file.
[2025-10-24T19:19:13.620366] [INFO ] [MAIN      ] Update Progress: 1084/2366 symbols completed. IBM took 44.9s. Estimated remaining: 2h 44m 36s. Rate: 7.8 symbols/min
[2025-10-24T19:19:13.758516] [INFO ] [REMOTE    ] ICL: Fetching primary data for 2025-04.
[2025-10-24T19:19:13.789579] [INFO ] [MAIN      ] IDA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:19:13.824270] [DEBUG] [LOCAL     ] IDA: Loaded 32984 existing records from primary storage.
[2025-10-24T19:19:13.824709] [INFO ] [MAIN      ] IDA: Loaded 32984 existing records.
[2025-10-24T19:19:14.034196] [INFO ] [REMOTE    ] IBTA: Incremental fetch complete for 2025-08 (1.89 seconds).
[2025-10-24T19:19:14.038954] [WARN ] [MAIN      ] IDA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:19:14.049180] [INFO ] [MAIN      ] IDA: Wiping existing primary data before full refresh.
[2025-10-24T19:19:14.049275] [INFO ] [LOCAL     ] IDA: Starting deletion of primary data.
[2025-10-24T19:19:14.049763] [DEBUG] [LOCAL     ] IDA: Deleted primary data file.
[2025-10-24T19:19:14.050003] [INFO ] [MAIN      ] IDA: Starting full primary refresh.
[2025-10-24T19:19:14.414143] [INFO ] [REMOTE    ] IDA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:19:14.474281] [INFO ] [REMOTE    ] ICE: Incremental fetch complete for 2025-06 (1.53 seconds).
[2025-10-24T19:19:14.547611] [INFO ] [REMOTE    ] ICE: Fetching primary data for 2025-07.
[2025-10-24T19:19:15.357694] [INFO ] [REMOTE    ] IDA: Fetching primary data for 2025-01.
[2025-10-24T19:19:15.381247] [INFO ] [REMOTE    ] ICL: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T19:19:15.994445] [INFO ] [REMOTE    ] ICE: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T19:19:16.147616] [INFO ] [REMOTE    ] ICL: Fetching primary data for 2025-05.
[2025-10-24T19:19:16.229949] [INFO ] [REMOTE    ] IDA: Incremental fetch complete for 2025-01 (0.87 seconds).
[2025-10-24T19:19:16.947673] [INFO ] [REMOTE    ] ICE: Fetching primary data for 2025-08.
[2025-10-24T19:19:17.344636] [INFO ] [REMOTE    ] ICL: Incremental fetch complete for 2025-05 (1.20 seconds).
[2025-10-24T19:19:17.747690] [INFO ] [REMOTE    ] IDA: Fetching primary data for 2025-02.
[2025-10-24T19:19:18.547632] [INFO ] [REMOTE    ] ICL: Fetching primary data for 2025-06.
[2025-10-24T19:19:18.718819] [INFO ] [REMOTE    ] ICE: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T19:19:18.964011] [INFO ] [REMOTE    ] IDA: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T19:19:19.347744] [INFO ] [REMOTE    ] ICE: Fetching primary data for 2025-09.
[2025-10-24T19:19:19.457793] [DEBUG] [REMOTE    ] ICE: Error fetching primary data for 2025-09: 'API call returned an empty response.'
[2025-10-24T19:19:19.458283] [WARN ] [REMOTE    ] ICE: No data returned for month 2025-09
[2025-10-24T19:19:19.458388] [FATAL] [REMOTE    ] ICE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:19:19.458746] [FATAL] [MAIN      ] ICE: Failed to fetch primary data.
[2025-10-24T19:19:19.458823] [WARN ] [MAIN      ] ICE: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:19:19.458901] [INFO ] [LOCAL     ] ICE: Starting deletion of primary data.
[2025-10-24T19:19:19.458976] [DEBUG] [LOCAL     ] ICE: No primary data file found to delete.
[2025-10-24T19:19:19.459014] [INFO ] [LOCAL     ] ICE: Starting deletion of derivative data.
[2025-10-24T19:19:19.459158] [DEBUG] [LOCAL     ] ICE: Deleted derivative data file.
[2025-10-24T19:19:19.459236] [INFO ] [MAIN      ] Update Progress: 1085/2366 symbols completed. ICE took 22.0s. Estimated remaining: 2h 44m 26s. Rate: 7.8 symbols/min
[2025-10-24T19:19:19.643169] [INFO ] [MAIN      ] IDE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:19:19.656361] [DEBUG] [LOCAL     ] IDE: Loaded 9157 existing records from primary storage.
[2025-10-24T19:19:19.656599] [INFO ] [MAIN      ] IDE: Loaded 9157 existing records.
[2025-10-24T19:19:19.847229] [WARN ] [MAIN      ] IDE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:19:19.847513] [INFO ] [MAIN      ] IDE: Wiping existing primary data before full refresh.
[2025-10-24T19:19:19.847567] [INFO ] [LOCAL     ] IDE: Starting deletion of primary data.
[2025-10-24T19:19:19.847758] [DEBUG] [LOCAL     ] IDE: Deleted primary data file.
[2025-10-24T19:19:19.847814] [INFO ] [MAIN      ] IDE: Starting full primary refresh.
[2025-10-24T19:19:20.147923] [INFO ] [REMOTE    ] IBTA: Fetching primary data for 2025-09.
[2025-10-24T19:19:20.171686] [INFO ] [REMOTE    ] ICL: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T19:19:20.272502] [INFO ] [REMOTE    ] IDE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:19:20.947682] [INFO ] [REMOTE    ] IDE: Fetching primary data for 2025-01.
[2025-10-24T19:19:21.667820] [INFO ] [REMOTE    ] IBTA: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T19:19:21.717798] [INFO ] [REMOTE    ] IDE: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T19:19:21.747607] [INFO ] [REMOTE    ] IDE: Fetching primary data for 2025-02.
[2025-10-24T19:19:22.460910] [INFO ] [REMOTE    ] IDE: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T19:19:22.547692] [INFO ] [REMOTE    ] IDA: Fetching primary data for 2025-03.
[2025-10-24T19:19:23.347615] [INFO ] [REMOTE    ] IBTA: Fetching primary data for 2025-10.
[2025-10-24T19:19:23.782572] [INFO ] [REMOTE    ] IDA: Incremental fetch complete for 2025-03 (1.23 seconds).
[2025-10-24T19:19:24.147636] [INFO ] [REMOTE    ] IDE: Fetching primary data for 2025-03.
[2025-10-24T19:19:24.761186] [INFO ] [REMOTE    ] IDE: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T19:19:24.947674] [INFO ] [REMOTE    ] ICL: Fetching primary data for 2025-07.
[2025-10-24T19:19:24.979054] [INFO ] [REMOTE    ] IBTA: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T19:19:24.985434] [INFO ] [REMOTE    ] IBTA: Full fetch complete (51158 records).
[2025-10-24T19:19:24.985545] [DEBUG] [VALIDATOR ] IBTA: Validating primary data.
[2025-10-24T19:19:25.354767] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present.
[2025-10-24T19:19:25.354845] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed.
[2025-10-24T19:19:25.355667] [INFO ] [MAIN      ] IBTA: Fetched primary data is valid.
[2025-10-24T19:19:25.355729] [DEBUG] [LOCAL     ] IBTA: Saving primary data.
[2025-10-24T19:19:25.356173] [FATAL] [LOCAL     ] IBTA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:19:25.356259] [FATAL] [MAIN      ] IBTA: Failed to save primary data.
[2025-10-24T19:19:25.356300] [WARN ] [MAIN      ] IBTA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:19:25.356335] [INFO ] [LOCAL     ] IBTA: Starting deletion of primary data.
[2025-10-24T19:19:25.356385] [DEBUG] [LOCAL     ] IBTA: No primary data file found to delete.
[2025-10-24T19:19:25.356422] [INFO ] [LOCAL     ] IBTA: Starting deletion of derivative data.
[2025-10-24T19:19:25.356563] [DEBUG] [LOCAL     ] IBTA: Deleted derivative data file.
[2025-10-24T19:19:25.356689] [INFO ] [MAIN      ] Update Progress: 1086/2366 symbols completed. IBTA took 30.0s. Estimated remaining: 2h 44m 16s. Rate: 7.8 symbols/min
[2025-10-24T19:19:25.522296] [INFO ] [MAIN      ] IDT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:19:25.542223] [DEBUG] [LOCAL     ] IDT: Loaded 18655 existing records from primary storage.
[2025-10-24T19:19:25.542470] [INFO ] [MAIN      ] IDT: Loaded 18655 existing records.
[2025-10-24T19:19:25.717200] [WARN ] [MAIN      ] IDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:19:25.717470] [INFO ] [MAIN      ] IDT: Wiping existing primary data before full refresh.
[2025-10-24T19:19:25.717524] [INFO ] [LOCAL     ] IDT: Starting deletion of primary data.
[2025-10-24T19:19:25.717923] [DEBUG] [LOCAL     ] IDT: Deleted primary data file.
[2025-10-24T19:19:25.717980] [INFO ] [MAIN      ] IDT: Starting full primary refresh.
[2025-10-24T19:19:25.752874] [INFO ] [REMOTE    ] IDA: Fetching primary data for 2025-04.
[2025-10-24T19:19:26.072542] [INFO ] [REMOTE    ] IDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:19:26.363238] [INFO ] [REMOTE    ] ICL: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T19:19:26.547734] [INFO ] [REMOTE    ] IDE: Fetching primary data for 2025-04.
[2025-10-24T19:19:27.173383] [INFO ] [REMOTE    ] IDA: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T19:19:27.284395] [INFO ] [REMOTE    ] IDE: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T19:19:27.347722] [INFO ] [REMOTE    ] ICL: Fetching primary data for 2025-08.
[2025-10-24T19:19:28.147705] [INFO ] [REMOTE    ] IDE: Fetching primary data for 2025-05.
[2025-10-24T19:19:28.648016] [INFO ] [REMOTE    ] ICL: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T19:19:28.897800] [INFO ] [REMOTE    ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T19:19:28.947707] [INFO ] [REMOTE    ] IDE: Fetching primary data for 2025-06.
[2025-10-24T19:19:29.659696] [INFO ] [REMOTE    ] IDE: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T19:19:29.747719] [INFO ] [REMOTE    ] IDE: Fetching primary data for 2025-07.
[2025-10-24T19:19:30.472365] [INFO ] [REMOTE    ] IDE: Incremental fetch complete for 2025-07 (0.72 seconds).
[2025-10-24T19:19:30.547553] [INFO ] [REMOTE    ] IDE: Fetching primary data for 2025-08.
[2025-10-24T19:19:31.347614] [INFO ] [REMOTE    ] ICL: Fetching primary data for 2025-09.
[2025-10-24T19:19:31.420435] [INFO ] [REMOTE    ] IDE: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T19:19:32.147685] [INFO ] [REMOTE    ] IDE: Fetching primary data for 2025-09.
[2025-10-24T19:19:32.742603] [INFO ] [REMOTE    ] IDE: Incremental fetch complete for 2025-09 (0.59 seconds).
[2025-10-24T19:19:32.952741] [INFO ] [REMOTE    ] IDA: Fetching primary data for 2025-05.
[2025-10-24T19:19:32.969477] [INFO ] [REMOTE    ] ICL: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T19:19:33.747732] [INFO ] [REMOTE    ] IDT: Fetching primary data for 2025-01.
[2025-10-24T19:19:34.453162] [INFO ] [REMOTE    ] IDA: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T19:19:34.547698] [INFO ] [REMOTE    ] ICL: Fetching primary data for 2025-10.
[2025-10-24T19:19:34.608836] [INFO ] [REMOTE    ] IDT: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T19:19:35.347739] [INFO ] [REMOTE    ] IDA: Fetching primary data for 2025-06.
[2025-10-24T19:19:35.999625] [INFO ] [REMOTE    ] ICL: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T19:19:36.006696] [INFO ] [REMOTE    ] ICL: Full fetch complete (55765 records).
[2025-10-24T19:19:36.006847] [DEBUG] [VALIDATOR ] ICL: Validating primary data.
[2025-10-24T19:19:36.152829] [INFO ] [REMOTE    ] IDT: Fetching primary data for 2025-02.
[2025-10-24T19:19:36.403218] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present.
[2025-10-24T19:19:36.403444] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed.
[2025-10-24T19:19:36.404541] [INFO ] [MAIN      ] ICL: Fetched primary data is valid.
[2025-10-24T19:19:36.404699] [DEBUG] [LOCAL     ] ICL: Saving primary data.
[2025-10-24T19:19:36.405256] [FATAL] [LOCAL     ] ICL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:19:36.405340] [FATAL] [MAIN      ] ICL: Failed to save primary data.
[2025-10-24T19:19:36.405384] [WARN ] [MAIN      ] ICL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:19:36.405418] [INFO ] [LOCAL     ] ICL: Starting deletion of primary data.
[2025-10-24T19:19:36.405470] [DEBUG] [LOCAL     ] ICL: No primary data file found to delete.
[2025-10-24T19:19:36.405505] [INFO ] [LOCAL     ] ICL: Starting deletion of derivative data.
[2025-10-24T19:19:36.405620] [DEBUG] [LOCAL     ] ICL: Deleted derivative data file.
[2025-10-24T19:19:36.405739] [INFO ] [MAIN      ] Update Progress: 1087/2366 symbols completed. ICL took 33.1s. Estimated remaining: 2h 44m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:19:36.575063] [INFO ] [MAIN      ] IEX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:19:36.598345] [INFO ] [REMOTE    ] IDA: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T19:19:36.642936] [DEBUG] [LOCAL     ] IEX: Loaded 38489 existing records from primary storage.
[2025-10-24T19:19:36.643250] [INFO ] [MAIN      ] IEX: Loaded 38489 existing records.
[2025-10-24T19:19:36.816942] [WARN ] [MAIN      ] IEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:19:36.817155] [INFO ] [MAIN      ] IEX: Wiping existing primary data before full refresh.
[2025-10-24T19:19:36.817227] [INFO ] [LOCAL     ] IEX: Starting deletion of primary data.
[2025-10-24T19:19:36.817472] [DEBUG] [LOCAL     ] IEX: Deleted primary data file.
[2025-10-24T19:19:36.817528] [INFO ] [MAIN      ] IEX: Starting full primary refresh.
[2025-10-24T19:19:36.954515] [INFO ] [REMOTE    ] IDE: Fetching primary data for 2025-10.
[2025-10-24T19:19:37.106432] [INFO ] [REMOTE    ] IDT: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T19:19:37.178484] [INFO ] [REMOTE    ] IEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:19:37.747709] [INFO ] [REMOTE    ] IDA: Fetching primary data for 2025-07.
[2025-10-24T19:19:37.927328] [INFO ] [REMOTE    ] IDE: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T19:19:37.929999] [INFO ] [REMOTE    ] IDE: Full fetch complete (12864 records).
[2025-10-24T19:19:37.930084] [DEBUG] [VALIDATOR ] IDE: Validating primary data.
[2025-10-24T19:19:38.312524] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present.
[2025-10-24T19:19:38.312624] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed.
[2025-10-24T19:19:38.313355] [INFO ] [MAIN      ] IDE: Fetched primary data is valid.
[2025-10-24T19:19:38.313421] [DEBUG] [LOCAL     ] IDE: Saving primary data.
[2025-10-24T19:19:38.313775] [FATAL] [LOCAL     ] IDE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:19:38.313933] [FATAL] [MAIN      ] IDE: Failed to save primary data.
[2025-10-24T19:19:38.314016] [WARN ] [MAIN      ] IDE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:19:38.314096] [INFO ] [LOCAL     ] IDE: Starting deletion of primary data.
[2025-10-24T19:19:38.314164] [DEBUG] [LOCAL     ] IDE: No primary data file found to delete.
[2025-10-24T19:19:38.314208] [INFO ] [LOCAL     ] IDE: Starting deletion of derivative data.
[2025-10-24T19:19:38.314404] [DEBUG] [LOCAL     ] IDE: Deleted derivative data file.
[2025-10-24T19:19:38.314507] [INFO ] [MAIN      ] Update Progress: 1088/2366 symbols completed. IDE took 18.9s. Estimated remaining: 2h 43m 58s. Rate: 7.8 symbols/min
[2025-10-24T19:19:38.508730] [INFO ] [MAIN      ] IFF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:19:38.551192] [INFO ] [REMOTE    ] IDT: Fetching primary data for 2025-03.
[2025-10-24T19:19:38.588574] [DEBUG] [LOCAL     ] IFF: Loaded 51608 existing records from primary storage.
[2025-10-24T19:19:38.589174] [INFO ] [MAIN      ] IFF: Loaded 51608 existing records.
[2025-10-24T19:19:38.777755] [WARN ] [MAIN      ] IFF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:19:38.778141] [INFO ] [MAIN      ] IFF: Wiping existing primary data before full refresh.
[2025-10-24T19:19:38.778205] [INFO ] [LOCAL     ] IFF: Starting deletion of primary data.
[2025-10-24T19:19:38.779120] [DEBUG] [LOCAL     ] IFF: Deleted primary data file.
[2025-10-24T19:19:38.779228] [INFO ] [MAIN      ] IFF: Starting full primary refresh.
[2025-10-24T19:19:39.153777] [INFO ] [REMOTE    ] IFF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:19:39.197119] [INFO ] [REMOTE    ] IDA: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T19:19:39.347681] [INFO ] [REMOTE    ] IFF: Fetching primary data for 2025-01.
[2025-10-24T19:19:39.566504] [INFO ] [REMOTE    ] IDT: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T19:19:40.147745] [INFO ] [REMOTE    ] IEX: Fetching primary data for 2025-01.
[2025-10-24T19:19:40.947630] [INFO ] [REMOTE    ] IDT: Fetching primary data for 2025-04.
[2025-10-24T19:19:41.047406] [INFO ] [REMOTE    ] IFF: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T19:19:41.561104] [INFO ] [REMOTE    ] IEX: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T19:19:41.747603] [INFO ] [REMOTE    ] IEX: Fetching primary data for 2025-02.
[2025-10-24T19:19:41.902061] [INFO ] [REMOTE    ] IDT: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T19:19:42.547745] [INFO ] [REMOTE    ] IFF: Fetching primary data for 2025-02.
[2025-10-24T19:19:43.196219] [INFO ] [REMOTE    ] IEX: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T19:19:43.347699] [INFO ] [REMOTE    ] IEX: Fetching primary data for 2025-03.
[2025-10-24T19:19:44.147708] [INFO ] [REMOTE    ] IDA: Fetching primary data for 2025-08.
[2025-10-24T19:19:44.176618] [INFO ] [REMOTE    ] IFF: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T19:19:44.947681] [INFO ] [REMOTE    ] IDT: Fetching primary data for 2025-05.
[2025-10-24T19:19:44.980737] [INFO ] [REMOTE    ] IEX: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T19:19:45.055446] [INFO ] [REMOTE    ] IDA: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T19:19:45.714115] [INFO ] [REMOTE    ] IDT: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T19:19:45.747633] [INFO ] [REMOTE    ] IDT: Fetching primary data for 2025-06.
[2025-10-24T19:19:46.547672] [INFO ] [REMOTE    ] IEX: Fetching primary data for 2025-04.
[2025-10-24T19:19:46.879371] [INFO ] [REMOTE    ] IDT: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T19:19:47.347734] [INFO ] [REMOTE    ] IFF: Fetching primary data for 2025-03.
[2025-10-24T19:19:48.073253] [INFO ] [REMOTE    ] IEX: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T19:19:48.147677] [INFO ] [REMOTE    ] IDT: Fetching primary data for 2025-07.
[2025-10-24T19:19:48.758086] [INFO ] [REMOTE    ] IFF: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T19:19:48.813443] [INFO ] [REMOTE    ] IDT: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T19:19:48.947639] [INFO ] [REMOTE    ] IEX: Fetching primary data for 2025-05.
[2025-10-24T19:19:49.747717] [INFO ] [REMOTE    ] IDT: Fetching primary data for 2025-08.
[2025-10-24T19:19:50.408588] [INFO ] [REMOTE    ] IEX: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T19:19:50.547597] [INFO ] [REMOTE    ] IEX: Fetching primary data for 2025-06.
[2025-10-24T19:19:50.703105] [INFO ] [REMOTE    ] IDT: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T19:19:51.347635] [INFO ] [REMOTE    ] IDA: Fetching primary data for 2025-09.
[2025-10-24T19:19:51.992252] [INFO ] [REMOTE    ] IEX: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T19:19:52.147674] [INFO ] [REMOTE    ] IEX: Fetching primary data for 2025-07.
[2025-10-24T19:19:52.509591] [INFO ] [REMOTE    ] IDA: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T19:19:52.947672] [INFO ] [REMOTE    ] IDA: Fetching primary data for 2025-10.
[2025-10-24T19:19:53.589431] [INFO ] [REMOTE    ] IEX: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T19:19:53.747677] [INFO ] [REMOTE    ] IEX: Fetching primary data for 2025-08.
[2025-10-24T19:19:54.337753] [INFO ] [REMOTE    ] IDA: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T19:19:54.343946] [INFO ] [REMOTE    ] IDA: Full fetch complete (45427 records).
[2025-10-24T19:19:54.344052] [DEBUG] [VALIDATOR ] IDA: Validating primary data.
[2025-10-24T19:19:54.555817] [INFO ] [REMOTE    ] IFF: Fetching primary data for 2025-04.
[2025-10-24T19:19:54.723809] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present.
[2025-10-24T19:19:54.723882] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed.
[2025-10-24T19:19:54.724733] [INFO ] [MAIN      ] IDA: Fetched primary data is valid.
[2025-10-24T19:19:54.724797] [DEBUG] [LOCAL     ] IDA: Saving primary data.
[2025-10-24T19:19:54.725200] [FATAL] [LOCAL     ] IDA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:19:54.725280] [FATAL] [MAIN      ] IDA: Failed to save primary data.
[2025-10-24T19:19:54.725350] [WARN ] [MAIN      ] IDA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:19:54.725420] [INFO ] [LOCAL     ] IDA: Starting deletion of primary data.
[2025-10-24T19:19:54.725479] [DEBUG] [LOCAL     ] IDA: No primary data file found to delete.
[2025-10-24T19:19:54.725516] [INFO ] [LOCAL     ] IDA: Starting deletion of derivative data.
[2025-10-24T19:19:54.725629] [DEBUG] [LOCAL     ] IDA: Deleted derivative data file.
[2025-10-24T19:19:54.725737] [INFO ] [MAIN      ] Update Progress: 1089/2366 symbols completed. IDA took 41.1s. Estimated remaining: 2h 44m 1s. Rate: 7.8 symbols/min
[2025-10-24T19:19:54.899896] [INFO ] [MAIN      ] IFN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:19:54.918948] [DEBUG] [LOCAL     ] IFN: Loaded 18692 existing records from primary storage.
[2025-10-24T19:19:54.919204] [INFO ] [MAIN      ] IFN: Loaded 18692 existing records.
[2025-10-24T19:19:55.100451] [WARN ] [MAIN      ] IFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:19:55.100681] [INFO ] [MAIN      ] IFN: Wiping existing primary data before full refresh.
[2025-10-24T19:19:55.100739] [INFO ] [LOCAL     ] IFN: Starting deletion of primary data.
[2025-10-24T19:19:55.100915] [DEBUG] [LOCAL     ] IFN: Deleted primary data file.
[2025-10-24T19:19:55.100965] [INFO ] [MAIN      ] IFN: Starting full primary refresh.
[2025-10-24T19:19:55.350382] [INFO ] [REMOTE    ] IDT: Fetching primary data for 2025-09.
[2025-10-24T19:19:55.423575] [INFO ] [REMOTE    ] IEX: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T19:19:55.494634] [INFO ] [REMOTE    ] IFN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:19:56.147684] [INFO ] [REMOTE    ] IEX: Fetching primary data for 2025-09.
[2025-10-24T19:19:56.467409] [INFO ] [REMOTE    ] IFF: Incremental fetch complete for 2025-04 (1.91 seconds).
[2025-10-24T19:19:56.491481] [INFO ] [REMOTE    ] IDT: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T19:19:56.947633] [INFO ] [REMOTE    ] IFF: Fetching primary data for 2025-05.
[2025-10-24T19:19:57.542199] [INFO ] [REMOTE    ] IEX: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T19:19:57.747699] [INFO ] [REMOTE    ] IEX: Fetching primary data for 2025-10.
[2025-10-24T19:19:58.547731] [INFO ] [REMOTE    ] IDT: Fetching primary data for 2025-10.
[2025-10-24T19:19:58.693622] [INFO ] [REMOTE    ] IFF: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T19:19:58.958958] [INFO ] [REMOTE    ] IEX: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T19:19:58.965514] [INFO ] [REMOTE    ] IEX: Full fetch complete (53794 records).
[2025-10-24T19:19:58.965667] [DEBUG] [VALIDATOR ] IEX: Validating primary data.
[2025-10-24T19:19:59.349320] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present.
[2025-10-24T19:19:59.349415] [INFO ] [REMOTE    ] IFN: Fetching primary data for 2025-01.
[2025-10-24T19:19:59.349929] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed.
[2025-10-24T19:19:59.351417] [INFO ] [MAIN      ] IEX: Fetched primary data is valid.
[2025-10-24T19:19:59.351483] [DEBUG] [LOCAL     ] IEX: Saving primary data.
[2025-10-24T19:19:59.352061] [FATAL] [LOCAL     ] IEX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:19:59.352143] [FATAL] [MAIN      ] IEX: Failed to save primary data.
[2025-10-24T19:19:59.352185] [WARN ] [MAIN      ] IEX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:19:59.352247] [INFO ] [LOCAL     ] IEX: Starting deletion of primary data.
[2025-10-24T19:19:59.352305] [DEBUG] [LOCAL     ] IEX: No primary data file found to delete.
[2025-10-24T19:19:59.352341] [INFO ] [LOCAL     ] IEX: Starting deletion of derivative data.
[2025-10-24T19:19:59.352525] [DEBUG] [LOCAL     ] IEX: Deleted derivative data file.
[2025-10-24T19:19:59.352616] [INFO ] [MAIN      ] Update Progress: 1090/2366 symbols completed. IEX took 22.9s. Estimated remaining: 2h 43m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:19:59.530313] [INFO ] [MAIN      ] IFS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:19:59.543464] [INFO ] [REMOTE    ] IDT: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T19:19:59.548298] [INFO ] [REMOTE    ] IDT: Full fetch complete (24192 records).
[2025-10-24T19:19:59.548377] [DEBUG] [VALIDATOR ] IDT: Validating primary data.
[2025-10-24T19:19:59.721976] [DEBUG] [LOCAL     ] IFS: Loaded 22293 existing records from primary storage.
[2025-10-24T19:19:59.747870] [INFO ] [MAIN      ] IFS: Loaded 22293 existing records.
[2025-10-24T19:20:00.120307] [WARN ] [MAIN      ] IFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:20:00.121163] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present.
[2025-10-24T19:20:00.121357] [INFO ] [MAIN      ] IFS: Wiping existing primary data before full refresh.
[2025-10-24T19:20:00.121510] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed.
[2025-10-24T19:20:00.121448] [INFO ] [LOCAL     ] IFS: Starting deletion of primary data.
[2025-10-24T19:20:00.122315] [INFO ] [MAIN      ] IDT: Fetched primary data is valid.
[2025-10-24T19:20:00.122402] [DEBUG] [LOCAL     ] IDT: Saving primary data.
[2025-10-24T19:20:00.122892] [DEBUG] [LOCAL     ] IFS: Deleted primary data file.
[2025-10-24T19:20:00.122817] [FATAL] [LOCAL     ] IDT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:20:00.122993] [INFO ] [MAIN      ] IFS: Starting full primary refresh.
[2025-10-24T19:20:00.123144] [FATAL] [MAIN      ] IDT: Failed to save primary data.
[2025-10-24T19:20:00.153791] [INFO ] [REMOTE    ] IFF: Fetching primary data for 2025-06.
[2025-10-24T19:20:00.153937] [WARN ] [MAIN      ] IDT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:20:00.165865] [INFO ] [LOCAL     ] IDT: Starting deletion of primary data.
[2025-10-24T19:20:00.228830] [DEBUG] [LOCAL     ] IDT: No primary data file found to delete.
[2025-10-24T19:20:00.229215] [INFO ] [LOCAL     ] IDT: Starting deletion of derivative data.
[2025-10-24T19:20:00.245077] [DEBUG] [LOCAL     ] IDT: Deleted derivative data file.
[2025-10-24T19:20:00.255498] [INFO ] [MAIN      ] Update Progress: 1091/2366 symbols completed. IDT took 34.9s. Estimated remaining: 2h 43m 34s. Rate: 7.8 symbols/min
[2025-10-24T19:20:00.628239] [INFO ] [MAIN      ] IGA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:20:00.702986] [INFO ] [REMOTE    ] IFS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:20:00.722013] [INFO ] [REMOTE    ] IFN: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T19:20:00.732107] [DEBUG] [LOCAL     ] IGA: Loaded 10175 existing records from primary storage.
[2025-10-24T19:20:00.732313] [INFO ] [MAIN      ] IGA: Loaded 10175 existing records.
[2025-10-24T19:20:00.905399] [WARN ] [MAIN      ] IGA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:20:00.905668] [INFO ] [MAIN      ] IGA: Wiping existing primary data before full refresh.
[2025-10-24T19:20:00.905730] [INFO ] [LOCAL     ] IGA: Starting deletion of primary data.
[2025-10-24T19:20:00.905887] [DEBUG] [LOCAL     ] IGA: Deleted primary data file.
[2025-10-24T19:20:00.905925] [INFO ] [MAIN      ] IGA: Starting full primary refresh.
[2025-10-24T19:20:00.959498] [INFO ] [REMOTE    ] IFN: Fetching primary data for 2025-02.
[2025-10-24T19:20:01.257246] [INFO ] [REMOTE    ] IGA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:20:01.463260] [INFO ] [REMOTE    ] IFF: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T19:20:01.747752] [INFO ] [REMOTE    ] IFF: Fetching primary data for 2025-07.
[2025-10-24T19:20:02.205987] [INFO ] [REMOTE    ] IFN: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T19:20:02.547718] [INFO ] [REMOTE    ] IGA: Fetching primary data for 2025-01.
[2025-10-24T19:20:03.242454] [INFO ] [REMOTE    ] IGA: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T19:20:03.347702] [INFO ] [REMOTE    ] IFS: Fetching primary data for 2025-01.
[2025-10-24T19:20:03.651918] [INFO ] [REMOTE    ] IFF: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T19:20:04.107572] [INFO ] [REMOTE    ] IFS: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T19:20:04.147619] [INFO ] [REMOTE    ] IFS: Fetching primary data for 2025-02.
[2025-10-24T19:20:04.947628] [INFO ] [REMOTE    ] IFF: Fetching primary data for 2025-08.
[2025-10-24T19:20:05.265716] [INFO ] [REMOTE    ] IFS: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T19:20:05.747727] [INFO ] [REMOTE    ] IFS: Fetching primary data for 2025-03.
[2025-10-24T19:20:06.547619] [INFO ] [REMOTE    ] IGA: Fetching primary data for 2025-02.
[2025-10-24T19:20:06.611161] [INFO ] [REMOTE    ] IFF: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T19:20:06.901233] [INFO ] [REMOTE    ] IFS: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T19:20:06.973610] [INFO ] [REMOTE    ] IGA: Incremental fetch complete for 2025-02 (0.43 seconds).
[2025-10-24T19:20:07.347627] [INFO ] [REMOTE    ] IGA: Fetching primary data for 2025-03.
[2025-10-24T19:20:08.094864] [INFO ] [REMOTE    ] IGA: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T19:20:08.147677] [INFO ] [REMOTE    ] IGA: Fetching primary data for 2025-04.
[2025-10-24T19:20:08.947721] [INFO ] [REMOTE    ] IFF: Fetching primary data for 2025-09.
[2025-10-24T19:20:09.080425] [INFO ] [REMOTE    ] IGA: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T19:20:09.747752] [INFO ] [REMOTE    ] IFN: Fetching primary data for 2025-03.
[2025-10-24T19:20:10.547637] [INFO ] [REMOTE    ] IGA: Fetching primary data for 2025-05.
[2025-10-24T19:20:10.661737] [INFO ] [REMOTE    ] IFF: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T19:20:11.032326] [INFO ] [REMOTE    ] IFN: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T19:20:11.169060] [INFO ] [REMOTE    ] IGA: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T19:20:11.347667] [INFO ] [REMOTE    ] IFN: Fetching primary data for 2025-04.
[2025-10-24T19:20:12.147716] [INFO ] [REMOTE    ] IFS: Fetching primary data for 2025-04.
[2025-10-24T19:20:12.367065] [INFO ] [REMOTE    ] IFN: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T19:20:12.947661] [INFO ] [REMOTE    ] IGA: Fetching primary data for 2025-06.
[2025-10-24T19:20:13.357497] [INFO ] [REMOTE    ] IFS: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T19:20:13.419194] [INFO ] [REMOTE    ] IGA: Incremental fetch complete for 2025-06 (0.47 seconds).
[2025-10-24T19:20:13.747709] [INFO ] [REMOTE    ] IFS: Fetching primary data for 2025-05.
[2025-10-24T19:20:14.547673] [INFO ] [REMOTE    ] IFF: Fetching primary data for 2025-10.
[2025-10-24T19:20:14.878891] [INFO ] [REMOTE    ] IFS: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T19:20:15.347695] [INFO ] [REMOTE    ] IFN: Fetching primary data for 2025-05.
[2025-10-24T19:20:16.147623] [INFO ] [REMOTE    ] IGA: Fetching primary data for 2025-07.
[2025-10-24T19:20:16.416857] [INFO ] [REMOTE    ] IFN: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T19:20:16.492476] [INFO ] [REMOTE    ] IFF: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T19:20:16.502099] [INFO ] [REMOTE    ] IFF: Full fetch complete (73766 records).
[2025-10-24T19:20:16.502234] [DEBUG] [VALIDATOR ] IFF: Validating primary data.
[2025-10-24T19:20:16.889117] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present.
[2025-10-24T19:20:16.889298] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed.
[2025-10-24T19:20:16.890376] [INFO ] [MAIN      ] IFF: Fetched primary data is valid.
[2025-10-24T19:20:16.890440] [DEBUG] [LOCAL     ] IFF: Saving primary data.
[2025-10-24T19:20:16.891048] [FATAL] [LOCAL     ] IFF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:20:16.891135] [FATAL] [MAIN      ] IFF: Failed to save primary data.
[2025-10-24T19:20:16.891203] [WARN ] [MAIN      ] IFF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:20:16.891273] [INFO ] [LOCAL     ] IFF: Starting deletion of primary data.
[2025-10-24T19:20:16.891353] [DEBUG] [LOCAL     ] IFF: No primary data file found to delete.
[2025-10-24T19:20:16.891389] [INFO ] [LOCAL     ] IFF: Starting deletion of derivative data.
[2025-10-24T19:20:16.891548] [DEBUG] [LOCAL     ] IFF: Deleted derivative data file.
[2025-10-24T19:20:16.892033] [INFO ] [MAIN      ] Update Progress: 1092/2366 symbols completed. IFF took 38.6s. Estimated remaining: 2h 43m 36s. Rate: 7.8 symbols/min
[2025-10-24T19:20:16.953361] [INFO ] [REMOTE    ] IFS: Fetching primary data for 2025-06.
[2025-10-24T19:20:17.002669] [INFO ] [REMOTE    ] IGA: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T19:20:17.075067] [INFO ] [MAIN      ] IGD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:20:17.095825] [DEBUG] [LOCAL     ] IGD: Loaded 19340 existing records from primary storage.
[2025-10-24T19:20:17.096097] [INFO ] [MAIN      ] IGD: Loaded 19340 existing records.
[2025-10-24T19:20:17.267918] [WARN ] [MAIN      ] IGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:20:17.268148] [INFO ] [MAIN      ] IGD: Wiping existing primary data before full refresh.
[2025-10-24T19:20:17.268197] [INFO ] [LOCAL     ] IGD: Starting deletion of primary data.
[2025-10-24T19:20:17.268404] [DEBUG] [LOCAL     ] IGD: Deleted primary data file.
[2025-10-24T19:20:17.268462] [INFO ] [MAIN      ] IGD: Starting full primary refresh.
[2025-10-24T19:20:17.613260] [INFO ] [REMOTE    ] IGD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:20:17.747690] [INFO ] [REMOTE    ] IGD: Fetching primary data for 2025-01.
[2025-10-24T19:20:18.248746] [INFO ] [REMOTE    ] IFS: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T19:20:18.547619] [INFO ] [REMOTE    ] IFN: Fetching primary data for 2025-06.
[2025-10-24T19:20:19.002241] [INFO ] [REMOTE    ] IGD: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T19:20:19.347668] [INFO ] [REMOTE    ] IFS: Fetching primary data for 2025-07.
[2025-10-24T19:20:19.446844] [INFO ] [REMOTE    ] IFN: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T19:20:20.147693] [INFO ] [REMOTE    ] IGA: Fetching primary data for 2025-08.
[2025-10-24T19:20:20.384833] [INFO ] [REMOTE    ] IFS: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T19:20:20.889699] [INFO ] [REMOTE    ] IGA: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T19:20:20.947609] [INFO ] [REMOTE    ] IGA: Fetching primary data for 2025-09.
[2025-10-24T19:20:21.747621] [INFO ] [REMOTE    ] IFS: Fetching primary data for 2025-08.
[2025-10-24T19:20:21.823204] [INFO ] [REMOTE    ] IGA: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T19:20:22.547619] [INFO ] [REMOTE    ] IGD: Fetching primary data for 2025-02.
[2025-10-24T19:20:22.652854] [INFO ] [REMOTE    ] IFS: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T19:20:23.243867] [INFO ] [REMOTE    ] IGD: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T19:20:23.347599] [INFO ] [REMOTE    ] IGD: Fetching primary data for 2025-03.
[2025-10-24T19:20:24.147624] [INFO ] [REMOTE    ] IFS: Fetching primary data for 2025-09.
[2025-10-24T19:20:24.348946] [INFO ] [REMOTE    ] IGD: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T19:20:24.947612] [INFO ] [REMOTE    ] IGD: Fetching primary data for 2025-04.
[2025-10-24T19:20:25.328092] [INFO ] [REMOTE    ] IFS: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T19:20:25.678686] [INFO ] [REMOTE    ] IGD: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T19:20:25.747611] [INFO ] [REMOTE    ] IGD: Fetching primary data for 2025-05.
[2025-10-24T19:20:26.547634] [INFO ] [REMOTE    ] IGA: Fetching primary data for 2025-10.
[2025-10-24T19:20:26.658420] [INFO ] [REMOTE    ] IGD: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T19:20:27.347744] [INFO ] [REMOTE    ] IFN: Fetching primary data for 2025-07.
[2025-10-24T19:20:27.382623] [INFO ] [REMOTE    ] IGA: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T19:20:27.385398] [INFO ] [REMOTE    ] IGA: Full fetch complete (14267 records).
[2025-10-24T19:20:27.385526] [DEBUG] [VALIDATOR ] IGA: Validating primary data.
[2025-10-24T19:20:27.740795] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present.
[2025-10-24T19:20:27.740872] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed.
[2025-10-24T19:20:27.741186] [INFO ] [MAIN      ] IGA: Fetched primary data is valid.
[2025-10-24T19:20:27.741227] [DEBUG] [LOCAL     ] IGA: Saving primary data.
[2025-10-24T19:20:27.741474] [FATAL] [LOCAL     ] IGA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:20:27.741558] [FATAL] [MAIN      ] IGA: Failed to save primary data.
[2025-10-24T19:20:27.741599] [WARN ] [MAIN      ] IGA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:20:27.741632] [INFO ] [LOCAL     ] IGA: Starting deletion of primary data.
[2025-10-24T19:20:27.741739] [DEBUG] [LOCAL     ] IGA: No primary data file found to delete.
[2025-10-24T19:20:27.741794] [INFO ] [LOCAL     ] IGA: Starting deletion of derivative data.
[2025-10-24T19:20:27.742071] [DEBUG] [LOCAL     ] IGA: Deleted derivative data file.
[2025-10-24T19:20:27.742163] [INFO ] [MAIN      ] Update Progress: 1093/2366 symbols completed. IGA took 27.5s. Estimated remaining: 2h 43m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:20:27.912298] [INFO ] [MAIN      ] IGI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:20:27.919724] [DEBUG] [LOCAL     ] IGI: Loaded 4171 existing records from primary storage.
[2025-10-24T19:20:27.919932] [INFO ] [MAIN      ] IGI: Loaded 4171 existing records.
[2025-10-24T19:20:28.092869] [WARN ] [MAIN      ] IGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:20:28.093049] [INFO ] [MAIN      ] IGI: Wiping existing primary data before full refresh.
[2025-10-24T19:20:28.093095] [INFO ] [LOCAL     ] IGI: Starting deletion of primary data.
[2025-10-24T19:20:28.093279] [DEBUG] [LOCAL     ] IGI: Deleted primary data file.
[2025-10-24T19:20:28.093334] [INFO ] [MAIN      ] IGI: Starting full primary refresh.
[2025-10-24T19:20:28.153615] [INFO ] [REMOTE    ] IFS: Fetching primary data for 2025-10.
[2025-10-24T19:20:28.406687] [INFO ] [REMOTE    ] IFN: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T19:20:28.466798] [INFO ] [REMOTE    ] IGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:20:28.947718] [INFO ] [REMOTE    ] IFN: Fetching primary data for 2025-08.
[2025-10-24T19:20:29.413319] [INFO ] [REMOTE    ] IFS: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T19:20:29.417318] [INFO ] [REMOTE    ] IFS: Full fetch complete (32318 records).
[2025-10-24T19:20:29.417408] [DEBUG] [VALIDATOR ] IFS: Validating primary data.
[2025-10-24T19:20:29.750870] [INFO ] [REMOTE    ] IGI: Fetching primary data for 2025-01.
[2025-10-24T19:20:29.780548] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present.
[2025-10-24T19:20:29.780614] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed.
[2025-10-24T19:20:29.781291] [INFO ] [MAIN      ] IFS: Fetched primary data is valid.
[2025-10-24T19:20:29.781459] [DEBUG] [LOCAL     ] IFS: Saving primary data.
[2025-10-24T19:20:29.781849] [FATAL] [LOCAL     ] IFS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:20:29.781930] [FATAL] [MAIN      ] IFS: Failed to save primary data.
[2025-10-24T19:20:29.781994] [WARN ] [MAIN      ] IFS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:20:29.782062] [INFO ] [LOCAL     ] IFS: Starting deletion of primary data.
[2025-10-24T19:20:29.782119] [DEBUG] [LOCAL     ] IFS: No primary data file found to delete.
[2025-10-24T19:20:29.782169] [INFO ] [LOCAL     ] IFS: Starting deletion of derivative data.
[2025-10-24T19:20:29.782344] [DEBUG] [LOCAL     ] IFS: Deleted derivative data file.
[2025-10-24T19:20:29.782434] [INFO ] [MAIN      ] Update Progress: 1094/2366 symbols completed. IFS took 30.4s. Estimated remaining: 2h 43m 18s. Rate: 7.8 symbols/min
[2025-10-24T19:20:29.948962] [INFO ] [MAIN      ] IGR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:20:29.977823] [DEBUG] [LOCAL     ] IGR: Loaded 30712 existing records from primary storage.
[2025-10-24T19:20:29.978078] [INFO ] [MAIN      ] IGR: Loaded 30712 existing records.
[2025-10-24T19:20:30.153883] [INFO ] [REMOTE    ] IFN: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T19:20:30.173280] [WARN ] [MAIN      ] IGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:20:30.178449] [INFO ] [MAIN      ] IGR: Wiping existing primary data before full refresh.
[2025-10-24T19:20:30.178557] [INFO ] [LOCAL     ] IGR: Starting deletion of primary data.
[2025-10-24T19:20:30.179052] [DEBUG] [LOCAL     ] IGR: Deleted primary data file.
[2025-10-24T19:20:30.179117] [INFO ] [MAIN      ] IGR: Starting full primary refresh.
[2025-10-24T19:20:30.375572] [INFO ] [REMOTE    ] IGI: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T19:20:30.552232] [INFO ] [REMOTE    ] IGI: Fetching primary data for 2025-02.
[2025-10-24T19:20:30.556416] [INFO ] [REMOTE    ] IGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:20:31.012333] [INFO ] [REMOTE    ] IGI: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T19:20:31.347636] [INFO ] [REMOTE    ] IFN: Fetching primary data for 2025-09.
[2025-10-24T19:20:32.147638] [INFO ] [REMOTE    ] IGI: Fetching primary data for 2025-03.
[2025-10-24T19:20:32.310508] [INFO ] [REMOTE    ] IFN: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T19:20:32.509108] [INFO ] [REMOTE    ] IGI: Incremental fetch complete for 2025-03 (0.36 seconds).
[2025-10-24T19:20:32.947696] [INFO ] [REMOTE    ] IGR: Fetching primary data for 2025-01.
[2025-10-24T19:20:33.747680] [INFO ] [REMOTE    ] IGI: Fetching primary data for 2025-04.
[2025-10-24T19:20:34.237106] [INFO ] [REMOTE    ] IGR: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T19:20:34.237255] [INFO ] [REMOTE    ] IGI: Incremental fetch complete for 2025-04 (0.49 seconds).
[2025-10-24T19:20:34.547689] [INFO ] [REMOTE    ] IFN: Fetching primary data for 2025-10.
[2025-10-24T19:20:35.347618] [INFO ] [REMOTE    ] IGI: Fetching primary data for 2025-05.
[2025-10-24T19:20:35.602062] [INFO ] [REMOTE    ] IFN: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T19:20:35.605751] [INFO ] [REMOTE    ] IFN: Full fetch complete (28154 records).
[2025-10-24T19:20:35.605847] [DEBUG] [VALIDATOR ] IFN: Validating primary data.
[2025-10-24T19:20:35.829798] [INFO ] [REMOTE    ] IGI: Incremental fetch complete for 2025-05 (0.48 seconds).
[2025-10-24T19:20:35.984971] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present.
[2025-10-24T19:20:35.985044] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed.
[2025-10-24T19:20:35.985596] [INFO ] [MAIN      ] IFN: Fetched primary data is valid.
[2025-10-24T19:20:35.985634] [DEBUG] [LOCAL     ] IFN: Saving primary data.
[2025-10-24T19:20:35.985959] [FATAL] [LOCAL     ] IFN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:20:35.986042] [FATAL] [MAIN      ] IFN: Failed to save primary data.
[2025-10-24T19:20:35.986083] [WARN ] [MAIN      ] IFN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:20:35.986117] [INFO ] [LOCAL     ] IFN: Starting deletion of primary data.
[2025-10-24T19:20:35.986165] [DEBUG] [LOCAL     ] IFN: No primary data file found to delete.
[2025-10-24T19:20:35.986199] [INFO ] [LOCAL     ] IFN: Starting deletion of derivative data.
[2025-10-24T19:20:35.986355] [DEBUG] [LOCAL     ] IFN: Deleted derivative data file.
[2025-10-24T19:20:35.986440] [INFO ] [MAIN      ] Update Progress: 1095/2366 symbols completed. IFN took 41.3s. Estimated remaining: 2h 43m 9s. Rate: 7.8 symbols/min
[2025-10-24T19:20:36.156841] [INFO ] [REMOTE    ] IGR: Fetching primary data for 2025-02.
[2025-10-24T19:20:36.160982] [INFO ] [MAIN      ] IH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:20:36.166206] [DEBUG] [LOCAL     ] IH: Loaded 2735 existing records from primary storage.
[2025-10-24T19:20:36.166370] [INFO ] [MAIN      ] IH: Loaded 2735 existing records.
[2025-10-24T19:20:36.353327] [WARN ] [MAIN      ] IH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:20:36.353541] [INFO ] [MAIN      ] IH: Wiping existing primary data before full refresh.
[2025-10-24T19:20:36.353595] [INFO ] [LOCAL     ] IH: Starting deletion of primary data.
[2025-10-24T19:20:36.353739] [DEBUG] [LOCAL     ] IH: Deleted primary data file.
[2025-10-24T19:20:36.353804] [INFO ] [MAIN      ] IH: Starting full primary refresh.
[2025-10-24T19:20:36.717757] [INFO ] [REMOTE    ] IH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:20:36.947622] [INFO ] [REMOTE    ] IH: Fetching primary data for 2025-01.
[2025-10-24T19:20:37.362230] [INFO ] [REMOTE    ] IH: Incremental fetch complete for 2025-01 (0.41 seconds).
[2025-10-24T19:20:37.653436] [INFO ] [REMOTE    ] IGR: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T19:20:37.747614] [INFO ] [REMOTE    ] IGI: Fetching primary data for 2025-06.
[2025-10-24T19:20:38.285387] [INFO ] [REMOTE    ] IGI: Incremental fetch complete for 2025-06 (0.54 seconds).
[2025-10-24T19:20:38.547633] [INFO ] [REMOTE    ] IGR: Fetching primary data for 2025-03.
[2025-10-24T19:20:39.347749] [INFO ] [REMOTE    ] IGI: Fetching primary data for 2025-07.
[2025-10-24T19:20:39.776910] [INFO ] [REMOTE    ] IGR: Incremental fetch complete for 2025-03 (1.23 seconds).
[2025-10-24T19:20:39.948471] [INFO ] [REMOTE    ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T19:20:40.147721] [INFO ] [REMOTE    ] IH: Fetching primary data for 2025-02.
[2025-10-24T19:20:40.753815] [INFO ] [REMOTE    ] IH: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T19:20:40.947685] [INFO ] [REMOTE    ] IGR: Fetching primary data for 2025-04.
[2025-10-24T19:20:41.747676] [INFO ] [REMOTE    ] IGD: Fetching primary data for 2025-06.
[2025-10-24T19:20:42.410980] [INFO ] [REMOTE    ] IGR: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T19:20:42.429268] [INFO ] [REMOTE    ] IGD: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T19:20:42.547617] [INFO ] [REMOTE    ] IGD: Fetching primary data for 2025-07.
[2025-10-24T19:20:43.347611] [INFO ] [REMOTE    ] IGI: Fetching primary data for 2025-08.
[2025-10-24T19:20:43.615380] [INFO ] [REMOTE    ] IGD: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T19:20:44.024975] [INFO ] [REMOTE    ] IGI: Incremental fetch complete for 2025-08 (0.68 seconds).
[2025-10-24T19:20:44.147672] [INFO ] [REMOTE    ] IGI: Fetching primary data for 2025-09.
[2025-10-24T19:20:44.758935] [INFO ] [REMOTE    ] IGI: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T19:20:44.947722] [INFO ] [REMOTE    ] IGR: Fetching primary data for 2025-05.
[2025-10-24T19:20:45.747689] [INFO ] [REMOTE    ] IGI: Fetching primary data for 2025-10.
[2025-10-24T19:20:46.260092] [INFO ] [REMOTE    ] IGR: Incremental fetch complete for 2025-05 (1.31 seconds).
[2025-10-24T19:20:46.488616] [INFO ] [REMOTE    ] IGI: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T19:20:46.490387] [INFO ] [REMOTE    ] IGI: Full fetch complete (5578 records).
[2025-10-24T19:20:46.490466] [DEBUG] [VALIDATOR ] IGI: Validating primary data.
[2025-10-24T19:20:46.553961] [INFO ] [REMOTE    ] IH: Fetching primary data for 2025-03.
[2025-10-24T19:20:46.857632] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present.
[2025-10-24T19:20:46.857791] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed.
[2025-10-24T19:20:46.858019] [INFO ] [MAIN      ] IGI: Fetched primary data is valid.
[2025-10-24T19:20:46.858077] [DEBUG] [LOCAL     ] IGI: Saving primary data.
[2025-10-24T19:20:46.858321] [FATAL] [LOCAL     ] IGI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:20:46.858417] [FATAL] [MAIN      ] IGI: Failed to save primary data.
[2025-10-24T19:20:46.858502] [WARN ] [MAIN      ] IGI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:20:46.858592] [INFO ] [LOCAL     ] IGI: Starting deletion of primary data.
[2025-10-24T19:20:46.858697] [DEBUG] [LOCAL     ] IGI: No primary data file found to delete.
[2025-10-24T19:20:46.858751] [INFO ] [LOCAL     ] IGI: Starting deletion of derivative data.
[2025-10-24T19:20:46.858886] [DEBUG] [LOCAL     ] IGI: Deleted derivative data file.
[2025-10-24T19:20:46.859009] [INFO ] [MAIN      ] Update Progress: 1096/2366 symbols completed. IGI took 19.1s. Estimated remaining: 2h 43m 5s. Rate: 7.8 symbols/min
[2025-10-24T19:20:47.032456] [INFO ] [MAIN      ] IHD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:20:47.042165] [DEBUG] [LOCAL     ] IHD: Loaded 7400 existing records from primary storage.
[2025-10-24T19:20:47.042398] [INFO ] [MAIN      ] IHD: Loaded 7400 existing records.
[2025-10-24T19:20:47.231467] [WARN ] [MAIN      ] IHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:20:47.231871] [INFO ] [MAIN      ] IHD: Wiping existing primary data before full refresh.
[2025-10-24T19:20:47.231934] [INFO ] [LOCAL     ] IHD: Starting deletion of primary data.
[2025-10-24T19:20:47.232078] [DEBUG] [LOCAL     ] IHD: Deleted primary data file.
[2025-10-24T19:20:47.232117] [INFO ] [MAIN      ] IHD: Starting full primary refresh.
[2025-10-24T19:20:47.348901] [INFO ] [REMOTE    ] IH: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T19:20:47.348455] [INFO ] [REMOTE    ] IGR: Fetching primary data for 2025-06.
[2025-10-24T19:20:47.604712] [INFO ] [REMOTE    ] IHD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:20:48.147637] [INFO ] [REMOTE    ] IHD: Fetching primary data for 2025-01.
[2025-10-24T19:20:48.477085] [INFO ] [REMOTE    ] IGR: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T19:20:48.934773] [INFO ] [REMOTE    ] IHD: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T19:20:48.947590] [INFO ] [REMOTE    ] IHD: Fetching primary data for 2025-02.
[2025-10-24T19:20:49.616740] [INFO ] [REMOTE    ] IHD: Incremental fetch complete for 2025-02 (0.67 seconds).
[2025-10-24T19:20:49.747697] [INFO ] [REMOTE    ] IGR: Fetching primary data for 2025-07.
[2025-10-24T19:20:50.547707] [INFO ] [REMOTE    ] IHD: Fetching primary data for 2025-03.
[2025-10-24T19:20:51.239695] [INFO ] [REMOTE    ] IGR: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T19:20:51.272012] [INFO ] [REMOTE    ] IHD: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T19:20:51.347614] [INFO ] [REMOTE    ] IGD: Fetching primary data for 2025-08.
[2025-10-24T19:20:52.147667] [INFO ] [REMOTE    ] IHD: Fetching primary data for 2025-04.
[2025-10-24T19:20:52.330179] [INFO ] [REMOTE    ] IGD: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T19:20:52.776050] [INFO ] [REMOTE    ] IHD: Incremental fetch complete for 2025-04 (0.63 seconds).
[2025-10-24T19:20:52.947717] [INFO ] [REMOTE    ] IGR: Fetching primary data for 2025-08.
[2025-10-24T19:20:53.747635] [INFO ] [REMOTE    ] IH: Fetching primary data for 2025-04.
[2025-10-24T19:20:54.292796] [INFO ] [REMOTE    ] IH: Incremental fetch complete for 2025-04 (0.55 seconds).
[2025-10-24T19:20:54.370318] [INFO ] [REMOTE    ] IGR: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T19:20:54.547634] [INFO ] [REMOTE    ] IGR: Fetching primary data for 2025-09.
[2025-10-24T19:20:55.347685] [INFO ] [REMOTE    ] IGD: Fetching primary data for 2025-09.
[2025-10-24T19:20:55.953169] [INFO ] [REMOTE    ] IGR: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T19:20:55.975207] [INFO ] [REMOTE    ] IGD: Incremental fetch complete for 2025-09 (0.63 seconds).
[2025-10-24T19:20:56.147717] [INFO ] [REMOTE    ] IGD: Fetching primary data for 2025-10.
[2025-10-24T19:20:56.947709] [INFO ] [REMOTE    ] IH: Fetching primary data for 2025-05.
[2025-10-24T19:20:57.323944] [INFO ] [REMOTE    ] IH: Incremental fetch complete for 2025-05 (0.38 seconds).
[2025-10-24T19:20:57.341752] [INFO ] [REMOTE    ] IGD: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T19:20:57.348120] [INFO ] [REMOTE    ] IGD: Full fetch complete (30107 records).
[2025-10-24T19:20:57.348246] [DEBUG] [VALIDATOR ] IGD: Validating primary data.
[2025-10-24T19:20:57.714402] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present.
[2025-10-24T19:20:57.714488] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed.
[2025-10-24T19:20:57.715107] [INFO ] [MAIN      ] IGD: Fetched primary data is valid.
[2025-10-24T19:20:57.715168] [DEBUG] [LOCAL     ] IGD: Saving primary data.
[2025-10-24T19:20:57.715542] [FATAL] [LOCAL     ] IGD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:20:57.715629] [FATAL] [MAIN      ] IGD: Failed to save primary data.
[2025-10-24T19:20:57.715707] [WARN ] [MAIN      ] IGD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:20:57.715749] [INFO ] [LOCAL     ] IGD: Starting deletion of primary data.
[2025-10-24T19:20:57.715800] [DEBUG] [LOCAL     ] IGD: No primary data file found to delete.
[2025-10-24T19:20:57.715835] [INFO ] [LOCAL     ] IGD: Starting deletion of derivative data.
[2025-10-24T19:20:57.715963] [DEBUG] [LOCAL     ] IGD: Deleted derivative data file.
[2025-10-24T19:20:57.716051] [INFO ] [MAIN      ] Update Progress: 1097/2366 symbols completed. IGD took 40.8s. Estimated remaining: 2h 43m 0s. Rate: 7.8 symbols/min
[2025-10-24T19:20:57.752838] [INFO ] [REMOTE    ] IHD: Fetching primary data for 2025-05.
[2025-10-24T19:20:57.885413] [INFO ] [MAIN      ] IHG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:20:57.909790] [DEBUG] [LOCAL     ] IHG: Loaded 24115 existing records from primary storage.
[2025-10-24T19:20:57.910032] [INFO ] [MAIN      ] IHG: Loaded 24115 existing records.
[2025-10-24T19:20:58.084070] [WARN ] [MAIN      ] IHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:20:58.084285] [INFO ] [MAIN      ] IHG: Wiping existing primary data before full refresh.
[2025-10-24T19:20:58.084341] [INFO ] [LOCAL     ] IHG: Starting deletion of primary data.
[2025-10-24T19:20:58.084496] [DEBUG] [LOCAL     ] IHG: Deleted primary data file.
[2025-10-24T19:20:58.084534] [INFO ] [MAIN      ] IHG: Starting full primary refresh.
[2025-10-24T19:20:58.439615] [INFO ] [REMOTE    ] IHG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:20:58.547600] [INFO ] [REMOTE    ] IGR: Fetching primary data for 2025-10.
[2025-10-24T19:20:58.556150] [INFO ] [REMOTE    ] IHD: Incremental fetch complete for 2025-05 (0.80 seconds).
[2025-10-24T19:20:59.347709] [INFO ] [REMOTE    ] IHD: Fetching primary data for 2025-06.
[2025-10-24T19:20:59.844211] [INFO ] [REMOTE    ] IGR: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T19:20:59.850106] [INFO ] [REMOTE    ] IGR: Full fetch complete (44602 records).
[2025-10-24T19:20:59.850243] [DEBUG] [VALIDATOR ] IGR: Validating primary data.
[2025-10-24T19:20:59.967961] [INFO ] [REMOTE    ] IHD: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T19:21:00.152826] [INFO ] [REMOTE    ] IHD: Fetching primary data for 2025-07.
[2025-10-24T19:21:00.259042] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present.
[2025-10-24T19:21:00.259135] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed.
[2025-10-24T19:21:00.259955] [INFO ] [MAIN      ] IGR: Fetched primary data is valid.
[2025-10-24T19:21:00.260037] [DEBUG] [LOCAL     ] IGR: Saving primary data.
[2025-10-24T19:21:00.260561] [FATAL] [LOCAL     ] IGR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:21:00.260687] [FATAL] [MAIN      ] IGR: Failed to save primary data.
[2025-10-24T19:21:00.260738] [WARN ] [MAIN      ] IGR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:21:00.260776] [INFO ] [LOCAL     ] IGR: Starting deletion of primary data.
[2025-10-24T19:21:00.260847] [DEBUG] [LOCAL     ] IGR: No primary data file found to delete.
[2025-10-24T19:21:00.260889] [INFO ] [LOCAL     ] IGR: Starting deletion of derivative data.
[2025-10-24T19:21:00.261002] [DEBUG] [LOCAL     ] IGR: Deleted derivative data file.
[2025-10-24T19:21:00.261080] [INFO ] [MAIN      ] Update Progress: 1098/2366 symbols completed. IGR took 30.5s. Estimated remaining: 2h 42m 47s. Rate: 7.8 symbols/min
[2025-10-24T19:21:00.431922] [INFO ] [MAIN      ] IHS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:21:00.466778] [DEBUG] [LOCAL     ] IHS: Loaded 37440 existing records from primary storage.
[2025-10-24T19:21:00.467051] [INFO ] [MAIN      ] IHS: Loaded 37440 existing records.
[2025-10-24T19:21:00.648049] [WARN ] [MAIN      ] IHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:21:00.648289] [INFO ] [MAIN      ] IHS: Wiping existing primary data before full refresh.
[2025-10-24T19:21:00.648350] [INFO ] [LOCAL     ] IHS: Starting deletion of primary data.
[2025-10-24T19:21:00.648558] [DEBUG] [LOCAL     ] IHS: Deleted primary data file.
[2025-10-24T19:21:00.648613] [INFO ] [MAIN      ] IHS: Starting full primary refresh.
[2025-10-24T19:21:00.940590] [INFO ] [REMOTE    ] IHD: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T19:21:00.948534] [INFO ] [REMOTE    ] IHG: Fetching primary data for 2025-01.
[2025-10-24T19:21:01.024236] [INFO ] [REMOTE    ] IHS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:21:01.747708] [INFO ] [REMOTE    ] IH: Fetching primary data for 2025-06.
[2025-10-24T19:21:02.082719] [INFO ] [REMOTE    ] IHG: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T19:21:02.085364] [INFO ] [REMOTE    ] IH: Incremental fetch complete for 2025-06 (0.34 seconds).
[2025-10-24T19:21:02.547719] [INFO ] [REMOTE    ] IHD: Fetching primary data for 2025-08.
[2025-10-24T19:21:03.178928] [INFO ] [REMOTE    ] IHD: Incremental fetch complete for 2025-08 (0.63 seconds).
[2025-10-24T19:21:03.347720] [INFO ] [REMOTE    ] IHS: Fetching primary data for 2025-01.
[2025-10-24T19:21:04.147749] [INFO ] [REMOTE    ] IHD: Fetching primary data for 2025-09.
[2025-10-24T19:21:04.501899] [INFO ] [REMOTE    ] IHS: Incremental fetch complete for 2025-01 (1.15 seconds).
[2025-10-24T19:21:04.888360] [INFO ] [REMOTE    ] IHD: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T19:21:04.947696] [INFO ] [REMOTE    ] IHG: Fetching primary data for 2025-02.
[2025-10-24T19:21:05.747683] [INFO ] [REMOTE    ] IHD: Fetching primary data for 2025-10.
[2025-10-24T19:21:06.126532] [INFO ] [REMOTE    ] IHG: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T19:21:06.327001] [INFO ] [REMOTE    ] IHD: Incremental fetch complete for 2025-10 (0.58 seconds).
[2025-10-24T19:21:06.329210] [INFO ] [REMOTE    ] IHD: Full fetch complete (11694 records).
[2025-10-24T19:21:06.329285] [DEBUG] [VALIDATOR ] IHD: Validating primary data.
[2025-10-24T19:21:06.552858] [INFO ] [REMOTE    ] IHS: Fetching primary data for 2025-02.
[2025-10-24T19:21:06.720405] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present.
[2025-10-24T19:21:06.720476] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed.
[2025-10-24T19:21:06.720774] [INFO ] [MAIN      ] IHD: Fetched primary data is valid.
[2025-10-24T19:21:06.720833] [DEBUG] [LOCAL     ] IHD: Saving primary data.
[2025-10-24T19:21:06.721036] [FATAL] [LOCAL     ] IHD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:21:06.721115] [FATAL] [MAIN      ] IHD: Failed to save primary data.
[2025-10-24T19:21:06.721155] [WARN ] [MAIN      ] IHD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:21:06.721188] [INFO ] [LOCAL     ] IHD: Starting deletion of primary data.
[2025-10-24T19:21:06.721235] [DEBUG] [LOCAL     ] IHD: No primary data file found to delete.
[2025-10-24T19:21:06.721268] [INFO ] [LOCAL     ] IHD: Starting deletion of derivative data.
[2025-10-24T19:21:06.721409] [DEBUG] [LOCAL     ] IHD: Deleted derivative data file.
[2025-10-24T19:21:06.721492] [INFO ] [MAIN      ] Update Progress: 1099/2366 symbols completed. IHD took 19.9s. Estimated remaining: 2h 42m 38s. Rate: 7.8 symbols/min
[2025-10-24T19:21:06.890628] [INFO ] [MAIN      ] IIF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:21:06.900526] [DEBUG] [LOCAL     ] IIF: Loaded 5300 existing records from primary storage.
[2025-10-24T19:21:06.900769] [INFO ] [MAIN      ] IIF: Loaded 5300 existing records.
[2025-10-24T19:21:07.086496] [WARN ] [MAIN      ] IIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:21:07.086787] [INFO ] [MAIN      ] IIF: Wiping existing primary data before full refresh.
[2025-10-24T19:21:07.086841] [INFO ] [LOCAL     ] IIF: Starting deletion of primary data.
[2025-10-24T19:21:07.086994] [DEBUG] [LOCAL     ] IIF: Deleted primary data file.
[2025-10-24T19:21:07.087050] [INFO ] [MAIN      ] IIF: Starting full primary refresh.
[2025-10-24T19:21:07.357789] [INFO ] [REMOTE    ] IH: Fetching primary data for 2025-07.
[2025-10-24T19:21:07.446530] [INFO ] [REMOTE    ] IIF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:21:07.704969] [INFO ] [REMOTE    ] IHS: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T19:21:07.988416] [INFO ] [REMOTE    ] IH: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T19:21:08.147726] [INFO ] [REMOTE    ] IHS: Fetching primary data for 2025-03.
[2025-10-24T19:21:08.947691] [INFO ] [REMOTE    ] IIF: Fetching primary data for 2025-01.
[2025-10-24T19:21:09.610445] [INFO ] [REMOTE    ] IHS: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T19:21:09.752855] [INFO ] [REMOTE    ] IIF: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T19:21:09.750209] [INFO ] [REMOTE    ] IHS: Fetching primary data for 2025-04.
[2025-10-24T19:21:10.547620] [INFO ] [REMOTE    ] IHG: Fetching primary data for 2025-03.
[2025-10-24T19:21:11.126263] [INFO ] [REMOTE    ] IHS: Incremental fetch complete for 2025-04 (1.38 seconds).
[2025-10-24T19:21:11.347754] [INFO ] [REMOTE    ] IH: Fetching primary data for 2025-08.
[2025-10-24T19:21:11.778220] [INFO ] [REMOTE    ] IHG: Incremental fetch complete for 2025-03 (1.23 seconds).
[2025-10-24T19:21:11.809976] [INFO ] [REMOTE    ] IH: Incremental fetch complete for 2025-08 (0.46 seconds).
[2025-10-24T19:21:12.147685] [INFO ] [REMOTE    ] IIF: Fetching primary data for 2025-02.
[2025-10-24T19:21:12.851834] [INFO ] [REMOTE    ] IIF: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T19:21:12.947670] [INFO ] [REMOTE    ] IHS: Fetching primary data for 2025-05.
[2025-10-24T19:21:13.747726] [INFO ] [REMOTE    ] IIF: Fetching primary data for 2025-03.
[2025-10-24T19:21:14.063766] [INFO ] [REMOTE    ] IHS: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T19:21:14.386730] [INFO ] [REMOTE    ] IIF: Incremental fetch complete for 2025-03 (0.64 seconds).
[2025-10-24T19:21:14.547692] [INFO ] [REMOTE    ] IH: Fetching primary data for 2025-09.
[2025-10-24T19:21:15.278611] [INFO ] [REMOTE    ] IH: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T19:21:15.347709] [INFO ] [REMOTE    ] IIF: Fetching primary data for 2025-04.
[2025-10-24T19:21:16.155264] [INFO ] [REMOTE    ] IHG: Fetching primary data for 2025-04.
[2025-10-24T19:21:16.156366] [INFO ] [REMOTE    ] IIF: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T19:21:16.947724] [INFO ] [REMOTE    ] IIF: Fetching primary data for 2025-05.
[2025-10-24T19:21:17.489941] [INFO ] [REMOTE    ] IHG: Incremental fetch complete for 2025-04 (1.33 seconds).
[2025-10-24T19:21:17.565106] [INFO ] [REMOTE    ] IIF: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T19:21:17.747702] [INFO ] [REMOTE    ] IIF: Fetching primary data for 2025-06.
[2025-10-24T19:21:18.344566] [INFO ] [REMOTE    ] IIF: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T19:21:18.547751] [INFO ] [REMOTE    ] IHS: Fetching primary data for 2025-06.
[2025-10-24T19:21:19.347682] [INFO ] [REMOTE    ] IH: Fetching primary data for 2025-10.
[2025-10-24T19:21:20.059961] [INFO ] [REMOTE    ] IHS: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T19:21:20.147625] [INFO ] [REMOTE    ] IHG: Fetching primary data for 2025-05.
[2025-10-24T19:21:20.174124] [INFO ] [REMOTE    ] IH: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T19:21:20.175150] [INFO ] [REMOTE    ] IH: Full fetch complete (5044 records).
[2025-10-24T19:21:20.175217] [DEBUG] [VALIDATOR ] IH: Validating primary data.
[2025-10-24T19:21:20.529952] [DEBUG] [VALIDATOR ] IH: All expected trading days are present.
[2025-10-24T19:21:20.530030] [DEBUG] [VALIDATOR ] IH: Primary data validation passed.
[2025-10-24T19:21:20.530206] [INFO ] [MAIN      ] IH: Fetched primary data is valid.
[2025-10-24T19:21:20.530267] [DEBUG] [LOCAL     ] IH: Saving primary data.
[2025-10-24T19:21:20.530451] [FATAL] [LOCAL     ] IH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:21:20.530530] [FATAL] [MAIN      ] IH: Failed to save primary data.
[2025-10-24T19:21:20.530571] [WARN ] [MAIN      ] IH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:21:20.530604] [INFO ] [LOCAL     ] IH: Starting deletion of primary data.
[2025-10-24T19:21:20.530674] [DEBUG] [LOCAL     ] IH: No primary data file found to delete.
[2025-10-24T19:21:20.530730] [INFO ] [LOCAL     ] IH: Starting deletion of derivative data.
[2025-10-24T19:21:20.530853] [DEBUG] [LOCAL     ] IH: Deleted derivative data file.
[2025-10-24T19:21:20.530922] [INFO ] [MAIN      ] Update Progress: 1100/2366 symbols completed. IH took 44.5s. Estimated remaining: 2h 42m 37s. Rate: 7.8 symbols/min
[2025-10-24T19:21:20.695752] [INFO ] [MAIN      ] IIIN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:21:20.713087] [DEBUG] [LOCAL     ] IIIN: Loaded 16364 existing records from primary storage.
[2025-10-24T19:21:20.713321] [INFO ] [MAIN      ] IIIN: Loaded 16364 existing records.
[2025-10-24T19:21:20.889718] [WARN ] [MAIN      ] IIIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:21:20.889922] [INFO ] [MAIN      ] IIIN: Wiping existing primary data before full refresh.
[2025-10-24T19:21:20.889968] [INFO ] [LOCAL     ] IIIN: Starting deletion of primary data.
[2025-10-24T19:21:20.890209] [DEBUG] [LOCAL     ] IIIN: Deleted primary data file.
[2025-10-24T19:21:20.890246] [INFO ] [MAIN      ] IIIN: Starting full primary refresh.
[2025-10-24T19:21:20.952805] [INFO ] [REMOTE    ] IIF: Fetching primary data for 2025-07.
[2025-10-24T19:21:21.286465] [INFO ] [REMOTE    ] IIIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:21:21.462589] [INFO ] [REMOTE    ] IHG: Incremental fetch complete for 2025-05 (1.31 seconds).
[2025-10-24T19:21:21.747709] [INFO ] [REMOTE    ] IHS: Fetching primary data for 2025-07.
[2025-10-24T19:21:21.873041] [INFO ] [REMOTE    ] IIF: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T19:21:22.547676] [INFO ] [REMOTE    ] IIIN: Fetching primary data for 2025-01.
[2025-10-24T19:21:23.091495] [INFO ] [REMOTE    ] IHS: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T19:21:23.312779] [INFO ] [REMOTE    ] IIIN: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T19:21:23.347612] [INFO ] [REMOTE    ] IIIN: Fetching primary data for 2025-02.
[2025-10-24T19:21:24.147710] [INFO ] [REMOTE    ] IHG: Fetching primary data for 2025-06.
[2025-10-24T19:21:24.336108] [INFO ] [REMOTE    ] IIIN: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T19:21:24.947664] [INFO ] [REMOTE    ] IIF: Fetching primary data for 2025-08.
[2025-10-24T19:21:25.286554] [INFO ] [REMOTE    ] IHG: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T19:21:25.541233] [INFO ] [REMOTE    ] IIF: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T19:21:25.747623] [INFO ] [REMOTE    ] IIF: Fetching primary data for 2025-09.
[2025-10-24T19:21:26.325087] [INFO ] [REMOTE    ] IIF: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T19:21:26.547728] [INFO ] [REMOTE    ] IHS: Fetching primary data for 2025-08.
[2025-10-24T19:21:27.347730] [INFO ] [REMOTE    ] IHG: Fetching primary data for 2025-07.
[2025-10-24T19:21:28.005833] [INFO ] [REMOTE    ] IHS: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T19:21:28.147727] [INFO ] [REMOTE    ] IIF: Fetching primary data for 2025-10.
[2025-10-24T19:21:28.584078] [INFO ] [REMOTE    ] IHG: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T19:21:28.785615] [INFO ] [REMOTE    ] IIF: Incremental fetch complete for 2025-10 (0.64 seconds).
[2025-10-24T19:21:28.786752] [INFO ] [REMOTE    ] IIF: Full fetch complete (8762 records).
[2025-10-24T19:21:28.786825] [DEBUG] [VALIDATOR ] IIF: Validating primary data.
[2025-10-24T19:21:28.964274] [INFO ] [REMOTE    ] IIIN: Fetching primary data for 2025-03.
[2025-10-24T19:21:29.213707] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present.
[2025-10-24T19:21:29.213785] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed.
[2025-10-24T19:21:29.214003] [INFO ] [MAIN      ] IIF: Fetched primary data is valid.
[2025-10-24T19:21:29.214040] [DEBUG] [LOCAL     ] IIF: Saving primary data.
[2025-10-24T19:21:29.214237] [FATAL] [LOCAL     ] IIF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:21:29.214332] [FATAL] [MAIN      ] IIF: Failed to save primary data.
[2025-10-24T19:21:29.214382] [WARN ] [MAIN      ] IIF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:21:29.214422] [INFO ] [LOCAL     ] IIF: Starting deletion of primary data.
[2025-10-24T19:21:29.214472] [DEBUG] [LOCAL     ] IIF: No primary data file found to delete.
[2025-10-24T19:21:29.214505] [INFO ] [LOCAL     ] IIF: Starting deletion of derivative data.
[2025-10-24T19:21:29.214665] [DEBUG] [LOCAL     ] IIF: Deleted derivative data file.
[2025-10-24T19:21:29.214771] [INFO ] [MAIN      ] Update Progress: 1101/2366 symbols completed. IIF took 22.5s. Estimated remaining: 2h 42m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:21:29.386522] [INFO ] [MAIN      ] IIM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:21:29.405080] [DEBUG] [LOCAL     ] IIM: Loaded 15593 existing records from primary storage.
[2025-10-24T19:21:29.405346] [INFO ] [MAIN      ] IIM: Loaded 15593 existing records.
[2025-10-24T19:21:29.583974] [WARN ] [MAIN      ] IIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:21:29.584172] [INFO ] [MAIN      ] IIM: Wiping existing primary data before full refresh.
[2025-10-24T19:21:29.584262] [INFO ] [LOCAL     ] IIM: Starting deletion of primary data.
[2025-10-24T19:21:29.584558] [DEBUG] [LOCAL     ] IIM: Deleted primary data file.
[2025-10-24T19:21:29.584615] [INFO ] [MAIN      ] IIM: Starting full primary refresh.
[2025-10-24T19:21:29.767299] [INFO ] [REMOTE    ] IHS: Fetching primary data for 2025-09.
[2025-10-24T19:21:29.972162] [INFO ] [REMOTE    ] IIM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:21:30.088035] [INFO ] [REMOTE    ] IIIN: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T19:21:30.547639] [INFO ] [REMOTE    ] IIM: Fetching primary data for 2025-01.
[2025-10-24T19:21:31.045831] [INFO ] [REMOTE    ] IHS: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T19:21:31.347694] [INFO ] [REMOTE    ] IIIN: Fetching primary data for 2025-04.
[2025-10-24T19:21:31.627836] [INFO ] [REMOTE    ] IIM: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T19:21:32.147711] [INFO ] [REMOTE    ] IIM: Fetching primary data for 2025-02.
[2025-10-24T19:21:32.458199] [INFO ] [REMOTE    ] IIIN: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T19:21:32.947707] [INFO ] [REMOTE    ] IHG: Fetching primary data for 2025-08.
[2025-10-24T19:21:33.215189] [INFO ] [REMOTE    ] IIM: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T19:21:33.747784] [INFO ] [REMOTE    ] IIM: Fetching primary data for 2025-03.
[2025-10-24T19:21:34.145328] [INFO ] [REMOTE    ] IHG: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T19:21:34.547714] [INFO ] [REMOTE    ] IHG: Fetching primary data for 2025-09.
[2025-10-24T19:21:34.797510] [INFO ] [REMOTE    ] IIM: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T19:21:35.316418] [INFO ] [REMOTE    ] IHG: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T19:21:35.347627] [INFO ] [REMOTE    ] IIM: Fetching primary data for 2025-04.
[2025-10-24T19:21:36.147691] [INFO ] [REMOTE    ] IIIN: Fetching primary data for 2025-05.
[2025-10-24T19:21:36.353933] [INFO ] [REMOTE    ] IIM: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T19:21:36.947676] [INFO ] [REMOTE    ] IHS: Fetching primary data for 2025-10.
[2025-10-24T19:21:37.137796] [INFO ] [REMOTE    ] IIIN: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T19:21:37.747679] [INFO ] [REMOTE    ] IHG: Fetching primary data for 2025-10.
[2025-10-24T19:21:38.010070] [INFO ] [REMOTE    ] IHS: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T19:21:38.018504] [INFO ] [REMOTE    ] IHS: Full fetch complete (51566 records).
[2025-10-24T19:21:38.018997] [DEBUG] [VALIDATOR ] IHS: Validating primary data.
[2025-10-24T19:21:38.548196] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present.
[2025-10-24T19:21:38.547759] [INFO ] [REMOTE    ] IIM: Fetching primary data for 2025-05.
[2025-10-24T19:21:38.548522] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed.
[2025-10-24T19:21:38.552110] [INFO ] [MAIN      ] IHS: Fetched primary data is valid.
[2025-10-24T19:21:38.552360] [DEBUG] [LOCAL     ] IHS: Saving primary data.
[2025-10-24T19:21:38.553679] [FATAL] [LOCAL     ] IHS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:21:38.553827] [FATAL] [MAIN      ] IHS: Failed to save primary data.
[2025-10-24T19:21:38.553895] [WARN ] [MAIN      ] IHS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:21:38.553955] [INFO ] [LOCAL     ] IHS: Starting deletion of primary data.
[2025-10-24T19:21:38.554028] [DEBUG] [LOCAL     ] IHS: No primary data file found to delete.
[2025-10-24T19:21:38.554068] [INFO ] [LOCAL     ] IHS: Starting deletion of derivative data.
[2025-10-24T19:21:38.554319] [DEBUG] [LOCAL     ] IHS: Deleted derivative data file.
[2025-10-24T19:21:38.554497] [INFO ] [MAIN      ] Update Progress: 1102/2366 symbols completed. IHS took 38.3s. Estimated remaining: 2h 42m 25s. Rate: 7.8 symbols/min
[2025-10-24T19:21:38.794947] [INFO ] [MAIN      ] IIPR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:21:38.834340] [DEBUG] [LOCAL     ] IIPR: Loaded 29025 existing records from primary storage.
[2025-10-24T19:21:38.834864] [INFO ] [MAIN      ] IIPR: Loaded 29025 existing records.
[2025-10-24T19:21:39.054905] [WARN ] [MAIN      ] IIPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:21:39.055336] [INFO ] [MAIN      ] IIPR: Wiping existing primary data before full refresh.
[2025-10-24T19:21:39.055547] [INFO ] [LOCAL     ] IIPR: Starting deletion of primary data.
[2025-10-24T19:21:39.067288] [DEBUG] [LOCAL     ] IIPR: Deleted primary data file.
[2025-10-24T19:21:39.067677] [INFO ] [MAIN      ] IIPR: Starting full primary refresh.
[2025-10-24T19:21:39.074635] [INFO ] [REMOTE    ] IHG: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T19:21:39.153469] [INFO ] [REMOTE    ] IHG: Full fetch complete (34436 records).
[2025-10-24T19:21:39.160194] [DEBUG] [VALIDATOR ] IHG: Validating primary data.
[2025-10-24T19:21:39.368624] [INFO ] [REMOTE    ] IIIN: Fetching primary data for 2025-06.
[2025-10-24T19:21:39.609201] [INFO ] [REMOTE    ] IIM: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T19:21:39.850921] [INFO ] [REMOTE    ] IIPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:21:39.851337] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present.
[2025-10-24T19:21:39.851392] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed.
[2025-10-24T19:21:39.852069] [INFO ] [MAIN      ] IHG: Fetched primary data is valid.
[2025-10-24T19:21:39.852129] [DEBUG] [LOCAL     ] IHG: Saving primary data.
[2025-10-24T19:21:39.852422] [FATAL] [LOCAL     ] IHG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:21:39.852500] [FATAL] [MAIN      ] IHG: Failed to save primary data.
[2025-10-24T19:21:39.852558] [WARN ] [MAIN      ] IHG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:21:39.852638] [INFO ] [LOCAL     ] IHG: Starting deletion of primary data.
[2025-10-24T19:21:39.852931] [DEBUG] [LOCAL     ] IHG: No primary data file found to delete.
[2025-10-24T19:21:39.852981] [INFO ] [LOCAL     ] IHG: Starting deletion of derivative data.
[2025-10-24T19:21:39.853148] [DEBUG] [LOCAL     ] IHG: Deleted derivative data file.
[2025-10-24T19:21:39.853259] [INFO ] [MAIN      ] Update Progress: 1103/2366 symbols completed. IHG took 42.1s. Estimated remaining: 2h 42m 10s. Rate: 7.8 symbols/min
[2025-10-24T19:21:40.027520] [INFO ] [MAIN      ] IMAX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:21:40.071143] [DEBUG] [LOCAL     ] IMAX: Loaded 43819 existing records from primary storage.
[2025-10-24T19:21:40.071539] [INFO ] [MAIN      ] IMAX: Loaded 43819 existing records.
[2025-10-24T19:21:40.150191] [INFO ] [REMOTE    ] IIM: Fetching primary data for 2025-06.
[2025-10-24T19:21:40.266833] [WARN ] [MAIN      ] IMAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:21:40.267044] [INFO ] [MAIN      ] IMAX: Wiping existing primary data before full refresh.
[2025-10-24T19:21:40.267089] [INFO ] [LOCAL     ] IMAX: Starting deletion of primary data.
[2025-10-24T19:21:40.267372] [DEBUG] [LOCAL     ] IMAX: Deleted primary data file.
[2025-10-24T19:21:40.267428] [INFO ] [MAIN      ] IMAX: Starting full primary refresh.
[2025-10-24T19:21:40.459700] [INFO ] [REMOTE    ] IIIN: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T19:21:40.650221] [INFO ] [REMOTE    ] IMAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:21:40.947732] [INFO ] [REMOTE    ] IMAX: Fetching primary data for 2025-01.
[2025-10-24T19:21:41.143330] [INFO ] [REMOTE    ] IIM: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T19:21:41.747723] [INFO ] [REMOTE    ] IIM: Fetching primary data for 2025-07.
[2025-10-24T19:21:42.275788] [INFO ] [REMOTE    ] IMAX: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T19:21:42.293709] [INFO ] [REMOTE    ] IIM: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T19:21:42.547727] [INFO ] [REMOTE    ] IIPR: Fetching primary data for 2025-01.
[2025-10-24T19:21:43.347667] [INFO ] [REMOTE    ] IIIN: Fetching primary data for 2025-07.
[2025-10-24T19:21:43.886847] [INFO ] [REMOTE    ] IIPR: Incremental fetch complete for 2025-01 (1.34 seconds).
[2025-10-24T19:21:44.147681] [INFO ] [REMOTE    ] IMAX: Fetching primary data for 2025-02.
[2025-10-24T19:21:44.377570] [INFO ] [REMOTE    ] IIIN: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T19:21:44.947713] [INFO ] [REMOTE    ] IIIN: Fetching primary data for 2025-08.
[2025-10-24T19:21:45.486363] [INFO ] [REMOTE    ] IMAX: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T19:21:45.747691] [INFO ] [REMOTE    ] IIM: Fetching primary data for 2025-08.
[2025-10-24T19:21:45.800849] [INFO ] [REMOTE    ] IIIN: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T19:21:46.547729] [INFO ] [REMOTE    ] IIIN: Fetching primary data for 2025-09.
[2025-10-24T19:21:46.738625] [INFO ] [REMOTE    ] IIM: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T19:21:47.352149] [INFO ] [REMOTE    ] IIM: Fetching primary data for 2025-09.
[2025-10-24T19:21:47.355058] [INFO ] [REMOTE    ] IIIN: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T19:21:48.147675] [INFO ] [REMOTE    ] IIIN: Fetching primary data for 2025-10.
[2025-10-24T19:21:48.342199] [INFO ] [REMOTE    ] IIM: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T19:21:48.947715] [INFO ] [REMOTE    ] IMAX: Fetching primary data for 2025-03.
[2025-10-24T19:21:49.214764] [INFO ] [REMOTE    ] IIIN: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T19:21:49.218750] [INFO ] [REMOTE    ] IIIN: Full fetch complete (24955 records).
[2025-10-24T19:21:49.218898] [DEBUG] [VALIDATOR ] IIIN: Validating primary data.
[2025-10-24T19:21:49.601598] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present.
[2025-10-24T19:21:49.601704] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed.
[2025-10-24T19:21:49.602231] [INFO ] [MAIN      ] IIIN: Fetched primary data is valid.
[2025-10-24T19:21:49.602273] [DEBUG] [LOCAL     ] IIIN: Saving primary data.
[2025-10-24T19:21:49.602572] [FATAL] [LOCAL     ] IIIN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:21:49.602691] [FATAL] [MAIN      ] IIIN: Failed to save primary data.
[2025-10-24T19:21:49.602763] [WARN ] [MAIN      ] IIIN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:21:49.602860] [INFO ] [LOCAL     ] IIIN: Starting deletion of primary data.
[2025-10-24T19:21:49.602933] [DEBUG] [LOCAL     ] IIIN: No primary data file found to delete.
[2025-10-24T19:21:49.602971] [INFO ] [LOCAL     ] IIIN: Starting deletion of derivative data.
[2025-10-24T19:21:49.603105] [DEBUG] [LOCAL     ] IIIN: Deleted derivative data file.
[2025-10-24T19:21:49.603197] [INFO ] [MAIN      ] Update Progress: 1104/2366 symbols completed. IIIN took 29.1s. Estimated remaining: 2h 42m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:21:49.757426] [INFO ] [REMOTE    ] IIPR: Fetching primary data for 2025-02.
[2025-10-24T19:21:49.798072] [INFO ] [MAIN      ] INFA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:21:49.853184] [DEBUG] [LOCAL     ] INFA: Loaded 48954 existing records from primary storage.
[2025-10-24T19:21:49.853613] [INFO ] [MAIN      ] INFA: Loaded 48954 existing records.
[2025-10-24T19:21:50.047160] [WARN ] [MAIN      ] INFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:21:50.047395] [INFO ] [MAIN      ] INFA: Wiping existing primary data before full refresh.
[2025-10-24T19:21:50.047441] [INFO ] [LOCAL     ] INFA: Starting deletion of primary data.
[2025-10-24T19:21:50.047627] [DEBUG] [LOCAL     ] INFA: Deleted primary data file.
[2025-10-24T19:21:50.047707] [INFO ] [MAIN      ] INFA: Starting full primary refresh.
[2025-10-24T19:21:50.402710] [INFO ] [REMOTE    ] INFA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:21:50.530692] [INFO ] [REMOTE    ] IMAX: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T19:21:50.547597] [INFO ] [REMOTE    ] INFA: Fetching primary data for 2025-01.
[2025-10-24T19:21:50.988382] [INFO ] [REMOTE    ] IIPR: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T19:21:51.347638] [INFO ] [REMOTE    ] IIM: Fetching primary data for 2025-10.
[2025-10-24T19:21:52.101174] [INFO ] [REMOTE    ] INFA: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T19:21:52.147621] [INFO ] [REMOTE    ] IMAX: Fetching primary data for 2025-04.
[2025-10-24T19:21:52.455224] [INFO ] [REMOTE    ] IIM: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T19:21:52.458438] [INFO ] [REMOTE    ] IIM: Full fetch complete (24725 records).
[2025-10-24T19:21:52.458509] [DEBUG] [VALIDATOR ] IIM: Validating primary data.
[2025-10-24T19:21:52.820008] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present.
[2025-10-24T19:21:52.820082] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed.
[2025-10-24T19:21:52.820558] [INFO ] [MAIN      ] IIM: Fetched primary data is valid.
[2025-10-24T19:21:52.820597] [DEBUG] [LOCAL     ] IIM: Saving primary data.
[2025-10-24T19:21:52.820879] [FATAL] [LOCAL     ] IIM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:21:52.820963] [FATAL] [MAIN      ] IIM: Failed to save primary data.
[2025-10-24T19:21:52.821005] [WARN ] [MAIN      ] IIM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:21:52.821039] [INFO ] [LOCAL     ] IIM: Starting deletion of primary data.
[2025-10-24T19:21:52.821088] [DEBUG] [LOCAL     ] IIM: No primary data file found to delete.
[2025-10-24T19:21:52.821123] [INFO ] [LOCAL     ] IIM: Starting deletion of derivative data.
[2025-10-24T19:21:52.821238] [DEBUG] [LOCAL     ] IIM: Deleted derivative data file.
[2025-10-24T19:21:52.821305] [INFO ] [MAIN      ] Update Progress: 1105/2366 symbols completed. IIM took 23.6s. Estimated remaining: 2h 41m 51s. Rate: 7.8 symbols/min
[2025-10-24T19:21:52.960268] [INFO ] [REMOTE    ] INFA: Fetching primary data for 2025-02.
[2025-10-24T19:21:52.990836] [INFO ] [MAIN      ] INFY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:21:53.043066] [DEBUG] [LOCAL     ] INFY: Loaded 53986 existing records from primary storage.
[2025-10-24T19:21:53.043361] [INFO ] [MAIN      ] INFY: Loaded 53986 existing records.
[2025-10-24T19:21:53.220427] [WARN ] [MAIN      ] INFY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:21:53.220634] [INFO ] [MAIN      ] INFY: Wiping existing primary data before full refresh.
[2025-10-24T19:21:53.220723] [INFO ] [LOCAL     ] INFY: Starting deletion of primary data.
[2025-10-24T19:21:53.221120] [DEBUG] [LOCAL     ] INFY: Deleted primary data file.
[2025-10-24T19:21:53.221176] [INFO ] [MAIN      ] INFY: Starting full primary refresh.
[2025-10-24T19:21:53.574535] [INFO ] [REMOTE    ] INFY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:21:53.747612] [INFO ] [REMOTE    ] INFY: Fetching primary data for 2025-01.
[2025-10-24T19:21:53.816584] [INFO ] [REMOTE    ] IMAX: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T19:21:54.547620] [INFO ] [REMOTE    ] IIPR: Fetching primary data for 2025-03.
[2025-10-24T19:21:54.751847] [INFO ] [REMOTE    ] INFA: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T19:21:55.210707] [INFO ] [REMOTE    ] INFY: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T19:21:55.347616] [INFO ] [REMOTE    ] INFY: Fetching primary data for 2025-02.
[2025-10-24T19:21:56.039968] [INFO ] [REMOTE    ] IIPR: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T19:21:56.147632] [INFO ] [REMOTE    ] INFA: Fetching primary data for 2025-03.
[2025-10-24T19:21:56.947624] [INFO ] [REMOTE    ] IIPR: Fetching primary data for 2025-04.
[2025-10-24T19:21:57.072248] [INFO ] [REMOTE    ] INFY: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T19:21:57.747744] [INFO ] [REMOTE    ] INFY: Fetching primary data for 2025-03.
[2025-10-24T19:21:57.895455] [INFO ] [REMOTE    ] INFA: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T19:21:58.454623] [INFO ] [REMOTE    ] IIPR: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T19:21:58.547638] [INFO ] [REMOTE    ] IIPR: Fetching primary data for 2025-05.
[2025-10-24T19:21:59.347625] [INFO ] [REMOTE    ] INFA: Fetching primary data for 2025-04.
[2025-10-24T19:21:59.549467] [INFO ] [REMOTE    ] INFY: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T19:21:59.872118] [INFO ] [REMOTE    ] IIPR: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T19:22:00.147737] [INFO ] [REMOTE    ] INFY: Fetching primary data for 2025-04.
[2025-10-24T19:22:00.927825] [INFO ] [REMOTE    ] INFA: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T19:22:00.947675] [INFO ] [REMOTE    ] INFA: Fetching primary data for 2025-05.
[2025-10-24T19:22:01.747710] [INFO ] [REMOTE    ] IIPR: Fetching primary data for 2025-06.
[2025-10-24T19:22:02.224390] [INFO ] [REMOTE    ] INFY: Incremental fetch complete for 2025-04 (2.08 seconds).
[2025-10-24T19:22:02.547725] [INFO ] [REMOTE    ] INFY: Fetching primary data for 2025-05.
[2025-10-24T19:22:02.771920] [INFO ] [REMOTE    ] INFA: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T19:22:02.998367] [INFO ] [REMOTE    ] IIPR: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T19:22:03.347738] [INFO ] [REMOTE    ] IMAX: Fetching primary data for 2025-05.
[2025-10-24T19:22:04.147681] [INFO ] [REMOTE    ] INFA: Fetching primary data for 2025-06.
[2025-10-24T19:22:04.376671] [INFO ] [REMOTE    ] INFY: Incremental fetch complete for 2025-05 (1.83 seconds).
[2025-10-24T19:22:04.849275] [INFO ] [REMOTE    ] IMAX: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T19:22:04.947632] [INFO ] [REMOTE    ] INFY: Fetching primary data for 2025-06.
[2025-10-24T19:22:05.747702] [INFO ] [REMOTE    ] IMAX: Fetching primary data for 2025-06.
[2025-10-24T19:22:05.812303] [INFO ] [REMOTE    ] INFA: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T19:22:06.547613] [INFO ] [REMOTE    ] INFA: Fetching primary data for 2025-07.
[2025-10-24T19:22:06.690538] [INFO ] [REMOTE    ] INFY: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T19:22:07.311248] [INFO ] [REMOTE    ] IMAX: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T19:22:07.347611] [INFO ] [REMOTE    ] IMAX: Fetching primary data for 2025-07.
[2025-10-24T19:22:08.151031] [INFO ] [REMOTE    ] IIPR: Fetching primary data for 2025-07.
[2025-10-24T19:22:08.157925] [INFO ] [REMOTE    ] INFA: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T19:22:08.660481] [INFO ] [REMOTE    ] IMAX: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T19:22:08.947719] [INFO ] [REMOTE    ] INFA: Fetching primary data for 2025-08.
[2025-10-24T19:22:09.473408] [INFO ] [REMOTE    ] IIPR: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T19:22:09.747709] [INFO ] [REMOTE    ] IIPR: Fetching primary data for 2025-08.
[2025-10-24T19:22:10.548371] [INFO ] [REMOTE    ] INFY: Fetching primary data for 2025-07.
[2025-10-24T19:22:10.548294] [INFO ] [REMOTE    ] INFA: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T19:22:11.045293] [INFO ] [REMOTE    ] IIPR: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T19:22:11.347720] [INFO ] [REMOTE    ] IMAX: Fetching primary data for 2025-08.
[2025-10-24T19:22:12.147699] [INFO ] [REMOTE    ] INFA: Fetching primary data for 2025-09.
[2025-10-24T19:22:12.417617] [INFO ] [REMOTE    ] INFY: Incremental fetch complete for 2025-07 (1.87 seconds).
[2025-10-24T19:22:12.834635] [INFO ] [REMOTE    ] IMAX: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T19:22:12.947686] [INFO ] [REMOTE    ] IIPR: Fetching primary data for 2025-09.
[2025-10-24T19:22:13.647382] [INFO ] [REMOTE    ] INFA: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T19:22:13.747718] [INFO ] [REMOTE    ] INFA: Fetching primary data for 2025-10.
[2025-10-24T19:22:14.403115] [INFO ] [REMOTE    ] IIPR: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T19:22:14.547691] [INFO ] [REMOTE    ] IMAX: Fetching primary data for 2025-09.
[2025-10-24T19:22:15.300412] [INFO ] [REMOTE    ] INFA: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T19:22:15.308025] [INFO ] [REMOTE    ] INFA: Full fetch complete (70681 records).
[2025-10-24T19:22:15.308156] [DEBUG] [VALIDATOR ] INFA: Validating primary data.
[2025-10-24T19:22:15.355920] [INFO ] [REMOTE    ] INFY: Fetching primary data for 2025-08.
[2025-10-24T19:22:15.731434] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present.
[2025-10-24T19:22:15.731533] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed.
[2025-10-24T19:22:15.732560] [INFO ] [MAIN      ] INFA: Fetched primary data is valid.
[2025-10-24T19:22:15.732639] [DEBUG] [LOCAL     ] INFA: Saving primary data.
[2025-10-24T19:22:15.733259] [FATAL] [LOCAL     ] INFA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:22:15.733355] [FATAL] [MAIN      ] INFA: Failed to save primary data.
[2025-10-24T19:22:15.733421] [WARN ] [MAIN      ] INFA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:22:15.733556] [INFO ] [LOCAL     ] INFA: Starting deletion of primary data.
[2025-10-24T19:22:15.733701] [DEBUG] [LOCAL     ] INFA: No primary data file found to delete.
[2025-10-24T19:22:15.733753] [INFO ] [LOCAL     ] INFA: Starting deletion of derivative data.
[2025-10-24T19:22:15.733895] [DEBUG] [LOCAL     ] INFA: Deleted derivative data file.
[2025-10-24T19:22:15.734453] [INFO ] [MAIN      ] Update Progress: 1106/2366 symbols completed. INFA took 26.1s. Estimated remaining: 2h 42m 1s. Rate: 7.8 symbols/min
[2025-10-24T19:22:15.918472] [INFO ] [MAIN      ] ING: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:22:15.954248] [INFO ] [REMOTE    ] IMAX: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T19:22:16.012351] [DEBUG] [LOCAL     ] ING: Loaded 51066 existing records from primary storage.
[2025-10-24T19:22:16.012707] [INFO ] [MAIN      ] ING: Loaded 51066 existing records.
[2025-10-24T19:22:16.152779] [INFO ] [REMOTE    ] IIPR: Fetching primary data for 2025-10.
[2025-10-24T19:22:16.190778] [WARN ] [MAIN      ] ING: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:22:16.191211] [INFO ] [MAIN      ] ING: Wiping existing primary data before full refresh.
[2025-10-24T19:22:16.191264] [INFO ] [LOCAL     ] ING: Starting deletion of primary data.
[2025-10-24T19:22:16.191813] [DEBUG] [LOCAL     ] ING: Deleted primary data file.
[2025-10-24T19:22:16.191868] [INFO ] [MAIN      ] ING: Starting full primary refresh.
[2025-10-24T19:22:16.540084] [INFO ] [REMOTE    ] ING: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:22:16.947715] [INFO ] [REMOTE    ] IMAX: Fetching primary data for 2025-10.
[2025-10-24T19:22:17.062207] [INFO ] [REMOTE    ] INFY: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T19:22:17.376686] [INFO ] [REMOTE    ] IIPR: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T19:22:17.385823] [INFO ] [REMOTE    ] IIPR: Full fetch complete (43624 records).
[2025-10-24T19:22:17.385948] [DEBUG] [VALIDATOR ] IIPR: Validating primary data.
[2025-10-24T19:22:17.760625] [INFO ] [REMOTE    ] INFY: Fetching primary data for 2025-09.
[2025-10-24T19:22:17.777276] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present.
[2025-10-24T19:22:17.777359] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed.
[2025-10-24T19:22:17.778169] [INFO ] [MAIN      ] IIPR: Fetched primary data is valid.
[2025-10-24T19:22:17.778231] [DEBUG] [LOCAL     ] IIPR: Saving primary data.
[2025-10-24T19:22:17.778687] [FATAL] [LOCAL     ] IIPR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:22:17.778807] [FATAL] [MAIN      ] IIPR: Failed to save primary data.
[2025-10-24T19:22:17.778848] [WARN ] [MAIN      ] IIPR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:22:17.778882] [INFO ] [LOCAL     ] IIPR: Starting deletion of primary data.
[2025-10-24T19:22:17.778933] [DEBUG] [LOCAL     ] IIPR: No primary data file found to delete.
[2025-10-24T19:22:17.778967] [INFO ] [LOCAL     ] IIPR: Starting deletion of derivative data.
[2025-10-24T19:22:17.779160] [DEBUG] [LOCAL     ] IIPR: Deleted derivative data file.
[2025-10-24T19:22:17.779253] [INFO ] [MAIN      ] Update Progress: 1107/2366 symbols completed. IIPR took 39.2s. Estimated remaining: 2h 41m 47s. Rate: 7.8 symbols/min
[2025-10-24T19:22:17.947220] [INFO ] [MAIN      ] INGM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:22:17.974910] [DEBUG] [LOCAL     ] INGM: Loaded 28324 existing records from primary storage.
[2025-10-24T19:22:17.975166] [INFO ] [MAIN      ] INGM: Loaded 28324 existing records.
[2025-10-24T19:22:18.149451] [WARN ] [MAIN      ] INGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:22:18.149708] [INFO ] [MAIN      ] INGM: Wiping existing primary data before full refresh.
[2025-10-24T19:22:18.149766] [INFO ] [LOCAL     ] INGM: Starting deletion of primary data.
[2025-10-24T19:22:18.150037] [DEBUG] [LOCAL     ] INGM: Deleted primary data file.
[2025-10-24T19:22:18.150077] [INFO ] [MAIN      ] INGM: Starting full primary refresh.
[2025-10-24T19:22:18.495594] [INFO ] [REMOTE    ] INGM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:22:18.547604] [INFO ] [REMOTE    ] INGM: Fetching primary data for 2025-01.
[2025-10-24T19:22:18.759632] [INFO ] [REMOTE    ] IMAX: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T19:22:18.769025] [INFO ] [REMOTE    ] IMAX: Full fetch complete (61256 records).
[2025-10-24T19:22:18.769156] [DEBUG] [VALIDATOR ] IMAX: Validating primary data.
[2025-10-24T19:22:19.153257] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present.
[2025-10-24T19:22:19.153336] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed.
[2025-10-24T19:22:19.154470] [INFO ] [MAIN      ] IMAX: Fetched primary data is valid.
[2025-10-24T19:22:19.154533] [DEBUG] [LOCAL     ] IMAX: Saving primary data.
[2025-10-24T19:22:19.155282] [FATAL] [LOCAL     ] IMAX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:22:19.155366] [FATAL] [MAIN      ] IMAX: Failed to save primary data.
[2025-10-24T19:22:19.155442] [WARN ] [MAIN      ] IMAX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:22:19.155510] [INFO ] [LOCAL     ] IMAX: Starting deletion of primary data.
[2025-10-24T19:22:19.155570] [DEBUG] [LOCAL     ] IMAX: No primary data file found to delete.
[2025-10-24T19:22:19.155606] [INFO ] [LOCAL     ] IMAX: Starting deletion of derivative data.
[2025-10-24T19:22:19.155789] [DEBUG] [LOCAL     ] IMAX: Deleted derivative data file.
[2025-10-24T19:22:19.156000] [INFO ] [MAIN      ] Update Progress: 1108/2366 symbols completed. IMAX took 39.3s. Estimated remaining: 2h 41m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:22:19.329373] [INFO ] [MAIN      ] INGR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:22:19.350266] [INFO ] [REMOTE    ] ING: Fetching primary data for 2025-01.
[2025-10-24T19:22:19.367015] [DEBUG] [LOCAL     ] INGR: Loaded 34005 existing records from primary storage.
[2025-10-24T19:22:19.367317] [INFO ] [MAIN      ] INGR: Loaded 34005 existing records.
[2025-10-24T19:22:19.555260] [WARN ] [MAIN      ] INGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:22:19.555887] [INFO ] [MAIN      ] INGR: Wiping existing primary data before full refresh.
[2025-10-24T19:22:19.555967] [INFO ] [LOCAL     ] INGR: Starting deletion of primary data.
[2025-10-24T19:22:19.556249] [DEBUG] [LOCAL     ] INGR: Deleted primary data file.
[2025-10-24T19:22:19.556420] [INFO ] [MAIN      ] INGR: Starting full primary refresh.
[2025-10-24T19:22:19.935942] [INFO ] [REMOTE    ] INFY: Incremental fetch complete for 2025-09 (2.18 seconds).
[2025-10-24T19:22:19.973510] [INFO ] [REMOTE    ] INGM: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T19:22:20.045208] [INFO ] [REMOTE    ] INGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:22:20.147674] [INFO ] [REMOTE    ] INGM: Fetching primary data for 2025-02.
[2025-10-24T19:22:20.922849] [INFO ] [REMOTE    ] ING: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T19:22:20.947816] [INFO ] [REMOTE    ] ING: Fetching primary data for 2025-02.
[2025-10-24T19:22:21.175314] [INFO ] [REMOTE    ] INGM: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T19:22:21.747716] [INFO ] [REMOTE    ] INGR: Fetching primary data for 2025-01.
[2025-10-24T19:22:22.478123] [INFO ] [REMOTE    ] ING: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T19:22:22.547605] [INFO ] [REMOTE    ] ING: Fetching primary data for 2025-03.
[2025-10-24T19:22:23.071607] [INFO ] [REMOTE    ] INGR: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T19:22:23.347673] [INFO ] [REMOTE    ] INGM: Fetching primary data for 2025-03.
[2025-10-24T19:22:24.147731] [INFO ] [REMOTE    ] INGR: Fetching primary data for 2025-02.
[2025-10-24T19:22:24.230101] [INFO ] [REMOTE    ] ING: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T19:22:24.863754] [INFO ] [REMOTE    ] INGM: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T19:22:24.947699] [INFO ] [REMOTE    ] INGM: Fetching primary data for 2025-04.
[2025-10-24T19:22:25.672197] [INFO ] [REMOTE    ] INGR: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T19:22:25.747614] [INFO ] [REMOTE    ] ING: Fetching primary data for 2025-04.
[2025-10-24T19:22:26.220298] [INFO ] [REMOTE    ] INGM: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T19:22:26.547680] [INFO ] [REMOTE    ] INGM: Fetching primary data for 2025-05.
[2025-10-24T19:22:27.347633] [INFO ] [REMOTE    ] INGR: Fetching primary data for 2025-03.
[2025-10-24T19:22:27.612377] [INFO ] [REMOTE    ] ING: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T19:22:27.867798] [INFO ] [REMOTE    ] INGM: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T19:22:28.147713] [INFO ] [REMOTE    ] INGM: Fetching primary data for 2025-06.
[2025-10-24T19:22:28.641593] [INFO ] [REMOTE    ] INGR: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T19:22:28.947668] [INFO ] [REMOTE    ] INFY: Fetching primary data for 2025-10.
[2025-10-24T19:22:29.274192] [INFO ] [REMOTE    ] INGM: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T19:22:29.747689] [INFO ] [REMOTE    ] INGR: Fetching primary data for 2025-04.
[2025-10-24T19:22:30.547754] [INFO ] [REMOTE    ] INGM: Fetching primary data for 2025-07.
[2025-10-24T19:22:30.932870] [INFO ] [REMOTE    ] INFY: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T19:22:30.943988] [INFO ] [REMOTE    ] INFY: Full fetch complete (77751 records).
[2025-10-24T19:22:30.944117] [DEBUG] [VALIDATOR ] INFY: Validating primary data.
[2025-10-24T19:22:31.328979] [INFO ] [REMOTE    ] INGR: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T19:22:31.360234] [INFO ] [REMOTE    ] ING: Fetching primary data for 2025-05.
[2025-10-24T19:22:31.385972] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present.
[2025-10-24T19:22:31.386988] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed.
[2025-10-24T19:22:31.388229] [INFO ] [MAIN      ] INFY: Fetched primary data is valid.
[2025-10-24T19:22:31.388442] [DEBUG] [LOCAL     ] INFY: Saving primary data.
[2025-10-24T19:22:31.395745] [FATAL] [LOCAL     ] INFY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:22:31.404212] [FATAL] [MAIN      ] INFY: Failed to save primary data.
[2025-10-24T19:22:31.408198] [INFO ] [REMOTE    ] INGM: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T19:22:31.406328] [WARN ] [MAIN      ] INFY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:22:31.415092] [INFO ] [LOCAL     ] INFY: Starting deletion of primary data.
[2025-10-24T19:22:31.415587] [DEBUG] [LOCAL     ] INFY: No primary data file found to delete.
[2025-10-24T19:22:31.415689] [INFO ] [LOCAL     ] INFY: Starting deletion of derivative data.
[2025-10-24T19:22:31.416143] [DEBUG] [LOCAL     ] INFY: Deleted derivative data file.
[2025-10-24T19:22:31.416624] [INFO ] [MAIN      ] Update Progress: 1109/2366 symbols completed. INFY took 38.6s. Estimated remaining: 2h 41m 29s. Rate: 7.8 symbols/min
[2025-10-24T19:22:31.585384] [INFO ] [MAIN      ] INN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:22:31.624055] [DEBUG] [LOCAL     ] INN: Loaded 41707 existing records from primary storage.
[2025-10-24T19:22:31.624322] [INFO ] [MAIN      ] INN: Loaded 41707 existing records.
[2025-10-24T19:22:31.798349] [WARN ] [MAIN      ] INN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:22:31.798574] [INFO ] [MAIN      ] INN: Wiping existing primary data before full refresh.
[2025-10-24T19:22:31.798619] [INFO ] [LOCAL     ] INN: Starting deletion of primary data.
[2025-10-24T19:22:31.798825] [DEBUG] [LOCAL     ] INN: Deleted primary data file.
[2025-10-24T19:22:31.798882] [INFO ] [MAIN      ] INN: Starting full primary refresh.
[2025-10-24T19:22:32.150422] [INFO ] [REMOTE    ] INGR: Fetching primary data for 2025-05.
[2025-10-24T19:22:32.202533] [INFO ] [REMOTE    ] INN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:22:32.952915] [INFO ] [REMOTE    ] INN: Fetching primary data for 2025-01.
[2025-10-24T19:22:32.972280] [INFO ] [REMOTE    ] ING: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T19:22:33.099584] [INFO ] [REMOTE    ] INGR: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T19:22:33.747740] [INFO ] [REMOTE    ] INGR: Fetching primary data for 2025-06.
[2025-10-24T19:22:34.362382] [INFO ] [REMOTE    ] INN: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T19:22:34.547695] [INFO ] [REMOTE    ] ING: Fetching primary data for 2025-06.
[2025-10-24T19:22:35.347766] [INFO ] [REMOTE    ] INGM: Fetching primary data for 2025-08.
[2025-10-24T19:22:35.390321] [INFO ] [REMOTE    ] INGR: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T19:22:36.147704] [INFO ] [REMOTE    ] INGR: Fetching primary data for 2025-07.
[2025-10-24T19:22:36.358983] [INFO ] [REMOTE    ] ING: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T19:22:36.607069] [INFO ] [REMOTE    ] INGM: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T19:22:36.947675] [INFO ] [REMOTE    ] ING: Fetching primary data for 2025-07.
[2025-10-24T19:22:37.491006] [INFO ] [REMOTE    ] INGR: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T19:22:37.747669] [INFO ] [REMOTE    ] INGM: Fetching primary data for 2025-09.
[2025-10-24T19:22:38.547631] [INFO ] [REMOTE    ] INGR: Fetching primary data for 2025-08.
[2025-10-24T19:22:38.703915] [INFO ] [REMOTE    ] ING: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T19:22:38.731771] [INFO ] [REMOTE    ] INGM: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T19:22:39.347707] [INFO ] [REMOTE    ] INGM: Fetching primary data for 2025-10.
[2025-10-24T19:22:39.876532] [INFO ] [REMOTE    ] INGR: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T19:22:40.147741] [INFO ] [REMOTE    ] ING: Fetching primary data for 2025-08.
[2025-10-24T19:22:40.767754] [INFO ] [REMOTE    ] INGM: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T19:22:40.773186] [INFO ] [REMOTE    ] INGM: Full fetch complete (41793 records).
[2025-10-24T19:22:40.773298] [DEBUG] [VALIDATOR ] INGM: Validating primary data.
[2025-10-24T19:22:40.948674] [INFO ] [REMOTE    ] INGR: Fetching primary data for 2025-09.
[2025-10-24T19:22:41.149443] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present.
[2025-10-24T19:22:41.149520] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed.
[2025-10-24T19:22:41.150291] [INFO ] [MAIN      ] INGM: Fetched primary data is valid.
[2025-10-24T19:22:41.150351] [DEBUG] [LOCAL     ] INGM: Saving primary data.
[2025-10-24T19:22:41.150749] [FATAL] [LOCAL     ] INGM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:22:41.150833] [FATAL] [MAIN      ] INGM: Failed to save primary data.
[2025-10-24T19:22:41.150874] [WARN ] [MAIN      ] INGM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:22:41.150910] [INFO ] [LOCAL     ] INGM: Starting deletion of primary data.
[2025-10-24T19:22:41.150977] [DEBUG] [LOCAL     ] INGM: No primary data file found to delete.
[2025-10-24T19:22:41.151031] [INFO ] [LOCAL     ] INGM: Starting deletion of derivative data.
[2025-10-24T19:22:41.151301] [DEBUG] [LOCAL     ] INGM: Deleted derivative data file.
[2025-10-24T19:22:41.151391] [INFO ] [MAIN      ] Update Progress: 1110/2366 symbols completed. INGM took 23.4s. Estimated remaining: 2h 41m 24s. Rate: 7.8 symbols/min
[2025-10-24T19:22:41.320715] [INFO ] [MAIN      ] INR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:22:41.320876] [DEBUG] [LOCAL     ] INR: No existing data file found in primary storage.
[2025-10-24T19:22:41.320912] [WARN ] [MAIN      ] INR: No existing data found, performing full refresh instead.
[2025-10-24T19:22:41.321023] [INFO ] [MAIN      ] INR: Wiping existing primary data before full refresh.
[2025-10-24T19:22:41.321063] [INFO ] [LOCAL     ] INR: Starting deletion of primary data.
[2025-10-24T19:22:41.321102] [DEBUG] [LOCAL     ] INR: No primary data file found to delete.
[2025-10-24T19:22:41.321133] [INFO ] [MAIN      ] INR: Starting full primary refresh.
[2025-10-24T19:22:41.681586] [INFO ] [REMOTE    ] INR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:22:41.710973] [INFO ] [REMOTE    ] ING: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T19:22:41.747628] [INFO ] [REMOTE    ] ING: Fetching primary data for 2025-09.
[2025-10-24T19:22:42.547860] [INFO ] [REMOTE    ] INN: Fetching primary data for 2025-02.
[2025-10-24T19:22:42.550628] [INFO ] [REMOTE    ] INGR: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T19:22:43.318433] [INFO ] [REMOTE    ] ING: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T19:22:43.347607] [INFO ] [REMOTE    ] ING: Fetching primary data for 2025-10.
[2025-10-24T19:22:43.837462] [INFO ] [REMOTE    ] INN: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T19:22:44.147679] [INFO ] [REMOTE    ] INGR: Fetching primary data for 2025-10.
[2025-10-24T19:22:44.947626] [INFO ] [REMOTE    ] INN: Fetching primary data for 2025-03.
[2025-10-24T19:22:45.292533] [INFO ] [REMOTE    ] ING: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T19:22:45.302030] [INFO ] [REMOTE    ] ING: Full fetch complete (73775 records).
[2025-10-24T19:22:45.302225] [DEBUG] [VALIDATOR ] ING: Validating primary data.
[2025-10-24T19:22:45.720438] [DEBUG] [VALIDATOR ] ING: All expected trading days are present.
[2025-10-24T19:22:45.720626] [DEBUG] [VALIDATOR ] ING: Primary data validation passed.
[2025-10-24T19:22:45.721748] [INFO ] [MAIN      ] ING: Fetched primary data is valid.
[2025-10-24T19:22:45.721857] [DEBUG] [LOCAL     ] ING: Saving primary data.
[2025-10-24T19:22:45.728921] [FATAL] [LOCAL     ] ING: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:22:45.740442] [FATAL] [MAIN      ] ING: Failed to save primary data.
[2025-10-24T19:22:45.741031] [WARN ] [MAIN      ] ING: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:22:45.741606] [INFO ] [REMOTE    ] INGR: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T19:22:45.748188] [INFO ] [REMOTE    ] INR: Fetching primary data for 2025-01.
[2025-10-24T19:22:45.748735] [INFO ] [LOCAL     ] ING: Starting deletion of primary data.
[2025-10-24T19:22:45.749940] [DEBUG] [LOCAL     ] ING: No primary data file found to delete.
[2025-10-24T19:22:45.749873] [INFO ] [REMOTE    ] INGR: Full fetch complete (50824 records).
[2025-10-24T19:22:45.750108] [INFO ] [LOCAL     ] ING: Starting deletion of derivative data.
[2025-10-24T19:22:45.750193] [DEBUG] [VALIDATOR ] INGR: Validating primary data.
[2025-10-24T19:22:45.750765] [DEBUG] [LOCAL     ] ING: Deleted derivative data file.
[2025-10-24T19:22:45.751541] [INFO ] [MAIN      ] Update Progress: 1111/2366 symbols completed. ING took 30.0s. Estimated remaining: 2h 41m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:22:46.105697] [INFO ] [MAIN      ] INSP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:22:46.226973] [INFO ] [REMOTE    ] INR: Incremental fetch complete for 2025-01 (0.48 seconds).
[2025-10-24T19:22:46.369390] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present.
[2025-10-24T19:22:46.370565] [DEBUG] [LOCAL     ] INSP: Loaded 38813 existing records from primary storage.
[2025-10-24T19:22:46.369526] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed.
[2025-10-24T19:22:46.371995] [INFO ] [MAIN      ] INGR: Fetched primary data is valid.
[2025-10-24T19:22:46.372307] [INFO ] [MAIN      ] INSP: Loaded 38813 existing records.
[2025-10-24T19:22:46.372508] [DEBUG] [LOCAL     ] INGR: Saving primary data.
[2025-10-24T19:22:46.451094] [FATAL] [LOCAL     ] INGR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:22:46.480863] [FATAL] [MAIN      ] INGR: Failed to save primary data.
[2025-10-24T19:22:46.500967] [WARN ] [MAIN      ] INGR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:22:46.507077] [INFO ] [REMOTE    ] INN: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T19:22:46.504850] [INFO ] [LOCAL     ] INGR: Starting deletion of primary data.
[2025-10-24T19:22:46.532768] [DEBUG] [LOCAL     ] INGR: No primary data file found to delete.
[2025-10-24T19:22:46.543102] [INFO ] [LOCAL     ] INGR: Starting deletion of derivative data.
[2025-10-24T19:22:46.558824] [INFO ] [REMOTE    ] INR: Fetching primary data for 2025-02.
[2025-10-24T19:22:46.559794] [DEBUG] [LOCAL     ] INGR: Deleted derivative data file.
[2025-10-24T19:22:46.603416] [INFO ] [MAIN      ] Update Progress: 1112/2366 symbols completed. INGR took 27.4s. Estimated remaining: 2h 40m 57s. Rate: 7.8 symbols/min
[2025-10-24T19:22:46.602900] [WARN ] [MAIN      ] INSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:22:46.604107] [INFO ] [MAIN      ] INSP: Wiping existing primary data before full refresh.
[2025-10-24T19:22:46.638612] [INFO ] [LOCAL     ] INSP: Starting deletion of primary data.
[2025-10-24T19:22:46.680681] [DEBUG] [LOCAL     ] INSP: Deleted primary data file.
[2025-10-24T19:22:46.687316] [INFO ] [MAIN      ] INSP: Starting full primary refresh.
[2025-10-24T19:22:46.949861] [INFO ] [MAIN      ] INSW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:22:47.186948] [INFO ] [REMOTE    ] INSP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:22:47.204058] [DEBUG] [LOCAL     ] INSW: Loaded 39476 existing records from primary storage.
[2025-10-24T19:22:47.204347] [INFO ] [MAIN      ] INSW: Loaded 39476 existing records.
[2025-10-24T19:22:47.356964] [INFO ] [REMOTE    ] INN: Fetching primary data for 2025-04.
[2025-10-24T19:22:47.387010] [WARN ] [MAIN      ] INSW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:22:47.387398] [INFO ] [MAIN      ] INSW: Wiping existing primary data before full refresh.
[2025-10-24T19:22:47.387451] [INFO ] [LOCAL     ] INSW: Starting deletion of primary data.
[2025-10-24T19:22:47.387716] [DEBUG] [LOCAL     ] INSW: Deleted primary data file.
[2025-10-24T19:22:47.387772] [INFO ] [MAIN      ] INSW: Starting full primary refresh.
[2025-10-24T19:22:47.754699] [INFO ] [REMOTE    ] INSW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:22:47.766553] [INFO ] [REMOTE    ] INR: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T19:22:48.147674] [INFO ] [REMOTE    ] INR: Fetching primary data for 2025-03.
[2025-10-24T19:22:48.930617] [INFO ] [REMOTE    ] INN: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T19:22:48.947617] [INFO ] [REMOTE    ] INN: Fetching primary data for 2025-05.
[2025-10-24T19:22:49.043134] [INFO ] [REMOTE    ] INR: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T19:22:49.747681] [INFO ] [REMOTE    ] INSP: Fetching primary data for 2025-01.
[2025-10-24T19:22:50.310624] [INFO ] [REMOTE    ] INN: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T19:22:50.547688] [INFO ] [REMOTE    ] INSW: Fetching primary data for 2025-01.
[2025-10-24T19:22:51.113905] [INFO ] [REMOTE    ] INSP: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T19:22:51.347638] [INFO ] [REMOTE    ] INR: Fetching primary data for 2025-04.
[2025-10-24T19:22:52.076329] [INFO ] [REMOTE    ] INSW: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T19:22:52.147626] [INFO ] [REMOTE    ] INSW: Fetching primary data for 2025-02.
[2025-10-24T19:22:52.178285] [INFO ] [REMOTE    ] INR: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T19:22:52.947717] [INFO ] [REMOTE    ] INN: Fetching primary data for 2025-06.
[2025-10-24T19:22:53.664895] [INFO ] [REMOTE    ] INSW: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T19:22:53.747605] [INFO ] [REMOTE    ] INSW: Fetching primary data for 2025-03.
[2025-10-24T19:22:54.533021] [INFO ] [REMOTE    ] INN: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T19:22:54.547612] [INFO ] [REMOTE    ] INN: Fetching primary data for 2025-07.
[2025-10-24T19:22:55.347618] [INFO ] [REMOTE    ] INR: Fetching primary data for 2025-05.
[2025-10-24T19:22:55.379552] [INFO ] [REMOTE    ] INSW: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T19:22:55.894345] [INFO ] [REMOTE    ] INN: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T19:22:56.147607] [INFO ] [REMOTE    ] INSP: Fetching primary data for 2025-02.
[2025-10-24T19:22:56.389177] [INFO ] [REMOTE    ] INR: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T19:22:56.947702] [INFO ] [REMOTE    ] INR: Fetching primary data for 2025-06.
[2025-10-24T19:22:57.512248] [INFO ] [REMOTE    ] INSP: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T19:22:57.747617] [INFO ] [REMOTE    ] INSW: Fetching primary data for 2025-04.
[2025-10-24T19:22:58.040479] [INFO ] [REMOTE    ] INR: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T19:22:58.547673] [INFO ] [REMOTE    ] INSP: Fetching primary data for 2025-03.
[2025-10-24T19:22:59.290020] [INFO ] [REMOTE    ] INSW: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T19:22:59.347710] [INFO ] [REMOTE    ] INSW: Fetching primary data for 2025-05.
[2025-10-24T19:22:59.859868] [INFO ] [REMOTE    ] INSP: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T19:23:00.147733] [INFO ] [REMOTE    ] INR: Fetching primary data for 2025-07.
[2025-10-24T19:23:00.947684] [INFO ] [REMOTE    ] INSP: Fetching primary data for 2025-04.
[2025-10-24T19:23:01.747634] [INFO ] [REMOTE    ] INN: Fetching primary data for 2025-08.
[2025-10-24T19:23:05.634190] [INFO ] [REMOTE    ] INSP: Incremental fetch complete for 2025-04 (4.69 seconds).
[2025-10-24T19:23:05.641354] [INFO ] [REMOTE    ] INSP: Fetching primary data for 2025-05.
[2025-10-24T19:23:05.730778] [INFO ] [REMOTE    ] INSW: Incremental fetch complete for 2025-05 (6.38 seconds).
[2025-10-24T19:23:05.739704] [INFO ] [REMOTE    ] INSW: Fetching primary data for 2025-06.
[2025-10-24T19:23:05.947281] [INFO ] [REMOTE    ] INR: Incremental fetch complete for 2025-07 (5.80 seconds).
[2025-10-24T19:23:05.954361] [INFO ] [REMOTE    ] INR: Fetching primary data for 2025-08.
[2025-10-24T19:23:06.588945] [INFO ] [REMOTE    ] INSP: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T19:23:06.596577] [INFO ] [REMOTE    ] INSP: Fetching primary data for 2025-06.
[2025-10-24T19:23:06.865094] [INFO ] [REMOTE    ] INN: Incremental fetch complete for 2025-08 (5.12 seconds).
[2025-10-24T19:23:06.878847] [INFO ] [REMOTE    ] INN: Fetching primary data for 2025-09.
[2025-10-24T19:23:07.250554] [INFO ] [REMOTE    ] INSW: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T19:23:07.260022] [INFO ] [REMOTE    ] INSW: Fetching primary data for 2025-07.
[2025-10-24T19:23:07.654861] [INFO ] [REMOTE    ] INR: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T19:23:07.660846] [INFO ] [REMOTE    ] INR: Fetching primary data for 2025-09.
[2025-10-24T19:23:07.898347] [INFO ] [REMOTE    ] INN: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T19:23:07.937522] [INFO ] [REMOTE    ] INSP: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T19:23:08.147747] [INFO ] [REMOTE    ] INN: Fetching primary data for 2025-10.
[2025-10-24T19:23:08.824377] [INFO ] [REMOTE    ] INSW: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T19:23:08.835763] [INFO ] [REMOTE    ] INR: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T19:23:08.947696] [INFO ] [REMOTE    ] INSW: Fetching primary data for 2025-08.
[2025-10-24T19:23:09.672076] [INFO ] [REMOTE    ] INN: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T19:23:09.678788] [INFO ] [REMOTE    ] INN: Full fetch complete (57670 records).
[2025-10-24T19:23:09.678890] [DEBUG] [VALIDATOR ] INN: Validating primary data.
[2025-10-24T19:23:09.748037] [INFO ] [REMOTE    ] INSP: Fetching primary data for 2025-07.
[2025-10-24T19:23:10.069919] [DEBUG] [VALIDATOR ] INN: All expected trading days are present.
[2025-10-24T19:23:10.070090] [DEBUG] [VALIDATOR ] INN: Primary data validation passed.
[2025-10-24T19:23:10.071093] [INFO ] [MAIN      ] INN: Fetched primary data is valid.
[2025-10-24T19:23:10.071173] [DEBUG] [LOCAL     ] INN: Saving primary data.
[2025-10-24T19:23:10.084415] [FATAL] [LOCAL     ] INN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:23:10.091945] [FATAL] [MAIN      ] INN: Failed to save primary data.
[2025-10-24T19:23:10.092061] [WARN ] [MAIN      ] INN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:23:10.092119] [INFO ] [LOCAL     ] INN: Starting deletion of primary data.
[2025-10-24T19:23:10.092358] [DEBUG] [LOCAL     ] INN: No primary data file found to delete.
[2025-10-24T19:23:10.093423] [INFO ] [REMOTE    ] INSW: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T19:23:10.092784] [INFO ] [LOCAL     ] INN: Starting deletion of derivative data.
[2025-10-24T19:23:10.096387] [DEBUG] [LOCAL     ] INN: Deleted derivative data file.
[2025-10-24T19:23:10.101899] [INFO ] [MAIN      ] Update Progress: 1113/2366 symbols completed. INN took 38.7s. Estimated remaining: 2h 41m 7s. Rate: 7.8 symbols/min
[2025-10-24T19:23:10.278299] [INFO ] [MAIN      ] INVH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:23:10.331020] [DEBUG] [LOCAL     ] INVH: Loaded 53583 existing records from primary storage.
[2025-10-24T19:23:10.331366] [INFO ] [MAIN      ] INVH: Loaded 53583 existing records.
[2025-10-24T19:23:10.508203] [WARN ] [MAIN      ] INVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:23:10.508376] [INFO ] [MAIN      ] INVH: Wiping existing primary data before full refresh.
[2025-10-24T19:23:10.508420] [INFO ] [LOCAL     ] INVH: Starting deletion of primary data.
[2025-10-24T19:23:10.508630] [DEBUG] [LOCAL     ] INVH: Deleted primary data file.
[2025-10-24T19:23:10.508722] [INFO ] [MAIN      ] INVH: Starting full primary refresh.
[2025-10-24T19:23:10.552897] [INFO ] [REMOTE    ] INR: Fetching primary data for 2025-10.
[2025-10-24T19:23:10.867612] [INFO ] [REMOTE    ] INVH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:23:11.001684] [INFO ] [REMOTE    ] INSP: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T19:23:11.347724] [INFO ] [REMOTE    ] INSW: Fetching primary data for 2025-09.
[2025-10-24T19:23:12.043928] [INFO ] [REMOTE    ] INR: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T19:23:12.049761] [INFO ] [REMOTE    ] INR: Full fetch complete (37662 records).
[2025-10-24T19:23:12.049858] [DEBUG] [VALIDATOR ] INR: Validating primary data.
[2025-10-24T19:23:12.153399] [INFO ] [REMOTE    ] INVH: Fetching primary data for 2025-01.
[2025-10-24T19:23:12.253696] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 185 unique days, need 200 days
[2025-10-24T19:23:12.254263] [FATAL] [MAIN      ] INR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:23:12.254349] [WARN ] [MAIN      ] INR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:23:12.254436] [INFO ] [LOCAL     ] INR: Starting deletion of primary data.
[2025-10-24T19:23:12.254520] [DEBUG] [LOCAL     ] INR: No primary data file found to delete.
[2025-10-24T19:23:12.254578] [INFO ] [LOCAL     ] INR: Starting deletion of derivative data.
[2025-10-24T19:23:12.254623] [DEBUG] [LOCAL     ] INR: No derivative data file found to delete.
[2025-10-24T19:23:12.254728] [INFO ] [MAIN      ] Update Progress: 1114/2366 symbols completed. INR took 31.1s. Estimated remaining: 2h 40m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:23:12.429163] [INFO ] [MAIN      ] INVX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:23:12.458702] [DEBUG] [LOCAL     ] INVX: Loaded 29267 existing records from primary storage.
[2025-10-24T19:23:12.458981] [INFO ] [MAIN      ] INVX: Loaded 29267 existing records.
[2025-10-24T19:23:12.641424] [WARN ] [MAIN      ] INVX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:23:12.641801] [INFO ] [MAIN      ] INVX: Wiping existing primary data before full refresh.
[2025-10-24T19:23:12.641902] [INFO ] [LOCAL     ] INVX: Starting deletion of primary data.
[2025-10-24T19:23:12.642201] [DEBUG] [LOCAL     ] INVX: Deleted primary data file.
[2025-10-24T19:23:12.642304] [INFO ] [MAIN      ] INVX: Starting full primary refresh.
[2025-10-24T19:23:12.769528] [INFO ] [REMOTE    ] INSW: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T19:23:12.953918] [INFO ] [REMOTE    ] INSP: Fetching primary data for 2025-08.
[2025-10-24T19:23:13.033905] [INFO ] [REMOTE    ] INVX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:23:13.747632] [INFO ] [REMOTE    ] INSW: Fetching primary data for 2025-10.
[2025-10-24T19:23:13.782404] [INFO ] [REMOTE    ] INVH: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T19:23:14.547617] [INFO ] [REMOTE    ] INVH: Fetching primary data for 2025-02.
[2025-10-24T19:23:14.653327] [INFO ] [REMOTE    ] INSP: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T19:23:15.226029] [INFO ] [REMOTE    ] INSW: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T19:23:15.232774] [INFO ] [REMOTE    ] INSW: Full fetch complete (59337 records).
[2025-10-24T19:23:15.232911] [DEBUG] [VALIDATOR ] INSW: Validating primary data.
[2025-10-24T19:23:15.352869] [INFO ] [REMOTE    ] INVX: Fetching primary data for 2025-01.
[2025-10-24T19:23:15.638401] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present.
[2025-10-24T19:23:15.638491] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed.
[2025-10-24T19:23:15.639599] [INFO ] [MAIN      ] INSW: Fetched primary data is valid.
[2025-10-24T19:23:15.639685] [DEBUG] [LOCAL     ] INSW: Saving primary data.
[2025-10-24T19:23:15.640228] [FATAL] [LOCAL     ] INSW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:23:15.640315] [FATAL] [MAIN      ] INSW: Failed to save primary data.
[2025-10-24T19:23:15.640358] [WARN ] [MAIN      ] INSW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:23:15.640393] [INFO ] [LOCAL     ] INSW: Starting deletion of primary data.
[2025-10-24T19:23:15.640446] [DEBUG] [LOCAL     ] INSW: No primary data file found to delete.
[2025-10-24T19:23:15.640482] [INFO ] [LOCAL     ] INSW: Starting deletion of derivative data.
[2025-10-24T19:23:15.640620] [DEBUG] [LOCAL     ] INSW: Deleted derivative data file.
[2025-10-24T19:23:15.641082] [INFO ] [MAIN      ] Update Progress: 1115/2366 symbols completed. INSW took 29.0s. Estimated remaining: 2h 40m 41s. Rate: 7.8 symbols/min
[2025-10-24T19:23:15.829356] [INFO ] [MAIN      ] IONQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:23:15.883455] [DEBUG] [LOCAL     ] IONQ: Loaded 54178 existing records from primary storage.
[2025-10-24T19:23:15.883833] [INFO ] [MAIN      ] IONQ: Loaded 54178 existing records.
[2025-10-24T19:23:16.064777] [WARN ] [MAIN      ] IONQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:23:16.065145] [INFO ] [MAIN      ] IONQ: Wiping existing primary data before full refresh.
[2025-10-24T19:23:16.065199] [INFO ] [LOCAL     ] IONQ: Starting deletion of primary data.
[2025-10-24T19:23:16.086801] [DEBUG] [LOCAL     ] IONQ: Deleted primary data file.
[2025-10-24T19:23:16.086917] [INFO ] [MAIN      ] IONQ: Starting full primary refresh.
[2025-10-24T19:23:16.152729] [INFO ] [REMOTE    ] INSP: Fetching primary data for 2025-09.
[2025-10-24T19:23:16.166194] [INFO ] [REMOTE    ] INVH: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T19:23:16.459608] [INFO ] [REMOTE    ] IONQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:23:16.686517] [INFO ] [REMOTE    ] INVX: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T19:23:16.947690] [INFO ] [REMOTE    ] INVH: Fetching primary data for 2025-03.
[2025-10-24T19:23:17.747679] [INFO ] [REMOTE    ] INVX: Fetching primary data for 2025-02.
[2025-10-24T19:23:17.792875] [INFO ] [REMOTE    ] INSP: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T19:23:18.547621] [INFO ] [REMOTE    ] IONQ: Fetching primary data for 2025-01.
[2025-10-24T19:23:18.638887] [INFO ] [REMOTE    ] INVH: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T19:23:18.666574] [INFO ] [REMOTE    ] INVX: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T19:23:19.347673] [INFO ] [REMOTE    ] INVH: Fetching primary data for 2025-04.
[2025-10-24T19:23:20.147676] [INFO ] [REMOTE    ] INSP: Fetching primary data for 2025-10.
[2025-10-24T19:23:20.896037] [INFO ] [REMOTE    ] IONQ: Incremental fetch complete for 2025-01 (2.35 seconds).
[2025-10-24T19:23:20.947613] [INFO ] [REMOTE    ] IONQ: Fetching primary data for 2025-02.
[2025-10-24T19:23:21.105375] [INFO ] [REMOTE    ] INVH: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T19:23:21.747702] [INFO ] [REMOTE    ] INVH: Fetching primary data for 2025-05.
[2025-10-24T19:23:21.970088] [INFO ] [REMOTE    ] INSP: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T19:23:21.979095] [INFO ] [REMOTE    ] INSP: Full fetch complete (53909 records).
[2025-10-24T19:23:21.979255] [DEBUG] [VALIDATOR ] INSP: Validating primary data.
[2025-10-24T19:23:22.389807] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present.
[2025-10-24T19:23:22.389923] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed.
[2025-10-24T19:23:22.391306] [INFO ] [MAIN      ] INSP: Fetched primary data is valid.
[2025-10-24T19:23:22.391373] [DEBUG] [LOCAL     ] INSP: Saving primary data.
[2025-10-24T19:23:22.392167] [FATAL] [LOCAL     ] INSP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:23:22.392261] [FATAL] [MAIN      ] INSP: Failed to save primary data.
[2025-10-24T19:23:22.392303] [WARN ] [MAIN      ] INSP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:23:22.392340] [INFO ] [LOCAL     ] INSP: Starting deletion of primary data.
[2025-10-24T19:23:22.392399] [DEBUG] [LOCAL     ] INSP: No primary data file found to delete.
[2025-10-24T19:23:22.392436] [INFO ] [LOCAL     ] INSP: Starting deletion of derivative data.
[2025-10-24T19:23:22.392612] [DEBUG] [LOCAL     ] INSP: Deleted derivative data file.
[2025-10-24T19:23:22.393103] [INFO ] [MAIN      ] Update Progress: 1116/2366 symbols completed. INSP took 36.6s. Estimated remaining: 2h 40m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:23:22.555735] [INFO ] [REMOTE    ] INVX: Fetching primary data for 2025-03.
[2025-10-24T19:23:22.645836] [INFO ] [MAIN      ] IOT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:23:22.722912] [DEBUG] [LOCAL     ] IOT: Loaded 53849 existing records from primary storage.
[2025-10-24T19:23:22.723763] [INFO ] [MAIN      ] IOT: Loaded 53849 existing records.
[2025-10-24T19:23:23.015498] [WARN ] [MAIN      ] IOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:23:23.016078] [INFO ] [MAIN      ] IOT: Wiping existing primary data before full refresh.
[2025-10-24T19:23:23.016247] [INFO ] [LOCAL     ] IOT: Starting deletion of primary data.
[2025-10-24T19:23:23.016785] [DEBUG] [LOCAL     ] IOT: Deleted primary data file.
[2025-10-24T19:23:23.016845] [INFO ] [MAIN      ] IOT: Starting full primary refresh.
[2025-10-24T19:23:23.555248] [INFO ] [REMOTE    ] IONQ: Incremental fetch complete for 2025-02 (2.61 seconds).
[2025-10-24T19:23:23.663684] [INFO ] [REMOTE    ] INVH: Incremental fetch complete for 2025-05 (1.92 seconds).
[2025-10-24T19:23:23.696555] [INFO ] [REMOTE    ] IONQ: Fetching primary data for 2025-03.
[2025-10-24T19:23:23.729305] [INFO ] [REMOTE    ] IOT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:23:23.750522] [INFO ] [REMOTE    ] INVX: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T19:23:24.147696] [INFO ] [REMOTE    ] INVX: Fetching primary data for 2025-04.
[2025-10-24T19:23:24.947714] [INFO ] [REMOTE    ] INVH: Fetching primary data for 2025-06.
[2025-10-24T19:23:25.250995] [INFO ] [REMOTE    ] INVX: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T19:23:25.747625] [INFO ] [REMOTE    ] INVX: Fetching primary data for 2025-05.
[2025-10-24T19:23:26.119875] [INFO ] [REMOTE    ] IONQ: Incremental fetch complete for 2025-03 (2.42 seconds).
[2025-10-24T19:23:26.526208] [INFO ] [REMOTE    ] INVX: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T19:23:26.547677] [INFO ] [REMOTE    ] INVX: Fetching primary data for 2025-06.
[2025-10-24T19:23:26.589041] [INFO ] [REMOTE    ] INVH: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T19:23:27.347627] [INFO ] [REMOTE    ] IOT: Fetching primary data for 2025-01.
[2025-10-24T19:23:27.760962] [INFO ] [REMOTE    ] INVX: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T19:23:28.147678] [INFO ] [REMOTE    ] INVX: Fetching primary data for 2025-07.
[2025-10-24T19:23:28.947693] [INFO ] [REMOTE    ] IONQ: Fetching primary data for 2025-04.
[2025-10-24T19:23:28.987601] [INFO ] [REMOTE    ] IOT: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T19:23:29.513385] [INFO ] [REMOTE    ] INVX: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T19:23:29.747671] [INFO ] [REMOTE    ] INVX: Fetching primary data for 2025-08.
[2025-10-24T19:23:30.547744] [INFO ] [REMOTE    ] IOT: Fetching primary data for 2025-02.
[2025-10-24T19:23:31.154451] [INFO ] [REMOTE    ] INVX: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T19:23:31.314920] [INFO ] [REMOTE    ] IONQ: Incremental fetch complete for 2025-04 (2.37 seconds).
[2025-10-24T19:23:31.347621] [INFO ] [REMOTE    ] IONQ: Fetching primary data for 2025-05.
[2025-10-24T19:23:32.147685] [INFO ] [REMOTE    ] INVX: Fetching primary data for 2025-09.
[2025-10-24T19:23:32.317594] [INFO ] [REMOTE    ] IOT: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T19:23:32.947695] [INFO ] [REMOTE    ] INVH: Fetching primary data for 2025-07.
[2025-10-24T19:23:33.327357] [INFO ] [REMOTE    ] INVX: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T19:23:33.491251] [INFO ] [REMOTE    ] IONQ: Incremental fetch complete for 2025-05 (2.14 seconds).
[2025-10-24T19:23:33.747738] [INFO ] [REMOTE    ] INVX: Fetching primary data for 2025-10.
[2025-10-24T19:23:34.547727] [INFO ] [REMOTE    ] IOT: Fetching primary data for 2025-03.
[2025-10-24T19:23:34.600060] [INFO ] [REMOTE    ] INVH: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T19:23:35.045884] [INFO ] [REMOTE    ] INVX: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T19:23:35.051719] [INFO ] [REMOTE    ] INVX: Full fetch complete (42697 records).
[2025-10-24T19:23:35.051844] [DEBUG] [VALIDATOR ] INVX: Validating primary data.
[2025-10-24T19:23:35.348900] [INFO ] [REMOTE    ] IONQ: Fetching primary data for 2025-06.
[2025-10-24T19:23:35.440901] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present.
[2025-10-24T19:23:35.441020] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed.
[2025-10-24T19:23:35.442190] [INFO ] [MAIN      ] INVX: Fetched primary data is valid.
[2025-10-24T19:23:35.442259] [DEBUG] [LOCAL     ] INVX: Saving primary data.
[2025-10-24T19:23:35.442938] [FATAL] [LOCAL     ] INVX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:23:35.443034] [FATAL] [MAIN      ] INVX: Failed to save primary data.
[2025-10-24T19:23:35.443077] [WARN ] [MAIN      ] INVX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:23:35.443113] [INFO ] [LOCAL     ] INVX: Starting deletion of primary data.
[2025-10-24T19:23:35.443169] [DEBUG] [LOCAL     ] INVX: No primary data file found to delete.
[2025-10-24T19:23:35.443207] [INFO ] [LOCAL     ] INVX: Starting deletion of derivative data.
[2025-10-24T19:23:35.443387] [DEBUG] [LOCAL     ] INVX: Deleted derivative data file.
[2025-10-24T19:23:35.443497] [INFO ] [MAIN      ] Update Progress: 1117/2366 symbols completed. INVX took 23.2s. Estimated remaining: 2h 40m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:23:36.147761] [INFO ] [REMOTE    ] INVH: Fetching primary data for 2025-08.
[2025-10-24T19:23:36.469404] [INFO ] [REMOTE    ] IOT: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T19:23:36.947702] [INFO ] [REMOTE    ] IOT: Fetching primary data for 2025-04.
[2025-10-24T19:23:37.649428] [INFO ] [REMOTE    ] IONQ: Incremental fetch complete for 2025-06 (2.30 seconds).
[2025-10-24T19:23:37.750219] [INFO ] [REMOTE    ] IONQ: Fetching primary data for 2025-07.
[2025-10-24T19:23:37.754571] [INFO ] [REMOTE    ] INVH: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T19:23:38.206242] [INFO ] [REMOTE    ] IOT: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T19:23:38.547684] [INFO ] [REMOTE    ] INVH: Fetching primary data for 2025-09.
[2025-10-24T19:23:39.347667] [INFO ] [REMOTE    ] IOT: Fetching primary data for 2025-05.
[2025-10-24T19:23:40.214803] [INFO ] [REMOTE    ] INVH: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T19:23:40.226851] [INFO ] [REMOTE    ] INVH: Fetching primary data for 2025-10.
[2025-10-24T19:23:40.534844] [INFO ] [REMOTE    ] IONQ: Incremental fetch complete for 2025-07 (2.78 seconds).
[2025-10-24T19:23:40.947823] [INFO ] [REMOTE    ] IONQ: Fetching primary data for 2025-08.
[2025-10-24T19:23:41.243354] [INFO ] [REMOTE    ] IOT: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T19:23:41.747687] [INFO ] [REMOTE    ] IOT: Fetching primary data for 2025-06.
[2025-10-24T19:23:42.156511] [INFO ] [REMOTE    ] INVH: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T19:23:42.167740] [INFO ] [REMOTE    ] INVH: Full fetch complete (76992 records).
[2025-10-24T19:23:42.167949] [DEBUG] [VALIDATOR ] INVH: Validating primary data.
[2025-10-24T19:23:42.577050] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present.
[2025-10-24T19:23:42.577278] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed.
[2025-10-24T19:23:42.578960] [INFO ] [MAIN      ] INVH: Fetched primary data is valid.
[2025-10-24T19:23:42.579028] [DEBUG] [LOCAL     ] INVH: Saving primary data.
[2025-10-24T19:23:42.580041] [FATAL] [LOCAL     ] INVH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:23:42.580142] [FATAL] [MAIN      ] INVH: Failed to save primary data.
[2025-10-24T19:23:42.580184] [WARN ] [MAIN      ] INVH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:23:42.580221] [INFO ] [LOCAL     ] INVH: Starting deletion of primary data.
[2025-10-24T19:23:42.580280] [DEBUG] [LOCAL     ] INVH: No primary data file found to delete.
[2025-10-24T19:23:42.580316] [INFO ] [LOCAL     ] INVH: Starting deletion of derivative data.
[2025-10-24T19:23:42.580604] [DEBUG] [LOCAL     ] INVH: Deleted derivative data file.
[2025-10-24T19:23:42.581244] [INFO ] [MAIN      ] Update Progress: 1118/2366 symbols completed. INVH took 32.5s. Estimated remaining: 2h 40m 22s. Rate: 7.8 symbols/min
[2025-10-24T19:23:43.156015] [INFO ] [REMOTE    ] IONQ: Incremental fetch complete for 2025-08 (2.21 seconds).
[2025-10-24T19:23:43.167386] [INFO ] [REMOTE    ] IONQ: Fetching primary data for 2025-09.
[2025-10-24T19:23:43.228840] [INFO ] [REMOTE    ] IOT: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T19:23:43.347669] [INFO ] [REMOTE    ] IOT: Fetching primary data for 2025-07.
[2025-10-24T19:23:45.172200] [INFO ] [REMOTE    ] IOT: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T19:23:45.183948] [INFO ] [REMOTE    ] IOT: Fetching primary data for 2025-08.
[2025-10-24T19:23:45.935162] [INFO ] [REMOTE    ] IONQ: Incremental fetch complete for 2025-09 (2.77 seconds).
[2025-10-24T19:23:45.947108] [INFO ] [REMOTE    ] IONQ: Fetching primary data for 2025-10.
[2025-10-24T19:23:47.156282] [INFO ] [REMOTE    ] IOT: Incremental fetch complete for 2025-08 (1.97 seconds).
[2025-10-24T19:23:47.168032] [INFO ] [REMOTE    ] IOT: Fetching primary data for 2025-09.
[2025-10-24T19:23:48.896233] [INFO ] [REMOTE    ] IOT: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T19:23:48.908303] [INFO ] [REMOTE    ] IOT: Fetching primary data for 2025-10.
[2025-10-24T19:23:48.975840] [INFO ] [REMOTE    ] IONQ: Incremental fetch complete for 2025-10 (3.03 seconds).
[2025-10-24T19:23:48.986471] [INFO ] [REMOTE    ] IONQ: Full fetch complete (77968 records).
[2025-10-24T19:23:48.986630] [DEBUG] [VALIDATOR ] IONQ: Validating primary data.
[2025-10-24T19:23:49.411104] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present.
[2025-10-24T19:23:49.411227] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed.
[2025-10-24T19:23:49.412394] [INFO ] [MAIN      ] IONQ: Fetched primary data is valid.
[2025-10-24T19:23:49.412459] [DEBUG] [LOCAL     ] IONQ: Saving primary data.
[2025-10-24T19:23:49.413152] [FATAL] [LOCAL     ] IONQ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:23:49.413244] [FATAL] [MAIN      ] IONQ: Failed to save primary data.
[2025-10-24T19:23:49.413287] [WARN ] [MAIN      ] IONQ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:23:49.413324] [INFO ] [LOCAL     ] IONQ: Starting deletion of primary data.
[2025-10-24T19:23:49.413378] [DEBUG] [LOCAL     ] IONQ: No primary data file found to delete.
[2025-10-24T19:23:49.413414] [INFO ] [LOCAL     ] IONQ: Starting deletion of derivative data.
[2025-10-24T19:23:49.413559] [DEBUG] [LOCAL     ] IONQ: Deleted derivative data file.
[2025-10-24T19:23:49.414443] [INFO ] [MAIN      ] Update Progress: 1119/2366 symbols completed. IONQ took 33.8s. Estimated remaining: 2h 40m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:23:51.026736] [INFO ] [REMOTE    ] IOT: Incremental fetch complete for 2025-10 (2.12 seconds).
[2025-10-24T19:23:51.036534] [INFO ] [REMOTE    ] IOT: Full fetch complete (77529 records).
[2025-10-24T19:23:51.036718] [DEBUG] [VALIDATOR ] IOT: Validating primary data.
[2025-10-24T19:23:51.422454] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present.
[2025-10-24T19:23:51.422562] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed.
[2025-10-24T19:23:51.423728] [INFO ] [MAIN      ] IOT: Fetched primary data is valid.
[2025-10-24T19:23:51.423791] [DEBUG] [LOCAL     ] IOT: Saving primary data.
[2025-10-24T19:23:51.424397] [FATAL] [LOCAL     ] IOT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:23:51.424501] [FATAL] [MAIN      ] IOT: Failed to save primary data.
[2025-10-24T19:23:51.424543] [WARN ] [MAIN      ] IOT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:23:51.424578] [INFO ] [LOCAL     ] IOT: Starting deletion of primary data.
[2025-10-24T19:23:51.424631] [DEBUG] [LOCAL     ] IOT: No primary data file found to delete.
[2025-10-24T19:23:51.424786] [INFO ] [LOCAL     ] IOT: Starting deletion of derivative data.
[2025-10-24T19:23:51.424957] [DEBUG] [LOCAL     ] IOT: Deleted derivative data file.
[2025-10-24T19:23:51.425387] [INFO ] [MAIN      ] Update Progress: 1120/2366 symbols completed. IOT took 29.0s. Estimated remaining: 2h 39m 59s. Rate: 7.8 symbols/min
[2025-10-24T19:23:51.999717] [INFO ] [MAIN      ] IPG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:23:52.121789] [INFO ] [MAIN      ] IP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:23:52.121012] [INFO ] [MAIN      ] IPI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:23:52.144775] [INFO ] [MAIN      ] IQI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:23:52.171366] [DEBUG] [LOCAL     ] IQI: Loaded 17831 existing records from primary storage.
[2025-10-24T19:23:52.171747] [INFO ] [MAIN      ] IQI: Loaded 17831 existing records.
[2025-10-24T19:23:52.282587] [DEBUG] [LOCAL     ] IPI: Loaded 21531 existing records from primary storage.
[2025-10-24T19:23:52.309744] [INFO ] [MAIN      ] IPI: Loaded 21531 existing records.
[2025-10-24T19:23:52.475486] [WARN ] [MAIN      ] IQI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:23:52.505689] [INFO ] [MAIN      ] IQI: Wiping existing primary data before full refresh.
[2025-10-24T19:23:52.524683] [DEBUG] [LOCAL     ] IPG: Loaded 53720 existing records from primary storage.
[2025-10-24T19:23:52.542758] [INFO ] [LOCAL     ] IQI: Starting deletion of primary data.
[2025-10-24T19:23:52.543194] [INFO ] [MAIN      ] IPG: Loaded 53720 existing records.
[2025-10-24T19:23:52.544201] [DEBUG] [LOCAL     ] IP: Loaded 53690 existing records from primary storage.
[2025-10-24T19:23:52.544272] [DEBUG] [LOCAL     ] IQI: Deleted primary data file.
[2025-10-24T19:23:52.555472] [INFO ] [MAIN      ] IQI: Starting full primary refresh.
[2025-10-24T19:23:52.605306] [INFO ] [MAIN      ] IP: Loaded 53690 existing records.
[2025-10-24T19:23:52.846061] [WARN ] [MAIN      ] IPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:23:52.921992] [INFO ] [MAIN      ] IPI: Wiping existing primary data before full refresh.
[2025-10-24T19:23:52.969717] [INFO ] [LOCAL     ] IPI: Starting deletion of primary data.
[2025-10-24T19:23:53.006024] [DEBUG] [LOCAL     ] IPI: Deleted primary data file.
[2025-10-24T19:23:53.006166] [INFO ] [MAIN      ] IPI: Starting full primary refresh.
[2025-10-24T19:23:53.277629] [WARN ] [MAIN      ] IPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:23:53.313802] [INFO ] [MAIN      ] IPG: Wiping existing primary data before full refresh.
[2025-10-24T19:23:53.286104] [WARN ] [MAIN      ] IP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:23:53.346241] [INFO ] [LOCAL     ] IPG: Starting deletion of primary data.
[2025-10-24T19:23:53.382505] [INFO ] [MAIN      ] IP: Wiping existing primary data before full refresh.
[2025-10-24T19:23:53.396540] [INFO ] [LOCAL     ] IP: Starting deletion of primary data.
[2025-10-24T19:23:53.388076] [DEBUG] [LOCAL     ] IPG: Deleted primary data file.
[2025-10-24T19:23:53.411253] [INFO ] [MAIN      ] IPG: Starting full primary refresh.
[2025-10-24T19:23:53.416633] [DEBUG] [LOCAL     ] IP: Deleted primary data file.
[2025-10-24T19:23:53.502529] [INFO ] [MAIN      ] IP: Starting full primary refresh.
[2025-10-24T19:23:53.803718] [INFO ] [REMOTE    ] IQI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:23:53.860234] [INFO ] [REMOTE    ] IQI: Fetching primary data for 2025-01.
[2025-10-24T19:23:54.332245] [INFO ] [REMOTE    ] IPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:23:54.349464] [INFO ] [REMOTE    ] IPI: Fetching primary data for 2025-01.
[2025-10-24T19:23:54.445246] [INFO ] [REMOTE    ] IPG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:23:54.455818] [INFO ] [REMOTE    ] IPG: Fetching primary data for 2025-01.
[2025-10-24T19:23:54.512693] [INFO ] [REMOTE    ] IP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:23:54.513017] [INFO ] [REMOTE    ] IP: Fetching primary data for 2025-01.
[2025-10-24T19:23:54.902619] [INFO ] [REMOTE    ] IQI: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T19:23:54.907165] [INFO ] [REMOTE    ] IQI: Fetching primary data for 2025-02.
[2025-10-24T19:23:55.316740] [INFO ] [REMOTE    ] IPI: Incremental fetch complete for 2025-01 (0.97 seconds).
[2025-10-24T19:23:55.320428] [INFO ] [REMOTE    ] IPI: Fetching primary data for 2025-02.
[2025-10-24T19:23:55.751988] [INFO ] [REMOTE    ] IQI: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T19:23:55.757293] [INFO ] [REMOTE    ] IQI: Fetching primary data for 2025-03.
[2025-10-24T19:23:55.945266] [INFO ] [REMOTE    ] IPI: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T19:23:55.949287] [INFO ] [REMOTE    ] IPI: Fetching primary data for 2025-03.
[2025-10-24T19:23:56.146166] [INFO ] [REMOTE    ] IP: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T19:23:56.156887] [INFO ] [REMOTE    ] IP: Fetching primary data for 2025-02.
[2025-10-24T19:23:56.205334] [INFO ] [REMOTE    ] IPG: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T19:23:56.215806] [INFO ] [REMOTE    ] IPG: Fetching primary data for 2025-02.
[2025-10-24T19:23:56.279006] [INFO ] [REMOTE    ] IQI: Incremental fetch complete for 2025-03 (0.52 seconds).
[2025-10-24T19:23:56.282808] [INFO ] [REMOTE    ] IQI: Fetching primary data for 2025-04.
[2025-10-24T19:23:56.948267] [INFO ] [REMOTE    ] IPI: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T19:23:56.953559] [INFO ] [REMOTE    ] IPI: Fetching primary data for 2025-04.
[2025-10-24T19:23:57.414779] [INFO ] [REMOTE    ] IQI: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T19:23:57.420177] [INFO ] [REMOTE    ] IQI: Fetching primary data for 2025-05.
[2025-10-24T19:23:57.492293] [INFO ] [REMOTE    ] IPG: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T19:23:57.596395] [INFO ] [REMOTE    ] IP: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T19:23:57.747606] [INFO ] [REMOTE    ] IP: Fetching primary data for 2025-03.
[2025-10-24T19:23:58.124413] [INFO ] [REMOTE    ] IQI: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T19:23:58.178537] [INFO ] [REMOTE    ] IPI: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T19:23:58.547696] [INFO ] [REMOTE    ] IQI: Fetching primary data for 2025-06.
[2025-10-24T19:23:59.347713] [INFO ] [REMOTE    ] IPI: Fetching primary data for 2025-05.
[2025-10-24T19:23:59.491691] [INFO ] [REMOTE    ] IQI: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T19:23:59.695837] [INFO ] [REMOTE    ] IP: Incremental fetch complete for 2025-03 (1.95 seconds).
[2025-10-24T19:24:00.147717] [INFO ] [REMOTE    ] IP: Fetching primary data for 2025-04.
[2025-10-24T19:24:00.514328] [INFO ] [REMOTE    ] IPI: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T19:24:00.947714] [INFO ] [REMOTE    ] IQI: Fetching primary data for 2025-07.
[2025-10-24T19:24:01.747721] [INFO ] [REMOTE    ] IPG: Fetching primary data for 2025-03.
[2025-10-24T19:24:01.981932] [INFO ] [REMOTE    ] IQI: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T19:24:02.213254] [INFO ] [REMOTE    ] IP: Incremental fetch complete for 2025-04 (2.07 seconds).
[2025-10-24T19:24:02.547717] [INFO ] [REMOTE    ] IQI: Fetching primary data for 2025-08.
[2025-10-24T19:24:03.229805] [INFO ] [REMOTE    ] IPG: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T19:24:03.284175] [INFO ] [REMOTE    ] IQI: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T19:24:03.347607] [INFO ] [REMOTE    ] IQI: Fetching primary data for 2025-09.
[2025-10-24T19:24:04.147630] [INFO ] [REMOTE    ] IPI: Fetching primary data for 2025-06.
[2025-10-24T19:24:04.321386] [INFO ] [REMOTE    ] IQI: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T19:24:04.876453] [INFO ] [REMOTE    ] IPI: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T19:24:04.947617] [INFO ] [REMOTE    ] IQI: Fetching primary data for 2025-10.
[2025-10-24T19:24:05.747625] [INFO ] [REMOTE    ] IPI: Fetching primary data for 2025-07.
[2025-10-24T19:24:05.926135] [INFO ] [REMOTE    ] IQI: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T19:24:05.929602] [INFO ] [REMOTE    ] IQI: Full fetch complete (26273 records).
[2025-10-24T19:24:05.929707] [DEBUG] [VALIDATOR ] IQI: Validating primary data.
[2025-10-24T19:24:06.339351] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present.
[2025-10-24T19:24:06.339433] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed.
[2025-10-24T19:24:06.340071] [INFO ] [MAIN      ] IQI: Fetched primary data is valid.
[2025-10-24T19:24:06.340174] [DEBUG] [LOCAL     ] IQI: Saving primary data.
[2025-10-24T19:24:06.340539] [FATAL] [LOCAL     ] IQI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:24:06.340637] [FATAL] [MAIN      ] IQI: Failed to save primary data.
[2025-10-24T19:24:06.340722] [WARN ] [MAIN      ] IQI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:24:06.340761] [INFO ] [LOCAL     ] IQI: Starting deletion of primary data.
[2025-10-24T19:24:06.340813] [DEBUG] [LOCAL     ] IQI: No primary data file found to delete.
[2025-10-24T19:24:06.340849] [INFO ] [LOCAL     ] IQI: Starting deletion of derivative data.
[2025-10-24T19:24:06.341001] [DEBUG] [LOCAL     ] IQI: Deleted derivative data file.
[2025-10-24T19:24:06.341106] [INFO ] [MAIN      ] Update Progress: 1121/2366 symbols completed. IQI took 14.9s. Estimated remaining: 2h 39m 60s. Rate: 7.8 symbols/min
[2025-10-24T19:24:06.532011] [INFO ] [MAIN      ] IQV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:24:06.558348] [INFO ] [REMOTE    ] IPG: Fetching primary data for 2025-04.
[2025-10-24T19:24:06.582602] [DEBUG] [LOCAL     ] IQV: Loaded 50338 existing records from primary storage.
[2025-10-24T19:24:06.582964] [INFO ] [MAIN      ] IQV: Loaded 50338 existing records.
[2025-10-24T19:24:06.784780] [INFO ] [REMOTE    ] IPI: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T19:24:06.790120] [WARN ] [MAIN      ] IQV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:24:06.790388] [INFO ] [MAIN      ] IQV: Wiping existing primary data before full refresh.
[2025-10-24T19:24:06.790484] [INFO ] [LOCAL     ] IQV: Starting deletion of primary data.
[2025-10-24T19:24:06.792022] [DEBUG] [LOCAL     ] IQV: Deleted primary data file.
[2025-10-24T19:24:06.794897] [INFO ] [MAIN      ] IQV: Starting full primary refresh.
[2025-10-24T19:24:07.161804] [INFO ] [REMOTE    ] IQV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:24:07.347679] [INFO ] [REMOTE    ] IPI: Fetching primary data for 2025-08.
[2025-10-24T19:24:08.147628] [INFO ] [REMOTE    ] IQV: Fetching primary data for 2025-01.
[2025-10-24T19:24:08.255163] [INFO ] [REMOTE    ] IPG: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T19:24:08.316762] [INFO ] [REMOTE    ] IPI: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T19:24:08.947731] [INFO ] [REMOTE    ] IPG: Fetching primary data for 2025-05.
[2025-10-24T19:24:09.747704] [INFO ] [REMOTE    ] IP: Fetching primary data for 2025-05.
[2025-10-24T19:24:09.834900] [INFO ] [REMOTE    ] IQV: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T19:24:10.320955] [INFO ] [REMOTE    ] IPG: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T19:24:10.547622] [INFO ] [REMOTE    ] IPG: Fetching primary data for 2025-06.
[2025-10-24T19:24:11.347705] [INFO ] [REMOTE    ] IPI: Fetching primary data for 2025-09.
[2025-10-24T19:24:11.434892] [INFO ] [REMOTE    ] IP: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T19:24:12.147740] [INFO ] [REMOTE    ] IQV: Fetching primary data for 2025-02.
[2025-10-24T19:24:12.271583] [INFO ] [REMOTE    ] IPG: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T19:24:12.276377] [INFO ] [REMOTE    ] IPI: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T19:24:12.947723] [INFO ] [REMOTE    ] IPI: Fetching primary data for 2025-10.
[2025-10-24T19:24:13.692971] [INFO ] [REMOTE    ] IQV: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T19:24:13.747608] [INFO ] [REMOTE    ] IQV: Fetching primary data for 2025-03.
[2025-10-24T19:24:14.126301] [INFO ] [REMOTE    ] IPI: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T19:24:14.131001] [INFO ] [REMOTE    ] IPI: Full fetch complete (30410 records).
[2025-10-24T19:24:14.131103] [DEBUG] [VALIDATOR ] IPI: Validating primary data.
[2025-10-24T19:24:14.535056] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present.
[2025-10-24T19:24:14.535129] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed.
[2025-10-24T19:24:14.535757] [INFO ] [MAIN      ] IPI: Fetched primary data is valid.
[2025-10-24T19:24:14.535817] [DEBUG] [LOCAL     ] IPI: Saving primary data.
[2025-10-24T19:24:14.536114] [FATAL] [LOCAL     ] IPI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:24:14.536204] [FATAL] [MAIN      ] IPI: Failed to save primary data.
[2025-10-24T19:24:14.536246] [WARN ] [MAIN      ] IPI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:24:14.536279] [INFO ] [LOCAL     ] IPI: Starting deletion of primary data.
[2025-10-24T19:24:14.536327] [DEBUG] [LOCAL     ] IPI: No primary data file found to delete.
[2025-10-24T19:24:14.536361] [INFO ] [LOCAL     ] IPI: Starting deletion of derivative data.
[2025-10-24T19:24:14.536466] [DEBUG] [LOCAL     ] IPI: Deleted derivative data file.
[2025-10-24T19:24:14.536532] [INFO ] [MAIN      ] Update Progress: 1122/2366 symbols completed. IPI took 23.1s. Estimated remaining: 2h 39m 52s. Rate: 7.8 symbols/min
[2025-10-24T19:24:14.551665] [INFO ] [REMOTE    ] IPG: Fetching primary data for 2025-07.
[2025-10-24T19:24:14.704583] [INFO ] [MAIN      ] IR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:24:14.754067] [DEBUG] [LOCAL     ] IR: Loaded 53119 existing records from primary storage.
[2025-10-24T19:24:14.754353] [INFO ] [MAIN      ] IR: Loaded 53119 existing records.
[2025-10-24T19:24:14.935964] [WARN ] [MAIN      ] IR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:24:14.936183] [INFO ] [MAIN      ] IR: Wiping existing primary data before full refresh.
[2025-10-24T19:24:14.936227] [INFO ] [LOCAL     ] IR: Starting deletion of primary data.
[2025-10-24T19:24:14.936821] [DEBUG] [LOCAL     ] IR: Deleted primary data file.
[2025-10-24T19:24:14.936878] [INFO ] [MAIN      ] IR: Starting full primary refresh.
[2025-10-24T19:24:15.299848] [INFO ] [REMOTE    ] IR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:24:15.347722] [INFO ] [REMOTE    ] IP: Fetching primary data for 2025-06.
[2025-10-24T19:24:15.447372] [INFO ] [REMOTE    ] IQV: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T19:24:16.147752] [INFO ] [REMOTE    ] IR: Fetching primary data for 2025-01.
[2025-10-24T19:24:16.309382] [INFO ] [REMOTE    ] IPG: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T19:24:16.903337] [INFO ] [REMOTE    ] IP: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T19:24:16.947604] [INFO ] [REMOTE    ] IP: Fetching primary data for 2025-07.
[2025-10-24T19:24:17.732155] [INFO ] [REMOTE    ] IR: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T19:24:17.747601] [INFO ] [REMOTE    ] IR: Fetching primary data for 2025-02.
[2025-10-24T19:24:18.547694] [INFO ] [REMOTE    ] IPG: Fetching primary data for 2025-08.
[2025-10-24T19:24:18.837044] [INFO ] [REMOTE    ] IP: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T19:24:19.230564] [INFO ] [REMOTE    ] IR: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T19:24:19.347637] [INFO ] [REMOTE    ] IR: Fetching primary data for 2025-03.
[2025-10-24T19:24:20.151761] [INFO ] [REMOTE    ] IP: Fetching primary data for 2025-08.
[2025-10-24T19:24:20.157530] [INFO ] [REMOTE    ] IPG: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T19:24:20.906299] [INFO ] [REMOTE    ] IR: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T19:24:20.947617] [INFO ] [REMOTE    ] IR: Fetching primary data for 2025-04.
[2025-10-24T19:24:21.747752] [INFO ] [REMOTE    ] IQV: Fetching primary data for 2025-04.
[2025-10-24T19:24:21.892814] [INFO ] [REMOTE    ] IP: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T19:24:22.550200] [INFO ] [REMOTE    ] IP: Fetching primary data for 2025-09.
[2025-10-24T19:24:22.556490] [INFO ] [REMOTE    ] IR: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T19:24:23.347696] [INFO ] [REMOTE    ] IR: Fetching primary data for 2025-05.
[2025-10-24T19:24:23.636996] [INFO ] [REMOTE    ] IQV: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T19:24:24.122432] [INFO ] [REMOTE    ] IP: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T19:24:24.147682] [INFO ] [REMOTE    ] IP: Fetching primary data for 2025-10.
[2025-10-24T19:24:24.947636] [INFO ] [REMOTE    ] IPG: Fetching primary data for 2025-09.
[2025-10-24T19:24:25.029240] [INFO ] [REMOTE    ] IR: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T19:24:25.747684] [INFO ] [REMOTE    ] IR: Fetching primary data for 2025-06.
[2025-10-24T19:24:25.872525] [INFO ] [REMOTE    ] IP: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T19:24:25.882901] [INFO ] [REMOTE    ] IP: Full fetch complete (77419 records).
[2025-10-24T19:24:25.883046] [DEBUG] [VALIDATOR ] IP: Validating primary data.
[2025-10-24T19:24:26.308284] [DEBUG] [VALIDATOR ] IP: All expected trading days are present.
[2025-10-24T19:24:26.308409] [DEBUG] [VALIDATOR ] IP: Primary data validation passed.
[2025-10-24T19:24:26.309539] [INFO ] [MAIN      ] IP: Fetched primary data is valid.
[2025-10-24T19:24:26.309603] [DEBUG] [LOCAL     ] IP: Saving primary data.
[2025-10-24T19:24:26.310248] [FATAL] [LOCAL     ] IP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:24:26.310337] [FATAL] [MAIN      ] IP: Failed to save primary data.
[2025-10-24T19:24:26.310405] [WARN ] [MAIN      ] IP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:24:26.310475] [INFO ] [LOCAL     ] IP: Starting deletion of primary data.
[2025-10-24T19:24:26.310536] [DEBUG] [LOCAL     ] IP: No primary data file found to delete.
[2025-10-24T19:24:26.310572] [INFO ] [LOCAL     ] IP: Starting deletion of derivative data.
[2025-10-24T19:24:26.310771] [DEBUG] [LOCAL     ] IP: Deleted derivative data file.
[2025-10-24T19:24:26.310994] [INFO ] [MAIN      ] Update Progress: 1123/2366 symbols completed. IP took 34.9s. Estimated remaining: 2h 39m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:24:26.487926] [INFO ] [MAIN      ] IRM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:24:26.527738] [INFO ] [REMOTE    ] IPG: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T19:24:26.554222] [INFO ] [REMOTE    ] IPG: Fetching primary data for 2025-10.
[2025-10-24T19:24:26.581104] [DEBUG] [LOCAL     ] IRM: Loaded 49213 existing records from primary storage.
[2025-10-24T19:24:26.581551] [INFO ] [MAIN      ] IRM: Loaded 49213 existing records.
[2025-10-24T19:24:26.760436] [WARN ] [MAIN      ] IRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:24:26.760740] [INFO ] [MAIN      ] IRM: Wiping existing primary data before full refresh.
[2025-10-24T19:24:26.760793] [INFO ] [LOCAL     ] IRM: Starting deletion of primary data.
[2025-10-24T19:24:26.761301] [DEBUG] [LOCAL     ] IRM: Deleted primary data file.
[2025-10-24T19:24:26.761356] [INFO ] [MAIN      ] IRM: Starting full primary refresh.
[2025-10-24T19:24:27.130826] [INFO ] [REMOTE    ] IRM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:24:27.344598] [INFO ] [REMOTE    ] IR: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T19:24:27.354860] [INFO ] [REMOTE    ] IQV: Fetching primary data for 2025-05.
[2025-10-24T19:24:28.092606] [INFO ] [REMOTE    ] IPG: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T19:24:28.103050] [INFO ] [REMOTE    ] IPG: Full fetch complete (77445 records).
[2025-10-24T19:24:28.103207] [DEBUG] [VALIDATOR ] IPG: Validating primary data.
[2025-10-24T19:24:28.152788] [INFO ] [REMOTE    ] IRM: Fetching primary data for 2025-01.
[2025-10-24T19:24:28.502710] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present.
[2025-10-24T19:24:28.502808] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed.
[2025-10-24T19:24:28.503873] [INFO ] [MAIN      ] IPG: Fetched primary data is valid.
[2025-10-24T19:24:28.503939] [DEBUG] [LOCAL     ] IPG: Saving primary data.
[2025-10-24T19:24:28.504620] [FATAL] [LOCAL     ] IPG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:24:28.504744] [FATAL] [MAIN      ] IPG: Failed to save primary data.
[2025-10-24T19:24:28.504786] [WARN ] [MAIN      ] IPG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:24:28.504821] [INFO ] [LOCAL     ] IPG: Starting deletion of primary data.
[2025-10-24T19:24:28.504875] [DEBUG] [LOCAL     ] IPG: No primary data file found to delete.
[2025-10-24T19:24:28.504910] [INFO ] [LOCAL     ] IPG: Starting deletion of derivative data.
[2025-10-24T19:24:28.505039] [DEBUG] [LOCAL     ] IPG: Deleted derivative data file.
[2025-10-24T19:24:28.505402] [INFO ] [MAIN      ] Update Progress: 1124/2366 symbols completed. IPG took 37.1s. Estimated remaining: 2h 39m 35s. Rate: 7.8 symbols/min
[2025-10-24T19:24:28.674446] [INFO ] [MAIN      ] IRS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:24:28.700513] [DEBUG] [LOCAL     ] IRS: Loaded 23500 existing records from primary storage.
[2025-10-24T19:24:28.700810] [INFO ] [MAIN      ] IRS: Loaded 23500 existing records.
[2025-10-24T19:24:28.881576] [WARN ] [MAIN      ] IRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:24:28.881845] [INFO ] [MAIN      ] IRS: Wiping existing primary data before full refresh.
[2025-10-24T19:24:28.881893] [INFO ] [LOCAL     ] IRS: Starting deletion of primary data.
[2025-10-24T19:24:28.882219] [DEBUG] [LOCAL     ] IRS: Deleted primary data file.
[2025-10-24T19:24:28.882274] [INFO ] [MAIN      ] IRS: Starting full primary refresh.
[2025-10-24T19:24:28.961687] [INFO ] [REMOTE    ] IR: Fetching primary data for 2025-07.
[2025-10-24T19:24:29.246632] [INFO ] [REMOTE    ] IRS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:24:29.275594] [INFO ] [REMOTE    ] IQV: Incremental fetch complete for 2025-05 (1.92 seconds).
[2025-10-24T19:24:29.747712] [INFO ] [REMOTE    ] IQV: Fetching primary data for 2025-06.
[2025-10-24T19:24:29.909867] [INFO ] [REMOTE    ] IRM: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T19:24:30.547733] [INFO ] [REMOTE    ] IRS: Fetching primary data for 2025-01.
[2025-10-24T19:24:30.623953] [INFO ] [REMOTE    ] IR: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T19:24:31.163786] [INFO ] [REMOTE    ] IQV: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T19:24:31.347695] [INFO ] [REMOTE    ] IQV: Fetching primary data for 2025-07.
[2025-10-24T19:24:31.656146] [INFO ] [REMOTE    ] IRS: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T19:24:32.147635] [INFO ] [REMOTE    ] IRM: Fetching primary data for 2025-02.
[2025-10-24T19:24:32.947673] [INFO ] [REMOTE    ] IR: Fetching primary data for 2025-08.
[2025-10-24T19:24:33.189972] [INFO ] [REMOTE    ] IQV: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T19:24:33.345427] [INFO ] [REMOTE    ] IRM: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T19:24:33.747668] [INFO ] [REMOTE    ] IRM: Fetching primary data for 2025-03.
[2025-10-24T19:24:34.547620] [INFO ] [REMOTE    ] IQV: Fetching primary data for 2025-08.
[2025-10-24T19:24:34.595767] [INFO ] [REMOTE    ] IR: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T19:24:35.347711] [INFO ] [REMOTE    ] IR: Fetching primary data for 2025-09.
[2025-10-24T19:24:35.476012] [INFO ] [REMOTE    ] IRM: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T19:24:36.064227] [INFO ] [REMOTE    ] IQV: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T19:24:36.147690] [INFO ] [REMOTE    ] IRS: Fetching primary data for 2025-02.
[2025-10-24T19:24:36.555855] [INFO ] [REMOTE    ] IR: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T19:24:36.947617] [INFO ] [REMOTE    ] IRM: Fetching primary data for 2025-04.
[2025-10-24T19:24:37.111367] [INFO ] [REMOTE    ] IRS: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T19:24:37.747718] [INFO ] [REMOTE    ] IR: Fetching primary data for 2025-10.
[2025-10-24T19:24:38.547606] [INFO ] [REMOTE    ] IRS: Fetching primary data for 2025-03.
[2025-10-24T19:24:38.745395] [INFO ] [REMOTE    ] IRM: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T19:24:39.347701] [INFO ] [REMOTE    ] IRM: Fetching primary data for 2025-05.
[2025-10-24T19:24:39.607058] [INFO ] [REMOTE    ] IR: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T19:24:39.618937] [INFO ] [REMOTE    ] IR: Full fetch complete (76478 records).
[2025-10-24T19:24:39.619061] [DEBUG] [VALIDATOR ] IR: Validating primary data.
[2025-10-24T19:24:39.739402] [INFO ] [REMOTE    ] IRS: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T19:24:40.027619] [DEBUG] [VALIDATOR ] IR: All expected trading days are present.
[2025-10-24T19:24:40.027725] [DEBUG] [VALIDATOR ] IR: Primary data validation passed.
[2025-10-24T19:24:40.028765] [INFO ] [MAIN      ] IR: Fetched primary data is valid.
[2025-10-24T19:24:40.028825] [DEBUG] [LOCAL     ] IR: Saving primary data.
[2025-10-24T19:24:40.029538] [FATAL] [LOCAL     ] IR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:24:40.029666] [FATAL] [MAIN      ] IR: Failed to save primary data.
[2025-10-24T19:24:40.029754] [WARN ] [MAIN      ] IR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:24:40.029855] [INFO ] [LOCAL     ] IR: Starting deletion of primary data.
[2025-10-24T19:24:40.029968] [DEBUG] [LOCAL     ] IR: No primary data file found to delete.
[2025-10-24T19:24:40.030049] [INFO ] [LOCAL     ] IR: Starting deletion of derivative data.
[2025-10-24T19:24:40.030700] [DEBUG] [LOCAL     ] IR: Deleted derivative data file.
[2025-10-24T19:24:40.031302] [INFO ] [MAIN      ] Update Progress: 1125/2366 symbols completed. IR took 25.5s. Estimated remaining: 2h 39m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:24:40.152803] [INFO ] [REMOTE    ] IQV: Fetching primary data for 2025-09.
[2025-10-24T19:24:40.203287] [INFO ] [MAIN      ] IRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:24:40.255058] [DEBUG] [LOCAL     ] IRT: Loaded 50769 existing records from primary storage.
[2025-10-24T19:24:40.255343] [INFO ] [MAIN      ] IRT: Loaded 50769 existing records.
[2025-10-24T19:24:40.437455] [WARN ] [MAIN      ] IRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:24:40.437700] [INFO ] [MAIN      ] IRT: Wiping existing primary data before full refresh.
[2025-10-24T19:24:40.437791] [INFO ] [LOCAL     ] IRT: Starting deletion of primary data.
[2025-10-24T19:24:40.438404] [DEBUG] [LOCAL     ] IRT: Deleted primary data file.
[2025-10-24T19:24:40.438461] [INFO ] [MAIN      ] IRT: Starting full primary refresh.
[2025-10-24T19:24:40.792888] [INFO ] [REMOTE    ] IRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:24:40.947623] [INFO ] [REMOTE    ] IRT: Fetching primary data for 2025-01.
[2025-10-24T19:24:41.041011] [INFO ] [REMOTE    ] IRM: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T19:24:41.743864] [INFO ] [REMOTE    ] IQV: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T19:24:41.752737] [INFO ] [REMOTE    ] IRM: Fetching primary data for 2025-06.
[2025-10-24T19:24:42.335935] [INFO ] [REMOTE    ] IRT: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T19:24:42.547681] [INFO ] [REMOTE    ] IRT: Fetching primary data for 2025-02.
[2025-10-24T19:24:43.332686] [INFO ] [REMOTE    ] IRM: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T19:24:43.347591] [INFO ] [REMOTE    ] IRM: Fetching primary data for 2025-07.
[2025-10-24T19:24:43.963540] [INFO ] [REMOTE    ] IRT: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T19:24:44.147634] [INFO ] [REMOTE    ] IRT: Fetching primary data for 2025-03.
[2025-10-24T19:24:44.947614] [INFO ] [REMOTE    ] IQV: Fetching primary data for 2025-10.
[2025-10-24T19:24:45.121849] [INFO ] [REMOTE    ] IRM: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T19:24:45.687767] [INFO ] [REMOTE    ] IRT: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T19:24:45.747605] [INFO ] [REMOTE    ] IRT: Fetching primary data for 2025-04.
[2025-10-24T19:24:46.547612] [INFO ] [REMOTE    ] IRS: Fetching primary data for 2025-04.
[2025-10-24T19:24:46.653535] [INFO ] [REMOTE    ] IQV: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T19:24:46.663089] [INFO ] [REMOTE    ] IQV: Full fetch complete (72625 records).
[2025-10-24T19:24:46.663259] [DEBUG] [VALIDATOR ] IQV: Validating primary data.
[2025-10-24T19:24:47.052182] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present.
[2025-10-24T19:24:47.052280] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed.
[2025-10-24T19:24:47.053363] [INFO ] [MAIN      ] IQV: Fetched primary data is valid.
[2025-10-24T19:24:47.053425] [DEBUG] [LOCAL     ] IQV: Saving primary data.
[2025-10-24T19:24:47.054002] [FATAL] [LOCAL     ] IQV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:24:47.054089] [FATAL] [MAIN      ] IQV: Failed to save primary data.
[2025-10-24T19:24:47.054131] [WARN ] [MAIN      ] IQV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:24:47.054193] [INFO ] [LOCAL     ] IQV: Starting deletion of primary data.
[2025-10-24T19:24:47.054252] [DEBUG] [LOCAL     ] IQV: No primary data file found to delete.
[2025-10-24T19:24:47.054288] [INFO ] [LOCAL     ] IQV: Starting deletion of derivative data.
[2025-10-24T19:24:47.054413] [DEBUG] [LOCAL     ] IQV: Deleted derivative data file.
[2025-10-24T19:24:47.054713] [INFO ] [MAIN      ] Update Progress: 1126/2366 symbols completed. IQV took 40.7s. Estimated remaining: 2h 39m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:24:47.229590] [INFO ] [MAIN      ] ISD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:24:47.248946] [DEBUG] [LOCAL     ] ISD: Loaded 15726 existing records from primary storage.
[2025-10-24T19:24:47.249233] [INFO ] [MAIN      ] ISD: Loaded 15726 existing records.
[2025-10-24T19:24:47.354695] [INFO ] [REMOTE    ] IRM: Fetching primary data for 2025-08.
[2025-10-24T19:24:47.420699] [INFO ] [REMOTE    ] IRT: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T19:24:47.492618] [WARN ] [MAIN      ] ISD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:24:47.492822] [INFO ] [MAIN      ] ISD: Wiping existing primary data before full refresh.
[2025-10-24T19:24:47.492874] [INFO ] [LOCAL     ] ISD: Starting deletion of primary data.
[2025-10-24T19:24:47.493086] [DEBUG] [LOCAL     ] ISD: Deleted primary data file.
[2025-10-24T19:24:47.493124] [INFO ] [MAIN      ] ISD: Starting full primary refresh.
[2025-10-24T19:24:47.635843] [INFO ] [REMOTE    ] IRS: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T19:24:47.864806] [INFO ] [REMOTE    ] ISD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:24:48.147700] [INFO ] [REMOTE    ] IRS: Fetching primary data for 2025-05.
[2025-10-24T19:24:48.952764] [INFO ] [REMOTE    ] ISD: Fetching primary data for 2025-01.
[2025-10-24T19:24:48.969804] [INFO ] [REMOTE    ] IRM: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T19:24:49.144335] [INFO ] [REMOTE    ] IRS: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T19:24:49.747727] [INFO ] [REMOTE    ] IRT: Fetching primary data for 2025-05.
[2025-10-24T19:24:49.948017] [INFO ] [REMOTE    ] ISD: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T19:24:50.547632] [INFO ] [REMOTE    ] IRM: Fetching primary data for 2025-09.
[2025-10-24T19:24:51.270101] [INFO ] [REMOTE    ] IRT: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T19:24:51.347693] [INFO ] [REMOTE    ] IRT: Fetching primary data for 2025-06.
[2025-10-24T19:24:51.990338] [INFO ] [REMOTE    ] IRM: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T19:24:52.147728] [INFO ] [REMOTE    ] ISD: Fetching primary data for 2025-02.
[2025-10-24T19:24:52.592586] [INFO ] [REMOTE    ] IRT: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T19:24:52.947628] [INFO ] [REMOTE    ] IRT: Fetching primary data for 2025-07.
[2025-10-24T19:24:53.098808] [INFO ] [REMOTE    ] ISD: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T19:24:53.747625] [INFO ] [REMOTE    ] ISD: Fetching primary data for 2025-03.
[2025-10-24T19:24:54.530194] [INFO ] [REMOTE    ] IRT: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T19:24:54.547591] [INFO ] [REMOTE    ] IRT: Fetching primary data for 2025-08.
[2025-10-24T19:24:54.690399] [INFO ] [REMOTE    ] ISD: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T19:24:55.347736] [INFO ] [REMOTE    ] ISD: Fetching primary data for 2025-04.
[2025-10-24T19:24:56.147616] [INFO ] [REMOTE    ] IRS: Fetching primary data for 2025-06.
[2025-10-24T19:24:56.191574] [INFO ] [REMOTE    ] IRT: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T19:24:56.270337] [INFO ] [REMOTE    ] ISD: Incremental fetch complete for 2025-04 (0.92 seconds).
[2025-10-24T19:24:56.947672] [INFO ] [REMOTE    ] IRT: Fetching primary data for 2025-09.
[2025-10-24T19:24:57.217573] [INFO ] [REMOTE    ] IRS: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T19:24:57.747670] [INFO ] [REMOTE    ] IRS: Fetching primary data for 2025-07.
[2025-10-24T19:24:58.228358] [INFO ] [REMOTE    ] IRT: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T19:24:58.506631] [INFO ] [REMOTE    ] IRS: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T19:24:58.547609] [INFO ] [REMOTE    ] IRS: Fetching primary data for 2025-08.
[2025-10-24T19:24:59.347617] [INFO ] [REMOTE    ] IRT: Fetching primary data for 2025-10.
[2025-10-24T19:24:59.491055] [INFO ] [REMOTE    ] IRS: Incremental fetch complete for 2025-08 (0.94 seconds).
[2025-10-24T19:25:00.147616] [INFO ] [REMOTE    ] IRM: Fetching primary data for 2025-10.
[2025-10-24T19:25:00.947675] [INFO ] [REMOTE    ] IRS: Fetching primary data for 2025-09.
[2025-10-24T19:25:01.030320] [INFO ] [REMOTE    ] IRT: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T19:25:01.039746] [INFO ] [REMOTE    ] IRT: Full fetch complete (72837 records).
[2025-10-24T19:25:01.039929] [DEBUG] [VALIDATOR ] IRT: Validating primary data.
[2025-10-24T19:25:01.470401] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present.
[2025-10-24T19:25:01.470489] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed.
[2025-10-24T19:25:01.471494] [INFO ] [MAIN      ] IRT: Fetched primary data is valid.
[2025-10-24T19:25:01.471557] [DEBUG] [LOCAL     ] IRT: Saving primary data.
[2025-10-24T19:25:01.472171] [FATAL] [LOCAL     ] IRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:25:01.472264] [FATAL] [MAIN      ] IRT: Failed to save primary data.
[2025-10-24T19:25:01.472306] [WARN ] [MAIN      ] IRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:25:01.472343] [INFO ] [LOCAL     ] IRT: Starting deletion of primary data.
[2025-10-24T19:25:01.472418] [DEBUG] [LOCAL     ] IRT: No primary data file found to delete.
[2025-10-24T19:25:01.472455] [INFO ] [LOCAL     ] IRT: Starting deletion of derivative data.
[2025-10-24T19:25:01.472566] [DEBUG] [LOCAL     ] IRT: Deleted derivative data file.
[2025-10-24T19:25:01.472793] [INFO ] [MAIN      ] Update Progress: 1127/2366 symbols completed. IRT took 21.4s. Estimated remaining: 2h 39m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:25:01.645743] [INFO ] [MAIN      ] IT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:25:01.688276] [DEBUG] [LOCAL     ] IT: Loaded 42542 existing records from primary storage.
[2025-10-24T19:25:01.688570] [INFO ] [MAIN      ] IT: Loaded 42542 existing records.
[2025-10-24T19:25:01.756458] [INFO ] [REMOTE    ] ISD: Fetching primary data for 2025-05.
[2025-10-24T19:25:01.884963] [WARN ] [MAIN      ] IT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:25:01.885156] [INFO ] [MAIN      ] IT: Wiping existing primary data before full refresh.
[2025-10-24T19:25:01.885204] [INFO ] [LOCAL     ] IT: Starting deletion of primary data.
[2025-10-24T19:25:01.886021] [DEBUG] [LOCAL     ] IT: Deleted primary data file.
[2025-10-24T19:25:01.886078] [INFO ] [MAIN      ] IT: Starting full primary refresh.
[2025-10-24T19:25:02.321011] [INFO ] [REMOTE    ] IT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:25:02.324045] [INFO ] [REMOTE    ] IRM: Incremental fetch complete for 2025-10 (2.18 seconds).
[2025-10-24T19:25:02.349689] [INFO ] [REMOTE    ] IRM: Full fetch complete (71995 records).
[2025-10-24T19:25:02.362990] [DEBUG] [VALIDATOR ] IRM: Validating primary data.
[2025-10-24T19:25:02.366130] [INFO ] [REMOTE    ] IRS: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T19:25:02.563539] [INFO ] [REMOTE    ] IT: Fetching primary data for 2025-01.
[2025-10-24T19:25:02.828939] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present.
[2025-10-24T19:25:02.829036] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed.
[2025-10-24T19:25:02.830416] [INFO ] [MAIN      ] IRM: Fetched primary data is valid.
[2025-10-24T19:25:02.830489] [DEBUG] [LOCAL     ] IRM: Saving primary data.
[2025-10-24T19:25:02.831195] [FATAL] [LOCAL     ] IRM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:25:02.831294] [FATAL] [MAIN      ] IRM: Failed to save primary data.
[2025-10-24T19:25:02.831336] [WARN ] [MAIN      ] IRM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:25:02.831378] [INFO ] [LOCAL     ] IRM: Starting deletion of primary data.
[2025-10-24T19:25:02.831434] [DEBUG] [LOCAL     ] IRM: No primary data file found to delete.
[2025-10-24T19:25:02.831476] [INFO ] [LOCAL     ] IRM: Starting deletion of derivative data.
[2025-10-24T19:25:02.831727] [DEBUG] [LOCAL     ] IRM: Deleted derivative data file.
[2025-10-24T19:25:02.832417] [INFO ] [MAIN      ] Update Progress: 1128/2366 symbols completed. IRM took 36.5s. Estimated remaining: 2h 39m 8s. Rate: 7.8 symbols/min
[2025-10-24T19:25:03.093894] [INFO ] [MAIN      ] ITGR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:25:03.111731] [INFO ] [REMOTE    ] ISD: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T19:25:03.167417] [DEBUG] [LOCAL     ] ITGR: Loaded 31335 existing records from primary storage.
[2025-10-24T19:25:03.167891] [INFO ] [MAIN      ] ITGR: Loaded 31335 existing records.
[2025-10-24T19:25:03.363471] [INFO ] [REMOTE    ] ISD: Fetching primary data for 2025-06.
[2025-10-24T19:25:03.418555] [WARN ] [MAIN      ] ITGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:25:03.419218] [INFO ] [MAIN      ] ITGR: Wiping existing primary data before full refresh.
[2025-10-24T19:25:03.419299] [INFO ] [LOCAL     ] ITGR: Starting deletion of primary data.
[2025-10-24T19:25:03.419811] [DEBUG] [LOCAL     ] ITGR: Deleted primary data file.
[2025-10-24T19:25:03.419886] [INFO ] [MAIN      ] ITGR: Starting full primary refresh.
[2025-10-24T19:25:03.916802] [INFO ] [REMOTE    ] ITGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:25:04.147726] [INFO ] [REMOTE    ] IRS: Fetching primary data for 2025-10.
[2025-10-24T19:25:04.179332] [INFO ] [REMOTE    ] IT: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T19:25:04.523126] [INFO ] [REMOTE    ] ISD: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T19:25:04.947689] [INFO ] [REMOTE    ] ITGR: Fetching primary data for 2025-01.
[2025-10-24T19:25:05.402418] [INFO ] [REMOTE    ] IRS: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T19:25:05.407930] [INFO ] [REMOTE    ] IRS: Full fetch complete (32636 records).
[2025-10-24T19:25:05.408013] [DEBUG] [VALIDATOR ] IRS: Validating primary data.
[2025-10-24T19:25:05.747867] [INFO ] [REMOTE    ] IT: Fetching primary data for 2025-02.
[2025-10-24T19:25:05.776392] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present.
[2025-10-24T19:25:05.776454] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed.
[2025-10-24T19:25:05.777159] [INFO ] [MAIN      ] IRS: Fetched primary data is valid.
[2025-10-24T19:25:05.777242] [DEBUG] [LOCAL     ] IRS: Saving primary data.
[2025-10-24T19:25:05.777575] [FATAL] [LOCAL     ] IRS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:25:05.777675] [FATAL] [MAIN      ] IRS: Failed to save primary data.
[2025-10-24T19:25:05.777750] [WARN ] [MAIN      ] IRS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:25:05.777819] [INFO ] [LOCAL     ] IRS: Starting deletion of primary data.
[2025-10-24T19:25:05.777875] [DEBUG] [LOCAL     ] IRS: No primary data file found to delete.
[2025-10-24T19:25:05.777910] [INFO ] [LOCAL     ] IRS: Starting deletion of derivative data.
[2025-10-24T19:25:05.778067] [DEBUG] [LOCAL     ] IRS: Deleted derivative data file.
[2025-10-24T19:25:05.778156] [INFO ] [MAIN      ] Update Progress: 1129/2366 symbols completed. IRS took 37.3s. Estimated remaining: 2h 38m 55s. Rate: 7.8 symbols/min
[2025-10-24T19:25:05.945584] [INFO ] [MAIN      ] ITT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:25:05.980996] [DEBUG] [LOCAL     ] ITT: Loaded 32539 existing records from primary storage.
[2025-10-24T19:25:05.981262] [INFO ] [MAIN      ] ITT: Loaded 32539 existing records.
[2025-10-24T19:25:06.142050] [INFO ] [REMOTE    ] ITGR: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T19:25:06.187238] [WARN ] [MAIN      ] ITT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:25:06.187440] [INFO ] [MAIN      ] ITT: Wiping existing primary data before full refresh.
[2025-10-24T19:25:06.187531] [INFO ] [LOCAL     ] ITT: Starting deletion of primary data.
[2025-10-24T19:25:06.187927] [DEBUG] [LOCAL     ] ITT: Deleted primary data file.
[2025-10-24T19:25:06.187983] [INFO ] [MAIN      ] ITT: Starting full primary refresh.
[2025-10-24T19:25:06.533501] [INFO ] [REMOTE    ] ITT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:25:06.547604] [INFO ] [REMOTE    ] ITT: Fetching primary data for 2025-01.
[2025-10-24T19:25:07.152071] [INFO ] [REMOTE    ] IT: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T19:25:07.347735] [INFO ] [REMOTE    ] IT: Fetching primary data for 2025-03.
[2025-10-24T19:25:07.634062] [INFO ] [REMOTE    ] ITT: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T19:25:08.147731] [INFO ] [REMOTE    ] ISD: Fetching primary data for 2025-07.
[2025-10-24T19:25:08.780084] [INFO ] [REMOTE    ] ISD: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T19:25:08.935462] [INFO ] [REMOTE    ] IT: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T19:25:08.947615] [INFO ] [REMOTE    ] ITGR: Fetching primary data for 2025-02.
[2025-10-24T19:25:09.747621] [INFO ] [REMOTE    ] ISD: Fetching primary data for 2025-08.
[2025-10-24T19:25:10.059023] [INFO ] [REMOTE    ] ITGR: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T19:25:10.547763] [INFO ] [REMOTE    ] ITGR: Fetching primary data for 2025-03.
[2025-10-24T19:25:10.651592] [INFO ] [REMOTE    ] ISD: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T19:25:11.347712] [INFO ] [REMOTE    ] ITT: Fetching primary data for 2025-02.
[2025-10-24T19:25:11.884307] [INFO ] [REMOTE    ] ITGR: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T19:25:12.147732] [INFO ] [REMOTE    ] ITGR: Fetching primary data for 2025-04.
[2025-10-24T19:25:12.820378] [INFO ] [REMOTE    ] ITT: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T19:25:12.947702] [INFO ] [REMOTE    ] ISD: Fetching primary data for 2025-09.
[2025-10-24T19:25:13.680915] [INFO ] [REMOTE    ] ITGR: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T19:25:13.701951] [INFO ] [REMOTE    ] ISD: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T19:25:13.747610] [INFO ] [REMOTE    ] IT: Fetching primary data for 2025-04.
[2025-10-24T19:25:14.547639] [INFO ] [REMOTE    ] ISD: Fetching primary data for 2025-10.
[2025-10-24T19:25:15.218189] [INFO ] [REMOTE    ] IT: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T19:25:15.347621] [INFO ] [REMOTE    ] ITGR: Fetching primary data for 2025-05.
[2025-10-24T19:25:15.801750] [INFO ] [REMOTE    ] ISD: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T19:25:15.805416] [INFO ] [REMOTE    ] ISD: Full fetch complete (24029 records).
[2025-10-24T19:25:15.805533] [DEBUG] [VALIDATOR ] ISD: Validating primary data.
[2025-10-24T19:25:16.156109] [INFO ] [REMOTE    ] IT: Fetching primary data for 2025-05.
[2025-10-24T19:25:16.167906] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present.
[2025-10-24T19:25:16.168517] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed.
[2025-10-24T19:25:16.169133] [INFO ] [MAIN      ] ISD: Fetched primary data is valid.
[2025-10-24T19:25:16.169219] [DEBUG] [LOCAL     ] ISD: Saving primary data.
[2025-10-24T19:25:16.169551] [FATAL] [LOCAL     ] ISD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:25:16.169667] [FATAL] [MAIN      ] ISD: Failed to save primary data.
[2025-10-24T19:25:16.169753] [WARN ] [MAIN      ] ISD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:25:16.169835] [INFO ] [LOCAL     ] ISD: Starting deletion of primary data.
[2025-10-24T19:25:16.169901] [DEBUG] [LOCAL     ] ISD: No primary data file found to delete.
[2025-10-24T19:25:16.169939] [INFO ] [LOCAL     ] ISD: Starting deletion of derivative data.
[2025-10-24T19:25:16.170080] [DEBUG] [LOCAL     ] ISD: Deleted derivative data file.
[2025-10-24T19:25:16.170179] [INFO ] [MAIN      ] Update Progress: 1130/2366 symbols completed. ISD took 29.1s. Estimated remaining: 2h 38m 51s. Rate: 7.8 symbols/min
[2025-10-24T19:25:16.341837] [INFO ] [MAIN      ] ITUB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:25:16.394491] [DEBUG] [LOCAL     ] ITUB: Loaded 53701 existing records from primary storage.
[2025-10-24T19:25:16.394822] [INFO ] [MAIN      ] ITUB: Loaded 53701 existing records.
[2025-10-24T19:25:16.579245] [WARN ] [MAIN      ] ITUB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:25:16.579528] [INFO ] [MAIN      ] ITUB: Wiping existing primary data before full refresh.
[2025-10-24T19:25:16.579634] [INFO ] [LOCAL     ] ITUB: Starting deletion of primary data.
[2025-10-24T19:25:16.580522] [DEBUG] [LOCAL     ] ITUB: Deleted primary data file.
[2025-10-24T19:25:16.580599] [INFO ] [MAIN      ] ITUB: Starting full primary refresh.
[2025-10-24T19:25:16.770684] [INFO ] [REMOTE    ] ITGR: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T19:25:16.962282] [INFO ] [REMOTE    ] ITGR: Fetching primary data for 2025-06.
[2025-10-24T19:25:17.004832] [INFO ] [REMOTE    ] ITUB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:25:17.747620] [INFO ] [REMOTE    ] ITUB: Fetching primary data for 2025-01.
[2025-10-24T19:25:17.792120] [INFO ] [REMOTE    ] IT: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T19:25:17.883358] [INFO ] [REMOTE    ] ITGR: Incremental fetch complete for 2025-06 (0.92 seconds).
[2025-10-24T19:25:18.547706] [INFO ] [REMOTE    ] IT: Fetching primary data for 2025-06.
[2025-10-24T19:25:19.347630] [INFO ] [REMOTE    ] ITT: Fetching primary data for 2025-03.
[2025-10-24T19:25:19.446447] [INFO ] [REMOTE    ] ITUB: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T19:25:19.907255] [INFO ] [REMOTE    ] IT: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T19:25:20.147684] [INFO ] [REMOTE    ] IT: Fetching primary data for 2025-07.
[2025-10-24T19:25:20.883673] [INFO ] [REMOTE    ] ITT: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T19:25:20.947620] [INFO ] [REMOTE    ] ITT: Fetching primary data for 2025-04.
[2025-10-24T19:25:21.747674] [INFO ] [REMOTE    ] ITUB: Fetching primary data for 2025-02.
[2025-10-24T19:25:21.796548] [INFO ] [REMOTE    ] IT: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T19:25:22.335818] [INFO ] [REMOTE    ] ITT: Incremental fetch complete for 2025-04 (1.39 seconds).
[2025-10-24T19:25:22.547713] [INFO ] [REMOTE    ] ITT: Fetching primary data for 2025-05.
[2025-10-24T19:25:23.347637] [INFO ] [REMOTE    ] IT: Fetching primary data for 2025-08.
[2025-10-24T19:25:23.422242] [INFO ] [REMOTE    ] ITUB: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T19:25:23.451897] [DEBUG] [REMOTE    ] IT: Error fetching primary data for 2025-08: 'API call returned an empty response.'
[2025-10-24T19:25:23.452206] [WARN ] [REMOTE    ] IT: No data returned for month 2025-08
[2025-10-24T19:25:23.452300] [FATAL] [REMOTE    ] IT: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:25:23.452372] [FATAL] [MAIN      ] IT: Failed to fetch primary data.
[2025-10-24T19:25:23.452435] [WARN ] [MAIN      ] IT: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:25:23.452508] [INFO ] [LOCAL     ] IT: Starting deletion of primary data.
[2025-10-24T19:25:23.452569] [DEBUG] [LOCAL     ] IT: No primary data file found to delete.
[2025-10-24T19:25:23.452606] [INFO ] [LOCAL     ] IT: Starting deletion of derivative data.
[2025-10-24T19:25:23.452748] [DEBUG] [LOCAL     ] IT: Deleted derivative data file.
[2025-10-24T19:25:23.452829] [INFO ] [MAIN      ] Update Progress: 1131/2366 symbols completed. IT took 22.0s. Estimated remaining: 2h 38m 42s. Rate: 7.8 symbols/min
[2025-10-24T19:25:23.627604] [INFO ] [MAIN      ] ITW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:25:23.673354] [DEBUG] [LOCAL     ] ITW: Loaded 45963 existing records from primary storage.
[2025-10-24T19:25:23.673751] [INFO ] [MAIN      ] ITW: Loaded 45963 existing records.
[2025-10-24T19:25:23.864699] [WARN ] [MAIN      ] ITW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:25:23.864985] [INFO ] [MAIN      ] ITW: Wiping existing primary data before full refresh.
[2025-10-24T19:25:23.865035] [INFO ] [LOCAL     ] ITW: Starting deletion of primary data.
[2025-10-24T19:25:23.866088] [DEBUG] [LOCAL     ] ITW: Deleted primary data file.
[2025-10-24T19:25:23.866147] [INFO ] [MAIN      ] ITW: Starting full primary refresh.
[2025-10-24T19:25:24.149741] [INFO ] [REMOTE    ] ITGR: Fetching primary data for 2025-07.
[2025-10-24T19:25:24.225930] [INFO ] [REMOTE    ] ITT: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T19:25:24.258026] [INFO ] [REMOTE    ] ITW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:25:24.947668] [INFO ] [REMOTE    ] ITW: Fetching primary data for 2025-01.
[2025-10-24T19:25:25.658719] [INFO ] [REMOTE    ] ITGR: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T19:25:25.747634] [INFO ] [REMOTE    ] ITUB: Fetching primary data for 2025-03.
[2025-10-24T19:25:26.547695] [INFO ] [REMOTE    ] ITGR: Fetching primary data for 2025-08.
[2025-10-24T19:25:26.575149] [INFO ] [REMOTE    ] ITW: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T19:25:27.347616] [INFO ] [REMOTE    ] ITW: Fetching primary data for 2025-02.
[2025-10-24T19:25:27.574822] [INFO ] [REMOTE    ] ITUB: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T19:25:27.649880] [INFO ] [REMOTE    ] ITGR: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T19:25:28.147749] [INFO ] [REMOTE    ] ITT: Fetching primary data for 2025-06.
[2025-10-24T19:25:28.809136] [INFO ] [REMOTE    ] ITW: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T19:25:28.947617] [INFO ] [REMOTE    ] ITW: Fetching primary data for 2025-03.
[2025-10-24T19:25:29.396162] [INFO ] [REMOTE    ] ITT: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T19:25:29.747633] [INFO ] [REMOTE    ] ITGR: Fetching primary data for 2025-09.
[2025-10-24T19:25:30.547623] [INFO ] [REMOTE    ] ITUB: Fetching primary data for 2025-04.
[2025-10-24T19:25:30.589932] [INFO ] [REMOTE    ] ITW: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T19:25:30.730199] [INFO ] [REMOTE    ] ITGR: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T19:25:31.347639] [INFO ] [REMOTE    ] ITGR: Fetching primary data for 2025-10.
[2025-10-24T19:25:32.147694] [INFO ] [REMOTE    ] ITW: Fetching primary data for 2025-04.
[2025-10-24T19:25:32.319342] [INFO ] [REMOTE    ] ITUB: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T19:25:32.455998] [INFO ] [REMOTE    ] ITGR: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T19:25:32.462877] [INFO ] [REMOTE    ] ITGR: Full fetch complete (43800 records).
[2025-10-24T19:25:32.463088] [DEBUG] [VALIDATOR ] ITGR: Validating primary data.
[2025-10-24T19:25:32.871635] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present.
[2025-10-24T19:25:32.871742] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed.
[2025-10-24T19:25:32.872488] [INFO ] [MAIN      ] ITGR: Fetched primary data is valid.
[2025-10-24T19:25:32.872528] [DEBUG] [LOCAL     ] ITGR: Saving primary data.
[2025-10-24T19:25:32.872927] [FATAL] [LOCAL     ] ITGR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:25:32.873013] [FATAL] [MAIN      ] ITGR: Failed to save primary data.
[2025-10-24T19:25:32.873055] [WARN ] [MAIN      ] ITGR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:25:32.873093] [INFO ] [LOCAL     ] ITGR: Starting deletion of primary data.
[2025-10-24T19:25:32.873143] [DEBUG] [LOCAL     ] ITGR: No primary data file found to delete.
[2025-10-24T19:25:32.873183] [INFO ] [LOCAL     ] ITGR: Starting deletion of derivative data.
[2025-10-24T19:25:32.873322] [DEBUG] [LOCAL     ] ITGR: Deleted derivative data file.
[2025-10-24T19:25:32.873394] [INFO ] [MAIN      ] Update Progress: 1132/2366 symbols completed. ITGR took 30.0s. Estimated remaining: 2h 38m 37s. Rate: 7.8 symbols/min
[2025-10-24T19:25:32.952839] [INFO ] [REMOTE    ] ITT: Fetching primary data for 2025-07.
[2025-10-24T19:25:33.047022] [INFO ] [MAIN      ] IVR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:25:33.088915] [DEBUG] [LOCAL     ] IVR: Loaded 48202 existing records from primary storage.
[2025-10-24T19:25:33.089210] [INFO ] [MAIN      ] IVR: Loaded 48202 existing records.
[2025-10-24T19:25:33.273956] [WARN ] [MAIN      ] IVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:25:33.274213] [INFO ] [MAIN      ] IVR: Wiping existing primary data before full refresh.
[2025-10-24T19:25:33.274265] [INFO ] [LOCAL     ] IVR: Starting deletion of primary data.
[2025-10-24T19:25:33.275062] [DEBUG] [LOCAL     ] IVR: Deleted primary data file.
[2025-10-24T19:25:33.275122] [INFO ] [MAIN      ] IVR: Starting full primary refresh.
[2025-10-24T19:25:33.644999] [INFO ] [REMOTE    ] IVR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:25:33.747694] [INFO ] [REMOTE    ] IVR: Fetching primary data for 2025-01.
[2025-10-24T19:25:33.793379] [INFO ] [REMOTE    ] ITW: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T19:25:34.221101] [INFO ] [REMOTE    ] ITT: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T19:25:34.547689] [INFO ] [REMOTE    ] ITT: Fetching primary data for 2025-08.
[2025-10-24T19:25:35.347627] [INFO ] [REMOTE    ] ITW: Fetching primary data for 2025-05.
[2025-10-24T19:25:35.467118] [INFO ] [REMOTE    ] IVR: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T19:25:35.725335] [INFO ] [REMOTE    ] ITT: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T19:25:36.147633] [INFO ] [REMOTE    ] IVR: Fetching primary data for 2025-02.
[2025-10-24T19:25:36.678101] [INFO ] [REMOTE    ] ITW: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T19:25:36.947739] [INFO ] [REMOTE    ] ITT: Fetching primary data for 2025-09.
[2025-10-24T19:25:37.580932] [INFO ] [REMOTE    ] IVR: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T19:25:37.747636] [INFO ] [REMOTE    ] ITUB: Fetching primary data for 2025-05.
[2025-10-24T19:25:38.197012] [INFO ] [REMOTE    ] ITT: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T19:25:38.547681] [INFO ] [REMOTE    ] ITW: Fetching primary data for 2025-06.
[2025-10-24T19:25:39.347668] [INFO ] [REMOTE    ] IVR: Fetching primary data for 2025-03.
[2025-10-24T19:25:39.589850] [INFO ] [REMOTE    ] ITUB: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T19:25:40.147734] [INFO ] [REMOTE    ] ITT: Fetching primary data for 2025-10.
[2025-10-24T19:25:40.213943] [INFO ] [REMOTE    ] ITW: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T19:25:40.947628] [INFO ] [REMOTE    ] ITW: Fetching primary data for 2025-07.
[2025-10-24T19:25:41.121447] [INFO ] [REMOTE    ] IVR: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T19:25:41.617480] [INFO ] [REMOTE    ] ITT: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T19:25:41.623428] [INFO ] [REMOTE    ] ITT: Full fetch complete (47530 records).
[2025-10-24T19:25:41.623572] [DEBUG] [VALIDATOR ] ITT: Validating primary data.
[2025-10-24T19:25:41.762404] [INFO ] [REMOTE    ] ITUB: Fetching primary data for 2025-06.
[2025-10-24T19:25:42.014336] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present.
[2025-10-24T19:25:42.014433] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed.
[2025-10-24T19:25:42.015290] [INFO ] [MAIN      ] ITT: Fetched primary data is valid.
[2025-10-24T19:25:42.015354] [DEBUG] [LOCAL     ] ITT: Saving primary data.
[2025-10-24T19:25:42.015843] [FATAL] [LOCAL     ] ITT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:25:42.015928] [FATAL] [MAIN      ] ITT: Failed to save primary data.
[2025-10-24T19:25:42.015970] [WARN ] [MAIN      ] ITT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:25:42.016004] [INFO ] [LOCAL     ] ITT: Starting deletion of primary data.
[2025-10-24T19:25:42.016097] [DEBUG] [LOCAL     ] ITT: No primary data file found to delete.
[2025-10-24T19:25:42.016138] [INFO ] [LOCAL     ] ITT: Starting deletion of derivative data.
[2025-10-24T19:25:42.016269] [DEBUG] [LOCAL     ] ITT: Deleted derivative data file.
[2025-10-24T19:25:42.016372] [INFO ] [MAIN      ] Update Progress: 1133/2366 symbols completed. ITT took 36.2s. Estimated remaining: 2h 38m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:25:42.183283] [INFO ] [MAIN      ] IVT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:25:42.213907] [DEBUG] [LOCAL     ] IVT: Loaded 31625 existing records from primary storage.
[2025-10-24T19:25:42.214199] [INFO ] [MAIN      ] IVT: Loaded 31625 existing records.
[2025-10-24T19:25:42.393127] [WARN ] [MAIN      ] IVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:25:42.393394] [INFO ] [MAIN      ] IVT: Wiping existing primary data before full refresh.
[2025-10-24T19:25:42.393449] [INFO ] [LOCAL     ] IVT: Starting deletion of primary data.
[2025-10-24T19:25:42.394132] [DEBUG] [LOCAL     ] IVT: Deleted primary data file.
[2025-10-24T19:25:42.394192] [INFO ] [MAIN      ] IVT: Starting full primary refresh.
[2025-10-24T19:25:42.570373] [INFO ] [REMOTE    ] IVR: Fetching primary data for 2025-04.
[2025-10-24T19:25:42.763574] [INFO ] [REMOTE    ] IVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:25:42.790951] [INFO ] [REMOTE    ] ITW: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T19:25:43.347728] [INFO ] [REMOTE    ] ITW: Fetching primary data for 2025-08.
[2025-10-24T19:25:43.650281] [INFO ] [REMOTE    ] ITUB: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T19:25:44.147744] [INFO ] [REMOTE    ] IVT: Fetching primary data for 2025-01.
[2025-10-24T19:25:44.402103] [INFO ] [REMOTE    ] IVR: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T19:25:44.598330] [INFO ] [REMOTE    ] ITW: Incremental fetch complete for 2025-08 (1.25 seconds).
[2025-10-24T19:25:44.947722] [INFO ] [REMOTE    ] IVR: Fetching primary data for 2025-05.
[2025-10-24T19:25:45.309940] [INFO ] [REMOTE    ] IVT: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T19:25:45.747683] [INFO ] [REMOTE    ] ITW: Fetching primary data for 2025-09.
[2025-10-24T19:25:46.547639] [INFO ] [REMOTE    ] IVT: Fetching primary data for 2025-02.
[2025-10-24T19:25:46.624806] [INFO ] [REMOTE    ] IVR: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T19:25:47.156337] [INFO ] [REMOTE    ] ITW: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T19:25:47.347694] [INFO ] [REMOTE    ] ITW: Fetching primary data for 2025-10.
[2025-10-24T19:25:47.698560] [INFO ] [REMOTE    ] IVT: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T19:25:48.147702] [INFO ] [REMOTE    ] ITUB: Fetching primary data for 2025-07.
[2025-10-24T19:25:48.947617] [INFO ] [REMOTE    ] IVT: Fetching primary data for 2025-03.
[2025-10-24T19:25:49.088688] [INFO ] [REMOTE    ] ITW: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T19:25:49.097512] [INFO ] [REMOTE    ] ITW: Full fetch complete (66907 records).
[2025-10-24T19:25:49.097717] [DEBUG] [VALIDATOR ] ITW: Validating primary data.
[2025-10-24T19:25:49.486828] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present.
[2025-10-24T19:25:49.486910] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed.
[2025-10-24T19:25:49.488037] [INFO ] [MAIN      ] ITW: Fetched primary data is valid.
[2025-10-24T19:25:49.488105] [DEBUG] [LOCAL     ] ITW: Saving primary data.
[2025-10-24T19:25:49.488705] [FATAL] [LOCAL     ] ITW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:25:49.488818] [FATAL] [MAIN      ] ITW: Failed to save primary data.
[2025-10-24T19:25:49.488862] [WARN ] [MAIN      ] ITW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:25:49.488898] [INFO ] [LOCAL     ] ITW: Starting deletion of primary data.
[2025-10-24T19:25:49.488951] [DEBUG] [LOCAL     ] ITW: No primary data file found to delete.
[2025-10-24T19:25:49.489009] [INFO ] [LOCAL     ] ITW: Starting deletion of derivative data.
[2025-10-24T19:25:49.489153] [DEBUG] [LOCAL     ] ITW: Deleted derivative data file.
[2025-10-24T19:25:49.489829] [INFO ] [MAIN      ] Update Progress: 1134/2366 symbols completed. ITW took 26.0s. Estimated remaining: 2h 38m 22s. Rate: 7.8 symbols/min
[2025-10-24T19:25:49.687864] [INFO ] [MAIN      ] IVZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:25:49.754288] [INFO ] [REMOTE    ] IVR: Fetching primary data for 2025-06.
[2025-10-24T19:25:49.766365] [DEBUG] [LOCAL     ] IVZ: Loaded 53518 existing records from primary storage.
[2025-10-24T19:25:49.778854] [INFO ] [MAIN      ] IVZ: Loaded 53518 existing records.
[2025-10-24T19:25:49.813420] [INFO ] [REMOTE    ] ITUB: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T19:25:49.978405] [WARN ] [MAIN      ] IVZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:25:49.978618] [INFO ] [MAIN      ] IVZ: Wiping existing primary data before full refresh.
[2025-10-24T19:25:49.978695] [INFO ] [LOCAL     ] IVZ: Starting deletion of primary data.
[2025-10-24T19:25:49.979318] [DEBUG] [LOCAL     ] IVZ: Deleted primary data file.
[2025-10-24T19:25:49.979388] [INFO ] [MAIN      ] IVZ: Starting full primary refresh.
[2025-10-24T19:25:50.340088] [INFO ] [REMOTE    ] IVZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:25:50.362720] [INFO ] [REMOTE    ] IVT: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T19:25:50.547639] [INFO ] [REMOTE    ] IVZ: Fetching primary data for 2025-01.
[2025-10-24T19:25:50.969981] [INFO ] [REMOTE    ] IVR: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T19:25:51.347737] [INFO ] [REMOTE    ] IVT: Fetching primary data for 2025-04.
[2025-10-24T19:25:52.147703] [INFO ] [REMOTE    ] ITUB: Fetching primary data for 2025-08.
[2025-10-24T19:25:52.300933] [INFO ] [REMOTE    ] IVZ: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T19:25:52.703577] [INFO ] [REMOTE    ] IVT: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T19:25:52.947683] [INFO ] [REMOTE    ] IVZ: Fetching primary data for 2025-02.
[2025-10-24T19:25:53.620936] [INFO ] [REMOTE    ] ITUB: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T19:25:53.747682] [INFO ] [REMOTE    ] IVT: Fetching primary data for 2025-05.
[2025-10-24T19:25:54.547625] [INFO ] [REMOTE    ] ITUB: Fetching primary data for 2025-09.
[2025-10-24T19:25:54.707364] [INFO ] [REMOTE    ] IVZ: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T19:25:55.014606] [INFO ] [REMOTE    ] IVT: Incremental fetch complete for 2025-05 (1.27 seconds).
[2025-10-24T19:25:55.347676] [INFO ] [REMOTE    ] IVZ: Fetching primary data for 2025-03.
[2025-10-24T19:25:56.105085] [INFO ] [REMOTE    ] ITUB: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T19:25:56.147602] [INFO ] [REMOTE    ] ITUB: Fetching primary data for 2025-10.
[2025-10-24T19:25:56.938072] [INFO ] [REMOTE    ] IVZ: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T19:25:56.948585] [INFO ] [REMOTE    ] IVR: Fetching primary data for 2025-07.
[2025-10-24T19:25:57.747703] [INFO ] [REMOTE    ] IVZ: Fetching primary data for 2025-04.
[2025-10-24T19:25:57.978387] [INFO ] [REMOTE    ] ITUB: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T19:25:57.987991] [INFO ] [REMOTE    ] ITUB: Full fetch complete (77312 records).
[2025-10-24T19:25:57.988111] [DEBUG] [VALIDATOR ] ITUB: Validating primary data.
[2025-10-24T19:25:58.387799] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present.
[2025-10-24T19:25:58.387967] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed.
[2025-10-24T19:25:58.389107] [INFO ] [MAIN      ] ITUB: Fetched primary data is valid.
[2025-10-24T19:25:58.389187] [DEBUG] [LOCAL     ] ITUB: Saving primary data.
[2025-10-24T19:25:58.390018] [FATAL] [LOCAL     ] ITUB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:25:58.390169] [FATAL] [MAIN      ] ITUB: Failed to save primary data.
[2025-10-24T19:25:58.390266] [WARN ] [MAIN      ] ITUB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:25:58.390406] [INFO ] [LOCAL     ] ITUB: Starting deletion of primary data.
[2025-10-24T19:25:58.390597] [DEBUG] [LOCAL     ] ITUB: No primary data file found to delete.
[2025-10-24T19:25:58.390681] [INFO ] [LOCAL     ] ITUB: Starting deletion of derivative data.
[2025-10-24T19:25:58.400305] [DEBUG] [LOCAL     ] ITUB: Deleted derivative data file.
[2025-10-24T19:25:58.417066] [INFO ] [MAIN      ] Update Progress: 1135/2366 symbols completed. ITUB took 42.2s. Estimated remaining: 2h 38m 16s. Rate: 7.8 symbols/min
[2025-10-24T19:25:58.450986] [INFO ] [REMOTE    ] IVR: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T19:25:58.552902] [INFO ] [REMOTE    ] IVR: Fetching primary data for 2025-08.
[2025-10-24T19:25:58.607389] [INFO ] [MAIN      ] IX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:25:58.629626] [DEBUG] [LOCAL     ] IX: Loaded 22244 existing records from primary storage.
[2025-10-24T19:25:58.629893] [INFO ] [MAIN      ] IX: Loaded 22244 existing records.
[2025-10-24T19:25:58.806622] [WARN ] [MAIN      ] IX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:25:58.806849] [INFO ] [MAIN      ] IX: Wiping existing primary data before full refresh.
[2025-10-24T19:25:58.806919] [INFO ] [LOCAL     ] IX: Starting deletion of primary data.
[2025-10-24T19:25:58.807254] [DEBUG] [LOCAL     ] IX: Deleted primary data file.
[2025-10-24T19:25:58.807312] [INFO ] [MAIN      ] IX: Starting full primary refresh.
[2025-10-24T19:25:59.166840] [INFO ] [REMOTE    ] IX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:25:59.199578] [INFO ] [REMOTE    ] IVZ: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T19:25:59.347624] [INFO ] [REMOTE    ] IVZ: Fetching primary data for 2025-05.
[2025-10-24T19:26:00.147682] [INFO ] [REMOTE    ] IX: Fetching primary data for 2025-01.
[2025-10-24T19:26:00.246232] [INFO ] [REMOTE    ] IVR: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T19:26:00.932938] [INFO ] [REMOTE    ] IX: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T19:26:00.947612] [INFO ] [REMOTE    ] IX: Fetching primary data for 2025-02.
[2025-10-24T19:26:01.184301] [INFO ] [REMOTE    ] IVZ: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T19:26:01.692701] [INFO ] [REMOTE    ] IX: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T19:26:01.747746] [INFO ] [REMOTE    ] IVT: Fetching primary data for 2025-06.
[2025-10-24T19:26:02.547733] [INFO ] [REMOTE    ] IVZ: Fetching primary data for 2025-06.
[2025-10-24T19:26:02.934614] [INFO ] [REMOTE    ] IVT: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T19:26:03.347705] [INFO ] [REMOTE    ] IVT: Fetching primary data for 2025-07.
[2025-10-24T19:26:04.147716] [INFO ] [REMOTE    ] IVR: Fetching primary data for 2025-09.
[2025-10-24T19:26:04.337400] [INFO ] [REMOTE    ] IVZ: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T19:26:04.803894] [INFO ] [REMOTE    ] IVT: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T19:26:04.947617] [INFO ] [REMOTE    ] IVT: Fetching primary data for 2025-08.
[2025-10-24T19:26:05.733632] [INFO ] [REMOTE    ] IVR: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T19:26:05.747609] [INFO ] [REMOTE    ] IVR: Fetching primary data for 2025-10.
[2025-10-24T19:26:05.804247] [INFO ] [REMOTE    ] IVT: Incremental fetch complete for 2025-08 (0.86 seconds).
[2025-10-24T19:26:06.547685] [INFO ] [REMOTE    ] IVZ: Fetching primary data for 2025-07.
[2025-10-24T19:26:07.347720] [INFO ] [REMOTE    ] IX: Fetching primary data for 2025-03.
[2025-10-24T19:26:07.401894] [INFO ] [REMOTE    ] IVR: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T19:26:07.410636] [INFO ] [REMOTE    ] IVR: Full fetch complete (69059 records).
[2025-10-24T19:26:07.410778] [DEBUG] [VALIDATOR ] IVR: Validating primary data.
[2025-10-24T19:26:07.797908] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present.
[2025-10-24T19:26:07.798026] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed.
[2025-10-24T19:26:07.799043] [INFO ] [MAIN      ] IVR: Fetched primary data is valid.
[2025-10-24T19:26:07.799191] [DEBUG] [LOCAL     ] IVR: Saving primary data.
[2025-10-24T19:26:07.799863] [FATAL] [LOCAL     ] IVR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:26:07.800095] [FATAL] [MAIN      ] IVR: Failed to save primary data.
[2025-10-24T19:26:07.800175] [WARN ] [MAIN      ] IVR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:26:07.800358] [INFO ] [LOCAL     ] IVR: Starting deletion of primary data.
[2025-10-24T19:26:07.800447] [DEBUG] [LOCAL     ] IVR: No primary data file found to delete.
[2025-10-24T19:26:07.800548] [INFO ] [LOCAL     ] IVR: Starting deletion of derivative data.
[2025-10-24T19:26:07.800821] [DEBUG] [LOCAL     ] IVR: Deleted derivative data file.
[2025-10-24T19:26:07.801212] [INFO ] [MAIN      ] Update Progress: 1136/2366 symbols completed. IVR took 34.9s. Estimated remaining: 2h 38m 10s. Rate: 7.8 symbols/min
[2025-10-24T19:26:07.991678] [INFO ] [MAIN      ] J: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:26:08.006751] [INFO ] [REMOTE    ] IVZ: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T19:26:08.057567] [DEBUG] [LOCAL     ] J: Loaded 40852 existing records from primary storage.
[2025-10-24T19:26:08.057908] [INFO ] [MAIN      ] J: Loaded 40852 existing records.
[2025-10-24T19:26:08.154796] [INFO ] [REMOTE    ] IVT: Fetching primary data for 2025-09.
[2025-10-24T19:26:08.234597] [WARN ] [MAIN      ] J: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:26:08.234825] [INFO ] [MAIN      ] J: Wiping existing primary data before full refresh.
[2025-10-24T19:26:08.234874] [INFO ] [LOCAL     ] J: Starting deletion of primary data.
[2025-10-24T19:26:08.235230] [DEBUG] [LOCAL     ] J: Deleted primary data file.
[2025-10-24T19:26:08.235268] [INFO ] [MAIN      ] J: Starting full primary refresh.
[2025-10-24T19:26:08.592150] [INFO ] [REMOTE    ] J: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:26:08.606013] [INFO ] [REMOTE    ] IX: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T19:26:08.947608] [INFO ] [REMOTE    ] J: Fetching primary data for 2025-01.
[2025-10-24T19:26:09.366384] [INFO ] [REMOTE    ] IVT: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T19:26:09.747628] [INFO ] [REMOTE    ] IVZ: Fetching primary data for 2025-08.
[2025-10-24T19:26:10.018395] [INFO ] [REMOTE    ] J: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T19:26:10.547714] [INFO ] [REMOTE    ] J: Fetching primary data for 2025-02.
[2025-10-24T19:26:11.310161] [INFO ] [REMOTE    ] IVZ: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T19:26:11.347808] [INFO ] [REMOTE    ] IX: Fetching primary data for 2025-04.
[2025-10-24T19:26:12.055457] [INFO ] [REMOTE    ] J: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T19:26:12.147699] [INFO ] [REMOTE    ] IVT: Fetching primary data for 2025-10.
[2025-10-24T19:26:12.535012] [INFO ] [REMOTE    ] IX: Incremental fetch complete for 2025-04 (1.19 seconds).
[2025-10-24T19:26:12.947737] [INFO ] [REMOTE    ] IX: Fetching primary data for 2025-05.
[2025-10-24T19:26:13.519418] [INFO ] [REMOTE    ] IVT: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T19:26:13.526292] [INFO ] [REMOTE    ] IVT: Full fetch complete (45629 records).
[2025-10-24T19:26:13.526465] [DEBUG] [VALIDATOR ] IVT: Validating primary data.
[2025-10-24T19:26:13.749978] [INFO ] [REMOTE    ] J: Fetching primary data for 2025-03.
[2025-10-24T19:26:13.921300] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present.
[2025-10-24T19:26:13.921472] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed.
[2025-10-24T19:26:13.922375] [INFO ] [MAIN      ] IVT: Fetched primary data is valid.
[2025-10-24T19:26:13.922459] [DEBUG] [LOCAL     ] IVT: Saving primary data.
[2025-10-24T19:26:13.928600] [FATAL] [LOCAL     ] IVT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:26:13.937713] [FATAL] [MAIN      ] IVT: Failed to save primary data.
[2025-10-24T19:26:13.938301] [WARN ] [MAIN      ] IVT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:26:13.938862] [INFO ] [REMOTE    ] IX: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T19:26:13.939087] [INFO ] [LOCAL     ] IVT: Starting deletion of primary data.
[2025-10-24T19:26:13.944565] [DEBUG] [LOCAL     ] IVT: No primary data file found to delete.
[2025-10-24T19:26:13.945435] [INFO ] [LOCAL     ] IVT: Starting deletion of derivative data.
[2025-10-24T19:26:13.945784] [DEBUG] [LOCAL     ] IVT: Deleted derivative data file.
[2025-10-24T19:26:13.945944] [INFO ] [MAIN      ] Update Progress: 1137/2366 symbols completed. IVT took 31.9s. Estimated remaining: 2h 38m 1s. Rate: 7.8 symbols/min
[2025-10-24T19:26:14.174190] [INFO ] [MAIN      ] JBGS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:26:14.221335] [DEBUG] [LOCAL     ] JBGS: Loaded 41920 existing records from primary storage.
[2025-10-24T19:26:14.221755] [INFO ] [MAIN      ] JBGS: Loaded 41920 existing records.
[2025-10-24T19:26:14.408905] [WARN ] [MAIN      ] JBGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:26:14.409200] [INFO ] [MAIN      ] JBGS: Wiping existing primary data before full refresh.
[2025-10-24T19:26:14.409253] [INFO ] [LOCAL     ] JBGS: Starting deletion of primary data.
[2025-10-24T19:26:14.409798] [DEBUG] [LOCAL     ] JBGS: Deleted primary data file.
[2025-10-24T19:26:14.409858] [INFO ] [MAIN      ] JBGS: Starting full primary refresh.
[2025-10-24T19:26:14.556369] [INFO ] [REMOTE    ] IVZ: Fetching primary data for 2025-09.
[2025-10-24T19:26:14.796245] [INFO ] [REMOTE    ] JBGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:26:15.308591] [INFO ] [REMOTE    ] J: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T19:26:15.347710] [INFO ] [REMOTE    ] IX: Fetching primary data for 2025-06.
[2025-10-24T19:26:16.147629] [INFO ] [REMOTE    ] J: Fetching primary data for 2025-04.
[2025-10-24T19:26:16.244484] [INFO ] [REMOTE    ] IVZ: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T19:26:16.480816] [INFO ] [REMOTE    ] IX: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T19:26:16.947668] [INFO ] [REMOTE    ] IX: Fetching primary data for 2025-07.
[2025-10-24T19:26:17.279533] [INFO ] [REMOTE    ] J: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T19:26:17.747706] [INFO ] [REMOTE    ] JBGS: Fetching primary data for 2025-01.
[2025-10-24T19:26:18.044746] [INFO ] [REMOTE    ] IX: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T19:26:18.547630] [INFO ] [REMOTE    ] IVZ: Fetching primary data for 2025-10.
[2025-10-24T19:26:18.908023] [INFO ] [REMOTE    ] JBGS: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T19:26:19.347675] [INFO ] [REMOTE    ] IX: Fetching primary data for 2025-08.
[2025-10-24T19:26:20.147728] [INFO ] [REMOTE    ] JBGS: Fetching primary data for 2025-02.
[2025-10-24T19:26:20.324929] [INFO ] [REMOTE    ] IX: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T19:26:20.441564] [INFO ] [REMOTE    ] IVZ: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T19:26:20.451900] [INFO ] [REMOTE    ] IVZ: Full fetch complete (77060 records).
[2025-10-24T19:26:20.452044] [DEBUG] [VALIDATOR ] IVZ: Validating primary data.
[2025-10-24T19:26:20.844242] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present.
[2025-10-24T19:26:20.844335] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed.
[2025-10-24T19:26:20.845433] [INFO ] [MAIN      ] IVZ: Fetched primary data is valid.
[2025-10-24T19:26:20.845504] [DEBUG] [LOCAL     ] IVZ: Saving primary data.
[2025-10-24T19:26:20.846172] [FATAL] [LOCAL     ] IVZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:26:20.846265] [FATAL] [MAIN      ] IVZ: Failed to save primary data.
[2025-10-24T19:26:20.846307] [WARN ] [MAIN      ] IVZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:26:20.846344] [INFO ] [LOCAL     ] IVZ: Starting deletion of primary data.
[2025-10-24T19:26:20.846397] [DEBUG] [LOCAL     ] IVZ: No primary data file found to delete.
[2025-10-24T19:26:20.846432] [INFO ] [LOCAL     ] IVZ: Starting deletion of derivative data.
[2025-10-24T19:26:20.846593] [DEBUG] [LOCAL     ] IVZ: Deleted derivative data file.
[2025-10-24T19:26:20.846998] [INFO ] [MAIN      ] Update Progress: 1138/2366 symbols completed. IVZ took 31.4s. Estimated remaining: 2h 37m 52s. Rate: 7.8 symbols/min
[2025-10-24T19:26:20.953348] [INFO ] [REMOTE    ] IX: Fetching primary data for 2025-09.
[2025-10-24T19:26:21.023635] [INFO ] [MAIN      ] JBI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:26:21.071585] [DEBUG] [LOCAL     ] JBI: Loaded 42829 existing records from primary storage.
[2025-10-24T19:26:21.072622] [INFO ] [MAIN      ] JBI: Loaded 42829 existing records.
[2025-10-24T19:26:21.252150] [WARN ] [MAIN      ] JBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:26:21.252439] [INFO ] [MAIN      ] JBI: Wiping existing primary data before full refresh.
[2025-10-24T19:26:21.252494] [INFO ] [LOCAL     ] JBI: Starting deletion of primary data.
[2025-10-24T19:26:21.252876] [DEBUG] [LOCAL     ] JBI: Deleted primary data file.
[2025-10-24T19:26:21.252931] [INFO ] [MAIN      ] JBI: Starting full primary refresh.
[2025-10-24T19:26:21.618863] [INFO ] [REMOTE    ] JBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:26:21.640318] [INFO ] [REMOTE    ] JBGS: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T19:26:21.657065] [INFO ] [REMOTE    ] IX: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T19:26:21.747631] [INFO ] [REMOTE    ] IX: Fetching primary data for 2025-10.
[2025-10-24T19:26:22.547612] [INFO ] [REMOTE    ] JBGS: Fetching primary data for 2025-03.
[2025-10-24T19:26:22.936779] [INFO ] [REMOTE    ] IX: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T19:26:22.940718] [INFO ] [REMOTE    ] IX: Full fetch complete (28838 records).
[2025-10-24T19:26:22.940824] [DEBUG] [VALIDATOR ] IX: Validating primary data.
[2025-10-24T19:26:23.305990] [DEBUG] [VALIDATOR ] IX: All expected trading days are present.
[2025-10-24T19:26:23.306069] [DEBUG] [VALIDATOR ] IX: Primary data validation passed.
[2025-10-24T19:26:23.306738] [INFO ] [MAIN      ] IX: Fetched primary data is valid.
[2025-10-24T19:26:23.306802] [DEBUG] [LOCAL     ] IX: Saving primary data.
[2025-10-24T19:26:23.307111] [FATAL] [LOCAL     ] IX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:26:23.307219] [FATAL] [MAIN      ] IX: Failed to save primary data.
[2025-10-24T19:26:23.307280] [WARN ] [MAIN      ] IX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:26:23.307341] [INFO ] [LOCAL     ] IX: Starting deletion of primary data.
[2025-10-24T19:26:23.307398] [DEBUG] [LOCAL     ] IX: No primary data file found to delete.
[2025-10-24T19:26:23.307451] [INFO ] [LOCAL     ] IX: Starting deletion of derivative data.
[2025-10-24T19:26:23.307560] [DEBUG] [LOCAL     ] IX: Deleted derivative data file.
[2025-10-24T19:26:23.307632] [INFO ] [MAIN      ] Update Progress: 1139/2366 symbols completed. IX took 24.9s. Estimated remaining: 2h 37m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:26:23.352825] [INFO ] [REMOTE    ] JBI: Fetching primary data for 2025-01.
[2025-10-24T19:26:23.483572] [INFO ] [MAIN      ] JBL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:26:23.529614] [DEBUG] [LOCAL     ] JBL: Loaded 48679 existing records from primary storage.
[2025-10-24T19:26:23.529935] [INFO ] [MAIN      ] JBL: Loaded 48679 existing records.
[2025-10-24T19:26:23.708028] [WARN ] [MAIN      ] JBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:26:23.708245] [INFO ] [MAIN      ] JBL: Wiping existing primary data before full refresh.
[2025-10-24T19:26:23.708293] [INFO ] [LOCAL     ] JBL: Starting deletion of primary data.
[2025-10-24T19:26:23.708832] [DEBUG] [LOCAL     ] JBL: Deleted primary data file.
[2025-10-24T19:26:23.708887] [INFO ] [MAIN      ] JBL: Starting full primary refresh.
[2025-10-24T19:26:24.083126] [INFO ] [REMOTE    ] JBGS: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T19:26:24.104298] [INFO ] [REMOTE    ] JBL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:26:24.147609] [INFO ] [REMOTE    ] JBGS: Fetching primary data for 2025-04.
[2025-10-24T19:26:24.809318] [INFO ] [REMOTE    ] JBI: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T19:26:24.947616] [INFO ] [REMOTE    ] J: Fetching primary data for 2025-05.
[2025-10-24T19:26:25.609393] [INFO ] [REMOTE    ] JBGS: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T19:26:25.747614] [INFO ] [REMOTE    ] JBI: Fetching primary data for 2025-02.
[2025-10-24T19:26:26.204927] [INFO ] [REMOTE    ] J: Incremental fetch complete for 2025-05 (1.26 seconds).
[2025-10-24T19:26:26.547740] [INFO ] [REMOTE    ] JBGS: Fetching primary data for 2025-05.
[2025-10-24T19:26:27.232876] [INFO ] [REMOTE    ] JBI: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T19:26:27.347639] [INFO ] [REMOTE    ] JBI: Fetching primary data for 2025-03.
[2025-10-24T19:26:28.078917] [INFO ] [REMOTE    ] JBGS: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T19:26:28.147601] [INFO ] [REMOTE    ] JBGS: Fetching primary data for 2025-06.
[2025-10-24T19:26:28.818762] [INFO ] [REMOTE    ] JBI: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T19:26:28.947618] [INFO ] [REMOTE    ] JBI: Fetching primary data for 2025-04.
[2025-10-24T19:26:29.220969] [INFO ] [REMOTE    ] JBGS: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T19:26:29.747634] [INFO ] [REMOTE    ] JBL: Fetching primary data for 2025-01.
[2025-10-24T19:26:30.076609] [INFO ] [REMOTE    ] JBI: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T19:26:30.547724] [INFO ] [REMOTE    ] J: Fetching primary data for 2025-06.
[2025-10-24T19:26:31.347704] [INFO ] [REMOTE    ] JBI: Fetching primary data for 2025-05.
[2025-10-24T19:26:31.572429] [INFO ] [REMOTE    ] JBL: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T19:26:32.003513] [INFO ] [REMOTE    ] J: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T19:26:32.147640] [INFO ] [REMOTE    ] J: Fetching primary data for 2025-07.
[2025-10-24T19:26:32.725823] [INFO ] [REMOTE    ] JBI: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T19:26:32.947685] [INFO ] [REMOTE    ] JBI: Fetching primary data for 2025-06.
[2025-10-24T19:26:33.115137] [INFO ] [REMOTE    ] J: Incremental fetch complete for 2025-07 (0.97 seconds).
[2025-10-24T19:26:33.747719] [INFO ] [REMOTE    ] JBGS: Fetching primary data for 2025-07.
[2025-10-24T19:26:34.451712] [INFO ] [REMOTE    ] JBI: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T19:26:34.547603] [INFO ] [REMOTE    ] JBI: Fetching primary data for 2025-07.
[2025-10-24T19:26:35.081724] [INFO ] [REMOTE    ] JBGS: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T19:26:35.347713] [INFO ] [REMOTE    ] J: Fetching primary data for 2025-08.
[2025-10-24T19:26:36.153153] [INFO ] [REMOTE    ] JBGS: Fetching primary data for 2025-08.
[2025-10-24T19:26:36.174222] [INFO ] [REMOTE    ] JBI: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T19:26:36.456798] [INFO ] [REMOTE    ] J: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T19:26:36.947675] [INFO ] [REMOTE    ] J: Fetching primary data for 2025-09.
[2025-10-24T19:26:37.202467] [INFO ] [REMOTE    ] JBGS: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T19:26:37.747714] [INFO ] [REMOTE    ] JBGS: Fetching primary data for 2025-09.
[2025-10-24T19:26:38.547684] [INFO ] [REMOTE    ] JBL: Fetching primary data for 2025-02.
[2025-10-24T19:26:38.645035] [INFO ] [REMOTE    ] J: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T19:26:39.164563] [INFO ] [REMOTE    ] JBGS: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T19:26:39.347631] [INFO ] [REMOTE    ] JBI: Fetching primary data for 2025-08.
[2025-10-24T19:26:39.994740] [INFO ] [REMOTE    ] JBL: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T19:26:40.147614] [INFO ] [REMOTE    ] J: Fetching primary data for 2025-10.
[2025-10-24T19:26:40.264866] [INFO ] [REMOTE    ] JBI: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T19:26:40.947635] [INFO ] [REMOTE    ] JBL: Fetching primary data for 2025-03.
[2025-10-24T19:26:41.748564] [INFO ] [REMOTE    ] J: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T19:26:41.747787] [INFO ] [REMOTE    ] JBI: Fetching primary data for 2025-09.
[2025-10-24T19:26:41.757860] [INFO ] [REMOTE    ] J: Full fetch complete (59871 records).
[2025-10-24T19:26:41.757946] [DEBUG] [VALIDATOR ] J: Validating primary data.
[2025-10-24T19:26:42.134172] [DEBUG] [VALIDATOR ] J: All expected trading days are present.
[2025-10-24T19:26:42.134246] [DEBUG] [VALIDATOR ] J: Primary data validation passed.
[2025-10-24T19:26:42.135111] [INFO ] [MAIN      ] J: Fetched primary data is valid.
[2025-10-24T19:26:42.135174] [DEBUG] [LOCAL     ] J: Saving primary data.
[2025-10-24T19:26:42.135631] [FATAL] [LOCAL     ] J: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:26:42.135771] [FATAL] [MAIN      ] J: Failed to save primary data.
[2025-10-24T19:26:42.135814] [WARN ] [MAIN      ] J: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:26:42.135849] [INFO ] [LOCAL     ] J: Starting deletion of primary data.
[2025-10-24T19:26:42.135898] [DEBUG] [LOCAL     ] J: No primary data file found to delete.
[2025-10-24T19:26:42.135933] [INFO ] [LOCAL     ] J: Starting deletion of derivative data.
[2025-10-24T19:26:42.136117] [DEBUG] [LOCAL     ] J: Deleted derivative data file.
[2025-10-24T19:26:42.136505] [INFO ] [MAIN      ] Update Progress: 1140/2366 symbols completed. J took 34.3s. Estimated remaining: 2h 37m 43s. Rate: 7.8 symbols/min
[2025-10-24T19:26:42.311219] [INFO ] [MAIN      ] JBND: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:26:42.345611] [INFO ] [REMOTE    ] JBL: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T19:26:42.374384] [DEBUG] [LOCAL     ] JBND: Loaded 27627 existing records from primary storage.
[2025-10-24T19:26:42.374631] [INFO ] [MAIN      ] JBND: Loaded 27627 existing records.
[2025-10-24T19:26:42.548995] [INFO ] [REMOTE    ] JBGS: Fetching primary data for 2025-10.
[2025-10-24T19:26:42.548918] [WARN ] [MAIN      ] JBND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:26:42.549889] [INFO ] [MAIN      ] JBND: Wiping existing primary data before full refresh.
[2025-10-24T19:26:42.549944] [INFO ] [LOCAL     ] JBND: Starting deletion of primary data.
[2025-10-24T19:26:42.550279] [DEBUG] [LOCAL     ] JBND: Deleted primary data file.
[2025-10-24T19:26:42.550337] [INFO ] [MAIN      ] JBND: Starting full primary refresh.
[2025-10-24T19:26:42.902191] [INFO ] [REMOTE    ] JBND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:26:43.163818] [INFO ] [REMOTE    ] JBI: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T19:26:43.347625] [INFO ] [REMOTE    ] JBND: Fetching primary data for 2025-01.
[2025-10-24T19:26:44.051592] [INFO ] [REMOTE    ] JBGS: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T19:26:44.058692] [INFO ] [REMOTE    ] JBGS: Full fetch complete (59132 records).
[2025-10-24T19:26:44.058814] [DEBUG] [VALIDATOR ] JBGS: Validating primary data.
[2025-10-24T19:26:44.152730] [INFO ] [REMOTE    ] JBL: Fetching primary data for 2025-04.
[2025-10-24T19:26:44.273257] [INFO ] [REMOTE    ] JBND: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T19:26:44.469286] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present.
[2025-10-24T19:26:44.469371] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed.
[2025-10-24T19:26:44.470333] [INFO ] [MAIN      ] JBGS: Fetched primary data is valid.
[2025-10-24T19:26:44.470398] [DEBUG] [LOCAL     ] JBGS: Saving primary data.
[2025-10-24T19:26:44.470970] [FATAL] [LOCAL     ] JBGS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:26:44.471074] [FATAL] [MAIN      ] JBGS: Failed to save primary data.
[2025-10-24T19:26:44.471116] [WARN ] [MAIN      ] JBGS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:26:44.471203] [INFO ] [LOCAL     ] JBGS: Starting deletion of primary data.
[2025-10-24T19:26:44.471277] [DEBUG] [LOCAL     ] JBGS: No primary data file found to delete.
[2025-10-24T19:26:44.471326] [INFO ] [LOCAL     ] JBGS: Starting deletion of derivative data.
[2025-10-24T19:26:44.471464] [DEBUG] [LOCAL     ] JBGS: Deleted derivative data file.
[2025-10-24T19:26:44.471892] [INFO ] [MAIN      ] Update Progress: 1141/2366 symbols completed. JBGS took 30.5s. Estimated remaining: 2h 37m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:26:44.638122] [INFO ] [MAIN      ] JBS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:26:44.638303] [DEBUG] [LOCAL     ] JBS: No existing data file found in primary storage.
[2025-10-24T19:26:44.638340] [WARN ] [MAIN      ] JBS: No existing data found, performing full refresh instead.
[2025-10-24T19:26:44.638448] [INFO ] [MAIN      ] JBS: Wiping existing primary data before full refresh.
[2025-10-24T19:26:44.638489] [INFO ] [LOCAL     ] JBS: Starting deletion of primary data.
[2025-10-24T19:26:44.638547] [DEBUG] [LOCAL     ] JBS: No primary data file found to delete.
[2025-10-24T19:26:44.638616] [INFO ] [MAIN      ] JBS: Starting full primary refresh.
[2025-10-24T19:26:44.952717] [INFO ] [REMOTE    ] JBI: Fetching primary data for 2025-10.
[2025-10-24T19:26:44.999726] [INFO ] [REMOTE    ] JBS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:26:45.670484] [INFO ] [REMOTE    ] JBL: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T19:26:45.747704] [INFO ] [REMOTE    ] JBS: Fetching primary data for 2025-01.
[2025-10-24T19:26:45.989161] [DEBUG] [REMOTE    ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:26:45.989511] [WARN ] [REMOTE    ] JBS: No data returned for month 2025-01
[2025-10-24T19:26:45.989600] [FATAL] [REMOTE    ] JBS: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:26:45.989705] [FATAL] [MAIN      ] JBS: Failed to fetch primary data.
[2025-10-24T19:26:45.989839] [WARN ] [MAIN      ] JBS: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:26:45.989913] [INFO ] [LOCAL     ] JBS: Starting deletion of primary data.
[2025-10-24T19:26:45.989989] [DEBUG] [LOCAL     ] JBS: No primary data file found to delete.
[2025-10-24T19:26:45.990044] [INFO ] [LOCAL     ] JBS: Starting deletion of derivative data.
[2025-10-24T19:26:45.990089] [DEBUG] [LOCAL     ] JBS: No derivative data file found to delete.
[2025-10-24T19:26:45.990137] [INFO ] [MAIN      ] Update Progress: 1142/2366 symbols completed. JBS took 1.5s. Estimated remaining: 2h 37m 15s. Rate: 7.8 symbols/min
[2025-10-24T19:26:46.164329] [INFO ] [MAIN      ] JBTM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:26:46.200585] [DEBUG] [LOCAL     ] JBTM: Loaded 33794 existing records from primary storage.
[2025-10-24T19:26:46.200917] [INFO ] [MAIN      ] JBTM: Loaded 33794 existing records.
[2025-10-24T19:26:46.377132] [WARN ] [MAIN      ] JBTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:26:46.377373] [INFO ] [MAIN      ] JBTM: Wiping existing primary data before full refresh.
[2025-10-24T19:26:46.377419] [INFO ] [LOCAL     ] JBTM: Starting deletion of primary data.
[2025-10-24T19:26:46.377994] [DEBUG] [LOCAL     ] JBTM: Deleted primary data file.
[2025-10-24T19:26:46.378052] [INFO ] [MAIN      ] JBTM: Starting full primary refresh.
[2025-10-24T19:26:46.548044] [INFO ] [REMOTE    ] JBND: Fetching primary data for 2025-02.
[2025-10-24T19:26:46.608482] [INFO ] [REMOTE    ] JBI: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T19:26:46.684685] [INFO ] [REMOTE    ] JBI: Full fetch complete (63344 records).
[2025-10-24T19:26:46.686995] [DEBUG] [VALIDATOR ] JBI: Validating primary data.
[2025-10-24T19:26:46.872406] [INFO ] [REMOTE    ] JBTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:26:47.154067] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present.
[2025-10-24T19:26:47.154143] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed.
[2025-10-24T19:26:47.155071] [INFO ] [MAIN      ] JBI: Fetched primary data is valid.
[2025-10-24T19:26:47.155131] [DEBUG] [LOCAL     ] JBI: Saving primary data.
[2025-10-24T19:26:47.155623] [FATAL] [LOCAL     ] JBI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:26:47.155725] [FATAL] [MAIN      ] JBI: Failed to save primary data.
[2025-10-24T19:26:47.155766] [WARN ] [MAIN      ] JBI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:26:47.155803] [INFO ] [LOCAL     ] JBI: Starting deletion of primary data.
[2025-10-24T19:26:47.155852] [DEBUG] [LOCAL     ] JBI: No primary data file found to delete.
[2025-10-24T19:26:47.155886] [INFO ] [LOCAL     ] JBI: Starting deletion of derivative data.
[2025-10-24T19:26:47.156019] [DEBUG] [LOCAL     ] JBI: Deleted derivative data file.
[2025-10-24T19:26:47.156386] [INFO ] [MAIN      ] Update Progress: 1143/2366 symbols completed. JBI took 26.3s. Estimated remaining: 2h 37m 0s. Rate: 7.8 symbols/min
[2025-10-24T19:26:47.327439] [INFO ] [MAIN      ] JCE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:26:47.338215] [DEBUG] [LOCAL     ] JCE: Loaded 7275 existing records from primary storage.
[2025-10-24T19:26:47.338422] [INFO ] [MAIN      ] JCE: Loaded 7275 existing records.
[2025-10-24T19:26:47.352853] [INFO ] [REMOTE    ] JBTM: Fetching primary data for 2025-01.
[2025-10-24T19:26:47.521383] [WARN ] [MAIN      ] JCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:26:47.521604] [INFO ] [MAIN      ] JCE: Wiping existing primary data before full refresh.
[2025-10-24T19:26:47.521678] [INFO ] [LOCAL     ] JCE: Starting deletion of primary data.
[2025-10-24T19:26:47.521953] [DEBUG] [LOCAL     ] JCE: Deleted primary data file.
[2025-10-24T19:26:47.522011] [INFO ] [MAIN      ] JCE: Starting full primary refresh.
[2025-10-24T19:26:47.647603] [INFO ] [REMOTE    ] JBND: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T19:26:47.904484] [INFO ] [REMOTE    ] JCE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:26:48.147614] [INFO ] [REMOTE    ] JCE: Fetching primary data for 2025-01.
[2025-10-24T19:26:48.386428] [INFO ] [REMOTE    ] JBTM: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T19:26:48.761136] [INFO ] [REMOTE    ] JCE: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T19:26:48.947632] [INFO ] [REMOTE    ] JBL: Fetching primary data for 2025-05.
[2025-10-24T19:26:49.747743] [INFO ] [REMOTE    ] JBTM: Fetching primary data for 2025-02.
[2025-10-24T19:26:50.528726] [INFO ] [REMOTE    ] JBL: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T19:26:50.547612] [INFO ] [REMOTE    ] JBND: Fetching primary data for 2025-03.
[2025-10-24T19:26:50.932444] [INFO ] [REMOTE    ] JBTM: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T19:26:51.347673] [INFO ] [REMOTE    ] JBL: Fetching primary data for 2025-06.
[2025-10-24T19:26:51.383796] [INFO ] [REMOTE    ] JBND: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T19:26:52.147676] [INFO ] [REMOTE    ] JBND: Fetching primary data for 2025-04.
[2025-10-24T19:26:52.947627] [INFO ] [REMOTE    ] JBTM: Fetching primary data for 2025-03.
[2025-10-24T19:26:53.300326] [INFO ] [REMOTE    ] JBL: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T19:26:53.357527] [INFO ] [REMOTE    ] JBND: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T19:26:53.747671] [INFO ] [REMOTE    ] JBND: Fetching primary data for 2025-05.
[2025-10-24T19:26:54.276353] [INFO ] [REMOTE    ] JBTM: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T19:26:54.547622] [INFO ] [REMOTE    ] JBTM: Fetching primary data for 2025-04.
[2025-10-24T19:26:54.836760] [INFO ] [REMOTE    ] JBND: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T19:26:55.347721] [INFO ] [REMOTE    ] JCE: Fetching primary data for 2025-02.
[2025-10-24T19:26:55.919121] [INFO ] [REMOTE    ] JBTM: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T19:26:55.931055] [INFO ] [REMOTE    ] JCE: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T19:26:56.147728] [INFO ] [REMOTE    ] JBTM: Fetching primary data for 2025-05.
[2025-10-24T19:26:56.947737] [INFO ] [REMOTE    ] JCE: Fetching primary data for 2025-03.
[2025-10-24T19:26:57.601503] [INFO ] [REMOTE    ] JBTM: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T19:26:57.601673] [INFO ] [REMOTE    ] JCE: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T19:26:57.747710] [INFO ] [REMOTE    ] JCE: Fetching primary data for 2025-04.
[2025-10-24T19:26:58.461195] [INFO ] [REMOTE    ] JCE: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T19:26:58.547737] [INFO ] [REMOTE    ] JCE: Fetching primary data for 2025-05.
[2025-10-24T19:26:59.127110] [INFO ] [REMOTE    ] JCE: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T19:26:59.347659] [INFO ] [REMOTE    ] JCE: Fetching primary data for 2025-06.
[2025-10-24T19:27:00.079291] [INFO ] [REMOTE    ] JCE: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T19:27:00.147617] [INFO ] [REMOTE    ] JBL: Fetching primary data for 2025-07.
[2025-10-24T19:27:00.947740] [INFO ] [REMOTE    ] JBND: Fetching primary data for 2025-06.
[2025-10-24T19:27:01.747727] [INFO ] [REMOTE    ] JBTM: Fetching primary data for 2025-06.
[2025-10-24T19:27:02.059164] [INFO ] [REMOTE    ] JBL: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T19:27:02.117173] [INFO ] [REMOTE    ] JBND: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T19:27:02.547747] [INFO ] [REMOTE    ] JBL: Fetching primary data for 2025-08.
[2025-10-24T19:27:03.051765] [INFO ] [REMOTE    ] JBTM: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T19:27:03.347671] [INFO ] [REMOTE    ] JCE: Fetching primary data for 2025-07.
[2025-10-24T19:27:04.145189] [INFO ] [REMOTE    ] JBL: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T19:27:04.148620] [INFO ] [REMOTE    ] JBTM: Fetching primary data for 2025-07.
[2025-10-24T19:27:04.167948] [INFO ] [REMOTE    ] JCE: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T19:27:04.947735] [INFO ] [REMOTE    ] JBND: Fetching primary data for 2025-07.
[2025-10-24T19:27:05.501095] [INFO ] [REMOTE    ] JBTM: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T19:27:05.747695] [INFO ] [REMOTE    ] JBTM: Fetching primary data for 2025-08.
[2025-10-24T19:27:06.087729] [INFO ] [REMOTE    ] JBND: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T19:27:06.547609] [INFO ] [REMOTE    ] JBL: Fetching primary data for 2025-09.
[2025-10-24T19:27:06.955084] [INFO ] [REMOTE    ] JBTM: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T19:27:07.347688] [INFO ] [REMOTE    ] JCE: Fetching primary data for 2025-08.
[2025-10-24T19:27:08.045421] [INFO ] [REMOTE    ] JCE: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T19:27:08.147721] [INFO ] [REMOTE    ] JBND: Fetching primary data for 2025-08.
[2025-10-24T19:27:08.348392] [INFO ] [REMOTE    ] JBL: Incremental fetch complete for 2025-09 (1.80 seconds).
[2025-10-24T19:27:08.947746] [INFO ] [REMOTE    ] JBTM: Fetching primary data for 2025-09.
[2025-10-24T19:27:09.262878] [INFO ] [REMOTE    ] JBND: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T19:27:09.747745] [INFO ] [REMOTE    ] JBND: Fetching primary data for 2025-09.
[2025-10-24T19:27:10.233985] [INFO ] [REMOTE    ] JBTM: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T19:27:10.547624] [INFO ] [REMOTE    ] JBL: Fetching primary data for 2025-10.
[2025-10-24T19:27:11.005148] [INFO ] [REMOTE    ] JBND: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T19:27:11.347753] [INFO ] [REMOTE    ] JBND: Fetching primary data for 2025-10.
[2025-10-24T19:27:12.147613] [INFO ] [REMOTE    ] JCE: Fetching primary data for 2025-09.
[2025-10-24T19:27:12.469139] [INFO ] [REMOTE    ] JBL: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T19:27:12.479010] [INFO ] [REMOTE    ] JBL: Full fetch complete (70600 records).
[2025-10-24T19:27:12.479193] [DEBUG] [VALIDATOR ] JBL: Validating primary data.
[2025-10-24T19:27:12.877433] [INFO ] [REMOTE    ] JBND: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T19:27:12.912952] [INFO ] [REMOTE    ] JCE: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T19:27:12.913102] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present.
[2025-10-24T19:27:12.913188] [INFO ] [REMOTE    ] JBND: Full fetch complete (36441 records).
[2025-10-24T19:27:12.915965] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed.
[2025-10-24T19:27:12.917678] [INFO ] [MAIN      ] JBL: Fetched primary data is valid.
[2025-10-24T19:27:12.916482] [DEBUG] [VALIDATOR ] JBND: Validating primary data.
[2025-10-24T19:27:12.917882] [DEBUG] [LOCAL     ] JBL: Saving primary data.
[2025-10-24T19:27:12.918839] [FATAL] [LOCAL     ] JBL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:27:12.924682] [FATAL] [MAIN      ] JBL: Failed to save primary data.
[2025-10-24T19:27:12.947883] [WARN ] [MAIN      ] JBL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:27:12.947680] [INFO ] [REMOTE    ] JBTM: Fetching primary data for 2025-10.
[2025-10-24T19:27:12.971068] [INFO ] [LOCAL     ] JBL: Starting deletion of primary data.
[2025-10-24T19:27:13.010461] [DEBUG] [LOCAL     ] JBL: No primary data file found to delete.
[2025-10-24T19:27:13.036933] [INFO ] [LOCAL     ] JBL: Starting deletion of derivative data.
[2025-10-24T19:27:13.048241] [DEBUG] [LOCAL     ] JBL: Deleted derivative data file.
[2025-10-24T19:27:13.048856] [INFO ] [MAIN      ] Update Progress: 1144/2366 symbols completed. JBL took 49.7s. Estimated remaining: 2h 37m 12s. Rate: 7.8 symbols/min
[2025-10-24T19:27:13.480065] [INFO ] [MAIN      ] JCI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:27:13.532811] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present.
[2025-10-24T19:27:13.532901] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed.
[2025-10-24T19:27:13.533791] [INFO ] [MAIN      ] JBND: Fetched primary data is valid.
[2025-10-24T19:27:13.533934] [DEBUG] [LOCAL     ] JBND: Saving primary data.
[2025-10-24T19:27:13.534494] [FATAL] [LOCAL     ] JBND: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:27:13.534592] [FATAL] [MAIN      ] JBND: Failed to save primary data.
[2025-10-24T19:27:13.534697] [WARN ] [MAIN      ] JBND: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:27:13.534794] [INFO ] [LOCAL     ] JBND: Starting deletion of primary data.
[2025-10-24T19:27:13.534870] [DEBUG] [LOCAL     ] JBND: No primary data file found to delete.
[2025-10-24T19:27:13.534909] [INFO ] [LOCAL     ] JBND: Starting deletion of derivative data.
[2025-10-24T19:27:13.535130] [DEBUG] [LOCAL     ] JBND: Deleted derivative data file.
[2025-10-24T19:27:13.535260] [INFO ] [MAIN      ] Update Progress: 1145/2366 symbols completed. JBND took 31.4s. Estimated remaining: 2h 36m 57s. Rate: 7.8 symbols/min
[2025-10-24T19:27:13.710228] [INFO ] [MAIN      ] JEF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:27:13.747617] [INFO ] [REMOTE    ] JCE: Fetching primary data for 2025-10.
[2025-10-24T19:27:13.750375] [DEBUG] [LOCAL     ] JCI: Loaded 53905 existing records from primary storage.
[2025-10-24T19:27:13.750905] [INFO ] [MAIN      ] JCI: Loaded 53905 existing records.
[2025-10-24T19:27:13.949048] [DEBUG] [LOCAL     ] JEF: Loaded 50570 existing records from primary storage.
[2025-10-24T19:27:13.969312] [WARN ] [MAIN      ] JCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:27:13.969548] [INFO ] [MAIN      ] JCI: Wiping existing primary data before full refresh.
[2025-10-24T19:27:13.969698] [INFO ] [LOCAL     ] JCI: Starting deletion of primary data.
[2025-10-24T19:27:13.969810] [INFO ] [MAIN      ] JEF: Loaded 50570 existing records.
[2025-10-24T19:27:13.995666] [DEBUG] [LOCAL     ] JCI: Deleted primary data file.
[2025-10-24T19:27:14.013522] [INFO ] [MAIN      ] JCI: Starting full primary refresh.
[2025-10-24T19:27:14.318760] [WARN ] [MAIN      ] JEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:27:14.359548] [INFO ] [MAIN      ] JEF: Wiping existing primary data before full refresh.
[2025-10-24T19:27:14.380791] [INFO ] [LOCAL     ] JEF: Starting deletion of primary data.
[2025-10-24T19:27:14.423181] [DEBUG] [LOCAL     ] JEF: Deleted primary data file.
[2025-10-24T19:27:14.433879] [INFO ] [MAIN      ] JEF: Starting full primary refresh.
[2025-10-24T19:27:14.634525] [INFO ] [REMOTE    ] JCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:27:14.635046] [INFO ] [REMOTE    ] JCI: Fetching primary data for 2025-01.
[2025-10-24T19:27:14.689203] [INFO ] [REMOTE    ] JCE: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T19:27:14.763804] [INFO ] [REMOTE    ] JCE: Full fetch complete (9606 records).
[2025-10-24T19:27:14.791042] [DEBUG] [VALIDATOR ] JCE: Validating primary data.
[2025-10-24T19:27:14.792812] [INFO ] [REMOTE    ] JBTM: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T19:27:14.885733] [INFO ] [REMOTE    ] JBTM: Full fetch complete (47001 records).
[2025-10-24T19:27:14.922312] [DEBUG] [VALIDATOR ] JBTM: Validating primary data.
[2025-10-24T19:27:15.129890] [INFO ] [REMOTE    ] JEF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:27:15.354543] [INFO ] [REMOTE    ] JEF: Fetching primary data for 2025-01.
[2025-10-24T19:27:15.590299] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present.
[2025-10-24T19:27:15.590425] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed.
[2025-10-24T19:27:15.590708] [INFO ] [MAIN      ] JCE: Fetched primary data is valid.
[2025-10-24T19:27:15.591000] [DEBUG] [LOCAL     ] JCE: Saving primary data.
[2025-10-24T19:27:15.596515] [FATAL] [LOCAL     ] JCE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:27:15.606892] [FATAL] [MAIN      ] JCE: Failed to save primary data.
[2025-10-24T19:27:15.612088] [WARN ] [MAIN      ] JCE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:27:15.617293] [INFO ] [LOCAL     ] JCE: Starting deletion of primary data.
[2025-10-24T19:27:15.629525] [DEBUG] [LOCAL     ] JCE: No primary data file found to delete.
[2025-10-24T19:27:15.639122] [INFO ] [LOCAL     ] JCE: Starting deletion of derivative data.
[2025-10-24T19:27:15.662621] [DEBUG] [LOCAL     ] JCE: Deleted derivative data file.
[2025-10-24T19:27:15.666935] [INFO ] [MAIN      ] Update Progress: 1146/2366 symbols completed. JCE took 28.5s. Estimated remaining: 2h 36m 43s. Rate: 7.8 symbols/min
[2025-10-24T19:27:15.689529] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present.
[2025-10-24T19:27:15.689690] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed.
[2025-10-24T19:27:15.690396] [INFO ] [MAIN      ] JBTM: Fetched primary data is valid.
[2025-10-24T19:27:15.690469] [DEBUG] [LOCAL     ] JBTM: Saving primary data.
[2025-10-24T19:27:15.723584] [FATAL] [LOCAL     ] JBTM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:27:15.736633] [FATAL] [MAIN      ] JBTM: Failed to save primary data.
[2025-10-24T19:27:15.745779] [WARN ] [MAIN      ] JBTM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:27:15.762512] [INFO ] [LOCAL     ] JBTM: Starting deletion of primary data.
[2025-10-24T19:27:15.783420] [DEBUG] [LOCAL     ] JBTM: No primary data file found to delete.
[2025-10-24T19:27:15.783514] [INFO ] [LOCAL     ] JBTM: Starting deletion of derivative data.
[2025-10-24T19:27:15.783827] [DEBUG] [LOCAL     ] JBTM: Deleted derivative data file.
[2025-10-24T19:27:15.789222] [INFO ] [MAIN      ] Update Progress: 1147/2366 symbols completed. JBTM took 29.8s. Estimated remaining: 2h 36m 27s. Rate: 7.8 symbols/min
[2025-10-24T19:27:15.975246] [INFO ] [MAIN      ] JELD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:27:16.053837] [INFO ] [MAIN      ] JFR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:27:16.105417] [DEBUG] [LOCAL     ] JELD: Loaded 46140 existing records from primary storage.
[2025-10-24T19:27:16.104165] [DEBUG] [LOCAL     ] JFR: Loaded 31341 existing records from primary storage.
[2025-10-24T19:27:16.105825] [INFO ] [MAIN      ] JELD: Loaded 46140 existing records.
[2025-10-24T19:27:16.105908] [INFO ] [MAIN      ] JFR: Loaded 31341 existing records.
[2025-10-24T19:27:16.432047] [WARN ] [MAIN      ] JELD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:27:16.450521] [INFO ] [MAIN      ] JELD: Wiping existing primary data before full refresh.
[2025-10-24T19:27:16.461864] [INFO ] [LOCAL     ] JELD: Starting deletion of primary data.
[2025-10-24T19:27:16.474298] [WARN ] [MAIN      ] JFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:27:16.474793] [INFO ] [MAIN      ] JFR: Wiping existing primary data before full refresh.
[2025-10-24T19:27:16.474906] [INFO ] [LOCAL     ] JFR: Starting deletion of primary data.
[2025-10-24T19:27:16.475101] [DEBUG] [LOCAL     ] JELD: Deleted primary data file.
[2025-10-24T19:27:16.475229] [INFO ] [MAIN      ] JELD: Starting full primary refresh.
[2025-10-24T19:27:16.486519] [DEBUG] [LOCAL     ] JFR: Deleted primary data file.
[2025-10-24T19:27:16.496005] [INFO ] [MAIN      ] JFR: Starting full primary refresh.
[2025-10-24T19:27:16.997372] [INFO ] [REMOTE    ] JCI: Incremental fetch complete for 2025-01 (2.36 seconds).
[2025-10-24T19:27:17.112979] [INFO ] [REMOTE    ] JELD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:27:17.120090] [INFO ] [REMOTE    ] JCI: Fetching primary data for 2025-02.
[2025-10-24T19:27:17.141115] [INFO ] [REMOTE    ] JELD: Fetching primary data for 2025-01.
[2025-10-24T19:27:17.251572] [INFO ] [REMOTE    ] JFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:27:17.282765] [INFO ] [REMOTE    ] JEF: Incremental fetch complete for 2025-01 (1.93 seconds).
[2025-10-24T19:27:17.747745] [INFO ] [REMOTE    ] JEF: Fetching primary data for 2025-02.
[2025-10-24T19:27:18.462861] [INFO ] [REMOTE    ] JELD: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T19:27:18.547630] [INFO ] [REMOTE    ] JELD: Fetching primary data for 2025-02.
[2025-10-24T19:27:18.796541] [INFO ] [REMOTE    ] JCI: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T19:27:18.889869] [INFO ] [REMOTE    ] JEF: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T19:27:19.347730] [INFO ] [REMOTE    ] JCI: Fetching primary data for 2025-03.
[2025-10-24T19:27:19.618394] [INFO ] [REMOTE    ] JELD: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T19:27:20.147728] [INFO ] [REMOTE    ] JELD: Fetching primary data for 2025-03.
[2025-10-24T19:27:20.947707] [INFO ] [REMOTE    ] JFR: Fetching primary data for 2025-01.
[2025-10-24T19:27:21.391439] [INFO ] [REMOTE    ] JCI: Incremental fetch complete for 2025-03 (2.04 seconds).
[2025-10-24T19:27:21.481728] [INFO ] [REMOTE    ] JELD: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T19:27:21.747698] [INFO ] [REMOTE    ] JEF: Fetching primary data for 2025-03.
[2025-10-24T19:27:21.918014] [INFO ] [REMOTE    ] JFR: Incremental fetch complete for 2025-01 (0.97 seconds).
[2025-10-24T19:27:22.547665] [INFO ] [REMOTE    ] JELD: Fetching primary data for 2025-04.
[2025-10-24T19:27:23.347618] [INFO ] [REMOTE    ] JCI: Fetching primary data for 2025-04.
[2025-10-24T19:27:23.558244] [INFO ] [REMOTE    ] JEF: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T19:27:24.145679] [INFO ] [REMOTE    ] JELD: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T19:27:24.149364] [INFO ] [REMOTE    ] JFR: Fetching primary data for 2025-02.
[2025-10-24T19:27:24.947624] [INFO ] [REMOTE    ] JEF: Fetching primary data for 2025-04.
[2025-10-24T19:27:25.121884] [INFO ] [REMOTE    ] JCI: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T19:27:25.637448] [INFO ] [REMOTE    ] JFR: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T19:27:25.747620] [INFO ] [REMOTE    ] JFR: Fetching primary data for 2025-03.
[2025-10-24T19:27:26.553451] [INFO ] [REMOTE    ] JCI: Fetching primary data for 2025-05.
[2025-10-24T19:27:26.567399] [INFO ] [REMOTE    ] JEF: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T19:27:26.996111] [INFO ] [REMOTE    ] JFR: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T19:27:27.347674] [INFO ] [REMOTE    ] JEF: Fetching primary data for 2025-05.
[2025-10-24T19:27:28.086707] [INFO ] [REMOTE    ] JCI: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T19:27:28.147607] [INFO ] [REMOTE    ] JELD: Fetching primary data for 2025-05.
[2025-10-24T19:27:28.873396] [INFO ] [REMOTE    ] JEF: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T19:27:28.947611] [INFO ] [REMOTE    ] JCI: Fetching primary data for 2025-06.
[2025-10-24T19:27:29.627568] [INFO ] [REMOTE    ] JELD: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T19:27:29.747604] [INFO ] [REMOTE    ] JELD: Fetching primary data for 2025-06.
[2025-10-24T19:27:30.547605] [INFO ] [REMOTE    ] JFR: Fetching primary data for 2025-04.
[2025-10-24T19:27:31.003539] [INFO ] [REMOTE    ] JCI: Incremental fetch complete for 2025-06 (2.06 seconds).
[2025-10-24T19:27:31.036924] [INFO ] [REMOTE    ] JELD: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T19:27:31.347730] [INFO ] [REMOTE    ] JELD: Fetching primary data for 2025-07.
[2025-10-24T19:27:31.927947] [INFO ] [REMOTE    ] JFR: Incremental fetch complete for 2025-04 (1.38 seconds).
[2025-10-24T19:27:32.147699] [INFO ] [REMOTE    ] JEF: Fetching primary data for 2025-06.
[2025-10-24T19:27:32.881605] [INFO ] [REMOTE    ] JELD: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T19:27:32.947612] [INFO ] [REMOTE    ] JCI: Fetching primary data for 2025-07.
[2025-10-24T19:27:33.286460] [INFO ] [REMOTE    ] JEF: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T19:27:33.747629] [INFO ] [REMOTE    ] JEF: Fetching primary data for 2025-07.
[2025-10-24T19:27:34.547723] [INFO ] [REMOTE    ] JELD: Fetching primary data for 2025-08.
[2025-10-24T19:27:34.617162] [INFO ] [REMOTE    ] JCI: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T19:27:35.347749] [INFO ] [REMOTE    ] JFR: Fetching primary data for 2025-05.
[2025-10-24T19:27:35.898188] [INFO ] [REMOTE    ] JEF: Incremental fetch complete for 2025-07 (2.15 seconds).
[2025-10-24T19:27:36.147694] [INFO ] [REMOTE    ] JCI: Fetching primary data for 2025-08.
[2025-10-24T19:27:36.184673] [INFO ] [REMOTE    ] JELD: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T19:27:36.486706] [INFO ] [REMOTE    ] JFR: Incremental fetch complete for 2025-05 (1.14 seconds).
[2025-10-24T19:27:36.947694] [INFO ] [REMOTE    ] JFR: Fetching primary data for 2025-06.
[2025-10-24T19:27:37.543264] [INFO ] [REMOTE    ] JCI: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T19:27:37.747631] [INFO ] [REMOTE    ] JELD: Fetching primary data for 2025-09.
[2025-10-24T19:27:37.996406] [INFO ] [REMOTE    ] JFR: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T19:27:38.547732] [INFO ] [REMOTE    ] JEF: Fetching primary data for 2025-08.
[2025-10-24T19:27:38.802762] [INFO ] [REMOTE    ] JELD: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T19:27:39.347670] [INFO ] [REMOTE    ] JELD: Fetching primary data for 2025-10.
[2025-10-24T19:27:39.756402] [INFO ] [REMOTE    ] JEF: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T19:27:40.147670] [INFO ] [REMOTE    ] JCI: Fetching primary data for 2025-09.
[2025-10-24T19:27:40.859877] [INFO ] [REMOTE    ] JELD: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T19:27:40.868888] [INFO ] [REMOTE    ] JELD: Full fetch complete (64601 records).
[2025-10-24T19:27:40.869095] [DEBUG] [VALIDATOR ] JELD: Validating primary data.
[2025-10-24T19:27:40.952855] [INFO ] [REMOTE    ] JFR: Fetching primary data for 2025-07.
[2025-10-24T19:27:41.269789] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present.
[2025-10-24T19:27:41.269928] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed.
[2025-10-24T19:27:41.272070] [INFO ] [MAIN      ] JELD: Fetched primary data is valid.
[2025-10-24T19:27:41.272140] [DEBUG] [LOCAL     ] JELD: Saving primary data.
[2025-10-24T19:27:41.273000] [FATAL] [LOCAL     ] JELD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:27:41.273105] [FATAL] [MAIN      ] JELD: Failed to save primary data.
[2025-10-24T19:27:41.273150] [WARN ] [MAIN      ] JELD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:27:41.273188] [INFO ] [LOCAL     ] JELD: Starting deletion of primary data.
[2025-10-24T19:27:41.273251] [DEBUG] [LOCAL     ] JELD: No primary data file found to delete.
[2025-10-24T19:27:41.273338] [INFO ] [LOCAL     ] JELD: Starting deletion of derivative data.
[2025-10-24T19:27:41.273544] [DEBUG] [LOCAL     ] JELD: Deleted derivative data file.
[2025-10-24T19:27:41.274096] [INFO ] [MAIN      ] Update Progress: 1148/2366 symbols completed. JELD took 25.6s. Estimated remaining: 2h 36m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:27:41.453248] [INFO ] [MAIN      ] JGH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:27:41.494510] [INFO ] [REMOTE    ] JCI: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T19:27:41.500336] [DEBUG] [LOCAL     ] JGH: Loaded 12607 existing records from primary storage.
[2025-10-24T19:27:41.512279] [INFO ] [MAIN      ] JGH: Loaded 12607 existing records.
[2025-10-24T19:27:41.696171] [WARN ] [MAIN      ] JGH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:27:41.696450] [INFO ] [MAIN      ] JGH: Wiping existing primary data before full refresh.
[2025-10-24T19:27:41.696501] [INFO ] [LOCAL     ] JGH: Starting deletion of primary data.
[2025-10-24T19:27:41.696892] [DEBUG] [LOCAL     ] JGH: Deleted primary data file.
[2025-10-24T19:27:41.696952] [INFO ] [MAIN      ] JGH: Starting full primary refresh.
[2025-10-24T19:27:41.753340] [INFO ] [REMOTE    ] JEF: Fetching primary data for 2025-09.
[2025-10-24T19:27:42.078789] [INFO ] [REMOTE    ] JGH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:27:42.289767] [INFO ] [REMOTE    ] JFR: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T19:27:42.547759] [INFO ] [REMOTE    ] JGH: Fetching primary data for 2025-01.
[2025-10-24T19:27:43.190056] [INFO ] [REMOTE    ] JGH: Incremental fetch complete for 2025-01 (0.64 seconds).
[2025-10-24T19:27:43.347693] [INFO ] [REMOTE    ] JFR: Fetching primary data for 2025-08.
[2025-10-24T19:27:43.495377] [INFO ] [REMOTE    ] JEF: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T19:27:44.147617] [INFO ] [REMOTE    ] JCI: Fetching primary data for 2025-10.
[2025-10-24T19:27:44.618385] [INFO ] [REMOTE    ] JFR: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T19:27:44.947689] [INFO ] [REMOTE    ] JFR: Fetching primary data for 2025-09.
[2025-10-24T19:27:45.747707] [INFO ] [REMOTE    ] JEF: Fetching primary data for 2025-10.
[2025-10-24T19:27:45.778218] [INFO ] [REMOTE    ] JCI: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T19:27:45.787982] [INFO ] [REMOTE    ] JCI: Full fetch complete (77658 records).
[2025-10-24T19:27:45.788156] [DEBUG] [VALIDATOR ] JCI: Validating primary data.
[2025-10-24T19:27:46.229230] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present.
[2025-10-24T19:27:46.229475] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed.
[2025-10-24T19:27:46.230877] [INFO ] [MAIN      ] JCI: Fetched primary data is valid.
[2025-10-24T19:27:46.231008] [DEBUG] [LOCAL     ] JCI: Saving primary data.
[2025-10-24T19:27:46.231839] [FATAL] [LOCAL     ] JCI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:27:46.232011] [FATAL] [MAIN      ] JCI: Failed to save primary data.
[2025-10-24T19:27:46.232084] [WARN ] [MAIN      ] JCI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:27:46.232163] [INFO ] [LOCAL     ] JCI: Starting deletion of primary data.
[2025-10-24T19:27:46.232228] [DEBUG] [LOCAL     ] JCI: No primary data file found to delete.
[2025-10-24T19:27:46.232267] [INFO ] [LOCAL     ] JCI: Starting deletion of derivative data.
[2025-10-24T19:27:46.232431] [DEBUG] [LOCAL     ] JCI: Deleted derivative data file.
[2025-10-24T19:27:46.232894] [INFO ] [MAIN      ] Update Progress: 1149/2366 symbols completed. JCI took 33.2s. Estimated remaining: 2h 36m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:27:46.425719] [INFO ] [REMOTE    ] JFR: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T19:27:46.474515] [INFO ] [MAIN      ] JHG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:27:46.521081] [DEBUG] [LOCAL     ] JHG: Loaded 47835 existing records from primary storage.
[2025-10-24T19:27:46.521405] [INFO ] [MAIN      ] JHG: Loaded 47835 existing records.
[2025-10-24T19:27:46.552735] [INFO ] [REMOTE    ] JFR: Fetching primary data for 2025-10.
[2025-10-24T19:27:46.698727] [WARN ] [MAIN      ] JHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:27:46.698952] [INFO ] [MAIN      ] JHG: Wiping existing primary data before full refresh.
[2025-10-24T19:27:46.699000] [INFO ] [LOCAL     ] JHG: Starting deletion of primary data.
[2025-10-24T19:27:46.699577] [DEBUG] [LOCAL     ] JHG: Deleted primary data file.
[2025-10-24T19:27:46.699617] [INFO ] [MAIN      ] JHG: Starting full primary refresh.
[2025-10-24T19:27:47.042825] [INFO ] [REMOTE    ] JHG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:27:47.273085] [INFO ] [REMOTE    ] JEF: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T19:27:47.283733] [INFO ] [REMOTE    ] JEF: Full fetch complete (73334 records).
[2025-10-24T19:27:47.283933] [DEBUG] [VALIDATOR ] JEF: Validating primary data.
[2025-10-24T19:27:47.354462] [INFO ] [REMOTE    ] JGH: Fetching primary data for 2025-02.
[2025-10-24T19:27:47.705701] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present.
[2025-10-24T19:27:47.705835] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed.
[2025-10-24T19:27:47.707451] [INFO ] [MAIN      ] JEF: Fetched primary data is valid.
[2025-10-24T19:27:47.707524] [DEBUG] [LOCAL     ] JEF: Saving primary data.
[2025-10-24T19:27:47.708535] [FATAL] [LOCAL     ] JEF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:27:47.708668] [FATAL] [MAIN      ] JEF: Failed to save primary data.
[2025-10-24T19:27:47.708728] [WARN ] [MAIN      ] JEF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:27:47.708772] [INFO ] [LOCAL     ] JEF: Starting deletion of primary data.
[2025-10-24T19:27:47.708871] [DEBUG] [LOCAL     ] JEF: No primary data file found to delete.
[2025-10-24T19:27:47.708921] [INFO ] [LOCAL     ] JEF: Starting deletion of derivative data.
[2025-10-24T19:27:47.709153] [DEBUG] [LOCAL     ] JEF: Deleted derivative data file.
[2025-10-24T19:27:47.709742] [INFO ] [MAIN      ] Update Progress: 1150/2366 symbols completed. JEF took 34.2s. Estimated remaining: 2h 36m 14s. Rate: 7.8 symbols/min
[2025-10-24T19:27:47.894831] [INFO ] [MAIN      ] JHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:27:47.903185] [DEBUG] [LOCAL     ] JHI: Loaded 4173 existing records from primary storage.
[2025-10-24T19:27:47.903475] [INFO ] [MAIN      ] JHI: Loaded 4173 existing records.
[2025-10-24T19:27:48.088402] [WARN ] [MAIN      ] JHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:27:48.117537] [INFO ] [MAIN      ] JHI: Wiping existing primary data before full refresh.
[2025-10-24T19:27:48.117250] [INFO ] [REMOTE    ] JGH: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T19:27:48.119828] [INFO ] [LOCAL     ] JHI: Starting deletion of primary data.
[2025-10-24T19:27:48.121615] [INFO ] [REMOTE    ] JFR: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T19:27:48.128038] [DEBUG] [LOCAL     ] JHI: Deleted primary data file.
[2025-10-24T19:27:48.128777] [INFO ] [MAIN      ] JHI: Starting full primary refresh.
[2025-10-24T19:27:48.152906] [INFO ] [REMOTE    ] JGH: Fetching primary data for 2025-03.
[2025-10-24T19:27:48.152829] [INFO ] [REMOTE    ] JFR: Full fetch complete (48671 records).
[2025-10-24T19:27:48.166112] [DEBUG] [VALIDATOR ] JFR: Validating primary data.
[2025-10-24T19:27:48.849234] [INFO ] [REMOTE    ] JHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:27:48.901937] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present.
[2025-10-24T19:27:48.902141] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed.
[2025-10-24T19:27:48.904250] [INFO ] [MAIN      ] JFR: Fetched primary data is valid.
[2025-10-24T19:27:48.904328] [DEBUG] [LOCAL     ] JFR: Saving primary data.
[2025-10-24T19:27:48.905112] [FATAL] [LOCAL     ] JFR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:27:48.905207] [FATAL] [MAIN      ] JFR: Failed to save primary data.
[2025-10-24T19:27:48.905252] [WARN ] [MAIN      ] JFR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:27:48.905288] [INFO ] [LOCAL     ] JFR: Starting deletion of primary data.
[2025-10-24T19:27:48.905350] [DEBUG] [LOCAL     ] JFR: No primary data file found to delete.
[2025-10-24T19:27:48.905390] [INFO ] [LOCAL     ] JFR: Starting deletion of derivative data.
[2025-10-24T19:27:48.905605] [DEBUG] [LOCAL     ] JFR: Deleted derivative data file.
[2025-10-24T19:27:48.905759] [INFO ] [MAIN      ] Update Progress: 1151/2366 symbols completed. JFR took 33.1s. Estimated remaining: 2h 35m 59s. Rate: 7.8 symbols/min
[2025-10-24T19:27:48.952777] [INFO ] [REMOTE    ] JHG: Fetching primary data for 2025-01.
[2025-10-24T19:27:49.024157] [INFO ] [REMOTE    ] JGH: Incremental fetch complete for 2025-03 (0.87 seconds).
[2025-10-24T19:27:49.108239] [INFO ] [MAIN      ] JHS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:27:49.114356] [DEBUG] [LOCAL     ] JHS: Loaded 3034 existing records from primary storage.
[2025-10-24T19:27:49.114553] [INFO ] [MAIN      ] JHS: Loaded 3034 existing records.
[2025-10-24T19:27:49.307869] [WARN ] [MAIN      ] JHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:27:49.308184] [INFO ] [MAIN      ] JHS: Wiping existing primary data before full refresh.
[2025-10-24T19:27:49.308247] [INFO ] [LOCAL     ] JHS: Starting deletion of primary data.
[2025-10-24T19:27:49.308443] [DEBUG] [LOCAL     ] JHS: Deleted primary data file.
[2025-10-24T19:27:49.308484] [INFO ] [MAIN      ] JHS: Starting full primary refresh.
[2025-10-24T19:27:49.698452] [INFO ] [REMOTE    ] JHS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:27:49.747712] [INFO ] [REMOTE    ] JHS: Fetching primary data for 2025-01.
[2025-10-24T19:27:50.274169] [INFO ] [REMOTE    ] JHG: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T19:27:50.378598] [INFO ] [REMOTE    ] JHS: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T19:27:50.547666] [INFO ] [REMOTE    ] JHG: Fetching primary data for 2025-02.
[2025-10-24T19:27:51.347813] [INFO ] [REMOTE    ] JHI: Fetching primary data for 2025-01.
[2025-10-24T19:27:51.949129] [INFO ] [REMOTE    ] JHI: Incremental fetch complete for 2025-01 (0.60 seconds).
[2025-10-24T19:27:51.955030] [INFO ] [REMOTE    ] JHG: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T19:27:52.147743] [INFO ] [REMOTE    ] JHG: Fetching primary data for 2025-03.
[2025-10-24T19:27:52.947673] [INFO ] [REMOTE    ] JGH: Fetching primary data for 2025-04.
[2025-10-24T19:27:53.631147] [INFO ] [REMOTE    ] JHG: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T19:27:53.653357] [INFO ] [REMOTE    ] JGH: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T19:27:53.747704] [INFO ] [REMOTE    ] JHG: Fetching primary data for 2025-04.
[2025-10-24T19:27:54.547708] [INFO ] [REMOTE    ] JGH: Fetching primary data for 2025-05.
[2025-10-24T19:27:55.264349] [INFO ] [REMOTE    ] JGH: Incremental fetch complete for 2025-05 (0.72 seconds).
[2025-10-24T19:27:55.347614] [INFO ] [REMOTE    ] JHS: Fetching primary data for 2025-02.
[2025-10-24T19:27:55.404615] [INFO ] [REMOTE    ] JHG: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T19:27:55.905304] [INFO ] [REMOTE    ] JHS: Incremental fetch complete for 2025-02 (0.56 seconds).
[2025-10-24T19:27:56.147803] [INFO ] [REMOTE    ] JGH: Fetching primary data for 2025-06.
[2025-10-24T19:27:56.947619] [INFO ] [REMOTE    ] JHG: Fetching primary data for 2025-05.
[2025-10-24T19:27:56.975949] [INFO ] [REMOTE    ] JGH: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T19:27:57.747628] [INFO ] [REMOTE    ] JHI: Fetching primary data for 2025-02.
[2025-10-24T19:27:58.204321] [INFO ] [REMOTE    ] JHI: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T19:27:58.456052] [INFO ] [REMOTE    ] JHG: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T19:27:58.547612] [INFO ] [REMOTE    ] JGH: Fetching primary data for 2025-07.
[2025-10-24T19:27:59.022552] [INFO ] [REMOTE    ] JGH: Incremental fetch complete for 2025-07 (0.47 seconds).
[2025-10-24T19:27:59.347746] [INFO ] [REMOTE    ] JHI: Fetching primary data for 2025-03.
[2025-10-24T19:27:59.703350] [INFO ] [REMOTE    ] JHI: Incremental fetch complete for 2025-03 (0.36 seconds).
[2025-10-24T19:28:00.147671] [INFO ] [REMOTE    ] JGH: Fetching primary data for 2025-08.
[2025-10-24T19:28:00.939229] [INFO ] [REMOTE    ] JGH: Incremental fetch complete for 2025-08 (0.79 seconds).
[2025-10-24T19:28:00.947600] [INFO ] [REMOTE    ] JGH: Fetching primary data for 2025-09.
[2025-10-24T19:28:01.747730] [INFO ] [REMOTE    ] JHS: Fetching primary data for 2025-03.
[2025-10-24T19:28:01.852267] [INFO ] [REMOTE    ] JGH: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T19:28:02.248789] [INFO ] [REMOTE    ] JHS: Incremental fetch complete for 2025-03 (0.50 seconds).
[2025-10-24T19:28:02.547721] [INFO ] [REMOTE    ] JHG: Fetching primary data for 2025-06.
[2025-10-24T19:28:03.347725] [INFO ] [REMOTE    ] JGH: Fetching primary data for 2025-10.
[2025-10-24T19:28:03.792342] [INFO ] [REMOTE    ] JHG: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T19:28:04.147734] [INFO ] [REMOTE    ] JHS: Fetching primary data for 2025-04.
[2025-10-24T19:28:04.459545] [INFO ] [REMOTE    ] JGH: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T19:28:04.463775] [INFO ] [REMOTE    ] JGH: Full fetch complete (16375 records).
[2025-10-24T19:28:04.463848] [DEBUG] [VALIDATOR ] JGH: Validating primary data.
[2025-10-24T19:28:04.640737] [INFO ] [REMOTE    ] JHS: Incremental fetch complete for 2025-04 (0.49 seconds).
[2025-10-24T19:28:04.827166] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present.
[2025-10-24T19:28:04.827270] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed.
[2025-10-24T19:28:04.827636] [INFO ] [MAIN      ] JGH: Fetched primary data is valid.
[2025-10-24T19:28:04.827715] [DEBUG] [LOCAL     ] JGH: Saving primary data.
[2025-10-24T19:28:04.827949] [FATAL] [LOCAL     ] JGH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:28:04.828031] [FATAL] [MAIN      ] JGH: Failed to save primary data.
[2025-10-24T19:28:04.828072] [WARN ] [MAIN      ] JGH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:28:04.828106] [INFO ] [LOCAL     ] JGH: Starting deletion of primary data.
[2025-10-24T19:28:04.828155] [DEBUG] [LOCAL     ] JGH: No primary data file found to delete.
[2025-10-24T19:28:04.828188] [INFO ] [LOCAL     ] JGH: Starting deletion of derivative data.
[2025-10-24T19:28:04.828311] [DEBUG] [LOCAL     ] JGH: Deleted derivative data file.
[2025-10-24T19:28:04.828380] [INFO ] [MAIN      ] Update Progress: 1152/2366 symbols completed. JGH took 23.6s. Estimated remaining: 2h 35m 60s. Rate: 7.8 symbols/min
[2025-10-24T19:28:04.952751] [INFO ] [REMOTE    ] JHG: Fetching primary data for 2025-07.
[2025-10-24T19:28:04.995522] [INFO ] [MAIN      ] JHX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:28:05.049696] [DEBUG] [LOCAL     ] JHX: Loaded 53589 existing records from primary storage.
[2025-10-24T19:28:05.049999] [INFO ] [MAIN      ] JHX: Loaded 53589 existing records.
[2025-10-24T19:28:05.220695] [WARN ] [MAIN      ] JHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:28:05.220903] [INFO ] [MAIN      ] JHX: Wiping existing primary data before full refresh.
[2025-10-24T19:28:05.220949] [INFO ] [LOCAL     ] JHX: Starting deletion of primary data.
[2025-10-24T19:28:05.221478] [DEBUG] [LOCAL     ] JHX: Deleted primary data file.
[2025-10-24T19:28:05.221533] [INFO ] [MAIN      ] JHX: Starting full primary refresh.
[2025-10-24T19:28:05.569742] [INFO ] [REMOTE    ] JHX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:28:05.747669] [INFO ] [REMOTE    ] JHI: Fetching primary data for 2025-04.
[2025-10-24T19:28:06.358312] [INFO ] [REMOTE    ] JHI: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T19:28:06.469134] [INFO ] [REMOTE    ] JHG: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T19:28:06.547692] [INFO ] [REMOTE    ] JHG: Fetching primary data for 2025-08.
[2025-10-24T19:28:07.347714] [INFO ] [REMOTE    ] JHX: Fetching primary data for 2025-01.
[2025-10-24T19:28:08.098326] [INFO ] [REMOTE    ] JHG: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T19:28:08.147610] [INFO ] [REMOTE    ] JHG: Fetching primary data for 2025-09.
[2025-10-24T19:28:08.271691] [INFO ] [REMOTE    ] JHX: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T19:28:08.947675] [INFO ] [REMOTE    ] JHS: Fetching primary data for 2025-05.
[2025-10-24T19:28:09.400717] [INFO ] [REMOTE    ] JHS: Incremental fetch complete for 2025-05 (0.45 seconds).
[2025-10-24T19:28:09.747679] [INFO ] [REMOTE    ] JHS: Fetching primary data for 2025-06.
[2025-10-24T19:28:09.828327] [INFO ] [REMOTE    ] JHG: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T19:28:10.285926] [INFO ] [REMOTE    ] JHS: Incremental fetch complete for 2025-06 (0.54 seconds).
[2025-10-24T19:28:10.547634] [INFO ] [REMOTE    ] JHG: Fetching primary data for 2025-10.
[2025-10-24T19:28:11.347664] [INFO ] [REMOTE    ] JHS: Fetching primary data for 2025-07.
[2025-10-24T19:28:11.992188] [INFO ] [REMOTE    ] JHS: Incremental fetch complete for 2025-07 (0.64 seconds).
[2025-10-24T19:28:12.147612] [INFO ] [REMOTE    ] JHX: Fetching primary data for 2025-02.
[2025-10-24T19:28:12.393873] [INFO ] [REMOTE    ] JHG: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T19:28:12.402448] [INFO ] [REMOTE    ] JHG: Full fetch complete (68664 records).
[2025-10-24T19:28:12.402564] [DEBUG] [VALIDATOR ] JHG: Validating primary data.
[2025-10-24T19:28:12.814423] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present.
[2025-10-24T19:28:12.814565] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed.
[2025-10-24T19:28:12.815779] [INFO ] [MAIN      ] JHG: Fetched primary data is valid.
[2025-10-24T19:28:12.815845] [DEBUG] [LOCAL     ] JHG: Saving primary data.
[2025-10-24T19:28:12.816451] [FATAL] [LOCAL     ] JHG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:28:12.816528] [FATAL] [MAIN      ] JHG: Failed to save primary data.
[2025-10-24T19:28:12.816570] [WARN ] [MAIN      ] JHG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:28:12.816633] [INFO ] [LOCAL     ] JHG: Starting deletion of primary data.
[2025-10-24T19:28:12.816764] [DEBUG] [LOCAL     ] JHG: No primary data file found to delete.
[2025-10-24T19:28:12.816824] [INFO ] [LOCAL     ] JHG: Starting deletion of derivative data.
[2025-10-24T19:28:12.816961] [DEBUG] [LOCAL     ] JHG: Deleted derivative data file.
[2025-10-24T19:28:12.817353] [INFO ] [MAIN      ] Update Progress: 1153/2366 symbols completed. JHG took 26.6s. Estimated remaining: 2h 35m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:28:12.957715] [INFO ] [REMOTE    ] JHS: Fetching primary data for 2025-08.
[2025-10-24T19:28:13.006372] [INFO ] [MAIN      ] JILL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:28:13.010696] [INFO ] [REMOTE    ] JHX: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T19:28:13.035279] [DEBUG] [LOCAL     ] JILL: Loaded 15317 existing records from primary storage.
[2025-10-24T19:28:13.035621] [INFO ] [MAIN      ] JILL: Loaded 15317 existing records.
[2025-10-24T19:28:13.216474] [WARN ] [MAIN      ] JILL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:28:13.216706] [INFO ] [MAIN      ] JILL: Wiping existing primary data before full refresh.
[2025-10-24T19:28:13.216765] [INFO ] [LOCAL     ] JILL: Starting deletion of primary data.
[2025-10-24T19:28:13.217007] [DEBUG] [LOCAL     ] JILL: Deleted primary data file.
[2025-10-24T19:28:13.217062] [INFO ] [MAIN      ] JILL: Starting full primary refresh.
[2025-10-24T19:28:13.580589] [INFO ] [REMOTE    ] JILL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:28:13.575705] [INFO ] [REMOTE    ] JHS: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T19:28:13.747712] [INFO ] [REMOTE    ] JILL: Fetching primary data for 2025-01.
[2025-10-24T19:28:14.549700] [INFO ] [REMOTE    ] JHX: Fetching primary data for 2025-03.
[2025-10-24T19:28:14.554953] [INFO ] [REMOTE    ] JILL: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T19:28:15.347697] [INFO ] [REMOTE    ] JILL: Fetching primary data for 2025-02.
[2025-10-24T19:28:15.711483] [INFO ] [REMOTE    ] JHX: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T19:28:16.147699] [INFO ] [REMOTE    ] JHS: Fetching primary data for 2025-09.
[2025-10-24T19:28:16.278131] [INFO ] [REMOTE    ] JILL: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T19:28:16.777017] [INFO ] [REMOTE    ] JHS: Incremental fetch complete for 2025-09 (0.63 seconds).
[2025-10-24T19:28:16.947626] [INFO ] [REMOTE    ] JHI: Fetching primary data for 2025-05.
[2025-10-24T19:28:17.449763] [INFO ] [REMOTE    ] JHI: Incremental fetch complete for 2025-05 (0.50 seconds).
[2025-10-24T19:28:17.747702] [INFO ] [REMOTE    ] JHI: Fetching primary data for 2025-06.
[2025-10-24T19:28:18.299725] [INFO ] [REMOTE    ] JHI: Incremental fetch complete for 2025-06 (0.55 seconds).
[2025-10-24T19:28:18.547721] [INFO ] [REMOTE    ] JHI: Fetching primary data for 2025-07.
[2025-10-24T19:28:19.023332] [INFO ] [REMOTE    ] JHI: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T19:28:19.347716] [INFO ] [REMOTE    ] JILL: Fetching primary data for 2025-03.
[2025-10-24T19:28:20.147631] [INFO ] [REMOTE    ] JHI: Fetching primary data for 2025-08.
[2025-10-24T19:28:20.379966] [INFO ] [REMOTE    ] JILL: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T19:28:20.602895] [INFO ] [REMOTE    ] JHI: Incremental fetch complete for 2025-08 (0.46 seconds).
[2025-10-24T19:28:20.947703] [INFO ] [REMOTE    ] JHX: Fetching primary data for 2025-04.
[2025-10-24T19:28:21.747710] [INFO ] [REMOTE    ] JHI: Fetching primary data for 2025-09.
[2025-10-24T19:28:22.452568] [INFO ] [REMOTE    ] JHX: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T19:28:22.483980] [INFO ] [REMOTE    ] JHI: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T19:28:22.547608] [INFO ] [REMOTE    ] JHX: Fetching primary data for 2025-05.
[2025-10-24T19:28:23.347710] [INFO ] [REMOTE    ] JHS: Fetching primary data for 2025-10.
[2025-10-24T19:28:23.956575] [INFO ] [REMOTE    ] JHS: Incremental fetch complete for 2025-10 (0.61 seconds).
[2025-10-24T19:28:23.957858] [INFO ] [REMOTE    ] JHS: Full fetch complete (4573 records).
[2025-10-24T19:28:23.957929] [DEBUG] [VALIDATOR ] JHS: Validating primary data.
[2025-10-24T19:28:24.152930] [INFO ] [REMOTE    ] JILL: Fetching primary data for 2025-04.
[2025-10-24T19:28:24.351537] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present.
[2025-10-24T19:28:24.353213] [INFO ] [REMOTE    ] JHX: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T19:28:24.353302] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed.
[2025-10-24T19:28:24.363889] [INFO ] [MAIN      ] JHS: Fetched primary data is valid.
[2025-10-24T19:28:24.364319] [DEBUG] [LOCAL     ] JHS: Saving primary data.
[2025-10-24T19:28:24.364889] [FATAL] [LOCAL     ] JHS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:28:24.364971] [FATAL] [MAIN      ] JHS: Failed to save primary data.
[2025-10-24T19:28:24.365037] [WARN ] [MAIN      ] JHS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:28:24.365101] [INFO ] [LOCAL     ] JHS: Starting deletion of primary data.
[2025-10-24T19:28:24.365163] [DEBUG] [LOCAL     ] JHS: No primary data file found to delete.
[2025-10-24T19:28:24.365198] [INFO ] [LOCAL     ] JHS: Starting deletion of derivative data.
[2025-10-24T19:28:24.365331] [DEBUG] [LOCAL     ] JHS: Deleted derivative data file.
[2025-10-24T19:28:24.365421] [INFO ] [MAIN      ] Update Progress: 1154/2366 symbols completed. JHS took 35.5s. Estimated remaining: 2h 35m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:28:24.540596] [INFO ] [MAIN      ] JKS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:28:24.589435] [DEBUG] [LOCAL     ] JKS: Loaded 39480 existing records from primary storage.
[2025-10-24T19:28:24.589771] [INFO ] [MAIN      ] JKS: Loaded 39480 existing records.
[2025-10-24T19:28:24.764590] [WARN ] [MAIN      ] JKS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:28:24.764822] [INFO ] [MAIN      ] JKS: Wiping existing primary data before full refresh.
[2025-10-24T19:28:24.764870] [INFO ] [LOCAL     ] JKS: Starting deletion of primary data.
[2025-10-24T19:28:24.765217] [DEBUG] [LOCAL     ] JKS: Deleted primary data file.
[2025-10-24T19:28:24.765277] [INFO ] [MAIN      ] JKS: Starting full primary refresh.
[2025-10-24T19:28:24.952717] [INFO ] [REMOTE    ] JHX: Fetching primary data for 2025-06.
[2025-10-24T19:28:25.119582] [INFO ] [REMOTE    ] JKS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:28:25.336572] [INFO ] [REMOTE    ] JILL: Incremental fetch complete for 2025-04 (1.18 seconds).
[2025-10-24T19:28:25.747628] [INFO ] [REMOTE    ] JKS: Fetching primary data for 2025-01.
[2025-10-24T19:28:26.547678] [INFO ] [REMOTE    ] JILL: Fetching primary data for 2025-05.
[2025-10-24T19:28:26.658473] [INFO ] [REMOTE    ] JHX: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T19:28:27.294747] [INFO ] [REMOTE    ] JKS: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T19:28:27.347602] [INFO ] [REMOTE    ] JKS: Fetching primary data for 2025-02.
[2025-10-24T19:28:27.410960] [INFO ] [REMOTE    ] JILL: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T19:28:28.147716] [INFO ] [REMOTE    ] JILL: Fetching primary data for 2025-06.
[2025-10-24T19:28:28.904090] [INFO ] [REMOTE    ] JKS: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T19:28:28.947670] [INFO ] [REMOTE    ] JHI: Fetching primary data for 2025-10.
[2025-10-24T19:28:29.224306] [INFO ] [REMOTE    ] JILL: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T19:28:29.747674] [INFO ] [REMOTE    ] JHX: Fetching primary data for 2025-07.
[2025-10-24T19:28:29.776214] [INFO ] [REMOTE    ] JHI: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T19:28:29.778242] [INFO ] [REMOTE    ] JHI: Full fetch complete (5819 records).
[2025-10-24T19:28:29.778321] [DEBUG] [VALIDATOR ] JHI: Validating primary data.
[2025-10-24T19:28:30.143217] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present.
[2025-10-24T19:28:30.143293] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed.
[2025-10-24T19:28:30.143470] [INFO ] [MAIN      ] JHI: Fetched primary data is valid.
[2025-10-24T19:28:30.143527] [DEBUG] [LOCAL     ] JHI: Saving primary data.
[2025-10-24T19:28:30.143806] [FATAL] [LOCAL     ] JHI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:28:30.143870] [FATAL] [MAIN      ] JHI: Failed to save primary data.
[2025-10-24T19:28:30.143905] [WARN ] [MAIN      ] JHI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:28:30.143939] [INFO ] [LOCAL     ] JHI: Starting deletion of primary data.
[2025-10-24T19:28:30.144013] [DEBUG] [LOCAL     ] JHI: No primary data file found to delete.
[2025-10-24T19:28:30.144069] [INFO ] [LOCAL     ] JHI: Starting deletion of derivative data.
[2025-10-24T19:28:30.144213] [DEBUG] [LOCAL     ] JHI: Deleted derivative data file.
[2025-10-24T19:28:30.144288] [INFO ] [MAIN      ] Update Progress: 1155/2366 symbols completed. JHI took 42.4s. Estimated remaining: 2h 35m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:28:30.315793] [INFO ] [MAIN      ] JLL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:28:30.347640] [DEBUG] [LOCAL     ] JLL: Loaded 31765 existing records from primary storage.
[2025-10-24T19:28:30.347952] [INFO ] [MAIN      ] JLL: Loaded 31765 existing records.
[2025-10-24T19:28:30.521024] [WARN ] [MAIN      ] JLL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:28:30.521272] [INFO ] [MAIN      ] JLL: Wiping existing primary data before full refresh.
[2025-10-24T19:28:30.521325] [INFO ] [LOCAL     ] JLL: Starting deletion of primary data.
[2025-10-24T19:28:30.521731] [DEBUG] [LOCAL     ] JLL: Deleted primary data file.
[2025-10-24T19:28:30.521787] [INFO ] [MAIN      ] JLL: Starting full primary refresh.
[2025-10-24T19:28:30.552711] [INFO ] [REMOTE    ] JKS: Fetching primary data for 2025-03.
[2025-10-24T19:28:30.873914] [INFO ] [REMOTE    ] JLL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:28:31.319278] [INFO ] [REMOTE    ] JHX: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T19:28:31.347610] [INFO ] [REMOTE    ] JHX: Fetching primary data for 2025-08.
[2025-10-24T19:28:32.147715] [INFO ] [REMOTE    ] JLL: Fetching primary data for 2025-01.
[2025-10-24T19:28:32.276309] [INFO ] [REMOTE    ] JKS: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T19:28:32.947699] [INFO ] [REMOTE    ] JILL: Fetching primary data for 2025-07.
[2025-10-24T19:28:33.195035] [INFO ] [REMOTE    ] JHX: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T19:28:33.316161] [INFO ] [REMOTE    ] JLL: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T19:28:33.622079] [INFO ] [REMOTE    ] JILL: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T19:28:33.747670] [INFO ] [REMOTE    ] JKS: Fetching primary data for 2025-04.
[2025-10-24T19:28:34.547639] [INFO ] [REMOTE    ] JLL: Fetching primary data for 2025-02.
[2025-10-24T19:28:35.170738] [INFO ] [REMOTE    ] JKS: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T19:28:35.347675] [INFO ] [REMOTE    ] JHX: Fetching primary data for 2025-09.
[2025-10-24T19:28:35.992449] [INFO ] [REMOTE    ] JLL: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T19:28:36.147690] [INFO ] [REMOTE    ] JLL: Fetching primary data for 2025-03.
[2025-10-24T19:28:36.947626] [INFO ] [REMOTE    ] JKS: Fetching primary data for 2025-05.
[2025-10-24T19:28:37.059064] [INFO ] [REMOTE    ] JHX: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T19:28:37.091997] [INFO ] [REMOTE    ] JLL: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T19:28:37.747681] [INFO ] [REMOTE    ] JILL: Fetching primary data for 2025-08.
[2025-10-24T19:28:38.248807] [INFO ] [REMOTE    ] JKS: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T19:28:38.453277] [INFO ] [REMOTE    ] JILL: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T19:28:38.547718] [INFO ] [REMOTE    ] JILL: Fetching primary data for 2025-09.
[2025-10-24T19:28:39.347700] [INFO ] [REMOTE    ] JHX: Fetching primary data for 2025-10.
[2025-10-24T19:28:39.484732] [INFO ] [REMOTE    ] JILL: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T19:28:40.147682] [INFO ] [REMOTE    ] JKS: Fetching primary data for 2025-06.
[2025-10-24T19:28:40.947702] [INFO ] [REMOTE    ] JILL: Fetching primary data for 2025-10.
[2025-10-24T19:28:41.275597] [INFO ] [REMOTE    ] JHX: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T19:28:41.285437] [INFO ] [REMOTE    ] JHX: Full fetch complete (63144 records).
[2025-10-24T19:28:41.285580] [DEBUG] [VALIDATOR ] JHX: Validating primary data.
[2025-10-24T19:28:41.685668] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present.
[2025-10-24T19:28:41.686123] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed.
[2025-10-24T19:28:41.693524] [INFO ] [MAIN      ] JHX: Fetched primary data is valid.
[2025-10-24T19:28:41.694206] [DEBUG] [LOCAL     ] JHX: Saving primary data.
[2025-10-24T19:28:41.694507] [INFO ] [REMOTE    ] JILL: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T19:28:41.697530] [INFO ] [REMOTE    ] JILL: Full fetch complete (22351 records).
[2025-10-24T19:28:41.697748] [DEBUG] [VALIDATOR ] JILL: Validating primary data.
[2025-10-24T19:28:41.709384] [FATAL] [LOCAL     ] JHX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:28:41.729631] [FATAL] [MAIN      ] JHX: Failed to save primary data.
[2025-10-24T19:28:41.759967] [INFO ] [REMOTE    ] JLL: Fetching primary data for 2025-04.
[2025-10-24T19:28:41.742025] [WARN ] [MAIN      ] JHX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:28:41.799927] [INFO ] [LOCAL     ] JHX: Starting deletion of primary data.
[2025-10-24T19:28:41.826128] [INFO ] [REMOTE    ] JKS: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T19:28:41.826727] [DEBUG] [LOCAL     ] JHX: No primary data file found to delete.
[2025-10-24T19:28:41.855828] [INFO ] [LOCAL     ] JHX: Starting deletion of derivative data.
[2025-10-24T19:28:41.884043] [DEBUG] [LOCAL     ] JHX: Deleted derivative data file.
[2025-10-24T19:28:41.920231] [INFO ] [MAIN      ] Update Progress: 1156/2366 symbols completed. JHX took 37.1s. Estimated remaining: 2h 35m 36s. Rate: 7.8 symbols/min
[2025-10-24T19:28:42.282906] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present.
[2025-10-24T19:28:42.282832] [INFO ] [MAIN      ] JLS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:28:42.283275] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed.
[2025-10-24T19:28:42.283825] [INFO ] [MAIN      ] JILL: Fetched primary data is valid.
[2025-10-24T19:28:42.283945] [DEBUG] [LOCAL     ] JILL: Saving primary data.
[2025-10-24T19:28:42.285367] [FATAL] [LOCAL     ] JILL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:28:42.285748] [FATAL] [MAIN      ] JILL: Failed to save primary data.
[2025-10-24T19:28:42.285883] [WARN ] [MAIN      ] JILL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:28:42.286016] [INFO ] [LOCAL     ] JILL: Starting deletion of primary data.
[2025-10-24T19:28:42.286129] [DEBUG] [LOCAL     ] JILL: No primary data file found to delete.
[2025-10-24T19:28:42.286199] [INFO ] [LOCAL     ] JILL: Starting deletion of derivative data.
[2025-10-24T19:28:42.286405] [DEBUG] [LOCAL     ] JILL: Deleted derivative data file.
[2025-10-24T19:28:42.287689] [INFO ] [MAIN      ] Update Progress: 1157/2366 symbols completed. JILL took 29.5s. Estimated remaining: 2h 35m 20s. Rate: 7.8 symbols/min
[2025-10-24T19:28:42.290827] [DEBUG] [LOCAL     ] JLS: Loaded 4024 existing records from primary storage.
[2025-10-24T19:28:42.290987] [INFO ] [MAIN      ] JLS: Loaded 4024 existing records.
[2025-10-24T19:28:42.466674] [WARN ] [MAIN      ] JLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:28:42.466918] [INFO ] [MAIN      ] JLS: Wiping existing primary data before full refresh.
[2025-10-24T19:28:42.466973] [INFO ] [LOCAL     ] JLS: Starting deletion of primary data.
[2025-10-24T19:28:42.467104] [DEBUG] [LOCAL     ] JLS: Deleted primary data file.
[2025-10-24T19:28:42.467142] [INFO ] [MAIN      ] JLS: Starting full primary refresh.
[2025-10-24T19:28:42.559419] [INFO ] [REMOTE    ] JKS: Fetching primary data for 2025-07.
[2025-10-24T19:28:42.828333] [INFO ] [REMOTE    ] JLS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:28:43.255513] [INFO ] [REMOTE    ] JLL: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T19:28:43.347672] [INFO ] [REMOTE    ] JLL: Fetching primary data for 2025-05.
[2025-10-24T19:28:44.100926] [INFO ] [REMOTE    ] JKS: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T19:28:44.147622] [INFO ] [REMOTE    ] JKS: Fetching primary data for 2025-08.
[2025-10-24T19:28:44.747107] [INFO ] [REMOTE    ] JLL: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T19:28:44.947733] [INFO ] [REMOTE    ] JLL: Fetching primary data for 2025-06.
[2025-10-24T19:28:45.547439] [INFO ] [REMOTE    ] JKS: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T19:28:45.747721] [INFO ] [REMOTE    ] JLS: Fetching primary data for 2025-01.
[2025-10-24T19:28:46.104461] [INFO ] [REMOTE    ] JLS: Incremental fetch complete for 2025-01 (0.36 seconds).
[2025-10-24T19:28:46.307413] [INFO ] [REMOTE    ] JLL: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T19:28:46.547739] [INFO ] [REMOTE    ] JLL: Fetching primary data for 2025-07.
[2025-10-24T19:28:47.347714] [INFO ] [REMOTE    ] JLS: Fetching primary data for 2025-02.
[2025-10-24T19:28:47.827149] [INFO ] [REMOTE    ] JLS: Incremental fetch complete for 2025-02 (0.48 seconds).
[2025-10-24T19:28:47.936542] [INFO ] [REMOTE    ] JLL: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T19:28:48.147721] [INFO ] [REMOTE    ] JLL: Fetching primary data for 2025-08.
[2025-10-24T19:28:48.947743] [INFO ] [REMOTE    ] JLS: Fetching primary data for 2025-03.
[2025-10-24T19:28:49.484498] [INFO ] [REMOTE    ] JLS: Incremental fetch complete for 2025-03 (0.54 seconds).
[2025-10-24T19:28:49.666824] [INFO ] [REMOTE    ] JLL: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T19:28:49.747628] [INFO ] [REMOTE    ] JLS: Fetching primary data for 2025-04.
[2025-10-24T19:28:50.342746] [INFO ] [REMOTE    ] JLS: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T19:28:50.547730] [INFO ] [REMOTE    ] JLL: Fetching primary data for 2025-09.
[2025-10-24T19:28:51.347745] [INFO ] [REMOTE    ] JLS: Fetching primary data for 2025-05.
[2025-10-24T19:28:51.830983] [INFO ] [REMOTE    ] JLL: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T19:28:52.002198] [INFO ] [REMOTE    ] JLS: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T19:28:52.147709] [INFO ] [REMOTE    ] JLL: Fetching primary data for 2025-10.
[2025-10-24T19:28:52.947625] [INFO ] [REMOTE    ] JKS: Fetching primary data for 2025-09.
[2025-10-24T19:28:53.477991] [INFO ] [REMOTE    ] JLL: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T19:28:53.483094] [INFO ] [REMOTE    ] JLL: Full fetch complete (45177 records).
[2025-10-24T19:28:53.483183] [DEBUG] [VALIDATOR ] JLL: Validating primary data.
[2025-10-24T19:28:53.753002] [INFO ] [REMOTE    ] JLS: Fetching primary data for 2025-06.
[2025-10-24T19:28:53.896084] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present.
[2025-10-24T19:28:53.896183] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed.
[2025-10-24T19:28:53.897115] [INFO ] [MAIN      ] JLL: Fetched primary data is valid.
[2025-10-24T19:28:53.897176] [DEBUG] [LOCAL     ] JLL: Saving primary data.
[2025-10-24T19:28:53.897608] [FATAL] [LOCAL     ] JLL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:28:53.897728] [FATAL] [MAIN      ] JLL: Failed to save primary data.
[2025-10-24T19:28:53.897771] [WARN ] [MAIN      ] JLL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:28:53.897807] [INFO ] [LOCAL     ] JLL: Starting deletion of primary data.
[2025-10-24T19:28:53.897855] [DEBUG] [LOCAL     ] JLL: No primary data file found to delete.
[2025-10-24T19:28:53.897889] [INFO ] [LOCAL     ] JLL: Starting deletion of derivative data.
[2025-10-24T19:28:53.898017] [DEBUG] [LOCAL     ] JLL: Deleted derivative data file.
[2025-10-24T19:28:53.898090] [INFO ] [MAIN      ] Update Progress: 1158/2366 symbols completed. JLL took 23.8s. Estimated remaining: 2h 35m 17s. Rate: 7.8 symbols/min
[2025-10-24T19:28:54.281951] [INFO ] [REMOTE    ] JLS: Incremental fetch complete for 2025-06 (0.53 seconds).
[2025-10-24T19:28:54.464448] [INFO ] [REMOTE    ] JKS: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T19:28:54.547620] [INFO ] [REMOTE    ] JKS: Fetching primary data for 2025-10.
[2025-10-24T19:28:55.347740] [INFO ] [REMOTE    ] JLS: Fetching primary data for 2025-07.
[2025-10-24T19:28:55.877452] [INFO ] [REMOTE    ] JLS: Incremental fetch complete for 2025-07 (0.53 seconds).
[2025-10-24T19:28:56.147671] [INFO ] [REMOTE    ] JLS: Fetching primary data for 2025-08.
[2025-10-24T19:28:56.228289] [INFO ] [REMOTE    ] JKS: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T19:28:56.235845] [INFO ] [REMOTE    ] JKS: Full fetch complete (58539 records).
[2025-10-24T19:28:56.235948] [DEBUG] [VALIDATOR ] JKS: Validating primary data.
[2025-10-24T19:28:56.616418] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present.
[2025-10-24T19:28:56.616524] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed.
[2025-10-24T19:28:56.617479] [INFO ] [MAIN      ] JKS: Fetched primary data is valid.
[2025-10-24T19:28:56.617541] [DEBUG] [LOCAL     ] JKS: Saving primary data.
[2025-10-24T19:28:56.618065] [FATAL] [LOCAL     ] JKS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:28:56.618179] [FATAL] [MAIN      ] JKS: Failed to save primary data.
[2025-10-24T19:28:56.618243] [WARN ] [MAIN      ] JKS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:28:56.618283] [INFO ] [LOCAL     ] JKS: Starting deletion of primary data.
[2025-10-24T19:28:56.618333] [DEBUG] [LOCAL     ] JKS: No primary data file found to delete.
[2025-10-24T19:28:56.618368] [INFO ] [LOCAL     ] JKS: Starting deletion of derivative data.
[2025-10-24T19:28:56.618533] [DEBUG] [LOCAL     ] JKS: Deleted derivative data file.
[2025-10-24T19:28:56.618918] [INFO ] [MAIN      ] Update Progress: 1159/2366 symbols completed. JKS took 32.3s. Estimated remaining: 2h 35m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:28:56.686721] [INFO ] [REMOTE    ] JLS: Incremental fetch complete for 2025-08 (0.54 seconds).
[2025-10-24T19:28:56.947711] [INFO ] [REMOTE    ] JLS: Fetching primary data for 2025-09.
[2025-10-24T19:28:57.529272] [INFO ] [REMOTE    ] JLS: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T19:28:57.747691] [INFO ] [REMOTE    ] JLS: Fetching primary data for 2025-10.
[2025-10-24T19:28:58.249885] [INFO ] [REMOTE    ] JLS: Incremental fetch complete for 2025-10 (0.50 seconds).
[2025-10-24T19:28:58.251120] [INFO ] [REMOTE    ] JLS: Full fetch complete (5814 records).
[2025-10-24T19:28:58.251188] [DEBUG] [VALIDATOR ] JLS: Validating primary data.
[2025-10-24T19:28:58.611055] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present.
[2025-10-24T19:28:58.611142] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed.
[2025-10-24T19:28:58.611312] [INFO ] [MAIN      ] JLS: Fetched primary data is valid.
[2025-10-24T19:28:58.611353] [DEBUG] [LOCAL     ] JLS: Saving primary data.
[2025-10-24T19:28:58.611536] [FATAL] [LOCAL     ] JLS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:28:58.611615] [FATAL] [MAIN      ] JLS: Failed to save primary data.
[2025-10-24T19:28:58.611710] [WARN ] [MAIN      ] JLS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:28:58.611762] [INFO ] [LOCAL     ] JLS: Starting deletion of primary data.
[2025-10-24T19:28:58.611815] [DEBUG] [LOCAL     ] JLS: No primary data file found to delete.
[2025-10-24T19:28:58.611865] [INFO ] [LOCAL     ] JLS: Starting deletion of derivative data.
[2025-10-24T19:28:58.612017] [DEBUG] [LOCAL     ] JLS: Deleted derivative data file.
[2025-10-24T19:28:58.612102] [INFO ] [MAIN      ] Update Progress: 1160/2366 symbols completed. JLS took 16.6s. Estimated remaining: 2h 34m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:28:59.281458] [INFO ] [MAIN      ] JNJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:28:59.285112] [INFO ] [MAIN      ] JMM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:28:59.314933] [DEBUG] [LOCAL     ] JMM: No existing data file found in primary storage.
[2025-10-24T19:28:59.317088] [INFO ] [MAIN      ] JMIA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:28:59.339116] [INFO ] [MAIN      ] JOBY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:28:59.317245] [WARN ] [MAIN      ] JMM: No existing data found, performing full refresh instead.
[2025-10-24T19:28:59.340024] [INFO ] [MAIN      ] JMM: Wiping existing primary data before full refresh.
[2025-10-24T19:28:59.340193] [INFO ] [LOCAL     ] JMM: Starting deletion of primary data.
[2025-10-24T19:28:59.340273] [DEBUG] [LOCAL     ] JMM: No primary data file found to delete.
[2025-10-24T19:28:59.340395] [INFO ] [MAIN      ] JMM: Starting full primary refresh.
[2025-10-24T19:28:59.750084] [DEBUG] [LOCAL     ] JMIA: Loaded 51570 existing records from primary storage.
[2025-10-24T19:28:59.763540] [DEBUG] [LOCAL     ] JOBY: Loaded 54199 existing records from primary storage.
[2025-10-24T19:28:59.764002] [INFO ] [MAIN      ] JMIA: Loaded 51570 existing records.
[2025-10-24T19:28:59.765233] [DEBUG] [LOCAL     ] JNJ: Loaded 54143 existing records from primary storage.
[2025-10-24T19:28:59.775731] [INFO ] [MAIN      ] JOBY: Loaded 54199 existing records.
[2025-10-24T19:28:59.836765] [INFO ] [MAIN      ] JNJ: Loaded 54143 existing records.
[2025-10-24T19:29:00.108061] [INFO ] [REMOTE    ] JMM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:29:00.126850] [INFO ] [REMOTE    ] JMM: Fetching primary data for 2025-01.
[2025-10-24T19:29:00.331253] [WARN ] [MAIN      ] JOBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:29:00.401731] [INFO ] [MAIN      ] JOBY: Wiping existing primary data before full refresh.
[2025-10-24T19:29:00.382542] [WARN ] [MAIN      ] JNJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:29:00.441008] [WARN ] [MAIN      ] JMIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:29:00.441397] [INFO ] [MAIN      ] JMIA: Wiping existing primary data before full refresh.
[2025-10-24T19:29:00.441176] [INFO ] [MAIN      ] JNJ: Wiping existing primary data before full refresh.
[2025-10-24T19:29:00.441632] [INFO ] [LOCAL     ] JNJ: Starting deletion of primary data.
[2025-10-24T19:29:00.441491] [INFO ] [LOCAL     ] JOBY: Starting deletion of primary data.
[2025-10-24T19:29:00.441549] [INFO ] [LOCAL     ] JMIA: Starting deletion of primary data.
[2025-10-24T19:29:00.442811] [DEBUG] [LOCAL     ] JOBY: Deleted primary data file.
[2025-10-24T19:29:00.442775] [DEBUG] [LOCAL     ] JMIA: Deleted primary data file.
[2025-10-24T19:29:00.443042] [INFO ] [MAIN      ] JOBY: Starting full primary refresh.
[2025-10-24T19:29:00.442998] [INFO ] [MAIN      ] JMIA: Starting full primary refresh.
[2025-10-24T19:29:00.443087] [DEBUG] [LOCAL     ] JNJ: Deleted primary data file.
[2025-10-24T19:29:00.464491] [INFO ] [MAIN      ] JNJ: Starting full primary refresh.
[2025-10-24T19:29:00.631916] [INFO ] [REMOTE    ] JMM: Incremental fetch complete for 2025-01 (0.51 seconds).
[2025-10-24T19:29:00.734810] [INFO ] [REMOTE    ] JMM: Fetching primary data for 2025-02.
[2025-10-24T19:29:01.270090] [INFO ] [REMOTE    ] JMM: Incremental fetch complete for 2025-02 (0.54 seconds).
[2025-10-24T19:29:01.282486] [INFO ] [REMOTE    ] JMM: Fetching primary data for 2025-03.
[2025-10-24T19:29:01.443526] [INFO ] [REMOTE    ] JOBY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:29:01.452173] [INFO ] [REMOTE    ] JOBY: Fetching primary data for 2025-01.
[2025-10-24T19:29:01.573692] [INFO ] [REMOTE    ] JMIA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:29:01.596016] [INFO ] [REMOTE    ] JNJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:29:01.747713] [INFO ] [REMOTE    ] JMIA: Fetching primary data for 2025-01.
[2025-10-24T19:29:01.860800] [INFO ] [REMOTE    ] JMM: Incremental fetch complete for 2025-03 (0.58 seconds).
[2025-10-24T19:29:02.547675] [INFO ] [REMOTE    ] JMM: Fetching primary data for 2025-04.
[2025-10-24T19:29:03.059116] [INFO ] [REMOTE    ] JMM: Incremental fetch complete for 2025-04 (0.51 seconds).
[2025-10-24T19:29:03.347689] [INFO ] [REMOTE    ] JMM: Fetching primary data for 2025-05.
[2025-10-24T19:29:03.433218] [INFO ] [REMOTE    ] JMIA: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T19:29:03.648000] [INFO ] [REMOTE    ] JOBY: Incremental fetch complete for 2025-01 (2.20 seconds).
[2025-10-24T19:29:03.829852] [INFO ] [REMOTE    ] JMM: Incremental fetch complete for 2025-05 (0.48 seconds).
[2025-10-24T19:29:04.147610] [INFO ] [REMOTE    ] JMIA: Fetching primary data for 2025-02.
[2025-10-24T19:29:04.947673] [INFO ] [REMOTE    ] JOBY: Fetching primary data for 2025-02.
[2025-10-24T19:29:05.747687] [INFO ] [REMOTE    ] JNJ: Fetching primary data for 2025-01.
[2025-10-24T19:29:05.878152] [INFO ] [REMOTE    ] JMIA: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T19:29:06.547605] [INFO ] [REMOTE    ] JMM: Fetching primary data for 2025-06.
[2025-10-24T19:29:07.010637] [INFO ] [REMOTE    ] JMM: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T19:29:07.045846] [INFO ] [REMOTE    ] JOBY: Incremental fetch complete for 2025-02 (2.10 seconds).
[2025-10-24T19:29:07.347627] [INFO ] [REMOTE    ] JMIA: Fetching primary data for 2025-03.
[2025-10-24T19:29:07.739822] [INFO ] [REMOTE    ] JNJ: Incremental fetch complete for 2025-01 (1.99 seconds).
[2025-10-24T19:29:08.147664] [INFO ] [REMOTE    ] JMM: Fetching primary data for 2025-07.
[2025-10-24T19:29:08.699215] [INFO ] [REMOTE    ] JMM: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T19:29:08.947627] [INFO ] [REMOTE    ] JMM: Fetching primary data for 2025-08.
[2025-10-24T19:29:09.017575] [INFO ] [REMOTE    ] JMIA: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T19:29:09.261899] [INFO ] [REMOTE    ] JMM: Incremental fetch complete for 2025-08 (0.31 seconds).
[2025-10-24T19:29:09.747636] [INFO ] [REMOTE    ] JNJ: Fetching primary data for 2025-02.
[2025-10-24T19:29:10.547710] [INFO ] [REMOTE    ] JOBY: Fetching primary data for 2025-03.
[2025-10-24T19:29:11.347736] [INFO ] [REMOTE    ] JMM: Fetching primary data for 2025-09.
[2025-10-24T19:29:11.663339] [INFO ] [REMOTE    ] JNJ: Incremental fetch complete for 2025-02 (1.92 seconds).
[2025-10-24T19:29:11.801175] [INFO ] [REMOTE    ] JMM: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T19:29:12.147693] [INFO ] [REMOTE    ] JNJ: Fetching primary data for 2025-03.
[2025-10-24T19:29:12.657624] [INFO ] [REMOTE    ] JOBY: Incremental fetch complete for 2025-03 (2.11 seconds).
[2025-10-24T19:29:12.947683] [INFO ] [REMOTE    ] JOBY: Fetching primary data for 2025-04.
[2025-10-24T19:29:13.747723] [INFO ] [REMOTE    ] JMM: Fetching primary data for 2025-10.
[2025-10-24T19:29:14.102399] [INFO ] [REMOTE    ] JMM: Incremental fetch complete for 2025-10 (0.35 seconds).
[2025-10-24T19:29:14.103392] [INFO ] [REMOTE    ] JMM: Full fetch complete (2308 records).
[2025-10-24T19:29:14.103748] [DEBUG] [VALIDATOR ] JMM: Validating primary data.
[2025-10-24T19:29:14.105015] [INFO ] [REMOTE    ] JNJ: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T19:29:14.323297] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days
[2025-10-24T19:29:14.323487] [FATAL] [MAIN      ] JMM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:29:14.323553] [WARN ] [MAIN      ] JMM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:29:14.323622] [INFO ] [LOCAL     ] JMM: Starting deletion of primary data.
[2025-10-24T19:29:14.323718] [DEBUG] [LOCAL     ] JMM: No primary data file found to delete.
[2025-10-24T19:29:14.323763] [INFO ] [LOCAL     ] JMM: Starting deletion of derivative data.
[2025-10-24T19:29:14.323804] [DEBUG] [LOCAL     ] JMM: No derivative data file found to delete.
[2025-10-24T19:29:14.323857] [INFO ] [MAIN      ] Update Progress: 1161/2366 symbols completed. JMM took 15.7s. Estimated remaining: 2h 34m 51s. Rate: 7.8 symbols/min
[2025-10-24T19:29:14.491372] [INFO ] [MAIN      ] JOE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:29:14.515962] [DEBUG] [LOCAL     ] JOE: Loaded 23818 existing records from primary storage.
[2025-10-24T19:29:14.516211] [INFO ] [MAIN      ] JOE: Loaded 23818 existing records.
[2025-10-24T19:29:14.552830] [INFO ] [REMOTE    ] JNJ: Fetching primary data for 2025-04.
[2025-10-24T19:29:14.696488] [WARN ] [MAIN      ] JOE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:29:14.696855] [INFO ] [MAIN      ] JOE: Wiping existing primary data before full refresh.
[2025-10-24T19:29:14.696910] [INFO ] [LOCAL     ] JOE: Starting deletion of primary data.
[2025-10-24T19:29:14.697184] [DEBUG] [LOCAL     ] JOE: Deleted primary data file.
[2025-10-24T19:29:14.697269] [INFO ] [MAIN      ] JOE: Starting full primary refresh.
[2025-10-24T19:29:15.049994] [INFO ] [REMOTE    ] JOE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:29:15.347707] [INFO ] [REMOTE    ] JMIA: Fetching primary data for 2025-04.
[2025-10-24T19:29:15.407920] [INFO ] [REMOTE    ] JOBY: Incremental fetch complete for 2025-04 (2.46 seconds).
[2025-10-24T19:29:16.147719] [INFO ] [REMOTE    ] JOE: Fetching primary data for 2025-01.
[2025-10-24T19:29:16.947707] [INFO ] [REMOTE    ] JOBY: Fetching primary data for 2025-05.
[2025-10-24T19:29:16.993324] [INFO ] [REMOTE    ] JNJ: Incremental fetch complete for 2025-04 (2.44 seconds).
[2025-10-24T19:29:17.232945] [INFO ] [REMOTE    ] JMIA: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T19:29:17.308794] [INFO ] [REMOTE    ] JOE: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T19:29:17.747670] [INFO ] [REMOTE    ] JOE: Fetching primary data for 2025-02.
[2025-10-24T19:29:18.547712] [INFO ] [REMOTE    ] JMIA: Fetching primary data for 2025-05.
[2025-10-24T19:29:18.651886] [INFO ] [REMOTE    ] JOE: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T19:29:19.347615] [INFO ] [REMOTE    ] JOE: Fetching primary data for 2025-03.
[2025-10-24T19:29:19.500871] [INFO ] [REMOTE    ] JOBY: Incremental fetch complete for 2025-05 (2.55 seconds).
[2025-10-24T19:29:20.147737] [INFO ] [REMOTE    ] JNJ: Fetching primary data for 2025-05.
[2025-10-24T19:29:20.351049] [INFO ] [REMOTE    ] JMIA: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T19:29:20.661873] [INFO ] [REMOTE    ] JOE: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T19:29:20.947639] [INFO ] [REMOTE    ] JMIA: Fetching primary data for 2025-06.
[2025-10-24T19:29:21.747634] [INFO ] [REMOTE    ] JOBY: Fetching primary data for 2025-06.
[2025-10-24T19:29:22.233537] [INFO ] [REMOTE    ] JNJ: Incremental fetch complete for 2025-05 (2.09 seconds).
[2025-10-24T19:29:22.313028] [INFO ] [REMOTE    ] JMIA: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T19:29:22.547671] [INFO ] [REMOTE    ] JOE: Fetching primary data for 2025-04.
[2025-10-24T19:29:23.347742] [INFO ] [REMOTE    ] JMIA: Fetching primary data for 2025-07.
[2025-10-24T19:29:23.762936] [INFO ] [REMOTE    ] JOE: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T19:29:24.146568] [INFO ] [REMOTE    ] JOBY: Incremental fetch complete for 2025-06 (2.40 seconds).
[2025-10-24T19:29:24.156342] [INFO ] [REMOTE    ] JNJ: Fetching primary data for 2025-06.
[2025-10-24T19:29:24.893709] [INFO ] [REMOTE    ] JMIA: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T19:29:24.947622] [INFO ] [REMOTE    ] JMIA: Fetching primary data for 2025-08.
[2025-10-24T19:29:25.747736] [INFO ] [REMOTE    ] JOE: Fetching primary data for 2025-05.
[2025-10-24T19:29:26.215544] [INFO ] [REMOTE    ] JNJ: Incremental fetch complete for 2025-06 (2.06 seconds).
[2025-10-24T19:29:26.547715] [INFO ] [REMOTE    ] JOBY: Fetching primary data for 2025-07.
[2025-10-24T19:29:26.873120] [INFO ] [REMOTE    ] JMIA: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T19:29:26.970090] [INFO ] [REMOTE    ] JOE: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T19:29:27.347685] [INFO ] [REMOTE    ] JMIA: Fetching primary data for 2025-09.
[2025-10-24T19:29:28.147731] [INFO ] [REMOTE    ] JOE: Fetching primary data for 2025-06.
[2025-10-24T19:29:28.947950] [INFO ] [REMOTE    ] JNJ: Fetching primary data for 2025-07.
[2025-10-24T19:29:29.013314] [INFO ] [REMOTE    ] JOBY: Incremental fetch complete for 2025-07 (2.47 seconds).
[2025-10-24T19:29:29.231388] [INFO ] [REMOTE    ] JOE: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T19:29:29.409764] [INFO ] [REMOTE    ] JMIA: Incremental fetch complete for 2025-09 (2.06 seconds).
[2025-10-24T19:29:29.747685] [INFO ] [REMOTE    ] JMIA: Fetching primary data for 2025-10.
[2025-10-24T19:29:30.547694] [INFO ] [REMOTE    ] JOBY: Fetching primary data for 2025-08.
[2025-10-24T19:29:30.945723] [INFO ] [REMOTE    ] JNJ: Incremental fetch complete for 2025-07 (2.00 seconds).
[2025-10-24T19:29:31.347713] [INFO ] [REMOTE    ] JNJ: Fetching primary data for 2025-08.
[2025-10-24T19:29:31.528557] [INFO ] [REMOTE    ] JMIA: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T19:29:31.538237] [INFO ] [REMOTE    ] JMIA: Full fetch complete (73513 records).
[2025-10-24T19:29:31.538369] [DEBUG] [VALIDATOR ] JMIA: Validating primary data.
[2025-10-24T19:29:31.931559] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present.
[2025-10-24T19:29:31.931681] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed.
[2025-10-24T19:29:31.932748] [INFO ] [MAIN      ] JMIA: Fetched primary data is valid.
[2025-10-24T19:29:31.932809] [DEBUG] [LOCAL     ] JMIA: Saving primary data.
[2025-10-24T19:29:31.933449] [FATAL] [LOCAL     ] JMIA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:29:31.933536] [FATAL] [MAIN      ] JMIA: Failed to save primary data.
[2025-10-24T19:29:31.933579] [WARN ] [MAIN      ] JMIA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:29:31.933663] [INFO ] [LOCAL     ] JMIA: Starting deletion of primary data.
[2025-10-24T19:29:31.933741] [DEBUG] [LOCAL     ] JMIA: No primary data file found to delete.
[2025-10-24T19:29:31.933778] [INFO ] [LOCAL     ] JMIA: Starting deletion of derivative data.
[2025-10-24T19:29:31.933907] [DEBUG] [LOCAL     ] JMIA: Deleted derivative data file.
[2025-10-24T19:29:31.934253] [INFO ] [MAIN      ] Update Progress: 1162/2366 symbols completed. JMIA took 33.3s. Estimated remaining: 2h 34m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:29:32.104119] [INFO ] [MAIN      ] JOF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:29:32.115001] [DEBUG] [LOCAL     ] JOF: Loaded 6978 existing records from primary storage.
[2025-10-24T19:29:32.115220] [INFO ] [MAIN      ] JOF: Loaded 6978 existing records.
[2025-10-24T19:29:32.157590] [INFO ] [REMOTE    ] JOE: Fetching primary data for 2025-07.
[2025-10-24T19:29:32.297035] [WARN ] [MAIN      ] JOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:29:32.297276] [INFO ] [MAIN      ] JOF: Wiping existing primary data before full refresh.
[2025-10-24T19:29:32.297328] [INFO ] [LOCAL     ] JOF: Starting deletion of primary data.
[2025-10-24T19:29:32.297506] [DEBUG] [LOCAL     ] JOF: Deleted primary data file.
[2025-10-24T19:29:32.297544] [INFO ] [MAIN      ] JOF: Starting full primary refresh.
[2025-10-24T19:29:32.653504] [INFO ] [REMOTE    ] JOF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:29:32.689194] [INFO ] [REMOTE    ] JOBY: Incremental fetch complete for 2025-08 (2.14 seconds).
[2025-10-24T19:29:32.947682] [INFO ] [REMOTE    ] JOBY: Fetching primary data for 2025-09.
[2025-10-24T19:29:33.383784] [INFO ] [REMOTE    ] JOE: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T19:29:33.608753] [INFO ] [REMOTE    ] JNJ: Incremental fetch complete for 2025-08 (2.26 seconds).
[2025-10-24T19:29:33.747676] [INFO ] [REMOTE    ] JNJ: Fetching primary data for 2025-09.
[2025-10-24T19:29:34.547671] [INFO ] [REMOTE    ] JOF: Fetching primary data for 2025-01.
[2025-10-24T19:29:35.064957] [INFO ] [REMOTE    ] JOF: Incremental fetch complete for 2025-01 (0.52 seconds).
[2025-10-24T19:29:35.347709] [INFO ] [REMOTE    ] JOE: Fetching primary data for 2025-08.
[2025-10-24T19:29:35.550633] [INFO ] [REMOTE    ] JOBY: Incremental fetch complete for 2025-09 (2.60 seconds).
[2025-10-24T19:29:35.721564] [INFO ] [REMOTE    ] JNJ: Incremental fetch complete for 2025-09 (1.97 seconds).
[2025-10-24T19:29:36.076060] [INFO ] [REMOTE    ] JOE: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T19:29:36.147629] [INFO ] [REMOTE    ] JOE: Fetching primary data for 2025-09.
[2025-10-24T19:29:36.947622] [INFO ] [REMOTE    ] JOBY: Fetching primary data for 2025-10.
[2025-10-24T19:29:37.189094] [INFO ] [REMOTE    ] JOE: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T19:29:37.747730] [INFO ] [REMOTE    ] JOF: Fetching primary data for 2025-02.
[2025-10-24T19:29:38.345824] [INFO ] [REMOTE    ] JOF: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T19:29:38.547695] [INFO ] [REMOTE    ] JOE: Fetching primary data for 2025-10.
[2025-10-24T19:29:39.347613] [INFO ] [REMOTE    ] JNJ: Fetching primary data for 2025-10.
[2025-10-24T19:29:39.671033] [INFO ] [REMOTE    ] JOBY: Incremental fetch complete for 2025-10 (2.72 seconds).
[2025-10-24T19:29:39.680763] [INFO ] [REMOTE    ] JOBY: Full fetch complete (77974 records).
[2025-10-24T19:29:39.680903] [DEBUG] [VALIDATOR ] JOBY: Validating primary data.
[2025-10-24T19:29:39.805681] [INFO ] [REMOTE    ] JOE: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T19:29:39.838089] [INFO ] [REMOTE    ] JOE: Full fetch complete (35406 records).
[2025-10-24T19:29:39.854638] [DEBUG] [VALIDATOR ] JOE: Validating primary data.
[2025-10-24T19:29:40.149460] [INFO ] [REMOTE    ] JOF: Fetching primary data for 2025-03.
[2025-10-24T19:29:40.311326] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present.
[2025-10-24T19:29:40.358065] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed.
[2025-10-24T19:29:40.387591] [INFO ] [MAIN      ] JOBY: Fetched primary data is valid.
[2025-10-24T19:29:40.401285] [DEBUG] [LOCAL     ] JOBY: Saving primary data.
[2025-10-24T19:29:40.419590] [FATAL] [LOCAL     ] JOBY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:29:40.431919] [FATAL] [MAIN      ] JOBY: Failed to save primary data.
[2025-10-24T19:29:40.437405] [WARN ] [MAIN      ] JOBY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:29:40.452856] [INFO ] [LOCAL     ] JOBY: Starting deletion of primary data.
[2025-10-24T19:29:40.463260] [DEBUG] [LOCAL     ] JOBY: No primary data file found to delete.
[2025-10-24T19:29:40.491342] [INFO ] [LOCAL     ] JOBY: Starting deletion of derivative data.
[2025-10-24T19:29:40.520067] [DEBUG] [LOCAL     ] JOBY: Deleted derivative data file.
[2025-10-24T19:29:40.529528] [INFO ] [MAIN      ] Update Progress: 1163/2366 symbols completed. JOBY took 41.9s. Estimated remaining: 2h 34m 46s. Rate: 7.8 symbols/min
[2025-10-24T19:29:40.561804] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present.
[2025-10-24T19:29:40.612420] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed.
[2025-10-24T19:29:40.623948] [INFO ] [MAIN      ] JOE: Fetched primary data is valid.
[2025-10-24T19:29:40.632363] [DEBUG] [LOCAL     ] JOE: Saving primary data.
[2025-10-24T19:29:40.635389] [FATAL] [LOCAL     ] JOE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:29:40.640939] [FATAL] [MAIN      ] JOE: Failed to save primary data.
[2025-10-24T19:29:40.651252] [WARN ] [MAIN      ] JOE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:29:40.651343] [INFO ] [LOCAL     ] JOE: Starting deletion of primary data.
[2025-10-24T19:29:40.661630] [DEBUG] [LOCAL     ] JOE: No primary data file found to delete.
[2025-10-24T19:29:40.680873] [INFO ] [LOCAL     ] JOE: Starting deletion of derivative data.
[2025-10-24T19:29:40.707767] [INFO ] [MAIN      ] JPC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:29:40.706257] [DEBUG] [LOCAL     ] JOE: Deleted derivative data file.
[2025-10-24T19:29:40.707979] [INFO ] [MAIN      ] Update Progress: 1164/2366 symbols completed. JOE took 26.4s. Estimated remaining: 2h 34m 31s. Rate: 7.8 symbols/min
[2025-10-24T19:29:40.708104] [DEBUG] [LOCAL     ] JPC: No existing data file found in primary storage.
[2025-10-24T19:29:40.713542] [WARN ] [MAIN      ] JPC: No existing data found, performing full refresh instead.
[2025-10-24T19:29:40.765791] [INFO ] [MAIN      ] JPC: Wiping existing primary data before full refresh.
[2025-10-24T19:29:40.765964] [INFO ] [LOCAL     ] JPC: Starting deletion of primary data.
[2025-10-24T19:29:40.780495] [DEBUG] [LOCAL     ] JPC: No primary data file found to delete.
[2025-10-24T19:29:40.786403] [INFO ] [MAIN      ] JPC: Starting full primary refresh.
[2025-10-24T19:29:40.998228] [INFO ] [MAIN      ] JPM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:29:41.073140] [INFO ] [REMOTE    ] JOF: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T19:29:41.076360] [INFO ] [REMOTE    ] JOF: Fetching primary data for 2025-04.
[2025-10-24T19:29:41.263315] [INFO ] [REMOTE    ] JPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:29:41.300412] [DEBUG] [LOCAL     ] JPM: Loaded 54184 existing records from primary storage.
[2025-10-24T19:29:41.300759] [INFO ] [MAIN      ] JPM: Loaded 54184 existing records.
[2025-10-24T19:29:41.486307] [WARN ] [MAIN      ] JPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:29:41.486666] [INFO ] [MAIN      ] JPM: Wiping existing primary data before full refresh.
[2025-10-24T19:29:41.486729] [INFO ] [LOCAL     ] JPM: Starting deletion of primary data.
[2025-10-24T19:29:41.487145] [DEBUG] [LOCAL     ] JPM: Deleted primary data file.
[2025-10-24T19:29:41.487186] [INFO ] [MAIN      ] JPM: Starting full primary refresh.
[2025-10-24T19:29:41.752032] [INFO ] [REMOTE    ] JPC: Fetching primary data for 2025-01.
[2025-10-24T19:29:41.893107] [INFO ] [REMOTE    ] JNJ: Incremental fetch complete for 2025-10 (2.55 seconds).
[2025-10-24T19:29:41.896835] [INFO ] [REMOTE    ] JPM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:29:41.913875] [INFO ] [REMOTE    ] JOF: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T19:29:41.913637] [INFO ] [REMOTE    ] JNJ: Full fetch complete (77933 records).
[2025-10-24T19:29:41.915978] [DEBUG] [VALIDATOR ] JNJ: Validating primary data.
[2025-10-24T19:29:42.316103] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present.
[2025-10-24T19:29:42.316179] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed.
[2025-10-24T19:29:42.317289] [INFO ] [MAIN      ] JNJ: Fetched primary data is valid.
[2025-10-24T19:29:42.317353] [DEBUG] [LOCAL     ] JNJ: Saving primary data.
[2025-10-24T19:29:42.317947] [FATAL] [LOCAL     ] JNJ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:29:42.318043] [FATAL] [MAIN      ] JNJ: Failed to save primary data.
[2025-10-24T19:29:42.318086] [WARN ] [MAIN      ] JNJ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:29:42.318123] [INFO ] [LOCAL     ] JNJ: Starting deletion of primary data.
[2025-10-24T19:29:42.318176] [DEBUG] [LOCAL     ] JNJ: No primary data file found to delete.
[2025-10-24T19:29:42.318215] [INFO ] [LOCAL     ] JNJ: Starting deletion of derivative data.
[2025-10-24T19:29:42.318395] [DEBUG] [LOCAL     ] JNJ: Deleted derivative data file.
[2025-10-24T19:29:42.318989] [INFO ] [MAIN      ] Update Progress: 1165/2366 symbols completed. JNJ took 43.7s. Estimated remaining: 2h 34m 17s. Rate: 7.8 symbols/min
[2025-10-24T19:29:42.491598] [INFO ] [MAIN      ] JQC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:29:42.526580] [DEBUG] [LOCAL     ] JQC: Loaded 34130 existing records from primary storage.
[2025-10-24T19:29:42.526868] [INFO ] [MAIN      ] JQC: Loaded 34130 existing records.
[2025-10-24T19:29:42.558282] [INFO ] [REMOTE    ] JOF: Fetching primary data for 2025-05.
[2025-10-24T19:29:42.711508] [WARN ] [MAIN      ] JQC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:29:42.711757] [INFO ] [MAIN      ] JQC: Wiping existing primary data before full refresh.
[2025-10-24T19:29:42.711812] [INFO ] [LOCAL     ] JQC: Starting deletion of primary data.
[2025-10-24T19:29:42.712179] [DEBUG] [LOCAL     ] JQC: Deleted primary data file.
[2025-10-24T19:29:42.712254] [INFO ] [MAIN      ] JQC: Starting full primary refresh.
[2025-10-24T19:29:43.083411] [INFO ] [REMOTE    ] JQC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:29:43.108986] [INFO ] [REMOTE    ] JPC: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T19:29:43.199845] [INFO ] [REMOTE    ] JOF: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T19:29:43.347619] [INFO ] [REMOTE    ] JOF: Fetching primary data for 2025-06.
[2025-10-24T19:29:43.951878] [INFO ] [REMOTE    ] JOF: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T19:29:44.147630] [INFO ] [REMOTE    ] JPC: Fetching primary data for 2025-02.
[2025-10-24T19:29:44.947628] [INFO ] [REMOTE    ] JPM: Fetching primary data for 2025-01.
[2025-10-24T19:29:45.504209] [INFO ] [REMOTE    ] JPC: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T19:29:45.747688] [INFO ] [REMOTE    ] JPC: Fetching primary data for 2025-03.
[2025-10-24T19:29:46.547678] [INFO ] [REMOTE    ] JOF: Fetching primary data for 2025-07.
[2025-10-24T19:29:47.069161] [INFO ] [REMOTE    ] JPM: Incremental fetch complete for 2025-01 (2.12 seconds).
[2025-10-24T19:29:47.259993] [INFO ] [REMOTE    ] JOF: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T19:29:47.304453] [INFO ] [REMOTE    ] JPC: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T19:29:47.347735] [INFO ] [REMOTE    ] JOF: Fetching primary data for 2025-08.
[2025-10-24T19:29:48.085484] [INFO ] [REMOTE    ] JOF: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T19:29:48.147686] [INFO ] [REMOTE    ] JPC: Fetching primary data for 2025-04.
[2025-10-24T19:29:48.947699] [INFO ] [REMOTE    ] JOF: Fetching primary data for 2025-09.
[2025-10-24T19:29:49.546673] [INFO ] [REMOTE    ] JOF: Incremental fetch complete for 2025-09 (0.60 seconds).
[2025-10-24T19:29:49.576150] [INFO ] [REMOTE    ] JPC: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T19:29:49.747667] [INFO ] [REMOTE    ] JPC: Fetching primary data for 2025-05.
[2025-10-24T19:29:50.547692] [INFO ] [REMOTE    ] JPM: Fetching primary data for 2025-02.
[2025-10-24T19:29:51.117721] [INFO ] [REMOTE    ] JPC: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T19:29:51.347675] [INFO ] [REMOTE    ] JPC: Fetching primary data for 2025-06.
[2025-10-24T19:29:52.147705] [INFO ] [REMOTE    ] JOF: Fetching primary data for 2025-10.
[2025-10-24T19:29:52.684539] [INFO ] [REMOTE    ] JPC: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T19:29:52.719635] [INFO ] [REMOTE    ] JPM: Incremental fetch complete for 2025-02 (2.17 seconds).
[2025-10-24T19:29:52.746009] [INFO ] [REMOTE    ] JOF: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T19:29:52.747858] [INFO ] [REMOTE    ] JOF: Full fetch complete (9525 records).
[2025-10-24T19:29:52.748011] [DEBUG] [VALIDATOR ] JOF: Validating primary data.
[2025-10-24T19:29:52.952874] [INFO ] [REMOTE    ] JQC: Fetching primary data for 2025-01.
[2025-10-24T19:29:53.115346] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present.
[2025-10-24T19:29:53.115419] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed.
[2025-10-24T19:29:53.115686] [INFO ] [MAIN      ] JOF: Fetched primary data is valid.
[2025-10-24T19:29:53.115746] [DEBUG] [LOCAL     ] JOF: Saving primary data.
[2025-10-24T19:29:53.115946] [FATAL] [LOCAL     ] JOF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:29:53.116033] [FATAL] [MAIN      ] JOF: Failed to save primary data.
[2025-10-24T19:29:53.116076] [WARN ] [MAIN      ] JOF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:29:53.116110] [INFO ] [LOCAL     ] JOF: Starting deletion of primary data.
[2025-10-24T19:29:53.116159] [DEBUG] [LOCAL     ] JOF: No primary data file found to delete.
[2025-10-24T19:29:53.116217] [INFO ] [LOCAL     ] JOF: Starting deletion of derivative data.
[2025-10-24T19:29:53.116372] [DEBUG] [LOCAL     ] JOF: Deleted derivative data file.
[2025-10-24T19:29:53.116444] [INFO ] [MAIN      ] Update Progress: 1166/2366 symbols completed. JOF took 21.2s. Estimated remaining: 2h 34m 12s. Rate: 7.8 symbols/min
[2025-10-24T19:29:53.285384] [INFO ] [MAIN      ] JRI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:29:53.304325] [DEBUG] [LOCAL     ] JRI: Loaded 15370 existing records from primary storage.
[2025-10-24T19:29:53.304552] [INFO ] [MAIN      ] JRI: Loaded 15370 existing records.
[2025-10-24T19:29:53.480353] [WARN ] [MAIN      ] JRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:29:53.480570] [INFO ] [MAIN      ] JRI: Wiping existing primary data before full refresh.
[2025-10-24T19:29:53.480617] [INFO ] [LOCAL     ] JRI: Starting deletion of primary data.
[2025-10-24T19:29:53.480885] [DEBUG] [LOCAL     ] JRI: Deleted primary data file.
[2025-10-24T19:29:53.480935] [INFO ] [MAIN      ] JRI: Starting full primary refresh.
[2025-10-24T19:29:53.757976] [INFO ] [REMOTE    ] JPM: Fetching primary data for 2025-03.
[2025-10-24T19:29:53.842788] [INFO ] [REMOTE    ] JRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:29:54.300106] [INFO ] [REMOTE    ] JQC: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T19:29:54.547683] [INFO ] [REMOTE    ] JQC: Fetching primary data for 2025-02.
[2025-10-24T19:29:55.347706] [INFO ] [REMOTE    ] JPC: Fetching primary data for 2025-07.
[2025-10-24T19:29:55.738888] [INFO ] [REMOTE    ] JQC: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T19:29:56.147730] [INFO ] [REMOTE    ] JRI: Fetching primary data for 2025-01.
[2025-10-24T19:29:56.201981] [INFO ] [REMOTE    ] JPM: Incremental fetch complete for 2025-03 (2.44 seconds).
[2025-10-24T19:29:56.839674] [INFO ] [REMOTE    ] JPC: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T19:29:56.874747] [INFO ] [REMOTE    ] JRI: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T19:29:56.947612] [INFO ] [REMOTE    ] JPC: Fetching primary data for 2025-08.
[2025-10-24T19:29:57.747714] [INFO ] [REMOTE    ] JQC: Fetching primary data for 2025-03.
[2025-10-24T19:29:58.311001] [INFO ] [REMOTE    ] JPC: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T19:29:58.547693] [INFO ] [REMOTE    ] JRI: Fetching primary data for 2025-02.
[2025-10-24T19:29:59.105209] [INFO ] [REMOTE    ] JQC: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T19:29:59.122699] [INFO ] [REMOTE    ] JRI: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T19:29:59.347670] [INFO ] [REMOTE    ] JQC: Fetching primary data for 2025-04.
[2025-10-24T19:30:00.147690] [INFO ] [REMOTE    ] JPM: Fetching primary data for 2025-04.
[2025-10-24T19:30:00.714169] [INFO ] [REMOTE    ] JQC: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T19:30:00.947699] [INFO ] [REMOTE    ] JQC: Fetching primary data for 2025-05.
[2025-10-24T19:30:01.747702] [INFO ] [REMOTE    ] JRI: Fetching primary data for 2025-03.
[2025-10-24T19:30:02.303769] [INFO ] [REMOTE    ] JQC: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T19:30:02.383454] [INFO ] [REMOTE    ] JPM: Incremental fetch complete for 2025-04 (2.24 seconds).
[2025-10-24T19:30:02.547678] [INFO ] [REMOTE    ] JQC: Fetching primary data for 2025-06.
[2025-10-24T19:30:02.721275] [INFO ] [REMOTE    ] JRI: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T19:30:03.347628] [INFO ] [REMOTE    ] JRI: Fetching primary data for 2025-04.
[2025-10-24T19:30:03.522362] [INFO ] [REMOTE    ] JQC: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T19:30:04.147736] [INFO ] [REMOTE    ] JPM: Fetching primary data for 2025-05.
[2025-10-24T19:30:04.349737] [INFO ] [REMOTE    ] JRI: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T19:30:04.947682] [INFO ] [REMOTE    ] JRI: Fetching primary data for 2025-05.
[2025-10-24T19:30:05.747630] [INFO ] [REMOTE    ] JQC: Fetching primary data for 2025-07.
[2025-10-24T19:30:05.833054] [INFO ] [REMOTE    ] JRI: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T19:30:06.190334] [INFO ] [REMOTE    ] JPM: Incremental fetch complete for 2025-05 (2.04 seconds).
[2025-10-24T19:30:06.547709] [INFO ] [REMOTE    ] JRI: Fetching primary data for 2025-06.
[2025-10-24T19:30:07.119879] [INFO ] [REMOTE    ] JQC: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T19:30:07.347636] [INFO ] [REMOTE    ] JPC: Fetching primary data for 2025-09.
[2025-10-24T19:30:07.422205] [INFO ] [REMOTE    ] JRI: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T19:30:08.147620] [INFO ] [REMOTE    ] JPM: Fetching primary data for 2025-06.
[2025-10-24T19:30:08.625199] [INFO ] [REMOTE    ] JPC: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T19:30:08.947708] [INFO ] [REMOTE    ] JRI: Fetching primary data for 2025-07.
[2025-10-24T19:30:09.747632] [INFO ] [REMOTE    ] JQC: Fetching primary data for 2025-08.
[2025-10-24T19:30:09.925878] [INFO ] [REMOTE    ] JRI: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T19:30:10.216091] [INFO ] [REMOTE    ] JPM: Incremental fetch complete for 2025-06 (2.07 seconds).
[2025-10-24T19:30:10.547616] [INFO ] [REMOTE    ] JPC: Fetching primary data for 2025-10.
[2025-10-24T19:30:10.730993] [INFO ] [REMOTE    ] JQC: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T19:30:11.347616] [INFO ] [REMOTE    ] JPM: Fetching primary data for 2025-07.
[2025-10-24T19:30:11.843521] [INFO ] [REMOTE    ] JPC: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T19:30:11.850679] [INFO ] [REMOTE    ] JPC: Full fetch complete (54952 records).
[2025-10-24T19:30:11.850798] [DEBUG] [VALIDATOR ] JPC: Validating primary data.
[2025-10-24T19:30:12.152730] [INFO ] [REMOTE    ] JQC: Fetching primary data for 2025-09.
[2025-10-24T19:30:12.233982] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present.
[2025-10-24T19:30:12.234060] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed.
[2025-10-24T19:30:12.235015] [INFO ] [MAIN      ] JPC: Fetched primary data is valid.
[2025-10-24T19:30:12.235076] [DEBUG] [LOCAL     ] JPC: Saving primary data.
[2025-10-24T19:30:12.235569] [FATAL] [LOCAL     ] JPC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:30:12.235681] [FATAL] [MAIN      ] JPC: Failed to save primary data.
[2025-10-24T19:30:12.235758] [WARN ] [MAIN      ] JPC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:30:12.235826] [INFO ] [LOCAL     ] JPC: Starting deletion of primary data.
[2025-10-24T19:30:12.235885] [DEBUG] [LOCAL     ] JPC: No primary data file found to delete.
[2025-10-24T19:30:12.235920] [INFO ] [LOCAL     ] JPC: Starting deletion of derivative data.
[2025-10-24T19:30:12.235958] [DEBUG] [LOCAL     ] JPC: No derivative data file found to delete.
[2025-10-24T19:30:12.236599] [INFO ] [MAIN      ] Update Progress: 1167/2366 symbols completed. JPC took 31.7s. Estimated remaining: 2h 34m 16s. Rate: 7.8 symbols/min
[2025-10-24T19:30:12.403724] [INFO ] [MAIN      ] JRS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:30:12.418076] [DEBUG] [LOCAL     ] JRS: Loaded 11582 existing records from primary storage.
[2025-10-24T19:30:12.418300] [INFO ] [MAIN      ] JRS: Loaded 11582 existing records.
[2025-10-24T19:30:12.596486] [WARN ] [MAIN      ] JRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:30:12.596742] [INFO ] [MAIN      ] JRS: Wiping existing primary data before full refresh.
[2025-10-24T19:30:12.596809] [INFO ] [LOCAL     ] JRS: Starting deletion of primary data.
[2025-10-24T19:30:12.597031] [DEBUG] [LOCAL     ] JRS: Deleted primary data file.
[2025-10-24T19:30:12.597072] [INFO ] [MAIN      ] JRS: Starting full primary refresh.
[2025-10-24T19:30:12.947671] [INFO ] [REMOTE    ] JRI: Fetching primary data for 2025-08.
[2025-10-24T19:30:12.947560] [INFO ] [REMOTE    ] JRS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:30:13.282197] [INFO ] [REMOTE    ] JPM: Incremental fetch complete for 2025-07 (1.93 seconds).
[2025-10-24T19:30:13.546083] [INFO ] [REMOTE    ] JQC: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T19:30:13.562801] [INFO ] [REMOTE    ] JRI: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T19:30:13.747677] [INFO ] [REMOTE    ] JRS: Fetching primary data for 2025-01.
[2025-10-24T19:30:14.493884] [INFO ] [REMOTE    ] JRS: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T19:30:14.547616] [INFO ] [REMOTE    ] JRI: Fetching primary data for 2025-09.
[2025-10-24T19:30:15.347703] [INFO ] [REMOTE    ] JPM: Fetching primary data for 2025-08.
[2025-10-24T19:30:15.515047] [INFO ] [REMOTE    ] JRI: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T19:30:16.147637] [INFO ] [REMOTE    ] JRI: Fetching primary data for 2025-10.
[2025-10-24T19:30:16.947681] [INFO ] [REMOTE    ] JQC: Fetching primary data for 2025-10.
[2025-10-24T19:30:17.112129] [INFO ] [REMOTE    ] JRI: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T19:30:17.115422] [INFO ] [REMOTE    ] JRI: Full fetch complete (22822 records).
[2025-10-24T19:30:17.115494] [DEBUG] [VALIDATOR ] JRI: Validating primary data.
[2025-10-24T19:30:17.509466] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present.
[2025-10-24T19:30:17.509637] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed.
[2025-10-24T19:30:17.510282] [INFO ] [MAIN      ] JRI: Fetched primary data is valid.
[2025-10-24T19:30:17.510362] [DEBUG] [LOCAL     ] JRI: Saving primary data.
[2025-10-24T19:30:17.510794] [FATAL] [LOCAL     ] JRI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:30:17.510943] [FATAL] [MAIN      ] JRI: Failed to save primary data.
[2025-10-24T19:30:17.511098] [WARN ] [MAIN      ] JRI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:30:17.511331] [INFO ] [LOCAL     ] JRI: Starting deletion of primary data.
[2025-10-24T19:30:17.511463] [DEBUG] [LOCAL     ] JRI: No primary data file found to delete.
[2025-10-24T19:30:17.511594] [INFO ] [LOCAL     ] JRI: Starting deletion of derivative data.
[2025-10-24T19:30:17.511836] [DEBUG] [LOCAL     ] JRI: Deleted derivative data file.
[2025-10-24T19:30:17.511930] [INFO ] [MAIN      ] Update Progress: 1168/2366 symbols completed. JRI took 24.4s. Estimated remaining: 2h 34m 6s. Rate: 7.8 symbols/min
[2025-10-24T19:30:17.687478] [INFO ] [REMOTE    ] JPM: Incremental fetch complete for 2025-08 (2.34 seconds).
[2025-10-24T19:30:17.723153] [INFO ] [MAIN      ] JXN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:30:17.747855] [INFO ] [REMOTE    ] JPM: Fetching primary data for 2025-09.
[2025-10-24T19:30:17.766764] [DEBUG] [LOCAL     ] JXN: Loaded 44543 existing records from primary storage.
[2025-10-24T19:30:17.767044] [INFO ] [MAIN      ] JXN: Loaded 44543 existing records.
[2025-10-24T19:30:17.949688] [WARN ] [MAIN      ] JXN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:30:17.949911] [INFO ] [MAIN      ] JXN: Wiping existing primary data before full refresh.
[2025-10-24T19:30:17.949964] [INFO ] [LOCAL     ] JXN: Starting deletion of primary data.
[2025-10-24T19:30:17.950287] [DEBUG] [LOCAL     ] JXN: Deleted primary data file.
[2025-10-24T19:30:17.950325] [INFO ] [MAIN      ] JXN: Starting full primary refresh.
[2025-10-24T19:30:18.305956] [INFO ] [REMOTE    ] JXN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:30:18.547639] [INFO ] [REMOTE    ] JXN: Fetching primary data for 2025-01.
[2025-10-24T19:30:18.955333] [INFO ] [REMOTE    ] JQC: Incremental fetch complete for 2025-10 (2.01 seconds).
[2025-10-24T19:30:18.962185] [INFO ] [REMOTE    ] JQC: Full fetch complete (50106 records).
[2025-10-24T19:30:18.962291] [DEBUG] [VALIDATOR ] JQC: Validating primary data.
[2025-10-24T19:30:19.342244] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present.
[2025-10-24T19:30:19.342347] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed.
[2025-10-24T19:30:19.343171] [INFO ] [MAIN      ] JQC: Fetched primary data is valid.
[2025-10-24T19:30:19.343232] [DEBUG] [LOCAL     ] JQC: Saving primary data.
[2025-10-24T19:30:19.343670] [FATAL] [LOCAL     ] JQC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:30:19.343758] [FATAL] [MAIN      ] JQC: Failed to save primary data.
[2025-10-24T19:30:19.343800] [WARN ] [MAIN      ] JQC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:30:19.343833] [INFO ] [LOCAL     ] JQC: Starting deletion of primary data.
[2025-10-24T19:30:19.343881] [DEBUG] [LOCAL     ] JQC: No primary data file found to delete.
[2025-10-24T19:30:19.343915] [INFO ] [LOCAL     ] JQC: Starting deletion of derivative data.
[2025-10-24T19:30:19.344073] [DEBUG] [LOCAL     ] JQC: Deleted derivative data file.
[2025-10-24T19:30:19.344162] [INFO ] [MAIN      ] Update Progress: 1169/2366 symbols completed. JQC took 37.0s. Estimated remaining: 2h 33m 52s. Rate: 7.8 symbols/min
[2025-10-24T19:30:19.355467] [INFO ] [REMOTE    ] JRS: Fetching primary data for 2025-02.
[2025-10-24T19:30:19.517296] [INFO ] [MAIN      ] K: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:30:19.567877] [DEBUG] [LOCAL     ] K: Loaded 50741 existing records from primary storage.
[2025-10-24T19:30:19.568165] [INFO ] [MAIN      ] K: Loaded 50741 existing records.
[2025-10-24T19:30:19.760150] [WARN ] [MAIN      ] K: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:30:19.760527] [INFO ] [MAIN      ] K: Wiping existing primary data before full refresh.
[2025-10-24T19:30:19.760752] [INFO ] [LOCAL     ] K: Starting deletion of primary data.
[2025-10-24T19:30:19.761246] [DEBUG] [LOCAL     ] K: Deleted primary data file.
[2025-10-24T19:30:19.761294] [INFO ] [MAIN      ] K: Starting full primary refresh.
[2025-10-24T19:30:20.068923] [INFO ] [REMOTE    ] JRS: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T19:30:20.154015] [INFO ] [REMOTE    ] JRS: Fetching primary data for 2025-03.
[2025-10-24T19:30:20.192364] [INFO ] [REMOTE    ] JXN: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T19:30:20.196191] [INFO ] [REMOTE    ] JPM: Incremental fetch complete for 2025-09 (2.45 seconds).
[2025-10-24T19:30:20.240360] [INFO ] [REMOTE    ] K: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:30:20.683168] [INFO ] [REMOTE    ] JRS: Incremental fetch complete for 2025-03 (0.53 seconds).
[2025-10-24T19:30:20.947639] [INFO ] [REMOTE    ] JRS: Fetching primary data for 2025-04.
[2025-10-24T19:30:21.708730] [INFO ] [REMOTE    ] JRS: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T19:30:21.747611] [INFO ] [REMOTE    ] JPM: Fetching primary data for 2025-10.
[2025-10-24T19:30:22.547759] [INFO ] [REMOTE    ] JRS: Fetching primary data for 2025-05.
[2025-10-24T19:30:23.300091] [INFO ] [REMOTE    ] JRS: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T19:30:23.347602] [INFO ] [REMOTE    ] JRS: Fetching primary data for 2025-06.
[2025-10-24T19:30:23.834433] [INFO ] [REMOTE    ] JRS: Incremental fetch complete for 2025-06 (0.49 seconds).
[2025-10-24T19:30:23.862615] [INFO ] [REMOTE    ] JPM: Incremental fetch complete for 2025-10 (2.11 seconds).
[2025-10-24T19:30:23.872377] [INFO ] [REMOTE    ] JPM: Full fetch complete (77973 records).
[2025-10-24T19:30:23.872509] [DEBUG] [VALIDATOR ] JPM: Validating primary data.
[2025-10-24T19:30:24.152859] [INFO ] [REMOTE    ] K: Fetching primary data for 2025-01.
[2025-10-24T19:30:24.259592] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present.
[2025-10-24T19:30:24.259704] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed.
[2025-10-24T19:30:24.260761] [INFO ] [MAIN      ] JPM: Fetched primary data is valid.
[2025-10-24T19:30:24.260822] [DEBUG] [LOCAL     ] JPM: Saving primary data.
[2025-10-24T19:30:24.261398] [FATAL] [LOCAL     ] JPM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:30:24.261487] [FATAL] [MAIN      ] JPM: Failed to save primary data.
[2025-10-24T19:30:24.261528] [WARN ] [MAIN      ] JPM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:30:24.261593] [INFO ] [LOCAL     ] JPM: Starting deletion of primary data.
[2025-10-24T19:30:24.261676] [DEBUG] [LOCAL     ] JPM: No primary data file found to delete.
[2025-10-24T19:30:24.261731] [INFO ] [LOCAL     ] JPM: Starting deletion of derivative data.
[2025-10-24T19:30:24.261894] [DEBUG] [LOCAL     ] JPM: Deleted derivative data file.
[2025-10-24T19:30:24.262720] [INFO ] [MAIN      ] Update Progress: 1170/2366 symbols completed. JPM took 43.6s. Estimated remaining: 2h 33m 42s. Rate: 7.8 symbols/min
[2025-10-24T19:30:24.426164] [INFO ] [MAIN      ] KAI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:30:24.442900] [DEBUG] [LOCAL     ] KAI: Loaded 13504 existing records from primary storage.
[2025-10-24T19:30:24.443140] [INFO ] [MAIN      ] KAI: Loaded 13504 existing records.
[2025-10-24T19:30:24.614941] [WARN ] [MAIN      ] KAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:30:24.615121] [INFO ] [MAIN      ] KAI: Wiping existing primary data before full refresh.
[2025-10-24T19:30:24.615166] [INFO ] [LOCAL     ] KAI: Starting deletion of primary data.
[2025-10-24T19:30:24.615376] [DEBUG] [LOCAL     ] KAI: Deleted primary data file.
[2025-10-24T19:30:24.615431] [INFO ] [MAIN      ] KAI: Starting full primary refresh.
[2025-10-24T19:30:24.957063] [INFO ] [REMOTE    ] JRS: Fetching primary data for 2025-07.
[2025-10-24T19:30:24.962317] [INFO ] [REMOTE    ] KAI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:30:25.686916] [INFO ] [REMOTE    ] K: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T19:30:25.736779] [INFO ] [REMOTE    ] JRS: Incremental fetch complete for 2025-07 (0.78 seconds).
[2025-10-24T19:30:25.747598] [INFO ] [REMOTE    ] JRS: Fetching primary data for 2025-08.
[2025-10-24T19:30:26.201811] [INFO ] [REMOTE    ] JRS: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T19:30:26.547694] [INFO ] [REMOTE    ] JXN: Fetching primary data for 2025-02.
[2025-10-24T19:30:27.347699] [INFO ] [REMOTE    ] K: Fetching primary data for 2025-02.
[2025-10-24T19:30:28.140801] [INFO ] [REMOTE    ] JXN: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T19:30:28.148866] [INFO ] [REMOTE    ] JRS: Fetching primary data for 2025-09.
[2025-10-24T19:30:28.923448] [INFO ] [REMOTE    ] JRS: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T19:30:28.952848] [INFO ] [REMOTE    ] JRS: Fetching primary data for 2025-10.
[2025-10-24T19:30:28.966696] [INFO ] [REMOTE    ] K: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T19:30:29.747722] [INFO ] [REMOTE    ] K: Fetching primary data for 2025-03.
[2025-10-24T19:30:29.931756] [INFO ] [REMOTE    ] JRS: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T19:30:29.934673] [INFO ] [REMOTE    ] JRS: Full fetch complete (16075 records).
[2025-10-24T19:30:29.934750] [DEBUG] [VALIDATOR ] JRS: Validating primary data.
[2025-10-24T19:30:30.302612] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present.
[2025-10-24T19:30:30.302714] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed.
[2025-10-24T19:30:30.303062] [INFO ] [MAIN      ] JRS: Fetched primary data is valid.
[2025-10-24T19:30:30.303101] [DEBUG] [LOCAL     ] JRS: Saving primary data.
[2025-10-24T19:30:30.303321] [FATAL] [LOCAL     ] JRS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:30:30.303398] [FATAL] [MAIN      ] JRS: Failed to save primary data.
[2025-10-24T19:30:30.303440] [WARN ] [MAIN      ] JRS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:30:30.303473] [INFO ] [LOCAL     ] JRS: Starting deletion of primary data.
[2025-10-24T19:30:30.303522] [DEBUG] [LOCAL     ] JRS: No primary data file found to delete.
[2025-10-24T19:30:30.303556] [INFO ] [LOCAL     ] JRS: Starting deletion of derivative data.
[2025-10-24T19:30:30.303741] [DEBUG] [LOCAL     ] JRS: Deleted derivative data file.
[2025-10-24T19:30:30.303827] [INFO ] [MAIN      ] Update Progress: 1171/2366 symbols completed. JRS took 18.1s. Estimated remaining: 2h 33m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:30:30.471325] [INFO ] [MAIN      ] KAR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:30:30.511742] [DEBUG] [LOCAL     ] KAR: Loaded 40036 existing records from primary storage.
[2025-10-24T19:30:30.512014] [INFO ] [MAIN      ] KAR: Loaded 40036 existing records.
[2025-10-24T19:30:30.555034] [INFO ] [REMOTE    ] KAI: Fetching primary data for 2025-01.
[2025-10-24T19:30:30.692169] [WARN ] [MAIN      ] KAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:30:30.692380] [INFO ] [MAIN      ] KAR: Wiping existing primary data before full refresh.
[2025-10-24T19:30:30.692426] [INFO ] [LOCAL     ] KAR: Starting deletion of primary data.
[2025-10-24T19:30:30.692795] [DEBUG] [LOCAL     ] KAR: Deleted primary data file.
[2025-10-24T19:30:30.692856] [INFO ] [MAIN      ] KAR: Starting full primary refresh.
[2025-10-24T19:30:31.053308] [INFO ] [REMOTE    ] KAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:30:31.347686] [INFO ] [REMOTE    ] JXN: Fetching primary data for 2025-03.
[2025-10-24T19:30:31.477696] [INFO ] [REMOTE    ] K: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T19:30:31.512465] [INFO ] [REMOTE    ] KAI: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T19:30:32.147692] [INFO ] [REMOTE    ] KAI: Fetching primary data for 2025-02.
[2025-10-24T19:30:32.947616] [INFO ] [REMOTE    ] K: Fetching primary data for 2025-04.
[2025-10-24T19:30:33.052828] [INFO ] [REMOTE    ] KAI: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T19:30:33.221102] [INFO ] [REMOTE    ] JXN: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T19:30:33.747724] [INFO ] [REMOTE    ] JXN: Fetching primary data for 2025-04.
[2025-10-24T19:30:34.246230] [INFO ] [REMOTE    ] K: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T19:30:34.547729] [INFO ] [REMOTE    ] K: Fetching primary data for 2025-05.
[2025-10-24T19:30:35.277847] [INFO ] [REMOTE    ] JXN: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T19:30:35.347741] [INFO ] [REMOTE    ] KAR: Fetching primary data for 2025-01.
[2025-10-24T19:30:36.124455] [INFO ] [REMOTE    ] K: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T19:30:36.147600] [INFO ] [REMOTE    ] K: Fetching primary data for 2025-06.
[2025-10-24T19:30:36.657847] [INFO ] [REMOTE    ] KAR: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T19:30:36.947637] [INFO ] [REMOTE    ] KAR: Fetching primary data for 2025-02.
[2025-10-24T19:30:37.744458] [INFO ] [REMOTE    ] K: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T19:30:37.753940] [INFO ] [REMOTE    ] JXN: Fetching primary data for 2025-05.
[2025-10-24T19:30:38.278704] [INFO ] [REMOTE    ] KAR: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T19:30:38.547622] [INFO ] [REMOTE    ] KAI: Fetching primary data for 2025-03.
[2025-10-24T19:30:39.345054] [INFO ] [REMOTE    ] JXN: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T19:30:39.354100] [INFO ] [REMOTE    ] K: Fetching primary data for 2025-07.
[2025-10-24T19:30:39.594798] [INFO ] [REMOTE    ] KAI: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T19:30:40.147629] [INFO ] [REMOTE    ] KAR: Fetching primary data for 2025-03.
[2025-10-24T19:30:40.947695] [INFO ] [REMOTE    ] KAI: Fetching primary data for 2025-04.
[2025-10-24T19:30:41.113792] [INFO ] [REMOTE    ] K: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T19:30:41.634737] [INFO ] [REMOTE    ] KAR: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T19:30:41.747625] [INFO ] [REMOTE    ] K: Fetching primary data for 2025-08.
[2025-10-24T19:30:42.006745] [INFO ] [REMOTE    ] KAI: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T19:30:42.547697] [INFO ] [REMOTE    ] KAR: Fetching primary data for 2025-04.
[2025-10-24T19:30:43.279580] [INFO ] [REMOTE    ] K: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T19:30:43.347740] [INFO ] [REMOTE    ] K: Fetching primary data for 2025-09.
[2025-10-24T19:30:43.480239] [INFO ] [REMOTE    ] KAR: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T19:30:44.147663] [INFO ] [REMOTE    ] KAR: Fetching primary data for 2025-05.
[2025-10-24T19:30:44.875803] [INFO ] [REMOTE    ] K: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T19:30:44.947681] [INFO ] [REMOTE    ] KAI: Fetching primary data for 2025-05.
[2025-10-24T19:30:45.553538] [INFO ] [REMOTE    ] KAR: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T19:30:45.747619] [INFO ] [REMOTE    ] K: Fetching primary data for 2025-10.
[2025-10-24T19:30:45.877708] [INFO ] [REMOTE    ] KAI: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T19:30:46.547669] [INFO ] [REMOTE    ] KAI: Fetching primary data for 2025-06.
[2025-10-24T19:30:47.347692] [INFO ] [REMOTE    ] KAR: Fetching primary data for 2025-06.
[2025-10-24T19:30:47.540609] [INFO ] [REMOTE    ] KAI: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T19:30:47.633372] [INFO ] [REMOTE    ] K: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T19:30:47.642920] [INFO ] [REMOTE    ] K: Full fetch complete (72287 records).
[2025-10-24T19:30:47.643087] [DEBUG] [VALIDATOR ] K: Validating primary data.
[2025-10-24T19:30:48.075051] [DEBUG] [VALIDATOR ] K: All expected trading days are present.
[2025-10-24T19:30:48.075133] [DEBUG] [VALIDATOR ] K: Primary data validation passed.
[2025-10-24T19:30:48.076162] [INFO ] [MAIN      ] K: Fetched primary data is valid.
[2025-10-24T19:30:48.076227] [DEBUG] [LOCAL     ] K: Saving primary data.
[2025-10-24T19:30:48.076848] [FATAL] [LOCAL     ] K: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:30:48.076954] [FATAL] [MAIN      ] K: Failed to save primary data.
[2025-10-24T19:30:48.077022] [WARN ] [MAIN      ] K: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:30:48.077116] [INFO ] [LOCAL     ] K: Starting deletion of primary data.
[2025-10-24T19:30:48.077216] [DEBUG] [LOCAL     ] K: No primary data file found to delete.
[2025-10-24T19:30:48.077275] [INFO ] [LOCAL     ] K: Starting deletion of derivative data.
[2025-10-24T19:30:48.077406] [DEBUG] [LOCAL     ] K: Deleted derivative data file.
[2025-10-24T19:30:48.077845] [INFO ] [MAIN      ] Update Progress: 1172/2366 symbols completed. K took 28.7s. Estimated remaining: 2h 33m 35s. Rate: 7.8 symbols/min
[2025-10-24T19:30:48.153315] [INFO ] [REMOTE    ] JXN: Fetching primary data for 2025-06.
[2025-10-24T19:30:48.275002] [INFO ] [MAIN      ] KB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:30:48.298207] [DEBUG] [LOCAL     ] KB: Loaded 23127 existing records from primary storage.
[2025-10-24T19:30:48.298496] [INFO ] [MAIN      ] KB: Loaded 23127 existing records.
[2025-10-24T19:30:48.487684] [WARN ] [MAIN      ] KB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:30:48.487970] [INFO ] [MAIN      ] KB: Wiping existing primary data before full refresh.
[2025-10-24T19:30:48.488140] [INFO ] [LOCAL     ] KB: Starting deletion of primary data.
[2025-10-24T19:30:48.495689] [DEBUG] [LOCAL     ] KB: Deleted primary data file.
[2025-10-24T19:30:48.508210] [INFO ] [MAIN      ] KB: Starting full primary refresh.
[2025-10-24T19:30:48.515145] [INFO ] [REMOTE    ] KAR: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T19:30:48.877138] [INFO ] [REMOTE    ] KB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:30:48.947725] [INFO ] [REMOTE    ] KB: Fetching primary data for 2025-01.
[2025-10-24T19:30:49.747741] [INFO ] [REMOTE    ] KAI: Fetching primary data for 2025-07.
[2025-10-24T19:30:49.784124] [INFO ] [REMOTE    ] JXN: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T19:30:49.806799] [INFO ] [REMOTE    ] KB: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T19:30:50.361810] [INFO ] [REMOTE    ] KAI: Incremental fetch complete for 2025-07 (0.61 seconds).
[2025-10-24T19:30:50.547635] [INFO ] [REMOTE    ] KAI: Fetching primary data for 2025-08.
[2025-10-24T19:30:51.347714] [INFO ] [REMOTE    ] KAR: Fetching primary data for 2025-07.
[2025-10-24T19:30:51.387396] [INFO ] [REMOTE    ] KAI: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T19:30:52.147718] [INFO ] [REMOTE    ] JXN: Fetching primary data for 2025-07.
[2025-10-24T19:30:52.928959] [INFO ] [REMOTE    ] KAR: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T19:30:52.947623] [INFO ] [REMOTE    ] KB: Fetching primary data for 2025-02.
[2025-10-24T19:30:53.407863] [INFO ] [REMOTE    ] JXN: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T19:30:53.747721] [INFO ] [REMOTE    ] KAI: Fetching primary data for 2025-09.
[2025-10-24T19:30:54.009225] [INFO ] [REMOTE    ] KB: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T19:30:54.502568] [INFO ] [REMOTE    ] KAI: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T19:30:54.547693] [INFO ] [REMOTE    ] KAR: Fetching primary data for 2025-08.
[2025-10-24T19:30:55.347672] [INFO ] [REMOTE    ] KAI: Fetching primary data for 2025-10.
[2025-10-24T19:30:55.895692] [INFO ] [REMOTE    ] KAR: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T19:30:56.147620] [INFO ] [REMOTE    ] KAR: Fetching primary data for 2025-09.
[2025-10-24T19:30:56.303570] [INFO ] [REMOTE    ] KAI: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T19:30:56.306567] [INFO ] [REMOTE    ] KAI: Full fetch complete (19335 records).
[2025-10-24T19:30:56.306669] [DEBUG] [VALIDATOR ] KAI: Validating primary data.
[2025-10-24T19:30:56.694189] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present.
[2025-10-24T19:30:56.694260] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed.
[2025-10-24T19:30:56.694680] [INFO ] [MAIN      ] KAI: Fetched primary data is valid.
[2025-10-24T19:30:56.694740] [DEBUG] [LOCAL     ] KAI: Saving primary data.
[2025-10-24T19:30:56.695018] [FATAL] [LOCAL     ] KAI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:30:56.695102] [FATAL] [MAIN      ] KAI: Failed to save primary data.
[2025-10-24T19:30:56.695145] [WARN ] [MAIN      ] KAI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:30:56.695178] [INFO ] [LOCAL     ] KAI: Starting deletion of primary data.
[2025-10-24T19:30:56.695226] [DEBUG] [LOCAL     ] KAI: No primary data file found to delete.
[2025-10-24T19:30:56.695260] [INFO ] [LOCAL     ] KAI: Starting deletion of derivative data.
[2025-10-24T19:30:56.695403] [DEBUG] [LOCAL     ] KAI: Deleted derivative data file.
[2025-10-24T19:30:56.695487] [INFO ] [MAIN      ] Update Progress: 1173/2366 symbols completed. KAI took 32.4s. Estimated remaining: 2h 33m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:30:56.873229] [INFO ] [MAIN      ] KBDC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:30:56.898632] [DEBUG] [LOCAL     ] KBDC: Loaded 22805 existing records from primary storage.
[2025-10-24T19:30:56.898895] [INFO ] [MAIN      ] KBDC: Loaded 22805 existing records.
[2025-10-24T19:30:56.952859] [INFO ] [REMOTE    ] KB: Fetching primary data for 2025-03.
[2025-10-24T19:30:57.102735] [WARN ] [MAIN      ] KBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:30:57.102936] [INFO ] [MAIN      ] KBDC: Wiping existing primary data before full refresh.
[2025-10-24T19:30:57.102982] [INFO ] [LOCAL     ] KBDC: Starting deletion of primary data.
[2025-10-24T19:30:57.103222] [DEBUG] [LOCAL     ] KBDC: Deleted primary data file.
[2025-10-24T19:30:57.103260] [INFO ] [MAIN      ] KBDC: Starting full primary refresh.
[2025-10-24T19:30:57.483852] [INFO ] [REMOTE    ] KAR: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T19:30:57.515131] [INFO ] [REMOTE    ] KBDC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:30:57.747680] [INFO ] [REMOTE    ] KAR: Fetching primary data for 2025-10.
[2025-10-24T19:30:58.210917] [INFO ] [REMOTE    ] KB: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T19:30:58.547673] [INFO ] [REMOTE    ] JXN: Fetching primary data for 2025-08.
[2025-10-24T19:30:59.164574] [INFO ] [REMOTE    ] KAR: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T19:30:59.172181] [INFO ] [REMOTE    ] KAR: Full fetch complete (56986 records).
[2025-10-24T19:30:59.172345] [DEBUG] [VALIDATOR ] KAR: Validating primary data.
[2025-10-24T19:30:59.357001] [INFO ] [REMOTE    ] KB: Fetching primary data for 2025-04.
[2025-10-24T19:30:59.598685] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present.
[2025-10-24T19:30:59.598779] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed.
[2025-10-24T19:30:59.599890] [INFO ] [MAIN      ] KAR: Fetched primary data is valid.
[2025-10-24T19:30:59.599958] [DEBUG] [LOCAL     ] KAR: Saving primary data.
[2025-10-24T19:30:59.600498] [FATAL] [LOCAL     ] KAR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:30:59.600589] [FATAL] [MAIN      ] KAR: Failed to save primary data.
[2025-10-24T19:30:59.600695] [WARN ] [MAIN      ] KAR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:30:59.600776] [INFO ] [LOCAL     ] KAR: Starting deletion of primary data.
[2025-10-24T19:30:59.600837] [DEBUG] [LOCAL     ] KAR: No primary data file found to delete.
[2025-10-24T19:30:59.600873] [INFO ] [LOCAL     ] KAR: Starting deletion of derivative data.
[2025-10-24T19:30:59.601015] [DEBUG] [LOCAL     ] KAR: Deleted derivative data file.
[2025-10-24T19:30:59.601248] [INFO ] [MAIN      ] Update Progress: 1174/2366 symbols completed. KAR took 29.3s. Estimated remaining: 2h 33m 16s. Rate: 7.8 symbols/min
[2025-10-24T19:30:59.788349] [INFO ] [MAIN      ] KBH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:30:59.818765] [INFO ] [REMOTE    ] JXN: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T19:30:59.873357] [DEBUG] [LOCAL     ] KBH: Loaded 49027 existing records from primary storage.
[2025-10-24T19:30:59.873743] [INFO ] [MAIN      ] KBH: Loaded 49027 existing records.
[2025-10-24T19:31:00.071710] [WARN ] [MAIN      ] KBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:31:00.071943] [INFO ] [MAIN      ] KBH: Wiping existing primary data before full refresh.
[2025-10-24T19:31:00.071990] [INFO ] [LOCAL     ] KBH: Starting deletion of primary data.
[2025-10-24T19:31:00.072461] [DEBUG] [LOCAL     ] KBH: Deleted primary data file.
[2025-10-24T19:31:00.072502] [INFO ] [MAIN      ] KBH: Starting full primary refresh.
[2025-10-24T19:31:00.152890] [INFO ] [REMOTE    ] JXN: Fetching primary data for 2025-09.
[2025-10-24T19:31:00.455722] [INFO ] [REMOTE    ] KBH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:31:00.473264] [INFO ] [REMOTE    ] KB: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T19:31:00.947716] [INFO ] [REMOTE    ] KBH: Fetching primary data for 2025-01.
[2025-10-24T19:31:01.752827] [INFO ] [REMOTE    ] KB: Fetching primary data for 2025-05.
[2025-10-24T19:31:01.772362] [INFO ] [REMOTE    ] JXN: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T19:31:02.534312] [INFO ] [REMOTE    ] KBH: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T19:31:02.547598] [INFO ] [REMOTE    ] KBH: Fetching primary data for 2025-02.
[2025-10-24T19:31:02.922296] [INFO ] [REMOTE    ] KB: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T19:31:03.347732] [INFO ] [REMOTE    ] KBDC: Fetching primary data for 2025-01.
[2025-10-24T19:31:04.013693] [INFO ] [REMOTE    ] KBH: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T19:31:04.032347] [INFO ] [REMOTE    ] KBDC: Incremental fetch complete for 2025-01 (0.68 seconds).
[2025-10-24T19:31:04.147623] [INFO ] [REMOTE    ] KB: Fetching primary data for 2025-06.
[2025-10-24T19:31:04.947723] [INFO ] [REMOTE    ] KBDC: Fetching primary data for 2025-02.
[2025-10-24T19:31:05.424173] [INFO ] [REMOTE    ] KB: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T19:31:05.747624] [INFO ] [REMOTE    ] JXN: Fetching primary data for 2025-10.
[2025-10-24T19:31:05.897879] [INFO ] [REMOTE    ] KBDC: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T19:31:06.547725] [INFO ] [REMOTE    ] KBDC: Fetching primary data for 2025-03.
[2025-10-24T19:31:07.236491] [INFO ] [REMOTE    ] JXN: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T19:31:07.243850] [INFO ] [REMOTE    ] JXN: Full fetch complete (65308 records).
[2025-10-24T19:31:07.243999] [DEBUG] [VALIDATOR ] JXN: Validating primary data.
[2025-10-24T19:31:07.352723] [INFO ] [REMOTE    ] KB: Fetching primary data for 2025-07.
[2025-10-24T19:31:07.641749] [INFO ] [REMOTE    ] KBDC: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T19:31:07.663223] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present.
[2025-10-24T19:31:07.668455] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed.
[2025-10-24T19:31:07.670047] [INFO ] [MAIN      ] JXN: Fetched primary data is valid.
[2025-10-24T19:31:07.670120] [DEBUG] [LOCAL     ] JXN: Saving primary data.
[2025-10-24T19:31:07.670617] [FATAL] [LOCAL     ] JXN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:31:07.670783] [FATAL] [MAIN      ] JXN: Failed to save primary data.
[2025-10-24T19:31:07.670868] [WARN ] [MAIN      ] JXN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:31:07.670951] [INFO ] [LOCAL     ] JXN: Starting deletion of primary data.
[2025-10-24T19:31:07.671025] [DEBUG] [LOCAL     ] JXN: No primary data file found to delete.
[2025-10-24T19:31:07.671064] [INFO ] [LOCAL     ] JXN: Starting deletion of derivative data.
[2025-10-24T19:31:07.671280] [DEBUG] [LOCAL     ] JXN: Deleted derivative data file.
[2025-10-24T19:31:07.671720] [INFO ] [MAIN      ] Update Progress: 1175/2366 symbols completed. JXN took 50.2s. Estimated remaining: 2h 33m 8s. Rate: 7.8 symbols/min
[2025-10-24T19:31:07.842939] [INFO ] [MAIN      ] KBR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:31:07.903279] [DEBUG] [LOCAL     ] KBR: Loaded 48343 existing records from primary storage.
[2025-10-24T19:31:07.903573] [INFO ] [MAIN      ] KBR: Loaded 48343 existing records.
[2025-10-24T19:31:08.082613] [WARN ] [MAIN      ] KBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:31:08.082837] [INFO ] [MAIN      ] KBR: Wiping existing primary data before full refresh.
[2025-10-24T19:31:08.082891] [INFO ] [LOCAL     ] KBR: Starting deletion of primary data.
[2025-10-24T19:31:08.083353] [DEBUG] [LOCAL     ] KBR: Deleted primary data file.
[2025-10-24T19:31:08.083392] [INFO ] [MAIN      ] KBR: Starting full primary refresh.
[2025-10-24T19:31:08.152746] [INFO ] [REMOTE    ] KBDC: Fetching primary data for 2025-04.
[2025-10-24T19:31:08.482297] [INFO ] [REMOTE    ] KBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:31:08.499295] [INFO ] [REMOTE    ] KB: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T19:31:08.947726] [INFO ] [REMOTE    ] KBR: Fetching primary data for 2025-01.
[2025-10-24T19:31:09.298926] [INFO ] [REMOTE    ] KBDC: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T19:31:09.747696] [INFO ] [REMOTE    ] KB: Fetching primary data for 2025-08.
[2025-10-24T19:31:10.374920] [INFO ] [REMOTE    ] KBR: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T19:31:10.547754] [INFO ] [REMOTE    ] KBDC: Fetching primary data for 2025-05.
[2025-10-24T19:31:10.893776] [INFO ] [REMOTE    ] KB: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T19:31:11.297343] [INFO ] [REMOTE    ] KBDC: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T19:31:11.347669] [INFO ] [REMOTE    ] KBDC: Fetching primary data for 2025-06.
[2025-10-24T19:31:12.147738] [INFO ] [REMOTE    ] KBH: Fetching primary data for 2025-03.
[2025-10-24T19:31:12.390368] [INFO ] [REMOTE    ] KBDC: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T19:31:12.947683] [INFO ] [REMOTE    ] KB: Fetching primary data for 2025-09.
[2025-10-24T19:31:13.747676] [INFO ] [REMOTE    ] KBR: Fetching primary data for 2025-02.
[2025-10-24T19:31:13.994466] [INFO ] [REMOTE    ] KBH: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T19:31:14.010881] [INFO ] [REMOTE    ] KB: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T19:31:14.547680] [INFO ] [REMOTE    ] KBH: Fetching primary data for 2025-04.
[2025-10-24T19:31:15.310686] [INFO ] [REMOTE    ] KBR: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T19:31:15.347612] [INFO ] [REMOTE    ] KBR: Fetching primary data for 2025-03.
[2025-10-24T19:31:16.147628] [INFO ] [REMOTE    ] KB: Fetching primary data for 2025-10.
[2025-10-24T19:31:16.213263] [INFO ] [REMOTE    ] KBH: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T19:31:16.692896] [INFO ] [REMOTE    ] KBR: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T19:31:16.947739] [INFO ] [REMOTE    ] KBH: Fetching primary data for 2025-05.
[2025-10-24T19:31:17.284884] [INFO ] [REMOTE    ] KB: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T19:31:17.288464] [INFO ] [REMOTE    ] KB: Full fetch complete (33407 records).
[2025-10-24T19:31:17.288545] [DEBUG] [VALIDATOR ] KB: Validating primary data.
[2025-10-24T19:31:17.657397] [DEBUG] [VALIDATOR ] KB: All expected trading days are present.
[2025-10-24T19:31:17.657483] [DEBUG] [VALIDATOR ] KB: Primary data validation passed.
[2025-10-24T19:31:17.658202] [INFO ] [MAIN      ] KB: Fetched primary data is valid.
[2025-10-24T19:31:17.658263] [DEBUG] [LOCAL     ] KB: Saving primary data.
[2025-10-24T19:31:17.658599] [FATAL] [LOCAL     ] KB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:31:17.658702] [FATAL] [MAIN      ] KB: Failed to save primary data.
[2025-10-24T19:31:17.658747] [WARN ] [MAIN      ] KB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:31:17.658806] [INFO ] [LOCAL     ] KB: Starting deletion of primary data.
[2025-10-24T19:31:17.658863] [DEBUG] [LOCAL     ] KB: No primary data file found to delete.
[2025-10-24T19:31:17.658899] [INFO ] [LOCAL     ] KB: Starting deletion of derivative data.
[2025-10-24T19:31:17.659043] [DEBUG] [LOCAL     ] KB: Deleted derivative data file.
[2025-10-24T19:31:17.659131] [INFO ] [MAIN      ] Update Progress: 1176/2366 symbols completed. KB took 29.6s. Estimated remaining: 2h 33m 3s. Rate: 7.8 symbols/min
[2025-10-24T19:31:17.756174] [INFO ] [REMOTE    ] KBR: Fetching primary data for 2025-04.
[2025-10-24T19:31:17.826996] [INFO ] [MAIN      ] KD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:31:17.877956] [DEBUG] [LOCAL     ] KD: Loaded 52704 existing records from primary storage.
[2025-10-24T19:31:17.878255] [INFO ] [MAIN      ] KD: Loaded 52704 existing records.
[2025-10-24T19:31:18.056899] [WARN ] [MAIN      ] KD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:31:18.057094] [INFO ] [MAIN      ] KD: Wiping existing primary data before full refresh.
[2025-10-24T19:31:18.057140] [INFO ] [LOCAL     ] KD: Starting deletion of primary data.
[2025-10-24T19:31:18.057605] [DEBUG] [LOCAL     ] KD: Deleted primary data file.
[2025-10-24T19:31:18.057701] [INFO ] [MAIN      ] KD: Starting full primary refresh.
[2025-10-24T19:31:18.414344] [INFO ] [REMOTE    ] KD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:31:18.443705] [INFO ] [REMOTE    ] KBH: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T19:31:18.547614] [INFO ] [REMOTE    ] KD: Fetching primary data for 2025-01.
[2025-10-24T19:31:19.257081] [INFO ] [REMOTE    ] KBR: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T19:31:19.347607] [INFO ] [REMOTE    ] KBR: Fetching primary data for 2025-05.
[2025-10-24T19:31:20.147632] [INFO ] [REMOTE    ] KBDC: Fetching primary data for 2025-07.
[2025-10-24T19:31:20.256230] [INFO ] [REMOTE    ] KD: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T19:31:20.777948] [INFO ] [REMOTE    ] KBR: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T19:31:20.947625] [INFO ] [REMOTE    ] KD: Fetching primary data for 2025-02.
[2025-10-24T19:31:21.101856] [INFO ] [REMOTE    ] KBDC: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T19:31:21.747732] [INFO ] [REMOTE    ] KBR: Fetching primary data for 2025-06.
[2025-10-24T19:31:22.322266] [INFO ] [REMOTE    ] KD: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T19:31:22.547739] [INFO ] [REMOTE    ] KBH: Fetching primary data for 2025-06.
[2025-10-24T19:31:23.347707] [INFO ] [REMOTE    ] KD: Fetching primary data for 2025-03.
[2025-10-24T19:31:23.527871] [INFO ] [REMOTE    ] KBR: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T19:31:24.147613] [INFO ] [REMOTE    ] KBR: Fetching primary data for 2025-07.
[2025-10-24T19:31:24.372081] [INFO ] [REMOTE    ] KBH: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T19:31:24.947627] [INFO ] [REMOTE    ] KBH: Fetching primary data for 2025-07.
[2025-10-24T19:31:25.365265] [INFO ] [REMOTE    ] KD: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T19:31:25.655804] [INFO ] [REMOTE    ] KBR: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T19:31:25.747632] [INFO ] [REMOTE    ] KBR: Fetching primary data for 2025-08.
[2025-10-24T19:31:26.547706] [INFO ] [REMOTE    ] KBDC: Fetching primary data for 2025-08.
[2025-10-24T19:31:26.752969] [INFO ] [REMOTE    ] KBH: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T19:31:27.347726] [INFO ] [REMOTE    ] KBH: Fetching primary data for 2025-08.
[2025-10-24T19:31:27.486627] [INFO ] [REMOTE    ] KBDC: Incremental fetch complete for 2025-08 (0.94 seconds).
[2025-10-24T19:31:27.485945] [INFO ] [REMOTE    ] KBR: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T19:31:28.147673] [INFO ] [REMOTE    ] KBR: Fetching primary data for 2025-09.
[2025-10-24T19:31:28.955328] [INFO ] [REMOTE    ] KD: Fetching primary data for 2025-04.
[2025-10-24T19:31:28.975701] [INFO ] [REMOTE    ] KBH: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T19:31:29.558269] [INFO ] [REMOTE    ] KBR: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T19:31:29.747677] [INFO ] [REMOTE    ] KBDC: Fetching primary data for 2025-09.
[2025-10-24T19:31:30.150688] [INFO ] [REMOTE    ] KD: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T19:31:30.547686] [INFO ] [REMOTE    ] KBR: Fetching primary data for 2025-10.
[2025-10-24T19:31:31.036046] [INFO ] [REMOTE    ] KBDC: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T19:31:31.347726] [INFO ] [REMOTE    ] KD: Fetching primary data for 2025-05.
[2025-10-24T19:31:32.147610] [INFO ] [REMOTE    ] KBH: Fetching primary data for 2025-09.
[2025-10-24T19:31:32.250385] [INFO ] [REMOTE    ] KBR: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T19:31:32.259031] [INFO ] [REMOTE    ] KBR: Full fetch complete (70045 records).
[2025-10-24T19:31:32.259152] [DEBUG] [VALIDATOR ] KBR: Validating primary data.
[2025-10-24T19:31:32.666256] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present.
[2025-10-24T19:31:32.666340] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed.
[2025-10-24T19:31:32.667433] [INFO ] [MAIN      ] KBR: Fetched primary data is valid.
[2025-10-24T19:31:32.667496] [DEBUG] [LOCAL     ] KBR: Saving primary data.
[2025-10-24T19:31:32.668083] [FATAL] [LOCAL     ] KBR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:31:32.668190] [FATAL] [MAIN      ] KBR: Failed to save primary data.
[2025-10-24T19:31:32.668232] [WARN ] [MAIN      ] KBR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:31:32.668268] [INFO ] [LOCAL     ] KBR: Starting deletion of primary data.
[2025-10-24T19:31:32.668341] [DEBUG] [LOCAL     ] KBR: No primary data file found to delete.
[2025-10-24T19:31:32.668396] [INFO ] [LOCAL     ] KBR: Starting deletion of derivative data.
[2025-10-24T19:31:32.668752] [DEBUG] [LOCAL     ] KBR: Deleted derivative data file.
[2025-10-24T19:31:32.669207] [INFO ] [MAIN      ] Update Progress: 1177/2366 symbols completed. KBR took 25.0s. Estimated remaining: 2h 33m 2s. Rate: 7.8 symbols/min
[2025-10-24T19:31:32.853628] [INFO ] [MAIN      ] KEN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:31:32.861980] [DEBUG] [LOCAL     ] KEN: Loaded 4616 existing records from primary storage.
[2025-10-24T19:31:32.862229] [INFO ] [MAIN      ] KEN: Loaded 4616 existing records.
[2025-10-24T19:31:32.949252] [INFO ] [REMOTE    ] KBDC: Fetching primary data for 2025-10.
[2025-10-24T19:31:33.087512] [WARN ] [MAIN      ] KEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:31:33.089744] [INFO ] [MAIN      ] KEN: Wiping existing primary data before full refresh.
[2025-10-24T19:31:33.089606] [INFO ] [REMOTE    ] KD: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T19:31:33.099850] [INFO ] [LOCAL     ] KEN: Starting deletion of primary data.
[2025-10-24T19:31:33.100399] [DEBUG] [LOCAL     ] KEN: Deleted primary data file.
[2025-10-24T19:31:33.100457] [INFO ] [MAIN      ] KEN: Starting full primary refresh.
[2025-10-24T19:31:33.491014] [INFO ] [REMOTE    ] KEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:31:33.521081] [INFO ] [REMOTE    ] KBH: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T19:31:33.747622] [INFO ] [REMOTE    ] KEN: Fetching primary data for 2025-01.
[2025-10-24T19:31:34.176720] [INFO ] [REMOTE    ] KBDC: Incremental fetch complete for 2025-10 (1.23 seconds).
[2025-10-24T19:31:34.182552] [INFO ] [REMOTE    ] KBDC: Full fetch complete (31038 records).
[2025-10-24T19:31:34.182630] [DEBUG] [VALIDATOR ] KBDC: Validating primary data.
[2025-10-24T19:31:34.288744] [INFO ] [REMOTE    ] KEN: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T19:31:34.550309] [INFO ] [REMOTE    ] KEN: Fetching primary data for 2025-02.
[2025-10-24T19:31:34.561732] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present.
[2025-10-24T19:31:34.561946] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed.
[2025-10-24T19:31:34.563246] [INFO ] [MAIN      ] KBDC: Fetched primary data is valid.
[2025-10-24T19:31:34.563311] [DEBUG] [LOCAL     ] KBDC: Saving primary data.
[2025-10-24T19:31:34.563688] [FATAL] [LOCAL     ] KBDC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:31:34.563889] [FATAL] [MAIN      ] KBDC: Failed to save primary data.
[2025-10-24T19:31:34.563972] [WARN ] [MAIN      ] KBDC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:31:34.564060] [INFO ] [LOCAL     ] KBDC: Starting deletion of primary data.
[2025-10-24T19:31:34.564139] [DEBUG] [LOCAL     ] KBDC: No primary data file found to delete.
[2025-10-24T19:31:34.564182] [INFO ] [LOCAL     ] KBDC: Starting deletion of derivative data.
[2025-10-24T19:31:34.564318] [DEBUG] [LOCAL     ] KBDC: Deleted derivative data file.
[2025-10-24T19:31:34.564392] [INFO ] [MAIN      ] Update Progress: 1178/2366 symbols completed. KBDC took 37.9s. Estimated remaining: 2h 32m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:31:34.736381] [INFO ] [MAIN      ] KEP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:31:34.769445] [DEBUG] [LOCAL     ] KEP: Loaded 32795 existing records from primary storage.
[2025-10-24T19:31:34.769785] [INFO ] [MAIN      ] KEP: Loaded 32795 existing records.
[2025-10-24T19:31:34.951779] [WARN ] [MAIN      ] KEP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:31:34.951989] [INFO ] [MAIN      ] KEP: Wiping existing primary data before full refresh.
[2025-10-24T19:31:34.952051] [INFO ] [LOCAL     ] KEP: Starting deletion of primary data.
[2025-10-24T19:31:34.952407] [DEBUG] [LOCAL     ] KEP: Deleted primary data file.
[2025-10-24T19:31:34.952462] [INFO ] [MAIN      ] KEP: Starting full primary refresh.
[2025-10-24T19:31:35.132454] [INFO ] [REMOTE    ] KEN: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T19:31:35.315174] [INFO ] [REMOTE    ] KEP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:31:35.347617] [INFO ] [REMOTE    ] KBH: Fetching primary data for 2025-10.
[2025-10-24T19:31:36.147675] [INFO ] [REMOTE    ] KD: Fetching primary data for 2025-06.
[2025-10-24T19:31:36.947708] [INFO ] [REMOTE    ] KEP: Fetching primary data for 2025-01.
[2025-10-24T19:31:37.121069] [INFO ] [REMOTE    ] KBH: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T19:31:37.130258] [INFO ] [REMOTE    ] KBH: Full fetch complete (71065 records).
[2025-10-24T19:31:37.130435] [DEBUG] [VALIDATOR ] KBH: Validating primary data.
[2025-10-24T19:31:37.544897] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present.
[2025-10-24T19:31:37.545029] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed.
[2025-10-24T19:31:37.546045] [INFO ] [MAIN      ] KBH: Fetched primary data is valid.
[2025-10-24T19:31:37.546155] [DEBUG] [LOCAL     ] KBH: Saving primary data.
[2025-10-24T19:31:37.546851] [FATAL] [LOCAL     ] KBH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:31:37.546933] [FATAL] [MAIN      ] KBH: Failed to save primary data.
[2025-10-24T19:31:37.546975] [WARN ] [MAIN      ] KBH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:31:37.547033] [INFO ] [LOCAL     ] KBH: Starting deletion of primary data.
[2025-10-24T19:31:37.547092] [DEBUG] [LOCAL     ] KBH: No primary data file found to delete.
[2025-10-24T19:31:37.547127] [INFO ] [LOCAL     ] KBH: Starting deletion of derivative data.
[2025-10-24T19:31:37.547271] [DEBUG] [LOCAL     ] KBH: Deleted derivative data file.
[2025-10-24T19:31:37.547541] [INFO ] [MAIN      ] Update Progress: 1179/2366 symbols completed. KBH took 37.9s. Estimated remaining: 2h 32m 36s. Rate: 7.8 symbols/min
[2025-10-24T19:31:37.720081] [INFO ] [MAIN      ] KEX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:31:37.748947] [INFO ] [REMOTE    ] KEN: Fetching primary data for 2025-03.
[2025-10-24T19:31:37.752932] [INFO ] [REMOTE    ] KD: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T19:31:37.797617] [DEBUG] [LOCAL     ] KEX: Loaded 39000 existing records from primary storage.
[2025-10-24T19:31:37.797957] [INFO ] [MAIN      ] KEX: Loaded 39000 existing records.
[2025-10-24T19:31:37.993854] [WARN ] [MAIN      ] KEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:31:37.994315] [INFO ] [MAIN      ] KEX: Wiping existing primary data before full refresh.
[2025-10-24T19:31:38.008143] [INFO ] [LOCAL     ] KEX: Starting deletion of primary data.
[2025-10-24T19:31:38.009548] [DEBUG] [LOCAL     ] KEX: Deleted primary data file.
[2025-10-24T19:31:38.009482] [INFO ] [REMOTE    ] KEP: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T19:31:38.009826] [INFO ] [MAIN      ] KEX: Starting full primary refresh.
[2025-10-24T19:31:38.314975] [INFO ] [REMOTE    ] KEN: Incremental fetch complete for 2025-03 (0.57 seconds).
[2025-10-24T19:31:38.391737] [INFO ] [REMOTE    ] KEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:31:38.547636] [INFO ] [REMOTE    ] KEX: Fetching primary data for 2025-01.
[2025-10-24T19:31:39.347667] [INFO ] [REMOTE    ] KEP: Fetching primary data for 2025-02.
[2025-10-24T19:31:39.779470] [INFO ] [REMOTE    ] KEX: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T19:31:40.147736] [INFO ] [REMOTE    ] KD: Fetching primary data for 2025-07.
[2025-10-24T19:31:40.368394] [INFO ] [REMOTE    ] KEP: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T19:31:40.947684] [INFO ] [REMOTE    ] KEN: Fetching primary data for 2025-04.
[2025-10-24T19:31:41.542880] [INFO ] [REMOTE    ] KEN: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T19:31:41.747710] [INFO ] [REMOTE    ] KEN: Fetching primary data for 2025-05.
[2025-10-24T19:31:41.849573] [INFO ] [REMOTE    ] KD: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T19:31:42.331824] [INFO ] [REMOTE    ] KEN: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T19:31:42.547677] [INFO ] [REMOTE    ] KEX: Fetching primary data for 2025-02.
[2025-10-24T19:31:43.347668] [INFO ] [REMOTE    ] KEP: Fetching primary data for 2025-03.
[2025-10-24T19:31:43.891687] [INFO ] [REMOTE    ] KEX: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T19:31:44.147684] [INFO ] [REMOTE    ] KEX: Fetching primary data for 2025-03.
[2025-10-24T19:31:44.341808] [INFO ] [REMOTE    ] KEP: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T19:31:44.947630] [INFO ] [REMOTE    ] KD: Fetching primary data for 2025-08.
[2025-10-24T19:31:45.507766] [INFO ] [REMOTE    ] KEX: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T19:31:45.747634] [INFO ] [REMOTE    ] KEN: Fetching primary data for 2025-06.
[2025-10-24T19:31:46.505683] [INFO ] [REMOTE    ] KEN: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T19:31:46.547601] [INFO ] [REMOTE    ] KEN: Fetching primary data for 2025-07.
[2025-10-24T19:31:46.659661] [INFO ] [REMOTE    ] KD: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T19:31:47.169536] [INFO ] [REMOTE    ] KEN: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T19:31:47.347685] [INFO ] [REMOTE    ] KEX: Fetching primary data for 2025-04.
[2025-10-24T19:31:48.147719] [INFO ] [REMOTE    ] KEP: Fetching primary data for 2025-04.
[2025-10-24T19:31:48.767177] [INFO ] [REMOTE    ] KEX: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T19:31:48.947607] [INFO ] [REMOTE    ] KEN: Fetching primary data for 2025-08.
[2025-10-24T19:31:49.422876] [INFO ] [REMOTE    ] KEP: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T19:31:49.503669] [INFO ] [REMOTE    ] KEN: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T19:31:49.747665] [INFO ] [REMOTE    ] KEN: Fetching primary data for 2025-09.
[2025-10-24T19:31:50.285004] [INFO ] [REMOTE    ] KEN: Incremental fetch complete for 2025-09 (0.54 seconds).
[2025-10-24T19:31:50.547669] [INFO ] [REMOTE    ] KEX: Fetching primary data for 2025-05.
[2025-10-24T19:31:51.347711] [INFO ] [REMOTE    ] KD: Fetching primary data for 2025-09.
[2025-10-24T19:31:51.933612] [INFO ] [REMOTE    ] KEX: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T19:31:52.147675] [INFO ] [REMOTE    ] KEX: Fetching primary data for 2025-06.
[2025-10-24T19:31:52.947608] [INFO ] [REMOTE    ] KEN: Fetching primary data for 2025-10.
[2025-10-24T19:31:53.014917] [INFO ] [REMOTE    ] KD: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T19:31:53.413918] [INFO ] [REMOTE    ] KEX: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T19:31:53.540928] [INFO ] [REMOTE    ] KEN: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T19:31:53.541938] [INFO ] [REMOTE    ] KEN: Full fetch complete (5834 records).
[2025-10-24T19:31:53.542006] [DEBUG] [VALIDATOR ] KEN: Validating primary data.
[2025-10-24T19:31:53.752732] [INFO ] [REMOTE    ] KEP: Fetching primary data for 2025-05.
[2025-10-24T19:31:53.902946] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present.
[2025-10-24T19:31:53.903023] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed.
[2025-10-24T19:31:53.903184] [INFO ] [MAIN      ] KEN: Fetched primary data is valid.
[2025-10-24T19:31:53.903223] [DEBUG] [LOCAL     ] KEN: Saving primary data.
[2025-10-24T19:31:53.903427] [FATAL] [LOCAL     ] KEN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:31:53.903512] [FATAL] [MAIN      ] KEN: Failed to save primary data.
[2025-10-24T19:31:53.903554] [WARN ] [MAIN      ] KEN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:31:53.903587] [INFO ] [LOCAL     ] KEN: Starting deletion of primary data.
[2025-10-24T19:31:53.903635] [DEBUG] [LOCAL     ] KEN: No primary data file found to delete.
[2025-10-24T19:31:53.903710] [INFO ] [LOCAL     ] KEN: Starting deletion of derivative data.
[2025-10-24T19:31:53.903877] [DEBUG] [LOCAL     ] KEN: Deleted derivative data file.
[2025-10-24T19:31:53.903964] [INFO ] [MAIN      ] Update Progress: 1180/2366 symbols completed. KEN took 21.2s. Estimated remaining: 2h 32m 37s. Rate: 7.8 symbols/min
[2025-10-24T19:31:54.073196] [INFO ] [MAIN      ] KEY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:31:54.073344] [DEBUG] [LOCAL     ] KEY: No existing data file found in primary storage.
[2025-10-24T19:31:54.073380] [WARN ] [MAIN      ] KEY: No existing data found, performing full refresh instead.
[2025-10-24T19:31:54.073486] [INFO ] [MAIN      ] KEY: Wiping existing primary data before full refresh.
[2025-10-24T19:31:54.073526] [INFO ] [LOCAL     ] KEY: Starting deletion of primary data.
[2025-10-24T19:31:54.073566] [DEBUG] [LOCAL     ] KEY: No primary data file found to delete.
[2025-10-24T19:31:54.073598] [INFO ] [MAIN      ] KEY: Starting full primary refresh.
[2025-10-24T19:31:54.424064] [INFO ] [REMOTE    ] KEY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:31:54.547668] [INFO ] [REMOTE    ] KEY: Fetching primary data for 2025-01.
[2025-10-24T19:31:55.058989] [INFO ] [REMOTE    ] KEP: Incremental fetch complete for 2025-05 (1.31 seconds).
[2025-10-24T19:31:55.347699] [INFO ] [REMOTE    ] KD: Fetching primary data for 2025-10.
[2025-10-24T19:31:56.047957] [INFO ] [REMOTE    ] KEY: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T19:31:56.147705] [INFO ] [REMOTE    ] KEY: Fetching primary data for 2025-02.
[2025-10-24T19:31:56.952881] [INFO ] [REMOTE    ] KEP: Fetching primary data for 2025-06.
[2025-10-24T19:31:56.964511] [INFO ] [REMOTE    ] KD: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T19:31:56.974360] [INFO ] [REMOTE    ] KD: Full fetch complete (76084 records).
[2025-10-24T19:31:56.974474] [DEBUG] [VALIDATOR ] KD: Validating primary data.
[2025-10-24T19:31:57.373323] [DEBUG] [VALIDATOR ] KD: All expected trading days are present.
[2025-10-24T19:31:57.373392] [DEBUG] [VALIDATOR ] KD: Primary data validation passed.
[2025-10-24T19:31:57.374433] [INFO ] [MAIN      ] KD: Fetched primary data is valid.
[2025-10-24T19:31:57.374494] [DEBUG] [LOCAL     ] KD: Saving primary data.
[2025-10-24T19:31:57.375088] [FATAL] [LOCAL     ] KD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:31:57.375175] [FATAL] [MAIN      ] KD: Failed to save primary data.
[2025-10-24T19:31:57.375216] [WARN ] [MAIN      ] KD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:31:57.375250] [INFO ] [LOCAL     ] KD: Starting deletion of primary data.
[2025-10-24T19:31:57.375302] [DEBUG] [LOCAL     ] KD: No primary data file found to delete.
[2025-10-24T19:31:57.375338] [INFO ] [LOCAL     ] KD: Starting deletion of derivative data.
[2025-10-24T19:31:57.375448] [DEBUG] [LOCAL     ] KD: Deleted derivative data file.
[2025-10-24T19:31:57.376054] [INFO ] [MAIN      ] Update Progress: 1181/2366 symbols completed. KD took 39.7s. Estimated remaining: 2h 32m 25s. Rate: 7.8 symbols/min
[2025-10-24T19:31:57.547627] [INFO ] [MAIN      ] KEYS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:31:57.591720] [DEBUG] [LOCAL     ] KEYS: Loaded 43425 existing records from primary storage.
[2025-10-24T19:31:57.592081] [INFO ] [MAIN      ] KEYS: Loaded 43425 existing records.
[2025-10-24T19:31:57.749040] [INFO ] [REMOTE    ] KEX: Fetching primary data for 2025-07.
[2025-10-24T19:31:57.778514] [WARN ] [MAIN      ] KEYS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:31:57.778911] [INFO ] [MAIN      ] KEYS: Wiping existing primary data before full refresh.
[2025-10-24T19:31:57.779017] [INFO ] [LOCAL     ] KEYS: Starting deletion of primary data.
[2025-10-24T19:31:57.780356] [DEBUG] [LOCAL     ] KEYS: Deleted primary data file.
[2025-10-24T19:31:57.780413] [INFO ] [MAIN      ] KEYS: Starting full primary refresh.
[2025-10-24T19:31:57.971403] [INFO ] [REMOTE    ] KEY: Incremental fetch complete for 2025-02 (1.82 seconds).
[2025-10-24T19:31:58.185662] [INFO ] [REMOTE    ] KEYS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:31:58.355680] [INFO ] [REMOTE    ] KEP: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T19:31:58.547742] [INFO ] [REMOTE    ] KEYS: Fetching primary data for 2025-01.
[2025-10-24T19:31:58.659503] [INFO ] [REMOTE    ] KEX: Incremental fetch complete for 2025-07 (0.91 seconds).
[2025-10-24T19:31:59.347724] [INFO ] [REMOTE    ] KEX: Fetching primary data for 2025-08.
[2025-10-24T19:32:00.045714] [INFO ] [REMOTE    ] KEYS: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T19:32:00.147605] [INFO ] [REMOTE    ] KEYS: Fetching primary data for 2025-02.
[2025-10-24T19:32:00.651163] [INFO ] [REMOTE    ] KEX: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T19:32:00.947671] [INFO ] [REMOTE    ] KEP: Fetching primary data for 2025-07.
[2025-10-24T19:32:01.381530] [INFO ] [REMOTE    ] KEYS: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T19:32:01.747628] [INFO ] [REMOTE    ] KEY: Fetching primary data for 2025-03.
[2025-10-24T19:32:02.547609] [INFO ] [REMOTE    ] KEX: Fetching primary data for 2025-09.
[2025-10-24T19:32:02.598878] [INFO ] [REMOTE    ] KEP: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T19:32:03.347698] [INFO ] [REMOTE    ] KEP: Fetching primary data for 2025-08.
[2025-10-24T19:32:03.662401] [INFO ] [REMOTE    ] KEY: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T19:32:04.147628] [INFO ] [REMOTE    ] KEY: Fetching primary data for 2025-04.
[2025-10-24T19:32:04.192849] [INFO ] [REMOTE    ] KEX: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T19:32:04.781189] [INFO ] [REMOTE    ] KEP: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T19:32:04.947635] [INFO ] [REMOTE    ] KEYS: Fetching primary data for 2025-03.
[2025-10-24T19:32:05.747618] [INFO ] [REMOTE    ] KEP: Fetching primary data for 2025-09.
[2025-10-24T19:32:06.263862] [INFO ] [REMOTE    ] KEY: Incremental fetch complete for 2025-04 (2.12 seconds).
[2025-10-24T19:32:06.547729] [INFO ] [REMOTE    ] KEX: Fetching primary data for 2025-10.
[2025-10-24T19:32:07.347720] [INFO ] [REMOTE    ] KEY: Fetching primary data for 2025-05.
[2025-10-24T19:32:07.460223] [INFO ] [REMOTE    ] KEP: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T19:32:07.908254] [INFO ] [REMOTE    ] KEX: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T19:32:07.916181] [INFO ] [REMOTE    ] KEX: Full fetch complete (56082 records).
[2025-10-24T19:32:07.916304] [DEBUG] [VALIDATOR ] KEX: Validating primary data.
[2025-10-24T19:32:08.156151] [INFO ] [REMOTE    ] KEP: Fetching primary data for 2025-10.
[2025-10-24T19:32:08.206600] [INFO ] [REMOTE    ] KEYS: Incremental fetch complete for 2025-03 (3.26 seconds).
[2025-10-24T19:32:08.342993] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present.
[2025-10-24T19:32:08.343123] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed.
[2025-10-24T19:32:08.344041] [INFO ] [MAIN      ] KEX: Fetched primary data is valid.
[2025-10-24T19:32:08.344102] [DEBUG] [LOCAL     ] KEX: Saving primary data.
[2025-10-24T19:32:08.344593] [FATAL] [LOCAL     ] KEX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:32:08.344700] [FATAL] [MAIN      ] KEX: Failed to save primary data.
[2025-10-24T19:32:08.344775] [WARN ] [MAIN      ] KEX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:32:08.344842] [INFO ] [LOCAL     ] KEX: Starting deletion of primary data.
[2025-10-24T19:32:08.344901] [DEBUG] [LOCAL     ] KEX: No primary data file found to delete.
[2025-10-24T19:32:08.344937] [INFO ] [LOCAL     ] KEX: Starting deletion of derivative data.
[2025-10-24T19:32:08.345078] [DEBUG] [LOCAL     ] KEX: Deleted derivative data file.
[2025-10-24T19:32:08.345443] [INFO ] [MAIN      ] Update Progress: 1182/2366 symbols completed. KEX took 30.8s. Estimated remaining: 2h 32m 21s. Rate: 7.8 symbols/min
[2025-10-24T19:32:08.512396] [INFO ] [MAIN      ] KF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:32:08.517070] [DEBUG] [LOCAL     ] KF: Loaded 2362 existing records from primary storage.
[2025-10-24T19:32:08.517273] [INFO ] [MAIN      ] KF: Loaded 2362 existing records.
[2025-10-24T19:32:08.698927] [WARN ] [MAIN      ] KF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:32:08.699145] [INFO ] [MAIN      ] KF: Wiping existing primary data before full refresh.
[2025-10-24T19:32:08.699228] [INFO ] [LOCAL     ] KF: Starting deletion of primary data.
[2025-10-24T19:32:08.699365] [DEBUG] [LOCAL     ] KF: Deleted primary data file.
[2025-10-24T19:32:08.699403] [INFO ] [MAIN      ] KF: Starting full primary refresh.
[2025-10-24T19:32:08.948009] [INFO ] [REMOTE    ] KEYS: Fetching primary data for 2025-04.
[2025-10-24T19:32:09.067753] [INFO ] [REMOTE    ] KF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:32:09.429361] [INFO ] [REMOTE    ] KEY: Incremental fetch complete for 2025-05 (2.08 seconds).
[2025-10-24T19:32:09.750276] [INFO ] [REMOTE    ] KEY: Fetching primary data for 2025-06.
[2025-10-24T19:32:09.754958] [INFO ] [REMOTE    ] KEP: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T19:32:09.762104] [INFO ] [REMOTE    ] KEP: Full fetch complete (42462 records).
[2025-10-24T19:32:09.762260] [DEBUG] [VALIDATOR ] KEP: Validating primary data.
[2025-10-24T19:32:10.154945] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present.
[2025-10-24T19:32:10.155118] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed.
[2025-10-24T19:32:10.156086] [INFO ] [MAIN      ] KEP: Fetched primary data is valid.
[2025-10-24T19:32:10.156152] [DEBUG] [LOCAL     ] KEP: Saving primary data.
[2025-10-24T19:32:10.156718] [FATAL] [LOCAL     ] KEP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:32:10.156805] [FATAL] [MAIN      ] KEP: Failed to save primary data.
[2025-10-24T19:32:10.156847] [WARN ] [MAIN      ] KEP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:32:10.156909] [INFO ] [LOCAL     ] KEP: Starting deletion of primary data.
[2025-10-24T19:32:10.156971] [DEBUG] [LOCAL     ] KEP: No primary data file found to delete.
[2025-10-24T19:32:10.157007] [INFO ] [LOCAL     ] KEP: Starting deletion of derivative data.
[2025-10-24T19:32:10.157162] [DEBUG] [LOCAL     ] KEP: Deleted derivative data file.
[2025-10-24T19:32:10.157304] [INFO ] [MAIN      ] Update Progress: 1183/2366 symbols completed. KEP took 35.6s. Estimated remaining: 2h 32m 7s. Rate: 7.8 symbols/min
[2025-10-24T19:32:10.333218] [INFO ] [MAIN      ] KFRC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:32:10.354607] [DEBUG] [LOCAL     ] KFRC: Loaded 21004 existing records from primary storage.
[2025-10-24T19:32:10.354871] [INFO ] [MAIN      ] KFRC: Loaded 21004 existing records.
[2025-10-24T19:32:10.534076] [WARN ] [MAIN      ] KFRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:32:10.534332] [INFO ] [MAIN      ] KFRC: Wiping existing primary data before full refresh.
[2025-10-24T19:32:10.534466] [INFO ] [LOCAL     ] KFRC: Starting deletion of primary data.
[2025-10-24T19:32:10.534870] [DEBUG] [LOCAL     ] KFRC: Deleted primary data file.
[2025-10-24T19:32:10.534964] [INFO ] [MAIN      ] KFRC: Starting full primary refresh.
[2025-10-24T19:32:10.557082] [INFO ] [REMOTE    ] KF: Fetching primary data for 2025-01.
[2025-10-24T19:32:10.747415] [INFO ] [REMOTE    ] KEYS: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T19:32:10.949266] [INFO ] [REMOTE    ] KFRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:32:10.976557] [INFO ] [REMOTE    ] KF: Incremental fetch complete for 2025-01 (0.42 seconds).
[2025-10-24T19:32:11.347686] [INFO ] [REMOTE    ] KFRC: Fetching primary data for 2025-01.
[2025-10-24T19:32:11.557640] [INFO ] [REMOTE    ] KEY: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T19:32:11.839177] [INFO ] [REMOTE    ] KFRC: Incremental fetch complete for 2025-01 (0.49 seconds).
[2025-10-24T19:32:12.147636] [INFO ] [REMOTE    ] KFRC: Fetching primary data for 2025-02.
[2025-10-24T19:32:12.737607] [INFO ] [REMOTE    ] KFRC: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T19:32:12.947673] [INFO ] [REMOTE    ] KEYS: Fetching primary data for 2025-05.
[2025-10-24T19:32:13.747740] [INFO ] [REMOTE    ] KFRC: Fetching primary data for 2025-03.
[2025-10-24T19:32:14.549024] [INFO ] [REMOTE    ] KEY: Fetching primary data for 2025-07.
[2025-10-24T19:32:14.557252] [INFO ] [REMOTE    ] KEYS: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T19:32:15.056235] [INFO ] [REMOTE    ] KFRC: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T19:32:15.347726] [INFO ] [REMOTE    ] KEYS: Fetching primary data for 2025-06.
[2025-10-24T19:32:16.147711] [INFO ] [REMOTE    ] KFRC: Fetching primary data for 2025-04.
[2025-10-24T19:32:16.628271] [INFO ] [REMOTE    ] KEY: Incremental fetch complete for 2025-07 (2.08 seconds).
[2025-10-24T19:32:16.931998] [INFO ] [REMOTE    ] KEYS: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T19:32:16.947603] [INFO ] [REMOTE    ] KEYS: Fetching primary data for 2025-07.
[2025-10-24T19:32:17.213638] [INFO ] [REMOTE    ] KFRC: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T19:32:17.747725] [INFO ] [REMOTE    ] KFRC: Fetching primary data for 2025-05.
[2025-10-24T19:32:18.477027] [INFO ] [REMOTE    ] KEYS: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T19:32:18.547626] [INFO ] [REMOTE    ] KEYS: Fetching primary data for 2025-08.
[2025-10-24T19:32:18.690977] [INFO ] [REMOTE    ] KFRC: Incremental fetch complete for 2025-05 (0.94 seconds).
[2025-10-24T19:32:19.347749] [INFO ] [REMOTE    ] KFRC: Fetching primary data for 2025-06.
[2025-10-24T19:32:20.147707] [INFO ] [REMOTE    ] KEY: Fetching primary data for 2025-08.
[2025-10-24T19:32:20.186402] [INFO ] [REMOTE    ] KFRC: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T19:32:20.343129] [INFO ] [REMOTE    ] KEYS: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T19:32:20.947673] [INFO ] [REMOTE    ] KF: Fetching primary data for 2025-02.
[2025-10-24T19:32:21.421332] [INFO ] [REMOTE    ] KF: Incremental fetch complete for 2025-02 (0.47 seconds).
[2025-10-24T19:32:21.747685] [INFO ] [REMOTE    ] KF: Fetching primary data for 2025-03.
[2025-10-24T19:32:21.997909] [INFO ] [REMOTE    ] KEY: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T19:32:22.547683] [INFO ] [REMOTE    ] KEY: Fetching primary data for 2025-09.
[2025-10-24T19:32:22.599994] [INFO ] [REMOTE    ] KF: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T19:32:23.347636] [INFO ] [REMOTE    ] KF: Fetching primary data for 2025-04.
[2025-10-24T19:32:23.770437] [INFO ] [REMOTE    ] KF: Incremental fetch complete for 2025-04 (0.42 seconds).
[2025-10-24T19:32:24.147705] [INFO ] [REMOTE    ] KF: Fetching primary data for 2025-05.
[2025-10-24T19:32:24.319990] [INFO ] [REMOTE    ] KEY: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T19:32:24.697532] [INFO ] [REMOTE    ] KF: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T19:32:24.947702] [INFO ] [REMOTE    ] KEYS: Fetching primary data for 2025-09.
[2025-10-24T19:32:25.747670] [INFO ] [REMOTE    ] KFRC: Fetching primary data for 2025-07.
[2025-10-24T19:32:26.478887] [INFO ] [REMOTE    ] KEYS: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T19:32:26.547597] [INFO ] [REMOTE    ] KEYS: Fetching primary data for 2025-10.
[2025-10-24T19:32:27.322485] [INFO ] [REMOTE    ] KFRC: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T19:32:27.347598] [INFO ] [REMOTE    ] KFRC: Fetching primary data for 2025-08.
[2025-10-24T19:32:28.147719] [INFO ] [REMOTE    ] KF: Fetching primary data for 2025-06.
[2025-10-24T19:32:28.256573] [INFO ] [REMOTE    ] KEYS: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T19:32:28.264636] [INFO ] [REMOTE    ] KEYS: Full fetch complete (63055 records).
[2025-10-24T19:32:28.264812] [DEBUG] [VALIDATOR ] KEYS: Validating primary data.
[2025-10-24T19:32:28.565073] [INFO ] [REMOTE    ] KF: Incremental fetch complete for 2025-06 (0.42 seconds).
[2025-10-24T19:32:28.681251] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present.
[2025-10-24T19:32:28.682137] [INFO ] [REMOTE    ] KFRC: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T19:32:28.682319] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed.
[2025-10-24T19:32:28.689050] [INFO ] [MAIN      ] KEYS: Fetched primary data is valid.
[2025-10-24T19:32:28.689134] [DEBUG] [LOCAL     ] KEYS: Saving primary data.
[2025-10-24T19:32:28.689785] [FATAL] [LOCAL     ] KEYS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:32:28.689878] [FATAL] [MAIN      ] KEYS: Failed to save primary data.
[2025-10-24T19:32:28.689920] [WARN ] [MAIN      ] KEYS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:32:28.689954] [INFO ] [LOCAL     ] KEYS: Starting deletion of primary data.
[2025-10-24T19:32:28.690004] [DEBUG] [LOCAL     ] KEYS: No primary data file found to delete.
[2025-10-24T19:32:28.690038] [INFO ] [LOCAL     ] KEYS: Starting deletion of derivative data.
[2025-10-24T19:32:28.690209] [DEBUG] [LOCAL     ] KEYS: Deleted derivative data file.
[2025-10-24T19:32:28.690629] [INFO ] [MAIN      ] Update Progress: 1184/2366 symbols completed. KEYS took 31.3s. Estimated remaining: 2h 32m 10s. Rate: 7.8 symbols/min
[2025-10-24T19:32:28.856444] [INFO ] [MAIN      ] KFS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:32:28.867787] [DEBUG] [LOCAL     ] KFS: Loaded 8762 existing records from primary storage.
[2025-10-24T19:32:28.867997] [INFO ] [MAIN      ] KFS: Loaded 8762 existing records.
[2025-10-24T19:32:28.952843] [INFO ] [REMOTE    ] KFRC: Fetching primary data for 2025-09.
[2025-10-24T19:32:29.042930] [WARN ] [MAIN      ] KFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:32:29.043116] [INFO ] [MAIN      ] KFS: Wiping existing primary data before full refresh.
[2025-10-24T19:32:29.043161] [INFO ] [LOCAL     ] KFS: Starting deletion of primary data.
[2025-10-24T19:32:29.043349] [DEBUG] [LOCAL     ] KFS: Deleted primary data file.
[2025-10-24T19:32:29.043404] [INFO ] [MAIN      ] KFS: Starting full primary refresh.
[2025-10-24T19:32:29.391553] [INFO ] [REMOTE    ] KFS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:32:29.747626] [INFO ] [REMOTE    ] KFS: Fetching primary data for 2025-01.
[2025-10-24T19:32:30.157287] [INFO ] [REMOTE    ] KFRC: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T19:32:30.411022] [INFO ] [REMOTE    ] KFS: Incremental fetch complete for 2025-01 (0.66 seconds).
[2025-10-24T19:32:30.547681] [INFO ] [REMOTE    ] KFS: Fetching primary data for 2025-02.
[2025-10-24T19:32:31.159229] [INFO ] [REMOTE    ] KFS: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T19:32:31.347608] [INFO ] [REMOTE    ] KEY: Fetching primary data for 2025-10.
[2025-10-24T19:32:32.147668] [INFO ] [REMOTE    ] KFRC: Fetching primary data for 2025-10.
[2025-10-24T19:32:32.947691] [INFO ] [REMOTE    ] KFS: Fetching primary data for 2025-03.
[2025-10-24T19:32:33.122096] [INFO ] [REMOTE    ] KFRC: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T19:32:33.126738] [INFO ] [REMOTE    ] KFRC: Full fetch complete (27202 records).
[2025-10-24T19:32:33.126811] [DEBUG] [VALIDATOR ] KFRC: Validating primary data.
[2025-10-24T19:32:33.497065] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present.
[2025-10-24T19:32:33.497167] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed.
[2025-10-24T19:32:33.497820] [INFO ] [MAIN      ] KFRC: Fetched primary data is valid.
[2025-10-24T19:32:33.497898] [DEBUG] [LOCAL     ] KFRC: Saving primary data.
[2025-10-24T19:32:33.498248] [FATAL] [LOCAL     ] KFRC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:32:33.498350] [FATAL] [MAIN      ] KFRC: Failed to save primary data.
[2025-10-24T19:32:33.498416] [WARN ] [MAIN      ] KFRC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:32:33.498564] [INFO ] [LOCAL     ] KFRC: Starting deletion of primary data.
[2025-10-24T19:32:33.498638] [DEBUG] [LOCAL     ] KFRC: No primary data file found to delete.
[2025-10-24T19:32:33.498724] [INFO ] [LOCAL     ] KFRC: Starting deletion of derivative data.
[2025-10-24T19:32:33.498851] [DEBUG] [LOCAL     ] KFRC: Deleted derivative data file.
[2025-10-24T19:32:33.498925] [INFO ] [MAIN      ] Update Progress: 1185/2366 symbols completed. KFRC took 23.3s. Estimated remaining: 2h 31m 60s. Rate: 7.8 symbols/min
[2025-10-24T19:32:33.663736] [INFO ] [REMOTE    ] KEY: Incremental fetch complete for 2025-10 (2.32 seconds).
[2025-10-24T19:32:33.703916] [INFO ] [MAIN      ] KFY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:32:33.704092] [INFO ] [REMOTE    ] KEY: Full fetch complete (77427 records).
[2025-10-24T19:32:33.704495] [DEBUG] [VALIDATOR ] KEY: Validating primary data.
[2025-10-24T19:32:33.758771] [INFO ] [REMOTE    ] KF: Fetching primary data for 2025-07.
[2025-10-24T19:32:33.880683] [INFO ] [REMOTE    ] KFS: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T19:32:33.922032] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T19:32:33.925807] [FATAL] [MAIN      ] KEY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:32:33.925881] [WARN ] [MAIN      ] KEY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:32:33.925941] [INFO ] [LOCAL     ] KEY: Starting deletion of primary data.
[2025-10-24T19:32:33.926917] [DEBUG] [LOCAL     ] KEY: No primary data file found to delete.
[2025-10-24T19:32:33.935573] [INFO ] [LOCAL     ] KEY: Starting deletion of derivative data.
[2025-10-24T19:32:33.935806] [DEBUG] [LOCAL     ] KEY: No derivative data file found to delete.
[2025-10-24T19:32:33.936326] [DEBUG] [LOCAL     ] KFY: Loaded 29699 existing records from primary storage.
[2025-10-24T19:32:33.936904] [INFO ] [MAIN      ] Update Progress: 1186/2366 symbols completed. KEY took 40.0s. Estimated remaining: 2h 31m 45s. Rate: 7.8 symbols/min
[2025-10-24T19:32:33.937036] [INFO ] [MAIN      ] KFY: Loaded 29699 existing records.
[2025-10-24T19:32:34.274227] [INFO ] [REMOTE    ] KF: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T19:32:34.265886] [INFO ] [MAIN      ] KGC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:32:34.309437] [WARN ] [MAIN      ] KFY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:32:34.309747] [INFO ] [MAIN      ] KFY: Wiping existing primary data before full refresh.
[2025-10-24T19:32:34.309809] [INFO ] [LOCAL     ] KFY: Starting deletion of primary data.
[2025-10-24T19:32:34.310185] [DEBUG] [LOCAL     ] KFY: Deleted primary data file.
[2025-10-24T19:32:34.310249] [INFO ] [MAIN      ] KFY: Starting full primary refresh.
[2025-10-24T19:32:34.555222] [INFO ] [REMOTE    ] KF: Fetching primary data for 2025-08.
[2025-10-24T19:32:34.654813] [DEBUG] [LOCAL     ] KGC: Loaded 54089 existing records from primary storage.
[2025-10-24T19:32:34.670380] [INFO ] [MAIN      ] KGC: Loaded 54089 existing records.
[2025-10-24T19:32:34.837602] [INFO ] [REMOTE    ] KFY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:32:34.908054] [WARN ] [MAIN      ] KGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:32:34.908225] [INFO ] [MAIN      ] KGC: Wiping existing primary data before full refresh.
[2025-10-24T19:32:34.908273] [INFO ] [LOCAL     ] KGC: Starting deletion of primary data.
[2025-10-24T19:32:34.908694] [DEBUG] [LOCAL     ] KGC: Deleted primary data file.
[2025-10-24T19:32:34.908752] [INFO ] [MAIN      ] KGC: Starting full primary refresh.
[2025-10-24T19:32:35.002243] [INFO ] [REMOTE    ] KF: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T19:32:35.261478] [INFO ] [REMOTE    ] KGC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:32:35.347627] [INFO ] [REMOTE    ] KFS: Fetching primary data for 2025-04.
[2025-10-24T19:32:36.145733] [INFO ] [REMOTE    ] KFS: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T19:32:36.148035] [INFO ] [REMOTE    ] KFS: Fetching primary data for 2025-05.
[2025-10-24T19:32:36.921406] [INFO ] [REMOTE    ] KFS: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T19:32:36.947625] [INFO ] [REMOTE    ] KFS: Fetching primary data for 2025-06.
[2025-10-24T19:32:37.747710] [INFO ] [REMOTE    ] KF: Fetching primary data for 2025-09.
[2025-10-24T19:32:37.926199] [INFO ] [REMOTE    ] KFS: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T19:32:38.189549] [INFO ] [REMOTE    ] KF: Incremental fetch complete for 2025-09 (0.44 seconds).
[2025-10-24T19:32:38.547723] [INFO ] [REMOTE    ] KGC: Fetching primary data for 2025-01.
[2025-10-24T19:32:39.347709] [INFO ] [REMOTE    ] KFS: Fetching primary data for 2025-07.
[2025-10-24T19:32:40.147953] [INFO ] [REMOTE    ] KFY: Fetching primary data for 2025-01.
[2025-10-24T19:32:40.148299] [INFO ] [REMOTE    ] KFS: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T19:32:40.383353] [INFO ] [REMOTE    ] KGC: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T19:32:40.947627] [INFO ] [REMOTE    ] KGC: Fetching primary data for 2025-02.
[2025-10-24T19:32:41.282869] [INFO ] [REMOTE    ] KFY: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T19:32:41.747613] [INFO ] [REMOTE    ] KF: Fetching primary data for 2025-10.
[2025-10-24T19:32:42.288575] [INFO ] [REMOTE    ] KF: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T19:32:42.289537] [INFO ] [REMOTE    ] KF: Full fetch complete (3420 records).
[2025-10-24T19:32:42.289606] [DEBUG] [VALIDATOR ] KF: Validating primary data.
[2025-10-24T19:32:42.552855] [INFO ] [REMOTE    ] KFY: Fetching primary data for 2025-02.
[2025-10-24T19:32:42.665907] [DEBUG] [VALIDATOR ] KF: All expected trading days are present.
[2025-10-24T19:32:42.666035] [DEBUG] [VALIDATOR ] KF: Primary data validation passed.
[2025-10-24T19:32:42.666329] [INFO ] [MAIN      ] KF: Fetched primary data is valid.
[2025-10-24T19:32:42.666457] [DEBUG] [LOCAL     ] KF: Saving primary data.
[2025-10-24T19:32:42.666794] [FATAL] [LOCAL     ] KF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:32:42.666958] [FATAL] [MAIN      ] KF: Failed to save primary data.
[2025-10-24T19:32:42.667081] [WARN ] [MAIN      ] KF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:32:42.667170] [INFO ] [LOCAL     ] KF: Starting deletion of primary data.
[2025-10-24T19:32:42.667299] [DEBUG] [LOCAL     ] KF: No primary data file found to delete.
[2025-10-24T19:32:42.667453] [INFO ] [LOCAL     ] KF: Starting deletion of derivative data.
[2025-10-24T19:32:42.667761] [DEBUG] [LOCAL     ] KF: Deleted derivative data file.
[2025-10-24T19:32:42.667869] [INFO ] [MAIN      ] Update Progress: 1187/2366 symbols completed. KF took 34.3s. Estimated remaining: 2h 31m 38s. Rate: 7.8 symbols/min
[2025-10-24T19:32:42.811305] [INFO ] [REMOTE    ] KGC: Incremental fetch complete for 2025-02 (1.86 seconds).
[2025-10-24T19:32:42.884101] [INFO ] [MAIN      ] KGS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:32:42.927252] [DEBUG] [LOCAL     ] KGS: Loaded 46358 existing records from primary storage.
[2025-10-24T19:32:42.927532] [INFO ] [MAIN      ] KGS: Loaded 46358 existing records.
[2025-10-24T19:32:43.105375] [WARN ] [MAIN      ] KGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:32:43.105603] [INFO ] [MAIN      ] KGS: Wiping existing primary data before full refresh.
[2025-10-24T19:32:43.105675] [INFO ] [LOCAL     ] KGS: Starting deletion of primary data.
[2025-10-24T19:32:43.106127] [DEBUG] [LOCAL     ] KGS: Deleted primary data file.
[2025-10-24T19:32:43.106184] [INFO ] [MAIN      ] KGS: Starting full primary refresh.
[2025-10-24T19:32:43.355140] [INFO ] [REMOTE    ] KFS: Fetching primary data for 2025-08.
[2025-10-24T19:32:43.461490] [INFO ] [REMOTE    ] KGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:32:43.725631] [INFO ] [REMOTE    ] KFY: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T19:32:44.099406] [INFO ] [REMOTE    ] KFS: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T19:32:44.147622] [INFO ] [REMOTE    ] KGC: Fetching primary data for 2025-03.
[2025-10-24T19:32:44.947771] [INFO ] [REMOTE    ] KFY: Fetching primary data for 2025-03.
[2025-10-24T19:32:45.747635] [INFO ] [REMOTE    ] KFS: Fetching primary data for 2025-09.
[2025-10-24T19:32:46.076082] [INFO ] [REMOTE    ] KGC: Incremental fetch complete for 2025-03 (1.93 seconds).
[2025-10-24T19:32:46.271036] [INFO ] [REMOTE    ] KFS: Incremental fetch complete for 2025-09 (0.52 seconds).
[2025-10-24T19:32:46.296367] [INFO ] [REMOTE    ] KFY: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T19:32:46.547683] [INFO ] [REMOTE    ] KGS: Fetching primary data for 2025-01.
[2025-10-24T19:32:47.347748] [INFO ] [REMOTE    ] KFS: Fetching primary data for 2025-10.
[2025-10-24T19:32:47.990786] [INFO ] [REMOTE    ] KGS: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T19:32:48.147824] [INFO ] [REMOTE    ] KGC: Fetching primary data for 2025-04.
[2025-10-24T19:32:48.151454] [INFO ] [REMOTE    ] KFS: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T19:32:48.153866] [INFO ] [REMOTE    ] KFS: Full fetch complete (11263 records).
[2025-10-24T19:32:48.154007] [DEBUG] [VALIDATOR ] KFS: Validating primary data.
[2025-10-24T19:32:48.510266] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present.
[2025-10-24T19:32:48.510343] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed.
[2025-10-24T19:32:48.510663] [INFO ] [MAIN      ] KFS: Fetched primary data is valid.
[2025-10-24T19:32:48.510746] [DEBUG] [LOCAL     ] KFS: Saving primary data.
[2025-10-24T19:32:48.510958] [FATAL] [LOCAL     ] KFS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:32:48.511035] [FATAL] [MAIN      ] KFS: Failed to save primary data.
[2025-10-24T19:32:48.511075] [WARN ] [MAIN      ] KFS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:32:48.511109] [INFO ] [LOCAL     ] KFS: Starting deletion of primary data.
[2025-10-24T19:32:48.511157] [DEBUG] [LOCAL     ] KFS: No primary data file found to delete.
[2025-10-24T19:32:48.511190] [INFO ] [LOCAL     ] KFS: Starting deletion of derivative data.
[2025-10-24T19:32:48.511374] [DEBUG] [LOCAL     ] KFS: Deleted derivative data file.
[2025-10-24T19:32:48.511461] [INFO ] [MAIN      ] Update Progress: 1188/2366 symbols completed. KFS took 19.8s. Estimated remaining: 2h 31m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:32:48.686633] [INFO ] [MAIN      ] KIM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:32:48.746737] [DEBUG] [LOCAL     ] KIM: Loaded 53384 existing records from primary storage.
[2025-10-24T19:32:48.747215] [INFO ] [MAIN      ] KIM: Loaded 53384 existing records.
[2025-10-24T19:32:48.922756] [WARN ] [MAIN      ] KIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:32:48.923031] [INFO ] [MAIN      ] KIM: Wiping existing primary data before full refresh.
[2025-10-24T19:32:48.923089] [INFO ] [LOCAL     ] KIM: Starting deletion of primary data.
[2025-10-24T19:32:48.923486] [DEBUG] [LOCAL     ] KIM: Deleted primary data file.
[2025-10-24T19:32:48.923543] [INFO ] [MAIN      ] KIM: Starting full primary refresh.
[2025-10-24T19:32:48.956817] [INFO ] [REMOTE    ] KGS: Fetching primary data for 2025-02.
[2025-10-24T19:32:49.291898] [INFO ] [REMOTE    ] KIM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:32:49.747725] [INFO ] [REMOTE    ] KIM: Fetching primary data for 2025-01.
[2025-10-24T19:32:50.182452] [INFO ] [REMOTE    ] KGC: Incremental fetch complete for 2025-04 (2.03 seconds).
[2025-10-24T19:32:50.389892] [INFO ] [REMOTE    ] KGS: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T19:32:50.547608] [INFO ] [REMOTE    ] KGS: Fetching primary data for 2025-03.
[2025-10-24T19:32:51.044682] [INFO ] [REMOTE    ] KIM: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T19:32:51.347699] [INFO ] [REMOTE    ] KFY: Fetching primary data for 2025-04.
[2025-10-24T19:32:52.061687] [INFO ] [REMOTE    ] KGS: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T19:32:52.147598] [INFO ] [REMOTE    ] KGS: Fetching primary data for 2025-04.
[2025-10-24T19:32:52.726270] [INFO ] [REMOTE    ] KFY: Incremental fetch complete for 2025-04 (1.38 seconds).
[2025-10-24T19:32:52.947708] [INFO ] [REMOTE    ] KIM: Fetching primary data for 2025-02.
[2025-10-24T19:32:53.694570] [INFO ] [REMOTE    ] KGS: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T19:32:53.747609] [INFO ] [REMOTE    ] KGS: Fetching primary data for 2025-05.
[2025-10-24T19:32:54.365559] [INFO ] [REMOTE    ] KIM: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T19:32:54.547700] [INFO ] [REMOTE    ] KFY: Fetching primary data for 2025-05.
[2025-10-24T19:32:55.186879] [INFO ] [REMOTE    ] KGS: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T19:32:55.347709] [INFO ] [REMOTE    ] KGC: Fetching primary data for 2025-05.
[2025-10-24T19:32:55.654343] [INFO ] [REMOTE    ] KFY: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T19:32:56.147692] [INFO ] [REMOTE    ] KGS: Fetching primary data for 2025-06.
[2025-10-24T19:32:56.947739] [INFO ] [REMOTE    ] KIM: Fetching primary data for 2025-03.
[2025-10-24T19:32:57.003502] [INFO ] [REMOTE    ] KGC: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T19:32:57.213568] [INFO ] [REMOTE    ] KGS: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T19:32:57.747723] [INFO ] [REMOTE    ] KGC: Fetching primary data for 2025-06.
[2025-10-24T19:32:58.547630] [INFO ] [REMOTE    ] KGS: Fetching primary data for 2025-07.
[2025-10-24T19:32:58.603067] [INFO ] [REMOTE    ] KIM: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T19:32:59.347617] [INFO ] [REMOTE    ] KIM: Fetching primary data for 2025-04.
[2025-10-24T19:32:59.497749] [INFO ] [REMOTE    ] KGC: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T19:32:59.978064] [INFO ] [REMOTE    ] KGS: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T19:33:00.147716] [INFO ] [REMOTE    ] KGS: Fetching primary data for 2025-08.
[2025-10-24T19:33:00.748960] [INFO ] [REMOTE    ] KIM: Incremental fetch complete for 2025-04 (1.40 seconds).
[2025-10-24T19:33:00.947762] [INFO ] [REMOTE    ] KIM: Fetching primary data for 2025-05.
[2025-10-24T19:33:01.719507] [INFO ] [REMOTE    ] KGS: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T19:33:01.747699] [INFO ] [REMOTE    ] KGS: Fetching primary data for 2025-09.
[2025-10-24T19:33:02.547683] [INFO ] [REMOTE    ] KFY: Fetching primary data for 2025-06.
[2025-10-24T19:33:02.707932] [INFO ] [REMOTE    ] KIM: Incremental fetch complete for 2025-05 (1.76 seconds).
[2025-10-24T19:33:03.343349] [INFO ] [REMOTE    ] KGS: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T19:33:03.353107] [INFO ] [REMOTE    ] KIM: Fetching primary data for 2025-06.
[2025-10-24T19:33:03.814925] [INFO ] [REMOTE    ] KFY: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T19:33:04.147734] [INFO ] [REMOTE    ] KGS: Fetching primary data for 2025-10.
[2025-10-24T19:33:04.864734] [INFO ] [REMOTE    ] KIM: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T19:33:04.947610] [INFO ] [REMOTE    ] KIM: Fetching primary data for 2025-07.
[2025-10-24T19:33:05.307753] [INFO ] [REMOTE    ] KGS: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T19:33:05.316147] [INFO ] [REMOTE    ] KGS: Full fetch complete (66538 records).
[2025-10-24T19:33:05.316258] [DEBUG] [VALIDATOR ] KGS: Validating primary data.
[2025-10-24T19:33:05.720183] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present.
[2025-10-24T19:33:05.720276] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed.
[2025-10-24T19:33:05.721300] [INFO ] [MAIN      ] KGS: Fetched primary data is valid.
[2025-10-24T19:33:05.721363] [DEBUG] [LOCAL     ] KGS: Saving primary data.
[2025-10-24T19:33:05.721976] [FATAL] [LOCAL     ] KGS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:33:05.722061] [FATAL] [MAIN      ] KGS: Failed to save primary data.
[2025-10-24T19:33:05.722102] [WARN ] [MAIN      ] KGS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:33:05.722137] [INFO ] [LOCAL     ] KGS: Starting deletion of primary data.
[2025-10-24T19:33:05.722189] [DEBUG] [LOCAL     ] KGS: No primary data file found to delete.
[2025-10-24T19:33:05.722225] [INFO ] [LOCAL     ] KGS: Starting deletion of derivative data.
[2025-10-24T19:33:05.722369] [DEBUG] [LOCAL     ] KGS: Deleted derivative data file.
[2025-10-24T19:33:05.722590] [INFO ] [MAIN      ] Update Progress: 1189/2366 symbols completed. KGS took 23.1s. Estimated remaining: 2h 31m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:33:05.753338] [INFO ] [REMOTE    ] KGC: Fetching primary data for 2025-07.
[2025-10-24T19:33:05.895171] [INFO ] [MAIN      ] KIO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:33:05.921865] [DEBUG] [LOCAL     ] KIO: Loaded 21847 existing records from primary storage.
[2025-10-24T19:33:05.922090] [INFO ] [MAIN      ] KIO: Loaded 21847 existing records.
[2025-10-24T19:33:06.103188] [WARN ] [MAIN      ] KIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:33:06.103456] [INFO ] [MAIN      ] KIO: Wiping existing primary data before full refresh.
[2025-10-24T19:33:06.103503] [INFO ] [LOCAL     ] KIO: Starting deletion of primary data.
[2025-10-24T19:33:06.103752] [DEBUG] [LOCAL     ] KIO: Deleted primary data file.
[2025-10-24T19:33:06.103809] [INFO ] [MAIN      ] KIO: Starting full primary refresh.
[2025-10-24T19:33:06.465351] [INFO ] [REMOTE    ] KIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:33:06.547634] [INFO ] [REMOTE    ] KFY: Fetching primary data for 2025-07.
[2025-10-24T19:33:06.630948] [INFO ] [REMOTE    ] KIM: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T19:33:07.347726] [INFO ] [REMOTE    ] KIM: Fetching primary data for 2025-08.
[2025-10-24T19:33:07.802440] [INFO ] [REMOTE    ] KGC: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T19:33:07.834481] [INFO ] [REMOTE    ] KFY: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T19:33:08.147687] [INFO ] [REMOTE    ] KIO: Fetching primary data for 2025-01.
[2025-10-24T19:33:08.947622] [INFO ] [REMOTE    ] KFY: Fetching primary data for 2025-08.
[2025-10-24T19:33:08.984376] [INFO ] [REMOTE    ] KIM: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T19:33:09.094306] [INFO ] [REMOTE    ] KIO: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T19:33:09.743852] [INFO ] [REMOTE    ] KFY: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T19:33:09.749406] [INFO ] [REMOTE    ] KIM: Fetching primary data for 2025-09.
[2025-10-24T19:33:10.547731] [INFO ] [REMOTE    ] KIO: Fetching primary data for 2025-02.
[2025-10-24T19:33:11.337084] [INFO ] [REMOTE    ] KIM: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T19:33:11.347733] [INFO ] [REMOTE    ] KGC: Fetching primary data for 2025-08.
[2025-10-24T19:33:11.623814] [INFO ] [REMOTE    ] KIO: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T19:33:12.147672] [INFO ] [REMOTE    ] KFY: Fetching primary data for 2025-09.
[2025-10-24T19:33:12.947719] [INFO ] [REMOTE    ] KIO: Fetching primary data for 2025-03.
[2025-10-24T19:33:13.191387] [INFO ] [REMOTE    ] KGC: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T19:33:13.484051] [INFO ] [REMOTE    ] KFY: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T19:33:13.747761] [INFO ] [REMOTE    ] KGC: Fetching primary data for 2025-09.
[2025-10-24T19:33:13.929072] [INFO ] [REMOTE    ] KIO: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T19:33:14.547737] [INFO ] [REMOTE    ] KFY: Fetching primary data for 2025-10.
[2025-10-24T19:33:15.347723] [INFO ] [REMOTE    ] KIM: Fetching primary data for 2025-10.
[2025-10-24T19:33:15.797898] [INFO ] [REMOTE    ] KFY: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T19:33:15.803324] [INFO ] [REMOTE    ] KFY: Full fetch complete (43306 records).
[2025-10-24T19:33:15.803423] [DEBUG] [VALIDATOR ] KFY: Validating primary data.
[2025-10-24T19:33:16.152668] [INFO ] [REMOTE    ] KIO: Fetching primary data for 2025-04.
[2025-10-24T19:33:16.184909] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present.
[2025-10-24T19:33:16.185053] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed.
[2025-10-24T19:33:16.186011] [INFO ] [MAIN      ] KFY: Fetched primary data is valid.
[2025-10-24T19:33:16.186336] [DEBUG] [LOCAL     ] KFY: Saving primary data.
[2025-10-24T19:33:16.197009] [FATAL] [LOCAL     ] KFY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:33:16.215214] [FATAL] [MAIN      ] KFY: Failed to save primary data.
[2025-10-24T19:33:16.215498] [WARN ] [MAIN      ] KFY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:33:16.217006] [INFO ] [REMOTE    ] KGC: Incremental fetch complete for 2025-09 (2.47 seconds).
[2025-10-24T19:33:16.215945] [INFO ] [LOCAL     ] KFY: Starting deletion of primary data.
[2025-10-24T19:33:16.228285] [DEBUG] [LOCAL     ] KFY: No primary data file found to delete.
[2025-10-24T19:33:16.228476] [INFO ] [LOCAL     ] KFY: Starting deletion of derivative data.
[2025-10-24T19:33:16.228623] [DEBUG] [LOCAL     ] KFY: Deleted derivative data file.
[2025-10-24T19:33:16.228758] [INFO ] [MAIN      ] Update Progress: 1190/2366 symbols completed. KFY took 42.7s. Estimated remaining: 2h 31m 25s. Rate: 7.8 symbols/min
[2025-10-24T19:33:16.399260] [INFO ] [MAIN      ] KKR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:33:16.453547] [DEBUG] [LOCAL     ] KKR: Loaded 53890 existing records from primary storage.
[2025-10-24T19:33:16.453881] [INFO ] [MAIN      ] KKR: Loaded 53890 existing records.
[2025-10-24T19:33:16.629447] [WARN ] [MAIN      ] KKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:33:16.629694] [INFO ] [MAIN      ] KKR: Wiping existing primary data before full refresh.
[2025-10-24T19:33:16.629753] [INFO ] [LOCAL     ] KKR: Starting deletion of primary data.
[2025-10-24T19:33:16.630270] [DEBUG] [LOCAL     ] KKR: Deleted primary data file.
[2025-10-24T19:33:16.630742] [INFO ] [MAIN      ] KKR: Starting full primary refresh.
[2025-10-24T19:33:16.952705] [INFO ] [REMOTE    ] KGC: Fetching primary data for 2025-10.
[2025-10-24T19:33:16.996509] [INFO ] [REMOTE    ] KKR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:33:17.150061] [INFO ] [REMOTE    ] KIM: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T19:33:17.160088] [INFO ] [REMOTE    ] KIM: Full fetch complete (76966 records).
[2025-10-24T19:33:17.160228] [DEBUG] [VALIDATOR ] KIM: Validating primary data.
[2025-10-24T19:33:17.467987] [INFO ] [REMOTE    ] KIO: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T19:33:17.575124] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present.
[2025-10-24T19:33:17.575200] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed.
[2025-10-24T19:33:17.576247] [INFO ] [MAIN      ] KIM: Fetched primary data is valid.
[2025-10-24T19:33:17.576311] [DEBUG] [LOCAL     ] KIM: Saving primary data.
[2025-10-24T19:33:17.576891] [FATAL] [LOCAL     ] KIM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:33:17.576994] [FATAL] [MAIN      ] KIM: Failed to save primary data.
[2025-10-24T19:33:17.577070] [WARN ] [MAIN      ] KIM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:33:17.577164] [INFO ] [LOCAL     ] KIM: Starting deletion of primary data.
[2025-10-24T19:33:17.577276] [DEBUG] [LOCAL     ] KIM: No primary data file found to delete.
[2025-10-24T19:33:17.577324] [INFO ] [LOCAL     ] KIM: Starting deletion of derivative data.
[2025-10-24T19:33:17.577503] [DEBUG] [LOCAL     ] KIM: Deleted derivative data file.
[2025-10-24T19:33:17.578032] [INFO ] [MAIN      ] Update Progress: 1191/2366 symbols completed. KIM took 29.1s. Estimated remaining: 2h 31m 11s. Rate: 7.8 symbols/min
[2025-10-24T19:33:17.743553] [INFO ] [MAIN      ] KKRS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:33:17.747964] [INFO ] [REMOTE    ] KIO: Fetching primary data for 2025-05.
[2025-10-24T19:33:17.753038] [DEBUG] [LOCAL     ] KKRS: Loaded 5564 existing records from primary storage.
[2025-10-24T19:33:17.753283] [INFO ] [MAIN      ] KKRS: Loaded 5564 existing records.
[2025-10-24T19:33:17.933034] [WARN ] [MAIN      ] KKRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:33:17.933256] [INFO ] [MAIN      ] KKRS: Wiping existing primary data before full refresh.
[2025-10-24T19:33:17.933312] [INFO ] [LOCAL     ] KKRS: Starting deletion of primary data.
[2025-10-24T19:33:17.933473] [DEBUG] [LOCAL     ] KKRS: Deleted primary data file.
[2025-10-24T19:33:17.933512] [INFO ] [MAIN      ] KKRS: Starting full primary refresh.
[2025-10-24T19:33:18.300949] [INFO ] [REMOTE    ] KKRS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:33:18.547636] [INFO ] [REMOTE    ] KKR: Fetching primary data for 2025-01.
[2025-10-24T19:33:18.837604] [INFO ] [REMOTE    ] KIO: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T19:33:19.109066] [INFO ] [REMOTE    ] KGC: Incremental fetch complete for 2025-10 (2.16 seconds).
[2025-10-24T19:33:19.118748] [INFO ] [REMOTE    ] KGC: Full fetch complete (77875 records).
[2025-10-24T19:33:19.118873] [DEBUG] [VALIDATOR ] KGC: Validating primary data.
[2025-10-24T19:33:19.352885] [INFO ] [REMOTE    ] KKRS: Fetching primary data for 2025-01.
[2025-10-24T19:33:19.518784] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present.
[2025-10-24T19:33:19.518856] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed.
[2025-10-24T19:33:19.519913] [INFO ] [MAIN      ] KGC: Fetched primary data is valid.
[2025-10-24T19:33:19.519979] [DEBUG] [LOCAL     ] KGC: Saving primary data.
[2025-10-24T19:33:19.520539] [FATAL] [LOCAL     ] KGC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:33:19.520618] [FATAL] [MAIN      ] KGC: Failed to save primary data.
[2025-10-24T19:33:19.520693] [WARN ] [MAIN      ] KGC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:33:19.520761] [INFO ] [LOCAL     ] KGC: Starting deletion of primary data.
[2025-10-24T19:33:19.520822] [DEBUG] [LOCAL     ] KGC: No primary data file found to delete.
[2025-10-24T19:33:19.520858] [INFO ] [LOCAL     ] KGC: Starting deletion of derivative data.
[2025-10-24T19:33:19.521019] [DEBUG] [LOCAL     ] KGC: Deleted derivative data file.
[2025-10-24T19:33:19.521234] [INFO ] [MAIN      ] Update Progress: 1192/2366 symbols completed. KGC took 45.6s. Estimated remaining: 2h 30m 58s. Rate: 7.8 symbols/min
[2025-10-24T19:33:19.692244] [INFO ] [MAIN      ] KKRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:33:19.692682] [DEBUG] [LOCAL     ] KKRT: No existing data file found in primary storage.
[2025-10-24T19:33:19.692736] [WARN ] [MAIN      ] KKRT: No existing data found, performing full refresh instead.
[2025-10-24T19:33:19.692881] [INFO ] [MAIN      ] KKRT: Wiping existing primary data before full refresh.
[2025-10-24T19:33:19.692922] [INFO ] [LOCAL     ] KKRT: Starting deletion of primary data.
[2025-10-24T19:33:19.692963] [DEBUG] [LOCAL     ] KKRT: No primary data file found to delete.
[2025-10-24T19:33:19.692993] [INFO ] [MAIN      ] KKRT: Starting full primary refresh.
[2025-10-24T19:33:19.986171] [INFO ] [REMOTE    ] KKRS: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T19:33:20.066034] [INFO ] [REMOTE    ] KKRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:33:20.147608] [INFO ] [REMOTE    ] KKRS: Fetching primary data for 2025-02.
[2025-10-24T19:33:20.303197] [INFO ] [REMOTE    ] KKR: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T19:33:20.815769] [INFO ] [REMOTE    ] KKRS: Incremental fetch complete for 2025-02 (0.67 seconds).
[2025-10-24T19:33:20.947695] [INFO ] [REMOTE    ] KKR: Fetching primary data for 2025-02.
[2025-10-24T19:33:21.747747] [INFO ] [REMOTE    ] KIO: Fetching primary data for 2025-06.
[2025-10-24T19:33:22.547706] [INFO ] [REMOTE    ] KKRT: Fetching primary data for 2025-01.
[2025-10-24T19:33:22.688273] [INFO ] [REMOTE    ] KIO: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T19:33:22.771562] [DEBUG] [REMOTE    ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:33:22.772053] [WARN ] [REMOTE    ] KKRT: No data returned for month 2025-01
[2025-10-24T19:33:22.772166] [FATAL] [REMOTE    ] KKRT: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:33:22.772307] [FATAL] [MAIN      ] KKRT: Failed to fetch primary data.
[2025-10-24T19:33:22.772403] [WARN ] [MAIN      ] KKRT: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:33:22.772581] [INFO ] [LOCAL     ] KKRT: Starting deletion of primary data.
[2025-10-24T19:33:22.773156] [DEBUG] [LOCAL     ] KKRT: No primary data file found to delete.
[2025-10-24T19:33:22.773876] [INFO ] [LOCAL     ] KKRT: Starting deletion of derivative data.
[2025-10-24T19:33:22.773989] [DEBUG] [LOCAL     ] KKRT: No derivative data file found to delete.
[2025-10-24T19:33:22.774076] [INFO ] [MAIN      ] Update Progress: 1193/2366 symbols completed. KKRT took 3.3s. Estimated remaining: 2h 30m 46s. Rate: 7.8 symbols/min
[2025-10-24T19:33:22.777526] [INFO ] [REMOTE    ] KKR: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T19:33:23.030019] [INFO ] [MAIN      ] KLAR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:33:23.030247] [DEBUG] [LOCAL     ] KLAR: No existing data file found in primary storage.
[2025-10-24T19:33:23.030315] [WARN ] [MAIN      ] KLAR: No existing data found, performing full refresh instead.
[2025-10-24T19:33:23.030449] [INFO ] [MAIN      ] KLAR: Wiping existing primary data before full refresh.
[2025-10-24T19:33:23.030492] [INFO ] [LOCAL     ] KLAR: Starting deletion of primary data.
[2025-10-24T19:33:23.030534] [DEBUG] [LOCAL     ] KLAR: No primary data file found to delete.
[2025-10-24T19:33:23.030567] [INFO ] [MAIN      ] KLAR: Starting full primary refresh.
[2025-10-24T19:33:23.352845] [INFO ] [REMOTE    ] KIO: Fetching primary data for 2025-07.
[2025-10-24T19:33:23.444423] [INFO ] [REMOTE    ] KLAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:33:24.147676] [INFO ] [REMOTE    ] KLAR: Fetching primary data for 2025-01.
[2025-10-24T19:33:24.360275] [DEBUG] [REMOTE    ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:33:24.360580] [WARN ] [REMOTE    ] KLAR: No data returned for month 2025-01
[2025-10-24T19:33:24.360717] [FATAL] [REMOTE    ] KLAR: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:33:24.360791] [FATAL] [MAIN      ] KLAR: Failed to fetch primary data.
[2025-10-24T19:33:24.360870] [WARN ] [MAIN      ] KLAR: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:33:24.360944] [INFO ] [LOCAL     ] KLAR: Starting deletion of primary data.
[2025-10-24T19:33:24.361007] [DEBUG] [LOCAL     ] KLAR: No primary data file found to delete.
[2025-10-24T19:33:24.361043] [INFO ] [LOCAL     ] KLAR: Starting deletion of derivative data.
[2025-10-24T19:33:24.361084] [DEBUG] [LOCAL     ] KLAR: No derivative data file found to delete.
[2025-10-24T19:33:24.361131] [INFO ] [MAIN      ] Update Progress: 1194/2366 symbols completed. KLAR took 1.6s. Estimated remaining: 2h 30m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:33:24.542811] [INFO ] [MAIN      ] KLC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:33:24.553253] [INFO ] [REMOTE    ] KIO: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T19:33:24.592873] [DEBUG] [LOCAL     ] KLC: Loaded 36361 existing records from primary storage.
[2025-10-24T19:33:24.593134] [INFO ] [MAIN      ] KLC: Loaded 36361 existing records.
[2025-10-24T19:33:24.784343] [WARN ] [MAIN      ] KLC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:33:24.784554] [INFO ] [MAIN      ] KLC: Wiping existing primary data before full refresh.
[2025-10-24T19:33:24.784601] [INFO ] [LOCAL     ] KLC: Starting deletion of primary data.
[2025-10-24T19:33:24.785008] [DEBUG] [LOCAL     ] KLC: Deleted primary data file.
[2025-10-24T19:33:24.785063] [INFO ] [MAIN      ] KLC: Starting full primary refresh.
[2025-10-24T19:33:24.948286] [INFO ] [REMOTE    ] KKRS: Fetching primary data for 2025-03.
[2025-10-24T19:33:25.158893] [INFO ] [REMOTE    ] KLC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:33:25.580173] [INFO ] [REMOTE    ] KKRS: Incremental fetch complete for 2025-03 (0.63 seconds).
[2025-10-24T19:33:25.747637] [INFO ] [REMOTE    ] KLC: Fetching primary data for 2025-01.
[2025-10-24T19:33:26.547674] [INFO ] [REMOTE    ] KKR: Fetching primary data for 2025-03.
[2025-10-24T19:33:27.027290] [INFO ] [REMOTE    ] KLC: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T19:33:27.347703] [INFO ] [REMOTE    ] KLC: Fetching primary data for 2025-02.
[2025-10-24T19:33:28.147628] [INFO ] [REMOTE    ] KIO: Fetching primary data for 2025-08.
[2025-10-24T19:33:28.343087] [INFO ] [REMOTE    ] KLC: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T19:33:28.388397] [INFO ] [REMOTE    ] KKR: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T19:33:28.947624] [INFO ] [REMOTE    ] KKRS: Fetching primary data for 2025-04.
[2025-10-24T19:33:29.200052] [INFO ] [REMOTE    ] KIO: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T19:33:29.685137] [INFO ] [REMOTE    ] KKRS: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T19:33:29.747631] [INFO ] [REMOTE    ] KLC: Fetching primary data for 2025-03.
[2025-10-24T19:33:30.547665] [INFO ] [REMOTE    ] KKRS: Fetching primary data for 2025-05.
[2025-10-24T19:33:30.999051] [INFO ] [REMOTE    ] KLC: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T19:33:31.258087] [INFO ] [REMOTE    ] KKRS: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T19:33:31.347711] [INFO ] [REMOTE    ] KLC: Fetching primary data for 2025-04.
[2025-10-24T19:33:32.147704] [INFO ] [REMOTE    ] KKRS: Fetching primary data for 2025-06.
[2025-10-24T19:33:32.650746] [INFO ] [REMOTE    ] KLC: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T19:33:32.725451] [INFO ] [REMOTE    ] KKRS: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T19:33:32.947672] [INFO ] [REMOTE    ] KIO: Fetching primary data for 2025-09.
[2025-10-24T19:33:33.747632] [INFO ] [REMOTE    ] KKRS: Fetching primary data for 2025-07.
[2025-10-24T19:33:34.033343] [INFO ] [REMOTE    ] KIO: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T19:33:34.301946] [INFO ] [REMOTE    ] KKRS: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T19:33:34.547632] [INFO ] [REMOTE    ] KKR: Fetching primary data for 2025-04.
[2025-10-24T19:33:35.347671] [INFO ] [REMOTE    ] KKRS: Fetching primary data for 2025-08.
[2025-10-24T19:33:35.948831] [INFO ] [REMOTE    ] KKRS: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T19:33:36.147605] [INFO ] [REMOTE    ] KKRS: Fetching primary data for 2025-09.
[2025-10-24T19:33:36.574543] [INFO ] [REMOTE    ] KKR: Incremental fetch complete for 2025-04 (2.03 seconds).
[2025-10-24T19:33:36.770134] [INFO ] [REMOTE    ] KKRS: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T19:33:36.947725] [INFO ] [REMOTE    ] KLC: Fetching primary data for 2025-05.
[2025-10-24T19:33:37.747733] [INFO ] [REMOTE    ] KIO: Fetching primary data for 2025-10.
[2025-10-24T19:33:38.343371] [INFO ] [REMOTE    ] KLC: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T19:33:38.547627] [INFO ] [REMOTE    ] KLC: Fetching primary data for 2025-06.
[2025-10-24T19:33:38.890835] [INFO ] [REMOTE    ] KIO: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T19:33:38.896959] [INFO ] [REMOTE    ] KIO: Full fetch complete (32329 records).
[2025-10-24T19:33:38.897060] [DEBUG] [VALIDATOR ] KIO: Validating primary data.
[2025-10-24T19:33:39.266852] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present.
[2025-10-24T19:33:39.266927] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed.
[2025-10-24T19:33:39.267579] [INFO ] [MAIN      ] KIO: Fetched primary data is valid.
[2025-10-24T19:33:39.267724] [DEBUG] [LOCAL     ] KIO: Saving primary data.
[2025-10-24T19:33:39.268045] [FATAL] [LOCAL     ] KIO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:33:39.268126] [FATAL] [MAIN      ] KIO: Failed to save primary data.
[2025-10-24T19:33:39.268167] [WARN ] [MAIN      ] KIO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:33:39.268226] [INFO ] [LOCAL     ] KIO: Starting deletion of primary data.
[2025-10-24T19:33:39.268297] [DEBUG] [LOCAL     ] KIO: No primary data file found to delete.
[2025-10-24T19:33:39.268352] [INFO ] [LOCAL     ] KIO: Starting deletion of derivative data.
[2025-10-24T19:33:39.268905] [DEBUG] [LOCAL     ] KIO: Deleted derivative data file.
[2025-10-24T19:33:39.268994] [INFO ] [MAIN      ] Update Progress: 1195/2366 symbols completed. KIO took 33.5s. Estimated remaining: 2h 30m 31s. Rate: 7.8 symbols/min
[2025-10-24T19:33:39.352918] [INFO ] [REMOTE    ] KKRS: Fetching primary data for 2025-10.
[2025-10-24T19:33:39.442301] [INFO ] [MAIN      ] KMI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:33:39.496123] [DEBUG] [LOCAL     ] KMI: Loaded 54083 existing records from primary storage.
[2025-10-24T19:33:39.496748] [INFO ] [MAIN      ] KMI: Loaded 54083 existing records.
[2025-10-24T19:33:39.706857] [INFO ] [REMOTE    ] KLC: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T19:33:39.712607] [WARN ] [MAIN      ] KMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:33:39.720191] [INFO ] [MAIN      ] KMI: Wiping existing primary data before full refresh.
[2025-10-24T19:33:39.720272] [INFO ] [LOCAL     ] KMI: Starting deletion of primary data.
[2025-10-24T19:33:39.720954] [DEBUG] [LOCAL     ] KMI: Deleted primary data file.
[2025-10-24T19:33:39.721016] [INFO ] [MAIN      ] KMI: Starting full primary refresh.
[2025-10-24T19:33:40.078746] [INFO ] [REMOTE    ] KKRS: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T19:33:40.078587] [INFO ] [REMOTE    ] KMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:33:40.080481] [INFO ] [REMOTE    ] KKRS: Full fetch complete (7530 records).
[2025-10-24T19:33:40.080556] [DEBUG] [VALIDATOR ] KKRS: Validating primary data.
[2025-10-24T19:33:40.152934] [INFO ] [REMOTE    ] KKR: Fetching primary data for 2025-05.
[2025-10-24T19:33:40.436813] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present.
[2025-10-24T19:33:40.436899] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed.
[2025-10-24T19:33:40.437179] [INFO ] [MAIN      ] KKRS: Fetched primary data is valid.
[2025-10-24T19:33:40.437249] [DEBUG] [LOCAL     ] KKRS: Saving primary data.
[2025-10-24T19:33:40.437472] [FATAL] [LOCAL     ] KKRS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:33:40.437551] [FATAL] [MAIN      ] KKRS: Failed to save primary data.
[2025-10-24T19:33:40.437593] [WARN ] [MAIN      ] KKRS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:33:40.437628] [INFO ] [LOCAL     ] KKRS: Starting deletion of primary data.
[2025-10-24T19:33:40.437716] [DEBUG] [LOCAL     ] KKRS: No primary data file found to delete.
[2025-10-24T19:33:40.437761] [INFO ] [LOCAL     ] KKRS: Starting deletion of derivative data.
[2025-10-24T19:33:40.437904] [DEBUG] [LOCAL     ] KKRS: Deleted derivative data file.
[2025-10-24T19:33:40.437980] [INFO ] [MAIN      ] Update Progress: 1196/2366 symbols completed. KKRS took 22.9s. Estimated remaining: 2h 30m 17s. Rate: 7.8 symbols/min
[2025-10-24T19:33:40.607493] [INFO ] [MAIN      ] KMPB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:33:40.615457] [DEBUG] [LOCAL     ] KMPB: Loaded 3495 existing records from primary storage.
[2025-10-24T19:33:40.615815] [INFO ] [MAIN      ] KMPB: Loaded 3495 existing records.
[2025-10-24T19:33:40.797885] [WARN ] [MAIN      ] KMPB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:33:40.798176] [INFO ] [MAIN      ] KMPB: Wiping existing primary data before full refresh.
[2025-10-24T19:33:40.798229] [INFO ] [LOCAL     ] KMPB: Starting deletion of primary data.
[2025-10-24T19:33:40.798415] [DEBUG] [LOCAL     ] KMPB: Deleted primary data file.
[2025-10-24T19:33:40.798458] [INFO ] [MAIN      ] KMPB: Starting full primary refresh.
[2025-10-24T19:33:40.953093] [INFO ] [REMOTE    ] KMI: Fetching primary data for 2025-01.
[2025-10-24T19:33:41.177379] [INFO ] [REMOTE    ] KMPB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:33:41.747668] [INFO ] [REMOTE    ] KMPB: Fetching primary data for 2025-01.
[2025-10-24T19:33:41.966467] [INFO ] [REMOTE    ] KKR: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T19:33:42.174310] [INFO ] [REMOTE    ] KMPB: Incremental fetch complete for 2025-01 (0.43 seconds).
[2025-10-24T19:33:42.547689] [INFO ] [REMOTE    ] KLC: Fetching primary data for 2025-07.
[2025-10-24T19:33:42.886612] [INFO ] [REMOTE    ] KMI: Incremental fetch complete for 2025-01 (1.93 seconds).
[2025-10-24T19:33:43.347719] [INFO ] [REMOTE    ] KMI: Fetching primary data for 2025-02.
[2025-10-24T19:33:43.849588] [INFO ] [REMOTE    ] KLC: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T19:33:44.147726] [INFO ] [REMOTE    ] KMPB: Fetching primary data for 2025-02.
[2025-10-24T19:33:44.501539] [INFO ] [REMOTE    ] KMPB: Incremental fetch complete for 2025-02 (0.35 seconds).
[2025-10-24T19:33:44.947696] [INFO ] [REMOTE    ] KKR: Fetching primary data for 2025-06.
[2025-10-24T19:33:44.976059] [INFO ] [REMOTE    ] KMI: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T19:33:45.747616] [INFO ] [REMOTE    ] KMI: Fetching primary data for 2025-03.
[2025-10-24T19:33:46.547660] [INFO ] [REMOTE    ] KMPB: Fetching primary data for 2025-03.
[2025-10-24T19:33:46.923220] [INFO ] [REMOTE    ] KKR: Incremental fetch complete for 2025-06 (1.98 seconds).
[2025-10-24T19:33:47.171275] [INFO ] [REMOTE    ] KMPB: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T19:33:47.347723] [INFO ] [REMOTE    ] KKR: Fetching primary data for 2025-07.
[2025-10-24T19:33:47.958298] [INFO ] [REMOTE    ] KMI: Incremental fetch complete for 2025-03 (2.21 seconds).
[2025-10-24T19:33:48.147631] [INFO ] [REMOTE    ] KMI: Fetching primary data for 2025-04.
[2025-10-24T19:33:48.947711] [INFO ] [REMOTE    ] KLC: Fetching primary data for 2025-08.
[2025-10-24T19:33:49.105517] [INFO ] [REMOTE    ] KKR: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T19:33:49.747628] [INFO ] [REMOTE    ] KKR: Fetching primary data for 2025-08.
[2025-10-24T19:33:50.002966] [INFO ] [REMOTE    ] KMI: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T19:33:50.076457] [INFO ] [REMOTE    ] KLC: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T19:33:50.547675] [INFO ] [REMOTE    ] KMPB: Fetching primary data for 2025-04.
[2025-10-24T19:33:51.008300] [INFO ] [REMOTE    ] KMPB: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T19:33:51.087627] [INFO ] [REMOTE    ] KKR: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T19:33:51.347724] [INFO ] [REMOTE    ] KMI: Fetching primary data for 2025-05.
[2025-10-24T19:33:52.147720] [INFO ] [REMOTE    ] KMPB: Fetching primary data for 2025-05.
[2025-10-24T19:33:52.608975] [INFO ] [REMOTE    ] KMPB: Incremental fetch complete for 2025-05 (0.46 seconds).
[2025-10-24T19:33:52.947700] [INFO ] [REMOTE    ] KMPB: Fetching primary data for 2025-06.
[2025-10-24T19:33:53.479737] [INFO ] [REMOTE    ] KMI: Incremental fetch complete for 2025-05 (2.13 seconds).
[2025-10-24T19:33:53.478532] [INFO ] [REMOTE    ] KMPB: Incremental fetch complete for 2025-06 (0.53 seconds).
[2025-10-24T19:33:53.747636] [INFO ] [REMOTE    ] KKR: Fetching primary data for 2025-09.
[2025-10-24T19:33:54.547622] [INFO ] [REMOTE    ] KMI: Fetching primary data for 2025-06.
[2025-10-24T19:33:55.347703] [INFO ] [REMOTE    ] KLC: Fetching primary data for 2025-09.
[2025-10-24T19:33:55.610841] [INFO ] [REMOTE    ] KKR: Incremental fetch complete for 2025-09 (1.86 seconds).
[2025-10-24T19:33:56.147700] [INFO ] [REMOTE    ] KKR: Fetching primary data for 2025-10.
[2025-10-24T19:33:56.463353] [INFO ] [REMOTE    ] KMI: Incremental fetch complete for 2025-06 (1.92 seconds).
[2025-10-24T19:33:56.817252] [INFO ] [REMOTE    ] KLC: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T19:33:56.947679] [INFO ] [REMOTE    ] KLC: Fetching primary data for 2025-10.
[2025-10-24T19:33:57.747696] [INFO ] [REMOTE    ] KMI: Fetching primary data for 2025-07.
[2025-10-24T19:33:58.117826] [INFO ] [REMOTE    ] KKR: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T19:33:58.127516] [INFO ] [REMOTE    ] KKR: Full fetch complete (77659 records).
[2025-10-24T19:33:58.127673] [DEBUG] [VALIDATOR ] KKR: Validating primary data.
[2025-10-24T19:33:58.536525] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present.
[2025-10-24T19:33:58.536662] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed.
[2025-10-24T19:33:58.537883] [INFO ] [MAIN      ] KKR: Fetched primary data is valid.
[2025-10-24T19:33:58.538012] [DEBUG] [LOCAL     ] KKR: Saving primary data.
[2025-10-24T19:33:58.538889] [FATAL] [LOCAL     ] KKR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:33:58.538999] [FATAL] [MAIN      ] KKR: Failed to save primary data.
[2025-10-24T19:33:58.539086] [WARN ] [MAIN      ] KKR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:33:58.539177] [INFO ] [LOCAL     ] KKR: Starting deletion of primary data.
[2025-10-24T19:33:58.539258] [DEBUG] [LOCAL     ] KKR: No primary data file found to delete.
[2025-10-24T19:33:58.539297] [INFO ] [LOCAL     ] KKR: Starting deletion of derivative data.
[2025-10-24T19:33:58.539466] [DEBUG] [LOCAL     ] KKR: Deleted derivative data file.
[2025-10-24T19:33:58.539768] [INFO ] [MAIN      ] Update Progress: 1197/2366 symbols completed. KKR took 42.3s. Estimated remaining: 2h 30m 20s. Rate: 7.8 symbols/min
[2025-10-24T19:33:58.547705] [INFO ] [REMOTE    ] KMPB: Fetching primary data for 2025-07.
[2025-10-24T19:33:58.614326] [INFO ] [REMOTE    ] KLC: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T19:33:58.621324] [INFO ] [REMOTE    ] KLC: Full fetch complete (50668 records).
[2025-10-24T19:33:58.621427] [DEBUG] [VALIDATOR ] KLC: Validating primary data.
[2025-10-24T19:33:58.996713] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present.
[2025-10-24T19:33:58.996790] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed.
[2025-10-24T19:33:58.997632] [INFO ] [MAIN      ] KLC: Fetched primary data is valid.
[2025-10-24T19:33:58.997713] [DEBUG] [LOCAL     ] KLC: Saving primary data.
[2025-10-24T19:33:58.998127] [FATAL] [LOCAL     ] KLC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:33:58.998208] [FATAL] [MAIN      ] KLC: Failed to save primary data.
[2025-10-24T19:33:58.998251] [WARN ] [MAIN      ] KLC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:33:58.998286] [INFO ] [LOCAL     ] KLC: Starting deletion of primary data.
[2025-10-24T19:33:58.998336] [DEBUG] [LOCAL     ] KLC: No primary data file found to delete.
[2025-10-24T19:33:58.998371] [INFO ] [LOCAL     ] KLC: Starting deletion of derivative data.
[2025-10-24T19:33:58.998528] [DEBUG] [LOCAL     ] KLC: Deleted derivative data file.
[2025-10-24T19:33:58.998799] [INFO ] [MAIN      ] Update Progress: 1198/2366 symbols completed. KLC took 34.6s. Estimated remaining: 2h 30m 5s. Rate: 7.8 symbols/min
[2025-10-24T19:33:59.021426] [INFO ] [REMOTE    ] KMPB: Incremental fetch complete for 2025-07 (0.47 seconds).
[2025-10-24T19:33:59.347717] [INFO ] [REMOTE    ] KMPB: Fetching primary data for 2025-08.
[2025-10-24T19:33:59.666364] [INFO ] [REMOTE    ] KMI: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T19:33:59.921802] [INFO ] [REMOTE    ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T19:34:00.147720] [INFO ] [REMOTE    ] KMPB: Fetching primary data for 2025-09.
[2025-10-24T19:34:00.763330] [INFO ] [REMOTE    ] KMPB: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T19:34:00.947728] [INFO ] [REMOTE    ] KMPB: Fetching primary data for 2025-10.
[2025-10-24T19:34:01.673678] [INFO ] [REMOTE    ] KMPB: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T19:34:01.674705] [INFO ] [REMOTE    ] KMPB: Full fetch complete (4922 records).
[2025-10-24T19:34:01.674775] [DEBUG] [VALIDATOR ] KMPB: Validating primary data.
[2025-10-24T19:34:01.755386] [INFO ] [REMOTE    ] KMI: Fetching primary data for 2025-08.
[2025-10-24T19:34:02.046482] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present.
[2025-10-24T19:34:02.046559] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed.
[2025-10-24T19:34:02.046716] [INFO ] [MAIN      ] KMPB: Fetched primary data is valid.
[2025-10-24T19:34:02.046777] [DEBUG] [LOCAL     ] KMPB: Saving primary data.
[2025-10-24T19:34:02.046985] [FATAL] [LOCAL     ] KMPB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:34:02.047071] [FATAL] [MAIN      ] KMPB: Failed to save primary data.
[2025-10-24T19:34:02.047112] [WARN ] [MAIN      ] KMPB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:34:02.047146] [INFO ] [LOCAL     ] KMPB: Starting deletion of primary data.
[2025-10-24T19:34:02.047214] [DEBUG] [LOCAL     ] KMPB: No primary data file found to delete.
[2025-10-24T19:34:02.047271] [INFO ] [LOCAL     ] KMPB: Starting deletion of derivative data.
[2025-10-24T19:34:02.047438] [DEBUG] [LOCAL     ] KMPB: Deleted derivative data file.
[2025-10-24T19:34:02.047526] [INFO ] [MAIN      ] Update Progress: 1199/2366 symbols completed. KMPB took 21.6s. Estimated remaining: 2h 29m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:34:03.603530] [INFO ] [REMOTE    ] KMI: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T19:34:03.614803] [INFO ] [REMOTE    ] KMI: Fetching primary data for 2025-09.
[2025-10-24T19:34:05.607323] [INFO ] [REMOTE    ] KMI: Incremental fetch complete for 2025-09 (1.99 seconds).
[2025-10-24T19:34:05.619052] [INFO ] [REMOTE    ] KMI: Fetching primary data for 2025-10.
[2025-10-24T19:34:07.594375] [INFO ] [REMOTE    ] KMI: Incremental fetch complete for 2025-10 (1.98 seconds).
[2025-10-24T19:34:07.604331] [INFO ] [REMOTE    ] KMI: Full fetch complete (77873 records).
[2025-10-24T19:34:07.604491] [DEBUG] [VALIDATOR ] KMI: Validating primary data.
[2025-10-24T19:34:08.016631] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present.
[2025-10-24T19:34:08.016736] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed.
[2025-10-24T19:34:08.017819] [INFO ] [MAIN      ] KMI: Fetched primary data is valid.
[2025-10-24T19:34:08.017880] [DEBUG] [LOCAL     ] KMI: Saving primary data.
[2025-10-24T19:34:08.018437] [FATAL] [LOCAL     ] KMI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:34:08.018522] [FATAL] [MAIN      ] KMI: Failed to save primary data.
[2025-10-24T19:34:08.018563] [WARN ] [MAIN      ] KMI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:34:08.018598] [INFO ] [LOCAL     ] KMI: Starting deletion of primary data.
[2025-10-24T19:34:08.018674] [DEBUG] [LOCAL     ] KMI: No primary data file found to delete.
[2025-10-24T19:34:08.018731] [INFO ] [LOCAL     ] KMI: Starting deletion of derivative data.
[2025-10-24T19:34:08.018866] [DEBUG] [LOCAL     ] KMI: Deleted derivative data file.
[2025-10-24T19:34:08.019506] [INFO ] [MAIN      ] Update Progress: 1200/2366 symbols completed. KMI took 28.8s. Estimated remaining: 2h 29m 43s. Rate: 7.8 symbols/min
[2025-10-24T19:34:08.651428] [INFO ] [MAIN      ] KMPR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:34:08.654705] [INFO ] [MAIN      ] KMT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:34:08.666466] [INFO ] [MAIN      ] KN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:34:08.730996] [INFO ] [MAIN      ] KMX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:34:08.791920] [DEBUG] [LOCAL     ] KMPR: Loaded 40795 existing records from primary storage.
[2025-10-24T19:34:08.793811] [DEBUG] [LOCAL     ] KN: Loaded 38737 existing records from primary storage.
[2025-10-24T19:34:08.794287] [INFO ] [MAIN      ] KMPR: Loaded 40795 existing records.
[2025-10-24T19:34:08.806315] [INFO ] [MAIN      ] KN: Loaded 38737 existing records.
[2025-10-24T19:34:08.875983] [DEBUG] [LOCAL     ] KMT: Loaded 43150 existing records from primary storage.
[2025-10-24T19:34:08.958158] [INFO ] [MAIN      ] KMT: Loaded 43150 existing records.
[2025-10-24T19:34:09.181733] [WARN ] [MAIN      ] KMPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:34:09.192683] [INFO ] [MAIN      ] KMPR: Wiping existing primary data before full refresh.
[2025-10-24T19:34:09.203555] [INFO ] [LOCAL     ] KMPR: Starting deletion of primary data.
[2025-10-24T19:34:09.233022] [DEBUG] [LOCAL     ] KMPR: Deleted primary data file.
[2025-10-24T19:34:09.243432] [INFO ] [MAIN      ] KMPR: Starting full primary refresh.
[2025-10-24T19:34:09.250427] [DEBUG] [LOCAL     ] KMX: Loaded 53676 existing records from primary storage.
[2025-10-24T19:34:09.325375] [INFO ] [MAIN      ] KMX: Loaded 53676 existing records.
[2025-10-24T19:34:09.395520] [WARN ] [MAIN      ] KN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:34:09.551606] [WARN ] [MAIN      ] KMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:34:09.576507] [INFO ] [MAIN      ] KN: Wiping existing primary data before full refresh.
[2025-10-24T19:34:09.595857] [INFO ] [MAIN      ] KMT: Wiping existing primary data before full refresh.
[2025-10-24T19:34:09.607008] [INFO ] [LOCAL     ] KN: Starting deletion of primary data.
[2025-10-24T19:34:09.606938] [INFO ] [LOCAL     ] KMT: Starting deletion of primary data.
[2025-10-24T19:34:09.628241] [DEBUG] [LOCAL     ] KN: Deleted primary data file.
[2025-10-24T19:34:09.638771] [INFO ] [MAIN      ] KN: Starting full primary refresh.
[2025-10-24T19:34:09.633435] [DEBUG] [LOCAL     ] KMT: Deleted primary data file.
[2025-10-24T19:34:09.688757] [INFO ] [MAIN      ] KMT: Starting full primary refresh.
[2025-10-24T19:34:10.303313] [WARN ] [MAIN      ] KMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:34:10.335317] [INFO ] [MAIN      ] KMX: Wiping existing primary data before full refresh.
[2025-10-24T19:34:10.340902] [INFO ] [LOCAL     ] KMX: Starting deletion of primary data.
[2025-10-24T19:34:10.520475] [DEBUG] [LOCAL     ] KMX: Deleted primary data file.
[2025-10-24T19:34:10.639809] [INFO ] [MAIN      ] KMX: Starting full primary refresh.
[2025-10-24T19:34:10.708614] [INFO ] [REMOTE    ] KMPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:34:10.733126] [INFO ] [REMOTE    ] KMPR: Fetching primary data for 2025-01.
[2025-10-24T19:34:11.083673] [INFO ] [REMOTE    ] KN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:34:11.179348] [INFO ] [REMOTE    ] KMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:34:11.219985] [INFO ] [REMOTE    ] KN: Fetching primary data for 2025-01.
[2025-10-24T19:34:11.285579] [INFO ] [REMOTE    ] KMT: Fetching primary data for 2025-01.
[2025-10-24T19:34:11.422056] [INFO ] [REMOTE    ] KMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:34:11.422408] [INFO ] [REMOTE    ] KMX: Fetching primary data for 2025-01.
[2025-10-24T19:34:12.375584] [INFO ] [REMOTE    ] KMPR: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T19:34:12.381283] [INFO ] [REMOTE    ] KMPR: Fetching primary data for 2025-02.
[2025-10-24T19:34:12.902526] [INFO ] [REMOTE    ] KN: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T19:34:12.910070] [INFO ] [REMOTE    ] KN: Fetching primary data for 2025-02.
[2025-10-24T19:34:13.052096] [INFO ] [REMOTE    ] KMT: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T19:34:13.060501] [INFO ] [REMOTE    ] KMT: Fetching primary data for 2025-02.
[2025-10-24T19:34:13.305540] [INFO ] [REMOTE    ] KMX: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T19:34:13.315446] [INFO ] [REMOTE    ] KMX: Fetching primary data for 2025-02.
[2025-10-24T19:34:13.623350] [INFO ] [REMOTE    ] KMPR: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T19:34:13.629193] [INFO ] [REMOTE    ] KMPR: Fetching primary data for 2025-03.
[2025-10-24T19:34:14.060217] [INFO ] [REMOTE    ] KN: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T19:34:14.068118] [INFO ] [REMOTE    ] KN: Fetching primary data for 2025-03.
[2025-10-24T19:34:14.237219] [INFO ] [REMOTE    ] KMT: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T19:34:14.245798] [INFO ] [REMOTE    ] KMT: Fetching primary data for 2025-03.
[2025-10-24T19:34:14.791767] [INFO ] [REMOTE    ] KMX: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T19:34:14.801253] [INFO ] [REMOTE    ] KMX: Fetching primary data for 2025-03.
[2025-10-24T19:34:14.828737] [INFO ] [REMOTE    ] KMPR: Incremental fetch complete for 2025-03 (1.20 seconds).
[2025-10-24T19:34:14.835453] [INFO ] [REMOTE    ] KMPR: Fetching primary data for 2025-04.
[2025-10-24T19:34:15.187688] [INFO ] [REMOTE    ] KN: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T19:34:15.196216] [INFO ] [REMOTE    ] KN: Fetching primary data for 2025-04.
[2025-10-24T19:34:15.362773] [INFO ] [REMOTE    ] KMT: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T19:34:15.371598] [INFO ] [REMOTE    ] KMT: Fetching primary data for 2025-04.
[2025-10-24T19:34:16.067025] [INFO ] [REMOTE    ] KMPR: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T19:34:16.147637] [INFO ] [REMOTE    ] KMPR: Fetching primary data for 2025-05.
[2025-10-24T19:34:16.464211] [INFO ] [REMOTE    ] KMX: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T19:34:16.821610] [INFO ] [REMOTE    ] KN: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T19:34:16.947632] [INFO ] [REMOTE    ] KN: Fetching primary data for 2025-05.
[2025-10-24T19:34:16.980356] [INFO ] [REMOTE    ] KMT: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T19:34:17.452503] [INFO ] [REMOTE    ] KMPR: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T19:34:17.747634] [INFO ] [REMOTE    ] KMT: Fetching primary data for 2025-05.
[2025-10-24T19:34:18.308994] [INFO ] [REMOTE    ] KN: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T19:34:18.547753] [INFO ] [REMOTE    ] KMX: Fetching primary data for 2025-04.
[2025-10-24T19:34:19.227127] [INFO ] [REMOTE    ] KMT: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T19:34:19.347624] [INFO ] [REMOTE    ] KMT: Fetching primary data for 2025-06.
[2025-10-24T19:34:20.147618] [INFO ] [REMOTE    ] KMPR: Fetching primary data for 2025-06.
[2025-10-24T19:34:20.336929] [INFO ] [REMOTE    ] KMX: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T19:34:20.826137] [INFO ] [REMOTE    ] KMT: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T19:34:20.942905] [INFO ] [REMOTE    ] KMPR: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T19:34:20.950227] [INFO ] [REMOTE    ] KMT: Fetching primary data for 2025-07.
[2025-10-24T19:34:21.747626] [INFO ] [REMOTE    ] KMPR: Fetching primary data for 2025-07.
[2025-10-24T19:34:22.376928] [INFO ] [REMOTE    ] KMT: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T19:34:22.547742] [INFO ] [REMOTE    ] KMT: Fetching primary data for 2025-08.
[2025-10-24T19:34:23.308310] [INFO ] [REMOTE    ] KMPR: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T19:34:23.347611] [INFO ] [REMOTE    ] KMPR: Fetching primary data for 2025-08.
[2025-10-24T19:34:23.939608] [INFO ] [REMOTE    ] KMT: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T19:34:24.147688] [INFO ] [REMOTE    ] KMT: Fetching primary data for 2025-09.
[2025-10-24T19:34:24.845956] [INFO ] [REMOTE    ] KMPR: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T19:34:24.947613] [INFO ] [REMOTE    ] KMPR: Fetching primary data for 2025-09.
[2025-10-24T19:34:25.644058] [INFO ] [REMOTE    ] KMT: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T19:34:25.747616] [INFO ] [REMOTE    ] KMX: Fetching primary data for 2025-05.
[2025-10-24T19:34:26.509144] [INFO ] [REMOTE    ] KMPR: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T19:34:26.547613] [INFO ] [REMOTE    ] KMPR: Fetching primary data for 2025-10.
[2025-10-24T19:34:27.070942] [INFO ] [REMOTE    ] KMX: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T19:34:27.347633] [INFO ] [REMOTE    ] KMX: Fetching primary data for 2025-06.
[2025-10-24T19:34:28.124192] [INFO ] [REMOTE    ] KMPR: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T19:34:28.132491] [INFO ] [REMOTE    ] KMPR: Full fetch complete (53754 records).
[2025-10-24T19:34:28.132687] [DEBUG] [VALIDATOR ] KMPR: Validating primary data.
[2025-10-24T19:34:28.154219] [INFO ] [REMOTE    ] KMT: Fetching primary data for 2025-10.
[2025-10-24T19:34:28.515833] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present.
[2025-10-24T19:34:28.515906] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed.
[2025-10-24T19:34:28.516754] [INFO ] [MAIN      ] KMPR: Fetched primary data is valid.
[2025-10-24T19:34:28.516818] [DEBUG] [LOCAL     ] KMPR: Saving primary data.
[2025-10-24T19:34:28.517268] [FATAL] [LOCAL     ] KMPR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:34:28.517352] [FATAL] [MAIN      ] KMPR: Failed to save primary data.
[2025-10-24T19:34:28.517392] [WARN ] [MAIN      ] KMPR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:34:28.517425] [INFO ] [LOCAL     ] KMPR: Starting deletion of primary data.
[2025-10-24T19:34:28.517474] [DEBUG] [LOCAL     ] KMPR: No primary data file found to delete.
[2025-10-24T19:34:28.517507] [INFO ] [LOCAL     ] KMPR: Starting deletion of derivative data.
[2025-10-24T19:34:28.517682] [DEBUG] [LOCAL     ] KMPR: Deleted derivative data file.
[2025-10-24T19:34:28.517774] [INFO ] [MAIN      ] Update Progress: 1201/2366 symbols completed. KMPR took 20.5s. Estimated remaining: 2h 29m 48s. Rate: 7.8 symbols/min
[2025-10-24T19:34:28.683464] [INFO ] [MAIN      ] KNF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:34:28.717373] [DEBUG] [LOCAL     ] KNF: Loaded 36958 existing records from primary storage.
[2025-10-24T19:34:28.717635] [INFO ] [MAIN      ] KNF: Loaded 36958 existing records.
[2025-10-24T19:34:28.896781] [WARN ] [MAIN      ] KNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:34:28.896984] [INFO ] [MAIN      ] KNF: Wiping existing primary data before full refresh.
[2025-10-24T19:34:28.897153] [INFO ] [LOCAL     ] KNF: Starting deletion of primary data.
[2025-10-24T19:34:28.901263] [DEBUG] [LOCAL     ] KNF: Deleted primary data file.
[2025-10-24T19:34:28.901356] [INFO ] [MAIN      ] KNF: Starting full primary refresh.
[2025-10-24T19:34:28.956076] [INFO ] [REMOTE    ] KN: Fetching primary data for 2025-06.
[2025-10-24T19:34:29.219226] [INFO ] [REMOTE    ] KMX: Incremental fetch complete for 2025-06 (1.87 seconds).
[2025-10-24T19:34:29.307060] [INFO ] [REMOTE    ] KNF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:34:29.554702] [INFO ] [REMOTE    ] KMT: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T19:34:29.563004] [INFO ] [REMOTE    ] KMT: Full fetch complete (61891 records).
[2025-10-24T19:34:29.563157] [DEBUG] [VALIDATOR ] KMT: Validating primary data.
[2025-10-24T19:34:29.753736] [INFO ] [REMOTE    ] KNF: Fetching primary data for 2025-01.
[2025-10-24T19:34:29.961299] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present.
[2025-10-24T19:34:29.961377] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed.
[2025-10-24T19:34:29.962382] [INFO ] [MAIN      ] KMT: Fetched primary data is valid.
[2025-10-24T19:34:29.962443] [DEBUG] [LOCAL     ] KMT: Saving primary data.
[2025-10-24T19:34:29.962950] [FATAL] [LOCAL     ] KMT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:34:29.963039] [FATAL] [MAIN      ] KMT: Failed to save primary data.
[2025-10-24T19:34:29.963080] [WARN ] [MAIN      ] KMT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:34:29.963113] [INFO ] [LOCAL     ] KMT: Starting deletion of primary data.
[2025-10-24T19:34:29.963164] [DEBUG] [LOCAL     ] KMT: No primary data file found to delete.
[2025-10-24T19:34:29.963199] [INFO ] [LOCAL     ] KMT: Starting deletion of derivative data.
[2025-10-24T19:34:29.963343] [DEBUG] [LOCAL     ] KMT: Deleted derivative data file.
[2025-10-24T19:34:29.963621] [INFO ] [MAIN      ] Update Progress: 1202/2366 symbols completed. KMT took 21.9s. Estimated remaining: 2h 29m 34s. Rate: 7.8 symbols/min
[2025-10-24T19:34:30.132134] [INFO ] [MAIN      ] KNOP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:34:30.144380] [DEBUG] [LOCAL     ] KNOP: Loaded 10130 existing records from primary storage.
[2025-10-24T19:34:30.144604] [INFO ] [MAIN      ] KNOP: Loaded 10130 existing records.
[2025-10-24T19:34:30.322258] [WARN ] [MAIN      ] KNOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:34:30.322698] [INFO ] [MAIN      ] KNOP: Wiping existing primary data before full refresh.
[2025-10-24T19:34:30.322840] [INFO ] [LOCAL     ] KNOP: Starting deletion of primary data.
[2025-10-24T19:34:30.330201] [DEBUG] [LOCAL     ] KNOP: Deleted primary data file.
[2025-10-24T19:34:30.341371] [INFO ] [MAIN      ] KNOP: Starting full primary refresh.
[2025-10-24T19:34:30.389406] [INFO ] [REMOTE    ] KN: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T19:34:30.552830] [INFO ] [REMOTE    ] KMX: Fetching primary data for 2025-07.
[2025-10-24T19:34:30.708927] [INFO ] [REMOTE    ] KNOP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:34:30.815247] [INFO ] [REMOTE    ] KNF: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T19:34:31.347633] [INFO ] [REMOTE    ] KN: Fetching primary data for 2025-07.
[2025-10-24T19:34:32.147618] [INFO ] [REMOTE    ] KNOP: Fetching primary data for 2025-01.
[2025-10-24T19:34:32.439786] [INFO ] [REMOTE    ] KMX: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T19:34:32.645074] [INFO ] [REMOTE    ] KN: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T19:34:32.947681] [INFO ] [REMOTE    ] KMX: Fetching primary data for 2025-08.
[2025-10-24T19:34:33.058886] [INFO ] [REMOTE    ] KNOP: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T19:34:33.747617] [INFO ] [REMOTE    ] KNOP: Fetching primary data for 2025-02.
[2025-10-24T19:34:34.479460] [INFO ] [REMOTE    ] KNOP: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T19:34:34.482930] [INFO ] [REMOTE    ] KMX: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T19:34:34.547694] [INFO ] [REMOTE    ] KMX: Fetching primary data for 2025-09.
[2025-10-24T19:34:35.347744] [INFO ] [REMOTE    ] KN: Fetching primary data for 2025-08.
[2025-10-24T19:34:36.147726] [INFO ] [REMOTE    ] KNOP: Fetching primary data for 2025-03.
[2025-10-24T19:34:36.288033] [INFO ] [REMOTE    ] KMX: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T19:34:36.710311] [INFO ] [REMOTE    ] KN: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T19:34:36.947729] [INFO ] [REMOTE    ] KNF: Fetching primary data for 2025-02.
[2025-10-24T19:34:36.977141] [INFO ] [REMOTE    ] KNOP: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T19:34:37.747695] [INFO ] [REMOTE    ] KN: Fetching primary data for 2025-09.
[2025-10-24T19:34:38.133834] [INFO ] [REMOTE    ] KNF: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T19:34:38.547724] [INFO ] [REMOTE    ] KMX: Fetching primary data for 2025-10.
[2025-10-24T19:34:39.251824] [INFO ] [REMOTE    ] KN: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T19:34:39.347608] [INFO ] [REMOTE    ] KN: Fetching primary data for 2025-10.
[2025-10-24T19:34:40.147614] [INFO ] [REMOTE    ] KNF: Fetching primary data for 2025-03.
[2025-10-24T19:34:40.538480] [INFO ] [REMOTE    ] KMX: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T19:34:40.548900] [INFO ] [REMOTE    ] KMX: Full fetch complete (76415 records).
[2025-10-24T19:34:40.549031] [DEBUG] [VALIDATOR ] KMX: Validating primary data.
[2025-10-24T19:34:40.946038] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present.
[2025-10-24T19:34:40.946155] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed.
[2025-10-24T19:34:40.947369] [INFO ] [MAIN      ] KMX: Fetched primary data is valid.
[2025-10-24T19:34:40.947470] [DEBUG] [LOCAL     ] KMX: Saving primary data.
[2025-10-24T19:34:40.948506] [FATAL] [LOCAL     ] KMX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:34:40.947692] [INFO ] [REMOTE    ] KNOP: Fetching primary data for 2025-04.
[2025-10-24T19:34:40.948883] [FATAL] [MAIN      ] KMX: Failed to save primary data.
[2025-10-24T19:34:40.955486] [WARN ] [MAIN      ] KMX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:34:40.968495] [INFO ] [LOCAL     ] KMX: Starting deletion of primary data.
[2025-10-24T19:34:40.971273] [DEBUG] [LOCAL     ] KMX: No primary data file found to delete.
[2025-10-24T19:34:40.971638] [INFO ] [LOCAL     ] KMX: Starting deletion of derivative data.
[2025-10-24T19:34:40.972620] [DEBUG] [LOCAL     ] KMX: Deleted derivative data file.
[2025-10-24T19:34:40.973572] [INFO ] [REMOTE    ] KN: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T19:34:40.974026] [INFO ] [MAIN      ] Update Progress: 1203/2366 symbols completed. KMX took 32.9s. Estimated remaining: 2h 29m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:34:41.014599] [INFO ] [REMOTE    ] KN: Full fetch complete (56806 records).
[2025-10-24T19:34:41.053522] [DEBUG] [VALIDATOR ] KN: Validating primary data.
[2025-10-24T19:34:41.270053] [INFO ] [MAIN      ] KNSL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:34:41.471177] [DEBUG] [LOCAL     ] KNSL: Loaded 18471 existing records from primary storage.
[2025-10-24T19:34:41.490356] [INFO ] [MAIN      ] KNSL: Loaded 18471 existing records.
[2025-10-24T19:34:41.694954] [DEBUG] [VALIDATOR ] KN: All expected trading days are present.
[2025-10-24T19:34:41.716304] [DEBUG] [VALIDATOR ] KN: Primary data validation passed.
[2025-10-24T19:34:41.747928] [INFO ] [MAIN      ] KN: Fetched primary data is valid.
[2025-10-24T19:34:41.757068] [DEBUG] [LOCAL     ] KN: Saving primary data.
[2025-10-24T19:34:41.779461] [FATAL] [LOCAL     ] KN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:34:41.779268] [WARN ] [MAIN      ] KNSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:34:41.779799] [INFO ] [MAIN      ] KNSL: Wiping existing primary data before full refresh.
[2025-10-24T19:34:41.779911] [FATAL] [MAIN      ] KN: Failed to save primary data.
[2025-10-24T19:34:41.780046] [WARN ] [MAIN      ] KN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:34:41.780303] [INFO ] [LOCAL     ] KNSL: Starting deletion of primary data.
[2025-10-24T19:34:41.780250] [INFO ] [LOCAL     ] KN: Starting deletion of primary data.
[2025-10-24T19:34:41.780586] [DEBUG] [LOCAL     ] KN: No primary data file found to delete.
[2025-10-24T19:34:41.780684] [INFO ] [LOCAL     ] KN: Starting deletion of derivative data.
[2025-10-24T19:34:41.780960] [DEBUG] [LOCAL     ] KN: Deleted derivative data file.
[2025-10-24T19:34:41.780993] [DEBUG] [LOCAL     ] KNSL: Deleted primary data file.
[2025-10-24T19:34:41.781140] [INFO ] [MAIN      ] KNSL: Starting full primary refresh.
[2025-10-24T19:34:41.867013] [INFO ] [MAIN      ] Update Progress: 1204/2366 symbols completed. KN took 33.8s. Estimated remaining: 2h 29m 15s. Rate: 7.8 symbols/min
[2025-10-24T19:34:41.883741] [INFO ] [REMOTE    ] KNF: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T19:34:41.996447] [INFO ] [REMOTE    ] KNF: Fetching primary data for 2025-04.
[2025-10-24T19:34:42.133754] [INFO ] [REMOTE    ] KNOP: Incremental fetch complete for 2025-04 (1.19 seconds).
[2025-10-24T19:34:42.314457] [INFO ] [MAIN      ] KNTK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:34:42.378401] [INFO ] [REMOTE    ] KNSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:34:42.417961] [DEBUG] [LOCAL     ] KNTK: Loaded 47587 existing records from primary storage.
[2025-10-24T19:34:42.418247] [INFO ] [MAIN      ] KNTK: Loaded 47587 existing records.
[2025-10-24T19:34:42.560509] [INFO ] [REMOTE    ] KNSL: Fetching primary data for 2025-01.
[2025-10-24T19:34:42.602041] [WARN ] [MAIN      ] KNTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:34:42.602256] [INFO ] [MAIN      ] KNTK: Wiping existing primary data before full refresh.
[2025-10-24T19:34:42.602314] [INFO ] [LOCAL     ] KNTK: Starting deletion of primary data.
[2025-10-24T19:34:42.602799] [DEBUG] [LOCAL     ] KNTK: Deleted primary data file.
[2025-10-24T19:34:42.602855] [INFO ] [MAIN      ] KNTK: Starting full primary refresh.
[2025-10-24T19:34:42.953816] [INFO ] [REMOTE    ] KNTK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:34:43.347627] [INFO ] [REMOTE    ] KNTK: Fetching primary data for 2025-01.
[2025-10-24T19:34:43.486543] [INFO ] [REMOTE    ] KNF: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T19:34:43.835567] [INFO ] [REMOTE    ] KNSL: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T19:34:44.147711] [INFO ] [REMOTE    ] KNSL: Fetching primary data for 2025-02.
[2025-10-24T19:34:44.418684] [INFO ] [REMOTE    ] KNTK: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T19:34:44.947706] [INFO ] [REMOTE    ] KNOP: Fetching primary data for 2025-05.
[2025-10-24T19:34:45.150360] [INFO ] [REMOTE    ] KNSL: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T19:34:45.690679] [INFO ] [REMOTE    ] KNOP: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T19:34:45.747594] [INFO ] [REMOTE    ] KNOP: Fetching primary data for 2025-06.
[2025-10-24T19:34:46.424989] [INFO ] [REMOTE    ] KNOP: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T19:34:46.547674] [INFO ] [REMOTE    ] KNF: Fetching primary data for 2025-05.
[2025-10-24T19:34:47.347730] [INFO ] [REMOTE    ] KNOP: Fetching primary data for 2025-07.
[2025-10-24T19:34:47.838726] [INFO ] [REMOTE    ] KNF: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T19:34:48.139330] [INFO ] [REMOTE    ] KNOP: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T19:34:48.147601] [INFO ] [REMOTE    ] KNSL: Fetching primary data for 2025-03.
[2025-10-24T19:34:48.947745] [INFO ] [REMOTE    ] KNTK: Fetching primary data for 2025-02.
[2025-10-24T19:34:49.174685] [INFO ] [REMOTE    ] KNSL: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T19:34:49.747694] [INFO ] [REMOTE    ] KNF: Fetching primary data for 2025-06.
[2025-10-24T19:34:50.428913] [INFO ] [REMOTE    ] KNTK: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T19:34:50.547678] [INFO ] [REMOTE    ] KNTK: Fetching primary data for 2025-03.
[2025-10-24T19:34:50.578621] [INFO ] [REMOTE    ] KNF: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T19:34:51.347732] [INFO ] [REMOTE    ] KNF: Fetching primary data for 2025-07.
[2025-10-24T19:34:51.992006] [INFO ] [REMOTE    ] KNTK: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T19:34:52.147717] [INFO ] [REMOTE    ] KNTK: Fetching primary data for 2025-04.
[2025-10-24T19:34:52.209429] [INFO ] [REMOTE    ] KNF: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T19:34:52.947711] [INFO ] [REMOTE    ] KNOP: Fetching primary data for 2025-08.
[2025-10-24T19:34:53.628233] [INFO ] [REMOTE    ] KNTK: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T19:34:53.643554] [INFO ] [REMOTE    ] KNOP: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T19:34:53.747629] [INFO ] [REMOTE    ] KNTK: Fetching primary data for 2025-05.
[2025-10-24T19:34:54.547713] [INFO ] [REMOTE    ] KNSL: Fetching primary data for 2025-04.
[2025-10-24T19:34:55.336087] [INFO ] [REMOTE    ] KNTK: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T19:34:55.347601] [INFO ] [REMOTE    ] KNTK: Fetching primary data for 2025-06.
[2025-10-24T19:34:55.508572] [INFO ] [REMOTE    ] KNSL: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T19:34:56.147691] [INFO ] [REMOTE    ] KNF: Fetching primary data for 2025-08.
[2025-10-24T19:34:56.929810] [INFO ] [REMOTE    ] KNTK: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T19:34:56.947604] [INFO ] [REMOTE    ] KNTK: Fetching primary data for 2025-07.
[2025-10-24T19:34:57.513167] [INFO ] [REMOTE    ] KNF: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T19:34:57.747731] [INFO ] [REMOTE    ] KNOP: Fetching primary data for 2025-09.
[2025-10-24T19:34:58.504275] [INFO ] [REMOTE    ] KNTK: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T19:34:58.546922] [INFO ] [REMOTE    ] KNOP: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T19:34:58.549810] [INFO ] [REMOTE    ] KNSL: Fetching primary data for 2025-05.
[2025-10-24T19:34:59.347680] [INFO ] [REMOTE    ] KNTK: Fetching primary data for 2025-08.
[2025-10-24T19:34:59.681366] [INFO ] [REMOTE    ] KNSL: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T19:35:00.147733] [INFO ] [REMOTE    ] KNSL: Fetching primary data for 2025-06.
[2025-10-24T19:35:00.653437] [INFO ] [REMOTE    ] KNTK: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T19:35:00.947620] [INFO ] [REMOTE    ] KNTK: Fetching primary data for 2025-09.
[2025-10-24T19:35:01.273427] [INFO ] [REMOTE    ] KNSL: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T19:35:01.747733] [INFO ] [REMOTE    ] KNSL: Fetching primary data for 2025-07.
[2025-10-24T19:35:02.547742] [INFO ] [REMOTE    ] KNF: Fetching primary data for 2025-09.
[2025-10-24T19:35:02.719145] [INFO ] [REMOTE    ] KNTK: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T19:35:02.788631] [INFO ] [REMOTE    ] KNSL: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T19:35:03.347707] [INFO ] [REMOTE    ] KNSL: Fetching primary data for 2025-08.
[2025-10-24T19:35:04.147622] [INFO ] [REMOTE    ] KNOP: Fetching primary data for 2025-10.
[2025-10-24T19:35:04.393488] [INFO ] [REMOTE    ] KNSL: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T19:35:04.435270] [INFO ] [REMOTE    ] KNF: Incremental fetch complete for 2025-09 (1.89 seconds).
[2025-10-24T19:35:04.920025] [INFO ] [REMOTE    ] KNOP: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T19:35:04.922669] [INFO ] [REMOTE    ] KNOP: Full fetch complete (14655 records).
[2025-10-24T19:35:04.922741] [DEBUG] [VALIDATOR ] KNOP: Validating primary data.
[2025-10-24T19:35:04.952820] [INFO ] [REMOTE    ] KNSL: Fetching primary data for 2025-09.
[2025-10-24T19:35:05.285299] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present.
[2025-10-24T19:35:05.285400] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed.
[2025-10-24T19:35:05.285746] [INFO ] [MAIN      ] KNOP: Fetched primary data is valid.
[2025-10-24T19:35:05.285807] [DEBUG] [LOCAL     ] KNOP: Saving primary data.
[2025-10-24T19:35:05.286028] [FATAL] [LOCAL     ] KNOP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:35:05.286107] [FATAL] [MAIN      ] KNOP: Failed to save primary data.
[2025-10-24T19:35:05.286148] [WARN ] [MAIN      ] KNOP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:35:05.286182] [INFO ] [LOCAL     ] KNOP: Starting deletion of primary data.
[2025-10-24T19:35:05.286231] [DEBUG] [LOCAL     ] KNOP: No primary data file found to delete.
[2025-10-24T19:35:05.286265] [INFO ] [LOCAL     ] KNOP: Starting deletion of derivative data.
[2025-10-24T19:35:05.286393] [DEBUG] [LOCAL     ] KNOP: Deleted derivative data file.
[2025-10-24T19:35:05.286462] [INFO ] [MAIN      ] Update Progress: 1205/2366 symbols completed. KNOP took 35.3s. Estimated remaining: 2h 29m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:35:05.456545] [INFO ] [MAIN      ] KNX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:35:05.512233] [DEBUG] [LOCAL     ] KNX: Loaded 53035 existing records from primary storage.
[2025-10-24T19:35:05.512683] [INFO ] [MAIN      ] KNX: Loaded 53035 existing records.
[2025-10-24T19:35:05.691969] [WARN ] [MAIN      ] KNX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:35:05.692194] [INFO ] [MAIN      ] KNX: Wiping existing primary data before full refresh.
[2025-10-24T19:35:05.692240] [INFO ] [LOCAL     ] KNX: Starting deletion of primary data.
[2025-10-24T19:35:05.692773] [DEBUG] [LOCAL     ] KNX: Deleted primary data file.
[2025-10-24T19:35:05.692835] [INFO ] [MAIN      ] KNX: Starting full primary refresh.
[2025-10-24T19:35:05.755557] [INFO ] [REMOTE    ] KNF: Fetching primary data for 2025-10.
[2025-10-24T19:35:06.052949] [INFO ] [REMOTE    ] KNX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:35:06.130308] [INFO ] [REMOTE    ] KNSL: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T19:35:06.547687] [INFO ] [REMOTE    ] KNX: Fetching primary data for 2025-01.
[2025-10-24T19:35:07.347620] [INFO ] [REMOTE    ] KNSL: Fetching primary data for 2025-10.
[2025-10-24T19:35:07.571572] [INFO ] [REMOTE    ] KNF: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T19:35:07.579097] [INFO ] [REMOTE    ] KNF: Full fetch complete (51538 records).
[2025-10-24T19:35:07.579205] [DEBUG] [VALIDATOR ] KNF: Validating primary data.
[2025-10-24T19:35:08.003760] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present.
[2025-10-24T19:35:08.003851] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed.
[2025-10-24T19:35:08.004724] [INFO ] [MAIN      ] KNF: Fetched primary data is valid.
[2025-10-24T19:35:08.004786] [DEBUG] [LOCAL     ] KNF: Saving primary data.
[2025-10-24T19:35:08.005225] [FATAL] [LOCAL     ] KNF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:35:08.005309] [FATAL] [MAIN      ] KNF: Failed to save primary data.
[2025-10-24T19:35:08.005404] [WARN ] [MAIN      ] KNF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:35:08.005463] [INFO ] [LOCAL     ] KNF: Starting deletion of primary data.
[2025-10-24T19:35:08.005533] [DEBUG] [LOCAL     ] KNF: No primary data file found to delete.
[2025-10-24T19:35:08.005598] [INFO ] [LOCAL     ] KNF: Starting deletion of derivative data.
[2025-10-24T19:35:08.005857] [DEBUG] [LOCAL     ] KNF: Deleted derivative data file.
[2025-10-24T19:35:08.005956] [INFO ] [MAIN      ] Update Progress: 1206/2366 symbols completed. KNF took 39.5s. Estimated remaining: 2h 29m 10s. Rate: 7.8 symbols/min
[2025-10-24T19:35:08.151738] [INFO ] [REMOTE    ] KNTK: Fetching primary data for 2025-10.
[2025-10-24T19:35:08.183614] [INFO ] [MAIN      ] KO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:35:08.183882] [DEBUG] [LOCAL     ] KO: No existing data file found in primary storage.
[2025-10-24T19:35:08.183937] [WARN ] [MAIN      ] KO: No existing data found, performing full refresh instead.
[2025-10-24T19:35:08.184053] [INFO ] [MAIN      ] KO: Wiping existing primary data before full refresh.
[2025-10-24T19:35:08.184096] [INFO ] [LOCAL     ] KO: Starting deletion of primary data.
[2025-10-24T19:35:08.184138] [DEBUG] [LOCAL     ] KO: No primary data file found to delete.
[2025-10-24T19:35:08.184170] [INFO ] [MAIN      ] KO: Starting full primary refresh.
[2025-10-24T19:35:08.542201] [INFO ] [REMOTE    ] KO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:35:08.612421] [INFO ] [REMOTE    ] KNX: Incremental fetch complete for 2025-01 (2.06 seconds).
[2025-10-24T19:35:08.654729] [INFO ] [REMOTE    ] KNSL: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T19:35:08.658969] [INFO ] [REMOTE    ] KNSL: Full fetch complete (27168 records).
[2025-10-24T19:35:08.659052] [DEBUG] [VALIDATOR ] KNSL: Validating primary data.
[2025-10-24T19:35:08.948420] [INFO ] [REMOTE    ] KO: Fetching primary data for 2025-01.
[2025-10-24T19:35:09.032461] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present.
[2025-10-24T19:35:09.032535] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed.
[2025-10-24T19:35:09.033097] [INFO ] [MAIN      ] KNSL: Fetched primary data is valid.
[2025-10-24T19:35:09.033158] [DEBUG] [LOCAL     ] KNSL: Saving primary data.
[2025-10-24T19:35:09.033445] [FATAL] [LOCAL     ] KNSL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:35:09.033531] [FATAL] [MAIN      ] KNSL: Failed to save primary data.
[2025-10-24T19:35:09.033572] [WARN ] [MAIN      ] KNSL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:35:09.033607] [INFO ] [LOCAL     ] KNSL: Starting deletion of primary data.
[2025-10-24T19:35:09.033678] [DEBUG] [LOCAL     ] KNSL: No primary data file found to delete.
[2025-10-24T19:35:09.033734] [INFO ] [LOCAL     ] KNSL: Starting deletion of derivative data.
[2025-10-24T19:35:09.033889] [DEBUG] [LOCAL     ] KNSL: Deleted derivative data file.
[2025-10-24T19:35:09.033980] [INFO ] [MAIN      ] Update Progress: 1207/2366 symbols completed. KNSL took 28.1s. Estimated remaining: 2h 28m 56s. Rate: 7.8 symbols/min
[2025-10-24T19:35:09.206198] [INFO ] [MAIN      ] KODK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:35:09.249290] [DEBUG] [LOCAL     ] KODK: Loaded 44027 existing records from primary storage.
[2025-10-24T19:35:09.249578] [INFO ] [MAIN      ] KODK: Loaded 44027 existing records.
[2025-10-24T19:35:09.428135] [WARN ] [MAIN      ] KODK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:35:09.428320] [INFO ] [MAIN      ] KODK: Wiping existing primary data before full refresh.
[2025-10-24T19:35:09.428366] [INFO ] [LOCAL     ] KODK: Starting deletion of primary data.
[2025-10-24T19:35:09.429044] [DEBUG] [LOCAL     ] KODK: Deleted primary data file.
[2025-10-24T19:35:09.429115] [INFO ] [MAIN      ] KODK: Starting full primary refresh.
[2025-10-24T19:35:09.756953] [INFO ] [REMOTE    ] KNX: Fetching primary data for 2025-02.
[2025-10-24T19:35:09.786852] [INFO ] [REMOTE    ] KODK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:35:10.295959] [INFO ] [REMOTE    ] KNTK: Incremental fetch complete for 2025-10 (2.14 seconds).
[2025-10-24T19:35:10.304833] [INFO ] [REMOTE    ] KNTK: Full fetch complete (66025 records).
[2025-10-24T19:35:10.304957] [DEBUG] [VALIDATOR ] KNTK: Validating primary data.
[2025-10-24T19:35:10.566750] [INFO ] [REMOTE    ] KODK: Fetching primary data for 2025-01.
[2025-10-24T19:35:10.702331] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present.
[2025-10-24T19:35:10.702413] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed.
[2025-10-24T19:35:10.703505] [INFO ] [MAIN      ] KNTK: Fetched primary data is valid.
[2025-10-24T19:35:10.703591] [DEBUG] [LOCAL     ] KNTK: Saving primary data.
[2025-10-24T19:35:10.704198] [FATAL] [LOCAL     ] KNTK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:35:10.704290] [FATAL] [MAIN      ] KNTK: Failed to save primary data.
[2025-10-24T19:35:10.704333] [WARN ] [MAIN      ] KNTK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:35:10.704369] [INFO ] [LOCAL     ] KNTK: Starting deletion of primary data.
[2025-10-24T19:35:10.704422] [DEBUG] [LOCAL     ] KNTK: No primary data file found to delete.
[2025-10-24T19:35:10.704458] [INFO ] [LOCAL     ] KNTK: Starting deletion of derivative data.
[2025-10-24T19:35:10.704625] [DEBUG] [LOCAL     ] KNTK: Deleted derivative data file.
[2025-10-24T19:35:10.705034] [INFO ] [MAIN      ] Update Progress: 1208/2366 symbols completed. KNTK took 28.8s. Estimated remaining: 2h 28m 43s. Rate: 7.8 symbols/min
[2025-10-24T19:35:10.881605] [INFO ] [MAIN      ] KOF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:35:10.910752] [DEBUG] [LOCAL     ] KOF: Loaded 26676 existing records from primary storage.
[2025-10-24T19:35:10.911019] [INFO ] [MAIN      ] KOF: Loaded 26676 existing records.
[2025-10-24T19:35:11.099959] [WARN ] [MAIN      ] KOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:35:11.100389] [INFO ] [MAIN      ] KOF: Wiping existing primary data before full refresh.
[2025-10-24T19:35:11.100617] [INFO ] [LOCAL     ] KOF: Starting deletion of primary data.
[2025-10-24T19:35:11.100952] [DEBUG] [LOCAL     ] KOF: Deleted primary data file.
[2025-10-24T19:35:11.101087] [INFO ] [MAIN      ] KOF: Starting full primary refresh.
[2025-10-24T19:35:11.423752] [INFO ] [REMOTE    ] KO: Incremental fetch complete for 2025-01 (2.48 seconds).
[2025-10-24T19:35:11.510533] [INFO ] [REMOTE    ] KO: Fetching primary data for 2025-02.
[2025-10-24T19:35:11.516045] [INFO ] [REMOTE    ] KOF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:35:11.548746] [INFO ] [REMOTE    ] KNX: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T19:35:12.147624] [INFO ] [REMOTE    ] KOF: Fetching primary data for 2025-01.
[2025-10-24T19:35:12.249221] [INFO ] [REMOTE    ] KODK: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T19:35:12.947703] [INFO ] [REMOTE    ] KNX: Fetching primary data for 2025-03.
[2025-10-24T19:35:13.634310] [INFO ] [REMOTE    ] KOF: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T19:35:13.747618] [INFO ] [REMOTE    ] KODK: Fetching primary data for 2025-02.
[2025-10-24T19:35:13.941977] [INFO ] [REMOTE    ] KO: Incremental fetch complete for 2025-02 (2.43 seconds).
[2025-10-24T19:35:14.547733] [INFO ] [REMOTE    ] KO: Fetching primary data for 2025-03.
[2025-10-24T19:35:14.674568] [INFO ] [REMOTE    ] KNX: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T19:35:15.273103] [INFO ] [REMOTE    ] KODK: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T19:35:15.347691] [INFO ] [REMOTE    ] KOF: Fetching primary data for 2025-02.
[2025-10-24T19:35:16.147748] [INFO ] [REMOTE    ] KNX: Fetching primary data for 2025-04.
[2025-10-24T19:35:16.632243] [INFO ] [REMOTE    ] KOF: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T19:35:16.947630] [INFO ] [REMOTE    ] KOF: Fetching primary data for 2025-03.
[2025-10-24T19:35:17.283869] [INFO ] [REMOTE    ] KO: Incremental fetch complete for 2025-03 (2.74 seconds).
[2025-10-24T19:35:17.747607] [INFO ] [REMOTE    ] KO: Fetching primary data for 2025-04.
[2025-10-24T19:35:17.867080] [INFO ] [REMOTE    ] KNX: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T19:35:18.077119] [INFO ] [REMOTE    ] KOF: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T19:35:18.547742] [INFO ] [REMOTE    ] KODK: Fetching primary data for 2025-03.
[2025-10-24T19:35:19.347748] [INFO ] [REMOTE    ] KNX: Fetching primary data for 2025-05.
[2025-10-24T19:35:20.000349] [INFO ] [REMOTE    ] KODK: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T19:35:20.147621] [INFO ] [REMOTE    ] KODK: Fetching primary data for 2025-04.
[2025-10-24T19:35:20.393671] [INFO ] [REMOTE    ] KO: Incremental fetch complete for 2025-04 (2.65 seconds).
[2025-10-24T19:35:20.739173] [INFO ] [REMOTE    ] KNX: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T19:35:20.947690] [INFO ] [REMOTE    ] KOF: Fetching primary data for 2025-04.
[2025-10-24T19:35:21.737915] [INFO ] [REMOTE    ] KODK: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T19:35:21.747538] [INFO ] [REMOTE    ] KODK: Fetching primary data for 2025-05.
[2025-10-24T19:35:22.034530] [INFO ] [REMOTE    ] KOF: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T19:35:22.547703] [INFO ] [REMOTE    ] KO: Fetching primary data for 2025-05.
[2025-10-24T19:35:23.186056] [INFO ] [REMOTE    ] KODK: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T19:35:23.347710] [INFO ] [REMOTE    ] KODK: Fetching primary data for 2025-06.
[2025-10-24T19:35:24.147679] [INFO ] [REMOTE    ] KOF: Fetching primary data for 2025-05.
[2025-10-24T19:35:24.799186] [INFO ] [REMOTE    ] KO: Incremental fetch complete for 2025-05 (2.25 seconds).
[2025-10-24T19:35:24.831051] [INFO ] [REMOTE    ] KODK: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T19:35:24.947639] [INFO ] [REMOTE    ] KNX: Fetching primary data for 2025-06.
[2025-10-24T19:35:25.314406] [INFO ] [REMOTE    ] KOF: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T19:35:25.747677] [INFO ] [REMOTE    ] KOF: Fetching primary data for 2025-06.
[2025-10-24T19:35:26.547720] [INFO ] [REMOTE    ] KODK: Fetching primary data for 2025-07.
[2025-10-24T19:35:26.681357] [INFO ] [REMOTE    ] KNX: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T19:35:26.761857] [INFO ] [REMOTE    ] KOF: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T19:35:27.347676] [INFO ] [REMOTE    ] KO: Fetching primary data for 2025-06.
[2025-10-24T19:35:28.147613] [INFO ] [REMOTE    ] KOF: Fetching primary data for 2025-07.
[2025-10-24T19:35:28.251129] [INFO ] [REMOTE    ] KODK: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T19:35:28.947721] [INFO ] [REMOTE    ] KODK: Fetching primary data for 2025-08.
[2025-10-24T19:35:28.993819] [INFO ] [REMOTE    ] KOF: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T19:35:29.752762] [INFO ] [REMOTE    ] KOF: Fetching primary data for 2025-08.
[2025-10-24T19:35:29.776002] [INFO ] [REMOTE    ] KO: Incremental fetch complete for 2025-06 (2.43 seconds).
[2025-10-24T19:35:30.547687] [INFO ] [REMOTE    ] KO: Fetching primary data for 2025-07.
[2025-10-24T19:35:30.729713] [INFO ] [REMOTE    ] KODK: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T19:35:30.901988] [INFO ] [REMOTE    ] KOF: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T19:35:31.347677] [INFO ] [REMOTE    ] KNX: Fetching primary data for 2025-07.
[2025-10-24T19:35:32.147680] [INFO ] [REMOTE    ] KOF: Fetching primary data for 2025-09.
[2025-10-24T19:35:32.906353] [INFO ] [REMOTE    ] KO: Incremental fetch complete for 2025-07 (2.36 seconds).
[2025-10-24T19:35:32.947616] [INFO ] [REMOTE    ] KO: Fetching primary data for 2025-08.
[2025-10-24T19:35:33.209878] [INFO ] [REMOTE    ] KNX: Incremental fetch complete for 2025-07 (1.86 seconds).
[2025-10-24T19:35:33.350823] [INFO ] [REMOTE    ] KOF: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T19:35:33.747719] [INFO ] [REMOTE    ] KNX: Fetching primary data for 2025-08.
[2025-10-24T19:35:34.547638] [INFO ] [REMOTE    ] KODK: Fetching primary data for 2025-09.
[2025-10-24T19:35:35.347670] [INFO ] [REMOTE    ] KOF: Fetching primary data for 2025-10.
[2025-10-24T19:35:35.613731] [INFO ] [REMOTE    ] KNX: Incremental fetch complete for 2025-08 (1.87 seconds).
[2025-10-24T19:35:35.866323] [INFO ] [REMOTE    ] KO: Incremental fetch complete for 2025-08 (2.92 seconds).
[2025-10-24T19:35:36.111906] [INFO ] [REMOTE    ] KODK: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T19:35:36.147605] [INFO ] [REMOTE    ] KO: Fetching primary data for 2025-09.
[2025-10-24T19:35:36.294856] [INFO ] [REMOTE    ] KOF: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T19:35:36.300010] [INFO ] [REMOTE    ] KOF: Full fetch complete (37900 records).
[2025-10-24T19:35:36.300101] [DEBUG] [VALIDATOR ] KOF: Validating primary data.
[2025-10-24T19:35:36.675515] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present.
[2025-10-24T19:35:36.675588] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed.
[2025-10-24T19:35:36.676350] [INFO ] [MAIN      ] KOF: Fetched primary data is valid.
[2025-10-24T19:35:36.676411] [DEBUG] [LOCAL     ] KOF: Saving primary data.
[2025-10-24T19:35:36.676772] [FATAL] [LOCAL     ] KOF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:35:36.676855] [FATAL] [MAIN      ] KOF: Failed to save primary data.
[2025-10-24T19:35:36.676896] [WARN ] [MAIN      ] KOF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:35:36.676929] [INFO ] [LOCAL     ] KOF: Starting deletion of primary data.
[2025-10-24T19:35:36.676977] [DEBUG] [LOCAL     ] KOF: No primary data file found to delete.
[2025-10-24T19:35:36.677009] [INFO ] [LOCAL     ] KOF: Starting deletion of derivative data.
[2025-10-24T19:35:36.677158] [DEBUG] [LOCAL     ] KOF: Deleted derivative data file.
[2025-10-24T19:35:36.677248] [INFO ] [MAIN      ] Update Progress: 1209/2366 symbols completed. KOF took 26.0s. Estimated remaining: 2h 28m 52s. Rate: 7.8 symbols/min
[2025-10-24T19:35:36.844399] [INFO ] [MAIN      ] KOP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:35:36.864614] [DEBUG] [LOCAL     ] KOP: Loaded 17418 existing records from primary storage.
[2025-10-24T19:35:36.864869] [INFO ] [MAIN      ] KOP: Loaded 17418 existing records.
[2025-10-24T19:35:36.954781] [INFO ] [REMOTE    ] KODK: Fetching primary data for 2025-10.
[2025-10-24T19:35:37.043544] [WARN ] [MAIN      ] KOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:35:37.043757] [INFO ] [MAIN      ] KOP: Wiping existing primary data before full refresh.
[2025-10-24T19:35:37.043807] [INFO ] [LOCAL     ] KOP: Starting deletion of primary data.
[2025-10-24T19:35:37.044007] [DEBUG] [LOCAL     ] KOP: Deleted primary data file.
[2025-10-24T19:35:37.044044] [INFO ] [MAIN      ] KOP: Starting full primary refresh.
[2025-10-24T19:35:37.395446] [INFO ] [REMOTE    ] KOP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:35:37.747701] [INFO ] [REMOTE    ] KNX: Fetching primary data for 2025-09.
[2025-10-24T19:35:38.342289] [INFO ] [REMOTE    ] KO: Incremental fetch complete for 2025-09 (2.19 seconds).
[2025-10-24T19:35:38.547695] [INFO ] [REMOTE    ] KOP: Fetching primary data for 2025-01.
[2025-10-24T19:35:38.735502] [INFO ] [REMOTE    ] KODK: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T19:35:38.744494] [INFO ] [REMOTE    ] KODK: Full fetch complete (63277 records).
[2025-10-24T19:35:38.744675] [DEBUG] [VALIDATOR ] KODK: Validating primary data.
[2025-10-24T19:35:39.157912] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present.
[2025-10-24T19:35:39.158004] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed.
[2025-10-24T19:35:39.159081] [INFO ] [MAIN      ] KODK: Fetched primary data is valid.
[2025-10-24T19:35:39.159149] [DEBUG] [LOCAL     ] KODK: Saving primary data.
[2025-10-24T19:35:39.159779] [FATAL] [LOCAL     ] KODK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:35:39.159873] [FATAL] [MAIN      ] KODK: Failed to save primary data.
[2025-10-24T19:35:39.159915] [WARN ] [MAIN      ] KODK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:35:39.159951] [INFO ] [LOCAL     ] KODK: Starting deletion of primary data.
[2025-10-24T19:35:39.160005] [DEBUG] [LOCAL     ] KODK: No primary data file found to delete.
[2025-10-24T19:35:39.160041] [INFO ] [LOCAL     ] KODK: Starting deletion of derivative data.
[2025-10-24T19:35:39.160197] [DEBUG] [LOCAL     ] KODK: Deleted derivative data file.
[2025-10-24T19:35:39.160545] [INFO ] [MAIN      ] Update Progress: 1210/2366 symbols completed. KODK took 30.1s. Estimated remaining: 2h 28m 40s. Rate: 7.8 symbols/min
[2025-10-24T19:35:39.336396] [INFO ] [MAIN      ] KORE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:35:39.341150] [DEBUG] [LOCAL     ] KORE: Loaded 2189 existing records from primary storage.
[2025-10-24T19:35:39.341332] [INFO ] [MAIN      ] KORE: Loaded 2189 existing records.
[2025-10-24T19:35:39.347755] [INFO ] [REMOTE    ] KO: Fetching primary data for 2025-10.
[2025-10-24T19:35:39.539857] [WARN ] [MAIN      ] KORE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:35:39.540115] [INFO ] [MAIN      ] KORE: Wiping existing primary data before full refresh.
[2025-10-24T19:35:39.540351] [INFO ] [LOCAL     ] KORE: Starting deletion of primary data.
[2025-10-24T19:35:39.540602] [DEBUG] [LOCAL     ] KORE: Deleted primary data file.
[2025-10-24T19:35:39.540740] [INFO ] [MAIN      ] KORE: Starting full primary refresh.
[2025-10-24T19:35:39.948102] [INFO ] [REMOTE    ] KNX: Incremental fetch complete for 2025-09 (2.20 seconds).
[2025-10-24T19:35:39.961683] [INFO ] [REMOTE    ] KORE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:35:40.116961] [INFO ] [REMOTE    ] KOP: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T19:35:40.147605] [INFO ] [REMOTE    ] KOP: Fetching primary data for 2025-02.
[2025-10-24T19:35:40.922568] [INFO ] [REMOTE    ] KOP: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T19:35:40.947675] [INFO ] [REMOTE    ] KORE: Fetching primary data for 2025-01.
[2025-10-24T19:35:41.747718] [INFO ] [REMOTE    ] KNX: Fetching primary data for 2025-10.
[2025-10-24T19:35:41.862458] [INFO ] [REMOTE    ] KORE: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T19:35:42.101442] [INFO ] [REMOTE    ] KO: Incremental fetch complete for 2025-10 (2.75 seconds).
[2025-10-24T19:35:42.111721] [INFO ] [REMOTE    ] KO: Full fetch complete (77218 records).
[2025-10-24T19:35:42.111886] [DEBUG] [VALIDATOR ] KO: Validating primary data.
[2025-10-24T19:35:42.311628] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days
[2025-10-24T19:35:42.312556] [FATAL] [MAIN      ] KO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:35:42.312674] [WARN ] [MAIN      ] KO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:35:42.312788] [INFO ] [LOCAL     ] KO: Starting deletion of primary data.
[2025-10-24T19:35:42.312917] [DEBUG] [LOCAL     ] KO: No primary data file found to delete.
[2025-10-24T19:35:42.312980] [INFO ] [LOCAL     ] KO: Starting deletion of derivative data.
[2025-10-24T19:35:42.313040] [DEBUG] [LOCAL     ] KO: No derivative data file found to delete.
[2025-10-24T19:35:42.313467] [INFO ] [MAIN      ] Update Progress: 1211/2366 symbols completed. KO took 34.3s. Estimated remaining: 2h 28m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:35:42.499073] [INFO ] [MAIN      ] KOS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:35:42.554302] [INFO ] [REMOTE    ] KOP: Fetching primary data for 2025-03.
[2025-10-24T19:35:42.558144] [DEBUG] [LOCAL     ] KOS: Loaded 53483 existing records from primary storage.
[2025-10-24T19:35:42.558556] [INFO ] [MAIN      ] KOS: Loaded 53483 existing records.
[2025-10-24T19:35:42.738632] [WARN ] [MAIN      ] KOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:35:42.738903] [INFO ] [MAIN      ] KOS: Wiping existing primary data before full refresh.
[2025-10-24T19:35:42.738968] [INFO ] [LOCAL     ] KOS: Starting deletion of primary data.
[2025-10-24T19:35:42.739543] [DEBUG] [LOCAL     ] KOS: Deleted primary data file.
[2025-10-24T19:35:42.739600] [INFO ] [MAIN      ] KOS: Starting full primary refresh.
[2025-10-24T19:35:43.101258] [INFO ] [REMOTE    ] KOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:35:43.347618] [INFO ] [REMOTE    ] KOS: Fetching primary data for 2025-01.
[2025-10-24T19:35:43.526508] [INFO ] [REMOTE    ] KNX: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T19:35:43.536381] [INFO ] [REMOTE    ] KNX: Full fetch complete (76319 records).
[2025-10-24T19:35:43.536542] [DEBUG] [VALIDATOR ] KNX: Validating primary data.
[2025-10-24T19:35:43.709288] [INFO ] [REMOTE    ] KOP: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T19:35:43.961283] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present.
[2025-10-24T19:35:43.961367] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed.
[2025-10-24T19:35:43.962426] [INFO ] [MAIN      ] KNX: Fetched primary data is valid.
[2025-10-24T19:35:43.962493] [DEBUG] [LOCAL     ] KNX: Saving primary data.
[2025-10-24T19:35:43.963136] [FATAL] [LOCAL     ] KNX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:35:43.963264] [FATAL] [MAIN      ] KNX: Failed to save primary data.
[2025-10-24T19:35:43.963307] [WARN ] [MAIN      ] KNX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:35:43.963343] [INFO ] [LOCAL     ] KNX: Starting deletion of primary data.
[2025-10-24T19:35:43.963396] [DEBUG] [LOCAL     ] KNX: No primary data file found to delete.
[2025-10-24T19:35:43.963431] [INFO ] [LOCAL     ] KNX: Starting deletion of derivative data.
[2025-10-24T19:35:43.963633] [DEBUG] [LOCAL     ] KNX: Deleted derivative data file.
[2025-10-24T19:35:43.964177] [INFO ] [MAIN      ] Update Progress: 1212/2366 symbols completed. KNX took 38.7s. Estimated remaining: 2h 28m 14s. Rate: 7.8 symbols/min
[2025-10-24T19:35:44.133683] [INFO ] [MAIN      ] KR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:35:44.147721] [INFO ] [REMOTE    ] KORE: Fetching primary data for 2025-02.
[2025-10-24T19:35:44.187982] [DEBUG] [LOCAL     ] KR: Loaded 54071 existing records from primary storage.
[2025-10-24T19:35:44.188298] [INFO ] [MAIN      ] KR: Loaded 54071 existing records.
[2025-10-24T19:35:44.362776] [WARN ] [MAIN      ] KR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:35:44.362960] [INFO ] [MAIN      ] KR: Wiping existing primary data before full refresh.
[2025-10-24T19:35:44.363023] [INFO ] [LOCAL     ] KR: Starting deletion of primary data.
[2025-10-24T19:35:44.363365] [DEBUG] [LOCAL     ] KR: Deleted primary data file.
[2025-10-24T19:35:44.363405] [INFO ] [MAIN      ] KR: Starting full primary refresh.
[2025-10-24T19:35:44.474054] [INFO ] [REMOTE    ] KORE: Incremental fetch complete for 2025-02 (0.33 seconds).
[2025-10-24T19:35:44.726695] [INFO ] [REMOTE    ] KR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:35:44.947715] [INFO ] [REMOTE    ] KR: Fetching primary data for 2025-01.
[2025-10-24T19:35:45.105532] [INFO ] [REMOTE    ] KOS: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T19:35:45.747632] [INFO ] [REMOTE    ] KOP: Fetching primary data for 2025-04.
[2025-10-24T19:35:46.547706] [INFO ] [REMOTE    ] KOS: Fetching primary data for 2025-02.
[2025-10-24T19:35:46.603355] [INFO ] [REMOTE    ] KR: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T19:35:46.814525] [INFO ] [REMOTE    ] KOP: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T19:35:47.347720] [INFO ] [REMOTE    ] KORE: Fetching primary data for 2025-03.
[2025-10-24T19:35:47.781152] [INFO ] [REMOTE    ] KORE: Incremental fetch complete for 2025-03 (0.43 seconds).
[2025-10-24T19:35:48.017793] [INFO ] [REMOTE    ] KOS: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T19:35:48.147720] [INFO ] [REMOTE    ] KOP: Fetching primary data for 2025-05.
[2025-10-24T19:35:48.947628] [INFO ] [REMOTE    ] KOS: Fetching primary data for 2025-03.
[2025-10-24T19:35:49.177223] [INFO ] [REMOTE    ] KOP: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T19:35:49.747900] [INFO ] [REMOTE    ] KR: Fetching primary data for 2025-02.
[2025-10-24T19:35:50.305949] [INFO ] [REMOTE    ] KOS: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T19:35:50.547716] [INFO ] [REMOTE    ] KORE: Fetching primary data for 2025-04.
[2025-10-24T19:35:50.998545] [INFO ] [REMOTE    ] KORE: Incremental fetch complete for 2025-04 (0.45 seconds).
[2025-10-24T19:35:51.347685] [INFO ] [REMOTE    ] KOP: Fetching primary data for 2025-06.
[2025-10-24T19:35:51.380871] [INFO ] [REMOTE    ] KR: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T19:35:52.147637] [INFO ] [REMOTE    ] KOS: Fetching primary data for 2025-04.
[2025-10-24T19:35:52.306954] [INFO ] [REMOTE    ] KOP: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T19:35:52.947726] [INFO ] [REMOTE    ] KORE: Fetching primary data for 2025-05.
[2025-10-24T19:35:53.478513] [INFO ] [REMOTE    ] KORE: Incremental fetch complete for 2025-05 (0.53 seconds).
[2025-10-24T19:35:53.740589] [INFO ] [REMOTE    ] KOS: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T19:35:53.751107] [INFO ] [REMOTE    ] KR: Fetching primary data for 2025-03.
[2025-10-24T19:35:54.547728] [INFO ] [REMOTE    ] KOS: Fetching primary data for 2025-05.
[2025-10-24T19:35:55.337022] [INFO ] [REMOTE    ] KR: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T19:35:55.349417] [INFO ] [REMOTE    ] KORE: Fetching primary data for 2025-06.
[2025-10-24T19:35:55.849792] [INFO ] [REMOTE    ] KORE: Incremental fetch complete for 2025-06 (0.50 seconds).
[2025-10-24T19:35:56.147708] [INFO ] [REMOTE    ] KR: Fetching primary data for 2025-04.
[2025-10-24T19:35:56.370545] [INFO ] [REMOTE    ] KOS: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T19:35:56.947708] [INFO ] [REMOTE    ] KOS: Fetching primary data for 2025-06.
[2025-10-24T19:35:57.747680] [INFO ] [REMOTE    ] KOP: Fetching primary data for 2025-07.
[2025-10-24T19:35:57.934954] [INFO ] [REMOTE    ] KR: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T19:35:58.547627] [INFO ] [REMOTE    ] KR: Fetching primary data for 2025-05.
[2025-10-24T19:35:58.598248] [INFO ] [REMOTE    ] KOS: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T19:35:58.622517] [INFO ] [REMOTE    ] KOP: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T19:35:59.347727] [INFO ] [REMOTE    ] KOP: Fetching primary data for 2025-08.
[2025-10-24T19:35:59.957477] [INFO ] [REMOTE    ] KOP: Incremental fetch complete for 2025-08 (0.61 seconds).
[2025-10-24T19:36:00.147620] [INFO ] [REMOTE    ] KORE: Fetching primary data for 2025-07.
[2025-10-24T19:36:00.364090] [INFO ] [REMOTE    ] KR: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T19:36:00.671822] [INFO ] [REMOTE    ] KORE: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T19:36:00.947687] [INFO ] [REMOTE    ] KORE: Fetching primary data for 2025-08.
[2025-10-24T19:36:01.700577] [INFO ] [REMOTE    ] KORE: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T19:36:01.747685] [INFO ] [REMOTE    ] KORE: Fetching primary data for 2025-09.
[2025-10-24T19:36:02.200671] [INFO ] [REMOTE    ] KORE: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T19:36:02.547634] [INFO ] [REMOTE    ] KR: Fetching primary data for 2025-06.
[2025-10-24T19:36:03.347674] [INFO ] [REMOTE    ] KOP: Fetching primary data for 2025-09.
[2025-10-24T19:36:04.147780] [INFO ] [REMOTE    ] KOS: Fetching primary data for 2025-07.
[2025-10-24T19:36:04.347814] [INFO ] [REMOTE    ] KR: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T19:36:04.369097] [INFO ] [REMOTE    ] KOP: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T19:36:04.947739] [INFO ] [REMOTE    ] KORE: Fetching primary data for 2025-10.
[2025-10-24T19:36:05.547741] [INFO ] [REMOTE    ] KORE: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T19:36:05.548904] [INFO ] [REMOTE    ] KORE: Full fetch complete (3884 records).
[2025-10-24T19:36:05.548972] [DEBUG] [VALIDATOR ] KORE: Validating primary data.
[2025-10-24T19:36:05.752828] [INFO ] [REMOTE    ] KR: Fetching primary data for 2025-07.
[2025-10-24T19:36:05.913584] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present.
[2025-10-24T19:36:05.913887] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed.
[2025-10-24T19:36:05.914046] [INFO ] [MAIN      ] KORE: Fetched primary data is valid.
[2025-10-24T19:36:05.925247] [DEBUG] [LOCAL     ] KORE: Saving primary data.
[2025-10-24T19:36:05.944573] [FATAL] [LOCAL     ] KORE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:36:05.944925] [FATAL] [MAIN      ] KORE: Failed to save primary data.
[2025-10-24T19:36:05.946816] [INFO ] [REMOTE    ] KOS: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T19:36:05.945343] [WARN ] [MAIN      ] KORE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:36:05.958300] [INFO ] [LOCAL     ] KORE: Starting deletion of primary data.
[2025-10-24T19:36:05.958382] [DEBUG] [LOCAL     ] KORE: No primary data file found to delete.
[2025-10-24T19:36:05.958421] [INFO ] [LOCAL     ] KORE: Starting deletion of derivative data.
[2025-10-24T19:36:05.958783] [DEBUG] [LOCAL     ] KORE: Deleted derivative data file.
[2025-10-24T19:36:05.958880] [INFO ] [MAIN      ] Update Progress: 1213/2366 symbols completed. KORE took 26.8s. Estimated remaining: 2h 28m 20s. Rate: 7.8 symbols/min
[2025-10-24T19:36:06.143818] [INFO ] [MAIN      ] KRC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:36:06.188408] [DEBUG] [LOCAL     ] KRC: Loaded 48386 existing records from primary storage.
[2025-10-24T19:36:06.188732] [INFO ] [MAIN      ] KRC: Loaded 48386 existing records.
[2025-10-24T19:36:06.359798] [WARN ] [MAIN      ] KRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:36:06.359984] [INFO ] [MAIN      ] KRC: Wiping existing primary data before full refresh.
[2025-10-24T19:36:06.360030] [INFO ] [LOCAL     ] KRC: Starting deletion of primary data.
[2025-10-24T19:36:06.360504] [DEBUG] [LOCAL     ] KRC: Deleted primary data file.
[2025-10-24T19:36:06.360559] [INFO ] [MAIN      ] KRC: Starting full primary refresh.
[2025-10-24T19:36:06.552938] [INFO ] [REMOTE    ] KOS: Fetching primary data for 2025-08.
[2025-10-24T19:36:06.705590] [INFO ] [REMOTE    ] KRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:36:07.347609] [INFO ] [REMOTE    ] KRC: Fetching primary data for 2025-01.
[2025-10-24T19:36:07.825919] [INFO ] [REMOTE    ] KR: Incremental fetch complete for 2025-07 (2.07 seconds).
[2025-10-24T19:36:08.147615] [INFO ] [REMOTE    ] KR: Fetching primary data for 2025-08.
[2025-10-24T19:36:08.521014] [INFO ] [REMOTE    ] KRC: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T19:36:08.542943] [INFO ] [REMOTE    ] KOS: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T19:36:08.947689] [INFO ] [REMOTE    ] KOP: Fetching primary data for 2025-10.
[2025-10-24T19:36:09.747668] [INFO ] [REMOTE    ] KOS: Fetching primary data for 2025-09.
[2025-10-24T19:36:09.849904] [INFO ] [REMOTE    ] KR: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T19:36:10.017229] [INFO ] [REMOTE    ] KOP: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T19:36:10.020897] [INFO ] [REMOTE    ] KOP: Full fetch complete (25305 records).
[2025-10-24T19:36:10.020985] [DEBUG] [VALIDATOR ] KOP: Validating primary data.
[2025-10-24T19:36:10.400538] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present.
[2025-10-24T19:36:10.400623] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed.
[2025-10-24T19:36:10.401232] [INFO ] [MAIN      ] KOP: Fetched primary data is valid.
[2025-10-24T19:36:10.401296] [DEBUG] [LOCAL     ] KOP: Saving primary data.
[2025-10-24T19:36:10.401681] [FATAL] [LOCAL     ] KOP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:36:10.401781] [FATAL] [MAIN      ] KOP: Failed to save primary data.
[2025-10-24T19:36:10.401852] [WARN ] [MAIN      ] KOP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:36:10.401943] [INFO ] [LOCAL     ] KOP: Starting deletion of primary data.
[2025-10-24T19:36:10.402018] [DEBUG] [LOCAL     ] KOP: No primary data file found to delete.
[2025-10-24T19:36:10.402056] [INFO ] [LOCAL     ] KOP: Starting deletion of derivative data.
[2025-10-24T19:36:10.402189] [DEBUG] [LOCAL     ] KOP: Deleted derivative data file.
[2025-10-24T19:36:10.402265] [INFO ] [MAIN      ] Update Progress: 1214/2366 symbols completed. KOP took 33.7s. Estimated remaining: 2h 28m 9s. Rate: 7.8 symbols/min
[2025-10-24T19:36:10.555671] [INFO ] [REMOTE    ] KRC: Fetching primary data for 2025-02.
[2025-10-24T19:36:10.578501] [INFO ] [MAIN      ] KREF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:36:10.614328] [DEBUG] [LOCAL     ] KREF: Loaded 38364 existing records from primary storage.
[2025-10-24T19:36:10.614604] [INFO ] [MAIN      ] KREF: Loaded 38364 existing records.
[2025-10-24T19:36:10.793121] [WARN ] [MAIN      ] KREF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:36:10.793472] [INFO ] [MAIN      ] KREF: Wiping existing primary data before full refresh.
[2025-10-24T19:36:10.793528] [INFO ] [LOCAL     ] KREF: Starting deletion of primary data.
[2025-10-24T19:36:10.794340] [DEBUG] [LOCAL     ] KREF: Deleted primary data file.
[2025-10-24T19:36:10.794396] [INFO ] [MAIN      ] KREF: Starting full primary refresh.
[2025-10-24T19:36:11.146633] [INFO ] [REMOTE    ] KREF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:36:11.209236] [INFO ] [REMOTE    ] KOS: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T19:36:11.347679] [INFO ] [REMOTE    ] KREF: Fetching primary data for 2025-01.
[2025-10-24T19:36:11.817865] [INFO ] [REMOTE    ] KRC: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T19:36:12.147687] [INFO ] [REMOTE    ] KRC: Fetching primary data for 2025-03.
[2025-10-24T19:36:12.693847] [INFO ] [REMOTE    ] KREF: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T19:36:12.947681] [INFO ] [REMOTE    ] KOS: Fetching primary data for 2025-10.
[2025-10-24T19:36:13.721133] [INFO ] [REMOTE    ] KRC: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T19:36:13.747598] [INFO ] [REMOTE    ] KRC: Fetching primary data for 2025-04.
[2025-10-24T19:36:14.547746] [INFO ] [REMOTE    ] KREF: Fetching primary data for 2025-02.
[2025-10-24T19:36:14.944399] [INFO ] [REMOTE    ] KOS: Incremental fetch complete for 2025-10 (2.00 seconds).
[2025-10-24T19:36:14.954439] [INFO ] [REMOTE    ] KOS: Full fetch complete (77037 records).
[2025-10-24T19:36:14.954673] [DEBUG] [VALIDATOR ] KOS: Validating primary data.
[2025-10-24T19:36:15.349746] [INFO ] [REMOTE    ] KR: Fetching primary data for 2025-09.
[2025-10-24T19:36:15.349674] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present.
[2025-10-24T19:36:15.350796] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed.
[2025-10-24T19:36:15.351929] [INFO ] [MAIN      ] KOS: Fetched primary data is valid.
[2025-10-24T19:36:15.352267] [DEBUG] [LOCAL     ] KOS: Saving primary data.
[2025-10-24T19:36:15.352982] [FATAL] [LOCAL     ] KOS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:36:15.353068] [FATAL] [MAIN      ] KOS: Failed to save primary data.
[2025-10-24T19:36:15.353137] [WARN ] [MAIN      ] KOS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:36:15.353205] [INFO ] [LOCAL     ] KOS: Starting deletion of primary data.
[2025-10-24T19:36:15.353267] [DEBUG] [LOCAL     ] KOS: No primary data file found to delete.
[2025-10-24T19:36:15.353303] [INFO ] [LOCAL     ] KOS: Starting deletion of derivative data.
[2025-10-24T19:36:15.353443] [DEBUG] [LOCAL     ] KOS: Deleted derivative data file.
[2025-10-24T19:36:15.353958] [INFO ] [MAIN      ] Update Progress: 1215/2366 symbols completed. KOS took 33.0s. Estimated remaining: 2h 27m 59s. Rate: 7.8 symbols/min
[2025-10-24T19:36:15.533056] [INFO ] [MAIN      ] KRG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:36:15.564130] [INFO ] [REMOTE    ] KREF: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T19:36:15.590004] [INFO ] [REMOTE    ] KRC: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T19:36:15.643934] [DEBUG] [LOCAL     ] KRG: Loaded 49641 existing records from primary storage.
[2025-10-24T19:36:15.644294] [INFO ] [MAIN      ] KRG: Loaded 49641 existing records.
[2025-10-24T19:36:15.821223] [WARN ] [MAIN      ] KRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:36:15.821454] [INFO ] [MAIN      ] KRG: Wiping existing primary data before full refresh.
[2025-10-24T19:36:15.821502] [INFO ] [LOCAL     ] KRG: Starting deletion of primary data.
[2025-10-24T19:36:15.822139] [DEBUG] [LOCAL     ] KRG: Deleted primary data file.
[2025-10-24T19:36:15.822195] [INFO ] [MAIN      ] KRG: Starting full primary refresh.
[2025-10-24T19:36:16.148621] [INFO ] [REMOTE    ] KREF: Fetching primary data for 2025-03.
[2025-10-24T19:36:16.175738] [INFO ] [REMOTE    ] KRG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:36:16.947683] [INFO ] [REMOTE    ] KRG: Fetching primary data for 2025-01.
[2025-10-24T19:36:17.373691] [INFO ] [REMOTE    ] KR: Incremental fetch complete for 2025-09 (2.02 seconds).
[2025-10-24T19:36:17.449018] [INFO ] [REMOTE    ] KREF: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T19:36:17.747663] [INFO ] [REMOTE    ] KR: Fetching primary data for 2025-10.
[2025-10-24T19:36:18.453425] [INFO ] [REMOTE    ] KRG: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T19:36:18.547636] [INFO ] [REMOTE    ] KRG: Fetching primary data for 2025-02.
[2025-10-24T19:36:19.347733] [INFO ] [REMOTE    ] KRC: Fetching primary data for 2025-05.
[2025-10-24T19:36:19.957634] [INFO ] [REMOTE    ] KR: Incremental fetch complete for 2025-10 (2.21 seconds).
[2025-10-24T19:36:19.967986] [INFO ] [REMOTE    ] KR: Full fetch complete (77843 records).
[2025-10-24T19:36:19.968188] [DEBUG] [VALIDATOR ] KR: Validating primary data.
[2025-10-24T19:36:20.170205] [INFO ] [REMOTE    ] KREF: Fetching primary data for 2025-04.
[2025-10-24T19:36:20.309050] [INFO ] [REMOTE    ] KRG: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T19:36:20.425247] [DEBUG] [VALIDATOR ] KR: All expected trading days are present.
[2025-10-24T19:36:20.425328] [DEBUG] [VALIDATOR ] KR: Primary data validation passed.
[2025-10-24T19:36:20.426388] [INFO ] [MAIN      ] KR: Fetched primary data is valid.
[2025-10-24T19:36:20.426450] [DEBUG] [LOCAL     ] KR: Saving primary data.
[2025-10-24T19:36:20.427042] [FATAL] [LOCAL     ] KR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:36:20.427130] [FATAL] [MAIN      ] KR: Failed to save primary data.
[2025-10-24T19:36:20.427224] [WARN ] [MAIN      ] KR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:36:20.427313] [INFO ] [LOCAL     ] KR: Starting deletion of primary data.
[2025-10-24T19:36:20.427382] [DEBUG] [LOCAL     ] KR: No primary data file found to delete.
[2025-10-24T19:36:20.427420] [INFO ] [LOCAL     ] KR: Starting deletion of derivative data.
[2025-10-24T19:36:20.427562] [DEBUG] [LOCAL     ] KR: Deleted derivative data file.
[2025-10-24T19:36:20.427978] [INFO ] [MAIN      ] Update Progress: 1216/2366 symbols completed. KR took 36.5s. Estimated remaining: 2h 27m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:36:20.600708] [INFO ] [MAIN      ] KRMN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:36:20.600991] [DEBUG] [LOCAL     ] KRMN: No existing data file found in primary storage.
[2025-10-24T19:36:20.601046] [WARN ] [MAIN      ] KRMN: No existing data found, performing full refresh instead.
[2025-10-24T19:36:20.601156] [INFO ] [MAIN      ] KRMN: Wiping existing primary data before full refresh.
[2025-10-24T19:36:20.601197] [INFO ] [LOCAL     ] KRMN: Starting deletion of primary data.
[2025-10-24T19:36:20.601239] [DEBUG] [LOCAL     ] KRMN: No primary data file found to delete.
[2025-10-24T19:36:20.601271] [INFO ] [MAIN      ] KRMN: Starting full primary refresh.
[2025-10-24T19:36:20.958570] [INFO ] [REMOTE    ] KRG: Fetching primary data for 2025-03.
[2025-10-24T19:36:20.963817] [INFO ] [REMOTE    ] KRMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:36:20.999029] [INFO ] [REMOTE    ] KRC: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T19:36:21.677266] [INFO ] [REMOTE    ] KREF: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T19:36:21.747684] [INFO ] [REMOTE    ] KREF: Fetching primary data for 2025-05.
[2025-10-24T19:36:22.551867] [INFO ] [REMOTE    ] KRMN: Fetching primary data for 2025-01.
[2025-10-24T19:36:22.558578] [INFO ] [REMOTE    ] KRG: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T19:36:22.780989] [DEBUG] [REMOTE    ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:36:22.781313] [WARN ] [REMOTE    ] KRMN: No data returned for month 2025-01
[2025-10-24T19:36:22.781399] [FATAL] [REMOTE    ] KRMN: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:36:22.781446] [FATAL] [MAIN      ] KRMN: Failed to fetch primary data.
[2025-10-24T19:36:22.781479] [WARN ] [MAIN      ] KRMN: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:36:22.781543] [INFO ] [LOCAL     ] KRMN: Starting deletion of primary data.
[2025-10-24T19:36:22.781605] [DEBUG] [LOCAL     ] KRMN: No primary data file found to delete.
[2025-10-24T19:36:22.781666] [INFO ] [LOCAL     ] KRMN: Starting deletion of derivative data.
[2025-10-24T19:36:22.781754] [DEBUG] [LOCAL     ] KRMN: No derivative data file found to delete.
[2025-10-24T19:36:22.781804] [INFO ] [MAIN      ] Update Progress: 1217/2366 symbols completed. KRMN took 2.4s. Estimated remaining: 2h 27m 36s. Rate: 7.8 symbols/min
[2025-10-24T19:36:22.955168] [INFO ] [MAIN      ] KRO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:36:22.981548] [DEBUG] [LOCAL     ] KRO: Loaded 26739 existing records from primary storage.
[2025-10-24T19:36:22.981948] [INFO ] [MAIN      ] KRO: Loaded 26739 existing records.
[2025-10-24T19:36:23.168347] [WARN ] [MAIN      ] KRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:36:23.168854] [INFO ] [MAIN      ] KRO: Wiping existing primary data before full refresh.
[2025-10-24T19:36:23.168921] [INFO ] [LOCAL     ] KRO: Starting deletion of primary data.
[2025-10-24T19:36:23.169328] [DEBUG] [LOCAL     ] KRO: Deleted primary data file.
[2025-10-24T19:36:23.169384] [INFO ] [MAIN      ] KRO: Starting full primary refresh.
[2025-10-24T19:36:23.301440] [INFO ] [REMOTE    ] KREF: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T19:36:23.352763] [INFO ] [REMOTE    ] KRC: Fetching primary data for 2025-06.
[2025-10-24T19:36:23.600711] [INFO ] [REMOTE    ] KRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:36:24.147696] [INFO ] [REMOTE    ] KREF: Fetching primary data for 2025-06.
[2025-10-24T19:36:24.854441] [INFO ] [REMOTE    ] KRC: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T19:36:24.947608] [INFO ] [REMOTE    ] KRC: Fetching primary data for 2025-07.
[2025-10-24T19:36:25.638282] [INFO ] [REMOTE    ] KREF: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T19:36:25.747703] [INFO ] [REMOTE    ] KREF: Fetching primary data for 2025-07.
[2025-10-24T19:36:26.547624] [INFO ] [REMOTE    ] KRG: Fetching primary data for 2025-04.
[2025-10-24T19:36:26.665614] [INFO ] [REMOTE    ] KRC: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T19:36:27.239466] [INFO ] [REMOTE    ] KREF: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T19:36:27.347602] [INFO ] [REMOTE    ] KREF: Fetching primary data for 2025-08.
[2025-10-24T19:36:28.147639] [INFO ] [REMOTE    ] KRC: Fetching primary data for 2025-08.
[2025-10-24T19:36:28.209144] [INFO ] [REMOTE    ] KRG: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T19:36:28.254589] [DEBUG] [REMOTE    ] KRC: Error fetching primary data for 2025-08: 'API call returned an empty response.'
[2025-10-24T19:36:28.254909] [WARN ] [REMOTE    ] KRC: No data returned for month 2025-08
[2025-10-24T19:36:28.255010] [FATAL] [REMOTE    ] KRC: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:36:28.255098] [FATAL] [MAIN      ] KRC: Failed to fetch primary data.
[2025-10-24T19:36:28.255178] [WARN ] [MAIN      ] KRC: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:36:28.255263] [INFO ] [LOCAL     ] KRC: Starting deletion of primary data.
[2025-10-24T19:36:28.255340] [DEBUG] [LOCAL     ] KRC: No primary data file found to delete.
[2025-10-24T19:36:28.255390] [INFO ] [LOCAL     ] KRC: Starting deletion of derivative data.
[2025-10-24T19:36:28.255555] [DEBUG] [LOCAL     ] KRC: Deleted derivative data file.
[2025-10-24T19:36:28.255865] [INFO ] [MAIN      ] Update Progress: 1218/2366 symbols completed. KRC took 22.3s. Estimated remaining: 2h 27m 26s. Rate: 7.8 symbols/min
[2025-10-24T19:36:28.426597] [INFO ] [MAIN      ] KRP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:36:28.465974] [DEBUG] [LOCAL     ] KRP: Loaded 36127 existing records from primary storage.
[2025-10-24T19:36:28.466276] [INFO ] [MAIN      ] KRP: Loaded 36127 existing records.
[2025-10-24T19:36:28.654286] [WARN ] [MAIN      ] KRP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:36:28.654579] [INFO ] [MAIN      ] KRP: Wiping existing primary data before full refresh.
[2025-10-24T19:36:28.654627] [INFO ] [LOCAL     ] KRP: Starting deletion of primary data.
[2025-10-24T19:36:28.655037] [DEBUG] [LOCAL     ] KRP: Deleted primary data file.
[2025-10-24T19:36:28.655086] [INFO ] [MAIN      ] KRP: Starting full primary refresh.
[2025-10-24T19:36:28.891124] [INFO ] [REMOTE    ] KREF: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T19:36:28.951630] [INFO ] [REMOTE    ] KRG: Fetching primary data for 2025-05.
[2025-10-24T19:36:29.051015] [INFO ] [REMOTE    ] KRP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:36:29.747671] [INFO ] [REMOTE    ] KREF: Fetching primary data for 2025-09.
[2025-10-24T19:36:30.547713] [INFO ] [REMOTE    ] KRO: Fetching primary data for 2025-01.
[2025-10-24T19:36:30.644716] [INFO ] [REMOTE    ] KRG: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T19:36:31.163206] [INFO ] [REMOTE    ] KREF: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T19:36:31.277103] [INFO ] [REMOTE    ] KRO: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T19:36:31.347630] [INFO ] [REMOTE    ] KRO: Fetching primary data for 2025-02.
[2025-10-24T19:36:32.147681] [INFO ] [REMOTE    ] KRP: Fetching primary data for 2025-01.
[2025-10-24T19:36:32.338778] [INFO ] [REMOTE    ] KRO: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T19:36:32.947683] [INFO ] [REMOTE    ] KRG: Fetching primary data for 2025-06.
[2025-10-24T19:36:33.757874] [INFO ] [REMOTE    ] KRO: Fetching primary data for 2025-03.
[2025-10-24T19:36:33.763621] [INFO ] [REMOTE    ] KRP: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T19:36:34.091463] [INFO ] [REMOTE    ] KRG: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T19:36:34.547618] [INFO ] [REMOTE    ] KRG: Fetching primary data for 2025-07.
[2025-10-24T19:36:34.805173] [INFO ] [REMOTE    ] KRO: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T19:36:35.347728] [INFO ] [REMOTE    ] KREF: Fetching primary data for 2025-10.
[2025-10-24T19:36:36.134494] [INFO ] [REMOTE    ] KRG: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T19:36:36.147598] [INFO ] [REMOTE    ] KRG: Fetching primary data for 2025-08.
[2025-10-24T19:36:36.942873] [INFO ] [REMOTE    ] KREF: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T19:36:36.949756] [INFO ] [REMOTE    ] KRP: Fetching primary data for 2025-02.
[2025-10-24T19:36:36.951436] [INFO ] [REMOTE    ] KREF: Full fetch complete (53041 records).
[2025-10-24T19:36:36.951515] [DEBUG] [VALIDATOR ] KREF: Validating primary data.
[2025-10-24T19:36:37.337487] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present.
[2025-10-24T19:36:37.337583] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed.
[2025-10-24T19:36:37.338479] [INFO ] [MAIN      ] KREF: Fetched primary data is valid.
[2025-10-24T19:36:37.338548] [DEBUG] [LOCAL     ] KREF: Saving primary data.
[2025-10-24T19:36:37.339094] [FATAL] [LOCAL     ] KREF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:36:37.339182] [FATAL] [MAIN      ] KREF: Failed to save primary data.
[2025-10-24T19:36:37.339223] [WARN ] [MAIN      ] KREF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:36:37.339258] [INFO ] [LOCAL     ] KREF: Starting deletion of primary data.
[2025-10-24T19:36:37.339307] [DEBUG] [LOCAL     ] KREF: No primary data file found to delete.
[2025-10-24T19:36:37.339341] [INFO ] [LOCAL     ] KREF: Starting deletion of derivative data.
[2025-10-24T19:36:37.339498] [DEBUG] [LOCAL     ] KREF: Deleted derivative data file.
[2025-10-24T19:36:37.340065] [INFO ] [MAIN      ] Update Progress: 1219/2366 symbols completed. KREF took 26.9s. Estimated remaining: 2h 27m 20s. Rate: 7.8 symbols/min
[2025-10-24T19:36:37.511158] [INFO ] [MAIN      ] KSS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:36:37.566534] [DEBUG] [LOCAL     ] KSS: Loaded 53970 existing records from primary storage.
[2025-10-24T19:36:37.566890] [INFO ] [MAIN      ] KSS: Loaded 53970 existing records.
[2025-10-24T19:36:37.756718] [INFO ] [REMOTE    ] KRO: Fetching primary data for 2025-04.
[2025-10-24T19:36:37.771226] [WARN ] [MAIN      ] KSS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:36:37.772287] [INFO ] [MAIN      ] KSS: Wiping existing primary data before full refresh.
[2025-10-24T19:36:37.772370] [INFO ] [LOCAL     ] KSS: Starting deletion of primary data.
[2025-10-24T19:36:37.773386] [DEBUG] [LOCAL     ] KSS: Deleted primary data file.
[2025-10-24T19:36:37.776954] [INFO ] [REMOTE    ] KRG: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T19:36:37.777282] [INFO ] [MAIN      ] KSS: Starting full primary refresh.
[2025-10-24T19:36:38.136324] [INFO ] [REMOTE    ] KSS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:36:38.547622] [INFO ] [REMOTE    ] KRG: Fetching primary data for 2025-09.
[2025-10-24T19:36:38.625237] [INFO ] [REMOTE    ] KRP: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T19:36:38.978777] [INFO ] [REMOTE    ] KRO: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T19:36:39.347710] [INFO ] [REMOTE    ] KRP: Fetching primary data for 2025-03.
[2025-10-24T19:36:40.147723] [INFO ] [REMOTE    ] KSS: Fetching primary data for 2025-01.
[2025-10-24T19:36:40.273024] [INFO ] [REMOTE    ] KRG: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T19:36:40.912811] [INFO ] [REMOTE    ] KRP: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T19:36:40.947660] [INFO ] [REMOTE    ] KRP: Fetching primary data for 2025-04.
[2025-10-24T19:36:41.747741] [INFO ] [REMOTE    ] KRO: Fetching primary data for 2025-05.
[2025-10-24T19:36:42.101503] [INFO ] [REMOTE    ] KSS: Incremental fetch complete for 2025-01 (1.95 seconds).
[2025-10-24T19:36:42.369890] [INFO ] [REMOTE    ] KRP: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T19:36:42.547678] [INFO ] [REMOTE    ] KSS: Fetching primary data for 2025-02.
[2025-10-24T19:36:42.817313] [INFO ] [REMOTE    ] KRO: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T19:36:43.347692] [INFO ] [REMOTE    ] KRP: Fetching primary data for 2025-05.
[2025-10-24T19:36:44.147630] [INFO ] [REMOTE    ] KRG: Fetching primary data for 2025-10.
[2025-10-24T19:36:44.738212] [INFO ] [REMOTE    ] KSS: Incremental fetch complete for 2025-02 (2.19 seconds).
[2025-10-24T19:36:44.846244] [INFO ] [REMOTE    ] KRP: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T19:36:44.947619] [INFO ] [REMOTE    ] KRP: Fetching primary data for 2025-06.
[2025-10-24T19:36:45.747745] [INFO ] [REMOTE    ] KRO: Fetching primary data for 2025-06.
[2025-10-24T19:36:46.071537] [INFO ] [REMOTE    ] KRG: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T19:36:46.081101] [INFO ] [REMOTE    ] KRG: Full fetch complete (71427 records).
[2025-10-24T19:36:46.093058] [DEBUG] [VALIDATOR ] KRG: Validating primary data.
[2025-10-24T19:36:46.134294] [INFO ] [REMOTE    ] KRP: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T19:36:46.508930] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present.
[2025-10-24T19:36:46.509013] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed.
[2025-10-24T19:36:46.510039] [INFO ] [MAIN      ] KRG: Fetched primary data is valid.
[2025-10-24T19:36:46.510104] [DEBUG] [LOCAL     ] KRG: Saving primary data.
[2025-10-24T19:36:46.510729] [FATAL] [LOCAL     ] KRG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:36:46.510824] [FATAL] [MAIN      ] KRG: Failed to save primary data.
[2025-10-24T19:36:46.510923] [WARN ] [MAIN      ] KRG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:36:46.510987] [INFO ] [LOCAL     ] KRG: Starting deletion of primary data.
[2025-10-24T19:36:46.511048] [DEBUG] [LOCAL     ] KRG: No primary data file found to delete.
[2025-10-24T19:36:46.511084] [INFO ] [LOCAL     ] KRG: Starting deletion of derivative data.
[2025-10-24T19:36:46.511248] [DEBUG] [LOCAL     ] KRG: Deleted derivative data file.
[2025-10-24T19:36:46.511878] [INFO ] [MAIN      ] Update Progress: 1220/2366 symbols completed. KRG took 31.2s. Estimated remaining: 2h 27m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:36:46.554046] [INFO ] [REMOTE    ] KSS: Fetching primary data for 2025-03.
[2025-10-24T19:36:46.685023] [INFO ] [MAIN      ] KT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:36:46.729146] [DEBUG] [LOCAL     ] KT: Loaded 45680 existing records from primary storage.
[2025-10-24T19:36:46.729429] [INFO ] [MAIN      ] KT: Loaded 45680 existing records.
[2025-10-24T19:36:46.910595] [WARN ] [MAIN      ] KT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:36:46.910991] [INFO ] [MAIN      ] KT: Wiping existing primary data before full refresh.
[2025-10-24T19:36:46.916198] [INFO ] [LOCAL     ] KT: Starting deletion of primary data.
[2025-10-24T19:36:46.924459] [DEBUG] [LOCAL     ] KT: Deleted primary data file.
[2025-10-24T19:36:46.924974] [INFO ] [REMOTE    ] KRO: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T19:36:46.924524] [INFO ] [MAIN      ] KT: Starting full primary refresh.
[2025-10-24T19:36:47.294069] [INFO ] [REMOTE    ] KT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:36:47.347631] [INFO ] [REMOTE    ] KRO: Fetching primary data for 2025-07.
[2025-10-24T19:36:48.147694] [INFO ] [REMOTE    ] KRP: Fetching primary data for 2025-07.
[2025-10-24T19:36:48.470001] [INFO ] [REMOTE    ] KRO: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T19:36:48.568793] [INFO ] [REMOTE    ] KSS: Incremental fetch complete for 2025-03 (2.01 seconds).
[2025-10-24T19:36:48.947702] [INFO ] [REMOTE    ] KSS: Fetching primary data for 2025-04.
[2025-10-24T19:36:49.702904] [INFO ] [REMOTE    ] KRP: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T19:36:49.747609] [INFO ] [REMOTE    ] KT: Fetching primary data for 2025-01.
[2025-10-24T19:36:50.547717] [INFO ] [REMOTE    ] KRP: Fetching primary data for 2025-08.
[2025-10-24T19:36:50.810920] [INFO ] [REMOTE    ] KSS: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T19:36:51.347686] [INFO ] [REMOTE    ] KRO: Fetching primary data for 2025-08.
[2025-10-24T19:36:51.397753] [INFO ] [REMOTE    ] KT: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T19:36:51.529119] [INFO ] [REMOTE    ] KRP: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T19:36:52.147717] [INFO ] [REMOTE    ] KRP: Fetching primary data for 2025-09.
[2025-10-24T19:36:52.305740] [INFO ] [REMOTE    ] KRO: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T19:36:52.947721] [INFO ] [REMOTE    ] KSS: Fetching primary data for 2025-05.
[2025-10-24T19:36:53.593603] [INFO ] [REMOTE    ] KRP: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T19:36:53.747696] [INFO ] [REMOTE    ] KRO: Fetching primary data for 2025-09.
[2025-10-24T19:36:54.531853] [INFO ] [REMOTE    ] KSS: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T19:36:54.547597] [INFO ] [REMOTE    ] KSS: Fetching primary data for 2025-06.
[2025-10-24T19:36:54.879945] [INFO ] [REMOTE    ] KRO: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T19:36:55.347704] [INFO ] [REMOTE    ] KT: Fetching primary data for 2025-02.
[2025-10-24T19:36:56.147692] [INFO ] [REMOTE    ] KRP: Fetching primary data for 2025-10.
[2025-10-24T19:36:56.262179] [INFO ] [REMOTE    ] KSS: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T19:36:56.947731] [INFO ] [REMOTE    ] KRO: Fetching primary data for 2025-10.
[2025-10-24T19:36:57.055507] [INFO ] [REMOTE    ] KT: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T19:36:57.343629] [INFO ] [REMOTE    ] KRP: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T19:36:57.350108] [INFO ] [REMOTE    ] KRP: Full fetch complete (54945 records).
[2025-10-24T19:36:57.350256] [DEBUG] [VALIDATOR ] KRP: Validating primary data.
[2025-10-24T19:36:57.732463] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present.
[2025-10-24T19:36:57.732544] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed.
[2025-10-24T19:36:57.733420] [INFO ] [MAIN      ] KRP: Fetched primary data is valid.
[2025-10-24T19:36:57.733483] [DEBUG] [LOCAL     ] KRP: Saving primary data.
[2025-10-24T19:36:57.734029] [FATAL] [LOCAL     ] KRP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:36:57.734126] [FATAL] [MAIN      ] KRP: Failed to save primary data.
[2025-10-24T19:36:57.734168] [WARN ] [MAIN      ] KRP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:36:57.734224] [INFO ] [LOCAL     ] KRP: Starting deletion of primary data.
[2025-10-24T19:36:57.734317] [DEBUG] [LOCAL     ] KRP: No primary data file found to delete.
[2025-10-24T19:36:57.734378] [INFO ] [LOCAL     ] KRP: Starting deletion of derivative data.
[2025-10-24T19:36:57.734566] [DEBUG] [LOCAL     ] KRP: Deleted derivative data file.
[2025-10-24T19:36:57.735021] [INFO ] [MAIN      ] Update Progress: 1221/2366 symbols completed. KRP took 29.5s. Estimated remaining: 2h 27m 9s. Rate: 7.8 symbols/min
[2025-10-24T19:36:57.756155] [INFO ] [REMOTE    ] KSS: Fetching primary data for 2025-07.
[2025-10-24T19:36:57.940783] [INFO ] [MAIN      ] KTB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:36:57.980150] [DEBUG] [LOCAL     ] KTB: Loaded 40495 existing records from primary storage.
[2025-10-24T19:36:57.980447] [INFO ] [MAIN      ] KTB: Loaded 40495 existing records.
[2025-10-24T19:36:58.170137] [WARN ] [MAIN      ] KTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:36:58.170508] [INFO ] [MAIN      ] KTB: Wiping existing primary data before full refresh.
[2025-10-24T19:36:58.170564] [INFO ] [LOCAL     ] KTB: Starting deletion of primary data.
[2025-10-24T19:36:58.170930] [DEBUG] [LOCAL     ] KTB: Deleted primary data file.
[2025-10-24T19:36:58.171014] [INFO ] [MAIN      ] KTB: Starting full primary refresh.
[2025-10-24T19:36:58.291069] [INFO ] [REMOTE    ] KRO: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T19:36:58.353483] [INFO ] [REMOTE    ] KRO: Full fetch complete (35361 records).
[2025-10-24T19:36:58.357144] [DEBUG] [VALIDATOR ] KRO: Validating primary data.
[2025-10-24T19:36:58.560464] [INFO ] [REMOTE    ] KT: Fetching primary data for 2025-03.
[2025-10-24T19:36:58.754610] [INFO ] [REMOTE    ] KTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:36:59.011267] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present.
[2025-10-24T19:36:59.011363] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed.
[2025-10-24T19:36:59.012159] [INFO ] [MAIN      ] KRO: Fetched primary data is valid.
[2025-10-24T19:36:59.012223] [DEBUG] [LOCAL     ] KRO: Saving primary data.
[2025-10-24T19:36:59.012736] [FATAL] [LOCAL     ] KRO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:36:59.012828] [FATAL] [MAIN      ] KRO: Failed to save primary data.
[2025-10-24T19:36:59.012873] [WARN ] [MAIN      ] KRO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:36:59.012946] [INFO ] [LOCAL     ] KRO: Starting deletion of primary data.
[2025-10-24T19:36:59.013021] [DEBUG] [LOCAL     ] KRO: No primary data file found to delete.
[2025-10-24T19:36:59.013090] [INFO ] [LOCAL     ] KRO: Starting deletion of derivative data.
[2025-10-24T19:36:59.013271] [DEBUG] [LOCAL     ] KRO: Deleted derivative data file.
[2025-10-24T19:36:59.013391] [INFO ] [MAIN      ] Update Progress: 1222/2366 symbols completed. KRO took 36.2s. Estimated remaining: 2h 26m 55s. Rate: 7.8 symbols/min
[2025-10-24T19:36:59.224154] [INFO ] [MAIN      ] KTF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:36:59.244491] [DEBUG] [LOCAL     ] KTF: Loaded 11723 existing records from primary storage.
[2025-10-24T19:36:59.244832] [INFO ] [MAIN      ] KTF: Loaded 11723 existing records.
[2025-10-24T19:36:59.355533] [INFO ] [REMOTE    ] KTB: Fetching primary data for 2025-01.
[2025-10-24T19:36:59.548487] [WARN ] [MAIN      ] KTF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:36:59.549053] [INFO ] [MAIN      ] KTF: Wiping existing primary data before full refresh.
[2025-10-24T19:36:59.549142] [INFO ] [LOCAL     ] KTF: Starting deletion of primary data.
[2025-10-24T19:36:59.549389] [DEBUG] [LOCAL     ] KTF: Deleted primary data file.
[2025-10-24T19:36:59.549450] [INFO ] [MAIN      ] KTF: Starting full primary refresh.
[2025-10-24T19:37:00.089206] [INFO ] [REMOTE    ] KTF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:37:00.134783] [INFO ] [REMOTE    ] KT: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T19:37:00.164756] [INFO ] [REMOTE    ] KT: Fetching primary data for 2025-04.
[2025-10-24T19:37:00.190662] [INFO ] [REMOTE    ] KSS: Incremental fetch complete for 2025-07 (2.43 seconds).
[2025-10-24T19:37:00.924531] [INFO ] [REMOTE    ] KTB: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T19:37:00.947617] [INFO ] [REMOTE    ] KTB: Fetching primary data for 2025-02.
[2025-10-24T19:37:01.747689] [INFO ] [REMOTE    ] KSS: Fetching primary data for 2025-08.
[2025-10-24T19:37:01.796224] [INFO ] [REMOTE    ] KT: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T19:37:02.547620] [INFO ] [REMOTE    ] KT: Fetching primary data for 2025-05.
[2025-10-24T19:37:02.648526] [INFO ] [REMOTE    ] KTB: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T19:37:03.347776] [INFO ] [REMOTE    ] KTF: Fetching primary data for 2025-01.
[2025-10-24T19:37:03.755298] [INFO ] [REMOTE    ] KSS: Incremental fetch complete for 2025-08 (2.01 seconds).
[2025-10-24T19:37:04.041295] [INFO ] [REMOTE    ] KT: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T19:37:04.147604] [INFO ] [REMOTE    ] KSS: Fetching primary data for 2025-09.
[2025-10-24T19:37:04.461490] [INFO ] [REMOTE    ] KTF: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T19:37:04.947746] [INFO ] [REMOTE    ] KT: Fetching primary data for 2025-06.
[2025-10-24T19:37:05.747712] [INFO ] [REMOTE    ] KTB: Fetching primary data for 2025-03.
[2025-10-24T19:37:06.062844] [INFO ] [REMOTE    ] KSS: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T19:37:06.547721] [INFO ] [REMOTE    ] KTF: Fetching primary data for 2025-02.
[2025-10-24T19:37:06.718485] [INFO ] [REMOTE    ] KT: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T19:37:07.347743] [INFO ] [REMOTE    ] KSS: Fetching primary data for 2025-10.
[2025-10-24T19:37:07.413392] [INFO ] [REMOTE    ] KTF: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T19:37:07.463729] [INFO ] [REMOTE    ] KTB: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T19:37:08.147698] [INFO ] [REMOTE    ] KTF: Fetching primary data for 2025-03.
[2025-10-24T19:37:08.947621] [INFO ] [REMOTE    ] KTB: Fetching primary data for 2025-04.
[2025-10-24T19:37:09.134803] [INFO ] [REMOTE    ] KTF: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T19:37:09.290866] [INFO ] [REMOTE    ] KSS: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T19:37:09.301116] [INFO ] [REMOTE    ] KSS: Full fetch complete (77738 records).
[2025-10-24T19:37:09.301248] [DEBUG] [VALIDATOR ] KSS: Validating primary data.
[2025-10-24T19:37:09.718217] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present.
[2025-10-24T19:37:09.718313] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed.
[2025-10-24T19:37:09.719431] [INFO ] [MAIN      ] KSS: Fetched primary data is valid.
[2025-10-24T19:37:09.719495] [DEBUG] [LOCAL     ] KSS: Saving primary data.
[2025-10-24T19:37:09.720130] [FATAL] [LOCAL     ] KSS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:37:09.720220] [FATAL] [MAIN      ] KSS: Failed to save primary data.
[2025-10-24T19:37:09.720262] [WARN ] [MAIN      ] KSS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:37:09.720324] [INFO ] [LOCAL     ] KSS: Starting deletion of primary data.
[2025-10-24T19:37:09.720384] [DEBUG] [LOCAL     ] KSS: No primary data file found to delete.
[2025-10-24T19:37:09.720421] [INFO ] [LOCAL     ] KSS: Starting deletion of derivative data.
[2025-10-24T19:37:09.720556] [DEBUG] [LOCAL     ] KSS: Deleted derivative data file.
[2025-10-24T19:37:09.721230] [INFO ] [MAIN      ] Update Progress: 1223/2366 symbols completed. KSS took 32.4s. Estimated remaining: 2h 26m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:37:09.752533] [INFO ] [REMOTE    ] KTF: Fetching primary data for 2025-04.
[2025-10-24T19:37:09.890367] [INFO ] [MAIN      ] KVUE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:37:09.943947] [DEBUG] [LOCAL     ] KVUE: Loaded 54057 existing records from primary storage.
[2025-10-24T19:37:09.944249] [INFO ] [MAIN      ] KVUE: Loaded 54057 existing records.
[2025-10-24T19:37:10.120262] [WARN ] [MAIN      ] KVUE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:37:10.120467] [INFO ] [MAIN      ] KVUE: Wiping existing primary data before full refresh.
[2025-10-24T19:37:10.120514] [INFO ] [LOCAL     ] KVUE: Starting deletion of primary data.
[2025-10-24T19:37:10.120983] [DEBUG] [LOCAL     ] KVUE: Deleted primary data file.
[2025-10-24T19:37:10.121039] [INFO ] [MAIN      ] KVUE: Starting full primary refresh.
[2025-10-24T19:37:10.477321] [INFO ] [REMOTE    ] KVUE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:37:10.547602] [INFO ] [REMOTE    ] KVUE: Fetching primary data for 2025-01.
[2025-10-24T19:37:10.590683] [INFO ] [REMOTE    ] KTB: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T19:37:10.743627] [INFO ] [REMOTE    ] KTF: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T19:37:11.347628] [INFO ] [REMOTE    ] KTF: Fetching primary data for 2025-05.
[2025-10-24T19:37:12.059076] [INFO ] [REMOTE    ] KVUE: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T19:37:12.087501] [INFO ] [REMOTE    ] KTF: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T19:37:12.147668] [INFO ] [REMOTE    ] KTF: Fetching primary data for 2025-06.
[2025-10-24T19:37:12.947637] [INFO ] [REMOTE    ] KT: Fetching primary data for 2025-07.
[2025-10-24T19:37:13.023013] [INFO ] [REMOTE    ] KTF: Incremental fetch complete for 2025-06 (0.88 seconds).
[2025-10-24T19:37:13.747671] [INFO ] [REMOTE    ] KTF: Fetching primary data for 2025-07.
[2025-10-24T19:37:14.547717] [INFO ] [REMOTE    ] KVUE: Fetching primary data for 2025-02.
[2025-10-24T19:37:14.568750] [INFO ] [REMOTE    ] KTF: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T19:37:14.602883] [INFO ] [REMOTE    ] KT: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T19:37:15.347692] [INFO ] [REMOTE    ] KT: Fetching primary data for 2025-08.
[2025-10-24T19:37:16.147621] [INFO ] [REMOTE    ] KTF: Fetching primary data for 2025-08.
[2025-10-24T19:37:16.409923] [INFO ] [REMOTE    ] KVUE: Incremental fetch complete for 2025-02 (1.86 seconds).
[2025-10-24T19:37:16.911823] [INFO ] [REMOTE    ] KT: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T19:37:16.947603] [INFO ] [REMOTE    ] KT: Fetching primary data for 2025-09.
[2025-10-24T19:37:17.103937] [INFO ] [REMOTE    ] KTF: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T19:37:17.747686] [INFO ] [REMOTE    ] KTF: Fetching primary data for 2025-09.
[2025-10-24T19:37:18.462914] [INFO ] [REMOTE    ] KT: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T19:37:18.545960] [INFO ] [REMOTE    ] KTF: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T19:37:18.548123] [INFO ] [REMOTE    ] KT: Fetching primary data for 2025-10.
[2025-10-24T19:37:19.347674] [INFO ] [REMOTE    ] KVUE: Fetching primary data for 2025-03.
[2025-10-24T19:37:20.147631] [INFO ] [REMOTE    ] KTF: Fetching primary data for 2025-10.
[2025-10-24T19:37:20.288130] [INFO ] [REMOTE    ] KT: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T19:37:20.296447] [INFO ] [REMOTE    ] KT: Full fetch complete (66674 records).
[2025-10-24T19:37:20.296578] [DEBUG] [VALIDATOR ] KT: Validating primary data.
[2025-10-24T19:37:20.747715] [DEBUG] [VALIDATOR ] KT: All expected trading days are present.
[2025-10-24T19:37:20.747803] [DEBUG] [VALIDATOR ] KT: Primary data validation passed.
[2025-10-24T19:37:20.748865] [INFO ] [MAIN      ] KT: Fetched primary data is valid.
[2025-10-24T19:37:20.748928] [DEBUG] [LOCAL     ] KT: Saving primary data.
[2025-10-24T19:37:20.749627] [FATAL] [LOCAL     ] KT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:37:20.749758] [FATAL] [MAIN      ] KT: Failed to save primary data.
[2025-10-24T19:37:20.749802] [WARN ] [MAIN      ] KT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:37:20.749873] [INFO ] [LOCAL     ] KT: Starting deletion of primary data.
[2025-10-24T19:37:20.749970] [DEBUG] [LOCAL     ] KT: No primary data file found to delete.
[2025-10-24T19:37:20.750044] [INFO ] [LOCAL     ] KT: Starting deletion of derivative data.
[2025-10-24T19:37:20.750236] [DEBUG] [LOCAL     ] KT: Deleted derivative data file.
[2025-10-24T19:37:20.750849] [INFO ] [MAIN      ] Update Progress: 1224/2366 symbols completed. KT took 34.2s. Estimated remaining: 2h 26m 46s. Rate: 7.8 symbols/min
[2025-10-24T19:37:20.958182] [INFO ] [MAIN      ] KVYO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:37:20.958277] [INFO ] [REMOTE    ] KTB: Fetching primary data for 2025-05.
[2025-10-24T19:37:21.002840] [INFO ] [REMOTE    ] KTF: Incremental fetch complete for 2025-10 (0.86 seconds).
[2025-10-24T19:37:21.026939] [INFO ] [REMOTE    ] KTF: Full fetch complete (17323 records).
[2025-10-24T19:37:21.027100] [DEBUG] [VALIDATOR ] KTF: Validating primary data.
[2025-10-24T19:37:21.051699] [DEBUG] [LOCAL     ] KVYO: Loaded 51270 existing records from primary storage.
[2025-10-24T19:37:21.096430] [INFO ] [MAIN      ] KVYO: Loaded 51270 existing records.
[2025-10-24T19:37:21.571671] [WARN ] [MAIN      ] KVYO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:37:21.594808] [INFO ] [MAIN      ] KVYO: Wiping existing primary data before full refresh.
[2025-10-24T19:37:21.594732] [INFO ] [REMOTE    ] KVUE: Incremental fetch complete for 2025-03 (2.25 seconds).
[2025-10-24T19:37:21.594959] [INFO ] [LOCAL     ] KVYO: Starting deletion of primary data.
[2025-10-24T19:37:21.658869] [DEBUG] [LOCAL     ] KVYO: Deleted primary data file.
[2025-10-24T19:37:21.669891] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present.
[2025-10-24T19:37:21.669995] [INFO ] [MAIN      ] KVYO: Starting full primary refresh.
[2025-10-24T19:37:21.675236] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed.
[2025-10-24T19:37:21.732737] [INFO ] [MAIN      ] KTF: Fetched primary data is valid.
[2025-10-24T19:37:21.748996] [DEBUG] [LOCAL     ] KTF: Saving primary data.
[2025-10-24T19:37:21.748894] [INFO ] [REMOTE    ] KVUE: Fetching primary data for 2025-04.
[2025-10-24T19:37:21.774921] [FATAL] [LOCAL     ] KTF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:37:21.791256] [FATAL] [MAIN      ] KTF: Failed to save primary data.
[2025-10-24T19:37:21.791794] [WARN ] [MAIN      ] KTF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:37:21.812957] [INFO ] [LOCAL     ] KTF: Starting deletion of primary data.
[2025-10-24T19:37:21.862195] [DEBUG] [LOCAL     ] KTF: No primary data file found to delete.
[2025-10-24T19:37:21.886548] [INFO ] [LOCAL     ] KTF: Starting deletion of derivative data.
[2025-10-24T19:37:21.956673] [DEBUG] [LOCAL     ] KTF: Deleted derivative data file.
[2025-10-24T19:37:21.972694] [INFO ] [MAIN      ] Update Progress: 1225/2366 symbols completed. KTF took 23.0s. Estimated remaining: 2h 26m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:37:22.177089] [INFO ] [REMOTE    ] KVYO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:37:22.238138] [INFO ] [MAIN      ] KW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:37:22.275092] [DEBUG] [LOCAL     ] KW: Loaded 40548 existing records from primary storage.
[2025-10-24T19:37:22.275365] [INFO ] [MAIN      ] KW: Loaded 40548 existing records.
[2025-10-24T19:37:22.475826] [WARN ] [MAIN      ] KW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:37:22.477679] [INFO ] [MAIN      ] KW: Wiping existing primary data before full refresh.
[2025-10-24T19:37:22.477603] [INFO ] [REMOTE    ] KTB: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T19:37:22.477811] [INFO ] [LOCAL     ] KW: Starting deletion of primary data.
[2025-10-24T19:37:22.486594] [DEBUG] [LOCAL     ] KW: Deleted primary data file.
[2025-10-24T19:37:22.486683] [INFO ] [MAIN      ] KW: Starting full primary refresh.
[2025-10-24T19:37:22.552791] [INFO ] [REMOTE    ] KTB: Fetching primary data for 2025-06.
[2025-10-24T19:37:22.837126] [INFO ] [REMOTE    ] KW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:37:23.347630] [INFO ] [REMOTE    ] KVYO: Fetching primary data for 2025-01.
[2025-10-24T19:37:23.430083] [INFO ] [REMOTE    ] KVUE: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T19:37:24.147635] [INFO ] [REMOTE    ] KVUE: Fetching primary data for 2025-05.
[2025-10-24T19:37:24.321287] [INFO ] [REMOTE    ] KTB: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T19:37:24.641195] [INFO ] [REMOTE    ] KVYO: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T19:37:24.947722] [INFO ] [REMOTE    ] KTB: Fetching primary data for 2025-07.
[2025-10-24T19:37:25.747709] [INFO ] [REMOTE    ] KW: Fetching primary data for 2025-01.
[2025-10-24T19:37:25.794280] [INFO ] [REMOTE    ] KVUE: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T19:37:26.412050] [INFO ] [REMOTE    ] KTB: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T19:37:26.547617] [INFO ] [REMOTE    ] KTB: Fetching primary data for 2025-08.
[2025-10-24T19:37:27.054898] [INFO ] [REMOTE    ] KW: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T19:37:27.347633] [INFO ] [REMOTE    ] KW: Fetching primary data for 2025-02.
[2025-10-24T19:37:28.062754] [INFO ] [REMOTE    ] KTB: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T19:37:28.147616] [INFO ] [REMOTE    ] KTB: Fetching primary data for 2025-09.
[2025-10-24T19:37:28.553356] [INFO ] [REMOTE    ] KW: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T19:37:28.947686] [INFO ] [REMOTE    ] KVUE: Fetching primary data for 2025-06.
[2025-10-24T19:37:29.476761] [INFO ] [REMOTE    ] KTB: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T19:37:29.747637] [INFO ] [REMOTE    ] KTB: Fetching primary data for 2025-10.
[2025-10-24T19:37:30.547708] [INFO ] [REMOTE    ] KVYO: Fetching primary data for 2025-02.
[2025-10-24T19:37:30.980372] [INFO ] [REMOTE    ] KVUE: Incremental fetch complete for 2025-06 (2.03 seconds).
[2025-10-24T19:37:31.347622] [INFO ] [REMOTE    ] KVUE: Fetching primary data for 2025-07.
[2025-10-24T19:37:31.430781] [INFO ] [REMOTE    ] KTB: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T19:37:31.437612] [INFO ] [REMOTE    ] KTB: Full fetch complete (58311 records).
[2025-10-24T19:37:31.437772] [DEBUG] [VALIDATOR ] KTB: Validating primary data.
[2025-10-24T19:37:31.880839] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present.
[2025-10-24T19:37:31.880935] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed.
[2025-10-24T19:37:31.882024] [INFO ] [MAIN      ] KTB: Fetched primary data is valid.
[2025-10-24T19:37:31.882108] [DEBUG] [LOCAL     ] KTB: Saving primary data.
[2025-10-24T19:37:31.882687] [FATAL] [LOCAL     ] KTB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:37:31.882776] [FATAL] [MAIN      ] KTB: Failed to save primary data.
[2025-10-24T19:37:31.882821] [WARN ] [MAIN      ] KTB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:37:31.882904] [INFO ] [LOCAL     ] KTB: Starting deletion of primary data.
[2025-10-24T19:37:31.882997] [DEBUG] [LOCAL     ] KTB: No primary data file found to delete.
[2025-10-24T19:37:31.883046] [INFO ] [LOCAL     ] KTB: Starting deletion of derivative data.
[2025-10-24T19:37:31.883245] [DEBUG] [LOCAL     ] KTB: Deleted derivative data file.
[2025-10-24T19:37:31.883754] [INFO ] [MAIN      ] Update Progress: 1226/2366 symbols completed. KTB took 34.1s. Estimated remaining: 2h 26m 26s. Rate: 7.8 symbols/min
[2025-10-24T19:37:32.080133] [INFO ] [MAIN      ] KWR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:37:32.108336] [INFO ] [REMOTE    ] KVYO: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T19:37:32.130341] [DEBUG] [LOCAL     ] KWR: Loaded 15764 existing records from primary storage.
[2025-10-24T19:37:32.130585] [INFO ] [MAIN      ] KWR: Loaded 15764 existing records.
[2025-10-24T19:37:32.153813] [INFO ] [REMOTE    ] KW: Fetching primary data for 2025-03.
[2025-10-24T19:37:32.333260] [WARN ] [MAIN      ] KWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:37:32.333436] [INFO ] [MAIN      ] KWR: Wiping existing primary data before full refresh.
[2025-10-24T19:37:32.333493] [INFO ] [LOCAL     ] KWR: Starting deletion of primary data.
[2025-10-24T19:37:32.333824] [DEBUG] [LOCAL     ] KWR: Deleted primary data file.
[2025-10-24T19:37:32.333903] [INFO ] [MAIN      ] KWR: Starting full primary refresh.
[2025-10-24T19:37:32.679969] [INFO ] [REMOTE    ] KWR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:37:32.947631] [INFO ] [REMOTE    ] KVYO: Fetching primary data for 2025-03.
[2025-10-24T19:37:33.419638] [INFO ] [REMOTE    ] KVUE: Incremental fetch complete for 2025-07 (2.07 seconds).
[2025-10-24T19:37:33.655552] [INFO ] [REMOTE    ] KW: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T19:37:33.747713] [INFO ] [REMOTE    ] KW: Fetching primary data for 2025-04.
[2025-10-24T19:37:34.547639] [INFO ] [REMOTE    ] KVUE: Fetching primary data for 2025-08.
[2025-10-24T19:37:34.997489] [INFO ] [REMOTE    ] KVYO: Incremental fetch complete for 2025-03 (2.05 seconds).
[2025-10-24T19:37:35.347621] [INFO ] [REMOTE    ] KVYO: Fetching primary data for 2025-04.
[2025-10-24T19:37:35.410009] [INFO ] [REMOTE    ] KW: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T19:37:36.147685] [INFO ] [REMOTE    ] KW: Fetching primary data for 2025-05.
[2025-10-24T19:37:36.260675] [INFO ] [REMOTE    ] KVUE: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T19:37:36.947630] [INFO ] [REMOTE    ] KWR: Fetching primary data for 2025-01.
[2025-10-24T19:37:37.079875] [INFO ] [REMOTE    ] KVYO: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T19:37:37.689215] [INFO ] [REMOTE    ] KW: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T19:37:37.747610] [INFO ] [REMOTE    ] KW: Fetching primary data for 2025-06.
[2025-10-24T19:37:38.114242] [INFO ] [REMOTE    ] KWR: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T19:37:38.547675] [INFO ] [REMOTE    ] KWR: Fetching primary data for 2025-02.
[2025-10-24T19:37:39.192941] [INFO ] [REMOTE    ] KW: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T19:37:39.245048] [INFO ] [REMOTE    ] KWR: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T19:37:39.347624] [INFO ] [REMOTE    ] KVYO: Fetching primary data for 2025-05.
[2025-10-24T19:37:40.147694] [INFO ] [REMOTE    ] KW: Fetching primary data for 2025-07.
[2025-10-24T19:37:40.960109] [INFO ] [REMOTE    ] KVUE: Fetching primary data for 2025-09.
[2025-10-24T19:37:40.968609] [INFO ] [REMOTE    ] KVYO: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T19:37:41.530816] [INFO ] [REMOTE    ] KW: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T19:37:41.747685] [INFO ] [REMOTE    ] KWR: Fetching primary data for 2025-03.
[2025-10-24T19:37:42.547707] [INFO ] [REMOTE    ] KVYO: Fetching primary data for 2025-06.
[2025-10-24T19:37:42.703495] [INFO ] [REMOTE    ] KWR: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T19:37:43.102200] [INFO ] [REMOTE    ] KVUE: Incremental fetch complete for 2025-09 (2.14 seconds).
[2025-10-24T19:37:43.347688] [INFO ] [REMOTE    ] KVUE: Fetching primary data for 2025-10.
[2025-10-24T19:37:43.992012] [INFO ] [REMOTE    ] KVYO: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T19:37:44.147763] [INFO ] [REMOTE    ] KWR: Fetching primary data for 2025-04.
[2025-10-24T19:37:44.947754] [INFO ] [REMOTE    ] KW: Fetching primary data for 2025-08.
[2025-10-24T19:37:45.172712] [INFO ] [REMOTE    ] KWR: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T19:37:45.702332] [INFO ] [REMOTE    ] KVUE: Incremental fetch complete for 2025-10 (2.35 seconds).
[2025-10-24T19:37:45.712380] [INFO ] [REMOTE    ] KVUE: Full fetch complete (77845 records).
[2025-10-24T19:37:45.712544] [DEBUG] [VALIDATOR ] KVUE: Validating primary data.
[2025-10-24T19:37:45.756491] [INFO ] [REMOTE    ] KWR: Fetching primary data for 2025-05.
[2025-10-24T19:37:46.131211] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present.
[2025-10-24T19:37:46.131422] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed.
[2025-10-24T19:37:46.132618] [INFO ] [MAIN      ] KVUE: Fetched primary data is valid.
[2025-10-24T19:37:46.132905] [DEBUG] [LOCAL     ] KVUE: Saving primary data.
[2025-10-24T19:37:46.133828] [FATAL] [LOCAL     ] KVUE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:37:46.134020] [FATAL] [MAIN      ] KVUE: Failed to save primary data.
[2025-10-24T19:37:46.134094] [WARN ] [MAIN      ] KVUE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:37:46.134163] [INFO ] [LOCAL     ] KVUE: Starting deletion of primary data.
[2025-10-24T19:37:46.134230] [DEBUG] [LOCAL     ] KVUE: No primary data file found to delete.
[2025-10-24T19:37:46.134270] [INFO ] [LOCAL     ] KVUE: Starting deletion of derivative data.
[2025-10-24T19:37:46.134450] [DEBUG] [LOCAL     ] KVUE: Deleted derivative data file.
[2025-10-24T19:37:46.134788] [INFO ] [MAIN      ] Update Progress: 1227/2366 symbols completed. KVUE took 36.4s. Estimated remaining: 2h 26m 25s. Rate: 7.8 symbols/min
[2025-10-24T19:37:46.270875] [INFO ] [REMOTE    ] KW: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T19:37:46.360343] [INFO ] [MAIN      ] KYN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:37:46.405039] [DEBUG] [LOCAL     ] KYN: Loaded 30347 existing records from primary storage.
[2025-10-24T19:37:46.405445] [INFO ] [MAIN      ] KYN: Loaded 30347 existing records.
[2025-10-24T19:37:46.552887] [INFO ] [REMOTE    ] KW: Fetching primary data for 2025-09.
[2025-10-24T19:37:46.669759] [WARN ] [MAIN      ] KYN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:37:46.670229] [INFO ] [MAIN      ] KYN: Wiping existing primary data before full refresh.
[2025-10-24T19:37:46.670297] [INFO ] [LOCAL     ] KYN: Starting deletion of primary data.
[2025-10-24T19:37:46.670786] [DEBUG] [LOCAL     ] KYN: Deleted primary data file.
[2025-10-24T19:37:46.670854] [INFO ] [MAIN      ] KYN: Starting full primary refresh.
[2025-10-24T19:37:47.001993] [INFO ] [REMOTE    ] KWR: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T19:37:47.216665] [INFO ] [REMOTE    ] KYN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:37:47.347732] [INFO ] [REMOTE    ] KYN: Fetching primary data for 2025-01.
[2025-10-24T19:37:47.924400] [INFO ] [REMOTE    ] KW: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T19:37:48.147614] [INFO ] [REMOTE    ] KW: Fetching primary data for 2025-10.
[2025-10-24T19:37:48.206962] [INFO ] [REMOTE    ] KYN: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T19:37:48.947664] [INFO ] [REMOTE    ] KWR: Fetching primary data for 2025-06.
[2025-10-24T19:37:49.590836] [INFO ] [REMOTE    ] KW: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T19:37:49.598691] [INFO ] [REMOTE    ] KW: Full fetch complete (57221 records).
[2025-10-24T19:37:49.598933] [DEBUG] [VALIDATOR ] KW: Validating primary data.
[2025-10-24T19:37:49.752761] [INFO ] [REMOTE    ] KYN: Fetching primary data for 2025-02.
[2025-10-24T19:37:50.022433] [DEBUG] [VALIDATOR ] KW: All expected trading days are present.
[2025-10-24T19:37:50.027736] [DEBUG] [VALIDATOR ] KW: Primary data validation passed.
[2025-10-24T19:37:50.034157] [INFO ] [MAIN      ] KW: Fetched primary data is valid.
[2025-10-24T19:37:50.034560] [INFO ] [REMOTE    ] KWR: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T19:37:50.034833] [DEBUG] [LOCAL     ] KW: Saving primary data.
[2025-10-24T19:37:50.038912] [FATAL] [LOCAL     ] KW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:37:50.039426] [FATAL] [MAIN      ] KW: Failed to save primary data.
[2025-10-24T19:37:50.039806] [WARN ] [MAIN      ] KW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:37:50.039877] [INFO ] [LOCAL     ] KW: Starting deletion of primary data.
[2025-10-24T19:37:50.039945] [DEBUG] [LOCAL     ] KW: No primary data file found to delete.
[2025-10-24T19:37:50.039982] [INFO ] [LOCAL     ] KW: Starting deletion of derivative data.
[2025-10-24T19:37:50.040143] [DEBUG] [LOCAL     ] KW: Deleted derivative data file.
[2025-10-24T19:37:50.040776] [INFO ] [MAIN      ] Update Progress: 1228/2366 symbols completed. KW took 28.1s. Estimated remaining: 2h 26m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:37:50.216319] [INFO ] [MAIN      ] L: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:37:50.257344] [DEBUG] [LOCAL     ] L: Loaded 41436 existing records from primary storage.
[2025-10-24T19:37:50.257709] [INFO ] [MAIN      ] L: Loaded 41436 existing records.
[2025-10-24T19:37:50.448424] [WARN ] [MAIN      ] L: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:37:50.448666] [INFO ] [MAIN      ] L: Wiping existing primary data before full refresh.
[2025-10-24T19:37:50.448728] [INFO ] [LOCAL     ] L: Starting deletion of primary data.
[2025-10-24T19:37:50.449062] [DEBUG] [LOCAL     ] L: Deleted primary data file.
[2025-10-24T19:37:50.449120] [INFO ] [MAIN      ] L: Starting full primary refresh.
[2025-10-24T19:37:50.553264] [INFO ] [REMOTE    ] KWR: Fetching primary data for 2025-07.
[2025-10-24T19:37:50.815874] [INFO ] [REMOTE    ] L: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:37:51.054584] [INFO ] [REMOTE    ] KYN: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T19:37:51.347721] [INFO ] [REMOTE    ] KYN: Fetching primary data for 2025-03.
[2025-10-24T19:37:51.488241] [INFO ] [REMOTE    ] KWR: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T19:37:52.147686] [INFO ] [REMOTE    ] KWR: Fetching primary data for 2025-08.
[2025-10-24T19:37:52.565500] [INFO ] [REMOTE    ] KYN: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T19:37:52.947692] [INFO ] [REMOTE    ] L: Fetching primary data for 2025-01.
[2025-10-24T19:37:53.149934] [INFO ] [REMOTE    ] KWR: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T19:37:53.747681] [INFO ] [REMOTE    ] KWR: Fetching primary data for 2025-09.
[2025-10-24T19:37:54.355604] [INFO ] [REMOTE    ] L: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T19:37:54.515697] [INFO ] [REMOTE    ] KWR: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T19:37:54.547699] [INFO ] [REMOTE    ] KWR: Fetching primary data for 2025-10.
[2025-10-24T19:37:55.347715] [INFO ] [REMOTE    ] KYN: Fetching primary data for 2025-04.
[2025-10-24T19:37:55.521897] [INFO ] [REMOTE    ] KWR: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T19:37:55.524356] [INFO ] [REMOTE    ] KWR: Full fetch complete (23199 records).
[2025-10-24T19:37:55.524424] [DEBUG] [VALIDATOR ] KWR: Validating primary data.
[2025-10-24T19:37:55.887296] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present.
[2025-10-24T19:37:55.887389] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed.
[2025-10-24T19:37:55.887919] [INFO ] [MAIN      ] KWR: Fetched primary data is valid.
[2025-10-24T19:37:55.887983] [DEBUG] [LOCAL     ] KWR: Saving primary data.
[2025-10-24T19:37:55.888342] [FATAL] [LOCAL     ] KWR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:37:55.888430] [FATAL] [MAIN      ] KWR: Failed to save primary data.
[2025-10-24T19:37:55.888472] [WARN ] [MAIN      ] KWR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:37:55.888509] [INFO ] [LOCAL     ] KWR: Starting deletion of primary data.
[2025-10-24T19:37:55.888561] [DEBUG] [LOCAL     ] KWR: No primary data file found to delete.
[2025-10-24T19:37:55.888596] [INFO ] [LOCAL     ] KWR: Starting deletion of derivative data.
[2025-10-24T19:37:55.888808] [DEBUG] [LOCAL     ] KWR: Deleted derivative data file.
[2025-10-24T19:37:55.888905] [INFO ] [MAIN      ] Update Progress: 1229/2366 symbols completed. KWR took 24.0s. Estimated remaining: 2h 26m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:37:56.061161] [INFO ] [MAIN      ] LAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:37:56.112270] [DEBUG] [LOCAL     ] LAC: Loaded 52961 existing records from primary storage.
[2025-10-24T19:37:56.112562] [INFO ] [MAIN      ] LAC: Loaded 52961 existing records.
[2025-10-24T19:37:56.154422] [INFO ] [REMOTE    ] KVYO: Fetching primary data for 2025-07.
[2025-10-24T19:37:56.297016] [WARN ] [MAIN      ] LAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:37:56.297224] [INFO ] [MAIN      ] LAC: Wiping existing primary data before full refresh.
[2025-10-24T19:37:56.297282] [INFO ] [LOCAL     ] LAC: Starting deletion of primary data.
[2025-10-24T19:37:56.297828] [DEBUG] [LOCAL     ] LAC: Deleted primary data file.
[2025-10-24T19:37:56.297882] [INFO ] [MAIN      ] LAC: Starting full primary refresh.
[2025-10-24T19:37:56.657176] [INFO ] [REMOTE    ] LAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:37:56.677306] [INFO ] [REMOTE    ] KYN: Incremental fetch complete for 2025-04 (1.33 seconds).
[2025-10-24T19:37:56.947698] [INFO ] [REMOTE    ] KYN: Fetching primary data for 2025-05.
[2025-10-24T19:37:57.306543] [INFO ] [REMOTE    ] KVYO: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T19:37:57.678227] [INFO ] [REMOTE    ] KYN: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T19:37:57.747611] [INFO ] [REMOTE    ] KYN: Fetching primary data for 2025-06.
[2025-10-24T19:37:58.547667] [INFO ] [REMOTE    ] L: Fetching primary data for 2025-02.
[2025-10-24T19:37:59.090949] [INFO ] [REMOTE    ] KYN: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T19:37:59.347730] [INFO ] [REMOTE    ] KYN: Fetching primary data for 2025-07.
[2025-10-24T19:37:59.860743] [INFO ] [REMOTE    ] L: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T19:38:00.147675] [INFO ] [REMOTE    ] L: Fetching primary data for 2025-03.
[2025-10-24T19:38:00.652168] [INFO ] [REMOTE    ] KYN: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T19:38:00.947680] [INFO ] [REMOTE    ] KYN: Fetching primary data for 2025-08.
[2025-10-24T19:38:01.297035] [INFO ] [REMOTE    ] L: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T19:38:01.747719] [INFO ] [REMOTE    ] LAC: Fetching primary data for 2025-01.
[2025-10-24T19:38:02.194926] [INFO ] [REMOTE    ] KYN: Incremental fetch complete for 2025-08 (1.25 seconds).
[2025-10-24T19:38:02.547612] [INFO ] [REMOTE    ] KYN: Fetching primary data for 2025-09.
[2025-10-24T19:38:03.347624] [INFO ] [REMOTE    ] KVYO: Fetching primary data for 2025-08.
[2025-10-24T19:38:03.619330] [INFO ] [REMOTE    ] LAC: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T19:38:03.713248] [INFO ] [REMOTE    ] KYN: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T19:38:04.147620] [INFO ] [REMOTE    ] KYN: Fetching primary data for 2025-10.
[2025-10-24T19:38:04.947676] [INFO ] [REMOTE    ] L: Fetching primary data for 2025-04.
[2025-10-24T19:38:05.108195] [INFO ] [REMOTE    ] KVYO: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T19:38:05.548588] [INFO ] [REMOTE    ] KYN: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T19:38:05.556079] [INFO ] [REMOTE    ] KYN: Full fetch complete (44377 records).
[2025-10-24T19:38:05.556190] [DEBUG] [VALIDATOR ] KYN: Validating primary data.
[2025-10-24T19:38:05.752783] [INFO ] [REMOTE    ] KVYO: Fetching primary data for 2025-09.
[2025-10-24T19:38:05.948683] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present.
[2025-10-24T19:38:05.948769] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed.
[2025-10-24T19:38:05.949540] [INFO ] [MAIN      ] KYN: Fetched primary data is valid.
[2025-10-24T19:38:05.949580] [DEBUG] [LOCAL     ] KYN: Saving primary data.
[2025-10-24T19:38:05.949975] [FATAL] [LOCAL     ] KYN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:38:05.950063] [FATAL] [MAIN      ] KYN: Failed to save primary data.
[2025-10-24T19:38:05.950105] [WARN ] [MAIN      ] KYN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:38:05.950140] [INFO ] [LOCAL     ] KYN: Starting deletion of primary data.
[2025-10-24T19:38:05.950190] [DEBUG] [LOCAL     ] KYN: No primary data file found to delete.
[2025-10-24T19:38:05.950228] [INFO ] [LOCAL     ] KYN: Starting deletion of derivative data.
[2025-10-24T19:38:05.950372] [DEBUG] [LOCAL     ] KYN: Deleted derivative data file.
[2025-10-24T19:38:05.950443] [INFO ] [MAIN      ] Update Progress: 1230/2366 symbols completed. KYN took 19.8s. Estimated remaining: 2h 25m 58s. Rate: 7.8 symbols/min
[2025-10-24T19:38:06.123014] [INFO ] [MAIN      ] LAD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:38:06.148121] [DEBUG] [LOCAL     ] LAD: Loaded 23562 existing records from primary storage.
[2025-10-24T19:38:06.148370] [INFO ] [MAIN      ] LAD: Loaded 23562 existing records.
[2025-10-24T19:38:06.329692] [WARN ] [MAIN      ] LAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:38:06.330031] [INFO ] [MAIN      ] LAD: Wiping existing primary data before full refresh.
[2025-10-24T19:38:06.330088] [INFO ] [LOCAL     ] LAD: Starting deletion of primary data.
[2025-10-24T19:38:06.330385] [DEBUG] [LOCAL     ] LAD: Deleted primary data file.
[2025-10-24T19:38:06.330443] [INFO ] [MAIN      ] LAD: Starting full primary refresh.
[2025-10-24T19:38:06.556443] [INFO ] [REMOTE    ] LAC: Fetching primary data for 2025-02.
[2025-10-24T19:38:06.722840] [INFO ] [REMOTE    ] LAD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:38:06.725599] [INFO ] [REMOTE    ] L: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T19:38:07.347691] [INFO ] [REMOTE    ] LAD: Fetching primary data for 2025-01.
[2025-10-24T19:38:07.463209] [INFO ] [REMOTE    ] KVYO: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T19:38:08.147617] [INFO ] [REMOTE    ] L: Fetching primary data for 2025-05.
[2025-10-24T19:38:08.341750] [INFO ] [REMOTE    ] LAC: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T19:38:08.414976] [INFO ] [REMOTE    ] LAD: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T19:38:08.947672] [INFO ] [REMOTE    ] LAD: Fetching primary data for 2025-02.
[2025-10-24T19:38:09.614345] [INFO ] [REMOTE    ] L: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T19:38:09.747614] [INFO ] [REMOTE    ] KVYO: Fetching primary data for 2025-10.
[2025-10-24T19:38:10.148035] [INFO ] [REMOTE    ] LAD: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T19:38:10.547670] [INFO ] [REMOTE    ] LAC: Fetching primary data for 2025-03.
[2025-10-24T19:38:11.347626] [INFO ] [REMOTE    ] LAD: Fetching primary data for 2025-03.
[2025-10-24T19:38:11.426490] [INFO ] [REMOTE    ] KVYO: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T19:38:11.436013] [INFO ] [REMOTE    ] KVYO: Full fetch complete (72367 records).
[2025-10-24T19:38:11.436137] [DEBUG] [VALIDATOR ] KVYO: Validating primary data.
[2025-10-24T19:38:11.825695] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present.
[2025-10-24T19:38:11.825849] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed.
[2025-10-24T19:38:11.827086] [INFO ] [MAIN      ] KVYO: Fetched primary data is valid.
[2025-10-24T19:38:11.827227] [DEBUG] [LOCAL     ] KVYO: Saving primary data.
[2025-10-24T19:38:11.827961] [FATAL] [LOCAL     ] KVYO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:38:11.828059] [FATAL] [MAIN      ] KVYO: Failed to save primary data.
[2025-10-24T19:38:11.828106] [WARN ] [MAIN      ] KVYO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:38:11.828171] [INFO ] [LOCAL     ] KVYO: Starting deletion of primary data.
[2025-10-24T19:38:11.828234] [DEBUG] [LOCAL     ] KVYO: No primary data file found to delete.
[2025-10-24T19:38:11.828271] [INFO ] [LOCAL     ] KVYO: Starting deletion of derivative data.
[2025-10-24T19:38:11.828419] [DEBUG] [LOCAL     ] KVYO: Deleted derivative data file.
[2025-10-24T19:38:11.829042] [INFO ] [MAIN      ] Update Progress: 1231/2366 symbols completed. KVYO took 51.1s. Estimated remaining: 2h 25m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:38:12.006187] [INFO ] [MAIN      ] LADR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:38:12.043800] [INFO ] [REMOTE    ] LAC: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T19:38:12.088608] [DEBUG] [LOCAL     ] LADR: Loaded 39650 existing records from primary storage.
[2025-10-24T19:38:12.088949] [INFO ] [MAIN      ] LADR: Loaded 39650 existing records.
[2025-10-24T19:38:12.152272] [INFO ] [REMOTE    ] L: Fetching primary data for 2025-06.
[2025-10-24T19:38:12.275863] [WARN ] [MAIN      ] LADR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:38:12.276100] [INFO ] [MAIN      ] LADR: Wiping existing primary data before full refresh.
[2025-10-24T19:38:12.276148] [INFO ] [LOCAL     ] LADR: Starting deletion of primary data.
[2025-10-24T19:38:12.276597] [DEBUG] [LOCAL     ] LADR: Deleted primary data file.
[2025-10-24T19:38:12.276695] [INFO ] [MAIN      ] LADR: Starting full primary refresh.
[2025-10-24T19:38:12.644381] [INFO ] [REMOTE    ] LAD: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T19:38:12.663898] [INFO ] [REMOTE    ] LADR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:38:12.947721] [INFO ] [REMOTE    ] LAC: Fetching primary data for 2025-04.
[2025-10-24T19:38:13.747617] [INFO ] [REMOTE    ] LAD: Fetching primary data for 2025-04.
[2025-10-24T19:38:13.787393] [INFO ] [REMOTE    ] L: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T19:38:14.547618] [INFO ] [REMOTE    ] L: Fetching primary data for 2025-07.
[2025-10-24T19:38:14.956495] [INFO ] [REMOTE    ] LAC: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T19:38:14.993476] [INFO ] [REMOTE    ] LAD: Incremental fetch complete for 2025-04 (1.25 seconds).
[2025-10-24T19:38:15.347729] [INFO ] [REMOTE    ] LAD: Fetching primary data for 2025-05.
[2025-10-24T19:38:15.993260] [INFO ] [REMOTE    ] L: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T19:38:16.147613] [INFO ] [REMOTE    ] L: Fetching primary data for 2025-08.
[2025-10-24T19:38:16.420796] [INFO ] [REMOTE    ] LAD: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T19:38:16.947688] [INFO ] [REMOTE    ] LAC: Fetching primary data for 2025-05.
[2025-10-24T19:38:17.553230] [INFO ] [REMOTE    ] L: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T19:38:17.747629] [INFO ] [REMOTE    ] LADR: Fetching primary data for 2025-01.
[2025-10-24T19:38:18.547619] [INFO ] [REMOTE    ] LAD: Fetching primary data for 2025-06.
[2025-10-24T19:38:18.675573] [INFO ] [REMOTE    ] LAC: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T19:38:18.725370] [INFO ] [REMOTE    ] LADR: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T19:38:19.193251] [INFO ] [REMOTE    ] LAD: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T19:38:19.347675] [INFO ] [REMOTE    ] LADR: Fetching primary data for 2025-02.
[2025-10-24T19:38:20.147730] [INFO ] [REMOTE    ] LAD: Fetching primary data for 2025-07.
[2025-10-24T19:38:20.665293] [INFO ] [REMOTE    ] LADR: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T19:38:20.947675] [INFO ] [REMOTE    ] LAC: Fetching primary data for 2025-06.
[2025-10-24T19:38:21.276635] [INFO ] [REMOTE    ] LAD: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T19:38:21.747665] [INFO ] [REMOTE    ] L: Fetching primary data for 2025-09.
[2025-10-24T19:38:22.547609] [INFO ] [REMOTE    ] LAD: Fetching primary data for 2025-08.
[2025-10-24T19:38:22.658270] [INFO ] [REMOTE    ] LAC: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T19:38:23.176061] [INFO ] [REMOTE    ] L: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T19:38:23.347629] [INFO ] [REMOTE    ] LADR: Fetching primary data for 2025-03.
[2025-10-24T19:38:23.696024] [INFO ] [REMOTE    ] LAD: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T19:38:24.147718] [INFO ] [REMOTE    ] LAC: Fetching primary data for 2025-07.
[2025-10-24T19:38:24.549723] [INFO ] [REMOTE    ] LADR: Incremental fetch complete for 2025-03 (1.20 seconds).
[2025-10-24T19:38:24.947680] [INFO ] [REMOTE    ] LADR: Fetching primary data for 2025-04.
[2025-10-24T19:38:25.747754] [INFO ] [REMOTE    ] LAD: Fetching primary data for 2025-09.
[2025-10-24T19:38:26.341394] [INFO ] [REMOTE    ] LAC: Incremental fetch complete for 2025-07 (2.19 seconds).
[2025-10-24T19:38:26.418580] [INFO ] [REMOTE    ] LADR: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T19:38:26.440930] [INFO ] [REMOTE    ] LAD: Incremental fetch complete for 2025-09 (0.69 seconds).
[2025-10-24T19:38:26.547615] [INFO ] [REMOTE    ] LADR: Fetching primary data for 2025-05.
[2025-10-24T19:38:27.347635] [INFO ] [REMOTE    ] L: Fetching primary data for 2025-10.
[2025-10-24T19:38:27.911552] [INFO ] [REMOTE    ] LADR: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T19:38:28.147670] [INFO ] [REMOTE    ] LADR: Fetching primary data for 2025-06.
[2025-10-24T19:38:28.947614] [INFO ] [REMOTE    ] LAD: Fetching primary data for 2025-10.
[2025-10-24T19:38:29.176553] [INFO ] [REMOTE    ] L: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T19:38:29.184592] [INFO ] [REMOTE    ] L: Full fetch complete (59291 records).
[2025-10-24T19:38:29.184738] [DEBUG] [VALIDATOR ] L: Validating primary data.
[2025-10-24T19:38:29.506338] [INFO ] [REMOTE    ] LADR: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T19:38:29.604725] [DEBUG] [VALIDATOR ] L: All expected trading days are present.
[2025-10-24T19:38:29.604805] [DEBUG] [VALIDATOR ] L: Primary data validation passed.
[2025-10-24T19:38:29.605714] [INFO ] [MAIN      ] L: Fetched primary data is valid.
[2025-10-24T19:38:29.605777] [DEBUG] [LOCAL     ] L: Saving primary data.
[2025-10-24T19:38:29.606235] [FATAL] [LOCAL     ] L: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:38:29.606325] [FATAL] [MAIN      ] L: Failed to save primary data.
[2025-10-24T19:38:29.606368] [WARN ] [MAIN      ] L: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:38:29.606437] [INFO ] [LOCAL     ] L: Starting deletion of primary data.
[2025-10-24T19:38:29.606724] [DEBUG] [LOCAL     ] L: No primary data file found to delete.
[2025-10-24T19:38:29.606770] [INFO ] [LOCAL     ] L: Starting deletion of derivative data.
[2025-10-24T19:38:29.607067] [DEBUG] [LOCAL     ] L: Deleted derivative data file.
[2025-10-24T19:38:29.607513] [INFO ] [MAIN      ] Update Progress: 1232/2366 symbols completed. L took 39.6s. Estimated remaining: 2h 25m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:38:29.755613] [INFO ] [REMOTE    ] LADR: Fetching primary data for 2025-07.
[2025-10-24T19:38:29.781196] [INFO ] [MAIN      ] LANV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:38:29.786077] [DEBUG] [LOCAL     ] LANV: Loaded 2803 existing records from primary storage.
[2025-10-24T19:38:29.786264] [INFO ] [MAIN      ] LANV: Loaded 2803 existing records.
[2025-10-24T19:38:29.961503] [WARN ] [MAIN      ] LANV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:38:29.961739] [INFO ] [MAIN      ] LANV: Wiping existing primary data before full refresh.
[2025-10-24T19:38:29.961790] [INFO ] [LOCAL     ] LANV: Starting deletion of primary data.
[2025-10-24T19:38:29.961923] [DEBUG] [LOCAL     ] LANV: Deleted primary data file.
[2025-10-24T19:38:29.961962] [INFO ] [MAIN      ] LANV: Starting full primary refresh.
[2025-10-24T19:38:30.329689] [INFO ] [REMOTE    ] LANV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:38:30.433722] [INFO ] [REMOTE    ] LAD: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T19:38:30.438683] [INFO ] [REMOTE    ] LAD: Full fetch complete (35673 records).
[2025-10-24T19:38:30.438774] [DEBUG] [VALIDATOR ] LAD: Validating primary data.
[2025-10-24T19:38:30.552834] [INFO ] [REMOTE    ] LAC: Fetching primary data for 2025-08.
[2025-10-24T19:38:30.814250] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present.
[2025-10-24T19:38:30.814327] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed.
[2025-10-24T19:38:30.815081] [INFO ] [MAIN      ] LAD: Fetched primary data is valid.
[2025-10-24T19:38:30.815142] [DEBUG] [LOCAL     ] LAD: Saving primary data.
[2025-10-24T19:38:30.815475] [FATAL] [LOCAL     ] LAD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:38:30.815579] [FATAL] [MAIN      ] LAD: Failed to save primary data.
[2025-10-24T19:38:30.815620] [WARN ] [MAIN      ] LAD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:38:30.815701] [INFO ] [LOCAL     ] LAD: Starting deletion of primary data.
[2025-10-24T19:38:30.815763] [DEBUG] [LOCAL     ] LAD: No primary data file found to delete.
[2025-10-24T19:38:30.815798] [INFO ] [LOCAL     ] LAD: Starting deletion of derivative data.
[2025-10-24T19:38:30.815915] [DEBUG] [LOCAL     ] LAD: Deleted derivative data file.
[2025-10-24T19:38:30.815986] [INFO ] [MAIN      ] Update Progress: 1233/2366 symbols completed. LAD took 24.9s. Estimated remaining: 2h 25m 37s. Rate: 7.8 symbols/min
[2025-10-24T19:38:30.986622] [INFO ] [MAIN      ] LAR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:38:30.986917] [DEBUG] [LOCAL     ] LAR: No existing data file found in primary storage.
[2025-10-24T19:38:30.987078] [WARN ] [MAIN      ] LAR: No existing data found, performing full refresh instead.
[2025-10-24T19:38:30.987231] [INFO ] [MAIN      ] LAR: Wiping existing primary data before full refresh.
[2025-10-24T19:38:30.987302] [INFO ] [LOCAL     ] LAR: Starting deletion of primary data.
[2025-10-24T19:38:30.987362] [DEBUG] [LOCAL     ] LAR: No primary data file found to delete.
[2025-10-24T19:38:30.987407] [INFO ] [MAIN      ] LAR: Starting full primary refresh.
[2025-10-24T19:38:31.344455] [INFO ] [REMOTE    ] LADR: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T19:38:31.375341] [INFO ] [REMOTE    ] LANV: Fetching primary data for 2025-01.
[2025-10-24T19:38:31.375145] [INFO ] [REMOTE    ] LAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:38:31.947052] [INFO ] [REMOTE    ] LANV: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T19:38:32.121665] [INFO ] [REMOTE    ] LAC: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T19:38:32.147608] [INFO ] [REMOTE    ] LAR: Fetching primary data for 2025-01.
[2025-10-24T19:38:32.947726] [INFO ] [REMOTE    ] LADR: Fetching primary data for 2025-08.
[2025-10-24T19:38:32.995469] [INFO ] [REMOTE    ] LAR: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T19:38:33.747693] [INFO ] [REMOTE    ] LAR: Fetching primary data for 2025-02.
[2025-10-24T19:38:34.354060] [INFO ] [REMOTE    ] LADR: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T19:38:34.547613] [INFO ] [REMOTE    ] LADR: Fetching primary data for 2025-09.
[2025-10-24T19:38:35.347684] [INFO ] [REMOTE    ] LAC: Fetching primary data for 2025-09.
[2025-10-24T19:38:35.513336] [INFO ] [REMOTE    ] LAR: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T19:38:35.928055] [INFO ] [REMOTE    ] LADR: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T19:38:36.147636] [INFO ] [REMOTE    ] LADR: Fetching primary data for 2025-10.
[2025-10-24T19:38:36.947707] [INFO ] [REMOTE    ] LAR: Fetching primary data for 2025-03.
[2025-10-24T19:38:37.617050] [INFO ] [REMOTE    ] LAC: Incremental fetch complete for 2025-09 (2.27 seconds).
[2025-10-24T19:38:37.639859] [INFO ] [REMOTE    ] LADR: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T19:38:37.648262] [INFO ] [REMOTE    ] LADR: Full fetch complete (55688 records).
[2025-10-24T19:38:37.648406] [DEBUG] [VALIDATOR ] LADR: Validating primary data.
[2025-10-24T19:38:37.750633] [INFO ] [REMOTE    ] LANV: Fetching primary data for 2025-02.
[2025-10-24T19:38:38.050474] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present.
[2025-10-24T19:38:38.050570] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed.
[2025-10-24T19:38:38.051506] [INFO ] [MAIN      ] LADR: Fetched primary data is valid.
[2025-10-24T19:38:38.051674] [DEBUG] [LOCAL     ] LADR: Saving primary data.
[2025-10-24T19:38:38.052249] [FATAL] [LOCAL     ] LADR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:38:38.052440] [FATAL] [MAIN      ] LADR: Failed to save primary data.
[2025-10-24T19:38:38.052524] [WARN ] [MAIN      ] LADR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:38:38.052730] [INFO ] [LOCAL     ] LADR: Starting deletion of primary data.
[2025-10-24T19:38:38.053042] [DEBUG] [LOCAL     ] LADR: No primary data file found to delete.
[2025-10-24T19:38:38.053112] [INFO ] [LOCAL     ] LADR: Starting deletion of derivative data.
[2025-10-24T19:38:38.073559] [DEBUG] [LOCAL     ] LADR: Deleted derivative data file.
[2025-10-24T19:38:38.076679] [INFO ] [MAIN      ] Update Progress: 1234/2366 symbols completed. LADR took 26.2s. Estimated remaining: 2h 25m 29s. Rate: 7.8 symbols/min
[2025-10-24T19:38:38.083556] [INFO ] [REMOTE    ] LAR: Incremental fetch complete for 2025-03 (1.14 seconds).
[2025-10-24T19:38:38.270563] [INFO ] [MAIN      ] LAW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:38:38.267455] [INFO ] [REMOTE    ] LANV: Incremental fetch complete for 2025-02 (0.52 seconds).
[2025-10-24T19:38:38.288385] [DEBUG] [LOCAL     ] LAW: Loaded 15075 existing records from primary storage.
[2025-10-24T19:38:38.288618] [INFO ] [MAIN      ] LAW: Loaded 15075 existing records.
[2025-10-24T19:38:38.472218] [WARN ] [MAIN      ] LAW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:38:38.472431] [INFO ] [MAIN      ] LAW: Wiping existing primary data before full refresh.
[2025-10-24T19:38:38.472479] [INFO ] [LOCAL     ] LAW: Starting deletion of primary data.
[2025-10-24T19:38:38.472741] [DEBUG] [LOCAL     ] LAW: Deleted primary data file.
[2025-10-24T19:38:38.472797] [INFO ] [MAIN      ] LAW: Starting full primary refresh.
[2025-10-24T19:38:38.552718] [INFO ] [REMOTE    ] LAR: Fetching primary data for 2025-04.
[2025-10-24T19:38:38.844935] [INFO ] [REMOTE    ] LAW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:38:39.348951] [INFO ] [REMOTE    ] LANV: Fetching primary data for 2025-03.
[2025-10-24T19:38:39.800827] [INFO ] [REMOTE    ] LANV: Incremental fetch complete for 2025-03 (0.45 seconds).
[2025-10-24T19:38:40.063101] [INFO ] [REMOTE    ] LAR: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T19:38:40.147706] [INFO ] [REMOTE    ] LANV: Fetching primary data for 2025-04.
[2025-10-24T19:38:40.566848] [INFO ] [REMOTE    ] LANV: Incremental fetch complete for 2025-04 (0.42 seconds).
[2025-10-24T19:38:40.947670] [INFO ] [REMOTE    ] LAC: Fetching primary data for 2025-10.
[2025-10-24T19:38:41.747702] [INFO ] [REMOTE    ] LAW: Fetching primary data for 2025-01.
[2025-10-24T19:38:42.547616] [INFO ] [REMOTE    ] LANV: Fetching primary data for 2025-05.
[2025-10-24T19:38:42.627586] [INFO ] [REMOTE    ] LAW: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T19:38:42.816948] [INFO ] [REMOTE    ] LANV: Incremental fetch complete for 2025-05 (0.27 seconds).
[2025-10-24T19:38:43.347678] [INFO ] [REMOTE    ] LANV: Fetching primary data for 2025-06.
[2025-10-24T19:38:43.566489] [INFO ] [REMOTE    ] LAC: Incremental fetch complete for 2025-10 (2.62 seconds).
[2025-10-24T19:38:43.577142] [INFO ] [REMOTE    ] LAC: Full fetch complete (76148 records).
[2025-10-24T19:38:43.577322] [DEBUG] [VALIDATOR ] LAC: Validating primary data.
[2025-10-24T19:38:43.958199] [INFO ] [REMOTE    ] LANV: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T19:38:44.033776] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present.
[2025-10-24T19:38:44.033855] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed.
[2025-10-24T19:38:44.034935] [INFO ] [MAIN      ] LAC: Fetched primary data is valid.
[2025-10-24T19:38:44.034995] [DEBUG] [LOCAL     ] LAC: Saving primary data.
[2025-10-24T19:38:44.035544] [FATAL] [LOCAL     ] LAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:38:44.035695] [FATAL] [MAIN      ] LAC: Failed to save primary data.
[2025-10-24T19:38:44.035760] [WARN ] [MAIN      ] LAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:38:44.035829] [INFO ] [LOCAL     ] LAC: Starting deletion of primary data.
[2025-10-24T19:38:44.035888] [DEBUG] [LOCAL     ] LAC: No primary data file found to delete.
[2025-10-24T19:38:44.035923] [INFO ] [LOCAL     ] LAC: Starting deletion of derivative data.
[2025-10-24T19:38:44.036098] [DEBUG] [LOCAL     ] LAC: Deleted derivative data file.
[2025-10-24T19:38:44.036737] [INFO ] [MAIN      ] Update Progress: 1235/2366 symbols completed. LAC took 48.1s. Estimated remaining: 2h 25m 19s. Rate: 7.8 symbols/min
[2025-10-24T19:38:44.152742] [INFO ] [REMOTE    ] LAW: Fetching primary data for 2025-02.
[2025-10-24T19:38:44.204130] [INFO ] [MAIN      ] LAZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:38:44.246175] [DEBUG] [LOCAL     ] LAZ: Loaded 44787 existing records from primary storage.
[2025-10-24T19:38:44.246452] [INFO ] [MAIN      ] LAZ: Loaded 44787 existing records.
[2025-10-24T19:38:44.422261] [WARN ] [MAIN      ] LAZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:38:44.422444] [INFO ] [MAIN      ] LAZ: Wiping existing primary data before full refresh.
[2025-10-24T19:38:44.422491] [INFO ] [LOCAL     ] LAZ: Starting deletion of primary data.
[2025-10-24T19:38:44.422963] [DEBUG] [LOCAL     ] LAZ: Deleted primary data file.
[2025-10-24T19:38:44.423025] [INFO ] [MAIN      ] LAZ: Starting full primary refresh.
[2025-10-24T19:38:44.790411] [INFO ] [REMOTE    ] LAZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:38:44.947608] [INFO ] [REMOTE    ] LAZ: Fetching primary data for 2025-01.
[2025-10-24T19:38:45.083881] [INFO ] [REMOTE    ] LAW: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T19:38:45.747717] [INFO ] [REMOTE    ] LAR: Fetching primary data for 2025-05.
[2025-10-24T19:38:46.547639] [INFO ] [REMOTE    ] LAW: Fetching primary data for 2025-03.
[2025-10-24T19:38:46.705963] [INFO ] [REMOTE    ] LAZ: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T19:38:47.126460] [INFO ] [REMOTE    ] LAW: Incremental fetch complete for 2025-03 (0.58 seconds).
[2025-10-24T19:38:47.154127] [INFO ] [REMOTE    ] LAR: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T19:38:47.347715] [INFO ] [REMOTE    ] LAW: Fetching primary data for 2025-04.
[2025-10-24T19:38:48.090450] [INFO ] [REMOTE    ] LAW: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T19:38:48.147683] [INFO ] [REMOTE    ] LAW: Fetching primary data for 2025-05.
[2025-10-24T19:38:48.947634] [INFO ] [REMOTE    ] LAZ: Fetching primary data for 2025-02.
[2025-10-24T19:38:48.982429] [INFO ] [REMOTE    ] LAW: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T19:38:49.747681] [INFO ] [REMOTE    ] LAR: Fetching primary data for 2025-06.
[2025-10-24T19:38:50.308247] [INFO ] [REMOTE    ] LAZ: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T19:38:50.547632] [INFO ] [REMOTE    ] LAZ: Fetching primary data for 2025-03.
[2025-10-24T19:38:51.313341] [INFO ] [REMOTE    ] LAR: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T19:38:51.347604] [INFO ] [REMOTE    ] LANV: Fetching primary data for 2025-07.
[2025-10-24T19:38:51.847742] [INFO ] [REMOTE    ] LANV: Incremental fetch complete for 2025-07 (0.50 seconds).
[2025-10-24T19:38:51.993621] [INFO ] [REMOTE    ] LAZ: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T19:38:52.147636] [INFO ] [REMOTE    ] LAR: Fetching primary data for 2025-07.
[2025-10-24T19:38:52.947680] [INFO ] [REMOTE    ] LAW: Fetching primary data for 2025-06.
[2025-10-24T19:38:53.748185] [INFO ] [REMOTE    ] LAZ: Fetching primary data for 2025-04.
[2025-10-24T19:38:53.751268] [INFO ] [REMOTE    ] LAR: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T19:38:53.846484] [INFO ] [REMOTE    ] LAW: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T19:38:54.547688] [INFO ] [REMOTE    ] LAR: Fetching primary data for 2025-08.
[2025-10-24T19:38:55.342013] [INFO ] [REMOTE    ] LAZ: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T19:38:55.351807] [INFO ] [REMOTE    ] LANV: Fetching primary data for 2025-08.
[2025-10-24T19:38:55.878418] [INFO ] [REMOTE    ] LANV: Incremental fetch complete for 2025-08 (0.53 seconds).
[2025-10-24T19:38:56.033234] [INFO ] [REMOTE    ] LAR: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T19:38:56.147639] [INFO ] [REMOTE    ] LANV: Fetching primary data for 2025-09.
[2025-10-24T19:38:56.707572] [INFO ] [REMOTE    ] LANV: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T19:38:56.947615] [INFO ] [REMOTE    ] LAW: Fetching primary data for 2025-07.
[2025-10-24T19:38:57.747706] [INFO ] [REMOTE    ] LAR: Fetching primary data for 2025-09.
[2025-10-24T19:38:57.871460] [INFO ] [REMOTE    ] LAW: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T19:38:58.547691] [INFO ] [REMOTE    ] LAZ: Fetching primary data for 2025-05.
[2025-10-24T19:38:59.317227] [INFO ] [REMOTE    ] LAR: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T19:38:59.347613] [INFO ] [REMOTE    ] LAR: Fetching primary data for 2025-10.
[2025-10-24T19:39:00.053398] [INFO ] [REMOTE    ] LAZ: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T19:39:00.147618] [INFO ] [REMOTE    ] LAZ: Fetching primary data for 2025-06.
[2025-10-24T19:39:00.947691] [INFO ] [REMOTE    ] LANV: Fetching primary data for 2025-10.
[2025-10-24T19:39:01.747757] [INFO ] [REMOTE    ] LAW: Fetching primary data for 2025-08.
[2025-10-24T19:39:02.100431] [INFO ] [REMOTE    ] LAR: Incremental fetch complete for 2025-10 (2.75 seconds).
[2025-10-24T19:39:02.110387] [INFO ] [REMOTE    ] LAR: Full fetch complete (63231 records).
[2025-10-24T19:39:02.110553] [DEBUG] [VALIDATOR ] LAR: Validating primary data.
[2025-10-24T19:39:02.325193] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 189 unique days, need 200 days
[2025-10-24T19:39:02.325968] [FATAL] [MAIN      ] LAR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:39:02.326144] [WARN ] [MAIN      ] LAR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:39:02.326328] [INFO ] [LOCAL     ] LAR: Starting deletion of primary data.
[2025-10-24T19:39:02.326403] [DEBUG] [LOCAL     ] LAR: No primary data file found to delete.
[2025-10-24T19:39:02.326441] [INFO ] [LOCAL     ] LAR: Starting deletion of derivative data.
[2025-10-24T19:39:02.326482] [DEBUG] [LOCAL     ] LAR: No derivative data file found to delete.
[2025-10-24T19:39:02.327149] [INFO ] [MAIN      ] Update Progress: 1236/2366 symbols completed. LAR took 31.5s. Estimated remaining: 2h 25m 21s. Rate: 7.8 symbols/min
[2025-10-24T19:39:02.529124] [INFO ] [MAIN      ] LB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:39:02.569799] [DEBUG] [LOCAL     ] LB: Loaded 37214 existing records from primary storage.
[2025-10-24T19:39:02.570097] [INFO ] [MAIN      ] LB: Loaded 37214 existing records.
[2025-10-24T19:39:02.668080] [INFO ] [REMOTE    ] LANV: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T19:39:02.694740] [INFO ] [REMOTE    ] LANV: Full fetch complete (4239 records).
[2025-10-24T19:39:02.695166] [DEBUG] [VALIDATOR ] LANV: Validating primary data.
[2025-10-24T19:39:02.906324] [WARN ] [MAIN      ] LB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:39:02.925375] [INFO ] [REMOTE    ] LAZ: Incremental fetch complete for 2025-06 (2.78 seconds).
[2025-10-24T19:39:02.930402] [INFO ] [MAIN      ] LB: Wiping existing primary data before full refresh.
[2025-10-24T19:39:02.930586] [INFO ] [LOCAL     ] LB: Starting deletion of primary data.
[2025-10-24T19:39:02.970538] [DEBUG] [LOCAL     ] LB: Deleted primary data file.
[2025-10-24T19:39:02.988747] [INFO ] [MAIN      ] LB: Starting full primary refresh.
[2025-10-24T19:39:02.999961] [INFO ] [REMOTE    ] LAZ: Fetching primary data for 2025-07.
[2025-10-24T19:39:03.545502] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present.
[2025-10-24T19:39:03.545709] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed.
[2025-10-24T19:39:03.545986] [INFO ] [MAIN      ] LANV: Fetched primary data is valid.
[2025-10-24T19:39:03.546179] [DEBUG] [LOCAL     ] LANV: Saving primary data.
[2025-10-24T19:39:03.547928] [INFO ] [REMOTE    ] LAW: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T19:39:03.572425] [FATAL] [LOCAL     ] LANV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:39:03.599379] [FATAL] [MAIN      ] LANV: Failed to save primary data.
[2025-10-24T19:39:03.620076] [INFO ] [REMOTE    ] LAW: Fetching primary data for 2025-09.
[2025-10-24T19:39:03.643630] [WARN ] [MAIN      ] LANV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:39:03.643358] [INFO ] [REMOTE    ] LB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:39:03.644736] [INFO ] [LOCAL     ] LANV: Starting deletion of primary data.
[2025-10-24T19:39:03.645122] [DEBUG] [LOCAL     ] LANV: No primary data file found to delete.
[2025-10-24T19:39:03.645191] [INFO ] [LOCAL     ] LANV: Starting deletion of derivative data.
[2025-10-24T19:39:03.645321] [DEBUG] [LOCAL     ] LANV: Deleted derivative data file.
[2025-10-24T19:39:03.645514] [INFO ] [MAIN      ] Update Progress: 1237/2366 symbols completed. LANV took 34.0s. Estimated remaining: 2h 25m 8s. Rate: 7.8 symbols/min
[2025-10-24T19:39:04.147695] [INFO ] [REMOTE    ] LB: Fetching primary data for 2025-01.
[2025-10-24T19:39:04.745361] [INFO ] [REMOTE    ] LAZ: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T19:39:04.816056] [INFO ] [REMOTE    ] LAW: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T19:39:04.947734] [INFO ] [REMOTE    ] LAZ: Fetching primary data for 2025-08.
[2025-10-24T19:39:05.747702] [INFO ] [REMOTE    ] LAW: Fetching primary data for 2025-10.
[2025-10-24T19:39:05.922977] [INFO ] [REMOTE    ] LB: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T19:39:06.547725] [INFO ] [REMOTE    ] LB: Fetching primary data for 2025-02.
[2025-10-24T19:39:06.657114] [INFO ] [REMOTE    ] LAZ: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T19:39:06.895943] [INFO ] [REMOTE    ] LAW: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T19:39:06.899860] [INFO ] [REMOTE    ] LAW: Full fetch complete (21228 records).
[2025-10-24T19:39:06.899958] [DEBUG] [VALIDATOR ] LAW: Validating primary data.
[2025-10-24T19:39:07.264563] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present.
[2025-10-24T19:39:07.264664] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed.
[2025-10-24T19:39:07.265133] [INFO ] [MAIN      ] LAW: Fetched primary data is valid.
[2025-10-24T19:39:07.265174] [DEBUG] [LOCAL     ] LAW: Saving primary data.
[2025-10-24T19:39:07.265492] [FATAL] [LOCAL     ] LAW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:39:07.265581] [FATAL] [MAIN      ] LAW: Failed to save primary data.
[2025-10-24T19:39:07.265622] [WARN ] [MAIN      ] LAW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:39:07.265691] [INFO ] [LOCAL     ] LAW: Starting deletion of primary data.
[2025-10-24T19:39:07.265753] [DEBUG] [LOCAL     ] LAW: No primary data file found to delete.
[2025-10-24T19:39:07.265788] [INFO ] [LOCAL     ] LAW: Starting deletion of derivative data.
[2025-10-24T19:39:07.265942] [DEBUG] [LOCAL     ] LAW: Deleted derivative data file.
[2025-10-24T19:39:07.266033] [INFO ] [MAIN      ] Update Progress: 1238/2366 symbols completed. LAW took 29.2s. Estimated remaining: 2h 24m 56s. Rate: 7.8 symbols/min
[2025-10-24T19:39:07.347689] [INFO ] [REMOTE    ] LAZ: Fetching primary data for 2025-09.
[2025-10-24T19:39:07.671957] [INFO ] [REMOTE    ] LB: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T19:39:08.147736] [INFO ] [REMOTE    ] LB: Fetching primary data for 2025-03.
[2025-10-24T19:39:08.819721] [INFO ] [REMOTE    ] LAZ: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T19:39:08.947690] [INFO ] [REMOTE    ] LAZ: Fetching primary data for 2025-10.
[2025-10-24T19:39:09.207055] [INFO ] [REMOTE    ] LB: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T19:39:09.747737] [INFO ] [REMOTE    ] LB: Fetching primary data for 2025-04.
[2025-10-24T19:39:10.476900] [INFO ] [REMOTE    ] LAZ: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T19:39:10.484545] [INFO ] [REMOTE    ] LAZ: Full fetch complete (65378 records).
[2025-10-24T19:39:10.484737] [DEBUG] [VALIDATOR ] LAZ: Validating primary data.
[2025-10-24T19:39:10.873569] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present.
[2025-10-24T19:39:10.873665] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed.
[2025-10-24T19:39:10.874705] [INFO ] [MAIN      ] LAZ: Fetched primary data is valid.
[2025-10-24T19:39:10.874766] [DEBUG] [LOCAL     ] LAZ: Saving primary data.
[2025-10-24T19:39:10.875251] [FATAL] [LOCAL     ] LAZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:39:10.875337] [FATAL] [MAIN      ] LAZ: Failed to save primary data.
[2025-10-24T19:39:10.875378] [WARN ] [MAIN      ] LAZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:39:10.875412] [INFO ] [LOCAL     ] LAZ: Starting deletion of primary data.
[2025-10-24T19:39:10.875462] [DEBUG] [LOCAL     ] LAZ: No primary data file found to delete.
[2025-10-24T19:39:10.875496] [INFO ] [LOCAL     ] LAZ: Starting deletion of derivative data.
[2025-10-24T19:39:10.875670] [DEBUG] [LOCAL     ] LAZ: Deleted derivative data file.
[2025-10-24T19:39:10.875932] [INFO ] [MAIN      ] Update Progress: 1239/2366 symbols completed. LAZ took 26.8s. Estimated remaining: 2h 24m 45s. Rate: 7.8 symbols/min
[2025-10-24T19:39:11.169698] [INFO ] [REMOTE    ] LB: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T19:39:11.181332] [INFO ] [REMOTE    ] LB: Fetching primary data for 2025-05.
[2025-10-24T19:39:13.134384] [INFO ] [REMOTE    ] LB: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T19:39:13.142142] [INFO ] [REMOTE    ] LB: Fetching primary data for 2025-06.
[2025-10-24T19:39:14.556197] [INFO ] [REMOTE    ] LB: Incremental fetch complete for 2025-06 (1.41 seconds).
[2025-10-24T19:39:14.563709] [INFO ] [REMOTE    ] LB: Fetching primary data for 2025-07.
[2025-10-24T19:39:16.039844] [INFO ] [REMOTE    ] LB: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T19:39:16.049191] [INFO ] [REMOTE    ] LB: Fetching primary data for 2025-08.
[2025-10-24T19:39:17.478857] [INFO ] [REMOTE    ] LB: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T19:39:17.487918] [INFO ] [REMOTE    ] LB: Fetching primary data for 2025-09.
[2025-10-24T19:39:18.819300] [INFO ] [REMOTE    ] LB: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T19:39:18.827674] [INFO ] [REMOTE    ] LB: Fetching primary data for 2025-10.
[2025-10-24T19:39:20.236448] [INFO ] [REMOTE    ] LB: Incremental fetch complete for 2025-10 (1.41 seconds).
[2025-10-24T19:39:20.243504] [INFO ] [REMOTE    ] LB: Full fetch complete (55581 records).
[2025-10-24T19:39:20.243673] [DEBUG] [VALIDATOR ] LB: Validating primary data.
[2025-10-24T19:39:20.644375] [DEBUG] [VALIDATOR ] LB: All expected trading days are present.
[2025-10-24T19:39:20.644506] [DEBUG] [VALIDATOR ] LB: Primary data validation passed.
[2025-10-24T19:39:20.646006] [INFO ] [MAIN      ] LB: Fetched primary data is valid.
[2025-10-24T19:39:20.646087] [DEBUG] [LOCAL     ] LB: Saving primary data.
[2025-10-24T19:39:20.646978] [FATAL] [LOCAL     ] LB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:39:20.647153] [FATAL] [MAIN      ] LB: Failed to save primary data.
[2025-10-24T19:39:20.647251] [WARN ] [MAIN      ] LB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:39:20.647327] [INFO ] [LOCAL     ] LB: Starting deletion of primary data.
[2025-10-24T19:39:20.647402] [DEBUG] [LOCAL     ] LB: No primary data file found to delete.
[2025-10-24T19:39:20.647440] [INFO ] [LOCAL     ] LB: Starting deletion of derivative data.
[2025-10-24T19:39:20.647678] [DEBUG] [LOCAL     ] LB: Deleted derivative data file.
[2025-10-24T19:39:20.648027] [INFO ] [MAIN      ] Update Progress: 1240/2366 symbols completed. LB took 18.3s. Estimated remaining: 2h 24m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:39:21.322949] [INFO ] [MAIN      ] LBRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:39:21.332471] [INFO ] [MAIN      ] LDI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:39:21.396081] [INFO ] [MAIN      ] LCII: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:39:21.422401] [INFO ] [MAIN      ] LC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:39:21.477929] [DEBUG] [LOCAL     ] LCII: Loaded 26970 existing records from primary storage.
[2025-10-24T19:39:21.478408] [INFO ] [MAIN      ] LCII: Loaded 26970 existing records.
[2025-10-24T19:39:21.603761] [DEBUG] [LOCAL     ] LDI: Loaded 45498 existing records from primary storage.
[2025-10-24T19:39:21.655364] [DEBUG] [LOCAL     ] LC: Loaded 48645 existing records from primary storage.
[2025-10-24T19:39:21.663571] [INFO ] [MAIN      ] LDI: Loaded 45498 existing records.
[2025-10-24T19:39:21.658138] [DEBUG] [LOCAL     ] LBRT: Loaded 53393 existing records from primary storage.
[2025-10-24T19:39:21.679578] [INFO ] [MAIN      ] LC: Loaded 48645 existing records.
[2025-10-24T19:39:21.706035] [INFO ] [MAIN      ] LBRT: Loaded 53393 existing records.
[2025-10-24T19:39:21.993101] [WARN ] [MAIN      ] LCII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:39:22.079498] [INFO ] [MAIN      ] LCII: Wiping existing primary data before full refresh.
[2025-10-24T19:39:22.114920] [INFO ] [LOCAL     ] LCII: Starting deletion of primary data.
[2025-10-24T19:39:22.191335] [DEBUG] [LOCAL     ] LCII: Deleted primary data file.
[2025-10-24T19:39:22.175444] [WARN ] [MAIN      ] LDI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:39:22.236475] [INFO ] [MAIN      ] LCII: Starting full primary refresh.
[2025-10-24T19:39:22.249296] [INFO ] [MAIN      ] LDI: Wiping existing primary data before full refresh.
[2025-10-24T19:39:22.318330] [INFO ] [LOCAL     ] LDI: Starting deletion of primary data.
[2025-10-24T19:39:22.318080] [WARN ] [MAIN      ] LC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:39:22.348870] [DEBUG] [LOCAL     ] LDI: Deleted primary data file.
[2025-10-24T19:39:22.356388] [INFO ] [MAIN      ] LC: Wiping existing primary data before full refresh.
[2025-10-24T19:39:22.366402] [INFO ] [MAIN      ] LDI: Starting full primary refresh.
[2025-10-24T19:39:22.375331] [INFO ] [LOCAL     ] LC: Starting deletion of primary data.
[2025-10-24T19:39:22.386183] [DEBUG] [LOCAL     ] LC: Deleted primary data file.
[2025-10-24T19:39:22.356028] [WARN ] [MAIN      ] LBRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:39:22.391464] [INFO ] [MAIN      ] LC: Starting full primary refresh.
[2025-10-24T19:39:22.433892] [INFO ] [MAIN      ] LBRT: Wiping existing primary data before full refresh.
[2025-10-24T19:39:22.508268] [INFO ] [LOCAL     ] LBRT: Starting deletion of primary data.
[2025-10-24T19:39:22.629574] [DEBUG] [LOCAL     ] LBRT: Deleted primary data file.
[2025-10-24T19:39:22.645246] [INFO ] [MAIN      ] LBRT: Starting full primary refresh.
[2025-10-24T19:39:23.572669] [INFO ] [REMOTE    ] LDI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:39:23.625360] [INFO ] [REMOTE    ] LDI: Fetching primary data for 2025-01.
[2025-10-24T19:39:23.715452] [INFO ] [REMOTE    ] LCII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:39:23.721862] [INFO ] [REMOTE    ] LCII: Fetching primary data for 2025-01.
[2025-10-24T19:39:23.820427] [INFO ] [REMOTE    ] LC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:39:23.859502] [INFO ] [REMOTE    ] LC: Fetching primary data for 2025-01.
[2025-10-24T19:39:23.974200] [INFO ] [REMOTE    ] LBRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:39:23.974602] [INFO ] [REMOTE    ] LBRT: Fetching primary data for 2025-01.
[2025-10-24T19:39:25.002825] [INFO ] [REMOTE    ] LDI: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T19:39:25.009746] [INFO ] [REMOTE    ] LDI: Fetching primary data for 2025-02.
[2025-10-24T19:39:25.023864] [INFO ] [REMOTE    ] LCII: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T19:39:25.028706] [INFO ] [REMOTE    ] LCII: Fetching primary data for 2025-02.
[2025-10-24T19:39:25.529255] [INFO ] [REMOTE    ] LBRT: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T19:39:25.540053] [INFO ] [REMOTE    ] LBRT: Fetching primary data for 2025-02.
[2025-10-24T19:39:25.635866] [INFO ] [REMOTE    ] LC: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T19:39:25.645852] [INFO ] [REMOTE    ] LC: Fetching primary data for 2025-02.
[2025-10-24T19:39:26.164567] [INFO ] [REMOTE    ] LCII: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T19:39:26.170877] [INFO ] [REMOTE    ] LCII: Fetching primary data for 2025-03.
[2025-10-24T19:39:26.278220] [INFO ] [REMOTE    ] LDI: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T19:39:26.286746] [INFO ] [REMOTE    ] LDI: Fetching primary data for 2025-03.
[2025-10-24T19:39:27.154527] [INFO ] [REMOTE    ] LBRT: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T19:39:27.165248] [INFO ] [REMOTE    ] LBRT: Fetching primary data for 2025-03.
[2025-10-24T19:39:27.284345] [INFO ] [REMOTE    ] LC: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T19:39:27.294056] [INFO ] [REMOTE    ] LC: Fetching primary data for 2025-03.
[2025-10-24T19:39:27.476791] [INFO ] [REMOTE    ] LCII: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T19:39:27.483325] [INFO ] [REMOTE    ] LCII: Fetching primary data for 2025-04.
[2025-10-24T19:39:27.711098] [INFO ] [REMOTE    ] LDI: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T19:39:27.720155] [INFO ] [REMOTE    ] LDI: Fetching primary data for 2025-04.
[2025-10-24T19:39:28.643271] [INFO ] [REMOTE    ] LBRT: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T19:39:28.654454] [INFO ] [REMOTE    ] LBRT: Fetching primary data for 2025-04.
[2025-10-24T19:39:28.903062] [INFO ] [REMOTE    ] LC: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T19:39:28.913795] [INFO ] [REMOTE    ] LC: Fetching primary data for 2025-04.
[2025-10-24T19:39:28.936774] [INFO ] [REMOTE    ] LCII: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T19:39:28.946355] [INFO ] [REMOTE    ] LCII: Fetching primary data for 2025-05.
[2025-10-24T19:39:28.986761] [INFO ] [REMOTE    ] LDI: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T19:39:28.996322] [INFO ] [REMOTE    ] LDI: Fetching primary data for 2025-05.
[2025-10-24T19:39:30.103758] [INFO ] [REMOTE    ] LCII: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T19:39:30.109814] [INFO ] [REMOTE    ] LCII: Fetching primary data for 2025-06.
[2025-10-24T19:39:30.362734] [INFO ] [REMOTE    ] LDI: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T19:39:30.471241] [INFO ] [REMOTE    ] LBRT: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T19:39:30.544467] [INFO ] [REMOTE    ] LC: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T19:39:30.548147] [INFO ] [REMOTE    ] LDI: Fetching primary data for 2025-06.
[2025-10-24T19:39:31.214176] [INFO ] [REMOTE    ] LCII: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T19:39:31.347701] [INFO ] [REMOTE    ] LC: Fetching primary data for 2025-05.
[2025-10-24T19:39:31.972057] [INFO ] [REMOTE    ] LDI: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T19:39:32.147713] [INFO ] [REMOTE    ] LCII: Fetching primary data for 2025-07.
[2025-10-24T19:39:32.894209] [INFO ] [REMOTE    ] LC: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T19:39:32.947606] [INFO ] [REMOTE    ] LC: Fetching primary data for 2025-06.
[2025-10-24T19:39:33.190870] [INFO ] [REMOTE    ] LCII: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T19:39:33.747721] [INFO ] [REMOTE    ] LCII: Fetching primary data for 2025-08.
[2025-10-24T19:39:34.029812] [INFO ] [REMOTE    ] LC: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T19:39:34.547699] [INFO ] [REMOTE    ] LDI: Fetching primary data for 2025-07.
[2025-10-24T19:39:34.889895] [INFO ] [REMOTE    ] LCII: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T19:39:35.347693] [INFO ] [REMOTE    ] LCII: Fetching primary data for 2025-09.
[2025-10-24T19:39:35.995972] [INFO ] [REMOTE    ] LDI: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T19:39:36.147698] [INFO ] [REMOTE    ] LDI: Fetching primary data for 2025-08.
[2025-10-24T19:39:36.498689] [INFO ] [REMOTE    ] LCII: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T19:39:36.947747] [INFO ] [REMOTE    ] LCII: Fetching primary data for 2025-10.
[2025-10-24T19:39:37.596233] [INFO ] [REMOTE    ] LDI: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T19:39:37.747693] [INFO ] [REMOTE    ] LBRT: Fetching primary data for 2025-05.
[2025-10-24T19:39:38.090548] [INFO ] [REMOTE    ] LCII: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T19:39:38.096337] [INFO ] [REMOTE    ] LCII: Full fetch complete (39059 records).
[2025-10-24T19:39:38.096441] [DEBUG] [VALIDATOR ] LCII: Validating primary data.
[2025-10-24T19:39:38.507332] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present.
[2025-10-24T19:39:38.507411] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed.
[2025-10-24T19:39:38.508271] [INFO ] [MAIN      ] LCII: Fetched primary data is valid.
[2025-10-24T19:39:38.508334] [DEBUG] [LOCAL     ] LCII: Saving primary data.
[2025-10-24T19:39:38.508719] [FATAL] [LOCAL     ] LCII: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:39:38.508809] [FATAL] [MAIN      ] LCII: Failed to save primary data.
[2025-10-24T19:39:38.508853] [WARN ] [MAIN      ] LCII: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:39:38.508889] [INFO ] [LOCAL     ] LCII: Starting deletion of primary data.
[2025-10-24T19:39:38.508941] [DEBUG] [LOCAL     ] LCII: No primary data file found to delete.
[2025-10-24T19:39:38.508978] [INFO ] [LOCAL     ] LCII: Starting deletion of derivative data.
[2025-10-24T19:39:38.509142] [DEBUG] [LOCAL     ] LCII: Deleted derivative data file.
[2025-10-24T19:39:38.509232] [INFO ] [MAIN      ] Update Progress: 1241/2366 symbols completed. LCII took 17.8s. Estimated remaining: 2h 24m 41s. Rate: 7.8 symbols/min
[2025-10-24T19:39:38.556208] [INFO ] [REMOTE    ] LDI: Fetching primary data for 2025-09.
[2025-10-24T19:39:38.697240] [INFO ] [MAIN      ] LDOS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:39:38.748146] [DEBUG] [LOCAL     ] LDOS: Loaded 44903 existing records from primary storage.
[2025-10-24T19:39:38.748426] [INFO ] [MAIN      ] LDOS: Loaded 44903 existing records.
[2025-10-24T19:39:38.925626] [WARN ] [MAIN      ] LDOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:39:38.925880] [INFO ] [MAIN      ] LDOS: Wiping existing primary data before full refresh.
[2025-10-24T19:39:38.925928] [INFO ] [LOCAL     ] LDOS: Starting deletion of primary data.
[2025-10-24T19:39:38.926505] [DEBUG] [LOCAL     ] LDOS: Deleted primary data file.
[2025-10-24T19:39:38.926560] [INFO ] [MAIN      ] LDOS: Starting full primary refresh.
[2025-10-24T19:39:39.286373] [INFO ] [REMOTE    ] LDOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:39:39.355364] [INFO ] [REMOTE    ] LDOS: Fetching primary data for 2025-01.
[2025-10-24T19:39:39.361796] [INFO ] [REMOTE    ] LBRT: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T19:39:40.147615] [INFO ] [REMOTE    ] LC: Fetching primary data for 2025-07.
[2025-10-24T19:39:40.658212] [INFO ] [REMOTE    ] LDI: Incremental fetch complete for 2025-09 (2.10 seconds).
[2025-10-24T19:39:40.745634] [INFO ] [REMOTE    ] LDOS: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T19:39:40.947725] [INFO ] [REMOTE    ] LDI: Fetching primary data for 2025-10.
[2025-10-24T19:39:41.750743] [INFO ] [REMOTE    ] LBRT: Fetching primary data for 2025-06.
[2025-10-24T19:39:41.756533] [INFO ] [REMOTE    ] LC: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T19:39:42.547617] [INFO ] [REMOTE    ] LDOS: Fetching primary data for 2025-02.
[2025-10-24T19:39:43.018359] [INFO ] [REMOTE    ] LDI: Incremental fetch complete for 2025-10 (2.07 seconds).
[2025-10-24T19:39:43.027820] [INFO ] [REMOTE    ] LDI: Full fetch complete (62381 records).
[2025-10-24T19:39:43.027931] [DEBUG] [VALIDATOR ] LDI: Validating primary data.
[2025-10-24T19:39:43.350060] [INFO ] [REMOTE    ] LC: Fetching primary data for 2025-08.
[2025-10-24T19:39:43.439250] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present.
[2025-10-24T19:39:43.439438] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed.
[2025-10-24T19:39:43.440503] [INFO ] [MAIN      ] LDI: Fetched primary data is valid.
[2025-10-24T19:39:43.440590] [DEBUG] [LOCAL     ] LDI: Saving primary data.
[2025-10-24T19:39:43.441227] [FATAL] [LOCAL     ] LDI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:39:43.441382] [FATAL] [MAIN      ] LDI: Failed to save primary data.
[2025-10-24T19:39:43.441443] [WARN ] [MAIN      ] LDI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:39:43.441509] [INFO ] [LOCAL     ] LDI: Starting deletion of primary data.
[2025-10-24T19:39:43.441575] [DEBUG] [LOCAL     ] LDI: No primary data file found to delete.
[2025-10-24T19:39:43.441613] [INFO ] [LOCAL     ] LDI: Starting deletion of derivative data.
[2025-10-24T19:39:43.441849] [DEBUG] [LOCAL     ] LDI: Deleted derivative data file.
[2025-10-24T19:39:43.442331] [INFO ] [MAIN      ] Update Progress: 1242/2366 symbols completed. LDI took 22.8s. Estimated remaining: 2h 24m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:39:43.635048] [INFO ] [MAIN      ] LDP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:39:43.645250] [DEBUG] [LOCAL     ] LDP: No existing data file found in primary storage.
[2025-10-24T19:39:43.645304] [WARN ] [MAIN      ] LDP: No existing data found, performing full refresh instead.
[2025-10-24T19:39:43.645597] [INFO ] [MAIN      ] LDP: Wiping existing primary data before full refresh.
[2025-10-24T19:39:43.645700] [INFO ] [LOCAL     ] LDP: Starting deletion of primary data.
[2025-10-24T19:39:43.646115] [DEBUG] [LOCAL     ] LDP: No primary data file found to delete.
[2025-10-24T19:39:43.647068] [INFO ] [REMOTE    ] LBRT: Incremental fetch complete for 2025-06 (1.90 seconds).
[2025-10-24T19:39:43.646175] [INFO ] [MAIN      ] LDP: Starting full primary refresh.
[2025-10-24T19:39:44.038278] [INFO ] [REMOTE    ] LDP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:39:44.065680] [INFO ] [REMOTE    ] LDOS: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T19:39:44.147622] [INFO ] [REMOTE    ] LDP: Fetching primary data for 2025-01.
[2025-10-24T19:39:44.947612] [INFO ] [REMOTE    ] LBRT: Fetching primary data for 2025-07.
[2025-10-24T19:39:45.128512] [INFO ] [REMOTE    ] LC: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T19:39:45.192301] [INFO ] [REMOTE    ] LDP: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T19:39:45.747681] [INFO ] [REMOTE    ] LDP: Fetching primary data for 2025-02.
[2025-10-24T19:39:46.457132] [INFO ] [REMOTE    ] LBRT: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T19:39:46.514554] [INFO ] [REMOTE    ] LDP: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T19:39:46.547615] [INFO ] [REMOTE    ] LDP: Fetching primary data for 2025-03.
[2025-10-24T19:39:47.347677] [INFO ] [REMOTE    ] LBRT: Fetching primary data for 2025-08.
[2025-10-24T19:39:47.459301] [INFO ] [REMOTE    ] LDP: Incremental fetch complete for 2025-03 (0.91 seconds).
[2025-10-24T19:39:48.147740] [INFO ] [REMOTE    ] LDP: Fetching primary data for 2025-04.
[2025-10-24T19:39:48.947717] [INFO ] [REMOTE    ] LDOS: Fetching primary data for 2025-03.
[2025-10-24T19:39:49.135743] [INFO ] [REMOTE    ] LBRT: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T19:39:49.159072] [INFO ] [REMOTE    ] LDP: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T19:39:49.747748] [INFO ] [REMOTE    ] LC: Fetching primary data for 2025-09.
[2025-10-24T19:39:50.494011] [INFO ] [REMOTE    ] LDOS: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T19:39:50.547687] [INFO ] [REMOTE    ] LDOS: Fetching primary data for 2025-04.
[2025-10-24T19:39:51.347630] [INFO ] [REMOTE    ] LDP: Fetching primary data for 2025-05.
[2025-10-24T19:39:51.448416] [INFO ] [REMOTE    ] LC: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T19:39:52.147682] [INFO ] [REMOTE    ] LC: Fetching primary data for 2025-10.
[2025-10-24T19:39:52.495513] [INFO ] [REMOTE    ] LDP: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T19:39:52.733858] [INFO ] [REMOTE    ] LDOS: Incremental fetch complete for 2025-04 (2.19 seconds).
[2025-10-24T19:39:52.947722] [INFO ] [REMOTE    ] LDOS: Fetching primary data for 2025-05.
[2025-10-24T19:39:53.747700] [INFO ] [REMOTE    ] LDP: Fetching primary data for 2025-06.
[2025-10-24T19:39:53.946797] [INFO ] [REMOTE    ] LC: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T19:39:53.956895] [INFO ] [REMOTE    ] LC: Full fetch complete (70724 records).
[2025-10-24T19:39:53.957126] [DEBUG] [VALIDATOR ] LC: Validating primary data.
[2025-10-24T19:39:54.360622] [DEBUG] [VALIDATOR ] LC: All expected trading days are present.
[2025-10-24T19:39:54.360765] [DEBUG] [VALIDATOR ] LC: Primary data validation passed.
[2025-10-24T19:39:54.362207] [INFO ] [MAIN      ] LC: Fetched primary data is valid.
[2025-10-24T19:39:54.362276] [DEBUG] [LOCAL     ] LC: Saving primary data.
[2025-10-24T19:39:54.363205] [FATAL] [LOCAL     ] LC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:39:54.363300] [FATAL] [MAIN      ] LC: Failed to save primary data.
[2025-10-24T19:39:54.363342] [WARN ] [MAIN      ] LC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:39:54.363409] [INFO ] [LOCAL     ] LC: Starting deletion of primary data.
[2025-10-24T19:39:54.363479] [DEBUG] [LOCAL     ] LC: No primary data file found to delete.
[2025-10-24T19:39:54.363517] [INFO ] [LOCAL     ] LC: Starting deletion of derivative data.
[2025-10-24T19:39:54.363741] [DEBUG] [LOCAL     ] LC: Deleted derivative data file.
[2025-10-24T19:39:54.364843] [INFO ] [MAIN      ] Update Progress: 1243/2366 symbols completed. LC took 33.7s. Estimated remaining: 2h 24m 26s. Rate: 7.8 symbols/min
[2025-10-24T19:39:54.545631] [INFO ] [MAIN      ] LEA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:39:54.555060] [INFO ] [REMOTE    ] LBRT: Fetching primary data for 2025-09.
[2025-10-24T19:39:54.556451] [INFO ] [REMOTE    ] LDP: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T19:39:54.603596] [DEBUG] [LOCAL     ] LEA: Loaded 41368 existing records from primary storage.
[2025-10-24T19:39:54.604006] [INFO ] [MAIN      ] LEA: Loaded 41368 existing records.
[2025-10-24T19:39:54.786684] [WARN ] [MAIN      ] LEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:39:54.787097] [INFO ] [MAIN      ] LEA: Wiping existing primary data before full refresh.
[2025-10-24T19:39:54.787175] [INFO ] [LOCAL     ] LEA: Starting deletion of primary data.
[2025-10-24T19:39:54.787859] [DEBUG] [LOCAL     ] LEA: Deleted primary data file.
[2025-10-24T19:39:54.787919] [INFO ] [MAIN      ] LEA: Starting full primary refresh.
[2025-10-24T19:39:54.927553] [INFO ] [REMOTE    ] LDOS: Incremental fetch complete for 2025-05 (1.98 seconds).
[2025-10-24T19:39:55.202936] [INFO ] [REMOTE    ] LEA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:39:55.347706] [INFO ] [REMOTE    ] LDP: Fetching primary data for 2025-07.
[2025-10-24T19:39:56.147677] [INFO ] [REMOTE    ] LEA: Fetching primary data for 2025-01.
[2025-10-24T19:39:56.275949] [INFO ] [REMOTE    ] LBRT: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T19:39:56.300946] [INFO ] [REMOTE    ] LDP: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T19:39:56.947731] [INFO ] [REMOTE    ] LDOS: Fetching primary data for 2025-06.
[2025-10-24T19:39:57.747756] [INFO ] [REMOTE    ] LDP: Fetching primary data for 2025-08.
[2025-10-24T19:39:57.810902] [INFO ] [REMOTE    ] LEA: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T19:39:58.454863] [INFO ] [REMOTE    ] LDOS: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T19:39:58.523051] [INFO ] [REMOTE    ] LDP: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T19:39:58.547602] [INFO ] [REMOTE    ] LDP: Fetching primary data for 2025-09.
[2025-10-24T19:39:59.276751] [INFO ] [REMOTE    ] LDP: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T19:39:59.347670] [INFO ] [REMOTE    ] LEA: Fetching primary data for 2025-02.
[2025-10-24T19:40:00.147721] [INFO ] [REMOTE    ] LBRT: Fetching primary data for 2025-10.
[2025-10-24T19:40:00.947687] [INFO ] [REMOTE    ] LDP: Fetching primary data for 2025-10.
[2025-10-24T19:40:01.114321] [INFO ] [REMOTE    ] LEA: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T19:40:01.747635] [INFO ] [REMOTE    ] LEA: Fetching primary data for 2025-03.
[2025-10-24T19:40:02.293104] [INFO ] [REMOTE    ] LDP: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T19:40:02.296284] [INFO ] [REMOTE    ] LDP: Full fetch complete (18572 records).
[2025-10-24T19:40:02.296382] [DEBUG] [VALIDATOR ] LDP: Validating primary data.
[2025-10-24T19:40:02.557005] [INFO ] [REMOTE    ] LDOS: Fetching primary data for 2025-07.
[2025-10-24T19:40:02.672556] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present.
[2025-10-24T19:40:02.672707] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed.
[2025-10-24T19:40:02.673160] [INFO ] [MAIN      ] LDP: Fetched primary data is valid.
[2025-10-24T19:40:02.673234] [DEBUG] [LOCAL     ] LDP: Saving primary data.
[2025-10-24T19:40:02.673539] [FATAL] [LOCAL     ] LDP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:40:02.673671] [FATAL] [MAIN      ] LDP: Failed to save primary data.
[2025-10-24T19:40:02.673793] [WARN ] [MAIN      ] LDP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:40:02.673955] [INFO ] [LOCAL     ] LDP: Starting deletion of primary data.
[2025-10-24T19:40:02.674067] [DEBUG] [LOCAL     ] LDP: No primary data file found to delete.
[2025-10-24T19:40:02.674118] [INFO ] [LOCAL     ] LDP: Starting deletion of derivative data.
[2025-10-24T19:40:02.674231] [DEBUG] [LOCAL     ] LDP: No derivative data file found to delete.
[2025-10-24T19:40:02.674299] [INFO ] [MAIN      ] Update Progress: 1244/2366 symbols completed. LDP took 19.2s. Estimated remaining: 2h 24m 18s. Rate: 7.8 symbols/min
[2025-10-24T19:40:02.869920] [INFO ] [MAIN      ] LEG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:40:02.890531] [INFO ] [REMOTE    ] LBRT: Incremental fetch complete for 2025-10 (2.74 seconds).
[2025-10-24T19:40:02.901912] [INFO ] [REMOTE    ] LBRT: Full fetch complete (76926 records).
[2025-10-24T19:40:02.902099] [DEBUG] [VALIDATOR ] LBRT: Validating primary data.
[2025-10-24T19:40:03.259682] [DEBUG] [LOCAL     ] LEG: Loaded 50311 existing records from primary storage.
[2025-10-24T19:40:03.271186] [INFO ] [MAIN      ] LEG: Loaded 50311 existing records.
[2025-10-24T19:40:03.479922] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present.
[2025-10-24T19:40:03.485504] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed.
[2025-10-24T19:40:03.487290] [INFO ] [MAIN      ] LBRT: Fetched primary data is valid.
[2025-10-24T19:40:03.492525] [DEBUG] [LOCAL     ] LBRT: Saving primary data.
[2025-10-24T19:40:03.498811] [FATAL] [LOCAL     ] LBRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:40:03.504114] [FATAL] [MAIN      ] LBRT: Failed to save primary data.
[2025-10-24T19:40:03.509351] [WARN ] [MAIN      ] LBRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:40:03.532969] [INFO ] [LOCAL     ] LBRT: Starting deletion of primary data.
[2025-10-24T19:40:03.542520] [DEBUG] [LOCAL     ] LBRT: No primary data file found to delete.
[2025-10-24T19:40:03.551031] [INFO ] [LOCAL     ] LBRT: Starting deletion of derivative data.
[2025-10-24T19:40:03.563457] [WARN ] [MAIN      ] LEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:40:03.563801] [INFO ] [MAIN      ] LEG: Wiping existing primary data before full refresh.
[2025-10-24T19:40:03.563881] [DEBUG] [LOCAL     ] LBRT: Deleted derivative data file.
[2025-10-24T19:40:03.564540] [INFO ] [MAIN      ] Update Progress: 1245/2366 symbols completed. LBRT took 42.9s. Estimated remaining: 2h 24m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:40:03.563858] [INFO ] [LOCAL     ] LEG: Starting deletion of primary data.
[2025-10-24T19:40:03.599268] [DEBUG] [LOCAL     ] LEG: Deleted primary data file.
[2025-10-24T19:40:03.632038] [INFO ] [MAIN      ] LEG: Starting full primary refresh.
[2025-10-24T19:40:03.927786] [INFO ] [MAIN      ] LEN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:40:04.111836] [INFO ] [REMOTE    ] LEG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:40:04.112374] [INFO ] [REMOTE    ] LEG: Fetching primary data for 2025-01.
[2025-10-24T19:40:04.158988] [DEBUG] [LOCAL     ] LEN: Loaded 53586 existing records from primary storage.
[2025-10-24T19:40:04.159373] [INFO ] [MAIN      ] LEN: Loaded 53586 existing records.
[2025-10-24T19:40:04.356254] [WARN ] [MAIN      ] LEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:40:04.356517] [INFO ] [MAIN      ] LEN: Wiping existing primary data before full refresh.
[2025-10-24T19:40:04.356592] [INFO ] [LOCAL     ] LEN: Starting deletion of primary data.
[2025-10-24T19:40:04.357327] [DEBUG] [LOCAL     ] LEN: Deleted primary data file.
[2025-10-24T19:40:04.357406] [INFO ] [MAIN      ] LEN: Starting full primary refresh.
[2025-10-24T19:40:04.557461] [INFO ] [REMOTE    ] LEA: Incremental fetch complete for 2025-03 (2.81 seconds).
[2025-10-24T19:40:04.647066] [INFO ] [REMOTE    ] LEA: Fetching primary data for 2025-04.
[2025-10-24T19:40:04.808497] [INFO ] [REMOTE    ] LEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:40:04.953857] [INFO ] [REMOTE    ] LEN: Fetching primary data for 2025-01.
[2025-10-24T19:40:04.956221] [INFO ] [REMOTE    ] LDOS: Incremental fetch complete for 2025-07 (2.40 seconds).
[2025-10-24T19:40:05.747762] [INFO ] [REMOTE    ] LDOS: Fetching primary data for 2025-08.
[2025-10-24T19:40:06.367122] [INFO ] [REMOTE    ] LEG: Incremental fetch complete for 2025-01 (2.25 seconds).
[2025-10-24T19:40:06.547634] [INFO ] [REMOTE    ] LEG: Fetching primary data for 2025-02.
[2025-10-24T19:40:07.120500] [INFO ] [REMOTE    ] LEA: Incremental fetch complete for 2025-04 (2.47 seconds).
[2025-10-24T19:40:07.347673] [INFO ] [REMOTE    ] LEA: Fetching primary data for 2025-05.
[2025-10-24T19:40:07.411373] [INFO ] [REMOTE    ] LEN: Incremental fetch complete for 2025-01 (2.46 seconds).
[2025-10-24T19:40:07.850157] [INFO ] [REMOTE    ] LDOS: Incremental fetch complete for 2025-08 (2.10 seconds).
[2025-10-24T19:40:08.147736] [INFO ] [REMOTE    ] LDOS: Fetching primary data for 2025-09.
[2025-10-24T19:40:08.772016] [INFO ] [REMOTE    ] LEG: Incremental fetch complete for 2025-02 (2.22 seconds).
[2025-10-24T19:40:08.888422] [INFO ] [REMOTE    ] LEA: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T19:40:08.947678] [INFO ] [REMOTE    ] LEA: Fetching primary data for 2025-06.
[2025-10-24T19:40:09.709866] [INFO ] [REMOTE    ] LDOS: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T19:40:09.747687] [INFO ] [REMOTE    ] LEN: Fetching primary data for 2025-02.
[2025-10-24T19:40:10.356228] [INFO ] [REMOTE    ] LEA: Incremental fetch complete for 2025-06 (1.41 seconds).
[2025-10-24T19:40:10.547696] [INFO ] [REMOTE    ] LDOS: Fetching primary data for 2025-10.
[2025-10-24T19:40:10.963185] [INFO ] [REMOTE    ] LEN: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T19:40:11.347674] [INFO ] [REMOTE    ] LEN: Fetching primary data for 2025-03.
[2025-10-24T19:40:12.147671] [INFO ] [REMOTE    ] LEG: Fetching primary data for 2025-03.
[2025-10-24T19:40:12.947676] [INFO ] [REMOTE    ] LEA: Fetching primary data for 2025-07.
[2025-10-24T19:40:13.361175] [INFO ] [REMOTE    ] LEN: Incremental fetch complete for 2025-03 (2.01 seconds).
[2025-10-24T19:40:13.447348] [INFO ] [REMOTE    ] LEG: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T19:40:13.747692] [INFO ] [REMOTE    ] LEG: Fetching primary data for 2025-04.
[2025-10-24T19:40:14.402489] [INFO ] [REMOTE    ] LDOS: Incremental fetch complete for 2025-10 (3.85 seconds).
[2025-10-24T19:40:14.410256] [INFO ] [REMOTE    ] LDOS: Full fetch complete (66775 records).
[2025-10-24T19:40:14.410474] [DEBUG] [VALIDATOR ] LDOS: Validating primary data.
[2025-10-24T19:40:14.537453] [INFO ] [REMOTE    ] LEA: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T19:40:14.549864] [INFO ] [REMOTE    ] LEN: Fetching primary data for 2025-04.
[2025-10-24T19:40:14.839995] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present.
[2025-10-24T19:40:14.840073] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed.
[2025-10-24T19:40:14.841048] [INFO ] [MAIN      ] LDOS: Fetched primary data is valid.
[2025-10-24T19:40:14.841110] [DEBUG] [LOCAL     ] LDOS: Saving primary data.
[2025-10-24T19:40:14.841611] [FATAL] [LOCAL     ] LDOS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:40:14.841731] [FATAL] [MAIN      ] LDOS: Failed to save primary data.
[2025-10-24T19:40:14.841817] [WARN ] [MAIN      ] LDOS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:40:14.841903] [INFO ] [LOCAL     ] LDOS: Starting deletion of primary data.
[2025-10-24T19:40:14.841979] [DEBUG] [LOCAL     ] LDOS: No primary data file found to delete.
[2025-10-24T19:40:14.842034] [INFO ] [LOCAL     ] LDOS: Starting deletion of derivative data.
[2025-10-24T19:40:14.842175] [DEBUG] [LOCAL     ] LDOS: Deleted derivative data file.
[2025-10-24T19:40:14.842488] [INFO ] [MAIN      ] Update Progress: 1246/2366 symbols completed. LDOS took 36.3s. Estimated remaining: 2h 23m 60s. Rate: 7.8 symbols/min
[2025-10-24T19:40:15.011982] [INFO ] [MAIN      ] LEO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:40:15.028886] [DEBUG] [LOCAL     ] LEO: Loaded 16918 existing records from primary storage.
[2025-10-24T19:40:15.029114] [INFO ] [MAIN      ] LEO: Loaded 16918 existing records.
[2025-10-24T19:40:15.215238] [WARN ] [MAIN      ] LEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:40:15.215465] [INFO ] [MAIN      ] LEO: Wiping existing primary data before full refresh.
[2025-10-24T19:40:15.215512] [INFO ] [LOCAL     ] LEO: Starting deletion of primary data.
[2025-10-24T19:40:15.216001] [DEBUG] [LOCAL     ] LEO: Deleted primary data file.
[2025-10-24T19:40:15.216059] [INFO ] [MAIN      ] LEO: Starting full primary refresh.
[2025-10-24T19:40:15.395873] [INFO ] [REMOTE    ] LEA: Fetching primary data for 2025-08.
[2025-10-24T19:40:15.590455] [INFO ] [REMOTE    ] LEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:40:15.627661] [INFO ] [REMOTE    ] LEG: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T19:40:16.147722] [INFO ] [REMOTE    ] LEG: Fetching primary data for 2025-05.
[2025-10-24T19:40:16.394837] [INFO ] [REMOTE    ] LEN: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T19:40:16.931070] [INFO ] [REMOTE    ] LEA: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T19:40:16.947605] [INFO ] [REMOTE    ] LEA: Fetching primary data for 2025-09.
[2025-10-24T19:40:17.681836] [INFO ] [REMOTE    ] LEG: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T19:40:17.747681] [INFO ] [REMOTE    ] LEO: Fetching primary data for 2025-01.
[2025-10-24T19:40:18.511937] [INFO ] [REMOTE    ] LEA: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T19:40:18.547604] [INFO ] [REMOTE    ] LEA: Fetching primary data for 2025-10.
[2025-10-24T19:40:18.564199] [INFO ] [REMOTE    ] LEO: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T19:40:19.347702] [INFO ] [REMOTE    ] LEN: Fetching primary data for 2025-05.
[2025-10-24T19:40:20.147628] [INFO ] [REMOTE    ] LEO: Fetching primary data for 2025-02.
[2025-10-24T19:40:20.177618] [INFO ] [REMOTE    ] LEA: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T19:40:20.185059] [INFO ] [REMOTE    ] LEA: Full fetch complete (60435 records).
[2025-10-24T19:40:20.185202] [DEBUG] [VALIDATOR ] LEA: Validating primary data.
[2025-10-24T19:40:20.573381] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present.
[2025-10-24T19:40:20.573462] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed.
[2025-10-24T19:40:20.574396] [INFO ] [MAIN      ] LEA: Fetched primary data is valid.
[2025-10-24T19:40:20.574464] [DEBUG] [LOCAL     ] LEA: Saving primary data.
[2025-10-24T19:40:20.574983] [FATAL] [LOCAL     ] LEA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:40:20.575070] [FATAL] [MAIN      ] LEA: Failed to save primary data.
[2025-10-24T19:40:20.575112] [WARN ] [MAIN      ] LEA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:40:20.575150] [INFO ] [LOCAL     ] LEA: Starting deletion of primary data.
[2025-10-24T19:40:20.575202] [DEBUG] [LOCAL     ] LEA: No primary data file found to delete.
[2025-10-24T19:40:20.575280] [INFO ] [LOCAL     ] LEA: Starting deletion of derivative data.
[2025-10-24T19:40:20.575454] [DEBUG] [LOCAL     ] LEA: Deleted derivative data file.
[2025-10-24T19:40:20.575974] [INFO ] [MAIN      ] Update Progress: 1247/2366 symbols completed. LEA took 26.2s. Estimated remaining: 2h 23m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:40:20.744070] [INFO ] [MAIN      ] LEVI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:40:20.795946] [DEBUG] [LOCAL     ] LEVI: Loaded 52204 existing records from primary storage.
[2025-10-24T19:40:20.796252] [INFO ] [MAIN      ] LEVI: Loaded 52204 existing records.
[2025-10-24T19:40:20.951721] [INFO ] [REMOTE    ] LEG: Fetching primary data for 2025-06.
[2025-10-24T19:40:20.981758] [WARN ] [MAIN      ] LEVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:40:20.982859] [INFO ] [MAIN      ] LEVI: Wiping existing primary data before full refresh.
[2025-10-24T19:40:20.982996] [INFO ] [LOCAL     ] LEVI: Starting deletion of primary data.
[2025-10-24T19:40:20.983302] [DEBUG] [LOCAL     ] LEVI: Deleted primary data file.
[2025-10-24T19:40:20.983490] [INFO ] [MAIN      ] LEVI: Starting full primary refresh.
[2025-10-24T19:40:21.272439] [INFO ] [REMOTE    ] LEN: Incremental fetch complete for 2025-05 (1.92 seconds).
[2025-10-24T19:40:21.334995] [INFO ] [REMOTE    ] LEO: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T19:40:21.418958] [INFO ] [REMOTE    ] LEVI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:40:21.747628] [INFO ] [REMOTE    ] LEVI: Fetching primary data for 2025-01.
[2025-10-24T19:40:22.553097] [INFO ] [REMOTE    ] LEN: Fetching primary data for 2025-06.
[2025-10-24T19:40:22.557985] [INFO ] [REMOTE    ] LEG: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T19:40:23.347699] [INFO ] [REMOTE    ] LEG: Fetching primary data for 2025-07.
[2025-10-24T19:40:23.513605] [INFO ] [REMOTE    ] LEVI: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T19:40:24.051511] [INFO ] [REMOTE    ] LEN: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T19:40:24.147601] [INFO ] [REMOTE    ] LEN: Fetching primary data for 2025-07.
[2025-10-24T19:40:24.925228] [INFO ] [REMOTE    ] LEG: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T19:40:24.947607] [INFO ] [REMOTE    ] LEG: Fetching primary data for 2025-08.
[2025-10-24T19:40:25.747628] [INFO ] [REMOTE    ] LEVI: Fetching primary data for 2025-02.
[2025-10-24T19:40:25.829034] [INFO ] [REMOTE    ] LEN: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T19:40:26.511511] [INFO ] [REMOTE    ] LEG: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T19:40:26.547699] [INFO ] [REMOTE    ] LEG: Fetching primary data for 2025-09.
[2025-10-24T19:40:27.342093] [INFO ] [REMOTE    ] LEVI: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T19:40:27.351766] [INFO ] [REMOTE    ] LEN: Fetching primary data for 2025-08.
[2025-10-24T19:40:28.009582] [INFO ] [REMOTE    ] LEG: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T19:40:28.147615] [INFO ] [REMOTE    ] LEG: Fetching primary data for 2025-10.
[2025-10-24T19:40:28.947631] [INFO ] [REMOTE    ] LEVI: Fetching primary data for 2025-03.
[2025-10-24T19:40:29.256864] [INFO ] [REMOTE    ] LEN: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T19:40:29.752699] [INFO ] [REMOTE    ] LEO: Fetching primary data for 2025-03.
[2025-10-24T19:40:29.769121] [INFO ] [REMOTE    ] LEG: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T19:40:29.778307] [INFO ] [REMOTE    ] LEG: Full fetch complete (72803 records).
[2025-10-24T19:40:29.778420] [DEBUG] [VALIDATOR ] LEG: Validating primary data.
[2025-10-24T19:40:30.170317] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present.
[2025-10-24T19:40:30.170488] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed.
[2025-10-24T19:40:30.171613] [INFO ] [MAIN      ] LEG: Fetched primary data is valid.
[2025-10-24T19:40:30.171751] [DEBUG] [LOCAL     ] LEG: Saving primary data.
[2025-10-24T19:40:30.172358] [FATAL] [LOCAL     ] LEG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:40:30.172461] [FATAL] [MAIN      ] LEG: Failed to save primary data.
[2025-10-24T19:40:30.172526] [WARN ] [MAIN      ] LEG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:40:30.172594] [INFO ] [LOCAL     ] LEG: Starting deletion of primary data.
[2025-10-24T19:40:30.172680] [DEBUG] [LOCAL     ] LEG: No primary data file found to delete.
[2025-10-24T19:40:30.172735] [INFO ] [LOCAL     ] LEG: Starting deletion of derivative data.
[2025-10-24T19:40:30.172900] [DEBUG] [LOCAL     ] LEG: Deleted derivative data file.
[2025-10-24T19:40:30.173534] [INFO ] [MAIN      ] Update Progress: 1248/2366 symbols completed. LEG took 27.5s. Estimated remaining: 2h 23m 44s. Rate: 7.8 symbols/min
[2025-10-24T19:40:30.344766] [INFO ] [MAIN      ] LFT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:40:30.363467] [DEBUG] [LOCAL     ] LFT: Loaded 18234 existing records from primary storage.
[2025-10-24T19:40:30.363738] [INFO ] [MAIN      ] LFT: Loaded 18234 existing records.
[2025-10-24T19:40:30.547159] [WARN ] [MAIN      ] LFT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:40:30.547581] [INFO ] [MAIN      ] LFT: Wiping existing primary data before full refresh.
[2025-10-24T19:40:30.547714] [INFO ] [REMOTE    ] LEN: Fetching primary data for 2025-09.
[2025-10-24T19:40:30.563616] [INFO ] [LOCAL     ] LFT: Starting deletion of primary data.
[2025-10-24T19:40:30.577684] [DEBUG] [LOCAL     ] LFT: Deleted primary data file.
[2025-10-24T19:40:30.578091] [INFO ] [MAIN      ] LFT: Starting full primary refresh.
[2025-10-24T19:40:30.580205] [INFO ] [REMOTE    ] LEVI: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T19:40:30.881767] [INFO ] [REMOTE    ] LEO: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T19:40:30.963303] [INFO ] [REMOTE    ] LFT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:40:31.347723] [INFO ] [REMOTE    ] LFT: Fetching primary data for 2025-01.
[2025-10-24T19:40:32.147718] [INFO ] [REMOTE    ] LEVI: Fetching primary data for 2025-04.
[2025-10-24T19:40:32.485169] [INFO ] [REMOTE    ] LFT: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T19:40:32.846397] [INFO ] [REMOTE    ] LEN: Incremental fetch complete for 2025-09 (2.30 seconds).
[2025-10-24T19:40:32.947612] [INFO ] [REMOTE    ] LEN: Fetching primary data for 2025-10.
[2025-10-24T19:40:33.724416] [INFO ] [REMOTE    ] LEVI: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T19:40:33.747599] [INFO ] [REMOTE    ] LEVI: Fetching primary data for 2025-05.
[2025-10-24T19:40:34.547733] [INFO ] [REMOTE    ] LEO: Fetching primary data for 2025-04.
[2025-10-24T19:40:35.088914] [INFO ] [REMOTE    ] LEN: Incremental fetch complete for 2025-10 (2.14 seconds).
[2025-10-24T19:40:35.098761] [INFO ] [REMOTE    ] LEN: Full fetch complete (77223 records).
[2025-10-24T19:40:35.098916] [DEBUG] [VALIDATOR ] LEN: Validating primary data.
[2025-10-24T19:40:35.350320] [INFO ] [REMOTE    ] LFT: Fetching primary data for 2025-02.
[2025-10-24T19:40:35.538131] [INFO ] [REMOTE    ] LEVI: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T19:40:35.542008] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present.
[2025-10-24T19:40:35.552798] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed.
[2025-10-24T19:40:35.554056] [INFO ] [MAIN      ] LEN: Fetched primary data is valid.
[2025-10-24T19:40:35.554259] [DEBUG] [LOCAL     ] LEN: Saving primary data.
[2025-10-24T19:40:35.554910] [FATAL] [LOCAL     ] LEN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:40:35.555031] [FATAL] [MAIN      ] LEN: Failed to save primary data.
[2025-10-24T19:40:35.555075] [WARN ] [MAIN      ] LEN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:40:35.555227] [INFO ] [LOCAL     ] LEN: Starting deletion of primary data.
[2025-10-24T19:40:35.555313] [DEBUG] [LOCAL     ] LEN: No primary data file found to delete.
[2025-10-24T19:40:35.555393] [INFO ] [LOCAL     ] LEN: Starting deletion of derivative data.
[2025-10-24T19:40:35.555920] [DEBUG] [LOCAL     ] LEN: Deleted derivative data file.
[2025-10-24T19:40:35.556379] [INFO ] [MAIN      ] Update Progress: 1249/2366 symbols completed. LEN took 32.0s. Estimated remaining: 2h 23m 35s. Rate: 7.8 symbols/min
[2025-10-24T19:40:35.754424] [INFO ] [MAIN      ] LGI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:40:35.752767] [INFO ] [REMOTE    ] LEO: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T19:40:35.775520] [DEBUG] [LOCAL     ] LGI: Loaded 10003 existing records from primary storage.
[2025-10-24T19:40:35.775779] [INFO ] [MAIN      ] LGI: Loaded 10003 existing records.
[2025-10-24T19:40:35.969695] [WARN ] [MAIN      ] LGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:40:35.969916] [INFO ] [MAIN      ] LGI: Wiping existing primary data before full refresh.
[2025-10-24T19:40:35.969978] [INFO ] [LOCAL     ] LGI: Starting deletion of primary data.
[2025-10-24T19:40:35.970208] [DEBUG] [LOCAL     ] LGI: Deleted primary data file.
[2025-10-24T19:40:35.970270] [INFO ] [MAIN      ] LGI: Starting full primary refresh.
[2025-10-24T19:40:36.151617] [INFO ] [REMOTE    ] LEO: Fetching primary data for 2025-05.
[2025-10-24T19:40:36.313759] [INFO ] [REMOTE    ] LFT: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T19:40:36.367638] [INFO ] [REMOTE    ] LGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:40:36.947629] [INFO ] [REMOTE    ] LFT: Fetching primary data for 2025-03.
[2025-10-24T19:40:37.077165] [INFO ] [REMOTE    ] LEO: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T19:40:37.747674] [INFO ] [REMOTE    ] LEVI: Fetching primary data for 2025-06.
[2025-10-24T19:40:37.786827] [INFO ] [REMOTE    ] LFT: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T19:40:38.547690] [INFO ] [REMOTE    ] LFT: Fetching primary data for 2025-04.
[2025-10-24T19:40:39.181454] [INFO ] [REMOTE    ] LEVI: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T19:40:39.347605] [INFO ] [REMOTE    ] LEVI: Fetching primary data for 2025-07.
[2025-10-24T19:40:39.572007] [INFO ] [REMOTE    ] LFT: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T19:40:40.147671] [INFO ] [REMOTE    ] LFT: Fetching primary data for 2025-05.
[2025-10-24T19:40:40.909545] [INFO ] [REMOTE    ] LFT: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T19:40:40.947602] [INFO ] [REMOTE    ] LFT: Fetching primary data for 2025-06.
[2025-10-24T19:40:41.039902] [INFO ] [REMOTE    ] LEVI: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T19:40:41.747728] [INFO ] [REMOTE    ] LEO: Fetching primary data for 2025-06.
[2025-10-24T19:40:42.191692] [INFO ] [REMOTE    ] LFT: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T19:40:42.547696] [INFO ] [REMOTE    ] LGI: Fetching primary data for 2025-01.
[2025-10-24T19:40:42.781714] [INFO ] [REMOTE    ] LEO: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T19:40:43.347674] [INFO ] [REMOTE    ] LFT: Fetching primary data for 2025-07.
[2025-10-24T19:40:43.576345] [INFO ] [REMOTE    ] LGI: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T19:40:44.147710] [INFO ] [REMOTE    ] LEVI: Fetching primary data for 2025-08.
[2025-10-24T19:40:44.320276] [INFO ] [REMOTE    ] LFT: Incremental fetch complete for 2025-07 (0.97 seconds).
[2025-10-24T19:40:44.947734] [INFO ] [REMOTE    ] LFT: Fetching primary data for 2025-08.
[2025-10-24T19:40:45.671667] [INFO ] [REMOTE    ] LEVI: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T19:40:45.747607] [INFO ] [REMOTE    ] LEVI: Fetching primary data for 2025-09.
[2025-10-24T19:40:45.959980] [INFO ] [REMOTE    ] LFT: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T19:40:46.547726] [INFO ] [REMOTE    ] LFT: Fetching primary data for 2025-09.
[2025-10-24T19:40:47.357296] [INFO ] [REMOTE    ] LEO: Fetching primary data for 2025-07.
[2025-10-24T19:40:47.362721] [INFO ] [REMOTE    ] LEVI: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T19:40:47.407375] [INFO ] [REMOTE    ] LFT: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T19:40:48.147712] [INFO ] [REMOTE    ] LFT: Fetching primary data for 2025-10.
[2025-10-24T19:40:48.285880] [INFO ] [REMOTE    ] LEO: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T19:40:48.947686] [INFO ] [REMOTE    ] LEVI: Fetching primary data for 2025-10.
[2025-10-24T19:40:49.193103] [INFO ] [REMOTE    ] LFT: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T19:40:49.196773] [INFO ] [REMOTE    ] LFT: Full fetch complete (23763 records).
[2025-10-24T19:40:49.196937] [DEBUG] [VALIDATOR ] LFT: Validating primary data.
[2025-10-24T19:40:49.600806] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present.
[2025-10-24T19:40:49.600965] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed.
[2025-10-24T19:40:49.601939] [INFO ] [MAIN      ] LFT: Fetched primary data is valid.
[2025-10-24T19:40:49.602008] [DEBUG] [LOCAL     ] LFT: Saving primary data.
[2025-10-24T19:40:49.602611] [FATAL] [LOCAL     ] LFT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:40:49.602730] [FATAL] [MAIN      ] LFT: Failed to save primary data.
[2025-10-24T19:40:49.602772] [WARN ] [MAIN      ] LFT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:40:49.602808] [INFO ] [LOCAL     ] LFT: Starting deletion of primary data.
[2025-10-24T19:40:49.602865] [DEBUG] [LOCAL     ] LFT: No primary data file found to delete.
[2025-10-24T19:40:49.602905] [INFO ] [LOCAL     ] LFT: Starting deletion of derivative data.
[2025-10-24T19:40:49.603064] [DEBUG] [LOCAL     ] LFT: Deleted derivative data file.
[2025-10-24T19:40:49.603161] [INFO ] [MAIN      ] Update Progress: 1250/2366 symbols completed. LFT took 19.4s. Estimated remaining: 2h 23m 33s. Rate: 7.8 symbols/min
[2025-10-24T19:40:49.752849] [INFO ] [REMOTE    ] LGI: Fetching primary data for 2025-02.
[2025-10-24T19:40:49.796587] [INFO ] [MAIN      ] LH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:40:49.833302] [DEBUG] [LOCAL     ] LH: Loaded 37267 existing records from primary storage.
[2025-10-24T19:40:49.833580] [INFO ] [MAIN      ] LH: Loaded 37267 existing records.
[2025-10-24T19:40:50.010051] [WARN ] [MAIN      ] LH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:40:50.010274] [INFO ] [MAIN      ] LH: Wiping existing primary data before full refresh.
[2025-10-24T19:40:50.010320] [INFO ] [LOCAL     ] LH: Starting deletion of primary data.
[2025-10-24T19:40:50.010676] [DEBUG] [LOCAL     ] LH: Deleted primary data file.
[2025-10-24T19:40:50.010733] [INFO ] [MAIN      ] LH: Starting full primary refresh.
[2025-10-24T19:40:50.392791] [INFO ] [REMOTE    ] LH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:40:50.528203] [INFO ] [REMOTE    ] LGI: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T19:40:50.547598] [INFO ] [REMOTE    ] LGI: Fetching primary data for 2025-03.
[2025-10-24T19:40:51.106982] [INFO ] [REMOTE    ] LGI: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T19:40:51.134296] [INFO ] [REMOTE    ] LEVI: Incremental fetch complete for 2025-10 (2.19 seconds).
[2025-10-24T19:40:51.144429] [INFO ] [REMOTE    ] LEVI: Full fetch complete (74998 records).
[2025-10-24T19:40:51.144564] [DEBUG] [VALIDATOR ] LEVI: Validating primary data.
[2025-10-24T19:40:51.352749] [INFO ] [REMOTE    ] LH: Fetching primary data for 2025-01.
[2025-10-24T19:40:51.546158] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present.
[2025-10-24T19:40:51.546247] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed.
[2025-10-24T19:40:51.547390] [INFO ] [MAIN      ] LEVI: Fetched primary data is valid.
[2025-10-24T19:40:51.547454] [DEBUG] [LOCAL     ] LEVI: Saving primary data.
[2025-10-24T19:40:51.548054] [FATAL] [LOCAL     ] LEVI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:40:51.548135] [FATAL] [MAIN      ] LEVI: Failed to save primary data.
[2025-10-24T19:40:51.548178] [WARN ] [MAIN      ] LEVI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:40:51.548238] [INFO ] [LOCAL     ] LEVI: Starting deletion of primary data.
[2025-10-24T19:40:51.548299] [DEBUG] [LOCAL     ] LEVI: No primary data file found to delete.
[2025-10-24T19:40:51.548335] [INFO ] [LOCAL     ] LEVI: Starting deletion of derivative data.
[2025-10-24T19:40:51.548470] [DEBUG] [LOCAL     ] LEVI: Deleted derivative data file.
[2025-10-24T19:40:51.548902] [INFO ] [MAIN      ] Update Progress: 1251/2366 symbols completed. LEVI took 31.0s. Estimated remaining: 2h 23m 20s. Rate: 7.8 symbols/min
[2025-10-24T19:40:51.717926] [INFO ] [MAIN      ] LHX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:40:51.765378] [DEBUG] [LOCAL     ] LHX: Loaded 48769 existing records from primary storage.
[2025-10-24T19:40:51.765707] [INFO ] [MAIN      ] LHX: Loaded 48769 existing records.
[2025-10-24T19:40:51.941537] [WARN ] [MAIN      ] LHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:40:51.941754] [INFO ] [MAIN      ] LHX: Wiping existing primary data before full refresh.
[2025-10-24T19:40:51.941821] [INFO ] [LOCAL     ] LHX: Starting deletion of primary data.
[2025-10-24T19:40:51.942289] [DEBUG] [LOCAL     ] LHX: Deleted primary data file.
[2025-10-24T19:40:51.942349] [INFO ] [MAIN      ] LHX: Starting full primary refresh.
[2025-10-24T19:40:52.152765] [INFO ] [REMOTE    ] LGI: Fetching primary data for 2025-04.
[2025-10-24T19:40:52.299243] [INFO ] [REMOTE    ] LHX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:40:52.853028] [INFO ] [REMOTE    ] LH: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T19:40:52.947686] [INFO ] [REMOTE    ] LH: Fetching primary data for 2025-02.
[2025-10-24T19:40:53.000459] [INFO ] [REMOTE    ] LGI: Incremental fetch complete for 2025-04 (0.85 seconds).
[2025-10-24T19:40:53.747635] [INFO ] [REMOTE    ] LGI: Fetching primary data for 2025-05.
[2025-10-24T19:40:54.169187] [INFO ] [REMOTE    ] LH: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T19:40:54.494032] [INFO ] [REMOTE    ] LGI: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T19:40:54.547618] [INFO ] [REMOTE    ] LGI: Fetching primary data for 2025-06.
[2025-10-24T19:40:55.347698] [INFO ] [REMOTE    ] LEO: Fetching primary data for 2025-08.
[2025-10-24T19:40:55.374871] [INFO ] [REMOTE    ] LGI: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T19:40:56.147716] [INFO ] [REMOTE    ] LH: Fetching primary data for 2025-03.
[2025-10-24T19:40:56.252376] [INFO ] [REMOTE    ] LEO: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T19:40:56.947637] [INFO ] [REMOTE    ] LGI: Fetching primary data for 2025-07.
[2025-10-24T19:40:57.564630] [INFO ] [REMOTE    ] LH: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T19:40:57.636001] [INFO ] [REMOTE    ] LGI: Incremental fetch complete for 2025-07 (0.69 seconds).
[2025-10-24T19:40:57.747626] [INFO ] [REMOTE    ] LGI: Fetching primary data for 2025-08.
[2025-10-24T19:40:58.547709] [INFO ] [REMOTE    ] LH: Fetching primary data for 2025-04.
[2025-10-24T19:40:58.606964] [INFO ] [REMOTE    ] LGI: Incremental fetch complete for 2025-08 (0.86 seconds).
[2025-10-24T19:40:59.347670] [INFO ] [REMOTE    ] LEO: Fetching primary data for 2025-09.
[2025-10-24T19:41:00.147756] [INFO ] [REMOTE    ] LGI: Fetching primary data for 2025-09.
[2025-10-24T19:41:00.174838] [INFO ] [REMOTE    ] LH: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T19:41:00.214105] [INFO ] [REMOTE    ] LEO: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T19:41:00.947681] [INFO ] [REMOTE    ] LEO: Fetching primary data for 2025-10.
[2025-10-24T19:41:01.413933] [INFO ] [REMOTE    ] LGI: Incremental fetch complete for 2025-09 (1.27 seconds).
[2025-10-24T19:41:01.747724] [INFO ] [REMOTE    ] LHX: Fetching primary data for 2025-01.
[2025-10-24T19:41:02.547739] [INFO ] [REMOTE    ] LGI: Fetching primary data for 2025-10.
[2025-10-24T19:41:02.716505] [INFO ] [REMOTE    ] LEO: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T19:41:02.719721] [INFO ] [REMOTE    ] LEO: Full fetch complete (26429 records).
[2025-10-24T19:41:02.719815] [DEBUG] [VALIDATOR ] LEO: Validating primary data.
[2025-10-24T19:41:03.096073] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present.
[2025-10-24T19:41:03.096162] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed.
[2025-10-24T19:41:03.096770] [INFO ] [MAIN      ] LEO: Fetched primary data is valid.
[2025-10-24T19:41:03.096832] [DEBUG] [LOCAL     ] LEO: Saving primary data.
[2025-10-24T19:41:03.097158] [FATAL] [LOCAL     ] LEO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:41:03.097264] [FATAL] [MAIN      ] LEO: Failed to save primary data.
[2025-10-24T19:41:03.097309] [WARN ] [MAIN      ] LEO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:41:03.097378] [INFO ] [LOCAL     ] LEO: Starting deletion of primary data.
[2025-10-24T19:41:03.097435] [DEBUG] [LOCAL     ] LEO: No primary data file found to delete.
[2025-10-24T19:41:03.097472] [INFO ] [LOCAL     ] LEO: Starting deletion of derivative data.
[2025-10-24T19:41:03.097583] [DEBUG] [LOCAL     ] LEO: Deleted derivative data file.
[2025-10-24T19:41:03.097691] [INFO ] [MAIN      ] Update Progress: 1252/2366 symbols completed. LEO took 48.3s. Estimated remaining: 2h 23m 15s. Rate: 7.8 symbols/min
[2025-10-24T19:41:03.271726] [INFO ] [MAIN      ] LII: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:41:03.300722] [DEBUG] [LOCAL     ] LII: Loaded 28039 existing records from primary storage.
[2025-10-24T19:41:03.300988] [INFO ] [MAIN      ] LII: Loaded 28039 existing records.
[2025-10-24T19:41:03.372175] [INFO ] [REMOTE    ] LH: Fetching primary data for 2025-05.
[2025-10-24T19:41:03.487404] [WARN ] [MAIN      ] LII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:41:03.487600] [INFO ] [MAIN      ] LII: Wiping existing primary data before full refresh.
[2025-10-24T19:41:03.487665] [INFO ] [LOCAL     ] LII: Starting deletion of primary data.
[2025-10-24T19:41:03.487912] [DEBUG] [LOCAL     ] LII: Deleted primary data file.
[2025-10-24T19:41:03.487951] [INFO ] [MAIN      ] LII: Starting full primary refresh.
[2025-10-24T19:41:03.802235] [INFO ] [REMOTE    ] LGI: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T19:41:03.815596] [INFO ] [REMOTE    ] LGI: Full fetch complete (14452 records).
[2025-10-24T19:41:03.815843] [DEBUG] [VALIDATOR ] LGI: Validating primary data.
[2025-10-24T19:41:03.890198] [INFO ] [REMOTE    ] LII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:41:04.158415] [INFO ] [REMOTE    ] LII: Fetching primary data for 2025-01.
[2025-10-24T19:41:04.285023] [INFO ] [REMOTE    ] LHX: Incremental fetch complete for 2025-01 (2.54 seconds).
[2025-10-24T19:41:04.294059] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present.
[2025-10-24T19:41:04.294139] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed.
[2025-10-24T19:41:04.303436] [INFO ] [MAIN      ] LGI: Fetched primary data is valid.
[2025-10-24T19:41:04.303513] [DEBUG] [LOCAL     ] LGI: Saving primary data.
[2025-10-24T19:41:04.303862] [FATAL] [LOCAL     ] LGI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:41:04.304440] [FATAL] [MAIN      ] LGI: Failed to save primary data.
[2025-10-24T19:41:04.304571] [WARN ] [MAIN      ] LGI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:41:04.304741] [INFO ] [LOCAL     ] LGI: Starting deletion of primary data.
[2025-10-24T19:41:04.304855] [DEBUG] [LOCAL     ] LGI: No primary data file found to delete.
[2025-10-24T19:41:04.304928] [INFO ] [LOCAL     ] LGI: Starting deletion of derivative data.
[2025-10-24T19:41:04.305059] [DEBUG] [LOCAL     ] LGI: Deleted derivative data file.
[2025-10-24T19:41:04.305129] [INFO ] [MAIN      ] Update Progress: 1253/2366 symbols completed. LGI took 28.7s. Estimated remaining: 2h 23m 2s. Rate: 7.8 symbols/min
[2025-10-24T19:41:04.472886] [INFO ] [MAIN      ] LION: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:41:04.515520] [DEBUG] [LOCAL     ] LION: Loaded 47284 existing records from primary storage.
[2025-10-24T19:41:04.515827] [INFO ] [MAIN      ] LION: Loaded 47284 existing records.
[2025-10-24T19:41:04.690311] [WARN ] [MAIN      ] LION: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:41:04.690523] [INFO ] [MAIN      ] LION: Wiping existing primary data before full refresh.
[2025-10-24T19:41:04.690569] [INFO ] [LOCAL     ] LION: Starting deletion of primary data.
[2025-10-24T19:41:04.690939] [DEBUG] [LOCAL     ] LION: Deleted primary data file.
[2025-10-24T19:41:04.690996] [INFO ] [MAIN      ] LION: Starting full primary refresh.
[2025-10-24T19:41:04.954671] [INFO ] [REMOTE    ] LHX: Fetching primary data for 2025-02.
[2025-10-24T19:41:05.069059] [INFO ] [REMOTE    ] LION: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:41:05.741638] [INFO ] [REMOTE    ] LH: Incremental fetch complete for 2025-05 (2.37 seconds).
[2025-10-24T19:41:05.749832] [INFO ] [REMOTE    ] LION: Fetching primary data for 2025-01.
[2025-10-24T19:41:05.772411] [INFO ] [REMOTE    ] LII: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T19:41:06.547686] [INFO ] [REMOTE    ] LII: Fetching primary data for 2025-02.
[2025-10-24T19:41:06.745955] [INFO ] [REMOTE    ] LION: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T19:41:06.928562] [INFO ] [REMOTE    ] LHX: Incremental fetch complete for 2025-02 (1.97 seconds).
[2025-10-24T19:41:07.347667] [INFO ] [REMOTE    ] LION: Fetching primary data for 2025-02.
[2025-10-24T19:41:07.536850] [INFO ] [REMOTE    ] LII: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T19:41:08.081940] [INFO ] [REMOTE    ] LION: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T19:41:08.147617] [INFO ] [REMOTE    ] LION: Fetching primary data for 2025-03.
[2025-10-24T19:41:08.830917] [INFO ] [REMOTE    ] LION: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T19:41:08.947677] [INFO ] [REMOTE    ] LHX: Fetching primary data for 2025-03.
[2025-10-24T19:41:09.747734] [INFO ] [REMOTE    ] LION: Fetching primary data for 2025-04.
[2025-10-24T19:41:10.547620] [INFO ] [REMOTE    ] LII: Fetching primary data for 2025-03.
[2025-10-24T19:41:10.876461] [INFO ] [REMOTE    ] LHX: Incremental fetch complete for 2025-03 (1.93 seconds).
[2025-10-24T19:41:11.110679] [INFO ] [REMOTE    ] LION: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T19:41:11.347679] [INFO ] [REMOTE    ] LH: Fetching primary data for 2025-06.
[2025-10-24T19:41:11.965338] [INFO ] [REMOTE    ] LII: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T19:41:12.147639] [INFO ] [REMOTE    ] LII: Fetching primary data for 2025-04.
[2025-10-24T19:41:12.781456] [INFO ] [REMOTE    ] LH: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T19:41:12.947688] [INFO ] [REMOTE    ] LHX: Fetching primary data for 2025-04.
[2025-10-24T19:41:13.652439] [INFO ] [REMOTE    ] LII: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T19:41:13.747720] [INFO ] [REMOTE    ] LII: Fetching primary data for 2025-05.
[2025-10-24T19:41:14.270123] [INFO ] [REMOTE    ] LHX: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T19:41:14.530069] [INFO ] [REMOTE    ] LII: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T19:41:14.547632] [INFO ] [REMOTE    ] LII: Fetching primary data for 2025-06.
[2025-10-24T19:41:15.347702] [INFO ] [REMOTE    ] LH: Fetching primary data for 2025-07.
[2025-10-24T19:41:15.878576] [INFO ] [REMOTE    ] LII: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T19:41:16.147693] [INFO ] [REMOTE    ] LION: Fetching primary data for 2025-05.
[2025-10-24T19:41:16.800585] [INFO ] [REMOTE    ] LH: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T19:41:16.947676] [INFO ] [REMOTE    ] LH: Fetching primary data for 2025-08.
[2025-10-24T19:41:17.747674] [INFO ] [REMOTE    ] LII: Fetching primary data for 2025-07.
[2025-10-24T19:41:17.852795] [INFO ] [REMOTE    ] LION: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T19:41:18.286046] [INFO ] [REMOTE    ] LH: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T19:41:18.547706] [INFO ] [REMOTE    ] LH: Fetching primary data for 2025-09.
[2025-10-24T19:41:19.091734] [INFO ] [REMOTE    ] LII: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T19:41:19.347713] [INFO ] [REMOTE    ] LION: Fetching primary data for 2025-06.
[2025-10-24T19:41:19.600383] [INFO ] [REMOTE    ] LH: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T19:41:20.147675] [INFO ] [REMOTE    ] LH: Fetching primary data for 2025-10.
[2025-10-24T19:41:20.867537] [INFO ] [REMOTE    ] LION: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T19:41:20.947691] [INFO ] [REMOTE    ] LHX: Fetching primary data for 2025-05.
[2025-10-24T19:41:21.578501] [INFO ] [REMOTE    ] LH: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T19:41:21.585022] [INFO ] [REMOTE    ] LH: Full fetch complete (54745 records).
[2025-10-24T19:41:21.585177] [DEBUG] [VALIDATOR ] LH: Validating primary data.
[2025-10-24T19:41:21.752827] [INFO ] [REMOTE    ] LION: Fetching primary data for 2025-07.
[2025-10-24T19:41:22.150244] [DEBUG] [VALIDATOR ] LH: All expected trading days are present.
[2025-10-24T19:41:22.150364] [DEBUG] [VALIDATOR ] LH: Primary data validation passed.
[2025-10-24T19:41:22.152139] [INFO ] [MAIN      ] LH: Fetched primary data is valid.
[2025-10-24T19:41:22.152227] [DEBUG] [LOCAL     ] LH: Saving primary data.
[2025-10-24T19:41:22.152952] [FATAL] [LOCAL     ] LH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:41:22.153071] [FATAL] [MAIN      ] LH: Failed to save primary data.
[2025-10-24T19:41:22.153132] [WARN ] [MAIN      ] LH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:41:22.153192] [INFO ] [LOCAL     ] LH: Starting deletion of primary data.
[2025-10-24T19:41:22.153274] [DEBUG] [LOCAL     ] LH: No primary data file found to delete.
[2025-10-24T19:41:22.153333] [INFO ] [LOCAL     ] LH: Starting deletion of derivative data.
[2025-10-24T19:41:22.153507] [DEBUG] [LOCAL     ] LH: Deleted derivative data file.
[2025-10-24T19:41:22.156913] [INFO ] [MAIN      ] Update Progress: 1254/2366 symbols completed. LH took 32.6s. Estimated remaining: 2h 23m 3s. Rate: 7.8 symbols/min
[2025-10-24T19:41:22.408088] [INFO ] [MAIN      ] LITB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:41:22.415560] [DEBUG] [LOCAL     ] LITB: Loaded 3886 existing records from primary storage.
[2025-10-24T19:41:22.415836] [INFO ] [MAIN      ] LITB: Loaded 3886 existing records.
[2025-10-24T19:41:22.552688] [INFO ] [REMOTE    ] LII: Fetching primary data for 2025-08.
[2025-10-24T19:41:22.706706] [WARN ] [MAIN      ] LITB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:41:22.706963] [INFO ] [MAIN      ] LITB: Wiping existing primary data before full refresh.
[2025-10-24T19:41:22.707089] [INFO ] [LOCAL     ] LITB: Starting deletion of primary data.
[2025-10-24T19:41:22.707353] [DEBUG] [LOCAL     ] LITB: Deleted primary data file.
[2025-10-24T19:41:22.707416] [INFO ] [MAIN      ] LITB: Starting full primary refresh.
[2025-10-24T19:41:23.067072] [INFO ] [REMOTE    ] LHX: Incremental fetch complete for 2025-05 (2.12 seconds).
[2025-10-24T19:41:23.131004] [INFO ] [REMOTE    ] LITB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:41:23.356120] [INFO ] [REMOTE    ] LHX: Fetching primary data for 2025-06.
[2025-10-24T19:41:23.375537] [INFO ] [REMOTE    ] LION: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T19:41:23.750424] [INFO ] [REMOTE    ] LII: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T19:41:24.147668] [INFO ] [REMOTE    ] LITB: Fetching primary data for 2025-01.
[2025-10-24T19:41:24.704143] [INFO ] [REMOTE    ] LITB: Incremental fetch complete for 2025-01 (0.56 seconds).
[2025-10-24T19:41:24.947751] [INFO ] [REMOTE    ] LII: Fetching primary data for 2025-09.
[2025-10-24T19:41:25.068458] [INFO ] [REMOTE    ] LHX: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T19:41:25.747624] [INFO ] [REMOTE    ] LHX: Fetching primary data for 2025-07.
[2025-10-24T19:41:25.805497] [INFO ] [REMOTE    ] LII: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T19:41:26.547673] [INFO ] [REMOTE    ] LITB: Fetching primary data for 2025-02.
[2025-10-24T19:41:27.229861] [INFO ] [REMOTE    ] LITB: Incremental fetch complete for 2025-02 (0.68 seconds).
[2025-10-24T19:41:27.347621] [INFO ] [REMOTE    ] LITB: Fetching primary data for 2025-03.
[2025-10-24T19:41:27.519102] [INFO ] [REMOTE    ] LHX: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T19:41:27.956452] [INFO ] [REMOTE    ] LITB: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T19:41:28.147716] [INFO ] [REMOTE    ] LITB: Fetching primary data for 2025-04.
[2025-10-24T19:41:28.938888] [INFO ] [REMOTE    ] LITB: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T19:41:28.947600] [INFO ] [REMOTE    ] LITB: Fetching primary data for 2025-05.
[2025-10-24T19:41:29.439299] [INFO ] [REMOTE    ] LITB: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T19:41:29.747708] [INFO ] [REMOTE    ] LITB: Fetching primary data for 2025-06.
[2025-10-24T19:41:30.155052] [INFO ] [REMOTE    ] LITB: Incremental fetch complete for 2025-06 (0.41 seconds).
[2025-10-24T19:41:30.547678] [INFO ] [REMOTE    ] LION: Fetching primary data for 2025-08.
[2025-10-24T19:41:31.347737] [INFO ] [REMOTE    ] LITB: Fetching primary data for 2025-07.
[2025-10-24T19:41:31.828501] [INFO ] [REMOTE    ] LITB: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T19:41:32.056909] [INFO ] [REMOTE    ] LION: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T19:41:32.147691] [INFO ] [REMOTE    ] LHX: Fetching primary data for 2025-08.
[2025-10-24T19:41:32.947687] [INFO ] [REMOTE    ] LION: Fetching primary data for 2025-09.
[2025-10-24T19:41:33.748719] [INFO ] [REMOTE    ] LII: Fetching primary data for 2025-10.
[2025-10-24T19:41:33.751676] [INFO ] [REMOTE    ] LHX: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T19:41:33.957546] [INFO ] [REMOTE    ] LION: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T19:41:34.547688] [INFO ] [REMOTE    ] LHX: Fetching primary data for 2025-09.
[2025-10-24T19:41:35.111440] [INFO ] [REMOTE    ] LII: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T19:41:35.117148] [INFO ] [REMOTE    ] LII: Full fetch complete (41941 records).
[2025-10-24T19:41:35.117300] [DEBUG] [VALIDATOR ] LII: Validating primary data.
[2025-10-24T19:41:35.358120] [INFO ] [REMOTE    ] LION: Fetching primary data for 2025-10.
[2025-10-24T19:41:35.494926] [DEBUG] [VALIDATOR ] LII: All expected trading days are present.
[2025-10-24T19:41:35.495001] [DEBUG] [VALIDATOR ] LII: Primary data validation passed.
[2025-10-24T19:41:35.495780] [INFO ] [MAIN      ] LII: Fetched primary data is valid.
[2025-10-24T19:41:35.495842] [DEBUG] [LOCAL     ] LII: Saving primary data.
[2025-10-24T19:41:35.496218] [FATAL] [LOCAL     ] LII: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:41:35.496301] [FATAL] [MAIN      ] LII: Failed to save primary data.
[2025-10-24T19:41:35.496343] [WARN ] [MAIN      ] LII: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:41:35.496380] [INFO ] [LOCAL     ] LII: Starting deletion of primary data.
[2025-10-24T19:41:35.496429] [DEBUG] [LOCAL     ] LII: No primary data file found to delete.
[2025-10-24T19:41:35.496465] [INFO ] [LOCAL     ] LII: Starting deletion of derivative data.
[2025-10-24T19:41:35.496577] [DEBUG] [LOCAL     ] LII: Deleted derivative data file.
[2025-10-24T19:41:35.496677] [INFO ] [MAIN      ] Update Progress: 1255/2366 symbols completed. LII took 32.4s. Estimated remaining: 2h 23m 0s. Rate: 7.8 symbols/min
[2025-10-24T19:41:35.672692] [INFO ] [MAIN      ] LLY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:41:35.724632] [DEBUG] [LOCAL     ] LLY: Loaded 53575 existing records from primary storage.
[2025-10-24T19:41:35.724973] [INFO ] [MAIN      ] LLY: Loaded 53575 existing records.
[2025-10-24T19:41:35.904823] [WARN ] [MAIN      ] LLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:41:35.905195] [INFO ] [MAIN      ] LLY: Wiping existing primary data before full refresh.
[2025-10-24T19:41:35.905285] [INFO ] [LOCAL     ] LLY: Starting deletion of primary data.
[2025-10-24T19:41:35.905704] [DEBUG] [LOCAL     ] LLY: Deleted primary data file.
[2025-10-24T19:41:35.905765] [INFO ] [MAIN      ] LLY: Starting full primary refresh.
[2025-10-24T19:41:36.159401] [INFO ] [REMOTE    ] LITB: Fetching primary data for 2025-08.
[2025-10-24T19:41:36.288100] [INFO ] [REMOTE    ] LLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:41:36.313701] [INFO ] [REMOTE    ] LHX: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T19:41:36.686003] [INFO ] [REMOTE    ] LITB: Incremental fetch complete for 2025-08 (0.53 seconds).
[2025-10-24T19:41:36.947615] [INFO ] [REMOTE    ] LITB: Fetching primary data for 2025-09.
[2025-10-24T19:41:37.169114] [INFO ] [REMOTE    ] LION: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T19:41:37.178173] [INFO ] [REMOTE    ] LION: Full fetch complete (58321 records).
[2025-10-24T19:41:37.178287] [DEBUG] [VALIDATOR ] LION: Validating primary data.
[2025-10-24T19:41:37.491992] [INFO ] [REMOTE    ] LITB: Incremental fetch complete for 2025-09 (0.54 seconds).
[2025-10-24T19:41:37.582574] [DEBUG] [VALIDATOR ] LION: All expected trading days are present.
[2025-10-24T19:41:37.582677] [DEBUG] [VALIDATOR ] LION: Primary data validation passed.
[2025-10-24T19:41:37.583593] [INFO ] [MAIN      ] LION: Fetched primary data is valid.
[2025-10-24T19:41:37.583635] [DEBUG] [LOCAL     ] LION: Saving primary data.
[2025-10-24T19:41:37.584170] [FATAL] [LOCAL     ] LION: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:41:37.584277] [FATAL] [MAIN      ] LION: Failed to save primary data.
[2025-10-24T19:41:37.584320] [WARN ] [MAIN      ] LION: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:41:37.584368] [INFO ] [LOCAL     ] LION: Starting deletion of primary data.
[2025-10-24T19:41:37.584445] [DEBUG] [LOCAL     ] LION: No primary data file found to delete.
[2025-10-24T19:41:37.584501] [INFO ] [LOCAL     ] LION: Starting deletion of derivative data.
[2025-10-24T19:41:37.584693] [DEBUG] [LOCAL     ] LION: Deleted derivative data file.
[2025-10-24T19:41:37.584900] [INFO ] [MAIN      ] Update Progress: 1256/2366 symbols completed. LION took 33.3s. Estimated remaining: 2h 22m 48s. Rate: 7.8 symbols/min
[2025-10-24T19:41:37.748289] [INFO ] [REMOTE    ] LLY: Fetching primary data for 2025-01.
[2025-10-24T19:41:37.760207] [INFO ] [MAIN      ] LMND: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:41:37.817822] [DEBUG] [LOCAL     ] LMND: Loaded 52502 existing records from primary storage.
[2025-10-24T19:41:37.818156] [INFO ] [MAIN      ] LMND: Loaded 52502 existing records.
[2025-10-24T19:41:38.021809] [WARN ] [MAIN      ] LMND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:41:38.022068] [INFO ] [MAIN      ] LMND: Wiping existing primary data before full refresh.
[2025-10-24T19:41:38.022151] [INFO ] [LOCAL     ] LMND: Starting deletion of primary data.
[2025-10-24T19:41:38.022600] [DEBUG] [LOCAL     ] LMND: Deleted primary data file.
[2025-10-24T19:41:38.022695] [INFO ] [MAIN      ] LMND: Starting full primary refresh.
[2025-10-24T19:41:38.425912] [INFO ] [REMOTE    ] LMND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:41:38.547683] [INFO ] [REMOTE    ] LITB: Fetching primary data for 2025-10.
[2025-10-24T19:41:39.215150] [INFO ] [REMOTE    ] LITB: Incremental fetch complete for 2025-10 (0.67 seconds).
[2025-10-24T19:41:39.216500] [INFO ] [REMOTE    ] LITB: Full fetch complete (5800 records).
[2025-10-24T19:41:39.216568] [DEBUG] [VALIDATOR ] LITB: Validating primary data.
[2025-10-24T19:41:39.354689] [INFO ] [REMOTE    ] LHX: Fetching primary data for 2025-10.
[2025-10-24T19:41:39.582316] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present.
[2025-10-24T19:41:39.582379] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed.
[2025-10-24T19:41:39.582553] [INFO ] [MAIN      ] LITB: Fetched primary data is valid.
[2025-10-24T19:41:39.582593] [DEBUG] [LOCAL     ] LITB: Saving primary data.
[2025-10-24T19:41:39.582815] [FATAL] [LOCAL     ] LITB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:41:39.582897] [FATAL] [MAIN      ] LITB: Failed to save primary data.
[2025-10-24T19:41:39.582964] [WARN ] [MAIN      ] LITB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:41:39.583034] [INFO ] [LOCAL     ] LITB: Starting deletion of primary data.
[2025-10-24T19:41:39.583091] [DEBUG] [LOCAL     ] LITB: No primary data file found to delete.
[2025-10-24T19:41:39.583128] [INFO ] [LOCAL     ] LITB: Starting deletion of derivative data.
[2025-10-24T19:41:39.583268] [DEBUG] [LOCAL     ] LITB: Deleted derivative data file.
[2025-10-24T19:41:39.583355] [INFO ] [MAIN      ] Update Progress: 1257/2366 symbols completed. LITB took 17.4s. Estimated remaining: 2h 22m 35s. Rate: 7.8 symbols/min
[2025-10-24T19:41:39.762070] [INFO ] [MAIN      ] LMT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:41:39.811964] [DEBUG] [LOCAL     ] LMT: Loaded 49977 existing records from primary storage.
[2025-10-24T19:41:39.812254] [INFO ] [MAIN      ] LMT: Loaded 49977 existing records.
[2025-10-24T19:41:39.993944] [WARN ] [MAIN      ] LMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:41:39.994527] [INFO ] [MAIN      ] LMT: Wiping existing primary data before full refresh.
[2025-10-24T19:41:39.994585] [INFO ] [LOCAL     ] LMT: Starting deletion of primary data.
[2025-10-24T19:41:40.004479] [DEBUG] [LOCAL     ] LMT: Deleted primary data file.
[2025-10-24T19:41:40.020679] [INFO ] [MAIN      ] LMT: Starting full primary refresh.
[2025-10-24T19:41:40.097995] [INFO ] [REMOTE    ] LLY: Incremental fetch complete for 2025-01 (2.35 seconds).
[2025-10-24T19:41:40.152738] [INFO ] [REMOTE    ] LMND: Fetching primary data for 2025-01.
[2025-10-24T19:41:40.384961] [INFO ] [REMOTE    ] LMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:41:40.947728] [INFO ] [REMOTE    ] LLY: Fetching primary data for 2025-02.
[2025-10-24T19:41:41.531610] [INFO ] [REMOTE    ] LHX: Incremental fetch complete for 2025-10 (2.18 seconds).
[2025-10-24T19:41:41.539995] [INFO ] [REMOTE    ] LHX: Full fetch complete (70699 records).
[2025-10-24T19:41:41.540111] [DEBUG] [VALIDATOR ] LHX: Validating primary data.
[2025-10-24T19:41:41.756717] [INFO ] [REMOTE    ] LMT: Fetching primary data for 2025-01.
[2025-10-24T19:41:41.942744] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present.
[2025-10-24T19:41:41.942888] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed.
[2025-10-24T19:41:41.944163] [INFO ] [MAIN      ] LHX: Fetched primary data is valid.
[2025-10-24T19:41:41.944236] [DEBUG] [LOCAL     ] LHX: Saving primary data.
[2025-10-24T19:41:41.944939] [FATAL] [LOCAL     ] LHX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:41:41.945109] [FATAL] [MAIN      ] LHX: Failed to save primary data.
[2025-10-24T19:41:41.945183] [WARN ] [MAIN      ] LHX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:41:41.945336] [INFO ] [LOCAL     ] LHX: Starting deletion of primary data.
[2025-10-24T19:41:41.945714] [DEBUG] [LOCAL     ] LHX: No primary data file found to delete.
[2025-10-24T19:41:41.945774] [INFO ] [LOCAL     ] LHX: Starting deletion of derivative data.
[2025-10-24T19:41:41.955448] [DEBUG] [LOCAL     ] LHX: Deleted derivative data file.
[2025-10-24T19:41:41.969577] [INFO ] [MAIN      ] Update Progress: 1258/2366 symbols completed. LHX took 50.4s. Estimated remaining: 2h 22m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:41:42.062199] [INFO ] [REMOTE    ] LMND: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T19:41:42.168383] [INFO ] [MAIN      ] LNC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:41:42.220295] [DEBUG] [LOCAL     ] LNC: Loaded 51801 existing records from primary storage.
[2025-10-24T19:41:42.220710] [INFO ] [MAIN      ] LNC: Loaded 51801 existing records.
[2025-10-24T19:41:42.405895] [WARN ] [MAIN      ] LNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:41:42.406097] [INFO ] [MAIN      ] LNC: Wiping existing primary data before full refresh.
[2025-10-24T19:41:42.406143] [INFO ] [LOCAL     ] LNC: Starting deletion of primary data.
[2025-10-24T19:41:42.406850] [DEBUG] [LOCAL     ] LNC: Deleted primary data file.
[2025-10-24T19:41:42.406908] [INFO ] [MAIN      ] LNC: Starting full primary refresh.
[2025-10-24T19:41:42.551867] [INFO ] [REMOTE    ] LMND: Fetching primary data for 2025-02.
[2025-10-24T19:41:42.782066] [INFO ] [REMOTE    ] LNC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:41:42.814301] [INFO ] [REMOTE    ] LLY: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T19:41:43.347726] [INFO ] [REMOTE    ] LLY: Fetching primary data for 2025-03.
[2025-10-24T19:41:43.733346] [INFO ] [REMOTE    ] LMT: Incremental fetch complete for 2025-01 (1.98 seconds).
[2025-10-24T19:41:44.147682] [INFO ] [REMOTE    ] LMT: Fetching primary data for 2025-02.
[2025-10-24T19:41:44.406701] [INFO ] [REMOTE    ] LMND: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T19:41:44.947705] [INFO ] [REMOTE    ] LMND: Fetching primary data for 2025-03.
[2025-10-24T19:41:45.575612] [INFO ] [REMOTE    ] LLY: Incremental fetch complete for 2025-03 (2.23 seconds).
[2025-10-24T19:41:45.740547] [INFO ] [REMOTE    ] LMT: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T19:41:45.749950] [INFO ] [REMOTE    ] LLY: Fetching primary data for 2025-04.
[2025-10-24T19:41:46.547701] [INFO ] [REMOTE    ] LMT: Fetching primary data for 2025-03.
[2025-10-24T19:41:46.618441] [INFO ] [REMOTE    ] LMND: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T19:41:47.347702] [INFO ] [REMOTE    ] LNC: Fetching primary data for 2025-01.
[2025-10-24T19:41:47.899619] [INFO ] [REMOTE    ] LLY: Incremental fetch complete for 2025-04 (2.15 seconds).
[2025-10-24T19:41:48.147694] [INFO ] [REMOTE    ] LLY: Fetching primary data for 2025-05.
[2025-10-24T19:41:48.746659] [INFO ] [REMOTE    ] LMT: Incremental fetch complete for 2025-03 (2.20 seconds).
[2025-10-24T19:41:48.807390] [INFO ] [REMOTE    ] LNC: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T19:41:48.947634] [INFO ] [REMOTE    ] LMT: Fetching primary data for 2025-04.
[2025-10-24T19:41:49.747699] [INFO ] [REMOTE    ] LNC: Fetching primary data for 2025-02.
[2025-10-24T19:41:50.275116] [INFO ] [REMOTE    ] LLY: Incremental fetch complete for 2025-05 (2.13 seconds).
[2025-10-24T19:41:50.547612] [INFO ] [REMOTE    ] LLY: Fetching primary data for 2025-06.
[2025-10-24T19:41:50.830240] [INFO ] [REMOTE    ] LNC: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T19:41:50.938759] [INFO ] [REMOTE    ] LMT: Incremental fetch complete for 2025-04 (1.99 seconds).
[2025-10-24T19:41:51.347733] [INFO ] [REMOTE    ] LMND: Fetching primary data for 2025-04.
[2025-10-24T19:41:52.147620] [INFO ] [REMOTE    ] LNC: Fetching primary data for 2025-03.
[2025-10-24T19:41:52.804319] [INFO ] [REMOTE    ] LLY: Incremental fetch complete for 2025-06 (2.26 seconds).
[2025-10-24T19:41:52.947675] [INFO ] [REMOTE    ] LLY: Fetching primary data for 2025-07.
[2025-10-24T19:41:53.033031] [INFO ] [REMOTE    ] LMND: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T19:41:53.328853] [INFO ] [REMOTE    ] LNC: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T19:41:53.747694] [INFO ] [REMOTE    ] LMND: Fetching primary data for 2025-05.
[2025-10-24T19:41:54.547691] [INFO ] [REMOTE    ] LNC: Fetching primary data for 2025-04.
[2025-10-24T19:41:55.187386] [INFO ] [REMOTE    ] LLY: Incremental fetch complete for 2025-07 (2.24 seconds).
[2025-10-24T19:41:55.353272] [INFO ] [REMOTE    ] LLY: Fetching primary data for 2025-08.
[2025-10-24T19:41:55.373370] [INFO ] [REMOTE    ] LMND: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T19:41:56.143691] [INFO ] [REMOTE    ] LNC: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T19:41:56.154144] [INFO ] [REMOTE    ] LMT: Fetching primary data for 2025-05.
[2025-10-24T19:41:56.947636] [INFO ] [REMOTE    ] LNC: Fetching primary data for 2025-05.
[2025-10-24T19:41:57.747682] [INFO ] [REMOTE    ] LMND: Fetching primary data for 2025-06.
[2025-10-24T19:41:57.785574] [INFO ] [REMOTE    ] LLY: Incremental fetch complete for 2025-08 (2.43 seconds).
[2025-10-24T19:41:57.841695] [INFO ] [REMOTE    ] LMT: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T19:41:58.490702] [INFO ] [REMOTE    ] LNC: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T19:41:58.547726] [INFO ] [REMOTE    ] LLY: Fetching primary data for 2025-09.
[2025-10-24T19:41:59.347666] [INFO ] [REMOTE    ] LMT: Fetching primary data for 2025-06.
[2025-10-24T19:41:59.877937] [INFO ] [REMOTE    ] LMND: Incremental fetch complete for 2025-06 (2.13 seconds).
[2025-10-24T19:42:00.147719] [INFO ] [REMOTE    ] LNC: Fetching primary data for 2025-06.
[2025-10-24T19:42:00.947673] [INFO ] [REMOTE    ] LMND: Fetching primary data for 2025-07.
[2025-10-24T19:42:01.660407] [INFO ] [REMOTE    ] LLY: Incremental fetch complete for 2025-09 (3.11 seconds).
[2025-10-24T19:42:01.747672] [INFO ] [REMOTE    ] LLY: Fetching primary data for 2025-10.
[2025-10-24T19:42:01.873060] [INFO ] [REMOTE    ] LMT: Incremental fetch complete for 2025-06 (2.53 seconds).
[2025-10-24T19:42:02.507289] [INFO ] [REMOTE    ] LNC: Incremental fetch complete for 2025-06 (2.36 seconds).
[2025-10-24T19:42:02.547607] [INFO ] [REMOTE    ] LNC: Fetching primary data for 2025-07.
[2025-10-24T19:42:03.347768] [INFO ] [REMOTE    ] LMT: Fetching primary data for 2025-07.
[2025-10-24T19:42:04.413821] [INFO ] [REMOTE    ] LLY: Incremental fetch complete for 2025-10 (2.67 seconds).
[2025-10-24T19:42:04.424077] [INFO ] [REMOTE    ] LLY: Full fetch complete (77201 records).
[2025-10-24T19:42:04.424209] [DEBUG] [VALIDATOR ] LLY: Validating primary data.
[2025-10-24T19:42:04.790741] [INFO ] [REMOTE    ] LMND: Incremental fetch complete for 2025-07 (3.84 seconds).
[2025-10-24T19:42:04.874713] [INFO ] [REMOTE    ] LMND: Fetching primary data for 2025-08.
[2025-10-24T19:42:04.874811] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present.
[2025-10-24T19:42:04.875094] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed.
[2025-10-24T19:42:04.877345] [INFO ] [MAIN      ] LLY: Fetched primary data is valid.
[2025-10-24T19:42:04.877530] [DEBUG] [LOCAL     ] LLY: Saving primary data.
[2025-10-24T19:42:04.878172] [FATAL] [LOCAL     ] LLY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:42:04.878264] [FATAL] [MAIN      ] LLY: Failed to save primary data.
[2025-10-24T19:42:04.878347] [WARN ] [MAIN      ] LLY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:42:04.878429] [INFO ] [LOCAL     ] LLY: Starting deletion of primary data.
[2025-10-24T19:42:04.878698] [DEBUG] [LOCAL     ] LLY: No primary data file found to delete.
[2025-10-24T19:42:04.878754] [INFO ] [LOCAL     ] LLY: Starting deletion of derivative data.
[2025-10-24T19:42:04.878910] [DEBUG] [LOCAL     ] LLY: Deleted derivative data file.
[2025-10-24T19:42:04.879263] [INFO ] [MAIN      ] Update Progress: 1259/2366 symbols completed. LLY took 29.4s. Estimated remaining: 2h 22m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:42:05.053668] [INFO ] [MAIN      ] LND: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:42:05.061848] [DEBUG] [LOCAL     ] LND: Loaded 4995 existing records from primary storage.
[2025-10-24T19:42:05.062067] [INFO ] [MAIN      ] LND: Loaded 4995 existing records.
[2025-10-24T19:42:05.243032] [WARN ] [MAIN      ] LND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:42:05.243314] [INFO ] [MAIN      ] LND: Wiping existing primary data before full refresh.
[2025-10-24T19:42:05.243394] [INFO ] [LOCAL     ] LND: Starting deletion of primary data.
[2025-10-24T19:42:05.243702] [DEBUG] [LOCAL     ] LND: Deleted primary data file.
[2025-10-24T19:42:05.243787] [INFO ] [MAIN      ] LND: Starting full primary refresh.
[2025-10-24T19:42:05.376141] [INFO ] [REMOTE    ] LNC: Incremental fetch complete for 2025-07 (2.83 seconds).
[2025-10-24T19:42:05.429140] [INFO ] [REMOTE    ] LNC: Fetching primary data for 2025-08.
[2025-10-24T19:42:05.655673] [INFO ] [REMOTE    ] LND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:42:05.686122] [INFO ] [REMOTE    ] LMT: Incremental fetch complete for 2025-07 (2.34 seconds).
[2025-10-24T19:42:05.747601] [INFO ] [REMOTE    ] LND: Fetching primary data for 2025-01.
[2025-10-24T19:42:06.420668] [INFO ] [REMOTE    ] LND: Incremental fetch complete for 2025-01 (0.67 seconds).
[2025-10-24T19:42:06.547623] [INFO ] [REMOTE    ] LMT: Fetching primary data for 2025-08.
[2025-10-24T19:42:06.644105] [INFO ] [REMOTE    ] LMND: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T19:42:07.347691] [INFO ] [REMOTE    ] LND: Fetching primary data for 2025-02.
[2025-10-24T19:42:07.646214] [INFO ] [REMOTE    ] LNC: Incremental fetch complete for 2025-08 (2.22 seconds).
[2025-10-24T19:42:08.039678] [INFO ] [REMOTE    ] LND: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T19:42:08.147689] [INFO ] [REMOTE    ] LND: Fetching primary data for 2025-03.
[2025-10-24T19:42:08.574027] [INFO ] [REMOTE    ] LMT: Incremental fetch complete for 2025-08 (2.03 seconds).
[2025-10-24T19:42:08.741067] [INFO ] [REMOTE    ] LND: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T19:42:08.947698] [INFO ] [REMOTE    ] LMT: Fetching primary data for 2025-09.
[2025-10-24T19:42:09.747614] [INFO ] [REMOTE    ] LND: Fetching primary data for 2025-04.
[2025-10-24T19:42:10.449584] [INFO ] [REMOTE    ] LND: Incremental fetch complete for 2025-04 (0.70 seconds).
[2025-10-24T19:42:10.547695] [INFO ] [REMOTE    ] LND: Fetching primary data for 2025-05.
[2025-10-24T19:42:10.926597] [INFO ] [REMOTE    ] LMT: Incremental fetch complete for 2025-09 (1.98 seconds).
[2025-10-24T19:42:11.128973] [INFO ] [REMOTE    ] LND: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T19:42:11.347731] [INFO ] [REMOTE    ] LND: Fetching primary data for 2025-06.
[2025-10-24T19:42:11.946688] [INFO ] [REMOTE    ] LND: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T19:42:12.147718] [INFO ] [REMOTE    ] LNC: Fetching primary data for 2025-09.
[2025-10-24T19:42:12.947674] [INFO ] [REMOTE    ] LMND: Fetching primary data for 2025-09.
[2025-10-24T19:42:13.747640] [INFO ] [REMOTE    ] LND: Fetching primary data for 2025-07.
[2025-10-24T19:42:13.815097] [INFO ] [REMOTE    ] LNC: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T19:42:14.372964] [INFO ] [REMOTE    ] LND: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T19:42:14.552929] [INFO ] [REMOTE    ] LND: Fetching primary data for 2025-08.
[2025-10-24T19:42:14.577135] [INFO ] [REMOTE    ] LMND: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T19:42:15.159089] [INFO ] [REMOTE    ] LND: Incremental fetch complete for 2025-08 (0.61 seconds).
[2025-10-24T19:42:15.347673] [INFO ] [REMOTE    ] LMT: Fetching primary data for 2025-10.
[2025-10-24T19:42:16.147685] [INFO ] [REMOTE    ] LND: Fetching primary data for 2025-09.
[2025-10-24T19:42:16.702820] [INFO ] [REMOTE    ] LND: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T19:42:16.947679] [INFO ] [REMOTE    ] LMND: Fetching primary data for 2025-10.
[2025-10-24T19:42:17.644466] [INFO ] [REMOTE    ] LMT: Incremental fetch complete for 2025-10 (2.30 seconds).
[2025-10-24T19:42:17.653790] [INFO ] [REMOTE    ] LMT: Full fetch complete (72552 records).
[2025-10-24T19:42:17.653925] [DEBUG] [VALIDATOR ] LMT: Validating primary data.
[2025-10-24T19:42:17.756328] [INFO ] [REMOTE    ] LNC: Fetching primary data for 2025-10.
[2025-10-24T19:42:18.064104] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present.
[2025-10-24T19:42:18.064183] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed.
[2025-10-24T19:42:18.065333] [INFO ] [MAIN      ] LMT: Fetched primary data is valid.
[2025-10-24T19:42:18.065398] [DEBUG] [LOCAL     ] LMT: Saving primary data.
[2025-10-24T19:42:18.066021] [FATAL] [LOCAL     ] LMT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:42:18.066108] [FATAL] [MAIN      ] LMT: Failed to save primary data.
[2025-10-24T19:42:18.066158] [WARN ] [MAIN      ] LMT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:42:18.066233] [INFO ] [LOCAL     ] LMT: Starting deletion of primary data.
[2025-10-24T19:42:18.066299] [DEBUG] [LOCAL     ] LMT: No primary data file found to delete.
[2025-10-24T19:42:18.066336] [INFO ] [LOCAL     ] LMT: Starting deletion of derivative data.
[2025-10-24T19:42:18.066504] [DEBUG] [LOCAL     ] LMT: Deleted derivative data file.
[2025-10-24T19:42:18.067346] [INFO ] [MAIN      ] Update Progress: 1260/2366 symbols completed. LMT took 38.5s. Estimated remaining: 2h 22m 25s. Rate: 7.8 symbols/min
[2025-10-24T19:42:18.239568] [INFO ] [MAIN      ] LNG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:42:18.288684] [DEBUG] [LOCAL     ] LNG: Loaded 51448 existing records from primary storage.
[2025-10-24T19:42:18.288979] [INFO ] [MAIN      ] LNG: Loaded 51448 existing records.
[2025-10-24T19:42:18.464613] [WARN ] [MAIN      ] LNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:42:18.464815] [INFO ] [MAIN      ] LNG: Wiping existing primary data before full refresh.
[2025-10-24T19:42:18.464862] [INFO ] [LOCAL     ] LNG: Starting deletion of primary data.
[2025-10-24T19:42:18.465373] [DEBUG] [LOCAL     ] LNG: Deleted primary data file.
[2025-10-24T19:42:18.465430] [INFO ] [MAIN      ] LNG: Starting full primary refresh.
[2025-10-24T19:42:18.561546] [INFO ] [REMOTE    ] LND: Fetching primary data for 2025-10.
[2025-10-24T19:42:18.823592] [INFO ] [REMOTE    ] LNG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:42:19.270847] [INFO ] [REMOTE    ] LND: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T19:42:19.272378] [INFO ] [REMOTE    ] LND: Full fetch complete (7816 records).
[2025-10-24T19:42:19.272449] [DEBUG] [VALIDATOR ] LND: Validating primary data.
[2025-10-24T19:42:19.352544] [INFO ] [REMOTE    ] LNG: Fetching primary data for 2025-01.
[2025-10-24T19:42:19.591550] [INFO ] [REMOTE    ] LMND: Incremental fetch complete for 2025-10 (2.64 seconds).
[2025-10-24T19:42:19.627545] [INFO ] [REMOTE    ] LMND: Full fetch complete (75480 records).
[2025-10-24T19:42:19.683833] [DEBUG] [VALIDATOR ] LMND: Validating primary data.
[2025-10-24T19:42:19.684540] [DEBUG] [VALIDATOR ] LND: All expected trading days are present.
[2025-10-24T19:42:19.684816] [DEBUG] [VALIDATOR ] LND: Primary data validation passed.
[2025-10-24T19:42:19.685097] [INFO ] [MAIN      ] LND: Fetched primary data is valid.
[2025-10-24T19:42:19.697515] [DEBUG] [LOCAL     ] LND: Saving primary data.
[2025-10-24T19:42:19.723906] [FATAL] [LOCAL     ] LND: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:42:19.743444] [FATAL] [MAIN      ] LND: Failed to save primary data.
[2025-10-24T19:42:19.755671] [WARN ] [MAIN      ] LND: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:42:19.788529] [INFO ] [LOCAL     ] LND: Starting deletion of primary data.
[2025-10-24T19:42:19.799442] [DEBUG] [LOCAL     ] LND: No primary data file found to delete.
[2025-10-24T19:42:19.829581] [INFO ] [REMOTE    ] LNC: Incremental fetch complete for 2025-10 (2.07 seconds).
[2025-10-24T19:42:19.827446] [INFO ] [LOCAL     ] LND: Starting deletion of derivative data.
[2025-10-24T19:42:19.840444] [DEBUG] [LOCAL     ] LND: Deleted derivative data file.
[2025-10-24T19:42:19.854021] [INFO ] [MAIN      ] Update Progress: 1261/2366 symbols completed. LND took 15.0s. Estimated remaining: 2h 22m 12s. Rate: 7.8 symbols/min
[2025-10-24T19:42:19.992326] [INFO ] [REMOTE    ] LNC: Full fetch complete (74546 records).
[2025-10-24T19:42:20.017236] [DEBUG] [VALIDATOR ] LNC: Validating primary data.
[2025-10-24T19:42:20.345415] [INFO ] [MAIN      ] LNN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:42:20.504762] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present.
[2025-10-24T19:42:20.553295] [DEBUG] [LOCAL     ] LNN: Loaded 11727 existing records from primary storage.
[2025-10-24T19:42:20.569093] [INFO ] [MAIN      ] LNN: Loaded 11727 existing records.
[2025-10-24T19:42:20.563714] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed.
[2025-10-24T19:42:20.620967] [INFO ] [MAIN      ] LMND: Fetched primary data is valid.
[2025-10-24T19:42:20.657520] [DEBUG] [LOCAL     ] LMND: Saving primary data.
[2025-10-24T19:42:20.702122] [FATAL] [LOCAL     ] LMND: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:42:20.724560] [FATAL] [MAIN      ] LMND: Failed to save primary data.
[2025-10-24T19:42:20.740775] [WARN ] [MAIN      ] LMND: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:42:20.741321] [INFO ] [LOCAL     ] LMND: Starting deletion of primary data.
[2025-10-24T19:42:20.752467] [DEBUG] [LOCAL     ] LMND: No primary data file found to delete.
[2025-10-24T19:42:20.757865] [INFO ] [LOCAL     ] LMND: Starting deletion of derivative data.
[2025-10-24T19:42:20.840492] [DEBUG] [LOCAL     ] LMND: Deleted derivative data file.
[2025-10-24T19:42:20.867678] [INFO ] [MAIN      ] Update Progress: 1262/2366 symbols completed. LMND took 43.3s. Estimated remaining: 2h 21m 59s. Rate: 7.8 symbols/min
[2025-10-24T19:42:20.881258] [WARN ] [MAIN      ] LNN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:42:20.904552] [INFO ] [MAIN      ] LNN: Wiping existing primary data before full refresh.
[2025-10-24T19:42:20.931833] [INFO ] [LOCAL     ] LNN: Starting deletion of primary data.
[2025-10-24T19:42:20.992582] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present.
[2025-10-24T19:42:20.992811] [DEBUG] [LOCAL     ] LNN: Deleted primary data file.
[2025-10-24T19:42:20.998156] [INFO ] [MAIN      ] LNN: Starting full primary refresh.
[2025-10-24T19:42:21.003359] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed.
[2025-10-24T19:42:21.074238] [INFO ] [MAIN      ] LNC: Fetched primary data is valid.
[2025-10-24T19:42:21.142848] [DEBUG] [LOCAL     ] LNC: Saving primary data.
[2025-10-24T19:42:21.204506] [FATAL] [LOCAL     ] LNC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:42:21.206023] [INFO ] [MAIN      ] LOAR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:42:21.206899] [FATAL] [MAIN      ] LNC: Failed to save primary data.
[2025-10-24T19:42:21.233307] [WARN ] [MAIN      ] LNC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:42:21.307028] [INFO ] [LOCAL     ] LNC: Starting deletion of primary data.
[2025-10-24T19:42:21.355985] [DEBUG] [LOCAL     ] LNC: No primary data file found to delete.
[2025-10-24T19:42:21.367908] [INFO ] [LOCAL     ] LNC: Starting deletion of derivative data.
[2025-10-24T19:42:21.378866] [DEBUG] [LOCAL     ] LNC: Deleted derivative data file.
[2025-10-24T19:42:21.389690] [INFO ] [MAIN      ] Update Progress: 1263/2366 symbols completed. LNC took 39.4s. Estimated remaining: 2h 21m 45s. Rate: 7.8 symbols/min
[2025-10-24T19:42:21.561482] [INFO ] [REMOTE    ] LNN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:42:21.581545] [INFO ] [REMOTE    ] LNN: Fetching primary data for 2025-01.
[2025-10-24T19:42:21.703885] [DEBUG] [LOCAL     ] LOAR: Loaded 42355 existing records from primary storage.
[2025-10-24T19:42:21.717898] [INFO ] [MAIN      ] LOB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:42:21.731621] [INFO ] [MAIN      ] LOAR: Loaded 42355 existing records.
[2025-10-24T19:42:21.760633] [INFO ] [REMOTE    ] LNG: Incremental fetch complete for 2025-01 (2.41 seconds).
[2025-10-24T19:42:21.866421] [INFO ] [REMOTE    ] LNG: Fetching primary data for 2025-02.
[2025-10-24T19:42:21.955068] [DEBUG] [LOCAL     ] LOB: Loaded 26868 existing records from primary storage.
[2025-10-24T19:42:21.960931] [WARN ] [MAIN      ] LOAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:42:21.961904] [INFO ] [MAIN      ] LOB: Loaded 26868 existing records.
[2025-10-24T19:42:21.961978] [INFO ] [MAIN      ] LOAR: Wiping existing primary data before full refresh.
[2025-10-24T19:42:21.995297] [INFO ] [LOCAL     ] LOAR: Starting deletion of primary data.
[2025-10-24T19:42:22.038207] [DEBUG] [LOCAL     ] LOAR: Deleted primary data file.
[2025-10-24T19:42:22.043411] [INFO ] [MAIN      ] LOAR: Starting full primary refresh.
[2025-10-24T19:42:22.255957] [WARN ] [MAIN      ] LOB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:42:22.266472] [INFO ] [MAIN      ] LOB: Wiping existing primary data before full refresh.
[2025-10-24T19:42:22.300046] [INFO ] [LOCAL     ] LOB: Starting deletion of primary data.
[2025-10-24T19:42:22.369800] [DEBUG] [LOCAL     ] LOB: Deleted primary data file.
[2025-10-24T19:42:22.369958] [INFO ] [MAIN      ] LOB: Starting full primary refresh.
[2025-10-24T19:42:22.635627] [INFO ] [REMOTE    ] LOAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:42:22.624304] [INFO ] [REMOTE    ] LNN: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T19:42:22.636037] [INFO ] [REMOTE    ] LOAR: Fetching primary data for 2025-01.
[2025-10-24T19:42:22.645050] [INFO ] [REMOTE    ] LNN: Fetching primary data for 2025-02.
[2025-10-24T19:42:22.886473] [INFO ] [REMOTE    ] LOB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:42:23.347624] [INFO ] [REMOTE    ] LOB: Fetching primary data for 2025-01.
[2025-10-24T19:42:23.504603] [INFO ] [REMOTE    ] LNN: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T19:42:23.757936] [INFO ] [REMOTE    ] LNG: Incremental fetch complete for 2025-02 (1.89 seconds).
[2025-10-24T19:42:23.873054] [INFO ] [REMOTE    ] LOAR: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T19:42:24.147717] [INFO ] [REMOTE    ] LNN: Fetching primary data for 2025-03.
[2025-10-24T19:42:24.383889] [INFO ] [REMOTE    ] LOB: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T19:42:24.932943] [INFO ] [REMOTE    ] LNN: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T19:42:24.947598] [INFO ] [REMOTE    ] LNN: Fetching primary data for 2025-04.
[2025-10-24T19:42:25.747606] [INFO ] [REMOTE    ] LNG: Fetching primary data for 2025-03.
[2025-10-24T19:42:25.897038] [INFO ] [REMOTE    ] LNN: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T19:42:26.547640] [INFO ] [REMOTE    ] LOAR: Fetching primary data for 2025-02.
[2025-10-24T19:42:27.294663] [INFO ] [REMOTE    ] LNG: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T19:42:27.347618] [INFO ] [REMOTE    ] LOB: Fetching primary data for 2025-02.
[2025-10-24T19:42:27.778159] [INFO ] [REMOTE    ] LOAR: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T19:42:28.147738] [INFO ] [REMOTE    ] LOAR: Fetching primary data for 2025-03.
[2025-10-24T19:42:28.404800] [INFO ] [REMOTE    ] LOB: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T19:42:28.947688] [INFO ] [REMOTE    ] LNN: Fetching primary data for 2025-05.
[2025-10-24T19:42:29.473175] [INFO ] [REMOTE    ] LOAR: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T19:42:29.738410] [INFO ] [REMOTE    ] LNN: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T19:42:29.747591] [INFO ] [REMOTE    ] LNN: Fetching primary data for 2025-06.
[2025-10-24T19:42:30.547618] [INFO ] [REMOTE    ] LNG: Fetching primary data for 2025-04.
[2025-10-24T19:42:30.613262] [INFO ] [REMOTE    ] LNN: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T19:42:31.347683] [INFO ] [REMOTE    ] LOAR: Fetching primary data for 2025-04.
[2025-10-24T19:42:32.147718] [INFO ] [REMOTE    ] LOB: Fetching primary data for 2025-03.
[2025-10-24T19:42:32.293854] [INFO ] [REMOTE    ] LNG: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T19:42:32.362950] [INFO ] [REMOTE    ] LOAR: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T19:42:32.858217] [INFO ] [REMOTE    ] LOB: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T19:42:32.947720] [INFO ] [REMOTE    ] LOAR: Fetching primary data for 2025-05.
[2025-10-24T19:42:33.747714] [INFO ] [REMOTE    ] LNN: Fetching primary data for 2025-07.
[2025-10-24T19:42:34.477356] [INFO ] [REMOTE    ] LOAR: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T19:42:34.547600] [INFO ] [REMOTE    ] LOB: Fetching primary data for 2025-04.
[2025-10-24T19:42:34.699034] [INFO ] [REMOTE    ] LNN: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T19:42:35.347717] [INFO ] [REMOTE    ] LNG: Fetching primary data for 2025-05.
[2025-10-24T19:42:35.880908] [INFO ] [REMOTE    ] LOB: Incremental fetch complete for 2025-04 (1.33 seconds).
[2025-10-24T19:42:36.147638] [INFO ] [REMOTE    ] LOB: Fetching primary data for 2025-05.
[2025-10-24T19:42:36.947615] [INFO ] [REMOTE    ] LOAR: Fetching primary data for 2025-06.
[2025-10-24T19:42:37.139333] [INFO ] [REMOTE    ] LNG: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T19:42:37.309441] [INFO ] [REMOTE    ] LOB: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T19:42:37.747726] [INFO ] [REMOTE    ] LOB: Fetching primary data for 2025-06.
[2025-10-24T19:42:38.415135] [INFO ] [REMOTE    ] LOAR: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T19:42:38.547615] [INFO ] [REMOTE    ] LOAR: Fetching primary data for 2025-07.
[2025-10-24T19:42:38.567578] [INFO ] [REMOTE    ] LOB: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T19:42:39.347679] [INFO ] [REMOTE    ] LOB: Fetching primary data for 2025-07.
[2025-10-24T19:42:39.901373] [INFO ] [REMOTE    ] LOAR: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T19:42:40.147707] [INFO ] [REMOTE    ] LNG: Fetching primary data for 2025-06.
[2025-10-24T19:42:40.604364] [INFO ] [REMOTE    ] LOB: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T19:42:40.947720] [INFO ] [REMOTE    ] LOB: Fetching primary data for 2025-08.
[2025-10-24T19:42:41.747620] [INFO ] [REMOTE    ] LNN: Fetching primary data for 2025-08.
[2025-10-24T19:42:41.805462] [INFO ] [REMOTE    ] LNG: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T19:42:41.992598] [INFO ] [REMOTE    ] LOB: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T19:42:42.164898] [INFO ] [REMOTE    ] LNN: Incremental fetch complete for 2025-08 (0.42 seconds).
[2025-10-24T19:42:42.547717] [INFO ] [REMOTE    ] LNG: Fetching primary data for 2025-07.
[2025-10-24T19:42:43.347680] [INFO ] [REMOTE    ] LNN: Fetching primary data for 2025-09.
[2025-10-24T19:42:44.132623] [INFO ] [REMOTE    ] LNN: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T19:42:44.147608] [INFO ] [REMOTE    ] LNN: Fetching primary data for 2025-10.
[2025-10-24T19:42:44.527682] [INFO ] [REMOTE    ] LNG: Incremental fetch complete for 2025-07 (1.98 seconds).
[2025-10-24T19:42:44.947679] [INFO ] [REMOTE    ] LNG: Fetching primary data for 2025-08.
[2025-10-24T19:42:45.190108] [INFO ] [REMOTE    ] LNN: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T19:42:45.193208] [INFO ] [REMOTE    ] LNN: Full fetch complete (16294 records).
[2025-10-24T19:42:45.193293] [DEBUG] [VALIDATOR ] LNN: Validating primary data.
[2025-10-24T19:42:45.563377] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present.
[2025-10-24T19:42:45.563454] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed.
[2025-10-24T19:42:45.563806] [INFO ] [MAIN      ] LNN: Fetched primary data is valid.
[2025-10-24T19:42:45.563867] [DEBUG] [LOCAL     ] LNN: Saving primary data.
[2025-10-24T19:42:45.564100] [FATAL] [LOCAL     ] LNN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:42:45.564179] [FATAL] [MAIN      ] LNN: Failed to save primary data.
[2025-10-24T19:42:45.564226] [WARN ] [MAIN      ] LNN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:42:45.564261] [INFO ] [LOCAL     ] LNN: Starting deletion of primary data.
[2025-10-24T19:42:45.564308] [DEBUG] [LOCAL     ] LNN: No primary data file found to delete.
[2025-10-24T19:42:45.564343] [INFO ] [LOCAL     ] LNN: Starting deletion of derivative data.
[2025-10-24T19:42:45.564484] [DEBUG] [LOCAL     ] LNN: Deleted derivative data file.
[2025-10-24T19:42:45.564554] [INFO ] [MAIN      ] Update Progress: 1264/2366 symbols completed. LNN took 25.7s. Estimated remaining: 2h 21m 51s. Rate: 7.8 symbols/min
[2025-10-24T19:42:45.734039] [INFO ] [MAIN      ] LOCL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:42:45.740117] [DEBUG] [LOCAL     ] LOCL: Loaded 3523 existing records from primary storage.
[2025-10-24T19:42:45.740283] [INFO ] [MAIN      ] LOCL: Loaded 3523 existing records.
[2025-10-24T19:42:45.747747] [INFO ] [REMOTE    ] LOB: Fetching primary data for 2025-09.
[2025-10-24T19:42:45.917141] [WARN ] [MAIN      ] LOCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:42:45.917370] [INFO ] [MAIN      ] LOCL: Wiping existing primary data before full refresh.
[2025-10-24T19:42:45.917417] [INFO ] [LOCAL     ] LOCL: Starting deletion of primary data.
[2025-10-24T19:42:45.917554] [DEBUG] [LOCAL     ] LOCL: Deleted primary data file.
[2025-10-24T19:42:45.917590] [INFO ] [MAIN      ] LOCL: Starting full primary refresh.
[2025-10-24T19:42:46.266923] [INFO ] [REMOTE    ] LOCL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:42:46.547626] [INFO ] [REMOTE    ] LOAR: Fetching primary data for 2025-08.
[2025-10-24T19:42:46.688627] [INFO ] [REMOTE    ] LNG: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T19:42:46.958025] [INFO ] [REMOTE    ] LOB: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T19:42:47.347741] [INFO ] [REMOTE    ] LNG: Fetching primary data for 2025-09.
[2025-10-24T19:42:48.079205] [INFO ] [REMOTE    ] LOAR: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T19:42:48.147609] [INFO ] [REMOTE    ] LOAR: Fetching primary data for 2025-09.
[2025-10-24T19:42:48.947753] [INFO ] [REMOTE    ] LOB: Fetching primary data for 2025-10.
[2025-10-24T19:42:49.192576] [INFO ] [REMOTE    ] LNG: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T19:42:49.628565] [INFO ] [REMOTE    ] LOAR: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T19:42:49.747618] [INFO ] [REMOTE    ] LOAR: Fetching primary data for 2025-10.
[2025-10-24T19:42:50.130822] [INFO ] [REMOTE    ] LOB: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T19:42:50.136004] [INFO ] [REMOTE    ] LOB: Full fetch complete (38768 records).
[2025-10-24T19:42:50.136146] [DEBUG] [VALIDATOR ] LOB: Validating primary data.
[2025-10-24T19:42:50.512600] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present.
[2025-10-24T19:42:50.512924] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed.
[2025-10-24T19:42:50.513687] [INFO ] [MAIN      ] LOB: Fetched primary data is valid.
[2025-10-24T19:42:50.513749] [DEBUG] [LOCAL     ] LOB: Saving primary data.
[2025-10-24T19:42:50.514135] [FATAL] [LOCAL     ] LOB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:42:50.514270] [FATAL] [MAIN      ] LOB: Failed to save primary data.
[2025-10-24T19:42:50.514353] [WARN ] [MAIN      ] LOB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:42:50.514440] [INFO ] [LOCAL     ] LOB: Starting deletion of primary data.
[2025-10-24T19:42:50.514556] [DEBUG] [LOCAL     ] LOB: No primary data file found to delete.
[2025-10-24T19:42:50.514615] [INFO ] [LOCAL     ] LOB: Starting deletion of derivative data.
[2025-10-24T19:42:50.515309] [DEBUG] [LOCAL     ] LOB: Deleted derivative data file.
[2025-10-24T19:42:50.515406] [INFO ] [MAIN      ] Update Progress: 1265/2366 symbols completed. LOB took 29.1s. Estimated remaining: 2h 21m 41s. Rate: 7.8 symbols/min
[2025-10-24T19:42:50.552836] [INFO ] [REMOTE    ] LNG: Fetching primary data for 2025-10.
[2025-10-24T19:42:50.686521] [INFO ] [MAIN      ] LOMA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:42:50.719514] [DEBUG] [LOCAL     ] LOMA: Loaded 33036 existing records from primary storage.
[2025-10-24T19:42:50.719795] [INFO ] [MAIN      ] LOMA: Loaded 33036 existing records.
[2025-10-24T19:42:50.896565] [WARN ] [MAIN      ] LOMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:42:50.896796] [INFO ] [MAIN      ] LOMA: Wiping existing primary data before full refresh.
[2025-10-24T19:42:50.896845] [INFO ] [LOCAL     ] LOMA: Starting deletion of primary data.
[2025-10-24T19:42:50.897026] [DEBUG] [LOCAL     ] LOMA: Deleted primary data file.
[2025-10-24T19:42:50.897065] [INFO ] [MAIN      ] LOMA: Starting full primary refresh.
[2025-10-24T19:42:51.253235] [INFO ] [REMOTE    ] LOMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:42:51.308832] [INFO ] [REMOTE    ] LOAR: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T19:42:51.315745] [INFO ] [REMOTE    ] LOAR: Full fetch complete (56051 records).
[2025-10-24T19:42:51.315861] [DEBUG] [VALIDATOR ] LOAR: Validating primary data.
[2025-10-24T19:42:51.352779] [INFO ] [REMOTE    ] LOMA: Fetching primary data for 2025-01.
[2025-10-24T19:42:51.700047] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present.
[2025-10-24T19:42:51.700127] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed.
[2025-10-24T19:42:51.701078] [INFO ] [MAIN      ] LOAR: Fetched primary data is valid.
[2025-10-24T19:42:51.701140] [DEBUG] [LOCAL     ] LOAR: Saving primary data.
[2025-10-24T19:42:51.701605] [FATAL] [LOCAL     ] LOAR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:42:51.701710] [FATAL] [MAIN      ] LOAR: Failed to save primary data.
[2025-10-24T19:42:51.701752] [WARN ] [MAIN      ] LOAR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:42:51.701786] [INFO ] [LOCAL     ] LOAR: Starting deletion of primary data.
[2025-10-24T19:42:51.701836] [DEBUG] [LOCAL     ] LOAR: No primary data file found to delete.
[2025-10-24T19:42:51.701870] [INFO ] [LOCAL     ] LOAR: Starting deletion of derivative data.
[2025-10-24T19:42:51.702020] [DEBUG] [LOCAL     ] LOAR: Deleted derivative data file.
[2025-10-24T19:42:51.702569] [INFO ] [MAIN      ] Update Progress: 1266/2366 symbols completed. LOAR took 30.8s. Estimated remaining: 2h 21m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:42:51.874409] [INFO ] [MAIN      ] LOW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:42:51.927790] [DEBUG] [LOCAL     ] LOW: Loaded 53351 existing records from primary storage.
[2025-10-24T19:42:51.928116] [INFO ] [MAIN      ] LOW: Loaded 53351 existing records.
[2025-10-24T19:42:52.103335] [WARN ] [MAIN      ] LOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:42:52.103552] [INFO ] [MAIN      ] LOW: Wiping existing primary data before full refresh.
[2025-10-24T19:42:52.103598] [INFO ] [LOCAL     ] LOW: Starting deletion of primary data.
[2025-10-24T19:42:52.104137] [DEBUG] [LOCAL     ] LOW: Deleted primary data file.
[2025-10-24T19:42:52.104191] [INFO ] [MAIN      ] LOW: Starting full primary refresh.
[2025-10-24T19:42:52.153677] [INFO ] [REMOTE    ] LOCL: Fetching primary data for 2025-01.
[2025-10-24T19:42:52.460146] [INFO ] [REMOTE    ] LOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:42:52.673991] [INFO ] [REMOTE    ] LOCL: Incremental fetch complete for 2025-01 (0.52 seconds).
[2025-10-24T19:42:52.724208] [INFO ] [REMOTE    ] LOMA: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T19:42:52.820145] [INFO ] [REMOTE    ] LNG: Incremental fetch complete for 2025-10 (2.27 seconds).
[2025-10-24T19:42:52.829193] [INFO ] [REMOTE    ] LNG: Full fetch complete (74682 records).
[2025-10-24T19:42:52.829380] [DEBUG] [VALIDATOR ] LNG: Validating primary data.
[2025-10-24T19:42:52.952779] [INFO ] [REMOTE    ] LOCL: Fetching primary data for 2025-02.
[2025-10-24T19:42:53.224132] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present.
[2025-10-24T19:42:53.224216] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed.
[2025-10-24T19:42:53.225254] [INFO ] [MAIN      ] LNG: Fetched primary data is valid.
[2025-10-24T19:42:53.225336] [DEBUG] [LOCAL     ] LNG: Saving primary data.
[2025-10-24T19:42:53.225917] [FATAL] [LOCAL     ] LNG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:42:53.226006] [FATAL] [MAIN      ] LNG: Failed to save primary data.
[2025-10-24T19:42:53.226048] [WARN ] [MAIN      ] LNG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:42:53.226083] [INFO ] [LOCAL     ] LNG: Starting deletion of primary data.
[2025-10-24T19:42:53.226133] [DEBUG] [LOCAL     ] LNG: No primary data file found to delete.
[2025-10-24T19:42:53.226172] [INFO ] [LOCAL     ] LNG: Starting deletion of derivative data.
[2025-10-24T19:42:53.226316] [DEBUG] [LOCAL     ] LNG: Deleted derivative data file.
[2025-10-24T19:42:53.226583] [INFO ] [MAIN      ] Update Progress: 1267/2366 symbols completed. LNG took 35.2s. Estimated remaining: 2h 21m 15s. Rate: 7.8 symbols/min
[2025-10-24T19:42:53.394819] [INFO ] [MAIN      ] LPG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:42:53.397082] [INFO ] [REMOTE    ] LOCL: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T19:42:53.436083] [DEBUG] [LOCAL     ] LPG: Loaded 39472 existing records from primary storage.
[2025-10-24T19:42:53.436357] [INFO ] [MAIN      ] LPG: Loaded 39472 existing records.
[2025-10-24T19:42:53.613505] [WARN ] [MAIN      ] LPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:42:53.613722] [INFO ] [MAIN      ] LPG: Wiping existing primary data before full refresh.
[2025-10-24T19:42:53.613775] [INFO ] [LOCAL     ] LPG: Starting deletion of primary data.
[2025-10-24T19:42:53.614108] [DEBUG] [LOCAL     ] LPG: Deleted primary data file.
[2025-10-24T19:42:53.614145] [INFO ] [MAIN      ] LPG: Starting full primary refresh.
[2025-10-24T19:42:53.752848] [INFO ] [REMOTE    ] LOMA: Fetching primary data for 2025-02.
[2025-10-24T19:42:53.964775] [INFO ] [REMOTE    ] LPG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:42:54.547719] [INFO ] [REMOTE    ] LOCL: Fetching primary data for 2025-03.
[2025-10-24T19:42:54.996476] [INFO ] [REMOTE    ] LOCL: Incremental fetch complete for 2025-03 (0.45 seconds).
[2025-10-24T19:42:55.001445] [INFO ] [REMOTE    ] LOMA: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T19:42:55.347694] [INFO ] [REMOTE    ] LOW: Fetching primary data for 2025-01.
[2025-10-24T19:42:56.147746] [INFO ] [REMOTE    ] LOMA: Fetching primary data for 2025-03.
[2025-10-24T19:42:56.926193] [INFO ] [REMOTE    ] LOW: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T19:42:56.947606] [INFO ] [REMOTE    ] LOW: Fetching primary data for 2025-02.
[2025-10-24T19:42:56.993257] [INFO ] [REMOTE    ] LOMA: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T19:42:57.747726] [INFO ] [REMOTE    ] LOCL: Fetching primary data for 2025-04.
[2025-10-24T19:42:58.526673] [INFO ] [REMOTE    ] LOCL: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T19:42:58.547601] [INFO ] [REMOTE    ] LOCL: Fetching primary data for 2025-05.
[2025-10-24T19:42:58.620083] [INFO ] [REMOTE    ] LOW: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T19:42:58.984932] [INFO ] [REMOTE    ] LOCL: Incremental fetch complete for 2025-05 (0.44 seconds).
[2025-10-24T19:42:59.347724] [INFO ] [REMOTE    ] LPG: Fetching primary data for 2025-01.
[2025-10-24T19:43:00.147688] [INFO ] [REMOTE    ] LOW: Fetching primary data for 2025-03.
[2025-10-24T19:43:00.947732] [INFO ] [REMOTE    ] LOCL: Fetching primary data for 2025-06.
[2025-10-24T19:43:01.712381] [INFO ] [REMOTE    ] LPG: Incremental fetch complete for 2025-01 (2.36 seconds).
[2025-10-24T19:43:01.747730] [INFO ] [REMOTE    ] LPG: Fetching primary data for 2025-02.
[2025-10-24T19:43:01.790128] [INFO ] [REMOTE    ] LOCL: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T19:43:02.547697] [INFO ] [REMOTE    ] LOCL: Fetching primary data for 2025-07.
[2025-10-24T19:43:02.778326] [INFO ] [REMOTE    ] LOW: Incremental fetch complete for 2025-03 (2.63 seconds).
[2025-10-24T19:43:03.347705] [INFO ] [REMOTE    ] LOW: Fetching primary data for 2025-04.
[2025-10-24T19:43:04.147719] [INFO ] [REMOTE    ] LOMA: Fetching primary data for 2025-04.
[2025-10-24T19:43:04.197866] [INFO ] [REMOTE    ] LOCL: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T19:43:04.899734] [INFO ] [REMOTE    ] LPG: Incremental fetch complete for 2025-02 (3.15 seconds).
[2025-10-24T19:43:04.947734] [INFO ] [REMOTE    ] LPG: Fetching primary data for 2025-03.
[2025-10-24T19:43:05.747757] [INFO ] [REMOTE    ] LOCL: Fetching primary data for 2025-08.
[2025-10-24T19:43:06.100415] [INFO ] [REMOTE    ] LOW: Incremental fetch complete for 2025-04 (2.75 seconds).
[2025-10-24T19:43:06.291078] [INFO ] [REMOTE    ] LOMA: Incremental fetch complete for 2025-04 (2.14 seconds).
[2025-10-24T19:43:06.303351] [INFO ] [REMOTE    ] LOCL: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T19:43:06.547740] [INFO ] [REMOTE    ] LOCL: Fetching primary data for 2025-09.
[2025-10-24T19:43:06.689351] [INFO ] [REMOTE    ] LPG: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T19:43:07.165340] [INFO ] [REMOTE    ] LOCL: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T19:43:07.347726] [INFO ] [REMOTE    ] LOMA: Fetching primary data for 2025-05.
[2025-10-24T19:43:08.147689] [INFO ] [REMOTE    ] LOCL: Fetching primary data for 2025-10.
[2025-10-24T19:43:08.594717] [INFO ] [REMOTE    ] LOMA: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T19:43:08.725486] [INFO ] [REMOTE    ] LOCL: Incremental fetch complete for 2025-10 (0.58 seconds).
[2025-10-24T19:43:08.726634] [INFO ] [REMOTE    ] LOCL: Full fetch complete (4535 records).
[2025-10-24T19:43:08.726726] [DEBUG] [VALIDATOR ] LOCL: Validating primary data.
[2025-10-24T19:43:08.952865] [INFO ] [REMOTE    ] LOW: Fetching primary data for 2025-05.
[2025-10-24T19:43:09.088417] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present.
[2025-10-24T19:43:09.088503] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed.
[2025-10-24T19:43:09.088667] [INFO ] [MAIN      ] LOCL: Fetched primary data is valid.
[2025-10-24T19:43:09.088730] [DEBUG] [LOCAL     ] LOCL: Saving primary data.
[2025-10-24T19:43:09.088922] [FATAL] [LOCAL     ] LOCL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:43:09.089002] [FATAL] [MAIN      ] LOCL: Failed to save primary data.
[2025-10-24T19:43:09.089045] [WARN ] [MAIN      ] LOCL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:43:09.089080] [INFO ] [LOCAL     ] LOCL: Starting deletion of primary data.
[2025-10-24T19:43:09.089130] [DEBUG] [LOCAL     ] LOCL: No primary data file found to delete.
[2025-10-24T19:43:09.089165] [INFO ] [LOCAL     ] LOCL: Starting deletion of derivative data.
[2025-10-24T19:43:09.089302] [DEBUG] [LOCAL     ] LOCL: Deleted derivative data file.
[2025-10-24T19:43:09.089382] [INFO ] [MAIN      ] Update Progress: 1268/2366 symbols completed. LOCL took 23.5s. Estimated remaining: 2h 21m 14s. Rate: 7.8 symbols/min
[2025-10-24T19:43:09.258901] [INFO ] [MAIN      ] LPL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:43:09.288870] [DEBUG] [LOCAL     ] LPL: Loaded 29271 existing records from primary storage.
[2025-10-24T19:43:09.289150] [INFO ] [MAIN      ] LPL: Loaded 29271 existing records.
[2025-10-24T19:43:09.465955] [WARN ] [MAIN      ] LPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:43:09.466168] [INFO ] [MAIN      ] LPL: Wiping existing primary data before full refresh.
[2025-10-24T19:43:09.466214] [INFO ] [LOCAL     ] LPL: Starting deletion of primary data.
[2025-10-24T19:43:09.466610] [DEBUG] [LOCAL     ] LPL: Deleted primary data file.
[2025-10-24T19:43:09.466737] [INFO ] [MAIN      ] LPL: Starting full primary refresh.
[2025-10-24T19:43:09.752869] [INFO ] [REMOTE    ] LOMA: Fetching primary data for 2025-06.
[2025-10-24T19:43:09.822453] [INFO ] [REMOTE    ] LPL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:43:10.547759] [INFO ] [REMOTE    ] LPL: Fetching primary data for 2025-01.
[2025-10-24T19:43:10.838445] [INFO ] [REMOTE    ] LOW: Incremental fetch complete for 2025-05 (1.89 seconds).
[2025-10-24T19:43:10.960225] [INFO ] [REMOTE    ] LOMA: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T19:43:11.243289] [INFO ] [REMOTE    ] LPL: Incremental fetch complete for 2025-01 (0.70 seconds).
[2025-10-24T19:43:11.347698] [INFO ] [REMOTE    ] LOW: Fetching primary data for 2025-06.
[2025-10-24T19:43:12.147725] [INFO ] [REMOTE    ] LPL: Fetching primary data for 2025-02.
[2025-10-24T19:43:12.947628] [INFO ] [REMOTE    ] LPG: Fetching primary data for 2025-04.
[2025-10-24T19:43:13.146269] [INFO ] [REMOTE    ] LOW: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T19:43:13.147182] [INFO ] [REMOTE    ] LPL: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T19:43:13.747628] [INFO ] [REMOTE    ] LPL: Fetching primary data for 2025-03.
[2025-10-24T19:43:14.442008] [INFO ] [REMOTE    ] LPG: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T19:43:14.547607] [INFO ] [REMOTE    ] LPG: Fetching primary data for 2025-05.
[2025-10-24T19:43:14.724216] [INFO ] [REMOTE    ] LPL: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T19:43:15.347667] [INFO ] [REMOTE    ] LPL: Fetching primary data for 2025-04.
[2025-10-24T19:43:15.991725] [INFO ] [REMOTE    ] LPG: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T19:43:16.075235] [INFO ] [REMOTE    ] LPL: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T19:43:16.147599] [INFO ] [REMOTE    ] LPL: Fetching primary data for 2025-05.
[2025-10-24T19:43:16.947619] [INFO ] [REMOTE    ] LOMA: Fetching primary data for 2025-07.
[2025-10-24T19:43:17.156588] [INFO ] [REMOTE    ] LPL: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T19:43:17.747636] [INFO ] [REMOTE    ] LPG: Fetching primary data for 2025-06.
[2025-10-24T19:43:18.093629] [INFO ] [REMOTE    ] LOMA: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T19:43:18.547686] [INFO ] [REMOTE    ] LOMA: Fetching primary data for 2025-08.
[2025-10-24T19:43:19.149175] [INFO ] [REMOTE    ] LPG: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T19:43:19.347618] [INFO ] [REMOTE    ] LPG: Fetching primary data for 2025-07.
[2025-10-24T19:43:19.903767] [INFO ] [REMOTE    ] LOMA: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T19:43:20.147634] [INFO ] [REMOTE    ] LPL: Fetching primary data for 2025-06.
[2025-10-24T19:43:20.714823] [INFO ] [REMOTE    ] LPG: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T19:43:20.768174] [INFO ] [REMOTE    ] LPL: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T19:43:20.947613] [INFO ] [REMOTE    ] LPG: Fetching primary data for 2025-08.
[2025-10-24T19:43:21.747671] [INFO ] [REMOTE    ] LPL: Fetching primary data for 2025-07.
[2025-10-24T19:43:22.406028] [INFO ] [REMOTE    ] LPG: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T19:43:22.547617] [INFO ] [REMOTE    ] LPG: Fetching primary data for 2025-09.
[2025-10-24T19:43:22.846394] [INFO ] [REMOTE    ] LPL: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T19:43:23.347674] [INFO ] [REMOTE    ] LPL: Fetching primary data for 2025-08.
[2025-10-24T19:43:24.035290] [INFO ] [REMOTE    ] LPG: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T19:43:24.147600] [INFO ] [REMOTE    ] LPG: Fetching primary data for 2025-10.
[2025-10-24T19:43:24.738423] [INFO ] [REMOTE    ] LPL: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T19:43:24.947708] [INFO ] [REMOTE    ] LPL: Fetching primary data for 2025-09.
[2025-10-24T19:43:25.725370] [INFO ] [REMOTE    ] LPG: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T19:43:25.731845] [INFO ] [REMOTE    ] LPG: Full fetch complete (58685 records).
[2025-10-24T19:43:25.731960] [DEBUG] [VALIDATOR ] LPG: Validating primary data.
[2025-10-24T19:43:25.753677] [INFO ] [REMOTE    ] LOW: Fetching primary data for 2025-07.
[2025-10-24T19:43:26.130917] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present.
[2025-10-24T19:43:26.131059] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed.
[2025-10-24T19:43:26.132204] [INFO ] [MAIN      ] LPG: Fetched primary data is valid.
[2025-10-24T19:43:26.132283] [DEBUG] [LOCAL     ] LPG: Saving primary data.
[2025-10-24T19:43:26.132925] [FATAL] [LOCAL     ] LPG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:43:26.133030] [FATAL] [MAIN      ] LPG: Failed to save primary data.
[2025-10-24T19:43:26.133072] [WARN ] [MAIN      ] LPG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:43:26.133108] [INFO ] [LOCAL     ] LPG: Starting deletion of primary data.
[2025-10-24T19:43:26.133163] [DEBUG] [LOCAL     ] LPG: No primary data file found to delete.
[2025-10-24T19:43:26.133200] [INFO ] [LOCAL     ] LPG: Starting deletion of derivative data.
[2025-10-24T19:43:26.133331] [DEBUG] [LOCAL     ] LPG: Deleted derivative data file.
[2025-10-24T19:43:26.133743] [INFO ] [MAIN      ] Update Progress: 1269/2366 symbols completed. LPG took 32.9s. Estimated remaining: 2h 21m 15s. Rate: 7.8 symbols/min
[2025-10-24T19:43:26.311525] [INFO ] [MAIN      ] LPX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:43:26.343415] [INFO ] [REMOTE    ] LPL: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T19:43:26.391547] [DEBUG] [LOCAL     ] LPX: Loaded 40357 existing records from primary storage.
[2025-10-24T19:43:26.391895] [INFO ] [MAIN      ] LPX: Loaded 40357 existing records.
[2025-10-24T19:43:26.548422] [INFO ] [REMOTE    ] LOMA: Fetching primary data for 2025-09.
[2025-10-24T19:43:26.571186] [WARN ] [MAIN      ] LPX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:43:26.571762] [INFO ] [MAIN      ] LPX: Wiping existing primary data before full refresh.
[2025-10-24T19:43:26.572737] [INFO ] [LOCAL     ] LPX: Starting deletion of primary data.
[2025-10-24T19:43:26.573151] [DEBUG] [LOCAL     ] LPX: Deleted primary data file.
[2025-10-24T19:43:26.573211] [INFO ] [MAIN      ] LPX: Starting full primary refresh.
[2025-10-24T19:43:26.945764] [INFO ] [REMOTE    ] LPX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:43:27.347637] [INFO ] [REMOTE    ] LPL: Fetching primary data for 2025-10.
[2025-10-24T19:43:27.750486] [INFO ] [REMOTE    ] LOW: Incremental fetch complete for 2025-07 (2.00 seconds).
[2025-10-24T19:43:28.068218] [INFO ] [REMOTE    ] LOMA: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T19:43:28.147636] [INFO ] [REMOTE    ] LOMA: Fetching primary data for 2025-10.
[2025-10-24T19:43:28.931793] [INFO ] [REMOTE    ] LPL: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T19:43:28.939275] [INFO ] [REMOTE    ] LPL: Full fetch complete (37852 records).
[2025-10-24T19:43:28.939384] [DEBUG] [VALIDATOR ] LPL: Validating primary data.
[2025-10-24T19:43:28.952871] [INFO ] [REMOTE    ] LOW: Fetching primary data for 2025-08.
[2025-10-24T19:43:29.318713] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present.
[2025-10-24T19:43:29.318796] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed.
[2025-10-24T19:43:29.319622] [INFO ] [MAIN      ] LPL: Fetched primary data is valid.
[2025-10-24T19:43:29.319697] [DEBUG] [LOCAL     ] LPL: Saving primary data.
[2025-10-24T19:43:29.320100] [FATAL] [LOCAL     ] LPL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:43:29.320174] [FATAL] [MAIN      ] LPL: Failed to save primary data.
[2025-10-24T19:43:29.320211] [WARN ] [MAIN      ] LPL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:43:29.320245] [INFO ] [LOCAL     ] LPL: Starting deletion of primary data.
[2025-10-24T19:43:29.320296] [DEBUG] [LOCAL     ] LPL: No primary data file found to delete.
[2025-10-24T19:43:29.320332] [INFO ] [LOCAL     ] LPL: Starting deletion of derivative data.
[2025-10-24T19:43:29.320453] [DEBUG] [LOCAL     ] LPL: Deleted derivative data file.
[2025-10-24T19:43:29.320528] [INFO ] [MAIN      ] Update Progress: 1270/2366 symbols completed. LPL took 20.2s. Estimated remaining: 2h 21m 3s. Rate: 7.8 symbols/min
[2025-10-24T19:43:29.496515] [INFO ] [MAIN      ] LRN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:43:29.538264] [INFO ] [REMOTE    ] LOMA: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T19:43:29.556839] [INFO ] [REMOTE    ] LOMA: Full fetch complete (47850 records).
[2025-10-24T19:43:29.557010] [DEBUG] [VALIDATOR ] LOMA: Validating primary data.
[2025-10-24T19:43:29.557673] [DEBUG] [LOCAL     ] LRN: Loaded 39569 existing records from primary storage.
[2025-10-24T19:43:29.558172] [INFO ] [MAIN      ] LRN: Loaded 39569 existing records.
[2025-10-24T19:43:29.751565] [INFO ] [REMOTE    ] LPX: Fetching primary data for 2025-01.
[2025-10-24T19:43:29.936437] [WARN ] [MAIN      ] LRN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:43:29.966329] [INFO ] [MAIN      ] LRN: Wiping existing primary data before full refresh.
[2025-10-24T19:43:29.999607] [INFO ] [LOCAL     ] LRN: Starting deletion of primary data.
[2025-10-24T19:43:30.037479] [DEBUG] [LOCAL     ] LRN: Deleted primary data file.
[2025-10-24T19:43:30.048908] [INFO ] [MAIN      ] LRN: Starting full primary refresh.
[2025-10-24T19:43:30.303846] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present.
[2025-10-24T19:43:30.322906] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed.
[2025-10-24T19:43:30.324790] [INFO ] [MAIN      ] LOMA: Fetched primary data is valid.
[2025-10-24T19:43:30.325491] [DEBUG] [LOCAL     ] LOMA: Saving primary data.
[2025-10-24T19:43:30.342777] [FATAL] [LOCAL     ] LOMA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:43:30.378721] [FATAL] [MAIN      ] LOMA: Failed to save primary data.
[2025-10-24T19:43:30.411399] [WARN ] [MAIN      ] LOMA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:43:30.411491] [INFO ] [LOCAL     ] LOMA: Starting deletion of primary data.
[2025-10-24T19:43:30.411592] [DEBUG] [LOCAL     ] LOMA: No primary data file found to delete.
[2025-10-24T19:43:30.417989] [INFO ] [LOCAL     ] LOMA: Starting deletion of derivative data.
[2025-10-24T19:43:30.440174] [DEBUG] [LOCAL     ] LOMA: Deleted derivative data file.
[2025-10-24T19:43:30.450581] [INFO ] [MAIN      ] Update Progress: 1271/2366 symbols completed. LOMA took 39.9s. Estimated remaining: 2h 20m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:43:30.634326] [INFO ] [REMOTE    ] LRN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:43:30.637191] [INFO ] [REMOTE    ] LRN: Fetching primary data for 2025-01.
[2025-10-24T19:43:30.710542] [INFO ] [MAIN      ] LSPD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:43:30.752863] [DEBUG] [LOCAL     ] LSPD: Loaded 42619 existing records from primary storage.
[2025-10-24T19:43:30.753152] [INFO ] [MAIN      ] LSPD: Loaded 42619 existing records.
[2025-10-24T19:43:30.933806] [WARN ] [MAIN      ] LSPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:43:30.934275] [INFO ] [MAIN      ] LSPD: Wiping existing primary data before full refresh.
[2025-10-24T19:43:30.934437] [INFO ] [LOCAL     ] LSPD: Starting deletion of primary data.
[2025-10-24T19:43:30.934956] [DEBUG] [LOCAL     ] LSPD: Deleted primary data file.
[2025-10-24T19:43:30.935013] [INFO ] [MAIN      ] LSPD: Starting full primary refresh.
[2025-10-24T19:43:31.252244] [INFO ] [REMOTE    ] LOW: Incremental fetch complete for 2025-08 (2.30 seconds).
[2025-10-24T19:43:31.343527] [INFO ] [REMOTE    ] LSPD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:43:31.353496] [INFO ] [REMOTE    ] LOW: Fetching primary data for 2025-09.
[2025-10-24T19:43:31.370423] [INFO ] [REMOTE    ] LPX: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T19:43:32.147704] [INFO ] [REMOTE    ] LSPD: Fetching primary data for 2025-01.
[2025-10-24T19:43:32.256612] [DEBUG] [REMOTE    ] LSPD: Error fetching primary data for 2025-01: 'API call returned an empty response.'
[2025-10-24T19:43:32.267352] [WARN ] [REMOTE    ] LSPD: No data returned for month 2025-01
[2025-10-24T19:43:32.267477] [FATAL] [REMOTE    ] LSPD: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:43:32.268061] [FATAL] [MAIN      ] LSPD: Failed to fetch primary data.
[2025-10-24T19:43:32.268956] [WARN ] [MAIN      ] LSPD: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:43:32.268884] [INFO ] [REMOTE    ] LRN: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T19:43:32.269156] [INFO ] [LOCAL     ] LSPD: Starting deletion of primary data.
[2025-10-24T19:43:32.278309] [DEBUG] [LOCAL     ] LSPD: No primary data file found to delete.
[2025-10-24T19:43:32.278378] [INFO ] [LOCAL     ] LSPD: Starting deletion of derivative data.
[2025-10-24T19:43:32.278547] [DEBUG] [LOCAL     ] LSPD: Deleted derivative data file.
[2025-10-24T19:43:32.278673] [INFO ] [MAIN      ] Update Progress: 1272/2366 symbols completed. LSPD took 1.8s. Estimated remaining: 2h 20m 37s. Rate: 7.8 symbols/min
[2025-10-24T19:43:32.450503] [INFO ] [MAIN      ] LTC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:43:32.481679] [DEBUG] [LOCAL     ] LTC: Loaded 30851 existing records from primary storage.
[2025-10-24T19:43:32.481954] [INFO ] [MAIN      ] LTC: Loaded 30851 existing records.
[2025-10-24T19:43:32.665875] [WARN ] [MAIN      ] LTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:43:32.666170] [INFO ] [MAIN      ] LTC: Wiping existing primary data before full refresh.
[2025-10-24T19:43:32.666275] [INFO ] [LOCAL     ] LTC: Starting deletion of primary data.
[2025-10-24T19:43:32.666588] [DEBUG] [LOCAL     ] LTC: Deleted primary data file.
[2025-10-24T19:43:32.666747] [INFO ] [MAIN      ] LTC: Starting full primary refresh.
[2025-10-24T19:43:32.952730] [INFO ] [REMOTE    ] LRN: Fetching primary data for 2025-02.
[2025-10-24T19:43:33.065462] [INFO ] [REMOTE    ] LTC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:43:33.067671] [INFO ] [REMOTE    ] LOW: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T19:43:33.747692] [INFO ] [REMOTE    ] LTC: Fetching primary data for 2025-01.
[2025-10-24T19:43:34.402442] [INFO ] [REMOTE    ] LRN: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T19:43:34.547668] [INFO ] [REMOTE    ] LRN: Fetching primary data for 2025-03.
[2025-10-24T19:43:34.964723] [INFO ] [REMOTE    ] LTC: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T19:43:35.347683] [INFO ] [REMOTE    ] LPX: Fetching primary data for 2025-02.
[2025-10-24T19:43:36.017227] [INFO ] [REMOTE    ] LRN: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T19:43:36.147608] [INFO ] [REMOTE    ] LRN: Fetching primary data for 2025-04.
[2025-10-24T19:43:36.862976] [INFO ] [REMOTE    ] LPX: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T19:43:36.947597] [INFO ] [REMOTE    ] LPX: Fetching primary data for 2025-03.
[2025-10-24T19:43:37.199331] [INFO ] [REMOTE    ] LRN: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T19:43:37.747677] [INFO ] [REMOTE    ] LTC: Fetching primary data for 2025-02.
[2025-10-24T19:43:38.399687] [INFO ] [REMOTE    ] LPX: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T19:43:38.547736] [INFO ] [REMOTE    ] LPX: Fetching primary data for 2025-04.
[2025-10-24T19:43:38.983723] [INFO ] [REMOTE    ] LTC: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T19:43:39.347721] [INFO ] [REMOTE    ] LOW: Fetching primary data for 2025-10.
[2025-10-24T19:43:39.920393] [INFO ] [REMOTE    ] LPX: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T19:43:40.147718] [INFO ] [REMOTE    ] LRN: Fetching primary data for 2025-05.
[2025-10-24T19:43:40.947618] [INFO ] [REMOTE    ] LTC: Fetching primary data for 2025-03.
[2025-10-24T19:43:41.294417] [INFO ] [REMOTE    ] LOW: Incremental fetch complete for 2025-10 (1.95 seconds).
[2025-10-24T19:43:41.303973] [INFO ] [REMOTE    ] LOW: Full fetch complete (76717 records).
[2025-10-24T19:43:41.304113] [DEBUG] [VALIDATOR ] LOW: Validating primary data.
[2025-10-24T19:43:41.702755] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present.
[2025-10-24T19:43:41.702867] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed.
[2025-10-24T19:43:41.703954] [INFO ] [MAIN      ] LOW: Fetched primary data is valid.
[2025-10-24T19:43:41.704043] [DEBUG] [LOCAL     ] LOW: Saving primary data.
[2025-10-24T19:43:41.704834] [FATAL] [LOCAL     ] LOW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:43:41.704923] [FATAL] [MAIN      ] LOW: Failed to save primary data.
[2025-10-24T19:43:41.704966] [WARN ] [MAIN      ] LOW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:43:41.705002] [INFO ] [LOCAL     ] LOW: Starting deletion of primary data.
[2025-10-24T19:43:41.705057] [DEBUG] [LOCAL     ] LOW: No primary data file found to delete.
[2025-10-24T19:43:41.705093] [INFO ] [LOCAL     ] LOW: Starting deletion of derivative data.
[2025-10-24T19:43:41.705203] [DEBUG] [LOCAL     ] LOW: Deleted derivative data file.
[2025-10-24T19:43:41.705717] [INFO ] [MAIN      ] Update Progress: 1273/2366 symbols completed. LOW took 50.0s. Estimated remaining: 2h 20m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:43:41.749570] [INFO ] [REMOTE    ] LPX: Fetching primary data for 2025-05.
[2025-10-24T19:43:41.857439] [INFO ] [REMOTE    ] LRN: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T19:43:41.916471] [INFO ] [MAIN      ] LTH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:43:41.935186] [INFO ] [REMOTE    ] LTC: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T19:43:41.985701] [DEBUG] [LOCAL     ] LTH: Loaded 51990 existing records from primary storage.
[2025-10-24T19:43:41.986014] [INFO ] [MAIN      ] LTH: Loaded 51990 existing records.
[2025-10-24T19:43:42.160961] [WARN ] [MAIN      ] LTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:43:42.161178] [INFO ] [MAIN      ] LTH: Wiping existing primary data before full refresh.
[2025-10-24T19:43:42.161225] [INFO ] [LOCAL     ] LTH: Starting deletion of primary data.
[2025-10-24T19:43:42.161540] [DEBUG] [LOCAL     ] LTH: Deleted primary data file.
[2025-10-24T19:43:42.161597] [INFO ] [MAIN      ] LTH: Starting full primary refresh.
[2025-10-24T19:43:42.510901] [INFO ] [REMOTE    ] LTH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:43:42.547611] [INFO ] [REMOTE    ] LTH: Fetching primary data for 2025-01.
[2025-10-24T19:43:43.269186] [INFO ] [REMOTE    ] LPX: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T19:43:43.347704] [INFO ] [REMOTE    ] LPX: Fetching primary data for 2025-06.
[2025-10-24T19:43:44.093492] [INFO ] [REMOTE    ] LTH: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T19:43:44.147710] [INFO ] [REMOTE    ] LTH: Fetching primary data for 2025-02.
[2025-10-24T19:43:44.651362] [INFO ] [REMOTE    ] LPX: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T19:43:44.947721] [INFO ] [REMOTE    ] LTC: Fetching primary data for 2025-04.
[2025-10-24T19:43:45.650203] [INFO ] [REMOTE    ] LTH: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T19:43:45.747666] [INFO ] [REMOTE    ] LTH: Fetching primary data for 2025-03.
[2025-10-24T19:43:46.194961] [INFO ] [REMOTE    ] LTC: Incremental fetch complete for 2025-04 (1.25 seconds).
[2025-10-24T19:43:46.547623] [INFO ] [REMOTE    ] LTC: Fetching primary data for 2025-05.
[2025-10-24T19:43:47.319114] [INFO ] [REMOTE    ] LTH: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T19:43:47.347609] [INFO ] [REMOTE    ] LPX: Fetching primary data for 2025-07.
[2025-10-24T19:43:47.777074] [INFO ] [REMOTE    ] LTC: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T19:43:48.147668] [INFO ] [REMOTE    ] LRN: Fetching primary data for 2025-06.
[2025-10-24T19:43:48.783999] [INFO ] [REMOTE    ] LPX: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T19:43:48.947704] [INFO ] [REMOTE    ] LTH: Fetching primary data for 2025-04.
[2025-10-24T19:43:49.605253] [INFO ] [REMOTE    ] LRN: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T19:43:49.747608] [INFO ] [REMOTE    ] LRN: Fetching primary data for 2025-07.
[2025-10-24T19:43:50.505342] [INFO ] [REMOTE    ] LTH: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T19:43:50.547610] [INFO ] [REMOTE    ] LTH: Fetching primary data for 2025-05.
[2025-10-24T19:43:51.238281] [INFO ] [REMOTE    ] LRN: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T19:43:51.347667] [INFO ] [REMOTE    ] LRN: Fetching primary data for 2025-08.
[2025-10-24T19:43:51.798956] [INFO ] [REMOTE    ] LTH: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T19:43:52.147746] [INFO ] [REMOTE    ] LTH: Fetching primary data for 2025-06.
[2025-10-24T19:43:52.751920] [INFO ] [REMOTE    ] LRN: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T19:43:52.947696] [INFO ] [REMOTE    ] LRN: Fetching primary data for 2025-09.
[2025-10-24T19:43:53.747639] [INFO ] [REMOTE    ] LPX: Fetching primary data for 2025-08.
[2025-10-24T19:43:53.942525] [INFO ] [REMOTE    ] LTH: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T19:43:54.359904] [INFO ] [REMOTE    ] LRN: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T19:43:54.547678] [INFO ] [REMOTE    ] LTC: Fetching primary data for 2025-06.
[2025-10-24T19:43:55.219193] [INFO ] [REMOTE    ] LPX: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T19:43:55.348584] [INFO ] [REMOTE    ] LPX: Fetching primary data for 2025-09.
[2025-10-24T19:43:55.352184] [INFO ] [REMOTE    ] LTC: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T19:43:56.147676] [INFO ] [REMOTE    ] LRN: Fetching primary data for 2025-10.
[2025-10-24T19:43:56.871439] [INFO ] [REMOTE    ] LPX: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T19:43:56.947606] [INFO ] [REMOTE    ] LPX: Fetching primary data for 2025-10.
[2025-10-24T19:43:57.566061] [INFO ] [REMOTE    ] LRN: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T19:43:57.572448] [INFO ] [REMOTE    ] LRN: Full fetch complete (58132 records).
[2025-10-24T19:43:57.572565] [DEBUG] [VALIDATOR ] LRN: Validating primary data.
[2025-10-24T19:43:57.748250] [INFO ] [REMOTE    ] LTH: Fetching primary data for 2025-07.
[2025-10-24T19:43:57.956848] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present.
[2025-10-24T19:43:57.956928] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed.
[2025-10-24T19:43:57.957941] [INFO ] [MAIN      ] LRN: Fetched primary data is valid.
[2025-10-24T19:43:57.958004] [DEBUG] [LOCAL     ] LRN: Saving primary data.
[2025-10-24T19:43:57.958554] [FATAL] [LOCAL     ] LRN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:43:57.958661] [FATAL] [MAIN      ] LRN: Failed to save primary data.
[2025-10-24T19:43:57.958720] [WARN ] [MAIN      ] LRN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:43:57.958785] [INFO ] [LOCAL     ] LRN: Starting deletion of primary data.
[2025-10-24T19:43:57.958845] [DEBUG] [LOCAL     ] LRN: No primary data file found to delete.
[2025-10-24T19:43:57.958882] [INFO ] [LOCAL     ] LRN: Starting deletion of derivative data.
[2025-10-24T19:43:57.959035] [DEBUG] [LOCAL     ] LRN: Deleted derivative data file.
[2025-10-24T19:43:57.959516] [INFO ] [MAIN      ] Update Progress: 1274/2366 symbols completed. LRN took 28.6s. Estimated remaining: 2h 20m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:43:58.130452] [INFO ] [MAIN      ] LTM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:43:58.169685] [DEBUG] [LOCAL     ] LTM: Loaded 39574 existing records from primary storage.
[2025-10-24T19:43:58.169973] [INFO ] [MAIN      ] LTM: Loaded 39574 existing records.
[2025-10-24T19:43:58.348864] [WARN ] [MAIN      ] LTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:43:58.349091] [INFO ] [MAIN      ] LTM: Wiping existing primary data before full refresh.
[2025-10-24T19:43:58.349199] [INFO ] [LOCAL     ] LTM: Starting deletion of primary data.
[2025-10-24T19:43:58.349595] [DEBUG] [LOCAL     ] LTM: Deleted primary data file.
[2025-10-24T19:43:58.349673] [INFO ] [MAIN      ] LTM: Starting full primary refresh.
[2025-10-24T19:43:58.553328] [INFO ] [REMOTE    ] LTC: Fetching primary data for 2025-07.
[2025-10-24T19:43:58.714751] [INFO ] [REMOTE    ] LPX: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T19:43:58.755991] [INFO ] [REMOTE    ] LPX: Full fetch complete (58724 records).
[2025-10-24T19:43:58.774811] [INFO ] [REMOTE    ] LTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:43:58.775127] [DEBUG] [VALIDATOR ] LPX: Validating primary data.
[2025-10-24T19:43:59.158709] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present.
[2025-10-24T19:43:59.158791] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed.
[2025-10-24T19:43:59.159707] [INFO ] [MAIN      ] LPX: Fetched primary data is valid.
[2025-10-24T19:43:59.159768] [DEBUG] [LOCAL     ] LPX: Saving primary data.
[2025-10-24T19:43:59.160193] [FATAL] [LOCAL     ] LPX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:43:59.160292] [FATAL] [MAIN      ] LPX: Failed to save primary data.
[2025-10-24T19:43:59.160361] [WARN ] [MAIN      ] LPX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:43:59.160453] [INFO ] [LOCAL     ] LPX: Starting deletion of primary data.
[2025-10-24T19:43:59.160531] [DEBUG] [LOCAL     ] LPX: No primary data file found to delete.
[2025-10-24T19:43:59.160572] [INFO ] [LOCAL     ] LPX: Starting deletion of derivative data.
[2025-10-24T19:43:59.160743] [DEBUG] [LOCAL     ] LPX: Deleted derivative data file.
[2025-10-24T19:43:59.160946] [INFO ] [MAIN      ] Update Progress: 1275/2366 symbols completed. LPX took 33.0s. Estimated remaining: 2h 20m 17s. Rate: 7.8 symbols/min
[2025-10-24T19:43:59.330892] [INFO ] [MAIN      ] LU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:43:59.356153] [INFO ] [REMOTE    ] LTM: Fetching primary data for 2025-01.
[2025-10-24T19:43:59.377572] [DEBUG] [LOCAL     ] LU: Loaded 49548 existing records from primary storage.
[2025-10-24T19:43:59.377900] [INFO ] [MAIN      ] LU: Loaded 49548 existing records.
[2025-10-24T19:43:59.564530] [WARN ] [MAIN      ] LU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:43:59.564924] [INFO ] [MAIN      ] LU: Wiping existing primary data before full refresh.
[2025-10-24T19:43:59.565023] [INFO ] [LOCAL     ] LU: Starting deletion of primary data.
[2025-10-24T19:43:59.565337] [DEBUG] [LOCAL     ] LU: Deleted primary data file.
[2025-10-24T19:43:59.565432] [INFO ] [MAIN      ] LU: Starting full primary refresh.
[2025-10-24T19:43:59.893429] [INFO ] [REMOTE    ] LTH: Incremental fetch complete for 2025-07 (2.15 seconds).
[2025-10-24T19:44:00.001729] [INFO ] [REMOTE    ] LU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:44:00.021706] [INFO ] [REMOTE    ] LTC: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T19:44:00.147696] [INFO ] [REMOTE    ] LTC: Fetching primary data for 2025-08.
[2025-10-24T19:44:00.595085] [INFO ] [REMOTE    ] LTM: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T19:44:00.947731] [INFO ] [REMOTE    ] LTH: Fetching primary data for 2025-08.
[2025-10-24T19:44:01.747725] [INFO ] [REMOTE    ] LU: Fetching primary data for 2025-01.
[2025-10-24T19:44:02.183058] [INFO ] [REMOTE    ] LTC: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T19:44:02.547684] [INFO ] [REMOTE    ] LTC: Fetching primary data for 2025-09.
[2025-10-24T19:44:02.690739] [INFO ] [REMOTE    ] LTH: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T19:44:03.347761] [INFO ] [REMOTE    ] LTM: Fetching primary data for 2025-02.
[2025-10-24T19:44:03.674422] [INFO ] [REMOTE    ] LU: Incremental fetch complete for 2025-01 (1.93 seconds).
[2025-10-24T19:44:03.848755] [INFO ] [REMOTE    ] LTC: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T19:44:04.147675] [INFO ] [REMOTE    ] LU: Fetching primary data for 2025-02.
[2025-10-24T19:44:04.404418] [INFO ] [REMOTE    ] LTM: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T19:44:04.947685] [INFO ] [REMOTE    ] LTC: Fetching primary data for 2025-10.
[2025-10-24T19:44:05.747632] [INFO ] [REMOTE    ] LTH: Fetching primary data for 2025-09.
[2025-10-24T19:44:05.923556] [INFO ] [REMOTE    ] LU: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T19:44:06.547630] [INFO ] [REMOTE    ] LTM: Fetching primary data for 2025-03.
[2025-10-24T19:44:06.777886] [INFO ] [REMOTE    ] LTC: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T19:44:06.783851] [INFO ] [REMOTE    ] LTC: Full fetch complete (43890 records).
[2025-10-24T19:44:06.783950] [DEBUG] [VALIDATOR ] LTC: Validating primary data.
[2025-10-24T19:44:07.156057] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present.
[2025-10-24T19:44:07.156192] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed.
[2025-10-24T19:44:07.157052] [INFO ] [MAIN      ] LTC: Fetched primary data is valid.
[2025-10-24T19:44:07.157268] [DEBUG] [LOCAL     ] LTC: Saving primary data.
[2025-10-24T19:44:07.157727] [FATAL] [LOCAL     ] LTC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:44:07.157810] [FATAL] [MAIN      ] LTC: Failed to save primary data.
[2025-10-24T19:44:07.157873] [WARN ] [MAIN      ] LTC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:44:07.157940] [INFO ] [LOCAL     ] LTC: Starting deletion of primary data.
[2025-10-24T19:44:07.157997] [DEBUG] [LOCAL     ] LTC: No primary data file found to delete.
[2025-10-24T19:44:07.158034] [INFO ] [LOCAL     ] LTC: Starting deletion of derivative data.
[2025-10-24T19:44:07.158161] [DEBUG] [LOCAL     ] LTC: Deleted derivative data file.
[2025-10-24T19:44:07.158234] [INFO ] [MAIN      ] Update Progress: 1276/2366 symbols completed. LTC took 34.9s. Estimated remaining: 2h 20m 9s. Rate: 7.8 symbols/min
[2025-10-24T19:44:07.330639] [INFO ] [MAIN      ] LUCK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:44:07.358725] [INFO ] [REMOTE    ] LU: Fetching primary data for 2025-03.
[2025-10-24T19:44:07.364995] [INFO ] [REMOTE    ] LTH: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T19:44:07.391799] [DEBUG] [LOCAL     ] LUCK: Loaded 23995 existing records from primary storage.
[2025-10-24T19:44:07.392052] [INFO ] [MAIN      ] LUCK: Loaded 23995 existing records.
[2025-10-24T19:44:07.565934] [WARN ] [MAIN      ] LUCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:44:07.566176] [INFO ] [MAIN      ] LUCK: Wiping existing primary data before full refresh.
[2025-10-24T19:44:07.566227] [INFO ] [LOCAL     ] LUCK: Starting deletion of primary data.
[2025-10-24T19:44:07.566526] [DEBUG] [LOCAL     ] LUCK: Deleted primary data file.
[2025-10-24T19:44:07.566682] [INFO ] [MAIN      ] LUCK: Starting full primary refresh.
[2025-10-24T19:44:07.946089] [INFO ] [REMOTE    ] LUCK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:44:07.950561] [INFO ] [REMOTE    ] LTM: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T19:44:08.147629] [INFO ] [REMOTE    ] LUCK: Fetching primary data for 2025-01.
[2025-10-24T19:44:08.895991] [INFO ] [REMOTE    ] LU: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T19:44:08.947672] [INFO ] [REMOTE    ] LTH: Fetching primary data for 2025-10.
[2025-10-24T19:44:09.557032] [INFO ] [REMOTE    ] LUCK: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T19:44:09.747734] [INFO ] [REMOTE    ] LTM: Fetching primary data for 2025-04.
[2025-10-24T19:44:10.547633] [INFO ] [REMOTE    ] LU: Fetching primary data for 2025-04.
[2025-10-24T19:44:10.637521] [INFO ] [REMOTE    ] LTH: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T19:44:10.647479] [INFO ] [REMOTE    ] LTH: Full fetch complete (74745 records).
[2025-10-24T19:44:10.647824] [DEBUG] [VALIDATOR ] LTH: Validating primary data.
[2025-10-24T19:44:10.778147] [INFO ] [REMOTE    ] LTM: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T19:44:11.067846] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present.
[2025-10-24T19:44:11.067924] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed.
[2025-10-24T19:44:11.068992] [INFO ] [MAIN      ] LTH: Fetched primary data is valid.
[2025-10-24T19:44:11.069054] [DEBUG] [LOCAL     ] LTH: Saving primary data.
[2025-10-24T19:44:11.069587] [FATAL] [LOCAL     ] LTH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:44:11.069694] [FATAL] [MAIN      ] LTH: Failed to save primary data.
[2025-10-24T19:44:11.069743] [WARN ] [MAIN      ] LTH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:44:11.069779] [INFO ] [LOCAL     ] LTH: Starting deletion of primary data.
[2025-10-24T19:44:11.069831] [DEBUG] [LOCAL     ] LTH: No primary data file found to delete.
[2025-10-24T19:44:11.069866] [INFO ] [LOCAL     ] LTH: Starting deletion of derivative data.
[2025-10-24T19:44:11.070014] [DEBUG] [LOCAL     ] LTH: Deleted derivative data file.
[2025-10-24T19:44:11.070214] [INFO ] [MAIN      ] Update Progress: 1277/2366 symbols completed. LTH took 29.4s. Estimated remaining: 2h 19m 58s. Rate: 7.8 symbols/min
[2025-10-24T19:44:11.347676] [INFO ] [REMOTE    ] LTM: Fetching primary data for 2025-05.
[2025-10-24T19:44:12.028341] [INFO ] [REMOTE    ] LU: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T19:44:12.147711] [INFO ] [REMOTE    ] LU: Fetching primary data for 2025-05.
[2025-10-24T19:44:12.688583] [INFO ] [REMOTE    ] LTM: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T19:44:12.947689] [INFO ] [REMOTE    ] LTM: Fetching primary data for 2025-06.
[2025-10-24T19:44:13.747625] [INFO ] [REMOTE    ] LUCK: Fetching primary data for 2025-02.
[2025-10-24T19:44:13.791487] [INFO ] [REMOTE    ] LU: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T19:44:14.311461] [INFO ] [REMOTE    ] LTM: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T19:44:14.547690] [INFO ] [REMOTE    ] LU: Fetching primary data for 2025-06.
[2025-10-24T19:44:14.966877] [INFO ] [REMOTE    ] LUCK: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T19:44:15.347672] [INFO ] [REMOTE    ] LUCK: Fetching primary data for 2025-03.
[2025-10-24T19:44:16.054338] [INFO ] [REMOTE    ] LU: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T19:44:16.147688] [INFO ] [REMOTE    ] LU: Fetching primary data for 2025-07.
[2025-10-24T19:44:16.511883] [INFO ] [REMOTE    ] LUCK: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T19:44:16.947743] [INFO ] [REMOTE    ] LTM: Fetching primary data for 2025-07.
[2025-10-24T19:44:17.626791] [INFO ] [REMOTE    ] LU: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T19:44:17.747707] [INFO ] [REMOTE    ] LU: Fetching primary data for 2025-08.
[2025-10-24T19:44:18.228596] [INFO ] [REMOTE    ] LTM: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T19:44:18.547673] [INFO ] [REMOTE    ] LUCK: Fetching primary data for 2025-04.
[2025-10-24T19:44:19.277572] [INFO ] [REMOTE    ] LU: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T19:44:19.347734] [INFO ] [REMOTE    ] LU: Fetching primary data for 2025-09.
[2025-10-24T19:44:19.804206] [INFO ] [REMOTE    ] LUCK: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T19:44:20.147717] [INFO ] [REMOTE    ] LUCK: Fetching primary data for 2025-05.
[2025-10-24T19:44:20.947681] [INFO ] [REMOTE    ] LTM: Fetching primary data for 2025-08.
[2025-10-24T19:44:20.992996] [INFO ] [REMOTE    ] LU: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T19:44:21.228817] [INFO ] [REMOTE    ] LUCK: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T19:44:21.747699] [INFO ] [REMOTE    ] LU: Fetching primary data for 2025-10.
[2025-10-24T19:44:22.445329] [INFO ] [REMOTE    ] LTM: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T19:44:22.547691] [INFO ] [REMOTE    ] LTM: Fetching primary data for 2025-09.
[2025-10-24T19:44:23.347696] [INFO ] [REMOTE    ] LUCK: Fetching primary data for 2025-06.
[2025-10-24T19:44:23.533695] [INFO ] [REMOTE    ] LU: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T19:44:23.543472] [INFO ] [REMOTE    ] LU: Full fetch complete (70934 records).
[2025-10-24T19:44:23.543756] [DEBUG] [VALIDATOR ] LU: Validating primary data.
[2025-10-24T19:44:23.951134] [DEBUG] [VALIDATOR ] LU: All expected trading days are present.
[2025-10-24T19:44:23.951252] [DEBUG] [VALIDATOR ] LU: Primary data validation passed.
[2025-10-24T19:44:23.952346] [INFO ] [MAIN      ] LU: Fetched primary data is valid.
[2025-10-24T19:44:23.952411] [DEBUG] [LOCAL     ] LU: Saving primary data.
[2025-10-24T19:44:23.953049] [FATAL] [LOCAL     ] LU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:44:23.953178] [FATAL] [MAIN      ] LU: Failed to save primary data.
[2025-10-24T19:44:23.953222] [WARN ] [MAIN      ] LU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:44:23.953286] [INFO ] [LOCAL     ] LU: Starting deletion of primary data.
[2025-10-24T19:44:23.953370] [DEBUG] [LOCAL     ] LU: No primary data file found to delete.
[2025-10-24T19:44:23.953442] [INFO ] [LOCAL     ] LU: Starting deletion of derivative data.
[2025-10-24T19:44:23.953826] [DEBUG] [LOCAL     ] LU: Deleted derivative data file.
[2025-10-24T19:44:23.954306] [INFO ] [MAIN      ] Update Progress: 1278/2366 symbols completed. LU took 24.8s. Estimated remaining: 2h 19m 55s. Rate: 7.8 symbols/min
[2025-10-24T19:44:24.153381] [INFO ] [REMOTE    ] LTM: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T19:44:24.163523] [INFO ] [REMOTE    ] LTM: Fetching primary data for 2025-10.
[2025-10-24T19:44:24.497583] [INFO ] [REMOTE    ] LUCK: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T19:44:24.947771] [INFO ] [REMOTE    ] LUCK: Fetching primary data for 2025-07.
[2025-10-24T19:44:25.548596] [INFO ] [REMOTE    ] LTM: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T19:44:25.557777] [INFO ] [REMOTE    ] LTM: Full fetch complete (51735 records).
[2025-10-24T19:44:25.557908] [DEBUG] [VALIDATOR ] LTM: Validating primary data.
[2025-10-24T19:44:25.941960] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present.
[2025-10-24T19:44:25.942036] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed.
[2025-10-24T19:44:25.942944] [INFO ] [MAIN      ] LTM: Fetched primary data is valid.
[2025-10-24T19:44:25.943004] [DEBUG] [LOCAL     ] LTM: Saving primary data.
[2025-10-24T19:44:25.943415] [FATAL] [LOCAL     ] LTM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:44:25.943492] [FATAL] [MAIN      ] LTM: Failed to save primary data.
[2025-10-24T19:44:25.943534] [WARN ] [MAIN      ] LTM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:44:25.943601] [INFO ] [LOCAL     ] LTM: Starting deletion of primary data.
[2025-10-24T19:44:25.943684] [DEBUG] [LOCAL     ] LTM: No primary data file found to delete.
[2025-10-24T19:44:25.943739] [INFO ] [LOCAL     ] LTM: Starting deletion of derivative data.
[2025-10-24T19:44:25.943879] [DEBUG] [LOCAL     ] LTM: Deleted derivative data file.
[2025-10-24T19:44:25.943956] [INFO ] [MAIN      ] Update Progress: 1279/2366 symbols completed. LTM took 28.0s. Estimated remaining: 2h 19m 42s. Rate: 7.8 symbols/min
[2025-10-24T19:44:26.044710] [INFO ] [REMOTE    ] LUCK: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T19:44:26.050807] [INFO ] [REMOTE    ] LUCK: Fetching primary data for 2025-08.
[2025-10-24T19:44:27.003845] [INFO ] [REMOTE    ] LUCK: Incremental fetch complete for 2025-08 (0.95 seconds).
[2025-10-24T19:44:27.008075] [INFO ] [REMOTE    ] LUCK: Fetching primary data for 2025-09.
[2025-10-24T19:44:28.113937] [INFO ] [REMOTE    ] LUCK: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T19:44:28.122042] [INFO ] [REMOTE    ] LUCK: Fetching primary data for 2025-10.
[2025-10-24T19:44:29.278487] [INFO ] [REMOTE    ] LUCK: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T19:44:29.282396] [INFO ] [REMOTE    ] LUCK: Full fetch complete (38988 records).
[2025-10-24T19:44:29.282546] [DEBUG] [VALIDATOR ] LUCK: Validating primary data.
[2025-10-24T19:44:29.648965] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present.
[2025-10-24T19:44:29.649053] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed.
[2025-10-24T19:44:29.649831] [INFO ] [MAIN      ] LUCK: Fetched primary data is valid.
[2025-10-24T19:44:29.649892] [DEBUG] [LOCAL     ] LUCK: Saving primary data.
[2025-10-24T19:44:29.650346] [FATAL] [LOCAL     ] LUCK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:44:29.650430] [FATAL] [MAIN      ] LUCK: Failed to save primary data.
[2025-10-24T19:44:29.650471] [WARN ] [MAIN      ] LUCK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:44:29.650505] [INFO ] [LOCAL     ] LUCK: Starting deletion of primary data.
[2025-10-24T19:44:29.650556] [DEBUG] [LOCAL     ] LUCK: No primary data file found to delete.
[2025-10-24T19:44:29.650589] [INFO ] [LOCAL     ] LUCK: Starting deletion of derivative data.
[2025-10-24T19:44:29.650757] [DEBUG] [LOCAL     ] LUCK: Deleted derivative data file.
[2025-10-24T19:44:29.650852] [INFO ] [MAIN      ] Update Progress: 1280/2366 symbols completed. LUCK took 22.5s. Estimated remaining: 2h 19m 31s. Rate: 7.8 symbols/min
[2025-10-24T19:44:30.315694] [INFO ] [MAIN      ] LVS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:44:30.353363] [INFO ] [MAIN      ] LUMN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:44:30.354907] [INFO ] [MAIN      ] LUXE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:44:30.384327] [INFO ] [MAIN      ] LUV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:44:30.385007] [DEBUG] [LOCAL     ] LUXE: No existing data file found in primary storage.
[2025-10-24T19:44:30.385545] [WARN ] [MAIN      ] LUXE: No existing data found, performing full refresh instead.
[2025-10-24T19:44:30.385793] [INFO ] [MAIN      ] LUXE: Wiping existing primary data before full refresh.
[2025-10-24T19:44:30.386224] [INFO ] [LOCAL     ] LUXE: Starting deletion of primary data.
[2025-10-24T19:44:30.386702] [DEBUG] [LOCAL     ] LUXE: No primary data file found to delete.
[2025-10-24T19:44:30.386776] [INFO ] [MAIN      ] LUXE: Starting full primary refresh.
[2025-10-24T19:44:30.818624] [DEBUG] [LOCAL     ] LVS: Loaded 53959 existing records from primary storage.
[2025-10-24T19:44:30.847172] [INFO ] [MAIN      ] LVS: Loaded 53959 existing records.
[2025-10-24T19:44:30.849284] [DEBUG] [LOCAL     ] LUMN: Loaded 54035 existing records from primary storage.
[2025-10-24T19:44:30.850739] [DEBUG] [LOCAL     ] LUV: Loaded 54079 existing records from primary storage.
[2025-10-24T19:44:30.882290] [INFO ] [MAIN      ] LUV: Loaded 54079 existing records.
[2025-10-24T19:44:30.887605] [INFO ] [MAIN      ] LUMN: Loaded 54035 existing records.
[2025-10-24T19:44:31.266736] [INFO ] [REMOTE    ] LUXE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:44:31.313923] [INFO ] [REMOTE    ] LUXE: Fetching primary data for 2025-01.
[2025-10-24T19:44:31.509187] [WARN ] [MAIN      ] LUV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:44:31.526546] [INFO ] [MAIN      ] LUV: Wiping existing primary data before full refresh.
[2025-10-24T19:44:31.526767] [INFO ] [LOCAL     ] LUV: Starting deletion of primary data.
[2025-10-24T19:44:31.522578] [WARN ] [MAIN      ] LVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:44:31.557688] [DEBUG] [LOCAL     ] LUV: Deleted primary data file.
[2025-10-24T19:44:31.557867] [INFO ] [MAIN      ] LUV: Starting full primary refresh.
[2025-10-24T19:44:31.557611] [WARN ] [MAIN      ] LUMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:44:31.582152] [INFO ] [MAIN      ] LUMN: Wiping existing primary data before full refresh.
[2025-10-24T19:44:31.575949] [INFO ] [MAIN      ] LVS: Wiping existing primary data before full refresh.
[2025-10-24T19:44:31.601263] [INFO ] [LOCAL     ] LVS: Starting deletion of primary data.
[2025-10-24T19:44:31.596054] [INFO ] [LOCAL     ] LUMN: Starting deletion of primary data.
[2025-10-24T19:44:31.623841] [DEBUG] [LOCAL     ] LVS: Deleted primary data file.
[2025-10-24T19:44:31.650483] [INFO ] [MAIN      ] LVS: Starting full primary refresh.
[2025-10-24T19:44:31.655725] [DEBUG] [LOCAL     ] LUMN: Deleted primary data file.
[2025-10-24T19:44:31.662222] [INFO ] [MAIN      ] LUMN: Starting full primary refresh.
[2025-10-24T19:44:31.656947] [DEBUG] [REMOTE    ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:44:31.739484] [WARN ] [REMOTE    ] LUXE: No data returned for month 2025-01
[2025-10-24T19:44:31.834396] [FATAL] [REMOTE    ] LUXE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:44:31.901772] [FATAL] [MAIN      ] LUXE: Failed to fetch primary data.
[2025-10-24T19:44:31.987842] [WARN ] [MAIN      ] LUXE: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:44:32.067349] [INFO ] [LOCAL     ] LUXE: Starting deletion of primary data.
[2025-10-24T19:44:32.150051] [DEBUG] [LOCAL     ] LUXE: No primary data file found to delete.
[2025-10-24T19:44:32.206394] [INFO ] [LOCAL     ] LUXE: Starting deletion of derivative data.
[2025-10-24T19:44:32.244345] [DEBUG] [LOCAL     ] LUXE: No derivative data file found to delete.
[2025-10-24T19:44:32.307160] [INFO ] [MAIN      ] Update Progress: 1281/2366 symbols completed. LUXE took 2.6s. Estimated remaining: 2h 19m 19s. Rate: 7.8 symbols/min
[2025-10-24T19:44:32.737817] [INFO ] [REMOTE    ] LUMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:44:32.767052] [INFO ] [REMOTE    ] LUMN: Fetching primary data for 2025-01.
[2025-10-24T19:44:32.910306] [INFO ] [REMOTE    ] LUV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:44:32.922218] [INFO ] [REMOTE    ] LUV: Fetching primary data for 2025-01.
[2025-10-24T19:44:32.953154] [INFO ] [MAIN      ] LVWR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:44:32.976932] [INFO ] [REMOTE    ] LVS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:44:32.977414] [INFO ] [REMOTE    ] LVS: Fetching primary data for 2025-01.
[2025-10-24T19:44:32.996062] [DEBUG] [LOCAL     ] LVWR: Loaded 18696 existing records from primary storage.
[2025-10-24T19:44:32.996352] [INFO ] [MAIN      ] LVWR: Loaded 18696 existing records.
[2025-10-24T19:44:33.172145] [WARN ] [MAIN      ] LVWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:44:33.172400] [INFO ] [MAIN      ] LVWR: Wiping existing primary data before full refresh.
[2025-10-24T19:44:33.172448] [INFO ] [LOCAL     ] LVWR: Starting deletion of primary data.
[2025-10-24T19:44:33.172715] [DEBUG] [LOCAL     ] LVWR: Deleted primary data file.
[2025-10-24T19:44:33.172771] [INFO ] [MAIN      ] LVWR: Starting full primary refresh.
[2025-10-24T19:44:33.529027] [INFO ] [REMOTE    ] LVWR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:44:33.529388] [INFO ] [REMOTE    ] LVWR: Fetching primary data for 2025-01.
[2025-10-24T19:44:34.282324] [INFO ] [REMOTE    ] LVWR: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T19:44:34.284090] [INFO ] [REMOTE    ] LVWR: Fetching primary data for 2025-02.
[2025-10-24T19:44:35.015886] [INFO ] [REMOTE    ] LVWR: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T19:44:35.017498] [INFO ] [REMOTE    ] LVWR: Fetching primary data for 2025-03.
[2025-10-24T19:44:35.127752] [INFO ] [REMOTE    ] LUMN: Incremental fetch complete for 2025-01 (2.36 seconds).
[2025-10-24T19:44:35.139872] [INFO ] [REMOTE    ] LUMN: Fetching primary data for 2025-02.
[2025-10-24T19:44:35.176320] [INFO ] [REMOTE    ] LVS: Incremental fetch complete for 2025-01 (2.20 seconds).
[2025-10-24T19:44:35.189303] [INFO ] [REMOTE    ] LVS: Fetching primary data for 2025-02.
[2025-10-24T19:44:35.415184] [INFO ] [REMOTE    ] LUV: Incremental fetch complete for 2025-01 (2.49 seconds).
[2025-10-24T19:44:35.425434] [INFO ] [REMOTE    ] LUV: Fetching primary data for 2025-02.
[2025-10-24T19:44:35.560399] [INFO ] [REMOTE    ] LVWR: Incremental fetch complete for 2025-03 (0.54 seconds).
[2025-10-24T19:44:36.147677] [INFO ] [REMOTE    ] LVWR: Fetching primary data for 2025-04.
[2025-10-24T19:44:36.649737] [INFO ] [REMOTE    ] LUMN: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T19:44:36.790338] [INFO ] [REMOTE    ] LVWR: Incremental fetch complete for 2025-04 (0.64 seconds).
[2025-10-24T19:44:36.927780] [INFO ] [REMOTE    ] LVS: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T19:44:36.947608] [INFO ] [REMOTE    ] LVS: Fetching primary data for 2025-03.
[2025-10-24T19:44:37.063781] [INFO ] [REMOTE    ] LUV: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T19:44:37.747697] [INFO ] [REMOTE    ] LUMN: Fetching primary data for 2025-03.
[2025-10-24T19:44:38.383107] [INFO ] [REMOTE    ] LVS: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T19:44:38.547713] [INFO ] [REMOTE    ] LUV: Fetching primary data for 2025-03.
[2025-10-24T19:44:39.347717] [INFO ] [REMOTE    ] LVS: Fetching primary data for 2025-04.
[2025-10-24T19:44:39.479723] [INFO ] [REMOTE    ] LUMN: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T19:44:40.147626] [INFO ] [REMOTE    ] LUMN: Fetching primary data for 2025-04.
[2025-10-24T19:44:40.344142] [INFO ] [REMOTE    ] LUV: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T19:44:40.947611] [INFO ] [REMOTE    ] LVWR: Fetching primary data for 2025-05.
[2025-10-24T19:44:41.112423] [INFO ] [REMOTE    ] LVS: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T19:44:41.747704] [INFO ] [REMOTE    ] LUV: Fetching primary data for 2025-04.
[2025-10-24T19:44:41.805493] [INFO ] [REMOTE    ] LUMN: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T19:44:41.849106] [INFO ] [REMOTE    ] LVWR: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T19:44:42.547734] [INFO ] [REMOTE    ] LUMN: Fetching primary data for 2025-05.
[2025-10-24T19:44:43.347702] [INFO ] [REMOTE    ] LVS: Fetching primary data for 2025-05.
[2025-10-24T19:44:43.732821] [INFO ] [REMOTE    ] LUV: Incremental fetch complete for 2025-04 (1.99 seconds).
[2025-10-24T19:44:44.147696] [INFO ] [REMOTE    ] LUV: Fetching primary data for 2025-05.
[2025-10-24T19:44:44.366084] [INFO ] [REMOTE    ] LUMN: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T19:44:44.671297] [INFO ] [REMOTE    ] LVS: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T19:44:44.947696] [INFO ] [REMOTE    ] LUMN: Fetching primary data for 2025-06.
[2025-10-24T19:44:45.740137] [INFO ] [REMOTE    ] LUV: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T19:44:45.750795] [INFO ] [REMOTE    ] LVS: Fetching primary data for 2025-06.
[2025-10-24T19:44:46.547718] [INFO ] [REMOTE    ] LUV: Fetching primary data for 2025-06.
[2025-10-24T19:44:46.644085] [INFO ] [REMOTE    ] LUMN: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T19:44:47.347639] [INFO ] [REMOTE    ] LUMN: Fetching primary data for 2025-07.
[2025-10-24T19:44:47.394868] [INFO ] [REMOTE    ] LVS: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T19:44:48.157552] [INFO ] [REMOTE    ] LVS: Fetching primary data for 2025-07.
[2025-10-24T19:44:48.176692] [INFO ] [REMOTE    ] LUV: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T19:44:48.947709] [INFO ] [REMOTE    ] LUV: Fetching primary data for 2025-07.
[2025-10-24T19:44:49.127429] [INFO ] [REMOTE    ] LUMN: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T19:44:49.747616] [INFO ] [REMOTE    ] LUMN: Fetching primary data for 2025-08.
[2025-10-24T19:44:49.930000] [INFO ] [REMOTE    ] LVS: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T19:44:50.451874] [INFO ] [REMOTE    ] LUV: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T19:44:50.547615] [INFO ] [REMOTE    ] LVWR: Fetching primary data for 2025-06.
[2025-10-24T19:44:51.347624] [INFO ] [REMOTE    ] LUV: Fetching primary data for 2025-08.
[2025-10-24T19:44:51.752008] [INFO ] [REMOTE    ] LUMN: Incremental fetch complete for 2025-08 (2.00 seconds).
[2025-10-24T19:44:52.089107] [INFO ] [REMOTE    ] LVWR: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T19:44:52.147612] [INFO ] [REMOTE    ] LVWR: Fetching primary data for 2025-07.
[2025-10-24T19:44:52.947727] [INFO ] [REMOTE    ] LVS: Fetching primary data for 2025-08.
[2025-10-24T19:44:53.159918] [INFO ] [REMOTE    ] LUV: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T19:44:53.186223] [INFO ] [REMOTE    ] LVWR: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T19:44:53.747696] [INFO ] [REMOTE    ] LVWR: Fetching primary data for 2025-08.
[2025-10-24T19:44:54.545236] [INFO ] [REMOTE    ] LVWR: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T19:44:54.548266] [INFO ] [REMOTE    ] LUMN: Fetching primary data for 2025-09.
[2025-10-24T19:44:54.615571] [INFO ] [REMOTE    ] LVS: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T19:44:55.347747] [INFO ] [REMOTE    ] LUV: Fetching primary data for 2025-09.
[2025-10-24T19:44:56.147749] [INFO ] [REMOTE    ] LVWR: Fetching primary data for 2025-09.
[2025-10-24T19:44:56.552712] [INFO ] [REMOTE    ] LUMN: Incremental fetch complete for 2025-09 (2.00 seconds).
[2025-10-24T19:44:56.947734] [INFO ] [REMOTE    ] LUMN: Fetching primary data for 2025-10.
[2025-10-24T19:44:57.223290] [INFO ] [REMOTE    ] LVWR: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T19:44:57.237493] [INFO ] [REMOTE    ] LUV: Incremental fetch complete for 2025-09 (1.89 seconds).
[2025-10-24T19:44:57.747735] [INFO ] [REMOTE    ] LVS: Fetching primary data for 2025-09.
[2025-10-24T19:44:58.547714] [INFO ] [REMOTE    ] LUV: Fetching primary data for 2025-10.
[2025-10-24T19:44:58.947452] [INFO ] [REMOTE    ] LUMN: Incremental fetch complete for 2025-10 (2.00 seconds).
[2025-10-24T19:44:58.958098] [INFO ] [REMOTE    ] LUMN: Full fetch complete (77778 records).
[2025-10-24T19:44:58.958314] [DEBUG] [VALIDATOR ] LUMN: Validating primary data.
[2025-10-24T19:44:59.365023] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present.
[2025-10-24T19:44:59.365155] [INFO ] [REMOTE    ] LVWR: Fetching primary data for 2025-10.
[2025-10-24T19:44:59.366266] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed.
[2025-10-24T19:44:59.367466] [INFO ] [MAIN      ] LUMN: Fetched primary data is valid.
[2025-10-24T19:44:59.367756] [DEBUG] [LOCAL     ] LUMN: Saving primary data.
[2025-10-24T19:44:59.368420] [FATAL] [LOCAL     ] LUMN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:44:59.397541] [FATAL] [MAIN      ] LUMN: Failed to save primary data.
[2025-10-24T19:44:59.397731] [WARN ] [MAIN      ] LUMN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:44:59.397812] [INFO ] [LOCAL     ] LUMN: Starting deletion of primary data.
[2025-10-24T19:44:59.397945] [DEBUG] [LOCAL     ] LUMN: No primary data file found to delete.
[2025-10-24T19:44:59.398204] [INFO ] [LOCAL     ] LUMN: Starting deletion of derivative data.
[2025-10-24T19:44:59.400030] [INFO ] [REMOTE    ] LVS: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T19:44:59.400098] [DEBUG] [LOCAL     ] LUMN: Deleted derivative data file.
[2025-10-24T19:44:59.400500] [INFO ] [MAIN      ] Update Progress: 1282/2366 symbols completed. LUMN took 29.7s. Estimated remaining: 2h 19m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:44:59.590417] [INFO ] [MAIN      ] LW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:44:59.658558] [DEBUG] [LOCAL     ] LW: Loaded 51535 existing records from primary storage.
[2025-10-24T19:44:59.658877] [INFO ] [MAIN      ] LW: Loaded 51535 existing records.
[2025-10-24T19:44:59.831823] [WARN ] [MAIN      ] LW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:44:59.832079] [INFO ] [MAIN      ] LW: Wiping existing primary data before full refresh.
[2025-10-24T19:44:59.832141] [INFO ] [LOCAL     ] LW: Starting deletion of primary data.
[2025-10-24T19:44:59.832628] [DEBUG] [LOCAL     ] LW: Deleted primary data file.
[2025-10-24T19:44:59.832716] [INFO ] [MAIN      ] LW: Starting full primary refresh.
[2025-10-24T19:45:00.152310] [INFO ] [REMOTE    ] LVS: Fetching primary data for 2025-10.
[2025-10-24T19:45:00.195639] [INFO ] [REMOTE    ] LW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:45:00.204055] [INFO ] [REMOTE    ] LVWR: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T19:45:00.207039] [INFO ] [REMOTE    ] LVWR: Full fetch complete (20865 records).
[2025-10-24T19:45:00.207174] [DEBUG] [VALIDATOR ] LVWR: Validating primary data.
[2025-10-24T19:45:00.397387] [INFO ] [REMOTE    ] LUV: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T19:45:00.486922] [INFO ] [REMOTE    ] LUV: Full fetch complete (77865 records).
[2025-10-24T19:45:00.513132] [DEBUG] [VALIDATOR ] LUV: Validating primary data.
[2025-10-24T19:45:00.812672] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present.
[2025-10-24T19:45:00.816529] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed.
[2025-10-24T19:45:00.834600] [INFO ] [MAIN      ] LVWR: Fetched primary data is valid.
[2025-10-24T19:45:00.839817] [DEBUG] [LOCAL     ] LVWR: Saving primary data.
[2025-10-24T19:45:00.872514] [FATAL] [LOCAL     ] LVWR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:45:00.906024] [FATAL] [MAIN      ] LVWR: Failed to save primary data.
[2025-10-24T19:45:00.917580] [WARN ] [MAIN      ] LVWR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:45:00.934688] [INFO ] [LOCAL     ] LVWR: Starting deletion of primary data.
[2025-10-24T19:45:00.934854] [DEBUG] [LOCAL     ] LVWR: No primary data file found to delete.
[2025-10-24T19:45:00.942996] [INFO ] [LOCAL     ] LVWR: Starting deletion of derivative data.
[2025-10-24T19:45:00.946051] [DEBUG] [LOCAL     ] LVWR: Deleted derivative data file.
[2025-10-24T19:45:00.951839] [INFO ] [MAIN      ] Update Progress: 1283/2366 symbols completed. LVWR took 28.6s. Estimated remaining: 2h 19m 15s. Rate: 7.8 symbols/min
[2025-10-24T19:45:00.951734] [INFO ] [REMOTE    ] LW: Fetching primary data for 2025-01.
[2025-10-24T19:45:01.153246] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present.
[2025-10-24T19:45:01.153732] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed.
[2025-10-24T19:45:01.154838] [INFO ] [MAIN      ] LUV: Fetched primary data is valid.
[2025-10-24T19:45:01.154937] [DEBUG] [LOCAL     ] LUV: Saving primary data.
[2025-10-24T19:45:01.177178] [FATAL] [LOCAL     ] LUV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:45:01.225990] [INFO ] [MAIN      ] LXFR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:45:01.224613] [FATAL] [MAIN      ] LUV: Failed to save primary data.
[2025-10-24T19:45:01.226435] [WARN ] [MAIN      ] LUV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:45:01.226507] [INFO ] [LOCAL     ] LUV: Starting deletion of primary data.
[2025-10-24T19:45:01.226567] [DEBUG] [LOCAL     ] LUV: No primary data file found to delete.
[2025-10-24T19:45:01.226602] [INFO ] [LOCAL     ] LUV: Starting deletion of derivative data.
[2025-10-24T19:45:01.226748] [DEBUG] [LOCAL     ] LUV: Deleted derivative data file.
[2025-10-24T19:45:01.227060] [INFO ] [MAIN      ] Update Progress: 1284/2366 symbols completed. LUV took 31.6s. Estimated remaining: 2h 19m 1s. Rate: 7.8 symbols/min
[2025-10-24T19:45:01.419115] [INFO ] [MAIN      ] LXP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:45:01.419726] [DEBUG] [LOCAL     ] LXFR: Loaded 16511 existing records from primary storage.
[2025-10-24T19:45:01.420204] [INFO ] [MAIN      ] LXFR: Loaded 16511 existing records.
[2025-10-24T19:45:01.615232] [WARN ] [MAIN      ] LXFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:45:01.615468] [INFO ] [MAIN      ] LXFR: Wiping existing primary data before full refresh.
[2025-10-24T19:45:01.615523] [INFO ] [LOCAL     ] LXFR: Starting deletion of primary data.
[2025-10-24T19:45:01.615750] [DEBUG] [LOCAL     ] LXFR: Deleted primary data file.
[2025-10-24T19:45:01.615807] [INFO ] [MAIN      ] LXFR: Starting full primary refresh.
[2025-10-24T19:45:01.800302] [DEBUG] [LOCAL     ] LXP: Loaded 51121 existing records from primary storage.
[2025-10-24T19:45:01.831262] [INFO ] [MAIN      ] LXP: Loaded 51121 existing records.
[2025-10-24T19:45:02.224639] [WARN ] [MAIN      ] LXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:45:02.260436] [INFO ] [MAIN      ] LXP: Wiping existing primary data before full refresh.
[2025-10-24T19:45:02.266367] [INFO ] [REMOTE    ] LXFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:45:02.266934] [INFO ] [LOCAL     ] LXP: Starting deletion of primary data.
[2025-10-24T19:45:02.266864] [INFO ] [REMOTE    ] LXFR: Fetching primary data for 2025-01.
[2025-10-24T19:45:02.268521] [DEBUG] [LOCAL     ] LXP: Deleted primary data file.
[2025-10-24T19:45:02.268595] [INFO ] [MAIN      ] LXP: Starting full primary refresh.
[2025-10-24T19:45:02.553962] [INFO ] [REMOTE    ] LVS: Incremental fetch complete for 2025-10 (2.40 seconds).
[2025-10-24T19:45:02.628727] [INFO ] [REMOTE    ] LVS: Full fetch complete (77725 records).
[2025-10-24T19:45:02.633452] [DEBUG] [VALIDATOR ] LVS: Validating primary data.
[2025-10-24T19:45:02.800615] [INFO ] [REMOTE    ] LXP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:45:02.815405] [INFO ] [REMOTE    ] LXP: Fetching primary data for 2025-01.
[2025-10-24T19:45:03.095878] [INFO ] [REMOTE    ] LW: Incremental fetch complete for 2025-01 (2.14 seconds).
[2025-10-24T19:45:03.194141] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present.
[2025-10-24T19:45:03.194221] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed.
[2025-10-24T19:45:03.195360] [INFO ] [MAIN      ] LVS: Fetched primary data is valid.
[2025-10-24T19:45:03.195425] [DEBUG] [LOCAL     ] LVS: Saving primary data.
[2025-10-24T19:45:03.196121] [FATAL] [LOCAL     ] LVS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:45:03.196216] [FATAL] [MAIN      ] LVS: Failed to save primary data.
[2025-10-24T19:45:03.196258] [WARN ] [MAIN      ] LVS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:45:03.196295] [INFO ] [LOCAL     ] LVS: Starting deletion of primary data.
[2025-10-24T19:45:03.196348] [DEBUG] [LOCAL     ] LVS: No primary data file found to delete.
[2025-10-24T19:45:03.196383] [INFO ] [LOCAL     ] LVS: Starting deletion of derivative data.
[2025-10-24T19:45:03.196511] [DEBUG] [LOCAL     ] LVS: Deleted derivative data file.
[2025-10-24T19:45:03.196841] [INFO ] [MAIN      ] Update Progress: 1285/2366 symbols completed. LVS took 33.5s. Estimated remaining: 2h 18m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:45:03.348523] [INFO ] [REMOTE    ] LW: Fetching primary data for 2025-02.
[2025-10-24T19:45:03.385662] [INFO ] [MAIN      ] LXU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:45:03.399371] [INFO ] [REMOTE    ] LXFR: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T19:45:03.429711] [DEBUG] [LOCAL     ] LXU: Loaded 31710 existing records from primary storage.
[2025-10-24T19:45:03.429998] [INFO ] [MAIN      ] LXU: Loaded 31710 existing records.
[2025-10-24T19:45:03.614789] [WARN ] [MAIN      ] LXU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:45:03.615067] [INFO ] [MAIN      ] LXU: Wiping existing primary data before full refresh.
[2025-10-24T19:45:03.615117] [INFO ] [LOCAL     ] LXU: Starting deletion of primary data.
[2025-10-24T19:45:03.615485] [DEBUG] [LOCAL     ] LXU: Deleted primary data file.
[2025-10-24T19:45:03.615524] [INFO ] [MAIN      ] LXU: Starting full primary refresh.
[2025-10-24T19:45:03.980935] [INFO ] [REMOTE    ] LXU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:45:04.147711] [INFO ] [REMOTE    ] LXU: Fetching primary data for 2025-01.
[2025-10-24T19:45:04.397019] [INFO ] [REMOTE    ] LXP: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T19:45:04.948061] [INFO ] [REMOTE    ] LXP: Fetching primary data for 2025-02.
[2025-10-24T19:45:04.953607] [INFO ] [REMOTE    ] LW: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T19:45:05.060593] [INFO ] [REMOTE    ] LXU: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T19:45:05.747746] [INFO ] [REMOTE    ] LXU: Fetching primary data for 2025-02.
[2025-10-24T19:45:06.140488] [INFO ] [REMOTE    ] LXP: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T19:45:06.404312] [INFO ] [REMOTE    ] LXU: Incremental fetch complete for 2025-02 (0.66 seconds).
[2025-10-24T19:45:06.547705] [INFO ] [REMOTE    ] LXU: Fetching primary data for 2025-03.
[2025-10-24T19:45:07.347636] [INFO ] [REMOTE    ] LXFR: Fetching primary data for 2025-02.
[2025-10-24T19:45:07.810242] [INFO ] [REMOTE    ] LXU: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T19:45:08.147672] [INFO ] [REMOTE    ] LXU: Fetching primary data for 2025-04.
[2025-10-24T19:45:08.258778] [INFO ] [REMOTE    ] LXFR: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T19:45:08.947697] [INFO ] [REMOTE    ] LXP: Fetching primary data for 2025-03.
[2025-10-24T19:45:09.301394] [INFO ] [REMOTE    ] LXU: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T19:45:09.747691] [INFO ] [REMOTE    ] LXU: Fetching primary data for 2025-05.
[2025-10-24T19:45:10.559097] [INFO ] [REMOTE    ] LW: Fetching primary data for 2025-03.
[2025-10-24T19:45:10.564478] [INFO ] [REMOTE    ] LXP: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T19:45:10.628514] [INFO ] [REMOTE    ] LXU: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T19:45:11.347638] [INFO ] [REMOTE    ] LXFR: Fetching primary data for 2025-03.
[2025-10-24T19:45:12.147608] [INFO ] [REMOTE    ] LXP: Fetching primary data for 2025-04.
[2025-10-24T19:45:12.209419] [INFO ] [REMOTE    ] LW: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T19:45:12.246852] [INFO ] [REMOTE    ] LXFR: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T19:45:12.947718] [INFO ] [REMOTE    ] LXU: Fetching primary data for 2025-06.
[2025-10-24T19:45:13.747615] [INFO ] [REMOTE    ] LXFR: Fetching primary data for 2025-04.
[2025-10-24T19:45:13.816573] [INFO ] [REMOTE    ] LXP: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T19:45:14.213740] [INFO ] [REMOTE    ] LXU: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T19:45:14.350593] [INFO ] [REMOTE    ] LXFR: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T19:45:14.547670] [INFO ] [REMOTE    ] LXU: Fetching primary data for 2025-07.
[2025-10-24T19:45:15.347677] [INFO ] [REMOTE    ] LXP: Fetching primary data for 2025-05.
[2025-10-24T19:45:15.895132] [INFO ] [REMOTE    ] LXU: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T19:45:16.147730] [INFO ] [REMOTE    ] LXFR: Fetching primary data for 2025-05.
[2025-10-24T19:45:16.907166] [INFO ] [REMOTE    ] LXP: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T19:45:16.947592] [INFO ] [REMOTE    ] LXU: Fetching primary data for 2025-08.
[2025-10-24T19:45:17.175411] [INFO ] [REMOTE    ] LXFR: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T19:45:17.747609] [INFO ] [REMOTE    ] LXFR: Fetching primary data for 2025-06.
[2025-10-24T19:45:18.132980] [INFO ] [REMOTE    ] LXU: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T19:45:18.547627] [INFO ] [REMOTE    ] LXP: Fetching primary data for 2025-06.
[2025-10-24T19:45:18.630572] [INFO ] [REMOTE    ] LXFR: Incremental fetch complete for 2025-06 (0.88 seconds).
[2025-10-24T19:45:19.347688] [INFO ] [REMOTE    ] LW: Fetching primary data for 2025-04.
[2025-10-24T19:45:20.147671] [INFO ] [REMOTE    ] LXU: Fetching primary data for 2025-09.
[2025-10-24T19:45:20.276114] [INFO ] [REMOTE    ] LXP: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T19:45:20.947618] [INFO ] [REMOTE    ] LXP: Fetching primary data for 2025-07.
[2025-10-24T19:45:21.212902] [INFO ] [REMOTE    ] LXU: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T19:45:21.629983] [INFO ] [REMOTE    ] LW: Incremental fetch complete for 2025-04 (2.28 seconds).
[2025-10-24T19:45:21.747624] [INFO ] [REMOTE    ] LW: Fetching primary data for 2025-05.
[2025-10-24T19:45:22.547703] [INFO ] [REMOTE    ] LXFR: Fetching primary data for 2025-07.
[2025-10-24T19:45:22.615619] [INFO ] [REMOTE    ] LXP: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T19:45:23.222200] [INFO ] [REMOTE    ] LXFR: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T19:45:23.347629] [INFO ] [REMOTE    ] LXFR: Fetching primary data for 2025-08.
[2025-10-24T19:45:23.462593] [INFO ] [REMOTE    ] LW: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T19:45:24.147615] [INFO ] [REMOTE    ] LW: Fetching primary data for 2025-06.
[2025-10-24T19:45:24.332409] [INFO ] [REMOTE    ] LXFR: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T19:45:24.947688] [INFO ] [REMOTE    ] LXP: Fetching primary data for 2025-08.
[2025-10-24T19:45:25.672155] [INFO ] [REMOTE    ] LW: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T19:45:25.747604] [INFO ] [REMOTE    ] LW: Fetching primary data for 2025-07.
[2025-10-24T19:45:26.552097] [INFO ] [REMOTE    ] LXU: Fetching primary data for 2025-10.
[2025-10-24T19:45:26.557689] [INFO ] [REMOTE    ] LXP: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T19:45:27.347624] [INFO ] [REMOTE    ] LXFR: Fetching primary data for 2025-09.
[2025-10-24T19:45:27.478003] [INFO ] [REMOTE    ] LW: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T19:45:27.795273] [INFO ] [REMOTE    ] LXU: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T19:45:27.800882] [INFO ] [REMOTE    ] LXU: Full fetch complete (45284 records).
[2025-10-24T19:45:27.800993] [DEBUG] [VALIDATOR ] LXU: Validating primary data.
[2025-10-24T19:45:28.168146] [INFO ] [REMOTE    ] LXP: Fetching primary data for 2025-09.
[2025-10-24T19:45:28.221063] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present.
[2025-10-24T19:45:28.221180] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed.
[2025-10-24T19:45:28.222393] [INFO ] [MAIN      ] LXU: Fetched primary data is valid.
[2025-10-24T19:45:28.222572] [DEBUG] [LOCAL     ] LXU: Saving primary data.
[2025-10-24T19:45:28.223312] [FATAL] [LOCAL     ] LXU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:45:28.223410] [FATAL] [MAIN      ] LXU: Failed to save primary data.
[2025-10-24T19:45:28.223489] [WARN ] [MAIN      ] LXU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:45:28.223574] [INFO ] [LOCAL     ] LXU: Starting deletion of primary data.
[2025-10-24T19:45:28.223698] [DEBUG] [LOCAL     ] LXU: No primary data file found to delete.
[2025-10-24T19:45:28.223766] [INFO ] [LOCAL     ] LXU: Starting deletion of derivative data.
[2025-10-24T19:45:28.224079] [DEBUG] [LOCAL     ] LXU: Deleted derivative data file.
[2025-10-24T19:45:28.224197] [INFO ] [MAIN      ] Update Progress: 1286/2366 symbols completed. LXU took 25.0s. Estimated remaining: 2h 18m 55s. Rate: 7.8 symbols/min
[2025-10-24T19:45:28.345481] [INFO ] [REMOTE    ] LXFR: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T19:45:28.418094] [INFO ] [MAIN      ] LYB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:45:28.469565] [DEBUG] [LOCAL     ] LYB: Loaded 54011 existing records from primary storage.
[2025-10-24T19:45:28.469924] [INFO ] [MAIN      ] LYB: Loaded 54011 existing records.
[2025-10-24T19:45:28.647181] [WARN ] [MAIN      ] LYB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:45:28.647417] [INFO ] [MAIN      ] LYB: Wiping existing primary data before full refresh.
[2025-10-24T19:45:28.647464] [INFO ] [LOCAL     ] LYB: Starting deletion of primary data.
[2025-10-24T19:45:28.647811] [DEBUG] [LOCAL     ] LYB: Deleted primary data file.
[2025-10-24T19:45:28.647867] [INFO ] [MAIN      ] LYB: Starting full primary refresh.
[2025-10-24T19:45:28.958458] [INFO ] [REMOTE    ] LXFR: Fetching primary data for 2025-10.
[2025-10-24T19:45:28.997897] [INFO ] [REMOTE    ] LYB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:45:29.742295] [INFO ] [REMOTE    ] LXP: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T19:45:29.753316] [INFO ] [REMOTE    ] LYB: Fetching primary data for 2025-01.
[2025-10-24T19:45:30.030251] [INFO ] [REMOTE    ] LXFR: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T19:45:30.033171] [INFO ] [REMOTE    ] LXFR: Full fetch complete (24629 records).
[2025-10-24T19:45:30.033249] [DEBUG] [VALIDATOR ] LXFR: Validating primary data.
[2025-10-24T19:45:30.392294] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present.
[2025-10-24T19:45:30.392367] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed.
[2025-10-24T19:45:30.392830] [INFO ] [MAIN      ] LXFR: Fetched primary data is valid.
[2025-10-24T19:45:30.392889] [DEBUG] [LOCAL     ] LXFR: Saving primary data.
[2025-10-24T19:45:30.393151] [FATAL] [LOCAL     ] LXFR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:45:30.393227] [FATAL] [MAIN      ] LXFR: Failed to save primary data.
[2025-10-24T19:45:30.393268] [WARN ] [MAIN      ] LXFR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:45:30.393302] [INFO ] [LOCAL     ] LXFR: Starting deletion of primary data.
[2025-10-24T19:45:30.393350] [DEBUG] [LOCAL     ] LXFR: No primary data file found to delete.
[2025-10-24T19:45:30.393383] [INFO ] [LOCAL     ] LXFR: Starting deletion of derivative data.
[2025-10-24T19:45:30.393538] [DEBUG] [LOCAL     ] LXFR: Deleted derivative data file.
[2025-10-24T19:45:30.393624] [INFO ] [MAIN      ] Update Progress: 1287/2366 symbols completed. LXFR took 29.4s. Estimated remaining: 2h 18m 43s. Rate: 7.8 symbols/min
[2025-10-24T19:45:30.549773] [INFO ] [REMOTE    ] LXP: Fetching primary data for 2025-10.
[2025-10-24T19:45:30.560175] [INFO ] [MAIN      ] LYG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:45:30.610885] [DEBUG] [LOCAL     ] LYG: Loaded 53036 existing records from primary storage.
[2025-10-24T19:45:30.611175] [INFO ] [MAIN      ] LYG: Loaded 53036 existing records.
[2025-10-24T19:45:30.789094] [WARN ] [MAIN      ] LYG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:45:30.789320] [INFO ] [MAIN      ] LYG: Wiping existing primary data before full refresh.
[2025-10-24T19:45:30.789387] [INFO ] [LOCAL     ] LYG: Starting deletion of primary data.
[2025-10-24T19:45:30.789793] [DEBUG] [LOCAL     ] LYG: Deleted primary data file.
[2025-10-24T19:45:30.789855] [INFO ] [MAIN      ] LYG: Starting full primary refresh.
[2025-10-24T19:45:31.142426] [INFO ] [REMOTE    ] LYG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:45:31.310163] [INFO ] [REMOTE    ] LYB: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T19:45:31.347593] [INFO ] [REMOTE    ] LYB: Fetching primary data for 2025-02.
[2025-10-24T19:45:32.155019] [INFO ] [REMOTE    ] LW: Fetching primary data for 2025-08.
[2025-10-24T19:45:32.157336] [INFO ] [REMOTE    ] LXP: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T19:45:32.167146] [INFO ] [REMOTE    ] LXP: Full fetch complete (72837 records).
[2025-10-24T19:45:32.167307] [DEBUG] [VALIDATOR ] LXP: Validating primary data.
[2025-10-24T19:45:32.579413] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present.
[2025-10-24T19:45:32.579492] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed.
[2025-10-24T19:45:32.580532] [INFO ] [MAIN      ] LXP: Fetched primary data is valid.
[2025-10-24T19:45:32.580593] [DEBUG] [LOCAL     ] LXP: Saving primary data.
[2025-10-24T19:45:32.581165] [FATAL] [LOCAL     ] LXP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:45:32.581254] [FATAL] [MAIN      ] LXP: Failed to save primary data.
[2025-10-24T19:45:32.581317] [WARN ] [MAIN      ] LXP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:45:32.581355] [INFO ] [LOCAL     ] LXP: Starting deletion of primary data.
[2025-10-24T19:45:32.581407] [DEBUG] [LOCAL     ] LXP: No primary data file found to delete.
[2025-10-24T19:45:32.581441] [INFO ] [LOCAL     ] LXP: Starting deletion of derivative data.
[2025-10-24T19:45:32.581582] [DEBUG] [LOCAL     ] LXP: Deleted derivative data file.
[2025-10-24T19:45:32.581887] [INFO ] [MAIN      ] Update Progress: 1288/2366 symbols completed. LXP took 31.4s. Estimated remaining: 2h 18m 31s. Rate: 7.8 symbols/min
[2025-10-24T19:45:32.749809] [INFO ] [MAIN      ] LYV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:45:32.800181] [DEBUG] [LOCAL     ] LYV: Loaded 51383 existing records from primary storage.
[2025-10-24T19:45:32.800491] [INFO ] [MAIN      ] LYV: Loaded 51383 existing records.
[2025-10-24T19:45:32.952973] [INFO ] [REMOTE    ] LYG: Fetching primary data for 2025-01.
[2025-10-24T19:45:32.985453] [WARN ] [MAIN      ] LYV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:45:32.985903] [INFO ] [MAIN      ] LYV: Wiping existing primary data before full refresh.
[2025-10-24T19:45:32.986043] [INFO ] [LOCAL     ] LYV: Starting deletion of primary data.
[2025-10-24T19:45:32.986824] [DEBUG] [LOCAL     ] LYV: Deleted primary data file.
[2025-10-24T19:45:32.986884] [INFO ] [MAIN      ] LYV: Starting full primary refresh.
[2025-10-24T19:45:33.182407] [INFO ] [REMOTE    ] LYB: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T19:45:33.402111] [INFO ] [REMOTE    ] LYV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:45:33.747620] [INFO ] [REMOTE    ] LYB: Fetching primary data for 2025-03.
[2025-10-24T19:45:33.881681] [INFO ] [REMOTE    ] LW: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T19:45:34.543923] [INFO ] [REMOTE    ] LYG: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T19:45:34.553216] [INFO ] [REMOTE    ] LW: Fetching primary data for 2025-09.
[2025-10-24T19:45:35.347618] [INFO ] [REMOTE    ] LYG: Fetching primary data for 2025-02.
[2025-10-24T19:45:35.614570] [INFO ] [REMOTE    ] LYB: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T19:45:36.008392] [INFO ] [REMOTE    ] LW: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T19:45:36.147619] [INFO ] [REMOTE    ] LYB: Fetching primary data for 2025-04.
[2025-10-24T19:45:36.839589] [INFO ] [REMOTE    ] LYG: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T19:45:36.947713] [INFO ] [REMOTE    ] LYV: Fetching primary data for 2025-01.
[2025-10-24T19:45:37.747751] [INFO ] [REMOTE    ] LYG: Fetching primary data for 2025-03.
[2025-10-24T19:45:38.501586] [INFO ] [REMOTE    ] LYB: Incremental fetch complete for 2025-04 (2.35 seconds).
[2025-10-24T19:45:38.553904] [INFO ] [REMOTE    ] LW: Fetching primary data for 2025-10.
[2025-10-24T19:45:38.572710] [INFO ] [REMOTE    ] LYV: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T19:45:39.077726] [INFO ] [REMOTE    ] LYG: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T19:45:39.347715] [INFO ] [REMOTE    ] LYB: Fetching primary data for 2025-05.
[2025-10-24T19:45:40.147707] [INFO ] [REMOTE    ] LYV: Fetching primary data for 2025-02.
[2025-10-24T19:45:40.288497] [INFO ] [REMOTE    ] LW: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T19:45:40.298275] [INFO ] [REMOTE    ] LW: Full fetch complete (74763 records).
[2025-10-24T19:45:40.298449] [DEBUG] [VALIDATOR ] LW: Validating primary data.
[2025-10-24T19:45:40.691520] [DEBUG] [VALIDATOR ] LW: All expected trading days are present.
[2025-10-24T19:45:40.691671] [DEBUG] [VALIDATOR ] LW: Primary data validation passed.
[2025-10-24T19:45:40.692751] [INFO ] [MAIN      ] LW: Fetched primary data is valid.
[2025-10-24T19:45:40.692830] [DEBUG] [LOCAL     ] LW: Saving primary data.
[2025-10-24T19:45:40.693395] [FATAL] [LOCAL     ] LW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:45:40.693477] [FATAL] [MAIN      ] LW: Failed to save primary data.
[2025-10-24T19:45:40.693520] [WARN ] [MAIN      ] LW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:45:40.693555] [INFO ] [LOCAL     ] LW: Starting deletion of primary data.
[2025-10-24T19:45:40.693608] [DEBUG] [LOCAL     ] LW: No primary data file found to delete.
[2025-10-24T19:45:40.693704] [INFO ] [LOCAL     ] LW: Starting deletion of derivative data.
[2025-10-24T19:45:40.693826] [DEBUG] [LOCAL     ] LW: Deleted derivative data file.
[2025-10-24T19:45:40.694001] [INFO ] [MAIN      ] Update Progress: 1289/2366 symbols completed. LW took 41.3s. Estimated remaining: 2h 18m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:45:40.865064] [INFO ] [MAIN      ] LZB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:45:40.899895] [DEBUG] [LOCAL     ] LZB: Loaded 35281 existing records from primary storage.
[2025-10-24T19:45:40.900152] [INFO ] [MAIN      ] LZB: Loaded 35281 existing records.
[2025-10-24T19:45:40.963415] [INFO ] [REMOTE    ] LYG: Fetching primary data for 2025-04.
[2025-10-24T19:45:41.083359] [WARN ] [MAIN      ] LZB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:45:41.083733] [INFO ] [MAIN      ] LZB: Wiping existing primary data before full refresh.
[2025-10-24T19:45:41.083830] [INFO ] [LOCAL     ] LZB: Starting deletion of primary data.
[2025-10-24T19:45:41.084310] [DEBUG] [LOCAL     ] LZB: Deleted primary data file.
[2025-10-24T19:45:41.084370] [INFO ] [MAIN      ] LZB: Starting full primary refresh.
[2025-10-24T19:45:41.288561] [INFO ] [REMOTE    ] LYB: Incremental fetch complete for 2025-05 (1.94 seconds).
[2025-10-24T19:45:41.516494] [INFO ] [REMOTE    ] LZB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:45:41.706982] [INFO ] [REMOTE    ] LYV: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T19:45:41.747609] [INFO ] [REMOTE    ] LZB: Fetching primary data for 2025-01.
[2025-10-24T19:45:42.547684] [INFO ] [REMOTE    ] LYV: Fetching primary data for 2025-03.
[2025-10-24T19:45:42.766445] [INFO ] [REMOTE    ] LYG: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T19:45:42.905952] [INFO ] [REMOTE    ] LZB: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T19:45:43.347727] [INFO ] [REMOTE    ] LYB: Fetching primary data for 2025-06.
[2025-10-24T19:45:44.147627] [INFO ] [REMOTE    ] LYG: Fetching primary data for 2025-05.
[2025-10-24T19:45:44.253953] [INFO ] [REMOTE    ] LYV: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T19:45:44.947632] [INFO ] [REMOTE    ] LZB: Fetching primary data for 2025-02.
[2025-10-24T19:45:45.046181] [INFO ] [REMOTE    ] LYB: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T19:45:45.729403] [INFO ] [REMOTE    ] LYG: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T19:45:45.747602] [INFO ] [REMOTE    ] LYG: Fetching primary data for 2025-06.
[2025-10-24T19:45:46.347436] [INFO ] [REMOTE    ] LZB: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T19:45:46.547706] [INFO ] [REMOTE    ] LZB: Fetching primary data for 2025-03.
[2025-10-24T19:45:46.990901] [INFO ] [REMOTE    ] LYG: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T19:45:47.347727] [INFO ] [REMOTE    ] LYG: Fetching primary data for 2025-07.
[2025-10-24T19:45:47.739544] [INFO ] [REMOTE    ] LZB: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T19:45:48.147739] [INFO ] [REMOTE    ] LYB: Fetching primary data for 2025-07.
[2025-10-24T19:45:48.947743] [INFO ] [REMOTE    ] LYV: Fetching primary data for 2025-04.
[2025-10-24T19:45:49.238048] [INFO ] [REMOTE    ] LYG: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T19:45:49.570807] [INFO ] [REMOTE    ] LYB: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T19:45:49.747638] [INFO ] [REMOTE    ] LYG: Fetching primary data for 2025-08.
[2025-10-24T19:45:50.547724] [INFO ] [REMOTE    ] LZB: Fetching primary data for 2025-04.
[2025-10-24T19:45:50.652136] [INFO ] [REMOTE    ] LYV: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T19:45:51.347672] [INFO ] [REMOTE    ] LYV: Fetching primary data for 2025-05.
[2025-10-24T19:45:51.484941] [INFO ] [REMOTE    ] LYG: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T19:45:52.010007] [INFO ] [REMOTE    ] LZB: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T19:45:52.147637] [INFO ] [REMOTE    ] LZB: Fetching primary data for 2025-05.
[2025-10-24T19:45:52.947722] [INFO ] [REMOTE    ] LYB: Fetching primary data for 2025-08.
[2025-10-24T19:45:53.150069] [INFO ] [REMOTE    ] LYV: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T19:45:53.347143] [INFO ] [REMOTE    ] LZB: Incremental fetch complete for 2025-05 (1.20 seconds).
[2025-10-24T19:45:53.747692] [INFO ] [REMOTE    ] LYV: Fetching primary data for 2025-06.
[2025-10-24T19:45:54.547724] [INFO ] [REMOTE    ] LZB: Fetching primary data for 2025-06.
[2025-10-24T19:45:54.591902] [INFO ] [REMOTE    ] LYB: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T19:45:55.328234] [INFO ] [REMOTE    ] LYV: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T19:45:55.347600] [INFO ] [REMOTE    ] LYV: Fetching primary data for 2025-07.
[2025-10-24T19:45:55.439706] [INFO ] [REMOTE    ] LZB: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T19:45:56.147695] [INFO ] [REMOTE    ] LYG: Fetching primary data for 2025-09.
[2025-10-24T19:45:56.947618] [INFO ] [REMOTE    ] LZB: Fetching primary data for 2025-07.
[2025-10-24T19:45:57.086792] [INFO ] [REMOTE    ] LYV: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T19:45:57.747624] [INFO ] [REMOTE    ] LYV: Fetching primary data for 2025-08.
[2025-10-24T19:45:58.125619] [INFO ] [REMOTE    ] LYG: Incremental fetch complete for 2025-09 (1.98 seconds).
[2025-10-24T19:45:58.240950] [INFO ] [REMOTE    ] LZB: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T19:45:58.547710] [INFO ] [REMOTE    ] LYG: Fetching primary data for 2025-10.
[2025-10-24T19:45:59.347685] [INFO ] [REMOTE    ] LZB: Fetching primary data for 2025-08.
[2025-10-24T19:45:59.389902] [INFO ] [REMOTE    ] LYV: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T19:46:00.147672] [INFO ] [REMOTE    ] LYB: Fetching primary data for 2025-09.
[2025-10-24T19:46:00.528069] [INFO ] [REMOTE    ] LYG: Incremental fetch complete for 2025-10 (1.98 seconds).
[2025-10-24T19:46:00.539114] [INFO ] [REMOTE    ] LYG: Full fetch complete (76257 records).
[2025-10-24T19:46:00.539296] [DEBUG] [VALIDATOR ] LYG: Validating primary data.
[2025-10-24T19:46:00.937004] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present.
[2025-10-24T19:46:00.937104] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed.
[2025-10-24T19:46:00.938212] [INFO ] [MAIN      ] LYG: Fetched primary data is valid.
[2025-10-24T19:46:00.938291] [DEBUG] [LOCAL     ] LYG: Saving primary data.
[2025-10-24T19:46:00.938964] [FATAL] [LOCAL     ] LYG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:46:00.950763] [INFO ] [REMOTE    ] LYV: Fetching primary data for 2025-09.
[2025-10-24T19:46:00.950688] [FATAL] [MAIN      ] LYG: Failed to save primary data.
[2025-10-24T19:46:00.958618] [WARN ] [MAIN      ] LYG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:46:00.958931] [INFO ] [LOCAL     ] LYG: Starting deletion of primary data.
[2025-10-24T19:46:00.960389] [INFO ] [REMOTE    ] LZB: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T19:46:00.960509] [DEBUG] [LOCAL     ] LYG: No primary data file found to delete.
[2025-10-24T19:46:00.960593] [INFO ] [LOCAL     ] LYG: Starting deletion of derivative data.
[2025-10-24T19:46:00.968539] [DEBUG] [LOCAL     ] LYG: Deleted derivative data file.
[2025-10-24T19:46:00.969009] [INFO ] [MAIN      ] Update Progress: 1290/2366 symbols completed. LYG took 30.6s. Estimated remaining: 2h 18m 26s. Rate: 7.8 symbols/min
[2025-10-24T19:46:01.144385] [INFO ] [MAIN      ] LZM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:46:01.165068] [DEBUG] [LOCAL     ] LZM: Loaded 14964 existing records from primary storage.
[2025-10-24T19:46:01.165329] [INFO ] [MAIN      ] LZM: Loaded 14964 existing records.
[2025-10-24T19:46:01.356113] [WARN ] [MAIN      ] LZM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:46:01.356396] [INFO ] [MAIN      ] LZM: Wiping existing primary data before full refresh.
[2025-10-24T19:46:01.356450] [INFO ] [LOCAL     ] LZM: Starting deletion of primary data.
[2025-10-24T19:46:01.356633] [DEBUG] [LOCAL     ] LZM: Deleted primary data file.
[2025-10-24T19:46:01.356724] [INFO ] [MAIN      ] LZM: Starting full primary refresh.
[2025-10-24T19:46:01.750326] [INFO ] [REMOTE    ] LZM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:46:01.750477] [INFO ] [REMOTE    ] LZB: Fetching primary data for 2025-09.
[2025-10-24T19:46:01.786156] [INFO ] [REMOTE    ] LYB: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T19:46:02.547629] [INFO ] [REMOTE    ] LZM: Fetching primary data for 2025-01.
[2025-10-24T19:46:02.766204] [INFO ] [REMOTE    ] LYV: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T19:46:02.980378] [INFO ] [REMOTE    ] LZM: Incremental fetch complete for 2025-01 (0.43 seconds).
[2025-10-24T19:46:03.170469] [INFO ] [REMOTE    ] LZB: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T19:46:03.347711] [INFO ] [REMOTE    ] LYB: Fetching primary data for 2025-10.
[2025-10-24T19:46:04.147638] [INFO ] [REMOTE    ] LZM: Fetching primary data for 2025-02.
[2025-10-24T19:46:04.886215] [INFO ] [REMOTE    ] LZM: Incremental fetch complete for 2025-02 (0.74 seconds).
[2025-10-24T19:46:04.947605] [INFO ] [REMOTE    ] LZM: Fetching primary data for 2025-03.
[2025-10-24T19:46:05.490923] [INFO ] [REMOTE    ] LYB: Incremental fetch complete for 2025-10 (2.14 seconds).
[2025-10-24T19:46:05.500703] [INFO ] [REMOTE    ] LYB: Full fetch complete (77635 records).
[2025-10-24T19:46:05.500857] [DEBUG] [VALIDATOR ] LYB: Validating primary data.
[2025-10-24T19:46:05.752757] [INFO ] [REMOTE    ] LYV: Fetching primary data for 2025-10.
[2025-10-24T19:46:05.906283] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present.
[2025-10-24T19:46:05.906426] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed.
[2025-10-24T19:46:05.907906] [INFO ] [REMOTE    ] LZM: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T19:46:05.909080] [INFO ] [MAIN      ] LYB: Fetched primary data is valid.
[2025-10-24T19:46:05.909288] [DEBUG] [LOCAL     ] LYB: Saving primary data.
[2025-10-24T19:46:05.914259] [FATAL] [LOCAL     ] LYB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:46:05.914722] [FATAL] [MAIN      ] LYB: Failed to save primary data.
[2025-10-24T19:46:05.914790] [WARN ] [MAIN      ] LYB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:46:05.914863] [INFO ] [LOCAL     ] LYB: Starting deletion of primary data.
[2025-10-24T19:46:05.914928] [DEBUG] [LOCAL     ] LYB: No primary data file found to delete.
[2025-10-24T19:46:05.914964] [INFO ] [LOCAL     ] LYB: Starting deletion of derivative data.
[2025-10-24T19:46:05.915106] [DEBUG] [LOCAL     ] LYB: Deleted derivative data file.
[2025-10-24T19:46:05.915317] [INFO ] [MAIN      ] Update Progress: 1291/2366 symbols completed. LYB took 37.7s. Estimated remaining: 2h 18m 16s. Rate: 7.8 symbols/min
[2025-10-24T19:46:06.079458] [INFO ] [MAIN      ] M: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:46:06.133196] [DEBUG] [LOCAL     ] M: Loaded 53934 existing records from primary storage.
[2025-10-24T19:46:06.133510] [INFO ] [MAIN      ] M: Loaded 53934 existing records.
[2025-10-24T19:46:06.305107] [WARN ] [MAIN      ] M: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:46:06.305340] [INFO ] [MAIN      ] M: Wiping existing primary data before full refresh.
[2025-10-24T19:46:06.305387] [INFO ] [LOCAL     ] M: Starting deletion of primary data.
[2025-10-24T19:46:06.305919] [DEBUG] [LOCAL     ] M: Deleted primary data file.
[2025-10-24T19:46:06.305975] [INFO ] [MAIN      ] M: Starting full primary refresh.
[2025-10-24T19:46:06.552763] [INFO ] [REMOTE    ] LZB: Fetching primary data for 2025-10.
[2025-10-24T19:46:06.651058] [INFO ] [REMOTE    ] M: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:46:07.347670] [INFO ] [REMOTE    ] M: Fetching primary data for 2025-01.
[2025-10-24T19:46:07.566471] [INFO ] [REMOTE    ] LYV: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T19:46:07.575947] [INFO ] [REMOTE    ] LYV: Full fetch complete (74144 records).
[2025-10-24T19:46:07.576071] [DEBUG] [VALIDATOR ] LYV: Validating primary data.
[2025-10-24T19:46:07.967969] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present.
[2025-10-24T19:46:07.968068] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed.
[2025-10-24T19:46:07.969239] [INFO ] [MAIN      ] LYV: Fetched primary data is valid.
[2025-10-24T19:46:07.969302] [DEBUG] [LOCAL     ] LYV: Saving primary data.
[2025-10-24T19:46:07.969891] [FATAL] [LOCAL     ] LYV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:46:07.969976] [FATAL] [MAIN      ] LYV: Failed to save primary data.
[2025-10-24T19:46:07.970018] [WARN ] [MAIN      ] LYV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:46:07.970078] [INFO ] [LOCAL     ] LYV: Starting deletion of primary data.
[2025-10-24T19:46:07.970138] [DEBUG] [LOCAL     ] LYV: No primary data file found to delete.
[2025-10-24T19:46:07.970174] [INFO ] [LOCAL     ] LYV: Starting deletion of derivative data.
[2025-10-24T19:46:07.970304] [DEBUG] [LOCAL     ] LYV: Deleted derivative data file.
[2025-10-24T19:46:07.970542] [INFO ] [MAIN      ] Update Progress: 1292/2366 symbols completed. LYV took 35.4s. Estimated remaining: 2h 18m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:46:08.153575] [INFO ] [REMOTE    ] LZB: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T19:46:08.152677] [INFO ] [REMOTE    ] LZM: Fetching primary data for 2025-04.
[2025-10-24T19:46:08.165330] [INFO ] [MAIN      ] MA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:46:08.173383] [INFO ] [REMOTE    ] LZB: Full fetch complete (51146 records).
[2025-10-24T19:46:08.173531] [DEBUG] [VALIDATOR ] LZB: Validating primary data.
[2025-10-24T19:46:08.572430] [DEBUG] [LOCAL     ] MA: Loaded 52828 existing records from primary storage.
[2025-10-24T19:46:08.598440] [INFO ] [MAIN      ] MA: Loaded 52828 existing records.
[2025-10-24T19:46:08.680471] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present.
[2025-10-24T19:46:08.732093] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed.
[2025-10-24T19:46:08.733178] [INFO ] [MAIN      ] LZB: Fetched primary data is valid.
[2025-10-24T19:46:08.747247] [DEBUG] [LOCAL     ] LZB: Saving primary data.
[2025-10-24T19:46:08.755347] [FATAL] [LOCAL     ] LZB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:46:08.759232] [FATAL] [MAIN      ] LZB: Failed to save primary data.
[2025-10-24T19:46:08.759667] [WARN ] [MAIN      ] LZB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:46:08.770155] [INFO ] [LOCAL     ] LZB: Starting deletion of primary data.
[2025-10-24T19:46:08.775532] [DEBUG] [LOCAL     ] LZB: No primary data file found to delete.
[2025-10-24T19:46:08.775681] [INFO ] [LOCAL     ] LZB: Starting deletion of derivative data.
[2025-10-24T19:46:08.786161] [DEBUG] [LOCAL     ] LZB: Deleted derivative data file.
[2025-10-24T19:46:08.843058] [INFO ] [MAIN      ] Update Progress: 1293/2366 symbols completed. LZB took 28.1s. Estimated remaining: 2h 17m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:46:08.842541] [WARN ] [MAIN      ] MA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:46:08.874661] [INFO ] [MAIN      ] MA: Wiping existing primary data before full refresh.
[2025-10-24T19:46:08.874743] [INFO ] [LOCAL     ] MA: Starting deletion of primary data.
[2025-10-24T19:46:08.898973] [DEBUG] [LOCAL     ] MA: Deleted primary data file.
[2025-10-24T19:46:08.918322] [INFO ] [MAIN      ] MA: Starting full primary refresh.
[2025-10-24T19:46:09.127364] [INFO ] [MAIN      ] MAA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:46:09.236151] [INFO ] [REMOTE    ] M: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T19:46:09.266607] [INFO ] [REMOTE    ] LZM: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T19:46:09.297072] [INFO ] [REMOTE    ] LZM: Fetching primary data for 2025-05.
[2025-10-24T19:46:09.480692] [DEBUG] [LOCAL     ] MAA: Loaded 43322 existing records from primary storage.
[2025-10-24T19:46:09.496931] [INFO ] [MAIN      ] MAA: Loaded 43322 existing records.
[2025-10-24T19:46:09.500696] [INFO ] [REMOTE    ] MA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:46:09.676035] [WARN ] [MAIN      ] MAA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:46:09.676251] [INFO ] [MAIN      ] MAA: Wiping existing primary data before full refresh.
[2025-10-24T19:46:09.676325] [INFO ] [LOCAL     ] MAA: Starting deletion of primary data.
[2025-10-24T19:46:09.676742] [DEBUG] [LOCAL     ] MAA: Deleted primary data file.
[2025-10-24T19:46:09.676799] [INFO ] [MAIN      ] MAA: Starting full primary refresh.
[2025-10-24T19:46:09.752836] [INFO ] [REMOTE    ] MA: Fetching primary data for 2025-01.
[2025-10-24T19:46:10.026817] [INFO ] [REMOTE    ] MAA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:46:10.105895] [INFO ] [REMOTE    ] LZM: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T19:46:10.547726] [INFO ] [REMOTE    ] MAA: Fetching primary data for 2025-01.
[2025-10-24T19:46:11.347702] [INFO ] [REMOTE    ] M: Fetching primary data for 2025-02.
[2025-10-24T19:46:11.640988] [INFO ] [REMOTE    ] MA: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T19:46:12.147712] [INFO ] [REMOTE    ] MA: Fetching primary data for 2025-02.
[2025-10-24T19:46:12.270233] [INFO ] [REMOTE    ] MAA: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T19:46:12.944605] [INFO ] [REMOTE    ] M: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T19:46:12.953910] [INFO ] [REMOTE    ] MAA: Fetching primary data for 2025-02.
[2025-10-24T19:46:13.747702] [INFO ] [REMOTE    ] LZM: Fetching primary data for 2025-06.
[2025-10-24T19:46:14.032716] [INFO ] [REMOTE    ] MA: Incremental fetch complete for 2025-02 (1.89 seconds).
[2025-10-24T19:46:14.265976] [INFO ] [REMOTE    ] LZM: Incremental fetch complete for 2025-06 (0.52 seconds).
[2025-10-24T19:46:14.371512] [INFO ] [REMOTE    ] MAA: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T19:46:14.547630] [INFO ] [REMOTE    ] MAA: Fetching primary data for 2025-03.
[2025-10-24T19:46:15.347686] [INFO ] [REMOTE    ] LZM: Fetching primary data for 2025-07.
[2025-10-24T19:46:16.147624] [INFO ] [REMOTE    ] M: Fetching primary data for 2025-03.
[2025-10-24T19:46:16.322760] [INFO ] [REMOTE    ] LZM: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T19:46:16.792414] [INFO ] [REMOTE    ] MAA: Incremental fetch complete for 2025-03 (2.24 seconds).
[2025-10-24T19:46:16.947665] [INFO ] [REMOTE    ] MA: Fetching primary data for 2025-03.
[2025-10-24T19:46:17.646338] [INFO ] [REMOTE    ] M: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T19:46:17.747672] [INFO ] [REMOTE    ] M: Fetching primary data for 2025-04.
[2025-10-24T19:46:18.547687] [INFO ] [REMOTE    ] MAA: Fetching primary data for 2025-04.
[2025-10-24T19:46:18.684599] [INFO ] [REMOTE    ] MA: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T19:46:19.248396] [INFO ] [REMOTE    ] M: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T19:46:19.347637] [INFO ] [REMOTE    ] M: Fetching primary data for 2025-05.
[2025-10-24T19:46:20.062319] [INFO ] [REMOTE    ] MAA: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T19:46:20.147637] [INFO ] [REMOTE    ] MA: Fetching primary data for 2025-04.
[2025-10-24T19:46:20.947680] [INFO ] [REMOTE    ] MAA: Fetching primary data for 2025-05.
[2025-10-24T19:46:21.402569] [INFO ] [REMOTE    ] M: Incremental fetch complete for 2025-05 (2.05 seconds).
[2025-10-24T19:46:21.747672] [INFO ] [REMOTE    ] LZM: Fetching primary data for 2025-08.
[2025-10-24T19:46:22.250311] [INFO ] [REMOTE    ] MA: Incremental fetch complete for 2025-04 (2.10 seconds).
[2025-10-24T19:46:22.321347] [INFO ] [REMOTE    ] MAA: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T19:46:22.434485] [INFO ] [REMOTE    ] LZM: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T19:46:22.547684] [INFO ] [REMOTE    ] M: Fetching primary data for 2025-06.
[2025-10-24T19:46:23.347682] [INFO ] [REMOTE    ] MAA: Fetching primary data for 2025-06.
[2025-10-24T19:46:24.147625] [INFO ] [REMOTE    ] MA: Fetching primary data for 2025-05.
[2025-10-24T19:46:24.244499] [INFO ] [REMOTE    ] M: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T19:46:24.849712] [INFO ] [REMOTE    ] MAA: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T19:46:24.947678] [INFO ] [REMOTE    ] MAA: Fetching primary data for 2025-07.
[2025-10-24T19:46:25.572325] [INFO ] [REMOTE    ] MA: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T19:46:25.747693] [INFO ] [REMOTE    ] LZM: Fetching primary data for 2025-09.
[2025-10-24T19:46:26.281025] [INFO ] [REMOTE    ] MAA: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T19:46:26.322366] [INFO ] [REMOTE    ] LZM: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T19:46:26.547717] [INFO ] [REMOTE    ] M: Fetching primary data for 2025-07.
[2025-10-24T19:46:27.347678] [INFO ] [REMOTE    ] MAA: Fetching primary data for 2025-08.
[2025-10-24T19:46:28.147627] [INFO ] [REMOTE    ] LZM: Fetching primary data for 2025-10.
[2025-10-24T19:46:28.456305] [INFO ] [REMOTE    ] M: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T19:46:28.936622] [INFO ] [REMOTE    ] MAA: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T19:46:28.947593] [INFO ] [REMOTE    ] MAA: Fetching primary data for 2025-09.
[2025-10-24T19:46:29.283388] [INFO ] [REMOTE    ] LZM: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T19:46:29.288215] [INFO ] [REMOTE    ] LZM: Full fetch complete (20074 records).
[2025-10-24T19:46:29.288305] [DEBUG] [VALIDATOR ] LZM: Validating primary data.
[2025-10-24T19:46:29.670364] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present.
[2025-10-24T19:46:29.670468] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed.
[2025-10-24T19:46:29.671356] [INFO ] [MAIN      ] LZM: Fetched primary data is valid.
[2025-10-24T19:46:29.671423] [DEBUG] [LOCAL     ] LZM: Saving primary data.
[2025-10-24T19:46:29.671963] [FATAL] [LOCAL     ] LZM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:46:29.672073] [FATAL] [MAIN      ] LZM: Failed to save primary data.
[2025-10-24T19:46:29.672117] [WARN ] [MAIN      ] LZM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:46:29.672161] [INFO ] [LOCAL     ] LZM: Starting deletion of primary data.
[2025-10-24T19:46:29.672217] [DEBUG] [LOCAL     ] LZM: No primary data file found to delete.
[2025-10-24T19:46:29.672254] [INFO ] [LOCAL     ] LZM: Starting deletion of derivative data.
[2025-10-24T19:46:29.672389] [DEBUG] [LOCAL     ] LZM: Deleted derivative data file.
[2025-10-24T19:46:29.672479] [INFO ] [MAIN      ] Update Progress: 1294/2366 symbols completed. LZM took 28.7s. Estimated remaining: 2h 17m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:46:29.754106] [INFO ] [REMOTE    ] M: Fetching primary data for 2025-08.
[2025-10-24T19:46:29.864334] [INFO ] [MAIN      ] MAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:46:29.924333] [DEBUG] [LOCAL     ] MAC: Loaded 49975 existing records from primary storage.
[2025-10-24T19:46:29.924847] [INFO ] [MAIN      ] MAC: Loaded 49975 existing records.
[2025-10-24T19:46:30.149821] [WARN ] [MAIN      ] MAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:46:30.150109] [INFO ] [MAIN      ] MAC: Wiping existing primary data before full refresh.
[2025-10-24T19:46:30.150163] [INFO ] [LOCAL     ] MAC: Starting deletion of primary data.
[2025-10-24T19:46:30.150429] [DEBUG] [LOCAL     ] MAC: Deleted primary data file.
[2025-10-24T19:46:30.150518] [INFO ] [MAIN      ] MAC: Starting full primary refresh.
[2025-10-24T19:46:30.521005] [INFO ] [REMOTE    ] MAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:46:30.547638] [INFO ] [REMOTE    ] MA: Fetching primary data for 2025-06.
[2025-10-24T19:46:30.820371] [INFO ] [REMOTE    ] MAA: Incremental fetch complete for 2025-09 (1.87 seconds).
[2025-10-24T19:46:31.347630] [INFO ] [REMOTE    ] MAA: Fetching primary data for 2025-10.
[2025-10-24T19:46:31.612457] [INFO ] [REMOTE    ] M: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T19:46:32.147737] [INFO ] [REMOTE    ] M: Fetching primary data for 2025-09.
[2025-10-24T19:46:32.307619] [INFO ] [REMOTE    ] MA: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T19:46:32.666767] [INFO ] [REMOTE    ] MAA: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T19:46:32.675566] [INFO ] [REMOTE    ] MAA: Full fetch complete (61937 records).
[2025-10-24T19:46:32.675769] [DEBUG] [VALIDATOR ] MAA: Validating primary data.
[2025-10-24T19:46:32.958998] [INFO ] [REMOTE    ] MAC: Fetching primary data for 2025-01.
[2025-10-24T19:46:33.100560] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present.
[2025-10-24T19:46:33.100635] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed.
[2025-10-24T19:46:33.101632] [INFO ] [MAIN      ] MAA: Fetched primary data is valid.
[2025-10-24T19:46:33.101716] [DEBUG] [LOCAL     ] MAA: Saving primary data.
[2025-10-24T19:46:33.102289] [FATAL] [LOCAL     ] MAA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:46:33.102375] [FATAL] [MAIN      ] MAA: Failed to save primary data.
[2025-10-24T19:46:33.102445] [WARN ] [MAIN      ] MAA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:46:33.102514] [INFO ] [LOCAL     ] MAA: Starting deletion of primary data.
[2025-10-24T19:46:33.102574] [DEBUG] [LOCAL     ] MAA: No primary data file found to delete.
[2025-10-24T19:46:33.102610] [INFO ] [LOCAL     ] MAA: Starting deletion of derivative data.
[2025-10-24T19:46:33.102800] [DEBUG] [LOCAL     ] MAA: Deleted derivative data file.
[2025-10-24T19:46:33.103182] [INFO ] [MAIN      ] Update Progress: 1295/2366 symbols completed. MAA took 24.3s. Estimated remaining: 2h 17m 42s. Rate: 7.8 symbols/min
[2025-10-24T19:46:33.268498] [INFO ] [MAIN      ] MAGN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:46:33.305745] [DEBUG] [LOCAL     ] MAGN: Loaded 36410 existing records from primary storage.
[2025-10-24T19:46:33.306012] [INFO ] [MAIN      ] MAGN: Loaded 36410 existing records.
[2025-10-24T19:46:33.480185] [WARN ] [MAIN      ] MAGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:46:33.480480] [INFO ] [MAIN      ] MAGN: Wiping existing primary data before full refresh.
[2025-10-24T19:46:33.480585] [INFO ] [LOCAL     ] MAGN: Starting deletion of primary data.
[2025-10-24T19:46:33.480999] [DEBUG] [LOCAL     ] MAGN: Deleted primary data file.
[2025-10-24T19:46:33.481050] [INFO ] [MAIN      ] MAGN: Starting full primary refresh.
[2025-10-24T19:46:33.751048] [INFO ] [REMOTE    ] MA: Fetching primary data for 2025-07.
[2025-10-24T19:46:33.848460] [INFO ] [REMOTE    ] MAGN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:46:33.878069] [INFO ] [REMOTE    ] M: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T19:46:34.419489] [INFO ] [REMOTE    ] MAC: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T19:46:34.547707] [INFO ] [REMOTE    ] M: Fetching primary data for 2025-10.
[2025-10-24T19:46:35.347673] [INFO ] [REMOTE    ] MAC: Fetching primary data for 2025-02.
[2025-10-24T19:46:35.636272] [INFO ] [REMOTE    ] MA: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T19:46:36.147637] [INFO ] [REMOTE    ] MAGN: Fetching primary data for 2025-01.
[2025-10-24T19:46:36.266998] [INFO ] [REMOTE    ] M: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T19:46:36.277406] [INFO ] [REMOTE    ] M: Full fetch complete (77657 records).
[2025-10-24T19:46:36.277545] [DEBUG] [VALIDATOR ] M: Validating primary data.
[2025-10-24T19:46:36.697816] [DEBUG] [VALIDATOR ] M: All expected trading days are present.
[2025-10-24T19:46:36.697947] [DEBUG] [VALIDATOR ] M: Primary data validation passed.
[2025-10-24T19:46:36.699168] [INFO ] [MAIN      ] M: Fetched primary data is valid.
[2025-10-24T19:46:36.699246] [DEBUG] [LOCAL     ] M: Saving primary data.
[2025-10-24T19:46:36.700070] [FATAL] [LOCAL     ] M: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:46:36.700176] [FATAL] [MAIN      ] M: Failed to save primary data.
[2025-10-24T19:46:36.700249] [WARN ] [MAIN      ] M: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:46:36.700320] [INFO ] [LOCAL     ] M: Starting deletion of primary data.
[2025-10-24T19:46:36.700384] [DEBUG] [LOCAL     ] M: No primary data file found to delete.
[2025-10-24T19:46:36.700436] [INFO ] [LOCAL     ] M: Starting deletion of derivative data.
[2025-10-24T19:46:36.700804] [DEBUG] [LOCAL     ] M: Deleted derivative data file.
[2025-10-24T19:46:36.701759] [INFO ] [MAIN      ] Update Progress: 1296/2366 symbols completed. M took 30.8s. Estimated remaining: 2h 17m 31s. Rate: 7.8 symbols/min
[2025-10-24T19:46:36.902365] [INFO ] [MAIN      ] MAIN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:46:36.904363] [INFO ] [REMOTE    ] MAC: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T19:46:36.951539] [INFO ] [REMOTE    ] MA: Fetching primary data for 2025-08.
[2025-10-24T19:46:36.953400] [DEBUG] [LOCAL     ] MAIN: Loaded 42219 existing records from primary storage.
[2025-10-24T19:46:36.953844] [INFO ] [MAIN      ] MAIN: Loaded 42219 existing records.
[2025-10-24T19:46:37.138746] [WARN ] [MAIN      ] MAIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:46:37.138927] [INFO ] [MAIN      ] MAIN: Wiping existing primary data before full refresh.
[2025-10-24T19:46:37.138974] [INFO ] [LOCAL     ] MAIN: Starting deletion of primary data.
[2025-10-24T19:46:37.139359] [DEBUG] [LOCAL     ] MAIN: Deleted primary data file.
[2025-10-24T19:46:37.139411] [INFO ] [MAIN      ] MAIN: Starting full primary refresh.
[2025-10-24T19:46:37.506258] [INFO ] [REMOTE    ] MAIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:46:37.607414] [INFO ] [REMOTE    ] MAGN: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T19:46:37.747634] [INFO ] [REMOTE    ] MAIN: Fetching primary data for 2025-01.
[2025-10-24T19:46:38.547608] [INFO ] [REMOTE    ] MAC: Fetching primary data for 2025-03.
[2025-10-24T19:46:39.183717] [INFO ] [REMOTE    ] MA: Incremental fetch complete for 2025-08 (2.23 seconds).
[2025-10-24T19:46:39.347706] [INFO ] [REMOTE    ] MA: Fetching primary data for 2025-09.
[2025-10-24T19:46:39.565077] [INFO ] [REMOTE    ] MAIN: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T19:46:39.687124] [INFO ] [REMOTE    ] MAC: Incremental fetch complete for 2025-03 (1.14 seconds).
[2025-10-24T19:46:40.147740] [INFO ] [REMOTE    ] MAGN: Fetching primary data for 2025-02.
[2025-10-24T19:46:40.901100] [INFO ] [REMOTE    ] MA: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T19:46:40.947639] [INFO ] [REMOTE    ] MA: Fetching primary data for 2025-10.
[2025-10-24T19:46:41.445916] [INFO ] [REMOTE    ] MAGN: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T19:46:41.747622] [INFO ] [REMOTE    ] MAGN: Fetching primary data for 2025-03.
[2025-10-24T19:46:42.547750] [INFO ] [REMOTE    ] MAC: Fetching primary data for 2025-04.
[2025-10-24T19:46:43.120956] [INFO ] [REMOTE    ] MA: Incremental fetch complete for 2025-10 (2.17 seconds).
[2025-10-24T19:46:43.130911] [INFO ] [REMOTE    ] MA: Full fetch complete (76382 records).
[2025-10-24T19:46:43.131034] [DEBUG] [VALIDATOR ] MA: Validating primary data.
[2025-10-24T19:46:43.292042] [INFO ] [REMOTE    ] MAGN: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T19:46:43.357673] [INFO ] [REMOTE    ] MAIN: Fetching primary data for 2025-02.
[2025-10-24T19:46:43.557832] [DEBUG] [VALIDATOR ] MA: All expected trading days are present.
[2025-10-24T19:46:43.557909] [DEBUG] [VALIDATOR ] MA: Primary data validation passed.
[2025-10-24T19:46:43.559030] [INFO ] [MAIN      ] MA: Fetched primary data is valid.
[2025-10-24T19:46:43.559092] [DEBUG] [LOCAL     ] MA: Saving primary data.
[2025-10-24T19:46:43.559635] [FATAL] [LOCAL     ] MA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:46:43.559748] [FATAL] [MAIN      ] MA: Failed to save primary data.
[2025-10-24T19:46:43.559789] [WARN ] [MAIN      ] MA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:46:43.559848] [INFO ] [LOCAL     ] MA: Starting deletion of primary data.
[2025-10-24T19:46:43.559907] [DEBUG] [LOCAL     ] MA: No primary data file found to delete.
[2025-10-24T19:46:43.559942] [INFO ] [LOCAL     ] MA: Starting deletion of derivative data.
[2025-10-24T19:46:43.560093] [DEBUG] [LOCAL     ] MA: Deleted derivative data file.
[2025-10-24T19:46:43.560332] [INFO ] [MAIN      ] Update Progress: 1297/2366 symbols completed. MA took 35.6s. Estimated remaining: 2h 17m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:46:43.739063] [INFO ] [MAIN      ] MAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:46:43.781819] [DEBUG] [LOCAL     ] MAN: Loaded 44638 existing records from primary storage.
[2025-10-24T19:46:43.798820] [INFO ] [MAIN      ] MAN: Loaded 44638 existing records.
[2025-10-24T19:46:43.879075] [INFO ] [REMOTE    ] MAC: Incremental fetch complete for 2025-04 (1.33 seconds).
[2025-10-24T19:46:44.004517] [WARN ] [MAIN      ] MAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:46:44.004765] [INFO ] [MAIN      ] MAN: Wiping existing primary data before full refresh.
[2025-10-24T19:46:44.004819] [INFO ] [LOCAL     ] MAN: Starting deletion of primary data.
[2025-10-24T19:46:44.005014] [DEBUG] [LOCAL     ] MAN: Deleted primary data file.
[2025-10-24T19:46:44.005090] [INFO ] [MAIN      ] MAN: Starting full primary refresh.
[2025-10-24T19:46:44.158387] [INFO ] [REMOTE    ] MAC: Fetching primary data for 2025-05.
[2025-10-24T19:46:44.355827] [INFO ] [REMOTE    ] MAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:46:44.947705] [INFO ] [REMOTE    ] MAGN: Fetching primary data for 2025-04.
[2025-10-24T19:46:45.145147] [INFO ] [REMOTE    ] MAIN: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T19:46:45.747748] [INFO ] [REMOTE    ] MAN: Fetching primary data for 2025-01.
[2025-10-24T19:46:45.919205] [INFO ] [REMOTE    ] MAC: Incremental fetch complete for 2025-05 (1.76 seconds).
[2025-10-24T19:46:46.303022] [INFO ] [REMOTE    ] MAGN: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T19:46:46.547740] [INFO ] [REMOTE    ] MAIN: Fetching primary data for 2025-03.
[2025-10-24T19:46:46.813936] [INFO ] [REMOTE    ] MAN: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T19:46:47.347736] [INFO ] [REMOTE    ] MAGN: Fetching primary data for 2025-05.
[2025-10-24T19:46:48.147638] [INFO ] [REMOTE    ] MAC: Fetching primary data for 2025-06.
[2025-10-24T19:46:48.286822] [INFO ] [REMOTE    ] MAIN: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T19:46:48.900392] [INFO ] [REMOTE    ] MAGN: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T19:46:48.947676] [INFO ] [REMOTE    ] MAGN: Fetching primary data for 2025-06.
[2025-10-24T19:46:49.366178] [INFO ] [REMOTE    ] MAC: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T19:46:49.747707] [INFO ] [REMOTE    ] MAIN: Fetching primary data for 2025-04.
[2025-10-24T19:46:50.334602] [INFO ] [REMOTE    ] MAGN: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T19:46:50.547720] [INFO ] [REMOTE    ] MAGN: Fetching primary data for 2025-07.
[2025-10-24T19:46:51.347707] [INFO ] [REMOTE    ] MAN: Fetching primary data for 2025-02.
[2025-10-24T19:46:51.623618] [INFO ] [REMOTE    ] MAIN: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T19:46:51.700523] [INFO ] [REMOTE    ] MAGN: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T19:46:52.147677] [INFO ] [REMOTE    ] MAC: Fetching primary data for 2025-07.
[2025-10-24T19:46:52.661231] [INFO ] [REMOTE    ] MAN: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T19:46:52.947672] [INFO ] [REMOTE    ] MAN: Fetching primary data for 2025-03.
[2025-10-24T19:46:53.627259] [INFO ] [REMOTE    ] MAC: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T19:46:53.747600] [INFO ] [REMOTE    ] MAC: Fetching primary data for 2025-08.
[2025-10-24T19:46:54.453277] [INFO ] [REMOTE    ] MAN: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T19:46:54.547619] [INFO ] [REMOTE    ] MAN: Fetching primary data for 2025-04.
[2025-10-24T19:46:55.347629] [INFO ] [REMOTE    ] MAGN: Fetching primary data for 2025-08.
[2025-10-24T19:46:55.443214] [INFO ] [REMOTE    ] MAC: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T19:46:56.147706] [INFO ] [REMOTE    ] MAC: Fetching primary data for 2025-09.
[2025-10-24T19:46:56.269912] [INFO ] [REMOTE    ] MAN: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T19:46:56.529165] [INFO ] [REMOTE    ] MAGN: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T19:46:56.947637] [INFO ] [REMOTE    ] MAN: Fetching primary data for 2025-05.
[2025-10-24T19:46:57.747704] [INFO ] [REMOTE    ] MAGN: Fetching primary data for 2025-09.
[2025-10-24T19:46:57.851015] [INFO ] [REMOTE    ] MAC: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T19:46:58.401794] [INFO ] [REMOTE    ] MAN: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T19:46:58.547626] [INFO ] [REMOTE    ] MAN: Fetching primary data for 2025-06.
[2025-10-24T19:46:59.103580] [INFO ] [REMOTE    ] MAGN: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T19:46:59.347638] [INFO ] [REMOTE    ] MAC: Fetching primary data for 2025-10.
[2025-10-24T19:47:00.030419] [INFO ] [REMOTE    ] MAN: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T19:47:00.147703] [INFO ] [REMOTE    ] MAN: Fetching primary data for 2025-07.
[2025-10-24T19:47:00.947683] [INFO ] [REMOTE    ] MAGN: Fetching primary data for 2025-10.
[2025-10-24T19:47:00.985226] [INFO ] [REMOTE    ] MAC: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T19:47:00.994060] [INFO ] [REMOTE    ] MAC: Full fetch complete (71527 records).
[2025-10-24T19:47:00.994197] [DEBUG] [VALIDATOR ] MAC: Validating primary data.
[2025-10-24T19:47:01.378389] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present.
[2025-10-24T19:47:01.378464] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed.
[2025-10-24T19:47:01.379483] [INFO ] [MAIN      ] MAC: Fetched primary data is valid.
[2025-10-24T19:47:01.379545] [DEBUG] [LOCAL     ] MAC: Saving primary data.
[2025-10-24T19:47:01.380098] [FATAL] [LOCAL     ] MAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:47:01.380187] [FATAL] [MAIN      ] MAC: Failed to save primary data.
[2025-10-24T19:47:01.380230] [WARN ] [MAIN      ] MAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:47:01.380264] [INFO ] [LOCAL     ] MAC: Starting deletion of primary data.
[2025-10-24T19:47:01.380332] [DEBUG] [LOCAL     ] MAC: No primary data file found to delete.
[2025-10-24T19:47:01.380391] [INFO ] [LOCAL     ] MAC: Starting deletion of derivative data.
[2025-10-24T19:47:01.380521] [DEBUG] [LOCAL     ] MAC: Deleted derivative data file.
[2025-10-24T19:47:01.380900] [INFO ] [MAIN      ] Update Progress: 1298/2366 symbols completed. MAC took 31.7s. Estimated remaining: 2h 17m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:47:01.547465] [INFO ] [MAIN      ] MANU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:47:01.575635] [DEBUG] [LOCAL     ] MANU: Loaded 27359 existing records from primary storage.
[2025-10-24T19:47:01.575915] [INFO ] [MAIN      ] MANU: Loaded 27359 existing records.
[2025-10-24T19:47:01.759105] [WARN ] [MAIN      ] MANU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:47:01.754012] [INFO ] [REMOTE    ] MAIN: Fetching primary data for 2025-05.
[2025-10-24T19:47:01.759348] [INFO ] [MAIN      ] MANU: Wiping existing primary data before full refresh.
[2025-10-24T19:47:01.760130] [INFO ] [LOCAL     ] MANU: Starting deletion of primary data.
[2025-10-24T19:47:01.760424] [DEBUG] [LOCAL     ] MANU: Deleted primary data file.
[2025-10-24T19:47:01.760479] [INFO ] [MAIN      ] MANU: Starting full primary refresh.
[2025-10-24T19:47:02.124608] [INFO ] [REMOTE    ] MANU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:47:02.155359] [INFO ] [REMOTE    ] MAN: Incremental fetch complete for 2025-07 (2.01 seconds).
[2025-10-24T19:47:02.272856] [INFO ] [REMOTE    ] MAGN: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T19:47:02.283861] [INFO ] [REMOTE    ] MAGN: Full fetch complete (51879 records).
[2025-10-24T19:47:02.284053] [DEBUG] [VALIDATOR ] MAGN: Validating primary data.
[2025-10-24T19:47:02.552741] [INFO ] [REMOTE    ] MANU: Fetching primary data for 2025-01.
[2025-10-24T19:47:02.667980] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present.
[2025-10-24T19:47:02.668060] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed.
[2025-10-24T19:47:02.668950] [INFO ] [MAIN      ] MAGN: Fetched primary data is valid.
[2025-10-24T19:47:02.669011] [DEBUG] [LOCAL     ] MAGN: Saving primary data.
[2025-10-24T19:47:02.669459] [FATAL] [LOCAL     ] MAGN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:47:02.669558] [FATAL] [MAIN      ] MAGN: Failed to save primary data.
[2025-10-24T19:47:02.669678] [WARN ] [MAIN      ] MAGN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:47:02.669766] [INFO ] [LOCAL     ] MAGN: Starting deletion of primary data.
[2025-10-24T19:47:02.669841] [DEBUG] [LOCAL     ] MAGN: No primary data file found to delete.
[2025-10-24T19:47:02.669877] [INFO ] [LOCAL     ] MAGN: Starting deletion of derivative data.
[2025-10-24T19:47:02.670025] [DEBUG] [LOCAL     ] MAGN: Deleted derivative data file.
[2025-10-24T19:47:02.670554] [INFO ] [MAIN      ] Update Progress: 1299/2366 symbols completed. MAGN took 29.6s. Estimated remaining: 2h 17m 10s. Rate: 7.8 symbols/min
[2025-10-24T19:47:02.835337] [INFO ] [MAIN      ] MAS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:47:02.897098] [DEBUG] [LOCAL     ] MAS: Loaded 52573 existing records from primary storage.
[2025-10-24T19:47:02.897428] [INFO ] [MAIN      ] MAS: Loaded 52573 existing records.
[2025-10-24T19:47:03.087870] [WARN ] [MAIN      ] MAS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:47:03.088189] [INFO ] [MAIN      ] MAS: Wiping existing primary data before full refresh.
[2025-10-24T19:47:03.088256] [INFO ] [LOCAL     ] MAS: Starting deletion of primary data.
[2025-10-24T19:47:03.088971] [DEBUG] [LOCAL     ] MAS: Deleted primary data file.
[2025-10-24T19:47:03.089027] [INFO ] [MAIN      ] MAS: Starting full primary refresh.
[2025-10-24T19:47:03.362093] [INFO ] [REMOTE    ] MAN: Fetching primary data for 2025-08.
[2025-10-24T19:47:03.475929] [INFO ] [REMOTE    ] MAS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:47:03.490677] [INFO ] [REMOTE    ] MAIN: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T19:47:03.621045] [INFO ] [REMOTE    ] MANU: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T19:47:04.147639] [INFO ] [REMOTE    ] MAS: Fetching primary data for 2025-01.
[2025-10-24T19:47:04.947745] [INFO ] [REMOTE    ] MAIN: Fetching primary data for 2025-06.
[2025-10-24T19:47:04.980581] [INFO ] [REMOTE    ] MAN: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T19:47:05.708351] [INFO ] [REMOTE    ] MAS: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T19:47:05.747681] [INFO ] [REMOTE    ] MAS: Fetching primary data for 2025-02.
[2025-10-24T19:47:06.430782] [INFO ] [REMOTE    ] MAIN: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T19:47:06.547702] [INFO ] [REMOTE    ] MAIN: Fetching primary data for 2025-07.
[2025-10-24T19:47:07.358417] [INFO ] [REMOTE    ] MAN: Fetching primary data for 2025-09.
[2025-10-24T19:47:07.360716] [INFO ] [REMOTE    ] MAS: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T19:47:08.061509] [INFO ] [REMOTE    ] MAIN: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T19:47:08.147610] [INFO ] [REMOTE    ] MAIN: Fetching primary data for 2025-08.
[2025-10-24T19:47:08.901493] [INFO ] [REMOTE    ] MAN: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T19:47:08.947616] [INFO ] [REMOTE    ] MANU: Fetching primary data for 2025-02.
[2025-10-24T19:47:09.747621] [INFO ] [REMOTE    ] MAN: Fetching primary data for 2025-10.
[2025-10-24T19:47:09.778222] [INFO ] [REMOTE    ] MAIN: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T19:47:10.114509] [INFO ] [REMOTE    ] MANU: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T19:47:10.547682] [INFO ] [REMOTE    ] MAS: Fetching primary data for 2025-03.
[2025-10-24T19:47:11.347715] [INFO ] [REMOTE    ] MANU: Fetching primary data for 2025-03.
[2025-10-24T19:47:11.663934] [INFO ] [REMOTE    ] MAN: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T19:47:11.672776] [INFO ] [REMOTE    ] MAN: Full fetch complete (62947 records).
[2025-10-24T19:47:11.672938] [DEBUG] [VALIDATOR ] MAN: Validating primary data.
[2025-10-24T19:47:12.105405] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present.
[2025-10-24T19:47:12.105554] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed.
[2025-10-24T19:47:12.106541] [INFO ] [MAIN      ] MAN: Fetched primary data is valid.
[2025-10-24T19:47:12.106621] [DEBUG] [LOCAL     ] MAN: Saving primary data.
[2025-10-24T19:47:12.107251] [FATAL] [LOCAL     ] MAN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:47:12.107333] [FATAL] [MAIN      ] MAN: Failed to save primary data.
[2025-10-24T19:47:12.107380] [WARN ] [MAIN      ] MAN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:47:12.107440] [INFO ] [LOCAL     ] MAN: Starting deletion of primary data.
[2025-10-24T19:47:12.107498] [DEBUG] [LOCAL     ] MAN: No primary data file found to delete.
[2025-10-24T19:47:12.107534] [INFO ] [LOCAL     ] MAN: Starting deletion of derivative data.
[2025-10-24T19:47:12.107692] [DEBUG] [LOCAL     ] MAN: Deleted derivative data file.
[2025-10-24T19:47:12.107960] [INFO ] [MAIN      ] Update Progress: 1300/2366 symbols completed. MAN took 28.5s. Estimated remaining: 2h 17m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:47:12.152802] [INFO ] [REMOTE    ] MAIN: Fetching primary data for 2025-09.
[2025-10-24T19:47:12.288167] [INFO ] [MAIN      ] MATV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:47:12.319936] [INFO ] [REMOTE    ] MAS: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T19:47:12.374898] [INFO ] [REMOTE    ] MANU: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T19:47:12.376034] [DEBUG] [LOCAL     ] MATV: Loaded 35246 existing records from primary storage.
[2025-10-24T19:47:12.382541] [INFO ] [MAIN      ] MATV: Loaded 35246 existing records.
[2025-10-24T19:47:12.562613] [WARN ] [MAIN      ] MATV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:47:12.562828] [INFO ] [MAIN      ] MATV: Wiping existing primary data before full refresh.
[2025-10-24T19:47:12.562877] [INFO ] [LOCAL     ] MATV: Starting deletion of primary data.
[2025-10-24T19:47:12.563248] [DEBUG] [LOCAL     ] MATV: Deleted primary data file.
[2025-10-24T19:47:12.563289] [INFO ] [MAIN      ] MATV: Starting full primary refresh.
[2025-10-24T19:47:12.922895] [INFO ] [REMOTE    ] MATV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:47:12.947595] [INFO ] [REMOTE    ] MATV: Fetching primary data for 2025-01.
[2025-10-24T19:47:13.747709] [INFO ] [REMOTE    ] MANU: Fetching primary data for 2025-04.
[2025-10-24T19:47:13.918457] [INFO ] [REMOTE    ] MAIN: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T19:47:13.982067] [INFO ] [REMOTE    ] MATV: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T19:47:14.547689] [INFO ] [REMOTE    ] MATV: Fetching primary data for 2025-02.
[2025-10-24T19:47:14.986778] [INFO ] [REMOTE    ] MANU: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T19:47:15.347627] [INFO ] [REMOTE    ] MAS: Fetching primary data for 2025-04.
[2025-10-24T19:47:15.809680] [INFO ] [REMOTE    ] MATV: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T19:47:16.147689] [INFO ] [REMOTE    ] MANU: Fetching primary data for 2025-05.
[2025-10-24T19:47:16.947721] [INFO ] [REMOTE    ] MATV: Fetching primary data for 2025-03.
[2025-10-24T19:47:16.990468] [INFO ] [REMOTE    ] MAS: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T19:47:17.194093] [INFO ] [REMOTE    ] MANU: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T19:47:17.747667] [INFO ] [REMOTE    ] MAS: Fetching primary data for 2025-05.
[2025-10-24T19:47:18.539614] [INFO ] [REMOTE    ] MATV: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T19:47:18.548913] [INFO ] [REMOTE    ] MANU: Fetching primary data for 2025-06.
[2025-10-24T19:47:19.347624] [INFO ] [REMOTE    ] MATV: Fetching primary data for 2025-04.
[2025-10-24T19:47:19.416420] [INFO ] [REMOTE    ] MAS: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T19:47:19.511189] [INFO ] [REMOTE    ] MANU: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T19:47:20.147690] [INFO ] [REMOTE    ] MAIN: Fetching primary data for 2025-10.
[2025-10-24T19:47:20.341124] [INFO ] [REMOTE    ] MATV: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T19:47:20.947747] [INFO ] [REMOTE    ] MAS: Fetching primary data for 2025-06.
[2025-10-24T19:47:21.747721] [INFO ] [REMOTE    ] MATV: Fetching primary data for 2025-05.
[2025-10-24T19:47:22.173551] [INFO ] [REMOTE    ] MAIN: Incremental fetch complete for 2025-10 (2.03 seconds).
[2025-10-24T19:47:22.181750] [INFO ] [REMOTE    ] MAIN: Full fetch complete (60315 records).
[2025-10-24T19:47:22.181860] [DEBUG] [VALIDATOR ] MAIN: Validating primary data.
[2025-10-24T19:47:22.547857] [INFO ] [REMOTE    ] MANU: Fetching primary data for 2025-07.
[2025-10-24T19:47:22.598461] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present.
[2025-10-24T19:47:22.598566] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed.
[2025-10-24T19:47:22.599731] [INFO ] [MAIN      ] MAIN: Fetched primary data is valid.
[2025-10-24T19:47:22.599909] [DEBUG] [LOCAL     ] MAIN: Saving primary data.
[2025-10-24T19:47:22.600527] [FATAL] [LOCAL     ] MAIN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:47:22.600698] [FATAL] [MAIN      ] MAIN: Failed to save primary data.
[2025-10-24T19:47:22.600772] [WARN ] [MAIN      ] MAIN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:47:22.600868] [INFO ] [LOCAL     ] MAIN: Starting deletion of primary data.
[2025-10-24T19:47:22.600961] [DEBUG] [LOCAL     ] MAIN: No primary data file found to delete.
[2025-10-24T19:47:22.601031] [INFO ] [LOCAL     ] MAIN: Starting deletion of derivative data.
[2025-10-24T19:47:22.601283] [DEBUG] [LOCAL     ] MAIN: Deleted derivative data file.
[2025-10-24T19:47:22.601700] [INFO ] [MAIN      ] Update Progress: 1301/2366 symbols completed. MAIN took 45.9s. Estimated remaining: 2h 16m 59s. Rate: 7.8 symbols/min
[2025-10-24T19:47:22.788124] [INFO ] [REMOTE    ] MAS: Incremental fetch complete for 2025-06 (1.84 seconds).
[2025-10-24T19:47:22.821708] [INFO ] [MAIN      ] MATX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:47:22.860294] [DEBUG] [LOCAL     ] MATX: Loaded 32093 existing records from primary storage.
[2025-10-24T19:47:22.860589] [INFO ] [MAIN      ] MATX: Loaded 32093 existing records.
[2025-10-24T19:47:23.067194] [WARN ] [MAIN      ] MATX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:47:23.070518] [INFO ] [MAIN      ] MATX: Wiping existing primary data before full refresh.
[2025-10-24T19:47:23.070620] [INFO ] [LOCAL     ] MATX: Starting deletion of primary data.
[2025-10-24T19:47:23.071206] [DEBUG] [LOCAL     ] MATX: Deleted primary data file.
[2025-10-24T19:47:23.071265] [INFO ] [MAIN      ] MATX: Starting full primary refresh.
[2025-10-24T19:47:23.269983] [INFO ] [REMOTE    ] MATV: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T19:47:23.351116] [INFO ] [REMOTE    ] MAS: Fetching primary data for 2025-07.
[2025-10-24T19:47:23.462468] [INFO ] [REMOTE    ] MATX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:47:23.878049] [INFO ] [REMOTE    ] MANU: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T19:47:24.147727] [INFO ] [REMOTE    ] MATV: Fetching primary data for 2025-06.
[2025-10-24T19:47:24.765400] [INFO ] [REMOTE    ] MAS: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T19:47:24.947606] [INFO ] [REMOTE    ] MAS: Fetching primary data for 2025-08.
[2025-10-24T19:47:25.568956] [INFO ] [REMOTE    ] MATV: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T19:47:25.747685] [INFO ] [REMOTE    ] MATX: Fetching primary data for 2025-01.
[2025-10-24T19:47:26.226016] [INFO ] [REMOTE    ] MAS: Incremental fetch complete for 2025-08 (1.28 seconds).
[2025-10-24T19:47:26.547694] [INFO ] [REMOTE    ] MANU: Fetching primary data for 2025-08.
[2025-10-24T19:47:26.903061] [INFO ] [REMOTE    ] MATX: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T19:47:27.268563] [INFO ] [REMOTE    ] MANU: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T19:47:27.347633] [INFO ] [REMOTE    ] MANU: Fetching primary data for 2025-09.
[2025-10-24T19:47:28.147669] [INFO ] [REMOTE    ] MAS: Fetching primary data for 2025-09.
[2025-10-24T19:47:28.741724] [INFO ] [REMOTE    ] MANU: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T19:47:28.947727] [INFO ] [REMOTE    ] MATV: Fetching primary data for 2025-07.
[2025-10-24T19:47:29.443038] [INFO ] [REMOTE    ] MAS: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T19:47:29.747691] [INFO ] [REMOTE    ] MAS: Fetching primary data for 2025-10.
[2025-10-24T19:47:30.371673] [INFO ] [REMOTE    ] MATV: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T19:47:30.547632] [INFO ] [REMOTE    ] MATV: Fetching primary data for 2025-08.
[2025-10-24T19:47:31.347621] [INFO ] [REMOTE    ] MANU: Fetching primary data for 2025-10.
[2025-10-24T19:47:31.512913] [INFO ] [REMOTE    ] MAS: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T19:47:31.527432] [INFO ] [REMOTE    ] MAS: Full fetch complete (75405 records).
[2025-10-24T19:47:31.527605] [DEBUG] [VALIDATOR ] MAS: Validating primary data.
[2025-10-24T19:47:31.912287] [INFO ] [REMOTE    ] MATV: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T19:47:32.003393] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present.
[2025-10-24T19:47:32.003476] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed.
[2025-10-24T19:47:32.004545] [INFO ] [MAIN      ] MAS: Fetched primary data is valid.
[2025-10-24T19:47:32.004607] [DEBUG] [LOCAL     ] MAS: Saving primary data.
[2025-10-24T19:47:32.005178] [FATAL] [LOCAL     ] MAS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:47:32.005304] [FATAL] [MAIN      ] MAS: Failed to save primary data.
[2025-10-24T19:47:32.005346] [WARN ] [MAIN      ] MAS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:47:32.005382] [INFO ] [LOCAL     ] MAS: Starting deletion of primary data.
[2025-10-24T19:47:32.005446] [DEBUG] [LOCAL     ] MAS: No primary data file found to delete.
[2025-10-24T19:47:32.005500] [INFO ] [LOCAL     ] MAS: Starting deletion of derivative data.
[2025-10-24T19:47:32.006106] [DEBUG] [LOCAL     ] MAS: Deleted derivative data file.
[2025-10-24T19:47:32.006837] [INFO ] [MAIN      ] Update Progress: 1302/2366 symbols completed. MAS took 29.3s. Estimated remaining: 2h 16m 52s. Rate: 7.8 symbols/min
[2025-10-24T19:47:32.155985] [INFO ] [REMOTE    ] MATX: Fetching primary data for 2025-02.
[2025-10-24T19:47:32.175235] [INFO ] [MAIN      ] MAX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:47:32.207588] [DEBUG] [LOCAL     ] MAX: Loaded 30905 existing records from primary storage.
[2025-10-24T19:47:32.207883] [INFO ] [MAIN      ] MAX: Loaded 30905 existing records.
[2025-10-24T19:47:32.383734] [WARN ] [MAIN      ] MAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:47:32.383919] [INFO ] [MAIN      ] MAX: Wiping existing primary data before full refresh.
[2025-10-24T19:47:32.383966] [INFO ] [LOCAL     ] MAX: Starting deletion of primary data.
[2025-10-24T19:47:32.384345] [DEBUG] [LOCAL     ] MAX: Deleted primary data file.
[2025-10-24T19:47:32.384384] [INFO ] [MAIN      ] MAX: Starting full primary refresh.
[2025-10-24T19:47:32.748030] [INFO ] [REMOTE    ] MAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:47:32.762617] [INFO ] [REMOTE    ] MANU: Incremental fetch complete for 2025-10 (1.41 seconds).
[2025-10-24T19:47:32.768257] [INFO ] [REMOTE    ] MANU: Full fetch complete (39413 records).
[2025-10-24T19:47:32.768352] [DEBUG] [VALIDATOR ] MANU: Validating primary data.
[2025-10-24T19:47:32.952748] [INFO ] [REMOTE    ] MATV: Fetching primary data for 2025-09.
[2025-10-24T19:47:33.140458] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present.
[2025-10-24T19:47:33.140528] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed.
[2025-10-24T19:47:33.141388] [INFO ] [MAIN      ] MANU: Fetched primary data is valid.
[2025-10-24T19:47:33.141449] [DEBUG] [LOCAL     ] MANU: Saving primary data.
[2025-10-24T19:47:33.141820] [FATAL] [LOCAL     ] MANU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:47:33.141900] [FATAL] [MAIN      ] MANU: Failed to save primary data.
[2025-10-24T19:47:33.141945] [WARN ] [MAIN      ] MANU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:47:33.142011] [INFO ] [LOCAL     ] MANU: Starting deletion of primary data.
[2025-10-24T19:47:33.142067] [DEBUG] [LOCAL     ] MANU: No primary data file found to delete.
[2025-10-24T19:47:33.142104] [INFO ] [LOCAL     ] MANU: Starting deletion of derivative data.
[2025-10-24T19:47:33.142243] [DEBUG] [LOCAL     ] MANU: Deleted derivative data file.
[2025-10-24T19:47:33.142333] [INFO ] [MAIN      ] Update Progress: 1303/2366 symbols completed. MANU took 31.8s. Estimated remaining: 2h 16m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:47:33.311773] [INFO ] [MAIN      ] MBC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:47:33.354905] [DEBUG] [LOCAL     ] MBC: Loaded 44219 existing records from primary storage.
[2025-10-24T19:47:33.355272] [INFO ] [MAIN      ] MBC: Loaded 44219 existing records.
[2025-10-24T19:47:33.513893] [INFO ] [REMOTE    ] MATX: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T19:47:33.558567] [WARN ] [MAIN      ] MBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:47:33.558740] [INFO ] [MAIN      ] MBC: Wiping existing primary data before full refresh.
[2025-10-24T19:47:33.558788] [INFO ] [LOCAL     ] MBC: Starting deletion of primary data.
[2025-10-24T19:47:33.559180] [DEBUG] [LOCAL     ] MBC: Deleted primary data file.
[2025-10-24T19:47:33.559219] [INFO ] [MAIN      ] MBC: Starting full primary refresh.
[2025-10-24T19:47:33.752936] [INFO ] [REMOTE    ] MAX: Fetching primary data for 2025-01.
[2025-10-24T19:47:33.909908] [INFO ] [REMOTE    ] MBC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:47:34.324781] [INFO ] [REMOTE    ] MATV: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T19:47:34.547688] [INFO ] [REMOTE    ] MBC: Fetching primary data for 2025-01.
[2025-10-24T19:47:34.690282] [INFO ] [REMOTE    ] MAX: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T19:47:35.347709] [INFO ] [REMOTE    ] MAX: Fetching primary data for 2025-02.
[2025-10-24T19:47:35.899747] [INFO ] [REMOTE    ] MBC: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T19:47:36.147680] [INFO ] [REMOTE    ] MATX: Fetching primary data for 2025-03.
[2025-10-24T19:47:36.588150] [INFO ] [REMOTE    ] MAX: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T19:47:36.947700] [INFO ] [REMOTE    ] MBC: Fetching primary data for 2025-02.
[2025-10-24T19:47:37.342332] [INFO ] [REMOTE    ] MATX: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T19:47:37.747735] [INFO ] [REMOTE    ] MATX: Fetching primary data for 2025-04.
[2025-10-24T19:47:38.314126] [INFO ] [REMOTE    ] MBC: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T19:47:38.547709] [INFO ] [REMOTE    ] MATV: Fetching primary data for 2025-10.
[2025-10-24T19:47:39.334206] [INFO ] [REMOTE    ] MATX: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T19:47:39.347606] [INFO ] [REMOTE    ] MATX: Fetching primary data for 2025-05.
[2025-10-24T19:47:39.866542] [INFO ] [REMOTE    ] MATV: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T19:47:39.871968] [INFO ] [REMOTE    ] MATV: Full fetch complete (52074 records).
[2025-10-24T19:47:39.872059] [DEBUG] [VALIDATOR ] MATV: Validating primary data.
[2025-10-24T19:47:40.156355] [INFO ] [REMOTE    ] MAX: Fetching primary data for 2025-03.
[2025-10-24T19:47:40.269853] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present.
[2025-10-24T19:47:40.269929] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed.
[2025-10-24T19:47:40.270948] [INFO ] [MAIN      ] MATV: Fetched primary data is valid.
[2025-10-24T19:47:40.271011] [DEBUG] [LOCAL     ] MATV: Saving primary data.
[2025-10-24T19:47:40.271454] [FATAL] [LOCAL     ] MATV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:47:40.271541] [FATAL] [MAIN      ] MATV: Failed to save primary data.
[2025-10-24T19:47:40.271583] [WARN ] [MAIN      ] MATV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:47:40.271626] [INFO ] [LOCAL     ] MATV: Starting deletion of primary data.
[2025-10-24T19:47:40.271717] [DEBUG] [LOCAL     ] MATV: No primary data file found to delete.
[2025-10-24T19:47:40.271767] [INFO ] [LOCAL     ] MATV: Starting deletion of derivative data.
[2025-10-24T19:47:40.271917] [DEBUG] [LOCAL     ] MATV: Deleted derivative data file.
[2025-10-24T19:47:40.272348] [INFO ] [MAIN      ] Update Progress: 1304/2366 symbols completed. MATV took 28.2s. Estimated remaining: 2h 16m 31s. Rate: 7.8 symbols/min
[2025-10-24T19:47:40.449713] [INFO ] [MAIN      ] MBI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:47:40.474876] [DEBUG] [LOCAL     ] MBI: Loaded 24075 existing records from primary storage.
[2025-10-24T19:47:40.475185] [INFO ] [MAIN      ] MBI: Loaded 24075 existing records.
[2025-10-24T19:47:40.653808] [WARN ] [MAIN      ] MBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:47:40.654038] [INFO ] [MAIN      ] MBI: Wiping existing primary data before full refresh.
[2025-10-24T19:47:40.654113] [INFO ] [LOCAL     ] MBI: Starting deletion of primary data.
[2025-10-24T19:47:40.654545] [DEBUG] [LOCAL     ] MBI: Deleted primary data file.
[2025-10-24T19:47:40.654607] [INFO ] [MAIN      ] MBI: Starting full primary refresh.
[2025-10-24T19:47:40.822148] [INFO ] [REMOTE    ] MATX: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T19:47:40.952927] [INFO ] [REMOTE    ] MBC: Fetching primary data for 2025-03.
[2025-10-24T19:47:41.046552] [INFO ] [REMOTE    ] MBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:47:41.523847] [INFO ] [REMOTE    ] MAX: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T19:47:41.747693] [INFO ] [REMOTE    ] MAX: Fetching primary data for 2025-04.
[2025-10-24T19:47:42.418341] [INFO ] [REMOTE    ] MBC: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T19:47:42.547609] [INFO ] [REMOTE    ] MBC: Fetching primary data for 2025-04.
[2025-10-24T19:47:43.051891] [INFO ] [REMOTE    ] MAX: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T19:47:43.347755] [INFO ] [REMOTE    ] MBI: Fetching primary data for 2025-01.
[2025-10-24T19:47:44.088423] [INFO ] [REMOTE    ] MBC: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T19:47:44.147705] [INFO ] [REMOTE    ] MBC: Fetching primary data for 2025-05.
[2025-10-24T19:47:44.480490] [INFO ] [REMOTE    ] MBI: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T19:47:44.947702] [INFO ] [REMOTE    ] MATX: Fetching primary data for 2025-06.
[2025-10-24T19:47:45.563750] [INFO ] [REMOTE    ] MBC: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T19:47:45.747731] [INFO ] [REMOTE    ] MBC: Fetching primary data for 2025-06.
[2025-10-24T19:47:46.234074] [INFO ] [REMOTE    ] MATX: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T19:47:46.547675] [INFO ] [REMOTE    ] MATX: Fetching primary data for 2025-07.
[2025-10-24T19:47:47.038789] [INFO ] [REMOTE    ] MBC: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T19:47:47.347731] [INFO ] [REMOTE    ] MBI: Fetching primary data for 2025-02.
[2025-10-24T19:47:47.946769] [INFO ] [REMOTE    ] MATX: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T19:47:48.147757] [INFO ] [REMOTE    ] MBC: Fetching primary data for 2025-07.
[2025-10-24T19:47:48.501750] [INFO ] [REMOTE    ] MBI: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T19:47:48.947723] [INFO ] [REMOTE    ] MATX: Fetching primary data for 2025-08.
[2025-10-24T19:47:49.575102] [INFO ] [REMOTE    ] MBC: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T19:47:49.747677] [INFO ] [REMOTE    ] MAX: Fetching primary data for 2025-05.
[2025-10-24T19:47:50.293906] [INFO ] [REMOTE    ] MATX: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T19:47:50.547677] [INFO ] [REMOTE    ] MBI: Fetching primary data for 2025-03.
[2025-10-24T19:47:51.124975] [INFO ] [REMOTE    ] MAX: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T19:47:51.347676] [INFO ] [REMOTE    ] MATX: Fetching primary data for 2025-09.
[2025-10-24T19:47:51.848062] [INFO ] [REMOTE    ] MBI: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T19:47:52.147618] [INFO ] [REMOTE    ] MAX: Fetching primary data for 2025-06.
[2025-10-24T19:47:52.583916] [INFO ] [REMOTE    ] MATX: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T19:47:52.947612] [INFO ] [REMOTE    ] MBC: Fetching primary data for 2025-08.
[2025-10-24T19:47:53.275769] [INFO ] [REMOTE    ] MAX: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T19:47:53.747681] [INFO ] [REMOTE    ] MATX: Fetching primary data for 2025-10.
[2025-10-24T19:47:54.547624] [INFO ] [REMOTE    ] MAX: Fetching primary data for 2025-07.
[2025-10-24T19:47:54.616628] [INFO ] [REMOTE    ] MBC: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T19:47:55.080635] [INFO ] [REMOTE    ] MATX: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T19:47:55.086464] [INFO ] [REMOTE    ] MATX: Full fetch complete (43891 records).
[2025-10-24T19:47:55.086558] [DEBUG] [VALIDATOR ] MATX: Validating primary data.
[2025-10-24T19:47:55.350160] [INFO ] [REMOTE    ] MBI: Fetching primary data for 2025-04.
[2025-10-24T19:47:55.467159] [INFO ] [REMOTE    ] MAX: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T19:47:55.488462] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present.
[2025-10-24T19:47:55.488535] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed.
[2025-10-24T19:47:55.489681] [INFO ] [MAIN      ] MATX: Fetched primary data is valid.
[2025-10-24T19:47:55.489767] [DEBUG] [LOCAL     ] MATX: Saving primary data.
[2025-10-24T19:47:55.490136] [FATAL] [LOCAL     ] MATX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:47:55.490217] [FATAL] [MAIN      ] MATX: Failed to save primary data.
[2025-10-24T19:47:55.490258] [WARN ] [MAIN      ] MATX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:47:55.490295] [INFO ] [LOCAL     ] MATX: Starting deletion of primary data.
[2025-10-24T19:47:55.490346] [DEBUG] [LOCAL     ] MATX: No primary data file found to delete.
[2025-10-24T19:47:55.490382] [INFO ] [LOCAL     ] MATX: Starting deletion of derivative data.
[2025-10-24T19:47:55.490492] [DEBUG] [LOCAL     ] MATX: Deleted derivative data file.
[2025-10-24T19:47:55.490562] [INFO ] [MAIN      ] Update Progress: 1305/2366 symbols completed. MATX took 32.9s. Estimated remaining: 2h 16m 29s. Rate: 7.8 symbols/min
[2025-10-24T19:47:55.658099] [INFO ] [MAIN      ] MC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:47:55.701022] [DEBUG] [LOCAL     ] MC: Loaded 43947 existing records from primary storage.
[2025-10-24T19:47:55.701429] [INFO ] [MAIN      ] MC: Loaded 43947 existing records.
[2025-10-24T19:47:55.874982] [WARN ] [MAIN      ] MC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:47:55.875150] [INFO ] [MAIN      ] MC: Wiping existing primary data before full refresh.
[2025-10-24T19:47:55.875195] [INFO ] [LOCAL     ] MC: Starting deletion of primary data.
[2025-10-24T19:47:55.875556] [DEBUG] [LOCAL     ] MC: Deleted primary data file.
[2025-10-24T19:47:55.875600] [INFO ] [MAIN      ] MC: Starting full primary refresh.
[2025-10-24T19:47:56.148686] [INFO ] [REMOTE    ] MBC: Fetching primary data for 2025-09.
[2025-10-24T19:47:56.225831] [INFO ] [REMOTE    ] MC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:47:56.568067] [INFO ] [REMOTE    ] MBI: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T19:47:56.947713] [INFO ] [REMOTE    ] MAX: Fetching primary data for 2025-08.
[2025-10-24T19:47:57.321598] [INFO ] [REMOTE    ] MBC: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T19:47:57.747616] [INFO ] [REMOTE    ] MBI: Fetching primary data for 2025-05.
[2025-10-24T19:47:58.144008] [INFO ] [REMOTE    ] MAX: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T19:47:58.547629] [INFO ] [REMOTE    ] MAX: Fetching primary data for 2025-09.
[2025-10-24T19:47:58.816127] [INFO ] [REMOTE    ] MBI: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T19:47:59.347622] [INFO ] [REMOTE    ] MC: Fetching primary data for 2025-01.
[2025-10-24T19:47:59.816601] [INFO ] [REMOTE    ] MAX: Incremental fetch complete for 2025-09 (1.27 seconds).
[2025-10-24T19:48:00.147713] [INFO ] [REMOTE    ] MAX: Fetching primary data for 2025-10.
[2025-10-24T19:48:00.842790] [INFO ] [REMOTE    ] MC: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T19:48:00.947622] [INFO ] [REMOTE    ] MC: Fetching primary data for 2025-02.
[2025-10-24T19:48:01.717730] [INFO ] [REMOTE    ] MAX: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T19:48:01.724691] [INFO ] [REMOTE    ] MAX: Full fetch complete (45004 records).
[2025-10-24T19:48:01.725031] [DEBUG] [VALIDATOR ] MAX: Validating primary data.
[2025-10-24T19:48:01.759411] [INFO ] [REMOTE    ] MBI: Fetching primary data for 2025-06.
[2025-10-24T19:48:02.107260] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present.
[2025-10-24T19:48:02.107359] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed.
[2025-10-24T19:48:02.108201] [INFO ] [MAIN      ] MAX: Fetched primary data is valid.
[2025-10-24T19:48:02.108263] [DEBUG] [LOCAL     ] MAX: Saving primary data.
[2025-10-24T19:48:02.108750] [FATAL] [LOCAL     ] MAX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:48:02.108837] [FATAL] [MAIN      ] MAX: Failed to save primary data.
[2025-10-24T19:48:02.108879] [WARN ] [MAIN      ] MAX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:48:02.108912] [INFO ] [LOCAL     ] MAX: Starting deletion of primary data.
[2025-10-24T19:48:02.108963] [DEBUG] [LOCAL     ] MAX: No primary data file found to delete.
[2025-10-24T19:48:02.108997] [INFO ] [LOCAL     ] MAX: Starting deletion of derivative data.
[2025-10-24T19:48:02.109109] [DEBUG] [LOCAL     ] MAX: Deleted derivative data file.
[2025-10-24T19:48:02.109475] [INFO ] [MAIN      ] Update Progress: 1306/2366 symbols completed. MAX took 30.1s. Estimated remaining: 2h 16m 21s. Rate: 7.8 symbols/min
[2025-10-24T19:48:02.284946] [INFO ] [MAIN      ] MCB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:48:02.303223] [DEBUG] [LOCAL     ] MCB: Loaded 11348 existing records from primary storage.
[2025-10-24T19:48:02.303547] [INFO ] [MAIN      ] MCB: Loaded 11348 existing records.
[2025-10-24T19:48:02.459741] [INFO ] [REMOTE    ] MC: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T19:48:02.525043] [WARN ] [MAIN      ] MCB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:48:02.526612] [INFO ] [MAIN      ] MCB: Wiping existing primary data before full refresh.
[2025-10-24T19:48:02.526739] [INFO ] [LOCAL     ] MCB: Starting deletion of primary data.
[2025-10-24T19:48:02.527087] [DEBUG] [LOCAL     ] MCB: Deleted primary data file.
[2025-10-24T19:48:02.527270] [INFO ] [MAIN      ] MCB: Starting full primary refresh.
[2025-10-24T19:48:02.557321] [INFO ] [REMOTE    ] MC: Fetching primary data for 2025-03.
[2025-10-24T19:48:02.652539] [INFO ] [REMOTE    ] MBI: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T19:48:02.926423] [INFO ] [REMOTE    ] MCB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:48:03.347639] [INFO ] [REMOTE    ] MBC: Fetching primary data for 2025-10.
[2025-10-24T19:48:04.111420] [INFO ] [REMOTE    ] MC: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T19:48:04.147605] [INFO ] [REMOTE    ] MC: Fetching primary data for 2025-04.
[2025-10-24T19:48:04.947032] [INFO ] [REMOTE    ] MBC: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T19:48:04.950305] [INFO ] [REMOTE    ] MBI: Fetching primary data for 2025-07.
[2025-10-24T19:48:04.957757] [INFO ] [REMOTE    ] MBC: Full fetch complete (63090 records).
[2025-10-24T19:48:04.957876] [DEBUG] [VALIDATOR ] MBC: Validating primary data.
[2025-10-24T19:48:05.394757] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present.
[2025-10-24T19:48:05.394884] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed.
[2025-10-24T19:48:05.396208] [INFO ] [MAIN      ] MBC: Fetched primary data is valid.
[2025-10-24T19:48:05.396274] [DEBUG] [LOCAL     ] MBC: Saving primary data.
[2025-10-24T19:48:05.397136] [FATAL] [LOCAL     ] MBC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:48:05.397262] [FATAL] [MAIN      ] MBC: Failed to save primary data.
[2025-10-24T19:48:05.397315] [WARN ] [MAIN      ] MBC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:48:05.397382] [INFO ] [LOCAL     ] MBC: Starting deletion of primary data.
[2025-10-24T19:48:05.397450] [DEBUG] [LOCAL     ] MBC: No primary data file found to delete.
[2025-10-24T19:48:05.397489] [INFO ] [LOCAL     ] MBC: Starting deletion of derivative data.
[2025-10-24T19:48:05.397689] [DEBUG] [LOCAL     ] MBC: Deleted derivative data file.
[2025-10-24T19:48:05.398044] [INFO ] [MAIN      ] Update Progress: 1307/2366 symbols completed. MBC took 32.3s. Estimated remaining: 2h 16m 9s. Rate: 7.8 symbols/min
[2025-10-24T19:48:05.575909] [INFO ] [MAIN      ] MCD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:48:05.576237] [DEBUG] [LOCAL     ] MCD: No existing data file found in primary storage.
[2025-10-24T19:48:05.576294] [WARN ] [MAIN      ] MCD: No existing data found, performing full refresh instead.
[2025-10-24T19:48:05.576417] [INFO ] [MAIN      ] MCD: Wiping existing primary data before full refresh.
[2025-10-24T19:48:05.576460] [INFO ] [LOCAL     ] MCD: Starting deletion of primary data.
[2025-10-24T19:48:05.576501] [DEBUG] [LOCAL     ] MCD: No primary data file found to delete.
[2025-10-24T19:48:05.576533] [INFO ] [MAIN      ] MCD: Starting full primary refresh.
[2025-10-24T19:48:05.753313] [INFO ] [REMOTE    ] MCB: Fetching primary data for 2025-01.
[2025-10-24T19:48:05.997034] [INFO ] [REMOTE    ] MCD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:48:06.021068] [INFO ] [REMOTE    ] MC: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T19:48:06.044907] [INFO ] [REMOTE    ] MBI: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T19:48:06.547676] [INFO ] [REMOTE    ] MC: Fetching primary data for 2025-05.
[2025-10-24T19:48:06.619484] [INFO ] [REMOTE    ] MCB: Incremental fetch complete for 2025-01 (0.87 seconds).
[2025-10-24T19:48:07.347703] [INFO ] [REMOTE    ] MCD: Fetching primary data for 2025-01.
[2025-10-24T19:48:08.059090] [INFO ] [REMOTE    ] MC: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T19:48:08.147694] [INFO ] [REMOTE    ] MCB: Fetching primary data for 2025-02.
[2025-10-24T19:48:08.870809] [INFO ] [REMOTE    ] MCB: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T19:48:08.947623] [INFO ] [REMOTE    ] MCB: Fetching primary data for 2025-03.
[2025-10-24T19:48:09.463253] [INFO ] [REMOTE    ] MCD: Incremental fetch complete for 2025-01 (2.12 seconds).
[2025-10-24T19:48:09.747722] [INFO ] [REMOTE    ] MC: Fetching primary data for 2025-06.
[2025-10-24T19:48:09.780344] [INFO ] [REMOTE    ] MCB: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T19:48:10.547684] [INFO ] [REMOTE    ] MBI: Fetching primary data for 2025-08.
[2025-10-24T19:48:11.132719] [INFO ] [REMOTE    ] MC: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T19:48:11.347693] [INFO ] [REMOTE    ] MC: Fetching primary data for 2025-07.
[2025-10-24T19:48:11.893113] [INFO ] [REMOTE    ] MBI: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T19:48:12.147733] [INFO ] [REMOTE    ] MBI: Fetching primary data for 2025-09.
[2025-10-24T19:48:12.947691] [INFO ] [REMOTE    ] MCB: Fetching primary data for 2025-04.
[2025-10-24T19:48:12.986347] [INFO ] [REMOTE    ] MC: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T19:48:13.051366] [INFO ] [REMOTE    ] MBI: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T19:48:13.747670] [INFO ] [REMOTE    ] MBI: Fetching primary data for 2025-10.
[2025-10-24T19:48:13.953881] [INFO ] [REMOTE    ] MCB: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T19:48:14.547693] [INFO ] [REMOTE    ] MCB: Fetching primary data for 2025-05.
[2025-10-24T19:48:14.905282] [INFO ] [REMOTE    ] MBI: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T19:48:14.909953] [INFO ] [REMOTE    ] MBI: Full fetch complete (35673 records).
[2025-10-24T19:48:14.910042] [DEBUG] [VALIDATOR ] MBI: Validating primary data.
[2025-10-24T19:48:15.287544] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present.
[2025-10-24T19:48:15.287674] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed.
[2025-10-24T19:48:15.289038] [INFO ] [MAIN      ] MBI: Fetched primary data is valid.
[2025-10-24T19:48:15.289102] [DEBUG] [LOCAL     ] MBI: Saving primary data.
[2025-10-24T19:48:15.289594] [FATAL] [LOCAL     ] MBI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:48:15.289706] [FATAL] [MAIN      ] MBI: Failed to save primary data.
[2025-10-24T19:48:15.289752] [WARN ] [MAIN      ] MBI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:48:15.289814] [INFO ] [LOCAL     ] MBI: Starting deletion of primary data.
[2025-10-24T19:48:15.289882] [DEBUG] [LOCAL     ] MBI: No primary data file found to delete.
[2025-10-24T19:48:15.289921] [INFO ] [LOCAL     ] MBI: Starting deletion of derivative data.
[2025-10-24T19:48:15.290117] [DEBUG] [LOCAL     ] MBI: Deleted derivative data file.
[2025-10-24T19:48:15.290226] [INFO ] [MAIN      ] Update Progress: 1308/2366 symbols completed. MBI took 35.0s. Estimated remaining: 2h 16m 3s. Rate: 7.8 symbols/min
[2025-10-24T19:48:15.353376] [INFO ] [REMOTE    ] MCD: Fetching primary data for 2025-02.
[2025-10-24T19:48:15.487266] [INFO ] [MAIN      ] MCI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:48:15.484014] [INFO ] [REMOTE    ] MCB: Incremental fetch complete for 2025-05 (0.94 seconds).
[2025-10-24T19:48:15.500846] [DEBUG] [LOCAL     ] MCI: Loaded 6219 existing records from primary storage.
[2025-10-24T19:48:15.501145] [INFO ] [MAIN      ] MCI: Loaded 6219 existing records.
[2025-10-24T19:48:15.728570] [WARN ] [MAIN      ] MCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:48:15.728937] [INFO ] [MAIN      ] MCI: Wiping existing primary data before full refresh.
[2025-10-24T19:48:15.729015] [INFO ] [LOCAL     ] MCI: Starting deletion of primary data.
[2025-10-24T19:48:15.729258] [DEBUG] [LOCAL     ] MCI: Deleted primary data file.
[2025-10-24T19:48:15.729350] [INFO ] [MAIN      ] MCI: Starting full primary refresh.
[2025-10-24T19:48:16.104537] [INFO ] [REMOTE    ] MCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:48:16.147631] [INFO ] [REMOTE    ] MC: Fetching primary data for 2025-08.
[2025-10-24T19:48:16.947675] [INFO ] [REMOTE    ] MCI: Fetching primary data for 2025-01.
[2025-10-24T19:48:17.337618] [INFO ] [REMOTE    ] MCD: Incremental fetch complete for 2025-02 (1.98 seconds).
[2025-10-24T19:48:17.577325] [INFO ] [REMOTE    ] MC: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T19:48:17.660439] [INFO ] [REMOTE    ] MCI: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T19:48:17.747686] [INFO ] [REMOTE    ] MCI: Fetching primary data for 2025-02.
[2025-10-24T19:48:18.547729] [INFO ] [REMOTE    ] MC: Fetching primary data for 2025-09.
[2025-10-24T19:48:18.595013] [INFO ] [REMOTE    ] MCI: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T19:48:19.347716] [INFO ] [REMOTE    ] MCI: Fetching primary data for 2025-03.
[2025-10-24T19:48:19.928585] [INFO ] [REMOTE    ] MC: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T19:48:20.017553] [INFO ] [REMOTE    ] MCI: Incremental fetch complete for 2025-03 (0.67 seconds).
[2025-10-24T19:48:20.147688] [INFO ] [REMOTE    ] MC: Fetching primary data for 2025-10.
[2025-10-24T19:48:20.947748] [INFO ] [REMOTE    ] MCD: Fetching primary data for 2025-03.
[2025-10-24T19:48:21.616462] [INFO ] [REMOTE    ] MC: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T19:48:21.625405] [INFO ] [REMOTE    ] MC: Full fetch complete (63161 records).
[2025-10-24T19:48:21.625570] [DEBUG] [VALIDATOR ] MC: Validating primary data.
[2025-10-24T19:48:21.752938] [INFO ] [REMOTE    ] MCI: Fetching primary data for 2025-04.
[2025-10-24T19:48:22.048013] [DEBUG] [VALIDATOR ] MC: All expected trading days are present.
[2025-10-24T19:48:22.048123] [DEBUG] [VALIDATOR ] MC: Primary data validation passed.
[2025-10-24T19:48:22.049469] [INFO ] [MAIN      ] MC: Fetched primary data is valid.
[2025-10-24T19:48:22.049536] [DEBUG] [LOCAL     ] MC: Saving primary data.
[2025-10-24T19:48:22.050398] [FATAL] [LOCAL     ] MC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:48:22.050498] [FATAL] [MAIN      ] MC: Failed to save primary data.
[2025-10-24T19:48:22.050541] [WARN ] [MAIN      ] MC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:48:22.050577] [INFO ] [LOCAL     ] MC: Starting deletion of primary data.
[2025-10-24T19:48:22.050637] [DEBUG] [LOCAL     ] MC: No primary data file found to delete.
[2025-10-24T19:48:22.050721] [INFO ] [LOCAL     ] MC: Starting deletion of derivative data.
[2025-10-24T19:48:22.050924] [DEBUG] [LOCAL     ] MC: Deleted derivative data file.
[2025-10-24T19:48:22.051042] [INFO ] [MAIN      ] Update Progress: 1309/2366 symbols completed. MC took 26.6s. Estimated remaining: 2h 15m 55s. Rate: 7.8 symbols/min
[2025-10-24T19:48:22.224717] [INFO ] [MAIN      ] MCK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:48:22.266532] [DEBUG] [LOCAL     ] MCK: Loaded 38261 existing records from primary storage.
[2025-10-24T19:48:22.266907] [INFO ] [MAIN      ] MCK: Loaded 38261 existing records.
[2025-10-24T19:48:22.464549] [WARN ] [MAIN      ] MCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:48:22.466352] [INFO ] [REMOTE    ] MCI: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T19:48:22.469679] [INFO ] [MAIN      ] MCK: Wiping existing primary data before full refresh.
[2025-10-24T19:48:22.469858] [INFO ] [LOCAL     ] MCK: Starting deletion of primary data.
[2025-10-24T19:48:22.470271] [DEBUG] [LOCAL     ] MCK: Deleted primary data file.
[2025-10-24T19:48:22.470357] [INFO ] [MAIN      ] MCK: Starting full primary refresh.
[2025-10-24T19:48:22.555892] [INFO ] [REMOTE    ] MCB: Fetching primary data for 2025-06.
[2025-10-24T19:48:22.882478] [INFO ] [REMOTE    ] MCK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:48:22.888895] [INFO ] [REMOTE    ] MCD: Incremental fetch complete for 2025-03 (1.94 seconds).
[2025-10-24T19:48:23.351225] [INFO ] [REMOTE    ] MCD: Fetching primary data for 2025-04.
[2025-10-24T19:48:23.353755] [INFO ] [REMOTE    ] MCB: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T19:48:24.147746] [INFO ] [REMOTE    ] MCI: Fetching primary data for 2025-05.
[2025-10-24T19:48:24.857978] [INFO ] [REMOTE    ] MCI: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T19:48:24.947689] [INFO ] [REMOTE    ] MCK: Fetching primary data for 2025-01.
[2025-10-24T19:48:25.563018] [INFO ] [REMOTE    ] MCD: Incremental fetch complete for 2025-04 (2.21 seconds).
[2025-10-24T19:48:25.747752] [INFO ] [REMOTE    ] MCD: Fetching primary data for 2025-05.
[2025-10-24T19:48:26.377540] [INFO ] [REMOTE    ] MCK: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T19:48:26.547734] [INFO ] [REMOTE    ] MCI: Fetching primary data for 2025-06.
[2025-10-24T19:48:27.282074] [INFO ] [REMOTE    ] MCI: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T19:48:27.347680] [INFO ] [REMOTE    ] MCB: Fetching primary data for 2025-07.
[2025-10-24T19:48:27.624219] [INFO ] [REMOTE    ] MCD: Incremental fetch complete for 2025-05 (1.88 seconds).
[2025-10-24T19:48:28.145539] [INFO ] [REMOTE    ] MCB: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T19:48:28.150256] [INFO ] [REMOTE    ] MCI: Fetching primary data for 2025-07.
[2025-10-24T19:48:28.803534] [INFO ] [REMOTE    ] MCI: Incremental fetch complete for 2025-07 (0.65 seconds).
[2025-10-24T19:48:28.947737] [INFO ] [REMOTE    ] MCK: Fetching primary data for 2025-02.
[2025-10-24T19:48:29.747732] [INFO ] [REMOTE    ] MCB: Fetching primary data for 2025-08.
[2025-10-24T19:48:30.378838] [INFO ] [REMOTE    ] MCK: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T19:48:30.547678] [INFO ] [REMOTE    ] MCK: Fetching primary data for 2025-03.
[2025-10-24T19:48:30.564586] [INFO ] [REMOTE    ] MCB: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T19:48:31.347765] [INFO ] [REMOTE    ] MCI: Fetching primary data for 2025-08.
[2025-10-24T19:48:32.009925] [INFO ] [REMOTE    ] MCI: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T19:48:32.147619] [INFO ] [REMOTE    ] MCI: Fetching primary data for 2025-09.
[2025-10-24T19:48:32.268928] [INFO ] [REMOTE    ] MCK: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T19:48:32.799703] [INFO ] [REMOTE    ] MCI: Incremental fetch complete for 2025-09 (0.65 seconds).
[2025-10-24T19:48:32.947640] [INFO ] [REMOTE    ] MCI: Fetching primary data for 2025-10.
[2025-10-24T19:48:33.672520] [INFO ] [REMOTE    ] MCI: Incremental fetch complete for 2025-10 (0.72 seconds).
[2025-10-24T19:48:33.674317] [INFO ] [REMOTE    ] MCI: Full fetch complete (9766 records).
[2025-10-24T19:48:33.674387] [DEBUG] [VALIDATOR ] MCI: Validating primary data.
[2025-10-24T19:48:33.752908] [INFO ] [REMOTE    ] MCB: Fetching primary data for 2025-09.
[2025-10-24T19:48:34.054450] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present.
[2025-10-24T19:48:34.054578] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed.
[2025-10-24T19:48:34.054943] [INFO ] [MAIN      ] MCI: Fetched primary data is valid.
[2025-10-24T19:48:34.055026] [DEBUG] [LOCAL     ] MCI: Saving primary data.
[2025-10-24T19:48:34.055296] [FATAL] [LOCAL     ] MCI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:48:34.055395] [FATAL] [MAIN      ] MCI: Failed to save primary data.
[2025-10-24T19:48:34.055470] [WARN ] [MAIN      ] MCI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:48:34.055559] [INFO ] [LOCAL     ] MCI: Starting deletion of primary data.
[2025-10-24T19:48:34.055638] [DEBUG] [LOCAL     ] MCI: No primary data file found to delete.
[2025-10-24T19:48:34.055732] [INFO ] [LOCAL     ] MCI: Starting deletion of derivative data.
[2025-10-24T19:48:34.055952] [DEBUG] [LOCAL     ] MCI: Deleted derivative data file.
[2025-10-24T19:48:34.056102] [INFO ] [MAIN      ] Update Progress: 1310/2366 symbols completed. MCI took 18.8s. Estimated remaining: 2h 15m 51s. Rate: 7.8 symbols/min
[2025-10-24T19:48:34.234853] [INFO ] [MAIN      ] MCN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:48:34.245357] [DEBUG] [LOCAL     ] MCN: Loaded 8036 existing records from primary storage.
[2025-10-24T19:48:34.245589] [INFO ] [MAIN      ] MCN: Loaded 8036 existing records.
[2025-10-24T19:48:34.430687] [WARN ] [MAIN      ] MCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:48:34.430903] [INFO ] [MAIN      ] MCN: Wiping existing primary data before full refresh.
[2025-10-24T19:48:34.430953] [INFO ] [LOCAL     ] MCN: Starting deletion of primary data.
[2025-10-24T19:48:34.431108] [DEBUG] [LOCAL     ] MCN: Deleted primary data file.
[2025-10-24T19:48:34.431148] [INFO ] [MAIN      ] MCN: Starting full primary refresh.
[2025-10-24T19:48:34.552797] [INFO ] [REMOTE    ] MCD: Fetching primary data for 2025-06.
[2025-10-24T19:48:34.766095] [INFO ] [REMOTE    ] MCB: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T19:48:34.847718] [INFO ] [REMOTE    ] MCN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:48:35.347680] [INFO ] [REMOTE    ] MCK: Fetching primary data for 2025-04.
[2025-10-24T19:48:36.147701] [INFO ] [REMOTE    ] MCB: Fetching primary data for 2025-10.
[2025-10-24T19:48:36.947700] [INFO ] [REMOTE    ] MCN: Fetching primary data for 2025-01.
[2025-10-24T19:48:37.086348] [INFO ] [REMOTE    ] MCD: Incremental fetch complete for 2025-06 (2.53 seconds).
[2025-10-24T19:48:37.185860] [INFO ] [REMOTE    ] MCB: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T19:48:37.188753] [INFO ] [REMOTE    ] MCB: Full fetch complete (16850 records).
[2025-10-24T19:48:37.188845] [DEBUG] [VALIDATOR ] MCB: Validating primary data.
[2025-10-24T19:48:37.574229] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present.
[2025-10-24T19:48:37.574324] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed.
[2025-10-24T19:48:37.574768] [INFO ] [MAIN      ] MCB: Fetched primary data is valid.
[2025-10-24T19:48:37.574891] [DEBUG] [LOCAL     ] MCB: Saving primary data.
[2025-10-24T19:48:37.584355] [FATAL] [LOCAL     ] MCB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:48:37.596633] [FATAL] [MAIN      ] MCB: Failed to save primary data.
[2025-10-24T19:48:37.599265] [WARN ] [MAIN      ] MCB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:48:37.599345] [INFO ] [LOCAL     ] MCB: Starting deletion of primary data.
[2025-10-24T19:48:37.600776] [INFO ] [REMOTE    ] MCK: Incremental fetch complete for 2025-04 (2.25 seconds).
[2025-10-24T19:48:37.600012] [DEBUG] [LOCAL     ] MCB: No primary data file found to delete.
[2025-10-24T19:48:37.610411] [INFO ] [LOCAL     ] MCB: Starting deletion of derivative data.
[2025-10-24T19:48:37.611133] [DEBUG] [LOCAL     ] MCB: Deleted derivative data file.
[2025-10-24T19:48:37.611230] [INFO ] [MAIN      ] Update Progress: 1311/2366 symbols completed. MCB took 35.5s. Estimated remaining: 2h 15m 40s. Rate: 7.8 symbols/min
[2025-10-24T19:48:37.756692] [INFO ] [REMOTE    ] MCD: Fetching primary data for 2025-07.
[2025-10-24T19:48:37.789141] [INFO ] [MAIN      ] MCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:48:37.789332] [DEBUG] [LOCAL     ] MCO: No existing data file found in primary storage.
[2025-10-24T19:48:37.789376] [WARN ] [MAIN      ] MCO: No existing data found, performing full refresh instead.
[2025-10-24T19:48:37.789482] [INFO ] [MAIN      ] MCO: Wiping existing primary data before full refresh.
[2025-10-24T19:48:37.789523] [INFO ] [LOCAL     ] MCO: Starting deletion of primary data.
[2025-10-24T19:48:37.789581] [DEBUG] [LOCAL     ] MCO: No primary data file found to delete.
[2025-10-24T19:48:37.789631] [INFO ] [MAIN      ] MCO: Starting full primary refresh.
[2025-10-24T19:48:37.963014] [INFO ] [REMOTE    ] MCN: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T19:48:38.171880] [INFO ] [REMOTE    ] MCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:48:38.547668] [INFO ] [REMOTE    ] MCK: Fetching primary data for 2025-05.
[2025-10-24T19:48:39.347631] [INFO ] [REMOTE    ] MCN: Fetching primary data for 2025-02.
[2025-10-24T19:48:39.585801] [INFO ] [REMOTE    ] MCD: Incremental fetch complete for 2025-07 (1.83 seconds).
[2025-10-24T19:48:40.120141] [INFO ] [REMOTE    ] MCK: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T19:48:40.134707] [INFO ] [REMOTE    ] MCN: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T19:48:40.147593] [INFO ] [REMOTE    ] MCK: Fetching primary data for 2025-06.
[2025-10-24T19:48:40.947679] [INFO ] [REMOTE    ] MCD: Fetching primary data for 2025-08.
[2025-10-24T19:48:41.458115] [INFO ] [REMOTE    ] MCK: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T19:48:41.747677] [INFO ] [REMOTE    ] MCN: Fetching primary data for 2025-03.
[2025-10-24T19:48:42.406122] [INFO ] [REMOTE    ] MCN: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T19:48:42.547715] [INFO ] [REMOTE    ] MCK: Fetching primary data for 2025-07.
[2025-10-24T19:48:43.149344] [INFO ] [REMOTE    ] MCD: Incremental fetch complete for 2025-08 (2.20 seconds).
[2025-10-24T19:48:43.347658] [INFO ] [REMOTE    ] MCN: Fetching primary data for 2025-04.
[2025-10-24T19:48:43.703708] [INFO ] [REMOTE    ] MCK: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T19:48:44.122985] [INFO ] [REMOTE    ] MCN: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T19:48:44.147634] [INFO ] [REMOTE    ] MCN: Fetching primary data for 2025-05.
[2025-10-24T19:48:44.857136] [INFO ] [REMOTE    ] MCN: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T19:48:44.947753] [INFO ] [REMOTE    ] MCK: Fetching primary data for 2025-08.
[2025-10-24T19:48:45.747730] [INFO ] [REMOTE    ] MCN: Fetching primary data for 2025-06.
[2025-10-24T19:48:46.507403] [INFO ] [REMOTE    ] MCN: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T19:48:46.536154] [INFO ] [REMOTE    ] MCK: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T19:48:46.547594] [INFO ] [REMOTE    ] MCK: Fetching primary data for 2025-09.
[2025-10-24T19:48:47.347762] [INFO ] [REMOTE    ] MCD: Fetching primary data for 2025-09.
[2025-10-24T19:48:48.043209] [INFO ] [REMOTE    ] MCK: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T19:48:48.147725] [INFO ] [REMOTE    ] MCN: Fetching primary data for 2025-07.
[2025-10-24T19:48:48.947701] [INFO ] [REMOTE    ] MCK: Fetching primary data for 2025-10.
[2025-10-24T19:48:49.136690] [INFO ] [REMOTE    ] MCD: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T19:48:49.160633] [INFO ] [REMOTE    ] MCN: Incremental fetch complete for 2025-07 (1.01 seconds).
[2025-10-24T19:48:49.747677] [INFO ] [REMOTE    ] MCN: Fetching primary data for 2025-08.
[2025-10-24T19:48:50.547693] [INFO ] [REMOTE    ] MCD: Fetching primary data for 2025-10.
[2025-10-24T19:48:50.603587] [INFO ] [REMOTE    ] MCK: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T19:48:50.606289] [INFO ] [REMOTE    ] MCN: Incremental fetch complete for 2025-08 (0.86 seconds).
[2025-10-24T19:48:50.612261] [INFO ] [REMOTE    ] MCK: Full fetch complete (56471 records).
[2025-10-24T19:48:50.612597] [DEBUG] [VALIDATOR ] MCK: Validating primary data.
[2025-10-24T19:48:51.003428] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present.
[2025-10-24T19:48:51.003519] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed.
[2025-10-24T19:48:51.004461] [INFO ] [MAIN      ] MCK: Fetched primary data is valid.
[2025-10-24T19:48:51.004582] [DEBUG] [LOCAL     ] MCK: Saving primary data.
[2025-10-24T19:48:51.005090] [FATAL] [LOCAL     ] MCK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:48:51.005154] [FATAL] [MAIN      ] MCK: Failed to save primary data.
[2025-10-24T19:48:51.005189] [WARN ] [MAIN      ] MCK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:48:51.005222] [INFO ] [LOCAL     ] MCK: Starting deletion of primary data.
[2025-10-24T19:48:51.005270] [DEBUG] [LOCAL     ] MCK: No primary data file found to delete.
[2025-10-24T19:48:51.005304] [INFO ] [LOCAL     ] MCK: Starting deletion of derivative data.
[2025-10-24T19:48:51.005526] [DEBUG] [LOCAL     ] MCK: Deleted derivative data file.
[2025-10-24T19:48:51.005618] [INFO ] [MAIN      ] Update Progress: 1312/2366 symbols completed. MCK took 29.0s. Estimated remaining: 2h 15m 36s. Rate: 7.8 symbols/min
[2025-10-24T19:48:51.185212] [INFO ] [MAIN      ] MCR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:48:51.196309] [DEBUG] [LOCAL     ] MCR: Loaded 8908 existing records from primary storage.
[2025-10-24T19:48:51.196515] [INFO ] [MAIN      ] MCR: Loaded 8908 existing records.
[2025-10-24T19:48:51.357274] [INFO ] [REMOTE    ] MCO: Fetching primary data for 2025-01.
[2025-10-24T19:48:51.389175] [WARN ] [MAIN      ] MCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:48:51.389419] [INFO ] [MAIN      ] MCR: Wiping existing primary data before full refresh.
[2025-10-24T19:48:51.389468] [INFO ] [LOCAL     ] MCR: Starting deletion of primary data.
[2025-10-24T19:48:51.389719] [DEBUG] [LOCAL     ] MCR: Deleted primary data file.
[2025-10-24T19:48:51.389786] [INFO ] [MAIN      ] MCR: Starting full primary refresh.
[2025-10-24T19:48:51.766546] [INFO ] [REMOTE    ] MCR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:48:52.147707] [INFO ] [REMOTE    ] MCR: Fetching primary data for 2025-01.
[2025-10-24T19:48:52.877457] [INFO ] [REMOTE    ] MCO: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T19:48:52.910183] [INFO ] [REMOTE    ] MCD: Incremental fetch complete for 2025-10 (2.36 seconds).
[2025-10-24T19:48:52.919991] [INFO ] [REMOTE    ] MCD: Full fetch complete (77120 records).
[2025-10-24T19:48:52.920118] [DEBUG] [VALIDATOR ] MCD: Validating primary data.
[2025-10-24T19:48:52.952227] [INFO ] [REMOTE    ] MCO: Fetching primary data for 2025-02.
[2025-10-24T19:48:53.039005] [INFO ] [REMOTE    ] MCR: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T19:48:53.140778] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T19:48:53.141599] [FATAL] [MAIN      ] MCD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:48:53.141693] [WARN ] [MAIN      ] MCD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:48:53.141747] [INFO ] [LOCAL     ] MCD: Starting deletion of primary data.
[2025-10-24T19:48:53.141805] [DEBUG] [LOCAL     ] MCD: No primary data file found to delete.
[2025-10-24T19:48:53.141840] [INFO ] [LOCAL     ] MCD: Starting deletion of derivative data.
[2025-10-24T19:48:53.141894] [DEBUG] [LOCAL     ] MCD: No derivative data file found to delete.
[2025-10-24T19:48:53.142262] [INFO ] [MAIN      ] Update Progress: 1313/2366 symbols completed. MCD took 47.7s. Estimated remaining: 2h 15m 24s. Rate: 7.8 symbols/min
[2025-10-24T19:48:53.309021] [INFO ] [MAIN      ] MCS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:48:53.335480] [DEBUG] [LOCAL     ] MCS: Loaded 21310 existing records from primary storage.
[2025-10-24T19:48:53.335785] [INFO ] [MAIN      ] MCS: Loaded 21310 existing records.
[2025-10-24T19:48:53.509409] [WARN ] [MAIN      ] MCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:48:53.509608] [INFO ] [MAIN      ] MCS: Wiping existing primary data before full refresh.
[2025-10-24T19:48:53.509680] [INFO ] [LOCAL     ] MCS: Starting deletion of primary data.
[2025-10-24T19:48:53.509955] [DEBUG] [LOCAL     ] MCS: Deleted primary data file.
[2025-10-24T19:48:53.509993] [INFO ] [MAIN      ] MCS: Starting full primary refresh.
[2025-10-24T19:48:53.752788] [INFO ] [REMOTE    ] MCN: Fetching primary data for 2025-09.
[2025-10-24T19:48:53.853217] [INFO ] [REMOTE    ] MCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:48:54.502587] [INFO ] [REMOTE    ] MCN: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T19:48:54.547686] [INFO ] [REMOTE    ] MCS: Fetching primary data for 2025-01.
[2025-10-24T19:48:54.595479] [INFO ] [REMOTE    ] MCO: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T19:48:55.347712] [INFO ] [REMOTE    ] MCO: Fetching primary data for 2025-03.
[2025-10-24T19:48:55.691631] [INFO ] [REMOTE    ] MCS: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T19:48:56.147728] [INFO ] [REMOTE    ] MCN: Fetching primary data for 2025-10.
[2025-10-24T19:48:56.947621] [INFO ] [REMOTE    ] MCR: Fetching primary data for 2025-02.
[2025-10-24T19:48:56.955880] [INFO ] [REMOTE    ] MCN: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T19:48:56.957849] [INFO ] [REMOTE    ] MCN: Full fetch complete (11505 records).
[2025-10-24T19:48:56.958033] [DEBUG] [VALIDATOR ] MCN: Validating primary data.
[2025-10-24T19:48:57.271533] [INFO ] [REMOTE    ] MCO: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T19:48:57.362217] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present.
[2025-10-24T19:48:57.362289] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed.
[2025-10-24T19:48:57.362545] [INFO ] [MAIN      ] MCN: Fetched primary data is valid.
[2025-10-24T19:48:57.362582] [DEBUG] [LOCAL     ] MCN: Saving primary data.
[2025-10-24T19:48:57.362810] [FATAL] [LOCAL     ] MCN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:48:57.362889] [FATAL] [MAIN      ] MCN: Failed to save primary data.
[2025-10-24T19:48:57.362931] [WARN ] [MAIN      ] MCN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:48:57.362970] [INFO ] [LOCAL     ] MCN: Starting deletion of primary data.
[2025-10-24T19:48:57.363018] [DEBUG] [LOCAL     ] MCN: No primary data file found to delete.
[2025-10-24T19:48:57.363052] [INFO ] [LOCAL     ] MCN: Starting deletion of derivative data.
[2025-10-24T19:48:57.363162] [DEBUG] [LOCAL     ] MCN: Deleted derivative data file.
[2025-10-24T19:48:57.363226] [INFO ] [MAIN      ] Update Progress: 1314/2366 symbols completed. MCN took 23.3s. Estimated remaining: 2h 15m 14s. Rate: 7.8 symbols/min
[2025-10-24T19:48:57.539126] [INFO ] [MAIN      ] MCY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:48:57.563347] [DEBUG] [LOCAL     ] MCY: Loaded 23681 existing records from primary storage.
[2025-10-24T19:48:57.563612] [INFO ] [MAIN      ] MCY: Loaded 23681 existing records.
[2025-10-24T19:48:57.676616] [INFO ] [REMOTE    ] MCR: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T19:48:57.753831] [INFO ] [REMOTE    ] MCR: Fetching primary data for 2025-03.
[2025-10-24T19:48:57.759509] [WARN ] [MAIN      ] MCY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:48:57.760604] [INFO ] [MAIN      ] MCY: Wiping existing primary data before full refresh.
[2025-10-24T19:48:57.760684] [INFO ] [LOCAL     ] MCY: Starting deletion of primary data.
[2025-10-24T19:48:57.760902] [DEBUG] [LOCAL     ] MCY: Deleted primary data file.
[2025-10-24T19:48:57.760961] [INFO ] [MAIN      ] MCY: Starting full primary refresh.
[2025-10-24T19:48:58.134160] [INFO ] [REMOTE    ] MCY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:48:58.547729] [INFO ] [REMOTE    ] MCS: Fetching primary data for 2025-02.
[2025-10-24T19:48:58.556127] [INFO ] [REMOTE    ] MCR: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T19:48:59.347716] [INFO ] [REMOTE    ] MCO: Fetching primary data for 2025-04.
[2025-10-24T19:48:59.567589] [INFO ] [REMOTE    ] MCS: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T19:49:00.147751] [INFO ] [REMOTE    ] MCR: Fetching primary data for 2025-04.
[2025-10-24T19:49:00.947721] [INFO ] [REMOTE    ] MCY: Fetching primary data for 2025-01.
[2025-10-24T19:49:01.445342] [INFO ] [REMOTE    ] MCR: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T19:49:01.747732] [INFO ] [REMOTE    ] MCS: Fetching primary data for 2025-03.
[2025-10-24T19:49:02.000754] [INFO ] [REMOTE    ] MCO: Incremental fetch complete for 2025-04 (2.65 seconds).
[2025-10-24T19:49:02.547617] [INFO ] [REMOTE    ] MCR: Fetching primary data for 2025-05.
[2025-10-24T19:49:02.731406] [INFO ] [REMOTE    ] MCY: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T19:49:03.347617] [INFO ] [REMOTE    ] MCY: Fetching primary data for 2025-02.
[2025-10-24T19:49:03.435245] [INFO ] [REMOTE    ] MCR: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T19:49:04.038205] [INFO ] [REMOTE    ] MCS: Incremental fetch complete for 2025-03 (2.29 seconds).
[2025-10-24T19:49:04.147715] [INFO ] [REMOTE    ] MCS: Fetching primary data for 2025-04.
[2025-10-24T19:49:04.708296] [INFO ] [REMOTE    ] MCY: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T19:49:04.947603] [INFO ] [REMOTE    ] MCY: Fetching primary data for 2025-03.
[2025-10-24T19:49:05.169608] [INFO ] [REMOTE    ] MCS: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T19:49:05.747720] [INFO ] [REMOTE    ] MCO: Fetching primary data for 2025-05.
[2025-10-24T19:49:06.108111] [INFO ] [REMOTE    ] MCY: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T19:49:06.547680] [INFO ] [REMOTE    ] MCS: Fetching primary data for 2025-05.
[2025-10-24T19:49:07.297093] [INFO ] [REMOTE    ] MCO: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T19:49:07.347606] [INFO ] [REMOTE    ] MCO: Fetching primary data for 2025-06.
[2025-10-24T19:49:07.574739] [INFO ] [REMOTE    ] MCS: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T19:49:08.147697] [INFO ] [REMOTE    ] MCR: Fetching primary data for 2025-06.
[2025-10-24T19:49:08.700624] [INFO ] [REMOTE    ] MCO: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T19:49:08.917445] [INFO ] [REMOTE    ] MCR: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T19:49:08.947682] [INFO ] [REMOTE    ] MCY: Fetching primary data for 2025-04.
[2025-10-24T19:49:09.747610] [INFO ] [REMOTE    ] MCS: Fetching primary data for 2025-06.
[2025-10-24T19:49:10.167347] [INFO ] [REMOTE    ] MCY: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T19:49:10.547612] [INFO ] [REMOTE    ] MCR: Fetching primary data for 2025-07.
[2025-10-24T19:49:10.746152] [INFO ] [REMOTE    ] MCS: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T19:49:10.975836] [INFO ] [REMOTE    ] MCR: Incremental fetch complete for 2025-07 (0.43 seconds).
[2025-10-24T19:49:11.347640] [INFO ] [REMOTE    ] MCO: Fetching primary data for 2025-07.
[2025-10-24T19:49:12.147674] [INFO ] [REMOTE    ] MCY: Fetching primary data for 2025-05.
[2025-10-24T19:49:12.840734] [INFO ] [REMOTE    ] MCO: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T19:49:12.947631] [INFO ] [REMOTE    ] MCO: Fetching primary data for 2025-08.
[2025-10-24T19:49:13.489547] [INFO ] [REMOTE    ] MCY: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T19:49:13.747623] [INFO ] [REMOTE    ] MCS: Fetching primary data for 2025-07.
[2025-10-24T19:49:14.479782] [INFO ] [REMOTE    ] MCO: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T19:49:14.540833] [INFO ] [REMOTE    ] MCS: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T19:49:14.547593] [INFO ] [REMOTE    ] MCS: Fetching primary data for 2025-08.
[2025-10-24T19:49:15.347735] [INFO ] [REMOTE    ] MCY: Fetching primary data for 2025-06.
[2025-10-24T19:49:15.748672] [INFO ] [REMOTE    ] MCS: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T19:49:16.147621] [INFO ] [REMOTE    ] MCR: Fetching primary data for 2025-08.
[2025-10-24T19:49:16.458314] [INFO ] [REMOTE    ] MCY: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T19:49:16.947694] [INFO ] [REMOTE    ] MCO: Fetching primary data for 2025-09.
[2025-10-24T19:49:16.975011] [INFO ] [REMOTE    ] MCR: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T19:49:17.747764] [INFO ] [REMOTE    ] MCR: Fetching primary data for 2025-09.
[2025-10-24T19:49:18.355182] [INFO ] [REMOTE    ] MCR: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T19:49:18.484409] [INFO ] [REMOTE    ] MCO: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T19:49:18.547674] [INFO ] [REMOTE    ] MCO: Fetching primary data for 2025-10.
[2025-10-24T19:49:19.347705] [INFO ] [REMOTE    ] MCR: Fetching primary data for 2025-10.
[2025-10-24T19:49:20.016720] [INFO ] [REMOTE    ] MCR: Incremental fetch complete for 2025-10 (0.67 seconds).
[2025-10-24T19:49:20.018815] [INFO ] [REMOTE    ] MCR: Full fetch complete (13311 records).
[2025-10-24T19:49:20.018885] [DEBUG] [VALIDATOR ] MCR: Validating primary data.
[2025-10-24T19:49:20.149984] [INFO ] [REMOTE    ] MCS: Fetching primary data for 2025-09.
[2025-10-24T19:49:20.412758] [INFO ] [REMOTE    ] MCO: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T19:49:20.412996] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present.
[2025-10-24T19:49:20.420924] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed.
[2025-10-24T19:49:20.421252] [INFO ] [MAIN      ] MCR: Fetched primary data is valid.
[2025-10-24T19:49:20.421529] [DEBUG] [LOCAL     ] MCR: Saving primary data.
[2025-10-24T19:49:20.421948] [FATAL] [LOCAL     ] MCR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:49:20.422028] [FATAL] [MAIN      ] MCR: Failed to save primary data.
[2025-10-24T19:49:20.422070] [WARN ] [MAIN      ] MCR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:49:20.422103] [INFO ] [LOCAL     ] MCR: Starting deletion of primary data.
[2025-10-24T19:49:20.422155] [DEBUG] [LOCAL     ] MCR: No primary data file found to delete.
[2025-10-24T19:49:20.422189] [INFO ] [LOCAL     ] MCR: Starting deletion of derivative data.
[2025-10-24T19:49:20.422311] [DEBUG] [LOCAL     ] MCR: Deleted derivative data file.
[2025-10-24T19:49:20.422383] [INFO ] [MAIN      ] Update Progress: 1315/2366 symbols completed. MCR took 29.4s. Estimated remaining: 2h 15m 18s. Rate: 7.8 symbols/min
[2025-10-24T19:49:20.422711] [INFO ] [REMOTE    ] MCO: Full fetch complete (58436 records).
[2025-10-24T19:49:20.465965] [DEBUG] [VALIDATOR ] MCO: Validating primary data.
[2025-10-24T19:49:20.756860] [INFO ] [MAIN      ] MD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:49:20.948180] [INFO ] [REMOTE    ] MCY: Fetching primary data for 2025-07.
[2025-10-24T19:49:21.007371] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present.
[2025-10-24T19:49:21.007630] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed.
[2025-10-24T19:49:21.008732] [INFO ] [MAIN      ] MCO: Fetched primary data is valid.
[2025-10-24T19:49:21.010272] [DEBUG] [LOCAL     ] MCO: Saving primary data.
[2025-10-24T19:49:21.022046] [FATAL] [LOCAL     ] MCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:49:21.023793] [FATAL] [MAIN      ] MCO: Failed to save primary data.
[2025-10-24T19:49:21.023926] [WARN ] [MAIN      ] MCO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:49:21.023999] [INFO ] [LOCAL     ] MCO: Starting deletion of primary data.
[2025-10-24T19:49:21.024820] [DEBUG] [LOCAL     ] MD: Loaded 38809 existing records from primary storage.
[2025-10-24T19:49:21.025044] [DEBUG] [LOCAL     ] MCO: No primary data file found to delete.
[2025-10-24T19:49:21.025464] [INFO ] [MAIN      ] MD: Loaded 38809 existing records.
[2025-10-24T19:49:21.025566] [INFO ] [LOCAL     ] MCO: Starting deletion of derivative data.
[2025-10-24T19:49:21.072293] [DEBUG] [LOCAL     ] MCO: No derivative data file found to delete.
[2025-10-24T19:49:21.086385] [INFO ] [MAIN      ] Update Progress: 1316/2366 symbols completed. MCO took 43.5s. Estimated remaining: 2h 15m 5s. Rate: 7.8 symbols/min
[2025-10-24T19:49:21.403302] [INFO ] [MAIN      ] MDST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:49:21.426289] [INFO ] [REMOTE    ] MCS: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T19:49:21.477508] [WARN ] [MAIN      ] MD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:49:21.480839] [INFO ] [MAIN      ] MD: Wiping existing primary data before full refresh.
[2025-10-24T19:49:21.481010] [INFO ] [LOCAL     ] MD: Starting deletion of primary data.
[2025-10-24T19:49:21.481985] [DEBUG] [LOCAL     ] MD: Deleted primary data file.
[2025-10-24T19:49:21.485705] [INFO ] [MAIN      ] MD: Starting full primary refresh.
[2025-10-24T19:49:21.485595] [DEBUG] [LOCAL     ] MDST: Loaded 6167 existing records from primary storage.
[2025-10-24T19:49:21.491215] [INFO ] [MAIN      ] MDST: Loaded 6167 existing records.
[2025-10-24T19:49:21.748713] [INFO ] [REMOTE    ] MCS: Fetching primary data for 2025-10.
[2025-10-24T19:49:21.817104] [WARN ] [MAIN      ] MDST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:49:21.868417] [INFO ] [MAIN      ] MDST: Wiping existing primary data before full refresh.
[2025-10-24T19:49:21.878204] [INFO ] [LOCAL     ] MDST: Starting deletion of primary data.
[2025-10-24T19:49:21.928137] [DEBUG] [LOCAL     ] MDST: Deleted primary data file.
[2025-10-24T19:49:21.936810] [INFO ] [MAIN      ] MDST: Starting full primary refresh.
[2025-10-24T19:49:22.164675] [INFO ] [REMOTE    ] MD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:49:22.254271] [INFO ] [REMOTE    ] MCY: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T19:49:22.440054] [INFO ] [REMOTE    ] MDST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:49:22.547624] [INFO ] [REMOTE    ] MCY: Fetching primary data for 2025-08.
[2025-10-24T19:49:23.130990] [INFO ] [REMOTE    ] MCS: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T19:49:23.135484] [INFO ] [REMOTE    ] MCS: Full fetch complete (30675 records).
[2025-10-24T19:49:23.135570] [DEBUG] [VALIDATOR ] MCS: Validating primary data.
[2025-10-24T19:49:23.358256] [INFO ] [REMOTE    ] MDST: Fetching primary data for 2025-01.
[2025-10-24T19:49:23.522997] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present.
[2025-10-24T19:49:23.523078] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed.
[2025-10-24T19:49:23.523774] [INFO ] [MAIN      ] MCS: Fetched primary data is valid.
[2025-10-24T19:49:23.523834] [DEBUG] [LOCAL     ] MCS: Saving primary data.
[2025-10-24T19:49:23.524131] [FATAL] [LOCAL     ] MCS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:49:23.524210] [FATAL] [MAIN      ] MCS: Failed to save primary data.
[2025-10-24T19:49:23.524251] [WARN ] [MAIN      ] MCS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:49:23.524286] [INFO ] [LOCAL     ] MCS: Starting deletion of primary data.
[2025-10-24T19:49:23.524334] [DEBUG] [LOCAL     ] MCS: No primary data file found to delete.
[2025-10-24T19:49:23.524369] [INFO ] [LOCAL     ] MCS: Starting deletion of derivative data.
[2025-10-24T19:49:23.524490] [DEBUG] [LOCAL     ] MCS: Deleted derivative data file.
[2025-10-24T19:49:23.524565] [INFO ] [MAIN      ] Update Progress: 1317/2366 symbols completed. MCS took 30.4s. Estimated remaining: 2h 14m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:49:23.689789] [INFO ] [REMOTE    ] MCY: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T19:49:24.075203] [INFO ] [REMOTE    ] MDST: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T19:49:24.147775] [INFO ] [REMOTE    ] MDST: Fetching primary data for 2025-02.
[2025-10-24T19:49:24.775635] [INFO ] [REMOTE    ] MDST: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T19:49:24.947684] [INFO ] [REMOTE    ] MDST: Fetching primary data for 2025-03.
[2025-10-24T19:49:25.541594] [INFO ] [REMOTE    ] MDST: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T19:49:25.747740] [INFO ] [REMOTE    ] MD: Fetching primary data for 2025-01.
[2025-10-24T19:49:26.547723] [INFO ] [REMOTE    ] MCY: Fetching primary data for 2025-09.
[2025-10-24T19:49:27.047347] [INFO ] [REMOTE    ] MD: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T19:49:27.347712] [INFO ] [REMOTE    ] MDST: Fetching primary data for 2025-04.
[2025-10-24T19:49:27.531610] [INFO ] [REMOTE    ] MCY: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T19:49:27.911469] [INFO ] [REMOTE    ] MDST: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T19:49:28.147767] [INFO ] [REMOTE    ] MD: Fetching primary data for 2025-02.
[2025-10-24T19:49:28.947754] [INFO ] [REMOTE    ] MCY: Fetching primary data for 2025-10.
[2025-10-24T19:49:29.472250] [INFO ] [REMOTE    ] MD: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T19:49:29.747743] [INFO ] [REMOTE    ] MDST: Fetching primary data for 2025-05.
[2025-10-24T19:49:30.149484] [INFO ] [REMOTE    ] MCY: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T19:49:30.153564] [INFO ] [REMOTE    ] MCY: Full fetch complete (40614 records).
[2025-10-24T19:49:30.153667] [DEBUG] [VALIDATOR ] MCY: Validating primary data.
[2025-10-24T19:49:30.381988] [INFO ] [REMOTE    ] MDST: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T19:49:30.543326] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present.
[2025-10-24T19:49:30.543462] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed.
[2025-10-24T19:49:30.544342] [INFO ] [MAIN      ] MCY: Fetched primary data is valid.
[2025-10-24T19:49:30.544403] [DEBUG] [LOCAL     ] MCY: Saving primary data.
[2025-10-24T19:49:30.544807] [FATAL] [LOCAL     ] MCY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:49:30.544913] [FATAL] [MAIN      ] MCY: Failed to save primary data.
[2025-10-24T19:49:30.544955] [WARN ] [MAIN      ] MCY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:49:30.545013] [INFO ] [LOCAL     ] MCY: Starting deletion of primary data.
[2025-10-24T19:49:30.545070] [DEBUG] [LOCAL     ] MCY: No primary data file found to delete.
[2025-10-24T19:49:30.545105] [INFO ] [LOCAL     ] MCY: Starting deletion of derivative data.
[2025-10-24T19:49:30.545242] [DEBUG] [LOCAL     ] MCY: Deleted derivative data file.
[2025-10-24T19:49:30.545350] [INFO ] [MAIN      ] Update Progress: 1318/2366 symbols completed. MCY took 33.2s. Estimated remaining: 2h 14m 45s. Rate: 7.8 symbols/min
[2025-10-24T19:49:30.547612] [INFO ] [REMOTE    ] MD: Fetching primary data for 2025-03.
[2025-10-24T19:49:31.347747] [INFO ] [REMOTE    ] MDST: Fetching primary data for 2025-06.
[2025-10-24T19:49:31.929666] [INFO ] [REMOTE    ] MDST: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T19:49:32.147734] [INFO ] [REMOTE    ] MDST: Fetching primary data for 2025-07.
[2025-10-24T19:49:32.188549] [INFO ] [REMOTE    ] MD: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T19:49:32.833012] [INFO ] [REMOTE    ] MDST: Incremental fetch complete for 2025-07 (0.69 seconds).
[2025-10-24T19:49:32.947635] [INFO ] [REMOTE    ] MDST: Fetching primary data for 2025-08.
[2025-10-24T19:49:33.590139] [INFO ] [REMOTE    ] MDST: Incremental fetch complete for 2025-08 (0.64 seconds).
[2025-10-24T19:49:33.747749] [INFO ] [REMOTE    ] MD: Fetching primary data for 2025-04.
[2025-10-24T19:49:34.547709] [INFO ] [REMOTE    ] MDST: Fetching primary data for 2025-09.
[2025-10-24T19:49:35.045129] [INFO ] [REMOTE    ] MD: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T19:49:35.347736] [INFO ] [REMOTE    ] MD: Fetching primary data for 2025-05.
[2025-10-24T19:49:35.356712] [INFO ] [REMOTE    ] MDST: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T19:49:36.147730] [INFO ] [REMOTE    ] MDST: Fetching primary data for 2025-10.
[2025-10-24T19:49:36.795251] [INFO ] [REMOTE    ] MDST: Incremental fetch complete for 2025-10 (0.65 seconds).
[2025-10-24T19:49:36.798090] [INFO ] [REMOTE    ] MDST: Full fetch complete (8903 records).
[2025-10-24T19:49:36.798184] [DEBUG] [VALIDATOR ] MDST: Validating primary data.
[2025-10-24T19:49:37.049127] [INFO ] [REMOTE    ] MD: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T19:49:37.166752] [INFO ] [REMOTE    ] MD: Fetching primary data for 2025-06.
[2025-10-24T19:49:37.256449] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present.
[2025-10-24T19:49:37.256594] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed.
[2025-10-24T19:49:37.256948] [INFO ] [MAIN      ] MDST: Fetched primary data is valid.
[2025-10-24T19:49:37.257010] [DEBUG] [LOCAL     ] MDST: Saving primary data.
[2025-10-24T19:49:37.257333] [FATAL] [LOCAL     ] MDST: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:49:37.257412] [FATAL] [MAIN      ] MDST: Failed to save primary data.
[2025-10-24T19:49:37.257477] [WARN ] [MAIN      ] MDST: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:49:37.257544] [INFO ] [LOCAL     ] MDST: Starting deletion of primary data.
[2025-10-24T19:49:37.257606] [DEBUG] [LOCAL     ] MDST: No primary data file found to delete.
[2025-10-24T19:49:37.257665] [INFO ] [LOCAL     ] MDST: Starting deletion of derivative data.
[2025-10-24T19:49:37.257830] [DEBUG] [LOCAL     ] MDST: Deleted derivative data file.
[2025-10-24T19:49:37.257914] [INFO ] [MAIN      ] Update Progress: 1319/2366 symbols completed. MDST took 16.2s. Estimated remaining: 2h 14m 36s. Rate: 7.8 symbols/min
[2025-10-24T19:49:38.598094] [INFO ] [REMOTE    ] MD: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T19:49:38.606425] [INFO ] [REMOTE    ] MD: Fetching primary data for 2025-07.
[2025-10-24T19:49:39.906111] [INFO ] [REMOTE    ] MD: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T19:49:39.915797] [INFO ] [REMOTE    ] MD: Fetching primary data for 2025-08.
[2025-10-24T19:49:41.233308] [INFO ] [REMOTE    ] MD: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T19:49:41.242943] [INFO ] [REMOTE    ] MD: Fetching primary data for 2025-09.
[2025-10-24T19:49:42.620746] [INFO ] [REMOTE    ] MD: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T19:49:42.629409] [INFO ] [REMOTE    ] MD: Fetching primary data for 2025-10.
[2025-10-24T19:49:44.185070] [INFO ] [REMOTE    ] MD: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T19:49:44.192608] [INFO ] [REMOTE    ] MD: Full fetch complete (55250 records).
[2025-10-24T19:49:44.192762] [DEBUG] [VALIDATOR ] MD: Validating primary data.
[2025-10-24T19:49:44.572264] [DEBUG] [VALIDATOR ] MD: All expected trading days are present.
[2025-10-24T19:49:44.572355] [DEBUG] [VALIDATOR ] MD: Primary data validation passed.
[2025-10-24T19:49:44.573304] [INFO ] [MAIN      ] MD: Fetched primary data is valid.
[2025-10-24T19:49:44.573365] [DEBUG] [LOCAL     ] MD: Saving primary data.
[2025-10-24T19:49:44.573839] [FATAL] [LOCAL     ] MD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:49:44.573948] [FATAL] [MAIN      ] MD: Failed to save primary data.
[2025-10-24T19:49:44.573989] [WARN ] [MAIN      ] MD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:49:44.574023] [INFO ] [LOCAL     ] MD: Starting deletion of primary data.
[2025-10-24T19:49:44.574077] [DEBUG] [LOCAL     ] MD: No primary data file found to delete.
[2025-10-24T19:49:44.574112] [INFO ] [LOCAL     ] MD: Starting deletion of derivative data.
[2025-10-24T19:49:44.574287] [DEBUG] [LOCAL     ] MD: Deleted derivative data file.
[2025-10-24T19:49:44.574379] [INFO ] [MAIN      ] Update Progress: 1320/2366 symbols completed. MD took 24.2s. Estimated remaining: 2h 14m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:49:45.298272] [INFO ] [MAIN      ] MEC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:49:45.299726] [INFO ] [MAIN      ] MDT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:49:45.350297] [INFO ] [MAIN      ] MDV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:49:45.352069] [INFO ] [MAIN      ] MDU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:49:45.379252] [DEBUG] [LOCAL     ] MEC: Loaded 17069 existing records from primary storage.
[2025-10-24T19:49:45.380025] [DEBUG] [LOCAL     ] MDV: Loaded 8334 existing records from primary storage.
[2025-10-24T19:49:45.380536] [INFO ] [MAIN      ] MEC: Loaded 17069 existing records.
[2025-10-24T19:49:45.380741] [INFO ] [MAIN      ] MDV: Loaded 8334 existing records.
[2025-10-24T19:49:45.761379] [DEBUG] [LOCAL     ] MDT: Loaded 54068 existing records from primary storage.
[2025-10-24T19:49:45.785379] [INFO ] [MAIN      ] MDT: Loaded 54068 existing records.
[2025-10-24T19:49:45.794185] [WARN ] [MAIN      ] MEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:49:45.835687] [INFO ] [MAIN      ] MEC: Wiping existing primary data before full refresh.
[2025-10-24T19:49:45.829604] [WARN ] [MAIN      ] MDV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:49:45.852300] [INFO ] [LOCAL     ] MEC: Starting deletion of primary data.
[2025-10-24T19:49:45.862418] [INFO ] [MAIN      ] MDV: Wiping existing primary data before full refresh.
[2025-10-24T19:49:45.868596] [DEBUG] [LOCAL     ] MDU: Loaded 48379 existing records from primary storage.
[2025-10-24T19:49:45.879306] [INFO ] [LOCAL     ] MDV: Starting deletion of primary data.
[2025-10-24T19:49:45.884822] [INFO ] [MAIN      ] MDU: Loaded 48379 existing records.
[2025-10-24T19:49:45.899956] [DEBUG] [LOCAL     ] MEC: Deleted primary data file.
[2025-10-24T19:49:45.910417] [DEBUG] [LOCAL     ] MDV: Deleted primary data file.
[2025-10-24T19:49:45.928790] [INFO ] [MAIN      ] MEC: Starting full primary refresh.
[2025-10-24T19:49:45.923479] [INFO ] [MAIN      ] MDV: Starting full primary refresh.
[2025-10-24T19:49:46.365840] [WARN ] [MAIN      ] MDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:49:46.405998] [INFO ] [MAIN      ] MDT: Wiping existing primary data before full refresh.
[2025-10-24T19:49:46.456594] [INFO ] [LOCAL     ] MDT: Starting deletion of primary data.
[2025-10-24T19:49:46.581031] [WARN ] [MAIN      ] MDU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:49:46.614337] [DEBUG] [LOCAL     ] MDT: Deleted primary data file.
[2025-10-24T19:49:46.648526] [INFO ] [MAIN      ] MDU: Wiping existing primary data before full refresh.
[2025-10-24T19:49:46.670940] [INFO ] [MAIN      ] MDT: Starting full primary refresh.
[2025-10-24T19:49:46.701763] [INFO ] [LOCAL     ] MDU: Starting deletion of primary data.
[2025-10-24T19:49:46.765538] [DEBUG] [LOCAL     ] MDU: Deleted primary data file.
[2025-10-24T19:49:46.799436] [INFO ] [MAIN      ] MDU: Starting full primary refresh.
[2025-10-24T19:49:47.230437] [INFO ] [REMOTE    ] MDV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:49:47.286699] [INFO ] [REMOTE    ] MDV: Fetching primary data for 2025-01.
[2025-10-24T19:49:47.587431] [INFO ] [REMOTE    ] MEC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:49:47.620835] [INFO ] [REMOTE    ] MEC: Fetching primary data for 2025-01.
[2025-10-24T19:49:47.775834] [INFO ] [REMOTE    ] MDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:49:47.792464] [INFO ] [REMOTE    ] MDT: Fetching primary data for 2025-01.
[2025-10-24T19:49:47.857811] [INFO ] [REMOTE    ] MDU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:49:47.858129] [INFO ] [REMOTE    ] MDU: Fetching primary data for 2025-01.
[2025-10-24T19:49:48.098095] [INFO ] [REMOTE    ] MDV: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T19:49:48.099944] [INFO ] [REMOTE    ] MDV: Fetching primary data for 2025-02.
[2025-10-24T19:49:48.582869] [INFO ] [REMOTE    ] MEC: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T19:49:48.586796] [INFO ] [REMOTE    ] MEC: Fetching primary data for 2025-02.
[2025-10-24T19:49:48.668264] [INFO ] [REMOTE    ] MDV: Incremental fetch complete for 2025-02 (0.57 seconds).
[2025-10-24T19:49:48.670403] [INFO ] [REMOTE    ] MDV: Fetching primary data for 2025-03.
[2025-10-24T19:49:49.421588] [INFO ] [REMOTE    ] MDV: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T19:49:49.426379] [INFO ] [REMOTE    ] MDV: Fetching primary data for 2025-04.
[2025-10-24T19:49:49.435286] [INFO ] [REMOTE    ] MEC: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T19:49:49.438552] [INFO ] [REMOTE    ] MEC: Fetching primary data for 2025-03.
[2025-10-24T19:49:49.471855] [INFO ] [REMOTE    ] MDU: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T19:49:49.482607] [INFO ] [REMOTE    ] MDU: Fetching primary data for 2025-02.
[2025-10-24T19:49:49.587726] [INFO ] [REMOTE    ] MDT: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T19:49:49.598870] [INFO ] [REMOTE    ] MDT: Fetching primary data for 2025-02.
[2025-10-24T19:49:50.233169] [INFO ] [REMOTE    ] MDV: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T19:49:50.235722] [INFO ] [REMOTE    ] MDV: Fetching primary data for 2025-05.
[2025-10-24T19:49:50.440524] [INFO ] [REMOTE    ] MEC: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T19:49:50.547689] [INFO ] [REMOTE    ] MEC: Fetching primary data for 2025-04.
[2025-10-24T19:49:50.716709] [INFO ] [REMOTE    ] MDV: Incremental fetch complete for 2025-05 (0.48 seconds).
[2025-10-24T19:49:51.083833] [INFO ] [REMOTE    ] MDU: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T19:49:51.186262] [INFO ] [REMOTE    ] MDT: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T19:49:51.211419] [INFO ] [REMOTE    ] MEC: Incremental fetch complete for 2025-04 (0.66 seconds).
[2025-10-24T19:49:51.347703] [INFO ] [REMOTE    ] MEC: Fetching primary data for 2025-05.
[2025-10-24T19:49:52.147622] [INFO ] [REMOTE    ] MDU: Fetching primary data for 2025-03.
[2025-10-24T19:49:52.354995] [INFO ] [REMOTE    ] MEC: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T19:49:52.947730] [INFO ] [REMOTE    ] MDV: Fetching primary data for 2025-06.
[2025-10-24T19:49:53.747696] [INFO ] [REMOTE    ] MEC: Fetching primary data for 2025-06.
[2025-10-24T19:49:53.761068] [INFO ] [REMOTE    ] MDV: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T19:49:53.796429] [INFO ] [REMOTE    ] MDU: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T19:49:54.547625] [INFO ] [REMOTE    ] MDV: Fetching primary data for 2025-07.
[2025-10-24T19:49:54.638346] [INFO ] [REMOTE    ] MEC: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T19:49:55.092402] [INFO ] [REMOTE    ] MDV: Incremental fetch complete for 2025-07 (0.54 seconds).
[2025-10-24T19:49:55.347697] [INFO ] [REMOTE    ] MEC: Fetching primary data for 2025-07.
[2025-10-24T19:49:56.147703] [INFO ] [REMOTE    ] MDT: Fetching primary data for 2025-03.
[2025-10-24T19:49:56.162414] [INFO ] [REMOTE    ] MEC: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T19:49:56.947635] [INFO ] [REMOTE    ] MEC: Fetching primary data for 2025-08.
[2025-10-24T19:49:57.747696] [INFO ] [REMOTE    ] MDU: Fetching primary data for 2025-04.
[2025-10-24T19:49:57.899573] [INFO ] [REMOTE    ] MEC: Incremental fetch complete for 2025-08 (0.95 seconds).
[2025-10-24T19:49:57.970056] [INFO ] [REMOTE    ] MDT: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T19:49:58.547663] [INFO ] [REMOTE    ] MDT: Fetching primary data for 2025-04.
[2025-10-24T19:49:59.347616] [INFO ] [REMOTE    ] MDV: Fetching primary data for 2025-08.
[2025-10-24T19:49:59.425830] [INFO ] [REMOTE    ] MDU: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T19:50:00.134265] [INFO ] [REMOTE    ] MDV: Incremental fetch complete for 2025-08 (0.79 seconds).
[2025-10-24T19:50:00.147620] [INFO ] [REMOTE    ] MDV: Fetching primary data for 2025-09.
[2025-10-24T19:50:00.553780] [INFO ] [REMOTE    ] MDT: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T19:50:00.947722] [INFO ] [REMOTE    ] MEC: Fetching primary data for 2025-09.
[2025-10-24T19:50:01.138934] [INFO ] [REMOTE    ] MDV: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T19:50:01.747706] [INFO ] [REMOTE    ] MDV: Fetching primary data for 2025-10.
[2025-10-24T19:50:02.462915] [INFO ] [REMOTE    ] MEC: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T19:50:02.474549] [INFO ] [REMOTE    ] MDV: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T19:50:02.476553] [INFO ] [REMOTE    ] MDV: Full fetch complete (11668 records).
[2025-10-24T19:50:02.476637] [DEBUG] [VALIDATOR ] MDV: Validating primary data.
[2025-10-24T19:50:02.552864] [INFO ] [REMOTE    ] MDT: Fetching primary data for 2025-05.
[2025-10-24T19:50:02.867225] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present.
[2025-10-24T19:50:02.867325] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed.
[2025-10-24T19:50:02.867667] [INFO ] [MAIN      ] MDV: Fetched primary data is valid.
[2025-10-24T19:50:02.867730] [DEBUG] [LOCAL     ] MDV: Saving primary data.
[2025-10-24T19:50:02.867966] [FATAL] [LOCAL     ] MDV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:50:02.868049] [FATAL] [MAIN      ] MDV: Failed to save primary data.
[2025-10-24T19:50:02.868093] [WARN ] [MAIN      ] MDV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:50:02.868129] [INFO ] [LOCAL     ] MDV: Starting deletion of primary data.
[2025-10-24T19:50:02.868180] [DEBUG] [LOCAL     ] MDV: No primary data file found to delete.
[2025-10-24T19:50:02.868217] [INFO ] [LOCAL     ] MDV: Starting deletion of derivative data.
[2025-10-24T19:50:02.868343] [DEBUG] [LOCAL     ] MDV: Deleted derivative data file.
[2025-10-24T19:50:02.868441] [INFO ] [MAIN      ] Update Progress: 1321/2366 symbols completed. MDV took 18.3s. Estimated remaining: 2h 14m 29s. Rate: 7.8 symbols/min
[2025-10-24T19:50:03.046599] [INFO ] [MAIN      ] MED: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:50:03.069606] [DEBUG] [LOCAL     ] MED: Loaded 21092 existing records from primary storage.
[2025-10-24T19:50:03.069881] [INFO ] [MAIN      ] MED: Loaded 21092 existing records.
[2025-10-24T19:50:03.252351] [WARN ] [MAIN      ] MED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:50:03.252577] [INFO ] [MAIN      ] MED: Wiping existing primary data before full refresh.
[2025-10-24T19:50:03.252625] [INFO ] [LOCAL     ] MED: Starting deletion of primary data.
[2025-10-24T19:50:03.253084] [DEBUG] [LOCAL     ] MED: Deleted primary data file.
[2025-10-24T19:50:03.253142] [INFO ] [MAIN      ] MED: Starting full primary refresh.
[2025-10-24T19:50:03.354583] [INFO ] [REMOTE    ] MDU: Fetching primary data for 2025-05.
[2025-10-24T19:50:03.624196] [INFO ] [REMOTE    ] MED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:50:04.147718] [INFO ] [REMOTE    ] MEC: Fetching primary data for 2025-10.
[2025-10-24T19:50:04.947622] [INFO ] [REMOTE    ] MED: Fetching primary data for 2025-01.
[2025-10-24T19:50:05.105036] [INFO ] [REMOTE    ] MDU: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T19:50:05.136735] [INFO ] [REMOTE    ] MEC: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T19:50:05.140587] [INFO ] [REMOTE    ] MEC: Full fetch complete (23151 records).
[2025-10-24T19:50:05.140692] [DEBUG] [VALIDATOR ] MEC: Validating primary data.
[2025-10-24T19:50:05.483994] [INFO ] [REMOTE    ] MDT: Incremental fetch complete for 2025-05 (2.93 seconds).
[2025-10-24T19:50:05.575796] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present.
[2025-10-24T19:50:05.575872] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed.
[2025-10-24T19:50:05.576346] [INFO ] [MAIN      ] MEC: Fetched primary data is valid.
[2025-10-24T19:50:05.576385] [DEBUG] [LOCAL     ] MEC: Saving primary data.
[2025-10-24T19:50:05.576685] [FATAL] [LOCAL     ] MEC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:50:05.576769] [FATAL] [MAIN      ] MEC: Failed to save primary data.
[2025-10-24T19:50:05.576810] [WARN ] [MAIN      ] MEC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:50:05.576868] [INFO ] [LOCAL     ] MEC: Starting deletion of primary data.
[2025-10-24T19:50:05.576925] [DEBUG] [LOCAL     ] MEC: No primary data file found to delete.
[2025-10-24T19:50:05.576960] [INFO ] [LOCAL     ] MEC: Starting deletion of derivative data.
[2025-10-24T19:50:05.577090] [DEBUG] [LOCAL     ] MEC: Deleted derivative data file.
[2025-10-24T19:50:05.577162] [INFO ] [MAIN      ] Update Progress: 1322/2366 symbols completed. MEC took 21.0s. Estimated remaining: 2h 14m 17s. Rate: 7.8 symbols/min
[2025-10-24T19:50:05.753032] [INFO ] [REMOTE    ] MDT: Fetching primary data for 2025-06.
[2025-10-24T19:50:05.756349] [INFO ] [MAIN      ] MEG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:50:05.771959] [INFO ] [REMOTE    ] MED: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T19:50:05.804562] [DEBUG] [LOCAL     ] MEG: Loaded 31806 existing records from primary storage.
[2025-10-24T19:50:05.804864] [INFO ] [MAIN      ] MEG: Loaded 31806 existing records.
[2025-10-24T19:50:05.981141] [WARN ] [MAIN      ] MEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:50:05.981347] [INFO ] [MAIN      ] MEG: Wiping existing primary data before full refresh.
[2025-10-24T19:50:05.981392] [INFO ] [LOCAL     ] MEG: Starting deletion of primary data.
[2025-10-24T19:50:05.982065] [DEBUG] [LOCAL     ] MEG: Deleted primary data file.
[2025-10-24T19:50:05.982121] [INFO ] [MAIN      ] MEG: Starting full primary refresh.
[2025-10-24T19:50:06.335944] [INFO ] [REMOTE    ] MEG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:50:06.547639] [INFO ] [REMOTE    ] MEG: Fetching primary data for 2025-01.
[2025-10-24T19:50:07.347637] [INFO ] [REMOTE    ] MED: Fetching primary data for 2025-02.
[2025-10-24T19:50:07.504210] [INFO ] [REMOTE    ] MDT: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T19:50:07.895679] [INFO ] [REMOTE    ] MEG: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T19:50:08.147627] [INFO ] [REMOTE    ] MEG: Fetching primary data for 2025-02.
[2025-10-24T19:50:08.504162] [INFO ] [REMOTE    ] MED: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T19:50:08.947637] [INFO ] [REMOTE    ] MDU: Fetching primary data for 2025-06.
[2025-10-24T19:50:09.312888] [INFO ] [REMOTE    ] MEG: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T19:50:09.747691] [INFO ] [REMOTE    ] MDT: Fetching primary data for 2025-07.
[2025-10-24T19:50:10.335112] [INFO ] [REMOTE    ] MDU: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T19:50:10.547708] [INFO ] [REMOTE    ] MED: Fetching primary data for 2025-03.
[2025-10-24T19:50:11.347704] [INFO ] [REMOTE    ] MEG: Fetching primary data for 2025-03.
[2025-10-24T19:50:11.564247] [INFO ] [REMOTE    ] MED: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T19:50:11.614817] [INFO ] [REMOTE    ] MDT: Incremental fetch complete for 2025-07 (1.87 seconds).
[2025-10-24T19:50:12.147664] [INFO ] [REMOTE    ] MDT: Fetching primary data for 2025-08.
[2025-10-24T19:50:12.482466] [INFO ] [REMOTE    ] MEG: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T19:50:12.947627] [INFO ] [REMOTE    ] MED: Fetching primary data for 2025-04.
[2025-10-24T19:50:13.725251] [INFO ] [REMOTE    ] MDT: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T19:50:13.747598] [INFO ] [REMOTE    ] MDT: Fetching primary data for 2025-09.
[2025-10-24T19:50:14.165230] [INFO ] [REMOTE    ] MED: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T19:50:14.547684] [INFO ] [REMOTE    ] MDU: Fetching primary data for 2025-07.
[2025-10-24T19:50:15.347735] [INFO ] [REMOTE    ] MEG: Fetching primary data for 2025-04.
[2025-10-24T19:50:15.748777] [INFO ] [REMOTE    ] MDT: Incremental fetch complete for 2025-09 (2.00 seconds).
[2025-10-24T19:50:16.147754] [INFO ] [REMOTE    ] MDT: Fetching primary data for 2025-10.
[2025-10-24T19:50:16.450973] [INFO ] [REMOTE    ] MDU: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T19:50:16.608939] [INFO ] [REMOTE    ] MEG: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T19:50:16.947676] [INFO ] [REMOTE    ] MEG: Fetching primary data for 2025-05.
[2025-10-24T19:50:17.747737] [INFO ] [REMOTE    ] MED: Fetching primary data for 2025-05.
[2025-10-24T19:50:18.271817] [INFO ] [REMOTE    ] MDT: Incremental fetch complete for 2025-10 (2.12 seconds).
[2025-10-24T19:50:18.282453] [INFO ] [REMOTE    ] MDT: Full fetch complete (77857 records).
[2025-10-24T19:50:18.282637] [DEBUG] [VALIDATOR ] MDT: Validating primary data.
[2025-10-24T19:50:18.525197] [INFO ] [REMOTE    ] MEG: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T19:50:18.547703] [INFO ] [REMOTE    ] MDU: Fetching primary data for 2025-08.
[2025-10-24T19:50:18.716150] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present.
[2025-10-24T19:50:18.716276] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed.
[2025-10-24T19:50:18.717437] [INFO ] [MAIN      ] MDT: Fetched primary data is valid.
[2025-10-24T19:50:18.717510] [DEBUG] [LOCAL     ] MDT: Saving primary data.
[2025-10-24T19:50:18.718194] [FATAL] [LOCAL     ] MDT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:50:18.718281] [FATAL] [MAIN      ] MDT: Failed to save primary data.
[2025-10-24T19:50:18.718342] [WARN ] [MAIN      ] MDT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:50:18.718381] [INFO ] [LOCAL     ] MDT: Starting deletion of primary data.
[2025-10-24T19:50:18.718432] [DEBUG] [LOCAL     ] MDT: No primary data file found to delete.
[2025-10-24T19:50:18.718467] [INFO ] [LOCAL     ] MDT: Starting deletion of derivative data.
[2025-10-24T19:50:18.718593] [DEBUG] [LOCAL     ] MDT: Deleted derivative data file.
[2025-10-24T19:50:18.719183] [INFO ] [MAIN      ] Update Progress: 1323/2366 symbols completed. MDT took 34.1s. Estimated remaining: 2h 14m 14s. Rate: 7.8 symbols/min
[2025-10-24T19:50:18.859582] [INFO ] [REMOTE    ] MED: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T19:50:18.906136] [INFO ] [MAIN      ] MEGI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:50:18.926274] [DEBUG] [LOCAL     ] MEGI: Loaded 19865 existing records from primary storage.
[2025-10-24T19:50:18.926505] [INFO ] [MAIN      ] MEGI: Loaded 19865 existing records.
[2025-10-24T19:50:19.102177] [WARN ] [MAIN      ] MEGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:50:19.102396] [INFO ] [MAIN      ] MEGI: Wiping existing primary data before full refresh.
[2025-10-24T19:50:19.102441] [INFO ] [LOCAL     ] MEGI: Starting deletion of primary data.
[2025-10-24T19:50:19.102939] [DEBUG] [LOCAL     ] MEGI: Deleted primary data file.
[2025-10-24T19:50:19.102996] [INFO ] [MAIN      ] MEGI: Starting full primary refresh.
[2025-10-24T19:50:19.352759] [INFO ] [REMOTE    ] MEG: Fetching primary data for 2025-06.
[2025-10-24T19:50:19.472659] [INFO ] [REMOTE    ] MEGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:50:20.147674] [INFO ] [REMOTE    ] MED: Fetching primary data for 2025-06.
[2025-10-24T19:50:20.306670] [INFO ] [REMOTE    ] MDU: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T19:50:20.603282] [INFO ] [REMOTE    ] MEG: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T19:50:20.947666] [INFO ] [REMOTE    ] MEG: Fetching primary data for 2025-07.
[2025-10-24T19:50:21.147014] [INFO ] [REMOTE    ] MED: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T19:50:21.747715] [INFO ] [REMOTE    ] MED: Fetching primary data for 2025-07.
[2025-10-24T19:50:22.016000] [INFO ] [REMOTE    ] MEG: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T19:50:22.547710] [INFO ] [REMOTE    ] MEGI: Fetching primary data for 2025-01.
[2025-10-24T19:50:22.838995] [INFO ] [REMOTE    ] MED: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T19:50:23.347723] [INFO ] [REMOTE    ] MDU: Fetching primary data for 2025-09.
[2025-10-24T19:50:23.608516] [INFO ] [REMOTE    ] MEGI: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T19:50:24.147740] [INFO ] [REMOTE    ] MEGI: Fetching primary data for 2025-02.
[2025-10-24T19:50:24.929343] [INFO ] [REMOTE    ] MDU: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T19:50:24.947611] [INFO ] [REMOTE    ] MED: Fetching primary data for 2025-08.
[2025-10-24T19:50:25.065933] [INFO ] [REMOTE    ] MEGI: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T19:50:25.747606] [INFO ] [REMOTE    ] MDU: Fetching primary data for 2025-10.
[2025-10-24T19:50:26.077498] [INFO ] [REMOTE    ] MED: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T19:50:26.547743] [INFO ] [REMOTE    ] MEG: Fetching primary data for 2025-08.
[2025-10-24T19:50:27.347742] [INFO ] [REMOTE    ] MEGI: Fetching primary data for 2025-03.
[2025-10-24T19:50:27.505197] [INFO ] [REMOTE    ] MDU: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T19:50:27.514547] [INFO ] [REMOTE    ] MDU: Full fetch complete (70693 records).
[2025-10-24T19:50:27.514724] [DEBUG] [VALIDATOR ] MDU: Validating primary data.
[2025-10-24T19:50:27.934367] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present.
[2025-10-24T19:50:27.934503] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed.
[2025-10-24T19:50:27.935724] [INFO ] [MAIN      ] MDU: Fetched primary data is valid.
[2025-10-24T19:50:27.935804] [DEBUG] [LOCAL     ] MDU: Saving primary data.
[2025-10-24T19:50:27.936542] [FATAL] [LOCAL     ] MDU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:50:27.936673] [FATAL] [MAIN      ] MDU: Failed to save primary data.
[2025-10-24T19:50:27.936869] [WARN ] [MAIN      ] MDU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:50:27.936950] [INFO ] [LOCAL     ] MDU: Starting deletion of primary data.
[2025-10-24T19:50:27.954922] [DEBUG] [LOCAL     ] MDU: No primary data file found to delete.
[2025-10-24T19:50:27.956144] [INFO ] [REMOTE    ] MEG: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T19:50:27.956296] [INFO ] [LOCAL     ] MDU: Starting deletion of derivative data.
[2025-10-24T19:50:27.963538] [DEBUG] [LOCAL     ] MDU: Deleted derivative data file.
[2025-10-24T19:50:27.964092] [INFO ] [MAIN      ] Update Progress: 1324/2366 symbols completed. MDU took 43.4s. Estimated remaining: 2h 14m 7s. Rate: 7.8 symbols/min
[2025-10-24T19:50:28.136673] [INFO ] [MAIN      ] MEI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:50:28.152795] [INFO ] [REMOTE    ] MEG: Fetching primary data for 2025-09.
[2025-10-24T19:50:28.166873] [DEBUG] [LOCAL     ] MEI: Loaded 31496 existing records from primary storage.
[2025-10-24T19:50:28.167555] [INFO ] [MAIN      ] MEI: Loaded 31496 existing records.
[2025-10-24T19:50:28.349914] [WARN ] [MAIN      ] MEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:50:28.350431] [INFO ] [MAIN      ] MEI: Wiping existing primary data before full refresh.
[2025-10-24T19:50:28.350493] [INFO ] [LOCAL     ] MEI: Starting deletion of primary data.
[2025-10-24T19:50:28.351266] [DEBUG] [LOCAL     ] MEI: Deleted primary data file.
[2025-10-24T19:50:28.351331] [INFO ] [MAIN      ] MEI: Starting full primary refresh.
[2025-10-24T19:50:28.506535] [INFO ] [REMOTE    ] MEGI: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T19:50:28.720355] [INFO ] [REMOTE    ] MEI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:50:28.947718] [INFO ] [REMOTE    ] MEI: Fetching primary data for 2025-01.
[2025-10-24T19:50:29.133834] [INFO ] [REMOTE    ] MEG: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T19:50:29.747686] [INFO ] [REMOTE    ] MEGI: Fetching primary data for 2025-04.
[2025-10-24T19:50:30.199075] [INFO ] [REMOTE    ] MEI: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T19:50:30.547662] [INFO ] [REMOTE    ] MEI: Fetching primary data for 2025-02.
[2025-10-24T19:50:31.150075] [INFO ] [REMOTE    ] MEGI: Incremental fetch complete for 2025-04 (1.40 seconds).
[2025-10-24T19:50:31.347610] [INFO ] [REMOTE    ] MEG: Fetching primary data for 2025-10.
[2025-10-24T19:50:31.374613] [INFO ] [REMOTE    ] MEI: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T19:50:32.147717] [INFO ] [REMOTE    ] MEGI: Fetching primary data for 2025-05.
[2025-10-24T19:50:32.884492] [INFO ] [REMOTE    ] MEG: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T19:50:32.891032] [INFO ] [REMOTE    ] MEG: Full fetch complete (47351 records).
[2025-10-24T19:50:32.891136] [DEBUG] [VALIDATOR ] MEG: Validating primary data.
[2025-10-24T19:50:32.958824] [INFO ] [REMOTE    ] MEI: Fetching primary data for 2025-03.
[2025-10-24T19:50:33.188784] [INFO ] [REMOTE    ] MEGI: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T19:50:33.318634] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present.
[2025-10-24T19:50:33.318756] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed.
[2025-10-24T19:50:33.319718] [INFO ] [MAIN      ] MEG: Fetched primary data is valid.
[2025-10-24T19:50:33.319783] [DEBUG] [LOCAL     ] MEG: Saving primary data.
[2025-10-24T19:50:33.320308] [FATAL] [LOCAL     ] MEG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:50:33.320393] [FATAL] [MAIN      ] MEG: Failed to save primary data.
[2025-10-24T19:50:33.320435] [WARN ] [MAIN      ] MEG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:50:33.320473] [INFO ] [LOCAL     ] MEG: Starting deletion of primary data.
[2025-10-24T19:50:33.320524] [DEBUG] [LOCAL     ] MEG: No primary data file found to delete.
[2025-10-24T19:50:33.320559] [INFO ] [LOCAL     ] MEG: Starting deletion of derivative data.
[2025-10-24T19:50:33.320738] [DEBUG] [LOCAL     ] MEG: Deleted derivative data file.
[2025-10-24T19:50:33.320840] [INFO ] [MAIN      ] Update Progress: 1325/2366 symbols completed. MEG took 27.7s. Estimated remaining: 2h 13m 58s. Rate: 7.8 symbols/min
[2025-10-24T19:50:33.492075] [INFO ] [MAIN      ] MET: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:50:33.543375] [DEBUG] [LOCAL     ] MET: Loaded 53677 existing records from primary storage.
[2025-10-24T19:50:33.543724] [INFO ] [MAIN      ] MET: Loaded 53677 existing records.
[2025-10-24T19:50:33.716716] [WARN ] [MAIN      ] MET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:50:33.716932] [INFO ] [MAIN      ] MET: Wiping existing primary data before full refresh.
[2025-10-24T19:50:33.716977] [INFO ] [LOCAL     ] MET: Starting deletion of primary data.
[2025-10-24T19:50:33.717434] [DEBUG] [LOCAL     ] MET: Deleted primary data file.
[2025-10-24T19:50:33.717491] [INFO ] [MAIN      ] MET: Starting full primary refresh.
[2025-10-24T19:50:33.753163] [INFO ] [REMOTE    ] MEGI: Fetching primary data for 2025-06.
[2025-10-24T19:50:34.078564] [INFO ] [REMOTE    ] MET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:50:34.477840] [INFO ] [REMOTE    ] MEI: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T19:50:34.547622] [INFO ] [REMOTE    ] MEI: Fetching primary data for 2025-04.
[2025-10-24T19:50:34.778447] [INFO ] [REMOTE    ] MEGI: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T19:50:35.347675] [INFO ] [REMOTE    ] MEGI: Fetching primary data for 2025-07.
[2025-10-24T19:50:35.965514] [INFO ] [REMOTE    ] MEI: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T19:50:36.147694] [INFO ] [REMOTE    ] MED: Fetching primary data for 2025-09.
[2025-10-24T19:50:36.465536] [INFO ] [REMOTE    ] MEGI: Incremental fetch complete for 2025-07 (1.12 seconds).
[2025-10-24T19:50:36.947700] [INFO ] [REMOTE    ] MEGI: Fetching primary data for 2025-08.
[2025-10-24T19:50:37.054967] [INFO ] [REMOTE    ] MED: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T19:50:37.747678] [INFO ] [REMOTE    ] MEI: Fetching primary data for 2025-05.
[2025-10-24T19:50:38.033840] [INFO ] [REMOTE    ] MEGI: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T19:50:38.547677] [INFO ] [REMOTE    ] MET: Fetching primary data for 2025-01.
[2025-10-24T19:50:39.002211] [INFO ] [REMOTE    ] MEI: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T19:50:39.347684] [INFO ] [REMOTE    ] MEGI: Fetching primary data for 2025-09.
[2025-10-24T19:50:40.099213] [INFO ] [REMOTE    ] MET: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T19:50:40.129097] [INFO ] [REMOTE    ] MEGI: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T19:50:40.147601] [INFO ] [REMOTE    ] MEGI: Fetching primary data for 2025-10.
[2025-10-24T19:50:40.947731] [INFO ] [REMOTE    ] MED: Fetching primary data for 2025-10.
[2025-10-24T19:50:41.268718] [INFO ] [REMOTE    ] MEGI: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T19:50:41.272149] [INFO ] [REMOTE    ] MEGI: Full fetch complete (28974 records).
[2025-10-24T19:50:41.272238] [DEBUG] [VALIDATOR ] MEGI: Validating primary data.
[2025-10-24T19:50:41.671284] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present.
[2025-10-24T19:50:41.671363] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed.
[2025-10-24T19:50:41.671989] [INFO ] [MAIN      ] MEGI: Fetched primary data is valid.
[2025-10-24T19:50:41.672052] [DEBUG] [LOCAL     ] MEGI: Saving primary data.
[2025-10-24T19:50:41.672415] [FATAL] [LOCAL     ] MEGI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:50:41.672499] [FATAL] [MAIN      ] MEGI: Failed to save primary data.
[2025-10-24T19:50:41.672540] [WARN ] [MAIN      ] MEGI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:50:41.672574] [INFO ] [LOCAL     ] MEGI: Starting deletion of primary data.
[2025-10-24T19:50:41.672624] [DEBUG] [LOCAL     ] MEGI: No primary data file found to delete.
[2025-10-24T19:50:41.672691] [INFO ] [LOCAL     ] MEGI: Starting deletion of derivative data.
[2025-10-24T19:50:41.672836] [DEBUG] [LOCAL     ] MEGI: Deleted derivative data file.
[2025-10-24T19:50:41.672912] [INFO ] [MAIN      ] Update Progress: 1326/2366 symbols completed. MEGI took 23.0s. Estimated remaining: 2h 13m 50s. Rate: 7.8 symbols/min
[2025-10-24T19:50:41.752723] [INFO ] [REMOTE    ] MET: Fetching primary data for 2025-02.
[2025-10-24T19:50:41.845762] [INFO ] [MAIN      ] MFA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:50:41.885170] [DEBUG] [LOCAL     ] MFA: Loaded 45870 existing records from primary storage.
[2025-10-24T19:50:41.885481] [INFO ] [MAIN      ] MFA: Loaded 45870 existing records.
[2025-10-24T19:50:42.066999] [WARN ] [MAIN      ] MFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:50:42.067373] [INFO ] [MAIN      ] MFA: Wiping existing primary data before full refresh.
[2025-10-24T19:50:42.076708] [INFO ] [REMOTE    ] MED: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T19:50:42.076383] [INFO ] [LOCAL     ] MFA: Starting deletion of primary data.
[2025-10-24T19:50:42.080439] [DEBUG] [LOCAL     ] MFA: Deleted primary data file.
[2025-10-24T19:50:42.080497] [INFO ] [MAIN      ] MFA: Starting full primary refresh.
[2025-10-24T19:50:42.112184] [INFO ] [REMOTE    ] MED: Full fetch complete (31838 records).
[2025-10-24T19:50:42.144945] [DEBUG] [VALIDATOR ] MED: Validating primary data.
[2025-10-24T19:50:42.552748] [INFO ] [REMOTE    ] MEI: Fetching primary data for 2025-06.
[2025-10-24T19:50:42.780675] [INFO ] [REMOTE    ] MFA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:50:42.825871] [DEBUG] [VALIDATOR ] MED: All expected trading days are present.
[2025-10-24T19:50:42.825937] [DEBUG] [VALIDATOR ] MED: Primary data validation passed.
[2025-10-24T19:50:42.826560] [INFO ] [MAIN      ] MED: Fetched primary data is valid.
[2025-10-24T19:50:42.826599] [DEBUG] [LOCAL     ] MED: Saving primary data.
[2025-10-24T19:50:42.826925] [FATAL] [LOCAL     ] MED: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:50:42.827016] [FATAL] [MAIN      ] MED: Failed to save primary data.
[2025-10-24T19:50:42.827090] [WARN ] [MAIN      ] MED: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:50:42.827176] [INFO ] [LOCAL     ] MED: Starting deletion of primary data.
[2025-10-24T19:50:42.827279] [DEBUG] [LOCAL     ] MED: No primary data file found to delete.
[2025-10-24T19:50:42.827325] [INFO ] [LOCAL     ] MED: Starting deletion of derivative data.
[2025-10-24T19:50:42.827435] [DEBUG] [LOCAL     ] MED: Deleted derivative data file.
[2025-10-24T19:50:42.827502] [INFO ] [MAIN      ] Update Progress: 1327/2366 symbols completed. MED took 40.0s. Estimated remaining: 2h 13m 38s. Rate: 7.8 symbols/min
[2025-10-24T19:50:43.002950] [INFO ] [MAIN      ] MFAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:50:43.010502] [DEBUG] [LOCAL     ] MFAN: Loaded 4331 existing records from primary storage.
[2025-10-24T19:50:43.010738] [INFO ] [MAIN      ] MFAN: Loaded 4331 existing records.
[2025-10-24T19:50:43.190981] [WARN ] [MAIN      ] MFAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:50:43.191222] [INFO ] [MAIN      ] MFAN: Wiping existing primary data before full refresh.
[2025-10-24T19:50:43.191313] [INFO ] [LOCAL     ] MFAN: Starting deletion of primary data.
[2025-10-24T19:50:43.191563] [DEBUG] [LOCAL     ] MFAN: Deleted primary data file.
[2025-10-24T19:50:43.191621] [INFO ] [MAIN      ] MFAN: Starting full primary refresh.
[2025-10-24T19:50:43.349293] [INFO ] [REMOTE    ] MFA: Fetching primary data for 2025-01.
[2025-10-24T19:50:43.579156] [INFO ] [REMOTE    ] MFAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:50:43.611738] [INFO ] [REMOTE    ] MET: Incremental fetch complete for 2025-02 (1.86 seconds).
[2025-10-24T19:50:43.637134] [INFO ] [REMOTE    ] MEI: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T19:50:44.147749] [INFO ] [REMOTE    ] MEI: Fetching primary data for 2025-07.
[2025-10-24T19:50:44.936285] [INFO ] [REMOTE    ] MFA: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T19:50:44.947711] [INFO ] [REMOTE    ] MFAN: Fetching primary data for 2025-01.
[2025-10-24T19:50:45.497136] [INFO ] [REMOTE    ] MFAN: Incremental fetch complete for 2025-01 (0.55 seconds).
[2025-10-24T19:50:45.537801] [INFO ] [REMOTE    ] MEI: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T19:50:45.747691] [INFO ] [REMOTE    ] MFAN: Fetching primary data for 2025-02.
[2025-10-24T19:50:46.392345] [INFO ] [REMOTE    ] MFAN: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T19:50:46.547716] [INFO ] [REMOTE    ] MFAN: Fetching primary data for 2025-03.
[2025-10-24T19:50:47.113927] [INFO ] [REMOTE    ] MFAN: Incremental fetch complete for 2025-03 (0.57 seconds).
[2025-10-24T19:50:47.347689] [INFO ] [REMOTE    ] MET: Fetching primary data for 2025-03.
[2025-10-24T19:50:48.147731] [INFO ] [REMOTE    ] MEI: Fetching primary data for 2025-08.
[2025-10-24T19:50:48.945901] [INFO ] [REMOTE    ] MET: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T19:50:48.956132] [INFO ] [REMOTE    ] MFAN: Fetching primary data for 2025-04.
[2025-10-24T19:50:49.506155] [INFO ] [REMOTE    ] MEI: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T19:50:49.545238] [INFO ] [REMOTE    ] MFAN: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T19:50:49.747707] [INFO ] [REMOTE    ] MFA: Fetching primary data for 2025-02.
[2025-10-24T19:50:50.547738] [INFO ] [REMOTE    ] MEI: Fetching primary data for 2025-09.
[2025-10-24T19:50:51.192029] [INFO ] [REMOTE    ] MFA: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T19:50:51.347681] [INFO ] [REMOTE    ] MFA: Fetching primary data for 2025-03.
[2025-10-24T19:50:51.896085] [INFO ] [REMOTE    ] MEI: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T19:50:52.147686] [INFO ] [REMOTE    ] MEI: Fetching primary data for 2025-10.
[2025-10-24T19:50:52.826134] [INFO ] [REMOTE    ] MFA: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T19:50:52.947604] [INFO ] [REMOTE    ] MFA: Fetching primary data for 2025-04.
[2025-10-24T19:50:53.398120] [INFO ] [REMOTE    ] MEI: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T19:50:53.403558] [INFO ] [REMOTE    ] MEI: Full fetch complete (45368 records).
[2025-10-24T19:50:53.403681] [DEBUG] [VALIDATOR ] MEI: Validating primary data.
[2025-10-24T19:50:53.750728] [INFO ] [REMOTE    ] MFAN: Fetching primary data for 2025-05.
[2025-10-24T19:50:53.791560] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present.
[2025-10-24T19:50:53.791741] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed.
[2025-10-24T19:50:53.792789] [INFO ] [MAIN      ] MEI: Fetched primary data is valid.
[2025-10-24T19:50:53.792853] [DEBUG] [LOCAL     ] MEI: Saving primary data.
[2025-10-24T19:50:53.793339] [FATAL] [LOCAL     ] MEI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:50:53.793422] [FATAL] [MAIN      ] MEI: Failed to save primary data.
[2025-10-24T19:50:53.793491] [WARN ] [MAIN      ] MEI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:50:53.793561] [INFO ] [LOCAL     ] MEI: Starting deletion of primary data.
[2025-10-24T19:50:53.793623] [DEBUG] [LOCAL     ] MEI: No primary data file found to delete.
[2025-10-24T19:50:53.793696] [INFO ] [LOCAL     ] MEI: Starting deletion of derivative data.
[2025-10-24T19:50:53.793870] [DEBUG] [LOCAL     ] MEI: Deleted derivative data file.
[2025-10-24T19:50:53.793966] [INFO ] [MAIN      ] Update Progress: 1328/2366 symbols completed. MEI took 25.8s. Estimated remaining: 2h 13m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:50:53.969992] [INFO ] [MAIN      ] MFAO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:50:53.977863] [DEBUG] [LOCAL     ] MFAO: Loaded 3900 existing records from primary storage.
[2025-10-24T19:50:53.978073] [INFO ] [MAIN      ] MFAO: Loaded 3900 existing records.
[2025-10-24T19:50:54.164768] [WARN ] [MAIN      ] MFAO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:50:54.164989] [INFO ] [MAIN      ] MFAO: Wiping existing primary data before full refresh.
[2025-10-24T19:50:54.165037] [INFO ] [LOCAL     ] MFAO: Starting deletion of primary data.
[2025-10-24T19:50:54.165166] [DEBUG] [LOCAL     ] MFAO: Deleted primary data file.
[2025-10-24T19:50:54.165204] [INFO ] [MAIN      ] MFAO: Starting full primary refresh.
[2025-10-24T19:50:54.454439] [INFO ] [REMOTE    ] MFAN: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T19:50:54.539734] [INFO ] [REMOTE    ] MFAO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:50:54.547604] [INFO ] [REMOTE    ] MFAO: Fetching primary data for 2025-01.
[2025-10-24T19:50:54.579296] [INFO ] [REMOTE    ] MFA: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T19:50:55.107584] [INFO ] [REMOTE    ] MFAO: Incremental fetch complete for 2025-01 (0.56 seconds).
[2025-10-24T19:50:55.347716] [INFO ] [REMOTE    ] MFAO: Fetching primary data for 2025-02.
[2025-10-24T19:50:55.862187] [INFO ] [REMOTE    ] MFAO: Incremental fetch complete for 2025-02 (0.51 seconds).
[2025-10-24T19:50:56.147684] [INFO ] [REMOTE    ] MET: Fetching primary data for 2025-04.
[2025-10-24T19:50:56.947736] [INFO ] [REMOTE    ] MFA: Fetching primary data for 2025-05.
[2025-10-24T19:50:57.747718] [INFO ] [REMOTE    ] MFAO: Fetching primary data for 2025-03.
[2025-10-24T19:50:57.820906] [INFO ] [REMOTE    ] MET: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T19:50:58.182437] [INFO ] [REMOTE    ] MFAO: Incremental fetch complete for 2025-03 (0.43 seconds).
[2025-10-24T19:50:58.469227] [INFO ] [REMOTE    ] MFA: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T19:50:58.547620] [INFO ] [REMOTE    ] MFA: Fetching primary data for 2025-06.
[2025-10-24T19:50:59.347722] [INFO ] [REMOTE    ] MFAN: Fetching primary data for 2025-06.
[2025-10-24T19:50:59.912945] [INFO ] [REMOTE    ] MFAN: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T19:50:59.984396] [INFO ] [REMOTE    ] MFA: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T19:51:00.147680] [INFO ] [REMOTE    ] MFAN: Fetching primary data for 2025-07.
[2025-10-24T19:51:00.763150] [INFO ] [REMOTE    ] MFAN: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T19:51:00.947669] [INFO ] [REMOTE    ] MET: Fetching primary data for 2025-05.
[2025-10-24T19:51:01.747639] [INFO ] [REMOTE    ] MFA: Fetching primary data for 2025-07.
[2025-10-24T19:51:02.547710] [INFO ] [REMOTE    ] MFAN: Fetching primary data for 2025-08.
[2025-10-24T19:51:02.836931] [INFO ] [REMOTE    ] MET: Incremental fetch complete for 2025-05 (1.89 seconds).
[2025-10-24T19:51:03.090230] [INFO ] [REMOTE    ] MFAN: Incremental fetch complete for 2025-08 (0.54 seconds).
[2025-10-24T19:51:03.286708] [INFO ] [REMOTE    ] MFA: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T19:51:03.347607] [INFO ] [REMOTE    ] MFA: Fetching primary data for 2025-08.
[2025-10-24T19:51:04.147691] [INFO ] [REMOTE    ] MFAN: Fetching primary data for 2025-09.
[2025-10-24T19:51:04.704759] [INFO ] [REMOTE    ] MFAN: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T19:51:04.947613] [INFO ] [REMOTE    ] MFAN: Fetching primary data for 2025-10.
[2025-10-24T19:51:04.997048] [INFO ] [REMOTE    ] MFA: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T19:51:05.602428] [INFO ] [REMOTE    ] MFAN: Incremental fetch complete for 2025-10 (0.65 seconds).
[2025-10-24T19:51:05.604022] [INFO ] [REMOTE    ] MFAN: Full fetch complete (6014 records).
[2025-10-24T19:51:05.604107] [DEBUG] [VALIDATOR ] MFAN: Validating primary data.
[2025-10-24T19:51:05.757321] [INFO ] [REMOTE    ] MFAO: Fetching primary data for 2025-04.
[2025-10-24T19:51:05.985116] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present.
[2025-10-24T19:51:05.985198] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed.
[2025-10-24T19:51:05.985387] [INFO ] [MAIN      ] MFAN: Fetched primary data is valid.
[2025-10-24T19:51:05.985427] [DEBUG] [LOCAL     ] MFAN: Saving primary data.
[2025-10-24T19:51:05.985661] [FATAL] [LOCAL     ] MFAN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:51:05.985746] [FATAL] [MAIN      ] MFAN: Failed to save primary data.
[2025-10-24T19:51:05.985789] [WARN ] [MAIN      ] MFAN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:51:05.985827] [INFO ] [LOCAL     ] MFAN: Starting deletion of primary data.
[2025-10-24T19:51:05.985880] [DEBUG] [LOCAL     ] MFAN: No primary data file found to delete.
[2025-10-24T19:51:05.985917] [INFO ] [LOCAL     ] MFAN: Starting deletion of derivative data.
[2025-10-24T19:51:05.986077] [DEBUG] [LOCAL     ] MFAN: Deleted derivative data file.
[2025-10-24T19:51:05.986195] [INFO ] [MAIN      ] Update Progress: 1329/2366 symbols completed. MFAN took 23.2s. Estimated remaining: 2h 13m 28s. Rate: 7.8 symbols/min
[2025-10-24T19:51:06.191169] [INFO ] [MAIN      ] MFC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:51:06.260347] [DEBUG] [LOCAL     ] MFC: Loaded 51351 existing records from primary storage.
[2025-10-24T19:51:06.260702] [INFO ] [MAIN      ] MFC: Loaded 51351 existing records.
[2025-10-24T19:51:06.356568] [INFO ] [REMOTE    ] MFAO: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T19:51:06.448668] [WARN ] [MAIN      ] MFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:51:06.448991] [INFO ] [MAIN      ] MFC: Wiping existing primary data before full refresh.
[2025-10-24T19:51:06.449045] [INFO ] [LOCAL     ] MFC: Starting deletion of primary data.
[2025-10-24T19:51:06.449390] [DEBUG] [LOCAL     ] MFC: Deleted primary data file.
[2025-10-24T19:51:06.449447] [INFO ] [MAIN      ] MFC: Starting full primary refresh.
[2025-10-24T19:51:06.547898] [INFO ] [REMOTE    ] MET: Fetching primary data for 2025-06.
[2025-10-24T19:51:06.829377] [INFO ] [REMOTE    ] MFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:51:07.347736] [INFO ] [REMOTE    ] MFAO: Fetching primary data for 2025-05.
[2025-10-24T19:51:07.931233] [INFO ] [REMOTE    ] MFAO: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T19:51:08.147616] [INFO ] [REMOTE    ] MFA: Fetching primary data for 2025-09.
[2025-10-24T19:51:08.205435] [INFO ] [REMOTE    ] MET: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T19:51:08.947685] [INFO ] [REMOTE    ] MFC: Fetching primary data for 2025-01.
[2025-10-24T19:51:09.636464] [INFO ] [REMOTE    ] MFA: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T19:51:09.747636] [INFO ] [REMOTE    ] MFA: Fetching primary data for 2025-10.
[2025-10-24T19:51:10.547625] [INFO ] [REMOTE    ] MFAO: Fetching primary data for 2025-06.
[2025-10-24T19:51:10.631748] [INFO ] [REMOTE    ] MFC: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T19:51:11.154999] [INFO ] [REMOTE    ] MFAO: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T19:51:11.347624] [INFO ] [REMOTE    ] MFAO: Fetching primary data for 2025-07.
[2025-10-24T19:51:11.495322] [INFO ] [REMOTE    ] MFA: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T19:51:11.503601] [INFO ] [REMOTE    ] MFA: Full fetch complete (65199 records).
[2025-10-24T19:51:11.503748] [DEBUG] [VALIDATOR ] MFA: Validating primary data.
[2025-10-24T19:51:11.893543] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present.
[2025-10-24T19:51:11.893667] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed.
[2025-10-24T19:51:11.894672] [INFO ] [MAIN      ] MFA: Fetched primary data is valid.
[2025-10-24T19:51:11.894733] [DEBUG] [LOCAL     ] MFA: Saving primary data.
[2025-10-24T19:51:11.895252] [FATAL] [LOCAL     ] MFA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:51:11.895360] [FATAL] [MAIN      ] MFA: Failed to save primary data.
[2025-10-24T19:51:11.895405] [WARN ] [MAIN      ] MFA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:51:11.895439] [INFO ] [LOCAL     ] MFA: Starting deletion of primary data.
[2025-10-24T19:51:11.895489] [DEBUG] [LOCAL     ] MFA: No primary data file found to delete.
[2025-10-24T19:51:11.895523] [INFO ] [LOCAL     ] MFA: Starting deletion of derivative data.
[2025-10-24T19:51:11.895777] [DEBUG] [LOCAL     ] MFA: Deleted derivative data file.
[2025-10-24T19:51:11.896195] [INFO ] [MAIN      ] Update Progress: 1330/2366 symbols completed. MFA took 30.2s. Estimated remaining: 2h 13m 19s. Rate: 7.8 symbols/min
[2025-10-24T19:51:12.072062] [INFO ] [MAIN      ] MFG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:51:12.075793] [INFO ] [REMOTE    ] MFAO: Incremental fetch complete for 2025-07 (0.73 seconds).
[2025-10-24T19:51:12.123754] [DEBUG] [LOCAL     ] MFG: Loaded 49876 existing records from primary storage.
[2025-10-24T19:51:12.124058] [INFO ] [MAIN      ] MFG: Loaded 49876 existing records.
[2025-10-24T19:51:12.153805] [INFO ] [REMOTE    ] MET: Fetching primary data for 2025-07.
[2025-10-24T19:51:12.310745] [WARN ] [MAIN      ] MFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:51:12.311004] [INFO ] [MAIN      ] MFG: Wiping existing primary data before full refresh.
[2025-10-24T19:51:12.311053] [INFO ] [LOCAL     ] MFG: Starting deletion of primary data.
[2025-10-24T19:51:12.311414] [DEBUG] [LOCAL     ] MFG: Deleted primary data file.
[2025-10-24T19:51:12.311470] [INFO ] [MAIN      ] MFG: Starting full primary refresh.
[2025-10-24T19:51:12.669623] [INFO ] [REMOTE    ] MFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:51:12.947628] [INFO ] [REMOTE    ] MFG: Fetching primary data for 2025-01.
[2025-10-24T19:51:13.747731] [INFO ] [REMOTE    ] MFC: Fetching primary data for 2025-02.
[2025-10-24T19:51:14.016200] [INFO ] [REMOTE    ] MET: Incremental fetch complete for 2025-07 (1.86 seconds).
[2025-10-24T19:51:14.443780] [INFO ] [REMOTE    ] MFG: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T19:51:14.547608] [INFO ] [REMOTE    ] MFG: Fetching primary data for 2025-02.
[2025-10-24T19:51:14.801286] [INFO ] [REMOTE    ] MFC: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T19:51:15.347727] [INFO ] [REMOTE    ] MFAO: Fetching primary data for 2025-08.
[2025-10-24T19:51:15.883144] [INFO ] [REMOTE    ] MFAO: Incremental fetch complete for 2025-08 (0.54 seconds).
[2025-10-24T19:51:16.142671] [INFO ] [REMOTE    ] MFG: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T19:51:16.150782] [INFO ] [REMOTE    ] MFC: Fetching primary data for 2025-03.
[2025-10-24T19:51:16.947716] [INFO ] [REMOTE    ] MFG: Fetching primary data for 2025-03.
[2025-10-24T19:51:17.747626] [INFO ] [REMOTE    ] MFAO: Fetching primary data for 2025-09.
[2025-10-24T19:51:17.917945] [INFO ] [REMOTE    ] MFC: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T19:51:18.226343] [INFO ] [REMOTE    ] MFAO: Incremental fetch complete for 2025-09 (0.48 seconds).
[2025-10-24T19:51:18.547688] [INFO ] [REMOTE    ] MFC: Fetching primary data for 2025-04.
[2025-10-24T19:51:18.608490] [INFO ] [REMOTE    ] MFG: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T19:51:19.347755] [INFO ] [REMOTE    ] MFG: Fetching primary data for 2025-04.
[2025-10-24T19:51:19.920899] [INFO ] [REMOTE    ] MFC: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T19:51:20.147637] [INFO ] [REMOTE    ] MFAO: Fetching primary data for 2025-10.
[2025-10-24T19:51:20.728147] [INFO ] [REMOTE    ] MFAO: Incremental fetch complete for 2025-10 (0.58 seconds).
[2025-10-24T19:51:20.729382] [INFO ] [REMOTE    ] MFAO: Full fetch complete (5461 records).
[2025-10-24T19:51:20.729451] [DEBUG] [VALIDATOR ] MFAO: Validating primary data.
[2025-10-24T19:51:20.958008] [INFO ] [REMOTE    ] MET: Fetching primary data for 2025-08.
[2025-10-24T19:51:21.151890] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present.
[2025-10-24T19:51:21.152057] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed.
[2025-10-24T19:51:21.152333] [INFO ] [MAIN      ] MFAO: Fetched primary data is valid.
[2025-10-24T19:51:21.152634] [DEBUG] [LOCAL     ] MFAO: Saving primary data.
[2025-10-24T19:51:21.153303] [FATAL] [LOCAL     ] MFAO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:51:21.154363] [INFO ] [REMOTE    ] MFG: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T19:51:21.154441] [FATAL] [MAIN      ] MFAO: Failed to save primary data.
[2025-10-24T19:51:21.154602] [WARN ] [MAIN      ] MFAO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:51:21.166973] [INFO ] [LOCAL     ] MFAO: Starting deletion of primary data.
[2025-10-24T19:51:21.167398] [DEBUG] [LOCAL     ] MFAO: No primary data file found to delete.
[2025-10-24T19:51:21.167556] [INFO ] [LOCAL     ] MFAO: Starting deletion of derivative data.
[2025-10-24T19:51:21.168051] [DEBUG] [LOCAL     ] MFAO: Deleted derivative data file.
[2025-10-24T19:51:21.168149] [INFO ] [MAIN      ] Update Progress: 1331/2366 symbols completed. MFAO took 27.4s. Estimated remaining: 2h 13m 12s. Rate: 7.8 symbols/min
[2025-10-24T19:51:21.336483] [INFO ] [MAIN      ] MFM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:51:21.353908] [DEBUG] [LOCAL     ] MFM: Loaded 14129 existing records from primary storage.
[2025-10-24T19:51:21.354163] [INFO ] [MAIN      ] MFM: Loaded 14129 existing records.
[2025-10-24T19:51:21.552381] [WARN ] [MAIN      ] MFM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:51:21.552614] [INFO ] [MAIN      ] MFM: Wiping existing primary data before full refresh.
[2025-10-24T19:51:21.552690] [INFO ] [LOCAL     ] MFM: Starting deletion of primary data.
[2025-10-24T19:51:21.552942] [DEBUG] [LOCAL     ] MFM: Deleted primary data file.
[2025-10-24T19:51:21.552981] [INFO ] [MAIN      ] MFM: Starting full primary refresh.
[2025-10-24T19:51:21.753987] [INFO ] [REMOTE    ] MFC: Fetching primary data for 2025-05.
[2025-10-24T19:51:21.942087] [INFO ] [REMOTE    ] MFM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:51:22.547707] [INFO ] [REMOTE    ] MFM: Fetching primary data for 2025-01.
[2025-10-24T19:51:22.617011] [INFO ] [REMOTE    ] MET: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T19:51:23.278811] [INFO ] [REMOTE    ] MFM: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T19:51:23.347669] [INFO ] [REMOTE    ] MFM: Fetching primary data for 2025-02.
[2025-10-24T19:51:23.418033] [INFO ] [REMOTE    ] MFC: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T19:51:24.104572] [INFO ] [REMOTE    ] MFM: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T19:51:24.147769] [INFO ] [REMOTE    ] MET: Fetching primary data for 2025-09.
[2025-10-24T19:51:24.947669] [INFO ] [REMOTE    ] MFG: Fetching primary data for 2025-05.
[2025-10-24T19:51:25.755931] [INFO ] [REMOTE    ] MFM: Fetching primary data for 2025-03.
[2025-10-24T19:51:25.775501] [INFO ] [REMOTE    ] MET: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T19:51:26.547713] [INFO ] [REMOTE    ] MFC: Fetching primary data for 2025-06.
[2025-10-24T19:51:26.770452] [INFO ] [REMOTE    ] MFG: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T19:51:26.803899] [INFO ] [REMOTE    ] MFM: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T19:51:27.347742] [INFO ] [REMOTE    ] MFG: Fetching primary data for 2025-06.
[2025-10-24T19:51:28.056510] [INFO ] [REMOTE    ] MFC: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T19:51:28.147722] [INFO ] [REMOTE    ] MFC: Fetching primary data for 2025-07.
[2025-10-24T19:51:28.720385] [INFO ] [REMOTE    ] MFG: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T19:51:28.947633] [INFO ] [REMOTE    ] MFG: Fetching primary data for 2025-07.
[2025-10-24T19:51:29.747683] [INFO ] [REMOTE    ] MET: Fetching primary data for 2025-10.
[2025-10-24T19:51:29.845590] [INFO ] [REMOTE    ] MFC: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T19:51:30.547729] [INFO ] [REMOTE    ] MFM: Fetching primary data for 2025-04.
[2025-10-24T19:51:30.596174] [INFO ] [REMOTE    ] MFG: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T19:51:31.347670] [INFO ] [REMOTE    ] MFC: Fetching primary data for 2025-08.
[2025-10-24T19:51:31.573823] [INFO ] [REMOTE    ] MFM: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T19:51:31.678767] [INFO ] [REMOTE    ] MET: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T19:51:31.690533] [INFO ] [REMOTE    ] MET: Full fetch complete (77358 records).
[2025-10-24T19:51:31.690746] [DEBUG] [VALIDATOR ] MET: Validating primary data.
[2025-10-24T19:51:32.084312] [DEBUG] [VALIDATOR ] MET: All expected trading days are present.
[2025-10-24T19:51:32.084391] [DEBUG] [VALIDATOR ] MET: Primary data validation passed.
[2025-10-24T19:51:32.085483] [INFO ] [MAIN      ] MET: Fetched primary data is valid.
[2025-10-24T19:51:32.085555] [DEBUG] [LOCAL     ] MET: Saving primary data.
[2025-10-24T19:51:32.086146] [FATAL] [LOCAL     ] MET: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:51:32.086248] [FATAL] [MAIN      ] MET: Failed to save primary data.
[2025-10-24T19:51:32.086326] [WARN ] [MAIN      ] MET: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:51:32.086416] [INFO ] [LOCAL     ] MET: Starting deletion of primary data.
[2025-10-24T19:51:32.086494] [DEBUG] [LOCAL     ] MET: No primary data file found to delete.
[2025-10-24T19:51:32.086533] [INFO ] [LOCAL     ] MET: Starting deletion of derivative data.
[2025-10-24T19:51:32.086701] [DEBUG] [LOCAL     ] MET: Deleted derivative data file.
[2025-10-24T19:51:32.087144] [INFO ] [MAIN      ] Update Progress: 1332/2366 symbols completed. MET took 58.8s. Estimated remaining: 2h 13m 7s. Rate: 7.8 symbols/min
[2025-10-24T19:51:32.152863] [INFO ] [REMOTE    ] MFM: Fetching primary data for 2025-05.
[2025-10-24T19:51:32.266817] [INFO ] [MAIN      ] MFSB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:51:32.266992] [DEBUG] [LOCAL     ] MFSB: No existing data file found in primary storage.
[2025-10-24T19:51:32.267029] [WARN ] [MAIN      ] MFSB: No existing data found, performing full refresh instead.
[2025-10-24T19:51:32.267138] [INFO ] [MAIN      ] MFSB: Wiping existing primary data before full refresh.
[2025-10-24T19:51:32.267180] [INFO ] [LOCAL     ] MFSB: Starting deletion of primary data.
[2025-10-24T19:51:32.267252] [DEBUG] [LOCAL     ] MFSB: No primary data file found to delete.
[2025-10-24T19:51:32.267302] [INFO ] [MAIN      ] MFSB: Starting full primary refresh.
[2025-10-24T19:51:32.640617] [INFO ] [REMOTE    ] MFSB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:51:32.933773] [INFO ] [REMOTE    ] MFC: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T19:51:32.947604] [INFO ] [REMOTE    ] MFC: Fetching primary data for 2025-09.
[2025-10-24T19:51:32.982108] [INFO ] [REMOTE    ] MFM: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T19:51:33.747695] [INFO ] [REMOTE    ] MFG: Fetching primary data for 2025-08.
[2025-10-24T19:51:34.547619] [INFO ] [REMOTE    ] MFSB: Fetching primary data for 2025-01.
[2025-10-24T19:51:34.590568] [INFO ] [REMOTE    ] MFC: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T19:51:34.856108] [INFO ] [REMOTE    ] MFSB: Incremental fetch complete for 2025-01 (0.31 seconds).
[2025-10-24T19:51:35.276683] [INFO ] [REMOTE    ] MFG: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T19:51:35.347609] [INFO ] [REMOTE    ] MFG: Fetching primary data for 2025-09.
[2025-10-24T19:51:36.147703] [INFO ] [REMOTE    ] MFSB: Fetching primary data for 2025-02.
[2025-10-24T19:51:36.384681] [INFO ] [REMOTE    ] MFSB: Incremental fetch complete for 2025-02 (0.24 seconds).
[2025-10-24T19:51:36.840537] [INFO ] [REMOTE    ] MFG: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T19:51:36.947637] [INFO ] [REMOTE    ] MFM: Fetching primary data for 2025-06.
[2025-10-24T19:51:37.734320] [INFO ] [REMOTE    ] MFM: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T19:51:37.747609] [INFO ] [REMOTE    ] MFG: Fetching primary data for 2025-10.
[2025-10-24T19:51:38.547717] [INFO ] [REMOTE    ] MFC: Fetching primary data for 2025-10.
[2025-10-24T19:51:39.347637] [INFO ] [REMOTE    ] MFSB: Fetching primary data for 2025-03.
[2025-10-24T19:51:39.412475] [INFO ] [REMOTE    ] MFG: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T19:51:39.421835] [INFO ] [REMOTE    ] MFG: Full fetch complete (69970 records).
[2025-10-24T19:51:39.421994] [DEBUG] [VALIDATOR ] MFG: Validating primary data.
[2025-10-24T19:51:39.705858] [INFO ] [REMOTE    ] MFSB: Incremental fetch complete for 2025-03 (0.36 seconds).
[2025-10-24T19:51:39.814461] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present.
[2025-10-24T19:51:39.814542] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed.
[2025-10-24T19:51:39.815715] [INFO ] [MAIN      ] MFG: Fetched primary data is valid.
[2025-10-24T19:51:39.815778] [DEBUG] [LOCAL     ] MFG: Saving primary data.
[2025-10-24T19:51:39.816335] [FATAL] [LOCAL     ] MFG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:51:39.816439] [FATAL] [MAIN      ] MFG: Failed to save primary data.
[2025-10-24T19:51:39.816511] [WARN ] [MAIN      ] MFG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:51:39.816595] [INFO ] [LOCAL     ] MFG: Starting deletion of primary data.
[2025-10-24T19:51:39.816708] [DEBUG] [LOCAL     ] MFG: No primary data file found to delete.
[2025-10-24T19:51:39.816774] [INFO ] [LOCAL     ] MFG: Starting deletion of derivative data.
[2025-10-24T19:51:39.816945] [DEBUG] [LOCAL     ] MFG: Deleted derivative data file.
[2025-10-24T19:51:39.817237] [INFO ] [MAIN      ] Update Progress: 1333/2366 symbols completed. MFG took 27.9s. Estimated remaining: 2h 12m 60s. Rate: 7.8 symbols/min
[2025-10-24T19:51:39.991431] [INFO ] [MAIN      ] MFSG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:51:40.000256] [DEBUG] [LOCAL     ] MFSG: Loaded 5990 existing records from primary storage.
[2025-10-24T19:51:40.000474] [INFO ] [MAIN      ] MFSG: Loaded 5990 existing records.
[2025-10-24T19:51:40.151863] [INFO ] [REMOTE    ] MFM: Fetching primary data for 2025-07.
[2025-10-24T19:51:40.193237] [WARN ] [MAIN      ] MFSG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:51:40.217098] [INFO ] [MAIN      ] MFSG: Wiping existing primary data before full refresh.
[2025-10-24T19:51:40.218015] [INFO ] [LOCAL     ] MFSG: Starting deletion of primary data.
[2025-10-24T19:51:40.218576] [DEBUG] [LOCAL     ] MFSG: Deleted primary data file.
[2025-10-24T19:51:40.219512] [INFO ] [REMOTE    ] MFC: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T19:51:40.219595] [INFO ] [MAIN      ] MFSG: Starting full primary refresh.
[2025-10-24T19:51:40.300525] [INFO ] [REMOTE    ] MFC: Full fetch complete (74361 records).
[2025-10-24T19:51:40.322997] [DEBUG] [VALIDATOR ] MFC: Validating primary data.
[2025-10-24T19:51:40.893886] [INFO ] [REMOTE    ] MFSG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:51:40.955741] [INFO ] [REMOTE    ] MFSG: Fetching primary data for 2025-01.
[2025-10-24T19:51:41.015699] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present.
[2025-10-24T19:51:41.015794] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed.
[2025-10-24T19:51:41.016942] [INFO ] [MAIN      ] MFC: Fetched primary data is valid.
[2025-10-24T19:51:41.017006] [DEBUG] [LOCAL     ] MFC: Saving primary data.
[2025-10-24T19:51:41.017666] [FATAL] [LOCAL     ] MFC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:51:41.017758] [FATAL] [MAIN      ] MFC: Failed to save primary data.
[2025-10-24T19:51:41.017800] [WARN ] [MAIN      ] MFC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:51:41.017838] [INFO ] [LOCAL     ] MFC: Starting deletion of primary data.
[2025-10-24T19:51:41.017892] [DEBUG] [LOCAL     ] MFC: No primary data file found to delete.
[2025-10-24T19:51:41.017925] [INFO ] [LOCAL     ] MFC: Starting deletion of derivative data.
[2025-10-24T19:51:41.018065] [DEBUG] [LOCAL     ] MFC: Deleted derivative data file.
[2025-10-24T19:51:41.018427] [INFO ] [MAIN      ] Update Progress: 1334/2366 symbols completed. MFC took 35.0s. Estimated remaining: 2h 12m 47s. Rate: 7.8 symbols/min
[2025-10-24T19:51:41.187470] [INFO ] [MAIN      ] MFSI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:51:41.200445] [INFO ] [REMOTE    ] MFM: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T19:51:41.218901] [DEBUG] [LOCAL     ] MFSI: Loaded 12771 existing records from primary storage.
[2025-10-24T19:51:41.219170] [INFO ] [MAIN      ] MFSI: Loaded 12771 existing records.
[2025-10-24T19:51:41.393680] [WARN ] [MAIN      ] MFSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:51:41.393901] [INFO ] [MAIN      ] MFSI: Wiping existing primary data before full refresh.
[2025-10-24T19:51:41.393950] [INFO ] [LOCAL     ] MFSI: Starting deletion of primary data.
[2025-10-24T19:51:41.394181] [DEBUG] [LOCAL     ] MFSI: Deleted primary data file.
[2025-10-24T19:51:41.394219] [INFO ] [MAIN      ] MFSI: Starting full primary refresh.
[2025-10-24T19:51:41.478398] [INFO ] [REMOTE    ] MFSG: Incremental fetch complete for 2025-01 (0.52 seconds).
[2025-10-24T19:51:41.746420] [INFO ] [REMOTE    ] MFSI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:51:41.747616] [INFO ] [REMOTE    ] MFSI: Fetching primary data for 2025-01.
[2025-10-24T19:51:42.360671] [INFO ] [REMOTE    ] MFSI: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T19:51:42.547684] [INFO ] [REMOTE    ] MFSB: Fetching primary data for 2025-04.
[2025-10-24T19:51:42.874663] [INFO ] [REMOTE    ] MFSB: Incremental fetch complete for 2025-04 (0.33 seconds).
[2025-10-24T19:51:43.347637] [INFO ] [REMOTE    ] MFSB: Fetching primary data for 2025-05.
[2025-10-24T19:51:43.577319] [INFO ] [REMOTE    ] MFSB: Incremental fetch complete for 2025-05 (0.23 seconds).
[2025-10-24T19:51:44.147713] [INFO ] [REMOTE    ] MFM: Fetching primary data for 2025-08.
[2025-10-24T19:51:44.920202] [INFO ] [REMOTE    ] MFM: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T19:51:44.947698] [INFO ] [REMOTE    ] MFM: Fetching primary data for 2025-09.
[2025-10-24T19:51:45.726085] [INFO ] [REMOTE    ] MFM: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T19:51:45.747703] [INFO ] [REMOTE    ] MFSI: Fetching primary data for 2025-02.
[2025-10-24T19:51:46.296256] [INFO ] [REMOTE    ] MFSI: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T19:51:46.547726] [INFO ] [REMOTE    ] MFSI: Fetching primary data for 2025-03.
[2025-10-24T19:51:47.226990] [INFO ] [REMOTE    ] MFSI: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T19:51:47.347672] [INFO ] [REMOTE    ] MFSG: Fetching primary data for 2025-02.
[2025-10-24T19:51:47.772142] [INFO ] [REMOTE    ] MFSG: Incremental fetch complete for 2025-02 (0.42 seconds).
[2025-10-24T19:51:48.147737] [INFO ] [REMOTE    ] MFSG: Fetching primary data for 2025-03.
[2025-10-24T19:51:48.623961] [INFO ] [REMOTE    ] MFSG: Incremental fetch complete for 2025-03 (0.48 seconds).
[2025-10-24T19:51:48.947697] [INFO ] [REMOTE    ] MFSI: Fetching primary data for 2025-04.
[2025-10-24T19:51:49.535932] [INFO ] [REMOTE    ] MFSI: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T19:51:49.747768] [INFO ] [REMOTE    ] MFSI: Fetching primary data for 2025-05.
[2025-10-24T19:51:50.475766] [INFO ] [REMOTE    ] MFSI: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T19:51:50.547696] [INFO ] [REMOTE    ] MFSI: Fetching primary data for 2025-06.
[2025-10-24T19:51:51.274251] [INFO ] [REMOTE    ] MFSI: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T19:51:51.347615] [INFO ] [REMOTE    ] MFSG: Fetching primary data for 2025-04.
[2025-10-24T19:51:51.914586] [INFO ] [REMOTE    ] MFSG: Incremental fetch complete for 2025-04 (0.57 seconds).
[2025-10-24T19:51:52.147702] [INFO ] [REMOTE    ] MFM: Fetching primary data for 2025-10.
[2025-10-24T19:51:52.947624] [INFO ] [REMOTE    ] MFSB: Fetching primary data for 2025-06.
[2025-10-24T19:51:53.040051] [INFO ] [REMOTE    ] MFM: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T19:51:53.043264] [INFO ] [REMOTE    ] MFM: Full fetch complete (19452 records).
[2025-10-24T19:51:53.043345] [DEBUG] [VALIDATOR ] MFM: Validating primary data.
[2025-10-24T19:51:53.361043] [INFO ] [REMOTE    ] MFSB: Incremental fetch complete for 2025-06 (0.41 seconds).
[2025-10-24T19:51:53.451410] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present.
[2025-10-24T19:51:53.451493] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed.
[2025-10-24T19:51:53.452032] [INFO ] [MAIN      ] MFM: Fetched primary data is valid.
[2025-10-24T19:51:53.452095] [DEBUG] [LOCAL     ] MFM: Saving primary data.
[2025-10-24T19:51:53.452366] [FATAL] [LOCAL     ] MFM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:51:53.452479] [FATAL] [MAIN      ] MFM: Failed to save primary data.
[2025-10-24T19:51:53.452520] [WARN ] [MAIN      ] MFM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:51:53.452556] [INFO ] [LOCAL     ] MFM: Starting deletion of primary data.
[2025-10-24T19:51:53.452606] [DEBUG] [LOCAL     ] MFM: No primary data file found to delete.
[2025-10-24T19:51:53.452707] [INFO ] [LOCAL     ] MFM: Starting deletion of derivative data.
[2025-10-24T19:51:53.452911] [DEBUG] [LOCAL     ] MFM: Deleted derivative data file.
[2025-10-24T19:51:53.453001] [INFO ] [MAIN      ] Update Progress: 1335/2366 symbols completed. MFM took 32.3s. Estimated remaining: 2h 12m 43s. Rate: 7.8 symbols/min
[2025-10-24T19:51:53.621025] [INFO ] [MAIN      ] MFSV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:51:53.626848] [DEBUG] [LOCAL     ] MFSV: Loaded 2986 existing records from primary storage.
[2025-10-24T19:51:53.627057] [INFO ] [MAIN      ] MFSV: Loaded 2986 existing records.
[2025-10-24T19:51:53.752787] [INFO ] [REMOTE    ] MFSG: Fetching primary data for 2025-05.
[2025-10-24T19:51:53.808792] [WARN ] [MAIN      ] MFSV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:51:53.809252] [INFO ] [MAIN      ] MFSV: Wiping existing primary data before full refresh.
[2025-10-24T19:51:53.809307] [INFO ] [LOCAL     ] MFSV: Starting deletion of primary data.
[2025-10-24T19:51:53.809500] [DEBUG] [LOCAL     ] MFSV: Deleted primary data file.
[2025-10-24T19:51:53.809557] [INFO ] [MAIN      ] MFSV: Starting full primary refresh.
[2025-10-24T19:51:54.157832] [INFO ] [REMOTE    ] MFSV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:51:54.361316] [INFO ] [REMOTE    ] MFSG: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T19:51:54.547700] [INFO ] [REMOTE    ] MFSG: Fetching primary data for 2025-06.
[2025-10-24T19:51:55.173376] [INFO ] [REMOTE    ] MFSG: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T19:51:55.347677] [INFO ] [REMOTE    ] MFSB: Fetching primary data for 2025-07.
[2025-10-24T19:51:55.740889] [INFO ] [REMOTE    ] MFSB: Incremental fetch complete for 2025-07 (0.39 seconds).
[2025-10-24T19:51:56.147709] [INFO ] [REMOTE    ] MFSV: Fetching primary data for 2025-01.
[2025-10-24T19:51:56.465786] [INFO ] [REMOTE    ] MFSV: Incremental fetch complete for 2025-01 (0.32 seconds).
[2025-10-24T19:51:56.947734] [INFO ] [REMOTE    ] MFSI: Fetching primary data for 2025-07.
[2025-10-24T19:51:57.747687] [INFO ] [REMOTE    ] MFSV: Fetching primary data for 2025-02.
[2025-10-24T19:51:57.804875] [INFO ] [REMOTE    ] MFSI: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T19:51:58.168127] [INFO ] [REMOTE    ] MFSV: Incremental fetch complete for 2025-02 (0.42 seconds).
[2025-10-24T19:51:58.547714] [INFO ] [REMOTE    ] MFSV: Fetching primary data for 2025-03.
[2025-10-24T19:51:58.984731] [INFO ] [REMOTE    ] MFSV: Incremental fetch complete for 2025-03 (0.44 seconds).
[2025-10-24T19:51:59.347724] [INFO ] [REMOTE    ] MFSI: Fetching primary data for 2025-08.
[2025-10-24T19:52:00.147675] [INFO ] [REMOTE    ] MFSG: Fetching primary data for 2025-07.
[2025-10-24T19:52:00.322919] [INFO ] [REMOTE    ] MFSI: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T19:52:00.701407] [INFO ] [REMOTE    ] MFSG: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T19:52:00.947740] [INFO ] [REMOTE    ] MFSB: Fetching primary data for 2025-08.
[2025-10-24T19:52:01.388927] [INFO ] [REMOTE    ] MFSB: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T19:52:01.747714] [INFO ] [REMOTE    ] MFSB: Fetching primary data for 2025-09.
[2025-10-24T19:52:02.279555] [INFO ] [REMOTE    ] MFSB: Incremental fetch complete for 2025-09 (0.53 seconds).
[2025-10-24T19:52:02.547684] [INFO ] [REMOTE    ] MFSG: Fetching primary data for 2025-08.
[2025-10-24T19:52:03.135570] [INFO ] [REMOTE    ] MFSG: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T19:52:03.347739] [INFO ] [REMOTE    ] MFSI: Fetching primary data for 2025-09.
[2025-10-24T19:52:04.147622] [INFO ] [REMOTE    ] MFSG: Fetching primary data for 2025-09.
[2025-10-24T19:52:04.399413] [INFO ] [REMOTE    ] MFSI: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T19:52:04.575596] [INFO ] [REMOTE    ] MFSG: Incremental fetch complete for 2025-09 (0.43 seconds).
[2025-10-24T19:52:04.947682] [INFO ] [REMOTE    ] MFSG: Fetching primary data for 2025-10.
[2025-10-24T19:52:05.738492] [INFO ] [REMOTE    ] MFSG: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T19:52:05.740437] [INFO ] [REMOTE    ] MFSG: Full fetch complete (6849 records).
[2025-10-24T19:52:05.740506] [DEBUG] [VALIDATOR ] MFSG: Validating primary data.
[2025-10-24T19:52:05.752788] [INFO ] [REMOTE    ] MFSB: Fetching primary data for 2025-10.
[2025-10-24T19:52:06.097168] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present.
[2025-10-24T19:52:06.097280] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed.
[2025-10-24T19:52:06.097537] [INFO ] [MAIN      ] MFSG: Fetched primary data is valid.
[2025-10-24T19:52:06.097578] [DEBUG] [LOCAL     ] MFSG: Saving primary data.
[2025-10-24T19:52:06.097794] [FATAL] [LOCAL     ] MFSG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:52:06.097897] [FATAL] [MAIN      ] MFSG: Failed to save primary data.
[2025-10-24T19:52:06.097939] [WARN ] [MAIN      ] MFSG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:52:06.097975] [INFO ] [LOCAL     ] MFSG: Starting deletion of primary data.
[2025-10-24T19:52:06.098024] [DEBUG] [LOCAL     ] MFSG: No primary data file found to delete.
[2025-10-24T19:52:06.098061] [INFO ] [LOCAL     ] MFSG: Starting deletion of derivative data.
[2025-10-24T19:52:06.098197] [DEBUG] [LOCAL     ] MFSG: Deleted derivative data file.
[2025-10-24T19:52:06.098285] [INFO ] [MAIN      ] Update Progress: 1336/2366 symbols completed. MFSG took 26.3s. Estimated remaining: 2h 12m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:52:06.267012] [INFO ] [MAIN      ] MG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:52:06.283858] [DEBUG] [LOCAL     ] MG: Loaded 15462 existing records from primary storage.
[2025-10-24T19:52:06.284087] [INFO ] [MAIN      ] MG: Loaded 15462 existing records.
[2025-10-24T19:52:06.464839] [WARN ] [MAIN      ] MG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:52:06.465046] [INFO ] [MAIN      ] MG: Wiping existing primary data before full refresh.
[2025-10-24T19:52:06.465093] [INFO ] [LOCAL     ] MG: Starting deletion of primary data.
[2025-10-24T19:52:06.465324] [DEBUG] [LOCAL     ] MG: Deleted primary data file.
[2025-10-24T19:52:06.465366] [INFO ] [MAIN      ] MG: Starting full primary refresh.
[2025-10-24T19:52:06.551717] [INFO ] [REMOTE    ] MFSI: Fetching primary data for 2025-10.
[2025-10-24T19:52:06.557633] [INFO ] [REMOTE    ] MFSB: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T19:52:06.578142] [INFO ] [REMOTE    ] MFSB: Full fetch complete (2120 records).
[2025-10-24T19:52:06.578350] [DEBUG] [VALIDATOR ] MFSB: Validating primary data.
[2025-10-24T19:52:06.955183] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days
[2025-10-24T19:52:06.993959] [FATAL] [MAIN      ] MFSB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:52:07.002931] [WARN ] [MAIN      ] MFSB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:52:07.023158] [INFO ] [LOCAL     ] MFSB: Starting deletion of primary data.
[2025-10-24T19:52:07.023099] [INFO ] [REMOTE    ] MG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:52:07.023508] [DEBUG] [LOCAL     ] MFSB: No primary data file found to delete.
[2025-10-24T19:52:07.023565] [INFO ] [LOCAL     ] MFSB: Starting deletion of derivative data.
[2025-10-24T19:52:07.023608] [DEBUG] [LOCAL     ] MFSB: No derivative data file found to delete.
[2025-10-24T19:52:07.023692] [INFO ] [MAIN      ] Update Progress: 1337/2366 symbols completed. MFSB took 34.9s. Estimated remaining: 2h 12m 26s. Rate: 7.8 symbols/min
[2025-10-24T19:52:07.191683] [INFO ] [MAIN      ] MGA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:52:07.243181] [DEBUG] [LOCAL     ] MGA: Loaded 50758 existing records from primary storage.
[2025-10-24T19:52:07.243479] [INFO ] [MAIN      ] MGA: Loaded 50758 existing records.
[2025-10-24T19:52:07.352756] [INFO ] [REMOTE    ] MG: Fetching primary data for 2025-01.
[2025-10-24T19:52:07.424889] [WARN ] [MAIN      ] MGA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:52:07.425098] [INFO ] [MAIN      ] MGA: Wiping existing primary data before full refresh.
[2025-10-24T19:52:07.425144] [INFO ] [LOCAL     ] MGA: Starting deletion of primary data.
[2025-10-24T19:52:07.425888] [DEBUG] [LOCAL     ] MGA: Deleted primary data file.
[2025-10-24T19:52:07.425947] [INFO ] [MAIN      ] MGA: Starting full primary refresh.
[2025-10-24T19:52:07.727199] [INFO ] [REMOTE    ] MFSI: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T19:52:07.776592] [INFO ] [REMOTE    ] MFSI: Full fetch complete (15122 records).
[2025-10-24T19:52:07.778433] [DEBUG] [VALIDATOR ] MFSI: Validating primary data.
[2025-10-24T19:52:07.829870] [INFO ] [REMOTE    ] MGA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:52:08.154743] [INFO ] [REMOTE    ] MGA: Fetching primary data for 2025-01.
[2025-10-24T19:52:08.164127] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present.
[2025-10-24T19:52:08.164194] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed.
[2025-10-24T19:52:08.164596] [INFO ] [MAIN      ] MFSI: Fetched primary data is valid.
[2025-10-24T19:52:08.164701] [DEBUG] [LOCAL     ] MFSI: Saving primary data.
[2025-10-24T19:52:08.165026] [FATAL] [LOCAL     ] MFSI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:52:08.165199] [FATAL] [MAIN      ] MFSI: Failed to save primary data.
[2025-10-24T19:52:08.165278] [WARN ] [MAIN      ] MFSI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:52:08.165359] [INFO ] [LOCAL     ] MFSI: Starting deletion of primary data.
[2025-10-24T19:52:08.165428] [DEBUG] [LOCAL     ] MFSI: No primary data file found to delete.
[2025-10-24T19:52:08.165467] [INFO ] [LOCAL     ] MFSI: Starting deletion of derivative data.
[2025-10-24T19:52:08.165590] [DEBUG] [LOCAL     ] MFSI: Deleted derivative data file.
[2025-10-24T19:52:08.165752] [INFO ] [MAIN      ] Update Progress: 1338/2366 symbols completed. MFSI took 27.1s. Estimated remaining: 2h 12m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:52:08.334225] [INFO ] [MAIN      ] MGF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:52:08.341344] [DEBUG] [LOCAL     ] MGF: Loaded 4146 existing records from primary storage.
[2025-10-24T19:52:08.341555] [INFO ] [MAIN      ] MGF: Loaded 4146 existing records.
[2025-10-24T19:52:08.475339] [INFO ] [REMOTE    ] MG: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T19:52:08.550927] [WARN ] [MAIN      ] MGF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:52:08.551153] [INFO ] [MAIN      ] MGF: Wiping existing primary data before full refresh.
[2025-10-24T19:52:08.551205] [INFO ] [LOCAL     ] MGF: Starting deletion of primary data.
[2025-10-24T19:52:08.551360] [DEBUG] [LOCAL     ] MGF: Deleted primary data file.
[2025-10-24T19:52:08.551416] [INFO ] [MAIN      ] MGF: Starting full primary refresh.
[2025-10-24T19:52:08.896596] [INFO ] [REMOTE    ] MGF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:52:08.947608] [INFO ] [REMOTE    ] MG: Fetching primary data for 2025-02.
[2025-10-24T19:52:09.492085] [INFO ] [REMOTE    ] MG: Incremental fetch complete for 2025-02 (0.54 seconds).
[2025-10-24T19:52:09.698471] [INFO ] [REMOTE    ] MGA: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T19:52:09.747612] [INFO ] [REMOTE    ] MGF: Fetching primary data for 2025-01.
[2025-10-24T19:52:10.112164] [INFO ] [REMOTE    ] MGF: Incremental fetch complete for 2025-01 (0.36 seconds).
[2025-10-24T19:52:10.547674] [INFO ] [REMOTE    ] MFSV: Fetching primary data for 2025-04.
[2025-10-24T19:52:11.004583] [INFO ] [REMOTE    ] MFSV: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T19:52:11.347718] [INFO ] [REMOTE    ] MFSV: Fetching primary data for 2025-05.
[2025-10-24T19:52:11.812704] [INFO ] [REMOTE    ] MFSV: Incremental fetch complete for 2025-05 (0.46 seconds).
[2025-10-24T19:52:12.147723] [INFO ] [REMOTE    ] MFSV: Fetching primary data for 2025-06.
[2025-10-24T19:52:12.572671] [INFO ] [REMOTE    ] MFSV: Incremental fetch complete for 2025-06 (0.42 seconds).
[2025-10-24T19:52:12.947676] [INFO ] [REMOTE    ] MGA: Fetching primary data for 2025-02.
[2025-10-24T19:52:13.747747] [INFO ] [REMOTE    ] MFSV: Fetching primary data for 2025-07.
[2025-10-24T19:52:14.417915] [INFO ] [REMOTE    ] MFSV: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T19:52:14.454481] [INFO ] [REMOTE    ] MGA: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T19:52:14.547701] [INFO ] [REMOTE    ] MGF: Fetching primary data for 2025-02.
[2025-10-24T19:52:15.069635] [INFO ] [REMOTE    ] MGF: Incremental fetch complete for 2025-02 (0.52 seconds).
[2025-10-24T19:52:15.347758] [INFO ] [REMOTE    ] MGF: Fetching primary data for 2025-03.
[2025-10-24T19:52:16.001985] [INFO ] [REMOTE    ] MGF: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T19:52:16.147698] [INFO ] [REMOTE    ] MFSV: Fetching primary data for 2025-08.
[2025-10-24T19:52:16.772384] [INFO ] [REMOTE    ] MFSV: Incremental fetch complete for 2025-08 (0.62 seconds).
[2025-10-24T19:52:16.947724] [INFO ] [REMOTE    ] MGF: Fetching primary data for 2025-04.
[2025-10-24T19:52:17.522063] [INFO ] [REMOTE    ] MGF: Incremental fetch complete for 2025-04 (0.57 seconds).
[2025-10-24T19:52:17.747734] [INFO ] [REMOTE    ] MG: Fetching primary data for 2025-03.
[2025-10-24T19:52:18.547733] [INFO ] [REMOTE    ] MGF: Fetching primary data for 2025-05.
[2025-10-24T19:52:18.837190] [INFO ] [REMOTE    ] MG: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T19:52:19.131566] [INFO ] [REMOTE    ] MGF: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T19:52:19.347719] [INFO ] [REMOTE    ] MGF: Fetching primary data for 2025-06.
[2025-10-24T19:52:19.893806] [INFO ] [REMOTE    ] MGF: Incremental fetch complete for 2025-06 (0.55 seconds).
[2025-10-24T19:52:20.147730] [INFO ] [REMOTE    ] MGF: Fetching primary data for 2025-07.
[2025-10-24T19:52:20.701120] [INFO ] [REMOTE    ] MGF: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T19:52:20.947679] [INFO ] [REMOTE    ] MG: Fetching primary data for 2025-04.
[2025-10-24T19:52:21.747717] [INFO ] [REMOTE    ] MGF: Fetching primary data for 2025-08.
[2025-10-24T19:52:21.953715] [INFO ] [REMOTE    ] MG: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T19:52:22.345093] [INFO ] [REMOTE    ] MGF: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T19:52:22.547728] [INFO ] [REMOTE    ] MGF: Fetching primary data for 2025-09.
[2025-10-24T19:52:23.152807] [INFO ] [REMOTE    ] MGF: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T19:52:23.347720] [INFO ] [REMOTE    ] MG: Fetching primary data for 2025-05.
[2025-10-24T19:52:24.147711] [INFO ] [REMOTE    ] MGF: Fetching primary data for 2025-10.
[2025-10-24T19:52:24.303221] [INFO ] [REMOTE    ] MG: Incremental fetch complete for 2025-05 (0.96 seconds).
[2025-10-24T19:52:24.625098] [INFO ] [REMOTE    ] MGF: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T19:52:24.626332] [INFO ] [REMOTE    ] MGF: Full fetch complete (5720 records).
[2025-10-24T19:52:24.626418] [DEBUG] [VALIDATOR ] MGF: Validating primary data.
[2025-10-24T19:52:24.952785] [INFO ] [REMOTE    ] MG: Fetching primary data for 2025-06.
[2025-10-24T19:52:25.020144] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present.
[2025-10-24T19:52:25.020227] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed.
[2025-10-24T19:52:25.020402] [INFO ] [MAIN      ] MGF: Fetched primary data is valid.
[2025-10-24T19:52:25.020441] [DEBUG] [LOCAL     ] MGF: Saving primary data.
[2025-10-24T19:52:25.020680] [FATAL] [LOCAL     ] MGF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:52:25.020768] [FATAL] [MAIN      ] MGF: Failed to save primary data.
[2025-10-24T19:52:25.020814] [WARN ] [MAIN      ] MGF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:52:25.020846] [INFO ] [LOCAL     ] MGF: Starting deletion of primary data.
[2025-10-24T19:52:25.020894] [DEBUG] [LOCAL     ] MGF: No primary data file found to delete.
[2025-10-24T19:52:25.020927] [INFO ] [LOCAL     ] MGF: Starting deletion of derivative data.
[2025-10-24T19:52:25.021074] [DEBUG] [LOCAL     ] MGF: Deleted derivative data file.
[2025-10-24T19:52:25.021164] [INFO ] [MAIN      ] Update Progress: 1339/2366 symbols completed. MGF took 16.9s. Estimated remaining: 2h 12m 12s. Rate: 7.8 symbols/min
[2025-10-24T19:52:25.207358] [INFO ] [MAIN      ] MGM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:52:25.264244] [DEBUG] [LOCAL     ] MGM: Loaded 53993 existing records from primary storage.
[2025-10-24T19:52:25.264594] [INFO ] [MAIN      ] MGM: Loaded 53993 existing records.
[2025-10-24T19:52:25.460637] [WARN ] [MAIN      ] MGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:52:25.460876] [INFO ] [MAIN      ] MGM: Wiping existing primary data before full refresh.
[2025-10-24T19:52:25.460939] [INFO ] [LOCAL     ] MGM: Starting deletion of primary data.
[2025-10-24T19:52:25.461270] [DEBUG] [LOCAL     ] MGM: Deleted primary data file.
[2025-10-24T19:52:25.461311] [INFO ] [MAIN      ] MGM: Starting full primary refresh.
[2025-10-24T19:52:25.749205] [INFO ] [REMOTE    ] MFSV: Fetching primary data for 2025-09.
[2025-10-24T19:52:25.824977] [INFO ] [REMOTE    ] MGM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:52:25.835880] [INFO ] [REMOTE    ] MG: Incremental fetch complete for 2025-06 (0.88 seconds).
[2025-10-24T19:52:26.356776] [INFO ] [REMOTE    ] MFSV: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T19:52:26.547699] [INFO ] [REMOTE    ] MG: Fetching primary data for 2025-07.
[2025-10-24T19:52:27.347712] [INFO ] [REMOTE    ] MFSV: Fetching primary data for 2025-10.
[2025-10-24T19:52:27.390940] [INFO ] [REMOTE    ] MG: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T19:52:28.012817] [INFO ] [REMOTE    ] MFSV: Incremental fetch complete for 2025-10 (0.67 seconds).
[2025-10-24T19:52:28.014355] [INFO ] [REMOTE    ] MFSV: Full fetch complete (3743 records).
[2025-10-24T19:52:28.014423] [DEBUG] [VALIDATOR ] MFSV: Validating primary data.
[2025-10-24T19:52:28.153146] [INFO ] [REMOTE    ] MGM: Fetching primary data for 2025-01.
[2025-10-24T19:52:28.375415] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present.
[2025-10-24T19:52:28.375509] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed.
[2025-10-24T19:52:28.375669] [INFO ] [MAIN      ] MFSV: Fetched primary data is valid.
[2025-10-24T19:52:28.375730] [DEBUG] [LOCAL     ] MFSV: Saving primary data.
[2025-10-24T19:52:28.375920] [FATAL] [LOCAL     ] MFSV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:52:28.376003] [FATAL] [MAIN      ] MFSV: Failed to save primary data.
[2025-10-24T19:52:28.376044] [WARN ] [MAIN      ] MFSV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:52:28.376078] [INFO ] [LOCAL     ] MFSV: Starting deletion of primary data.
[2025-10-24T19:52:28.376125] [DEBUG] [LOCAL     ] MFSV: No primary data file found to delete.
[2025-10-24T19:52:28.376178] [INFO ] [LOCAL     ] MFSV: Starting deletion of derivative data.
[2025-10-24T19:52:28.376330] [DEBUG] [LOCAL     ] MFSV: Deleted derivative data file.
[2025-10-24T19:52:28.376424] [INFO ] [MAIN      ] Update Progress: 1340/2366 symbols completed. MFSV took 34.9s. Estimated remaining: 2h 12m 1s. Rate: 7.8 symbols/min
[2025-10-24T19:52:28.554587] [INFO ] [MAIN      ] MGR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:52:28.563622] [DEBUG] [LOCAL     ] MGR: Loaded 5552 existing records from primary storage.
[2025-10-24T19:52:28.563856] [INFO ] [MAIN      ] MGR: Loaded 5552 existing records.
[2025-10-24T19:52:28.758210] [WARN ] [MAIN      ] MGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:52:28.758434] [INFO ] [MAIN      ] MGR: Wiping existing primary data before full refresh.
[2025-10-24T19:52:28.758491] [INFO ] [LOCAL     ] MGR: Starting deletion of primary data.
[2025-10-24T19:52:28.758679] [DEBUG] [LOCAL     ] MGR: Deleted primary data file.
[2025-10-24T19:52:28.758738] [INFO ] [MAIN      ] MGR: Starting full primary refresh.
[2025-10-24T19:52:28.952935] [INFO ] [REMOTE    ] MGA: Fetching primary data for 2025-03.
[2025-10-24T19:52:29.149930] [INFO ] [REMOTE    ] MGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:52:29.747723] [INFO ] [REMOTE    ] MGR: Fetching primary data for 2025-01.
[2025-10-24T19:52:30.042446] [INFO ] [REMOTE    ] MGM: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T19:52:30.320901] [INFO ] [REMOTE    ] MGR: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T19:52:30.547731] [INFO ] [REMOTE    ] MG: Fetching primary data for 2025-08.
[2025-10-24T19:52:30.756098] [INFO ] [REMOTE    ] MGA: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T19:52:31.347610] [INFO ] [REMOTE    ] MGR: Fetching primary data for 2025-02.
[2025-10-24T19:52:31.506857] [INFO ] [REMOTE    ] MG: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T19:52:31.894579] [INFO ] [REMOTE    ] MGR: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T19:52:32.147690] [INFO ] [REMOTE    ] MGA: Fetching primary data for 2025-04.
[2025-10-24T19:52:32.947669] [INFO ] [REMOTE    ] MGM: Fetching primary data for 2025-02.
[2025-10-24T19:52:33.702450] [INFO ] [REMOTE    ] MGA: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T19:52:33.747700] [INFO ] [REMOTE    ] MGA: Fetching primary data for 2025-05.
[2025-10-24T19:52:34.555252] [INFO ] [REMOTE    ] MGR: Fetching primary data for 2025-03.
[2025-10-24T19:52:34.575148] [INFO ] [REMOTE    ] MGM: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T19:52:35.086155] [INFO ] [REMOTE    ] MGA: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T19:52:35.280148] [INFO ] [REMOTE    ] MGR: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T19:52:35.347691] [INFO ] [REMOTE    ] MG: Fetching primary data for 2025-09.
[2025-10-24T19:52:36.147731] [INFO ] [REMOTE    ] MGR: Fetching primary data for 2025-04.
[2025-10-24T19:52:36.250311] [INFO ] [REMOTE    ] MG: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T19:52:36.254471] [DEBUG] [REMOTE    ] MGR: Error fetching primary data for 2025-04: 'API call returned an empty response.'
[2025-10-24T19:52:36.255218] [WARN ] [REMOTE    ] MGR: No data returned for month 2025-04
[2025-10-24T19:52:36.255333] [FATAL] [REMOTE    ] MGR: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:52:36.255419] [FATAL] [MAIN      ] MGR: Failed to fetch primary data.
[2025-10-24T19:52:36.255498] [WARN ] [MAIN      ] MGR: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:52:36.255585] [INFO ] [LOCAL     ] MGR: Starting deletion of primary data.
[2025-10-24T19:52:36.255709] [DEBUG] [LOCAL     ] MGR: No primary data file found to delete.
[2025-10-24T19:52:36.255772] [INFO ] [LOCAL     ] MGR: Starting deletion of derivative data.
[2025-10-24T19:52:36.255907] [DEBUG] [LOCAL     ] MGR: Deleted derivative data file.
[2025-10-24T19:52:36.255987] [INFO ] [MAIN      ] Update Progress: 1341/2366 symbols completed. MGR took 7.9s. Estimated remaining: 2h 11m 54s. Rate: 7.8 symbols/min
[2025-10-24T19:52:36.424278] [INFO ] [MAIN      ] MGRB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:52:36.431419] [DEBUG] [LOCAL     ] MGRB: Loaded 4007 existing records from primary storage.
[2025-10-24T19:52:36.431628] [INFO ] [MAIN      ] MGRB: Loaded 4007 existing records.
[2025-10-24T19:52:36.607741] [WARN ] [MAIN      ] MGRB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:52:36.607971] [INFO ] [MAIN      ] MGRB: Wiping existing primary data before full refresh.
[2025-10-24T19:52:36.608016] [INFO ] [LOCAL     ] MGRB: Starting deletion of primary data.
[2025-10-24T19:52:36.608208] [DEBUG] [LOCAL     ] MGRB: Deleted primary data file.
[2025-10-24T19:52:36.608246] [INFO ] [MAIN      ] MGRB: Starting full primary refresh.
[2025-10-24T19:52:36.953841] [INFO ] [REMOTE    ] MGA: Fetching primary data for 2025-06.
[2025-10-24T19:52:36.958718] [INFO ] [REMOTE    ] MGRB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:52:37.747722] [INFO ] [REMOTE    ] MGRB: Fetching primary data for 2025-01.
[2025-10-24T19:52:38.368141] [INFO ] [REMOTE    ] MGRB: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T19:52:38.547721] [INFO ] [REMOTE    ] MGRB: Fetching primary data for 2025-02.
[2025-10-24T19:52:38.625973] [INFO ] [REMOTE    ] MGA: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T19:52:39.108127] [INFO ] [REMOTE    ] MGRB: Incremental fetch complete for 2025-02 (0.56 seconds).
[2025-10-24T19:52:39.347728] [INFO ] [REMOTE    ] MGM: Fetching primary data for 2025-03.
[2025-10-24T19:52:40.147672] [INFO ] [REMOTE    ] MGA: Fetching primary data for 2025-07.
[2025-10-24T19:52:40.947635] [INFO ] [REMOTE    ] MG: Fetching primary data for 2025-10.
[2025-10-24T19:52:41.215155] [INFO ] [REMOTE    ] MGM: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T19:52:41.747678] [INFO ] [REMOTE    ] MGRB: Fetching primary data for 2025-03.
[2025-10-24T19:52:41.865819] [INFO ] [REMOTE    ] MGA: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T19:52:41.908267] [INFO ] [REMOTE    ] MG: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T19:52:41.911341] [INFO ] [REMOTE    ] MG: Full fetch complete (23191 records).
[2025-10-24T19:52:41.911421] [DEBUG] [VALIDATOR ] MG: Validating primary data.
[2025-10-24T19:52:42.313453] [INFO ] [REMOTE    ] MGRB: Incremental fetch complete for 2025-03 (0.57 seconds).
[2025-10-24T19:52:42.327570] [DEBUG] [VALIDATOR ] MG: All expected trading days are present.
[2025-10-24T19:52:42.327691] [DEBUG] [VALIDATOR ] MG: Primary data validation passed.
[2025-10-24T19:52:42.328322] [INFO ] [MAIN      ] MG: Fetched primary data is valid.
[2025-10-24T19:52:42.328385] [DEBUG] [LOCAL     ] MG: Saving primary data.
[2025-10-24T19:52:42.328787] [FATAL] [LOCAL     ] MG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:52:42.328887] [FATAL] [MAIN      ] MG: Failed to save primary data.
[2025-10-24T19:52:42.328977] [WARN ] [MAIN      ] MG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:52:42.329061] [INFO ] [LOCAL     ] MG: Starting deletion of primary data.
[2025-10-24T19:52:42.329154] [DEBUG] [LOCAL     ] MG: No primary data file found to delete.
[2025-10-24T19:52:42.329211] [INFO ] [LOCAL     ] MG: Starting deletion of derivative data.
[2025-10-24T19:52:42.329348] [DEBUG] [LOCAL     ] MG: Deleted derivative data file.
[2025-10-24T19:52:42.329461] [INFO ] [MAIN      ] Update Progress: 1342/2366 symbols completed. MG took 36.2s. Estimated remaining: 2h 11m 45s. Rate: 7.8 symbols/min
[2025-10-24T19:52:42.524012] [INFO ] [MAIN      ] MGRD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:52:42.529016] [DEBUG] [LOCAL     ] MGRD: Loaded 2213 existing records from primary storage.
[2025-10-24T19:52:42.529203] [INFO ] [MAIN      ] MGRD: Loaded 2213 existing records.
[2025-10-24T19:52:42.552866] [INFO ] [REMOTE    ] MGRB: Fetching primary data for 2025-04.
[2025-10-24T19:52:42.726637] [WARN ] [MAIN      ] MGRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:52:42.726899] [INFO ] [MAIN      ] MGRD: Wiping existing primary data before full refresh.
[2025-10-24T19:52:42.726962] [INFO ] [LOCAL     ] MGRD: Starting deletion of primary data.
[2025-10-24T19:52:42.727138] [DEBUG] [LOCAL     ] MGRD: Deleted primary data file.
[2025-10-24T19:52:42.727197] [INFO ] [MAIN      ] MGRD: Starting full primary refresh.
[2025-10-24T19:52:43.138058] [INFO ] [REMOTE    ] MGRD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:52:43.286752] [INFO ] [REMOTE    ] MGRB: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T19:52:43.347626] [INFO ] [REMOTE    ] MGRB: Fetching primary data for 2025-05.
[2025-10-24T19:52:43.953346] [INFO ] [REMOTE    ] MGRB: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T19:52:44.147698] [INFO ] [REMOTE    ] MGM: Fetching primary data for 2025-04.
[2025-10-24T19:52:44.947639] [INFO ] [REMOTE    ] MGRD: Fetching primary data for 2025-01.
[2025-10-24T19:52:45.419528] [INFO ] [REMOTE    ] MGRD: Incremental fetch complete for 2025-01 (0.47 seconds).
[2025-10-24T19:52:45.747735] [INFO ] [REMOTE    ] MGRB: Fetching primary data for 2025-06.
[2025-10-24T19:52:45.840190] [INFO ] [REMOTE    ] MGM: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T19:52:46.296352] [INFO ] [REMOTE    ] MGRB: Incremental fetch complete for 2025-06 (0.55 seconds).
[2025-10-24T19:52:46.547726] [INFO ] [REMOTE    ] MGRB: Fetching primary data for 2025-07.
[2025-10-24T19:52:47.088667] [INFO ] [REMOTE    ] MGRB: Incremental fetch complete for 2025-07 (0.54 seconds).
[2025-10-24T19:52:47.347752] [INFO ] [REMOTE    ] MGM: Fetching primary data for 2025-05.
[2025-10-24T19:52:48.147687] [INFO ] [REMOTE    ] MGA: Fetching primary data for 2025-08.
[2025-10-24T19:52:48.947633] [INFO ] [REMOTE    ] MGRD: Fetching primary data for 2025-02.
[2025-10-24T19:52:49.405236] [INFO ] [REMOTE    ] MGM: Incremental fetch complete for 2025-05 (2.06 seconds).
[2025-10-24T19:52:49.661909] [INFO ] [REMOTE    ] MGRD: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T19:52:49.747713] [INFO ] [REMOTE    ] MGM: Fetching primary data for 2025-06.
[2025-10-24T19:52:50.257556] [INFO ] [REMOTE    ] MGA: Incremental fetch complete for 2025-08 (2.11 seconds).
[2025-10-24T19:52:50.547734] [INFO ] [REMOTE    ] MGRD: Fetching primary data for 2025-03.
[2025-10-24T19:52:50.954580] [INFO ] [REMOTE    ] MGRD: Incremental fetch complete for 2025-03 (0.41 seconds).
[2025-10-24T19:52:51.352137] [INFO ] [REMOTE    ] MGA: Fetching primary data for 2025-09.
[2025-10-24T19:52:51.357801] [INFO ] [REMOTE    ] MGM: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T19:52:52.147743] [INFO ] [REMOTE    ] MGRD: Fetching primary data for 2025-04.
[2025-10-24T19:52:52.620265] [INFO ] [REMOTE    ] MGRD: Incremental fetch complete for 2025-04 (0.47 seconds).
[2025-10-24T19:52:52.947623] [INFO ] [REMOTE    ] MGRD: Fetching primary data for 2025-05.
[2025-10-24T19:52:53.027050] [INFO ] [REMOTE    ] MGA: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T19:52:53.226314] [INFO ] [REMOTE    ] MGRD: Incremental fetch complete for 2025-05 (0.28 seconds).
[2025-10-24T19:52:53.747685] [INFO ] [REMOTE    ] MGRB: Fetching primary data for 2025-08.
[2025-10-24T19:52:54.488326] [INFO ] [REMOTE    ] MGRB: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T19:52:54.547723] [INFO ] [REMOTE    ] MGRD: Fetching primary data for 2025-06.
[2025-10-24T19:52:54.981156] [INFO ] [REMOTE    ] MGRD: Incremental fetch complete for 2025-06 (0.43 seconds).
[2025-10-24T19:52:55.347740] [INFO ] [REMOTE    ] MGRB: Fetching primary data for 2025-09.
[2025-10-24T19:52:55.830151] [INFO ] [REMOTE    ] MGRB: Incremental fetch complete for 2025-09 (0.48 seconds).
[2025-10-24T19:52:56.147686] [INFO ] [REMOTE    ] MGA: Fetching primary data for 2025-10.
[2025-10-24T19:52:56.947671] [INFO ] [REMOTE    ] MGRB: Fetching primary data for 2025-10.
[2025-10-24T19:52:57.565664] [INFO ] [REMOTE    ] MGRB: Incremental fetch complete for 2025-10 (0.62 seconds).
[2025-10-24T19:52:57.566598] [INFO ] [REMOTE    ] MGRB: Full fetch complete (5495 records).
[2025-10-24T19:52:57.566699] [DEBUG] [VALIDATOR ] MGRB: Validating primary data.
[2025-10-24T19:52:57.759242] [INFO ] [REMOTE    ] MGM: Fetching primary data for 2025-07.
[2025-10-24T19:52:57.938893] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present.
[2025-10-24T19:52:57.939067] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed.
[2025-10-24T19:52:57.939266] [INFO ] [MAIN      ] MGRB: Fetched primary data is valid.
[2025-10-24T19:52:57.939335] [DEBUG] [LOCAL     ] MGRB: Saving primary data.
[2025-10-24T19:52:57.939547] [FATAL] [LOCAL     ] MGRB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:52:57.939741] [FATAL] [MAIN      ] MGRB: Failed to save primary data.
[2025-10-24T19:52:57.939842] [WARN ] [MAIN      ] MGRB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:52:57.939997] [INFO ] [LOCAL     ] MGRB: Starting deletion of primary data.
[2025-10-24T19:52:57.940063] [DEBUG] [LOCAL     ] MGRB: No primary data file found to delete.
[2025-10-24T19:52:57.948094] [INFO ] [LOCAL     ] MGRB: Starting deletion of derivative data.
[2025-10-24T19:52:57.961857] [DEBUG] [LOCAL     ] MGRB: Deleted derivative data file.
[2025-10-24T19:52:57.963020] [INFO ] [REMOTE    ] MGA: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T19:52:57.962287] [INFO ] [MAIN      ] Update Progress: 1343/2366 symbols completed. MGRB took 21.7s. Estimated remaining: 2h 11m 43s. Rate: 7.8 symbols/min
[2025-10-24T19:52:58.048176] [INFO ] [REMOTE    ] MGA: Full fetch complete (73687 records).
[2025-10-24T19:52:58.065350] [DEBUG] [VALIDATOR ] MGA: Validating primary data.
[2025-10-24T19:52:58.251412] [INFO ] [MAIN      ] MGRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:52:58.350578] [DEBUG] [LOCAL     ] MGRE: Loaded 6452 existing records from primary storage.
[2025-10-24T19:52:58.402039] [INFO ] [MAIN      ] MGRE: Loaded 6452 existing records.
[2025-10-24T19:52:58.554429] [INFO ] [REMOTE    ] MGRD: Fetching primary data for 2025-07.
[2025-10-24T19:52:58.715586] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present.
[2025-10-24T19:52:58.716017] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed.
[2025-10-24T19:52:58.732498] [INFO ] [MAIN      ] MGA: Fetched primary data is valid.
[2025-10-24T19:52:58.739423] [DEBUG] [LOCAL     ] MGA: Saving primary data.
[2025-10-24T19:52:58.739315] [WARN ] [MAIN      ] MGRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:52:58.739840] [INFO ] [MAIN      ] MGRE: Wiping existing primary data before full refresh.
[2025-10-24T19:52:58.739930] [INFO ] [LOCAL     ] MGRE: Starting deletion of primary data.
[2025-10-24T19:52:58.740208] [DEBUG] [LOCAL     ] MGRE: Deleted primary data file.
[2025-10-24T19:52:58.740301] [INFO ] [MAIN      ] MGRE: Starting full primary refresh.
[2025-10-24T19:52:58.740156] [FATAL] [LOCAL     ] MGA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:52:58.783962] [FATAL] [MAIN      ] MGA: Failed to save primary data.
[2025-10-24T19:52:58.811063] [WARN ] [MAIN      ] MGA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:52:58.821959] [INFO ] [LOCAL     ] MGA: Starting deletion of primary data.
[2025-10-24T19:52:58.842722] [DEBUG] [LOCAL     ] MGA: No primary data file found to delete.
[2025-10-24T19:52:58.844918] [INFO ] [LOCAL     ] MGA: Starting deletion of derivative data.
[2025-10-24T19:52:58.845227] [DEBUG] [LOCAL     ] MGA: Deleted derivative data file.
[2025-10-24T19:52:58.856514] [INFO ] [MAIN      ] Update Progress: 1344/2366 symbols completed. MGA took 51.8s. Estimated remaining: 2h 11m 30s. Rate: 7.8 symbols/min
[2025-10-24T19:52:59.220770] [INFO ] [MAIN      ] MGY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:52:59.289833] [INFO ] [REMOTE    ] MGRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:52:59.293454] [INFO ] [REMOTE    ] MGRD: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T19:52:59.340539] [DEBUG] [LOCAL     ] MGY: Loaded 52808 existing records from primary storage.
[2025-10-24T19:52:59.340910] [INFO ] [MAIN      ] MGY: Loaded 52808 existing records.
[2025-10-24T19:52:59.353628] [INFO ] [REMOTE    ] MGRE: Fetching primary data for 2025-01.
[2025-10-24T19:52:59.519016] [WARN ] [MAIN      ] MGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:52:59.519214] [INFO ] [MAIN      ] MGY: Wiping existing primary data before full refresh.
[2025-10-24T19:52:59.519259] [INFO ] [LOCAL     ] MGY: Starting deletion of primary data.
[2025-10-24T19:52:59.519613] [DEBUG] [LOCAL     ] MGY: Deleted primary data file.
[2025-10-24T19:52:59.519705] [INFO ] [MAIN      ] MGY: Starting full primary refresh.
[2025-10-24T19:52:59.872170] [INFO ] [REMOTE    ] MGY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:53:00.147624] [INFO ] [REMOTE    ] MGY: Fetching primary data for 2025-01.
[2025-10-24T19:53:00.270061] [INFO ] [REMOTE    ] MGRE: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T19:53:00.334562] [INFO ] [REMOTE    ] MGM: Incremental fetch complete for 2025-07 (2.58 seconds).
[2025-10-24T19:53:00.947680] [INFO ] [REMOTE    ] MGM: Fetching primary data for 2025-08.
[2025-10-24T19:53:01.747674] [INFO ] [REMOTE    ] MGRE: Fetching primary data for 2025-02.
[2025-10-24T19:53:01.819751] [INFO ] [REMOTE    ] MGY: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T19:53:02.441365] [INFO ] [REMOTE    ] MGRE: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T19:53:02.547692] [INFO ] [REMOTE    ] MGRE: Fetching primary data for 2025-03.
[2025-10-24T19:53:02.674436] [INFO ] [REMOTE    ] MGM: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T19:53:03.204221] [INFO ] [REMOTE    ] MGRE: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T19:53:03.347721] [INFO ] [REMOTE    ] MGRD: Fetching primary data for 2025-08.
[2025-10-24T19:53:03.838699] [INFO ] [REMOTE    ] MGRD: Incremental fetch complete for 2025-08 (0.49 seconds).
[2025-10-24T19:53:04.147694] [INFO ] [REMOTE    ] MGY: Fetching primary data for 2025-02.
[2025-10-24T19:53:04.947764] [INFO ] [REMOTE    ] MGRD: Fetching primary data for 2025-09.
[2025-10-24T19:53:05.747687] [INFO ] [REMOTE    ] MGRE: Fetching primary data for 2025-04.
[2025-10-24T19:53:05.779294] [INFO ] [REMOTE    ] MGRD: Incremental fetch complete for 2025-09 (0.83 seconds).
[2025-10-24T19:53:06.136690] [INFO ] [REMOTE    ] MGY: Incremental fetch complete for 2025-02 (1.99 seconds).
[2025-10-24T19:53:06.320389] [INFO ] [REMOTE    ] MGRE: Incremental fetch complete for 2025-04 (0.57 seconds).
[2025-10-24T19:53:06.547694] [INFO ] [REMOTE    ] MGRE: Fetching primary data for 2025-05.
[2025-10-24T19:53:07.227606] [INFO ] [REMOTE    ] MGRE: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T19:53:07.347638] [INFO ] [REMOTE    ] MGM: Fetching primary data for 2025-09.
[2025-10-24T19:53:08.147735] [INFO ] [REMOTE    ] MGRE: Fetching primary data for 2025-06.
[2025-10-24T19:53:08.680830] [INFO ] [REMOTE    ] MGM: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T19:53:08.772172] [INFO ] [REMOTE    ] MGRE: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T19:53:08.947619] [INFO ] [REMOTE    ] MGRE: Fetching primary data for 2025-07.
[2025-10-24T19:53:09.539014] [INFO ] [REMOTE    ] MGRE: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T19:53:09.747700] [INFO ] [REMOTE    ] MGM: Fetching primary data for 2025-10.
[2025-10-24T19:53:10.547676] [INFO ] [REMOTE    ] MGRD: Fetching primary data for 2025-10.
[2025-10-24T19:53:11.025402] [INFO ] [REMOTE    ] MGRD: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T19:53:11.026332] [INFO ] [REMOTE    ] MGRD: Full fetch complete (3285 records).
[2025-10-24T19:53:11.026400] [DEBUG] [VALIDATOR ] MGRD: Validating primary data.
[2025-10-24T19:53:11.352417] [INFO ] [REMOTE    ] MGY: Fetching primary data for 2025-03.
[2025-10-24T19:53:11.387443] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present.
[2025-10-24T19:53:11.387545] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed.
[2025-10-24T19:53:11.387761] [INFO ] [MAIN      ] MGRD: Fetched primary data is valid.
[2025-10-24T19:53:11.387843] [DEBUG] [LOCAL     ] MGRD: Saving primary data.
[2025-10-24T19:53:11.388090] [FATAL] [LOCAL     ] MGRD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:53:11.388188] [FATAL] [MAIN      ] MGRD: Failed to save primary data.
[2025-10-24T19:53:11.388250] [WARN ] [MAIN      ] MGRD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:53:11.388336] [INFO ] [LOCAL     ] MGRD: Starting deletion of primary data.
[2025-10-24T19:53:11.388409] [DEBUG] [LOCAL     ] MGRD: No primary data file found to delete.
[2025-10-24T19:53:11.388458] [INFO ] [LOCAL     ] MGRD: Starting deletion of derivative data.
[2025-10-24T19:53:11.388625] [DEBUG] [LOCAL     ] MGRD: Deleted derivative data file.
[2025-10-24T19:53:11.388793] [INFO ] [MAIN      ] Update Progress: 1345/2366 symbols completed. MGRD took 29.1s. Estimated remaining: 2h 11m 26s. Rate: 7.8 symbols/min
[2025-10-24T19:53:11.575532] [INFO ] [MAIN      ] MH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:53:11.575750] [DEBUG] [LOCAL     ] MH: No existing data file found in primary storage.
[2025-10-24T19:53:11.575798] [WARN ] [MAIN      ] MH: No existing data found, performing full refresh instead.
[2025-10-24T19:53:11.575915] [INFO ] [MAIN      ] MH: Wiping existing primary data before full refresh.
[2025-10-24T19:53:11.575958] [INFO ] [LOCAL     ] MH: Starting deletion of primary data.
[2025-10-24T19:53:11.576003] [DEBUG] [LOCAL     ] MH: No primary data file found to delete.
[2025-10-24T19:53:11.576058] [INFO ] [MAIN      ] MH: Starting full primary refresh.
[2025-10-24T19:53:11.940076] [INFO ] [REMOTE    ] MH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:53:11.965510] [INFO ] [REMOTE    ] MGM: Incremental fetch complete for 2025-10 (2.22 seconds).
[2025-10-24T19:53:11.975224] [INFO ] [REMOTE    ] MGM: Full fetch complete (77758 records).
[2025-10-24T19:53:11.975347] [DEBUG] [VALIDATOR ] MGM: Validating primary data.
[2025-10-24T19:53:12.151388] [INFO ] [REMOTE    ] MGRE: Fetching primary data for 2025-08.
[2025-10-24T19:53:12.368620] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present.
[2025-10-24T19:53:12.368730] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed.
[2025-10-24T19:53:12.369946] [INFO ] [MAIN      ] MGM: Fetched primary data is valid.
[2025-10-24T19:53:12.370031] [DEBUG] [LOCAL     ] MGM: Saving primary data.
[2025-10-24T19:53:12.370683] [FATAL] [LOCAL     ] MGM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:53:12.370766] [FATAL] [MAIN      ] MGM: Failed to save primary data.
[2025-10-24T19:53:12.370803] [WARN ] [MAIN      ] MGM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:53:12.370835] [INFO ] [LOCAL     ] MGM: Starting deletion of primary data.
[2025-10-24T19:53:12.370886] [DEBUG] [LOCAL     ] MGM: No primary data file found to delete.
[2025-10-24T19:53:12.370920] [INFO ] [LOCAL     ] MGM: Starting deletion of derivative data.
[2025-10-24T19:53:12.371065] [DEBUG] [LOCAL     ] MGM: Deleted derivative data file.
[2025-10-24T19:53:12.371447] [INFO ] [MAIN      ] Update Progress: 1346/2366 symbols completed. MGM took 47.4s. Estimated remaining: 2h 11m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:53:12.541045] [INFO ] [MAIN      ] MHD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:53:12.555551] [DEBUG] [LOCAL     ] MHD: Loaded 11963 existing records from primary storage.
[2025-10-24T19:53:12.555807] [INFO ] [MAIN      ] MHD: Loaded 11963 existing records.
[2025-10-24T19:53:12.734770] [WARN ] [MAIN      ] MHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:53:12.735015] [INFO ] [MAIN      ] MHD: Wiping existing primary data before full refresh.
[2025-10-24T19:53:12.735076] [INFO ] [LOCAL     ] MHD: Starting deletion of primary data.
[2025-10-24T19:53:12.735296] [DEBUG] [LOCAL     ] MHD: Deleted primary data file.
[2025-10-24T19:53:12.735350] [INFO ] [MAIN      ] MHD: Starting full primary refresh.
[2025-10-24T19:53:12.948148] [INFO ] [REMOTE    ] MH: Fetching primary data for 2025-01.
[2025-10-24T19:53:13.105524] [INFO ] [REMOTE    ] MHD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:53:13.106729] [INFO ] [REMOTE    ] MGRE: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T19:53:13.139936] [INFO ] [REMOTE    ] MGY: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T19:53:13.214086] [DEBUG] [REMOTE    ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:53:13.214391] [WARN ] [REMOTE    ] MH: No data returned for month 2025-01
[2025-10-24T19:53:13.214486] [FATAL] [REMOTE    ] MH: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:53:13.214532] [FATAL] [MAIN      ] MH: Failed to fetch primary data.
[2025-10-24T19:53:13.214592] [WARN ] [MAIN      ] MH: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:53:13.214686] [INFO ] [LOCAL     ] MH: Starting deletion of primary data.
[2025-10-24T19:53:13.214759] [DEBUG] [LOCAL     ] MH: No primary data file found to delete.
[2025-10-24T19:53:13.214794] [INFO ] [LOCAL     ] MH: Starting deletion of derivative data.
[2025-10-24T19:53:13.214834] [DEBUG] [LOCAL     ] MH: No derivative data file found to delete.
[2025-10-24T19:53:13.214880] [INFO ] [MAIN      ] Update Progress: 1347/2366 symbols completed. MH took 1.8s. Estimated remaining: 2h 11m 0s. Rate: 7.8 symbols/min
[2025-10-24T19:53:13.385752] [INFO ] [MAIN      ] MHF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:53:13.397674] [DEBUG] [LOCAL     ] MHF: Loaded 9083 existing records from primary storage.
[2025-10-24T19:53:13.397909] [INFO ] [MAIN      ] MHF: Loaded 9083 existing records.
[2025-10-24T19:53:13.572381] [WARN ] [MAIN      ] MHF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:53:13.572560] [INFO ] [MAIN      ] MHF: Wiping existing primary data before full refresh.
[2025-10-24T19:53:13.572605] [INFO ] [LOCAL     ] MHF: Starting deletion of primary data.
[2025-10-24T19:53:13.572873] [DEBUG] [LOCAL     ] MHF: Deleted primary data file.
[2025-10-24T19:53:13.572925] [INFO ] [MAIN      ] MHF: Starting full primary refresh.
[2025-10-24T19:53:13.757973] [INFO ] [REMOTE    ] MGY: Fetching primary data for 2025-04.
[2025-10-24T19:53:13.926780] [INFO ] [REMOTE    ] MHF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:53:14.547705] [INFO ] [REMOTE    ] MGRE: Fetching primary data for 2025-09.
[2025-10-24T19:53:15.252195] [INFO ] [REMOTE    ] MGRE: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T19:53:15.347704] [INFO ] [REMOTE    ] MGRE: Fetching primary data for 2025-10.
[2025-10-24T19:53:15.452822] [INFO ] [REMOTE    ] MGY: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T19:53:16.083919] [INFO ] [REMOTE    ] MGRE: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T19:53:16.085328] [INFO ] [REMOTE    ] MGRE: Full fetch complete (9156 records).
[2025-10-24T19:53:16.085395] [DEBUG] [VALIDATOR ] MGRE: Validating primary data.
[2025-10-24T19:53:16.152737] [INFO ] [REMOTE    ] MHD: Fetching primary data for 2025-01.
[2025-10-24T19:53:16.441827] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present.
[2025-10-24T19:53:16.441909] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed.
[2025-10-24T19:53:16.442131] [INFO ] [MAIN      ] MGRE: Fetched primary data is valid.
[2025-10-24T19:53:16.442169] [DEBUG] [LOCAL     ] MGRE: Saving primary data.
[2025-10-24T19:53:16.442377] [FATAL] [LOCAL     ] MGRE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:53:16.442457] [FATAL] [MAIN      ] MGRE: Failed to save primary data.
[2025-10-24T19:53:16.442498] [WARN ] [MAIN      ] MGRE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:53:16.442539] [INFO ] [LOCAL     ] MGRE: Starting deletion of primary data.
[2025-10-24T19:53:16.442588] [DEBUG] [LOCAL     ] MGRE: No primary data file found to delete.
[2025-10-24T19:53:16.442622] [INFO ] [LOCAL     ] MGRE: Starting deletion of derivative data.
[2025-10-24T19:53:16.442803] [DEBUG] [LOCAL     ] MGRE: Deleted derivative data file.
[2025-10-24T19:53:16.442891] [INFO ] [MAIN      ] Update Progress: 1348/2366 symbols completed. MGRE took 18.5s. Estimated remaining: 2h 10m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:53:16.611413] [INFO ] [MAIN      ] MHK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:53:16.653698] [DEBUG] [LOCAL     ] MHK: Loaded 42331 existing records from primary storage.
[2025-10-24T19:53:16.653984] [INFO ] [MAIN      ] MHK: Loaded 42331 existing records.
[2025-10-24T19:53:16.828186] [WARN ] [MAIN      ] MHK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:53:16.828390] [INFO ] [MAIN      ] MHK: Wiping existing primary data before full refresh.
[2025-10-24T19:53:16.828436] [INFO ] [LOCAL     ] MHK: Starting deletion of primary data.
[2025-10-24T19:53:16.828669] [DEBUG] [LOCAL     ] MHK: Deleted primary data file.
[2025-10-24T19:53:16.828729] [INFO ] [MAIN      ] MHK: Starting full primary refresh.
[2025-10-24T19:53:16.952774] [INFO ] [REMOTE    ] MGY: Fetching primary data for 2025-05.
[2025-10-24T19:53:17.155458] [INFO ] [REMOTE    ] MHD: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T19:53:17.199555] [INFO ] [REMOTE    ] MHK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:53:17.747791] [INFO ] [REMOTE    ] MHK: Fetching primary data for 2025-01.
[2025-10-24T19:53:18.547671] [INFO ] [REMOTE    ] MHD: Fetching primary data for 2025-02.
[2025-10-24T19:53:18.697201] [INFO ] [REMOTE    ] MGY: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T19:53:19.198498] [INFO ] [REMOTE    ] MHK: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T19:53:19.247396] [INFO ] [REMOTE    ] MHD: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T19:53:19.347619] [INFO ] [REMOTE    ] MHK: Fetching primary data for 2025-02.
[2025-10-24T19:53:20.147713] [INFO ] [REMOTE    ] MGY: Fetching primary data for 2025-06.
[2025-10-24T19:53:20.760276] [INFO ] [REMOTE    ] MHK: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T19:53:20.947708] [INFO ] [REMOTE    ] MHD: Fetching primary data for 2025-03.
[2025-10-24T19:53:21.717713] [INFO ] [REMOTE    ] MGY: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T19:53:21.747625] [INFO ] [REMOTE    ] MHK: Fetching primary data for 2025-03.
[2025-10-24T19:53:21.825920] [INFO ] [REMOTE    ] MHD: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T19:53:22.547756] [INFO ] [REMOTE    ] MGY: Fetching primary data for 2025-07.
[2025-10-24T19:53:23.178795] [INFO ] [REMOTE    ] MHK: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T19:53:23.347629] [INFO ] [REMOTE    ] MHK: Fetching primary data for 2025-04.
[2025-10-24T19:53:24.147629] [INFO ] [REMOTE    ] MHF: Fetching primary data for 2025-01.
[2025-10-24T19:53:24.184596] [INFO ] [REMOTE    ] MGY: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T19:53:24.909128] [INFO ] [REMOTE    ] MHK: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T19:53:24.938293] [INFO ] [REMOTE    ] MHF: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T19:53:24.947596] [INFO ] [REMOTE    ] MHK: Fetching primary data for 2025-05.
[2025-10-24T19:53:25.747633] [INFO ] [REMOTE    ] MHF: Fetching primary data for 2025-02.
[2025-10-24T19:53:26.399573] [INFO ] [REMOTE    ] MHK: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T19:53:26.469896] [INFO ] [REMOTE    ] MHF: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T19:53:26.547735] [INFO ] [REMOTE    ] MGY: Fetching primary data for 2025-08.
[2025-10-24T19:53:27.347693] [INFO ] [REMOTE    ] MHF: Fetching primary data for 2025-03.
[2025-10-24T19:53:28.065097] [INFO ] [REMOTE    ] MHF: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T19:53:28.147617] [INFO ] [REMOTE    ] MHD: Fetching primary data for 2025-04.
[2025-10-24T19:53:28.194600] [INFO ] [REMOTE    ] MGY: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T19:53:28.947679] [INFO ] [REMOTE    ] MHK: Fetching primary data for 2025-06.
[2025-10-24T19:53:29.090242] [INFO ] [REMOTE    ] MHD: Incremental fetch complete for 2025-04 (0.94 seconds).
[2025-10-24T19:53:29.747684] [INFO ] [REMOTE    ] MHD: Fetching primary data for 2025-05.
[2025-10-24T19:53:30.373035] [INFO ] [REMOTE    ] MHK: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T19:53:30.518252] [INFO ] [REMOTE    ] MHD: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T19:53:30.547603] [INFO ] [REMOTE    ] MHD: Fetching primary data for 2025-06.
[2025-10-24T19:53:31.347735] [INFO ] [REMOTE    ] MHK: Fetching primary data for 2025-07.
[2025-10-24T19:53:31.455494] [INFO ] [REMOTE    ] MHD: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T19:53:32.147709] [INFO ] [REMOTE    ] MGY: Fetching primary data for 2025-09.
[2025-10-24T19:53:32.700090] [INFO ] [REMOTE    ] MHK: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T19:53:32.947726] [INFO ] [REMOTE    ] MHD: Fetching primary data for 2025-07.
[2025-10-24T19:53:33.702498] [INFO ] [REMOTE    ] MGY: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T19:53:33.747608] [INFO ] [REMOTE    ] MHF: Fetching primary data for 2025-04.
[2025-10-24T19:53:33.757045] [INFO ] [REMOTE    ] MHD: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T19:53:34.546477] [INFO ] [REMOTE    ] MHF: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T19:53:34.548715] [INFO ] [REMOTE    ] MGY: Fetching primary data for 2025-10.
[2025-10-24T19:53:35.347692] [INFO ] [REMOTE    ] MHD: Fetching primary data for 2025-08.
[2025-10-24T19:53:36.147622] [INFO ] [REMOTE    ] MHF: Fetching primary data for 2025-05.
[2025-10-24T19:53:36.225427] [INFO ] [REMOTE    ] MGY: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T19:53:36.235435] [INFO ] [REMOTE    ] MGY: Full fetch complete (75969 records).
[2025-10-24T19:53:36.235576] [DEBUG] [VALIDATOR ] MGY: Validating primary data.
[2025-10-24T19:53:36.363734] [INFO ] [REMOTE    ] MHD: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T19:53:36.660417] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present.
[2025-10-24T19:53:36.660500] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed.
[2025-10-24T19:53:36.661595] [INFO ] [MAIN      ] MGY: Fetched primary data is valid.
[2025-10-24T19:53:36.661682] [DEBUG] [LOCAL     ] MGY: Saving primary data.
[2025-10-24T19:53:36.662288] [FATAL] [LOCAL     ] MGY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:53:36.662372] [FATAL] [MAIN      ] MGY: Failed to save primary data.
[2025-10-24T19:53:36.662415] [WARN ] [MAIN      ] MGY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:53:36.662449] [INFO ] [LOCAL     ] MGY: Starting deletion of primary data.
[2025-10-24T19:53:36.662501] [DEBUG] [LOCAL     ] MGY: No primary data file found to delete.
[2025-10-24T19:53:36.662536] [INFO ] [LOCAL     ] MGY: Starting deletion of derivative data.
[2025-10-24T19:53:36.662722] [DEBUG] [LOCAL     ] MGY: Deleted derivative data file.
[2025-10-24T19:53:36.663082] [INFO ] [MAIN      ] Update Progress: 1349/2366 symbols completed. MGY took 37.8s. Estimated remaining: 2h 10m 51s. Rate: 7.8 symbols/min
[2025-10-24T19:53:36.781106] [INFO ] [REMOTE    ] MHF: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T19:53:36.878335] [INFO ] [MAIN      ] MHLA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:53:36.878559] [DEBUG] [LOCAL     ] MHLA: No existing data file found in primary storage.
[2025-10-24T19:53:36.878624] [WARN ] [MAIN      ] MHLA: No existing data found, performing full refresh instead.
[2025-10-24T19:53:36.878793] [INFO ] [MAIN      ] MHLA: Wiping existing primary data before full refresh.
[2025-10-24T19:53:36.878862] [INFO ] [LOCAL     ] MHLA: Starting deletion of primary data.
[2025-10-24T19:53:36.878955] [DEBUG] [LOCAL     ] MHLA: No primary data file found to delete.
[2025-10-24T19:53:36.879024] [INFO ] [MAIN      ] MHLA: Starting full primary refresh.
[2025-10-24T19:53:36.952916] [INFO ] [REMOTE    ] MHD: Fetching primary data for 2025-09.
[2025-10-24T19:53:37.243037] [INFO ] [REMOTE    ] MHLA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:53:37.747707] [INFO ] [REMOTE    ] MHLA: Fetching primary data for 2025-01.
[2025-10-24T19:53:37.899088] [INFO ] [REMOTE    ] MHD: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T19:53:38.067792] [INFO ] [REMOTE    ] MHLA: Incremental fetch complete for 2025-01 (0.32 seconds).
[2025-10-24T19:53:38.547715] [INFO ] [REMOTE    ] MHK: Fetching primary data for 2025-08.
[2025-10-24T19:53:39.347681] [INFO ] [REMOTE    ] MHD: Fetching primary data for 2025-10.
[2025-10-24T19:53:40.123019] [INFO ] [REMOTE    ] MHK: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T19:53:40.147620] [INFO ] [REMOTE    ] MHK: Fetching primary data for 2025-09.
[2025-10-24T19:53:40.177892] [INFO ] [REMOTE    ] MHD: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T19:53:40.180260] [INFO ] [REMOTE    ] MHD: Full fetch complete (17974 records).
[2025-10-24T19:53:40.180336] [DEBUG] [VALIDATOR ] MHD: Validating primary data.
[2025-10-24T19:53:40.538976] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present.
[2025-10-24T19:53:40.539052] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed.
[2025-10-24T19:53:40.539434] [INFO ] [MAIN      ] MHD: Fetched primary data is valid.
[2025-10-24T19:53:40.539472] [DEBUG] [LOCAL     ] MHD: Saving primary data.
[2025-10-24T19:53:40.539741] [FATAL] [LOCAL     ] MHD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:53:40.539827] [FATAL] [MAIN      ] MHD: Failed to save primary data.
[2025-10-24T19:53:40.539887] [WARN ] [MAIN      ] MHD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:53:40.539948] [INFO ] [LOCAL     ] MHD: Starting deletion of primary data.
[2025-10-24T19:53:40.540030] [DEBUG] [LOCAL     ] MHD: No primary data file found to delete.
[2025-10-24T19:53:40.540084] [INFO ] [LOCAL     ] MHD: Starting deletion of derivative data.
[2025-10-24T19:53:40.540210] [DEBUG] [LOCAL     ] MHD: Deleted derivative data file.
[2025-10-24T19:53:40.540279] [INFO ] [MAIN      ] Update Progress: 1350/2366 symbols completed. MHD took 28.2s. Estimated remaining: 2h 10m 40s. Rate: 7.8 symbols/min
[2025-10-24T19:53:40.704422] [INFO ] [MAIN      ] MHN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:53:40.715022] [DEBUG] [LOCAL     ] MHN: Loaded 7408 existing records from primary storage.
[2025-10-24T19:53:40.715236] [INFO ] [MAIN      ] MHN: Loaded 7408 existing records.
[2025-10-24T19:53:40.888190] [WARN ] [MAIN      ] MHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:53:40.888426] [INFO ] [MAIN      ] MHN: Wiping existing primary data before full refresh.
[2025-10-24T19:53:40.888509] [INFO ] [LOCAL     ] MHN: Starting deletion of primary data.
[2025-10-24T19:53:40.888869] [DEBUG] [LOCAL     ] MHN: Deleted primary data file.
[2025-10-24T19:53:40.888927] [INFO ] [MAIN      ] MHN: Starting full primary refresh.
[2025-10-24T19:53:40.953748] [INFO ] [REMOTE    ] MHF: Fetching primary data for 2025-06.
[2025-10-24T19:53:41.254319] [INFO ] [REMOTE    ] MHN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:53:41.585613] [INFO ] [REMOTE    ] MHK: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T19:53:41.606681] [INFO ] [REMOTE    ] MHF: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T19:53:41.747711] [INFO ] [REMOTE    ] MHK: Fetching primary data for 2025-10.
[2025-10-24T19:53:42.547708] [INFO ] [REMOTE    ] MHN: Fetching primary data for 2025-01.
[2025-10-24T19:53:43.280781] [INFO ] [REMOTE    ] MHK: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T19:53:43.288842] [INFO ] [REMOTE    ] MHK: Full fetch complete (61451 records).
[2025-10-24T19:53:43.288968] [DEBUG] [VALIDATOR ] MHK: Validating primary data.
[2025-10-24T19:53:43.352811] [INFO ] [REMOTE    ] MHLA: Fetching primary data for 2025-02.
[2025-10-24T19:53:43.590224] [INFO ] [REMOTE    ] MHN: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T19:53:43.685938] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present.
[2025-10-24T19:53:43.686011] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed.
[2025-10-24T19:53:43.686975] [INFO ] [MAIN      ] MHK: Fetched primary data is valid.
[2025-10-24T19:53:43.687035] [DEBUG] [LOCAL     ] MHK: Saving primary data.
[2025-10-24T19:53:43.687520] [FATAL] [LOCAL     ] MHK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:53:43.687605] [FATAL] [MAIN      ] MHK: Failed to save primary data.
[2025-10-24T19:53:43.687694] [WARN ] [MAIN      ] MHK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:53:43.687758] [INFO ] [LOCAL     ] MHK: Starting deletion of primary data.
[2025-10-24T19:53:43.687823] [DEBUG] [LOCAL     ] MHK: No primary data file found to delete.
[2025-10-24T19:53:43.687888] [INFO ] [LOCAL     ] MHK: Starting deletion of derivative data.
[2025-10-24T19:53:43.688047] [DEBUG] [LOCAL     ] MHK: Deleted derivative data file.
[2025-10-24T19:53:43.688312] [INFO ] [MAIN      ] Update Progress: 1351/2366 symbols completed. MHK took 27.2s. Estimated remaining: 2h 10m 29s. Rate: 7.8 symbols/min
[2025-10-24T19:53:43.769930] [INFO ] [REMOTE    ] MHLA: Incremental fetch complete for 2025-02 (0.42 seconds).
[2025-10-24T19:53:43.858537] [INFO ] [MAIN      ] MHO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:53:43.882947] [DEBUG] [LOCAL     ] MHO: Loaded 23852 existing records from primary storage.
[2025-10-24T19:53:43.883191] [INFO ] [MAIN      ] MHO: Loaded 23852 existing records.
[2025-10-24T19:53:44.057981] [WARN ] [MAIN      ] MHO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:53:44.058179] [INFO ] [MAIN      ] MHO: Wiping existing primary data before full refresh.
[2025-10-24T19:53:44.058225] [INFO ] [LOCAL     ] MHO: Starting deletion of primary data.
[2025-10-24T19:53:44.058420] [DEBUG] [LOCAL     ] MHO: Deleted primary data file.
[2025-10-24T19:53:44.058458] [INFO ] [MAIN      ] MHO: Starting full primary refresh.
[2025-10-24T19:53:44.154203] [INFO ] [REMOTE    ] MHLA: Fetching primary data for 2025-03.
[2025-10-24T19:53:44.413983] [INFO ] [REMOTE    ] MHO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:53:44.541765] [INFO ] [REMOTE    ] MHLA: Incremental fetch complete for 2025-03 (0.39 seconds).
[2025-10-24T19:53:44.947638] [INFO ] [REMOTE    ] MHLA: Fetching primary data for 2025-04.
[2025-10-24T19:53:45.354043] [INFO ] [REMOTE    ] MHLA: Incremental fetch complete for 2025-04 (0.41 seconds).
[2025-10-24T19:53:45.747711] [INFO ] [REMOTE    ] MHF: Fetching primary data for 2025-07.
[2025-10-24T19:53:46.429877] [INFO ] [REMOTE    ] MHF: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T19:53:46.547708] [INFO ] [REMOTE    ] MHN: Fetching primary data for 2025-02.
[2025-10-24T19:53:47.295584] [INFO ] [REMOTE    ] MHN: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T19:53:47.347609] [INFO ] [REMOTE    ] MHO: Fetching primary data for 2025-01.
[2025-10-24T19:53:48.147609] [INFO ] [REMOTE    ] MHF: Fetching primary data for 2025-08.
[2025-10-24T19:53:48.547480] [INFO ] [REMOTE    ] MHO: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T19:53:48.614614] [INFO ] [REMOTE    ] MHF: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T19:53:48.947715] [INFO ] [REMOTE    ] MHO: Fetching primary data for 2025-02.
[2025-10-24T19:53:49.747741] [INFO ] [REMOTE    ] MHF: Fetching primary data for 2025-09.
[2025-10-24T19:53:50.329989] [INFO ] [REMOTE    ] MHO: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T19:53:50.468602] [INFO ] [REMOTE    ] MHF: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T19:53:50.547741] [INFO ] [REMOTE    ] MHO: Fetching primary data for 2025-03.
[2025-10-24T19:53:51.347711] [INFO ] [REMOTE    ] MHLA: Fetching primary data for 2025-05.
[2025-10-24T19:53:51.645795] [INFO ] [REMOTE    ] MHO: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T19:53:51.851596] [INFO ] [REMOTE    ] MHLA: Incremental fetch complete for 2025-05 (0.50 seconds).
[2025-10-24T19:53:52.147678] [INFO ] [REMOTE    ] MHF: Fetching primary data for 2025-10.
[2025-10-24T19:53:52.947704] [INFO ] [REMOTE    ] MHO: Fetching primary data for 2025-04.
[2025-10-24T19:53:53.000013] [INFO ] [REMOTE    ] MHF: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T19:53:53.002271] [INFO ] [REMOTE    ] MHF: Full fetch complete (12846 records).
[2025-10-24T19:53:53.002341] [DEBUG] [VALIDATOR ] MHF: Validating primary data.
[2025-10-24T19:53:53.364410] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present.
[2025-10-24T19:53:53.364482] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed.
[2025-10-24T19:53:53.364789] [INFO ] [MAIN      ] MHF: Fetched primary data is valid.
[2025-10-24T19:53:53.364849] [DEBUG] [LOCAL     ] MHF: Saving primary data.
[2025-10-24T19:53:53.365062] [FATAL] [LOCAL     ] MHF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:53:53.365141] [FATAL] [MAIN      ] MHF: Failed to save primary data.
[2025-10-24T19:53:53.365182] [WARN ] [MAIN      ] MHF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:53:53.365235] [INFO ] [LOCAL     ] MHF: Starting deletion of primary data.
[2025-10-24T19:53:53.365283] [DEBUG] [LOCAL     ] MHF: No primary data file found to delete.
[2025-10-24T19:53:53.365317] [INFO ] [LOCAL     ] MHF: Starting deletion of derivative data.
[2025-10-24T19:53:53.365449] [DEBUG] [LOCAL     ] MHF: Deleted derivative data file.
[2025-10-24T19:53:53.365517] [INFO ] [MAIN      ] Update Progress: 1352/2366 symbols completed. MHF took 40.2s. Estimated remaining: 2h 10m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:53:53.534597] [INFO ] [MAIN      ] MIAX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:53:53.534803] [DEBUG] [LOCAL     ] MIAX: No existing data file found in primary storage.
[2025-10-24T19:53:53.534845] [WARN ] [MAIN      ] MIAX: No existing data found, performing full refresh instead.
[2025-10-24T19:53:53.534954] [INFO ] [MAIN      ] MIAX: Wiping existing primary data before full refresh.
[2025-10-24T19:53:53.534994] [INFO ] [LOCAL     ] MIAX: Starting deletion of primary data.
[2025-10-24T19:53:53.535037] [DEBUG] [LOCAL     ] MIAX: No primary data file found to delete.
[2025-10-24T19:53:53.535097] [INFO ] [MAIN      ] MIAX: Starting full primary refresh.
[2025-10-24T19:53:53.752714] [INFO ] [REMOTE    ] MHN: Fetching primary data for 2025-03.
[2025-10-24T19:53:53.900496] [INFO ] [REMOTE    ] MIAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:53:54.094027] [INFO ] [REMOTE    ] MHO: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T19:53:54.508589] [INFO ] [REMOTE    ] MHN: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T19:53:54.547677] [INFO ] [REMOTE    ] MHN: Fetching primary data for 2025-04.
[2025-10-24T19:53:55.322201] [INFO ] [REMOTE    ] MHN: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T19:53:55.347674] [INFO ] [REMOTE    ] MHLA: Fetching primary data for 2025-06.
[2025-10-24T19:53:55.676721] [INFO ] [REMOTE    ] MHLA: Incremental fetch complete for 2025-06 (0.33 seconds).
[2025-10-24T19:53:56.147680] [INFO ] [REMOTE    ] MHN: Fetching primary data for 2025-05.
[2025-10-24T19:53:56.845816] [INFO ] [REMOTE    ] MHN: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T19:53:56.947702] [INFO ] [REMOTE    ] MHLA: Fetching primary data for 2025-07.
[2025-10-24T19:53:57.172150] [INFO ] [REMOTE    ] MHLA: Incremental fetch complete for 2025-07 (0.22 seconds).
[2025-10-24T19:53:57.747685] [INFO ] [REMOTE    ] MIAX: Fetching primary data for 2025-01.
[2025-10-24T19:53:57.952353] [DEBUG] [REMOTE    ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:53:57.952715] [WARN ] [REMOTE    ] MIAX: No data returned for month 2025-01
[2025-10-24T19:53:57.952800] [FATAL] [REMOTE    ] MIAX: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:53:57.952846] [FATAL] [MAIN      ] MIAX: Failed to fetch primary data.
[2025-10-24T19:53:57.952914] [WARN ] [MAIN      ] MIAX: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:53:57.953003] [INFO ] [LOCAL     ] MIAX: Starting deletion of primary data.
[2025-10-24T19:53:57.953064] [DEBUG] [LOCAL     ] MIAX: No primary data file found to delete.
[2025-10-24T19:53:57.953098] [INFO ] [LOCAL     ] MIAX: Starting deletion of derivative data.
[2025-10-24T19:53:57.953137] [DEBUG] [LOCAL     ] MIAX: No derivative data file found to delete.
[2025-10-24T19:53:57.953181] [INFO ] [MAIN      ] Update Progress: 1353/2366 symbols completed. MIAX took 4.6s. Estimated remaining: 2h 10m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:53:58.133611] [INFO ] [MAIN      ] MIN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:53:58.151950] [DEBUG] [LOCAL     ] MIN: Loaded 13984 existing records from primary storage.
[2025-10-24T19:53:58.152221] [INFO ] [MAIN      ] MIN: Loaded 13984 existing records.
[2025-10-24T19:53:58.339697] [WARN ] [MAIN      ] MIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:53:58.339944] [INFO ] [MAIN      ] MIN: Wiping existing primary data before full refresh.
[2025-10-24T19:53:58.339999] [INFO ] [LOCAL     ] MIN: Starting deletion of primary data.
[2025-10-24T19:53:58.340195] [DEBUG] [LOCAL     ] MIN: Deleted primary data file.
[2025-10-24T19:53:58.340235] [INFO ] [MAIN      ] MIN: Starting full primary refresh.
[2025-10-24T19:53:58.552786] [INFO ] [REMOTE    ] MHLA: Fetching primary data for 2025-08.
[2025-10-24T19:53:58.689985] [INFO ] [REMOTE    ] MIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:53:58.923776] [INFO ] [REMOTE    ] MHLA: Incremental fetch complete for 2025-08 (0.37 seconds).
[2025-10-24T19:53:59.347673] [INFO ] [REMOTE    ] MIN: Fetching primary data for 2025-01.
[2025-10-24T19:54:00.119795] [INFO ] [REMOTE    ] MIN: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T19:54:00.147603] [INFO ] [REMOTE    ] MIN: Fetching primary data for 2025-02.
[2025-10-24T19:54:00.947668] [INFO ] [REMOTE    ] MHLA: Fetching primary data for 2025-09.
[2025-10-24T19:54:01.260701] [INFO ] [REMOTE    ] MIN: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T19:54:01.747618] [INFO ] [REMOTE    ] MIN: Fetching primary data for 2025-03.
[2025-10-24T19:54:01.824438] [INFO ] [REMOTE    ] MHLA: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T19:54:02.547639] [INFO ] [REMOTE    ] MHN: Fetching primary data for 2025-06.
[2025-10-24T19:54:02.959483] [INFO ] [REMOTE    ] MIN: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T19:54:03.347631] [INFO ] [REMOTE    ] MHLA: Fetching primary data for 2025-10.
[2025-10-24T19:54:03.834346] [INFO ] [REMOTE    ] MHN: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T19:54:04.080188] [INFO ] [REMOTE    ] MHLA: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T19:54:04.080924] [INFO ] [REMOTE    ] MHLA: Full fetch complete (1485 records).
[2025-10-24T19:54:04.080994] [DEBUG] [VALIDATOR ] MHLA: Validating primary data.
[2025-10-24T19:54:04.152778] [INFO ] [REMOTE    ] MHO: Fetching primary data for 2025-05.
[2025-10-24T19:54:04.277078] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 178 unique days, need 200 days
[2025-10-24T19:54:04.277307] [FATAL] [MAIN      ] MHLA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:54:04.277365] [WARN ] [MAIN      ] MHLA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:54:04.277436] [INFO ] [LOCAL     ] MHLA: Starting deletion of primary data.
[2025-10-24T19:54:04.277499] [DEBUG] [LOCAL     ] MHLA: No primary data file found to delete.
[2025-10-24T19:54:04.277536] [INFO ] [LOCAL     ] MHLA: Starting deletion of derivative data.
[2025-10-24T19:54:04.277576] [DEBUG] [LOCAL     ] MHLA: No derivative data file found to delete.
[2025-10-24T19:54:04.277633] [INFO ] [MAIN      ] Update Progress: 1354/2366 symbols completed. MHLA took 27.6s. Estimated remaining: 2h 10m 4s. Rate: 7.8 symbols/min
[2025-10-24T19:54:04.451948] [INFO ] [MAIN      ] MIR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:54:04.503828] [DEBUG] [LOCAL     ] MIR: Loaded 51787 existing records from primary storage.
[2025-10-24T19:54:04.504153] [INFO ] [MAIN      ] MIR: Loaded 51787 existing records.
[2025-10-24T19:54:04.681835] [WARN ] [MAIN      ] MIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:54:04.682081] [INFO ] [MAIN      ] MIR: Wiping existing primary data before full refresh.
[2025-10-24T19:54:04.682144] [INFO ] [LOCAL     ] MIR: Starting deletion of primary data.
[2025-10-24T19:54:04.682550] [DEBUG] [LOCAL     ] MIR: Deleted primary data file.
[2025-10-24T19:54:04.682674] [INFO ] [MAIN      ] MIR: Starting full primary refresh.
[2025-10-24T19:54:04.952914] [INFO ] [REMOTE    ] MIN: Fetching primary data for 2025-04.
[2025-10-24T19:54:05.059321] [INFO ] [REMOTE    ] MIR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:54:05.747685] [INFO ] [REMOTE    ] MIR: Fetching primary data for 2025-01.
[2025-10-24T19:54:05.954052] [INFO ] [REMOTE    ] MIN: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T19:54:06.467810] [INFO ] [REMOTE    ] MHO: Incremental fetch complete for 2025-05 (2.32 seconds).
[2025-10-24T19:54:06.547730] [INFO ] [REMOTE    ] MHN: Fetching primary data for 2025-07.
[2025-10-24T19:54:07.247867] [INFO ] [REMOTE    ] MIR: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T19:54:07.347708] [INFO ] [REMOTE    ] MIN: Fetching primary data for 2025-05.
[2025-10-24T19:54:07.355535] [INFO ] [REMOTE    ] MHN: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T19:54:08.147754] [INFO ] [REMOTE    ] MHN: Fetching primary data for 2025-08.
[2025-10-24T19:54:08.241760] [INFO ] [REMOTE    ] MIN: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T19:54:08.850127] [INFO ] [REMOTE    ] MHN: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T19:54:08.947750] [INFO ] [REMOTE    ] MIN: Fetching primary data for 2025-06.
[2025-10-24T19:54:09.747674] [INFO ] [REMOTE    ] MHO: Fetching primary data for 2025-06.
[2025-10-24T19:54:09.866099] [INFO ] [REMOTE    ] MIN: Incremental fetch complete for 2025-06 (0.92 seconds).
[2025-10-24T19:54:10.547617] [INFO ] [REMOTE    ] MHN: Fetching primary data for 2025-09.
[2025-10-24T19:54:10.705392] [INFO ] [REMOTE    ] MHO: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T19:54:11.306586] [INFO ] [REMOTE    ] MHN: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T19:54:11.347617] [INFO ] [REMOTE    ] MHN: Fetching primary data for 2025-10.
[2025-10-24T19:54:12.049975] [INFO ] [REMOTE    ] MHN: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T19:54:12.051562] [INFO ] [REMOTE    ] MHN: Full fetch complete (11169 records).
[2025-10-24T19:54:12.051632] [DEBUG] [VALIDATOR ] MHN: Validating primary data.
[2025-10-24T19:54:12.152086] [INFO ] [REMOTE    ] MIR: Fetching primary data for 2025-02.
[2025-10-24T19:54:12.407358] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present.
[2025-10-24T19:54:12.407433] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed.
[2025-10-24T19:54:12.407714] [INFO ] [MAIN      ] MHN: Fetched primary data is valid.
[2025-10-24T19:54:12.407773] [DEBUG] [LOCAL     ] MHN: Saving primary data.
[2025-10-24T19:54:12.407979] [FATAL] [LOCAL     ] MHN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:54:12.408056] [FATAL] [MAIN      ] MHN: Failed to save primary data.
[2025-10-24T19:54:12.408097] [WARN ] [MAIN      ] MHN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:54:12.408131] [INFO ] [LOCAL     ] MHN: Starting deletion of primary data.
[2025-10-24T19:54:12.408178] [DEBUG] [LOCAL     ] MHN: No primary data file found to delete.
[2025-10-24T19:54:12.408212] [INFO ] [LOCAL     ] MHN: Starting deletion of derivative data.
[2025-10-24T19:54:12.408361] [DEBUG] [LOCAL     ] MHN: Deleted derivative data file.
[2025-10-24T19:54:12.408447] [INFO ] [MAIN      ] Update Progress: 1355/2366 symbols completed. MHN took 31.9s. Estimated remaining: 2h 9m 57s. Rate: 7.8 symbols/min
[2025-10-24T19:54:12.575148] [INFO ] [MAIN      ] MITN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:54:12.575303] [DEBUG] [LOCAL     ] MITN: No existing data file found in primary storage.
[2025-10-24T19:54:12.575340] [WARN ] [MAIN      ] MITN: No existing data found, performing full refresh instead.
[2025-10-24T19:54:12.575447] [INFO ] [MAIN      ] MITN: Wiping existing primary data before full refresh.
[2025-10-24T19:54:12.575507] [INFO ] [LOCAL     ] MITN: Starting deletion of primary data.
[2025-10-24T19:54:12.575550] [DEBUG] [LOCAL     ] MITN: No primary data file found to delete.
[2025-10-24T19:54:12.575582] [INFO ] [MAIN      ] MITN: Starting full primary refresh.
[2025-10-24T19:54:12.930470] [INFO ] [REMOTE    ] MITN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:54:12.947602] [INFO ] [REMOTE    ] MITN: Fetching primary data for 2025-01.
[2025-10-24T19:54:13.304910] [INFO ] [REMOTE    ] MITN: Incremental fetch complete for 2025-01 (0.36 seconds).
[2025-10-24T19:54:13.663063] [INFO ] [REMOTE    ] MIR: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T19:54:13.747670] [INFO ] [REMOTE    ] MIR: Fetching primary data for 2025-03.
[2025-10-24T19:54:14.547728] [INFO ] [REMOTE    ] MIN: Fetching primary data for 2025-07.
[2025-10-24T19:54:15.298994] [INFO ] [REMOTE    ] MIR: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T19:54:15.347672] [INFO ] [REMOTE    ] MIR: Fetching primary data for 2025-04.
[2025-10-24T19:54:15.718587] [INFO ] [REMOTE    ] MIN: Incremental fetch complete for 2025-07 (1.17 seconds).
[2025-10-24T19:54:16.147713] [INFO ] [REMOTE    ] MIN: Fetching primary data for 2025-08.
[2025-10-24T19:54:16.900170] [INFO ] [REMOTE    ] MIR: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T19:54:16.947609] [INFO ] [REMOTE    ] MITN: Fetching primary data for 2025-02.
[2025-10-24T19:54:17.027716] [INFO ] [REMOTE    ] MIN: Incremental fetch complete for 2025-08 (0.88 seconds).
[2025-10-24T19:54:17.358835] [INFO ] [REMOTE    ] MITN: Incremental fetch complete for 2025-02 (0.41 seconds).
[2025-10-24T19:54:17.747721] [INFO ] [REMOTE    ] MITN: Fetching primary data for 2025-03.
[2025-10-24T19:54:18.186879] [INFO ] [REMOTE    ] MITN: Incremental fetch complete for 2025-03 (0.44 seconds).
[2025-10-24T19:54:18.547747] [INFO ] [REMOTE    ] MITN: Fetching primary data for 2025-04.
[2025-10-24T19:54:19.162105] [INFO ] [REMOTE    ] MITN: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T19:54:19.347624] [INFO ] [REMOTE    ] MITN: Fetching primary data for 2025-05.
[2025-10-24T19:54:19.682929] [INFO ] [REMOTE    ] MITN: Incremental fetch complete for 2025-05 (0.34 seconds).
[2025-10-24T19:54:20.147688] [INFO ] [REMOTE    ] MIR: Fetching primary data for 2025-05.
[2025-10-24T19:54:20.947704] [INFO ] [REMOTE    ] MITN: Fetching primary data for 2025-06.
[2025-10-24T19:54:21.273660] [INFO ] [REMOTE    ] MITN: Incremental fetch complete for 2025-06 (0.33 seconds).
[2025-10-24T19:54:21.729571] [INFO ] [REMOTE    ] MIR: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T19:54:21.747605] [INFO ] [REMOTE    ] MIR: Fetching primary data for 2025-06.
[2025-10-24T19:54:22.547733] [INFO ] [REMOTE    ] MIN: Fetching primary data for 2025-09.
[2025-10-24T19:54:23.263023] [INFO ] [REMOTE    ] MIN: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T19:54:23.359333] [INFO ] [REMOTE    ] MHO: Fetching primary data for 2025-07.
[2025-10-24T19:54:23.361266] [INFO ] [REMOTE    ] MIR: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T19:54:24.147671] [INFO ] [REMOTE    ] MIR: Fetching primary data for 2025-07.
[2025-10-24T19:54:24.598444] [INFO ] [REMOTE    ] MHO: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T19:54:24.947705] [INFO ] [REMOTE    ] MITN: Fetching primary data for 2025-07.
[2025-10-24T19:54:25.284918] [INFO ] [REMOTE    ] MITN: Incremental fetch complete for 2025-07 (0.34 seconds).
[2025-10-24T19:54:25.658504] [INFO ] [REMOTE    ] MIR: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T19:54:25.747674] [INFO ] [REMOTE    ] MIN: Fetching primary data for 2025-10.
[2025-10-24T19:54:26.547683] [INFO ] [REMOTE    ] MITN: Fetching primary data for 2025-08.
[2025-10-24T19:54:26.702272] [INFO ] [REMOTE    ] MIN: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T19:54:26.706213] [INFO ] [REMOTE    ] MIN: Full fetch complete (17716 records).
[2025-10-24T19:54:26.706331] [DEBUG] [VALIDATOR ] MIN: Validating primary data.
[2025-10-24T19:54:26.972375] [INFO ] [REMOTE    ] MITN: Incremental fetch complete for 2025-08 (0.42 seconds).
[2025-10-24T19:54:27.092375] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present.
[2025-10-24T19:54:27.092449] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed.
[2025-10-24T19:54:27.092872] [INFO ] [MAIN      ] MIN: Fetched primary data is valid.
[2025-10-24T19:54:27.092934] [DEBUG] [LOCAL     ] MIN: Saving primary data.
[2025-10-24T19:54:27.093171] [FATAL] [LOCAL     ] MIN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:54:27.093251] [FATAL] [MAIN      ] MIN: Failed to save primary data.
[2025-10-24T19:54:27.093293] [WARN ] [MAIN      ] MIN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:54:27.093329] [INFO ] [LOCAL     ] MIN: Starting deletion of primary data.
[2025-10-24T19:54:27.093394] [DEBUG] [LOCAL     ] MIN: No primary data file found to delete.
[2025-10-24T19:54:27.093450] [INFO ] [LOCAL     ] MIN: Starting deletion of derivative data.
[2025-10-24T19:54:27.093774] [DEBUG] [LOCAL     ] MIN: Deleted derivative data file.
[2025-10-24T19:54:27.093862] [INFO ] [MAIN      ] Update Progress: 1356/2366 symbols completed. MIN took 29.1s. Estimated remaining: 2h 9m 54s. Rate: 7.8 symbols/min
[2025-10-24T19:54:27.259779] [INFO ] [MAIN      ] MITP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:54:27.264380] [DEBUG] [LOCAL     ] MITP: Loaded 2207 existing records from primary storage.
[2025-10-24T19:54:27.264540] [INFO ] [MAIN      ] MITP: Loaded 2207 existing records.
[2025-10-24T19:54:27.352863] [INFO ] [REMOTE    ] MIR: Fetching primary data for 2025-08.
[2025-10-24T19:54:27.447249] [WARN ] [MAIN      ] MITP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:54:27.447456] [INFO ] [MAIN      ] MITP: Wiping existing primary data before full refresh.
[2025-10-24T19:54:27.447504] [INFO ] [LOCAL     ] MITP: Starting deletion of primary data.
[2025-10-24T19:54:27.447678] [DEBUG] [LOCAL     ] MITP: Deleted primary data file.
[2025-10-24T19:54:27.447735] [INFO ] [MAIN      ] MITP: Starting full primary refresh.
[2025-10-24T19:54:27.805873] [INFO ] [REMOTE    ] MITP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:54:28.147720] [INFO ] [REMOTE    ] MITN: Fetching primary data for 2025-09.
[2025-10-24T19:54:28.486396] [INFO ] [REMOTE    ] MITN: Incremental fetch complete for 2025-09 (0.34 seconds).
[2025-10-24T19:54:28.947704] [INFO ] [REMOTE    ] MITP: Fetching primary data for 2025-01.
[2025-10-24T19:54:29.132449] [INFO ] [REMOTE    ] MIR: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T19:54:29.378413] [INFO ] [REMOTE    ] MITP: Incremental fetch complete for 2025-01 (0.43 seconds).
[2025-10-24T19:54:29.747684] [INFO ] [REMOTE    ] MITN: Fetching primary data for 2025-10.
[2025-10-24T19:54:30.156688] [INFO ] [REMOTE    ] MITN: Incremental fetch complete for 2025-10 (0.41 seconds).
[2025-10-24T19:54:30.157584] [INFO ] [REMOTE    ] MITN: Full fetch complete (2333 records).
[2025-10-24T19:54:30.157700] [DEBUG] [VALIDATOR ] MITN: Validating primary data.
[2025-10-24T19:54:30.364298] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days
[2025-10-24T19:54:30.364494] [FATAL] [MAIN      ] MITN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:54:30.364561] [WARN ] [MAIN      ] MITN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:54:30.364611] [INFO ] [LOCAL     ] MITN: Starting deletion of primary data.
[2025-10-24T19:54:30.364693] [DEBUG] [LOCAL     ] MITN: No primary data file found to delete.
[2025-10-24T19:54:30.364766] [INFO ] [LOCAL     ] MITN: Starting deletion of derivative data.
[2025-10-24T19:54:30.364811] [DEBUG] [LOCAL     ] MITN: No derivative data file found to delete.
[2025-10-24T19:54:30.364867] [INFO ] [MAIN      ] Update Progress: 1357/2366 symbols completed. MITN took 18.0s. Estimated remaining: 2h 9m 43s. Rate: 7.8 symbols/min
[2025-10-24T19:54:30.547640] [INFO ] [REMOTE    ] MITP: Fetching primary data for 2025-02.
[2025-10-24T19:54:30.886465] [INFO ] [REMOTE    ] MITP: Incremental fetch complete for 2025-02 (0.34 seconds).
[2025-10-24T19:54:31.347673] [INFO ] [REMOTE    ] MITP: Fetching primary data for 2025-03.
[2025-10-24T19:54:31.768850] [INFO ] [REMOTE    ] MITP: Incremental fetch complete for 2025-03 (0.42 seconds).
[2025-10-24T19:54:32.147639] [INFO ] [REMOTE    ] MIR: Fetching primary data for 2025-09.
[2025-10-24T19:54:32.947626] [INFO ] [REMOTE    ] MITP: Fetching primary data for 2025-04.
[2025-10-24T19:54:33.463989] [INFO ] [REMOTE    ] MITP: Incremental fetch complete for 2025-04 (0.52 seconds).
[2025-10-24T19:54:33.747714] [INFO ] [REMOTE    ] MITP: Fetching primary data for 2025-05.
[2025-10-24T19:54:33.927574] [INFO ] [REMOTE    ] MIR: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T19:54:34.294178] [INFO ] [REMOTE    ] MITP: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T19:54:34.547706] [INFO ] [REMOTE    ] MIR: Fetching primary data for 2025-10.
[2025-10-24T19:54:35.347678] [INFO ] [REMOTE    ] MITP: Fetching primary data for 2025-06.
[2025-10-24T19:54:35.758967] [INFO ] [REMOTE    ] MITP: Incremental fetch complete for 2025-06 (0.41 seconds).
[2025-10-24T19:54:36.147725] [INFO ] [REMOTE    ] MHO: Fetching primary data for 2025-08.
[2025-10-24T19:54:36.374932] [INFO ] [REMOTE    ] MIR: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T19:54:36.384434] [INFO ] [REMOTE    ] MIR: Full fetch complete (74017 records).
[2025-10-24T19:54:36.384556] [DEBUG] [VALIDATOR ] MIR: Validating primary data.
[2025-10-24T19:54:36.800333] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present.
[2025-10-24T19:54:36.800426] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed.
[2025-10-24T19:54:36.801691] [INFO ] [MAIN      ] MIR: Fetched primary data is valid.
[2025-10-24T19:54:36.801756] [DEBUG] [LOCAL     ] MIR: Saving primary data.
[2025-10-24T19:54:36.802365] [FATAL] [LOCAL     ] MIR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:54:36.802475] [FATAL] [MAIN      ] MIR: Failed to save primary data.
[2025-10-24T19:54:36.802559] [WARN ] [MAIN      ] MIR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:54:36.802626] [INFO ] [LOCAL     ] MIR: Starting deletion of primary data.
[2025-10-24T19:54:36.802722] [DEBUG] [LOCAL     ] MIR: No primary data file found to delete.
[2025-10-24T19:54:36.802788] [INFO ] [LOCAL     ] MIR: Starting deletion of derivative data.
[2025-10-24T19:54:36.802993] [DEBUG] [LOCAL     ] MIR: Deleted derivative data file.
[2025-10-24T19:54:36.803401] [INFO ] [MAIN      ] Update Progress: 1358/2366 symbols completed. MIR took 32.5s. Estimated remaining: 2h 9m 34s. Rate: 7.8 symbols/min
[2025-10-24T19:54:36.947618] [INFO ] [REMOTE    ] MITP: Fetching primary data for 2025-07.
[2025-10-24T19:54:37.402104] [INFO ] [REMOTE    ] MITP: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T19:54:37.421522] [INFO ] [REMOTE    ] MHO: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T19:54:37.747747] [INFO ] [REMOTE    ] MHO: Fetching primary data for 2025-09.
[2025-10-24T19:54:38.547712] [INFO ] [REMOTE    ] MITP: Fetching primary data for 2025-08.
[2025-10-24T19:54:38.839095] [INFO ] [REMOTE    ] MHO: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T19:54:38.998525] [INFO ] [REMOTE    ] MITP: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T19:54:39.347673] [INFO ] [REMOTE    ] MITP: Fetching primary data for 2025-09.
[2025-10-24T19:54:39.772135] [INFO ] [REMOTE    ] MITP: Incremental fetch complete for 2025-09 (0.42 seconds).
[2025-10-24T19:54:40.147639] [INFO ] [REMOTE    ] MHO: Fetching primary data for 2025-10.
[2025-10-24T19:54:40.947734] [INFO ] [REMOTE    ] MITP: Fetching primary data for 2025-10.
[2025-10-24T19:54:41.331403] [INFO ] [REMOTE    ] MHO: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T19:54:41.336937] [INFO ] [REMOTE    ] MHO: Full fetch complete (36514 records).
[2025-10-24T19:54:41.337082] [DEBUG] [VALIDATOR ] MHO: Validating primary data.
[2025-10-24T19:54:41.451793] [INFO ] [REMOTE    ] MITP: Incremental fetch complete for 2025-10 (0.50 seconds).
[2025-10-24T19:54:41.462053] [INFO ] [REMOTE    ] MITP: Full fetch complete (3204 records).
[2025-10-24T19:54:41.472510] [DEBUG] [VALIDATOR ] MITP: Validating primary data.
[2025-10-24T19:54:42.088698] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present.
[2025-10-24T19:54:42.088801] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed.
[2025-10-24T19:54:42.089596] [INFO ] [MAIN      ] MHO: Fetched primary data is valid.
[2025-10-24T19:54:42.089969] [DEBUG] [LOCAL     ] MHO: Saving primary data.
[2025-10-24T19:54:42.106141] [FATAL] [LOCAL     ] MHO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:54:42.116536] [FATAL] [MAIN      ] MHO: Failed to save primary data.
[2025-10-24T19:54:42.139615] [WARN ] [MAIN      ] MHO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:54:42.145928] [INFO ] [LOCAL     ] MHO: Starting deletion of primary data.
[2025-10-24T19:54:42.150084] [DEBUG] [LOCAL     ] MHO: No primary data file found to delete.
[2025-10-24T19:54:42.170953] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present.
[2025-10-24T19:54:42.170797] [INFO ] [LOCAL     ] MHO: Starting deletion of derivative data.
[2025-10-24T19:54:42.171112] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed.
[2025-10-24T19:54:42.171290] [DEBUG] [LOCAL     ] MHO: Deleted derivative data file.
[2025-10-24T19:54:42.171254] [INFO ] [MAIN      ] MITP: Fetched primary data is valid.
[2025-10-24T19:54:42.171438] [INFO ] [MAIN      ] Update Progress: 1359/2366 symbols completed. MHO took 58.5s. Estimated remaining: 2h 9m 25s. Rate: 7.8 symbols/min
[2025-10-24T19:54:42.171495] [DEBUG] [LOCAL     ] MITP: Saving primary data.
[2025-10-24T19:54:42.171915] [FATAL] [LOCAL     ] MITP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:54:42.172007] [FATAL] [MAIN      ] MITP: Failed to save primary data.
[2025-10-24T19:54:42.172095] [WARN ] [MAIN      ] MITP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:54:42.172190] [INFO ] [LOCAL     ] MITP: Starting deletion of primary data.
[2025-10-24T19:54:42.172266] [DEBUG] [LOCAL     ] MITP: No primary data file found to delete.
[2025-10-24T19:54:42.172303] [INFO ] [LOCAL     ] MITP: Starting deletion of derivative data.
[2025-10-24T19:54:42.172408] [DEBUG] [LOCAL     ] MITP: Deleted derivative data file.
[2025-10-24T19:54:42.172492] [INFO ] [MAIN      ] Update Progress: 1360/2366 symbols completed. MITP took 15.1s. Estimated remaining: 2h 9m 12s. Rate: 7.8 symbols/min
[2025-10-24T19:54:42.788244] [INFO ] [MAIN      ] MKL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:54:42.841279] [INFO ] [MAIN      ] MITT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:54:42.867325] [INFO ] [MAIN      ] MKC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:54:42.885015] [INFO ] [MAIN      ] MIY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:54:42.901972] [DEBUG] [LOCAL     ] MIY: Loaded 6252 existing records from primary storage.
[2025-10-24T19:54:42.902373] [INFO ] [MAIN      ] MIY: Loaded 6252 existing records.
[2025-10-24T19:54:42.994214] [DEBUG] [LOCAL     ] MITT: Loaded 22373 existing records from primary storage.
[2025-10-24T19:54:43.011635] [DEBUG] [LOCAL     ] MKL: Loaded 33977 existing records from primary storage.
[2025-10-24T19:54:43.027341] [INFO ] [MAIN      ] MITT: Loaded 22373 existing records.
[2025-10-24T19:54:43.033057] [INFO ] [MAIN      ] MKL: Loaded 33977 existing records.
[2025-10-24T19:54:43.334192] [WARN ] [MAIN      ] MIY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:54:43.410515] [INFO ] [MAIN      ] MIY: Wiping existing primary data before full refresh.
[2025-10-24T19:54:43.432852] [INFO ] [LOCAL     ] MIY: Starting deletion of primary data.
[2025-10-24T19:54:43.427579] [DEBUG] [LOCAL     ] MKC: Loaded 52909 existing records from primary storage.
[2025-10-24T19:54:43.462798] [INFO ] [MAIN      ] MKC: Loaded 52909 existing records.
[2025-10-24T19:54:43.462914] [DEBUG] [LOCAL     ] MIY: Deleted primary data file.
[2025-10-24T19:54:43.492763] [INFO ] [MAIN      ] MIY: Starting full primary refresh.
[2025-10-24T19:54:43.564347] [WARN ] [MAIN      ] MITT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:54:43.648039] [INFO ] [MAIN      ] MITT: Wiping existing primary data before full refresh.
[2025-10-24T19:54:43.705460] [INFO ] [LOCAL     ] MITT: Starting deletion of primary data.
[2025-10-24T19:54:43.709072] [WARN ] [MAIN      ] MKL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:54:43.726961] [INFO ] [MAIN      ] MKL: Wiping existing primary data before full refresh.
[2025-10-24T19:54:43.732417] [INFO ] [LOCAL     ] MKL: Starting deletion of primary data.
[2025-10-24T19:54:43.742990] [DEBUG] [LOCAL     ] MITT: Deleted primary data file.
[2025-10-24T19:54:43.748692] [INFO ] [MAIN      ] MITT: Starting full primary refresh.
[2025-10-24T19:54:43.759061] [DEBUG] [LOCAL     ] MKL: Deleted primary data file.
[2025-10-24T19:54:43.836207] [INFO ] [MAIN      ] MKL: Starting full primary refresh.
[2025-10-24T19:54:44.026587] [WARN ] [MAIN      ] MKC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:54:44.156876] [INFO ] [MAIN      ] MKC: Wiping existing primary data before full refresh.
[2025-10-24T19:54:44.196881] [INFO ] [LOCAL     ] MKC: Starting deletion of primary data.
[2025-10-24T19:54:44.265836] [DEBUG] [LOCAL     ] MKC: Deleted primary data file.
[2025-10-24T19:54:44.307500] [INFO ] [MAIN      ] MKC: Starting full primary refresh.
[2025-10-24T19:54:44.504016] [INFO ] [REMOTE    ] MIY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:54:44.593685] [INFO ] [REMOTE    ] MIY: Fetching primary data for 2025-01.
[2025-10-24T19:54:45.139228] [INFO ] [REMOTE    ] MKL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:54:45.198729] [INFO ] [REMOTE    ] MKL: Fetching primary data for 2025-01.
[2025-10-24T19:54:45.218012] [INFO ] [REMOTE    ] MITT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:54:45.239753] [INFO ] [REMOTE    ] MITT: Fetching primary data for 2025-01.
[2025-10-24T19:54:45.321228] [INFO ] [REMOTE    ] MKC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:54:45.321564] [INFO ] [REMOTE    ] MKC: Fetching primary data for 2025-01.
[2025-10-24T19:54:45.347845] [INFO ] [REMOTE    ] MIY: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T19:54:45.350125] [INFO ] [REMOTE    ] MIY: Fetching primary data for 2025-02.
[2025-10-24T19:54:45.941000] [INFO ] [REMOTE    ] MIY: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T19:54:45.942611] [INFO ] [REMOTE    ] MIY: Fetching primary data for 2025-03.
[2025-10-24T19:54:46.491290] [INFO ] [REMOTE    ] MKL: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T19:54:46.538479] [INFO ] [REMOTE    ] MIY: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T19:54:46.552723] [INFO ] [REMOTE    ] MIY: Fetching primary data for 2025-04.
[2025-10-24T19:54:46.562437] [INFO ] [REMOTE    ] MITT: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T19:54:46.697611] [INFO ] [REMOTE    ] MKC: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T19:54:47.249790] [INFO ] [REMOTE    ] MIY: Incremental fetch complete for 2025-04 (0.70 seconds).
[2025-10-24T19:54:47.347614] [INFO ] [REMOTE    ] MKL: Fetching primary data for 2025-02.
[2025-10-24T19:54:48.147633] [INFO ] [REMOTE    ] MIY: Fetching primary data for 2025-05.
[2025-10-24T19:54:48.719172] [INFO ] [REMOTE    ] MKL: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T19:54:48.759262] [INFO ] [REMOTE    ] MIY: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T19:54:48.947625] [INFO ] [REMOTE    ] MITT: Fetching primary data for 2025-02.
[2025-10-24T19:54:49.747620] [INFO ] [REMOTE    ] MIY: Fetching primary data for 2025-06.
[2025-10-24T19:54:49.999850] [INFO ] [REMOTE    ] MITT: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T19:54:50.547617] [INFO ] [REMOTE    ] MKL: Fetching primary data for 2025-03.
[2025-10-24T19:54:50.586409] [INFO ] [REMOTE    ] MIY: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T19:54:51.347673] [INFO ] [REMOTE    ] MIY: Fetching primary data for 2025-07.
[2025-10-24T19:54:51.909129] [INFO ] [REMOTE    ] MIY: Incremental fetch complete for 2025-07 (0.56 seconds).
[2025-10-24T19:54:51.910241] [INFO ] [REMOTE    ] MKL: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T19:54:52.147632] [INFO ] [REMOTE    ] MKC: Fetching primary data for 2025-02.
[2025-10-24T19:54:52.947683] [INFO ] [REMOTE    ] MIY: Fetching primary data for 2025-08.
[2025-10-24T19:54:53.531000] [INFO ] [REMOTE    ] MIY: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T19:54:53.684289] [INFO ] [REMOTE    ] MKC: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T19:54:53.747610] [INFO ] [REMOTE    ] MKC: Fetching primary data for 2025-03.
[2025-10-24T19:54:54.547693] [INFO ] [REMOTE    ] MITT: Fetching primary data for 2025-03.
[2025-10-24T19:54:55.347682] [INFO ] [REMOTE    ] MKL: Fetching primary data for 2025-04.
[2025-10-24T19:54:55.489446] [INFO ] [REMOTE    ] MKC: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T19:54:55.695727] [INFO ] [REMOTE    ] MITT: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T19:54:56.147685] [INFO ] [REMOTE    ] MITT: Fetching primary data for 2025-04.
[2025-10-24T19:54:56.404731] [INFO ] [REMOTE    ] MKL: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T19:54:56.947747] [INFO ] [REMOTE    ] MKC: Fetching primary data for 2025-04.
[2025-10-24T19:54:57.072235] [INFO ] [REMOTE    ] MITT: Incremental fetch complete for 2025-04 (0.92 seconds).
[2025-10-24T19:54:57.747693] [INFO ] [REMOTE    ] MKL: Fetching primary data for 2025-05.
[2025-10-24T19:54:58.547717] [INFO ] [REMOTE    ] MIY: Fetching primary data for 2025-09.
[2025-10-24T19:54:58.601523] [INFO ] [REMOTE    ] MKC: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T19:54:59.121001] [INFO ] [REMOTE    ] MKL: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T19:54:59.203245] [INFO ] [REMOTE    ] MIY: Incremental fetch complete for 2025-09 (0.66 seconds).
[2025-10-24T19:54:59.347708] [INFO ] [REMOTE    ] MITT: Fetching primary data for 2025-05.
[2025-10-24T19:55:00.147721] [INFO ] [REMOTE    ] MKL: Fetching primary data for 2025-06.
[2025-10-24T19:55:00.271037] [INFO ] [REMOTE    ] MITT: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T19:55:00.947711] [INFO ] [REMOTE    ] MKC: Fetching primary data for 2025-05.
[2025-10-24T19:55:01.747693] [INFO ] [REMOTE    ] MIY: Fetching primary data for 2025-10.
[2025-10-24T19:55:02.017327] [INFO ] [REMOTE    ] MKL: Incremental fetch complete for 2025-06 (1.87 seconds).
[2025-10-24T19:55:02.547699] [INFO ] [REMOTE    ] MITT: Fetching primary data for 2025-06.
[2025-10-24T19:55:03.347712] [INFO ] [REMOTE    ] MKL: Fetching primary data for 2025-07.
[2025-10-24T19:55:03.464209] [INFO ] [REMOTE    ] MKC: Incremental fetch complete for 2025-05 (2.52 seconds).
[2025-10-24T19:55:03.487910] [INFO ] [REMOTE    ] MIY: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T19:55:03.490702] [INFO ] [REMOTE    ] MIY: Full fetch complete (8669 records).
[2025-10-24T19:55:03.490891] [DEBUG] [VALIDATOR ] MIY: Validating primary data.
[2025-10-24T19:55:03.883733] [INFO ] [REMOTE    ] MITT: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T19:55:03.892439] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present.
[2025-10-24T19:55:03.897305] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed.
[2025-10-24T19:55:03.897568] [INFO ] [MAIN      ] MIY: Fetched primary data is valid.
[2025-10-24T19:55:03.897675] [DEBUG] [LOCAL     ] MIY: Saving primary data.
[2025-10-24T19:55:03.898559] [FATAL] [LOCAL     ] MIY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:55:03.898715] [FATAL] [MAIN      ] MIY: Failed to save primary data.
[2025-10-24T19:55:03.898791] [WARN ] [MAIN      ] MIY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:55:03.898878] [INFO ] [LOCAL     ] MIY: Starting deletion of primary data.
[2025-10-24T19:55:03.898956] [DEBUG] [LOCAL     ] MIY: No primary data file found to delete.
[2025-10-24T19:55:03.898997] [INFO ] [LOCAL     ] MIY: Starting deletion of derivative data.
[2025-10-24T19:55:03.899146] [DEBUG] [LOCAL     ] MIY: Deleted derivative data file.
[2025-10-24T19:55:03.899243] [INFO ] [MAIN      ] Update Progress: 1361/2366 symbols completed. MIY took 21.7s. Estimated remaining: 2h 9m 14s. Rate: 7.8 symbols/min
[2025-10-24T19:55:04.089661] [INFO ] [MAIN      ] MLI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:55:04.132461] [DEBUG] [LOCAL     ] MLI: Loaded 43734 existing records from primary storage.
[2025-10-24T19:55:04.132826] [INFO ] [MAIN      ] MLI: Loaded 43734 existing records.
[2025-10-24T19:55:04.153526] [INFO ] [REMOTE    ] MKC: Fetching primary data for 2025-06.
[2025-10-24T19:55:04.321962] [WARN ] [MAIN      ] MLI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:55:04.322198] [INFO ] [MAIN      ] MLI: Wiping existing primary data before full refresh.
[2025-10-24T19:55:04.322254] [INFO ] [LOCAL     ] MLI: Starting deletion of primary data.
[2025-10-24T19:55:04.322719] [DEBUG] [LOCAL     ] MLI: Deleted primary data file.
[2025-10-24T19:55:04.322776] [INFO ] [MAIN      ] MLI: Starting full primary refresh.
[2025-10-24T19:55:04.691176] [INFO ] [REMOTE    ] MLI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:55:04.947679] [INFO ] [REMOTE    ] MITT: Fetching primary data for 2025-07.
[2025-10-24T19:55:05.019580] [INFO ] [REMOTE    ] MKL: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T19:55:05.719414] [INFO ] [REMOTE    ] MITT: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T19:55:05.747615] [INFO ] [REMOTE    ] MITT: Fetching primary data for 2025-08.
[2025-10-24T19:55:06.054252] [INFO ] [REMOTE    ] MKC: Incremental fetch complete for 2025-06 (1.90 seconds).
[2025-10-24T19:55:06.547671] [INFO ] [REMOTE    ] MLI: Fetching primary data for 2025-01.
[2025-10-24T19:55:07.063832] [INFO ] [REMOTE    ] MITT: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T19:55:07.347709] [INFO ] [REMOTE    ] MKC: Fetching primary data for 2025-07.
[2025-10-24T19:55:07.739304] [INFO ] [REMOTE    ] MLI: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T19:55:08.147710] [INFO ] [REMOTE    ] MLI: Fetching primary data for 2025-02.
[2025-10-24T19:55:08.947683] [INFO ] [REMOTE    ] MITT: Fetching primary data for 2025-09.
[2025-10-24T19:55:09.233265] [INFO ] [REMOTE    ] MKC: Incremental fetch complete for 2025-07 (1.89 seconds).
[2025-10-24T19:55:09.699114] [INFO ] [REMOTE    ] MITT: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T19:55:09.753926] [INFO ] [REMOTE    ] MITT: Fetching primary data for 2025-10.
[2025-10-24T19:55:09.761130] [INFO ] [REMOTE    ] MLI: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T19:55:10.547691] [INFO ] [REMOTE    ] MKC: Fetching primary data for 2025-08.
[2025-10-24T19:55:10.918024] [INFO ] [REMOTE    ] MITT: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T19:55:10.922122] [INFO ] [REMOTE    ] MITT: Full fetch complete (33220 records).
[2025-10-24T19:55:10.922214] [DEBUG] [VALIDATOR ] MITT: Validating primary data.
[2025-10-24T19:55:11.290363] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present.
[2025-10-24T19:55:11.290444] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed.
[2025-10-24T19:55:11.291123] [INFO ] [MAIN      ] MITT: Fetched primary data is valid.
[2025-10-24T19:55:11.291185] [DEBUG] [LOCAL     ] MITT: Saving primary data.
[2025-10-24T19:55:11.291565] [FATAL] [LOCAL     ] MITT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:55:11.291680] [FATAL] [MAIN      ] MITT: Failed to save primary data.
[2025-10-24T19:55:11.291732] [WARN ] [MAIN      ] MITT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:55:11.291768] [INFO ] [LOCAL     ] MITT: Starting deletion of primary data.
[2025-10-24T19:55:11.291818] [DEBUG] [LOCAL     ] MITT: No primary data file found to delete.
[2025-10-24T19:55:11.291851] [INFO ] [LOCAL     ] MITT: Starting deletion of derivative data.
[2025-10-24T19:55:11.291976] [DEBUG] [LOCAL     ] MITT: Deleted derivative data file.
[2025-10-24T19:55:11.292051] [INFO ] [MAIN      ] Update Progress: 1362/2366 symbols completed. MITT took 29.1s. Estimated remaining: 2h 9m 6s. Rate: 7.8 symbols/min
[2025-10-24T19:55:11.354721] [INFO ] [REMOTE    ] MKL: Fetching primary data for 2025-08.
[2025-10-24T19:55:11.463470] [INFO ] [MAIN      ] MLM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:55:11.492507] [DEBUG] [LOCAL     ] MLM: Loaded 28771 existing records from primary storage.
[2025-10-24T19:55:11.492798] [INFO ] [MAIN      ] MLM: Loaded 28771 existing records.
[2025-10-24T19:55:11.670021] [WARN ] [MAIN      ] MLM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:55:11.670286] [INFO ] [MAIN      ] MLM: Wiping existing primary data before full refresh.
[2025-10-24T19:55:11.670348] [INFO ] [LOCAL     ] MLM: Starting deletion of primary data.
[2025-10-24T19:55:11.670708] [DEBUG] [LOCAL     ] MLM: Deleted primary data file.
[2025-10-24T19:55:11.670764] [INFO ] [MAIN      ] MLM: Starting full primary refresh.
[2025-10-24T19:55:12.023995] [INFO ] [REMOTE    ] MLM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:55:12.097608] [INFO ] [REMOTE    ] MKC: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T19:55:12.147619] [INFO ] [REMOTE    ] MKC: Fetching primary data for 2025-09.
[2025-10-24T19:55:12.721681] [INFO ] [REMOTE    ] MKL: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T19:55:12.947631] [INFO ] [REMOTE    ] MLM: Fetching primary data for 2025-01.
[2025-10-24T19:55:13.747613] [INFO ] [REMOTE    ] MKL: Fetching primary data for 2025-09.
[2025-10-24T19:55:13.809547] [INFO ] [REMOTE    ] MKC: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T19:55:14.321323] [INFO ] [REMOTE    ] MLM: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T19:55:14.547689] [INFO ] [REMOTE    ] MLI: Fetching primary data for 2025-03.
[2025-10-24T19:55:14.956288] [INFO ] [REMOTE    ] MKL: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T19:55:15.347697] [INFO ] [REMOTE    ] MLM: Fetching primary data for 2025-02.
[2025-10-24T19:55:16.147703] [INFO ] [REMOTE    ] MKL: Fetching primary data for 2025-10.
[2025-10-24T19:55:16.200382] [INFO ] [REMOTE    ] MLI: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T19:55:16.758598] [INFO ] [REMOTE    ] MLM: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T19:55:16.947742] [INFO ] [REMOTE    ] MLM: Fetching primary data for 2025-03.
[2025-10-24T19:55:17.607760] [INFO ] [REMOTE    ] MKL: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T19:55:17.613531] [INFO ] [REMOTE    ] MKL: Full fetch complete (49833 records).
[2025-10-24T19:55:17.613626] [DEBUG] [VALIDATOR ] MKL: Validating primary data.
[2025-10-24T19:55:17.752926] [INFO ] [REMOTE    ] MLI: Fetching primary data for 2025-04.
[2025-10-24T19:55:18.003709] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present.
[2025-10-24T19:55:18.003852] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed.
[2025-10-24T19:55:18.004897] [INFO ] [MAIN      ] MKL: Fetched primary data is valid.
[2025-10-24T19:55:18.004983] [DEBUG] [LOCAL     ] MKL: Saving primary data.
[2025-10-24T19:55:18.005570] [FATAL] [LOCAL     ] MKL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:55:18.005680] [FATAL] [MAIN      ] MKL: Failed to save primary data.
[2025-10-24T19:55:18.005734] [WARN ] [MAIN      ] MKL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:55:18.005799] [INFO ] [LOCAL     ] MKL: Starting deletion of primary data.
[2025-10-24T19:55:18.005861] [DEBUG] [LOCAL     ] MKL: No primary data file found to delete.
[2025-10-24T19:55:18.005903] [INFO ] [LOCAL     ] MKL: Starting deletion of derivative data.
[2025-10-24T19:55:18.006055] [DEBUG] [LOCAL     ] MKL: Deleted derivative data file.
[2025-10-24T19:55:18.006152] [INFO ] [MAIN      ] Update Progress: 1363/2366 symbols completed. MKL took 35.8s. Estimated remaining: 2h 8m 58s. Rate: 7.8 symbols/min
[2025-10-24T19:55:18.193375] [INFO ] [MAIN      ] MLP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:55:18.200318] [DEBUG] [LOCAL     ] MLP: Loaded 3014 existing records from primary storage.
[2025-10-24T19:55:18.200718] [INFO ] [MAIN      ] MLP: Loaded 3014 existing records.
[2025-10-24T19:55:18.325112] [INFO ] [REMOTE    ] MLM: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T19:55:18.425382] [WARN ] [MAIN      ] MLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:55:18.425629] [INFO ] [MAIN      ] MLP: Wiping existing primary data before full refresh.
[2025-10-24T19:55:18.425714] [INFO ] [LOCAL     ] MLP: Starting deletion of primary data.
[2025-10-24T19:55:18.425870] [DEBUG] [LOCAL     ] MLP: Deleted primary data file.
[2025-10-24T19:55:18.425908] [INFO ] [MAIN      ] MLP: Starting full primary refresh.
[2025-10-24T19:55:18.552872] [INFO ] [REMOTE    ] MKC: Fetching primary data for 2025-10.
[2025-10-24T19:55:18.784634] [INFO ] [REMOTE    ] MLP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:55:19.347679] [INFO ] [REMOTE    ] MLP: Fetching primary data for 2025-01.
[2025-10-24T19:55:19.508306] [INFO ] [REMOTE    ] MLI: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T19:55:19.965009] [INFO ] [REMOTE    ] MLP: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T19:55:20.147621] [INFO ] [REMOTE    ] MLI: Fetching primary data for 2025-05.
[2025-10-24T19:55:20.273425] [INFO ] [REMOTE    ] MKC: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T19:55:20.283230] [INFO ] [REMOTE    ] MKC: Full fetch complete (76006 records).
[2025-10-24T19:55:20.283353] [DEBUG] [VALIDATOR ] MKC: Validating primary data.
[2025-10-24T19:55:20.666385] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present.
[2025-10-24T19:55:20.666479] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed.
[2025-10-24T19:55:20.667541] [INFO ] [MAIN      ] MKC: Fetched primary data is valid.
[2025-10-24T19:55:20.667602] [DEBUG] [LOCAL     ] MKC: Saving primary data.
[2025-10-24T19:55:20.668162] [FATAL] [LOCAL     ] MKC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:55:20.668249] [FATAL] [MAIN      ] MKC: Failed to save primary data.
[2025-10-24T19:55:20.668290] [WARN ] [MAIN      ] MKC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:55:20.668324] [INFO ] [LOCAL     ] MKC: Starting deletion of primary data.
[2025-10-24T19:55:20.668374] [DEBUG] [LOCAL     ] MKC: No primary data file found to delete.
[2025-10-24T19:55:20.668412] [INFO ] [LOCAL     ] MKC: Starting deletion of derivative data.
[2025-10-24T19:55:20.668544] [DEBUG] [LOCAL     ] MKC: Deleted derivative data file.
[2025-10-24T19:55:20.669008] [INFO ] [MAIN      ] Update Progress: 1364/2366 symbols completed. MKC took 38.5s. Estimated remaining: 2h 8m 46s. Rate: 7.8 symbols/min
[2025-10-24T19:55:20.837104] [INFO ] [MAIN      ] MLR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:55:20.851936] [DEBUG] [LOCAL     ] MLR: Loaded 12181 existing records from primary storage.
[2025-10-24T19:55:20.852167] [INFO ] [MAIN      ] MLR: Loaded 12181 existing records.
[2025-10-24T19:55:20.951794] [INFO ] [REMOTE    ] MLM: Fetching primary data for 2025-04.
[2025-10-24T19:55:21.032833] [WARN ] [MAIN      ] MLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:55:21.033065] [INFO ] [MAIN      ] MLR: Wiping existing primary data before full refresh.
[2025-10-24T19:55:21.033117] [INFO ] [LOCAL     ] MLR: Starting deletion of primary data.
[2025-10-24T19:55:21.033310] [DEBUG] [LOCAL     ] MLR: Deleted primary data file.
[2025-10-24T19:55:21.033366] [INFO ] [MAIN      ] MLR: Starting full primary refresh.
[2025-10-24T19:55:21.385704] [INFO ] [REMOTE    ] MLR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:55:21.621197] [INFO ] [REMOTE    ] MLI: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T19:55:21.747599] [INFO ] [REMOTE    ] MLI: Fetching primary data for 2025-06.
[2025-10-24T19:55:22.430901] [INFO ] [REMOTE    ] MLM: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T19:55:22.547735] [INFO ] [REMOTE    ] MLP: Fetching primary data for 2025-02.
[2025-10-24T19:55:22.999989] [INFO ] [REMOTE    ] MLP: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T19:55:23.291024] [INFO ] [REMOTE    ] MLI: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T19:55:23.347669] [INFO ] [REMOTE    ] MLM: Fetching primary data for 2025-05.
[2025-10-24T19:55:24.147729] [INFO ] [REMOTE    ] MLR: Fetching primary data for 2025-01.
[2025-10-24T19:55:24.633419] [INFO ] [REMOTE    ] MLM: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T19:55:24.934536] [INFO ] [REMOTE    ] MLR: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T19:55:24.947631] [INFO ] [REMOTE    ] MLR: Fetching primary data for 2025-02.
[2025-10-24T19:55:25.747716] [INFO ] [REMOTE    ] MLP: Fetching primary data for 2025-03.
[2025-10-24T19:55:25.789887] [INFO ] [REMOTE    ] MLR: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T19:55:26.208248] [INFO ] [REMOTE    ] MLP: Incremental fetch complete for 2025-03 (0.46 seconds).
[2025-10-24T19:55:26.547733] [INFO ] [REMOTE    ] MLI: Fetching primary data for 2025-07.
[2025-10-24T19:55:27.347711] [INFO ] [REMOTE    ] MLR: Fetching primary data for 2025-03.
[2025-10-24T19:55:28.147713] [INFO ] [REMOTE    ] MLM: Fetching primary data for 2025-06.
[2025-10-24T19:55:28.384227] [INFO ] [REMOTE    ] MLI: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T19:55:28.601350] [INFO ] [REMOTE    ] MLR: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T19:55:28.947753] [INFO ] [REMOTE    ] MLI: Fetching primary data for 2025-08.
[2025-10-24T19:55:29.503001] [INFO ] [REMOTE    ] MLM: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T19:55:29.747750] [INFO ] [REMOTE    ] MLP: Fetching primary data for 2025-04.
[2025-10-24T19:55:30.414294] [INFO ] [REMOTE    ] MLP: Incremental fetch complete for 2025-04 (0.67 seconds).
[2025-10-24T19:55:30.491260] [INFO ] [REMOTE    ] MLI: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T19:55:30.547612] [INFO ] [REMOTE    ] MLR: Fetching primary data for 2025-04.
[2025-10-24T19:55:31.347700] [INFO ] [REMOTE    ] MLP: Fetching primary data for 2025-05.
[2025-10-24T19:55:31.438173] [INFO ] [REMOTE    ] MLR: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T19:55:31.927908] [INFO ] [REMOTE    ] MLP: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T19:55:32.147668] [INFO ] [REMOTE    ] MLP: Fetching primary data for 2025-06.
[2025-10-24T19:55:32.706195] [INFO ] [REMOTE    ] MLP: Incremental fetch complete for 2025-06 (0.56 seconds).
[2025-10-24T19:55:32.947671] [INFO ] [REMOTE    ] MLP: Fetching primary data for 2025-07.
[2025-10-24T19:55:33.399314] [INFO ] [REMOTE    ] MLP: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T19:55:33.747699] [INFO ] [REMOTE    ] MLR: Fetching primary data for 2025-05.
[2025-10-24T19:55:34.482719] [INFO ] [REMOTE    ] MLR: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T19:55:34.547631] [INFO ] [REMOTE    ] MLR: Fetching primary data for 2025-06.
[2025-10-24T19:55:35.264491] [INFO ] [REMOTE    ] MLR: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T19:55:35.347727] [INFO ] [REMOTE    ] MLI: Fetching primary data for 2025-09.
[2025-10-24T19:55:36.147709] [INFO ] [REMOTE    ] MLR: Fetching primary data for 2025-07.
[2025-10-24T19:55:36.905448] [INFO ] [REMOTE    ] MLR: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T19:55:36.934436] [INFO ] [REMOTE    ] MLI: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T19:55:36.947605] [INFO ] [REMOTE    ] MLR: Fetching primary data for 2025-08.
[2025-10-24T19:55:37.747623] [INFO ] [REMOTE    ] MLM: Fetching primary data for 2025-07.
[2025-10-24T19:55:37.854338] [INFO ] [REMOTE    ] MLR: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T19:55:38.547681] [INFO ] [REMOTE    ] MLP: Fetching primary data for 2025-08.
[2025-10-24T19:55:39.000721] [INFO ] [REMOTE    ] MLP: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T19:55:39.109017] [INFO ] [REMOTE    ] MLM: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T19:55:39.347616] [INFO ] [REMOTE    ] MLM: Fetching primary data for 2025-08.
[2025-10-24T19:55:40.147635] [INFO ] [REMOTE    ] MLR: Fetching primary data for 2025-09.
[2025-10-24T19:55:40.703925] [INFO ] [REMOTE    ] MLM: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T19:55:40.947709] [INFO ] [REMOTE    ] MLP: Fetching primary data for 2025-09.
[2025-10-24T19:55:41.073229] [INFO ] [REMOTE    ] MLR: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T19:55:41.274766] [INFO ] [REMOTE    ] MLP: Incremental fetch complete for 2025-09 (0.33 seconds).
[2025-10-24T19:55:41.747702] [INFO ] [REMOTE    ] MLP: Fetching primary data for 2025-10.
[2025-10-24T19:55:42.281680] [INFO ] [REMOTE    ] MLP: Incremental fetch complete for 2025-10 (0.53 seconds).
[2025-10-24T19:55:42.282715] [INFO ] [REMOTE    ] MLP: Full fetch complete (4297 records).
[2025-10-24T19:55:42.282787] [DEBUG] [VALIDATOR ] MLP: Validating primary data.
[2025-10-24T19:55:42.552917] [INFO ] [REMOTE    ] MLR: Fetching primary data for 2025-10.
[2025-10-24T19:55:42.683490] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present.
[2025-10-24T19:55:42.683571] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed.
[2025-10-24T19:55:42.683733] [INFO ] [MAIN      ] MLP: Fetched primary data is valid.
[2025-10-24T19:55:42.683854] [DEBUG] [LOCAL     ] MLP: Saving primary data.
[2025-10-24T19:55:42.684078] [FATAL] [LOCAL     ] MLP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:55:42.684165] [FATAL] [MAIN      ] MLP: Failed to save primary data.
[2025-10-24T19:55:42.684208] [WARN ] [MAIN      ] MLP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:55:42.684243] [INFO ] [LOCAL     ] MLP: Starting deletion of primary data.
[2025-10-24T19:55:42.684293] [DEBUG] [LOCAL     ] MLP: No primary data file found to delete.
[2025-10-24T19:55:42.684330] [INFO ] [LOCAL     ] MLP: Starting deletion of derivative data.
[2025-10-24T19:55:42.684475] [DEBUG] [LOCAL     ] MLP: Deleted derivative data file.
[2025-10-24T19:55:42.684566] [INFO ] [MAIN      ] Update Progress: 1365/2366 symbols completed. MLP took 24.7s. Estimated remaining: 2h 8m 49s. Rate: 7.8 symbols/min
[2025-10-24T19:55:42.875154] [INFO ] [MAIN      ] MMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:55:42.930104] [DEBUG] [LOCAL     ] MMC: Loaded 52316 existing records from primary storage.
[2025-10-24T19:55:42.930423] [INFO ] [MAIN      ] MMC: Loaded 52316 existing records.
[2025-10-24T19:55:43.114885] [WARN ] [MAIN      ] MMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:55:43.115151] [INFO ] [MAIN      ] MMC: Wiping existing primary data before full refresh.
[2025-10-24T19:55:43.115198] [INFO ] [LOCAL     ] MMC: Starting deletion of primary data.
[2025-10-24T19:55:43.115591] [DEBUG] [LOCAL     ] MMC: Deleted primary data file.
[2025-10-24T19:55:43.115682] [INFO ] [MAIN      ] MMC: Starting full primary refresh.
[2025-10-24T19:55:43.353618] [INFO ] [REMOTE    ] MLM: Fetching primary data for 2025-09.
[2025-10-24T19:55:43.527758] [INFO ] [REMOTE    ] MMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:55:43.535873] [INFO ] [REMOTE    ] MLR: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T19:55:43.538953] [INFO ] [REMOTE    ] MLR: Full fetch complete (18893 records).
[2025-10-24T19:55:43.539050] [DEBUG] [VALIDATOR ] MLR: Validating primary data.
[2025-10-24T19:55:43.907269] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present.
[2025-10-24T19:55:43.907351] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed.
[2025-10-24T19:55:43.907840] [INFO ] [MAIN      ] MLR: Fetched primary data is valid.
[2025-10-24T19:55:43.907900] [DEBUG] [LOCAL     ] MLR: Saving primary data.
[2025-10-24T19:55:43.908147] [FATAL] [LOCAL     ] MLR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:55:43.908227] [FATAL] [MAIN      ] MLR: Failed to save primary data.
[2025-10-24T19:55:43.908268] [WARN ] [MAIN      ] MLR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:55:43.908326] [INFO ] [LOCAL     ] MLR: Starting deletion of primary data.
[2025-10-24T19:55:43.908382] [DEBUG] [LOCAL     ] MLR: No primary data file found to delete.
[2025-10-24T19:55:43.908416] [INFO ] [LOCAL     ] MLR: Starting deletion of derivative data.
[2025-10-24T19:55:43.908553] [DEBUG] [LOCAL     ] MLR: Deleted derivative data file.
[2025-10-24T19:55:43.908700] [INFO ] [MAIN      ] Update Progress: 1366/2366 symbols completed. MLR took 23.2s. Estimated remaining: 2h 8m 37s. Rate: 7.8 symbols/min
[2025-10-24T19:55:44.079180] [INFO ] [MAIN      ] MMD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:55:44.093172] [DEBUG] [LOCAL     ] MMD: Loaded 10792 existing records from primary storage.
[2025-10-24T19:55:44.093400] [INFO ] [MAIN      ] MMD: Loaded 10792 existing records.
[2025-10-24T19:55:44.160374] [INFO ] [REMOTE    ] MLI: Fetching primary data for 2025-10.
[2025-10-24T19:55:44.285036] [WARN ] [MAIN      ] MMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:55:44.285256] [INFO ] [MAIN      ] MMD: Wiping existing primary data before full refresh.
[2025-10-24T19:55:44.285315] [INFO ] [LOCAL     ] MMD: Starting deletion of primary data.
[2025-10-24T19:55:44.285515] [DEBUG] [LOCAL     ] MMD: Deleted primary data file.
[2025-10-24T19:55:44.285558] [INFO ] [MAIN      ] MMD: Starting full primary refresh.
[2025-10-24T19:55:44.641783] [INFO ] [REMOTE    ] MMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:55:44.660875] [INFO ] [REMOTE    ] MLM: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T19:55:44.947717] [INFO ] [REMOTE    ] MMD: Fetching primary data for 2025-01.
[2025-10-24T19:55:45.751230] [INFO ] [REMOTE    ] MLM: Fetching primary data for 2025-10.
[2025-10-24T19:55:45.757397] [INFO ] [REMOTE    ] MLI: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T19:55:45.766783] [INFO ] [REMOTE    ] MLI: Full fetch complete (63341 records).
[2025-10-24T19:55:45.766960] [DEBUG] [VALIDATOR ] MLI: Validating primary data.
[2025-10-24T19:55:46.122765] [INFO ] [REMOTE    ] MMD: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T19:55:46.213069] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present.
[2025-10-24T19:55:46.213192] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed.
[2025-10-24T19:55:46.214826] [INFO ] [MAIN      ] MLI: Fetched primary data is valid.
[2025-10-24T19:55:46.214895] [DEBUG] [LOCAL     ] MLI: Saving primary data.
[2025-10-24T19:55:46.215826] [FATAL] [LOCAL     ] MLI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:55:46.215929] [FATAL] [MAIN      ] MLI: Failed to save primary data.
[2025-10-24T19:55:46.215979] [WARN ] [MAIN      ] MLI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:55:46.216022] [INFO ] [LOCAL     ] MLI: Starting deletion of primary data.
[2025-10-24T19:55:46.216082] [DEBUG] [LOCAL     ] MLI: No primary data file found to delete.
[2025-10-24T19:55:46.216125] [INFO ] [LOCAL     ] MLI: Starting deletion of derivative data.
[2025-10-24T19:55:46.216297] [DEBUG] [LOCAL     ] MLI: Deleted derivative data file.
[2025-10-24T19:55:46.216411] [INFO ] [MAIN      ] Update Progress: 1367/2366 symbols completed. MLI took 42.3s. Estimated remaining: 2h 8m 25s. Rate: 7.8 symbols/min
[2025-10-24T19:55:46.394928] [INFO ] [MAIN      ] MMI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:55:46.415899] [DEBUG] [LOCAL     ] MMI: Loaded 15494 existing records from primary storage.
[2025-10-24T19:55:46.416214] [INFO ] [MAIN      ] MMI: Loaded 15494 existing records.
[2025-10-24T19:55:46.552848] [INFO ] [REMOTE    ] MMC: Fetching primary data for 2025-01.
[2025-10-24T19:55:46.625241] [WARN ] [MAIN      ] MMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:55:46.625718] [INFO ] [MAIN      ] MMI: Wiping existing primary data before full refresh.
[2025-10-24T19:55:46.625779] [INFO ] [LOCAL     ] MMI: Starting deletion of primary data.
[2025-10-24T19:55:46.626053] [DEBUG] [LOCAL     ] MMI: Deleted primary data file.
[2025-10-24T19:55:46.626099] [INFO ] [MAIN      ] MMI: Starting full primary refresh.
[2025-10-24T19:55:47.035494] [INFO ] [REMOTE    ] MMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:55:47.089462] [INFO ] [REMOTE    ] MLM: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T19:55:47.094321] [INFO ] [REMOTE    ] MLM: Full fetch complete (45036 records).
[2025-10-24T19:55:47.094454] [DEBUG] [VALIDATOR ] MLM: Validating primary data.
[2025-10-24T19:55:47.353636] [INFO ] [REMOTE    ] MMD: Fetching primary data for 2025-02.
[2025-10-24T19:55:47.466882] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present.
[2025-10-24T19:55:47.466978] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed.
[2025-10-24T19:55:47.467869] [INFO ] [MAIN      ] MLM: Fetched primary data is valid.
[2025-10-24T19:55:47.467930] [DEBUG] [LOCAL     ] MLM: Saving primary data.
[2025-10-24T19:55:47.468326] [FATAL] [LOCAL     ] MLM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:55:47.468413] [FATAL] [MAIN      ] MLM: Failed to save primary data.
[2025-10-24T19:55:47.468454] [WARN ] [MAIN      ] MLM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:55:47.468488] [INFO ] [LOCAL     ] MLM: Starting deletion of primary data.
[2025-10-24T19:55:47.468540] [DEBUG] [LOCAL     ] MLM: No primary data file found to delete.
[2025-10-24T19:55:47.468579] [INFO ] [LOCAL     ] MLM: Starting deletion of derivative data.
[2025-10-24T19:55:47.468713] [DEBUG] [LOCAL     ] MLM: Deleted derivative data file.
[2025-10-24T19:55:47.468802] [INFO ] [MAIN      ] Update Progress: 1368/2366 symbols completed. MLM took 36.2s. Estimated remaining: 2h 8m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:55:47.637258] [INFO ] [MAIN      ] MMID: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:55:47.637442] [DEBUG] [LOCAL     ] MMID: No existing data file found in primary storage.
[2025-10-24T19:55:47.637481] [WARN ] [MAIN      ] MMID: No existing data found, performing full refresh instead.
[2025-10-24T19:55:47.637604] [INFO ] [MAIN      ] MMID: Wiping existing primary data before full refresh.
[2025-10-24T19:55:47.637670] [INFO ] [LOCAL     ] MMID: Starting deletion of primary data.
[2025-10-24T19:55:47.637738] [DEBUG] [LOCAL     ] MMID: No primary data file found to delete.
[2025-10-24T19:55:47.637773] [INFO ] [MAIN      ] MMID: Starting full primary refresh.
[2025-10-24T19:55:48.111005] [INFO ] [REMOTE    ] MMID: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:55:48.147716] [INFO ] [REMOTE    ] MMI: Fetching primary data for 2025-01.
[2025-10-24T19:55:48.228154] [INFO ] [REMOTE    ] MMD: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T19:55:48.368340] [INFO ] [REMOTE    ] MMC: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T19:55:48.914327] [INFO ] [REMOTE    ] MMI: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T19:55:48.947600] [INFO ] [REMOTE    ] MMI: Fetching primary data for 2025-02.
[2025-10-24T19:55:49.747684] [INFO ] [REMOTE    ] MMID: Fetching primary data for 2025-01.
[2025-10-24T19:55:49.873084] [INFO ] [REMOTE    ] MMI: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T19:55:49.950675] [DEBUG] [REMOTE    ] MMID: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:55:49.951004] [WARN ] [REMOTE    ] MMID: No data returned for month 2025-01
[2025-10-24T19:55:49.951092] [FATAL] [REMOTE    ] MMID: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:55:49.951143] [FATAL] [MAIN      ] MMID: Failed to fetch primary data.
[2025-10-24T19:55:49.951202] [WARN ] [MAIN      ] MMID: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:55:49.951273] [INFO ] [LOCAL     ] MMID: Starting deletion of primary data.
[2025-10-24T19:55:49.951333] [DEBUG] [LOCAL     ] MMID: No primary data file found to delete.
[2025-10-24T19:55:49.951372] [INFO ] [LOCAL     ] MMID: Starting deletion of derivative data.
[2025-10-24T19:55:49.951410] [DEBUG] [LOCAL     ] MMID: No derivative data file found to delete.
[2025-10-24T19:55:49.951456] [INFO ] [MAIN      ] Update Progress: 1369/2366 symbols completed. MMID took 2.5s. Estimated remaining: 2h 8m 1s. Rate: 7.8 symbols/min
[2025-10-24T19:55:50.122539] [INFO ] [MAIN      ] MMKT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:55:50.122724] [DEBUG] [LOCAL     ] MMKT: No existing data file found in primary storage.
[2025-10-24T19:55:50.122793] [WARN ] [MAIN      ] MMKT: No existing data found, performing full refresh instead.
[2025-10-24T19:55:50.122906] [INFO ] [MAIN      ] MMKT: Wiping existing primary data before full refresh.
[2025-10-24T19:55:50.122949] [INFO ] [LOCAL     ] MMKT: Starting deletion of primary data.
[2025-10-24T19:55:50.122991] [DEBUG] [LOCAL     ] MMKT: No primary data file found to delete.
[2025-10-24T19:55:50.123024] [INFO ] [MAIN      ] MMKT: Starting full primary refresh.
[2025-10-24T19:55:50.483243] [INFO ] [REMOTE    ] MMKT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:55:50.547625] [INFO ] [REMOTE    ] MMD: Fetching primary data for 2025-03.
[2025-10-24T19:55:51.347682] [INFO ] [REMOTE    ] MMI: Fetching primary data for 2025-03.
[2025-10-24T19:55:51.367583] [INFO ] [REMOTE    ] MMD: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T19:55:52.147615] [INFO ] [REMOTE    ] MMD: Fetching primary data for 2025-04.
[2025-10-24T19:55:52.306788] [INFO ] [REMOTE    ] MMI: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T19:55:52.947636] [INFO ] [REMOTE    ] MMKT: Fetching primary data for 2025-01.
[2025-10-24T19:55:53.078512] [INFO ] [REMOTE    ] MMD: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T19:55:53.377635] [INFO ] [REMOTE    ] MMKT: Incremental fetch complete for 2025-01 (0.43 seconds).
[2025-10-24T19:55:53.747635] [INFO ] [REMOTE    ] MMC: Fetching primary data for 2025-02.
[2025-10-24T19:55:54.547634] [INFO ] [REMOTE    ] MMD: Fetching primary data for 2025-05.
[2025-10-24T19:55:55.263436] [INFO ] [REMOTE    ] MMD: Incremental fetch complete for 2025-05 (0.72 seconds).
[2025-10-24T19:55:55.347673] [INFO ] [REMOTE    ] MMKT: Fetching primary data for 2025-02.
[2025-10-24T19:55:55.587170] [INFO ] [REMOTE    ] MMC: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T19:55:55.782910] [INFO ] [REMOTE    ] MMKT: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T19:55:56.147685] [INFO ] [REMOTE    ] MMC: Fetching primary data for 2025-03.
[2025-10-24T19:55:56.947633] [INFO ] [REMOTE    ] MMKT: Fetching primary data for 2025-03.
[2025-10-24T19:55:57.461493] [INFO ] [REMOTE    ] MMKT: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T19:55:57.747706] [INFO ] [REMOTE    ] MMKT: Fetching primary data for 2025-04.
[2025-10-24T19:55:57.978984] [INFO ] [REMOTE    ] MMC: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T19:55:58.035561] [INFO ] [REMOTE    ] MMKT: Incremental fetch complete for 2025-04 (0.29 seconds).
[2025-10-24T19:55:58.547690] [INFO ] [REMOTE    ] MMI: Fetching primary data for 2025-04.
[2025-10-24T19:55:59.347684] [INFO ] [REMOTE    ] MMD: Fetching primary data for 2025-06.
[2025-10-24T19:55:59.569956] [INFO ] [REMOTE    ] MMI: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T19:56:00.121294] [INFO ] [REMOTE    ] MMD: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T19:56:00.147597] [INFO ] [REMOTE    ] MMD: Fetching primary data for 2025-07.
[2025-10-24T19:56:00.947717] [INFO ] [REMOTE    ] MMC: Fetching primary data for 2025-04.
[2025-10-24T19:56:01.581358] [INFO ] [REMOTE    ] MMD: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T19:56:01.747639] [INFO ] [REMOTE    ] MMD: Fetching primary data for 2025-08.
[2025-10-24T19:56:02.547711] [INFO ] [REMOTE    ] MMKT: Fetching primary data for 2025-05.
[2025-10-24T19:56:02.727297] [INFO ] [REMOTE    ] MMD: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T19:56:02.985717] [INFO ] [REMOTE    ] MMKT: Incremental fetch complete for 2025-05 (0.44 seconds).
[2025-10-24T19:56:03.304631] [INFO ] [REMOTE    ] MMC: Incremental fetch complete for 2025-04 (2.36 seconds).
[2025-10-24T19:56:03.347608] [INFO ] [REMOTE    ] MMC: Fetching primary data for 2025-05.
[2025-10-24T19:56:04.147623] [INFO ] [REMOTE    ] MMKT: Fetching primary data for 2025-06.
[2025-10-24T19:56:04.615116] [INFO ] [REMOTE    ] MMKT: Incremental fetch complete for 2025-06 (0.47 seconds).
[2025-10-24T19:56:04.942335] [INFO ] [REMOTE    ] MMC: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T19:56:04.952957] [INFO ] [REMOTE    ] MMKT: Fetching primary data for 2025-07.
[2025-10-24T19:56:05.355955] [INFO ] [REMOTE    ] MMKT: Incremental fetch complete for 2025-07 (0.40 seconds).
[2025-10-24T19:56:05.747717] [INFO ] [REMOTE    ] MMD: Fetching primary data for 2025-09.
[2025-10-24T19:56:06.547619] [INFO ] [REMOTE    ] MMI: Fetching primary data for 2025-05.
[2025-10-24T19:56:06.622316] [INFO ] [REMOTE    ] MMD: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T19:56:07.347665] [INFO ] [REMOTE    ] MMC: Fetching primary data for 2025-06.
[2025-10-24T19:56:07.467137] [INFO ] [REMOTE    ] MMI: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T19:56:08.147677] [INFO ] [REMOTE    ] MMI: Fetching primary data for 2025-06.
[2025-10-24T19:56:08.947675] [INFO ] [REMOTE    ] MMKT: Fetching primary data for 2025-08.
[2025-10-24T19:56:09.021714] [INFO ] [REMOTE    ] MMC: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T19:56:09.213884] [INFO ] [REMOTE    ] MMI: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T19:56:09.295332] [INFO ] [REMOTE    ] MMKT: Incremental fetch complete for 2025-08 (0.35 seconds).
[2025-10-24T19:56:09.747638] [INFO ] [REMOTE    ] MMC: Fetching primary data for 2025-07.
[2025-10-24T19:56:10.547717] [INFO ] [REMOTE    ] MMKT: Fetching primary data for 2025-09.
[2025-10-24T19:56:10.880081] [INFO ] [REMOTE    ] MMKT: Incremental fetch complete for 2025-09 (0.33 seconds).
[2025-10-24T19:56:11.355080] [INFO ] [REMOTE    ] MMD: Fetching primary data for 2025-10.
[2025-10-24T19:56:11.376474] [INFO ] [REMOTE    ] MMC: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T19:56:12.147701] [INFO ] [REMOTE    ] MMKT: Fetching primary data for 2025-10.
[2025-10-24T19:56:12.465187] [INFO ] [REMOTE    ] MMD: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T19:56:12.467998] [INFO ] [REMOTE    ] MMD: Full fetch complete (16930 records).
[2025-10-24T19:56:12.468117] [DEBUG] [VALIDATOR ] MMD: Validating primary data.
[2025-10-24T19:56:12.849950] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present.
[2025-10-24T19:56:12.850142] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed.
[2025-10-24T19:56:12.855130] [INFO ] [REMOTE    ] MMKT: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T19:56:12.854941] [INFO ] [MAIN      ] MMD: Fetched primary data is valid.
[2025-10-24T19:56:12.856850] [DEBUG] [LOCAL     ] MMD: Saving primary data.
[2025-10-24T19:56:12.856763] [INFO ] [REMOTE    ] MMKT: Full fetch complete (2140 records).
[2025-10-24T19:56:12.857169] [DEBUG] [VALIDATOR ] MMKT: Validating primary data.
[2025-10-24T19:56:12.863118] [FATAL] [LOCAL     ] MMD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:56:12.910484] [FATAL] [MAIN      ] MMD: Failed to save primary data.
[2025-10-24T19:56:12.934417] [WARN ] [MAIN      ] MMD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:56:12.948192] [INFO ] [REMOTE    ] MMI: Fetching primary data for 2025-07.
[2025-10-24T19:56:12.948108] [INFO ] [LOCAL     ] MMD: Starting deletion of primary data.
[2025-10-24T19:56:12.969710] [DEBUG] [LOCAL     ] MMD: No primary data file found to delete.
[2025-10-24T19:56:12.983196] [INFO ] [LOCAL     ] MMD: Starting deletion of derivative data.
[2025-10-24T19:56:12.983892] [DEBUG] [LOCAL     ] MMD: Deleted derivative data file.
[2025-10-24T19:56:13.005209] [INFO ] [MAIN      ] Update Progress: 1370/2366 symbols completed. MMD took 29.1s. Estimated remaining: 2h 8m 5s. Rate: 7.8 symbols/min
[2025-10-24T19:56:13.180241] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days
[2025-10-24T19:56:13.183990] [FATAL] [MAIN      ] MMKT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:56:13.189929] [WARN ] [MAIN      ] MMKT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:56:13.200317] [INFO ] [LOCAL     ] MMKT: Starting deletion of primary data.
[2025-10-24T19:56:13.210617] [DEBUG] [LOCAL     ] MMKT: No primary data file found to delete.
[2025-10-24T19:56:13.231700] [INFO ] [LOCAL     ] MMKT: Starting deletion of derivative data.
[2025-10-24T19:56:13.239766] [DEBUG] [LOCAL     ] MMKT: No derivative data file found to delete.
[2025-10-24T19:56:13.240578] [INFO ] [MAIN      ] Update Progress: 1371/2366 symbols completed. MMKT took 23.3s. Estimated remaining: 2h 7m 51s. Rate: 7.8 symbols/min
[2025-10-24T19:56:13.302494] [INFO ] [MAIN      ] MMM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:56:13.442347] [INFO ] [MAIN      ] MMS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:56:13.484971] [DEBUG] [LOCAL     ] MMM: Loaded 53501 existing records from primary storage.
[2025-10-24T19:56:13.496243] [INFO ] [MAIN      ] MMM: Loaded 53501 existing records.
[2025-10-24T19:56:13.697025] [WARN ] [MAIN      ] MMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:56:13.677122] [DEBUG] [LOCAL     ] MMS: Loaded 33605 existing records from primary storage.
[2025-10-24T19:56:13.697482] [INFO ] [MAIN      ] MMM: Wiping existing primary data before full refresh.
[2025-10-24T19:56:13.697716] [INFO ] [LOCAL     ] MMM: Starting deletion of primary data.
[2025-10-24T19:56:13.697893] [INFO ] [MAIN      ] MMS: Loaded 33605 existing records.
[2025-10-24T19:56:13.709129] [DEBUG] [LOCAL     ] MMM: Deleted primary data file.
[2025-10-24T19:56:13.772284] [INFO ] [MAIN      ] MMM: Starting full primary refresh.
[2025-10-24T19:56:13.782858] [INFO ] [REMOTE    ] MMC: Fetching primary data for 2025-08.
[2025-10-24T19:56:13.910467] [INFO ] [REMOTE    ] MMI: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T19:56:13.986527] [WARN ] [MAIN      ] MMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:56:14.028155] [INFO ] [MAIN      ] MMS: Wiping existing primary data before full refresh.
[2025-10-24T19:56:14.028381] [INFO ] [LOCAL     ] MMS: Starting deletion of primary data.
[2025-10-24T19:56:14.034546] [DEBUG] [LOCAL     ] MMS: Deleted primary data file.
[2025-10-24T19:56:14.045087] [INFO ] [MAIN      ] MMS: Starting full primary refresh.
[2025-10-24T19:56:14.559706] [INFO ] [REMOTE    ] MMM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:56:14.565033] [INFO ] [REMOTE    ] MMI: Fetching primary data for 2025-08.
[2025-10-24T19:56:14.683329] [INFO ] [REMOTE    ] MMS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:56:15.347751] [INFO ] [REMOTE    ] MMS: Fetching primary data for 2025-01.
[2025-10-24T19:56:15.510483] [INFO ] [REMOTE    ] MMI: Incremental fetch complete for 2025-08 (0.95 seconds).
[2025-10-24T19:56:15.699098] [INFO ] [REMOTE    ] MMC: Incremental fetch complete for 2025-08 (1.92 seconds).
[2025-10-24T19:56:16.147705] [INFO ] [REMOTE    ] MMI: Fetching primary data for 2025-09.
[2025-10-24T19:56:16.950989] [INFO ] [REMOTE    ] MMC: Fetching primary data for 2025-09.
[2025-10-24T19:56:16.953188] [INFO ] [REMOTE    ] MMS: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T19:56:16.974397] [INFO ] [REMOTE    ] MMI: Incremental fetch complete for 2025-09 (0.83 seconds).
[2025-10-24T19:56:17.747676] [INFO ] [REMOTE    ] MMM: Fetching primary data for 2025-01.
[2025-10-24T19:56:18.547695] [INFO ] [REMOTE    ] MMS: Fetching primary data for 2025-02.
[2025-10-24T19:56:18.591135] [INFO ] [REMOTE    ] MMC: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T19:56:19.347624] [INFO ] [REMOTE    ] MMC: Fetching primary data for 2025-10.
[2025-10-24T19:56:19.720685] [INFO ] [REMOTE    ] MMM: Incremental fetch complete for 2025-01 (1.97 seconds).
[2025-10-24T19:56:19.915390] [INFO ] [REMOTE    ] MMS: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T19:56:20.147679] [INFO ] [REMOTE    ] MMM: Fetching primary data for 2025-02.
[2025-10-24T19:56:20.947680] [INFO ] [REMOTE    ] MMS: Fetching primary data for 2025-03.
[2025-10-24T19:56:21.104989] [INFO ] [REMOTE    ] MMC: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T19:56:21.114560] [INFO ] [REMOTE    ] MMC: Full fetch complete (75232 records).
[2025-10-24T19:56:21.114724] [DEBUG] [VALIDATOR ] MMC: Validating primary data.
[2025-10-24T19:56:21.519492] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present.
[2025-10-24T19:56:21.519604] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed.
[2025-10-24T19:56:21.520870] [INFO ] [MAIN      ] MMC: Fetched primary data is valid.
[2025-10-24T19:56:21.520937] [DEBUG] [LOCAL     ] MMC: Saving primary data.
[2025-10-24T19:56:21.521601] [FATAL] [LOCAL     ] MMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:56:21.521725] [FATAL] [MAIN      ] MMC: Failed to save primary data.
[2025-10-24T19:56:21.521766] [WARN ] [MAIN      ] MMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:56:21.521801] [INFO ] [LOCAL     ] MMC: Starting deletion of primary data.
[2025-10-24T19:56:21.521854] [DEBUG] [LOCAL     ] MMC: No primary data file found to delete.
[2025-10-24T19:56:21.521888] [INFO ] [LOCAL     ] MMC: Starting deletion of derivative data.
[2025-10-24T19:56:21.522014] [DEBUG] [LOCAL     ] MMC: Deleted derivative data file.
[2025-10-24T19:56:21.522264] [INFO ] [MAIN      ] Update Progress: 1372/2366 symbols completed. MMC took 38.8s. Estimated remaining: 2h 7m 44s. Rate: 7.8 symbols/min
[2025-10-24T19:56:21.698433] [INFO ] [MAIN      ] MMT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:56:21.710432] [DEBUG] [LOCAL     ] MMT: Loaded 10170 existing records from primary storage.
[2025-10-24T19:56:21.710694] [INFO ] [MAIN      ] MMT: Loaded 10170 existing records.
[2025-10-24T19:56:21.753113] [INFO ] [REMOTE    ] MMI: Fetching primary data for 2025-10.
[2025-10-24T19:56:21.893540] [WARN ] [MAIN      ] MMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:56:21.893776] [INFO ] [MAIN      ] MMT: Wiping existing primary data before full refresh.
[2025-10-24T19:56:21.893829] [INFO ] [LOCAL     ] MMT: Starting deletion of primary data.
[2025-10-24T19:56:21.893979] [DEBUG] [LOCAL     ] MMT: Deleted primary data file.
[2025-10-24T19:56:21.894019] [INFO ] [MAIN      ] MMT: Starting full primary refresh.
[2025-10-24T19:56:22.257338] [INFO ] [REMOTE    ] MMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:56:22.547631] [INFO ] [REMOTE    ] MMT: Fetching primary data for 2025-01.
[2025-10-24T19:56:22.736551] [INFO ] [REMOTE    ] MMM: Incremental fetch complete for 2025-02 (2.59 seconds).
[2025-10-24T19:56:22.786620] [INFO ] [REMOTE    ] MMI: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T19:56:22.790693] [INFO ] [REMOTE    ] MMI: Full fetch complete (21962 records).
[2025-10-24T19:56:22.790829] [DEBUG] [VALIDATOR ] MMI: Validating primary data.
[2025-10-24T19:56:22.934786] [INFO ] [REMOTE    ] MMS: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T19:56:23.198337] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present.
[2025-10-24T19:56:23.198415] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed.
[2025-10-24T19:56:23.198964] [INFO ] [MAIN      ] MMI: Fetched primary data is valid.
[2025-10-24T19:56:23.199026] [DEBUG] [LOCAL     ] MMI: Saving primary data.
[2025-10-24T19:56:23.199299] [FATAL] [LOCAL     ] MMI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:56:23.199448] [FATAL] [MAIN      ] MMI: Failed to save primary data.
[2025-10-24T19:56:23.199505] [WARN ] [MAIN      ] MMI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:56:23.199570] [INFO ] [LOCAL     ] MMI: Starting deletion of primary data.
[2025-10-24T19:56:23.199628] [DEBUG] [LOCAL     ] MMI: No primary data file found to delete.
[2025-10-24T19:56:23.199700] [INFO ] [LOCAL     ] MMI: Starting deletion of derivative data.
[2025-10-24T19:56:23.199865] [DEBUG] [LOCAL     ] MMI: Deleted derivative data file.
[2025-10-24T19:56:23.199960] [INFO ] [MAIN      ] Update Progress: 1373/2366 symbols completed. MMI took 37.0s. Estimated remaining: 2h 7m 32s. Rate: 7.8 symbols/min
[2025-10-24T19:56:23.353142] [INFO ] [REMOTE    ] MMS: Fetching primary data for 2025-04.
[2025-10-24T19:56:23.385485] [INFO ] [MAIN      ] MMU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:56:23.387331] [INFO ] [REMOTE    ] MMT: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T19:56:23.407903] [DEBUG] [LOCAL     ] MMU: Loaded 16875 existing records from primary storage.
[2025-10-24T19:56:23.408151] [INFO ] [MAIN      ] MMU: Loaded 16875 existing records.
[2025-10-24T19:56:23.587465] [WARN ] [MAIN      ] MMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:56:23.587699] [INFO ] [MAIN      ] MMU: Wiping existing primary data before full refresh.
[2025-10-24T19:56:23.587756] [INFO ] [LOCAL     ] MMU: Starting deletion of primary data.
[2025-10-24T19:56:23.588030] [DEBUG] [LOCAL     ] MMU: Deleted primary data file.
[2025-10-24T19:56:23.588100] [INFO ] [MAIN      ] MMU: Starting full primary refresh.
[2025-10-24T19:56:23.944167] [INFO ] [REMOTE    ] MMU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:56:24.147669] [INFO ] [REMOTE    ] MMT: Fetching primary data for 2025-02.
[2025-10-24T19:56:24.842116] [INFO ] [REMOTE    ] MMT: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T19:56:24.865211] [INFO ] [REMOTE    ] MMS: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T19:56:24.947717] [INFO ] [REMOTE    ] MMT: Fetching primary data for 2025-03.
[2025-10-24T19:56:25.747625] [INFO ] [REMOTE    ] MMU: Fetching primary data for 2025-01.
[2025-10-24T19:56:25.863597] [INFO ] [REMOTE    ] MMT: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T19:56:26.547664] [INFO ] [REMOTE    ] MMT: Fetching primary data for 2025-04.
[2025-10-24T19:56:26.802274] [INFO ] [REMOTE    ] MMU: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T19:56:27.347621] [INFO ] [REMOTE    ] MMS: Fetching primary data for 2025-05.
[2025-10-24T19:56:27.409079] [INFO ] [REMOTE    ] MMT: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T19:56:28.147680] [INFO ] [REMOTE    ] MMU: Fetching primary data for 2025-02.
[2025-10-24T19:56:28.595459] [INFO ] [REMOTE    ] MMS: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T19:56:28.947709] [INFO ] [REMOTE    ] MMM: Fetching primary data for 2025-03.
[2025-10-24T19:56:29.169599] [INFO ] [REMOTE    ] MMU: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T19:56:29.747675] [INFO ] [REMOTE    ] MMT: Fetching primary data for 2025-05.
[2025-10-24T19:56:30.539074] [INFO ] [REMOTE    ] MMT: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T19:56:30.547596] [INFO ] [REMOTE    ] MMT: Fetching primary data for 2025-06.
[2025-10-24T19:56:30.799508] [INFO ] [REMOTE    ] MMM: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T19:56:31.323974] [INFO ] [REMOTE    ] MMT: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T19:56:31.347671] [INFO ] [REMOTE    ] MMU: Fetching primary data for 2025-03.
[2025-10-24T19:56:32.152460] [INFO ] [REMOTE    ] MMS: Fetching primary data for 2025-06.
[2025-10-24T19:56:32.154385] [INFO ] [REMOTE    ] MMU: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T19:56:32.947706] [INFO ] [REMOTE    ] MMM: Fetching primary data for 2025-04.
[2025-10-24T19:56:33.351240] [INFO ] [REMOTE    ] MMS: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T19:56:33.747628] [INFO ] [REMOTE    ] MMS: Fetching primary data for 2025-07.
[2025-10-24T19:56:34.547701] [INFO ] [REMOTE    ] MMU: Fetching primary data for 2025-04.
[2025-10-24T19:56:34.822660] [INFO ] [REMOTE    ] MMM: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T19:56:34.857682] [INFO ] [REMOTE    ] MMS: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T19:56:35.347746] [INFO ] [REMOTE    ] MMM: Fetching primary data for 2025-05.
[2025-10-24T19:56:35.814909] [INFO ] [REMOTE    ] MMU: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T19:56:36.147731] [INFO ] [REMOTE    ] MMU: Fetching primary data for 2025-05.
[2025-10-24T19:56:36.947628] [INFO ] [REMOTE    ] MMS: Fetching primary data for 2025-08.
[2025-10-24T19:56:37.022904] [INFO ] [REMOTE    ] MMU: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T19:56:37.212200] [INFO ] [REMOTE    ] MMM: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T19:56:37.747694] [INFO ] [REMOTE    ] MMM: Fetching primary data for 2025-06.
[2025-10-24T19:56:38.258146] [INFO ] [REMOTE    ] MMS: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T19:56:38.547748] [INFO ] [REMOTE    ] MMS: Fetching primary data for 2025-09.
[2025-10-24T19:56:39.347693] [INFO ] [REMOTE    ] MMT: Fetching primary data for 2025-07.
[2025-10-24T19:56:39.565169] [INFO ] [REMOTE    ] MMM: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T19:56:39.981996] [INFO ] [REMOTE    ] MMS: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T19:56:40.147740] [INFO ] [REMOTE    ] MMM: Fetching primary data for 2025-07.
[2025-10-24T19:56:40.277491] [INFO ] [REMOTE    ] MMT: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T19:56:40.947748] [INFO ] [REMOTE    ] MMS: Fetching primary data for 2025-10.
[2025-10-24T19:56:41.747749] [INFO ] [REMOTE    ] MMT: Fetching primary data for 2025-08.
[2025-10-24T19:56:42.055115] [INFO ] [REMOTE    ] MMM: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T19:56:42.359480] [INFO ] [REMOTE    ] MMS: Incremental fetch complete for 2025-10 (1.41 seconds).
[2025-10-24T19:56:42.366521] [INFO ] [REMOTE    ] MMS: Full fetch complete (51014 records).
[2025-10-24T19:56:42.366714] [DEBUG] [VALIDATOR ] MMS: Validating primary data.
[2025-10-24T19:56:42.566260] [INFO ] [REMOTE    ] MMT: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T19:56:42.563801] [INFO ] [REMOTE    ] MMM: Fetching primary data for 2025-08.
[2025-10-24T19:56:42.790440] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present.
[2025-10-24T19:56:42.790553] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed.
[2025-10-24T19:56:42.792091] [INFO ] [MAIN      ] MMS: Fetched primary data is valid.
[2025-10-24T19:56:42.792161] [DEBUG] [LOCAL     ] MMS: Saving primary data.
[2025-10-24T19:56:42.792933] [FATAL] [LOCAL     ] MMS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:56:42.793029] [FATAL] [MAIN      ] MMS: Failed to save primary data.
[2025-10-24T19:56:42.793073] [WARN ] [MAIN      ] MMS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:56:42.793109] [INFO ] [LOCAL     ] MMS: Starting deletion of primary data.
[2025-10-24T19:56:42.793196] [DEBUG] [LOCAL     ] MMS: No primary data file found to delete.
[2025-10-24T19:56:42.793254] [INFO ] [LOCAL     ] MMS: Starting deletion of derivative data.
[2025-10-24T19:56:42.793448] [DEBUG] [LOCAL     ] MMS: Deleted derivative data file.
[2025-10-24T19:56:42.793750] [INFO ] [MAIN      ] Update Progress: 1374/2366 symbols completed. MMS took 29.6s. Estimated remaining: 2h 7m 33s. Rate: 7.8 symbols/min
[2025-10-24T19:56:42.976839] [INFO ] [MAIN      ] MNR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:56:43.009378] [DEBUG] [LOCAL     ] MNR: Loaded 25198 existing records from primary storage.
[2025-10-24T19:56:43.009756] [INFO ] [MAIN      ] MNR: Loaded 25198 existing records.
[2025-10-24T19:56:43.194354] [WARN ] [MAIN      ] MNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:56:43.194777] [INFO ] [MAIN      ] MNR: Wiping existing primary data before full refresh.
[2025-10-24T19:56:43.194839] [INFO ] [LOCAL     ] MNR: Starting deletion of primary data.
[2025-10-24T19:56:43.195559] [DEBUG] [LOCAL     ] MNR: Deleted primary data file.
[2025-10-24T19:56:43.195617] [INFO ] [MAIN      ] MNR: Starting full primary refresh.
[2025-10-24T19:56:43.359489] [INFO ] [REMOTE    ] MMU: Fetching primary data for 2025-06.
[2025-10-24T19:56:43.573842] [INFO ] [REMOTE    ] MNR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:56:44.147709] [INFO ] [REMOTE    ] MMT: Fetching primary data for 2025-09.
[2025-10-24T19:56:44.417283] [INFO ] [REMOTE    ] MMU: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T19:56:44.605329] [INFO ] [REMOTE    ] MMM: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T19:56:44.882178] [INFO ] [REMOTE    ] MMT: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T19:56:44.947678] [INFO ] [REMOTE    ] MNR: Fetching primary data for 2025-01.
[2025-10-24T19:56:45.747623] [INFO ] [REMOTE    ] MMM: Fetching primary data for 2025-09.
[2025-10-24T19:56:46.068413] [INFO ] [REMOTE    ] MNR: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T19:56:46.547679] [INFO ] [REMOTE    ] MMT: Fetching primary data for 2025-10.
[2025-10-24T19:56:47.331773] [INFO ] [REMOTE    ] MMT: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T19:56:47.333805] [INFO ] [REMOTE    ] MMT: Full fetch complete (15920 records).
[2025-10-24T19:56:47.333883] [DEBUG] [VALIDATOR ] MMT: Validating primary data.
[2025-10-24T19:56:47.355115] [INFO ] [REMOTE    ] MNR: Fetching primary data for 2025-02.
[2025-10-24T19:56:47.706271] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present.
[2025-10-24T19:56:47.706390] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed.
[2025-10-24T19:56:47.706812] [INFO ] [MAIN      ] MMT: Fetched primary data is valid.
[2025-10-24T19:56:47.706874] [DEBUG] [LOCAL     ] MMT: Saving primary data.
[2025-10-24T19:56:47.707114] [FATAL] [LOCAL     ] MMT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:56:47.707204] [FATAL] [MAIN      ] MMT: Failed to save primary data.
[2025-10-24T19:56:47.707297] [WARN ] [MAIN      ] MMT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:56:47.707365] [INFO ] [LOCAL     ] MMT: Starting deletion of primary data.
[2025-10-24T19:56:47.707421] [DEBUG] [LOCAL     ] MMT: No primary data file found to delete.
[2025-10-24T19:56:47.707456] [INFO ] [LOCAL     ] MMT: Starting deletion of derivative data.
[2025-10-24T19:56:47.707575] [DEBUG] [LOCAL     ] MMT: Deleted derivative data file.
[2025-10-24T19:56:47.707677] [INFO ] [MAIN      ] Update Progress: 1375/2366 symbols completed. MMT took 26.2s. Estimated remaining: 2h 7m 23s. Rate: 7.8 symbols/min
[2025-10-24T19:56:47.905456] [INFO ] [REMOTE    ] MMM: Incremental fetch complete for 2025-09 (2.16 seconds).
[2025-10-24T19:56:47.908390] [INFO ] [MAIN      ] MNSO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:56:47.961044] [DEBUG] [LOCAL     ] MNSO: Loaded 44260 existing records from primary storage.
[2025-10-24T19:56:47.961318] [INFO ] [MAIN      ] MNSO: Loaded 44260 existing records.
[2025-10-24T19:56:48.137636] [WARN ] [MAIN      ] MNSO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:56:48.137857] [INFO ] [MAIN      ] MNSO: Wiping existing primary data before full refresh.
[2025-10-24T19:56:48.137902] [INFO ] [LOCAL     ] MNSO: Starting deletion of primary data.
[2025-10-24T19:56:48.138415] [DEBUG] [LOCAL     ] MNSO: Deleted primary data file.
[2025-10-24T19:56:48.138453] [INFO ] [MAIN      ] MNSO: Starting full primary refresh.
[2025-10-24T19:56:48.152787] [INFO ] [REMOTE    ] MMU: Fetching primary data for 2025-07.
[2025-10-24T19:56:48.529005] [INFO ] [REMOTE    ] MNR: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T19:56:48.527861] [INFO ] [REMOTE    ] MNSO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:56:48.947636] [INFO ] [REMOTE    ] MNSO: Fetching primary data for 2025-01.
[2025-10-24T19:56:49.103414] [INFO ] [REMOTE    ] MMU: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T19:56:49.747734] [INFO ] [REMOTE    ] MMM: Fetching primary data for 2025-10.
[2025-10-24T19:56:50.426560] [INFO ] [REMOTE    ] MNSO: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T19:56:50.547610] [INFO ] [REMOTE    ] MNSO: Fetching primary data for 2025-02.
[2025-10-24T19:56:51.347668] [INFO ] [REMOTE    ] MMU: Fetching primary data for 2025-08.
[2025-10-24T19:56:51.964578] [INFO ] [REMOTE    ] MMM: Incremental fetch complete for 2025-10 (2.22 seconds).
[2025-10-24T19:56:51.999570] [INFO ] [REMOTE    ] MNSO: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T19:56:51.997800] [INFO ] [REMOTE    ] MMM: Full fetch complete (77221 records).
[2025-10-24T19:56:52.002775] [DEBUG] [VALIDATOR ] MMM: Validating primary data.
[2025-10-24T19:56:52.149540] [INFO ] [REMOTE    ] MNSO: Fetching primary data for 2025-03.
[2025-10-24T19:56:52.151114] [INFO ] [REMOTE    ] MMU: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T19:56:52.434599] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present.
[2025-10-24T19:56:52.434715] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed.
[2025-10-24T19:56:52.435814] [INFO ] [MAIN      ] MMM: Fetched primary data is valid.
[2025-10-24T19:56:52.435877] [DEBUG] [LOCAL     ] MMM: Saving primary data.
[2025-10-24T19:56:52.436512] [FATAL] [LOCAL     ] MMM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:56:52.436605] [FATAL] [MAIN      ] MMM: Failed to save primary data.
[2025-10-24T19:56:52.436686] [WARN ] [MAIN      ] MMM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:56:52.436756] [INFO ] [LOCAL     ] MMM: Starting deletion of primary data.
[2025-10-24T19:56:52.436816] [DEBUG] [LOCAL     ] MMM: No primary data file found to delete.
[2025-10-24T19:56:52.436851] [INFO ] [LOCAL     ] MMM: Starting deletion of derivative data.
[2025-10-24T19:56:52.436965] [DEBUG] [LOCAL     ] MMM: Deleted derivative data file.
[2025-10-24T19:56:52.437278] [INFO ] [MAIN      ] Update Progress: 1376/2366 symbols completed. MMM took 39.4s. Estimated remaining: 2h 7m 13s. Rate: 7.8 symbols/min
[2025-10-24T19:56:52.630972] [INFO ] [MAIN      ] MNTN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:56:52.631189] [DEBUG] [LOCAL     ] MNTN: No existing data file found in primary storage.
[2025-10-24T19:56:52.631244] [WARN ] [MAIN      ] MNTN: No existing data found, performing full refresh instead.
[2025-10-24T19:56:52.631361] [INFO ] [MAIN      ] MNTN: Wiping existing primary data before full refresh.
[2025-10-24T19:56:52.631403] [INFO ] [LOCAL     ] MNTN: Starting deletion of primary data.
[2025-10-24T19:56:52.631445] [DEBUG] [LOCAL     ] MNTN: No primary data file found to delete.
[2025-10-24T19:56:52.631478] [INFO ] [MAIN      ] MNTN: Starting full primary refresh.
[2025-10-24T19:56:52.952875] [INFO ] [REMOTE    ] MNR: Fetching primary data for 2025-03.
[2025-10-24T19:56:52.988877] [INFO ] [REMOTE    ] MNTN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:56:53.747734] [INFO ] [REMOTE    ] MMU: Fetching primary data for 2025-09.
[2025-10-24T19:56:53.900501] [INFO ] [REMOTE    ] MNSO: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T19:56:54.013404] [INFO ] [REMOTE    ] MNR: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T19:56:54.547637] [INFO ] [REMOTE    ] MNTN: Fetching primary data for 2025-01.
[2025-10-24T19:56:54.656008] [INFO ] [REMOTE    ] MMU: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T19:56:54.752202] [DEBUG] [REMOTE    ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:56:54.752468] [WARN ] [REMOTE    ] MNTN: No data returned for month 2025-01
[2025-10-24T19:56:54.752554] [FATAL] [REMOTE    ] MNTN: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:56:54.752599] [FATAL] [MAIN      ] MNTN: Failed to fetch primary data.
[2025-10-24T19:56:54.752632] [WARN ] [MAIN      ] MNTN: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:56:54.752706] [INFO ] [LOCAL     ] MNTN: Starting deletion of primary data.
[2025-10-24T19:56:54.752765] [DEBUG] [LOCAL     ] MNTN: No primary data file found to delete.
[2025-10-24T19:56:54.752808] [INFO ] [LOCAL     ] MNTN: Starting deletion of derivative data.
[2025-10-24T19:56:54.752846] [DEBUG] [LOCAL     ] MNTN: No derivative data file found to delete.
[2025-10-24T19:56:54.752890] [INFO ] [MAIN      ] Update Progress: 1377/2366 symbols completed. MNTN took 2.3s. Estimated remaining: 2h 7m 2s. Rate: 7.8 symbols/min
[2025-10-24T19:56:54.921249] [INFO ] [MAIN      ] MO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:56:54.921431] [DEBUG] [LOCAL     ] MO: No existing data file found in primary storage.
[2025-10-24T19:56:54.921468] [WARN ] [MAIN      ] MO: No existing data found, performing full refresh instead.
[2025-10-24T19:56:54.921581] [INFO ] [MAIN      ] MO: Wiping existing primary data before full refresh.
[2025-10-24T19:56:54.921621] [INFO ] [LOCAL     ] MO: Starting deletion of primary data.
[2025-10-24T19:56:54.921697] [DEBUG] [LOCAL     ] MO: No primary data file found to delete.
[2025-10-24T19:56:54.921744] [INFO ] [MAIN      ] MO: Starting full primary refresh.
[2025-10-24T19:56:55.276199] [INFO ] [REMOTE    ] MO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:56:55.347607] [INFO ] [REMOTE    ] MO: Fetching primary data for 2025-01.
[2025-10-24T19:56:56.147677] [INFO ] [REMOTE    ] MNR: Fetching primary data for 2025-04.
[2025-10-24T19:56:56.947629] [INFO ] [REMOTE    ] MMU: Fetching primary data for 2025-10.
[2025-10-24T19:56:57.246791] [INFO ] [REMOTE    ] MNR: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T19:56:57.682587] [INFO ] [REMOTE    ] MO: Incremental fetch complete for 2025-01 (2.33 seconds).
[2025-10-24T19:56:57.747636] [INFO ] [REMOTE    ] MNR: Fetching primary data for 2025-05.
[2025-10-24T19:56:57.986051] [INFO ] [REMOTE    ] MMU: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T19:56:57.990804] [INFO ] [REMOTE    ] MMU: Full fetch complete (24982 records).
[2025-10-24T19:56:57.990962] [DEBUG] [VALIDATOR ] MMU: Validating primary data.
[2025-10-24T19:56:58.361778] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present.
[2025-10-24T19:56:58.361852] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed.
[2025-10-24T19:56:58.362371] [INFO ] [MAIN      ] MMU: Fetched primary data is valid.
[2025-10-24T19:56:58.362409] [DEBUG] [LOCAL     ] MMU: Saving primary data.
[2025-10-24T19:56:58.362715] [FATAL] [LOCAL     ] MMU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:56:58.362811] [FATAL] [MAIN      ] MMU: Failed to save primary data.
[2025-10-24T19:56:58.362884] [WARN ] [MAIN      ] MMU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:56:58.362988] [INFO ] [LOCAL     ] MMU: Starting deletion of primary data.
[2025-10-24T19:56:58.363058] [DEBUG] [LOCAL     ] MMU: No primary data file found to delete.
[2025-10-24T19:56:58.363095] [INFO ] [LOCAL     ] MMU: Starting deletion of derivative data.
[2025-10-24T19:56:58.363222] [DEBUG] [LOCAL     ] MMU: Deleted derivative data file.
[2025-10-24T19:56:58.363292] [INFO ] [MAIN      ] Update Progress: 1378/2366 symbols completed. MMU took 35.2s. Estimated remaining: 2h 6m 51s. Rate: 7.8 symbols/min
[2025-10-24T19:56:58.535857] [INFO ] [MAIN      ] MOD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:56:58.547608] [INFO ] [REMOTE    ] MNSO: Fetching primary data for 2025-04.
[2025-10-24T19:56:58.583234] [DEBUG] [LOCAL     ] MOD: Loaded 44795 existing records from primary storage.
[2025-10-24T19:56:58.583551] [INFO ] [MAIN      ] MOD: Loaded 44795 existing records.
[2025-10-24T19:56:58.761668] [WARN ] [MAIN      ] MOD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:56:58.761896] [INFO ] [MAIN      ] MOD: Wiping existing primary data before full refresh.
[2025-10-24T19:56:58.761952] [INFO ] [LOCAL     ] MOD: Starting deletion of primary data.
[2025-10-24T19:56:58.762372] [DEBUG] [LOCAL     ] MOD: Deleted primary data file.
[2025-10-24T19:56:58.762429] [INFO ] [MAIN      ] MOD: Starting full primary refresh.
[2025-10-24T19:56:59.120869] [INFO ] [REMOTE    ] MNR: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T19:56:59.143733] [INFO ] [REMOTE    ] MOD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:56:59.347632] [INFO ] [REMOTE    ] MNR: Fetching primary data for 2025-06.
[2025-10-24T19:57:00.155634] [INFO ] [REMOTE    ] MO: Fetching primary data for 2025-02.
[2025-10-24T19:57:00.160523] [INFO ] [REMOTE    ] MNSO: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T19:57:00.600185] [INFO ] [REMOTE    ] MNR: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T19:57:00.947714] [INFO ] [REMOTE    ] MOD: Fetching primary data for 2025-01.
[2025-10-24T19:57:01.747765] [INFO ] [REMOTE    ] MNR: Fetching primary data for 2025-07.
[2025-10-24T19:57:02.411349] [INFO ] [REMOTE    ] MO: Incremental fetch complete for 2025-02 (2.26 seconds).
[2025-10-24T19:57:02.547766] [INFO ] [REMOTE    ] MO: Fetching primary data for 2025-03.
[2025-10-24T19:57:02.675565] [INFO ] [REMOTE    ] MOD: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T19:57:03.205534] [INFO ] [REMOTE    ] MNR: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T19:57:03.347760] [INFO ] [REMOTE    ] MNR: Fetching primary data for 2025-08.
[2025-10-24T19:57:04.147755] [INFO ] [REMOTE    ] MNSO: Fetching primary data for 2025-05.
[2025-10-24T19:57:04.532865] [INFO ] [REMOTE    ] MNR: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T19:57:04.952910] [INFO ] [REMOTE    ] MNR: Fetching primary data for 2025-09.
[2025-10-24T19:57:04.982451] [INFO ] [REMOTE    ] MO: Incremental fetch complete for 2025-03 (2.43 seconds).
[2025-10-24T19:57:05.747614] [INFO ] [REMOTE    ] MO: Fetching primary data for 2025-04.
[2025-10-24T19:57:05.965790] [INFO ] [REMOTE    ] MNSO: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T19:57:05.995287] [INFO ] [REMOTE    ] MNR: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T19:57:06.547766] [INFO ] [REMOTE    ] MOD: Fetching primary data for 2025-02.
[2025-10-24T19:57:07.347673] [INFO ] [REMOTE    ] MNR: Fetching primary data for 2025-10.
[2025-10-24T19:57:08.038746] [INFO ] [REMOTE    ] MO: Incremental fetch complete for 2025-04 (2.29 seconds).
[2025-10-24T19:57:08.138435] [INFO ] [REMOTE    ] MOD: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T19:57:08.147856] [INFO ] [REMOTE    ] MNSO: Fetching primary data for 2025-06.
[2025-10-24T19:57:08.470037] [INFO ] [REMOTE    ] MNR: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T19:57:08.475096] [INFO ] [REMOTE    ] MNR: Full fetch complete (37010 records).
[2025-10-24T19:57:08.475192] [DEBUG] [VALIDATOR ] MNR: Validating primary data.
[2025-10-24T19:57:08.847391] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present.
[2025-10-24T19:57:08.847473] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed.
[2025-10-24T19:57:08.848227] [INFO ] [MAIN      ] MNR: Fetched primary data is valid.
[2025-10-24T19:57:08.848288] [DEBUG] [LOCAL     ] MNR: Saving primary data.
[2025-10-24T19:57:08.848617] [FATAL] [LOCAL     ] MNR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:57:08.848727] [FATAL] [MAIN      ] MNR: Failed to save primary data.
[2025-10-24T19:57:08.848769] [WARN ] [MAIN      ] MNR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:57:08.848803] [INFO ] [LOCAL     ] MNR: Starting deletion of primary data.
[2025-10-24T19:57:08.848851] [DEBUG] [LOCAL     ] MNR: No primary data file found to delete.
[2025-10-24T19:57:08.848885] [INFO ] [LOCAL     ] MNR: Starting deletion of derivative data.
[2025-10-24T19:57:08.849026] [DEBUG] [LOCAL     ] MNR: Deleted derivative data file.
[2025-10-24T19:57:08.849113] [INFO ] [MAIN      ] Update Progress: 1379/2366 symbols completed. MNR took 26.1s. Estimated remaining: 2h 6m 45s. Rate: 7.8 symbols/min
[2025-10-24T19:57:08.952560] [INFO ] [REMOTE    ] MOD: Fetching primary data for 2025-03.
[2025-10-24T19:57:09.022700] [INFO ] [MAIN      ] MODG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:57:09.071595] [DEBUG] [LOCAL     ] MODG: Loaded 51898 existing records from primary storage.
[2025-10-24T19:57:09.071912] [INFO ] [MAIN      ] MODG: Loaded 51898 existing records.
[2025-10-24T19:57:09.253830] [WARN ] [MAIN      ] MODG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:57:09.254125] [INFO ] [MAIN      ] MODG: Wiping existing primary data before full refresh.
[2025-10-24T19:57:09.254300] [INFO ] [LOCAL     ] MODG: Starting deletion of primary data.
[2025-10-24T19:57:09.254732] [DEBUG] [LOCAL     ] MODG: Deleted primary data file.
[2025-10-24T19:57:09.254790] [INFO ] [MAIN      ] MODG: Starting full primary refresh.
[2025-10-24T19:57:09.618407] [INFO ] [REMOTE    ] MODG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:57:09.642518] [INFO ] [REMOTE    ] MNSO: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T19:57:09.747677] [INFO ] [REMOTE    ] MODG: Fetching primary data for 2025-01.
[2025-10-24T19:57:10.516075] [INFO ] [REMOTE    ] MOD: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T19:57:10.547705] [INFO ] [REMOTE    ] MO: Fetching primary data for 2025-05.
[2025-10-24T19:57:11.347685] [INFO ] [REMOTE    ] MNSO: Fetching primary data for 2025-07.
[2025-10-24T19:57:11.539446] [INFO ] [REMOTE    ] MODG: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T19:57:12.147675] [INFO ] [REMOTE    ] MODG: Fetching primary data for 2025-02.
[2025-10-24T19:57:12.809154] [INFO ] [REMOTE    ] MNSO: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T19:57:12.875440] [INFO ] [REMOTE    ] MO: Incremental fetch complete for 2025-05 (2.33 seconds).
[2025-10-24T19:57:12.947627] [INFO ] [REMOTE    ] MNSO: Fetching primary data for 2025-08.
[2025-10-24T19:57:13.722046] [INFO ] [REMOTE    ] MODG: Incremental fetch complete for 2025-02 (1.57 seconds).
[2025-10-24T19:57:13.747617] [INFO ] [REMOTE    ] MODG: Fetching primary data for 2025-03.
[2025-10-24T19:57:14.365542] [INFO ] [REMOTE    ] MNSO: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T19:57:14.547741] [INFO ] [REMOTE    ] MNSO: Fetching primary data for 2025-09.
[2025-10-24T19:57:14.989377] [INFO ] [REMOTE    ] MODG: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T19:57:15.347688] [INFO ] [REMOTE    ] MODG: Fetching primary data for 2025-04.
[2025-10-24T19:57:16.045622] [INFO ] [REMOTE    ] MNSO: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T19:57:16.147633] [INFO ] [REMOTE    ] MNSO: Fetching primary data for 2025-10.
[2025-10-24T19:57:16.941814] [INFO ] [REMOTE    ] MODG: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T19:57:16.952445] [INFO ] [REMOTE    ] MO: Fetching primary data for 2025-06.
[2025-10-24T19:57:17.757659] [INFO ] [REMOTE    ] MODG: Fetching primary data for 2025-05.
[2025-10-24T19:57:17.761952] [INFO ] [REMOTE    ] MNSO: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T19:57:17.773593] [INFO ] [REMOTE    ] MNSO: Full fetch complete (64457 records).
[2025-10-24T19:57:17.773767] [DEBUG] [VALIDATOR ] MNSO: Validating primary data.
[2025-10-24T19:57:18.152548] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present.
[2025-10-24T19:57:18.152628] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed.
[2025-10-24T19:57:18.153630] [INFO ] [MAIN      ] MNSO: Fetched primary data is valid.
[2025-10-24T19:57:18.153710] [DEBUG] [LOCAL     ] MNSO: Saving primary data.
[2025-10-24T19:57:18.154191] [FATAL] [LOCAL     ] MNSO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:57:18.154275] [FATAL] [MAIN      ] MNSO: Failed to save primary data.
[2025-10-24T19:57:18.154316] [WARN ] [MAIN      ] MNSO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:57:18.154350] [INFO ] [LOCAL     ] MNSO: Starting deletion of primary data.
[2025-10-24T19:57:18.154399] [DEBUG] [LOCAL     ] MNSO: No primary data file found to delete.
[2025-10-24T19:57:18.154434] [INFO ] [LOCAL     ] MNSO: Starting deletion of derivative data.
[2025-10-24T19:57:18.154569] [DEBUG] [LOCAL     ] MNSO: Deleted derivative data file.
[2025-10-24T19:57:18.154803] [INFO ] [MAIN      ] Update Progress: 1380/2366 symbols completed. MNSO took 30.4s. Estimated remaining: 2h 6m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:57:18.321278] [INFO ] [MAIN      ] MOH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:57:18.362992] [DEBUG] [LOCAL     ] MOH: Loaded 43431 existing records from primary storage.
[2025-10-24T19:57:18.363262] [INFO ] [MAIN      ] MOH: Loaded 43431 existing records.
[2025-10-24T19:57:18.546198] [WARN ] [MAIN      ] MOH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:57:18.546514] [INFO ] [MAIN      ] MOH: Wiping existing primary data before full refresh.
[2025-10-24T19:57:18.546678] [INFO ] [LOCAL     ] MOH: Starting deletion of primary data.
[2025-10-24T19:57:18.547052] [DEBUG] [LOCAL     ] MOH: Deleted primary data file.
[2025-10-24T19:57:18.547109] [INFO ] [MAIN      ] MOH: Starting full primary refresh.
[2025-10-24T19:57:18.558198] [INFO ] [REMOTE    ] MOD: Fetching primary data for 2025-04.
[2025-10-24T19:57:18.847532] [INFO ] [REMOTE    ] MO: Incremental fetch complete for 2025-06 (1.90 seconds).
[2025-10-24T19:57:18.942806] [INFO ] [REMOTE    ] MOH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:57:19.347738] [INFO ] [REMOTE    ] MOH: Fetching primary data for 2025-01.
[2025-10-24T19:57:19.617026] [INFO ] [REMOTE    ] MODG: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T19:57:20.147625] [INFO ] [REMOTE    ] MODG: Fetching primary data for 2025-06.
[2025-10-24T19:57:20.377447] [INFO ] [REMOTE    ] MOD: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T19:57:20.442272] [INFO ] [REMOTE    ] MOH: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T19:57:20.947710] [INFO ] [REMOTE    ] MOH: Fetching primary data for 2025-02.
[2025-10-24T19:57:21.747713] [INFO ] [REMOTE    ] MOD: Fetching primary data for 2025-05.
[2025-10-24T19:57:21.897314] [INFO ] [REMOTE    ] MODG: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T19:57:22.463849] [INFO ] [REMOTE    ] MOH: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T19:57:22.547606] [INFO ] [REMOTE    ] MOH: Fetching primary data for 2025-03.
[2025-10-24T19:57:23.045952] [INFO ] [REMOTE    ] MOD: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T19:57:23.347720] [INFO ] [REMOTE    ] MOD: Fetching primary data for 2025-06.
[2025-10-24T19:57:24.045987] [INFO ] [REMOTE    ] MOH: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T19:57:24.147621] [INFO ] [REMOTE    ] MODG: Fetching primary data for 2025-07.
[2025-10-24T19:57:24.719847] [INFO ] [REMOTE    ] MOD: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T19:57:24.947712] [INFO ] [REMOTE    ] MOH: Fetching primary data for 2025-04.
[2025-10-24T19:57:25.747622] [INFO ] [REMOTE    ] MO: Fetching primary data for 2025-07.
[2025-10-24T19:57:25.988556] [INFO ] [REMOTE    ] MODG: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T19:57:26.527771] [INFO ] [REMOTE    ] MOH: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T19:57:26.547607] [INFO ] [REMOTE    ] MOH: Fetching primary data for 2025-05.
[2025-10-24T19:57:27.347703] [INFO ] [REMOTE    ] MODG: Fetching primary data for 2025-08.
[2025-10-24T19:57:27.919824] [INFO ] [REMOTE    ] MO: Incremental fetch complete for 2025-07 (2.17 seconds).
[2025-10-24T19:57:28.147754] [INFO ] [REMOTE    ] MO: Fetching primary data for 2025-08.
[2025-10-24T19:57:28.194486] [INFO ] [REMOTE    ] MOH: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T19:57:28.951703] [INFO ] [REMOTE    ] MOD: Fetching primary data for 2025-07.
[2025-10-24T19:57:28.964081] [INFO ] [REMOTE    ] MODG: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T19:57:29.747749] [INFO ] [REMOTE    ] MOH: Fetching primary data for 2025-06.
[2025-10-24T19:57:30.368891] [INFO ] [REMOTE    ] MO: Incremental fetch complete for 2025-08 (2.22 seconds).
[2025-10-24T19:57:30.547630] [INFO ] [REMOTE    ] MO: Fetching primary data for 2025-09.
[2025-10-24T19:57:30.731421] [INFO ] [REMOTE    ] MOD: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T19:57:30.965296] [INFO ] [REMOTE    ] MOH: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T19:57:31.347664] [INFO ] [REMOTE    ] MOD: Fetching primary data for 2025-08.
[2025-10-24T19:57:32.147621] [INFO ] [REMOTE    ] MOH: Fetching primary data for 2025-07.
[2025-10-24T19:57:32.556114] [INFO ] [REMOTE    ] MO: Incremental fetch complete for 2025-09 (2.01 seconds).
[2025-10-24T19:57:32.779472] [INFO ] [REMOTE    ] MOD: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T19:57:32.947637] [INFO ] [REMOTE    ] MOD: Fetching primary data for 2025-09.
[2025-10-24T19:57:33.747695] [INFO ] [REMOTE    ] MODG: Fetching primary data for 2025-09.
[2025-10-24T19:57:33.846209] [INFO ] [REMOTE    ] MOH: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T19:57:34.009896] [INFO ] [REMOTE    ] MOD: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T19:57:34.547672] [INFO ] [REMOTE    ] MO: Fetching primary data for 2025-10.
[2025-10-24T19:57:35.347740] [INFO ] [REMOTE    ] MOH: Fetching primary data for 2025-08.
[2025-10-24T19:57:35.433741] [INFO ] [REMOTE    ] MODG: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T19:57:36.147674] [INFO ] [REMOTE    ] MODG: Fetching primary data for 2025-10.
[2025-10-24T19:57:36.955225] [INFO ] [REMOTE    ] MOD: Fetching primary data for 2025-10.
[2025-10-24T19:57:36.957708] [INFO ] [REMOTE    ] MO: Incremental fetch complete for 2025-10 (2.41 seconds).
[2025-10-24T19:57:36.967786] [INFO ] [REMOTE    ] MO: Full fetch complete (77541 records).
[2025-10-24T19:57:36.967930] [DEBUG] [VALIDATOR ] MO: Validating primary data.
[2025-10-24T19:57:37.177147] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T19:57:37.178081] [FATAL] [MAIN      ] MO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:57:37.178218] [WARN ] [MAIN      ] MO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:57:37.178434] [INFO ] [LOCAL     ] MO: Starting deletion of primary data.
[2025-10-24T19:57:37.178566] [DEBUG] [LOCAL     ] MO: No primary data file found to delete.
[2025-10-24T19:57:37.178744] [INFO ] [LOCAL     ] MO: Starting deletion of derivative data.
[2025-10-24T19:57:37.178916] [DEBUG] [LOCAL     ] MO: No derivative data file found to delete.
[2025-10-24T19:57:37.179215] [INFO ] [MAIN      ] Update Progress: 1381/2366 symbols completed. MO took 42.4s. Estimated remaining: 2h 6m 39s. Rate: 7.8 symbols/min
[2025-10-24T19:57:37.338855] [INFO ] [REMOTE    ] MOH: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T19:57:37.406181] [INFO ] [MAIN      ] MOS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:57:37.462314] [DEBUG] [LOCAL     ] MOS: Loaded 53900 existing records from primary storage.
[2025-10-24T19:57:37.462714] [INFO ] [MAIN      ] MOS: Loaded 53900 existing records.
[2025-10-24T19:57:37.637896] [WARN ] [MAIN      ] MOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:57:37.638144] [INFO ] [MAIN      ] MOS: Wiping existing primary data before full refresh.
[2025-10-24T19:57:37.638227] [INFO ] [LOCAL     ] MOS: Starting deletion of primary data.
[2025-10-24T19:57:37.638607] [DEBUG] [LOCAL     ] MOS: Deleted primary data file.
[2025-10-24T19:57:37.638730] [INFO ] [MAIN      ] MOS: Starting full primary refresh.
[2025-10-24T19:57:37.757705] [INFO ] [REMOTE    ] MOH: Fetching primary data for 2025-09.
[2025-10-24T19:57:37.948991] [INFO ] [REMOTE    ] MODG: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T19:57:37.979830] [INFO ] [REMOTE    ] MODG: Full fetch complete (74784 records).
[2025-10-24T19:57:38.007760] [DEBUG] [VALIDATOR ] MODG: Validating primary data.
[2025-10-24T19:57:38.042298] [INFO ] [REMOTE    ] MOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:57:38.433900] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present.
[2025-10-24T19:57:38.434067] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed.
[2025-10-24T19:57:38.435363] [INFO ] [MAIN      ] MODG: Fetched primary data is valid.
[2025-10-24T19:57:38.435492] [DEBUG] [LOCAL     ] MODG: Saving primary data.
[2025-10-24T19:57:38.436181] [FATAL] [LOCAL     ] MODG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:57:38.436268] [FATAL] [MAIN      ] MODG: Failed to save primary data.
[2025-10-24T19:57:38.436331] [WARN ] [MAIN      ] MODG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:57:38.436400] [INFO ] [LOCAL     ] MODG: Starting deletion of primary data.
[2025-10-24T19:57:38.436464] [DEBUG] [LOCAL     ] MODG: No primary data file found to delete.
[2025-10-24T19:57:38.436502] [INFO ] [LOCAL     ] MODG: Starting deletion of derivative data.
[2025-10-24T19:57:38.436673] [DEBUG] [LOCAL     ] MODG: Deleted derivative data file.
[2025-10-24T19:57:38.437130] [INFO ] [MAIN      ] Update Progress: 1382/2366 symbols completed. MODG took 29.6s. Estimated remaining: 2h 6m 27s. Rate: 7.8 symbols/min
[2025-10-24T19:57:38.552396] [INFO ] [REMOTE    ] MOS: Fetching primary data for 2025-01.
[2025-10-24T19:57:38.617070] [INFO ] [MAIN      ] MOV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:57:38.640985] [DEBUG] [LOCAL     ] MOV: Loaded 21238 existing records from primary storage.
[2025-10-24T19:57:38.641307] [INFO ] [MAIN      ] MOV: Loaded 21238 existing records.
[2025-10-24T19:57:38.841853] [INFO ] [REMOTE    ] MOD: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T19:57:38.854496] [WARN ] [MAIN      ] MOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:57:38.862773] [INFO ] [MAIN      ] MOV: Wiping existing primary data before full refresh.
[2025-10-24T19:57:38.862861] [INFO ] [LOCAL     ] MOV: Starting deletion of primary data.
[2025-10-24T19:57:38.863031] [INFO ] [REMOTE    ] MOD: Full fetch complete (66457 records).
[2025-10-24T19:57:38.863156] [DEBUG] [LOCAL     ] MOV: Deleted primary data file.
[2025-10-24T19:57:38.863240] [INFO ] [MAIN      ] MOV: Starting full primary refresh.
[2025-10-24T19:57:38.863124] [DEBUG] [VALIDATOR ] MOD: Validating primary data.
[2025-10-24T19:57:39.710344] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present.
[2025-10-24T19:57:39.710155] [INFO ] [REMOTE    ] MOV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:57:39.710516] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed.
[2025-10-24T19:57:39.710866] [INFO ] [REMOTE    ] MOV: Fetching primary data for 2025-01.
[2025-10-24T19:57:39.712737] [INFO ] [MAIN      ] MOD: Fetched primary data is valid.
[2025-10-24T19:57:39.713764] [DEBUG] [LOCAL     ] MOD: Saving primary data.
[2025-10-24T19:57:39.724799] [FATAL] [LOCAL     ] MOD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:57:39.740971] [FATAL] [MAIN      ] MOD: Failed to save primary data.
[2025-10-24T19:57:39.742718] [INFO ] [REMOTE    ] MOH: Incremental fetch complete for 2025-09 (1.99 seconds).
[2025-10-24T19:57:39.743002] [WARN ] [MAIN      ] MOD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:57:39.752920] [INFO ] [LOCAL     ] MOD: Starting deletion of primary data.
[2025-10-24T19:57:39.753003] [DEBUG] [LOCAL     ] MOD: No primary data file found to delete.
[2025-10-24T19:57:39.753044] [INFO ] [LOCAL     ] MOD: Starting deletion of derivative data.
[2025-10-24T19:57:39.753461] [DEBUG] [LOCAL     ] MOD: Deleted derivative data file.
[2025-10-24T19:57:39.753733] [INFO ] [MAIN      ] Update Progress: 1383/2366 symbols completed. MOD took 41.4s. Estimated remaining: 2h 6m 15s. Rate: 7.8 symbols/min
[2025-10-24T19:57:39.949978] [INFO ] [MAIN      ] MP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:57:39.988050] [INFO ] [REMOTE    ] MOS: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T19:57:40.048676] [DEBUG] [LOCAL     ] MP: Loaded 54134 existing records from primary storage.
[2025-10-24T19:57:40.049031] [INFO ] [MAIN      ] MP: Loaded 54134 existing records.
[2025-10-24T19:57:40.153403] [INFO ] [REMOTE    ] MOH: Fetching primary data for 2025-10.
[2025-10-24T19:57:40.259093] [WARN ] [MAIN      ] MP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:57:40.259393] [INFO ] [MAIN      ] MP: Wiping existing primary data before full refresh.
[2025-10-24T19:57:40.259467] [INFO ] [LOCAL     ] MP: Starting deletion of primary data.
[2025-10-24T19:57:40.260190] [DEBUG] [LOCAL     ] MP: Deleted primary data file.
[2025-10-24T19:57:40.260247] [INFO ] [MAIN      ] MP: Starting full primary refresh.
[2025-10-24T19:57:40.574832] [INFO ] [REMOTE    ] MOV: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T19:57:40.685897] [INFO ] [REMOTE    ] MP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:57:40.947731] [INFO ] [REMOTE    ] MP: Fetching primary data for 2025-01.
[2025-10-24T19:57:41.747681] [INFO ] [REMOTE    ] MOV: Fetching primary data for 2025-02.
[2025-10-24T19:57:41.801252] [INFO ] [REMOTE    ] MOH: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T19:57:41.811786] [INFO ] [REMOTE    ] MOH: Full fetch complete (60217 records).
[2025-10-24T19:57:41.811978] [DEBUG] [VALIDATOR ] MOH: Validating primary data.
[2025-10-24T19:57:42.189804] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present.
[2025-10-24T19:57:42.189937] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed.
[2025-10-24T19:57:42.191022] [INFO ] [MAIN      ] MOH: Fetched primary data is valid.
[2025-10-24T19:57:42.191084] [DEBUG] [LOCAL     ] MOH: Saving primary data.
[2025-10-24T19:57:42.191609] [FATAL] [LOCAL     ] MOH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:57:42.191719] [FATAL] [MAIN      ] MOH: Failed to save primary data.
[2025-10-24T19:57:42.191761] [WARN ] [MAIN      ] MOH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:57:42.191795] [INFO ] [LOCAL     ] MOH: Starting deletion of primary data.
[2025-10-24T19:57:42.191848] [DEBUG] [LOCAL     ] MOH: No primary data file found to delete.
[2025-10-24T19:57:42.191883] [INFO ] [LOCAL     ] MOH: Starting deletion of derivative data.
[2025-10-24T19:57:42.192045] [DEBUG] [LOCAL     ] MOH: Deleted derivative data file.
[2025-10-24T19:57:42.192683] [INFO ] [MAIN      ] Update Progress: 1384/2366 symbols completed. MOH took 24.0s. Estimated remaining: 2h 6m 3s. Rate: 7.8 symbols/min
[2025-10-24T19:57:42.358512] [INFO ] [MAIN      ] MPA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:57:42.367749] [DEBUG] [LOCAL     ] MPA: Loaded 5223 existing records from primary storage.
[2025-10-24T19:57:42.367986] [INFO ] [MAIN      ] MPA: Loaded 5223 existing records.
[2025-10-24T19:57:42.542388] [WARN ] [MAIN      ] MPA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:57:42.542564] [INFO ] [MAIN      ] MPA: Wiping existing primary data before full refresh.
[2025-10-24T19:57:42.542611] [INFO ] [LOCAL     ] MPA: Starting deletion of primary data.
[2025-10-24T19:57:42.542923] [DEBUG] [LOCAL     ] MPA: Deleted primary data file.
[2025-10-24T19:57:42.542979] [INFO ] [MAIN      ] MPA: Starting full primary refresh.
[2025-10-24T19:57:42.554202] [INFO ] [REMOTE    ] MOS: Fetching primary data for 2025-02.
[2025-10-24T19:57:42.816775] [INFO ] [REMOTE    ] MOV: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T19:57:42.926009] [INFO ] [REMOTE    ] MPA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:57:42.957055] [INFO ] [REMOTE    ] MP: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T19:57:43.347714] [INFO ] [REMOTE    ] MPA: Fetching primary data for 2025-01.
[2025-10-24T19:57:44.040126] [INFO ] [REMOTE    ] MPA: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T19:57:44.147637] [INFO ] [REMOTE    ] MP: Fetching primary data for 2025-02.
[2025-10-24T19:57:44.257320] [INFO ] [REMOTE    ] MOS: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T19:57:44.947673] [INFO ] [REMOTE    ] MOS: Fetching primary data for 2025-03.
[2025-10-24T19:57:45.747635] [INFO ] [REMOTE    ] MPA: Fetching primary data for 2025-02.
[2025-10-24T19:57:45.982885] [INFO ] [REMOTE    ] MP: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T19:57:46.361418] [INFO ] [REMOTE    ] MPA: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T19:57:46.547715] [INFO ] [REMOTE    ] MOV: Fetching primary data for 2025-03.
[2025-10-24T19:57:46.687258] [INFO ] [REMOTE    ] MOS: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T19:57:47.347718] [INFO ] [REMOTE    ] MP: Fetching primary data for 2025-03.
[2025-10-24T19:57:47.564836] [INFO ] [REMOTE    ] MOV: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T19:57:48.147667] [INFO ] [REMOTE    ] MOV: Fetching primary data for 2025-04.
[2025-10-24T19:57:48.971161] [INFO ] [REMOTE    ] MPA: Fetching primary data for 2025-03.
[2025-10-24T19:57:48.994078] [INFO ] [REMOTE    ] MP: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T19:57:49.554912] [INFO ] [REMOTE    ] MOV: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T19:57:49.568381] [INFO ] [REMOTE    ] MPA: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T19:57:49.747624] [INFO ] [REMOTE    ] MPA: Fetching primary data for 2025-04.
[2025-10-24T19:57:50.475959] [INFO ] [REMOTE    ] MPA: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T19:57:50.547680] [INFO ] [REMOTE    ] MPA: Fetching primary data for 2025-05.
[2025-10-24T19:57:51.132868] [INFO ] [REMOTE    ] MPA: Incremental fetch complete for 2025-05 (0.59 seconds).
[2025-10-24T19:57:51.347639] [INFO ] [REMOTE    ] MOS: Fetching primary data for 2025-04.
[2025-10-24T19:57:52.147724] [INFO ] [REMOTE    ] MP: Fetching primary data for 2025-04.
[2025-10-24T19:57:52.947620] [INFO ] [REMOTE    ] MPA: Fetching primary data for 2025-06.
[2025-10-24T19:57:53.233330] [INFO ] [REMOTE    ] MOS: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T19:57:53.577456] [INFO ] [REMOTE    ] MPA: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T19:57:53.747716] [INFO ] [REMOTE    ] MPA: Fetching primary data for 2025-07.
[2025-10-24T19:57:54.132302] [INFO ] [REMOTE    ] MPA: Incremental fetch complete for 2025-07 (0.38 seconds).
[2025-10-24T19:57:54.165289] [INFO ] [REMOTE    ] MP: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T19:57:54.547676] [INFO ] [REMOTE    ] MP: Fetching primary data for 2025-05.
[2025-10-24T19:57:55.347666] [INFO ] [REMOTE    ] MOV: Fetching primary data for 2025-05.
[2025-10-24T19:57:56.147618] [INFO ] [REMOTE    ] MOS: Fetching primary data for 2025-05.
[2025-10-24T19:57:56.494023] [INFO ] [REMOTE    ] MP: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T19:57:56.520421] [INFO ] [REMOTE    ] MOV: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T19:57:56.947676] [INFO ] [REMOTE    ] MOV: Fetching primary data for 2025-06.
[2025-10-24T19:57:57.747718] [INFO ] [REMOTE    ] MP: Fetching primary data for 2025-06.
[2025-10-24T19:57:58.015319] [INFO ] [REMOTE    ] MOS: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T19:57:58.040847] [INFO ] [REMOTE    ] MOV: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T19:57:58.547703] [INFO ] [REMOTE    ] MOV: Fetching primary data for 2025-07.
[2025-10-24T19:57:59.347619] [INFO ] [REMOTE    ] MOS: Fetching primary data for 2025-06.
[2025-10-24T19:57:59.587730] [INFO ] [REMOTE    ] MOV: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T19:58:00.147690] [INFO ] [REMOTE    ] MOV: Fetching primary data for 2025-08.
[2025-10-24T19:58:00.785480] [INFO ] [REMOTE    ] MP: Incremental fetch complete for 2025-06 (3.04 seconds).
[2025-10-24T19:58:00.947672] [INFO ] [REMOTE    ] MP: Fetching primary data for 2025-07.
[2025-10-24T19:58:01.234417] [INFO ] [REMOTE    ] MOS: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T19:58:01.276177] [INFO ] [REMOTE    ] MOV: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T19:58:01.747721] [INFO ] [REMOTE    ] MOS: Fetching primary data for 2025-07.
[2025-10-24T19:58:02.547693] [INFO ] [REMOTE    ] MOV: Fetching primary data for 2025-09.
[2025-10-24T19:58:03.325460] [INFO ] [REMOTE    ] MP: Incremental fetch complete for 2025-07 (2.38 seconds).
[2025-10-24T19:58:03.347609] [INFO ] [REMOTE    ] MP: Fetching primary data for 2025-08.
[2025-10-24T19:58:03.754122] [INFO ] [REMOTE    ] MOV: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T19:58:04.023251] [INFO ] [REMOTE    ] MOS: Incremental fetch complete for 2025-07 (2.28 seconds).
[2025-10-24T19:58:04.147606] [INFO ] [REMOTE    ] MOS: Fetching primary data for 2025-08.
[2025-10-24T19:58:04.947627] [INFO ] [REMOTE    ] MPA: Fetching primary data for 2025-08.
[2025-10-24T19:58:05.673324] [INFO ] [REMOTE    ] MPA: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T19:58:05.747614] [INFO ] [REMOTE    ] MPA: Fetching primary data for 2025-09.
[2025-10-24T19:58:06.264589] [INFO ] [REMOTE    ] MOS: Incremental fetch complete for 2025-08 (2.12 seconds).
[2025-10-24T19:58:06.377989] [INFO ] [REMOTE    ] MP: Incremental fetch complete for 2025-08 (3.03 seconds).
[2025-10-24T19:58:06.500039] [INFO ] [REMOTE    ] MPA: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T19:58:06.547666] [INFO ] [REMOTE    ] MOV: Fetching primary data for 2025-10.
[2025-10-24T19:58:07.347614] [INFO ] [REMOTE    ] MOS: Fetching primary data for 2025-09.
[2025-10-24T19:58:07.797393] [INFO ] [REMOTE    ] MOV: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T19:58:07.800985] [INFO ] [REMOTE    ] MOV: Full fetch complete (30450 records).
[2025-10-24T19:58:07.801107] [DEBUG] [VALIDATOR ] MOV: Validating primary data.
[2025-10-24T19:58:08.157249] [INFO ] [REMOTE    ] MPA: Fetching primary data for 2025-10.
[2025-10-24T19:58:08.188226] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present.
[2025-10-24T19:58:08.188308] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed.
[2025-10-24T19:58:08.189055] [INFO ] [MAIN      ] MOV: Fetched primary data is valid.
[2025-10-24T19:58:08.189231] [DEBUG] [LOCAL     ] MOV: Saving primary data.
[2025-10-24T19:58:08.189582] [FATAL] [LOCAL     ] MOV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:58:08.189688] [FATAL] [MAIN      ] MOV: Failed to save primary data.
[2025-10-24T19:58:08.189755] [WARN ] [MAIN      ] MOV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:58:08.189843] [INFO ] [LOCAL     ] MOV: Starting deletion of primary data.
[2025-10-24T19:58:08.189962] [DEBUG] [LOCAL     ] MOV: No primary data file found to delete.
[2025-10-24T19:58:08.190020] [INFO ] [LOCAL     ] MOV: Starting deletion of derivative data.
[2025-10-24T19:58:08.190202] [DEBUG] [LOCAL     ] MOV: Deleted derivative data file.
[2025-10-24T19:58:08.190297] [INFO ] [MAIN      ] Update Progress: 1385/2366 symbols completed. MOV took 29.8s. Estimated remaining: 2h 6m 8s. Rate: 7.8 symbols/min
[2025-10-24T19:58:08.371442] [INFO ] [MAIN      ] MPC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:58:08.427590] [DEBUG] [LOCAL     ] MPC: Loaded 52270 existing records from primary storage.
[2025-10-24T19:58:08.427980] [INFO ] [MAIN      ] MPC: Loaded 52270 existing records.
[2025-10-24T19:58:08.603544] [WARN ] [MAIN      ] MPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:58:08.603771] [INFO ] [MAIN      ] MPC: Wiping existing primary data before full refresh.
[2025-10-24T19:58:08.603836] [INFO ] [LOCAL     ] MPC: Starting deletion of primary data.
[2025-10-24T19:58:08.604432] [DEBUG] [LOCAL     ] MPC: Deleted primary data file.
[2025-10-24T19:58:08.604489] [INFO ] [MAIN      ] MPC: Starting full primary refresh.
[2025-10-24T19:58:08.912799] [INFO ] [REMOTE    ] MPA: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T19:58:08.962984] [INFO ] [REMOTE    ] MPA: Full fetch complete (7081 records).
[2025-10-24T19:58:08.963053] [INFO ] [REMOTE    ] MP: Fetching primary data for 2025-09.
[2025-10-24T19:58:08.977817] [DEBUG] [VALIDATOR ] MPA: Validating primary data.
[2025-10-24T19:58:08.976911] [INFO ] [REMOTE    ] MPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:58:09.374204] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present.
[2025-10-24T19:58:09.376092] [INFO ] [REMOTE    ] MOS: Incremental fetch complete for 2025-09 (2.03 seconds).
[2025-10-24T19:58:09.376200] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed.
[2025-10-24T19:58:09.387806] [INFO ] [MAIN      ] MPA: Fetched primary data is valid.
[2025-10-24T19:58:09.387948] [DEBUG] [LOCAL     ] MPA: Saving primary data.
[2025-10-24T19:58:09.388525] [FATAL] [LOCAL     ] MPA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:58:09.388605] [FATAL] [MAIN      ] MPA: Failed to save primary data.
[2025-10-24T19:58:09.388716] [WARN ] [MAIN      ] MPA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:58:09.388814] [INFO ] [LOCAL     ] MPA: Starting deletion of primary data.
[2025-10-24T19:58:09.388891] [DEBUG] [LOCAL     ] MPA: No primary data file found to delete.
[2025-10-24T19:58:09.388943] [INFO ] [LOCAL     ] MPA: Starting deletion of derivative data.
[2025-10-24T19:58:09.389114] [DEBUG] [LOCAL     ] MPA: Deleted derivative data file.
[2025-10-24T19:58:09.389226] [INFO ] [MAIN      ] Update Progress: 1386/2366 symbols completed. MPA took 27.2s. Estimated remaining: 2h 5m 56s. Rate: 7.8 symbols/min
[2025-10-24T19:58:09.556725] [INFO ] [MAIN      ] MPLX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:58:09.606398] [DEBUG] [LOCAL     ] MPLX: Loaded 51157 existing records from primary storage.
[2025-10-24T19:58:09.606735] [INFO ] [MAIN      ] MPLX: Loaded 51157 existing records.
[2025-10-24T19:58:09.752806] [INFO ] [REMOTE    ] MOS: Fetching primary data for 2025-10.
[2025-10-24T19:58:09.789880] [WARN ] [MAIN      ] MPLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:58:09.790112] [INFO ] [MAIN      ] MPLX: Wiping existing primary data before full refresh.
[2025-10-24T19:58:09.790167] [INFO ] [LOCAL     ] MPLX: Starting deletion of primary data.
[2025-10-24T19:58:09.790387] [DEBUG] [LOCAL     ] MPLX: Deleted primary data file.
[2025-10-24T19:58:09.790444] [INFO ] [MAIN      ] MPLX: Starting full primary refresh.
[2025-10-24T19:58:10.144074] [INFO ] [REMOTE    ] MPLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:58:10.547687] [INFO ] [REMOTE    ] MPC: Fetching primary data for 2025-01.
[2025-10-24T19:58:11.347675] [INFO ] [REMOTE    ] MPLX: Fetching primary data for 2025-01.
[2025-10-24T19:58:11.665568] [INFO ] [REMOTE    ] MP: Incremental fetch complete for 2025-09 (2.70 seconds).
[2025-10-24T19:58:11.794049] [INFO ] [REMOTE    ] MOS: Incremental fetch complete for 2025-10 (2.04 seconds).
[2025-10-24T19:58:11.804406] [INFO ] [REMOTE    ] MOS: Full fetch complete (77631 records).
[2025-10-24T19:58:11.804531] [DEBUG] [VALIDATOR ] MOS: Validating primary data.
[2025-10-24T19:58:12.154679] [INFO ] [REMOTE    ] MP: Fetching primary data for 2025-10.
[2025-10-24T19:58:12.202450] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present.
[2025-10-24T19:58:12.202795] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed.
[2025-10-24T19:58:12.203926] [INFO ] [MAIN      ] MOS: Fetched primary data is valid.
[2025-10-24T19:58:12.204008] [DEBUG] [LOCAL     ] MOS: Saving primary data.
[2025-10-24T19:58:12.204699] [FATAL] [LOCAL     ] MOS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:58:12.204794] [FATAL] [MAIN      ] MOS: Failed to save primary data.
[2025-10-24T19:58:12.204856] [WARN ] [MAIN      ] MOS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:58:12.204934] [INFO ] [LOCAL     ] MOS: Starting deletion of primary data.
[2025-10-24T19:58:12.205106] [DEBUG] [LOCAL     ] MOS: No primary data file found to delete.
[2025-10-24T19:58:12.205180] [INFO ] [LOCAL     ] MOS: Starting deletion of derivative data.
[2025-10-24T19:58:12.205478] [DEBUG] [LOCAL     ] MOS: Deleted derivative data file.
[2025-10-24T19:58:12.206061] [INFO ] [MAIN      ] Update Progress: 1387/2366 symbols completed. MOS took 35.0s. Estimated remaining: 2h 5m 45s. Rate: 7.8 symbols/min
[2025-10-24T19:58:12.394005] [INFO ] [MAIN      ] MPV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:58:12.408568] [INFO ] [REMOTE    ] MPC: Incremental fetch complete for 2025-01 (1.86 seconds).
[2025-10-24T19:58:12.424053] [DEBUG] [LOCAL     ] MPV: Loaded 4393 existing records from primary storage.
[2025-10-24T19:58:12.424254] [INFO ] [MAIN      ] MPV: Loaded 4393 existing records.
[2025-10-24T19:58:12.598323] [WARN ] [MAIN      ] MPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:58:12.598530] [INFO ] [MAIN      ] MPV: Wiping existing primary data before full refresh.
[2025-10-24T19:58:12.598576] [INFO ] [LOCAL     ] MPV: Starting deletion of primary data.
[2025-10-24T19:58:12.598718] [DEBUG] [LOCAL     ] MPV: Deleted primary data file.
[2025-10-24T19:58:12.598773] [INFO ] [MAIN      ] MPV: Starting full primary refresh.
[2025-10-24T19:58:12.952942] [INFO ] [REMOTE    ] MPC: Fetching primary data for 2025-02.
[2025-10-24T19:58:12.959196] [INFO ] [REMOTE    ] MPV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:58:13.142965] [INFO ] [REMOTE    ] MPLX: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T19:58:13.747723] [INFO ] [REMOTE    ] MPLX: Fetching primary data for 2025-02.
[2025-10-24T19:58:14.547618] [INFO ] [REMOTE    ] MPV: Fetching primary data for 2025-01.
[2025-10-24T19:58:14.672384] [INFO ] [REMOTE    ] MPC: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T19:58:14.897905] [INFO ] [REMOTE    ] MP: Incremental fetch complete for 2025-10 (2.74 seconds).
[2025-10-24T19:58:14.908138] [INFO ] [REMOTE    ] MP: Full fetch complete (77589 records).
[2025-10-24T19:58:14.908352] [DEBUG] [VALIDATOR ] MP: Validating primary data.
[2025-10-24T19:58:15.225024] [INFO ] [REMOTE    ] MPV: Incremental fetch complete for 2025-01 (0.68 seconds).
[2025-10-24T19:58:15.337794] [DEBUG] [VALIDATOR ] MP: All expected trading days are present.
[2025-10-24T19:58:15.338004] [DEBUG] [VALIDATOR ] MP: Primary data validation passed.
[2025-10-24T19:58:15.339226] [INFO ] [MAIN      ] MP: Fetched primary data is valid.
[2025-10-24T19:58:15.339303] [DEBUG] [LOCAL     ] MP: Saving primary data.
[2025-10-24T19:58:15.340096] [FATAL] [LOCAL     ] MP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:58:15.340185] [FATAL] [MAIN      ] MP: Failed to save primary data.
[2025-10-24T19:58:15.340227] [WARN ] [MAIN      ] MP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:58:15.340265] [INFO ] [LOCAL     ] MP: Starting deletion of primary data.
[2025-10-24T19:58:15.340317] [DEBUG] [LOCAL     ] MP: No primary data file found to delete.
[2025-10-24T19:58:15.340352] [INFO ] [LOCAL     ] MP: Starting deletion of derivative data.
[2025-10-24T19:58:15.340479] [DEBUG] [LOCAL     ] MP: Deleted derivative data file.
[2025-10-24T19:58:15.340854] [INFO ] [MAIN      ] Update Progress: 1388/2366 symbols completed. MP took 35.6s. Estimated remaining: 2h 5m 34s. Rate: 7.8 symbols/min
[2025-10-24T19:58:15.352951] [INFO ] [REMOTE    ] MPV: Fetching primary data for 2025-02.
[2025-10-24T19:58:15.537265] [INFO ] [MAIN      ] MPW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:58:15.548869] [INFO ] [REMOTE    ] MPLX: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T19:58:15.629713] [DEBUG] [LOCAL     ] MPW: Loaded 53872 existing records from primary storage.
[2025-10-24T19:58:15.630124] [INFO ] [MAIN      ] MPW: Loaded 53872 existing records.
[2025-10-24T19:58:15.808920] [WARN ] [MAIN      ] MPW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:58:15.809152] [INFO ] [MAIN      ] MPW: Wiping existing primary data before full refresh.
[2025-10-24T19:58:15.809198] [INFO ] [LOCAL     ] MPW: Starting deletion of primary data.
[2025-10-24T19:58:15.809729] [DEBUG] [LOCAL     ] MPW: Deleted primary data file.
[2025-10-24T19:58:15.809784] [INFO ] [MAIN      ] MPW: Starting full primary refresh.
[2025-10-24T19:58:16.158394] [INFO ] [REMOTE    ] MPLX: Fetching primary data for 2025-03.
[2025-10-24T19:58:16.165434] [INFO ] [REMOTE    ] MPW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:58:16.207934] [INFO ] [REMOTE    ] MPV: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T19:58:16.947713] [INFO ] [REMOTE    ] MPV: Fetching primary data for 2025-03.
[2025-10-24T19:58:17.747692] [INFO ] [REMOTE    ] MPW: Fetching primary data for 2025-01.
[2025-10-24T19:58:17.970887] [INFO ] [REMOTE    ] MPLX: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T19:58:17.977848] [INFO ] [REMOTE    ] MPV: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T19:58:18.547672] [INFO ] [REMOTE    ] MPLX: Fetching primary data for 2025-04.
[2025-10-24T19:58:19.347711] [INFO ] [REMOTE    ] MPV: Fetching primary data for 2025-04.
[2025-10-24T19:58:19.578467] [INFO ] [REMOTE    ] MPW: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T19:58:19.843422] [INFO ] [REMOTE    ] MPLX: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T19:58:19.941899] [INFO ] [REMOTE    ] MPV: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T19:58:20.147706] [INFO ] [REMOTE    ] MPW: Fetching primary data for 2025-02.
[2025-10-24T19:58:20.947731] [INFO ] [REMOTE    ] MPC: Fetching primary data for 2025-03.
[2025-10-24T19:58:21.747678] [INFO ] [REMOTE    ] MPLX: Fetching primary data for 2025-05.
[2025-10-24T19:58:21.947478] [INFO ] [REMOTE    ] MPW: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T19:58:22.257159] [INFO ] [REMOTE    ] MPC: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T19:58:22.547672] [INFO ] [REMOTE    ] MPC: Fetching primary data for 2025-04.
[2025-10-24T19:58:23.347699] [INFO ] [REMOTE    ] MPV: Fetching primary data for 2025-05.
[2025-10-24T19:58:23.489135] [INFO ] [REMOTE    ] MPLX: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T19:58:24.032302] [INFO ] [REMOTE    ] MPV: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T19:58:24.147615] [INFO ] [REMOTE    ] MPV: Fetching primary data for 2025-06.
[2025-10-24T19:58:24.336920] [INFO ] [REMOTE    ] MPC: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T19:58:24.556625] [INFO ] [REMOTE    ] MPV: Incremental fetch complete for 2025-06 (0.41 seconds).
[2025-10-24T19:58:24.947671] [INFO ] [REMOTE    ] MPV: Fetching primary data for 2025-07.
[2025-10-24T19:58:25.490254] [INFO ] [REMOTE    ] MPV: Incremental fetch complete for 2025-07 (0.54 seconds).
[2025-10-24T19:58:25.747677] [INFO ] [REMOTE    ] MPC: Fetching primary data for 2025-05.
[2025-10-24T19:58:26.547717] [INFO ] [REMOTE    ] MPLX: Fetching primary data for 2025-06.
[2025-10-24T19:58:27.347728] [INFO ] [REMOTE    ] MPW: Fetching primary data for 2025-03.
[2025-10-24T19:58:27.656740] [INFO ] [REMOTE    ] MPC: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T19:58:28.120439] [INFO ] [REMOTE    ] MPLX: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T19:58:28.147629] [INFO ] [REMOTE    ] MPLX: Fetching primary data for 2025-07.
[2025-10-24T19:58:28.947686] [INFO ] [REMOTE    ] MPV: Fetching primary data for 2025-08.
[2025-10-24T19:58:29.186041] [INFO ] [REMOTE    ] MPW: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T19:58:29.645466] [INFO ] [REMOTE    ] MPV: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T19:58:29.747687] [INFO ] [REMOTE    ] MPC: Fetching primary data for 2025-06.
[2025-10-24T19:58:29.785215] [INFO ] [REMOTE    ] MPLX: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T19:58:30.547684] [INFO ] [REMOTE    ] MPW: Fetching primary data for 2025-04.
[2025-10-24T19:58:31.347691] [INFO ] [REMOTE    ] MPLX: Fetching primary data for 2025-08.
[2025-10-24T19:58:31.619786] [INFO ] [REMOTE    ] MPC: Incremental fetch complete for 2025-06 (1.87 seconds).
[2025-10-24T19:58:32.147628] [INFO ] [REMOTE    ] MPC: Fetching primary data for 2025-07.
[2025-10-24T19:58:32.472889] [INFO ] [REMOTE    ] MPW: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T19:58:32.720795] [INFO ] [REMOTE    ] MPLX: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T19:58:32.947695] [INFO ] [REMOTE    ] MPW: Fetching primary data for 2025-05.
[2025-10-24T19:58:33.747633] [INFO ] [REMOTE    ] MPV: Fetching primary data for 2025-09.
[2025-10-24T19:58:33.894750] [INFO ] [REMOTE    ] MPC: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T19:58:34.117784] [INFO ] [REMOTE    ] MPV: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T19:58:34.547631] [INFO ] [REMOTE    ] MPLX: Fetching primary data for 2025-09.
[2025-10-24T19:58:34.856304] [INFO ] [REMOTE    ] MPW: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T19:58:35.347690] [INFO ] [REMOTE    ] MPV: Fetching primary data for 2025-10.
[2025-10-24T19:58:35.949469] [INFO ] [REMOTE    ] MPV: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T19:58:35.950902] [INFO ] [REMOTE    ] MPV: Full fetch complete (7597 records).
[2025-10-24T19:58:35.951023] [DEBUG] [VALIDATOR ] MPV: Validating primary data.
[2025-10-24T19:58:36.151944] [INFO ] [REMOTE    ] MPC: Fetching primary data for 2025-08.
[2025-10-24T19:58:36.433962] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present.
[2025-10-24T19:58:36.434091] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed.
[2025-10-24T19:58:36.434356] [INFO ] [MAIN      ] MPV: Fetched primary data is valid.
[2025-10-24T19:58:36.434499] [DEBUG] [LOCAL     ] MPV: Saving primary data.
[2025-10-24T19:58:36.434998] [FATAL] [LOCAL     ] MPV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:58:36.435382] [FATAL] [MAIN      ] MPV: Failed to save primary data.
[2025-10-24T19:58:36.435527] [WARN ] [MAIN      ] MPV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:58:36.435750] [INFO ] [LOCAL     ] MPV: Starting deletion of primary data.
[2025-10-24T19:58:36.435832] [DEBUG] [LOCAL     ] MPV: No primary data file found to delete.
[2025-10-24T19:58:36.453761] [INFO ] [LOCAL     ] MPV: Starting deletion of derivative data.
[2025-10-24T19:58:36.467548] [DEBUG] [LOCAL     ] MPV: Deleted derivative data file.
[2025-10-24T19:58:36.470178] [INFO ] [REMOTE    ] MPLX: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T19:58:36.468157] [INFO ] [MAIN      ] Update Progress: 1389/2366 symbols completed. MPV took 24.3s. Estimated remaining: 2h 5m 36s. Rate: 7.8 symbols/min
[2025-10-24T19:58:36.651946] [INFO ] [MAIN      ] MPX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:58:36.660083] [DEBUG] [LOCAL     ] MPX: Loaded 3981 existing records from primary storage.
[2025-10-24T19:58:36.660299] [INFO ] [MAIN      ] MPX: Loaded 3981 existing records.
[2025-10-24T19:58:36.833938] [WARN ] [MAIN      ] MPX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:58:36.834132] [INFO ] [MAIN      ] MPX: Wiping existing primary data before full refresh.
[2025-10-24T19:58:36.834186] [INFO ] [LOCAL     ] MPX: Starting deletion of primary data.
[2025-10-24T19:58:36.834330] [DEBUG] [LOCAL     ] MPX: Deleted primary data file.
[2025-10-24T19:58:36.834367] [INFO ] [MAIN      ] MPX: Starting full primary refresh.
[2025-10-24T19:58:36.952802] [INFO ] [REMOTE    ] MPLX: Fetching primary data for 2025-10.
[2025-10-24T19:58:37.188972] [INFO ] [REMOTE    ] MPX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:58:37.747625] [INFO ] [REMOTE    ] MPX: Fetching primary data for 2025-01.
[2025-10-24T19:58:38.004968] [INFO ] [REMOTE    ] MPC: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T19:58:38.400320] [INFO ] [REMOTE    ] MPX: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T19:58:38.547674] [INFO ] [REMOTE    ] MPW: Fetching primary data for 2025-06.
[2025-10-24T19:58:39.016229] [INFO ] [REMOTE    ] MPLX: Incremental fetch complete for 2025-10 (2.06 seconds).
[2025-10-24T19:58:39.025815] [INFO ] [REMOTE    ] MPLX: Full fetch complete (74363 records).
[2025-10-24T19:58:39.025983] [DEBUG] [VALIDATOR ] MPLX: Validating primary data.
[2025-10-24T19:58:39.352783] [INFO ] [REMOTE    ] MPX: Fetching primary data for 2025-02.
[2025-10-24T19:58:39.429861] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present.
[2025-10-24T19:58:39.429937] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed.
[2025-10-24T19:58:39.431001] [INFO ] [MAIN      ] MPLX: Fetched primary data is valid.
[2025-10-24T19:58:39.431071] [DEBUG] [LOCAL     ] MPLX: Saving primary data.
[2025-10-24T19:58:39.431631] [FATAL] [LOCAL     ] MPLX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:58:39.431754] [FATAL] [MAIN      ] MPLX: Failed to save primary data.
[2025-10-24T19:58:39.431796] [WARN ] [MAIN      ] MPLX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:58:39.431855] [INFO ] [LOCAL     ] MPLX: Starting deletion of primary data.
[2025-10-24T19:58:39.431916] [DEBUG] [LOCAL     ] MPLX: No primary data file found to delete.
[2025-10-24T19:58:39.431951] [INFO ] [LOCAL     ] MPLX: Starting deletion of derivative data.
[2025-10-24T19:58:39.432085] [DEBUG] [LOCAL     ] MPLX: Deleted derivative data file.
[2025-10-24T19:58:39.432524] [INFO ] [MAIN      ] Update Progress: 1390/2366 symbols completed. MPLX took 30.0s. Estimated remaining: 2h 5m 25s. Rate: 7.8 symbols/min
[2025-10-24T19:58:39.609763] [INFO ] [MAIN      ] MQT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:58:39.620953] [DEBUG] [LOCAL     ] MQT: Loaded 8068 existing records from primary storage.
[2025-10-24T19:58:39.621185] [INFO ] [MAIN      ] MQT: Loaded 8068 existing records.
[2025-10-24T19:58:39.805307] [WARN ] [MAIN      ] MQT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:58:39.805598] [INFO ] [MAIN      ] MQT: Wiping existing primary data before full refresh.
[2025-10-24T19:58:39.806321] [INFO ] [LOCAL     ] MQT: Starting deletion of primary data.
[2025-10-24T19:58:39.806566] [DEBUG] [LOCAL     ] MQT: Deleted primary data file.
[2025-10-24T19:58:39.806626] [INFO ] [MAIN      ] MQT: Starting full primary refresh.
[2025-10-24T19:58:40.111136] [INFO ] [REMOTE    ] MPX: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T19:58:40.152154] [INFO ] [REMOTE    ] MPX: Fetching primary data for 2025-03.
[2025-10-24T19:58:40.194932] [INFO ] [REMOTE    ] MQT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:58:40.411621] [INFO ] [REMOTE    ] MPW: Incremental fetch complete for 2025-06 (1.86 seconds).
[2025-10-24T19:58:40.848317] [INFO ] [REMOTE    ] MPX: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T19:58:40.947680] [INFO ] [REMOTE    ] MPX: Fetching primary data for 2025-04.
[2025-10-24T19:58:41.571910] [INFO ] [REMOTE    ] MPX: Incremental fetch complete for 2025-04 (0.62 seconds).
[2025-10-24T19:58:41.747634] [INFO ] [REMOTE    ] MPX: Fetching primary data for 2025-05.
[2025-10-24T19:58:42.343161] [INFO ] [REMOTE    ] MPX: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T19:58:42.547683] [INFO ] [REMOTE    ] MPX: Fetching primary data for 2025-06.
[2025-10-24T19:58:43.181285] [INFO ] [REMOTE    ] MPX: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T19:58:43.347697] [INFO ] [REMOTE    ] MPX: Fetching primary data for 2025-07.
[2025-10-24T19:58:43.930825] [INFO ] [REMOTE    ] MPX: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T19:58:44.147715] [INFO ] [REMOTE    ] MQT: Fetching primary data for 2025-01.
[2025-10-24T19:58:44.901374] [INFO ] [REMOTE    ] MQT: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T19:58:44.947638] [INFO ] [REMOTE    ] MQT: Fetching primary data for 2025-02.
[2025-10-24T19:58:45.724400] [INFO ] [REMOTE    ] MQT: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T19:58:45.747681] [INFO ] [REMOTE    ] MPW: Fetching primary data for 2025-07.
[2025-10-24T19:58:46.547672] [INFO ] [REMOTE    ] MQT: Fetching primary data for 2025-03.
[2025-10-24T19:58:47.274545] [INFO ] [REMOTE    ] MQT: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T19:58:47.347636] [INFO ] [REMOTE    ] MPX: Fetching primary data for 2025-08.
[2025-10-24T19:58:47.778837] [INFO ] [REMOTE    ] MPX: Incremental fetch complete for 2025-08 (0.43 seconds).
[2025-10-24T19:58:47.783234] [INFO ] [REMOTE    ] MPW: Incremental fetch complete for 2025-07 (2.04 seconds).
[2025-10-24T19:58:48.147668] [INFO ] [REMOTE    ] MPX: Fetching primary data for 2025-09.
[2025-10-24T19:58:48.727573] [INFO ] [REMOTE    ] MPX: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T19:58:48.947635] [INFO ] [REMOTE    ] MPX: Fetching primary data for 2025-10.
[2025-10-24T19:58:49.521152] [INFO ] [REMOTE    ] MPX: Incremental fetch complete for 2025-10 (0.57 seconds).
[2025-10-24T19:58:49.522337] [INFO ] [REMOTE    ] MPX: Full fetch complete (6466 records).
[2025-10-24T19:58:49.522404] [DEBUG] [VALIDATOR ] MPX: Validating primary data.
[2025-10-24T19:58:49.752788] [INFO ] [REMOTE    ] MPC: Fetching primary data for 2025-09.
[2025-10-24T19:58:49.886683] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present.
[2025-10-24T19:58:49.886765] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed.
[2025-10-24T19:58:49.886950] [INFO ] [MAIN      ] MPX: Fetched primary data is valid.
[2025-10-24T19:58:49.886989] [DEBUG] [LOCAL     ] MPX: Saving primary data.
[2025-10-24T19:58:49.887180] [FATAL] [LOCAL     ] MPX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:58:49.887287] [FATAL] [MAIN      ] MPX: Failed to save primary data.
[2025-10-24T19:58:49.887335] [WARN ] [MAIN      ] MPX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:58:49.887414] [INFO ] [LOCAL     ] MPX: Starting deletion of primary data.
[2025-10-24T19:58:49.887472] [DEBUG] [LOCAL     ] MPX: No primary data file found to delete.
[2025-10-24T19:58:49.887549] [INFO ] [LOCAL     ] MPX: Starting deletion of derivative data.
[2025-10-24T19:58:49.887768] [DEBUG] [LOCAL     ] MPX: Deleted derivative data file.
[2025-10-24T19:58:49.887860] [INFO ] [MAIN      ] Update Progress: 1391/2366 symbols completed. MPX took 13.4s. Estimated remaining: 2h 5m 19s. Rate: 7.8 symbols/min
[2025-10-24T19:58:50.055882] [INFO ] [MAIN      ] MQY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:58:50.074761] [DEBUG] [LOCAL     ] MQY: Loaded 16740 existing records from primary storage.
[2025-10-24T19:58:50.074988] [INFO ] [MAIN      ] MQY: Loaded 16740 existing records.
[2025-10-24T19:58:50.256686] [WARN ] [MAIN      ] MQY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:58:50.256889] [INFO ] [MAIN      ] MQY: Wiping existing primary data before full refresh.
[2025-10-24T19:58:50.256936] [INFO ] [LOCAL     ] MQY: Starting deletion of primary data.
[2025-10-24T19:58:50.257177] [DEBUG] [LOCAL     ] MQY: Deleted primary data file.
[2025-10-24T19:58:50.257216] [INFO ] [MAIN      ] MQY: Starting full primary refresh.
[2025-10-24T19:58:50.552804] [INFO ] [REMOTE    ] MQT: Fetching primary data for 2025-04.
[2025-10-24T19:58:50.626194] [INFO ] [REMOTE    ] MQY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:58:51.347735] [INFO ] [REMOTE    ] MPW: Fetching primary data for 2025-08.
[2025-10-24T19:58:51.525146] [INFO ] [REMOTE    ] MPC: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T19:58:51.557720] [INFO ] [REMOTE    ] MQT: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T19:58:52.147669] [INFO ] [REMOTE    ] MPC: Fetching primary data for 2025-10.
[2025-10-24T19:58:52.947710] [INFO ] [REMOTE    ] MQY: Fetching primary data for 2025-01.
[2025-10-24T19:58:53.240804] [INFO ] [REMOTE    ] MPW: Incremental fetch complete for 2025-08 (1.89 seconds).
[2025-10-24T19:58:53.641513] [INFO ] [REMOTE    ] MQY: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T19:58:53.747634] [INFO ] [REMOTE    ] MQT: Fetching primary data for 2025-05.
[2025-10-24T19:58:54.009365] [INFO ] [REMOTE    ] MPC: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T19:58:54.018696] [INFO ] [REMOTE    ] MPC: Full fetch complete (75674 records).
[2025-10-24T19:58:54.018840] [DEBUG] [VALIDATOR ] MPC: Validating primary data.
[2025-10-24T19:58:54.396284] [INFO ] [REMOTE    ] MQT: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T19:58:54.420938] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present.
[2025-10-24T19:58:54.421003] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed.
[2025-10-24T19:58:54.422208] [INFO ] [MAIN      ] MPC: Fetched primary data is valid.
[2025-10-24T19:58:54.422274] [DEBUG] [LOCAL     ] MPC: Saving primary data.
[2025-10-24T19:58:54.422851] [FATAL] [LOCAL     ] MPC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:58:54.422937] [FATAL] [MAIN      ] MPC: Failed to save primary data.
[2025-10-24T19:58:54.422980] [WARN ] [MAIN      ] MPC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:58:54.423127] [INFO ] [LOCAL     ] MPC: Starting deletion of primary data.
[2025-10-24T19:58:54.423227] [DEBUG] [LOCAL     ] MPC: No primary data file found to delete.
[2025-10-24T19:58:54.423278] [INFO ] [LOCAL     ] MPC: Starting deletion of derivative data.
[2025-10-24T19:58:54.423521] [DEBUG] [LOCAL     ] MPC: Deleted derivative data file.
[2025-10-24T19:58:54.423906] [INFO ] [MAIN      ] Update Progress: 1392/2366 symbols completed. MPC took 46.2s. Estimated remaining: 2h 5m 9s. Rate: 7.8 symbols/min
[2025-10-24T19:58:54.552870] [INFO ] [REMOTE    ] MQT: Fetching primary data for 2025-06.
[2025-10-24T19:58:54.598442] [INFO ] [MAIN      ] MRC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:58:54.636513] [DEBUG] [LOCAL     ] MRC: Loaded 37336 existing records from primary storage.
[2025-10-24T19:58:54.636818] [INFO ] [MAIN      ] MRC: Loaded 37336 existing records.
[2025-10-24T19:58:54.817570] [WARN ] [MAIN      ] MRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:58:54.817803] [INFO ] [MAIN      ] MRC: Wiping existing primary data before full refresh.
[2025-10-24T19:58:54.817852] [INFO ] [LOCAL     ] MRC: Starting deletion of primary data.
[2025-10-24T19:58:54.818228] [DEBUG] [LOCAL     ] MRC: Deleted primary data file.
[2025-10-24T19:58:54.818283] [INFO ] [MAIN      ] MRC: Starting full primary refresh.
[2025-10-24T19:58:55.173147] [INFO ] [REMOTE    ] MRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:58:55.347621] [INFO ] [REMOTE    ] MRC: Fetching primary data for 2025-01.
[2025-10-24T19:58:55.374605] [INFO ] [REMOTE    ] MQT: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T19:58:56.147682] [INFO ] [REMOTE    ] MQY: Fetching primary data for 2025-02.
[2025-10-24T19:58:56.777616] [INFO ] [REMOTE    ] MRC: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T19:58:56.947676] [INFO ] [REMOTE    ] MPW: Fetching primary data for 2025-09.
[2025-10-24T19:58:57.121545] [INFO ] [REMOTE    ] MQY: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T19:58:57.747672] [INFO ] [REMOTE    ] MQY: Fetching primary data for 2025-03.
[2025-10-24T19:58:58.547713] [INFO ] [REMOTE    ] MRC: Fetching primary data for 2025-02.
[2025-10-24T19:58:58.864383] [INFO ] [REMOTE    ] MPW: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T19:58:58.910075] [INFO ] [REMOTE    ] MQY: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T19:58:59.347616] [INFO ] [REMOTE    ] MQY: Fetching primary data for 2025-04.
[2025-10-24T19:58:59.923805] [INFO ] [REMOTE    ] MRC: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T19:59:00.147680] [INFO ] [REMOTE    ] MPW: Fetching primary data for 2025-10.
[2025-10-24T19:59:00.468365] [INFO ] [REMOTE    ] MQY: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T19:59:00.947687] [INFO ] [REMOTE    ] MRC: Fetching primary data for 2025-03.
[2025-10-24T19:59:01.747755] [INFO ] [REMOTE    ] MQT: Fetching primary data for 2025-07.
[2025-10-24T19:59:02.368544] [INFO ] [REMOTE    ] MPW: Incremental fetch complete for 2025-10 (2.22 seconds).
[2025-10-24T19:59:02.378834] [INFO ] [REMOTE    ] MPW: Full fetch complete (77573 records).
[2025-10-24T19:59:02.379002] [DEBUG] [VALIDATOR ] MPW: Validating primary data.
[2025-10-24T19:59:02.501358] [INFO ] [REMOTE    ] MQT: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T19:59:02.553803] [INFO ] [REMOTE    ] MQT: Fetching primary data for 2025-08.
[2025-10-24T19:59:02.760449] [INFO ] [REMOTE    ] MRC: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T19:59:02.846696] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present.
[2025-10-24T19:59:02.846772] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed.
[2025-10-24T19:59:02.847941] [INFO ] [MAIN      ] MPW: Fetched primary data is valid.
[2025-10-24T19:59:02.848014] [DEBUG] [LOCAL     ] MPW: Saving primary data.
[2025-10-24T19:59:02.848595] [FATAL] [LOCAL     ] MPW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:59:02.848807] [FATAL] [MAIN      ] MPW: Failed to save primary data.
[2025-10-24T19:59:02.848892] [WARN ] [MAIN      ] MPW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:59:02.848981] [INFO ] [LOCAL     ] MPW: Starting deletion of primary data.
[2025-10-24T19:59:02.849062] [DEBUG] [LOCAL     ] MPW: No primary data file found to delete.
[2025-10-24T19:59:02.849100] [INFO ] [LOCAL     ] MPW: Starting deletion of derivative data.
[2025-10-24T19:59:02.849272] [DEBUG] [LOCAL     ] MPW: Deleted derivative data file.
[2025-10-24T19:59:02.849990] [INFO ] [MAIN      ] Update Progress: 1393/2366 symbols completed. MPW took 47.5s. Estimated remaining: 2h 5m 2s. Rate: 7.8 symbols/min
[2025-10-24T19:59:03.027730] [INFO ] [MAIN      ] MRK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:59:03.081021] [DEBUG] [LOCAL     ] MRK: Loaded 54180 existing records from primary storage.
[2025-10-24T19:59:03.081431] [INFO ] [MAIN      ] MRK: Loaded 54180 existing records.
[2025-10-24T19:59:03.273680] [WARN ] [MAIN      ] MRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:59:03.273920] [INFO ] [MAIN      ] MRK: Wiping existing primary data before full refresh.
[2025-10-24T19:59:03.273976] [INFO ] [LOCAL     ] MRK: Starting deletion of primary data.
[2025-10-24T19:59:03.274379] [DEBUG] [LOCAL     ] MRK: Deleted primary data file.
[2025-10-24T19:59:03.274418] [INFO ] [MAIN      ] MRK: Starting full primary refresh.
[2025-10-24T19:59:03.354632] [INFO ] [REMOTE    ] MRC: Fetching primary data for 2025-04.
[2025-10-24T19:59:03.384595] [INFO ] [REMOTE    ] MQT: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T19:59:03.647629] [INFO ] [REMOTE    ] MRK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:59:04.147680] [INFO ] [REMOTE    ] MQT: Fetching primary data for 2025-09.
[2025-10-24T19:59:04.847512] [INFO ] [REMOTE    ] MRC: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T19:59:04.947613] [INFO ] [REMOTE    ] MRC: Fetching primary data for 2025-05.
[2025-10-24T19:59:05.058718] [INFO ] [REMOTE    ] MQT: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T19:59:05.747690] [INFO ] [REMOTE    ] MRK: Fetching primary data for 2025-01.
[2025-10-24T19:59:06.186902] [INFO ] [REMOTE    ] MRC: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T19:59:06.547725] [INFO ] [REMOTE    ] MRC: Fetching primary data for 2025-06.
[2025-10-24T19:59:07.347718] [INFO ] [REMOTE    ] MQT: Fetching primary data for 2025-10.
[2025-10-24T19:59:07.630140] [INFO ] [REMOTE    ] MRK: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T19:59:08.035718] [INFO ] [REMOTE    ] MRC: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T19:59:08.049358] [INFO ] [REMOTE    ] MQT: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T19:59:08.052546] [INFO ] [REMOTE    ] MQT: Full fetch complete (13024 records).
[2025-10-24T19:59:08.052662] [DEBUG] [VALIDATOR ] MQT: Validating primary data.
[2025-10-24T19:59:08.152949] [INFO ] [REMOTE    ] MQY: Fetching primary data for 2025-05.
[2025-10-24T19:59:08.443844] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present.
[2025-10-24T19:59:08.443929] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed.
[2025-10-24T19:59:08.444231] [INFO ] [MAIN      ] MQT: Fetched primary data is valid.
[2025-10-24T19:59:08.444291] [DEBUG] [LOCAL     ] MQT: Saving primary data.
[2025-10-24T19:59:08.444538] [FATAL] [LOCAL     ] MQT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:59:08.444621] [FATAL] [MAIN      ] MQT: Failed to save primary data.
[2025-10-24T19:59:08.444697] [WARN ] [MAIN      ] MQT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:59:08.444743] [INFO ] [LOCAL     ] MQT: Starting deletion of primary data.
[2025-10-24T19:59:08.444793] [DEBUG] [LOCAL     ] MQT: No primary data file found to delete.
[2025-10-24T19:59:08.444827] [INFO ] [LOCAL     ] MQT: Starting deletion of derivative data.
[2025-10-24T19:59:08.444940] [DEBUG] [LOCAL     ] MQT: Deleted derivative data file.
[2025-10-24T19:59:08.445019] [INFO ] [MAIN      ] Update Progress: 1394/2366 symbols completed. MQT took 29.0s. Estimated remaining: 2h 4m 53s. Rate: 7.8 symbols/min
[2025-10-24T19:59:08.616934] [INFO ] [MAIN      ] MRP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:59:08.617117] [DEBUG] [LOCAL     ] MRP: No existing data file found in primary storage.
[2025-10-24T19:59:08.617175] [WARN ] [MAIN      ] MRP: No existing data found, performing full refresh instead.
[2025-10-24T19:59:08.617317] [INFO ] [MAIN      ] MRP: Wiping existing primary data before full refresh.
[2025-10-24T19:59:08.617364] [INFO ] [LOCAL     ] MRP: Starting deletion of primary data.
[2025-10-24T19:59:08.617407] [DEBUG] [LOCAL     ] MRP: No primary data file found to delete.
[2025-10-24T19:59:08.617440] [INFO ] [MAIN      ] MRP: Starting full primary refresh.
[2025-10-24T19:59:08.954740] [INFO ] [REMOTE    ] MRC: Fetching primary data for 2025-07.
[2025-10-24T19:59:08.996033] [INFO ] [REMOTE    ] MRP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:59:09.078817] [INFO ] [REMOTE    ] MQY: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T19:59:09.747710] [INFO ] [REMOTE    ] MQY: Fetching primary data for 2025-06.
[2025-10-24T19:59:10.478266] [INFO ] [REMOTE    ] MRC: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T19:59:10.547610] [INFO ] [REMOTE    ] MRP: Fetching primary data for 2025-01.
[2025-10-24T19:59:10.716860] [INFO ] [REMOTE    ] MQY: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T19:59:10.821480] [DEBUG] [REMOTE    ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T19:59:10.821759] [WARN ] [REMOTE    ] MRP: No data returned for month 2025-01
[2025-10-24T19:59:10.821844] [FATAL] [REMOTE    ] MRP: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T19:59:10.821910] [FATAL] [MAIN      ] MRP: Failed to fetch primary data.
[2025-10-24T19:59:10.821971] [WARN ] [MAIN      ] MRP: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T19:59:10.822053] [INFO ] [LOCAL     ] MRP: Starting deletion of primary data.
[2025-10-24T19:59:10.822114] [DEBUG] [LOCAL     ] MRP: No primary data file found to delete.
[2025-10-24T19:59:10.822149] [INFO ] [LOCAL     ] MRP: Starting deletion of derivative data.
[2025-10-24T19:59:10.822187] [DEBUG] [LOCAL     ] MRP: No derivative data file found to delete.
[2025-10-24T19:59:10.822232] [INFO ] [MAIN      ] Update Progress: 1395/2366 symbols completed. MRP took 2.4s. Estimated remaining: 2h 4m 41s. Rate: 7.8 symbols/min
[2025-10-24T19:59:11.007575] [INFO ] [MAIN      ] MS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:59:11.061305] [DEBUG] [LOCAL     ] MS: Loaded 54077 existing records from primary storage.
[2025-10-24T19:59:11.061629] [INFO ] [MAIN      ] MS: Loaded 54077 existing records.
[2025-10-24T19:59:11.238785] [WARN ] [MAIN      ] MS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:59:11.238984] [INFO ] [MAIN      ] MS: Wiping existing primary data before full refresh.
[2025-10-24T19:59:11.239033] [INFO ] [LOCAL     ] MS: Starting deletion of primary data.
[2025-10-24T19:59:11.239370] [DEBUG] [LOCAL     ] MS: Deleted primary data file.
[2025-10-24T19:59:11.239427] [INFO ] [MAIN      ] MS: Starting full primary refresh.
[2025-10-24T19:59:11.352854] [INFO ] [REMOTE    ] MQY: Fetching primary data for 2025-07.
[2025-10-24T19:59:11.598948] [INFO ] [REMOTE    ] MS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:59:12.147611] [INFO ] [REMOTE    ] MRC: Fetching primary data for 2025-08.
[2025-10-24T19:59:12.434699] [INFO ] [REMOTE    ] MQY: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T19:59:12.947714] [INFO ] [REMOTE    ] MRK: Fetching primary data for 2025-02.
[2025-10-24T19:59:13.315966] [INFO ] [REMOTE    ] MRC: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T19:59:13.747627] [INFO ] [REMOTE    ] MRC: Fetching primary data for 2025-09.
[2025-10-24T19:59:14.547677] [INFO ] [REMOTE    ] MQY: Fetching primary data for 2025-08.
[2025-10-24T19:59:15.324673] [INFO ] [REMOTE    ] MRK: Incremental fetch complete for 2025-02 (2.38 seconds).
[2025-10-24T19:59:15.347616] [INFO ] [REMOTE    ] MRK: Fetching primary data for 2025-03.
[2025-10-24T19:59:15.372350] [INFO ] [REMOTE    ] MQY: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T19:59:15.399844] [INFO ] [REMOTE    ] MRC: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T19:59:16.147749] [INFO ] [REMOTE    ] MQY: Fetching primary data for 2025-09.
[2025-10-24T19:59:16.947701] [INFO ] [REMOTE    ] MS: Fetching primary data for 2025-01.
[2025-10-24T19:59:17.160057] [INFO ] [REMOTE    ] MQY: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T19:59:17.343507] [INFO ] [REMOTE    ] MRK: Incremental fetch complete for 2025-03 (2.00 seconds).
[2025-10-24T19:59:17.747688] [INFO ] [REMOTE    ] MRK: Fetching primary data for 2025-04.
[2025-10-24T19:59:18.547738] [INFO ] [REMOTE    ] MRC: Fetching primary data for 2025-10.
[2025-10-24T19:59:19.022831] [INFO ] [REMOTE    ] MS: Incremental fetch complete for 2025-01 (2.08 seconds).
[2025-10-24T19:59:19.347708] [INFO ] [REMOTE    ] MQY: Fetching primary data for 2025-10.
[2025-10-24T19:59:19.453328] [INFO ] [REMOTE    ] MRK: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T19:59:19.714179] [INFO ] [REMOTE    ] MRC: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T19:59:19.721074] [INFO ] [REMOTE    ] MRC: Full fetch complete (55002 records).
[2025-10-24T19:59:19.721197] [DEBUG] [VALIDATOR ] MRC: Validating primary data.
[2025-10-24T19:59:20.114027] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present.
[2025-10-24T19:59:20.114120] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed.
[2025-10-24T19:59:20.115052] [INFO ] [MAIN      ] MRC: Fetched primary data is valid.
[2025-10-24T19:59:20.115227] [DEBUG] [LOCAL     ] MRC: Saving primary data.
[2025-10-24T19:59:20.115776] [FATAL] [LOCAL     ] MRC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:59:20.121207] [FATAL] [MAIN      ] MRC: Failed to save primary data.
[2025-10-24T19:59:20.125316] [WARN ] [MAIN      ] MRC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:59:20.125485] [INFO ] [LOCAL     ] MRC: Starting deletion of primary data.
[2025-10-24T19:59:20.125587] [DEBUG] [LOCAL     ] MRC: No primary data file found to delete.
[2025-10-24T19:59:20.126403] [INFO ] [REMOTE    ] MQY: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T19:59:20.126138] [INFO ] [LOCAL     ] MRC: Starting deletion of derivative data.
[2025-10-24T19:59:20.130359] [DEBUG] [LOCAL     ] MRC: Deleted derivative data file.
[2025-10-24T19:59:20.130840] [INFO ] [MAIN      ] Update Progress: 1396/2366 symbols completed. MRC took 25.7s. Estimated remaining: 2h 4m 35s. Rate: 7.8 symbols/min
[2025-10-24T19:59:20.130970] [INFO ] [REMOTE    ] MQY: Full fetch complete (25722 records).
[2025-10-24T19:59:20.152695] [INFO ] [REMOTE    ] MRK: Fetching primary data for 2025-05.
[2025-10-24T19:59:20.166370] [DEBUG] [VALIDATOR ] MQY: Validating primary data.
[2025-10-24T19:59:20.452598] [INFO ] [MAIN      ] MSA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:59:20.690153] [DEBUG] [LOCAL     ] MSA: Loaded 18945 existing records from primary storage.
[2025-10-24T19:59:20.701560] [INFO ] [MAIN      ] MSA: Loaded 18945 existing records.
[2025-10-24T19:59:20.744446] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present.
[2025-10-24T19:59:20.765688] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed.
[2025-10-24T19:59:20.771885] [INFO ] [MAIN      ] MQY: Fetched primary data is valid.
[2025-10-24T19:59:20.771966] [DEBUG] [LOCAL     ] MQY: Saving primary data.
[2025-10-24T19:59:20.778176] [FATAL] [LOCAL     ] MQY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:59:20.794840] [FATAL] [MAIN      ] MQY: Failed to save primary data.
[2025-10-24T19:59:20.803834] [WARN ] [MAIN      ] MQY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:59:20.806569] [INFO ] [LOCAL     ] MQY: Starting deletion of primary data.
[2025-10-24T19:59:20.806665] [DEBUG] [LOCAL     ] MQY: No primary data file found to delete.
[2025-10-24T19:59:20.806735] [INFO ] [LOCAL     ] MQY: Starting deletion of derivative data.
[2025-10-24T19:59:20.807070] [DEBUG] [LOCAL     ] MQY: Deleted derivative data file.
[2025-10-24T19:59:20.812519] [INFO ] [MAIN      ] Update Progress: 1397/2366 symbols completed. MQY took 30.9s. Estimated remaining: 2h 4m 22s. Rate: 7.8 symbols/min
[2025-10-24T19:59:20.882158] [WARN ] [MAIN      ] MSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:59:20.882348] [INFO ] [MAIN      ] MSA: Wiping existing primary data before full refresh.
[2025-10-24T19:59:20.882415] [INFO ] [LOCAL     ] MSA: Starting deletion of primary data.
[2025-10-24T19:59:20.882698] [DEBUG] [LOCAL     ] MSA: Deleted primary data file.
[2025-10-24T19:59:20.882756] [INFO ] [MAIN      ] MSA: Starting full primary refresh.
[2025-10-24T19:59:20.957629] [INFO ] [REMOTE    ] MS: Fetching primary data for 2025-02.
[2025-10-24T19:59:21.237432] [INFO ] [REMOTE    ] MSA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:59:21.747722] [INFO ] [REMOTE    ] MSA: Fetching primary data for 2025-01.
[2025-10-24T19:59:22.473424] [INFO ] [REMOTE    ] MRK: Incremental fetch complete for 2025-05 (2.32 seconds).
[2025-10-24T19:59:22.547599] [INFO ] [REMOTE    ] MRK: Fetching primary data for 2025-06.
[2025-10-24T19:59:22.745435] [INFO ] [REMOTE    ] MSA: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T19:59:22.935681] [INFO ] [REMOTE    ] MS: Incremental fetch complete for 2025-02 (1.98 seconds).
[2025-10-24T19:59:23.347696] [INFO ] [REMOTE    ] MS: Fetching primary data for 2025-03.
[2025-10-24T19:59:24.147739] [INFO ] [REMOTE    ] MSA: Fetching primary data for 2025-02.
[2025-10-24T19:59:24.709628] [INFO ] [REMOTE    ] MRK: Incremental fetch complete for 2025-06 (2.16 seconds).
[2025-10-24T19:59:24.835702] [INFO ] [REMOTE    ] MS: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T19:59:24.856762] [INFO ] [REMOTE    ] MSA: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T19:59:24.947604] [INFO ] [REMOTE    ] MSA: Fetching primary data for 2025-03.
[2025-10-24T19:59:25.747625] [INFO ] [REMOTE    ] MRK: Fetching primary data for 2025-07.
[2025-10-24T19:59:25.983471] [INFO ] [REMOTE    ] MSA: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T19:59:26.547617] [INFO ] [REMOTE    ] MSA: Fetching primary data for 2025-04.
[2025-10-24T19:59:27.347758] [INFO ] [REMOTE    ] MS: Fetching primary data for 2025-04.
[2025-10-24T19:59:27.798833] [INFO ] [REMOTE    ] MSA: Incremental fetch complete for 2025-04 (1.25 seconds).
[2025-10-24T19:59:27.905492] [INFO ] [REMOTE    ] MRK: Incremental fetch complete for 2025-07 (2.16 seconds).
[2025-10-24T19:59:28.147638] [INFO ] [REMOTE    ] MSA: Fetching primary data for 2025-05.
[2025-10-24T19:59:28.947718] [INFO ] [REMOTE    ] MRK: Fetching primary data for 2025-08.
[2025-10-24T19:59:29.170349] [INFO ] [REMOTE    ] MS: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T19:59:29.177759] [INFO ] [REMOTE    ] MSA: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T19:59:29.747724] [INFO ] [REMOTE    ] MS: Fetching primary data for 2025-05.
[2025-10-24T19:59:30.547752] [INFO ] [REMOTE    ] MSA: Fetching primary data for 2025-06.
[2025-10-24T19:59:31.370482] [INFO ] [REMOTE    ] MRK: Incremental fetch complete for 2025-08 (2.42 seconds).
[2025-10-24T19:59:31.382858] [INFO ] [REMOTE    ] MRK: Fetching primary data for 2025-09.
[2025-10-24T19:59:31.582186] [INFO ] [REMOTE    ] MS: Incremental fetch complete for 2025-05 (1.83 seconds).
[2025-10-24T19:59:31.622492] [INFO ] [REMOTE    ] MSA: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T19:59:32.147703] [INFO ] [REMOTE    ] MSA: Fetching primary data for 2025-07.
[2025-10-24T19:59:32.947629] [INFO ] [REMOTE    ] MS: Fetching primary data for 2025-06.
[2025-10-24T19:59:33.207328] [INFO ] [REMOTE    ] MSA: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T19:59:33.388376] [INFO ] [REMOTE    ] MRK: Incremental fetch complete for 2025-09 (2.01 seconds).
[2025-10-24T19:59:33.747682] [INFO ] [REMOTE    ] MRK: Fetching primary data for 2025-10.
[2025-10-24T19:59:34.547706] [INFO ] [REMOTE    ] MSA: Fetching primary data for 2025-08.
[2025-10-24T19:59:34.844612] [INFO ] [REMOTE    ] MS: Incremental fetch complete for 2025-06 (1.90 seconds).
[2025-10-24T19:59:35.205062] [INFO ] [REMOTE    ] MSA: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T19:59:35.347688] [INFO ] [REMOTE    ] MSA: Fetching primary data for 2025-09.
[2025-10-24T19:59:35.519163] [INFO ] [REMOTE    ] MRK: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T19:59:35.528935] [INFO ] [REMOTE    ] MRK: Full fetch complete (77968 records).
[2025-10-24T19:59:35.529109] [DEBUG] [VALIDATOR ] MRK: Validating primary data.
[2025-10-24T19:59:35.916909] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present.
[2025-10-24T19:59:35.916988] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed.
[2025-10-24T19:59:35.918138] [INFO ] [MAIN      ] MRK: Fetched primary data is valid.
[2025-10-24T19:59:35.918204] [DEBUG] [LOCAL     ] MRK: Saving primary data.
[2025-10-24T19:59:35.918854] [FATAL] [LOCAL     ] MRK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:59:35.918942] [FATAL] [MAIN      ] MRK: Failed to save primary data.
[2025-10-24T19:59:35.918983] [WARN ] [MAIN      ] MRK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:59:35.919046] [INFO ] [LOCAL     ] MRK: Starting deletion of primary data.
[2025-10-24T19:59:35.919099] [DEBUG] [LOCAL     ] MRK: No primary data file found to delete.
[2025-10-24T19:59:35.919135] [INFO ] [LOCAL     ] MRK: Starting deletion of derivative data.
[2025-10-24T19:59:35.919266] [DEBUG] [LOCAL     ] MRK: Deleted derivative data file.
[2025-10-24T19:59:35.919851] [INFO ] [MAIN      ] Update Progress: 1398/2366 symbols completed. MRK took 33.1s. Estimated remaining: 2h 4m 19s. Rate: 7.8 symbols/min
[2025-10-24T19:59:36.147707] [INFO ] [REMOTE    ] MS: Fetching primary data for 2025-07.
[2025-10-24T19:59:36.297194] [INFO ] [REMOTE    ] MSA: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T19:59:36.947711] [INFO ] [REMOTE    ] MSA: Fetching primary data for 2025-10.
[2025-10-24T19:59:38.004532] [INFO ] [REMOTE    ] MSA: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T19:59:38.007974] [INFO ] [REMOTE    ] MSA: Full fetch complete (25915 records).
[2025-10-24T19:59:38.008054] [DEBUG] [VALIDATOR ] MSA: Validating primary data.
[2025-10-24T19:59:38.384357] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present.
[2025-10-24T19:59:38.384446] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed.
[2025-10-24T19:59:38.385102] [INFO ] [MAIN      ] MSA: Fetched primary data is valid.
[2025-10-24T19:59:38.385163] [DEBUG] [LOCAL     ] MSA: Saving primary data.
[2025-10-24T19:59:38.385776] [FATAL] [LOCAL     ] MSA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:59:38.385865] [FATAL] [MAIN      ] MSA: Failed to save primary data.
[2025-10-24T19:59:38.385907] [WARN ] [MAIN      ] MSA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:59:38.385973] [INFO ] [LOCAL     ] MSA: Starting deletion of primary data.
[2025-10-24T19:59:38.386100] [DEBUG] [LOCAL     ] MSA: No primary data file found to delete.
[2025-10-24T19:59:38.386223] [INFO ] [LOCAL     ] MSA: Starting deletion of derivative data.
[2025-10-24T19:59:38.386408] [DEBUG] [LOCAL     ] MSA: Deleted derivative data file.
[2025-10-24T19:59:38.386498] [INFO ] [MAIN      ] Update Progress: 1399/2366 symbols completed. MSA took 18.3s. Estimated remaining: 2h 4m 8s. Rate: 7.8 symbols/min
[2025-10-24T19:59:38.418834] [INFO ] [REMOTE    ] MS: Incremental fetch complete for 2025-07 (2.27 seconds).
[2025-10-24T19:59:38.430549] [INFO ] [REMOTE    ] MS: Fetching primary data for 2025-08.
[2025-10-24T19:59:40.218764] [INFO ] [REMOTE    ] MS: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T19:59:40.230523] [INFO ] [REMOTE    ] MS: Fetching primary data for 2025-09.
[2025-10-24T19:59:42.155998] [INFO ] [REMOTE    ] MS: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T19:59:42.168039] [INFO ] [REMOTE    ] MS: Fetching primary data for 2025-10.
[2025-10-24T19:59:44.135062] [INFO ] [REMOTE    ] MS: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T19:59:44.144704] [INFO ] [REMOTE    ] MS: Full fetch complete (77858 records).
[2025-10-24T19:59:44.144912] [DEBUG] [VALIDATOR ] MS: Validating primary data.
[2025-10-24T19:59:44.532990] [DEBUG] [VALIDATOR ] MS: All expected trading days are present.
[2025-10-24T19:59:44.533085] [DEBUG] [VALIDATOR ] MS: Primary data validation passed.
[2025-10-24T19:59:44.534263] [INFO ] [MAIN      ] MS: Fetched primary data is valid.
[2025-10-24T19:59:44.534326] [DEBUG] [LOCAL     ] MS: Saving primary data.
[2025-10-24T19:59:44.535059] [FATAL] [LOCAL     ] MS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T19:59:44.535162] [FATAL] [MAIN      ] MS: Failed to save primary data.
[2025-10-24T19:59:44.535205] [WARN ] [MAIN      ] MS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T19:59:44.535242] [INFO ] [LOCAL     ] MS: Starting deletion of primary data.
[2025-10-24T19:59:44.535297] [DEBUG] [LOCAL     ] MS: No primary data file found to delete.
[2025-10-24T19:59:44.535352] [INFO ] [LOCAL     ] MS: Starting deletion of derivative data.
[2025-10-24T19:59:44.535495] [DEBUG] [LOCAL     ] MS: Deleted derivative data file.
[2025-10-24T19:59:44.536074] [INFO ] [MAIN      ] Update Progress: 1400/2366 symbols completed. MS took 33.7s. Estimated remaining: 2h 3m 59s. Rate: 7.8 symbols/min
[2025-10-24T19:59:45.065831] [INFO ] [MAIN      ] MSD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:59:45.126762] [INFO ] [MAIN      ] MSB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:59:45.255195] [INFO ] [MAIN      ] MSCI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:59:45.253737] [INFO ] [MAIN      ] MSC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:59:45.255601] [DEBUG] [LOCAL     ] MSC: No existing data file found in primary storage.
[2025-10-24T19:59:45.260228] [WARN ] [MAIN      ] MSC: No existing data found, performing full refresh instead.
[2025-10-24T19:59:45.264595] [INFO ] [MAIN      ] MSC: Wiping existing primary data before full refresh.
[2025-10-24T19:59:45.264908] [DEBUG] [LOCAL     ] MSB: Loaded 8024 existing records from primary storage.
[2025-10-24T19:59:45.265247] [INFO ] [MAIN      ] MSB: Loaded 8024 existing records.
[2025-10-24T19:59:45.270603] [INFO ] [LOCAL     ] MSC: Starting deletion of primary data.
[2025-10-24T19:59:45.307173] [DEBUG] [LOCAL     ] MSC: No primary data file found to delete.
[2025-10-24T19:59:45.301906] [DEBUG] [LOCAL     ] MSD: Loaded 16719 existing records from primary storage.
[2025-10-24T19:59:45.326408] [INFO ] [MAIN      ] MSC: Starting full primary refresh.
[2025-10-24T19:59:45.340591] [INFO ] [MAIN      ] MSD: Loaded 16719 existing records.
[2025-10-24T19:59:45.672049] [DEBUG] [LOCAL     ] MSCI: Loaded 34366 existing records from primary storage.
[2025-10-24T19:59:45.777853] [INFO ] [MAIN      ] MSCI: Loaded 34366 existing records.
[2025-10-24T19:59:45.763624] [WARN ] [MAIN      ] MSB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:59:45.804872] [INFO ] [MAIN      ] MSB: Wiping existing primary data before full refresh.
[2025-10-24T19:59:45.837612] [INFO ] [LOCAL     ] MSB: Starting deletion of primary data.
[2025-10-24T19:59:45.895696] [WARN ] [MAIN      ] MSD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:59:45.927513] [DEBUG] [LOCAL     ] MSB: Deleted primary data file.
[2025-10-24T19:59:45.959601] [INFO ] [MAIN      ] MSB: Starting full primary refresh.
[2025-10-24T19:59:45.997936] [INFO ] [MAIN      ] MSD: Wiping existing primary data before full refresh.
[2025-10-24T19:59:46.022934] [INFO ] [LOCAL     ] MSD: Starting deletion of primary data.
[2025-10-24T19:59:46.111335] [DEBUG] [LOCAL     ] MSD: Deleted primary data file.
[2025-10-24T19:59:46.127147] [INFO ] [MAIN      ] MSD: Starting full primary refresh.
[2025-10-24T19:59:46.408820] [WARN ] [MAIN      ] MSCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:59:46.429251] [INFO ] [REMOTE    ] MSC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:59:46.470880] [INFO ] [MAIN      ] MSCI: Wiping existing primary data before full refresh.
[2025-10-24T19:59:46.471117] [INFO ] [REMOTE    ] MSC: Fetching primary data for 2025-01.
[2025-10-24T19:59:46.474498] [INFO ] [LOCAL     ] MSCI: Starting deletion of primary data.
[2025-10-24T19:59:46.637059] [DEBUG] [LOCAL     ] MSCI: Deleted primary data file.
[2025-10-24T19:59:46.642492] [INFO ] [MAIN      ] MSCI: Starting full primary refresh.
[2025-10-24T19:59:46.981499] [INFO ] [REMOTE    ] MSB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:59:47.000946] [INFO ] [REMOTE    ] MSB: Fetching primary data for 2025-01.
[2025-10-24T19:59:47.057311] [INFO ] [REMOTE    ] MSD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:59:47.082781] [INFO ] [REMOTE    ] MSD: Fetching primary data for 2025-01.
[2025-10-24T19:59:47.123969] [INFO ] [REMOTE    ] MSC: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T19:59:47.132113] [INFO ] [REMOTE    ] MSC: Fetching primary data for 2025-02.
[2025-10-24T19:59:47.306512] [INFO ] [REMOTE    ] MSCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:59:47.306844] [INFO ] [REMOTE    ] MSCI: Fetching primary data for 2025-01.
[2025-10-24T19:59:47.717487] [INFO ] [REMOTE    ] MSC: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T19:59:47.719110] [INFO ] [REMOTE    ] MSC: Fetching primary data for 2025-03.
[2025-10-24T19:59:47.941337] [INFO ] [REMOTE    ] MSD: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T19:59:47.946610] [INFO ] [REMOTE    ] MSD: Fetching primary data for 2025-02.
[2025-10-24T19:59:47.959062] [INFO ] [REMOTE    ] MSB: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T19:59:47.963108] [INFO ] [REMOTE    ] MSB: Fetching primary data for 2025-02.
[2025-10-24T19:59:48.059858] [INFO ] [REMOTE    ] MSC: Incremental fetch complete for 2025-03 (0.34 seconds).
[2025-10-24T19:59:48.060974] [INFO ] [REMOTE    ] MSC: Fetching primary data for 2025-04.
[2025-10-24T19:59:48.476210] [INFO ] [REMOTE    ] MSCI: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T19:59:48.483422] [INFO ] [REMOTE    ] MSCI: Fetching primary data for 2025-02.
[2025-10-24T19:59:48.533440] [INFO ] [REMOTE    ] MSC: Incremental fetch complete for 2025-04 (0.47 seconds).
[2025-10-24T19:59:48.534720] [INFO ] [REMOTE    ] MSC: Fetching primary data for 2025-05.
[2025-10-24T19:59:48.786175] [INFO ] [REMOTE    ] MSB: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T19:59:48.856193] [INFO ] [REMOTE    ] MSC: Incremental fetch complete for 2025-05 (0.32 seconds).
[2025-10-24T19:59:48.872155] [INFO ] [REMOTE    ] MSD: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T19:59:48.947694] [INFO ] [REMOTE    ] MSC: Fetching primary data for 2025-06.
[2025-10-24T19:59:49.282841] [INFO ] [REMOTE    ] MSC: Incremental fetch complete for 2025-06 (0.34 seconds).
[2025-10-24T19:59:49.747624] [INFO ] [REMOTE    ] MSB: Fetching primary data for 2025-03.
[2025-10-24T19:59:49.839989] [INFO ] [REMOTE    ] MSCI: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T19:59:50.508710] [INFO ] [REMOTE    ] MSB: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T19:59:50.547619] [INFO ] [REMOTE    ] MSC: Fetching primary data for 2025-07.
[2025-10-24T19:59:50.960770] [INFO ] [REMOTE    ] MSC: Incremental fetch complete for 2025-07 (0.41 seconds).
[2025-10-24T19:59:51.347721] [INFO ] [REMOTE    ] MSCI: Fetching primary data for 2025-03.
[2025-10-24T19:59:52.147726] [INFO ] [REMOTE    ] MSD: Fetching primary data for 2025-03.
[2025-10-24T19:59:52.867716] [INFO ] [REMOTE    ] MSCI: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T19:59:52.947669] [INFO ] [REMOTE    ] MSCI: Fetching primary data for 2025-04.
[2025-10-24T19:59:53.073974] [INFO ] [REMOTE    ] MSD: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T19:59:53.747720] [INFO ] [REMOTE    ] MSD: Fetching primary data for 2025-04.
[2025-10-24T19:59:54.521079] [INFO ] [REMOTE    ] MSD: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T19:59:54.549535] [INFO ] [REMOTE    ] MSB: Fetching primary data for 2025-04.
[2025-10-24T19:59:54.552438] [INFO ] [REMOTE    ] MSCI: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T19:59:55.287895] [INFO ] [REMOTE    ] MSB: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T19:59:55.347711] [INFO ] [REMOTE    ] MSD: Fetching primary data for 2025-05.
[2025-10-24T19:59:56.147680] [INFO ] [REMOTE    ] MSC: Fetching primary data for 2025-08.
[2025-10-24T19:59:56.368068] [INFO ] [REMOTE    ] MSD: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T19:59:56.491053] [INFO ] [REMOTE    ] MSC: Incremental fetch complete for 2025-08 (0.34 seconds).
[2025-10-24T19:59:56.947672] [INFO ] [REMOTE    ] MSC: Fetching primary data for 2025-09.
[2025-10-24T19:59:57.442660] [INFO ] [REMOTE    ] MSC: Incremental fetch complete for 2025-09 (0.49 seconds).
[2025-10-24T19:59:57.747719] [INFO ] [REMOTE    ] MSC: Fetching primary data for 2025-10.
[2025-10-24T19:59:58.206502] [INFO ] [REMOTE    ] MSC: Incremental fetch complete for 2025-10 (0.46 seconds).
[2025-10-24T19:59:58.207339] [INFO ] [REMOTE    ] MSC: Full fetch complete (2460 records).
[2025-10-24T19:59:58.207407] [DEBUG] [VALIDATOR ] MSC: Validating primary data.
[2025-10-24T19:59:58.385676] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days
[2025-10-24T19:59:58.385862] [FATAL] [MAIN      ] MSC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T19:59:58.385929] [WARN ] [MAIN      ] MSC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T19:59:58.386001] [INFO ] [LOCAL     ] MSC: Starting deletion of primary data.
[2025-10-24T19:59:58.386063] [DEBUG] [LOCAL     ] MSC: No primary data file found to delete.
[2025-10-24T19:59:58.386100] [INFO ] [LOCAL     ] MSC: Starting deletion of derivative data.
[2025-10-24T19:59:58.386139] [DEBUG] [LOCAL     ] MSC: No derivative data file found to delete.
[2025-10-24T19:59:58.386193] [INFO ] [MAIN      ] Update Progress: 1401/2366 symbols completed. MSC took 13.8s. Estimated remaining: 2h 3m 56s. Rate: 7.8 symbols/min
[2025-10-24T19:59:58.559227] [INFO ] [MAIN      ] MSDL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T19:59:58.555558] [INFO ] [REMOTE    ] MSCI: Fetching primary data for 2025-05.
[2025-10-24T19:59:58.600638] [DEBUG] [LOCAL     ] MSDL: Loaded 38893 existing records from primary storage.
[2025-10-24T19:59:58.600992] [INFO ] [MAIN      ] MSDL: Loaded 38893 existing records.
[2025-10-24T19:59:58.794810] [WARN ] [MAIN      ] MSDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T19:59:58.795137] [INFO ] [MAIN      ] MSDL: Wiping existing primary data before full refresh.
[2025-10-24T19:59:58.795199] [INFO ] [LOCAL     ] MSDL: Starting deletion of primary data.
[2025-10-24T19:59:58.796060] [DEBUG] [LOCAL     ] MSDL: Deleted primary data file.
[2025-10-24T19:59:58.796126] [INFO ] [MAIN      ] MSDL: Starting full primary refresh.
[2025-10-24T19:59:59.151364] [INFO ] [REMOTE    ] MSDL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T19:59:59.347682] [INFO ] [REMOTE    ] MSDL: Fetching primary data for 2025-01.
[2025-10-24T19:59:59.840848] [INFO ] [REMOTE    ] MSCI: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T20:00:00.147704] [INFO ] [REMOTE    ] MSCI: Fetching primary data for 2025-06.
[2025-10-24T20:00:00.276250] [INFO ] [REMOTE    ] MSDL: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T20:00:00.947685] [INFO ] [REMOTE    ] MSB: Fetching primary data for 2025-05.
[2025-10-24T20:00:01.427328] [INFO ] [REMOTE    ] MSCI: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T20:00:01.735836] [INFO ] [REMOTE    ] MSB: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T20:00:01.747672] [INFO ] [REMOTE    ] MSD: Fetching primary data for 2025-06.
[2025-10-24T20:00:02.547734] [INFO ] [REMOTE    ] MSDL: Fetching primary data for 2025-02.
[2025-10-24T20:00:02.844874] [INFO ] [REMOTE    ] MSD: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T20:00:03.347885] [INFO ] [REMOTE    ] MSB: Fetching primary data for 2025-06.
[2025-10-24T20:00:04.073767] [INFO ] [REMOTE    ] MSDL: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T20:00:04.147726] [INFO ] [REMOTE    ] MSCI: Fetching primary data for 2025-07.
[2025-10-24T20:00:04.198425] [INFO ] [REMOTE    ] MSB: Incremental fetch complete for 2025-06 (0.85 seconds).
[2025-10-24T20:00:04.947690] [INFO ] [REMOTE    ] MSB: Fetching primary data for 2025-07.
[2025-10-24T20:00:05.747636] [INFO ] [REMOTE    ] MSD: Fetching primary data for 2025-07.
[2025-10-24T20:00:05.772561] [INFO ] [REMOTE    ] MSB: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T20:00:05.818715] [INFO ] [REMOTE    ] MSCI: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T20:00:06.327048] [INFO ] [REMOTE    ] MSD: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T20:00:06.547677] [INFO ] [REMOTE    ] MSCI: Fetching primary data for 2025-08.
[2025-10-24T20:00:07.347681] [INFO ] [REMOTE    ] MSDL: Fetching primary data for 2025-03.
[2025-10-24T20:00:08.077865] [INFO ] [REMOTE    ] MSCI: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T20:00:08.147697] [INFO ] [REMOTE    ] MSB: Fetching primary data for 2025-08.
[2025-10-24T20:00:08.940901] [INFO ] [REMOTE    ] MSB: Incremental fetch complete for 2025-08 (0.79 seconds).
[2025-10-24T20:00:08.942409] [INFO ] [REMOTE    ] MSDL: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T20:00:08.952714] [INFO ] [REMOTE    ] MSD: Fetching primary data for 2025-08.
[2025-10-24T20:00:09.747675] [INFO ] [REMOTE    ] MSB: Fetching primary data for 2025-09.
[2025-10-24T20:00:09.971007] [INFO ] [REMOTE    ] MSD: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T20:00:10.197221] [INFO ] [REMOTE    ] MSB: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T20:00:10.547685] [INFO ] [REMOTE    ] MSB: Fetching primary data for 2025-10.
[2025-10-24T20:00:11.347628] [INFO ] [REMOTE    ] MSD: Fetching primary data for 2025-09.
[2025-10-24T20:00:11.431446] [INFO ] [REMOTE    ] MSB: Incremental fetch complete for 2025-10 (0.88 seconds).
[2025-10-24T20:00:11.433482] [INFO ] [REMOTE    ] MSB: Full fetch complete (13203 records).
[2025-10-24T20:00:11.433574] [DEBUG] [VALIDATOR ] MSB: Validating primary data.
[2025-10-24T20:00:11.821142] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present.
[2025-10-24T20:00:11.821224] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed.
[2025-10-24T20:00:11.821624] [INFO ] [MAIN      ] MSB: Fetched primary data is valid.
[2025-10-24T20:00:11.821711] [DEBUG] [LOCAL     ] MSB: Saving primary data.
[2025-10-24T20:00:11.821980] [FATAL] [LOCAL     ] MSB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:00:11.822078] [FATAL] [MAIN      ] MSB: Failed to save primary data.
[2025-10-24T20:00:11.822135] [WARN ] [MAIN      ] MSB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:00:11.822200] [INFO ] [LOCAL     ] MSB: Starting deletion of primary data.
[2025-10-24T20:00:11.822259] [DEBUG] [LOCAL     ] MSB: No primary data file found to delete.
[2025-10-24T20:00:11.822297] [INFO ] [LOCAL     ] MSB: Starting deletion of derivative data.
[2025-10-24T20:00:11.822447] [DEBUG] [LOCAL     ] MSB: Deleted derivative data file.
[2025-10-24T20:00:11.822538] [INFO ] [MAIN      ] Update Progress: 1402/2366 symbols completed. MSB took 27.3s. Estimated remaining: 2h 3m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:00:12.021269] [INFO ] [MAIN      ] MSGE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:00:12.073071] [DEBUG] [LOCAL     ] MSGE: Loaded 27255 existing records from primary storage.
[2025-10-24T20:00:12.073333] [INFO ] [MAIN      ] MSGE: Loaded 27255 existing records.
[2025-10-24T20:00:12.152724] [INFO ] [REMOTE    ] MSDL: Fetching primary data for 2025-04.
[2025-10-24T20:00:12.260992] [INFO ] [REMOTE    ] MSD: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T20:00:12.264977] [WARN ] [MAIN      ] MSGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:00:12.265539] [INFO ] [MAIN      ] MSGE: Wiping existing primary data before full refresh.
[2025-10-24T20:00:12.270266] [INFO ] [LOCAL     ] MSGE: Starting deletion of primary data.
[2025-10-24T20:00:12.270568] [DEBUG] [LOCAL     ] MSGE: Deleted primary data file.
[2025-10-24T20:00:12.271060] [INFO ] [MAIN      ] MSGE: Starting full primary refresh.
[2025-10-24T20:00:12.672276] [INFO ] [REMOTE    ] MSGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:00:12.947721] [INFO ] [REMOTE    ] MSGE: Fetching primary data for 2025-01.
[2025-10-24T20:00:13.751009] [INFO ] [REMOTE    ] MSCI: Fetching primary data for 2025-09.
[2025-10-24T20:00:13.754592] [INFO ] [REMOTE    ] MSDL: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T20:00:14.213887] [INFO ] [REMOTE    ] MSGE: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T20:00:14.547705] [INFO ] [REMOTE    ] MSD: Fetching primary data for 2025-10.
[2025-10-24T20:00:14.955321] [INFO ] [REMOTE    ] MSCI: Incremental fetch complete for 2025-09 (1.20 seconds).
[2025-10-24T20:00:15.347683] [INFO ] [REMOTE    ] MSCI: Fetching primary data for 2025-10.
[2025-10-24T20:00:15.708386] [INFO ] [REMOTE    ] MSD: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T20:00:15.712675] [INFO ] [REMOTE    ] MSD: Full fetch complete (23181 records).
[2025-10-24T20:00:15.712793] [DEBUG] [VALIDATOR ] MSD: Validating primary data.
[2025-10-24T20:00:16.152914] [INFO ] [REMOTE    ] MSDL: Fetching primary data for 2025-05.
[2025-10-24T20:00:16.290178] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present.
[2025-10-24T20:00:16.290280] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed.
[2025-10-24T20:00:16.291240] [INFO ] [MAIN      ] MSD: Fetched primary data is valid.
[2025-10-24T20:00:16.291320] [DEBUG] [LOCAL     ] MSD: Saving primary data.
[2025-10-24T20:00:16.291812] [FATAL] [LOCAL     ] MSD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:00:16.291922] [FATAL] [MAIN      ] MSD: Failed to save primary data.
[2025-10-24T20:00:16.291970] [WARN ] [MAIN      ] MSD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:00:16.292011] [INFO ] [LOCAL     ] MSD: Starting deletion of primary data.
[2025-10-24T20:00:16.292073] [DEBUG] [LOCAL     ] MSD: No primary data file found to delete.
[2025-10-24T20:00:16.292114] [INFO ] [LOCAL     ] MSD: Starting deletion of derivative data.
[2025-10-24T20:00:16.292248] [DEBUG] [LOCAL     ] MSD: Deleted derivative data file.
[2025-10-24T20:00:16.292343] [INFO ] [MAIN      ] Update Progress: 1403/2366 symbols completed. MSD took 31.7s. Estimated remaining: 2h 3m 42s. Rate: 7.8 symbols/min
[2025-10-24T20:00:16.544238] [INFO ] [MAIN      ] MSGS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:00:16.568572] [DEBUG] [LOCAL     ] MSGS: Loaded 17313 existing records from primary storage.
[2025-10-24T20:00:16.568874] [INFO ] [MAIN      ] MSGS: Loaded 17313 existing records.
[2025-10-24T20:00:16.792932] [WARN ] [MAIN      ] MSGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:00:16.797191] [INFO ] [REMOTE    ] MSCI: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T20:00:16.803499] [INFO ] [MAIN      ] MSGS: Wiping existing primary data before full refresh.
[2025-10-24T20:00:16.803816] [INFO ] [LOCAL     ] MSGS: Starting deletion of primary data.
[2025-10-24T20:00:16.803980] [INFO ] [REMOTE    ] MSCI: Full fetch complete (50473 records).
[2025-10-24T20:00:16.804069] [DEBUG] [VALIDATOR ] MSCI: Validating primary data.
[2025-10-24T20:00:16.804224] [DEBUG] [LOCAL     ] MSGS: Deleted primary data file.
[2025-10-24T20:00:16.804296] [INFO ] [MAIN      ] MSGS: Starting full primary refresh.
[2025-10-24T20:00:16.948076] [INFO ] [REMOTE    ] MSGE: Fetching primary data for 2025-02.
[2025-10-24T20:00:17.663409] [INFO ] [REMOTE    ] MSGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:00:17.716599] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present.
[2025-10-24T20:00:17.716813] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed.
[2025-10-24T20:00:17.718055] [INFO ] [MAIN      ] MSCI: Fetched primary data is valid.
[2025-10-24T20:00:17.718191] [DEBUG] [LOCAL     ] MSCI: Saving primary data.
[2025-10-24T20:00:17.725602] [FATAL] [LOCAL     ] MSCI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:00:17.738672] [FATAL] [MAIN      ] MSCI: Failed to save primary data.
[2025-10-24T20:00:17.739340] [WARN ] [MAIN      ] MSCI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:00:17.740421] [INFO ] [REMOTE    ] MSDL: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T20:00:17.740739] [INFO ] [LOCAL     ] MSCI: Starting deletion of primary data.
[2025-10-24T20:00:17.747849] [DEBUG] [LOCAL     ] MSCI: No primary data file found to delete.
[2025-10-24T20:00:17.748240] [INFO ] [LOCAL     ] MSCI: Starting deletion of derivative data.
[2025-10-24T20:00:17.747718] [INFO ] [REMOTE    ] MSGS: Fetching primary data for 2025-01.
[2025-10-24T20:00:17.750047] [DEBUG] [LOCAL     ] MSCI: Deleted derivative data file.
[2025-10-24T20:00:17.750406] [INFO ] [MAIN      ] Update Progress: 1404/2366 symbols completed. MSCI took 33.2s. Estimated remaining: 2h 3m 30s. Rate: 7.8 symbols/min
[2025-10-24T20:00:17.943878] [INFO ] [MAIN      ] MSI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:00:17.985719] [DEBUG] [LOCAL     ] MSI: Loaded 39876 existing records from primary storage.
[2025-10-24T20:00:17.986031] [INFO ] [MAIN      ] MSI: Loaded 39876 existing records.
[2025-10-24T20:00:18.184837] [WARN ] [MAIN      ] MSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:00:18.185101] [INFO ] [MAIN      ] MSI: Wiping existing primary data before full refresh.
[2025-10-24T20:00:18.185275] [INFO ] [LOCAL     ] MSI: Starting deletion of primary data.
[2025-10-24T20:00:18.193061] [DEBUG] [LOCAL     ] MSI: Deleted primary data file.
[2025-10-24T20:00:18.197884] [INFO ] [MAIN      ] MSI: Starting full primary refresh.
[2025-10-24T20:00:18.289695] [INFO ] [REMOTE    ] MSGE: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T20:00:18.574338] [INFO ] [REMOTE    ] MSGE: Fetching primary data for 2025-03.
[2025-10-24T20:00:18.579173] [INFO ] [REMOTE    ] MSI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:00:18.588752] [INFO ] [REMOTE    ] MSGS: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T20:00:19.347723] [INFO ] [REMOTE    ] MSI: Fetching primary data for 2025-01.
[2025-10-24T20:00:19.941808] [INFO ] [REMOTE    ] MSGE: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T20:00:20.147720] [INFO ] [REMOTE    ] MSGS: Fetching primary data for 2025-02.
[2025-10-24T20:00:20.806552] [INFO ] [REMOTE    ] MSI: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T20:00:20.947622] [INFO ] [REMOTE    ] MSGE: Fetching primary data for 2025-04.
[2025-10-24T20:00:20.997268] [INFO ] [REMOTE    ] MSGS: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T20:00:21.747693] [INFO ] [REMOTE    ] MSI: Fetching primary data for 2025-02.
[2025-10-24T20:00:22.058488] [INFO ] [REMOTE    ] MSGE: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T20:00:22.547718] [INFO ] [REMOTE    ] MSGE: Fetching primary data for 2025-05.
[2025-10-24T20:00:23.347703] [INFO ] [REMOTE    ] MSDL: Fetching primary data for 2025-06.
[2025-10-24T20:00:23.385870] [INFO ] [REMOTE    ] MSI: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T20:00:23.435759] [INFO ] [REMOTE    ] MSGE: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T20:00:24.147731] [INFO ] [REMOTE    ] MSGS: Fetching primary data for 2025-03.
[2025-10-24T20:00:24.804993] [INFO ] [REMOTE    ] MSDL: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T20:00:24.947761] [INFO ] [REMOTE    ] MSDL: Fetching primary data for 2025-07.
[2025-10-24T20:00:25.223899] [INFO ] [REMOTE    ] MSGS: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T20:00:25.747690] [INFO ] [REMOTE    ] MSI: Fetching primary data for 2025-03.
[2025-10-24T20:00:26.169625] [INFO ] [REMOTE    ] MSDL: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T20:00:26.547694] [INFO ] [REMOTE    ] MSGE: Fetching primary data for 2025-06.
[2025-10-24T20:00:26.951791] [INFO ] [REMOTE    ] MSI: Incremental fetch complete for 2025-03 (1.20 seconds).
[2025-10-24T20:00:27.347704] [INFO ] [REMOTE    ] MSDL: Fetching primary data for 2025-08.
[2025-10-24T20:00:27.650370] [INFO ] [REMOTE    ] MSGE: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T20:00:28.147673] [INFO ] [REMOTE    ] MSI: Fetching primary data for 2025-04.
[2025-10-24T20:00:28.674238] [INFO ] [REMOTE    ] MSDL: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T20:00:28.947741] [INFO ] [REMOTE    ] MSGE: Fetching primary data for 2025-07.
[2025-10-24T20:00:29.747621] [INFO ] [REMOTE    ] MSGS: Fetching primary data for 2025-04.
[2025-10-24T20:00:29.906072] [INFO ] [REMOTE    ] MSI: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T20:00:30.017031] [INFO ] [REMOTE    ] MSGE: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T20:00:30.547702] [INFO ] [REMOTE    ] MSI: Fetching primary data for 2025-05.
[2025-10-24T20:00:30.792468] [INFO ] [REMOTE    ] MSGS: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T20:00:31.347723] [INFO ] [REMOTE    ] MSDL: Fetching primary data for 2025-09.
[2025-10-24T20:00:32.147734] [INFO ] [REMOTE    ] MSGS: Fetching primary data for 2025-05.
[2025-10-24T20:00:32.182270] [INFO ] [REMOTE    ] MSI: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T20:00:32.855062] [INFO ] [REMOTE    ] MSDL: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T20:00:32.947677] [INFO ] [REMOTE    ] MSI: Fetching primary data for 2025-06.
[2025-10-24T20:00:33.032500] [INFO ] [REMOTE    ] MSGS: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T20:00:33.747732] [INFO ] [REMOTE    ] MSGE: Fetching primary data for 2025-08.
[2025-10-24T20:00:34.311396] [INFO ] [REMOTE    ] MSI: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T20:00:34.547620] [INFO ] [REMOTE    ] MSI: Fetching primary data for 2025-07.
[2025-10-24T20:00:34.830192] [INFO ] [REMOTE    ] MSGE: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T20:00:35.347689] [INFO ] [REMOTE    ] MSGE: Fetching primary data for 2025-09.
[2025-10-24T20:00:35.694452] [INFO ] [REMOTE    ] MSI: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T20:00:36.147637] [INFO ] [REMOTE    ] MSI: Fetching primary data for 2025-08.
[2025-10-24T20:00:36.569793] [INFO ] [REMOTE    ] MSGE: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T20:00:36.947669] [INFO ] [REMOTE    ] MSGE: Fetching primary data for 2025-10.
[2025-10-24T20:00:37.601861] [INFO ] [REMOTE    ] MSI: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T20:00:37.747702] [INFO ] [REMOTE    ] MSI: Fetching primary data for 2025-09.
[2025-10-24T20:00:38.190873] [INFO ] [REMOTE    ] MSGE: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T20:00:38.197329] [INFO ] [REMOTE    ] MSGE: Full fetch complete (39876 records).
[2025-10-24T20:00:38.197481] [DEBUG] [VALIDATOR ] MSGE: Validating primary data.
[2025-10-24T20:00:38.549123] [INFO ] [REMOTE    ] MSGS: Fetching primary data for 2025-06.
[2025-10-24T20:00:38.587863] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present.
[2025-10-24T20:00:38.587949] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed.
[2025-10-24T20:00:38.589054] [INFO ] [MAIN      ] MSGE: Fetched primary data is valid.
[2025-10-24T20:00:38.589205] [DEBUG] [LOCAL     ] MSGE: Saving primary data.
[2025-10-24T20:00:38.589796] [FATAL] [LOCAL     ] MSGE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:00:38.589904] [FATAL] [MAIN      ] MSGE: Failed to save primary data.
[2025-10-24T20:00:38.589968] [WARN ] [MAIN      ] MSGE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:00:38.590029] [INFO ] [LOCAL     ] MSGE: Starting deletion of primary data.
[2025-10-24T20:00:38.590090] [DEBUG] [LOCAL     ] MSGE: No primary data file found to delete.
[2025-10-24T20:00:38.590128] [INFO ] [LOCAL     ] MSGE: Starting deletion of derivative data.
[2025-10-24T20:00:38.590294] [DEBUG] [LOCAL     ] MSGE: Deleted derivative data file.
[2025-10-24T20:00:38.590419] [INFO ] [MAIN      ] Update Progress: 1405/2366 symbols completed. MSGE took 26.8s. Estimated remaining: 2h 3m 31s. Rate: 7.8 symbols/min
[2025-10-24T20:00:38.764692] [INFO ] [MAIN      ] MSIF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:00:38.764874] [DEBUG] [LOCAL     ] MSIF: No existing data file found in primary storage.
[2025-10-24T20:00:38.764916] [WARN ] [MAIN      ] MSIF: No existing data found, performing full refresh instead.
[2025-10-24T20:00:38.765061] [INFO ] [MAIN      ] MSIF: Wiping existing primary data before full refresh.
[2025-10-24T20:00:38.765126] [INFO ] [LOCAL     ] MSIF: Starting deletion of primary data.
[2025-10-24T20:00:38.765174] [DEBUG] [LOCAL     ] MSIF: No primary data file found to delete.
[2025-10-24T20:00:38.765206] [INFO ] [MAIN      ] MSIF: Starting full primary refresh.
[2025-10-24T20:00:39.117423] [INFO ] [REMOTE    ] MSIF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:00:39.347623] [INFO ] [REMOTE    ] MSIF: Fetching primary data for 2025-01.
[2025-10-24T20:00:39.393536] [INFO ] [REMOTE    ] MSI: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T20:00:39.652255] [INFO ] [REMOTE    ] MSGS: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T20:00:39.725056] [INFO ] [REMOTE    ] MSIF: Incremental fetch complete for 2025-01 (0.38 seconds).
[2025-10-24T20:00:40.147703] [INFO ] [REMOTE    ] MSI: Fetching primary data for 2025-10.
[2025-10-24T20:00:40.947710] [INFO ] [REMOTE    ] MSGS: Fetching primary data for 2025-07.
[2025-10-24T20:00:41.747751] [INFO ] [REMOTE    ] MSIF: Fetching primary data for 2025-02.
[2025-10-24T20:00:41.887272] [INFO ] [REMOTE    ] MSGS: Incremental fetch complete for 2025-07 (0.94 seconds).
[2025-10-24T20:00:41.929189] [INFO ] [REMOTE    ] MSI: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T20:00:41.935686] [INFO ] [REMOTE    ] MSI: Full fetch complete (58013 records).
[2025-10-24T20:00:41.935779] [DEBUG] [VALIDATOR ] MSI: Validating primary data.
[2025-10-24T20:00:42.319311] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present.
[2025-10-24T20:00:42.319614] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed.
[2025-10-24T20:00:42.321173] [INFO ] [MAIN      ] MSI: Fetched primary data is valid.
[2025-10-24T20:00:42.321235] [DEBUG] [LOCAL     ] MSI: Saving primary data.
[2025-10-24T20:00:42.321744] [FATAL] [LOCAL     ] MSI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:00:42.321861] [FATAL] [MAIN      ] MSI: Failed to save primary data.
[2025-10-24T20:00:42.321928] [WARN ] [MAIN      ] MSI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:00:42.321971] [INFO ] [LOCAL     ] MSI: Starting deletion of primary data.
[2025-10-24T20:00:42.322033] [DEBUG] [LOCAL     ] MSI: No primary data file found to delete.
[2025-10-24T20:00:42.322088] [INFO ] [LOCAL     ] MSI: Starting deletion of derivative data.
[2025-10-24T20:00:42.322811] [DEBUG] [LOCAL     ] MSI: Deleted derivative data file.
[2025-10-24T20:00:42.323531] [INFO ] [MAIN      ] Update Progress: 1406/2366 symbols completed. MSI took 24.6s. Estimated remaining: 2h 3m 21s. Rate: 7.8 symbols/min
[2025-10-24T20:00:42.490049] [INFO ] [MAIN      ] MSM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:00:42.526092] [DEBUG] [LOCAL     ] MSM: Loaded 35752 existing records from primary storage.
[2025-10-24T20:00:42.526358] [INFO ] [MAIN      ] MSM: Loaded 35752 existing records.
[2025-10-24T20:00:42.555870] [INFO ] [REMOTE    ] MSDL: Fetching primary data for 2025-10.
[2025-10-24T20:00:42.709926] [INFO ] [REMOTE    ] MSIF: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T20:00:42.723132] [WARN ] [MAIN      ] MSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:00:42.726744] [INFO ] [MAIN      ] MSM: Wiping existing primary data before full refresh.
[2025-10-24T20:00:42.726796] [INFO ] [LOCAL     ] MSM: Starting deletion of primary data.
[2025-10-24T20:00:42.727006] [DEBUG] [LOCAL     ] MSM: Deleted primary data file.
[2025-10-24T20:00:42.727062] [INFO ] [MAIN      ] MSM: Starting full primary refresh.
[2025-10-24T20:00:43.079148] [INFO ] [REMOTE    ] MSM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:00:43.347674] [INFO ] [REMOTE    ] MSM: Fetching primary data for 2025-01.
[2025-10-24T20:00:44.147615] [INFO ] [REMOTE    ] MSGS: Fetching primary data for 2025-08.
[2025-10-24T20:00:44.479036] [INFO ] [REMOTE    ] MSDL: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T20:00:44.487713] [INFO ] [REMOTE    ] MSDL: Full fetch complete (56576 records).
[2025-10-24T20:00:44.487912] [DEBUG] [VALIDATOR ] MSDL: Validating primary data.
[2025-10-24T20:00:44.888033] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present.
[2025-10-24T20:00:44.888117] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed.
[2025-10-24T20:00:44.889164] [INFO ] [MAIN      ] MSDL: Fetched primary data is valid.
[2025-10-24T20:00:44.889246] [DEBUG] [LOCAL     ] MSDL: Saving primary data.
[2025-10-24T20:00:44.889834] [FATAL] [LOCAL     ] MSDL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:00:44.889992] [FATAL] [MAIN      ] MSDL: Failed to save primary data.
[2025-10-24T20:00:44.897634] [WARN ] [MAIN      ] MSDL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:00:44.909947] [INFO ] [LOCAL     ] MSDL: Starting deletion of primary data.
[2025-10-24T20:00:44.911266] [INFO ] [REMOTE    ] MSM: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T20:00:44.910518] [DEBUG] [LOCAL     ] MSDL: No primary data file found to delete.
[2025-10-24T20:00:44.919239] [INFO ] [LOCAL     ] MSDL: Starting deletion of derivative data.
[2025-10-24T20:00:44.919830] [DEBUG] [LOCAL     ] MSDL: Deleted derivative data file.
[2025-10-24T20:00:44.919914] [INFO ] [MAIN      ] Update Progress: 1407/2366 symbols completed. MSDL took 46.5s. Estimated remaining: 2h 3m 10s. Rate: 7.8 symbols/min
[2025-10-24T20:00:44.951357] [INFO ] [REMOTE    ] MSIF: Fetching primary data for 2025-03.
[2025-10-24T20:00:45.098142] [INFO ] [MAIN      ] MT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:00:45.109939] [INFO ] [REMOTE    ] MSGS: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T20:00:45.159552] [DEBUG] [LOCAL     ] MT: Loaded 50743 existing records from primary storage.
[2025-10-24T20:00:45.159878] [INFO ] [MAIN      ] MT: Loaded 50743 existing records.
[2025-10-24T20:00:45.334379] [WARN ] [MAIN      ] MT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:00:45.334556] [INFO ] [MAIN      ] MT: Wiping existing primary data before full refresh.
[2025-10-24T20:00:45.334605] [INFO ] [LOCAL     ] MT: Starting deletion of primary data.
[2025-10-24T20:00:45.335178] [DEBUG] [LOCAL     ] MT: Deleted primary data file.
[2025-10-24T20:00:45.335235] [INFO ] [MAIN      ] MT: Starting full primary refresh.
[2025-10-24T20:00:45.683140] [INFO ] [REMOTE    ] MT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:00:45.747600] [INFO ] [REMOTE    ] MT: Fetching primary data for 2025-01.
[2025-10-24T20:00:45.831153] [INFO ] [REMOTE    ] MSIF: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T20:00:46.547719] [INFO ] [REMOTE    ] MSIF: Fetching primary data for 2025-04.
[2025-10-24T20:00:47.237521] [INFO ] [REMOTE    ] MT: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T20:00:47.261262] [INFO ] [REMOTE    ] MSIF: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T20:00:47.347607] [INFO ] [REMOTE    ] MSIF: Fetching primary data for 2025-05.
[2025-10-24T20:00:47.942583] [INFO ] [REMOTE    ] MSIF: Incremental fetch complete for 2025-05 (0.59 seconds).
[2025-10-24T20:00:48.147637] [INFO ] [REMOTE    ] MT: Fetching primary data for 2025-02.
[2025-10-24T20:00:48.947664] [INFO ] [REMOTE    ] MSGS: Fetching primary data for 2025-09.
[2025-10-24T20:00:49.747720] [INFO ] [REMOTE    ] MSM: Fetching primary data for 2025-02.
[2025-10-24T20:00:49.799079] [INFO ] [REMOTE    ] MT: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T20:00:50.042066] [INFO ] [REMOTE    ] MSGS: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T20:00:50.547727] [INFO ] [REMOTE    ] MSIF: Fetching primary data for 2025-06.
[2025-10-24T20:00:51.083371] [INFO ] [REMOTE    ] MSM: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T20:00:51.347627] [INFO ] [REMOTE    ] MSM: Fetching primary data for 2025-03.
[2025-10-24T20:00:51.498801] [INFO ] [REMOTE    ] MSIF: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T20:00:52.147678] [INFO ] [REMOTE    ] MSIF: Fetching primary data for 2025-07.
[2025-10-24T20:00:52.744238] [INFO ] [REMOTE    ] MSM: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T20:00:52.947620] [INFO ] [REMOTE    ] MT: Fetching primary data for 2025-03.
[2025-10-24T20:00:52.971216] [INFO ] [REMOTE    ] MSIF: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T20:00:53.747626] [INFO ] [REMOTE    ] MSIF: Fetching primary data for 2025-08.
[2025-10-24T20:00:54.547628] [INFO ] [REMOTE    ] MSM: Fetching primary data for 2025-04.
[2025-10-24T20:00:54.786816] [INFO ] [REMOTE    ] MT: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T20:00:54.837266] [INFO ] [REMOTE    ] MSIF: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T20:00:55.347719] [INFO ] [REMOTE    ] MSIF: Fetching primary data for 2025-09.
[2025-10-24T20:00:56.029206] [INFO ] [REMOTE    ] MSM: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T20:00:56.082414] [INFO ] [REMOTE    ] MSIF: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T20:00:56.147602] [INFO ] [REMOTE    ] MSM: Fetching primary data for 2025-05.
[2025-10-24T20:00:56.947667] [INFO ] [REMOTE    ] MT: Fetching primary data for 2025-04.
[2025-10-24T20:00:57.493677] [INFO ] [REMOTE    ] MSM: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T20:00:57.747698] [INFO ] [REMOTE    ] MSIF: Fetching primary data for 2025-10.
[2025-10-24T20:00:58.547725] [INFO ] [REMOTE    ] MSM: Fetching primary data for 2025-06.
[2025-10-24T20:00:58.828300] [INFO ] [REMOTE    ] MT: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T20:00:58.955790] [INFO ] [REMOTE    ] MSIF: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T20:00:58.959945] [INFO ] [REMOTE    ] MSIF: Full fetch complete (19554 records).
[2025-10-24T20:00:58.960041] [DEBUG] [VALIDATOR ] MSIF: Validating primary data.
[2025-10-24T20:00:59.142809] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 186 unique days, need 200 days
[2025-10-24T20:00:59.143221] [FATAL] [MAIN      ] MSIF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:00:59.143303] [WARN ] [MAIN      ] MSIF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:00:59.143364] [INFO ] [LOCAL     ] MSIF: Starting deletion of primary data.
[2025-10-24T20:00:59.143443] [DEBUG] [LOCAL     ] MSIF: No primary data file found to delete.
[2025-10-24T20:00:59.143493] [INFO ] [LOCAL     ] MSIF: Starting deletion of derivative data.
[2025-10-24T20:00:59.143555] [DEBUG] [LOCAL     ] MSIF: No derivative data file found to delete.
[2025-10-24T20:00:59.143635] [INFO ] [MAIN      ] Update Progress: 1408/2366 symbols completed. MSIF took 20.6s. Estimated remaining: 2h 3m 7s. Rate: 7.8 symbols/min
[2025-10-24T20:00:59.321152] [INFO ] [MAIN      ] MTB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:00:59.347676] [INFO ] [REMOTE    ] MT: Fetching primary data for 2025-05.
[2025-10-24T20:00:59.370479] [DEBUG] [LOCAL     ] MTB: Loaded 46978 existing records from primary storage.
[2025-10-24T20:00:59.370817] [INFO ] [MAIN      ] MTB: Loaded 46978 existing records.
[2025-10-24T20:00:59.561400] [WARN ] [MAIN      ] MTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:00:59.561586] [INFO ] [MAIN      ] MTB: Wiping existing primary data before full refresh.
[2025-10-24T20:00:59.561633] [INFO ] [LOCAL     ] MTB: Starting deletion of primary data.
[2025-10-24T20:00:59.562138] [DEBUG] [LOCAL     ] MTB: Deleted primary data file.
[2025-10-24T20:00:59.562185] [INFO ] [MAIN      ] MTB: Starting full primary refresh.
[2025-10-24T20:00:59.934356] [INFO ] [REMOTE    ] MTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:00:59.952212] [INFO ] [REMOTE    ] MSM: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T20:01:00.147622] [INFO ] [REMOTE    ] MSGS: Fetching primary data for 2025-10.
[2025-10-24T20:01:00.947677] [INFO ] [REMOTE    ] MTB: Fetching primary data for 2025-01.
[2025-10-24T20:01:01.542106] [INFO ] [REMOTE    ] MSGS: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T20:01:01.550571] [INFO ] [REMOTE    ] MT: Incremental fetch complete for 2025-05 (2.20 seconds).
[2025-10-24T20:01:01.551023] [INFO ] [REMOTE    ] MSGS: Full fetch complete (23762 records).
[2025-10-24T20:01:01.562091] [DEBUG] [VALIDATOR ] MSGS: Validating primary data.
[2025-10-24T20:01:01.748476] [INFO ] [REMOTE    ] MT: Fetching primary data for 2025-06.
[2025-10-24T20:01:01.976399] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present.
[2025-10-24T20:01:01.976504] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed.
[2025-10-24T20:01:01.977115] [INFO ] [MAIN      ] MSGS: Fetched primary data is valid.
[2025-10-24T20:01:01.977185] [DEBUG] [LOCAL     ] MSGS: Saving primary data.
[2025-10-24T20:01:01.977670] [FATAL] [LOCAL     ] MSGS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:01:01.977765] [FATAL] [MAIN      ] MSGS: Failed to save primary data.
[2025-10-24T20:01:01.977808] [WARN ] [MAIN      ] MSGS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:01:01.977844] [INFO ] [LOCAL     ] MSGS: Starting deletion of primary data.
[2025-10-24T20:01:01.977895] [DEBUG] [LOCAL     ] MSGS: No primary data file found to delete.
[2025-10-24T20:01:01.977934] [INFO ] [LOCAL     ] MSGS: Starting deletion of derivative data.
[2025-10-24T20:01:01.978049] [DEBUG] [LOCAL     ] MSGS: Deleted derivative data file.
[2025-10-24T20:01:01.978129] [INFO ] [MAIN      ] Update Progress: 1409/2366 symbols completed. MSGS took 45.7s. Estimated remaining: 2h 2m 56s. Rate: 7.8 symbols/min
[2025-10-24T20:01:02.166211] [INFO ] [MAIN      ] MTD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:01:02.185700] [DEBUG] [LOCAL     ] MTD: Loaded 15251 existing records from primary storage.
[2025-10-24T20:01:02.185987] [INFO ] [MAIN      ] MTD: Loaded 15251 existing records.
[2025-10-24T20:01:02.381990] [WARN ] [MAIN      ] MTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:01:02.382284] [INFO ] [MAIN      ] MTD: Wiping existing primary data before full refresh.
[2025-10-24T20:01:02.382361] [INFO ] [LOCAL     ] MTD: Starting deletion of primary data.
[2025-10-24T20:01:02.382600] [DEBUG] [LOCAL     ] MTD: Deleted primary data file.
[2025-10-24T20:01:02.382686] [INFO ] [MAIN      ] MTD: Starting full primary refresh.
[2025-10-24T20:01:02.547957] [INFO ] [REMOTE    ] MSM: Fetching primary data for 2025-07.
[2025-10-24T20:01:02.756430] [INFO ] [REMOTE    ] MTD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:01:02.786983] [INFO ] [REMOTE    ] MTB: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T20:01:03.347750] [INFO ] [REMOTE    ] MTD: Fetching primary data for 2025-01.
[2025-10-24T20:01:03.418492] [INFO ] [REMOTE    ] MT: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T20:01:04.037611] [INFO ] [REMOTE    ] MSM: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T20:01:04.147686] [INFO ] [REMOTE    ] MSM: Fetching primary data for 2025-08.
[2025-10-24T20:01:04.257519] [INFO ] [REMOTE    ] MTD: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T20:01:04.947743] [INFO ] [REMOTE    ] MT: Fetching primary data for 2025-07.
[2025-10-24T20:01:05.324098] [INFO ] [REMOTE    ] MSM: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T20:01:05.747731] [INFO ] [REMOTE    ] MSM: Fetching primary data for 2025-09.
[2025-10-24T20:01:06.547682] [INFO ] [REMOTE    ] MTB: Fetching primary data for 2025-02.
[2025-10-24T20:01:06.645287] [INFO ] [REMOTE    ] MT: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T20:01:07.097408] [INFO ] [REMOTE    ] MSM: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T20:01:07.347691] [INFO ] [REMOTE    ] MSM: Fetching primary data for 2025-10.
[2025-10-24T20:01:07.824175] [INFO ] [REMOTE    ] MTB: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T20:01:08.147740] [INFO ] [REMOTE    ] MTD: Fetching primary data for 2025-02.
[2025-10-24T20:01:08.832724] [INFO ] [REMOTE    ] MSM: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T20:01:08.841851] [INFO ] [REMOTE    ] MSM: Full fetch complete (51871 records).
[2025-10-24T20:01:08.841989] [DEBUG] [VALIDATOR ] MSM: Validating primary data.
[2025-10-24T20:01:08.952785] [INFO ] [REMOTE    ] MTB: Fetching primary data for 2025-03.
[2025-10-24T20:01:09.306473] [INFO ] [REMOTE    ] MTD: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T20:01:09.381843] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present.
[2025-10-24T20:01:09.381936] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed.
[2025-10-24T20:01:09.383051] [INFO ] [MAIN      ] MSM: Fetched primary data is valid.
[2025-10-24T20:01:09.383116] [DEBUG] [LOCAL     ] MSM: Saving primary data.
[2025-10-24T20:01:09.383722] [FATAL] [LOCAL     ] MSM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:01:09.383821] [FATAL] [MAIN      ] MSM: Failed to save primary data.
[2025-10-24T20:01:09.383863] [WARN ] [MAIN      ] MSM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:01:09.383898] [INFO ] [LOCAL     ] MSM: Starting deletion of primary data.
[2025-10-24T20:01:09.383952] [DEBUG] [LOCAL     ] MSM: No primary data file found to delete.
[2025-10-24T20:01:09.383989] [INFO ] [LOCAL     ] MSM: Starting deletion of derivative data.
[2025-10-24T20:01:09.384116] [DEBUG] [LOCAL     ] MSM: Deleted derivative data file.
[2025-10-24T20:01:09.384727] [INFO ] [MAIN      ] Update Progress: 1410/2366 symbols completed. MSM took 27.1s. Estimated remaining: 2h 2m 48s. Rate: 7.8 symbols/min
[2025-10-24T20:01:09.555664] [INFO ] [MAIN      ] MTDR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:01:09.606423] [DEBUG] [LOCAL     ] MTDR: Loaded 52152 existing records from primary storage.
[2025-10-24T20:01:09.606750] [INFO ] [MAIN      ] MTDR: Loaded 52152 existing records.
[2025-10-24T20:01:09.747949] [INFO ] [REMOTE    ] MTD: Fetching primary data for 2025-03.
[2025-10-24T20:01:09.782459] [WARN ] [MAIN      ] MTDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:01:09.782968] [INFO ] [MAIN      ] MTDR: Wiping existing primary data before full refresh.
[2025-10-24T20:01:09.783058] [INFO ] [LOCAL     ] MTDR: Starting deletion of primary data.
[2025-10-24T20:01:09.783425] [DEBUG] [LOCAL     ] MTDR: Deleted primary data file.
[2025-10-24T20:01:09.783485] [INFO ] [MAIN      ] MTDR: Starting full primary refresh.
[2025-10-24T20:01:10.153773] [INFO ] [REMOTE    ] MTDR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:01:10.547635] [INFO ] [REMOTE    ] MTDR: Fetching primary data for 2025-01.
[2025-10-24T20:01:10.657413] [INFO ] [REMOTE    ] MTB: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T20:01:10.749959] [INFO ] [REMOTE    ] MTD: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T20:01:11.347679] [INFO ] [REMOTE    ] MTB: Fetching primary data for 2025-04.
[2025-10-24T20:01:12.147708] [INFO ] [REMOTE    ] MTD: Fetching primary data for 2025-04.
[2025-10-24T20:01:12.331596] [INFO ] [REMOTE    ] MTDR: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T20:01:12.947725] [INFO ] [REMOTE    ] MTDR: Fetching primary data for 2025-02.
[2025-10-24T20:01:12.998904] [INFO ] [REMOTE    ] MTB: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T20:01:13.066632] [INFO ] [REMOTE    ] MTD: Incremental fetch complete for 2025-04 (0.92 seconds).
[2025-10-24T20:01:13.747725] [INFO ] [REMOTE    ] MT: Fetching primary data for 2025-08.
[2025-10-24T20:01:14.137481] [INFO ] [REMOTE    ] MTDR: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T20:01:14.547690] [INFO ] [REMOTE    ] MTD: Fetching primary data for 2025-05.
[2025-10-24T20:01:15.065408] [INFO ] [REMOTE    ] MT: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T20:01:15.347619] [INFO ] [REMOTE    ] MTDR: Fetching primary data for 2025-03.
[2025-10-24T20:01:15.700637] [INFO ] [REMOTE    ] MTD: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T20:01:16.147721] [INFO ] [REMOTE    ] MT: Fetching primary data for 2025-09.
[2025-10-24T20:01:16.959313] [INFO ] [REMOTE    ] MTD: Fetching primary data for 2025-06.
[2025-10-24T20:01:16.965685] [INFO ] [REMOTE    ] MTDR: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T20:01:17.747677] [INFO ] [REMOTE    ] MTB: Fetching primary data for 2025-05.
[2025-10-24T20:01:17.811053] [INFO ] [REMOTE    ] MT: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T20:01:17.867358] [INFO ] [REMOTE    ] MTD: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T20:01:18.547731] [INFO ] [REMOTE    ] MTDR: Fetching primary data for 2025-04.
[2025-10-24T20:01:19.336334] [INFO ] [REMOTE    ] MTB: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T20:01:19.347604] [INFO ] [REMOTE    ] MTD: Fetching primary data for 2025-07.
[2025-10-24T20:01:19.868784] [INFO ] [REMOTE    ] MTDR: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T20:01:20.147627] [INFO ] [REMOTE    ] MTB: Fetching primary data for 2025-06.
[2025-10-24T20:01:20.346063] [INFO ] [REMOTE    ] MTD: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T20:01:20.947679] [INFO ] [REMOTE    ] MT: Fetching primary data for 2025-10.
[2025-10-24T20:01:21.747766] [INFO ] [REMOTE    ] MTDR: Fetching primary data for 2025-05.
[2025-10-24T20:01:21.806196] [INFO ] [REMOTE    ] MTB: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T20:01:22.547700] [INFO ] [REMOTE    ] MTD: Fetching primary data for 2025-08.
[2025-10-24T20:01:22.694271] [INFO ] [REMOTE    ] MT: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T20:01:22.705211] [INFO ] [REMOTE    ] MT: Full fetch complete (73694 records).
[2025-10-24T20:01:22.705471] [DEBUG] [VALIDATOR ] MT: Validating primary data.
[2025-10-24T20:01:23.113384] [DEBUG] [VALIDATOR ] MT: All expected trading days are present.
[2025-10-24T20:01:23.113557] [DEBUG] [VALIDATOR ] MT: Primary data validation passed.
[2025-10-24T20:01:23.114795] [INFO ] [MAIN      ] MT: Fetched primary data is valid.
[2025-10-24T20:01:23.114901] [DEBUG] [LOCAL     ] MT: Saving primary data.
[2025-10-24T20:01:23.115582] [FATAL] [LOCAL     ] MT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:01:23.115777] [FATAL] [MAIN      ] MT: Failed to save primary data.
[2025-10-24T20:01:23.115846] [WARN ] [MAIN      ] MT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:01:23.116023] [INFO ] [LOCAL     ] MT: Starting deletion of primary data.
[2025-10-24T20:01:23.116113] [DEBUG] [LOCAL     ] MT: No primary data file found to delete.
[2025-10-24T20:01:23.116233] [INFO ] [LOCAL     ] MT: Starting deletion of derivative data.
[2025-10-24T20:01:23.116396] [DEBUG] [LOCAL     ] MT: Deleted derivative data file.
[2025-10-24T20:01:23.116879] [INFO ] [MAIN      ] Update Progress: 1411/2366 symbols completed. MT took 38.2s. Estimated remaining: 2h 2m 44s. Rate: 7.8 symbols/min
[2025-10-24T20:01:23.299990] [INFO ] [REMOTE    ] MTDR: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T20:01:23.336516] [INFO ] [MAIN      ] MTG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:01:23.347628] [INFO ] [REMOTE    ] MTDR: Fetching primary data for 2025-06.
[2025-10-24T20:01:23.390015] [DEBUG] [LOCAL     ] MTG: Loaded 51417 existing records from primary storage.
[2025-10-24T20:01:23.390346] [INFO ] [MAIN      ] MTG: Loaded 51417 existing records.
[2025-10-24T20:01:23.515748] [INFO ] [REMOTE    ] MTD: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T20:01:23.586252] [WARN ] [MAIN      ] MTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:01:23.586447] [INFO ] [MAIN      ] MTG: Wiping existing primary data before full refresh.
[2025-10-24T20:01:23.586494] [INFO ] [LOCAL     ] MTG: Starting deletion of primary data.
[2025-10-24T20:01:23.586938] [DEBUG] [LOCAL     ] MTG: Deleted primary data file.
[2025-10-24T20:01:23.586994] [INFO ] [MAIN      ] MTG: Starting full primary refresh.
[2025-10-24T20:01:23.959761] [INFO ] [REMOTE    ] MTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:01:24.147721] [INFO ] [REMOTE    ] MTG: Fetching primary data for 2025-01.
[2025-10-24T20:01:24.957763] [INFO ] [REMOTE    ] MTB: Fetching primary data for 2025-07.
[2025-10-24T20:01:24.963504] [INFO ] [REMOTE    ] MTDR: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T20:01:25.747740] [INFO ] [REMOTE    ] MTDR: Fetching primary data for 2025-07.
[2025-10-24T20:01:25.779594] [INFO ] [REMOTE    ] MTG: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T20:01:26.206626] [INFO ] [REMOTE    ] MTB: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T20:01:26.547728] [INFO ] [REMOTE    ] MTD: Fetching primary data for 2025-09.
[2025-10-24T20:01:27.157217] [INFO ] [REMOTE    ] MTDR: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T20:01:27.347715] [INFO ] [REMOTE    ] MTDR: Fetching primary data for 2025-08.
[2025-10-24T20:01:27.403056] [INFO ] [REMOTE    ] MTD: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T20:01:28.147742] [INFO ] [REMOTE    ] MTG: Fetching primary data for 2025-02.
[2025-10-24T20:01:28.942336] [INFO ] [REMOTE    ] MTDR: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T20:01:28.952452] [INFO ] [REMOTE    ] MTD: Fetching primary data for 2025-10.
[2025-10-24T20:01:29.747692] [INFO ] [REMOTE    ] MTDR: Fetching primary data for 2025-09.
[2025-10-24T20:01:29.867802] [INFO ] [REMOTE    ] MTG: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T20:01:29.919990] [INFO ] [REMOTE    ] MTD: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T20:01:29.923333] [INFO ] [REMOTE    ] MTD: Full fetch complete (21462 records).
[2025-10-24T20:01:29.923417] [DEBUG] [VALIDATOR ] MTD: Validating primary data.
[2025-10-24T20:01:30.294957] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present.
[2025-10-24T20:01:30.295065] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed.
[2025-10-24T20:01:30.295544] [INFO ] [MAIN      ] MTD: Fetched primary data is valid.
[2025-10-24T20:01:30.295585] [DEBUG] [LOCAL     ] MTD: Saving primary data.
[2025-10-24T20:01:30.295919] [FATAL] [LOCAL     ] MTD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:01:30.296002] [FATAL] [MAIN      ] MTD: Failed to save primary data.
[2025-10-24T20:01:30.296043] [WARN ] [MAIN      ] MTD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:01:30.296076] [INFO ] [LOCAL     ] MTD: Starting deletion of primary data.
[2025-10-24T20:01:30.296126] [DEBUG] [LOCAL     ] MTD: No primary data file found to delete.
[2025-10-24T20:01:30.296161] [INFO ] [LOCAL     ] MTD: Starting deletion of derivative data.
[2025-10-24T20:01:30.296305] [DEBUG] [LOCAL     ] MTD: Deleted derivative data file.
[2025-10-24T20:01:30.296378] [INFO ] [MAIN      ] Update Progress: 1412/2366 symbols completed. MTD took 28.3s. Estimated remaining: 2h 2m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:01:30.462593] [INFO ] [MAIN      ] MTH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:01:30.504361] [DEBUG] [LOCAL     ] MTH: Loaded 44086 existing records from primary storage.
[2025-10-24T20:01:30.504637] [INFO ] [MAIN      ] MTH: Loaded 44086 existing records.
[2025-10-24T20:01:30.558980] [INFO ] [REMOTE    ] MTB: Fetching primary data for 2025-08.
[2025-10-24T20:01:30.681211] [WARN ] [MAIN      ] MTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:01:30.681421] [INFO ] [MAIN      ] MTH: Wiping existing primary data before full refresh.
[2025-10-24T20:01:30.681469] [INFO ] [LOCAL     ] MTH: Starting deletion of primary data.
[2025-10-24T20:01:30.681696] [DEBUG] [LOCAL     ] MTH: Deleted primary data file.
[2025-10-24T20:01:30.681753] [INFO ] [MAIN      ] MTH: Starting full primary refresh.
[2025-10-24T20:01:31.029615] [INFO ] [REMOTE    ] MTH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:01:31.342664] [INFO ] [REMOTE    ] MTDR: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T20:01:31.352868] [INFO ] [REMOTE    ] MTH: Fetching primary data for 2025-01.
[2025-10-24T20:01:31.725979] [INFO ] [REMOTE    ] MTB: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T20:01:32.147753] [INFO ] [REMOTE    ] MTG: Fetching primary data for 2025-03.
[2025-10-24T20:01:32.411620] [INFO ] [REMOTE    ] MTH: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T20:01:32.947703] [INFO ] [REMOTE    ] MTH: Fetching primary data for 2025-02.
[2025-10-24T20:01:33.747734] [INFO ] [REMOTE    ] MTDR: Fetching primary data for 2025-10.
[2025-10-24T20:01:33.816489] [INFO ] [REMOTE    ] MTG: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T20:01:34.346873] [INFO ] [REMOTE    ] MTH: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T20:01:34.547717] [INFO ] [REMOTE    ] MTB: Fetching primary data for 2025-09.
[2025-10-24T20:01:35.347686] [INFO ] [REMOTE    ] MTH: Fetching primary data for 2025-03.
[2025-10-24T20:01:35.724581] [INFO ] [REMOTE    ] MTDR: Incremental fetch complete for 2025-10 (1.98 seconds).
[2025-10-24T20:01:35.734243] [INFO ] [REMOTE    ] MTDR: Full fetch complete (74375 records).
[2025-10-24T20:01:35.734375] [DEBUG] [VALIDATOR ] MTDR: Validating primary data.
[2025-10-24T20:01:36.141471] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present.
[2025-10-24T20:01:36.141571] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed.
[2025-10-24T20:01:36.142832] [INFO ] [MAIN      ] MTDR: Fetched primary data is valid.
[2025-10-24T20:01:36.142896] [DEBUG] [LOCAL     ] MTDR: Saving primary data.
[2025-10-24T20:01:36.143631] [FATAL] [LOCAL     ] MTDR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:01:36.158801] [INFO ] [REMOTE    ] MTG: Fetching primary data for 2025-04.
[2025-10-24T20:01:36.143974] [FATAL] [MAIN      ] MTDR: Failed to save primary data.
[2025-10-24T20:01:36.169691] [WARN ] [MAIN      ] MTDR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:01:36.170132] [INFO ] [LOCAL     ] MTDR: Starting deletion of primary data.
[2025-10-24T20:01:36.172189] [INFO ] [REMOTE    ] MTB: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T20:01:36.170554] [DEBUG] [LOCAL     ] MTDR: No primary data file found to delete.
[2025-10-24T20:01:36.172377] [INFO ] [LOCAL     ] MTDR: Starting deletion of derivative data.
[2025-10-24T20:01:36.181209] [DEBUG] [LOCAL     ] MTDR: Deleted derivative data file.
[2025-10-24T20:01:36.181782] [INFO ] [MAIN      ] Update Progress: 1413/2366 symbols completed. MTDR took 26.8s. Estimated remaining: 2h 2m 27s. Rate: 7.8 symbols/min
[2025-10-24T20:01:36.353536] [INFO ] [MAIN      ] MTN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:01:36.395808] [DEBUG] [LOCAL     ] MTN: Loaded 39602 existing records from primary storage.
[2025-10-24T20:01:36.396110] [INFO ] [MAIN      ] MTN: Loaded 39602 existing records.
[2025-10-24T20:01:36.601042] [WARN ] [MAIN      ] MTN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:01:36.601250] [INFO ] [MAIN      ] MTN: Wiping existing primary data before full refresh.
[2025-10-24T20:01:36.601297] [INFO ] [LOCAL     ] MTN: Starting deletion of primary data.
[2025-10-24T20:01:36.601610] [DEBUG] [LOCAL     ] MTN: Deleted primary data file.
[2025-10-24T20:01:36.601686] [INFO ] [MAIN      ] MTN: Starting full primary refresh.
[2025-10-24T20:01:36.956236] [INFO ] [REMOTE    ] MTB: Fetching primary data for 2025-10.
[2025-10-24T20:01:36.962728] [INFO ] [REMOTE    ] MTN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:01:36.990458] [INFO ] [REMOTE    ] MTH: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T20:01:37.747690] [INFO ] [REMOTE    ] MTN: Fetching primary data for 2025-01.
[2025-10-24T20:01:37.940871] [INFO ] [REMOTE    ] MTG: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T20:01:38.547706] [INFO ] [REMOTE    ] MTG: Fetching primary data for 2025-05.
[2025-10-24T20:01:39.116720] [INFO ] [REMOTE    ] MTB: Incremental fetch complete for 2025-10 (2.16 seconds).
[2025-10-24T20:01:39.125824] [INFO ] [REMOTE    ] MTB: Full fetch complete (68280 records).
[2025-10-24T20:01:39.126000] [DEBUG] [VALIDATOR ] MTB: Validating primary data.
[2025-10-24T20:01:39.356566] [INFO ] [REMOTE    ] MTH: Fetching primary data for 2025-04.
[2025-10-24T20:01:39.456123] [INFO ] [REMOTE    ] MTN: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T20:01:39.558921] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present.
[2025-10-24T20:01:39.558998] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed.
[2025-10-24T20:01:39.560099] [INFO ] [MAIN      ] MTB: Fetched primary data is valid.
[2025-10-24T20:01:39.560162] [DEBUG] [LOCAL     ] MTB: Saving primary data.
[2025-10-24T20:01:39.560725] [FATAL] [LOCAL     ] MTB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:01:39.560835] [FATAL] [MAIN      ] MTB: Failed to save primary data.
[2025-10-24T20:01:39.560910] [WARN ] [MAIN      ] MTB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:01:39.560979] [INFO ] [LOCAL     ] MTB: Starting deletion of primary data.
[2025-10-24T20:01:39.561039] [DEBUG] [LOCAL     ] MTB: No primary data file found to delete.
[2025-10-24T20:01:39.561075] [INFO ] [LOCAL     ] MTB: Starting deletion of derivative data.
[2025-10-24T20:01:39.561190] [DEBUG] [LOCAL     ] MTB: Deleted derivative data file.
[2025-10-24T20:01:39.561692] [INFO ] [MAIN      ] Update Progress: 1414/2366 symbols completed. MTB took 40.4s. Estimated remaining: 2h 2m 16s. Rate: 7.8 symbols/min
[2025-10-24T20:01:39.741157] [INFO ] [MAIN      ] MTR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:01:39.741415] [DEBUG] [LOCAL     ] MTR: No existing data file found in primary storage.
[2025-10-24T20:01:39.741476] [WARN ] [MAIN      ] MTR: No existing data found, performing full refresh instead.
[2025-10-24T20:01:39.741796] [INFO ] [MAIN      ] MTR: Wiping existing primary data before full refresh.
[2025-10-24T20:01:39.741874] [INFO ] [LOCAL     ] MTR: Starting deletion of primary data.
[2025-10-24T20:01:39.741944] [DEBUG] [LOCAL     ] MTR: No primary data file found to delete.
[2025-10-24T20:01:39.741980] [INFO ] [MAIN      ] MTR: Starting full primary refresh.
[2025-10-24T20:01:40.132082] [INFO ] [REMOTE    ] MTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:01:40.134279] [INFO ] [REMOTE    ] MTG: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T20:01:40.147602] [INFO ] [REMOTE    ] MTG: Fetching primary data for 2025-06.
[2025-10-24T20:01:40.947619] [INFO ] [REMOTE    ] MTN: Fetching primary data for 2025-02.
[2025-10-24T20:01:41.020890] [INFO ] [REMOTE    ] MTH: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T20:01:41.048967] [DEBUG] [REMOTE    ] MTN: Error fetching primary data for 2025-02: 'API call returned an empty response.'
[2025-10-24T20:01:41.049250] [WARN ] [REMOTE    ] MTN: No data returned for month 2025-02
[2025-10-24T20:01:41.049359] [FATAL] [REMOTE    ] MTN: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:01:41.049468] [FATAL] [MAIN      ] MTN: Failed to fetch primary data.
[2025-10-24T20:01:41.049548] [WARN ] [MAIN      ] MTN: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:01:41.049639] [INFO ] [LOCAL     ] MTN: Starting deletion of primary data.
[2025-10-24T20:01:41.049750] [DEBUG] [LOCAL     ] MTN: No primary data file found to delete.
[2025-10-24T20:01:41.049790] [INFO ] [LOCAL     ] MTN: Starting deletion of derivative data.
[2025-10-24T20:01:41.049924] [DEBUG] [LOCAL     ] MTN: Deleted derivative data file.
[2025-10-24T20:01:41.050003] [INFO ] [MAIN      ] Update Progress: 1415/2366 symbols completed. MTN took 4.9s. Estimated remaining: 2h 2m 4s. Rate: 7.8 symbols/min
[2025-10-24T20:01:41.220566] [INFO ] [MAIN      ] MTRN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:01:41.241902] [DEBUG] [LOCAL     ] MTRN: Loaded 18229 existing records from primary storage.
[2025-10-24T20:01:41.242136] [INFO ] [MAIN      ] MTRN: Loaded 18229 existing records.
[2025-10-24T20:01:41.418729] [WARN ] [MAIN      ] MTRN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:01:41.418956] [INFO ] [MAIN      ] MTRN: Wiping existing primary data before full refresh.
[2025-10-24T20:01:41.419013] [INFO ] [LOCAL     ] MTRN: Starting deletion of primary data.
[2025-10-24T20:01:41.419223] [DEBUG] [LOCAL     ] MTRN: Deleted primary data file.
[2025-10-24T20:01:41.419278] [INFO ] [MAIN      ] MTRN: Starting full primary refresh.
[2025-10-24T20:01:41.753618] [INFO ] [REMOTE    ] MTH: Fetching primary data for 2025-05.
[2025-10-24T20:01:41.797865] [INFO ] [REMOTE    ] MTRN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:01:41.825206] [INFO ] [REMOTE    ] MTG: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T20:01:42.547624] [INFO ] [REMOTE    ] MTR: Fetching primary data for 2025-01.
[2025-10-24T20:01:42.976848] [INFO ] [REMOTE    ] MTR: Incremental fetch complete for 2025-01 (0.43 seconds).
[2025-10-24T20:01:43.348235] [INFO ] [REMOTE    ] MTRN: Fetching primary data for 2025-01.
[2025-10-24T20:01:43.353536] [INFO ] [REMOTE    ] MTH: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T20:01:44.147632] [INFO ] [REMOTE    ] MTG: Fetching primary data for 2025-07.
[2025-10-24T20:01:44.208000] [INFO ] [REMOTE    ] MTRN: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T20:01:44.947706] [INFO ] [REMOTE    ] MTRN: Fetching primary data for 2025-02.
[2025-10-24T20:01:45.742666] [INFO ] [REMOTE    ] MTG: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T20:01:45.752899] [INFO ] [REMOTE    ] MTH: Fetching primary data for 2025-06.
[2025-10-24T20:01:45.860329] [INFO ] [REMOTE    ] MTRN: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T20:01:46.547692] [INFO ] [REMOTE    ] MTG: Fetching primary data for 2025-08.
[2025-10-24T20:01:47.150623] [INFO ] [REMOTE    ] MTH: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T20:01:47.347676] [INFO ] [REMOTE    ] MTRN: Fetching primary data for 2025-03.
[2025-10-24T20:01:48.147664] [INFO ] [REMOTE    ] MTH: Fetching primary data for 2025-07.
[2025-10-24T20:01:48.248183] [INFO ] [REMOTE    ] MTRN: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T20:01:48.319126] [INFO ] [REMOTE    ] MTG: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T20:01:48.947676] [INFO ] [REMOTE    ] MTRN: Fetching primary data for 2025-04.
[2025-10-24T20:01:49.747664] [INFO ] [REMOTE    ] MTR: Fetching primary data for 2025-02.
[2025-10-24T20:01:49.788418] [INFO ] [REMOTE    ] MTH: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T20:01:50.047466] [INFO ] [REMOTE    ] MTRN: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T20:01:50.091204] [INFO ] [REMOTE    ] MTR: Incremental fetch complete for 2025-02 (0.34 seconds).
[2025-10-24T20:01:50.547632] [INFO ] [REMOTE    ] MTR: Fetching primary data for 2025-03.
[2025-10-24T20:01:50.977778] [INFO ] [REMOTE    ] MTR: Incremental fetch complete for 2025-03 (0.43 seconds).
[2025-10-24T20:01:51.347662] [INFO ] [REMOTE    ] MTG: Fetching primary data for 2025-09.
[2025-10-24T20:01:52.147691] [INFO ] [REMOTE    ] MTRN: Fetching primary data for 2025-05.
[2025-10-24T20:01:52.838857] [INFO ] [REMOTE    ] MTG: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T20:01:52.896524] [INFO ] [REMOTE    ] MTRN: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T20:01:52.947625] [INFO ] [REMOTE    ] MTRN: Fetching primary data for 2025-06.
[2025-10-24T20:01:53.747683] [INFO ] [REMOTE    ] MTR: Fetching primary data for 2025-04.
[2025-10-24T20:01:53.999360] [INFO ] [REMOTE    ] MTRN: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T20:01:54.117083] [INFO ] [REMOTE    ] MTR: Incremental fetch complete for 2025-04 (0.37 seconds).
[2025-10-24T20:01:54.547741] [INFO ] [REMOTE    ] MTG: Fetching primary data for 2025-10.
[2025-10-24T20:01:55.347710] [INFO ] [REMOTE    ] MTR: Fetching primary data for 2025-05.
[2025-10-24T20:01:55.695231] [INFO ] [REMOTE    ] MTR: Incremental fetch complete for 2025-05 (0.35 seconds).
[2025-10-24T20:01:56.147702] [INFO ] [REMOTE    ] MTR: Fetching primary data for 2025-06.
[2025-10-24T20:01:56.305813] [INFO ] [REMOTE    ] MTG: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T20:01:56.315715] [INFO ] [REMOTE    ] MTG: Full fetch complete (74311 records).
[2025-10-24T20:01:56.315877] [DEBUG] [VALIDATOR ] MTG: Validating primary data.
[2025-10-24T20:01:56.734245] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present.
[2025-10-24T20:01:56.734342] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed.
[2025-10-24T20:01:56.735635] [INFO ] [MAIN      ] MTG: Fetched primary data is valid.
[2025-10-24T20:01:56.735728] [DEBUG] [LOCAL     ] MTG: Saving primary data.
[2025-10-24T20:01:56.736405] [FATAL] [LOCAL     ] MTG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:01:56.736523] [FATAL] [MAIN      ] MTG: Failed to save primary data.
[2025-10-24T20:01:56.736567] [WARN ] [MAIN      ] MTG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:01:56.736685] [INFO ] [LOCAL     ] MTG: Starting deletion of primary data.
[2025-10-24T20:01:56.736782] [DEBUG] [LOCAL     ] MTG: No primary data file found to delete.
[2025-10-24T20:01:56.736841] [INFO ] [LOCAL     ] MTG: Starting deletion of derivative data.
[2025-10-24T20:01:56.737051] [DEBUG] [LOCAL     ] MTG: Deleted derivative data file.
[2025-10-24T20:01:56.737504] [INFO ] [MAIN      ] Update Progress: 1416/2366 symbols completed. MTG took 33.6s. Estimated remaining: 2h 2m 2s. Rate: 7.8 symbols/min
[2025-10-24T20:01:56.933166] [INFO ] [MAIN      ] MTUS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:01:56.950041] [INFO ] [REMOTE    ] MTRN: Fetching primary data for 2025-07.
[2025-10-24T20:01:56.963479] [DEBUG] [LOCAL     ] MTUS: Loaded 27624 existing records from primary storage.
[2025-10-24T20:01:56.963778] [INFO ] [MAIN      ] MTUS: Loaded 27624 existing records.
[2025-10-24T20:01:57.146225] [WARN ] [MAIN      ] MTUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:01:57.146490] [INFO ] [MAIN      ] MTUS: Wiping existing primary data before full refresh.
[2025-10-24T20:01:57.146540] [INFO ] [LOCAL     ] MTUS: Starting deletion of primary data.
[2025-10-24T20:01:57.146846] [DEBUG] [LOCAL     ] MTUS: Deleted primary data file.
[2025-10-24T20:01:57.146905] [INFO ] [MAIN      ] MTUS: Starting full primary refresh.
[2025-10-24T20:01:57.260794] [INFO ] [REMOTE    ] MTR: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T20:01:57.521627] [INFO ] [REMOTE    ] MTUS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:01:57.747723] [INFO ] [REMOTE    ] MTUS: Fetching primary data for 2025-01.
[2025-10-24T20:01:58.289836] [INFO ] [REMOTE    ] MTRN: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T20:01:58.547676] [INFO ] [REMOTE    ] MTH: Fetching primary data for 2025-08.
[2025-10-24T20:01:58.855282] [INFO ] [REMOTE    ] MTUS: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T20:01:59.347735] [INFO ] [REMOTE    ] MTR: Fetching primary data for 2025-07.
[2025-10-24T20:01:59.870840] [INFO ] [REMOTE    ] MTR: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T20:02:00.097530] [INFO ] [REMOTE    ] MTH: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T20:02:00.147668] [INFO ] [REMOTE    ] MTH: Fetching primary data for 2025-09.
[2025-10-24T20:02:00.947732] [INFO ] [REMOTE    ] MTRN: Fetching primary data for 2025-08.
[2025-10-24T20:02:01.747684] [INFO ] [REMOTE    ] MTUS: Fetching primary data for 2025-02.
[2025-10-24T20:02:01.915449] [INFO ] [REMOTE    ] MTH: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T20:02:02.019250] [INFO ] [REMOTE    ] MTRN: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T20:02:02.547683] [INFO ] [REMOTE    ] MTRN: Fetching primary data for 2025-09.
[2025-10-24T20:02:03.075758] [INFO ] [REMOTE    ] MTUS: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T20:02:03.347742] [INFO ] [REMOTE    ] MTUS: Fetching primary data for 2025-03.
[2025-10-24T20:02:03.518023] [INFO ] [REMOTE    ] MTRN: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T20:02:04.147699] [INFO ] [REMOTE    ] MTRN: Fetching primary data for 2025-10.
[2025-10-24T20:02:04.602167] [INFO ] [REMOTE    ] MTUS: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T20:02:04.947726] [INFO ] [REMOTE    ] MTUS: Fetching primary data for 2025-04.
[2025-10-24T20:02:05.458697] [INFO ] [REMOTE    ] MTRN: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T20:02:05.462054] [INFO ] [REMOTE    ] MTRN: Full fetch complete (24133 records).
[2025-10-24T20:02:05.462127] [DEBUG] [VALIDATOR ] MTRN: Validating primary data.
[2025-10-24T20:02:05.752742] [INFO ] [REMOTE    ] MTH: Fetching primary data for 2025-10.
[2025-10-24T20:02:05.839075] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present.
[2025-10-24T20:02:05.839152] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed.
[2025-10-24T20:02:05.839634] [INFO ] [MAIN      ] MTRN: Fetched primary data is valid.
[2025-10-24T20:02:05.839719] [DEBUG] [LOCAL     ] MTRN: Saving primary data.
[2025-10-24T20:02:05.840013] [FATAL] [LOCAL     ] MTRN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:02:05.840091] [FATAL] [MAIN      ] MTRN: Failed to save primary data.
[2025-10-24T20:02:05.840153] [WARN ] [MAIN      ] MTRN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:02:05.840220] [INFO ] [LOCAL     ] MTRN: Starting deletion of primary data.
[2025-10-24T20:02:05.840275] [DEBUG] [LOCAL     ] MTRN: No primary data file found to delete.
[2025-10-24T20:02:05.840309] [INFO ] [LOCAL     ] MTRN: Starting deletion of derivative data.
[2025-10-24T20:02:05.840445] [DEBUG] [LOCAL     ] MTRN: Deleted derivative data file.
[2025-10-24T20:02:05.840531] [INFO ] [MAIN      ] Update Progress: 1417/2366 symbols completed. MTRN took 24.8s. Estimated remaining: 2h 1m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:02:06.017758] [INFO ] [MAIN      ] MTW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:02:06.045320] [DEBUG] [LOCAL     ] MTW: Loaded 26615 existing records from primary storage.
[2025-10-24T20:02:06.045572] [INFO ] [MAIN      ] MTW: Loaded 26615 existing records.
[2025-10-24T20:02:06.232282] [WARN ] [MAIN      ] MTW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:02:06.232595] [INFO ] [MAIN      ] MTW: Wiping existing primary data before full refresh.
[2025-10-24T20:02:06.232751] [INFO ] [LOCAL     ] MTW: Starting deletion of primary data.
[2025-10-24T20:02:06.233055] [DEBUG] [LOCAL     ] MTW: Deleted primary data file.
[2025-10-24T20:02:06.233219] [INFO ] [MAIN      ] MTW: Starting full primary refresh.
[2025-10-24T20:02:06.368511] [INFO ] [REMOTE    ] MTUS: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T20:02:06.551728] [INFO ] [REMOTE    ] MTR: Fetching primary data for 2025-08.
[2025-10-24T20:02:06.629720] [INFO ] [REMOTE    ] MTW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:02:06.950496] [INFO ] [REMOTE    ] MTR: Incremental fetch complete for 2025-08 (0.40 seconds).
[2025-10-24T20:02:07.347695] [INFO ] [REMOTE    ] MTUS: Fetching primary data for 2025-05.
[2025-10-24T20:02:07.552286] [INFO ] [REMOTE    ] MTH: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T20:02:07.560313] [INFO ] [REMOTE    ] MTH: Full fetch complete (64115 records).
[2025-10-24T20:02:07.560425] [DEBUG] [VALIDATOR ] MTH: Validating primary data.
[2025-10-24T20:02:07.937129] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present.
[2025-10-24T20:02:07.937280] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed.
[2025-10-24T20:02:07.938315] [INFO ] [MAIN      ] MTH: Fetched primary data is valid.
[2025-10-24T20:02:07.938377] [DEBUG] [LOCAL     ] MTH: Saving primary data.
[2025-10-24T20:02:07.938911] [FATAL] [LOCAL     ] MTH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:02:07.938989] [FATAL] [MAIN      ] MTH: Failed to save primary data.
[2025-10-24T20:02:07.939067] [WARN ] [MAIN      ] MTH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:02:07.939135] [INFO ] [LOCAL     ] MTH: Starting deletion of primary data.
[2025-10-24T20:02:07.939194] [DEBUG] [LOCAL     ] MTH: No primary data file found to delete.
[2025-10-24T20:02:07.939229] [INFO ] [LOCAL     ] MTH: Starting deletion of derivative data.
[2025-10-24T20:02:07.939348] [DEBUG] [LOCAL     ] MTH: Deleted derivative data file.
[2025-10-24T20:02:07.939671] [INFO ] [MAIN      ] Update Progress: 1418/2366 symbols completed. MTH took 37.6s. Estimated remaining: 2h 1m 44s. Rate: 7.8 symbols/min
[2025-10-24T20:02:08.105702] [INFO ] [MAIN      ] MTX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:02:08.128308] [DEBUG] [LOCAL     ] MTX: Loaded 22713 existing records from primary storage.
[2025-10-24T20:02:08.128552] [INFO ] [MAIN      ] MTX: Loaded 22713 existing records.
[2025-10-24T20:02:08.158752] [INFO ] [REMOTE    ] MTW: Fetching primary data for 2025-01.
[2025-10-24T20:02:08.305898] [WARN ] [MAIN      ] MTX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:02:08.306120] [INFO ] [MAIN      ] MTX: Wiping existing primary data before full refresh.
[2025-10-24T20:02:08.306165] [INFO ] [LOCAL     ] MTX: Starting deletion of primary data.
[2025-10-24T20:02:08.306406] [DEBUG] [LOCAL     ] MTX: Deleted primary data file.
[2025-10-24T20:02:08.306445] [INFO ] [MAIN      ] MTX: Starting full primary refresh.
[2025-10-24T20:02:08.661187] [INFO ] [REMOTE    ] MTX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:02:08.704152] [INFO ] [REMOTE    ] MTUS: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T20:02:08.947628] [INFO ] [REMOTE    ] MTX: Fetching primary data for 2025-01.
[2025-10-24T20:02:09.455384] [INFO ] [REMOTE    ] MTW: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T20:02:09.747732] [INFO ] [REMOTE    ] MTUS: Fetching primary data for 2025-06.
[2025-10-24T20:02:09.924321] [INFO ] [REMOTE    ] MTX: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T20:02:10.547720] [INFO ] [REMOTE    ] MTR: Fetching primary data for 2025-09.
[2025-10-24T20:02:10.810328] [INFO ] [REMOTE    ] MTR: Incremental fetch complete for 2025-09 (0.26 seconds).
[2025-10-24T20:02:11.105898] [INFO ] [REMOTE    ] MTUS: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T20:02:11.347739] [INFO ] [REMOTE    ] MTR: Fetching primary data for 2025-10.
[2025-10-24T20:02:11.935870] [INFO ] [REMOTE    ] MTR: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T20:02:11.937403] [INFO ] [REMOTE    ] MTR: Full fetch complete (2417 records).
[2025-10-24T20:02:11.937544] [DEBUG] [VALIDATOR ] MTR: Validating primary data.
[2025-10-24T20:02:12.150067] [INFO ] [REMOTE    ] MTW: Fetching primary data for 2025-02.
[2025-10-24T20:02:12.155290] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T20:02:12.157115] [FATAL] [MAIN      ] MTR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:02:12.157384] [WARN ] [MAIN      ] MTR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:02:12.157485] [INFO ] [LOCAL     ] MTR: Starting deletion of primary data.
[2025-10-24T20:02:12.157558] [DEBUG] [LOCAL     ] MTR: No primary data file found to delete.
[2025-10-24T20:02:12.157601] [INFO ] [LOCAL     ] MTR: Starting deletion of derivative data.
[2025-10-24T20:02:12.157664] [DEBUG] [LOCAL     ] MTR: No derivative data file found to delete.
[2025-10-24T20:02:12.157774] [INFO ] [MAIN      ] Update Progress: 1419/2366 symbols completed. MTR took 32.6s. Estimated remaining: 2h 1m 34s. Rate: 7.8 symbols/min
[2025-10-24T20:02:12.353399] [INFO ] [MAIN      ] MTZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:02:12.398304] [DEBUG] [LOCAL     ] MTZ: Loaded 43006 existing records from primary storage.
[2025-10-24T20:02:12.398721] [INFO ] [MAIN      ] MTZ: Loaded 43006 existing records.
[2025-10-24T20:02:12.596321] [WARN ] [MAIN      ] MTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:02:12.596554] [INFO ] [MAIN      ] MTZ: Wiping existing primary data before full refresh.
[2025-10-24T20:02:12.596623] [INFO ] [LOCAL     ] MTZ: Starting deletion of primary data.
[2025-10-24T20:02:12.597362] [DEBUG] [LOCAL     ] MTZ: Deleted primary data file.
[2025-10-24T20:02:12.597428] [INFO ] [MAIN      ] MTZ: Starting full primary refresh.
[2025-10-24T20:02:12.947937] [INFO ] [REMOTE    ] MTZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:02:12.948044] [INFO ] [REMOTE    ] MTUS: Fetching primary data for 2025-07.
[2025-10-24T20:02:13.380310] [INFO ] [REMOTE    ] MTW: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T20:02:13.747703] [INFO ] [REMOTE    ] MTZ: Fetching primary data for 2025-01.
[2025-10-24T20:02:13.844124] [INFO ] [REMOTE    ] MTUS: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T20:02:14.547722] [INFO ] [REMOTE    ] MTW: Fetching primary data for 2025-03.
[2025-10-24T20:02:15.099979] [INFO ] [REMOTE    ] MTZ: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T20:02:15.347719] [INFO ] [REMOTE    ] MTZ: Fetching primary data for 2025-02.
[2025-10-24T20:02:15.776960] [INFO ] [REMOTE    ] MTW: Incremental fetch complete for 2025-03 (1.23 seconds).
[2025-10-24T20:02:16.147632] [INFO ] [REMOTE    ] MTX: Fetching primary data for 2025-02.
[2025-10-24T20:02:16.749273] [INFO ] [REMOTE    ] MTZ: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T20:02:16.947614] [INFO ] [REMOTE    ] MTZ: Fetching primary data for 2025-03.
[2025-10-24T20:02:17.296826] [INFO ] [REMOTE    ] MTX: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T20:02:17.747696] [INFO ] [REMOTE    ] MTUS: Fetching primary data for 2025-08.
[2025-10-24T20:02:18.547624] [INFO ] [REMOTE    ] MTW: Fetching primary data for 2025-04.
[2025-10-24T20:02:18.641152] [INFO ] [REMOTE    ] MTZ: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T20:02:18.951937] [INFO ] [REMOTE    ] MTUS: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T20:02:19.347674] [INFO ] [REMOTE    ] MTUS: Fetching primary data for 2025-09.
[2025-10-24T20:02:19.369736] [INFO ] [REMOTE    ] MTW: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T20:02:20.147770] [INFO ] [REMOTE    ] MTZ: Fetching primary data for 2025-04.
[2025-10-24T20:02:20.438934] [INFO ] [REMOTE    ] MTUS: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T20:02:20.947711] [INFO ] [REMOTE    ] MTUS: Fetching primary data for 2025-10.
[2025-10-24T20:02:21.752834] [INFO ] [REMOTE    ] MTX: Fetching primary data for 2025-03.
[2025-10-24T20:02:21.769698] [INFO ] [REMOTE    ] MTZ: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T20:02:22.044635] [INFO ] [REMOTE    ] MTUS: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T20:02:22.049332] [INFO ] [REMOTE    ] MTUS: Full fetch complete (41020 records).
[2025-10-24T20:02:22.049411] [DEBUG] [VALIDATOR ] MTUS: Validating primary data.
[2025-10-24T20:02:22.423300] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present.
[2025-10-24T20:02:22.423375] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed.
[2025-10-24T20:02:22.424162] [INFO ] [MAIN      ] MTUS: Fetched primary data is valid.
[2025-10-24T20:02:22.424223] [DEBUG] [LOCAL     ] MTUS: Saving primary data.
[2025-10-24T20:02:22.424576] [FATAL] [LOCAL     ] MTUS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:02:22.424677] [FATAL] [MAIN      ] MTUS: Failed to save primary data.
[2025-10-24T20:02:22.424748] [WARN ] [MAIN      ] MTUS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:02:22.424809] [INFO ] [LOCAL     ] MTUS: Starting deletion of primary data.
[2025-10-24T20:02:22.424881] [DEBUG] [LOCAL     ] MTUS: No primary data file found to delete.
[2025-10-24T20:02:22.424932] [INFO ] [LOCAL     ] MTUS: Starting deletion of derivative data.
[2025-10-24T20:02:22.425113] [DEBUG] [LOCAL     ] MTUS: Deleted derivative data file.
[2025-10-24T20:02:22.425199] [INFO ] [MAIN      ] Update Progress: 1420/2366 symbols completed. MTUS took 25.7s. Estimated remaining: 2h 1m 28s. Rate: 7.8 symbols/min
[2025-10-24T20:02:22.552868] [INFO ] [REMOTE    ] MTZ: Fetching primary data for 2025-05.
[2025-10-24T20:02:22.599574] [INFO ] [MAIN      ] MUA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:02:22.614150] [DEBUG] [LOCAL     ] MUA: Loaded 11632 existing records from primary storage.
[2025-10-24T20:02:22.614390] [INFO ] [MAIN      ] MUA: Loaded 11632 existing records.
[2025-10-24T20:02:22.796775] [WARN ] [MAIN      ] MUA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:02:22.796960] [INFO ] [MAIN      ] MUA: Wiping existing primary data before full refresh.
[2025-10-24T20:02:22.797008] [INFO ] [LOCAL     ] MUA: Starting deletion of primary data.
[2025-10-24T20:02:22.797189] [DEBUG] [LOCAL     ] MUA: Deleted primary data file.
[2025-10-24T20:02:22.797244] [INFO ] [MAIN      ] MUA: Starting full primary refresh.
[2025-10-24T20:02:22.921699] [INFO ] [REMOTE    ] MTX: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T20:02:23.169886] [INFO ] [REMOTE    ] MUA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:02:23.347615] [INFO ] [REMOTE    ] MUA: Fetching primary data for 2025-01.
[2025-10-24T20:02:24.147722] [INFO ] [REMOTE    ] MTW: Fetching primary data for 2025-05.
[2025-10-24T20:02:24.352743] [INFO ] [REMOTE    ] MUA: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T20:02:24.354174] [INFO ] [REMOTE    ] MTZ: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T20:02:24.947685] [INFO ] [REMOTE    ] MTZ: Fetching primary data for 2025-06.
[2025-10-24T20:02:25.397316] [INFO ] [REMOTE    ] MTW: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T20:02:25.747677] [INFO ] [REMOTE    ] MTW: Fetching primary data for 2025-06.
[2025-10-24T20:02:26.383537] [INFO ] [REMOTE    ] MTZ: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T20:02:26.528396] [INFO ] [REMOTE    ] MTW: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T20:02:26.547597] [INFO ] [REMOTE    ] MTW: Fetching primary data for 2025-07.
[2025-10-24T20:02:27.347689] [INFO ] [REMOTE    ] MUA: Fetching primary data for 2025-02.
[2025-10-24T20:02:27.821531] [INFO ] [REMOTE    ] MTW: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T20:02:28.147620] [INFO ] [REMOTE    ] MTX: Fetching primary data for 2025-04.
[2025-10-24T20:02:28.192751] [INFO ] [REMOTE    ] MUA: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T20:02:28.947669] [INFO ] [REMOTE    ] MTZ: Fetching primary data for 2025-07.
[2025-10-24T20:02:29.348893] [INFO ] [REMOTE    ] MTX: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T20:02:29.747688] [INFO ] [REMOTE    ] MTX: Fetching primary data for 2025-05.
[2025-10-24T20:02:30.390247] [INFO ] [REMOTE    ] MTZ: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T20:02:30.547714] [INFO ] [REMOTE    ] MUA: Fetching primary data for 2025-03.
[2025-10-24T20:02:30.812235] [INFO ] [REMOTE    ] MTX: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T20:02:31.347691] [INFO ] [REMOTE    ] MTW: Fetching primary data for 2025-08.
[2025-10-24T20:02:31.563986] [INFO ] [REMOTE    ] MUA: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T20:02:32.147713] [INFO ] [REMOTE    ] MUA: Fetching primary data for 2025-04.
[2025-10-24T20:02:32.599820] [INFO ] [REMOTE    ] MTW: Incremental fetch complete for 2025-08 (1.25 seconds).
[2025-10-24T20:02:32.947637] [INFO ] [REMOTE    ] MTZ: Fetching primary data for 2025-08.
[2025-10-24T20:02:32.963763] [INFO ] [REMOTE    ] MUA: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T20:02:33.747675] [INFO ] [REMOTE    ] MUA: Fetching primary data for 2025-05.
[2025-10-24T20:02:34.541848] [INFO ] [REMOTE    ] MUA: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T20:02:34.547591] [INFO ] [REMOTE    ] MUA: Fetching primary data for 2025-06.
[2025-10-24T20:02:34.607952] [INFO ] [REMOTE    ] MTZ: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T20:02:35.347704] [INFO ] [REMOTE    ] MTW: Fetching primary data for 2025-09.
[2025-10-24T20:02:35.552959] [INFO ] [REMOTE    ] MUA: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T20:02:36.147612] [INFO ] [REMOTE    ] MTZ: Fetching primary data for 2025-09.
[2025-10-24T20:02:36.474485] [INFO ] [REMOTE    ] MTW: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T20:02:36.947617] [INFO ] [REMOTE    ] MTX: Fetching primary data for 2025-06.
[2025-10-24T20:02:37.686449] [INFO ] [REMOTE    ] MTZ: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T20:02:37.747603] [INFO ] [REMOTE    ] MTZ: Fetching primary data for 2025-10.
[2025-10-24T20:02:38.129087] [INFO ] [REMOTE    ] MTX: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T20:02:38.547721] [INFO ] [REMOTE    ] MUA: Fetching primary data for 2025-07.
[2025-10-24T20:02:39.349778] [INFO ] [REMOTE    ] MTX: Fetching primary data for 2025-07.
[2025-10-24T20:02:39.352574] [INFO ] [REMOTE    ] MTZ: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T20:02:39.367882] [INFO ] [REMOTE    ] MUA: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T20:02:39.367565] [INFO ] [REMOTE    ] MTZ: Full fetch complete (63607 records).
[2025-10-24T20:02:39.371114] [DEBUG] [VALIDATOR ] MTZ: Validating primary data.
[2025-10-24T20:02:39.786403] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present.
[2025-10-24T20:02:39.786478] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed.
[2025-10-24T20:02:39.787583] [INFO ] [MAIN      ] MTZ: Fetched primary data is valid.
[2025-10-24T20:02:39.787673] [DEBUG] [LOCAL     ] MTZ: Saving primary data.
[2025-10-24T20:02:39.788160] [FATAL] [LOCAL     ] MTZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:02:39.788245] [FATAL] [MAIN      ] MTZ: Failed to save primary data.
[2025-10-24T20:02:39.788288] [WARN ] [MAIN      ] MTZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:02:39.788361] [INFO ] [LOCAL     ] MTZ: Starting deletion of primary data.
[2025-10-24T20:02:39.788422] [DEBUG] [LOCAL     ] MTZ: No primary data file found to delete.
[2025-10-24T20:02:39.788459] [INFO ] [LOCAL     ] MTZ: Starting deletion of derivative data.
[2025-10-24T20:02:39.788597] [DEBUG] [LOCAL     ] MTZ: Deleted derivative data file.
[2025-10-24T20:02:39.788726] [INFO ] [MAIN      ] Update Progress: 1421/2366 symbols completed. MTZ took 27.6s. Estimated remaining: 2h 1m 27s. Rate: 7.8 symbols/min
[2025-10-24T20:02:39.960335] [INFO ] [MAIN      ] MUC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:02:39.980863] [DEBUG] [LOCAL     ] MUC: Loaded 20783 existing records from primary storage.
[2025-10-24T20:02:39.981098] [INFO ] [MAIN      ] MUC: Loaded 20783 existing records.
[2025-10-24T20:02:40.149321] [INFO ] [REMOTE    ] MTW: Fetching primary data for 2025-10.
[2025-10-24T20:02:40.162280] [WARN ] [MAIN      ] MUC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:02:40.163263] [INFO ] [MAIN      ] MUC: Wiping existing primary data before full refresh.
[2025-10-24T20:02:40.163356] [INFO ] [LOCAL     ] MUC: Starting deletion of primary data.
[2025-10-24T20:02:40.163637] [DEBUG] [LOCAL     ] MUC: Deleted primary data file.
[2025-10-24T20:02:40.163725] [INFO ] [MAIN      ] MUC: Starting full primary refresh.
[2025-10-24T20:02:40.520407] [INFO ] [REMOTE    ] MUC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:02:40.593121] [INFO ] [REMOTE    ] MTX: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T20:02:40.947739] [INFO ] [REMOTE    ] MUA: Fetching primary data for 2025-08.
[2025-10-24T20:02:41.532562] [INFO ] [REMOTE    ] MTW: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T20:02:41.537333] [INFO ] [REMOTE    ] MTW: Full fetch complete (38209 records).
[2025-10-24T20:02:41.537432] [DEBUG] [VALIDATOR ] MTW: Validating primary data.
[2025-10-24T20:02:41.752788] [INFO ] [REMOTE    ] MTX: Fetching primary data for 2025-08.
[2025-10-24T20:02:41.851996] [INFO ] [REMOTE    ] MUA: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T20:02:41.937614] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present.
[2025-10-24T20:02:41.937718] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed.
[2025-10-24T20:02:41.938470] [INFO ] [MAIN      ] MTW: Fetched primary data is valid.
[2025-10-24T20:02:41.938511] [DEBUG] [LOCAL     ] MTW: Saving primary data.
[2025-10-24T20:02:41.938885] [FATAL] [LOCAL     ] MTW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:02:41.938967] [FATAL] [MAIN      ] MTW: Failed to save primary data.
[2025-10-24T20:02:41.939010] [WARN ] [MAIN      ] MTW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:02:41.939075] [INFO ] [LOCAL     ] MTW: Starting deletion of primary data.
[2025-10-24T20:02:41.939151] [DEBUG] [LOCAL     ] MTW: No primary data file found to delete.
[2025-10-24T20:02:41.939200] [INFO ] [LOCAL     ] MTW: Starting deletion of derivative data.
[2025-10-24T20:02:41.939344] [DEBUG] [LOCAL     ] MTW: Deleted derivative data file.
[2025-10-24T20:02:41.939440] [INFO ] [MAIN      ] Update Progress: 1422/2366 symbols completed. MTW took 36.1s. Estimated remaining: 2h 1m 15s. Rate: 7.8 symbols/min
[2025-10-24T20:02:42.115147] [INFO ] [MAIN      ] MUE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:02:42.129459] [DEBUG] [LOCAL     ] MUE: Loaded 12258 existing records from primary storage.
[2025-10-24T20:02:42.129714] [INFO ] [MAIN      ] MUE: Loaded 12258 existing records.
[2025-10-24T20:02:42.301703] [WARN ] [MAIN      ] MUE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:02:42.301893] [INFO ] [MAIN      ] MUE: Wiping existing primary data before full refresh.
[2025-10-24T20:02:42.301938] [INFO ] [LOCAL     ] MUE: Starting deletion of primary data.
[2025-10-24T20:02:42.302106] [DEBUG] [LOCAL     ] MUE: Deleted primary data file.
[2025-10-24T20:02:42.302142] [INFO ] [MAIN      ] MUE: Starting full primary refresh.
[2025-10-24T20:02:42.552751] [INFO ] [REMOTE    ] MUC: Fetching primary data for 2025-01.
[2025-10-24T20:02:42.668375] [INFO ] [REMOTE    ] MUE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:02:42.873852] [INFO ] [REMOTE    ] MTX: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T20:02:43.347624] [INFO ] [REMOTE    ] MTX: Fetching primary data for 2025-09.
[2025-10-24T20:02:43.636317] [INFO ] [REMOTE    ] MUC: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T20:02:44.147688] [INFO ] [REMOTE    ] MUA: Fetching primary data for 2025-09.
[2025-10-24T20:02:44.350405] [INFO ] [REMOTE    ] MTX: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T20:02:44.810816] [INFO ] [REMOTE    ] MUA: Incremental fetch complete for 2025-09 (0.66 seconds).
[2025-10-24T20:02:44.947689] [INFO ] [REMOTE    ] MTX: Fetching primary data for 2025-10.
[2025-10-24T20:02:45.747693] [INFO ] [REMOTE    ] MUA: Fetching primary data for 2025-10.
[2025-10-24T20:02:46.027886] [INFO ] [REMOTE    ] MTX: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T20:02:46.031407] [INFO ] [REMOTE    ] MTX: Full fetch complete (31404 records).
[2025-10-24T20:02:46.031488] [DEBUG] [VALIDATOR ] MTX: Validating primary data.
[2025-10-24T20:02:46.400145] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present.
[2025-10-24T20:02:46.400248] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed.
[2025-10-24T20:02:46.401000] [INFO ] [MAIN      ] MTX: Fetched primary data is valid.
[2025-10-24T20:02:46.401063] [DEBUG] [LOCAL     ] MTX: Saving primary data.
[2025-10-24T20:02:46.401417] [FATAL] [LOCAL     ] MTX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:02:46.401533] [FATAL] [MAIN      ] MTX: Failed to save primary data.
[2025-10-24T20:02:46.401575] [WARN ] [MAIN      ] MTX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:02:46.401610] [INFO ] [LOCAL     ] MTX: Starting deletion of primary data.
[2025-10-24T20:02:46.401683] [DEBUG] [LOCAL     ] MTX: No primary data file found to delete.
[2025-10-24T20:02:46.401738] [INFO ] [LOCAL     ] MTX: Starting deletion of derivative data.
[2025-10-24T20:02:46.402021] [DEBUG] [LOCAL     ] MTX: Deleted derivative data file.
[2025-10-24T20:02:46.402113] [INFO ] [MAIN      ] Update Progress: 1423/2366 symbols completed. MTX took 38.5s. Estimated remaining: 2h 1m 5s. Rate: 7.8 symbols/min
[2025-10-24T20:02:46.554712] [INFO ] [REMOTE    ] MUE: Fetching primary data for 2025-01.
[2025-10-24T20:02:46.574097] [INFO ] [MAIN      ] MUFG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:02:46.630840] [DEBUG] [LOCAL     ] MUFG: Loaded 52806 existing records from primary storage.
[2025-10-24T20:02:46.631190] [INFO ] [MAIN      ] MUFG: Loaded 52806 existing records.
[2025-10-24T20:02:46.833012] [WARN ] [MAIN      ] MUFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:02:46.833294] [INFO ] [MAIN      ] MUFG: Wiping existing primary data before full refresh.
[2025-10-24T20:02:46.841103] [INFO ] [LOCAL     ] MUFG: Starting deletion of primary data.
[2025-10-24T20:02:46.842358] [DEBUG] [LOCAL     ] MUFG: Deleted primary data file.
[2025-10-24T20:02:46.842266] [INFO ] [REMOTE    ] MUA: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T20:02:46.842611] [INFO ] [MAIN      ] MUFG: Starting full primary refresh.
[2025-10-24T20:02:46.883479] [INFO ] [REMOTE    ] MUA: Full fetch complete (18226 records).
[2025-10-24T20:02:46.910006] [DEBUG] [VALIDATOR ] MUA: Validating primary data.
[2025-10-24T20:02:47.358013] [INFO ] [REMOTE    ] MUC: Fetching primary data for 2025-02.
[2025-10-24T20:02:47.419336] [INFO ] [REMOTE    ] MUE: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T20:02:47.587063] [INFO ] [REMOTE    ] MUFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:02:47.698904] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present.
[2025-10-24T20:02:47.699012] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed.
[2025-10-24T20:02:47.699784] [INFO ] [MAIN      ] MUA: Fetched primary data is valid.
[2025-10-24T20:02:47.699851] [DEBUG] [LOCAL     ] MUA: Saving primary data.
[2025-10-24T20:02:47.700190] [FATAL] [LOCAL     ] MUA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:02:47.700280] [FATAL] [MAIN      ] MUA: Failed to save primary data.
[2025-10-24T20:02:47.700324] [WARN ] [MAIN      ] MUA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:02:47.700394] [INFO ] [LOCAL     ] MUA: Starting deletion of primary data.
[2025-10-24T20:02:47.700457] [DEBUG] [LOCAL     ] MUA: No primary data file found to delete.
[2025-10-24T20:02:47.700563] [INFO ] [LOCAL     ] MUA: Starting deletion of derivative data.
[2025-10-24T20:02:47.700761] [DEBUG] [LOCAL     ] MUA: Deleted derivative data file.
[2025-10-24T20:02:47.700867] [INFO ] [MAIN      ] Update Progress: 1424/2366 symbols completed. MUA took 25.3s. Estimated remaining: 2h 0m 53s. Rate: 7.8 symbols/min
[2025-10-24T20:02:47.877559] [INFO ] [MAIN      ] MUJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:02:47.898469] [DEBUG] [LOCAL     ] MUJ: Loaded 13954 existing records from primary storage.
[2025-10-24T20:02:47.898841] [INFO ] [MAIN      ] MUJ: Loaded 13954 existing records.
[2025-10-24T20:02:48.101971] [WARN ] [MAIN      ] MUJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:02:48.102275] [INFO ] [MAIN      ] MUJ: Wiping existing primary data before full refresh.
[2025-10-24T20:02:48.102326] [INFO ] [LOCAL     ] MUJ: Starting deletion of primary data.
[2025-10-24T20:02:48.102604] [DEBUG] [LOCAL     ] MUJ: Deleted primary data file.
[2025-10-24T20:02:48.102705] [INFO ] [MAIN      ] MUJ: Starting full primary refresh.
[2025-10-24T20:02:48.152779] [INFO ] [REMOTE    ] MUE: Fetching primary data for 2025-02.
[2025-10-24T20:02:48.427913] [INFO ] [REMOTE    ] MUC: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T20:02:48.515719] [INFO ] [REMOTE    ] MUJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:02:48.845593] [INFO ] [REMOTE    ] MUE: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T20:02:48.947675] [INFO ] [REMOTE    ] MUC: Fetching primary data for 2025-03.
[2025-10-24T20:02:49.747684] [INFO ] [REMOTE    ] MUE: Fetching primary data for 2025-03.
[2025-10-24T20:02:50.029624] [INFO ] [REMOTE    ] MUC: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T20:02:50.507145] [INFO ] [REMOTE    ] MUE: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T20:02:50.547701] [INFO ] [REMOTE    ] MUE: Fetching primary data for 2025-04.
[2025-10-24T20:02:51.327774] [INFO ] [REMOTE    ] MUE: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:02:51.347603] [INFO ] [REMOTE    ] MUE: Fetching primary data for 2025-05.
[2025-10-24T20:02:52.123008] [INFO ] [REMOTE    ] MUE: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T20:02:52.147600] [INFO ] [REMOTE    ] MUE: Fetching primary data for 2025-06.
[2025-10-24T20:02:52.947726] [INFO ] [REMOTE    ] MUC: Fetching primary data for 2025-04.
[2025-10-24T20:02:53.041942] [INFO ] [REMOTE    ] MUE: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T20:02:53.747673] [INFO ] [REMOTE    ] MUFG: Fetching primary data for 2025-01.
[2025-10-24T20:02:53.979333] [INFO ] [REMOTE    ] MUC: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T20:02:54.547723] [INFO ] [REMOTE    ] MUJ: Fetching primary data for 2025-01.
[2025-10-24T20:02:55.347752] [INFO ] [REMOTE    ] MUE: Fetching primary data for 2025-07.
[2025-10-24T20:02:55.404497] [INFO ] [REMOTE    ] MUFG: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T20:02:55.669716] [INFO ] [REMOTE    ] MUJ: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T20:02:56.151319] [INFO ] [REMOTE    ] MUJ: Fetching primary data for 2025-02.
[2025-10-24T20:02:56.152711] [INFO ] [REMOTE    ] MUE: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T20:02:56.947717] [INFO ] [REMOTE    ] MUFG: Fetching primary data for 2025-02.
[2025-10-24T20:02:56.960346] [INFO ] [REMOTE    ] MUJ: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T20:02:57.747730] [INFO ] [REMOTE    ] MUC: Fetching primary data for 2025-05.
[2025-10-24T20:02:58.547727] [INFO ] [REMOTE    ] MUE: Fetching primary data for 2025-08.
[2025-10-24T20:02:58.686695] [INFO ] [REMOTE    ] MUC: Incremental fetch complete for 2025-05 (0.94 seconds).
[2025-10-24T20:02:58.741281] [INFO ] [REMOTE    ] MUFG: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T20:02:59.181075] [INFO ] [REMOTE    ] MUE: Incremental fetch complete for 2025-08 (0.63 seconds).
[2025-10-24T20:02:59.347735] [INFO ] [REMOTE    ] MUFG: Fetching primary data for 2025-03.
[2025-10-24T20:03:00.147721] [INFO ] [REMOTE    ] MUE: Fetching primary data for 2025-09.
[2025-10-24T20:03:00.947739] [INFO ] [REMOTE    ] MUC: Fetching primary data for 2025-06.
[2025-10-24T20:03:01.141405] [INFO ] [REMOTE    ] MUE: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T20:03:01.643184] [INFO ] [REMOTE    ] MUFG: Incremental fetch complete for 2025-03 (2.30 seconds).
[2025-10-24T20:03:01.747704] [INFO ] [REMOTE    ] MUJ: Fetching primary data for 2025-03.
[2025-10-24T20:03:01.933972] [INFO ] [REMOTE    ] MUC: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T20:03:02.547723] [INFO ] [REMOTE    ] MUFG: Fetching primary data for 2025-04.
[2025-10-24T20:03:02.579703] [INFO ] [REMOTE    ] MUJ: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T20:03:03.347732] [INFO ] [REMOTE    ] MUE: Fetching primary data for 2025-10.
[2025-10-24T20:03:04.147633] [INFO ] [REMOTE    ] MUC: Fetching primary data for 2025-07.
[2025-10-24T20:03:04.216584] [INFO ] [REMOTE    ] MUE: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T20:03:04.219832] [INFO ] [REMOTE    ] MUE: Full fetch complete (15948 records).
[2025-10-24T20:03:04.219922] [DEBUG] [VALIDATOR ] MUE: Validating primary data.
[2025-10-24T20:03:04.592692] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present.
[2025-10-24T20:03:04.592794] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed.
[2025-10-24T20:03:04.593190] [INFO ] [MAIN      ] MUE: Fetched primary data is valid.
[2025-10-24T20:03:04.593234] [DEBUG] [LOCAL     ] MUE: Saving primary data.
[2025-10-24T20:03:04.593487] [FATAL] [LOCAL     ] MUE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:03:04.593567] [FATAL] [MAIN      ] MUE: Failed to save primary data.
[2025-10-24T20:03:04.593611] [WARN ] [MAIN      ] MUE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:03:04.593672] [INFO ] [LOCAL     ] MUE: Starting deletion of primary data.
[2025-10-24T20:03:04.593745] [DEBUG] [LOCAL     ] MUE: No primary data file found to delete.
[2025-10-24T20:03:04.593783] [INFO ] [LOCAL     ] MUE: Starting deletion of derivative data.
[2025-10-24T20:03:04.593904] [DEBUG] [LOCAL     ] MUE: Deleted derivative data file.
[2025-10-24T20:03:04.593978] [INFO ] [MAIN      ] Update Progress: 1425/2366 symbols completed. MUE took 22.7s. Estimated remaining: 2h 0m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:03:04.771619] [INFO ] [REMOTE    ] MUFG: Incremental fetch complete for 2025-04 (2.22 seconds).
[2025-10-24T20:03:04.807718] [INFO ] [MAIN      ] MUR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:03:04.859071] [DEBUG] [LOCAL     ] MUR: Loaded 53250 existing records from primary storage.
[2025-10-24T20:03:04.859381] [INFO ] [MAIN      ] MUR: Loaded 53250 existing records.
[2025-10-24T20:03:04.952820] [INFO ] [REMOTE    ] MUJ: Fetching primary data for 2025-04.
[2025-10-24T20:03:05.057683] [WARN ] [MAIN      ] MUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:03:05.057878] [INFO ] [MAIN      ] MUR: Wiping existing primary data before full refresh.
[2025-10-24T20:03:05.057925] [INFO ] [LOCAL     ] MUR: Starting deletion of primary data.
[2025-10-24T20:03:05.058379] [DEBUG] [LOCAL     ] MUR: Deleted primary data file.
[2025-10-24T20:03:05.058418] [INFO ] [MAIN      ] MUR: Starting full primary refresh.
[2025-10-24T20:03:05.447030] [INFO ] [REMOTE    ] MUR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:03:05.463918] [INFO ] [REMOTE    ] MUC: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T20:03:05.747701] [INFO ] [REMOTE    ] MUC: Fetching primary data for 2025-08.
[2025-10-24T20:03:05.880812] [INFO ] [REMOTE    ] MUJ: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T20:03:06.547692] [INFO ] [REMOTE    ] MUR: Fetching primary data for 2025-01.
[2025-10-24T20:03:06.726978] [INFO ] [REMOTE    ] MUC: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T20:03:07.347692] [INFO ] [REMOTE    ] MUC: Fetching primary data for 2025-09.
[2025-10-24T20:03:08.085243] [INFO ] [REMOTE    ] MUR: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T20:03:08.133838] [INFO ] [REMOTE    ] MUC: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T20:03:08.147603] [INFO ] [REMOTE    ] MUFG: Fetching primary data for 2025-05.
[2025-10-24T20:03:08.947638] [INFO ] [REMOTE    ] MUJ: Fetching primary data for 2025-05.
[2025-10-24T20:03:09.443327] [INFO ] [REMOTE    ] MUJ: Incremental fetch complete for 2025-05 (0.50 seconds).
[2025-10-24T20:03:09.747623] [INFO ] [REMOTE    ] MUC: Fetching primary data for 2025-10.
[2025-10-24T20:03:10.010378] [INFO ] [REMOTE    ] MUFG: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T20:03:10.547628] [INFO ] [REMOTE    ] MUFG: Fetching primary data for 2025-06.
[2025-10-24T20:03:10.926708] [INFO ] [REMOTE    ] MUC: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T20:03:10.931175] [INFO ] [REMOTE    ] MUC: Full fetch complete (29539 records).
[2025-10-24T20:03:10.931322] [DEBUG] [VALIDATOR ] MUC: Validating primary data.
[2025-10-24T20:03:11.292901] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present.
[2025-10-24T20:03:11.292982] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed.
[2025-10-24T20:03:11.293578] [INFO ] [MAIN      ] MUC: Fetched primary data is valid.
[2025-10-24T20:03:11.293618] [DEBUG] [LOCAL     ] MUC: Saving primary data.
[2025-10-24T20:03:11.293973] [FATAL] [LOCAL     ] MUC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:03:11.294061] [FATAL] [MAIN      ] MUC: Failed to save primary data.
[2025-10-24T20:03:11.294127] [WARN ] [MAIN      ] MUC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:03:11.294212] [INFO ] [LOCAL     ] MUC: Starting deletion of primary data.
[2025-10-24T20:03:11.294314] [DEBUG] [LOCAL     ] MUC: No primary data file found to delete.
[2025-10-24T20:03:11.294383] [INFO ] [LOCAL     ] MUC: Starting deletion of derivative data.
[2025-10-24T20:03:11.294841] [DEBUG] [LOCAL     ] MUC: Deleted derivative data file.
[2025-10-24T20:03:11.294937] [INFO ] [MAIN      ] Update Progress: 1426/2366 symbols completed. MUC took 31.5s. Estimated remaining: 2h 0m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:03:11.356789] [INFO ] [REMOTE    ] MUJ: Fetching primary data for 2025-06.
[2025-10-24T20:03:11.465508] [INFO ] [MAIN      ] MUSA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:03:11.490490] [DEBUG] [LOCAL     ] MUSA: Loaded 24766 existing records from primary storage.
[2025-10-24T20:03:11.490793] [INFO ] [MAIN      ] MUSA: Loaded 24766 existing records.
[2025-10-24T20:03:11.664582] [WARN ] [MAIN      ] MUSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:03:11.664826] [INFO ] [MAIN      ] MUSA: Wiping existing primary data before full refresh.
[2025-10-24T20:03:11.664889] [INFO ] [LOCAL     ] MUSA: Starting deletion of primary data.
[2025-10-24T20:03:11.665162] [DEBUG] [LOCAL     ] MUSA: Deleted primary data file.
[2025-10-24T20:03:11.665217] [INFO ] [MAIN      ] MUSA: Starting full primary refresh.
[2025-10-24T20:03:12.025509] [INFO ] [REMOTE    ] MUSA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:03:12.151022] [INFO ] [REMOTE    ] MUSA: Fetching primary data for 2025-01.
[2025-10-24T20:03:12.156621] [INFO ] [REMOTE    ] MUFG: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T20:03:12.355513] [INFO ] [REMOTE    ] MUJ: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T20:03:12.952782] [INFO ] [REMOTE    ] MUFG: Fetching primary data for 2025-07.
[2025-10-24T20:03:12.961423] [INFO ] [REMOTE    ] MUSA: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T20:03:13.747690] [INFO ] [REMOTE    ] MUJ: Fetching primary data for 2025-07.
[2025-10-24T20:03:14.547626] [INFO ] [REMOTE    ] MUSA: Fetching primary data for 2025-02.
[2025-10-24T20:03:14.763446] [INFO ] [REMOTE    ] MUFG: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T20:03:14.790632] [INFO ] [REMOTE    ] MUJ: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T20:03:15.347628] [INFO ] [REMOTE    ] MUFG: Fetching primary data for 2025-08.
[2025-10-24T20:03:15.568630] [INFO ] [REMOTE    ] MUSA: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T20:03:16.147720] [INFO ] [REMOTE    ] MUSA: Fetching primary data for 2025-03.
[2025-10-24T20:03:16.947703] [INFO ] [REMOTE    ] MUR: Fetching primary data for 2025-02.
[2025-10-24T20:03:17.148310] [INFO ] [REMOTE    ] MUFG: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T20:03:17.441262] [INFO ] [REMOTE    ] MUSA: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T20:03:17.747679] [INFO ] [REMOTE    ] MUSA: Fetching primary data for 2025-04.
[2025-10-24T20:03:18.556786] [INFO ] [REMOTE    ] MUJ: Fetching primary data for 2025-08.
[2025-10-24T20:03:18.563331] [INFO ] [REMOTE    ] MUR: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T20:03:18.624198] [INFO ] [REMOTE    ] MUSA: Incremental fetch complete for 2025-04 (0.88 seconds).
[2025-10-24T20:03:19.347633] [INFO ] [REMOTE    ] MUSA: Fetching primary data for 2025-05.
[2025-10-24T20:03:19.513790] [INFO ] [REMOTE    ] MUJ: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T20:03:20.147611] [INFO ] [REMOTE    ] MUFG: Fetching primary data for 2025-09.
[2025-10-24T20:03:20.399342] [INFO ] [REMOTE    ] MUSA: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T20:03:20.947708] [INFO ] [REMOTE    ] MUR: Fetching primary data for 2025-03.
[2025-10-24T20:03:21.756872] [INFO ] [REMOTE    ] MUJ: Fetching primary data for 2025-09.
[2025-10-24T20:03:21.780043] [INFO ] [REMOTE    ] MUFG: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T20:03:22.547616] [INFO ] [REMOTE    ] MUFG: Fetching primary data for 2025-10.
[2025-10-24T20:03:22.630499] [INFO ] [REMOTE    ] MUR: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T20:03:22.671193] [INFO ] [REMOTE    ] MUJ: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T20:03:23.347717] [INFO ] [REMOTE    ] MUR: Fetching primary data for 2025-04.
[2025-10-24T20:03:24.147766] [INFO ] [REMOTE    ] MUJ: Fetching primary data for 2025-10.
[2025-10-24T20:03:24.296469] [INFO ] [REMOTE    ] MUFG: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T20:03:24.305985] [INFO ] [REMOTE    ] MUFG: Full fetch complete (75865 records).
[2025-10-24T20:03:24.306145] [DEBUG] [VALIDATOR ] MUFG: Validating primary data.
[2025-10-24T20:03:24.708977] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present.
[2025-10-24T20:03:24.709068] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed.
[2025-10-24T20:03:24.710195] [INFO ] [MAIN      ] MUFG: Fetched primary data is valid.
[2025-10-24T20:03:24.710261] [DEBUG] [LOCAL     ] MUFG: Saving primary data.
[2025-10-24T20:03:24.710898] [FATAL] [LOCAL     ] MUFG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:03:24.710988] [FATAL] [MAIN      ] MUFG: Failed to save primary data.
[2025-10-24T20:03:24.711031] [WARN ] [MAIN      ] MUFG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:03:24.711067] [INFO ] [LOCAL     ] MUFG: Starting deletion of primary data.
[2025-10-24T20:03:24.711123] [DEBUG] [LOCAL     ] MUFG: No primary data file found to delete.
[2025-10-24T20:03:24.711178] [INFO ] [LOCAL     ] MUFG: Starting deletion of derivative data.
[2025-10-24T20:03:24.711285] [DEBUG] [LOCAL     ] MUFG: Deleted derivative data file.
[2025-10-24T20:03:24.712027] [INFO ] [MAIN      ] Update Progress: 1427/2366 symbols completed. MUFG took 38.3s. Estimated remaining: 2h 0m 39s. Rate: 7.8 symbols/min
[2025-10-24T20:03:24.890777] [INFO ] [MAIN      ] MUSE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:03:24.891041] [DEBUG] [LOCAL     ] MUSE: No existing data file found in primary storage.
[2025-10-24T20:03:24.891202] [WARN ] [MAIN      ] MUSE: No existing data found, performing full refresh instead.
[2025-10-24T20:03:24.891319] [INFO ] [MAIN      ] MUSE: Wiping existing primary data before full refresh.
[2025-10-24T20:03:24.891363] [INFO ] [LOCAL     ] MUSE: Starting deletion of primary data.
[2025-10-24T20:03:24.891406] [DEBUG] [LOCAL     ] MUSE: No primary data file found to delete.
[2025-10-24T20:03:24.891439] [INFO ] [MAIN      ] MUSE: Starting full primary refresh.
[2025-10-24T20:03:24.961264] [INFO ] [REMOTE    ] MUSA: Fetching primary data for 2025-06.
[2025-10-24T20:03:25.255158] [INFO ] [REMOTE    ] MUSE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:03:25.315224] [INFO ] [REMOTE    ] MUJ: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T20:03:25.321494] [INFO ] [REMOTE    ] MUR: Incremental fetch complete for 2025-04 (1.97 seconds).
[2025-10-24T20:03:25.322289] [INFO ] [REMOTE    ] MUJ: Full fetch complete (19352 records).
[2025-10-24T20:03:25.333580] [DEBUG] [VALIDATOR ] MUJ: Validating primary data.
[2025-10-24T20:03:25.698537] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present.
[2025-10-24T20:03:25.698815] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed.
[2025-10-24T20:03:25.699509] [INFO ] [MAIN      ] MUJ: Fetched primary data is valid.
[2025-10-24T20:03:25.699619] [DEBUG] [LOCAL     ] MUJ: Saving primary data.
[2025-10-24T20:03:25.700195] [FATAL] [LOCAL     ] MUJ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:03:25.700329] [FATAL] [MAIN      ] MUJ: Failed to save primary data.
[2025-10-24T20:03:25.700559] [WARN ] [MAIN      ] MUJ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:03:25.700829] [INFO ] [LOCAL     ] MUJ: Starting deletion of primary data.
[2025-10-24T20:03:25.701023] [DEBUG] [LOCAL     ] MUJ: No primary data file found to delete.
[2025-10-24T20:03:25.701227] [INFO ] [LOCAL     ] MUJ: Starting deletion of derivative data.
[2025-10-24T20:03:25.701493] [DEBUG] [LOCAL     ] MUJ: Deleted derivative data file.
[2025-10-24T20:03:25.701606] [INFO ] [MAIN      ] Update Progress: 1428/2366 symbols completed. MUJ took 38.0s. Estimated remaining: 2h 0m 27s. Rate: 7.8 symbols/min
[2025-10-24T20:03:25.758953] [INFO ] [REMOTE    ] MUR: Fetching primary data for 2025-05.
[2025-10-24T20:03:25.919272] [INFO ] [MAIN      ] MUX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:03:25.916915] [INFO ] [REMOTE    ] MUSA: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T20:03:25.967059] [DEBUG] [LOCAL     ] MUX: Loaded 44187 existing records from primary storage.
[2025-10-24T20:03:25.967395] [INFO ] [MAIN      ] MUX: Loaded 44187 existing records.
[2025-10-24T20:03:26.141776] [WARN ] [MAIN      ] MUX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:03:26.141995] [INFO ] [MAIN      ] MUX: Wiping existing primary data before full refresh.
[2025-10-24T20:03:26.142042] [INFO ] [LOCAL     ] MUX: Starting deletion of primary data.
[2025-10-24T20:03:26.142638] [DEBUG] [LOCAL     ] MUX: Deleted primary data file.
[2025-10-24T20:03:26.142731] [INFO ] [MAIN      ] MUX: Starting full primary refresh.
[2025-10-24T20:03:26.492808] [INFO ] [REMOTE    ] MUX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:03:26.547615] [INFO ] [REMOTE    ] MUX: Fetching primary data for 2025-01.
[2025-10-24T20:03:27.347712] [INFO ] [REMOTE    ] MUSA: Fetching primary data for 2025-07.
[2025-10-24T20:03:27.561299] [INFO ] [REMOTE    ] MUR: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T20:03:27.892459] [INFO ] [REMOTE    ] MUX: Incremental fetch complete for 2025-01 (1.34 seconds).
[2025-10-24T20:03:28.136281] [INFO ] [REMOTE    ] MUSA: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T20:03:28.147606] [INFO ] [REMOTE    ] MUSA: Fetching primary data for 2025-08.
[2025-10-24T20:03:28.947742] [INFO ] [REMOTE    ] MUX: Fetching primary data for 2025-02.
[2025-10-24T20:03:29.175714] [INFO ] [REMOTE    ] MUSA: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T20:03:29.747734] [INFO ] [REMOTE    ] MUR: Fetching primary data for 2025-06.
[2025-10-24T20:03:30.379875] [INFO ] [REMOTE    ] MUX: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T20:03:30.547736] [INFO ] [REMOTE    ] MUSE: Fetching primary data for 2025-01.
[2025-10-24T20:03:30.780157] [DEBUG] [REMOTE    ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:03:30.780685] [WARN ] [REMOTE    ] MUSE: No data returned for month 2025-01
[2025-10-24T20:03:30.780796] [FATAL] [REMOTE    ] MUSE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:03:30.780860] [FATAL] [MAIN      ] MUSE: Failed to fetch primary data.
[2025-10-24T20:03:30.780918] [WARN ] [MAIN      ] MUSE: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:03:30.781009] [INFO ] [LOCAL     ] MUSE: Starting deletion of primary data.
[2025-10-24T20:03:30.781081] [DEBUG] [LOCAL     ] MUSE: No primary data file found to delete.
[2025-10-24T20:03:30.781158] [INFO ] [LOCAL     ] MUSE: Starting deletion of derivative data.
[2025-10-24T20:03:30.781221] [DEBUG] [LOCAL     ] MUSE: No derivative data file found to delete.
[2025-10-24T20:03:30.781278] [INFO ] [MAIN      ] Update Progress: 1429/2366 symbols completed. MUSE took 6.1s. Estimated remaining: 2h 0m 18s. Rate: 7.8 symbols/min
[2025-10-24T20:03:30.956737] [INFO ] [MAIN      ] MVF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:03:30.971737] [DEBUG] [LOCAL     ] MVF: Loaded 12832 existing records from primary storage.
[2025-10-24T20:03:30.971976] [INFO ] [MAIN      ] MVF: Loaded 12832 existing records.
[2025-10-24T20:03:31.163673] [WARN ] [MAIN      ] MVF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:03:31.164015] [INFO ] [MAIN      ] MVF: Wiping existing primary data before full refresh.
[2025-10-24T20:03:31.164093] [INFO ] [LOCAL     ] MVF: Starting deletion of primary data.
[2025-10-24T20:03:31.164415] [DEBUG] [LOCAL     ] MVF: Deleted primary data file.
[2025-10-24T20:03:31.164561] [INFO ] [MAIN      ] MVF: Starting full primary refresh.
[2025-10-24T20:03:31.396683] [INFO ] [REMOTE    ] MUX: Fetching primary data for 2025-03.
[2025-10-24T20:03:31.430402] [INFO ] [REMOTE    ] MUR: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T20:03:31.587750] [INFO ] [REMOTE    ] MVF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:03:32.147677] [INFO ] [REMOTE    ] MVF: Fetching primary data for 2025-01.
[2025-10-24T20:03:32.836934] [INFO ] [REMOTE    ] MUX: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T20:03:32.838078] [INFO ] [REMOTE    ] MVF: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T20:03:32.947679] [INFO ] [REMOTE    ] MVF: Fetching primary data for 2025-02.
[2025-10-24T20:03:33.723077] [INFO ] [REMOTE    ] MVF: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T20:03:33.747631] [INFO ] [REMOTE    ] MVF: Fetching primary data for 2025-03.
[2025-10-24T20:03:34.547736] [INFO ] [REMOTE    ] MUX: Fetching primary data for 2025-04.
[2025-10-24T20:03:34.571861] [INFO ] [REMOTE    ] MVF: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T20:03:35.347777] [INFO ] [REMOTE    ] MVF: Fetching primary data for 2025-04.
[2025-10-24T20:03:36.058354] [INFO ] [REMOTE    ] MUX: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T20:03:36.147637] [INFO ] [REMOTE    ] MUX: Fetching primary data for 2025-05.
[2025-10-24T20:03:36.365411] [INFO ] [REMOTE    ] MVF: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T20:03:36.947754] [INFO ] [REMOTE    ] MUSA: Fetching primary data for 2025-09.
[2025-10-24T20:03:37.524335] [INFO ] [REMOTE    ] MUX: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T20:03:37.747627] [INFO ] [REMOTE    ] MUX: Fetching primary data for 2025-06.
[2025-10-24T20:03:38.063780] [INFO ] [REMOTE    ] MUSA: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T20:03:38.547639] [INFO ] [REMOTE    ] MUR: Fetching primary data for 2025-07.
[2025-10-24T20:03:39.347678] [INFO ] [REMOTE    ] MVF: Fetching primary data for 2025-05.
[2025-10-24T20:03:39.761369] [INFO ] [REMOTE    ] MUX: Incremental fetch complete for 2025-06 (2.01 seconds).
[2025-10-24T20:03:40.009769] [INFO ] [REMOTE    ] MVF: Incremental fetch complete for 2025-05 (0.66 seconds).
[2025-10-24T20:03:40.147687] [INFO ] [REMOTE    ] MUX: Fetching primary data for 2025-07.
[2025-10-24T20:03:40.189768] [INFO ] [REMOTE    ] MUR: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T20:03:40.947703] [INFO ] [REMOTE    ] MUSA: Fetching primary data for 2025-10.
[2025-10-24T20:03:41.760374] [INFO ] [REMOTE    ] MUR: Fetching primary data for 2025-08.
[2025-10-24T20:03:41.764080] [INFO ] [REMOTE    ] MUX: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T20:03:42.153620] [INFO ] [REMOTE    ] MUSA: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T20:03:42.158044] [INFO ] [REMOTE    ] MUSA: Full fetch complete (35686 records).
[2025-10-24T20:03:42.158146] [DEBUG] [VALIDATOR ] MUSA: Validating primary data.
[2025-10-24T20:03:42.526885] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present.
[2025-10-24T20:03:42.527022] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed.
[2025-10-24T20:03:42.527821] [INFO ] [MAIN      ] MUSA: Fetched primary data is valid.
[2025-10-24T20:03:42.527884] [DEBUG] [LOCAL     ] MUSA: Saving primary data.
[2025-10-24T20:03:42.528322] [FATAL] [LOCAL     ] MUSA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:03:42.528403] [FATAL] [MAIN      ] MUSA: Failed to save primary data.
[2025-10-24T20:03:42.528470] [WARN ] [MAIN      ] MUSA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:03:42.528536] [INFO ] [LOCAL     ] MUSA: Starting deletion of primary data.
[2025-10-24T20:03:42.528603] [DEBUG] [LOCAL     ] MUSA: No primary data file found to delete.
[2025-10-24T20:03:42.528686] [INFO ] [LOCAL     ] MUSA: Starting deletion of derivative data.
[2025-10-24T20:03:42.528848] [DEBUG] [LOCAL     ] MUSA: Deleted derivative data file.
[2025-10-24T20:03:42.528951] [INFO ] [MAIN      ] Update Progress: 1430/2366 symbols completed. MUSA took 31.2s. Estimated remaining: 2h 0m 13s. Rate: 7.8 symbols/min
[2025-10-24T20:03:42.552898] [INFO ] [REMOTE    ] MUX: Fetching primary data for 2025-08.
[2025-10-24T20:03:42.705386] [INFO ] [MAIN      ] MVO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:03:42.715445] [DEBUG] [LOCAL     ] MVO: Loaded 9083 existing records from primary storage.
[2025-10-24T20:03:42.715709] [INFO ] [MAIN      ] MVO: Loaded 9083 existing records.
[2025-10-24T20:03:42.888635] [WARN ] [MAIN      ] MVO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:03:42.888888] [INFO ] [MAIN      ] MVO: Wiping existing primary data before full refresh.
[2025-10-24T20:03:42.888942] [INFO ] [LOCAL     ] MVO: Starting deletion of primary data.
[2025-10-24T20:03:42.889221] [DEBUG] [LOCAL     ] MVO: Deleted primary data file.
[2025-10-24T20:03:42.889258] [INFO ] [MAIN      ] MVO: Starting full primary refresh.
[2025-10-24T20:03:43.237697] [INFO ] [REMOTE    ] MVO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:03:43.347608] [INFO ] [REMOTE    ] MVO: Fetching primary data for 2025-01.
[2025-10-24T20:03:43.425762] [INFO ] [REMOTE    ] MUR: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T20:03:43.951198] [INFO ] [REMOTE    ] MVO: Incremental fetch complete for 2025-01 (0.60 seconds).
[2025-10-24T20:03:44.147665] [INFO ] [REMOTE    ] MVO: Fetching primary data for 2025-02.
[2025-10-24T20:03:44.193471] [INFO ] [REMOTE    ] MUX: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T20:03:44.946035] [INFO ] [REMOTE    ] MVO: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T20:03:44.948892] [INFO ] [REMOTE    ] MUR: Fetching primary data for 2025-09.
[2025-10-24T20:03:45.747711] [INFO ] [REMOTE    ] MVF: Fetching primary data for 2025-06.
[2025-10-24T20:03:46.547615] [INFO ] [REMOTE    ] MUX: Fetching primary data for 2025-09.
[2025-10-24T20:03:46.635621] [INFO ] [REMOTE    ] MVF: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T20:03:46.702417] [INFO ] [REMOTE    ] MUR: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T20:03:47.347677] [INFO ] [REMOTE    ] MUR: Fetching primary data for 2025-10.
[2025-10-24T20:03:48.090802] [INFO ] [REMOTE    ] MUX: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T20:03:48.147635] [INFO ] [REMOTE    ] MUX: Fetching primary data for 2025-10.
[2025-10-24T20:03:48.947712] [INFO ] [REMOTE    ] MVF: Fetching primary data for 2025-07.
[2025-10-24T20:03:48.979195] [INFO ] [REMOTE    ] MUR: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T20:03:48.988804] [INFO ] [REMOTE    ] MUR: Full fetch complete (76818 records).
[2025-10-24T20:03:48.988956] [DEBUG] [VALIDATOR ] MUR: Validating primary data.
[2025-10-24T20:03:49.405214] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present.
[2025-10-24T20:03:49.405319] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed.
[2025-10-24T20:03:49.406598] [INFO ] [MAIN      ] MUR: Fetched primary data is valid.
[2025-10-24T20:03:49.406686] [DEBUG] [LOCAL     ] MUR: Saving primary data.
[2025-10-24T20:03:49.407275] [FATAL] [LOCAL     ] MUR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:03:49.407367] [FATAL] [MAIN      ] MUR: Failed to save primary data.
[2025-10-24T20:03:49.407425] [WARN ] [MAIN      ] MUR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:03:49.407491] [INFO ] [LOCAL     ] MUR: Starting deletion of primary data.
[2025-10-24T20:03:49.407551] [DEBUG] [LOCAL     ] MUR: No primary data file found to delete.
[2025-10-24T20:03:49.407587] [INFO ] [LOCAL     ] MUR: Starting deletion of derivative data.
[2025-10-24T20:03:49.407808] [DEBUG] [LOCAL     ] MUR: Deleted derivative data file.
[2025-10-24T20:03:49.408086] [INFO ] [MAIN      ] Update Progress: 1431/2366 symbols completed. MUR took 44.8s. Estimated remaining: 2h 0m 5s. Rate: 7.8 symbols/min
[2025-10-24T20:03:49.575984] [INFO ] [MAIN      ] MVT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:03:49.589314] [DEBUG] [LOCAL     ] MVT: Loaded 9850 existing records from primary storage.
[2025-10-24T20:03:49.589540] [INFO ] [MAIN      ] MVT: Loaded 9850 existing records.
[2025-10-24T20:03:49.700409] [INFO ] [REMOTE    ] MVF: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T20:03:49.752805] [INFO ] [REMOTE    ] MVO: Fetching primary data for 2025-03.
[2025-10-24T20:03:49.796174] [WARN ] [MAIN      ] MVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:03:49.796447] [INFO ] [MAIN      ] MVT: Wiping existing primary data before full refresh.
[2025-10-24T20:03:49.796504] [INFO ] [LOCAL     ] MVT: Starting deletion of primary data.
[2025-10-24T20:03:49.796794] [DEBUG] [LOCAL     ] MVT: Deleted primary data file.
[2025-10-24T20:03:49.796857] [INFO ] [MAIN      ] MVT: Starting full primary refresh.
[2025-10-24T20:03:50.184582] [INFO ] [REMOTE    ] MVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:03:50.228900] [INFO ] [REMOTE    ] MUX: Incremental fetch complete for 2025-10 (2.08 seconds).
[2025-10-24T20:03:50.239058] [INFO ] [REMOTE    ] MUX: Full fetch complete (61751 records).
[2025-10-24T20:03:50.239260] [DEBUG] [VALIDATOR ] MUX: Validating primary data.
[2025-10-24T20:03:50.347997] [INFO ] [REMOTE    ] MVO: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T20:03:50.552827] [INFO ] [REMOTE    ] MVO: Fetching primary data for 2025-04.
[2025-10-24T20:03:50.634262] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present.
[2025-10-24T20:03:50.634342] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed.
[2025-10-24T20:03:50.635388] [INFO ] [MAIN      ] MUX: Fetched primary data is valid.
[2025-10-24T20:03:50.635452] [DEBUG] [LOCAL     ] MUX: Saving primary data.
[2025-10-24T20:03:50.636035] [FATAL] [LOCAL     ] MUX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:03:50.636119] [FATAL] [MAIN      ] MUX: Failed to save primary data.
[2025-10-24T20:03:50.636195] [WARN ] [MAIN      ] MUX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:03:50.636278] [INFO ] [LOCAL     ] MUX: Starting deletion of primary data.
[2025-10-24T20:03:50.636351] [DEBUG] [LOCAL     ] MUX: No primary data file found to delete.
[2025-10-24T20:03:50.636389] [INFO ] [LOCAL     ] MUX: Starting deletion of derivative data.
[2025-10-24T20:03:50.636515] [DEBUG] [LOCAL     ] MUX: Deleted derivative data file.
[2025-10-24T20:03:50.636876] [INFO ] [MAIN      ] Update Progress: 1432/2366 symbols completed. MUX took 24.9s. Estimated remaining: 1h 59m 53s. Rate: 7.8 symbols/min
[2025-10-24T20:03:50.808797] [INFO ] [MAIN      ] MWA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:03:50.854023] [DEBUG] [LOCAL     ] MWA: Loaded 46053 existing records from primary storage.
[2025-10-24T20:03:50.854320] [INFO ] [MAIN      ] MWA: Loaded 46053 existing records.
[2025-10-24T20:03:51.031295] [WARN ] [MAIN      ] MWA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:03:51.031506] [INFO ] [MAIN      ] MWA: Wiping existing primary data before full refresh.
[2025-10-24T20:03:51.031556] [INFO ] [LOCAL     ] MWA: Starting deletion of primary data.
[2025-10-24T20:03:51.032139] [DEBUG] [LOCAL     ] MWA: Deleted primary data file.
[2025-10-24T20:03:51.032197] [INFO ] [MAIN      ] MWA: Starting full primary refresh.
[2025-10-24T20:03:51.359991] [INFO ] [REMOTE    ] MVT: Fetching primary data for 2025-01.
[2025-10-24T20:03:51.404903] [INFO ] [REMOTE    ] MWA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:03:51.519814] [INFO ] [REMOTE    ] MVO: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T20:03:52.147744] [INFO ] [REMOTE    ] MVO: Fetching primary data for 2025-05.
[2025-10-24T20:03:52.200120] [INFO ] [REMOTE    ] MVT: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T20:03:52.801156] [INFO ] [REMOTE    ] MVO: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T20:03:52.947672] [INFO ] [REMOTE    ] MVO: Fetching primary data for 2025-06.
[2025-10-24T20:03:53.682975] [INFO ] [REMOTE    ] MVO: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T20:03:53.747702] [INFO ] [REMOTE    ] MVT: Fetching primary data for 2025-02.
[2025-10-24T20:03:54.371532] [INFO ] [REMOTE    ] MVT: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T20:03:54.547697] [INFO ] [REMOTE    ] MVO: Fetching primary data for 2025-07.
[2025-10-24T20:03:55.331871] [INFO ] [REMOTE    ] MVO: Incremental fetch complete for 2025-07 (0.78 seconds).
[2025-10-24T20:03:55.347610] [INFO ] [REMOTE    ] MVO: Fetching primary data for 2025-08.
[2025-10-24T20:03:56.100123] [INFO ] [REMOTE    ] MVO: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T20:03:56.147605] [INFO ] [REMOTE    ] MVO: Fetching primary data for 2025-09.
[2025-10-24T20:03:56.895803] [INFO ] [REMOTE    ] MVO: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T20:03:56.947626] [INFO ] [REMOTE    ] MWA: Fetching primary data for 2025-01.
[2025-10-24T20:03:57.747633] [INFO ] [REMOTE    ] MVT: Fetching primary data for 2025-03.
[2025-10-24T20:03:58.327087] [INFO ] [REMOTE    ] MWA: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T20:03:58.522897] [INFO ] [REMOTE    ] MVT: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T20:03:58.547603] [INFO ] [REMOTE    ] MVO: Fetching primary data for 2025-10.
[2025-10-24T20:03:59.347622] [INFO ] [REMOTE    ] MVF: Fetching primary data for 2025-08.
[2025-10-24T20:03:59.412688] [INFO ] [REMOTE    ] MVO: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T20:03:59.414995] [INFO ] [REMOTE    ] MVO: Full fetch complete (14674 records).
[2025-10-24T20:03:59.415066] [DEBUG] [VALIDATOR ] MVO: Validating primary data.
[2025-10-24T20:03:59.771042] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present.
[2025-10-24T20:03:59.771121] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed.
[2025-10-24T20:03:59.771391] [INFO ] [MAIN      ] MVO: Fetched primary data is valid.
[2025-10-24T20:03:59.771427] [DEBUG] [LOCAL     ] MVO: Saving primary data.
[2025-10-24T20:03:59.771638] [FATAL] [LOCAL     ] MVO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:03:59.771746] [FATAL] [MAIN      ] MVO: Failed to save primary data.
[2025-10-24T20:03:59.771789] [WARN ] [MAIN      ] MVO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:03:59.771823] [INFO ] [LOCAL     ] MVO: Starting deletion of primary data.
[2025-10-24T20:03:59.771870] [DEBUG] [LOCAL     ] MVO: No primary data file found to delete.
[2025-10-24T20:03:59.771904] [INFO ] [LOCAL     ] MVO: Starting deletion of derivative data.
[2025-10-24T20:03:59.772057] [DEBUG] [LOCAL     ] MVO: Deleted derivative data file.
[2025-10-24T20:03:59.772156] [INFO ] [MAIN      ] Update Progress: 1433/2366 symbols completed. MVO took 17.2s. Estimated remaining: 1h 59m 46s. Rate: 7.8 symbols/min
[2025-10-24T20:03:59.940255] [INFO ] [MAIN      ] MX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:03:59.963159] [DEBUG] [LOCAL     ] MX: Loaded 22387 existing records from primary storage.
[2025-10-24T20:03:59.963395] [INFO ] [MAIN      ] MX: Loaded 22387 existing records.
[2025-10-24T20:04:00.140677] [WARN ] [MAIN      ] MX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:04:00.140966] [INFO ] [MAIN      ] MX: Wiping existing primary data before full refresh.
[2025-10-24T20:04:00.141028] [INFO ] [LOCAL     ] MX: Starting deletion of primary data.
[2025-10-24T20:04:00.141284] [DEBUG] [LOCAL     ] MX: Deleted primary data file.
[2025-10-24T20:04:00.141322] [INFO ] [MAIN      ] MX: Starting full primary refresh.
[2025-10-24T20:04:00.153987] [INFO ] [REMOTE    ] MWA: Fetching primary data for 2025-02.
[2025-10-24T20:04:00.264100] [INFO ] [REMOTE    ] MVF: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T20:04:00.506817] [INFO ] [REMOTE    ] MX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:04:00.947636] [INFO ] [REMOTE    ] MVF: Fetching primary data for 2025-09.
[2025-10-24T20:04:01.747731] [INFO ] [REMOTE    ] MVT: Fetching primary data for 2025-04.
[2025-10-24T20:04:01.966415] [INFO ] [REMOTE    ] MVF: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T20:04:02.000977] [INFO ] [REMOTE    ] MWA: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T20:04:02.551671] [INFO ] [REMOTE    ] MVF: Fetching primary data for 2025-10.
[2025-10-24T20:04:02.552799] [INFO ] [REMOTE    ] MVT: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T20:04:03.347716] [INFO ] [REMOTE    ] MVT: Fetching primary data for 2025-05.
[2025-10-24T20:04:03.519423] [INFO ] [REMOTE    ] MVF: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T20:04:03.523233] [INFO ] [REMOTE    ] MVF: Full fetch complete (18614 records).
[2025-10-24T20:04:03.523366] [DEBUG] [VALIDATOR ] MVF: Validating primary data.
[2025-10-24T20:04:03.939282] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present.
[2025-10-24T20:04:03.939402] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed.
[2025-10-24T20:04:03.940118] [INFO ] [MAIN      ] MVF: Fetched primary data is valid.
[2025-10-24T20:04:03.940183] [DEBUG] [LOCAL     ] MVF: Saving primary data.
[2025-10-24T20:04:03.940575] [FATAL] [LOCAL     ] MVF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:04:03.940687] [FATAL] [MAIN      ] MVF: Failed to save primary data.
[2025-10-24T20:04:03.940741] [WARN ] [MAIN      ] MVF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:04:03.940778] [INFO ] [LOCAL     ] MVF: Starting deletion of primary data.
[2025-10-24T20:04:03.940833] [DEBUG] [LOCAL     ] MVF: No primary data file found to delete.
[2025-10-24T20:04:03.940870] [INFO ] [LOCAL     ] MVF: Starting deletion of derivative data.
[2025-10-24T20:04:03.941054] [DEBUG] [LOCAL     ] MVF: Deleted derivative data file.
[2025-10-24T20:04:03.941171] [INFO ] [MAIN      ] Update Progress: 1434/2366 symbols completed. MVF took 33.2s. Estimated remaining: 1h 59m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:04:04.130568] [INFO ] [MAIN      ] MXE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:04:04.130876] [DEBUG] [LOCAL     ] MXE: No existing data file found in primary storage.
[2025-10-24T20:04:04.130936] [WARN ] [MAIN      ] MXE: No existing data found, performing full refresh instead.
[2025-10-24T20:04:04.131073] [INFO ] [MAIN      ] MXE: Wiping existing primary data before full refresh.
[2025-10-24T20:04:04.131117] [INFO ] [LOCAL     ] MXE: Starting deletion of primary data.
[2025-10-24T20:04:04.131161] [DEBUG] [LOCAL     ] MXE: No primary data file found to delete.
[2025-10-24T20:04:04.131197] [INFO ] [MAIN      ] MXE: Starting full primary refresh.
[2025-10-24T20:04:04.152852] [INFO ] [REMOTE    ] MWA: Fetching primary data for 2025-03.
[2025-10-24T20:04:04.252961] [INFO ] [REMOTE    ] MVT: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T20:04:04.527421] [INFO ] [REMOTE    ] MXE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:04:04.947680] [INFO ] [REMOTE    ] MXE: Fetching primary data for 2025-01.
[2025-10-24T20:04:05.468953] [INFO ] [REMOTE    ] MXE: Incremental fetch complete for 2025-01 (0.52 seconds).
[2025-10-24T20:04:05.747620] [INFO ] [REMOTE    ] MXE: Fetching primary data for 2025-02.
[2025-10-24T20:04:05.976823] [INFO ] [REMOTE    ] MWA: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T20:04:06.038049] [INFO ] [REMOTE    ] MXE: Incremental fetch complete for 2025-02 (0.29 seconds).
[2025-10-24T20:04:06.547669] [INFO ] [REMOTE    ] MVT: Fetching primary data for 2025-06.
[2025-10-24T20:04:07.318143] [INFO ] [REMOTE    ] MVT: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T20:04:07.347617] [INFO ] [REMOTE    ] MVT: Fetching primary data for 2025-07.
[2025-10-24T20:04:08.101396] [INFO ] [REMOTE    ] MVT: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T20:04:08.147621] [INFO ] [REMOTE    ] MVT: Fetching primary data for 2025-08.
[2025-10-24T20:04:08.919070] [INFO ] [REMOTE    ] MVT: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T20:04:08.947609] [INFO ] [REMOTE    ] MVT: Fetching primary data for 2025-09.
[2025-10-24T20:04:09.699332] [INFO ] [REMOTE    ] MVT: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T20:04:09.747766] [INFO ] [REMOTE    ] MWA: Fetching primary data for 2025-04.
[2025-10-24T20:04:10.547626] [INFO ] [REMOTE    ] MXE: Fetching primary data for 2025-03.
[2025-10-24T20:04:10.914885] [INFO ] [REMOTE    ] MXE: Incremental fetch complete for 2025-03 (0.37 seconds).
[2025-10-24T20:04:11.277202] [INFO ] [REMOTE    ] MWA: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T20:04:11.347684] [INFO ] [REMOTE    ] MX: Fetching primary data for 2025-01.
[2025-10-24T20:04:12.147716] [INFO ] [REMOTE    ] MWA: Fetching primary data for 2025-05.
[2025-10-24T20:04:12.331975] [INFO ] [REMOTE    ] MX: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T20:04:12.947722] [INFO ] [REMOTE    ] MXE: Fetching primary data for 2025-04.
[2025-10-24T20:04:13.459764] [INFO ] [REMOTE    ] MXE: Incremental fetch complete for 2025-04 (0.51 seconds).
[2025-10-24T20:04:13.747619] [INFO ] [REMOTE    ] MXE: Fetching primary data for 2025-05.
[2025-10-24T20:04:13.849784] [INFO ] [REMOTE    ] MWA: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T20:04:14.114627] [INFO ] [REMOTE    ] MXE: Incremental fetch complete for 2025-05 (0.37 seconds).
[2025-10-24T20:04:14.547729] [INFO ] [REMOTE    ] MXE: Fetching primary data for 2025-06.
[2025-10-24T20:04:14.958796] [INFO ] [REMOTE    ] MXE: Incremental fetch complete for 2025-06 (0.41 seconds).
[2025-10-24T20:04:15.347720] [INFO ] [REMOTE    ] MXE: Fetching primary data for 2025-07.
[2025-10-24T20:04:15.855088] [INFO ] [REMOTE    ] MXE: Incremental fetch complete for 2025-07 (0.51 seconds).
[2025-10-24T20:04:16.147735] [INFO ] [REMOTE    ] MVT: Fetching primary data for 2025-10.
[2025-10-24T20:04:16.947710] [INFO ] [REMOTE    ] MXE: Fetching primary data for 2025-08.
[2025-10-24T20:04:17.013783] [INFO ] [REMOTE    ] MVT: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T20:04:17.015544] [INFO ] [REMOTE    ] MVT: Full fetch complete (13645 records).
[2025-10-24T20:04:17.015612] [DEBUG] [VALIDATOR ] MVT: Validating primary data.
[2025-10-24T20:04:17.382986] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present.
[2025-10-24T20:04:17.383077] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed.
[2025-10-24T20:04:17.383427] [INFO ] [MAIN      ] MVT: Fetched primary data is valid.
[2025-10-24T20:04:17.383468] [DEBUG] [LOCAL     ] MVT: Saving primary data.
[2025-10-24T20:04:17.383718] [FATAL] [LOCAL     ] MVT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:04:17.383805] [FATAL] [MAIN      ] MVT: Failed to save primary data.
[2025-10-24T20:04:17.383847] [WARN ] [MAIN      ] MVT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:04:17.383883] [INFO ] [LOCAL     ] MVT: Starting deletion of primary data.
[2025-10-24T20:04:17.383933] [DEBUG] [LOCAL     ] MVT: No primary data file found to delete.
[2025-10-24T20:04:17.383971] [INFO ] [LOCAL     ] MVT: Starting deletion of derivative data.
[2025-10-24T20:04:17.384086] [DEBUG] [LOCAL     ] MVT: Deleted derivative data file.
[2025-10-24T20:04:17.384175] [INFO ] [MAIN      ] Update Progress: 1435/2366 symbols completed. MVT took 28.0s. Estimated remaining: 1h 59m 32s. Rate: 7.8 symbols/min
[2025-10-24T20:04:17.465242] [INFO ] [REMOTE    ] MXE: Incremental fetch complete for 2025-08 (0.52 seconds).
[2025-10-24T20:04:17.563847] [INFO ] [MAIN      ] MXF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:04:17.573138] [DEBUG] [LOCAL     ] MXF: Loaded 5580 existing records from primary storage.
[2025-10-24T20:04:17.573380] [INFO ] [MAIN      ] MXF: Loaded 5580 existing records.
[2025-10-24T20:04:17.750044] [WARN ] [MAIN      ] MXF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:04:17.750221] [INFO ] [REMOTE    ] MXE: Fetching primary data for 2025-09.
[2025-10-24T20:04:17.750632] [INFO ] [MAIN      ] MXF: Wiping existing primary data before full refresh.
[2025-10-24T20:04:17.751748] [INFO ] [LOCAL     ] MXF: Starting deletion of primary data.
[2025-10-24T20:04:17.752000] [DEBUG] [LOCAL     ] MXF: Deleted primary data file.
[2025-10-24T20:04:17.752046] [INFO ] [MAIN      ] MXF: Starting full primary refresh.
[2025-10-24T20:04:18.167439] [INFO ] [REMOTE    ] MXF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:04:18.297402] [INFO ] [REMOTE    ] MXE: Incremental fetch complete for 2025-09 (0.55 seconds).
[2025-10-24T20:04:18.547723] [INFO ] [REMOTE    ] MXE: Fetching primary data for 2025-10.
[2025-10-24T20:04:19.115736] [INFO ] [REMOTE    ] MXE: Incremental fetch complete for 2025-10 (0.57 seconds).
[2025-10-24T20:04:19.117136] [INFO ] [REMOTE    ] MXE: Full fetch complete (2543 records).
[2025-10-24T20:04:19.117232] [DEBUG] [VALIDATOR ] MXE: Validating primary data.
[2025-10-24T20:04:19.297631] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 197 unique days, need 200 days
[2025-10-24T20:04:19.297837] [FATAL] [MAIN      ] MXE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:04:19.297881] [WARN ] [MAIN      ] MXE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:04:19.297921] [INFO ] [LOCAL     ] MXE: Starting deletion of primary data.
[2025-10-24T20:04:19.297973] [DEBUG] [LOCAL     ] MXE: No primary data file found to delete.
[2025-10-24T20:04:19.298007] [INFO ] [LOCAL     ] MXE: Starting deletion of derivative data.
[2025-10-24T20:04:19.298045] [DEBUG] [LOCAL     ] MXE: No derivative data file found to delete.
[2025-10-24T20:04:19.298098] [INFO ] [MAIN      ] Update Progress: 1436/2366 symbols completed. MXE took 15.4s. Estimated remaining: 1h 59m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:04:19.352917] [INFO ] [REMOTE    ] MXF: Fetching primary data for 2025-01.
[2025-10-24T20:04:19.472042] [INFO ] [MAIN      ] MYD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:04:19.488353] [DEBUG] [LOCAL     ] MYD: Loaded 13242 existing records from primary storage.
[2025-10-24T20:04:19.488625] [INFO ] [MAIN      ] MYD: Loaded 13242 existing records.
[2025-10-24T20:04:19.667699] [WARN ] [MAIN      ] MYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:04:19.667941] [INFO ] [MAIN      ] MYD: Wiping existing primary data before full refresh.
[2025-10-24T20:04:19.667993] [INFO ] [LOCAL     ] MYD: Starting deletion of primary data.
[2025-10-24T20:04:19.668221] [DEBUG] [LOCAL     ] MYD: Deleted primary data file.
[2025-10-24T20:04:19.668258] [INFO ] [MAIN      ] MYD: Starting full primary refresh.
[2025-10-24T20:04:20.017760] [INFO ] [REMOTE    ] MYD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:04:20.147718] [INFO ] [REMOTE    ] MWA: Fetching primary data for 2025-06.
[2025-10-24T20:04:20.214682] [INFO ] [REMOTE    ] MXF: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T20:04:20.947671] [INFO ] [REMOTE    ] MXF: Fetching primary data for 2025-02.
[2025-10-24T20:04:21.673412] [INFO ] [REMOTE    ] MXF: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T20:04:21.733071] [INFO ] [REMOTE    ] MWA: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T20:04:21.747612] [INFO ] [REMOTE    ] MX: Fetching primary data for 2025-02.
[2025-10-24T20:04:22.547689] [INFO ] [REMOTE    ] MYD: Fetching primary data for 2025-01.
[2025-10-24T20:04:22.728313] [INFO ] [REMOTE    ] MX: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T20:04:23.033763] [INFO ] [REMOTE    ] MYD: Incremental fetch complete for 2025-01 (0.49 seconds).
[2025-10-24T20:04:23.347729] [INFO ] [REMOTE    ] MYD: Fetching primary data for 2025-02.
[2025-10-24T20:04:24.147635] [INFO ] [REMOTE    ] MX: Fetching primary data for 2025-03.
[2025-10-24T20:04:24.401451] [INFO ] [REMOTE    ] MYD: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T20:04:24.947633] [INFO ] [REMOTE    ] MWA: Fetching primary data for 2025-07.
[2025-10-24T20:04:25.267282] [INFO ] [REMOTE    ] MX: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T20:04:25.747681] [INFO ] [REMOTE    ] MXF: Fetching primary data for 2025-03.
[2025-10-24T20:04:26.389599] [INFO ] [REMOTE    ] MWA: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T20:04:26.439039] [INFO ] [REMOTE    ] MXF: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T20:04:26.547678] [INFO ] [REMOTE    ] MXF: Fetching primary data for 2025-04.
[2025-10-24T20:04:27.341057] [INFO ] [REMOTE    ] MXF: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T20:04:27.347602] [INFO ] [REMOTE    ] MXF: Fetching primary data for 2025-05.
[2025-10-24T20:04:28.097522] [INFO ] [REMOTE    ] MXF: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T20:04:28.147612] [INFO ] [REMOTE    ] MYD: Fetching primary data for 2025-03.
[2025-10-24T20:04:28.947669] [INFO ] [REMOTE    ] MXF: Fetching primary data for 2025-06.
[2025-10-24T20:04:29.020469] [INFO ] [REMOTE    ] MYD: Incremental fetch complete for 2025-03 (0.87 seconds).
[2025-10-24T20:04:29.605466] [INFO ] [REMOTE    ] MXF: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T20:04:29.747638] [INFO ] [REMOTE    ] MX: Fetching primary data for 2025-04.
[2025-10-24T20:04:30.547712] [INFO ] [REMOTE    ] MYD: Fetching primary data for 2025-04.
[2025-10-24T20:04:30.840507] [INFO ] [REMOTE    ] MX: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T20:04:31.347622] [INFO ] [REMOTE    ] MX: Fetching primary data for 2025-05.
[2025-10-24T20:04:31.642045] [INFO ] [REMOTE    ] MYD: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T20:04:32.147667] [INFO ] [REMOTE    ] MXF: Fetching primary data for 2025-07.
[2025-10-24T20:04:32.468998] [INFO ] [REMOTE    ] MX: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T20:04:32.532537] [INFO ] [REMOTE    ] MXF: Incremental fetch complete for 2025-07 (0.38 seconds).
[2025-10-24T20:04:32.947718] [INFO ] [REMOTE    ] MWA: Fetching primary data for 2025-08.
[2025-10-24T20:04:33.747723] [INFO ] [REMOTE    ] MYD: Fetching primary data for 2025-05.
[2025-10-24T20:04:34.381316] [INFO ] [REMOTE    ] MWA: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T20:04:34.534782] [INFO ] [REMOTE    ] MYD: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T20:04:34.547619] [INFO ] [REMOTE    ] MYD: Fetching primary data for 2025-06.
[2025-10-24T20:04:35.310009] [INFO ] [REMOTE    ] MYD: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T20:04:35.347677] [INFO ] [REMOTE    ] MXF: Fetching primary data for 2025-08.
[2025-10-24T20:04:35.798475] [INFO ] [REMOTE    ] MXF: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T20:04:36.147674] [INFO ] [REMOTE    ] MYD: Fetching primary data for 2025-07.
[2025-10-24T20:04:36.947626] [INFO ] [REMOTE    ] MX: Fetching primary data for 2025-06.
[2025-10-24T20:04:36.991390] [INFO ] [REMOTE    ] MYD: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T20:04:37.747614] [INFO ] [REMOTE    ] MWA: Fetching primary data for 2025-09.
[2025-10-24T20:04:37.887614] [INFO ] [REMOTE    ] MX: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T20:04:38.547698] [INFO ] [REMOTE    ] MX: Fetching primary data for 2025-07.
[2025-10-24T20:04:39.173517] [INFO ] [REMOTE    ] MWA: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T20:04:39.347734] [INFO ] [REMOTE    ] MXF: Fetching primary data for 2025-09.
[2025-10-24T20:04:39.769684] [INFO ] [REMOTE    ] MX: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T20:04:39.852746] [INFO ] [REMOTE    ] MXF: Incremental fetch complete for 2025-09 (0.51 seconds).
[2025-10-24T20:04:40.147690] [INFO ] [REMOTE    ] MXF: Fetching primary data for 2025-10.
[2025-10-24T20:04:40.867560] [INFO ] [REMOTE    ] MXF: Incremental fetch complete for 2025-10 (0.72 seconds).
[2025-10-24T20:04:40.869335] [INFO ] [REMOTE    ] MXF: Full fetch complete (9761 records).
[2025-10-24T20:04:40.869409] [DEBUG] [VALIDATOR ] MXF: Validating primary data.
[2025-10-24T20:04:40.952853] [INFO ] [REMOTE    ] MYD: Fetching primary data for 2025-08.
[2025-10-24T20:04:41.237932] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present.
[2025-10-24T20:04:41.238006] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed.
[2025-10-24T20:04:41.238248] [INFO ] [MAIN      ] MXF: Fetched primary data is valid.
[2025-10-24T20:04:41.238287] [DEBUG] [LOCAL     ] MXF: Saving primary data.
[2025-10-24T20:04:41.238484] [FATAL] [LOCAL     ] MXF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:04:41.238564] [FATAL] [MAIN      ] MXF: Failed to save primary data.
[2025-10-24T20:04:41.238606] [WARN ] [MAIN      ] MXF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:04:41.238639] [INFO ] [LOCAL     ] MXF: Starting deletion of primary data.
[2025-10-24T20:04:41.238735] [DEBUG] [LOCAL     ] MXF: No primary data file found to delete.
[2025-10-24T20:04:41.238772] [INFO ] [LOCAL     ] MXF: Starting deletion of derivative data.
[2025-10-24T20:04:41.238928] [DEBUG] [LOCAL     ] MXF: Deleted derivative data file.
[2025-10-24T20:04:41.239012] [INFO ] [MAIN      ] Update Progress: 1437/2366 symbols completed. MXF took 23.9s. Estimated remaining: 1h 59m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:04:41.747721] [INFO ] [REMOTE    ] MX: Fetching primary data for 2025-08.
[2025-10-24T20:04:41.815678] [INFO ] [REMOTE    ] MYD: Incremental fetch complete for 2025-08 (0.86 seconds).
[2025-10-24T20:04:42.547742] [INFO ] [REMOTE    ] MWA: Fetching primary data for 2025-10.
[2025-10-24T20:04:43.004381] [INFO ] [REMOTE    ] MX: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T20:04:43.347725] [INFO ] [REMOTE    ] MX: Fetching primary data for 2025-09.
[2025-10-24T20:04:43.821322] [INFO ] [REMOTE    ] MWA: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T20:04:43.829853] [INFO ] [REMOTE    ] MWA: Full fetch complete (68155 records).
[2025-10-24T20:04:43.829968] [DEBUG] [VALIDATOR ] MWA: Validating primary data.
[2025-10-24T20:04:44.152951] [INFO ] [REMOTE    ] MYD: Fetching primary data for 2025-09.
[2025-10-24T20:04:44.236407] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present.
[2025-10-24T20:04:44.236486] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed.
[2025-10-24T20:04:44.237553] [INFO ] [MAIN      ] MWA: Fetched primary data is valid.
[2025-10-24T20:04:44.237615] [DEBUG] [LOCAL     ] MWA: Saving primary data.
[2025-10-24T20:04:44.238179] [FATAL] [LOCAL     ] MWA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:04:44.238283] [FATAL] [MAIN      ] MWA: Failed to save primary data.
[2025-10-24T20:04:44.238334] [WARN ] [MAIN      ] MWA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:04:44.238394] [INFO ] [LOCAL     ] MWA: Starting deletion of primary data.
[2025-10-24T20:04:44.238453] [DEBUG] [LOCAL     ] MWA: No primary data file found to delete.
[2025-10-24T20:04:44.238487] [INFO ] [LOCAL     ] MWA: Starting deletion of derivative data.
[2025-10-24T20:04:44.238680] [DEBUG] [LOCAL     ] MWA: Deleted derivative data file.
[2025-10-24T20:04:44.239062] [INFO ] [MAIN      ] Update Progress: 1438/2366 symbols completed. MWA took 53.6s. Estimated remaining: 1h 59m 11s. Rate: 7.8 symbols/min
[2025-10-24T20:04:44.426477] [INFO ] [REMOTE    ] MX: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T20:04:44.947709] [INFO ] [REMOTE    ] MX: Fetching primary data for 2025-10.
[2025-10-24T20:04:45.036188] [INFO ] [REMOTE    ] MYD: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T20:04:45.747683] [INFO ] [REMOTE    ] MYD: Fetching primary data for 2025-10.
[2025-10-24T20:04:46.105749] [INFO ] [REMOTE    ] MX: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T20:04:46.110071] [INFO ] [REMOTE    ] MX: Full fetch complete (31645 records).
[2025-10-24T20:04:46.110182] [DEBUG] [VALIDATOR ] MX: Validating primary data.
[2025-10-24T20:04:46.490037] [DEBUG] [VALIDATOR ] MX: All expected trading days are present.
[2025-10-24T20:04:46.490131] [DEBUG] [VALIDATOR ] MX: Primary data validation passed.
[2025-10-24T20:04:46.490877] [INFO ] [MAIN      ] MX: Fetched primary data is valid.
[2025-10-24T20:04:46.490941] [DEBUG] [LOCAL     ] MX: Saving primary data.
[2025-10-24T20:04:46.491412] [FATAL] [LOCAL     ] MX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:04:46.491498] [FATAL] [MAIN      ] MX: Failed to save primary data.
[2025-10-24T20:04:46.491541] [WARN ] [MAIN      ] MX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:04:46.491605] [INFO ] [LOCAL     ] MX: Starting deletion of primary data.
[2025-10-24T20:04:46.491694] [DEBUG] [LOCAL     ] MX: No primary data file found to delete.
[2025-10-24T20:04:46.491750] [INFO ] [LOCAL     ] MX: Starting deletion of derivative data.
[2025-10-24T20:04:46.491866] [DEBUG] [LOCAL     ] MX: Deleted derivative data file.
[2025-10-24T20:04:46.491946] [INFO ] [MAIN      ] Update Progress: 1439/2366 symbols completed. MX took 46.7s. Estimated remaining: 1h 59m 0s. Rate: 7.8 symbols/min
[2025-10-24T20:04:46.774577] [INFO ] [REMOTE    ] MYD: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T20:04:46.777714] [INFO ] [REMOTE    ] MYD: Full fetch complete (19975 records).
[2025-10-24T20:04:46.777820] [DEBUG] [VALIDATOR ] MYD: Validating primary data.
[2025-10-24T20:04:47.145280] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present.
[2025-10-24T20:04:47.145356] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed.
[2025-10-24T20:04:47.145789] [INFO ] [MAIN      ] MYD: Fetched primary data is valid.
[2025-10-24T20:04:47.145850] [DEBUG] [LOCAL     ] MYD: Saving primary data.
[2025-10-24T20:04:47.146134] [FATAL] [LOCAL     ] MYD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:04:47.146227] [FATAL] [MAIN      ] MYD: Failed to save primary data.
[2025-10-24T20:04:47.146269] [WARN ] [MAIN      ] MYD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:04:47.146303] [INFO ] [LOCAL     ] MYD: Starting deletion of primary data.
[2025-10-24T20:04:47.146352] [DEBUG] [LOCAL     ] MYD: No primary data file found to delete.
[2025-10-24T20:04:47.146386] [INFO ] [LOCAL     ] MYD: Starting deletion of derivative data.
[2025-10-24T20:04:47.146525] [DEBUG] [LOCAL     ] MYD: Deleted derivative data file.
[2025-10-24T20:04:47.146614] [INFO ] [MAIN      ] Update Progress: 1440/2366 symbols completed. MYD took 27.8s. Estimated remaining: 1h 58m 48s. Rate: 7.8 symbols/min
[2025-10-24T20:04:47.680563] [INFO ] [MAIN      ] MYE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:04:47.861799] [INFO ] [MAIN      ] NABL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:04:47.870834] [INFO ] [MAIN      ] MYN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:04:47.899826] [INFO ] [MAIN      ] MYI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:04:47.918393] [DEBUG] [LOCAL     ] MYN: Loaded 10063 existing records from primary storage.
[2025-10-24T20:04:47.918738] [INFO ] [MAIN      ] MYN: Loaded 10063 existing records.
[2025-10-24T20:04:47.967676] [DEBUG] [LOCAL     ] MYE: Loaded 24133 existing records from primary storage.
[2025-10-24T20:04:47.998924] [INFO ] [MAIN      ] MYE: Loaded 24133 existing records.
[2025-10-24T20:04:48.041959] [DEBUG] [LOCAL     ] MYI: Loaded 19487 existing records from primary storage.
[2025-10-24T20:04:48.072139] [INFO ] [MAIN      ] MYI: Loaded 19487 existing records.
[2025-10-24T20:04:48.177158] [DEBUG] [LOCAL     ] NABL: Loaded 39110 existing records from primary storage.
[2025-10-24T20:04:48.211010] [INFO ] [MAIN      ] NABL: Loaded 39110 existing records.
[2025-10-24T20:04:48.545131] [WARN ] [MAIN      ] MYN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:04:48.660328] [WARN ] [MAIN      ] MYE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:04:48.663386] [WARN ] [MAIN      ] MYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:04:48.673952] [INFO ] [MAIN      ] MYE: Wiping existing primary data before full refresh.
[2025-10-24T20:04:48.674181] [INFO ] [MAIN      ] MYN: Wiping existing primary data before full refresh.
[2025-10-24T20:04:48.693002] [INFO ] [MAIN      ] MYI: Wiping existing primary data before full refresh.
[2025-10-24T20:04:48.708146] [INFO ] [LOCAL     ] MYE: Starting deletion of primary data.
[2025-10-24T20:04:48.708089] [INFO ] [LOCAL     ] MYI: Starting deletion of primary data.
[2025-10-24T20:04:48.698356] [INFO ] [LOCAL     ] MYN: Starting deletion of primary data.
[2025-10-24T20:04:48.728295] [DEBUG] [LOCAL     ] MYE: Deleted primary data file.
[2025-10-24T20:04:48.731666] [INFO ] [MAIN      ] MYE: Starting full primary refresh.
[2025-10-24T20:04:48.731436] [WARN ] [MAIN      ] NABL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:04:48.731768] [DEBUG] [LOCAL     ] MYN: Deleted primary data file.
[2025-10-24T20:04:48.743001] [INFO ] [MAIN      ] MYN: Starting full primary refresh.
[2025-10-24T20:04:48.737077] [DEBUG] [LOCAL     ] MYI: Deleted primary data file.
[2025-10-24T20:04:48.763229] [INFO ] [MAIN      ] MYI: Starting full primary refresh.
[2025-10-24T20:04:48.806162] [INFO ] [MAIN      ] NABL: Wiping existing primary data before full refresh.
[2025-10-24T20:04:48.884388] [INFO ] [LOCAL     ] NABL: Starting deletion of primary data.
[2025-10-24T20:04:49.009408] [DEBUG] [LOCAL     ] NABL: Deleted primary data file.
[2025-10-24T20:04:49.009516] [INFO ] [MAIN      ] NABL: Starting full primary refresh.
[2025-10-24T20:04:50.033243] [INFO ] [REMOTE    ] MYN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:04:50.097229] [INFO ] [REMOTE    ] MYE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:04:50.121438] [INFO ] [REMOTE    ] MYE: Fetching primary data for 2025-01.
[2025-10-24T20:04:50.120863] [INFO ] [REMOTE    ] MYN: Fetching primary data for 2025-01.
[2025-10-24T20:04:50.179269] [INFO ] [REMOTE    ] MYI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:04:50.186100] [INFO ] [REMOTE    ] MYI: Fetching primary data for 2025-01.
[2025-10-24T20:04:50.238629] [INFO ] [REMOTE    ] NABL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:04:50.239433] [INFO ] [REMOTE    ] NABL: Fetching primary data for 2025-01.
[2025-10-24T20:04:51.111609] [INFO ] [REMOTE    ] MYN: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T20:04:51.114666] [INFO ] [REMOTE    ] MYN: Fetching primary data for 2025-02.
[2025-10-24T20:04:51.201565] [INFO ] [REMOTE    ] MYI: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T20:04:51.205943] [INFO ] [REMOTE    ] MYI: Fetching primary data for 2025-02.
[2025-10-24T20:04:51.336005] [INFO ] [REMOTE    ] MYE: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T20:04:51.347595] [INFO ] [REMOTE    ] MYE: Fetching primary data for 2025-02.
[2025-10-24T20:04:51.624425] [INFO ] [REMOTE    ] NABL: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T20:04:51.959582] [INFO ] [REMOTE    ] MYN: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T20:04:52.115322] [INFO ] [REMOTE    ] MYE: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T20:04:52.123436] [INFO ] [REMOTE    ] MYI: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T20:04:52.147616] [INFO ] [REMOTE    ] NABL: Fetching primary data for 2025-02.
[2025-10-24T20:04:52.947630] [INFO ] [REMOTE    ] MYE: Fetching primary data for 2025-03.
[2025-10-24T20:04:53.247178] [INFO ] [REMOTE    ] NABL: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T20:04:53.747748] [INFO ] [REMOTE    ] MYI: Fetching primary data for 2025-03.
[2025-10-24T20:04:54.379445] [INFO ] [REMOTE    ] MYE: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T20:04:54.547695] [INFO ] [REMOTE    ] MYE: Fetching primary data for 2025-04.
[2025-10-24T20:04:54.727824] [INFO ] [REMOTE    ] MYI: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T20:04:55.347709] [INFO ] [REMOTE    ] MYI: Fetching primary data for 2025-04.
[2025-10-24T20:04:56.147708] [INFO ] [REMOTE    ] NABL: Fetching primary data for 2025-03.
[2025-10-24T20:04:56.270963] [INFO ] [REMOTE    ] MYE: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T20:04:56.475269] [INFO ] [REMOTE    ] MYI: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T20:04:56.947755] [INFO ] [REMOTE    ] MYN: Fetching primary data for 2025-03.
[2025-10-24T20:04:57.668536] [INFO ] [REMOTE    ] NABL: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T20:04:57.719080] [INFO ] [REMOTE    ] MYN: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T20:04:57.747611] [INFO ] [REMOTE    ] MYN: Fetching primary data for 2025-04.
[2025-10-24T20:04:58.499265] [INFO ] [REMOTE    ] MYN: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T20:04:58.547618] [INFO ] [REMOTE    ] MYI: Fetching primary data for 2025-05.
[2025-10-24T20:04:59.347675] [INFO ] [REMOTE    ] MYE: Fetching primary data for 2025-05.
[2025-10-24T20:04:59.491290] [INFO ] [REMOTE    ] MYI: Incremental fetch complete for 2025-05 (0.94 seconds).
[2025-10-24T20:05:00.147710] [INFO ] [REMOTE    ] MYN: Fetching primary data for 2025-05.
[2025-10-24T20:05:00.361355] [INFO ] [REMOTE    ] MYE: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T20:05:00.876877] [INFO ] [REMOTE    ] MYN: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T20:05:00.947626] [INFO ] [REMOTE    ] MYE: Fetching primary data for 2025-06.
[2025-10-24T20:05:01.747721] [INFO ] [REMOTE    ] MYI: Fetching primary data for 2025-06.
[2025-10-24T20:05:02.220195] [INFO ] [REMOTE    ] MYE: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T20:05:02.547686] [INFO ] [REMOTE    ] NABL: Fetching primary data for 2025-04.
[2025-10-24T20:05:02.935474] [INFO ] [REMOTE    ] MYI: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T20:05:03.347700] [INFO ] [REMOTE    ] MYI: Fetching primary data for 2025-07.
[2025-10-24T20:05:04.152053] [INFO ] [REMOTE    ] MYE: Fetching primary data for 2025-07.
[2025-10-24T20:05:04.158339] [INFO ] [REMOTE    ] NABL: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T20:05:04.363955] [INFO ] [REMOTE    ] MYI: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T20:05:04.947675] [INFO ] [REMOTE    ] MYN: Fetching primary data for 2025-06.
[2025-10-24T20:05:05.445812] [INFO ] [REMOTE    ] MYE: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T20:05:05.747709] [INFO ] [REMOTE    ] MYE: Fetching primary data for 2025-08.
[2025-10-24T20:05:05.788099] [INFO ] [REMOTE    ] MYN: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T20:05:06.547666] [INFO ] [REMOTE    ] MYN: Fetching primary data for 2025-07.
[2025-10-24T20:05:06.716007] [INFO ] [REMOTE    ] MYE: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T20:05:07.347736] [INFO ] [REMOTE    ] MYI: Fetching primary data for 2025-08.
[2025-10-24T20:05:07.378338] [INFO ] [REMOTE    ] MYN: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T20:05:08.147743] [INFO ] [REMOTE    ] MYE: Fetching primary data for 2025-09.
[2025-10-24T20:05:08.350271] [INFO ] [REMOTE    ] MYI: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T20:05:08.952935] [INFO ] [REMOTE    ] MYN: Fetching primary data for 2025-08.
[2025-10-24T20:05:08.964235] [INFO ] [REMOTE    ] MYE: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T20:05:09.750968] [INFO ] [REMOTE    ] MYI: Fetching primary data for 2025-09.
[2025-10-24T20:05:09.754923] [INFO ] [REMOTE    ] MYN: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T20:05:10.547704] [INFO ] [REMOTE    ] MYN: Fetching primary data for 2025-09.
[2025-10-24T20:05:10.878015] [INFO ] [REMOTE    ] MYI: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T20:05:11.347687] [INFO ] [REMOTE    ] MYI: Fetching primary data for 2025-10.
[2025-10-24T20:05:11.404111] [INFO ] [REMOTE    ] MYN: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T20:05:12.147742] [INFO ] [REMOTE    ] MYN: Fetching primary data for 2025-10.
[2025-10-24T20:05:12.700210] [INFO ] [REMOTE    ] MYI: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T20:05:12.705396] [INFO ] [REMOTE    ] MYI: Full fetch complete (29119 records).
[2025-10-24T20:05:12.705565] [DEBUG] [VALIDATOR ] MYI: Validating primary data.
[2025-10-24T20:05:12.956069] [INFO ] [REMOTE    ] NABL: Fetching primary data for 2025-05.
[2025-10-24T20:05:13.101955] [INFO ] [REMOTE    ] MYN: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T20:05:13.112988] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present.
[2025-10-24T20:05:13.113522] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed.
[2025-10-24T20:05:13.115364] [INFO ] [REMOTE    ] MYN: Full fetch complete (14998 records).
[2025-10-24T20:05:13.115177] [INFO ] [MAIN      ] MYI: Fetched primary data is valid.
[2025-10-24T20:05:13.115621] [DEBUG] [LOCAL     ] MYI: Saving primary data.
[2025-10-24T20:05:13.115761] [DEBUG] [VALIDATOR ] MYN: Validating primary data.
[2025-10-24T20:05:13.116446] [FATAL] [LOCAL     ] MYI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:05:13.116688] [FATAL] [MAIN      ] MYI: Failed to save primary data.
[2025-10-24T20:05:13.136119] [WARN ] [MAIN      ] MYI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:05:13.196254] [INFO ] [LOCAL     ] MYI: Starting deletion of primary data.
[2025-10-24T20:05:13.214148] [DEBUG] [LOCAL     ] MYI: No primary data file found to delete.
[2025-10-24T20:05:13.236265] [INFO ] [LOCAL     ] MYI: Starting deletion of derivative data.
[2025-10-24T20:05:13.240094] [DEBUG] [LOCAL     ] MYI: Deleted derivative data file.
[2025-10-24T20:05:13.250974] [INFO ] [MAIN      ] Update Progress: 1441/2366 symbols completed. MYI took 26.1s. Estimated remaining: 1h 58m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:05:13.671983] [INFO ] [MAIN      ] NAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:05:13.733967] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present.
[2025-10-24T20:05:13.734067] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed.
[2025-10-24T20:05:13.734744] [INFO ] [MAIN      ] MYN: Fetched primary data is valid.
[2025-10-24T20:05:13.734808] [DEBUG] [LOCAL     ] MYN: Saving primary data.
[2025-10-24T20:05:13.735208] [FATAL] [LOCAL     ] MYN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:05:13.735502] [FATAL] [MAIN      ] MYN: Failed to save primary data.
[2025-10-24T20:05:13.735576] [WARN ] [MAIN      ] MYN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:05:13.735669] [INFO ] [LOCAL     ] MYN: Starting deletion of primary data.
[2025-10-24T20:05:13.735752] [DEBUG] [LOCAL     ] MYN: No primary data file found to delete.
[2025-10-24T20:05:13.735793] [INFO ] [LOCAL     ] MYN: Starting deletion of derivative data.
[2025-10-24T20:05:13.735939] [DEBUG] [LOCAL     ] MYN: Deleted derivative data file.
[2025-10-24T20:05:13.736040] [INFO ] [MAIN      ] Update Progress: 1442/2366 symbols completed. MYN took 26.6s. Estimated remaining: 1h 58m 40s. Rate: 7.8 symbols/min
[2025-10-24T20:05:13.752779] [INFO ] [REMOTE    ] MYE: Fetching primary data for 2025-10.
[2025-10-24T20:05:13.969194] [INFO ] [MAIN      ] NAD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:05:13.970178] [DEBUG] [LOCAL     ] NAC: Loaded 24674 existing records from primary storage.
[2025-10-24T20:05:13.971103] [INFO ] [MAIN      ] NAC: Loaded 24674 existing records.
[2025-10-24T20:05:14.194696] [WARN ] [MAIN      ] NAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:05:14.195142] [INFO ] [MAIN      ] NAC: Wiping existing primary data before full refresh.
[2025-10-24T20:05:14.195200] [INFO ] [LOCAL     ] NAC: Starting deletion of primary data.
[2025-10-24T20:05:14.195543] [DEBUG] [LOCAL     ] NAC: Deleted primary data file.
[2025-10-24T20:05:14.195583] [INFO ] [MAIN      ] NAC: Starting full primary refresh.
[2025-10-24T20:05:14.322376] [DEBUG] [LOCAL     ] NAD: Loaded 33735 existing records from primary storage.
[2025-10-24T20:05:14.338353] [INFO ] [MAIN      ] NAD: Loaded 33735 existing records.
[2025-10-24T20:05:14.781457] [WARN ] [MAIN      ] NAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:05:14.810984] [INFO ] [MAIN      ] NAD: Wiping existing primary data before full refresh.
[2025-10-24T20:05:14.811469] [INFO ] [LOCAL     ] NAD: Starting deletion of primary data.
[2025-10-24T20:05:14.817930] [DEBUG] [LOCAL     ] NAD: Deleted primary data file.
[2025-10-24T20:05:14.817856] [INFO ] [REMOTE    ] NAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:05:14.818067] [INFO ] [MAIN      ] NAD: Starting full primary refresh.
[2025-10-24T20:05:14.818731] [INFO ] [REMOTE    ] NAC: Fetching primary data for 2025-01.
[2025-10-24T20:05:15.234394] [INFO ] [REMOTE    ] NABL: Incremental fetch complete for 2025-05 (2.28 seconds).
[2025-10-24T20:05:15.236282] [INFO ] [REMOTE    ] MYE: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T20:05:15.293203] [INFO ] [REMOTE    ] MYE: Full fetch complete (35938 records).
[2025-10-24T20:05:15.295684] [INFO ] [REMOTE    ] NAD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:05:15.296860] [DEBUG] [VALIDATOR ] MYE: Validating primary data.
[2025-10-24T20:05:15.355402] [INFO ] [REMOTE    ] NAD: Fetching primary data for 2025-01.
[2025-10-24T20:05:15.685931] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present.
[2025-10-24T20:05:15.686033] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed.
[2025-10-24T20:05:15.687256] [INFO ] [MAIN      ] MYE: Fetched primary data is valid.
[2025-10-24T20:05:15.687322] [DEBUG] [LOCAL     ] MYE: Saving primary data.
[2025-10-24T20:05:15.687837] [FATAL] [LOCAL     ] MYE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:05:15.687981] [FATAL] [MAIN      ] MYE: Failed to save primary data.
[2025-10-24T20:05:15.688048] [WARN ] [MAIN      ] MYE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:05:15.688122] [INFO ] [LOCAL     ] MYE: Starting deletion of primary data.
[2025-10-24T20:05:15.688252] [DEBUG] [LOCAL     ] MYE: No primary data file found to delete.
[2025-10-24T20:05:15.688319] [INFO ] [LOCAL     ] MYE: Starting deletion of derivative data.
[2025-10-24T20:05:15.688559] [DEBUG] [LOCAL     ] MYE: Deleted derivative data file.
[2025-10-24T20:05:15.688707] [INFO ] [MAIN      ] Update Progress: 1443/2366 symbols completed. MYE took 28.5s. Estimated remaining: 1h 58m 28s. Rate: 7.8 symbols/min
[2025-10-24T20:05:15.873990] [INFO ] [MAIN      ] NAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:05:15.889938] [DEBUG] [LOCAL     ] NAN: Loaded 8556 existing records from primary storage.
[2025-10-24T20:05:15.890517] [INFO ] [MAIN      ] NAN: Loaded 8556 existing records.
[2025-10-24T20:05:15.989841] [INFO ] [REMOTE    ] NAC: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T20:05:16.110961] [WARN ] [MAIN      ] NAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:05:16.111272] [INFO ] [MAIN      ] NAN: Wiping existing primary data before full refresh.
[2025-10-24T20:05:16.111326] [INFO ] [LOCAL     ] NAN: Starting deletion of primary data.
[2025-10-24T20:05:16.111546] [DEBUG] [LOCAL     ] NAN: Deleted primary data file.
[2025-10-24T20:05:16.111586] [INFO ] [MAIN      ] NAN: Starting full primary refresh.
[2025-10-24T20:05:16.152896] [INFO ] [REMOTE    ] NABL: Fetching primary data for 2025-06.
[2025-10-24T20:05:16.494622] [INFO ] [REMOTE    ] NAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:05:16.899268] [INFO ] [REMOTE    ] NAD: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T20:05:16.947691] [INFO ] [REMOTE    ] NAD: Fetching primary data for 2025-02.
[2025-10-24T20:05:17.540536] [INFO ] [REMOTE    ] NABL: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T20:05:17.747725] [INFO ] [REMOTE    ] NABL: Fetching primary data for 2025-07.
[2025-10-24T20:05:18.212868] [INFO ] [REMOTE    ] NAD: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T20:05:18.547731] [INFO ] [REMOTE    ] NAN: Fetching primary data for 2025-01.
[2025-10-24T20:05:19.087685] [INFO ] [REMOTE    ] NABL: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T20:05:19.323056] [INFO ] [REMOTE    ] NAN: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T20:05:19.347631] [INFO ] [REMOTE    ] NAN: Fetching primary data for 2025-02.
[2025-10-24T20:05:20.138997] [INFO ] [REMOTE    ] NAN: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T20:05:20.147595] [INFO ] [REMOTE    ] NAN: Fetching primary data for 2025-03.
[2025-10-24T20:05:20.925257] [INFO ] [REMOTE    ] NAN: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T20:05:20.947671] [INFO ] [REMOTE    ] NAC: Fetching primary data for 2025-02.
[2025-10-24T20:05:21.747625] [INFO ] [REMOTE    ] NABL: Fetching primary data for 2025-08.
[2025-10-24T20:05:21.980254] [INFO ] [REMOTE    ] NAC: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T20:05:22.547714] [INFO ] [REMOTE    ] NAC: Fetching primary data for 2025-03.
[2025-10-24T20:05:23.000294] [INFO ] [REMOTE    ] NABL: Incremental fetch complete for 2025-08 (1.25 seconds).
[2025-10-24T20:05:23.347619] [INFO ] [REMOTE    ] NAN: Fetching primary data for 2025-04.
[2025-10-24T20:05:23.662895] [INFO ] [REMOTE    ] NAC: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T20:05:24.111281] [INFO ] [REMOTE    ] NAN: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T20:05:24.147608] [INFO ] [REMOTE    ] NAN: Fetching primary data for 2025-05.
[2025-10-24T20:05:24.874534] [INFO ] [REMOTE    ] NAN: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T20:05:24.947620] [INFO ] [REMOTE    ] NAC: Fetching primary data for 2025-04.
[2025-10-24T20:05:25.747620] [INFO ] [REMOTE    ] NAD: Fetching primary data for 2025-03.
[2025-10-24T20:05:25.866202] [INFO ] [REMOTE    ] NAC: Incremental fetch complete for 2025-04 (0.92 seconds).
[2025-10-24T20:05:26.547725] [INFO ] [REMOTE    ] NAC: Fetching primary data for 2025-05.
[2025-10-24T20:05:27.122867] [INFO ] [REMOTE    ] NAD: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T20:05:27.347715] [INFO ] [REMOTE    ] NAD: Fetching primary data for 2025-04.
[2025-10-24T20:05:27.622491] [INFO ] [REMOTE    ] NAC: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T20:05:28.147685] [INFO ] [REMOTE    ] NABL: Fetching primary data for 2025-09.
[2025-10-24T20:05:28.789193] [INFO ] [REMOTE    ] NAD: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T20:05:28.947708] [INFO ] [REMOTE    ] NAN: Fetching primary data for 2025-06.
[2025-10-24T20:05:29.472340] [INFO ] [REMOTE    ] NABL: Incremental fetch complete for 2025-09 (1.32 seconds).
[2025-10-24T20:05:29.475971] [INFO ] [REMOTE    ] NAN: Incremental fetch complete for 2025-06 (0.53 seconds).
[2025-10-24T20:05:29.747700] [INFO ] [REMOTE    ] NAD: Fetching primary data for 2025-05.
[2025-10-24T20:05:30.547663] [INFO ] [REMOTE    ] NABL: Fetching primary data for 2025-10.
[2025-10-24T20:05:31.194004] [INFO ] [REMOTE    ] NAD: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T20:05:31.347667] [INFO ] [REMOTE    ] NAD: Fetching primary data for 2025-06.
[2025-10-24T20:05:32.097712] [INFO ] [REMOTE    ] NABL: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T20:05:32.104309] [INFO ] [REMOTE    ] NABL: Full fetch complete (56795 records).
[2025-10-24T20:05:32.104414] [DEBUG] [VALIDATOR ] NABL: Validating primary data.
[2025-10-24T20:05:32.148955] [INFO ] [REMOTE    ] NAC: Fetching primary data for 2025-06.
[2025-10-24T20:05:32.511344] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present.
[2025-10-24T20:05:32.511420] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed.
[2025-10-24T20:05:32.512365] [INFO ] [MAIN      ] NABL: Fetched primary data is valid.
[2025-10-24T20:05:32.512426] [DEBUG] [LOCAL     ] NABL: Saving primary data.
[2025-10-24T20:05:32.512914] [FATAL] [LOCAL     ] NABL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:05:32.512998] [FATAL] [MAIN      ] NABL: Failed to save primary data.
[2025-10-24T20:05:32.513047] [WARN ] [MAIN      ] NABL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:05:32.513113] [INFO ] [LOCAL     ] NABL: Starting deletion of primary data.
[2025-10-24T20:05:32.513171] [DEBUG] [LOCAL     ] NABL: No primary data file found to delete.
[2025-10-24T20:05:32.513206] [INFO ] [LOCAL     ] NABL: Starting deletion of derivative data.
[2025-10-24T20:05:32.513334] [DEBUG] [LOCAL     ] NABL: Deleted derivative data file.
[2025-10-24T20:05:32.513425] [INFO ] [MAIN      ] Update Progress: 1444/2366 symbols completed. NABL took 45.4s. Estimated remaining: 1h 58m 26s. Rate: 7.8 symbols/min
[2025-10-24T20:05:32.659479] [INFO ] [REMOTE    ] NAD: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T20:05:32.708968] [INFO ] [MAIN      ] NAT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:05:32.760254] [DEBUG] [LOCAL     ] NAT: Loaded 49578 existing records from primary storage.
[2025-10-24T20:05:32.761560] [INFO ] [MAIN      ] NAT: Loaded 49578 existing records.
[2025-10-24T20:05:32.937891] [WARN ] [MAIN      ] NAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:05:32.938179] [INFO ] [MAIN      ] NAT: Wiping existing primary data before full refresh.
[2025-10-24T20:05:32.938238] [INFO ] [LOCAL     ] NAT: Starting deletion of primary data.
[2025-10-24T20:05:32.939129] [DEBUG] [LOCAL     ] NAT: Deleted primary data file.
[2025-10-24T20:05:32.939189] [INFO ] [MAIN      ] NAT: Starting full primary refresh.
[2025-10-24T20:05:32.952860] [INFO ] [REMOTE    ] NAN: Fetching primary data for 2025-07.
[2025-10-24T20:05:33.319569] [INFO ] [REMOTE    ] NAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:05:33.333819] [INFO ] [REMOTE    ] NAC: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T20:05:33.747708] [INFO ] [REMOTE    ] NAD: Fetching primary data for 2025-07.
[2025-10-24T20:05:33.784372] [INFO ] [REMOTE    ] NAN: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T20:05:34.547696] [INFO ] [REMOTE    ] NAT: Fetching primary data for 2025-01.
[2025-10-24T20:05:35.225954] [INFO ] [REMOTE    ] NAD: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T20:05:35.347670] [INFO ] [REMOTE    ] NAD: Fetching primary data for 2025-08.
[2025-10-24T20:05:36.148492] [INFO ] [REMOTE    ] NAC: Fetching primary data for 2025-07.
[2025-10-24T20:05:36.154221] [INFO ] [REMOTE    ] NAT: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T20:05:36.801329] [INFO ] [REMOTE    ] NAD: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T20:05:36.947694] [INFO ] [REMOTE    ] NAT: Fetching primary data for 2025-02.
[2025-10-24T20:05:37.293587] [INFO ] [REMOTE    ] NAC: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T20:05:37.747714] [INFO ] [REMOTE    ] NAD: Fetching primary data for 2025-09.
[2025-10-24T20:05:38.547718] [INFO ] [REMOTE    ] NAN: Fetching primary data for 2025-08.
[2025-10-24T20:05:38.643511] [INFO ] [REMOTE    ] NAT: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T20:05:39.030147] [INFO ] [REMOTE    ] NAD: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T20:05:39.265893] [INFO ] [REMOTE    ] NAN: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T20:05:39.347685] [INFO ] [REMOTE    ] NAN: Fetching primary data for 2025-09.
[2025-10-24T20:05:40.083158] [INFO ] [REMOTE    ] NAN: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T20:05:40.147675] [INFO ] [REMOTE    ] NAD: Fetching primary data for 2025-10.
[2025-10-24T20:05:40.947714] [INFO ] [REMOTE    ] NAT: Fetching primary data for 2025-03.
[2025-10-24T20:05:41.386961] [INFO ] [REMOTE    ] NAD: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T20:05:41.392707] [INFO ] [REMOTE    ] NAD: Full fetch complete (48394 records).
[2025-10-24T20:05:41.392826] [DEBUG] [VALIDATOR ] NAD: Validating primary data.
[2025-10-24T20:05:41.753770] [INFO ] [REMOTE    ] NAC: Fetching primary data for 2025-08.
[2025-10-24T20:05:41.772457] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present.
[2025-10-24T20:05:41.773202] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed.
[2025-10-24T20:05:41.774221] [INFO ] [MAIN      ] NAD: Fetched primary data is valid.
[2025-10-24T20:05:41.774403] [DEBUG] [LOCAL     ] NAD: Saving primary data.
[2025-10-24T20:05:41.774998] [FATAL] [LOCAL     ] NAD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:05:41.775083] [FATAL] [MAIN      ] NAD: Failed to save primary data.
[2025-10-24T20:05:41.775132] [WARN ] [MAIN      ] NAD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:05:41.775180] [INFO ] [LOCAL     ] NAD: Starting deletion of primary data.
[2025-10-24T20:05:41.775245] [DEBUG] [LOCAL     ] NAD: No primary data file found to delete.
[2025-10-24T20:05:41.775293] [INFO ] [LOCAL     ] NAD: Starting deletion of derivative data.
[2025-10-24T20:05:41.775473] [DEBUG] [LOCAL     ] NAD: Deleted derivative data file.
[2025-10-24T20:05:41.775587] [INFO ] [MAIN      ] Update Progress: 1445/2366 symbols completed. NAD took 28.0s. Estimated remaining: 1h 58m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:05:41.961157] [INFO ] [MAIN      ] NATL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:05:41.991463] [DEBUG] [LOCAL     ] NATL: Loaded 32261 existing records from primary storage.
[2025-10-24T20:05:41.991784] [INFO ] [MAIN      ] NATL: Loaded 32261 existing records.
[2025-10-24T20:05:42.177124] [WARN ] [MAIN      ] NATL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:05:42.177416] [INFO ] [MAIN      ] NATL: Wiping existing primary data before full refresh.
[2025-10-24T20:05:42.177490] [INFO ] [LOCAL     ] NATL: Starting deletion of primary data.
[2025-10-24T20:05:42.177813] [DEBUG] [LOCAL     ] NATL: Deleted primary data file.
[2025-10-24T20:05:42.177871] [INFO ] [MAIN      ] NATL: Starting full primary refresh.
[2025-10-24T20:05:42.546907] [INFO ] [REMOTE    ] NATL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:05:42.547606] [INFO ] [REMOTE    ] NATL: Fetching primary data for 2025-01.
[2025-10-24T20:05:42.577094] [INFO ] [REMOTE    ] NAT: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T20:05:42.608122] [INFO ] [REMOTE    ] NAC: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T20:05:43.347704] [INFO ] [REMOTE    ] NAT: Fetching primary data for 2025-04.
[2025-10-24T20:05:43.729934] [INFO ] [REMOTE    ] NATL: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T20:05:44.147684] [INFO ] [REMOTE    ] NAN: Fetching primary data for 2025-10.
[2025-10-24T20:05:44.947614] [INFO ] [REMOTE    ] NATL: Fetching primary data for 2025-02.
[2025-10-24T20:05:44.950041] [INFO ] [REMOTE    ] NAT: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T20:05:44.965697] [INFO ] [REMOTE    ] NAN: Incremental fetch complete for 2025-10 (0.82 seconds).
[2025-10-24T20:05:44.968170] [INFO ] [REMOTE    ] NAN: Full fetch complete (13592 records).
[2025-10-24T20:05:44.968364] [DEBUG] [VALIDATOR ] NAN: Validating primary data.
[2025-10-24T20:05:45.327002] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present.
[2025-10-24T20:05:45.327082] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed.
[2025-10-24T20:05:45.327400] [INFO ] [MAIN      ] NAN: Fetched primary data is valid.
[2025-10-24T20:05:45.327460] [DEBUG] [LOCAL     ] NAN: Saving primary data.
[2025-10-24T20:05:45.327697] [FATAL] [LOCAL     ] NAN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:05:45.327780] [FATAL] [MAIN      ] NAN: Failed to save primary data.
[2025-10-24T20:05:45.327821] [WARN ] [MAIN      ] NAN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:05:45.327854] [INFO ] [LOCAL     ] NAN: Starting deletion of primary data.
[2025-10-24T20:05:45.327901] [DEBUG] [LOCAL     ] NAN: No primary data file found to delete.
[2025-10-24T20:05:45.327936] [INFO ] [LOCAL     ] NAN: Starting deletion of derivative data.
[2025-10-24T20:05:45.328064] [DEBUG] [LOCAL     ] NAN: Deleted derivative data file.
[2025-10-24T20:05:45.328130] [INFO ] [MAIN      ] Update Progress: 1446/2366 symbols completed. NAN took 29.6s. Estimated remaining: 1h 58m 9s. Rate: 7.8 symbols/min
[2025-10-24T20:05:45.493620] [INFO ] [MAIN      ] NAZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:05:45.498672] [DEBUG] [LOCAL     ] NAZ: Loaded 2688 existing records from primary storage.
[2025-10-24T20:05:45.498826] [INFO ] [MAIN      ] NAZ: Loaded 2688 existing records.
[2025-10-24T20:05:45.675947] [WARN ] [MAIN      ] NAZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:05:45.676120] [INFO ] [MAIN      ] NAZ: Wiping existing primary data before full refresh.
[2025-10-24T20:05:45.676165] [INFO ] [LOCAL     ] NAZ: Starting deletion of primary data.
[2025-10-24T20:05:45.676287] [DEBUG] [LOCAL     ] NAZ: Deleted primary data file.
[2025-10-24T20:05:45.676324] [INFO ] [MAIN      ] NAZ: Starting full primary refresh.
[2025-10-24T20:05:45.750687] [INFO ] [REMOTE    ] NAC: Fetching primary data for 2025-09.
[2025-10-24T20:05:46.034930] [INFO ] [REMOTE    ] NAZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:05:46.047938] [INFO ] [REMOTE    ] NATL: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T20:05:46.547674] [INFO ] [REMOTE    ] NAT: Fetching primary data for 2025-05.
[2025-10-24T20:05:47.012305] [INFO ] [REMOTE    ] NAC: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T20:05:47.347720] [INFO ] [REMOTE    ] NATL: Fetching primary data for 2025-03.
[2025-10-24T20:05:48.147721] [INFO ] [REMOTE    ] NAC: Fetching primary data for 2025-10.
[2025-10-24T20:05:48.201602] [INFO ] [REMOTE    ] NAT: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T20:05:48.600676] [INFO ] [REMOTE    ] NATL: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T20:05:48.947682] [INFO ] [REMOTE    ] NAT: Fetching primary data for 2025-06.
[2025-10-24T20:05:49.495030] [INFO ] [REMOTE    ] NAC: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T20:05:49.500226] [INFO ] [REMOTE    ] NAC: Full fetch complete (35401 records).
[2025-10-24T20:05:49.500377] [DEBUG] [VALIDATOR ] NAC: Validating primary data.
[2025-10-24T20:05:49.758995] [INFO ] [REMOTE    ] NAZ: Fetching primary data for 2025-01.
[2025-10-24T20:05:49.881018] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present.
[2025-10-24T20:05:49.881092] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed.
[2025-10-24T20:05:49.881835] [INFO ] [MAIN      ] NAC: Fetched primary data is valid.
[2025-10-24T20:05:49.881896] [DEBUG] [LOCAL     ] NAC: Saving primary data.
[2025-10-24T20:05:49.882234] [FATAL] [LOCAL     ] NAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:05:49.882315] [FATAL] [MAIN      ] NAC: Failed to save primary data.
[2025-10-24T20:05:49.882356] [WARN ] [MAIN      ] NAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:05:49.882398] [INFO ] [LOCAL     ] NAC: Starting deletion of primary data.
[2025-10-24T20:05:49.882446] [DEBUG] [LOCAL     ] NAC: No primary data file found to delete.
[2025-10-24T20:05:49.882479] [INFO ] [LOCAL     ] NAC: Starting deletion of derivative data.
[2025-10-24T20:05:49.882608] [DEBUG] [LOCAL     ] NAC: Deleted derivative data file.
[2025-10-24T20:05:49.882732] [INFO ] [MAIN      ] Update Progress: 1447/2366 symbols completed. NAC took 36.6s. Estimated remaining: 1h 57m 60s. Rate: 7.8 symbols/min
[2025-10-24T20:05:50.048911] [INFO ] [MAIN      ] NBB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:05:50.061777] [DEBUG] [LOCAL     ] NBB: Loaded 9081 existing records from primary storage.
[2025-10-24T20:05:50.062011] [INFO ] [MAIN      ] NBB: Loaded 9081 existing records.
[2025-10-24T20:05:50.243466] [WARN ] [MAIN      ] NBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:05:50.243730] [INFO ] [MAIN      ] NBB: Wiping existing primary data before full refresh.
[2025-10-24T20:05:50.243784] [INFO ] [LOCAL     ] NBB: Starting deletion of primary data.
[2025-10-24T20:05:50.243942] [DEBUG] [LOCAL     ] NBB: Deleted primary data file.
[2025-10-24T20:05:50.243998] [INFO ] [MAIN      ] NBB: Starting full primary refresh.
[2025-10-24T20:05:50.352801] [INFO ] [REMOTE    ] NAZ: Incremental fetch complete for 2025-01 (0.59 seconds).
[2025-10-24T20:05:50.548164] [INFO ] [REMOTE    ] NAZ: Fetching primary data for 2025-02.
[2025-10-24T20:05:50.617730] [INFO ] [REMOTE    ] NBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:05:50.644630] [INFO ] [REMOTE    ] NAT: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T20:05:51.135092] [INFO ] [REMOTE    ] NAZ: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T20:05:51.347702] [INFO ] [REMOTE    ] NAZ: Fetching primary data for 2025-03.
[2025-10-24T20:05:51.893713] [INFO ] [REMOTE    ] NAZ: Incremental fetch complete for 2025-03 (0.55 seconds).
[2025-10-24T20:05:52.147672] [INFO ] [REMOTE    ] NATL: Fetching primary data for 2025-04.
[2025-10-24T20:05:52.947613] [INFO ] [REMOTE    ] NAZ: Fetching primary data for 2025-04.
[2025-10-24T20:05:53.384352] [INFO ] [REMOTE    ] NATL: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T20:05:53.479267] [INFO ] [REMOTE    ] NAZ: Incremental fetch complete for 2025-04 (0.53 seconds).
[2025-10-24T20:05:53.747695] [INFO ] [REMOTE    ] NATL: Fetching primary data for 2025-05.
[2025-10-24T20:05:54.547614] [INFO ] [REMOTE    ] NAT: Fetching primary data for 2025-07.
[2025-10-24T20:05:54.867971] [INFO ] [REMOTE    ] NATL: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T20:05:55.347680] [INFO ] [REMOTE    ] NAZ: Fetching primary data for 2025-05.
[2025-10-24T20:05:55.813213] [INFO ] [REMOTE    ] NAZ: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T20:05:56.092324] [INFO ] [REMOTE    ] NAT: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T20:05:56.147607] [INFO ] [REMOTE    ] NAT: Fetching primary data for 2025-08.
[2025-10-24T20:05:56.947669] [INFO ] [REMOTE    ] NAZ: Fetching primary data for 2025-06.
[2025-10-24T20:05:57.400718] [INFO ] [REMOTE    ] NAZ: Incremental fetch complete for 2025-06 (0.45 seconds).
[2025-10-24T20:05:57.652734] [INFO ] [REMOTE    ] NAT: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T20:05:57.747609] [INFO ] [REMOTE    ] NAZ: Fetching primary data for 2025-07.
[2025-10-24T20:05:58.318232] [INFO ] [REMOTE    ] NAZ: Incremental fetch complete for 2025-07 (0.57 seconds).
[2025-10-24T20:05:58.547668] [INFO ] [REMOTE    ] NAT: Fetching primary data for 2025-09.
[2025-10-24T20:05:59.347622] [INFO ] [REMOTE    ] NATL: Fetching primary data for 2025-06.
[2025-10-24T20:06:00.107286] [INFO ] [REMOTE    ] NAT: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T20:06:00.147603] [INFO ] [REMOTE    ] NAT: Fetching primary data for 2025-10.
[2025-10-24T20:06:00.447379] [INFO ] [REMOTE    ] NATL: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T20:06:00.947692] [INFO ] [REMOTE    ] NBB: Fetching primary data for 2025-01.
[2025-10-24T20:06:01.733276] [INFO ] [REMOTE    ] NBB: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T20:06:01.747613] [INFO ] [REMOTE    ] NBB: Fetching primary data for 2025-02.
[2025-10-24T20:06:01.969343] [INFO ] [REMOTE    ] NAT: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T20:06:01.978894] [INFO ] [REMOTE    ] NAT: Full fetch complete (72203 records).
[2025-10-24T20:06:01.979061] [DEBUG] [VALIDATOR ] NAT: Validating primary data.
[2025-10-24T20:06:02.300841] [INFO ] [REMOTE    ] NBB: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T20:06:02.385385] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present.
[2025-10-24T20:06:02.385466] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed.
[2025-10-24T20:06:02.386526] [INFO ] [MAIN      ] NAT: Fetched primary data is valid.
[2025-10-24T20:06:02.386588] [DEBUG] [LOCAL     ] NAT: Saving primary data.
[2025-10-24T20:06:02.387176] [FATAL] [LOCAL     ] NAT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:06:02.387285] [FATAL] [MAIN      ] NAT: Failed to save primary data.
[2025-10-24T20:06:02.387337] [WARN ] [MAIN      ] NAT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:06:02.387399] [INFO ] [LOCAL     ] NAT: Starting deletion of primary data.
[2025-10-24T20:06:02.387460] [DEBUG] [LOCAL     ] NAT: No primary data file found to delete.
[2025-10-24T20:06:02.387496] [INFO ] [LOCAL     ] NAT: Starting deletion of derivative data.
[2025-10-24T20:06:02.387630] [DEBUG] [LOCAL     ] NAT: Deleted derivative data file.
[2025-10-24T20:06:02.387990] [INFO ] [MAIN      ] Update Progress: 1448/2366 symbols completed. NAT took 29.9s. Estimated remaining: 1h 57m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:06:02.559515] [INFO ] [MAIN      ] NBHC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:06:02.549302] [INFO ] [REMOTE    ] NBB: Fetching primary data for 2025-03.
[2025-10-24T20:06:02.583232] [DEBUG] [LOCAL     ] NBHC: Loaded 23975 existing records from primary storage.
[2025-10-24T20:06:02.583504] [INFO ] [MAIN      ] NBHC: Loaded 23975 existing records.
[2025-10-24T20:06:02.758784] [WARN ] [MAIN      ] NBHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:06:02.758979] [INFO ] [MAIN      ] NBHC: Wiping existing primary data before full refresh.
[2025-10-24T20:06:02.759029] [INFO ] [LOCAL     ] NBHC: Starting deletion of primary data.
[2025-10-24T20:06:02.759230] [DEBUG] [LOCAL     ] NBHC: Deleted primary data file.
[2025-10-24T20:06:02.759268] [INFO ] [MAIN      ] NBHC: Starting full primary refresh.
[2025-10-24T20:06:03.105053] [INFO ] [REMOTE    ] NBHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:06:03.153363] [INFO ] [REMOTE    ] NBB: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T20:06:03.347622] [INFO ] [REMOTE    ] NBHC: Fetching primary data for 2025-01.
[2025-10-24T20:06:04.147723] [INFO ] [REMOTE    ] NATL: Fetching primary data for 2025-07.
[2025-10-24T20:06:04.401481] [INFO ] [REMOTE    ] NBHC: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T20:06:04.947720] [INFO ] [REMOTE    ] NAZ: Fetching primary data for 2025-08.
[2025-10-24T20:06:05.453994] [INFO ] [REMOTE    ] NATL: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T20:06:05.452790] [INFO ] [REMOTE    ] NAZ: Incremental fetch complete for 2025-08 (0.51 seconds).
[2025-10-24T20:06:05.747671] [INFO ] [REMOTE    ] NAZ: Fetching primary data for 2025-09.
[2025-10-24T20:06:06.325015] [INFO ] [REMOTE    ] NAZ: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T20:06:06.547731] [INFO ] [REMOTE    ] NBHC: Fetching primary data for 2025-02.
[2025-10-24T20:06:07.347707] [INFO ] [REMOTE    ] NBB: Fetching primary data for 2025-04.
[2025-10-24T20:06:07.572891] [INFO ] [REMOTE    ] NBHC: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T20:06:08.149020] [INFO ] [REMOTE    ] NAZ: Fetching primary data for 2025-10.
[2025-10-24T20:06:08.151034] [INFO ] [REMOTE    ] NBB: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T20:06:08.761740] [INFO ] [REMOTE    ] NAZ: Incremental fetch complete for 2025-10 (0.61 seconds).
[2025-10-24T20:06:08.762812] [INFO ] [REMOTE    ] NAZ: Full fetch complete (4075 records).
[2025-10-24T20:06:08.762883] [DEBUG] [VALIDATOR ] NAZ: Validating primary data.
[2025-10-24T20:06:08.954084] [INFO ] [REMOTE    ] NATL: Fetching primary data for 2025-08.
[2025-10-24T20:06:09.122985] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present.
[2025-10-24T20:06:09.123084] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed.
[2025-10-24T20:06:09.123239] [INFO ] [MAIN      ] NAZ: Fetched primary data is valid.
[2025-10-24T20:06:09.123298] [DEBUG] [LOCAL     ] NAZ: Saving primary data.
[2025-10-24T20:06:09.123475] [FATAL] [LOCAL     ] NAZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:06:09.123551] [FATAL] [MAIN      ] NAZ: Failed to save primary data.
[2025-10-24T20:06:09.123593] [WARN ] [MAIN      ] NAZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:06:09.123626] [INFO ] [LOCAL     ] NAZ: Starting deletion of primary data.
[2025-10-24T20:06:09.123710] [DEBUG] [LOCAL     ] NAZ: No primary data file found to delete.
[2025-10-24T20:06:09.123755] [INFO ] [LOCAL     ] NAZ: Starting deletion of derivative data.
[2025-10-24T20:06:09.123878] [DEBUG] [LOCAL     ] NAZ: Deleted derivative data file.
[2025-10-24T20:06:09.123962] [INFO ] [MAIN      ] Update Progress: 1449/2366 symbols completed. NAZ took 23.8s. Estimated remaining: 1h 57m 47s. Rate: 7.8 symbols/min
[2025-10-24T20:06:09.289470] [INFO ] [MAIN      ] NBR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:06:09.322859] [DEBUG] [LOCAL     ] NBR: Loaded 34642 existing records from primary storage.
[2025-10-24T20:06:09.323154] [INFO ] [MAIN      ] NBR: Loaded 34642 existing records.
[2025-10-24T20:06:09.500508] [WARN ] [MAIN      ] NBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:06:09.500740] [INFO ] [MAIN      ] NBR: Wiping existing primary data before full refresh.
[2025-10-24T20:06:09.500793] [INFO ] [LOCAL     ] NBR: Starting deletion of primary data.
[2025-10-24T20:06:09.501010] [DEBUG] [LOCAL     ] NBR: Deleted primary data file.
[2025-10-24T20:06:09.501049] [INFO ] [MAIN      ] NBR: Starting full primary refresh.
[2025-10-24T20:06:09.756402] [INFO ] [REMOTE    ] NBB: Fetching primary data for 2025-05.
[2025-10-24T20:06:09.861071] [INFO ] [REMOTE    ] NBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:06:10.394095] [INFO ] [REMOTE    ] NATL: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T20:06:10.503125] [INFO ] [REMOTE    ] NBB: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T20:06:10.547612] [INFO ] [REMOTE    ] NBB: Fetching primary data for 2025-06.
[2025-10-24T20:06:11.260942] [INFO ] [REMOTE    ] NBB: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T20:06:11.347683] [INFO ] [REMOTE    ] NBB: Fetching primary data for 2025-07.
[2025-10-24T20:06:11.881482] [INFO ] [REMOTE    ] NBB: Incremental fetch complete for 2025-07 (0.53 seconds).
[2025-10-24T20:06:12.147698] [INFO ] [REMOTE    ] NATL: Fetching primary data for 2025-09.
[2025-10-24T20:06:12.947739] [INFO ] [REMOTE    ] NBHC: Fetching primary data for 2025-03.
[2025-10-24T20:06:13.449423] [INFO ] [REMOTE    ] NATL: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T20:06:13.747695] [INFO ] [REMOTE    ] NBB: Fetching primary data for 2025-08.
[2025-10-24T20:06:14.028398] [INFO ] [REMOTE    ] NBHC: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T20:06:14.553082] [INFO ] [REMOTE    ] NBHC: Fetching primary data for 2025-04.
[2025-10-24T20:06:14.555567] [INFO ] [REMOTE    ] NBB: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T20:06:15.347744] [INFO ] [REMOTE    ] NBB: Fetching primary data for 2025-09.
[2025-10-24T20:06:15.808225] [INFO ] [REMOTE    ] NBHC: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T20:06:16.088634] [INFO ] [REMOTE    ] NBB: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T20:06:16.147714] [INFO ] [REMOTE    ] NATL: Fetching primary data for 2025-10.
[2025-10-24T20:06:16.947722] [INFO ] [REMOTE    ] NBR: Fetching primary data for 2025-01.
[2025-10-24T20:06:17.430027] [INFO ] [REMOTE    ] NATL: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T20:06:17.435712] [INFO ] [REMOTE    ] NATL: Full fetch complete (44844 records).
[2025-10-24T20:06:17.435823] [DEBUG] [VALIDATOR ] NATL: Validating primary data.
[2025-10-24T20:06:17.752933] [INFO ] [REMOTE    ] NBHC: Fetching primary data for 2025-05.
[2025-10-24T20:06:17.884107] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present.
[2025-10-24T20:06:17.884206] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed.
[2025-10-24T20:06:17.885154] [INFO ] [MAIN      ] NATL: Fetched primary data is valid.
[2025-10-24T20:06:17.885220] [DEBUG] [LOCAL     ] NATL: Saving primary data.
[2025-10-24T20:06:17.885797] [FATAL] [LOCAL     ] NATL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:06:17.885893] [FATAL] [MAIN      ] NATL: Failed to save primary data.
[2025-10-24T20:06:17.885935] [WARN ] [MAIN      ] NATL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:06:17.885970] [INFO ] [LOCAL     ] NATL: Starting deletion of primary data.
[2025-10-24T20:06:17.886023] [DEBUG] [LOCAL     ] NATL: No primary data file found to delete.
[2025-10-24T20:06:17.886059] [INFO ] [LOCAL     ] NATL: Starting deletion of derivative data.
[2025-10-24T20:06:17.886209] [DEBUG] [LOCAL     ] NATL: Deleted derivative data file.
[2025-10-24T20:06:17.886318] [INFO ] [MAIN      ] Update Progress: 1450/2366 symbols completed. NATL took 36.1s. Estimated remaining: 1h 57m 40s. Rate: 7.8 symbols/min
[2025-10-24T20:06:18.073081] [INFO ] [MAIN      ] NBXG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:06:18.096349] [DEBUG] [LOCAL     ] NBXG: Loaded 21773 existing records from primary storage.
[2025-10-24T20:06:18.096611] [INFO ] [MAIN      ] NBXG: Loaded 21773 existing records.
[2025-10-24T20:06:18.233218] [INFO ] [REMOTE    ] NBR: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T20:06:18.320976] [WARN ] [MAIN      ] NBXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:06:18.321221] [INFO ] [MAIN      ] NBXG: Wiping existing primary data before full refresh.
[2025-10-24T20:06:18.321270] [INFO ] [LOCAL     ] NBXG: Starting deletion of primary data.
[2025-10-24T20:06:18.321468] [DEBUG] [LOCAL     ] NBXG: Deleted primary data file.
[2025-10-24T20:06:18.321507] [INFO ] [MAIN      ] NBXG: Starting full primary refresh.
[2025-10-24T20:06:18.552816] [INFO ] [REMOTE    ] NBB: Fetching primary data for 2025-10.
[2025-10-24T20:06:18.617136] [INFO ] [REMOTE    ] NBHC: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T20:06:18.735964] [INFO ] [REMOTE    ] NBXG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:06:19.347753] [INFO ] [REMOTE    ] NBHC: Fetching primary data for 2025-06.
[2025-10-24T20:06:19.463690] [INFO ] [REMOTE    ] NBB: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T20:06:19.466532] [INFO ] [REMOTE    ] NBB: Full fetch complete (12919 records).
[2025-10-24T20:06:19.466634] [DEBUG] [VALIDATOR ] NBB: Validating primary data.
[2025-10-24T20:06:19.852811] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present.
[2025-10-24T20:06:19.852906] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed.
[2025-10-24T20:06:19.853291] [INFO ] [MAIN      ] NBB: Fetched primary data is valid.
[2025-10-24T20:06:19.853333] [DEBUG] [LOCAL     ] NBB: Saving primary data.
[2025-10-24T20:06:19.853558] [FATAL] [LOCAL     ] NBB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:06:19.853661] [FATAL] [MAIN      ] NBB: Failed to save primary data.
[2025-10-24T20:06:19.853720] [WARN ] [MAIN      ] NBB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:06:19.853764] [INFO ] [LOCAL     ] NBB: Starting deletion of primary data.
[2025-10-24T20:06:19.853826] [DEBUG] [LOCAL     ] NBB: No primary data file found to delete.
[2025-10-24T20:06:19.853884] [INFO ] [LOCAL     ] NBB: Starting deletion of derivative data.
[2025-10-24T20:06:19.854038] [DEBUG] [LOCAL     ] NBB: Deleted derivative data file.
[2025-10-24T20:06:19.854129] [INFO ] [MAIN      ] Update Progress: 1451/2366 symbols completed. NBB took 30.0s. Estimated remaining: 1h 57m 28s. Rate: 7.8 symbols/min
[2025-10-24T20:06:20.027819] [INFO ] [MAIN      ] NC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:06:20.033045] [DEBUG] [LOCAL     ] NC: Loaded 2009 existing records from primary storage.
[2025-10-24T20:06:20.033239] [INFO ] [MAIN      ] NC: Loaded 2009 existing records.
[2025-10-24T20:06:20.150537] [INFO ] [REMOTE    ] NBHC: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T20:06:20.147937] [INFO ] [REMOTE    ] NBXG: Fetching primary data for 2025-01.
[2025-10-24T20:06:20.239298] [WARN ] [MAIN      ] NC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:06:20.239521] [INFO ] [MAIN      ] NC: Wiping existing primary data before full refresh.
[2025-10-24T20:06:20.239571] [INFO ] [LOCAL     ] NC: Starting deletion of primary data.
[2025-10-24T20:06:20.239785] [DEBUG] [LOCAL     ] NC: Deleted primary data file.
[2025-10-24T20:06:20.239843] [INFO ] [MAIN      ] NC: Starting full primary refresh.
[2025-10-24T20:06:20.601166] [INFO ] [REMOTE    ] NC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:06:20.947699] [INFO ] [REMOTE    ] NBR: Fetching primary data for 2025-02.
[2025-10-24T20:06:21.264819] [INFO ] [REMOTE    ] NBXG: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T20:06:21.747603] [INFO ] [REMOTE    ] NBXG: Fetching primary data for 2025-02.
[2025-10-24T20:06:21.840722] [INFO ] [REMOTE    ] NBR: Incremental fetch complete for 2025-02 (0.89 seconds).
[2025-10-24T20:06:22.547631] [INFO ] [REMOTE    ] NBR: Fetching primary data for 2025-03.
[2025-10-24T20:06:22.749271] [INFO ] [REMOTE    ] NBXG: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T20:06:23.347684] [INFO ] [REMOTE    ] NBHC: Fetching primary data for 2025-07.
[2025-10-24T20:06:23.601038] [INFO ] [REMOTE    ] NBR: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T20:06:24.147620] [INFO ] [REMOTE    ] NBXG: Fetching primary data for 2025-03.
[2025-10-24T20:06:24.435876] [INFO ] [REMOTE    ] NBHC: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T20:06:24.947621] [INFO ] [REMOTE    ] NBHC: Fetching primary data for 2025-08.
[2025-10-24T20:06:25.221003] [INFO ] [REMOTE    ] NBXG: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T20:06:25.747626] [INFO ] [REMOTE    ] NBXG: Fetching primary data for 2025-04.
[2025-10-24T20:06:26.020243] [INFO ] [REMOTE    ] NBHC: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T20:06:26.547622] [INFO ] [REMOTE    ] NBHC: Fetching primary data for 2025-09.
[2025-10-24T20:06:26.770339] [INFO ] [REMOTE    ] NBXG: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T20:06:27.347714] [INFO ] [REMOTE    ] NBR: Fetching primary data for 2025-04.
[2025-10-24T20:06:27.691695] [INFO ] [REMOTE    ] NBHC: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T20:06:28.147702] [INFO ] [REMOTE    ] NBHC: Fetching primary data for 2025-10.
[2025-10-24T20:06:28.742027] [INFO ] [REMOTE    ] NBR: Incremental fetch complete for 2025-04 (1.39 seconds).
[2025-10-24T20:06:28.947632] [INFO ] [REMOTE    ] NBXG: Fetching primary data for 2025-05.
[2025-10-24T20:06:29.620289] [INFO ] [REMOTE    ] NBHC: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T20:06:29.626053] [INFO ] [REMOTE    ] NBHC: Full fetch complete (33463 records).
[2025-10-24T20:06:29.626151] [DEBUG] [VALIDATOR ] NBHC: Validating primary data.
[2025-10-24T20:06:29.752772] [INFO ] [REMOTE    ] NBR: Fetching primary data for 2025-05.
[2025-10-24T20:06:30.041473] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present.
[2025-10-24T20:06:30.041604] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed.
[2025-10-24T20:06:30.042835] [INFO ] [MAIN      ] NBHC: Fetched primary data is valid.
[2025-10-24T20:06:30.042905] [DEBUG] [LOCAL     ] NBHC: Saving primary data.
[2025-10-24T20:06:30.043481] [FATAL] [LOCAL     ] NBHC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:06:30.043564] [FATAL] [MAIN      ] NBHC: Failed to save primary data.
[2025-10-24T20:06:30.043634] [WARN ] [MAIN      ] NBHC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:06:30.043735] [INFO ] [LOCAL     ] NBHC: Starting deletion of primary data.
[2025-10-24T20:06:30.043802] [DEBUG] [LOCAL     ] NBHC: No primary data file found to delete.
[2025-10-24T20:06:30.043842] [INFO ] [LOCAL     ] NBHC: Starting deletion of derivative data.
[2025-10-24T20:06:30.043986] [DEBUG] [LOCAL     ] NBHC: Deleted derivative data file.
[2025-10-24T20:06:30.044080] [INFO ] [MAIN      ] Update Progress: 1452/2366 symbols completed. NBHC took 27.7s. Estimated remaining: 1h 57m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:06:30.192323] [INFO ] [REMOTE    ] NBXG: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T20:06:30.260536] [INFO ] [MAIN      ] NCA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:06:30.275520] [DEBUG] [LOCAL     ] NCA: Loaded 9801 existing records from primary storage.
[2025-10-24T20:06:30.275850] [INFO ] [MAIN      ] NCA: Loaded 9801 existing records.
[2025-10-24T20:06:30.460477] [WARN ] [MAIN      ] NCA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:06:30.460796] [INFO ] [MAIN      ] NCA: Wiping existing primary data before full refresh.
[2025-10-24T20:06:30.460861] [INFO ] [LOCAL     ] NCA: Starting deletion of primary data.
[2025-10-24T20:06:30.461110] [DEBUG] [LOCAL     ] NCA: Deleted primary data file.
[2025-10-24T20:06:30.461168] [INFO ] [MAIN      ] NCA: Starting full primary refresh.
[2025-10-24T20:06:30.552814] [INFO ] [REMOTE    ] NC: Fetching primary data for 2025-01.
[2025-10-24T20:06:30.849389] [INFO ] [REMOTE    ] NCA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:06:31.062258] [INFO ] [REMOTE    ] NC: Incremental fetch complete for 2025-01 (0.51 seconds).
[2025-10-24T20:06:31.129396] [INFO ] [REMOTE    ] NBR: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T20:06:31.347713] [INFO ] [REMOTE    ] NCA: Fetching primary data for 2025-01.
[2025-10-24T20:06:32.140819] [INFO ] [REMOTE    ] NCA: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T20:06:32.147591] [INFO ] [REMOTE    ] NCA: Fetching primary data for 2025-02.
[2025-10-24T20:06:32.860556] [INFO ] [REMOTE    ] NCA: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T20:06:32.947676] [INFO ] [REMOTE    ] NBR: Fetching primary data for 2025-06.
[2025-10-24T20:06:33.747673] [INFO ] [REMOTE    ] NBXG: Fetching primary data for 2025-06.
[2025-10-24T20:06:34.436197] [INFO ] [REMOTE    ] NBR: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T20:06:34.547720] [INFO ] [REMOTE    ] NBR: Fetching primary data for 2025-07.
[2025-10-24T20:06:34.848055] [INFO ] [REMOTE    ] NBXG: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T20:06:35.347728] [INFO ] [REMOTE    ] NBXG: Fetching primary data for 2025-07.
[2025-10-24T20:06:36.029398] [INFO ] [REMOTE    ] NBR: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T20:06:36.147721] [INFO ] [REMOTE    ] NBR: Fetching primary data for 2025-08.
[2025-10-24T20:06:36.418823] [INFO ] [REMOTE    ] NBXG: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T20:06:36.947694] [INFO ] [REMOTE    ] NC: Fetching primary data for 2025-02.
[2025-10-24T20:06:37.625667] [INFO ] [REMOTE    ] NC: Incremental fetch complete for 2025-02 (0.68 seconds).
[2025-10-24T20:06:37.647409] [INFO ] [REMOTE    ] NBR: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T20:06:37.747634] [INFO ] [REMOTE    ] NBR: Fetching primary data for 2025-09.
[2025-10-24T20:06:38.547702] [INFO ] [REMOTE    ] NC: Fetching primary data for 2025-03.
[2025-10-24T20:06:39.021114] [INFO ] [REMOTE    ] NC: Incremental fetch complete for 2025-03 (0.47 seconds).
[2025-10-24T20:06:39.088828] [INFO ] [REMOTE    ] NBR: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T20:06:39.347726] [INFO ] [REMOTE    ] NC: Fetching primary data for 2025-04.
[2025-10-24T20:06:39.949693] [INFO ] [REMOTE    ] NC: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T20:06:40.147726] [INFO ] [REMOTE    ] NBXG: Fetching primary data for 2025-08.
[2025-10-24T20:06:40.947701] [INFO ] [REMOTE    ] NC: Fetching primary data for 2025-05.
[2025-10-24T20:06:41.224701] [INFO ] [REMOTE    ] NBXG: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T20:06:41.380533] [INFO ] [REMOTE    ] NC: Incremental fetch complete for 2025-05 (0.43 seconds).
[2025-10-24T20:06:41.747637] [INFO ] [REMOTE    ] NC: Fetching primary data for 2025-06.
[2025-10-24T20:06:42.180408] [INFO ] [REMOTE    ] NC: Incremental fetch complete for 2025-06 (0.43 seconds).
[2025-10-24T20:06:42.547667] [INFO ] [REMOTE    ] NBR: Fetching primary data for 2025-10.
[2025-10-24T20:06:43.347683] [INFO ] [REMOTE    ] NC: Fetching primary data for 2025-07.
[2025-10-24T20:06:43.785201] [INFO ] [REMOTE    ] NC: Incremental fetch complete for 2025-07 (0.44 seconds).
[2025-10-24T20:06:43.786356] [INFO ] [REMOTE    ] NBR: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T20:06:43.793507] [INFO ] [REMOTE    ] NBR: Full fetch complete (49186 records).
[2025-10-24T20:06:43.793682] [DEBUG] [VALIDATOR ] NBR: Validating primary data.
[2025-10-24T20:06:44.154287] [INFO ] [REMOTE    ] NBXG: Fetching primary data for 2025-09.
[2025-10-24T20:06:44.188287] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present.
[2025-10-24T20:06:44.188404] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed.
[2025-10-24T20:06:44.189302] [INFO ] [MAIN      ] NBR: Fetched primary data is valid.
[2025-10-24T20:06:44.189363] [DEBUG] [LOCAL     ] NBR: Saving primary data.
[2025-10-24T20:06:44.189796] [FATAL] [LOCAL     ] NBR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:06:44.189891] [FATAL] [MAIN      ] NBR: Failed to save primary data.
[2025-10-24T20:06:44.189963] [WARN ] [MAIN      ] NBR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:06:44.190049] [INFO ] [LOCAL     ] NBR: Starting deletion of primary data.
[2025-10-24T20:06:44.190124] [DEBUG] [LOCAL     ] NBR: No primary data file found to delete.
[2025-10-24T20:06:44.190161] [INFO ] [LOCAL     ] NBR: Starting deletion of derivative data.
[2025-10-24T20:06:44.190279] [DEBUG] [LOCAL     ] NBR: Deleted derivative data file.
[2025-10-24T20:06:44.190371] [INFO ] [MAIN      ] Update Progress: 1453/2366 symbols completed. NBR took 35.1s. Estimated remaining: 1h 57m 18s. Rate: 7.8 symbols/min
[2025-10-24T20:06:44.359343] [INFO ] [MAIN      ] NCDL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:06:44.382265] [DEBUG] [LOCAL     ] NCDL: Loaded 21793 existing records from primary storage.
[2025-10-24T20:06:44.382505] [INFO ] [MAIN      ] NCDL: Loaded 21793 existing records.
[2025-10-24T20:06:44.563095] [WARN ] [MAIN      ] NCDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:06:44.563314] [INFO ] [MAIN      ] NCDL: Wiping existing primary data before full refresh.
[2025-10-24T20:06:44.563373] [INFO ] [LOCAL     ] NCDL: Starting deletion of primary data.
[2025-10-24T20:06:44.563556] [DEBUG] [LOCAL     ] NCDL: Deleted primary data file.
[2025-10-24T20:06:44.563610] [INFO ] [MAIN      ] NCDL: Starting full primary refresh.
[2025-10-24T20:06:44.917018] [INFO ] [REMOTE    ] NCDL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:06:44.947599] [INFO ] [REMOTE    ] NCDL: Fetching primary data for 2025-01.
[2025-10-24T20:06:45.196024] [INFO ] [REMOTE    ] NBXG: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T20:06:45.747674] [INFO ] [REMOTE    ] NCA: Fetching primary data for 2025-03.
[2025-10-24T20:06:46.015204] [INFO ] [REMOTE    ] NCDL: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T20:06:46.517781] [INFO ] [REMOTE    ] NCA: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T20:06:46.547599] [INFO ] [REMOTE    ] NCA: Fetching primary data for 2025-04.
[2025-10-24T20:06:47.347693] [INFO ] [REMOTE    ] NBXG: Fetching primary data for 2025-10.
[2025-10-24T20:06:47.437509] [INFO ] [REMOTE    ] NCA: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T20:06:48.147701] [INFO ] [REMOTE    ] NC: Fetching primary data for 2025-08.
[2025-10-24T20:06:48.438760] [INFO ] [REMOTE    ] NBXG: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T20:06:48.442732] [INFO ] [REMOTE    ] NBXG: Full fetch complete (32388 records).
[2025-10-24T20:06:48.442839] [DEBUG] [VALIDATOR ] NBXG: Validating primary data.
[2025-10-24T20:06:48.546140] [INFO ] [REMOTE    ] NC: Incremental fetch complete for 2025-08 (0.40 seconds).
[2025-10-24T20:06:48.819546] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present.
[2025-10-24T20:06:48.819619] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed.
[2025-10-24T20:06:48.820351] [INFO ] [MAIN      ] NBXG: Fetched primary data is valid.
[2025-10-24T20:06:48.820405] [DEBUG] [LOCAL     ] NBXG: Saving primary data.
[2025-10-24T20:06:48.820743] [FATAL] [LOCAL     ] NBXG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:06:48.820828] [FATAL] [MAIN      ] NBXG: Failed to save primary data.
[2025-10-24T20:06:48.820870] [WARN ] [MAIN      ] NBXG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:06:48.820905] [INFO ] [LOCAL     ] NBXG: Starting deletion of primary data.
[2025-10-24T20:06:48.820953] [DEBUG] [LOCAL     ] NBXG: No primary data file found to delete.
[2025-10-24T20:06:48.820989] [INFO ] [LOCAL     ] NBXG: Starting deletion of derivative data.
[2025-10-24T20:06:48.821140] [DEBUG] [LOCAL     ] NBXG: Deleted derivative data file.
[2025-10-24T20:06:48.821229] [INFO ] [MAIN      ] Update Progress: 1454/2366 symbols completed. NBXG took 30.9s. Estimated remaining: 1h 57m 9s. Rate: 7.8 symbols/min
[2025-10-24T20:06:48.963130] [INFO ] [REMOTE    ] NCDL: Fetching primary data for 2025-02.
[2025-10-24T20:06:48.993920] [INFO ] [MAIN      ] NCLH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:06:49.048550] [DEBUG] [LOCAL     ] NCLH: Loaded 54143 existing records from primary storage.
[2025-10-24T20:06:49.048892] [INFO ] [MAIN      ] NCLH: Loaded 54143 existing records.
[2025-10-24T20:06:49.231238] [WARN ] [MAIN      ] NCLH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:06:49.231440] [INFO ] [MAIN      ] NCLH: Wiping existing primary data before full refresh.
[2025-10-24T20:06:49.231485] [INFO ] [LOCAL     ] NCLH: Starting deletion of primary data.
[2025-10-24T20:06:49.232024] [DEBUG] [LOCAL     ] NCLH: Deleted primary data file.
[2025-10-24T20:06:49.232081] [INFO ] [MAIN      ] NCLH: Starting full primary refresh.
[2025-10-24T20:06:49.586598] [INFO ] [REMOTE    ] NCLH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:06:49.747608] [INFO ] [REMOTE    ] NCLH: Fetching primary data for 2025-01.
[2025-10-24T20:06:49.960806] [INFO ] [REMOTE    ] NCDL: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T20:06:50.547715] [INFO ] [REMOTE    ] NCA: Fetching primary data for 2025-05.
[2025-10-24T20:06:51.139331] [INFO ] [REMOTE    ] NCA: Incremental fetch complete for 2025-05 (0.59 seconds).
[2025-10-24T20:06:51.335201] [INFO ] [REMOTE    ] NCLH: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T20:06:51.347605] [INFO ] [REMOTE    ] NCLH: Fetching primary data for 2025-02.
[2025-10-24T20:06:52.147726] [INFO ] [REMOTE    ] NCA: Fetching primary data for 2025-06.
[2025-10-24T20:06:52.912235] [INFO ] [REMOTE    ] NCA: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T20:06:52.947614] [INFO ] [REMOTE    ] NCDL: Fetching primary data for 2025-03.
[2025-10-24T20:06:53.184012] [INFO ] [REMOTE    ] NCLH: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T20:06:53.747679] [INFO ] [REMOTE    ] NC: Fetching primary data for 2025-09.
[2025-10-24T20:06:54.155754] [INFO ] [REMOTE    ] NCDL: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T20:06:54.176732] [INFO ] [REMOTE    ] NC: Incremental fetch complete for 2025-09 (0.43 seconds).
[2025-10-24T20:06:54.547761] [INFO ] [REMOTE    ] NCLH: Fetching primary data for 2025-03.
[2025-10-24T20:06:55.347738] [INFO ] [REMOTE    ] NC: Fetching primary data for 2025-10.
[2025-10-24T20:06:55.915861] [INFO ] [REMOTE    ] NC: Incremental fetch complete for 2025-10 (0.57 seconds).
[2025-10-24T20:06:55.916878] [INFO ] [REMOTE    ] NC: Full fetch complete (2744 records).
[2025-10-24T20:06:55.916946] [DEBUG] [VALIDATOR ] NC: Validating primary data.
[2025-10-24T20:06:56.154305] [INFO ] [REMOTE    ] NCDL: Fetching primary data for 2025-04.
[2025-10-24T20:06:56.287113] [DEBUG] [VALIDATOR ] NC: All expected trading days are present.
[2025-10-24T20:06:56.287217] [DEBUG] [VALIDATOR ] NC: Primary data validation passed.
[2025-10-24T20:06:56.287395] [INFO ] [MAIN      ] NC: Fetched primary data is valid.
[2025-10-24T20:06:56.287542] [DEBUG] [LOCAL     ] NC: Saving primary data.
[2025-10-24T20:06:56.287839] [FATAL] [LOCAL     ] NC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:06:56.288006] [FATAL] [MAIN      ] NC: Failed to save primary data.
[2025-10-24T20:06:56.288079] [WARN ] [MAIN      ] NC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:06:56.288259] [INFO ] [LOCAL     ] NC: Starting deletion of primary data.
[2025-10-24T20:06:56.288355] [DEBUG] [LOCAL     ] NC: No primary data file found to delete.
[2025-10-24T20:06:56.288455] [INFO ] [LOCAL     ] NC: Starting deletion of derivative data.
[2025-10-24T20:06:56.288705] [DEBUG] [LOCAL     ] NC: Deleted derivative data file.
[2025-10-24T20:06:56.288797] [INFO ] [MAIN      ] Update Progress: 1455/2366 symbols completed. NC took 36.4s. Estimated remaining: 1h 57m 1s. Rate: 7.8 symbols/min
[2025-10-24T20:06:56.460132] [INFO ] [MAIN      ] NCV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:06:56.460378] [DEBUG] [LOCAL     ] NCV: No existing data file found in primary storage.
[2025-10-24T20:06:56.460447] [WARN ] [MAIN      ] NCV: No existing data found, performing full refresh instead.
[2025-10-24T20:06:56.460599] [INFO ] [MAIN      ] NCV: Wiping existing primary data before full refresh.
[2025-10-24T20:06:56.460701] [INFO ] [LOCAL     ] NCV: Starting deletion of primary data.
[2025-10-24T20:06:56.460819] [DEBUG] [LOCAL     ] NCV: No primary data file found to delete.
[2025-10-24T20:06:56.460891] [INFO ] [MAIN      ] NCV: Starting full primary refresh.
[2025-10-24T20:06:56.761826] [INFO ] [REMOTE    ] NCLH: Incremental fetch complete for 2025-03 (2.21 seconds).
[2025-10-24T20:06:56.874338] [INFO ] [REMOTE    ] NCV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:06:56.947604] [INFO ] [REMOTE    ] NCLH: Fetching primary data for 2025-04.
[2025-10-24T20:06:57.278054] [INFO ] [REMOTE    ] NCDL: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T20:06:57.747671] [INFO ] [REMOTE    ] NCV: Fetching primary data for 2025-01.
[2025-10-24T20:06:58.547710] [INFO ] [REMOTE    ] NCA: Fetching primary data for 2025-07.
[2025-10-24T20:06:58.856299] [INFO ] [REMOTE    ] NCV: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T20:06:59.030052] [INFO ] [REMOTE    ] NCLH: Incremental fetch complete for 2025-04 (2.08 seconds).
[2025-10-24T20:06:59.347637] [INFO ] [REMOTE    ] NCLH: Fetching primary data for 2025-05.
[2025-10-24T20:06:59.422446] [INFO ] [REMOTE    ] NCA: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T20:07:00.147713] [INFO ] [REMOTE    ] NCDL: Fetching primary data for 2025-05.
[2025-10-24T20:07:00.947676] [INFO ] [REMOTE    ] NCA: Fetching primary data for 2025-08.
[2025-10-24T20:07:01.367001] [INFO ] [REMOTE    ] NCDL: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T20:07:01.678199] [INFO ] [REMOTE    ] NCLH: Incremental fetch complete for 2025-05 (2.33 seconds).
[2025-10-24T20:07:01.747724] [INFO ] [REMOTE    ] NCLH: Fetching primary data for 2025-06.
[2025-10-24T20:07:02.134572] [INFO ] [REMOTE    ] NCA: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T20:07:02.547710] [INFO ] [REMOTE    ] NCV: Fetching primary data for 2025-02.
[2025-10-24T20:07:03.347681] [INFO ] [REMOTE    ] NCA: Fetching primary data for 2025-09.
[2025-10-24T20:07:03.620907] [INFO ] [REMOTE    ] NCV: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T20:07:03.806857] [INFO ] [REMOTE    ] NCLH: Incremental fetch complete for 2025-06 (2.06 seconds).
[2025-10-24T20:07:04.151466] [INFO ] [REMOTE    ] NCLH: Fetching primary data for 2025-07.
[2025-10-24T20:07:04.154438] [INFO ] [REMOTE    ] NCA: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T20:07:04.947757] [INFO ] [REMOTE    ] NCV: Fetching primary data for 2025-03.
[2025-10-24T20:07:05.747703] [INFO ] [REMOTE    ] NCA: Fetching primary data for 2025-10.
[2025-10-24T20:07:05.957448] [INFO ] [REMOTE    ] NCV: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T20:07:06.205820] [INFO ] [REMOTE    ] NCLH: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T20:07:06.530737] [INFO ] [REMOTE    ] NCA: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T20:07:06.532780] [INFO ] [REMOTE    ] NCA: Full fetch complete (14263 records).
[2025-10-24T20:07:06.532879] [DEBUG] [VALIDATOR ] NCA: Validating primary data.
[2025-10-24T20:07:06.555293] [INFO ] [REMOTE    ] NCDL: Fetching primary data for 2025-06.
[2025-10-24T20:07:06.922058] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present.
[2025-10-24T20:07:06.922165] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed.
[2025-10-24T20:07:06.922691] [INFO ] [MAIN      ] NCA: Fetched primary data is valid.
[2025-10-24T20:07:06.922757] [DEBUG] [LOCAL     ] NCA: Saving primary data.
[2025-10-24T20:07:06.923071] [FATAL] [LOCAL     ] NCA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:07:06.923168] [FATAL] [MAIN      ] NCA: Failed to save primary data.
[2025-10-24T20:07:06.923221] [WARN ] [MAIN      ] NCA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:07:06.923266] [INFO ] [LOCAL     ] NCA: Starting deletion of primary data.
[2025-10-24T20:07:06.923397] [DEBUG] [LOCAL     ] NCA: No primary data file found to delete.
[2025-10-24T20:07:06.923469] [INFO ] [LOCAL     ] NCA: Starting deletion of derivative data.
[2025-10-24T20:07:06.923714] [DEBUG] [LOCAL     ] NCA: Deleted derivative data file.
[2025-10-24T20:07:06.923833] [INFO ] [MAIN      ] Update Progress: 1456/2366 symbols completed. NCA took 36.9s. Estimated remaining: 1h 56m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:07:07.103744] [INFO ] [MAIN      ] NCZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:07:07.120767] [DEBUG] [LOCAL     ] NCZ: Loaded 12391 existing records from primary storage.
[2025-10-24T20:07:07.121077] [INFO ] [MAIN      ] NCZ: Loaded 12391 existing records.
[2025-10-24T20:07:07.309092] [WARN ] [MAIN      ] NCZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:07:07.309351] [INFO ] [MAIN      ] NCZ: Wiping existing primary data before full refresh.
[2025-10-24T20:07:07.309398] [INFO ] [LOCAL     ] NCZ: Starting deletion of primary data.
[2025-10-24T20:07:07.309669] [DEBUG] [LOCAL     ] NCZ: Deleted primary data file.
[2025-10-24T20:07:07.309748] [INFO ] [MAIN      ] NCZ: Starting full primary refresh.
[2025-10-24T20:07:07.353005] [INFO ] [REMOTE    ] NCV: Fetching primary data for 2025-04.
[2025-10-24T20:07:07.691351] [INFO ] [REMOTE    ] NCZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:07:07.759202] [INFO ] [REMOTE    ] NCDL: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T20:07:08.147713] [INFO ] [REMOTE    ] NCZ: Fetching primary data for 2025-01.
[2025-10-24T20:07:08.231331] [INFO ] [REMOTE    ] NCV: Incremental fetch complete for 2025-04 (0.88 seconds).
[2025-10-24T20:07:08.947757] [INFO ] [REMOTE    ] NCDL: Fetching primary data for 2025-07.
[2025-10-24T20:07:09.155124] [INFO ] [REMOTE    ] NCZ: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T20:07:09.747671] [INFO ] [REMOTE    ] NCV: Fetching primary data for 2025-05.
[2025-10-24T20:07:10.018785] [INFO ] [REMOTE    ] NCDL: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T20:07:10.555780] [INFO ] [REMOTE    ] NCZ: Fetching primary data for 2025-02.
[2025-10-24T20:07:10.558140] [INFO ] [REMOTE    ] NCV: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:07:11.347747] [INFO ] [REMOTE    ] NCLH: Fetching primary data for 2025-08.
[2025-10-24T20:07:11.455788] [INFO ] [REMOTE    ] NCZ: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T20:07:12.147758] [INFO ] [REMOTE    ] NCDL: Fetching primary data for 2025-08.
[2025-10-24T20:07:12.947674] [INFO ] [REMOTE    ] NCZ: Fetching primary data for 2025-03.
[2025-10-24T20:07:13.086776] [INFO ] [REMOTE    ] NCDL: Incremental fetch complete for 2025-08 (0.94 seconds).
[2025-10-24T20:07:13.086206] [INFO ] [REMOTE    ] NCLH: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T20:07:13.747635] [INFO ] [REMOTE    ] NCLH: Fetching primary data for 2025-09.
[2025-10-24T20:07:13.780316] [INFO ] [REMOTE    ] NCZ: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T20:07:14.547711] [INFO ] [REMOTE    ] NCZ: Fetching primary data for 2025-04.
[2025-10-24T20:07:15.347771] [INFO ] [REMOTE    ] NCDL: Fetching primary data for 2025-09.
[2025-10-24T20:07:15.534551] [INFO ] [REMOTE    ] NCZ: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T20:07:15.937358] [INFO ] [REMOTE    ] NCLH: Incremental fetch complete for 2025-09 (2.19 seconds).
[2025-10-24T20:07:16.147791] [INFO ] [REMOTE    ] NCV: Fetching primary data for 2025-06.
[2025-10-24T20:07:16.429959] [INFO ] [REMOTE    ] NCDL: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T20:07:16.667195] [INFO ] [REMOTE    ] NCV: Incremental fetch complete for 2025-06 (0.52 seconds).
[2025-10-24T20:07:16.947719] [INFO ] [REMOTE    ] NCLH: Fetching primary data for 2025-10.
[2025-10-24T20:07:17.747700] [INFO ] [REMOTE    ] NCDL: Fetching primary data for 2025-10.
[2025-10-24T20:07:18.547716] [INFO ] [REMOTE    ] NCV: Fetching primary data for 2025-07.
[2025-10-24T20:07:18.914091] [INFO ] [REMOTE    ] NCLH: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T20:07:18.933732] [INFO ] [REMOTE    ] NCLH: Full fetch complete (77933 records).
[2025-10-24T20:07:18.934009] [DEBUG] [VALIDATOR ] NCLH: Validating primary data.
[2025-10-24T20:07:19.332220] [INFO ] [REMOTE    ] NCDL: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T20:07:19.357791] [INFO ] [REMOTE    ] NCZ: Fetching primary data for 2025-05.
[2025-10-24T20:07:19.410208] [INFO ] [REMOTE    ] NCV: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T20:07:19.416687] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present.
[2025-10-24T20:07:19.416920] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed.
[2025-10-24T20:07:19.419846] [INFO ] [MAIN      ] NCLH: Fetched primary data is valid.
[2025-10-24T20:07:19.420362] [INFO ] [REMOTE    ] NCDL: Full fetch complete (32999 records).
[2025-10-24T20:07:19.420660] [DEBUG] [VALIDATOR ] NCDL: Validating primary data.
[2025-10-24T20:07:19.420528] [DEBUG] [LOCAL     ] NCLH: Saving primary data.
[2025-10-24T20:07:19.427316] [FATAL] [LOCAL     ] NCLH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:07:19.485968] [FATAL] [MAIN      ] NCLH: Failed to save primary data.
[2025-10-24T20:07:19.501694] [WARN ] [MAIN      ] NCLH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:07:19.512762] [INFO ] [LOCAL     ] NCLH: Starting deletion of primary data.
[2025-10-24T20:07:19.524418] [DEBUG] [LOCAL     ] NCLH: No primary data file found to delete.
[2025-10-24T20:07:19.524499] [INFO ] [LOCAL     ] NCLH: Starting deletion of derivative data.
[2025-10-24T20:07:19.535430] [DEBUG] [LOCAL     ] NCLH: Deleted derivative data file.
[2025-10-24T20:07:19.552209] [INFO ] [MAIN      ] Update Progress: 1457/2366 symbols completed. NCLH took 30.7s. Estimated remaining: 1h 56m 50s. Rate: 7.8 symbols/min
[2025-10-24T20:07:20.009156] [INFO ] [MAIN      ] NDMO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:07:20.061982] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present.
[2025-10-24T20:07:20.062095] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed.
[2025-10-24T20:07:20.063408] [INFO ] [MAIN      ] NCDL: Fetched primary data is valid.
[2025-10-24T20:07:20.063526] [DEBUG] [LOCAL     ] NCDL: Saving primary data.
[2025-10-24T20:07:20.064347] [FATAL] [LOCAL     ] NCDL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:07:20.070214] [FATAL] [MAIN      ] NCDL: Failed to save primary data.
[2025-10-24T20:07:20.070343] [WARN ] [MAIN      ] NCDL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:07:20.070419] [INFO ] [LOCAL     ] NCDL: Starting deletion of primary data.
[2025-10-24T20:07:20.070493] [DEBUG] [LOCAL     ] NCDL: No primary data file found to delete.
[2025-10-24T20:07:20.070533] [INFO ] [LOCAL     ] NCDL: Starting deletion of derivative data.
[2025-10-24T20:07:20.070771] [DEBUG] [LOCAL     ] NCDL: Deleted derivative data file.
[2025-10-24T20:07:20.070891] [INFO ] [MAIN      ] Update Progress: 1458/2366 symbols completed. NCDL took 35.9s. Estimated remaining: 1h 56m 38s. Rate: 7.8 symbols/min
[2025-10-24T20:07:20.148670] [INFO ] [REMOTE    ] NCV: Fetching primary data for 2025-08.
[2025-10-24T20:07:20.196228] [DEBUG] [LOCAL     ] NDMO: Loaded 17101 existing records from primary storage.
[2025-10-24T20:07:20.202756] [INFO ] [MAIN      ] NDMO: Loaded 17101 existing records.
[2025-10-24T20:07:20.376960] [INFO ] [MAIN      ] NE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:07:20.402253] [INFO ] [REMOTE    ] NCZ: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T20:07:20.498628] [WARN ] [MAIN      ] NDMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:07:20.499198] [INFO ] [MAIN      ] NDMO: Wiping existing primary data before full refresh.
[2025-10-24T20:07:20.499259] [INFO ] [LOCAL     ] NDMO: Starting deletion of primary data.
[2025-10-24T20:07:20.499479] [DEBUG] [LOCAL     ] NDMO: Deleted primary data file.
[2025-10-24T20:07:20.499522] [INFO ] [MAIN      ] NDMO: Starting full primary refresh.
[2025-10-24T20:07:20.794943] [DEBUG] [LOCAL     ] NE: Loaded 52682 existing records from primary storage.
[2025-10-24T20:07:20.834967] [INFO ] [MAIN      ] NE: Loaded 52682 existing records.
[2025-10-24T20:07:20.952592] [INFO ] [REMOTE    ] NCZ: Fetching primary data for 2025-06.
[2025-10-24T20:07:21.034279] [INFO ] [REMOTE    ] NDMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:07:21.130611] [WARN ] [MAIN      ] NE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:07:21.130982] [INFO ] [MAIN      ] NE: Wiping existing primary data before full refresh.
[2025-10-24T20:07:21.131095] [INFO ] [LOCAL     ] NE: Starting deletion of primary data.
[2025-10-24T20:07:21.137409] [DEBUG] [LOCAL     ] NE: Deleted primary data file.
[2025-10-24T20:07:21.137496] [INFO ] [MAIN      ] NE: Starting full primary refresh.
[2025-10-24T20:07:21.189348] [INFO ] [REMOTE    ] NCV: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T20:07:21.526068] [INFO ] [REMOTE    ] NE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:07:21.747712] [INFO ] [REMOTE    ] NCV: Fetching primary data for 2025-09.
[2025-10-24T20:07:21.856548] [INFO ] [REMOTE    ] NCZ: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T20:07:22.547675] [INFO ] [REMOTE    ] NE: Fetching primary data for 2025-01.
[2025-10-24T20:07:22.675618] [INFO ] [REMOTE    ] NCV: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T20:07:23.347715] [INFO ] [REMOTE    ] NCV: Fetching primary data for 2025-10.
[2025-10-24T20:07:24.089483] [INFO ] [REMOTE    ] NE: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T20:07:24.147671] [INFO ] [REMOTE    ] NE: Fetching primary data for 2025-02.
[2025-10-24T20:07:24.494861] [INFO ] [REMOTE    ] NCV: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T20:07:24.498892] [INFO ] [REMOTE    ] NCV: Full fetch complete (22516 records).
[2025-10-24T20:07:24.498993] [DEBUG] [VALIDATOR ] NCV: Validating primary data.
[2025-10-24T20:07:24.883254] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present.
[2025-10-24T20:07:24.883359] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed.
[2025-10-24T20:07:24.884286] [INFO ] [MAIN      ] NCV: Fetched primary data is valid.
[2025-10-24T20:07:24.884350] [DEBUG] [LOCAL     ] NCV: Saving primary data.
[2025-10-24T20:07:24.884773] [FATAL] [LOCAL     ] NCV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:07:24.884874] [FATAL] [MAIN      ] NCV: Failed to save primary data.
[2025-10-24T20:07:24.884934] [WARN ] [MAIN      ] NCV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:07:24.885008] [INFO ] [LOCAL     ] NCV: Starting deletion of primary data.
[2025-10-24T20:07:24.885081] [DEBUG] [LOCAL     ] NCV: No primary data file found to delete.
[2025-10-24T20:07:24.885119] [INFO ] [LOCAL     ] NCV: Starting deletion of derivative data.
[2025-10-24T20:07:24.885157] [DEBUG] [LOCAL     ] NCV: No derivative data file found to delete.
[2025-10-24T20:07:24.885222] [INFO ] [MAIN      ] Update Progress: 1459/2366 symbols completed. NCV took 28.6s. Estimated remaining: 1h 56m 29s. Rate: 7.8 symbols/min
[2025-10-24T20:07:24.952915] [INFO ] [REMOTE    ] NDMO: Fetching primary data for 2025-01.
[2025-10-24T20:07:25.072924] [INFO ] [MAIN      ] NEA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:07:25.118216] [DEBUG] [LOCAL     ] NEA: Loaded 35402 existing records from primary storage.
[2025-10-24T20:07:25.118584] [INFO ] [MAIN      ] NEA: Loaded 35402 existing records.
[2025-10-24T20:07:25.306706] [WARN ] [MAIN      ] NEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:07:25.307188] [INFO ] [MAIN      ] NEA: Wiping existing primary data before full refresh.
[2025-10-24T20:07:25.307292] [INFO ] [LOCAL     ] NEA: Starting deletion of primary data.
[2025-10-24T20:07:25.307967] [DEBUG] [LOCAL     ] NEA: Deleted primary data file.
[2025-10-24T20:07:25.308043] [INFO ] [MAIN      ] NEA: Starting full primary refresh.
[2025-10-24T20:07:25.691215] [INFO ] [REMOTE    ] NEA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:07:25.754331] [INFO ] [REMOTE    ] NCZ: Fetching primary data for 2025-07.
[2025-10-24T20:07:25.775464] [INFO ] [REMOTE    ] NE: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T20:07:25.883802] [INFO ] [REMOTE    ] NDMO: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T20:07:26.446710] [INFO ] [REMOTE    ] NCZ: Incremental fetch complete for 2025-07 (0.69 seconds).
[2025-10-24T20:07:26.547717] [INFO ] [REMOTE    ] NEA: Fetching primary data for 2025-01.
[2025-10-24T20:07:27.347763] [INFO ] [REMOTE    ] NDMO: Fetching primary data for 2025-02.
[2025-10-24T20:07:27.984940] [INFO ] [REMOTE    ] NEA: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T20:07:28.147637] [INFO ] [REMOTE    ] NEA: Fetching primary data for 2025-02.
[2025-10-24T20:07:28.187944] [INFO ] [REMOTE    ] NDMO: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T20:07:28.947751] [INFO ] [REMOTE    ] NCZ: Fetching primary data for 2025-08.
[2025-10-24T20:07:29.478250] [INFO ] [REMOTE    ] NEA: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T20:07:29.747734] [INFO ] [REMOTE    ] NEA: Fetching primary data for 2025-03.
[2025-10-24T20:07:29.773342] [INFO ] [REMOTE    ] NCZ: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T20:07:30.547745] [INFO ] [REMOTE    ] NE: Fetching primary data for 2025-03.
[2025-10-24T20:07:31.212628] [INFO ] [REMOTE    ] NEA: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T20:07:31.347722] [INFO ] [REMOTE    ] NDMO: Fetching primary data for 2025-03.
[2025-10-24T20:07:32.124965] [INFO ] [REMOTE    ] NDMO: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T20:07:32.147601] [INFO ] [REMOTE    ] NDMO: Fetching primary data for 2025-04.
[2025-10-24T20:07:32.412629] [INFO ] [REMOTE    ] NE: Incremental fetch complete for 2025-03 (1.86 seconds).
[2025-10-24T20:07:32.947615] [INFO ] [REMOTE    ] NEA: Fetching primary data for 2025-04.
[2025-10-24T20:07:33.186188] [INFO ] [REMOTE    ] NDMO: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T20:07:33.747675] [INFO ] [REMOTE    ] NDMO: Fetching primary data for 2025-05.
[2025-10-24T20:07:34.295143] [INFO ] [REMOTE    ] NEA: Incremental fetch complete for 2025-04 (1.35 seconds).
[2025-10-24T20:07:34.547683] [INFO ] [REMOTE    ] NCZ: Fetching primary data for 2025-09.
[2025-10-24T20:07:34.689730] [INFO ] [REMOTE    ] NDMO: Incremental fetch complete for 2025-05 (0.94 seconds).
[2025-10-24T20:07:35.347633] [INFO ] [REMOTE    ] NE: Fetching primary data for 2025-04.
[2025-10-24T20:07:35.827070] [INFO ] [REMOTE    ] NCZ: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T20:07:36.147724] [INFO ] [REMOTE    ] NCZ: Fetching primary data for 2025-10.
[2025-10-24T20:07:36.947707] [INFO ] [REMOTE    ] NDMO: Fetching primary data for 2025-06.
[2025-10-24T20:07:37.205718] [INFO ] [REMOTE    ] NCZ: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T20:07:37.209531] [INFO ] [REMOTE    ] NCZ: Full fetch complete (20854 records).
[2025-10-24T20:07:37.209706] [DEBUG] [VALIDATOR ] NCZ: Validating primary data.
[2025-10-24T20:07:37.444797] [INFO ] [REMOTE    ] NE: Incremental fetch complete for 2025-04 (2.10 seconds).
[2025-10-24T20:07:37.648702] [INFO ] [REMOTE    ] NDMO: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T20:07:37.661333] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present.
[2025-10-24T20:07:37.661424] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed.
[2025-10-24T20:07:37.662146] [INFO ] [MAIN      ] NCZ: Fetched primary data is valid.
[2025-10-24T20:07:37.662203] [DEBUG] [LOCAL     ] NCZ: Saving primary data.
[2025-10-24T20:07:37.662446] [FATAL] [LOCAL     ] NCZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:07:37.662539] [FATAL] [MAIN      ] NCZ: Failed to save primary data.
[2025-10-24T20:07:37.662580] [WARN ] [MAIN      ] NCZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:07:37.662615] [INFO ] [LOCAL     ] NCZ: Starting deletion of primary data.
[2025-10-24T20:07:37.662704] [DEBUG] [LOCAL     ] NCZ: No primary data file found to delete.
[2025-10-24T20:07:37.662757] [INFO ] [LOCAL     ] NCZ: Starting deletion of derivative data.
[2025-10-24T20:07:37.662879] [DEBUG] [LOCAL     ] NCZ: Deleted derivative data file.
[2025-10-24T20:07:37.662946] [INFO ] [MAIN      ] Update Progress: 1460/2366 symbols completed. NCZ took 30.7s. Estimated remaining: 1h 56m 24s. Rate: 7.8 symbols/min
[2025-10-24T20:07:37.752779] [INFO ] [REMOTE    ] NEA: Fetching primary data for 2025-05.
[2025-10-24T20:07:37.830385] [INFO ] [MAIN      ] NEE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:07:37.882487] [DEBUG] [LOCAL     ] NEE: Loaded 54097 existing records from primary storage.
[2025-10-24T20:07:37.882831] [INFO ] [MAIN      ] NEE: Loaded 54097 existing records.
[2025-10-24T20:07:38.056358] [WARN ] [MAIN      ] NEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:07:38.056563] [INFO ] [MAIN      ] NEE: Wiping existing primary data before full refresh.
[2025-10-24T20:07:38.056608] [INFO ] [LOCAL     ] NEE: Starting deletion of primary data.
[2025-10-24T20:07:38.057073] [DEBUG] [LOCAL     ] NEE: Deleted primary data file.
[2025-10-24T20:07:38.057128] [INFO ] [MAIN      ] NEE: Starting full primary refresh.
[2025-10-24T20:07:38.409120] [INFO ] [REMOTE    ] NEE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:07:38.547597] [INFO ] [REMOTE    ] NDMO: Fetching primary data for 2025-07.
[2025-10-24T20:07:39.118385] [INFO ] [REMOTE    ] NEA: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T20:07:39.347693] [INFO ] [REMOTE    ] NE: Fetching primary data for 2025-05.
[2025-10-24T20:07:39.603384] [INFO ] [REMOTE    ] NDMO: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T20:07:40.147636] [INFO ] [REMOTE    ] NEE: Fetching primary data for 2025-01.
[2025-10-24T20:07:40.844346] [INFO ] [REMOTE    ] NE: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T20:07:40.947710] [INFO ] [REMOTE    ] NE: Fetching primary data for 2025-06.
[2025-10-24T20:07:41.747622] [INFO ] [REMOTE    ] NEA: Fetching primary data for 2025-06.
[2025-10-24T20:07:42.158799] [INFO ] [REMOTE    ] NEE: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T20:07:42.547614] [INFO ] [REMOTE    ] NEE: Fetching primary data for 2025-02.
[2025-10-24T20:07:42.588259] [INFO ] [REMOTE    ] NE: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T20:07:42.720229] [INFO ] [REMOTE    ] NEA: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T20:07:43.347682] [INFO ] [REMOTE    ] NEA: Fetching primary data for 2025-07.
[2025-10-24T20:07:43.974854] [INFO ] [REMOTE    ] NEE: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T20:07:44.147614] [INFO ] [REMOTE    ] NDMO: Fetching primary data for 2025-08.
[2025-10-24T20:07:44.716905] [INFO ] [REMOTE    ] NEA: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T20:07:44.947636] [INFO ] [REMOTE    ] NE: Fetching primary data for 2025-07.
[2025-10-24T20:07:45.175095] [INFO ] [REMOTE    ] NDMO: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T20:07:45.747723] [INFO ] [REMOTE    ] NDMO: Fetching primary data for 2025-09.
[2025-10-24T20:07:46.547721] [INFO ] [REMOTE    ] NEA: Fetching primary data for 2025-08.
[2025-10-24T20:07:46.727195] [INFO ] [REMOTE    ] NE: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T20:07:46.751704] [INFO ] [REMOTE    ] NDMO: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T20:07:47.347636] [INFO ] [REMOTE    ] NE: Fetching primary data for 2025-08.
[2025-10-24T20:07:47.655032] [INFO ] [REMOTE    ] NEA: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T20:07:48.147625] [INFO ] [REMOTE    ] NDMO: Fetching primary data for 2025-10.
[2025-10-24T20:07:48.886381] [INFO ] [REMOTE    ] NDMO: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T20:07:48.889993] [INFO ] [REMOTE    ] NDMO: Full fetch complete (23318 records).
[2025-10-24T20:07:48.890229] [DEBUG] [VALIDATOR ] NDMO: Validating primary data.
[2025-10-24T20:07:48.972750] [INFO ] [REMOTE    ] NEA: Fetching primary data for 2025-09.
[2025-10-24T20:07:49.004255] [INFO ] [REMOTE    ] NE: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T20:07:49.295185] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present.
[2025-10-24T20:07:49.295262] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed.
[2025-10-24T20:07:49.295740] [INFO ] [MAIN      ] NDMO: Fetched primary data is valid.
[2025-10-24T20:07:49.295800] [DEBUG] [LOCAL     ] NDMO: Saving primary data.
[2025-10-24T20:07:49.296066] [FATAL] [LOCAL     ] NDMO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:07:49.296150] [FATAL] [MAIN      ] NDMO: Failed to save primary data.
[2025-10-24T20:07:49.296191] [WARN ] [MAIN      ] NDMO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:07:49.296253] [INFO ] [LOCAL     ] NDMO: Starting deletion of primary data.
[2025-10-24T20:07:49.296321] [DEBUG] [LOCAL     ] NDMO: No primary data file found to delete.
[2025-10-24T20:07:49.296374] [INFO ] [LOCAL     ] NDMO: Starting deletion of derivative data.
[2025-10-24T20:07:49.296702] [DEBUG] [LOCAL     ] NDMO: Deleted derivative data file.
[2025-10-24T20:07:49.296798] [INFO ] [MAIN      ] Update Progress: 1461/2366 symbols completed. NDMO took 29.7s. Estimated remaining: 1h 56m 19s. Rate: 7.8 symbols/min
[2025-10-24T20:07:49.466315] [INFO ] [MAIN      ] NEM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:07:49.517508] [DEBUG] [LOCAL     ] NEM: Loaded 54098 existing records from primary storage.
[2025-10-24T20:07:49.517882] [INFO ] [MAIN      ] NEM: Loaded 54098 existing records.
[2025-10-24T20:07:49.690770] [WARN ] [MAIN      ] NEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:07:49.690994] [INFO ] [MAIN      ] NEM: Wiping existing primary data before full refresh.
[2025-10-24T20:07:49.691038] [INFO ] [LOCAL     ] NEM: Starting deletion of primary data.
[2025-10-24T20:07:49.691332] [DEBUG] [LOCAL     ] NEM: Deleted primary data file.
[2025-10-24T20:07:49.691370] [INFO ] [MAIN      ] NEM: Starting full primary refresh.
[2025-10-24T20:07:49.753207] [INFO ] [REMOTE    ] NEE: Fetching primary data for 2025-03.
[2025-10-24T20:07:50.044083] [INFO ] [REMOTE    ] NEM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:07:50.356096] [INFO ] [REMOTE    ] NEA: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T20:07:50.547639] [INFO ] [REMOTE    ] NEA: Fetching primary data for 2025-10.
[2025-10-24T20:07:51.347717] [INFO ] [REMOTE    ] NE: Fetching primary data for 2025-09.
[2025-10-24T20:07:51.686634] [INFO ] [REMOTE    ] NEE: Incremental fetch complete for 2025-03 (1.93 seconds).
[2025-10-24T20:07:52.152798] [INFO ] [REMOTE    ] NEM: Fetching primary data for 2025-01.
[2025-10-24T20:07:52.155506] [INFO ] [REMOTE    ] NEA: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T20:07:52.162124] [INFO ] [REMOTE    ] NEA: Full fetch complete (50885 records).
[2025-10-24T20:07:52.162286] [DEBUG] [VALIDATOR ] NEA: Validating primary data.
[2025-10-24T20:07:52.539139] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present.
[2025-10-24T20:07:52.539223] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed.
[2025-10-24T20:07:52.540167] [INFO ] [MAIN      ] NEA: Fetched primary data is valid.
[2025-10-24T20:07:52.540227] [DEBUG] [LOCAL     ] NEA: Saving primary data.
[2025-10-24T20:07:52.540669] [FATAL] [LOCAL     ] NEA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:07:52.540751] [FATAL] [MAIN      ] NEA: Failed to save primary data.
[2025-10-24T20:07:52.540792] [WARN ] [MAIN      ] NEA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:07:52.540836] [INFO ] [LOCAL     ] NEA: Starting deletion of primary data.
[2025-10-24T20:07:52.540909] [DEBUG] [LOCAL     ] NEA: No primary data file found to delete.
[2025-10-24T20:07:52.540953] [INFO ] [LOCAL     ] NEA: Starting deletion of derivative data.
[2025-10-24T20:07:52.541092] [DEBUG] [LOCAL     ] NEA: Deleted derivative data file.
[2025-10-24T20:07:52.541183] [INFO ] [MAIN      ] Update Progress: 1462/2366 symbols completed. NEA took 27.7s. Estimated remaining: 1h 56m 8s. Rate: 7.8 symbols/min
[2025-10-24T20:07:52.709351] [INFO ] [MAIN      ] NET: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:07:52.762377] [DEBUG] [LOCAL     ] NET: Loaded 53162 existing records from primary storage.
[2025-10-24T20:07:52.762713] [INFO ] [MAIN      ] NET: Loaded 53162 existing records.
[2025-10-24T20:07:52.947763] [INFO ] [REMOTE    ] NEE: Fetching primary data for 2025-04.
[2025-10-24T20:07:52.947574] [WARN ] [MAIN      ] NET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:07:52.948244] [INFO ] [MAIN      ] NET: Wiping existing primary data before full refresh.
[2025-10-24T20:07:52.948316] [INFO ] [LOCAL     ] NET: Starting deletion of primary data.
[2025-10-24T20:07:52.949316] [DEBUG] [LOCAL     ] NET: Deleted primary data file.
[2025-10-24T20:07:52.949365] [INFO ] [MAIN      ] NET: Starting full primary refresh.
[2025-10-24T20:07:53.317751] [INFO ] [REMOTE    ] NET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:07:53.345829] [INFO ] [REMOTE    ] NE: Incremental fetch complete for 2025-09 (2.00 seconds).
[2025-10-24T20:07:53.747714] [INFO ] [REMOTE    ] NE: Fetching primary data for 2025-10.
[2025-10-24T20:07:54.235121] [INFO ] [REMOTE    ] NEM: Incremental fetch complete for 2025-01 (2.08 seconds).
[2025-10-24T20:07:54.547732] [INFO ] [REMOTE    ] NEM: Fetching primary data for 2025-02.
[2025-10-24T20:07:54.751604] [INFO ] [REMOTE    ] NEE: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T20:07:55.347716] [INFO ] [REMOTE    ] NEE: Fetching primary data for 2025-05.
[2025-10-24T20:07:55.646099] [INFO ] [REMOTE    ] NE: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T20:07:55.655752] [INFO ] [REMOTE    ] NE: Full fetch complete (75767 records).
[2025-10-24T20:07:55.655912] [DEBUG] [VALIDATOR ] NE: Validating primary data.
[2025-10-24T20:07:56.058775] [DEBUG] [VALIDATOR ] NE: All expected trading days are present.
[2025-10-24T20:07:56.058853] [DEBUG] [VALIDATOR ] NE: Primary data validation passed.
[2025-10-24T20:07:56.060012] [INFO ] [MAIN      ] NE: Fetched primary data is valid.
[2025-10-24T20:07:56.060076] [DEBUG] [LOCAL     ] NE: Saving primary data.
[2025-10-24T20:07:56.060716] [FATAL] [LOCAL     ] NE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:07:56.060804] [FATAL] [MAIN      ] NE: Failed to save primary data.
[2025-10-24T20:07:56.060847] [WARN ] [MAIN      ] NE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:07:56.060882] [INFO ] [LOCAL     ] NE: Starting deletion of primary data.
[2025-10-24T20:07:56.060934] [DEBUG] [LOCAL     ] NE: No primary data file found to delete.
[2025-10-24T20:07:56.060969] [INFO ] [LOCAL     ] NE: Starting deletion of derivative data.
[2025-10-24T20:07:56.061115] [DEBUG] [LOCAL     ] NE: Deleted derivative data file.
[2025-10-24T20:07:56.061675] [INFO ] [MAIN      ] Update Progress: 1463/2366 symbols completed. NE took 36.0s. Estimated remaining: 1h 55m 58s. Rate: 7.8 symbols/min
[2025-10-24T20:07:56.155360] [INFO ] [REMOTE    ] NET: Fetching primary data for 2025-01.
[2025-10-24T20:07:56.235635] [INFO ] [MAIN      ] NEU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:07:56.247868] [DEBUG] [LOCAL     ] NEU: Loaded 8671 existing records from primary storage.
[2025-10-24T20:07:56.248238] [INFO ] [MAIN      ] NEU: Loaded 8671 existing records.
[2025-10-24T20:07:56.433984] [WARN ] [MAIN      ] NEU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:07:56.434275] [INFO ] [MAIN      ] NEU: Wiping existing primary data before full refresh.
[2025-10-24T20:07:56.434399] [INFO ] [LOCAL     ] NEU: Starting deletion of primary data.
[2025-10-24T20:07:56.434595] [DEBUG] [LOCAL     ] NEU: Deleted primary data file.
[2025-10-24T20:07:56.434682] [INFO ] [MAIN      ] NEU: Starting full primary refresh.
[2025-10-24T20:07:56.642964] [INFO ] [REMOTE    ] NEM: Incremental fetch complete for 2025-02 (2.10 seconds).
[2025-10-24T20:07:56.838436] [INFO ] [REMOTE    ] NEU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:07:56.947610] [INFO ] [REMOTE    ] NEU: Fetching primary data for 2025-01.
[2025-10-24T20:07:57.262929] [INFO ] [REMOTE    ] NEE: Incremental fetch complete for 2025-05 (1.92 seconds).
[2025-10-24T20:07:57.674232] [INFO ] [REMOTE    ] NEU: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T20:07:57.747692] [INFO ] [REMOTE    ] NEM: Fetching primary data for 2025-03.
[2025-10-24T20:07:58.009857] [INFO ] [REMOTE    ] NET: Incremental fetch complete for 2025-01 (1.85 seconds).
[2025-10-24T20:07:58.547729] [INFO ] [REMOTE    ] NEU: Fetching primary data for 2025-02.
[2025-10-24T20:07:59.347764] [INFO ] [REMOTE    ] NET: Fetching primary data for 2025-02.
[2025-10-24T20:07:59.452214] [INFO ] [REMOTE    ] NEU: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T20:07:59.665931] [INFO ] [REMOTE    ] NEM: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T20:08:00.147682] [INFO ] [REMOTE    ] NEU: Fetching primary data for 2025-03.
[2025-10-24T20:08:00.881890] [INFO ] [REMOTE    ] NEU: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T20:08:00.947733] [INFO ] [REMOTE    ] NEU: Fetching primary data for 2025-04.
[2025-10-24T20:08:01.670633] [INFO ] [REMOTE    ] NET: Incremental fetch complete for 2025-02 (2.32 seconds).
[2025-10-24T20:08:01.733198] [INFO ] [REMOTE    ] NEU: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T20:08:01.747684] [INFO ] [REMOTE    ] NEE: Fetching primary data for 2025-06.
[2025-10-24T20:08:02.547679] [INFO ] [REMOTE    ] NEM: Fetching primary data for 2025-04.
[2025-10-24T20:08:03.347638] [INFO ] [REMOTE    ] NET: Fetching primary data for 2025-03.
[2025-10-24T20:08:03.626735] [INFO ] [REMOTE    ] NEE: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T20:08:04.147685] [INFO ] [REMOTE    ] NEU: Fetching primary data for 2025-05.
[2025-10-24T20:08:04.714714] [INFO ] [REMOTE    ] NEM: Incremental fetch complete for 2025-04 (2.17 seconds).
[2025-10-24T20:08:04.828338] [INFO ] [REMOTE    ] NEU: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T20:08:04.947708] [INFO ] [REMOTE    ] NEE: Fetching primary data for 2025-07.
[2025-10-24T20:08:05.244261] [INFO ] [REMOTE    ] NET: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T20:08:05.747754] [INFO ] [REMOTE    ] NEU: Fetching primary data for 2025-06.
[2025-10-24T20:08:06.547739] [INFO ] [REMOTE    ] NEM: Fetching primary data for 2025-05.
[2025-10-24T20:08:06.773847] [INFO ] [REMOTE    ] NEU: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T20:08:06.942245] [INFO ] [REMOTE    ] NEE: Incremental fetch complete for 2025-07 (1.99 seconds).
[2025-10-24T20:08:07.347671] [INFO ] [REMOTE    ] NEE: Fetching primary data for 2025-08.
[2025-10-24T20:08:08.147720] [INFO ] [REMOTE    ] NEU: Fetching primary data for 2025-07.
[2025-10-24T20:08:08.841164] [INFO ] [REMOTE    ] NEM: Incremental fetch complete for 2025-05 (2.29 seconds).
[2025-10-24T20:08:08.923361] [INFO ] [REMOTE    ] NEU: Incremental fetch complete for 2025-07 (0.78 seconds).
[2025-10-24T20:08:08.947680] [INFO ] [REMOTE    ] NEU: Fetching primary data for 2025-08.
[2025-10-24T20:08:09.025835] [INFO ] [REMOTE    ] NEE: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T20:08:09.440900] [INFO ] [REMOTE    ] NEU: Incremental fetch complete for 2025-08 (0.49 seconds).
[2025-10-24T20:08:09.747664] [INFO ] [REMOTE    ] NEE: Fetching primary data for 2025-09.
[2025-10-24T20:08:10.547685] [INFO ] [REMOTE    ] NET: Fetching primary data for 2025-04.
[2025-10-24T20:08:11.347746] [INFO ] [REMOTE    ] NEU: Fetching primary data for 2025-09.
[2025-10-24T20:08:12.019495] [INFO ] [REMOTE    ] NEE: Incremental fetch complete for 2025-09 (2.27 seconds).
[2025-10-24T20:08:12.132773] [INFO ] [REMOTE    ] NEU: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T20:08:12.147613] [INFO ] [REMOTE    ] NEU: Fetching primary data for 2025-10.
[2025-10-24T20:08:12.415181] [INFO ] [REMOTE    ] NET: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T20:08:12.947731] [INFO ] [REMOTE    ] NET: Fetching primary data for 2025-05.
[2025-10-24T20:08:12.981770] [INFO ] [REMOTE    ] NEU: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T20:08:12.983557] [INFO ] [REMOTE    ] NEU: Full fetch complete (10816 records).
[2025-10-24T20:08:12.983623] [DEBUG] [VALIDATOR ] NEU: Validating primary data.
[2025-10-24T20:08:13.337818] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present.
[2025-10-24T20:08:13.337902] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed.
[2025-10-24T20:08:13.338152] [INFO ] [MAIN      ] NEU: Fetched primary data is valid.
[2025-10-24T20:08:13.338190] [DEBUG] [LOCAL     ] NEU: Saving primary data.
[2025-10-24T20:08:13.338390] [FATAL] [LOCAL     ] NEU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:08:13.338468] [FATAL] [MAIN      ] NEU: Failed to save primary data.
[2025-10-24T20:08:13.338509] [WARN ] [MAIN      ] NEU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:08:13.338545] [INFO ] [LOCAL     ] NEU: Starting deletion of primary data.
[2025-10-24T20:08:13.338593] [DEBUG] [LOCAL     ] NEU: No primary data file found to delete.
[2025-10-24T20:08:13.338627] [INFO ] [LOCAL     ] NEU: Starting deletion of derivative data.
[2025-10-24T20:08:13.338811] [DEBUG] [LOCAL     ] NEU: Deleted derivative data file.
[2025-10-24T20:08:13.338895] [INFO ] [MAIN      ] Update Progress: 1464/2366 symbols completed. NEU took 17.3s. Estimated remaining: 1h 55m 56s. Rate: 7.8 symbols/min
[2025-10-24T20:08:13.504946] [INFO ] [MAIN      ] NEXA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:08:13.514122] [DEBUG] [LOCAL     ] NEXA: Loaded 5766 existing records from primary storage.
[2025-10-24T20:08:13.514347] [INFO ] [MAIN      ] NEXA: Loaded 5766 existing records.
[2025-10-24T20:08:13.690605] [WARN ] [MAIN      ] NEXA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:08:13.690837] [INFO ] [MAIN      ] NEXA: Wiping existing primary data before full refresh.
[2025-10-24T20:08:13.690884] [INFO ] [LOCAL     ] NEXA: Starting deletion of primary data.
[2025-10-24T20:08:13.691030] [DEBUG] [LOCAL     ] NEXA: Deleted primary data file.
[2025-10-24T20:08:13.691069] [INFO ] [MAIN      ] NEXA: Starting full primary refresh.
[2025-10-24T20:08:13.756831] [INFO ] [REMOTE    ] NEM: Fetching primary data for 2025-06.
[2025-10-24T20:08:14.049385] [INFO ] [REMOTE    ] NEXA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:08:14.547723] [INFO ] [REMOTE    ] NEE: Fetching primary data for 2025-10.
[2025-10-24T20:08:14.915455] [INFO ] [REMOTE    ] NET: Incremental fetch complete for 2025-05 (1.97 seconds).
[2025-10-24T20:08:15.347694] [INFO ] [REMOTE    ] NET: Fetching primary data for 2025-06.
[2025-10-24T20:08:15.779310] [INFO ] [REMOTE    ] NEM: Incremental fetch complete for 2025-06 (2.02 seconds).
[2025-10-24T20:08:16.147764] [INFO ] [REMOTE    ] NEXA: Fetching primary data for 2025-01.
[2025-10-24T20:08:16.889713] [INFO ] [REMOTE    ] NEE: Incremental fetch complete for 2025-10 (2.34 seconds).
[2025-10-24T20:08:16.899862] [INFO ] [REMOTE    ] NEE: Full fetch complete (77887 records).
[2025-10-24T20:08:16.900024] [DEBUG] [VALIDATOR ] NEE: Validating primary data.
[2025-10-24T20:08:16.956898] [INFO ] [REMOTE    ] NEM: Fetching primary data for 2025-07.
[2025-10-24T20:08:17.020274] [INFO ] [REMOTE    ] NEXA: Incremental fetch complete for 2025-01 (0.87 seconds).
[2025-10-24T20:08:17.319300] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present.
[2025-10-24T20:08:17.319401] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed.
[2025-10-24T20:08:17.320503] [INFO ] [MAIN      ] NEE: Fetched primary data is valid.
[2025-10-24T20:08:17.320578] [DEBUG] [LOCAL     ] NEE: Saving primary data.
[2025-10-24T20:08:17.321368] [FATAL] [LOCAL     ] NEE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:08:17.321508] [FATAL] [MAIN      ] NEE: Failed to save primary data.
[2025-10-24T20:08:17.321575] [WARN ] [MAIN      ] NEE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:08:17.321664] [INFO ] [LOCAL     ] NEE: Starting deletion of primary data.
[2025-10-24T20:08:17.321742] [DEBUG] [LOCAL     ] NEE: No primary data file found to delete.
[2025-10-24T20:08:17.321781] [INFO ] [LOCAL     ] NEE: Starting deletion of derivative data.
[2025-10-24T20:08:17.321887] [DEBUG] [LOCAL     ] NEE: Deleted derivative data file.
[2025-10-24T20:08:17.322347] [INFO ] [MAIN      ] Update Progress: 1465/2366 symbols completed. NEE took 39.7s. Estimated remaining: 1h 55m 46s. Rate: 7.8 symbols/min
[2025-10-24T20:08:17.493459] [INFO ] [MAIN      ] NFG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:08:17.522875] [INFO ] [REMOTE    ] NET: Incremental fetch complete for 2025-06 (2.18 seconds).
[2025-10-24T20:08:17.564176] [DEBUG] [LOCAL     ] NFG: Loaded 38484 existing records from primary storage.
[2025-10-24T20:08:17.564439] [INFO ] [MAIN      ] NFG: Loaded 38484 existing records.
[2025-10-24T20:08:17.741797] [WARN ] [MAIN      ] NFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:08:17.741991] [INFO ] [MAIN      ] NFG: Wiping existing primary data before full refresh.
[2025-10-24T20:08:17.742037] [INFO ] [LOCAL     ] NFG: Starting deletion of primary data.
[2025-10-24T20:08:17.742308] [DEBUG] [LOCAL     ] NFG: Deleted primary data file.
[2025-10-24T20:08:17.742373] [INFO ] [MAIN      ] NFG: Starting full primary refresh.
[2025-10-24T20:08:17.753803] [INFO ] [REMOTE    ] NET: Fetching primary data for 2025-07.
[2025-10-24T20:08:18.118626] [INFO ] [REMOTE    ] NFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:08:18.547695] [INFO ] [REMOTE    ] NEXA: Fetching primary data for 2025-02.
[2025-10-24T20:08:19.064566] [INFO ] [REMOTE    ] NEM: Incremental fetch complete for 2025-07 (2.11 seconds).
[2025-10-24T20:08:19.118677] [INFO ] [REMOTE    ] NEXA: Incremental fetch complete for 2025-02 (0.57 seconds).
[2025-10-24T20:08:19.347721] [INFO ] [REMOTE    ] NEXA: Fetching primary data for 2025-03.
[2025-10-24T20:08:19.853529] [INFO ] [REMOTE    ] NEXA: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T20:08:20.147631] [INFO ] [REMOTE    ] NEXA: Fetching primary data for 2025-04.
[2025-10-24T20:08:20.220994] [INFO ] [REMOTE    ] NET: Incremental fetch complete for 2025-07 (2.47 seconds).
[2025-10-24T20:08:20.553887] [INFO ] [REMOTE    ] NEXA: Incremental fetch complete for 2025-04 (0.41 seconds).
[2025-10-24T20:08:20.947698] [INFO ] [REMOTE    ] NEM: Fetching primary data for 2025-08.
[2025-10-24T20:08:21.747678] [INFO ] [REMOTE    ] NFG: Fetching primary data for 2025-01.
[2025-10-24T20:08:22.547680] [INFO ] [REMOTE    ] NEXA: Fetching primary data for 2025-05.
[2025-10-24T20:08:22.877515] [INFO ] [REMOTE    ] NEM: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T20:08:22.894947] [INFO ] [REMOTE    ] NEXA: Incremental fetch complete for 2025-05 (0.35 seconds).
[2025-10-24T20:08:23.336462] [INFO ] [REMOTE    ] NFG: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T20:08:23.347599] [INFO ] [REMOTE    ] NFG: Fetching primary data for 2025-02.
[2025-10-24T20:08:24.147735] [INFO ] [REMOTE    ] NEM: Fetching primary data for 2025-09.
[2025-10-24T20:08:24.439280] [INFO ] [REMOTE    ] NFG: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T20:08:24.947905] [INFO ] [REMOTE    ] NET: Fetching primary data for 2025-08.
[2025-10-24T20:08:25.748039] [INFO ] [REMOTE    ] NEXA: Fetching primary data for 2025-06.
[2025-10-24T20:08:25.806177] [INFO ] [REMOTE    ] NEM: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T20:08:26.317710] [INFO ] [REMOTE    ] NEXA: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T20:08:26.547717] [INFO ] [REMOTE    ] NEXA: Fetching primary data for 2025-07.
[2025-10-24T20:08:27.055106] [INFO ] [REMOTE    ] NET: Incremental fetch complete for 2025-08 (2.11 seconds).
[2025-10-24T20:08:27.152206] [INFO ] [REMOTE    ] NEXA: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T20:08:27.347727] [INFO ] [REMOTE    ] NEXA: Fetching primary data for 2025-08.
[2025-10-24T20:08:27.758162] [INFO ] [REMOTE    ] NEXA: Incremental fetch complete for 2025-08 (0.41 seconds).
[2025-10-24T20:08:28.147631] [INFO ] [REMOTE    ] NEXA: Fetching primary data for 2025-09.
[2025-10-24T20:08:28.915988] [INFO ] [REMOTE    ] NEXA: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T20:08:28.947633] [INFO ] [REMOTE    ] NEXA: Fetching primary data for 2025-10.
[2025-10-24T20:08:29.747713] [INFO ] [REMOTE    ] NET: Fetching primary data for 2025-09.
[2025-10-24T20:08:29.928265] [INFO ] [REMOTE    ] NEXA: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T20:08:29.932814] [INFO ] [REMOTE    ] NEXA: Full fetch complete (8055 records).
[2025-10-24T20:08:29.932936] [DEBUG] [VALIDATOR ] NEXA: Validating primary data.
[2025-10-24T20:08:30.298766] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present.
[2025-10-24T20:08:30.298850] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed.
[2025-10-24T20:08:30.299051] [INFO ] [MAIN      ] NEXA: Fetched primary data is valid.
[2025-10-24T20:08:30.299092] [DEBUG] [LOCAL     ] NEXA: Saving primary data.
[2025-10-24T20:08:30.299298] [FATAL] [LOCAL     ] NEXA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:08:30.299379] [FATAL] [MAIN      ] NEXA: Failed to save primary data.
[2025-10-24T20:08:30.299422] [WARN ] [MAIN      ] NEXA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:08:30.299461] [INFO ] [LOCAL     ] NEXA: Starting deletion of primary data.
[2025-10-24T20:08:30.299521] [DEBUG] [LOCAL     ] NEXA: No primary data file found to delete.
[2025-10-24T20:08:30.299564] [INFO ] [LOCAL     ] NEXA: Starting deletion of derivative data.
[2025-10-24T20:08:30.299721] [DEBUG] [LOCAL     ] NEXA: Deleted derivative data file.
[2025-10-24T20:08:30.299809] [INFO ] [MAIN      ] Update Progress: 1466/2366 symbols completed. NEXA took 17.0s. Estimated remaining: 1h 55m 42s. Rate: 7.8 symbols/min
[2025-10-24T20:08:30.473565] [INFO ] [MAIN      ] NFJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:08:30.495224] [DEBUG] [LOCAL     ] NFJ: Loaded 19799 existing records from primary storage.
[2025-10-24T20:08:30.495480] [INFO ] [MAIN      ] NFJ: Loaded 19799 existing records.
[2025-10-24T20:08:30.560411] [INFO ] [REMOTE    ] NEM: Fetching primary data for 2025-10.
[2025-10-24T20:08:30.678207] [WARN ] [MAIN      ] NFJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:08:30.678395] [INFO ] [MAIN      ] NFJ: Wiping existing primary data before full refresh.
[2025-10-24T20:08:30.678444] [INFO ] [LOCAL     ] NFJ: Starting deletion of primary data.
[2025-10-24T20:08:30.678792] [DEBUG] [LOCAL     ] NFJ: Deleted primary data file.
[2025-10-24T20:08:30.678850] [INFO ] [MAIN      ] NFJ: Starting full primary refresh.
[2025-10-24T20:08:31.033601] [INFO ] [REMOTE    ] NFJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:08:31.347675] [INFO ] [REMOTE    ] NFJ: Fetching primary data for 2025-01.
[2025-10-24T20:08:31.708551] [INFO ] [REMOTE    ] NET: Incremental fetch complete for 2025-09 (1.96 seconds).
[2025-10-24T20:08:32.147724] [INFO ] [REMOTE    ] NET: Fetching primary data for 2025-10.
[2025-10-24T20:08:32.403744] [INFO ] [REMOTE    ] NFJ: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T20:08:32.947633] [INFO ] [REMOTE    ] NFG: Fetching primary data for 2025-03.
[2025-10-24T20:08:33.366802] [INFO ] [REMOTE    ] NEM: Incremental fetch complete for 2025-10 (2.81 seconds).
[2025-10-24T20:08:33.376818] [INFO ] [REMOTE    ] NEM: Full fetch complete (77887 records).
[2025-10-24T20:08:33.376977] [DEBUG] [VALIDATOR ] NEM: Validating primary data.
[2025-10-24T20:08:33.765093] [INFO ] [REMOTE    ] NFJ: Fetching primary data for 2025-02.
[2025-10-24T20:08:33.789411] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present.
[2025-10-24T20:08:33.789563] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed.
[2025-10-24T20:08:33.790777] [INFO ] [MAIN      ] NEM: Fetched primary data is valid.
[2025-10-24T20:08:33.790961] [DEBUG] [LOCAL     ] NEM: Saving primary data.
[2025-10-24T20:08:33.791734] [FATAL] [LOCAL     ] NEM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:08:33.791818] [FATAL] [MAIN      ] NEM: Failed to save primary data.
[2025-10-24T20:08:33.791862] [WARN ] [MAIN      ] NEM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:08:33.791925] [INFO ] [LOCAL     ] NEM: Starting deletion of primary data.
[2025-10-24T20:08:33.791986] [DEBUG] [LOCAL     ] NEM: No primary data file found to delete.
[2025-10-24T20:08:33.792022] [INFO ] [LOCAL     ] NEM: Starting deletion of derivative data.
[2025-10-24T20:08:33.792152] [DEBUG] [LOCAL     ] NEM: Deleted derivative data file.
[2025-10-24T20:08:33.792356] [INFO ] [MAIN      ] Update Progress: 1467/2366 symbols completed. NEM took 44.5s. Estimated remaining: 1h 55m 31s. Rate: 7.8 symbols/min
[2025-10-24T20:08:33.964509] [INFO ] [MAIN      ] NGG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:08:33.991461] [INFO ] [REMOTE    ] NET: Incremental fetch complete for 2025-10 (1.84 seconds).
[2025-10-24T20:08:34.001291] [INFO ] [REMOTE    ] NET: Full fetch complete (76803 records).
[2025-10-24T20:08:34.001529] [DEBUG] [VALIDATOR ] NET: Validating primary data.
[2025-10-24T20:08:34.324486] [DEBUG] [LOCAL     ] NGG: Loaded 47110 existing records from primary storage.
[2025-10-24T20:08:34.352348] [INFO ] [MAIN      ] NGG: Loaded 47110 existing records.
[2025-10-24T20:08:34.584133] [DEBUG] [VALIDATOR ] NET: All expected trading days are present.
[2025-10-24T20:08:34.599673] [DEBUG] [VALIDATOR ] NET: Primary data validation passed.
[2025-10-24T20:08:34.655436] [WARN ] [MAIN      ] NGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:08:34.656974] [INFO ] [MAIN      ] NET: Fetched primary data is valid.
[2025-10-24T20:08:34.657320] [DEBUG] [LOCAL     ] NET: Saving primary data.
[2025-10-24T20:08:34.657183] [INFO ] [MAIN      ] NGG: Wiping existing primary data before full refresh.
[2025-10-24T20:08:34.657612] [INFO ] [LOCAL     ] NGG: Starting deletion of primary data.
[2025-10-24T20:08:34.658125] [FATAL] [LOCAL     ] NET: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:08:34.658381] [DEBUG] [LOCAL     ] NGG: Deleted primary data file.
[2025-10-24T20:08:34.658220] [FATAL] [MAIN      ] NET: Failed to save primary data.
[2025-10-24T20:08:34.658623] [INFO ] [MAIN      ] NGG: Starting full primary refresh.
[2025-10-24T20:08:34.658722] [WARN ] [MAIN      ] NET: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:08:34.710786] [INFO ] [LOCAL     ] NET: Starting deletion of primary data.
[2025-10-24T20:08:34.759768] [INFO ] [REMOTE    ] NFG: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T20:08:34.799619] [DEBUG] [LOCAL     ] NET: No primary data file found to delete.
[2025-10-24T20:08:34.815840] [INFO ] [LOCAL     ] NET: Starting deletion of derivative data.
[2025-10-24T20:08:34.825771] [INFO ] [REMOTE    ] NFG: Fetching primary data for 2025-04.
[2025-10-24T20:08:34.837211] [DEBUG] [LOCAL     ] NET: Deleted derivative data file.
[2025-10-24T20:08:34.837164] [INFO ] [REMOTE    ] NFJ: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T20:08:34.879484] [INFO ] [MAIN      ] Update Progress: 1468/2366 symbols completed. NET took 42.3s. Estimated remaining: 1h 55m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:08:35.265973] [INFO ] [MAIN      ] NGL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:08:35.295480] [INFO ] [REMOTE    ] NGG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:08:35.321634] [DEBUG] [LOCAL     ] NGL: Loaded 30035 existing records from primary storage.
[2025-10-24T20:08:35.321945] [INFO ] [MAIN      ] NGL: Loaded 30035 existing records.
[2025-10-24T20:08:35.353214] [INFO ] [REMOTE    ] NGG: Fetching primary data for 2025-01.
[2025-10-24T20:08:35.506233] [WARN ] [MAIN      ] NGL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:08:35.506445] [INFO ] [MAIN      ] NGL: Wiping existing primary data before full refresh.
[2025-10-24T20:08:35.506494] [INFO ] [LOCAL     ] NGL: Starting deletion of primary data.
[2025-10-24T20:08:35.506716] [DEBUG] [LOCAL     ] NGL: Deleted primary data file.
[2025-10-24T20:08:35.506773] [INFO ] [MAIN      ] NGL: Starting full primary refresh.
[2025-10-24T20:08:35.866082] [INFO ] [REMOTE    ] NGL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:08:36.147682] [INFO ] [REMOTE    ] NGL: Fetching primary data for 2025-01.
[2025-10-24T20:08:36.522385] [INFO ] [REMOTE    ] NFG: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T20:08:36.931218] [INFO ] [REMOTE    ] NGL: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T20:08:36.947608] [INFO ] [REMOTE    ] NGL: Fetching primary data for 2025-02.
[2025-10-24T20:08:37.087997] [INFO ] [REMOTE    ] NGG: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T20:08:37.747721] [INFO ] [REMOTE    ] NFJ: Fetching primary data for 2025-03.
[2025-10-24T20:08:38.047102] [INFO ] [REMOTE    ] NGL: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T20:08:38.547616] [INFO ] [REMOTE    ] NFG: Fetching primary data for 2025-05.
[2025-10-24T20:08:38.793170] [INFO ] [REMOTE    ] NFJ: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T20:08:39.347612] [INFO ] [REMOTE    ] NGG: Fetching primary data for 2025-02.
[2025-10-24T20:08:39.834390] [INFO ] [REMOTE    ] NFG: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T20:08:40.147748] [INFO ] [REMOTE    ] NFG: Fetching primary data for 2025-06.
[2025-10-24T20:08:40.943515] [INFO ] [REMOTE    ] NGG: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T20:08:40.951403] [INFO ] [REMOTE    ] NFJ: Fetching primary data for 2025-04.
[2025-10-24T20:08:41.400598] [INFO ] [REMOTE    ] NFG: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T20:08:41.747616] [INFO ] [REMOTE    ] NGG: Fetching primary data for 2025-03.
[2025-10-24T20:08:42.053462] [INFO ] [REMOTE    ] NFJ: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T20:08:42.547633] [INFO ] [REMOTE    ] NGL: Fetching primary data for 2025-03.
[2025-10-24T20:08:43.179261] [INFO ] [REMOTE    ] NGG: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T20:08:43.273406] [INFO ] [REMOTE    ] NGL: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T20:08:43.347726] [INFO ] [REMOTE    ] NGL: Fetching primary data for 2025-04.
[2025-10-24T20:08:44.147689] [INFO ] [REMOTE    ] NGG: Fetching primary data for 2025-04.
[2025-10-24T20:08:44.947631] [INFO ] [REMOTE    ] NFJ: Fetching primary data for 2025-05.
[2025-10-24T20:08:45.324006] [INFO ] [REMOTE    ] NGL: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T20:08:45.747686] [INFO ] [REMOTE    ] NFG: Fetching primary data for 2025-07.
[2025-10-24T20:08:46.547680] [INFO ] [REMOTE    ] NGL: Fetching primary data for 2025-05.
[2025-10-24T20:08:48.466571] [INFO ] [REMOTE    ] NFG: Incremental fetch complete for 2025-07 (2.72 seconds).
[2025-10-24T20:08:48.475862] [INFO ] [REMOTE    ] NFG: Fetching primary data for 2025-08.
[2025-10-24T20:08:49.079895] [INFO ] [REMOTE    ] NGG: Incremental fetch complete for 2025-04 (4.93 seconds).
[2025-10-24T20:08:49.090235] [INFO ] [REMOTE    ] NGG: Fetching primary data for 2025-05.
[2025-10-24T20:08:49.132724] [INFO ] [REMOTE    ] NGL: Incremental fetch complete for 2025-05 (2.59 seconds).
[2025-10-24T20:08:49.137890] [INFO ] [REMOTE    ] NGL: Fetching primary data for 2025-06.
[2025-10-24T20:08:49.855496] [INFO ] [REMOTE    ] NFG: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T20:08:49.864381] [INFO ] [REMOTE    ] NFG: Fetching primary data for 2025-09.
[2025-10-24T20:08:50.158038] [INFO ] [REMOTE    ] NFJ: Incremental fetch complete for 2025-05 (5.21 seconds).
[2025-10-24T20:08:50.547623] [INFO ] [REMOTE    ] NFJ: Fetching primary data for 2025-06.
[2025-10-24T20:08:51.268200] [INFO ] [REMOTE    ] NGL: Incremental fetch complete for 2025-06 (2.13 seconds).
[2025-10-24T20:08:51.296772] [INFO ] [REMOTE    ] NFG: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T20:08:51.347617] [INFO ] [REMOTE    ] NFG: Fetching primary data for 2025-10.
[2025-10-24T20:08:52.147716] [INFO ] [REMOTE    ] NGL: Fetching primary data for 2025-07.
[2025-10-24T20:08:52.514728] [INFO ] [REMOTE    ] NGG: Incremental fetch complete for 2025-05 (3.42 seconds).
[2025-10-24T20:08:52.947622] [INFO ] [REMOTE    ] NGG: Fetching primary data for 2025-06.
[2025-10-24T20:08:52.980086] [INFO ] [REMOTE    ] NFG: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T20:08:52.987539] [INFO ] [REMOTE    ] NFG: Full fetch complete (57227 records).
[2025-10-24T20:08:52.987734] [DEBUG] [VALIDATOR ] NFG: Validating primary data.
[2025-10-24T20:08:53.088924] [INFO ] [REMOTE    ] NFJ: Incremental fetch complete for 2025-06 (2.54 seconds).
[2025-10-24T20:08:53.400667] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present.
[2025-10-24T20:08:53.401070] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed.
[2025-10-24T20:08:53.402071] [INFO ] [MAIN      ] NFG: Fetched primary data is valid.
[2025-10-24T20:08:53.409761] [DEBUG] [LOCAL     ] NFG: Saving primary data.
[2025-10-24T20:08:53.422038] [FATAL] [LOCAL     ] NFG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:08:53.422192] [FATAL] [MAIN      ] NFG: Failed to save primary data.
[2025-10-24T20:08:53.422266] [WARN ] [MAIN      ] NFG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:08:53.422504] [INFO ] [LOCAL     ] NFG: Starting deletion of primary data.
[2025-10-24T20:08:53.423000] [DEBUG] [LOCAL     ] NFG: No primary data file found to delete.
[2025-10-24T20:08:53.423718] [INFO ] [REMOTE    ] NGL: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T20:08:53.423933] [INFO ] [LOCAL     ] NFG: Starting deletion of derivative data.
[2025-10-24T20:08:53.431701] [DEBUG] [LOCAL     ] NFG: Deleted derivative data file.
[2025-10-24T20:08:53.431940] [INFO ] [MAIN      ] Update Progress: 1469/2366 symbols completed. NFG took 36.1s. Estimated remaining: 1h 55m 19s. Rate: 7.8 symbols/min
[2025-10-24T20:08:53.603411] [INFO ] [MAIN      ] NGS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:08:53.617704] [DEBUG] [LOCAL     ] NGS: Loaded 10918 existing records from primary storage.
[2025-10-24T20:08:53.617966] [INFO ] [MAIN      ] NGS: Loaded 10918 existing records.
[2025-10-24T20:08:53.754952] [INFO ] [REMOTE    ] NFJ: Fetching primary data for 2025-07.
[2025-10-24T20:08:53.795864] [WARN ] [MAIN      ] NGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:08:53.796230] [INFO ] [MAIN      ] NGS: Wiping existing primary data before full refresh.
[2025-10-24T20:08:53.796281] [INFO ] [LOCAL     ] NGS: Starting deletion of primary data.
[2025-10-24T20:08:53.796546] [DEBUG] [LOCAL     ] NGS: Deleted primary data file.
[2025-10-24T20:08:53.796610] [INFO ] [MAIN      ] NGS: Starting full primary refresh.
[2025-10-24T20:08:54.149569] [INFO ] [REMOTE    ] NGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:08:54.547633] [INFO ] [REMOTE    ] NGL: Fetching primary data for 2025-08.
[2025-10-24T20:08:54.955686] [INFO ] [REMOTE    ] NFJ: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T20:08:55.347633] [INFO ] [REMOTE    ] NFJ: Fetching primary data for 2025-08.
[2025-10-24T20:08:55.578976] [INFO ] [REMOTE    ] NGG: Incremental fetch complete for 2025-06 (2.63 seconds).
[2025-10-24T20:08:55.814725] [INFO ] [REMOTE    ] NGL: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T20:08:56.147664] [INFO ] [REMOTE    ] NGL: Fetching primary data for 2025-09.
[2025-10-24T20:08:56.273106] [INFO ] [REMOTE    ] NFJ: Incremental fetch complete for 2025-08 (0.93 seconds).
[2025-10-24T20:08:56.947639] [INFO ] [REMOTE    ] NGG: Fetching primary data for 2025-07.
[2025-10-24T20:08:57.198594] [INFO ] [REMOTE    ] NGL: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T20:08:57.747636] [INFO ] [REMOTE    ] NGS: Fetching primary data for 2025-01.
[2025-10-24T20:08:58.405705] [INFO ] [REMOTE    ] NGG: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T20:08:58.441742] [INFO ] [REMOTE    ] NGS: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T20:08:58.547614] [INFO ] [REMOTE    ] NFJ: Fetching primary data for 2025-09.
[2025-10-24T20:08:59.347699] [INFO ] [REMOTE    ] NGS: Fetching primary data for 2025-02.
[2025-10-24T20:08:59.611514] [INFO ] [REMOTE    ] NFJ: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T20:09:00.100410] [INFO ] [REMOTE    ] NGS: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T20:09:00.147682] [INFO ] [REMOTE    ] NGG: Fetching primary data for 2025-08.
[2025-10-24T20:09:00.947680] [INFO ] [REMOTE    ] NGL: Fetching primary data for 2025-10.
[2025-10-24T20:09:01.747741] [INFO ] [REMOTE    ] NGS: Fetching primary data for 2025-03.
[2025-10-24T20:09:01.830380] [INFO ] [REMOTE    ] NGG: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T20:09:02.212235] [INFO ] [REMOTE    ] NGL: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T20:09:02.216922] [INFO ] [REMOTE    ] NGL: Full fetch complete (41646 records).
[2025-10-24T20:09:02.217098] [DEBUG] [VALIDATOR ] NGL: Validating primary data.
[2025-10-24T20:09:02.554520] [INFO ] [REMOTE    ] NGG: Fetching primary data for 2025-09.
[2025-10-24T20:09:02.606129] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present.
[2025-10-24T20:09:02.606212] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed.
[2025-10-24T20:09:02.607079] [INFO ] [MAIN      ] NGL: Fetched primary data is valid.
[2025-10-24T20:09:02.607141] [DEBUG] [LOCAL     ] NGL: Saving primary data.
[2025-10-24T20:09:02.607615] [FATAL] [LOCAL     ] NGL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:09:02.607720] [FATAL] [MAIN      ] NGL: Failed to save primary data.
[2025-10-24T20:09:02.607785] [WARN ] [MAIN      ] NGL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:09:02.607845] [INFO ] [LOCAL     ] NGL: Starting deletion of primary data.
[2025-10-24T20:09:02.607910] [DEBUG] [LOCAL     ] NGL: No primary data file found to delete.
[2025-10-24T20:09:02.607968] [INFO ] [LOCAL     ] NGL: Starting deletion of derivative data.
[2025-10-24T20:09:02.608156] [DEBUG] [LOCAL     ] NGL: Deleted derivative data file.
[2025-10-24T20:09:02.608254] [INFO ] [MAIN      ] Update Progress: 1470/2366 symbols completed. NGL took 27.7s. Estimated remaining: 1h 55m 12s. Rate: 7.8 symbols/min
[2025-10-24T20:09:02.784026] [INFO ] [MAIN      ] NGVC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:09:02.808466] [DEBUG] [LOCAL     ] NGVC: Loaded 22904 existing records from primary storage.
[2025-10-24T20:09:02.808791] [INFO ] [MAIN      ] NGVC: Loaded 22904 existing records.
[2025-10-24T20:09:02.986753] [WARN ] [MAIN      ] NGVC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:09:02.986945] [INFO ] [MAIN      ] NGVC: Wiping existing primary data before full refresh.
[2025-10-24T20:09:02.986993] [INFO ] [LOCAL     ] NGVC: Starting deletion of primary data.
[2025-10-24T20:09:02.987243] [DEBUG] [LOCAL     ] NGVC: Deleted primary data file.
[2025-10-24T20:09:02.987321] [INFO ] [MAIN      ] NGVC: Starting full primary refresh.
[2025-10-24T20:09:03.349599] [INFO ] [REMOTE    ] NGVC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:09:03.349722] [INFO ] [REMOTE    ] NFJ: Fetching primary data for 2025-10.
[2025-10-24T20:09:04.147628] [INFO ] [REMOTE    ] NGVC: Fetching primary data for 2025-01.
[2025-10-24T20:09:04.174322] [INFO ] [REMOTE    ] NGS: Incremental fetch complete for 2025-03 (2.43 seconds).
[2025-10-24T20:09:04.312841] [INFO ] [REMOTE    ] NGG: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T20:09:04.366562] [INFO ] [REMOTE    ] NFJ: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T20:09:04.370998] [INFO ] [REMOTE    ] NFJ: Full fetch complete (29440 records).
[2025-10-24T20:09:04.371092] [DEBUG] [VALIDATOR ] NFJ: Validating primary data.
[2025-10-24T20:09:04.807214] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present.
[2025-10-24T20:09:04.807322] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed.
[2025-10-24T20:09:04.807975] [INFO ] [MAIN      ] NFJ: Fetched primary data is valid.
[2025-10-24T20:09:04.808036] [DEBUG] [LOCAL     ] NFJ: Saving primary data.
[2025-10-24T20:09:04.808344] [FATAL] [LOCAL     ] NFJ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:09:04.808425] [FATAL] [MAIN      ] NFJ: Failed to save primary data.
[2025-10-24T20:09:04.808470] [WARN ] [MAIN      ] NFJ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:09:04.808505] [INFO ] [LOCAL     ] NFJ: Starting deletion of primary data.
[2025-10-24T20:09:04.808554] [DEBUG] [LOCAL     ] NFJ: No primary data file found to delete.
[2025-10-24T20:09:04.808588] [INFO ] [LOCAL     ] NFJ: Starting deletion of derivative data.
[2025-10-24T20:09:04.808749] [DEBUG] [LOCAL     ] NFJ: Deleted derivative data file.
[2025-10-24T20:09:04.808842] [INFO ] [MAIN      ] Update Progress: 1471/2366 symbols completed. NFJ took 34.5s. Estimated remaining: 1h 55m 1s. Rate: 7.8 symbols/min
[2025-10-24T20:09:04.954894] [INFO ] [REMOTE    ] NGS: Fetching primary data for 2025-04.
[2025-10-24T20:09:04.984158] [INFO ] [MAIN      ] NGVT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:09:05.010391] [DEBUG] [LOCAL     ] NGVT: Loaded 23895 existing records from primary storage.
[2025-10-24T20:09:05.010722] [INFO ] [MAIN      ] NGVT: Loaded 23895 existing records.
[2025-10-24T20:09:05.142870] [INFO ] [REMOTE    ] NGVC: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T20:09:05.208385] [WARN ] [MAIN      ] NGVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:09:05.208630] [INFO ] [MAIN      ] NGVT: Wiping existing primary data before full refresh.
[2025-10-24T20:09:05.208713] [INFO ] [LOCAL     ] NGVT: Starting deletion of primary data.
[2025-10-24T20:09:05.209054] [DEBUG] [LOCAL     ] NGVT: Deleted primary data file.
[2025-10-24T20:09:05.209112] [INFO ] [MAIN      ] NGVT: Starting full primary refresh.
[2025-10-24T20:09:05.561755] [INFO ] [REMOTE    ] NGVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:09:05.747686] [INFO ] [REMOTE    ] NGVT: Fetching primary data for 2025-01.
[2025-10-24T20:09:06.021911] [INFO ] [REMOTE    ] NGS: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T20:09:06.547725] [INFO ] [REMOTE    ] NGVC: Fetching primary data for 2025-02.
[2025-10-24T20:09:06.821776] [INFO ] [REMOTE    ] NGVT: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T20:09:07.347744] [INFO ] [REMOTE    ] NGG: Fetching primary data for 2025-10.
[2025-10-24T20:09:07.470849] [INFO ] [REMOTE    ] NGVC: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T20:09:08.147686] [INFO ] [REMOTE    ] NGS: Fetching primary data for 2025-05.
[2025-10-24T20:09:08.947702] [INFO ] [REMOTE    ] NGVT: Fetching primary data for 2025-02.
[2025-10-24T20:09:08.968285] [INFO ] [REMOTE    ] NGS: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T20:09:09.167084] [INFO ] [REMOTE    ] NGG: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T20:09:09.175814] [INFO ] [REMOTE    ] NGG: Full fetch complete (66657 records).
[2025-10-24T20:09:09.175979] [DEBUG] [VALIDATOR ] NGG: Validating primary data.
[2025-10-24T20:09:09.558473] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present.
[2025-10-24T20:09:09.558550] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed.
[2025-10-24T20:09:09.559558] [INFO ] [MAIN      ] NGG: Fetched primary data is valid.
[2025-10-24T20:09:09.559619] [DEBUG] [LOCAL     ] NGG: Saving primary data.
[2025-10-24T20:09:09.560137] [FATAL] [LOCAL     ] NGG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:09:09.560225] [FATAL] [MAIN      ] NGG: Failed to save primary data.
[2025-10-24T20:09:09.560266] [WARN ] [MAIN      ] NGG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:09:09.560301] [INFO ] [LOCAL     ] NGG: Starting deletion of primary data.
[2025-10-24T20:09:09.560351] [DEBUG] [LOCAL     ] NGG: No primary data file found to delete.
[2025-10-24T20:09:09.560385] [INFO ] [LOCAL     ] NGG: Starting deletion of derivative data.
[2025-10-24T20:09:09.560500] [DEBUG] [LOCAL     ] NGG: Deleted derivative data file.
[2025-10-24T20:09:09.560779] [INFO ] [MAIN      ] Update Progress: 1472/2366 symbols completed. NGG took 35.8s. Estimated remaining: 1h 54m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:09:09.731337] [INFO ] [MAIN      ] NHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:09:09.752711] [INFO ] [REMOTE    ] NGS: Fetching primary data for 2025-06.
[2025-10-24T20:09:09.754015] [DEBUG] [LOCAL     ] NHI: Loaded 21978 existing records from primary storage.
[2025-10-24T20:09:09.754216] [INFO ] [MAIN      ] NHI: Loaded 21978 existing records.
[2025-10-24T20:09:09.931583] [WARN ] [MAIN      ] NHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:09:09.931886] [INFO ] [MAIN      ] NHI: Wiping existing primary data before full refresh.
[2025-10-24T20:09:09.931939] [INFO ] [LOCAL     ] NHI: Starting deletion of primary data.
[2025-10-24T20:09:09.932138] [DEBUG] [LOCAL     ] NHI: Deleted primary data file.
[2025-10-24T20:09:09.932193] [INFO ] [MAIN      ] NHI: Starting full primary refresh.
[2025-10-24T20:09:10.227314] [INFO ] [REMOTE    ] NGVT: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T20:09:10.307067] [INFO ] [REMOTE    ] NHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:09:10.547695] [INFO ] [REMOTE    ] NGVT: Fetching primary data for 2025-03.
[2025-10-24T20:09:10.680204] [INFO ] [REMOTE    ] NGS: Incremental fetch complete for 2025-06 (0.93 seconds).
[2025-10-24T20:09:11.347725] [INFO ] [REMOTE    ] NHI: Fetching primary data for 2025-01.
[2025-10-24T20:09:11.646377] [INFO ] [REMOTE    ] NGVT: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T20:09:12.124112] [INFO ] [REMOTE    ] NHI: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T20:09:12.147615] [INFO ] [REMOTE    ] NGVC: Fetching primary data for 2025-03.
[2025-10-24T20:09:12.947744] [INFO ] [REMOTE    ] NGS: Fetching primary data for 2025-07.
[2025-10-24T20:09:13.224788] [INFO ] [REMOTE    ] NGVC: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T20:09:13.747692] [INFO ] [REMOTE    ] NGVT: Fetching primary data for 2025-04.
[2025-10-24T20:09:13.783377] [INFO ] [REMOTE    ] NGS: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T20:09:14.547738] [INFO ] [REMOTE    ] NHI: Fetching primary data for 2025-02.
[2025-10-24T20:09:14.994181] [INFO ] [REMOTE    ] NGVT: Incremental fetch complete for 2025-04 (1.25 seconds).
[2025-10-24T20:09:15.347704] [INFO ] [REMOTE    ] NGVT: Fetching primary data for 2025-05.
[2025-10-24T20:09:15.650604] [INFO ] [REMOTE    ] NHI: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T20:09:16.147740] [INFO ] [REMOTE    ] NGVC: Fetching primary data for 2025-04.
[2025-10-24T20:09:16.820769] [INFO ] [REMOTE    ] NGVT: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T20:09:16.947707] [INFO ] [REMOTE    ] NGS: Fetching primary data for 2025-08.
[2025-10-24T20:09:17.289329] [INFO ] [REMOTE    ] NGVC: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T20:09:17.747622] [INFO ] [REMOTE    ] NGVC: Fetching primary data for 2025-05.
[2025-10-24T20:09:17.791085] [INFO ] [REMOTE    ] NGS: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T20:09:18.547680] [INFO ] [REMOTE    ] NGVT: Fetching primary data for 2025-06.
[2025-10-24T20:09:18.783388] [INFO ] [REMOTE    ] NGVC: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T20:09:19.347692] [INFO ] [REMOTE    ] NGS: Fetching primary data for 2025-09.
[2025-10-24T20:09:19.587471] [INFO ] [REMOTE    ] NGVT: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T20:09:20.133695] [INFO ] [REMOTE    ] NGS: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T20:09:20.147598] [INFO ] [REMOTE    ] NGS: Fetching primary data for 2025-10.
[2025-10-24T20:09:20.942551] [INFO ] [REMOTE    ] NGS: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T20:09:20.944520] [INFO ] [REMOTE    ] NGS: Full fetch complete (16549 records).
[2025-10-24T20:09:20.944589] [DEBUG] [VALIDATOR ] NGS: Validating primary data.
[2025-10-24T20:09:20.955889] [INFO ] [REMOTE    ] NHI: Fetching primary data for 2025-03.
[2025-10-24T20:09:21.312940] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present.
[2025-10-24T20:09:21.313024] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed.
[2025-10-24T20:09:21.313386] [INFO ] [MAIN      ] NGS: Fetched primary data is valid.
[2025-10-24T20:09:21.313426] [DEBUG] [LOCAL     ] NGS: Saving primary data.
[2025-10-24T20:09:21.313765] [FATAL] [LOCAL     ] NGS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:09:21.313856] [FATAL] [MAIN      ] NGS: Failed to save primary data.
[2025-10-24T20:09:21.313897] [WARN ] [MAIN      ] NGS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:09:21.313931] [INFO ] [LOCAL     ] NGS: Starting deletion of primary data.
[2025-10-24T20:09:21.314005] [DEBUG] [LOCAL     ] NGS: No primary data file found to delete.
[2025-10-24T20:09:21.314065] [INFO ] [LOCAL     ] NGS: Starting deletion of derivative data.
[2025-10-24T20:09:21.314192] [DEBUG] [LOCAL     ] NGS: Deleted derivative data file.
[2025-10-24T20:09:21.314307] [INFO ] [MAIN      ] Update Progress: 1473/2366 symbols completed. NGS took 27.9s. Estimated remaining: 1h 54m 46s. Rate: 7.8 symbols/min
[2025-10-24T20:09:21.488689] [INFO ] [MAIN      ] NI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:09:21.541355] [DEBUG] [LOCAL     ] NI: Loaded 53798 existing records from primary storage.
[2025-10-24T20:09:21.541704] [INFO ] [MAIN      ] NI: Loaded 53798 existing records.
[2025-10-24T20:09:21.727046] [WARN ] [MAIN      ] NI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:09:21.727301] [INFO ] [MAIN      ] NI: Wiping existing primary data before full refresh.
[2025-10-24T20:09:21.727382] [INFO ] [LOCAL     ] NI: Starting deletion of primary data.
[2025-10-24T20:09:21.727942] [DEBUG] [LOCAL     ] NI: Deleted primary data file.
[2025-10-24T20:09:21.727999] [INFO ] [MAIN      ] NI: Starting full primary refresh.
[2025-10-24T20:09:21.757190] [INFO ] [REMOTE    ] NGVC: Fetching primary data for 2025-06.
[2025-10-24T20:09:22.093715] [INFO ] [REMOTE    ] NI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:09:22.105821] [INFO ] [REMOTE    ] NHI: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T20:09:22.547736] [INFO ] [REMOTE    ] NI: Fetching primary data for 2025-01.
[2025-10-24T20:09:22.956890] [INFO ] [REMOTE    ] NGVC: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T20:09:23.347727] [INFO ] [REMOTE    ] NHI: Fetching primary data for 2025-04.
[2025-10-24T20:09:24.147699] [INFO ] [REMOTE    ] NGVT: Fetching primary data for 2025-07.
[2025-10-24T20:09:24.307334] [INFO ] [REMOTE    ] NI: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T20:09:24.368484] [INFO ] [REMOTE    ] NHI: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T20:09:24.947709] [INFO ] [REMOTE    ] NGVC: Fetching primary data for 2025-07.
[2025-10-24T20:09:25.169153] [INFO ] [REMOTE    ] NGVT: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T20:09:25.747696] [INFO ] [REMOTE    ] NHI: Fetching primary data for 2025-05.
[2025-10-24T20:09:26.111050] [INFO ] [REMOTE    ] NGVC: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T20:09:26.547694] [INFO ] [REMOTE    ] NGVT: Fetching primary data for 2025-08.
[2025-10-24T20:09:26.774305] [INFO ] [REMOTE    ] NHI: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T20:09:27.347719] [INFO ] [REMOTE    ] NGVC: Fetching primary data for 2025-08.
[2025-10-24T20:09:27.846154] [INFO ] [REMOTE    ] NGVT: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T20:09:28.147744] [INFO ] [REMOTE    ] NI: Fetching primary data for 2025-02.
[2025-10-24T20:09:28.482409] [INFO ] [REMOTE    ] NGVC: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T20:09:28.947717] [INFO ] [REMOTE    ] NGVT: Fetching primary data for 2025-09.
[2025-10-24T20:09:29.490133] [INFO ] [REMOTE    ] NI: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T20:09:29.673112] [INFO ] [REMOTE    ] NGVT: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T20:09:29.747636] [INFO ] [REMOTE    ] NGVT: Fetching primary data for 2025-10.
[2025-10-24T20:09:30.547726] [INFO ] [REMOTE    ] NHI: Fetching primary data for 2025-06.
[2025-10-24T20:09:30.911933] [INFO ] [REMOTE    ] NGVT: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T20:09:30.915995] [INFO ] [REMOTE    ] NGVT: Full fetch complete (34219 records).
[2025-10-24T20:09:30.916104] [DEBUG] [VALIDATOR ] NGVT: Validating primary data.
[2025-10-24T20:09:31.292051] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present.
[2025-10-24T20:09:31.292127] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed.
[2025-10-24T20:09:31.292828] [INFO ] [MAIN      ] NGVT: Fetched primary data is valid.
[2025-10-24T20:09:31.292892] [DEBUG] [LOCAL     ] NGVT: Saving primary data.
[2025-10-24T20:09:31.293238] [FATAL] [LOCAL     ] NGVT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:09:31.293328] [FATAL] [MAIN      ] NGVT: Failed to save primary data.
[2025-10-24T20:09:31.293369] [WARN ] [MAIN      ] NGVT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:09:31.293403] [INFO ] [LOCAL     ] NGVT: Starting deletion of primary data.
[2025-10-24T20:09:31.293452] [DEBUG] [LOCAL     ] NGVT: No primary data file found to delete.
[2025-10-24T20:09:31.293486] [INFO ] [LOCAL     ] NGVT: Starting deletion of derivative data.
[2025-10-24T20:09:31.293624] [DEBUG] [LOCAL     ] NGVT: Deleted derivative data file.
[2025-10-24T20:09:31.293765] [INFO ] [MAIN      ] Update Progress: 1474/2366 symbols completed. NGVT took 26.5s. Estimated remaining: 1h 54m 40s. Rate: 7.8 symbols/min
[2025-10-24T20:09:31.355453] [INFO ] [REMOTE    ] NI: Fetching primary data for 2025-03.
[2025-10-24T20:09:31.466295] [INFO ] [MAIN      ] NIC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:09:31.478732] [DEBUG] [LOCAL     ] NIC: Loaded 8934 existing records from primary storage.
[2025-10-24T20:09:31.478971] [INFO ] [MAIN      ] NIC: Loaded 8934 existing records.
[2025-10-24T20:09:31.662693] [WARN ] [MAIN      ] NIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:09:31.663023] [INFO ] [MAIN      ] NIC: Wiping existing primary data before full refresh.
[2025-10-24T20:09:31.663099] [INFO ] [LOCAL     ] NIC: Starting deletion of primary data.
[2025-10-24T20:09:31.663277] [DEBUG] [LOCAL     ] NIC: Deleted primary data file.
[2025-10-24T20:09:31.663336] [INFO ] [MAIN      ] NIC: Starting full primary refresh.
[2025-10-24T20:09:31.777775] [INFO ] [REMOTE    ] NHI: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T20:09:32.030885] [INFO ] [REMOTE    ] NIC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:09:32.147610] [INFO ] [REMOTE    ] NGVC: Fetching primary data for 2025-09.
[2025-10-24T20:09:32.909867] [INFO ] [REMOTE    ] NI: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T20:09:32.947600] [INFO ] [REMOTE    ] NHI: Fetching primary data for 2025-07.
[2025-10-24T20:09:33.388046] [INFO ] [REMOTE    ] NGVC: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T20:09:33.747613] [INFO ] [REMOTE    ] NIC: Fetching primary data for 2025-01.
[2025-10-24T20:09:34.043234] [INFO ] [REMOTE    ] NHI: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T20:09:34.455324] [INFO ] [REMOTE    ] NIC: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T20:09:34.547708] [INFO ] [REMOTE    ] NGVC: Fetching primary data for 2025-10.
[2025-10-24T20:09:35.347683] [INFO ] [REMOTE    ] NHI: Fetching primary data for 2025-08.
[2025-10-24T20:09:35.702235] [INFO ] [REMOTE    ] NGVC: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T20:09:35.706531] [INFO ] [REMOTE    ] NGVC: Full fetch complete (31144 records).
[2025-10-24T20:09:35.706634] [DEBUG] [VALIDATOR ] NGVC: Validating primary data.
[2025-10-24T20:09:36.096343] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present.
[2025-10-24T20:09:36.096424] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed.
[2025-10-24T20:09:36.097074] [INFO ] [MAIN      ] NGVC: Fetched primary data is valid.
[2025-10-24T20:09:36.097148] [DEBUG] [LOCAL     ] NGVC: Saving primary data.
[2025-10-24T20:09:36.097522] [FATAL] [LOCAL     ] NGVC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:09:36.097608] [FATAL] [MAIN      ] NGVC: Failed to save primary data.
[2025-10-24T20:09:36.097698] [WARN ] [MAIN      ] NGVC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:09:36.097767] [INFO ] [LOCAL     ] NGVC: Starting deletion of primary data.
[2025-10-24T20:09:36.097826] [DEBUG] [LOCAL     ] NGVC: No primary data file found to delete.
[2025-10-24T20:09:36.097862] [INFO ] [LOCAL     ] NGVC: Starting deletion of derivative data.
[2025-10-24T20:09:36.098006] [DEBUG] [LOCAL     ] NGVC: Deleted derivative data file.
[2025-10-24T20:09:36.098100] [INFO ] [MAIN      ] Update Progress: 1475/2366 symbols completed. NGVC took 33.5s. Estimated remaining: 1h 54m 30s. Rate: 7.8 symbols/min
[2025-10-24T20:09:36.154130] [INFO ] [REMOTE    ] NI: Fetching primary data for 2025-04.
[2025-10-24T20:09:36.270613] [INFO ] [MAIN      ] NIE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:09:36.284888] [DEBUG] [LOCAL     ] NIE: Loaded 11861 existing records from primary storage.
[2025-10-24T20:09:36.285151] [INFO ] [MAIN      ] NIE: Loaded 11861 existing records.
[2025-10-24T20:09:36.465221] [WARN ] [MAIN      ] NIE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:09:36.465557] [INFO ] [MAIN      ] NIE: Wiping existing primary data before full refresh.
[2025-10-24T20:09:36.465626] [INFO ] [LOCAL     ] NIE: Starting deletion of primary data.
[2025-10-24T20:09:36.471118] [DEBUG] [LOCAL     ] NIE: Deleted primary data file.
[2025-10-24T20:09:36.478550] [INFO ] [MAIN      ] NIE: Starting full primary refresh.
[2025-10-24T20:09:36.545201] [INFO ] [REMOTE    ] NHI: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T20:09:36.845178] [INFO ] [REMOTE    ] NIE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:09:36.947627] [INFO ] [REMOTE    ] NIE: Fetching primary data for 2025-01.
[2025-10-24T20:09:37.700816] [INFO ] [REMOTE    ] NI: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T20:09:37.720859] [INFO ] [REMOTE    ] NIE: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T20:09:37.747623] [INFO ] [REMOTE    ] NIE: Fetching primary data for 2025-02.
[2025-10-24T20:09:38.520098] [INFO ] [REMOTE    ] NIE: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T20:09:38.547605] [INFO ] [REMOTE    ] NIE: Fetching primary data for 2025-03.
[2025-10-24T20:09:39.347619] [INFO ] [REMOTE    ] NIC: Fetching primary data for 2025-02.
[2025-10-24T20:09:39.402628] [INFO ] [REMOTE    ] NIE: Incremental fetch complete for 2025-03 (0.86 seconds).
[2025-10-24T20:09:39.894789] [INFO ] [REMOTE    ] NIC: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T20:09:40.147629] [INFO ] [REMOTE    ] NI: Fetching primary data for 2025-05.
[2025-10-24T20:09:40.947688] [INFO ] [REMOTE    ] NIC: Fetching primary data for 2025-03.
[2025-10-24T20:09:41.695264] [INFO ] [REMOTE    ] NIC: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T20:09:41.747636] [INFO ] [REMOTE    ] NIE: Fetching primary data for 2025-04.
[2025-10-24T20:09:41.935854] [INFO ] [REMOTE    ] NI: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T20:09:42.547714] [INFO ] [REMOTE    ] NI: Fetching primary data for 2025-06.
[2025-10-24T20:09:42.674207] [INFO ] [REMOTE    ] NIE: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T20:09:43.347741] [INFO ] [REMOTE    ] NIC: Fetching primary data for 2025-04.
[2025-10-24T20:09:44.093842] [INFO ] [REMOTE    ] NI: Incremental fetch complete for 2025-06 (1.55 seconds).
[2025-10-24T20:09:44.111625] [INFO ] [REMOTE    ] NIC: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T20:09:44.147608] [INFO ] [REMOTE    ] NI: Fetching primary data for 2025-07.
[2025-10-24T20:09:44.947754] [INFO ] [REMOTE    ] NIC: Fetching primary data for 2025-05.
[2025-10-24T20:09:45.733901] [INFO ] [REMOTE    ] NIC: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T20:09:45.747594] [INFO ] [REMOTE    ] NIC: Fetching primary data for 2025-06.
[2025-10-24T20:09:45.956788] [INFO ] [REMOTE    ] NI: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T20:09:46.494488] [INFO ] [REMOTE    ] NIC: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T20:09:46.547607] [INFO ] [REMOTE    ] NIC: Fetching primary data for 2025-07.
[2025-10-24T20:09:47.347717] [INFO ] [REMOTE    ] NHI: Fetching primary data for 2025-09.
[2025-10-24T20:09:47.398434] [INFO ] [REMOTE    ] NIC: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T20:09:48.147663] [INFO ] [REMOTE    ] NIC: Fetching primary data for 2025-08.
[2025-10-24T20:09:48.365329] [INFO ] [REMOTE    ] NHI: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T20:09:48.856809] [INFO ] [REMOTE    ] NIC: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T20:09:48.947633] [INFO ] [REMOTE    ] NHI: Fetching primary data for 2025-10.
[2025-10-24T20:09:49.747636] [INFO ] [REMOTE    ] NIE: Fetching primary data for 2025-05.
[2025-10-24T20:09:50.108486] [INFO ] [REMOTE    ] NHI: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T20:09:50.112577] [INFO ] [REMOTE    ] NHI: Full fetch complete (30991 records).
[2025-10-24T20:09:50.112726] [DEBUG] [VALIDATOR ] NHI: Validating primary data.
[2025-10-24T20:09:50.511884] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present.
[2025-10-24T20:09:50.511997] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed.
[2025-10-24T20:09:50.512934] [INFO ] [MAIN      ] NHI: Fetched primary data is valid.
[2025-10-24T20:09:50.512998] [DEBUG] [LOCAL     ] NHI: Saving primary data.
[2025-10-24T20:09:50.513487] [FATAL] [LOCAL     ] NHI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:09:50.513591] [FATAL] [MAIN      ] NHI: Failed to save primary data.
[2025-10-24T20:09:50.513633] [WARN ] [MAIN      ] NHI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:09:50.513708] [INFO ] [LOCAL     ] NHI: Starting deletion of primary data.
[2025-10-24T20:09:50.513769] [DEBUG] [LOCAL     ] NHI: No primary data file found to delete.
[2025-10-24T20:09:50.513806] [INFO ] [LOCAL     ] NHI: Starting deletion of derivative data.
[2025-10-24T20:09:50.513993] [DEBUG] [LOCAL     ] NHI: Deleted derivative data file.
[2025-10-24T20:09:50.514101] [INFO ] [MAIN      ] Update Progress: 1476/2366 symbols completed. NHI took 41.0s. Estimated remaining: 1h 54m 27s. Rate: 7.8 symbols/min
[2025-10-24T20:09:50.552775] [INFO ] [REMOTE    ] NI: Fetching primary data for 2025-08.
[2025-10-24T20:09:50.638775] [INFO ] [REMOTE    ] NIE: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T20:09:50.709094] [INFO ] [MAIN      ] NIM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:09:50.716177] [DEBUG] [LOCAL     ] NIM: Loaded 3546 existing records from primary storage.
[2025-10-24T20:09:50.716409] [INFO ] [MAIN      ] NIM: Loaded 3546 existing records.
[2025-10-24T20:09:50.903475] [WARN ] [MAIN      ] NIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:09:50.903793] [INFO ] [MAIN      ] NIM: Wiping existing primary data before full refresh.
[2025-10-24T20:09:50.903848] [INFO ] [LOCAL     ] NIM: Starting deletion of primary data.
[2025-10-24T20:09:50.904075] [DEBUG] [LOCAL     ] NIM: Deleted primary data file.
[2025-10-24T20:09:50.904133] [INFO ] [MAIN      ] NIM: Starting full primary refresh.
[2025-10-24T20:09:51.271941] [INFO ] [REMOTE    ] NIM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:09:51.347725] [INFO ] [REMOTE    ] NIM: Fetching primary data for 2025-01.
[2025-10-24T20:09:51.952499] [INFO ] [REMOTE    ] NIM: Incremental fetch complete for 2025-01 (0.60 seconds).
[2025-10-24T20:09:52.147672] [INFO ] [REMOTE    ] NIC: Fetching primary data for 2025-09.
[2025-10-24T20:09:52.302099] [INFO ] [REMOTE    ] NI: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T20:09:52.907136] [INFO ] [REMOTE    ] NIC: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T20:09:52.947736] [INFO ] [REMOTE    ] NIE: Fetching primary data for 2025-06.
[2025-10-24T20:09:53.736323] [INFO ] [REMOTE    ] NIE: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T20:09:53.747617] [INFO ] [REMOTE    ] NIE: Fetching primary data for 2025-07.
[2025-10-24T20:09:54.547707] [INFO ] [REMOTE    ] NIM: Fetching primary data for 2025-02.
[2025-10-24T20:09:54.971465] [INFO ] [REMOTE    ] NIE: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T20:09:55.212346] [INFO ] [REMOTE    ] NIM: Incremental fetch complete for 2025-02 (0.66 seconds).
[2025-10-24T20:09:55.347709] [INFO ] [REMOTE    ] NIE: Fetching primary data for 2025-08.
[2025-10-24T20:09:56.127130] [INFO ] [REMOTE    ] NIE: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T20:09:56.147633] [INFO ] [REMOTE    ] NIE: Fetching primary data for 2025-09.
[2025-10-24T20:09:56.946848] [INFO ] [REMOTE    ] NIE: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T20:09:56.950298] [INFO ] [REMOTE    ] NIC: Fetching primary data for 2025-10.
[2025-10-24T20:09:57.747680] [INFO ] [REMOTE    ] NIE: Fetching primary data for 2025-10.
[2025-10-24T20:09:57.892698] [INFO ] [REMOTE    ] NIC: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T20:09:57.895526] [INFO ] [REMOTE    ] NIC: Full fetch complete (12777 records).
[2025-10-24T20:09:57.895614] [DEBUG] [VALIDATOR ] NIC: Validating primary data.
[2025-10-24T20:09:58.286932] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present.
[2025-10-24T20:09:58.287291] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed.
[2025-10-24T20:09:58.287948] [INFO ] [MAIN      ] NIC: Fetched primary data is valid.
[2025-10-24T20:09:58.288017] [DEBUG] [LOCAL     ] NIC: Saving primary data.
[2025-10-24T20:09:58.288308] [FATAL] [LOCAL     ] NIC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:09:58.288428] [FATAL] [MAIN      ] NIC: Failed to save primary data.
[2025-10-24T20:09:58.288503] [WARN ] [MAIN      ] NIC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:09:58.288579] [INFO ] [LOCAL     ] NIC: Starting deletion of primary data.
[2025-10-24T20:09:58.288687] [DEBUG] [LOCAL     ] NIC: No primary data file found to delete.
[2025-10-24T20:09:58.288766] [INFO ] [LOCAL     ] NIC: Starting deletion of derivative data.
[2025-10-24T20:09:58.289762] [DEBUG] [LOCAL     ] NIC: Deleted derivative data file.
[2025-10-24T20:09:58.289904] [INFO ] [MAIN      ] Update Progress: 1477/2366 symbols completed. NIC took 27.0s. Estimated remaining: 1h 54m 19s. Rate: 7.8 symbols/min
[2025-10-24T20:09:58.547692] [INFO ] [REMOTE    ] NI: Fetching primary data for 2025-09.
[2025-10-24T20:09:58.653686] [INFO ] [REMOTE    ] NIE: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T20:09:58.657154] [INFO ] [REMOTE    ] NIE: Full fetch complete (16918 records).
[2025-10-24T20:09:58.657235] [DEBUG] [VALIDATOR ] NIE: Validating primary data.
[2025-10-24T20:09:59.021213] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present.
[2025-10-24T20:09:59.021320] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed.
[2025-10-24T20:09:59.022054] [INFO ] [MAIN      ] NIE: Fetched primary data is valid.
[2025-10-24T20:09:59.022120] [DEBUG] [LOCAL     ] NIE: Saving primary data.
[2025-10-24T20:09:59.022436] [FATAL] [LOCAL     ] NIE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:09:59.022534] [FATAL] [MAIN      ] NIE: Failed to save primary data.
[2025-10-24T20:09:59.022601] [WARN ] [MAIN      ] NIE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:09:59.022704] [INFO ] [LOCAL     ] NIE: Starting deletion of primary data.
[2025-10-24T20:09:59.022786] [DEBUG] [LOCAL     ] NIE: No primary data file found to delete.
[2025-10-24T20:09:59.022827] [INFO ] [LOCAL     ] NIE: Starting deletion of derivative data.
[2025-10-24T20:09:59.022975] [DEBUG] [LOCAL     ] NIE: Deleted derivative data file.
[2025-10-24T20:09:59.023061] [INFO ] [MAIN      ] Update Progress: 1478/2366 symbols completed. NIE took 22.9s. Estimated remaining: 1h 54m 7s. Rate: 7.8 symbols/min
[2025-10-24T20:09:59.347728] [INFO ] [REMOTE    ] NIM: Fetching primary data for 2025-03.
[2025-10-24T20:10:00.076046] [INFO ] [REMOTE    ] NIM: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T20:10:00.147787] [INFO ] [REMOTE    ] NIM: Fetching primary data for 2025-04.
[2025-10-24T20:10:00.248062] [INFO ] [REMOTE    ] NI: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T20:10:00.535036] [INFO ] [REMOTE    ] NIM: Incremental fetch complete for 2025-04 (0.39 seconds).
[2025-10-24T20:10:00.947741] [INFO ] [REMOTE    ] NIM: Fetching primary data for 2025-05.
[2025-10-24T20:10:01.485636] [INFO ] [REMOTE    ] NIM: Incremental fetch complete for 2025-05 (0.54 seconds).
[2025-10-24T20:10:01.747738] [INFO ] [REMOTE    ] NI: Fetching primary data for 2025-10.
[2025-10-24T20:10:02.547765] [INFO ] [REMOTE    ] NIM: Fetching primary data for 2025-06.
[2025-10-24T20:10:03.197598] [INFO ] [REMOTE    ] NIM: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T20:10:03.347757] [INFO ] [REMOTE    ] NIM: Fetching primary data for 2025-07.
[2025-10-24T20:10:03.733750] [INFO ] [REMOTE    ] NI: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T20:10:03.746695] [INFO ] [REMOTE    ] NI: Full fetch complete (77508 records).
[2025-10-24T20:10:03.747154] [DEBUG] [VALIDATOR ] NI: Validating primary data.
[2025-10-24T20:10:04.022381] [INFO ] [REMOTE    ] NIM: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T20:10:04.162807] [INFO ] [REMOTE    ] NIM: Fetching primary data for 2025-08.
[2025-10-24T20:10:04.196178] [DEBUG] [VALIDATOR ] NI: All expected trading days are present.
[2025-10-24T20:10:04.196301] [DEBUG] [VALIDATOR ] NI: Primary data validation passed.
[2025-10-24T20:10:04.198332] [INFO ] [MAIN      ] NI: Fetched primary data is valid.
[2025-10-24T20:10:04.198590] [DEBUG] [LOCAL     ] NI: Saving primary data.
[2025-10-24T20:10:04.199557] [FATAL] [LOCAL     ] NI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:10:04.199722] [FATAL] [MAIN      ] NI: Failed to save primary data.
[2025-10-24T20:10:04.199805] [WARN ] [MAIN      ] NI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:10:04.199887] [INFO ] [LOCAL     ] NI: Starting deletion of primary data.
[2025-10-24T20:10:04.199966] [DEBUG] [LOCAL     ] NI: No primary data file found to delete.
[2025-10-24T20:10:04.200015] [INFO ] [LOCAL     ] NI: Starting deletion of derivative data.
[2025-10-24T20:10:04.200195] [DEBUG] [LOCAL     ] NI: Deleted derivative data file.
[2025-10-24T20:10:04.200626] [INFO ] [MAIN      ] Update Progress: 1479/2366 symbols completed. NI took 42.9s. Estimated remaining: 1h 53m 58s. Rate: 7.8 symbols/min
[2025-10-24T20:10:04.739086] [INFO ] [REMOTE    ] NIM: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T20:10:04.947739] [INFO ] [REMOTE    ] NIM: Fetching primary data for 2025-09.
[2025-10-24T20:10:05.474960] [INFO ] [REMOTE    ] NIM: Incremental fetch complete for 2025-09 (0.53 seconds).
[2025-10-24T20:10:05.747746] [INFO ] [REMOTE    ] NIM: Fetching primary data for 2025-10.
[2025-10-24T20:10:06.341037] [INFO ] [REMOTE    ] NIM: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T20:10:06.342107] [INFO ] [REMOTE    ] NIM: Full fetch complete (6111 records).
[2025-10-24T20:10:06.342176] [DEBUG] [VALIDATOR ] NIM: Validating primary data.
[2025-10-24T20:10:06.734569] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present.
[2025-10-24T20:10:06.734708] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed.
[2025-10-24T20:10:06.735012] [INFO ] [MAIN      ] NIM: Fetched primary data is valid.
[2025-10-24T20:10:06.735058] [DEBUG] [LOCAL     ] NIM: Saving primary data.
[2025-10-24T20:10:06.735306] [FATAL] [LOCAL     ] NIM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:10:06.735398] [FATAL] [MAIN      ] NIM: Failed to save primary data.
[2025-10-24T20:10:06.735449] [WARN ] [MAIN      ] NIM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:10:06.735485] [INFO ] [LOCAL     ] NIM: Starting deletion of primary data.
[2025-10-24T20:10:06.735540] [DEBUG] [LOCAL     ] NIM: No primary data file found to delete.
[2025-10-24T20:10:06.735577] [INFO ] [LOCAL     ] NIM: Starting deletion of derivative data.
[2025-10-24T20:10:06.735749] [DEBUG] [LOCAL     ] NIM: Deleted derivative data file.
[2025-10-24T20:10:06.735856] [INFO ] [MAIN      ] Update Progress: 1480/2366 symbols completed. NIM took 16.2s. Estimated remaining: 1h 53m 47s. Rate: 7.8 symbols/min
[2025-10-24T20:10:07.387490] [INFO ] [MAIN      ] NIO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:10:07.502430] [INFO ] [MAIN      ] NIQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:10:07.542196] [INFO ] [MAIN      ] NINE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:10:07.548285] [INFO ] [MAIN      ] NJR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:10:07.548501] [DEBUG] [LOCAL     ] NIQ: No existing data file found in primary storage.
[2025-10-24T20:10:07.549677] [WARN ] [MAIN      ] NIQ: No existing data found, performing full refresh instead.
[2025-10-24T20:10:07.549901] [INFO ] [MAIN      ] NIQ: Wiping existing primary data before full refresh.
[2025-10-24T20:10:07.550023] [INFO ] [LOCAL     ] NIQ: Starting deletion of primary data.
[2025-10-24T20:10:07.550308] [DEBUG] [LOCAL     ] NIQ: No primary data file found to delete.
[2025-10-24T20:10:07.550367] [INFO ] [MAIN      ] NIQ: Starting full primary refresh.
[2025-10-24T20:10:07.773325] [DEBUG] [LOCAL     ] NINE: Loaded 29054 existing records from primary storage.
[2025-10-24T20:10:07.840764] [INFO ] [MAIN      ] NINE: Loaded 29054 existing records.
[2025-10-24T20:10:07.842749] [DEBUG] [LOCAL     ] NIO: Loaded 54192 existing records from primary storage.
[2025-10-24T20:10:07.928308] [INFO ] [MAIN      ] NIO: Loaded 54192 existing records.
[2025-10-24T20:10:08.093826] [DEBUG] [LOCAL     ] NJR: Loaded 38100 existing records from primary storage.
[2025-10-24T20:10:08.168620] [INFO ] [MAIN      ] NJR: Loaded 38100 existing records.
[2025-10-24T20:10:08.373320] [WARN ] [MAIN      ] NINE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:10:08.484564] [INFO ] [MAIN      ] NINE: Wiping existing primary data before full refresh.
[2025-10-24T20:10:08.454156] [INFO ] [REMOTE    ] NIQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:10:08.515037] [INFO ] [LOCAL     ] NINE: Starting deletion of primary data.
[2025-10-24T20:10:08.520067] [INFO ] [REMOTE    ] NIQ: Fetching primary data for 2025-01.
[2025-10-24T20:10:08.544226] [DEBUG] [LOCAL     ] NINE: Deleted primary data file.
[2025-10-24T20:10:08.561674] [INFO ] [MAIN      ] NINE: Starting full primary refresh.
[2025-10-24T20:10:08.556168] [WARN ] [MAIN      ] NIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:10:08.601422] [INFO ] [MAIN      ] NIO: Wiping existing primary data before full refresh.
[2025-10-24T20:10:08.613166] [INFO ] [LOCAL     ] NIO: Starting deletion of primary data.
[2025-10-24T20:10:08.673899] [WARN ] [MAIN      ] NJR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:10:08.695420] [DEBUG] [LOCAL     ] NIO: Deleted primary data file.
[2025-10-24T20:10:08.695557] [INFO ] [MAIN      ] NIO: Starting full primary refresh.
[2025-10-24T20:10:08.695756] [INFO ] [MAIN      ] NJR: Wiping existing primary data before full refresh.
[2025-10-24T20:10:08.710154] [INFO ] [LOCAL     ] NJR: Starting deletion of primary data.
[2025-10-24T20:10:08.715520] [DEBUG] [LOCAL     ] NJR: Deleted primary data file.
[2025-10-24T20:10:08.738575] [INFO ] [MAIN      ] NJR: Starting full primary refresh.
[2025-10-24T20:10:08.828531] [DEBUG] [REMOTE    ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:10:08.903915] [WARN ] [REMOTE    ] NIQ: No data returned for month 2025-01
[2025-10-24T20:10:08.977008] [FATAL] [REMOTE    ] NIQ: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:10:09.050853] [FATAL] [MAIN      ] NIQ: Failed to fetch primary data.
[2025-10-24T20:10:09.079961] [WARN ] [MAIN      ] NIQ: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:10:09.149699] [INFO ] [LOCAL     ] NIQ: Starting deletion of primary data.
[2025-10-24T20:10:09.213278] [DEBUG] [LOCAL     ] NIQ: No primary data file found to delete.
[2025-10-24T20:10:09.265110] [INFO ] [LOCAL     ] NIQ: Starting deletion of derivative data.
[2025-10-24T20:10:09.408050] [DEBUG] [LOCAL     ] NIQ: No derivative data file found to delete.
[2025-10-24T20:10:09.526962] [INFO ] [MAIN      ] Update Progress: 1481/2366 symbols completed. NIQ took 2.8s. Estimated remaining: 1h 53m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:10:09.910081] [INFO ] [REMOTE    ] NINE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:10:09.921447] [INFO ] [REMOTE    ] NINE: Fetching primary data for 2025-01.
[2025-10-24T20:10:09.830250] [INFO ] [REMOTE    ] NIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:10:09.938702] [INFO ] [REMOTE    ] NIO: Fetching primary data for 2025-01.
[2025-10-24T20:10:10.026942] [INFO ] [MAIN      ] NKE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:10:10.075489] [DEBUG] [LOCAL     ] NKE: No existing data file found in primary storage.
[2025-10-24T20:10:10.110211] [WARN ] [MAIN      ] NKE: No existing data found, performing full refresh instead.
[2025-10-24T20:10:10.116141] [INFO ] [REMOTE    ] NJR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:10:10.117320] [INFO ] [MAIN      ] NKE: Wiping existing primary data before full refresh.
[2025-10-24T20:10:10.117471] [INFO ] [LOCAL     ] NKE: Starting deletion of primary data.
[2025-10-24T20:10:10.117997] [INFO ] [REMOTE    ] NJR: Fetching primary data for 2025-01.
[2025-10-24T20:10:10.117615] [DEBUG] [LOCAL     ] NKE: No primary data file found to delete.
[2025-10-24T20:10:10.119189] [INFO ] [MAIN      ] NKE: Starting full primary refresh.
[2025-10-24T20:10:10.628974] [INFO ] [REMOTE    ] NKE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:10:10.629306] [INFO ] [REMOTE    ] NKE: Fetching primary data for 2025-01.
[2025-10-24T20:10:11.620780] [INFO ] [REMOTE    ] NJR: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T20:10:11.632106] [INFO ] [REMOTE    ] NJR: Fetching primary data for 2025-02.
[2025-10-24T20:10:11.703529] [INFO ] [REMOTE    ] NINE: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T20:10:11.713301] [INFO ] [REMOTE    ] NINE: Fetching primary data for 2025-02.
[2025-10-24T20:10:12.370790] [INFO ] [REMOTE    ] NIO: Incremental fetch complete for 2025-01 (2.43 seconds).
[2025-10-24T20:10:12.381490] [INFO ] [REMOTE    ] NIO: Fetching primary data for 2025-02.
[2025-10-24T20:10:12.797837] [INFO ] [REMOTE    ] NKE: Incremental fetch complete for 2025-01 (2.17 seconds).
[2025-10-24T20:10:12.935680] [INFO ] [REMOTE    ] NINE: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T20:10:12.947627] [INFO ] [REMOTE    ] NKE: Fetching primary data for 2025-02.
[2025-10-24T20:10:13.015740] [INFO ] [REMOTE    ] NJR: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T20:10:13.747716] [INFO ] [REMOTE    ] NJR: Fetching primary data for 2025-03.
[2025-10-24T20:10:14.181986] [INFO ] [REMOTE    ] NIO: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T20:10:14.547714] [INFO ] [REMOTE    ] NIO: Fetching primary data for 2025-03.
[2025-10-24T20:10:14.909379] [INFO ] [REMOTE    ] NJR: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T20:10:15.116173] [INFO ] [REMOTE    ] NKE: Incremental fetch complete for 2025-02 (2.17 seconds).
[2025-10-24T20:10:15.347706] [INFO ] [REMOTE    ] NKE: Fetching primary data for 2025-03.
[2025-10-24T20:10:16.147744] [INFO ] [REMOTE    ] NJR: Fetching primary data for 2025-04.
[2025-10-24T20:10:16.891296] [INFO ] [REMOTE    ] NIO: Incremental fetch complete for 2025-03 (2.34 seconds).
[2025-10-24T20:10:16.947738] [INFO ] [REMOTE    ] NINE: Fetching primary data for 2025-03.
[2025-10-24T20:10:17.614959] [INFO ] [REMOTE    ] NJR: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T20:10:17.747631] [INFO ] [REMOTE    ] NJR: Fetching primary data for 2025-05.
[2025-10-24T20:10:18.232228] [INFO ] [REMOTE    ] NINE: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T20:10:18.330538] [INFO ] [REMOTE    ] NKE: Incremental fetch complete for 2025-03 (2.98 seconds).
[2025-10-24T20:10:18.547711] [INFO ] [REMOTE    ] NKE: Fetching primary data for 2025-04.
[2025-10-24T20:10:19.310914] [INFO ] [REMOTE    ] NJR: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T20:10:19.347702] [INFO ] [REMOTE    ] NINE: Fetching primary data for 2025-04.
[2025-10-24T20:10:20.147746] [INFO ] [REMOTE    ] NJR: Fetching primary data for 2025-06.
[2025-10-24T20:10:20.595358] [INFO ] [REMOTE    ] NINE: Incremental fetch complete for 2025-04 (1.25 seconds).
[2025-10-24T20:10:20.947686] [INFO ] [REMOTE    ] NINE: Fetching primary data for 2025-05.
[2025-10-24T20:10:21.266144] [INFO ] [REMOTE    ] NKE: Incremental fetch complete for 2025-04 (2.72 seconds).
[2025-10-24T20:10:21.747635] [INFO ] [REMOTE    ] NKE: Fetching primary data for 2025-05.
[2025-10-24T20:10:22.312009] [INFO ] [REMOTE    ] NINE: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T20:10:22.547707] [INFO ] [REMOTE    ] NINE: Fetching primary data for 2025-06.
[2025-10-24T20:10:22.585633] [INFO ] [REMOTE    ] NJR: Incremental fetch complete for 2025-06 (2.44 seconds).
[2025-10-24T20:10:23.347714] [INFO ] [REMOTE    ] NJR: Fetching primary data for 2025-07.
[2025-10-24T20:10:24.026504] [INFO ] [REMOTE    ] NKE: Incremental fetch complete for 2025-05 (2.28 seconds).
[2025-10-24T20:10:24.100684] [INFO ] [REMOTE    ] NINE: Incremental fetch complete for 2025-06 (1.55 seconds).
[2025-10-24T20:10:24.147707] [INFO ] [REMOTE    ] NIO: Fetching primary data for 2025-04.
[2025-10-24T20:10:24.778983] [INFO ] [REMOTE    ] NJR: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T20:10:24.947710] [INFO ] [REMOTE    ] NJR: Fetching primary data for 2025-08.
[2025-10-24T20:10:25.747756] [INFO ] [REMOTE    ] NKE: Fetching primary data for 2025-06.
[2025-10-24T20:10:26.319288] [INFO ] [REMOTE    ] NJR: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T20:10:26.424986] [INFO ] [REMOTE    ] NIO: Incremental fetch complete for 2025-04 (2.28 seconds).
[2025-10-24T20:10:26.547745] [INFO ] [REMOTE    ] NIO: Fetching primary data for 2025-05.
[2025-10-24T20:10:27.347731] [INFO ] [REMOTE    ] NINE: Fetching primary data for 2025-07.
[2025-10-24T20:10:28.147628] [INFO ] [REMOTE    ] NJR: Fetching primary data for 2025-09.
[2025-10-24T20:10:28.655932] [INFO ] [REMOTE    ] NKE: Incremental fetch complete for 2025-06 (2.91 seconds).
[2025-10-24T20:10:28.750697] [INFO ] [REMOTE    ] NIO: Incremental fetch complete for 2025-05 (2.20 seconds).
[2025-10-24T20:10:28.783674] [INFO ] [REMOTE    ] NINE: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T20:10:28.947726] [INFO ] [REMOTE    ] NIO: Fetching primary data for 2025-06.
[2025-10-24T20:10:29.493920] [INFO ] [REMOTE    ] NJR: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T20:10:29.747670] [INFO ] [REMOTE    ] NJR: Fetching primary data for 2025-10.
[2025-10-24T20:10:30.547637] [INFO ] [REMOTE    ] NINE: Fetching primary data for 2025-08.
[2025-10-24T20:10:31.197148] [INFO ] [REMOTE    ] NJR: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T20:10:31.203943] [INFO ] [REMOTE    ] NJR: Full fetch complete (54768 records).
[2025-10-24T20:10:31.204042] [DEBUG] [VALIDATOR ] NJR: Validating primary data.
[2025-10-24T20:10:31.352173] [INFO ] [REMOTE    ] NKE: Fetching primary data for 2025-07.
[2025-10-24T20:10:31.628447] [INFO ] [REMOTE    ] NIO: Incremental fetch complete for 2025-06 (2.68 seconds).
[2025-10-24T20:10:31.626618] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present.
[2025-10-24T20:10:31.638269] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed.
[2025-10-24T20:10:31.642109] [INFO ] [MAIN      ] NJR: Fetched primary data is valid.
[2025-10-24T20:10:31.642860] [DEBUG] [LOCAL     ] NJR: Saving primary data.
[2025-10-24T20:10:31.649005] [FATAL] [LOCAL     ] NJR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:10:31.657232] [FATAL] [MAIN      ] NJR: Failed to save primary data.
[2025-10-24T20:10:31.658291] [INFO ] [REMOTE    ] NINE: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T20:10:31.658373] [WARN ] [MAIN      ] NJR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:10:31.663926] [INFO ] [LOCAL     ] NJR: Starting deletion of primary data.
[2025-10-24T20:10:31.664015] [DEBUG] [LOCAL     ] NJR: No primary data file found to delete.
[2025-10-24T20:10:31.664328] [INFO ] [LOCAL     ] NJR: Starting deletion of derivative data.
[2025-10-24T20:10:31.664521] [DEBUG] [LOCAL     ] NJR: Deleted derivative data file.
[2025-10-24T20:10:31.664915] [INFO ] [MAIN      ] Update Progress: 1482/2366 symbols completed. NJR took 24.9s. Estimated remaining: 1h 53m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:10:31.830571] [INFO ] [MAIN      ] NKX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:10:31.847926] [DEBUG] [LOCAL     ] NKX: Loaded 13725 existing records from primary storage.
[2025-10-24T20:10:31.848162] [INFO ] [MAIN      ] NKX: Loaded 13725 existing records.
[2025-10-24T20:10:32.022044] [WARN ] [MAIN      ] NKX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:10:32.022249] [INFO ] [MAIN      ] NKX: Wiping existing primary data before full refresh.
[2025-10-24T20:10:32.022295] [INFO ] [LOCAL     ] NKX: Starting deletion of primary data.
[2025-10-24T20:10:32.022479] [DEBUG] [LOCAL     ] NKX: Deleted primary data file.
[2025-10-24T20:10:32.022534] [INFO ] [MAIN      ] NKX: Starting full primary refresh.
[2025-10-24T20:10:32.159791] [INFO ] [REMOTE    ] NINE: Fetching primary data for 2025-09.
[2025-10-24T20:10:32.382904] [INFO ] [REMOTE    ] NKX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:10:32.947707] [INFO ] [REMOTE    ] NKX: Fetching primary data for 2025-01.
[2025-10-24T20:10:33.296757] [INFO ] [REMOTE    ] NINE: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T20:10:33.735927] [INFO ] [REMOTE    ] NKX: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T20:10:33.747596] [INFO ] [REMOTE    ] NKX: Fetching primary data for 2025-02.
[2025-10-24T20:10:34.547743] [INFO ] [REMOTE    ] NINE: Fetching primary data for 2025-10.
[2025-10-24T20:10:35.083873] [INFO ] [REMOTE    ] NKE: Incremental fetch complete for 2025-07 (3.73 seconds).
[2025-10-24T20:10:35.347703] [INFO ] [REMOTE    ] NKE: Fetching primary data for 2025-08.
[2025-10-24T20:10:35.401817] [INFO ] [REMOTE    ] NKX: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T20:10:36.147756] [INFO ] [REMOTE    ] NIO: Fetching primary data for 2025-07.
[2025-10-24T20:10:36.269892] [INFO ] [REMOTE    ] NINE: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T20:10:36.275995] [INFO ] [REMOTE    ] NINE: Full fetch complete (43305 records).
[2025-10-24T20:10:36.276137] [DEBUG] [VALIDATOR ] NINE: Validating primary data.
[2025-10-24T20:10:36.653544] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present.
[2025-10-24T20:10:36.653619] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed.
[2025-10-24T20:10:36.654568] [INFO ] [MAIN      ] NINE: Fetched primary data is valid.
[2025-10-24T20:10:36.654625] [DEBUG] [LOCAL     ] NINE: Saving primary data.
[2025-10-24T20:10:36.655031] [FATAL] [LOCAL     ] NINE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:10:36.655137] [FATAL] [MAIN      ] NINE: Failed to save primary data.
[2025-10-24T20:10:36.655180] [WARN ] [MAIN      ] NINE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:10:36.655243] [INFO ] [LOCAL     ] NINE: Starting deletion of primary data.
[2025-10-24T20:10:36.655302] [DEBUG] [LOCAL     ] NINE: No primary data file found to delete.
[2025-10-24T20:10:36.655338] [INFO ] [LOCAL     ] NINE: Starting deletion of derivative data.
[2025-10-24T20:10:36.655460] [DEBUG] [LOCAL     ] NINE: Deleted derivative data file.
[2025-10-24T20:10:36.655534] [INFO ] [MAIN      ] Update Progress: 1483/2366 symbols completed. NINE took 29.9s. Estimated remaining: 1h 53m 28s. Rate: 7.8 symbols/min
[2025-10-24T20:10:36.822470] [INFO ] [MAIN      ] NL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:10:36.822626] [DEBUG] [LOCAL     ] NL: No existing data file found in primary storage.
[2025-10-24T20:10:36.822695] [WARN ] [MAIN      ] NL: No existing data found, performing full refresh instead.
[2025-10-24T20:10:36.822810] [INFO ] [MAIN      ] NL: Wiping existing primary data before full refresh.
[2025-10-24T20:10:36.822851] [INFO ] [LOCAL     ] NL: Starting deletion of primary data.
[2025-10-24T20:10:36.822895] [DEBUG] [LOCAL     ] NL: No primary data file found to delete.
[2025-10-24T20:10:36.822928] [INFO ] [MAIN      ] NL: Starting full primary refresh.
[2025-10-24T20:10:36.951504] [INFO ] [REMOTE    ] NKX: Fetching primary data for 2025-03.
[2025-10-24T20:10:37.185203] [INFO ] [REMOTE    ] NL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:10:37.379797] [INFO ] [REMOTE    ] NKE: Incremental fetch complete for 2025-08 (2.03 seconds).
[2025-10-24T20:10:37.498680] [INFO ] [REMOTE    ] NKX: Incremental fetch complete for 2025-03 (0.55 seconds).
[2025-10-24T20:10:37.747626] [INFO ] [REMOTE    ] NL: Fetching primary data for 2025-01.
[2025-10-24T20:10:38.363316] [INFO ] [REMOTE    ] NL: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T20:10:38.547621] [INFO ] [REMOTE    ] NKE: Fetching primary data for 2025-09.
[2025-10-24T20:10:38.693406] [INFO ] [REMOTE    ] NIO: Incremental fetch complete for 2025-07 (2.55 seconds).
[2025-10-24T20:10:39.347638] [INFO ] [REMOTE    ] NIO: Fetching primary data for 2025-08.
[2025-10-24T20:10:40.147734] [INFO ] [REMOTE    ] NKX: Fetching primary data for 2025-04.
[2025-10-24T20:10:40.947713] [INFO ] [REMOTE    ] NL: Fetching primary data for 2025-02.
[2025-10-24T20:10:41.002349] [INFO ] [REMOTE    ] NKE: Incremental fetch complete for 2025-09 (2.45 seconds).
[2025-10-24T20:10:41.041497] [INFO ] [REMOTE    ] NKX: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T20:10:41.272290] [INFO ] [REMOTE    ] NL: Incremental fetch complete for 2025-02 (0.32 seconds).
[2025-10-24T20:10:41.523544] [INFO ] [REMOTE    ] NIO: Incremental fetch complete for 2025-08 (2.18 seconds).
[2025-10-24T20:10:41.747712] [INFO ] [REMOTE    ] NKE: Fetching primary data for 2025-10.
[2025-10-24T20:10:42.547707] [INFO ] [REMOTE    ] NL: Fetching primary data for 2025-03.
[2025-10-24T20:10:43.132218] [INFO ] [REMOTE    ] NL: Incremental fetch complete for 2025-03 (0.58 seconds).
[2025-10-24T20:10:43.347663] [INFO ] [REMOTE    ] NKX: Fetching primary data for 2025-05.
[2025-10-24T20:10:44.147701] [INFO ] [REMOTE    ] NL: Fetching primary data for 2025-04.
[2025-10-24T20:10:44.156984] [INFO ] [REMOTE    ] NKX: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:10:44.195734] [INFO ] [REMOTE    ] NKE: Incremental fetch complete for 2025-10 (2.45 seconds).
[2025-10-24T20:10:44.205611] [INFO ] [REMOTE    ] NKE: Full fetch complete (77217 records).
[2025-10-24T20:10:44.205796] [DEBUG] [VALIDATOR ] NKE: Validating primary data.
[2025-10-24T20:10:44.404992] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days
[2025-10-24T20:10:44.405826] [FATAL] [MAIN      ] NKE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:10:44.405897] [WARN ] [MAIN      ] NKE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:10:44.405966] [INFO ] [LOCAL     ] NKE: Starting deletion of primary data.
[2025-10-24T20:10:44.406027] [DEBUG] [LOCAL     ] NKE: No primary data file found to delete.
[2025-10-24T20:10:44.406082] [INFO ] [LOCAL     ] NKE: Starting deletion of derivative data.
[2025-10-24T20:10:44.406139] [DEBUG] [LOCAL     ] NKE: No derivative data file found to delete.
[2025-10-24T20:10:44.406415] [INFO ] [MAIN      ] Update Progress: 1484/2366 symbols completed. NKE took 34.9s. Estimated remaining: 1h 53m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:10:44.575844] [INFO ] [MAIN      ] NLOP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:10:44.589681] [DEBUG] [LOCAL     ] NLOP: Loaded 11532 existing records from primary storage.
[2025-10-24T20:10:44.589905] [INFO ] [MAIN      ] NLOP: Loaded 11532 existing records.
[2025-10-24T20:10:44.775751] [WARN ] [MAIN      ] NLOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:10:44.770746] [INFO ] [REMOTE    ] NL: Incremental fetch complete for 2025-04 (0.62 seconds).
[2025-10-24T20:10:44.775964] [INFO ] [MAIN      ] NLOP: Wiping existing primary data before full refresh.
[2025-10-24T20:10:44.776031] [INFO ] [LOCAL     ] NLOP: Starting deletion of primary data.
[2025-10-24T20:10:44.777757] [DEBUG] [LOCAL     ] NLOP: Deleted primary data file.
[2025-10-24T20:10:44.778045] [INFO ] [MAIN      ] NLOP: Starting full primary refresh.
[2025-10-24T20:10:44.953095] [INFO ] [REMOTE    ] NIO: Fetching primary data for 2025-09.
[2025-10-24T20:10:45.139794] [INFO ] [REMOTE    ] NLOP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:10:45.747630] [INFO ] [REMOTE    ] NLOP: Fetching primary data for 2025-01.
[2025-10-24T20:10:46.547720] [INFO ] [REMOTE    ] NL: Fetching primary data for 2025-05.
[2025-10-24T20:10:47.220534] [INFO ] [REMOTE    ] NL: Incremental fetch complete for 2025-05 (0.67 seconds).
[2025-10-24T20:10:47.221169] [INFO ] [REMOTE    ] NLOP: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T20:10:47.258343] [INFO ] [REMOTE    ] NIO: Incremental fetch complete for 2025-09 (2.31 seconds).
[2025-10-24T20:10:47.347609] [INFO ] [REMOTE    ] NIO: Fetching primary data for 2025-10.
[2025-10-24T20:10:48.147729] [INFO ] [REMOTE    ] NLOP: Fetching primary data for 2025-02.
[2025-10-24T20:10:48.886424] [INFO ] [REMOTE    ] NLOP: Incremental fetch complete for 2025-02 (0.74 seconds).
[2025-10-24T20:10:48.947708] [INFO ] [REMOTE    ] NL: Fetching primary data for 2025-06.
[2025-10-24T20:10:49.532342] [INFO ] [REMOTE    ] NL: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T20:10:49.747711] [INFO ] [REMOTE    ] NL: Fetching primary data for 2025-07.
[2025-10-24T20:10:49.804297] [INFO ] [REMOTE    ] NIO: Incremental fetch complete for 2025-10 (2.46 seconds).
[2025-10-24T20:10:49.813972] [INFO ] [REMOTE    ] NIO: Full fetch complete (77982 records).
[2025-10-24T20:10:49.814103] [DEBUG] [VALIDATOR ] NIO: Validating primary data.
[2025-10-24T20:10:50.204753] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present.
[2025-10-24T20:10:50.204844] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed.
[2025-10-24T20:10:50.206044] [INFO ] [MAIN      ] NIO: Fetched primary data is valid.
[2025-10-24T20:10:50.206106] [DEBUG] [LOCAL     ] NIO: Saving primary data.
[2025-10-24T20:10:50.206855] [FATAL] [LOCAL     ] NIO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:10:50.206944] [FATAL] [MAIN      ] NIO: Failed to save primary data.
[2025-10-24T20:10:50.206985] [WARN ] [MAIN      ] NIO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:10:50.207057] [INFO ] [LOCAL     ] NIO: Starting deletion of primary data.
[2025-10-24T20:10:50.207141] [DEBUG] [LOCAL     ] NIO: No primary data file found to delete.
[2025-10-24T20:10:50.207189] [INFO ] [LOCAL     ] NIO: Starting deletion of derivative data.
[2025-10-24T20:10:50.207466] [DEBUG] [LOCAL     ] NIO: Deleted derivative data file.
[2025-10-24T20:10:50.207743] [INFO ] [MAIN      ] Update Progress: 1485/2366 symbols completed. NIO took 43.5s. Estimated remaining: 1h 53m 11s. Rate: 7.8 symbols/min
[2025-10-24T20:10:50.378074] [INFO ] [MAIN      ] NLY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:10:50.385550] [INFO ] [REMOTE    ] NL: Incremental fetch complete for 2025-07 (0.64 seconds).
[2025-10-24T20:10:50.438058] [DEBUG] [LOCAL     ] NLY: Loaded 53954 existing records from primary storage.
[2025-10-24T20:10:50.438391] [INFO ] [MAIN      ] NLY: Loaded 53954 existing records.
[2025-10-24T20:10:50.564411] [INFO ] [REMOTE    ] NLOP: Fetching primary data for 2025-03.
[2025-10-24T20:10:50.642296] [WARN ] [MAIN      ] NLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:10:50.642494] [INFO ] [MAIN      ] NLY: Wiping existing primary data before full refresh.
[2025-10-24T20:10:50.642570] [INFO ] [LOCAL     ] NLY: Starting deletion of primary data.
[2025-10-24T20:10:50.642863] [DEBUG] [LOCAL     ] NLY: Deleted primary data file.
[2025-10-24T20:10:50.642920] [INFO ] [MAIN      ] NLY: Starting full primary refresh.
[2025-10-24T20:10:50.992596] [INFO ] [REMOTE    ] NLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:10:51.347622] [INFO ] [REMOTE    ] NLY: Fetching primary data for 2025-01.
[2025-10-24T20:10:51.499151] [INFO ] [REMOTE    ] NLOP: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T20:10:52.147639] [INFO ] [REMOTE    ] NLOP: Fetching primary data for 2025-04.
[2025-10-24T20:10:52.947680] [INFO ] [REMOTE    ] NL: Fetching primary data for 2025-08.
[2025-10-24T20:10:53.095141] [INFO ] [REMOTE    ] NLOP: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T20:10:53.167338] [INFO ] [REMOTE    ] NLY: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T20:10:53.546050] [INFO ] [REMOTE    ] NL: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T20:10:53.747747] [INFO ] [REMOTE    ] NKX: Fetching primary data for 2025-06.
[2025-10-24T20:10:54.547692] [INFO ] [REMOTE    ] NLOP: Fetching primary data for 2025-05.
[2025-10-24T20:10:54.814269] [INFO ] [REMOTE    ] NKX: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T20:10:55.351891] [INFO ] [REMOTE    ] NL: Fetching primary data for 2025-09.
[2025-10-24T20:10:55.354166] [INFO ] [REMOTE    ] NLOP: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:10:55.931632] [INFO ] [REMOTE    ] NL: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T20:10:56.147699] [INFO ] [REMOTE    ] NL: Fetching primary data for 2025-10.
[2025-10-24T20:10:56.885167] [INFO ] [REMOTE    ] NL: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T20:10:56.886535] [INFO ] [REMOTE    ] NL: Full fetch complete (6892 records).
[2025-10-24T20:10:56.886603] [DEBUG] [VALIDATOR ] NL: Validating primary data.
[2025-10-24T20:10:56.952796] [INFO ] [REMOTE    ] NLOP: Fetching primary data for 2025-06.
[2025-10-24T20:10:57.072662] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T20:10:57.072946] [FATAL] [MAIN      ] NL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:10:57.073035] [WARN ] [MAIN      ] NL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:10:57.073129] [INFO ] [LOCAL     ] NL: Starting deletion of primary data.
[2025-10-24T20:10:57.073209] [DEBUG] [LOCAL     ] NL: No primary data file found to delete.
[2025-10-24T20:10:57.073249] [INFO ] [LOCAL     ] NL: Starting deletion of derivative data.
[2025-10-24T20:10:57.073308] [DEBUG] [LOCAL     ] NL: No derivative data file found to delete.
[2025-10-24T20:10:57.073373] [INFO ] [MAIN      ] Update Progress: 1486/2366 symbols completed. NL took 20.4s. Estimated remaining: 1h 53m 3s. Rate: 7.8 symbols/min
[2025-10-24T20:10:57.241088] [INFO ] [MAIN      ] NMAI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:10:57.256925] [DEBUG] [LOCAL     ] NMAI: Loaded 12639 existing records from primary storage.
[2025-10-24T20:10:57.257158] [INFO ] [MAIN      ] NMAI: Loaded 12639 existing records.
[2025-10-24T20:10:57.432014] [WARN ] [MAIN      ] NMAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:10:57.432203] [INFO ] [MAIN      ] NMAI: Wiping existing primary data before full refresh.
[2025-10-24T20:10:57.432250] [INFO ] [LOCAL     ] NMAI: Starting deletion of primary data.
[2025-10-24T20:10:57.432419] [DEBUG] [LOCAL     ] NMAI: Deleted primary data file.
[2025-10-24T20:10:57.432485] [INFO ] [MAIN      ] NMAI: Starting full primary refresh.
[2025-10-24T20:10:57.752727] [INFO ] [REMOTE    ] NLY: Fetching primary data for 2025-02.
[2025-10-24T20:10:57.788962] [INFO ] [REMOTE    ] NMAI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:10:57.796361] [INFO ] [REMOTE    ] NLOP: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T20:10:58.547697] [INFO ] [REMOTE    ] NKX: Fetching primary data for 2025-07.
[2025-10-24T20:10:59.347694] [INFO ] [REMOTE    ] NLOP: Fetching primary data for 2025-07.
[2025-10-24T20:10:59.500394] [INFO ] [REMOTE    ] NKX: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T20:10:59.643854] [INFO ] [REMOTE    ] NLY: Incremental fetch complete for 2025-02 (1.89 seconds).
[2025-10-24T20:10:59.879556] [INFO ] [REMOTE    ] NLOP: Incremental fetch complete for 2025-07 (0.53 seconds).
[2025-10-24T20:11:00.147724] [INFO ] [REMOTE    ] NMAI: Fetching primary data for 2025-01.
[2025-10-24T20:11:00.947716] [INFO ] [REMOTE    ] NLOP: Fetching primary data for 2025-08.
[2025-10-24T20:11:01.271848] [INFO ] [REMOTE    ] NMAI: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T20:11:01.747697] [INFO ] [REMOTE    ] NLY: Fetching primary data for 2025-03.
[2025-10-24T20:11:01.912327] [INFO ] [REMOTE    ] NLOP: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T20:11:02.547747] [INFO ] [REMOTE    ] NMAI: Fetching primary data for 2025-02.
[2025-10-24T20:11:03.347735] [INFO ] [REMOTE    ] NKX: Fetching primary data for 2025-08.
[2025-10-24T20:11:03.501032] [INFO ] [REMOTE    ] NLY: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T20:11:03.538012] [INFO ] [REMOTE    ] NMAI: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T20:11:04.122695] [INFO ] [REMOTE    ] NKX: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T20:11:04.147674] [INFO ] [REMOTE    ] NKX: Fetching primary data for 2025-09.
[2025-10-24T20:11:04.947715] [INFO ] [REMOTE    ] NMAI: Fetching primary data for 2025-03.
[2025-10-24T20:11:05.056431] [INFO ] [REMOTE    ] NKX: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T20:11:05.747632] [INFO ] [REMOTE    ] NLY: Fetching primary data for 2025-04.
[2025-10-24T20:11:05.851913] [INFO ] [REMOTE    ] NMAI: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T20:11:06.547732] [INFO ] [REMOTE    ] NMAI: Fetching primary data for 2025-04.
[2025-10-24T20:11:07.352220] [INFO ] [REMOTE    ] NLOP: Fetching primary data for 2025-09.
[2025-10-24T20:11:07.353055] [INFO ] [REMOTE    ] NMAI: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T20:11:07.614254] [INFO ] [REMOTE    ] NLY: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T20:11:08.147764] [INFO ] [REMOTE    ] NKX: Fetching primary data for 2025-10.
[2025-10-24T20:11:08.322461] [INFO ] [REMOTE    ] NLOP: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T20:11:08.947727] [INFO ] [REMOTE    ] NMAI: Fetching primary data for 2025-05.
[2025-10-24T20:11:09.328758] [INFO ] [REMOTE    ] NKX: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T20:11:09.331473] [INFO ] [REMOTE    ] NKX: Full fetch complete (19027 records).
[2025-10-24T20:11:09.331567] [DEBUG] [VALIDATOR ] NKX: Validating primary data.
[2025-10-24T20:11:09.499748] [INFO ] [REMOTE    ] NMAI: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T20:11:09.749085] [INFO ] [REMOTE    ] NLY: Fetching primary data for 2025-05.
[2025-10-24T20:11:09.749597] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present.
[2025-10-24T20:11:09.750316] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed.
[2025-10-24T20:11:09.750853] [INFO ] [MAIN      ] NKX: Fetched primary data is valid.
[2025-10-24T20:11:09.750924] [DEBUG] [LOCAL     ] NKX: Saving primary data.
[2025-10-24T20:11:09.751338] [FATAL] [LOCAL     ] NKX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:11:09.751462] [FATAL] [MAIN      ] NKX: Failed to save primary data.
[2025-10-24T20:11:09.751545] [WARN ] [MAIN      ] NKX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:11:09.751619] [INFO ] [LOCAL     ] NKX: Starting deletion of primary data.
[2025-10-24T20:11:09.751732] [DEBUG] [LOCAL     ] NKX: No primary data file found to delete.
[2025-10-24T20:11:09.751785] [INFO ] [LOCAL     ] NKX: Starting deletion of derivative data.
[2025-10-24T20:11:09.751928] [DEBUG] [LOCAL     ] NKX: Deleted derivative data file.
[2025-10-24T20:11:09.752018] [INFO ] [MAIN      ] Update Progress: 1487/2366 symbols completed. NKX took 38.1s. Estimated remaining: 1h 52m 58s. Rate: 7.8 symbols/min
[2025-10-24T20:11:09.926221] [INFO ] [MAIN      ] NMAX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:11:09.926382] [DEBUG] [LOCAL     ] NMAX: No existing data file found in primary storage.
[2025-10-24T20:11:09.926419] [WARN ] [MAIN      ] NMAX: No existing data found, performing full refresh instead.
[2025-10-24T20:11:09.926527] [INFO ] [MAIN      ] NMAX: Wiping existing primary data before full refresh.
[2025-10-24T20:11:09.926570] [INFO ] [LOCAL     ] NMAX: Starting deletion of primary data.
[2025-10-24T20:11:09.926682] [DEBUG] [LOCAL     ] NMAX: No primary data file found to delete.
[2025-10-24T20:11:09.926735] [INFO ] [MAIN      ] NMAX: Starting full primary refresh.
[2025-10-24T20:11:10.277521] [INFO ] [REMOTE    ] NMAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:11:10.547670] [INFO ] [REMOTE    ] NMAX: Fetching primary data for 2025-01.
[2025-10-24T20:11:10.789010] [DEBUG] [REMOTE    ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:11:10.789282] [WARN ] [REMOTE    ] NMAX: No data returned for month 2025-01
[2025-10-24T20:11:10.789367] [FATAL] [REMOTE    ] NMAX: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:11:10.789416] [FATAL] [MAIN      ] NMAX: Failed to fetch primary data.
[2025-10-24T20:11:10.789449] [WARN ] [MAIN      ] NMAX: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:11:10.789513] [INFO ] [LOCAL     ] NMAX: Starting deletion of primary data.
[2025-10-24T20:11:10.789574] [DEBUG] [LOCAL     ] NMAX: No primary data file found to delete.
[2025-10-24T20:11:10.789607] [INFO ] [LOCAL     ] NMAX: Starting deletion of derivative data.
[2025-10-24T20:11:10.789673] [DEBUG] [LOCAL     ] NMAX: No derivative data file found to delete.
[2025-10-24T20:11:10.789740] [INFO ] [MAIN      ] Update Progress: 1488/2366 symbols completed. NMAX took 1.0s. Estimated remaining: 1h 52m 47s. Rate: 7.8 symbols/min
[2025-10-24T20:11:10.955954] [INFO ] [MAIN      ] NMCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:11:10.974842] [DEBUG] [LOCAL     ] NMCO: Loaded 16776 existing records from primary storage.
[2025-10-24T20:11:10.975083] [INFO ] [MAIN      ] NMCO: Loaded 16776 existing records.
[2025-10-24T20:11:11.149672] [WARN ] [MAIN      ] NMCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:11:11.149868] [INFO ] [MAIN      ] NMCO: Wiping existing primary data before full refresh.
[2025-10-24T20:11:11.149913] [INFO ] [LOCAL     ] NMCO: Starting deletion of primary data.
[2025-10-24T20:11:11.150148] [DEBUG] [LOCAL     ] NMCO: Deleted primary data file.
[2025-10-24T20:11:11.150186] [INFO ] [MAIN      ] NMCO: Starting full primary refresh.
[2025-10-24T20:11:11.352791] [INFO ] [REMOTE    ] NMAI: Fetching primary data for 2025-06.
[2025-10-24T20:11:11.529038] [INFO ] [REMOTE    ] NMCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:11:11.560447] [INFO ] [REMOTE    ] NLY: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T20:11:12.147717] [INFO ] [REMOTE    ] NMCO: Fetching primary data for 2025-01.
[2025-10-24T20:11:12.289532] [INFO ] [REMOTE    ] NMAI: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T20:11:12.947633] [INFO ] [REMOTE    ] NMAI: Fetching primary data for 2025-07.
[2025-10-24T20:11:13.190329] [INFO ] [REMOTE    ] NMCO: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T20:11:13.655514] [INFO ] [REMOTE    ] NMAI: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T20:11:13.747611] [INFO ] [REMOTE    ] NMAI: Fetching primary data for 2025-08.
[2025-10-24T20:11:14.547733] [INFO ] [REMOTE    ] NMCO: Fetching primary data for 2025-02.
[2025-10-24T20:11:14.636787] [INFO ] [REMOTE    ] NMAI: Incremental fetch complete for 2025-08 (0.89 seconds).
[2025-10-24T20:11:15.347770] [INFO ] [REMOTE    ] NLOP: Fetching primary data for 2025-10.
[2025-10-24T20:11:15.371970] [INFO ] [REMOTE    ] NMCO: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T20:11:16.147744] [INFO ] [REMOTE    ] NMCO: Fetching primary data for 2025-03.
[2025-10-24T20:11:16.217557] [INFO ] [REMOTE    ] NLOP: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T20:11:16.219996] [INFO ] [REMOTE    ] NLOP: Full fetch complete (17585 records).
[2025-10-24T20:11:16.220084] [DEBUG] [VALIDATOR ] NLOP: Validating primary data.
[2025-10-24T20:11:16.622054] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present.
[2025-10-24T20:11:16.622136] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed.
[2025-10-24T20:11:16.622515] [INFO ] [MAIN      ] NLOP: Fetched primary data is valid.
[2025-10-24T20:11:16.622565] [DEBUG] [LOCAL     ] NLOP: Saving primary data.
[2025-10-24T20:11:16.622932] [FATAL] [LOCAL     ] NLOP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:11:16.623015] [FATAL] [MAIN      ] NLOP: Failed to save primary data.
[2025-10-24T20:11:16.623058] [WARN ] [MAIN      ] NLOP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:11:16.623102] [INFO ] [LOCAL     ] NLOP: Starting deletion of primary data.
[2025-10-24T20:11:16.623152] [DEBUG] [LOCAL     ] NLOP: No primary data file found to delete.
[2025-10-24T20:11:16.623187] [INFO ] [LOCAL     ] NLOP: Starting deletion of derivative data.
[2025-10-24T20:11:16.623342] [DEBUG] [LOCAL     ] NLOP: Deleted derivative data file.
[2025-10-24T20:11:16.623434] [INFO ] [MAIN      ] Update Progress: 1489/2366 symbols completed. NLOP took 32.2s. Estimated remaining: 1h 52m 38s. Rate: 7.8 symbols/min
[2025-10-24T20:11:16.797092] [INFO ] [MAIN      ] NMG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:11:16.811614] [DEBUG] [LOCAL     ] NMG: Loaded 12292 existing records from primary storage.
[2025-10-24T20:11:16.811889] [INFO ] [MAIN      ] NMG: Loaded 12292 existing records.
[2025-10-24T20:11:16.960189] [INFO ] [REMOTE    ] NLY: Fetching primary data for 2025-06.
[2025-10-24T20:11:17.002295] [WARN ] [MAIN      ] NMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:11:17.002701] [INFO ] [MAIN      ] NMG: Wiping existing primary data before full refresh.
[2025-10-24T20:11:17.002859] [INFO ] [LOCAL     ] NMG: Starting deletion of primary data.
[2025-10-24T20:11:17.003147] [DEBUG] [LOCAL     ] NMG: Deleted primary data file.
[2025-10-24T20:11:17.012913] [INFO ] [MAIN      ] NMG: Starting full primary refresh.
[2025-10-24T20:11:17.013810] [INFO ] [REMOTE    ] NMCO: Incremental fetch complete for 2025-03 (0.87 seconds).
[2025-10-24T20:11:17.366549] [INFO ] [REMOTE    ] NMG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:11:17.747679] [INFO ] [REMOTE    ] NMG: Fetching primary data for 2025-01.
[2025-10-24T20:11:18.547708] [INFO ] [REMOTE    ] NMCO: Fetching primary data for 2025-04.
[2025-10-24T20:11:18.673547] [INFO ] [REMOTE    ] NMG: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T20:11:18.739560] [INFO ] [REMOTE    ] NLY: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T20:11:19.347631] [INFO ] [REMOTE    ] NMG: Fetching primary data for 2025-02.
[2025-10-24T20:11:19.516158] [INFO ] [REMOTE    ] NMCO: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T20:11:20.041615] [INFO ] [REMOTE    ] NMG: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T20:11:20.147772] [INFO ] [REMOTE    ] NMAI: Fetching primary data for 2025-09.
[2025-10-24T20:11:20.947720] [INFO ] [REMOTE    ] NMG: Fetching primary data for 2025-03.
[2025-10-24T20:11:21.128034] [INFO ] [REMOTE    ] NMAI: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T20:11:21.553457] [INFO ] [REMOTE    ] NMG: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T20:11:21.747694] [INFO ] [REMOTE    ] NMCO: Fetching primary data for 2025-05.
[2025-10-24T20:11:22.547638] [INFO ] [REMOTE    ] NMAI: Fetching primary data for 2025-10.
[2025-10-24T20:11:22.680715] [INFO ] [REMOTE    ] NMCO: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T20:11:23.347606] [INFO ] [REMOTE    ] NMCO: Fetching primary data for 2025-06.
[2025-10-24T20:11:23.431403] [INFO ] [REMOTE    ] NMAI: Incremental fetch complete for 2025-10 (0.88 seconds).
[2025-10-24T20:11:23.434137] [INFO ] [REMOTE    ] NMAI: Full fetch complete (19428 records).
[2025-10-24T20:11:23.434219] [DEBUG] [VALIDATOR ] NMAI: Validating primary data.
[2025-10-24T20:11:23.796837] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present.
[2025-10-24T20:11:23.796944] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed.
[2025-10-24T20:11:23.797537] [INFO ] [MAIN      ] NMAI: Fetched primary data is valid.
[2025-10-24T20:11:23.797599] [DEBUG] [LOCAL     ] NMAI: Saving primary data.
[2025-10-24T20:11:23.797885] [FATAL] [LOCAL     ] NMAI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:11:23.797960] [FATAL] [MAIN      ] NMAI: Failed to save primary data.
[2025-10-24T20:11:23.798026] [WARN ] [MAIN      ] NMAI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:11:23.798090] [INFO ] [LOCAL     ] NMAI: Starting deletion of primary data.
[2025-10-24T20:11:23.798146] [DEBUG] [LOCAL     ] NMAI: No primary data file found to delete.
[2025-10-24T20:11:23.798182] [INFO ] [LOCAL     ] NMAI: Starting deletion of derivative data.
[2025-10-24T20:11:23.798354] [DEBUG] [LOCAL     ] NMAI: Deleted derivative data file.
[2025-10-24T20:11:23.798441] [INFO ] [MAIN      ] Update Progress: 1490/2366 symbols completed. NMAI took 26.7s. Estimated remaining: 1h 52m 30s. Rate: 7.8 symbols/min
[2025-10-24T20:11:23.963605] [INFO ] [MAIN      ] NMI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:11:23.971935] [DEBUG] [LOCAL     ] NMI: Loaded 4059 existing records from primary storage.
[2025-10-24T20:11:23.972404] [INFO ] [MAIN      ] NMI: Loaded 4059 existing records.
[2025-10-24T20:11:24.098280] [INFO ] [REMOTE    ] NMCO: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T20:11:24.151576] [INFO ] [REMOTE    ] NMCO: Fetching primary data for 2025-07.
[2025-10-24T20:11:24.164299] [WARN ] [MAIN      ] NMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:11:24.165241] [INFO ] [MAIN      ] NMI: Wiping existing primary data before full refresh.
[2025-10-24T20:11:24.165293] [INFO ] [LOCAL     ] NMI: Starting deletion of primary data.
[2025-10-24T20:11:24.165422] [DEBUG] [LOCAL     ] NMI: Deleted primary data file.
[2025-10-24T20:11:24.165461] [INFO ] [MAIN      ] NMI: Starting full primary refresh.
[2025-10-24T20:11:24.510242] [INFO ] [REMOTE    ] NMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:11:24.947638] [INFO ] [REMOTE    ] NMG: Fetching primary data for 2025-04.
[2025-10-24T20:11:25.156435] [INFO ] [REMOTE    ] NMCO: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T20:11:25.725168] [INFO ] [REMOTE    ] NMG: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:11:25.747611] [INFO ] [REMOTE    ] NMCO: Fetching primary data for 2025-08.
[2025-10-24T20:11:26.547625] [INFO ] [REMOTE    ] NMI: Fetching primary data for 2025-01.
[2025-10-24T20:11:26.677501] [INFO ] [REMOTE    ] NMCO: Incremental fetch complete for 2025-08 (0.93 seconds).
[2025-10-24T20:11:26.859381] [INFO ] [REMOTE    ] NMI: Incremental fetch complete for 2025-01 (0.31 seconds).
[2025-10-24T20:11:27.347697] [INFO ] [REMOTE    ] NMG: Fetching primary data for 2025-05.
[2025-10-24T20:11:27.941094] [INFO ] [REMOTE    ] NMG: Incremental fetch complete for 2025-05 (0.59 seconds).
[2025-10-24T20:11:28.147683] [INFO ] [REMOTE    ] NMCO: Fetching primary data for 2025-09.
[2025-10-24T20:11:28.947617] [INFO ] [REMOTE    ] NMI: Fetching primary data for 2025-02.
[2025-10-24T20:11:29.403584] [INFO ] [REMOTE    ] NMCO: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T20:11:29.566797] [INFO ] [REMOTE    ] NMI: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T20:11:29.747630] [INFO ] [REMOTE    ] NMG: Fetching primary data for 2025-06.
[2025-10-24T20:11:30.380975] [INFO ] [REMOTE    ] NMG: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T20:11:30.547682] [INFO ] [REMOTE    ] NMCO: Fetching primary data for 2025-10.
[2025-10-24T20:11:31.347690] [INFO ] [REMOTE    ] NLY: Fetching primary data for 2025-07.
[2025-10-24T20:11:31.546610] [INFO ] [REMOTE    ] NMCO: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T20:11:31.549458] [INFO ] [REMOTE    ] NMCO: Full fetch complete (22841 records).
[2025-10-24T20:11:31.549542] [DEBUG] [VALIDATOR ] NMCO: Validating primary data.
[2025-10-24T20:11:31.927944] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present.
[2025-10-24T20:11:31.928026] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed.
[2025-10-24T20:11:31.928509] [INFO ] [MAIN      ] NMCO: Fetched primary data is valid.
[2025-10-24T20:11:31.928549] [DEBUG] [LOCAL     ] NMCO: Saving primary data.
[2025-10-24T20:11:31.928921] [FATAL] [LOCAL     ] NMCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:11:31.929010] [FATAL] [MAIN      ] NMCO: Failed to save primary data.
[2025-10-24T20:11:31.929052] [WARN ] [MAIN      ] NMCO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:11:31.929087] [INFO ] [LOCAL     ] NMCO: Starting deletion of primary data.
[2025-10-24T20:11:31.929137] [DEBUG] [LOCAL     ] NMCO: No primary data file found to delete.
[2025-10-24T20:11:31.929172] [INFO ] [LOCAL     ] NMCO: Starting deletion of derivative data.
[2025-10-24T20:11:31.929316] [DEBUG] [LOCAL     ] NMCO: Deleted derivative data file.
[2025-10-24T20:11:31.929424] [INFO ] [MAIN      ] Update Progress: 1491/2366 symbols completed. NMCO took 21.1s. Estimated remaining: 1h 52m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:11:32.099232] [INFO ] [MAIN      ] NMM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:11:32.115340] [DEBUG] [LOCAL     ] NMM: Loaded 14355 existing records from primary storage.
[2025-10-24T20:11:32.115570] [INFO ] [MAIN      ] NMM: Loaded 14355 existing records.
[2025-10-24T20:11:32.152808] [INFO ] [REMOTE    ] NMI: Fetching primary data for 2025-03.
[2025-10-24T20:11:32.297761] [WARN ] [MAIN      ] NMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:11:32.297975] [INFO ] [MAIN      ] NMM: Wiping existing primary data before full refresh.
[2025-10-24T20:11:32.298020] [INFO ] [LOCAL     ] NMM: Starting deletion of primary data.
[2025-10-24T20:11:32.298218] [DEBUG] [LOCAL     ] NMM: Deleted primary data file.
[2025-10-24T20:11:32.298273] [INFO ] [MAIN      ] NMM: Starting full primary refresh.
[2025-10-24T20:11:32.659762] [INFO ] [REMOTE    ] NMM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:11:32.841178] [INFO ] [REMOTE    ] NMI: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T20:11:32.947610] [INFO ] [REMOTE    ] NMG: Fetching primary data for 2025-07.
[2025-10-24T20:11:33.043560] [INFO ] [REMOTE    ] NLY: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T20:11:33.471742] [INFO ] [REMOTE    ] NMG: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T20:11:33.747675] [INFO ] [REMOTE    ] NMI: Fetching primary data for 2025-04.
[2025-10-24T20:11:34.360140] [INFO ] [REMOTE    ] NMI: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T20:11:34.547668] [INFO ] [REMOTE    ] NMI: Fetching primary data for 2025-05.
[2025-10-24T20:11:35.106314] [INFO ] [REMOTE    ] NMI: Incremental fetch complete for 2025-05 (0.56 seconds).
[2025-10-24T20:11:35.347670] [INFO ] [REMOTE    ] NMG: Fetching primary data for 2025-08.
[2025-10-24T20:11:36.056867] [INFO ] [REMOTE    ] NMG: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T20:11:36.147638] [INFO ] [REMOTE    ] NMI: Fetching primary data for 2025-06.
[2025-10-24T20:11:36.724351] [INFO ] [REMOTE    ] NMI: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T20:11:36.947625] [INFO ] [REMOTE    ] NLY: Fetching primary data for 2025-08.
[2025-10-24T20:11:37.747741] [INFO ] [REMOTE    ] NMI: Fetching primary data for 2025-07.
[2025-10-24T20:11:38.373489] [INFO ] [REMOTE    ] NMI: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T20:11:38.547637] [INFO ] [REMOTE    ] NMG: Fetching primary data for 2025-09.
[2025-10-24T20:11:38.830059] [INFO ] [REMOTE    ] NLY: Incremental fetch complete for 2025-08 (1.88 seconds).
[2025-10-24T20:11:39.348298] [INFO ] [REMOTE    ] NMM: Fetching primary data for 2025-01.
[2025-10-24T20:11:39.354060] [INFO ] [REMOTE    ] NMG: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T20:11:40.147745] [INFO ] [REMOTE    ] NMI: Fetching primary data for 2025-08.
[2025-10-24T20:11:40.359952] [INFO ] [REMOTE    ] NMM: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T20:11:40.834114] [INFO ] [REMOTE    ] NMI: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T20:11:40.947706] [INFO ] [REMOTE    ] NMM: Fetching primary data for 2025-02.
[2025-10-24T20:11:41.747728] [INFO ] [REMOTE    ] NMG: Fetching primary data for 2025-10.
[2025-10-24T20:11:41.914599] [INFO ] [REMOTE    ] NMM: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T20:11:42.547744] [INFO ] [REMOTE    ] NMI: Fetching primary data for 2025-09.
[2025-10-24T20:11:43.107778] [INFO ] [REMOTE    ] NMI: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T20:11:43.347722] [INFO ] [REMOTE    ] NMI: Fetching primary data for 2025-10.
[2025-10-24T20:11:43.567084] [INFO ] [REMOTE    ] NMG: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T20:11:43.574672] [INFO ] [REMOTE    ] NMG: Full fetch complete (16259 records).
[2025-10-24T20:11:43.574832] [DEBUG] [VALIDATOR ] NMG: Validating primary data.
[2025-10-24T20:11:43.965233] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present.
[2025-10-24T20:11:43.965318] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed.
[2025-10-24T20:11:43.965697] [INFO ] [MAIN      ] NMG: Fetched primary data is valid.
[2025-10-24T20:11:43.965757] [DEBUG] [LOCAL     ] NMG: Saving primary data.
[2025-10-24T20:11:43.966046] [FATAL] [LOCAL     ] NMG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:11:43.966132] [FATAL] [MAIN      ] NMG: Failed to save primary data.
[2025-10-24T20:11:43.966173] [WARN ] [MAIN      ] NMG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:11:43.966208] [INFO ] [LOCAL     ] NMG: Starting deletion of primary data.
[2025-10-24T20:11:43.966257] [DEBUG] [LOCAL     ] NMG: No primary data file found to delete.
[2025-10-24T20:11:43.966292] [INFO ] [LOCAL     ] NMG: Starting deletion of derivative data.
[2025-10-24T20:11:43.966428] [DEBUG] [LOCAL     ] NMG: Deleted derivative data file.
[2025-10-24T20:11:43.966517] [INFO ] [MAIN      ] Update Progress: 1492/2366 symbols completed. NMG took 27.3s. Estimated remaining: 1h 52m 17s. Rate: 7.8 symbols/min
[2025-10-24T20:11:44.038784] [INFO ] [REMOTE    ] NMI: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T20:11:44.069629] [INFO ] [REMOTE    ] NMI: Full fetch complete (5638 records).
[2025-10-24T20:11:44.081638] [DEBUG] [VALIDATOR ] NMI: Validating primary data.
[2025-10-24T20:11:44.170319] [INFO ] [REMOTE    ] NLY: Fetching primary data for 2025-09.
[2025-10-24T20:11:44.280349] [INFO ] [MAIN      ] NMR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:11:44.571365] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present.
[2025-10-24T20:11:44.571117] [DEBUG] [LOCAL     ] NMR: Loaded 35672 existing records from primary storage.
[2025-10-24T20:11:44.571703] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed.
[2025-10-24T20:11:44.572110] [INFO ] [MAIN      ] NMR: Loaded 35672 existing records.
[2025-10-24T20:11:44.572445] [INFO ] [MAIN      ] NMI: Fetched primary data is valid.
[2025-10-24T20:11:44.572564] [DEBUG] [LOCAL     ] NMI: Saving primary data.
[2025-10-24T20:11:44.599684] [FATAL] [LOCAL     ] NMI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:11:44.599796] [FATAL] [MAIN      ] NMI: Failed to save primary data.
[2025-10-24T20:11:44.599871] [WARN ] [MAIN      ] NMI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:11:44.623866] [INFO ] [LOCAL     ] NMI: Starting deletion of primary data.
[2025-10-24T20:11:44.623978] [DEBUG] [LOCAL     ] NMI: No primary data file found to delete.
[2025-10-24T20:11:44.624054] [INFO ] [LOCAL     ] NMI: Starting deletion of derivative data.
[2025-10-24T20:11:44.649831] [DEBUG] [LOCAL     ] NMI: Deleted derivative data file.
[2025-10-24T20:11:44.656866] [INFO ] [MAIN      ] Update Progress: 1493/2366 symbols completed. NMI took 20.9s. Estimated remaining: 1h 52m 5s. Rate: 7.8 symbols/min
[2025-10-24T20:11:44.950692] [INFO ] [REMOTE    ] NMM: Fetching primary data for 2025-03.
[2025-10-24T20:11:44.953307] [INFO ] [MAIN      ] NMS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:11:44.974574] [WARN ] [MAIN      ] NMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:11:44.975429] [INFO ] [MAIN      ] NMR: Wiping existing primary data before full refresh.
[2025-10-24T20:11:44.975486] [INFO ] [LOCAL     ] NMR: Starting deletion of primary data.
[2025-10-24T20:11:44.975827] [DEBUG] [LOCAL     ] NMR: Deleted primary data file.
[2025-10-24T20:11:44.975909] [INFO ] [MAIN      ] NMR: Starting full primary refresh.
[2025-10-24T20:11:45.073555] [DEBUG] [LOCAL     ] NMS: Loaded 2935 existing records from primary storage.
[2025-10-24T20:11:45.095063] [INFO ] [MAIN      ] NMS: Loaded 2935 existing records.
[2025-10-24T20:11:45.479220] [WARN ] [MAIN      ] NMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:11:45.494597] [INFO ] [MAIN      ] NMS: Wiping existing primary data before full refresh.
[2025-10-24T20:11:45.497915] [INFO ] [LOCAL     ] NMS: Starting deletion of primary data.
[2025-10-24T20:11:45.498230] [DEBUG] [LOCAL     ] NMS: Deleted primary data file.
[2025-10-24T20:11:45.503714] [INFO ] [MAIN      ] NMS: Starting full primary refresh.
[2025-10-24T20:11:45.690557] [INFO ] [REMOTE    ] NMR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:11:45.750498] [INFO ] [REMOTE    ] NMR: Fetching primary data for 2025-01.
[2025-10-24T20:11:45.959075] [INFO ] [REMOTE    ] NMM: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T20:11:45.963220] [INFO ] [REMOTE    ] NMS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:11:46.159897] [INFO ] [REMOTE    ] NLY: Incremental fetch complete for 2025-09 (1.99 seconds).
[2025-10-24T20:11:46.547636] [INFO ] [REMOTE    ] NMM: Fetching primary data for 2025-04.
[2025-10-24T20:11:47.125174] [INFO ] [REMOTE    ] NMR: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T20:11:47.347618] [INFO ] [REMOTE    ] NMS: Fetching primary data for 2025-01.
[2025-10-24T20:11:47.545307] [INFO ] [REMOTE    ] NMM: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T20:11:47.798438] [INFO ] [REMOTE    ] NMS: Incremental fetch complete for 2025-01 (0.45 seconds).
[2025-10-24T20:11:48.147687] [INFO ] [REMOTE    ] NMM: Fetching primary data for 2025-05.
[2025-10-24T20:11:48.906705] [INFO ] [REMOTE    ] NMM: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T20:11:48.947616] [INFO ] [REMOTE    ] NMM: Fetching primary data for 2025-06.
[2025-10-24T20:11:49.747725] [INFO ] [REMOTE    ] NMR: Fetching primary data for 2025-02.
[2025-10-24T20:11:49.823326] [INFO ] [REMOTE    ] NMM: Incremental fetch complete for 2025-06 (0.88 seconds).
[2025-10-24T20:11:50.547734] [INFO ] [REMOTE    ] NMM: Fetching primary data for 2025-07.
[2025-10-24T20:11:51.078167] [INFO ] [REMOTE    ] NMR: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T20:11:51.347729] [INFO ] [REMOTE    ] NMS: Fetching primary data for 2025-02.
[2025-10-24T20:11:51.440804] [INFO ] [REMOTE    ] NMM: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T20:11:51.896108] [INFO ] [REMOTE    ] NMS: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T20:11:52.147683] [INFO ] [REMOTE    ] NMS: Fetching primary data for 2025-03.
[2025-10-24T20:11:52.598272] [INFO ] [REMOTE    ] NMS: Incremental fetch complete for 2025-03 (0.45 seconds).
[2025-10-24T20:11:52.947621] [INFO ] [REMOTE    ] NLY: Fetching primary data for 2025-10.
[2025-10-24T20:11:53.747711] [INFO ] [REMOTE    ] NMR: Fetching primary data for 2025-03.
[2025-10-24T20:11:54.547714] [INFO ] [REMOTE    ] NMM: Fetching primary data for 2025-08.
[2025-10-24T20:11:54.994259] [INFO ] [REMOTE    ] NMR: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T20:11:55.111011] [INFO ] [REMOTE    ] NLY: Incremental fetch complete for 2025-10 (2.16 seconds).
[2025-10-24T20:11:55.120613] [INFO ] [REMOTE    ] NLY: Full fetch complete (77699 records).
[2025-10-24T20:11:55.120799] [DEBUG] [VALIDATOR ] NLY: Validating primary data.
[2025-10-24T20:11:55.352696] [INFO ] [REMOTE    ] NMR: Fetching primary data for 2025-04.
[2025-10-24T20:11:55.512312] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present.
[2025-10-24T20:11:55.512432] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed.
[2025-10-24T20:11:55.513624] [INFO ] [MAIN      ] NLY: Fetched primary data is valid.
[2025-10-24T20:11:55.513722] [DEBUG] [LOCAL     ] NLY: Saving primary data.
[2025-10-24T20:11:55.514443] [FATAL] [LOCAL     ] NLY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:11:55.514534] [FATAL] [MAIN      ] NLY: Failed to save primary data.
[2025-10-24T20:11:55.514577] [WARN ] [MAIN      ] NLY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:11:55.514612] [INFO ] [LOCAL     ] NLY: Starting deletion of primary data.
[2025-10-24T20:11:55.514704] [DEBUG] [LOCAL     ] NLY: No primary data file found to delete.
[2025-10-24T20:11:55.514758] [INFO ] [LOCAL     ] NLY: Starting deletion of derivative data.
[2025-10-24T20:11:55.514874] [DEBUG] [LOCAL     ] NLY: Deleted derivative data file.
[2025-10-24T20:11:55.515188] [INFO ] [MAIN      ] Update Progress: 1494/2366 symbols completed. NLY took 1m 5s. Estimated remaining: 1h 51m 60s. Rate: 7.8 symbols/min
[2025-10-24T20:11:55.633982] [INFO ] [REMOTE    ] NMM: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T20:11:55.704850] [INFO ] [MAIN      ] NMT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:11:55.710547] [DEBUG] [LOCAL     ] NMT: Loaded 2826 existing records from primary storage.
[2025-10-24T20:11:55.710776] [INFO ] [MAIN      ] NMT: Loaded 2826 existing records.
[2025-10-24T20:11:55.894637] [WARN ] [MAIN      ] NMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:11:55.894902] [INFO ] [MAIN      ] NMT: Wiping existing primary data before full refresh.
[2025-10-24T20:11:55.894972] [INFO ] [LOCAL     ] NMT: Starting deletion of primary data.
[2025-10-24T20:11:55.895124] [DEBUG] [LOCAL     ] NMT: Deleted primary data file.
[2025-10-24T20:11:55.895182] [INFO ] [MAIN      ] NMT: Starting full primary refresh.
[2025-10-24T20:11:56.158501] [INFO ] [REMOTE    ] NMM: Fetching primary data for 2025-09.
[2025-10-24T20:11:56.277231] [INFO ] [REMOTE    ] NMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:11:56.949466] [INFO ] [REMOTE    ] NMT: Fetching primary data for 2025-01.
[2025-10-24T20:11:56.955399] [INFO ] [REMOTE    ] NMR: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T20:11:57.106166] [INFO ] [REMOTE    ] NMM: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T20:11:57.493398] [INFO ] [REMOTE    ] NMT: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T20:11:57.747670] [INFO ] [REMOTE    ] NMS: Fetching primary data for 2025-04.
[2025-10-24T20:11:58.177382] [INFO ] [REMOTE    ] NMS: Incremental fetch complete for 2025-04 (0.43 seconds).
[2025-10-24T20:11:58.547723] [INFO ] [REMOTE    ] NMR: Fetching primary data for 2025-05.
[2025-10-24T20:11:59.347703] [INFO ] [REMOTE    ] NMT: Fetching primary data for 2025-02.
[2025-10-24T20:11:59.814149] [INFO ] [REMOTE    ] NMT: Incremental fetch complete for 2025-02 (0.47 seconds).
[2025-10-24T20:12:00.050581] [INFO ] [REMOTE    ] NMR: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T20:12:00.147686] [INFO ] [REMOTE    ] NMT: Fetching primary data for 2025-03.
[2025-10-24T20:12:00.679832] [INFO ] [REMOTE    ] NMT: Incremental fetch complete for 2025-03 (0.53 seconds).
[2025-10-24T20:12:00.947721] [INFO ] [REMOTE    ] NMT: Fetching primary data for 2025-04.
[2025-10-24T20:12:01.697133] [INFO ] [REMOTE    ] NMT: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T20:12:01.747695] [INFO ] [REMOTE    ] NMR: Fetching primary data for 2025-06.
[2025-10-24T20:12:02.547711] [INFO ] [REMOTE    ] NMM: Fetching primary data for 2025-10.
[2025-10-24T20:12:02.991706] [INFO ] [REMOTE    ] NMR: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T20:12:03.347683] [INFO ] [REMOTE    ] NMS: Fetching primary data for 2025-05.
[2025-10-24T20:12:03.738613] [INFO ] [REMOTE    ] NMM: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T20:12:03.741904] [INFO ] [REMOTE    ] NMM: Full fetch complete (21561 records).
[2025-10-24T20:12:03.742037] [DEBUG] [VALIDATOR ] NMM: Validating primary data.
[2025-10-24T20:12:03.948557] [INFO ] [REMOTE    ] NMS: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T20:12:04.141963] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present.
[2025-10-24T20:12:04.142052] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed.
[2025-10-24T20:12:04.142510] [INFO ] [MAIN      ] NMM: Fetched primary data is valid.
[2025-10-24T20:12:04.142551] [DEBUG] [LOCAL     ] NMM: Saving primary data.
[2025-10-24T20:12:04.142962] [FATAL] [LOCAL     ] NMM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:12:04.143094] [FATAL] [MAIN      ] NMM: Failed to save primary data.
[2025-10-24T20:12:04.143136] [WARN ] [MAIN      ] NMM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:12:04.143171] [INFO ] [LOCAL     ] NMM: Starting deletion of primary data.
[2025-10-24T20:12:04.143251] [DEBUG] [LOCAL     ] NMM: No primary data file found to delete.
[2025-10-24T20:12:04.143290] [INFO ] [LOCAL     ] NMM: Starting deletion of derivative data.
[2025-10-24T20:12:04.143520] [DEBUG] [LOCAL     ] NMM: Deleted derivative data file.
[2025-10-24T20:12:04.143613] [INFO ] [MAIN      ] Update Progress: 1495/2366 symbols completed. NMM took 32.2s. Estimated remaining: 1h 51m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:12:04.155107] [INFO ] [REMOTE    ] NMR: Fetching primary data for 2025-07.
[2025-10-24T20:12:04.331954] [INFO ] [MAIN      ] NMZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:12:04.354407] [DEBUG] [LOCAL     ] NMZ: Loaded 21507 existing records from primary storage.
[2025-10-24T20:12:04.354686] [INFO ] [MAIN      ] NMZ: Loaded 21507 existing records.
[2025-10-24T20:12:04.527614] [WARN ] [MAIN      ] NMZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:12:04.527830] [INFO ] [MAIN      ] NMZ: Wiping existing primary data before full refresh.
[2025-10-24T20:12:04.527875] [INFO ] [LOCAL     ] NMZ: Starting deletion of primary data.
[2025-10-24T20:12:04.528097] [DEBUG] [LOCAL     ] NMZ: Deleted primary data file.
[2025-10-24T20:12:04.528152] [INFO ] [MAIN      ] NMZ: Starting full primary refresh.
[2025-10-24T20:12:04.876592] [INFO ] [REMOTE    ] NMZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:12:04.947609] [INFO ] [REMOTE    ] NMZ: Fetching primary data for 2025-01.
[2025-10-24T20:12:05.653369] [INFO ] [REMOTE    ] NMR: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T20:12:05.747620] [INFO ] [REMOTE    ] NMS: Fetching primary data for 2025-06.
[2025-10-24T20:12:05.978961] [INFO ] [REMOTE    ] NMZ: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T20:12:06.193942] [INFO ] [REMOTE    ] NMS: Incremental fetch complete for 2025-06 (0.45 seconds).
[2025-10-24T20:12:06.547698] [INFO ] [REMOTE    ] NMS: Fetching primary data for 2025-07.
[2025-10-24T20:12:07.026700] [INFO ] [REMOTE    ] NMS: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T20:12:07.347671] [INFO ] [REMOTE    ] NMS: Fetching primary data for 2025-08.
[2025-10-24T20:12:07.945999] [INFO ] [REMOTE    ] NMS: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T20:12:08.147675] [INFO ] [REMOTE    ] NMR: Fetching primary data for 2025-08.
[2025-10-24T20:12:08.947722] [INFO ] [REMOTE    ] NMS: Fetching primary data for 2025-09.
[2025-10-24T20:12:09.393530] [INFO ] [REMOTE    ] NMS: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T20:12:09.448209] [INFO ] [REMOTE    ] NMR: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T20:12:09.747682] [INFO ] [REMOTE    ] NMT: Fetching primary data for 2025-05.
[2025-10-24T20:12:10.322048] [INFO ] [REMOTE    ] NMT: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T20:12:10.547681] [INFO ] [REMOTE    ] NMR: Fetching primary data for 2025-09.
[2025-10-24T20:12:11.347611] [INFO ] [REMOTE    ] NMS: Fetching primary data for 2025-10.
[2025-10-24T20:12:11.787872] [INFO ] [REMOTE    ] NMR: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T20:12:12.147679] [INFO ] [REMOTE    ] NMR: Fetching primary data for 2025-10.
[2025-10-24T20:12:12.947675] [INFO ] [REMOTE    ] NMT: Fetching primary data for 2025-06.
[2025-10-24T20:12:13.402947] [INFO ] [REMOTE    ] NMT: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T20:12:13.513726] [INFO ] [REMOTE    ] NMS: Incremental fetch complete for 2025-10 (2.17 seconds).
[2025-10-24T20:12:13.515086] [INFO ] [REMOTE    ] NMS: Full fetch complete (4068 records).
[2025-10-24T20:12:13.515185] [DEBUG] [VALIDATOR ] NMS: Validating primary data.
[2025-10-24T20:12:13.757965] [INFO ] [REMOTE    ] NMZ: Fetching primary data for 2025-02.
[2025-10-24T20:12:13.860615] [INFO ] [REMOTE    ] NMR: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T20:12:13.922747] [INFO ] [REMOTE    ] NMR: Full fetch complete (51352 records).
[2025-10-24T20:12:13.928259] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present.
[2025-10-24T20:12:13.928412] [DEBUG] [VALIDATOR ] NMR: Validating primary data.
[2025-10-24T20:12:13.928519] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed.
[2025-10-24T20:12:13.928790] [INFO ] [MAIN      ] NMS: Fetched primary data is valid.
[2025-10-24T20:12:13.928877] [DEBUG] [LOCAL     ] NMS: Saving primary data.
[2025-10-24T20:12:13.929431] [FATAL] [LOCAL     ] NMS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:12:13.929517] [FATAL] [MAIN      ] NMS: Failed to save primary data.
[2025-10-24T20:12:13.998930] [WARN ] [MAIN      ] NMS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:12:14.010040] [INFO ] [LOCAL     ] NMS: Starting deletion of primary data.
[2025-10-24T20:12:14.028517] [DEBUG] [LOCAL     ] NMS: No primary data file found to delete.
[2025-10-24T20:12:14.030850] [INFO ] [LOCAL     ] NMS: Starting deletion of derivative data.
[2025-10-24T20:12:14.031197] [DEBUG] [LOCAL     ] NMS: Deleted derivative data file.
[2025-10-24T20:12:14.041809] [INFO ] [MAIN      ] Update Progress: 1496/2366 symbols completed. NMS took 29.4s. Estimated remaining: 1h 51m 46s. Rate: 7.8 symbols/min
[2025-10-24T20:12:14.409349] [INFO ] [MAIN      ] NNI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:12:14.495804] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present.
[2025-10-24T20:12:14.495890] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed.
[2025-10-24T20:12:14.496851] [INFO ] [MAIN      ] NMR: Fetched primary data is valid.
[2025-10-24T20:12:14.496931] [DEBUG] [LOCAL     ] NMR: Saving primary data.
[2025-10-24T20:12:14.497463] [FATAL] [LOCAL     ] NMR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:12:14.497597] [FATAL] [MAIN      ] NMR: Failed to save primary data.
[2025-10-24T20:12:14.497639] [WARN ] [MAIN      ] NMR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:12:14.497721] [INFO ] [LOCAL     ] NMR: Starting deletion of primary data.
[2025-10-24T20:12:14.497788] [DEBUG] [LOCAL     ] NMR: No primary data file found to delete.
[2025-10-24T20:12:14.497843] [INFO ] [LOCAL     ] NMR: Starting deletion of derivative data.
[2025-10-24T20:12:14.503046] [DEBUG] [LOCAL     ] NMR: Deleted derivative data file.
[2025-10-24T20:12:14.503849] [INFO ] [MAIN      ] Update Progress: 1497/2366 symbols completed. NMR took 30.5s. Estimated remaining: 1h 51m 34s. Rate: 7.8 symbols/min
[2025-10-24T20:12:14.503482] [DEBUG] [LOCAL     ] NNI: Loaded 10530 existing records from primary storage.
[2025-10-24T20:12:14.504159] [INFO ] [MAIN      ] NNI: Loaded 10530 existing records.
[2025-10-24T20:12:14.559808] [INFO ] [REMOTE    ] NMT: Fetching primary data for 2025-07.
[2025-10-24T20:12:14.840417] [INFO ] [MAIN      ] NNN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:12:14.872675] [WARN ] [MAIN      ] NNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:12:14.873325] [INFO ] [MAIN      ] NNI: Wiping existing primary data before full refresh.
[2025-10-24T20:12:14.873385] [INFO ] [LOCAL     ] NNI: Starting deletion of primary data.
[2025-10-24T20:12:14.873604] [DEBUG] [LOCAL     ] NNI: Deleted primary data file.
[2025-10-24T20:12:14.873700] [INFO ] [MAIN      ] NNI: Starting full primary refresh.
[2025-10-24T20:12:15.142187] [INFO ] [REMOTE    ] NMZ: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T20:12:15.202429] [INFO ] [REMOTE    ] NMT: Incremental fetch complete for 2025-07 (0.64 seconds).
[2025-10-24T20:12:15.280292] [DEBUG] [LOCAL     ] NNN: Loaded 48512 existing records from primary storage.
[2025-10-24T20:12:15.302683] [INFO ] [REMOTE    ] NNI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:12:15.303248] [INFO ] [MAIN      ] NNN: Loaded 48512 existing records.
[2025-10-24T20:12:15.352880] [INFO ] [REMOTE    ] NMZ: Fetching primary data for 2025-03.
[2025-10-24T20:12:15.487776] [WARN ] [MAIN      ] NNN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:12:15.488014] [INFO ] [MAIN      ] NNN: Wiping existing primary data before full refresh.
[2025-10-24T20:12:15.488060] [INFO ] [LOCAL     ] NNN: Starting deletion of primary data.
[2025-10-24T20:12:15.488440] [DEBUG] [LOCAL     ] NNN: Deleted primary data file.
[2025-10-24T20:12:15.488478] [INFO ] [MAIN      ] NNN: Starting full primary refresh.
[2025-10-24T20:12:15.840973] [INFO ] [REMOTE    ] NNN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:12:16.147710] [INFO ] [REMOTE    ] NNN: Fetching primary data for 2025-01.
[2025-10-24T20:12:16.504207] [INFO ] [REMOTE    ] NMZ: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T20:12:16.947683] [INFO ] [REMOTE    ] NNI: Fetching primary data for 2025-01.
[2025-10-24T20:12:17.555901] [INFO ] [REMOTE    ] NNI: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T20:12:17.648165] [INFO ] [REMOTE    ] NNN: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T20:12:17.747668] [INFO ] [REMOTE    ] NMT: Fetching primary data for 2025-08.
[2025-10-24T20:12:18.299359] [INFO ] [REMOTE    ] NMT: Incremental fetch complete for 2025-08 (0.55 seconds).
[2025-10-24T20:12:18.547687] [INFO ] [REMOTE    ] NNI: Fetching primary data for 2025-02.
[2025-10-24T20:12:19.347635] [INFO ] [REMOTE    ] NNN: Fetching primary data for 2025-02.
[2025-10-24T20:12:19.356293] [INFO ] [REMOTE    ] NNI: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T20:12:20.147680] [INFO ] [REMOTE    ] NMZ: Fetching primary data for 2025-04.
[2025-10-24T20:12:20.947720] [INFO ] [REMOTE    ] NMT: Fetching primary data for 2025-09.
[2025-10-24T20:12:20.983794] [INFO ] [REMOTE    ] NNN: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T20:12:21.273129] [INFO ] [REMOTE    ] NMZ: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T20:12:21.450271] [INFO ] [REMOTE    ] NMT: Incremental fetch complete for 2025-09 (0.50 seconds).
[2025-10-24T20:12:21.747703] [INFO ] [REMOTE    ] NMT: Fetching primary data for 2025-10.
[2025-10-24T20:12:22.330906] [INFO ] [REMOTE    ] NMT: Incremental fetch complete for 2025-10 (0.58 seconds).
[2025-10-24T20:12:22.332179] [INFO ] [REMOTE    ] NMT: Full fetch complete (3867 records).
[2025-10-24T20:12:22.332313] [DEBUG] [VALIDATOR ] NMT: Validating primary data.
[2025-10-24T20:12:22.552842] [INFO ] [REMOTE    ] NNI: Fetching primary data for 2025-03.
[2025-10-24T20:12:22.726686] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present.
[2025-10-24T20:12:22.726850] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed.
[2025-10-24T20:12:22.727111] [INFO ] [MAIN      ] NMT: Fetched primary data is valid.
[2025-10-24T20:12:22.727179] [DEBUG] [LOCAL     ] NMT: Saving primary data.
[2025-10-24T20:12:22.727798] [FATAL] [LOCAL     ] NMT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:12:22.727917] [FATAL] [MAIN      ] NMT: Failed to save primary data.
[2025-10-24T20:12:22.727972] [WARN ] [MAIN      ] NMT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:12:22.728021] [INFO ] [LOCAL     ] NMT: Starting deletion of primary data.
[2025-10-24T20:12:22.728096] [DEBUG] [LOCAL     ] NMT: No primary data file found to delete.
[2025-10-24T20:12:22.728205] [INFO ] [LOCAL     ] NMT: Starting deletion of derivative data.
[2025-10-24T20:12:22.728435] [DEBUG] [LOCAL     ] NMT: Deleted derivative data file.
[2025-10-24T20:12:22.728579] [INFO ] [MAIN      ] Update Progress: 1498/2366 symbols completed. NMT took 27.2s. Estimated remaining: 1h 51m 27s. Rate: 7.8 symbols/min
[2025-10-24T20:12:22.924393] [INFO ] [MAIN      ] NNY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:12:22.934517] [DEBUG] [LOCAL     ] NNY: Loaded 5814 existing records from primary storage.
[2025-10-24T20:12:22.934788] [INFO ] [MAIN      ] NNY: Loaded 5814 existing records.
[2025-10-24T20:12:23.065280] [INFO ] [REMOTE    ] NNI: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T20:12:23.155265] [WARN ] [MAIN      ] NNY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:12:23.155561] [INFO ] [MAIN      ] NNY: Wiping existing primary data before full refresh.
[2025-10-24T20:12:23.155639] [INFO ] [LOCAL     ] NNY: Starting deletion of primary data.
[2025-10-24T20:12:23.155863] [DEBUG] [LOCAL     ] NNY: Deleted primary data file.
[2025-10-24T20:12:23.155920] [INFO ] [MAIN      ] NNY: Starting full primary refresh.
[2025-10-24T20:12:23.353551] [INFO ] [REMOTE    ] NMZ: Fetching primary data for 2025-05.
[2025-10-24T20:12:23.556101] [INFO ] [REMOTE    ] NNY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:12:24.147638] [INFO ] [REMOTE    ] NNI: Fetching primary data for 2025-04.
[2025-10-24T20:12:24.348369] [INFO ] [REMOTE    ] NMZ: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T20:12:24.851178] [INFO ] [REMOTE    ] NNI: Incremental fetch complete for 2025-04 (0.70 seconds).
[2025-10-24T20:12:24.947680] [INFO ] [REMOTE    ] NNI: Fetching primary data for 2025-05.
[2025-10-24T20:12:25.747623] [INFO ] [REMOTE    ] NNN: Fetching primary data for 2025-03.
[2025-10-24T20:12:25.796437] [INFO ] [REMOTE    ] NNI: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T20:12:26.547719] [INFO ] [REMOTE    ] NMZ: Fetching primary data for 2025-06.
[2025-10-24T20:12:27.347719] [INFO ] [REMOTE    ] NNI: Fetching primary data for 2025-06.
[2025-10-24T20:12:27.419424] [INFO ] [REMOTE    ] NNN: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T20:12:27.604818] [INFO ] [REMOTE    ] NMZ: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T20:12:28.147633] [INFO ] [REMOTE    ] NNN: Fetching primary data for 2025-04.
[2025-10-24T20:12:28.174139] [INFO ] [REMOTE    ] NNI: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T20:12:28.947678] [INFO ] [REMOTE    ] NNY: Fetching primary data for 2025-01.
[2025-10-24T20:12:29.719247] [INFO ] [REMOTE    ] NNN: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T20:12:29.746147] [INFO ] [REMOTE    ] NNY: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T20:12:29.747685] [INFO ] [REMOTE    ] NNI: Fetching primary data for 2025-07.
[2025-10-24T20:12:30.547733] [INFO ] [REMOTE    ] NMZ: Fetching primary data for 2025-07.
[2025-10-24T20:12:30.652576] [INFO ] [REMOTE    ] NNI: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T20:12:31.333763] [INFO ] [REMOTE    ] NMZ: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T20:12:31.347594] [INFO ] [REMOTE    ] NMZ: Fetching primary data for 2025-08.
[2025-10-24T20:12:32.147743] [INFO ] [REMOTE    ] NNN: Fetching primary data for 2025-05.
[2025-10-24T20:12:32.356622] [INFO ] [REMOTE    ] NMZ: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T20:12:32.947733] [INFO ] [REMOTE    ] NNY: Fetching primary data for 2025-02.
[2025-10-24T20:12:33.560854] [INFO ] [REMOTE    ] NNY: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T20:12:33.747688] [INFO ] [REMOTE    ] NNI: Fetching primary data for 2025-08.
[2025-10-24T20:12:33.794761] [INFO ] [REMOTE    ] NNN: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T20:12:34.518400] [INFO ] [REMOTE    ] NNI: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T20:12:34.547705] [INFO ] [REMOTE    ] NNY: Fetching primary data for 2025-03.
[2025-10-24T20:12:35.209394] [INFO ] [REMOTE    ] NNY: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T20:12:35.347637] [INFO ] [REMOTE    ] NNI: Fetching primary data for 2025-09.
[2025-10-24T20:12:36.147674] [INFO ] [REMOTE    ] NNY: Fetching primary data for 2025-04.
[2025-10-24T20:12:36.231082] [INFO ] [REMOTE    ] NNI: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T20:12:36.858080] [INFO ] [REMOTE    ] NNY: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T20:12:36.947731] [INFO ] [REMOTE    ] NNY: Fetching primary data for 2025-05.
[2025-10-24T20:12:37.502479] [INFO ] [REMOTE    ] NNY: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T20:12:37.747732] [INFO ] [REMOTE    ] NNI: Fetching primary data for 2025-10.
[2025-10-24T20:12:38.547629] [INFO ] [REMOTE    ] NNN: Fetching primary data for 2025-06.
[2025-10-24T20:12:38.662878] [INFO ] [REMOTE    ] NNI: Incremental fetch complete for 2025-10 (0.92 seconds).
[2025-10-24T20:12:38.664936] [INFO ] [REMOTE    ] NNI: Full fetch complete (13142 records).
[2025-10-24T20:12:38.665008] [DEBUG] [VALIDATOR ] NNI: Validating primary data.
[2025-10-24T20:12:39.017302] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present.
[2025-10-24T20:12:39.017399] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed.
[2025-10-24T20:12:39.017715] [INFO ] [MAIN      ] NNI: Fetched primary data is valid.
[2025-10-24T20:12:39.017776] [DEBUG] [LOCAL     ] NNI: Saving primary data.
[2025-10-24T20:12:39.017996] [FATAL] [LOCAL     ] NNI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:12:39.018084] [FATAL] [MAIN      ] NNI: Failed to save primary data.
[2025-10-24T20:12:39.018127] [WARN ] [MAIN      ] NNI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:12:39.018171] [INFO ] [LOCAL     ] NNI: Starting deletion of primary data.
[2025-10-24T20:12:39.018220] [DEBUG] [LOCAL     ] NNI: No primary data file found to delete.
[2025-10-24T20:12:39.018255] [INFO ] [LOCAL     ] NNI: Starting deletion of derivative data.
[2025-10-24T20:12:39.018395] [DEBUG] [LOCAL     ] NNI: Deleted derivative data file.
[2025-10-24T20:12:39.018482] [INFO ] [MAIN      ] Update Progress: 1499/2366 symbols completed. NNI took 25.0s. Estimated remaining: 1h 51m 24s. Rate: 7.8 symbols/min
[2025-10-24T20:12:39.189701] [INFO ] [MAIN      ] NOA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:12:39.207629] [DEBUG] [LOCAL     ] NOA: Loaded 15889 existing records from primary storage.
[2025-10-24T20:12:39.207887] [INFO ] [MAIN      ] NOA: Loaded 15889 existing records.
[2025-10-24T20:12:39.355536] [INFO ] [REMOTE    ] NMZ: Fetching primary data for 2025-09.
[2025-10-24T20:12:39.385945] [WARN ] [MAIN      ] NOA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:12:39.386843] [INFO ] [MAIN      ] NOA: Wiping existing primary data before full refresh.
[2025-10-24T20:12:39.386892] [INFO ] [LOCAL     ] NOA: Starting deletion of primary data.
[2025-10-24T20:12:39.387039] [DEBUG] [LOCAL     ] NOA: Deleted primary data file.
[2025-10-24T20:12:39.387079] [INFO ] [MAIN      ] NOA: Starting full primary refresh.
[2025-10-24T20:12:39.745027] [INFO ] [REMOTE    ] NOA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:12:40.130606] [INFO ] [REMOTE    ] NNN: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T20:12:40.147600] [INFO ] [REMOTE    ] NNN: Fetching primary data for 2025-07.
[2025-10-24T20:12:40.279053] [INFO ] [REMOTE    ] NMZ: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T20:12:40.947674] [INFO ] [REMOTE    ] NNY: Fetching primary data for 2025-06.
[2025-10-24T20:12:41.707079] [INFO ] [REMOTE    ] NNY: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T20:12:41.737876] [INFO ] [REMOTE    ] NNN: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T20:12:41.747628] [INFO ] [REMOTE    ] NOA: Fetching primary data for 2025-01.
[2025-10-24T20:12:42.547620] [INFO ] [REMOTE    ] NNN: Fetching primary data for 2025-08.
[2025-10-24T20:12:42.631529] [INFO ] [REMOTE    ] NOA: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T20:12:43.347720] [INFO ] [REMOTE    ] NNY: Fetching primary data for 2025-07.
[2025-10-24T20:12:43.902348] [INFO ] [REMOTE    ] NNY: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T20:12:44.147729] [INFO ] [REMOTE    ] NMZ: Fetching primary data for 2025-10.
[2025-10-24T20:12:44.190390] [INFO ] [REMOTE    ] NNN: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T20:12:44.947715] [INFO ] [REMOTE    ] NNN: Fetching primary data for 2025-09.
[2025-10-24T20:12:45.301327] [INFO ] [REMOTE    ] NMZ: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T20:12:45.305486] [INFO ] [REMOTE    ] NMZ: Full fetch complete (30935 records).
[2025-10-24T20:12:45.305624] [DEBUG] [VALIDATOR ] NMZ: Validating primary data.
[2025-10-24T20:12:45.682941] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present.
[2025-10-24T20:12:45.683029] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed.
[2025-10-24T20:12:45.683781] [INFO ] [MAIN      ] NMZ: Fetched primary data is valid.
[2025-10-24T20:12:45.683857] [DEBUG] [LOCAL     ] NMZ: Saving primary data.
[2025-10-24T20:12:45.684338] [FATAL] [LOCAL     ] NMZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:12:45.684424] [FATAL] [MAIN      ] NMZ: Failed to save primary data.
[2025-10-24T20:12:45.684466] [WARN ] [MAIN      ] NMZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:12:45.684504] [INFO ] [LOCAL     ] NMZ: Starting deletion of primary data.
[2025-10-24T20:12:45.684559] [DEBUG] [LOCAL     ] NMZ: No primary data file found to delete.
[2025-10-24T20:12:45.684596] [INFO ] [LOCAL     ] NMZ: Starting deletion of derivative data.
[2025-10-24T20:12:45.684746] [DEBUG] [LOCAL     ] NMZ: Deleted derivative data file.
[2025-10-24T20:12:45.684839] [INFO ] [MAIN      ] Update Progress: 1500/2366 symbols completed. NMZ took 41.5s. Estimated remaining: 1h 51m 16s. Rate: 7.8 symbols/min
[2025-10-24T20:12:45.752923] [INFO ] [REMOTE    ] NNY: Fetching primary data for 2025-08.
[2025-10-24T20:12:45.861054] [INFO ] [MAIN      ] NOAH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:12:45.882828] [DEBUG] [LOCAL     ] NOAH: Loaded 19894 existing records from primary storage.
[2025-10-24T20:12:45.883083] [INFO ] [MAIN      ] NOAH: Loaded 19894 existing records.
[2025-10-24T20:12:46.066081] [WARN ] [MAIN      ] NOAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:12:46.066336] [INFO ] [MAIN      ] NOAH: Wiping existing primary data before full refresh.
[2025-10-24T20:12:46.066383] [INFO ] [LOCAL     ] NOAH: Starting deletion of primary data.
[2025-10-24T20:12:46.066540] [DEBUG] [LOCAL     ] NOAH: Deleted primary data file.
[2025-10-24T20:12:46.066579] [INFO ] [MAIN      ] NOAH: Starting full primary refresh.
[2025-10-24T20:12:46.439603] [INFO ] [REMOTE    ] NOAH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:12:46.444396] [INFO ] [REMOTE    ] NNY: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T20:12:46.547621] [INFO ] [REMOTE    ] NOAH: Fetching primary data for 2025-01.
[2025-10-24T20:12:46.758503] [INFO ] [REMOTE    ] NNN: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T20:12:47.347687] [INFO ] [REMOTE    ] NNN: Fetching primary data for 2025-10.
[2025-10-24T20:12:47.601493] [INFO ] [REMOTE    ] NOAH: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T20:12:48.147672] [INFO ] [REMOTE    ] NOA: Fetching primary data for 2025-02.
[2025-10-24T20:12:48.947697] [INFO ] [REMOTE    ] NOAH: Fetching primary data for 2025-02.
[2025-10-24T20:12:49.006517] [INFO ] [REMOTE    ] NOA: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T20:12:49.180771] [INFO ] [REMOTE    ] NNN: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T20:12:49.189361] [INFO ] [REMOTE    ] NNN: Full fetch complete (70282 records).
[2025-10-24T20:12:49.189480] [DEBUG] [VALIDATOR ] NNN: Validating primary data.
[2025-10-24T20:12:49.588284] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present.
[2025-10-24T20:12:49.588360] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed.
[2025-10-24T20:12:49.589496] [INFO ] [MAIN      ] NNN: Fetched primary data is valid.
[2025-10-24T20:12:49.589558] [DEBUG] [LOCAL     ] NNN: Saving primary data.
[2025-10-24T20:12:49.590146] [FATAL] [LOCAL     ] NNN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:12:49.590252] [FATAL] [MAIN      ] NNN: Failed to save primary data.
[2025-10-24T20:12:49.590300] [WARN ] [MAIN      ] NNN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:12:49.590359] [INFO ] [LOCAL     ] NNN: Starting deletion of primary data.
[2025-10-24T20:12:49.590418] [DEBUG] [LOCAL     ] NNN: No primary data file found to delete.
[2025-10-24T20:12:49.590455] [INFO ] [LOCAL     ] NNN: Starting deletion of derivative data.
[2025-10-24T20:12:49.590567] [DEBUG] [LOCAL     ] NNN: Deleted derivative data file.
[2025-10-24T20:12:49.591111] [INFO ] [MAIN      ] Update Progress: 1501/2366 symbols completed. NNN took 35.1s. Estimated remaining: 1h 51m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:12:49.750112] [INFO ] [REMOTE    ] NNY: Fetching primary data for 2025-09.
[2025-10-24T20:12:49.768394] [INFO ] [MAIN      ] NOC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:12:49.808843] [DEBUG] [LOCAL     ] NOC: Loaded 41909 existing records from primary storage.
[2025-10-24T20:12:49.809117] [INFO ] [MAIN      ] NOC: Loaded 41909 existing records.
[2025-10-24T20:12:49.921638] [INFO ] [REMOTE    ] NOAH: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T20:12:49.999198] [WARN ] [MAIN      ] NOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:12:49.999403] [INFO ] [MAIN      ] NOC: Wiping existing primary data before full refresh.
[2025-10-24T20:12:49.999480] [INFO ] [LOCAL     ] NOC: Starting deletion of primary data.
[2025-10-24T20:12:49.999735] [DEBUG] [LOCAL     ] NOC: Deleted primary data file.
[2025-10-24T20:12:49.999799] [INFO ] [MAIN      ] NOC: Starting full primary refresh.
[2025-10-24T20:12:50.348820] [INFO ] [REMOTE    ] NOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:12:50.471287] [INFO ] [REMOTE    ] NNY: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T20:12:50.547670] [INFO ] [REMOTE    ] NOC: Fetching primary data for 2025-01.
[2025-10-24T20:12:51.347742] [INFO ] [REMOTE    ] NOA: Fetching primary data for 2025-03.
[2025-10-24T20:12:52.147628] [INFO ] [REMOTE    ] NNY: Fetching primary data for 2025-10.
[2025-10-24T20:12:52.247499] [INFO ] [REMOTE    ] NOC: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T20:12:52.287047] [INFO ] [REMOTE    ] NOA: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T20:12:52.623834] [INFO ] [REMOTE    ] NNY: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T20:12:52.625557] [INFO ] [REMOTE    ] NNY: Full fetch complete (8420 records).
[2025-10-24T20:12:52.625632] [DEBUG] [VALIDATOR ] NNY: Validating primary data.
[2025-10-24T20:12:52.958479] [INFO ] [REMOTE    ] NOAH: Fetching primary data for 2025-03.
[2025-10-24T20:12:52.980593] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present.
[2025-10-24T20:12:52.980706] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed.
[2025-10-24T20:12:52.980930] [INFO ] [MAIN      ] NNY: Fetched primary data is valid.
[2025-10-24T20:12:52.980970] [DEBUG] [LOCAL     ] NNY: Saving primary data.
[2025-10-24T20:12:52.981165] [FATAL] [LOCAL     ] NNY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:12:52.981241] [FATAL] [MAIN      ] NNY: Failed to save primary data.
[2025-10-24T20:12:52.981283] [WARN ] [MAIN      ] NNY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:12:52.981344] [INFO ] [LOCAL     ] NNY: Starting deletion of primary data.
[2025-10-24T20:12:52.981398] [DEBUG] [LOCAL     ] NNY: No primary data file found to delete.
[2025-10-24T20:12:52.981471] [INFO ] [LOCAL     ] NNY: Starting deletion of derivative data.
[2025-10-24T20:12:52.981589] [DEBUG] [LOCAL     ] NNY: Deleted derivative data file.
[2025-10-24T20:12:52.981686] [INFO ] [MAIN      ] Update Progress: 1502/2366 symbols completed. NNY took 30.3s. Estimated remaining: 1h 50m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:12:53.154241] [INFO ] [MAIN      ] NOG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:12:53.206930] [DEBUG] [LOCAL     ] NOG: Loaded 51729 existing records from primary storage.
[2025-10-24T20:12:53.207290] [INFO ] [MAIN      ] NOG: Loaded 51729 existing records.
[2025-10-24T20:12:53.386683] [WARN ] [MAIN      ] NOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:12:53.386882] [INFO ] [MAIN      ] NOG: Wiping existing primary data before full refresh.
[2025-10-24T20:12:53.386929] [INFO ] [LOCAL     ] NOG: Starting deletion of primary data.
[2025-10-24T20:12:53.387798] [DEBUG] [LOCAL     ] NOG: Deleted primary data file.
[2025-10-24T20:12:53.387855] [INFO ] [MAIN      ] NOG: Starting full primary refresh.
[2025-10-24T20:12:53.739783] [INFO ] [REMOTE    ] NOG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:12:53.747598] [INFO ] [REMOTE    ] NOG: Fetching primary data for 2025-01.
[2025-10-24T20:12:54.012132] [INFO ] [REMOTE    ] NOAH: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T20:12:54.547676] [INFO ] [REMOTE    ] NOAH: Fetching primary data for 2025-04.
[2025-10-24T20:12:55.347820] [INFO ] [REMOTE    ] NOC: Fetching primary data for 2025-02.
[2025-10-24T20:12:55.389780] [INFO ] [REMOTE    ] NOG: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T20:12:55.450439] [INFO ] [REMOTE    ] NOAH: Incremental fetch complete for 2025-04 (0.90 seconds).
[2025-10-24T20:12:56.147681] [INFO ] [REMOTE    ] NOAH: Fetching primary data for 2025-05.
[2025-10-24T20:12:56.710563] [INFO ] [REMOTE    ] NOAH: Incremental fetch complete for 2025-05 (0.56 seconds).
[2025-10-24T20:12:56.947631] [INFO ] [REMOTE    ] NOG: Fetching primary data for 2025-02.
[2025-10-24T20:12:56.993536] [INFO ] [REMOTE    ] NOC: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T20:12:57.747724] [INFO ] [REMOTE    ] NOA: Fetching primary data for 2025-04.
[2025-10-24T20:12:58.547627] [INFO ] [REMOTE    ] NOAH: Fetching primary data for 2025-06.
[2025-10-24T20:12:58.790687] [INFO ] [REMOTE    ] NOA: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T20:12:58.941838] [INFO ] [REMOTE    ] NOG: Incremental fetch complete for 2025-02 (1.99 seconds).
[2025-10-24T20:12:59.347730] [INFO ] [REMOTE    ] NOG: Fetching primary data for 2025-03.
[2025-10-24T20:12:59.728259] [INFO ] [REMOTE    ] NOAH: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T20:13:00.147688] [INFO ] [REMOTE    ] NOA: Fetching primary data for 2025-05.
[2025-10-24T20:13:00.947614] [INFO ] [REMOTE    ] NOC: Fetching primary data for 2025-03.
[2025-10-24T20:13:01.120854] [INFO ] [REMOTE    ] NOA: Incremental fetch complete for 2025-05 (0.97 seconds).
[2025-10-24T20:13:01.752735] [INFO ] [REMOTE    ] NOA: Fetching primary data for 2025-06.
[2025-10-24T20:13:01.766772] [INFO ] [REMOTE    ] NOG: Incremental fetch complete for 2025-03 (2.42 seconds).
[2025-10-24T20:13:02.547670] [INFO ] [REMOTE    ] NOG: Fetching primary data for 2025-04.
[2025-10-24T20:13:02.597224] [INFO ] [REMOTE    ] NOA: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T20:13:03.020902] [INFO ] [REMOTE    ] NOC: Incremental fetch complete for 2025-03 (2.07 seconds).
[2025-10-24T20:13:03.347755] [INFO ] [REMOTE    ] NOA: Fetching primary data for 2025-07.
[2025-10-24T20:13:04.147803] [INFO ] [REMOTE    ] NOC: Fetching primary data for 2025-04.
[2025-10-24T20:13:04.217475] [INFO ] [REMOTE    ] NOA: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T20:13:04.269467] [INFO ] [REMOTE    ] NOG: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T20:13:04.947733] [INFO ] [REMOTE    ] NOA: Fetching primary data for 2025-08.
[2025-10-24T20:13:05.747698] [INFO ] [REMOTE    ] NOAH: Fetching primary data for 2025-07.
[2025-10-24T20:13:05.967577] [INFO ] [REMOTE    ] NOC: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T20:13:06.009040] [INFO ] [REMOTE    ] NOA: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T20:13:06.402007] [INFO ] [REMOTE    ] NOAH: Incremental fetch complete for 2025-07 (0.65 seconds).
[2025-10-24T20:13:06.547714] [INFO ] [REMOTE    ] NOA: Fetching primary data for 2025-09.
[2025-10-24T20:13:07.347684] [INFO ] [REMOTE    ] NOC: Fetching primary data for 2025-05.
[2025-10-24T20:13:07.550714] [INFO ] [REMOTE    ] NOA: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T20:13:08.147698] [INFO ] [REMOTE    ] NOAH: Fetching primary data for 2025-08.
[2025-10-24T20:13:08.952794] [INFO ] [REMOTE    ] NOG: Fetching primary data for 2025-05.
[2025-10-24T20:13:08.969064] [INFO ] [REMOTE    ] NOC: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T20:13:09.096471] [INFO ] [REMOTE    ] NOAH: Incremental fetch complete for 2025-08 (0.95 seconds).
[2025-10-24T20:13:09.747698] [INFO ] [REMOTE    ] NOA: Fetching primary data for 2025-10.
[2025-10-24T20:13:10.547726] [INFO ] [REMOTE    ] NOAH: Fetching primary data for 2025-09.
[2025-10-24T20:13:10.683963] [INFO ] [REMOTE    ] NOG: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T20:13:10.948426] [INFO ] [REMOTE    ] NOA: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T20:13:10.952233] [INFO ] [REMOTE    ] NOA: Full fetch complete (22609 records).
[2025-10-24T20:13:10.952369] [DEBUG] [VALIDATOR ] NOA: Validating primary data.
[2025-10-24T20:13:11.337928] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present.
[2025-10-24T20:13:11.338015] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed.
[2025-10-24T20:13:11.338537] [INFO ] [MAIN      ] NOA: Fetched primary data is valid.
[2025-10-24T20:13:11.338578] [DEBUG] [LOCAL     ] NOA: Saving primary data.
[2025-10-24T20:13:11.338875] [FATAL] [LOCAL     ] NOA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:13:11.338981] [FATAL] [MAIN      ] NOA: Failed to save primary data.
[2025-10-24T20:13:11.339023] [WARN ] [MAIN      ] NOA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:13:11.339056] [INFO ] [LOCAL     ] NOA: Starting deletion of primary data.
[2025-10-24T20:13:11.339105] [DEBUG] [LOCAL     ] NOA: No primary data file found to delete.
[2025-10-24T20:13:11.339139] [INFO ] [LOCAL     ] NOA: Starting deletion of derivative data.
[2025-10-24T20:13:11.339264] [DEBUG] [LOCAL     ] NOA: Deleted derivative data file.
[2025-10-24T20:13:11.339335] [INFO ] [MAIN      ] Update Progress: 1503/2366 symbols completed. NOA took 32.3s. Estimated remaining: 1h 50m 54s. Rate: 7.8 symbols/min
[2025-10-24T20:13:11.352760] [INFO ] [REMOTE    ] NOC: Fetching primary data for 2025-06.
[2025-10-24T20:13:11.524240] [INFO ] [MAIN      ] NOK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:13:11.583338] [DEBUG] [LOCAL     ] NOK: Loaded 54012 existing records from primary storage.
[2025-10-24T20:13:11.583806] [INFO ] [MAIN      ] NOK: Loaded 54012 existing records.
[2025-10-24T20:13:11.796214] [INFO ] [REMOTE    ] NOAH: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T20:13:11.800862] [WARN ] [MAIN      ] NOK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:13:11.806080] [INFO ] [MAIN      ] NOK: Wiping existing primary data before full refresh.
[2025-10-24T20:13:11.806288] [INFO ] [LOCAL     ] NOK: Starting deletion of primary data.
[2025-10-24T20:13:11.806867] [DEBUG] [LOCAL     ] NOK: Deleted primary data file.
[2025-10-24T20:13:11.806928] [INFO ] [MAIN      ] NOK: Starting full primary refresh.
[2025-10-24T20:13:12.163801] [INFO ] [REMOTE    ] NOG: Fetching primary data for 2025-06.
[2025-10-24T20:13:12.168455] [INFO ] [REMOTE    ] NOK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:13:12.947623] [INFO ] [REMOTE    ] NOK: Fetching primary data for 2025-01.
[2025-10-24T20:13:13.108760] [INFO ] [REMOTE    ] NOC: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T20:13:13.747635] [INFO ] [REMOTE    ] NOC: Fetching primary data for 2025-07.
[2025-10-24T20:13:13.938805] [INFO ] [REMOTE    ] NOG: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T20:13:14.547712] [INFO ] [REMOTE    ] NOG: Fetching primary data for 2025-07.
[2025-10-24T20:13:14.820724] [INFO ] [REMOTE    ] NOK: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T20:13:15.347626] [INFO ] [REMOTE    ] NOAH: Fetching primary data for 2025-10.
[2025-10-24T20:13:15.396212] [INFO ] [REMOTE    ] NOC: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T20:13:16.147613] [INFO ] [REMOTE    ] NOC: Fetching primary data for 2025-08.
[2025-10-24T20:13:16.190503] [INFO ] [REMOTE    ] NOG: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T20:13:16.534763] [INFO ] [REMOTE    ] NOAH: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T20:13:16.538535] [INFO ] [REMOTE    ] NOAH: Full fetch complete (27060 records).
[2025-10-24T20:13:16.538690] [DEBUG] [VALIDATOR ] NOAH: Validating primary data.
[2025-10-24T20:13:16.928072] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present.
[2025-10-24T20:13:16.928157] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed.
[2025-10-24T20:13:16.928743] [INFO ] [MAIN      ] NOAH: Fetched primary data is valid.
[2025-10-24T20:13:16.928804] [DEBUG] [LOCAL     ] NOAH: Saving primary data.
[2025-10-24T20:13:16.929301] [FATAL] [LOCAL     ] NOAH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:13:16.929403] [FATAL] [MAIN      ] NOAH: Failed to save primary data.
[2025-10-24T20:13:16.929444] [WARN ] [MAIN      ] NOAH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:13:16.929496] [INFO ] [LOCAL     ] NOAH: Starting deletion of primary data.
[2025-10-24T20:13:16.929549] [DEBUG] [LOCAL     ] NOAH: No primary data file found to delete.
[2025-10-24T20:13:16.929583] [INFO ] [LOCAL     ] NOAH: Starting deletion of derivative data.
[2025-10-24T20:13:16.929731] [DEBUG] [LOCAL     ] NOAH: Deleted derivative data file.
[2025-10-24T20:13:16.929822] [INFO ] [MAIN      ] Update Progress: 1504/2366 symbols completed. NOAH took 31.2s. Estimated remaining: 1h 50m 45s. Rate: 7.8 symbols/min
[2025-10-24T20:13:16.952872] [INFO ] [REMOTE    ] NOG: Fetching primary data for 2025-08.
[2025-10-24T20:13:17.103107] [INFO ] [MAIN      ] NOM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:13:17.103278] [DEBUG] [LOCAL     ] NOM: No existing data file found in primary storage.
[2025-10-24T20:13:17.103314] [WARN ] [MAIN      ] NOM: No existing data found, performing full refresh instead.
[2025-10-24T20:13:17.103427] [INFO ] [MAIN      ] NOM: Wiping existing primary data before full refresh.
[2025-10-24T20:13:17.103467] [INFO ] [LOCAL     ] NOM: Starting deletion of primary data.
[2025-10-24T20:13:17.103507] [DEBUG] [LOCAL     ] NOM: No primary data file found to delete.
[2025-10-24T20:13:17.103538] [INFO ] [MAIN      ] NOM: Starting full primary refresh.
[2025-10-24T20:13:17.466812] [INFO ] [REMOTE    ] NOM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:13:17.657089] [INFO ] [REMOTE    ] NOC: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T20:13:17.747681] [INFO ] [REMOTE    ] NOM: Fetching primary data for 2025-01.
[2025-10-24T20:13:18.029181] [INFO ] [REMOTE    ] NOM: Incremental fetch complete for 2025-01 (0.28 seconds).
[2025-10-24T20:13:18.325436] [INFO ] [REMOTE    ] NOG: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T20:13:18.547667] [INFO ] [REMOTE    ] NOK: Fetching primary data for 2025-02.
[2025-10-24T20:13:19.347670] [INFO ] [REMOTE    ] NOM: Fetching primary data for 2025-02.
[2025-10-24T20:13:19.686429] [INFO ] [REMOTE    ] NOM: Incremental fetch complete for 2025-02 (0.34 seconds).
[2025-10-24T20:13:20.147677] [INFO ] [REMOTE    ] NOG: Fetching primary data for 2025-09.
[2025-10-24T20:13:20.947675] [INFO ] [REMOTE    ] NOM: Fetching primary data for 2025-03.
[2025-10-24T20:13:21.151549] [INFO ] [REMOTE    ] NOK: Incremental fetch complete for 2025-02 (2.60 seconds).
[2025-10-24T20:13:21.294884] [INFO ] [REMOTE    ] NOM: Incremental fetch complete for 2025-03 (0.35 seconds).
[2025-10-24T20:13:21.747631] [INFO ] [REMOTE    ] NOK: Fetching primary data for 2025-03.
[2025-10-24T20:13:22.375713] [INFO ] [REMOTE    ] NOG: Incremental fetch complete for 2025-09 (2.23 seconds).
[2025-10-24T20:13:22.547711] [INFO ] [REMOTE    ] NOC: Fetching primary data for 2025-09.
[2025-10-24T20:13:23.347719] [INFO ] [REMOTE    ] NOM: Fetching primary data for 2025-04.
[2025-10-24T20:13:23.737145] [INFO ] [REMOTE    ] NOM: Incremental fetch complete for 2025-04 (0.39 seconds).
[2025-10-24T20:13:24.045050] [INFO ] [REMOTE    ] NOK: Incremental fetch complete for 2025-03 (2.30 seconds).
[2025-10-24T20:13:24.147694] [INFO ] [REMOTE    ] NOG: Fetching primary data for 2025-10.
[2025-10-24T20:13:24.600042] [INFO ] [REMOTE    ] NOC: Incremental fetch complete for 2025-09 (2.05 seconds).
[2025-10-24T20:13:24.947680] [INFO ] [REMOTE    ] NOK: Fetching primary data for 2025-04.
[2025-10-24T20:13:25.747637] [INFO ] [REMOTE    ] NOM: Fetching primary data for 2025-05.
[2025-10-24T20:13:26.060978] [INFO ] [REMOTE    ] NOM: Incremental fetch complete for 2025-05 (0.31 seconds).
[2025-10-24T20:13:26.099997] [INFO ] [REMOTE    ] NOG: Incremental fetch complete for 2025-10 (1.95 seconds).
[2025-10-24T20:13:26.109925] [INFO ] [REMOTE    ] NOG: Full fetch complete (74361 records).
[2025-10-24T20:13:26.110093] [DEBUG] [VALIDATOR ] NOG: Validating primary data.
[2025-10-24T20:13:26.507676] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present.
[2025-10-24T20:13:26.507821] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed.
[2025-10-24T20:13:26.508954] [INFO ] [MAIN      ] NOG: Fetched primary data is valid.
[2025-10-24T20:13:26.509016] [DEBUG] [LOCAL     ] NOG: Saving primary data.
[2025-10-24T20:13:26.509744] [FATAL] [LOCAL     ] NOG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:13:26.509833] [FATAL] [MAIN      ] NOG: Failed to save primary data.
[2025-10-24T20:13:26.509874] [WARN ] [MAIN      ] NOG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:13:26.509908] [INFO ] [LOCAL     ] NOG: Starting deletion of primary data.
[2025-10-24T20:13:26.509960] [DEBUG] [LOCAL     ] NOG: No primary data file found to delete.
[2025-10-24T20:13:26.509994] [INFO ] [LOCAL     ] NOG: Starting deletion of derivative data.
[2025-10-24T20:13:26.510109] [DEBUG] [LOCAL     ] NOG: Deleted derivative data file.
[2025-10-24T20:13:26.510561] [INFO ] [MAIN      ] Update Progress: 1505/2366 symbols completed. NOG took 33.5s. Estimated remaining: 1h 50m 38s. Rate: 7.8 symbols/min
[2025-10-24T20:13:26.554838] [INFO ] [REMOTE    ] NOM: Fetching primary data for 2025-06.
[2025-10-24T20:13:26.682536] [INFO ] [MAIN      ] NOMD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:13:26.723700] [DEBUG] [LOCAL     ] NOMD: Loaded 43545 existing records from primary storage.
[2025-10-24T20:13:26.723990] [INFO ] [MAIN      ] NOMD: Loaded 43545 existing records.
[2025-10-24T20:13:26.903092] [WARN ] [MAIN      ] NOMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:13:26.903334] [INFO ] [MAIN      ] NOMD: Wiping existing primary data before full refresh.
[2025-10-24T20:13:26.903381] [INFO ] [LOCAL     ] NOMD: Starting deletion of primary data.
[2025-10-24T20:13:26.904201] [DEBUG] [LOCAL     ] NOMD: Deleted primary data file.
[2025-10-24T20:13:26.904260] [INFO ] [MAIN      ] NOMD: Starting full primary refresh.
[2025-10-24T20:13:26.997804] [INFO ] [REMOTE    ] NOM: Incremental fetch complete for 2025-06 (0.44 seconds).
[2025-10-24T20:13:27.303332] [INFO ] [REMOTE    ] NOK: Incremental fetch complete for 2025-04 (2.36 seconds).
[2025-10-24T20:13:27.301448] [INFO ] [REMOTE    ] NOMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:13:27.347596] [INFO ] [REMOTE    ] NOK: Fetching primary data for 2025-05.
[2025-10-24T20:13:28.147668] [INFO ] [REMOTE    ] NOMD: Fetching primary data for 2025-01.
[2025-10-24T20:13:28.947637] [INFO ] [REMOTE    ] NOM: Fetching primary data for 2025-07.
[2025-10-24T20:13:29.369618] [INFO ] [REMOTE    ] NOM: Incremental fetch complete for 2025-07 (0.42 seconds).
[2025-10-24T20:13:29.543828] [INFO ] [REMOTE    ] NOMD: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T20:13:29.643722] [INFO ] [REMOTE    ] NOK: Incremental fetch complete for 2025-05 (2.30 seconds).
[2025-10-24T20:13:29.747612] [INFO ] [REMOTE    ] NOM: Fetching primary data for 2025-08.
[2025-10-24T20:13:30.210608] [INFO ] [REMOTE    ] NOM: Incremental fetch complete for 2025-08 (0.46 seconds).
[2025-10-24T20:13:30.547706] [INFO ] [REMOTE    ] NOMD: Fetching primary data for 2025-02.
[2025-10-24T20:13:31.347727] [INFO ] [REMOTE    ] NOK: Fetching primary data for 2025-06.
[2025-10-24T20:13:31.969815] [INFO ] [REMOTE    ] NOMD: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T20:13:32.147683] [INFO ] [REMOTE    ] NOMD: Fetching primary data for 2025-03.
[2025-10-24T20:13:32.947668] [INFO ] [REMOTE    ] NOC: Fetching primary data for 2025-10.
[2025-10-24T20:13:33.155098] [INFO ] [REMOTE    ] NOK: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T20:13:33.484935] [INFO ] [REMOTE    ] NOMD: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T20:13:33.747729] [INFO ] [REMOTE    ] NOM: Fetching primary data for 2025-09.
[2025-10-24T20:13:34.194469] [INFO ] [REMOTE    ] NOM: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T20:13:34.547666] [INFO ] [REMOTE    ] NOK: Fetching primary data for 2025-07.
[2025-10-24T20:13:34.707149] [INFO ] [REMOTE    ] NOC: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T20:13:34.715183] [INFO ] [REMOTE    ] NOC: Full fetch complete (61943 records).
[2025-10-24T20:13:34.715386] [DEBUG] [VALIDATOR ] NOC: Validating primary data.
[2025-10-24T20:13:35.142108] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present.
[2025-10-24T20:13:35.142252] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed.
[2025-10-24T20:13:35.144226] [INFO ] [MAIN      ] NOC: Fetched primary data is valid.
[2025-10-24T20:13:35.144301] [DEBUG] [LOCAL     ] NOC: Saving primary data.
[2025-10-24T20:13:35.145391] [FATAL] [LOCAL     ] NOC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:13:35.145499] [FATAL] [MAIN      ] NOC: Failed to save primary data.
[2025-10-24T20:13:35.145558] [WARN ] [MAIN      ] NOC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:13:35.145622] [INFO ] [LOCAL     ] NOC: Starting deletion of primary data.
[2025-10-24T20:13:35.145729] [DEBUG] [LOCAL     ] NOC: No primary data file found to delete.
[2025-10-24T20:13:35.145781] [INFO ] [LOCAL     ] NOC: Starting deletion of derivative data.
[2025-10-24T20:13:35.145948] [DEBUG] [LOCAL     ] NOC: Deleted derivative data file.
[2025-10-24T20:13:35.146459] [INFO ] [MAIN      ] Update Progress: 1506/2366 symbols completed. NOC took 45.6s. Estimated remaining: 1h 50m 31s. Rate: 7.8 symbols/min
[2025-10-24T20:13:35.331402] [INFO ] [MAIN      ] NOTE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:13:35.357705] [INFO ] [REMOTE    ] NOM: Fetching primary data for 2025-10.
[2025-10-24T20:13:35.377590] [DEBUG] [LOCAL     ] NOTE: Loaded 39696 existing records from primary storage.
[2025-10-24T20:13:35.378004] [INFO ] [MAIN      ] NOTE: Loaded 39696 existing records.
[2025-10-24T20:13:35.561870] [WARN ] [MAIN      ] NOTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:13:35.562144] [INFO ] [MAIN      ] NOTE: Wiping existing primary data before full refresh.
[2025-10-24T20:13:35.562194] [INFO ] [LOCAL     ] NOTE: Starting deletion of primary data.
[2025-10-24T20:13:35.562684] [DEBUG] [LOCAL     ] NOTE: Deleted primary data file.
[2025-10-24T20:13:35.562743] [INFO ] [MAIN      ] NOTE: Starting full primary refresh.
[2025-10-24T20:13:35.854949] [INFO ] [REMOTE    ] NOM: Incremental fetch complete for 2025-10 (0.50 seconds).
[2025-10-24T20:13:35.857554] [INFO ] [REMOTE    ] NOM: Full fetch complete (1535 records).
[2025-10-24T20:13:35.873746] [DEBUG] [VALIDATOR ] NOM: Validating primary data.
[2025-10-24T20:13:36.036832] [INFO ] [REMOTE    ] NOTE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:13:36.126463] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 189 unique days, need 200 days
[2025-10-24T20:13:36.126667] [FATAL] [MAIN      ] NOM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:13:36.126726] [WARN ] [MAIN      ] NOM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:13:36.126767] [INFO ] [LOCAL     ] NOM: Starting deletion of primary data.
[2025-10-24T20:13:36.126822] [DEBUG] [LOCAL     ] NOM: No primary data file found to delete.
[2025-10-24T20:13:36.126858] [INFO ] [LOCAL     ] NOM: Starting deletion of derivative data.
[2025-10-24T20:13:36.126896] [DEBUG] [LOCAL     ] NOM: No derivative data file found to delete.
[2025-10-24T20:13:36.126951] [INFO ] [MAIN      ] Update Progress: 1507/2366 symbols completed. NOM took 19.2s. Estimated remaining: 1h 50m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:13:36.155947] [INFO ] [REMOTE    ] NOMD: Fetching primary data for 2025-04.
[2025-10-24T20:13:36.300561] [INFO ] [MAIN      ] NOV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:13:36.353030] [DEBUG] [LOCAL     ] NOV: Loaded 53551 existing records from primary storage.
[2025-10-24T20:13:36.353329] [INFO ] [MAIN      ] NOV: Loaded 53551 existing records.
[2025-10-24T20:13:36.536374] [WARN ] [MAIN      ] NOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:13:36.536725] [INFO ] [MAIN      ] NOV: Wiping existing primary data before full refresh.
[2025-10-24T20:13:36.536801] [INFO ] [LOCAL     ] NOV: Starting deletion of primary data.
[2025-10-24T20:13:36.537176] [DEBUG] [LOCAL     ] NOV: Deleted primary data file.
[2025-10-24T20:13:36.537233] [INFO ] [MAIN      ] NOV: Starting full primary refresh.
[2025-10-24T20:13:36.684372] [INFO ] [REMOTE    ] NOK: Incremental fetch complete for 2025-07 (2.14 seconds).
[2025-10-24T20:13:36.934920] [INFO ] [REMOTE    ] NOV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:13:36.947608] [INFO ] [REMOTE    ] NOV: Fetching primary data for 2025-01.
[2025-10-24T20:13:37.699758] [INFO ] [REMOTE    ] NOMD: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T20:13:37.747610] [INFO ] [REMOTE    ] NOMD: Fetching primary data for 2025-05.
[2025-10-24T20:13:38.304166] [INFO ] [REMOTE    ] NOV: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T20:13:38.547721] [INFO ] [REMOTE    ] NOK: Fetching primary data for 2025-08.
[2025-10-24T20:13:39.151170] [INFO ] [REMOTE    ] NOMD: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T20:13:39.347634] [INFO ] [REMOTE    ] NOV: Fetching primary data for 2025-02.
[2025-10-24T20:13:40.147617] [INFO ] [REMOTE    ] NOMD: Fetching primary data for 2025-06.
[2025-10-24T20:13:40.635918] [INFO ] [REMOTE    ] NOK: Incremental fetch complete for 2025-08 (2.09 seconds).
[2025-10-24T20:13:40.947618] [INFO ] [REMOTE    ] NOTE: Fetching primary data for 2025-01.
[2025-10-24T20:13:41.078845] [INFO ] [REMOTE    ] NOV: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T20:13:41.153119] [INFO ] [REMOTE    ] NOMD: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T20:13:41.747705] [INFO ] [REMOTE    ] NOMD: Fetching primary data for 2025-07.
[2025-10-24T20:13:42.547617] [INFO ] [REMOTE    ] NOK: Fetching primary data for 2025-09.
[2025-10-24T20:13:43.259444] [INFO ] [REMOTE    ] NOMD: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T20:13:43.347616] [INFO ] [REMOTE    ] NOMD: Fetching primary data for 2025-08.
[2025-10-24T20:13:43.397103] [INFO ] [REMOTE    ] NOTE: Incremental fetch complete for 2025-01 (2.45 seconds).
[2025-10-24T20:13:44.140362] [INFO ] [REMOTE    ] NOK: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T20:13:44.150862] [INFO ] [REMOTE    ] NOTE: Fetching primary data for 2025-02.
[2025-10-24T20:13:44.780970] [INFO ] [REMOTE    ] NOMD: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T20:13:44.947729] [INFO ] [REMOTE    ] NOK: Fetching primary data for 2025-10.
[2025-10-24T20:13:45.747627] [INFO ] [REMOTE    ] NOMD: Fetching primary data for 2025-09.
[2025-10-24T20:13:45.951668] [INFO ] [REMOTE    ] NOTE: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T20:13:46.547719] [INFO ] [REMOTE    ] NOV: Fetching primary data for 2025-03.
[2025-10-24T20:13:47.049143] [INFO ] [REMOTE    ] NOMD: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T20:13:47.117371] [INFO ] [REMOTE    ] NOK: Incremental fetch complete for 2025-10 (2.17 seconds).
[2025-10-24T20:13:47.127433] [INFO ] [REMOTE    ] NOK: Full fetch complete (77774 records).
[2025-10-24T20:13:47.127603] [DEBUG] [VALIDATOR ] NOK: Validating primary data.
[2025-10-24T20:13:47.354485] [INFO ] [REMOTE    ] NOTE: Fetching primary data for 2025-03.
[2025-10-24T20:13:47.545553] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present.
[2025-10-24T20:13:47.545669] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed.
[2025-10-24T20:13:47.546765] [INFO ] [MAIN      ] NOK: Fetched primary data is valid.
[2025-10-24T20:13:47.546825] [DEBUG] [LOCAL     ] NOK: Saving primary data.
[2025-10-24T20:13:47.547401] [FATAL] [LOCAL     ] NOK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:13:47.547491] [FATAL] [MAIN      ] NOK: Failed to save primary data.
[2025-10-24T20:13:47.547532] [WARN ] [MAIN      ] NOK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:13:47.547597] [INFO ] [LOCAL     ] NOK: Starting deletion of primary data.
[2025-10-24T20:13:47.547682] [DEBUG] [LOCAL     ] NOK: No primary data file found to delete.
[2025-10-24T20:13:47.547747] [INFO ] [LOCAL     ] NOK: Starting deletion of derivative data.
[2025-10-24T20:13:47.547915] [DEBUG] [LOCAL     ] NOK: Deleted derivative data file.
[2025-10-24T20:13:47.548125] [INFO ] [MAIN      ] Update Progress: 1508/2366 symbols completed. NOK took 36.2s. Estimated remaining: 1h 50m 14s. Rate: 7.8 symbols/min
[2025-10-24T20:13:47.717622] [INFO ] [MAIN      ] NOW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:13:47.766253] [DEBUG] [LOCAL     ] NOW: Loaded 48142 existing records from primary storage.
[2025-10-24T20:13:47.766617] [INFO ] [MAIN      ] NOW: Loaded 48142 existing records.
[2025-10-24T20:13:47.951251] [WARN ] [MAIN      ] NOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:13:47.951442] [INFO ] [MAIN      ] NOW: Wiping existing primary data before full refresh.
[2025-10-24T20:13:47.951487] [INFO ] [LOCAL     ] NOW: Starting deletion of primary data.
[2025-10-24T20:13:47.951820] [DEBUG] [LOCAL     ] NOW: Deleted primary data file.
[2025-10-24T20:13:47.951876] [INFO ] [MAIN      ] NOW: Starting full primary refresh.
[2025-10-24T20:13:48.153418] [INFO ] [REMOTE    ] NOMD: Fetching primary data for 2025-10.
[2025-10-24T20:13:48.348522] [INFO ] [REMOTE    ] NOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:13:48.350723] [INFO ] [REMOTE    ] NOV: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T20:13:48.947689] [INFO ] [REMOTE    ] NOV: Fetching primary data for 2025-04.
[2025-10-24T20:13:49.037425] [INFO ] [REMOTE    ] NOTE: Incremental fetch complete for 2025-03 (1.68 seconds).
[2025-10-24T20:13:49.747705] [INFO ] [REMOTE    ] NOTE: Fetching primary data for 2025-04.
[2025-10-24T20:13:49.989356] [INFO ] [REMOTE    ] NOMD: Incremental fetch complete for 2025-10 (1.84 seconds).
[2025-10-24T20:13:49.998757] [INFO ] [REMOTE    ] NOMD: Full fetch complete (61007 records).
[2025-10-24T20:13:49.998906] [DEBUG] [VALIDATOR ] NOMD: Validating primary data.
[2025-10-24T20:13:50.415566] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present.
[2025-10-24T20:13:50.415711] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed.
[2025-10-24T20:13:50.416731] [INFO ] [MAIN      ] NOMD: Fetched primary data is valid.
[2025-10-24T20:13:50.416810] [DEBUG] [LOCAL     ] NOMD: Saving primary data.
[2025-10-24T20:13:50.417419] [FATAL] [LOCAL     ] NOMD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:13:50.417505] [FATAL] [MAIN      ] NOMD: Failed to save primary data.
[2025-10-24T20:13:50.417550] [WARN ] [MAIN      ] NOMD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:13:50.417586] [INFO ] [LOCAL     ] NOMD: Starting deletion of primary data.
[2025-10-24T20:13:50.417638] [DEBUG] [LOCAL     ] NOMD: No primary data file found to delete.
[2025-10-24T20:13:50.417719] [INFO ] [LOCAL     ] NOMD: Starting deletion of derivative data.
[2025-10-24T20:13:50.417853] [DEBUG] [LOCAL     ] NOMD: Deleted derivative data file.
[2025-10-24T20:13:50.418193] [INFO ] [MAIN      ] Update Progress: 1509/2366 symbols completed. NOMD took 23.9s. Estimated remaining: 1h 50m 4s. Rate: 7.8 symbols/min
[2025-10-24T20:13:50.558581] [INFO ] [REMOTE    ] NOW: Fetching primary data for 2025-01.
[2025-10-24T20:13:50.594039] [INFO ] [MAIN      ] NP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:13:50.594292] [DEBUG] [LOCAL     ] NP: No existing data file found in primary storage.
[2025-10-24T20:13:50.594357] [WARN ] [MAIN      ] NP: No existing data found, performing full refresh instead.
[2025-10-24T20:13:50.594610] [INFO ] [MAIN      ] NP: Wiping existing primary data before full refresh.
[2025-10-24T20:13:50.594699] [INFO ] [LOCAL     ] NP: Starting deletion of primary data.
[2025-10-24T20:13:50.594812] [DEBUG] [LOCAL     ] NP: No primary data file found to delete.
[2025-10-24T20:13:50.594886] [INFO ] [MAIN      ] NP: Starting full primary refresh.
[2025-10-24T20:13:50.753820] [INFO ] [REMOTE    ] NOV: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T20:13:51.016943] [INFO ] [REMOTE    ] NP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:13:51.041896] [INFO ] [REMOTE    ] NOTE: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T20:13:51.347722] [INFO ] [REMOTE    ] NOTE: Fetching primary data for 2025-05.
[2025-10-24T20:13:52.147727] [INFO ] [REMOTE    ] NOV: Fetching primary data for 2025-05.
[2025-10-24T20:13:52.761690] [INFO ] [REMOTE    ] NOW: Incremental fetch complete for 2025-01 (2.20 seconds).
[2025-10-24T20:13:52.943688] [INFO ] [REMOTE    ] NOTE: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T20:13:52.952705] [INFO ] [REMOTE    ] NP: Fetching primary data for 2025-01.
[2025-10-24T20:13:53.161458] [DEBUG] [REMOTE    ] NP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:13:53.161722] [WARN ] [REMOTE    ] NP: No data returned for month 2025-01
[2025-10-24T20:13:53.161807] [FATAL] [REMOTE    ] NP: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:13:53.161900] [FATAL] [MAIN      ] NP: Failed to fetch primary data.
[2025-10-24T20:13:53.161967] [WARN ] [MAIN      ] NP: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:13:53.162043] [INFO ] [LOCAL     ] NP: Starting deletion of primary data.
[2025-10-24T20:13:53.162105] [DEBUG] [LOCAL     ] NP: No primary data file found to delete.
[2025-10-24T20:13:53.162140] [INFO ] [LOCAL     ] NP: Starting deletion of derivative data.
[2025-10-24T20:13:53.162180] [DEBUG] [LOCAL     ] NP: No derivative data file found to delete.
[2025-10-24T20:13:53.162225] [INFO ] [MAIN      ] Update Progress: 1510/2366 symbols completed. NP took 2.7s. Estimated remaining: 1h 49m 53s. Rate: 7.8 symbols/min
[2025-10-24T20:13:53.336698] [INFO ] [MAIN      ] NPB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:13:53.336930] [DEBUG] [LOCAL     ] NPB: No existing data file found in primary storage.
[2025-10-24T20:13:53.336976] [WARN ] [MAIN      ] NPB: No existing data found, performing full refresh instead.
[2025-10-24T20:13:53.337089] [INFO ] [MAIN      ] NPB: Wiping existing primary data before full refresh.
[2025-10-24T20:13:53.337131] [INFO ] [LOCAL     ] NPB: Starting deletion of primary data.
[2025-10-24T20:13:53.337173] [DEBUG] [LOCAL     ] NPB: No primary data file found to delete.
[2025-10-24T20:13:53.337251] [INFO ] [MAIN      ] NPB: Starting full primary refresh.
[2025-10-24T20:13:53.733478] [INFO ] [REMOTE    ] NPB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:13:53.747615] [INFO ] [REMOTE    ] NPB: Fetching primary data for 2025-01.
[2025-10-24T20:13:54.408479] [DEBUG] [REMOTE    ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:13:54.423864] [WARN ] [REMOTE    ] NPB: No data returned for month 2025-01
[2025-10-24T20:13:54.426961] [FATAL] [REMOTE    ] NPB: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:13:54.427238] [FATAL] [MAIN      ] NPB: Failed to fetch primary data.
[2025-10-24T20:13:54.429889] [INFO ] [REMOTE    ] NOV: Incremental fetch complete for 2025-05 (2.28 seconds).
[2025-10-24T20:13:54.427770] [WARN ] [MAIN      ] NPB: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:13:54.440909] [INFO ] [LOCAL     ] NPB: Starting deletion of primary data.
[2025-10-24T20:13:54.441326] [DEBUG] [LOCAL     ] NPB: No primary data file found to delete.
[2025-10-24T20:13:54.442043] [INFO ] [LOCAL     ] NPB: Starting deletion of derivative data.
[2025-10-24T20:13:54.442135] [DEBUG] [LOCAL     ] NPB: No derivative data file found to delete.
[2025-10-24T20:13:54.442200] [INFO ] [MAIN      ] Update Progress: 1511/2366 symbols completed. NPB took 1.3s. Estimated remaining: 1h 49m 42s. Rate: 7.8 symbols/min
[2025-10-24T20:13:54.552827] [INFO ] [REMOTE    ] NOV: Fetching primary data for 2025-06.
[2025-10-24T20:13:54.610996] [INFO ] [MAIN      ] NPCT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:13:54.630753] [DEBUG] [LOCAL     ] NPCT: Loaded 16524 existing records from primary storage.
[2025-10-24T20:13:54.631002] [INFO ] [MAIN      ] NPCT: Loaded 16524 existing records.
[2025-10-24T20:13:54.802025] [WARN ] [MAIN      ] NPCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:13:54.802222] [INFO ] [MAIN      ] NPCT: Wiping existing primary data before full refresh.
[2025-10-24T20:13:54.802267] [INFO ] [LOCAL     ] NPCT: Starting deletion of primary data.
[2025-10-24T20:13:54.802510] [DEBUG] [LOCAL     ] NPCT: Deleted primary data file.
[2025-10-24T20:13:54.802565] [INFO ] [MAIN      ] NPCT: Starting full primary refresh.
[2025-10-24T20:13:55.152502] [INFO ] [REMOTE    ] NPCT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:13:55.347687] [INFO ] [REMOTE    ] NPCT: Fetching primary data for 2025-01.
[2025-10-24T20:13:56.147704] [INFO ] [REMOTE    ] NOW: Fetching primary data for 2025-02.
[2025-10-24T20:13:56.361053] [INFO ] [REMOTE    ] NOV: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T20:13:56.459200] [INFO ] [REMOTE    ] NPCT: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T20:13:56.947679] [INFO ] [REMOTE    ] NPCT: Fetching primary data for 2025-02.
[2025-10-24T20:13:57.729196] [INFO ] [REMOTE    ] NPCT: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T20:13:57.747599] [INFO ] [REMOTE    ] NOTE: Fetching primary data for 2025-06.
[2025-10-24T20:13:57.965591] [INFO ] [REMOTE    ] NOW: Incremental fetch complete for 2025-02 (1.82 seconds).
[2025-10-24T20:13:58.547690] [INFO ] [REMOTE    ] NOV: Fetching primary data for 2025-07.
[2025-10-24T20:13:59.324477] [INFO ] [REMOTE    ] NOTE: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T20:13:59.347631] [INFO ] [REMOTE    ] NOTE: Fetching primary data for 2025-07.
[2025-10-24T20:14:00.147632] [INFO ] [REMOTE    ] NPCT: Fetching primary data for 2025-03.
[2025-10-24T20:14:00.207551] [INFO ] [REMOTE    ] NOV: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T20:14:00.947757] [INFO ] [REMOTE    ] NOV: Fetching primary data for 2025-08.
[2025-10-24T20:14:01.144003] [INFO ] [REMOTE    ] NPCT: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T20:14:01.274319] [INFO ] [REMOTE    ] NOTE: Incremental fetch complete for 2025-07 (1.93 seconds).
[2025-10-24T20:14:01.747682] [INFO ] [REMOTE    ] NPCT: Fetching primary data for 2025-04.
[2025-10-24T20:14:02.436030] [INFO ] [REMOTE    ] NOV: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T20:14:02.547618] [INFO ] [REMOTE    ] NOV: Fetching primary data for 2025-09.
[2025-10-24T20:14:02.760734] [INFO ] [REMOTE    ] NPCT: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T20:14:03.347714] [INFO ] [REMOTE    ] NOTE: Fetching primary data for 2025-08.
[2025-10-24T20:14:04.147684] [INFO ] [REMOTE    ] NPCT: Fetching primary data for 2025-05.
[2025-10-24T20:14:04.217590] [INFO ] [REMOTE    ] NOV: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T20:14:04.947725] [INFO ] [REMOTE    ] NOV: Fetching primary data for 2025-10.
[2025-10-24T20:14:05.097016] [INFO ] [REMOTE    ] NOTE: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T20:14:05.271114] [INFO ] [REMOTE    ] NPCT: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T20:14:05.747690] [INFO ] [REMOTE    ] NOTE: Fetching primary data for 2025-09.
[2025-10-24T20:14:06.547746] [INFO ] [REMOTE    ] NOW: Fetching primary data for 2025-03.
[2025-10-24T20:14:06.931047] [INFO ] [REMOTE    ] NOTE: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T20:14:06.938533] [INFO ] [REMOTE    ] NOV: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T20:14:06.949838] [INFO ] [REMOTE    ] NOV: Full fetch complete (77193 records).
[2025-10-24T20:14:06.950013] [DEBUG] [VALIDATOR ] NOV: Validating primary data.
[2025-10-24T20:14:07.348603] [INFO ] [REMOTE    ] NPCT: Fetching primary data for 2025-06.
[2025-10-24T20:14:07.371856] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present.
[2025-10-24T20:14:07.371953] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed.
[2025-10-24T20:14:07.373238] [INFO ] [MAIN      ] NOV: Fetched primary data is valid.
[2025-10-24T20:14:07.373418] [DEBUG] [LOCAL     ] NOV: Saving primary data.
[2025-10-24T20:14:07.374159] [FATAL] [LOCAL     ] NOV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:14:07.374250] [FATAL] [MAIN      ] NOV: Failed to save primary data.
[2025-10-24T20:14:07.374318] [WARN ] [MAIN      ] NOV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:14:07.374389] [INFO ] [LOCAL     ] NOV: Starting deletion of primary data.
[2025-10-24T20:14:07.374455] [DEBUG] [LOCAL     ] NOV: No primary data file found to delete.
[2025-10-24T20:14:07.374491] [INFO ] [LOCAL     ] NOV: Starting deletion of derivative data.
[2025-10-24T20:14:07.374680] [DEBUG] [LOCAL     ] NOV: Deleted derivative data file.
[2025-10-24T20:14:07.375315] [INFO ] [MAIN      ] Update Progress: 1512/2366 symbols completed. NOV took 31.2s. Estimated remaining: 1h 49m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:14:07.556636] [INFO ] [MAIN      ] NPFD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:14:07.570302] [DEBUG] [LOCAL     ] NPFD: Loaded 10132 existing records from primary storage.
[2025-10-24T20:14:07.570537] [INFO ] [MAIN      ] NPFD: Loaded 10132 existing records.
[2025-10-24T20:14:07.757596] [WARN ] [MAIN      ] NPFD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:14:07.757835] [INFO ] [MAIN      ] NPFD: Wiping existing primary data before full refresh.
[2025-10-24T20:14:07.757880] [INFO ] [LOCAL     ] NPFD: Starting deletion of primary data.
[2025-10-24T20:14:07.758051] [DEBUG] [LOCAL     ] NPFD: Deleted primary data file.
[2025-10-24T20:14:07.758090] [INFO ] [MAIN      ] NPFD: Starting full primary refresh.
[2025-10-24T20:14:08.128374] [INFO ] [REMOTE    ] NPFD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:14:08.147604] [INFO ] [REMOTE    ] NPFD: Fetching primary data for 2025-01.
[2025-10-24T20:14:08.424871] [INFO ] [REMOTE    ] NPCT: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T20:14:08.671692] [INFO ] [REMOTE    ] NPFD: Incremental fetch complete for 2025-01 (0.52 seconds).
[2025-10-24T20:14:08.676035] [INFO ] [REMOTE    ] NOW: Incremental fetch complete for 2025-03 (2.13 seconds).
[2025-10-24T20:14:08.947702] [INFO ] [REMOTE    ] NPFD: Fetching primary data for 2025-02.
[2025-10-24T20:14:09.721160] [INFO ] [REMOTE    ] NPFD: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T20:14:09.747675] [INFO ] [REMOTE    ] NPFD: Fetching primary data for 2025-03.
[2025-10-24T20:14:10.547732] [INFO ] [REMOTE    ] NOW: Fetching primary data for 2025-04.
[2025-10-24T20:14:10.551512] [INFO ] [REMOTE    ] NPFD: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T20:14:11.347685] [INFO ] [REMOTE    ] NOTE: Fetching primary data for 2025-10.
[2025-10-24T20:14:12.147697] [INFO ] [REMOTE    ] NPFD: Fetching primary data for 2025-04.
[2025-10-24T20:14:12.572246] [INFO ] [REMOTE    ] NOTE: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T20:14:12.577287] [INFO ] [REMOTE    ] NOTE: Full fetch complete (60557 records).
[2025-10-24T20:14:12.577425] [DEBUG] [VALIDATOR ] NOTE: Validating primary data.
[2025-10-24T20:14:12.933050] [INFO ] [REMOTE    ] NPFD: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T20:14:12.973121] [INFO ] [REMOTE    ] NOW: Incremental fetch complete for 2025-04 (2.43 seconds).
[2025-10-24T20:14:12.953825] [INFO ] [REMOTE    ] NPCT: Fetching primary data for 2025-07.
[2025-10-24T20:14:13.051372] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present.
[2025-10-24T20:14:13.051485] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed.
[2025-10-24T20:14:13.052992] [INFO ] [MAIN      ] NOTE: Fetched primary data is valid.
[2025-10-24T20:14:13.053074] [DEBUG] [LOCAL     ] NOTE: Saving primary data.
[2025-10-24T20:14:13.053764] [FATAL] [LOCAL     ] NOTE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:14:13.054142] [FATAL] [MAIN      ] NOTE: Failed to save primary data.
[2025-10-24T20:14:13.054329] [WARN ] [MAIN      ] NOTE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:14:13.054413] [INFO ] [LOCAL     ] NOTE: Starting deletion of primary data.
[2025-10-24T20:14:13.054489] [DEBUG] [LOCAL     ] NOTE: No primary data file found to delete.
[2025-10-24T20:14:13.054538] [INFO ] [LOCAL     ] NOTE: Starting deletion of derivative data.
[2025-10-24T20:14:13.054727] [DEBUG] [LOCAL     ] NOTE: Deleted derivative data file.
[2025-10-24T20:14:13.055451] [INFO ] [MAIN      ] Update Progress: 1513/2366 symbols completed. NOTE took 37.9s. Estimated remaining: 1h 49m 28s. Rate: 7.8 symbols/min
[2025-10-24T20:14:13.227704] [INFO ] [MAIN      ] NPK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:14:13.238712] [DEBUG] [LOCAL     ] NPK: Loaded 8417 existing records from primary storage.
[2025-10-24T20:14:13.238949] [INFO ] [MAIN      ] NPK: Loaded 8417 existing records.
[2025-10-24T20:14:13.425894] [WARN ] [MAIN      ] NPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:14:13.426132] [INFO ] [MAIN      ] NPK: Wiping existing primary data before full refresh.
[2025-10-24T20:14:13.426186] [INFO ] [LOCAL     ] NPK: Starting deletion of primary data.
[2025-10-24T20:14:13.426369] [DEBUG] [LOCAL     ] NPK: Deleted primary data file.
[2025-10-24T20:14:13.426431] [INFO ] [MAIN      ] NPK: Starting full primary refresh.
[2025-10-24T20:14:13.758899] [INFO ] [REMOTE    ] NOW: Fetching primary data for 2025-05.
[2025-10-24T20:14:13.799575] [INFO ] [REMOTE    ] NPK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:14:14.051823] [INFO ] [REMOTE    ] NPCT: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T20:14:14.547684] [INFO ] [REMOTE    ] NPCT: Fetching primary data for 2025-08.
[2025-10-24T20:14:15.325888] [INFO ] [REMOTE    ] NPCT: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T20:14:15.347676] [INFO ] [REMOTE    ] NPCT: Fetching primary data for 2025-09.
[2025-10-24T20:14:15.676063] [INFO ] [REMOTE    ] NOW: Incremental fetch complete for 2025-05 (1.92 seconds).
[2025-10-24T20:14:16.147685] [INFO ] [REMOTE    ] NOW: Fetching primary data for 2025-06.
[2025-10-24T20:14:16.257176] [INFO ] [REMOTE    ] NPCT: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T20:14:16.947721] [INFO ] [REMOTE    ] NPFD: Fetching primary data for 2025-05.
[2025-10-24T20:14:17.678752] [INFO ] [REMOTE    ] NPFD: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T20:14:17.747612] [INFO ] [REMOTE    ] NPFD: Fetching primary data for 2025-06.
[2025-10-24T20:14:17.808874] [INFO ] [REMOTE    ] NOW: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T20:14:18.476906] [INFO ] [REMOTE    ] NPFD: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T20:14:18.547691] [INFO ] [REMOTE    ] NPCT: Fetching primary data for 2025-10.
[2025-10-24T20:14:19.347639] [INFO ] [REMOTE    ] NPFD: Fetching primary data for 2025-07.
[2025-10-24T20:14:19.508699] [INFO ] [REMOTE    ] NPCT: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T20:14:19.511497] [INFO ] [REMOTE    ] NPCT: Full fetch complete (24279 records).
[2025-10-24T20:14:19.511587] [DEBUG] [VALIDATOR ] NPCT: Validating primary data.
[2025-10-24T20:14:19.889789] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present.
[2025-10-24T20:14:19.889927] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed.
[2025-10-24T20:14:19.890460] [INFO ] [MAIN      ] NPCT: Fetched primary data is valid.
[2025-10-24T20:14:19.890504] [DEBUG] [LOCAL     ] NPCT: Saving primary data.
[2025-10-24T20:14:19.890904] [FATAL] [LOCAL     ] NPCT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:14:19.891074] [FATAL] [MAIN      ] NPCT: Failed to save primary data.
[2025-10-24T20:14:19.891130] [WARN ] [MAIN      ] NPCT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:14:19.891196] [INFO ] [LOCAL     ] NPCT: Starting deletion of primary data.
[2025-10-24T20:14:19.891283] [DEBUG] [LOCAL     ] NPCT: No primary data file found to delete.
[2025-10-24T20:14:19.891352] [INFO ] [LOCAL     ] NPCT: Starting deletion of derivative data.
[2025-10-24T20:14:19.891848] [DEBUG] [LOCAL     ] NPCT: Deleted derivative data file.
[2025-10-24T20:14:19.891956] [INFO ] [MAIN      ] Update Progress: 1514/2366 symbols completed. NPCT took 25.4s. Estimated remaining: 1h 49m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:14:20.066948] [INFO ] [MAIN      ] NPKI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:14:20.106605] [DEBUG] [LOCAL     ] NPKI: Loaded 40736 existing records from primary storage.
[2025-10-24T20:14:20.106936] [INFO ] [MAIN      ] NPKI: Loaded 40736 existing records.
[2025-10-24T20:14:20.149829] [INFO ] [REMOTE    ] NPK: Fetching primary data for 2025-01.
[2025-10-24T20:14:20.231716] [INFO ] [REMOTE    ] NPFD: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T20:14:20.307996] [WARN ] [MAIN      ] NPKI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:14:20.308274] [INFO ] [MAIN      ] NPKI: Wiping existing primary data before full refresh.
[2025-10-24T20:14:20.308335] [INFO ] [LOCAL     ] NPKI: Starting deletion of primary data.
[2025-10-24T20:14:20.308682] [DEBUG] [LOCAL     ] NPKI: Deleted primary data file.
[2025-10-24T20:14:20.308739] [INFO ] [MAIN      ] NPKI: Starting full primary refresh.
[2025-10-24T20:14:20.669605] [INFO ] [REMOTE    ] NPKI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:14:20.919706] [INFO ] [REMOTE    ] NPK: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T20:14:20.947691] [INFO ] [REMOTE    ] NOW: Fetching primary data for 2025-07.
[2025-10-24T20:14:21.747678] [INFO ] [REMOTE    ] NPK: Fetching primary data for 2025-02.
[2025-10-24T20:14:22.360887] [INFO ] [REMOTE    ] NPK: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T20:14:22.547686] [INFO ] [REMOTE    ] NPKI: Fetching primary data for 2025-01.
[2025-10-24T20:14:22.988717] [INFO ] [REMOTE    ] NOW: Incremental fetch complete for 2025-07 (2.04 seconds).
[2025-10-24T20:14:23.347691] [INFO ] [REMOTE    ] NPFD: Fetching primary data for 2025-08.
[2025-10-24T20:14:23.767459] [INFO ] [REMOTE    ] NPKI: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T20:14:24.083801] [INFO ] [REMOTE    ] NPFD: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T20:14:24.147673] [INFO ] [REMOTE    ] NOW: Fetching primary data for 2025-08.
[2025-10-24T20:14:24.947716] [INFO ] [REMOTE    ] NPFD: Fetching primary data for 2025-09.
[2025-10-24T20:14:25.742401] [INFO ] [REMOTE    ] NPFD: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T20:14:25.747593] [INFO ] [REMOTE    ] NPFD: Fetching primary data for 2025-10.
[2025-10-24T20:14:25.985570] [INFO ] [REMOTE    ] NOW: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T20:14:26.401874] [INFO ] [REMOTE    ] NPFD: Incremental fetch complete for 2025-10 (0.65 seconds).
[2025-10-24T20:14:26.404676] [INFO ] [REMOTE    ] NPFD: Full fetch complete (14701 records).
[2025-10-24T20:14:26.404768] [DEBUG] [VALIDATOR ] NPFD: Validating primary data.
[2025-10-24T20:14:26.552855] [INFO ] [REMOTE    ] NPK: Fetching primary data for 2025-03.
[2025-10-24T20:14:26.783715] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present.
[2025-10-24T20:14:26.783810] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed.
[2025-10-24T20:14:26.784178] [INFO ] [MAIN      ] NPFD: Fetched primary data is valid.
[2025-10-24T20:14:26.784221] [DEBUG] [LOCAL     ] NPFD: Saving primary data.
[2025-10-24T20:14:26.784444] [FATAL] [LOCAL     ] NPFD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:14:26.784536] [FATAL] [MAIN      ] NPFD: Failed to save primary data.
[2025-10-24T20:14:26.784580] [WARN ] [MAIN      ] NPFD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:14:26.784618] [INFO ] [LOCAL     ] NPFD: Starting deletion of primary data.
[2025-10-24T20:14:26.784706] [DEBUG] [LOCAL     ] NPFD: No primary data file found to delete.
[2025-10-24T20:14:26.784756] [INFO ] [LOCAL     ] NPFD: Starting deletion of derivative data.
[2025-10-24T20:14:26.784899] [DEBUG] [LOCAL     ] NPFD: Deleted derivative data file.
[2025-10-24T20:14:26.784987] [INFO ] [MAIN      ] Update Progress: 1515/2366 symbols completed. NPFD took 19.4s. Estimated remaining: 1h 49m 12s. Rate: 7.8 symbols/min
[2025-10-24T20:14:26.953732] [INFO ] [MAIN      ] NPO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:14:26.970659] [DEBUG] [LOCAL     ] NPO: Loaded 13600 existing records from primary storage.
[2025-10-24T20:14:26.970906] [INFO ] [MAIN      ] NPO: Loaded 13600 existing records.
[2025-10-24T20:14:27.150378] [WARN ] [MAIN      ] NPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:14:27.150563] [INFO ] [MAIN      ] NPO: Wiping existing primary data before full refresh.
[2025-10-24T20:14:27.150612] [INFO ] [LOCAL     ] NPO: Starting deletion of primary data.
[2025-10-24T20:14:27.150948] [DEBUG] [LOCAL     ] NPO: Deleted primary data file.
[2025-10-24T20:14:27.151005] [INFO ] [MAIN      ] NPO: Starting full primary refresh.
[2025-10-24T20:14:27.352920] [INFO ] [REMOTE    ] NPKI: Fetching primary data for 2025-02.
[2025-10-24T20:14:27.407555] [INFO ] [REMOTE    ] NPK: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T20:14:27.524437] [INFO ] [REMOTE    ] NPO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:14:28.147724] [INFO ] [REMOTE    ] NPK: Fetching primary data for 2025-04.
[2025-10-24T20:14:28.731997] [INFO ] [REMOTE    ] NPKI: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T20:14:28.734572] [INFO ] [REMOTE    ] NPK: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T20:14:28.947683] [INFO ] [REMOTE    ] NPK: Fetching primary data for 2025-05.
[2025-10-24T20:14:29.562026] [INFO ] [REMOTE    ] NPK: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T20:14:29.747704] [INFO ] [REMOTE    ] NPKI: Fetching primary data for 2025-03.
[2025-10-24T20:14:30.547721] [INFO ] [REMOTE    ] NPK: Fetching primary data for 2025-06.
[2025-10-24T20:14:31.181909] [INFO ] [REMOTE    ] NPKI: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T20:14:31.347683] [INFO ] [REMOTE    ] NPO: Fetching primary data for 2025-01.
[2025-10-24T20:14:31.383951] [INFO ] [REMOTE    ] NPK: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T20:14:32.147679] [INFO ] [REMOTE    ] NOW: Fetching primary data for 2025-09.
[2025-10-24T20:14:32.162066] [INFO ] [REMOTE    ] NPO: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T20:14:32.947668] [INFO ] [REMOTE    ] NPO: Fetching primary data for 2025-02.
[2025-10-24T20:14:33.746620] [INFO ] [REMOTE    ] NPO: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T20:14:33.749404] [INFO ] [REMOTE    ] NPKI: Fetching primary data for 2025-04.
[2025-10-24T20:14:33.955782] [INFO ] [REMOTE    ] NOW: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T20:14:34.547684] [INFO ] [REMOTE    ] NPK: Fetching primary data for 2025-07.
[2025-10-24T20:14:34.810136] [INFO ] [REMOTE    ] NPKI: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T20:14:35.347631] [INFO ] [REMOTE    ] NPO: Fetching primary data for 2025-03.
[2025-10-24T20:14:35.454057] [INFO ] [REMOTE    ] NPK: Incremental fetch complete for 2025-07 (0.91 seconds).
[2025-10-24T20:14:36.133030] [INFO ] [REMOTE    ] NPO: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T20:14:36.147612] [INFO ] [REMOTE    ] NPO: Fetching primary data for 2025-04.
[2025-10-24T20:14:36.947733] [INFO ] [REMOTE    ] NPKI: Fetching primary data for 2025-05.
[2025-10-24T20:14:37.213962] [INFO ] [REMOTE    ] NPO: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T20:14:37.747700] [INFO ] [REMOTE    ] NPO: Fetching primary data for 2025-05.
[2025-10-24T20:14:38.369085] [INFO ] [REMOTE    ] NPKI: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T20:14:38.547697] [INFO ] [REMOTE    ] NPKI: Fetching primary data for 2025-06.
[2025-10-24T20:14:38.713072] [INFO ] [REMOTE    ] NPO: Incremental fetch complete for 2025-05 (0.97 seconds).
[2025-10-24T20:14:39.347738] [INFO ] [REMOTE    ] NPO: Fetching primary data for 2025-06.
[2025-10-24T20:14:39.654160] [INFO ] [REMOTE    ] NPKI: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T20:14:39.963921] [INFO ] [REMOTE    ] NPO: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T20:14:40.147731] [INFO ] [REMOTE    ] NPKI: Fetching primary data for 2025-07.
[2025-10-24T20:14:40.947844] [INFO ] [REMOTE    ] NPO: Fetching primary data for 2025-07.
[2025-10-24T20:14:41.251625] [INFO ] [REMOTE    ] NPKI: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T20:14:41.532840] [INFO ] [REMOTE    ] NPO: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T20:14:41.747688] [INFO ] [REMOTE    ] NPO: Fetching primary data for 2025-08.
[2025-10-24T20:14:42.547747] [INFO ] [REMOTE    ] NPK: Fetching primary data for 2025-08.
[2025-10-24T20:14:42.566250] [INFO ] [REMOTE    ] NPO: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T20:14:43.289730] [INFO ] [REMOTE    ] NPK: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T20:14:43.347700] [INFO ] [REMOTE    ] NPO: Fetching primary data for 2025-09.
[2025-10-24T20:14:44.147716] [INFO ] [REMOTE    ] NOW: Fetching primary data for 2025-10.
[2025-10-24T20:14:44.181175] [INFO ] [REMOTE    ] NPO: Incremental fetch complete for 2025-09 (0.83 seconds).
[2025-10-24T20:14:44.947744] [INFO ] [REMOTE    ] NPO: Fetching primary data for 2025-10.
[2025-10-24T20:14:45.747745] [INFO ] [REMOTE    ] NPK: Fetching primary data for 2025-09.
[2025-10-24T20:14:46.142570] [INFO ] [REMOTE    ] NPO: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T20:14:46.146781] [INFO ] [REMOTE    ] NPO: Full fetch complete (18953 records).
[2025-10-24T20:14:46.146893] [DEBUG] [VALIDATOR ] NPO: Validating primary data.
[2025-10-24T20:14:46.452389] [INFO ] [REMOTE    ] NPK: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T20:14:46.537146] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present.
[2025-10-24T20:14:46.537439] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed.
[2025-10-24T20:14:46.537889] [INFO ] [MAIN      ] NPO: Fetched primary data is valid.
[2025-10-24T20:14:46.537965] [DEBUG] [LOCAL     ] NPO: Saving primary data.
[2025-10-24T20:14:46.555882] [INFO ] [REMOTE    ] NPKI: Fetching primary data for 2025-08.
[2025-10-24T20:14:46.556134] [FATAL] [LOCAL     ] NPO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:14:46.559395] [FATAL] [MAIN      ] NPO: Failed to save primary data.
[2025-10-24T20:14:46.560809] [WARN ] [MAIN      ] NPO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:14:46.560757] [INFO ] [REMOTE    ] NOW: Incremental fetch complete for 2025-10 (2.41 seconds).
[2025-10-24T20:14:46.560949] [INFO ] [LOCAL     ] NPO: Starting deletion of primary data.
[2025-10-24T20:14:46.569155] [DEBUG] [LOCAL     ] NPO: No primary data file found to delete.
[2025-10-24T20:14:46.569322] [INFO ] [LOCAL     ] NPO: Starting deletion of derivative data.
[2025-10-24T20:14:46.569668] [DEBUG] [LOCAL     ] NPO: Deleted derivative data file.
[2025-10-24T20:14:46.570316] [INFO ] [MAIN      ] Update Progress: 1516/2366 symbols completed. NPO took 19.8s. Estimated remaining: 1h 49m 11s. Rate: 7.8 symbols/min
[2025-10-24T20:14:46.569604] [INFO ] [REMOTE    ] NOW: Full fetch complete (70672 records).
[2025-10-24T20:14:46.581684] [DEBUG] [VALIDATOR ] NOW: Validating primary data.
[2025-10-24T20:14:46.905522] [INFO ] [MAIN      ] NPV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:14:47.030015] [DEBUG] [LOCAL     ] NPV: Loaded 5400 existing records from primary storage.
[2025-10-24T20:14:47.049600] [INFO ] [MAIN      ] NPV: Loaded 5400 existing records.
[2025-10-24T20:14:47.297749] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present.
[2025-10-24T20:14:47.306534] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed.
[2025-10-24T20:14:47.309256] [INFO ] [MAIN      ] NOW: Fetched primary data is valid.
[2025-10-24T20:14:47.309342] [DEBUG] [LOCAL     ] NOW: Saving primary data.
[2025-10-24T20:14:47.329387] [WARN ] [MAIN      ] NPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:14:47.329538] [FATAL] [LOCAL     ] NOW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:14:47.329840] [INFO ] [MAIN      ] NPV: Wiping existing primary data before full refresh.
[2025-10-24T20:14:47.329713] [FATAL] [MAIN      ] NOW: Failed to save primary data.
[2025-10-24T20:14:47.329938] [WARN ] [MAIN      ] NOW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:14:47.330002] [INFO ] [LOCAL     ] NPV: Starting deletion of primary data.
[2025-10-24T20:14:47.330109] [INFO ] [LOCAL     ] NOW: Starting deletion of primary data.
[2025-10-24T20:14:47.330244] [DEBUG] [LOCAL     ] NOW: No primary data file found to delete.
[2025-10-24T20:14:47.330291] [INFO ] [LOCAL     ] NOW: Starting deletion of derivative data.
[2025-10-24T20:14:47.330380] [DEBUG] [LOCAL     ] NOW: Deleted derivative data file.
[2025-10-24T20:14:47.330396] [DEBUG] [LOCAL     ] NPV: Deleted primary data file.
[2025-10-24T20:14:47.330780] [INFO ] [MAIN      ] Update Progress: 1517/2366 symbols completed. NOW took 59.8s. Estimated remaining: 1h 48m 59s. Rate: 7.8 symbols/min
[2025-10-24T20:14:47.330568] [INFO ] [MAIN      ] NPV: Starting full primary refresh.
[2025-10-24T20:14:47.352841] [INFO ] [REMOTE    ] NPK: Fetching primary data for 2025-10.
[2025-10-24T20:14:47.716198] [INFO ] [REMOTE    ] NPV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:14:47.740716] [INFO ] [REMOTE    ] NPKI: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T20:14:48.147713] [INFO ] [REMOTE    ] NPV: Fetching primary data for 2025-01.
[2025-10-24T20:14:48.703338] [INFO ] [REMOTE    ] NPK: Incremental fetch complete for 2025-10 (1.35 seconds).
[2025-10-24T20:14:48.705594] [INFO ] [REMOTE    ] NPK: Full fetch complete (11098 records).
[2025-10-24T20:14:48.705736] [DEBUG] [VALIDATOR ] NPK: Validating primary data.
[2025-10-24T20:14:48.820903] [INFO ] [REMOTE    ] NPV: Incremental fetch complete for 2025-01 (0.67 seconds).
[2025-10-24T20:14:48.952821] [INFO ] [REMOTE    ] NPV: Fetching primary data for 2025-02.
[2025-10-24T20:14:49.099721] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present.
[2025-10-24T20:14:49.099803] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed.
[2025-10-24T20:14:49.100086] [INFO ] [MAIN      ] NPK: Fetched primary data is valid.
[2025-10-24T20:14:49.100154] [DEBUG] [LOCAL     ] NPK: Saving primary data.
[2025-10-24T20:14:49.100470] [FATAL] [LOCAL     ] NPK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:14:49.100580] [FATAL] [MAIN      ] NPK: Failed to save primary data.
[2025-10-24T20:14:49.100637] [WARN ] [MAIN      ] NPK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:14:49.100743] [INFO ] [LOCAL     ] NPK: Starting deletion of primary data.
[2025-10-24T20:14:49.100821] [DEBUG] [LOCAL     ] NPK: No primary data file found to delete.
[2025-10-24T20:14:49.100866] [INFO ] [LOCAL     ] NPK: Starting deletion of derivative data.
[2025-10-24T20:14:49.101075] [DEBUG] [LOCAL     ] NPK: Deleted derivative data file.
[2025-10-24T20:14:49.101187] [INFO ] [MAIN      ] Update Progress: 1518/2366 symbols completed. NPK took 36.0s. Estimated remaining: 1h 48m 48s. Rate: 7.8 symbols/min
[2025-10-24T20:14:49.432550] [INFO ] [REMOTE    ] NPV: Incremental fetch complete for 2025-02 (0.48 seconds).
[2025-10-24T20:14:49.747718] [INFO ] [REMOTE    ] NPKI: Fetching primary data for 2025-09.
[2025-10-24T20:14:50.547622] [INFO ] [REMOTE    ] NPV: Fetching primary data for 2025-03.
[2025-10-24T20:14:50.985893] [INFO ] [REMOTE    ] NPKI: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T20:14:51.282125] [INFO ] [REMOTE    ] NPV: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T20:14:51.347726] [INFO ] [REMOTE    ] NPV: Fetching primary data for 2025-04.
[2025-10-24T20:14:51.978941] [INFO ] [REMOTE    ] NPV: Incremental fetch complete for 2025-04 (0.63 seconds).
[2025-10-24T20:14:52.147780] [INFO ] [REMOTE    ] NPKI: Fetching primary data for 2025-10.
[2025-10-24T20:14:52.947754] [INFO ] [REMOTE    ] NPV: Fetching primary data for 2025-05.
[2025-10-24T20:14:53.547447] [INFO ] [REMOTE    ] NPV: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T20:14:53.727387] [INFO ] [REMOTE    ] NPKI: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T20:14:53.735152] [INFO ] [REMOTE    ] NPKI: Full fetch complete (56346 records).
[2025-10-24T20:14:53.735261] [DEBUG] [VALIDATOR ] NPKI: Validating primary data.
[2025-10-24T20:14:53.767331] [INFO ] [REMOTE    ] NPV: Fetching primary data for 2025-06.
[2025-10-24T20:14:54.120293] [DEBUG] [VALIDATOR ] NPKI: All expected trading days are present.
[2025-10-24T20:14:54.120371] [DEBUG] [VALIDATOR ] NPKI: Primary data validation passed.
[2025-10-24T20:14:54.121335] [INFO ] [MAIN      ] NPKI: Fetched primary data is valid.
[2025-10-24T20:14:54.121396] [DEBUG] [LOCAL     ] NPKI: Saving primary data.
[2025-10-24T20:14:54.121900] [FATAL] [LOCAL     ] NPKI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:14:54.122000] [FATAL] [MAIN      ] NPKI: Failed to save primary data.
[2025-10-24T20:14:54.122072] [WARN ] [MAIN      ] NPKI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:14:54.122181] [INFO ] [LOCAL     ] NPKI: Starting deletion of primary data.
[2025-10-24T20:14:54.122253] [DEBUG] [LOCAL     ] NPKI: No primary data file found to delete.
[2025-10-24T20:14:54.122290] [INFO ] [LOCAL     ] NPKI: Starting deletion of derivative data.
[2025-10-24T20:14:54.122456] [DEBUG] [LOCAL     ] NPKI: Deleted derivative data file.
[2025-10-24T20:14:54.122563] [INFO ] [MAIN      ] Update Progress: 1519/2366 symbols completed. NPKI took 34.2s. Estimated remaining: 1h 48m 39s. Rate: 7.8 symbols/min
[2025-10-24T20:14:54.416773] [INFO ] [REMOTE    ] NPV: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T20:14:54.547696] [INFO ] [REMOTE    ] NPV: Fetching primary data for 2025-07.
[2025-10-24T20:14:55.165324] [INFO ] [REMOTE    ] NPV: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T20:14:55.347725] [INFO ] [REMOTE    ] NPV: Fetching primary data for 2025-08.
[2025-10-24T20:14:56.014610] [INFO ] [REMOTE    ] NPV: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T20:14:56.147744] [INFO ] [REMOTE    ] NPV: Fetching primary data for 2025-09.
[2025-10-24T20:14:56.883771] [INFO ] [REMOTE    ] NPV: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T20:14:56.947701] [INFO ] [REMOTE    ] NPV: Fetching primary data for 2025-10.
[2025-10-24T20:14:57.643687] [INFO ] [REMOTE    ] NPV: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T20:14:57.645353] [INFO ] [REMOTE    ] NPV: Full fetch complete (7163 records).
[2025-10-24T20:14:57.645435] [DEBUG] [VALIDATOR ] NPV: Validating primary data.
[2025-10-24T20:14:58.030997] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present.
[2025-10-24T20:14:58.031078] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed.
[2025-10-24T20:14:58.031254] [INFO ] [MAIN      ] NPV: Fetched primary data is valid.
[2025-10-24T20:14:58.031292] [DEBUG] [LOCAL     ] NPV: Saving primary data.
[2025-10-24T20:14:58.031491] [FATAL] [LOCAL     ] NPV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:14:58.031571] [FATAL] [MAIN      ] NPV: Failed to save primary data.
[2025-10-24T20:14:58.031611] [WARN ] [MAIN      ] NPV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:14:58.031670] [INFO ] [LOCAL     ] NPV: Starting deletion of primary data.
[2025-10-24T20:14:58.031740] [DEBUG] [LOCAL     ] NPV: No primary data file found to delete.
[2025-10-24T20:14:58.031775] [INFO ] [LOCAL     ] NPV: Starting deletion of derivative data.
[2025-10-24T20:14:58.031884] [DEBUG] [LOCAL     ] NPV: Deleted derivative data file.
[2025-10-24T20:14:58.031959] [INFO ] [MAIN      ] Update Progress: 1520/2366 symbols completed. NPV took 11.5s. Estimated remaining: 1h 48m 29s. Rate: 7.8 symbols/min
[2025-10-24T20:14:58.656635] [INFO ] [MAIN      ] NPWR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:14:58.754995] [INFO ] [MAIN      ] NRDY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:14:58.751190] [INFO ] [MAIN      ] NQP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:14:58.768144] [INFO ] [MAIN      ] NREF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:14:58.784596] [DEBUG] [LOCAL     ] NREF: Loaded 7848 existing records from primary storage.
[2025-10-24T20:14:58.784960] [INFO ] [MAIN      ] NREF: Loaded 7848 existing records.
[2025-10-24T20:14:58.863528] [DEBUG] [LOCAL     ] NQP: Loaded 9104 existing records from primary storage.
[2025-10-24T20:14:58.872786] [INFO ] [MAIN      ] NQP: Loaded 9104 existing records.
[2025-10-24T20:14:58.976971] [DEBUG] [LOCAL     ] NRDY: Loaded 32344 existing records from primary storage.
[2025-10-24T20:14:58.992872] [INFO ] [MAIN      ] NRDY: Loaded 32344 existing records.
[2025-10-24T20:14:59.029181] [DEBUG] [LOCAL     ] NPWR: Loaded 43826 existing records from primary storage.
[2025-10-24T20:14:59.151068] [INFO ] [MAIN      ] NPWR: Loaded 43826 existing records.
[2025-10-24T20:14:59.200598] [WARN ] [MAIN      ] NREF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:14:59.232429] [INFO ] [MAIN      ] NREF: Wiping existing primary data before full refresh.
[2025-10-24T20:14:59.272737] [INFO ] [LOCAL     ] NREF: Starting deletion of primary data.
[2025-10-24T20:14:59.394610] [DEBUG] [LOCAL     ] NREF: Deleted primary data file.
[2025-10-24T20:14:59.435804] [INFO ] [MAIN      ] NREF: Starting full primary refresh.
[2025-10-24T20:14:59.455724] [WARN ] [MAIN      ] NQP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:14:59.494780] [INFO ] [MAIN      ] NQP: Wiping existing primary data before full refresh.
[2025-10-24T20:14:59.585405] [INFO ] [LOCAL     ] NQP: Starting deletion of primary data.
[2025-10-24T20:14:59.644269] [DEBUG] [LOCAL     ] NQP: Deleted primary data file.
[2025-10-24T20:14:59.669101] [INFO ] [MAIN      ] NQP: Starting full primary refresh.
[2025-10-24T20:14:59.677774] [WARN ] [MAIN      ] NRDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:14:59.705746] [WARN ] [MAIN      ] NPWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:14:59.726202] [INFO ] [MAIN      ] NPWR: Wiping existing primary data before full refresh.
[2025-10-24T20:14:59.735742] [INFO ] [LOCAL     ] NPWR: Starting deletion of primary data.
[2025-10-24T20:14:59.726061] [INFO ] [MAIN      ] NRDY: Wiping existing primary data before full refresh.
[2025-10-24T20:14:59.756791] [DEBUG] [LOCAL     ] NPWR: Deleted primary data file.
[2025-10-24T20:14:59.756925] [INFO ] [LOCAL     ] NRDY: Starting deletion of primary data.
[2025-10-24T20:14:59.767335] [INFO ] [MAIN      ] NPWR: Starting full primary refresh.
[2025-10-24T20:14:59.878556] [DEBUG] [LOCAL     ] NRDY: Deleted primary data file.
[2025-10-24T20:14:59.902575] [INFO ] [MAIN      ] NRDY: Starting full primary refresh.
[2025-10-24T20:15:00.641472] [INFO ] [REMOTE    ] NREF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:15:00.662464] [INFO ] [REMOTE    ] NREF: Fetching primary data for 2025-01.
[2025-10-24T20:15:00.940990] [INFO ] [REMOTE    ] NQP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:15:00.986426] [INFO ] [REMOTE    ] NQP: Fetching primary data for 2025-01.
[2025-10-24T20:15:01.091016] [INFO ] [REMOTE    ] NPWR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:15:01.096619] [INFO ] [REMOTE    ] NPWR: Fetching primary data for 2025-01.
[2025-10-24T20:15:01.164225] [INFO ] [REMOTE    ] NRDY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:15:01.164555] [INFO ] [REMOTE    ] NRDY: Fetching primary data for 2025-01.
[2025-10-24T20:15:01.633296] [INFO ] [REMOTE    ] NREF: Incremental fetch complete for 2025-01 (0.97 seconds).
[2025-10-24T20:15:01.635236] [INFO ] [REMOTE    ] NREF: Fetching primary data for 2025-02.
[2025-10-24T20:15:02.172806] [INFO ] [REMOTE    ] NQP: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T20:15:02.174915] [INFO ] [REMOTE    ] NQP: Fetching primary data for 2025-02.
[2025-10-24T20:15:02.275909] [INFO ] [REMOTE    ] NREF: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T20:15:02.547743] [INFO ] [REMOTE    ] NREF: Fetching primary data for 2025-03.
[2025-10-24T20:15:02.683942] [INFO ] [REMOTE    ] NPWR: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T20:15:02.770423] [INFO ] [REMOTE    ] NRDY: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T20:15:02.897347] [INFO ] [REMOTE    ] NQP: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:15:03.347766] [INFO ] [REMOTE    ] NRDY: Fetching primary data for 2025-02.
[2025-10-24T20:15:03.392996] [INFO ] [REMOTE    ] NREF: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T20:15:04.147752] [INFO ] [REMOTE    ] NPWR: Fetching primary data for 2025-02.
[2025-10-24T20:15:04.839368] [INFO ] [REMOTE    ] NRDY: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T20:15:04.947669] [INFO ] [REMOTE    ] NRDY: Fetching primary data for 2025-03.
[2025-10-24T20:15:05.455877] [INFO ] [REMOTE    ] NPWR: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T20:15:05.747741] [INFO ] [REMOTE    ] NQP: Fetching primary data for 2025-03.
[2025-10-24T20:15:06.031058] [INFO ] [REMOTE    ] NRDY: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T20:15:06.511836] [INFO ] [REMOTE    ] NQP: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T20:15:06.547664] [INFO ] [REMOTE    ] NQP: Fetching primary data for 2025-04.
[2025-10-24T20:15:07.323607] [INFO ] [REMOTE    ] NQP: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:15:07.347625] [INFO ] [REMOTE    ] NREF: Fetching primary data for 2025-04.
[2025-10-24T20:15:08.064538] [INFO ] [REMOTE    ] NREF: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T20:15:08.147720] [INFO ] [REMOTE    ] NRDY: Fetching primary data for 2025-04.
[2025-10-24T20:15:08.947699] [INFO ] [REMOTE    ] NQP: Fetching primary data for 2025-05.
[2025-10-24T20:15:09.731399] [INFO ] [REMOTE    ] NQP: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T20:15:09.747595] [INFO ] [REMOTE    ] NQP: Fetching primary data for 2025-06.
[2025-10-24T20:15:09.906846] [INFO ] [REMOTE    ] NRDY: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T20:15:10.209661] [INFO ] [REMOTE    ] NQP: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T20:15:10.547680] [INFO ] [REMOTE    ] NPWR: Fetching primary data for 2025-03.
[2025-10-24T20:15:11.347636] [INFO ] [REMOTE    ] NQP: Fetching primary data for 2025-07.
[2025-10-24T20:15:12.094637] [INFO ] [REMOTE    ] NPWR: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T20:15:12.115593] [INFO ] [REMOTE    ] NQP: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T20:15:12.147595] [INFO ] [REMOTE    ] NPWR: Fetching primary data for 2025-04.
[2025-10-24T20:15:12.947737] [INFO ] [REMOTE    ] NQP: Fetching primary data for 2025-08.
[2025-10-24T20:15:13.660349] [INFO ] [REMOTE    ] NQP: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T20:15:13.688317] [INFO ] [REMOTE    ] NPWR: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T20:15:13.747612] [INFO ] [REMOTE    ] NRDY: Fetching primary data for 2025-05.
[2025-10-24T20:15:14.547635] [INFO ] [REMOTE    ] NPWR: Fetching primary data for 2025-05.
[2025-10-24T20:15:15.202051] [INFO ] [REMOTE    ] NRDY: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T20:15:15.347621] [INFO ] [REMOTE    ] NRDY: Fetching primary data for 2025-06.
[2025-10-24T20:15:16.120919] [INFO ] [REMOTE    ] NPWR: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T20:15:16.147618] [INFO ] [REMOTE    ] NPWR: Fetching primary data for 2025-06.
[2025-10-24T20:15:16.656905] [INFO ] [REMOTE    ] NRDY: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T20:15:16.947658] [INFO ] [REMOTE    ] NREF: Fetching primary data for 2025-05.
[2025-10-24T20:15:17.315772] [INFO ] [REMOTE    ] NPWR: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T20:15:17.561341] [INFO ] [REMOTE    ] NREF: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T20:15:17.747619] [INFO ] [REMOTE    ] NREF: Fetching primary data for 2025-06.
[2025-10-24T20:15:18.501055] [INFO ] [REMOTE    ] NREF: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T20:15:18.547700] [INFO ] [REMOTE    ] NREF: Fetching primary data for 2025-07.
[2025-10-24T20:15:19.347687] [INFO ] [REMOTE    ] NPWR: Fetching primary data for 2025-07.
[2025-10-24T20:15:19.399307] [INFO ] [REMOTE    ] NREF: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T20:15:20.147721] [INFO ] [REMOTE    ] NQP: Fetching primary data for 2025-09.
[2025-10-24T20:15:20.902687] [INFO ] [REMOTE    ] NQP: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T20:15:20.955553] [INFO ] [REMOTE    ] NQP: Fetching primary data for 2025-10.
[2025-10-24T20:15:20.959344] [INFO ] [REMOTE    ] NPWR: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T20:15:21.750740] [INFO ] [REMOTE    ] NPWR: Fetching primary data for 2025-08.
[2025-10-24T20:15:21.752631] [INFO ] [REMOTE    ] NQP: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T20:15:21.755041] [INFO ] [REMOTE    ] NQP: Full fetch complete (12658 records).
[2025-10-24T20:15:21.755125] [DEBUG] [VALIDATOR ] NQP: Validating primary data.
[2025-10-24T20:15:22.126210] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present.
[2025-10-24T20:15:22.126286] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed.
[2025-10-24T20:15:22.126570] [INFO ] [MAIN      ] NQP: Fetched primary data is valid.
[2025-10-24T20:15:22.126609] [DEBUG] [LOCAL     ] NQP: Saving primary data.
[2025-10-24T20:15:22.126849] [FATAL] [LOCAL     ] NQP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:15:22.126931] [FATAL] [MAIN      ] NQP: Failed to save primary data.
[2025-10-24T20:15:22.126972] [WARN ] [MAIN      ] NQP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:15:22.127006] [INFO ] [LOCAL     ] NQP: Starting deletion of primary data.
[2025-10-24T20:15:22.127055] [DEBUG] [LOCAL     ] NQP: No primary data file found to delete.
[2025-10-24T20:15:22.127088] [INFO ] [LOCAL     ] NQP: Starting deletion of derivative data.
[2025-10-24T20:15:22.127201] [DEBUG] [LOCAL     ] NQP: Deleted derivative data file.
[2025-10-24T20:15:22.127289] [INFO ] [MAIN      ] Update Progress: 1521/2366 symbols completed. NQP took 24.1s. Estimated remaining: 1h 48m 31s. Rate: 7.8 symbols/min
[2025-10-24T20:15:22.303566] [INFO ] [MAIN      ] NRG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:15:22.359404] [DEBUG] [LOCAL     ] NRG: Loaded 53197 existing records from primary storage.
[2025-10-24T20:15:22.359791] [INFO ] [MAIN      ] NRG: Loaded 53197 existing records.
[2025-10-24T20:15:22.542114] [WARN ] [MAIN      ] NRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:15:22.542326] [INFO ] [MAIN      ] NRG: Wiping existing primary data before full refresh.
[2025-10-24T20:15:22.542373] [INFO ] [LOCAL     ] NRG: Starting deletion of primary data.
[2025-10-24T20:15:22.542708] [DEBUG] [LOCAL     ] NRG: Deleted primary data file.
[2025-10-24T20:15:22.542766] [INFO ] [MAIN      ] NRG: Starting full primary refresh.
[2025-10-24T20:15:22.554105] [INFO ] [REMOTE    ] NRDY: Fetching primary data for 2025-07.
[2025-10-24T20:15:22.898800] [INFO ] [REMOTE    ] NRG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:15:23.347746] [INFO ] [REMOTE    ] NRG: Fetching primary data for 2025-01.
[2025-10-24T20:15:23.411610] [INFO ] [REMOTE    ] NPWR: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T20:15:23.901897] [INFO ] [REMOTE    ] NRDY: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T20:15:24.147722] [INFO ] [REMOTE    ] NPWR: Fetching primary data for 2025-09.
[2025-10-24T20:15:24.947680] [INFO ] [REMOTE    ] NREF: Fetching primary data for 2025-08.
[2025-10-24T20:15:25.057779] [INFO ] [REMOTE    ] NRG: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T20:15:25.558210] [INFO ] [REMOTE    ] NPWR: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T20:15:25.632010] [INFO ] [REMOTE    ] NREF: Incremental fetch complete for 2025-08 (0.68 seconds).
[2025-10-24T20:15:25.747663] [INFO ] [REMOTE    ] NPWR: Fetching primary data for 2025-10.
[2025-10-24T20:15:26.547726] [INFO ] [REMOTE    ] NRDY: Fetching primary data for 2025-08.
[2025-10-24T20:15:27.347611] [INFO ] [REMOTE    ] NREF: Fetching primary data for 2025-09.
[2025-10-24T20:15:27.486180] [INFO ] [REMOTE    ] NPWR: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T20:15:27.495169] [INFO ] [REMOTE    ] NPWR: Full fetch complete (60907 records).
[2025-10-24T20:15:27.495274] [DEBUG] [VALIDATOR ] NPWR: Validating primary data.
[2025-10-24T20:15:27.903794] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present.
[2025-10-24T20:15:27.903987] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed.
[2025-10-24T20:15:27.906114] [INFO ] [MAIN      ] NPWR: Fetched primary data is valid.
[2025-10-24T20:15:27.926340] [DEBUG] [LOCAL     ] NPWR: Saving primary data.
[2025-10-24T20:15:27.929045] [INFO ] [REMOTE    ] NRDY: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T20:15:27.927800] [FATAL] [LOCAL     ] NPWR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:15:27.935915] [FATAL] [MAIN      ] NPWR: Failed to save primary data.
[2025-10-24T20:15:27.936401] [WARN ] [MAIN      ] NPWR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:15:27.936480] [INFO ] [LOCAL     ] NPWR: Starting deletion of primary data.
[2025-10-24T20:15:27.936554] [DEBUG] [LOCAL     ] NPWR: No primary data file found to delete.
[2025-10-24T20:15:27.936595] [INFO ] [LOCAL     ] NPWR: Starting deletion of derivative data.
[2025-10-24T20:15:27.936774] [DEBUG] [LOCAL     ] NPWR: Deleted derivative data file.
[2025-10-24T20:15:27.937200] [INFO ] [MAIN      ] Update Progress: 1522/2366 symbols completed. NPWR took 29.9s. Estimated remaining: 1h 48m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:15:28.099935] [INFO ] [REMOTE    ] NREF: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T20:15:28.156360] [INFO ] [REMOTE    ] NRG: Fetching primary data for 2025-02.
[2025-10-24T20:15:28.207108] [INFO ] [MAIN      ] NRGV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:15:28.262705] [DEBUG] [LOCAL     ] NRGV: Loaded 44291 existing records from primary storage.
[2025-10-24T20:15:28.263153] [INFO ] [MAIN      ] NRGV: Loaded 44291 existing records.
[2025-10-24T20:15:28.550332] [WARN ] [MAIN      ] NRGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:15:28.550691] [INFO ] [MAIN      ] NRGV: Wiping existing primary data before full refresh.
[2025-10-24T20:15:28.550762] [INFO ] [LOCAL     ] NRGV: Starting deletion of primary data.
[2025-10-24T20:15:28.551047] [DEBUG] [LOCAL     ] NRGV: Deleted primary data file.
[2025-10-24T20:15:28.551118] [INFO ] [MAIN      ] NRGV: Starting full primary refresh.
[2025-10-24T20:15:28.954377] [INFO ] [REMOTE    ] NRDY: Fetching primary data for 2025-09.
[2025-10-24T20:15:28.960617] [INFO ] [REMOTE    ] NRGV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:15:29.747741] [INFO ] [REMOTE    ] NRGV: Fetching primary data for 2025-01.
[2025-10-24T20:15:29.997706] [INFO ] [REMOTE    ] NRG: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T20:15:30.273550] [INFO ] [REMOTE    ] NRDY: Incremental fetch complete for 2025-09 (1.32 seconds).
[2025-10-24T20:15:30.547635] [INFO ] [REMOTE    ] NRG: Fetching primary data for 2025-03.
[2025-10-24T20:15:30.864521] [INFO ] [REMOTE    ] NRGV: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T20:15:31.347682] [INFO ] [REMOTE    ] NRGV: Fetching primary data for 2025-02.
[2025-10-24T20:15:32.147707] [INFO ] [REMOTE    ] NRDY: Fetching primary data for 2025-10.
[2025-10-24T20:15:32.183710] [INFO ] [REMOTE    ] NRG: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T20:15:32.814935] [INFO ] [REMOTE    ] NRGV: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T20:15:32.947634] [INFO ] [REMOTE    ] NRG: Fetching primary data for 2025-04.
[2025-10-24T20:15:33.514480] [INFO ] [REMOTE    ] NRDY: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T20:15:33.520285] [INFO ] [REMOTE    ] NRDY: Full fetch complete (49681 records).
[2025-10-24T20:15:33.520367] [DEBUG] [VALIDATOR ] NRDY: Validating primary data.
[2025-10-24T20:15:33.755737] [INFO ] [REMOTE    ] NREF: Fetching primary data for 2025-10.
[2025-10-24T20:15:33.918852] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present.
[2025-10-24T20:15:33.918929] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed.
[2025-10-24T20:15:33.919921] [INFO ] [MAIN      ] NRDY: Fetched primary data is valid.
[2025-10-24T20:15:33.919984] [DEBUG] [LOCAL     ] NRDY: Saving primary data.
[2025-10-24T20:15:33.920412] [FATAL] [LOCAL     ] NRDY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:15:33.920501] [FATAL] [MAIN      ] NRDY: Failed to save primary data.
[2025-10-24T20:15:33.920545] [WARN ] [MAIN      ] NRDY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:15:33.920606] [INFO ] [LOCAL     ] NRDY: Starting deletion of primary data.
[2025-10-24T20:15:33.920695] [DEBUG] [LOCAL     ] NRDY: No primary data file found to delete.
[2025-10-24T20:15:33.920750] [INFO ] [LOCAL     ] NRDY: Starting deletion of derivative data.
[2025-10-24T20:15:33.920882] [DEBUG] [LOCAL     ] NRDY: Deleted derivative data file.
[2025-10-24T20:15:33.920962] [INFO ] [MAIN      ] Update Progress: 1523/2366 symbols completed. NRDY took 35.9s. Estimated remaining: 1h 48m 13s. Rate: 7.8 symbols/min
[2025-10-24T20:15:34.094565] [INFO ] [MAIN      ] NRK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:15:34.116055] [DEBUG] [LOCAL     ] NRK: Loaded 20613 existing records from primary storage.
[2025-10-24T20:15:34.116304] [INFO ] [MAIN      ] NRK: Loaded 20613 existing records.
[2025-10-24T20:15:34.302695] [WARN ] [MAIN      ] NRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:15:34.302925] [INFO ] [MAIN      ] NRK: Wiping existing primary data before full refresh.
[2025-10-24T20:15:34.302981] [INFO ] [LOCAL     ] NRK: Starting deletion of primary data.
[2025-10-24T20:15:34.303226] [DEBUG] [LOCAL     ] NRK: Deleted primary data file.
[2025-10-24T20:15:34.303265] [INFO ] [MAIN      ] NRK: Starting full primary refresh.
[2025-10-24T20:15:34.550272] [INFO ] [REMOTE    ] NRGV: Fetching primary data for 2025-03.
[2025-10-24T20:15:34.663931] [INFO ] [REMOTE    ] NRK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:15:34.670746] [INFO ] [REMOTE    ] NREF: Incremental fetch complete for 2025-10 (0.92 seconds).
[2025-10-24T20:15:34.672697] [INFO ] [REMOTE    ] NREF: Full fetch complete (10873 records).
[2025-10-24T20:15:34.672772] [DEBUG] [VALIDATOR ] NREF: Validating primary data.
[2025-10-24T20:15:35.051175] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present.
[2025-10-24T20:15:35.051269] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed.
[2025-10-24T20:15:35.051620] [INFO ] [MAIN      ] NREF: Fetched primary data is valid.
[2025-10-24T20:15:35.051724] [DEBUG] [LOCAL     ] NREF: Saving primary data.
[2025-10-24T20:15:35.052022] [FATAL] [LOCAL     ] NREF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:15:35.052144] [FATAL] [MAIN      ] NREF: Failed to save primary data.
[2025-10-24T20:15:35.052264] [WARN ] [MAIN      ] NREF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:15:35.052410] [INFO ] [LOCAL     ] NREF: Starting deletion of primary data.
[2025-10-24T20:15:35.052570] [DEBUG] [LOCAL     ] NREF: No primary data file found to delete.
[2025-10-24T20:15:35.052616] [INFO ] [LOCAL     ] NREF: Starting deletion of derivative data.
[2025-10-24T20:15:35.080058] [DEBUG] [LOCAL     ] NREF: Deleted derivative data file.
[2025-10-24T20:15:35.080245] [INFO ] [MAIN      ] Update Progress: 1524/2366 symbols completed. NREF took 37.0s. Estimated remaining: 1h 48m 2s. Rate: 7.8 symbols/min
[2025-10-24T20:15:35.104797] [INFO ] [REMOTE    ] NRG: Incremental fetch complete for 2025-04 (2.16 seconds).
[2025-10-24T20:15:35.271095] [INFO ] [MAIN      ] NRP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:15:35.278398] [DEBUG] [LOCAL     ] NRP: Loaded 4185 existing records from primary storage.
[2025-10-24T20:15:35.278602] [INFO ] [MAIN      ] NRP: Loaded 4185 existing records.
[2025-10-24T20:15:35.352717] [INFO ] [REMOTE    ] NRG: Fetching primary data for 2025-05.
[2025-10-24T20:15:35.460341] [WARN ] [MAIN      ] NRP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:15:35.460560] [INFO ] [MAIN      ] NRP: Wiping existing primary data before full refresh.
[2025-10-24T20:15:35.460631] [INFO ] [LOCAL     ] NRP: Starting deletion of primary data.
[2025-10-24T20:15:35.460868] [DEBUG] [LOCAL     ] NRP: Deleted primary data file.
[2025-10-24T20:15:35.460926] [INFO ] [MAIN      ] NRP: Starting full primary refresh.
[2025-10-24T20:15:35.826855] [INFO ] [REMOTE    ] NRP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:15:36.152910] [INFO ] [REMOTE    ] NRK: Fetching primary data for 2025-01.
[2025-10-24T20:15:36.164369] [INFO ] [REMOTE    ] NRGV: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T20:15:36.814032] [INFO ] [REMOTE    ] NRG: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T20:15:36.837737] [INFO ] [REMOTE    ] NRK: Incremental fetch complete for 2025-01 (0.68 seconds).
[2025-10-24T20:15:36.947688] [INFO ] [REMOTE    ] NRK: Fetching primary data for 2025-02.
[2025-10-24T20:15:37.747684] [INFO ] [REMOTE    ] NRGV: Fetching primary data for 2025-04.
[2025-10-24T20:15:37.852981] [INFO ] [REMOTE    ] NRK: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T20:15:38.547742] [INFO ] [REMOTE    ] NRP: Fetching primary data for 2025-01.
[2025-10-24T20:15:39.162494] [INFO ] [REMOTE    ] NRP: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T20:15:39.347636] [INFO ] [REMOTE    ] NRP: Fetching primary data for 2025-02.
[2025-10-24T20:15:39.912567] [INFO ] [REMOTE    ] NRP: Incremental fetch complete for 2025-02 (0.56 seconds).
[2025-10-24T20:15:40.147674] [INFO ] [REMOTE    ] NRG: Fetching primary data for 2025-06.
[2025-10-24T20:15:40.217200] [INFO ] [REMOTE    ] NRGV: Incremental fetch complete for 2025-04 (2.47 seconds).
[2025-10-24T20:15:40.947730] [INFO ] [REMOTE    ] NRP: Fetching primary data for 2025-03.
[2025-10-24T20:15:41.535556] [INFO ] [REMOTE    ] NRP: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T20:15:41.747726] [INFO ] [REMOTE    ] NRGV: Fetching primary data for 2025-05.
[2025-10-24T20:15:42.547638] [INFO ] [REMOTE    ] NRP: Fetching primary data for 2025-04.
[2025-10-24T20:15:43.073932] [INFO ] [REMOTE    ] NRG: Incremental fetch complete for 2025-06 (2.93 seconds).
[2025-10-24T20:15:43.197608] [INFO ] [REMOTE    ] NRP: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T20:15:43.238414] [INFO ] [REMOTE    ] NRGV: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T20:15:43.347698] [INFO ] [REMOTE    ] NRGV: Fetching primary data for 2025-06.
[2025-10-24T20:15:44.147718] [INFO ] [REMOTE    ] NRK: Fetching primary data for 2025-03.
[2025-10-24T20:15:44.744319] [INFO ] [REMOTE    ] NRGV: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T20:15:44.763059] [INFO ] [REMOTE    ] NRK: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T20:15:44.947722] [INFO ] [REMOTE    ] NRK: Fetching primary data for 2025-04.
[2025-10-24T20:15:45.747636] [INFO ] [REMOTE    ] NRP: Fetching primary data for 2025-05.
[2025-10-24T20:15:45.976002] [INFO ] [REMOTE    ] NRK: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T20:15:46.328127] [INFO ] [REMOTE    ] NRP: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T20:15:46.547735] [INFO ] [REMOTE    ] NRGV: Fetching primary data for 2025-07.
[2025-10-24T20:15:47.347671] [INFO ] [REMOTE    ] NRP: Fetching primary data for 2025-06.
[2025-10-24T20:15:47.917519] [INFO ] [REMOTE    ] NRP: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T20:15:48.016325] [INFO ] [REMOTE    ] NRGV: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T20:15:48.147688] [INFO ] [REMOTE    ] NRG: Fetching primary data for 2025-07.
[2025-10-24T20:15:48.947694] [INFO ] [REMOTE    ] NRP: Fetching primary data for 2025-07.
[2025-10-24T20:15:49.564774] [INFO ] [REMOTE    ] NRP: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T20:15:49.747749] [INFO ] [REMOTE    ] NRK: Fetching primary data for 2025-05.
[2025-10-24T20:15:49.960249] [INFO ] [REMOTE    ] NRG: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T20:15:50.547712] [INFO ] [REMOTE    ] NRGV: Fetching primary data for 2025-08.
[2025-10-24T20:15:50.734267] [INFO ] [REMOTE    ] NRK: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T20:15:51.347724] [INFO ] [REMOTE    ] NRP: Fetching primary data for 2025-08.
[2025-10-24T20:15:51.828824] [INFO ] [REMOTE    ] NRP: Incremental fetch complete for 2025-08 (0.48 seconds).
[2025-10-24T20:15:52.063484] [INFO ] [REMOTE    ] NRGV: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T20:15:52.147673] [INFO ] [REMOTE    ] NRP: Fetching primary data for 2025-09.
[2025-10-24T20:15:52.690988] [INFO ] [REMOTE    ] NRP: Incremental fetch complete for 2025-09 (0.54 seconds).
[2025-10-24T20:15:52.947637] [INFO ] [REMOTE    ] NRP: Fetching primary data for 2025-10.
[2025-10-24T20:15:53.641339] [INFO ] [REMOTE    ] NRP: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T20:15:53.642790] [INFO ] [REMOTE    ] NRP: Full fetch complete (6327 records).
[2025-10-24T20:15:53.642863] [DEBUG] [VALIDATOR ] NRP: Validating primary data.
[2025-10-24T20:15:53.752935] [INFO ] [REMOTE    ] NRGV: Fetching primary data for 2025-09.
[2025-10-24T20:15:54.006607] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present.
[2025-10-24T20:15:54.006710] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed.
[2025-10-24T20:15:54.006890] [INFO ] [MAIN      ] NRP: Fetched primary data is valid.
[2025-10-24T20:15:54.006930] [DEBUG] [LOCAL     ] NRP: Saving primary data.
[2025-10-24T20:15:54.007117] [FATAL] [LOCAL     ] NRP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:15:54.007196] [FATAL] [MAIN      ] NRP: Failed to save primary data.
[2025-10-24T20:15:54.007238] [WARN ] [MAIN      ] NRP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:15:54.007309] [INFO ] [LOCAL     ] NRP: Starting deletion of primary data.
[2025-10-24T20:15:54.007375] [DEBUG] [LOCAL     ] NRP: No primary data file found to delete.
[2025-10-24T20:15:54.007416] [INFO ] [LOCAL     ] NRP: Starting deletion of derivative data.
[2025-10-24T20:15:54.007614] [DEBUG] [LOCAL     ] NRP: Deleted derivative data file.
[2025-10-24T20:15:54.007735] [INFO ] [MAIN      ] Update Progress: 1525/2366 symbols completed. NRP took 18.9s. Estimated remaining: 1h 48m 0s. Rate: 7.8 symbols/min
[2025-10-24T20:15:54.172475] [INFO ] [MAIN      ] NRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:15:54.179911] [DEBUG] [LOCAL     ] NRT: Loaded 4930 existing records from primary storage.
[2025-10-24T20:15:54.180118] [INFO ] [MAIN      ] NRT: Loaded 4930 existing records.
[2025-10-24T20:15:54.357049] [WARN ] [MAIN      ] NRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:15:54.357432] [INFO ] [MAIN      ] NRT: Wiping existing primary data before full refresh.
[2025-10-24T20:15:54.357486] [INFO ] [LOCAL     ] NRT: Starting deletion of primary data.
[2025-10-24T20:15:54.357711] [DEBUG] [LOCAL     ] NRT: Deleted primary data file.
[2025-10-24T20:15:54.357769] [INFO ] [MAIN      ] NRT: Starting full primary refresh.
[2025-10-24T20:15:54.552923] [INFO ] [REMOTE    ] NRK: Fetching primary data for 2025-06.
[2025-10-24T20:15:54.713863] [INFO ] [REMOTE    ] NRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:15:55.347637] [INFO ] [REMOTE    ] NRT: Fetching primary data for 2025-01.
[2025-10-24T20:15:55.482220] [INFO ] [REMOTE    ] NRGV: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T20:15:55.532803] [INFO ] [REMOTE    ] NRK: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T20:15:56.140721] [INFO ] [REMOTE    ] NRT: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T20:15:56.147601] [INFO ] [REMOTE    ] NRT: Fetching primary data for 2025-02.
[2025-10-24T20:15:56.828216] [INFO ] [REMOTE    ] NRT: Incremental fetch complete for 2025-02 (0.68 seconds).
[2025-10-24T20:15:56.947622] [INFO ] [REMOTE    ] NRG: Fetching primary data for 2025-08.
[2025-10-24T20:15:57.747675] [INFO ] [REMOTE    ] NRT: Fetching primary data for 2025-03.
[2025-10-24T20:15:58.542362] [INFO ] [REMOTE    ] NRT: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T20:15:58.547590] [INFO ] [REMOTE    ] NRT: Fetching primary data for 2025-04.
[2025-10-24T20:15:58.689556] [INFO ] [REMOTE    ] NRG: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T20:15:59.137107] [INFO ] [REMOTE    ] NRT: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T20:15:59.347685] [INFO ] [REMOTE    ] NRT: Fetching primary data for 2025-05.
[2025-10-24T20:15:59.947236] [INFO ] [REMOTE    ] NRT: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T20:16:00.147691] [INFO ] [REMOTE    ] NRT: Fetching primary data for 2025-06.
[2025-10-24T20:16:00.946427] [INFO ] [REMOTE    ] NRT: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T20:16:00.947677] [INFO ] [REMOTE    ] NRG: Fetching primary data for 2025-09.
[2025-10-24T20:16:01.747617] [INFO ] [REMOTE    ] NRK: Fetching primary data for 2025-07.
[2025-10-24T20:16:01.998008] [INFO ] [REMOTE    ] NRG: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T20:16:02.547703] [INFO ] [REMOTE    ] NRG: Fetching primary data for 2025-10.
[2025-10-24T20:16:02.899823] [INFO ] [REMOTE    ] NRK: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T20:16:03.347636] [INFO ] [REMOTE    ] NRT: Fetching primary data for 2025-07.
[2025-10-24T20:16:04.065252] [INFO ] [REMOTE    ] NRT: Incremental fetch complete for 2025-07 (0.72 seconds).
[2025-10-24T20:16:04.147637] [INFO ] [REMOTE    ] NRT: Fetching primary data for 2025-08.
[2025-10-24T20:16:04.206045] [INFO ] [REMOTE    ] NRG: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T20:16:04.215859] [INFO ] [REMOTE    ] NRG: Full fetch complete (76788 records).
[2025-10-24T20:16:04.216034] [DEBUG] [VALIDATOR ] NRG: Validating primary data.
[2025-10-24T20:16:04.640115] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present.
[2025-10-24T20:16:04.640192] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed.
[2025-10-24T20:16:04.641283] [INFO ] [MAIN      ] NRG: Fetched primary data is valid.
[2025-10-24T20:16:04.641346] [DEBUG] [LOCAL     ] NRG: Saving primary data.
[2025-10-24T20:16:04.641959] [FATAL] [LOCAL     ] NRG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:16:04.642065] [FATAL] [MAIN      ] NRG: Failed to save primary data.
[2025-10-24T20:16:04.642140] [WARN ] [MAIN      ] NRG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:16:04.642231] [INFO ] [LOCAL     ] NRG: Starting deletion of primary data.
[2025-10-24T20:16:04.642324] [DEBUG] [LOCAL     ] NRG: No primary data file found to delete.
[2025-10-24T20:16:04.642362] [INFO ] [LOCAL     ] NRG: Starting deletion of derivative data.
[2025-10-24T20:16:04.642508] [DEBUG] [LOCAL     ] NRG: Deleted derivative data file.
[2025-10-24T20:16:04.643113] [INFO ] [MAIN      ] Update Progress: 1526/2366 symbols completed. NRG took 42.5s. Estimated remaining: 1h 47m 54s. Rate: 7.8 symbols/min
[2025-10-24T20:16:04.829732] [INFO ] [MAIN      ] NRUC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:16:04.829902] [DEBUG] [LOCAL     ] NRUC: No existing data file found in primary storage.
[2025-10-24T20:16:04.829951] [WARN ] [MAIN      ] NRUC: No existing data found, performing full refresh instead.
[2025-10-24T20:16:04.830061] [INFO ] [MAIN      ] NRUC: Wiping existing primary data before full refresh.
[2025-10-24T20:16:04.830103] [INFO ] [LOCAL     ] NRUC: Starting deletion of primary data.
[2025-10-24T20:16:04.830144] [DEBUG] [LOCAL     ] NRUC: No primary data file found to delete.
[2025-10-24T20:16:04.830177] [INFO ] [MAIN      ] NRUC: Starting full primary refresh.
[2025-10-24T20:16:04.952732] [INFO ] [REMOTE    ] NRK: Fetching primary data for 2025-08.
[2025-10-24T20:16:05.127782] [INFO ] [REMOTE    ] NRT: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T20:16:05.195540] [INFO ] [REMOTE    ] NRUC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:16:05.747694] [INFO ] [REMOTE    ] NRGV: Fetching primary data for 2025-10.
[2025-10-24T20:16:06.009997] [INFO ] [REMOTE    ] NRK: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T20:16:06.547731] [INFO ] [REMOTE    ] NRUC: Fetching primary data for 2025-01.
[2025-10-24T20:16:07.347631] [INFO ] [REMOTE    ] NRT: Fetching primary data for 2025-09.
[2025-10-24T20:16:07.372421] [INFO ] [REMOTE    ] NRUC: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T20:16:07.651632] [INFO ] [REMOTE    ] NRGV: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T20:16:07.661185] [INFO ] [REMOTE    ] NRGV: Full fetch complete (62589 records).
[2025-10-24T20:16:07.661343] [DEBUG] [VALIDATOR ] NRGV: Validating primary data.
[2025-10-24T20:16:08.065451] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present.
[2025-10-24T20:16:08.065544] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed.
[2025-10-24T20:16:08.066672] [INFO ] [MAIN      ] NRGV: Fetched primary data is valid.
[2025-10-24T20:16:08.066740] [DEBUG] [LOCAL     ] NRGV: Saving primary data.
[2025-10-24T20:16:08.067403] [FATAL] [LOCAL     ] NRGV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:16:08.067500] [FATAL] [MAIN      ] NRGV: Failed to save primary data.
[2025-10-24T20:16:08.067543] [WARN ] [MAIN      ] NRGV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:16:08.067579] [INFO ] [LOCAL     ] NRGV: Starting deletion of primary data.
[2025-10-24T20:16:08.067633] [DEBUG] [LOCAL     ] NRGV: No primary data file found to delete.
[2025-10-24T20:16:08.067711] [INFO ] [LOCAL     ] NRGV: Starting deletion of derivative data.
[2025-10-24T20:16:08.067902] [DEBUG] [LOCAL     ] NRGV: Deleted derivative data file.
[2025-10-24T20:16:08.068002] [INFO ] [MAIN      ] Update Progress: 1527/2366 symbols completed. NRGV took 40.1s. Estimated remaining: 1h 47m 44s. Rate: 7.8 symbols/min
[2025-10-24T20:16:08.152834] [INFO ] [REMOTE    ] NRUC: Fetching primary data for 2025-02.
[2025-10-24T20:16:08.232375] [INFO ] [REMOTE    ] NRT: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T20:16:08.257099] [INFO ] [MAIN      ] NSA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:16:08.297452] [DEBUG] [LOCAL     ] NSA: Loaded 45453 existing records from primary storage.
[2025-10-24T20:16:08.297823] [INFO ] [MAIN      ] NSA: Loaded 45453 existing records.
[2025-10-24T20:16:08.498802] [WARN ] [MAIN      ] NSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:16:08.499086] [INFO ] [MAIN      ] NSA: Wiping existing primary data before full refresh.
[2025-10-24T20:16:08.499143] [INFO ] [LOCAL     ] NSA: Starting deletion of primary data.
[2025-10-24T20:16:08.499426] [DEBUG] [LOCAL     ] NSA: Deleted primary data file.
[2025-10-24T20:16:08.499465] [INFO ] [MAIN      ] NSA: Starting full primary refresh.
[2025-10-24T20:16:08.857676] [INFO ] [REMOTE    ] NSA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:16:08.877631] [INFO ] [REMOTE    ] NRUC: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:16:08.947671] [INFO ] [REMOTE    ] NRUC: Fetching primary data for 2025-03.
[2025-10-24T20:16:09.659031] [INFO ] [REMOTE    ] NRUC: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T20:16:09.747664] [INFO ] [REMOTE    ] NRUC: Fetching primary data for 2025-04.
[2025-10-24T20:16:10.526336] [INFO ] [REMOTE    ] NRUC: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:16:10.547613] [INFO ] [REMOTE    ] NRUC: Fetching primary data for 2025-05.
[2025-10-24T20:16:11.180765] [INFO ] [REMOTE    ] NRUC: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T20:16:11.347687] [INFO ] [REMOTE    ] NRK: Fetching primary data for 2025-09.
[2025-10-24T20:16:12.147670] [INFO ] [REMOTE    ] NRUC: Fetching primary data for 2025-06.
[2025-10-24T20:16:12.539859] [INFO ] [REMOTE    ] NRK: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T20:16:12.760350] [INFO ] [REMOTE    ] NRUC: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T20:16:12.947682] [INFO ] [REMOTE    ] NRT: Fetching primary data for 2025-10.
[2025-10-24T20:16:13.694860] [INFO ] [REMOTE    ] NRT: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T20:16:13.696275] [INFO ] [REMOTE    ] NRT: Full fetch complete (7640 records).
[2025-10-24T20:16:13.696341] [DEBUG] [VALIDATOR ] NRT: Validating primary data.
[2025-10-24T20:16:13.757567] [INFO ] [REMOTE    ] NSA: Fetching primary data for 2025-01.
[2025-10-24T20:16:14.080202] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present.
[2025-10-24T20:16:14.080276] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed.
[2025-10-24T20:16:14.080488] [INFO ] [MAIN      ] NRT: Fetched primary data is valid.
[2025-10-24T20:16:14.080528] [DEBUG] [LOCAL     ] NRT: Saving primary data.
[2025-10-24T20:16:14.080820] [FATAL] [LOCAL     ] NRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:16:14.080903] [FATAL] [MAIN      ] NRT: Failed to save primary data.
[2025-10-24T20:16:14.080946] [WARN ] [MAIN      ] NRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:16:14.080981] [INFO ] [LOCAL     ] NRT: Starting deletion of primary data.
[2025-10-24T20:16:14.081031] [DEBUG] [LOCAL     ] NRT: No primary data file found to delete.
[2025-10-24T20:16:14.081083] [INFO ] [LOCAL     ] NRT: Starting deletion of derivative data.
[2025-10-24T20:16:14.081230] [DEBUG] [LOCAL     ] NRT: Deleted derivative data file.
[2025-10-24T20:16:14.081299] [INFO ] [MAIN      ] Update Progress: 1528/2366 symbols completed. NRT took 20.1s. Estimated remaining: 1h 47m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:16:14.252248] [INFO ] [MAIN      ] NSC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:16:14.297727] [DEBUG] [LOCAL     ] NSC: Loaded 49001 existing records from primary storage.
[2025-10-24T20:16:14.298025] [INFO ] [MAIN      ] NSC: Loaded 49001 existing records.
[2025-10-24T20:16:14.478626] [WARN ] [MAIN      ] NSC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:16:14.478874] [INFO ] [MAIN      ] NSC: Wiping existing primary data before full refresh.
[2025-10-24T20:16:14.478944] [INFO ] [LOCAL     ] NSC: Starting deletion of primary data.
[2025-10-24T20:16:14.479292] [DEBUG] [LOCAL     ] NSC: Deleted primary data file.
[2025-10-24T20:16:14.479349] [INFO ] [MAIN      ] NSC: Starting full primary refresh.
[2025-10-24T20:16:14.555487] [INFO ] [REMOTE    ] NRK: Fetching primary data for 2025-10.
[2025-10-24T20:16:14.846223] [INFO ] [REMOTE    ] NSC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:16:15.306529] [INFO ] [REMOTE    ] NSA: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T20:16:15.347616] [INFO ] [REMOTE    ] NSA: Fetching primary data for 2025-02.
[2025-10-24T20:16:15.385198] [INFO ] [REMOTE    ] NRK: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T20:16:15.390191] [INFO ] [REMOTE    ] NRK: Full fetch complete (27695 records).
[2025-10-24T20:16:15.390366] [DEBUG] [VALIDATOR ] NRK: Validating primary data.
[2025-10-24T20:16:15.775078] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present.
[2025-10-24T20:16:15.775164] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed.
[2025-10-24T20:16:15.775878] [INFO ] [MAIN      ] NRK: Fetched primary data is valid.
[2025-10-24T20:16:15.775941] [DEBUG] [LOCAL     ] NRK: Saving primary data.
[2025-10-24T20:16:15.776309] [FATAL] [LOCAL     ] NRK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:16:15.776413] [FATAL] [MAIN      ] NRK: Failed to save primary data.
[2025-10-24T20:16:15.776456] [WARN ] [MAIN      ] NRK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:16:15.776498] [INFO ] [LOCAL     ] NRK: Starting deletion of primary data.
[2025-10-24T20:16:15.776550] [DEBUG] [LOCAL     ] NRK: No primary data file found to delete.
[2025-10-24T20:16:15.776586] [INFO ] [LOCAL     ] NRK: Starting deletion of derivative data.
[2025-10-24T20:16:15.776795] [DEBUG] [LOCAL     ] NRK: Deleted derivative data file.
[2025-10-24T20:16:15.776891] [INFO ] [MAIN      ] Update Progress: 1529/2366 symbols completed. NRK took 41.9s. Estimated remaining: 1h 47m 25s. Rate: 7.8 symbols/min
[2025-10-24T20:16:15.949791] [INFO ] [MAIN      ] NSP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:16:15.983204] [DEBUG] [LOCAL     ] NSP: Loaded 36010 existing records from primary storage.
[2025-10-24T20:16:15.983490] [INFO ] [MAIN      ] NSP: Loaded 36010 existing records.
[2025-10-24T20:16:16.156172] [INFO ] [REMOTE    ] NSC: Fetching primary data for 2025-01.
[2025-10-24T20:16:16.160682] [WARN ] [MAIN      ] NSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:16:16.161487] [INFO ] [MAIN      ] NSP: Wiping existing primary data before full refresh.
[2025-10-24T20:16:16.161537] [INFO ] [LOCAL     ] NSP: Starting deletion of primary data.
[2025-10-24T20:16:16.161771] [DEBUG] [LOCAL     ] NSP: Deleted primary data file.
[2025-10-24T20:16:16.161826] [INFO ] [MAIN      ] NSP: Starting full primary refresh.
[2025-10-24T20:16:16.512450] [INFO ] [REMOTE    ] NSP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:16:16.737061] [INFO ] [REMOTE    ] NSA: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T20:16:16.947708] [INFO ] [REMOTE    ] NRUC: Fetching primary data for 2025-07.
[2025-10-24T20:16:17.660832] [INFO ] [REMOTE    ] NRUC: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T20:16:17.747721] [INFO ] [REMOTE    ] NRUC: Fetching primary data for 2025-08.
[2025-10-24T20:16:18.052888] [INFO ] [REMOTE    ] NSC: Incremental fetch complete for 2025-01 (1.90 seconds).
[2025-10-24T20:16:18.451707] [INFO ] [REMOTE    ] NRUC: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T20:16:18.547723] [INFO ] [REMOTE    ] NSA: Fetching primary data for 2025-03.
[2025-10-24T20:16:19.347673] [INFO ] [REMOTE    ] NSP: Fetching primary data for 2025-01.
[2025-10-24T20:16:20.099002] [INFO ] [REMOTE    ] NSA: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T20:16:20.147707] [INFO ] [REMOTE    ] NSC: Fetching primary data for 2025-02.
[2025-10-24T20:16:20.644797] [INFO ] [REMOTE    ] NSP: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T20:16:20.947696] [INFO ] [REMOTE    ] NRUC: Fetching primary data for 2025-09.
[2025-10-24T20:16:21.622219] [INFO ] [REMOTE    ] NRUC: Incremental fetch complete for 2025-09 (0.67 seconds).
[2025-10-24T20:16:21.747638] [INFO ] [REMOTE    ] NRUC: Fetching primary data for 2025-10.
[2025-10-24T20:16:21.904329] [INFO ] [REMOTE    ] NSC: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T20:16:22.408077] [INFO ] [REMOTE    ] NRUC: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T20:16:22.409307] [INFO ] [REMOTE    ] NRUC: Full fetch complete (4931 records).
[2025-10-24T20:16:22.409377] [DEBUG] [VALIDATOR ] NRUC: Validating primary data.
[2025-10-24T20:16:22.555608] [INFO ] [REMOTE    ] NSP: Fetching primary data for 2025-02.
[2025-10-24T20:16:22.764964] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present.
[2025-10-24T20:16:22.765065] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed.
[2025-10-24T20:16:22.765248] [INFO ] [MAIN      ] NRUC: Fetched primary data is valid.
[2025-10-24T20:16:22.765311] [DEBUG] [LOCAL     ] NRUC: Saving primary data.
[2025-10-24T20:16:22.765501] [FATAL] [LOCAL     ] NRUC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:16:22.765585] [FATAL] [MAIN      ] NRUC: Failed to save primary data.
[2025-10-24T20:16:22.765626] [WARN ] [MAIN      ] NRUC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:16:22.765698] [INFO ] [LOCAL     ] NRUC: Starting deletion of primary data.
[2025-10-24T20:16:22.765757] [DEBUG] [LOCAL     ] NRUC: No primary data file found to delete.
[2025-10-24T20:16:22.765792] [INFO ] [LOCAL     ] NRUC: Starting deletion of derivative data.
[2025-10-24T20:16:22.765830] [DEBUG] [LOCAL     ] NRUC: No derivative data file found to delete.
[2025-10-24T20:16:22.765886] [INFO ] [MAIN      ] Update Progress: 1530/2366 symbols completed. NRUC took 18.1s. Estimated remaining: 1h 47m 17s. Rate: 7.8 symbols/min
[2025-10-24T20:16:22.930772] [INFO ] [MAIN      ] NTB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:16:22.950925] [DEBUG] [LOCAL     ] NTB: Loaded 20317 existing records from primary storage.
[2025-10-24T20:16:22.951186] [INFO ] [MAIN      ] NTB: Loaded 20317 existing records.
[2025-10-24T20:16:23.125288] [WARN ] [MAIN      ] NTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:16:23.125517] [INFO ] [MAIN      ] NTB: Wiping existing primary data before full refresh.
[2025-10-24T20:16:23.125585] [INFO ] [LOCAL     ] NTB: Starting deletion of primary data.
[2025-10-24T20:16:23.125861] [DEBUG] [LOCAL     ] NTB: Deleted primary data file.
[2025-10-24T20:16:23.125918] [INFO ] [MAIN      ] NTB: Starting full primary refresh.
[2025-10-24T20:16:23.353269] [INFO ] [REMOTE    ] NSC: Fetching primary data for 2025-03.
[2025-10-24T20:16:23.478534] [INFO ] [REMOTE    ] NTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:16:24.102834] [INFO ] [REMOTE    ] NSP: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T20:16:24.147627] [INFO ] [REMOTE    ] NSP: Fetching primary data for 2025-03.
[2025-10-24T20:16:24.952982] [INFO ] [REMOTE    ] NSA: Fetching primary data for 2025-04.
[2025-10-24T20:16:24.958588] [INFO ] [REMOTE    ] NSC: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T20:16:25.617155] [INFO ] [REMOTE    ] NSP: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T20:16:25.747671] [INFO ] [REMOTE    ] NTB: Fetching primary data for 2025-01.
[2025-10-24T20:16:26.547617] [INFO ] [REMOTE    ] NSP: Fetching primary data for 2025-04.
[2025-10-24T20:16:26.669204] [INFO ] [REMOTE    ] NSA: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T20:16:26.917986] [INFO ] [REMOTE    ] NTB: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T20:16:27.347680] [INFO ] [REMOTE    ] NSA: Fetching primary data for 2025-05.
[2025-10-24T20:16:28.041797] [INFO ] [REMOTE    ] NSP: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T20:16:28.147679] [INFO ] [REMOTE    ] NSP: Fetching primary data for 2025-05.
[2025-10-24T20:16:28.923293] [INFO ] [REMOTE    ] NSA: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T20:16:28.947609] [INFO ] [REMOTE    ] NSA: Fetching primary data for 2025-06.
[2025-10-24T20:16:29.747742] [INFO ] [REMOTE    ] NTB: Fetching primary data for 2025-02.
[2025-10-24T20:16:29.814965] [INFO ] [REMOTE    ] NSP: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T20:16:30.214953] [INFO ] [REMOTE    ] NSA: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T20:16:30.547736] [INFO ] [REMOTE    ] NSC: Fetching primary data for 2025-04.
[2025-10-24T20:16:30.880861] [INFO ] [REMOTE    ] NTB: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T20:16:31.347751] [INFO ] [REMOTE    ] NSA: Fetching primary data for 2025-07.
[2025-10-24T20:16:32.147703] [INFO ] [REMOTE    ] NTB: Fetching primary data for 2025-03.
[2025-10-24T20:16:32.947759] [INFO ] [REMOTE    ] NSP: Fetching primary data for 2025-06.
[2025-10-24T20:16:33.300795] [INFO ] [REMOTE    ] NTB: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T20:16:33.747737] [INFO ] [REMOTE    ] NTB: Fetching primary data for 2025-04.
[2025-10-24T20:16:33.951689] [INFO ] [REMOTE    ] NSP: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T20:16:34.547711] [INFO ] [REMOTE    ] NSP: Fetching primary data for 2025-07.
[2025-10-24T20:16:34.629752] [INFO ] [REMOTE    ] NSC: Incremental fetch complete for 2025-04 (4.08 seconds).
[2025-10-24T20:16:34.934332] [INFO ] [REMOTE    ] NTB: Incremental fetch complete for 2025-04 (1.19 seconds).
[2025-10-24T20:16:35.347728] [INFO ] [REMOTE    ] NTB: Fetching primary data for 2025-05.
[2025-10-24T20:16:36.005251] [INFO ] [REMOTE    ] NSP: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T20:16:36.147717] [INFO ] [REMOTE    ] NSP: Fetching primary data for 2025-08.
[2025-10-24T20:16:36.357355] [INFO ] [REMOTE    ] NSA: Incremental fetch complete for 2025-07 (5.01 seconds).
[2025-10-24T20:16:36.471079] [INFO ] [REMOTE    ] NTB: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T20:16:36.947701] [INFO ] [REMOTE    ] NTB: Fetching primary data for 2025-06.
[2025-10-24T20:16:37.747737] [INFO ] [REMOTE    ] NSC: Fetching primary data for 2025-05.
[2025-10-24T20:16:38.015520] [INFO ] [REMOTE    ] NTB: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T20:16:38.547619] [INFO ] [REMOTE    ] NTB: Fetching primary data for 2025-07.
[2025-10-24T20:16:38.681415] [INFO ] [REMOTE    ] NSP: Incremental fetch complete for 2025-08 (2.53 seconds).
[2025-10-24T20:16:39.347617] [INFO ] [REMOTE    ] NSP: Fetching primary data for 2025-09.
[2025-10-24T20:16:39.455905] [INFO ] [REMOTE    ] NSC: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T20:16:39.503404] [INFO ] [REMOTE    ] NTB: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T20:16:40.147685] [INFO ] [REMOTE    ] NTB: Fetching primary data for 2025-08.
[2025-10-24T20:16:40.859430] [INFO ] [REMOTE    ] NSP: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T20:16:40.947696] [INFO ] [REMOTE    ] NSP: Fetching primary data for 2025-10.
[2025-10-24T20:16:41.389908] [INFO ] [REMOTE    ] NTB: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T20:16:41.747673] [INFO ] [REMOTE    ] NSC: Fetching primary data for 2025-06.
[2025-10-24T20:16:42.547738] [INFO ] [REMOTE    ] NTB: Fetching primary data for 2025-09.
[2025-10-24T20:16:42.549780] [INFO ] [REMOTE    ] NSP: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T20:16:42.556807] [INFO ] [REMOTE    ] NSP: Full fetch complete (50395 records).
[2025-10-24T20:16:42.556919] [DEBUG] [VALIDATOR ] NSP: Validating primary data.
[2025-10-24T20:16:42.938205] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present.
[2025-10-24T20:16:42.938285] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed.
[2025-10-24T20:16:42.939314] [INFO ] [MAIN      ] NSP: Fetched primary data is valid.
[2025-10-24T20:16:42.939378] [DEBUG] [LOCAL     ] NSP: Saving primary data.
[2025-10-24T20:16:42.939860] [FATAL] [LOCAL     ] NSP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:16:42.939982] [FATAL] [MAIN      ] NSP: Failed to save primary data.
[2025-10-24T20:16:42.940026] [WARN ] [MAIN      ] NSP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:16:42.940062] [INFO ] [LOCAL     ] NSP: Starting deletion of primary data.
[2025-10-24T20:16:42.940114] [DEBUG] [LOCAL     ] NSP: No primary data file found to delete.
[2025-10-24T20:16:42.940162] [INFO ] [LOCAL     ] NSP: Starting deletion of derivative data.
[2025-10-24T20:16:42.940398] [DEBUG] [LOCAL     ] NSP: Deleted derivative data file.
[2025-10-24T20:16:42.940497] [INFO ] [MAIN      ] Update Progress: 1531/2366 symbols completed. NSP took 27.2s. Estimated remaining: 1h 47m 16s. Rate: 7.8 symbols/min
[2025-10-24T20:16:43.112488] [INFO ] [MAIN      ] NTEST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:16:43.112659] [DEBUG] [LOCAL     ] NTEST: No existing data file found in primary storage.
[2025-10-24T20:16:43.112716] [WARN ] [MAIN      ] NTEST: No existing data found, performing full refresh instead.
[2025-10-24T20:16:43.112821] [INFO ] [MAIN      ] NTEST: Wiping existing primary data before full refresh.
[2025-10-24T20:16:43.112861] [INFO ] [LOCAL     ] NTEST: Starting deletion of primary data.
[2025-10-24T20:16:43.112901] [DEBUG] [LOCAL     ] NTEST: No primary data file found to delete.
[2025-10-24T20:16:43.112933] [INFO ] [MAIN      ] NTEST: Starting full primary refresh.
[2025-10-24T20:16:43.350717] [INFO ] [REMOTE    ] NSA: Fetching primary data for 2025-08.
[2025-10-24T20:16:43.483678] [INFO ] [REMOTE    ] NTEST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:16:43.589078] [INFO ] [REMOTE    ] NSC: Incremental fetch complete for 2025-06 (1.84 seconds).
[2025-10-24T20:16:43.691101] [INFO ] [REMOTE    ] NTB: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T20:16:44.147726] [INFO ] [REMOTE    ] NSC: Fetching primary data for 2025-07.
[2025-10-24T20:16:44.947634] [INFO ] [REMOTE    ] NTEST: Fetching primary data for 2025-01.
[2025-10-24T20:16:45.003373] [INFO ] [REMOTE    ] NSA: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T20:16:45.617362] [INFO ] [REMOTE    ] NTEST: Incremental fetch complete for 2025-01 (0.67 seconds).
[2025-10-24T20:16:45.747609] [INFO ] [REMOTE    ] NTB: Fetching primary data for 2025-10.
[2025-10-24T20:16:46.183913] [INFO ] [REMOTE    ] NSC: Incremental fetch complete for 2025-07 (2.04 seconds).
[2025-10-24T20:16:46.547609] [INFO ] [REMOTE    ] NTEST: Fetching primary data for 2025-02.
[2025-10-24T20:16:46.942511] [INFO ] [REMOTE    ] NTB: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T20:16:46.946807] [INFO ] [REMOTE    ] NTB: Full fetch complete (30777 records).
[2025-10-24T20:16:46.946985] [DEBUG] [VALIDATOR ] NTB: Validating primary data.
[2025-10-24T20:16:47.063355] [INFO ] [REMOTE    ] NTEST: Incremental fetch complete for 2025-02 (0.52 seconds).
[2025-10-24T20:16:47.328904] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present.
[2025-10-24T20:16:47.328994] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed.
[2025-10-24T20:16:47.329632] [INFO ] [MAIN      ] NTB: Fetched primary data is valid.
[2025-10-24T20:16:47.329731] [DEBUG] [LOCAL     ] NTB: Saving primary data.
[2025-10-24T20:16:47.330119] [FATAL] [LOCAL     ] NTB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:16:47.330207] [FATAL] [MAIN      ] NTB: Failed to save primary data.
[2025-10-24T20:16:47.330248] [WARN ] [MAIN      ] NTB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:16:47.330290] [INFO ] [LOCAL     ] NTB: Starting deletion of primary data.
[2025-10-24T20:16:47.330376] [DEBUG] [LOCAL     ] NTB: No primary data file found to delete.
[2025-10-24T20:16:47.330428] [INFO ] [LOCAL     ] NTB: Starting deletion of derivative data.
[2025-10-24T20:16:47.330602] [DEBUG] [LOCAL     ] NTB: Deleted derivative data file.
[2025-10-24T20:16:47.330761] [INFO ] [MAIN      ] Update Progress: 1532/2366 symbols completed. NTB took 24.6s. Estimated remaining: 1h 47m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:16:47.352804] [INFO ] [REMOTE    ] NTEST: Fetching primary data for 2025-03.
[2025-10-24T20:16:47.516957] [INFO ] [MAIN      ] NTR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:16:47.569058] [DEBUG] [LOCAL     ] NTR: Loaded 53001 existing records from primary storage.
[2025-10-24T20:16:47.569359] [INFO ] [MAIN      ] NTR: Loaded 53001 existing records.
[2025-10-24T20:16:47.742695] [WARN ] [MAIN      ] NTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:16:47.742988] [INFO ] [MAIN      ] NTR: Wiping existing primary data before full refresh.
[2025-10-24T20:16:47.743044] [INFO ] [LOCAL     ] NTR: Starting deletion of primary data.
[2025-10-24T20:16:47.743873] [DEBUG] [LOCAL     ] NTR: Deleted primary data file.
[2025-10-24T20:16:47.743930] [INFO ] [MAIN      ] NTR: Starting full primary refresh.
[2025-10-24T20:16:48.033679] [INFO ] [REMOTE    ] NTEST: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T20:16:48.110794] [INFO ] [REMOTE    ] NTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:16:48.147605] [INFO ] [REMOTE    ] NTR: Fetching primary data for 2025-01.
[2025-10-24T20:16:48.947707] [INFO ] [REMOTE    ] NTEST: Fetching primary data for 2025-04.
[2025-10-24T20:16:49.521908] [INFO ] [REMOTE    ] NTEST: Incremental fetch complete for 2025-04 (0.57 seconds).
[2025-10-24T20:16:49.747715] [INFO ] [REMOTE    ] NSA: Fetching primary data for 2025-09.
[2025-10-24T20:16:50.038614] [INFO ] [REMOTE    ] NTR: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T20:16:50.547759] [INFO ] [REMOTE    ] NSC: Fetching primary data for 2025-08.
[2025-10-24T20:16:51.347725] [INFO ] [REMOTE    ] NTEST: Fetching primary data for 2025-05.
[2025-10-24T20:16:51.386556] [INFO ] [REMOTE    ] NSA: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T20:16:52.147626] [INFO ] [REMOTE    ] NSA: Fetching primary data for 2025-10.
[2025-10-24T20:16:52.466399] [INFO ] [REMOTE    ] NTEST: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T20:16:52.507640] [INFO ] [REMOTE    ] NSC: Incremental fetch complete for 2025-08 (1.96 seconds).
[2025-10-24T20:16:52.947667] [INFO ] [REMOTE    ] NTEST: Fetching primary data for 2025-06.
[2025-10-24T20:16:53.587522] [INFO ] [REMOTE    ] NSA: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T20:16:53.596032] [INFO ] [REMOTE    ] NSA: Full fetch complete (62885 records).
[2025-10-24T20:16:53.596154] [DEBUG] [VALIDATOR ] NSA: Validating primary data.
[2025-10-24T20:16:53.670797] [INFO ] [REMOTE    ] NTEST: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T20:16:53.752025] [INFO ] [REMOTE    ] NTEST: Fetching primary data for 2025-07.
[2025-10-24T20:16:54.014604] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present.
[2025-10-24T20:16:54.014734] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed.
[2025-10-24T20:16:54.015890] [INFO ] [MAIN      ] NSA: Fetched primary data is valid.
[2025-10-24T20:16:54.015977] [DEBUG] [LOCAL     ] NSA: Saving primary data.
[2025-10-24T20:16:54.016602] [FATAL] [LOCAL     ] NSA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:16:54.016722] [FATAL] [MAIN      ] NSA: Failed to save primary data.
[2025-10-24T20:16:54.016766] [WARN ] [MAIN      ] NSA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:16:54.016804] [INFO ] [LOCAL     ] NSA: Starting deletion of primary data.
[2025-10-24T20:16:54.016857] [DEBUG] [LOCAL     ] NSA: No primary data file found to delete.
[2025-10-24T20:16:54.016893] [INFO ] [LOCAL     ] NSA: Starting deletion of derivative data.
[2025-10-24T20:16:54.017086] [DEBUG] [LOCAL     ] NSA: Deleted derivative data file.
[2025-10-24T20:16:54.017187] [INFO ] [MAIN      ] Update Progress: 1533/2366 symbols completed. NSA took 45.9s. Estimated remaining: 1h 46m 58s. Rate: 7.8 symbols/min
[2025-10-24T20:16:54.202940] [INFO ] [MAIN      ] NTST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:16:54.243984] [DEBUG] [LOCAL     ] NTST: Loaded 44366 existing records from primary storage.
[2025-10-24T20:16:54.244288] [INFO ] [MAIN      ] NTST: Loaded 44366 existing records.
[2025-10-24T20:16:54.423123] [WARN ] [MAIN      ] NTST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:16:54.423350] [INFO ] [MAIN      ] NTST: Wiping existing primary data before full refresh.
[2025-10-24T20:16:54.423396] [INFO ] [LOCAL     ] NTST: Starting deletion of primary data.
[2025-10-24T20:16:54.423870] [DEBUG] [LOCAL     ] NTST: Deleted primary data file.
[2025-10-24T20:16:54.423925] [INFO ] [MAIN      ] NTST: Starting full primary refresh.
[2025-10-24T20:16:54.552726] [INFO ] [REMOTE    ] NSC: Fetching primary data for 2025-09.
[2025-10-24T20:16:54.722892] [INFO ] [REMOTE    ] NTEST: Incremental fetch complete for 2025-07 (0.97 seconds).
[2025-10-24T20:16:54.801629] [INFO ] [REMOTE    ] NTST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:16:55.347639] [INFO ] [REMOTE    ] NTST: Fetching primary data for 2025-01.
[2025-10-24T20:16:55.646862] [INFO ] [REMOTE    ] NSC: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T20:16:56.147686] [INFO ] [REMOTE    ] NTR: Fetching primary data for 2025-02.
[2025-10-24T20:16:56.770798] [INFO ] [REMOTE    ] NTST: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T20:16:56.947743] [INFO ] [REMOTE    ] NTEST: Fetching primary data for 2025-08.
[2025-10-24T20:16:57.588559] [INFO ] [REMOTE    ] NTEST: Incremental fetch complete for 2025-08 (0.64 seconds).
[2025-10-24T20:16:57.747715] [INFO ] [REMOTE    ] NTEST: Fetching primary data for 2025-09.
[2025-10-24T20:16:57.784712] [INFO ] [REMOTE    ] NTR: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T20:16:58.314876] [INFO ] [REMOTE    ] NTEST: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T20:16:58.547689] [INFO ] [REMOTE    ] NTR: Fetching primary data for 2025-03.
[2025-10-24T20:16:59.347719] [INFO ] [REMOTE    ] NTST: Fetching primary data for 2025-02.
[2025-10-24T20:17:00.147632] [INFO ] [REMOTE    ] NTEST: Fetching primary data for 2025-10.
[2025-10-24T20:17:00.939940] [INFO ] [REMOTE    ] NTST: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T20:17:00.947593] [INFO ] [REMOTE    ] NTST: Fetching primary data for 2025-03.
[2025-10-24T20:17:01.441220] [INFO ] [REMOTE    ] NTEST: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T20:17:01.442046] [INFO ] [REMOTE    ] NTEST: Full fetch complete (1965 records).
[2025-10-24T20:17:01.456735] [DEBUG] [VALIDATOR ] NTEST: Validating primary data.
[2025-10-24T20:17:01.592438] [INFO ] [REMOTE    ] NTR: Incremental fetch complete for 2025-03 (3.04 seconds).
[2025-10-24T20:17:01.684077] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 179 unique days, need 200 days
[2025-10-24T20:17:01.684334] [FATAL] [MAIN      ] NTEST: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:17:01.684383] [WARN ] [MAIN      ] NTEST: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:17:01.684427] [INFO ] [LOCAL     ] NTEST: Starting deletion of primary data.
[2025-10-24T20:17:01.684502] [DEBUG] [LOCAL     ] NTEST: No primary data file found to delete.
[2025-10-24T20:17:01.684540] [INFO ] [LOCAL     ] NTEST: Starting deletion of derivative data.
[2025-10-24T20:17:01.684580] [DEBUG] [LOCAL     ] NTEST: No derivative data file found to delete.
[2025-10-24T20:17:01.684638] [INFO ] [MAIN      ] Update Progress: 1534/2366 symbols completed. NTEST took 18.7s. Estimated remaining: 1h 46m 50s. Rate: 7.8 symbols/min
[2025-10-24T20:17:01.760069] [INFO ] [REMOTE    ] NSC: Fetching primary data for 2025-10.
[2025-10-24T20:17:01.878513] [INFO ] [MAIN      ] NU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:17:01.933533] [DEBUG] [LOCAL     ] NU: Loaded 54136 existing records from primary storage.
[2025-10-24T20:17:01.933920] [INFO ] [MAIN      ] NU: Loaded 54136 existing records.
[2025-10-24T20:17:02.111579] [WARN ] [MAIN      ] NU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:17:02.111807] [INFO ] [MAIN      ] NU: Wiping existing primary data before full refresh.
[2025-10-24T20:17:02.111855] [INFO ] [LOCAL     ] NU: Starting deletion of primary data.
[2025-10-24T20:17:02.112566] [DEBUG] [LOCAL     ] NU: Deleted primary data file.
[2025-10-24T20:17:02.112624] [INFO ] [MAIN      ] NU: Starting full primary refresh.
[2025-10-24T20:17:02.470914] [INFO ] [REMOTE    ] NU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:17:02.547682] [INFO ] [REMOTE    ] NU: Fetching primary data for 2025-01.
[2025-10-24T20:17:03.030238] [INFO ] [REMOTE    ] NTST: Incremental fetch complete for 2025-03 (2.08 seconds).
[2025-10-24T20:17:03.347627] [INFO ] [REMOTE    ] NTR: Fetching primary data for 2025-04.
[2025-10-24T20:17:03.644787] [INFO ] [REMOTE    ] NSC: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T20:17:03.653018] [INFO ] [REMOTE    ] NSC: Full fetch complete (70592 records).
[2025-10-24T20:17:03.653156] [DEBUG] [VALIDATOR ] NSC: Validating primary data.
[2025-10-24T20:17:03.654330] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:17:03.654428] [FATAL] [MAIN      ] NSC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:17:03.654502] [WARN ] [MAIN      ] NSC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:17:03.654591] [INFO ] [LOCAL     ] NSC: Starting deletion of primary data.
[2025-10-24T20:17:03.654707] [DEBUG] [LOCAL     ] NSC: No primary data file found to delete.
[2025-10-24T20:17:03.654757] [INFO ] [LOCAL     ] NSC: Starting deletion of derivative data.
[2025-10-24T20:17:03.654915] [DEBUG] [LOCAL     ] NSC: Deleted derivative data file.
[2025-10-24T20:17:03.655426] [INFO ] [MAIN      ] Update Progress: 1535/2366 symbols completed. NSC took 49.6s. Estimated remaining: 1h 46m 39s. Rate: 7.8 symbols/min
[2025-10-24T20:17:03.820918] [INFO ] [MAIN      ] NUE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:17:03.821102] [DEBUG] [LOCAL     ] NUE: No existing data file found in primary storage.
[2025-10-24T20:17:03.821138] [WARN ] [MAIN      ] NUE: No existing data found, performing full refresh instead.
[2025-10-24T20:17:03.821280] [INFO ] [MAIN      ] NUE: Wiping existing primary data before full refresh.
[2025-10-24T20:17:03.821351] [INFO ] [LOCAL     ] NUE: Starting deletion of primary data.
[2025-10-24T20:17:03.821408] [DEBUG] [LOCAL     ] NUE: No primary data file found to delete.
[2025-10-24T20:17:03.821460] [INFO ] [MAIN      ] NUE: Starting full primary refresh.
[2025-10-24T20:17:04.156844] [INFO ] [REMOTE    ] NTST: Fetching primary data for 2025-04.
[2025-10-24T20:17:04.189283] [INFO ] [REMOTE    ] NUE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:17:04.798437] [INFO ] [REMOTE    ] NU: Incremental fetch complete for 2025-01 (2.25 seconds).
[2025-10-24T20:17:04.947626] [INFO ] [REMOTE    ] NU: Fetching primary data for 2025-02.
[2025-10-24T20:17:05.122052] [INFO ] [REMOTE    ] NTR: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T20:17:05.747707] [INFO ] [REMOTE    ] NTR: Fetching primary data for 2025-05.
[2025-10-24T20:17:05.944138] [INFO ] [REMOTE    ] NTST: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T20:17:06.547631] [INFO ] [REMOTE    ] NUE: Fetching primary data for 2025-01.
[2025-10-24T20:17:07.213257] [INFO ] [REMOTE    ] NU: Incremental fetch complete for 2025-02 (2.27 seconds).
[2025-10-24T20:17:07.347632] [INFO ] [REMOTE    ] NU: Fetching primary data for 2025-03.
[2025-10-24T20:17:07.586593] [INFO ] [REMOTE    ] NTR: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T20:17:08.147667] [INFO ] [REMOTE    ] NTST: Fetching primary data for 2025-05.
[2025-10-24T20:17:08.396631] [INFO ] [REMOTE    ] NUE: Incremental fetch complete for 2025-01 (1.85 seconds).
[2025-10-24T20:17:08.947705] [INFO ] [REMOTE    ] NUE: Fetching primary data for 2025-02.
[2025-10-24T20:17:09.710399] [INFO ] [REMOTE    ] NU: Incremental fetch complete for 2025-03 (2.36 seconds).
[2025-10-24T20:17:09.747634] [INFO ] [REMOTE    ] NU: Fetching primary data for 2025-04.
[2025-10-24T20:17:09.837040] [INFO ] [REMOTE    ] NTST: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T20:17:10.547741] [INFO ] [REMOTE    ] NTST: Fetching primary data for 2025-06.
[2025-10-24T20:17:11.012591] [INFO ] [REMOTE    ] NUE: Incremental fetch complete for 2025-02 (2.06 seconds).
[2025-10-24T20:17:11.347732] [INFO ] [REMOTE    ] NUE: Fetching primary data for 2025-03.
[2025-10-24T20:17:12.057169] [INFO ] [REMOTE    ] NTST: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T20:17:12.147685] [INFO ] [REMOTE    ] NTST: Fetching primary data for 2025-07.
[2025-10-24T20:17:12.272526] [INFO ] [REMOTE    ] NU: Incremental fetch complete for 2025-04 (2.52 seconds).
[2025-10-24T20:17:12.947707] [INFO ] [REMOTE    ] NTR: Fetching primary data for 2025-06.
[2025-10-24T20:17:13.403151] [INFO ] [REMOTE    ] NUE: Incremental fetch complete for 2025-03 (2.06 seconds).
[2025-10-24T20:17:13.747730] [INFO ] [REMOTE    ] NUE: Fetching primary data for 2025-04.
[2025-10-24T20:17:13.823900] [INFO ] [REMOTE    ] NTST: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T20:17:14.547726] [INFO ] [REMOTE    ] NTST: Fetching primary data for 2025-08.
[2025-10-24T20:17:14.966233] [INFO ] [REMOTE    ] NTR: Incremental fetch complete for 2025-06 (2.02 seconds).
[2025-10-24T20:17:15.347668] [INFO ] [REMOTE    ] NU: Fetching primary data for 2025-05.
[2025-10-24T20:17:15.854545] [INFO ] [REMOTE    ] NUE: Incremental fetch complete for 2025-04 (2.11 seconds).
[2025-10-24T20:17:15.924974] [INFO ] [REMOTE    ] NTST: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T20:17:16.147681] [INFO ] [REMOTE    ] NUE: Fetching primary data for 2025-05.
[2025-10-24T20:17:16.947728] [INFO ] [REMOTE    ] NTST: Fetching primary data for 2025-09.
[2025-10-24T20:17:17.747770] [INFO ] [REMOTE    ] NTR: Fetching primary data for 2025-07.
[2025-10-24T20:17:17.895956] [INFO ] [REMOTE    ] NU: Incremental fetch complete for 2025-05 (2.55 seconds).
[2025-10-24T20:17:18.079831] [INFO ] [REMOTE    ] NUE: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T20:17:18.547745] [INFO ] [REMOTE    ] NU: Fetching primary data for 2025-06.
[2025-10-24T20:17:18.630045] [INFO ] [REMOTE    ] NTST: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T20:17:19.347742] [INFO ] [REMOTE    ] NUE: Fetching primary data for 2025-06.
[2025-10-24T20:17:19.649822] [INFO ] [REMOTE    ] NTR: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T20:17:20.147734] [INFO ] [REMOTE    ] NTR: Fetching primary data for 2025-08.
[2025-10-24T20:17:20.698226] [INFO ] [REMOTE    ] NU: Incremental fetch complete for 2025-06 (2.15 seconds).
[2025-10-24T20:17:20.947746] [INFO ] [REMOTE    ] NU: Fetching primary data for 2025-07.
[2025-10-24T20:17:21.489137] [INFO ] [REMOTE    ] NUE: Incremental fetch complete for 2025-06 (2.14 seconds).
[2025-10-24T20:17:21.747689] [INFO ] [REMOTE    ] NUE: Fetching primary data for 2025-07.
[2025-10-24T20:17:22.055379] [INFO ] [REMOTE    ] NTR: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T20:17:22.547685] [INFO ] [REMOTE    ] NTST: Fetching primary data for 2025-10.
[2025-10-24T20:17:22.681943] [INFO ] [REMOTE    ] NU: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T20:17:23.340468] [INFO ] [REMOTE    ] NUE: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T20:17:23.350809] [INFO ] [REMOTE    ] NTR: Fetching primary data for 2025-09.
[2025-10-24T20:17:24.147681] [INFO ] [REMOTE    ] NUE: Fetching primary data for 2025-08.
[2025-10-24T20:17:24.395221] [INFO ] [REMOTE    ] NTST: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T20:17:24.404006] [INFO ] [REMOTE    ] NTST: Full fetch complete (61912 records).
[2025-10-24T20:17:24.404184] [DEBUG] [VALIDATOR ] NTST: Validating primary data.
[2025-10-24T20:17:24.961930] [INFO ] [REMOTE    ] NU: Fetching primary data for 2025-08.
[2025-10-24T20:17:24.993071] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present.
[2025-10-24T20:17:24.993561] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed.
[2025-10-24T20:17:24.995896] [INFO ] [MAIN      ] NTST: Fetched primary data is valid.
[2025-10-24T20:17:24.996233] [DEBUG] [LOCAL     ] NTST: Saving primary data.
[2025-10-24T20:17:24.997149] [FATAL] [LOCAL     ] NTST: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:17:24.997241] [FATAL] [MAIN      ] NTST: Failed to save primary data.
[2025-10-24T20:17:24.997329] [WARN ] [MAIN      ] NTST: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:17:24.997379] [INFO ] [LOCAL     ] NTST: Starting deletion of primary data.
[2025-10-24T20:17:24.997436] [DEBUG] [LOCAL     ] NTST: No primary data file found to delete.
[2025-10-24T20:17:24.997471] [INFO ] [LOCAL     ] NTST: Starting deletion of derivative data.
[2025-10-24T20:17:24.997624] [DEBUG] [LOCAL     ] NTST: Deleted derivative data file.
[2025-10-24T20:17:24.997757] [INFO ] [MAIN      ] Update Progress: 1536/2366 symbols completed. NTST took 31.0s. Estimated remaining: 1h 46m 39s. Rate: 7.8 symbols/min
[2025-10-24T20:17:25.244684] [INFO ] [MAIN      ] NUS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:17:25.286027] [INFO ] [REMOTE    ] NTR: Incremental fetch complete for 2025-09 (1.94 seconds).
[2025-10-24T20:17:25.329460] [DEBUG] [LOCAL     ] NUS: Loaded 36280 existing records from primary storage.
[2025-10-24T20:17:25.329781] [INFO ] [MAIN      ] NUS: Loaded 36280 existing records.
[2025-10-24T20:17:25.508590] [WARN ] [MAIN      ] NUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:17:25.508802] [INFO ] [MAIN      ] NUS: Wiping existing primary data before full refresh.
[2025-10-24T20:17:25.508848] [INFO ] [LOCAL     ] NUS: Starting deletion of primary data.
[2025-10-24T20:17:25.509158] [DEBUG] [LOCAL     ] NUS: Deleted primary data file.
[2025-10-24T20:17:25.509213] [INFO ] [MAIN      ] NUS: Starting full primary refresh.
[2025-10-24T20:17:25.756438] [INFO ] [REMOTE    ] NTR: Fetching primary data for 2025-10.
[2025-10-24T20:17:25.859078] [INFO ] [REMOTE    ] NUS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:17:26.221357] [INFO ] [REMOTE    ] NUE: Incremental fetch complete for 2025-08 (2.07 seconds).
[2025-10-24T20:17:26.547714] [INFO ] [REMOTE    ] NUS: Fetching primary data for 2025-01.
[2025-10-24T20:17:27.340499] [INFO ] [REMOTE    ] NTR: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T20:17:27.349605] [INFO ] [REMOTE    ] NUE: Fetching primary data for 2025-09.
[2025-10-24T20:17:27.351431] [INFO ] [REMOTE    ] NTR: Full fetch complete (76468 records).
[2025-10-24T20:17:27.351565] [DEBUG] [VALIDATOR ] NTR: Validating primary data.
[2025-10-24T20:17:27.794247] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present.
[2025-10-24T20:17:27.797184] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed.
[2025-10-24T20:17:27.798425] [INFO ] [MAIN      ] NTR: Fetched primary data is valid.
[2025-10-24T20:17:27.798537] [DEBUG] [LOCAL     ] NTR: Saving primary data.
[2025-10-24T20:17:27.800773] [INFO ] [REMOTE    ] NU: Incremental fetch complete for 2025-08 (2.84 seconds).
[2025-10-24T20:17:27.799546] [FATAL] [LOCAL     ] NTR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:17:27.811393] [FATAL] [MAIN      ] NTR: Failed to save primary data.
[2025-10-24T20:17:27.811901] [WARN ] [MAIN      ] NTR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:17:27.812401] [INFO ] [LOCAL     ] NTR: Starting deletion of primary data.
[2025-10-24T20:17:27.813103] [DEBUG] [LOCAL     ] NTR: No primary data file found to delete.
[2025-10-24T20:17:27.813268] [INFO ] [LOCAL     ] NTR: Starting deletion of derivative data.
[2025-10-24T20:17:27.813489] [DEBUG] [LOCAL     ] NTR: Deleted derivative data file.
[2025-10-24T20:17:27.813843] [INFO ] [MAIN      ] Update Progress: 1537/2366 symbols completed. NTR took 40.5s. Estimated remaining: 1h 46m 29s. Rate: 7.8 symbols/min
[2025-10-24T20:17:27.990121] [INFO ] [MAIN      ] NUV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:17:28.013186] [DEBUG] [LOCAL     ] NUV: Loaded 23426 existing records from primary storage.
[2025-10-24T20:17:28.013473] [INFO ] [MAIN      ] NUV: Loaded 23426 existing records.
[2025-10-24T20:17:28.158724] [INFO ] [REMOTE    ] NU: Fetching primary data for 2025-09.
[2025-10-24T20:17:28.204223] [WARN ] [MAIN      ] NUV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:17:28.204856] [INFO ] [MAIN      ] NUV: Wiping existing primary data before full refresh.
[2025-10-24T20:17:28.204927] [INFO ] [LOCAL     ] NUV: Starting deletion of primary data.
[2025-10-24T20:17:28.205325] [DEBUG] [LOCAL     ] NUV: Deleted primary data file.
[2025-10-24T20:17:28.205458] [INFO ] [MAIN      ] NUV: Starting full primary refresh.
[2025-10-24T20:17:28.319187] [INFO ] [REMOTE    ] NUS: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T20:17:28.593865] [INFO ] [REMOTE    ] NUV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:17:28.947717] [INFO ] [REMOTE    ] NUS: Fetching primary data for 2025-02.
[2025-10-24T20:17:29.305823] [INFO ] [REMOTE    ] NUE: Incremental fetch complete for 2025-09 (1.96 seconds).
[2025-10-24T20:17:29.747686] [INFO ] [REMOTE    ] NUE: Fetching primary data for 2025-10.
[2025-10-24T20:17:30.404572] [INFO ] [REMOTE    ] NU: Incremental fetch complete for 2025-09 (2.25 seconds).
[2025-10-24T20:17:30.438289] [INFO ] [REMOTE    ] NUS: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T20:17:30.547612] [INFO ] [REMOTE    ] NUS: Fetching primary data for 2025-03.
[2025-10-24T20:17:31.347621] [INFO ] [REMOTE    ] NUV: Fetching primary data for 2025-01.
[2025-10-24T20:17:31.843291] [INFO ] [REMOTE    ] NUE: Incremental fetch complete for 2025-10 (2.10 seconds).
[2025-10-24T20:17:31.854334] [INFO ] [REMOTE    ] NUE: Full fetch complete (74732 records).
[2025-10-24T20:17:31.854593] [DEBUG] [VALIDATOR ] NUE: Validating primary data.
[2025-10-24T20:17:32.069543] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T20:17:32.070382] [FATAL] [MAIN      ] NUE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:17:32.070466] [WARN ] [MAIN      ] NUE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:17:32.070545] [INFO ] [LOCAL     ] NUE: Starting deletion of primary data.
[2025-10-24T20:17:32.070674] [DEBUG] [LOCAL     ] NUE: No primary data file found to delete.
[2025-10-24T20:17:32.070752] [INFO ] [LOCAL     ] NUE: Starting deletion of derivative data.
[2025-10-24T20:17:32.070945] [DEBUG] [LOCAL     ] NUE: No derivative data file found to delete.
[2025-10-24T20:17:32.071708] [INFO ] [MAIN      ] Update Progress: 1538/2366 symbols completed. NUE took 28.4s. Estimated remaining: 1h 46m 19s. Rate: 7.8 symbols/min
[2025-10-24T20:17:32.152802] [INFO ] [REMOTE    ] NU: Fetching primary data for 2025-10.
[2025-10-24T20:17:32.246209] [INFO ] [MAIN      ] NUVB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:17:32.299124] [DEBUG] [LOCAL     ] NUVB: Loaded 52098 existing records from primary storage.
[2025-10-24T20:17:32.299485] [INFO ] [MAIN      ] NUVB: Loaded 52098 existing records.
[2025-10-24T20:17:32.467819] [INFO ] [REMOTE    ] NUS: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T20:17:32.518586] [WARN ] [MAIN      ] NUVB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:17:32.519251] [INFO ] [MAIN      ] NUVB: Wiping existing primary data before full refresh.
[2025-10-24T20:17:32.519427] [INFO ] [LOCAL     ] NUVB: Starting deletion of primary data.
[2025-10-24T20:17:32.520437] [DEBUG] [LOCAL     ] NUVB: Deleted primary data file.
[2025-10-24T20:17:32.520502] [INFO ] [MAIN      ] NUVB: Starting full primary refresh.
[2025-10-24T20:17:32.638802] [INFO ] [REMOTE    ] NUV: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T20:17:32.895807] [INFO ] [REMOTE    ] NUVB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:17:32.947752] [INFO ] [REMOTE    ] NUV: Fetching primary data for 2025-02.
[2025-10-24T20:17:33.747676] [INFO ] [REMOTE    ] NUVB: Fetching primary data for 2025-01.
[2025-10-24T20:17:34.147063] [INFO ] [REMOTE    ] NUV: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T20:17:34.333805] [INFO ] [REMOTE    ] NU: Incremental fetch complete for 2025-10 (2.18 seconds).
[2025-10-24T20:17:34.343810] [INFO ] [REMOTE    ] NU: Full fetch complete (77925 records).
[2025-10-24T20:17:34.343965] [DEBUG] [VALIDATOR ] NU: Validating primary data.
[2025-10-24T20:17:34.552885] [INFO ] [REMOTE    ] NUV: Fetching primary data for 2025-03.
[2025-10-24T20:17:34.755056] [DEBUG] [VALIDATOR ] NU: All expected trading days are present.
[2025-10-24T20:17:34.755145] [DEBUG] [VALIDATOR ] NU: Primary data validation passed.
[2025-10-24T20:17:34.756466] [INFO ] [MAIN      ] NU: Fetched primary data is valid.
[2025-10-24T20:17:34.756533] [DEBUG] [LOCAL     ] NU: Saving primary data.
[2025-10-24T20:17:34.757342] [FATAL] [LOCAL     ] NU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:17:34.757446] [FATAL] [MAIN      ] NU: Failed to save primary data.
[2025-10-24T20:17:34.757488] [WARN ] [MAIN      ] NU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:17:34.757526] [INFO ] [LOCAL     ] NU: Starting deletion of primary data.
[2025-10-24T20:17:34.757583] [DEBUG] [LOCAL     ] NU: No primary data file found to delete.
[2025-10-24T20:17:34.757619] [INFO ] [LOCAL     ] NU: Starting deletion of derivative data.
[2025-10-24T20:17:34.757817] [DEBUG] [LOCAL     ] NU: Deleted derivative data file.
[2025-10-24T20:17:34.758517] [INFO ] [MAIN      ] Update Progress: 1539/2366 symbols completed. NU took 33.1s. Estimated remaining: 1h 46m 9s. Rate: 7.8 symbols/min
[2025-10-24T20:17:34.932068] [INFO ] [MAIN      ] NUW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:17:34.944276] [DEBUG] [LOCAL     ] NUW: Loaded 6664 existing records from primary storage.
[2025-10-24T20:17:34.944498] [INFO ] [MAIN      ] NUW: Loaded 6664 existing records.
[2025-10-24T20:17:35.137818] [WARN ] [MAIN      ] NUW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:17:35.138109] [INFO ] [MAIN      ] NUW: Wiping existing primary data before full refresh.
[2025-10-24T20:17:35.138162] [INFO ] [LOCAL     ] NUW: Starting deletion of primary data.
[2025-10-24T20:17:35.138338] [DEBUG] [LOCAL     ] NUW: Deleted primary data file.
[2025-10-24T20:17:35.138376] [INFO ] [MAIN      ] NUW: Starting full primary refresh.
[2025-10-24T20:17:35.349965] [INFO ] [REMOTE    ] NUS: Fetching primary data for 2025-04.
[2025-10-24T20:17:35.514138] [INFO ] [REMOTE    ] NUW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:17:35.545116] [INFO ] [REMOTE    ] NUVB: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T20:17:35.787046] [INFO ] [REMOTE    ] NUV: Incremental fetch complete for 2025-03 (1.23 seconds).
[2025-10-24T20:17:36.147672] [INFO ] [REMOTE    ] NUVB: Fetching primary data for 2025-02.
[2025-10-24T20:17:36.947679] [INFO ] [REMOTE    ] NUV: Fetching primary data for 2025-04.
[2025-10-24T20:17:37.070109] [INFO ] [REMOTE    ] NUS: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T20:17:37.747686] [INFO ] [REMOTE    ] NUS: Fetching primary data for 2025-05.
[2025-10-24T20:17:37.805678] [INFO ] [REMOTE    ] NUVB: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T20:17:38.419142] [INFO ] [REMOTE    ] NUV: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T20:17:38.547685] [INFO ] [REMOTE    ] NUVB: Fetching primary data for 2025-03.
[2025-10-24T20:17:38.919614] [INFO ] [REMOTE    ] NUS: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T20:17:39.347671] [INFO ] [REMOTE    ] NUV: Fetching primary data for 2025-05.
[2025-10-24T20:17:40.147728] [INFO ] [REMOTE    ] NUS: Fetching primary data for 2025-06.
[2025-10-24T20:17:40.380524] [INFO ] [REMOTE    ] NUVB: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T20:17:40.631942] [INFO ] [REMOTE    ] NUV: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T20:17:40.947640] [INFO ] [REMOTE    ] NUV: Fetching primary data for 2025-06.
[2025-10-24T20:17:41.268031] [INFO ] [REMOTE    ] NUS: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T20:17:41.747677] [INFO ] [REMOTE    ] NUW: Fetching primary data for 2025-01.
[2025-10-24T20:17:42.107679] [INFO ] [REMOTE    ] NUV: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T20:17:42.547719] [INFO ] [REMOTE    ] NUV: Fetching primary data for 2025-07.
[2025-10-24T20:17:42.638616] [INFO ] [REMOTE    ] NUW: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T20:17:43.347747] [INFO ] [REMOTE    ] NUVB: Fetching primary data for 2025-04.
[2025-10-24T20:17:43.781578] [INFO ] [REMOTE    ] NUV: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T20:17:44.147733] [INFO ] [REMOTE    ] NUW: Fetching primary data for 2025-02.
[2025-10-24T20:17:44.838086] [INFO ] [REMOTE    ] NUVB: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T20:17:44.947705] [INFO ] [REMOTE    ] NUVB: Fetching primary data for 2025-05.
[2025-10-24T20:17:44.994985] [INFO ] [REMOTE    ] NUW: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T20:17:45.747714] [INFO ] [REMOTE    ] NUS: Fetching primary data for 2025-07.
[2025-10-24T20:17:46.547737] [INFO ] [REMOTE    ] NUW: Fetching primary data for 2025-03.
[2025-10-24T20:17:46.988284] [INFO ] [REMOTE    ] NUVB: Incremental fetch complete for 2025-05 (2.04 seconds).
[2025-10-24T20:17:47.216733] [INFO ] [REMOTE    ] NUW: Incremental fetch complete for 2025-03 (0.67 seconds).
[2025-10-24T20:17:47.347730] [INFO ] [REMOTE    ] NUW: Fetching primary data for 2025-04.
[2025-10-24T20:17:47.477339] [INFO ] [REMOTE    ] NUS: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T20:17:48.147631] [INFO ] [REMOTE    ] NUS: Fetching primary data for 2025-08.
[2025-10-24T20:17:48.361065] [INFO ] [REMOTE    ] NUW: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T20:17:48.947745] [INFO ] [REMOTE    ] NUW: Fetching primary data for 2025-05.
[2025-10-24T20:17:49.590179] [INFO ] [REMOTE    ] NUS: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T20:17:49.747719] [INFO ] [REMOTE    ] NUV: Fetching primary data for 2025-08.
[2025-10-24T20:17:49.812681] [INFO ] [REMOTE    ] NUW: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T20:17:50.547673] [INFO ] [REMOTE    ] NUW: Fetching primary data for 2025-06.
[2025-10-24T20:17:50.912423] [INFO ] [REMOTE    ] NUV: Incremental fetch complete for 2025-08 (1.16 seconds).
[2025-10-24T20:17:51.347628] [INFO ] [REMOTE    ] NUVB: Fetching primary data for 2025-06.
[2025-10-24T20:17:51.395312] [INFO ] [REMOTE    ] NUW: Incremental fetch complete for 2025-06 (0.85 seconds).
[2025-10-24T20:17:52.147701] [INFO ] [REMOTE    ] NUS: Fetching primary data for 2025-09.
[2025-10-24T20:17:52.947687] [INFO ] [REMOTE    ] NUW: Fetching primary data for 2025-07.
[2025-10-24T20:17:53.180198] [INFO ] [REMOTE    ] NUVB: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T20:17:53.643522] [INFO ] [REMOTE    ] NUW: Incremental fetch complete for 2025-07 (0.70 seconds).
[2025-10-24T20:17:53.667527] [INFO ] [REMOTE    ] NUS: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T20:17:53.747686] [INFO ] [REMOTE    ] NUW: Fetching primary data for 2025-08.
[2025-10-24T20:17:54.547622] [INFO ] [REMOTE    ] NUS: Fetching primary data for 2025-10.
[2025-10-24T20:17:55.304181] [INFO ] [REMOTE    ] NUW: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T20:17:55.347621] [INFO ] [REMOTE    ] NUV: Fetching primary data for 2025-09.
[2025-10-24T20:17:56.056555] [INFO ] [REMOTE    ] NUS: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T20:17:56.063345] [INFO ] [REMOTE    ] NUS: Full fetch complete (53026 records).
[2025-10-24T20:17:56.063506] [DEBUG] [VALIDATOR ] NUS: Validating primary data.
[2025-10-24T20:17:56.152731] [INFO ] [REMOTE    ] NUW: Fetching primary data for 2025-09.
[2025-10-24T20:17:56.491154] [INFO ] [REMOTE    ] NUV: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T20:17:56.491676] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present.
[2025-10-24T20:17:56.491750] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed.
[2025-10-24T20:17:56.497922] [INFO ] [MAIN      ] NUS: Fetched primary data is valid.
[2025-10-24T20:17:56.498002] [DEBUG] [LOCAL     ] NUS: Saving primary data.
[2025-10-24T20:17:56.498929] [FATAL] [LOCAL     ] NUS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:17:56.499014] [FATAL] [MAIN      ] NUS: Failed to save primary data.
[2025-10-24T20:17:56.499057] [WARN ] [MAIN      ] NUS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:17:56.499093] [INFO ] [LOCAL     ] NUS: Starting deletion of primary data.
[2025-10-24T20:17:56.499157] [DEBUG] [LOCAL     ] NUS: No primary data file found to delete.
[2025-10-24T20:17:56.499223] [INFO ] [LOCAL     ] NUS: Starting deletion of derivative data.
[2025-10-24T20:17:56.499394] [DEBUG] [LOCAL     ] NUS: Deleted derivative data file.
[2025-10-24T20:17:56.499484] [INFO ] [MAIN      ] Update Progress: 1540/2366 symbols completed. NUS took 31.5s. Estimated remaining: 1h 46m 9s. Rate: 7.8 symbols/min
[2025-10-24T20:17:56.670412] [INFO ] [MAIN      ] NVG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:17:56.698192] [DEBUG] [LOCAL     ] NVG: Loaded 27531 existing records from primary storage.
[2025-10-24T20:17:56.698481] [INFO ] [MAIN      ] NVG: Loaded 27531 existing records.
[2025-10-24T20:17:56.876951] [WARN ] [MAIN      ] NVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:17:56.877162] [INFO ] [MAIN      ] NVG: Wiping existing primary data before full refresh.
[2025-10-24T20:17:56.877244] [INFO ] [LOCAL     ] NVG: Starting deletion of primary data.
[2025-10-24T20:17:56.877607] [DEBUG] [LOCAL     ] NVG: Deleted primary data file.
[2025-10-24T20:17:56.877695] [INFO ] [MAIN      ] NVG: Starting full primary refresh.
[2025-10-24T20:17:56.952856] [INFO ] [REMOTE    ] NUVB: Fetching primary data for 2025-07.
[2025-10-24T20:17:57.056362] [INFO ] [REMOTE    ] NUW: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T20:17:57.234980] [INFO ] [REMOTE    ] NVG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:17:57.747686] [INFO ] [REMOTE    ] NUW: Fetching primary data for 2025-10.
[2025-10-24T20:17:58.371126] [INFO ] [REMOTE    ] NUW: Incremental fetch complete for 2025-10 (0.62 seconds).
[2025-10-24T20:17:58.372350] [INFO ] [REMOTE    ] NUW: Full fetch complete (10658 records).
[2025-10-24T20:17:58.372419] [DEBUG] [VALIDATOR ] NUW: Validating primary data.
[2025-10-24T20:17:58.553124] [INFO ] [REMOTE    ] NUV: Fetching primary data for 2025-10.
[2025-10-24T20:17:58.760305] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present.
[2025-10-24T20:17:58.760376] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed.
[2025-10-24T20:17:58.760615] [INFO ] [MAIN      ] NUW: Fetched primary data is valid.
[2025-10-24T20:17:58.760798] [DEBUG] [LOCAL     ] NUW: Saving primary data.
[2025-10-24T20:17:58.761021] [FATAL] [LOCAL     ] NUW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:17:58.761099] [FATAL] [MAIN      ] NUW: Failed to save primary data.
[2025-10-24T20:17:58.761141] [WARN ] [MAIN      ] NUW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:17:58.761199] [INFO ] [LOCAL     ] NUW: Starting deletion of primary data.
[2025-10-24T20:17:58.761255] [DEBUG] [LOCAL     ] NUW: No primary data file found to delete.
[2025-10-24T20:17:58.761289] [INFO ] [LOCAL     ] NUW: Starting deletion of derivative data.
[2025-10-24T20:17:58.761426] [DEBUG] [LOCAL     ] NUW: Deleted derivative data file.
[2025-10-24T20:17:58.761494] [INFO ] [MAIN      ] Update Progress: 1541/2366 symbols completed. NUW took 24.0s. Estimated remaining: 1h 45m 58s. Rate: 7.8 symbols/min
[2025-10-24T20:17:58.948416] [INFO ] [MAIN      ] NVGS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:17:58.978930] [DEBUG] [LOCAL     ] NVGS: Loaded 30091 existing records from primary storage.
[2025-10-24T20:17:58.979180] [INFO ] [MAIN      ] NVGS: Loaded 30091 existing records.
[2025-10-24T20:17:59.187531] [WARN ] [MAIN      ] NVGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:17:59.188248] [INFO ] [MAIN      ] NVGS: Wiping existing primary data before full refresh.
[2025-10-24T20:17:59.190052] [INFO ] [REMOTE    ] NUVB: Incremental fetch complete for 2025-07 (2.24 seconds).
[2025-10-24T20:17:59.190135] [INFO ] [LOCAL     ] NVGS: Starting deletion of primary data.
[2025-10-24T20:17:59.201071] [DEBUG] [LOCAL     ] NVGS: Deleted primary data file.
[2025-10-24T20:17:59.201147] [INFO ] [MAIN      ] NVGS: Starting full primary refresh.
[2025-10-24T20:17:59.350336] [INFO ] [REMOTE    ] NVG: Fetching primary data for 2025-01.
[2025-10-24T20:17:59.554764] [INFO ] [REMOTE    ] NVGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:17:59.567784] [INFO ] [REMOTE    ] NUV: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T20:17:59.572785] [INFO ] [REMOTE    ] NUV: Full fetch complete (33807 records).
[2025-10-24T20:17:59.572886] [DEBUG] [VALIDATOR ] NUV: Validating primary data.
[2025-10-24T20:17:59.935949] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present.
[2025-10-24T20:17:59.936024] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed.
[2025-10-24T20:17:59.936739] [INFO ] [MAIN      ] NUV: Fetched primary data is valid.
[2025-10-24T20:17:59.936799] [DEBUG] [LOCAL     ] NUV: Saving primary data.
[2025-10-24T20:17:59.937117] [FATAL] [LOCAL     ] NUV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:17:59.937200] [FATAL] [MAIN      ] NUV: Failed to save primary data.
[2025-10-24T20:17:59.937241] [WARN ] [MAIN      ] NUV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:17:59.937321] [INFO ] [LOCAL     ] NUV: Starting deletion of primary data.
[2025-10-24T20:17:59.937388] [DEBUG] [LOCAL     ] NUV: No primary data file found to delete.
[2025-10-24T20:17:59.937429] [INFO ] [LOCAL     ] NUV: Starting deletion of derivative data.
[2025-10-24T20:17:59.937625] [DEBUG] [LOCAL     ] NUV: Deleted derivative data file.
[2025-10-24T20:17:59.937747] [INFO ] [MAIN      ] Update Progress: 1542/2366 symbols completed. NUV took 32.1s. Estimated remaining: 1h 45m 47s. Rate: 7.8 symbols/min
[2025-10-24T20:18:00.105017] [INFO ] [MAIN      ] NVO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:18:00.155380] [INFO ] [REMOTE    ] NUVB: Fetching primary data for 2025-08.
[2025-10-24T20:18:00.159312] [DEBUG] [LOCAL     ] NVO: Loaded 54174 existing records from primary storage.
[2025-10-24T20:18:00.159930] [INFO ] [MAIN      ] NVO: Loaded 54174 existing records.
[2025-10-24T20:18:00.344736] [WARN ] [MAIN      ] NVO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:18:00.344985] [INFO ] [MAIN      ] NVO: Wiping existing primary data before full refresh.
[2025-10-24T20:18:00.345039] [INFO ] [LOCAL     ] NVO: Starting deletion of primary data.
[2025-10-24T20:18:00.345285] [DEBUG] [LOCAL     ] NVO: Deleted primary data file.
[2025-10-24T20:18:00.345367] [INFO ] [MAIN      ] NVO: Starting full primary refresh.
[2025-10-24T20:18:00.696570] [INFO ] [REMOTE    ] NVO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:18:00.922821] [INFO ] [REMOTE    ] NVG: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T20:18:00.947600] [INFO ] [REMOTE    ] NVG: Fetching primary data for 2025-02.
[2025-10-24T20:18:01.747671] [INFO ] [REMOTE    ] NVGS: Fetching primary data for 2025-01.
[2025-10-24T20:18:02.250300] [INFO ] [REMOTE    ] NVG: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T20:18:02.414042] [INFO ] [REMOTE    ] NUVB: Incremental fetch complete for 2025-08 (2.26 seconds).
[2025-10-24T20:18:02.547671] [INFO ] [REMOTE    ] NUVB: Fetching primary data for 2025-09.
[2025-10-24T20:18:02.990336] [INFO ] [REMOTE    ] NVGS: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T20:18:03.347677] [INFO ] [REMOTE    ] NVO: Fetching primary data for 2025-01.
[2025-10-24T20:18:04.147709] [INFO ] [REMOTE    ] NVG: Fetching primary data for 2025-03.
[2025-10-24T20:18:04.746508] [INFO ] [REMOTE    ] NUVB: Incremental fetch complete for 2025-09 (2.20 seconds).
[2025-10-24T20:18:04.947681] [INFO ] [REMOTE    ] NVGS: Fetching primary data for 2025-02.
[2025-10-24T20:18:05.514837] [INFO ] [REMOTE    ] NVG: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T20:18:05.580230] [INFO ] [REMOTE    ] NVO: Incremental fetch complete for 2025-01 (2.23 seconds).
[2025-10-24T20:18:05.739306] [INFO ] [REMOTE    ] NVGS: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T20:18:05.747601] [INFO ] [REMOTE    ] NVGS: Fetching primary data for 2025-03.
[2025-10-24T20:18:06.547707] [INFO ] [REMOTE    ] NUVB: Fetching primary data for 2025-10.
[2025-10-24T20:18:07.227044] [INFO ] [REMOTE    ] NVGS: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T20:18:07.347736] [INFO ] [REMOTE    ] NVGS: Fetching primary data for 2025-04.
[2025-10-24T20:18:08.147705] [INFO ] [REMOTE    ] NVO: Fetching primary data for 2025-02.
[2025-10-24T20:18:08.720598] [INFO ] [REMOTE    ] NVGS: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T20:18:08.947630] [INFO ] [REMOTE    ] NVGS: Fetching primary data for 2025-05.
[2025-10-24T20:18:09.747726] [INFO ] [REMOTE    ] NVG: Fetching primary data for 2025-04.
[2025-10-24T20:18:10.362437] [INFO ] [REMOTE    ] NVGS: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T20:18:10.400694] [INFO ] [REMOTE    ] NVO: Incremental fetch complete for 2025-02 (2.25 seconds).
[2025-10-24T20:18:10.547613] [INFO ] [REMOTE    ] NVO: Fetching primary data for 2025-03.
[2025-10-24T20:18:10.910735] [INFO ] [REMOTE    ] NVG: Incremental fetch complete for 2025-04 (1.16 seconds).
[2025-10-24T20:18:11.007590] [INFO ] [REMOTE    ] NUVB: Incremental fetch complete for 2025-10 (4.46 seconds).
[2025-10-24T20:18:11.019203] [INFO ] [REMOTE    ] NUVB: Full fetch complete (73532 records).
[2025-10-24T20:18:11.019462] [DEBUG] [VALIDATOR ] NUVB: Validating primary data.
[2025-10-24T20:18:11.352036] [INFO ] [REMOTE    ] NVG: Fetching primary data for 2025-05.
[2025-10-24T20:18:11.405145] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present.
[2025-10-24T20:18:11.405242] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed.
[2025-10-24T20:18:11.406388] [INFO ] [MAIN      ] NUVB: Fetched primary data is valid.
[2025-10-24T20:18:11.406456] [DEBUG] [LOCAL     ] NUVB: Saving primary data.
[2025-10-24T20:18:11.407142] [FATAL] [LOCAL     ] NUVB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:18:11.407241] [FATAL] [MAIN      ] NUVB: Failed to save primary data.
[2025-10-24T20:18:11.407323] [WARN ] [MAIN      ] NUVB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:18:11.407392] [INFO ] [LOCAL     ] NUVB: Starting deletion of primary data.
[2025-10-24T20:18:11.407454] [DEBUG] [LOCAL     ] NUVB: No primary data file found to delete.
[2025-10-24T20:18:11.407491] [INFO ] [LOCAL     ] NUVB: Starting deletion of derivative data.
[2025-10-24T20:18:11.407742] [DEBUG] [LOCAL     ] NUVB: Deleted derivative data file.
[2025-10-24T20:18:11.408225] [INFO ] [MAIN      ] Update Progress: 1543/2366 symbols completed. NUVB took 39.3s. Estimated remaining: 1h 45m 41s. Rate: 7.8 symbols/min
[2025-10-24T20:18:11.573749] [INFO ] [MAIN      ] NVR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:18:11.594501] [DEBUG] [LOCAL     ] NVR: Loaded 18511 existing records from primary storage.
[2025-10-24T20:18:11.594782] [INFO ] [MAIN      ] NVR: Loaded 18511 existing records.
[2025-10-24T20:18:11.801689] [WARN ] [MAIN      ] NVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:18:11.802016] [INFO ] [MAIN      ] NVR: Wiping existing primary data before full refresh.
[2025-10-24T20:18:11.802067] [INFO ] [LOCAL     ] NVR: Starting deletion of primary data.
[2025-10-24T20:18:11.802289] [DEBUG] [LOCAL     ] NVR: Deleted primary data file.
[2025-10-24T20:18:11.802346] [INFO ] [MAIN      ] NVR: Starting full primary refresh.
[2025-10-24T20:18:12.148264] [INFO ] [REMOTE    ] NVGS: Fetching primary data for 2025-06.
[2025-10-24T20:18:12.148150] [INFO ] [REMOTE    ] NVR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:18:12.369210] [INFO ] [REMOTE    ] NVG: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T20:18:12.947615] [INFO ] [REMOTE    ] NVG: Fetching primary data for 2025-06.
[2025-10-24T20:18:13.052815] [INFO ] [REMOTE    ] NVO: Incremental fetch complete for 2025-03 (2.51 seconds).
[2025-10-24T20:18:13.365123] [INFO ] [REMOTE    ] NVGS: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T20:18:13.747636] [INFO ] [REMOTE    ] NVO: Fetching primary data for 2025-04.
[2025-10-24T20:18:14.185473] [INFO ] [REMOTE    ] NVG: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T20:18:14.547673] [INFO ] [REMOTE    ] NVG: Fetching primary data for 2025-07.
[2025-10-24T20:18:15.347674] [INFO ] [REMOTE    ] NVR: Fetching primary data for 2025-01.
[2025-10-24T20:18:15.947671] [INFO ] [REMOTE    ] NVG: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T20:18:16.130854] [INFO ] [REMOTE    ] NVO: Incremental fetch complete for 2025-04 (2.38 seconds).
[2025-10-24T20:18:16.147612] [INFO ] [REMOTE    ] NVO: Fetching primary data for 2025-05.
[2025-10-24T20:18:16.947782] [INFO ] [REMOTE    ] NVGS: Fetching primary data for 2025-07.
[2025-10-24T20:18:17.579059] [INFO ] [REMOTE    ] NVR: Incremental fetch complete for 2025-01 (2.23 seconds).
[2025-10-24T20:18:17.747685] [INFO ] [REMOTE    ] NVR: Fetching primary data for 2025-02.
[2025-10-24T20:18:18.424530] [INFO ] [REMOTE    ] NVGS: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T20:18:18.547605] [INFO ] [REMOTE    ] NVGS: Fetching primary data for 2025-08.
[2025-10-24T20:18:18.927492] [INFO ] [REMOTE    ] NVO: Incremental fetch complete for 2025-05 (2.78 seconds).
[2025-10-24T20:18:18.973832] [INFO ] [REMOTE    ] NVR: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T20:18:19.347682] [INFO ] [REMOTE    ] NVR: Fetching primary data for 2025-03.
[2025-10-24T20:18:19.982330] [INFO ] [REMOTE    ] NVGS: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T20:18:20.147737] [INFO ] [REMOTE    ] NVG: Fetching primary data for 2025-08.
[2025-10-24T20:18:20.608983] [INFO ] [REMOTE    ] NVR: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T20:18:20.947670] [INFO ] [REMOTE    ] NVO: Fetching primary data for 2025-06.
[2025-10-24T20:18:21.389254] [INFO ] [REMOTE    ] NVG: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T20:18:21.747638] [INFO ] [REMOTE    ] NVGS: Fetching primary data for 2025-09.
[2025-10-24T20:18:22.547628] [INFO ] [REMOTE    ] NVR: Fetching primary data for 2025-04.
[2025-10-24T20:18:22.931459] [INFO ] [REMOTE    ] NVGS: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T20:18:23.347623] [INFO ] [REMOTE    ] NVGS: Fetching primary data for 2025-10.
[2025-10-24T20:18:23.438957] [INFO ] [REMOTE    ] NVO: Incremental fetch complete for 2025-06 (2.49 seconds).
[2025-10-24T20:18:24.147678] [INFO ] [REMOTE    ] NVO: Fetching primary data for 2025-07.
[2025-10-24T20:18:24.568318] [INFO ] [REMOTE    ] NVGS: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T20:18:24.573152] [INFO ] [REMOTE    ] NVGS: Full fetch complete (41890 records).
[2025-10-24T20:18:24.573252] [DEBUG] [VALIDATOR ] NVGS: Validating primary data.
[2025-10-24T20:18:24.688245] [INFO ] [REMOTE    ] NVR: Incremental fetch complete for 2025-04 (2.14 seconds).
[2025-10-24T20:18:24.954951] [INFO ] [REMOTE    ] NVG: Fetching primary data for 2025-09.
[2025-10-24T20:18:24.971237] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present.
[2025-10-24T20:18:24.971314] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed.
[2025-10-24T20:18:24.972169] [INFO ] [MAIN      ] NVGS: Fetched primary data is valid.
[2025-10-24T20:18:24.972320] [DEBUG] [LOCAL     ] NVGS: Saving primary data.
[2025-10-24T20:18:24.972842] [FATAL] [LOCAL     ] NVGS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:18:24.972926] [FATAL] [MAIN      ] NVGS: Failed to save primary data.
[2025-10-24T20:18:24.972989] [WARN ] [MAIN      ] NVGS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:18:24.973057] [INFO ] [LOCAL     ] NVGS: Starting deletion of primary data.
[2025-10-24T20:18:24.973113] [DEBUG] [LOCAL     ] NVGS: No primary data file found to delete.
[2025-10-24T20:18:24.973149] [INFO ] [LOCAL     ] NVGS: Starting deletion of derivative data.
[2025-10-24T20:18:24.973289] [DEBUG] [LOCAL     ] NVGS: Deleted derivative data file.
[2025-10-24T20:18:24.973379] [INFO ] [MAIN      ] Update Progress: 1544/2366 symbols completed. NVGS took 26.2s. Estimated remaining: 1h 45m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:18:25.143739] [INFO ] [MAIN      ] NVRI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:18:25.179754] [DEBUG] [LOCAL     ] NVRI: Loaded 39257 existing records from primary storage.
[2025-10-24T20:18:25.180026] [INFO ] [MAIN      ] NVRI: Loaded 39257 existing records.
[2025-10-24T20:18:25.354889] [WARN ] [MAIN      ] NVRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:18:25.355111] [INFO ] [MAIN      ] NVRI: Wiping existing primary data before full refresh.
[2025-10-24T20:18:25.355156] [INFO ] [LOCAL     ] NVRI: Starting deletion of primary data.
[2025-10-24T20:18:25.355364] [DEBUG] [LOCAL     ] NVRI: Deleted primary data file.
[2025-10-24T20:18:25.355432] [INFO ] [MAIN      ] NVRI: Starting full primary refresh.
[2025-10-24T20:18:25.709337] [INFO ] [REMOTE    ] NVRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:18:25.747609] [INFO ] [REMOTE    ] NVRI: Fetching primary data for 2025-01.
[2025-10-24T20:18:26.384254] [INFO ] [REMOTE    ] NVG: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T20:18:26.547661] [INFO ] [REMOTE    ] NVG: Fetching primary data for 2025-10.
[2025-10-24T20:18:26.743414] [INFO ] [REMOTE    ] NVO: Incremental fetch complete for 2025-07 (2.60 seconds).
[2025-10-24T20:18:27.347616] [INFO ] [REMOTE    ] NVR: Fetching primary data for 2025-05.
[2025-10-24T20:18:27.373464] [INFO ] [REMOTE    ] NVRI: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T20:18:27.783925] [INFO ] [REMOTE    ] NVG: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T20:18:27.788771] [INFO ] [REMOTE    ] NVG: Full fetch complete (39309 records).
[2025-10-24T20:18:27.788887] [DEBUG] [VALIDATOR ] NVG: Validating primary data.
[2025-10-24T20:18:28.153358] [INFO ] [REMOTE    ] NVRI: Fetching primary data for 2025-02.
[2025-10-24T20:18:28.168848] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present.
[2025-10-24T20:18:28.168975] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed.
[2025-10-24T20:18:28.169887] [INFO ] [MAIN      ] NVG: Fetched primary data is valid.
[2025-10-24T20:18:28.169949] [DEBUG] [LOCAL     ] NVG: Saving primary data.
[2025-10-24T20:18:28.170383] [FATAL] [LOCAL     ] NVG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:18:28.170465] [FATAL] [MAIN      ] NVG: Failed to save primary data.
[2025-10-24T20:18:28.170532] [WARN ] [MAIN      ] NVG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:18:28.170665] [INFO ] [LOCAL     ] NVG: Starting deletion of primary data.
[2025-10-24T20:18:28.170740] [DEBUG] [LOCAL     ] NVG: No primary data file found to delete.
[2025-10-24T20:18:28.170779] [INFO ] [LOCAL     ] NVG: Starting deletion of derivative data.
[2025-10-24T20:18:28.170955] [DEBUG] [LOCAL     ] NVG: Deleted derivative data file.
[2025-10-24T20:18:28.171048] [INFO ] [MAIN      ] Update Progress: 1545/2366 symbols completed. NVG took 31.7s. Estimated remaining: 1h 45m 26s. Rate: 7.8 symbols/min
[2025-10-24T20:18:28.345740] [INFO ] [MAIN      ] NVS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:18:28.395872] [DEBUG] [LOCAL     ] NVS: Loaded 51660 existing records from primary storage.
[2025-10-24T20:18:28.396183] [INFO ] [MAIN      ] NVS: Loaded 51660 existing records.
[2025-10-24T20:18:28.581936] [WARN ] [MAIN      ] NVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:18:28.587480] [INFO ] [MAIN      ] NVS: Wiping existing primary data before full refresh.
[2025-10-24T20:18:28.593689] [INFO ] [LOCAL     ] NVS: Starting deletion of primary data.
[2025-10-24T20:18:28.594328] [DEBUG] [LOCAL     ] NVS: Deleted primary data file.
[2025-10-24T20:18:28.594391] [INFO ] [MAIN      ] NVS: Starting full primary refresh.
[2025-10-24T20:18:28.594929] [INFO ] [REMOTE    ] NVR: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T20:18:28.953107] [INFO ] [REMOTE    ] NVO: Fetching primary data for 2025-08.
[2025-10-24T20:18:28.957784] [INFO ] [REMOTE    ] NVS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:18:29.208707] [INFO ] [REMOTE    ] NVRI: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T20:18:29.747682] [INFO ] [REMOTE    ] NVRI: Fetching primary data for 2025-03.
[2025-10-24T20:18:30.547682] [INFO ] [REMOTE    ] NVS: Fetching primary data for 2025-01.
[2025-10-24T20:18:31.329134] [INFO ] [REMOTE    ] NVRI: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T20:18:31.347606] [INFO ] [REMOTE    ] NVRI: Fetching primary data for 2025-04.
[2025-10-24T20:18:31.534963] [INFO ] [REMOTE    ] NVO: Incremental fetch complete for 2025-08 (2.58 seconds).
[2025-10-24T20:18:32.147635] [INFO ] [REMOTE    ] NVR: Fetching primary data for 2025-06.
[2025-10-24T20:18:32.440026] [INFO ] [REMOTE    ] NVS: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T20:18:32.895358] [INFO ] [REMOTE    ] NVRI: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T20:18:32.947702] [INFO ] [REMOTE    ] NVS: Fetching primary data for 2025-02.
[2025-10-24T20:18:33.409315] [INFO ] [REMOTE    ] NVR: Incremental fetch complete for 2025-06 (1.26 seconds).
[2025-10-24T20:18:33.747734] [INFO ] [REMOTE    ] NVO: Fetching primary data for 2025-09.
[2025-10-24T20:18:34.547637] [INFO ] [REMOTE    ] NVRI: Fetching primary data for 2025-05.
[2025-10-24T20:18:34.829923] [INFO ] [REMOTE    ] NVS: Incremental fetch complete for 2025-02 (1.88 seconds).
[2025-10-24T20:18:35.347701] [INFO ] [REMOTE    ] NVS: Fetching primary data for 2025-03.
[2025-10-24T20:18:36.072907] [INFO ] [REMOTE    ] NVO: Incremental fetch complete for 2025-09 (2.33 seconds).
[2025-10-24T20:18:36.122488] [INFO ] [REMOTE    ] NVRI: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T20:18:36.147727] [INFO ] [REMOTE    ] NVR: Fetching primary data for 2025-07.
[2025-10-24T20:18:36.947759] [INFO ] [REMOTE    ] NVRI: Fetching primary data for 2025-06.
[2025-10-24T20:18:37.383209] [INFO ] [REMOTE    ] NVR: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T20:18:37.747678] [INFO ] [REMOTE    ] NVO: Fetching primary data for 2025-10.
[2025-10-24T20:18:38.432952] [INFO ] [REMOTE    ] NVS: Incremental fetch complete for 2025-03 (3.09 seconds).
[2025-10-24T20:18:38.547612] [INFO ] [REMOTE    ] NVS: Fetching primary data for 2025-04.
[2025-10-24T20:18:39.296680] [INFO ] [REMOTE    ] NVRI: Incremental fetch complete for 2025-06 (2.35 seconds).
[2025-10-24T20:18:39.347671] [INFO ] [REMOTE    ] NVRI: Fetching primary data for 2025-07.
[2025-10-24T20:18:40.147692] [INFO ] [REMOTE    ] NVR: Fetching primary data for 2025-08.
[2025-10-24T20:18:40.216331] [INFO ] [REMOTE    ] NVO: Incremental fetch complete for 2025-10 (2.47 seconds).
[2025-10-24T20:18:40.226132] [INFO ] [REMOTE    ] NVO: Full fetch complete (77964 records).
[2025-10-24T20:18:40.226276] [DEBUG] [VALIDATOR ] NVO: Validating primary data.
[2025-10-24T20:18:40.553946] [INFO ] [REMOTE    ] NVRI: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T20:18:40.659628] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present.
[2025-10-24T20:18:40.659761] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed.
[2025-10-24T20:18:40.660907] [INFO ] [MAIN      ] NVO: Fetched primary data is valid.
[2025-10-24T20:18:40.661083] [DEBUG] [LOCAL     ] NVO: Saving primary data.
[2025-10-24T20:18:40.661775] [FATAL] [LOCAL     ] NVO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:18:40.661934] [FATAL] [MAIN      ] NVO: Failed to save primary data.
[2025-10-24T20:18:40.662061] [WARN ] [MAIN      ] NVO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:18:40.662222] [INFO ] [LOCAL     ] NVO: Starting deletion of primary data.
[2025-10-24T20:18:40.662329] [DEBUG] [LOCAL     ] NVO: No primary data file found to delete.
[2025-10-24T20:18:40.662408] [INFO ] [LOCAL     ] NVO: Starting deletion of derivative data.
[2025-10-24T20:18:40.662768] [DEBUG] [LOCAL     ] NVO: Deleted derivative data file.
[2025-10-24T20:18:40.663113] [INFO ] [MAIN      ] Update Progress: 1546/2366 symbols completed. NVO took 40.7s. Estimated remaining: 1h 45m 21s. Rate: 7.8 symbols/min
[2025-10-24T20:18:40.820727] [INFO ] [REMOTE    ] NVS: Incremental fetch complete for 2025-04 (2.27 seconds).
[2025-10-24T20:18:40.893753] [INFO ] [MAIN      ] NVST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:18:40.948623] [DEBUG] [LOCAL     ] NVST: Loaded 51815 existing records from primary storage.
[2025-10-24T20:18:40.948741] [INFO ] [REMOTE    ] NVS: Fetching primary data for 2025-05.
[2025-10-24T20:18:40.950022] [INFO ] [MAIN      ] NVST: Loaded 51815 existing records.
[2025-10-24T20:18:41.142542] [WARN ] [MAIN      ] NVST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:18:41.142760] [INFO ] [MAIN      ] NVST: Wiping existing primary data before full refresh.
[2025-10-24T20:18:41.142810] [INFO ] [LOCAL     ] NVST: Starting deletion of primary data.
[2025-10-24T20:18:41.143278] [DEBUG] [LOCAL     ] NVST: Deleted primary data file.
[2025-10-24T20:18:41.143334] [INFO ] [MAIN      ] NVST: Starting full primary refresh.
[2025-10-24T20:18:41.375351] [INFO ] [REMOTE    ] NVR: Incremental fetch complete for 2025-08 (1.23 seconds).
[2025-10-24T20:18:41.509250] [INFO ] [REMOTE    ] NVST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:18:41.747632] [INFO ] [REMOTE    ] NVRI: Fetching primary data for 2025-08.
[2025-10-24T20:18:42.547694] [INFO ] [REMOTE    ] NVR: Fetching primary data for 2025-09.
[2025-10-24T20:18:43.004404] [INFO ] [REMOTE    ] NVS: Incremental fetch complete for 2025-05 (2.06 seconds).
[2025-10-24T20:18:43.228787] [INFO ] [REMOTE    ] NVRI: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T20:18:43.347610] [INFO ] [REMOTE    ] NVST: Fetching primary data for 2025-01.
[2025-10-24T20:18:43.769545] [INFO ] [REMOTE    ] NVR: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T20:18:44.147636] [INFO ] [REMOTE    ] NVR: Fetching primary data for 2025-10.
[2025-10-24T20:18:44.947615] [INFO ] [REMOTE    ] NVS: Fetching primary data for 2025-06.
[2025-10-24T20:18:45.341833] [INFO ] [REMOTE    ] NVR: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T20:18:45.346166] [INFO ] [REMOTE    ] NVR: Full fetch complete (29060 records).
[2025-10-24T20:18:45.346260] [DEBUG] [VALIDATOR ] NVR: Validating primary data.
[2025-10-24T20:18:45.726173] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present.
[2025-10-24T20:18:45.726402] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed.
[2025-10-24T20:18:45.727042] [INFO ] [MAIN      ] NVR: Fetched primary data is valid.
[2025-10-24T20:18:45.727104] [DEBUG] [LOCAL     ] NVR: Saving primary data.
[2025-10-24T20:18:45.727442] [FATAL] [LOCAL     ] NVR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:18:45.727522] [FATAL] [MAIN      ] NVR: Failed to save primary data.
[2025-10-24T20:18:45.727564] [WARN ] [MAIN      ] NVR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:18:45.727605] [INFO ] [LOCAL     ] NVR: Starting deletion of primary data.
[2025-10-24T20:18:45.727682] [DEBUG] [LOCAL     ] NVR: No primary data file found to delete.
[2025-10-24T20:18:45.727736] [INFO ] [LOCAL     ] NVR: Starting deletion of derivative data.
[2025-10-24T20:18:45.727901] [DEBUG] [LOCAL     ] NVR: Deleted derivative data file.
[2025-10-24T20:18:45.728003] [INFO ] [MAIN      ] Update Progress: 1547/2366 symbols completed. NVR took 34.3s. Estimated remaining: 1h 45m 12s. Rate: 7.8 symbols/min
[2025-10-24T20:18:45.759612] [INFO ] [REMOTE    ] NVRI: Fetching primary data for 2025-09.
[2025-10-24T20:18:45.914638] [INFO ] [MAIN      ] NVT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:18:45.963770] [DEBUG] [LOCAL     ] NVT: Loaded 51798 existing records from primary storage.
[2025-10-24T20:18:45.964098] [INFO ] [MAIN      ] NVT: Loaded 51798 existing records.
[2025-10-24T20:18:46.144685] [WARN ] [MAIN      ] NVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:18:46.144877] [INFO ] [MAIN      ] NVT: Wiping existing primary data before full refresh.
[2025-10-24T20:18:46.144924] [INFO ] [LOCAL     ] NVT: Starting deletion of primary data.
[2025-10-24T20:18:46.145124] [DEBUG] [LOCAL     ] NVT: Deleted primary data file.
[2025-10-24T20:18:46.145165] [INFO ] [MAIN      ] NVT: Starting full primary refresh.
[2025-10-24T20:18:46.290123] [INFO ] [REMOTE    ] NVST: Incremental fetch complete for 2025-01 (2.94 seconds).
[2025-10-24T20:18:46.549403] [INFO ] [REMOTE    ] NVST: Fetching primary data for 2025-02.
[2025-10-24T20:18:46.571954] [INFO ] [REMOTE    ] NVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:18:46.753156] [INFO ] [REMOTE    ] NVS: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T20:18:47.347728] [INFO ] [REMOTE    ] NVT: Fetching primary data for 2025-01.
[2025-10-24T20:18:47.536412] [INFO ] [REMOTE    ] NVRI: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T20:18:48.147667] [INFO ] [REMOTE    ] NVS: Fetching primary data for 2025-07.
[2025-10-24T20:18:48.340547] [INFO ] [REMOTE    ] NVST: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T20:18:48.947718] [INFO ] [REMOTE    ] NVST: Fetching primary data for 2025-03.
[2025-10-24T20:18:49.115802] [INFO ] [REMOTE    ] NVT: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T20:18:49.747691] [INFO ] [REMOTE    ] NVRI: Fetching primary data for 2025-10.
[2025-10-24T20:18:50.440298] [INFO ] [REMOTE    ] NVS: Incremental fetch complete for 2025-07 (2.29 seconds).
[2025-10-24T20:18:50.547629] [INFO ] [REMOTE    ] NVS: Fetching primary data for 2025-08.
[2025-10-24T20:18:50.903410] [INFO ] [REMOTE    ] NVST: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T20:18:51.258107] [INFO ] [REMOTE    ] NVRI: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T20:18:51.266156] [INFO ] [REMOTE    ] NVRI: Full fetch complete (55957 records).
[2025-10-24T20:18:51.266311] [DEBUG] [VALIDATOR ] NVRI: Validating primary data.
[2025-10-24T20:18:51.357816] [INFO ] [REMOTE    ] NVT: Fetching primary data for 2025-02.
[2025-10-24T20:18:51.662185] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present.
[2025-10-24T20:18:51.662286] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed.
[2025-10-24T20:18:51.663353] [INFO ] [MAIN      ] NVRI: Fetched primary data is valid.
[2025-10-24T20:18:51.663420] [DEBUG] [LOCAL     ] NVRI: Saving primary data.
[2025-10-24T20:18:51.664002] [FATAL] [LOCAL     ] NVRI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:18:51.664103] [FATAL] [MAIN      ] NVRI: Failed to save primary data.
[2025-10-24T20:18:51.664148] [WARN ] [MAIN      ] NVRI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:18:51.664219] [INFO ] [LOCAL     ] NVRI: Starting deletion of primary data.
[2025-10-24T20:18:51.664282] [DEBUG] [LOCAL     ] NVRI: No primary data file found to delete.
[2025-10-24T20:18:51.664321] [INFO ] [LOCAL     ] NVRI: Starting deletion of derivative data.
[2025-10-24T20:18:51.664506] [DEBUG] [LOCAL     ] NVRI: Deleted derivative data file.
[2025-10-24T20:18:51.664623] [INFO ] [MAIN      ] Update Progress: 1548/2366 symbols completed. NVRI took 26.7s. Estimated remaining: 1h 45m 3s. Rate: 7.8 symbols/min
[2025-10-24T20:18:51.887018] [INFO ] [MAIN      ] NWG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:18:51.941961] [DEBUG] [LOCAL     ] NWG: Loaded 51774 existing records from primary storage.
[2025-10-24T20:18:51.942375] [INFO ] [MAIN      ] NWG: Loaded 51774 existing records.
[2025-10-24T20:18:52.129022] [WARN ] [MAIN      ] NWG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:18:52.129227] [INFO ] [MAIN      ] NWG: Wiping existing primary data before full refresh.
[2025-10-24T20:18:52.129273] [INFO ] [LOCAL     ] NWG: Starting deletion of primary data.
[2025-10-24T20:18:52.129801] [DEBUG] [LOCAL     ] NWG: Deleted primary data file.
[2025-10-24T20:18:52.129858] [INFO ] [MAIN      ] NWG: Starting full primary refresh.
[2025-10-24T20:18:52.152727] [INFO ] [REMOTE    ] NVST: Fetching primary data for 2025-04.
[2025-10-24T20:18:52.508249] [INFO ] [REMOTE    ] NWG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:18:52.541412] [INFO ] [REMOTE    ] NVS: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T20:18:52.947611] [INFO ] [REMOTE    ] NVS: Fetching primary data for 2025-09.
[2025-10-24T20:18:53.111148] [INFO ] [REMOTE    ] NVT: Incremental fetch complete for 2025-02 (1.75 seconds).
[2025-10-24T20:18:53.661820] [INFO ] [REMOTE    ] NVST: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T20:18:53.747742] [INFO ] [REMOTE    ] NVST: Fetching primary data for 2025-05.
[2025-10-24T20:18:54.530771] [INFO ] [REMOTE    ] NVS: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T20:18:54.547606] [INFO ] [REMOTE    ] NWG: Fetching primary data for 2025-01.
[2025-10-24T20:18:55.347674] [INFO ] [REMOTE    ] NVS: Fetching primary data for 2025-10.
[2025-10-24T20:18:55.418393] [INFO ] [REMOTE    ] NVST: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T20:18:55.941598] [INFO ] [REMOTE    ] NWG: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T20:18:56.147635] [INFO ] [REMOTE    ] NWG: Fetching primary data for 2025-02.
[2025-10-24T20:18:56.947628] [INFO ] [REMOTE    ] NVT: Fetching primary data for 2025-03.
[2025-10-24T20:18:57.300106] [INFO ] [REMOTE    ] NVS: Incremental fetch complete for 2025-10 (1.95 seconds).
[2025-10-24T20:18:57.309602] [INFO ] [REMOTE    ] NVS: Full fetch complete (74959 records).
[2025-10-24T20:18:57.309809] [DEBUG] [VALIDATOR ] NVS: Validating primary data.
[2025-10-24T20:18:57.705006] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present.
[2025-10-24T20:18:57.705334] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed.
[2025-10-24T20:18:57.706525] [INFO ] [MAIN      ] NVS: Fetched primary data is valid.
[2025-10-24T20:18:57.706591] [DEBUG] [LOCAL     ] NVS: Saving primary data.
[2025-10-24T20:18:57.707731] [FATAL] [LOCAL     ] NVS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:18:57.707922] [FATAL] [MAIN      ] NVS: Failed to save primary data.
[2025-10-24T20:18:57.708004] [WARN ] [MAIN      ] NVS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:18:57.708087] [INFO ] [LOCAL     ] NVS: Starting deletion of primary data.
[2025-10-24T20:18:57.708200] [DEBUG] [LOCAL     ] NVS: No primary data file found to delete.
[2025-10-24T20:18:57.708259] [INFO ] [LOCAL     ] NVS: Starting deletion of derivative data.
[2025-10-24T20:18:57.709101] [DEBUG] [LOCAL     ] NVS: Deleted derivative data file.
[2025-10-24T20:18:57.709983] [INFO ] [MAIN      ] Update Progress: 1549/2366 symbols completed. NVS took 29.5s. Estimated remaining: 1h 44m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:18:57.754731] [INFO ] [REMOTE    ] NVST: Fetching primary data for 2025-06.
[2025-10-24T20:18:57.903347] [INFO ] [MAIN      ] NWN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:18:57.933269] [DEBUG] [LOCAL     ] NWN: Loaded 26582 existing records from primary storage.
[2025-10-24T20:18:57.933554] [INFO ] [MAIN      ] NWN: Loaded 26582 existing records.
[2025-10-24T20:18:58.130314] [WARN ] [MAIN      ] NWN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:18:58.130608] [INFO ] [MAIN      ] NWN: Wiping existing primary data before full refresh.
[2025-10-24T20:18:58.130696] [INFO ] [LOCAL     ] NWN: Starting deletion of primary data.
[2025-10-24T20:18:58.130951] [DEBUG] [LOCAL     ] NWN: Deleted primary data file.
[2025-10-24T20:18:58.130997] [INFO ] [MAIN      ] NWN: Starting full primary refresh.
[2025-10-24T20:18:58.488541] [INFO ] [REMOTE    ] NWN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:18:58.547594] [INFO ] [REMOTE    ] NWN: Fetching primary data for 2025-01.
[2025-10-24T20:18:58.725939] [INFO ] [REMOTE    ] NWG: Incremental fetch complete for 2025-02 (2.58 seconds).
[2025-10-24T20:18:58.764304] [INFO ] [REMOTE    ] NVT: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T20:18:59.347690] [INFO ] [REMOTE    ] NVT: Fetching primary data for 2025-04.
[2025-10-24T20:18:59.836623] [INFO ] [REMOTE    ] NWN: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T20:19:00.147621] [INFO ] [REMOTE    ] NWN: Fetching primary data for 2025-02.
[2025-10-24T20:19:00.622902] [INFO ] [REMOTE    ] NVST: Incremental fetch complete for 2025-06 (2.87 seconds).
[2025-10-24T20:19:00.947710] [INFO ] [REMOTE    ] NWG: Fetching primary data for 2025-03.
[2025-10-24T20:19:01.000014] [INFO ] [REMOTE    ] NVT: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T20:19:01.427485] [INFO ] [REMOTE    ] NWN: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T20:19:01.747666] [INFO ] [REMOTE    ] NVST: Fetching primary data for 2025-07.
[2025-10-24T20:19:02.547694] [INFO ] [REMOTE    ] NVT: Fetching primary data for 2025-05.
[2025-10-24T20:19:02.841551] [INFO ] [REMOTE    ] NWG: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T20:19:03.347623] [INFO ] [REMOTE    ] NWN: Fetching primary data for 2025-03.
[2025-10-24T20:19:03.454628] [INFO ] [REMOTE    ] NVST: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T20:19:04.039785] [INFO ] [REMOTE    ] NVT: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T20:19:04.147689] [INFO ] [REMOTE    ] NVST: Fetching primary data for 2025-08.
[2025-10-24T20:19:04.619983] [INFO ] [REMOTE    ] NWN: Incremental fetch complete for 2025-03 (1.27 seconds).
[2025-10-24T20:19:04.947711] [INFO ] [REMOTE    ] NVT: Fetching primary data for 2025-06.
[2025-10-24T20:19:05.747688] [INFO ] [REMOTE    ] NWG: Fetching primary data for 2025-04.
[2025-10-24T20:19:05.841590] [INFO ] [REMOTE    ] NVST: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T20:19:06.549425] [INFO ] [REMOTE    ] NWN: Fetching primary data for 2025-04.
[2025-10-24T20:19:06.556397] [INFO ] [REMOTE    ] NVT: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T20:19:07.347678] [INFO ] [REMOTE    ] NVT: Fetching primary data for 2025-07.
[2025-10-24T20:19:07.939243] [INFO ] [REMOTE    ] NWG: Incremental fetch complete for 2025-04 (2.19 seconds).
[2025-10-24T20:19:08.147688] [INFO ] [REMOTE    ] NWG: Fetching primary data for 2025-05.
[2025-10-24T20:19:08.423169] [INFO ] [REMOTE    ] NWN: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T20:19:08.947739] [INFO ] [REMOTE    ] NVST: Fetching primary data for 2025-09.
[2025-10-24T20:19:09.258863] [INFO ] [REMOTE    ] NVT: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T20:19:09.747637] [INFO ] [REMOTE    ] NVT: Fetching primary data for 2025-08.
[2025-10-24T20:19:10.009927] [INFO ] [REMOTE    ] NWG: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T20:19:10.547682] [INFO ] [REMOTE    ] NWG: Fetching primary data for 2025-06.
[2025-10-24T20:19:11.347671] [INFO ] [REMOTE    ] NWN: Fetching primary data for 2025-05.
[2025-10-24T20:19:11.380026] [INFO ] [REMOTE    ] NVT: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T20:19:11.486861] [INFO ] [REMOTE    ] NVST: Incremental fetch complete for 2025-09 (2.54 seconds).
[2025-10-24T20:19:12.147714] [INFO ] [REMOTE    ] NVT: Fetching primary data for 2025-09.
[2025-10-24T20:19:12.476256] [INFO ] [REMOTE    ] NWG: Incremental fetch complete for 2025-06 (1.93 seconds).
[2025-10-24T20:19:12.649127] [INFO ] [REMOTE    ] NWN: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T20:19:12.947764] [INFO ] [REMOTE    ] NWG: Fetching primary data for 2025-07.
[2025-10-24T20:19:13.747710] [INFO ] [REMOTE    ] NWN: Fetching primary data for 2025-06.
[2025-10-24T20:19:13.986790] [INFO ] [REMOTE    ] NVT: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T20:19:14.481415] [INFO ] [REMOTE    ] NWG: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T20:19:14.547619] [INFO ] [REMOTE    ] NWG: Fetching primary data for 2025-08.
[2025-10-24T20:19:14.892536] [INFO ] [REMOTE    ] NWN: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T20:19:15.347722] [INFO ] [REMOTE    ] NVT: Fetching primary data for 2025-10.
[2025-10-24T20:19:16.147618] [INFO ] [REMOTE    ] NWN: Fetching primary data for 2025-07.
[2025-10-24T20:19:16.361069] [INFO ] [REMOTE    ] NWG: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T20:19:16.947743] [INFO ] [REMOTE    ] NWG: Fetching primary data for 2025-09.
[2025-10-24T20:19:17.097904] [INFO ] [REMOTE    ] NVT: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T20:19:17.108567] [INFO ] [REMOTE    ] NVT: Full fetch complete (74890 records).
[2025-10-24T20:19:17.108866] [DEBUG] [VALIDATOR ] NVT: Validating primary data.
[2025-10-24T20:19:17.537778] [INFO ] [REMOTE    ] NWN: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T20:19:17.588162] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present.
[2025-10-24T20:19:17.588329] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed.
[2025-10-24T20:19:17.590475] [INFO ] [MAIN      ] NVT: Fetched primary data is valid.
[2025-10-24T20:19:17.590558] [DEBUG] [LOCAL     ] NVT: Saving primary data.
[2025-10-24T20:19:17.591708] [FATAL] [LOCAL     ] NVT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:19:17.591834] [FATAL] [MAIN      ] NVT: Failed to save primary data.
[2025-10-24T20:19:17.591908] [WARN ] [MAIN      ] NVT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:19:17.591983] [INFO ] [LOCAL     ] NVT: Starting deletion of primary data.
[2025-10-24T20:19:17.592063] [DEBUG] [LOCAL     ] NVT: No primary data file found to delete.
[2025-10-24T20:19:17.592104] [INFO ] [LOCAL     ] NVT: Starting deletion of derivative data.
[2025-10-24T20:19:17.592311] [DEBUG] [LOCAL     ] NVT: Deleted derivative data file.
[2025-10-24T20:19:17.592865] [INFO ] [MAIN      ] Update Progress: 1550/2366 symbols completed. NVT took 31.9s. Estimated remaining: 1h 44m 54s. Rate: 7.8 symbols/min
[2025-10-24T20:19:17.752753] [INFO ] [REMOTE    ] NVST: Fetching primary data for 2025-10.
[2025-10-24T20:19:17.777748] [INFO ] [MAIN      ] NX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:19:17.818767] [DEBUG] [LOCAL     ] NX: Loaded 33545 existing records from primary storage.
[2025-10-24T20:19:17.819169] [INFO ] [MAIN      ] NX: Loaded 33545 existing records.
[2025-10-24T20:19:18.004922] [WARN ] [MAIN      ] NX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:19:18.005257] [INFO ] [MAIN      ] NX: Wiping existing primary data before full refresh.
[2025-10-24T20:19:18.005312] [INFO ] [LOCAL     ] NX: Starting deletion of primary data.
[2025-10-24T20:19:18.005797] [DEBUG] [LOCAL     ] NX: Deleted primary data file.
[2025-10-24T20:19:18.005856] [INFO ] [MAIN      ] NX: Starting full primary refresh.
[2025-10-24T20:19:18.396919] [INFO ] [REMOTE    ] NX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:19:18.548203] [INFO ] [REMOTE    ] NX: Fetching primary data for 2025-01.
[2025-10-24T20:19:18.550902] [INFO ] [REMOTE    ] NWG: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T20:19:19.347605] [INFO ] [REMOTE    ] NWN: Fetching primary data for 2025-08.
[2025-10-24T20:19:19.469299] [INFO ] [REMOTE    ] NVST: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T20:19:19.478937] [INFO ] [REMOTE    ] NVST: Full fetch complete (74437 records).
[2025-10-24T20:19:19.479108] [DEBUG] [VALIDATOR ] NVST: Validating primary data.
[2025-10-24T20:19:19.900636] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present.
[2025-10-24T20:19:19.900817] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed.
[2025-10-24T20:19:19.902038] [INFO ] [MAIN      ] NVST: Fetched primary data is valid.
[2025-10-24T20:19:19.902198] [DEBUG] [LOCAL     ] NVST: Saving primary data.
[2025-10-24T20:19:19.902932] [FATAL] [LOCAL     ] NVST: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:19:19.903045] [FATAL] [MAIN      ] NVST: Failed to save primary data.
[2025-10-24T20:19:19.903176] [WARN ] [MAIN      ] NVST: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:19:19.903261] [INFO ] [LOCAL     ] NVST: Starting deletion of primary data.
[2025-10-24T20:19:19.903347] [DEBUG] [LOCAL     ] NVST: No primary data file found to delete.
[2025-10-24T20:19:19.903391] [INFO ] [LOCAL     ] NVST: Starting deletion of derivative data.
[2025-10-24T20:19:19.903538] [DEBUG] [LOCAL     ] NVST: Deleted derivative data file.
[2025-10-24T20:19:19.903832] [INFO ] [MAIN      ] Update Progress: 1551/2366 symbols completed. NVST took 39.2s. Estimated remaining: 1h 44m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:19:20.045162] [INFO ] [REMOTE    ] NX: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T20:19:20.115577] [INFO ] [MAIN      ] NXC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:19:20.123072] [DEBUG] [LOCAL     ] NXC: Loaded 4096 existing records from primary storage.
[2025-10-24T20:19:20.123322] [INFO ] [MAIN      ] NXC: Loaded 4096 existing records.
[2025-10-24T20:19:20.154468] [INFO ] [REMOTE    ] NWG: Fetching primary data for 2025-10.
[2025-10-24T20:19:20.333074] [WARN ] [MAIN      ] NXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:19:20.333296] [INFO ] [MAIN      ] NXC: Wiping existing primary data before full refresh.
[2025-10-24T20:19:20.333343] [INFO ] [LOCAL     ] NXC: Starting deletion of primary data.
[2025-10-24T20:19:20.333500] [DEBUG] [LOCAL     ] NXC: Deleted primary data file.
[2025-10-24T20:19:20.333538] [INFO ] [MAIN      ] NXC: Starting full primary refresh.
[2025-10-24T20:19:20.717482] [INFO ] [REMOTE    ] NXC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:19:20.719024] [INFO ] [REMOTE    ] NWN: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T20:19:20.947681] [INFO ] [REMOTE    ] NX: Fetching primary data for 2025-02.
[2025-10-24T20:19:21.747691] [INFO ] [REMOTE    ] NWN: Fetching primary data for 2025-09.
[2025-10-24T20:19:22.051318] [INFO ] [REMOTE    ] NWG: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T20:19:22.060757] [INFO ] [REMOTE    ] NWG: Full fetch complete (74096 records).
[2025-10-24T20:19:22.060929] [DEBUG] [VALIDATOR ] NWG: Validating primary data.
[2025-10-24T20:19:22.479259] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present.
[2025-10-24T20:19:22.479869] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed.
[2025-10-24T20:19:22.480505] [INFO ] [REMOTE    ] NX: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T20:19:22.487697] [INFO ] [MAIN      ] NWG: Fetched primary data is valid.
[2025-10-24T20:19:22.488205] [DEBUG] [LOCAL     ] NWG: Saving primary data.
[2025-10-24T20:19:22.489037] [FATAL] [LOCAL     ] NWG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:19:22.489128] [FATAL] [MAIN      ] NWG: Failed to save primary data.
[2025-10-24T20:19:22.489171] [WARN ] [MAIN      ] NWG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:19:22.489206] [INFO ] [LOCAL     ] NWG: Starting deletion of primary data.
[2025-10-24T20:19:22.489261] [DEBUG] [LOCAL     ] NWG: No primary data file found to delete.
[2025-10-24T20:19:22.489296] [INFO ] [LOCAL     ] NWG: Starting deletion of derivative data.
[2025-10-24T20:19:22.489466] [DEBUG] [LOCAL     ] NWG: Deleted derivative data file.
[2025-10-24T20:19:22.489791] [INFO ] [MAIN      ] Update Progress: 1552/2366 symbols completed. NWG took 30.8s. Estimated remaining: 1h 44m 33s. Rate: 7.8 symbols/min
[2025-10-24T20:19:22.555742] [INFO ] [REMOTE    ] NX: Fetching primary data for 2025-03.
[2025-10-24T20:19:22.666747] [INFO ] [MAIN      ] NXDR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:19:22.667076] [DEBUG] [LOCAL     ] NXDR: No existing data file found in primary storage.
[2025-10-24T20:19:22.667151] [WARN ] [MAIN      ] NXDR: No existing data found, performing full refresh instead.
[2025-10-24T20:19:22.667300] [INFO ] [MAIN      ] NXDR: Wiping existing primary data before full refresh.
[2025-10-24T20:19:22.667386] [INFO ] [LOCAL     ] NXDR: Starting deletion of primary data.
[2025-10-24T20:19:22.667590] [DEBUG] [LOCAL     ] NXDR: No primary data file found to delete.
[2025-10-24T20:19:22.667719] [INFO ] [MAIN      ] NXDR: Starting full primary refresh.
[2025-10-24T20:19:22.824191] [INFO ] [REMOTE    ] NWN: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T20:19:23.044849] [INFO ] [REMOTE    ] NXDR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:19:23.347633] [INFO ] [REMOTE    ] NXDR: Fetching primary data for 2025-01.
[2025-10-24T20:19:24.061131] [DEBUG] [REMOTE    ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:19:24.061437] [WARN ] [REMOTE    ] NXDR: No data returned for month 2025-01
[2025-10-24T20:19:24.061528] [FATAL] [REMOTE    ] NXDR: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:19:24.061579] [FATAL] [MAIN      ] NXDR: Failed to fetch primary data.
[2025-10-24T20:19:24.061639] [WARN ] [MAIN      ] NXDR: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:19:24.061746] [INFO ] [LOCAL     ] NXDR: Starting deletion of primary data.
[2025-10-24T20:19:24.061838] [DEBUG] [LOCAL     ] NXDR: No primary data file found to delete.
[2025-10-24T20:19:24.061883] [INFO ] [LOCAL     ] NXDR: Starting deletion of derivative data.
[2025-10-24T20:19:24.061927] [DEBUG] [LOCAL     ] NXDR: No derivative data file found to delete.
[2025-10-24T20:19:24.061976] [INFO ] [MAIN      ] Update Progress: 1553/2366 symbols completed. NXDR took 1.6s. Estimated remaining: 1h 44m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:19:24.149690] [INFO ] [REMOTE    ] NWN: Fetching primary data for 2025-10.
[2025-10-24T20:19:24.222057] [INFO ] [REMOTE    ] NX: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T20:19:24.279936] [INFO ] [MAIN      ] NXDT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:19:24.295850] [DEBUG] [LOCAL     ] NXDT: Loaded 14863 existing records from primary storage.
[2025-10-24T20:19:24.296117] [INFO ] [MAIN      ] NXDT: Loaded 14863 existing records.
[2025-10-24T20:19:24.476603] [WARN ] [MAIN      ] NXDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:19:24.476871] [INFO ] [MAIN      ] NXDT: Wiping existing primary data before full refresh.
[2025-10-24T20:19:24.476927] [INFO ] [LOCAL     ] NXDT: Starting deletion of primary data.
[2025-10-24T20:19:24.477165] [DEBUG] [LOCAL     ] NXDT: Deleted primary data file.
[2025-10-24T20:19:24.477207] [INFO ] [MAIN      ] NXDT: Starting full primary refresh.
[2025-10-24T20:19:24.857712] [INFO ] [REMOTE    ] NXDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:19:24.947623] [INFO ] [REMOTE    ] NXC: Fetching primary data for 2025-01.
[2025-10-24T20:19:25.323886] [INFO ] [REMOTE    ] NWN: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T20:19:25.328708] [INFO ] [REMOTE    ] NWN: Full fetch complete (37301 records).
[2025-10-24T20:19:25.328842] [DEBUG] [VALIDATOR ] NWN: Validating primary data.
[2025-10-24T20:19:25.599494] [INFO ] [REMOTE    ] NXC: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T20:19:25.732534] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present.
[2025-10-24T20:19:25.732679] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed.
[2025-10-24T20:19:25.734189] [INFO ] [MAIN      ] NWN: Fetched primary data is valid.
[2025-10-24T20:19:25.734254] [DEBUG] [LOCAL     ] NWN: Saving primary data.
[2025-10-24T20:19:25.734842] [FATAL] [LOCAL     ] NWN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:19:25.734934] [FATAL] [MAIN      ] NWN: Failed to save primary data.
[2025-10-24T20:19:25.734975] [WARN ] [MAIN      ] NWN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:19:25.735011] [INFO ] [LOCAL     ] NWN: Starting deletion of primary data.
[2025-10-24T20:19:25.735068] [DEBUG] [LOCAL     ] NWN: No primary data file found to delete.
[2025-10-24T20:19:25.735104] [INFO ] [LOCAL     ] NWN: Starting deletion of derivative data.
[2025-10-24T20:19:25.735321] [DEBUG] [LOCAL     ] NWN: Deleted derivative data file.
[2025-10-24T20:19:25.735436] [INFO ] [MAIN      ] Update Progress: 1554/2366 symbols completed. NWN took 28.0s. Estimated remaining: 1h 44m 11s. Rate: 7.8 symbols/min
[2025-10-24T20:19:25.753156] [INFO ] [REMOTE    ] NXC: Fetching primary data for 2025-02.
[2025-10-24T20:19:25.916184] [INFO ] [MAIN      ] NXE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:19:25.966043] [DEBUG] [LOCAL     ] NXE: Loaded 53454 existing records from primary storage.
[2025-10-24T20:19:25.966379] [INFO ] [MAIN      ] NXE: Loaded 53454 existing records.
[2025-10-24T20:19:26.142087] [WARN ] [MAIN      ] NXE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:19:26.142301] [INFO ] [MAIN      ] NXE: Wiping existing primary data before full refresh.
[2025-10-24T20:19:26.142355] [INFO ] [LOCAL     ] NXE: Starting deletion of primary data.
[2025-10-24T20:19:26.142827] [DEBUG] [LOCAL     ] NXE: Deleted primary data file.
[2025-10-24T20:19:26.142882] [INFO ] [MAIN      ] NXE: Starting full primary refresh.
[2025-10-24T20:19:26.485012] [INFO ] [REMOTE    ] NXC: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T20:19:26.507069] [INFO ] [REMOTE    ] NXE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:19:26.547602] [INFO ] [REMOTE    ] NXE: Fetching primary data for 2025-01.
[2025-10-24T20:19:27.347689] [INFO ] [REMOTE    ] NX: Fetching primary data for 2025-04.
[2025-10-24T20:19:28.147704] [INFO ] [REMOTE    ] NXDT: Fetching primary data for 2025-01.
[2025-10-24T20:19:28.473842] [INFO ] [REMOTE    ] NXE: Incremental fetch complete for 2025-01 (1.93 seconds).
[2025-10-24T20:19:28.817680] [INFO ] [REMOTE    ] NX: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T20:19:28.883509] [INFO ] [REMOTE    ] NXDT: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T20:19:28.947684] [INFO ] [REMOTE    ] NXDT: Fetching primary data for 2025-02.
[2025-10-24T20:19:29.747676] [INFO ] [REMOTE    ] NX: Fetching primary data for 2025-05.
[2025-10-24T20:19:30.031338] [INFO ] [REMOTE    ] NXDT: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T20:19:30.547698] [INFO ] [REMOTE    ] NXC: Fetching primary data for 2025-03.
[2025-10-24T20:19:31.223267] [INFO ] [REMOTE    ] NX: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T20:19:31.244234] [INFO ] [REMOTE    ] NXC: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T20:19:31.347667] [INFO ] [REMOTE    ] NXC: Fetching primary data for 2025-04.
[2025-10-24T20:19:32.147711] [INFO ] [REMOTE    ] NXDT: Fetching primary data for 2025-03.
[2025-10-24T20:19:32.174764] [INFO ] [REMOTE    ] NXC: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T20:19:32.947734] [INFO ] [REMOTE    ] NX: Fetching primary data for 2025-06.
[2025-10-24T20:19:33.530173] [INFO ] [REMOTE    ] NXDT: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T20:19:33.747706] [INFO ] [REMOTE    ] NXDT: Fetching primary data for 2025-04.
[2025-10-24T20:19:34.441184] [INFO ] [REMOTE    ] NX: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T20:19:34.547612] [INFO ] [REMOTE    ] NX: Fetching primary data for 2025-07.
[2025-10-24T20:19:34.917147] [INFO ] [REMOTE    ] NXDT: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T20:19:35.347726] [INFO ] [REMOTE    ] NXC: Fetching primary data for 2025-05.
[2025-10-24T20:19:35.952567] [INFO ] [REMOTE    ] NXC: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T20:19:35.952412] [INFO ] [REMOTE    ] NX: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T20:19:36.147636] [INFO ] [REMOTE    ] NX: Fetching primary data for 2025-08.
[2025-10-24T20:19:36.947676] [INFO ] [REMOTE    ] NXC: Fetching primary data for 2025-06.
[2025-10-24T20:19:37.604225] [INFO ] [REMOTE    ] NXC: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T20:19:37.624195] [INFO ] [REMOTE    ] NX: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T20:19:37.747670] [INFO ] [REMOTE    ] NX: Fetching primary data for 2025-09.
[2025-10-24T20:19:38.547678] [INFO ] [REMOTE    ] NXE: Fetching primary data for 2025-02.
[2025-10-24T20:19:39.236142] [INFO ] [REMOTE    ] NX: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T20:19:39.347701] [INFO ] [REMOTE    ] NX: Fetching primary data for 2025-10.
[2025-10-24T20:19:40.147626] [INFO ] [REMOTE    ] NXDT: Fetching primary data for 2025-05.
[2025-10-24T20:19:40.274835] [INFO ] [REMOTE    ] NXE: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T20:19:40.947722] [INFO ] [REMOTE    ] NXC: Fetching primary data for 2025-07.
[2025-10-24T20:19:41.004697] [INFO ] [REMOTE    ] NX: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T20:19:41.011380] [INFO ] [REMOTE    ] NX: Full fetch complete (48364 records).
[2025-10-24T20:19:41.011538] [DEBUG] [VALIDATOR ] NX: Validating primary data.
[2025-10-24T20:19:41.367950] [INFO ] [REMOTE    ] NXDT: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T20:19:41.462349] [DEBUG] [VALIDATOR ] NX: All expected trading days are present.
[2025-10-24T20:19:41.462459] [DEBUG] [VALIDATOR ] NX: Primary data validation passed.
[2025-10-24T20:19:41.463884] [INFO ] [MAIN      ] NX: Fetched primary data is valid.
[2025-10-24T20:19:41.463955] [DEBUG] [LOCAL     ] NX: Saving primary data.
[2025-10-24T20:19:41.464632] [FATAL] [LOCAL     ] NX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:19:41.464747] [FATAL] [MAIN      ] NX: Failed to save primary data.
[2025-10-24T20:19:41.464791] [WARN ] [MAIN      ] NX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:19:41.464826] [INFO ] [LOCAL     ] NX: Starting deletion of primary data.
[2025-10-24T20:19:41.464913] [DEBUG] [LOCAL     ] NX: No primary data file found to delete.
[2025-10-24T20:19:41.464953] [INFO ] [LOCAL     ] NX: Starting deletion of derivative data.
[2025-10-24T20:19:41.465158] [DEBUG] [LOCAL     ] NX: Deleted derivative data file.
[2025-10-24T20:19:41.465267] [INFO ] [MAIN      ] Update Progress: 1555/2366 symbols completed. NX took 23.9s. Estimated remaining: 1h 44m 7s. Rate: 7.8 symbols/min
[2025-10-24T20:19:41.648784] [INFO ] [MAIN      ] NXG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:19:41.645306] [INFO ] [REMOTE    ] NXC: Incremental fetch complete for 2025-07 (0.70 seconds).
[2025-10-24T20:19:41.665829] [DEBUG] [LOCAL     ] NXG: Loaded 10567 existing records from primary storage.
[2025-10-24T20:19:41.666158] [INFO ] [MAIN      ] NXG: Loaded 10567 existing records.
[2025-10-24T20:19:41.752854] [INFO ] [REMOTE    ] NXE: Fetching primary data for 2025-03.
[2025-10-24T20:19:41.852311] [WARN ] [MAIN      ] NXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:19:41.852634] [INFO ] [MAIN      ] NXG: Wiping existing primary data before full refresh.
[2025-10-24T20:19:41.852725] [INFO ] [LOCAL     ] NXG: Starting deletion of primary data.
[2025-10-24T20:19:41.852967] [DEBUG] [LOCAL     ] NXG: Deleted primary data file.
[2025-10-24T20:19:41.853010] [INFO ] [MAIN      ] NXG: Starting full primary refresh.
[2025-10-24T20:19:42.225876] [INFO ] [REMOTE    ] NXG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:19:42.547702] [INFO ] [REMOTE    ] NXG: Fetching primary data for 2025-01.
[2025-10-24T20:19:43.347734] [INFO ] [REMOTE    ] NXC: Fetching primary data for 2025-08.
[2025-10-24T20:19:43.491274] [INFO ] [REMOTE    ] NXG: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T20:19:43.564676] [INFO ] [REMOTE    ] NXE: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T20:19:43.922836] [INFO ] [REMOTE    ] NXC: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T20:19:44.147670] [INFO ] [REMOTE    ] NXC: Fetching primary data for 2025-09.
[2025-10-24T20:19:44.844223] [INFO ] [REMOTE    ] NXC: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T20:19:44.947679] [INFO ] [REMOTE    ] NXE: Fetching primary data for 2025-04.
[2025-10-24T20:19:45.747683] [INFO ] [REMOTE    ] NXG: Fetching primary data for 2025-02.
[2025-10-24T20:19:46.547675] [INFO ] [REMOTE    ] NXDT: Fetching primary data for 2025-06.
[2025-10-24T20:19:46.610503] [INFO ] [REMOTE    ] NXG: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T20:19:46.794073] [INFO ] [REMOTE    ] NXE: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T20:19:47.347681] [INFO ] [REMOTE    ] NXC: Fetching primary data for 2025-10.
[2025-10-24T20:19:47.486115] [INFO ] [REMOTE    ] NXDT: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T20:19:47.980479] [INFO ] [REMOTE    ] NXC: Incremental fetch complete for 2025-10 (0.63 seconds).
[2025-10-24T20:19:47.981865] [INFO ] [REMOTE    ] NXC: Full fetch complete (5660 records).
[2025-10-24T20:19:47.981937] [DEBUG] [VALIDATOR ] NXC: Validating primary data.
[2025-10-24T20:19:48.152019] [INFO ] [REMOTE    ] NXG: Fetching primary data for 2025-03.
[2025-10-24T20:19:48.370864] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present.
[2025-10-24T20:19:48.370974] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed.
[2025-10-24T20:19:48.371214] [INFO ] [MAIN      ] NXC: Fetched primary data is valid.
[2025-10-24T20:19:48.371257] [DEBUG] [LOCAL     ] NXC: Saving primary data.
[2025-10-24T20:19:48.371477] [FATAL] [LOCAL     ] NXC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:19:48.371577] [FATAL] [MAIN      ] NXC: Failed to save primary data.
[2025-10-24T20:19:48.371621] [WARN ] [MAIN      ] NXC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:19:48.371750] [INFO ] [LOCAL     ] NXC: Starting deletion of primary data.
[2025-10-24T20:19:48.371825] [DEBUG] [LOCAL     ] NXC: No primary data file found to delete.
[2025-10-24T20:19:48.371862] [INFO ] [LOCAL     ] NXC: Starting deletion of derivative data.
[2025-10-24T20:19:48.372081] [DEBUG] [LOCAL     ] NXC: Deleted derivative data file.
[2025-10-24T20:19:48.372183] [INFO ] [MAIN      ] Update Progress: 1556/2366 symbols completed. NXC took 28.5s. Estimated remaining: 1h 43m 59s. Rate: 7.8 symbols/min
[2025-10-24T20:19:48.550981] [INFO ] [MAIN      ] NXJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:19:48.571362] [DEBUG] [LOCAL     ] NXJ: Loaded 14866 existing records from primary storage.
[2025-10-24T20:19:48.571707] [INFO ] [MAIN      ] NXJ: Loaded 14866 existing records.
[2025-10-24T20:19:48.767785] [WARN ] [MAIN      ] NXJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:19:48.768127] [INFO ] [MAIN      ] NXJ: Wiping existing primary data before full refresh.
[2025-10-24T20:19:48.768227] [INFO ] [LOCAL     ] NXJ: Starting deletion of primary data.
[2025-10-24T20:19:48.768493] [DEBUG] [LOCAL     ] NXJ: Deleted primary data file.
[2025-10-24T20:19:48.768535] [INFO ] [MAIN      ] NXJ: Starting full primary refresh.
[2025-10-24T20:19:48.950204] [INFO ] [REMOTE    ] NXDT: Fetching primary data for 2025-07.
[2025-10-24T20:19:49.151877] [INFO ] [REMOTE    ] NXJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:19:49.325347] [INFO ] [REMOTE    ] NXG: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T20:19:49.747624] [INFO ] [REMOTE    ] NXE: Fetching primary data for 2025-05.
[2025-10-24T20:19:50.397991] [INFO ] [REMOTE    ] NXDT: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T20:19:50.547726] [INFO ] [REMOTE    ] NXJ: Fetching primary data for 2025-01.
[2025-10-24T20:19:51.347757] [INFO ] [REMOTE    ] NXDT: Fetching primary data for 2025-08.
[2025-10-24T20:19:51.970771] [INFO ] [REMOTE    ] NXE: Incremental fetch complete for 2025-05 (2.22 seconds).
[2025-10-24T20:19:52.099180] [INFO ] [REMOTE    ] NXJ: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T20:19:52.147636] [INFO ] [REMOTE    ] NXJ: Fetching primary data for 2025-02.
[2025-10-24T20:19:52.259034] [INFO ] [REMOTE    ] NXDT: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T20:19:52.783818] [INFO ] [REMOTE    ] NXJ: Incremental fetch complete for 2025-02 (0.64 seconds).
[2025-10-24T20:19:52.947712] [INFO ] [REMOTE    ] NXG: Fetching primary data for 2025-04.
[2025-10-24T20:19:53.747692] [INFO ] [REMOTE    ] NXJ: Fetching primary data for 2025-03.
[2025-10-24T20:19:53.841006] [INFO ] [REMOTE    ] NXG: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T20:19:54.412417] [INFO ] [REMOTE    ] NXJ: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T20:19:54.547721] [INFO ] [REMOTE    ] NXJ: Fetching primary data for 2025-04.
[2025-10-24T20:19:55.347718] [INFO ] [REMOTE    ] NXDT: Fetching primary data for 2025-09.
[2025-10-24T20:19:55.641143] [INFO ] [REMOTE    ] NXJ: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T20:19:56.147679] [INFO ] [REMOTE    ] NXG: Fetching primary data for 2025-05.
[2025-10-24T20:19:56.255146] [INFO ] [REMOTE    ] NXDT: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T20:19:56.947686] [INFO ] [REMOTE    ] NXDT: Fetching primary data for 2025-10.
[2025-10-24T20:19:56.986961] [INFO ] [REMOTE    ] NXG: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T20:19:57.747671] [INFO ] [REMOTE    ] NXG: Fetching primary data for 2025-06.
[2025-10-24T20:19:57.852078] [INFO ] [REMOTE    ] NXDT: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T20:19:57.855171] [INFO ] [REMOTE    ] NXDT: Full fetch complete (23764 records).
[2025-10-24T20:19:57.855338] [DEBUG] [VALIDATOR ] NXDT: Validating primary data.
[2025-10-24T20:19:58.220092] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present.
[2025-10-24T20:19:58.220171] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed.
[2025-10-24T20:19:58.220672] [INFO ] [MAIN      ] NXDT: Fetched primary data is valid.
[2025-10-24T20:19:58.220734] [DEBUG] [LOCAL     ] NXDT: Saving primary data.
[2025-10-24T20:19:58.221016] [FATAL] [LOCAL     ] NXDT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:19:58.221097] [FATAL] [MAIN      ] NXDT: Failed to save primary data.
[2025-10-24T20:19:58.221139] [WARN ] [MAIN      ] NXDT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:19:58.221172] [INFO ] [LOCAL     ] NXDT: Starting deletion of primary data.
[2025-10-24T20:19:58.221221] [DEBUG] [LOCAL     ] NXDT: No primary data file found to delete.
[2025-10-24T20:19:58.221255] [INFO ] [LOCAL     ] NXDT: Starting deletion of derivative data.
[2025-10-24T20:19:58.221427] [DEBUG] [LOCAL     ] NXDT: Deleted derivative data file.
[2025-10-24T20:19:58.221513] [INFO ] [MAIN      ] Update Progress: 1557/2366 symbols completed. NXDT took 34.2s. Estimated remaining: 1h 43m 53s. Rate: 7.8 symbols/min
[2025-10-24T20:19:58.375337] [INFO ] [REMOTE    ] NXG: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T20:19:58.547639] [INFO ] [REMOTE    ] NXE: Fetching primary data for 2025-06.
[2025-10-24T20:19:59.347679] [INFO ] [REMOTE    ] NXG: Fetching primary data for 2025-07.
[2025-10-24T20:20:00.147670] [INFO ] [REMOTE    ] NXJ: Fetching primary data for 2025-05.
[2025-10-24T20:20:00.259607] [INFO ] [REMOTE    ] NXG: Incremental fetch complete for 2025-07 (0.91 seconds).
[2025-10-24T20:20:00.364093] [INFO ] [REMOTE    ] NXE: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T20:20:00.947680] [INFO ] [REMOTE    ] NXG: Fetching primary data for 2025-08.
[2025-10-24T20:20:01.747703] [INFO ] [REMOTE    ] NXE: Fetching primary data for 2025-07.
[2025-10-24T20:20:02.841519] [INFO ] [REMOTE    ] NXJ: Incremental fetch complete for 2025-05 (2.69 seconds).
[2025-10-24T20:20:02.845117] [INFO ] [REMOTE    ] NXJ: Fetching primary data for 2025-06.
[2025-10-24T20:20:03.379118] [INFO ] [REMOTE    ] NXG: Incremental fetch complete for 2025-08 (2.43 seconds).
[2025-10-24T20:20:03.382317] [INFO ] [REMOTE    ] NXG: Fetching primary data for 2025-09.
[2025-10-24T20:20:04.142213] [INFO ] [REMOTE    ] NXJ: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T20:20:04.147598] [INFO ] [REMOTE    ] NXJ: Fetching primary data for 2025-07.
[2025-10-24T20:20:04.334916] [INFO ] [REMOTE    ] NXG: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T20:20:04.622950] [INFO ] [REMOTE    ] NXE: Incremental fetch complete for 2025-07 (2.88 seconds).
[2025-10-24T20:20:04.947697] [INFO ] [REMOTE    ] NXE: Fetching primary data for 2025-08.
[2025-10-24T20:20:05.276698] [INFO ] [REMOTE    ] NXJ: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T20:20:05.747681] [INFO ] [REMOTE    ] NXG: Fetching primary data for 2025-10.
[2025-10-24T20:20:06.547706] [INFO ] [REMOTE    ] NXJ: Fetching primary data for 2025-08.
[2025-10-24T20:20:06.641378] [INFO ] [REMOTE    ] NXG: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T20:20:06.644067] [INFO ] [REMOTE    ] NXG: Full fetch complete (14771 records).
[2025-10-24T20:20:06.644144] [DEBUG] [VALIDATOR ] NXG: Validating primary data.
[2025-10-24T20:20:07.015542] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present.
[2025-10-24T20:20:07.015858] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed.
[2025-10-24T20:20:07.016267] [INFO ] [MAIN      ] NXG: Fetched primary data is valid.
[2025-10-24T20:20:07.016366] [DEBUG] [LOCAL     ] NXG: Saving primary data.
[2025-10-24T20:20:07.016738] [FATAL] [LOCAL     ] NXG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:20:07.016861] [FATAL] [MAIN      ] NXG: Failed to save primary data.
[2025-10-24T20:20:07.016927] [WARN ] [MAIN      ] NXG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:20:07.016995] [INFO ] [LOCAL     ] NXG: Starting deletion of primary data.
[2025-10-24T20:20:07.017055] [DEBUG] [LOCAL     ] NXG: No primary data file found to delete.
[2025-10-24T20:20:07.017091] [INFO ] [LOCAL     ] NXG: Starting deletion of derivative data.
[2025-10-24T20:20:07.017300] [DEBUG] [LOCAL     ] NXG: Deleted derivative data file.
[2025-10-24T20:20:07.017419] [INFO ] [MAIN      ] Update Progress: 1558/2366 symbols completed. NXG took 25.6s. Estimated remaining: 1h 43m 45s. Rate: 7.8 symbols/min
[2025-10-24T20:20:07.499801] [INFO ] [REMOTE    ] NXE: Incremental fetch complete for 2025-08 (2.55 seconds).
[2025-10-24T20:20:07.511007] [INFO ] [REMOTE    ] NXE: Fetching primary data for 2025-09.
[2025-10-24T20:20:07.784425] [INFO ] [REMOTE    ] NXJ: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T20:20:08.147629] [INFO ] [REMOTE    ] NXJ: Fetching primary data for 2025-09.
[2025-10-24T20:20:09.229633] [INFO ] [REMOTE    ] NXJ: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T20:20:09.233271] [INFO ] [REMOTE    ] NXJ: Fetching primary data for 2025-10.
[2025-10-24T20:20:10.067807] [INFO ] [REMOTE    ] NXJ: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T20:20:10.070082] [INFO ] [REMOTE    ] NXJ: Full fetch complete (19934 records).
[2025-10-24T20:20:10.070151] [DEBUG] [VALIDATOR ] NXJ: Validating primary data.
[2025-10-24T20:20:10.398678] [INFO ] [REMOTE    ] NXE: Incremental fetch complete for 2025-09 (2.89 seconds).
[2025-10-24T20:20:10.458181] [INFO ] [REMOTE    ] NXE: Fetching primary data for 2025-10.
[2025-10-24T20:20:10.483380] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present.
[2025-10-24T20:20:10.483453] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed.
[2025-10-24T20:20:10.483979] [INFO ] [MAIN      ] NXJ: Fetched primary data is valid.
[2025-10-24T20:20:10.484164] [DEBUG] [LOCAL     ] NXJ: Saving primary data.
[2025-10-24T20:20:10.484499] [FATAL] [LOCAL     ] NXJ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:20:10.484580] [FATAL] [MAIN      ] NXJ: Failed to save primary data.
[2025-10-24T20:20:10.484630] [WARN ] [MAIN      ] NXJ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:20:10.484721] [INFO ] [LOCAL     ] NXJ: Starting deletion of primary data.
[2025-10-24T20:20:10.484791] [DEBUG] [LOCAL     ] NXJ: No primary data file found to delete.
[2025-10-24T20:20:10.484839] [INFO ] [LOCAL     ] NXJ: Starting deletion of derivative data.
[2025-10-24T20:20:10.485022] [DEBUG] [LOCAL     ] NXJ: Deleted derivative data file.
[2025-10-24T20:20:10.485132] [INFO ] [MAIN      ] Update Progress: 1559/2366 symbols completed. NXJ took 22.1s. Estimated remaining: 1h 43m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:20:12.555243] [INFO ] [REMOTE    ] NXE: Incremental fetch complete for 2025-10 (2.10 seconds).
[2025-10-24T20:20:12.567080] [INFO ] [REMOTE    ] NXE: Full fetch complete (76959 records).
[2025-10-24T20:20:12.567321] [DEBUG] [VALIDATOR ] NXE: Validating primary data.
[2025-10-24T20:20:13.065433] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present.
[2025-10-24T20:20:13.065533] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed.
[2025-10-24T20:20:13.066989] [INFO ] [MAIN      ] NXE: Fetched primary data is valid.
[2025-10-24T20:20:13.067061] [DEBUG] [LOCAL     ] NXE: Saving primary data.
[2025-10-24T20:20:13.071138] [FATAL] [LOCAL     ] NXE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:20:13.071363] [FATAL] [MAIN      ] NXE: Failed to save primary data.
[2025-10-24T20:20:13.071418] [WARN ] [MAIN      ] NXE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:20:13.071495] [INFO ] [LOCAL     ] NXE: Starting deletion of primary data.
[2025-10-24T20:20:13.071606] [DEBUG] [LOCAL     ] NXE: No primary data file found to delete.
[2025-10-24T20:20:13.071690] [INFO ] [LOCAL     ] NXE: Starting deletion of derivative data.
[2025-10-24T20:20:13.071890] [DEBUG] [LOCAL     ] NXE: Deleted derivative data file.
[2025-10-24T20:20:13.072273] [INFO ] [MAIN      ] Update Progress: 1560/2366 symbols completed. NXE took 47.3s. Estimated remaining: 1h 43m 25s. Rate: 7.8 symbols/min
[2025-10-24T20:20:13.881559] [INFO ] [MAIN      ] NXRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:20:13.891855] [INFO ] [MAIN      ] NXP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:20:13.895377] [INFO ] [MAIN      ] NXN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:20:13.922119] [INFO ] [MAIN      ] NYC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:20:13.923013] [DEBUG] [LOCAL     ] NYC: No existing data file found in primary storage.
[2025-10-24T20:20:13.923175] [WARN ] [MAIN      ] NYC: No existing data found, performing full refresh instead.
[2025-10-24T20:20:13.923320] [INFO ] [MAIN      ] NYC: Wiping existing primary data before full refresh.
[2025-10-24T20:20:13.923374] [INFO ] [LOCAL     ] NYC: Starting deletion of primary data.
[2025-10-24T20:20:13.923435] [DEBUG] [LOCAL     ] NYC: No primary data file found to delete.
[2025-10-24T20:20:13.923483] [INFO ] [MAIN      ] NYC: Starting full primary refresh.
[2025-10-24T20:20:13.949963] [DEBUG] [LOCAL     ] NXN: Loaded 2313 existing records from primary storage.
[2025-10-24T20:20:13.976020] [INFO ] [MAIN      ] NXN: Loaded 2313 existing records.
[2025-10-24T20:20:14.008276] [DEBUG] [LOCAL     ] NXP: Loaded 12306 existing records from primary storage.
[2025-10-24T20:20:14.047201] [INFO ] [MAIN      ] NXP: Loaded 12306 existing records.
[2025-10-24T20:20:14.092465] [DEBUG] [LOCAL     ] NXRT: Loaded 19039 existing records from primary storage.
[2025-10-24T20:20:14.259891] [INFO ] [MAIN      ] NXRT: Loaded 19039 existing records.
[2025-10-24T20:20:14.655242] [WARN ] [MAIN      ] NXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:20:14.694170] [INFO ] [MAIN      ] NXP: Wiping existing primary data before full refresh.
[2025-10-24T20:20:14.697687] [WARN ] [MAIN      ] NXN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:20:14.751786] [INFO ] [MAIN      ] NXN: Wiping existing primary data before full refresh.
[2025-10-24T20:20:14.781245] [INFO ] [LOCAL     ] NXP: Starting deletion of primary data.
[2025-10-24T20:20:14.791856] [INFO ] [LOCAL     ] NXN: Starting deletion of primary data.
[2025-10-24T20:20:14.856957] [DEBUG] [LOCAL     ] NXN: Deleted primary data file.
[2025-10-24T20:20:14.851716] [WARN ] [MAIN      ] NXRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:20:14.848231] [DEBUG] [LOCAL     ] NXP: Deleted primary data file.
[2025-10-24T20:20:14.864665] [INFO ] [MAIN      ] NXN: Starting full primary refresh.
[2025-10-24T20:20:14.868838] [INFO ] [MAIN      ] NXRT: Wiping existing primary data before full refresh.
[2025-10-24T20:20:14.880104] [INFO ] [MAIN      ] NXP: Starting full primary refresh.
[2025-10-24T20:20:14.889501] [INFO ] [LOCAL     ] NXRT: Starting deletion of primary data.
[2025-10-24T20:20:14.941864] [DEBUG] [LOCAL     ] NXRT: Deleted primary data file.
[2025-10-24T20:20:14.966795] [INFO ] [MAIN      ] NXRT: Starting full primary refresh.
[2025-10-24T20:20:15.112385] [INFO ] [REMOTE    ] NYC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:20:15.158569] [INFO ] [REMOTE    ] NYC: Fetching primary data for 2025-01.
[2025-10-24T20:20:15.954082] [INFO ] [REMOTE    ] NYC: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T20:20:16.013610] [INFO ] [REMOTE    ] NYC: Fetching primary data for 2025-02.
[2025-10-24T20:20:16.101332] [INFO ] [REMOTE    ] NXN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:20:16.169574] [INFO ] [REMOTE    ] NXN: Fetching primary data for 2025-01.
[2025-10-24T20:20:16.169295] [INFO ] [REMOTE    ] NXP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:20:16.198032] [INFO ] [REMOTE    ] NXRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:20:16.199366] [INFO ] [REMOTE    ] NXP: Fetching primary data for 2025-01.
[2025-10-24T20:20:16.199702] [INFO ] [REMOTE    ] NXRT: Fetching primary data for 2025-01.
[2025-10-24T20:20:16.733455] [INFO ] [REMOTE    ] NYC: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:20:16.734638] [INFO ] [REMOTE    ] NYC: Fetching primary data for 2025-03.
[2025-10-24T20:20:16.915288] [INFO ] [REMOTE    ] NXN: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T20:20:16.916561] [INFO ] [REMOTE    ] NXN: Fetching primary data for 2025-02.
[2025-10-24T20:20:17.163471] [INFO ] [REMOTE    ] NYC: Incremental fetch complete for 2025-03 (0.43 seconds).
[2025-10-24T20:20:17.172073] [INFO ] [REMOTE    ] NXP: Incremental fetch complete for 2025-01 (0.97 seconds).
[2025-10-24T20:20:17.174874] [INFO ] [REMOTE    ] NYC: Fetching primary data for 2025-04.
[2025-10-24T20:20:17.178183] [INFO ] [REMOTE    ] NXP: Fetching primary data for 2025-02.
[2025-10-24T20:20:17.207734] [INFO ] [REMOTE    ] NXRT: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T20:20:17.361957] [INFO ] [REMOTE    ] NXN: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T20:20:17.750065] [INFO ] [REMOTE    ] NYC: Incremental fetch complete for 2025-04 (0.58 seconds).
[2025-10-24T20:20:17.749912] [INFO ] [REMOTE    ] NXRT: Fetching primary data for 2025-02.
[2025-10-24T20:20:18.024306] [INFO ] [REMOTE    ] NXP: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T20:20:18.547738] [INFO ] [REMOTE    ] NXP: Fetching primary data for 2025-03.
[2025-10-24T20:20:18.748456] [INFO ] [REMOTE    ] NXRT: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T20:20:19.347737] [INFO ] [REMOTE    ] NYC: Fetching primary data for 2025-05.
[2025-10-24T20:20:19.539876] [INFO ] [REMOTE    ] NXP: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T20:20:20.075618] [INFO ] [REMOTE    ] NYC: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T20:20:20.147722] [INFO ] [REMOTE    ] NYC: Fetching primary data for 2025-06.
[2025-10-24T20:20:20.754669] [INFO ] [REMOTE    ] NYC: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T20:20:20.947705] [INFO ] [REMOTE    ] NYC: Fetching primary data for 2025-07.
[2025-10-24T20:20:21.458128] [INFO ] [REMOTE    ] NYC: Incremental fetch complete for 2025-07 (0.51 seconds).
[2025-10-24T20:20:21.747678] [INFO ] [REMOTE    ] NXP: Fetching primary data for 2025-04.
[2025-10-24T20:20:22.547704] [INFO ] [REMOTE    ] NXRT: Fetching primary data for 2025-03.
[2025-10-24T20:20:22.897099] [INFO ] [REMOTE    ] NXP: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T20:20:23.347712] [INFO ] [REMOTE    ] NXN: Fetching primary data for 2025-03.
[2025-10-24T20:20:23.659805] [INFO ] [REMOTE    ] NXRT: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T20:20:23.982762] [INFO ] [REMOTE    ] NXN: Incremental fetch complete for 2025-03 (0.64 seconds).
[2025-10-24T20:20:24.147712] [INFO ] [REMOTE    ] NXP: Fetching primary data for 2025-05.
[2025-10-24T20:20:24.947674] [INFO ] [REMOTE    ] NXN: Fetching primary data for 2025-04.
[2025-10-24T20:20:25.124916] [INFO ] [REMOTE    ] NXP: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T20:20:25.595783] [INFO ] [REMOTE    ] NXN: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T20:20:25.747766] [INFO ] [REMOTE    ] NXRT: Fetching primary data for 2025-04.
[2025-10-24T20:20:26.547710] [INFO ] [REMOTE    ] NXP: Fetching primary data for 2025-06.
[2025-10-24T20:20:26.896868] [INFO ] [REMOTE    ] NXRT: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T20:20:27.347699] [INFO ] [REMOTE    ] NXRT: Fetching primary data for 2025-05.
[2025-10-24T20:20:27.497514] [INFO ] [REMOTE    ] NXP: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T20:20:28.147689] [INFO ] [REMOTE    ] NXP: Fetching primary data for 2025-07.
[2025-10-24T20:20:28.527525] [INFO ] [REMOTE    ] NXRT: Incremental fetch complete for 2025-05 (1.18 seconds).
[2025-10-24T20:20:28.947675] [INFO ] [REMOTE    ] NYC: Fetching primary data for 2025-08.
[2025-10-24T20:20:29.145869] [INFO ] [REMOTE    ] NXP: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T20:20:29.430203] [INFO ] [REMOTE    ] NYC: Incremental fetch complete for 2025-08 (0.48 seconds).
[2025-10-24T20:20:29.747666] [INFO ] [REMOTE    ] NXP: Fetching primary data for 2025-08.
[2025-10-24T20:20:30.547630] [INFO ] [REMOTE    ] NXN: Fetching primary data for 2025-05.
[2025-10-24T20:20:30.744678] [INFO ] [REMOTE    ] NXP: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T20:20:31.182586] [INFO ] [REMOTE    ] NXN: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T20:20:31.347702] [INFO ] [REMOTE    ] NYC: Fetching primary data for 2025-09.
[2025-10-24T20:20:31.931802] [INFO ] [REMOTE    ] NYC: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T20:20:32.147686] [INFO ] [REMOTE    ] NXP: Fetching primary data for 2025-09.
[2025-10-24T20:20:32.947694] [INFO ] [REMOTE    ] NXN: Fetching primary data for 2025-06.
[2025-10-24T20:20:33.044372] [INFO ] [REMOTE    ] NXP: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T20:20:33.655609] [INFO ] [REMOTE    ] NXN: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T20:20:33.747749] [INFO ] [REMOTE    ] NYC: Fetching primary data for 2025-10.
[2025-10-24T20:20:34.221116] [INFO ] [REMOTE    ] NYC: Incremental fetch complete for 2025-10 (0.47 seconds).
[2025-10-24T20:20:34.221896] [INFO ] [REMOTE    ] NYC: Full fetch complete (1844 records).
[2025-10-24T20:20:34.221964] [DEBUG] [VALIDATOR ] NYC: Validating primary data.
[2025-10-24T20:20:34.400981] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days
[2025-10-24T20:20:34.401165] [FATAL] [MAIN      ] NYC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:20:34.401233] [WARN ] [MAIN      ] NYC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:20:34.401306] [INFO ] [LOCAL     ] NYC: Starting deletion of primary data.
[2025-10-24T20:20:34.401369] [DEBUG] [LOCAL     ] NYC: No primary data file found to delete.
[2025-10-24T20:20:34.401405] [INFO ] [LOCAL     ] NYC: Starting deletion of derivative data.
[2025-10-24T20:20:34.401444] [DEBUG] [LOCAL     ] NYC: No derivative data file found to delete.
[2025-10-24T20:20:34.401501] [INFO ] [MAIN      ] Update Progress: 1561/2366 symbols completed. NYC took 21.3s. Estimated remaining: 1h 43m 25s. Rate: 7.8 symbols/min
[2025-10-24T20:20:34.551930] [INFO ] [REMOTE    ] NXRT: Fetching primary data for 2025-06.
[2025-10-24T20:20:34.573537] [INFO ] [MAIN      ] NYT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:20:34.619304] [DEBUG] [LOCAL     ] NYT: Loaded 49803 existing records from primary storage.
[2025-10-24T20:20:34.619604] [INFO ] [MAIN      ] NYT: Loaded 49803 existing records.
[2025-10-24T20:20:34.800484] [WARN ] [MAIN      ] NYT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:20:34.800719] [INFO ] [MAIN      ] NYT: Wiping existing primary data before full refresh.
[2025-10-24T20:20:34.800774] [INFO ] [LOCAL     ] NYT: Starting deletion of primary data.
[2025-10-24T20:20:34.801822] [DEBUG] [LOCAL     ] NYT: Deleted primary data file.
[2025-10-24T20:20:34.801882] [INFO ] [MAIN      ] NYT: Starting full primary refresh.
[2025-10-24T20:20:35.188580] [INFO ] [REMOTE    ] NYT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:20:35.347673] [INFO ] [REMOTE    ] NYT: Fetching primary data for 2025-01.
[2025-10-24T20:20:35.656502] [INFO ] [REMOTE    ] NXRT: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T20:20:36.147702] [INFO ] [REMOTE    ] NXRT: Fetching primary data for 2025-07.
[2025-10-24T20:20:36.947605] [INFO ] [REMOTE    ] NXP: Fetching primary data for 2025-10.
[2025-10-24T20:20:36.973624] [INFO ] [REMOTE    ] NYT: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T20:20:37.025342] [INFO ] [REMOTE    ] NXRT: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T20:20:37.747625] [INFO ] [REMOTE    ] NXN: Fetching primary data for 2025-07.
[2025-10-24T20:20:37.887590] [INFO ] [REMOTE    ] NXP: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T20:20:37.890355] [INFO ] [REMOTE    ] NXP: Full fetch complete (17014 records).
[2025-10-24T20:20:37.890442] [DEBUG] [VALIDATOR ] NXP: Validating primary data.
[2025-10-24T20:20:38.245382] [INFO ] [REMOTE    ] NXN: Incremental fetch complete for 2025-07 (0.50 seconds).
[2025-10-24T20:20:38.271169] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present.
[2025-10-24T20:20:38.271228] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed.
[2025-10-24T20:20:38.271680] [INFO ] [MAIN      ] NXP: Fetched primary data is valid.
[2025-10-24T20:20:38.271741] [DEBUG] [LOCAL     ] NXP: Saving primary data.
[2025-10-24T20:20:38.271972] [FATAL] [LOCAL     ] NXP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:20:38.272062] [FATAL] [MAIN      ] NXP: Failed to save primary data.
[2025-10-24T20:20:38.272135] [WARN ] [MAIN      ] NXP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:20:38.272220] [INFO ] [LOCAL     ] NXP: Starting deletion of primary data.
[2025-10-24T20:20:38.272321] [DEBUG] [LOCAL     ] NXP: No primary data file found to delete.
[2025-10-24T20:20:38.272417] [INFO ] [LOCAL     ] NXP: Starting deletion of derivative data.
[2025-10-24T20:20:38.272639] [DEBUG] [LOCAL     ] NXP: Deleted derivative data file.
[2025-10-24T20:20:38.272801] [INFO ] [MAIN      ] Update Progress: 1562/2366 symbols completed. NXP took 25.2s. Estimated remaining: 1h 43m 15s. Rate: 7.8 symbols/min
[2025-10-24T20:20:38.438342] [INFO ] [MAIN      ] NZF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:20:38.468688] [DEBUG] [LOCAL     ] NZF: Loaded 28909 existing records from primary storage.
[2025-10-24T20:20:38.468949] [INFO ] [MAIN      ] NZF: Loaded 28909 existing records.
[2025-10-24T20:20:38.552767] [INFO ] [REMOTE    ] NYT: Fetching primary data for 2025-02.
[2025-10-24T20:20:38.648852] [WARN ] [MAIN      ] NZF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:20:38.649079] [INFO ] [MAIN      ] NZF: Wiping existing primary data before full refresh.
[2025-10-24T20:20:38.649135] [INFO ] [LOCAL     ] NZF: Starting deletion of primary data.
[2025-10-24T20:20:38.649527] [DEBUG] [LOCAL     ] NZF: Deleted primary data file.
[2025-10-24T20:20:38.649582] [INFO ] [MAIN      ] NZF: Starting full primary refresh.
[2025-10-24T20:20:39.007193] [INFO ] [REMOTE    ] NZF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:20:39.347693] [INFO ] [REMOTE    ] NXN: Fetching primary data for 2025-08.
[2025-10-24T20:20:39.933739] [INFO ] [REMOTE    ] NXN: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T20:20:40.147628] [INFO ] [REMOTE    ] NXRT: Fetching primary data for 2025-08.
[2025-10-24T20:20:40.233536] [INFO ] [REMOTE    ] NYT: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T20:20:40.947624] [INFO ] [REMOTE    ] NXN: Fetching primary data for 2025-09.
[2025-10-24T20:20:41.010271] [INFO ] [REMOTE    ] NXRT: Incremental fetch complete for 2025-08 (0.86 seconds).
[2025-10-24T20:20:41.524139] [INFO ] [REMOTE    ] NXN: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T20:20:41.747698] [INFO ] [REMOTE    ] NYT: Fetching primary data for 2025-03.
[2025-10-24T20:20:42.547679] [INFO ] [REMOTE    ] NXN: Fetching primary data for 2025-10.
[2025-10-24T20:20:43.223843] [INFO ] [REMOTE    ] NXN: Incremental fetch complete for 2025-10 (0.68 seconds).
[2025-10-24T20:20:43.224810] [INFO ] [REMOTE    ] NXN: Full fetch complete (3446 records).
[2025-10-24T20:20:43.224877] [DEBUG] [VALIDATOR ] NXN: Validating primary data.
[2025-10-24T20:20:43.352809] [INFO ] [REMOTE    ] NZF: Fetching primary data for 2025-01.
[2025-10-24T20:20:43.598901] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present.
[2025-10-24T20:20:43.599001] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed.
[2025-10-24T20:20:43.599190] [INFO ] [MAIN      ] NXN: Fetched primary data is valid.
[2025-10-24T20:20:43.599269] [DEBUG] [LOCAL     ] NXN: Saving primary data.
[2025-10-24T20:20:43.599593] [FATAL] [LOCAL     ] NXN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:20:43.615625] [FATAL] [MAIN      ] NXN: Failed to save primary data.
[2025-10-24T20:20:43.623513] [WARN ] [MAIN      ] NXN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:20:43.626331] [INFO ] [LOCAL     ] NXN: Starting deletion of primary data.
[2025-10-24T20:20:43.626411] [DEBUG] [LOCAL     ] NXN: No primary data file found to delete.
[2025-10-24T20:20:43.626456] [INFO ] [LOCAL     ] NXN: Starting deletion of derivative data.
[2025-10-24T20:20:43.628120] [DEBUG] [LOCAL     ] NXN: Deleted derivative data file.
[2025-10-24T20:20:43.628079] [INFO ] [REMOTE    ] NYT: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T20:20:43.628289] [INFO ] [MAIN      ] Update Progress: 1563/2366 symbols completed. NXN took 30.6s. Estimated remaining: 1h 43m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:20:43.805676] [INFO ] [MAIN      ] O: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:20:43.805846] [DEBUG] [LOCAL     ] O: No existing data file found in primary storage.
[2025-10-24T20:20:43.805883] [WARN ] [MAIN      ] O: No existing data found, performing full refresh instead.
[2025-10-24T20:20:43.805988] [INFO ] [MAIN      ] O: Wiping existing primary data before full refresh.
[2025-10-24T20:20:43.806029] [INFO ] [LOCAL     ] O: Starting deletion of primary data.
[2025-10-24T20:20:43.806069] [DEBUG] [LOCAL     ] O: No primary data file found to delete.
[2025-10-24T20:20:43.806101] [INFO ] [MAIN      ] O: Starting full primary refresh.
[2025-10-24T20:20:44.156266] [INFO ] [REMOTE    ] NXRT: Fetching primary data for 2025-09.
[2025-10-24T20:20:44.160921] [INFO ] [REMOTE    ] O: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:20:44.933330] [INFO ] [REMOTE    ] NZF: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T20:20:44.947608] [INFO ] [REMOTE    ] NZF: Fetching primary data for 2025-02.
[2025-10-24T20:20:45.322550] [INFO ] [REMOTE    ] NXRT: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T20:20:45.747735] [INFO ] [REMOTE    ] NXRT: Fetching primary data for 2025-10.
[2025-10-24T20:20:46.298433] [INFO ] [REMOTE    ] NZF: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T20:20:46.547697] [INFO ] [REMOTE    ] NZF: Fetching primary data for 2025-03.
[2025-10-24T20:20:46.887315] [INFO ] [REMOTE    ] NXRT: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T20:20:46.891351] [INFO ] [REMOTE    ] NXRT: Full fetch complete (26104 records).
[2025-10-24T20:20:46.891432] [DEBUG] [VALIDATOR ] NXRT: Validating primary data.
[2025-10-24T20:20:47.270690] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present.
[2025-10-24T20:20:47.270793] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed.
[2025-10-24T20:20:47.271520] [INFO ] [MAIN      ] NXRT: Fetched primary data is valid.
[2025-10-24T20:20:47.271585] [DEBUG] [LOCAL     ] NXRT: Saving primary data.
[2025-10-24T20:20:47.272128] [FATAL] [LOCAL     ] NXRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:20:47.272212] [FATAL] [MAIN      ] NXRT: Failed to save primary data.
[2025-10-24T20:20:47.272261] [WARN ] [MAIN      ] NXRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:20:47.272296] [INFO ] [LOCAL     ] NXRT: Starting deletion of primary data.
[2025-10-24T20:20:47.272349] [DEBUG] [LOCAL     ] NXRT: No primary data file found to delete.
[2025-10-24T20:20:47.272386] [INFO ] [LOCAL     ] NXRT: Starting deletion of derivative data.
[2025-10-24T20:20:47.272556] [DEBUG] [LOCAL     ] NXRT: Deleted derivative data file.
[2025-10-24T20:20:47.272691] [INFO ] [MAIN      ] Update Progress: 1564/2366 symbols completed. NXRT took 34.2s. Estimated remaining: 1h 42m 56s. Rate: 7.8 symbols/min
[2025-10-24T20:20:47.352936] [INFO ] [REMOTE    ] NYT: Fetching primary data for 2025-04.
[2025-10-24T20:20:47.465931] [INFO ] [MAIN      ] OBDC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:20:47.539114] [DEBUG] [LOCAL     ] OBDC: Loaded 52109 existing records from primary storage.
[2025-10-24T20:20:47.539555] [INFO ] [MAIN      ] OBDC: Loaded 52109 existing records.
[2025-10-24T20:20:47.738293] [WARN ] [MAIN      ] OBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:20:47.738531] [INFO ] [MAIN      ] OBDC: Wiping existing primary data before full refresh.
[2025-10-24T20:20:47.738610] [INFO ] [LOCAL     ] OBDC: Starting deletion of primary data.
[2025-10-24T20:20:47.739146] [DEBUG] [LOCAL     ] OBDC: Deleted primary data file.
[2025-10-24T20:20:47.739199] [INFO ] [MAIN      ] OBDC: Starting full primary refresh.
[2025-10-24T20:20:48.064159] [INFO ] [REMOTE    ] NZF: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T20:20:48.138386] [INFO ] [REMOTE    ] OBDC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:20:48.147626] [INFO ] [REMOTE    ] NZF: Fetching primary data for 2025-04.
[2025-10-24T20:20:48.947704] [INFO ] [REMOTE    ] O: Fetching primary data for 2025-01.
[2025-10-24T20:20:49.115670] [INFO ] [REMOTE    ] NYT: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T20:20:49.186749] [INFO ] [REMOTE    ] NZF: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T20:20:49.747665] [INFO ] [REMOTE    ] OBDC: Fetching primary data for 2025-01.
[2025-10-24T20:20:50.547683] [INFO ] [REMOTE    ] NZF: Fetching primary data for 2025-05.
[2025-10-24T20:20:51.336232] [INFO ] [REMOTE    ] O: Incremental fetch complete for 2025-01 (2.39 seconds).
[2025-10-24T20:20:51.347591] [INFO ] [REMOTE    ] O: Fetching primary data for 2025-02.
[2025-10-24T20:20:51.432333] [INFO ] [REMOTE    ] OBDC: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T20:20:51.882296] [INFO ] [REMOTE    ] NZF: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T20:20:52.147671] [INFO ] [REMOTE    ] OBDC: Fetching primary data for 2025-02.
[2025-10-24T20:20:52.947679] [INFO ] [REMOTE    ] NYT: Fetching primary data for 2025-05.
[2025-10-24T20:20:53.642747] [INFO ] [REMOTE    ] O: Incremental fetch complete for 2025-02 (2.30 seconds).
[2025-10-24T20:20:53.747620] [INFO ] [REMOTE    ] O: Fetching primary data for 2025-03.
[2025-10-24T20:20:53.893430] [INFO ] [REMOTE    ] OBDC: Incremental fetch complete for 2025-02 (1.75 seconds).
[2025-10-24T20:20:54.547714] [INFO ] [REMOTE    ] OBDC: Fetching primary data for 2025-03.
[2025-10-24T20:20:54.901189] [INFO ] [REMOTE    ] NYT: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T20:20:55.347699] [INFO ] [REMOTE    ] NYT: Fetching primary data for 2025-06.
[2025-10-24T20:20:56.147711] [INFO ] [REMOTE    ] NZF: Fetching primary data for 2025-06.
[2025-10-24T20:20:56.428596] [INFO ] [REMOTE    ] OBDC: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T20:20:56.829122] [INFO ] [REMOTE    ] O: Incremental fetch complete for 2025-03 (3.08 seconds).
[2025-10-24T20:20:56.947612] [INFO ] [REMOTE    ] O: Fetching primary data for 2025-04.
[2025-10-24T20:20:57.279844] [INFO ] [REMOTE    ] NYT: Incremental fetch complete for 2025-06 (1.93 seconds).
[2025-10-24T20:20:57.531944] [INFO ] [REMOTE    ] NZF: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T20:20:57.747719] [INFO ] [REMOTE    ] NYT: Fetching primary data for 2025-07.
[2025-10-24T20:20:58.547684] [INFO ] [REMOTE    ] NZF: Fetching primary data for 2025-07.
[2025-10-24T20:20:59.347632] [INFO ] [REMOTE    ] OBDC: Fetching primary data for 2025-04.
[2025-10-24T20:20:59.558545] [INFO ] [REMOTE    ] NYT: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T20:20:59.579619] [INFO ] [REMOTE    ] O: Incremental fetch complete for 2025-04 (2.63 seconds).
[2025-10-24T20:20:59.871380] [INFO ] [REMOTE    ] NZF: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T20:21:00.147702] [INFO ] [REMOTE    ] NYT: Fetching primary data for 2025-08.
[2025-10-24T20:21:00.947638] [INFO ] [REMOTE    ] NZF: Fetching primary data for 2025-08.
[2025-10-24T20:21:01.464180] [INFO ] [REMOTE    ] OBDC: Incremental fetch complete for 2025-04 (2.12 seconds).
[2025-10-24T20:21:01.747691] [INFO ] [REMOTE    ] O: Fetching primary data for 2025-05.
[2025-10-24T20:21:01.949369] [INFO ] [REMOTE    ] NYT: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T20:21:02.020767] [INFO ] [REMOTE    ] NZF: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T20:21:02.547738] [INFO ] [REMOTE    ] OBDC: Fetching primary data for 2025-05.
[2025-10-24T20:21:03.347755] [INFO ] [REMOTE    ] NZF: Fetching primary data for 2025-09.
[2025-10-24T20:21:04.127771] [INFO ] [REMOTE    ] O: Incremental fetch complete for 2025-05 (2.38 seconds).
[2025-10-24T20:21:04.147620] [INFO ] [REMOTE    ] O: Fetching primary data for 2025-06.
[2025-10-24T20:21:04.254676] [INFO ] [REMOTE    ] OBDC: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T20:21:04.701237] [INFO ] [REMOTE    ] NZF: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T20:21:04.947747] [INFO ] [REMOTE    ] NZF: Fetching primary data for 2025-10.
[2025-10-24T20:21:05.747681] [INFO ] [REMOTE    ] OBDC: Fetching primary data for 2025-06.
[2025-10-24T20:21:06.241370] [INFO ] [REMOTE    ] NZF: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T20:21:06.246631] [INFO ] [REMOTE    ] NZF: Full fetch complete (42137 records).
[2025-10-24T20:21:06.246775] [DEBUG] [VALIDATOR ] NZF: Validating primary data.
[2025-10-24T20:21:06.548995] [INFO ] [REMOTE    ] NYT: Fetching primary data for 2025-09.
[2025-10-24T20:21:06.642568] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present.
[2025-10-24T20:21:06.642699] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed.
[2025-10-24T20:21:06.643540] [INFO ] [MAIN      ] NZF: Fetched primary data is valid.
[2025-10-24T20:21:06.643613] [DEBUG] [LOCAL     ] NZF: Saving primary data.
[2025-10-24T20:21:06.644243] [FATAL] [LOCAL     ] NZF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:21:06.644459] [FATAL] [MAIN      ] NZF: Failed to save primary data.
[2025-10-24T20:21:06.644527] [WARN ] [MAIN      ] NZF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:21:06.644605] [INFO ] [LOCAL     ] NZF: Starting deletion of primary data.
[2025-10-24T20:21:06.644796] [DEBUG] [LOCAL     ] NZF: No primary data file found to delete.
[2025-10-24T20:21:06.644862] [INFO ] [LOCAL     ] NZF: Starting deletion of derivative data.
[2025-10-24T20:21:06.645152] [DEBUG] [LOCAL     ] NZF: Deleted derivative data file.
[2025-10-24T20:21:06.645244] [INFO ] [MAIN      ] Update Progress: 1565/2366 symbols completed. NZF took 28.4s. Estimated remaining: 1h 42m 54s. Rate: 7.8 symbols/min
[2025-10-24T20:21:06.828133] [INFO ] [MAIN      ] OBK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:21:06.858577] [INFO ] [REMOTE    ] O: Incremental fetch complete for 2025-06 (2.71 seconds).
[2025-10-24T20:21:06.881554] [DEBUG] [LOCAL     ] OBK: Loaded 16495 existing records from primary storage.
[2025-10-24T20:21:06.881814] [INFO ] [MAIN      ] OBK: Loaded 16495 existing records.
[2025-10-24T20:21:07.069040] [WARN ] [MAIN      ] OBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:21:07.069283] [INFO ] [MAIN      ] OBK: Wiping existing primary data before full refresh.
[2025-10-24T20:21:07.069332] [INFO ] [LOCAL     ] OBK: Starting deletion of primary data.
[2025-10-24T20:21:07.069783] [DEBUG] [LOCAL     ] OBK: Deleted primary data file.
[2025-10-24T20:21:07.069841] [INFO ] [MAIN      ] OBK: Starting full primary refresh.
[2025-10-24T20:21:07.356188] [INFO ] [REMOTE    ] O: Fetching primary data for 2025-07.
[2025-10-24T20:21:07.493964] [INFO ] [REMOTE    ] OBK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:21:07.593834] [INFO ] [REMOTE    ] OBDC: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T20:21:08.147671] [INFO ] [REMOTE    ] OBDC: Fetching primary data for 2025-07.
[2025-10-24T20:21:08.245882] [INFO ] [REMOTE    ] NYT: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T20:21:08.947674] [INFO ] [REMOTE    ] NYT: Fetching primary data for 2025-10.
[2025-10-24T20:21:09.747634] [INFO ] [REMOTE    ] OBK: Fetching primary data for 2025-01.
[2025-10-24T20:21:09.864465] [INFO ] [REMOTE    ] O: Incremental fetch complete for 2025-07 (2.51 seconds).
[2025-10-24T20:21:09.921015] [INFO ] [REMOTE    ] OBDC: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T20:21:10.516966] [INFO ] [REMOTE    ] OBK: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T20:21:10.547598] [INFO ] [REMOTE    ] OBDC: Fetching primary data for 2025-08.
[2025-10-24T20:21:10.644257] [INFO ] [REMOTE    ] NYT: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T20:21:10.653135] [INFO ] [REMOTE    ] NYT: Full fetch complete (72183 records).
[2025-10-24T20:21:10.653264] [DEBUG] [VALIDATOR ] NYT: Validating primary data.
[2025-10-24T20:21:11.045739] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present.
[2025-10-24T20:21:11.045876] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed.
[2025-10-24T20:21:11.046991] [INFO ] [MAIN      ] NYT: Fetched primary data is valid.
[2025-10-24T20:21:11.047051] [DEBUG] [LOCAL     ] NYT: Saving primary data.
[2025-10-24T20:21:11.047715] [FATAL] [LOCAL     ] NYT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:21:11.047795] [FATAL] [MAIN      ] NYT: Failed to save primary data.
[2025-10-24T20:21:11.047858] [WARN ] [MAIN      ] NYT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:21:11.047926] [INFO ] [LOCAL     ] NYT: Starting deletion of primary data.
[2025-10-24T20:21:11.047986] [DEBUG] [LOCAL     ] NYT: No primary data file found to delete.
[2025-10-24T20:21:11.048021] [INFO ] [LOCAL     ] NYT: Starting deletion of derivative data.
[2025-10-24T20:21:11.048183] [DEBUG] [LOCAL     ] NYT: Deleted derivative data file.
[2025-10-24T20:21:11.048678] [INFO ] [MAIN      ] Update Progress: 1566/2366 symbols completed. NYT took 36.6s. Estimated remaining: 1h 42m 45s. Rate: 7.8 symbols/min
[2025-10-24T20:21:11.236203] [INFO ] [MAIN      ] OC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:21:11.280358] [DEBUG] [LOCAL     ] OC: Loaded 45203 existing records from primary storage.
[2025-10-24T20:21:11.280750] [INFO ] [MAIN      ] OC: Loaded 45203 existing records.
[2025-10-24T20:21:11.354759] [INFO ] [REMOTE    ] O: Fetching primary data for 2025-08.
[2025-10-24T20:21:11.460089] [WARN ] [MAIN      ] OC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:21:11.460274] [INFO ] [MAIN      ] OC: Wiping existing primary data before full refresh.
[2025-10-24T20:21:11.460320] [INFO ] [LOCAL     ] OC: Starting deletion of primary data.
[2025-10-24T20:21:11.461209] [DEBUG] [LOCAL     ] OC: Deleted primary data file.
[2025-10-24T20:21:11.461265] [INFO ] [MAIN      ] OC: Starting full primary refresh.
[2025-10-24T20:21:11.814931] [INFO ] [REMOTE    ] OC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:21:12.147622] [INFO ] [REMOTE    ] OBK: Fetching primary data for 2025-02.
[2025-10-24T20:21:12.288410] [INFO ] [REMOTE    ] OBDC: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T20:21:12.947784] [INFO ] [REMOTE    ] OC: Fetching primary data for 2025-01.
[2025-10-24T20:21:13.176732] [INFO ] [REMOTE    ] OBK: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T20:21:13.577620] [INFO ] [REMOTE    ] O: Incremental fetch complete for 2025-08 (2.22 seconds).
[2025-10-24T20:21:13.747615] [INFO ] [REMOTE    ] O: Fetching primary data for 2025-09.
[2025-10-24T20:21:14.445058] [INFO ] [REMOTE    ] OC: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T20:21:14.547684] [INFO ] [REMOTE    ] OC: Fetching primary data for 2025-02.
[2025-10-24T20:21:15.347794] [INFO ] [REMOTE    ] OBK: Fetching primary data for 2025-03.
[2025-10-24T20:21:16.106305] [INFO ] [REMOTE    ] O: Incremental fetch complete for 2025-09 (2.36 seconds).
[2025-10-24T20:21:16.147600] [INFO ] [REMOTE    ] O: Fetching primary data for 2025-10.
[2025-10-24T20:21:16.184005] [INFO ] [REMOTE    ] OC: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T20:21:16.461170] [INFO ] [REMOTE    ] OBK: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T20:21:16.947676] [INFO ] [REMOTE    ] OBDC: Fetching primary data for 2025-09.
[2025-10-24T20:21:17.747741] [INFO ] [REMOTE    ] OC: Fetching primary data for 2025-03.
[2025-10-24T20:21:18.481525] [INFO ] [REMOTE    ] O: Incremental fetch complete for 2025-10 (2.33 seconds).
[2025-10-24T20:21:18.491282] [INFO ] [REMOTE    ] O: Full fetch complete (77182 records).
[2025-10-24T20:21:18.491454] [DEBUG] [VALIDATOR ] O: Validating primary data.
[2025-10-24T20:21:18.492263] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:21:18.492355] [FATAL] [MAIN      ] O: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:21:18.492399] [WARN ] [MAIN      ] O: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:21:18.492438] [INFO ] [LOCAL     ] O: Starting deletion of primary data.
[2025-10-24T20:21:18.492494] [DEBUG] [LOCAL     ] O: No primary data file found to delete.
[2025-10-24T20:21:18.492528] [INFO ] [LOCAL     ] O: Starting deletion of derivative data.
[2025-10-24T20:21:18.492567] [DEBUG] [LOCAL     ] O: No derivative data file found to delete.
[2025-10-24T20:21:18.492792] [INFO ] [MAIN      ] Update Progress: 1567/2366 symbols completed. O took 34.9s. Estimated remaining: 1h 42m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:21:18.560799] [INFO ] [REMOTE    ] OBK: Fetching primary data for 2025-04.
[2025-10-24T20:21:18.670615] [INFO ] [MAIN      ] OCFT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:21:18.681492] [DEBUG] [LOCAL     ] OCFT: Loaded 7130 existing records from primary storage.
[2025-10-24T20:21:18.681732] [INFO ] [MAIN      ] OCFT: Loaded 7130 existing records.
[2025-10-24T20:21:18.898519] [WARN ] [MAIN      ] OCFT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:21:18.898947] [INFO ] [MAIN      ] OCFT: Wiping existing primary data before full refresh.
[2025-10-24T20:21:18.899024] [INFO ] [LOCAL     ] OCFT: Starting deletion of primary data.
[2025-10-24T20:21:18.899638] [DEBUG] [LOCAL     ] OCFT: Deleted primary data file.
[2025-10-24T20:21:18.899733] [INFO ] [MAIN      ] OCFT: Starting full primary refresh.
[2025-10-24T20:21:19.113171] [INFO ] [REMOTE    ] OBDC: Incremental fetch complete for 2025-09 (2.17 seconds).
[2025-10-24T20:21:19.301430] [INFO ] [REMOTE    ] OCFT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:21:19.347673] [INFO ] [REMOTE    ] OBDC: Fetching primary data for 2025-10.
[2025-10-24T20:21:19.771863] [INFO ] [REMOTE    ] OC: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T20:21:19.794135] [INFO ] [REMOTE    ] OBK: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T20:21:20.147714] [INFO ] [REMOTE    ] OBK: Fetching primary data for 2025-05.
[2025-10-24T20:21:20.947638] [INFO ] [REMOTE    ] OC: Fetching primary data for 2025-04.
[2025-10-24T20:21:21.046491] [INFO ] [REMOTE    ] OBDC: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T20:21:21.056702] [INFO ] [REMOTE    ] OBDC: Full fetch complete (75414 records).
[2025-10-24T20:21:21.056872] [DEBUG] [VALIDATOR ] OBDC: Validating primary data.
[2025-10-24T20:21:21.381384] [INFO ] [REMOTE    ] OBK: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T20:21:21.478949] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present.
[2025-10-24T20:21:21.479035] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed.
[2025-10-24T20:21:21.480309] [INFO ] [MAIN      ] OBDC: Fetched primary data is valid.
[2025-10-24T20:21:21.480395] [DEBUG] [LOCAL     ] OBDC: Saving primary data.
[2025-10-24T20:21:21.481090] [FATAL] [LOCAL     ] OBDC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:21:21.481184] [FATAL] [MAIN      ] OBDC: Failed to save primary data.
[2025-10-24T20:21:21.481227] [WARN ] [MAIN      ] OBDC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:21:21.481298] [INFO ] [LOCAL     ] OBDC: Starting deletion of primary data.
[2025-10-24T20:21:21.481399] [DEBUG] [LOCAL     ] OBDC: No primary data file found to delete.
[2025-10-24T20:21:21.481444] [INFO ] [LOCAL     ] OBDC: Starting deletion of derivative data.
[2025-10-24T20:21:21.481602] [DEBUG] [LOCAL     ] OBDC: Deleted derivative data file.
[2025-10-24T20:21:21.481894] [INFO ] [MAIN      ] Update Progress: 1568/2366 symbols completed. OBDC took 34.2s. Estimated remaining: 1h 42m 27s. Rate: 7.8 symbols/min
[2025-10-24T20:21:21.666538] [INFO ] [MAIN      ] ODC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:21:21.676824] [DEBUG] [LOCAL     ] ODC: Loaded 8741 existing records from primary storage.
[2025-10-24T20:21:21.677050] [INFO ] [MAIN      ] ODC: Loaded 8741 existing records.
[2025-10-24T20:21:21.752841] [INFO ] [REMOTE    ] OCFT: Fetching primary data for 2025-01.
[2025-10-24T20:21:21.877176] [WARN ] [MAIN      ] ODC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:21:21.877452] [INFO ] [MAIN      ] ODC: Wiping existing primary data before full refresh.
[2025-10-24T20:21:21.877504] [INFO ] [LOCAL     ] ODC: Starting deletion of primary data.
[2025-10-24T20:21:21.877782] [DEBUG] [LOCAL     ] ODC: Deleted primary data file.
[2025-10-24T20:21:21.877840] [INFO ] [MAIN      ] ODC: Starting full primary refresh.
[2025-10-24T20:21:22.236080] [INFO ] [REMOTE    ] ODC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:21:22.450749] [INFO ] [REMOTE    ] OCFT: Incremental fetch complete for 2025-01 (0.70 seconds).
[2025-10-24T20:21:22.481251] [INFO ] [REMOTE    ] OC: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T20:21:22.547617] [INFO ] [REMOTE    ] OCFT: Fetching primary data for 2025-02.
[2025-10-24T20:21:23.280851] [INFO ] [REMOTE    ] OCFT: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T20:21:23.347674] [INFO ] [REMOTE    ] ODC: Fetching primary data for 2025-01.
[2025-10-24T20:21:24.102065] [INFO ] [REMOTE    ] ODC: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T20:21:24.147622] [INFO ] [REMOTE    ] OCFT: Fetching primary data for 2025-03.
[2025-10-24T20:21:24.947683] [INFO ] [REMOTE    ] OC: Fetching primary data for 2025-05.
[2025-10-24T20:21:25.334026] [INFO ] [REMOTE    ] OCFT: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T20:21:25.747668] [INFO ] [REMOTE    ] OCFT: Fetching primary data for 2025-04.
[2025-10-24T20:21:26.547619] [INFO ] [REMOTE    ] ODC: Fetching primary data for 2025-02.
[2025-10-24T20:21:26.612199] [INFO ] [REMOTE    ] OC: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T20:21:26.655462] [INFO ] [REMOTE    ] OCFT: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T20:21:27.211620] [INFO ] [REMOTE    ] ODC: Incremental fetch complete for 2025-02 (0.66 seconds).
[2025-10-24T20:21:27.347623] [INFO ] [REMOTE    ] OCFT: Fetching primary data for 2025-05.
[2025-10-24T20:21:28.147628] [INFO ] [REMOTE    ] ODC: Fetching primary data for 2025-03.
[2025-10-24T20:21:28.256447] [INFO ] [REMOTE    ] OCFT: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T20:21:28.947668] [INFO ] [REMOTE    ] OCFT: Fetching primary data for 2025-06.
[2025-10-24T20:21:28.979842] [INFO ] [REMOTE    ] ODC: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T20:21:29.747718] [INFO ] [REMOTE    ] OBK: Fetching primary data for 2025-06.
[2025-10-24T20:21:29.833833] [INFO ] [REMOTE    ] OCFT: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T20:21:30.547711] [INFO ] [REMOTE    ] OCFT: Fetching primary data for 2025-07.
[2025-10-24T20:21:30.961126] [INFO ] [REMOTE    ] OBK: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T20:21:31.347705] [INFO ] [REMOTE    ] OBK: Fetching primary data for 2025-07.
[2025-10-24T20:21:31.485310] [INFO ] [REMOTE    ] OCFT: Incremental fetch complete for 2025-07 (0.94 seconds).
[2025-10-24T20:21:32.147711] [INFO ] [REMOTE    ] OCFT: Fetching primary data for 2025-08.
[2025-10-24T20:21:32.450595] [INFO ] [REMOTE    ] OBK: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T20:21:32.947710] [INFO ] [REMOTE    ] OC: Fetching primary data for 2025-06.
[2025-10-24T20:21:32.967217] [INFO ] [REMOTE    ] OCFT: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T20:21:33.747753] [INFO ] [REMOTE    ] OCFT: Fetching primary data for 2025-09.
[2025-10-24T20:21:34.547677] [INFO ] [REMOTE    ] OBK: Fetching primary data for 2025-08.
[2025-10-24T20:21:34.678699] [INFO ] [REMOTE    ] OCFT: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T20:21:34.704868] [INFO ] [REMOTE    ] OC: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T20:21:35.347679] [INFO ] [REMOTE    ] OC: Fetching primary data for 2025-07.
[2025-10-24T20:21:35.599223] [INFO ] [REMOTE    ] OBK: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T20:21:36.147620] [INFO ] [REMOTE    ] ODC: Fetching primary data for 2025-04.
[2025-10-24T20:21:36.947631] [INFO ] [REMOTE    ] OCFT: Fetching primary data for 2025-10.
[2025-10-24T20:21:37.000701] [INFO ] [REMOTE    ] OC: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T20:21:37.062451] [INFO ] [REMOTE    ] ODC: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T20:21:37.572849] [INFO ] [REMOTE    ] OCFT: Incremental fetch complete for 2025-10 (0.63 seconds).
[2025-10-24T20:21:37.573992] [INFO ] [REMOTE    ] OCFT: Full fetch complete (11694 records).
[2025-10-24T20:21:37.574094] [DEBUG] [VALIDATOR ] OCFT: Validating primary data.
[2025-10-24T20:21:37.755760] [INFO ] [REMOTE    ] ODC: Fetching primary data for 2025-05.
[2025-10-24T20:21:37.979871] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present.
[2025-10-24T20:21:37.979955] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed.
[2025-10-24T20:21:37.980246] [INFO ] [MAIN      ] OCFT: Fetched primary data is valid.
[2025-10-24T20:21:37.980305] [DEBUG] [LOCAL     ] OCFT: Saving primary data.
[2025-10-24T20:21:37.980514] [FATAL] [LOCAL     ] OCFT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:21:37.980597] [FATAL] [MAIN      ] OCFT: Failed to save primary data.
[2025-10-24T20:21:37.980638] [WARN ] [MAIN      ] OCFT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:21:37.980719] [INFO ] [LOCAL     ] OCFT: Starting deletion of primary data.
[2025-10-24T20:21:37.980771] [DEBUG] [LOCAL     ] OCFT: No primary data file found to delete.
[2025-10-24T20:21:37.980806] [INFO ] [LOCAL     ] OCFT: Starting deletion of derivative data.
[2025-10-24T20:21:37.980951] [DEBUG] [LOCAL     ] OCFT: Deleted derivative data file.
[2025-10-24T20:21:37.981020] [INFO ] [MAIN      ] Update Progress: 1569/2366 symbols completed. OCFT took 19.5s. Estimated remaining: 1h 42m 24s. Rate: 7.8 symbols/min
[2025-10-24T20:21:38.145601] [INFO ] [MAIN      ] ODV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:21:38.174906] [DEBUG] [LOCAL     ] ODV: Loaded 30299 existing records from primary storage.
[2025-10-24T20:21:38.175165] [INFO ] [MAIN      ] ODV: Loaded 30299 existing records.
[2025-10-24T20:21:38.351845] [WARN ] [MAIN      ] ODV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:21:38.352083] [INFO ] [MAIN      ] ODV: Wiping existing primary data before full refresh.
[2025-10-24T20:21:38.352132] [INFO ] [LOCAL     ] ODV: Starting deletion of primary data.
[2025-10-24T20:21:38.352694] [DEBUG] [LOCAL     ] ODV: Deleted primary data file.
[2025-10-24T20:21:38.352752] [INFO ] [MAIN      ] ODV: Starting full primary refresh.
[2025-10-24T20:21:38.553089] [INFO ] [REMOTE    ] OC: Fetching primary data for 2025-08.
[2025-10-24T20:21:38.725901] [INFO ] [REMOTE    ] ODC: Incremental fetch complete for 2025-05 (0.97 seconds).
[2025-10-24T20:21:38.751367] [INFO ] [REMOTE    ] ODV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:21:39.347699] [INFO ] [REMOTE    ] OBK: Fetching primary data for 2025-09.
[2025-10-24T20:21:40.147624] [INFO ] [REMOTE    ] ODC: Fetching primary data for 2025-06.
[2025-10-24T20:21:40.319409] [INFO ] [REMOTE    ] OC: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T20:21:40.450395] [INFO ] [REMOTE    ] OBK: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T20:21:40.947707] [INFO ] [REMOTE    ] OBK: Fetching primary data for 2025-10.
[2025-10-24T20:21:41.014555] [INFO ] [REMOTE    ] ODC: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T20:21:41.747621] [INFO ] [REMOTE    ] ODV: Fetching primary data for 2025-01.
[2025-10-24T20:21:41.937554] [INFO ] [REMOTE    ] OBK: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T20:21:41.941025] [INFO ] [REMOTE    ] OBK: Full fetch complete (23935 records).
[2025-10-24T20:21:41.941101] [DEBUG] [VALIDATOR ] OBK: Validating primary data.
[2025-10-24T20:21:42.310228] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present.
[2025-10-24T20:21:42.310314] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed.
[2025-10-24T20:21:42.310874] [INFO ] [MAIN      ] OBK: Fetched primary data is valid.
[2025-10-24T20:21:42.310934] [DEBUG] [LOCAL     ] OBK: Saving primary data.
[2025-10-24T20:21:42.311223] [FATAL] [LOCAL     ] OBK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:21:42.311296] [FATAL] [MAIN      ] OBK: Failed to save primary data.
[2025-10-24T20:21:42.311361] [WARN ] [MAIN      ] OBK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:21:42.311443] [INFO ] [LOCAL     ] OBK: Starting deletion of primary data.
[2025-10-24T20:21:42.311501] [DEBUG] [LOCAL     ] OBK: No primary data file found to delete.
[2025-10-24T20:21:42.311537] [INFO ] [LOCAL     ] OBK: Starting deletion of derivative data.
[2025-10-24T20:21:42.311714] [DEBUG] [LOCAL     ] OBK: Deleted derivative data file.
[2025-10-24T20:21:42.311800] [INFO ] [MAIN      ] Update Progress: 1570/2366 symbols completed. OBK took 35.7s. Estimated remaining: 1h 42m 14s. Rate: 7.8 symbols/min
[2025-10-24T20:21:42.482452] [INFO ] [MAIN      ] OEC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:21:42.497478] [INFO ] [REMOTE    ] ODV: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T20:21:42.525880] [DEBUG] [LOCAL     ] OEC: Loaded 37414 existing records from primary storage.
[2025-10-24T20:21:42.526157] [INFO ] [MAIN      ] OEC: Loaded 37414 existing records.
[2025-10-24T20:21:42.555049] [INFO ] [REMOTE    ] ODC: Fetching primary data for 2025-07.
[2025-10-24T20:21:42.705404] [WARN ] [MAIN      ] OEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:21:42.705628] [INFO ] [MAIN      ] OEC: Wiping existing primary data before full refresh.
[2025-10-24T20:21:42.705710] [INFO ] [LOCAL     ] OEC: Starting deletion of primary data.
[2025-10-24T20:21:42.706373] [DEBUG] [LOCAL     ] OEC: Deleted primary data file.
[2025-10-24T20:21:42.706428] [INFO ] [MAIN      ] OEC: Starting full primary refresh.
[2025-10-24T20:21:43.053638] [INFO ] [REMOTE    ] OEC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:21:43.347668] [INFO ] [REMOTE    ] OC: Fetching primary data for 2025-09.
[2025-10-24T20:21:43.417448] [INFO ] [REMOTE    ] ODC: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T20:21:44.147681] [INFO ] [REMOTE    ] ODC: Fetching primary data for 2025-08.
[2025-10-24T20:21:44.879430] [INFO ] [REMOTE    ] ODC: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T20:21:44.947611] [INFO ] [REMOTE    ] OEC: Fetching primary data for 2025-01.
[2025-10-24T20:21:45.132784] [INFO ] [REMOTE    ] OC: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T20:21:45.747674] [INFO ] [REMOTE    ] ODV: Fetching primary data for 2025-02.
[2025-10-24T20:21:46.327714] [INFO ] [REMOTE    ] OEC: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T20:21:46.547636] [INFO ] [REMOTE    ] ODC: Fetching primary data for 2025-09.
[2025-10-24T20:21:46.760369] [INFO ] [REMOTE    ] ODV: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T20:21:47.117505] [INFO ] [REMOTE    ] ODC: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T20:21:47.347670] [INFO ] [REMOTE    ] ODC: Fetching primary data for 2025-10.
[2025-10-24T20:21:48.147632] [INFO ] [REMOTE    ] ODV: Fetching primary data for 2025-03.
[2025-10-24T20:21:48.188894] [INFO ] [REMOTE    ] ODC: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T20:21:48.191127] [INFO ] [REMOTE    ] ODC: Full fetch complete (11477 records).
[2025-10-24T20:21:48.191203] [DEBUG] [VALIDATOR ] ODC: Validating primary data.
[2025-10-24T20:21:48.568454] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present.
[2025-10-24T20:21:48.568534] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed.
[2025-10-24T20:21:48.568859] [INFO ] [MAIN      ] ODC: Fetched primary data is valid.
[2025-10-24T20:21:48.568921] [DEBUG] [LOCAL     ] ODC: Saving primary data.
[2025-10-24T20:21:48.569168] [FATAL] [LOCAL     ] ODC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:21:48.569282] [FATAL] [MAIN      ] ODC: Failed to save primary data.
[2025-10-24T20:21:48.569357] [WARN ] [MAIN      ] ODC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:21:48.569469] [INFO ] [LOCAL     ] ODC: Starting deletion of primary data.
[2025-10-24T20:21:48.569547] [DEBUG] [LOCAL     ] ODC: No primary data file found to delete.
[2025-10-24T20:21:48.569585] [INFO ] [LOCAL     ] ODC: Starting deletion of derivative data.
[2025-10-24T20:21:48.569777] [DEBUG] [LOCAL     ] ODC: Deleted derivative data file.
[2025-10-24T20:21:48.569873] [INFO ] [MAIN      ] Update Progress: 1571/2366 symbols completed. ODC took 27.1s. Estimated remaining: 1h 42m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:21:48.752800] [INFO ] [MAIN      ] OFG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:21:48.774021] [DEBUG] [LOCAL     ] OFG: Loaded 20730 existing records from primary storage.
[2025-10-24T20:21:48.774285] [INFO ] [MAIN      ] OFG: Loaded 20730 existing records.
[2025-10-24T20:21:48.952483] [INFO ] [REMOTE    ] OEC: Fetching primary data for 2025-02.
[2025-10-24T20:21:48.958035] [WARN ] [MAIN      ] OFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:21:48.959086] [INFO ] [MAIN      ] OFG: Wiping existing primary data before full refresh.
[2025-10-24T20:21:48.959135] [INFO ] [LOCAL     ] OFG: Starting deletion of primary data.
[2025-10-24T20:21:48.959366] [DEBUG] [LOCAL     ] OFG: Deleted primary data file.
[2025-10-24T20:21:48.959405] [INFO ] [MAIN      ] OFG: Starting full primary refresh.
[2025-10-24T20:21:49.238629] [INFO ] [REMOTE    ] ODV: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T20:21:49.364034] [INFO ] [REMOTE    ] OFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:21:49.747693] [INFO ] [REMOTE    ] ODV: Fetching primary data for 2025-04.
[2025-10-24T20:21:50.547616] [INFO ] [REMOTE    ] OFG: Fetching primary data for 2025-01.
[2025-10-24T20:21:50.586498] [INFO ] [REMOTE    ] OEC: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T20:21:50.870391] [INFO ] [REMOTE    ] ODV: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T20:21:51.347704] [INFO ] [REMOTE    ] OEC: Fetching primary data for 2025-03.
[2025-10-24T20:21:52.012438] [INFO ] [REMOTE    ] OFG: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T20:21:52.147705] [INFO ] [REMOTE    ] OFG: Fetching primary data for 2025-02.
[2025-10-24T20:21:52.568129] [INFO ] [REMOTE    ] OEC: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T20:21:52.947772] [INFO ] [REMOTE    ] ODV: Fetching primary data for 2025-05.
[2025-10-24T20:21:53.747746] [INFO ] [REMOTE    ] OC: Fetching primary data for 2025-10.
[2025-10-24T20:21:53.781073] [INFO ] [REMOTE    ] OFG: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T20:21:54.121580] [INFO ] [REMOTE    ] ODV: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T20:21:54.547668] [INFO ] [REMOTE    ] OEC: Fetching primary data for 2025-04.
[2025-10-24T20:21:55.347618] [INFO ] [REMOTE    ] OFG: Fetching primary data for 2025-03.
[2025-10-24T20:21:55.535880] [INFO ] [REMOTE    ] OC: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T20:21:55.544726] [INFO ] [REMOTE    ] OC: Full fetch complete (64987 records).
[2025-10-24T20:21:55.544841] [DEBUG] [VALIDATOR ] OC: Validating primary data.
[2025-10-24T20:21:55.931790] [DEBUG] [VALIDATOR ] OC: All expected trading days are present.
[2025-10-24T20:21:55.931883] [DEBUG] [VALIDATOR ] OC: Primary data validation passed.
[2025-10-24T20:21:55.932989] [INFO ] [MAIN      ] OC: Fetched primary data is valid.
[2025-10-24T20:21:55.933052] [DEBUG] [LOCAL     ] OC: Saving primary data.
[2025-10-24T20:21:55.933638] [FATAL] [LOCAL     ] OC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:21:55.933753] [FATAL] [MAIN      ] OC: Failed to save primary data.
[2025-10-24T20:21:55.933825] [WARN ] [MAIN      ] OC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:21:55.933931] [INFO ] [LOCAL     ] OC: Starting deletion of primary data.
[2025-10-24T20:21:55.934009] [DEBUG] [LOCAL     ] OC: No primary data file found to delete.
[2025-10-24T20:21:55.934047] [INFO ] [LOCAL     ] OC: Starting deletion of derivative data.
[2025-10-24T20:21:55.934211] [DEBUG] [LOCAL     ] OC: Deleted derivative data file.
[2025-10-24T20:21:55.934357] [INFO ] [MAIN      ] Update Progress: 1572/2366 symbols completed. OC took 44.9s. Estimated remaining: 1h 41m 58s. Rate: 7.8 symbols/min
[2025-10-24T20:21:56.115158] [INFO ] [MAIN      ] OGE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:21:56.140259] [INFO ] [REMOTE    ] OEC: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T20:21:56.148887] [INFO ] [REMOTE    ] ODV: Fetching primary data for 2025-06.
[2025-10-24T20:21:56.187733] [DEBUG] [LOCAL     ] OGE: Loaded 46128 existing records from primary storage.
[2025-10-24T20:21:56.188016] [INFO ] [MAIN      ] OGE: Loaded 46128 existing records.
[2025-10-24T20:21:56.366035] [WARN ] [MAIN      ] OGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:21:56.366305] [INFO ] [MAIN      ] OGE: Wiping existing primary data before full refresh.
[2025-10-24T20:21:56.366497] [INFO ] [LOCAL     ] OGE: Starting deletion of primary data.
[2025-10-24T20:21:56.367357] [DEBUG] [LOCAL     ] OGE: Deleted primary data file.
[2025-10-24T20:21:56.367425] [INFO ] [MAIN      ] OGE: Starting full primary refresh.
[2025-10-24T20:21:56.701289] [INFO ] [REMOTE    ] OFG: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T20:21:56.754611] [INFO ] [REMOTE    ] OGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:21:56.947605] [INFO ] [REMOTE    ] OGE: Fetching primary data for 2025-01.
[2025-10-24T20:21:57.269173] [INFO ] [REMOTE    ] ODV: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T20:21:57.747713] [INFO ] [REMOTE    ] ODV: Fetching primary data for 2025-07.
[2025-10-24T20:21:58.547628] [INFO ] [REMOTE    ] OEC: Fetching primary data for 2025-05.
[2025-10-24T20:21:58.740485] [INFO ] [REMOTE    ] OGE: Incremental fetch complete for 2025-01 (1.79 seconds).
[2025-10-24T20:21:59.036358] [INFO ] [REMOTE    ] ODV: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T20:21:59.347857] [INFO ] [REMOTE    ] OGE: Fetching primary data for 2025-02.
[2025-10-24T20:22:00.147704] [INFO ] [REMOTE    ] ODV: Fetching primary data for 2025-08.
[2025-10-24T20:22:00.185765] [INFO ] [REMOTE    ] OEC: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T20:22:00.957402] [INFO ] [REMOTE    ] OEC: Fetching primary data for 2025-06.
[2025-10-24T20:22:00.959579] [INFO ] [REMOTE    ] OGE: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T20:22:01.392553] [INFO ] [REMOTE    ] ODV: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T20:22:01.747723] [INFO ] [REMOTE    ] OGE: Fetching primary data for 2025-03.
[2025-10-24T20:22:02.547727] [INFO ] [REMOTE    ] OFG: Fetching primary data for 2025-04.
[2025-10-24T20:22:02.677829] [INFO ] [REMOTE    ] OEC: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T20:22:03.125859] [INFO ] [REMOTE    ] OGE: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T20:22:03.347712] [INFO ] [REMOTE    ] ODV: Fetching primary data for 2025-09.
[2025-10-24T20:22:03.952153] [INFO ] [REMOTE    ] OFG: Incremental fetch complete for 2025-04 (1.40 seconds).
[2025-10-24T20:22:04.147714] [INFO ] [REMOTE    ] OEC: Fetching primary data for 2025-07.
[2025-10-24T20:22:04.899168] [INFO ] [REMOTE    ] ODV: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T20:22:04.947606] [INFO ] [REMOTE    ] ODV: Fetching primary data for 2025-10.
[2025-10-24T20:22:05.751387] [INFO ] [REMOTE    ] OFG: Fetching primary data for 2025-05.
[2025-10-24T20:22:05.754025] [INFO ] [REMOTE    ] OEC: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T20:22:06.547627] [INFO ] [REMOTE    ] OEC: Fetching primary data for 2025-08.
[2025-10-24T20:22:06.693799] [INFO ] [REMOTE    ] ODV: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T20:22:06.702555] [INFO ] [REMOTE    ] ODV: Full fetch complete (36564 records).
[2025-10-24T20:22:06.702700] [DEBUG] [VALIDATOR ] ODV: Validating primary data.
[2025-10-24T20:22:07.086200] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present.
[2025-10-24T20:22:07.086402] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed.
[2025-10-24T20:22:07.087232] [INFO ] [MAIN      ] ODV: Fetched primary data is valid.
[2025-10-24T20:22:07.087338] [DEBUG] [LOCAL     ] ODV: Saving primary data.
[2025-10-24T20:22:07.087857] [FATAL] [LOCAL     ] ODV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:22:07.088033] [FATAL] [MAIN      ] ODV: Failed to save primary data.
[2025-10-24T20:22:07.088101] [WARN ] [MAIN      ] ODV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:22:07.088168] [INFO ] [LOCAL     ] ODV: Starting deletion of primary data.
[2025-10-24T20:22:07.088230] [DEBUG] [LOCAL     ] ODV: No primary data file found to delete.
[2025-10-24T20:22:07.088266] [INFO ] [LOCAL     ] ODV: Starting deletion of derivative data.
[2025-10-24T20:22:07.088460] [DEBUG] [LOCAL     ] ODV: Deleted derivative data file.
[2025-10-24T20:22:07.088557] [INFO ] [MAIN      ] Update Progress: 1573/2366 symbols completed. ODV took 29.1s. Estimated remaining: 1h 41m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:22:07.254712] [INFO ] [REMOTE    ] OFG: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T20:22:07.308787] [INFO ] [MAIN      ] OGN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:22:07.358593] [INFO ] [REMOTE    ] OFG: Fetching primary data for 2025-06.
[2025-10-24T20:22:07.361765] [DEBUG] [LOCAL     ] OGN: Loaded 53494 existing records from primary storage.
[2025-10-24T20:22:07.362187] [INFO ] [MAIN      ] OGN: Loaded 53494 existing records.
[2025-10-24T20:22:07.540055] [WARN ] [MAIN      ] OGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:22:07.540278] [INFO ] [MAIN      ] OGN: Wiping existing primary data before full refresh.
[2025-10-24T20:22:07.540329] [INFO ] [LOCAL     ] OGN: Starting deletion of primary data.
[2025-10-24T20:22:07.540563] [DEBUG] [LOCAL     ] OGN: Deleted primary data file.
[2025-10-24T20:22:07.540604] [INFO ] [MAIN      ] OGN: Starting full primary refresh.
[2025-10-24T20:22:07.896971] [INFO ] [REMOTE    ] OGN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:22:07.921328] [INFO ] [REMOTE    ] OEC: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T20:22:08.147702] [INFO ] [REMOTE    ] OGE: Fetching primary data for 2025-04.
[2025-10-24T20:22:08.551862] [INFO ] [REMOTE    ] OFG: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T20:22:08.947692] [INFO ] [REMOTE    ] OGN: Fetching primary data for 2025-01.
[2025-10-24T20:22:09.747704] [INFO ] [REMOTE    ] OEC: Fetching primary data for 2025-09.
[2025-10-24T20:22:09.952196] [INFO ] [REMOTE    ] OGE: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T20:22:10.547707] [INFO ] [REMOTE    ] OGE: Fetching primary data for 2025-05.
[2025-10-24T20:22:10.868277] [INFO ] [REMOTE    ] OGN: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T20:22:11.225294] [INFO ] [REMOTE    ] OEC: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T20:22:11.347706] [INFO ] [REMOTE    ] OEC: Fetching primary data for 2025-10.
[2025-10-24T20:22:12.147626] [INFO ] [REMOTE    ] OGN: Fetching primary data for 2025-02.
[2025-10-24T20:22:12.186523] [INFO ] [REMOTE    ] OGE: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T20:22:12.447986] [INFO ] [REMOTE    ] OEC: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T20:22:12.454973] [INFO ] [REMOTE    ] OEC: Full fetch complete (53631 records).
[2025-10-24T20:22:12.455065] [DEBUG] [VALIDATOR ] OEC: Validating primary data.
[2025-10-24T20:22:12.836377] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present.
[2025-10-24T20:22:12.836459] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed.
[2025-10-24T20:22:12.837491] [INFO ] [MAIN      ] OEC: Fetched primary data is valid.
[2025-10-24T20:22:12.837554] [DEBUG] [LOCAL     ] OEC: Saving primary data.
[2025-10-24T20:22:12.838048] [FATAL] [LOCAL     ] OEC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:22:12.838128] [FATAL] [MAIN      ] OEC: Failed to save primary data.
[2025-10-24T20:22:12.838192] [WARN ] [MAIN      ] OEC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:22:12.838257] [INFO ] [LOCAL     ] OEC: Starting deletion of primary data.
[2025-10-24T20:22:12.838318] [DEBUG] [LOCAL     ] OEC: No primary data file found to delete.
[2025-10-24T20:22:12.838353] [INFO ] [LOCAL     ] OEC: Starting deletion of derivative data.
[2025-10-24T20:22:12.838496] [DEBUG] [LOCAL     ] OEC: Deleted derivative data file.
[2025-10-24T20:22:12.838702] [INFO ] [MAIN      ] Update Progress: 1574/2366 symbols completed. OEC took 30.5s. Estimated remaining: 1h 41m 44s. Rate: 7.8 symbols/min
[2025-10-24T20:22:12.952831] [INFO ] [REMOTE    ] OFG: Fetching primary data for 2025-07.
[2025-10-24T20:22:13.010196] [INFO ] [MAIN      ] OGS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:22:13.043887] [DEBUG] [LOCAL     ] OGS: Loaded 34115 existing records from primary storage.
[2025-10-24T20:22:13.044140] [INFO ] [MAIN      ] OGS: Loaded 34115 existing records.
[2025-10-24T20:22:13.218666] [WARN ] [MAIN      ] OGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:22:13.218861] [INFO ] [MAIN      ] OGS: Wiping existing primary data before full refresh.
[2025-10-24T20:22:13.218915] [INFO ] [LOCAL     ] OGS: Starting deletion of primary data.
[2025-10-24T20:22:13.219124] [DEBUG] [LOCAL     ] OGS: Deleted primary data file.
[2025-10-24T20:22:13.219171] [INFO ] [MAIN      ] OGS: Starting full primary refresh.
[2025-10-24T20:22:13.580980] [INFO ] [REMOTE    ] OGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:22:13.747632] [INFO ] [REMOTE    ] OGS: Fetching primary data for 2025-01.
[2025-10-24T20:22:13.867189] [INFO ] [REMOTE    ] OGN: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T20:22:13.930807] [INFO ] [REMOTE    ] OFG: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T20:22:14.547722] [INFO ] [REMOTE    ] OFG: Fetching primary data for 2025-08.
[2025-10-24T20:22:15.203100] [INFO ] [REMOTE    ] OGS: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T20:22:15.347609] [INFO ] [REMOTE    ] OGS: Fetching primary data for 2025-02.
[2025-10-24T20:22:15.699381] [INFO ] [REMOTE    ] OFG: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T20:22:16.147677] [INFO ] [REMOTE    ] OFG: Fetching primary data for 2025-09.
[2025-10-24T20:22:16.638030] [INFO ] [REMOTE    ] OGS: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T20:22:16.947616] [INFO ] [REMOTE    ] OGN: Fetching primary data for 2025-03.
[2025-10-24T20:22:17.008760] [INFO ] [REMOTE    ] OFG: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T20:22:17.747703] [INFO ] [REMOTE    ] OGE: Fetching primary data for 2025-06.
[2025-10-24T20:22:18.547622] [INFO ] [REMOTE    ] OFG: Fetching primary data for 2025-10.
[2025-10-24T20:22:18.947292] [INFO ] [REMOTE    ] OGN: Incremental fetch complete for 2025-03 (2.00 seconds).
[2025-10-24T20:22:19.347622] [INFO ] [REMOTE    ] OGN: Fetching primary data for 2025-04.
[2025-10-24T20:22:19.539824] [INFO ] [REMOTE    ] OGE: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T20:22:19.597033] [INFO ] [REMOTE    ] OFG: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T20:22:19.600933] [INFO ] [REMOTE    ] OFG: Full fetch complete (33560 records).
[2025-10-24T20:22:19.601012] [DEBUG] [VALIDATOR ] OFG: Validating primary data.
[2025-10-24T20:22:19.972791] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present.
[2025-10-24T20:22:19.972871] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed.
[2025-10-24T20:22:19.973568] [INFO ] [MAIN      ] OFG: Fetched primary data is valid.
[2025-10-24T20:22:19.973629] [DEBUG] [LOCAL     ] OFG: Saving primary data.
[2025-10-24T20:22:19.973990] [FATAL] [LOCAL     ] OFG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:22:19.974069] [FATAL] [MAIN      ] OFG: Failed to save primary data.
[2025-10-24T20:22:19.974110] [WARN ] [MAIN      ] OFG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:22:19.974169] [INFO ] [LOCAL     ] OFG: Starting deletion of primary data.
[2025-10-24T20:22:19.974226] [DEBUG] [LOCAL     ] OFG: No primary data file found to delete.
[2025-10-24T20:22:19.974260] [INFO ] [LOCAL     ] OFG: Starting deletion of derivative data.
[2025-10-24T20:22:19.974427] [DEBUG] [LOCAL     ] OFG: Deleted derivative data file.
[2025-10-24T20:22:19.974518] [INFO ] [MAIN      ] Update Progress: 1575/2366 symbols completed. OFG took 31.4s. Estimated remaining: 1h 41m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:22:20.144581] [INFO ] [MAIN      ] OHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:22:20.147669] [INFO ] [REMOTE    ] OGE: Fetching primary data for 2025-07.
[2025-10-24T20:22:20.201424] [DEBUG] [LOCAL     ] OHI: Loaded 52179 existing records from primary storage.
[2025-10-24T20:22:20.201812] [INFO ] [MAIN      ] OHI: Loaded 52179 existing records.
[2025-10-24T20:22:20.395459] [WARN ] [MAIN      ] OHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:22:20.395677] [INFO ] [MAIN      ] OHI: Wiping existing primary data before full refresh.
[2025-10-24T20:22:20.395734] [INFO ] [LOCAL     ] OHI: Starting deletion of primary data.
[2025-10-24T20:22:20.396316] [DEBUG] [LOCAL     ] OHI: Deleted primary data file.
[2025-10-24T20:22:20.396371] [INFO ] [MAIN      ] OHI: Starting full primary refresh.
[2025-10-24T20:22:20.744675] [INFO ] [REMOTE    ] OHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:22:20.947624] [INFO ] [REMOTE    ] OHI: Fetching primary data for 2025-01.
[2025-10-24T20:22:21.274627] [INFO ] [REMOTE    ] OGN: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T20:22:21.747732] [INFO ] [REMOTE    ] OGN: Fetching primary data for 2025-05.
[2025-10-24T20:22:22.026816] [INFO ] [REMOTE    ] OGE: Incremental fetch complete for 2025-07 (1.88 seconds).
[2025-10-24T20:22:22.547708] [INFO ] [REMOTE    ] OGS: Fetching primary data for 2025-03.
[2025-10-24T20:22:22.674280] [INFO ] [REMOTE    ] OHI: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T20:22:23.347633] [INFO ] [REMOTE    ] OHI: Fetching primary data for 2025-02.
[2025-10-24T20:22:23.917047] [INFO ] [REMOTE    ] OGN: Incremental fetch complete for 2025-05 (2.17 seconds).
[2025-10-24T20:22:23.985432] [INFO ] [REMOTE    ] OGS: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T20:22:24.147611] [INFO ] [REMOTE    ] OGS: Fetching primary data for 2025-04.
[2025-10-24T20:22:24.947760] [INFO ] [REMOTE    ] OGE: Fetching primary data for 2025-08.
[2025-10-24T20:22:25.097240] [INFO ] [REMOTE    ] OHI: Incremental fetch complete for 2025-02 (1.75 seconds).
[2025-10-24T20:22:25.754515] [INFO ] [REMOTE    ] OGN: Fetching primary data for 2025-06.
[2025-10-24T20:22:25.768951] [INFO ] [REMOTE    ] OGS: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T20:22:26.547629] [INFO ] [REMOTE    ] OHI: Fetching primary data for 2025-03.
[2025-10-24T20:22:26.716119] [INFO ] [REMOTE    ] OGE: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T20:22:27.347700] [INFO ] [REMOTE    ] OGE: Fetching primary data for 2025-09.
[2025-10-24T20:22:27.818052] [INFO ] [REMOTE    ] OGN: Incremental fetch complete for 2025-06 (2.06 seconds).
[2025-10-24T20:22:28.004504] [INFO ] [REMOTE    ] OHI: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T20:22:28.147621] [INFO ] [REMOTE    ] OHI: Fetching primary data for 2025-04.
[2025-10-24T20:22:28.486121] [INFO ] [REMOTE    ] OGE: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T20:22:28.947636] [INFO ] [REMOTE    ] OGE: Fetching primary data for 2025-10.
[2025-10-24T20:22:29.747625] [INFO ] [REMOTE    ] OGN: Fetching primary data for 2025-07.
[2025-10-24T20:22:29.958164] [INFO ] [REMOTE    ] OHI: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T20:22:30.346457] [INFO ] [REMOTE    ] OGE: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T20:22:30.354921] [INFO ] [REMOTE    ] OGE: Full fetch complete (66827 records).
[2025-10-24T20:22:30.355040] [DEBUG] [VALIDATOR ] OGE: Validating primary data.
[2025-10-24T20:22:30.553372] [INFO ] [REMOTE    ] OHI: Fetching primary data for 2025-05.
[2025-10-24T20:22:30.749671] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present.
[2025-10-24T20:22:30.749754] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed.
[2025-10-24T20:22:30.750774] [INFO ] [MAIN      ] OGE: Fetched primary data is valid.
[2025-10-24T20:22:30.750835] [DEBUG] [LOCAL     ] OGE: Saving primary data.
[2025-10-24T20:22:30.751387] [FATAL] [LOCAL     ] OGE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:22:30.751475] [FATAL] [MAIN      ] OGE: Failed to save primary data.
[2025-10-24T20:22:30.751517] [WARN ] [MAIN      ] OGE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:22:30.751586] [INFO ] [LOCAL     ] OGE: Starting deletion of primary data.
[2025-10-24T20:22:30.751670] [DEBUG] [LOCAL     ] OGE: No primary data file found to delete.
[2025-10-24T20:22:30.751727] [INFO ] [LOCAL     ] OGE: Starting deletion of derivative data.
[2025-10-24T20:22:30.751878] [DEBUG] [LOCAL     ] OGE: Deleted derivative data file.
[2025-10-24T20:22:30.751954] [INFO ] [MAIN      ] Update Progress: 1576/2366 symbols completed. OGE took 34.8s. Estimated remaining: 1h 41m 29s. Rate: 7.8 symbols/min
[2025-10-24T20:22:30.921087] [INFO ] [MAIN      ] OI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:22:30.963109] [DEBUG] [LOCAL     ] OI: Loaded 47371 existing records from primary storage.
[2025-10-24T20:22:30.963402] [INFO ] [MAIN      ] OI: Loaded 47371 existing records.
[2025-10-24T20:22:31.137532] [WARN ] [MAIN      ] OI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:22:31.137768] [INFO ] [MAIN      ] OI: Wiping existing primary data before full refresh.
[2025-10-24T20:22:31.137817] [INFO ] [LOCAL     ] OI: Starting deletion of primary data.
[2025-10-24T20:22:31.138266] [DEBUG] [LOCAL     ] OI: Deleted primary data file.
[2025-10-24T20:22:31.138305] [INFO ] [MAIN      ] OI: Starting full primary refresh.
[2025-10-24T20:22:31.352931] [INFO ] [REMOTE    ] OGS: Fetching primary data for 2025-05.
[2025-10-24T20:22:31.496520] [INFO ] [REMOTE    ] OI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:22:31.824839] [INFO ] [REMOTE    ] OGN: Incremental fetch complete for 2025-07 (2.08 seconds).
[2025-10-24T20:22:32.075822] [INFO ] [REMOTE    ] OHI: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T20:22:32.147690] [INFO ] [REMOTE    ] OI: Fetching primary data for 2025-01.
[2025-10-24T20:22:32.947626] [INFO ] [REMOTE    ] OGN: Fetching primary data for 2025-08.
[2025-10-24T20:22:32.980552] [INFO ] [REMOTE    ] OGS: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T20:22:33.693849] [INFO ] [REMOTE    ] OI: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T20:22:33.747607] [INFO ] [REMOTE    ] OI: Fetching primary data for 2025-02.
[2025-10-24T20:22:34.547676] [INFO ] [REMOTE    ] OHI: Fetching primary data for 2025-06.
[2025-10-24T20:22:34.807383] [INFO ] [REMOTE    ] OGN: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T20:22:35.290959] [INFO ] [REMOTE    ] OI: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T20:22:35.347600] [INFO ] [REMOTE    ] OI: Fetching primary data for 2025-03.
[2025-10-24T20:22:36.147621] [INFO ] [REMOTE    ] OGN: Fetching primary data for 2025-09.
[2025-10-24T20:22:36.545575] [INFO ] [REMOTE    ] OHI: Incremental fetch complete for 2025-06 (2.00 seconds).
[2025-10-24T20:22:36.855483] [INFO ] [REMOTE    ] OI: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T20:22:36.947625] [INFO ] [REMOTE    ] OGS: Fetching primary data for 2025-06.
[2025-10-24T20:22:37.747628] [INFO ] [REMOTE    ] OHI: Fetching primary data for 2025-07.
[2025-10-24T20:22:37.895700] [INFO ] [REMOTE    ] OGN: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T20:22:38.361085] [INFO ] [REMOTE    ] OGS: Incremental fetch complete for 2025-06 (1.41 seconds).
[2025-10-24T20:22:38.547680] [INFO ] [REMOTE    ] OGN: Fetching primary data for 2025-10.
[2025-10-24T20:22:39.347680] [INFO ] [REMOTE    ] OGS: Fetching primary data for 2025-07.
[2025-10-24T20:22:39.608324] [INFO ] [REMOTE    ] OHI: Incremental fetch complete for 2025-07 (1.86 seconds).
[2025-10-24T20:22:40.147626] [INFO ] [REMOTE    ] OHI: Fetching primary data for 2025-08.
[2025-10-24T20:22:40.574153] [INFO ] [REMOTE    ] OGN: Incremental fetch complete for 2025-10 (2.03 seconds).
[2025-10-24T20:22:40.589808] [INFO ] [REMOTE    ] OGN: Full fetch complete (76936 records).
[2025-10-24T20:22:40.590036] [DEBUG] [VALIDATOR ] OGN: Validating primary data.
[2025-10-24T20:22:40.966847] [INFO ] [REMOTE    ] OGS: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T20:22:40.959216] [INFO ] [REMOTE    ] OI: Fetching primary data for 2025-04.
[2025-10-24T20:22:41.175829] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present.
[2025-10-24T20:22:41.175921] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed.
[2025-10-24T20:22:41.177586] [INFO ] [MAIN      ] OGN: Fetched primary data is valid.
[2025-10-24T20:22:41.177679] [DEBUG] [LOCAL     ] OGN: Saving primary data.
[2025-10-24T20:22:41.178355] [FATAL] [LOCAL     ] OGN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:22:41.178449] [FATAL] [MAIN      ] OGN: Failed to save primary data.
[2025-10-24T20:22:41.178491] [WARN ] [MAIN      ] OGN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:22:41.178528] [INFO ] [LOCAL     ] OGN: Starting deletion of primary data.
[2025-10-24T20:22:41.178584] [DEBUG] [LOCAL     ] OGN: No primary data file found to delete.
[2025-10-24T20:22:41.178619] [INFO ] [LOCAL     ] OGN: Starting deletion of derivative data.
[2025-10-24T20:22:41.178886] [DEBUG] [LOCAL     ] OGN: Deleted derivative data file.
[2025-10-24T20:22:41.179189] [INFO ] [MAIN      ] Update Progress: 1577/2366 symbols completed. OGN took 34.1s. Estimated remaining: 1h 41m 23s. Rate: 7.8 symbols/min
[2025-10-24T20:22:41.361568] [INFO ] [MAIN      ] OIA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:22:41.378151] [DEBUG] [LOCAL     ] OIA: Loaded 13127 existing records from primary storage.
[2025-10-24T20:22:41.378372] [INFO ] [MAIN      ] OIA: Loaded 13127 existing records.
[2025-10-24T20:22:41.560481] [WARN ] [MAIN      ] OIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:22:41.560871] [INFO ] [MAIN      ] OIA: Wiping existing primary data before full refresh.
[2025-10-24T20:22:41.561029] [INFO ] [LOCAL     ] OIA: Starting deletion of primary data.
[2025-10-24T20:22:41.561268] [DEBUG] [LOCAL     ] OIA: Deleted primary data file.
[2025-10-24T20:22:41.561324] [INFO ] [MAIN      ] OIA: Starting full primary refresh.
[2025-10-24T20:22:41.762575] [INFO ] [REMOTE    ] OGS: Fetching primary data for 2025-08.
[2025-10-24T20:22:41.939563] [INFO ] [REMOTE    ] OIA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:22:41.980897] [INFO ] [REMOTE    ] OHI: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T20:22:42.558393] [INFO ] [REMOTE    ] OIA: Fetching primary data for 2025-01.
[2025-10-24T20:22:42.563793] [INFO ] [REMOTE    ] OI: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T20:22:43.347692] [INFO ] [REMOTE    ] OI: Fetching primary data for 2025-05.
[2025-10-24T20:22:43.405416] [INFO ] [REMOTE    ] OGS: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T20:22:43.486971] [INFO ] [REMOTE    ] OIA: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T20:22:44.147638] [INFO ] [REMOTE    ] OGS: Fetching primary data for 2025-09.
[2025-10-24T20:22:44.947621] [INFO ] [REMOTE    ] OHI: Fetching primary data for 2025-09.
[2025-10-24T20:22:45.097338] [INFO ] [REMOTE    ] OI: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T20:22:45.628466] [INFO ] [REMOTE    ] OGS: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T20:22:45.747633] [INFO ] [REMOTE    ] OGS: Fetching primary data for 2025-10.
[2025-10-24T20:22:46.547625] [INFO ] [REMOTE    ] OI: Fetching primary data for 2025-06.
[2025-10-24T20:22:46.797035] [INFO ] [REMOTE    ] OHI: Incremental fetch complete for 2025-09 (1.85 seconds).
[2025-10-24T20:22:46.979179] [INFO ] [REMOTE    ] OGS: Incremental fetch complete for 2025-10 (1.23 seconds).
[2025-10-24T20:22:46.984964] [INFO ] [REMOTE    ] OGS: Full fetch complete (47818 records).
[2025-10-24T20:22:46.985074] [DEBUG] [VALIDATOR ] OGS: Validating primary data.
[2025-10-24T20:22:47.349866] [INFO ] [REMOTE    ] OIA: Fetching primary data for 2025-02.
[2025-10-24T20:22:47.365081] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present.
[2025-10-24T20:22:47.365174] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed.
[2025-10-24T20:22:47.366202] [INFO ] [MAIN      ] OGS: Fetched primary data is valid.
[2025-10-24T20:22:47.366382] [DEBUG] [LOCAL     ] OGS: Saving primary data.
[2025-10-24T20:22:47.366946] [FATAL] [LOCAL     ] OGS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:22:47.367031] [FATAL] [MAIN      ] OGS: Failed to save primary data.
[2025-10-24T20:22:47.367099] [WARN ] [MAIN      ] OGS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:22:47.367169] [INFO ] [LOCAL     ] OGS: Starting deletion of primary data.
[2025-10-24T20:22:47.367231] [DEBUG] [LOCAL     ] OGS: No primary data file found to delete.
[2025-10-24T20:22:47.367293] [INFO ] [LOCAL     ] OGS: Starting deletion of derivative data.
[2025-10-24T20:22:47.367506] [DEBUG] [LOCAL     ] OGS: Deleted derivative data file.
[2025-10-24T20:22:47.367923] [INFO ] [MAIN      ] Update Progress: 1578/2366 symbols completed. OGS took 34.5s. Estimated remaining: 1h 41m 15s. Rate: 7.8 symbols/min
[2025-10-24T20:22:47.551784] [INFO ] [MAIN      ] OII: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:22:47.591359] [DEBUG] [LOCAL     ] OII: Loaded 42179 existing records from primary storage.
[2025-10-24T20:22:47.591630] [INFO ] [MAIN      ] OII: Loaded 42179 existing records.
[2025-10-24T20:22:47.765529] [WARN ] [MAIN      ] OII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:22:47.765755] [INFO ] [MAIN      ] OII: Wiping existing primary data before full refresh.
[2025-10-24T20:22:47.766530] [INFO ] [LOCAL     ] OII: Starting deletion of primary data.
[2025-10-24T20:22:47.767007] [DEBUG] [LOCAL     ] OII: Deleted primary data file.
[2025-10-24T20:22:47.767064] [INFO ] [MAIN      ] OII: Starting full primary refresh.
[2025-10-24T20:22:48.122840] [INFO ] [REMOTE    ] OII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:22:48.147606] [INFO ] [REMOTE    ] OII: Fetching primary data for 2025-01.
[2025-10-24T20:22:48.226406] [INFO ] [REMOTE    ] OI: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T20:22:48.635559] [INFO ] [REMOTE    ] OIA: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T20:22:48.947679] [INFO ] [REMOTE    ] OIA: Fetching primary data for 2025-03.
[2025-10-24T20:22:49.505829] [INFO ] [REMOTE    ] OII: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T20:22:49.747717] [INFO ] [REMOTE    ] OI: Fetching primary data for 2025-07.
[2025-10-24T20:22:49.762225] [INFO ] [REMOTE    ] OIA: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T20:22:50.547689] [INFO ] [REMOTE    ] OII: Fetching primary data for 2025-02.
[2025-10-24T20:22:51.086491] [INFO ] [REMOTE    ] OI: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T20:22:51.347705] [INFO ] [REMOTE    ] OIA: Fetching primary data for 2025-04.
[2025-10-24T20:22:52.080569] [INFO ] [REMOTE    ] OII: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T20:22:52.147607] [INFO ] [REMOTE    ] OII: Fetching primary data for 2025-03.
[2025-10-24T20:22:52.301620] [INFO ] [REMOTE    ] OIA: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T20:22:52.947677] [INFO ] [REMOTE    ] OHI: Fetching primary data for 2025-10.
[2025-10-24T20:22:53.747676] [INFO ] [REMOTE    ] OIA: Fetching primary data for 2025-05.
[2025-10-24T20:22:53.790606] [INFO ] [REMOTE    ] OII: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T20:22:54.552824] [INFO ] [REMOTE    ] OII: Fetching primary data for 2025-04.
[2025-10-24T20:22:54.559755] [INFO ] [REMOTE    ] OHI: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T20:22:54.570990] [INFO ] [REMOTE    ] OHI: Full fetch complete (75254 records).
[2025-10-24T20:22:54.571231] [DEBUG] [VALIDATOR ] OHI: Validating primary data.
[2025-10-24T20:22:54.781211] [INFO ] [REMOTE    ] OIA: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T20:22:55.047294] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present.
[2025-10-24T20:22:55.047398] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed.
[2025-10-24T20:22:55.048527] [INFO ] [MAIN      ] OHI: Fetched primary data is valid.
[2025-10-24T20:22:55.048593] [DEBUG] [LOCAL     ] OHI: Saving primary data.
[2025-10-24T20:22:55.049262] [FATAL] [LOCAL     ] OHI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:22:55.049354] [FATAL] [MAIN      ] OHI: Failed to save primary data.
[2025-10-24T20:22:55.049397] [WARN ] [MAIN      ] OHI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:22:55.049433] [INFO ] [LOCAL     ] OHI: Starting deletion of primary data.
[2025-10-24T20:22:55.049515] [DEBUG] [LOCAL     ] OHI: No primary data file found to delete.
[2025-10-24T20:22:55.049570] [INFO ] [LOCAL     ] OHI: Starting deletion of derivative data.
[2025-10-24T20:22:55.049779] [DEBUG] [LOCAL     ] OHI: Deleted derivative data file.
[2025-10-24T20:22:55.050049] [INFO ] [MAIN      ] Update Progress: 1579/2366 symbols completed. OHI took 35.1s. Estimated remaining: 1h 41m 7s. Rate: 7.8 symbols/min
[2025-10-24T20:22:55.250684] [INFO ] [MAIN      ] OIS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:22:55.288957] [DEBUG] [LOCAL     ] OIS: Loaded 40115 existing records from primary storage.
[2025-10-24T20:22:55.289225] [INFO ] [MAIN      ] OIS: Loaded 40115 existing records.
[2025-10-24T20:22:55.352786] [INFO ] [REMOTE    ] OIA: Fetching primary data for 2025-06.
[2025-10-24T20:22:55.466087] [WARN ] [MAIN      ] OIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:22:55.466264] [INFO ] [MAIN      ] OIS: Wiping existing primary data before full refresh.
[2025-10-24T20:22:55.466308] [INFO ] [LOCAL     ] OIS: Starting deletion of primary data.
[2025-10-24T20:22:55.466577] [DEBUG] [LOCAL     ] OIS: Deleted primary data file.
[2025-10-24T20:22:55.466631] [INFO ] [MAIN      ] OIS: Starting full primary refresh.
[2025-10-24T20:22:55.816016] [INFO ] [REMOTE    ] OIS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:22:56.152774] [INFO ] [REMOTE    ] OIS: Fetching primary data for 2025-01.
[2025-10-24T20:22:56.167029] [INFO ] [REMOTE    ] OII: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T20:22:56.354663] [INFO ] [REMOTE    ] OIA: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T20:22:56.947618] [INFO ] [REMOTE    ] OI: Fetching primary data for 2025-08.
[2025-10-24T20:22:57.507816] [INFO ] [REMOTE    ] OIS: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T20:22:57.747631] [INFO ] [REMOTE    ] OIA: Fetching primary data for 2025-07.
[2025-10-24T20:22:58.547637] [INFO ] [REMOTE    ] OII: Fetching primary data for 2025-05.
[2025-10-24T20:22:58.689557] [INFO ] [REMOTE    ] OI: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T20:22:58.701305] [INFO ] [REMOTE    ] OIA: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T20:22:59.347668] [INFO ] [REMOTE    ] OI: Fetching primary data for 2025-09.
[2025-10-24T20:22:59.880811] [INFO ] [REMOTE    ] OII: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T20:23:00.147633] [INFO ] [REMOTE    ] OIS: Fetching primary data for 2025-02.
[2025-10-24T20:23:00.947630] [INFO ] [REMOTE    ] OIA: Fetching primary data for 2025-08.
[2025-10-24T20:23:01.747769] [INFO ] [REMOTE    ] OII: Fetching primary data for 2025-06.
[2025-10-24T20:23:06.402881] [INFO ] [REMOTE    ] OI: Incremental fetch complete for 2025-09 (7.06 seconds).
[2025-10-24T20:23:06.413008] [INFO ] [REMOTE    ] OI: Fetching primary data for 2025-10.
[2025-10-24T20:23:06.455505] [INFO ] [REMOTE    ] OIA: Incremental fetch complete for 2025-08 (5.51 seconds).
[2025-10-24T20:23:06.460089] [INFO ] [REMOTE    ] OIA: Fetching primary data for 2025-09.
[2025-10-24T20:23:06.892507] [INFO ] [REMOTE    ] OIS: Incremental fetch complete for 2025-02 (6.74 seconds).
[2025-10-24T20:23:06.902095] [INFO ] [REMOTE    ] OIS: Fetching primary data for 2025-03.
[2025-10-24T20:23:06.974282] [INFO ] [REMOTE    ] OII: Incremental fetch complete for 2025-06 (5.23 seconds).
[2025-10-24T20:23:06.982880] [INFO ] [REMOTE    ] OII: Fetching primary data for 2025-07.
[2025-10-24T20:23:07.250982] [INFO ] [REMOTE    ] OIA: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T20:23:07.256032] [INFO ] [REMOTE    ] OIA: Fetching primary data for 2025-10.
[2025-10-24T20:23:08.153610] [INFO ] [REMOTE    ] OIA: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T20:23:08.155837] [INFO ] [REMOTE    ] OIA: Full fetch complete (20052 records).
[2025-10-24T20:23:08.155914] [DEBUG] [VALIDATOR ] OIA: Validating primary data.
[2025-10-24T20:23:08.524120] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present.
[2025-10-24T20:23:08.524224] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed.
[2025-10-24T20:23:08.524614] [INFO ] [MAIN      ] OIA: Fetched primary data is valid.
[2025-10-24T20:23:08.524896] [DEBUG] [LOCAL     ] OIA: Saving primary data.
[2025-10-24T20:23:08.525249] [FATAL] [LOCAL     ] OIA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:23:08.525415] [FATAL] [MAIN      ] OIA: Failed to save primary data.
[2025-10-24T20:23:08.525491] [WARN ] [MAIN      ] OIA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:23:08.525536] [INFO ] [LOCAL     ] OIA: Starting deletion of primary data.
[2025-10-24T20:23:08.525609] [DEBUG] [LOCAL     ] OIA: No primary data file found to delete.
[2025-10-24T20:23:08.525666] [INFO ] [LOCAL     ] OIA: Starting deletion of derivative data.
[2025-10-24T20:23:08.525844] [DEBUG] [LOCAL     ] OIA: Deleted derivative data file.
[2025-10-24T20:23:08.525916] [INFO ] [MAIN      ] Update Progress: 1580/2366 symbols completed. OIA took 27.3s. Estimated remaining: 1h 41m 2s. Rate: 7.8 symbols/min
[2025-10-24T20:23:08.727408] [INFO ] [MAIN      ] OKE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:23:08.724228] [INFO ] [REMOTE    ] OIS: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T20:23:08.737900] [INFO ] [REMOTE    ] OIS: Fetching primary data for 2025-04.
[2025-10-24T20:23:08.802586] [INFO ] [REMOTE    ] OII: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T20:23:08.811540] [INFO ] [REMOTE    ] OI: Incremental fetch complete for 2025-10 (2.40 seconds).
[2025-10-24T20:23:08.829130] [INFO ] [REMOTE    ] OI: Full fetch complete (68224 records).
[2025-10-24T20:23:08.829596] [INFO ] [REMOTE    ] OII: Fetching primary data for 2025-08.
[2025-10-24T20:23:08.829756] [DEBUG] [VALIDATOR ] OI: Validating primary data.
[2025-10-24T20:23:09.003526] [DEBUG] [LOCAL     ] OKE: Loaded 53966 existing records from primary storage.
[2025-10-24T20:23:09.031601] [INFO ] [MAIN      ] OKE: Loaded 53966 existing records.
[2025-10-24T20:23:09.426526] [WARN ] [MAIN      ] OKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:23:09.456906] [INFO ] [MAIN      ] OKE: Wiping existing primary data before full refresh.
[2025-10-24T20:23:09.457038] [INFO ] [LOCAL     ] OKE: Starting deletion of primary data.
[2025-10-24T20:23:09.483669] [DEBUG] [LOCAL     ] OKE: Deleted primary data file.
[2025-10-24T20:23:09.489728] [INFO ] [MAIN      ] OKE: Starting full primary refresh.
[2025-10-24T20:23:09.539394] [DEBUG] [VALIDATOR ] OI: All expected trading days are present.
[2025-10-24T20:23:09.583433] [DEBUG] [VALIDATOR ] OI: Primary data validation passed.
[2025-10-24T20:23:09.612581] [INFO ] [MAIN      ] OI: Fetched primary data is valid.
[2025-10-24T20:23:09.618587] [DEBUG] [LOCAL     ] OI: Saving primary data.
[2025-10-24T20:23:09.640375] [FATAL] [LOCAL     ] OI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:23:09.664750] [FATAL] [MAIN      ] OI: Failed to save primary data.
[2025-10-24T20:23:09.719325] [WARN ] [MAIN      ] OI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:23:09.744172] [INFO ] [LOCAL     ] OI: Starting deletion of primary data.
[2025-10-24T20:23:09.764858] [DEBUG] [LOCAL     ] OI: No primary data file found to delete.
[2025-10-24T20:23:09.770510] [INFO ] [LOCAL     ] OI: Starting deletion of derivative data.
[2025-10-24T20:23:09.792185] [DEBUG] [LOCAL     ] OI: Deleted derivative data file.
[2025-10-24T20:23:09.802486] [INFO ] [MAIN      ] Update Progress: 1581/2366 symbols completed. OI took 39.1s. Estimated remaining: 1h 40m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:23:09.990237] [INFO ] [REMOTE    ] OKE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:23:10.001287] [INFO ] [REMOTE    ] OKE: Fetching primary data for 2025-01.
[2025-10-24T20:23:10.064617] [INFO ] [MAIN      ] OKLO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:23:10.119211] [DEBUG] [LOCAL     ] OKLO: Loaded 54209 existing records from primary storage.
[2025-10-24T20:23:10.119603] [INFO ] [MAIN      ] OKLO: Loaded 54209 existing records.
[2025-10-24T20:23:10.297690] [WARN ] [MAIN      ] OKLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:23:10.297971] [INFO ] [MAIN      ] OKLO: Wiping existing primary data before full refresh.
[2025-10-24T20:23:10.298117] [INFO ] [LOCAL     ] OKLO: Starting deletion of primary data.
[2025-10-24T20:23:10.298559] [DEBUG] [LOCAL     ] OKLO: Deleted primary data file.
[2025-10-24T20:23:10.298599] [INFO ] [MAIN      ] OKLO: Starting full primary refresh.
[2025-10-24T20:23:10.667998] [INFO ] [REMOTE    ] OKLO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:23:10.668567] [INFO ] [REMOTE    ] OKLO: Fetching primary data for 2025-01.
[2025-10-24T20:23:10.738941] [INFO ] [REMOTE    ] OII: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T20:23:10.754424] [INFO ] [REMOTE    ] OIS: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T20:23:10.767152] [INFO ] [REMOTE    ] OII: Fetching primary data for 2025-09.
[2025-10-24T20:23:10.768259] [INFO ] [REMOTE    ] OIS: Fetching primary data for 2025-05.
[2025-10-24T20:23:11.995176] [INFO ] [REMOTE    ] OKE: Incremental fetch complete for 2025-01 (1.99 seconds).
[2025-10-24T20:23:12.005844] [INFO ] [REMOTE    ] OKE: Fetching primary data for 2025-02.
[2025-10-24T20:23:12.450080] [INFO ] [REMOTE    ] OII: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T20:23:12.459592] [INFO ] [REMOTE    ] OII: Fetching primary data for 2025-10.
[2025-10-24T20:23:12.532898] [INFO ] [REMOTE    ] OIS: Incremental fetch complete for 2025-05 (1.76 seconds).
[2025-10-24T20:23:12.947767] [INFO ] [REMOTE    ] OIS: Fetching primary data for 2025-06.
[2025-10-24T20:23:13.175674] [INFO ] [REMOTE    ] OKLO: Incremental fetch complete for 2025-01 (2.51 seconds).
[2025-10-24T20:23:13.549156] [INFO ] [REMOTE    ] OKE: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T20:23:13.747687] [INFO ] [REMOTE    ] OKE: Fetching primary data for 2025-03.
[2025-10-24T20:23:14.043525] [INFO ] [REMOTE    ] OII: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T20:23:14.051171] [INFO ] [REMOTE    ] OII: Full fetch complete (61721 records).
[2025-10-24T20:23:14.051319] [DEBUG] [VALIDATOR ] OII: Validating primary data.
[2025-10-24T20:23:14.478275] [DEBUG] [VALIDATOR ] OII: All expected trading days are present.
[2025-10-24T20:23:14.478438] [DEBUG] [VALIDATOR ] OII: Primary data validation passed.
[2025-10-24T20:23:14.479587] [INFO ] [MAIN      ] OII: Fetched primary data is valid.
[2025-10-24T20:23:14.479674] [DEBUG] [LOCAL     ] OII: Saving primary data.
[2025-10-24T20:23:14.480249] [FATAL] [LOCAL     ] OII: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:23:14.480350] [FATAL] [MAIN      ] OII: Failed to save primary data.
[2025-10-24T20:23:14.480428] [WARN ] [MAIN      ] OII: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:23:14.480508] [INFO ] [LOCAL     ] OII: Starting deletion of primary data.
[2025-10-24T20:23:14.480584] [DEBUG] [LOCAL     ] OII: No primary data file found to delete.
[2025-10-24T20:23:14.480629] [INFO ] [LOCAL     ] OII: Starting deletion of derivative data.
[2025-10-24T20:23:14.480875] [DEBUG] [LOCAL     ] OII: Deleted derivative data file.
[2025-10-24T20:23:14.481535] [INFO ] [MAIN      ] Update Progress: 1582/2366 symbols completed. OII took 27.1s. Estimated remaining: 1h 40m 42s. Rate: 7.8 symbols/min
[2025-10-24T20:23:14.558424] [INFO ] [REMOTE    ] OKLO: Fetching primary data for 2025-02.
[2025-10-24T20:23:14.674300] [INFO ] [MAIN      ] OLN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:23:14.710599] [INFO ] [REMOTE    ] OIS: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T20:23:14.765449] [DEBUG] [LOCAL     ] OLN: Loaded 52381 existing records from primary storage.
[2025-10-24T20:23:14.765783] [INFO ] [MAIN      ] OLN: Loaded 52381 existing records.
[2025-10-24T20:23:14.953824] [WARN ] [MAIN      ] OLN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:23:14.954046] [INFO ] [MAIN      ] OLN: Wiping existing primary data before full refresh.
[2025-10-24T20:23:14.954117] [INFO ] [LOCAL     ] OLN: Starting deletion of primary data.
[2025-10-24T20:23:14.954802] [DEBUG] [LOCAL     ] OLN: Deleted primary data file.
[2025-10-24T20:23:14.954879] [INFO ] [MAIN      ] OLN: Starting full primary refresh.
[2025-10-24T20:23:15.333964] [INFO ] [REMOTE    ] OLN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:23:15.347598] [INFO ] [REMOTE    ] OIS: Fetching primary data for 2025-07.
[2025-10-24T20:23:15.675757] [INFO ] [REMOTE    ] OKE: Incremental fetch complete for 2025-03 (1.93 seconds).
[2025-10-24T20:23:16.147748] [INFO ] [REMOTE    ] OLN: Fetching primary data for 2025-01.
[2025-10-24T20:23:16.857788] [INFO ] [REMOTE    ] OKLO: Incremental fetch complete for 2025-02 (2.30 seconds).
[2025-10-24T20:23:16.947606] [INFO ] [REMOTE    ] OKLO: Fetching primary data for 2025-03.
[2025-10-24T20:23:17.018392] [INFO ] [REMOTE    ] OIS: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T20:23:17.747673] [INFO ] [REMOTE    ] OIS: Fetching primary data for 2025-08.
[2025-10-24T20:23:18.056876] [INFO ] [REMOTE    ] OLN: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T20:23:18.547721] [INFO ] [REMOTE    ] OLN: Fetching primary data for 2025-02.
[2025-10-24T20:23:19.115914] [INFO ] [REMOTE    ] OIS: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T20:23:19.347637] [INFO ] [REMOTE    ] OIS: Fetching primary data for 2025-09.
[2025-10-24T20:23:19.493358] [INFO ] [REMOTE    ] OKLO: Incremental fetch complete for 2025-03 (2.55 seconds).
[2025-10-24T20:23:20.147719] [INFO ] [REMOTE    ] OKLO: Fetching primary data for 2025-04.
[2025-10-24T20:23:20.346461] [INFO ] [REMOTE    ] OLN: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T20:23:20.947765] [INFO ] [REMOTE    ] OLN: Fetching primary data for 2025-03.
[2025-10-24T20:23:21.042988] [INFO ] [REMOTE    ] OIS: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T20:23:21.747701] [INFO ] [REMOTE    ] OIS: Fetching primary data for 2025-10.
[2025-10-24T20:23:22.547609] [INFO ] [REMOTE    ] OKE: Fetching primary data for 2025-04.
[2025-10-24T20:23:22.655220] [INFO ] [REMOTE    ] OLN: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T20:23:22.748758] [INFO ] [REMOTE    ] OIS: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T20:23:22.755736] [INFO ] [REMOTE    ] OIS: Full fetch complete (57399 records).
[2025-10-24T20:23:22.755845] [DEBUG] [VALIDATOR ] OIS: Validating primary data.
[2025-10-24T20:23:23.141312] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present.
[2025-10-24T20:23:23.141394] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed.
[2025-10-24T20:23:23.142443] [INFO ] [MAIN      ] OIS: Fetched primary data is valid.
[2025-10-24T20:23:23.142559] [DEBUG] [LOCAL     ] OIS: Saving primary data.
[2025-10-24T20:23:23.143082] [FATAL] [LOCAL     ] OIS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:23:23.143172] [FATAL] [MAIN      ] OIS: Failed to save primary data.
[2025-10-24T20:23:23.143313] [WARN ] [MAIN      ] OIS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:23:23.143379] [INFO ] [LOCAL     ] OIS: Starting deletion of primary data.
[2025-10-24T20:23:23.143546] [DEBUG] [LOCAL     ] OIS: No primary data file found to delete.
[2025-10-24T20:23:23.143600] [INFO ] [LOCAL     ] OIS: Starting deletion of derivative data.
[2025-10-24T20:23:23.153757] [DEBUG] [LOCAL     ] OIS: Deleted derivative data file.
[2025-10-24T20:23:23.168228] [INFO ] [MAIN      ] Update Progress: 1583/2366 symbols completed. OIS took 28.1s. Estimated remaining: 1h 40m 35s. Rate: 7.8 symbols/min
[2025-10-24T20:23:23.219717] [INFO ] [REMOTE    ] OKLO: Incremental fetch complete for 2025-04 (3.07 seconds).
[2025-10-24T20:23:23.353440] [INFO ] [REMOTE    ] OLN: Fetching primary data for 2025-04.
[2025-10-24T20:23:23.356471] [INFO ] [MAIN      ] OLP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:23:23.369205] [DEBUG] [LOCAL     ] OLP: Loaded 10133 existing records from primary storage.
[2025-10-24T20:23:23.369532] [INFO ] [MAIN      ] OLP: Loaded 10133 existing records.
[2025-10-24T20:23:23.547034] [WARN ] [MAIN      ] OLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:23:23.547290] [INFO ] [MAIN      ] OLP: Wiping existing primary data before full refresh.
[2025-10-24T20:23:23.547350] [INFO ] [LOCAL     ] OLP: Starting deletion of primary data.
[2025-10-24T20:23:23.547512] [DEBUG] [LOCAL     ] OLP: Deleted primary data file.
[2025-10-24T20:23:23.547549] [INFO ] [MAIN      ] OLP: Starting full primary refresh.
[2025-10-24T20:23:23.924081] [INFO ] [REMOTE    ] OLP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:23:24.147620] [INFO ] [REMOTE    ] OLP: Fetching primary data for 2025-01.
[2025-10-24T20:23:24.204270] [INFO ] [REMOTE    ] OKE: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T20:23:24.947722] [INFO ] [REMOTE    ] OKLO: Fetching primary data for 2025-05.
[2025-10-24T20:23:25.009820] [INFO ] [REMOTE    ] OLP: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T20:23:25.331025] [INFO ] [REMOTE    ] OLN: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T20:23:25.747719] [INFO ] [REMOTE    ] OLP: Fetching primary data for 2025-02.
[2025-10-24T20:23:26.547717] [INFO ] [REMOTE    ] OKE: Fetching primary data for 2025-05.
[2025-10-24T20:23:26.755387] [INFO ] [REMOTE    ] OLP: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T20:23:27.347697] [INFO ] [REMOTE    ] OLN: Fetching primary data for 2025-05.
[2025-10-24T20:23:27.496667] [INFO ] [REMOTE    ] OKLO: Incremental fetch complete for 2025-05 (2.55 seconds).
[2025-10-24T20:23:28.147683] [INFO ] [REMOTE    ] OKLO: Fetching primary data for 2025-06.
[2025-10-24T20:23:28.487715] [INFO ] [REMOTE    ] OKE: Incremental fetch complete for 2025-05 (1.94 seconds).
[2025-10-24T20:23:28.947696] [INFO ] [REMOTE    ] OLP: Fetching primary data for 2025-03.
[2025-10-24T20:23:29.376799] [INFO ] [REMOTE    ] OLN: Incremental fetch complete for 2025-05 (2.03 seconds).
[2025-10-24T20:23:29.747688] [INFO ] [REMOTE    ] OLN: Fetching primary data for 2025-06.
[2025-10-24T20:23:29.944056] [INFO ] [REMOTE    ] OLP: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T20:23:30.547619] [INFO ] [REMOTE    ] OKE: Fetching primary data for 2025-06.
[2025-10-24T20:23:30.998147] [INFO ] [REMOTE    ] OKLO: Incremental fetch complete for 2025-06 (2.85 seconds).
[2025-10-24T20:23:31.347616] [INFO ] [REMOTE    ] OKLO: Fetching primary data for 2025-07.
[2025-10-24T20:23:31.655230] [INFO ] [REMOTE    ] OLN: Incremental fetch complete for 2025-06 (1.91 seconds).
[2025-10-24T20:23:32.147738] [INFO ] [REMOTE    ] OLP: Fetching primary data for 2025-04.
[2025-10-24T20:23:32.614032] [INFO ] [REMOTE    ] OKE: Incremental fetch complete for 2025-06 (2.07 seconds).
[2025-10-24T20:23:32.947638] [INFO ] [REMOTE    ] OKE: Fetching primary data for 2025-07.
[2025-10-24T20:23:33.080285] [INFO ] [REMOTE    ] OLP: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T20:23:33.747607] [INFO ] [REMOTE    ] OLN: Fetching primary data for 2025-07.
[2025-10-24T20:23:34.103717] [INFO ] [REMOTE    ] OKLO: Incremental fetch complete for 2025-07 (2.76 seconds).
[2025-10-24T20:23:34.547723] [INFO ] [REMOTE    ] OKLO: Fetching primary data for 2025-08.
[2025-10-24T20:23:34.703722] [INFO ] [REMOTE    ] OKE: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T20:23:35.347700] [INFO ] [REMOTE    ] OKE: Fetching primary data for 2025-08.
[2025-10-24T20:23:35.696534] [INFO ] [REMOTE    ] OLN: Incremental fetch complete for 2025-07 (1.95 seconds).
[2025-10-24T20:23:36.147709] [INFO ] [REMOTE    ] OLP: Fetching primary data for 2025-05.
[2025-10-24T20:23:36.947626] [INFO ] [REMOTE    ] OLN: Fetching primary data for 2025-08.
[2025-10-24T20:23:37.125960] [INFO ] [REMOTE    ] OLP: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T20:23:37.386026] [INFO ] [REMOTE    ] OKE: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T20:23:37.458502] [INFO ] [REMOTE    ] OKLO: Incremental fetch complete for 2025-08 (2.91 seconds).
[2025-10-24T20:23:37.747717] [INFO ] [REMOTE    ] OLP: Fetching primary data for 2025-06.
[2025-10-24T20:23:38.526411] [INFO ] [REMOTE    ] OLP: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T20:23:38.547589] [INFO ] [REMOTE    ] OLP: Fetching primary data for 2025-07.
[2025-10-24T20:23:38.803197] [INFO ] [REMOTE    ] OLN: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T20:23:39.347623] [INFO ] [REMOTE    ] OKLO: Fetching primary data for 2025-09.
[2025-10-24T20:23:39.529050] [INFO ] [REMOTE    ] OLP: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T20:23:40.147712] [INFO ] [REMOTE    ] OLP: Fetching primary data for 2025-08.
[2025-10-24T20:23:40.947616] [INFO ] [REMOTE    ] OLN: Fetching primary data for 2025-09.
[2025-10-24T20:23:41.027756] [INFO ] [REMOTE    ] OLP: Incremental fetch complete for 2025-08 (0.88 seconds).
[2025-10-24T20:23:41.747620] [INFO ] [REMOTE    ] OLP: Fetching primary data for 2025-09.
[2025-10-24T20:23:42.161267] [INFO ] [REMOTE    ] OKLO: Incremental fetch complete for 2025-09 (2.81 seconds).
[2025-10-24T20:23:42.547728] [INFO ] [REMOTE    ] OKLO: Fetching primary data for 2025-10.
[2025-10-24T20:23:42.669816] [INFO ] [REMOTE    ] OLP: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T20:23:42.869856] [INFO ] [REMOTE    ] OLN: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T20:23:43.347618] [INFO ] [REMOTE    ] OKE: Fetching primary data for 2025-09.
[2025-10-24T20:23:43.729914] [INFO ] [REMOTE    ] OKLO: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T20:23:43.739336] [INFO ] [REMOTE    ] OKLO: Full fetch complete (77609 records).
[2025-10-24T20:23:43.739495] [DEBUG] [VALIDATOR ] OKLO: Validating primary data.
[2025-10-24T20:23:43.740401] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:23:43.740492] [FATAL] [MAIN      ] OKLO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:23:43.740534] [WARN ] [MAIN      ] OKLO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:23:43.740570] [INFO ] [LOCAL     ] OKLO: Starting deletion of primary data.
[2025-10-24T20:23:43.740628] [DEBUG] [LOCAL     ] OKLO: No primary data file found to delete.
[2025-10-24T20:23:43.740700] [INFO ] [LOCAL     ] OKLO: Starting deletion of derivative data.
[2025-10-24T20:23:43.741033] [DEBUG] [LOCAL     ] OKLO: Deleted derivative data file.
[2025-10-24T20:23:43.741382] [INFO ] [MAIN      ] Update Progress: 1584/2366 symbols completed. OKLO took 33.9s. Estimated remaining: 1h 40m 33s. Rate: 7.8 symbols/min
[2025-10-24T20:23:43.918757] [INFO ] [MAIN      ] OMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:23:43.969784] [DEBUG] [LOCAL     ] OMC: Loaded 53682 existing records from primary storage.
[2025-10-24T20:23:43.970121] [INFO ] [MAIN      ] OMC: Loaded 53682 existing records.
[2025-10-24T20:23:44.153072] [INFO ] [REMOTE    ] OLN: Fetching primary data for 2025-10.
[2025-10-24T20:23:44.157598] [WARN ] [MAIN      ] OMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:23:44.157821] [INFO ] [MAIN      ] OMC: Wiping existing primary data before full refresh.
[2025-10-24T20:23:44.157894] [INFO ] [LOCAL     ] OMC: Starting deletion of primary data.
[2025-10-24T20:23:44.158637] [DEBUG] [LOCAL     ] OMC: Deleted primary data file.
[2025-10-24T20:23:44.158737] [INFO ] [MAIN      ] OMC: Starting full primary refresh.
[2025-10-24T20:23:44.521049] [INFO ] [REMOTE    ] OMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:23:44.947705] [INFO ] [REMOTE    ] OLP: Fetching primary data for 2025-10.
[2025-10-24T20:23:45.447424] [INFO ] [REMOTE    ] OKE: Incremental fetch complete for 2025-09 (2.10 seconds).
[2025-10-24T20:23:45.747692] [INFO ] [REMOTE    ] OKE: Fetching primary data for 2025-10.
[2025-10-24T20:23:45.938352] [INFO ] [REMOTE    ] OLP: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T20:23:45.941201] [INFO ] [REMOTE    ] OLP: Full fetch complete (14285 records).
[2025-10-24T20:23:45.941282] [DEBUG] [VALIDATOR ] OLP: Validating primary data.
[2025-10-24T20:23:46.333120] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present.
[2025-10-24T20:23:46.333302] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed.
[2025-10-24T20:23:46.333790] [INFO ] [MAIN      ] OLP: Fetched primary data is valid.
[2025-10-24T20:23:46.333866] [DEBUG] [LOCAL     ] OLP: Saving primary data.
[2025-10-24T20:23:46.342514] [FATAL] [LOCAL     ] OLP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:23:46.356814] [FATAL] [MAIN      ] OLP: Failed to save primary data.
[2025-10-24T20:23:46.356929] [WARN ] [MAIN      ] OLP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:23:46.357062] [INFO ] [LOCAL     ] OLP: Starting deletion of primary data.
[2025-10-24T20:23:46.357292] [DEBUG] [LOCAL     ] OLP: No primary data file found to delete.
[2025-10-24T20:23:46.358450] [INFO ] [REMOTE    ] OLN: Incremental fetch complete for 2025-10 (2.21 seconds).
[2025-10-24T20:23:46.357726] [INFO ] [LOCAL     ] OLP: Starting deletion of derivative data.
[2025-10-24T20:23:46.367776] [DEBUG] [LOCAL     ] OLP: Deleted derivative data file.
[2025-10-24T20:23:46.367875] [INFO ] [MAIN      ] Update Progress: 1585/2366 symbols completed. OLP took 23.2s. Estimated remaining: 1h 40m 23s. Rate: 7.8 symbols/min
[2025-10-24T20:23:46.415166] [INFO ] [REMOTE    ] OLN: Full fetch complete (74777 records).
[2025-10-24T20:23:46.429467] [DEBUG] [VALIDATOR ] OLN: Validating primary data.
[2025-10-24T20:23:46.563455] [INFO ] [REMOTE    ] OMC: Fetching primary data for 2025-01.
[2025-10-24T20:23:46.722123] [INFO ] [MAIN      ] OMF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:23:46.969442] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present.
[2025-10-24T20:23:46.969536] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed.
[2025-10-24T20:23:46.970635] [INFO ] [MAIN      ] OLN: Fetched primary data is valid.
[2025-10-24T20:23:46.970752] [DEBUG] [LOCAL     ] OLN: Saving primary data.
[2025-10-24T20:23:46.984131] [FATAL] [LOCAL     ] OLN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:23:46.985129] [FATAL] [MAIN      ] OLN: Failed to save primary data.
[2025-10-24T20:23:46.985201] [WARN ] [MAIN      ] OLN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:23:46.985928] [DEBUG] [LOCAL     ] OMF: Loaded 46802 existing records from primary storage.
[2025-10-24T20:23:46.985277] [INFO ] [LOCAL     ] OLN: Starting deletion of primary data.
[2025-10-24T20:23:46.986116] [DEBUG] [LOCAL     ] OLN: No primary data file found to delete.
[2025-10-24T20:23:46.986347] [INFO ] [MAIN      ] OMF: Loaded 46802 existing records.
[2025-10-24T20:23:46.986257] [INFO ] [LOCAL     ] OLN: Starting deletion of derivative data.
[2025-10-24T20:23:47.047930] [DEBUG] [LOCAL     ] OLN: Deleted derivative data file.
[2025-10-24T20:23:47.063815] [INFO ] [MAIN      ] Update Progress: 1586/2366 symbols completed. OLN took 32.6s. Estimated remaining: 1h 40m 12s. Rate: 7.8 symbols/min
[2025-10-24T20:23:47.338913] [WARN ] [MAIN      ] OMF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:23:47.356638] [INFO ] [MAIN      ] OMF: Wiping existing primary data before full refresh.
[2025-10-24T20:23:47.356505] [INFO ] [MAIN      ] OMI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:23:47.356850] [DEBUG] [LOCAL     ] OMI: No existing data file found in primary storage.
[2025-10-24T20:23:47.356923] [WARN ] [MAIN      ] OMI: No existing data found, performing full refresh instead.
[2025-10-24T20:23:47.357133] [INFO ] [LOCAL     ] OMF: Starting deletion of primary data.
[2025-10-24T20:23:47.357083] [INFO ] [MAIN      ] OMI: Wiping existing primary data before full refresh.
[2025-10-24T20:23:47.357296] [INFO ] [LOCAL     ] OMI: Starting deletion of primary data.
[2025-10-24T20:23:47.357366] [DEBUG] [LOCAL     ] OMI: No primary data file found to delete.
[2025-10-24T20:23:47.357403] [INFO ] [MAIN      ] OMI: Starting full primary refresh.
[2025-10-24T20:23:47.377831] [DEBUG] [LOCAL     ] OMF: Deleted primary data file.
[2025-10-24T20:23:47.388062] [INFO ] [MAIN      ] OMF: Starting full primary refresh.
[2025-10-24T20:23:48.028181] [INFO ] [REMOTE    ] OMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:23:48.028732] [INFO ] [REMOTE    ] OMI: Fetching primary data for 2025-01.
[2025-10-24T20:23:48.100680] [INFO ] [REMOTE    ] OMF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:23:48.128797] [INFO ] [REMOTE    ] OKE: Incremental fetch complete for 2025-10 (2.38 seconds).
[2025-10-24T20:23:48.138929] [INFO ] [REMOTE    ] OKE: Full fetch complete (77685 records).
[2025-10-24T20:23:48.139084] [DEBUG] [VALIDATOR ] OKE: Validating primary data.
[2025-10-24T20:23:48.170715] [INFO ] [REMOTE    ] OMF: Fetching primary data for 2025-01.
[2025-10-24T20:23:48.567434] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present.
[2025-10-24T20:23:48.567857] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed.
[2025-10-24T20:23:48.569252] [INFO ] [MAIN      ] OKE: Fetched primary data is valid.
[2025-10-24T20:23:48.569338] [DEBUG] [LOCAL     ] OKE: Saving primary data.
[2025-10-24T20:23:48.572103] [INFO ] [REMOTE    ] OMC: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T20:23:48.570087] [FATAL] [LOCAL     ] OKE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:23:48.583004] [FATAL] [MAIN      ] OKE: Failed to save primary data.
[2025-10-24T20:23:48.583080] [WARN ] [MAIN      ] OKE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:23:48.583126] [INFO ] [LOCAL     ] OKE: Starting deletion of primary data.
[2025-10-24T20:23:48.583182] [DEBUG] [LOCAL     ] OKE: No primary data file found to delete.
[2025-10-24T20:23:48.583218] [INFO ] [LOCAL     ] OKE: Starting deletion of derivative data.
[2025-10-24T20:23:48.583373] [DEBUG] [LOCAL     ] OKE: Deleted derivative data file.
[2025-10-24T20:23:48.584008] [INFO ] [MAIN      ] Update Progress: 1587/2366 symbols completed. OKE took 40.1s. Estimated remaining: 1h 40m 1s. Rate: 7.8 symbols/min
[2025-10-24T20:23:48.748299] [INFO ] [MAIN      ] ONIT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:23:48.757465] [DEBUG] [LOCAL     ] ONIT: Loaded 7548 existing records from primary storage.
[2025-10-24T20:23:48.757710] [INFO ] [MAIN      ] ONIT: Loaded 7548 existing records.
[2025-10-24T20:23:48.930182] [WARN ] [MAIN      ] ONIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:23:48.930606] [INFO ] [MAIN      ] ONIT: Wiping existing primary data before full refresh.
[2025-10-24T20:23:48.930681] [INFO ] [LOCAL     ] ONIT: Starting deletion of primary data.
[2025-10-24T20:23:48.930855] [DEBUG] [LOCAL     ] ONIT: Deleted primary data file.
[2025-10-24T20:23:48.930894] [INFO ] [MAIN      ] ONIT: Starting full primary refresh.
[2025-10-24T20:23:48.962794] [INFO ] [REMOTE    ] OMC: Fetching primary data for 2025-02.
[2025-10-24T20:23:49.379671] [INFO ] [REMOTE    ] ONIT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:23:49.658047] [INFO ] [REMOTE    ] OMI: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T20:23:49.747739] [INFO ] [REMOTE    ] OMI: Fetching primary data for 2025-02.
[2025-10-24T20:23:49.978282] [INFO ] [REMOTE    ] OMF: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T20:23:50.547724] [INFO ] [REMOTE    ] OMF: Fetching primary data for 2025-02.
[2025-10-24T20:23:50.864895] [INFO ] [REMOTE    ] OMC: Incremental fetch complete for 2025-02 (1.90 seconds).
[2025-10-24T20:23:50.942193] [INFO ] [REMOTE    ] OMI: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T20:23:51.347685] [INFO ] [REMOTE    ] OMC: Fetching primary data for 2025-03.
[2025-10-24T20:23:52.066267] [INFO ] [REMOTE    ] OMF: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T20:23:52.147670] [INFO ] [REMOTE    ] OMF: Fetching primary data for 2025-03.
[2025-10-24T20:23:52.947719] [INFO ] [REMOTE    ] ONIT: Fetching primary data for 2025-01.
[2025-10-24T20:23:53.226221] [INFO ] [REMOTE    ] OMC: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T20:23:53.610076] [INFO ] [REMOTE    ] ONIT: Incremental fetch complete for 2025-01 (0.66 seconds).
[2025-10-24T20:23:53.747626] [INFO ] [REMOTE    ] ONIT: Fetching primary data for 2025-02.
[2025-10-24T20:23:53.859499] [INFO ] [REMOTE    ] OMF: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T20:23:54.547638] [INFO ] [REMOTE    ] OMF: Fetching primary data for 2025-04.
[2025-10-24T20:23:54.709479] [INFO ] [REMOTE    ] ONIT: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T20:23:55.347675] [INFO ] [REMOTE    ] ONIT: Fetching primary data for 2025-03.
[2025-10-24T20:23:56.147608] [INFO ] [REMOTE    ] OMC: Fetching primary data for 2025-04.
[2025-10-24T20:23:56.236606] [INFO ] [REMOTE    ] ONIT: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T20:23:56.266516] [INFO ] [REMOTE    ] OMF: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T20:23:56.947664] [INFO ] [REMOTE    ] OMF: Fetching primary data for 2025-05.
[2025-10-24T20:23:57.747615] [INFO ] [REMOTE    ] ONIT: Fetching primary data for 2025-04.
[2025-10-24T20:23:58.181786] [INFO ] [REMOTE    ] OMC: Incremental fetch complete for 2025-04 (2.03 seconds).
[2025-10-24T20:23:58.547612] [INFO ] [REMOTE    ] OMI: Fetching primary data for 2025-03.
[2025-10-24T20:23:58.883873] [INFO ] [REMOTE    ] OMF: Incremental fetch complete for 2025-05 (1.94 seconds).
[2025-10-24T20:23:59.347630] [INFO ] [REMOTE    ] OMF: Fetching primary data for 2025-06.
[2025-10-24T20:23:59.813427] [INFO ] [REMOTE    ] ONIT: Incremental fetch complete for 2025-04 (2.07 seconds).
[2025-10-24T20:24:00.152797] [INFO ] [REMOTE    ] OMC: Fetching primary data for 2025-05.
[2025-10-24T20:24:00.166571] [INFO ] [REMOTE    ] OMI: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T20:24:00.555508] [INFO ] [REMOTE    ] OMF: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T20:24:00.947697] [INFO ] [REMOTE    ] OMF: Fetching primary data for 2025-07.
[2025-10-24T20:24:01.747626] [INFO ] [REMOTE    ] OMI: Fetching primary data for 2025-04.
[2025-10-24T20:24:02.097373] [INFO ] [REMOTE    ] OMC: Incremental fetch complete for 2025-05 (1.94 seconds).
[2025-10-24T20:24:02.215111] [INFO ] [REMOTE    ] OMF: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T20:24:02.547727] [INFO ] [REMOTE    ] OMC: Fetching primary data for 2025-06.
[2025-10-24T20:24:03.347671] [INFO ] [REMOTE    ] ONIT: Fetching primary data for 2025-05.
[2025-10-24T20:24:03.507179] [INFO ] [REMOTE    ] OMI: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T20:24:04.147621] [INFO ] [REMOTE    ] OMI: Fetching primary data for 2025-05.
[2025-10-24T20:24:04.217192] [INFO ] [REMOTE    ] ONIT: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T20:24:04.365235] [INFO ] [REMOTE    ] OMC: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T20:24:04.947696] [INFO ] [REMOTE    ] ONIT: Fetching primary data for 2025-06.
[2025-10-24T20:24:05.528540] [INFO ] [REMOTE    ] OMI: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T20:24:05.747715] [INFO ] [REMOTE    ] OMC: Fetching primary data for 2025-07.
[2025-10-24T20:24:05.809388] [INFO ] [REMOTE    ] ONIT: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T20:24:06.547683] [INFO ] [REMOTE    ] ONIT: Fetching primary data for 2025-07.
[2025-10-24T20:24:07.347685] [INFO ] [REMOTE    ] OMI: Fetching primary data for 2025-06.
[2025-10-24T20:24:07.367640] [INFO ] [REMOTE    ] ONIT: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T20:24:07.852881] [INFO ] [REMOTE    ] OMC: Incremental fetch complete for 2025-07 (2.11 seconds).
[2025-10-24T20:24:08.147770] [INFO ] [REMOTE    ] OMC: Fetching primary data for 2025-08.
[2025-10-24T20:24:08.462195] [INFO ] [REMOTE    ] OMI: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T20:24:08.947713] [INFO ] [REMOTE    ] OMI: Fetching primary data for 2025-07.
[2025-10-24T20:24:09.747696] [INFO ] [REMOTE    ] OMF: Fetching primary data for 2025-08.
[2025-10-24T20:24:10.128814] [INFO ] [REMOTE    ] OMC: Incremental fetch complete for 2025-08 (1.98 seconds).
[2025-10-24T20:24:10.547689] [INFO ] [REMOTE    ] ONIT: Fetching primary data for 2025-08.
[2025-10-24T20:24:10.790101] [INFO ] [REMOTE    ] OMI: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T20:24:11.134715] [INFO ] [REMOTE    ] ONIT: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T20:24:11.347668] [INFO ] [REMOTE    ] ONIT: Fetching primary data for 2025-09.
[2025-10-24T20:24:11.401032] [INFO ] [REMOTE    ] OMF: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T20:24:12.147676] [INFO ] [REMOTE    ] OMF: Fetching primary data for 2025-09.
[2025-10-24T20:24:12.340197] [INFO ] [REMOTE    ] ONIT: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T20:24:12.947752] [INFO ] [REMOTE    ] OMC: Fetching primary data for 2025-09.
[2025-10-24T20:24:13.747635] [INFO ] [REMOTE    ] OMI: Fetching primary data for 2025-08.
[2025-10-24T20:24:13.962178] [INFO ] [REMOTE    ] OMF: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T20:24:14.547630] [INFO ] [REMOTE    ] ONIT: Fetching primary data for 2025-10.
[2025-10-24T20:24:14.812816] [INFO ] [REMOTE    ] OMC: Incremental fetch complete for 2025-09 (1.87 seconds).
[2025-10-24T20:24:15.347613] [INFO ] [REMOTE    ] OMF: Fetching primary data for 2025-10.
[2025-10-24T20:24:15.408776] [INFO ] [REMOTE    ] ONIT: Incremental fetch complete for 2025-10 (0.86 seconds).
[2025-10-24T20:24:15.410291] [INFO ] [REMOTE    ] ONIT: Full fetch complete (10952 records).
[2025-10-24T20:24:15.410358] [DEBUG] [VALIDATOR ] ONIT: Validating primary data.
[2025-10-24T20:24:15.806826] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present.
[2025-10-24T20:24:15.807002] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed.
[2025-10-24T20:24:15.807374] [INFO ] [MAIN      ] ONIT: Fetched primary data is valid.
[2025-10-24T20:24:15.807452] [DEBUG] [LOCAL     ] ONIT: Saving primary data.
[2025-10-24T20:24:15.809738] [FATAL] [LOCAL     ] ONIT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:24:15.809474] [INFO ] [REMOTE    ] OMI: Incremental fetch complete for 2025-08 (2.06 seconds).
[2025-10-24T20:24:15.819992] [FATAL] [MAIN      ] ONIT: Failed to save primary data.
[2025-10-24T20:24:15.820443] [WARN ] [MAIN      ] ONIT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:24:15.820531] [INFO ] [LOCAL     ] ONIT: Starting deletion of primary data.
[2025-10-24T20:24:15.820663] [DEBUG] [LOCAL     ] ONIT: No primary data file found to delete.
[2025-10-24T20:24:15.821049] [INFO ] [LOCAL     ] ONIT: Starting deletion of derivative data.
[2025-10-24T20:24:15.821212] [DEBUG] [LOCAL     ] ONIT: Deleted derivative data file.
[2025-10-24T20:24:15.821295] [INFO ] [MAIN      ] Update Progress: 1588/2366 symbols completed. ONIT took 27.2s. Estimated remaining: 1h 40m 3s. Rate: 7.8 symbols/min
[2025-10-24T20:24:15.990597] [INFO ] [MAIN      ] ONL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:24:16.018276] [DEBUG] [LOCAL     ] ONL: Loaded 29013 existing records from primary storage.
[2025-10-24T20:24:16.018546] [INFO ] [MAIN      ] ONL: Loaded 29013 existing records.
[2025-10-24T20:24:16.155101] [INFO ] [REMOTE    ] OMC: Fetching primary data for 2025-10.
[2025-10-24T20:24:16.198721] [WARN ] [MAIN      ] ONL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:24:16.199015] [INFO ] [MAIN      ] ONL: Wiping existing primary data before full refresh.
[2025-10-24T20:24:16.199076] [INFO ] [LOCAL     ] ONL: Starting deletion of primary data.
[2025-10-24T20:24:16.199303] [DEBUG] [LOCAL     ] ONL: Deleted primary data file.
[2025-10-24T20:24:16.199359] [INFO ] [MAIN      ] ONL: Starting full primary refresh.
[2025-10-24T20:24:16.548730] [INFO ] [REMOTE    ] ONL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:24:16.947683] [INFO ] [REMOTE    ] OMI: Fetching primary data for 2025-09.
[2025-10-24T20:24:17.112693] [INFO ] [REMOTE    ] OMF: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T20:24:17.122126] [INFO ] [REMOTE    ] OMF: Full fetch complete (67844 records).
[2025-10-24T20:24:17.122247] [DEBUG] [VALIDATOR ] OMF: Validating primary data.
[2025-10-24T20:24:17.563144] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present.
[2025-10-24T20:24:17.563241] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed.
[2025-10-24T20:24:17.564394] [INFO ] [MAIN      ] OMF: Fetched primary data is valid.
[2025-10-24T20:24:17.564458] [DEBUG] [LOCAL     ] OMF: Saving primary data.
[2025-10-24T20:24:17.565128] [FATAL] [LOCAL     ] OMF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:24:17.565242] [FATAL] [MAIN      ] OMF: Failed to save primary data.
[2025-10-24T20:24:17.565289] [WARN ] [MAIN      ] OMF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:24:17.565331] [INFO ] [LOCAL     ] OMF: Starting deletion of primary data.
[2025-10-24T20:24:17.565397] [DEBUG] [LOCAL     ] OMF: No primary data file found to delete.
[2025-10-24T20:24:17.565446] [INFO ] [LOCAL     ] OMF: Starting deletion of derivative data.
[2025-10-24T20:24:17.565635] [DEBUG] [LOCAL     ] OMF: Deleted derivative data file.
[2025-10-24T20:24:17.566047] [INFO ] [MAIN      ] Update Progress: 1589/2366 symbols completed. OMF took 31.2s. Estimated remaining: 1h 39m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:24:17.739020] [INFO ] [MAIN      ] ONON: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:24:17.747680] [INFO ] [REMOTE    ] ONL: Fetching primary data for 2025-01.
[2025-10-24T20:24:17.790822] [DEBUG] [LOCAL     ] ONON: Loaded 54003 existing records from primary storage.
[2025-10-24T20:24:17.791143] [INFO ] [MAIN      ] ONON: Loaded 54003 existing records.
[2025-10-24T20:24:17.984930] [WARN ] [MAIN      ] ONON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:24:17.985266] [INFO ] [MAIN      ] ONON: Wiping existing primary data before full refresh.
[2025-10-24T20:24:17.985320] [INFO ] [LOCAL     ] ONON: Starting deletion of primary data.
[2025-10-24T20:24:17.985703] [DEBUG] [LOCAL     ] ONON: Deleted primary data file.
[2025-10-24T20:24:17.985757] [INFO ] [MAIN      ] ONON: Starting full primary refresh.
[2025-10-24T20:24:18.345169] [INFO ] [REMOTE    ] ONON: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:24:18.373034] [INFO ] [REMOTE    ] OMC: Incremental fetch complete for 2025-10 (2.22 seconds).
[2025-10-24T20:24:18.384324] [INFO ] [REMOTE    ] OMC: Full fetch complete (77291 records).
[2025-10-24T20:24:18.384484] [DEBUG] [VALIDATOR ] OMC: Validating primary data.
[2025-10-24T20:24:18.554766] [INFO ] [REMOTE    ] ONON: Fetching primary data for 2025-01.
[2025-10-24T20:24:18.838354] [INFO ] [REMOTE    ] OMI: Incremental fetch complete for 2025-09 (1.89 seconds).
[2025-10-24T20:24:18.836450] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present.
[2025-10-24T20:24:18.847918] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed.
[2025-10-24T20:24:18.849214] [INFO ] [MAIN      ] OMC: Fetched primary data is valid.
[2025-10-24T20:24:18.849861] [DEBUG] [LOCAL     ] OMC: Saving primary data.
[2025-10-24T20:24:18.850579] [FATAL] [LOCAL     ] OMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:24:18.850714] [FATAL] [MAIN      ] OMC: Failed to save primary data.
[2025-10-24T20:24:18.850914] [WARN ] [MAIN      ] OMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:24:18.850987] [INFO ] [LOCAL     ] OMC: Starting deletion of primary data.
[2025-10-24T20:24:18.851052] [DEBUG] [LOCAL     ] OMC: No primary data file found to delete.
[2025-10-24T20:24:18.851089] [INFO ] [LOCAL     ] OMC: Starting deletion of derivative data.
[2025-10-24T20:24:18.851454] [DEBUG] [LOCAL     ] OMC: Deleted derivative data file.
[2025-10-24T20:24:18.851863] [INFO ] [MAIN      ] Update Progress: 1590/2366 symbols completed. OMC took 35.1s. Estimated remaining: 1h 39m 42s. Rate: 7.8 symbols/min
[2025-10-24T20:24:19.030930] [INFO ] [MAIN      ] ONTF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:24:19.054100] [DEBUG] [LOCAL     ] ONTF: Loaded 22692 existing records from primary storage.
[2025-10-24T20:24:19.054447] [INFO ] [MAIN      ] ONTF: Loaded 22692 existing records.
[2025-10-24T20:24:19.205155] [INFO ] [REMOTE    ] ONL: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T20:24:19.263003] [WARN ] [MAIN      ] ONTF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:24:19.263198] [INFO ] [MAIN      ] ONTF: Wiping existing primary data before full refresh.
[2025-10-24T20:24:19.263243] [INFO ] [LOCAL     ] ONTF: Starting deletion of primary data.
[2025-10-24T20:24:19.263463] [DEBUG] [LOCAL     ] ONTF: Deleted primary data file.
[2025-10-24T20:24:19.263519] [INFO ] [MAIN      ] ONTF: Starting full primary refresh.
[2025-10-24T20:24:19.354709] [INFO ] [REMOTE    ] ONL: Fetching primary data for 2025-02.
[2025-10-24T20:24:19.630547] [INFO ] [REMOTE    ] ONTF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:24:20.147677] [INFO ] [REMOTE    ] ONTF: Fetching primary data for 2025-01.
[2025-10-24T20:24:20.597591] [INFO ] [REMOTE    ] ONON: Incremental fetch complete for 2025-01 (2.04 seconds).
[2025-10-24T20:24:20.736487] [INFO ] [REMOTE    ] ONL: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T20:24:20.947630] [INFO ] [REMOTE    ] ONON: Fetching primary data for 2025-02.
[2025-10-24T20:24:21.289463] [INFO ] [REMOTE    ] ONTF: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T20:24:21.747718] [INFO ] [REMOTE    ] ONTF: Fetching primary data for 2025-02.
[2025-10-24T20:24:22.547630] [INFO ] [REMOTE    ] ONL: Fetching primary data for 2025-03.
[2025-10-24T20:24:22.762867] [INFO ] [REMOTE    ] ONTF: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T20:24:22.843945] [INFO ] [REMOTE    ] ONON: Incremental fetch complete for 2025-02 (1.90 seconds).
[2025-10-24T20:24:23.347682] [INFO ] [REMOTE    ] ONTF: Fetching primary data for 2025-03.
[2025-10-24T20:24:24.147679] [INFO ] [REMOTE    ] ONON: Fetching primary data for 2025-03.
[2025-10-24T20:24:24.269366] [INFO ] [REMOTE    ] ONL: Incremental fetch complete for 2025-03 (1.72 seconds).
[2025-10-24T20:24:24.512406] [INFO ] [REMOTE    ] ONTF: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T20:24:24.947640] [INFO ] [REMOTE    ] OMI: Fetching primary data for 2025-10.
[2025-10-24T20:24:25.747624] [INFO ] [REMOTE    ] ONTF: Fetching primary data for 2025-04.
[2025-10-24T20:24:26.208086] [INFO ] [REMOTE    ] ONON: Incremental fetch complete for 2025-03 (2.06 seconds).
[2025-10-24T20:24:26.547691] [INFO ] [REMOTE    ] ONL: Fetching primary data for 2025-04.
[2025-10-24T20:24:26.610006] [INFO ] [REMOTE    ] OMI: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T20:24:26.619677] [INFO ] [REMOTE    ] OMI: Full fetch complete (65864 records).
[2025-10-24T20:24:26.619832] [DEBUG] [VALIDATOR ] OMI: Validating primary data.
[2025-10-24T20:24:26.965229] [INFO ] [REMOTE    ] ONTF: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T20:24:27.041526] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present.
[2025-10-24T20:24:27.041606] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed.
[2025-10-24T20:24:27.042619] [INFO ] [MAIN      ] OMI: Fetched primary data is valid.
[2025-10-24T20:24:27.042712] [DEBUG] [LOCAL     ] OMI: Saving primary data.
[2025-10-24T20:24:27.043295] [FATAL] [LOCAL     ] OMI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:24:27.043383] [FATAL] [MAIN      ] OMI: Failed to save primary data.
[2025-10-24T20:24:27.043425] [WARN ] [MAIN      ] OMI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:24:27.043483] [INFO ] [LOCAL     ] OMI: Starting deletion of primary data.
[2025-10-24T20:24:27.043543] [DEBUG] [LOCAL     ] OMI: No primary data file found to delete.
[2025-10-24T20:24:27.043578] [INFO ] [LOCAL     ] OMI: Starting deletion of derivative data.
[2025-10-24T20:24:27.043616] [DEBUG] [LOCAL     ] OMI: No derivative data file found to delete.
[2025-10-24T20:24:27.043995] [INFO ] [MAIN      ] Update Progress: 1591/2366 symbols completed. OMI took 40.0s. Estimated remaining: 1h 39m 34s. Rate: 7.8 symbols/min
[2025-10-24T20:24:27.208821] [INFO ] [MAIN      ] ONTO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:24:27.255071] [DEBUG] [LOCAL     ] ONTO: Loaded 47505 existing records from primary storage.
[2025-10-24T20:24:27.255374] [INFO ] [MAIN      ] ONTO: Loaded 47505 existing records.
[2025-10-24T20:24:27.352793] [INFO ] [REMOTE    ] ONTF: Fetching primary data for 2025-05.
[2025-10-24T20:24:27.432818] [WARN ] [MAIN      ] ONTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:24:27.433051] [INFO ] [MAIN      ] ONTO: Wiping existing primary data before full refresh.
[2025-10-24T20:24:27.433098] [INFO ] [LOCAL     ] ONTO: Starting deletion of primary data.
[2025-10-24T20:24:27.433463] [DEBUG] [LOCAL     ] ONTO: Deleted primary data file.
[2025-10-24T20:24:27.433518] [INFO ] [MAIN      ] ONTO: Starting full primary refresh.
[2025-10-24T20:24:27.781588] [INFO ] [REMOTE    ] ONTO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:24:27.868793] [INFO ] [REMOTE    ] ONL: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T20:24:28.147684] [INFO ] [REMOTE    ] ONON: Fetching primary data for 2025-04.
[2025-10-24T20:24:28.647970] [INFO ] [REMOTE    ] ONTF: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T20:24:28.947634] [INFO ] [REMOTE    ] ONTO: Fetching primary data for 2025-01.
[2025-10-24T20:24:29.747694] [INFO ] [REMOTE    ] ONTF: Fetching primary data for 2025-06.
[2025-10-24T20:24:30.353272] [INFO ] [REMOTE    ] ONON: Incremental fetch complete for 2025-04 (2.21 seconds).
[2025-10-24T20:24:30.547620] [INFO ] [REMOTE    ] ONL: Fetching primary data for 2025-05.
[2025-10-24T20:24:30.664272] [INFO ] [REMOTE    ] ONTO: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T20:24:30.727004] [INFO ] [REMOTE    ] ONTF: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T20:24:31.347717] [INFO ] [REMOTE    ] ONTO: Fetching primary data for 2025-02.
[2025-10-24T20:24:32.058000] [INFO ] [REMOTE    ] ONL: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T20:24:32.147602] [INFO ] [REMOTE    ] ONL: Fetching primary data for 2025-06.
[2025-10-24T20:24:32.905184] [INFO ] [REMOTE    ] ONTO: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T20:24:32.947631] [INFO ] [REMOTE    ] ONTO: Fetching primary data for 2025-03.
[2025-10-24T20:24:33.614382] [INFO ] [REMOTE    ] ONL: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T20:24:33.747610] [INFO ] [REMOTE    ] ONTF: Fetching primary data for 2025-07.
[2025-10-24T20:24:34.547611] [INFO ] [REMOTE    ] ONON: Fetching primary data for 2025-05.
[2025-10-24T20:24:34.849054] [INFO ] [REMOTE    ] ONTO: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T20:24:34.960429] [INFO ] [REMOTE    ] ONTF: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T20:24:35.347621] [INFO ] [REMOTE    ] ONTO: Fetching primary data for 2025-04.
[2025-10-24T20:24:36.147675] [INFO ] [REMOTE    ] ONTF: Fetching primary data for 2025-08.
[2025-10-24T20:24:36.674074] [INFO ] [REMOTE    ] ONON: Incremental fetch complete for 2025-05 (2.13 seconds).
[2025-10-24T20:24:36.947722] [INFO ] [REMOTE    ] ONON: Fetching primary data for 2025-06.
[2025-10-24T20:24:37.111448] [INFO ] [REMOTE    ] ONTO: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T20:24:37.326829] [INFO ] [REMOTE    ] ONTF: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T20:24:37.747688] [INFO ] [REMOTE    ] ONTF: Fetching primary data for 2025-09.
[2025-10-24T20:24:38.547720] [INFO ] [REMOTE    ] ONL: Fetching primary data for 2025-07.
[2025-10-24T20:24:38.896227] [INFO ] [REMOTE    ] ONTF: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T20:24:39.155280] [INFO ] [REMOTE    ] ONON: Incremental fetch complete for 2025-06 (2.21 seconds).
[2025-10-24T20:24:39.347631] [INFO ] [REMOTE    ] ONTF: Fetching primary data for 2025-10.
[2025-10-24T20:24:39.367047] [INFO ] [REMOTE    ] ONL: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T20:24:40.147619] [INFO ] [REMOTE    ] ONON: Fetching primary data for 2025-07.
[2025-10-24T20:24:40.463851] [INFO ] [REMOTE    ] ONTF: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T20:24:40.468132] [INFO ] [REMOTE    ] ONTF: Full fetch complete (31506 records).
[2025-10-24T20:24:40.468216] [DEBUG] [VALIDATOR ] ONTF: Validating primary data.
[2025-10-24T20:24:40.840031] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present.
[2025-10-24T20:24:40.840107] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed.
[2025-10-24T20:24:40.840742] [INFO ] [MAIN      ] ONTF: Fetched primary data is valid.
[2025-10-24T20:24:40.840802] [DEBUG] [LOCAL     ] ONTF: Saving primary data.
[2025-10-24T20:24:40.841100] [FATAL] [LOCAL     ] ONTF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:24:40.841183] [FATAL] [MAIN      ] ONTF: Failed to save primary data.
[2025-10-24T20:24:40.841225] [WARN ] [MAIN      ] ONTF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:24:40.841262] [INFO ] [LOCAL     ] ONTF: Starting deletion of primary data.
[2025-10-24T20:24:40.841311] [DEBUG] [LOCAL     ] ONTF: No primary data file found to delete.
[2025-10-24T20:24:40.841346] [INFO ] [LOCAL     ] ONTF: Starting deletion of derivative data.
[2025-10-24T20:24:40.841520] [DEBUG] [LOCAL     ] ONTF: Deleted derivative data file.
[2025-10-24T20:24:40.841610] [INFO ] [MAIN      ] Update Progress: 1592/2366 symbols completed. ONTF took 22.0s. Estimated remaining: 1h 39m 29s. Rate: 7.8 symbols/min
[2025-10-24T20:24:40.952715] [INFO ] [REMOTE    ] ONL: Fetching primary data for 2025-08.
[2025-10-24T20:24:41.015189] [INFO ] [MAIN      ] OOMA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:24:41.034442] [DEBUG] [LOCAL     ] OOMA: Loaded 18375 existing records from primary storage.
[2025-10-24T20:24:41.034708] [INFO ] [MAIN      ] OOMA: Loaded 18375 existing records.
[2025-10-24T20:24:41.208840] [WARN ] [MAIN      ] OOMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:24:41.209066] [INFO ] [MAIN      ] OOMA: Wiping existing primary data before full refresh.
[2025-10-24T20:24:41.209112] [INFO ] [LOCAL     ] OOMA: Starting deletion of primary data.
[2025-10-24T20:24:41.209371] [DEBUG] [LOCAL     ] OOMA: Deleted primary data file.
[2025-10-24T20:24:41.209429] [INFO ] [MAIN      ] OOMA: Starting full primary refresh.
[2025-10-24T20:24:41.556895] [INFO ] [REMOTE    ] OOMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:24:41.747685] [INFO ] [REMOTE    ] ONTO: Fetching primary data for 2025-05.
[2025-10-24T20:24:42.170215] [INFO ] [REMOTE    ] ONON: Incremental fetch complete for 2025-07 (2.02 seconds).
[2025-10-24T20:24:42.293738] [INFO ] [REMOTE    ] ONL: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T20:24:42.547712] [INFO ] [REMOTE    ] OOMA: Fetching primary data for 2025-01.
[2025-10-24T20:24:43.347715] [INFO ] [REMOTE    ] ONON: Fetching primary data for 2025-08.
[2025-10-24T20:24:43.446637] [INFO ] [REMOTE    ] OOMA: Incremental fetch complete for 2025-01 (0.90 seconds).
[2025-10-24T20:24:43.647966] [INFO ] [REMOTE    ] ONTO: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T20:24:44.147717] [INFO ] [REMOTE    ] OOMA: Fetching primary data for 2025-02.
[2025-10-24T20:24:44.947617] [INFO ] [REMOTE    ] ONL: Fetching primary data for 2025-09.
[2025-10-24T20:24:45.245955] [INFO ] [REMOTE    ] OOMA: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T20:24:45.452017] [INFO ] [REMOTE    ] ONON: Incremental fetch complete for 2025-08 (2.10 seconds).
[2025-10-24T20:24:45.747634] [INFO ] [REMOTE    ] OOMA: Fetching primary data for 2025-03.
[2025-10-24T20:24:46.217080] [INFO ] [REMOTE    ] ONL: Incremental fetch complete for 2025-09 (1.27 seconds).
[2025-10-24T20:24:46.547638] [INFO ] [REMOTE    ] ONTO: Fetching primary data for 2025-06.
[2025-10-24T20:24:46.906217] [INFO ] [REMOTE    ] OOMA: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T20:24:47.347728] [INFO ] [REMOTE    ] OOMA: Fetching primary data for 2025-04.
[2025-10-24T20:24:48.147618] [INFO ] [REMOTE    ] ONON: Fetching primary data for 2025-09.
[2025-10-24T20:24:48.281140] [INFO ] [REMOTE    ] ONTO: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T20:24:48.478907] [INFO ] [REMOTE    ] OOMA: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T20:24:48.947716] [INFO ] [REMOTE    ] ONTO: Fetching primary data for 2025-07.
[2025-10-24T20:24:49.747672] [INFO ] [REMOTE    ] ONL: Fetching primary data for 2025-10.
[2025-10-24T20:24:50.343347] [INFO ] [REMOTE    ] ONON: Incremental fetch complete for 2025-09 (2.20 seconds).
[2025-10-24T20:24:50.547627] [INFO ] [REMOTE    ] ONON: Fetching primary data for 2025-10.
[2025-10-24T20:24:50.852140] [INFO ] [REMOTE    ] ONTO: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T20:24:50.909020] [INFO ] [REMOTE    ] ONL: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T20:24:50.914318] [INFO ] [REMOTE    ] ONL: Full fetch complete (42346 records).
[2025-10-24T20:24:50.914626] [DEBUG] [VALIDATOR ] ONL: Validating primary data.
[2025-10-24T20:24:51.285910] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present.
[2025-10-24T20:24:51.285989] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed.
[2025-10-24T20:24:51.286836] [INFO ] [MAIN      ] ONL: Fetched primary data is valid.
[2025-10-24T20:24:51.286897] [DEBUG] [LOCAL     ] ONL: Saving primary data.
[2025-10-24T20:24:51.287300] [FATAL] [LOCAL     ] ONL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:24:51.287407] [FATAL] [MAIN      ] ONL: Failed to save primary data.
[2025-10-24T20:24:51.287450] [WARN ] [MAIN      ] ONL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:24:51.287533] [INFO ] [LOCAL     ] ONL: Starting deletion of primary data.
[2025-10-24T20:24:51.287620] [DEBUG] [LOCAL     ] ONL: No primary data file found to delete.
[2025-10-24T20:24:51.287700] [INFO ] [LOCAL     ] ONL: Starting deletion of derivative data.
[2025-10-24T20:24:51.287906] [DEBUG] [LOCAL     ] ONL: Deleted derivative data file.
[2025-10-24T20:24:51.287985] [INFO ] [MAIN      ] Update Progress: 1593/2366 symbols completed. ONL took 35.5s. Estimated remaining: 1h 39m 23s. Rate: 7.8 symbols/min
[2025-10-24T20:24:51.352780] [INFO ] [REMOTE    ] OOMA: Fetching primary data for 2025-05.
[2025-10-24T20:24:51.461914] [INFO ] [MAIN      ] OPAD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:24:51.489218] [DEBUG] [LOCAL     ] OPAD: Loaded 26687 existing records from primary storage.
[2025-10-24T20:24:51.489514] [INFO ] [MAIN      ] OPAD: Loaded 26687 existing records.
[2025-10-24T20:24:51.670683] [WARN ] [MAIN      ] OPAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:24:51.670902] [INFO ] [MAIN      ] OPAD: Wiping existing primary data before full refresh.
[2025-10-24T20:24:51.670949] [INFO ] [LOCAL     ] OPAD: Starting deletion of primary data.
[2025-10-24T20:24:51.671288] [DEBUG] [LOCAL     ] OPAD: Deleted primary data file.
[2025-10-24T20:24:51.671344] [INFO ] [MAIN      ] OPAD: Starting full primary refresh.
[2025-10-24T20:24:52.030353] [INFO ] [REMOTE    ] OPAD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:24:52.147615] [INFO ] [REMOTE    ] ONTO: Fetching primary data for 2025-08.
[2025-10-24T20:24:52.515234] [INFO ] [REMOTE    ] OOMA: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T20:24:52.653711] [INFO ] [REMOTE    ] ONON: Incremental fetch complete for 2025-10 (2.11 seconds).
[2025-10-24T20:24:52.663526] [INFO ] [REMOTE    ] ONON: Full fetch complete (77770 records).
[2025-10-24T20:24:52.663693] [DEBUG] [VALIDATOR ] ONON: Validating primary data.
[2025-10-24T20:24:52.952716] [INFO ] [REMOTE    ] OOMA: Fetching primary data for 2025-06.
[2025-10-24T20:24:53.061234] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present.
[2025-10-24T20:24:53.061304] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed.
[2025-10-24T20:24:53.062409] [INFO ] [MAIN      ] ONON: Fetched primary data is valid.
[2025-10-24T20:24:53.062471] [DEBUG] [LOCAL     ] ONON: Saving primary data.
[2025-10-24T20:24:53.063076] [FATAL] [LOCAL     ] ONON: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:24:53.063166] [FATAL] [MAIN      ] ONON: Failed to save primary data.
[2025-10-24T20:24:53.063208] [WARN ] [MAIN      ] ONON: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:24:53.063274] [INFO ] [LOCAL     ] ONON: Starting deletion of primary data.
[2025-10-24T20:24:53.063334] [DEBUG] [LOCAL     ] ONON: No primary data file found to delete.
[2025-10-24T20:24:53.063369] [INFO ] [LOCAL     ] ONON: Starting deletion of derivative data.
[2025-10-24T20:24:53.063511] [DEBUG] [LOCAL     ] ONON: Deleted derivative data file.
[2025-10-24T20:24:53.064235] [INFO ] [MAIN      ] Update Progress: 1594/2366 symbols completed. ONON took 35.5s. Estimated remaining: 1h 39m 12s. Rate: 7.8 symbols/min
[2025-10-24T20:24:53.239858] [INFO ] [MAIN      ] OPFI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:24:53.285634] [DEBUG] [LOCAL     ] OPFI: Loaded 46281 existing records from primary storage.
[2025-10-24T20:24:53.285957] [INFO ] [MAIN      ] OPFI: Loaded 46281 existing records.
[2025-10-24T20:24:53.466720] [WARN ] [MAIN      ] OPFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:24:53.466975] [INFO ] [MAIN      ] OPFI: Wiping existing primary data before full refresh.
[2025-10-24T20:24:53.467022] [INFO ] [LOCAL     ] OPFI: Starting deletion of primary data.
[2025-10-24T20:24:53.467420] [DEBUG] [LOCAL     ] OPFI: Deleted primary data file.
[2025-10-24T20:24:53.467475] [INFO ] [MAIN      ] OPFI: Starting full primary refresh.
[2025-10-24T20:24:53.748437] [INFO ] [REMOTE    ] OPAD: Fetching primary data for 2025-01.
[2025-10-24T20:24:53.830995] [INFO ] [REMOTE    ] OPFI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:24:53.865400] [INFO ] [REMOTE    ] ONTO: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T20:24:54.116796] [INFO ] [REMOTE    ] OOMA: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T20:24:54.501366] [INFO ] [REMOTE    ] OPAD: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T20:24:54.547606] [INFO ] [REMOTE    ] OPAD: Fetching primary data for 2025-02.
[2025-10-24T20:24:55.288004] [INFO ] [REMOTE    ] OPAD: Incremental fetch complete for 2025-02 (0.74 seconds).
[2025-10-24T20:24:55.347639] [INFO ] [REMOTE    ] OPFI: Fetching primary data for 2025-01.
[2025-10-24T20:24:56.147729] [INFO ] [REMOTE    ] OOMA: Fetching primary data for 2025-07.
[2025-10-24T20:24:56.947721] [INFO ] [REMOTE    ] ONTO: Fetching primary data for 2025-09.
[2025-10-24T20:24:57.191810] [INFO ] [REMOTE    ] OPFI: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T20:24:57.377185] [INFO ] [REMOTE    ] OOMA: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T20:24:57.747676] [INFO ] [REMOTE    ] OPFI: Fetching primary data for 2025-02.
[2025-10-24T20:24:58.547688] [INFO ] [REMOTE    ] OOMA: Fetching primary data for 2025-08.
[2025-10-24T20:24:58.643522] [INFO ] [REMOTE    ] ONTO: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T20:24:59.347687] [INFO ] [REMOTE    ] ONTO: Fetching primary data for 2025-10.
[2025-10-24T20:24:59.725486] [INFO ] [REMOTE    ] OOMA: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T20:24:59.827779] [INFO ] [REMOTE    ] OPFI: Incremental fetch complete for 2025-02 (2.08 seconds).
[2025-10-24T20:25:00.147698] [INFO ] [REMOTE    ] OPFI: Fetching primary data for 2025-03.
[2025-10-24T20:25:00.947700] [INFO ] [REMOTE    ] OOMA: Fetching primary data for 2025-09.
[2025-10-24T20:25:01.122409] [INFO ] [REMOTE    ] ONTO: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T20:25:01.131081] [INFO ] [REMOTE    ] ONTO: Full fetch complete (67292 records).
[2025-10-24T20:25:01.131211] [DEBUG] [VALIDATOR ] ONTO: Validating primary data.
[2025-10-24T20:25:01.530028] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present.
[2025-10-24T20:25:01.530123] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed.
[2025-10-24T20:25:01.531763] [INFO ] [MAIN      ] ONTO: Fetched primary data is valid.
[2025-10-24T20:25:01.531849] [DEBUG] [LOCAL     ] ONTO: Saving primary data.
[2025-10-24T20:25:01.532482] [FATAL] [LOCAL     ] ONTO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:25:01.532580] [FATAL] [MAIN      ] ONTO: Failed to save primary data.
[2025-10-24T20:25:01.532623] [WARN ] [MAIN      ] ONTO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:25:01.532705] [INFO ] [LOCAL     ] ONTO: Starting deletion of primary data.
[2025-10-24T20:25:01.532783] [DEBUG] [LOCAL     ] ONTO: No primary data file found to delete.
[2025-10-24T20:25:01.532820] [INFO ] [LOCAL     ] ONTO: Starting deletion of derivative data.
[2025-10-24T20:25:01.533015] [DEBUG] [LOCAL     ] ONTO: Deleted derivative data file.
[2025-10-24T20:25:01.533459] [INFO ] [MAIN      ] Update Progress: 1595/2366 symbols completed. ONTO took 34.5s. Estimated remaining: 1h 39m 5s. Rate: 7.8 symbols/min
[2025-10-24T20:25:01.726331] [INFO ] [MAIN      ] OPP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:25:01.739301] [DEBUG] [LOCAL     ] OPP: Loaded 12463 existing records from primary storage.
[2025-10-24T20:25:01.739533] [INFO ] [MAIN      ] OPP: Loaded 12463 existing records.
[2025-10-24T20:25:01.760786] [INFO ] [REMOTE    ] OPAD: Fetching primary data for 2025-03.
[2025-10-24T20:25:01.955890] [WARN ] [MAIN      ] OPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:25:01.956325] [INFO ] [MAIN      ] OPP: Wiping existing primary data before full refresh.
[2025-10-24T20:25:01.956399] [INFO ] [LOCAL     ] OPP: Starting deletion of primary data.
[2025-10-24T20:25:01.962038] [DEBUG] [LOCAL     ] OPP: Deleted primary data file.
[2025-10-24T20:25:01.967684] [INFO ] [MAIN      ] OPP: Starting full primary refresh.
[2025-10-24T20:25:01.984090] [INFO ] [REMOTE    ] OOMA: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T20:25:02.411424] [INFO ] [REMOTE    ] OPP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:25:02.439714] [INFO ] [REMOTE    ] OPFI: Incremental fetch complete for 2025-03 (2.29 seconds).
[2025-10-24T20:25:02.469764] [INFO ] [REMOTE    ] OPAD: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T20:25:02.547611] [INFO ] [REMOTE    ] OPAD: Fetching primary data for 2025-04.
[2025-10-24T20:25:03.347726] [INFO ] [REMOTE    ] OOMA: Fetching primary data for 2025-10.
[2025-10-24T20:25:03.526039] [INFO ] [REMOTE    ] OPAD: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T20:25:04.147683] [INFO ] [REMOTE    ] OPFI: Fetching primary data for 2025-04.
[2025-10-24T20:25:04.494070] [INFO ] [REMOTE    ] OOMA: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T20:25:04.497303] [INFO ] [REMOTE    ] OOMA: Full fetch complete (25870 records).
[2025-10-24T20:25:04.497384] [DEBUG] [VALIDATOR ] OOMA: Validating primary data.
[2025-10-24T20:25:04.863411] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present.
[2025-10-24T20:25:04.863489] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed.
[2025-10-24T20:25:04.864032] [INFO ] [MAIN      ] OOMA: Fetched primary data is valid.
[2025-10-24T20:25:04.864095] [DEBUG] [LOCAL     ] OOMA: Saving primary data.
[2025-10-24T20:25:04.864430] [FATAL] [LOCAL     ] OOMA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:25:04.864510] [FATAL] [MAIN      ] OOMA: Failed to save primary data.
[2025-10-24T20:25:04.864552] [WARN ] [MAIN      ] OOMA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:25:04.864586] [INFO ] [LOCAL     ] OOMA: Starting deletion of primary data.
[2025-10-24T20:25:04.864635] [DEBUG] [LOCAL     ] OOMA: No primary data file found to delete.
[2025-10-24T20:25:04.864711] [INFO ] [LOCAL     ] OOMA: Starting deletion of derivative data.
[2025-10-24T20:25:04.864894] [DEBUG] [LOCAL     ] OOMA: Deleted derivative data file.
[2025-10-24T20:25:04.864986] [INFO ] [MAIN      ] Update Progress: 1596/2366 symbols completed. OOMA took 24.0s. Estimated remaining: 1h 38m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:25:04.954488] [INFO ] [REMOTE    ] OPP: Fetching primary data for 2025-01.
[2025-10-24T20:25:05.036582] [INFO ] [MAIN      ] OPY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:25:05.036785] [DEBUG] [LOCAL     ] OPY: No existing data file found in primary storage.
[2025-10-24T20:25:05.036828] [WARN ] [MAIN      ] OPY: No existing data found, performing full refresh instead.
[2025-10-24T20:25:05.036938] [INFO ] [MAIN      ] OPY: Wiping existing primary data before full refresh.
[2025-10-24T20:25:05.036979] [INFO ] [LOCAL     ] OPY: Starting deletion of primary data.
[2025-10-24T20:25:05.037019] [DEBUG] [LOCAL     ] OPY: No primary data file found to delete.
[2025-10-24T20:25:05.037052] [INFO ] [MAIN      ] OPY: Starting full primary refresh.
[2025-10-24T20:25:05.396768] [INFO ] [REMOTE    ] OPY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:25:05.747722] [INFO ] [REMOTE    ] OPAD: Fetching primary data for 2025-05.
[2025-10-24T20:25:05.902442] [INFO ] [REMOTE    ] OPP: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T20:25:06.007152] [INFO ] [REMOTE    ] OPFI: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T20:25:06.337541] [INFO ] [REMOTE    ] OPAD: Incremental fetch complete for 2025-05 (0.59 seconds).
[2025-10-24T20:25:06.547728] [INFO ] [REMOTE    ] OPAD: Fetching primary data for 2025-06.
[2025-10-24T20:25:07.347616] [INFO ] [REMOTE    ] OPP: Fetching primary data for 2025-02.
[2025-10-24T20:25:07.417311] [INFO ] [REMOTE    ] OPAD: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T20:25:08.147726] [INFO ] [REMOTE    ] OPY: Fetching primary data for 2025-01.
[2025-10-24T20:25:08.260037] [INFO ] [REMOTE    ] OPP: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T20:25:08.947708] [INFO ] [REMOTE    ] OPP: Fetching primary data for 2025-03.
[2025-10-24T20:25:08.954120] [INFO ] [REMOTE    ] OPY: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T20:25:09.747621] [INFO ] [REMOTE    ] OPY: Fetching primary data for 2025-02.
[2025-10-24T20:25:09.980954] [INFO ] [REMOTE    ] OPP: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T20:25:10.450886] [INFO ] [REMOTE    ] OPY: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T20:25:10.547622] [INFO ] [REMOTE    ] OPP: Fetching primary data for 2025-04.
[2025-10-24T20:25:11.347637] [INFO ] [REMOTE    ] OPAD: Fetching primary data for 2025-07.
[2025-10-24T20:25:11.774373] [INFO ] [REMOTE    ] OPP: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T20:25:12.147674] [INFO ] [REMOTE    ] OPFI: Fetching primary data for 2025-05.
[2025-10-24T20:25:12.913034] [INFO ] [REMOTE    ] OPAD: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T20:25:12.947612] [INFO ] [REMOTE    ] OPP: Fetching primary data for 2025-05.
[2025-10-24T20:25:13.747626] [INFO ] [REMOTE    ] OPAD: Fetching primary data for 2025-08.
[2025-10-24T20:25:14.099349] [INFO ] [REMOTE    ] OPFI: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T20:25:14.138098] [INFO ] [REMOTE    ] OPP: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T20:25:14.547689] [INFO ] [REMOTE    ] OPP: Fetching primary data for 2025-06.
[2025-10-24T20:25:15.347726] [INFO ] [REMOTE    ] OPY: Fetching primary data for 2025-03.
[2025-10-24T20:25:15.493665] [INFO ] [REMOTE    ] OPP: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T20:25:15.557124] [INFO ] [REMOTE    ] OPAD: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T20:25:16.147737] [INFO ] [REMOTE    ] OPP: Fetching primary data for 2025-07.
[2025-10-24T20:25:16.233677] [INFO ] [REMOTE    ] OPY: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T20:25:16.947613] [INFO ] [REMOTE    ] OPAD: Fetching primary data for 2025-09.
[2025-10-24T20:25:17.192448] [INFO ] [REMOTE    ] OPP: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T20:25:17.747722] [INFO ] [REMOTE    ] OPFI: Fetching primary data for 2025-06.
[2025-10-24T20:25:18.547676] [INFO ] [REMOTE    ] OPP: Fetching primary data for 2025-08.
[2025-10-24T20:25:19.353791] [INFO ] [REMOTE    ] OPY: Fetching primary data for 2025-04.
[2025-10-24T20:25:19.367394] [INFO ] [REMOTE    ] OPAD: Incremental fetch complete for 2025-09 (2.42 seconds).
[2025-10-24T20:25:19.499991] [INFO ] [REMOTE    ] OPFI: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T20:25:19.521994] [INFO ] [REMOTE    ] OPP: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T20:25:20.147704] [INFO ] [REMOTE    ] OPFI: Fetching primary data for 2025-07.
[2025-10-24T20:25:20.285751] [INFO ] [REMOTE    ] OPY: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T20:25:20.947766] [INFO ] [REMOTE    ] OPP: Fetching primary data for 2025-09.
[2025-10-24T20:25:21.747718] [INFO ] [REMOTE    ] OPY: Fetching primary data for 2025-05.
[2025-10-24T20:25:21.875776] [INFO ] [REMOTE    ] OPP: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T20:25:21.921591] [INFO ] [REMOTE    ] OPFI: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T20:25:22.547699] [INFO ] [REMOTE    ] OPP: Fetching primary data for 2025-10.
[2025-10-24T20:25:22.613014] [INFO ] [REMOTE    ] OPY: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T20:25:23.347708] [INFO ] [REMOTE    ] OPY: Fetching primary data for 2025-06.
[2025-10-24T20:25:23.655274] [INFO ] [REMOTE    ] OPP: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T20:25:23.658957] [INFO ] [REMOTE    ] OPP: Full fetch complete (17494 records).
[2025-10-24T20:25:23.659046] [DEBUG] [VALIDATOR ] OPP: Validating primary data.
[2025-10-24T20:25:24.036630] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present.
[2025-10-24T20:25:24.036736] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed.
[2025-10-24T20:25:24.037161] [INFO ] [MAIN      ] OPP: Fetched primary data is valid.
[2025-10-24T20:25:24.037201] [DEBUG] [LOCAL     ] OPP: Saving primary data.
[2025-10-24T20:25:24.037495] [FATAL] [LOCAL     ] OPP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:25:24.037577] [FATAL] [MAIN      ] OPP: Failed to save primary data.
[2025-10-24T20:25:24.037618] [WARN ] [MAIN      ] OPP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:25:24.037704] [INFO ] [LOCAL     ] OPP: Starting deletion of primary data.
[2025-10-24T20:25:24.037785] [DEBUG] [LOCAL     ] OPP: No primary data file found to delete.
[2025-10-24T20:25:24.037842] [INFO ] [LOCAL     ] OPP: Starting deletion of derivative data.
[2025-10-24T20:25:24.037996] [DEBUG] [LOCAL     ] OPP: Deleted derivative data file.
[2025-10-24T20:25:24.038067] [INFO ] [MAIN      ] Update Progress: 1597/2366 symbols completed. OPP took 22.5s. Estimated remaining: 1h 38m 53s. Rate: 7.8 symbols/min
[2025-10-24T20:25:24.147702] [INFO ] [REMOTE    ] OPFI: Fetching primary data for 2025-08.
[2025-10-24T20:25:24.229916] [INFO ] [REMOTE    ] OPY: Incremental fetch complete for 2025-06 (0.88 seconds).
[2025-10-24T20:25:24.947754] [INFO ] [REMOTE    ] OPAD: Fetching primary data for 2025-10.
[2025-10-24T20:25:25.747720] [INFO ] [REMOTE    ] OPY: Fetching primary data for 2025-07.
[2025-10-24T20:25:25.912063] [INFO ] [REMOTE    ] OPFI: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T20:25:26.547722] [INFO ] [REMOTE    ] OPFI: Fetching primary data for 2025-09.
[2025-10-24T20:25:26.624329] [INFO ] [REMOTE    ] OPAD: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T20:25:26.633913] [INFO ] [REMOTE    ] OPAD: Full fetch complete (29496 records).
[2025-10-24T20:25:26.634048] [DEBUG] [VALIDATOR ] OPAD: Validating primary data.
[2025-10-24T20:25:26.645901] [INFO ] [REMOTE    ] OPY: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T20:25:27.021951] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present.
[2025-10-24T20:25:27.022030] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed.
[2025-10-24T20:25:27.022610] [INFO ] [MAIN      ] OPAD: Fetched primary data is valid.
[2025-10-24T20:25:27.022674] [DEBUG] [LOCAL     ] OPAD: Saving primary data.
[2025-10-24T20:25:27.023028] [FATAL] [LOCAL     ] OPAD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:25:27.023111] [FATAL] [MAIN      ] OPAD: Failed to save primary data.
[2025-10-24T20:25:27.023153] [WARN ] [MAIN      ] OPAD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:25:27.023186] [INFO ] [LOCAL     ] OPAD: Starting deletion of primary data.
[2025-10-24T20:25:27.023248] [DEBUG] [LOCAL     ] OPAD: No primary data file found to delete.
[2025-10-24T20:25:27.023323] [INFO ] [LOCAL     ] OPAD: Starting deletion of derivative data.
[2025-10-24T20:25:27.023471] [DEBUG] [LOCAL     ] OPAD: Deleted derivative data file.
[2025-10-24T20:25:27.023544] [INFO ] [MAIN      ] Update Progress: 1598/2366 symbols completed. OPAD took 35.7s. Estimated remaining: 1h 38m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:25:27.347730] [INFO ] [REMOTE    ] OPY: Fetching primary data for 2025-08.
[2025-10-24T20:25:28.159701] [INFO ] [REMOTE    ] OPY: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T20:25:28.162159] [INFO ] [REMOTE    ] OPY: Fetching primary data for 2025-09.
[2025-10-24T20:25:28.188712] [INFO ] [REMOTE    ] OPFI: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T20:25:28.947757] [INFO ] [REMOTE    ] OPFI: Fetching primary data for 2025-10.
[2025-10-24T20:25:29.062552] [INFO ] [REMOTE    ] OPY: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T20:25:29.747739] [INFO ] [REMOTE    ] OPY: Fetching primary data for 2025-10.
[2025-10-24T20:25:30.627461] [INFO ] [REMOTE    ] OPY: Incremental fetch complete for 2025-10 (0.88 seconds).
[2025-10-24T20:25:30.630144] [INFO ] [REMOTE    ] OPY: Full fetch complete (10227 records).
[2025-10-24T20:25:30.630232] [DEBUG] [VALIDATOR ] OPY: Validating primary data.
[2025-10-24T20:25:30.826927] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T20:25:30.827241] [FATAL] [MAIN      ] OPY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:25:30.827508] [WARN ] [MAIN      ] OPY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:25:30.827632] [INFO ] [LOCAL     ] OPY: Starting deletion of primary data.
[2025-10-24T20:25:30.827758] [DEBUG] [LOCAL     ] OPY: No primary data file found to delete.
[2025-10-24T20:25:30.827891] [INFO ] [LOCAL     ] OPY: Starting deletion of derivative data.
[2025-10-24T20:25:30.828026] [DEBUG] [LOCAL     ] OPY: No derivative data file found to delete.
[2025-10-24T20:25:30.828157] [INFO ] [MAIN      ] Update Progress: 1599/2366 symbols completed. OPY took 26.0s. Estimated remaining: 1h 38m 33s. Rate: 7.8 symbols/min
[2025-10-24T20:25:30.849808] [INFO ] [REMOTE    ] OPFI: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T20:25:30.857949] [INFO ] [REMOTE    ] OPFI: Full fetch complete (68507 records).
[2025-10-24T20:25:30.858082] [DEBUG] [VALIDATOR ] OPFI: Validating primary data.
[2025-10-24T20:25:31.241121] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present.
[2025-10-24T20:25:31.241206] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed.
[2025-10-24T20:25:31.242302] [INFO ] [MAIN      ] OPFI: Fetched primary data is valid.
[2025-10-24T20:25:31.242366] [DEBUG] [LOCAL     ] OPFI: Saving primary data.
[2025-10-24T20:25:31.242975] [FATAL] [LOCAL     ] OPFI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:25:31.243066] [FATAL] [MAIN      ] OPFI: Failed to save primary data.
[2025-10-24T20:25:31.243107] [WARN ] [MAIN      ] OPFI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:25:31.243141] [INFO ] [LOCAL     ] OPFI: Starting deletion of primary data.
[2025-10-24T20:25:31.243195] [DEBUG] [LOCAL     ] OPFI: No primary data file found to delete.
[2025-10-24T20:25:31.243230] [INFO ] [LOCAL     ] OPFI: Starting deletion of derivative data.
[2025-10-24T20:25:31.243402] [DEBUG] [LOCAL     ] OPFI: Deleted derivative data file.
[2025-10-24T20:25:31.243746] [INFO ] [MAIN      ] Update Progress: 1600/2366 symbols completed. OPFI took 38.2s. Estimated remaining: 1h 38m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:25:31.982382] [INFO ] [MAIN      ] ORCL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:25:32.009000] [DEBUG] [LOCAL     ] ORCL: No existing data file found in primary storage.
[2025-10-24T20:25:32.009149] [WARN ] [MAIN      ] ORCL: No existing data found, performing full refresh instead.
[2025-10-24T20:25:31.991081] [INFO ] [MAIN      ] ORC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:25:31.977227] [INFO ] [MAIN      ] ORA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:25:32.010310] [INFO ] [MAIN      ] OR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:25:32.010729] [INFO ] [MAIN      ] ORCL: Wiping existing primary data before full refresh.
[2025-10-24T20:25:32.011380] [INFO ] [LOCAL     ] ORCL: Starting deletion of primary data.
[2025-10-24T20:25:32.011818] [DEBUG] [LOCAL     ] ORCL: No primary data file found to delete.
[2025-10-24T20:25:32.011958] [INFO ] [MAIN      ] ORCL: Starting full primary refresh.
[2025-10-24T20:25:32.293326] [DEBUG] [LOCAL     ] ORA: Loaded 33371 existing records from primary storage.
[2025-10-24T20:25:32.343924] [INFO ] [MAIN      ] ORA: Loaded 33371 existing records.
[2025-10-24T20:25:32.435318] [DEBUG] [LOCAL     ] ORC: Loaded 52861 existing records from primary storage.
[2025-10-24T20:25:32.465409] [DEBUG] [LOCAL     ] OR: Loaded 47206 existing records from primary storage.
[2025-10-24T20:25:32.480298] [INFO ] [MAIN      ] ORC: Loaded 52861 existing records.
[2025-10-24T20:25:32.533448] [INFO ] [MAIN      ] OR: Loaded 47206 existing records.
[2025-10-24T20:25:32.657498] [INFO ] [REMOTE    ] ORCL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:25:32.673556] [INFO ] [REMOTE    ] ORCL: Fetching primary data for 2025-01.
[2025-10-24T20:25:32.887016] [WARN ] [MAIN      ] ORA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:25:32.911973] [INFO ] [MAIN      ] ORA: Wiping existing primary data before full refresh.
[2025-10-24T20:25:32.943070] [INFO ] [LOCAL     ] ORA: Starting deletion of primary data.
[2025-10-24T20:25:32.982202] [DEBUG] [LOCAL     ] ORA: Deleted primary data file.
[2025-10-24T20:25:33.033961] [INFO ] [MAIN      ] ORA: Starting full primary refresh.
[2025-10-24T20:25:33.053052] [WARN ] [MAIN      ] ORC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:25:33.074109] [INFO ] [MAIN      ] ORC: Wiping existing primary data before full refresh.
[2025-10-24T20:25:33.074264] [INFO ] [LOCAL     ] ORC: Starting deletion of primary data.
[2025-10-24T20:25:33.122773] [WARN ] [MAIN      ] OR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:25:33.161591] [INFO ] [MAIN      ] OR: Wiping existing primary data before full refresh.
[2025-10-24T20:25:33.167250] [DEBUG] [LOCAL     ] ORC: Deleted primary data file.
[2025-10-24T20:25:33.177538] [INFO ] [LOCAL     ] OR: Starting deletion of primary data.
[2025-10-24T20:25:33.188200] [INFO ] [MAIN      ] ORC: Starting full primary refresh.
[2025-10-24T20:25:33.193614] [DEBUG] [LOCAL     ] OR: Deleted primary data file.
[2025-10-24T20:25:33.200247] [INFO ] [MAIN      ] OR: Starting full primary refresh.
[2025-10-24T20:25:34.099666] [INFO ] [REMOTE    ] ORA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:25:34.138901] [INFO ] [REMOTE    ] ORA: Fetching primary data for 2025-01.
[2025-10-24T20:25:34.188428] [INFO ] [REMOTE    ] ORC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:25:34.199044] [INFO ] [REMOTE    ] ORC: Fetching primary data for 2025-01.
[2025-10-24T20:25:34.274550] [INFO ] [REMOTE    ] OR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:25:34.274906] [INFO ] [REMOTE    ] OR: Fetching primary data for 2025-01.
[2025-10-24T20:25:35.151282] [INFO ] [REMOTE    ] ORCL: Incremental fetch complete for 2025-01 (2.48 seconds).
[2025-10-24T20:25:35.163005] [INFO ] [REMOTE    ] ORCL: Fetching primary data for 2025-02.
[2025-10-24T20:25:35.245012] [INFO ] [REMOTE    ] ORA: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T20:25:35.252792] [INFO ] [REMOTE    ] ORA: Fetching primary data for 2025-02.
[2025-10-24T20:25:35.838082] [INFO ] [REMOTE    ] OR: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T20:25:35.846736] [INFO ] [REMOTE    ] OR: Fetching primary data for 2025-02.
[2025-10-24T20:25:36.187576] [INFO ] [REMOTE    ] ORC: Incremental fetch complete for 2025-01 (1.99 seconds).
[2025-10-24T20:25:36.197698] [INFO ] [REMOTE    ] ORC: Fetching primary data for 2025-02.
[2025-10-24T20:25:36.324931] [INFO ] [REMOTE    ] ORA: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T20:25:36.947737] [INFO ] [REMOTE    ] ORA: Fetching primary data for 2025-03.
[2025-10-24T20:25:37.172155] [INFO ] [REMOTE    ] OR: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T20:25:37.414270] [INFO ] [REMOTE    ] ORCL: Incremental fetch complete for 2025-02 (2.25 seconds).
[2025-10-24T20:25:37.556472] [INFO ] [REMOTE    ] ORC: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T20:25:37.747621] [INFO ] [REMOTE    ] OR: Fetching primary data for 2025-03.
[2025-10-24T20:25:38.502459] [INFO ] [REMOTE    ] ORA: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T20:25:38.547681] [INFO ] [REMOTE    ] ORCL: Fetching primary data for 2025-03.
[2025-10-24T20:25:39.347621] [INFO ] [REMOTE    ] ORC: Fetching primary data for 2025-03.
[2025-10-24T20:25:39.505933] [INFO ] [REMOTE    ] OR: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T20:25:40.147714] [INFO ] [REMOTE    ] OR: Fetching primary data for 2025-04.
[2025-10-24T20:25:40.947681] [INFO ] [REMOTE    ] ORA: Fetching primary data for 2025-04.
[2025-10-24T20:25:41.328169] [INFO ] [REMOTE    ] ORCL: Incremental fetch complete for 2025-03 (2.78 seconds).
[2025-10-24T20:25:41.441042] [INFO ] [REMOTE    ] ORC: Incremental fetch complete for 2025-03 (2.09 seconds).
[2025-10-24T20:25:41.747684] [INFO ] [REMOTE    ] ORC: Fetching primary data for 2025-04.
[2025-10-24T20:25:42.167163] [INFO ] [REMOTE    ] OR: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T20:25:42.448993] [INFO ] [REMOTE    ] ORA: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T20:25:42.547601] [INFO ] [REMOTE    ] ORA: Fetching primary data for 2025-05.
[2025-10-24T20:25:43.347717] [INFO ] [REMOTE    ] ORCL: Fetching primary data for 2025-04.
[2025-10-24T20:25:43.925855] [INFO ] [REMOTE    ] ORA: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T20:25:44.147700] [INFO ] [REMOTE    ] OR: Fetching primary data for 2025-05.
[2025-10-24T20:25:44.213313] [INFO ] [REMOTE    ] ORC: Incremental fetch complete for 2025-04 (2.47 seconds).
[2025-10-24T20:25:44.947735] [INFO ] [REMOTE    ] ORA: Fetching primary data for 2025-06.
[2025-10-24T20:25:45.747616] [INFO ] [REMOTE    ] ORC: Fetching primary data for 2025-05.
[2025-10-24T20:25:45.834995] [INFO ] [REMOTE    ] OR: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T20:25:46.278444] [INFO ] [REMOTE    ] ORCL: Incremental fetch complete for 2025-04 (2.93 seconds).
[2025-10-24T20:25:46.547146] [INFO ] [REMOTE    ] ORA: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T20:25:46.554151] [INFO ] [REMOTE    ] ORCL: Fetching primary data for 2025-05.
[2025-10-24T20:25:47.347630] [INFO ] [REMOTE    ] ORA: Fetching primary data for 2025-07.
[2025-10-24T20:25:47.878804] [INFO ] [REMOTE    ] ORC: Incremental fetch complete for 2025-05 (2.13 seconds).
[2025-10-24T20:25:48.147677] [INFO ] [REMOTE    ] ORC: Fetching primary data for 2025-06.
[2025-10-24T20:25:48.947708] [INFO ] [REMOTE    ] OR: Fetching primary data for 2025-06.
[2025-10-24T20:25:48.971844] [INFO ] [REMOTE    ] ORA: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T20:25:49.143716] [INFO ] [REMOTE    ] ORCL: Incremental fetch complete for 2025-05 (2.59 seconds).
[2025-10-24T20:25:49.747633] [INFO ] [REMOTE    ] ORA: Fetching primary data for 2025-08.
[2025-10-24T20:25:50.078477] [INFO ] [REMOTE    ] ORC: Incremental fetch complete for 2025-06 (1.93 seconds).
[2025-10-24T20:25:50.491430] [INFO ] [REMOTE    ] OR: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T20:25:50.547613] [INFO ] [REMOTE    ] OR: Fetching primary data for 2025-07.
[2025-10-24T20:25:51.052425] [INFO ] [REMOTE    ] ORA: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T20:25:51.347677] [INFO ] [REMOTE    ] ORCL: Fetching primary data for 2025-06.
[2025-10-24T20:25:52.147616] [INFO ] [REMOTE    ] ORC: Fetching primary data for 2025-07.
[2025-10-24T20:25:52.387402] [INFO ] [REMOTE    ] OR: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T20:25:52.947624] [INFO ] [REMOTE    ] OR: Fetching primary data for 2025-08.
[2025-10-24T20:25:53.752879] [INFO ] [REMOTE    ] ORA: Fetching primary data for 2025-09.
[2025-10-24T20:25:53.788766] [INFO ] [REMOTE    ] ORCL: Incremental fetch complete for 2025-06 (2.44 seconds).
[2025-10-24T20:25:54.490208] [INFO ] [REMOTE    ] ORC: Incremental fetch complete for 2025-07 (2.34 seconds).
[2025-10-24T20:25:54.547604] [INFO ] [REMOTE    ] ORC: Fetching primary data for 2025-08.
[2025-10-24T20:25:54.597241] [INFO ] [REMOTE    ] OR: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T20:25:54.805362] [INFO ] [REMOTE    ] ORA: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T20:25:55.347728] [INFO ] [REMOTE    ] ORA: Fetching primary data for 2025-10.
[2025-10-24T20:25:56.147617] [INFO ] [REMOTE    ] ORCL: Fetching primary data for 2025-07.
[2025-10-24T20:25:56.285554] [INFO ] [REMOTE    ] ORC: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T20:25:56.923592] [INFO ] [REMOTE    ] ORA: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T20:25:56.930750] [INFO ] [REMOTE    ] ORA: Full fetch complete (48894 records).
[2025-10-24T20:25:56.930851] [DEBUG] [VALIDATOR ] ORA: Validating primary data.
[2025-10-24T20:25:56.952866] [INFO ] [REMOTE    ] ORC: Fetching primary data for 2025-09.
[2025-10-24T20:25:57.331620] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present.
[2025-10-24T20:25:57.331760] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed.
[2025-10-24T20:25:57.332770] [INFO ] [MAIN      ] ORA: Fetched primary data is valid.
[2025-10-24T20:25:57.332832] [DEBUG] [LOCAL     ] ORA: Saving primary data.
[2025-10-24T20:25:57.333258] [FATAL] [LOCAL     ] ORA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:25:57.333369] [FATAL] [MAIN      ] ORA: Failed to save primary data.
[2025-10-24T20:25:57.333412] [WARN ] [MAIN      ] ORA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:25:57.333449] [INFO ] [LOCAL     ] ORA: Starting deletion of primary data.
[2025-10-24T20:25:57.333500] [DEBUG] [LOCAL     ] ORA: No primary data file found to delete.
[2025-10-24T20:25:57.333537] [INFO ] [LOCAL     ] ORA: Starting deletion of derivative data.
[2025-10-24T20:25:57.333811] [DEBUG] [LOCAL     ] ORA: Deleted derivative data file.
[2025-10-24T20:25:57.333907] [INFO ] [MAIN      ] Update Progress: 1601/2366 symbols completed. ORA took 26.1s. Estimated remaining: 1h 38m 23s. Rate: 7.8 symbols/min
[2025-10-24T20:25:57.508836] [INFO ] [MAIN      ] ORI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:25:57.509014] [DEBUG] [LOCAL     ] ORI: No existing data file found in primary storage.
[2025-10-24T20:25:57.509051] [WARN ] [MAIN      ] ORI: No existing data found, performing full refresh instead.
[2025-10-24T20:25:57.509159] [INFO ] [MAIN      ] ORI: Wiping existing primary data before full refresh.
[2025-10-24T20:25:57.509200] [INFO ] [LOCAL     ] ORI: Starting deletion of primary data.
[2025-10-24T20:25:57.509243] [DEBUG] [LOCAL     ] ORI: No primary data file found to delete.
[2025-10-24T20:25:57.509276] [INFO ] [MAIN      ] ORI: Starting full primary refresh.
[2025-10-24T20:25:57.758367] [INFO ] [REMOTE    ] OR: Fetching primary data for 2025-09.
[2025-10-24T20:25:57.871109] [INFO ] [REMOTE    ] ORI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:25:58.547637] [INFO ] [REMOTE    ] ORI: Fetching primary data for 2025-01.
[2025-10-24T20:25:59.082412] [INFO ] [REMOTE    ] ORC: Incremental fetch complete for 2025-09 (2.13 seconds).
[2025-10-24T20:25:59.151576] [INFO ] [REMOTE    ] ORCL: Incremental fetch complete for 2025-07 (3.00 seconds).
[2025-10-24T20:25:59.347614] [INFO ] [REMOTE    ] ORCL: Fetching primary data for 2025-08.
[2025-10-24T20:25:59.654730] [INFO ] [REMOTE    ] OR: Incremental fetch complete for 2025-09 (1.90 seconds).
[2025-10-24T20:26:00.018321] [INFO ] [REMOTE    ] ORI: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T20:26:00.147668] [INFO ] [REMOTE    ] OR: Fetching primary data for 2025-10.
[2025-10-24T20:26:00.947722] [INFO ] [REMOTE    ] ORI: Fetching primary data for 2025-02.
[2025-10-24T20:26:01.747740] [INFO ] [REMOTE    ] ORC: Fetching primary data for 2025-10.
[2025-10-24T20:26:02.099636] [INFO ] [REMOTE    ] OR: Incremental fetch complete for 2025-10 (1.95 seconds).
[2025-10-24T20:26:02.109561] [INFO ] [REMOTE    ] OR: Full fetch complete (67073 records).
[2025-10-24T20:26:02.109751] [DEBUG] [VALIDATOR ] OR: Validating primary data.
[2025-10-24T20:26:02.511533] [DEBUG] [VALIDATOR ] OR: All expected trading days are present.
[2025-10-24T20:26:02.511860] [DEBUG] [VALIDATOR ] OR: Primary data validation passed.
[2025-10-24T20:26:02.512934] [INFO ] [MAIN      ] OR: Fetched primary data is valid.
[2025-10-24T20:26:02.513019] [DEBUG] [LOCAL     ] OR: Saving primary data.
[2025-10-24T20:26:02.513742] [FATAL] [LOCAL     ] OR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:26:02.530680] [FATAL] [MAIN      ] OR: Failed to save primary data.
[2025-10-24T20:26:02.536623] [WARN ] [MAIN      ] OR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:26:02.536858] [INFO ] [LOCAL     ] OR: Starting deletion of primary data.
[2025-10-24T20:26:02.538407] [INFO ] [REMOTE    ] ORI: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T20:26:02.546948] [DEBUG] [LOCAL     ] OR: No primary data file found to delete.
[2025-10-24T20:26:02.547934] [INFO ] [REMOTE    ] ORI: Fetching primary data for 2025-03.
[2025-10-24T20:26:02.547632] [INFO ] [LOCAL     ] OR: Starting deletion of derivative data.
[2025-10-24T20:26:02.573391] [DEBUG] [LOCAL     ] OR: Deleted derivative data file.
[2025-10-24T20:26:02.574061] [INFO ] [MAIN      ] Update Progress: 1602/2366 symbols completed. OR took 31.3s. Estimated remaining: 1h 38m 14s. Rate: 7.8 symbols/min
[2025-10-24T20:26:02.664212] [INFO ] [REMOTE    ] ORCL: Incremental fetch complete for 2025-08 (3.32 seconds).
[2025-10-24T20:26:02.771351] [INFO ] [MAIN      ] ORN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:26:02.801369] [DEBUG] [LOCAL     ] ORN: Loaded 30896 existing records from primary storage.
[2025-10-24T20:26:02.801618] [INFO ] [MAIN      ] ORN: Loaded 30896 existing records.
[2025-10-24T20:26:02.979379] [WARN ] [MAIN      ] ORN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:26:02.979598] [INFO ] [MAIN      ] ORN: Wiping existing primary data before full refresh.
[2025-10-24T20:26:02.979663] [INFO ] [LOCAL     ] ORN: Starting deletion of primary data.
[2025-10-24T20:26:02.979968] [DEBUG] [LOCAL     ] ORN: Deleted primary data file.
[2025-10-24T20:26:02.980024] [INFO ] [MAIN      ] ORN: Starting full primary refresh.
[2025-10-24T20:26:03.328108] [INFO ] [REMOTE    ] ORN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:26:03.347599] [INFO ] [REMOTE    ] ORN: Fetching primary data for 2025-01.
[2025-10-24T20:26:03.807958] [INFO ] [REMOTE    ] ORC: Incremental fetch complete for 2025-10 (2.06 seconds).
[2025-10-24T20:26:03.817633] [INFO ] [REMOTE    ] ORC: Full fetch complete (75634 records).
[2025-10-24T20:26:03.817958] [DEBUG] [VALIDATOR ] ORC: Validating primary data.
[2025-10-24T20:26:04.157413] [INFO ] [REMOTE    ] ORCL: Fetching primary data for 2025-09.
[2025-10-24T20:26:04.220661] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present.
[2025-10-24T20:26:04.221076] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed.
[2025-10-24T20:26:04.222240] [INFO ] [MAIN      ] ORC: Fetched primary data is valid.
[2025-10-24T20:26:04.222324] [DEBUG] [LOCAL     ] ORC: Saving primary data.
[2025-10-24T20:26:04.223175] [FATAL] [LOCAL     ] ORC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:26:04.223288] [FATAL] [MAIN      ] ORC: Failed to save primary data.
[2025-10-24T20:26:04.223330] [WARN ] [MAIN      ] ORC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:26:04.223391] [INFO ] [LOCAL     ] ORC: Starting deletion of primary data.
[2025-10-24T20:26:04.223462] [DEBUG] [LOCAL     ] ORC: No primary data file found to delete.
[2025-10-24T20:26:04.223517] [INFO ] [LOCAL     ] ORC: Starting deletion of derivative data.
[2025-10-24T20:26:04.224089] [DEBUG] [LOCAL     ] ORC: Deleted derivative data file.
[2025-10-24T20:26:04.224949] [INFO ] [MAIN      ] Update Progress: 1603/2366 symbols completed. ORC took 33.0s. Estimated remaining: 1h 38m 4s. Rate: 7.8 symbols/min
[2025-10-24T20:26:04.413770] [INFO ] [MAIN      ] OSCR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:26:04.427606] [INFO ] [REMOTE    ] ORI: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T20:26:04.457257] [INFO ] [REMOTE    ] ORN: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T20:26:04.508347] [DEBUG] [LOCAL     ] OSCR: Loaded 54159 existing records from primary storage.
[2025-10-24T20:26:04.508637] [INFO ] [MAIN      ] OSCR: Loaded 54159 existing records.
[2025-10-24T20:26:04.684635] [WARN ] [MAIN      ] OSCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:26:04.684841] [INFO ] [MAIN      ] OSCR: Wiping existing primary data before full refresh.
[2025-10-24T20:26:04.684887] [INFO ] [LOCAL     ] OSCR: Starting deletion of primary data.
[2025-10-24T20:26:04.685306] [DEBUG] [LOCAL     ] OSCR: Deleted primary data file.
[2025-10-24T20:26:04.685363] [INFO ] [MAIN      ] OSCR: Starting full primary refresh.
[2025-10-24T20:26:04.957043] [INFO ] [REMOTE    ] ORI: Fetching primary data for 2025-04.
[2025-10-24T20:26:05.041273] [INFO ] [REMOTE    ] OSCR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:26:05.747721] [INFO ] [REMOTE    ] ORN: Fetching primary data for 2025-02.
[2025-10-24T20:26:06.547730] [INFO ] [REMOTE    ] OSCR: Fetching primary data for 2025-01.
[2025-10-24T20:26:06.783268] [INFO ] [REMOTE    ] ORCL: Incremental fetch complete for 2025-09 (2.63 seconds).
[2025-10-24T20:26:06.956596] [INFO ] [REMOTE    ] ORI: Incremental fetch complete for 2025-04 (2.00 seconds).
[2025-10-24T20:26:07.185347] [INFO ] [REMOTE    ] ORN: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T20:26:07.347604] [INFO ] [REMOTE    ] ORN: Fetching primary data for 2025-03.
[2025-10-24T20:26:08.147731] [INFO ] [REMOTE    ] ORI: Fetching primary data for 2025-05.
[2025-10-24T20:26:08.186777] [INFO ] [REMOTE    ] OSCR: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T20:26:08.680047] [INFO ] [REMOTE    ] ORN: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T20:26:08.947715] [INFO ] [REMOTE    ] ORCL: Fetching primary data for 2025-10.
[2025-10-24T20:26:09.747694] [INFO ] [REMOTE    ] ORN: Fetching primary data for 2025-04.
[2025-10-24T20:26:09.892978] [INFO ] [REMOTE    ] ORCL: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T20:26:09.903333] [INFO ] [REMOTE    ] ORCL: Full fetch complete (77213 records).
[2025-10-24T20:26:09.903473] [DEBUG] [VALIDATOR ] ORCL: Validating primary data.
[2025-10-24T20:26:09.904383] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:26:09.904475] [FATAL] [MAIN      ] ORCL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:26:09.904520] [WARN ] [MAIN      ] ORCL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:26:09.904560] [INFO ] [LOCAL     ] ORCL: Starting deletion of primary data.
[2025-10-24T20:26:09.904619] [DEBUG] [LOCAL     ] ORCL: No primary data file found to delete.
[2025-10-24T20:26:09.904709] [INFO ] [LOCAL     ] ORCL: Starting deletion of derivative data.
[2025-10-24T20:26:09.904780] [DEBUG] [LOCAL     ] ORCL: No derivative data file found to delete.
[2025-10-24T20:26:09.905243] [INFO ] [MAIN      ] Update Progress: 1604/2366 symbols completed. ORCL took 38.7s. Estimated remaining: 1h 37m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:26:10.088917] [INFO ] [MAIN      ] OSK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:26:10.089193] [DEBUG] [LOCAL     ] OSK: No existing data file found in primary storage.
[2025-10-24T20:26:10.089286] [WARN ] [MAIN      ] OSK: No existing data found, performing full refresh instead.
[2025-10-24T20:26:10.089506] [INFO ] [MAIN      ] OSK: Wiping existing primary data before full refresh.
[2025-10-24T20:26:10.089666] [INFO ] [LOCAL     ] OSK: Starting deletion of primary data.
[2025-10-24T20:26:10.089798] [DEBUG] [LOCAL     ] OSK: No primary data file found to delete.
[2025-10-24T20:26:10.089919] [INFO ] [MAIN      ] OSK: Starting full primary refresh.
[2025-10-24T20:26:10.276754] [INFO ] [REMOTE    ] ORI: Incremental fetch complete for 2025-05 (2.13 seconds).
[2025-10-24T20:26:10.486043] [INFO ] [REMOTE    ] OSK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:26:10.547611] [INFO ] [REMOTE    ] OSK: Fetching primary data for 2025-01.
[2025-10-24T20:26:11.068821] [INFO ] [REMOTE    ] ORN: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T20:26:11.347638] [INFO ] [REMOTE    ] ORI: Fetching primary data for 2025-06.
[2025-10-24T20:26:12.147738] [INFO ] [REMOTE    ] OSCR: Fetching primary data for 2025-02.
[2025-10-24T20:26:12.251321] [INFO ] [REMOTE    ] OSK: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T20:26:12.947638] [INFO ] [REMOTE    ] ORN: Fetching primary data for 2025-05.
[2025-10-24T20:26:13.077518] [INFO ] [REMOTE    ] ORI: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T20:26:13.747623] [INFO ] [REMOTE    ] ORI: Fetching primary data for 2025-07.
[2025-10-24T20:26:14.083166] [INFO ] [REMOTE    ] ORN: Incremental fetch complete for 2025-05 (1.14 seconds).
[2025-10-24T20:26:14.343928] [INFO ] [REMOTE    ] OSCR: Incremental fetch complete for 2025-02 (2.20 seconds).
[2025-10-24T20:26:14.547621] [INFO ] [REMOTE    ] OSK: Fetching primary data for 2025-02.
[2025-10-24T20:26:15.347616] [INFO ] [REMOTE    ] ORN: Fetching primary data for 2025-06.
[2025-10-24T20:26:15.439268] [INFO ] [REMOTE    ] ORI: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T20:26:16.145403] [INFO ] [REMOTE    ] OSK: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T20:26:16.152997] [INFO ] [REMOTE    ] ORI: Fetching primary data for 2025-08.
[2025-10-24T20:26:16.317432] [INFO ] [REMOTE    ] ORN: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T20:26:16.947746] [INFO ] [REMOTE    ] OSCR: Fetching primary data for 2025-03.
[2025-10-24T20:26:17.747718] [INFO ] [REMOTE    ] ORN: Fetching primary data for 2025-07.
[2025-10-24T20:26:17.995340] [INFO ] [REMOTE    ] ORI: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T20:26:18.547729] [INFO ] [REMOTE    ] ORI: Fetching primary data for 2025-09.
[2025-10-24T20:26:19.110254] [INFO ] [REMOTE    ] OSCR: Incremental fetch complete for 2025-03 (2.16 seconds).
[2025-10-24T20:26:19.196060] [INFO ] [REMOTE    ] ORN: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T20:26:19.347678] [INFO ] [REMOTE    ] ORN: Fetching primary data for 2025-08.
[2025-10-24T20:26:20.007924] [INFO ] [REMOTE    ] ORI: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T20:26:20.147666] [INFO ] [REMOTE    ] OSCR: Fetching primary data for 2025-04.
[2025-10-24T20:26:20.754412] [INFO ] [REMOTE    ] ORN: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T20:26:20.947699] [INFO ] [REMOTE    ] OSK: Fetching primary data for 2025-03.
[2025-10-24T20:26:21.747686] [INFO ] [REMOTE    ] ORN: Fetching primary data for 2025-09.
[2025-10-24T20:26:22.092639] [INFO ] [REMOTE    ] OSCR: Incremental fetch complete for 2025-04 (1.94 seconds).
[2025-10-24T20:26:22.547636] [INFO ] [REMOTE    ] OSCR: Fetching primary data for 2025-05.
[2025-10-24T20:26:22.654771] [INFO ] [REMOTE    ] OSK: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T20:26:22.714260] [INFO ] [REMOTE    ] ORN: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T20:26:23.347639] [INFO ] [REMOTE    ] ORN: Fetching primary data for 2025-10.
[2025-10-24T20:26:24.147709] [INFO ] [REMOTE    ] ORI: Fetching primary data for 2025-10.
[2025-10-24T20:26:24.628535] [INFO ] [REMOTE    ] OSCR: Incremental fetch complete for 2025-05 (2.08 seconds).
[2025-10-24T20:26:24.653270] [INFO ] [REMOTE    ] ORN: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T20:26:24.658761] [INFO ] [REMOTE    ] ORN: Full fetch complete (45585 records).
[2025-10-24T20:26:24.658859] [DEBUG] [VALIDATOR ] ORN: Validating primary data.
[2025-10-24T20:26:24.967060] [INFO ] [REMOTE    ] OSK: Fetching primary data for 2025-04.
[2025-10-24T20:26:25.053019] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present.
[2025-10-24T20:26:25.053099] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed.
[2025-10-24T20:26:25.053999] [INFO ] [MAIN      ] ORN: Fetched primary data is valid.
[2025-10-24T20:26:25.054061] [DEBUG] [LOCAL     ] ORN: Saving primary data.
[2025-10-24T20:26:25.054491] [FATAL] [LOCAL     ] ORN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:26:25.054577] [FATAL] [MAIN      ] ORN: Failed to save primary data.
[2025-10-24T20:26:25.054626] [WARN ] [MAIN      ] ORN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:26:25.054739] [INFO ] [LOCAL     ] ORN: Starting deletion of primary data.
[2025-10-24T20:26:25.054812] [DEBUG] [LOCAL     ] ORN: No primary data file found to delete.
[2025-10-24T20:26:25.054861] [INFO ] [LOCAL     ] ORN: Starting deletion of derivative data.
[2025-10-24T20:26:25.055068] [DEBUG] [LOCAL     ] ORN: Deleted derivative data file.
[2025-10-24T20:26:25.055180] [INFO ] [MAIN      ] Update Progress: 1605/2366 symbols completed. ORN took 22.5s. Estimated remaining: 1h 37m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:26:25.245027] [INFO ] [MAIN      ] OTF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:26:25.245204] [DEBUG] [LOCAL     ] OTF: No existing data file found in primary storage.
[2025-10-24T20:26:25.245261] [WARN ] [MAIN      ] OTF: No existing data found, performing full refresh instead.
[2025-10-24T20:26:25.245382] [INFO ] [MAIN      ] OTF: Wiping existing primary data before full refresh.
[2025-10-24T20:26:25.245447] [INFO ] [LOCAL     ] OTF: Starting deletion of primary data.
[2025-10-24T20:26:25.245506] [DEBUG] [LOCAL     ] OTF: No primary data file found to delete.
[2025-10-24T20:26:25.245549] [INFO ] [MAIN      ] OTF: Starting full primary refresh.
[2025-10-24T20:26:25.599080] [INFO ] [REMOTE    ] OTF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:26:25.747609] [INFO ] [REMOTE    ] OTF: Fetching primary data for 2025-01.
[2025-10-24T20:26:25.968500] [INFO ] [REMOTE    ] ORI: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T20:26:25.977595] [INFO ] [REMOTE    ] ORI: Full fetch complete (70522 records).
[2025-10-24T20:26:25.977746] [DEBUG] [VALIDATOR ] ORI: Validating primary data.
[2025-10-24T20:26:26.130386] [DEBUG] [REMOTE    ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:26:26.139707] [WARN ] [REMOTE    ] OTF: No data returned for month 2025-01
[2025-10-24T20:26:26.154605] [FATAL] [REMOTE    ] OTF: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:26:26.154721] [FATAL] [MAIN      ] OTF: Failed to fetch primary data.
[2025-10-24T20:26:26.159876] [WARN ] [MAIN      ] OTF: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:26:26.176340] [INFO ] [LOCAL     ] OTF: Starting deletion of primary data.
[2025-10-24T20:26:26.176273] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T20:26:26.176498] [DEBUG] [LOCAL     ] OTF: No primary data file found to delete.
[2025-10-24T20:26:26.177221] [INFO ] [LOCAL     ] OTF: Starting deletion of derivative data.
[2025-10-24T20:26:26.177342] [DEBUG] [LOCAL     ] OTF: No derivative data file found to delete.
[2025-10-24T20:26:26.177405] [INFO ] [MAIN      ] Update Progress: 1606/2366 symbols completed. OTF took 1.1s. Estimated remaining: 1h 37m 40s. Rate: 7.8 symbols/min
[2025-10-24T20:26:26.177138] [FATAL] [MAIN      ] ORI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:26:26.183689] [WARN ] [MAIN      ] ORI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:26:26.241795] [INFO ] [LOCAL     ] ORI: Starting deletion of primary data.
[2025-10-24T20:26:26.280356] [DEBUG] [LOCAL     ] ORI: No primary data file found to delete.
[2025-10-24T20:26:26.283089] [INFO ] [LOCAL     ] ORI: Starting deletion of derivative data.
[2025-10-24T20:26:26.283237] [DEBUG] [LOCAL     ] ORI: No derivative data file found to delete.
[2025-10-24T20:26:26.283807] [INFO ] [MAIN      ] Update Progress: 1607/2366 symbols completed. ORI took 28.9s. Estimated remaining: 1h 37m 29s. Rate: 7.8 symbols/min
[2025-10-24T20:26:26.508240] [INFO ] [MAIN      ] OTIS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:26:26.543162] [INFO ] [MAIN      ] OUT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:26:26.547628] [INFO ] [REMOTE    ] OSCR: Fetching primary data for 2025-06.
[2025-10-24T20:26:26.605684] [DEBUG] [LOCAL     ] OTIS: Loaded 53082 existing records from primary storage.
[2025-10-24T20:26:26.607159] [INFO ] [MAIN      ] OTIS: Loaded 53082 existing records.
[2025-10-24T20:26:26.719899] [DEBUG] [LOCAL     ] OUT: Loaded 48059 existing records from primary storage.
[2025-10-24T20:26:26.732017] [INFO ] [MAIN      ] OUT: Loaded 48059 existing records.
[2025-10-24T20:26:26.858336] [WARN ] [MAIN      ] OTIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:26:26.871733] [INFO ] [MAIN      ] OTIS: Wiping existing primary data before full refresh.
[2025-10-24T20:26:26.880500] [INFO ] [LOCAL     ] OTIS: Starting deletion of primary data.
[2025-10-24T20:26:26.892582] [DEBUG] [LOCAL     ] OTIS: Deleted primary data file.
[2025-10-24T20:26:26.902965] [INFO ] [MAIN      ] OTIS: Starting full primary refresh.
[2025-10-24T20:26:27.101546] [WARN ] [MAIN      ] OUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:26:27.113536] [INFO ] [MAIN      ] OUT: Wiping existing primary data before full refresh.
[2025-10-24T20:26:27.119114] [INFO ] [LOCAL     ] OUT: Starting deletion of primary data.
[2025-10-24T20:26:27.129481] [DEBUG] [LOCAL     ] OUT: Deleted primary data file.
[2025-10-24T20:26:27.134820] [INFO ] [MAIN      ] OUT: Starting full primary refresh.
[2025-10-24T20:26:27.421044] [INFO ] [REMOTE    ] OSK: Incremental fetch complete for 2025-04 (2.45 seconds).
[2025-10-24T20:26:27.511512] [INFO ] [REMOTE    ] OSK: Fetching primary data for 2025-05.
[2025-10-24T20:26:27.664572] [INFO ] [REMOTE    ] OTIS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:26:27.768952] [INFO ] [REMOTE    ] OUT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:26:28.147737] [INFO ] [REMOTE    ] OUT: Fetching primary data for 2025-01.
[2025-10-24T20:26:28.815711] [INFO ] [REMOTE    ] OSCR: Incremental fetch complete for 2025-06 (2.27 seconds).
[2025-10-24T20:26:28.947603] [INFO ] [REMOTE    ] OSCR: Fetching primary data for 2025-07.
[2025-10-24T20:26:29.391184] [INFO ] [REMOTE    ] OSK: Incremental fetch complete for 2025-05 (1.88 seconds).
[2025-10-24T20:26:29.592050] [INFO ] [REMOTE    ] OUT: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T20:26:29.747674] [INFO ] [REMOTE    ] OUT: Fetching primary data for 2025-02.
[2025-10-24T20:26:30.547686] [INFO ] [REMOTE    ] OTIS: Fetching primary data for 2025-01.
[2025-10-24T20:26:31.347634] [INFO ] [REMOTE    ] OSK: Fetching primary data for 2025-06.
[2025-10-24T20:26:31.515126] [INFO ] [REMOTE    ] OUT: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T20:26:31.628831] [INFO ] [REMOTE    ] OSCR: Incremental fetch complete for 2025-07 (2.68 seconds).
[2025-10-24T20:26:32.147622] [INFO ] [REMOTE    ] OUT: Fetching primary data for 2025-03.
[2025-10-24T20:26:32.247504] [INFO ] [REMOTE    ] OTIS: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T20:26:32.748895] [INFO ] [REMOTE    ] OSK: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T20:26:32.947697] [INFO ] [REMOTE    ] OSK: Fetching primary data for 2025-07.
[2025-10-24T20:26:33.747697] [INFO ] [REMOTE    ] OTIS: Fetching primary data for 2025-02.
[2025-10-24T20:26:34.013507] [INFO ] [REMOTE    ] OUT: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T20:26:34.547626] [INFO ] [REMOTE    ] OUT: Fetching primary data for 2025-04.
[2025-10-24T20:26:34.657165] [INFO ] [REMOTE    ] OSK: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T20:26:35.347699] [INFO ] [REMOTE    ] OSK: Fetching primary data for 2025-08.
[2025-10-24T20:26:35.449599] [INFO ] [REMOTE    ] OTIS: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T20:26:36.147710] [INFO ] [REMOTE    ] OTIS: Fetching primary data for 2025-03.
[2025-10-24T20:26:36.596909] [INFO ] [REMOTE    ] OUT: Incremental fetch complete for 2025-04 (2.05 seconds).
[2025-10-24T20:26:36.886809] [INFO ] [REMOTE    ] OSK: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T20:26:36.947627] [INFO ] [REMOTE    ] OSK: Fetching primary data for 2025-09.
[2025-10-24T20:26:37.747629] [INFO ] [REMOTE    ] OSCR: Fetching primary data for 2025-08.
[2025-10-24T20:26:38.172785] [INFO ] [REMOTE    ] OTIS: Incremental fetch complete for 2025-03 (2.03 seconds).
[2025-10-24T20:26:38.547700] [INFO ] [REMOTE    ] OTIS: Fetching primary data for 2025-04.
[2025-10-24T20:26:38.758591] [INFO ] [REMOTE    ] OSK: Incremental fetch complete for 2025-09 (1.81 seconds).
[2025-10-24T20:26:39.347730] [INFO ] [REMOTE    ] OSK: Fetching primary data for 2025-10.
[2025-10-24T20:26:39.899842] [INFO ] [REMOTE    ] OSCR: Incremental fetch complete for 2025-08 (2.15 seconds).
[2025-10-24T20:26:40.147684] [INFO ] [REMOTE    ] OSCR: Fetching primary data for 2025-09.
[2025-10-24T20:26:40.541956] [INFO ] [REMOTE    ] OTIS: Incremental fetch complete for 2025-04 (1.99 seconds).
[2025-10-24T20:26:40.610987] [INFO ] [REMOTE    ] OSK: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T20:26:40.619058] [INFO ] [REMOTE    ] OSK: Full fetch complete (61369 records).
[2025-10-24T20:26:40.619212] [DEBUG] [VALIDATOR ] OSK: Validating primary data.
[2025-10-24T20:26:40.815946] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T20:26:40.816687] [FATAL] [MAIN      ] OSK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:26:40.816760] [WARN ] [MAIN      ] OSK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:26:40.816817] [INFO ] [LOCAL     ] OSK: Starting deletion of primary data.
[2025-10-24T20:26:40.816874] [DEBUG] [LOCAL     ] OSK: No primary data file found to delete.
[2025-10-24T20:26:40.816934] [INFO ] [LOCAL     ] OSK: Starting deletion of derivative data.
[2025-10-24T20:26:40.816991] [DEBUG] [LOCAL     ] OSK: No derivative data file found to delete.
[2025-10-24T20:26:40.817235] [INFO ] [MAIN      ] Update Progress: 1608/2366 symbols completed. OSK took 30.9s. Estimated remaining: 1h 37m 24s. Rate: 7.8 symbols/min
[2025-10-24T20:26:40.957568] [INFO ] [REMOTE    ] OTIS: Fetching primary data for 2025-05.
[2025-10-24T20:26:40.989127] [INFO ] [MAIN      ] OVV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:26:41.041313] [DEBUG] [LOCAL     ] OVV: Loaded 53884 existing records from primary storage.
[2025-10-24T20:26:41.041690] [INFO ] [MAIN      ] OVV: Loaded 53884 existing records.
[2025-10-24T20:26:41.216698] [WARN ] [MAIN      ] OVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:26:41.216899] [INFO ] [MAIN      ] OVV: Wiping existing primary data before full refresh.
[2025-10-24T20:26:41.216944] [INFO ] [LOCAL     ] OVV: Starting deletion of primary data.
[2025-10-24T20:26:41.217448] [DEBUG] [LOCAL     ] OVV: Deleted primary data file.
[2025-10-24T20:26:41.217504] [INFO ] [MAIN      ] OVV: Starting full primary refresh.
[2025-10-24T20:26:41.567211] [INFO ] [REMOTE    ] OVV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:26:41.747663] [INFO ] [REMOTE    ] OUT: Fetching primary data for 2025-05.
[2025-10-24T20:26:42.547718] [INFO ] [REMOTE    ] OVV: Fetching primary data for 2025-01.
[2025-10-24T20:26:42.771559] [INFO ] [REMOTE    ] OTIS: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T20:26:42.816267] [INFO ] [REMOTE    ] OSCR: Incremental fetch complete for 2025-09 (2.67 seconds).
[2025-10-24T20:26:43.353777] [INFO ] [REMOTE    ] OTIS: Fetching primary data for 2025-06.
[2025-10-24T20:26:43.359292] [INFO ] [REMOTE    ] OUT: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T20:26:44.147679] [INFO ] [REMOTE    ] OSCR: Fetching primary data for 2025-10.
[2025-10-24T20:26:44.177087] [INFO ] [REMOTE    ] OVV: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T20:26:44.947723] [INFO ] [REMOTE    ] OVV: Fetching primary data for 2025-02.
[2025-10-24T20:26:45.134569] [INFO ] [REMOTE    ] OTIS: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T20:26:45.747709] [INFO ] [REMOTE    ] OTIS: Fetching primary data for 2025-07.
[2025-10-24T20:26:46.552190] [INFO ] [REMOTE    ] OUT: Fetching primary data for 2025-06.
[2025-10-24T20:26:46.569964] [INFO ] [REMOTE    ] OSCR: Incremental fetch complete for 2025-10 (2.42 seconds).
[2025-10-24T20:26:46.581922] [INFO ] [REMOTE    ] OSCR: Full fetch complete (77765 records).
[2025-10-24T20:26:46.582085] [DEBUG] [VALIDATOR ] OSCR: Validating primary data.
[2025-10-24T20:26:47.018992] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present.
[2025-10-24T20:26:47.019254] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed.
[2025-10-24T20:26:47.021868] [INFO ] [MAIN      ] OSCR: Fetched primary data is valid.
[2025-10-24T20:26:47.021963] [DEBUG] [LOCAL     ] OSCR: Saving primary data.
[2025-10-24T20:26:47.036129] [FATAL] [LOCAL     ] OSCR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:26:47.052414] [FATAL] [MAIN      ] OSCR: Failed to save primary data.
[2025-10-24T20:26:47.055577] [WARN ] [MAIN      ] OSCR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:26:47.055799] [INFO ] [LOCAL     ] OSCR: Starting deletion of primary data.
[2025-10-24T20:26:47.055909] [DEBUG] [LOCAL     ] OSCR: No primary data file found to delete.
[2025-10-24T20:26:47.055961] [INFO ] [LOCAL     ] OSCR: Starting deletion of derivative data.
[2025-10-24T20:26:47.056428] [DEBUG] [LOCAL     ] OSCR: Deleted derivative data file.
[2025-10-24T20:26:47.057363] [INFO ] [MAIN      ] Update Progress: 1609/2366 symbols completed. OSCR took 42.8s. Estimated remaining: 1h 37m 16s. Rate: 7.8 symbols/min
[2025-10-24T20:26:47.058895] [INFO ] [REMOTE    ] OVV: Incremental fetch complete for 2025-02 (2.11 seconds).
[2025-10-24T20:26:47.253340] [INFO ] [MAIN      ] OWL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:26:47.317299] [DEBUG] [LOCAL     ] OWL: Loaded 53950 existing records from primary storage.
[2025-10-24T20:26:47.317844] [INFO ] [MAIN      ] OWL: Loaded 53950 existing records.
[2025-10-24T20:26:47.352799] [INFO ] [REMOTE    ] OVV: Fetching primary data for 2025-03.
[2025-10-24T20:26:47.524110] [WARN ] [MAIN      ] OWL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:26:47.524700] [INFO ] [MAIN      ] OWL: Wiping existing primary data before full refresh.
[2025-10-24T20:26:47.524845] [INFO ] [LOCAL     ] OWL: Starting deletion of primary data.
[2025-10-24T20:26:47.525480] [DEBUG] [LOCAL     ] OWL: Deleted primary data file.
[2025-10-24T20:26:47.525544] [INFO ] [MAIN      ] OWL: Starting full primary refresh.
[2025-10-24T20:26:48.002548] [INFO ] [REMOTE    ] OWL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:26:48.008469] [INFO ] [REMOTE    ] OTIS: Incremental fetch complete for 2025-07 (2.26 seconds).
[2025-10-24T20:26:48.047330] [INFO ] [REMOTE    ] OUT: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T20:26:48.147601] [INFO ] [REMOTE    ] OUT: Fetching primary data for 2025-07.
[2025-10-24T20:26:48.947773] [INFO ] [REMOTE    ] OWL: Fetching primary data for 2025-01.
[2025-10-24T20:26:49.479948] [INFO ] [REMOTE    ] OVV: Incremental fetch complete for 2025-03 (2.13 seconds).
[2025-10-24T20:26:49.747623] [INFO ] [REMOTE    ] OVV: Fetching primary data for 2025-04.
[2025-10-24T20:26:50.167259] [INFO ] [REMOTE    ] OUT: Incremental fetch complete for 2025-07 (2.02 seconds).
[2025-10-24T20:26:50.547626] [INFO ] [REMOTE    ] OTIS: Fetching primary data for 2025-08.
[2025-10-24T20:26:50.653443] [DEBUG] [REMOTE    ] OTIS: Error fetching primary data for 2025-08: 'API call returned an empty response.'
[2025-10-24T20:26:50.653913] [WARN ] [REMOTE    ] OTIS: No data returned for month 2025-08
[2025-10-24T20:26:50.654034] [FATAL] [REMOTE    ] OTIS: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:26:50.654258] [FATAL] [MAIN      ] OTIS: Failed to fetch primary data.
[2025-10-24T20:26:50.654363] [WARN ] [MAIN      ] OTIS: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:26:50.654489] [INFO ] [LOCAL     ] OTIS: Starting deletion of primary data.
[2025-10-24T20:26:50.654573] [DEBUG] [LOCAL     ] OTIS: No primary data file found to delete.
[2025-10-24T20:26:50.654613] [INFO ] [LOCAL     ] OTIS: Starting deletion of derivative data.
[2025-10-24T20:26:50.654824] [DEBUG] [LOCAL     ] OTIS: Deleted derivative data file.
[2025-10-24T20:26:50.655309] [INFO ] [MAIN      ] Update Progress: 1610/2366 symbols completed. OTIS took 24.5s. Estimated remaining: 1h 37m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:26:50.886444] [INFO ] [MAIN      ] OWLT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:26:50.888764] [INFO ] [REMOTE    ] OWL: Incremental fetch complete for 2025-01 (1.94 seconds).
[2025-10-24T20:26:50.911002] [DEBUG] [LOCAL     ] OWLT: Loaded 9966 existing records from primary storage.
[2025-10-24T20:26:50.911248] [INFO ] [MAIN      ] OWLT: Loaded 9966 existing records.
[2025-10-24T20:26:51.123040] [WARN ] [MAIN      ] OWLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:26:51.123247] [INFO ] [MAIN      ] OWLT: Wiping existing primary data before full refresh.
[2025-10-24T20:26:51.123294] [INFO ] [LOCAL     ] OWLT: Starting deletion of primary data.
[2025-10-24T20:26:51.123459] [DEBUG] [LOCAL     ] OWLT: Deleted primary data file.
[2025-10-24T20:26:51.123497] [INFO ] [MAIN      ] OWLT: Starting full primary refresh.
[2025-10-24T20:26:51.349012] [INFO ] [REMOTE    ] OUT: Fetching primary data for 2025-08.
[2025-10-24T20:26:51.487248] [INFO ] [REMOTE    ] OWLT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:26:51.619928] [INFO ] [REMOTE    ] OVV: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T20:26:52.147681] [INFO ] [REMOTE    ] OVV: Fetching primary data for 2025-05.
[2025-10-24T20:26:52.724174] [INFO ] [REMOTE    ] OUT: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T20:26:52.947676] [INFO ] [REMOTE    ] OUT: Fetching primary data for 2025-09.
[2025-10-24T20:26:53.756965] [INFO ] [REMOTE    ] OWLT: Fetching primary data for 2025-01.
[2025-10-24T20:26:53.762951] [INFO ] [REMOTE    ] OVV: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T20:26:54.496000] [INFO ] [REMOTE    ] OUT: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T20:26:54.526396] [INFO ] [REMOTE    ] OWLT: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T20:26:54.547603] [INFO ] [REMOTE    ] OWLT: Fetching primary data for 2025-02.
[2025-10-24T20:26:55.269971] [INFO ] [REMOTE    ] OWLT: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:26:55.347624] [INFO ] [REMOTE    ] OWL: Fetching primary data for 2025-02.
[2025-10-24T20:26:56.147737] [INFO ] [REMOTE    ] OUT: Fetching primary data for 2025-10.
[2025-10-24T20:26:56.947685] [INFO ] [REMOTE    ] OWLT: Fetching primary data for 2025-03.
[2025-10-24T20:26:57.200955] [INFO ] [REMOTE    ] OWL: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T20:26:57.747619] [INFO ] [REMOTE    ] OWL: Fetching primary data for 2025-03.
[2025-10-24T20:26:57.826557] [INFO ] [REMOTE    ] OWLT: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T20:26:57.883418] [INFO ] [REMOTE    ] OUT: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T20:26:57.892280] [INFO ] [REMOTE    ] OUT: Full fetch complete (69185 records).
[2025-10-24T20:26:57.892396] [DEBUG] [VALIDATOR ] OUT: Validating primary data.
[2025-10-24T20:26:58.301599] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present.
[2025-10-24T20:26:58.301740] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed.
[2025-10-24T20:26:58.302829] [INFO ] [MAIN      ] OUT: Fetched primary data is valid.
[2025-10-24T20:26:58.302889] [DEBUG] [LOCAL     ] OUT: Saving primary data.
[2025-10-24T20:26:58.303506] [FATAL] [LOCAL     ] OUT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:26:58.303596] [FATAL] [MAIN      ] OUT: Failed to save primary data.
[2025-10-24T20:26:58.303637] [WARN ] [MAIN      ] OUT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:26:58.303715] [INFO ] [LOCAL     ] OUT: Starting deletion of primary data.
[2025-10-24T20:26:58.303770] [DEBUG] [LOCAL     ] OUT: No primary data file found to delete.
[2025-10-24T20:26:58.303805] [INFO ] [LOCAL     ] OUT: Starting deletion of derivative data.
[2025-10-24T20:26:58.303975] [DEBUG] [LOCAL     ] OUT: Deleted derivative data file.
[2025-10-24T20:26:58.304581] [INFO ] [MAIN      ] Update Progress: 1611/2366 symbols completed. OUT took 32.0s. Estimated remaining: 1h 36m 59s. Rate: 7.8 symbols/min
[2025-10-24T20:26:58.470348] [INFO ] [MAIN      ] OXM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:26:58.502198] [DEBUG] [LOCAL     ] OXM: Loaded 33367 existing records from primary storage.
[2025-10-24T20:26:58.502457] [INFO ] [MAIN      ] OXM: Loaded 33367 existing records.
[2025-10-24T20:26:58.557011] [INFO ] [REMOTE    ] OVV: Fetching primary data for 2025-06.
[2025-10-24T20:26:58.684893] [WARN ] [MAIN      ] OXM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:26:58.685153] [INFO ] [MAIN      ] OXM: Wiping existing primary data before full refresh.
[2025-10-24T20:26:58.685210] [INFO ] [LOCAL     ] OXM: Starting deletion of primary data.
[2025-10-24T20:26:58.685602] [DEBUG] [LOCAL     ] OXM: Deleted primary data file.
[2025-10-24T20:26:58.685692] [INFO ] [MAIN      ] OXM: Starting full primary refresh.
[2025-10-24T20:26:59.032094] [INFO ] [REMOTE    ] OXM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:26:59.347624] [INFO ] [REMOTE    ] OWLT: Fetching primary data for 2025-04.
[2025-10-24T20:26:59.484998] [INFO ] [REMOTE    ] OWL: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T20:27:00.106955] [INFO ] [REMOTE    ] OWLT: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T20:27:00.147636] [INFO ] [REMOTE    ] OWLT: Fetching primary data for 2025-05.
[2025-10-24T20:27:00.406990] [INFO ] [REMOTE    ] OVV: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T20:27:00.817137] [INFO ] [REMOTE    ] OWLT: Incremental fetch complete for 2025-05 (0.67 seconds).
[2025-10-24T20:27:00.947611] [INFO ] [REMOTE    ] OVV: Fetching primary data for 2025-07.
[2025-10-24T20:27:01.747667] [INFO ] [REMOTE    ] OXM: Fetching primary data for 2025-01.
[2025-10-24T20:27:02.547621] [INFO ] [REMOTE    ] OWLT: Fetching primary data for 2025-06.
[2025-10-24T20:27:02.932432] [INFO ] [REMOTE    ] OVV: Incremental fetch complete for 2025-07 (1.98 seconds).
[2025-10-24T20:27:02.958002] [INFO ] [REMOTE    ] OXM: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T20:27:03.347618] [INFO ] [REMOTE    ] OWL: Fetching primary data for 2025-04.
[2025-10-24T20:27:03.551926] [INFO ] [REMOTE    ] OWLT: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T20:27:04.147671] [INFO ] [REMOTE    ] OXM: Fetching primary data for 2025-02.
[2025-10-24T20:27:04.947617] [INFO ] [REMOTE    ] OVV: Fetching primary data for 2025-08.
[2025-10-24T20:27:05.237800] [INFO ] [REMOTE    ] OWL: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T20:27:05.280930] [INFO ] [REMOTE    ] OXM: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T20:27:05.747638] [INFO ] [REMOTE    ] OWL: Fetching primary data for 2025-05.
[2025-10-24T20:27:06.547765] [INFO ] [REMOTE    ] OWLT: Fetching primary data for 2025-07.
[2025-10-24T20:27:06.672024] [INFO ] [REMOTE    ] OVV: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T20:27:07.150253] [INFO ] [REMOTE    ] OWLT: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T20:27:07.350326] [INFO ] [REMOTE    ] OWLT: Fetching primary data for 2025-08.
[2025-10-24T20:27:07.352943] [INFO ] [REMOTE    ] OWL: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T20:27:08.147706] [INFO ] [REMOTE    ] OXM: Fetching primary data for 2025-03.
[2025-10-24T20:27:08.219083] [INFO ] [REMOTE    ] OWLT: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T20:27:08.947663] [INFO ] [REMOTE    ] OVV: Fetching primary data for 2025-09.
[2025-10-24T20:27:09.683406] [INFO ] [REMOTE    ] OXM: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T20:27:09.747719] [INFO ] [REMOTE    ] OXM: Fetching primary data for 2025-04.
[2025-10-24T20:27:10.391559] [INFO ] [REMOTE    ] OVV: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T20:27:10.547676] [INFO ] [REMOTE    ] OWLT: Fetching primary data for 2025-09.
[2025-10-24T20:27:11.347624] [INFO ] [REMOTE    ] OWL: Fetching primary data for 2025-06.
[2025-10-24T20:27:11.405182] [INFO ] [REMOTE    ] OXM: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T20:27:11.503050] [INFO ] [REMOTE    ] OWLT: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T20:27:12.147673] [INFO ] [REMOTE    ] OVV: Fetching primary data for 2025-10.
[2025-10-24T20:27:12.947723] [INFO ] [REMOTE    ] OWLT: Fetching primary data for 2025-10.
[2025-10-24T20:27:13.277399] [INFO ] [REMOTE    ] OWL: Incremental fetch complete for 2025-06 (1.93 seconds).
[2025-10-24T20:27:13.607338] [INFO ] [REMOTE    ] OWLT: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T20:27:13.610467] [INFO ] [REMOTE    ] OWLT: Full fetch complete (12754 records).
[2025-10-24T20:27:13.610536] [DEBUG] [VALIDATOR ] OWLT: Validating primary data.
[2025-10-24T20:27:13.750282] [INFO ] [REMOTE    ] OXM: Fetching primary data for 2025-05.
[2025-10-24T20:27:13.987145] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present.
[2025-10-24T20:27:13.987240] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed.
[2025-10-24T20:27:13.987617] [INFO ] [MAIN      ] OWLT: Fetched primary data is valid.
[2025-10-24T20:27:13.987711] [DEBUG] [LOCAL     ] OWLT: Saving primary data.
[2025-10-24T20:27:13.988024] [FATAL] [LOCAL     ] OWLT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:27:13.988109] [FATAL] [MAIN      ] OWLT: Failed to save primary data.
[2025-10-24T20:27:13.988152] [WARN ] [MAIN      ] OWLT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:27:13.988215] [INFO ] [LOCAL     ] OWLT: Starting deletion of primary data.
[2025-10-24T20:27:13.988276] [DEBUG] [LOCAL     ] OWLT: No primary data file found to delete.
[2025-10-24T20:27:13.988314] [INFO ] [LOCAL     ] OWLT: Starting deletion of derivative data.
[2025-10-24T20:27:13.988529] [DEBUG] [LOCAL     ] OWLT: Deleted derivative data file.
[2025-10-24T20:27:13.988627] [INFO ] [MAIN      ] Update Progress: 1612/2366 symbols completed. OWLT took 23.3s. Estimated remaining: 1h 36m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:27:14.135414] [INFO ] [REMOTE    ] OVV: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T20:27:14.197019] [INFO ] [REMOTE    ] OVV: Full fetch complete (77519 records).
[2025-10-24T20:27:14.198437] [INFO ] [MAIN      ] OXY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:27:14.198845] [DEBUG] [LOCAL     ] OXY: No existing data file found in primary storage.
[2025-10-24T20:27:14.198638] [DEBUG] [VALIDATOR ] OVV: Validating primary data.
[2025-10-24T20:27:14.199087] [WARN ] [MAIN      ] OXY: No existing data found, performing full refresh instead.
[2025-10-24T20:27:14.199268] [INFO ] [MAIN      ] OXY: Wiping existing primary data before full refresh.
[2025-10-24T20:27:14.199317] [INFO ] [LOCAL     ] OXY: Starting deletion of primary data.
[2025-10-24T20:27:14.199362] [DEBUG] [LOCAL     ] OXY: No primary data file found to delete.
[2025-10-24T20:27:14.199394] [INFO ] [MAIN      ] OXY: Starting full primary refresh.
[2025-10-24T20:27:14.558949] [INFO ] [REMOTE    ] OWL: Fetching primary data for 2025-07.
[2025-10-24T20:27:14.946277] [INFO ] [REMOTE    ] OXY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:27:14.971322] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present.
[2025-10-24T20:27:14.971409] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed.
[2025-10-24T20:27:14.972715] [INFO ] [MAIN      ] OVV: Fetched primary data is valid.
[2025-10-24T20:27:14.972778] [DEBUG] [LOCAL     ] OVV: Saving primary data.
[2025-10-24T20:27:14.973452] [FATAL] [LOCAL     ] OVV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:27:14.973542] [FATAL] [MAIN      ] OVV: Failed to save primary data.
[2025-10-24T20:27:14.973584] [WARN ] [MAIN      ] OVV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:27:14.973694] [INFO ] [LOCAL     ] OVV: Starting deletion of primary data.
[2025-10-24T20:27:14.973770] [DEBUG] [LOCAL     ] OVV: No primary data file found to delete.
[2025-10-24T20:27:14.973808] [INFO ] [LOCAL     ] OVV: Starting deletion of derivative data.
[2025-10-24T20:27:14.973980] [DEBUG] [LOCAL     ] OVV: Deleted derivative data file.
[2025-10-24T20:27:14.974757] [INFO ] [MAIN      ] Update Progress: 1613/2366 symbols completed. OVV took 34.2s. Estimated remaining: 1h 36m 44s. Rate: 7.8 symbols/min
[2025-10-24T20:27:15.145999] [INFO ] [MAIN      ] PAAS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:27:15.197375] [DEBUG] [LOCAL     ] PAAS: Loaded 54015 existing records from primary storage.
[2025-10-24T20:27:15.197729] [INFO ] [MAIN      ] PAAS: Loaded 54015 existing records.
[2025-10-24T20:27:15.347996] [INFO ] [REMOTE    ] OXY: Fetching primary data for 2025-01.
[2025-10-24T20:27:15.407586] [WARN ] [MAIN      ] PAAS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:27:15.424200] [INFO ] [MAIN      ] PAAS: Wiping existing primary data before full refresh.
[2025-10-24T20:27:15.424311] [INFO ] [LOCAL     ] PAAS: Starting deletion of primary data.
[2025-10-24T20:27:15.425571] [DEBUG] [LOCAL     ] PAAS: Deleted primary data file.
[2025-10-24T20:27:15.425511] [INFO ] [REMOTE    ] OXM: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T20:27:15.431976] [INFO ] [MAIN      ] PAAS: Starting full primary refresh.
[2025-10-24T20:27:15.792108] [INFO ] [REMOTE    ] PAAS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:27:16.150060] [INFO ] [REMOTE    ] OXM: Fetching primary data for 2025-06.
[2025-10-24T20:27:16.168018] [INFO ] [REMOTE    ] OWL: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T20:27:16.679309] [INFO ] [REMOTE    ] OXY: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T20:27:16.947610] [INFO ] [REMOTE    ] OWL: Fetching primary data for 2025-08.
[2025-10-24T20:27:17.696676] [INFO ] [REMOTE    ] OXM: Incremental fetch complete for 2025-06 (1.55 seconds).
[2025-10-24T20:27:17.747604] [INFO ] [REMOTE    ] OXM: Fetching primary data for 2025-07.
[2025-10-24T20:27:18.547707] [INFO ] [REMOTE    ] PAAS: Fetching primary data for 2025-01.
[2025-10-24T20:27:18.923808] [INFO ] [REMOTE    ] OWL: Incremental fetch complete for 2025-08 (1.98 seconds).
[2025-10-24T20:27:19.307620] [INFO ] [REMOTE    ] OXM: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T20:27:19.347544] [INFO ] [REMOTE    ] OXM: Fetching primary data for 2025-08.
[2025-10-24T20:27:20.147611] [INFO ] [REMOTE    ] OXY: Fetching primary data for 2025-02.
[2025-10-24T20:27:20.611172] [INFO ] [REMOTE    ] PAAS: Incremental fetch complete for 2025-01 (2.06 seconds).
[2025-10-24T20:27:20.648950] [INFO ] [REMOTE    ] OXM: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T20:27:20.755489] [INFO ] [REMOTE    ] OXY: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T20:27:20.947615] [INFO ] [REMOTE    ] OXY: Fetching primary data for 2025-03.
[2025-10-24T20:27:21.747625] [INFO ] [REMOTE    ] OWL: Fetching primary data for 2025-09.
[2025-10-24T20:27:22.055886] [INFO ] [REMOTE    ] OXY: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T20:27:22.547721] [INFO ] [REMOTE    ] OXY: Fetching primary data for 2025-04.
[2025-10-24T20:27:23.347615] [INFO ] [REMOTE    ] OXM: Fetching primary data for 2025-09.
[2025-10-24T20:27:23.420429] [INFO ] [REMOTE    ] OWL: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T20:27:23.598101] [INFO ] [REMOTE    ] OXY: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T20:27:24.147670] [INFO ] [REMOTE    ] OWL: Fetching primary data for 2025-10.
[2025-10-24T20:27:24.947696] [INFO ] [REMOTE    ] PAAS: Fetching primary data for 2025-02.
[2025-10-24T20:27:24.984789] [INFO ] [REMOTE    ] OXM: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T20:27:25.747719] [INFO ] [REMOTE    ] OXY: Fetching primary data for 2025-05.
[2025-10-24T20:27:26.040937] [INFO ] [REMOTE    ] OWL: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T20:27:26.051740] [INFO ] [REMOTE    ] OWL: Full fetch complete (77712 records).
[2025-10-24T20:27:26.051890] [DEBUG] [VALIDATOR ] OWL: Validating primary data.
[2025-10-24T20:27:26.521944] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present.
[2025-10-24T20:27:26.522068] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed.
[2025-10-24T20:27:26.523574] [INFO ] [MAIN      ] OWL: Fetched primary data is valid.
[2025-10-24T20:27:26.523689] [DEBUG] [LOCAL     ] OWL: Saving primary data.
[2025-10-24T20:27:26.524395] [FATAL] [LOCAL     ] OWL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:27:26.524491] [FATAL] [MAIN      ] OWL: Failed to save primary data.
[2025-10-24T20:27:26.524534] [WARN ] [MAIN      ] OWL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:27:26.524598] [INFO ] [LOCAL     ] OWL: Starting deletion of primary data.
[2025-10-24T20:27:26.524718] [DEBUG] [LOCAL     ] OWL: No primary data file found to delete.
[2025-10-24T20:27:26.524794] [INFO ] [LOCAL     ] OWL: Starting deletion of derivative data.
[2025-10-24T20:27:26.524992] [DEBUG] [LOCAL     ] OWL: Deleted derivative data file.
[2025-10-24T20:27:26.525411] [INFO ] [MAIN      ] Update Progress: 1614/2366 symbols completed. OWL took 39.5s. Estimated remaining: 1h 36m 38s. Rate: 7.8 symbols/min
[2025-10-24T20:27:26.549706] [INFO ] [REMOTE    ] OXM: Fetching primary data for 2025-10.
[2025-10-24T20:27:26.808288] [INFO ] [MAIN      ] PAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:27:26.927797] [INFO ] [REMOTE    ] PAAS: Incremental fetch complete for 2025-02 (1.98 seconds).
[2025-10-24T20:27:26.948594] [DEBUG] [LOCAL     ] PAC: Loaded 11602 existing records from primary storage.
[2025-10-24T20:27:26.951442] [INFO ] [REMOTE    ] OXY: Incremental fetch complete for 2025-05 (1.20 seconds).
[2025-10-24T20:27:26.952036] [INFO ] [MAIN      ] PAC: Loaded 11602 existing records.
[2025-10-24T20:27:27.203790] [WARN ] [MAIN      ] PAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:27:27.204014] [INFO ] [MAIN      ] PAC: Wiping existing primary data before full refresh.
[2025-10-24T20:27:27.204062] [INFO ] [LOCAL     ] PAC: Starting deletion of primary data.
[2025-10-24T20:27:27.204262] [DEBUG] [LOCAL     ] PAC: Deleted primary data file.
[2025-10-24T20:27:27.204318] [INFO ] [MAIN      ] PAC: Starting full primary refresh.
[2025-10-24T20:27:27.349446] [INFO ] [REMOTE    ] OXY: Fetching primary data for 2025-06.
[2025-10-24T20:27:27.557908] [INFO ] [REMOTE    ] PAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:27:27.749320] [INFO ] [REMOTE    ] OXM: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T20:27:27.755515] [INFO ] [REMOTE    ] OXM: Full fetch complete (46543 records).
[2025-10-24T20:27:27.755612] [DEBUG] [VALIDATOR ] OXM: Validating primary data.
[2025-10-24T20:27:28.141625] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present.
[2025-10-24T20:27:28.141733] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed.
[2025-10-24T20:27:28.142584] [INFO ] [MAIN      ] OXM: Fetched primary data is valid.
[2025-10-24T20:27:28.142624] [DEBUG] [LOCAL     ] OXM: Saving primary data.
[2025-10-24T20:27:28.143078] [FATAL] [LOCAL     ] OXM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:27:28.143169] [FATAL] [MAIN      ] OXM: Failed to save primary data.
[2025-10-24T20:27:28.143211] [WARN ] [MAIN      ] OXM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:27:28.143266] [INFO ] [LOCAL     ] OXM: Starting deletion of primary data.
[2025-10-24T20:27:28.143343] [DEBUG] [LOCAL     ] OXM: No primary data file found to delete.
[2025-10-24T20:27:28.143399] [INFO ] [LOCAL     ] OXM: Starting deletion of derivative data.
[2025-10-24T20:27:28.143557] [DEBUG] [LOCAL     ] OXM: Deleted derivative data file.
[2025-10-24T20:27:28.143678] [INFO ] [MAIN      ] Update Progress: 1615/2366 symbols completed. OXM took 29.8s. Estimated remaining: 1h 36m 27s. Rate: 7.8 symbols/min
[2025-10-24T20:27:28.155335] [INFO ] [REMOTE    ] PAAS: Fetching primary data for 2025-03.
[2025-10-24T20:27:28.337943] [INFO ] [MAIN      ] PACK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:27:28.368980] [DEBUG] [LOCAL     ] PACK: Loaded 32108 existing records from primary storage.
[2025-10-24T20:27:28.369248] [INFO ] [MAIN      ] PACK: Loaded 32108 existing records.
[2025-10-24T20:27:28.574004] [WARN ] [MAIN      ] PACK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:27:28.574277] [INFO ] [MAIN      ] PACK: Wiping existing primary data before full refresh.
[2025-10-24T20:27:28.574379] [INFO ] [LOCAL     ] PACK: Starting deletion of primary data.
[2025-10-24T20:27:28.574607] [DEBUG] [LOCAL     ] PACK: Deleted primary data file.
[2025-10-24T20:27:28.574695] [INFO ] [MAIN      ] PACK: Starting full primary refresh.
[2025-10-24T20:27:28.707715] [INFO ] [REMOTE    ] OXY: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T20:27:28.952738] [INFO ] [REMOTE    ] OXY: Fetching primary data for 2025-07.
[2025-10-24T20:27:28.984571] [INFO ] [REMOTE    ] PACK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:27:29.747765] [INFO ] [REMOTE    ] PAC: Fetching primary data for 2025-01.
[2025-10-24T20:27:30.143441] [INFO ] [REMOTE    ] OXY: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T20:27:30.171541] [INFO ] [REMOTE    ] PAAS: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T20:27:30.363976] [INFO ] [REMOTE    ] PAC: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T20:27:30.547695] [INFO ] [REMOTE    ] PAAS: Fetching primary data for 2025-04.
[2025-10-24T20:27:31.347756] [INFO ] [REMOTE    ] OXY: Fetching primary data for 2025-08.
[2025-10-24T20:27:32.147637] [INFO ] [REMOTE    ] PACK: Fetching primary data for 2025-01.
[2025-10-24T20:27:32.401810] [INFO ] [REMOTE    ] OXY: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T20:27:32.522903] [INFO ] [REMOTE    ] PAAS: Incremental fetch complete for 2025-04 (1.98 seconds).
[2025-10-24T20:27:32.947671] [INFO ] [REMOTE    ] OXY: Fetching primary data for 2025-09.
[2025-10-24T20:27:33.485163] [INFO ] [REMOTE    ] PACK: Incremental fetch complete for 2025-01 (1.34 seconds).
[2025-10-24T20:27:33.747674] [INFO ] [REMOTE    ] PAAS: Fetching primary data for 2025-05.
[2025-10-24T20:27:34.049986] [INFO ] [REMOTE    ] OXY: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T20:27:34.547690] [INFO ] [REMOTE    ] PAC: Fetching primary data for 2025-02.
[2025-10-24T20:27:35.347728] [INFO ] [REMOTE    ] PACK: Fetching primary data for 2025-02.
[2025-10-24T20:27:35.555277] [INFO ] [REMOTE    ] PAC: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T20:27:36.056838] [INFO ] [REMOTE    ] PAAS: Incremental fetch complete for 2025-05 (2.31 seconds).
[2025-10-24T20:27:36.147614] [INFO ] [REMOTE    ] PAC: Fetching primary data for 2025-03.
[2025-10-24T20:27:36.328072] [INFO ] [REMOTE    ] PACK: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T20:27:36.909390] [INFO ] [REMOTE    ] PAC: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T20:27:36.947678] [INFO ] [REMOTE    ] PAAS: Fetching primary data for 2025-06.
[2025-10-24T20:27:37.747710] [INFO ] [REMOTE    ] PAC: Fetching primary data for 2025-04.
[2025-10-24T20:27:38.547848] [INFO ] [REMOTE    ] PACK: Fetching primary data for 2025-03.
[2025-10-24T20:27:38.939451] [INFO ] [REMOTE    ] PAC: Incremental fetch complete for 2025-04 (1.19 seconds).
[2025-10-24T20:27:39.356737] [INFO ] [REMOTE    ] PAC: Fetching primary data for 2025-05.
[2025-10-24T20:27:39.375871] [INFO ] [REMOTE    ] PAAS: Incremental fetch complete for 2025-06 (2.43 seconds).
[2025-10-24T20:27:39.991082] [INFO ] [REMOTE    ] PACK: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T20:27:40.147687] [INFO ] [REMOTE    ] PAAS: Fetching primary data for 2025-07.
[2025-10-24T20:27:40.484198] [INFO ] [REMOTE    ] PAC: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T20:27:40.947687] [INFO ] [REMOTE    ] OXY: Fetching primary data for 2025-10.
[2025-10-24T20:27:41.747626] [INFO ] [REMOTE    ] PACK: Fetching primary data for 2025-04.
[2025-10-24T20:27:41.844266] [INFO ] [REMOTE    ] OXY: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T20:27:41.853915] [INFO ] [REMOTE    ] OXY: Full fetch complete (77195 records).
[2025-10-24T20:27:41.854058] [DEBUG] [VALIDATOR ] OXY: Validating primary data.
[2025-10-24T20:27:41.854916] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:27:41.855006] [FATAL] [MAIN      ] OXY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:27:41.855055] [WARN ] [MAIN      ] OXY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:27:41.855140] [INFO ] [LOCAL     ] OXY: Starting deletion of primary data.
[2025-10-24T20:27:41.855217] [DEBUG] [LOCAL     ] OXY: No primary data file found to delete.
[2025-10-24T20:27:41.855267] [INFO ] [LOCAL     ] OXY: Starting deletion of derivative data.
[2025-10-24T20:27:41.855324] [DEBUG] [LOCAL     ] OXY: No derivative data file found to delete.
[2025-10-24T20:27:41.856124] [INFO ] [MAIN      ] Update Progress: 1616/2366 symbols completed. OXY took 27.9s. Estimated remaining: 1h 36m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:27:42.029875] [INFO ] [MAIN      ] PACS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:27:42.066633] [DEBUG] [LOCAL     ] PACS: Loaded 34973 existing records from primary storage.
[2025-10-24T20:27:42.066927] [INFO ] [MAIN      ] PACS: Loaded 34973 existing records.
[2025-10-24T20:27:42.249067] [WARN ] [MAIN      ] PACS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:27:42.249340] [INFO ] [MAIN      ] PACS: Wiping existing primary data before full refresh.
[2025-10-24T20:27:42.249475] [INFO ] [LOCAL     ] PACS: Starting deletion of primary data.
[2025-10-24T20:27:42.249807] [DEBUG] [LOCAL     ] PACS: Deleted primary data file.
[2025-10-24T20:27:42.249864] [INFO ] [MAIN      ] PACS: Starting full primary refresh.
[2025-10-24T20:27:42.485294] [INFO ] [REMOTE    ] PAAS: Incremental fetch complete for 2025-07 (2.34 seconds).
[2025-10-24T20:27:42.552382] [INFO ] [REMOTE    ] PAC: Fetching primary data for 2025-06.
[2025-10-24T20:27:42.699535] [INFO ] [REMOTE    ] PACS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:27:43.169847] [INFO ] [REMOTE    ] PACK: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T20:27:43.347678] [INFO ] [REMOTE    ] PACS: Fetching primary data for 2025-01.
[2025-10-24T20:27:43.650132] [INFO ] [REMOTE    ] PAC: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T20:27:44.147695] [INFO ] [REMOTE    ] PAC: Fetching primary data for 2025-07.
[2025-10-24T20:27:44.859261] [INFO ] [REMOTE    ] PACS: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T20:27:44.947695] [INFO ] [REMOTE    ] PACS: Fetching primary data for 2025-02.
[2025-10-24T20:27:45.046167] [INFO ] [REMOTE    ] PAC: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T20:27:45.747723] [INFO ] [REMOTE    ] PAAS: Fetching primary data for 2025-08.
[2025-10-24T20:27:46.444420] [INFO ] [REMOTE    ] PACS: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T20:27:46.547720] [INFO ] [REMOTE    ] PACS: Fetching primary data for 2025-03.
[2025-10-24T20:27:47.347615] [INFO ] [REMOTE    ] PAC: Fetching primary data for 2025-08.
[2025-10-24T20:27:47.778522] [INFO ] [REMOTE    ] PAAS: Incremental fetch complete for 2025-08 (2.03 seconds).
[2025-10-24T20:27:48.121113] [INFO ] [REMOTE    ] PACS: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T20:27:48.147597] [INFO ] [REMOTE    ] PACS: Fetching primary data for 2025-04.
[2025-10-24T20:27:48.324828] [INFO ] [REMOTE    ] PAC: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T20:27:48.947627] [INFO ] [REMOTE    ] PAAS: Fetching primary data for 2025-09.
[2025-10-24T20:27:49.600574] [INFO ] [REMOTE    ] PACS: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T20:27:49.747626] [INFO ] [REMOTE    ] PACS: Fetching primary data for 2025-05.
[2025-10-24T20:27:50.547723] [INFO ] [REMOTE    ] PACK: Fetching primary data for 2025-05.
[2025-10-24T20:27:51.087345] [INFO ] [REMOTE    ] PAAS: Incremental fetch complete for 2025-09 (2.14 seconds).
[2025-10-24T20:27:51.135057] [INFO ] [REMOTE    ] PACS: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T20:27:51.347738] [INFO ] [REMOTE    ] PAC: Fetching primary data for 2025-09.
[2025-10-24T20:27:51.895911] [INFO ] [REMOTE    ] PACK: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T20:27:52.147626] [INFO ] [REMOTE    ] PAAS: Fetching primary data for 2025-10.
[2025-10-24T20:27:52.334186] [INFO ] [REMOTE    ] PAC: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T20:27:52.947673] [INFO ] [REMOTE    ] PACS: Fetching primary data for 2025-06.
[2025-10-24T20:27:53.747625] [INFO ] [REMOTE    ] PACK: Fetching primary data for 2025-06.
[2025-10-24T20:27:54.339041] [INFO ] [REMOTE    ] PACS: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T20:27:54.372313] [INFO ] [REMOTE    ] PAAS: Incremental fetch complete for 2025-10 (2.22 seconds).
[2025-10-24T20:27:54.382240] [INFO ] [REMOTE    ] PAAS: Full fetch complete (77661 records).
[2025-10-24T20:27:54.382372] [DEBUG] [VALIDATOR ] PAAS: Validating primary data.
[2025-10-24T20:27:54.558444] [INFO ] [REMOTE    ] PAC: Fetching primary data for 2025-10.
[2025-10-24T20:27:54.785388] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present.
[2025-10-24T20:27:54.785465] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed.
[2025-10-24T20:27:54.786633] [INFO ] [MAIN      ] PAAS: Fetched primary data is valid.
[2025-10-24T20:27:54.786717] [DEBUG] [LOCAL     ] PAAS: Saving primary data.
[2025-10-24T20:27:54.787328] [FATAL] [LOCAL     ] PAAS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:27:54.787446] [FATAL] [MAIN      ] PAAS: Failed to save primary data.
[2025-10-24T20:27:54.787487] [WARN ] [MAIN      ] PAAS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:27:54.787521] [INFO ] [LOCAL     ] PAAS: Starting deletion of primary data.
[2025-10-24T20:27:54.787573] [DEBUG] [LOCAL     ] PAAS: No primary data file found to delete.
[2025-10-24T20:27:54.787608] [INFO ] [LOCAL     ] PAAS: Starting deletion of derivative data.
[2025-10-24T20:27:54.787812] [DEBUG] [LOCAL     ] PAAS: Deleted derivative data file.
[2025-10-24T20:27:54.788206] [INFO ] [MAIN      ] Update Progress: 1617/2366 symbols completed. PAAS took 39.8s. Estimated remaining: 1h 36m 17s. Rate: 7.8 symbols/min
[2025-10-24T20:27:54.974792] [INFO ] [MAIN      ] PAG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:27:54.997033] [DEBUG] [LOCAL     ] PAG: Loaded 21424 existing records from primary storage.
[2025-10-24T20:27:54.997367] [INFO ] [MAIN      ] PAG: Loaded 21424 existing records.
[2025-10-24T20:27:55.125807] [INFO ] [REMOTE    ] PACK: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T20:27:55.199157] [WARN ] [MAIN      ] PAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:27:55.199348] [INFO ] [MAIN      ] PAG: Wiping existing primary data before full refresh.
[2025-10-24T20:27:55.199395] [INFO ] [LOCAL     ] PAG: Starting deletion of primary data.
[2025-10-24T20:27:55.199581] [DEBUG] [LOCAL     ] PAG: Deleted primary data file.
[2025-10-24T20:27:55.199687] [INFO ] [MAIN      ] PAG: Starting full primary refresh.
[2025-10-24T20:27:55.355753] [INFO ] [REMOTE    ] PACK: Fetching primary data for 2025-07.
[2025-10-24T20:27:55.568270] [INFO ] [REMOTE    ] PAG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:27:55.574930] [INFO ] [REMOTE    ] PAC: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T20:27:55.577235] [INFO ] [REMOTE    ] PAC: Full fetch complete (16813 records).
[2025-10-24T20:27:55.577327] [DEBUG] [VALIDATOR ] PAC: Validating primary data.
[2025-10-24T20:27:55.940859] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present.
[2025-10-24T20:27:55.940933] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed.
[2025-10-24T20:27:55.941292] [INFO ] [MAIN      ] PAC: Fetched primary data is valid.
[2025-10-24T20:27:55.941329] [DEBUG] [LOCAL     ] PAC: Saving primary data.
[2025-10-24T20:27:55.941558] [FATAL] [LOCAL     ] PAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:27:55.941682] [FATAL] [MAIN      ] PAC: Failed to save primary data.
[2025-10-24T20:27:55.941756] [WARN ] [MAIN      ] PAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:27:55.941840] [INFO ] [LOCAL     ] PAC: Starting deletion of primary data.
[2025-10-24T20:27:55.941909] [DEBUG] [LOCAL     ] PAC: No primary data file found to delete.
[2025-10-24T20:27:55.941945] [INFO ] [LOCAL     ] PAC: Starting deletion of derivative data.
[2025-10-24T20:27:55.942124] [DEBUG] [LOCAL     ] PAC: Deleted derivative data file.
[2025-10-24T20:27:55.942210] [INFO ] [MAIN      ] Update Progress: 1618/2366 symbols completed. PAC took 29.4s. Estimated remaining: 1h 36m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:27:56.112445] [INFO ] [MAIN      ] PAGS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:27:56.159554] [INFO ] [REMOTE    ] PACS: Fetching primary data for 2025-07.
[2025-10-24T20:27:56.162606] [DEBUG] [LOCAL     ] PAGS: Loaded 53193 existing records from primary storage.
[2025-10-24T20:27:56.163035] [INFO ] [MAIN      ] PAGS: Loaded 53193 existing records.
[2025-10-24T20:27:56.354161] [WARN ] [MAIN      ] PAGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:27:56.354351] [INFO ] [MAIN      ] PAGS: Wiping existing primary data before full refresh.
[2025-10-24T20:27:56.354400] [INFO ] [LOCAL     ] PAGS: Starting deletion of primary data.
[2025-10-24T20:27:56.354863] [DEBUG] [LOCAL     ] PAGS: Deleted primary data file.
[2025-10-24T20:27:56.354919] [INFO ] [MAIN      ] PAGS: Starting full primary refresh.
[2025-10-24T20:27:56.723684] [INFO ] [REMOTE    ] PAGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:27:56.742420] [INFO ] [REMOTE    ] PACK: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T20:27:56.947611] [INFO ] [REMOTE    ] PAGS: Fetching primary data for 2025-01.
[2025-10-24T20:27:57.357114] [INFO ] [REMOTE    ] PACS: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T20:27:57.747639] [INFO ] [REMOTE    ] PACS: Fetching primary data for 2025-08.
[2025-10-24T20:27:58.547613] [INFO ] [REMOTE    ] PACK: Fetching primary data for 2025-08.
[2025-10-24T20:27:58.729753] [INFO ] [REMOTE    ] PAGS: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T20:27:59.219508] [INFO ] [REMOTE    ] PACS: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T20:27:59.347669] [INFO ] [REMOTE    ] PAG: Fetching primary data for 2025-01.
[2025-10-24T20:28:00.157501] [INFO ] [REMOTE    ] PACS: Fetching primary data for 2025-09.
[2025-10-24T20:28:00.162137] [INFO ] [REMOTE    ] PACK: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T20:28:00.182714] [INFO ] [REMOTE    ] PAG: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T20:28:00.947715] [INFO ] [REMOTE    ] PACK: Fetching primary data for 2025-09.
[2025-10-24T20:28:01.747732] [INFO ] [REMOTE    ] PAG: Fetching primary data for 2025-02.
[2025-10-24T20:28:01.887575] [INFO ] [REMOTE    ] PACS: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T20:28:02.547738] [INFO ] [REMOTE    ] PACS: Fetching primary data for 2025-10.
[2025-10-24T20:28:02.613726] [INFO ] [REMOTE    ] PACK: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T20:28:02.995825] [INFO ] [REMOTE    ] PAG: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T20:28:03.347729] [INFO ] [REMOTE    ] PAG: Fetching primary data for 2025-03.
[2025-10-24T20:28:04.092951] [INFO ] [REMOTE    ] PACS: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T20:28:04.099623] [INFO ] [REMOTE    ] PACS: Full fetch complete (50278 records).
[2025-10-24T20:28:04.099773] [DEBUG] [VALIDATOR ] PACS: Validating primary data.
[2025-10-24T20:28:04.154095] [INFO ] [REMOTE    ] PACK: Fetching primary data for 2025-10.
[2025-10-24T20:28:04.483178] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present.
[2025-10-24T20:28:04.483326] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed.
[2025-10-24T20:28:04.484334] [INFO ] [MAIN      ] PACS: Fetched primary data is valid.
[2025-10-24T20:28:04.484436] [DEBUG] [LOCAL     ] PACS: Saving primary data.
[2025-10-24T20:28:04.484898] [FATAL] [LOCAL     ] PACS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:28:04.484986] [FATAL] [MAIN      ] PACS: Failed to save primary data.
[2025-10-24T20:28:04.485095] [WARN ] [MAIN      ] PACS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:28:04.485145] [INFO ] [LOCAL     ] PACS: Starting deletion of primary data.
[2025-10-24T20:28:04.485214] [DEBUG] [LOCAL     ] PACS: No primary data file found to delete.
[2025-10-24T20:28:04.485275] [INFO ] [LOCAL     ] PACS: Starting deletion of derivative data.
[2025-10-24T20:28:04.485629] [DEBUG] [LOCAL     ] PACS: Deleted derivative data file.
[2025-10-24T20:28:04.486148] [INFO ] [MAIN      ] Update Progress: 1619/2366 symbols completed. PACS took 22.6s. Estimated remaining: 1h 35m 59s. Rate: 7.8 symbols/min
[2025-10-24T20:28:04.677006] [INFO ] [MAIN      ] PAI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:28:04.679744] [INFO ] [REMOTE    ] PAG: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T20:28:04.689638] [DEBUG] [LOCAL     ] PAI: Loaded 2872 existing records from primary storage.
[2025-10-24T20:28:04.689853] [INFO ] [MAIN      ] PAI: Loaded 2872 existing records.
[2025-10-24T20:28:04.866109] [WARN ] [MAIN      ] PAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:28:04.866316] [INFO ] [MAIN      ] PAI: Wiping existing primary data before full refresh.
[2025-10-24T20:28:04.866364] [INFO ] [LOCAL     ] PAI: Starting deletion of primary data.
[2025-10-24T20:28:04.866564] [DEBUG] [LOCAL     ] PAI: Deleted primary data file.
[2025-10-24T20:28:04.866619] [INFO ] [MAIN      ] PAI: Starting full primary refresh.
[2025-10-24T20:28:04.952903] [INFO ] [REMOTE    ] PAGS: Fetching primary data for 2025-02.
[2025-10-24T20:28:05.227568] [INFO ] [REMOTE    ] PAI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:28:05.624604] [INFO ] [REMOTE    ] PACK: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T20:28:05.631045] [INFO ] [REMOTE    ] PACK: Full fetch complete (45562 records).
[2025-10-24T20:28:05.631131] [DEBUG] [VALIDATOR ] PACK: Validating primary data.
[2025-10-24T20:28:05.752822] [INFO ] [REMOTE    ] PAG: Fetching primary data for 2025-04.
[2025-10-24T20:28:06.006560] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present.
[2025-10-24T20:28:06.006633] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed.
[2025-10-24T20:28:06.007532] [INFO ] [MAIN      ] PACK: Fetched primary data is valid.
[2025-10-24T20:28:06.007593] [DEBUG] [LOCAL     ] PACK: Saving primary data.
[2025-10-24T20:28:06.007989] [FATAL] [LOCAL     ] PACK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:28:06.008087] [FATAL] [MAIN      ] PACK: Failed to save primary data.
[2025-10-24T20:28:06.008138] [WARN ] [MAIN      ] PACK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:28:06.008180] [INFO ] [LOCAL     ] PACK: Starting deletion of primary data.
[2025-10-24T20:28:06.008237] [DEBUG] [LOCAL     ] PACK: No primary data file found to delete.
[2025-10-24T20:28:06.008275] [INFO ] [LOCAL     ] PACK: Starting deletion of derivative data.
[2025-10-24T20:28:06.008447] [DEBUG] [LOCAL     ] PACK: Deleted derivative data file.
[2025-10-24T20:28:06.008535] [INFO ] [MAIN      ] Update Progress: 1620/2366 symbols completed. PACK took 37.9s. Estimated remaining: 1h 35m 48s. Rate: 7.8 symbols/min
[2025-10-24T20:28:06.198404] [INFO ] [MAIN      ] PAII: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:28:06.198542] [DEBUG] [LOCAL     ] PAII: No existing data file found in primary storage.
[2025-10-24T20:28:06.198578] [WARN ] [MAIN      ] PAII: No existing data found, performing full refresh instead.
[2025-10-24T20:28:06.198704] [INFO ] [MAIN      ] PAII: Wiping existing primary data before full refresh.
[2025-10-24T20:28:06.198757] [INFO ] [LOCAL     ] PAII: Starting deletion of primary data.
[2025-10-24T20:28:06.198799] [DEBUG] [LOCAL     ] PAII: No primary data file found to delete.
[2025-10-24T20:28:06.198832] [INFO ] [MAIN      ] PAII: Starting full primary refresh.
[2025-10-24T20:28:06.557547] [INFO ] [REMOTE    ] PAI: Fetching primary data for 2025-01.
[2025-10-24T20:28:06.557489] [INFO ] [REMOTE    ] PAII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:28:06.688384] [INFO ] [REMOTE    ] PAGS: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T20:28:06.899765] [INFO ] [REMOTE    ] PAG: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T20:28:07.234869] [INFO ] [REMOTE    ] PAI: Incremental fetch complete for 2025-01 (0.68 seconds).
[2025-10-24T20:28:07.347681] [INFO ] [REMOTE    ] PAII: Fetching primary data for 2025-01.
[2025-10-24T20:28:07.719220] [DEBUG] [REMOTE    ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:28:07.719540] [WARN ] [REMOTE    ] PAII: No data returned for month 2025-01
[2025-10-24T20:28:07.719614] [FATAL] [REMOTE    ] PAII: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:28:07.719686] [FATAL] [MAIN      ] PAII: Failed to fetch primary data.
[2025-10-24T20:28:07.719739] [WARN ] [MAIN      ] PAII: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:28:07.719778] [INFO ] [LOCAL     ] PAII: Starting deletion of primary data.
[2025-10-24T20:28:07.719831] [DEBUG] [LOCAL     ] PAII: No primary data file found to delete.
[2025-10-24T20:28:07.719865] [INFO ] [LOCAL     ] PAII: Starting deletion of derivative data.
[2025-10-24T20:28:07.719903] [DEBUG] [LOCAL     ] PAII: No derivative data file found to delete.
[2025-10-24T20:28:07.719947] [INFO ] [MAIN      ] Update Progress: 1621/2366 symbols completed. PAII took 1.7s. Estimated remaining: 1h 35m 38s. Rate: 7.8 symbols/min
[2025-10-24T20:28:07.887686] [INFO ] [MAIN      ] PAM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:28:07.915168] [DEBUG] [LOCAL     ] PAM: Loaded 29368 existing records from primary storage.
[2025-10-24T20:28:07.915416] [INFO ] [MAIN      ] PAM: Loaded 29368 existing records.
[2025-10-24T20:28:08.090789] [WARN ] [MAIN      ] PAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:28:08.090991] [INFO ] [MAIN      ] PAM: Wiping existing primary data before full refresh.
[2025-10-24T20:28:08.091036] [INFO ] [LOCAL     ] PAM: Starting deletion of primary data.
[2025-10-24T20:28:08.091296] [DEBUG] [LOCAL     ] PAM: Deleted primary data file.
[2025-10-24T20:28:08.091339] [INFO ] [MAIN      ] PAM: Starting full primary refresh.
[2025-10-24T20:28:08.156390] [INFO ] [REMOTE    ] PAI: Fetching primary data for 2025-02.
[2025-10-24T20:28:08.447541] [INFO ] [REMOTE    ] PAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:28:08.886515] [INFO ] [REMOTE    ] PAI: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T20:28:08.947626] [INFO ] [REMOTE    ] PAI: Fetching primary data for 2025-03.
[2025-10-24T20:28:09.605874] [INFO ] [REMOTE    ] PAI: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T20:28:09.747729] [INFO ] [REMOTE    ] PAI: Fetching primary data for 2025-04.
[2025-10-24T20:28:10.338794] [INFO ] [REMOTE    ] PAI: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T20:28:10.547730] [INFO ] [REMOTE    ] PAI: Fetching primary data for 2025-05.
[2025-10-24T20:28:11.229606] [INFO ] [REMOTE    ] PAI: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T20:28:11.347690] [INFO ] [REMOTE    ] PAGS: Fetching primary data for 2025-03.
[2025-10-24T20:28:12.147722] [INFO ] [REMOTE    ] PAI: Fetching primary data for 2025-06.
[2025-10-24T20:28:12.681553] [INFO ] [REMOTE    ] PAI: Incremental fetch complete for 2025-06 (0.53 seconds).
[2025-10-24T20:28:12.947725] [INFO ] [REMOTE    ] PAG: Fetching primary data for 2025-05.
[2025-10-24T20:28:13.116095] [INFO ] [REMOTE    ] PAGS: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T20:28:13.747736] [INFO ] [REMOTE    ] PAGS: Fetching primary data for 2025-04.
[2025-10-24T20:28:14.086462] [INFO ] [REMOTE    ] PAG: Incremental fetch complete for 2025-05 (1.14 seconds).
[2025-10-24T20:28:14.547697] [INFO ] [REMOTE    ] PAG: Fetching primary data for 2025-06.
[2025-10-24T20:28:15.347622] [INFO ] [REMOTE    ] PAM: Fetching primary data for 2025-01.
[2025-10-24T20:28:15.785587] [INFO ] [REMOTE    ] PAG: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T20:28:15.829054] [INFO ] [REMOTE    ] PAGS: Incremental fetch complete for 2025-04 (2.08 seconds).
[2025-10-24T20:28:16.147736] [INFO ] [REMOTE    ] PAGS: Fetching primary data for 2025-05.
[2025-10-24T20:28:16.953155] [INFO ] [REMOTE    ] PAG: Fetching primary data for 2025-07.
[2025-10-24T20:28:16.962717] [INFO ] [REMOTE    ] PAM: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T20:28:17.747731] [INFO ] [REMOTE    ] PAI: Fetching primary data for 2025-07.
[2025-10-24T20:28:18.031583] [INFO ] [REMOTE    ] PAGS: Incremental fetch complete for 2025-05 (1.88 seconds).
[2025-10-24T20:28:18.430296] [INFO ] [REMOTE    ] PAG: Incremental fetch complete for 2025-07 (1.48 seconds).
[2025-10-24T20:28:18.547610] [INFO ] [REMOTE    ] PAG: Fetching primary data for 2025-08.
[2025-10-24T20:28:18.618545] [INFO ] [REMOTE    ] PAI: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T20:28:19.347613] [INFO ] [REMOTE    ] PAM: Fetching primary data for 2025-02.
[2025-10-24T20:28:19.753118] [INFO ] [REMOTE    ] PAG: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T20:28:20.147691] [INFO ] [REMOTE    ] PAG: Fetching primary data for 2025-09.
[2025-10-24T20:28:20.805590] [INFO ] [REMOTE    ] PAM: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T20:28:20.947633] [INFO ] [REMOTE    ] PAI: Fetching primary data for 2025-08.
[2025-10-24T20:28:21.205753] [INFO ] [REMOTE    ] PAG: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T20:28:21.591346] [INFO ] [REMOTE    ] PAI: Incremental fetch complete for 2025-08 (0.64 seconds).
[2025-10-24T20:28:21.747630] [INFO ] [REMOTE    ] PAGS: Fetching primary data for 2025-06.
[2025-10-24T20:28:22.547667] [INFO ] [REMOTE    ] PAM: Fetching primary data for 2025-03.
[2025-10-24T20:28:23.347701] [INFO ] [REMOTE    ] PAI: Fetching primary data for 2025-09.
[2025-10-24T20:28:23.385412] [INFO ] [REMOTE    ] PAGS: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T20:28:23.811055] [INFO ] [REMOTE    ] PAM: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T20:28:23.866291] [INFO ] [REMOTE    ] PAI: Incremental fetch complete for 2025-09 (0.52 seconds).
[2025-10-24T20:28:24.147733] [INFO ] [REMOTE    ] PAM: Fetching primary data for 2025-04.
[2025-10-24T20:28:24.947635] [INFO ] [REMOTE    ] PAGS: Fetching primary data for 2025-07.
[2025-10-24T20:28:25.506921] [INFO ] [REMOTE    ] PAM: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T20:28:25.747737] [INFO ] [REMOTE    ] PAM: Fetching primary data for 2025-05.
[2025-10-24T20:28:26.547623] [INFO ] [REMOTE    ] PAI: Fetching primary data for 2025-10.
[2025-10-24T20:28:26.753264] [INFO ] [REMOTE    ] PAGS: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T20:28:27.049965] [INFO ] [REMOTE    ] PAM: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T20:28:27.200402] [INFO ] [REMOTE    ] PAI: Incremental fetch complete for 2025-10 (0.65 seconds).
[2025-10-24T20:28:27.202036] [INFO ] [REMOTE    ] PAI: Full fetch complete (4245 records).
[2025-10-24T20:28:27.202110] [DEBUG] [VALIDATOR ] PAI: Validating primary data.
[2025-10-24T20:28:27.354020] [INFO ] [REMOTE    ] PAGS: Fetching primary data for 2025-08.
[2025-10-24T20:28:27.589669] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present.
[2025-10-24T20:28:27.589783] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed.
[2025-10-24T20:28:27.589983] [INFO ] [MAIN      ] PAI: Fetched primary data is valid.
[2025-10-24T20:28:27.590025] [DEBUG] [LOCAL     ] PAI: Saving primary data.
[2025-10-24T20:28:27.590263] [FATAL] [LOCAL     ] PAI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:28:27.590351] [FATAL] [MAIN      ] PAI: Failed to save primary data.
[2025-10-24T20:28:27.590392] [WARN ] [MAIN      ] PAI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:28:27.590426] [INFO ] [LOCAL     ] PAI: Starting deletion of primary data.
[2025-10-24T20:28:27.590477] [DEBUG] [LOCAL     ] PAI: No primary data file found to delete.
[2025-10-24T20:28:27.590511] [INFO ] [LOCAL     ] PAI: Starting deletion of derivative data.
[2025-10-24T20:28:27.590737] [DEBUG] [LOCAL     ] PAI: Deleted derivative data file.
[2025-10-24T20:28:27.590839] [INFO ] [MAIN      ] Update Progress: 1622/2366 symbols completed. PAI took 23.1s. Estimated remaining: 1h 35m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:28:27.764155] [INFO ] [MAIN      ] PAR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:28:27.801151] [DEBUG] [LOCAL     ] PAR: Loaded 34604 existing records from primary storage.
[2025-10-24T20:28:27.801550] [INFO ] [MAIN      ] PAR: Loaded 34604 existing records.
[2025-10-24T20:28:27.990631] [WARN ] [MAIN      ] PAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:28:27.990938] [INFO ] [MAIN      ] PAR: Wiping existing primary data before full refresh.
[2025-10-24T20:28:27.990986] [INFO ] [LOCAL     ] PAR: Starting deletion of primary data.
[2025-10-24T20:28:27.991741] [DEBUG] [LOCAL     ] PAR: Deleted primary data file.
[2025-10-24T20:28:27.991807] [INFO ] [MAIN      ] PAR: Starting full primary refresh.
[2025-10-24T20:28:28.156819] [INFO ] [REMOTE    ] PAG: Fetching primary data for 2025-10.
[2025-10-24T20:28:28.355890] [INFO ] [REMOTE    ] PAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:28:28.947625] [INFO ] [REMOTE    ] PAM: Fetching primary data for 2025-06.
[2025-10-24T20:28:29.173554] [INFO ] [REMOTE    ] PAGS: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T20:28:29.482712] [INFO ] [REMOTE    ] PAG: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T20:28:29.487087] [INFO ] [REMOTE    ] PAG: Full fetch complete (30941 records).
[2025-10-24T20:28:29.487163] [DEBUG] [VALIDATOR ] PAG: Validating primary data.
[2025-10-24T20:28:29.750901] [INFO ] [REMOTE    ] PAR: Fetching primary data for 2025-01.
[2025-10-24T20:28:29.861476] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present.
[2025-10-24T20:28:29.861559] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed.
[2025-10-24T20:28:29.862258] [INFO ] [MAIN      ] PAG: Fetched primary data is valid.
[2025-10-24T20:28:29.862322] [DEBUG] [LOCAL     ] PAG: Saving primary data.
[2025-10-24T20:28:29.862730] [FATAL] [LOCAL     ] PAG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:28:29.862818] [FATAL] [MAIN      ] PAG: Failed to save primary data.
[2025-10-24T20:28:29.862859] [WARN ] [MAIN      ] PAG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:28:29.862894] [INFO ] [LOCAL     ] PAG: Starting deletion of primary data.
[2025-10-24T20:28:29.862943] [DEBUG] [LOCAL     ] PAG: No primary data file found to delete.
[2025-10-24T20:28:29.862978] [INFO ] [LOCAL     ] PAG: Starting deletion of derivative data.
[2025-10-24T20:28:29.863137] [DEBUG] [LOCAL     ] PAG: Deleted derivative data file.
[2025-10-24T20:28:29.863212] [INFO ] [MAIN      ] Update Progress: 1623/2366 symbols completed. PAG took 35.1s. Estimated remaining: 1h 35m 26s. Rate: 7.8 symbols/min
[2025-10-24T20:28:30.033553] [INFO ] [MAIN      ] PARR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:28:30.077886] [DEBUG] [LOCAL     ] PARR: Loaded 48324 existing records from primary storage.
[2025-10-24T20:28:30.078198] [INFO ] [MAIN      ] PARR: Loaded 48324 existing records.
[2025-10-24T20:28:30.269072] [WARN ] [MAIN      ] PARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:28:30.270952] [INFO ] [MAIN      ] PARR: Wiping existing primary data before full refresh.
[2025-10-24T20:28:30.270772] [INFO ] [REMOTE    ] PAM: Incremental fetch complete for 2025-06 (1.32 seconds).
[2025-10-24T20:28:30.271127] [INFO ] [LOCAL     ] PARR: Starting deletion of primary data.
[2025-10-24T20:28:30.277315] [DEBUG] [LOCAL     ] PARR: Deleted primary data file.
[2025-10-24T20:28:30.277379] [INFO ] [MAIN      ] PARR: Starting full primary refresh.
[2025-10-24T20:28:30.549279] [INFO ] [REMOTE    ] PAGS: Fetching primary data for 2025-09.
[2025-10-24T20:28:30.626063] [INFO ] [REMOTE    ] PARR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:28:31.240698] [INFO ] [REMOTE    ] PAR: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T20:28:31.347610] [INFO ] [REMOTE    ] PAR: Fetching primary data for 2025-02.
[2025-10-24T20:28:32.147620] [INFO ] [REMOTE    ] PAM: Fetching primary data for 2025-07.
[2025-10-24T20:28:32.454867] [INFO ] [REMOTE    ] PAGS: Incremental fetch complete for 2025-09 (1.91 seconds).
[2025-10-24T20:28:32.519617] [INFO ] [REMOTE    ] PAR: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T20:28:32.947713] [INFO ] [REMOTE    ] PARR: Fetching primary data for 2025-01.
[2025-10-24T20:28:33.227355] [INFO ] [REMOTE    ] PAM: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T20:28:33.747722] [INFO ] [REMOTE    ] PAR: Fetching primary data for 2025-03.
[2025-10-24T20:28:34.484347] [INFO ] [REMOTE    ] PARR: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T20:28:34.547604] [INFO ] [REMOTE    ] PARR: Fetching primary data for 2025-02.
[2025-10-24T20:28:35.347615] [INFO ] [REMOTE    ] PAGS: Fetching primary data for 2025-10.
[2025-10-24T20:28:35.604590] [INFO ] [REMOTE    ] PAR: Incremental fetch complete for 2025-03 (1.86 seconds).
[2025-10-24T20:28:36.147767] [INFO ] [REMOTE    ] PAM: Fetching primary data for 2025-08.
[2025-10-24T20:28:36.258926] [INFO ] [REMOTE    ] PARR: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T20:28:36.947623] [INFO ] [REMOTE    ] PAR: Fetching primary data for 2025-04.
[2025-10-24T20:28:37.229102] [INFO ] [REMOTE    ] PAGS: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T20:28:37.240466] [INFO ] [REMOTE    ] PAGS: Full fetch complete (76498 records).
[2025-10-24T20:28:37.240630] [DEBUG] [VALIDATOR ] PAGS: Validating primary data.
[2025-10-24T20:28:37.644057] [INFO ] [REMOTE    ] PAM: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T20:28:37.709357] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present.
[2025-10-24T20:28:37.709437] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed.
[2025-10-24T20:28:37.710583] [INFO ] [MAIN      ] PAGS: Fetched primary data is valid.
[2025-10-24T20:28:37.710665] [DEBUG] [LOCAL     ] PAGS: Saving primary data.
[2025-10-24T20:28:37.711272] [FATAL] [LOCAL     ] PAGS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:28:37.711359] [FATAL] [MAIN      ] PAGS: Failed to save primary data.
[2025-10-24T20:28:37.711401] [WARN ] [MAIN      ] PAGS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:28:37.711462] [INFO ] [LOCAL     ] PAGS: Starting deletion of primary data.
[2025-10-24T20:28:37.711521] [DEBUG] [LOCAL     ] PAGS: No primary data file found to delete.
[2025-10-24T20:28:37.711556] [INFO ] [LOCAL     ] PAGS: Starting deletion of derivative data.
[2025-10-24T20:28:37.711743] [DEBUG] [LOCAL     ] PAGS: Deleted derivative data file.
[2025-10-24T20:28:37.712115] [INFO ] [MAIN      ] Update Progress: 1624/2366 symbols completed. PAGS took 41.8s. Estimated remaining: 1h 35m 18s. Rate: 7.8 symbols/min
[2025-10-24T20:28:37.755699] [INFO ] [REMOTE    ] PAM: Fetching primary data for 2025-09.
[2025-10-24T20:28:37.884790] [INFO ] [MAIN      ] PATH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:28:37.936180] [DEBUG] [LOCAL     ] PATH: Loaded 54070 existing records from primary storage.
[2025-10-24T20:28:37.936490] [INFO ] [MAIN      ] PATH: Loaded 54070 existing records.
[2025-10-24T20:28:38.119382] [WARN ] [MAIN      ] PATH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:28:38.119616] [INFO ] [MAIN      ] PATH: Wiping existing primary data before full refresh.
[2025-10-24T20:28:38.119698] [INFO ] [LOCAL     ] PATH: Starting deletion of primary data.
[2025-10-24T20:28:38.120875] [DEBUG] [LOCAL     ] PATH: Deleted primary data file.
[2025-10-24T20:28:38.120936] [INFO ] [MAIN      ] PATH: Starting full primary refresh.
[2025-10-24T20:28:38.476267] [INFO ] [REMOTE    ] PATH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:28:38.552453] [INFO ] [REMOTE    ] PARR: Fetching primary data for 2025-03.
[2025-10-24T20:28:38.556727] [INFO ] [REMOTE    ] PAR: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T20:28:39.347618] [INFO ] [REMOTE    ] PAR: Fetching primary data for 2025-05.
[2025-10-24T20:28:39.527213] [INFO ] [REMOTE    ] PAM: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T20:28:40.147722] [INFO ] [REMOTE    ] PATH: Fetching primary data for 2025-01.
[2025-10-24T20:28:40.403529] [INFO ] [REMOTE    ] PARR: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T20:28:40.743343] [INFO ] [REMOTE    ] PAR: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T20:28:40.947697] [INFO ] [REMOTE    ] PARR: Fetching primary data for 2025-04.
[2025-10-24T20:28:41.747628] [INFO ] [REMOTE    ] PAR: Fetching primary data for 2025-06.
[2025-10-24T20:28:42.368517] [INFO ] [REMOTE    ] PATH: Incremental fetch complete for 2025-01 (2.22 seconds).
[2025-10-24T20:28:42.547619] [INFO ] [REMOTE    ] PATH: Fetching primary data for 2025-02.
[2025-10-24T20:28:42.660074] [INFO ] [REMOTE    ] PARR: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T20:28:42.717093] [INFO ] [REMOTE    ] PAR: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T20:28:43.347679] [INFO ] [REMOTE    ] PAM: Fetching primary data for 2025-10.
[2025-10-24T20:28:44.147679] [INFO ] [REMOTE    ] PAR: Fetching primary data for 2025-07.
[2025-10-24T20:28:44.768813] [INFO ] [REMOTE    ] PAM: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T20:28:44.779206] [INFO ] [REMOTE    ] PAM: Full fetch complete (42442 records).
[2025-10-24T20:28:44.779450] [DEBUG] [VALIDATOR ] PAM: Validating primary data.
[2025-10-24T20:28:44.948809] [INFO ] [REMOTE    ] PARR: Fetching primary data for 2025-05.
[2025-10-24T20:28:45.237206] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present.
[2025-10-24T20:28:45.237897] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed.
[2025-10-24T20:28:45.242876] [INFO ] [MAIN      ] PAM: Fetched primary data is valid.
[2025-10-24T20:28:45.242997] [DEBUG] [LOCAL     ] PAM: Saving primary data.
[2025-10-24T20:28:45.240800] [INFO ] [REMOTE    ] PATH: Incremental fetch complete for 2025-02 (2.69 seconds).
[2025-10-24T20:28:45.253677] [FATAL] [LOCAL     ] PAM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:28:45.254103] [FATAL] [MAIN      ] PAM: Failed to save primary data.
[2025-10-24T20:28:45.254767] [WARN ] [MAIN      ] PAM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:28:45.254894] [INFO ] [LOCAL     ] PAM: Starting deletion of primary data.
[2025-10-24T20:28:45.255378] [DEBUG] [LOCAL     ] PAM: No primary data file found to delete.
[2025-10-24T20:28:45.255442] [INFO ] [LOCAL     ] PAM: Starting deletion of derivative data.
[2025-10-24T20:28:45.255630] [DEBUG] [LOCAL     ] PAM: Deleted derivative data file.
[2025-10-24T20:28:45.255787] [INFO ] [MAIN      ] Update Progress: 1625/2366 symbols completed. PAM took 37.5s. Estimated remaining: 1h 35m 10s. Rate: 7.8 symbols/min
[2025-10-24T20:28:45.436751] [INFO ] [MAIN      ] PAXS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:28:45.456629] [INFO ] [REMOTE    ] PAR: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T20:28:45.484756] [DEBUG] [LOCAL     ] PAXS: Loaded 21019 existing records from primary storage.
[2025-10-24T20:28:45.485099] [INFO ] [MAIN      ] PAXS: Loaded 21019 existing records.
[2025-10-24T20:28:45.667924] [WARN ] [MAIN      ] PAXS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:28:45.668259] [INFO ] [MAIN      ] PAXS: Wiping existing primary data before full refresh.
[2025-10-24T20:28:45.668319] [INFO ] [LOCAL     ] PAXS: Starting deletion of primary data.
[2025-10-24T20:28:45.668908] [DEBUG] [LOCAL     ] PAXS: Deleted primary data file.
[2025-10-24T20:28:45.668969] [INFO ] [MAIN      ] PAXS: Starting full primary refresh.
[2025-10-24T20:28:45.752825] [INFO ] [REMOTE    ] PATH: Fetching primary data for 2025-03.
[2025-10-24T20:28:46.042292] [INFO ] [REMOTE    ] PAXS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:28:46.547678] [INFO ] [REMOTE    ] PAR: Fetching primary data for 2025-08.
[2025-10-24T20:28:46.583991] [INFO ] [REMOTE    ] PARR: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T20:28:47.347734] [INFO ] [REMOTE    ] PARR: Fetching primary data for 2025-06.
[2025-10-24T20:28:47.986819] [INFO ] [REMOTE    ] PATH: Incremental fetch complete for 2025-03 (2.23 seconds).
[2025-10-24T20:28:48.064693] [INFO ] [REMOTE    ] PAR: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T20:28:48.147632] [INFO ] [REMOTE    ] PATH: Fetching primary data for 2025-04.
[2025-10-24T20:28:48.947735] [INFO ] [REMOTE    ] PAR: Fetching primary data for 2025-09.
[2025-10-24T20:28:48.952534] [INFO ] [REMOTE    ] PARR: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T20:28:49.747718] [INFO ] [REMOTE    ] PARR: Fetching primary data for 2025-07.
[2025-10-24T20:28:50.262870] [INFO ] [REMOTE    ] PATH: Incremental fetch complete for 2025-04 (2.12 seconds).
[2025-10-24T20:28:50.547692] [INFO ] [REMOTE    ] PAXS: Fetching primary data for 2025-01.
[2025-10-24T20:28:50.685370] [INFO ] [REMOTE    ] PAR: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T20:28:51.347704] [INFO ] [REMOTE    ] PAR: Fetching primary data for 2025-10.
[2025-10-24T20:28:51.445870] [INFO ] [REMOTE    ] PARR: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T20:28:51.493978] [INFO ] [REMOTE    ] PAXS: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T20:28:52.147687] [INFO ] [REMOTE    ] PARR: Fetching primary data for 2025-08.
[2025-10-24T20:28:52.253549] [DEBUG] [REMOTE    ] PARR: Error fetching primary data for 2025-08: 'API call returned an empty response.'
[2025-10-24T20:28:52.253839] [WARN ] [REMOTE    ] PARR: No data returned for month 2025-08
[2025-10-24T20:28:52.253944] [FATAL] [REMOTE    ] PARR: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:28:52.254029] [FATAL] [MAIN      ] PARR: Failed to fetch primary data.
[2025-10-24T20:28:52.254082] [WARN ] [MAIN      ] PARR: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:28:52.254167] [INFO ] [LOCAL     ] PARR: Starting deletion of primary data.
[2025-10-24T20:28:52.254259] [DEBUG] [LOCAL     ] PARR: No primary data file found to delete.
[2025-10-24T20:28:52.254317] [INFO ] [LOCAL     ] PARR: Starting deletion of derivative data.
[2025-10-24T20:28:52.254483] [DEBUG] [LOCAL     ] PARR: Deleted derivative data file.
[2025-10-24T20:28:52.254966] [INFO ] [MAIN      ] Update Progress: 1626/2366 symbols completed. PARR took 22.4s. Estimated remaining: 1h 35m 2s. Rate: 7.8 symbols/min
[2025-10-24T20:28:52.439071] [INFO ] [MAIN      ] PAY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:28:52.474866] [DEBUG] [LOCAL     ] PAY: Loaded 38809 existing records from primary storage.
[2025-10-24T20:28:52.475136] [INFO ] [MAIN      ] PAY: Loaded 38809 existing records.
[2025-10-24T20:28:52.657051] [WARN ] [MAIN      ] PAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:28:52.657279] [INFO ] [MAIN      ] PAY: Wiping existing primary data before full refresh.
[2025-10-24T20:28:52.657339] [INFO ] [LOCAL     ] PAY: Starting deletion of primary data.
[2025-10-24T20:28:52.657978] [DEBUG] [LOCAL     ] PAY: Deleted primary data file.
[2025-10-24T20:28:52.658035] [INFO ] [MAIN      ] PAY: Starting full primary refresh.
[2025-10-24T20:28:52.950463] [INFO ] [REMOTE    ] PATH: Fetching primary data for 2025-05.
[2025-10-24T20:28:53.021264] [INFO ] [REMOTE    ] PAY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:28:53.042734] [INFO ] [REMOTE    ] PAR: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T20:28:53.050332] [INFO ] [REMOTE    ] PAR: Full fetch complete (49379 records).
[2025-10-24T20:28:53.050427] [DEBUG] [VALIDATOR ] PAR: Validating primary data.
[2025-10-24T20:28:53.427853] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present.
[2025-10-24T20:28:53.427924] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed.
[2025-10-24T20:28:53.428735] [INFO ] [MAIN      ] PAR: Fetched primary data is valid.
[2025-10-24T20:28:53.428816] [DEBUG] [LOCAL     ] PAR: Saving primary data.
[2025-10-24T20:28:53.429191] [FATAL] [LOCAL     ] PAR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:28:53.429277] [FATAL] [MAIN      ] PAR: Failed to save primary data.
[2025-10-24T20:28:53.429318] [WARN ] [MAIN      ] PAR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:28:53.429352] [INFO ] [LOCAL     ] PAR: Starting deletion of primary data.
[2025-10-24T20:28:53.429408] [DEBUG] [LOCAL     ] PAR: No primary data file found to delete.
[2025-10-24T20:28:53.429475] [INFO ] [LOCAL     ] PAR: Starting deletion of derivative data.
[2025-10-24T20:28:53.429705] [DEBUG] [LOCAL     ] PAR: Deleted derivative data file.
[2025-10-24T20:28:53.430169] [INFO ] [MAIN      ] Update Progress: 1627/2366 symbols completed. PAR took 25.8s. Estimated remaining: 1h 34m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:28:53.609262] [INFO ] [MAIN      ] PAYC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:28:53.644097] [DEBUG] [LOCAL     ] PAYC: Loaded 36283 existing records from primary storage.
[2025-10-24T20:28:53.644356] [INFO ] [MAIN      ] PAYC: Loaded 36283 existing records.
[2025-10-24T20:28:53.753981] [INFO ] [REMOTE    ] PAY: Fetching primary data for 2025-01.
[2025-10-24T20:28:53.835489] [WARN ] [MAIN      ] PAYC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:28:53.835697] [INFO ] [MAIN      ] PAYC: Wiping existing primary data before full refresh.
[2025-10-24T20:28:53.835763] [INFO ] [LOCAL     ] PAYC: Starting deletion of primary data.
[2025-10-24T20:28:53.836704] [DEBUG] [LOCAL     ] PAYC: Deleted primary data file.
[2025-10-24T20:28:53.836763] [INFO ] [MAIN      ] PAYC: Starting full primary refresh.
[2025-10-24T20:28:54.210198] [INFO ] [REMOTE    ] PAYC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:28:54.547709] [INFO ] [REMOTE    ] PAXS: Fetching primary data for 2025-02.
[2025-10-24T20:28:55.150150] [INFO ] [REMOTE    ] PAY: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T20:28:55.257051] [INFO ] [REMOTE    ] PATH: Incremental fetch complete for 2025-05 (2.31 seconds).
[2025-10-24T20:28:55.347598] [INFO ] [REMOTE    ] PATH: Fetching primary data for 2025-06.
[2025-10-24T20:28:55.626034] [INFO ] [REMOTE    ] PAXS: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T20:28:56.147725] [INFO ] [REMOTE    ] PAXS: Fetching primary data for 2025-03.
[2025-10-24T20:28:56.947712] [INFO ] [REMOTE    ] PAYC: Fetching primary data for 2025-01.
[2025-10-24T20:28:57.313381] [INFO ] [REMOTE    ] PAXS: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T20:28:57.629474] [INFO ] [REMOTE    ] PATH: Incremental fetch complete for 2025-06 (2.28 seconds).
[2025-10-24T20:28:57.747602] [INFO ] [REMOTE    ] PATH: Fetching primary data for 2025-07.
[2025-10-24T20:28:58.397737] [INFO ] [REMOTE    ] PAYC: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T20:28:58.547681] [INFO ] [REMOTE    ] PAYC: Fetching primary data for 2025-02.
[2025-10-24T20:28:59.347724] [INFO ] [REMOTE    ] PAY: Fetching primary data for 2025-02.
[2025-10-24T20:29:00.027878] [INFO ] [REMOTE    ] PATH: Incremental fetch complete for 2025-07 (2.28 seconds).
[2025-10-24T20:29:00.062620] [INFO ] [REMOTE    ] PAYC: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T20:29:00.147608] [INFO ] [REMOTE    ] PAYC: Fetching primary data for 2025-03.
[2025-10-24T20:29:00.322833] [INFO ] [REMOTE    ] PAY: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T20:29:00.947740] [INFO ] [REMOTE    ] PAXS: Fetching primary data for 2025-04.
[2025-10-24T20:29:01.510418] [INFO ] [REMOTE    ] PAYC: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T20:29:01.747710] [INFO ] [REMOTE    ] PAYC: Fetching primary data for 2025-04.
[2025-10-24T20:29:02.250087] [INFO ] [REMOTE    ] PAXS: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T20:29:02.547671] [INFO ] [REMOTE    ] PAXS: Fetching primary data for 2025-05.
[2025-10-24T20:29:03.347613] [INFO ] [REMOTE    ] PATH: Fetching primary data for 2025-08.
[2025-10-24T20:29:03.482328] [INFO ] [REMOTE    ] PAYC: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T20:29:03.660870] [INFO ] [REMOTE    ] PAXS: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T20:29:04.147675] [INFO ] [REMOTE    ] PAXS: Fetching primary data for 2025-06.
[2025-10-24T20:29:04.947729] [INFO ] [REMOTE    ] PAYC: Fetching primary data for 2025-05.
[2025-10-24T20:29:05.286860] [INFO ] [REMOTE    ] PAXS: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T20:29:05.504257] [INFO ] [REMOTE    ] PATH: Incremental fetch complete for 2025-08 (2.16 seconds).
[2025-10-24T20:29:05.747624] [INFO ] [REMOTE    ] PAXS: Fetching primary data for 2025-07.
[2025-10-24T20:29:06.547963] [INFO ] [REMOTE    ] PAY: Fetching primary data for 2025-03.
[2025-10-24T20:29:06.662974] [INFO ] [REMOTE    ] PAYC: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T20:29:07.192898] [INFO ] [REMOTE    ] PAXS: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T20:29:07.347673] [INFO ] [REMOTE    ] PAXS: Fetching primary data for 2025-08.
[2025-10-24T20:29:07.939427] [INFO ] [REMOTE    ] PAY: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T20:29:08.154264] [INFO ] [REMOTE    ] PAY: Fetching primary data for 2025-04.
[2025-10-24T20:29:08.157723] [INFO ] [REMOTE    ] PAXS: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T20:29:08.947687] [INFO ] [REMOTE    ] PATH: Fetching primary data for 2025-09.
[2025-10-24T20:29:09.303678] [INFO ] [REMOTE    ] PAY: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T20:29:09.747684] [INFO ] [REMOTE    ] PAY: Fetching primary data for 2025-05.
[2025-10-24T20:29:10.547742] [INFO ] [REMOTE    ] PAXS: Fetching primary data for 2025-09.
[2025-10-24T20:29:11.355758] [INFO ] [REMOTE    ] PAYC: Fetching primary data for 2025-06.
[2025-10-24T20:29:11.357827] [INFO ] [REMOTE    ] PAY: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T20:29:11.401256] [INFO ] [REMOTE    ] PATH: Incremental fetch complete for 2025-09 (2.45 seconds).
[2025-10-24T20:29:11.732968] [INFO ] [REMOTE    ] PAXS: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T20:29:12.147688] [INFO ] [REMOTE    ] PAY: Fetching primary data for 2025-06.
[2025-10-24T20:29:12.947694] [INFO ] [REMOTE    ] PATH: Fetching primary data for 2025-10.
[2025-10-24T20:29:12.986951] [INFO ] [REMOTE    ] PAYC: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T20:29:13.598061] [INFO ] [REMOTE    ] PAY: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T20:29:13.747617] [INFO ] [REMOTE    ] PAY: Fetching primary data for 2025-07.
[2025-10-24T20:29:14.547721] [INFO ] [REMOTE    ] PAYC: Fetching primary data for 2025-07.
[2025-10-24T20:29:15.260051] [INFO ] [REMOTE    ] PAY: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T20:29:15.347710] [INFO ] [REMOTE    ] PAXS: Fetching primary data for 2025-10.
[2025-10-24T20:29:15.835564] [INFO ] [REMOTE    ] PATH: Incremental fetch complete for 2025-10 (2.89 seconds).
[2025-10-24T20:29:15.846119] [INFO ] [REMOTE    ] PATH: Full fetch complete (77852 records).
[2025-10-24T20:29:15.846263] [DEBUG] [VALIDATOR ] PATH: Validating primary data.
[2025-10-24T20:29:16.153510] [INFO ] [REMOTE    ] PAY: Fetching primary data for 2025-08.
[2025-10-24T20:29:16.191576] [INFO ] [REMOTE    ] PAXS: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T20:29:16.296103] [INFO ] [REMOTE    ] PAYC: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T20:29:16.304183] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present.
[2025-10-24T20:29:16.296542] [INFO ] [REMOTE    ] PAXS: Full fetch complete (29354 records).
[2025-10-24T20:29:16.304263] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed.
[2025-10-24T20:29:16.304907] [DEBUG] [VALIDATOR ] PAXS: Validating primary data.
[2025-10-24T20:29:16.306324] [INFO ] [MAIN      ] PATH: Fetched primary data is valid.
[2025-10-24T20:29:16.306782] [DEBUG] [LOCAL     ] PATH: Saving primary data.
[2025-10-24T20:29:16.312886] [FATAL] [LOCAL     ] PATH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:29:16.354213] [FATAL] [MAIN      ] PATH: Failed to save primary data.
[2025-10-24T20:29:16.381916] [WARN ] [MAIN      ] PATH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:29:16.393283] [INFO ] [LOCAL     ] PATH: Starting deletion of primary data.
[2025-10-24T20:29:16.405081] [DEBUG] [LOCAL     ] PATH: No primary data file found to delete.
[2025-10-24T20:29:16.405199] [INFO ] [LOCAL     ] PATH: Starting deletion of derivative data.
[2025-10-24T20:29:16.416503] [DEBUG] [LOCAL     ] PATH: Deleted derivative data file.
[2025-10-24T20:29:16.416992] [INFO ] [MAIN      ] Update Progress: 1628/2366 symbols completed. PATH took 38.7s. Estimated remaining: 1h 34m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:29:16.801361] [INFO ] [MAIN      ] PB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:29:16.904319] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present.
[2025-10-24T20:29:16.914260] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed.
[2025-10-24T20:29:16.915393] [INFO ] [MAIN      ] PAXS: Fetched primary data is valid.
[2025-10-24T20:29:16.915485] [DEBUG] [LOCAL     ] PAXS: Saving primary data.
[2025-10-24T20:29:16.916050] [FATAL] [LOCAL     ] PAXS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:29:16.916139] [FATAL] [MAIN      ] PAXS: Failed to save primary data.
[2025-10-24T20:29:16.916182] [WARN ] [MAIN      ] PAXS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:29:16.916216] [INFO ] [LOCAL     ] PAXS: Starting deletion of primary data.
[2025-10-24T20:29:16.916272] [DEBUG] [LOCAL     ] PAXS: No primary data file found to delete.
[2025-10-24T20:29:16.916308] [INFO ] [LOCAL     ] PAXS: Starting deletion of derivative data.
[2025-10-24T20:29:16.916604] [DEBUG] [LOCAL     ] PAXS: Deleted derivative data file.
[2025-10-24T20:29:16.916764] [INFO ] [MAIN      ] Update Progress: 1629/2366 symbols completed. PAXS took 31.7s. Estimated remaining: 1h 34m 40s. Rate: 7.8 symbols/min
[2025-10-24T20:29:16.950498] [INFO ] [REMOTE    ] PAYC: Fetching primary data for 2025-08.
[2025-10-24T20:29:17.040680] [DEBUG] [LOCAL     ] PB: Loaded 42660 existing records from primary storage.
[2025-10-24T20:29:17.052211] [INFO ] [MAIN      ] PB: Loaded 42660 existing records.
[2025-10-24T20:29:17.234885] [INFO ] [MAIN      ] PBA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:29:17.373139] [WARN ] [MAIN      ] PB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:29:17.373535] [INFO ] [MAIN      ] PB: Wiping existing primary data before full refresh.
[2025-10-24T20:29:17.373604] [INFO ] [LOCAL     ] PB: Starting deletion of primary data.
[2025-10-24T20:29:17.374738] [DEBUG] [LOCAL     ] PB: Deleted primary data file.
[2025-10-24T20:29:17.374810] [INFO ] [MAIN      ] PB: Starting full primary refresh.
[2025-10-24T20:29:17.643797] [DEBUG] [LOCAL     ] PBA: Loaded 49535 existing records from primary storage.
[2025-10-24T20:29:17.689368] [INFO ] [MAIN      ] PBA: Loaded 49535 existing records.
[2025-10-24T20:29:17.971070] [INFO ] [REMOTE    ] PB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:29:17.992180] [INFO ] [REMOTE    ] PB: Fetching primary data for 2025-01.
[2025-10-24T20:29:18.029973] [WARN ] [MAIN      ] PBA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:29:18.030433] [INFO ] [MAIN      ] PBA: Wiping existing primary data before full refresh.
[2025-10-24T20:29:18.032329] [INFO ] [REMOTE    ] PAY: Incremental fetch complete for 2025-08 (1.88 seconds).
[2025-10-24T20:29:18.041200] [INFO ] [LOCAL     ] PBA: Starting deletion of primary data.
[2025-10-24T20:29:18.043192] [DEBUG] [LOCAL     ] PBA: Deleted primary data file.
[2025-10-24T20:29:18.043271] [INFO ] [MAIN      ] PBA: Starting full primary refresh.
[2025-10-24T20:29:18.426287] [INFO ] [REMOTE    ] PBA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:29:18.448405] [INFO ] [REMOTE    ] PAYC: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T20:29:18.547605] [INFO ] [REMOTE    ] PAYC: Fetching primary data for 2025-09.
[2025-10-24T20:29:19.347634] [INFO ] [REMOTE    ] PAY: Fetching primary data for 2025-09.
[2025-10-24T20:29:19.575023] [INFO ] [REMOTE    ] PB: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T20:29:20.047218] [INFO ] [REMOTE    ] PAYC: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T20:29:20.147603] [INFO ] [REMOTE    ] PAYC: Fetching primary data for 2025-10.
[2025-10-24T20:29:20.686704] [INFO ] [REMOTE    ] PAY: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T20:29:20.947624] [INFO ] [REMOTE    ] PAY: Fetching primary data for 2025-10.
[2025-10-24T20:29:21.636894] [INFO ] [REMOTE    ] PAYC: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T20:29:21.643435] [INFO ] [REMOTE    ] PAYC: Full fetch complete (53102 records).
[2025-10-24T20:29:21.643524] [DEBUG] [VALIDATOR ] PAYC: Validating primary data.
[2025-10-24T20:29:21.752792] [INFO ] [REMOTE    ] PBA: Fetching primary data for 2025-01.
[2025-10-24T20:29:22.017130] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present.
[2025-10-24T20:29:22.017206] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed.
[2025-10-24T20:29:22.018035] [INFO ] [MAIN      ] PAYC: Fetched primary data is valid.
[2025-10-24T20:29:22.018095] [DEBUG] [LOCAL     ] PAYC: Saving primary data.
[2025-10-24T20:29:22.018595] [FATAL] [LOCAL     ] PAYC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:29:22.018700] [FATAL] [MAIN      ] PAYC: Failed to save primary data.
[2025-10-24T20:29:22.018745] [WARN ] [MAIN      ] PAYC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:29:22.018781] [INFO ] [LOCAL     ] PAYC: Starting deletion of primary data.
[2025-10-24T20:29:22.018830] [DEBUG] [LOCAL     ] PAYC: No primary data file found to delete.
[2025-10-24T20:29:22.018864] [INFO ] [LOCAL     ] PAYC: Starting deletion of derivative data.
[2025-10-24T20:29:22.019047] [DEBUG] [LOCAL     ] PAYC: Deleted derivative data file.
[2025-10-24T20:29:22.019444] [INFO ] [MAIN      ] Update Progress: 1630/2366 symbols completed. PAYC took 28.6s. Estimated remaining: 1h 34m 31s. Rate: 7.8 symbols/min
[2025-10-24T20:29:22.188783] [INFO ] [MAIN      ] PBF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:29:22.240071] [DEBUG] [LOCAL     ] PBF: Loaded 53493 existing records from primary storage.
[2025-10-24T20:29:22.240375] [INFO ] [MAIN      ] PBF: Loaded 53493 existing records.
[2025-10-24T20:29:22.417539] [WARN ] [MAIN      ] PBF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:29:22.417746] [INFO ] [MAIN      ] PBF: Wiping existing primary data before full refresh.
[2025-10-24T20:29:22.417795] [INFO ] [LOCAL     ] PBF: Starting deletion of primary data.
[2025-10-24T20:29:22.418150] [DEBUG] [LOCAL     ] PBF: Deleted primary data file.
[2025-10-24T20:29:22.418206] [INFO ] [MAIN      ] PBF: Starting full primary refresh.
[2025-10-24T20:29:22.557769] [INFO ] [REMOTE    ] PB: Fetching primary data for 2025-02.
[2025-10-24T20:29:22.711195] [INFO ] [REMOTE    ] PAY: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T20:29:22.739522] [INFO ] [REMOTE    ] PAY: Full fetch complete (53978 records).
[2025-10-24T20:29:22.739681] [DEBUG] [VALIDATOR ] PAY: Validating primary data.
[2025-10-24T20:29:22.908418] [INFO ] [REMOTE    ] PBF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:29:23.180376] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present.
[2025-10-24T20:29:23.180449] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed.
[2025-10-24T20:29:23.181389] [INFO ] [MAIN      ] PAY: Fetched primary data is valid.
[2025-10-24T20:29:23.181449] [DEBUG] [LOCAL     ] PAY: Saving primary data.
[2025-10-24T20:29:23.181886] [FATAL] [LOCAL     ] PAY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:29:23.182128] [FATAL] [MAIN      ] PAY: Failed to save primary data.
[2025-10-24T20:29:23.182192] [WARN ] [MAIN      ] PAY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:29:23.182236] [INFO ] [LOCAL     ] PAY: Starting deletion of primary data.
[2025-10-24T20:29:23.182287] [DEBUG] [LOCAL     ] PAY: No primary data file found to delete.
[2025-10-24T20:29:23.182323] [INFO ] [LOCAL     ] PAY: Starting deletion of derivative data.
[2025-10-24T20:29:23.182465] [DEBUG] [LOCAL     ] PAY: Deleted derivative data file.
[2025-10-24T20:29:23.182832] [INFO ] [MAIN      ] Update Progress: 1631/2366 symbols completed. PAY took 30.9s. Estimated remaining: 1h 34m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:29:23.353796] [INFO ] [MAIN      ] PBH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:29:23.351160] [INFO ] [REMOTE    ] PBF: Fetching primary data for 2025-01.
[2025-10-24T20:29:23.385056] [DEBUG] [LOCAL     ] PBH: Loaded 32673 existing records from primary storage.
[2025-10-24T20:29:23.385307] [INFO ] [MAIN      ] PBH: Loaded 32673 existing records.
[2025-10-24T20:29:23.564987] [WARN ] [MAIN      ] PBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:29:23.565240] [INFO ] [MAIN      ] PBH: Wiping existing primary data before full refresh.
[2025-10-24T20:29:23.565295] [INFO ] [LOCAL     ] PBH: Starting deletion of primary data.
[2025-10-24T20:29:23.565624] [DEBUG] [LOCAL     ] PBH: Deleted primary data file.
[2025-10-24T20:29:23.565713] [INFO ] [MAIN      ] PBH: Starting full primary refresh.
[2025-10-24T20:29:23.859540] [INFO ] [REMOTE    ] PBA: Incremental fetch complete for 2025-01 (2.11 seconds).
[2025-10-24T20:29:23.969148] [INFO ] [REMOTE    ] PBH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:29:23.990842] [INFO ] [REMOTE    ] PB: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T20:29:24.147606] [INFO ] [REMOTE    ] PBH: Fetching primary data for 2025-01.
[2025-10-24T20:29:24.947701] [INFO ] [REMOTE    ] PB: Fetching primary data for 2025-03.
[2025-10-24T20:29:25.076436] [INFO ] [REMOTE    ] PBF: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T20:29:25.145836] [INFO ] [REMOTE    ] PBH: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T20:29:25.747701] [INFO ] [REMOTE    ] PBH: Fetching primary data for 2025-02.
[2025-10-24T20:29:26.210526] [INFO ] [REMOTE    ] PB: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T20:29:26.547728] [INFO ] [REMOTE    ] PB: Fetching primary data for 2025-04.
[2025-10-24T20:29:27.027326] [INFO ] [REMOTE    ] PBH: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T20:29:27.347615] [INFO ] [REMOTE    ] PBA: Fetching primary data for 2025-02.
[2025-10-24T20:29:28.147710] [INFO ] [REMOTE    ] PBH: Fetching primary data for 2025-03.
[2025-10-24T20:29:28.349108] [INFO ] [REMOTE    ] PB: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T20:29:28.643591] [INFO ] [REMOTE    ] PBA: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T20:29:28.947714] [INFO ] [REMOTE    ] PBF: Fetching primary data for 2025-02.
[2025-10-24T20:29:29.593690] [INFO ] [REMOTE    ] PBH: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T20:29:29.747745] [INFO ] [REMOTE    ] PB: Fetching primary data for 2025-05.
[2025-10-24T20:29:30.547678] [INFO ] [REMOTE    ] PBA: Fetching primary data for 2025-03.
[2025-10-24T20:29:30.604011] [INFO ] [REMOTE    ] PBF: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T20:29:30.842405] [INFO ] [REMOTE    ] PB: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T20:29:31.347747] [INFO ] [REMOTE    ] PB: Fetching primary data for 2025-06.
[2025-10-24T20:29:32.147691] [INFO ] [REMOTE    ] PBH: Fetching primary data for 2025-04.
[2025-10-24T20:29:32.472559] [INFO ] [REMOTE    ] PBA: Incremental fetch complete for 2025-03 (1.92 seconds).
[2025-10-24T20:29:32.836311] [INFO ] [REMOTE    ] PB: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T20:29:32.947619] [INFO ] [REMOTE    ] PBA: Fetching primary data for 2025-04.
[2025-10-24T20:29:33.572141] [INFO ] [REMOTE    ] PBH: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T20:29:33.747622] [INFO ] [REMOTE    ] PBH: Fetching primary data for 2025-05.
[2025-10-24T20:29:34.547693] [INFO ] [REMOTE    ] PB: Fetching primary data for 2025-07.
[2025-10-24T20:29:34.678850] [INFO ] [REMOTE    ] PBA: Incremental fetch complete for 2025-04 (1.73 seconds).
[2025-10-24T20:29:35.275452] [INFO ] [REMOTE    ] PBH: Incremental fetch complete for 2025-05 (1.53 seconds).
[2025-10-24T20:29:35.347604] [INFO ] [REMOTE    ] PBH: Fetching primary data for 2025-06.
[2025-10-24T20:29:36.147622] [INFO ] [REMOTE    ] PBA: Fetching primary data for 2025-05.
[2025-10-24T20:29:36.229707] [INFO ] [REMOTE    ] PB: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T20:29:36.661899] [INFO ] [REMOTE    ] PBH: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T20:29:36.947722] [INFO ] [REMOTE    ] PBH: Fetching primary data for 2025-07.
[2025-10-24T20:29:37.747721] [INFO ] [REMOTE    ] PBF: Fetching primary data for 2025-03.
[2025-10-24T20:29:38.335215] [INFO ] [REMOTE    ] PBH: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T20:29:38.473342] [INFO ] [REMOTE    ] PBA: Incremental fetch complete for 2025-05 (2.33 seconds).
[2025-10-24T20:29:38.547608] [INFO ] [REMOTE    ] PBA: Fetching primary data for 2025-06.
[2025-10-24T20:29:39.347619] [INFO ] [REMOTE    ] PBH: Fetching primary data for 2025-08.
[2025-10-24T20:29:39.548201] [INFO ] [REMOTE    ] PBF: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T20:29:40.147617] [INFO ] [REMOTE    ] PB: Fetching primary data for 2025-08.
[2025-10-24T20:29:40.299035] [INFO ] [REMOTE    ] PBA: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T20:29:40.947665] [INFO ] [REMOTE    ] PBF: Fetching primary data for 2025-04.
[2025-10-24T20:29:41.171060] [INFO ] [REMOTE    ] PBH: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T20:29:41.506756] [INFO ] [REMOTE    ] PB: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T20:29:41.747678] [INFO ] [REMOTE    ] PBA: Fetching primary data for 2025-07.
[2025-10-24T20:29:42.547700] [INFO ] [REMOTE    ] PB: Fetching primary data for 2025-09.
[2025-10-24T20:29:42.761507] [INFO ] [REMOTE    ] PBF: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T20:29:43.357691] [INFO ] [REMOTE    ] PBF: Fetching primary data for 2025-05.
[2025-10-24T20:29:43.363539] [INFO ] [REMOTE    ] PBA: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T20:29:43.931632] [INFO ] [REMOTE    ] PB: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T20:29:44.147723] [INFO ] [REMOTE    ] PB: Fetching primary data for 2025-10.
[2025-10-24T20:29:44.947722] [INFO ] [REMOTE    ] PBA: Fetching primary data for 2025-08.
[2025-10-24T20:29:45.378474] [INFO ] [REMOTE    ] PBF: Incremental fetch complete for 2025-05 (2.02 seconds).
[2025-10-24T20:29:45.753002] [INFO ] [REMOTE    ] PBF: Fetching primary data for 2025-06.
[2025-10-24T20:29:45.763225] [INFO ] [REMOTE    ] PB: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T20:29:45.771881] [INFO ] [REMOTE    ] PB: Full fetch complete (59915 records).
[2025-10-24T20:29:45.771983] [DEBUG] [VALIDATOR ] PB: Validating primary data.
[2025-10-24T20:29:46.171938] [DEBUG] [VALIDATOR ] PB: All expected trading days are present.
[2025-10-24T20:29:46.172019] [DEBUG] [VALIDATOR ] PB: Primary data validation passed.
[2025-10-24T20:29:46.172996] [INFO ] [MAIN      ] PB: Fetched primary data is valid.
[2025-10-24T20:29:46.173057] [DEBUG] [LOCAL     ] PB: Saving primary data.
[2025-10-24T20:29:46.173572] [FATAL] [LOCAL     ] PB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:29:46.173700] [FATAL] [MAIN      ] PB: Failed to save primary data.
[2025-10-24T20:29:46.173772] [WARN ] [MAIN      ] PB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:29:46.173858] [INFO ] [LOCAL     ] PB: Starting deletion of primary data.
[2025-10-24T20:29:46.173942] [DEBUG] [LOCAL     ] PB: No primary data file found to delete.
[2025-10-24T20:29:46.173998] [INFO ] [LOCAL     ] PB: Starting deletion of derivative data.
[2025-10-24T20:29:46.174178] [DEBUG] [LOCAL     ] PB: Deleted derivative data file.
[2025-10-24T20:29:46.174274] [INFO ] [MAIN      ] Update Progress: 1632/2366 symbols completed. PB took 29.8s. Estimated remaining: 1h 34m 19s. Rate: 7.8 symbols/min
[2025-10-24T20:29:46.356349] [INFO ] [MAIN      ] PBI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:29:46.401235] [DEBUG] [LOCAL     ] PBI: Loaded 50327 existing records from primary storage.
[2025-10-24T20:29:46.401523] [INFO ] [MAIN      ] PBI: Loaded 50327 existing records.
[2025-10-24T20:29:46.552731] [INFO ] [REMOTE    ] PBH: Fetching primary data for 2025-09.
[2025-10-24T20:29:46.583859] [WARN ] [MAIN      ] PBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:29:46.584142] [INFO ] [MAIN      ] PBI: Wiping existing primary data before full refresh.
[2025-10-24T20:29:46.584298] [INFO ] [LOCAL     ] PBI: Starting deletion of primary data.
[2025-10-24T20:29:46.585289] [DEBUG] [LOCAL     ] PBI: Deleted primary data file.
[2025-10-24T20:29:46.585348] [INFO ] [MAIN      ] PBI: Starting full primary refresh.
[2025-10-24T20:29:46.911403] [INFO ] [REMOTE    ] PBA: Incremental fetch complete for 2025-08 (1.96 seconds).
[2025-10-24T20:29:46.988343] [INFO ] [REMOTE    ] PBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:29:47.347686] [INFO ] [REMOTE    ] PBA: Fetching primary data for 2025-09.
[2025-10-24T20:29:47.574421] [INFO ] [REMOTE    ] PBF: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T20:29:48.137177] [INFO ] [REMOTE    ] PBH: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T20:29:48.147614] [INFO ] [REMOTE    ] PBF: Fetching primary data for 2025-07.
[2025-10-24T20:29:48.947621] [INFO ] [REMOTE    ] PBH: Fetching primary data for 2025-10.
[2025-10-24T20:29:49.225292] [INFO ] [REMOTE    ] PBA: Incremental fetch complete for 2025-09 (1.88 seconds).
[2025-10-24T20:29:49.747632] [INFO ] [REMOTE    ] PBA: Fetching primary data for 2025-10.
[2025-10-24T20:29:49.984752] [INFO ] [REMOTE    ] PBF: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T20:29:50.462197] [INFO ] [REMOTE    ] PBH: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T20:29:50.468244] [INFO ] [REMOTE    ] PBH: Full fetch complete (44830 records).
[2025-10-24T20:29:50.468347] [DEBUG] [VALIDATOR ] PBH: Validating primary data.
[2025-10-24T20:29:50.552752] [INFO ] [REMOTE    ] PBF: Fetching primary data for 2025-08.
[2025-10-24T20:29:50.858766] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present.
[2025-10-24T20:29:50.858882] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed.
[2025-10-24T20:29:50.860485] [INFO ] [MAIN      ] PBH: Fetched primary data is valid.
[2025-10-24T20:29:50.860551] [DEBUG] [LOCAL     ] PBH: Saving primary data.
[2025-10-24T20:29:50.861010] [FATAL] [LOCAL     ] PBH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:29:50.861093] [FATAL] [MAIN      ] PBH: Failed to save primary data.
[2025-10-24T20:29:50.861136] [WARN ] [MAIN      ] PBH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:29:50.861172] [INFO ] [LOCAL     ] PBH: Starting deletion of primary data.
[2025-10-24T20:29:50.861223] [DEBUG] [LOCAL     ] PBH: No primary data file found to delete.
[2025-10-24T20:29:50.861259] [INFO ] [LOCAL     ] PBH: Starting deletion of derivative data.
[2025-10-24T20:29:50.861390] [DEBUG] [LOCAL     ] PBH: Deleted derivative data file.
[2025-10-24T20:29:50.861463] [INFO ] [MAIN      ] Update Progress: 1633/2366 symbols completed. PBH took 27.7s. Estimated remaining: 1h 34m 10s. Rate: 7.8 symbols/min
[2025-10-24T20:29:51.029371] [INFO ] [MAIN      ] PBR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:29:51.083817] [DEBUG] [LOCAL     ] PBR: Loaded 54103 existing records from primary storage.
[2025-10-24T20:29:51.084123] [INFO ] [MAIN      ] PBR: Loaded 54103 existing records.
[2025-10-24T20:29:51.260618] [WARN ] [MAIN      ] PBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:29:51.260970] [INFO ] [MAIN      ] PBR: Wiping existing primary data before full refresh.
[2025-10-24T20:29:51.261050] [INFO ] [LOCAL     ] PBR: Starting deletion of primary data.
[2025-10-24T20:29:51.261589] [DEBUG] [LOCAL     ] PBR: Deleted primary data file.
[2025-10-24T20:29:51.261682] [INFO ] [MAIN      ] PBR: Starting full primary refresh.
[2025-10-24T20:29:51.353530] [INFO ] [REMOTE    ] PBI: Fetching primary data for 2025-01.
[2025-10-24T20:29:51.647713] [INFO ] [REMOTE    ] PBA: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T20:29:51.646412] [INFO ] [REMOTE    ] PBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:29:51.656862] [INFO ] [REMOTE    ] PBA: Full fetch complete (71657 records).
[2025-10-24T20:29:51.656968] [DEBUG] [VALIDATOR ] PBA: Validating primary data.
[2025-10-24T20:29:52.038309] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present.
[2025-10-24T20:29:52.038388] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed.
[2025-10-24T20:29:52.039574] [INFO ] [MAIN      ] PBA: Fetched primary data is valid.
[2025-10-24T20:29:52.039672] [DEBUG] [LOCAL     ] PBA: Saving primary data.
[2025-10-24T20:29:52.040233] [FATAL] [LOCAL     ] PBA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:29:52.040315] [FATAL] [MAIN      ] PBA: Failed to save primary data.
[2025-10-24T20:29:52.040357] [WARN ] [MAIN      ] PBA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:29:52.040416] [INFO ] [LOCAL     ] PBA: Starting deletion of primary data.
[2025-10-24T20:29:52.040474] [DEBUG] [LOCAL     ] PBA: No primary data file found to delete.
[2025-10-24T20:29:52.040510] [INFO ] [LOCAL     ] PBA: Starting deletion of derivative data.
[2025-10-24T20:29:52.040693] [DEBUG] [LOCAL     ] PBA: Deleted derivative data file.
[2025-10-24T20:29:52.041109] [INFO ] [MAIN      ] Update Progress: 1634/2366 symbols completed. PBA took 35.1s. Estimated remaining: 1h 33m 60s. Rate: 7.8 symbols/min
[2025-10-24T20:29:52.152748] [INFO ] [REMOTE    ] PBR: Fetching primary data for 2025-01.
[2025-10-24T20:29:52.212563] [INFO ] [MAIN      ] PBT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:29:52.231127] [DEBUG] [LOCAL     ] PBT: Loaded 17415 existing records from primary storage.
[2025-10-24T20:29:52.231364] [INFO ] [MAIN      ] PBT: Loaded 17415 existing records.
[2025-10-24T20:29:52.413072] [WARN ] [MAIN      ] PBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:29:52.413412] [INFO ] [MAIN      ] PBT: Wiping existing primary data before full refresh.
[2025-10-24T20:29:52.413465] [INFO ] [LOCAL     ] PBT: Starting deletion of primary data.
[2025-10-24T20:29:52.413787] [DEBUG] [LOCAL     ] PBT: Deleted primary data file.
[2025-10-24T20:29:52.413842] [INFO ] [MAIN      ] PBT: Starting full primary refresh.
[2025-10-24T20:29:52.768667] [INFO ] [REMOTE    ] PBT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:29:52.803711] [INFO ] [REMOTE    ] PBF: Incremental fetch complete for 2025-08 (2.25 seconds).
[2025-10-24T20:29:52.841892] [INFO ] [REMOTE    ] PBI: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T20:29:52.947607] [INFO ] [REMOTE    ] PBI: Fetching primary data for 2025-02.
[2025-10-24T20:29:53.747768] [INFO ] [REMOTE    ] PBT: Fetching primary data for 2025-01.
[2025-10-24T20:29:54.242047] [INFO ] [REMOTE    ] PBR: Incremental fetch complete for 2025-01 (2.09 seconds).
[2025-10-24T20:29:54.296633] [INFO ] [REMOTE    ] PBI: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T20:29:54.547630] [INFO ] [REMOTE    ] PBR: Fetching primary data for 2025-02.
[2025-10-24T20:29:54.891843] [INFO ] [REMOTE    ] PBT: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T20:29:55.347687] [INFO ] [REMOTE    ] PBI: Fetching primary data for 2025-03.
[2025-10-24T20:29:56.147696] [INFO ] [REMOTE    ] PBT: Fetching primary data for 2025-02.
[2025-10-24T20:29:56.543857] [INFO ] [REMOTE    ] PBR: Incremental fetch complete for 2025-02 (2.00 seconds).
[2025-10-24T20:29:56.947616] [INFO ] [REMOTE    ] PBR: Fetching primary data for 2025-03.
[2025-10-24T20:29:57.215930] [INFO ] [REMOTE    ] PBI: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T20:29:57.258830] [INFO ] [REMOTE    ] PBT: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T20:29:57.747625] [INFO ] [REMOTE    ] PBI: Fetching primary data for 2025-04.
[2025-10-24T20:29:58.547612] [INFO ] [REMOTE    ] PBT: Fetching primary data for 2025-03.
[2025-10-24T20:29:59.015175] [INFO ] [REMOTE    ] PBR: Incremental fetch complete for 2025-03 (2.07 seconds).
[2025-10-24T20:29:59.347611] [INFO ] [REMOTE    ] PBR: Fetching primary data for 2025-04.
[2025-10-24T20:29:59.509152] [INFO ] [REMOTE    ] PBI: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T20:29:59.687429] [INFO ] [REMOTE    ] PBT: Incremental fetch complete for 2025-03 (1.14 seconds).
[2025-10-24T20:30:00.147728] [INFO ] [REMOTE    ] PBI: Fetching primary data for 2025-05.
[2025-10-24T20:30:00.947714] [INFO ] [REMOTE    ] PBF: Fetching primary data for 2025-09.
[2025-10-24T20:30:01.548237] [INFO ] [REMOTE    ] PBR: Incremental fetch complete for 2025-04 (2.20 seconds).
[2025-10-24T20:30:01.747701] [INFO ] [REMOTE    ] PBT: Fetching primary data for 2025-04.
[2025-10-24T20:30:02.187899] [INFO ] [REMOTE    ] PBI: Incremental fetch complete for 2025-05 (2.04 seconds).
[2025-10-24T20:30:02.547701] [INFO ] [REMOTE    ] PBR: Fetching primary data for 2025-05.
[2025-10-24T20:30:02.704694] [INFO ] [REMOTE    ] PBF: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T20:30:02.806500] [INFO ] [REMOTE    ] PBT: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T20:30:03.347683] [INFO ] [REMOTE    ] PBF: Fetching primary data for 2025-10.
[2025-10-24T20:30:04.147728] [INFO ] [REMOTE    ] PBT: Fetching primary data for 2025-05.
[2025-10-24T20:30:04.947719] [INFO ] [REMOTE    ] PBI: Fetching primary data for 2025-06.
[2025-10-24T20:30:05.214068] [INFO ] [REMOTE    ] PBR: Incremental fetch complete for 2025-05 (2.67 seconds).
[2025-10-24T20:30:05.414673] [INFO ] [REMOTE    ] PBT: Incremental fetch complete for 2025-05 (1.27 seconds).
[2025-10-24T20:30:05.747701] [INFO ] [REMOTE    ] PBR: Fetching primary data for 2025-06.
[2025-10-24T20:30:05.881505] [INFO ] [REMOTE    ] PBF: Incremental fetch complete for 2025-10 (2.53 seconds).
[2025-10-24T20:30:05.891007] [INFO ] [REMOTE    ] PBF: Full fetch complete (76756 records).
[2025-10-24T20:30:05.891133] [DEBUG] [VALIDATOR ] PBF: Validating primary data.
[2025-10-24T20:30:06.278025] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present.
[2025-10-24T20:30:06.278093] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed.
[2025-10-24T20:30:06.279219] [INFO ] [MAIN      ] PBF: Fetched primary data is valid.
[2025-10-24T20:30:06.279283] [DEBUG] [LOCAL     ] PBF: Saving primary data.
[2025-10-24T20:30:06.280332] [FATAL] [LOCAL     ] PBF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:30:06.280416] [FATAL] [MAIN      ] PBF: Failed to save primary data.
[2025-10-24T20:30:06.280459] [WARN ] [MAIN      ] PBF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:30:06.280524] [INFO ] [LOCAL     ] PBF: Starting deletion of primary data.
[2025-10-24T20:30:06.280583] [DEBUG] [LOCAL     ] PBF: No primary data file found to delete.
[2025-10-24T20:30:06.280619] [INFO ] [LOCAL     ] PBF: Starting deletion of derivative data.
[2025-10-24T20:30:06.280823] [DEBUG] [LOCAL     ] PBF: Deleted derivative data file.
[2025-10-24T20:30:06.281543] [INFO ] [MAIN      ] Update Progress: 1635/2366 symbols completed. PBF took 44.3s. Estimated remaining: 1h 33m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:30:06.479569] [INFO ] [MAIN      ] PCF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:30:06.492556] [DEBUG] [LOCAL     ] PCF: Loaded 9131 existing records from primary storage.
[2025-10-24T20:30:06.492828] [INFO ] [MAIN      ] PCF: Loaded 9131 existing records.
[2025-10-24T20:30:06.558593] [INFO ] [REMOTE    ] PBT: Fetching primary data for 2025-06.
[2025-10-24T20:30:06.676243] [WARN ] [MAIN      ] PCF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:30:06.676599] [INFO ] [MAIN      ] PCF: Wiping existing primary data before full refresh.
[2025-10-24T20:30:06.676811] [INFO ] [LOCAL     ] PCF: Starting deletion of primary data.
[2025-10-24T20:30:06.677097] [DEBUG] [LOCAL     ] PCF: Deleted primary data file.
[2025-10-24T20:30:06.677192] [INFO ] [MAIN      ] PCF: Starting full primary refresh.
[2025-10-24T20:30:06.925748] [INFO ] [REMOTE    ] PBI: Incremental fetch complete for 2025-06 (1.98 seconds).
[2025-10-24T20:30:07.073217] [INFO ] [REMOTE    ] PCF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:30:07.347712] [INFO ] [REMOTE    ] PCF: Fetching primary data for 2025-01.
[2025-10-24T20:30:07.981509] [INFO ] [REMOTE    ] PBT: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T20:30:08.129961] [INFO ] [REMOTE    ] PBR: Incremental fetch complete for 2025-06 (2.38 seconds).
[2025-10-24T20:30:08.147619] [INFO ] [REMOTE    ] PBT: Fetching primary data for 2025-07.
[2025-10-24T20:30:08.188950] [INFO ] [REMOTE    ] PCF: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T20:30:08.947708] [INFO ] [REMOTE    ] PBI: Fetching primary data for 2025-07.
[2025-10-24T20:30:09.320558] [INFO ] [REMOTE    ] PBT: Incremental fetch complete for 2025-07 (1.17 seconds).
[2025-10-24T20:30:09.747638] [INFO ] [REMOTE    ] PCF: Fetching primary data for 2025-02.
[2025-10-24T20:30:10.547623] [INFO ] [REMOTE    ] PBR: Fetching primary data for 2025-07.
[2025-10-24T20:30:10.710627] [INFO ] [REMOTE    ] PCF: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T20:30:10.818792] [INFO ] [REMOTE    ] PBI: Incremental fetch complete for 2025-07 (1.87 seconds).
[2025-10-24T20:30:11.347661] [INFO ] [REMOTE    ] PBI: Fetching primary data for 2025-08.
[2025-10-24T20:30:12.147720] [INFO ] [REMOTE    ] PCF: Fetching primary data for 2025-03.
[2025-10-24T20:30:12.760763] [INFO ] [REMOTE    ] PCF: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T20:30:12.760526] [INFO ] [REMOTE    ] PBR: Incremental fetch complete for 2025-07 (2.21 seconds).
[2025-10-24T20:30:12.947605] [INFO ] [REMOTE    ] PBR: Fetching primary data for 2025-08.
[2025-10-24T20:30:13.305321] [INFO ] [REMOTE    ] PBI: Incremental fetch complete for 2025-08 (1.96 seconds).
[2025-10-24T20:30:13.747636] [INFO ] [REMOTE    ] PCF: Fetching primary data for 2025-04.
[2025-10-24T20:30:14.547688] [INFO ] [REMOTE    ] PBI: Fetching primary data for 2025-09.
[2025-10-24T20:30:14.637721] [INFO ] [REMOTE    ] PCF: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T20:30:15.029080] [INFO ] [REMOTE    ] PBR: Incremental fetch complete for 2025-08 (2.08 seconds).
[2025-10-24T20:30:15.347637] [INFO ] [REMOTE    ] PBR: Fetching primary data for 2025-09.
[2025-10-24T20:30:16.147631] [INFO ] [REMOTE    ] PBT: Fetching primary data for 2025-08.
[2025-10-24T20:30:16.404431] [INFO ] [REMOTE    ] PBI: Incremental fetch complete for 2025-09 (1.86 seconds).
[2025-10-24T20:30:16.947624] [INFO ] [REMOTE    ] PCF: Fetching primary data for 2025-05.
[2025-10-24T20:30:17.247862] [INFO ] [REMOTE    ] PBR: Incremental fetch complete for 2025-09 (1.90 seconds).
[2025-10-24T20:30:17.248960] [INFO ] [REMOTE    ] PBT: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T20:30:17.747693] [INFO ] [REMOTE    ] PBR: Fetching primary data for 2025-10.
[2025-10-24T20:30:17.873448] [INFO ] [REMOTE    ] PCF: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T20:30:18.547689] [INFO ] [REMOTE    ] PBT: Fetching primary data for 2025-09.
[2025-10-24T20:30:19.347677] [INFO ] [REMOTE    ] PCF: Fetching primary data for 2025-06.
[2025-10-24T20:30:19.608307] [INFO ] [REMOTE    ] PBT: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T20:30:20.075552] [INFO ] [REMOTE    ] PBR: Incremental fetch complete for 2025-10 (2.33 seconds).
[2025-10-24T20:30:20.085471] [INFO ] [REMOTE    ] PBR: Full fetch complete (77882 records).
[2025-10-24T20:30:20.085629] [DEBUG] [VALIDATOR ] PBR: Validating primary data.
[2025-10-24T20:30:20.149734] [INFO ] [REMOTE    ] PBI: Fetching primary data for 2025-10.
[2025-10-24T20:30:20.369401] [INFO ] [REMOTE    ] PCF: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T20:30:20.485436] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present.
[2025-10-24T20:30:20.485528] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed.
[2025-10-24T20:30:20.486768] [INFO ] [MAIN      ] PBR: Fetched primary data is valid.
[2025-10-24T20:30:20.486851] [DEBUG] [LOCAL     ] PBR: Saving primary data.
[2025-10-24T20:30:20.487568] [FATAL] [LOCAL     ] PBR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:30:20.487688] [FATAL] [MAIN      ] PBR: Failed to save primary data.
[2025-10-24T20:30:20.487742] [WARN ] [MAIN      ] PBR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:30:20.487810] [INFO ] [LOCAL     ] PBR: Starting deletion of primary data.
[2025-10-24T20:30:20.487874] [DEBUG] [LOCAL     ] PBR: No primary data file found to delete.
[2025-10-24T20:30:20.487912] [INFO ] [LOCAL     ] PBR: Starting deletion of derivative data.
[2025-10-24T20:30:20.488199] [DEBUG] [LOCAL     ] PBR: Deleted derivative data file.
[2025-10-24T20:30:20.488948] [INFO ] [MAIN      ] Update Progress: 1636/2366 symbols completed. PBR took 29.6s. Estimated remaining: 1h 33m 50s. Rate: 7.8 symbols/min
[2025-10-24T20:30:20.662757] [INFO ] [MAIN      ] PCG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:30:20.714579] [DEBUG] [LOCAL     ] PCG: Loaded 54109 existing records from primary storage.
[2025-10-24T20:30:20.714926] [INFO ] [MAIN      ] PCG: Loaded 54109 existing records.
[2025-10-24T20:30:20.894022] [WARN ] [MAIN      ] PCG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:30:20.894245] [INFO ] [MAIN      ] PCG: Wiping existing primary data before full refresh.
[2025-10-24T20:30:20.894291] [INFO ] [LOCAL     ] PCG: Starting deletion of primary data.
[2025-10-24T20:30:20.894981] [DEBUG] [LOCAL     ] PCG: Deleted primary data file.
[2025-10-24T20:30:20.895037] [INFO ] [MAIN      ] PCG: Starting full primary refresh.
[2025-10-24T20:30:20.958789] [INFO ] [REMOTE    ] PBT: Fetching primary data for 2025-10.
[2025-10-24T20:30:21.261518] [INFO ] [REMOTE    ] PCG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:30:21.747626] [INFO ] [REMOTE    ] PCG: Fetching primary data for 2025-01.
[2025-10-24T20:30:22.040781] [INFO ] [REMOTE    ] PBI: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T20:30:22.050361] [INFO ] [REMOTE    ] PBI: Full fetch complete (72427 records).
[2025-10-24T20:30:22.050562] [DEBUG] [VALIDATOR ] PBI: Validating primary data.
[2025-10-24T20:30:22.179124] [INFO ] [REMOTE    ] PBT: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T20:30:22.223713] [INFO ] [REMOTE    ] PBT: Full fetch complete (24495 records).
[2025-10-24T20:30:22.226223] [DEBUG] [VALIDATOR ] PBT: Validating primary data.
[2025-10-24T20:30:22.568091] [INFO ] [REMOTE    ] PCF: Fetching primary data for 2025-07.
[2025-10-24T20:30:22.698434] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present.
[2025-10-24T20:30:22.710921] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed.
[2025-10-24T20:30:22.721461] [INFO ] [MAIN      ] PBI: Fetched primary data is valid.
[2025-10-24T20:30:22.733781] [DEBUG] [LOCAL     ] PBI: Saving primary data.
[2025-10-24T20:30:22.750465] [FATAL] [LOCAL     ] PBI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:30:22.761783] [FATAL] [MAIN      ] PBI: Failed to save primary data.
[2025-10-24T20:30:22.761867] [WARN ] [MAIN      ] PBI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:30:22.767525] [INFO ] [LOCAL     ] PBI: Starting deletion of primary data.
[2025-10-24T20:30:22.777856] [DEBUG] [LOCAL     ] PBI: No primary data file found to delete.
[2025-10-24T20:30:22.783040] [INFO ] [LOCAL     ] PBI: Starting deletion of derivative data.
[2025-10-24T20:30:22.810707] [DEBUG] [LOCAL     ] PBI: Deleted derivative data file.
[2025-10-24T20:30:22.818427] [INFO ] [MAIN      ] Update Progress: 1637/2366 symbols completed. PBI took 36.6s. Estimated remaining: 1h 33m 40s. Rate: 7.8 symbols/min
[2025-10-24T20:30:22.844332] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present.
[2025-10-24T20:30:22.844391] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed.
[2025-10-24T20:30:22.844638] [INFO ] [MAIN      ] PBT: Fetched primary data is valid.
[2025-10-24T20:30:22.844716] [DEBUG] [LOCAL     ] PBT: Saving primary data.
[2025-10-24T20:30:22.844974] [FATAL] [LOCAL     ] PBT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:30:22.845051] [FATAL] [MAIN      ] PBT: Failed to save primary data.
[2025-10-24T20:30:22.845092] [WARN ] [MAIN      ] PBT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:30:22.845150] [INFO ] [LOCAL     ] PBT: Starting deletion of primary data.
[2025-10-24T20:30:22.845206] [DEBUG] [LOCAL     ] PBT: No primary data file found to delete.
[2025-10-24T20:30:22.845241] [INFO ] [LOCAL     ] PBT: Starting deletion of derivative data.
[2025-10-24T20:30:22.845388] [DEBUG] [LOCAL     ] PBT: Deleted derivative data file.
[2025-10-24T20:30:22.845459] [INFO ] [MAIN      ] Update Progress: 1638/2366 symbols completed. PBT took 30.8s. Estimated remaining: 1h 33m 29s. Rate: 7.8 symbols/min
[2025-10-24T20:30:23.631053] [INFO ] [REMOTE    ] PCG: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T20:30:23.641922] [INFO ] [REMOTE    ] PCG: Fetching primary data for 2025-02.
[2025-10-24T20:30:23.706852] [INFO ] [REMOTE    ] PCF: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T20:30:24.147685] [INFO ] [REMOTE    ] PCF: Fetching primary data for 2025-08.
[2025-10-24T20:30:25.160663] [INFO ] [REMOTE    ] PCF: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T20:30:25.162991] [INFO ] [REMOTE    ] PCF: Fetching primary data for 2025-09.
[2025-10-24T20:30:25.624133] [INFO ] [REMOTE    ] PCG: Incremental fetch complete for 2025-02 (1.98 seconds).
[2025-10-24T20:30:25.747613] [INFO ] [REMOTE    ] PCG: Fetching primary data for 2025-03.
[2025-10-24T20:30:26.208045] [INFO ] [REMOTE    ] PCF: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T20:30:26.547639] [INFO ] [REMOTE    ] PCF: Fetching primary data for 2025-10.
[2025-10-24T20:30:27.512116] [INFO ] [REMOTE    ] PCF: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T20:30:27.514771] [INFO ] [REMOTE    ] PCF: Full fetch complete (13392 records).
[2025-10-24T20:30:27.514869] [DEBUG] [VALIDATOR ] PCF: Validating primary data.
[2025-10-24T20:30:27.893621] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present.
[2025-10-24T20:30:27.893759] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed.
[2025-10-24T20:30:27.894110] [INFO ] [MAIN      ] PCF: Fetched primary data is valid.
[2025-10-24T20:30:27.894274] [DEBUG] [LOCAL     ] PCF: Saving primary data.
[2025-10-24T20:30:27.894546] [FATAL] [LOCAL     ] PCF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:30:27.894628] [FATAL] [MAIN      ] PCF: Failed to save primary data.
[2025-10-24T20:30:27.894724] [WARN ] [MAIN      ] PCF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:30:27.894793] [INFO ] [LOCAL     ] PCF: Starting deletion of primary data.
[2025-10-24T20:30:27.894853] [DEBUG] [LOCAL     ] PCF: No primary data file found to delete.
[2025-10-24T20:30:27.894892] [INFO ] [LOCAL     ] PCF: Starting deletion of derivative data.
[2025-10-24T20:30:27.895036] [DEBUG] [LOCAL     ] PCF: Deleted derivative data file.
[2025-10-24T20:30:27.895108] [INFO ] [MAIN      ] Update Progress: 1639/2366 symbols completed. PCF took 21.6s. Estimated remaining: 1h 33m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:30:27.925357] [INFO ] [REMOTE    ] PCG: Incremental fetch complete for 2025-03 (2.18 seconds).
[2025-10-24T20:30:27.936496] [INFO ] [REMOTE    ] PCG: Fetching primary data for 2025-04.
[2025-10-24T20:30:30.033286] [INFO ] [REMOTE    ] PCG: Incremental fetch complete for 2025-04 (2.10 seconds).
[2025-10-24T20:30:30.044462] [INFO ] [REMOTE    ] PCG: Fetching primary data for 2025-05.
[2025-10-24T20:30:32.155115] [INFO ] [REMOTE    ] PCG: Incremental fetch complete for 2025-05 (2.11 seconds).
[2025-10-24T20:30:32.167167] [INFO ] [REMOTE    ] PCG: Fetching primary data for 2025-06.
[2025-10-24T20:30:34.189992] [INFO ] [REMOTE    ] PCG: Incremental fetch complete for 2025-06 (2.02 seconds).
[2025-10-24T20:30:34.204124] [INFO ] [REMOTE    ] PCG: Fetching primary data for 2025-07.
[2025-10-24T20:30:36.256074] [INFO ] [REMOTE    ] PCG: Incremental fetch complete for 2025-07 (2.05 seconds).
[2025-10-24T20:30:36.268855] [INFO ] [REMOTE    ] PCG: Fetching primary data for 2025-08.
[2025-10-24T20:30:38.373129] [INFO ] [REMOTE    ] PCG: Incremental fetch complete for 2025-08 (2.10 seconds).
[2025-10-24T20:30:38.384808] [INFO ] [REMOTE    ] PCG: Fetching primary data for 2025-09.
[2025-10-24T20:30:40.482982] [INFO ] [REMOTE    ] PCG: Incremental fetch complete for 2025-09 (2.10 seconds).
[2025-10-24T20:30:40.494515] [INFO ] [REMOTE    ] PCG: Fetching primary data for 2025-10.
[2025-10-24T20:30:42.629687] [INFO ] [REMOTE    ] PCG: Incremental fetch complete for 2025-10 (2.14 seconds).
[2025-10-24T20:30:42.639818] [INFO ] [REMOTE    ] PCG: Full fetch complete (77898 records).
[2025-10-24T20:30:42.639968] [DEBUG] [VALIDATOR ] PCG: Validating primary data.
[2025-10-24T20:30:43.027453] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present.
[2025-10-24T20:30:43.027543] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed.
[2025-10-24T20:30:43.028732] [INFO ] [MAIN      ] PCG: Fetched primary data is valid.
[2025-10-24T20:30:43.028798] [DEBUG] [LOCAL     ] PCG: Saving primary data.
[2025-10-24T20:30:43.029409] [FATAL] [LOCAL     ] PCG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:30:43.029497] [FATAL] [MAIN      ] PCG: Failed to save primary data.
[2025-10-24T20:30:43.029539] [WARN ] [MAIN      ] PCG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:30:43.029573] [INFO ] [LOCAL     ] PCG: Starting deletion of primary data.
[2025-10-24T20:30:43.029624] [DEBUG] [LOCAL     ] PCG: No primary data file found to delete.
[2025-10-24T20:30:43.029693] [INFO ] [LOCAL     ] PCG: Starting deletion of derivative data.
[2025-10-24T20:30:43.029866] [DEBUG] [LOCAL     ] PCG: Deleted derivative data file.
[2025-10-24T20:30:43.030157] [INFO ] [MAIN      ] Update Progress: 1640/2366 symbols completed. PCG took 22.5s. Estimated remaining: 1h 33m 16s. Rate: 7.8 symbols/min
[2025-10-24T20:30:43.642705] [INFO ] [MAIN      ] PCOR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:30:43.698365] [INFO ] [MAIN      ] PCQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:30:43.755834] [INFO ] [MAIN      ] PCN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:30:43.759731] [INFO ] [MAIN      ] PCM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:30:43.778167] [DEBUG] [LOCAL     ] PCM: Loaded 6946 existing records from primary storage.
[2025-10-24T20:30:43.778685] [INFO ] [MAIN      ] PCM: Loaded 6946 existing records.
[2025-10-24T20:30:43.808414] [DEBUG] [LOCAL     ] PCQ: Loaded 12163 existing records from primary storage.
[2025-10-24T20:30:43.830265] [INFO ] [MAIN      ] PCQ: Loaded 12163 existing records.
[2025-10-24T20:30:43.990053] [DEBUG] [LOCAL     ] PCN: Loaded 25543 existing records from primary storage.
[2025-10-24T20:30:44.054569] [INFO ] [MAIN      ] PCN: Loaded 25543 existing records.
[2025-10-24T20:30:44.202800] [DEBUG] [LOCAL     ] PCOR: Loaded 47684 existing records from primary storage.
[2025-10-24T20:30:44.191510] [WARN ] [MAIN      ] PCM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:30:44.241786] [INFO ] [MAIN      ] PCM: Wiping existing primary data before full refresh.
[2025-10-24T20:30:44.298818] [WARN ] [MAIN      ] PCQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:30:44.304052] [INFO ] [LOCAL     ] PCM: Starting deletion of primary data.
[2025-10-24T20:30:44.304305] [INFO ] [MAIN      ] PCOR: Loaded 47684 existing records.
[2025-10-24T20:30:44.347680] [INFO ] [MAIN      ] PCQ: Wiping existing primary data before full refresh.
[2025-10-24T20:30:44.347729] [DEBUG] [LOCAL     ] PCM: Deleted primary data file.
[2025-10-24T20:30:44.372844] [INFO ] [LOCAL     ] PCQ: Starting deletion of primary data.
[2025-10-24T20:30:44.412484] [DEBUG] [LOCAL     ] PCQ: Deleted primary data file.
[2025-10-24T20:30:44.412629] [INFO ] [MAIN      ] PCM: Starting full primary refresh.
[2025-10-24T20:30:44.412757] [INFO ] [MAIN      ] PCQ: Starting full primary refresh.
[2025-10-24T20:30:44.696609] [WARN ] [MAIN      ] PCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:30:44.748186] [INFO ] [MAIN      ] PCN: Wiping existing primary data before full refresh.
[2025-10-24T20:30:44.770930] [INFO ] [LOCAL     ] PCN: Starting deletion of primary data.
[2025-10-24T20:30:44.836397] [WARN ] [MAIN      ] PCOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:30:44.867494] [INFO ] [MAIN      ] PCOR: Wiping existing primary data before full refresh.
[2025-10-24T20:30:44.873129] [INFO ] [LOCAL     ] PCOR: Starting deletion of primary data.
[2025-10-24T20:30:44.905000] [DEBUG] [LOCAL     ] PCN: Deleted primary data file.
[2025-10-24T20:30:44.915527] [DEBUG] [LOCAL     ] PCOR: Deleted primary data file.
[2025-10-24T20:30:44.917029] [INFO ] [MAIN      ] PCOR: Starting full primary refresh.
[2025-10-24T20:30:44.917147] [INFO ] [MAIN      ] PCN: Starting full primary refresh.
[2025-10-24T20:30:45.761432] [INFO ] [REMOTE    ] PCM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:30:45.811797] [INFO ] [REMOTE    ] PCM: Fetching primary data for 2025-01.
[2025-10-24T20:30:45.903415] [INFO ] [REMOTE    ] PCQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:30:45.943515] [INFO ] [REMOTE    ] PCQ: Fetching primary data for 2025-01.
[2025-10-24T20:30:46.069950] [INFO ] [REMOTE    ] PCN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:30:46.070632] [INFO ] [REMOTE    ] PCN: Fetching primary data for 2025-01.
[2025-10-24T20:30:46.156315] [INFO ] [REMOTE    ] PCOR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:30:46.156633] [INFO ] [REMOTE    ] PCOR: Fetching primary data for 2025-01.
[2025-10-24T20:30:46.908370] [INFO ] [REMOTE    ] PCM: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T20:30:46.911252] [INFO ] [REMOTE    ] PCM: Fetching primary data for 2025-02.
[2025-10-24T20:30:46.997477] [INFO ] [REMOTE    ] PCQ: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T20:30:47.000144] [INFO ] [REMOTE    ] PCQ: Fetching primary data for 2025-02.
[2025-10-24T20:30:47.534273] [INFO ] [REMOTE    ] PCN: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T20:30:47.538994] [INFO ] [REMOTE    ] PCN: Fetching primary data for 2025-02.
[2025-10-24T20:30:47.631897] [INFO ] [REMOTE    ] PCM: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:30:47.633888] [INFO ] [REMOTE    ] PCM: Fetching primary data for 2025-03.
[2025-10-24T20:30:47.747296] [INFO ] [REMOTE    ] PCOR: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T20:30:47.756329] [INFO ] [REMOTE    ] PCOR: Fetching primary data for 2025-02.
[2025-10-24T20:30:47.852008] [INFO ] [REMOTE    ] PCQ: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T20:30:47.854445] [INFO ] [REMOTE    ] PCQ: Fetching primary data for 2025-03.
[2025-10-24T20:30:48.483448] [INFO ] [REMOTE    ] PCM: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T20:30:48.485446] [INFO ] [REMOTE    ] PCM: Fetching primary data for 2025-04.
[2025-10-24T20:30:48.594119] [INFO ] [REMOTE    ] PCQ: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T20:30:48.597031] [INFO ] [REMOTE    ] PCQ: Fetching primary data for 2025-04.
[2025-10-24T20:30:48.671961] [INFO ] [REMOTE    ] PCN: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T20:30:48.676471] [INFO ] [REMOTE    ] PCN: Fetching primary data for 2025-03.
[2025-10-24T20:30:49.252891] [INFO ] [REMOTE    ] PCM: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T20:30:49.255095] [INFO ] [REMOTE    ] PCM: Fetching primary data for 2025-05.
[2025-10-24T20:30:49.564000] [INFO ] [REMOTE    ] PCOR: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T20:30:49.575426] [INFO ] [REMOTE    ] PCOR: Fetching primary data for 2025-03.
[2025-10-24T20:30:49.740369] [INFO ] [REMOTE    ] PCQ: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T20:30:49.744340] [INFO ] [REMOTE    ] PCQ: Fetching primary data for 2025-05.
[2025-10-24T20:30:49.855085] [INFO ] [REMOTE    ] PCN: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T20:30:49.862567] [INFO ] [REMOTE    ] PCN: Fetching primary data for 2025-04.
[2025-10-24T20:30:49.866224] [INFO ] [REMOTE    ] PCM: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T20:30:49.868500] [INFO ] [REMOTE    ] PCM: Fetching primary data for 2025-06.
[2025-10-24T20:30:50.385692] [INFO ] [REMOTE    ] PCQ: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T20:30:50.388489] [INFO ] [REMOTE    ] PCQ: Fetching primary data for 2025-06.
[2025-10-24T20:30:50.752566] [INFO ] [REMOTE    ] PCM: Incremental fetch complete for 2025-06 (0.88 seconds).
[2025-10-24T20:30:50.754821] [INFO ] [REMOTE    ] PCM: Fetching primary data for 2025-07.
[2025-10-24T20:30:51.158232] [INFO ] [REMOTE    ] PCN: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T20:30:51.164523] [INFO ] [REMOTE    ] PCN: Fetching primary data for 2025-05.
[2025-10-24T20:30:51.191222] [INFO ] [REMOTE    ] PCQ: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T20:30:51.193774] [INFO ] [REMOTE    ] PCQ: Fetching primary data for 2025-07.
[2025-10-24T20:30:51.239374] [INFO ] [REMOTE    ] PCOR: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T20:30:51.250037] [INFO ] [REMOTE    ] PCOR: Fetching primary data for 2025-04.
[2025-10-24T20:30:51.513458] [INFO ] [REMOTE    ] PCM: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T20:30:51.515462] [INFO ] [REMOTE    ] PCM: Fetching primary data for 2025-08.
[2025-10-24T20:30:52.126235] [INFO ] [REMOTE    ] PCQ: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T20:30:52.147601] [INFO ] [REMOTE    ] PCQ: Fetching primary data for 2025-08.
[2025-10-24T20:30:52.251599] [INFO ] [REMOTE    ] PCM: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T20:30:52.331369] [INFO ] [REMOTE    ] PCN: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T20:30:52.686421] [INFO ] [REMOTE    ] PCOR: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T20:30:52.947627] [INFO ] [REMOTE    ] PCOR: Fetching primary data for 2025-05.
[2025-10-24T20:30:53.038038] [INFO ] [REMOTE    ] PCQ: Incremental fetch complete for 2025-08 (0.89 seconds).
[2025-10-24T20:30:53.747668] [INFO ] [REMOTE    ] PCM: Fetching primary data for 2025-09.
[2025-10-24T20:30:54.459524] [INFO ] [REMOTE    ] PCOR: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T20:30:54.547611] [INFO ] [REMOTE    ] PCOR: Fetching primary data for 2025-06.
[2025-10-24T20:30:54.633410] [INFO ] [REMOTE    ] PCM: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T20:30:55.347711] [INFO ] [REMOTE    ] PCM: Fetching primary data for 2025-10.
[2025-10-24T20:30:56.000696] [INFO ] [REMOTE    ] PCOR: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T20:30:56.147625] [INFO ] [REMOTE    ] PCOR: Fetching primary data for 2025-07.
[2025-10-24T20:30:56.307833] [INFO ] [REMOTE    ] PCM: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T20:30:56.309723] [INFO ] [REMOTE    ] PCM: Full fetch complete (10205 records).
[2025-10-24T20:30:56.309791] [DEBUG] [VALIDATOR ] PCM: Validating primary data.
[2025-10-24T20:30:56.673822] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present.
[2025-10-24T20:30:56.673927] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed.
[2025-10-24T20:30:56.674212] [INFO ] [MAIN      ] PCM: Fetched primary data is valid.
[2025-10-24T20:30:56.674271] [DEBUG] [LOCAL     ] PCM: Saving primary data.
[2025-10-24T20:30:56.674483] [FATAL] [LOCAL     ] PCM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:30:56.674566] [FATAL] [MAIN      ] PCM: Failed to save primary data.
[2025-10-24T20:30:56.674606] [WARN ] [MAIN      ] PCM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:30:56.674660] [INFO ] [LOCAL     ] PCM: Starting deletion of primary data.
[2025-10-24T20:30:56.674734] [DEBUG] [LOCAL     ] PCM: No primary data file found to delete.
[2025-10-24T20:30:56.674780] [INFO ] [LOCAL     ] PCM: Starting deletion of derivative data.
[2025-10-24T20:30:56.674971] [DEBUG] [LOCAL     ] PCM: Deleted derivative data file.
[2025-10-24T20:30:56.675100] [INFO ] [MAIN      ] Update Progress: 1641/2366 symbols completed. PCM took 13.6s. Estimated remaining: 1h 33m 10s. Rate: 7.8 symbols/min
[2025-10-24T20:30:56.842365] [INFO ] [MAIN      ] PD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:30:56.888627] [DEBUG] [LOCAL     ] PD: Loaded 48648 existing records from primary storage.
[2025-10-24T20:30:56.889144] [INFO ] [MAIN      ] PD: Loaded 48648 existing records.
[2025-10-24T20:30:56.952779] [INFO ] [REMOTE    ] PCN: Fetching primary data for 2025-06.
[2025-10-24T20:30:57.067250] [WARN ] [MAIN      ] PD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:30:57.067479] [INFO ] [MAIN      ] PD: Wiping existing primary data before full refresh.
[2025-10-24T20:30:57.067525] [INFO ] [LOCAL     ] PD: Starting deletion of primary data.
[2025-10-24T20:30:57.067978] [DEBUG] [LOCAL     ] PD: Deleted primary data file.
[2025-10-24T20:30:57.068035] [INFO ] [MAIN      ] PD: Starting full primary refresh.
[2025-10-24T20:30:57.417947] [INFO ] [REMOTE    ] PD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:30:57.747626] [INFO ] [REMOTE    ] PD: Fetching primary data for 2025-01.
[2025-10-24T20:30:57.880813] [INFO ] [REMOTE    ] PCOR: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T20:30:57.905171] [INFO ] [REMOTE    ] PCN: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T20:30:58.547638] [INFO ] [REMOTE    ] PCOR: Fetching primary data for 2025-08.
[2025-10-24T20:30:59.338261] [INFO ] [REMOTE    ] PD: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T20:30:59.347607] [INFO ] [REMOTE    ] PD: Fetching primary data for 2025-02.
[2025-10-24T20:31:00.147679] [INFO ] [REMOTE    ] PCN: Fetching primary data for 2025-07.
[2025-10-24T20:31:00.265458] [INFO ] [REMOTE    ] PCOR: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T20:31:00.947635] [INFO ] [REMOTE    ] PCOR: Fetching primary data for 2025-09.
[2025-10-24T20:31:01.021526] [INFO ] [REMOTE    ] PD: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T20:31:01.461762] [INFO ] [REMOTE    ] PCN: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T20:31:01.747716] [INFO ] [REMOTE    ] PCQ: Fetching primary data for 2025-09.
[2025-10-24T20:31:02.547729] [INFO ] [REMOTE    ] PCN: Fetching primary data for 2025-08.
[2025-10-24T20:31:02.969487] [INFO ] [REMOTE    ] PCOR: Incremental fetch complete for 2025-09 (2.02 seconds).
[2025-10-24T20:31:03.001600] [INFO ] [REMOTE    ] PCQ: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T20:31:03.347725] [INFO ] [REMOTE    ] PCOR: Fetching primary data for 2025-10.
[2025-10-24T20:31:03.845054] [INFO ] [REMOTE    ] PCN: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T20:31:04.147743] [INFO ] [REMOTE    ] PCN: Fetching primary data for 2025-09.
[2025-10-24T20:31:04.947618] [INFO ] [REMOTE    ] PCQ: Fetching primary data for 2025-10.
[2025-10-24T20:31:05.136910] [INFO ] [REMOTE    ] PCOR: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T20:31:05.145508] [INFO ] [REMOTE    ] PCOR: Full fetch complete (69127 records).
[2025-10-24T20:31:05.145668] [DEBUG] [VALIDATOR ] PCOR: Validating primary data.
[2025-10-24T20:31:05.318960] [INFO ] [REMOTE    ] PCN: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T20:31:05.565973] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present.
[2025-10-24T20:31:05.566093] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed.
[2025-10-24T20:31:05.567387] [INFO ] [MAIN      ] PCOR: Fetched primary data is valid.
[2025-10-24T20:31:05.567454] [DEBUG] [LOCAL     ] PCOR: Saving primary data.
[2025-10-24T20:31:05.568099] [FATAL] [LOCAL     ] PCOR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:31:05.568183] [FATAL] [MAIN      ] PCOR: Failed to save primary data.
[2025-10-24T20:31:05.568268] [WARN ] [MAIN      ] PCOR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:31:05.568337] [INFO ] [LOCAL     ] PCOR: Starting deletion of primary data.
[2025-10-24T20:31:05.568402] [DEBUG] [LOCAL     ] PCOR: No primary data file found to delete.
[2025-10-24T20:31:05.568438] [INFO ] [LOCAL     ] PCOR: Starting deletion of derivative data.
[2025-10-24T20:31:05.568616] [DEBUG] [LOCAL     ] PCOR: Deleted derivative data file.
[2025-10-24T20:31:05.569300] [INFO ] [MAIN      ] Update Progress: 1642/2366 symbols completed. PCOR took 22.5s. Estimated remaining: 1h 33m 3s. Rate: 7.8 symbols/min
[2025-10-24T20:31:05.740145] [INFO ] [MAIN      ] PDCC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:31:05.740329] [DEBUG] [LOCAL     ] PDCC: No existing data file found in primary storage.
[2025-10-24T20:31:05.740366] [WARN ] [MAIN      ] PDCC: No existing data found, performing full refresh instead.
[2025-10-24T20:31:05.740479] [INFO ] [MAIN      ] PDCC: Wiping existing primary data before full refresh.
[2025-10-24T20:31:05.740519] [INFO ] [LOCAL     ] PDCC: Starting deletion of primary data.
[2025-10-24T20:31:05.740562] [DEBUG] [LOCAL     ] PDCC: No primary data file found to delete.
[2025-10-24T20:31:05.740593] [INFO ] [MAIN      ] PDCC: Starting full primary refresh.
[2025-10-24T20:31:05.753357] [INFO ] [REMOTE    ] PCN: Fetching primary data for 2025-10.
[2025-10-24T20:31:06.110366] [INFO ] [REMOTE    ] PDCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:31:06.258496] [INFO ] [REMOTE    ] PCQ: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T20:31:06.262503] [INFO ] [REMOTE    ] PCQ: Full fetch complete (17065 records).
[2025-10-24T20:31:06.262695] [DEBUG] [VALIDATOR ] PCQ: Validating primary data.
[2025-10-24T20:31:06.552804] [INFO ] [REMOTE    ] PD: Fetching primary data for 2025-03.
[2025-10-24T20:31:06.654829] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present.
[2025-10-24T20:31:06.654899] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed.
[2025-10-24T20:31:06.655250] [INFO ] [MAIN      ] PCQ: Fetched primary data is valid.
[2025-10-24T20:31:06.655292] [DEBUG] [LOCAL     ] PCQ: Saving primary data.
[2025-10-24T20:31:06.655528] [FATAL] [LOCAL     ] PCQ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:31:06.655605] [FATAL] [MAIN      ] PCQ: Failed to save primary data.
[2025-10-24T20:31:06.655700] [WARN ] [MAIN      ] PCQ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:31:06.655767] [INFO ] [LOCAL     ] PCQ: Starting deletion of primary data.
[2025-10-24T20:31:06.655822] [DEBUG] [LOCAL     ] PCQ: No primary data file found to delete.
[2025-10-24T20:31:06.655857] [INFO ] [LOCAL     ] PCQ: Starting deletion of derivative data.
[2025-10-24T20:31:06.656012] [DEBUG] [LOCAL     ] PCQ: Deleted derivative data file.
[2025-10-24T20:31:06.656099] [INFO ] [MAIN      ] Update Progress: 1643/2366 symbols completed. PCQ took 23.6s. Estimated remaining: 1h 32m 53s. Rate: 7.8 symbols/min
[2025-10-24T20:31:06.823598] [INFO ] [MAIN      ] PDI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:31:06.873626] [DEBUG] [LOCAL     ] PDI: Loaded 50572 existing records from primary storage.
[2025-10-24T20:31:06.873960] [INFO ] [MAIN      ] PDI: Loaded 50572 existing records.
[2025-10-24T20:31:07.053585] [WARN ] [MAIN      ] PDI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:31:07.053800] [INFO ] [MAIN      ] PDI: Wiping existing primary data before full refresh.
[2025-10-24T20:31:07.053846] [INFO ] [LOCAL     ] PDI: Starting deletion of primary data.
[2025-10-24T20:31:07.054455] [DEBUG] [LOCAL     ] PDI: Deleted primary data file.
[2025-10-24T20:31:07.054509] [INFO ] [MAIN      ] PDI: Starting full primary refresh.
[2025-10-24T20:31:07.358063] [INFO ] [REMOTE    ] PDCC: Fetching primary data for 2025-01.
[2025-10-24T20:31:07.377341] [INFO ] [REMOTE    ] PCN: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T20:31:07.441458] [INFO ] [REMOTE    ] PCN: Full fetch complete (34918 records).
[2025-10-24T20:31:07.467535] [INFO ] [REMOTE    ] PDI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:31:07.459771] [DEBUG] [VALIDATOR ] PCN: Validating primary data.
[2025-10-24T20:31:07.759577] [INFO ] [REMOTE    ] PDCC: Incremental fetch complete for 2025-01 (0.40 seconds).
[2025-10-24T20:31:07.845308] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present.
[2025-10-24T20:31:07.845384] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed.
[2025-10-24T20:31:07.846093] [INFO ] [MAIN      ] PCN: Fetched primary data is valid.
[2025-10-24T20:31:07.846155] [DEBUG] [LOCAL     ] PCN: Saving primary data.
[2025-10-24T20:31:07.846521] [FATAL] [LOCAL     ] PCN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:31:07.846607] [FATAL] [MAIN      ] PCN: Failed to save primary data.
[2025-10-24T20:31:07.846675] [WARN ] [MAIN      ] PCN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:31:07.846730] [INFO ] [LOCAL     ] PCN: Starting deletion of primary data.
[2025-10-24T20:31:07.846781] [DEBUG] [LOCAL     ] PCN: No primary data file found to delete.
[2025-10-24T20:31:07.846815] [INFO ] [LOCAL     ] PCN: Starting deletion of derivative data.
[2025-10-24T20:31:07.846971] [DEBUG] [LOCAL     ] PCN: Deleted derivative data file.
[2025-10-24T20:31:07.847064] [INFO ] [MAIN      ] Update Progress: 1644/2366 symbols completed. PCN took 24.8s. Estimated remaining: 1h 32m 42s. Rate: 7.8 symbols/min
[2025-10-24T20:31:08.019025] [INFO ] [MAIN      ] PDM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:31:08.056374] [DEBUG] [LOCAL     ] PDM: Loaded 40001 existing records from primary storage.
[2025-10-24T20:31:08.056684] [INFO ] [MAIN      ] PDM: Loaded 40001 existing records.
[2025-10-24T20:31:08.156475] [INFO ] [REMOTE    ] PDCC: Fetching primary data for 2025-02.
[2025-10-24T20:31:08.245029] [WARN ] [MAIN      ] PDM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:31:08.245292] [INFO ] [MAIN      ] PDM: Wiping existing primary data before full refresh.
[2025-10-24T20:31:08.245345] [INFO ] [LOCAL     ] PDM: Starting deletion of primary data.
[2025-10-24T20:31:08.245756] [DEBUG] [LOCAL     ] PDM: Deleted primary data file.
[2025-10-24T20:31:08.245815] [INFO ] [MAIN      ] PDM: Starting full primary refresh.
[2025-10-24T20:31:08.608151] [INFO ] [REMOTE    ] PDM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:31:08.643737] [INFO ] [REMOTE    ] PD: Incremental fetch complete for 2025-03 (2.09 seconds).
[2025-10-24T20:31:08.815660] [INFO ] [REMOTE    ] PDCC: Incremental fetch complete for 2025-02 (0.66 seconds).
[2025-10-24T20:31:08.947698] [INFO ] [REMOTE    ] PDCC: Fetching primary data for 2025-03.
[2025-10-24T20:31:09.525478] [INFO ] [REMOTE    ] PDCC: Incremental fetch complete for 2025-03 (0.58 seconds).
[2025-10-24T20:31:09.747633] [INFO ] [REMOTE    ] PDM: Fetching primary data for 2025-01.
[2025-10-24T20:31:10.547660] [INFO ] [REMOTE    ] PD: Fetching primary data for 2025-04.
[2025-10-24T20:31:11.323850] [INFO ] [REMOTE    ] PDM: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T20:31:11.347602] [INFO ] [REMOTE    ] PDM: Fetching primary data for 2025-02.
[2025-10-24T20:31:12.147686] [INFO ] [REMOTE    ] PDI: Fetching primary data for 2025-01.
[2025-10-24T20:31:12.907150] [INFO ] [REMOTE    ] PDM: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T20:31:12.947603] [INFO ] [REMOTE    ] PDM: Fetching primary data for 2025-03.
[2025-10-24T20:31:13.213122] [INFO ] [REMOTE    ] PD: Incremental fetch complete for 2025-04 (2.67 seconds).
[2025-10-24T20:31:13.747617] [INFO ] [REMOTE    ] PDCC: Fetching primary data for 2025-04.
[2025-10-24T20:31:14.061523] [INFO ] [REMOTE    ] PDI: Incremental fetch complete for 2025-01 (1.91 seconds).
[2025-10-24T20:31:14.283570] [INFO ] [REMOTE    ] PDM: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T20:31:14.353674] [INFO ] [REMOTE    ] PDCC: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T20:31:14.547670] [INFO ] [REMOTE    ] PDM: Fetching primary data for 2025-04.
[2025-10-24T20:31:15.347743] [INFO ] [REMOTE    ] PD: Fetching primary data for 2025-05.
[2025-10-24T20:31:16.153912] [INFO ] [REMOTE    ] PDCC: Fetching primary data for 2025-05.
[2025-10-24T20:31:16.170678] [INFO ] [REMOTE    ] PDM: Incremental fetch complete for 2025-04 (1.62 seconds).
[2025-10-24T20:31:16.667101] [INFO ] [REMOTE    ] PDCC: Incremental fetch complete for 2025-05 (0.51 seconds).
[2025-10-24T20:31:16.668533] [INFO ] [REMOTE    ] PD: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T20:31:16.947634] [INFO ] [REMOTE    ] PDI: Fetching primary data for 2025-02.
[2025-10-24T20:31:17.747751] [INFO ] [REMOTE    ] PDM: Fetching primary data for 2025-05.
[2025-10-24T20:31:18.547614] [INFO ] [REMOTE    ] PDCC: Fetching primary data for 2025-06.
[2025-10-24T20:31:18.727326] [INFO ] [REMOTE    ] PDI: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T20:31:19.003756] [INFO ] [REMOTE    ] PDCC: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T20:31:19.347696] [INFO ] [REMOTE    ] PDCC: Fetching primary data for 2025-07.
[2025-10-24T20:31:19.447374] [INFO ] [REMOTE    ] PDM: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T20:31:19.833606] [INFO ] [REMOTE    ] PDCC: Incremental fetch complete for 2025-07 (0.49 seconds).
[2025-10-24T20:31:20.147722] [INFO ] [REMOTE    ] PD: Fetching primary data for 2025-06.
[2025-10-24T20:31:20.947693] [INFO ] [REMOTE    ] PDI: Fetching primary data for 2025-03.
[2025-10-24T20:31:21.747611] [INFO ] [REMOTE    ] PDM: Fetching primary data for 2025-06.
[2025-10-24T20:31:21.860740] [INFO ] [REMOTE    ] PD: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T20:31:22.547744] [INFO ] [REMOTE    ] PDCC: Fetching primary data for 2025-08.
[2025-10-24T20:31:22.906563] [INFO ] [REMOTE    ] PDI: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T20:31:22.996087] [INFO ] [REMOTE    ] PDCC: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T20:31:23.198686] [INFO ] [REMOTE    ] PDM: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T20:31:23.347662] [INFO ] [REMOTE    ] PDM: Fetching primary data for 2025-07.
[2025-10-24T20:31:24.147764] [INFO ] [REMOTE    ] PDCC: Fetching primary data for 2025-09.
[2025-10-24T20:31:24.579246] [INFO ] [REMOTE    ] PDCC: Incremental fetch complete for 2025-09 (0.43 seconds).
[2025-10-24T20:31:24.902295] [INFO ] [REMOTE    ] PDM: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T20:31:24.947727] [INFO ] [REMOTE    ] PDCC: Fetching primary data for 2025-10.
[2025-10-24T20:31:25.430638] [INFO ] [REMOTE    ] PDCC: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T20:31:25.431379] [INFO ] [REMOTE    ] PDCC: Full fetch complete (1394 records).
[2025-10-24T20:31:25.431448] [DEBUG] [VALIDATOR ] PDCC: Validating primary data.
[2025-10-24T20:31:25.637324] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 194 unique days, need 200 days
[2025-10-24T20:31:25.637525] [FATAL] [MAIN      ] PDCC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:31:25.637602] [WARN ] [MAIN      ] PDCC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:31:25.637697] [INFO ] [LOCAL     ] PDCC: Starting deletion of primary data.
[2025-10-24T20:31:25.637771] [DEBUG] [LOCAL     ] PDCC: No primary data file found to delete.
[2025-10-24T20:31:25.637810] [INFO ] [LOCAL     ] PDCC: Starting deletion of derivative data.
[2025-10-24T20:31:25.637869] [DEBUG] [LOCAL     ] PDCC: No derivative data file found to delete.
[2025-10-24T20:31:25.637927] [INFO ] [MAIN      ] Update Progress: 1645/2366 symbols completed. PDCC took 20.1s. Estimated remaining: 1h 32m 39s. Rate: 7.8 symbols/min
[2025-10-24T20:31:25.752334] [INFO ] [REMOTE    ] PDI: Fetching primary data for 2025-04.
[2025-10-24T20:31:25.831536] [INFO ] [MAIN      ] PDO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:31:25.863921] [DEBUG] [LOCAL     ] PDO: Loaded 31605 existing records from primary storage.
[2025-10-24T20:31:25.864178] [INFO ] [MAIN      ] PDO: Loaded 31605 existing records.
[2025-10-24T20:31:26.066128] [WARN ] [MAIN      ] PDO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:31:26.066352] [INFO ] [MAIN      ] PDO: Wiping existing primary data before full refresh.
[2025-10-24T20:31:26.066400] [INFO ] [LOCAL     ] PDO: Starting deletion of primary data.
[2025-10-24T20:31:26.066791] [DEBUG] [LOCAL     ] PDO: Deleted primary data file.
[2025-10-24T20:31:26.066849] [INFO ] [MAIN      ] PDO: Starting full primary refresh.
[2025-10-24T20:31:26.467521] [INFO ] [REMOTE    ] PDO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:31:26.547677] [INFO ] [REMOTE    ] PDM: Fetching primary data for 2025-08.
[2025-10-24T20:31:27.347682] [INFO ] [REMOTE    ] PD: Fetching primary data for 2025-07.
[2025-10-24T20:31:27.779498] [INFO ] [REMOTE    ] PDI: Incremental fetch complete for 2025-04 (2.03 seconds).
[2025-10-24T20:31:27.917040] [INFO ] [REMOTE    ] PDM: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T20:31:28.147706] [INFO ] [REMOTE    ] PDI: Fetching primary data for 2025-05.
[2025-10-24T20:31:28.947725] [INFO ] [REMOTE    ] PDM: Fetching primary data for 2025-09.
[2025-10-24T20:31:29.011782] [INFO ] [REMOTE    ] PD: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T20:31:29.747748] [INFO ] [REMOTE    ] PD: Fetching primary data for 2025-08.
[2025-10-24T20:31:29.986112] [INFO ] [REMOTE    ] PDI: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T20:31:30.547722] [INFO ] [REMOTE    ] PDO: Fetching primary data for 2025-01.
[2025-10-24T20:31:30.572769] [INFO ] [REMOTE    ] PDM: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T20:31:31.347711] [INFO ] [REMOTE    ] PDM: Fetching primary data for 2025-10.
[2025-10-24T20:31:31.987924] [INFO ] [REMOTE    ] PDO: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T20:31:32.117018] [INFO ] [REMOTE    ] PD: Incremental fetch complete for 2025-08 (2.37 seconds).
[2025-10-24T20:31:32.147603] [INFO ] [REMOTE    ] PD: Fetching primary data for 2025-09.
[2025-10-24T20:31:32.947630] [INFO ] [REMOTE    ] PDO: Fetching primary data for 2025-02.
[2025-10-24T20:31:32.969170] [INFO ] [REMOTE    ] PDM: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T20:31:32.976971] [INFO ] [REMOTE    ] PDM: Full fetch complete (57357 records).
[2025-10-24T20:31:32.977117] [DEBUG] [VALIDATOR ] PDM: Validating primary data.
[2025-10-24T20:31:33.364183] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present.
[2025-10-24T20:31:33.364275] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed.
[2025-10-24T20:31:33.365262] [INFO ] [MAIN      ] PDM: Fetched primary data is valid.
[2025-10-24T20:31:33.365324] [DEBUG] [LOCAL     ] PDM: Saving primary data.
[2025-10-24T20:31:33.365840] [FATAL] [LOCAL     ] PDM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:31:33.365928] [FATAL] [MAIN      ] PDM: Failed to save primary data.
[2025-10-24T20:31:33.365969] [WARN ] [MAIN      ] PDM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:31:33.366004] [INFO ] [LOCAL     ] PDM: Starting deletion of primary data.
[2025-10-24T20:31:33.366074] [DEBUG] [LOCAL     ] PDM: No primary data file found to delete.
[2025-10-24T20:31:33.366110] [INFO ] [LOCAL     ] PDM: Starting deletion of derivative data.
[2025-10-24T20:31:33.366256] [DEBUG] [LOCAL     ] PDM: Deleted derivative data file.
[2025-10-24T20:31:33.366756] [INFO ] [MAIN      ] Update Progress: 1646/2366 symbols completed. PDM took 25.5s. Estimated remaining: 1h 32m 31s. Rate: 7.8 symbols/min
[2025-10-24T20:31:33.538985] [INFO ] [MAIN      ] PDS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:31:33.557715] [DEBUG] [LOCAL     ] PDS: Loaded 16766 existing records from primary storage.
[2025-10-24T20:31:33.557981] [INFO ] [MAIN      ] PDS: Loaded 16766 existing records.
[2025-10-24T20:31:33.746940] [WARN ] [MAIN      ] PDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:31:33.747147] [INFO ] [MAIN      ] PDS: Wiping existing primary data before full refresh.
[2025-10-24T20:31:33.747195] [INFO ] [LOCAL     ] PDS: Starting deletion of primary data.
[2025-10-24T20:31:33.747434] [DEBUG] [LOCAL     ] PDS: Deleted primary data file.
[2025-10-24T20:31:33.747491] [INFO ] [MAIN      ] PDS: Starting full primary refresh.
[2025-10-24T20:31:33.791041] [INFO ] [REMOTE    ] PDI: Fetching primary data for 2025-06.
[2025-10-24T20:31:34.149847] [INFO ] [REMOTE    ] PDS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:31:34.142676] [INFO ] [REMOTE    ] PD: Incremental fetch complete for 2025-09 (2.00 seconds).
[2025-10-24T20:31:34.389489] [INFO ] [REMOTE    ] PDO: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T20:31:34.547696] [INFO ] [REMOTE    ] PDO: Fetching primary data for 2025-03.
[2025-10-24T20:31:35.347708] [INFO ] [REMOTE    ] PD: Fetching primary data for 2025-10.
[2025-10-24T20:31:35.621471] [INFO ] [REMOTE    ] PDI: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T20:31:35.908272] [INFO ] [REMOTE    ] PDO: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T20:31:36.147693] [INFO ] [REMOTE    ] PDS: Fetching primary data for 2025-01.
[2025-10-24T20:31:36.947671] [INFO ] [REMOTE    ] PDO: Fetching primary data for 2025-04.
[2025-10-24T20:31:37.154030] [INFO ] [REMOTE    ] PD: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T20:31:37.165095] [INFO ] [REMOTE    ] PD: Full fetch complete (68322 records).
[2025-10-24T20:31:37.165239] [DEBUG] [VALIDATOR ] PD: Validating primary data.
[2025-10-24T20:31:37.282696] [INFO ] [REMOTE    ] PDS: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T20:31:37.567859] [DEBUG] [VALIDATOR ] PD: All expected trading days are present.
[2025-10-24T20:31:37.567943] [DEBUG] [VALIDATOR ] PD: Primary data validation passed.
[2025-10-24T20:31:37.569171] [INFO ] [MAIN      ] PD: Fetched primary data is valid.
[2025-10-24T20:31:37.569236] [DEBUG] [LOCAL     ] PD: Saving primary data.
[2025-10-24T20:31:37.569848] [FATAL] [LOCAL     ] PD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:31:37.569942] [FATAL] [MAIN      ] PD: Failed to save primary data.
[2025-10-24T20:31:37.569984] [WARN ] [MAIN      ] PD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:31:37.570025] [INFO ] [LOCAL     ] PD: Starting deletion of primary data.
[2025-10-24T20:31:37.570080] [DEBUG] [LOCAL     ] PD: No primary data file found to delete.
[2025-10-24T20:31:37.570117] [INFO ] [LOCAL     ] PD: Starting deletion of derivative data.
[2025-10-24T20:31:37.570315] [DEBUG] [LOCAL     ] PD: Deleted derivative data file.
[2025-10-24T20:31:37.570856] [INFO ] [MAIN      ] Update Progress: 1647/2366 symbols completed. PD took 40.9s. Estimated remaining: 1h 32m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:31:37.742500] [INFO ] [MAIN      ] PDT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:31:37.747794] [INFO ] [REMOTE    ] PDI: Fetching primary data for 2025-07.
[2025-10-24T20:31:37.762837] [DEBUG] [LOCAL     ] PDT: Loaded 17588 existing records from primary storage.
[2025-10-24T20:31:37.763338] [INFO ] [MAIN      ] PDT: Loaded 17588 existing records.
[2025-10-24T20:31:37.944851] [WARN ] [MAIN      ] PDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:31:37.945107] [INFO ] [MAIN      ] PDT: Wiping existing primary data before full refresh.
[2025-10-24T20:31:37.945156] [INFO ] [LOCAL     ] PDT: Starting deletion of primary data.
[2025-10-24T20:31:37.945358] [DEBUG] [LOCAL     ] PDT: Deleted primary data file.
[2025-10-24T20:31:37.945415] [INFO ] [MAIN      ] PDT: Starting full primary refresh.
[2025-10-24T20:31:38.316690] [INFO ] [REMOTE    ] PDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:31:38.515975] [INFO ] [REMOTE    ] PDO: Incremental fetch complete for 2025-04 (1.57 seconds).
[2025-10-24T20:31:38.547607] [INFO ] [REMOTE    ] PDO: Fetching primary data for 2025-05.
[2025-10-24T20:31:39.347638] [INFO ] [REMOTE    ] PDT: Fetching primary data for 2025-01.
[2025-10-24T20:31:39.610325] [INFO ] [REMOTE    ] PDI: Incremental fetch complete for 2025-07 (1.86 seconds).
[2025-10-24T20:31:39.864343] [INFO ] [REMOTE    ] PDO: Incremental fetch complete for 2025-05 (1.32 seconds).
[2025-10-24T20:31:40.147638] [INFO ] [REMOTE    ] PDO: Fetching primary data for 2025-06.
[2025-10-24T20:31:40.408428] [INFO ] [REMOTE    ] PDT: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T20:31:40.947693] [INFO ] [REMOTE    ] PDS: Fetching primary data for 2025-02.
[2025-10-24T20:31:41.313207] [INFO ] [REMOTE    ] PDO: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T20:31:41.747735] [INFO ] [REMOTE    ] PDI: Fetching primary data for 2025-08.
[2025-10-24T20:31:42.147117] [INFO ] [REMOTE    ] PDS: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T20:31:42.547746] [INFO ] [REMOTE    ] PDT: Fetching primary data for 2025-02.
[2025-10-24T20:31:43.347689] [INFO ] [REMOTE    ] PDO: Fetching primary data for 2025-07.
[2025-10-24T20:31:43.852747] [INFO ] [REMOTE    ] PDI: Incremental fetch complete for 2025-08 (2.11 seconds).
[2025-10-24T20:31:44.059550] [INFO ] [REMOTE    ] PDT: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T20:31:44.147610] [INFO ] [REMOTE    ] PDI: Fetching primary data for 2025-09.
[2025-10-24T20:31:44.870163] [INFO ] [REMOTE    ] PDO: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T20:31:44.947622] [INFO ] [REMOTE    ] PDT: Fetching primary data for 2025-03.
[2025-10-24T20:31:45.747700] [INFO ] [REMOTE    ] PDO: Fetching primary data for 2025-08.
[2025-10-24T20:31:46.039728] [INFO ] [REMOTE    ] PDI: Incremental fetch complete for 2025-09 (1.89 seconds).
[2025-10-24T20:31:46.098121] [INFO ] [REMOTE    ] PDT: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T20:31:46.547698] [INFO ] [REMOTE    ] PDT: Fetching primary data for 2025-04.
[2025-10-24T20:31:47.248725] [INFO ] [REMOTE    ] PDO: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T20:31:47.347607] [INFO ] [REMOTE    ] PDO: Fetching primary data for 2025-09.
[2025-10-24T20:31:47.674348] [INFO ] [REMOTE    ] PDT: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T20:31:48.147678] [INFO ] [REMOTE    ] PDT: Fetching primary data for 2025-05.
[2025-10-24T20:31:48.625253] [INFO ] [REMOTE    ] PDO: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T20:31:48.947636] [INFO ] [REMOTE    ] PDO: Fetching primary data for 2025-10.
[2025-10-24T20:31:49.313969] [INFO ] [REMOTE    ] PDT: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T20:31:49.747638] [INFO ] [REMOTE    ] PDT: Fetching primary data for 2025-06.
[2025-10-24T20:31:50.419879] [INFO ] [REMOTE    ] PDO: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T20:31:50.426375] [INFO ] [REMOTE    ] PDO: Full fetch complete (46676 records).
[2025-10-24T20:31:50.426495] [DEBUG] [VALIDATOR ] PDO: Validating primary data.
[2025-10-24T20:31:50.548276] [INFO ] [REMOTE    ] PDI: Fetching primary data for 2025-10.
[2025-10-24T20:31:50.606829] [INFO ] [REMOTE    ] PDT: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T20:31:50.973149] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present.
[2025-10-24T20:31:50.973264] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed.
[2025-10-24T20:31:50.975423] [INFO ] [MAIN      ] PDO: Fetched primary data is valid.
[2025-10-24T20:31:50.975525] [DEBUG] [LOCAL     ] PDO: Saving primary data.
[2025-10-24T20:31:50.977323] [FATAL] [LOCAL     ] PDO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:31:50.977409] [FATAL] [MAIN      ] PDO: Failed to save primary data.
[2025-10-24T20:31:50.977465] [WARN ] [MAIN      ] PDO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:31:50.977535] [INFO ] [LOCAL     ] PDO: Starting deletion of primary data.
[2025-10-24T20:31:50.977632] [DEBUG] [LOCAL     ] PDO: No primary data file found to delete.
[2025-10-24T20:31:50.977739] [INFO ] [LOCAL     ] PDO: Starting deletion of derivative data.
[2025-10-24T20:31:50.977978] [DEBUG] [LOCAL     ] PDO: Deleted derivative data file.
[2025-10-24T20:31:50.978105] [INFO ] [MAIN      ] Update Progress: 1648/2366 symbols completed. PDO took 25.3s. Estimated remaining: 1h 32m 17s. Rate: 7.8 symbols/min
[2025-10-24T20:31:51.240586] [INFO ] [MAIN      ] PDX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:31:51.258615] [DEBUG] [LOCAL     ] PDX: Loaded 14236 existing records from primary storage.
[2025-10-24T20:31:51.258910] [INFO ] [MAIN      ] PDX: Loaded 14236 existing records.
[2025-10-24T20:31:51.355687] [INFO ] [REMOTE    ] PDT: Fetching primary data for 2025-07.
[2025-10-24T20:31:51.450284] [WARN ] [MAIN      ] PDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:31:51.450509] [INFO ] [MAIN      ] PDX: Wiping existing primary data before full refresh.
[2025-10-24T20:31:51.450558] [INFO ] [LOCAL     ] PDX: Starting deletion of primary data.
[2025-10-24T20:31:51.450828] [DEBUG] [LOCAL     ] PDX: Deleted primary data file.
[2025-10-24T20:31:51.450887] [INFO ] [MAIN      ] PDX: Starting full primary refresh.
[2025-10-24T20:31:51.814439] [INFO ] [REMOTE    ] PDX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:31:52.147623] [INFO ] [REMOTE    ] PDX: Fetching primary data for 2025-01.
[2025-10-24T20:31:52.593584] [INFO ] [REMOTE    ] PDI: Incremental fetch complete for 2025-10 (2.05 seconds).
[2025-10-24T20:31:52.603021] [INFO ] [REMOTE    ] PDI: Full fetch complete (73147 records).
[2025-10-24T20:31:52.603150] [DEBUG] [VALIDATOR ] PDI: Validating primary data.
[2025-10-24T20:31:52.717001] [INFO ] [REMOTE    ] PDT: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T20:31:52.952795] [INFO ] [REMOTE    ] PDS: Fetching primary data for 2025-03.
[2025-10-24T20:31:53.005176] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present.
[2025-10-24T20:31:53.005256] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed.
[2025-10-24T20:31:53.006393] [INFO ] [MAIN      ] PDI: Fetched primary data is valid.
[2025-10-24T20:31:53.006456] [DEBUG] [LOCAL     ] PDI: Saving primary data.
[2025-10-24T20:31:53.007049] [FATAL] [LOCAL     ] PDI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:31:53.007135] [FATAL] [MAIN      ] PDI: Failed to save primary data.
[2025-10-24T20:31:53.007177] [WARN ] [MAIN      ] PDI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:31:53.007238] [INFO ] [LOCAL     ] PDI: Starting deletion of primary data.
[2025-10-24T20:31:53.007328] [DEBUG] [LOCAL     ] PDI: No primary data file found to delete.
[2025-10-24T20:31:53.007400] [INFO ] [LOCAL     ] PDI: Starting deletion of derivative data.
[2025-10-24T20:31:53.007583] [DEBUG] [LOCAL     ] PDI: Deleted derivative data file.
[2025-10-24T20:31:53.007921] [INFO ] [MAIN      ] Update Progress: 1649/2366 symbols completed. PDI took 46.4s. Estimated remaining: 1h 32m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:31:53.177601] [INFO ] [MAIN      ] PEB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:31:53.226637] [DEBUG] [LOCAL     ] PEB: Loaded 51098 existing records from primary storage.
[2025-10-24T20:31:53.227005] [INFO ] [MAIN      ] PEB: Loaded 51098 existing records.
[2025-10-24T20:31:53.409663] [WARN ] [MAIN      ] PEB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:31:53.409966] [INFO ] [MAIN      ] PEB: Wiping existing primary data before full refresh.
[2025-10-24T20:31:53.410039] [INFO ] [LOCAL     ] PEB: Starting deletion of primary data.
[2025-10-24T20:31:53.416121] [DEBUG] [LOCAL     ] PEB: Deleted primary data file.
[2025-10-24T20:31:53.426024] [INFO ] [MAIN      ] PEB: Starting full primary refresh.
[2025-10-24T20:31:53.497085] [INFO ] [REMOTE    ] PDX: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T20:31:53.756992] [INFO ] [REMOTE    ] PDX: Fetching primary data for 2025-02.
[2025-10-24T20:31:53.788948] [INFO ] [REMOTE    ] PEB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:31:54.365376] [INFO ] [REMOTE    ] PDS: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T20:31:54.547702] [INFO ] [REMOTE    ] PEB: Fetching primary data for 2025-01.
[2025-10-24T20:31:54.875587] [INFO ] [REMOTE    ] PDX: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T20:31:55.347665] [INFO ] [REMOTE    ] PDX: Fetching primary data for 2025-03.
[2025-10-24T20:31:56.147636] [INFO ] [REMOTE    ] PDS: Fetching primary data for 2025-04.
[2025-10-24T20:31:56.288234] [INFO ] [REMOTE    ] PEB: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T20:31:56.528624] [INFO ] [REMOTE    ] PDX: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T20:31:56.947639] [INFO ] [REMOTE    ] PEB: Fetching primary data for 2025-02.
[2025-10-24T20:31:57.360968] [INFO ] [REMOTE    ] PDS: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T20:31:57.747696] [INFO ] [REMOTE    ] PDS: Fetching primary data for 2025-05.
[2025-10-24T20:31:58.547631] [INFO ] [REMOTE    ] PDX: Fetching primary data for 2025-04.
[2025-10-24T20:31:58.781579] [INFO ] [REMOTE    ] PDS: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T20:31:58.837244] [INFO ] [REMOTE    ] PEB: Incremental fetch complete for 2025-02 (1.89 seconds).
[2025-10-24T20:31:59.347625] [INFO ] [REMOTE    ] PDT: Fetching primary data for 2025-08.
[2025-10-24T20:31:59.410446] [INFO ] [REMOTE    ] PDX: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T20:32:00.147730] [INFO ] [REMOTE    ] PDS: Fetching primary data for 2025-06.
[2025-10-24T20:32:00.490636] [INFO ] [REMOTE    ] PDT: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T20:32:00.947722] [INFO ] [REMOTE    ] PDT: Fetching primary data for 2025-09.
[2025-10-24T20:32:01.416281] [INFO ] [REMOTE    ] PDS: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T20:32:01.747701] [INFO ] [REMOTE    ] PDS: Fetching primary data for 2025-07.
[2025-10-24T20:32:02.130890] [INFO ] [REMOTE    ] PDT: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T20:32:02.547713] [INFO ] [REMOTE    ] PEB: Fetching primary data for 2025-03.
[2025-10-24T20:32:02.933550] [INFO ] [REMOTE    ] PDS: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T20:32:03.347680] [INFO ] [REMOTE    ] PDS: Fetching primary data for 2025-08.
[2025-10-24T20:32:04.147619] [INFO ] [REMOTE    ] PDX: Fetching primary data for 2025-05.
[2025-10-24T20:32:04.376934] [INFO ] [REMOTE    ] PEB: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T20:32:04.378088] [INFO ] [REMOTE    ] PDS: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T20:32:04.910798] [INFO ] [REMOTE    ] PDX: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T20:32:04.947615] [INFO ] [REMOTE    ] PDX: Fetching primary data for 2025-06.
[2025-10-24T20:32:05.747706] [INFO ] [REMOTE    ] PEB: Fetching primary data for 2025-04.
[2025-10-24T20:32:06.118181] [INFO ] [REMOTE    ] PDX: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T20:32:06.547704] [INFO ] [REMOTE    ] PDX: Fetching primary data for 2025-07.
[2025-10-24T20:32:07.347670] [INFO ] [REMOTE    ] PDS: Fetching primary data for 2025-09.
[2025-10-24T20:32:07.753090] [INFO ] [REMOTE    ] PEB: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T20:32:07.753598] [INFO ] [REMOTE    ] PDX: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T20:32:08.147737] [INFO ] [REMOTE    ] PDX: Fetching primary data for 2025-08.
[2025-10-24T20:32:08.299384] [INFO ] [REMOTE    ] PDS: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T20:32:08.947731] [INFO ] [REMOTE    ] PEB: Fetching primary data for 2025-05.
[2025-10-24T20:32:09.131242] [INFO ] [REMOTE    ] PDX: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T20:32:09.747736] [INFO ] [REMOTE    ] PDT: Fetching primary data for 2025-10.
[2025-10-24T20:32:10.547626] [INFO ] [REMOTE    ] PDS: Fetching primary data for 2025-10.
[2025-10-24T20:32:10.703099] [INFO ] [REMOTE    ] PEB: Incremental fetch complete for 2025-05 (1.76 seconds).
[2025-10-24T20:32:10.837120] [INFO ] [REMOTE    ] PDT: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T20:32:10.841729] [INFO ] [REMOTE    ] PDT: Full fetch complete (25106 records).
[2025-10-24T20:32:10.841887] [DEBUG] [VALIDATOR ] PDT: Validating primary data.
[2025-10-24T20:32:11.222474] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present.
[2025-10-24T20:32:11.222578] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed.
[2025-10-24T20:32:11.223476] [INFO ] [MAIN      ] PDT: Fetched primary data is valid.
[2025-10-24T20:32:11.223540] [DEBUG] [LOCAL     ] PDT: Saving primary data.
[2025-10-24T20:32:11.224054] [FATAL] [LOCAL     ] PDT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:32:11.224144] [FATAL] [MAIN      ] PDT: Failed to save primary data.
[2025-10-24T20:32:11.224186] [WARN ] [MAIN      ] PDT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:32:11.224222] [INFO ] [LOCAL     ] PDT: Starting deletion of primary data.
[2025-10-24T20:32:11.224276] [DEBUG] [LOCAL     ] PDT: No primary data file found to delete.
[2025-10-24T20:32:11.224312] [INFO ] [LOCAL     ] PDT: Starting deletion of derivative data.
[2025-10-24T20:32:11.224548] [DEBUG] [LOCAL     ] PDT: Deleted derivative data file.
[2025-10-24T20:32:11.224695] [INFO ] [MAIN      ] Update Progress: 1650/2366 symbols completed. PDT took 33.7s. Estimated remaining: 1h 32m 3s. Rate: 7.8 symbols/min
[2025-10-24T20:32:11.352924] [INFO ] [REMOTE    ] PEB: Fetching primary data for 2025-06.
[2025-10-24T20:32:11.415154] [INFO ] [MAIN      ] PEG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:32:11.474774] [DEBUG] [LOCAL     ] PEG: Loaded 53508 existing records from primary storage.
[2025-10-24T20:32:11.475313] [INFO ] [MAIN      ] PEG: Loaded 53508 existing records.
[2025-10-24T20:32:11.633582] [INFO ] [REMOTE    ] PDS: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T20:32:11.667883] [INFO ] [REMOTE    ] PDS: Full fetch complete (25694 records).
[2025-10-24T20:32:11.686739] [DEBUG] [VALIDATOR ] PDS: Validating primary data.
[2025-10-24T20:32:11.691570] [WARN ] [MAIN      ] PEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:32:11.692356] [INFO ] [MAIN      ] PEG: Wiping existing primary data before full refresh.
[2025-10-24T20:32:11.692423] [INFO ] [LOCAL     ] PEG: Starting deletion of primary data.
[2025-10-24T20:32:11.713680] [DEBUG] [LOCAL     ] PEG: Deleted primary data file.
[2025-10-24T20:32:11.713771] [INFO ] [MAIN      ] PEG: Starting full primary refresh.
[2025-10-24T20:32:12.162716] [INFO ] [REMOTE    ] PDX: Fetching primary data for 2025-09.
[2025-10-24T20:32:12.546315] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present.
[2025-10-24T20:32:12.552720] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed.
[2025-10-24T20:32:12.553427] [INFO ] [MAIN      ] PDS: Fetched primary data is valid.
[2025-10-24T20:32:12.553510] [DEBUG] [LOCAL     ] PDS: Saving primary data.
[2025-10-24T20:32:12.581002] [FATAL] [LOCAL     ] PDS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:32:12.587635] [INFO ] [REMOTE    ] PEG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:32:12.587776] [FATAL] [MAIN      ] PDS: Failed to save primary data.
[2025-10-24T20:32:12.588012] [WARN ] [MAIN      ] PDS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:32:12.588445] [INFO ] [LOCAL     ] PDS: Starting deletion of primary data.
[2025-10-24T20:32:12.588531] [DEBUG] [LOCAL     ] PDS: No primary data file found to delete.
[2025-10-24T20:32:12.588591] [INFO ] [LOCAL     ] PDS: Starting deletion of derivative data.
[2025-10-24T20:32:12.588804] [DEBUG] [LOCAL     ] PDS: Deleted derivative data file.
[2025-10-24T20:32:12.588915] [INFO ] [MAIN      ] Update Progress: 1651/2366 symbols completed. PDS took 39.2s. Estimated remaining: 1h 31m 53s. Rate: 7.8 symbols/min
[2025-10-24T20:32:12.754356] [INFO ] [MAIN      ] PEN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:32:12.783182] [DEBUG] [LOCAL     ] PEN: Loaded 29706 existing records from primary storage.
[2025-10-24T20:32:12.783443] [INFO ] [MAIN      ] PEN: Loaded 29706 existing records.
[2025-10-24T20:32:12.957310] [INFO ] [REMOTE    ] PEG: Fetching primary data for 2025-01.
[2025-10-24T20:32:12.962277] [WARN ] [MAIN      ] PEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:32:12.962476] [INFO ] [MAIN      ] PEN: Wiping existing primary data before full refresh.
[2025-10-24T20:32:12.962553] [INFO ] [LOCAL     ] PEN: Starting deletion of primary data.
[2025-10-24T20:32:12.963458] [DEBUG] [LOCAL     ] PEN: Deleted primary data file.
[2025-10-24T20:32:12.963505] [INFO ] [MAIN      ] PEN: Starting full primary refresh.
[2025-10-24T20:32:13.340410] [INFO ] [REMOTE    ] PDX: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T20:32:13.345742] [INFO ] [REMOTE    ] PEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:32:13.380281] [INFO ] [REMOTE    ] PEB: Incremental fetch complete for 2025-06 (2.03 seconds).
[2025-10-24T20:32:13.747669] [INFO ] [REMOTE    ] PEN: Fetching primary data for 2025-01.
[2025-10-24T20:32:14.547706] [INFO ] [REMOTE    ] PEB: Fetching primary data for 2025-07.
[2025-10-24T20:32:14.793061] [INFO ] [REMOTE    ] PEG: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T20:32:15.186090] [INFO ] [REMOTE    ] PEN: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T20:32:15.347716] [INFO ] [REMOTE    ] PEN: Fetching primary data for 2025-02.
[2025-10-24T20:32:16.147730] [INFO ] [REMOTE    ] PDX: Fetching primary data for 2025-10.
[2025-10-24T20:32:16.464041] [INFO ] [REMOTE    ] PEB: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T20:32:16.543111] [INFO ] [REMOTE    ] PEN: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T20:32:16.947726] [INFO ] [REMOTE    ] PEN: Fetching primary data for 2025-03.
[2025-10-24T20:32:17.092924] [INFO ] [REMOTE    ] PDX: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T20:32:17.096272] [INFO ] [REMOTE    ] PDX: Full fetch complete (23676 records).
[2025-10-24T20:32:17.096379] [DEBUG] [VALIDATOR ] PDX: Validating primary data.
[2025-10-24T20:32:17.491098] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present.
[2025-10-24T20:32:17.491207] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed.
[2025-10-24T20:32:17.492045] [INFO ] [MAIN      ] PDX: Fetched primary data is valid.
[2025-10-24T20:32:17.492111] [DEBUG] [LOCAL     ] PDX: Saving primary data.
[2025-10-24T20:32:17.492529] [FATAL] [LOCAL     ] PDX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:32:17.492616] [FATAL] [MAIN      ] PDX: Failed to save primary data.
[2025-10-24T20:32:17.492692] [WARN ] [MAIN      ] PDX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:32:17.492742] [INFO ] [LOCAL     ] PDX: Starting deletion of primary data.
[2025-10-24T20:32:17.492799] [DEBUG] [LOCAL     ] PDX: No primary data file found to delete.
[2025-10-24T20:32:17.492835] [INFO ] [LOCAL     ] PDX: Starting deletion of derivative data.
[2025-10-24T20:32:17.493075] [DEBUG] [LOCAL     ] PDX: Deleted derivative data file.
[2025-10-24T20:32:17.493179] [INFO ] [MAIN      ] Update Progress: 1652/2366 symbols completed. PDX took 26.5s. Estimated remaining: 1h 31m 44s. Rate: 7.8 symbols/min
[2025-10-24T20:32:17.674339] [INFO ] [MAIN      ] PEO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:32:17.674635] [DEBUG] [LOCAL     ] PEO: No existing data file found in primary storage.
[2025-10-24T20:32:17.674717] [WARN ] [MAIN      ] PEO: No existing data found, performing full refresh instead.
[2025-10-24T20:32:17.674848] [INFO ] [MAIN      ] PEO: Wiping existing primary data before full refresh.
[2025-10-24T20:32:17.674891] [INFO ] [LOCAL     ] PEO: Starting deletion of primary data.
[2025-10-24T20:32:17.674953] [DEBUG] [LOCAL     ] PEO: No primary data file found to delete.
[2025-10-24T20:32:17.674989] [INFO ] [MAIN      ] PEO: Starting full primary refresh.
[2025-10-24T20:32:17.752932] [INFO ] [REMOTE    ] PEB: Fetching primary data for 2025-08.
[2025-10-24T20:32:18.086429] [INFO ] [REMOTE    ] PEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:32:18.514334] [INFO ] [REMOTE    ] PEN: Incremental fetch complete for 2025-03 (1.57 seconds).
[2025-10-24T20:32:18.547697] [INFO ] [REMOTE    ] PEO: Fetching primary data for 2025-01.
[2025-10-24T20:32:19.347748] [INFO ] [REMOTE    ] PEG: Fetching primary data for 2025-02.
[2025-10-24T20:32:19.510843] [INFO ] [REMOTE    ] PEB: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T20:32:19.532498] [INFO ] [REMOTE    ] PEO: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T20:32:20.147748] [INFO ] [REMOTE    ] PEB: Fetching primary data for 2025-09.
[2025-10-24T20:32:20.947620] [INFO ] [REMOTE    ] PEO: Fetching primary data for 2025-02.
[2025-10-24T20:32:21.216442] [INFO ] [REMOTE    ] PEG: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T20:32:21.747618] [INFO ] [REMOTE    ] PEG: Fetching primary data for 2025-03.
[2025-10-24T20:32:21.832341] [INFO ] [REMOTE    ] PEO: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T20:32:21.884468] [INFO ] [REMOTE    ] PEB: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T20:32:22.547617] [INFO ] [REMOTE    ] PEN: Fetching primary data for 2025-04.
[2025-10-24T20:32:23.347704] [INFO ] [REMOTE    ] PEB: Fetching primary data for 2025-10.
[2025-10-24T20:32:23.735699] [INFO ] [REMOTE    ] PEG: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T20:32:23.769935] [INFO ] [REMOTE    ] PEN: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T20:32:24.147671] [INFO ] [REMOTE    ] PEO: Fetching primary data for 2025-03.
[2025-10-24T20:32:24.947626] [INFO ] [REMOTE    ] PEN: Fetching primary data for 2025-05.
[2025-10-24T20:32:25.097525] [INFO ] [REMOTE    ] PEO: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T20:32:25.169494] [INFO ] [REMOTE    ] PEB: Incremental fetch complete for 2025-10 (1.82 seconds).
[2025-10-24T20:32:25.178872] [INFO ] [REMOTE    ] PEB: Full fetch complete (73260 records).
[2025-10-24T20:32:25.179003] [DEBUG] [VALIDATOR ] PEB: Validating primary data.
[2025-10-24T20:32:25.576969] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present.
[2025-10-24T20:32:25.577052] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed.
[2025-10-24T20:32:25.578177] [INFO ] [MAIN      ] PEB: Fetched primary data is valid.
[2025-10-24T20:32:25.578241] [DEBUG] [LOCAL     ] PEB: Saving primary data.
[2025-10-24T20:32:25.578841] [FATAL] [LOCAL     ] PEB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:32:25.578927] [FATAL] [MAIN      ] PEB: Failed to save primary data.
[2025-10-24T20:32:25.578969] [WARN ] [MAIN      ] PEB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:32:25.579031] [INFO ] [LOCAL     ] PEB: Starting deletion of primary data.
[2025-10-24T20:32:25.579091] [DEBUG] [LOCAL     ] PEB: No primary data file found to delete.
[2025-10-24T20:32:25.579125] [INFO ] [LOCAL     ] PEB: Starting deletion of derivative data.
[2025-10-24T20:32:25.579265] [DEBUG] [LOCAL     ] PEB: Deleted derivative data file.
[2025-10-24T20:32:25.579454] [INFO ] [MAIN      ] Update Progress: 1653/2366 symbols completed. PEB took 32.6s. Estimated remaining: 1h 31m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:32:25.745670] [INFO ] [MAIN      ] PERF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:32:25.747684] [INFO ] [REMOTE    ] PEO: Fetching primary data for 2025-04.
[2025-10-24T20:32:25.761471] [DEBUG] [LOCAL     ] PERF: Loaded 14582 existing records from primary storage.
[2025-10-24T20:32:25.761718] [INFO ] [MAIN      ] PERF: Loaded 14582 existing records.
[2025-10-24T20:32:25.936552] [WARN ] [MAIN      ] PERF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:32:25.936766] [INFO ] [MAIN      ] PERF: Wiping existing primary data before full refresh.
[2025-10-24T20:32:25.936815] [INFO ] [LOCAL     ] PERF: Starting deletion of primary data.
[2025-10-24T20:32:25.937053] [DEBUG] [LOCAL     ] PERF: Deleted primary data file.
[2025-10-24T20:32:25.937090] [INFO ] [MAIN      ] PERF: Starting full primary refresh.
[2025-10-24T20:32:26.291913] [INFO ] [REMOTE    ] PERF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:32:26.429813] [INFO ] [REMOTE    ] PEN: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T20:32:26.547632] [INFO ] [REMOTE    ] PEG: Fetching primary data for 2025-04.
[2025-10-24T20:32:26.852784] [INFO ] [REMOTE    ] PEO: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T20:32:27.347760] [INFO ] [REMOTE    ] PEN: Fetching primary data for 2025-06.
[2025-10-24T20:32:28.147606] [INFO ] [REMOTE    ] PEO: Fetching primary data for 2025-05.
[2025-10-24T20:32:28.588505] [INFO ] [REMOTE    ] PEG: Incremental fetch complete for 2025-04 (2.04 seconds).
[2025-10-24T20:32:28.767485] [INFO ] [REMOTE    ] PEN: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T20:32:28.831343] [INFO ] [REMOTE    ] PEO: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T20:32:28.947666] [INFO ] [REMOTE    ] PEN: Fetching primary data for 2025-07.
[2025-10-24T20:32:29.747638] [INFO ] [REMOTE    ] PEG: Fetching primary data for 2025-05.
[2025-10-24T20:32:30.548378] [INFO ] [REMOTE    ] PERF: Fetching primary data for 2025-01.
[2025-10-24T20:32:30.550492] [INFO ] [REMOTE    ] PEN: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T20:32:31.347702] [INFO ] [REMOTE    ] PEO: Fetching primary data for 2025-06.
[2025-10-24T20:32:31.485233] [INFO ] [REMOTE    ] PEG: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T20:32:31.753813] [INFO ] [REMOTE    ] PERF: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T20:32:32.040002] [INFO ] [REMOTE    ] PEO: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T20:32:32.147687] [INFO ] [REMOTE    ] PEG: Fetching primary data for 2025-06.
[2025-10-24T20:32:32.947683] [INFO ] [REMOTE    ] PEN: Fetching primary data for 2025-08.
[2025-10-24T20:32:33.747636] [INFO ] [REMOTE    ] PERF: Fetching primary data for 2025-02.
[2025-10-24T20:32:33.891029] [INFO ] [REMOTE    ] PEG: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T20:32:34.261179] [INFO ] [REMOTE    ] PEN: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T20:32:34.463011] [INFO ] [REMOTE    ] PERF: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:32:34.547637] [INFO ] [REMOTE    ] PERF: Fetching primary data for 2025-03.
[2025-10-24T20:32:35.347686] [INFO ] [REMOTE    ] PEN: Fetching primary data for 2025-09.
[2025-10-24T20:32:35.451469] [INFO ] [REMOTE    ] PERF: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T20:32:36.147693] [INFO ] [REMOTE    ] PERF: Fetching primary data for 2025-04.
[2025-10-24T20:32:36.639596] [INFO ] [REMOTE    ] PEN: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T20:32:36.947679] [INFO ] [REMOTE    ] PEN: Fetching primary data for 2025-10.
[2025-10-24T20:32:36.990716] [INFO ] [REMOTE    ] PERF: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T20:32:37.747680] [INFO ] [REMOTE    ] PEG: Fetching primary data for 2025-07.
[2025-10-24T20:32:38.217346] [INFO ] [REMOTE    ] PEN: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T20:32:38.222575] [INFO ] [REMOTE    ] PEN: Full fetch complete (43993 records).
[2025-10-24T20:32:38.222782] [DEBUG] [VALIDATOR ] PEN: Validating primary data.
[2025-10-24T20:32:38.552787] [INFO ] [REMOTE    ] PEO: Fetching primary data for 2025-07.
[2025-10-24T20:32:38.601026] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present.
[2025-10-24T20:32:38.601103] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed.
[2025-10-24T20:32:38.601971] [INFO ] [MAIN      ] PEN: Fetched primary data is valid.
[2025-10-24T20:32:38.602033] [DEBUG] [LOCAL     ] PEN: Saving primary data.
[2025-10-24T20:32:38.602409] [FATAL] [LOCAL     ] PEN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:32:38.602487] [FATAL] [MAIN      ] PEN: Failed to save primary data.
[2025-10-24T20:32:38.602528] [WARN ] [MAIN      ] PEN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:32:38.602563] [INFO ] [LOCAL     ] PEN: Starting deletion of primary data.
[2025-10-24T20:32:38.602612] [DEBUG] [LOCAL     ] PEN: No primary data file found to delete.
[2025-10-24T20:32:38.602671] [INFO ] [LOCAL     ] PEN: Starting deletion of derivative data.
[2025-10-24T20:32:38.602866] [DEBUG] [LOCAL     ] PEN: Deleted derivative data file.
[2025-10-24T20:32:38.602959] [INFO ] [MAIN      ] Update Progress: 1654/2366 symbols completed. PEN took 26.0s. Estimated remaining: 1h 31m 31s. Rate: 7.8 symbols/min
[2025-10-24T20:32:38.770165] [INFO ] [MAIN      ] PEW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:32:38.770346] [DEBUG] [LOCAL     ] PEW: No existing data file found in primary storage.
[2025-10-24T20:32:38.770382] [WARN ] [MAIN      ] PEW: No existing data found, performing full refresh instead.
[2025-10-24T20:32:38.770490] [INFO ] [MAIN      ] PEW: Wiping existing primary data before full refresh.
[2025-10-24T20:32:38.770530] [INFO ] [LOCAL     ] PEW: Starting deletion of primary data.
[2025-10-24T20:32:38.770570] [DEBUG] [LOCAL     ] PEW: No primary data file found to delete.
[2025-10-24T20:32:38.770602] [INFO ] [MAIN      ] PEW: Starting full primary refresh.
[2025-10-24T20:32:39.128800] [INFO ] [REMOTE    ] PEW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:32:39.347620] [INFO ] [REMOTE    ] PEW: Fetching primary data for 2025-01.
[2025-10-24T20:32:39.429762] [INFO ] [REMOTE    ] PEG: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T20:32:39.661308] [INFO ] [REMOTE    ] PEO: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T20:32:39.698557] [DEBUG] [REMOTE    ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:32:39.698879] [WARN ] [REMOTE    ] PEW: No data returned for month 2025-01
[2025-10-24T20:32:39.698963] [FATAL] [REMOTE    ] PEW: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:32:39.699013] [FATAL] [MAIN      ] PEW: Failed to fetch primary data.
[2025-10-24T20:32:39.699046] [WARN ] [MAIN      ] PEW: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:32:39.699108] [INFO ] [LOCAL     ] PEW: Starting deletion of primary data.
[2025-10-24T20:32:39.699170] [DEBUG] [LOCAL     ] PEW: No primary data file found to delete.
[2025-10-24T20:32:39.699204] [INFO ] [LOCAL     ] PEW: Starting deletion of derivative data.
[2025-10-24T20:32:39.699243] [DEBUG] [LOCAL     ] PEW: No derivative data file found to delete.
[2025-10-24T20:32:39.699288] [INFO ] [MAIN      ] Update Progress: 1655/2366 symbols completed. PEW took 1.1s. Estimated remaining: 1h 31m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:32:39.869742] [INFO ] [MAIN      ] PFD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:32:39.879191] [DEBUG] [LOCAL     ] PFD: Loaded 5392 existing records from primary storage.
[2025-10-24T20:32:39.879407] [INFO ] [MAIN      ] PFD: Loaded 5392 existing records.
[2025-10-24T20:32:40.052869] [WARN ] [MAIN      ] PFD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:32:40.053108] [INFO ] [MAIN      ] PFD: Wiping existing primary data before full refresh.
[2025-10-24T20:32:40.053155] [INFO ] [LOCAL     ] PFD: Starting deletion of primary data.
[2025-10-24T20:32:40.053326] [DEBUG] [LOCAL     ] PFD: Deleted primary data file.
[2025-10-24T20:32:40.053382] [INFO ] [MAIN      ] PFD: Starting full primary refresh.
[2025-10-24T20:32:40.152862] [INFO ] [REMOTE    ] PEO: Fetching primary data for 2025-08.
[2025-10-24T20:32:40.406235] [INFO ] [REMOTE    ] PFD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:32:40.947717] [INFO ] [REMOTE    ] PEG: Fetching primary data for 2025-08.
[2025-10-24T20:32:41.066025] [INFO ] [REMOTE    ] PEO: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T20:32:41.747675] [INFO ] [REMOTE    ] PERF: Fetching primary data for 2025-05.
[2025-10-24T20:32:42.547626] [INFO ] [REMOTE    ] PEO: Fetching primary data for 2025-09.
[2025-10-24T20:32:42.683751] [INFO ] [REMOTE    ] PERF: Incremental fetch complete for 2025-05 (0.94 seconds).
[2025-10-24T20:32:42.852839] [INFO ] [REMOTE    ] PEG: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T20:32:43.129671] [INFO ] [REMOTE    ] PEO: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T20:32:43.347722] [INFO ] [REMOTE    ] PERF: Fetching primary data for 2025-06.
[2025-10-24T20:32:44.147734] [INFO ] [REMOTE    ] PEG: Fetching primary data for 2025-09.
[2025-10-24T20:32:44.677595] [INFO ] [REMOTE    ] PERF: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T20:32:44.947639] [INFO ] [REMOTE    ] PFD: Fetching primary data for 2025-01.
[2025-10-24T20:32:45.747671] [INFO ] [REMOTE    ] PEO: Fetching primary data for 2025-10.
[2025-10-24T20:32:45.759221] [INFO ] [REMOTE    ] PFD: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T20:32:46.078158] [INFO ] [REMOTE    ] PEG: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T20:32:46.547635] [INFO ] [REMOTE    ] PEG: Fetching primary data for 2025-10.
[2025-10-24T20:32:46.649125] [INFO ] [REMOTE    ] PEO: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T20:32:46.651752] [INFO ] [REMOTE    ] PEO: Full fetch complete (16323 records).
[2025-10-24T20:32:46.651832] [DEBUG] [VALIDATOR ] PEO: Validating primary data.
[2025-10-24T20:32:47.010395] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present.
[2025-10-24T20:32:47.010468] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed.
[2025-10-24T20:32:47.010837] [INFO ] [MAIN      ] PEO: Fetched primary data is valid.
[2025-10-24T20:32:47.010897] [DEBUG] [LOCAL     ] PEO: Saving primary data.
[2025-10-24T20:32:47.011126] [FATAL] [LOCAL     ] PEO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:32:47.011207] [FATAL] [MAIN      ] PEO: Failed to save primary data.
[2025-10-24T20:32:47.011248] [WARN ] [MAIN      ] PEO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:32:47.011282] [INFO ] [LOCAL     ] PEO: Starting deletion of primary data.
[2025-10-24T20:32:47.011330] [DEBUG] [LOCAL     ] PEO: No primary data file found to delete.
[2025-10-24T20:32:47.011363] [INFO ] [LOCAL     ] PEO: Starting deletion of derivative data.
[2025-10-24T20:32:47.011401] [DEBUG] [LOCAL     ] PEO: No derivative data file found to delete.
[2025-10-24T20:32:47.011455] [INFO ] [MAIN      ] Update Progress: 1656/2366 symbols completed. PEO took 29.5s. Estimated remaining: 1h 31m 13s. Rate: 7.8 symbols/min
[2025-10-24T20:32:47.183014] [INFO ] [MAIN      ] PFE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:32:47.235703] [DEBUG] [LOCAL     ] PFE: Loaded 54203 existing records from primary storage.
[2025-10-24T20:32:47.236040] [INFO ] [MAIN      ] PFE: Loaded 54203 existing records.
[2025-10-24T20:32:47.352735] [INFO ] [REMOTE    ] PERF: Fetching primary data for 2025-07.
[2025-10-24T20:32:47.416337] [WARN ] [MAIN      ] PFE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:32:47.416626] [INFO ] [MAIN      ] PFE: Wiping existing primary data before full refresh.
[2025-10-24T20:32:47.416734] [INFO ] [LOCAL     ] PFE: Starting deletion of primary data.
[2025-10-24T20:32:47.417422] [DEBUG] [LOCAL     ] PFE: Deleted primary data file.
[2025-10-24T20:32:47.417480] [INFO ] [MAIN      ] PFE: Starting full primary refresh.
[2025-10-24T20:32:47.776292] [INFO ] [REMOTE    ] PFE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:32:48.147672] [INFO ] [REMOTE    ] PFE: Fetching primary data for 2025-01.
[2025-10-24T20:32:48.396190] [INFO ] [REMOTE    ] PEG: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T20:32:48.406831] [INFO ] [REMOTE    ] PEG: Full fetch complete (76996 records).
[2025-10-24T20:32:48.406976] [DEBUG] [VALIDATOR ] PEG: Validating primary data.
[2025-10-24T20:32:48.741127] [INFO ] [REMOTE    ] PERF: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T20:32:48.858739] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present.
[2025-10-24T20:32:48.858837] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed.
[2025-10-24T20:32:48.859975] [INFO ] [MAIN      ] PEG: Fetched primary data is valid.
[2025-10-24T20:32:48.860039] [DEBUG] [LOCAL     ] PEG: Saving primary data.
[2025-10-24T20:32:48.860783] [FATAL] [LOCAL     ] PEG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:32:48.860876] [FATAL] [MAIN      ] PEG: Failed to save primary data.
[2025-10-24T20:32:48.860918] [WARN ] [MAIN      ] PEG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:32:48.860953] [INFO ] [LOCAL     ] PEG: Starting deletion of primary data.
[2025-10-24T20:32:48.861008] [DEBUG] [LOCAL     ] PEG: No primary data file found to delete.
[2025-10-24T20:32:48.861043] [INFO ] [LOCAL     ] PEG: Starting deletion of derivative data.
[2025-10-24T20:32:48.861225] [DEBUG] [LOCAL     ] PEG: Deleted derivative data file.
[2025-10-24T20:32:48.861612] [INFO ] [MAIN      ] Update Progress: 1657/2366 symbols completed. PEG took 37.6s. Estimated remaining: 1h 31m 2s. Rate: 7.8 symbols/min
[2025-10-24T20:32:48.955960] [INFO ] [REMOTE    ] PERF: Fetching primary data for 2025-08.
[2025-10-24T20:32:49.037512] [INFO ] [MAIN      ] PFGC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:32:49.081001] [DEBUG] [LOCAL     ] PFGC: Loaded 47021 existing records from primary storage.
[2025-10-24T20:32:49.081334] [INFO ] [MAIN      ] PFGC: Loaded 47021 existing records.
[2025-10-24T20:32:49.262149] [WARN ] [MAIN      ] PFGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:32:49.262313] [INFO ] [MAIN      ] PFGC: Wiping existing primary data before full refresh.
[2025-10-24T20:32:49.262359] [INFO ] [LOCAL     ] PFGC: Starting deletion of primary data.
[2025-10-24T20:32:49.262567] [DEBUG] [LOCAL     ] PFGC: Deleted primary data file.
[2025-10-24T20:32:49.262604] [INFO ] [MAIN      ] PFGC: Starting full primary refresh.
[2025-10-24T20:32:49.618827] [INFO ] [REMOTE    ] PFGC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:32:49.747625] [INFO ] [REMOTE    ] PFD: Fetching primary data for 2025-02.
[2025-10-24T20:32:50.309311] [INFO ] [REMOTE    ] PFD: Incremental fetch complete for 2025-02 (0.56 seconds).
[2025-10-24T20:32:50.321998] [INFO ] [REMOTE    ] PERF: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T20:32:50.511486] [INFO ] [REMOTE    ] PFE: Incremental fetch complete for 2025-01 (2.36 seconds).
[2025-10-24T20:32:50.547600] [INFO ] [REMOTE    ] PFE: Fetching primary data for 2025-02.
[2025-10-24T20:32:51.347731] [INFO ] [REMOTE    ] PFD: Fetching primary data for 2025-03.
[2025-10-24T20:32:52.063143] [INFO ] [REMOTE    ] PFD: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T20:32:52.147691] [INFO ] [REMOTE    ] PFGC: Fetching primary data for 2025-01.
[2025-10-24T20:32:52.845096] [INFO ] [REMOTE    ] PFE: Incremental fetch complete for 2025-02 (2.30 seconds).
[2025-10-24T20:32:52.947604] [INFO ] [REMOTE    ] PFE: Fetching primary data for 2025-03.
[2025-10-24T20:32:53.747672] [INFO ] [REMOTE    ] PFD: Fetching primary data for 2025-04.
[2025-10-24T20:32:53.892815] [INFO ] [REMOTE    ] PFGC: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T20:32:54.484841] [INFO ] [REMOTE    ] PFD: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T20:32:54.547634] [INFO ] [REMOTE    ] PFD: Fetching primary data for 2025-05.
[2025-10-24T20:32:55.257437] [INFO ] [REMOTE    ] PFD: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T20:32:55.347635] [INFO ] [REMOTE    ] PERF: Fetching primary data for 2025-09.
[2025-10-24T20:32:55.715178] [INFO ] [REMOTE    ] PFE: Incremental fetch complete for 2025-03 (2.77 seconds).
[2025-10-24T20:32:56.147613] [INFO ] [REMOTE    ] PFGC: Fetching primary data for 2025-02.
[2025-10-24T20:32:56.362786] [INFO ] [REMOTE    ] PERF: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T20:32:56.947723] [INFO ] [REMOTE    ] PFE: Fetching primary data for 2025-04.
[2025-10-24T20:32:57.747697] [INFO ] [REMOTE    ] PFD: Fetching primary data for 2025-06.
[2025-10-24T20:32:57.927757] [INFO ] [REMOTE    ] PFGC: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T20:32:58.240715] [INFO ] [REMOTE    ] PFD: Incremental fetch complete for 2025-06 (0.49 seconds).
[2025-10-24T20:32:58.547710] [INFO ] [REMOTE    ] PERF: Fetching primary data for 2025-10.
[2025-10-24T20:32:59.347714] [INFO ] [REMOTE    ] PFGC: Fetching primary data for 2025-03.
[2025-10-24T20:32:59.677866] [INFO ] [REMOTE    ] PERF: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T20:32:59.681385] [INFO ] [REMOTE    ] PERF: Full fetch complete (21277 records).
[2025-10-24T20:32:59.681856] [DEBUG] [VALIDATOR ] PERF: Validating primary data.
[2025-10-24T20:32:59.891087] [INFO ] [REMOTE    ] PFE: Incremental fetch complete for 2025-04 (2.94 seconds).
[2025-10-24T20:33:00.121101] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present.
[2025-10-24T20:33:00.121187] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed.
[2025-10-24T20:33:00.121679] [INFO ] [MAIN      ] PERF: Fetched primary data is valid.
[2025-10-24T20:33:00.121740] [DEBUG] [LOCAL     ] PERF: Saving primary data.
[2025-10-24T20:33:00.122007] [FATAL] [LOCAL     ] PERF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:33:00.122093] [FATAL] [MAIN      ] PERF: Failed to save primary data.
[2025-10-24T20:33:00.122134] [WARN ] [MAIN      ] PERF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:33:00.122167] [INFO ] [LOCAL     ] PERF: Starting deletion of primary data.
[2025-10-24T20:33:00.122214] [DEBUG] [LOCAL     ] PERF: No primary data file found to delete.
[2025-10-24T20:33:00.122247] [INFO ] [LOCAL     ] PERF: Starting deletion of derivative data.
[2025-10-24T20:33:00.122449] [DEBUG] [LOCAL     ] PERF: Deleted derivative data file.
[2025-10-24T20:33:00.122537] [INFO ] [MAIN      ] Update Progress: 1658/2366 symbols completed. PERF took 34.5s. Estimated remaining: 1h 30m 56s. Rate: 7.8 symbols/min
[2025-10-24T20:33:00.152752] [INFO ] [REMOTE    ] PFD: Fetching primary data for 2025-07.
[2025-10-24T20:33:00.312053] [INFO ] [MAIN      ] PFH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:33:00.322008] [DEBUG] [LOCAL     ] PFH: Loaded 6448 existing records from primary storage.
[2025-10-24T20:33:00.322320] [INFO ] [MAIN      ] PFH: Loaded 6448 existing records.
[2025-10-24T20:33:00.539281] [WARN ] [MAIN      ] PFH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:33:00.539522] [INFO ] [MAIN      ] PFH: Wiping existing primary data before full refresh.
[2025-10-24T20:33:00.539573] [INFO ] [LOCAL     ] PFH: Starting deletion of primary data.
[2025-10-24T20:33:00.539793] [DEBUG] [LOCAL     ] PFH: Deleted primary data file.
[2025-10-24T20:33:00.539851] [INFO ] [MAIN      ] PFH: Starting full primary refresh.
[2025-10-24T20:33:00.950913] [INFO ] [REMOTE    ] PFH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:33:00.951042] [INFO ] [REMOTE    ] PFE: Fetching primary data for 2025-05.
[2025-10-24T20:33:01.054173] [INFO ] [REMOTE    ] PFD: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T20:33:01.084366] [INFO ] [REMOTE    ] PFGC: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T20:33:01.747710] [INFO ] [REMOTE    ] PFGC: Fetching primary data for 2025-04.
[2025-10-24T20:33:02.547736] [INFO ] [REMOTE    ] PFD: Fetching primary data for 2025-08.
[2025-10-24T20:33:03.347724] [INFO ] [REMOTE    ] PFH: Fetching primary data for 2025-01.
[2025-10-24T20:33:03.358281] [INFO ] [REMOTE    ] PFD: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T20:33:03.415524] [INFO ] [REMOTE    ] PFGC: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T20:33:03.515378] [INFO ] [REMOTE    ] PFE: Incremental fetch complete for 2025-05 (2.56 seconds).
[2025-10-24T20:33:04.147704] [INFO ] [REMOTE    ] PFD: Fetching primary data for 2025-09.
[2025-10-24T20:33:04.288999] [INFO ] [REMOTE    ] PFH: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T20:33:04.947621] [INFO ] [REMOTE    ] PFH: Fetching primary data for 2025-02.
[2025-10-24T20:33:05.022485] [INFO ] [REMOTE    ] PFD: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T20:33:05.501246] [INFO ] [REMOTE    ] PFH: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T20:33:05.747683] [INFO ] [REMOTE    ] PFH: Fetching primary data for 2025-03.
[2025-10-24T20:33:06.548024] [INFO ] [REMOTE    ] PFH: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T20:33:06.547773] [INFO ] [REMOTE    ] PFE: Fetching primary data for 2025-06.
[2025-10-24T20:33:07.347729] [INFO ] [REMOTE    ] PFGC: Fetching primary data for 2025-05.
[2025-10-24T20:33:08.147709] [INFO ] [REMOTE    ] PFH: Fetching primary data for 2025-04.
[2025-10-24T20:33:08.947713] [INFO ] [REMOTE    ] PFD: Fetching primary data for 2025-10.
[2025-10-24T20:33:09.079629] [INFO ] [REMOTE    ] PFH: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T20:33:09.145163] [INFO ] [REMOTE    ] PFGC: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T20:33:09.249057] [INFO ] [REMOTE    ] PFE: Incremental fetch complete for 2025-06 (2.70 seconds).
[2025-10-24T20:33:09.703757] [INFO ] [REMOTE    ] PFD: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T20:33:09.706194] [INFO ] [REMOTE    ] PFD: Full fetch complete (7484 records).
[2025-10-24T20:33:09.706282] [DEBUG] [VALIDATOR ] PFD: Validating primary data.
[2025-10-24T20:33:09.752888] [INFO ] [REMOTE    ] PFE: Fetching primary data for 2025-07.
[2025-10-24T20:33:10.122847] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present.
[2025-10-24T20:33:10.122945] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed.
[2025-10-24T20:33:10.123235] [INFO ] [MAIN      ] PFD: Fetched primary data is valid.
[2025-10-24T20:33:10.123275] [DEBUG] [LOCAL     ] PFD: Saving primary data.
[2025-10-24T20:33:10.123505] [FATAL] [LOCAL     ] PFD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:33:10.123589] [FATAL] [MAIN      ] PFD: Failed to save primary data.
[2025-10-24T20:33:10.123630] [WARN ] [MAIN      ] PFD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:33:10.123705] [INFO ] [LOCAL     ] PFD: Starting deletion of primary data.
[2025-10-24T20:33:10.123766] [DEBUG] [LOCAL     ] PFD: No primary data file found to delete.
[2025-10-24T20:33:10.123802] [INFO ] [LOCAL     ] PFD: Starting deletion of derivative data.
[2025-10-24T20:33:10.124012] [DEBUG] [LOCAL     ] PFD: Deleted derivative data file.
[2025-10-24T20:33:10.124116] [INFO ] [MAIN      ] Update Progress: 1659/2366 symbols completed. PFD took 30.4s. Estimated remaining: 1h 30m 49s. Rate: 7.8 symbols/min
[2025-10-24T20:33:10.301574] [INFO ] [MAIN      ] PFL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:33:10.320555] [DEBUG] [LOCAL     ] PFL: Loaded 14547 existing records from primary storage.
[2025-10-24T20:33:10.320963] [INFO ] [MAIN      ] PFL: Loaded 14547 existing records.
[2025-10-24T20:33:10.502304] [WARN ] [MAIN      ] PFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:33:10.502579] [INFO ] [MAIN      ] PFL: Wiping existing primary data before full refresh.
[2025-10-24T20:33:10.502629] [INFO ] [LOCAL     ] PFL: Starting deletion of primary data.
[2025-10-24T20:33:10.502915] [DEBUG] [LOCAL     ] PFL: Deleted primary data file.
[2025-10-24T20:33:10.502961] [INFO ] [MAIN      ] PFL: Starting full primary refresh.
[2025-10-24T20:33:10.556774] [INFO ] [REMOTE    ] PFH: Fetching primary data for 2025-05.
[2025-10-24T20:33:10.878772] [INFO ] [REMOTE    ] PFL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:33:11.347679] [INFO ] [REMOTE    ] PFGC: Fetching primary data for 2025-06.
[2025-10-24T20:33:11.559942] [INFO ] [REMOTE    ] PFH: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T20:33:12.147740] [INFO ] [REMOTE    ] PFH: Fetching primary data for 2025-06.
[2025-10-24T20:33:12.202205] [INFO ] [REMOTE    ] PFE: Incremental fetch complete for 2025-07 (2.45 seconds).
[2025-10-24T20:33:12.913075] [INFO ] [REMOTE    ] PFGC: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T20:33:12.947678] [INFO ] [REMOTE    ] PFGC: Fetching primary data for 2025-07.
[2025-10-24T20:33:13.067123] [INFO ] [REMOTE    ] PFH: Incremental fetch complete for 2025-06 (0.92 seconds).
[2025-10-24T20:33:13.747736] [INFO ] [REMOTE    ] PFE: Fetching primary data for 2025-08.
[2025-10-24T20:33:14.547617] [INFO ] [REMOTE    ] PFL: Fetching primary data for 2025-01.
[2025-10-24T20:33:14.809770] [INFO ] [REMOTE    ] PFGC: Incremental fetch complete for 2025-07 (1.86 seconds).
[2025-10-24T20:33:15.166127] [INFO ] [REMOTE    ] PFL: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T20:33:15.347729] [INFO ] [REMOTE    ] PFH: Fetching primary data for 2025-07.
[2025-10-24T20:33:16.147722] [INFO ] [REMOTE    ] PFGC: Fetching primary data for 2025-08.
[2025-10-24T20:33:16.241024] [INFO ] [REMOTE    ] PFH: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T20:33:16.726504] [INFO ] [REMOTE    ] PFE: Incremental fetch complete for 2025-08 (2.98 seconds).
[2025-10-24T20:33:16.947738] [INFO ] [REMOTE    ] PFE: Fetching primary data for 2025-09.
[2025-10-24T20:33:17.567882] [INFO ] [REMOTE    ] PFGC: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T20:33:17.747703] [INFO ] [REMOTE    ] PFH: Fetching primary data for 2025-08.
[2025-10-24T20:33:18.547709] [INFO ] [REMOTE    ] PFL: Fetching primary data for 2025-02.
[2025-10-24T20:33:18.648296] [INFO ] [REMOTE    ] PFH: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T20:33:19.347621] [INFO ] [REMOTE    ] PFH: Fetching primary data for 2025-09.
[2025-10-24T20:33:19.516449] [INFO ] [REMOTE    ] PFE: Incremental fetch complete for 2025-09 (2.57 seconds).
[2025-10-24T20:33:19.680182] [INFO ] [REMOTE    ] PFL: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T20:33:20.063418] [INFO ] [REMOTE    ] PFH: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T20:33:20.147738] [INFO ] [REMOTE    ] PFE: Fetching primary data for 2025-10.
[2025-10-24T20:33:20.947724] [INFO ] [REMOTE    ] PFGC: Fetching primary data for 2025-09.
[2025-10-24T20:33:21.747695] [INFO ] [REMOTE    ] PFH: Fetching primary data for 2025-10.
[2025-10-24T20:33:22.402390] [INFO ] [REMOTE    ] PFH: Incremental fetch complete for 2025-10 (0.65 seconds).
[2025-10-24T20:33:22.403721] [INFO ] [REMOTE    ] PFH: Full fetch complete (9587 records).
[2025-10-24T20:33:22.403794] [DEBUG] [VALIDATOR ] PFH: Validating primary data.
[2025-10-24T20:33:22.556744] [INFO ] [REMOTE    ] PFL: Fetching primary data for 2025-03.
[2025-10-24T20:33:22.803095] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present.
[2025-10-24T20:33:22.803291] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed.
[2025-10-24T20:33:22.803733] [INFO ] [MAIN      ] PFH: Fetched primary data is valid.
[2025-10-24T20:33:22.804002] [DEBUG] [LOCAL     ] PFH: Saving primary data.
[2025-10-24T20:33:22.804319] [FATAL] [LOCAL     ] PFH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:33:22.804521] [FATAL] [MAIN      ] PFH: Failed to save primary data.
[2025-10-24T20:33:22.804639] [WARN ] [MAIN      ] PFH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:33:22.804746] [INFO ] [LOCAL     ] PFH: Starting deletion of primary data.
[2025-10-24T20:33:22.805027] [DEBUG] [LOCAL     ] PFH: No primary data file found to delete.
[2025-10-24T20:33:22.805271] [INFO ] [LOCAL     ] PFH: Starting deletion of derivative data.
[2025-10-24T20:33:22.805723] [DEBUG] [LOCAL     ] PFH: Deleted derivative data file.
[2025-10-24T20:33:22.806076] [INFO ] [MAIN      ] Update Progress: 1660/2366 symbols completed. PFH took 22.7s. Estimated remaining: 1h 30m 44s. Rate: 7.8 symbols/min
[2025-10-24T20:33:22.964046] [INFO ] [REMOTE    ] PFE: Incremental fetch complete for 2025-10 (2.82 seconds).
[2025-10-24T20:33:22.986454] [INFO ] [REMOTE    ] PFGC: Incremental fetch complete for 2025-09 (2.04 seconds).
[2025-10-24T20:33:23.031536] [INFO ] [REMOTE    ] PFE: Full fetch complete (77993 records).
[2025-10-24T20:33:23.062167] [DEBUG] [VALIDATOR ] PFE: Validating primary data.
[2025-10-24T20:33:23.065997] [INFO ] [MAIN      ] PFLT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:33:23.348834] [INFO ] [REMOTE    ] PFGC: Fetching primary data for 2025-10.
[2025-10-24T20:33:23.460795] [DEBUG] [LOCAL     ] PFLT: Loaded 44559 existing records from primary storage.
[2025-10-24T20:33:23.505951] [INFO ] [MAIN      ] PFLT: Loaded 44559 existing records.
[2025-10-24T20:33:23.509827] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present.
[2025-10-24T20:33:23.543168] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed.
[2025-10-24T20:33:23.544505] [INFO ] [MAIN      ] PFE: Fetched primary data is valid.
[2025-10-24T20:33:23.544593] [DEBUG] [LOCAL     ] PFE: Saving primary data.
[2025-10-24T20:33:23.569638] [FATAL] [LOCAL     ] PFE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:33:23.579894] [FATAL] [MAIN      ] PFE: Failed to save primary data.
[2025-10-24T20:33:23.586602] [WARN ] [MAIN      ] PFE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:33:23.598056] [INFO ] [LOCAL     ] PFE: Starting deletion of primary data.
[2025-10-24T20:33:23.609161] [DEBUG] [LOCAL     ] PFE: No primary data file found to delete.
[2025-10-24T20:33:23.617464] [INFO ] [LOCAL     ] PFE: Starting deletion of derivative data.
[2025-10-24T20:33:23.620881] [DEBUG] [LOCAL     ] PFE: Deleted derivative data file.
[2025-10-24T20:33:23.631730] [INFO ] [MAIN      ] Update Progress: 1661/2366 symbols completed. PFE took 36.6s. Estimated remaining: 1h 30m 33s. Rate: 7.8 symbols/min
[2025-10-24T20:33:23.747307] [WARN ] [MAIN      ] PFLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:33:23.768792] [INFO ] [MAIN      ] PFLT: Wiping existing primary data before full refresh.
[2025-10-24T20:33:23.797335] [INFO ] [LOCAL     ] PFLT: Starting deletion of primary data.
[2025-10-24T20:33:23.832759] [INFO ] [REMOTE    ] PFL: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T20:33:23.832905] [DEBUG] [LOCAL     ] PFLT: Deleted primary data file.
[2025-10-24T20:33:23.848460] [INFO ] [MAIN      ] PFLT: Starting full primary refresh.
[2025-10-24T20:33:24.017187] [INFO ] [MAIN      ] PFN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:33:24.152409] [INFO ] [REMOTE    ] PFL: Fetching primary data for 2025-04.
[2025-10-24T20:33:24.226558] [DEBUG] [LOCAL     ] PFN: Loaded 22319 existing records from primary storage.
[2025-10-24T20:33:24.241602] [INFO ] [MAIN      ] PFN: Loaded 22319 existing records.
[2025-10-24T20:33:24.402150] [INFO ] [REMOTE    ] PFLT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:33:24.505271] [WARN ] [MAIN      ] PFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:33:24.505612] [INFO ] [MAIN      ] PFN: Wiping existing primary data before full refresh.
[2025-10-24T20:33:24.505701] [INFO ] [LOCAL     ] PFN: Starting deletion of primary data.
[2025-10-24T20:33:24.506171] [DEBUG] [LOCAL     ] PFN: Deleted primary data file.
[2025-10-24T20:33:24.506229] [INFO ] [MAIN      ] PFN: Starting full primary refresh.
[2025-10-24T20:33:24.897373] [INFO ] [REMOTE    ] PFN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:33:24.922886] [INFO ] [REMOTE    ] PFGC: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T20:33:24.932731] [INFO ] [REMOTE    ] PFGC: Full fetch complete (67599 records).
[2025-10-24T20:33:24.932948] [DEBUG] [VALIDATOR ] PFGC: Validating primary data.
[2025-10-24T20:33:24.955749] [INFO ] [REMOTE    ] PFLT: Fetching primary data for 2025-01.
[2025-10-24T20:33:25.060230] [INFO ] [REMOTE    ] PFL: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T20:33:25.380623] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present.
[2025-10-24T20:33:25.380791] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed.
[2025-10-24T20:33:25.382161] [INFO ] [MAIN      ] PFGC: Fetched primary data is valid.
[2025-10-24T20:33:25.382228] [DEBUG] [LOCAL     ] PFGC: Saving primary data.
[2025-10-24T20:33:25.382906] [FATAL] [LOCAL     ] PFGC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:33:25.382998] [FATAL] [MAIN      ] PFGC: Failed to save primary data.
[2025-10-24T20:33:25.383041] [WARN ] [MAIN      ] PFGC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:33:25.383078] [INFO ] [LOCAL     ] PFGC: Starting deletion of primary data.
[2025-10-24T20:33:25.383133] [DEBUG] [LOCAL     ] PFGC: No primary data file found to delete.
[2025-10-24T20:33:25.383169] [INFO ] [LOCAL     ] PFGC: Starting deletion of derivative data.
[2025-10-24T20:33:25.383322] [DEBUG] [LOCAL     ] PFGC: Deleted derivative data file.
[2025-10-24T20:33:25.383426] [INFO ] [MAIN      ] Update Progress: 1662/2366 symbols completed. PFGC took 36.5s. Estimated remaining: 1h 30m 23s. Rate: 7.8 symbols/min
[2025-10-24T20:33:25.552475] [INFO ] [MAIN      ] PFO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:33:25.560105] [DEBUG] [LOCAL     ] PFO: Loaded 6133 existing records from primary storage.
[2025-10-24T20:33:25.560320] [INFO ] [MAIN      ] PFO: Loaded 6133 existing records.
[2025-10-24T20:33:25.737070] [WARN ] [MAIN      ] PFO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:33:25.737333] [INFO ] [MAIN      ] PFO: Wiping existing primary data before full refresh.
[2025-10-24T20:33:25.737390] [INFO ] [LOCAL     ] PFO: Starting deletion of primary data.
[2025-10-24T20:33:25.737563] [DEBUG] [LOCAL     ] PFO: Deleted primary data file.
[2025-10-24T20:33:25.737618] [INFO ] [MAIN      ] PFO: Starting full primary refresh.
[2025-10-24T20:33:25.752773] [INFO ] [REMOTE    ] PFL: Fetching primary data for 2025-05.
[2025-10-24T20:33:26.098726] [INFO ] [REMOTE    ] PFO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:33:26.547718] [INFO ] [REMOTE    ] PFN: Fetching primary data for 2025-01.
[2025-10-24T20:33:26.731333] [INFO ] [REMOTE    ] PFLT: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T20:33:26.795905] [INFO ] [REMOTE    ] PFL: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T20:33:27.347701] [INFO ] [REMOTE    ] PFLT: Fetching primary data for 2025-02.
[2025-10-24T20:33:27.452312] [INFO ] [REMOTE    ] PFN: Incremental fetch complete for 2025-01 (0.90 seconds).
[2025-10-24T20:33:28.147684] [INFO ] [REMOTE    ] PFN: Fetching primary data for 2025-02.
[2025-10-24T20:33:28.947723] [INFO ] [REMOTE    ] PFO: Fetching primary data for 2025-01.
[2025-10-24T20:33:29.035444] [INFO ] [REMOTE    ] PFLT: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T20:33:29.092575] [INFO ] [REMOTE    ] PFN: Incremental fetch complete for 2025-02 (0.94 seconds).
[2025-10-24T20:33:29.634882] [INFO ] [REMOTE    ] PFO: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T20:33:29.747734] [INFO ] [REMOTE    ] PFL: Fetching primary data for 2025-06.
[2025-10-24T20:33:30.547724] [INFO ] [REMOTE    ] PFLT: Fetching primary data for 2025-03.
[2025-10-24T20:33:30.681612] [INFO ] [REMOTE    ] PFL: Incremental fetch complete for 2025-06 (0.93 seconds).
[2025-10-24T20:33:31.347714] [INFO ] [REMOTE    ] PFL: Fetching primary data for 2025-07.
[2025-10-24T20:33:32.147722] [INFO ] [REMOTE    ] PFO: Fetching primary data for 2025-02.
[2025-10-24T20:33:32.318678] [INFO ] [REMOTE    ] PFLT: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T20:33:32.363756] [INFO ] [REMOTE    ] PFL: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T20:33:32.854919] [INFO ] [REMOTE    ] PFO: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T20:33:32.947699] [INFO ] [REMOTE    ] PFL: Fetching primary data for 2025-08.
[2025-10-24T20:33:33.747615] [INFO ] [REMOTE    ] PFO: Fetching primary data for 2025-03.
[2025-10-24T20:33:34.119967] [INFO ] [REMOTE    ] PFL: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T20:33:34.475079] [INFO ] [REMOTE    ] PFO: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T20:33:34.547619] [INFO ] [REMOTE    ] PFL: Fetching primary data for 2025-09.
[2025-10-24T20:33:35.347707] [INFO ] [REMOTE    ] PFN: Fetching primary data for 2025-03.
[2025-10-24T20:33:35.587927] [INFO ] [REMOTE    ] PFL: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T20:33:36.147635] [INFO ] [REMOTE    ] PFL: Fetching primary data for 2025-10.
[2025-10-24T20:33:36.603061] [INFO ] [REMOTE    ] PFN: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T20:33:36.947635] [INFO ] [REMOTE    ] PFLT: Fetching primary data for 2025-04.
[2025-10-24T20:33:37.392328] [INFO ] [REMOTE    ] PFL: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T20:33:37.396329] [INFO ] [REMOTE    ] PFL: Full fetch complete (20762 records).
[2025-10-24T20:33:37.396404] [DEBUG] [VALIDATOR ] PFL: Validating primary data.
[2025-10-24T20:33:37.747705] [INFO ] [REMOTE    ] PFO: Fetching primary data for 2025-04.
[2025-10-24T20:33:37.777344] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present.
[2025-10-24T20:33:37.777429] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed.
[2025-10-24T20:33:37.778016] [INFO ] [MAIN      ] PFL: Fetched primary data is valid.
[2025-10-24T20:33:37.778201] [DEBUG] [LOCAL     ] PFL: Saving primary data.
[2025-10-24T20:33:37.778533] [FATAL] [LOCAL     ] PFL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:33:37.778614] [FATAL] [MAIN      ] PFL: Failed to save primary data.
[2025-10-24T20:33:37.778720] [WARN ] [MAIN      ] PFL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:33:37.778802] [INFO ] [LOCAL     ] PFL: Starting deletion of primary data.
[2025-10-24T20:33:37.778872] [DEBUG] [LOCAL     ] PFL: No primary data file found to delete.
[2025-10-24T20:33:37.778922] [INFO ] [LOCAL     ] PFL: Starting deletion of derivative data.
[2025-10-24T20:33:37.779124] [DEBUG] [LOCAL     ] PFL: Deleted derivative data file.
[2025-10-24T20:33:37.779230] [INFO ] [MAIN      ] Update Progress: 1663/2366 symbols completed. PFL took 27.7s. Estimated remaining: 1h 30m 17s. Rate: 7.8 symbols/min
[2025-10-24T20:33:37.950514] [INFO ] [MAIN      ] PFS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:33:37.985349] [DEBUG] [LOCAL     ] PFS: Loaded 35957 existing records from primary storage.
[2025-10-24T20:33:37.985607] [INFO ] [MAIN      ] PFS: Loaded 35957 existing records.
[2025-10-24T20:33:38.164628] [WARN ] [MAIN      ] PFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:33:38.164836] [INFO ] [MAIN      ] PFS: Wiping existing primary data before full refresh.
[2025-10-24T20:33:38.164887] [INFO ] [LOCAL     ] PFS: Starting deletion of primary data.
[2025-10-24T20:33:38.165133] [DEBUG] [LOCAL     ] PFS: Deleted primary data file.
[2025-10-24T20:33:38.165173] [INFO ] [MAIN      ] PFS: Starting full primary refresh.
[2025-10-24T20:33:38.530842] [INFO ] [REMOTE    ] PFS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:33:38.547601] [INFO ] [REMOTE    ] PFS: Fetching primary data for 2025-01.
[2025-10-24T20:33:38.663893] [INFO ] [REMOTE    ] PFO: Incremental fetch complete for 2025-04 (0.92 seconds).
[2025-10-24T20:33:38.791638] [INFO ] [REMOTE    ] PFLT: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T20:33:39.347636] [INFO ] [REMOTE    ] PFN: Fetching primary data for 2025-04.
[2025-10-24T20:33:40.147699] [INFO ] [REMOTE    ] PFO: Fetching primary data for 2025-05.
[2025-10-24T20:33:40.171059] [INFO ] [REMOTE    ] PFS: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T20:33:40.801260] [INFO ] [REMOTE    ] PFN: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T20:33:40.947686] [INFO ] [REMOTE    ] PFN: Fetching primary data for 2025-05.
[2025-10-24T20:33:41.033956] [INFO ] [REMOTE    ] PFO: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T20:33:41.747712] [INFO ] [REMOTE    ] PFS: Fetching primary data for 2025-02.
[2025-10-24T20:33:41.957025] [INFO ] [REMOTE    ] PFN: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T20:33:42.547683] [INFO ] [REMOTE    ] PFLT: Fetching primary data for 2025-05.
[2025-10-24T20:33:42.764957] [INFO ] [REMOTE    ] PFS: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T20:33:43.347714] [INFO ] [REMOTE    ] PFO: Fetching primary data for 2025-06.
[2025-10-24T20:33:43.986823] [INFO ] [REMOTE    ] PFO: Incremental fetch complete for 2025-06 (0.64 seconds).
[2025-10-24T20:33:44.147683] [INFO ] [REMOTE    ] PFN: Fetching primary data for 2025-06.
[2025-10-24T20:33:44.189010] [INFO ] [REMOTE    ] PFLT: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T20:33:44.947740] [INFO ] [REMOTE    ] PFLT: Fetching primary data for 2025-06.
[2025-10-24T20:33:45.710234] [INFO ] [REMOTE    ] PFN: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T20:33:45.747603] [INFO ] [REMOTE    ] PFN: Fetching primary data for 2025-07.
[2025-10-24T20:33:46.547734] [INFO ] [REMOTE    ] PFO: Fetching primary data for 2025-07.
[2025-10-24T20:33:46.692391] [INFO ] [REMOTE    ] PFLT: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T20:33:47.064961] [INFO ] [REMOTE    ] PFN: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T20:33:47.347716] [INFO ] [REMOTE    ] PFN: Fetching primary data for 2025-08.
[2025-10-24T20:33:47.362262] [INFO ] [REMOTE    ] PFO: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T20:33:48.147701] [INFO ] [REMOTE    ] PFS: Fetching primary data for 2025-03.
[2025-10-24T20:33:48.544359] [INFO ] [REMOTE    ] PFN: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T20:33:48.947720] [INFO ] [REMOTE    ] PFN: Fetching primary data for 2025-09.
[2025-10-24T20:33:49.752799] [INFO ] [REMOTE    ] PFO: Fetching primary data for 2025-08.
[2025-10-24T20:33:49.763447] [INFO ] [REMOTE    ] PFS: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T20:33:50.319201] [INFO ] [REMOTE    ] PFN: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T20:33:50.547632] [INFO ] [REMOTE    ] PFLT: Fetching primary data for 2025-07.
[2025-10-24T20:33:50.672043] [INFO ] [REMOTE    ] PFO: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T20:33:51.347685] [INFO ] [REMOTE    ] PFO: Fetching primary data for 2025-09.
[2025-10-24T20:33:52.147691] [INFO ] [REMOTE    ] PFN: Fetching primary data for 2025-10.
[2025-10-24T20:33:52.356229] [INFO ] [REMOTE    ] PFLT: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T20:33:52.399183] [INFO ] [REMOTE    ] PFO: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T20:33:52.947732] [INFO ] [REMOTE    ] PFS: Fetching primary data for 2025-04.
[2025-10-24T20:33:53.459465] [INFO ] [REMOTE    ] PFN: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T20:33:53.465315] [INFO ] [REMOTE    ] PFN: Full fetch complete (31419 records).
[2025-10-24T20:33:53.465433] [DEBUG] [VALIDATOR ] PFN: Validating primary data.
[2025-10-24T20:33:53.752929] [INFO ] [REMOTE    ] PFO: Fetching primary data for 2025-10.
[2025-10-24T20:33:53.898799] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present.
[2025-10-24T20:33:53.898925] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed.
[2025-10-24T20:33:53.900285] [INFO ] [MAIN      ] PFN: Fetched primary data is valid.
[2025-10-24T20:33:53.900357] [DEBUG] [LOCAL     ] PFN: Saving primary data.
[2025-10-24T20:33:53.900922] [FATAL] [LOCAL     ] PFN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:33:53.901052] [FATAL] [MAIN      ] PFN: Failed to save primary data.
[2025-10-24T20:33:53.901097] [WARN ] [MAIN      ] PFN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:33:53.901160] [INFO ] [LOCAL     ] PFN: Starting deletion of primary data.
[2025-10-24T20:33:53.901226] [DEBUG] [LOCAL     ] PFN: No primary data file found to delete.
[2025-10-24T20:33:53.901309] [INFO ] [LOCAL     ] PFN: Starting deletion of derivative data.
[2025-10-24T20:33:53.901533] [DEBUG] [LOCAL     ] PFN: Deleted derivative data file.
[2025-10-24T20:33:53.901678] [INFO ] [MAIN      ] Update Progress: 1664/2366 symbols completed. PFN took 30.3s. Estimated remaining: 1h 30m 13s. Rate: 7.8 symbols/min
[2025-10-24T20:33:54.099636] [INFO ] [MAIN      ] PFSI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:33:54.135475] [DEBUG] [LOCAL     ] PFSI: Loaded 29349 existing records from primary storage.
[2025-10-24T20:33:54.135855] [INFO ] [MAIN      ] PFSI: Loaded 29349 existing records.
[2025-10-24T20:33:54.329328] [WARN ] [MAIN      ] PFSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:33:54.329799] [INFO ] [MAIN      ] PFSI: Wiping existing primary data before full refresh.
[2025-10-24T20:33:54.329897] [INFO ] [LOCAL     ] PFSI: Starting deletion of primary data.
[2025-10-24T20:33:54.330291] [DEBUG] [LOCAL     ] PFSI: Deleted primary data file.
[2025-10-24T20:33:54.330347] [INFO ] [MAIN      ] PFSI: Starting full primary refresh.
[2025-10-24T20:33:54.561112] [INFO ] [REMOTE    ] PFLT: Fetching primary data for 2025-08.
[2025-10-24T20:33:54.619851] [INFO ] [REMOTE    ] PFS: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T20:33:54.651395] [INFO ] [REMOTE    ] PFO: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T20:33:54.676916] [INFO ] [REMOTE    ] PFO: Full fetch complete (7921 records).
[2025-10-24T20:33:54.677479] [DEBUG] [VALIDATOR ] PFO: Validating primary data.
[2025-10-24T20:33:54.860724] [INFO ] [REMOTE    ] PFSI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:33:55.129101] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present.
[2025-10-24T20:33:55.129177] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed.
[2025-10-24T20:33:55.129380] [INFO ] [MAIN      ] PFO: Fetched primary data is valid.
[2025-10-24T20:33:55.129418] [DEBUG] [LOCAL     ] PFO: Saving primary data.
[2025-10-24T20:33:55.129616] [FATAL] [LOCAL     ] PFO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:33:55.129718] [FATAL] [MAIN      ] PFO: Failed to save primary data.
[2025-10-24T20:33:55.129759] [WARN ] [MAIN      ] PFO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:33:55.129794] [INFO ] [LOCAL     ] PFO: Starting deletion of primary data.
[2025-10-24T20:33:55.129843] [DEBUG] [LOCAL     ] PFO: No primary data file found to delete.
[2025-10-24T20:33:55.129876] [INFO ] [LOCAL     ] PFO: Starting deletion of derivative data.
[2025-10-24T20:33:55.130048] [DEBUG] [LOCAL     ] PFO: Deleted derivative data file.
[2025-10-24T20:33:55.130138] [INFO ] [MAIN      ] Update Progress: 1665/2366 symbols completed. PFO took 29.7s. Estimated remaining: 1h 30m 3s. Rate: 7.8 symbols/min
[2025-10-24T20:33:55.296587] [INFO ] [MAIN      ] PG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:33:55.348519] [INFO ] [REMOTE    ] PFS: Fetching primary data for 2025-05.
[2025-10-24T20:33:55.350518] [DEBUG] [LOCAL     ] PG: Loaded 54143 existing records from primary storage.
[2025-10-24T20:33:55.350937] [INFO ] [MAIN      ] PG: Loaded 54143 existing records.
[2025-10-24T20:33:55.526854] [WARN ] [MAIN      ] PG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:33:55.527088] [INFO ] [MAIN      ] PG: Wiping existing primary data before full refresh.
[2025-10-24T20:33:55.527133] [INFO ] [LOCAL     ] PG: Starting deletion of primary data.
[2025-10-24T20:33:55.527453] [DEBUG] [LOCAL     ] PG: Deleted primary data file.
[2025-10-24T20:33:55.527508] [INFO ] [MAIN      ] PG: Starting full primary refresh.
[2025-10-24T20:33:55.873840] [INFO ] [REMOTE    ] PG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:33:56.147703] [INFO ] [REMOTE    ] PFSI: Fetching primary data for 2025-01.
[2025-10-24T20:33:56.546479] [INFO ] [REMOTE    ] PFLT: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T20:33:56.617095] [INFO ] [REMOTE    ] PFS: Incremental fetch complete for 2025-05 (1.27 seconds).
[2025-10-24T20:33:56.947687] [INFO ] [REMOTE    ] PFS: Fetching primary data for 2025-06.
[2025-10-24T20:33:57.718874] [INFO ] [REMOTE    ] PFSI: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T20:33:57.747617] [INFO ] [REMOTE    ] PFSI: Fetching primary data for 2025-02.
[2025-10-24T20:33:58.382731] [INFO ] [REMOTE    ] PFS: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T20:33:58.547711] [INFO ] [REMOTE    ] PFS: Fetching primary data for 2025-07.
[2025-10-24T20:33:59.114871] [INFO ] [REMOTE    ] PFSI: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T20:33:59.347686] [INFO ] [REMOTE    ] PG: Fetching primary data for 2025-01.
[2025-10-24T20:34:00.076313] [INFO ] [REMOTE    ] PFS: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T20:34:00.147599] [INFO ] [REMOTE    ] PFS: Fetching primary data for 2025-08.
[2025-10-24T20:34:00.187861] [INFO ] [REMOTE    ] PG: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T20:34:00.947715] [INFO ] [REMOTE    ] PFLT: Fetching primary data for 2025-09.
[2025-10-24T20:34:01.705699] [INFO ] [REMOTE    ] PFS: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T20:34:01.747802] [INFO ] [REMOTE    ] PFSI: Fetching primary data for 2025-03.
[2025-10-24T20:34:02.547682] [INFO ] [REMOTE    ] PG: Fetching primary data for 2025-02.
[2025-10-24T20:34:02.873366] [INFO ] [REMOTE    ] PFLT: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T20:34:03.255244] [INFO ] [REMOTE    ] PFSI: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T20:34:03.347683] [INFO ] [REMOTE    ] PFLT: Fetching primary data for 2025-10.
[2025-10-24T20:34:03.615288] [INFO ] [REMOTE    ] PG: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T20:34:04.147692] [INFO ] [REMOTE    ] PFS: Fetching primary data for 2025-09.
[2025-10-24T20:34:04.947616] [INFO ] [REMOTE    ] PG: Fetching primary data for 2025-03.
[2025-10-24T20:34:05.216862] [INFO ] [REMOTE    ] PFLT: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T20:34:05.227254] [INFO ] [REMOTE    ] PFLT: Full fetch complete (64372 records).
[2025-10-24T20:34:05.227431] [DEBUG] [VALIDATOR ] PFLT: Validating primary data.
[2025-10-24T20:34:05.655660] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present.
[2025-10-24T20:34:05.655744] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed.
[2025-10-24T20:34:05.656770] [INFO ] [MAIN      ] PFLT: Fetched primary data is valid.
[2025-10-24T20:34:05.656831] [DEBUG] [LOCAL     ] PFLT: Saving primary data.
[2025-10-24T20:34:05.657365] [FATAL] [LOCAL     ] PFLT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:34:05.657461] [FATAL] [MAIN      ] PFLT: Failed to save primary data.
[2025-10-24T20:34:05.657512] [WARN ] [MAIN      ] PFLT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:34:05.657555] [INFO ] [LOCAL     ] PFLT: Starting deletion of primary data.
[2025-10-24T20:34:05.657614] [DEBUG] [LOCAL     ] PFLT: No primary data file found to delete.
[2025-10-24T20:34:05.657675] [INFO ] [LOCAL     ] PFLT: Starting deletion of derivative data.
[2025-10-24T20:34:05.657897] [DEBUG] [LOCAL     ] PFLT: Deleted derivative data file.
[2025-10-24T20:34:05.658459] [INFO ] [MAIN      ] Update Progress: 1666/2366 symbols completed. PFLT took 42.9s. Estimated remaining: 1h 29m 56s. Rate: 7.8 symbols/min
[2025-10-24T20:34:05.750944] [INFO ] [REMOTE    ] PFSI: Fetching primary data for 2025-04.
[2025-10-24T20:34:05.835689] [INFO ] [MAIN      ] PGP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:34:05.862256] [INFO ] [REMOTE    ] PFS: Incremental fetch complete for 2025-09 (1.71 seconds).
[2025-10-24T20:34:05.874461] [DEBUG] [LOCAL     ] PGP: Loaded 5713 existing records from primary storage.
[2025-10-24T20:34:05.875213] [INFO ] [MAIN      ] PGP: Loaded 5713 existing records.
[2025-10-24T20:34:06.054894] [WARN ] [MAIN      ] PGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:34:06.055323] [INFO ] [MAIN      ] PGP: Wiping existing primary data before full refresh.
[2025-10-24T20:34:06.055433] [INFO ] [LOCAL     ] PGP: Starting deletion of primary data.
[2025-10-24T20:34:06.055765] [DEBUG] [LOCAL     ] PGP: Deleted primary data file.
[2025-10-24T20:34:06.055877] [INFO ] [MAIN      ] PGP: Starting full primary refresh.
[2025-10-24T20:34:06.397316] [INFO ] [REMOTE    ] PG: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T20:34:06.462695] [INFO ] [REMOTE    ] PGP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:34:06.547618] [INFO ] [REMOTE    ] PGP: Fetching primary data for 2025-01.
[2025-10-24T20:34:07.347689] [INFO ] [REMOTE    ] PG: Fetching primary data for 2025-04.
[2025-10-24T20:34:07.475916] [INFO ] [REMOTE    ] PFSI: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T20:34:07.655627] [INFO ] [REMOTE    ] PGP: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T20:34:08.147637] [INFO ] [REMOTE    ] PFS: Fetching primary data for 2025-10.
[2025-10-24T20:34:08.336894] [INFO ] [REMOTE    ] PG: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T20:34:08.947775] [INFO ] [REMOTE    ] PGP: Fetching primary data for 2025-02.
[2025-10-24T20:34:09.667510] [INFO ] [REMOTE    ] PFS: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T20:34:09.674877] [INFO ] [REMOTE    ] PFS: Full fetch complete (52270 records).
[2025-10-24T20:34:09.675000] [DEBUG] [VALIDATOR ] PFS: Validating primary data.
[2025-10-24T20:34:09.751616] [INFO ] [REMOTE    ] PG: Fetching primary data for 2025-05.
[2025-10-24T20:34:09.790907] [INFO ] [REMOTE    ] PGP: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T20:34:10.074243] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present.
[2025-10-24T20:34:10.074340] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed.
[2025-10-24T20:34:10.075335] [INFO ] [MAIN      ] PFS: Fetched primary data is valid.
[2025-10-24T20:34:10.075398] [DEBUG] [LOCAL     ] PFS: Saving primary data.
[2025-10-24T20:34:10.075922] [FATAL] [LOCAL     ] PFS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:34:10.076005] [FATAL] [MAIN      ] PFS: Failed to save primary data.
[2025-10-24T20:34:10.076047] [WARN ] [MAIN      ] PFS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:34:10.076086] [INFO ] [LOCAL     ] PFS: Starting deletion of primary data.
[2025-10-24T20:34:10.076139] [DEBUG] [LOCAL     ] PFS: No primary data file found to delete.
[2025-10-24T20:34:10.076174] [INFO ] [LOCAL     ] PFS: Starting deletion of derivative data.
[2025-10-24T20:34:10.076376] [DEBUG] [LOCAL     ] PFS: Deleted derivative data file.
[2025-10-24T20:34:10.076481] [INFO ] [MAIN      ] Update Progress: 1667/2366 symbols completed. PFS took 32.3s. Estimated remaining: 1h 29m 47s. Rate: 7.8 symbols/min
[2025-10-24T20:34:10.248788] [INFO ] [MAIN      ] PGR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:34:10.300516] [DEBUG] [LOCAL     ] PGR: Loaded 53254 existing records from primary storage.
[2025-10-24T20:34:10.300906] [INFO ] [MAIN      ] PGR: Loaded 53254 existing records.
[2025-10-24T20:34:10.485440] [WARN ] [MAIN      ] PGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:34:10.485668] [INFO ] [MAIN      ] PGR: Wiping existing primary data before full refresh.
[2025-10-24T20:34:10.485732] [INFO ] [LOCAL     ] PGR: Starting deletion of primary data.
[2025-10-24T20:34:10.486316] [DEBUG] [LOCAL     ] PGR: Deleted primary data file.
[2025-10-24T20:34:10.486385] [INFO ] [MAIN      ] PGR: Starting full primary refresh.
[2025-10-24T20:34:10.558674] [INFO ] [REMOTE    ] PFSI: Fetching primary data for 2025-05.
[2025-10-24T20:34:10.893046] [INFO ] [REMOTE    ] PGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:34:10.936946] [INFO ] [REMOTE    ] PG: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T20:34:11.347710] [INFO ] [REMOTE    ] PGR: Fetching primary data for 2025-01.
[2025-10-24T20:34:11.948209] [INFO ] [REMOTE    ] PFSI: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T20:34:12.147708] [INFO ] [REMOTE    ] PGP: Fetching primary data for 2025-03.
[2025-10-24T20:34:12.947886] [INFO ] [REMOTE    ] PGP: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T20:34:12.947629] [INFO ] [REMOTE    ] PG: Fetching primary data for 2025-06.
[2025-10-24T20:34:13.635316] [INFO ] [REMOTE    ] PGR: Incremental fetch complete for 2025-01 (2.29 seconds).
[2025-10-24T20:34:13.747690] [INFO ] [REMOTE    ] PGP: Fetching primary data for 2025-04.
[2025-10-24T20:34:14.017772] [INFO ] [REMOTE    ] PG: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T20:34:14.547637] [INFO ] [REMOTE    ] PGR: Fetching primary data for 2025-02.
[2025-10-24T20:34:14.588480] [INFO ] [REMOTE    ] PGP: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T20:34:15.347723] [INFO ] [REMOTE    ] PFSI: Fetching primary data for 2025-06.
[2025-10-24T20:34:16.147729] [INFO ] [REMOTE    ] PGP: Fetching primary data for 2025-05.
[2025-10-24T20:34:16.659030] [INFO ] [REMOTE    ] PGP: Incremental fetch complete for 2025-05 (0.51 seconds).
[2025-10-24T20:34:16.674958] [INFO ] [REMOTE    ] PFSI: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T20:34:16.708911] [INFO ] [REMOTE    ] PGR: Incremental fetch complete for 2025-02 (2.16 seconds).
[2025-10-24T20:34:16.947704] [INFO ] [REMOTE    ] PGR: Fetching primary data for 2025-03.
[2025-10-24T20:34:17.747718] [INFO ] [REMOTE    ] PG: Fetching primary data for 2025-07.
[2025-10-24T20:34:18.547820] [INFO ] [REMOTE    ] PFSI: Fetching primary data for 2025-07.
[2025-10-24T20:34:18.885298] [INFO ] [REMOTE    ] PG: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T20:34:19.189510] [INFO ] [REMOTE    ] PGR: Incremental fetch complete for 2025-03 (2.24 seconds).
[2025-10-24T20:34:19.347613] [INFO ] [REMOTE    ] PG: Fetching primary data for 2025-08.
[2025-10-24T20:34:19.810274] [INFO ] [REMOTE    ] PFSI: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T20:34:20.147616] [INFO ] [REMOTE    ] PGR: Fetching primary data for 2025-04.
[2025-10-24T20:34:20.317680] [INFO ] [REMOTE    ] PG: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T20:34:20.947717] [INFO ] [REMOTE    ] PFSI: Fetching primary data for 2025-08.
[2025-10-24T20:34:21.747637] [INFO ] [REMOTE    ] PGP: Fetching primary data for 2025-06.
[2025-10-24T20:34:22.226912] [INFO ] [REMOTE    ] PGR: Incremental fetch complete for 2025-04 (2.08 seconds).
[2025-10-24T20:34:22.393574] [INFO ] [REMOTE    ] PFSI: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T20:34:22.492691] [INFO ] [REMOTE    ] PGP: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T20:34:22.547689] [INFO ] [REMOTE    ] PGP: Fetching primary data for 2025-07.
[2025-10-24T20:34:23.340513] [INFO ] [REMOTE    ] PGP: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T20:34:23.347596] [INFO ] [REMOTE    ] PGP: Fetching primary data for 2025-08.
[2025-10-24T20:34:23.975918] [INFO ] [REMOTE    ] PGP: Incremental fetch complete for 2025-08 (0.63 seconds).
[2025-10-24T20:34:24.147714] [INFO ] [REMOTE    ] PG: Fetching primary data for 2025-09.
[2025-10-24T20:34:24.947608] [INFO ] [REMOTE    ] PFSI: Fetching primary data for 2025-09.
[2025-10-24T20:34:25.236429] [INFO ] [REMOTE    ] PG: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T20:34:25.747638] [INFO ] [REMOTE    ] PG: Fetching primary data for 2025-10.
[2025-10-24T20:34:26.524209] [INFO ] [REMOTE    ] PFSI: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T20:34:26.547605] [INFO ] [REMOTE    ] PFSI: Fetching primary data for 2025-10.
[2025-10-24T20:34:26.722371] [INFO ] [REMOTE    ] PG: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T20:34:26.733217] [INFO ] [REMOTE    ] PG: Full fetch complete (77538 records).
[2025-10-24T20:34:26.733423] [DEBUG] [VALIDATOR ] PG: Validating primary data.
[2025-10-24T20:34:26.734565] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:34:26.734694] [FATAL] [MAIN      ] PG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:34:26.734765] [WARN ] [MAIN      ] PG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:34:26.734842] [INFO ] [LOCAL     ] PG: Starting deletion of primary data.
[2025-10-24T20:34:26.734917] [DEBUG] [LOCAL     ] PG: No primary data file found to delete.
[2025-10-24T20:34:26.734955] [INFO ] [LOCAL     ] PG: Starting deletion of derivative data.
[2025-10-24T20:34:26.735149] [DEBUG] [LOCAL     ] PG: Deleted derivative data file.
[2025-10-24T20:34:26.735514] [INFO ] [MAIN      ] Update Progress: 1668/2366 symbols completed. PG took 31.6s. Estimated remaining: 1h 29m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:34:26.910431] [INFO ] [MAIN      ] PGRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:34:26.954601] [DEBUG] [LOCAL     ] PGRE: Loaded 47324 existing records from primary storage.
[2025-10-24T20:34:26.954999] [INFO ] [MAIN      ] PGRE: Loaded 47324 existing records.
[2025-10-24T20:34:27.135602] [WARN ] [MAIN      ] PGRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:34:27.135839] [INFO ] [MAIN      ] PGRE: Wiping existing primary data before full refresh.
[2025-10-24T20:34:27.135887] [INFO ] [LOCAL     ] PGRE: Starting deletion of primary data.
[2025-10-24T20:34:27.136196] [DEBUG] [LOCAL     ] PGRE: Deleted primary data file.
[2025-10-24T20:34:27.136252] [INFO ] [MAIN      ] PGRE: Starting full primary refresh.
[2025-10-24T20:34:27.360075] [INFO ] [REMOTE    ] PGR: Fetching primary data for 2025-05.
[2025-10-24T20:34:27.483080] [INFO ] [REMOTE    ] PGRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:34:27.998506] [INFO ] [REMOTE    ] PFSI: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T20:34:28.007531] [INFO ] [REMOTE    ] PFSI: Full fetch complete (41941 records).
[2025-10-24T20:34:28.007778] [DEBUG] [VALIDATOR ] PFSI: Validating primary data.
[2025-10-24T20:34:28.155464] [INFO ] [REMOTE    ] PGRE: Fetching primary data for 2025-01.
[2025-10-24T20:34:28.385017] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present.
[2025-10-24T20:34:28.385097] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed.
[2025-10-24T20:34:28.385957] [INFO ] [MAIN      ] PFSI: Fetched primary data is valid.
[2025-10-24T20:34:28.386020] [DEBUG] [LOCAL     ] PFSI: Saving primary data.
[2025-10-24T20:34:28.386393] [FATAL] [LOCAL     ] PFSI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:34:28.386496] [FATAL] [MAIN      ] PFSI: Failed to save primary data.
[2025-10-24T20:34:28.386570] [WARN ] [MAIN      ] PFSI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:34:28.386637] [INFO ] [LOCAL     ] PFSI: Starting deletion of primary data.
[2025-10-24T20:34:28.386766] [DEBUG] [LOCAL     ] PFSI: No primary data file found to delete.
[2025-10-24T20:34:28.386823] [INFO ] [LOCAL     ] PFSI: Starting deletion of derivative data.
[2025-10-24T20:34:28.386982] [DEBUG] [LOCAL     ] PFSI: Deleted derivative data file.
[2025-10-24T20:34:28.387078] [INFO ] [MAIN      ] Update Progress: 1669/2366 symbols completed. PFSI took 34.5s. Estimated remaining: 1h 29m 33s. Rate: 7.8 symbols/min
[2025-10-24T20:34:28.554551] [INFO ] [MAIN      ] PGZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:34:28.563157] [DEBUG] [LOCAL     ] PGZ: Loaded 5521 existing records from primary storage.
[2025-10-24T20:34:28.563388] [INFO ] [MAIN      ] PGZ: Loaded 5521 existing records.
[2025-10-24T20:34:28.743624] [WARN ] [MAIN      ] PGZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:34:28.743865] [INFO ] [MAIN      ] PGZ: Wiping existing primary data before full refresh.
[2025-10-24T20:34:28.743912] [INFO ] [LOCAL     ] PGZ: Starting deletion of primary data.
[2025-10-24T20:34:28.744080] [DEBUG] [LOCAL     ] PGZ: Deleted primary data file.
[2025-10-24T20:34:28.744135] [INFO ] [MAIN      ] PGZ: Starting full primary refresh.
[2025-10-24T20:34:28.963490] [INFO ] [REMOTE    ] PGP: Fetching primary data for 2025-09.
[2025-10-24T20:34:29.102265] [INFO ] [REMOTE    ] PGZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:34:29.508609] [INFO ] [REMOTE    ] PGR: Incremental fetch complete for 2025-05 (2.15 seconds).
[2025-10-24T20:34:29.747618] [INFO ] [REMOTE    ] PGZ: Fetching primary data for 2025-01.
[2025-10-24T20:34:29.885978] [INFO ] [REMOTE    ] PGP: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T20:34:30.166044] [INFO ] [REMOTE    ] PGRE: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T20:34:30.547725] [INFO ] [REMOTE    ] PGR: Fetching primary data for 2025-06.
[2025-10-24T20:34:30.595958] [INFO ] [REMOTE    ] PGZ: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T20:34:31.347690] [INFO ] [REMOTE    ] PGRE: Fetching primary data for 2025-02.
[2025-10-24T20:34:32.147753] [INFO ] [REMOTE    ] PGZ: Fetching primary data for 2025-02.
[2025-10-24T20:34:32.329150] [INFO ] [REMOTE    ] PGR: Incremental fetch complete for 2025-06 (1.78 seconds).
[2025-10-24T20:34:32.796929] [INFO ] [REMOTE    ] PGRE: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T20:34:32.916135] [INFO ] [REMOTE    ] PGZ: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T20:34:32.947638] [INFO ] [REMOTE    ] PGRE: Fetching primary data for 2025-03.
[2025-10-24T20:34:33.747754] [INFO ] [REMOTE    ] PGR: Fetching primary data for 2025-07.
[2025-10-24T20:34:34.452437] [INFO ] [REMOTE    ] PGRE: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T20:34:34.547610] [INFO ] [REMOTE    ] PGRE: Fetching primary data for 2025-04.
[2025-10-24T20:34:35.347736] [INFO ] [REMOTE    ] PGP: Fetching primary data for 2025-10.
[2025-10-24T20:34:35.989739] [INFO ] [REMOTE    ] PGR: Incremental fetch complete for 2025-07 (2.24 seconds).
[2025-10-24T20:34:36.147688] [INFO ] [REMOTE    ] PGR: Fetching primary data for 2025-08.
[2025-10-24T20:34:36.225918] [INFO ] [REMOTE    ] PGRE: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T20:34:36.254487] [INFO ] [REMOTE    ] PGP: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T20:34:36.256616] [INFO ] [REMOTE    ] PGP: Full fetch complete (7975 records).
[2025-10-24T20:34:36.256727] [DEBUG] [VALIDATOR ] PGP: Validating primary data.
[2025-10-24T20:34:36.637553] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present.
[2025-10-24T20:34:36.637631] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed.
[2025-10-24T20:34:36.637901] [INFO ] [MAIN      ] PGP: Fetched primary data is valid.
[2025-10-24T20:34:36.637948] [DEBUG] [LOCAL     ] PGP: Saving primary data.
[2025-10-24T20:34:36.638155] [FATAL] [LOCAL     ] PGP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:34:36.638239] [FATAL] [MAIN      ] PGP: Failed to save primary data.
[2025-10-24T20:34:36.638283] [WARN ] [MAIN      ] PGP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:34:36.638317] [INFO ] [LOCAL     ] PGP: Starting deletion of primary data.
[2025-10-24T20:34:36.638366] [DEBUG] [LOCAL     ] PGP: No primary data file found to delete.
[2025-10-24T20:34:36.638400] [INFO ] [LOCAL     ] PGP: Starting deletion of derivative data.
[2025-10-24T20:34:36.638591] [DEBUG] [LOCAL     ] PGP: Deleted derivative data file.
[2025-10-24T20:34:36.638714] [INFO ] [MAIN      ] Update Progress: 1670/2366 symbols completed. PGP took 31.0s. Estimated remaining: 1h 29m 25s. Rate: 7.8 symbols/min
[2025-10-24T20:34:36.803737] [INFO ] [MAIN      ] PH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:34:36.839007] [DEBUG] [LOCAL     ] PH: Loaded 36710 existing records from primary storage.
[2025-10-24T20:34:36.839271] [INFO ] [MAIN      ] PH: Loaded 36710 existing records.
[2025-10-24T20:34:36.952952] [INFO ] [REMOTE    ] PGRE: Fetching primary data for 2025-05.
[2025-10-24T20:34:37.019171] [WARN ] [MAIN      ] PH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:34:37.019710] [INFO ] [MAIN      ] PH: Wiping existing primary data before full refresh.
[2025-10-24T20:34:37.019802] [INFO ] [LOCAL     ] PH: Starting deletion of primary data.
[2025-10-24T20:34:37.020205] [DEBUG] [LOCAL     ] PH: Deleted primary data file.
[2025-10-24T20:34:37.020313] [INFO ] [MAIN      ] PH: Starting full primary refresh.
[2025-10-24T20:34:37.379167] [INFO ] [REMOTE    ] PH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:34:37.747742] [INFO ] [REMOTE    ] PGZ: Fetching primary data for 2025-03.
[2025-10-24T20:34:38.521240] [INFO ] [REMOTE    ] PGZ: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T20:34:38.525373] [INFO ] [REMOTE    ] PGR: Incremental fetch complete for 2025-08 (2.38 seconds).
[2025-10-24T20:34:38.547608] [INFO ] [REMOTE    ] PGR: Fetching primary data for 2025-09.
[2025-10-24T20:34:39.347721] [INFO ] [REMOTE    ] PH: Fetching primary data for 2025-01.
[2025-10-24T20:34:40.147789] [INFO ] [REMOTE    ] PGZ: Fetching primary data for 2025-04.
[2025-10-24T20:34:40.696591] [INFO ] [REMOTE    ] PGR: Incremental fetch complete for 2025-09 (2.15 seconds).
[2025-10-24T20:34:40.927966] [INFO ] [REMOTE    ] PGZ: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:34:40.947626] [INFO ] [REMOTE    ] PGZ: Fetching primary data for 2025-05.
[2025-10-24T20:34:41.747697] [INFO ] [REMOTE    ] PGR: Fetching primary data for 2025-10.
[2025-10-24T20:34:41.867214] [INFO ] [REMOTE    ] PGZ: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T20:34:42.547752] [INFO ] [REMOTE    ] PGZ: Fetching primary data for 2025-06.
[2025-10-24T20:34:43.236184] [INFO ] [REMOTE    ] PGZ: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T20:34:43.347758] [INFO ] [REMOTE    ] PGZ: Fetching primary data for 2025-07.
[2025-10-24T20:34:43.678827] [INFO ] [REMOTE    ] PGR: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T20:34:43.688690] [INFO ] [REMOTE    ] PGR: Full fetch complete (76795 records).
[2025-10-24T20:34:43.688843] [DEBUG] [VALIDATOR ] PGR: Validating primary data.
[2025-10-24T20:34:44.076158] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present.
[2025-10-24T20:34:44.076260] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed.
[2025-10-24T20:34:44.077394] [INFO ] [MAIN      ] PGR: Fetched primary data is valid.
[2025-10-24T20:34:44.077456] [DEBUG] [LOCAL     ] PGR: Saving primary data.
[2025-10-24T20:34:44.078056] [FATAL] [LOCAL     ] PGR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:34:44.078143] [FATAL] [MAIN      ] PGR: Failed to save primary data.
[2025-10-24T20:34:44.078184] [WARN ] [MAIN      ] PGR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:34:44.078221] [INFO ] [LOCAL     ] PGR: Starting deletion of primary data.
[2025-10-24T20:34:44.078273] [DEBUG] [LOCAL     ] PGR: No primary data file found to delete.
[2025-10-24T20:34:44.078309] [INFO ] [LOCAL     ] PGR: Starting deletion of derivative data.
[2025-10-24T20:34:44.078488] [DEBUG] [LOCAL     ] PGR: Deleted derivative data file.
[2025-10-24T20:34:44.078719] [INFO ] [MAIN      ] Update Progress: 1671/2366 symbols completed. PGR took 34.0s. Estimated remaining: 1h 29m 18s. Rate: 7.8 symbols/min
[2025-10-24T20:34:44.210278] [INFO ] [REMOTE    ] PGZ: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T20:34:44.236381] [INFO ] [REMOTE    ] PGZ: Fetching primary data for 2025-08.
[2025-10-24T20:34:44.256482] [INFO ] [MAIN      ] PHG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:34:44.297895] [DEBUG] [LOCAL     ] PHG: Loaded 45790 existing records from primary storage.
[2025-10-24T20:34:44.298186] [INFO ] [MAIN      ] PHG: Loaded 45790 existing records.
[2025-10-24T20:34:44.470826] [WARN ] [MAIN      ] PHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:34:44.471011] [INFO ] [MAIN      ] PHG: Wiping existing primary data before full refresh.
[2025-10-24T20:34:44.471056] [INFO ] [LOCAL     ] PHG: Starting deletion of primary data.
[2025-10-24T20:34:44.471386] [DEBUG] [LOCAL     ] PHG: Deleted primary data file.
[2025-10-24T20:34:44.471423] [INFO ] [MAIN      ] PHG: Starting full primary refresh.
[2025-10-24T20:34:44.825235] [INFO ] [REMOTE    ] PHG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:34:44.953976] [INFO ] [REMOTE    ] PHG: Fetching primary data for 2025-01.
[2025-10-24T20:34:44.959677] [INFO ] [REMOTE    ] PGRE: Incremental fetch complete for 2025-05 (8.01 seconds).
[2025-10-24T20:34:45.115829] [INFO ] [REMOTE    ] PGZ: Incremental fetch complete for 2025-08 (0.88 seconds).
[2025-10-24T20:34:45.747775] [INFO ] [REMOTE    ] PGZ: Fetching primary data for 2025-09.
[2025-10-24T20:34:46.466091] [INFO ] [REMOTE    ] PGZ: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T20:34:46.547636] [INFO ] [REMOTE    ] PGZ: Fetching primary data for 2025-10.
[2025-10-24T20:34:46.916364] [INFO ] [REMOTE    ] PHG: Incremental fetch complete for 2025-01 (1.96 seconds).
[2025-10-24T20:34:46.977640] [INFO ] [REMOTE    ] PH: Incremental fetch complete for 2025-01 (7.63 seconds).
[2025-10-24T20:34:47.277917] [INFO ] [REMOTE    ] PGZ: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T20:34:47.279675] [INFO ] [REMOTE    ] PGZ: Full fetch complete (8160 records).
[2025-10-24T20:34:47.279755] [DEBUG] [VALIDATOR ] PGZ: Validating primary data.
[2025-10-24T20:34:47.353165] [INFO ] [REMOTE    ] PH: Fetching primary data for 2025-02.
[2025-10-24T20:34:47.678624] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present.
[2025-10-24T20:34:47.678756] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed.
[2025-10-24T20:34:47.679062] [INFO ] [MAIN      ] PGZ: Fetched primary data is valid.
[2025-10-24T20:34:47.679106] [DEBUG] [LOCAL     ] PGZ: Saving primary data.
[2025-10-24T20:34:47.679358] [FATAL] [LOCAL     ] PGZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:34:47.679471] [FATAL] [MAIN      ] PGZ: Failed to save primary data.
[2025-10-24T20:34:47.679540] [WARN ] [MAIN      ] PGZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:34:47.679576] [INFO ] [LOCAL     ] PGZ: Starting deletion of primary data.
[2025-10-24T20:34:47.679628] [DEBUG] [LOCAL     ] PGZ: No primary data file found to delete.
[2025-10-24T20:34:47.679703] [INFO ] [LOCAL     ] PGZ: Starting deletion of derivative data.
[2025-10-24T20:34:47.679981] [DEBUG] [LOCAL     ] PGZ: Deleted derivative data file.
[2025-10-24T20:34:47.680083] [INFO ] [MAIN      ] Update Progress: 1672/2366 symbols completed. PGZ took 19.3s. Estimated remaining: 1h 29m 8s. Rate: 7.8 symbols/min
[2025-10-24T20:34:47.866841] [INFO ] [MAIN      ] PHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:34:47.887858] [DEBUG] [LOCAL     ] PHI: Loaded 15292 existing records from primary storage.
[2025-10-24T20:34:47.888189] [INFO ] [MAIN      ] PHI: Loaded 15292 existing records.
[2025-10-24T20:34:48.095778] [WARN ] [MAIN      ] PHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:34:48.096087] [INFO ] [MAIN      ] PHI: Wiping existing primary data before full refresh.
[2025-10-24T20:34:48.096163] [INFO ] [LOCAL     ] PHI: Starting deletion of primary data.
[2025-10-24T20:34:48.096497] [DEBUG] [LOCAL     ] PHI: Deleted primary data file.
[2025-10-24T20:34:48.096544] [INFO ] [MAIN      ] PHI: Starting full primary refresh.
[2025-10-24T20:34:48.159751] [INFO ] [REMOTE    ] PHG: Fetching primary data for 2025-02.
[2025-10-24T20:34:48.480678] [INFO ] [REMOTE    ] PHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:34:48.947724] [INFO ] [REMOTE    ] PHI: Fetching primary data for 2025-01.
[2025-10-24T20:34:49.223524] [INFO ] [REMOTE    ] PH: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T20:34:49.747691] [INFO ] [REMOTE    ] PGRE: Fetching primary data for 2025-06.
[2025-10-24T20:34:49.989732] [INFO ] [REMOTE    ] PHG: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T20:34:50.280474] [INFO ] [REMOTE    ] PHI: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T20:34:50.547687] [INFO ] [REMOTE    ] PH: Fetching primary data for 2025-03.
[2025-10-24T20:34:51.347684] [INFO ] [REMOTE    ] PHG: Fetching primary data for 2025-03.
[2025-10-24T20:34:51.445175] [INFO ] [REMOTE    ] PGRE: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T20:34:52.147633] [INFO ] [REMOTE    ] PGRE: Fetching primary data for 2025-07.
[2025-10-24T20:34:52.563470] [INFO ] [REMOTE    ] PH: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T20:34:52.947737] [INFO ] [REMOTE    ] PHI: Fetching primary data for 2025-02.
[2025-10-24T20:34:53.304687] [INFO ] [REMOTE    ] PHG: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T20:34:53.747679] [INFO ] [REMOTE    ] PH: Fetching primary data for 2025-04.
[2025-10-24T20:34:53.882864] [INFO ] [REMOTE    ] PHI: Incremental fetch complete for 2025-02 (0.94 seconds).
[2025-10-24T20:34:54.058530] [INFO ] [REMOTE    ] PGRE: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T20:34:54.547704] [INFO ] [REMOTE    ] PHG: Fetching primary data for 2025-04.
[2025-10-24T20:34:55.347751] [INFO ] [REMOTE    ] PHI: Fetching primary data for 2025-03.
[2025-10-24T20:34:55.629249] [INFO ] [REMOTE    ] PH: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T20:34:56.147619] [INFO ] [REMOTE    ] PH: Fetching primary data for 2025-05.
[2025-10-24T20:34:56.335466] [INFO ] [REMOTE    ] PHG: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T20:34:56.458968] [INFO ] [REMOTE    ] PHI: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T20:34:56.947682] [INFO ] [REMOTE    ] PGRE: Fetching primary data for 2025-08.
[2025-10-24T20:34:57.747678] [INFO ] [REMOTE    ] PHI: Fetching primary data for 2025-04.
[2025-10-24T20:34:57.835325] [INFO ] [REMOTE    ] PH: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T20:34:58.547630] [INFO ] [REMOTE    ] PHG: Fetching primary data for 2025-05.
[2025-10-24T20:34:58.900062] [INFO ] [REMOTE    ] PHI: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T20:34:59.347715] [INFO ] [REMOTE    ] PHI: Fetching primary data for 2025-05.
[2025-10-24T20:34:59.619603] [INFO ] [REMOTE    ] PGRE: Incremental fetch complete for 2025-08 (2.67 seconds).
[2025-10-24T20:35:00.147678] [INFO ] [REMOTE    ] PH: Fetching primary data for 2025-06.
[2025-10-24T20:35:00.453167] [INFO ] [REMOTE    ] PHG: Incremental fetch complete for 2025-05 (1.91 seconds).
[2025-10-24T20:35:00.716019] [INFO ] [REMOTE    ] PHI: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T20:35:00.947690] [INFO ] [REMOTE    ] PGRE: Fetching primary data for 2025-09.
[2025-10-24T20:35:01.747734] [INFO ] [REMOTE    ] PHI: Fetching primary data for 2025-06.
[2025-10-24T20:35:02.138527] [INFO ] [REMOTE    ] PH: Incremental fetch complete for 2025-06 (1.99 seconds).
[2025-10-24T20:35:02.373120] [INFO ] [REMOTE    ] PGRE: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T20:35:02.547717] [INFO ] [REMOTE    ] PHG: Fetching primary data for 2025-06.
[2025-10-24T20:35:02.774853] [INFO ] [REMOTE    ] PHI: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T20:35:03.347700] [INFO ] [REMOTE    ] PGRE: Fetching primary data for 2025-10.
[2025-10-24T20:35:04.147615] [INFO ] [REMOTE    ] PH: Fetching primary data for 2025-07.
[2025-10-24T20:35:04.336103] [INFO ] [REMOTE    ] PHG: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T20:35:04.947618] [INFO ] [REMOTE    ] PHG: Fetching primary data for 2025-07.
[2025-10-24T20:35:04.980586] [INFO ] [REMOTE    ] PGRE: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T20:35:04.988880] [INFO ] [REMOTE    ] PGRE: Full fetch complete (64671 records).
[2025-10-24T20:35:04.989002] [DEBUG] [VALIDATOR ] PGRE: Validating primary data.
[2025-10-24T20:35:05.408295] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present.
[2025-10-24T20:35:05.408392] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed.
[2025-10-24T20:35:05.409504] [INFO ] [MAIN      ] PGRE: Fetched primary data is valid.
[2025-10-24T20:35:05.409597] [DEBUG] [LOCAL     ] PGRE: Saving primary data.
[2025-10-24T20:35:05.410241] [FATAL] [LOCAL     ] PGRE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:35:05.410840] [FATAL] [MAIN      ] PGRE: Failed to save primary data.
[2025-10-24T20:35:05.410907] [WARN ] [MAIN      ] PGRE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:35:05.410975] [INFO ] [LOCAL     ] PGRE: Starting deletion of primary data.
[2025-10-24T20:35:05.411050] [DEBUG] [LOCAL     ] PGRE: No primary data file found to delete.
[2025-10-24T20:35:05.411104] [INFO ] [LOCAL     ] PGRE: Starting deletion of derivative data.
[2025-10-24T20:35:05.411630] [DEBUG] [LOCAL     ] PGRE: Deleted derivative data file.
[2025-10-24T20:35:05.411757] [INFO ] [MAIN      ] Update Progress: 1673/2366 symbols completed. PGRE took 38.7s. Estimated remaining: 1h 29m 5s. Rate: 7.8 symbols/min
[2025-10-24T20:35:05.581188] [INFO ] [MAIN      ] PHIN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:35:05.601974] [INFO ] [REMOTE    ] PH: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T20:35:05.634827] [DEBUG] [LOCAL     ] PHIN: Loaded 31596 existing records from primary storage.
[2025-10-24T20:35:05.635094] [INFO ] [MAIN      ] PHIN: Loaded 31596 existing records.
[2025-10-24T20:35:05.752729] [INFO ] [REMOTE    ] PH: Fetching primary data for 2025-08.
[2025-10-24T20:35:05.817162] [WARN ] [MAIN      ] PHIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:35:05.817375] [INFO ] [MAIN      ] PHIN: Wiping existing primary data before full refresh.
[2025-10-24T20:35:05.817445] [INFO ] [LOCAL     ] PHIN: Starting deletion of primary data.
[2025-10-24T20:35:05.817676] [DEBUG] [LOCAL     ] PHIN: Deleted primary data file.
[2025-10-24T20:35:05.817733] [INFO ] [MAIN      ] PHIN: Starting full primary refresh.
[2025-10-24T20:35:06.176189] [INFO ] [REMOTE    ] PHIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:35:06.547673] [INFO ] [REMOTE    ] PHIN: Fetching primary data for 2025-01.
[2025-10-24T20:35:06.984127] [INFO ] [REMOTE    ] PHG: Incremental fetch complete for 2025-07 (2.04 seconds).
[2025-10-24T20:35:07.347684] [INFO ] [REMOTE    ] PHG: Fetching primary data for 2025-08.
[2025-10-24T20:35:07.588587] [INFO ] [REMOTE    ] PH: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T20:35:07.659053] [INFO ] [REMOTE    ] PHIN: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T20:35:08.147725] [INFO ] [REMOTE    ] PH: Fetching primary data for 2025-09.
[2025-10-24T20:35:08.854397] [INFO ] [REMOTE    ] PHG: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T20:35:08.947616] [INFO ] [REMOTE    ] PHG: Fetching primary data for 2025-09.
[2025-10-24T20:35:09.257377] [INFO ] [REMOTE    ] PH: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T20:35:09.747718] [INFO ] [REMOTE    ] PHIN: Fetching primary data for 2025-02.
[2025-10-24T20:35:10.492297] [INFO ] [REMOTE    ] PHG: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T20:35:10.547613] [INFO ] [REMOTE    ] PHG: Fetching primary data for 2025-10.
[2025-10-24T20:35:11.191598] [INFO ] [REMOTE    ] PHIN: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T20:35:11.347723] [INFO ] [REMOTE    ] PHI: Fetching primary data for 2025-07.
[2025-10-24T20:35:12.156682] [INFO ] [REMOTE    ] PH: Fetching primary data for 2025-10.
[2025-10-24T20:35:12.159349] [INFO ] [REMOTE    ] PHG: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T20:35:12.167563] [INFO ] [REMOTE    ] PHG: Full fetch complete (65771 records).
[2025-10-24T20:35:12.167734] [DEBUG] [VALIDATOR ] PHG: Validating primary data.
[2025-10-24T20:35:12.490121] [INFO ] [REMOTE    ] PHI: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T20:35:12.586680] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present.
[2025-10-24T20:35:12.586775] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed.
[2025-10-24T20:35:12.587887] [INFO ] [MAIN      ] PHG: Fetched primary data is valid.
[2025-10-24T20:35:12.587950] [DEBUG] [LOCAL     ] PHG: Saving primary data.
[2025-10-24T20:35:12.588530] [FATAL] [LOCAL     ] PHG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:35:12.588611] [FATAL] [MAIN      ] PHG: Failed to save primary data.
[2025-10-24T20:35:12.588701] [WARN ] [MAIN      ] PHG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:35:12.588769] [INFO ] [LOCAL     ] PHG: Starting deletion of primary data.
[2025-10-24T20:35:12.588829] [DEBUG] [LOCAL     ] PHG: No primary data file found to delete.
[2025-10-24T20:35:12.588865] [INFO ] [LOCAL     ] PHG: Starting deletion of derivative data.
[2025-10-24T20:35:12.589026] [DEBUG] [LOCAL     ] PHG: Deleted derivative data file.
[2025-10-24T20:35:12.589635] [INFO ] [MAIN      ] Update Progress: 1674/2366 symbols completed. PHG took 28.5s. Estimated remaining: 1h 28m 57s. Rate: 7.8 symbols/min
[2025-10-24T20:35:12.757137] [INFO ] [MAIN      ] PHK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:35:12.757307] [DEBUG] [LOCAL     ] PHK: No existing data file found in primary storage.
[2025-10-24T20:35:12.757370] [WARN ] [MAIN      ] PHK: No existing data found, performing full refresh instead.
[2025-10-24T20:35:12.757481] [INFO ] [MAIN      ] PHK: Wiping existing primary data before full refresh.
[2025-10-24T20:35:12.757521] [INFO ] [LOCAL     ] PHK: Starting deletion of primary data.
[2025-10-24T20:35:12.757580] [DEBUG] [LOCAL     ] PHK: No primary data file found to delete.
[2025-10-24T20:35:12.757612] [INFO ] [MAIN      ] PHK: Starting full primary refresh.
[2025-10-24T20:35:12.955885] [INFO ] [REMOTE    ] PHIN: Fetching primary data for 2025-03.
[2025-10-24T20:35:13.112045] [INFO ] [REMOTE    ] PHK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:35:13.665248] [INFO ] [REMOTE    ] PH: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T20:35:13.671320] [INFO ] [REMOTE    ] PH: Full fetch complete (55623 records).
[2025-10-24T20:35:13.671469] [DEBUG] [VALIDATOR ] PH: Validating primary data.
[2025-10-24T20:35:13.752765] [INFO ] [REMOTE    ] PHI: Fetching primary data for 2025-08.
[2025-10-24T20:35:14.058344] [DEBUG] [VALIDATOR ] PH: All expected trading days are present.
[2025-10-24T20:35:14.058432] [DEBUG] [VALIDATOR ] PH: Primary data validation passed.
[2025-10-24T20:35:14.059446] [INFO ] [MAIN      ] PH: Fetched primary data is valid.
[2025-10-24T20:35:14.059510] [DEBUG] [LOCAL     ] PH: Saving primary data.
[2025-10-24T20:35:14.060074] [FATAL] [LOCAL     ] PH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:35:14.060163] [FATAL] [MAIN      ] PH: Failed to save primary data.
[2025-10-24T20:35:14.060205] [WARN ] [MAIN      ] PH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:35:14.060250] [INFO ] [LOCAL     ] PH: Starting deletion of primary data.
[2025-10-24T20:35:14.060325] [DEBUG] [LOCAL     ] PH: No primary data file found to delete.
[2025-10-24T20:35:14.060362] [INFO ] [LOCAL     ] PH: Starting deletion of derivative data.
[2025-10-24T20:35:14.060544] [DEBUG] [LOCAL     ] PH: Deleted derivative data file.
[2025-10-24T20:35:14.060936] [INFO ] [MAIN      ] Update Progress: 1675/2366 symbols completed. PH took 37.4s. Estimated remaining: 1h 28m 46s. Rate: 7.8 symbols/min
[2025-10-24T20:35:14.252634] [INFO ] [MAIN      ] PHM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:35:14.314189] [DEBUG] [LOCAL     ] PHM: Loaded 52071 existing records from primary storage.
[2025-10-24T20:35:14.314538] [INFO ] [MAIN      ] PHM: Loaded 52071 existing records.
[2025-10-24T20:35:14.505369] [WARN ] [MAIN      ] PHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:35:14.505586] [INFO ] [MAIN      ] PHM: Wiping existing primary data before full refresh.
[2025-10-24T20:35:14.505631] [INFO ] [LOCAL     ] PHM: Starting deletion of primary data.
[2025-10-24T20:35:14.506174] [DEBUG] [LOCAL     ] PHM: Deleted primary data file.
[2025-10-24T20:35:14.506217] [INFO ] [MAIN      ] PHM: Starting full primary refresh.
[2025-10-24T20:35:14.548681] [INFO ] [REMOTE    ] PHK: Fetching primary data for 2025-01.
[2025-10-24T20:35:14.849242] [INFO ] [REMOTE    ] PHI: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T20:35:14.878360] [INFO ] [REMOTE    ] PHM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:35:14.905137] [INFO ] [REMOTE    ] PHIN: Incremental fetch complete for 2025-03 (1.95 seconds).
[2025-10-24T20:35:15.347682] [INFO ] [REMOTE    ] PHI: Fetching primary data for 2025-09.
[2025-10-24T20:35:16.147638] [INFO ] [REMOTE    ] PHM: Fetching primary data for 2025-01.
[2025-10-24T20:35:16.508989] [INFO ] [REMOTE    ] PHK: Incremental fetch complete for 2025-01 (1.96 seconds).
[2025-10-24T20:35:16.582951] [INFO ] [REMOTE    ] PHI: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T20:35:16.947721] [INFO ] [REMOTE    ] PHI: Fetching primary data for 2025-10.
[2025-10-24T20:35:17.747616] [INFO ] [REMOTE    ] PHIN: Fetching primary data for 2025-04.
[2025-10-24T20:35:18.093768] [INFO ] [REMOTE    ] PHI: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T20:35:18.097312] [INFO ] [REMOTE    ] PHI: Full fetch complete (21389 records).
[2025-10-24T20:35:18.097406] [DEBUG] [VALIDATOR ] PHI: Validating primary data.
[2025-10-24T20:35:18.464789] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present.
[2025-10-24T20:35:18.464896] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed.
[2025-10-24T20:35:18.465359] [INFO ] [MAIN      ] PHI: Fetched primary data is valid.
[2025-10-24T20:35:18.465442] [DEBUG] [LOCAL     ] PHI: Saving primary data.
[2025-10-24T20:35:18.465868] [FATAL] [LOCAL     ] PHI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:35:18.466017] [FATAL] [MAIN      ] PHI: Failed to save primary data.
[2025-10-24T20:35:18.466190] [WARN ] [MAIN      ] PHI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:35:18.466287] [INFO ] [LOCAL     ] PHI: Starting deletion of primary data.
[2025-10-24T20:35:18.466481] [DEBUG] [LOCAL     ] PHI: No primary data file found to delete.
[2025-10-24T20:35:18.466574] [INFO ] [LOCAL     ] PHI: Starting deletion of derivative data.
[2025-10-24T20:35:18.466834] [DEBUG] [LOCAL     ] PHI: Deleted derivative data file.
[2025-10-24T20:35:18.466944] [INFO ] [MAIN      ] Update Progress: 1676/2366 symbols completed. PHI took 30.8s. Estimated remaining: 1h 28m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:35:18.553271] [INFO ] [REMOTE    ] PHK: Fetching primary data for 2025-02.
[2025-10-24T20:35:18.667766] [INFO ] [MAIN      ] PHR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:35:18.665540] [INFO ] [REMOTE    ] PHM: Incremental fetch complete for 2025-01 (2.52 seconds).
[2025-10-24T20:35:18.712691] [DEBUG] [LOCAL     ] PHR: Loaded 38203 existing records from primary storage.
[2025-10-24T20:35:18.712955] [INFO ] [MAIN      ] PHR: Loaded 38203 existing records.
[2025-10-24T20:35:18.888636] [WARN ] [MAIN      ] PHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:35:18.888856] [INFO ] [MAIN      ] PHR: Wiping existing primary data before full refresh.
[2025-10-24T20:35:18.888902] [INFO ] [LOCAL     ] PHR: Starting deletion of primary data.
[2025-10-24T20:35:18.889130] [DEBUG] [LOCAL     ] PHR: Deleted primary data file.
[2025-10-24T20:35:18.889167] [INFO ] [MAIN      ] PHR: Starting full primary refresh.
[2025-10-24T20:35:19.286617] [INFO ] [REMOTE    ] PHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:35:19.310427] [INFO ] [REMOTE    ] PHIN: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T20:35:19.347607] [INFO ] [REMOTE    ] PHR: Fetching primary data for 2025-01.
[2025-10-24T20:35:19.374707] [INFO ] [REMOTE    ] PHK: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T20:35:20.147745] [INFO ] [REMOTE    ] PHM: Fetching primary data for 2025-02.
[2025-10-24T20:35:20.947717] [INFO ] [REMOTE    ] PHIN: Fetching primary data for 2025-05.
[2025-10-24T20:35:21.007621] [INFO ] [REMOTE    ] PHR: Incremental fetch complete for 2025-01 (1.66 seconds).
[2025-10-24T20:35:21.747621] [INFO ] [REMOTE    ] PHK: Fetching primary data for 2025-03.
[2025-10-24T20:35:21.929909] [INFO ] [REMOTE    ] PHM: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T20:35:22.056669] [INFO ] [REMOTE    ] PHIN: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T20:35:22.547682] [INFO ] [REMOTE    ] PHR: Fetching primary data for 2025-02.
[2025-10-24T20:35:23.132706] [INFO ] [REMOTE    ] PHK: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T20:35:23.347630] [INFO ] [REMOTE    ] PHIN: Fetching primary data for 2025-06.
[2025-10-24T20:35:23.867088] [INFO ] [REMOTE    ] PHR: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T20:35:24.147730] [INFO ] [REMOTE    ] PHM: Fetching primary data for 2025-03.
[2025-10-24T20:35:24.754623] [INFO ] [REMOTE    ] PHIN: Incremental fetch complete for 2025-06 (1.41 seconds).
[2025-10-24T20:35:24.947685] [INFO ] [REMOTE    ] PHIN: Fetching primary data for 2025-07.
[2025-10-24T20:35:25.747692] [INFO ] [REMOTE    ] PHR: Fetching primary data for 2025-03.
[2025-10-24T20:35:26.018957] [INFO ] [REMOTE    ] PHM: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T20:35:26.505237] [INFO ] [REMOTE    ] PHIN: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T20:35:26.547685] [INFO ] [REMOTE    ] PHIN: Fetching primary data for 2025-08.
[2025-10-24T20:35:27.347723] [INFO ] [REMOTE    ] PHK: Fetching primary data for 2025-04.
[2025-10-24T20:35:27.567333] [INFO ] [REMOTE    ] PHR: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T20:35:27.924460] [INFO ] [REMOTE    ] PHIN: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T20:35:28.147695] [INFO ] [REMOTE    ] PHIN: Fetching primary data for 2025-09.
[2025-10-24T20:35:28.719716] [INFO ] [REMOTE    ] PHK: Incremental fetch complete for 2025-04 (1.37 seconds).
[2025-10-24T20:35:28.947685] [INFO ] [REMOTE    ] PHR: Fetching primary data for 2025-04.
[2025-10-24T20:35:29.544418] [INFO ] [REMOTE    ] PHIN: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T20:35:29.747675] [INFO ] [REMOTE    ] PHIN: Fetching primary data for 2025-10.
[2025-10-24T20:35:30.547769] [INFO ] [REMOTE    ] PHM: Fetching primary data for 2025-04.
[2025-10-24T20:35:30.719895] [INFO ] [REMOTE    ] PHR: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T20:35:31.056598] [INFO ] [REMOTE    ] PHIN: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T20:35:31.062085] [INFO ] [REMOTE    ] PHIN: Full fetch complete (47363 records).
[2025-10-24T20:35:31.062177] [DEBUG] [VALIDATOR ] PHIN: Validating primary data.
[2025-10-24T20:35:31.357742] [INFO ] [REMOTE    ] PHR: Fetching primary data for 2025-05.
[2025-10-24T20:35:31.449220] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present.
[2025-10-24T20:35:31.449300] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed.
[2025-10-24T20:35:31.450416] [INFO ] [MAIN      ] PHIN: Fetched primary data is valid.
[2025-10-24T20:35:31.450480] [DEBUG] [LOCAL     ] PHIN: Saving primary data.
[2025-10-24T20:35:31.451133] [FATAL] [LOCAL     ] PHIN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:35:31.451219] [FATAL] [MAIN      ] PHIN: Failed to save primary data.
[2025-10-24T20:35:31.451261] [WARN ] [MAIN      ] PHIN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:35:31.451328] [INFO ] [LOCAL     ] PHIN: Starting deletion of primary data.
[2025-10-24T20:35:31.451387] [DEBUG] [LOCAL     ] PHIN: No primary data file found to delete.
[2025-10-24T20:35:31.451425] [INFO ] [LOCAL     ] PHIN: Starting deletion of derivative data.
[2025-10-24T20:35:31.451564] [DEBUG] [LOCAL     ] PHIN: Deleted derivative data file.
[2025-10-24T20:35:31.451639] [INFO ] [MAIN      ] Update Progress: 1677/2366 symbols completed. PHIN took 26.0s. Estimated remaining: 1h 28m 32s. Rate: 7.8 symbols/min
[2025-10-24T20:35:32.147699] [INFO ] [REMOTE    ] PHK: Fetching primary data for 2025-05.
[2025-10-24T20:35:32.879758] [INFO ] [REMOTE    ] PHM: Incremental fetch complete for 2025-04 (2.33 seconds).
[2025-10-24T20:35:32.911860] [INFO ] [REMOTE    ] PHR: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T20:35:32.947597] [INFO ] [REMOTE    ] PHR: Fetching primary data for 2025-06.
[2025-10-24T20:35:33.341598] [INFO ] [REMOTE    ] PHK: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T20:35:33.747676] [INFO ] [REMOTE    ] PHK: Fetching primary data for 2025-06.
[2025-10-24T20:35:34.349058] [INFO ] [REMOTE    ] PHR: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T20:35:34.547688] [INFO ] [REMOTE    ] PHR: Fetching primary data for 2025-07.
[2025-10-24T20:35:35.347710] [INFO ] [REMOTE    ] PHM: Fetching primary data for 2025-05.
[2025-10-24T20:35:35.718861] [INFO ] [REMOTE    ] PHK: Incremental fetch complete for 2025-06 (1.97 seconds).
[2025-10-24T20:35:36.147742] [INFO ] [REMOTE    ] PHK: Fetching primary data for 2025-07.
[2025-10-24T20:35:36.449430] [INFO ] [REMOTE    ] PHR: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T20:35:36.947739] [INFO ] [REMOTE    ] PHR: Fetching primary data for 2025-08.
[2025-10-24T20:35:37.363027] [INFO ] [REMOTE    ] PHK: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T20:35:37.747713] [INFO ] [REMOTE    ] PHK: Fetching primary data for 2025-08.
[2025-10-24T20:35:37.960530] [INFO ] [REMOTE    ] PHM: Incremental fetch complete for 2025-05 (2.61 seconds).
[2025-10-24T20:35:38.558326] [INFO ] [REMOTE    ] PHM: Fetching primary data for 2025-06.
[2025-10-24T20:35:38.560475] [INFO ] [REMOTE    ] PHR: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T20:35:39.010874] [INFO ] [REMOTE    ] PHK: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T20:35:39.347695] [INFO ] [REMOTE    ] PHK: Fetching primary data for 2025-09.
[2025-10-24T20:35:40.147729] [INFO ] [REMOTE    ] PHR: Fetching primary data for 2025-09.
[2025-10-24T20:35:40.485610] [INFO ] [REMOTE    ] PHM: Incremental fetch complete for 2025-06 (1.93 seconds).
[2025-10-24T20:35:40.756924] [INFO ] [REMOTE    ] PHK: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T20:35:40.947620] [INFO ] [REMOTE    ] PHM: Fetching primary data for 2025-07.
[2025-10-24T20:35:41.747700] [INFO ] [REMOTE    ] PHK: Fetching primary data for 2025-10.
[2025-10-24T20:35:41.778245] [INFO ] [REMOTE    ] PHR: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T20:35:42.547614] [INFO ] [REMOTE    ] PHR: Fetching primary data for 2025-10.
[2025-10-24T20:35:43.051985] [INFO ] [REMOTE    ] PHM: Incremental fetch complete for 2025-07 (2.10 seconds).
[2025-10-24T20:35:43.077091] [INFO ] [REMOTE    ] PHK: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T20:35:43.083185] [INFO ] [REMOTE    ] PHK: Full fetch complete (39361 records).
[2025-10-24T20:35:43.083272] [DEBUG] [VALIDATOR ] PHK: Validating primary data.
[2025-10-24T20:35:43.352868] [INFO ] [REMOTE    ] PHM: Fetching primary data for 2025-08.
[2025-10-24T20:35:43.464290] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present.
[2025-10-24T20:35:43.464362] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed.
[2025-10-24T20:35:43.465137] [INFO ] [MAIN      ] PHK: Fetched primary data is valid.
[2025-10-24T20:35:43.465195] [DEBUG] [LOCAL     ] PHK: Saving primary data.
[2025-10-24T20:35:43.465581] [FATAL] [LOCAL     ] PHK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:35:43.465684] [FATAL] [MAIN      ] PHK: Failed to save primary data.
[2025-10-24T20:35:43.465734] [WARN ] [MAIN      ] PHK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:35:43.465802] [INFO ] [LOCAL     ] PHK: Starting deletion of primary data.
[2025-10-24T20:35:43.465888] [DEBUG] [LOCAL     ] PHK: No primary data file found to delete.
[2025-10-24T20:35:43.465937] [INFO ] [LOCAL     ] PHK: Starting deletion of derivative data.
[2025-10-24T20:35:43.465994] [DEBUG] [LOCAL     ] PHK: No derivative data file found to delete.
[2025-10-24T20:35:43.466081] [INFO ] [MAIN      ] Update Progress: 1678/2366 symbols completed. PHK took 30.9s. Estimated remaining: 1h 28m 26s. Rate: 7.8 symbols/min
[2025-10-24T20:35:43.716349] [INFO ] [REMOTE    ] PHR: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T20:35:43.724040] [INFO ] [REMOTE    ] PHR: Full fetch complete (53477 records).
[2025-10-24T20:35:43.724154] [DEBUG] [VALIDATOR ] PHR: Validating primary data.
[2025-10-24T20:35:44.100263] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present.
[2025-10-24T20:35:44.100334] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed.
[2025-10-24T20:35:44.101258] [INFO ] [MAIN      ] PHR: Fetched primary data is valid.
[2025-10-24T20:35:44.101317] [DEBUG] [LOCAL     ] PHR: Saving primary data.
[2025-10-24T20:35:44.101772] [FATAL] [LOCAL     ] PHR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:35:44.101900] [FATAL] [MAIN      ] PHR: Failed to save primary data.
[2025-10-24T20:35:44.101953] [WARN ] [MAIN      ] PHR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:35:44.101989] [INFO ] [LOCAL     ] PHR: Starting deletion of primary data.
[2025-10-24T20:35:44.102039] [DEBUG] [LOCAL     ] PHR: No primary data file found to delete.
[2025-10-24T20:35:44.102072] [INFO ] [LOCAL     ] PHR: Starting deletion of derivative data.
[2025-10-24T20:35:44.102223] [DEBUG] [LOCAL     ] PHR: Deleted derivative data file.
[2025-10-24T20:35:44.102681] [INFO ] [MAIN      ] Update Progress: 1679/2366 symbols completed. PHR took 25.6s. Estimated remaining: 1h 28m 15s. Rate: 7.8 symbols/min
[2025-10-24T20:35:45.472683] [INFO ] [REMOTE    ] PHM: Incremental fetch complete for 2025-08 (2.12 seconds).
[2025-10-24T20:35:45.483977] [INFO ] [REMOTE    ] PHM: Fetching primary data for 2025-09.
[2025-10-24T20:35:46.489250] [INFO ] [REMOTE    ] PHM: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T20:35:46.500587] [INFO ] [REMOTE    ] PHM: Fetching primary data for 2025-10.
[2025-10-24T20:35:48.536617] [INFO ] [REMOTE    ] PHM: Incremental fetch complete for 2025-10 (2.04 seconds).
[2025-10-24T20:35:48.547228] [INFO ] [REMOTE    ] PHM: Full fetch complete (75250 records).
[2025-10-24T20:35:48.547429] [DEBUG] [VALIDATOR ] PHM: Validating primary data.
[2025-10-24T20:35:48.963506] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present.
[2025-10-24T20:35:48.963579] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed.
[2025-10-24T20:35:48.964700] [INFO ] [MAIN      ] PHM: Fetched primary data is valid.
[2025-10-24T20:35:48.964760] [DEBUG] [LOCAL     ] PHM: Saving primary data.
[2025-10-24T20:35:48.965334] [FATAL] [LOCAL     ] PHM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:35:48.965439] [FATAL] [MAIN      ] PHM: Failed to save primary data.
[2025-10-24T20:35:48.965509] [WARN ] [MAIN      ] PHM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:35:48.965603] [INFO ] [LOCAL     ] PHM: Starting deletion of primary data.
[2025-10-24T20:35:48.965713] [DEBUG] [LOCAL     ] PHM: No primary data file found to delete.
[2025-10-24T20:35:48.965770] [INFO ] [LOCAL     ] PHM: Starting deletion of derivative data.
[2025-10-24T20:35:48.965913] [DEBUG] [LOCAL     ] PHM: Deleted derivative data file.
[2025-10-24T20:35:48.966378] [INFO ] [MAIN      ] Update Progress: 1680/2366 symbols completed. PHM took 34.9s. Estimated remaining: 1h 28m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:35:49.580670] [INFO ] [MAIN      ] PINS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:35:49.644130] [INFO ] [MAIN      ] PIM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:35:49.661639] [INFO ] [MAIN      ] PINE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:35:49.641789] [INFO ] [MAIN      ] PII: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:35:49.673602] [DEBUG] [LOCAL     ] PIM: Loaded 4876 existing records from primary storage.
[2025-10-24T20:35:49.673987] [INFO ] [MAIN      ] PIM: Loaded 4876 existing records.
[2025-10-24T20:35:49.750205] [DEBUG] [LOCAL     ] PINE: Loaded 14507 existing records from primary storage.
[2025-10-24T20:35:49.771540] [INFO ] [MAIN      ] PINE: Loaded 14507 existing records.
[2025-10-24T20:35:50.037351] [DEBUG] [LOCAL     ] PII: Loaded 49002 existing records from primary storage.
[2025-10-24T20:35:50.046620] [WARN ] [MAIN      ] PIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:35:50.057854] [DEBUG] [LOCAL     ] PINS: Loaded 54083 existing records from primary storage.
[2025-10-24T20:35:50.094364] [INFO ] [MAIN      ] PIM: Wiping existing primary data before full refresh.
[2025-10-24T20:35:50.081303] [INFO ] [MAIN      ] PINS: Loaded 54083 existing records.
[2025-10-24T20:35:50.102269] [INFO ] [MAIN      ] PII: Loaded 49002 existing records.
[2025-10-24T20:35:50.094590] [INFO ] [LOCAL     ] PIM: Starting deletion of primary data.
[2025-10-24T20:35:50.212584] [WARN ] [MAIN      ] PINE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:35:50.245055] [DEBUG] [LOCAL     ] PIM: Deleted primary data file.
[2025-10-24T20:35:50.245245] [INFO ] [MAIN      ] PINE: Wiping existing primary data before full refresh.
[2025-10-24T20:35:50.250484] [INFO ] [MAIN      ] PIM: Starting full primary refresh.
[2025-10-24T20:35:50.303605] [INFO ] [LOCAL     ] PINE: Starting deletion of primary data.
[2025-10-24T20:35:50.377372] [DEBUG] [LOCAL     ] PINE: Deleted primary data file.
[2025-10-24T20:35:50.377460] [INFO ] [MAIN      ] PINE: Starting full primary refresh.
[2025-10-24T20:35:50.694347] [WARN ] [MAIN      ] PINS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:35:50.718940] [WARN ] [MAIN      ] PII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:35:50.719499] [INFO ] [MAIN      ] PINS: Wiping existing primary data before full refresh.
[2025-10-24T20:35:50.719760] [INFO ] [LOCAL     ] PINS: Starting deletion of primary data.
[2025-10-24T20:35:50.719908] [INFO ] [MAIN      ] PII: Wiping existing primary data before full refresh.
[2025-10-24T20:35:50.741468] [INFO ] [LOCAL     ] PII: Starting deletion of primary data.
[2025-10-24T20:35:50.762191] [DEBUG] [LOCAL     ] PINS: Deleted primary data file.
[2025-10-24T20:35:50.799634] [INFO ] [MAIN      ] PINS: Starting full primary refresh.
[2025-10-24T20:35:50.828334] [DEBUG] [LOCAL     ] PII: Deleted primary data file.
[2025-10-24T20:35:50.903907] [INFO ] [MAIN      ] PII: Starting full primary refresh.
[2025-10-24T20:35:51.446736] [INFO ] [REMOTE    ] PIM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:35:51.506307] [INFO ] [REMOTE    ] PIM: Fetching primary data for 2025-01.
[2025-10-24T20:35:51.747725] [INFO ] [REMOTE    ] PINE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:35:51.769858] [INFO ] [REMOTE    ] PINE: Fetching primary data for 2025-01.
[2025-10-24T20:35:51.957044] [INFO ] [REMOTE    ] PINS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:35:51.967620] [INFO ] [REMOTE    ] PINS: Fetching primary data for 2025-01.
[2025-10-24T20:35:52.026267] [INFO ] [REMOTE    ] PII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:35:52.026531] [INFO ] [REMOTE    ] PII: Fetching primary data for 2025-01.
[2025-10-24T20:35:52.714939] [INFO ] [REMOTE    ] PIM: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T20:35:52.716479] [INFO ] [REMOTE    ] PIM: Fetching primary data for 2025-02.
[2025-10-24T20:35:53.067137] [INFO ] [REMOTE    ] PINE: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T20:35:53.070891] [INFO ] [REMOTE    ] PINE: Fetching primary data for 2025-02.
[2025-10-24T20:35:53.434889] [INFO ] [REMOTE    ] PIM: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:35:53.436284] [INFO ] [REMOTE    ] PIM: Fetching primary data for 2025-03.
[2025-10-24T20:35:53.808901] [INFO ] [REMOTE    ] PII: Incremental fetch complete for 2025-01 (1.78 seconds).
[2025-10-24T20:35:53.818785] [INFO ] [REMOTE    ] PII: Fetching primary data for 2025-02.
[2025-10-24T20:35:54.197187] [INFO ] [REMOTE    ] PINE: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T20:35:54.197830] [INFO ] [REMOTE    ] PIM: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T20:35:54.203769] [INFO ] [REMOTE    ] PIM: Fetching primary data for 2025-04.
[2025-10-24T20:35:54.202858] [INFO ] [REMOTE    ] PINE: Fetching primary data for 2025-03.
[2025-10-24T20:35:54.268631] [INFO ] [REMOTE    ] PINS: Incremental fetch complete for 2025-01 (2.30 seconds).
[2025-10-24T20:35:54.279421] [INFO ] [REMOTE    ] PINS: Fetching primary data for 2025-02.
[2025-10-24T20:35:54.970413] [INFO ] [REMOTE    ] PIM: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T20:35:54.971990] [INFO ] [REMOTE    ] PIM: Fetching primary data for 2025-05.
[2025-10-24T20:35:55.198424] [INFO ] [REMOTE    ] PINE: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T20:35:55.347623] [INFO ] [REMOTE    ] PINE: Fetching primary data for 2025-04.
[2025-10-24T20:35:55.662057] [INFO ] [REMOTE    ] PII: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T20:35:55.783910] [INFO ] [REMOTE    ] PIM: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:35:55.895500] [INFO ] [REMOTE    ] PINS: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T20:35:56.062148] [INFO ] [REMOTE    ] PINE: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T20:35:56.147606] [INFO ] [REMOTE    ] PINE: Fetching primary data for 2025-05.
[2025-10-24T20:35:56.947625] [INFO ] [REMOTE    ] PINS: Fetching primary data for 2025-03.
[2025-10-24T20:35:57.032339] [INFO ] [REMOTE    ] PINE: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T20:35:57.747631] [INFO ] [REMOTE    ] PIM: Fetching primary data for 2025-06.
[2025-10-24T20:35:58.433854] [INFO ] [REMOTE    ] PIM: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T20:35:58.547594] [INFO ] [REMOTE    ] PIM: Fetching primary data for 2025-07.
[2025-10-24T20:35:58.966809] [INFO ] [REMOTE    ] PINS: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T20:35:59.347627] [INFO ] [REMOTE    ] PINS: Fetching primary data for 2025-04.
[2025-10-24T20:35:59.362189] [INFO ] [REMOTE    ] PIM: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T20:36:00.147678] [INFO ] [REMOTE    ] PIM: Fetching primary data for 2025-08.
[2025-10-24T20:36:00.947759] [INFO ] [REMOTE    ] PII: Fetching primary data for 2025-03.
[2025-10-24T20:36:00.988031] [INFO ] [REMOTE    ] PIM: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T20:36:01.555091] [INFO ] [REMOTE    ] PINS: Incremental fetch complete for 2025-04 (2.21 seconds).
[2025-10-24T20:36:01.747726] [INFO ] [REMOTE    ] PINE: Fetching primary data for 2025-06.
[2025-10-24T20:36:02.547722] [INFO ] [REMOTE    ] PIM: Fetching primary data for 2025-09.
[2025-10-24T20:36:02.801895] [INFO ] [REMOTE    ] PINE: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T20:36:02.969580] [INFO ] [REMOTE    ] PII: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T20:36:03.264946] [INFO ] [REMOTE    ] PIM: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T20:36:03.347617] [INFO ] [REMOTE    ] PIM: Fetching primary data for 2025-10.
[2025-10-24T20:36:04.107879] [INFO ] [REMOTE    ] PIM: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T20:36:04.109274] [INFO ] [REMOTE    ] PIM: Full fetch complete (6493 records).
[2025-10-24T20:36:04.109367] [DEBUG] [VALIDATOR ] PIM: Validating primary data.
[2025-10-24T20:36:04.152801] [INFO ] [REMOTE    ] PINE: Fetching primary data for 2025-07.
[2025-10-24T20:36:04.474052] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present.
[2025-10-24T20:36:04.474132] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed.
[2025-10-24T20:36:04.474351] [INFO ] [MAIN      ] PIM: Fetched primary data is valid.
[2025-10-24T20:36:04.474408] [DEBUG] [LOCAL     ] PIM: Saving primary data.
[2025-10-24T20:36:04.474597] [FATAL] [LOCAL     ] PIM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:36:04.474720] [FATAL] [MAIN      ] PIM: Failed to save primary data.
[2025-10-24T20:36:04.474764] [WARN ] [MAIN      ] PIM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:36:04.474860] [INFO ] [LOCAL     ] PIM: Starting deletion of primary data.
[2025-10-24T20:36:04.474930] [DEBUG] [LOCAL     ] PIM: No primary data file found to delete.
[2025-10-24T20:36:04.474968] [INFO ] [LOCAL     ] PIM: Starting deletion of derivative data.
[2025-10-24T20:36:04.475108] [DEBUG] [LOCAL     ] PIM: Deleted derivative data file.
[2025-10-24T20:36:04.475180] [INFO ] [MAIN      ] Update Progress: 1681/2366 symbols completed. PIM took 15.5s. Estimated remaining: 1h 28m 2s. Rate: 7.8 symbols/min
[2025-10-24T20:36:04.655241] [INFO ] [MAIN      ] PIPR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:36:04.672282] [DEBUG] [LOCAL     ] PIPR: Loaded 15051 existing records from primary storage.
[2025-10-24T20:36:04.672523] [INFO ] [MAIN      ] PIPR: Loaded 15051 existing records.
[2025-10-24T20:36:04.852527] [WARN ] [MAIN      ] PIPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:36:04.852783] [INFO ] [MAIN      ] PIPR: Wiping existing primary data before full refresh.
[2025-10-24T20:36:04.852842] [INFO ] [LOCAL     ] PIPR: Starting deletion of primary data.
[2025-10-24T20:36:04.853070] [DEBUG] [LOCAL     ] PIPR: Deleted primary data file.
[2025-10-24T20:36:04.853110] [INFO ] [MAIN      ] PIPR: Starting full primary refresh.
[2025-10-24T20:36:04.952558] [INFO ] [REMOTE    ] PINS: Fetching primary data for 2025-05.
[2025-10-24T20:36:05.208531] [INFO ] [REMOTE    ] PIPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:36:05.349197] [INFO ] [REMOTE    ] PINE: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T20:36:05.747741] [INFO ] [REMOTE    ] PII: Fetching primary data for 2025-04.
[2025-10-24T20:36:06.547701] [INFO ] [REMOTE    ] PINE: Fetching primary data for 2025-08.
[2025-10-24T20:36:07.074940] [INFO ] [REMOTE    ] PINS: Incremental fetch complete for 2025-05 (2.12 seconds).
[2025-10-24T20:36:07.347725] [INFO ] [REMOTE    ] PIPR: Fetching primary data for 2025-01.
[2025-10-24T20:36:07.609784] [INFO ] [REMOTE    ] PINE: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T20:36:07.746714] [INFO ] [REMOTE    ] PII: Incremental fetch complete for 2025-04 (2.00 seconds).
[2025-10-24T20:36:08.147674] [INFO ] [REMOTE    ] PII: Fetching primary data for 2025-05.
[2025-10-24T20:36:08.602251] [INFO ] [REMOTE    ] PIPR: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T20:36:08.947686] [INFO ] [REMOTE    ] PIPR: Fetching primary data for 2025-02.
[2025-10-24T20:36:09.747691] [INFO ] [REMOTE    ] PINS: Fetching primary data for 2025-06.
[2025-10-24T20:36:09.864345] [INFO ] [REMOTE    ] PIPR: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T20:36:10.002967] [INFO ] [REMOTE    ] PII: Incremental fetch complete for 2025-05 (1.86 seconds).
[2025-10-24T20:36:10.547638] [INFO ] [REMOTE    ] PINE: Fetching primary data for 2025-09.
[2025-10-24T20:36:11.347698] [INFO ] [REMOTE    ] PII: Fetching primary data for 2025-06.
[2025-10-24T20:36:11.435669] [INFO ] [REMOTE    ] PINE: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T20:36:11.692755] [INFO ] [REMOTE    ] PINS: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T20:36:12.147616] [INFO ] [REMOTE    ] PINE: Fetching primary data for 2025-10.
[2025-10-24T20:36:12.918826] [INFO ] [REMOTE    ] PII: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T20:36:12.947699] [INFO ] [REMOTE    ] PIPR: Fetching primary data for 2025-03.
[2025-10-24T20:36:12.958871] [INFO ] [REMOTE    ] PINE: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T20:36:12.962295] [INFO ] [REMOTE    ] PINE: Full fetch complete (21080 records).
[2025-10-24T20:36:12.962369] [DEBUG] [VALIDATOR ] PINE: Validating primary data.
[2025-10-24T20:36:13.328829] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present.
[2025-10-24T20:36:13.328924] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed.
[2025-10-24T20:36:13.329350] [INFO ] [MAIN      ] PINE: Fetched primary data is valid.
[2025-10-24T20:36:13.329387] [DEBUG] [LOCAL     ] PINE: Saving primary data.
[2025-10-24T20:36:13.329638] [FATAL] [LOCAL     ] PINE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:36:13.329739] [FATAL] [MAIN      ] PINE: Failed to save primary data.
[2025-10-24T20:36:13.329780] [WARN ] [MAIN      ] PINE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:36:13.329818] [INFO ] [LOCAL     ] PINE: Starting deletion of primary data.
[2025-10-24T20:36:13.329866] [DEBUG] [LOCAL     ] PINE: No primary data file found to delete.
[2025-10-24T20:36:13.329910] [INFO ] [LOCAL     ] PINE: Starting deletion of derivative data.
[2025-10-24T20:36:13.330120] [DEBUG] [LOCAL     ] PINE: Deleted derivative data file.
[2025-10-24T20:36:13.330227] [INFO ] [MAIN      ] Update Progress: 1682/2366 symbols completed. PINE took 24.4s. Estimated remaining: 1h 27m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:36:13.499411] [INFO ] [MAIN      ] PJT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:36:13.522165] [DEBUG] [LOCAL     ] PJT: Loaded 21297 existing records from primary storage.
[2025-10-24T20:36:13.522416] [INFO ] [MAIN      ] PJT: Loaded 21297 existing records.
[2025-10-24T20:36:13.707820] [WARN ] [MAIN      ] PJT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:36:13.708016] [INFO ] [MAIN      ] PJT: Wiping existing primary data before full refresh.
[2025-10-24T20:36:13.708063] [INFO ] [LOCAL     ] PJT: Starting deletion of primary data.
[2025-10-24T20:36:13.708367] [DEBUG] [LOCAL     ] PJT: Deleted primary data file.
[2025-10-24T20:36:13.708422] [INFO ] [MAIN      ] PJT: Starting full primary refresh.
[2025-10-24T20:36:13.754182] [INFO ] [REMOTE    ] PINS: Fetching primary data for 2025-07.
[2025-10-24T20:36:14.079730] [INFO ] [REMOTE    ] PJT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:36:14.097410] [INFO ] [REMOTE    ] PIPR: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T20:36:14.547688] [INFO ] [REMOTE    ] PJT: Fetching primary data for 2025-01.
[2025-10-24T20:36:15.347723] [INFO ] [REMOTE    ] PIPR: Fetching primary data for 2025-04.
[2025-10-24T20:36:15.775553] [INFO ] [REMOTE    ] PINS: Incremental fetch complete for 2025-07 (2.02 seconds).
[2025-10-24T20:36:15.902946] [INFO ] [REMOTE    ] PJT: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T20:36:16.147721] [INFO ] [REMOTE    ] PJT: Fetching primary data for 2025-02.
[2025-10-24T20:36:16.497689] [INFO ] [REMOTE    ] PIPR: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T20:36:16.947729] [INFO ] [REMOTE    ] PII: Fetching primary data for 2025-07.
[2025-10-24T20:36:17.351301] [INFO ] [REMOTE    ] PJT: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T20:36:17.747740] [INFO ] [REMOTE    ] PIPR: Fetching primary data for 2025-05.
[2025-10-24T20:36:18.547627] [INFO ] [REMOTE    ] PJT: Fetching primary data for 2025-03.
[2025-10-24T20:36:18.865300] [INFO ] [REMOTE    ] PII: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T20:36:19.030857] [INFO ] [REMOTE    ] PIPR: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T20:36:19.347708] [INFO ] [REMOTE    ] PINS: Fetching primary data for 2025-08.
[2025-10-24T20:36:19.493439] [INFO ] [REMOTE    ] PJT: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T20:36:20.147728] [INFO ] [REMOTE    ] PII: Fetching primary data for 2025-08.
[2025-10-24T20:36:20.947700] [INFO ] [REMOTE    ] PJT: Fetching primary data for 2025-04.
[2025-10-24T20:36:21.616554] [INFO ] [REMOTE    ] PINS: Incremental fetch complete for 2025-08 (2.27 seconds).
[2025-10-24T20:36:21.747728] [INFO ] [REMOTE    ] PIPR: Fetching primary data for 2025-06.
[2025-10-24T20:36:21.981530] [INFO ] [REMOTE    ] PII: Incremental fetch complete for 2025-08 (1.83 seconds).
[2025-10-24T20:36:22.100434] [INFO ] [REMOTE    ] PJT: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T20:36:22.547638] [INFO ] [REMOTE    ] PJT: Fetching primary data for 2025-05.
[2025-10-24T20:36:22.855280] [INFO ] [REMOTE    ] PIPR: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T20:36:23.347688] [INFO ] [REMOTE    ] PII: Fetching primary data for 2025-09.
[2025-10-24T20:36:23.884734] [INFO ] [REMOTE    ] PJT: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T20:36:24.147702] [INFO ] [REMOTE    ] PIPR: Fetching primary data for 2025-07.
[2025-10-24T20:36:24.745757] [INFO ] [REMOTE    ] PII: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T20:36:24.947695] [INFO ] [REMOTE    ] PII: Fetching primary data for 2025-10.
[2025-10-24T20:36:25.322983] [INFO ] [REMOTE    ] PIPR: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T20:36:25.747671] [INFO ] [REMOTE    ] PINS: Fetching primary data for 2025-09.
[2025-10-24T20:36:26.549004] [INFO ] [REMOTE    ] PJT: Fetching primary data for 2025-06.
[2025-10-24T20:36:26.551924] [INFO ] [REMOTE    ] PII: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T20:36:26.560985] [INFO ] [REMOTE    ] PII: Full fetch complete (71270 records).
[2025-10-24T20:36:26.561128] [DEBUG] [VALIDATOR ] PII: Validating primary data.
[2025-10-24T20:36:26.969443] [DEBUG] [VALIDATOR ] PII: All expected trading days are present.
[2025-10-24T20:36:26.969533] [DEBUG] [VALIDATOR ] PII: Primary data validation passed.
[2025-10-24T20:36:26.970620] [INFO ] [MAIN      ] PII: Fetched primary data is valid.
[2025-10-24T20:36:26.970705] [DEBUG] [LOCAL     ] PII: Saving primary data.
[2025-10-24T20:36:26.971348] [FATAL] [LOCAL     ] PII: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:36:26.971437] [FATAL] [MAIN      ] PII: Failed to save primary data.
[2025-10-24T20:36:26.971479] [WARN ] [MAIN      ] PII: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:36:26.971513] [INFO ] [LOCAL     ] PII: Starting deletion of primary data.
[2025-10-24T20:36:26.971566] [DEBUG] [LOCAL     ] PII: No primary data file found to delete.
[2025-10-24T20:36:26.971601] [INFO ] [LOCAL     ] PII: Starting deletion of derivative data.
[2025-10-24T20:36:26.971810] [DEBUG] [LOCAL     ] PII: Deleted derivative data file.
[2025-10-24T20:36:26.972211] [INFO ] [MAIN      ] Update Progress: 1683/2366 symbols completed. PII took 38.0s. Estimated remaining: 1h 27m 49s. Rate: 7.8 symbols/min
[2025-10-24T20:36:27.137695] [INFO ] [MAIN      ] PK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:36:27.186578] [DEBUG] [LOCAL     ] PK: Loaded 53137 existing records from primary storage.
[2025-10-24T20:36:27.186912] [INFO ] [MAIN      ] PK: Loaded 53137 existing records.
[2025-10-24T20:36:27.363708] [INFO ] [REMOTE    ] PIPR: Fetching primary data for 2025-08.
[2025-10-24T20:36:27.368189] [WARN ] [MAIN      ] PK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:36:27.369341] [INFO ] [MAIN      ] PK: Wiping existing primary data before full refresh.
[2025-10-24T20:36:27.369391] [INFO ] [LOCAL     ] PK: Starting deletion of primary data.
[2025-10-24T20:36:27.369886] [DEBUG] [LOCAL     ] PK: Deleted primary data file.
[2025-10-24T20:36:27.370027] [INFO ] [MAIN      ] PK: Starting full primary refresh.
[2025-10-24T20:36:27.729600] [INFO ] [REMOTE    ] PK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:36:27.742235] [INFO ] [REMOTE    ] PJT: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T20:36:27.777370] [INFO ] [REMOTE    ] PINS: Incremental fetch complete for 2025-09 (2.03 seconds).
[2025-10-24T20:36:28.128342] [INFO ] [REMOTE    ] PIPR: Incremental fetch complete for 2025-08 (0.76 seconds).
[2025-10-24T20:36:28.147606] [INFO ] [REMOTE    ] PIPR: Fetching primary data for 2025-09.
[2025-10-24T20:36:28.947673] [INFO ] [REMOTE    ] PJT: Fetching primary data for 2025-07.
[2025-10-24T20:36:29.214147] [INFO ] [REMOTE    ] PIPR: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T20:36:29.747609] [INFO ] [REMOTE    ] PINS: Fetching primary data for 2025-10.
[2025-10-24T20:36:30.198868] [INFO ] [REMOTE    ] PJT: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T20:36:30.547631] [INFO ] [REMOTE    ] PIPR: Fetching primary data for 2025-10.
[2025-10-24T20:36:31.347716] [INFO ] [REMOTE    ] PJT: Fetching primary data for 2025-08.
[2025-10-24T20:36:31.478041] [INFO ] [REMOTE    ] PIPR: Incremental fetch complete for 2025-10 (0.93 seconds).
[2025-10-24T20:36:31.481493] [INFO ] [REMOTE    ] PIPR: Full fetch complete (20959 records).
[2025-10-24T20:36:31.481600] [DEBUG] [VALIDATOR ] PIPR: Validating primary data.
[2025-10-24T20:36:31.908264] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present.
[2025-10-24T20:36:31.908355] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed.
[2025-10-24T20:36:31.908875] [INFO ] [MAIN      ] PIPR: Fetched primary data is valid.
[2025-10-24T20:36:31.908941] [DEBUG] [LOCAL     ] PIPR: Saving primary data.
[2025-10-24T20:36:31.909368] [FATAL] [LOCAL     ] PIPR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:36:31.909451] [FATAL] [MAIN      ] PIPR: Failed to save primary data.
[2025-10-24T20:36:31.909494] [WARN ] [MAIN      ] PIPR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:36:31.909530] [INFO ] [LOCAL     ] PIPR: Starting deletion of primary data.
[2025-10-24T20:36:31.909580] [DEBUG] [LOCAL     ] PIPR: No primary data file found to delete.
[2025-10-24T20:36:31.909616] [INFO ] [LOCAL     ] PIPR: Starting deletion of derivative data.
[2025-10-24T20:36:31.909873] [DEBUG] [LOCAL     ] PIPR: Deleted derivative data file.
[2025-10-24T20:36:31.909966] [INFO ] [MAIN      ] Update Progress: 1684/2366 symbols completed. PIPR took 27.4s. Estimated remaining: 1h 27m 40s. Rate: 7.8 symbols/min
[2025-10-24T20:36:32.095431] [INFO ] [MAIN      ] PKE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:36:32.111710] [DEBUG] [LOCAL     ] PKE: Loaded 14380 existing records from primary storage.
[2025-10-24T20:36:32.111949] [INFO ] [MAIN      ] PKE: Loaded 14380 existing records.
[2025-10-24T20:36:32.157687] [INFO ] [REMOTE    ] PK: Fetching primary data for 2025-01.
[2025-10-24T20:36:32.330795] [INFO ] [REMOTE    ] PINS: Incremental fetch complete for 2025-10 (2.58 seconds).
[2025-10-24T20:36:32.334239] [WARN ] [MAIN      ] PKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:36:32.343408] [INFO ] [MAIN      ] PKE: Wiping existing primary data before full refresh.
[2025-10-24T20:36:32.343511] [INFO ] [LOCAL     ] PKE: Starting deletion of primary data.
[2025-10-24T20:36:32.344198] [DEBUG] [LOCAL     ] PKE: Deleted primary data file.
[2025-10-24T20:36:32.344257] [INFO ] [MAIN      ] PKE: Starting full primary refresh.
[2025-10-24T20:36:32.388038] [INFO ] [REMOTE    ] PINS: Full fetch complete (77871 records).
[2025-10-24T20:36:32.415247] [DEBUG] [VALIDATOR ] PINS: Validating primary data.
[2025-10-24T20:36:32.795701] [INFO ] [REMOTE    ] PJT: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T20:36:32.960424] [INFO ] [REMOTE    ] PJT: Fetching primary data for 2025-09.
[2025-10-24T20:36:32.940710] [INFO ] [REMOTE    ] PKE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:36:33.123959] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present.
[2025-10-24T20:36:33.124031] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed.
[2025-10-24T20:36:33.125125] [INFO ] [MAIN      ] PINS: Fetched primary data is valid.
[2025-10-24T20:36:33.125186] [DEBUG] [LOCAL     ] PINS: Saving primary data.
[2025-10-24T20:36:33.125770] [FATAL] [LOCAL     ] PINS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:36:33.125854] [FATAL] [MAIN      ] PINS: Failed to save primary data.
[2025-10-24T20:36:33.125895] [WARN ] [MAIN      ] PINS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:36:33.125930] [INFO ] [LOCAL     ] PINS: Starting deletion of primary data.
[2025-10-24T20:36:33.125980] [DEBUG] [LOCAL     ] PINS: No primary data file found to delete.
[2025-10-24T20:36:33.126014] [INFO ] [LOCAL     ] PINS: Starting deletion of derivative data.
[2025-10-24T20:36:33.126227] [DEBUG] [LOCAL     ] PINS: Deleted derivative data file.
[2025-10-24T20:36:33.126576] [INFO ] [MAIN      ] Update Progress: 1685/2366 symbols completed. PINS took 44.2s. Estimated remaining: 1h 27m 30s. Rate: 7.8 symbols/min
[2025-10-24T20:36:33.297000] [INFO ] [MAIN      ] PKG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:36:33.334093] [DEBUG] [LOCAL     ] PKG: Loaded 38951 existing records from primary storage.
[2025-10-24T20:36:33.334359] [INFO ] [MAIN      ] PKG: Loaded 38951 existing records.
[2025-10-24T20:36:33.511502] [WARN ] [MAIN      ] PKG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:36:33.511780] [INFO ] [MAIN      ] PKG: Wiping existing primary data before full refresh.
[2025-10-24T20:36:33.511828] [INFO ] [LOCAL     ] PKG: Starting deletion of primary data.
[2025-10-24T20:36:33.512120] [DEBUG] [LOCAL     ] PKG: Deleted primary data file.
[2025-10-24T20:36:33.512159] [INFO ] [MAIN      ] PKG: Starting full primary refresh.
[2025-10-24T20:36:33.754018] [INFO ] [REMOTE    ] PKE: Fetching primary data for 2025-01.
[2025-10-24T20:36:33.872714] [INFO ] [REMOTE    ] PKG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:36:34.120529] [INFO ] [REMOTE    ] PJT: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T20:36:34.285215] [INFO ] [REMOTE    ] PK: Incremental fetch complete for 2025-01 (2.13 seconds).
[2025-10-24T20:36:34.547730] [INFO ] [REMOTE    ] PJT: Fetching primary data for 2025-10.
[2025-10-24T20:36:34.772361] [INFO ] [REMOTE    ] PKE: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T20:36:35.347715] [INFO ] [REMOTE    ] PK: Fetching primary data for 2025-02.
[2025-10-24T20:36:35.631842] [INFO ] [REMOTE    ] PJT: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T20:36:35.636664] [INFO ] [REMOTE    ] PJT: Full fetch complete (32043 records).
[2025-10-24T20:36:35.636805] [DEBUG] [VALIDATOR ] PJT: Validating primary data.
[2025-10-24T20:36:36.019200] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present.
[2025-10-24T20:36:36.019297] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed.
[2025-10-24T20:36:36.020017] [INFO ] [MAIN      ] PJT: Fetched primary data is valid.
[2025-10-24T20:36:36.020083] [DEBUG] [LOCAL     ] PJT: Saving primary data.
[2025-10-24T20:36:36.020407] [FATAL] [LOCAL     ] PJT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:36:36.020493] [FATAL] [MAIN      ] PJT: Failed to save primary data.
[2025-10-24T20:36:36.020535] [WARN ] [MAIN      ] PJT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:36:36.020569] [INFO ] [LOCAL     ] PJT: Starting deletion of primary data.
[2025-10-24T20:36:36.020617] [DEBUG] [LOCAL     ] PJT: No primary data file found to delete.
[2025-10-24T20:36:36.020678] [INFO ] [LOCAL     ] PJT: Starting deletion of derivative data.
[2025-10-24T20:36:36.020859] [DEBUG] [LOCAL     ] PJT: Deleted derivative data file.
[2025-10-24T20:36:36.020944] [INFO ] [MAIN      ] Update Progress: 1686/2366 symbols completed. PJT took 22.7s. Estimated remaining: 1h 27m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:36:36.152856] [INFO ] [REMOTE    ] PKG: Fetching primary data for 2025-01.
[2025-10-24T20:36:36.200095] [INFO ] [MAIN      ] PKST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:36:36.219633] [DEBUG] [LOCAL     ] PKST: Loaded 18267 existing records from primary storage.
[2025-10-24T20:36:36.219905] [INFO ] [MAIN      ] PKST: Loaded 18267 existing records.
[2025-10-24T20:36:36.402315] [WARN ] [MAIN      ] PKST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:36:36.402518] [INFO ] [MAIN      ] PKST: Wiping existing primary data before full refresh.
[2025-10-24T20:36:36.402566] [INFO ] [LOCAL     ] PKST: Starting deletion of primary data.
[2025-10-24T20:36:36.402832] [DEBUG] [LOCAL     ] PKST: Deleted primary data file.
[2025-10-24T20:36:36.402892] [INFO ] [MAIN      ] PKST: Starting full primary refresh.
[2025-10-24T20:36:36.781039] [INFO ] [REMOTE    ] PKST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:36:36.947701] [INFO ] [REMOTE    ] PKST: Fetching primary data for 2025-01.
[2025-10-24T20:36:37.161449] [INFO ] [REMOTE    ] PK: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T20:36:37.747681] [INFO ] [REMOTE    ] PKE: Fetching primary data for 2025-02.
[2025-10-24T20:36:38.264329] [INFO ] [REMOTE    ] PKST: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T20:36:38.296420] [INFO ] [REMOTE    ] PKG: Incremental fetch complete for 2025-01 (2.14 seconds).
[2025-10-24T20:36:38.547624] [INFO ] [REMOTE    ] PKG: Fetching primary data for 2025-02.
[2025-10-24T20:36:38.598011] [INFO ] [REMOTE    ] PKE: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T20:36:39.347620] [INFO ] [REMOTE    ] PK: Fetching primary data for 2025-03.
[2025-10-24T20:36:40.098546] [INFO ] [REMOTE    ] PKG: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T20:36:40.147679] [INFO ] [REMOTE    ] PKST: Fetching primary data for 2025-02.
[2025-10-24T20:36:40.947621] [INFO ] [REMOTE    ] PKE: Fetching primary data for 2025-03.
[2025-10-24T20:36:41.148820] [INFO ] [REMOTE    ] PK: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T20:36:41.202305] [INFO ] [REMOTE    ] PKST: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T20:36:41.733629] [INFO ] [REMOTE    ] PKE: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T20:36:41.747598] [INFO ] [REMOTE    ] PKE: Fetching primary data for 2025-04.
[2025-10-24T20:36:42.547620] [INFO ] [REMOTE    ] PK: Fetching primary data for 2025-04.
[2025-10-24T20:36:42.757547] [INFO ] [REMOTE    ] PKE: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T20:36:43.347687] [INFO ] [REMOTE    ] PKST: Fetching primary data for 2025-03.
[2025-10-24T20:36:44.147612] [INFO ] [REMOTE    ] PKG: Fetching primary data for 2025-03.
[2025-10-24T20:36:44.292502] [INFO ] [REMOTE    ] PK: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T20:36:44.583549] [INFO ] [REMOTE    ] PKST: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T20:36:44.947681] [INFO ] [REMOTE    ] PKE: Fetching primary data for 2025-05.
[2025-10-24T20:36:45.747751] [INFO ] [REMOTE    ] PK: Fetching primary data for 2025-05.
[2025-10-24T20:36:45.793921] [INFO ] [REMOTE    ] PKG: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T20:36:45.863268] [INFO ] [REMOTE    ] PKE: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T20:36:46.547712] [INFO ] [REMOTE    ] PKST: Fetching primary data for 2025-04.
[2025-10-24T20:36:47.347637] [INFO ] [REMOTE    ] PKG: Fetching primary data for 2025-04.
[2025-10-24T20:36:47.544305] [INFO ] [REMOTE    ] PK: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T20:36:47.713814] [INFO ] [REMOTE    ] PKST: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T20:36:48.147714] [INFO ] [REMOTE    ] PKST: Fetching primary data for 2025-05.
[2025-10-24T20:36:48.947617] [INFO ] [REMOTE    ] PKE: Fetching primary data for 2025-06.
[2025-10-24T20:36:49.211450] [INFO ] [REMOTE    ] PKG: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T20:36:49.364684] [INFO ] [REMOTE    ] PKST: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T20:36:49.747676] [INFO ] [REMOTE    ] PK: Fetching primary data for 2025-06.
[2025-10-24T20:36:49.832372] [INFO ] [REMOTE    ] PKE: Incremental fetch complete for 2025-06 (0.88 seconds).
[2025-10-24T20:36:50.547719] [INFO ] [REMOTE    ] PKG: Fetching primary data for 2025-05.
[2025-10-24T20:36:51.258337] [INFO ] [REMOTE    ] PK: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T20:36:51.347677] [INFO ] [REMOTE    ] PK: Fetching primary data for 2025-07.
[2025-10-24T20:36:52.147704] [INFO ] [REMOTE    ] PKST: Fetching primary data for 2025-06.
[2025-10-24T20:36:52.855412] [INFO ] [REMOTE    ] PKG: Incremental fetch complete for 2025-05 (2.31 seconds).
[2025-10-24T20:36:52.947616] [INFO ] [REMOTE    ] PKG: Fetching primary data for 2025-06.
[2025-10-24T20:36:53.094464] [INFO ] [REMOTE    ] PK: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T20:36:53.323873] [INFO ] [REMOTE    ] PKST: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T20:36:53.747631] [INFO ] [REMOTE    ] PKST: Fetching primary data for 2025-07.
[2025-10-24T20:36:54.462000] [INFO ] [REMOTE    ] PKG: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T20:36:54.547612] [INFO ] [REMOTE    ] PK: Fetching primary data for 2025-08.
[2025-10-24T20:36:54.835598] [INFO ] [REMOTE    ] PKST: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T20:36:55.347677] [INFO ] [REMOTE    ] PKE: Fetching primary data for 2025-07.
[2025-10-24T20:36:55.453388] [DEBUG] [REMOTE    ] PKE: Error fetching primary data for 2025-07: 'API call returned an empty response.'
[2025-10-24T20:36:55.453618] [WARN ] [REMOTE    ] PKE: No data returned for month 2025-07
[2025-10-24T20:36:55.453737] [FATAL] [REMOTE    ] PKE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:36:55.453838] [FATAL] [MAIN      ] PKE: Failed to fetch primary data.
[2025-10-24T20:36:55.453904] [WARN ] [MAIN      ] PKE: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:36:55.453972] [INFO ] [LOCAL     ] PKE: Starting deletion of primary data.
[2025-10-24T20:36:55.454032] [DEBUG] [LOCAL     ] PKE: No primary data file found to delete.
[2025-10-24T20:36:55.454067] [INFO ] [LOCAL     ] PKE: Starting deletion of derivative data.
[2025-10-24T20:36:55.454225] [DEBUG] [LOCAL     ] PKE: Deleted derivative data file.
[2025-10-24T20:36:55.454304] [INFO ] [MAIN      ] Update Progress: 1687/2366 symbols completed. PKE took 23.5s. Estimated remaining: 1h 27m 17s. Rate: 7.8 symbols/min
[2025-10-24T20:36:55.630768] [INFO ] [MAIN      ] PKX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:36:55.652255] [DEBUG] [LOCAL     ] PKX: Loaded 22749 existing records from primary storage.
[2025-10-24T20:36:55.652503] [INFO ] [MAIN      ] PKX: Loaded 22749 existing records.
[2025-10-24T20:36:55.834453] [WARN ] [MAIN      ] PKX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:36:55.834714] [INFO ] [MAIN      ] PKX: Wiping existing primary data before full refresh.
[2025-10-24T20:36:55.834774] [INFO ] [LOCAL     ] PKX: Starting deletion of primary data.
[2025-10-24T20:36:55.834996] [DEBUG] [LOCAL     ] PKX: Deleted primary data file.
[2025-10-24T20:36:55.835052] [INFO ] [MAIN      ] PKX: Starting full primary refresh.
[2025-10-24T20:36:56.152748] [INFO ] [REMOTE    ] PKST: Fetching primary data for 2025-08.
[2025-10-24T20:36:56.223201] [INFO ] [REMOTE    ] PKX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:36:56.432990] [INFO ] [REMOTE    ] PK: Incremental fetch complete for 2025-08 (1.89 seconds).
[2025-10-24T20:36:56.947616] [INFO ] [REMOTE    ] PKG: Fetching primary data for 2025-07.
[2025-10-24T20:36:57.374324] [INFO ] [REMOTE    ] PKST: Incremental fetch complete for 2025-08 (1.22 seconds).
[2025-10-24T20:36:57.747634] [INFO ] [REMOTE    ] PKST: Fetching primary data for 2025-09.
[2025-10-24T20:36:58.547619] [INFO ] [REMOTE    ] PKX: Fetching primary data for 2025-01.
[2025-10-24T20:36:58.602721] [INFO ] [REMOTE    ] PKG: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T20:36:58.849750] [INFO ] [REMOTE    ] PKST: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T20:36:59.347668] [INFO ] [REMOTE    ] PKG: Fetching primary data for 2025-08.
[2025-10-24T20:37:00.059435] [INFO ] [REMOTE    ] PKX: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T20:37:00.147704] [INFO ] [REMOTE    ] PKX: Fetching primary data for 2025-02.
[2025-10-24T20:37:00.947714] [INFO ] [REMOTE    ] PKST: Fetching primary data for 2025-10.
[2025-10-24T20:37:00.988629] [INFO ] [REMOTE    ] PKG: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T20:37:01.747688] [INFO ] [REMOTE    ] PKG: Fetching primary data for 2025-09.
[2025-10-24T20:37:01.828855] [INFO ] [REMOTE    ] PKX: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T20:37:02.215344] [INFO ] [REMOTE    ] PKST: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T20:37:02.219481] [INFO ] [REMOTE    ] PKST: Full fetch complete (28899 records).
[2025-10-24T20:37:02.219601] [DEBUG] [VALIDATOR ] PKST: Validating primary data.
[2025-10-24T20:37:02.552909] [INFO ] [REMOTE    ] PKX: Fetching primary data for 2025-03.
[2025-10-24T20:37:02.598518] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present.
[2025-10-24T20:37:02.598591] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed.
[2025-10-24T20:37:02.599218] [INFO ] [MAIN      ] PKST: Fetched primary data is valid.
[2025-10-24T20:37:02.599280] [DEBUG] [LOCAL     ] PKST: Saving primary data.
[2025-10-24T20:37:02.599605] [FATAL] [LOCAL     ] PKST: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:37:02.599720] [FATAL] [MAIN      ] PKST: Failed to save primary data.
[2025-10-24T20:37:02.599809] [WARN ] [MAIN      ] PKST: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:37:02.599898] [INFO ] [LOCAL     ] PKST: Starting deletion of primary data.
[2025-10-24T20:37:02.599978] [DEBUG] [LOCAL     ] PKST: No primary data file found to delete.
[2025-10-24T20:37:02.600017] [INFO ] [LOCAL     ] PKST: Starting deletion of derivative data.
[2025-10-24T20:37:02.600196] [DEBUG] [LOCAL     ] PKST: Deleted derivative data file.
[2025-10-24T20:37:02.600292] [INFO ] [MAIN      ] Update Progress: 1688/2366 symbols completed. PKST took 26.6s. Estimated remaining: 1h 27m 9s. Rate: 7.8 symbols/min
[2025-10-24T20:37:02.783005] [INFO ] [MAIN      ] PL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:37:02.832894] [DEBUG] [LOCAL     ] PL: Loaded 53602 existing records from primary storage.
[2025-10-24T20:37:02.833203] [INFO ] [MAIN      ] PL: Loaded 53602 existing records.
[2025-10-24T20:37:03.022878] [WARN ] [MAIN      ] PL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:37:03.023135] [INFO ] [MAIN      ] PL: Wiping existing primary data before full refresh.
[2025-10-24T20:37:03.023198] [INFO ] [LOCAL     ] PL: Starting deletion of primary data.
[2025-10-24T20:37:03.023532] [DEBUG] [LOCAL     ] PL: Deleted primary data file.
[2025-10-24T20:37:03.023591] [INFO ] [MAIN      ] PL: Starting full primary refresh.
[2025-10-24T20:37:03.353529] [INFO ] [REMOTE    ] PK: Fetching primary data for 2025-09.
[2025-10-24T20:37:03.397213] [INFO ] [REMOTE    ] PL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:37:03.718910] [INFO ] [REMOTE    ] PKG: Incremental fetch complete for 2025-09 (1.97 seconds).
[2025-10-24T20:37:03.815550] [INFO ] [REMOTE    ] PKX: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T20:37:04.147711] [INFO ] [REMOTE    ] PKG: Fetching primary data for 2025-10.
[2025-10-24T20:37:04.947673] [INFO ] [REMOTE    ] PKX: Fetching primary data for 2025-04.
[2025-10-24T20:37:04.986482] [INFO ] [REMOTE    ] PK: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T20:37:05.747700] [INFO ] [REMOTE    ] PK: Fetching primary data for 2025-10.
[2025-10-24T20:37:05.832500] [INFO ] [REMOTE    ] PKG: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T20:37:05.839727] [INFO ] [REMOTE    ] PKG: Full fetch complete (57786 records).
[2025-10-24T20:37:05.839833] [DEBUG] [VALIDATOR ] PKG: Validating primary data.
[2025-10-24T20:37:06.229292] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present.
[2025-10-24T20:37:06.229392] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed.
[2025-10-24T20:37:06.230468] [INFO ] [MAIN      ] PKG: Fetched primary data is valid.
[2025-10-24T20:37:06.230529] [DEBUG] [LOCAL     ] PKG: Saving primary data.
[2025-10-24T20:37:06.231003] [FATAL] [LOCAL     ] PKG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:37:06.231089] [FATAL] [MAIN      ] PKG: Failed to save primary data.
[2025-10-24T20:37:06.231130] [WARN ] [MAIN      ] PKG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:37:06.231165] [INFO ] [LOCAL     ] PKG: Starting deletion of primary data.
[2025-10-24T20:37:06.231215] [DEBUG] [LOCAL     ] PKG: No primary data file found to delete.
[2025-10-24T20:37:06.231250] [INFO ] [LOCAL     ] PKG: Starting deletion of derivative data.
[2025-10-24T20:37:06.231399] [DEBUG] [LOCAL     ] PKG: Deleted derivative data file.
[2025-10-24T20:37:06.231824] [INFO ] [MAIN      ] Update Progress: 1689/2366 symbols completed. PKG took 33.1s. Estimated remaining: 1h 27m 0s. Rate: 7.8 symbols/min
[2025-10-24T20:37:06.407273] [INFO ] [MAIN      ] PLD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:37:06.426330] [INFO ] [REMOTE    ] PKX: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T20:37:06.485406] [DEBUG] [LOCAL     ] PLD: Loaded 53803 existing records from primary storage.
[2025-10-24T20:37:06.485760] [INFO ] [MAIN      ] PLD: Loaded 53803 existing records.
[2025-10-24T20:37:06.552718] [INFO ] [REMOTE    ] PKX: Fetching primary data for 2025-05.
[2025-10-24T20:37:06.663751] [WARN ] [MAIN      ] PLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:37:06.663937] [INFO ] [MAIN      ] PLD: Wiping existing primary data before full refresh.
[2025-10-24T20:37:06.663983] [INFO ] [LOCAL     ] PLD: Starting deletion of primary data.
[2025-10-24T20:37:06.664900] [DEBUG] [LOCAL     ] PLD: Deleted primary data file.
[2025-10-24T20:37:06.664955] [INFO ] [MAIN      ] PLD: Starting full primary refresh.
[2025-10-24T20:37:07.051976] [INFO ] [REMOTE    ] PLD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:37:07.347734] [INFO ] [REMOTE    ] PLD: Fetching primary data for 2025-01.
[2025-10-24T20:37:07.493503] [INFO ] [REMOTE    ] PK: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T20:37:07.509368] [INFO ] [REMOTE    ] PK: Full fetch complete (76531 records).
[2025-10-24T20:37:07.509594] [DEBUG] [VALIDATOR ] PK: Validating primary data.
[2025-10-24T20:37:08.041887] [DEBUG] [VALIDATOR ] PK: All expected trading days are present.
[2025-10-24T20:37:08.042112] [DEBUG] [VALIDATOR ] PK: Primary data validation passed.
[2025-10-24T20:37:08.043750] [INFO ] [MAIN      ] PK: Fetched primary data is valid.
[2025-10-24T20:37:08.044080] [DEBUG] [LOCAL     ] PK: Saving primary data.
[2025-10-24T20:37:08.051330] [FATAL] [LOCAL     ] PK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:37:08.065439] [FATAL] [MAIN      ] PK: Failed to save primary data.
[2025-10-24T20:37:08.067185] [INFO ] [REMOTE    ] PKX: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T20:37:08.067249] [WARN ] [MAIN      ] PK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:37:08.073528] [INFO ] [LOCAL     ] PK: Starting deletion of primary data.
[2025-10-24T20:37:08.073988] [DEBUG] [LOCAL     ] PK: No primary data file found to delete.
[2025-10-24T20:37:08.074230] [INFO ] [LOCAL     ] PK: Starting deletion of derivative data.
[2025-10-24T20:37:08.074456] [DEBUG] [LOCAL     ] PK: Deleted derivative data file.
[2025-10-24T20:37:08.074850] [INFO ] [MAIN      ] Update Progress: 1690/2366 symbols completed. PK took 41.1s. Estimated remaining: 1h 26m 50s. Rate: 7.8 symbols/min
[2025-10-24T20:37:08.152814] [INFO ] [REMOTE    ] PL: Fetching primary data for 2025-01.
[2025-10-24T20:37:08.246480] [INFO ] [MAIN      ] PLNT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:37:08.290299] [DEBUG] [LOCAL     ] PLNT: Loaded 48347 existing records from primary storage.
[2025-10-24T20:37:08.290604] [INFO ] [MAIN      ] PLNT: Loaded 48347 existing records.
[2025-10-24T20:37:08.464053] [WARN ] [MAIN      ] PLNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:37:08.464229] [INFO ] [MAIN      ] PLNT: Wiping existing primary data before full refresh.
[2025-10-24T20:37:08.464274] [INFO ] [LOCAL     ] PLNT: Starting deletion of primary data.
[2025-10-24T20:37:08.464734] [DEBUG] [LOCAL     ] PLNT: Deleted primary data file.
[2025-10-24T20:37:08.464795] [INFO ] [MAIN      ] PLNT: Starting full primary refresh.
[2025-10-24T20:37:08.815340] [INFO ] [REMOTE    ] PLNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:37:08.947622] [INFO ] [REMOTE    ] PLNT: Fetching primary data for 2025-01.
[2025-10-24T20:37:09.266743] [INFO ] [REMOTE    ] PLD: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T20:37:09.747728] [INFO ] [REMOTE    ] PKX: Fetching primary data for 2025-06.
[2025-10-24T20:37:10.478191] [INFO ] [REMOTE    ] PL: Incremental fetch complete for 2025-01 (2.33 seconds).
[2025-10-24T20:37:10.552824] [INFO ] [REMOTE    ] PLD: Fetching primary data for 2025-02.
[2025-10-24T20:37:10.569562] [INFO ] [REMOTE    ] PLNT: Incremental fetch complete for 2025-01 (1.62 seconds).
[2025-10-24T20:37:11.041745] [INFO ] [REMOTE    ] PKX: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T20:37:11.347698] [INFO ] [REMOTE    ] PKX: Fetching primary data for 2025-07.
[2025-10-24T20:37:12.147702] [INFO ] [REMOTE    ] PLNT: Fetching primary data for 2025-02.
[2025-10-24T20:37:12.396889] [INFO ] [REMOTE    ] PLD: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T20:37:12.659512] [INFO ] [REMOTE    ] PKX: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T20:37:12.947740] [INFO ] [REMOTE    ] PLD: Fetching primary data for 2025-03.
[2025-10-24T20:37:13.394149] [INFO ] [REMOTE    ] PLNT: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T20:37:13.747733] [INFO ] [REMOTE    ] PKX: Fetching primary data for 2025-08.
[2025-10-24T20:37:14.547626] [INFO ] [REMOTE    ] PLNT: Fetching primary data for 2025-03.
[2025-10-24T20:37:14.600533] [INFO ] [REMOTE    ] PLD: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T20:37:14.950724] [INFO ] [REMOTE    ] PKX: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T20:37:15.347674] [INFO ] [REMOTE    ] PKX: Fetching primary data for 2025-09.
[2025-10-24T20:37:16.147635] [INFO ] [REMOTE    ] PL: Fetching primary data for 2025-02.
[2025-10-24T20:37:16.355124] [INFO ] [REMOTE    ] PLNT: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T20:37:16.380728] [INFO ] [REMOTE    ] PKX: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T20:37:16.947704] [INFO ] [REMOTE    ] PKX: Fetching primary data for 2025-10.
[2025-10-24T20:37:17.747670] [INFO ] [REMOTE    ] PLD: Fetching primary data for 2025-04.
[2025-10-24T20:37:18.164371] [INFO ] [REMOTE    ] PL: Incremental fetch complete for 2025-02 (2.02 seconds).
[2025-10-24T20:37:18.214191] [INFO ] [REMOTE    ] PKX: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T20:37:18.218375] [INFO ] [REMOTE    ] PKX: Full fetch complete (35844 records).
[2025-10-24T20:37:18.218451] [DEBUG] [VALIDATOR ] PKX: Validating primary data.
[2025-10-24T20:37:18.552754] [INFO ] [REMOTE    ] PL: Fetching primary data for 2025-03.
[2025-10-24T20:37:18.623062] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present.
[2025-10-24T20:37:18.623132] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed.
[2025-10-24T20:37:18.623971] [INFO ] [MAIN      ] PKX: Fetched primary data is valid.
[2025-10-24T20:37:18.624035] [DEBUG] [LOCAL     ] PKX: Saving primary data.
[2025-10-24T20:37:18.624503] [FATAL] [LOCAL     ] PKX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:37:18.624589] [FATAL] [MAIN      ] PKX: Failed to save primary data.
[2025-10-24T20:37:18.624674] [WARN ] [MAIN      ] PKX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:37:18.624733] [INFO ] [LOCAL     ] PKX: Starting deletion of primary data.
[2025-10-24T20:37:18.624787] [DEBUG] [LOCAL     ] PKX: No primary data file found to delete.
[2025-10-24T20:37:18.624823] [INFO ] [LOCAL     ] PKX: Starting deletion of derivative data.
[2025-10-24T20:37:18.625004] [DEBUG] [LOCAL     ] PKX: Deleted derivative data file.
[2025-10-24T20:37:18.625099] [INFO ] [MAIN      ] Update Progress: 1691/2366 symbols completed. PKX took 23.2s. Estimated remaining: 1h 26m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:37:18.797035] [INFO ] [MAIN      ] PLOW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:37:18.817802] [DEBUG] [LOCAL     ] PLOW: Loaded 19740 existing records from primary storage.
[2025-10-24T20:37:18.818045] [INFO ] [MAIN      ] PLOW: Loaded 19740 existing records.
[2025-10-24T20:37:18.999872] [WARN ] [MAIN      ] PLOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:37:19.000070] [INFO ] [MAIN      ] PLOW: Wiping existing primary data before full refresh.
[2025-10-24T20:37:19.000119] [INFO ] [LOCAL     ] PLOW: Starting deletion of primary data.
[2025-10-24T20:37:19.000334] [DEBUG] [LOCAL     ] PLOW: Deleted primary data file.
[2025-10-24T20:37:19.000390] [INFO ] [MAIN      ] PLOW: Starting full primary refresh.
[2025-10-24T20:37:19.352921] [INFO ] [REMOTE    ] PLNT: Fetching primary data for 2025-04.
[2025-10-24T20:37:19.372526] [INFO ] [REMOTE    ] PLOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:37:19.876369] [INFO ] [REMOTE    ] PLD: Incremental fetch complete for 2025-04 (2.13 seconds).
[2025-10-24T20:37:20.147694] [INFO ] [REMOTE    ] PLD: Fetching primary data for 2025-05.
[2025-10-24T20:37:20.947629] [INFO ] [REMOTE    ] PLOW: Fetching primary data for 2025-01.
[2025-10-24T20:37:21.058620] [INFO ] [REMOTE    ] PL: Incremental fetch complete for 2025-03 (2.51 seconds).
[2025-10-24T20:37:21.253034] [INFO ] [REMOTE    ] PLNT: Incremental fetch complete for 2025-04 (1.90 seconds).
[2025-10-24T20:37:21.747632] [INFO ] [REMOTE    ] PL: Fetching primary data for 2025-04.
[2025-10-24T20:37:21.968578] [INFO ] [REMOTE    ] PLOW: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T20:37:22.051316] [INFO ] [REMOTE    ] PLD: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T20:37:22.547632] [INFO ] [REMOTE    ] PLOW: Fetching primary data for 2025-02.
[2025-10-24T20:37:23.347612] [INFO ] [REMOTE    ] PLD: Fetching primary data for 2025-06.
[2025-10-24T20:37:23.658595] [INFO ] [REMOTE    ] PLOW: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T20:37:23.733416] [INFO ] [REMOTE    ] PL: Incremental fetch complete for 2025-04 (1.99 seconds).
[2025-10-24T20:37:24.147683] [INFO ] [REMOTE    ] PL: Fetching primary data for 2025-05.
[2025-10-24T20:37:24.947674] [INFO ] [REMOTE    ] PLOW: Fetching primary data for 2025-03.
[2025-10-24T20:37:25.085109] [INFO ] [REMOTE    ] PLD: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T20:37:25.747634] [INFO ] [REMOTE    ] PLNT: Fetching primary data for 2025-05.
[2025-10-24T20:37:25.808027] [INFO ] [REMOTE    ] PLOW: Incremental fetch complete for 2025-03 (0.86 seconds).
[2025-10-24T20:37:26.071256] [INFO ] [REMOTE    ] PL: Incremental fetch complete for 2025-05 (1.92 seconds).
[2025-10-24T20:37:26.547669] [INFO ] [REMOTE    ] PLD: Fetching primary data for 2025-07.
[2025-10-24T20:37:27.347626] [INFO ] [REMOTE    ] PL: Fetching primary data for 2025-06.
[2025-10-24T20:37:27.631316] [INFO ] [REMOTE    ] PLNT: Incremental fetch complete for 2025-05 (1.88 seconds).
[2025-10-24T20:37:28.147698] [INFO ] [REMOTE    ] PLOW: Fetching primary data for 2025-04.
[2025-10-24T20:37:28.712967] [INFO ] [REMOTE    ] PLD: Incremental fetch complete for 2025-07 (2.17 seconds).
[2025-10-24T20:37:28.947672] [INFO ] [REMOTE    ] PLNT: Fetching primary data for 2025-06.
[2025-10-24T20:37:29.488233] [INFO ] [REMOTE    ] PLOW: Incremental fetch complete for 2025-04 (1.34 seconds).
[2025-10-24T20:37:29.554254] [INFO ] [REMOTE    ] PL: Incremental fetch complete for 2025-06 (2.21 seconds).
[2025-10-24T20:37:29.747684] [INFO ] [REMOTE    ] PLOW: Fetching primary data for 2025-05.
[2025-10-24T20:37:30.547620] [INFO ] [REMOTE    ] PLD: Fetching primary data for 2025-08.
[2025-10-24T20:37:30.654041] [INFO ] [REMOTE    ] PLNT: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T20:37:31.091751] [INFO ] [REMOTE    ] PLOW: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T20:37:31.347669] [INFO ] [REMOTE    ] PL: Fetching primary data for 2025-07.
[2025-10-24T20:37:32.147690] [INFO ] [REMOTE    ] PLOW: Fetching primary data for 2025-06.
[2025-10-24T20:37:32.645318] [INFO ] [REMOTE    ] PLD: Incremental fetch complete for 2025-08 (2.10 seconds).
[2025-10-24T20:37:32.947722] [INFO ] [REMOTE    ] PLD: Fetching primary data for 2025-09.
[2025-10-24T20:37:33.373911] [INFO ] [REMOTE    ] PLOW: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T20:37:33.747712] [INFO ] [REMOTE    ] PLNT: Fetching primary data for 2025-07.
[2025-10-24T20:37:34.117391] [INFO ] [REMOTE    ] PL: Incremental fetch complete for 2025-07 (2.77 seconds).
[2025-10-24T20:37:34.547718] [INFO ] [REMOTE    ] PLOW: Fetching primary data for 2025-07.
[2025-10-24T20:37:35.278004] [INFO ] [REMOTE    ] PLD: Incremental fetch complete for 2025-09 (2.33 seconds).
[2025-10-24T20:37:35.347618] [INFO ] [REMOTE    ] PLD: Fetching primary data for 2025-10.
[2025-10-24T20:37:35.570268] [INFO ] [REMOTE    ] PLNT: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T20:37:35.764773] [INFO ] [REMOTE    ] PLOW: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T20:37:36.147676] [INFO ] [REMOTE    ] PLOW: Fetching primary data for 2025-08.
[2025-10-24T20:37:36.947695] [INFO ] [REMOTE    ] PLNT: Fetching primary data for 2025-08.
[2025-10-24T20:37:37.355497] [INFO ] [REMOTE    ] PLD: Incremental fetch complete for 2025-10 (2.01 seconds).
[2025-10-24T20:37:37.365894] [INFO ] [REMOTE    ] PLD: Full fetch complete (77504 records).
[2025-10-24T20:37:37.366041] [DEBUG] [VALIDATOR ] PLD: Validating primary data.
[2025-10-24T20:37:37.557403] [INFO ] [REMOTE    ] PLOW: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T20:37:37.756549] [INFO ] [REMOTE    ] PLOW: Fetching primary data for 2025-09.
[2025-10-24T20:37:37.780791] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present.
[2025-10-24T20:37:37.780877] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed.
[2025-10-24T20:37:37.782109] [INFO ] [MAIN      ] PLD: Fetched primary data is valid.
[2025-10-24T20:37:37.782172] [DEBUG] [LOCAL     ] PLD: Saving primary data.
[2025-10-24T20:37:37.782847] [FATAL] [LOCAL     ] PLD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:37:37.782983] [FATAL] [MAIN      ] PLD: Failed to save primary data.
[2025-10-24T20:37:37.783046] [WARN ] [MAIN      ] PLD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:37:37.783117] [INFO ] [LOCAL     ] PLD: Starting deletion of primary data.
[2025-10-24T20:37:37.783209] [DEBUG] [LOCAL     ] PLD: No primary data file found to delete.
[2025-10-24T20:37:37.783250] [INFO ] [LOCAL     ] PLD: Starting deletion of derivative data.
[2025-10-24T20:37:37.783563] [DEBUG] [LOCAL     ] PLD: Deleted derivative data file.
[2025-10-24T20:37:37.784199] [INFO ] [MAIN      ] Update Progress: 1692/2366 symbols completed. PLD took 31.6s. Estimated remaining: 1h 26m 40s. Rate: 7.8 symbols/min
[2025-10-24T20:37:37.950619] [INFO ] [MAIN      ] PLYM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:37:37.985029] [DEBUG] [LOCAL     ] PLYM: Loaded 34660 existing records from primary storage.
[2025-10-24T20:37:37.985290] [INFO ] [MAIN      ] PLYM: Loaded 34660 existing records.
[2025-10-24T20:37:38.159480] [WARN ] [MAIN      ] PLYM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:37:38.159703] [INFO ] [MAIN      ] PLYM: Wiping existing primary data before full refresh.
[2025-10-24T20:37:38.159761] [INFO ] [LOCAL     ] PLYM: Starting deletion of primary data.
[2025-10-24T20:37:38.160081] [DEBUG] [LOCAL     ] PLYM: Deleted primary data file.
[2025-10-24T20:37:38.160137] [INFO ] [MAIN      ] PLYM: Starting full primary refresh.
[2025-10-24T20:37:38.520935] [INFO ] [REMOTE    ] PLYM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:37:38.552747] [INFO ] [REMOTE    ] PLYM: Fetching primary data for 2025-01.
[2025-10-24T20:37:38.570081] [INFO ] [REMOTE    ] PLNT: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T20:37:38.898895] [INFO ] [REMOTE    ] PLOW: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T20:37:39.347713] [INFO ] [REMOTE    ] PLNT: Fetching primary data for 2025-09.
[2025-10-24T20:37:40.014339] [INFO ] [REMOTE    ] PLYM: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T20:37:40.147681] [INFO ] [REMOTE    ] PLYM: Fetching primary data for 2025-02.
[2025-10-24T20:37:40.947678] [INFO ] [REMOTE    ] PLOW: Fetching primary data for 2025-10.
[2025-10-24T20:37:41.069050] [INFO ] [REMOTE    ] PLNT: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T20:37:41.412506] [INFO ] [REMOTE    ] PLYM: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T20:37:41.747698] [INFO ] [REMOTE    ] PLNT: Fetching primary data for 2025-10.
[2025-10-24T20:37:41.993180] [INFO ] [REMOTE    ] PLOW: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T20:37:41.996120] [INFO ] [REMOTE    ] PLOW: Full fetch complete (28100 records).
[2025-10-24T20:37:41.996210] [DEBUG] [VALIDATOR ] PLOW: Validating primary data.
[2025-10-24T20:37:42.368750] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present.
[2025-10-24T20:37:42.368829] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed.
[2025-10-24T20:37:42.369400] [INFO ] [MAIN      ] PLOW: Fetched primary data is valid.
[2025-10-24T20:37:42.369439] [DEBUG] [LOCAL     ] PLOW: Saving primary data.
[2025-10-24T20:37:42.369805] [FATAL] [LOCAL     ] PLOW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:37:42.369889] [FATAL] [MAIN      ] PLOW: Failed to save primary data.
[2025-10-24T20:37:42.369931] [WARN ] [MAIN      ] PLOW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:37:42.370011] [INFO ] [LOCAL     ] PLOW: Starting deletion of primary data.
[2025-10-24T20:37:42.370068] [DEBUG] [LOCAL     ] PLOW: No primary data file found to delete.
[2025-10-24T20:37:42.370102] [INFO ] [LOCAL     ] PLOW: Starting deletion of derivative data.
[2025-10-24T20:37:42.370259] [DEBUG] [LOCAL     ] PLOW: Deleted derivative data file.
[2025-10-24T20:37:42.370353] [INFO ] [MAIN      ] Update Progress: 1693/2366 symbols completed. PLOW took 23.7s. Estimated remaining: 1h 26m 31s. Rate: 7.8 symbols/min
[2025-10-24T20:37:42.542126] [INFO ] [MAIN      ] PM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:37:42.555264] [INFO ] [REMOTE    ] PLYM: Fetching primary data for 2025-03.
[2025-10-24T20:37:42.572156] [INFO ] [REMOTE    ] PLNT: Incremental fetch complete for 2025-10 (0.82 seconds).
[2025-10-24T20:37:42.581694] [INFO ] [REMOTE    ] PLNT: Full fetch complete (70594 records).
[2025-10-24T20:37:42.581885] [DEBUG] [VALIDATOR ] PLNT: Validating primary data.
[2025-10-24T20:37:42.914357] [DEBUG] [LOCAL     ] PM: Loaded 54064 existing records from primary storage.
[2025-10-24T20:37:42.941931] [INFO ] [MAIN      ] PM: Loaded 54064 existing records.
[2025-10-24T20:37:43.261619] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present.
[2025-10-24T20:37:43.262044] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed.
[2025-10-24T20:37:43.279680] [INFO ] [MAIN      ] PLNT: Fetched primary data is valid.
[2025-10-24T20:37:43.284045] [WARN ] [MAIN      ] PM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:37:43.284206] [DEBUG] [LOCAL     ] PLNT: Saving primary data.
[2025-10-24T20:37:43.284388] [INFO ] [MAIN      ] PM: Wiping existing primary data before full refresh.
[2025-10-24T20:37:43.284459] [INFO ] [LOCAL     ] PM: Starting deletion of primary data.
[2025-10-24T20:37:43.285104] [FATAL] [LOCAL     ] PLNT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:37:43.285164] [DEBUG] [LOCAL     ] PM: Deleted primary data file.
[2025-10-24T20:37:43.285301] [INFO ] [MAIN      ] PM: Starting full primary refresh.
[2025-10-24T20:37:43.285372] [FATAL] [MAIN      ] PLNT: Failed to save primary data.
[2025-10-24T20:37:43.349993] [INFO ] [REMOTE    ] PL: Fetching primary data for 2025-08.
[2025-10-24T20:37:43.355172] [WARN ] [MAIN      ] PLNT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:37:43.385343] [INFO ] [LOCAL     ] PLNT: Starting deletion of primary data.
[2025-10-24T20:37:43.388584] [DEBUG] [LOCAL     ] PLNT: No primary data file found to delete.
[2025-10-24T20:37:43.388761] [INFO ] [LOCAL     ] PLNT: Starting deletion of derivative data.
[2025-10-24T20:37:43.410513] [DEBUG] [LOCAL     ] PLNT: Deleted derivative data file.
[2025-10-24T20:37:43.432250] [INFO ] [MAIN      ] Update Progress: 1694/2366 symbols completed. PLNT took 35.4s. Estimated remaining: 1h 26m 21s. Rate: 7.8 symbols/min
[2025-10-24T20:37:43.800937] [INFO ] [REMOTE    ] PM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:37:43.827282] [INFO ] [MAIN      ] PML: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:37:43.850147] [DEBUG] [LOCAL     ] PML: Loaded 22040 existing records from primary storage.
[2025-10-24T20:37:43.850510] [INFO ] [MAIN      ] PML: Loaded 22040 existing records.
[2025-10-24T20:37:44.029237] [WARN ] [MAIN      ] PML: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:37:44.029608] [INFO ] [MAIN      ] PML: Wiping existing primary data before full refresh.
[2025-10-24T20:37:44.029731] [INFO ] [LOCAL     ] PML: Starting deletion of primary data.
[2025-10-24T20:37:44.036718] [DEBUG] [LOCAL     ] PML: Deleted primary data file.
[2025-10-24T20:37:44.048276] [INFO ] [MAIN      ] PML: Starting full primary refresh.
[2025-10-24T20:37:44.113890] [INFO ] [REMOTE    ] PLYM: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T20:37:44.155527] [INFO ] [REMOTE    ] PM: Fetching primary data for 2025-01.
[2025-10-24T20:37:44.415732] [INFO ] [REMOTE    ] PML: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:37:44.947667] [INFO ] [REMOTE    ] PLYM: Fetching primary data for 2025-04.
[2025-10-24T20:37:45.747789] [INFO ] [REMOTE    ] PML: Fetching primary data for 2025-01.
[2025-10-24T20:37:45.789071] [INFO ] [REMOTE    ] PL: Incremental fetch complete for 2025-08 (2.44 seconds).
[2025-10-24T20:37:45.894823] [INFO ] [REMOTE    ] PM: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T20:37:46.019094] [INFO ] [REMOTE    ] PLYM: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T20:37:46.547666] [INFO ] [REMOTE    ] PLYM: Fetching primary data for 2025-05.
[2025-10-24T20:37:46.922729] [INFO ] [REMOTE    ] PML: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T20:37:47.347675] [INFO ] [REMOTE    ] PML: Fetching primary data for 2025-02.
[2025-10-24T20:37:48.103723] [INFO ] [REMOTE    ] PLYM: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T20:37:48.147605] [INFO ] [REMOTE    ] PLYM: Fetching primary data for 2025-06.
[2025-10-24T20:37:48.411243] [INFO ] [REMOTE    ] PML: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T20:37:48.947636] [INFO ] [REMOTE    ] PL: Fetching primary data for 2025-09.
[2025-10-24T20:37:49.619092] [INFO ] [REMOTE    ] PLYM: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T20:37:49.747765] [INFO ] [REMOTE    ] PML: Fetching primary data for 2025-03.
[2025-10-24T20:37:50.547697] [INFO ] [REMOTE    ] PLYM: Fetching primary data for 2025-07.
[2025-10-24T20:37:50.872473] [INFO ] [REMOTE    ] PML: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T20:37:51.347622] [INFO ] [REMOTE    ] PM: Fetching primary data for 2025-02.
[2025-10-24T20:37:51.580795] [INFO ] [REMOTE    ] PL: Incremental fetch complete for 2025-09 (2.63 seconds).
[2025-10-24T20:37:51.647261] [INFO ] [REMOTE    ] PLYM: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T20:37:52.147736] [INFO ] [REMOTE    ] PML: Fetching primary data for 2025-04.
[2025-10-24T20:37:52.947699] [INFO ] [REMOTE    ] PL: Fetching primary data for 2025-10.
[2025-10-24T20:37:53.287168] [INFO ] [REMOTE    ] PM: Incremental fetch complete for 2025-02 (1.94 seconds).
[2025-10-24T20:37:53.562510] [INFO ] [REMOTE    ] PML: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T20:37:53.747682] [INFO ] [REMOTE    ] PLYM: Fetching primary data for 2025-08.
[2025-10-24T20:37:54.547721] [INFO ] [REMOTE    ] PM: Fetching primary data for 2025-03.
[2025-10-24T20:37:55.302296] [INFO ] [REMOTE    ] PLYM: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T20:37:55.347613] [INFO ] [REMOTE    ] PLYM: Fetching primary data for 2025-09.
[2025-10-24T20:37:55.486041] [INFO ] [REMOTE    ] PL: Incremental fetch complete for 2025-10 (2.54 seconds).
[2025-10-24T20:37:55.497635] [INFO ] [REMOTE    ] PL: Full fetch complete (77131 records).
[2025-10-24T20:37:55.497875] [DEBUG] [VALIDATOR ] PL: Validating primary data.
[2025-10-24T20:37:55.921157] [DEBUG] [VALIDATOR ] PL: All expected trading days are present.
[2025-10-24T20:37:55.921274] [DEBUG] [VALIDATOR ] PL: Primary data validation passed.
[2025-10-24T20:37:55.923564] [INFO ] [MAIN      ] PL: Fetched primary data is valid.
[2025-10-24T20:37:55.923685] [DEBUG] [LOCAL     ] PL: Saving primary data.
[2025-10-24T20:37:55.924712] [FATAL] [LOCAL     ] PL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:37:55.924818] [FATAL] [MAIN      ] PL: Failed to save primary data.
[2025-10-24T20:37:55.924864] [WARN ] [MAIN      ] PL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:37:55.924937] [INFO ] [LOCAL     ] PL: Starting deletion of primary data.
[2025-10-24T20:37:55.925038] [DEBUG] [LOCAL     ] PL: No primary data file found to delete.
[2025-10-24T20:37:55.925078] [INFO ] [LOCAL     ] PL: Starting deletion of derivative data.
[2025-10-24T20:37:55.925268] [DEBUG] [LOCAL     ] PL: Deleted derivative data file.
[2025-10-24T20:37:55.925906] [INFO ] [MAIN      ] Update Progress: 1695/2366 symbols completed. PL took 53.3s. Estimated remaining: 1h 26m 15s. Rate: 7.8 symbols/min
[2025-10-24T20:37:56.109995] [INFO ] [MAIN      ] PMM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:37:56.126091] [DEBUG] [LOCAL     ] PMM: Loaded 10151 existing records from primary storage.
[2025-10-24T20:37:56.126415] [INFO ] [MAIN      ] PMM: Loaded 10151 existing records.
[2025-10-24T20:37:56.160761] [INFO ] [REMOTE    ] PML: Fetching primary data for 2025-05.
[2025-10-24T20:37:56.326565] [WARN ] [MAIN      ] PMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:37:56.327024] [INFO ] [MAIN      ] PMM: Wiping existing primary data before full refresh.
[2025-10-24T20:37:56.327163] [INFO ] [LOCAL     ] PMM: Starting deletion of primary data.
[2025-10-24T20:37:56.327527] [DEBUG] [LOCAL     ] PMM: Deleted primary data file.
[2025-10-24T20:37:56.327602] [INFO ] [MAIN      ] PMM: Starting full primary refresh.
[2025-10-24T20:37:56.512591] [INFO ] [REMOTE    ] PM: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T20:37:56.745750] [INFO ] [REMOTE    ] PMM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:37:56.920888] [INFO ] [REMOTE    ] PLYM: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T20:37:56.947608] [INFO ] [REMOTE    ] PLYM: Fetching primary data for 2025-10.
[2025-10-24T20:37:57.262796] [INFO ] [REMOTE    ] PML: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T20:37:57.747684] [INFO ] [REMOTE    ] PM: Fetching primary data for 2025-04.
[2025-10-24T20:37:58.547684] [INFO ] [REMOTE    ] PML: Fetching primary data for 2025-06.
[2025-10-24T20:37:58.677274] [INFO ] [REMOTE    ] PLYM: Incremental fetch complete for 2025-10 (1.73 seconds).
[2025-10-24T20:37:58.684899] [INFO ] [REMOTE    ] PLYM: Full fetch complete (48052 records).
[2025-10-24T20:37:58.685066] [DEBUG] [VALIDATOR ] PLYM: Validating primary data.
[2025-10-24T20:37:59.101094] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present.
[2025-10-24T20:37:59.101261] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed.
[2025-10-24T20:37:59.102832] [INFO ] [MAIN      ] PLYM: Fetched primary data is valid.
[2025-10-24T20:37:59.102910] [DEBUG] [LOCAL     ] PLYM: Saving primary data.
[2025-10-24T20:37:59.103755] [FATAL] [LOCAL     ] PLYM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:37:59.103864] [FATAL] [MAIN      ] PLYM: Failed to save primary data.
[2025-10-24T20:37:59.103908] [WARN ] [MAIN      ] PLYM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:37:59.103945] [INFO ] [LOCAL     ] PLYM: Starting deletion of primary data.
[2025-10-24T20:37:59.104002] [DEBUG] [LOCAL     ] PLYM: No primary data file found to delete.
[2025-10-24T20:37:59.104040] [INFO ] [LOCAL     ] PLYM: Starting deletion of derivative data.
[2025-10-24T20:37:59.104256] [DEBUG] [LOCAL     ] PLYM: Deleted derivative data file.
[2025-10-24T20:37:59.104772] [INFO ] [MAIN      ] Update Progress: 1696/2366 symbols completed. PLYM took 21.3s. Estimated remaining: 1h 26m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:37:59.275247] [INFO ] [MAIN      ] PMO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:37:59.290256] [DEBUG] [LOCAL     ] PMO: Loaded 9477 existing records from primary storage.
[2025-10-24T20:37:59.290599] [INFO ] [MAIN      ] PMO: Loaded 9477 existing records.
[2025-10-24T20:37:59.353935] [INFO ] [REMOTE    ] PMM: Fetching primary data for 2025-01.
[2025-10-24T20:37:59.479446] [WARN ] [MAIN      ] PMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:37:59.479898] [INFO ] [MAIN      ] PMO: Wiping existing primary data before full refresh.
[2025-10-24T20:37:59.479951] [INFO ] [LOCAL     ] PMO: Starting deletion of primary data.
[2025-10-24T20:37:59.480259] [DEBUG] [LOCAL     ] PMO: Deleted primary data file.
[2025-10-24T20:37:59.480338] [INFO ] [MAIN      ] PMO: Starting full primary refresh.
[2025-10-24T20:37:59.873107] [INFO ] [REMOTE    ] PMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:37:59.888427] [INFO ] [REMOTE    ] PML: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T20:37:59.927519] [INFO ] [REMOTE    ] PM: Incremental fetch complete for 2025-04 (2.18 seconds).
[2025-10-24T20:38:00.147728] [INFO ] [REMOTE    ] PM: Fetching primary data for 2025-05.
[2025-10-24T20:38:00.388052] [INFO ] [REMOTE    ] PMM: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T20:38:00.947631] [INFO ] [REMOTE    ] PMO: Fetching primary data for 2025-01.
[2025-10-24T20:38:01.747722] [INFO ] [REMOTE    ] PMM: Fetching primary data for 2025-02.
[2025-10-24T20:38:02.547737] [INFO ] [REMOTE    ] PML: Fetching primary data for 2025-07.
[2025-10-24T20:38:02.681853] [INFO ] [REMOTE    ] PM: Incremental fetch complete for 2025-05 (2.53 seconds).
[2025-10-24T20:38:02.705179] [INFO ] [REMOTE    ] PMO: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T20:38:02.832566] [INFO ] [REMOTE    ] PMM: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T20:38:03.347620] [INFO ] [REMOTE    ] PM: Fetching primary data for 2025-06.
[2025-10-24T20:38:03.799147] [INFO ] [REMOTE    ] PML: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T20:38:04.147736] [INFO ] [REMOTE    ] PMO: Fetching primary data for 2025-02.
[2025-10-24T20:38:04.947703] [INFO ] [REMOTE    ] PMM: Fetching primary data for 2025-03.
[2025-10-24T20:38:05.084905] [INFO ] [REMOTE    ] PMO: Incremental fetch complete for 2025-02 (0.94 seconds).
[2025-10-24T20:38:05.527854] [INFO ] [REMOTE    ] PM: Incremental fetch complete for 2025-06 (2.18 seconds).
[2025-10-24T20:38:05.714266] [INFO ] [REMOTE    ] PMM: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T20:38:05.747629] [INFO ] [REMOTE    ] PMO: Fetching primary data for 2025-03.
[2025-10-24T20:38:06.547728] [INFO ] [REMOTE    ] PM: Fetching primary data for 2025-07.
[2025-10-24T20:38:06.849219] [INFO ] [REMOTE    ] PMO: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T20:38:07.347684] [INFO ] [REMOTE    ] PMO: Fetching primary data for 2025-04.
[2025-10-24T20:38:08.147736] [INFO ] [REMOTE    ] PMM: Fetching primary data for 2025-04.
[2025-10-24T20:38:08.582316] [INFO ] [REMOTE    ] PMO: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T20:38:08.887529] [INFO ] [REMOTE    ] PM: Incremental fetch complete for 2025-07 (2.34 seconds).
[2025-10-24T20:38:08.947687] [INFO ] [REMOTE    ] PM: Fetching primary data for 2025-08.
[2025-10-24T20:38:08.983940] [INFO ] [REMOTE    ] PMM: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T20:38:09.747699] [INFO ] [REMOTE    ] PML: Fetching primary data for 2025-08.
[2025-10-24T20:38:10.547608] [INFO ] [REMOTE    ] PMM: Fetching primary data for 2025-05.
[2025-10-24T20:38:10.897686] [INFO ] [REMOTE    ] PM: Incremental fetch complete for 2025-08 (1.95 seconds).
[2025-10-24T20:38:11.176608] [INFO ] [REMOTE    ] PML: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T20:38:11.347724] [INFO ] [REMOTE    ] PML: Fetching primary data for 2025-09.
[2025-10-24T20:38:11.448939] [INFO ] [REMOTE    ] PMM: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T20:38:12.147733] [INFO ] [REMOTE    ] PMO: Fetching primary data for 2025-05.
[2025-10-24T20:38:12.612512] [INFO ] [REMOTE    ] PML: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T20:38:12.685401] [INFO ] [REMOTE    ] PMO: Incremental fetch complete for 2025-05 (0.54 seconds).
[2025-10-24T20:38:12.947729] [INFO ] [REMOTE    ] PML: Fetching primary data for 2025-10.
[2025-10-24T20:38:13.747724] [INFO ] [REMOTE    ] PMM: Fetching primary data for 2025-06.
[2025-10-24T20:38:14.196401] [INFO ] [REMOTE    ] PML: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T20:38:14.201132] [INFO ] [REMOTE    ] PML: Full fetch complete (29791 records).
[2025-10-24T20:38:14.201224] [DEBUG] [VALIDATOR ] PML: Validating primary data.
[2025-10-24T20:38:14.552752] [INFO ] [REMOTE    ] PMO: Fetching primary data for 2025-06.
[2025-10-24T20:38:14.617579] [DEBUG] [VALIDATOR ] PML: All expected trading days are present.
[2025-10-24T20:38:14.617692] [DEBUG] [VALIDATOR ] PML: Primary data validation passed.
[2025-10-24T20:38:14.618425] [INFO ] [MAIN      ] PML: Fetched primary data is valid.
[2025-10-24T20:38:14.618488] [DEBUG] [LOCAL     ] PML: Saving primary data.
[2025-10-24T20:38:14.618857] [FATAL] [LOCAL     ] PML: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:38:14.618938] [FATAL] [MAIN      ] PML: Failed to save primary data.
[2025-10-24T20:38:14.618980] [WARN ] [MAIN      ] PML: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:38:14.619043] [INFO ] [LOCAL     ] PML: Starting deletion of primary data.
[2025-10-24T20:38:14.619100] [DEBUG] [LOCAL     ] PML: No primary data file found to delete.
[2025-10-24T20:38:14.619137] [INFO ] [LOCAL     ] PML: Starting deletion of derivative data.
[2025-10-24T20:38:14.619277] [DEBUG] [LOCAL     ] PML: Deleted derivative data file.
[2025-10-24T20:38:14.619352] [INFO ] [MAIN      ] Update Progress: 1697/2366 symbols completed. PML took 31.2s. Estimated remaining: 1h 26m 1s. Rate: 7.8 symbols/min
[2025-10-24T20:38:14.730073] [INFO ] [REMOTE    ] PMM: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T20:38:14.798623] [INFO ] [MAIN      ] PMT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:38:14.836694] [DEBUG] [LOCAL     ] PMT: Loaded 41066 existing records from primary storage.
[2025-10-24T20:38:14.836971] [INFO ] [MAIN      ] PMT: Loaded 41066 existing records.
[2025-10-24T20:38:15.016299] [WARN ] [MAIN      ] PMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:38:15.016532] [INFO ] [MAIN      ] PMT: Wiping existing primary data before full refresh.
[2025-10-24T20:38:15.016580] [INFO ] [LOCAL     ] PMT: Starting deletion of primary data.
[2025-10-24T20:38:15.017112] [DEBUG] [LOCAL     ] PMT: Deleted primary data file.
[2025-10-24T20:38:15.017169] [INFO ] [MAIN      ] PMT: Starting full primary refresh.
[2025-10-24T20:38:15.352974] [INFO ] [REMOTE    ] PM: Fetching primary data for 2025-09.
[2025-10-24T20:38:15.449171] [INFO ] [REMOTE    ] PMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:38:15.620305] [INFO ] [REMOTE    ] PMO: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T20:38:16.147854] [INFO ] [REMOTE    ] PMO: Fetching primary data for 2025-07.
[2025-10-24T20:38:16.947675] [INFO ] [REMOTE    ] PMT: Fetching primary data for 2025-01.
[2025-10-24T20:38:17.096284] [INFO ] [REMOTE    ] PMO: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T20:38:17.573876] [INFO ] [REMOTE    ] PM: Incremental fetch complete for 2025-09 (2.22 seconds).
[2025-10-24T20:38:17.747876] [INFO ] [REMOTE    ] PM: Fetching primary data for 2025-10.
[2025-10-24T20:38:18.117115] [INFO ] [REMOTE    ] PMT: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T20:38:18.547686] [INFO ] [REMOTE    ] PMO: Fetching primary data for 2025-08.
[2025-10-24T20:38:19.119355] [INFO ] [REMOTE    ] PMO: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T20:38:19.347707] [INFO ] [REMOTE    ] PMO: Fetching primary data for 2025-09.
[2025-10-24T20:38:19.631501] [INFO ] [REMOTE    ] PM: Incremental fetch complete for 2025-10 (1.88 seconds).
[2025-10-24T20:38:19.641575] [INFO ] [REMOTE    ] PM: Full fetch complete (77834 records).
[2025-10-24T20:38:19.641766] [DEBUG] [VALIDATOR ] PM: Validating primary data.
[2025-10-24T20:38:20.038099] [DEBUG] [VALIDATOR ] PM: All expected trading days are present.
[2025-10-24T20:38:20.038209] [DEBUG] [VALIDATOR ] PM: Primary data validation passed.
[2025-10-24T20:38:20.039382] [INFO ] [MAIN      ] PM: Fetched primary data is valid.
[2025-10-24T20:38:20.039446] [DEBUG] [LOCAL     ] PM: Saving primary data.
[2025-10-24T20:38:20.040112] [FATAL] [LOCAL     ] PM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:38:20.040199] [FATAL] [MAIN      ] PM: Failed to save primary data.
[2025-10-24T20:38:20.040241] [WARN ] [MAIN      ] PM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:38:20.040276] [INFO ] [LOCAL     ] PM: Starting deletion of primary data.
[2025-10-24T20:38:20.040329] [DEBUG] [LOCAL     ] PM: No primary data file found to delete.
[2025-10-24T20:38:20.040363] [INFO ] [LOCAL     ] PM: Starting deletion of derivative data.
[2025-10-24T20:38:20.040538] [DEBUG] [LOCAL     ] PM: Deleted derivative data file.
[2025-10-24T20:38:20.041248] [INFO ] [MAIN      ] Update Progress: 1698/2366 symbols completed. PM took 37.7s. Estimated remaining: 1h 25m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:38:20.150308] [INFO ] [REMOTE    ] PMT: Fetching primary data for 2025-02.
[2025-10-24T20:38:20.214714] [INFO ] [MAIN      ] PMTU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:38:20.214882] [DEBUG] [LOCAL     ] PMTU: No existing data file found in primary storage.
[2025-10-24T20:38:20.214919] [WARN ] [MAIN      ] PMTU: No existing data found, performing full refresh instead.
[2025-10-24T20:38:20.215021] [INFO ] [MAIN      ] PMTU: Wiping existing primary data before full refresh.
[2025-10-24T20:38:20.215062] [INFO ] [LOCAL     ] PMTU: Starting deletion of primary data.
[2025-10-24T20:38:20.215102] [DEBUG] [LOCAL     ] PMTU: No primary data file found to delete.
[2025-10-24T20:38:20.215133] [INFO ] [MAIN      ] PMTU: Starting full primary refresh.
[2025-10-24T20:38:20.322385] [INFO ] [REMOTE    ] PMO: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T20:38:20.586231] [INFO ] [REMOTE    ] PMTU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:38:20.947638] [INFO ] [REMOTE    ] PMM: Fetching primary data for 2025-07.
[2025-10-24T20:38:21.747621] [INFO ] [REMOTE    ] PMO: Fetching primary data for 2025-10.
[2025-10-24T20:38:21.784983] [INFO ] [REMOTE    ] PMT: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T20:38:21.857388] [INFO ] [REMOTE    ] PMM: Incremental fetch complete for 2025-07 (0.91 seconds).
[2025-10-24T20:38:22.547639] [INFO ] [REMOTE    ] PMT: Fetching primary data for 2025-03.
[2025-10-24T20:38:22.596542] [INFO ] [REMOTE    ] PMO: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T20:38:22.598272] [INFO ] [REMOTE    ] PMO: Full fetch complete (15822 records).
[2025-10-24T20:38:22.598343] [DEBUG] [VALIDATOR ] PMO: Validating primary data.
[2025-10-24T20:38:22.983119] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present.
[2025-10-24T20:38:22.983193] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed.
[2025-10-24T20:38:22.983578] [INFO ] [MAIN      ] PMO: Fetched primary data is valid.
[2025-10-24T20:38:22.983639] [DEBUG] [LOCAL     ] PMO: Saving primary data.
[2025-10-24T20:38:22.983910] [FATAL] [LOCAL     ] PMO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:38:22.983991] [FATAL] [MAIN      ] PMO: Failed to save primary data.
[2025-10-24T20:38:22.984034] [WARN ] [MAIN      ] PMO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:38:22.984068] [INFO ] [LOCAL     ] PMO: Starting deletion of primary data.
[2025-10-24T20:38:22.984138] [DEBUG] [LOCAL     ] PMO: No primary data file found to delete.
[2025-10-24T20:38:22.984174] [INFO ] [LOCAL     ] PMO: Starting deletion of derivative data.
[2025-10-24T20:38:22.984318] [DEBUG] [LOCAL     ] PMO: Deleted derivative data file.
[2025-10-24T20:38:22.984389] [INFO ] [MAIN      ] Update Progress: 1699/2366 symbols completed. PMO took 23.9s. Estimated remaining: 1h 25m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:38:23.149024] [INFO ] [MAIN      ] PMTV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:38:23.149149] [DEBUG] [LOCAL     ] PMTV: No existing data file found in primary storage.
[2025-10-24T20:38:23.149184] [WARN ] [MAIN      ] PMTV: No existing data found, performing full refresh instead.
[2025-10-24T20:38:23.149285] [INFO ] [MAIN      ] PMTV: Wiping existing primary data before full refresh.
[2025-10-24T20:38:23.149325] [INFO ] [LOCAL     ] PMTV: Starting deletion of primary data.
[2025-10-24T20:38:23.149365] [DEBUG] [LOCAL     ] PMTV: No primary data file found to delete.
[2025-10-24T20:38:23.149395] [INFO ] [MAIN      ] PMTV: Starting full primary refresh.
[2025-10-24T20:38:23.352819] [INFO ] [REMOTE    ] PMTU: Fetching primary data for 2025-01.
[2025-10-24T20:38:23.497502] [INFO ] [REMOTE    ] PMTV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:38:23.922260] [INFO ] [REMOTE    ] PMTU: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T20:38:24.147674] [INFO ] [REMOTE    ] PMTV: Fetching primary data for 2025-01.
[2025-10-24T20:38:24.240927] [INFO ] [REMOTE    ] PMT: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T20:38:24.497922] [DEBUG] [REMOTE    ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:38:24.498165] [WARN ] [REMOTE    ] PMTV: No data returned for month 2025-01
[2025-10-24T20:38:24.498252] [FATAL] [REMOTE    ] PMTV: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:38:24.498318] [FATAL] [MAIN      ] PMTV: Failed to fetch primary data.
[2025-10-24T20:38:24.498394] [WARN ] [MAIN      ] PMTV: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:38:24.498460] [INFO ] [LOCAL     ] PMTV: Starting deletion of primary data.
[2025-10-24T20:38:24.498523] [DEBUG] [LOCAL     ] PMTV: No primary data file found to delete.
[2025-10-24T20:38:24.498566] [INFO ] [LOCAL     ] PMTV: Starting deletion of derivative data.
[2025-10-24T20:38:24.498614] [DEBUG] [LOCAL     ] PMTV: No derivative data file found to delete.
[2025-10-24T20:38:24.498706] [INFO ] [MAIN      ] Update Progress: 1700/2366 symbols completed. PMTV took 1.5s. Estimated remaining: 1h 25m 33s. Rate: 7.8 symbols/min
[2025-10-24T20:38:24.668923] [INFO ] [MAIN      ] PMTW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:38:24.669137] [DEBUG] [LOCAL     ] PMTW: No existing data file found in primary storage.
[2025-10-24T20:38:24.669189] [WARN ] [MAIN      ] PMTW: No existing data found, performing full refresh instead.
[2025-10-24T20:38:24.669304] [INFO ] [MAIN      ] PMTW: Wiping existing primary data before full refresh.
[2025-10-24T20:38:24.669345] [INFO ] [LOCAL     ] PMTW: Starting deletion of primary data.
[2025-10-24T20:38:24.669385] [DEBUG] [LOCAL     ] PMTW: No primary data file found to delete.
[2025-10-24T20:38:24.669417] [INFO ] [MAIN      ] PMTW: Starting full primary refresh.
[2025-10-24T20:38:24.952756] [INFO ] [REMOTE    ] PMTU: Fetching primary data for 2025-02.
[2025-10-24T20:38:25.027786] [INFO ] [REMOTE    ] PMTW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:38:25.563392] [INFO ] [REMOTE    ] PMTU: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T20:38:25.747699] [INFO ] [REMOTE    ] PMM: Fetching primary data for 2025-08.
[2025-10-24T20:38:26.547690] [INFO ] [REMOTE    ] PMTW: Fetching primary data for 2025-01.
[2025-10-24T20:38:26.590340] [INFO ] [REMOTE    ] PMM: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T20:38:26.940612] [DEBUG] [REMOTE    ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:38:26.941067] [WARN ] [REMOTE    ] PMTW: No data returned for month 2025-01
[2025-10-24T20:38:26.941161] [FATAL] [REMOTE    ] PMTW: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:38:26.941243] [FATAL] [MAIN      ] PMTW: Failed to fetch primary data.
[2025-10-24T20:38:26.941327] [WARN ] [MAIN      ] PMTW: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:38:26.941419] [INFO ] [LOCAL     ] PMTW: Starting deletion of primary data.
[2025-10-24T20:38:26.941497] [DEBUG] [LOCAL     ] PMTW: No primary data file found to delete.
[2025-10-24T20:38:26.941534] [INFO ] [LOCAL     ] PMTW: Starting deletion of derivative data.
[2025-10-24T20:38:26.941573] [DEBUG] [LOCAL     ] PMTW: No derivative data file found to delete.
[2025-10-24T20:38:26.941618] [INFO ] [MAIN      ] Update Progress: 1701/2366 symbols completed. PMTW took 2.4s. Estimated remaining: 1h 25m 23s. Rate: 7.8 symbols/min
[2025-10-24T20:38:27.107484] [INFO ] [MAIN      ] PNC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:38:27.158221] [DEBUG] [LOCAL     ] PNC: Loaded 52438 existing records from primary storage.
[2025-10-24T20:38:27.158525] [INFO ] [MAIN      ] PNC: Loaded 52438 existing records.
[2025-10-24T20:38:27.335390] [WARN ] [MAIN      ] PNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:38:27.335628] [INFO ] [MAIN      ] PNC: Wiping existing primary data before full refresh.
[2025-10-24T20:38:27.335708] [INFO ] [LOCAL     ] PNC: Starting deletion of primary data.
[2025-10-24T20:38:27.336186] [DEBUG] [LOCAL     ] PNC: Deleted primary data file.
[2025-10-24T20:38:27.336242] [INFO ] [MAIN      ] PNC: Starting full primary refresh.
[2025-10-24T20:38:27.356273] [INFO ] [REMOTE    ] PMTU: Fetching primary data for 2025-03.
[2025-10-24T20:38:27.686709] [INFO ] [REMOTE    ] PNC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:38:27.962232] [INFO ] [REMOTE    ] PMTU: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T20:38:28.147714] [INFO ] [REMOTE    ] PMM: Fetching primary data for 2025-09.
[2025-10-24T20:38:28.947707] [INFO ] [REMOTE    ] PMTU: Fetching primary data for 2025-04.
[2025-10-24T20:38:29.214614] [INFO ] [REMOTE    ] PMM: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T20:38:29.542599] [INFO ] [REMOTE    ] PMTU: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T20:38:29.747668] [INFO ] [REMOTE    ] PMM: Fetching primary data for 2025-10.
[2025-10-24T20:38:30.547673] [INFO ] [REMOTE    ] PMTU: Fetching primary data for 2025-05.
[2025-10-24T20:38:30.713050] [INFO ] [REMOTE    ] PMM: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T20:38:30.715962] [INFO ] [REMOTE    ] PMM: Full fetch complete (17395 records).
[2025-10-24T20:38:30.716041] [DEBUG] [VALIDATOR ] PMM: Validating primary data.
[2025-10-24T20:38:31.010313] [INFO ] [REMOTE    ] PMTU: Incremental fetch complete for 2025-05 (0.46 seconds).
[2025-10-24T20:38:31.094272] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present.
[2025-10-24T20:38:31.094382] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed.
[2025-10-24T20:38:31.095145] [INFO ] [MAIN      ] PMM: Fetched primary data is valid.
[2025-10-24T20:38:31.095209] [DEBUG] [LOCAL     ] PMM: Saving primary data.
[2025-10-24T20:38:31.095603] [FATAL] [LOCAL     ] PMM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:38:31.095744] [FATAL] [MAIN      ] PMM: Failed to save primary data.
[2025-10-24T20:38:31.095788] [WARN ] [MAIN      ] PMM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:38:31.095824] [INFO ] [LOCAL     ] PMM: Starting deletion of primary data.
[2025-10-24T20:38:31.095877] [DEBUG] [LOCAL     ] PMM: No primary data file found to delete.
[2025-10-24T20:38:31.095915] [INFO ] [LOCAL     ] PMM: Starting deletion of derivative data.
[2025-10-24T20:38:31.096095] [DEBUG] [LOCAL     ] PMM: Deleted derivative data file.
[2025-10-24T20:38:31.096188] [INFO ] [MAIN      ] Update Progress: 1702/2366 symbols completed. PMM took 35.2s. Estimated remaining: 1h 25m 14s. Rate: 7.8 symbols/min
[2025-10-24T20:38:31.266312] [INFO ] [MAIN      ] PNI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:38:31.277864] [DEBUG] [LOCAL     ] PNI: Loaded 6914 existing records from primary storage.
[2025-10-24T20:38:31.278158] [INFO ] [MAIN      ] PNI: Loaded 6914 existing records.
[2025-10-24T20:38:31.352854] [INFO ] [REMOTE    ] PMT: Fetching primary data for 2025-04.
[2025-10-24T20:38:31.464409] [WARN ] [MAIN      ] PNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:38:31.464757] [INFO ] [MAIN      ] PNI: Wiping existing primary data before full refresh.
[2025-10-24T20:38:31.464825] [INFO ] [LOCAL     ] PNI: Starting deletion of primary data.
[2025-10-24T20:38:31.465112] [DEBUG] [LOCAL     ] PNI: Deleted primary data file.
[2025-10-24T20:38:31.465180] [INFO ] [MAIN      ] PNI: Starting full primary refresh.
[2025-10-24T20:38:31.874970] [INFO ] [REMOTE    ] PNI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:38:32.147709] [INFO ] [REMOTE    ] PNI: Fetching primary data for 2025-01.
[2025-10-24T20:38:32.947701] [INFO ] [REMOTE    ] PMTU: Fetching primary data for 2025-06.
[2025-10-24T20:38:33.195223] [INFO ] [REMOTE    ] PNI: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T20:38:33.311865] [INFO ] [REMOTE    ] PMT: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T20:38:33.443516] [INFO ] [REMOTE    ] PMTU: Incremental fetch complete for 2025-06 (0.50 seconds).
[2025-10-24T20:38:33.747696] [INFO ] [REMOTE    ] PNC: Fetching primary data for 2025-01.
[2025-10-24T20:38:34.547756] [INFO ] [REMOTE    ] PMT: Fetching primary data for 2025-05.
[2025-10-24T20:38:35.347719] [INFO ] [REMOTE    ] PNI: Fetching primary data for 2025-02.
[2025-10-24T20:38:35.555881] [INFO ] [REMOTE    ] PNC: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T20:38:36.147718] [INFO ] [REMOTE    ] PMTU: Fetching primary data for 2025-07.
[2025-10-24T20:38:36.244116] [INFO ] [REMOTE    ] PNI: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T20:38:36.269940] [INFO ] [REMOTE    ] PMT: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T20:38:36.575373] [INFO ] [REMOTE    ] PMTU: Incremental fetch complete for 2025-07 (0.43 seconds).
[2025-10-24T20:38:36.947639] [INFO ] [REMOTE    ] PMTU: Fetching primary data for 2025-08.
[2025-10-24T20:38:37.261246] [INFO ] [REMOTE    ] PMTU: Incremental fetch complete for 2025-08 (0.31 seconds).
[2025-10-24T20:38:37.747676] [INFO ] [REMOTE    ] PNC: Fetching primary data for 2025-02.
[2025-10-24T20:38:38.547667] [INFO ] [REMOTE    ] PMT: Fetching primary data for 2025-06.
[2025-10-24T20:38:39.347635] [INFO ] [REMOTE    ] PMTU: Fetching primary data for 2025-09.
[2025-10-24T20:38:39.654783] [INFO ] [REMOTE    ] PNC: Incremental fetch complete for 2025-02 (1.91 seconds).
[2025-10-24T20:38:39.931355] [INFO ] [REMOTE    ] PMTU: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T20:38:40.071992] [INFO ] [REMOTE    ] PMT: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T20:38:40.147613] [INFO ] [REMOTE    ] PMT: Fetching primary data for 2025-07.
[2025-10-24T20:38:40.947668] [INFO ] [REMOTE    ] PMTU: Fetching primary data for 2025-10.
[2025-10-24T20:38:41.369865] [INFO ] [REMOTE    ] PMTU: Incremental fetch complete for 2025-10 (0.42 seconds).
[2025-10-24T20:38:41.370562] [INFO ] [REMOTE    ] PMTU: Full fetch complete (1186 records).
[2025-10-24T20:38:41.370628] [DEBUG] [VALIDATOR ] PMTU: Validating primary data.
[2025-10-24T20:38:41.551492] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days
[2025-10-24T20:38:41.551705] [FATAL] [MAIN      ] PMTU: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:38:41.551791] [WARN ] [MAIN      ] PMTU: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:38:41.551874] [INFO ] [LOCAL     ] PMTU: Starting deletion of primary data.
[2025-10-24T20:38:41.551949] [DEBUG] [LOCAL     ] PMTU: No primary data file found to delete.
[2025-10-24T20:38:41.551998] [INFO ] [LOCAL     ] PMTU: Starting deletion of derivative data.
[2025-10-24T20:38:41.552052] [DEBUG] [LOCAL     ] PMTU: No derivative data file found to delete.
[2025-10-24T20:38:41.552125] [INFO ] [MAIN      ] Update Progress: 1703/2366 symbols completed. PMTU took 21.5s. Estimated remaining: 1h 25m 7s. Rate: 7.8 symbols/min
[2025-10-24T20:38:41.728587] [INFO ] [MAIN      ] PNNT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:38:41.747627] [INFO ] [REMOTE    ] PNI: Fetching primary data for 2025-03.
[2025-10-24T20:38:41.761946] [DEBUG] [LOCAL     ] PNNT: Loaded 33582 existing records from primary storage.
[2025-10-24T20:38:41.762222] [INFO ] [MAIN      ] PNNT: Loaded 33582 existing records.
[2025-10-24T20:38:41.945681] [WARN ] [MAIN      ] PNNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:38:41.946008] [INFO ] [MAIN      ] PNNT: Wiping existing primary data before full refresh.
[2025-10-24T20:38:41.946110] [INFO ] [LOCAL     ] PNNT: Starting deletion of primary data.
[2025-10-24T20:38:41.946530] [DEBUG] [LOCAL     ] PNNT: Deleted primary data file.
[2025-10-24T20:38:41.946709] [INFO ] [MAIN      ] PNNT: Starting full primary refresh.
[2025-10-24T20:38:42.116112] [INFO ] [REMOTE    ] PMT: Incremental fetch complete for 2025-07 (1.97 seconds).
[2025-10-24T20:38:42.337866] [INFO ] [REMOTE    ] PNNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:38:42.487807] [INFO ] [REMOTE    ] PNI: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T20:38:42.547611] [INFO ] [REMOTE    ] PNNT: Fetching primary data for 2025-01.
[2025-10-24T20:38:43.347714] [INFO ] [REMOTE    ] PNC: Fetching primary data for 2025-03.
[2025-10-24T20:38:44.147628] [INFO ] [REMOTE    ] PMT: Fetching primary data for 2025-08.
[2025-10-24T20:38:44.181639] [INFO ] [REMOTE    ] PNNT: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T20:38:44.947670] [INFO ] [REMOTE    ] PNNT: Fetching primary data for 2025-02.
[2025-10-24T20:38:45.232078] [INFO ] [REMOTE    ] PNC: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T20:38:45.747610] [INFO ] [REMOTE    ] PNC: Fetching primary data for 2025-04.
[2025-10-24T20:38:45.787746] [INFO ] [REMOTE    ] PMT: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T20:38:46.020213] [INFO ] [REMOTE    ] PNNT: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T20:38:46.547632] [INFO ] [REMOTE    ] PMT: Fetching primary data for 2025-09.
[2025-10-24T20:38:47.347621] [INFO ] [REMOTE    ] PNI: Fetching primary data for 2025-04.
[2025-10-24T20:38:47.705090] [INFO ] [REMOTE    ] PNC: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T20:38:47.740218] [INFO ] [REMOTE    ] PMT: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T20:38:48.147697] [INFO ] [REMOTE    ] PNNT: Fetching primary data for 2025-03.
[2025-10-24T20:38:48.317428] [INFO ] [REMOTE    ] PNI: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T20:38:48.947680] [INFO ] [REMOTE    ] PNC: Fetching primary data for 2025-05.
[2025-10-24T20:38:49.637052] [INFO ] [REMOTE    ] PNNT: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T20:38:49.747710] [INFO ] [REMOTE    ] PMT: Fetching primary data for 2025-10.
[2025-10-24T20:38:50.547707] [INFO ] [REMOTE    ] PNI: Fetching primary data for 2025-05.
[2025-10-24T20:38:50.960579] [INFO ] [REMOTE    ] PNC: Incremental fetch complete for 2025-05 (2.01 seconds).
[2025-10-24T20:38:50.992963] [INFO ] [REMOTE    ] PNI: Incremental fetch complete for 2025-05 (0.45 seconds).
[2025-10-24T20:38:51.256524] [INFO ] [REMOTE    ] PMT: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T20:38:51.264858] [INFO ] [REMOTE    ] PMT: Full fetch complete (58819 records).
[2025-10-24T20:38:51.264959] [DEBUG] [VALIDATOR ] PMT: Validating primary data.
[2025-10-24T20:38:51.352862] [INFO ] [REMOTE    ] PNC: Fetching primary data for 2025-06.
[2025-10-24T20:38:51.643185] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present.
[2025-10-24T20:38:51.643257] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed.
[2025-10-24T20:38:51.644257] [INFO ] [MAIN      ] PMT: Fetched primary data is valid.
[2025-10-24T20:38:51.644320] [DEBUG] [LOCAL     ] PMT: Saving primary data.
[2025-10-24T20:38:51.644872] [FATAL] [LOCAL     ] PMT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:38:51.644955] [FATAL] [MAIN      ] PMT: Failed to save primary data.
[2025-10-24T20:38:51.645021] [WARN ] [MAIN      ] PMT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:38:51.645087] [INFO ] [LOCAL     ] PMT: Starting deletion of primary data.
[2025-10-24T20:38:51.645145] [DEBUG] [LOCAL     ] PMT: No primary data file found to delete.
[2025-10-24T20:38:51.645180] [INFO ] [LOCAL     ] PMT: Starting deletion of derivative data.
[2025-10-24T20:38:51.645413] [DEBUG] [LOCAL     ] PMT: Deleted derivative data file.
[2025-10-24T20:38:51.645507] [INFO ] [MAIN      ] Update Progress: 1704/2366 symbols completed. PMT took 37.0s. Estimated remaining: 1h 25m 0s. Rate: 7.8 symbols/min
[2025-10-24T20:38:51.811156] [INFO ] [MAIN      ] PNR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:38:51.854795] [DEBUG] [LOCAL     ] PNR: Loaded 47863 existing records from primary storage.
[2025-10-24T20:38:51.855078] [INFO ] [MAIN      ] PNR: Loaded 47863 existing records.
[2025-10-24T20:38:52.030883] [WARN ] [MAIN      ] PNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:38:52.031081] [INFO ] [MAIN      ] PNR: Wiping existing primary data before full refresh.
[2025-10-24T20:38:52.031126] [INFO ] [LOCAL     ] PNR: Starting deletion of primary data.
[2025-10-24T20:38:52.031545] [DEBUG] [LOCAL     ] PNR: Deleted primary data file.
[2025-10-24T20:38:52.031602] [INFO ] [MAIN      ] PNR: Starting full primary refresh.
[2025-10-24T20:38:52.152820] [INFO ] [REMOTE    ] PNNT: Fetching primary data for 2025-04.
[2025-10-24T20:38:52.382389] [INFO ] [REMOTE    ] PNR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:38:52.947624] [INFO ] [REMOTE    ] PNI: Fetching primary data for 2025-06.
[2025-10-24T20:38:53.163614] [INFO ] [REMOTE    ] PNC: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T20:38:53.706405] [INFO ] [REMOTE    ] PNI: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T20:38:53.747604] [INFO ] [REMOTE    ] PNI: Fetching primary data for 2025-07.
[2025-10-24T20:38:53.902385] [INFO ] [REMOTE    ] PNNT: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T20:38:54.546015] [INFO ] [REMOTE    ] PNI: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T20:38:54.547918] [INFO ] [REMOTE    ] PNR: Fetching primary data for 2025-01.
[2025-10-24T20:38:55.347703] [INFO ] [REMOTE    ] PNNT: Fetching primary data for 2025-05.
[2025-10-24T20:38:56.147719] [INFO ] [REMOTE    ] PNI: Fetching primary data for 2025-08.
[2025-10-24T20:38:56.285416] [INFO ] [REMOTE    ] PNR: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T20:38:56.477439] [INFO ] [REMOTE    ] PNNT: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T20:38:56.947703] [INFO ] [REMOTE    ] PNNT: Fetching primary data for 2025-06.
[2025-10-24T20:38:57.021311] [INFO ] [REMOTE    ] PNI: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T20:38:57.747637] [INFO ] [REMOTE    ] PNC: Fetching primary data for 2025-07.
[2025-10-24T20:38:58.232740] [INFO ] [REMOTE    ] PNNT: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T20:38:58.547696] [INFO ] [REMOTE    ] PNI: Fetching primary data for 2025-09.
[2025-10-24T20:38:59.347627] [INFO ] [REMOTE    ] PNR: Fetching primary data for 2025-02.
[2025-10-24T20:38:59.416048] [INFO ] [REMOTE    ] PNI: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T20:38:59.882469] [INFO ] [REMOTE    ] PNC: Incremental fetch complete for 2025-07 (2.13 seconds).
[2025-10-24T20:39:00.147755] [INFO ] [REMOTE    ] PNC: Fetching primary data for 2025-08.
[2025-10-24T20:39:00.947767] [INFO ] [REMOTE    ] PNI: Fetching primary data for 2025-10.
[2025-10-24T20:39:01.107669] [INFO ] [REMOTE    ] PNR: Incremental fetch complete for 2025-02 (1.76 seconds).
[2025-10-24T20:39:01.487549] [INFO ] [REMOTE    ] PNI: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T20:39:01.489705] [INFO ] [REMOTE    ] PNI: Full fetch complete (9619 records).
[2025-10-24T20:39:01.489833] [DEBUG] [VALIDATOR ] PNI: Validating primary data.
[2025-10-24T20:39:01.752985] [INFO ] [REMOTE    ] PNR: Fetching primary data for 2025-03.
[2025-10-24T20:39:01.902268] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present.
[2025-10-24T20:39:01.902417] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed.
[2025-10-24T20:39:01.902972] [INFO ] [MAIN      ] PNI: Fetched primary data is valid.
[2025-10-24T20:39:01.903060] [DEBUG] [LOCAL     ] PNI: Saving primary data.
[2025-10-24T20:39:01.903398] [FATAL] [LOCAL     ] PNI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:39:01.903668] [FATAL] [MAIN      ] PNI: Failed to save primary data.
[2025-10-24T20:39:01.903860] [WARN ] [MAIN      ] PNI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:39:01.903937] [INFO ] [LOCAL     ] PNI: Starting deletion of primary data.
[2025-10-24T20:39:01.904003] [DEBUG] [LOCAL     ] PNI: No primary data file found to delete.
[2025-10-24T20:39:01.904041] [INFO ] [LOCAL     ] PNI: Starting deletion of derivative data.
[2025-10-24T20:39:01.904291] [DEBUG] [LOCAL     ] PNI: Deleted derivative data file.
[2025-10-24T20:39:01.904425] [INFO ] [MAIN      ] Update Progress: 1705/2366 symbols completed. PNI took 30.8s. Estimated remaining: 1h 24m 54s. Rate: 7.8 symbols/min
[2025-10-24T20:39:02.083141] [INFO ] [MAIN      ] PNW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:39:02.115335] [INFO ] [REMOTE    ] PNC: Incremental fetch complete for 2025-08 (1.97 seconds).
[2025-10-24T20:39:02.178237] [DEBUG] [LOCAL     ] PNW: Loaded 45849 existing records from primary storage.
[2025-10-24T20:39:02.178934] [INFO ] [MAIN      ] PNW: Loaded 45849 existing records.
[2025-10-24T20:39:02.406060] [WARN ] [MAIN      ] PNW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:39:02.406310] [INFO ] [MAIN      ] PNW: Wiping existing primary data before full refresh.
[2025-10-24T20:39:02.406366] [INFO ] [LOCAL     ] PNW: Starting deletion of primary data.
[2025-10-24T20:39:02.406961] [DEBUG] [LOCAL     ] PNW: Deleted primary data file.
[2025-10-24T20:39:02.407018] [INFO ] [MAIN      ] PNW: Starting full primary refresh.
[2025-10-24T20:39:02.552914] [INFO ] [REMOTE    ] PNNT: Fetching primary data for 2025-07.
[2025-10-24T20:39:02.880224] [INFO ] [REMOTE    ] PNW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:39:03.347730] [INFO ] [REMOTE    ] PNC: Fetching primary data for 2025-09.
[2025-10-24T20:39:03.700269] [INFO ] [REMOTE    ] PNR: Incremental fetch complete for 2025-03 (1.95 seconds).
[2025-10-24T20:39:04.147685] [INFO ] [REMOTE    ] PNR: Fetching primary data for 2025-04.
[2025-10-24T20:39:04.248315] [INFO ] [REMOTE    ] PNNT: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T20:39:04.470836] [INFO ] [REMOTE    ] PNC: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T20:39:04.947670] [INFO ] [REMOTE    ] PNNT: Fetching primary data for 2025-08.
[2025-10-24T20:39:05.747679] [INFO ] [REMOTE    ] PNW: Fetching primary data for 2025-01.
[2025-10-24T20:39:05.897454] [INFO ] [REMOTE    ] PNR: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T20:39:06.485686] [INFO ] [REMOTE    ] PNNT: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T20:39:06.547637] [INFO ] [REMOTE    ] PNNT: Fetching primary data for 2025-09.
[2025-10-24T20:39:07.313387] [INFO ] [REMOTE    ] PNW: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T20:39:07.347689] [INFO ] [REMOTE    ] PNW: Fetching primary data for 2025-02.
[2025-10-24T20:39:07.608691] [INFO ] [REMOTE    ] PNNT: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T20:39:08.147681] [INFO ] [REMOTE    ] PNC: Fetching primary data for 2025-10.
[2025-10-24T20:39:08.692944] [INFO ] [REMOTE    ] PNW: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T20:39:08.947701] [INFO ] [REMOTE    ] PNW: Fetching primary data for 2025-03.
[2025-10-24T20:39:09.747625] [INFO ] [REMOTE    ] PNR: Fetching primary data for 2025-05.
[2025-10-24T20:39:10.110425] [INFO ] [REMOTE    ] PNC: Incremental fetch complete for 2025-10 (1.96 seconds).
[2025-10-24T20:39:10.121056] [INFO ] [REMOTE    ] PNC: Full fetch complete (75775 records).
[2025-10-24T20:39:10.121255] [DEBUG] [VALIDATOR ] PNC: Validating primary data.
[2025-10-24T20:39:10.565557] [INFO ] [REMOTE    ] PNNT: Fetching primary data for 2025-10.
[2025-10-24T20:39:10.566673] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present.
[2025-10-24T20:39:10.566751] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed.
[2025-10-24T20:39:10.568088] [INFO ] [MAIN      ] PNC: Fetched primary data is valid.
[2025-10-24T20:39:10.568289] [DEBUG] [LOCAL     ] PNC: Saving primary data.
[2025-10-24T20:39:10.569097] [FATAL] [LOCAL     ] PNC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:39:10.569185] [FATAL] [MAIN      ] PNC: Failed to save primary data.
[2025-10-24T20:39:10.569252] [WARN ] [MAIN      ] PNC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:39:10.569323] [INFO ] [LOCAL     ] PNC: Starting deletion of primary data.
[2025-10-24T20:39:10.569386] [DEBUG] [LOCAL     ] PNC: No primary data file found to delete.
[2025-10-24T20:39:10.569424] [INFO ] [LOCAL     ] PNC: Starting deletion of derivative data.
[2025-10-24T20:39:10.569601] [DEBUG] [LOCAL     ] PNC: Deleted derivative data file.
[2025-10-24T20:39:10.570221] [INFO ] [MAIN      ] Update Progress: 1706/2366 symbols completed. PNC took 43.6s. Estimated remaining: 1h 24m 46s. Rate: 7.8 symbols/min
[2025-10-24T20:39:10.767356] [INFO ] [MAIN      ] POR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:39:10.799080] [INFO ] [REMOTE    ] PNW: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T20:39:10.846355] [DEBUG] [LOCAL     ] POR: Loaded 47087 existing records from primary storage.
[2025-10-24T20:39:10.846698] [INFO ] [MAIN      ] POR: Loaded 47087 existing records.
[2025-10-24T20:39:11.046445] [WARN ] [MAIN      ] POR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:39:11.046764] [INFO ] [MAIN      ] POR: Wiping existing primary data before full refresh.
[2025-10-24T20:39:11.046825] [INFO ] [LOCAL     ] POR: Starting deletion of primary data.
[2025-10-24T20:39:11.047168] [DEBUG] [LOCAL     ] POR: Deleted primary data file.
[2025-10-24T20:39:11.047262] [INFO ] [MAIN      ] POR: Starting full primary refresh.
[2025-10-24T20:39:11.373057] [INFO ] [REMOTE    ] PNW: Fetching primary data for 2025-04.
[2025-10-24T20:39:11.420451] [INFO ] [REMOTE    ] PNR: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T20:39:11.486232] [INFO ] [REMOTE    ] POR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:39:11.581450] [INFO ] [REMOTE    ] PNNT: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T20:39:11.588463] [INFO ] [REMOTE    ] PNNT: Full fetch complete (47821 records).
[2025-10-24T20:39:11.588601] [DEBUG] [VALIDATOR ] PNNT: Validating primary data.
[2025-10-24T20:39:11.987926] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present.
[2025-10-24T20:39:11.988003] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed.
[2025-10-24T20:39:11.988918] [INFO ] [MAIN      ] PNNT: Fetched primary data is valid.
[2025-10-24T20:39:11.988979] [DEBUG] [LOCAL     ] PNNT: Saving primary data.
[2025-10-24T20:39:11.989455] [FATAL] [LOCAL     ] PNNT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:39:11.989539] [FATAL] [MAIN      ] PNNT: Failed to save primary data.
[2025-10-24T20:39:11.989580] [WARN ] [MAIN      ] PNNT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:39:11.989614] [INFO ] [LOCAL     ] PNNT: Starting deletion of primary data.
[2025-10-24T20:39:11.989694] [DEBUG] [LOCAL     ] PNNT: No primary data file found to delete.
[2025-10-24T20:39:11.989749] [INFO ] [LOCAL     ] PNNT: Starting deletion of derivative data.
[2025-10-24T20:39:11.989947] [DEBUG] [LOCAL     ] PNNT: Deleted derivative data file.
[2025-10-24T20:39:11.990369] [INFO ] [MAIN      ] Update Progress: 1707/2366 symbols completed. PNNT took 30.4s. Estimated remaining: 1h 24m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:39:12.159216] [INFO ] [REMOTE    ] POR: Fetching primary data for 2025-01.
[2025-10-24T20:39:12.162265] [INFO ] [MAIN      ] POST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:39:12.203129] [DEBUG] [LOCAL     ] POST: Loaded 38731 existing records from primary storage.
[2025-10-24T20:39:12.203424] [INFO ] [MAIN      ] POST: Loaded 38731 existing records.
[2025-10-24T20:39:12.379930] [WARN ] [MAIN      ] POST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:39:12.380130] [INFO ] [MAIN      ] POST: Wiping existing primary data before full refresh.
[2025-10-24T20:39:12.380177] [INFO ] [LOCAL     ] POST: Starting deletion of primary data.
[2025-10-24T20:39:12.380605] [DEBUG] [LOCAL     ] POST: Deleted primary data file.
[2025-10-24T20:39:12.380699] [INFO ] [MAIN      ] POST: Starting full primary refresh.
[2025-10-24T20:39:12.718287] [INFO ] [REMOTE    ] POST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:39:12.947624] [INFO ] [REMOTE    ] POST: Fetching primary data for 2025-01.
[2025-10-24T20:39:13.305720] [INFO ] [REMOTE    ] PNW: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T20:39:13.747718] [INFO ] [REMOTE    ] PNW: Fetching primary data for 2025-05.
[2025-10-24T20:39:13.916361] [INFO ] [REMOTE    ] POR: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T20:39:14.382231] [INFO ] [REMOTE    ] POST: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T20:39:14.547736] [INFO ] [REMOTE    ] POST: Fetching primary data for 2025-02.
[2025-10-24T20:39:15.347738] [INFO ] [REMOTE    ] PNR: Fetching primary data for 2025-06.
[2025-10-24T20:39:15.670077] [INFO ] [REMOTE    ] PNW: Incremental fetch complete for 2025-05 (1.92 seconds).
[2025-10-24T20:39:15.889906] [INFO ] [REMOTE    ] POST: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T20:39:16.147719] [INFO ] [REMOTE    ] PNW: Fetching primary data for 2025-06.
[2025-10-24T20:39:16.764939] [INFO ] [REMOTE    ] PNR: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T20:39:16.947718] [INFO ] [REMOTE    ] POST: Fetching primary data for 2025-03.
[2025-10-24T20:39:17.747704] [INFO ] [REMOTE    ] PNR: Fetching primary data for 2025-07.
[2025-10-24T20:39:17.837025] [INFO ] [REMOTE    ] PNW: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T20:39:18.348836] [INFO ] [REMOTE    ] POST: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T20:39:18.547633] [INFO ] [REMOTE    ] PNW: Fetching primary data for 2025-07.
[2025-10-24T20:39:19.188180] [INFO ] [REMOTE    ] PNR: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T20:39:19.347674] [INFO ] [REMOTE    ] PNR: Fetching primary data for 2025-08.
[2025-10-24T20:39:19.963435] [INFO ] [REMOTE    ] PNW: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T20:39:20.147606] [INFO ] [REMOTE    ] PNW: Fetching primary data for 2025-08.
[2025-10-24T20:39:20.947714] [INFO ] [REMOTE    ] POR: Fetching primary data for 2025-02.
[2025-10-24T20:39:21.043832] [INFO ] [REMOTE    ] PNR: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T20:39:21.747718] [INFO ] [REMOTE    ] PNR: Fetching primary data for 2025-09.
[2025-10-24T20:39:21.989750] [INFO ] [REMOTE    ] PNW: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T20:39:22.547638] [INFO ] [REMOTE    ] PNW: Fetching primary data for 2025-09.
[2025-10-24T20:39:22.581492] [INFO ] [REMOTE    ] POR: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T20:39:23.347732] [INFO ] [REMOTE    ] POR: Fetching primary data for 2025-03.
[2025-10-24T20:39:23.383555] [INFO ] [REMOTE    ] PNR: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T20:39:23.699918] [INFO ] [REMOTE    ] PNW: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T20:39:24.147722] [INFO ] [REMOTE    ] POST: Fetching primary data for 2025-04.
[2025-10-24T20:39:24.947678] [INFO ] [REMOTE    ] PNW: Fetching primary data for 2025-10.
[2025-10-24T20:39:25.212217] [INFO ] [REMOTE    ] POR: Incremental fetch complete for 2025-03 (1.86 seconds).
[2025-10-24T20:39:25.747664] [INFO ] [REMOTE    ] POR: Fetching primary data for 2025-04.
[2025-10-24T20:39:25.944114] [INFO ] [REMOTE    ] POST: Incremental fetch complete for 2025-04 (1.80 seconds).
[2025-10-24T20:39:26.547683] [INFO ] [REMOTE    ] PNR: Fetching primary data for 2025-10.
[2025-10-24T20:39:26.758298] [INFO ] [REMOTE    ] PNW: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T20:39:26.766315] [INFO ] [REMOTE    ] PNW: Full fetch complete (65986 records).
[2025-10-24T20:39:26.766446] [DEBUG] [VALIDATOR ] PNW: Validating primary data.
[2025-10-24T20:39:27.148745] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present.
[2025-10-24T20:39:27.148855] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed.
[2025-10-24T20:39:27.150023] [INFO ] [MAIN      ] PNW: Fetched primary data is valid.
[2025-10-24T20:39:27.150107] [DEBUG] [LOCAL     ] PNW: Saving primary data.
[2025-10-24T20:39:27.150731] [FATAL] [LOCAL     ] PNW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:39:27.150901] [FATAL] [MAIN      ] PNW: Failed to save primary data.
[2025-10-24T20:39:27.151030] [WARN ] [MAIN      ] PNW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:39:27.151105] [INFO ] [LOCAL     ] PNW: Starting deletion of primary data.
[2025-10-24T20:39:27.151198] [DEBUG] [LOCAL     ] PNW: No primary data file found to delete.
[2025-10-24T20:39:27.151327] [INFO ] [LOCAL     ] PNW: Starting deletion of derivative data.
[2025-10-24T20:39:27.151544] [DEBUG] [LOCAL     ] PNW: Deleted derivative data file.
[2025-10-24T20:39:27.152145] [INFO ] [MAIN      ] Update Progress: 1708/2366 symbols completed. PNW took 25.2s. Estimated remaining: 1h 24m 31s. Rate: 7.8 symbols/min
[2025-10-24T20:39:27.320627] [INFO ] [MAIN      ] PPG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:39:27.353875] [INFO ] [REMOTE    ] POST: Fetching primary data for 2025-05.
[2025-10-24T20:39:27.357262] [INFO ] [REMOTE    ] POR: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T20:39:27.413030] [DEBUG] [LOCAL     ] PPG: Loaded 50853 existing records from primary storage.
[2025-10-24T20:39:27.413376] [INFO ] [MAIN      ] PPG: Loaded 50853 existing records.
[2025-10-24T20:39:27.589423] [WARN ] [MAIN      ] PPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:39:27.589684] [INFO ] [MAIN      ] PPG: Wiping existing primary data before full refresh.
[2025-10-24T20:39:27.589747] [INFO ] [LOCAL     ] PPG: Starting deletion of primary data.
[2025-10-24T20:39:27.590103] [DEBUG] [LOCAL     ] PPG: Deleted primary data file.
[2025-10-24T20:39:27.590142] [INFO ] [MAIN      ] PPG: Starting full primary refresh.
[2025-10-24T20:39:27.936762] [INFO ] [REMOTE    ] PPG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:39:28.147680] [INFO ] [REMOTE    ] PPG: Fetching primary data for 2025-01.
[2025-10-24T20:39:28.353408] [INFO ] [REMOTE    ] PNR: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T20:39:28.362269] [INFO ] [REMOTE    ] PNR: Full fetch complete (69772 records).
[2025-10-24T20:39:28.362397] [DEBUG] [VALIDATOR ] PNR: Validating primary data.
[2025-10-24T20:39:28.742508] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present.
[2025-10-24T20:39:28.742589] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed.
[2025-10-24T20:39:28.743670] [INFO ] [MAIN      ] PNR: Fetched primary data is valid.
[2025-10-24T20:39:28.743731] [DEBUG] [LOCAL     ] PNR: Saving primary data.
[2025-10-24T20:39:28.744254] [FATAL] [LOCAL     ] PNR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:39:28.744342] [FATAL] [MAIN      ] PNR: Failed to save primary data.
[2025-10-24T20:39:28.744383] [WARN ] [MAIN      ] PNR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:39:28.744417] [INFO ] [LOCAL     ] PNR: Starting deletion of primary data.
[2025-10-24T20:39:28.744468] [DEBUG] [LOCAL     ] PNR: No primary data file found to delete.
[2025-10-24T20:39:28.744544] [INFO ] [LOCAL     ] PNR: Starting deletion of derivative data.
[2025-10-24T20:39:28.744743] [DEBUG] [LOCAL     ] PNR: Deleted derivative data file.
[2025-10-24T20:39:28.744836] [INFO ] [MAIN      ] Update Progress: 1709/2366 symbols completed. PNR took 37.1s. Estimated remaining: 1h 24m 21s. Rate: 7.8 symbols/min
[2025-10-24T20:39:28.918312] [INFO ] [MAIN      ] PPL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:39:28.948110] [INFO ] [REMOTE    ] POR: Fetching primary data for 2025-05.
[2025-10-24T20:39:28.949769] [INFO ] [REMOTE    ] POST: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T20:39:29.006877] [DEBUG] [LOCAL     ] PPL: Loaded 53894 existing records from primary storage.
[2025-10-24T20:39:29.007250] [INFO ] [MAIN      ] PPL: Loaded 53894 existing records.
[2025-10-24T20:39:29.208519] [WARN ] [MAIN      ] PPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:39:29.208748] [INFO ] [MAIN      ] PPL: Wiping existing primary data before full refresh.
[2025-10-24T20:39:29.208800] [INFO ] [LOCAL     ] PPL: Starting deletion of primary data.
[2025-10-24T20:39:29.209078] [DEBUG] [LOCAL     ] PPL: Deleted primary data file.
[2025-10-24T20:39:29.209133] [INFO ] [MAIN      ] PPL: Starting full primary refresh.
[2025-10-24T20:39:29.569902] [INFO ] [REMOTE    ] PPL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:39:29.641554] [INFO ] [REMOTE    ] PPG: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T20:39:29.747722] [INFO ] [REMOTE    ] PPL: Fetching primary data for 2025-01.
[2025-10-24T20:39:30.236415] [INFO ] [REMOTE    ] POR: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T20:39:30.547689] [INFO ] [REMOTE    ] POST: Fetching primary data for 2025-06.
[2025-10-24T20:39:31.347744] [INFO ] [REMOTE    ] PPG: Fetching primary data for 2025-02.
[2025-10-24T20:39:31.487438] [INFO ] [REMOTE    ] PPL: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T20:39:31.976396] [INFO ] [REMOTE    ] POST: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T20:39:32.147774] [INFO ] [REMOTE    ] POST: Fetching primary data for 2025-07.
[2025-10-24T20:39:32.947747] [INFO ] [REMOTE    ] POR: Fetching primary data for 2025-06.
[2025-10-24T20:39:33.190622] [INFO ] [REMOTE    ] PPG: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T20:39:33.747675] [INFO ] [REMOTE    ] PPG: Fetching primary data for 2025-03.
[2025-10-24T20:39:33.853711] [INFO ] [REMOTE    ] POST: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T20:39:34.547620] [INFO ] [REMOTE    ] PPL: Fetching primary data for 2025-02.
[2025-10-24T20:39:34.623388] [INFO ] [REMOTE    ] POR: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T20:39:35.347627] [INFO ] [REMOTE    ] POR: Fetching primary data for 2025-07.
[2025-10-24T20:39:35.789549] [INFO ] [REMOTE    ] PPG: Incremental fetch complete for 2025-03 (2.04 seconds).
[2025-10-24T20:39:36.147672] [INFO ] [REMOTE    ] POST: Fetching primary data for 2025-08.
[2025-10-24T20:39:36.391294] [INFO ] [REMOTE    ] PPL: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T20:39:36.947613] [INFO ] [REMOTE    ] PPL: Fetching primary data for 2025-03.
[2025-10-24T20:39:37.091291] [INFO ] [REMOTE    ] POR: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T20:39:37.702369] [INFO ] [REMOTE    ] POST: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T20:39:37.747669] [INFO ] [REMOTE    ] POST: Fetching primary data for 2025-09.
[2025-10-24T20:39:38.547611] [INFO ] [REMOTE    ] POR: Fetching primary data for 2025-08.
[2025-10-24T20:39:38.879321] [INFO ] [REMOTE    ] PPL: Incremental fetch complete for 2025-03 (1.93 seconds).
[2025-10-24T20:39:39.350323] [INFO ] [REMOTE    ] PPG: Fetching primary data for 2025-04.
[2025-10-24T20:39:39.353225] [INFO ] [REMOTE    ] POST: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T20:39:40.147613] [INFO ] [REMOTE    ] PPL: Fetching primary data for 2025-04.
[2025-10-24T20:39:40.185867] [INFO ] [REMOTE    ] POR: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T20:39:40.947690] [INFO ] [REMOTE    ] POR: Fetching primary data for 2025-09.
[2025-10-24T20:39:41.390759] [INFO ] [REMOTE    ] PPG: Incremental fetch complete for 2025-04 (2.04 seconds).
[2025-10-24T20:39:41.747719] [INFO ] [REMOTE    ] PPG: Fetching primary data for 2025-05.
[2025-10-24T20:39:42.094142] [INFO ] [REMOTE    ] PPL: Incremental fetch complete for 2025-04 (1.95 seconds).
[2025-10-24T20:39:42.547624] [INFO ] [REMOTE    ] PPL: Fetching primary data for 2025-05.
[2025-10-24T20:39:42.740228] [INFO ] [REMOTE    ] POR: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T20:39:43.347746] [INFO ] [REMOTE    ] POR: Fetching primary data for 2025-10.
[2025-10-24T20:39:43.552480] [INFO ] [REMOTE    ] PPG: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T20:39:44.147681] [INFO ] [REMOTE    ] POST: Fetching primary data for 2025-10.
[2025-10-24T20:39:44.313439] [INFO ] [REMOTE    ] PPL: Incremental fetch complete for 2025-05 (1.77 seconds).
[2025-10-24T20:39:44.623623] [INFO ] [REMOTE    ] POR: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T20:39:44.634354] [INFO ] [REMOTE    ] POR: Full fetch complete (68291 records).
[2025-10-24T20:39:44.634538] [DEBUG] [VALIDATOR ] POR: Validating primary data.
[2025-10-24T20:39:44.952943] [INFO ] [REMOTE    ] PPL: Fetching primary data for 2025-06.
[2025-10-24T20:39:45.095808] [DEBUG] [VALIDATOR ] POR: All expected trading days are present.
[2025-10-24T20:39:45.095890] [DEBUG] [VALIDATOR ] POR: Primary data validation passed.
[2025-10-24T20:39:45.096979] [INFO ] [MAIN      ] POR: Fetched primary data is valid.
[2025-10-24T20:39:45.097042] [DEBUG] [LOCAL     ] POR: Saving primary data.
[2025-10-24T20:39:45.097631] [FATAL] [LOCAL     ] POR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:39:45.097764] [FATAL] [MAIN      ] POR: Failed to save primary data.
[2025-10-24T20:39:45.097806] [WARN ] [MAIN      ] POR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:39:45.097842] [INFO ] [LOCAL     ] POR: Starting deletion of primary data.
[2025-10-24T20:39:45.097894] [DEBUG] [LOCAL     ] POR: No primary data file found to delete.
[2025-10-24T20:39:45.097929] [INFO ] [LOCAL     ] POR: Starting deletion of derivative data.
[2025-10-24T20:39:45.098105] [DEBUG] [LOCAL     ] POR: Deleted derivative data file.
[2025-10-24T20:39:45.098363] [INFO ] [MAIN      ] Update Progress: 1710/2366 symbols completed. POR took 34.5s. Estimated remaining: 1h 24m 17s. Rate: 7.8 symbols/min
[2025-10-24T20:39:45.266750] [INFO ] [MAIN      ] PPT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:39:45.286303] [DEBUG] [LOCAL     ] PPT: Loaded 19765 existing records from primary storage.
[2025-10-24T20:39:45.286545] [INFO ] [MAIN      ] PPT: Loaded 19765 existing records.
[2025-10-24T20:39:45.466789] [WARN ] [MAIN      ] PPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:39:45.467102] [INFO ] [MAIN      ] PPT: Wiping existing primary data before full refresh.
[2025-10-24T20:39:45.467172] [INFO ] [LOCAL     ] PPT: Starting deletion of primary data.
[2025-10-24T20:39:45.467545] [DEBUG] [LOCAL     ] PPT: Deleted primary data file.
[2025-10-24T20:39:45.467601] [INFO ] [MAIN      ] PPT: Starting full primary refresh.
[2025-10-24T20:39:45.772508] [INFO ] [REMOTE    ] POST: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T20:39:45.771363] [INFO ] [REMOTE    ] PPG: Fetching primary data for 2025-06.
[2025-10-24T20:39:45.784147] [INFO ] [REMOTE    ] POST: Full fetch complete (55481 records).
[2025-10-24T20:39:45.794892] [DEBUG] [VALIDATOR ] POST: Validating primary data.
[2025-10-24T20:39:45.946389] [INFO ] [REMOTE    ] PPT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:39:46.243714] [DEBUG] [VALIDATOR ] POST: All expected trading days are present.
[2025-10-24T20:39:46.243801] [DEBUG] [VALIDATOR ] POST: Primary data validation passed.
[2025-10-24T20:39:46.244793] [INFO ] [MAIN      ] POST: Fetched primary data is valid.
[2025-10-24T20:39:46.244853] [DEBUG] [LOCAL     ] POST: Saving primary data.
[2025-10-24T20:39:46.245302] [FATAL] [LOCAL     ] POST: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:39:46.245389] [FATAL] [MAIN      ] POST: Failed to save primary data.
[2025-10-24T20:39:46.245430] [WARN ] [MAIN      ] POST: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:39:46.245463] [INFO ] [LOCAL     ] POST: Starting deletion of primary data.
[2025-10-24T20:39:46.245512] [DEBUG] [LOCAL     ] POST: No primary data file found to delete.
[2025-10-24T20:39:46.245546] [INFO ] [LOCAL     ] POST: Starting deletion of derivative data.
[2025-10-24T20:39:46.245741] [DEBUG] [LOCAL     ] POST: Deleted derivative data file.
[2025-10-24T20:39:46.246156] [INFO ] [MAIN      ] Update Progress: 1711/2366 symbols completed. POST took 34.3s. Estimated remaining: 1h 24m 7s. Rate: 7.8 symbols/min
[2025-10-24T20:39:46.414492] [INFO ] [MAIN      ] PR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:39:46.469093] [DEBUG] [LOCAL     ] PR: Loaded 54001 existing records from primary storage.
[2025-10-24T20:39:46.469400] [INFO ] [MAIN      ] PR: Loaded 54001 existing records.
[2025-10-24T20:39:46.571525] [INFO ] [REMOTE    ] PPT: Fetching primary data for 2025-01.
[2025-10-24T20:39:46.656938] [WARN ] [MAIN      ] PR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:39:46.657218] [INFO ] [MAIN      ] PR: Wiping existing primary data before full refresh.
[2025-10-24T20:39:46.657279] [INFO ] [LOCAL     ] PR: Starting deletion of primary data.
[2025-10-24T20:39:46.658280] [DEBUG] [LOCAL     ] PR: Deleted primary data file.
[2025-10-24T20:39:46.658339] [INFO ] [MAIN      ] PR: Starting full primary refresh.
[2025-10-24T20:39:47.017140] [INFO ] [REMOTE    ] PR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:39:47.056059] [INFO ] [REMOTE    ] PPL: Incremental fetch complete for 2025-06 (2.10 seconds).
[2025-10-24T20:39:47.347750] [INFO ] [REMOTE    ] PPL: Fetching primary data for 2025-07.
[2025-10-24T20:39:47.577248] [INFO ] [REMOTE    ] PPG: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T20:39:47.885900] [INFO ] [REMOTE    ] PPT: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T20:39:48.147742] [INFO ] [REMOTE    ] PPT: Fetching primary data for 2025-02.
[2025-10-24T20:39:48.947670] [INFO ] [REMOTE    ] PR: Fetching primary data for 2025-01.
[2025-10-24T20:39:49.142788] [INFO ] [REMOTE    ] PPL: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T20:39:49.227912] [INFO ] [REMOTE    ] PPT: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T20:39:49.747720] [INFO ] [REMOTE    ] PPL: Fetching primary data for 2025-08.
[2025-10-24T20:39:50.547685] [INFO ] [REMOTE    ] PPG: Fetching primary data for 2025-07.
[2025-10-24T20:39:50.656729] [INFO ] [REMOTE    ] PR: Incremental fetch complete for 2025-01 (1.71 seconds).
[2025-10-24T20:39:51.347701] [INFO ] [REMOTE    ] PR: Fetching primary data for 2025-02.
[2025-10-24T20:39:51.517080] [INFO ] [REMOTE    ] PPL: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T20:39:52.147717] [INFO ] [REMOTE    ] PPL: Fetching primary data for 2025-09.
[2025-10-24T20:39:52.397558] [INFO ] [REMOTE    ] PPG: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T20:39:52.751251] [INFO ] [REMOTE    ] PR: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T20:39:52.947716] [INFO ] [REMOTE    ] PPG: Fetching primary data for 2025-08.
[2025-10-24T20:39:53.747723] [INFO ] [REMOTE    ] PR: Fetching primary data for 2025-03.
[2025-10-24T20:39:54.237925] [INFO ] [REMOTE    ] PPL: Incremental fetch complete for 2025-09 (2.09 seconds).
[2025-10-24T20:39:54.547717] [INFO ] [REMOTE    ] PPL: Fetching primary data for 2025-10.
[2025-10-24T20:39:54.695285] [INFO ] [REMOTE    ] PPG: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T20:39:55.152496] [INFO ] [REMOTE    ] PR: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T20:39:55.347722] [INFO ] [REMOTE    ] PR: Fetching primary data for 2025-04.
[2025-10-24T20:39:56.147722] [INFO ] [REMOTE    ] PPT: Fetching primary data for 2025-03.
[2025-10-24T20:39:56.311295] [INFO ] [REMOTE    ] PPL: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T20:39:56.323268] [INFO ] [REMOTE    ] PPL: Full fetch complete (77630 records).
[2025-10-24T20:39:56.323457] [DEBUG] [VALIDATOR ] PPL: Validating primary data.
[2025-10-24T20:39:56.725339] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present.
[2025-10-24T20:39:56.725422] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed.
[2025-10-24T20:39:56.726569] [INFO ] [MAIN      ] PPL: Fetched primary data is valid.
[2025-10-24T20:39:56.726631] [DEBUG] [LOCAL     ] PPL: Saving primary data.
[2025-10-24T20:39:56.727275] [FATAL] [LOCAL     ] PPL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:39:56.727386] [FATAL] [MAIN      ] PPL: Failed to save primary data.
[2025-10-24T20:39:56.727428] [WARN ] [MAIN      ] PPL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:39:56.727463] [INFO ] [LOCAL     ] PPL: Starting deletion of primary data.
[2025-10-24T20:39:56.727516] [DEBUG] [LOCAL     ] PPL: No primary data file found to delete.
[2025-10-24T20:39:56.727551] [INFO ] [LOCAL     ] PPL: Starting deletion of derivative data.
[2025-10-24T20:39:56.727737] [DEBUG] [LOCAL     ] PPL: Deleted derivative data file.
[2025-10-24T20:39:56.728309] [INFO ] [MAIN      ] Update Progress: 1712/2366 symbols completed. PPL took 28.0s. Estimated remaining: 1h 24m 0s. Rate: 7.8 symbols/min
[2025-10-24T20:39:56.914186] [INFO ] [MAIN      ] PRA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:39:56.949373] [INFO ] [REMOTE    ] PPG: Fetching primary data for 2025-09.
[2025-10-24T20:39:56.951285] [DEBUG] [LOCAL     ] PRA: Loaded 34625 existing records from primary storage.
[2025-10-24T20:39:56.951720] [INFO ] [MAIN      ] PRA: Loaded 34625 existing records.
[2025-10-24T20:39:57.140187] [WARN ] [MAIN      ] PRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:39:57.140408] [INFO ] [MAIN      ] PRA: Wiping existing primary data before full refresh.
[2025-10-24T20:39:57.140458] [INFO ] [LOCAL     ] PRA: Starting deletion of primary data.
[2025-10-24T20:39:57.140809] [DEBUG] [LOCAL     ] PRA: Deleted primary data file.
[2025-10-24T20:39:57.140864] [INFO ] [MAIN      ] PRA: Starting full primary refresh.
[2025-10-24T20:39:57.440970] [INFO ] [REMOTE    ] PPT: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T20:39:57.529464] [INFO ] [REMOTE    ] PRA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:39:57.560190] [INFO ] [REMOTE    ] PR: Incremental fetch complete for 2025-04 (2.21 seconds).
[2025-10-24T20:39:57.747680] [INFO ] [REMOTE    ] PR: Fetching primary data for 2025-05.
[2025-10-24T20:39:58.547622] [INFO ] [REMOTE    ] PRA: Fetching primary data for 2025-01.
[2025-10-24T20:39:58.865279] [INFO ] [REMOTE    ] PPG: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T20:39:59.347705] [INFO ] [REMOTE    ] PPG: Fetching primary data for 2025-10.
[2025-10-24T20:39:59.555104] [INFO ] [REMOTE    ] PR: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T20:39:59.800607] [INFO ] [REMOTE    ] PRA: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T20:40:00.147759] [INFO ] [REMOTE    ] PR: Fetching primary data for 2025-06.
[2025-10-24T20:40:00.947670] [INFO ] [REMOTE    ] PPT: Fetching primary data for 2025-04.
[2025-10-24T20:40:01.262407] [INFO ] [REMOTE    ] PPG: Incremental fetch complete for 2025-10 (1.91 seconds).
[2025-10-24T20:40:01.272536] [INFO ] [REMOTE    ] PPG: Full fetch complete (73878 records).
[2025-10-24T20:40:01.272742] [DEBUG] [VALIDATOR ] PPG: Validating primary data.
[2025-10-24T20:40:01.674674] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present.
[2025-10-24T20:40:01.674773] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed.
[2025-10-24T20:40:01.675921] [INFO ] [MAIN      ] PPG: Fetched primary data is valid.
[2025-10-24T20:40:01.675990] [DEBUG] [LOCAL     ] PPG: Saving primary data.
[2025-10-24T20:40:01.676683] [FATAL] [LOCAL     ] PPG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:40:01.676793] [FATAL] [MAIN      ] PPG: Failed to save primary data.
[2025-10-24T20:40:01.676835] [WARN ] [MAIN      ] PPG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:40:01.676870] [INFO ] [LOCAL     ] PPG: Starting deletion of primary data.
[2025-10-24T20:40:01.676924] [DEBUG] [LOCAL     ] PPG: No primary data file found to delete.
[2025-10-24T20:40:01.676979] [INFO ] [LOCAL     ] PPG: Starting deletion of derivative data.
[2025-10-24T20:40:01.677195] [DEBUG] [LOCAL     ] PPG: Deleted derivative data file.
[2025-10-24T20:40:01.677950] [INFO ] [MAIN      ] Update Progress: 1713/2366 symbols completed. PPG took 34.5s. Estimated remaining: 1h 23m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:40:01.756307] [INFO ] [REMOTE    ] PRA: Fetching primary data for 2025-02.
[2025-10-24T20:40:01.861263] [INFO ] [MAIN      ] PRCS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:40:01.866324] [DEBUG] [LOCAL     ] PRCS: Loaded 2802 existing records from primary storage.
[2025-10-24T20:40:01.866548] [INFO ] [MAIN      ] PRCS: Loaded 2802 existing records.
[2025-10-24T20:40:02.064086] [WARN ] [MAIN      ] PRCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:40:02.064517] [INFO ] [MAIN      ] PRCS: Wiping existing primary data before full refresh.
[2025-10-24T20:40:02.064604] [INFO ] [LOCAL     ] PRCS: Starting deletion of primary data.
[2025-10-24T20:40:02.077847] [DEBUG] [LOCAL     ] PRCS: Deleted primary data file.
[2025-10-24T20:40:02.079112] [INFO ] [REMOTE    ] PPT: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T20:40:02.079240] [INFO ] [MAIN      ] PRCS: Starting full primary refresh.
[2025-10-24T20:40:02.242697] [INFO ] [REMOTE    ] PR: Incremental fetch complete for 2025-06 (2.09 seconds).
[2025-10-24T20:40:02.517274] [INFO ] [REMOTE    ] PRCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:40:02.547726] [INFO ] [REMOTE    ] PPT: Fetching primary data for 2025-05.
[2025-10-24T20:40:02.627171] [INFO ] [REMOTE    ] PRA: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T20:40:03.347611] [INFO ] [REMOTE    ] PR: Fetching primary data for 2025-07.
[2025-10-24T20:40:03.733912] [INFO ] [REMOTE    ] PPT: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T20:40:04.147630] [INFO ] [REMOTE    ] PPT: Fetching primary data for 2025-06.
[2025-10-24T20:40:04.947616] [INFO ] [REMOTE    ] PRCS: Fetching primary data for 2025-01.
[2025-10-24T20:40:05.312694] [INFO ] [REMOTE    ] PR: Incremental fetch complete for 2025-07 (1.97 seconds).
[2025-10-24T20:40:05.365100] [INFO ] [REMOTE    ] PPT: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T20:40:05.504671] [INFO ] [REMOTE    ] PRCS: Incremental fetch complete for 2025-01 (0.56 seconds).
[2025-10-24T20:40:05.747718] [INFO ] [REMOTE    ] PRA: Fetching primary data for 2025-03.
[2025-10-24T20:40:06.547725] [INFO ] [REMOTE    ] PPT: Fetching primary data for 2025-07.
[2025-10-24T20:40:07.157050] [INFO ] [REMOTE    ] PRA: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T20:40:07.347605] [INFO ] [REMOTE    ] PRCS: Fetching primary data for 2025-02.
[2025-10-24T20:40:07.742853] [INFO ] [REMOTE    ] PPT: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T20:40:07.959452] [INFO ] [REMOTE    ] PRCS: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T20:40:08.147664] [INFO ] [REMOTE    ] PR: Fetching primary data for 2025-08.
[2025-10-24T20:40:08.947676] [INFO ] [REMOTE    ] PRA: Fetching primary data for 2025-04.
[2025-10-24T20:40:09.747708] [INFO ] [REMOTE    ] PRCS: Fetching primary data for 2025-03.
[2025-10-24T20:40:10.032154] [INFO ] [REMOTE    ] PR: Incremental fetch complete for 2025-08 (1.88 seconds).
[2025-10-24T20:40:10.302353] [INFO ] [REMOTE    ] PRCS: Incremental fetch complete for 2025-03 (0.55 seconds).
[2025-10-24T20:40:10.547697] [INFO ] [REMOTE    ] PR: Fetching primary data for 2025-09.
[2025-10-24T20:40:10.696964] [INFO ] [REMOTE    ] PRA: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T20:40:11.347759] [INFO ] [REMOTE    ] PRCS: Fetching primary data for 2025-04.
[2025-10-24T20:40:12.082148] [INFO ] [REMOTE    ] PRCS: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T20:40:12.147630] [INFO ] [REMOTE    ] PRCS: Fetching primary data for 2025-05.
[2025-10-24T20:40:12.628383] [INFO ] [REMOTE    ] PR: Incremental fetch complete for 2025-09 (2.08 seconds).
[2025-10-24T20:40:12.765934] [INFO ] [REMOTE    ] PRCS: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T20:40:12.947688] [INFO ] [REMOTE    ] PRCS: Fetching primary data for 2025-06.
[2025-10-24T20:40:13.523716] [INFO ] [REMOTE    ] PRCS: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T20:40:13.747721] [INFO ] [REMOTE    ] PPT: Fetching primary data for 2025-08.
[2025-10-24T20:40:14.547672] [INFO ] [REMOTE    ] PRCS: Fetching primary data for 2025-07.
[2025-10-24T20:40:14.884312] [INFO ] [REMOTE    ] PPT: Incremental fetch complete for 2025-08 (1.14 seconds).
[2025-10-24T20:40:14.993230] [INFO ] [REMOTE    ] PRCS: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T20:40:15.347722] [INFO ] [REMOTE    ] PPT: Fetching primary data for 2025-09.
[2025-10-24T20:40:16.147691] [INFO ] [REMOTE    ] PR: Fetching primary data for 2025-10.
[2025-10-24T20:40:16.947679] [INFO ] [REMOTE    ] PRA: Fetching primary data for 2025-05.
[2025-10-24T20:40:17.715630] [INFO ] [REMOTE    ] PPT: Incremental fetch complete for 2025-09 (2.37 seconds).
[2025-10-24T20:40:17.747685] [INFO ] [REMOTE    ] PPT: Fetching primary data for 2025-10.
[2025-10-24T20:40:18.547761] [INFO ] [REMOTE    ] PRCS: Fetching primary data for 2025-08.
[2025-10-24T20:40:19.382883] [INFO ] [REMOTE    ] PPT: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T20:40:19.386110] [INFO ] [REMOTE    ] PPT: Full fetch complete (28306 records).
[2025-10-24T20:40:19.386190] [DEBUG] [VALIDATOR ] PPT: Validating primary data.
[2025-10-24T20:40:19.596951] [INFO ] [REMOTE    ] PRCS: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T20:40:19.616309] [INFO ] [REMOTE    ] PRCS: Fetching primary data for 2025-09.
[2025-10-24T20:40:19.808212] [INFO ] [REMOTE    ] PR: Incremental fetch complete for 2025-10 (3.66 seconds).
[2025-10-24T20:40:19.831802] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present.
[2025-10-24T20:40:19.832073] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed.
[2025-10-24T20:40:19.832786] [INFO ] [MAIN      ] PPT: Fetched primary data is valid.
[2025-10-24T20:40:19.833001] [DEBUG] [LOCAL     ] PPT: Saving primary data.
[2025-10-24T20:40:19.833285] [INFO ] [REMOTE    ] PR: Full fetch complete (77762 records).
[2025-10-24T20:40:19.833874] [FATAL] [LOCAL     ] PPT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:40:19.833633] [DEBUG] [VALIDATOR ] PR: Validating primary data.
[2025-10-24T20:40:19.834086] [FATAL] [MAIN      ] PPT: Failed to save primary data.
[2025-10-24T20:40:19.834527] [WARN ] [MAIN      ] PPT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:40:19.835054] [INFO ] [LOCAL     ] PPT: Starting deletion of primary data.
[2025-10-24T20:40:19.876322] [DEBUG] [LOCAL     ] PPT: No primary data file found to delete.
[2025-10-24T20:40:19.879557] [INFO ] [LOCAL     ] PPT: Starting deletion of derivative data.
[2025-10-24T20:40:19.909564] [DEBUG] [LOCAL     ] PPT: Deleted derivative data file.
[2025-10-24T20:40:19.928145] [INFO ] [REMOTE    ] PRA: Incremental fetch complete for 2025-05 (2.98 seconds).
[2025-10-24T20:40:19.926401] [INFO ] [MAIN      ] Update Progress: 1714/2366 symbols completed. PPT took 34.8s. Estimated remaining: 1h 23m 48s. Rate: 7.8 symbols/min
[2025-10-24T20:40:20.159921] [INFO ] [REMOTE    ] PRA: Fetching primary data for 2025-06.
[2025-10-24T20:40:20.242883] [INFO ] [REMOTE    ] PRCS: Incremental fetch complete for 2025-09 (0.63 seconds).
[2025-10-24T20:40:20.280832] [INFO ] [MAIN      ] PRG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:40:20.467037] [DEBUG] [VALIDATOR ] PR: All expected trading days are present.
[2025-10-24T20:40:20.467109] [DEBUG] [VALIDATOR ] PR: Primary data validation passed.
[2025-10-24T20:40:20.468265] [INFO ] [MAIN      ] PR: Fetched primary data is valid.
[2025-10-24T20:40:20.468344] [DEBUG] [LOCAL     ] PR: Saving primary data.
[2025-10-24T20:40:20.478422] [FATAL] [LOCAL     ] PR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:40:20.478581] [FATAL] [MAIN      ] PR: Failed to save primary data.
[2025-10-24T20:40:20.479166] [DEBUG] [LOCAL     ] PRG: Loaded 29965 existing records from primary storage.
[2025-10-24T20:40:20.479578] [INFO ] [MAIN      ] PRG: Loaded 29965 existing records.
[2025-10-24T20:40:20.479444] [WARN ] [MAIN      ] PR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:40:20.479760] [INFO ] [LOCAL     ] PR: Starting deletion of primary data.
[2025-10-24T20:40:20.522037] [DEBUG] [LOCAL     ] PR: No primary data file found to delete.
[2025-10-24T20:40:20.542456] [INFO ] [LOCAL     ] PR: Starting deletion of derivative data.
[2025-10-24T20:40:20.553708] [DEBUG] [LOCAL     ] PR: Deleted derivative data file.
[2025-10-24T20:40:20.559321] [INFO ] [MAIN      ] Update Progress: 1715/2366 symbols completed. PR took 34.3s. Estimated remaining: 1h 23m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:40:20.795882] [WARN ] [MAIN      ] PRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:40:20.823015] [INFO ] [MAIN      ] PRG: Wiping existing primary data before full refresh.
[2025-10-24T20:40:20.823110] [INFO ] [LOCAL     ] PRG: Starting deletion of primary data.
[2025-10-24T20:40:20.851331] [DEBUG] [LOCAL     ] PRG: Deleted primary data file.
[2025-10-24T20:40:20.852256] [INFO ] [MAIN      ] PRG: Starting full primary refresh.
[2025-10-24T20:40:20.853773] [INFO ] [MAIN      ] PRGO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:40:20.952732] [INFO ] [REMOTE    ] PRCS: Fetching primary data for 2025-10.
[2025-10-24T20:40:21.233308] [INFO ] [REMOTE    ] PRG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:40:21.249469] [DEBUG] [LOCAL     ] PRGO: Loaded 47472 existing records from primary storage.
[2025-10-24T20:40:21.249872] [INFO ] [MAIN      ] PRGO: Loaded 47472 existing records.
[2025-10-24T20:40:21.452496] [WARN ] [MAIN      ] PRGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:40:21.452825] [INFO ] [MAIN      ] PRGO: Wiping existing primary data before full refresh.
[2025-10-24T20:40:21.452881] [INFO ] [LOCAL     ] PRGO: Starting deletion of primary data.
[2025-10-24T20:40:21.453539] [DEBUG] [LOCAL     ] PRGO: Deleted primary data file.
[2025-10-24T20:40:21.453601] [INFO ] [MAIN      ] PRGO: Starting full primary refresh.
[2025-10-24T20:40:21.650012] [INFO ] [REMOTE    ] PRCS: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T20:40:21.658329] [INFO ] [REMOTE    ] PRCS: Full fetch complete (3884 records).
[2025-10-24T20:40:21.656713] [INFO ] [REMOTE    ] PRA: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T20:40:21.692033] [DEBUG] [VALIDATOR ] PRCS: Validating primary data.
[2025-10-24T20:40:21.752073] [INFO ] [REMOTE    ] PRG: Fetching primary data for 2025-01.
[2025-10-24T20:40:22.111487] [INFO ] [REMOTE    ] PRGO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:40:22.248019] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present.
[2025-10-24T20:40:22.248102] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed.
[2025-10-24T20:40:22.248252] [INFO ] [MAIN      ] PRCS: Fetched primary data is valid.
[2025-10-24T20:40:22.248291] [DEBUG] [LOCAL     ] PRCS: Saving primary data.
[2025-10-24T20:40:22.248507] [FATAL] [LOCAL     ] PRCS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:40:22.248588] [FATAL] [MAIN      ] PRCS: Failed to save primary data.
[2025-10-24T20:40:22.248673] [WARN ] [MAIN      ] PRCS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:40:22.248728] [INFO ] [LOCAL     ] PRCS: Starting deletion of primary data.
[2025-10-24T20:40:22.248779] [DEBUG] [LOCAL     ] PRCS: No primary data file found to delete.
[2025-10-24T20:40:22.248815] [INFO ] [LOCAL     ] PRCS: Starting deletion of derivative data.
[2025-10-24T20:40:22.248988] [DEBUG] [LOCAL     ] PRCS: Deleted derivative data file.
[2025-10-24T20:40:22.249079] [INFO ] [MAIN      ] Update Progress: 1716/2366 symbols completed. PRCS took 20.6s. Estimated remaining: 1h 23m 27s. Rate: 7.8 symbols/min
[2025-10-24T20:40:22.414810] [INFO ] [MAIN      ] PRH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:40:22.422540] [DEBUG] [LOCAL     ] PRH: Loaded 4702 existing records from primary storage.
[2025-10-24T20:40:22.422806] [INFO ] [MAIN      ] PRH: Loaded 4702 existing records.
[2025-10-24T20:40:22.559336] [INFO ] [REMOTE    ] PRGO: Fetching primary data for 2025-01.
[2025-10-24T20:40:22.601463] [WARN ] [MAIN      ] PRH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:40:22.601780] [INFO ] [MAIN      ] PRH: Wiping existing primary data before full refresh.
[2025-10-24T20:40:22.601840] [INFO ] [LOCAL     ] PRH: Starting deletion of primary data.
[2025-10-24T20:40:22.601995] [DEBUG] [LOCAL     ] PRH: Deleted primary data file.
[2025-10-24T20:40:22.602036] [INFO ] [MAIN      ] PRH: Starting full primary refresh.
[2025-10-24T20:40:22.960067] [INFO ] [REMOTE    ] PRH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:40:23.038947] [INFO ] [REMOTE    ] PRG: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T20:40:23.347727] [INFO ] [REMOTE    ] PRH: Fetching primary data for 2025-01.
[2025-10-24T20:40:24.147635] [INFO ] [REMOTE    ] PRG: Fetching primary data for 2025-02.
[2025-10-24T20:40:24.242463] [INFO ] [REMOTE    ] PRGO: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T20:40:24.947710] [INFO ] [REMOTE    ] PRA: Fetching primary data for 2025-07.
[2025-10-24T20:40:25.357720] [INFO ] [REMOTE    ] PRH: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T20:40:25.747634] [INFO ] [REMOTE    ] PRH: Fetching primary data for 2025-02.
[2025-10-24T20:40:26.547638] [INFO ] [REMOTE    ] PRGO: Fetching primary data for 2025-02.
[2025-10-24T20:40:26.648378] [INFO ] [REMOTE    ] PRG: Incremental fetch complete for 2025-02 (2.50 seconds).
[2025-10-24T20:40:26.660861] [INFO ] [REMOTE    ] PRH: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T20:40:26.805817] [INFO ] [REMOTE    ] PRA: Incremental fetch complete for 2025-07 (1.86 seconds).
[2025-10-24T20:40:27.347698] [INFO ] [REMOTE    ] PRG: Fetching primary data for 2025-03.
[2025-10-24T20:40:28.015959] [INFO ] [REMOTE    ] PRGO: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T20:40:28.147690] [INFO ] [REMOTE    ] PRGO: Fetching primary data for 2025-03.
[2025-10-24T20:40:28.935099] [INFO ] [REMOTE    ] PRG: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T20:40:28.947614] [INFO ] [REMOTE    ] PRG: Fetching primary data for 2025-04.
[2025-10-24T20:40:29.747705] [INFO ] [REMOTE    ] PRA: Fetching primary data for 2025-08.
[2025-10-24T20:40:29.848545] [INFO ] [REMOTE    ] PRGO: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T20:40:30.524399] [INFO ] [REMOTE    ] PRG: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T20:40:30.547631] [INFO ] [REMOTE    ] PRG: Fetching primary data for 2025-05.
[2025-10-24T20:40:31.162192] [INFO ] [REMOTE    ] PRA: Incremental fetch complete for 2025-08 (1.41 seconds).
[2025-10-24T20:40:31.347714] [INFO ] [REMOTE    ] PRGO: Fetching primary data for 2025-04.
[2025-10-24T20:40:32.128166] [INFO ] [REMOTE    ] PRG: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T20:40:32.147630] [INFO ] [REMOTE    ] PRH: Fetching primary data for 2025-03.
[2025-10-24T20:40:32.848609] [INFO ] [REMOTE    ] PRH: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T20:40:32.947703] [INFO ] [REMOTE    ] PRH: Fetching primary data for 2025-04.
[2025-10-24T20:40:33.135274] [INFO ] [REMOTE    ] PRGO: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T20:40:33.747699] [INFO ] [REMOTE    ] PRA: Fetching primary data for 2025-09.
[2025-10-24T20:40:33.814380] [INFO ] [REMOTE    ] PRH: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T20:40:34.547714] [INFO ] [REMOTE    ] PRGO: Fetching primary data for 2025-05.
[2025-10-24T20:40:35.024762] [INFO ] [REMOTE    ] PRA: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T20:40:35.347689] [INFO ] [REMOTE    ] PRG: Fetching primary data for 2025-06.
[2025-10-24T20:40:36.091363] [INFO ] [REMOTE    ] PRGO: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T20:40:36.147614] [INFO ] [REMOTE    ] PRGO: Fetching primary data for 2025-06.
[2025-10-24T20:40:36.332626] [INFO ] [REMOTE    ] PRG: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T20:40:36.947640] [INFO ] [REMOTE    ] PRA: Fetching primary data for 2025-10.
[2025-10-24T20:40:37.419634] [INFO ] [REMOTE    ] PRGO: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T20:40:37.747723] [INFO ] [REMOTE    ] PRG: Fetching primary data for 2025-07.
[2025-10-24T20:40:38.352873] [INFO ] [REMOTE    ] PRA: Incremental fetch complete for 2025-10 (1.41 seconds).
[2025-10-24T20:40:38.359022] [INFO ] [REMOTE    ] PRA: Full fetch complete (45333 records).
[2025-10-24T20:40:38.359148] [DEBUG] [VALIDATOR ] PRA: Validating primary data.
[2025-10-24T20:40:38.553668] [INFO ] [REMOTE    ] PRH: Fetching primary data for 2025-05.
[2025-10-24T20:40:38.741047] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present.
[2025-10-24T20:40:38.741118] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed.
[2025-10-24T20:40:38.742007] [INFO ] [MAIN      ] PRA: Fetched primary data is valid.
[2025-10-24T20:40:38.742066] [DEBUG] [LOCAL     ] PRA: Saving primary data.
[2025-10-24T20:40:38.742455] [FATAL] [LOCAL     ] PRA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:40:38.742533] [FATAL] [MAIN      ] PRA: Failed to save primary data.
[2025-10-24T20:40:38.742574] [WARN ] [MAIN      ] PRA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:40:38.742608] [INFO ] [LOCAL     ] PRA: Starting deletion of primary data.
[2025-10-24T20:40:38.742715] [DEBUG] [LOCAL     ] PRA: No primary data file found to delete.
[2025-10-24T20:40:38.742783] [INFO ] [LOCAL     ] PRA: Starting deletion of derivative data.
[2025-10-24T20:40:38.742989] [DEBUG] [LOCAL     ] PRA: Deleted derivative data file.
[2025-10-24T20:40:38.743122] [INFO ] [MAIN      ] Update Progress: 1717/2366 symbols completed. PRA took 42.0s. Estimated remaining: 1h 23m 23s. Rate: 7.8 symbols/min
[2025-10-24T20:40:39.120210] [INFO ] [REMOTE    ] PRG: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T20:40:39.347714] [INFO ] [REMOTE    ] PRG: Fetching primary data for 2025-08.
[2025-10-24T20:40:39.385471] [INFO ] [REMOTE    ] PRH: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T20:40:40.147749] [INFO ] [REMOTE    ] PRH: Fetching primary data for 2025-06.
[2025-10-24T20:40:40.663938] [INFO ] [REMOTE    ] PRG: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T20:40:40.845986] [INFO ] [REMOTE    ] PRH: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T20:40:40.947727] [INFO ] [REMOTE    ] PRH: Fetching primary data for 2025-07.
[2025-10-24T20:40:41.570877] [INFO ] [REMOTE    ] PRH: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T20:40:41.747622] [INFO ] [REMOTE    ] PRGO: Fetching primary data for 2025-07.
[2025-10-24T20:40:42.547672] [INFO ] [REMOTE    ] PRH: Fetching primary data for 2025-08.
[2025-10-24T20:40:42.915261] [INFO ] [REMOTE    ] PRH: Incremental fetch complete for 2025-08 (0.37 seconds).
[2025-10-24T20:40:43.292821] [INFO ] [REMOTE    ] PRGO: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T20:40:43.347680] [INFO ] [REMOTE    ] PRGO: Fetching primary data for 2025-08.
[2025-10-24T20:40:44.147685] [INFO ] [REMOTE    ] PRH: Fetching primary data for 2025-09.
[2025-10-24T20:40:44.847786] [INFO ] [REMOTE    ] PRH: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T20:40:44.947696] [INFO ] [REMOTE    ] PRH: Fetching primary data for 2025-10.
[2025-10-24T20:40:45.010229] [INFO ] [REMOTE    ] PRGO: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T20:40:45.583179] [INFO ] [REMOTE    ] PRH: Incremental fetch complete for 2025-10 (0.64 seconds).
[2025-10-24T20:40:45.584434] [INFO ] [REMOTE    ] PRH: Full fetch complete (7392 records).
[2025-10-24T20:40:45.584503] [DEBUG] [VALIDATOR ] PRH: Validating primary data.
[2025-10-24T20:40:45.584916] [FATAL] [VALIDATOR ] PRH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:40:45.584999] [FATAL] [MAIN      ] PRH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:40:45.585042] [WARN ] [MAIN      ] PRH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:40:45.585080] [INFO ] [LOCAL     ] PRH: Starting deletion of primary data.
[2025-10-24T20:40:45.585134] [DEBUG] [LOCAL     ] PRH: No primary data file found to delete.
[2025-10-24T20:40:45.585168] [INFO ] [LOCAL     ] PRH: Starting deletion of derivative data.
[2025-10-24T20:40:45.585327] [DEBUG] [LOCAL     ] PRH: Deleted derivative data file.
[2025-10-24T20:40:45.585412] [INFO ] [MAIN      ] Update Progress: 1718/2366 symbols completed. PRH took 23.3s. Estimated remaining: 1h 23m 15s. Rate: 7.8 symbols/min
[2025-10-24T20:40:45.747695] [INFO ] [REMOTE    ] PRGO: Fetching primary data for 2025-09.
[2025-10-24T20:40:46.547741] [INFO ] [REMOTE    ] PRG: Fetching primary data for 2025-09.
[2025-10-24T20:40:47.503958] [INFO ] [REMOTE    ] PRGO: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T20:40:47.518174] [INFO ] [REMOTE    ] PRGO: Fetching primary data for 2025-10.
[2025-10-24T20:40:47.644873] [INFO ] [REMOTE    ] PRG: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T20:40:48.147727] [INFO ] [REMOTE    ] PRG: Fetching primary data for 2025-10.
[2025-10-24T20:40:49.256293] [INFO ] [REMOTE    ] PRGO: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T20:40:49.265426] [INFO ] [REMOTE    ] PRGO: Full fetch complete (68855 records).
[2025-10-24T20:40:49.265542] [DEBUG] [VALIDATOR ] PRGO: Validating primary data.
[2025-10-24T20:40:49.602007] [INFO ] [REMOTE    ] PRG: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T20:40:49.621130] [INFO ] [REMOTE    ] PRG: Full fetch complete (44607 records).
[2025-10-24T20:40:49.631862] [DEBUG] [VALIDATOR ] PRG: Validating primary data.
[2025-10-24T20:40:49.824847] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present.
[2025-10-24T20:40:49.824978] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed.
[2025-10-24T20:40:49.826183] [INFO ] [MAIN      ] PRGO: Fetched primary data is valid.
[2025-10-24T20:40:49.826289] [DEBUG] [LOCAL     ] PRGO: Saving primary data.
[2025-10-24T20:40:49.826891] [FATAL] [LOCAL     ] PRGO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:40:49.837538] [FATAL] [MAIN      ] PRGO: Failed to save primary data.
[2025-10-24T20:40:49.842736] [WARN ] [MAIN      ] PRGO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:40:49.847952] [INFO ] [LOCAL     ] PRGO: Starting deletion of primary data.
[2025-10-24T20:40:49.867414] [DEBUG] [LOCAL     ] PRGO: No primary data file found to delete.
[2025-10-24T20:40:49.872613] [INFO ] [LOCAL     ] PRGO: Starting deletion of derivative data.
[2025-10-24T20:40:49.888553] [DEBUG] [LOCAL     ] PRGO: Deleted derivative data file.
[2025-10-24T20:40:49.910178] [INFO ] [MAIN      ] Update Progress: 1719/2366 symbols completed. PRGO took 29.3s. Estimated remaining: 1h 23m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:40:50.119543] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present.
[2025-10-24T20:40:50.119613] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed.
[2025-10-24T20:40:50.120689] [INFO ] [MAIN      ] PRG: Fetched primary data is valid.
[2025-10-24T20:40:50.120784] [DEBUG] [LOCAL     ] PRG: Saving primary data.
[2025-10-24T20:40:50.121202] [FATAL] [LOCAL     ] PRG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:40:50.121282] [FATAL] [MAIN      ] PRG: Failed to save primary data.
[2025-10-24T20:40:50.121351] [WARN ] [MAIN      ] PRG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:40:50.121421] [INFO ] [LOCAL     ] PRG: Starting deletion of primary data.
[2025-10-24T20:40:50.121481] [DEBUG] [LOCAL     ] PRG: No primary data file found to delete.
[2025-10-24T20:40:50.121519] [INFO ] [LOCAL     ] PRG: Starting deletion of derivative data.
[2025-10-24T20:40:50.121712] [DEBUG] [LOCAL     ] PRG: Deleted derivative data file.
[2025-10-24T20:40:50.121808] [INFO ] [MAIN      ] Update Progress: 1720/2366 symbols completed. PRG took 30.2s. Estimated remaining: 1h 22m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:40:50.815173] [INFO ] [MAIN      ] PRIM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:40:50.766857] [INFO ] [MAIN      ] PRKS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:40:50.849770] [INFO ] [MAIN      ] PRLB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:40:50.872093] [INFO ] [MAIN      ] PRI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:40:50.907676] [DEBUG] [LOCAL     ] PRI: Loaded 17835 existing records from primary storage.
[2025-10-24T20:40:50.908436] [DEBUG] [LOCAL     ] PRLB: Loaded 20478 existing records from primary storage.
[2025-10-24T20:40:50.908781] [INFO ] [MAIN      ] PRI: Loaded 17835 existing records.
[2025-10-24T20:40:50.938478] [INFO ] [MAIN      ] PRLB: Loaded 20478 existing records.
[2025-10-24T20:40:51.163591] [DEBUG] [LOCAL     ] PRKS: Loaded 42500 existing records from primary storage.
[2025-10-24T20:40:51.169522] [DEBUG] [LOCAL     ] PRIM: Loaded 44369 existing records from primary storage.
[2025-10-24T20:40:51.185513] [INFO ] [MAIN      ] PRKS: Loaded 42500 existing records.
[2025-10-24T20:40:51.258217] [INFO ] [MAIN      ] PRIM: Loaded 44369 existing records.
[2025-10-24T20:40:51.441555] [WARN ] [MAIN      ] PRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:40:51.501525] [INFO ] [MAIN      ] PRI: Wiping existing primary data before full refresh.
[2025-10-24T20:40:51.542693] [INFO ] [LOCAL     ] PRI: Starting deletion of primary data.
[2025-10-24T20:40:51.546703] [WARN ] [MAIN      ] PRLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:40:51.573450] [DEBUG] [LOCAL     ] PRI: Deleted primary data file.
[2025-10-24T20:40:51.562997] [INFO ] [MAIN      ] PRLB: Wiping existing primary data before full refresh.
[2025-10-24T20:40:51.597832] [INFO ] [MAIN      ] PRI: Starting full primary refresh.
[2025-10-24T20:40:51.597996] [INFO ] [LOCAL     ] PRLB: Starting deletion of primary data.
[2025-10-24T20:40:51.692339] [DEBUG] [LOCAL     ] PRLB: Deleted primary data file.
[2025-10-24T20:40:51.776604] [INFO ] [MAIN      ] PRLB: Starting full primary refresh.
[2025-10-24T20:40:51.752577] [WARN ] [MAIN      ] PRKS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:40:51.892990] [INFO ] [MAIN      ] PRKS: Wiping existing primary data before full refresh.
[2025-10-24T20:40:51.911933] [WARN ] [MAIN      ] PRIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:40:51.923151] [INFO ] [MAIN      ] PRIM: Wiping existing primary data before full refresh.
[2025-10-24T20:40:51.923267] [INFO ] [LOCAL     ] PRIM: Starting deletion of primary data.
[2025-10-24T20:40:51.938146] [INFO ] [LOCAL     ] PRKS: Starting deletion of primary data.
[2025-10-24T20:40:51.957439] [DEBUG] [LOCAL     ] PRIM: Deleted primary data file.
[2025-10-24T20:40:51.967858] [DEBUG] [LOCAL     ] PRKS: Deleted primary data file.
[2025-10-24T20:40:51.983393] [INFO ] [MAIN      ] PRIM: Starting full primary refresh.
[2025-10-24T20:40:51.988634] [INFO ] [MAIN      ] PRKS: Starting full primary refresh.
[2025-10-24T20:40:53.056142] [INFO ] [REMOTE    ] PRLB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:40:53.116420] [INFO ] [REMOTE    ] PRLB: Fetching primary data for 2025-01.
[2025-10-24T20:40:53.066571] [INFO ] [REMOTE    ] PRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:40:53.134335] [INFO ] [REMOTE    ] PRI: Fetching primary data for 2025-01.
[2025-10-24T20:40:53.292176] [INFO ] [REMOTE    ] PRKS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:40:53.305599] [INFO ] [REMOTE    ] PRKS: Fetching primary data for 2025-01.
[2025-10-24T20:40:53.332798] [INFO ] [REMOTE    ] PRIM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:40:53.333183] [INFO ] [REMOTE    ] PRIM: Fetching primary data for 2025-01.
[2025-10-24T20:40:53.783968] [INFO ] [REMOTE    ] PRLB: Incremental fetch complete for 2025-01 (0.67 seconds).
[2025-10-24T20:40:53.788839] [INFO ] [REMOTE    ] PRLB: Fetching primary data for 2025-02.
[2025-10-24T20:40:54.455923] [INFO ] [REMOTE    ] PRI: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T20:40:54.459749] [INFO ] [REMOTE    ] PRI: Fetching primary data for 2025-02.
[2025-10-24T20:40:54.575170] [INFO ] [REMOTE    ] PRKS: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T20:40:54.584140] [INFO ] [REMOTE    ] PRKS: Fetching primary data for 2025-02.
[2025-10-24T20:40:54.660311] [INFO ] [REMOTE    ] PRIM: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T20:40:54.669164] [INFO ] [REMOTE    ] PRIM: Fetching primary data for 2025-02.
[2025-10-24T20:40:54.684363] [INFO ] [REMOTE    ] PRLB: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T20:40:55.347711] [INFO ] [REMOTE    ] PRLB: Fetching primary data for 2025-03.
[2025-10-24T20:40:55.576745] [INFO ] [REMOTE    ] PRI: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T20:40:55.970789] [INFO ] [REMOTE    ] PRKS: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T20:40:56.147629] [INFO ] [REMOTE    ] PRKS: Fetching primary data for 2025-03.
[2025-10-24T20:40:56.197754] [INFO ] [REMOTE    ] PRLB: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T20:40:56.368257] [INFO ] [REMOTE    ] PRIM: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T20:40:56.878297] [INFO ] [REMOTE    ] PRKS: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T20:40:56.947623] [INFO ] [REMOTE    ] PRKS: Fetching primary data for 2025-04.
[2025-10-24T20:40:57.686140] [INFO ] [REMOTE    ] PRKS: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T20:40:57.747625] [INFO ] [REMOTE    ] PRLB: Fetching primary data for 2025-04.
[2025-10-24T20:40:58.343251] [INFO ] [REMOTE    ] PRLB: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T20:40:58.547623] [INFO ] [REMOTE    ] PRLB: Fetching primary data for 2025-05.
[2025-10-24T20:40:59.347619] [INFO ] [REMOTE    ] PRKS: Fetching primary data for 2025-05.
[2025-10-24T20:40:59.410446] [INFO ] [REMOTE    ] PRLB: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T20:41:00.062241] [INFO ] [REMOTE    ] PRKS: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T20:41:00.147627] [INFO ] [REMOTE    ] PRLB: Fetching primary data for 2025-06.
[2025-10-24T20:41:00.947617] [INFO ] [REMOTE    ] PRI: Fetching primary data for 2025-03.
[2025-10-24T20:41:01.267560] [INFO ] [REMOTE    ] PRLB: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T20:41:01.747701] [INFO ] [REMOTE    ] PRIM: Fetching primary data for 2025-03.
[2025-10-24T20:41:02.208195] [INFO ] [REMOTE    ] PRI: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T20:41:02.547737] [INFO ] [REMOTE    ] PRKS: Fetching primary data for 2025-06.
[2025-10-24T20:41:03.238342] [INFO ] [REMOTE    ] PRKS: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T20:41:03.344120] [INFO ] [REMOTE    ] PRIM: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T20:41:03.347672] [INFO ] [REMOTE    ] PRKS: Fetching primary data for 2025-07.
[2025-10-24T20:41:04.147694] [INFO ] [REMOTE    ] PRI: Fetching primary data for 2025-04.
[2025-10-24T20:41:04.912792] [INFO ] [REMOTE    ] PRKS: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T20:41:04.947610] [INFO ] [REMOTE    ] PRKS: Fetching primary data for 2025-08.
[2025-10-24T20:41:05.223414] [INFO ] [REMOTE    ] PRI: Incremental fetch complete for 2025-04 (1.08 seconds).
[2025-10-24T20:41:05.449594] [INFO ] [REMOTE    ] PRKS: Incremental fetch complete for 2025-08 (0.50 seconds).
[2025-10-24T20:41:05.747706] [INFO ] [REMOTE    ] PRI: Fetching primary data for 2025-05.
[2025-10-24T20:41:06.547707] [INFO ] [REMOTE    ] PRKS: Fetching primary data for 2025-09.
[2025-10-24T20:41:06.640725] [INFO ] [REMOTE    ] PRI: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T20:41:07.043539] [INFO ] [REMOTE    ] PRKS: Incremental fetch complete for 2025-09 (0.50 seconds).
[2025-10-24T20:41:07.347639] [INFO ] [REMOTE    ] PRKS: Fetching primary data for 2025-10.
[2025-10-24T20:41:08.147633] [INFO ] [REMOTE    ] PRLB: Fetching primary data for 2025-07.
[2025-10-24T20:41:08.297068] [INFO ] [REMOTE    ] PRKS: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T20:41:08.305470] [INFO ] [REMOTE    ] PRKS: Full fetch complete (61220 records).
[2025-10-24T20:41:08.305702] [DEBUG] [VALIDATOR ] PRKS: Validating primary data.
[2025-10-24T20:41:08.307090] [FATAL] [VALIDATOR ] PRKS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:41:08.307174] [FATAL] [MAIN      ] PRKS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:41:08.307216] [WARN ] [MAIN      ] PRKS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:41:08.307256] [INFO ] [LOCAL     ] PRKS: Starting deletion of primary data.
[2025-10-24T20:41:08.307341] [DEBUG] [LOCAL     ] PRKS: No primary data file found to delete.
[2025-10-24T20:41:08.307400] [INFO ] [LOCAL     ] PRKS: Starting deletion of derivative data.
[2025-10-24T20:41:08.307566] [DEBUG] [LOCAL     ] PRKS: Deleted derivative data file.
[2025-10-24T20:41:08.307998] [INFO ] [MAIN      ] Update Progress: 1721/2366 symbols completed. PRKS took 18.1s. Estimated remaining: 1h 22m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:41:08.475705] [INFO ] [MAIN      ] PRM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:41:08.517951] [DEBUG] [LOCAL     ] PRM: Loaded 44667 existing records from primary storage.
[2025-10-24T20:41:08.518254] [INFO ] [MAIN      ] PRM: Loaded 44667 existing records.
[2025-10-24T20:41:08.711913] [WARN ] [MAIN      ] PRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:41:08.712220] [INFO ] [MAIN      ] PRM: Wiping existing primary data before full refresh.
[2025-10-24T20:41:08.712430] [INFO ] [LOCAL     ] PRM: Starting deletion of primary data.
[2025-10-24T20:41:08.712928] [DEBUG] [LOCAL     ] PRM: Deleted primary data file.
[2025-10-24T20:41:08.712987] [INFO ] [MAIN      ] PRM: Starting full primary refresh.
[2025-10-24T20:41:08.833375] [INFO ] [REMOTE    ] PRLB: Incremental fetch complete for 2025-07 (0.69 seconds).
[2025-10-24T20:41:08.952905] [INFO ] [REMOTE    ] PRI: Fetching primary data for 2025-06.
[2025-10-24T20:41:09.089274] [INFO ] [REMOTE    ] PRM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:41:09.579482] [INFO ] [REMOTE    ] PRI: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T20:41:09.747689] [INFO ] [REMOTE    ] PRLB: Fetching primary data for 2025-08.
[2025-10-24T20:41:10.547636] [INFO ] [REMOTE    ] PRM: Fetching primary data for 2025-01.
[2025-10-24T20:41:10.929604] [INFO ] [REMOTE    ] PRLB: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T20:41:11.257518] [INFO ] [REMOTE    ] PRM: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T20:41:11.347716] [INFO ] [REMOTE    ] PRLB: Fetching primary data for 2025-09.
[2025-10-24T20:41:12.134616] [INFO ] [REMOTE    ] PRLB: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T20:41:12.147611] [INFO ] [REMOTE    ] PRLB: Fetching primary data for 2025-10.
[2025-10-24T20:41:12.947694] [INFO ] [REMOTE    ] PRM: Fetching primary data for 2025-02.
[2025-10-24T20:41:13.051389] [INFO ] [REMOTE    ] PRLB: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T20:41:13.055096] [INFO ] [REMOTE    ] PRLB: Full fetch complete (30375 records).
[2025-10-24T20:41:13.055177] [DEBUG] [VALIDATOR ] PRLB: Validating primary data.
[2025-10-24T20:41:13.055614] [FATAL] [VALIDATOR ] PRLB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:41:13.055728] [FATAL] [MAIN      ] PRLB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:41:13.055774] [WARN ] [MAIN      ] PRLB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:41:13.055812] [INFO ] [LOCAL     ] PRLB: Starting deletion of primary data.
[2025-10-24T20:41:13.055866] [DEBUG] [LOCAL     ] PRLB: No primary data file found to delete.
[2025-10-24T20:41:13.055901] [INFO ] [LOCAL     ] PRLB: Starting deletion of derivative data.
[2025-10-24T20:41:13.056053] [DEBUG] [LOCAL     ] PRLB: Deleted derivative data file.
[2025-10-24T20:41:13.056121] [INFO ] [MAIN      ] Update Progress: 1722/2366 symbols completed. PRLB took 22.9s. Estimated remaining: 1h 22m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:41:13.220704] [INFO ] [MAIN      ] PRMB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:41:13.269846] [DEBUG] [LOCAL     ] PRMB: Loaded 53483 existing records from primary storage.
[2025-10-24T20:41:13.270151] [INFO ] [MAIN      ] PRMB: Loaded 53483 existing records.
[2025-10-24T20:41:13.466696] [WARN ] [MAIN      ] PRMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:41:13.466910] [INFO ] [MAIN      ] PRMB: Wiping existing primary data before full refresh.
[2025-10-24T20:41:13.466956] [INFO ] [LOCAL     ] PRMB: Starting deletion of primary data.
[2025-10-24T20:41:13.467330] [DEBUG] [LOCAL     ] PRMB: Deleted primary data file.
[2025-10-24T20:41:13.467399] [INFO ] [MAIN      ] PRMB: Starting full primary refresh.
[2025-10-24T20:41:13.748685] [INFO ] [REMOTE    ] PRIM: Fetching primary data for 2025-04.
[2025-10-24T20:41:13.835846] [INFO ] [REMOTE    ] PRMB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:41:13.852152] [INFO ] [REMOTE    ] PRM: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T20:41:14.547602] [INFO ] [REMOTE    ] PRM: Fetching primary data for 2025-03.
[2025-10-24T20:41:14.891941] [INFO ] [REMOTE    ] PRIM: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T20:41:15.325509] [INFO ] [REMOTE    ] PRM: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T20:41:15.347595] [INFO ] [REMOTE    ] PRM: Fetching primary data for 2025-04.
[2025-10-24T20:41:16.147926] [INFO ] [REMOTE    ] PRMB: Fetching primary data for 2025-01.
[2025-10-24T20:41:16.153192] [INFO ] [REMOTE    ] PRM: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T20:41:16.947701] [INFO ] [REMOTE    ] PRIM: Fetching primary data for 2025-05.
[2025-10-24T20:41:17.137864] [INFO ] [REMOTE    ] PRMB: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T20:41:17.250107] [INFO ] [REMOTE    ] PRIM: Incremental fetch complete for 2025-05 (0.30 seconds).
[2025-10-24T20:41:17.747700] [INFO ] [REMOTE    ] PRIM: Fetching primary data for 2025-06.
[2025-10-24T20:41:18.501844] [INFO ] [REMOTE    ] PRIM: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T20:41:18.547629] [INFO ] [REMOTE    ] PRIM: Fetching primary data for 2025-07.
[2025-10-24T20:41:19.331197] [INFO ] [REMOTE    ] PRIM: Incremental fetch complete for 2025-07 (0.78 seconds).
[2025-10-24T20:41:19.347599] [INFO ] [REMOTE    ] PRIM: Fetching primary data for 2025-08.
[2025-10-24T20:41:20.038292] [INFO ] [REMOTE    ] PRIM: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T20:41:20.147677] [INFO ] [REMOTE    ] PRIM: Fetching primary data for 2025-09.
[2025-10-24T20:41:20.890246] [INFO ] [REMOTE    ] PRIM: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T20:41:20.947631] [INFO ] [REMOTE    ] PRIM: Fetching primary data for 2025-10.
[2025-10-24T20:41:21.747619] [INFO ] [REMOTE    ] PRI: Fetching primary data for 2025-07.
[2025-10-24T20:41:21.918848] [INFO ] [REMOTE    ] PRIM: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T20:41:21.926222] [INFO ] [REMOTE    ] PRIM: Full fetch complete (63539 records).
[2025-10-24T20:41:21.926338] [DEBUG] [VALIDATOR ] PRIM: Validating primary data.
[2025-10-24T20:41:21.927173] [FATAL] [VALIDATOR ] PRIM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:41:21.927259] [FATAL] [MAIN      ] PRIM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:41:21.927356] [WARN ] [MAIN      ] PRIM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:41:21.927440] [INFO ] [LOCAL     ] PRIM: Starting deletion of primary data.
[2025-10-24T20:41:21.927516] [DEBUG] [LOCAL     ] PRIM: No primary data file found to delete.
[2025-10-24T20:41:21.927564] [INFO ] [LOCAL     ] PRIM: Starting deletion of derivative data.
[2025-10-24T20:41:21.927767] [DEBUG] [LOCAL     ] PRIM: Deleted derivative data file.
[2025-10-24T20:41:21.928159] [INFO ] [MAIN      ] Update Progress: 1723/2366 symbols completed. PRIM took 31.8s. Estimated remaining: 1h 22m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:41:22.108081] [INFO ] [MAIN      ] PRO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:41:22.147752] [DEBUG] [LOCAL     ] PRO: Loaded 40426 existing records from primary storage.
[2025-10-24T20:41:22.148040] [INFO ] [MAIN      ] PRO: Loaded 40426 existing records.
[2025-10-24T20:41:22.323575] [WARN ] [MAIN      ] PRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:41:22.323824] [INFO ] [MAIN      ] PRO: Wiping existing primary data before full refresh.
[2025-10-24T20:41:22.323895] [INFO ] [LOCAL     ] PRO: Starting deletion of primary data.
[2025-10-24T20:41:22.324328] [DEBUG] [LOCAL     ] PRO: Deleted primary data file.
[2025-10-24T20:41:22.324386] [INFO ] [MAIN      ] PRO: Starting full primary refresh.
[2025-10-24T20:41:22.555773] [INFO ] [REMOTE    ] PRMB: Fetching primary data for 2025-02.
[2025-10-24T20:41:22.697055] [INFO ] [REMOTE    ] PRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:41:22.709077] [INFO ] [REMOTE    ] PRI: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T20:41:23.347636] [INFO ] [REMOTE    ] PRO: Fetching primary data for 2025-01.
[2025-10-24T20:41:23.618684] [INFO ] [REMOTE    ] PRMB: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T20:41:23.690783] [INFO ] [REMOTE    ] PRO: Incremental fetch complete for 2025-01 (0.34 seconds).
[2025-10-24T20:41:24.147686] [INFO ] [REMOTE    ] PRO: Fetching primary data for 2025-02.
[2025-10-24T20:41:24.805446] [INFO ] [REMOTE    ] PRO: Incremental fetch complete for 2025-02 (0.66 seconds).
[2025-10-24T20:41:24.947668] [INFO ] [REMOTE    ] PRM: Fetching primary data for 2025-05.
[2025-10-24T20:41:25.678419] [INFO ] [REMOTE    ] PRM: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T20:41:25.747627] [INFO ] [REMOTE    ] PRI: Fetching primary data for 2025-08.
[2025-10-24T20:41:26.547636] [INFO ] [REMOTE    ] PRM: Fetching primary data for 2025-06.
[2025-10-24T20:41:27.244489] [INFO ] [REMOTE    ] PRM: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T20:41:27.347618] [INFO ] [REMOTE    ] PRMB: Fetching primary data for 2025-03.
[2025-10-24T20:41:27.824889] [INFO ] [REMOTE    ] PRI: Incremental fetch complete for 2025-08 (2.08 seconds).
[2025-10-24T20:41:28.147692] [INFO ] [REMOTE    ] PRI: Fetching primary data for 2025-09.
[2025-10-24T20:41:28.493811] [INFO ] [REMOTE    ] PRMB: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T20:41:28.704298] [INFO ] [REMOTE    ] PRI: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T20:41:28.947673] [INFO ] [REMOTE    ] PRO: Fetching primary data for 2025-03.
[2025-10-24T20:41:29.747635] [INFO ] [REMOTE    ] PRM: Fetching primary data for 2025-07.
[2025-10-24T20:41:30.022742] [INFO ] [REMOTE    ] PRO: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T20:41:30.536261] [INFO ] [REMOTE    ] PRM: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T20:41:30.547720] [INFO ] [REMOTE    ] PRI: Fetching primary data for 2025-10.
[2025-10-24T20:41:31.347671] [INFO ] [REMOTE    ] PRO: Fetching primary data for 2025-04.
[2025-10-24T20:41:31.441574] [INFO ] [REMOTE    ] PRI: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T20:41:31.444741] [INFO ] [REMOTE    ] PRI: Full fetch complete (25477 records).
[2025-10-24T20:41:31.444821] [DEBUG] [VALIDATOR ] PRI: Validating primary data.
[2025-10-24T20:41:31.445245] [FATAL] [VALIDATOR ] PRI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:41:31.445326] [FATAL] [MAIN      ] PRI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:41:31.445367] [WARN ] [MAIN      ] PRI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:41:31.445431] [INFO ] [LOCAL     ] PRI: Starting deletion of primary data.
[2025-10-24T20:41:31.445514] [DEBUG] [LOCAL     ] PRI: No primary data file found to delete.
[2025-10-24T20:41:31.445572] [INFO ] [LOCAL     ] PRI: Starting deletion of derivative data.
[2025-10-24T20:41:31.445816] [DEBUG] [LOCAL     ] PRI: Deleted derivative data file.
[2025-10-24T20:41:31.445904] [INFO ] [MAIN      ] Update Progress: 1724/2366 symbols completed. PRI took 41.3s. Estimated remaining: 1h 22m 29s. Rate: 7.8 symbols/min
[2025-10-24T20:41:31.612848] [INFO ] [MAIN      ] PRSU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:41:31.636120] [DEBUG] [LOCAL     ] PRSU: Loaded 23223 existing records from primary storage.
[2025-10-24T20:41:31.636383] [INFO ] [MAIN      ] PRSU: Loaded 23223 existing records.
[2025-10-24T20:41:31.819194] [WARN ] [MAIN      ] PRSU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:41:31.819747] [INFO ] [MAIN      ] PRSU: Wiping existing primary data before full refresh.
[2025-10-24T20:41:31.819813] [INFO ] [LOCAL     ] PRSU: Starting deletion of primary data.
[2025-10-24T20:41:31.820145] [DEBUG] [LOCAL     ] PRSU: Deleted primary data file.
[2025-10-24T20:41:31.820199] [INFO ] [MAIN      ] PRSU: Starting full primary refresh.
[2025-10-24T20:41:32.151274] [INFO ] [REMOTE    ] PRMB: Fetching primary data for 2025-04.
[2025-10-24T20:41:32.174371] [INFO ] [REMOTE    ] PRSU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:41:32.306278] [INFO ] [REMOTE    ] PRO: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T20:41:32.947664] [INFO ] [REMOTE    ] PRO: Fetching primary data for 2025-05.
[2025-10-24T20:41:33.626105] [INFO ] [REMOTE    ] PRMB: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T20:41:33.748989] [INFO ] [REMOTE    ] PRSU: Fetching primary data for 2025-01.
[2025-10-24T20:41:33.753678] [INFO ] [REMOTE    ] PRO: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:41:34.358897] [INFO ] [REMOTE    ] PRSU: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T20:41:34.547678] [INFO ] [REMOTE    ] PRO: Fetching primary data for 2025-06.
[2025-10-24T20:41:35.261730] [INFO ] [REMOTE    ] PRO: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T20:41:35.347625] [INFO ] [REMOTE    ] PRMB: Fetching primary data for 2025-05.
[2025-10-24T20:41:36.153190] [INFO ] [REMOTE    ] PRSU: Fetching primary data for 2025-02.
[2025-10-24T20:41:36.158874] [INFO ] [REMOTE    ] PRMB: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:41:36.752264] [INFO ] [REMOTE    ] PRSU: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T20:41:36.947682] [INFO ] [REMOTE    ] PRO: Fetching primary data for 2025-07.
[2025-10-24T20:41:37.678125] [INFO ] [REMOTE    ] PRO: Incremental fetch complete for 2025-07 (0.73 seconds).
[2025-10-24T20:41:37.747605] [INFO ] [REMOTE    ] PRO: Fetching primary data for 2025-08.
[2025-10-24T20:41:38.386520] [INFO ] [REMOTE    ] PRO: Incremental fetch complete for 2025-08 (0.64 seconds).
[2025-10-24T20:41:38.547624] [INFO ] [REMOTE    ] PRM: Fetching primary data for 2025-08.
[2025-10-24T20:41:39.302624] [INFO ] [REMOTE    ] PRM: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T20:41:39.347609] [INFO ] [REMOTE    ] PRO: Fetching primary data for 2025-09.
[2025-10-24T20:41:40.068853] [INFO ] [REMOTE    ] PRO: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T20:41:40.147608] [INFO ] [REMOTE    ] PRM: Fetching primary data for 2025-09.
[2025-10-24T20:41:40.947606] [INFO ] [REMOTE    ] PRMB: Fetching primary data for 2025-06.
[2025-10-24T20:41:41.140217] [INFO ] [REMOTE    ] PRM: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T20:41:41.747603] [INFO ] [REMOTE    ] PRM: Fetching primary data for 2025-10.
[2025-10-24T20:41:42.103986] [INFO ] [REMOTE    ] PRMB: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T20:41:42.547620] [INFO ] [REMOTE    ] PRMB: Fetching primary data for 2025-07.
[2025-10-24T20:41:42.667002] [INFO ] [REMOTE    ] PRM: Incremental fetch complete for 2025-10 (0.92 seconds).
[2025-10-24T20:41:42.676676] [INFO ] [REMOTE    ] PRM: Full fetch complete (64609 records).
[2025-10-24T20:41:42.676807] [DEBUG] [VALIDATOR ] PRM: Validating primary data.
[2025-10-24T20:41:42.677677] [FATAL] [VALIDATOR ] PRM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:41:42.677772] [FATAL] [MAIN      ] PRM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:41:42.677824] [WARN ] [MAIN      ] PRM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:41:42.677906] [INFO ] [LOCAL     ] PRM: Starting deletion of primary data.
[2025-10-24T20:41:42.678008] [DEBUG] [LOCAL     ] PRM: No primary data file found to delete.
[2025-10-24T20:41:42.678079] [INFO ] [LOCAL     ] PRM: Starting deletion of derivative data.
[2025-10-24T20:41:42.678244] [DEBUG] [LOCAL     ] PRM: Deleted derivative data file.
[2025-10-24T20:41:42.678677] [INFO ] [MAIN      ] Update Progress: 1725/2366 symbols completed. PRM took 34.4s. Estimated remaining: 1h 22m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:41:42.849575] [INFO ] [MAIN      ] PRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:41:42.857279] [DEBUG] [LOCAL     ] PRT: Loaded 5085 existing records from primary storage.
[2025-10-24T20:41:42.857519] [INFO ] [MAIN      ] PRT: Loaded 5085 existing records.
[2025-10-24T20:41:43.033691] [WARN ] [MAIN      ] PRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:41:43.033897] [INFO ] [MAIN      ] PRT: Wiping existing primary data before full refresh.
[2025-10-24T20:41:43.033950] [INFO ] [LOCAL     ] PRT: Starting deletion of primary data.
[2025-10-24T20:41:43.034125] [DEBUG] [LOCAL     ] PRT: Deleted primary data file.
[2025-10-24T20:41:43.034180] [INFO ] [MAIN      ] PRT: Starting full primary refresh.
[2025-10-24T20:41:43.350089] [INFO ] [REMOTE    ] PRSU: Fetching primary data for 2025-03.
[2025-10-24T20:41:43.391445] [INFO ] [REMOTE    ] PRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:41:43.422474] [INFO ] [REMOTE    ] PRMB: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T20:41:43.964418] [INFO ] [REMOTE    ] PRSU: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T20:41:44.147676] [INFO ] [REMOTE    ] PRMB: Fetching primary data for 2025-08.
[2025-10-24T20:41:44.947675] [INFO ] [REMOTE    ] PRO: Fetching primary data for 2025-10.
[2025-10-24T20:41:45.323055] [INFO ] [REMOTE    ] PRMB: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T20:41:45.604985] [INFO ] [REMOTE    ] PRO: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T20:41:45.613668] [INFO ] [REMOTE    ] PRO: Full fetch complete (53781 records).
[2025-10-24T20:41:45.613844] [DEBUG] [VALIDATOR ] PRO: Validating primary data.
[2025-10-24T20:41:45.614490] [FATAL] [VALIDATOR ] PRO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:41:45.614587] [FATAL] [MAIN      ] PRO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:41:45.614631] [WARN ] [MAIN      ] PRO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:41:45.614736] [INFO ] [LOCAL     ] PRO: Starting deletion of primary data.
[2025-10-24T20:41:45.614811] [DEBUG] [LOCAL     ] PRO: No primary data file found to delete.
[2025-10-24T20:41:45.614859] [INFO ] [LOCAL     ] PRO: Starting deletion of derivative data.
[2025-10-24T20:41:45.615076] [DEBUG] [LOCAL     ] PRO: Deleted derivative data file.
[2025-10-24T20:41:45.615824] [INFO ] [MAIN      ] Update Progress: 1726/2366 symbols completed. PRO took 23.7s. Estimated remaining: 1h 22m 13s. Rate: 7.8 symbols/min
[2025-10-24T20:41:45.760589] [INFO ] [REMOTE    ] PRMB: Fetching primary data for 2025-09.
[2025-10-24T20:41:45.792547] [INFO ] [MAIN      ] PRU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:41:45.846594] [DEBUG] [LOCAL     ] PRU: Loaded 51504 existing records from primary storage.
[2025-10-24T20:41:45.846953] [INFO ] [MAIN      ] PRU: Loaded 51504 existing records.
[2025-10-24T20:41:46.037968] [WARN ] [MAIN      ] PRU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:41:46.038209] [INFO ] [MAIN      ] PRU: Wiping existing primary data before full refresh.
[2025-10-24T20:41:46.038274] [INFO ] [LOCAL     ] PRU: Starting deletion of primary data.
[2025-10-24T20:41:46.038698] [DEBUG] [LOCAL     ] PRU: Deleted primary data file.
[2025-10-24T20:41:46.038756] [INFO ] [MAIN      ] PRU: Starting full primary refresh.
[2025-10-24T20:41:46.440413] [INFO ] [REMOTE    ] PRU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:41:46.547688] [INFO ] [REMOTE    ] PRU: Fetching primary data for 2025-01.
[2025-10-24T20:41:47.137904] [INFO ] [REMOTE    ] PRMB: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T20:41:47.347689] [INFO ] [REMOTE    ] PRSU: Fetching primary data for 2025-04.
[2025-10-24T20:41:47.608967] [INFO ] [REMOTE    ] PRU: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T20:41:48.147679] [INFO ] [REMOTE    ] PRT: Fetching primary data for 2025-01.
[2025-10-24T20:41:48.412971] [INFO ] [REMOTE    ] PRSU: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T20:41:48.864947] [INFO ] [REMOTE    ] PRT: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T20:41:48.947720] [INFO ] [REMOTE    ] PRMB: Fetching primary data for 2025-10.
[2025-10-24T20:41:49.747712] [INFO ] [REMOTE    ] PRSU: Fetching primary data for 2025-05.
[2025-10-24T20:41:49.892127] [INFO ] [REMOTE    ] PRMB: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T20:41:49.902383] [INFO ] [REMOTE    ] PRMB: Full fetch complete (75931 records).
[2025-10-24T20:41:49.902573] [DEBUG] [VALIDATOR ] PRMB: Validating primary data.
[2025-10-24T20:41:49.903375] [FATAL] [VALIDATOR ] PRMB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:41:49.903468] [FATAL] [MAIN      ] PRMB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:41:49.903527] [WARN ] [MAIN      ] PRMB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:41:49.903602] [INFO ] [LOCAL     ] PRMB: Starting deletion of primary data.
[2025-10-24T20:41:49.903688] [DEBUG] [LOCAL     ] PRMB: No primary data file found to delete.
[2025-10-24T20:41:49.903743] [INFO ] [LOCAL     ] PRMB: Starting deletion of derivative data.
[2025-10-24T20:41:49.903927] [DEBUG] [LOCAL     ] PRMB: Deleted derivative data file.
[2025-10-24T20:41:49.904209] [INFO ] [MAIN      ] Update Progress: 1727/2366 symbols completed. PRMB took 36.8s. Estimated remaining: 1h 22m 4s. Rate: 7.8 symbols/min
[2025-10-24T20:41:50.070606] [INFO ] [MAIN      ] PRVS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:41:50.070798] [DEBUG] [LOCAL     ] PRVS: No existing data file found in primary storage.
[2025-10-24T20:41:50.070839] [WARN ] [MAIN      ] PRVS: No existing data found, performing full refresh instead.
[2025-10-24T20:41:50.070953] [INFO ] [MAIN      ] PRVS: Wiping existing primary data before full refresh.
[2025-10-24T20:41:50.070993] [INFO ] [LOCAL     ] PRVS: Starting deletion of primary data.
[2025-10-24T20:41:50.071033] [DEBUG] [LOCAL     ] PRVS: No primary data file found to delete.
[2025-10-24T20:41:50.071064] [INFO ] [MAIN      ] PRVS: Starting full primary refresh.
[2025-10-24T20:41:50.417796] [INFO ] [REMOTE    ] PRVS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:41:50.547751] [INFO ] [REMOTE    ] PRVS: Fetching primary data for 2025-01.
[2025-10-24T20:41:50.945705] [INFO ] [REMOTE    ] PRSU: Incremental fetch complete for 2025-05 (1.20 seconds).
[2025-10-24T20:41:50.960995] [INFO ] [REMOTE    ] PRVS: Incremental fetch complete for 2025-01 (0.41 seconds).
[2025-10-24T20:41:51.347735] [INFO ] [REMOTE    ] PRVS: Fetching primary data for 2025-02.
[2025-10-24T20:41:51.832286] [INFO ] [REMOTE    ] PRVS: Incremental fetch complete for 2025-02 (0.48 seconds).
[2025-10-24T20:41:52.147734] [INFO ] [REMOTE    ] PRT: Fetching primary data for 2025-02.
[2025-10-24T20:41:52.844501] [INFO ] [REMOTE    ] PRT: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T20:41:52.947631] [INFO ] [REMOTE    ] PRU: Fetching primary data for 2025-02.
[2025-10-24T20:41:53.747696] [INFO ] [REMOTE    ] PRSU: Fetching primary data for 2025-06.
[2025-10-24T20:41:53.837107] [INFO ] [REMOTE    ] PRU: Incremental fetch complete for 2025-02 (0.89 seconds).
[2025-10-24T20:41:53.956493] [INFO ] [REMOTE    ] PRSU: Incremental fetch complete for 2025-06 (0.21 seconds).
[2025-10-24T20:41:54.547634] [INFO ] [REMOTE    ] PRT: Fetching primary data for 2025-03.
[2025-10-24T20:41:54.999047] [INFO ] [REMOTE    ] PRT: Incremental fetch complete for 2025-03 (0.45 seconds).
[2025-10-24T20:41:55.347694] [INFO ] [REMOTE    ] PRSU: Fetching primary data for 2025-07.
[2025-10-24T20:41:55.958556] [INFO ] [REMOTE    ] PRSU: Incremental fetch complete for 2025-07 (0.61 seconds).
[2025-10-24T20:41:56.147675] [INFO ] [REMOTE    ] PRSU: Fetching primary data for 2025-08.
[2025-10-24T20:41:56.752190] [INFO ] [REMOTE    ] PRSU: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T20:41:56.947763] [INFO ] [REMOTE    ] PRVS: Fetching primary data for 2025-03.
[2025-10-24T20:41:57.149860] [INFO ] [REMOTE    ] PRVS: Incremental fetch complete for 2025-03 (0.20 seconds).
[2025-10-24T20:41:57.747763] [INFO ] [REMOTE    ] PRVS: Fetching primary data for 2025-04.
[2025-10-24T20:41:58.547637] [INFO ] [REMOTE    ] PRSU: Fetching primary data for 2025-09.
[2025-10-24T20:41:58.564896] [INFO ] [REMOTE    ] PRVS: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T20:41:59.116706] [INFO ] [REMOTE    ] PRSU: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T20:41:59.347719] [INFO ] [REMOTE    ] PRU: Fetching primary data for 2025-03.
[2025-10-24T20:42:00.119344] [INFO ] [REMOTE    ] PRU: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T20:42:00.147624] [INFO ] [REMOTE    ] PRU: Fetching primary data for 2025-04.
[2025-10-24T20:42:00.947698] [INFO ] [REMOTE    ] PRT: Fetching primary data for 2025-04.
[2025-10-24T20:42:01.290280] [INFO ] [REMOTE    ] PRU: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T20:42:01.657565] [INFO ] [REMOTE    ] PRT: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T20:42:01.747735] [INFO ] [REMOTE    ] PRT: Fetching primary data for 2025-05.
[2025-10-24T20:42:02.361670] [INFO ] [REMOTE    ] PRT: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T20:42:02.547697] [INFO ] [REMOTE    ] PRVS: Fetching primary data for 2025-05.
[2025-10-24T20:42:02.748773] [INFO ] [REMOTE    ] PRVS: Incremental fetch complete for 2025-05 (0.20 seconds).
[2025-10-24T20:42:03.347675] [INFO ] [REMOTE    ] PRVS: Fetching primary data for 2025-06.
[2025-10-24T20:42:03.822843] [INFO ] [REMOTE    ] PRVS: Incremental fetch complete for 2025-06 (0.48 seconds).
[2025-10-24T20:42:04.147683] [INFO ] [REMOTE    ] PRSU: Fetching primary data for 2025-10.
[2025-10-24T20:42:04.708071] [INFO ] [REMOTE    ] PRSU: Incremental fetch complete for 2025-10 (0.56 seconds).
[2025-10-24T20:42:04.712040] [INFO ] [REMOTE    ] PRSU: Full fetch complete (34069 records).
[2025-10-24T20:42:04.712125] [DEBUG] [VALIDATOR ] PRSU: Validating primary data.
[2025-10-24T20:42:04.712678] [FATAL] [VALIDATOR ] PRSU: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:42:04.712759] [FATAL] [MAIN      ] PRSU: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:42:04.712802] [WARN ] [MAIN      ] PRSU: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:42:04.712840] [INFO ] [LOCAL     ] PRSU: Starting deletion of primary data.
[2025-10-24T20:42:04.712896] [DEBUG] [LOCAL     ] PRSU: No primary data file found to delete.
[2025-10-24T20:42:04.712931] [INFO ] [LOCAL     ] PRSU: Starting deletion of derivative data.
[2025-10-24T20:42:04.713077] [DEBUG] [LOCAL     ] PRSU: Deleted derivative data file.
[2025-10-24T20:42:04.713145] [INFO ] [MAIN      ] Update Progress: 1728/2366 symbols completed. PRSU took 33.3s. Estimated remaining: 1h 21m 59s. Rate: 7.8 symbols/min
[2025-10-24T20:42:04.895692] [INFO ] [MAIN      ] PSA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:42:04.935565] [DEBUG] [LOCAL     ] PSA: Loaded 42392 existing records from primary storage.
[2025-10-24T20:42:04.935866] [INFO ] [MAIN      ] PSA: Loaded 42392 existing records.
[2025-10-24T20:42:04.956621] [INFO ] [REMOTE    ] PRU: Fetching primary data for 2025-05.
[2025-10-24T20:42:05.120522] [WARN ] [MAIN      ] PSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:42:05.120725] [INFO ] [MAIN      ] PSA: Wiping existing primary data before full refresh.
[2025-10-24T20:42:05.120778] [INFO ] [LOCAL     ] PSA: Starting deletion of primary data.
[2025-10-24T20:42:05.121096] [DEBUG] [LOCAL     ] PSA: Deleted primary data file.
[2025-10-24T20:42:05.121151] [INFO ] [MAIN      ] PSA: Starting full primary refresh.
[2025-10-24T20:42:05.476961] [INFO ] [REMOTE    ] PSA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:42:05.747673] [INFO ] [REMOTE    ] PRT: Fetching primary data for 2025-06.
[2025-10-24T20:42:05.840394] [INFO ] [REMOTE    ] PRU: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T20:42:06.494390] [INFO ] [REMOTE    ] PRT: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T20:42:06.547601] [INFO ] [REMOTE    ] PSA: Fetching primary data for 2025-01.
[2025-10-24T20:42:07.347698] [INFO ] [REMOTE    ] PRT: Fetching primary data for 2025-07.
[2025-10-24T20:42:07.518250] [INFO ] [REMOTE    ] PSA: Incremental fetch complete for 2025-01 (0.97 seconds).
[2025-10-24T20:42:07.992223] [INFO ] [REMOTE    ] PRT: Incremental fetch complete for 2025-07 (0.64 seconds).
[2025-10-24T20:42:08.147720] [INFO ] [REMOTE    ] PRVS: Fetching primary data for 2025-07.
[2025-10-24T20:42:08.348003] [INFO ] [REMOTE    ] PRVS: Incremental fetch complete for 2025-07 (0.20 seconds).
[2025-10-24T20:42:08.947637] [INFO ] [REMOTE    ] PSA: Fetching primary data for 2025-02.
[2025-10-24T20:42:09.645174] [INFO ] [REMOTE    ] PSA: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T20:42:09.747602] [INFO ] [REMOTE    ] PSA: Fetching primary data for 2025-03.
[2025-10-24T20:42:10.540492] [INFO ] [REMOTE    ] PSA: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T20:42:10.548251] [INFO ] [REMOTE    ] PRT: Fetching primary data for 2025-08.
[2025-10-24T20:42:11.347699] [INFO ] [REMOTE    ] PRU: Fetching primary data for 2025-06.
[2025-10-24T20:42:11.523170] [INFO ] [REMOTE    ] PRT: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T20:42:12.147749] [INFO ] [REMOTE    ] PSA: Fetching primary data for 2025-04.
[2025-10-24T20:42:12.365540] [INFO ] [REMOTE    ] PRU: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T20:42:12.881587] [INFO ] [REMOTE    ] PSA: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T20:42:12.947609] [INFO ] [REMOTE    ] PSA: Fetching primary data for 2025-05.
[2025-10-24T20:42:13.690840] [INFO ] [REMOTE    ] PSA: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T20:42:13.747610] [INFO ] [REMOTE    ] PSA: Fetching primary data for 2025-06.
[2025-10-24T20:42:14.470093] [INFO ] [REMOTE    ] PSA: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T20:42:14.547694] [INFO ] [REMOTE    ] PRT: Fetching primary data for 2025-09.
[2025-10-24T20:42:14.920491] [INFO ] [REMOTE    ] PRT: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T20:42:15.347695] [INFO ] [REMOTE    ] PRT: Fetching primary data for 2025-10.
[2025-10-24T20:42:15.478791] [INFO ] [REMOTE    ] PRT: Incremental fetch complete for 2025-10 (0.13 seconds).
[2025-10-24T20:42:15.480063] [INFO ] [REMOTE    ] PRT: Full fetch complete (8399 records).
[2025-10-24T20:42:15.480134] [DEBUG] [VALIDATOR ] PRT: Validating primary data.
[2025-10-24T20:42:15.480482] [FATAL] [VALIDATOR ] PRT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:42:15.480580] [FATAL] [MAIN      ] PRT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:42:15.480623] [WARN ] [MAIN      ] PRT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:42:15.480696] [INFO ] [LOCAL     ] PRT: Starting deletion of primary data.
[2025-10-24T20:42:15.480761] [DEBUG] [LOCAL     ] PRT: No primary data file found to delete.
[2025-10-24T20:42:15.480795] [INFO ] [LOCAL     ] PRT: Starting deletion of derivative data.
[2025-10-24T20:42:15.480955] [DEBUG] [LOCAL     ] PRT: Deleted derivative data file.
[2025-10-24T20:42:15.481040] [INFO ] [MAIN      ] Update Progress: 1729/2366 symbols completed. PRT took 32.8s. Estimated remaining: 1h 21m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:42:15.646952] [INFO ] [MAIN      ] PSBD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:42:15.657114] [DEBUG] [LOCAL     ] PSBD: Loaded 8310 existing records from primary storage.
[2025-10-24T20:42:15.657357] [INFO ] [MAIN      ] PSBD: Loaded 8310 existing records.
[2025-10-24T20:42:15.833810] [WARN ] [MAIN      ] PSBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:42:15.834011] [INFO ] [MAIN      ] PSBD: Wiping existing primary data before full refresh.
[2025-10-24T20:42:15.834056] [INFO ] [LOCAL     ] PSBD: Starting deletion of primary data.
[2025-10-24T20:42:15.834234] [DEBUG] [LOCAL     ] PSBD: Deleted primary data file.
[2025-10-24T20:42:15.834290] [INFO ] [MAIN      ] PSBD: Starting full primary refresh.
[2025-10-24T20:42:16.154467] [INFO ] [REMOTE    ] PRU: Fetching primary data for 2025-07.
[2025-10-24T20:42:16.194149] [INFO ] [REMOTE    ] PSBD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:42:16.947599] [INFO ] [REMOTE    ] PRVS: Fetching primary data for 2025-08.
[2025-10-24T20:42:17.188374] [INFO ] [REMOTE    ] PRVS: Incremental fetch complete for 2025-08 (0.24 seconds).
[2025-10-24T20:42:17.201686] [INFO ] [REMOTE    ] PRU: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T20:42:17.747635] [INFO ] [REMOTE    ] PRU: Fetching primary data for 2025-08.
[2025-10-24T20:42:18.547626] [INFO ] [REMOTE    ] PSA: Fetching primary data for 2025-07.
[2025-10-24T20:42:18.877251] [INFO ] [REMOTE    ] PRU: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T20:42:19.297179] [INFO ] [REMOTE    ] PSA: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T20:42:19.347607] [INFO ] [REMOTE    ] PRVS: Fetching primary data for 2025-09.
[2025-10-24T20:42:19.541390] [INFO ] [REMOTE    ] PRVS: Incremental fetch complete for 2025-09 (0.19 seconds).
[2025-10-24T20:42:20.147682] [INFO ] [REMOTE    ] PRVS: Fetching primary data for 2025-10.
[2025-10-24T20:42:20.627155] [INFO ] [REMOTE    ] PRVS: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T20:42:20.627964] [INFO ] [REMOTE    ] PRVS: Full fetch complete (1219 records).
[2025-10-24T20:42:20.628033] [DEBUG] [VALIDATOR ] PRVS: Validating primary data.
[2025-10-24T20:42:20.628362] [FATAL] [VALIDATOR ] PRVS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:42:20.628465] [FATAL] [MAIN      ] PRVS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:42:20.628506] [WARN ] [MAIN      ] PRVS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:42:20.628543] [INFO ] [LOCAL     ] PRVS: Starting deletion of primary data.
[2025-10-24T20:42:20.628596] [DEBUG] [LOCAL     ] PRVS: No primary data file found to delete.
[2025-10-24T20:42:20.628630] [INFO ] [LOCAL     ] PRVS: Starting deletion of derivative data.
[2025-10-24T20:42:20.628728] [DEBUG] [LOCAL     ] PRVS: No derivative data file found to delete.
[2025-10-24T20:42:20.628794] [INFO ] [MAIN      ] Update Progress: 1730/2366 symbols completed. PRVS took 30.7s. Estimated remaining: 1h 21m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:42:20.801848] [INFO ] [MAIN      ] PSF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:42:20.810701] [DEBUG] [LOCAL     ] PSF: Loaded 6972 existing records from primary storage.
[2025-10-24T20:42:20.810914] [INFO ] [MAIN      ] PSF: Loaded 6972 existing records.
[2025-10-24T20:42:20.961815] [INFO ] [REMOTE    ] PSBD: Fetching primary data for 2025-01.
[2025-10-24T20:42:21.002349] [WARN ] [MAIN      ] PSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:42:21.002672] [INFO ] [MAIN      ] PSF: Wiping existing primary data before full refresh.
[2025-10-24T20:42:21.002732] [INFO ] [LOCAL     ] PSF: Starting deletion of primary data.
[2025-10-24T20:42:21.002926] [DEBUG] [LOCAL     ] PSF: Deleted primary data file.
[2025-10-24T20:42:21.002983] [INFO ] [MAIN      ] PSF: Starting full primary refresh.
[2025-10-24T20:42:21.366145] [INFO ] [REMOTE    ] PSF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:42:21.403793] [INFO ] [REMOTE    ] PSBD: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T20:42:21.747706] [INFO ] [REMOTE    ] PSA: Fetching primary data for 2025-08.
[2025-10-24T20:42:22.456723] [INFO ] [REMOTE    ] PSA: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T20:42:22.547600] [INFO ] [REMOTE    ] PSA: Fetching primary data for 2025-09.
[2025-10-24T20:42:23.273606] [INFO ] [REMOTE    ] PSA: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T20:42:23.347619] [INFO ] [REMOTE    ] PSF: Fetching primary data for 2025-01.
[2025-10-24T20:42:24.147678] [INFO ] [REMOTE    ] PRU: Fetching primary data for 2025-09.
[2025-10-24T20:42:24.160487] [INFO ] [REMOTE    ] PSF: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T20:42:24.947697] [INFO ] [REMOTE    ] PSA: Fetching primary data for 2025-10.
[2025-10-24T20:42:25.292161] [INFO ] [REMOTE    ] PRU: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T20:42:25.747669] [INFO ] [REMOTE    ] PRU: Fetching primary data for 2025-10.
[2025-10-24T20:42:26.547620] [INFO ] [REMOTE    ] PSBD: Fetching primary data for 2025-02.
[2025-10-24T20:42:26.729362] [INFO ] [REMOTE    ] PRU: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T20:42:26.738572] [INFO ] [REMOTE    ] PRU: Full fetch complete (74215 records).
[2025-10-24T20:42:26.738790] [DEBUG] [VALIDATOR ] PRU: Validating primary data.
[2025-10-24T20:42:26.739773] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:42:26.739882] [FATAL] [MAIN      ] PRU: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:42:26.739925] [WARN ] [MAIN      ] PRU: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:42:26.739967] [INFO ] [LOCAL     ] PRU: Starting deletion of primary data.
[2025-10-24T20:42:26.740022] [DEBUG] [LOCAL     ] PRU: No primary data file found to delete.
[2025-10-24T20:42:26.740058] [INFO ] [LOCAL     ] PRU: Starting deletion of derivative data.
[2025-10-24T20:42:26.740231] [DEBUG] [LOCAL     ] PRU: Deleted derivative data file.
[2025-10-24T20:42:26.741094] [INFO ] [MAIN      ] Update Progress: 1731/2366 symbols completed. PRU took 41.1s. Estimated remaining: 1h 21m 35s. Rate: 7.8 symbols/min
[2025-10-24T20:42:26.917715] [INFO ] [MAIN      ] PSFE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:42:26.922336] [INFO ] [REMOTE    ] PSBD: Incremental fetch complete for 2025-02 (0.37 seconds).
[2025-10-24T20:42:26.953875] [DEBUG] [LOCAL     ] PSFE: Loaded 29746 existing records from primary storage.
[2025-10-24T20:42:26.954209] [INFO ] [MAIN      ] PSFE: Loaded 29746 existing records.
[2025-10-24T20:42:27.138201] [WARN ] [MAIN      ] PSFE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:42:27.138460] [INFO ] [MAIN      ] PSFE: Wiping existing primary data before full refresh.
[2025-10-24T20:42:27.138508] [INFO ] [LOCAL     ] PSFE: Starting deletion of primary data.
[2025-10-24T20:42:27.138878] [DEBUG] [LOCAL     ] PSFE: Deleted primary data file.
[2025-10-24T20:42:27.138935] [INFO ] [MAIN      ] PSFE: Starting full primary refresh.
[2025-10-24T20:42:27.352773] [INFO ] [REMOTE    ] PSF: Fetching primary data for 2025-02.
[2025-10-24T20:42:27.504010] [INFO ] [REMOTE    ] PSFE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:42:27.791349] [INFO ] [REMOTE    ] PSF: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T20:42:28.147733] [INFO ] [REMOTE    ] PSBD: Fetching primary data for 2025-03.
[2025-10-24T20:42:28.644311] [INFO ] [REMOTE    ] PSA: Incremental fetch complete for 2025-10 (3.70 seconds).
[2025-10-24T20:42:28.651513] [INFO ] [REMOTE    ] PSA: Full fetch complete (59428 records).
[2025-10-24T20:42:28.651622] [DEBUG] [VALIDATOR ] PSA: Validating primary data.
[2025-10-24T20:42:28.652249] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:42:28.652332] [FATAL] [MAIN      ] PSA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:42:28.652374] [WARN ] [MAIN      ] PSA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:42:28.652411] [INFO ] [LOCAL     ] PSA: Starting deletion of primary data.
[2025-10-24T20:42:28.652463] [DEBUG] [LOCAL     ] PSA: No primary data file found to delete.
[2025-10-24T20:42:28.652497] [INFO ] [LOCAL     ] PSA: Starting deletion of derivative data.
[2025-10-24T20:42:28.652681] [DEBUG] [LOCAL     ] PSA: Deleted derivative data file.
[2025-10-24T20:42:28.652782] [INFO ] [MAIN      ] Update Progress: 1732/2366 symbols completed. PSA took 23.9s. Estimated remaining: 1h 21m 25s. Rate: 7.8 symbols/min
[2025-10-24T20:42:28.836836] [INFO ] [MAIN      ] PSN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:42:28.842384] [INFO ] [REMOTE    ] PSBD: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T20:42:28.881407] [DEBUG] [LOCAL     ] PSN: Loaded 45425 existing records from primary storage.
[2025-10-24T20:42:28.881723] [INFO ] [MAIN      ] PSN: Loaded 45425 existing records.
[2025-10-24T20:42:28.952792] [INFO ] [REMOTE    ] PSBD: Fetching primary data for 2025-04.
[2025-10-24T20:42:29.076721] [WARN ] [MAIN      ] PSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:42:29.076945] [INFO ] [MAIN      ] PSN: Wiping existing primary data before full refresh.
[2025-10-24T20:42:29.077014] [INFO ] [LOCAL     ] PSN: Starting deletion of primary data.
[2025-10-24T20:42:29.077706] [DEBUG] [LOCAL     ] PSN: Deleted primary data file.
[2025-10-24T20:42:29.077765] [INFO ] [MAIN      ] PSN: Starting full primary refresh.
[2025-10-24T20:42:29.387454] [INFO ] [REMOTE    ] PSBD: Incremental fetch complete for 2025-04 (0.43 seconds).
[2025-10-24T20:42:29.465459] [INFO ] [REMOTE    ] PSN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:42:29.747686] [INFO ] [REMOTE    ] PSN: Fetching primary data for 2025-01.
[2025-10-24T20:42:30.487738] [INFO ] [REMOTE    ] PSN: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T20:42:30.547690] [INFO ] [REMOTE    ] PSF: Fetching primary data for 2025-03.
[2025-10-24T20:42:31.111327] [INFO ] [REMOTE    ] PSF: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T20:42:31.347639] [INFO ] [REMOTE    ] PSN: Fetching primary data for 2025-02.
[2025-10-24T20:42:32.114092] [INFO ] [REMOTE    ] PSN: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T20:42:32.147608] [INFO ] [REMOTE    ] PSN: Fetching primary data for 2025-03.
[2025-10-24T20:42:32.907520] [INFO ] [REMOTE    ] PSN: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T20:42:32.947607] [INFO ] [REMOTE    ] PSN: Fetching primary data for 2025-04.
[2025-10-24T20:42:33.747677] [INFO ] [REMOTE    ] PSF: Fetching primary data for 2025-04.
[2025-10-24T20:42:33.965398] [INFO ] [REMOTE    ] PSN: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T20:42:34.509196] [INFO ] [REMOTE    ] PSF: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T20:42:34.547619] [INFO ] [REMOTE    ] PSFE: Fetching primary data for 2025-01.
[2025-10-24T20:42:35.347614] [INFO ] [REMOTE    ] PSF: Fetching primary data for 2025-05.
[2025-10-24T20:42:35.729572] [INFO ] [REMOTE    ] PSFE: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T20:42:36.147727] [INFO ] [REMOTE    ] PSBD: Fetching primary data for 2025-05.
[2025-10-24T20:42:36.429921] [INFO ] [REMOTE    ] PSF: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T20:42:36.570441] [INFO ] [REMOTE    ] PSBD: Incremental fetch complete for 2025-05 (0.42 seconds).
[2025-10-24T20:42:36.947670] [INFO ] [REMOTE    ] PSF: Fetching primary data for 2025-06.
[2025-10-24T20:42:37.747691] [INFO ] [REMOTE    ] PSFE: Fetching primary data for 2025-02.
[2025-10-24T20:42:37.994282] [INFO ] [REMOTE    ] PSF: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T20:42:38.245603] [INFO ] [REMOTE    ] PSFE: Incremental fetch complete for 2025-02 (0.50 seconds).
[2025-10-24T20:42:38.547725] [INFO ] [REMOTE    ] PSN: Fetching primary data for 2025-05.
[2025-10-24T20:42:39.347702] [INFO ] [REMOTE    ] PSBD: Fetching primary data for 2025-06.
[2025-10-24T20:42:39.763903] [INFO ] [REMOTE    ] PSN: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T20:42:39.792442] [INFO ] [REMOTE    ] PSBD: Incremental fetch complete for 2025-06 (0.44 seconds).
[2025-10-24T20:42:40.147666] [INFO ] [REMOTE    ] PSF: Fetching primary data for 2025-07.
[2025-10-24T20:42:40.825963] [INFO ] [REMOTE    ] PSF: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T20:42:40.947734] [INFO ] [REMOTE    ] PSF: Fetching primary data for 2025-08.
[2025-10-24T20:42:41.747614] [INFO ] [REMOTE    ] PSBD: Fetching primary data for 2025-07.
[2025-10-24T20:42:41.980815] [INFO ] [REMOTE    ] PSF: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T20:42:42.547635] [INFO ] [REMOTE    ] PSFE: Fetching primary data for 2025-03.
[2025-10-24T20:42:42.665619] [INFO ] [REMOTE    ] PSBD: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T20:42:43.223333] [INFO ] [REMOTE    ] PSFE: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T20:42:43.347687] [INFO ] [REMOTE    ] PSN: Fetching primary data for 2025-06.
[2025-10-24T20:42:44.067360] [INFO ] [REMOTE    ] PSN: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T20:42:44.147620] [INFO ] [REMOTE    ] PSN: Fetching primary data for 2025-07.
[2025-10-24T20:42:44.947609] [INFO ] [REMOTE    ] PSBD: Fetching primary data for 2025-08.
[2025-10-24T20:42:45.212341] [INFO ] [REMOTE    ] PSN: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T20:42:45.641674] [INFO ] [REMOTE    ] PSBD: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T20:42:45.747606] [INFO ] [REMOTE    ] PSBD: Fetching primary data for 2025-09.
[2025-10-24T20:42:46.547620] [INFO ] [REMOTE    ] PSF: Fetching primary data for 2025-09.
[2025-10-24T20:42:46.563208] [INFO ] [REMOTE    ] PSBD: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T20:42:46.996393] [INFO ] [REMOTE    ] PSF: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T20:42:47.347685] [INFO ] [REMOTE    ] PSBD: Fetching primary data for 2025-10.
[2025-10-24T20:42:47.883280] [INFO ] [REMOTE    ] PSBD: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T20:42:47.886542] [INFO ] [REMOTE    ] PSBD: Full fetch complete (10961 records).
[2025-10-24T20:42:47.886667] [DEBUG] [VALIDATOR ] PSBD: Validating primary data.
[2025-10-24T20:42:47.887105] [FATAL] [VALIDATOR ] PSBD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:42:47.887186] [FATAL] [MAIN      ] PSBD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:42:47.887229] [WARN ] [MAIN      ] PSBD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:42:47.887289] [INFO ] [LOCAL     ] PSBD: Starting deletion of primary data.
[2025-10-24T20:42:47.887394] [DEBUG] [LOCAL     ] PSBD: No primary data file found to delete.
[2025-10-24T20:42:47.887438] [INFO ] [LOCAL     ] PSBD: Starting deletion of derivative data.
[2025-10-24T20:42:47.887586] [DEBUG] [LOCAL     ] PSBD: Deleted derivative data file.
[2025-10-24T20:42:47.887688] [INFO ] [MAIN      ] Update Progress: 1733/2366 symbols completed. PSBD took 32.4s. Estimated remaining: 1h 21m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:42:48.055685] [INFO ] [MAIN      ] PSO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:42:48.092261] [DEBUG] [LOCAL     ] PSO: Loaded 36855 existing records from primary storage.
[2025-10-24T20:42:48.092530] [INFO ] [MAIN      ] PSO: Loaded 36855 existing records.
[2025-10-24T20:42:48.154336] [INFO ] [REMOTE    ] PSFE: Fetching primary data for 2025-04.
[2025-10-24T20:42:48.272753] [WARN ] [MAIN      ] PSO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:42:48.272969] [INFO ] [MAIN      ] PSO: Wiping existing primary data before full refresh.
[2025-10-24T20:42:48.273016] [INFO ] [LOCAL     ] PSO: Starting deletion of primary data.
[2025-10-24T20:42:48.273384] [DEBUG] [LOCAL     ] PSO: Deleted primary data file.
[2025-10-24T20:42:48.273440] [INFO ] [MAIN      ] PSO: Starting full primary refresh.
[2025-10-24T20:42:48.652706] [INFO ] [REMOTE    ] PSO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:42:48.874128] [INFO ] [REMOTE    ] PSFE: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T20:42:48.947606] [INFO ] [REMOTE    ] PSFE: Fetching primary data for 2025-05.
[2025-10-24T20:42:49.694819] [INFO ] [REMOTE    ] PSFE: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T20:42:49.747611] [INFO ] [REMOTE    ] PSFE: Fetching primary data for 2025-06.
[2025-10-24T20:42:50.547626] [INFO ] [REMOTE    ] PSO: Fetching primary data for 2025-01.
[2025-10-24T20:42:50.643909] [INFO ] [REMOTE    ] PSFE: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T20:42:51.347678] [INFO ] [REMOTE    ] PSN: Fetching primary data for 2025-08.
[2025-10-24T20:42:51.950805] [INFO ] [REMOTE    ] PSO: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T20:42:52.089041] [INFO ] [REMOTE    ] PSN: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T20:42:52.147611] [INFO ] [REMOTE    ] PSN: Fetching primary data for 2025-09.
[2025-10-24T20:42:52.947614] [INFO ] [REMOTE    ] PSFE: Fetching primary data for 2025-07.
[2025-10-24T20:42:53.127143] [INFO ] [REMOTE    ] PSN: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T20:42:53.752813] [INFO ] [REMOTE    ] PSO: Fetching primary data for 2025-02.
[2025-10-24T20:42:53.762550] [INFO ] [REMOTE    ] PSFE: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T20:42:54.547694] [INFO ] [REMOTE    ] PSFE: Fetching primary data for 2025-08.
[2025-10-24T20:42:54.615052] [INFO ] [REMOTE    ] PSO: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T20:42:55.222269] [INFO ] [REMOTE    ] PSFE: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T20:42:55.347700] [INFO ] [REMOTE    ] PSFE: Fetching primary data for 2025-09.
[2025-10-24T20:42:56.147609] [INFO ] [REMOTE    ] PSF: Fetching primary data for 2025-10.
[2025-10-24T20:42:56.235286] [INFO ] [REMOTE    ] PSFE: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T20:42:56.806752] [INFO ] [REMOTE    ] PSF: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T20:42:56.808391] [INFO ] [REMOTE    ] PSF: Full fetch complete (9615 records).
[2025-10-24T20:42:56.808464] [DEBUG] [VALIDATOR ] PSF: Validating primary data.
[2025-10-24T20:42:56.808910] [FATAL] [VALIDATOR ] PSF: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:42:56.809031] [FATAL] [MAIN      ] PSF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:42:56.809114] [WARN ] [MAIN      ] PSF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:42:56.809192] [INFO ] [LOCAL     ] PSF: Starting deletion of primary data.
[2025-10-24T20:42:56.809254] [DEBUG] [LOCAL     ] PSF: No primary data file found to delete.
[2025-10-24T20:42:56.809289] [INFO ] [LOCAL     ] PSF: Starting deletion of derivative data.
[2025-10-24T20:42:56.809438] [DEBUG] [LOCAL     ] PSF: Deleted derivative data file.
[2025-10-24T20:42:56.809508] [INFO ] [MAIN      ] Update Progress: 1734/2366 symbols completed. PSF took 36.2s. Estimated remaining: 1h 21m 14s. Rate: 7.8 symbols/min
[2025-10-24T20:42:56.957631] [INFO ] [REMOTE    ] PSFE: Fetching primary data for 2025-10.
[2025-10-24T20:42:56.983435] [INFO ] [MAIN      ] PSQH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:42:57.018195] [DEBUG] [LOCAL     ] PSQH: Loaded 35712 existing records from primary storage.
[2025-10-24T20:42:57.018458] [INFO ] [MAIN      ] PSQH: Loaded 35712 existing records.
[2025-10-24T20:42:57.195570] [WARN ] [MAIN      ] PSQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:42:57.195783] [INFO ] [MAIN      ] PSQH: Wiping existing primary data before full refresh.
[2025-10-24T20:42:57.195830] [INFO ] [LOCAL     ] PSQH: Starting deletion of primary data.
[2025-10-24T20:42:57.196246] [DEBUG] [LOCAL     ] PSQH: Deleted primary data file.
[2025-10-24T20:42:57.196301] [INFO ] [MAIN      ] PSQH: Starting full primary refresh.
[2025-10-24T20:42:57.516607] [INFO ] [REMOTE    ] PSFE: Incremental fetch complete for 2025-10 (0.56 seconds).
[2025-10-24T20:42:57.555809] [INFO ] [REMOTE    ] PSFE: Full fetch complete (42871 records).
[2025-10-24T20:42:57.575369] [DEBUG] [VALIDATOR ] PSFE: Validating primary data.
[2025-10-24T20:42:57.578950] [INFO ] [REMOTE    ] PSQH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:42:57.579986] [FATAL] [VALIDATOR ] PSFE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:42:57.580081] [FATAL] [MAIN      ] PSFE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:42:57.580125] [WARN ] [MAIN      ] PSFE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:42:57.580191] [INFO ] [LOCAL     ] PSFE: Starting deletion of primary data.
[2025-10-24T20:42:57.580257] [DEBUG] [LOCAL     ] PSFE: No primary data file found to delete.
[2025-10-24T20:42:57.580293] [INFO ] [LOCAL     ] PSFE: Starting deletion of derivative data.
[2025-10-24T20:42:57.580446] [DEBUG] [LOCAL     ] PSFE: Deleted derivative data file.
[2025-10-24T20:42:57.580524] [INFO ] [MAIN      ] Update Progress: 1735/2366 symbols completed. PSFE took 30.8s. Estimated remaining: 1h 21m 4s. Rate: 7.8 symbols/min
[2025-10-24T20:42:57.747366] [INFO ] [MAIN      ] PSTG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:42:57.747951] [INFO ] [REMOTE    ] PSQH: Fetching primary data for 2025-01.
[2025-10-24T20:42:57.797790] [DEBUG] [LOCAL     ] PSTG: Loaded 53212 existing records from primary storage.
[2025-10-24T20:42:57.798106] [INFO ] [MAIN      ] PSTG: Loaded 53212 existing records.
[2025-10-24T20:42:57.973493] [WARN ] [MAIN      ] PSTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:42:57.974255] [INFO ] [MAIN      ] PSTG: Wiping existing primary data before full refresh.
[2025-10-24T20:42:57.974305] [INFO ] [LOCAL     ] PSTG: Starting deletion of primary data.
[2025-10-24T20:42:57.974738] [DEBUG] [LOCAL     ] PSTG: Deleted primary data file.
[2025-10-24T20:42:57.974794] [INFO ] [MAIN      ] PSTG: Starting full primary refresh.
[2025-10-24T20:42:58.354944] [INFO ] [REMOTE    ] PSTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:42:58.473886] [INFO ] [REMOTE    ] PSQH: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T20:42:58.547699] [INFO ] [REMOTE    ] PSN: Fetching primary data for 2025-10.
[2025-10-24T20:42:59.347667] [INFO ] [REMOTE    ] PSO: Fetching primary data for 2025-03.
[2025-10-24T20:42:59.564978] [INFO ] [REMOTE    ] PSN: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T20:42:59.572632] [INFO ] [REMOTE    ] PSN: Full fetch complete (66473 records).
[2025-10-24T20:42:59.572812] [DEBUG] [VALIDATOR ] PSN: Validating primary data.
[2025-10-24T20:42:59.573449] [FATAL] [VALIDATOR ] PSN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:42:59.573534] [FATAL] [MAIN      ] PSN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:42:59.573579] [WARN ] [MAIN      ] PSN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:42:59.573619] [INFO ] [LOCAL     ] PSN: Starting deletion of primary data.
[2025-10-24T20:42:59.573718] [DEBUG] [LOCAL     ] PSN: No primary data file found to delete.
[2025-10-24T20:42:59.573768] [INFO ] [LOCAL     ] PSN: Starting deletion of derivative data.
[2025-10-24T20:42:59.573923] [DEBUG] [LOCAL     ] PSN: Deleted derivative data file.
[2025-10-24T20:42:59.573996] [INFO ] [MAIN      ] Update Progress: 1736/2366 symbols completed. PSN took 30.9s. Estimated remaining: 1h 20m 54s. Rate: 7.8 symbols/min
[2025-10-24T20:42:59.766989] [INFO ] [MAIN      ] PSTL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:42:59.787566] [DEBUG] [LOCAL     ] PSTL: Loaded 20000 existing records from primary storage.
[2025-10-24T20:42:59.787873] [INFO ] [MAIN      ] PSTL: Loaded 20000 existing records.
[2025-10-24T20:42:59.974250] [WARN ] [MAIN      ] PSTL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:42:59.974487] [INFO ] [MAIN      ] PSTL: Wiping existing primary data before full refresh.
[2025-10-24T20:42:59.974536] [INFO ] [LOCAL     ] PSTL: Starting deletion of primary data.
[2025-10-24T20:42:59.974829] [DEBUG] [LOCAL     ] PSTL: Deleted primary data file.
[2025-10-24T20:42:59.974886] [INFO ] [MAIN      ] PSTL: Starting full primary refresh.
[2025-10-24T20:43:00.151357] [INFO ] [REMOTE    ] PSTG: Fetching primary data for 2025-01.
[2025-10-24T20:43:00.335605] [INFO ] [REMOTE    ] PSTL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:43:00.507881] [INFO ] [REMOTE    ] PSO: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T20:43:00.947683] [INFO ] [REMOTE    ] PSO: Fetching primary data for 2025-04.
[2025-10-24T20:43:01.260123] [INFO ] [REMOTE    ] PSTG: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T20:43:01.703011] [INFO ] [REMOTE    ] PSO: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T20:43:01.747720] [INFO ] [REMOTE    ] PSTG: Fetching primary data for 2025-02.
[2025-10-24T20:43:02.547639] [INFO ] [REMOTE    ] PSTL: Fetching primary data for 2025-01.
[2025-10-24T20:43:02.861942] [INFO ] [REMOTE    ] PSTG: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T20:43:03.139263] [INFO ] [REMOTE    ] PSTL: Incremental fetch complete for 2025-01 (0.59 seconds).
[2025-10-24T20:43:03.347709] [INFO ] [REMOTE    ] PSTL: Fetching primary data for 2025-02.
[2025-10-24T20:43:04.147612] [INFO ] [REMOTE    ] PSQH: Fetching primary data for 2025-02.
[2025-10-24T20:43:04.522175] [INFO ] [REMOTE    ] PSTL: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T20:43:04.836250] [INFO ] [REMOTE    ] PSQH: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T20:43:04.947612] [INFO ] [REMOTE    ] PSQH: Fetching primary data for 2025-03.
[2025-10-24T20:43:05.747719] [INFO ] [REMOTE    ] PSTG: Fetching primary data for 2025-03.
[2025-10-24T20:43:05.956312] [INFO ] [REMOTE    ] PSQH: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T20:43:06.548534] [INFO ] [REMOTE    ] PSQH: Fetching primary data for 2025-04.
[2025-10-24T20:43:06.553956] [INFO ] [REMOTE    ] PSTG: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T20:43:07.236587] [INFO ] [REMOTE    ] PSQH: Incremental fetch complete for 2025-04 (0.69 seconds).
[2025-10-24T20:43:07.347635] [INFO ] [REMOTE    ] PSO: Fetching primary data for 2025-05.
[2025-10-24T20:43:08.147629] [INFO ] [REMOTE    ] PSTG: Fetching primary data for 2025-04.
[2025-10-24T20:43:08.344143] [INFO ] [REMOTE    ] PSO: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T20:43:08.947610] [INFO ] [REMOTE    ] PSQH: Fetching primary data for 2025-05.
[2025-10-24T20:43:09.421776] [INFO ] [REMOTE    ] PSTG: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T20:43:09.747682] [INFO ] [REMOTE    ] PSTL: Fetching primary data for 2025-03.
[2025-10-24T20:43:10.128539] [INFO ] [REMOTE    ] PSQH: Incremental fetch complete for 2025-05 (1.18 seconds).
[2025-10-24T20:43:10.345181] [INFO ] [REMOTE    ] PSTL: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T20:43:10.547618] [INFO ] [REMOTE    ] PSQH: Fetching primary data for 2025-06.
[2025-10-24T20:43:11.262437] [INFO ] [REMOTE    ] PSQH: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T20:43:11.347634] [INFO ] [REMOTE    ] PSTG: Fetching primary data for 2025-05.
[2025-10-24T20:43:12.152796] [INFO ] [REMOTE    ] PSQH: Fetching primary data for 2025-07.
[2025-10-24T20:43:12.166079] [INFO ] [REMOTE    ] PSTG: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T20:43:12.947680] [INFO ] [REMOTE    ] PSTG: Fetching primary data for 2025-06.
[2025-10-24T20:43:13.100440] [INFO ] [REMOTE    ] PSQH: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T20:43:13.747612] [INFO ] [REMOTE    ] PSO: Fetching primary data for 2025-06.
[2025-10-24T20:43:14.241782] [INFO ] [REMOTE    ] PSTG: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T20:43:14.547689] [INFO ] [REMOTE    ] PSTL: Fetching primary data for 2025-04.
[2025-10-24T20:43:14.737399] [INFO ] [REMOTE    ] PSO: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T20:43:15.347713] [INFO ] [REMOTE    ] PSO: Fetching primary data for 2025-07.
[2025-10-24T20:43:15.516453] [INFO ] [REMOTE    ] PSTL: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T20:43:16.147705] [INFO ] [REMOTE    ] PSQH: Fetching primary data for 2025-08.
[2025-10-24T20:43:16.834385] [INFO ] [REMOTE    ] PSQH: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T20:43:16.947724] [INFO ] [REMOTE    ] PSTL: Fetching primary data for 2025-05.
[2025-10-24T20:43:17.070913] [INFO ] [REMOTE    ] PSO: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T20:43:17.747719] [INFO ] [REMOTE    ] PSTG: Fetching primary data for 2025-07.
[2025-10-24T20:43:17.859609] [INFO ] [REMOTE    ] PSTL: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T20:43:18.547677] [INFO ] [REMOTE    ] PSQH: Fetching primary data for 2025-09.
[2025-10-24T20:43:18.930487] [INFO ] [REMOTE    ] PSTG: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T20:43:19.347626] [INFO ] [REMOTE    ] PSTG: Fetching primary data for 2025-08.
[2025-10-24T20:43:19.571557] [INFO ] [REMOTE    ] PSQH: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T20:43:20.147703] [INFO ] [REMOTE    ] PSQH: Fetching primary data for 2025-10.
[2025-10-24T20:43:20.470681] [INFO ] [REMOTE    ] PSTG: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T20:43:20.531592] [INFO ] [REMOTE    ] PSQH: Incremental fetch complete for 2025-10 (0.38 seconds).
[2025-10-24T20:43:20.539445] [INFO ] [REMOTE    ] PSQH: Full fetch complete (52989 records).
[2025-10-24T20:43:20.539626] [DEBUG] [VALIDATOR ] PSQH: Validating primary data.
[2025-10-24T20:43:20.540450] [FATAL] [VALIDATOR ] PSQH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:43:20.540540] [FATAL] [MAIN      ] PSQH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:43:20.540583] [WARN ] [MAIN      ] PSQH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:43:20.540673] [INFO ] [LOCAL     ] PSQH: Starting deletion of primary data.
[2025-10-24T20:43:20.540756] [DEBUG] [LOCAL     ] PSQH: No primary data file found to delete.
[2025-10-24T20:43:20.540792] [INFO ] [LOCAL     ] PSQH: Starting deletion of derivative data.
[2025-10-24T20:43:20.540954] [DEBUG] [LOCAL     ] PSQH: Deleted derivative data file.
[2025-10-24T20:43:20.541044] [INFO ] [MAIN      ] Update Progress: 1737/2366 symbols completed. PSQH took 23.7s. Estimated remaining: 1h 20m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:43:20.715431] [INFO ] [MAIN      ] PSX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:43:20.768880] [DEBUG] [LOCAL     ] PSX: Loaded 53511 existing records from primary storage.
[2025-10-24T20:43:20.769230] [INFO ] [MAIN      ] PSX: Loaded 53511 existing records.
[2025-10-24T20:43:20.945179] [WARN ] [MAIN      ] PSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:43:20.945401] [INFO ] [MAIN      ] PSX: Wiping existing primary data before full refresh.
[2025-10-24T20:43:20.945447] [INFO ] [LOCAL     ] PSX: Starting deletion of primary data.
[2025-10-24T20:43:20.946368] [DEBUG] [LOCAL     ] PSX: Deleted primary data file.
[2025-10-24T20:43:20.946428] [INFO ] [MAIN      ] PSX: Starting full primary refresh.
[2025-10-24T20:43:20.957448] [INFO ] [REMOTE    ] PSTL: Fetching primary data for 2025-06.
[2025-10-24T20:43:21.303996] [INFO ] [REMOTE    ] PSX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:43:21.616969] [INFO ] [REMOTE    ] PSTL: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T20:43:21.747628] [INFO ] [REMOTE    ] PSTL: Fetching primary data for 2025-07.
[2025-10-24T20:43:22.547689] [INFO ] [REMOTE    ] PSX: Fetching primary data for 2025-01.
[2025-10-24T20:43:22.599213] [INFO ] [REMOTE    ] PSTL: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T20:43:23.312454] [INFO ] [REMOTE    ] PSX: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T20:43:23.347599] [INFO ] [REMOTE    ] PSX: Fetching primary data for 2025-02.
[2025-10-24T20:43:24.156617] [INFO ] [REMOTE    ] PSTL: Fetching primary data for 2025-08.
[2025-10-24T20:43:24.183249] [INFO ] [REMOTE    ] PSX: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T20:43:24.755459] [INFO ] [REMOTE    ] PSTL: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T20:43:24.947688] [INFO ] [REMOTE    ] PSO: Fetching primary data for 2025-08.
[2025-10-24T20:43:25.747721] [INFO ] [REMOTE    ] PSX: Fetching primary data for 2025-03.
[2025-10-24T20:43:26.554463] [INFO ] [REMOTE    ] PSTL: Fetching primary data for 2025-09.
[2025-10-24T20:43:26.574458] [INFO ] [REMOTE    ] PSX: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T20:43:26.884417] [INFO ] [REMOTE    ] PSO: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T20:43:27.347720] [INFO ] [REMOTE    ] PSTG: Fetching primary data for 2025-09.
[2025-10-24T20:43:27.639464] [INFO ] [REMOTE    ] PSTL: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T20:43:28.147713] [INFO ] [REMOTE    ] PSX: Fetching primary data for 2025-04.
[2025-10-24T20:43:28.781012] [INFO ] [REMOTE    ] PSTG: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T20:43:28.953244] [INFO ] [REMOTE    ] PSTG: Fetching primary data for 2025-10.
[2025-10-24T20:43:28.975892] [INFO ] [REMOTE    ] PSX: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T20:43:29.716558] [INFO ] [REMOTE    ] PSTG: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T20:43:29.726052] [INFO ] [REMOTE    ] PSTG: Full fetch complete (76312 records).
[2025-10-24T20:43:29.726189] [DEBUG] [VALIDATOR ] PSTG: Validating primary data.
[2025-10-24T20:43:29.726933] [FATAL] [VALIDATOR ] PSTG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:43:29.727016] [FATAL] [MAIN      ] PSTG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:43:29.727059] [WARN ] [MAIN      ] PSTG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:43:29.727099] [INFO ] [LOCAL     ] PSTG: Starting deletion of primary data.
[2025-10-24T20:43:29.727156] [DEBUG] [LOCAL     ] PSTG: No primary data file found to delete.
[2025-10-24T20:43:29.727192] [INFO ] [LOCAL     ] PSTG: Starting deletion of derivative data.
[2025-10-24T20:43:29.727373] [DEBUG] [LOCAL     ] PSTG: Deleted derivative data file.
[2025-10-24T20:43:29.727734] [INFO ] [MAIN      ] Update Progress: 1738/2366 symbols completed. PSTG took 32.1s. Estimated remaining: 1h 20m 44s. Rate: 7.8 symbols/min
[2025-10-24T20:43:29.757761] [INFO ] [REMOTE    ] PSX: Fetching primary data for 2025-05.
[2025-10-24T20:43:29.902208] [INFO ] [MAIN      ] PTA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:43:29.902388] [DEBUG] [LOCAL     ] PTA: No existing data file found in primary storage.
[2025-10-24T20:43:29.902424] [WARN ] [MAIN      ] PTA: No existing data found, performing full refresh instead.
[2025-10-24T20:43:29.902537] [INFO ] [MAIN      ] PTA: Wiping existing primary data before full refresh.
[2025-10-24T20:43:29.902578] [INFO ] [LOCAL     ] PTA: Starting deletion of primary data.
[2025-10-24T20:43:29.902618] [DEBUG] [LOCAL     ] PTA: No primary data file found to delete.
[2025-10-24T20:43:29.902677] [INFO ] [MAIN      ] PTA: Starting full primary refresh.
[2025-10-24T20:43:30.335480] [INFO ] [REMOTE    ] PTA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:43:30.547720] [INFO ] [REMOTE    ] PSO: Fetching primary data for 2025-09.
[2025-10-24T20:43:31.004387] [INFO ] [REMOTE    ] PSX: Incremental fetch complete for 2025-05 (1.25 seconds).
[2025-10-24T20:43:31.347625] [INFO ] [REMOTE    ] PSX: Fetching primary data for 2025-06.
[2025-10-24T20:43:31.571293] [INFO ] [REMOTE    ] PSO: Incremental fetch complete for 2025-09 (1.02 seconds).
[2025-10-24T20:43:32.147634] [INFO ] [REMOTE    ] PTA: Fetching primary data for 2025-01.
[2025-10-24T20:43:32.268356] [INFO ] [REMOTE    ] PSX: Incremental fetch complete for 2025-06 (0.92 seconds).
[2025-10-24T20:43:32.947672] [INFO ] [REMOTE    ] PSX: Fetching primary data for 2025-07.
[2025-10-24T20:43:33.302324] [INFO ] [REMOTE    ] PTA: Incremental fetch complete for 2025-01 (1.15 seconds).
[2025-10-24T20:43:33.747632] [INFO ] [REMOTE    ] PTA: Fetching primary data for 2025-02.
[2025-10-24T20:43:34.103408] [INFO ] [REMOTE    ] PSX: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T20:43:34.229529] [INFO ] [REMOTE    ] PTA: Incremental fetch complete for 2025-02 (0.48 seconds).
[2025-10-24T20:43:34.547678] [INFO ] [REMOTE    ] PSTL: Fetching primary data for 2025-10.
[2025-10-24T20:43:35.347703] [INFO ] [REMOTE    ] PTA: Fetching primary data for 2025-03.
[2025-10-24T20:43:35.659637] [INFO ] [REMOTE    ] PSTL: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T20:43:35.663401] [INFO ] [REMOTE    ] PSTL: Full fetch complete (29206 records).
[2025-10-24T20:43:35.663524] [DEBUG] [VALIDATOR ] PSTL: Validating primary data.
[2025-10-24T20:43:35.664089] [FATAL] [VALIDATOR ] PSTL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:43:35.664172] [FATAL] [MAIN      ] PSTL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:43:35.664214] [WARN ] [MAIN      ] PSTL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:43:35.664278] [INFO ] [LOCAL     ] PSTL: Starting deletion of primary data.
[2025-10-24T20:43:35.664344] [DEBUG] [LOCAL     ] PSTL: No primary data file found to delete.
[2025-10-24T20:43:35.664380] [INFO ] [LOCAL     ] PSTL: Starting deletion of derivative data.
[2025-10-24T20:43:35.664533] [DEBUG] [LOCAL     ] PSTL: Deleted derivative data file.
[2025-10-24T20:43:35.664606] [INFO ] [MAIN      ] Update Progress: 1739/2366 symbols completed. PSTL took 36.1s. Estimated remaining: 1h 20m 36s. Rate: 7.8 symbols/min
[2025-10-24T20:43:35.838905] [INFO ] [MAIN      ] PTY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:43:35.877805] [DEBUG] [LOCAL     ] PTY: Loaded 38196 existing records from primary storage.
[2025-10-24T20:43:35.878139] [INFO ] [MAIN      ] PTY: Loaded 38196 existing records.
[2025-10-24T20:43:36.008426] [INFO ] [REMOTE    ] PTA: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T20:43:36.078932] [WARN ] [MAIN      ] PTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:43:36.079169] [INFO ] [MAIN      ] PTY: Wiping existing primary data before full refresh.
[2025-10-24T20:43:36.079219] [INFO ] [LOCAL     ] PTY: Starting deletion of primary data.
[2025-10-24T20:43:36.079588] [DEBUG] [LOCAL     ] PTY: Deleted primary data file.
[2025-10-24T20:43:36.079628] [INFO ] [MAIN      ] PTY: Starting full primary refresh.
[2025-10-24T20:43:36.152784] [INFO ] [REMOTE    ] PSX: Fetching primary data for 2025-08.
[2025-10-24T20:43:36.440521] [INFO ] [REMOTE    ] PTY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:43:36.947727] [INFO ] [REMOTE    ] PTY: Fetching primary data for 2025-01.
[2025-10-24T20:43:37.627586] [INFO ] [REMOTE    ] PSX: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T20:43:37.747635] [INFO ] [REMOTE    ] PSX: Fetching primary data for 2025-09.
[2025-10-24T20:43:37.935928] [INFO ] [REMOTE    ] PTY: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T20:43:38.147238] [INFO ] [REMOTE    ] PSX: Incremental fetch complete for 2025-09 (0.40 seconds).
[2025-10-24T20:43:38.547724] [INFO ] [REMOTE    ] PTA: Fetching primary data for 2025-04.
[2025-10-24T20:43:39.347613] [INFO ] [REMOTE    ] PSO: Fetching primary data for 2025-10.
[2025-10-24T20:43:39.554689] [INFO ] [REMOTE    ] PTA: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T20:43:40.147681] [INFO ] [REMOTE    ] PTA: Fetching primary data for 2025-05.
[2025-10-24T20:43:40.251279] [INFO ] [REMOTE    ] PSO: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T20:43:40.258266] [INFO ] [REMOTE    ] PSO: Full fetch complete (52577 records).
[2025-10-24T20:43:40.258433] [DEBUG] [VALIDATOR ] PSO: Validating primary data.
[2025-10-24T20:43:40.259185] [FATAL] [VALIDATOR ] PSO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:43:40.259280] [FATAL] [MAIN      ] PSO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:43:40.259350] [WARN ] [MAIN      ] PSO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:43:40.259453] [INFO ] [LOCAL     ] PSO: Starting deletion of primary data.
[2025-10-24T20:43:40.259531] [DEBUG] [LOCAL     ] PSO: No primary data file found to delete.
[2025-10-24T20:43:40.259582] [INFO ] [LOCAL     ] PSO: Starting deletion of derivative data.
[2025-10-24T20:43:40.259781] [DEBUG] [LOCAL     ] PSO: Deleted derivative data file.
[2025-10-24T20:43:40.259892] [INFO ] [MAIN      ] Update Progress: 1740/2366 symbols completed. PSO took 52.4s. Estimated remaining: 1h 20m 27s. Rate: 7.8 symbols/min
[2025-10-24T20:43:40.431680] [INFO ] [MAIN      ] PUK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:43:40.472763] [DEBUG] [LOCAL     ] PUK: Loaded 44662 existing records from primary storage.
[2025-10-24T20:43:40.473054] [INFO ] [MAIN      ] PUK: Loaded 44662 existing records.
[2025-10-24T20:43:40.657835] [WARN ] [MAIN      ] PUK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:43:40.658130] [INFO ] [MAIN      ] PUK: Wiping existing primary data before full refresh.
[2025-10-24T20:43:40.658185] [INFO ] [LOCAL     ] PUK: Starting deletion of primary data.
[2025-10-24T20:43:40.658621] [DEBUG] [LOCAL     ] PUK: Deleted primary data file.
[2025-10-24T20:43:40.658713] [INFO ] [MAIN      ] PUK: Starting full primary refresh.
[2025-10-24T20:43:40.952870] [INFO ] [REMOTE    ] PTY: Fetching primary data for 2025-02.
[2025-10-24T20:43:41.005268] [INFO ] [REMOTE    ] PTA: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T20:43:41.035703] [INFO ] [REMOTE    ] PUK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:43:41.731407] [INFO ] [REMOTE    ] PTY: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T20:43:41.747609] [INFO ] [REMOTE    ] PTA: Fetching primary data for 2025-06.
[2025-10-24T20:43:42.547676] [INFO ] [REMOTE    ] PSX: Fetching primary data for 2025-10.
[2025-10-24T20:43:42.901782] [INFO ] [REMOTE    ] PTA: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T20:43:43.333186] [INFO ] [REMOTE    ] PSX: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T20:43:43.342316] [INFO ] [REMOTE    ] PSX: Full fetch complete (76748 records).
[2025-10-24T20:43:43.342443] [DEBUG] [VALIDATOR ] PSX: Validating primary data.
[2025-10-24T20:43:43.343192] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:43:43.343281] [FATAL] [MAIN      ] PSX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:43:43.343323] [WARN ] [MAIN      ] PSX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:43:43.343384] [INFO ] [LOCAL     ] PSX: Starting deletion of primary data.
[2025-10-24T20:43:43.343446] [DEBUG] [LOCAL     ] PSX: No primary data file found to delete.
[2025-10-24T20:43:43.343481] [INFO ] [LOCAL     ] PSX: Starting deletion of derivative data.
[2025-10-24T20:43:43.343623] [DEBUG] [LOCAL     ] PSX: Deleted derivative data file.
[2025-10-24T20:43:43.343997] [INFO ] [MAIN      ] Update Progress: 1741/2366 symbols completed. PSX took 22.8s. Estimated remaining: 1h 20m 18s. Rate: 7.8 symbols/min
[2025-10-24T20:43:43.354213] [INFO ] [REMOTE    ] PTY: Fetching primary data for 2025-03.
[2025-10-24T20:43:43.514148] [INFO ] [MAIN      ] PUMP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:43:43.559225] [DEBUG] [LOCAL     ] PUMP: Loaded 49808 existing records from primary storage.
[2025-10-24T20:43:43.559538] [INFO ] [MAIN      ] PUMP: Loaded 49808 existing records.
[2025-10-24T20:43:43.744838] [WARN ] [MAIN      ] PUMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:43:43.745021] [INFO ] [MAIN      ] PUMP: Wiping existing primary data before full refresh.
[2025-10-24T20:43:43.745087] [INFO ] [LOCAL     ] PUMP: Starting deletion of primary data.
[2025-10-24T20:43:43.745417] [DEBUG] [LOCAL     ] PUMP: Deleted primary data file.
[2025-10-24T20:43:43.745454] [INFO ] [MAIN      ] PUMP: Starting full primary refresh.
[2025-10-24T20:43:44.108195] [INFO ] [REMOTE    ] PUMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:43:44.129110] [INFO ] [REMOTE    ] PTY: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T20:43:44.147624] [INFO ] [REMOTE    ] PTY: Fetching primary data for 2025-04.
[2025-10-24T20:43:44.947620] [INFO ] [REMOTE    ] PTA: Fetching primary data for 2025-07.
[2025-10-24T20:43:45.214808] [INFO ] [REMOTE    ] PTY: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T20:43:45.747674] [INFO ] [REMOTE    ] PUK: Fetching primary data for 2025-01.
[2025-10-24T20:43:45.996998] [INFO ] [REMOTE    ] PTA: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T20:43:46.517979] [INFO ] [REMOTE    ] PUK: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T20:43:46.547625] [INFO ] [REMOTE    ] PUK: Fetching primary data for 2025-02.
[2025-10-24T20:43:47.347712] [INFO ] [REMOTE    ] PTY: Fetching primary data for 2025-05.
[2025-10-24T20:43:47.683183] [INFO ] [REMOTE    ] PUK: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T20:43:48.147760] [INFO ] [REMOTE    ] PUK: Fetching primary data for 2025-03.
[2025-10-24T20:43:48.439951] [INFO ] [REMOTE    ] PTY: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T20:43:48.947724] [INFO ] [REMOTE    ] PTY: Fetching primary data for 2025-06.
[2025-10-24T20:43:48.999279] [INFO ] [REMOTE    ] PUK: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T20:43:49.747634] [INFO ] [REMOTE    ] PUK: Fetching primary data for 2025-04.
[2025-10-24T20:43:49.945429] [INFO ] [REMOTE    ] PTY: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T20:43:50.547620] [INFO ] [REMOTE    ] PTY: Fetching primary data for 2025-07.
[2025-10-24T20:43:51.011913] [INFO ] [REMOTE    ] PUK: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T20:43:51.253027] [INFO ] [REMOTE    ] PTY: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T20:43:51.347690] [INFO ] [REMOTE    ] PUMP: Fetching primary data for 2025-01.
[2025-10-24T20:43:52.153068] [INFO ] [REMOTE    ] PTA: Fetching primary data for 2025-08.
[2025-10-24T20:43:52.167667] [INFO ] [REMOTE    ] PUMP: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T20:43:52.947680] [INFO ] [REMOTE    ] PUK: Fetching primary data for 2025-05.
[2025-10-24T20:43:53.200726] [INFO ] [REMOTE    ] PTA: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T20:43:53.739982] [INFO ] [REMOTE    ] PUK: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T20:43:53.748971] [INFO ] [REMOTE    ] PTY: Fetching primary data for 2025-08.
[2025-10-24T20:43:54.263781] [INFO ] [REMOTE    ] PTY: Incremental fetch complete for 2025-08 (0.51 seconds).
[2025-10-24T20:43:54.547634] [INFO ] [REMOTE    ] PUK: Fetching primary data for 2025-06.
[2025-10-24T20:43:55.303764] [INFO ] [REMOTE    ] PUK: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T20:43:55.347685] [INFO ] [REMOTE    ] PUK: Fetching primary data for 2025-07.
[2025-10-24T20:43:56.147727] [INFO ] [REMOTE    ] PTY: Fetching primary data for 2025-09.
[2025-10-24T20:43:56.700708] [INFO ] [REMOTE    ] PUK: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T20:43:56.900709] [INFO ] [REMOTE    ] PTY: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T20:43:56.947703] [INFO ] [REMOTE    ] PUK: Fetching primary data for 2025-08.
[2025-10-24T20:43:57.677330] [INFO ] [REMOTE    ] PUK: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T20:43:57.747729] [INFO ] [REMOTE    ] PTA: Fetching primary data for 2025-09.
[2025-10-24T20:43:57.857916] [DEBUG] [REMOTE    ] PTA: Error fetching primary data for 2025-09: 'API call returned an empty response.'
[2025-10-24T20:43:57.858374] [WARN ] [REMOTE    ] PTA: No data returned for month 2025-09
[2025-10-24T20:43:57.858472] [FATAL] [REMOTE    ] PTA: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:43:57.858570] [FATAL] [MAIN      ] PTA: Failed to fetch primary data.
[2025-10-24T20:43:57.858635] [WARN ] [MAIN      ] PTA: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:43:57.858761] [INFO ] [LOCAL     ] PTA: Starting deletion of primary data.
[2025-10-24T20:43:57.858848] [DEBUG] [LOCAL     ] PTA: No primary data file found to delete.
[2025-10-24T20:43:57.858887] [INFO ] [LOCAL     ] PTA: Starting deletion of derivative data.
[2025-10-24T20:43:57.858927] [DEBUG] [LOCAL     ] PTA: No derivative data file found to delete.
[2025-10-24T20:43:57.858977] [INFO ] [MAIN      ] Update Progress: 1742/2366 symbols completed. PTA took 28.1s. Estimated remaining: 1h 20m 13s. Rate: 7.8 symbols/min
[2025-10-24T20:43:58.034257] [INFO ] [MAIN      ] PVH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:43:58.085533] [DEBUG] [LOCAL     ] PVH: Loaded 49778 existing records from primary storage.
[2025-10-24T20:43:58.085993] [INFO ] [MAIN      ] PVH: Loaded 49778 existing records.
[2025-10-24T20:43:58.272293] [WARN ] [MAIN      ] PVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:43:58.272604] [INFO ] [MAIN      ] PVH: Wiping existing primary data before full refresh.
[2025-10-24T20:43:58.272687] [INFO ] [LOCAL     ] PVH: Starting deletion of primary data.
[2025-10-24T20:43:58.273187] [DEBUG] [LOCAL     ] PVH: Deleted primary data file.
[2025-10-24T20:43:58.273232] [INFO ] [MAIN      ] PVH: Starting full primary refresh.
[2025-10-24T20:43:58.552991] [INFO ] [REMOTE    ] PUK: Fetching primary data for 2025-09.
[2025-10-24T20:43:58.658253] [INFO ] [REMOTE    ] PVH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:43:59.321774] [INFO ] [REMOTE    ] PUK: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T20:43:59.347605] [INFO ] [REMOTE    ] PUK: Fetching primary data for 2025-10.
[2025-10-24T20:44:00.114405] [INFO ] [REMOTE    ] PUK: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T20:44:00.123006] [INFO ] [REMOTE    ] PUK: Full fetch complete (64961 records).
[2025-10-24T20:44:00.123192] [DEBUG] [VALIDATOR ] PUK: Validating primary data.
[2025-10-24T20:44:00.124224] [FATAL] [VALIDATOR ] PUK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:44:00.124337] [FATAL] [MAIN      ] PUK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:44:00.124382] [WARN ] [MAIN      ] PUK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:44:00.124423] [INFO ] [LOCAL     ] PUK: Starting deletion of primary data.
[2025-10-24T20:44:00.124488] [DEBUG] [LOCAL     ] PUK: No primary data file found to delete.
[2025-10-24T20:44:00.124526] [INFO ] [LOCAL     ] PUK: Starting deletion of derivative data.
[2025-10-24T20:44:00.124788] [DEBUG] [LOCAL     ] PUK: Deleted derivative data file.
[2025-10-24T20:44:00.125595] [INFO ] [MAIN      ] Update Progress: 1743/2366 symbols completed. PUK took 19.9s. Estimated remaining: 1h 20m 3s. Rate: 7.8 symbols/min
[2025-10-24T20:44:00.156134] [INFO ] [REMOTE    ] PVH: Fetching primary data for 2025-01.
[2025-10-24T20:44:00.307774] [INFO ] [MAIN      ] PVL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:44:00.316783] [DEBUG] [LOCAL     ] PVL: Loaded 4774 existing records from primary storage.
[2025-10-24T20:44:00.317094] [INFO ] [MAIN      ] PVL: Loaded 4774 existing records.
[2025-10-24T20:44:00.509370] [WARN ] [MAIN      ] PVL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:44:00.509743] [INFO ] [MAIN      ] PVL: Wiping existing primary data before full refresh.
[2025-10-24T20:44:00.509805] [INFO ] [LOCAL     ] PVL: Starting deletion of primary data.
[2025-10-24T20:44:00.510025] [DEBUG] [LOCAL     ] PVL: Deleted primary data file.
[2025-10-24T20:44:00.510086] [INFO ] [MAIN      ] PVL: Starting full primary refresh.
[2025-10-24T20:44:00.894249] [INFO ] [REMOTE    ] PVL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:44:00.947710] [INFO ] [REMOTE    ] PTY: Fetching primary data for 2025-10.
[2025-10-24T20:44:01.040343] [INFO ] [REMOTE    ] PVH: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T20:44:01.648297] [INFO ] [REMOTE    ] PTY: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T20:44:01.655833] [INFO ] [REMOTE    ] PTY: Full fetch complete (54325 records).
[2025-10-24T20:44:01.655954] [DEBUG] [VALIDATOR ] PTY: Validating primary data.
[2025-10-24T20:44:01.656515] [FATAL] [VALIDATOR ] PTY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:44:01.656597] [FATAL] [MAIN      ] PTY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:44:01.656678] [WARN ] [MAIN      ] PTY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:44:01.656764] [INFO ] [LOCAL     ] PTY: Starting deletion of primary data.
[2025-10-24T20:44:01.656844] [DEBUG] [LOCAL     ] PTY: No primary data file found to delete.
[2025-10-24T20:44:01.656894] [INFO ] [LOCAL     ] PTY: Starting deletion of derivative data.
[2025-10-24T20:44:01.657104] [DEBUG] [LOCAL     ] PTY: Deleted derivative data file.
[2025-10-24T20:44:01.657218] [INFO ] [MAIN      ] Update Progress: 1744/2366 symbols completed. PTY took 26.0s. Estimated remaining: 1h 19m 53s. Rate: 7.8 symbols/min
[2025-10-24T20:44:01.752946] [INFO ] [REMOTE    ] PVL: Fetching primary data for 2025-01.
[2025-10-24T20:44:01.835272] [INFO ] [MAIN      ] PWR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:44:01.877948] [DEBUG] [LOCAL     ] PWR: Loaded 46797 existing records from primary storage.
[2025-10-24T20:44:01.878253] [INFO ] [MAIN      ] PWR: Loaded 46797 existing records.
[2025-10-24T20:44:02.055481] [WARN ] [MAIN      ] PWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:44:02.055767] [INFO ] [MAIN      ] PWR: Wiping existing primary data before full refresh.
[2025-10-24T20:44:02.055843] [INFO ] [LOCAL     ] PWR: Starting deletion of primary data.
[2025-10-24T20:44:02.056123] [DEBUG] [LOCAL     ] PWR: Deleted primary data file.
[2025-10-24T20:44:02.056165] [INFO ] [MAIN      ] PWR: Starting full primary refresh.
[2025-10-24T20:44:02.419612] [INFO ] [REMOTE    ] PWR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:44:02.432325] [INFO ] [REMOTE    ] PVL: Incremental fetch complete for 2025-01 (0.68 seconds).
[2025-10-24T20:44:02.547702] [INFO ] [REMOTE    ] PWR: Fetching primary data for 2025-01.
[2025-10-24T20:44:03.347627] [INFO ] [REMOTE    ] PVH: Fetching primary data for 2025-02.
[2025-10-24T20:44:03.383298] [INFO ] [REMOTE    ] PWR: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T20:44:04.154397] [INFO ] [REMOTE    ] PUMP: Fetching primary data for 2025-02.
[2025-10-24T20:44:04.170475] [INFO ] [REMOTE    ] PVH: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T20:44:04.947630] [INFO ] [REMOTE    ] PWR: Fetching primary data for 2025-02.
[2025-10-24T20:44:05.151970] [INFO ] [REMOTE    ] PUMP: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T20:44:05.711274] [INFO ] [REMOTE    ] PWR: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T20:44:05.747689] [INFO ] [REMOTE    ] PUMP: Fetching primary data for 2025-03.
[2025-10-24T20:44:06.547614] [INFO ] [REMOTE    ] PWR: Fetching primary data for 2025-03.
[2025-10-24T20:44:06.880158] [INFO ] [REMOTE    ] PUMP: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T20:44:07.347694] [INFO ] [REMOTE    ] PVH: Fetching primary data for 2025-03.
[2025-10-24T20:44:07.563045] [INFO ] [REMOTE    ] PWR: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T20:44:08.138620] [INFO ] [REMOTE    ] PVH: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T20:44:08.148374] [INFO ] [REMOTE    ] PWR: Fetching primary data for 2025-04.
[2025-10-24T20:44:08.947634] [INFO ] [REMOTE    ] PVL: Fetching primary data for 2025-02.
[2025-10-24T20:44:09.315245] [INFO ] [REMOTE    ] PVL: Incremental fetch complete for 2025-02 (0.37 seconds).
[2025-10-24T20:44:09.380596] [INFO ] [REMOTE    ] PWR: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T20:44:09.747681] [INFO ] [REMOTE    ] PUMP: Fetching primary data for 2025-04.
[2025-10-24T20:44:10.547619] [INFO ] [REMOTE    ] PVH: Fetching primary data for 2025-04.
[2025-10-24T20:44:10.845089] [INFO ] [REMOTE    ] PUMP: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T20:44:11.328602] [INFO ] [REMOTE    ] PVH: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:44:11.347604] [INFO ] [REMOTE    ] PVH: Fetching primary data for 2025-05.
[2025-10-24T20:44:12.156162] [INFO ] [REMOTE    ] PWR: Fetching primary data for 2025-05.
[2025-10-24T20:44:12.177383] [INFO ] [REMOTE    ] PVH: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T20:44:12.947714] [INFO ] [REMOTE    ] PUMP: Fetching primary data for 2025-05.
[2025-10-24T20:44:13.040594] [INFO ] [REMOTE    ] PWR: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T20:44:13.262865] [INFO ] [REMOTE    ] PUMP: Incremental fetch complete for 2025-05 (0.32 seconds).
[2025-10-24T20:44:13.747681] [INFO ] [REMOTE    ] PVH: Fetching primary data for 2025-06.
[2025-10-24T20:44:14.547615] [INFO ] [REMOTE    ] PUMP: Fetching primary data for 2025-06.
[2025-10-24T20:44:14.621426] [INFO ] [REMOTE    ] PVH: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T20:44:15.347604] [INFO ] [REMOTE    ] PWR: Fetching primary data for 2025-06.
[2025-10-24T20:44:15.538997] [INFO ] [REMOTE    ] PUMP: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T20:44:16.147710] [INFO ] [REMOTE    ] PUMP: Fetching primary data for 2025-07.
[2025-10-24T20:44:16.242997] [INFO ] [REMOTE    ] PWR: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T20:44:16.509502] [INFO ] [REMOTE    ] PUMP: Incremental fetch complete for 2025-07 (0.36 seconds).
[2025-10-24T20:44:16.947630] [INFO ] [REMOTE    ] PVH: Fetching primary data for 2025-07.
[2025-10-24T20:44:17.747721] [INFO ] [REMOTE    ] PUMP: Fetching primary data for 2025-08.
[2025-10-24T20:44:18.526926] [INFO ] [REMOTE    ] PUMP: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T20:44:18.547664] [INFO ] [REMOTE    ] PVL: Fetching primary data for 2025-03.
[2025-10-24T20:44:18.928851] [INFO ] [REMOTE    ] PVL: Incremental fetch complete for 2025-03 (0.38 seconds).
[2025-10-24T20:44:19.347696] [INFO ] [REMOTE    ] PVL: Fetching primary data for 2025-04.
[2025-10-24T20:44:19.717381] [INFO ] [REMOTE    ] PVL: Incremental fetch complete for 2025-04 (0.37 seconds).
[2025-10-24T20:44:19.996953] [INFO ] [REMOTE    ] PVH: Incremental fetch complete for 2025-07 (3.05 seconds).
[2025-10-24T20:44:20.147611] [INFO ] [REMOTE    ] PVL: Fetching primary data for 2025-05.
[2025-10-24T20:44:20.848769] [INFO ] [REMOTE    ] PVL: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T20:44:20.947633] [INFO ] [REMOTE    ] PVL: Fetching primary data for 2025-06.
[2025-10-24T20:44:21.315559] [INFO ] [REMOTE    ] PVL: Incremental fetch complete for 2025-06 (0.37 seconds).
[2025-10-24T20:44:21.747631] [INFO ] [REMOTE    ] PVL: Fetching primary data for 2025-07.
[2025-10-24T20:44:22.108875] [INFO ] [REMOTE    ] PVL: Incremental fetch complete for 2025-07 (0.36 seconds).
[2025-10-24T20:44:22.547715] [INFO ] [REMOTE    ] PWR: Fetching primary data for 2025-07.
[2025-10-24T20:44:23.355235] [INFO ] [REMOTE    ] PVH: Fetching primary data for 2025-08.
[2025-10-24T20:44:23.358300] [INFO ] [REMOTE    ] PWR: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T20:44:24.147688] [INFO ] [REMOTE    ] PWR: Fetching primary data for 2025-08.
[2025-10-24T20:44:24.586273] [INFO ] [REMOTE    ] PVH: Incremental fetch complete for 2025-08 (1.23 seconds).
[2025-10-24T20:44:24.947708] [INFO ] [REMOTE    ] PVH: Fetching primary data for 2025-09.
[2025-10-24T20:44:25.150397] [INFO ] [REMOTE    ] PWR: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T20:44:25.685573] [INFO ] [REMOTE    ] PVH: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T20:44:25.747623] [INFO ] [REMOTE    ] PVH: Fetching primary data for 2025-10.
[2025-10-24T20:44:26.440783] [INFO ] [REMOTE    ] PVH: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T20:44:26.448330] [INFO ] [REMOTE    ] PVH: Full fetch complete (70536 records).
[2025-10-24T20:44:26.448448] [DEBUG] [VALIDATOR ] PVH: Validating primary data.
[2025-10-24T20:44:26.449235] [FATAL] [VALIDATOR ] PVH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:44:26.449322] [FATAL] [MAIN      ] PVH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:44:26.449370] [WARN ] [MAIN      ] PVH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:44:26.449455] [INFO ] [LOCAL     ] PVH: Starting deletion of primary data.
[2025-10-24T20:44:26.449562] [DEBUG] [LOCAL     ] PVH: No primary data file found to delete.
[2025-10-24T20:44:26.449629] [INFO ] [LOCAL     ] PVH: Starting deletion of derivative data.
[2025-10-24T20:44:26.449878] [DEBUG] [LOCAL     ] PVH: Deleted derivative data file.
[2025-10-24T20:44:26.450208] [INFO ] [MAIN      ] Update Progress: 1745/2366 symbols completed. PVH took 28.6s. Estimated remaining: 1h 19m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:44:26.552833] [INFO ] [REMOTE    ] PWR: Fetching primary data for 2025-09.
[2025-10-24T20:44:26.626466] [INFO ] [MAIN      ] PX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:44:26.661082] [DEBUG] [LOCAL     ] PX: Loaded 34132 existing records from primary storage.
[2025-10-24T20:44:26.661359] [INFO ] [MAIN      ] PX: Loaded 34132 existing records.
[2025-10-24T20:44:26.839664] [WARN ] [MAIN      ] PX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:44:26.839897] [INFO ] [MAIN      ] PX: Wiping existing primary data before full refresh.
[2025-10-24T20:44:26.839971] [INFO ] [LOCAL     ] PX: Starting deletion of primary data.
[2025-10-24T20:44:26.840286] [DEBUG] [LOCAL     ] PX: Deleted primary data file.
[2025-10-24T20:44:26.840343] [INFO ] [MAIN      ] PX: Starting full primary refresh.
[2025-10-24T20:44:27.227600] [INFO ] [REMOTE    ] PX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:44:27.347696] [INFO ] [REMOTE    ] PX: Fetching primary data for 2025-01.
[2025-10-24T20:44:27.402571] [INFO ] [REMOTE    ] PWR: Incremental fetch complete for 2025-09 (0.85 seconds).
[2025-10-24T20:44:28.058266] [INFO ] [REMOTE    ] PX: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T20:44:28.147621] [INFO ] [REMOTE    ] PX: Fetching primary data for 2025-02.
[2025-10-24T20:44:28.851377] [INFO ] [REMOTE    ] PX: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T20:44:28.947718] [INFO ] [REMOTE    ] PX: Fetching primary data for 2025-03.
[2025-10-24T20:44:29.747629] [INFO ] [REMOTE    ] PWR: Fetching primary data for 2025-10.
[2025-10-24T20:44:29.978095] [INFO ] [REMOTE    ] PX: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T20:44:30.547608] [INFO ] [REMOTE    ] PUMP: Fetching primary data for 2025-09.
[2025-10-24T20:44:30.802235] [INFO ] [REMOTE    ] PWR: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T20:44:30.810089] [INFO ] [REMOTE    ] PWR: Full fetch complete (68812 records).
[2025-10-24T20:44:30.810216] [DEBUG] [VALIDATOR ] PWR: Validating primary data.
[2025-10-24T20:44:30.811135] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:44:30.811231] [FATAL] [MAIN      ] PWR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:44:30.811317] [WARN ] [MAIN      ] PWR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:44:30.811401] [INFO ] [LOCAL     ] PWR: Starting deletion of primary data.
[2025-10-24T20:44:30.811477] [DEBUG] [LOCAL     ] PWR: No primary data file found to delete.
[2025-10-24T20:44:30.811517] [INFO ] [LOCAL     ] PWR: Starting deletion of derivative data.
[2025-10-24T20:44:30.811699] [DEBUG] [LOCAL     ] PWR: Deleted derivative data file.
[2025-10-24T20:44:30.811835] [INFO ] [MAIN      ] Update Progress: 1746/2366 symbols completed. PWR took 29.2s. Estimated remaining: 1h 19m 42s. Rate: 7.8 symbols/min
[2025-10-24T20:44:30.979106] [INFO ] [MAIN      ] PXED: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:44:30.979282] [DEBUG] [LOCAL     ] PXED: No existing data file found in primary storage.
[2025-10-24T20:44:30.979327] [WARN ] [MAIN      ] PXED: No existing data found, performing full refresh instead.
[2025-10-24T20:44:30.979465] [INFO ] [MAIN      ] PXED: Wiping existing primary data before full refresh.
[2025-10-24T20:44:30.979530] [INFO ] [LOCAL     ] PXED: Starting deletion of primary data.
[2025-10-24T20:44:30.979582] [DEBUG] [LOCAL     ] PXED: No primary data file found to delete.
[2025-10-24T20:44:30.979613] [INFO ] [MAIN      ] PXED: Starting full primary refresh.
[2025-10-24T20:44:31.354036] [INFO ] [REMOTE    ] PXED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:44:31.354100] [INFO ] [REMOTE    ] PVL: Fetching primary data for 2025-08.
[2025-10-24T20:44:31.709803] [INFO ] [REMOTE    ] PUMP: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T20:44:31.738565] [INFO ] [REMOTE    ] PVL: Incremental fetch complete for 2025-08 (0.38 seconds).
[2025-10-24T20:44:32.147729] [INFO ] [REMOTE    ] PXED: Fetching primary data for 2025-01.
[2025-10-24T20:44:32.543010] [DEBUG] [REMOTE    ] PXED: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:44:32.543308] [WARN ] [REMOTE    ] PXED: No data returned for month 2025-01
[2025-10-24T20:44:32.543393] [FATAL] [REMOTE    ] PXED: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:44:32.543443] [FATAL] [MAIN      ] PXED: Failed to fetch primary data.
[2025-10-24T20:44:32.543501] [WARN ] [MAIN      ] PXED: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:44:32.543571] [INFO ] [LOCAL     ] PXED: Starting deletion of primary data.
[2025-10-24T20:44:32.543676] [DEBUG] [LOCAL     ] PXED: No primary data file found to delete.
[2025-10-24T20:44:32.543733] [INFO ] [LOCAL     ] PXED: Starting deletion of derivative data.
[2025-10-24T20:44:32.543776] [DEBUG] [LOCAL     ] PXED: No derivative data file found to delete.
[2025-10-24T20:44:32.543822] [INFO ] [MAIN      ] Update Progress: 1747/2366 symbols completed. PXED took 1.7s. Estimated remaining: 1h 19m 33s. Rate: 7.8 symbols/min
[2025-10-24T20:44:32.713554] [INFO ] [MAIN      ] QBTS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:44:32.763718] [DEBUG] [LOCAL     ] QBTS: Loaded 54210 existing records from primary storage.
[2025-10-24T20:44:32.764045] [INFO ] [MAIN      ] QBTS: Loaded 54210 existing records.
[2025-10-24T20:44:32.945062] [WARN ] [MAIN      ] QBTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:44:32.945224] [INFO ] [MAIN      ] QBTS: Wiping existing primary data before full refresh.
[2025-10-24T20:44:32.945271] [INFO ] [LOCAL     ] QBTS: Starting deletion of primary data.
[2025-10-24T20:44:32.945799] [DEBUG] [LOCAL     ] QBTS: Deleted primary data file.
[2025-10-24T20:44:32.945856] [INFO ] [MAIN      ] QBTS: Starting full primary refresh.
[2025-10-24T20:44:32.957499] [INFO ] [REMOTE    ] PUMP: Fetching primary data for 2025-10.
[2025-10-24T20:44:33.304037] [INFO ] [REMOTE    ] QBTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:44:33.747682] [INFO ] [REMOTE    ] PVL: Fetching primary data for 2025-09.
[2025-10-24T20:44:33.982132] [INFO ] [REMOTE    ] PUMP: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T20:44:33.990924] [INFO ] [REMOTE    ] PUMP: Full fetch complete (71413 records).
[2025-10-24T20:44:33.991047] [DEBUG] [VALIDATOR ] PUMP: Validating primary data.
[2025-10-24T20:44:33.991745] [FATAL] [VALIDATOR ] PUMP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:44:33.991833] [FATAL] [MAIN      ] PUMP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:44:33.991874] [WARN ] [MAIN      ] PUMP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:44:33.991911] [INFO ] [LOCAL     ] PUMP: Starting deletion of primary data.
[2025-10-24T20:44:33.991979] [DEBUG] [LOCAL     ] PUMP: No primary data file found to delete.
[2025-10-24T20:44:33.992036] [INFO ] [LOCAL     ] PUMP: Starting deletion of derivative data.
[2025-10-24T20:44:33.992182] [DEBUG] [LOCAL     ] PUMP: Deleted derivative data file.
[2025-10-24T20:44:33.992418] [INFO ] [MAIN      ] Update Progress: 1748/2366 symbols completed. PUMP took 50.6s. Estimated remaining: 1h 19m 23s. Rate: 7.8 symbols/min
[2025-10-24T20:44:34.162427] [INFO ] [MAIN      ] QD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:44:34.188765] [DEBUG] [LOCAL     ] QD: Loaded 27628 existing records from primary storage.
[2025-10-24T20:44:34.189021] [INFO ] [MAIN      ] QD: Loaded 27628 existing records.
[2025-10-24T20:44:34.369293] [WARN ] [MAIN      ] QD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:44:34.369558] [INFO ] [MAIN      ] QD: Wiping existing primary data before full refresh.
[2025-10-24T20:44:34.369605] [INFO ] [LOCAL     ] QD: Starting deletion of primary data.
[2025-10-24T20:44:34.369926] [DEBUG] [LOCAL     ] QD: Deleted primary data file.
[2025-10-24T20:44:34.369980] [INFO ] [MAIN      ] QD: Starting full primary refresh.
[2025-10-24T20:44:34.477979] [INFO ] [REMOTE    ] PVL: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T20:44:34.558311] [INFO ] [REMOTE    ] PVL: Fetching primary data for 2025-10.
[2025-10-24T20:44:34.789618] [INFO ] [REMOTE    ] QD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:44:35.018744] [INFO ] [REMOTE    ] PVL: Incremental fetch complete for 2025-10 (0.46 seconds).
[2025-10-24T20:44:35.020357] [INFO ] [REMOTE    ] PVL: Full fetch complete (7040 records).
[2025-10-24T20:44:35.020439] [DEBUG] [VALIDATOR ] PVL: Validating primary data.
[2025-10-24T20:44:35.020885] [FATAL] [VALIDATOR ] PVL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:44:35.020972] [FATAL] [MAIN      ] PVL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:44:35.021015] [WARN ] [MAIN      ] PVL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:44:35.021190] [INFO ] [LOCAL     ] PVL: Starting deletion of primary data.
[2025-10-24T20:44:35.021278] [DEBUG] [LOCAL     ] PVL: No primary data file found to delete.
[2025-10-24T20:44:35.021317] [INFO ] [LOCAL     ] PVL: Starting deletion of derivative data.
[2025-10-24T20:44:35.021530] [DEBUG] [LOCAL     ] PVL: Deleted derivative data file.
[2025-10-24T20:44:35.021627] [INFO ] [MAIN      ] Update Progress: 1749/2366 symbols completed. PVL took 34.9s. Estimated remaining: 1h 19m 13s. Rate: 7.8 symbols/min
[2025-10-24T20:44:35.190687] [INFO ] [MAIN      ] QGEN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:44:35.235535] [DEBUG] [LOCAL     ] QGEN: Loaded 49391 existing records from primary storage.
[2025-10-24T20:44:35.235860] [INFO ] [MAIN      ] QGEN: Loaded 49391 existing records.
[2025-10-24T20:44:35.352792] [INFO ] [REMOTE    ] QD: Fetching primary data for 2025-01.
[2025-10-24T20:44:35.415727] [WARN ] [MAIN      ] QGEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:44:35.416142] [INFO ] [MAIN      ] QGEN: Wiping existing primary data before full refresh.
[2025-10-24T20:44:35.416191] [INFO ] [LOCAL     ] QGEN: Starting deletion of primary data.
[2025-10-24T20:44:35.416831] [DEBUG] [LOCAL     ] QGEN: Deleted primary data file.
[2025-10-24T20:44:35.416887] [INFO ] [MAIN      ] QGEN: Starting full primary refresh.
[2025-10-24T20:44:35.761441] [INFO ] [REMOTE    ] QGEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:44:36.011750] [INFO ] [REMOTE    ] QD: Incremental fetch complete for 2025-01 (0.66 seconds).
[2025-10-24T20:44:36.147681] [INFO ] [REMOTE    ] QBTS: Fetching primary data for 2025-01.
[2025-10-24T20:44:36.953811] [INFO ] [REMOTE    ] QGEN: Fetching primary data for 2025-01.
[2025-10-24T20:44:36.956397] [INFO ] [REMOTE    ] QBTS: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T20:44:37.747704] [INFO ] [REMOTE    ] QD: Fetching primary data for 2025-02.
[2025-10-24T20:44:38.128912] [INFO ] [REMOTE    ] QGEN: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T20:44:38.324192] [INFO ] [REMOTE    ] QD: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T20:44:38.547680] [INFO ] [REMOTE    ] QBTS: Fetching primary data for 2025-02.
[2025-10-24T20:44:39.347677] [INFO ] [REMOTE    ] QGEN: Fetching primary data for 2025-02.
[2025-10-24T20:44:39.549883] [INFO ] [REMOTE    ] QBTS: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T20:44:40.147705] [INFO ] [REMOTE    ] PX: Fetching primary data for 2025-04.
[2025-10-24T20:44:40.389966] [INFO ] [REMOTE    ] QGEN: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T20:44:40.947620] [INFO ] [REMOTE    ] QBTS: Fetching primary data for 2025-03.
[2025-10-24T20:44:41.124522] [INFO ] [REMOTE    ] PX: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T20:44:41.747613] [INFO ] [REMOTE    ] PX: Fetching primary data for 2025-05.
[2025-10-24T20:44:42.254859] [INFO ] [REMOTE    ] QBTS: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T20:44:42.547622] [INFO ] [REMOTE    ] QBTS: Fetching primary data for 2025-04.
[2025-10-24T20:44:43.039783] [INFO ] [REMOTE    ] PX: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T20:44:43.347717] [INFO ] [REMOTE    ] PX: Fetching primary data for 2025-06.
[2025-10-24T20:44:43.572047] [INFO ] [REMOTE    ] QBTS: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T20:44:43.623980] [INFO ] [REMOTE    ] PX: Incremental fetch complete for 2025-06 (0.28 seconds).
[2025-10-24T20:44:44.147671] [INFO ] [REMOTE    ] QGEN: Fetching primary data for 2025-03.
[2025-10-24T20:44:44.947623] [INFO ] [REMOTE    ] PX: Fetching primary data for 2025-07.
[2025-10-24T20:44:45.177429] [INFO ] [REMOTE    ] QGEN: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T20:44:45.473337] [INFO ] [REMOTE    ] PX: Incremental fetch complete for 2025-07 (0.53 seconds).
[2025-10-24T20:44:45.747606] [INFO ] [REMOTE    ] PX: Fetching primary data for 2025-08.
[2025-10-24T20:44:46.547612] [INFO ] [REMOTE    ] QGEN: Fetching primary data for 2025-04.
[2025-10-24T20:44:46.820022] [INFO ] [REMOTE    ] PX: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T20:44:47.300592] [INFO ] [REMOTE    ] QGEN: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T20:44:47.347664] [INFO ] [REMOTE    ] QBTS: Fetching primary data for 2025-05.
[2025-10-24T20:44:48.147628] [INFO ] [REMOTE    ] QD: Fetching primary data for 2025-03.
[2025-10-24T20:44:48.541341] [INFO ] [REMOTE    ] QBTS: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T20:44:48.569329] [INFO ] [REMOTE    ] QD: Incremental fetch complete for 2025-03 (0.42 seconds).
[2025-10-24T20:44:48.947684] [INFO ] [REMOTE    ] PX: Fetching primary data for 2025-09.
[2025-10-24T20:44:49.747630] [INFO ] [REMOTE    ] QGEN: Fetching primary data for 2025-05.
[2025-10-24T20:44:49.889504] [INFO ] [REMOTE    ] PX: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T20:44:50.552782] [INFO ] [REMOTE    ] PX: Fetching primary data for 2025-10.
[2025-10-24T20:44:50.567248] [INFO ] [REMOTE    ] QGEN: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T20:44:51.166369] [INFO ] [REMOTE    ] PX: Incremental fetch complete for 2025-10 (0.61 seconds).
[2025-10-24T20:44:51.171407] [INFO ] [REMOTE    ] PX: Full fetch complete (49459 records).
[2025-10-24T20:44:51.171497] [DEBUG] [VALIDATOR ] PX: Validating primary data.
[2025-10-24T20:44:51.172141] [FATAL] [VALIDATOR ] PX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:44:51.172226] [FATAL] [MAIN      ] PX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:44:51.172269] [WARN ] [MAIN      ] PX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:44:51.172307] [INFO ] [LOCAL     ] PX: Starting deletion of primary data.
[2025-10-24T20:44:51.172363] [DEBUG] [LOCAL     ] PX: No primary data file found to delete.
[2025-10-24T20:44:51.172398] [INFO ] [LOCAL     ] PX: Starting deletion of derivative data.
[2025-10-24T20:44:51.172547] [DEBUG] [LOCAL     ] PX: Deleted derivative data file.
[2025-10-24T20:44:51.172970] [INFO ] [MAIN      ] Update Progress: 1750/2366 symbols completed. PX took 24.7s. Estimated remaining: 1h 19m 8s. Rate: 7.8 symbols/min
[2025-10-24T20:44:51.341306] [INFO ] [MAIN      ] QS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:44:51.347716] [INFO ] [REMOTE    ] QGEN: Fetching primary data for 2025-06.
[2025-10-24T20:44:51.395532] [DEBUG] [LOCAL     ] QS: Loaded 54150 existing records from primary storage.
[2025-10-24T20:44:51.395889] [INFO ] [MAIN      ] QS: Loaded 54150 existing records.
[2025-10-24T20:44:51.577591] [WARN ] [MAIN      ] QS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:44:51.578116] [INFO ] [MAIN      ] QS: Wiping existing primary data before full refresh.
[2025-10-24T20:44:51.578176] [INFO ] [LOCAL     ] QS: Starting deletion of primary data.
[2025-10-24T20:44:51.579163] [DEBUG] [LOCAL     ] QS: Deleted primary data file.
[2025-10-24T20:44:51.579224] [INFO ] [MAIN      ] QS: Starting full primary refresh.
[2025-10-24T20:44:51.931704] [INFO ] [REMOTE    ] QS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:44:52.147701] [INFO ] [REMOTE    ] QS: Fetching primary data for 2025-01.
[2025-10-24T20:44:52.923214] [INFO ] [REMOTE    ] QS: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T20:44:52.947594] [INFO ] [REMOTE    ] QS: Fetching primary data for 2025-02.
[2025-10-24T20:44:53.532129] [INFO ] [REMOTE    ] QGEN: Incremental fetch complete for 2025-06 (2.18 seconds).
[2025-10-24T20:44:53.696205] [INFO ] [REMOTE    ] QS: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T20:44:53.747603] [INFO ] [REMOTE    ] QS: Fetching primary data for 2025-03.
[2025-10-24T20:44:54.547637] [INFO ] [REMOTE    ] QD: Fetching primary data for 2025-04.
[2025-10-24T20:44:55.034445] [INFO ] [REMOTE    ] QS: Incremental fetch complete for 2025-03 (1.29 seconds).
[2025-10-24T20:44:55.212979] [INFO ] [REMOTE    ] QD: Incremental fetch complete for 2025-04 (0.67 seconds).
[2025-10-24T20:44:55.347682] [INFO ] [REMOTE    ] QS: Fetching primary data for 2025-04.
[2025-10-24T20:44:56.147671] [INFO ] [REMOTE    ] QBTS: Fetching primary data for 2025-06.
[2025-10-24T20:44:56.536046] [INFO ] [REMOTE    ] QS: Incremental fetch complete for 2025-04 (1.19 seconds).
[2025-10-24T20:44:56.746883] [INFO ] [REMOTE    ] QBTS: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T20:44:56.947739] [INFO ] [REMOTE    ] QS: Fetching primary data for 2025-05.
[2025-10-24T20:44:57.754318] [INFO ] [REMOTE    ] QBTS: Fetching primary data for 2025-07.
[2025-10-24T20:44:57.759899] [INFO ] [REMOTE    ] QS: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:44:58.442507] [INFO ] [REMOTE    ] QBTS: Incremental fetch complete for 2025-07 (0.69 seconds).
[2025-10-24T20:44:58.547680] [INFO ] [REMOTE    ] QBTS: Fetching primary data for 2025-08.
[2025-10-24T20:44:59.347638] [INFO ] [REMOTE    ] QGEN: Fetching primary data for 2025-07.
[2025-10-24T20:44:59.748345] [INFO ] [REMOTE    ] QBTS: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T20:45:00.119455] [INFO ] [REMOTE    ] QGEN: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T20:45:00.147694] [INFO ] [REMOTE    ] QGEN: Fetching primary data for 2025-08.
[2025-10-24T20:45:00.947628] [INFO ] [REMOTE    ] QBTS: Fetching primary data for 2025-09.
[2025-10-24T20:45:01.356673] [INFO ] [REMOTE    ] QGEN: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T20:45:01.747747] [INFO ] [REMOTE    ] QS: Fetching primary data for 2025-06.
[2025-10-24T20:45:02.105348] [INFO ] [REMOTE    ] QBTS: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T20:45:02.547734] [INFO ] [REMOTE    ] QGEN: Fetching primary data for 2025-09.
[2025-10-24T20:45:02.782508] [INFO ] [REMOTE    ] QS: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T20:45:03.347692] [INFO ] [REMOTE    ] QBTS: Fetching primary data for 2025-10.
[2025-10-24T20:45:04.147687] [INFO ] [REMOTE    ] QS: Fetching primary data for 2025-07.
[2025-10-24T20:45:04.323192] [INFO ] [REMOTE    ] QGEN: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T20:45:04.430763] [INFO ] [REMOTE    ] QBTS: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T20:45:04.441246] [INFO ] [REMOTE    ] QBTS: Full fetch complete (77533 records).
[2025-10-24T20:45:04.441422] [DEBUG] [VALIDATOR ] QBTS: Validating primary data.
[2025-10-24T20:45:04.442279] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:45:04.442374] [FATAL] [MAIN      ] QBTS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:45:04.442418] [WARN ] [MAIN      ] QBTS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:45:04.442455] [INFO ] [LOCAL     ] QBTS: Starting deletion of primary data.
[2025-10-24T20:45:04.442510] [DEBUG] [LOCAL     ] QBTS: No primary data file found to delete.
[2025-10-24T20:45:04.442545] [INFO ] [LOCAL     ] QBTS: Starting deletion of derivative data.
[2025-10-24T20:45:04.442729] [DEBUG] [LOCAL     ] QBTS: Deleted derivative data file.
[2025-10-24T20:45:04.443197] [INFO ] [MAIN      ] Update Progress: 1751/2366 symbols completed. QBTS took 31.9s. Estimated remaining: 1h 19m 2s. Rate: 7.8 symbols/min
[2025-10-24T20:45:04.629312] [INFO ] [MAIN      ] QSR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:45:04.678021] [DEBUG] [LOCAL     ] QSR: Loaded 52811 existing records from primary storage.
[2025-10-24T20:45:04.678333] [INFO ] [MAIN      ] QSR: Loaded 52811 existing records.
[2025-10-24T20:45:04.884477] [WARN ] [MAIN      ] QSR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:45:04.884708] [INFO ] [MAIN      ] QSR: Wiping existing primary data before full refresh.
[2025-10-24T20:45:04.884763] [INFO ] [LOCAL     ] QSR: Starting deletion of primary data.
[2025-10-24T20:45:04.885935] [DEBUG] [LOCAL     ] QSR: Deleted primary data file.
[2025-10-24T20:45:04.885992] [INFO ] [MAIN      ] QSR: Starting full primary refresh.
[2025-10-24T20:45:04.953385] [INFO ] [REMOTE    ] QD: Fetching primary data for 2025-05.
[2025-10-24T20:45:05.237609] [INFO ] [REMOTE    ] QSR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:45:05.747729] [INFO ] [REMOTE    ] QGEN: Fetching primary data for 2025-10.
[2025-10-24T20:45:06.103676] [INFO ] [REMOTE    ] QD: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T20:45:06.146113] [INFO ] [REMOTE    ] QS: Incremental fetch complete for 2025-07 (2.00 seconds).
[2025-10-24T20:45:06.547706] [INFO ] [REMOTE    ] QD: Fetching primary data for 2025-06.
[2025-10-24T20:45:06.668853] [INFO ] [REMOTE    ] QGEN: Incremental fetch complete for 2025-10 (0.92 seconds).
[2025-10-24T20:45:06.677126] [INFO ] [REMOTE    ] QGEN: Full fetch complete (70365 records).
[2025-10-24T20:45:06.677253] [DEBUG] [VALIDATOR ] QGEN: Validating primary data.
[2025-10-24T20:45:06.678323] [FATAL] [VALIDATOR ] QGEN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:45:06.678407] [FATAL] [MAIN      ] QGEN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:45:06.678449] [WARN ] [MAIN      ] QGEN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:45:06.678490] [INFO ] [LOCAL     ] QGEN: Starting deletion of primary data.
[2025-10-24T20:45:06.678561] [DEBUG] [LOCAL     ] QGEN: No primary data file found to delete.
[2025-10-24T20:45:06.678614] [INFO ] [LOCAL     ] QGEN: Starting deletion of derivative data.
[2025-10-24T20:45:06.679054] [DEBUG] [LOCAL     ] QGEN: Deleted derivative data file.
[2025-10-24T20:45:06.679422] [INFO ] [MAIN      ] Update Progress: 1752/2366 symbols completed. QGEN took 31.7s. Estimated remaining: 1h 18m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:45:06.846846] [INFO ] [MAIN      ] QTWO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:45:06.884990] [DEBUG] [LOCAL     ] QTWO: Loaded 39712 existing records from primary storage.
[2025-10-24T20:45:06.885247] [INFO ] [MAIN      ] QTWO: Loaded 39712 existing records.
[2025-10-24T20:45:07.057869] [WARN ] [MAIN      ] QTWO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:45:07.058059] [INFO ] [MAIN      ] QTWO: Wiping existing primary data before full refresh.
[2025-10-24T20:45:07.058104] [INFO ] [LOCAL     ] QTWO: Starting deletion of primary data.
[2025-10-24T20:45:07.058895] [DEBUG] [LOCAL     ] QTWO: Deleted primary data file.
[2025-10-24T20:45:07.058952] [INFO ] [MAIN      ] QTWO: Starting full primary refresh.
[2025-10-24T20:45:07.352720] [INFO ] [REMOTE    ] QSR: Fetching primary data for 2025-01.
[2025-10-24T20:45:07.403985] [INFO ] [REMOTE    ] QTWO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:45:07.738269] [INFO ] [REMOTE    ] QD: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T20:45:08.147618] [INFO ] [REMOTE    ] QD: Fetching primary data for 2025-07.
[2025-10-24T20:45:08.386867] [INFO ] [REMOTE    ] QSR: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T20:45:08.947697] [INFO ] [REMOTE    ] QSR: Fetching primary data for 2025-02.
[2025-10-24T20:45:09.035710] [INFO ] [REMOTE    ] QD: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T20:45:09.747714] [INFO ] [REMOTE    ] QS: Fetching primary data for 2025-08.
[2025-10-24T20:45:09.818201] [INFO ] [REMOTE    ] QSR: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T20:45:10.432800] [INFO ] [REMOTE    ] QS: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T20:45:10.547633] [INFO ] [REMOTE    ] QS: Fetching primary data for 2025-09.
[2025-10-24T20:45:11.347685] [INFO ] [REMOTE    ] QSR: Fetching primary data for 2025-03.
[2025-10-24T20:45:11.447433] [INFO ] [REMOTE    ] QS: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T20:45:12.128619] [INFO ] [REMOTE    ] QSR: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T20:45:12.147598] [INFO ] [REMOTE    ] QSR: Fetching primary data for 2025-04.
[2025-10-24T20:45:12.947634] [INFO ] [REMOTE    ] QS: Fetching primary data for 2025-10.
[2025-10-24T20:45:13.244715] [INFO ] [REMOTE    ] QSR: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T20:45:13.747623] [INFO ] [REMOTE    ] QTWO: Fetching primary data for 2025-01.
[2025-10-24T20:45:13.977210] [INFO ] [REMOTE    ] QS: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T20:45:13.986709] [INFO ] [REMOTE    ] QS: Full fetch complete (77530 records).
[2025-10-24T20:45:13.986844] [DEBUG] [VALIDATOR ] QS: Validating primary data.
[2025-10-24T20:45:13.987638] [FATAL] [VALIDATOR ] QS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:45:13.987759] [FATAL] [MAIN      ] QS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:45:13.987802] [WARN ] [MAIN      ] QS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:45:13.987877] [INFO ] [LOCAL     ] QS: Starting deletion of primary data.
[2025-10-24T20:45:13.987939] [DEBUG] [LOCAL     ] QS: No primary data file found to delete.
[2025-10-24T20:45:13.987976] [INFO ] [LOCAL     ] QS: Starting deletion of derivative data.
[2025-10-24T20:45:13.988121] [DEBUG] [LOCAL     ] QS: Deleted derivative data file.
[2025-10-24T20:45:13.988537] [INFO ] [MAIN      ] Update Progress: 1753/2366 symbols completed. QS took 22.8s. Estimated remaining: 1h 18m 45s. Rate: 7.8 symbols/min
[2025-10-24T20:45:14.165042] [INFO ] [MAIN      ] QUAD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:45:14.187488] [DEBUG] [LOCAL     ] QUAD: Loaded 23146 existing records from primary storage.
[2025-10-24T20:45:14.187757] [INFO ] [MAIN      ] QUAD: Loaded 23146 existing records.
[2025-10-24T20:45:14.365533] [WARN ] [MAIN      ] QUAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:45:14.365775] [INFO ] [MAIN      ] QUAD: Wiping existing primary data before full refresh.
[2025-10-24T20:45:14.365844] [INFO ] [LOCAL     ] QUAD: Starting deletion of primary data.
[2025-10-24T20:45:14.366146] [DEBUG] [LOCAL     ] QUAD: Deleted primary data file.
[2025-10-24T20:45:14.366263] [INFO ] [MAIN      ] QUAD: Starting full primary refresh.
[2025-10-24T20:45:14.558818] [INFO ] [REMOTE    ] QD: Fetching primary data for 2025-08.
[2025-10-24T20:45:14.560030] [INFO ] [REMOTE    ] QTWO: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T20:45:14.768109] [INFO ] [REMOTE    ] QUAD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:45:15.347613] [INFO ] [REMOTE    ] QUAD: Fetching primary data for 2025-01.
[2025-10-24T20:45:15.467531] [INFO ] [REMOTE    ] QD: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T20:45:16.130203] [INFO ] [REMOTE    ] QUAD: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T20:45:16.147590] [INFO ] [REMOTE    ] QUAD: Fetching primary data for 2025-02.
[2025-10-24T20:45:16.742745] [INFO ] [REMOTE    ] QUAD: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T20:45:16.947704] [INFO ] [REMOTE    ] QSR: Fetching primary data for 2025-05.
[2025-10-24T20:45:17.747629] [INFO ] [REMOTE    ] QTWO: Fetching primary data for 2025-02.
[2025-10-24T20:45:17.985165] [INFO ] [REMOTE    ] QSR: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T20:45:18.547685] [INFO ] [REMOTE    ] QSR: Fetching primary data for 2025-06.
[2025-10-24T20:45:18.649145] [INFO ] [REMOTE    ] QTWO: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T20:45:19.320515] [INFO ] [REMOTE    ] QSR: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T20:45:19.347603] [INFO ] [REMOTE    ] QSR: Fetching primary data for 2025-07.
[2025-10-24T20:45:20.147624] [INFO ] [REMOTE    ] QD: Fetching primary data for 2025-09.
[2025-10-24T20:45:20.190500] [INFO ] [REMOTE    ] QSR: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T20:45:20.831393] [INFO ] [REMOTE    ] QD: Incremental fetch complete for 2025-09 (0.68 seconds).
[2025-10-24T20:45:20.947607] [INFO ] [REMOTE    ] QD: Fetching primary data for 2025-10.
[2025-10-24T20:45:21.747633] [INFO ] [REMOTE    ] QTWO: Fetching primary data for 2025-03.
[2025-10-24T20:45:21.987362] [INFO ] [REMOTE    ] QD: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T20:45:21.992087] [INFO ] [REMOTE    ] QD: Full fetch complete (39678 records).
[2025-10-24T20:45:21.992196] [DEBUG] [VALIDATOR ] QD: Validating primary data.
[2025-10-24T20:45:21.992841] [FATAL] [VALIDATOR ] QD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:45:21.992925] [FATAL] [MAIN      ] QD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:45:21.992995] [WARN ] [MAIN      ] QD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:45:21.993067] [INFO ] [LOCAL     ] QD: Starting deletion of primary data.
[2025-10-24T20:45:21.993130] [DEBUG] [LOCAL     ] QD: No primary data file found to delete.
[2025-10-24T20:45:21.993166] [INFO ] [LOCAL     ] QD: Starting deletion of derivative data.
[2025-10-24T20:45:21.993317] [DEBUG] [LOCAL     ] QD: Deleted derivative data file.
[2025-10-24T20:45:21.993386] [INFO ] [MAIN      ] Update Progress: 1754/2366 symbols completed. QD took 48.0s. Estimated remaining: 1h 18m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:45:22.164248] [INFO ] [MAIN      ] QVCC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:45:22.175500] [DEBUG] [LOCAL     ] QVCC: Loaded 8745 existing records from primary storage.
[2025-10-24T20:45:22.175753] [INFO ] [MAIN      ] QVCC: Loaded 8745 existing records.
[2025-10-24T20:45:22.360301] [WARN ] [MAIN      ] QVCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:45:22.360524] [INFO ] [MAIN      ] QVCC: Wiping existing primary data before full refresh.
[2025-10-24T20:45:22.360572] [INFO ] [LOCAL     ] QVCC: Starting deletion of primary data.
[2025-10-24T20:45:22.360814] [DEBUG] [LOCAL     ] QVCC: Deleted primary data file.
[2025-10-24T20:45:22.360873] [INFO ] [MAIN      ] QVCC: Starting full primary refresh.
[2025-10-24T20:45:22.548217] [INFO ] [REMOTE    ] QSR: Fetching primary data for 2025-08.
[2025-10-24T20:45:22.734260] [INFO ] [REMOTE    ] QVCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:45:22.889125] [INFO ] [REMOTE    ] QTWO: Incremental fetch complete for 2025-03 (1.14 seconds).
[2025-10-24T20:45:23.347625] [INFO ] [REMOTE    ] QUAD: Fetching primary data for 2025-03.
[2025-10-24T20:45:23.804075] [INFO ] [REMOTE    ] QSR: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T20:45:24.147732] [INFO ] [REMOTE    ] QVCC: Fetching primary data for 2025-01.
[2025-10-24T20:45:24.196817] [INFO ] [REMOTE    ] QUAD: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T20:45:24.947618] [INFO ] [REMOTE    ] QTWO: Fetching primary data for 2025-04.
[2025-10-24T20:45:25.123528] [INFO ] [REMOTE    ] QVCC: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T20:45:25.747685] [INFO ] [REMOTE    ] QUAD: Fetching primary data for 2025-04.
[2025-10-24T20:45:25.923532] [INFO ] [REMOTE    ] QTWO: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T20:45:25.982089] [INFO ] [REMOTE    ] QUAD: Incremental fetch complete for 2025-04 (0.23 seconds).
[2025-10-24T20:45:26.547700] [INFO ] [REMOTE    ] QVCC: Fetching primary data for 2025-02.
[2025-10-24T20:45:27.143404] [INFO ] [REMOTE    ] QVCC: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T20:45:27.347694] [INFO ] [REMOTE    ] QVCC: Fetching primary data for 2025-03.
[2025-10-24T20:45:28.083381] [INFO ] [REMOTE    ] QVCC: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T20:45:28.147627] [INFO ] [REMOTE    ] QSR: Fetching primary data for 2025-09.
[2025-10-24T20:45:28.952791] [INFO ] [REMOTE    ] QUAD: Fetching primary data for 2025-05.
[2025-10-24T20:45:28.967290] [INFO ] [REMOTE    ] QSR: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T20:45:29.747640] [INFO ] [REMOTE    ] QVCC: Fetching primary data for 2025-04.
[2025-10-24T20:45:29.942989] [INFO ] [REMOTE    ] QUAD: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T20:45:30.464305] [INFO ] [REMOTE    ] QVCC: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T20:45:30.547704] [INFO ] [REMOTE    ] QTWO: Fetching primary data for 2025-05.
[2025-10-24T20:45:31.347695] [INFO ] [REMOTE    ] QVCC: Fetching primary data for 2025-05.
[2025-10-24T20:45:31.503242] [INFO ] [REMOTE    ] QTWO: Incremental fetch complete for 2025-05 (0.96 seconds).
[2025-10-24T20:45:32.147637] [INFO ] [REMOTE    ] QTWO: Fetching primary data for 2025-06.
[2025-10-24T20:45:32.407926] [INFO ] [REMOTE    ] QVCC: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T20:45:32.947627] [INFO ] [REMOTE    ] QUAD: Fetching primary data for 2025-06.
[2025-10-24T20:45:33.102394] [INFO ] [REMOTE    ] QTWO: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T20:45:33.747668] [INFO ] [REMOTE    ] QTWO: Fetching primary data for 2025-07.
[2025-10-24T20:45:33.853917] [INFO ] [REMOTE    ] QUAD: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T20:45:34.547616] [INFO ] [REMOTE    ] QVCC: Fetching primary data for 2025-06.
[2025-10-24T20:45:34.702900] [INFO ] [REMOTE    ] QTWO: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T20:45:35.327971] [INFO ] [REMOTE    ] QVCC: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T20:45:35.347626] [INFO ] [REMOTE    ] QTWO: Fetching primary data for 2025-08.
[2025-10-24T20:45:36.085418] [INFO ] [REMOTE    ] QTWO: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T20:45:36.147635] [INFO ] [REMOTE    ] QTWO: Fetching primary data for 2025-09.
[2025-10-24T20:45:36.889067] [INFO ] [REMOTE    ] QTWO: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T20:45:36.947597] [INFO ] [REMOTE    ] QTWO: Fetching primary data for 2025-10.
[2025-10-24T20:45:37.747693] [INFO ] [REMOTE    ] QSR: Fetching primary data for 2025-10.
[2025-10-24T20:45:37.896534] [INFO ] [REMOTE    ] QTWO: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T20:45:37.904399] [INFO ] [REMOTE    ] QTWO: Full fetch complete (57887 records).
[2025-10-24T20:45:37.904525] [DEBUG] [VALIDATOR ] QTWO: Validating primary data.
[2025-10-24T20:45:37.905272] [FATAL] [VALIDATOR ] QTWO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:45:37.905351] [FATAL] [MAIN      ] QTWO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:45:37.905417] [WARN ] [MAIN      ] QTWO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:45:37.905502] [INFO ] [LOCAL     ] QTWO: Starting deletion of primary data.
[2025-10-24T20:45:37.905568] [DEBUG] [LOCAL     ] QTWO: No primary data file found to delete.
[2025-10-24T20:45:37.905602] [INFO ] [LOCAL     ] QTWO: Starting deletion of derivative data.
[2025-10-24T20:45:37.905784] [DEBUG] [LOCAL     ] QTWO: Deleted derivative data file.
[2025-10-24T20:45:37.905870] [INFO ] [MAIN      ] Update Progress: 1755/2366 symbols completed. QTWO took 31.2s. Estimated remaining: 1h 18m 32s. Rate: 7.8 symbols/min
[2025-10-24T20:45:38.073616] [INFO ] [MAIN      ] QVCD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:45:38.081459] [DEBUG] [LOCAL     ] QVCD: Loaded 4583 existing records from primary storage.
[2025-10-24T20:45:38.081698] [INFO ] [MAIN      ] QVCD: Loaded 4583 existing records.
[2025-10-24T20:45:38.257918] [WARN ] [MAIN      ] QVCD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:45:38.258117] [INFO ] [MAIN      ] QVCD: Wiping existing primary data before full refresh.
[2025-10-24T20:45:38.258164] [INFO ] [LOCAL     ] QVCD: Starting deletion of primary data.
[2025-10-24T20:45:38.258360] [DEBUG] [LOCAL     ] QVCD: Deleted primary data file.
[2025-10-24T20:45:38.258416] [INFO ] [MAIN      ] QVCD: Starting full primary refresh.
[2025-10-24T20:45:38.552936] [INFO ] [REMOTE    ] QUAD: Fetching primary data for 2025-07.
[2025-10-24T20:45:38.619215] [INFO ] [REMOTE    ] QVCD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:45:39.071169] [INFO ] [REMOTE    ] QSR: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T20:45:39.081208] [INFO ] [REMOTE    ] QSR: Full fetch complete (75676 records).
[2025-10-24T20:45:39.081382] [DEBUG] [VALIDATOR ] QSR: Validating primary data.
[2025-10-24T20:45:39.082242] [FATAL] [VALIDATOR ] QSR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:45:39.082333] [FATAL] [MAIN      ] QSR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:45:39.082377] [WARN ] [MAIN      ] QSR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:45:39.082416] [INFO ] [LOCAL     ] QSR: Starting deletion of primary data.
[2025-10-24T20:45:39.082472] [DEBUG] [LOCAL     ] QSR: No primary data file found to delete.
[2025-10-24T20:45:39.082506] [INFO ] [LOCAL     ] QSR: Starting deletion of derivative data.
[2025-10-24T20:45:39.082700] [DEBUG] [LOCAL     ] QSR: Deleted derivative data file.
[2025-10-24T20:45:39.083042] [INFO ] [MAIN      ] Update Progress: 1756/2366 symbols completed. QSR took 34.6s. Estimated remaining: 1h 18m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:45:39.240133] [INFO ] [REMOTE    ] QUAD: Incremental fetch complete for 2025-07 (0.69 seconds).
[2025-10-24T20:45:39.276736] [INFO ] [MAIN      ] QXO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:45:39.329743] [DEBUG] [LOCAL     ] QXO: Loaded 53865 existing records from primary storage.
[2025-10-24T20:45:39.330057] [INFO ] [MAIN      ] QXO: Loaded 53865 existing records.
[2025-10-24T20:45:39.352850] [INFO ] [REMOTE    ] QVCC: Fetching primary data for 2025-07.
[2025-10-24T20:45:39.524480] [WARN ] [MAIN      ] QXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:45:39.524690] [INFO ] [MAIN      ] QXO: Wiping existing primary data before full refresh.
[2025-10-24T20:45:39.524747] [INFO ] [LOCAL     ] QXO: Starting deletion of primary data.
[2025-10-24T20:45:39.525294] [DEBUG] [LOCAL     ] QXO: Deleted primary data file.
[2025-10-24T20:45:39.525349] [INFO ] [MAIN      ] QXO: Starting full primary refresh.
[2025-10-24T20:45:39.873679] [INFO ] [REMOTE    ] QXO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:45:40.147603] [INFO ] [REMOTE    ] QVCD: Fetching primary data for 2025-01.
[2025-10-24T20:45:40.449576] [INFO ] [REMOTE    ] QVCC: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T20:45:40.515215] [INFO ] [REMOTE    ] QVCD: Incremental fetch complete for 2025-01 (0.37 seconds).
[2025-10-24T20:45:40.947628] [INFO ] [REMOTE    ] QVCC: Fetching primary data for 2025-08.
[2025-10-24T20:45:41.747631] [INFO ] [REMOTE    ] QVCD: Fetching primary data for 2025-02.
[2025-10-24T20:45:41.960742] [INFO ] [REMOTE    ] QVCC: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T20:45:42.029380] [INFO ] [REMOTE    ] QVCD: Incremental fetch complete for 2025-02 (0.28 seconds).
[2025-10-24T20:45:42.547671] [INFO ] [REMOTE    ] QUAD: Fetching primary data for 2025-08.
[2025-10-24T20:45:43.347704] [INFO ] [REMOTE    ] QVCD: Fetching primary data for 2025-03.
[2025-10-24T20:45:43.443378] [INFO ] [REMOTE    ] QUAD: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T20:45:43.789262] [INFO ] [REMOTE    ] QVCD: Incremental fetch complete for 2025-03 (0.44 seconds).
[2025-10-24T20:45:44.147703] [INFO ] [REMOTE    ] QUAD: Fetching primary data for 2025-09.
[2025-10-24T20:45:44.736463] [INFO ] [REMOTE    ] QUAD: Incremental fetch complete for 2025-09 (0.59 seconds).
[2025-10-24T20:45:44.947684] [INFO ] [REMOTE    ] QUAD: Fetching primary data for 2025-10.
[2025-10-24T20:45:45.747710] [INFO ] [REMOTE    ] QXO: Fetching primary data for 2025-01.
[2025-10-24T20:45:45.760745] [INFO ] [REMOTE    ] QUAD: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T20:45:45.764594] [INFO ] [REMOTE    ] QUAD: Full fetch complete (33748 records).
[2025-10-24T20:45:45.764705] [DEBUG] [VALIDATOR ] QUAD: Validating primary data.
[2025-10-24T20:45:45.765296] [FATAL] [VALIDATOR ] QUAD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:45:45.765387] [FATAL] [MAIN      ] QUAD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:45:45.765430] [WARN ] [MAIN      ] QUAD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:45:45.765497] [INFO ] [LOCAL     ] QUAD: Starting deletion of primary data.
[2025-10-24T20:45:45.765561] [DEBUG] [LOCAL     ] QUAD: No primary data file found to delete.
[2025-10-24T20:45:45.765596] [INFO ] [LOCAL     ] QUAD: Starting deletion of derivative data.
[2025-10-24T20:45:45.765781] [DEBUG] [LOCAL     ] QUAD: Deleted derivative data file.
[2025-10-24T20:45:45.765874] [INFO ] [MAIN      ] Update Progress: 1757/2366 symbols completed. QUAD took 31.8s. Estimated remaining: 1h 18m 14s. Rate: 7.8 symbols/min
[2025-10-24T20:45:46.547615] [INFO ] [REMOTE    ] QVCD: Fetching primary data for 2025-04.
[2025-10-24T20:45:46.744344] [INFO ] [REMOTE    ] QXO: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T20:45:47.162553] [INFO ] [REMOTE    ] QVCD: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T20:45:47.347730] [INFO ] [REMOTE    ] QXO: Fetching primary data for 2025-02.
[2025-10-24T20:45:48.147616] [INFO ] [REMOTE    ] QVCC: Fetching primary data for 2025-09.
[2025-10-24T20:45:48.405925] [INFO ] [REMOTE    ] QXO: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T20:45:48.909249] [INFO ] [REMOTE    ] QVCC: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T20:45:48.947595] [INFO ] [REMOTE    ] QVCC: Fetching primary data for 2025-10.
[2025-10-24T20:45:49.708272] [INFO ] [REMOTE    ] QVCC: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T20:45:49.710278] [INFO ] [REMOTE    ] QVCC: Full fetch complete (11823 records).
[2025-10-24T20:45:49.710344] [DEBUG] [VALIDATOR ] QVCC: Validating primary data.
[2025-10-24T20:45:49.710749] [FATAL] [VALIDATOR ] QVCC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:45:49.710844] [FATAL] [MAIN      ] QVCC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:45:49.710887] [WARN ] [MAIN      ] QVCC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:45:49.710924] [INFO ] [LOCAL     ] QVCC: Starting deletion of primary data.
[2025-10-24T20:45:49.710977] [DEBUG] [LOCAL     ] QVCC: No primary data file found to delete.
[2025-10-24T20:45:49.711019] [INFO ] [LOCAL     ] QVCC: Starting deletion of derivative data.
[2025-10-24T20:45:49.711155] [DEBUG] [LOCAL     ] QVCC: Deleted derivative data file.
[2025-10-24T20:45:49.711219] [INFO ] [MAIN      ] Update Progress: 1758/2366 symbols completed. QVCC took 27.7s. Estimated remaining: 1h 18m 5s. Rate: 7.8 symbols/min
[2025-10-24T20:45:49.747697] [INFO ] [REMOTE    ] QXO: Fetching primary data for 2025-03.
[2025-10-24T20:45:50.547732] [INFO ] [REMOTE    ] QVCD: Fetching primary data for 2025-05.
[2025-10-24T20:45:50.757256] [INFO ] [REMOTE    ] QXO: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T20:45:51.278113] [INFO ] [REMOTE    ] QVCD: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T20:45:51.347709] [INFO ] [REMOTE    ] QXO: Fetching primary data for 2025-04.
[2025-10-24T20:45:52.147624] [INFO ] [REMOTE    ] QVCD: Fetching primary data for 2025-06.
[2025-10-24T20:45:52.494484] [INFO ] [REMOTE    ] QXO: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T20:45:52.512878] [INFO ] [REMOTE    ] QVCD: Incremental fetch complete for 2025-06 (0.37 seconds).
[2025-10-24T20:45:52.947713] [INFO ] [REMOTE    ] QVCD: Fetching primary data for 2025-07.
[2025-10-24T20:45:53.747741] [INFO ] [REMOTE    ] QXO: Fetching primary data for 2025-05.
[2025-10-24T20:45:53.759757] [INFO ] [REMOTE    ] QVCD: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T20:45:54.554636] [INFO ] [REMOTE    ] QVCD: Fetching primary data for 2025-08.
[2025-10-24T20:45:54.559939] [INFO ] [REMOTE    ] QXO: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:45:55.210709] [INFO ] [REMOTE    ] QVCD: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T20:45:55.347632] [INFO ] [REMOTE    ] QVCD: Fetching primary data for 2025-09.
[2025-10-24T20:45:55.989608] [INFO ] [REMOTE    ] QVCD: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T20:45:56.147673] [INFO ] [REMOTE    ] QXO: Fetching primary data for 2025-06.
[2025-10-24T20:45:56.947731] [INFO ] [REMOTE    ] QVCD: Fetching primary data for 2025-10.
[2025-10-24T20:45:57.229866] [INFO ] [REMOTE    ] QXO: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T20:45:57.588869] [INFO ] [REMOTE    ] QVCD: Incremental fetch complete for 2025-10 (0.64 seconds).
[2025-10-24T20:45:57.590260] [INFO ] [REMOTE    ] QVCD: Full fetch complete (6163 records).
[2025-10-24T20:45:57.590328] [DEBUG] [VALIDATOR ] QVCD: Validating primary data.
[2025-10-24T20:45:57.590696] [FATAL] [VALIDATOR ] QVCD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:45:57.590778] [FATAL] [MAIN      ] QVCD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:45:57.590850] [WARN ] [MAIN      ] QVCD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:45:57.590920] [INFO ] [LOCAL     ] QVCD: Starting deletion of primary data.
[2025-10-24T20:45:57.590981] [DEBUG] [LOCAL     ] QVCD: No primary data file found to delete.
[2025-10-24T20:45:57.591016] [INFO ] [LOCAL     ] QVCD: Starting deletion of derivative data.
[2025-10-24T20:45:57.591244] [DEBUG] [LOCAL     ] QVCD: Deleted derivative data file.
[2025-10-24T20:45:57.591328] [INFO ] [MAIN      ] Update Progress: 1759/2366 symbols completed. QVCD took 19.7s. Estimated remaining: 1h 17m 57s. Rate: 7.8 symbols/min
[2025-10-24T20:45:57.747679] [INFO ] [REMOTE    ] QXO: Fetching primary data for 2025-07.
[2025-10-24T20:45:58.585241] [INFO ] [REMOTE    ] QXO: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T20:45:58.600622] [INFO ] [REMOTE    ] QXO: Fetching primary data for 2025-08.
[2025-10-24T20:45:59.430344] [INFO ] [REMOTE    ] QXO: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T20:45:59.441721] [INFO ] [REMOTE    ] QXO: Fetching primary data for 2025-09.
[2025-10-24T20:46:00.604983] [INFO ] [REMOTE    ] QXO: Incremental fetch complete for 2025-09 (1.16 seconds).
[2025-10-24T20:46:00.619134] [INFO ] [REMOTE    ] QXO: Fetching primary data for 2025-10.
[2025-10-24T20:46:01.509175] [INFO ] [REMOTE    ] QXO: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T20:46:01.519226] [INFO ] [REMOTE    ] QXO: Full fetch complete (75964 records).
[2025-10-24T20:46:01.519392] [DEBUG] [VALIDATOR ] QXO: Validating primary data.
[2025-10-24T20:46:01.520279] [FATAL] [VALIDATOR ] QXO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:46:01.520386] [FATAL] [MAIN      ] QXO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:46:01.520429] [WARN ] [MAIN      ] QXO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:46:01.520495] [INFO ] [LOCAL     ] QXO: Starting deletion of primary data.
[2025-10-24T20:46:01.520560] [DEBUG] [LOCAL     ] QXO: No primary data file found to delete.
[2025-10-24T20:46:01.520596] [INFO ] [LOCAL     ] QXO: Starting deletion of derivative data.
[2025-10-24T20:46:01.520812] [DEBUG] [LOCAL     ] QXO: Deleted derivative data file.
[2025-10-24T20:46:01.521158] [INFO ] [MAIN      ] Update Progress: 1760/2366 symbols completed. QXO took 22.4s. Estimated remaining: 1h 17m 48s. Rate: 7.8 symbols/min
[2025-10-24T20:46:02.245539] [INFO ] [MAIN      ] RACE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:46:02.210744] [INFO ] [MAIN      ] RA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:46:02.252193] [INFO ] [MAIN      ] R: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:46:02.253263] [INFO ] [MAIN      ] RAMP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:46:02.295285] [DEBUG] [LOCAL     ] RA: Loaded 22073 existing records from primary storage.
[2025-10-24T20:46:02.295824] [INFO ] [MAIN      ] RA: Loaded 22073 existing records.
[2025-10-24T20:46:02.390153] [DEBUG] [LOCAL     ] R: Loaded 28186 existing records from primary storage.
[2025-10-24T20:46:02.452742] [INFO ] [MAIN      ] R: Loaded 28186 existing records.
[2025-10-24T20:46:02.452111] [DEBUG] [LOCAL     ] RAMP: Loaded 37923 existing records from primary storage.
[2025-10-24T20:46:02.452361] [DEBUG] [LOCAL     ] RACE: Loaded 33262 existing records from primary storage.
[2025-10-24T20:46:02.458328] [INFO ] [MAIN      ] RAMP: Loaded 37923 existing records.
[2025-10-24T20:46:02.487240] [INFO ] [MAIN      ] RACE: Loaded 33262 existing records.
[2025-10-24T20:46:02.776918] [WARN ] [MAIN      ] RA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:46:02.877442] [INFO ] [MAIN      ] RA: Wiping existing primary data before full refresh.
[2025-10-24T20:46:02.922838] [INFO ] [LOCAL     ] RA: Starting deletion of primary data.
[2025-10-24T20:46:03.028513] [DEBUG] [LOCAL     ] RA: Deleted primary data file.
[2025-10-24T20:46:03.051708] [INFO ] [MAIN      ] RA: Starting full primary refresh.
[2025-10-24T20:46:03.023287] [WARN ] [MAIN      ] R: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:46:03.112028] [INFO ] [MAIN      ] R: Wiping existing primary data before full refresh.
[2025-10-24T20:46:03.115854] [INFO ] [LOCAL     ] R: Starting deletion of primary data.
[2025-10-24T20:46:03.115744] [WARN ] [MAIN      ] RACE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:46:03.151532] [DEBUG] [LOCAL     ] R: Deleted primary data file.
[2025-10-24T20:46:03.187913] [INFO ] [MAIN      ] RACE: Wiping existing primary data before full refresh.
[2025-10-24T20:46:03.200283] [INFO ] [LOCAL     ] RACE: Starting deletion of primary data.
[2025-10-24T20:46:03.191837] [WARN ] [MAIN      ] RAMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:46:03.187826] [INFO ] [MAIN      ] R: Starting full primary refresh.
[2025-10-24T20:46:03.219701] [DEBUG] [LOCAL     ] RACE: Deleted primary data file.
[2025-10-24T20:46:03.227508] [INFO ] [MAIN      ] RACE: Starting full primary refresh.
[2025-10-24T20:46:03.200703] [INFO ] [MAIN      ] RAMP: Wiping existing primary data before full refresh.
[2025-10-24T20:46:03.282849] [INFO ] [LOCAL     ] RAMP: Starting deletion of primary data.
[2025-10-24T20:46:03.404770] [DEBUG] [LOCAL     ] RAMP: Deleted primary data file.
[2025-10-24T20:46:03.456501] [INFO ] [MAIN      ] RAMP: Starting full primary refresh.
[2025-10-24T20:46:04.228670] [INFO ] [REMOTE    ] RA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:46:04.332873] [INFO ] [REMOTE    ] RA: Fetching primary data for 2025-01.
[2025-10-24T20:46:04.559814] [INFO ] [REMOTE    ] R: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:46:04.577948] [INFO ] [REMOTE    ] R: Fetching primary data for 2025-01.
[2025-10-24T20:46:04.581607] [INFO ] [REMOTE    ] RACE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:46:04.583187] [INFO ] [REMOTE    ] RACE: Fetching primary data for 2025-01.
[2025-10-24T20:46:04.663611] [INFO ] [REMOTE    ] RAMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:46:04.663986] [INFO ] [REMOTE    ] RAMP: Fetching primary data for 2025-01.
[2025-10-24T20:46:05.055390] [INFO ] [REMOTE    ] RA: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T20:46:05.060218] [INFO ] [REMOTE    ] RA: Fetching primary data for 2025-02.
[2025-10-24T20:46:05.338416] [INFO ] [REMOTE    ] RACE: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T20:46:05.344979] [INFO ] [REMOTE    ] RACE: Fetching primary data for 2025-02.
[2025-10-24T20:46:05.378228] [INFO ] [REMOTE    ] RA: Incremental fetch complete for 2025-02 (0.32 seconds).
[2025-10-24T20:46:05.384248] [INFO ] [REMOTE    ] RAMP: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T20:46:05.424223] [INFO ] [REMOTE    ] R: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T20:46:05.747614] [INFO ] [REMOTE    ] R: Fetching primary data for 2025-02.
[2025-10-24T20:46:06.042041] [INFO ] [REMOTE    ] RACE: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T20:46:06.547617] [INFO ] [REMOTE    ] RACE: Fetching primary data for 2025-03.
[2025-10-24T20:46:06.630061] [INFO ] [REMOTE    ] R: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T20:46:07.279945] [INFO ] [REMOTE    ] RACE: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T20:46:07.347679] [INFO ] [REMOTE    ] RA: Fetching primary data for 2025-03.
[2025-10-24T20:46:08.002839] [INFO ] [REMOTE    ] RA: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T20:46:08.147672] [INFO ] [REMOTE    ] R: Fetching primary data for 2025-03.
[2025-10-24T20:46:08.947698] [INFO ] [REMOTE    ] RACE: Fetching primary data for 2025-04.
[2025-10-24T20:46:09.160978] [INFO ] [REMOTE    ] R: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T20:46:09.747759] [INFO ] [REMOTE    ] RA: Fetching primary data for 2025-04.
[2025-10-24T20:46:10.015924] [INFO ] [REMOTE    ] RACE: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T20:46:10.328486] [INFO ] [REMOTE    ] RA: Incremental fetch complete for 2025-04 (0.58 seconds).
[2025-10-24T20:46:10.547681] [INFO ] [REMOTE    ] RA: Fetching primary data for 2025-05.
[2025-10-24T20:46:11.347689] [INFO ] [REMOTE    ] RACE: Fetching primary data for 2025-05.
[2025-10-24T20:46:11.528429] [INFO ] [REMOTE    ] RA: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T20:46:12.147703] [INFO ] [REMOTE    ] RAMP: Fetching primary data for 2025-02.
[2025-10-24T20:46:12.330542] [INFO ] [REMOTE    ] RACE: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T20:46:12.947666] [INFO ] [REMOTE    ] R: Fetching primary data for 2025-04.
[2025-10-24T20:46:13.127909] [INFO ] [REMOTE    ] RAMP: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T20:46:13.747729] [INFO ] [REMOTE    ] RA: Fetching primary data for 2025-06.
[2025-10-24T20:46:13.970420] [INFO ] [REMOTE    ] R: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T20:46:14.547624] [INFO ] [REMOTE    ] RAMP: Fetching primary data for 2025-03.
[2025-10-24T20:46:14.717142] [INFO ] [REMOTE    ] RA: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T20:46:15.347724] [INFO ] [REMOTE    ] RACE: Fetching primary data for 2025-06.
[2025-10-24T20:46:15.495177] [INFO ] [REMOTE    ] RAMP: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T20:46:16.147713] [INFO ] [REMOTE    ] RAMP: Fetching primary data for 2025-04.
[2025-10-24T20:46:16.277356] [INFO ] [REMOTE    ] RACE: Incremental fetch complete for 2025-06 (0.93 seconds).
[2025-10-24T20:46:16.859884] [INFO ] [REMOTE    ] RAMP: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T20:46:16.947611] [INFO ] [REMOTE    ] RA: Fetching primary data for 2025-07.
[2025-10-24T20:46:17.747634] [INFO ] [REMOTE    ] RAMP: Fetching primary data for 2025-05.
[2025-10-24T20:46:18.007857] [INFO ] [REMOTE    ] RA: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T20:46:18.547684] [INFO ] [REMOTE    ] RACE: Fetching primary data for 2025-07.
[2025-10-24T20:46:18.743891] [INFO ] [REMOTE    ] RAMP: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T20:46:19.046092] [INFO ] [REMOTE    ] RACE: Incremental fetch complete for 2025-07 (0.50 seconds).
[2025-10-24T20:46:19.347731] [INFO ] [REMOTE    ] R: Fetching primary data for 2025-05.
[2025-10-24T20:46:20.071208] [INFO ] [REMOTE    ] R: Incremental fetch complete for 2025-05 (0.72 seconds).
[2025-10-24T20:46:20.147638] [INFO ] [REMOTE    ] R: Fetching primary data for 2025-06.
[2025-10-24T20:46:20.947626] [INFO ] [REMOTE    ] RAMP: Fetching primary data for 2025-06.
[2025-10-24T20:46:21.042254] [INFO ] [REMOTE    ] R: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T20:46:21.671578] [INFO ] [REMOTE    ] RAMP: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T20:46:21.747666] [INFO ] [REMOTE    ] RACE: Fetching primary data for 2025-08.
[2025-10-24T20:46:22.439813] [INFO ] [REMOTE    ] RACE: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T20:46:22.547628] [INFO ] [REMOTE    ] RACE: Fetching primary data for 2025-09.
[2025-10-24T20:46:23.103877] [INFO ] [REMOTE    ] RACE: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T20:46:23.347713] [INFO ] [REMOTE    ] RA: Fetching primary data for 2025-08.
[2025-10-24T20:46:23.995730] [INFO ] [REMOTE    ] RA: Incremental fetch complete for 2025-08 (0.65 seconds).
[2025-10-24T20:46:24.147708] [INFO ] [REMOTE    ] RAMP: Fetching primary data for 2025-07.
[2025-10-24T20:46:24.947629] [INFO ] [REMOTE    ] R: Fetching primary data for 2025-07.
[2025-10-24T20:46:25.170928] [INFO ] [REMOTE    ] RAMP: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T20:46:25.488625] [INFO ] [REMOTE    ] R: Incremental fetch complete for 2025-07 (0.54 seconds).
[2025-10-24T20:46:25.747638] [INFO ] [REMOTE    ] R: Fetching primary data for 2025-08.
[2025-10-24T20:46:26.547671] [INFO ] [REMOTE    ] RA: Fetching primary data for 2025-09.
[2025-10-24T20:46:26.659811] [INFO ] [REMOTE    ] R: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T20:46:27.117802] [INFO ] [REMOTE    ] RA: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T20:46:27.347690] [INFO ] [REMOTE    ] R: Fetching primary data for 2025-09.
[2025-10-24T20:46:27.918300] [INFO ] [REMOTE    ] R: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T20:46:28.147615] [INFO ] [REMOTE    ] RACE: Fetching primary data for 2025-10.
[2025-10-24T20:46:28.861305] [INFO ] [REMOTE    ] RACE: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T20:46:28.869094] [INFO ] [REMOTE    ] RACE: Full fetch complete (49416 records).
[2025-10-24T20:46:28.869202] [DEBUG] [VALIDATOR ] RACE: Validating primary data.
[2025-10-24T20:46:28.869842] [FATAL] [VALIDATOR ] RACE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:46:28.869925] [FATAL] [MAIN      ] RACE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:46:28.869966] [WARN ] [MAIN      ] RACE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:46:28.870028] [INFO ] [LOCAL     ] RACE: Starting deletion of primary data.
[2025-10-24T20:46:28.870088] [DEBUG] [LOCAL     ] RACE: No primary data file found to delete.
[2025-10-24T20:46:28.870122] [INFO ] [LOCAL     ] RACE: Starting deletion of derivative data.
[2025-10-24T20:46:28.870285] [DEBUG] [LOCAL     ] RACE: Deleted derivative data file.
[2025-10-24T20:46:28.870370] [INFO ] [MAIN      ] Update Progress: 1761/2366 symbols completed. RACE took 27.3s. Estimated remaining: 1h 17m 48s. Rate: 7.8 symbols/min
[2025-10-24T20:46:28.952771] [INFO ] [REMOTE    ] RAMP: Fetching primary data for 2025-08.
[2025-10-24T20:46:29.042751] [INFO ] [MAIN      ] RBA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:46:29.087508] [DEBUG] [LOCAL     ] RBA: Loaded 46387 existing records from primary storage.
[2025-10-24T20:46:29.087864] [INFO ] [MAIN      ] RBA: Loaded 46387 existing records.
[2025-10-24T20:46:29.274108] [WARN ] [MAIN      ] RBA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:46:29.274389] [INFO ] [MAIN      ] RBA: Wiping existing primary data before full refresh.
[2025-10-24T20:46:29.274456] [INFO ] [LOCAL     ] RBA: Starting deletion of primary data.
[2025-10-24T20:46:29.275269] [DEBUG] [LOCAL     ] RBA: Deleted primary data file.
[2025-10-24T20:46:29.275328] [INFO ] [MAIN      ] RBA: Starting full primary refresh.
[2025-10-24T20:46:29.625011] [INFO ] [REMOTE    ] RBA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:46:29.747671] [INFO ] [REMOTE    ] RA: Fetching primary data for 2025-10.
[2025-10-24T20:46:30.128131] [INFO ] [REMOTE    ] RAMP: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T20:46:30.339851] [INFO ] [REMOTE    ] RA: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T20:46:30.344157] [INFO ] [REMOTE    ] RA: Full fetch complete (31780 records).
[2025-10-24T20:46:30.344234] [DEBUG] [VALIDATOR ] RA: Validating primary data.
[2025-10-24T20:46:30.344692] [FATAL] [VALIDATOR ] RA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:46:30.344772] [FATAL] [MAIN      ] RA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:46:30.344814] [WARN ] [MAIN      ] RA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:46:30.344863] [INFO ] [LOCAL     ] RA: Starting deletion of primary data.
[2025-10-24T20:46:30.344940] [DEBUG] [LOCAL     ] RA: No primary data file found to delete.
[2025-10-24T20:46:30.344979] [INFO ] [LOCAL     ] RA: Starting deletion of derivative data.
[2025-10-24T20:46:30.345139] [DEBUG] [LOCAL     ] RA: Deleted derivative data file.
[2025-10-24T20:46:30.345235] [INFO ] [MAIN      ] Update Progress: 1762/2366 symbols completed. RA took 28.8s. Estimated remaining: 1h 17m 38s. Rate: 7.8 symbols/min
[2025-10-24T20:46:30.513175] [INFO ] [MAIN      ] RBC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:46:30.529970] [DEBUG] [LOCAL     ] RBC: Loaded 15417 existing records from primary storage.
[2025-10-24T20:46:30.530201] [INFO ] [MAIN      ] RBC: Loaded 15417 existing records.
[2025-10-24T20:46:30.552912] [INFO ] [REMOTE    ] RAMP: Fetching primary data for 2025-09.
[2025-10-24T20:46:30.712076] [WARN ] [MAIN      ] RBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:46:30.712352] [INFO ] [MAIN      ] RBC: Wiping existing primary data before full refresh.
[2025-10-24T20:46:30.712420] [INFO ] [LOCAL     ] RBC: Starting deletion of primary data.
[2025-10-24T20:46:30.712832] [DEBUG] [LOCAL     ] RBC: Deleted primary data file.
[2025-10-24T20:46:30.712892] [INFO ] [MAIN      ] RBC: Starting full primary refresh.
[2025-10-24T20:46:31.077042] [INFO ] [REMOTE    ] RBC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:46:31.347616] [INFO ] [REMOTE    ] R: Fetching primary data for 2025-10.
[2025-10-24T20:46:31.596451] [INFO ] [REMOTE    ] RAMP: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T20:46:32.147692] [INFO ] [REMOTE    ] RAMP: Fetching primary data for 2025-10.
[2025-10-24T20:46:32.495535] [INFO ] [REMOTE    ] R: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T20:46:32.501319] [INFO ] [REMOTE    ] R: Full fetch complete (42317 records).
[2025-10-24T20:46:32.501447] [DEBUG] [VALIDATOR ] R: Validating primary data.
[2025-10-24T20:46:32.502037] [FATAL] [VALIDATOR ] R: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:46:32.502121] [FATAL] [MAIN      ] R: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:46:32.502163] [WARN ] [MAIN      ] R: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:46:32.502226] [INFO ] [LOCAL     ] R: Starting deletion of primary data.
[2025-10-24T20:46:32.502288] [DEBUG] [LOCAL     ] R: No primary data file found to delete.
[2025-10-24T20:46:32.502322] [INFO ] [LOCAL     ] R: Starting deletion of derivative data.
[2025-10-24T20:46:32.502467] [DEBUG] [LOCAL     ] R: Deleted derivative data file.
[2025-10-24T20:46:32.502535] [INFO ] [MAIN      ] Update Progress: 1763/2366 symbols completed. R took 31.0s. Estimated remaining: 1h 17m 28s. Rate: 7.8 symbols/min
[2025-10-24T20:46:32.676348] [INFO ] [MAIN      ] RBLX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:46:32.729554] [DEBUG] [LOCAL     ] RBLX: Loaded 54107 existing records from primary storage.
[2025-10-24T20:46:32.729896] [INFO ] [MAIN      ] RBLX: Loaded 54107 existing records.
[2025-10-24T20:46:32.907781] [WARN ] [MAIN      ] RBLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:46:32.907978] [INFO ] [MAIN      ] RBLX: Wiping existing primary data before full refresh.
[2025-10-24T20:46:32.908024] [INFO ] [LOCAL     ] RBLX: Starting deletion of primary data.
[2025-10-24T20:46:32.909128] [DEBUG] [LOCAL     ] RBLX: Deleted primary data file.
[2025-10-24T20:46:32.909189] [INFO ] [MAIN      ] RBLX: Starting full primary refresh.
[2025-10-24T20:46:32.952901] [INFO ] [REMOTE    ] RBA: Fetching primary data for 2025-01.
[2025-10-24T20:46:33.278598] [INFO ] [REMOTE    ] RBLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:46:33.402798] [INFO ] [REMOTE    ] RAMP: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T20:46:33.410178] [INFO ] [REMOTE    ] RAMP: Full fetch complete (54604 records).
[2025-10-24T20:46:33.410343] [DEBUG] [VALIDATOR ] RAMP: Validating primary data.
[2025-10-24T20:46:33.410948] [FATAL] [VALIDATOR ] RAMP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:46:33.411041] [FATAL] [MAIN      ] RAMP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:46:33.411118] [WARN ] [MAIN      ] RAMP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:46:33.411212] [INFO ] [LOCAL     ] RAMP: Starting deletion of primary data.
[2025-10-24T20:46:33.411289] [DEBUG] [LOCAL     ] RAMP: No primary data file found to delete.
[2025-10-24T20:46:33.411325] [INFO ] [LOCAL     ] RAMP: Starting deletion of derivative data.
[2025-10-24T20:46:33.411483] [DEBUG] [LOCAL     ] RAMP: Deleted derivative data file.
[2025-10-24T20:46:33.411569] [INFO ] [MAIN      ] Update Progress: 1764/2366 symbols completed. RAMP took 31.9s. Estimated remaining: 1h 17m 18s. Rate: 7.8 symbols/min
[2025-10-24T20:46:33.580265] [INFO ] [MAIN      ] RBOT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:46:33.587718] [DEBUG] [LOCAL     ] RBOT: Loaded 6293 existing records from primary storage.
[2025-10-24T20:46:33.587939] [INFO ] [MAIN      ] RBOT: Loaded 6293 existing records.
[2025-10-24T20:46:33.752515] [INFO ] [REMOTE    ] RBLX: Fetching primary data for 2025-01.
[2025-10-24T20:46:33.782598] [WARN ] [MAIN      ] RBOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:46:33.783045] [INFO ] [MAIN      ] RBOT: Wiping existing primary data before full refresh.
[2025-10-24T20:46:33.783104] [INFO ] [LOCAL     ] RBOT: Starting deletion of primary data.
[2025-10-24T20:46:33.783405] [DEBUG] [LOCAL     ] RBOT: Deleted primary data file.
[2025-10-24T20:46:33.783446] [INFO ] [MAIN      ] RBOT: Starting full primary refresh.
[2025-10-24T20:46:34.143297] [INFO ] [REMOTE    ] RBOT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:46:34.165698] [INFO ] [REMOTE    ] RBA: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T20:46:34.547689] [INFO ] [REMOTE    ] RBA: Fetching primary data for 2025-02.
[2025-10-24T20:46:34.806264] [INFO ] [REMOTE    ] RBLX: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T20:46:35.309227] [INFO ] [REMOTE    ] RBA: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T20:46:35.347607] [INFO ] [REMOTE    ] RBA: Fetching primary data for 2025-03.
[2025-10-24T20:46:36.147671] [INFO ] [REMOTE    ] RBLX: Fetching primary data for 2025-02.
[2025-10-24T20:46:36.389979] [INFO ] [REMOTE    ] RBA: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T20:46:36.741232] [INFO ] [REMOTE    ] RBLX: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T20:46:36.947677] [INFO ] [REMOTE    ] RBLX: Fetching primary data for 2025-03.
[2025-10-24T20:46:37.747626] [INFO ] [REMOTE    ] RBC: Fetching primary data for 2025-01.
[2025-10-24T20:46:37.851062] [INFO ] [REMOTE    ] RBLX: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T20:46:38.547679] [INFO ] [REMOTE    ] RBLX: Fetching primary data for 2025-04.
[2025-10-24T20:46:38.597836] [INFO ] [REMOTE    ] RBC: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T20:46:39.347690] [INFO ] [REMOTE    ] RBC: Fetching primary data for 2025-02.
[2025-10-24T20:46:39.535481] [INFO ] [REMOTE    ] RBLX: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T20:46:39.901892] [INFO ] [REMOTE    ] RBC: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T20:46:40.147680] [INFO ] [REMOTE    ] RBA: Fetching primary data for 2025-04.
[2025-10-24T20:46:40.947691] [INFO ] [REMOTE    ] RBOT: Fetching primary data for 2025-01.
[2025-10-24T20:46:41.162102] [INFO ] [REMOTE    ] RBA: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T20:46:41.677776] [INFO ] [REMOTE    ] RBOT: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T20:46:41.747613] [INFO ] [REMOTE    ] RBOT: Fetching primary data for 2025-02.
[2025-10-24T20:46:42.506019] [INFO ] [REMOTE    ] RBOT: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T20:46:42.547678] [INFO ] [REMOTE    ] RBLX: Fetching primary data for 2025-05.
[2025-10-24T20:46:43.347678] [INFO ] [REMOTE    ] RBOT: Fetching primary data for 2025-03.
[2025-10-24T20:46:43.783802] [INFO ] [REMOTE    ] RBLX: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T20:46:43.949525] [INFO ] [REMOTE    ] RBOT: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T20:46:44.147712] [INFO ] [REMOTE    ] RBOT: Fetching primary data for 2025-04.
[2025-10-24T20:46:44.794099] [INFO ] [REMOTE    ] RBOT: Incremental fetch complete for 2025-04 (0.65 seconds).
[2025-10-24T20:46:44.947700] [INFO ] [REMOTE    ] RBC: Fetching primary data for 2025-03.
[2025-10-24T20:46:45.505816] [INFO ] [REMOTE    ] RBC: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T20:46:45.747706] [INFO ] [REMOTE    ] RBLX: Fetching primary data for 2025-06.
[2025-10-24T20:46:46.511996] [INFO ] [REMOTE    ] RBLX: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T20:46:46.547620] [INFO ] [REMOTE    ] RBLX: Fetching primary data for 2025-07.
[2025-10-24T20:46:47.347622] [INFO ] [REMOTE    ] RBA: Fetching primary data for 2025-05.
[2025-10-24T20:46:47.876367] [INFO ] [REMOTE    ] RBLX: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T20:46:48.147714] [INFO ] [REMOTE    ] RBOT: Fetching primary data for 2025-05.
[2025-10-24T20:46:48.352914] [INFO ] [REMOTE    ] RBA: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T20:46:48.528060] [INFO ] [REMOTE    ] RBOT: Incremental fetch complete for 2025-05 (0.38 seconds).
[2025-10-24T20:46:48.947673] [INFO ] [REMOTE    ] RBLX: Fetching primary data for 2025-08.
[2025-10-24T20:46:49.747690] [INFO ] [REMOTE    ] RBOT: Fetching primary data for 2025-06.
[2025-10-24T20:46:50.021766] [INFO ] [REMOTE    ] RBLX: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T20:46:50.439047] [INFO ] [REMOTE    ] RBOT: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T20:46:50.547716] [INFO ] [REMOTE    ] RBLX: Fetching primary data for 2025-09.
[2025-10-24T20:46:51.347700] [INFO ] [REMOTE    ] RBOT: Fetching primary data for 2025-07.
[2025-10-24T20:46:51.573626] [INFO ] [REMOTE    ] RBLX: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T20:46:51.801962] [INFO ] [REMOTE    ] RBOT: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T20:46:52.147670] [INFO ] [REMOTE    ] RBOT: Fetching primary data for 2025-08.
[2025-10-24T20:46:52.604961] [INFO ] [REMOTE    ] RBOT: Incremental fetch complete for 2025-08 (0.46 seconds).
[2025-10-24T20:46:52.947700] [INFO ] [REMOTE    ] RBOT: Fetching primary data for 2025-09.
[2025-10-24T20:46:53.700057] [INFO ] [REMOTE    ] RBOT: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T20:46:53.747609] [INFO ] [REMOTE    ] RBOT: Fetching primary data for 2025-10.
[2025-10-24T20:46:54.486560] [INFO ] [REMOTE    ] RBOT: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T20:46:54.489456] [INFO ] [REMOTE    ] RBOT: Full fetch complete (9084 records).
[2025-10-24T20:46:54.489528] [DEBUG] [VALIDATOR ] RBOT: Validating primary data.
[2025-10-24T20:46:54.489927] [FATAL] [VALIDATOR ] RBOT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:46:54.490004] [FATAL] [MAIN      ] RBOT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:46:54.490046] [WARN ] [MAIN      ] RBOT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:46:54.490084] [INFO ] [LOCAL     ] RBOT: Starting deletion of primary data.
[2025-10-24T20:46:54.490137] [DEBUG] [LOCAL     ] RBOT: No primary data file found to delete.
[2025-10-24T20:46:54.490189] [INFO ] [LOCAL     ] RBOT: Starting deletion of derivative data.
[2025-10-24T20:46:54.490363] [DEBUG] [LOCAL     ] RBOT: Deleted derivative data file.
[2025-10-24T20:46:54.490447] [INFO ] [MAIN      ] Update Progress: 1765/2366 symbols completed. RBOT took 21.1s. Estimated remaining: 1h 17m 15s. Rate: 7.8 symbols/min
[2025-10-24T20:46:54.557421] [INFO ] [REMOTE    ] RBA: Fetching primary data for 2025-06.
[2025-10-24T20:46:54.672340] [INFO ] [MAIN      ] RBRK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:46:54.722880] [DEBUG] [LOCAL     ] RBRK: Loaded 53553 existing records from primary storage.
[2025-10-24T20:46:54.723198] [INFO ] [MAIN      ] RBRK: Loaded 53553 existing records.
[2025-10-24T20:46:54.946481] [WARN ] [MAIN      ] RBRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:46:54.946700] [INFO ] [MAIN      ] RBRK: Wiping existing primary data before full refresh.
[2025-10-24T20:46:54.946757] [INFO ] [LOCAL     ] RBRK: Starting deletion of primary data.
[2025-10-24T20:46:54.947473] [DEBUG] [LOCAL     ] RBRK: Deleted primary data file.
[2025-10-24T20:46:54.947534] [INFO ] [MAIN      ] RBRK: Starting full primary refresh.
[2025-10-24T20:46:55.329888] [INFO ] [REMOTE    ] RBRK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:46:55.357627] [INFO ] [REMOTE    ] RBC: Fetching primary data for 2025-04.
[2025-10-24T20:46:55.363973] [INFO ] [REMOTE    ] RBA: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T20:46:56.147726] [INFO ] [REMOTE    ] RBA: Fetching primary data for 2025-07.
[2025-10-24T20:46:56.315523] [INFO ] [REMOTE    ] RBC: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T20:46:56.947635] [INFO ] [REMOTE    ] RBLX: Fetching primary data for 2025-10.
[2025-10-24T20:46:57.124998] [INFO ] [REMOTE    ] RBA: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T20:46:57.743065] [INFO ] [REMOTE    ] RBLX: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T20:46:57.751609] [INFO ] [REMOTE    ] RBRK: Fetching primary data for 2025-01.
[2025-10-24T20:46:57.753202] [INFO ] [REMOTE    ] RBLX: Full fetch complete (77496 records).
[2025-10-24T20:46:57.753286] [DEBUG] [VALIDATOR ] RBLX: Validating primary data.
[2025-10-24T20:46:57.754202] [FATAL] [VALIDATOR ] RBLX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:46:57.754290] [FATAL] [MAIN      ] RBLX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:46:57.754356] [WARN ] [MAIN      ] RBLX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:46:57.754429] [INFO ] [LOCAL     ] RBLX: Starting deletion of primary data.
[2025-10-24T20:46:57.754491] [DEBUG] [LOCAL     ] RBLX: No primary data file found to delete.
[2025-10-24T20:46:57.754528] [INFO ] [LOCAL     ] RBLX: Starting deletion of derivative data.
[2025-10-24T20:46:57.754752] [DEBUG] [LOCAL     ] RBLX: Deleted derivative data file.
[2025-10-24T20:46:57.755270] [INFO ] [MAIN      ] Update Progress: 1766/2366 symbols completed. RBLX took 25.3s. Estimated remaining: 1h 17m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:46:57.925599] [INFO ] [MAIN      ] RC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:46:57.968926] [DEBUG] [LOCAL     ] RC: Loaded 49201 existing records from primary storage.
[2025-10-24T20:46:57.969256] [INFO ] [MAIN      ] RC: Loaded 49201 existing records.
[2025-10-24T20:46:58.145274] [WARN ] [MAIN      ] RC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:46:58.145467] [INFO ] [MAIN      ] RC: Wiping existing primary data before full refresh.
[2025-10-24T20:46:58.145558] [INFO ] [LOCAL     ] RC: Starting deletion of primary data.
[2025-10-24T20:46:58.146388] [DEBUG] [LOCAL     ] RC: Deleted primary data file.
[2025-10-24T20:46:58.146446] [INFO ] [MAIN      ] RC: Starting full primary refresh.
[2025-10-24T20:46:58.502558] [INFO ] [REMOTE    ] RC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:46:58.547615] [INFO ] [REMOTE    ] RBA: Fetching primary data for 2025-08.
[2025-10-24T20:46:58.879160] [INFO ] [REMOTE    ] RBRK: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T20:46:59.347622] [INFO ] [REMOTE    ] RBRK: Fetching primary data for 2025-02.
[2025-10-24T20:46:59.375409] [INFO ] [REMOTE    ] RBA: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T20:47:00.147623] [INFO ] [REMOTE    ] RBC: Fetching primary data for 2025-05.
[2025-10-24T20:47:00.416107] [INFO ] [REMOTE    ] RBRK: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T20:47:00.947620] [INFO ] [REMOTE    ] RC: Fetching primary data for 2025-01.
[2025-10-24T20:47:01.094703] [INFO ] [REMOTE    ] RBC: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T20:47:01.747694] [INFO ] [REMOTE    ] RBA: Fetching primary data for 2025-09.
[2025-10-24T20:47:01.875151] [INFO ] [REMOTE    ] RC: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T20:47:02.547616] [INFO ] [REMOTE    ] RBRK: Fetching primary data for 2025-03.
[2025-10-24T20:47:02.890920] [INFO ] [REMOTE    ] RBA: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T20:47:03.347688] [INFO ] [REMOTE    ] RBC: Fetching primary data for 2025-06.
[2025-10-24T20:47:04.128000] [INFO ] [REMOTE    ] RBRK: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T20:47:04.147630] [INFO ] [REMOTE    ] RBRK: Fetching primary data for 2025-04.
[2025-10-24T20:47:04.217372] [INFO ] [REMOTE    ] RBC: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T20:47:04.947625] [INFO ] [REMOTE    ] RC: Fetching primary data for 2025-02.
[2025-10-24T20:47:05.346256] [INFO ] [REMOTE    ] RBRK: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T20:47:05.537802] [INFO ] [REMOTE    ] RC: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T20:47:05.747727] [INFO ] [REMOTE    ] RBA: Fetching primary data for 2025-10.
[2025-10-24T20:47:06.506771] [INFO ] [REMOTE    ] RBA: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T20:47:06.515313] [INFO ] [REMOTE    ] RBA: Full fetch complete (66319 records).
[2025-10-24T20:47:06.515470] [DEBUG] [VALIDATOR ] RBA: Validating primary data.
[2025-10-24T20:47:06.516288] [FATAL] [VALIDATOR ] RBA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:47:06.516389] [FATAL] [MAIN      ] RBA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:47:06.516434] [WARN ] [MAIN      ] RBA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:47:06.516472] [INFO ] [LOCAL     ] RBA: Starting deletion of primary data.
[2025-10-24T20:47:06.516528] [DEBUG] [LOCAL     ] RBA: No primary data file found to delete.
[2025-10-24T20:47:06.516563] [INFO ] [LOCAL     ] RBA: Starting deletion of derivative data.
[2025-10-24T20:47:06.516742] [DEBUG] [LOCAL     ] RBA: Deleted derivative data file.
[2025-10-24T20:47:06.517071] [INFO ] [MAIN      ] Update Progress: 1767/2366 symbols completed. RBA took 37.6s. Estimated remaining: 1h 16m 58s. Rate: 7.8 symbols/min
[2025-10-24T20:47:06.552836] [INFO ] [REMOTE    ] RBC: Fetching primary data for 2025-07.
[2025-10-24T20:47:06.702817] [INFO ] [MAIN      ] RCB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:47:06.703017] [DEBUG] [LOCAL     ] RCB: No existing data file found in primary storage.
[2025-10-24T20:47:06.703055] [WARN ] [MAIN      ] RCB: No existing data found, performing full refresh instead.
[2025-10-24T20:47:06.703171] [INFO ] [MAIN      ] RCB: Wiping existing primary data before full refresh.
[2025-10-24T20:47:06.703260] [INFO ] [LOCAL     ] RCB: Starting deletion of primary data.
[2025-10-24T20:47:06.703346] [DEBUG] [LOCAL     ] RCB: No primary data file found to delete.
[2025-10-24T20:47:06.703391] [INFO ] [MAIN      ] RCB: Starting full primary refresh.
[2025-10-24T20:47:07.065216] [INFO ] [REMOTE    ] RCB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:47:07.347625] [INFO ] [REMOTE    ] RBRK: Fetching primary data for 2025-05.
[2025-10-24T20:47:07.646801] [INFO ] [REMOTE    ] RBC: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T20:47:08.159975] [INFO ] [REMOTE    ] RBC: Fetching primary data for 2025-08.
[2025-10-24T20:47:08.186567] [INFO ] [REMOTE    ] RBRK: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T20:47:08.947683] [INFO ] [REMOTE    ] RC: Fetching primary data for 2025-03.
[2025-10-24T20:47:08.997984] [INFO ] [REMOTE    ] RBC: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T20:47:09.743935] [INFO ] [REMOTE    ] RC: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T20:47:09.753837] [INFO ] [REMOTE    ] RCB: Fetching primary data for 2025-01.
[2025-10-24T20:47:10.261747] [INFO ] [REMOTE    ] RCB: Incremental fetch complete for 2025-01 (0.51 seconds).
[2025-10-24T20:47:10.547669] [INFO ] [REMOTE    ] RC: Fetching primary data for 2025-04.
[2025-10-24T20:47:11.320440] [INFO ] [REMOTE    ] RC: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T20:47:11.347609] [INFO ] [REMOTE    ] RC: Fetching primary data for 2025-05.
[2025-10-24T20:47:12.147722] [INFO ] [REMOTE    ] RBC: Fetching primary data for 2025-09.
[2025-10-24T20:47:12.469925] [INFO ] [REMOTE    ] RC: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T20:47:12.947713] [INFO ] [REMOTE    ] RC: Fetching primary data for 2025-06.
[2025-10-24T20:47:12.986859] [INFO ] [REMOTE    ] RBC: Incremental fetch complete for 2025-09 (0.84 seconds).
[2025-10-24T20:47:13.747611] [INFO ] [REMOTE    ] RBC: Fetching primary data for 2025-10.
[2025-10-24T20:47:13.927271] [INFO ] [REMOTE    ] RC: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T20:47:14.303281] [INFO ] [REMOTE    ] RBC: Incremental fetch complete for 2025-10 (0.56 seconds).
[2025-10-24T20:47:14.307276] [INFO ] [REMOTE    ] RBC: Full fetch complete (21843 records).
[2025-10-24T20:47:14.307382] [DEBUG] [VALIDATOR ] RBC: Validating primary data.
[2025-10-24T20:47:14.307958] [FATAL] [VALIDATOR ] RBC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:47:14.308045] [FATAL] [MAIN      ] RBC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:47:14.308088] [WARN ] [MAIN      ] RBC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:47:14.308129] [INFO ] [LOCAL     ] RBC: Starting deletion of primary data.
[2025-10-24T20:47:14.308196] [DEBUG] [LOCAL     ] RBC: No primary data file found to delete.
[2025-10-24T20:47:14.308233] [INFO ] [LOCAL     ] RBC: Starting deletion of derivative data.
[2025-10-24T20:47:14.308423] [DEBUG] [LOCAL     ] RBC: Deleted derivative data file.
[2025-10-24T20:47:14.308500] [INFO ] [MAIN      ] Update Progress: 1768/2366 symbols completed. RBC took 44.0s. Estimated remaining: 1h 16m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:47:14.492330] [INFO ] [MAIN      ] RCD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:47:14.497568] [DEBUG] [LOCAL     ] RCD: Loaded 3372 existing records from primary storage.
[2025-10-24T20:47:14.497810] [INFO ] [MAIN      ] RCD: Loaded 3372 existing records.
[2025-10-24T20:47:14.552872] [INFO ] [REMOTE    ] RC: Fetching primary data for 2025-07.
[2025-10-24T20:47:14.677807] [WARN ] [MAIN      ] RCD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:47:14.678040] [INFO ] [MAIN      ] RCD: Wiping existing primary data before full refresh.
[2025-10-24T20:47:14.678088] [INFO ] [LOCAL     ] RCD: Starting deletion of primary data.
[2025-10-24T20:47:14.678229] [DEBUG] [LOCAL     ] RCD: Deleted primary data file.
[2025-10-24T20:47:14.678304] [INFO ] [MAIN      ] RCD: Starting full primary refresh.
[2025-10-24T20:47:15.047784] [INFO ] [REMOTE    ] RCD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:47:15.355084] [INFO ] [REMOTE    ] RCB: Fetching primary data for 2025-02.
[2025-10-24T20:47:15.358025] [INFO ] [REMOTE    ] RC: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T20:47:16.062287] [INFO ] [REMOTE    ] RCB: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T20:47:16.147603] [INFO ] [REMOTE    ] RCB: Fetching primary data for 2025-03.
[2025-10-24T20:47:16.513746] [INFO ] [REMOTE    ] RCB: Incremental fetch complete for 2025-03 (0.37 seconds).
[2025-10-24T20:47:16.947719] [INFO ] [REMOTE    ] RC: Fetching primary data for 2025-08.
[2025-10-24T20:47:17.747739] [INFO ] [REMOTE    ] RCD: Fetching primary data for 2025-01.
[2025-10-24T20:47:18.386360] [INFO ] [REMOTE    ] RCD: Incremental fetch complete for 2025-01 (0.64 seconds).
[2025-10-24T20:47:18.387862] [INFO ] [REMOTE    ] RC: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T20:47:18.547621] [INFO ] [REMOTE    ] RC: Fetching primary data for 2025-09.
[2025-10-24T20:47:19.347622] [INFO ] [REMOTE    ] RBRK: Fetching primary data for 2025-06.
[2025-10-24T20:47:19.528427] [INFO ] [REMOTE    ] RC: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T20:47:20.147710] [INFO ] [REMOTE    ] RCB: Fetching primary data for 2025-04.
[2025-10-24T20:47:20.624143] [INFO ] [REMOTE    ] RCB: Incremental fetch complete for 2025-04 (0.48 seconds).
[2025-10-24T20:47:20.660105] [INFO ] [REMOTE    ] RBRK: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T20:47:20.947728] [INFO ] [REMOTE    ] RCB: Fetching primary data for 2025-05.
[2025-10-24T20:47:21.747752] [INFO ] [REMOTE    ] RC: Fetching primary data for 2025-10.
[2025-10-24T20:47:21.909122] [INFO ] [REMOTE    ] RCB: Incremental fetch complete for 2025-05 (0.96 seconds).
[2025-10-24T20:47:22.547626] [INFO ] [REMOTE    ] RBRK: Fetching primary data for 2025-07.
[2025-10-24T20:47:22.813866] [INFO ] [REMOTE    ] RC: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T20:47:22.825143] [INFO ] [REMOTE    ] RC: Full fetch complete (70725 records).
[2025-10-24T20:47:22.825425] [DEBUG] [VALIDATOR ] RC: Validating primary data.
[2025-10-24T20:47:22.826991] [FATAL] [VALIDATOR ] RC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:47:22.827092] [FATAL] [MAIN      ] RC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:47:22.827138] [WARN ] [MAIN      ] RC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:47:22.827177] [INFO ] [LOCAL     ] RC: Starting deletion of primary data.
[2025-10-24T20:47:22.827236] [DEBUG] [LOCAL     ] RC: No primary data file found to delete.
[2025-10-24T20:47:22.827272] [INFO ] [LOCAL     ] RC: Starting deletion of derivative data.
[2025-10-24T20:47:22.827479] [DEBUG] [LOCAL     ] RC: Deleted derivative data file.
[2025-10-24T20:47:22.827979] [INFO ] [MAIN      ] Update Progress: 1769/2366 symbols completed. RC took 25.1s. Estimated remaining: 1h 16m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:47:23.025461] [INFO ] [MAIN      ] RCI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:47:23.064526] [INFO ] [REMOTE    ] RBRK: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T20:47:23.115578] [DEBUG] [LOCAL     ] RCI: Loaded 48956 existing records from primary storage.
[2025-10-24T20:47:23.115933] [INFO ] [MAIN      ] RCI: Loaded 48956 existing records.
[2025-10-24T20:47:23.289175] [WARN ] [MAIN      ] RCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:47:23.289378] [INFO ] [MAIN      ] RCI: Wiping existing primary data before full refresh.
[2025-10-24T20:47:23.289426] [INFO ] [LOCAL     ] RCI: Starting deletion of primary data.
[2025-10-24T20:47:23.290130] [DEBUG] [LOCAL     ] RCI: Deleted primary data file.
[2025-10-24T20:47:23.290185] [INFO ] [MAIN      ] RCI: Starting full primary refresh.
[2025-10-24T20:47:23.352865] [INFO ] [REMOTE    ] RCD: Fetching primary data for 2025-02.
[2025-10-24T20:47:23.675189] [INFO ] [REMOTE    ] RCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:47:24.124470] [INFO ] [REMOTE    ] RCD: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T20:47:24.147618] [INFO ] [REMOTE    ] RCD: Fetching primary data for 2025-03.
[2025-10-24T20:47:24.947696] [INFO ] [REMOTE    ] RCB: Fetching primary data for 2025-06.
[2025-10-24T20:47:25.065946] [INFO ] [REMOTE    ] RCD: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T20:47:25.536614] [INFO ] [REMOTE    ] RCB: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T20:47:25.747633] [INFO ] [REMOTE    ] RCB: Fetching primary data for 2025-07.
[2025-10-24T20:47:26.216060] [INFO ] [REMOTE    ] RCB: Incremental fetch complete for 2025-07 (0.47 seconds).
[2025-10-24T20:47:26.547738] [INFO ] [REMOTE    ] RCD: Fetching primary data for 2025-04.
[2025-10-24T20:47:27.163140] [INFO ] [REMOTE    ] RCD: Incremental fetch complete for 2025-04 (0.62 seconds).
[2025-10-24T20:47:27.347729] [INFO ] [REMOTE    ] RCB: Fetching primary data for 2025-08.
[2025-10-24T20:47:27.831456] [INFO ] [REMOTE    ] RCB: Incremental fetch complete for 2025-08 (0.48 seconds).
[2025-10-24T20:47:28.147639] [INFO ] [REMOTE    ] RCD: Fetching primary data for 2025-05.
[2025-10-24T20:47:28.828363] [INFO ] [REMOTE    ] RCD: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T20:47:28.947639] [INFO ] [REMOTE    ] RBRK: Fetching primary data for 2025-08.
[2025-10-24T20:47:29.747635] [INFO ] [REMOTE    ] RCD: Fetching primary data for 2025-06.
[2025-10-24T20:47:30.031671] [INFO ] [REMOTE    ] RBRK: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T20:47:30.353523] [INFO ] [REMOTE    ] RCD: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T20:47:30.547683] [INFO ] [REMOTE    ] RCD: Fetching primary data for 2025-07.
[2025-10-24T20:47:31.164296] [INFO ] [REMOTE    ] RCD: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T20:47:31.347637] [INFO ] [REMOTE    ] RBRK: Fetching primary data for 2025-09.
[2025-10-24T20:47:32.147686] [INFO ] [REMOTE    ] RCB: Fetching primary data for 2025-09.
[2025-10-24T20:47:32.348338] [INFO ] [REMOTE    ] RCB: Incremental fetch complete for 2025-09 (0.20 seconds).
[2025-10-24T20:47:32.525676] [INFO ] [REMOTE    ] RBRK: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T20:47:32.947631] [INFO ] [REMOTE    ] RBRK: Fetching primary data for 2025-10.
[2025-10-24T20:47:33.747632] [INFO ] [REMOTE    ] RCB: Fetching primary data for 2025-10.
[2025-10-24T20:47:33.781276] [INFO ] [REMOTE    ] RBRK: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T20:47:33.791254] [INFO ] [REMOTE    ] RBRK: Full fetch complete (76322 records).
[2025-10-24T20:47:33.791410] [DEBUG] [VALIDATOR ] RBRK: Validating primary data.
[2025-10-24T20:47:33.792261] [FATAL] [VALIDATOR ] RBRK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:47:33.792353] [FATAL] [MAIN      ] RBRK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:47:33.792398] [WARN ] [MAIN      ] RBRK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:47:33.792445] [INFO ] [LOCAL     ] RBRK: Starting deletion of primary data.
[2025-10-24T20:47:33.792531] [DEBUG] [LOCAL     ] RBRK: No primary data file found to delete.
[2025-10-24T20:47:33.792578] [INFO ] [LOCAL     ] RBRK: Starting deletion of derivative data.
[2025-10-24T20:47:33.792780] [DEBUG] [LOCAL     ] RBRK: Deleted derivative data file.
[2025-10-24T20:47:33.793151] [INFO ] [MAIN      ] Update Progress: 1770/2366 symbols completed. RBRK took 39.3s. Estimated remaining: 1h 16m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:47:33.966780] [INFO ] [MAIN      ] RCL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:47:34.015888] [DEBUG] [LOCAL     ] RCL: Loaded 52040 existing records from primary storage.
[2025-10-24T20:47:34.016223] [INFO ] [MAIN      ] RCL: Loaded 52040 existing records.
[2025-10-24T20:47:34.198480] [WARN ] [MAIN      ] RCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:47:34.198734] [INFO ] [MAIN      ] RCL: Wiping existing primary data before full refresh.
[2025-10-24T20:47:34.198787] [INFO ] [LOCAL     ] RCL: Starting deletion of primary data.
[2025-10-24T20:47:34.199243] [DEBUG] [LOCAL     ] RCL: Deleted primary data file.
[2025-10-24T20:47:34.199299] [INFO ] [MAIN      ] RCL: Starting full primary refresh.
[2025-10-24T20:47:34.278897] [INFO ] [REMOTE    ] RCB: Incremental fetch complete for 2025-10 (0.53 seconds).
[2025-10-24T20:47:34.296060] [INFO ] [REMOTE    ] RCB: Full fetch complete (3691 records).
[2025-10-24T20:47:34.307117] [DEBUG] [VALIDATOR ] RCB: Validating primary data.
[2025-10-24T20:47:34.308319] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:47:34.313882] [FATAL] [MAIN      ] RCB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:47:34.319139] [WARN ] [MAIN      ] RCB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:47:34.324366] [INFO ] [LOCAL     ] RCB: Starting deletion of primary data.
[2025-10-24T20:47:34.329751] [DEBUG] [LOCAL     ] RCB: No primary data file found to delete.
[2025-10-24T20:47:34.348578] [INFO ] [LOCAL     ] RCB: Starting deletion of derivative data.
[2025-10-24T20:47:34.359942] [DEBUG] [LOCAL     ] RCB: No derivative data file found to delete.
[2025-10-24T20:47:34.360075] [INFO ] [MAIN      ] Update Progress: 1771/2366 symbols completed. RCB took 27.8s. Estimated remaining: 1h 16m 26s. Rate: 7.8 symbols/min
[2025-10-24T20:47:34.554619] [INFO ] [REMOTE    ] RCD: Fetching primary data for 2025-08.
[2025-10-24T20:47:34.730880] [INFO ] [MAIN      ] RCS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:47:34.761169] [INFO ] [REMOTE    ] RCL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:47:34.772021] [DEBUG] [LOCAL     ] RCS: Loaded 12530 existing records from primary storage.
[2025-10-24T20:47:34.772258] [INFO ] [MAIN      ] RCS: Loaded 12530 existing records.
[2025-10-24T20:47:34.953579] [WARN ] [MAIN      ] RCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:47:34.953815] [INFO ] [MAIN      ] RCS: Wiping existing primary data before full refresh.
[2025-10-24T20:47:34.953863] [INFO ] [LOCAL     ] RCS: Starting deletion of primary data.
[2025-10-24T20:47:34.954067] [DEBUG] [LOCAL     ] RCS: Deleted primary data file.
[2025-10-24T20:47:34.954107] [INFO ] [MAIN      ] RCS: Starting full primary refresh.
[2025-10-24T20:47:35.293256] [INFO ] [REMOTE    ] RCD: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T20:47:35.325353] [INFO ] [REMOTE    ] RCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:47:35.347609] [INFO ] [REMOTE    ] RCD: Fetching primary data for 2025-09.
[2025-10-24T20:47:35.957982] [INFO ] [REMOTE    ] RCD: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T20:47:36.147695] [INFO ] [REMOTE    ] RCS: Fetching primary data for 2025-01.
[2025-10-24T20:47:36.947638] [INFO ] [REMOTE    ] RCI: Fetching primary data for 2025-01.
[2025-10-24T20:47:37.010598] [INFO ] [REMOTE    ] RCS: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T20:47:37.747620] [INFO ] [REMOTE    ] RCS: Fetching primary data for 2025-02.
[2025-10-24T20:47:37.971266] [INFO ] [REMOTE    ] RCI: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T20:47:38.540259] [INFO ] [REMOTE    ] RCS: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T20:47:38.547596] [INFO ] [REMOTE    ] RCS: Fetching primary data for 2025-03.
[2025-10-24T20:47:39.014463] [INFO ] [REMOTE    ] RCS: Incremental fetch complete for 2025-03 (0.47 seconds).
[2025-10-24T20:47:39.347626] [INFO ] [REMOTE    ] RCI: Fetching primary data for 2025-02.
[2025-10-24T20:47:40.147613] [INFO ] [REMOTE    ] RCS: Fetching primary data for 2025-04.
[2025-10-24T20:47:40.335829] [INFO ] [REMOTE    ] RCI: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T20:47:40.947609] [INFO ] [REMOTE    ] RCL: Fetching primary data for 2025-01.
[2025-10-24T20:47:40.976169] [INFO ] [REMOTE    ] RCS: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T20:47:41.714265] [INFO ] [REMOTE    ] RCL: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T20:47:41.747590] [INFO ] [REMOTE    ] RCL: Fetching primary data for 2025-02.
[2025-10-24T20:47:42.547710] [INFO ] [REMOTE    ] RCS: Fetching primary data for 2025-05.
[2025-10-24T20:47:42.854137] [INFO ] [REMOTE    ] RCL: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T20:47:43.028157] [INFO ] [REMOTE    ] RCS: Incremental fetch complete for 2025-05 (0.48 seconds).
[2025-10-24T20:47:43.347703] [INFO ] [REMOTE    ] RCD: Fetching primary data for 2025-10.
[2025-10-24T20:47:44.147718] [INFO ] [REMOTE    ] RCS: Fetching primary data for 2025-06.
[2025-10-24T20:47:44.187480] [INFO ] [REMOTE    ] RCD: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T20:47:44.188379] [INFO ] [REMOTE    ] RCD: Full fetch complete (5751 records).
[2025-10-24T20:47:44.188447] [DEBUG] [VALIDATOR ] RCD: Validating primary data.
[2025-10-24T20:47:44.188839] [FATAL] [VALIDATOR ] RCD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:47:44.188920] [FATAL] [MAIN      ] RCD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:47:44.188963] [WARN ] [MAIN      ] RCD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:47:44.189026] [INFO ] [LOCAL     ] RCD: Starting deletion of primary data.
[2025-10-24T20:47:44.189085] [DEBUG] [LOCAL     ] RCD: No primary data file found to delete.
[2025-10-24T20:47:44.189121] [INFO ] [LOCAL     ] RCD: Starting deletion of derivative data.
[2025-10-24T20:47:44.189288] [DEBUG] [LOCAL     ] RCD: Deleted derivative data file.
[2025-10-24T20:47:44.189371] [INFO ] [MAIN      ] Update Progress: 1772/2366 symbols completed. RCD took 29.9s. Estimated remaining: 1h 16m 19s. Rate: 7.8 symbols/min
[2025-10-24T20:47:44.361057] [INFO ] [MAIN      ] RCUS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:47:44.399811] [DEBUG] [LOCAL     ] RCUS: Loaded 43277 existing records from primary storage.
[2025-10-24T20:47:44.400093] [INFO ] [MAIN      ] RCUS: Loaded 43277 existing records.
[2025-10-24T20:47:44.578031] [WARN ] [MAIN      ] RCUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:47:44.578264] [INFO ] [MAIN      ] RCUS: Wiping existing primary data before full refresh.
[2025-10-24T20:47:44.578327] [INFO ] [LOCAL     ] RCUS: Starting deletion of primary data.
[2025-10-24T20:47:44.578551] [DEBUG] [LOCAL     ] RCUS: Deleted primary data file.
[2025-10-24T20:47:44.578607] [INFO ] [MAIN      ] RCUS: Starting full primary refresh.
[2025-10-24T20:47:44.905353] [INFO ] [REMOTE    ] RCS: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T20:47:44.968455] [INFO ] [REMOTE    ] RCUS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:47:44.963792] [INFO ] [REMOTE    ] RCS: Fetching primary data for 2025-07.
[2025-10-24T20:47:45.736492] [INFO ] [REMOTE    ] RCS: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T20:47:45.747591] [INFO ] [REMOTE    ] RCS: Fetching primary data for 2025-08.
[2025-10-24T20:47:46.253235] [INFO ] [REMOTE    ] RCS: Incremental fetch complete for 2025-08 (0.51 seconds).
[2025-10-24T20:47:46.547630] [INFO ] [REMOTE    ] RCL: Fetching primary data for 2025-03.
[2025-10-24T20:47:47.348991] [INFO ] [REMOTE    ] RCUS: Fetching primary data for 2025-01.
[2025-10-24T20:47:47.351627] [INFO ] [REMOTE    ] RCL: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T20:47:48.147682] [INFO ] [REMOTE    ] RCS: Fetching primary data for 2025-09.
[2025-10-24T20:47:48.710748] [INFO ] [REMOTE    ] RCUS: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T20:47:48.947621] [INFO ] [REMOTE    ] RCL: Fetching primary data for 2025-04.
[2025-10-24T20:47:48.985802] [INFO ] [REMOTE    ] RCS: Incremental fetch complete for 2025-09 (0.84 seconds).
[2025-10-24T20:47:49.747618] [INFO ] [REMOTE    ] RCI: Fetching primary data for 2025-03.
[2025-10-24T20:47:49.783098] [INFO ] [REMOTE    ] RCL: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T20:47:50.547633] [INFO ] [REMOTE    ] RCS: Fetching primary data for 2025-10.
[2025-10-24T20:47:50.648096] [INFO ] [REMOTE    ] RCI: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T20:47:51.161359] [INFO ] [REMOTE    ] RCS: Incremental fetch complete for 2025-10 (0.61 seconds).
[2025-10-24T20:47:51.165102] [INFO ] [REMOTE    ] RCS: Full fetch complete (18665 records).
[2025-10-24T20:47:51.165181] [DEBUG] [VALIDATOR ] RCS: Validating primary data.
[2025-10-24T20:47:51.165711] [FATAL] [VALIDATOR ] RCS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:47:51.165795] [FATAL] [MAIN      ] RCS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:47:51.165867] [WARN ] [MAIN      ] RCS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:47:51.165955] [INFO ] [LOCAL     ] RCS: Starting deletion of primary data.
[2025-10-24T20:47:51.166027] [DEBUG] [LOCAL     ] RCS: No primary data file found to delete.
[2025-10-24T20:47:51.166064] [INFO ] [LOCAL     ] RCS: Starting deletion of derivative data.
[2025-10-24T20:47:51.166335] [DEBUG] [LOCAL     ] RCS: Deleted derivative data file.
[2025-10-24T20:47:51.166438] [INFO ] [MAIN      ] Update Progress: 1773/2366 symbols completed. RCS took 16.8s. Estimated remaining: 1h 16m 12s. Rate: 7.8 symbols/min
[2025-10-24T20:47:51.344358] [INFO ] [MAIN      ] RDDT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:47:51.347616] [INFO ] [REMOTE    ] RCI: Fetching primary data for 2025-04.
[2025-10-24T20:47:51.399174] [DEBUG] [LOCAL     ] RDDT: Loaded 54159 existing records from primary storage.
[2025-10-24T20:47:51.399481] [INFO ] [MAIN      ] RDDT: Loaded 54159 existing records.
[2025-10-24T20:47:51.576934] [WARN ] [MAIN      ] RDDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:47:51.577194] [INFO ] [MAIN      ] RDDT: Wiping existing primary data before full refresh.
[2025-10-24T20:47:51.578061] [INFO ] [LOCAL     ] RDDT: Starting deletion of primary data.
[2025-10-24T20:47:51.578449] [DEBUG] [LOCAL     ] RDDT: Deleted primary data file.
[2025-10-24T20:47:51.578505] [INFO ] [MAIN      ] RDDT: Starting full primary refresh.
[2025-10-24T20:47:51.934045] [INFO ] [REMOTE    ] RDDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:47:52.147679] [INFO ] [REMOTE    ] RDDT: Fetching primary data for 2025-01.
[2025-10-24T20:47:52.699943] [INFO ] [REMOTE    ] RCI: Incremental fetch complete for 2025-04 (1.35 seconds).
[2025-10-24T20:47:52.930365] [INFO ] [REMOTE    ] RDDT: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T20:47:52.947617] [INFO ] [REMOTE    ] RDDT: Fetching primary data for 2025-02.
[2025-10-24T20:47:53.747721] [INFO ] [REMOTE    ] RCI: Fetching primary data for 2025-05.
[2025-10-24T20:47:54.151988] [INFO ] [REMOTE    ] RDDT: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T20:47:54.547710] [INFO ] [REMOTE    ] RDDT: Fetching primary data for 2025-03.
[2025-10-24T20:47:54.805838] [INFO ] [REMOTE    ] RCI: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T20:47:55.160586] [INFO ] [REMOTE    ] RDDT: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T20:47:55.347624] [INFO ] [REMOTE    ] RDDT: Fetching primary data for 2025-04.
[2025-10-24T20:47:56.147618] [INFO ] [REMOTE    ] RCUS: Fetching primary data for 2025-02.
[2025-10-24T20:47:56.499969] [INFO ] [REMOTE    ] RDDT: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T20:47:56.947616] [INFO ] [REMOTE    ] RCL: Fetching primary data for 2025-05.
[2025-10-24T20:47:57.103587] [INFO ] [REMOTE    ] RCUS: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T20:47:57.327845] [INFO ] [REMOTE    ] RCL: Incremental fetch complete for 2025-05 (0.38 seconds).
[2025-10-24T20:47:57.747729] [INFO ] [REMOTE    ] RCI: Fetching primary data for 2025-06.
[2025-10-24T20:47:58.547620] [INFO ] [REMOTE    ] RDDT: Fetching primary data for 2025-05.
[2025-10-24T20:47:58.773356] [INFO ] [REMOTE    ] RCI: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T20:47:59.347608] [INFO ] [REMOTE    ] RCUS: Fetching primary data for 2025-03.
[2025-10-24T20:47:59.457481] [INFO ] [REMOTE    ] RDDT: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T20:48:00.089936] [INFO ] [REMOTE    ] RCUS: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T20:48:00.147599] [INFO ] [REMOTE    ] RCUS: Fetching primary data for 2025-04.
[2025-10-24T20:48:00.952776] [INFO ] [REMOTE    ] RCI: Fetching primary data for 2025-07.
[2025-10-24T20:48:00.957783] [INFO ] [REMOTE    ] RCUS: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T20:48:01.749325] [INFO ] [REMOTE    ] RDDT: Fetching primary data for 2025-06.
[2025-10-24T20:48:01.755200] [INFO ] [REMOTE    ] RCI: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T20:48:02.536630] [INFO ] [REMOTE    ] RDDT: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T20:48:02.547751] [INFO ] [REMOTE    ] RCL: Fetching primary data for 2025-06.
[2025-10-24T20:48:03.347666] [INFO ] [REMOTE    ] RCUS: Fetching primary data for 2025-05.
[2025-10-24T20:48:03.589117] [INFO ] [REMOTE    ] RCL: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T20:48:04.147726] [INFO ] [REMOTE    ] RCI: Fetching primary data for 2025-08.
[2025-10-24T20:48:04.702575] [INFO ] [REMOTE    ] RCUS: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T20:48:04.909326] [INFO ] [REMOTE    ] RCI: Incremental fetch complete for 2025-08 (0.76 seconds).
[2025-10-24T20:48:04.947612] [INFO ] [REMOTE    ] RCI: Fetching primary data for 2025-09.
[2025-10-24T20:48:05.747727] [INFO ] [REMOTE    ] RCUS: Fetching primary data for 2025-06.
[2025-10-24T20:48:05.802803] [INFO ] [REMOTE    ] RCI: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T20:48:06.544407] [INFO ] [REMOTE    ] RCUS: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T20:48:06.554073] [INFO ] [REMOTE    ] RDDT: Fetching primary data for 2025-07.
[2025-10-24T20:48:07.347633] [INFO ] [REMOTE    ] RCL: Fetching primary data for 2025-07.
[2025-10-24T20:48:07.778635] [INFO ] [REMOTE    ] RDDT: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T20:48:08.147741] [INFO ] [REMOTE    ] RCI: Fetching primary data for 2025-10.
[2025-10-24T20:48:08.449458] [INFO ] [REMOTE    ] RCL: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T20:48:08.947734] [INFO ] [REMOTE    ] RDDT: Fetching primary data for 2025-08.
[2025-10-24T20:48:09.414611] [INFO ] [REMOTE    ] RCI: Incremental fetch complete for 2025-10 (1.27 seconds).
[2025-10-24T20:48:09.424608] [INFO ] [REMOTE    ] RCI: Full fetch complete (70350 records).
[2025-10-24T20:48:09.424874] [DEBUG] [VALIDATOR ] RCI: Validating primary data.
[2025-10-24T20:48:09.427193] [FATAL] [VALIDATOR ] RCI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:48:09.427305] [FATAL] [MAIN      ] RCI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:48:09.427401] [WARN ] [MAIN      ] RCI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:48:09.427480] [INFO ] [LOCAL     ] RCI: Starting deletion of primary data.
[2025-10-24T20:48:09.427554] [DEBUG] [LOCAL     ] RCI: No primary data file found to delete.
[2025-10-24T20:48:09.427593] [INFO ] [LOCAL     ] RCI: Starting deletion of derivative data.
[2025-10-24T20:48:09.427993] [DEBUG] [LOCAL     ] RCI: Deleted derivative data file.
[2025-10-24T20:48:09.428751] [INFO ] [MAIN      ] Update Progress: 1774/2366 symbols completed. RCI took 46.6s. Estimated remaining: 1h 16m 7s. Rate: 7.8 symbols/min
[2025-10-24T20:48:09.610918] [INFO ] [MAIN      ] RDN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:48:09.657688] [DEBUG] [LOCAL     ] RDN: Loaded 44353 existing records from primary storage.
[2025-10-24T20:48:09.658091] [INFO ] [MAIN      ] RDN: Loaded 44353 existing records.
[2025-10-24T20:48:09.752116] [INFO ] [REMOTE    ] RCUS: Fetching primary data for 2025-07.
[2025-10-24T20:48:09.849016] [WARN ] [MAIN      ] RDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:48:09.849369] [INFO ] [MAIN      ] RDN: Wiping existing primary data before full refresh.
[2025-10-24T20:48:09.849517] [INFO ] [LOCAL     ] RDN: Starting deletion of primary data.
[2025-10-24T20:48:09.850027] [DEBUG] [LOCAL     ] RDN: Deleted primary data file.
[2025-10-24T20:48:09.850091] [INFO ] [MAIN      ] RDN: Starting full primary refresh.
[2025-10-24T20:48:10.266171] [INFO ] [REMOTE    ] RDDT: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T20:48:10.271911] [INFO ] [REMOTE    ] RDN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:48:10.547740] [INFO ] [REMOTE    ] RCL: Fetching primary data for 2025-08.
[2025-10-24T20:48:10.751261] [INFO ] [REMOTE    ] RCUS: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T20:48:11.276907] [INFO ] [REMOTE    ] RCL: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T20:48:11.347638] [INFO ] [REMOTE    ] RDDT: Fetching primary data for 2025-09.
[2025-10-24T20:48:12.147632] [INFO ] [REMOTE    ] RCL: Fetching primary data for 2025-09.
[2025-10-24T20:48:12.468813] [INFO ] [REMOTE    ] RDDT: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T20:48:12.947671] [INFO ] [REMOTE    ] RCUS: Fetching primary data for 2025-08.
[2025-10-24T20:48:13.390820] [INFO ] [REMOTE    ] RCL: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T20:48:13.683215] [INFO ] [REMOTE    ] RCUS: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T20:48:13.747633] [INFO ] [REMOTE    ] RCUS: Fetching primary data for 2025-09.
[2025-10-24T20:48:14.526187] [INFO ] [REMOTE    ] RCUS: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T20:48:14.547610] [INFO ] [REMOTE    ] RCUS: Fetching primary data for 2025-10.
[2025-10-24T20:48:15.260810] [INFO ] [REMOTE    ] RCUS: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T20:48:15.269742] [INFO ] [REMOTE    ] RCUS: Full fetch complete (61036 records).
[2025-10-24T20:48:15.269899] [DEBUG] [VALIDATOR ] RCUS: Validating primary data.
[2025-10-24T20:48:15.270605] [FATAL] [VALIDATOR ] RCUS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:48:15.270733] [FATAL] [MAIN      ] RCUS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:48:15.270831] [WARN ] [MAIN      ] RCUS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:48:15.270923] [INFO ] [LOCAL     ] RCUS: Starting deletion of primary data.
[2025-10-24T20:48:15.271002] [DEBUG] [LOCAL     ] RCUS: No primary data file found to delete.
[2025-10-24T20:48:15.271039] [INFO ] [LOCAL     ] RCUS: Starting deletion of derivative data.
[2025-10-24T20:48:15.271203] [DEBUG] [LOCAL     ] RCUS: Deleted derivative data file.
[2025-10-24T20:48:15.271528] [INFO ] [MAIN      ] Update Progress: 1775/2366 symbols completed. RCUS took 31.1s. Estimated remaining: 1h 15m 59s. Rate: 7.8 symbols/min
[2025-10-24T20:48:15.352803] [INFO ] [REMOTE    ] RDN: Fetching primary data for 2025-01.
[2025-10-24T20:48:15.442709] [INFO ] [MAIN      ] RDW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:48:15.494492] [DEBUG] [LOCAL     ] RDW: Loaded 52676 existing records from primary storage.
[2025-10-24T20:48:15.494840] [INFO ] [MAIN      ] RDW: Loaded 52676 existing records.
[2025-10-24T20:48:15.676725] [WARN ] [MAIN      ] RDW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:48:15.676909] [INFO ] [MAIN      ] RDW: Wiping existing primary data before full refresh.
[2025-10-24T20:48:15.676954] [INFO ] [LOCAL     ] RDW: Starting deletion of primary data.
[2025-10-24T20:48:15.677402] [DEBUG] [LOCAL     ] RDW: Deleted primary data file.
[2025-10-24T20:48:15.677459] [INFO ] [MAIN      ] RDW: Starting full primary refresh.
[2025-10-24T20:48:16.041467] [INFO ] [REMOTE    ] RDW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:48:16.152768] [INFO ] [REMOTE    ] RCL: Fetching primary data for 2025-10.
[2025-10-24T20:48:16.173454] [INFO ] [REMOTE    ] RDN: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T20:48:16.942123] [INFO ] [REMOTE    ] RCL: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T20:48:16.950164] [INFO ] [REMOTE    ] RDDT: Fetching primary data for 2025-10.
[2025-10-24T20:48:16.951954] [INFO ] [REMOTE    ] RCL: Full fetch complete (75017 records).
[2025-10-24T20:48:16.952071] [DEBUG] [VALIDATOR ] RCL: Validating primary data.
[2025-10-24T20:48:16.952929] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:48:16.953092] [FATAL] [MAIN      ] RCL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:48:16.953160] [WARN ] [MAIN      ] RCL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:48:16.953231] [INFO ] [LOCAL     ] RCL: Starting deletion of primary data.
[2025-10-24T20:48:16.953294] [DEBUG] [LOCAL     ] RCL: No primary data file found to delete.
[2025-10-24T20:48:16.953334] [INFO ] [LOCAL     ] RCL: Starting deletion of derivative data.
[2025-10-24T20:48:16.953514] [DEBUG] [LOCAL     ] RCL: Deleted derivative data file.
[2025-10-24T20:48:16.954006] [INFO ] [MAIN      ] Update Progress: 1776/2366 symbols completed. RCL took 43.2s. Estimated remaining: 1h 15m 49s. Rate: 7.8 symbols/min
[2025-10-24T20:48:17.124615] [INFO ] [MAIN      ] RDY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:48:17.168476] [DEBUG] [LOCAL     ] RDY: Loaded 46507 existing records from primary storage.
[2025-10-24T20:48:17.168802] [INFO ] [MAIN      ] RDY: Loaded 46507 existing records.
[2025-10-24T20:48:17.350159] [WARN ] [MAIN      ] RDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:48:17.350366] [INFO ] [MAIN      ] RDY: Wiping existing primary data before full refresh.
[2025-10-24T20:48:17.350410] [INFO ] [LOCAL     ] RDY: Starting deletion of primary data.
[2025-10-24T20:48:17.350839] [DEBUG] [LOCAL     ] RDY: Deleted primary data file.
[2025-10-24T20:48:17.350894] [INFO ] [MAIN      ] RDY: Starting full primary refresh.
[2025-10-24T20:48:17.707057] [INFO ] [REMOTE    ] RDY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:48:17.747632] [INFO ] [REMOTE    ] RDN: Fetching primary data for 2025-02.
[2025-10-24T20:48:18.168401] [INFO ] [REMOTE    ] RDDT: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T20:48:18.177739] [INFO ] [REMOTE    ] RDDT: Full fetch complete (77536 records).
[2025-10-24T20:48:18.177897] [DEBUG] [VALIDATOR ] RDDT: Validating primary data.
[2025-10-24T20:48:18.178785] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:48:18.178879] [FATAL] [MAIN      ] RDDT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:48:18.178923] [WARN ] [MAIN      ] RDDT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:48:18.178965] [INFO ] [LOCAL     ] RDDT: Starting deletion of primary data.
[2025-10-24T20:48:18.179023] [DEBUG] [LOCAL     ] RDDT: No primary data file found to delete.
[2025-10-24T20:48:18.179060] [INFO ] [LOCAL     ] RDDT: Starting deletion of derivative data.
[2025-10-24T20:48:18.179244] [DEBUG] [LOCAL     ] RDDT: Deleted derivative data file.
[2025-10-24T20:48:18.179922] [INFO ] [MAIN      ] Update Progress: 1777/2366 symbols completed. RDDT took 27.0s. Estimated remaining: 1h 15m 39s. Rate: 7.8 symbols/min
[2025-10-24T20:48:18.353025] [INFO ] [MAIN      ] RELX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:48:18.401240] [DEBUG] [LOCAL     ] RELX: Loaded 48903 existing records from primary storage.
[2025-10-24T20:48:18.401765] [INFO ] [MAIN      ] RELX: Loaded 48903 existing records.
[2025-10-24T20:48:18.554404] [INFO ] [REMOTE    ] RDW: Fetching primary data for 2025-01.
[2025-10-24T20:48:18.586084] [WARN ] [MAIN      ] RELX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:48:18.611959] [INFO ] [MAIN      ] RELX: Wiping existing primary data before full refresh.
[2025-10-24T20:48:18.612175] [INFO ] [LOCAL     ] RELX: Starting deletion of primary data.
[2025-10-24T20:48:18.612537] [DEBUG] [LOCAL     ] RELX: Deleted primary data file.
[2025-10-24T20:48:18.612921] [INFO ] [MAIN      ] RELX: Starting full primary refresh.
[2025-10-24T20:48:18.614138] [INFO ] [REMOTE    ] RDN: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T20:48:18.986410] [INFO ] [REMOTE    ] RELX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:48:19.347723] [INFO ] [REMOTE    ] RELX: Fetching primary data for 2025-01.
[2025-10-24T20:48:19.696742] [INFO ] [REMOTE    ] RDW: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T20:48:19.890929] [INFO ] [REMOTE    ] RELX: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T20:48:20.147716] [INFO ] [REMOTE    ] RDN: Fetching primary data for 2025-03.
[2025-10-24T20:48:20.953154] [INFO ] [REMOTE    ] RDY: Fetching primary data for 2025-01.
[2025-10-24T20:48:20.959100] [INFO ] [REMOTE    ] RDN: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T20:48:21.747717] [INFO ] [REMOTE    ] RDW: Fetching primary data for 2025-02.
[2025-10-24T20:48:21.995615] [INFO ] [REMOTE    ] RDY: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T20:48:22.547684] [INFO ] [REMOTE    ] RELX: Fetching primary data for 2025-02.
[2025-10-24T20:48:22.810016] [INFO ] [REMOTE    ] RDW: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T20:48:23.347705] [INFO ] [REMOTE    ] RDW: Fetching primary data for 2025-03.
[2025-10-24T20:48:23.792090] [INFO ] [REMOTE    ] RELX: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T20:48:24.158966] [INFO ] [REMOTE    ] RDY: Fetching primary data for 2025-02.
[2025-10-24T20:48:24.165181] [INFO ] [REMOTE    ] RDW: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T20:48:24.958192] [INFO ] [REMOTE    ] RELX: Fetching primary data for 2025-03.
[2025-10-24T20:48:24.960881] [INFO ] [REMOTE    ] RDY: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T20:48:25.706724] [INFO ] [REMOTE    ] RELX: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T20:48:25.747600] [INFO ] [REMOTE    ] RELX: Fetching primary data for 2025-04.
[2025-10-24T20:48:26.547726] [INFO ] [REMOTE    ] RDY: Fetching primary data for 2025-03.
[2025-10-24T20:48:26.745011] [INFO ] [REMOTE    ] RELX: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T20:48:27.299078] [INFO ] [REMOTE    ] RDY: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T20:48:27.347606] [INFO ] [REMOTE    ] RDY: Fetching primary data for 2025-04.
[2025-10-24T20:48:28.110963] [INFO ] [REMOTE    ] RDY: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T20:48:28.147598] [INFO ] [REMOTE    ] RDY: Fetching primary data for 2025-05.
[2025-10-24T20:48:28.947621] [INFO ] [REMOTE    ] RELX: Fetching primary data for 2025-05.
[2025-10-24T20:48:29.023109] [INFO ] [REMOTE    ] RDY: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T20:48:29.747685] [INFO ] [REMOTE    ] RDW: Fetching primary data for 2025-04.
[2025-10-24T20:48:29.842363] [INFO ] [REMOTE    ] RELX: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T20:48:30.543891] [INFO ] [REMOTE    ] RDW: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T20:48:30.553305] [INFO ] [REMOTE    ] RDY: Fetching primary data for 2025-06.
[2025-10-24T20:48:31.347693] [INFO ] [REMOTE    ] RELX: Fetching primary data for 2025-06.
[2025-10-24T20:48:31.439860] [INFO ] [REMOTE    ] RDY: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T20:48:32.147671] [INFO ] [REMOTE    ] RDN: Fetching primary data for 2025-04.
[2025-10-24T20:48:32.252834] [INFO ] [REMOTE    ] RELX: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T20:48:32.947636] [INFO ] [REMOTE    ] RDW: Fetching primary data for 2025-05.
[2025-10-24T20:48:33.199291] [INFO ] [REMOTE    ] RDN: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T20:48:33.747693] [INFO ] [REMOTE    ] RDY: Fetching primary data for 2025-07.
[2025-10-24T20:48:34.037549] [INFO ] [REMOTE    ] RDW: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T20:48:34.500788] [INFO ] [REMOTE    ] RDY: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T20:48:34.547618] [INFO ] [REMOTE    ] RDW: Fetching primary data for 2025-06.
[2025-10-24T20:48:35.347685] [INFO ] [REMOTE    ] RELX: Fetching primary data for 2025-07.
[2025-10-24T20:48:35.621083] [INFO ] [REMOTE    ] RDW: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T20:48:36.147674] [INFO ] [REMOTE    ] RDN: Fetching primary data for 2025-05.
[2025-10-24T20:48:36.693093] [INFO ] [REMOTE    ] RELX: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T20:48:36.947716] [INFO ] [REMOTE    ] RDW: Fetching primary data for 2025-07.
[2025-10-24T20:48:37.158313] [INFO ] [REMOTE    ] RDN: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T20:48:37.747636] [INFO ] [REMOTE    ] RDY: Fetching primary data for 2025-08.
[2025-10-24T20:48:38.075058] [INFO ] [REMOTE    ] RDW: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T20:48:38.547705] [INFO ] [REMOTE    ] RDW: Fetching primary data for 2025-08.
[2025-10-24T20:48:38.878433] [INFO ] [REMOTE    ] RDY: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T20:48:39.347627] [INFO ] [REMOTE    ] RELX: Fetching primary data for 2025-08.
[2025-10-24T20:48:39.846187] [INFO ] [REMOTE    ] RDW: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T20:48:40.147699] [INFO ] [REMOTE    ] RDW: Fetching primary data for 2025-09.
[2025-10-24T20:48:40.363303] [INFO ] [REMOTE    ] RELX: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T20:48:40.947704] [INFO ] [REMOTE    ] RDN: Fetching primary data for 2025-06.
[2025-10-24T20:48:41.228714] [INFO ] [REMOTE    ] RDW: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T20:48:41.747622] [INFO ] [REMOTE    ] RDW: Fetching primary data for 2025-10.
[2025-10-24T20:48:42.050434] [INFO ] [REMOTE    ] RDN: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T20:48:42.548745] [INFO ] [REMOTE    ] RDY: Fetching primary data for 2025-09.
[2025-10-24T20:48:42.554350] [INFO ] [REMOTE    ] RDW: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T20:48:42.564445] [INFO ] [REMOTE    ] RDW: Full fetch complete (75202 records).
[2025-10-24T20:48:42.564621] [DEBUG] [VALIDATOR ] RDW: Validating primary data.
[2025-10-24T20:48:42.565424] [FATAL] [VALIDATOR ] RDW: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:48:42.565516] [FATAL] [MAIN      ] RDW: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:48:42.565558] [WARN ] [MAIN      ] RDW: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:48:42.565598] [INFO ] [LOCAL     ] RDW: Starting deletion of primary data.
[2025-10-24T20:48:42.565701] [DEBUG] [LOCAL     ] RDW: No primary data file found to delete.
[2025-10-24T20:48:42.565761] [INFO ] [LOCAL     ] RDW: Starting deletion of derivative data.
[2025-10-24T20:48:42.565933] [DEBUG] [LOCAL     ] RDW: Deleted derivative data file.
[2025-10-24T20:48:42.566548] [INFO ] [MAIN      ] Update Progress: 1778/2366 symbols completed. RDW took 27.3s. Estimated remaining: 1h 15m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:48:42.738403] [INFO ] [MAIN      ] RERE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:48:42.777365] [DEBUG] [LOCAL     ] RERE: Loaded 42083 existing records from primary storage.
[2025-10-24T20:48:42.777636] [INFO ] [MAIN      ] RERE: Loaded 42083 existing records.
[2025-10-24T20:48:42.958503] [WARN ] [MAIN      ] RERE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:48:42.958744] [INFO ] [MAIN      ] RERE: Wiping existing primary data before full refresh.
[2025-10-24T20:48:42.958804] [INFO ] [LOCAL     ] RERE: Starting deletion of primary data.
[2025-10-24T20:48:42.959133] [DEBUG] [LOCAL     ] RERE: Deleted primary data file.
[2025-10-24T20:48:42.959171] [INFO ] [MAIN      ] RERE: Starting full primary refresh.
[2025-10-24T20:48:43.320964] [INFO ] [REMOTE    ] RERE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:48:43.347597] [INFO ] [REMOTE    ] RDN: Fetching primary data for 2025-07.
[2025-10-24T20:48:43.429869] [INFO ] [REMOTE    ] RDY: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T20:48:44.147692] [INFO ] [REMOTE    ] RERE: Fetching primary data for 2025-01.
[2025-10-24T20:48:44.689045] [INFO ] [REMOTE    ] RDN: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T20:48:44.947622] [INFO ] [REMOTE    ] RELX: Fetching primary data for 2025-09.
[2025-10-24T20:48:45.066819] [INFO ] [REMOTE    ] RERE: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T20:48:45.717017] [INFO ] [REMOTE    ] RELX: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T20:48:45.747613] [INFO ] [REMOTE    ] RELX: Fetching primary data for 2025-10.
[2025-10-24T20:48:46.472878] [INFO ] [REMOTE    ] RELX: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T20:48:46.481582] [INFO ] [REMOTE    ] RELX: Full fetch complete (68196 records).
[2025-10-24T20:48:46.481736] [DEBUG] [VALIDATOR ] RELX: Validating primary data.
[2025-10-24T20:48:46.482437] [FATAL] [VALIDATOR ] RELX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:48:46.482523] [FATAL] [MAIN      ] RELX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:48:46.482567] [WARN ] [MAIN      ] RELX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:48:46.482634] [INFO ] [LOCAL     ] RELX: Starting deletion of primary data.
[2025-10-24T20:48:46.482736] [DEBUG] [LOCAL     ] RELX: No primary data file found to delete.
[2025-10-24T20:48:46.482778] [INFO ] [LOCAL     ] RELX: Starting deletion of derivative data.
[2025-10-24T20:48:46.482929] [DEBUG] [LOCAL     ] RELX: Deleted derivative data file.
[2025-10-24T20:48:46.483246] [INFO ] [MAIN      ] Update Progress: 1779/2366 symbols completed. RELX took 28.3s. Estimated remaining: 1h 15m 28s. Rate: 7.8 symbols/min
[2025-10-24T20:48:46.552766] [INFO ] [REMOTE    ] RDY: Fetching primary data for 2025-10.
[2025-10-24T20:48:46.664277] [INFO ] [MAIN      ] RES: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:48:46.706180] [DEBUG] [LOCAL     ] RES: Loaded 47208 existing records from primary storage.
[2025-10-24T20:48:46.706458] [INFO ] [MAIN      ] RES: Loaded 47208 existing records.
[2025-10-24T20:48:46.883391] [WARN ] [MAIN      ] RES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:48:46.883570] [INFO ] [MAIN      ] RES: Wiping existing primary data before full refresh.
[2025-10-24T20:48:46.883616] [INFO ] [LOCAL     ] RES: Starting deletion of primary data.
[2025-10-24T20:48:46.884062] [DEBUG] [LOCAL     ] RES: Deleted primary data file.
[2025-10-24T20:48:46.884109] [INFO ] [MAIN      ] RES: Starting full primary refresh.
[2025-10-24T20:48:47.235222] [INFO ] [REMOTE    ] RES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:48:47.347611] [INFO ] [REMOTE    ] RDN: Fetching primary data for 2025-08.
[2025-10-24T20:48:47.702884] [INFO ] [REMOTE    ] RDY: Incremental fetch complete for 2025-10 (1.15 seconds).
[2025-10-24T20:48:47.710546] [INFO ] [REMOTE    ] RDY: Full fetch complete (68075 records).
[2025-10-24T20:48:47.710676] [DEBUG] [VALIDATOR ] RDY: Validating primary data.
[2025-10-24T20:48:47.711581] [FATAL] [VALIDATOR ] RDY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:48:47.711691] [FATAL] [MAIN      ] RDY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:48:47.711741] [WARN ] [MAIN      ] RDY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:48:47.711807] [INFO ] [LOCAL     ] RDY: Starting deletion of primary data.
[2025-10-24T20:48:47.711870] [DEBUG] [LOCAL     ] RDY: No primary data file found to delete.
[2025-10-24T20:48:47.711906] [INFO ] [LOCAL     ] RDY: Starting deletion of derivative data.
[2025-10-24T20:48:47.712040] [DEBUG] [LOCAL     ] RDY: Deleted derivative data file.
[2025-10-24T20:48:47.712109] [INFO ] [MAIN      ] Update Progress: 1780/2366 symbols completed. RDY took 30.8s. Estimated remaining: 1h 15m 18s. Rate: 7.8 symbols/min
[2025-10-24T20:48:47.879538] [INFO ] [MAIN      ] REVG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:48:47.916107] [DEBUG] [LOCAL     ] REVG: Loaded 40460 existing records from primary storage.
[2025-10-24T20:48:47.916368] [INFO ] [MAIN      ] REVG: Loaded 40460 existing records.
[2025-10-24T20:48:48.097188] [WARN ] [MAIN      ] REVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:48:48.097432] [INFO ] [MAIN      ] REVG: Wiping existing primary data before full refresh.
[2025-10-24T20:48:48.097493] [INFO ] [LOCAL     ] REVG: Starting deletion of primary data.
[2025-10-24T20:48:48.097981] [DEBUG] [LOCAL     ] REVG: Deleted primary data file.
[2025-10-24T20:48:48.098044] [INFO ] [MAIN      ] REVG: Starting full primary refresh.
[2025-10-24T20:48:48.159225] [INFO ] [REMOTE    ] RERE: Fetching primary data for 2025-02.
[2025-10-24T20:48:48.478896] [INFO ] [REMOTE    ] REVG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:48:48.480378] [INFO ] [REMOTE    ] RDN: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T20:48:48.947697] [INFO ] [REMOTE    ] REVG: Fetching primary data for 2025-01.
[2025-10-24T20:48:49.365474] [INFO ] [REMOTE    ] RERE: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T20:48:49.446210] [INFO ] [REMOTE    ] REVG: Incremental fetch complete for 2025-01 (0.50 seconds).
[2025-10-24T20:48:49.747724] [INFO ] [REMOTE    ] RDN: Fetching primary data for 2025-09.
[2025-10-24T20:48:50.547672] [INFO ] [REMOTE    ] REVG: Fetching primary data for 2025-02.
[2025-10-24T20:48:51.126037] [INFO ] [REMOTE    ] RDN: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T20:48:51.347630] [INFO ] [REMOTE    ] RERE: Fetching primary data for 2025-03.
[2025-10-24T20:48:51.585838] [INFO ] [REMOTE    ] REVG: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T20:48:51.671559] [INFO ] [REMOTE    ] RERE: Incremental fetch complete for 2025-03 (0.32 seconds).
[2025-10-24T20:48:52.147659] [INFO ] [REMOTE    ] RES: Fetching primary data for 2025-01.
[2025-10-24T20:48:52.947625] [INFO ] [REMOTE    ] RDN: Fetching primary data for 2025-10.
[2025-10-24T20:48:53.032493] [INFO ] [REMOTE    ] RES: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T20:48:53.643848] [INFO ] [REMOTE    ] RDN: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T20:48:53.651360] [INFO ] [REMOTE    ] RDN: Full fetch complete (65398 records).
[2025-10-24T20:48:53.651531] [DEBUG] [VALIDATOR ] RDN: Validating primary data.
[2025-10-24T20:48:53.652377] [FATAL] [VALIDATOR ] RDN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:48:53.652469] [FATAL] [MAIN      ] RDN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:48:53.652514] [WARN ] [MAIN      ] RDN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:48:53.652558] [INFO ] [LOCAL     ] RDN: Starting deletion of primary data.
[2025-10-24T20:48:53.652677] [DEBUG] [LOCAL     ] RDN: No primary data file found to delete.
[2025-10-24T20:48:53.652746] [INFO ] [LOCAL     ] RDN: Starting deletion of derivative data.
[2025-10-24T20:48:53.652984] [DEBUG] [LOCAL     ] RDN: Deleted derivative data file.
[2025-10-24T20:48:53.653329] [INFO ] [MAIN      ] Update Progress: 1781/2366 symbols completed. RDN took 44.2s. Estimated remaining: 1h 15m 10s. Rate: 7.8 symbols/min
[2025-10-24T20:48:53.752755] [INFO ] [REMOTE    ] RERE: Fetching primary data for 2025-04.
[2025-10-24T20:48:53.854486] [INFO ] [MAIN      ] REX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:48:53.875852] [DEBUG] [LOCAL     ] REX: Loaded 14444 existing records from primary storage.
[2025-10-24T20:48:53.876125] [INFO ] [MAIN      ] REX: Loaded 14444 existing records.
[2025-10-24T20:48:54.060825] [WARN ] [MAIN      ] REX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:48:54.061093] [INFO ] [MAIN      ] REX: Wiping existing primary data before full refresh.
[2025-10-24T20:48:54.061145] [INFO ] [LOCAL     ] REX: Starting deletion of primary data.
[2025-10-24T20:48:54.061314] [DEBUG] [LOCAL     ] REX: Deleted primary data file.
[2025-10-24T20:48:54.061375] [INFO ] [MAIN      ] REX: Starting full primary refresh.
[2025-10-24T20:48:54.458830] [INFO ] [REMOTE    ] REX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:48:54.547603] [INFO ] [REMOTE    ] REX: Fetching primary data for 2025-01.
[2025-10-24T20:48:54.961158] [INFO ] [REMOTE    ] RERE: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T20:48:55.100777] [INFO ] [REMOTE    ] REX: Incremental fetch complete for 2025-01 (0.55 seconds).
[2025-10-24T20:48:55.347697] [INFO ] [REMOTE    ] RERE: Fetching primary data for 2025-05.
[2025-10-24T20:48:56.024170] [INFO ] [REMOTE    ] RERE: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T20:48:56.147639] [INFO ] [REMOTE    ] RERE: Fetching primary data for 2025-06.
[2025-10-24T20:48:56.947668] [INFO ] [REMOTE    ] RES: Fetching primary data for 2025-02.
[2025-10-24T20:48:57.134382] [INFO ] [REMOTE    ] RERE: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T20:48:57.739103] [INFO ] [REMOTE    ] RES: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T20:48:57.748030] [INFO ] [REMOTE    ] REVG: Fetching primary data for 2025-03.
[2025-10-24T20:48:58.461951] [INFO ] [REMOTE    ] REVG: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T20:48:58.547676] [INFO ] [REMOTE    ] REX: Fetching primary data for 2025-02.
[2025-10-24T20:48:59.347814] [INFO ] [REMOTE    ] REVG: Fetching primary data for 2025-04.
[2025-10-24T20:48:59.350359] [INFO ] [REMOTE    ] REX: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T20:49:00.091314] [INFO ] [REMOTE    ] REVG: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T20:49:00.147677] [INFO ] [REMOTE    ] RERE: Fetching primary data for 2025-07.
[2025-10-24T20:49:00.947693] [INFO ] [REMOTE    ] REVG: Fetching primary data for 2025-05.
[2025-10-24T20:49:01.293782] [INFO ] [REMOTE    ] RERE: Incremental fetch complete for 2025-07 (1.15 seconds).
[2025-10-24T20:49:01.747672] [INFO ] [REMOTE    ] RERE: Fetching primary data for 2025-08.
[2025-10-24T20:49:02.316410] [INFO ] [REMOTE    ] REVG: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T20:49:02.513554] [INFO ] [REMOTE    ] RERE: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T20:49:02.547674] [INFO ] [REMOTE    ] RERE: Fetching primary data for 2025-09.
[2025-10-24T20:49:03.347749] [INFO ] [REMOTE    ] RES: Fetching primary data for 2025-03.
[2025-10-24T20:49:03.699946] [INFO ] [REMOTE    ] RERE: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T20:49:04.152731] [INFO ] [REMOTE    ] REX: Fetching primary data for 2025-03.
[2025-10-24T20:49:04.166747] [INFO ] [REMOTE    ] RES: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T20:49:04.947638] [INFO ] [REMOTE    ] REVG: Fetching primary data for 2025-06.
[2025-10-24T20:49:05.045352] [INFO ] [REMOTE    ] REX: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T20:49:05.747622] [INFO ] [REMOTE    ] RERE: Fetching primary data for 2025-10.
[2025-10-24T20:49:05.912004] [INFO ] [REMOTE    ] REVG: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T20:49:06.547696] [INFO ] [REMOTE    ] REVG: Fetching primary data for 2025-07.
[2025-10-24T20:49:06.807508] [INFO ] [REMOTE    ] RERE: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T20:49:06.814800] [INFO ] [REMOTE    ] RERE: Full fetch complete (57936 records).
[2025-10-24T20:49:06.814904] [DEBUG] [VALIDATOR ] RERE: Validating primary data.
[2025-10-24T20:49:06.815537] [FATAL] [VALIDATOR ] RERE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:49:06.815620] [FATAL] [MAIN      ] RERE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:49:06.815698] [WARN ] [MAIN      ] RERE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:49:06.815766] [INFO ] [LOCAL     ] RERE: Starting deletion of primary data.
[2025-10-24T20:49:06.815822] [DEBUG] [LOCAL     ] RERE: No primary data file found to delete.
[2025-10-24T20:49:06.815865] [INFO ] [LOCAL     ] RERE: Starting deletion of derivative data.
[2025-10-24T20:49:06.816028] [DEBUG] [LOCAL     ] RERE: Deleted derivative data file.
[2025-10-24T20:49:06.816406] [INFO ] [MAIN      ] Update Progress: 1782/2366 symbols completed. RERE took 24.2s. Estimated remaining: 1h 15m 4s. Rate: 7.8 symbols/min
[2025-10-24T20:49:06.985469] [INFO ] [MAIN      ] REXR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:49:07.035529] [DEBUG] [LOCAL     ] REXR: Loaded 52569 existing records from primary storage.
[2025-10-24T20:49:07.035866] [INFO ] [MAIN      ] REXR: Loaded 52569 existing records.
[2025-10-24T20:49:07.222333] [WARN ] [MAIN      ] REXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:49:07.222599] [INFO ] [MAIN      ] REXR: Wiping existing primary data before full refresh.
[2025-10-24T20:49:07.222688] [INFO ] [LOCAL     ] REXR: Starting deletion of primary data.
[2025-10-24T20:49:07.223134] [DEBUG] [LOCAL     ] REXR: Deleted primary data file.
[2025-10-24T20:49:07.223203] [INFO ] [MAIN      ] REXR: Starting full primary refresh.
[2025-10-24T20:49:07.352729] [INFO ] [REMOTE    ] RES: Fetching primary data for 2025-04.
[2025-10-24T20:49:07.596772] [INFO ] [REMOTE    ] REXR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:49:08.003098] [INFO ] [REMOTE    ] REVG: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T20:49:08.149360] [INFO ] [REMOTE    ] REVG: Fetching primary data for 2025-08.
[2025-10-24T20:49:08.154405] [INFO ] [REMOTE    ] RES: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T20:49:08.926153] [INFO ] [REMOTE    ] REVG: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T20:49:08.947598] [INFO ] [REMOTE    ] REVG: Fetching primary data for 2025-09.
[2025-10-24T20:49:09.735217] [INFO ] [REMOTE    ] REVG: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T20:49:09.747592] [INFO ] [REMOTE    ] REVG: Fetching primary data for 2025-10.
[2025-10-24T20:49:10.410514] [INFO ] [REMOTE    ] REVG: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T20:49:10.417402] [INFO ] [REMOTE    ] REVG: Full fetch complete (57586 records).
[2025-10-24T20:49:10.417544] [DEBUG] [VALIDATOR ] REVG: Validating primary data.
[2025-10-24T20:49:10.418237] [FATAL] [VALIDATOR ] REVG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:49:10.418327] [FATAL] [MAIN      ] REVG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:49:10.418369] [WARN ] [MAIN      ] REVG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:49:10.418444] [INFO ] [LOCAL     ] REVG: Starting deletion of primary data.
[2025-10-24T20:49:10.418504] [DEBUG] [LOCAL     ] REVG: No primary data file found to delete.
[2025-10-24T20:49:10.418540] [INFO ] [LOCAL     ] REVG: Starting deletion of derivative data.
[2025-10-24T20:49:10.418766] [DEBUG] [LOCAL     ] REVG: Deleted derivative data file.
[2025-10-24T20:49:10.418868] [INFO ] [MAIN      ] Update Progress: 1783/2366 symbols completed. REVG took 22.7s. Estimated remaining: 1h 14m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:49:10.558848] [INFO ] [REMOTE    ] REX: Fetching primary data for 2025-04.
[2025-10-24T20:49:10.592263] [INFO ] [MAIN      ] REZI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:49:10.634918] [DEBUG] [LOCAL     ] REZI: Loaded 47445 existing records from primary storage.
[2025-10-24T20:49:10.635197] [INFO ] [MAIN      ] REZI: Loaded 47445 existing records.
[2025-10-24T20:49:10.822847] [WARN ] [MAIN      ] REZI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:49:10.823067] [INFO ] [MAIN      ] REZI: Wiping existing primary data before full refresh.
[2025-10-24T20:49:10.823130] [INFO ] [LOCAL     ] REZI: Starting deletion of primary data.
[2025-10-24T20:49:10.823522] [DEBUG] [LOCAL     ] REZI: Deleted primary data file.
[2025-10-24T20:49:10.823577] [INFO ] [MAIN      ] REZI: Starting full primary refresh.
[2025-10-24T20:49:11.185900] [INFO ] [REMOTE    ] REZI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:49:11.197111] [INFO ] [REMOTE    ] REX: Incremental fetch complete for 2025-04 (0.64 seconds).
[2025-10-24T20:49:11.347626] [INFO ] [REMOTE    ] REZI: Fetching primary data for 2025-01.
[2025-10-24T20:49:12.147624] [INFO ] [REMOTE    ] RES: Fetching primary data for 2025-05.
[2025-10-24T20:49:12.517453] [INFO ] [REMOTE    ] REZI: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T20:49:12.947667] [INFO ] [REMOTE    ] REXR: Fetching primary data for 2025-01.
[2025-10-24T20:49:13.753783] [INFO ] [REMOTE    ] REZI: Fetching primary data for 2025-02.
[2025-10-24T20:49:13.771015] [INFO ] [REMOTE    ] RES: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T20:49:14.386337] [INFO ] [REMOTE    ] REXR: Incremental fetch complete for 2025-01 (1.44 seconds).
[2025-10-24T20:49:14.474285] [INFO ] [REMOTE    ] REZI: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:49:14.547605] [INFO ] [REMOTE    ] REZI: Fetching primary data for 2025-03.
[2025-10-24T20:49:15.310349] [INFO ] [REMOTE    ] REZI: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T20:49:15.347674] [INFO ] [REMOTE    ] RES: Fetching primary data for 2025-06.
[2025-10-24T20:49:16.078553] [INFO ] [REMOTE    ] RES: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T20:49:16.147615] [INFO ] [REMOTE    ] RES: Fetching primary data for 2025-07.
[2025-10-24T20:49:16.944104] [INFO ] [REMOTE    ] RES: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T20:49:16.953536] [INFO ] [REMOTE    ] REXR: Fetching primary data for 2025-02.
[2025-10-24T20:49:17.747667] [INFO ] [REMOTE    ] REX: Fetching primary data for 2025-05.
[2025-10-24T20:49:18.006351] [INFO ] [REMOTE    ] REX: Incremental fetch complete for 2025-05 (0.26 seconds).
[2025-10-24T20:49:18.520547] [INFO ] [REMOTE    ] REXR: Incremental fetch complete for 2025-02 (1.57 seconds).
[2025-10-24T20:49:18.547629] [INFO ] [REMOTE    ] REZI: Fetching primary data for 2025-04.
[2025-10-24T20:49:19.347735] [INFO ] [REMOTE    ] RES: Fetching primary data for 2025-08.
[2025-10-24T20:49:19.535555] [INFO ] [REMOTE    ] REZI: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T20:49:20.147627] [INFO ] [REMOTE    ] REXR: Fetching primary data for 2025-03.
[2025-10-24T20:49:20.545676] [INFO ] [REMOTE    ] RES: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T20:49:20.637227] [INFO ] [REMOTE    ] REXR: Incremental fetch complete for 2025-03 (0.49 seconds).
[2025-10-24T20:49:20.947666] [INFO ] [REMOTE    ] REX: Fetching primary data for 2025-06.
[2025-10-24T20:49:21.704256] [INFO ] [REMOTE    ] REX: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T20:49:21.747611] [INFO ] [REMOTE    ] REX: Fetching primary data for 2025-07.
[2025-10-24T20:49:22.513120] [INFO ] [REMOTE    ] REX: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T20:49:22.547604] [INFO ] [REMOTE    ] REX: Fetching primary data for 2025-08.
[2025-10-24T20:49:23.194694] [INFO ] [REMOTE    ] REX: Incremental fetch complete for 2025-08 (0.65 seconds).
[2025-10-24T20:49:23.347697] [INFO ] [REMOTE    ] REZI: Fetching primary data for 2025-05.
[2025-10-24T20:49:24.147696] [INFO ] [REMOTE    ] REX: Fetching primary data for 2025-09.
[2025-10-24T20:49:24.579594] [INFO ] [REMOTE    ] REZI: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T20:49:24.947681] [INFO ] [REMOTE    ] REXR: Fetching primary data for 2025-04.
[2025-10-24T20:49:25.281150] [INFO ] [REMOTE    ] REX: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T20:49:25.747689] [INFO ] [REMOTE    ] REX: Fetching primary data for 2025-10.
[2025-10-24T20:49:25.990940] [INFO ] [REMOTE    ] REXR: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T20:49:26.301768] [INFO ] [REMOTE    ] REX: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T20:49:26.305604] [INFO ] [REMOTE    ] REX: Full fetch complete (21031 records).
[2025-10-24T20:49:26.305781] [DEBUG] [VALIDATOR ] REX: Validating primary data.
[2025-10-24T20:49:26.306278] [FATAL] [VALIDATOR ] REX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:49:26.306362] [FATAL] [MAIN      ] REX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:49:26.306407] [WARN ] [MAIN      ] REX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:49:26.306446] [INFO ] [LOCAL     ] REX: Starting deletion of primary data.
[2025-10-24T20:49:26.306501] [DEBUG] [LOCAL     ] REX: No primary data file found to delete.
[2025-10-24T20:49:26.306537] [INFO ] [LOCAL     ] REX: Starting deletion of derivative data.
[2025-10-24T20:49:26.306740] [DEBUG] [LOCAL     ] REX: Deleted derivative data file.
[2025-10-24T20:49:26.306829] [INFO ] [MAIN      ] Update Progress: 1784/2366 symbols completed. REX took 32.7s. Estimated remaining: 1h 14m 50s. Rate: 7.8 symbols/min
[2025-10-24T20:49:26.475604] [INFO ] [MAIN      ] RF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:49:26.527996] [DEBUG] [LOCAL     ] RF: Loaded 54023 existing records from primary storage.
[2025-10-24T20:49:26.528306] [INFO ] [MAIN      ] RF: Loaded 54023 existing records.
[2025-10-24T20:49:26.557101] [INFO ] [REMOTE    ] REZI: Fetching primary data for 2025-06.
[2025-10-24T20:49:26.709729] [WARN ] [MAIN      ] RF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:49:26.709966] [INFO ] [MAIN      ] RF: Wiping existing primary data before full refresh.
[2025-10-24T20:49:26.710013] [INFO ] [LOCAL     ] RF: Starting deletion of primary data.
[2025-10-24T20:49:26.710363] [DEBUG] [LOCAL     ] RF: Deleted primary data file.
[2025-10-24T20:49:26.710401] [INFO ] [MAIN      ] RF: Starting full primary refresh.
[2025-10-24T20:49:27.061131] [INFO ] [REMOTE    ] RF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:49:27.347722] [INFO ] [REMOTE    ] RF: Fetching primary data for 2025-01.
[2025-10-24T20:49:27.404948] [INFO ] [REMOTE    ] REZI: Incremental fetch complete for 2025-06 (0.85 seconds).
[2025-10-24T20:49:28.147712] [INFO ] [REMOTE    ] RES: Fetching primary data for 2025-09.
[2025-10-24T20:49:28.222507] [INFO ] [REMOTE    ] RF: Incremental fetch complete for 2025-01 (0.87 seconds).
[2025-10-24T20:49:28.921431] [INFO ] [REMOTE    ] RES: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T20:49:28.947606] [INFO ] [REMOTE    ] RES: Fetching primary data for 2025-10.
[2025-10-24T20:49:29.747622] [INFO ] [REMOTE    ] REXR: Fetching primary data for 2025-05.
[2025-10-24T20:49:29.929771] [INFO ] [REMOTE    ] RES: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T20:49:29.937354] [INFO ] [REMOTE    ] RES: Full fetch complete (68354 records).
[2025-10-24T20:49:29.937470] [DEBUG] [VALIDATOR ] RES: Validating primary data.
[2025-10-24T20:49:29.938745] [FATAL] [VALIDATOR ] RES: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:49:29.938832] [FATAL] [MAIN      ] RES: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:49:29.938875] [WARN ] [MAIN      ] RES: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:49:29.938930] [INFO ] [LOCAL     ] RES: Starting deletion of primary data.
[2025-10-24T20:49:29.938986] [DEBUG] [LOCAL     ] RES: No primary data file found to delete.
[2025-10-24T20:49:29.939032] [INFO ] [LOCAL     ] RES: Starting deletion of derivative data.
[2025-10-24T20:49:29.939185] [DEBUG] [LOCAL     ] RES: Deleted derivative data file.
[2025-10-24T20:49:29.939621] [INFO ] [MAIN      ] Update Progress: 1785/2366 symbols completed. RES took 43.5s. Estimated remaining: 1h 14m 41s. Rate: 7.8 symbols/min
[2025-10-24T20:49:30.105528] [INFO ] [MAIN      ] RFI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:49:30.116940] [DEBUG] [LOCAL     ] RFI: Loaded 10283 existing records from primary storage.
[2025-10-24T20:49:30.117159] [INFO ] [MAIN      ] RFI: Loaded 10283 existing records.
[2025-10-24T20:49:30.297093] [WARN ] [MAIN      ] RFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:49:30.297403] [INFO ] [MAIN      ] RFI: Wiping existing primary data before full refresh.
[2025-10-24T20:49:30.297455] [INFO ] [LOCAL     ] RFI: Starting deletion of primary data.
[2025-10-24T20:49:30.297704] [DEBUG] [LOCAL     ] RFI: Deleted primary data file.
[2025-10-24T20:49:30.297764] [INFO ] [MAIN      ] RFI: Starting full primary refresh.
[2025-10-24T20:49:30.548330] [INFO ] [REMOTE    ] REZI: Fetching primary data for 2025-07.
[2025-10-24T20:49:30.654133] [INFO ] [REMOTE    ] RFI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:49:30.780225] [INFO ] [REMOTE    ] REXR: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T20:49:31.336089] [INFO ] [REMOTE    ] REZI: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T20:49:31.347610] [INFO ] [REMOTE    ] REZI: Fetching primary data for 2025-08.
[2025-10-24T20:49:32.147694] [INFO ] [REMOTE    ] RF: Fetching primary data for 2025-02.
[2025-10-24T20:49:32.377152] [INFO ] [REMOTE    ] REZI: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T20:49:32.947627] [INFO ] [REMOTE    ] RFI: Fetching primary data for 2025-01.
[2025-10-24T20:49:33.338277] [INFO ] [REMOTE    ] RF: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T20:49:33.747686] [INFO ] [REMOTE    ] REXR: Fetching primary data for 2025-06.
[2025-10-24T20:49:33.881930] [INFO ] [REMOTE    ] RFI: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T20:49:34.547699] [INFO ] [REMOTE    ] RF: Fetching primary data for 2025-03.
[2025-10-24T20:49:35.098814] [INFO ] [REMOTE    ] REXR: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T20:49:35.347631] [INFO ] [REMOTE    ] REZI: Fetching primary data for 2025-09.
[2025-10-24T20:49:35.387587] [INFO ] [REMOTE    ] RF: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T20:49:36.085573] [INFO ] [REMOTE    ] REZI: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T20:49:36.147621] [INFO ] [REMOTE    ] RF: Fetching primary data for 2025-04.
[2025-10-24T20:49:36.947668] [INFO ] [REMOTE    ] RFI: Fetching primary data for 2025-02.
[2025-10-24T20:49:37.239089] [INFO ] [REMOTE    ] RF: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T20:49:37.287255] [INFO ] [REMOTE    ] RFI: Incremental fetch complete for 2025-02 (0.34 seconds).
[2025-10-24T20:49:37.747639] [INFO ] [REMOTE    ] RF: Fetching primary data for 2025-05.
[2025-10-24T20:49:38.533572] [INFO ] [REMOTE    ] RF: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T20:49:38.547604] [INFO ] [REMOTE    ] RF: Fetching primary data for 2025-06.
[2025-10-24T20:49:39.347680] [INFO ] [REMOTE    ] REZI: Fetching primary data for 2025-10.
[2025-10-24T20:49:40.021988] [INFO ] [REMOTE    ] RF: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T20:49:40.104163] [INFO ] [REMOTE    ] REZI: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T20:49:40.112744] [INFO ] [REMOTE    ] REZI: Full fetch complete (65940 records).
[2025-10-24T20:49:40.112868] [DEBUG] [VALIDATOR ] REZI: Validating primary data.
[2025-10-24T20:49:40.113606] [FATAL] [VALIDATOR ] REZI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:49:40.113711] [FATAL] [MAIN      ] REZI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:49:40.113753] [WARN ] [MAIN      ] REZI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:49:40.113792] [INFO ] [LOCAL     ] REZI: Starting deletion of primary data.
[2025-10-24T20:49:40.113845] [DEBUG] [LOCAL     ] REZI: No primary data file found to delete.
[2025-10-24T20:49:40.113880] [INFO ] [LOCAL     ] REZI: Starting deletion of derivative data.
[2025-10-24T20:49:40.114066] [DEBUG] [LOCAL     ] REZI: Deleted derivative data file.
[2025-10-24T20:49:40.114157] [INFO ] [MAIN      ] Update Progress: 1786/2366 symbols completed. REZI took 29.7s. Estimated remaining: 1h 14m 34s. Rate: 7.8 symbols/min
[2025-10-24T20:49:40.153199] [INFO ] [REMOTE    ] RF: Fetching primary data for 2025-07.
[2025-10-24T20:49:40.282902] [INFO ] [MAIN      ] RFL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:49:40.294362] [DEBUG] [LOCAL     ] RFL: Loaded 11436 existing records from primary storage.
[2025-10-24T20:49:40.294574] [INFO ] [MAIN      ] RFL: Loaded 11436 existing records.
[2025-10-24T20:49:40.471674] [WARN ] [MAIN      ] RFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:49:40.471933] [INFO ] [MAIN      ] RFL: Wiping existing primary data before full refresh.
[2025-10-24T20:49:40.471981] [INFO ] [LOCAL     ] RFL: Starting deletion of primary data.
[2025-10-24T20:49:40.472180] [DEBUG] [LOCAL     ] RFL: Deleted primary data file.
[2025-10-24T20:49:40.472236] [INFO ] [MAIN      ] RFL: Starting full primary refresh.
[2025-10-24T20:49:40.826324] [INFO ] [REMOTE    ] RFL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:49:40.947634] [INFO ] [REMOTE    ] RFI: Fetching primary data for 2025-03.
[2025-10-24T20:49:41.046051] [INFO ] [REMOTE    ] RF: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T20:49:41.503193] [INFO ] [REMOTE    ] RFI: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T20:49:41.747662] [INFO ] [REMOTE    ] RF: Fetching primary data for 2025-08.
[2025-10-24T20:49:42.547730] [INFO ] [REMOTE    ] REXR: Fetching primary data for 2025-07.
[2025-10-24T20:49:42.605224] [INFO ] [REMOTE    ] RF: Incremental fetch complete for 2025-08 (0.86 seconds).
[2025-10-24T20:49:43.347670] [INFO ] [REMOTE    ] RFL: Fetching primary data for 2025-01.
[2025-10-24T20:49:43.875076] [INFO ] [REMOTE    ] RFL: Incremental fetch complete for 2025-01 (0.53 seconds).
[2025-10-24T20:49:43.879120] [INFO ] [REMOTE    ] REXR: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T20:49:44.147662] [INFO ] [REMOTE    ] RF: Fetching primary data for 2025-09.
[2025-10-24T20:49:44.947925] [INFO ] [REMOTE    ] REXR: Fetching primary data for 2025-08.
[2025-10-24T20:49:44.947847] [INFO ] [REMOTE    ] RF: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T20:49:45.747720] [INFO ] [REMOTE    ] RFI: Fetching primary data for 2025-04.
[2025-10-24T20:49:45.793472] [INFO ] [REMOTE    ] REXR: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T20:49:46.547727] [INFO ] [REMOTE    ] REXR: Fetching primary data for 2025-09.
[2025-10-24T20:49:46.920832] [INFO ] [REMOTE    ] RFI: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T20:49:47.347729] [INFO ] [REMOTE    ] RFI: Fetching primary data for 2025-05.
[2025-10-24T20:49:47.719307] [INFO ] [REMOTE    ] REXR: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T20:49:48.142243] [INFO ] [REMOTE    ] RFI: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T20:49:48.147590] [INFO ] [REMOTE    ] RFI: Fetching primary data for 2025-06.
[2025-10-24T20:49:48.614630] [INFO ] [REMOTE    ] RFI: Incremental fetch complete for 2025-06 (0.47 seconds).
[2025-10-24T20:49:48.947689] [INFO ] [REMOTE    ] REXR: Fetching primary data for 2025-10.
[2025-10-24T20:49:49.663361] [INFO ] [REMOTE    ] REXR: Incremental fetch complete for 2025-10 (0.72 seconds).
[2025-10-24T20:49:49.672430] [INFO ] [REMOTE    ] REXR: Full fetch complete (74976 records).
[2025-10-24T20:49:49.672589] [DEBUG] [VALIDATOR ] REXR: Validating primary data.
[2025-10-24T20:49:49.673372] [FATAL] [VALIDATOR ] REXR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:49:49.673466] [FATAL] [MAIN      ] REXR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:49:49.673509] [WARN ] [MAIN      ] REXR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:49:49.673546] [INFO ] [LOCAL     ] REXR: Starting deletion of primary data.
[2025-10-24T20:49:49.673600] [DEBUG] [LOCAL     ] REXR: No primary data file found to delete.
[2025-10-24T20:49:49.673634] [INFO ] [LOCAL     ] REXR: Starting deletion of derivative data.
[2025-10-24T20:49:49.673847] [DEBUG] [LOCAL     ] REXR: Deleted derivative data file.
[2025-10-24T20:49:49.674229] [INFO ] [MAIN      ] Update Progress: 1787/2366 symbols completed. REXR took 42.9s. Estimated remaining: 1h 14m 27s. Rate: 7.8 symbols/min
[2025-10-24T20:49:49.752766] [INFO ] [REMOTE    ] RFL: Fetching primary data for 2025-02.
[2025-10-24T20:49:49.860458] [INFO ] [MAIN      ] RFM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:49:49.873081] [DEBUG] [LOCAL     ] RFM: Loaded 4225 existing records from primary storage.
[2025-10-24T20:49:49.873394] [INFO ] [MAIN      ] RFM: Loaded 4225 existing records.
[2025-10-24T20:49:50.132699] [WARN ] [MAIN      ] RFM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:49:50.132976] [INFO ] [MAIN      ] RFM: Wiping existing primary data before full refresh.
[2025-10-24T20:49:50.133053] [INFO ] [LOCAL     ] RFM: Starting deletion of primary data.
[2025-10-24T20:49:50.133284] [DEBUG] [LOCAL     ] RFM: Deleted primary data file.
[2025-10-24T20:49:50.133355] [INFO ] [MAIN      ] RFM: Starting full primary refresh.
[2025-10-24T20:49:50.269995] [INFO ] [REMOTE    ] RFL: Incremental fetch complete for 2025-02 (0.52 seconds).
[2025-10-24T20:49:50.552814] [INFO ] [REMOTE    ] RF: Fetching primary data for 2025-10.
[2025-10-24T20:49:50.591075] [INFO ] [REMOTE    ] RFM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:49:51.254727] [INFO ] [REMOTE    ] RF: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T20:49:51.265550] [INFO ] [REMOTE    ] RF: Full fetch complete (77408 records).
[2025-10-24T20:49:51.265755] [DEBUG] [VALIDATOR ] RF: Validating primary data.
[2025-10-24T20:49:51.266555] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:49:51.266669] [FATAL] [MAIN      ] RF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:49:51.266733] [WARN ] [MAIN      ] RF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:49:51.266801] [INFO ] [LOCAL     ] RF: Starting deletion of primary data.
[2025-10-24T20:49:51.266865] [DEBUG] [LOCAL     ] RF: No primary data file found to delete.
[2025-10-24T20:49:51.266902] [INFO ] [LOCAL     ] RF: Starting deletion of derivative data.
[2025-10-24T20:49:51.267089] [DEBUG] [LOCAL     ] RF: Deleted derivative data file.
[2025-10-24T20:49:51.267545] [INFO ] [MAIN      ] Update Progress: 1788/2366 symbols completed. RF took 25.0s. Estimated remaining: 1h 14m 17s. Rate: 7.8 symbols/min
[2025-10-24T20:49:51.352824] [INFO ] [REMOTE    ] RFI: Fetching primary data for 2025-07.
[2025-10-24T20:49:51.453114] [INFO ] [MAIN      ] RFMZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:49:51.465903] [DEBUG] [LOCAL     ] RFMZ: Loaded 9143 existing records from primary storage.
[2025-10-24T20:49:51.466142] [INFO ] [MAIN      ] RFMZ: Loaded 9143 existing records.
[2025-10-24T20:49:51.649318] [WARN ] [MAIN      ] RFMZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:49:51.649557] [INFO ] [MAIN      ] RFMZ: Wiping existing primary data before full refresh.
[2025-10-24T20:49:51.649604] [INFO ] [LOCAL     ] RFMZ: Starting deletion of primary data.
[2025-10-24T20:49:51.649832] [DEBUG] [LOCAL     ] RFMZ: Deleted primary data file.
[2025-10-24T20:49:51.649887] [INFO ] [MAIN      ] RFMZ: Starting full primary refresh.
[2025-10-24T20:49:51.974341] [INFO ] [REMOTE    ] RFI: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T20:49:52.056246] [INFO ] [REMOTE    ] RFMZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:49:52.147638] [INFO ] [REMOTE    ] RFI: Fetching primary data for 2025-08.
[2025-10-24T20:49:52.947669] [INFO ] [REMOTE    ] RFM: Fetching primary data for 2025-01.
[2025-10-24T20:49:52.973732] [INFO ] [REMOTE    ] RFI: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T20:49:53.747711] [INFO ] [REMOTE    ] RFL: Fetching primary data for 2025-03.
[2025-10-24T20:49:53.796910] [INFO ] [REMOTE    ] RFM: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T20:49:54.116412] [INFO ] [REMOTE    ] RFL: Incremental fetch complete for 2025-03 (0.37 seconds).
[2025-10-24T20:49:54.547694] [INFO ] [REMOTE    ] RFL: Fetching primary data for 2025-04.
[2025-10-24T20:49:55.264682] [INFO ] [REMOTE    ] RFL: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T20:49:55.347692] [INFO ] [REMOTE    ] RFM: Fetching primary data for 2025-02.
[2025-10-24T20:49:56.015202] [INFO ] [REMOTE    ] RFM: Incremental fetch complete for 2025-02 (0.67 seconds).
[2025-10-24T20:49:56.147626] [INFO ] [REMOTE    ] RFMZ: Fetching primary data for 2025-01.
[2025-10-24T20:49:56.873602] [INFO ] [REMOTE    ] RFMZ: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T20:49:56.947683] [INFO ] [REMOTE    ] RFMZ: Fetching primary data for 2025-02.
[2025-10-24T20:49:57.317318] [INFO ] [REMOTE    ] RFMZ: Incremental fetch complete for 2025-02 (0.37 seconds).
[2025-10-24T20:49:57.747719] [INFO ] [REMOTE    ] RFMZ: Fetching primary data for 2025-03.
[2025-10-24T20:49:58.503118] [INFO ] [REMOTE    ] RFMZ: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T20:49:58.547601] [INFO ] [REMOTE    ] RFMZ: Fetching primary data for 2025-04.
[2025-10-24T20:49:59.325576] [INFO ] [REMOTE    ] RFMZ: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:49:59.347596] [INFO ] [REMOTE    ] RFMZ: Fetching primary data for 2025-05.
[2025-10-24T20:50:00.147637] [INFO ] [REMOTE    ] RFI: Fetching primary data for 2025-09.
[2025-10-24T20:50:00.253244] [INFO ] [REMOTE    ] RFMZ: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T20:50:00.627030] [INFO ] [REMOTE    ] RFI: Incremental fetch complete for 2025-09 (0.48 seconds).
[2025-10-24T20:50:00.947726] [INFO ] [REMOTE    ] RFI: Fetching primary data for 2025-10.
[2025-10-24T20:50:01.486611] [INFO ] [REMOTE    ] RFI: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T20:50:01.488902] [INFO ] [REMOTE    ] RFI: Full fetch complete (14898 records).
[2025-10-24T20:50:01.489013] [DEBUG] [VALIDATOR ] RFI: Validating primary data.
[2025-10-24T20:50:01.489512] [FATAL] [VALIDATOR ] RFI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:50:01.489611] [FATAL] [MAIN      ] RFI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:50:01.489734] [WARN ] [MAIN      ] RFI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:50:01.489826] [INFO ] [LOCAL     ] RFI: Starting deletion of primary data.
[2025-10-24T20:50:01.489929] [DEBUG] [LOCAL     ] RFI: No primary data file found to delete.
[2025-10-24T20:50:01.489989] [INFO ] [LOCAL     ] RFI: Starting deletion of derivative data.
[2025-10-24T20:50:01.490143] [DEBUG] [LOCAL     ] RFI: Deleted derivative data file.
[2025-10-24T20:50:01.490216] [INFO ] [MAIN      ] Update Progress: 1789/2366 symbols completed. RFI took 31.6s. Estimated remaining: 1h 14m 10s. Rate: 7.8 symbols/min
[2025-10-24T20:50:01.670969] [INFO ] [MAIN      ] RGA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:50:01.671161] [DEBUG] [LOCAL     ] RGA: No existing data file found in primary storage.
[2025-10-24T20:50:01.671198] [WARN ] [MAIN      ] RGA: No existing data found, performing full refresh instead.
[2025-10-24T20:50:01.671304] [INFO ] [MAIN      ] RGA: Wiping existing primary data before full refresh.
[2025-10-24T20:50:01.671343] [INFO ] [LOCAL     ] RGA: Starting deletion of primary data.
[2025-10-24T20:50:01.671383] [DEBUG] [LOCAL     ] RGA: No primary data file found to delete.
[2025-10-24T20:50:01.671413] [INFO ] [MAIN      ] RGA: Starting full primary refresh.
[2025-10-24T20:50:01.752915] [INFO ] [REMOTE    ] RFL: Fetching primary data for 2025-05.
[2025-10-24T20:50:02.040719] [INFO ] [REMOTE    ] RGA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:50:02.290315] [INFO ] [REMOTE    ] RFL: Incremental fetch complete for 2025-05 (0.54 seconds).
[2025-10-24T20:50:02.547725] [INFO ] [REMOTE    ] RFMZ: Fetching primary data for 2025-06.
[2025-10-24T20:50:03.016132] [INFO ] [REMOTE    ] RFMZ: Incremental fetch complete for 2025-06 (0.47 seconds).
[2025-10-24T20:50:03.347712] [INFO ] [REMOTE    ] RFL: Fetching primary data for 2025-06.
[2025-10-24T20:50:03.966806] [INFO ] [REMOTE    ] RFL: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T20:50:04.147720] [INFO ] [REMOTE    ] RGA: Fetching primary data for 2025-01.
[2025-10-24T20:50:04.920244] [INFO ] [REMOTE    ] RGA: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T20:50:04.947604] [INFO ] [REMOTE    ] RGA: Fetching primary data for 2025-02.
[2025-10-24T20:50:05.747618] [INFO ] [REMOTE    ] RFMZ: Fetching primary data for 2025-07.
[2025-10-24T20:50:05.956887] [INFO ] [REMOTE    ] RGA: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T20:50:06.204455] [INFO ] [REMOTE    ] RFMZ: Incremental fetch complete for 2025-07 (0.46 seconds).
[2025-10-24T20:50:06.547749] [INFO ] [REMOTE    ] RFM: Fetching primary data for 2025-03.
[2025-10-24T20:50:06.907352] [INFO ] [REMOTE    ] RFM: Incremental fetch complete for 2025-03 (0.36 seconds).
[2025-10-24T20:50:07.347703] [INFO ] [REMOTE    ] RFM: Fetching primary data for 2025-04.
[2025-10-24T20:50:07.990300] [INFO ] [REMOTE    ] RFM: Incremental fetch complete for 2025-04 (0.64 seconds).
[2025-10-24T20:50:08.147625] [INFO ] [REMOTE    ] RFM: Fetching primary data for 2025-05.
[2025-10-24T20:50:08.792014] [INFO ] [REMOTE    ] RFM: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T20:50:08.947610] [INFO ] [REMOTE    ] RFM: Fetching primary data for 2025-06.
[2025-10-24T20:50:09.606365] [INFO ] [REMOTE    ] RFM: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T20:50:09.747626] [INFO ] [REMOTE    ] RFM: Fetching primary data for 2025-07.
[2025-10-24T20:50:10.372236] [INFO ] [REMOTE    ] RFM: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T20:50:10.547708] [INFO ] [REMOTE    ] RFL: Fetching primary data for 2025-07.
[2025-10-24T20:50:11.025016] [INFO ] [REMOTE    ] RFL: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T20:50:11.347687] [INFO ] [REMOTE    ] RGA: Fetching primary data for 2025-03.
[2025-10-24T20:50:12.042953] [INFO ] [REMOTE    ] RGA: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T20:50:12.147634] [INFO ] [REMOTE    ] RFMZ: Fetching primary data for 2025-08.
[2025-10-24T20:50:12.860489] [INFO ] [REMOTE    ] RFMZ: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T20:50:12.947689] [INFO ] [REMOTE    ] RGA: Fetching primary data for 2025-04.
[2025-10-24T20:50:13.701531] [INFO ] [REMOTE    ] RGA: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T20:50:13.747627] [INFO ] [REMOTE    ] RGA: Fetching primary data for 2025-05.
[2025-10-24T20:50:14.547710] [INFO ] [REMOTE    ] RFM: Fetching primary data for 2025-08.
[2025-10-24T20:50:14.742893] [INFO ] [REMOTE    ] RGA: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T20:50:14.920940] [INFO ] [REMOTE    ] RFM: Incremental fetch complete for 2025-08 (0.37 seconds).
[2025-10-24T20:50:15.347635] [INFO ] [REMOTE    ] RFM: Fetching primary data for 2025-09.
[2025-10-24T20:50:15.728308] [INFO ] [REMOTE    ] RFM: Incremental fetch complete for 2025-09 (0.38 seconds).
[2025-10-24T20:50:16.147684] [INFO ] [REMOTE    ] RFMZ: Fetching primary data for 2025-09.
[2025-10-24T20:50:16.637107] [INFO ] [REMOTE    ] RFMZ: Incremental fetch complete for 2025-09 (0.49 seconds).
[2025-10-24T20:50:16.947681] [INFO ] [REMOTE    ] RFM: Fetching primary data for 2025-10.
[2025-10-24T20:50:17.690084] [INFO ] [REMOTE    ] RFM: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T20:50:17.691302] [INFO ] [REMOTE    ] RFM: Full fetch complete (5585 records).
[2025-10-24T20:50:17.691370] [DEBUG] [VALIDATOR ] RFM: Validating primary data.
[2025-10-24T20:50:17.691747] [FATAL] [VALIDATOR ] RFM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:50:17.691824] [FATAL] [MAIN      ] RFM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:50:17.691866] [WARN ] [MAIN      ] RFM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:50:17.691905] [INFO ] [LOCAL     ] RFM: Starting deletion of primary data.
[2025-10-24T20:50:17.691956] [DEBUG] [LOCAL     ] RFM: No primary data file found to delete.
[2025-10-24T20:50:17.691994] [INFO ] [LOCAL     ] RFM: Starting deletion of derivative data.
[2025-10-24T20:50:17.692152] [DEBUG] [LOCAL     ] RFM: Deleted derivative data file.
[2025-10-24T20:50:17.692237] [INFO ] [MAIN      ] Update Progress: 1790/2366 symbols completed. RFM took 28.0s. Estimated remaining: 1h 14m 5s. Rate: 7.8 symbols/min
[2025-10-24T20:50:17.753451] [INFO ] [REMOTE    ] RFL: Fetching primary data for 2025-08.
[2025-10-24T20:50:17.862262] [INFO ] [MAIN      ] RGR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:50:17.883083] [DEBUG] [LOCAL     ] RGR: Loaded 21085 existing records from primary storage.
[2025-10-24T20:50:17.883344] [INFO ] [MAIN      ] RGR: Loaded 21085 existing records.
[2025-10-24T20:50:18.060735] [WARN ] [MAIN      ] RGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:50:18.060999] [INFO ] [MAIN      ] RGR: Wiping existing primary data before full refresh.
[2025-10-24T20:50:18.061068] [INFO ] [LOCAL     ] RGR: Starting deletion of primary data.
[2025-10-24T20:50:18.061347] [DEBUG] [LOCAL     ] RGR: Deleted primary data file.
[2025-10-24T20:50:18.061402] [INFO ] [MAIN      ] RGR: Starting full primary refresh.
[2025-10-24T20:50:18.409027] [INFO ] [REMOTE    ] RGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:50:18.547613] [INFO ] [REMOTE    ] RGR: Fetching primary data for 2025-01.
[2025-10-24T20:50:18.984823] [INFO ] [REMOTE    ] RFL: Incremental fetch complete for 2025-08 (1.23 seconds).
[2025-10-24T20:50:19.116334] [INFO ] [REMOTE    ] RGR: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T20:50:19.347700] [INFO ] [REMOTE    ] RGR: Fetching primary data for 2025-02.
[2025-10-24T20:50:20.147732] [INFO ] [REMOTE    ] RFL: Fetching primary data for 2025-09.
[2025-10-24T20:50:20.351011] [INFO ] [REMOTE    ] RGR: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T20:50:20.722694] [INFO ] [REMOTE    ] RFL: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T20:50:20.947639] [INFO ] [REMOTE    ] RFMZ: Fetching primary data for 2025-10.
[2025-10-24T20:50:21.747661] [INFO ] [REMOTE    ] RGR: Fetching primary data for 2025-03.
[2025-10-24T20:50:21.917162] [INFO ] [REMOTE    ] RFMZ: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T20:50:21.919543] [INFO ] [REMOTE    ] RFMZ: Full fetch complete (12364 records).
[2025-10-24T20:50:21.919612] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data.
[2025-10-24T20:50:21.920432] [FATAL] [VALIDATOR ] RFMZ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:50:21.920510] [FATAL] [MAIN      ] RFMZ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:50:21.920573] [WARN ] [MAIN      ] RFMZ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:50:21.920665] [INFO ] [LOCAL     ] RFMZ: Starting deletion of primary data.
[2025-10-24T20:50:21.920741] [DEBUG] [LOCAL     ] RFMZ: No primary data file found to delete.
[2025-10-24T20:50:21.920777] [INFO ] [LOCAL     ] RFMZ: Starting deletion of derivative data.
[2025-10-24T20:50:21.920911] [DEBUG] [LOCAL     ] RFMZ: Deleted derivative data file.
[2025-10-24T20:50:21.920975] [INFO ] [MAIN      ] Update Progress: 1791/2366 symbols completed. RFMZ took 30.7s. Estimated remaining: 1h 13m 57s. Rate: 7.8 symbols/min
[2025-10-24T20:50:22.089661] [INFO ] [MAIN      ] RGT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:50:22.094720] [DEBUG] [LOCAL     ] RGT: Loaded 2721 existing records from primary storage.
[2025-10-24T20:50:22.094927] [INFO ] [MAIN      ] RGT: Loaded 2721 existing records.
[2025-10-24T20:50:22.275702] [WARN ] [MAIN      ] RGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:50:22.275915] [INFO ] [MAIN      ] RGT: Wiping existing primary data before full refresh.
[2025-10-24T20:50:22.275964] [INFO ] [LOCAL     ] RGT: Starting deletion of primary data.
[2025-10-24T20:50:22.276176] [DEBUG] [LOCAL     ] RGT: Deleted primary data file.
[2025-10-24T20:50:22.276232] [INFO ] [MAIN      ] RGT: Starting full primary refresh.
[2025-10-24T20:50:22.398772] [INFO ] [REMOTE    ] RGR: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T20:50:22.552815] [INFO ] [REMOTE    ] RGR: Fetching primary data for 2025-04.
[2025-10-24T20:50:22.652092] [INFO ] [REMOTE    ] RGT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:50:23.347625] [INFO ] [REMOTE    ] RFL: Fetching primary data for 2025-10.
[2025-10-24T20:50:23.497402] [INFO ] [REMOTE    ] RGR: Incremental fetch complete for 2025-04 (0.94 seconds).
[2025-10-24T20:50:23.722421] [INFO ] [REMOTE    ] RFL: Incremental fetch complete for 2025-10 (0.37 seconds).
[2025-10-24T20:50:23.724315] [INFO ] [REMOTE    ] RFL: Full fetch complete (13215 records).
[2025-10-24T20:50:23.724382] [DEBUG] [VALIDATOR ] RFL: Validating primary data.
[2025-10-24T20:50:23.724847] [FATAL] [VALIDATOR ] RFL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:50:23.724926] [FATAL] [MAIN      ] RFL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:50:23.724968] [WARN ] [MAIN      ] RFL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:50:23.725031] [INFO ] [LOCAL     ] RFL: Starting deletion of primary data.
[2025-10-24T20:50:23.725092] [DEBUG] [LOCAL     ] RFL: No primary data file found to delete.
[2025-10-24T20:50:23.725143] [INFO ] [LOCAL     ] RFL: Starting deletion of derivative data.
[2025-10-24T20:50:23.725323] [DEBUG] [LOCAL     ] RFL: Deleted derivative data file.
[2025-10-24T20:50:23.725406] [INFO ] [MAIN      ] Update Progress: 1792/2366 symbols completed. RFL took 43.6s. Estimated remaining: 1h 13m 47s. Rate: 7.8 symbols/min
[2025-10-24T20:50:23.893176] [INFO ] [MAIN      ] RH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:50:23.936526] [DEBUG] [LOCAL     ] RH: Loaded 47408 existing records from primary storage.
[2025-10-24T20:50:23.936863] [INFO ] [MAIN      ] RH: Loaded 47408 existing records.
[2025-10-24T20:50:24.110135] [WARN ] [MAIN      ] RH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:50:24.110336] [INFO ] [MAIN      ] RH: Wiping existing primary data before full refresh.
[2025-10-24T20:50:24.110382] [INFO ] [LOCAL     ] RH: Starting deletion of primary data.
[2025-10-24T20:50:24.110862] [DEBUG] [LOCAL     ] RH: Deleted primary data file.
[2025-10-24T20:50:24.110917] [INFO ] [MAIN      ] RH: Starting full primary refresh.
[2025-10-24T20:50:24.152815] [INFO ] [REMOTE    ] RGR: Fetching primary data for 2025-05.
[2025-10-24T20:50:24.461506] [INFO ] [REMOTE    ] RH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:50:24.823216] [INFO ] [REMOTE    ] RGR: Incremental fetch complete for 2025-05 (0.67 seconds).
[2025-10-24T20:50:24.947626] [INFO ] [REMOTE    ] RGR: Fetching primary data for 2025-06.
[2025-10-24T20:50:25.747721] [INFO ] [REMOTE    ] RGA: Fetching primary data for 2025-06.
[2025-10-24T20:50:25.923880] [INFO ] [REMOTE    ] RGR: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T20:50:26.047899] [INFO ] [REMOTE    ] RGA: Incremental fetch complete for 2025-06 (0.30 seconds).
[2025-10-24T20:50:26.547689] [INFO ] [REMOTE    ] RH: Fetching primary data for 2025-01.
[2025-10-24T20:50:27.246956] [INFO ] [REMOTE    ] RH: Incremental fetch complete for 2025-01 (0.70 seconds).
[2025-10-24T20:50:27.347684] [INFO ] [REMOTE    ] RH: Fetching primary data for 2025-02.
[2025-10-24T20:50:28.058628] [INFO ] [REMOTE    ] RH: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T20:50:28.147665] [INFO ] [REMOTE    ] RH: Fetching primary data for 2025-03.
[2025-10-24T20:50:28.947618] [INFO ] [REMOTE    ] RGT: Fetching primary data for 2025-01.
[2025-10-24T20:50:29.212151] [INFO ] [REMOTE    ] RH: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T20:50:29.246515] [INFO ] [REMOTE    ] RGT: Incremental fetch complete for 2025-01 (0.30 seconds).
[2025-10-24T20:50:29.747702] [INFO ] [REMOTE    ] RGA: Fetching primary data for 2025-07.
[2025-10-24T20:50:30.547751] [INFO ] [REMOTE    ] RGR: Fetching primary data for 2025-07.
[2025-10-24T20:50:31.188551] [INFO ] [REMOTE    ] RGA: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T20:50:31.347707] [INFO ] [REMOTE    ] RGT: Fetching primary data for 2025-02.
[2025-10-24T20:50:31.479323] [INFO ] [REMOTE    ] RGR: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T20:50:31.874015] [INFO ] [REMOTE    ] RGT: Incremental fetch complete for 2025-02 (0.53 seconds).
[2025-10-24T20:50:32.147692] [INFO ] [REMOTE    ] RH: Fetching primary data for 2025-04.
[2025-10-24T20:50:32.947695] [INFO ] [REMOTE    ] RGR: Fetching primary data for 2025-08.
[2025-10-24T20:50:33.541155] [INFO ] [REMOTE    ] RGR: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T20:50:33.580896] [INFO ] [REMOTE    ] RH: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T20:50:33.747678] [INFO ] [REMOTE    ] RGR: Fetching primary data for 2025-09.
[2025-10-24T20:50:34.454999] [INFO ] [REMOTE    ] RGR: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T20:50:34.547630] [INFO ] [REMOTE    ] RGR: Fetching primary data for 2025-10.
[2025-10-24T20:50:35.347673] [INFO ] [REMOTE    ] RGA: Fetching primary data for 2025-08.
[2025-10-24T20:50:35.782730] [INFO ] [REMOTE    ] RGR: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T20:50:35.786334] [INFO ] [REMOTE    ] RGR: Full fetch complete (28676 records).
[2025-10-24T20:50:35.786412] [DEBUG] [VALIDATOR ] RGR: Validating primary data.
[2025-10-24T20:50:35.786948] [FATAL] [VALIDATOR ] RGR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:50:35.787031] [FATAL] [MAIN      ] RGR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:50:35.787073] [WARN ] [MAIN      ] RGR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:50:35.787136] [INFO ] [LOCAL     ] RGR: Starting deletion of primary data.
[2025-10-24T20:50:35.787197] [DEBUG] [LOCAL     ] RGR: No primary data file found to delete.
[2025-10-24T20:50:35.787232] [INFO ] [LOCAL     ] RGR: Starting deletion of derivative data.
[2025-10-24T20:50:35.787405] [DEBUG] [LOCAL     ] RGR: Deleted derivative data file.
[2025-10-24T20:50:35.787489] [INFO ] [MAIN      ] Update Progress: 1793/2366 symbols completed. RGR took 18.1s. Estimated remaining: 1h 13m 41s. Rate: 7.8 symbols/min
[2025-10-24T20:50:35.955465] [INFO ] [MAIN      ] RHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:50:36.001156] [DEBUG] [LOCAL     ] RHI: Loaded 50078 existing records from primary storage.
[2025-10-24T20:50:36.001449] [INFO ] [MAIN      ] RHI: Loaded 50078 existing records.
[2025-10-24T20:50:36.153591] [INFO ] [REMOTE    ] RH: Fetching primary data for 2025-05.
[2025-10-24T20:50:36.183216] [WARN ] [MAIN      ] RHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:50:36.183395] [INFO ] [MAIN      ] RHI: Wiping existing primary data before full refresh.
[2025-10-24T20:50:36.183441] [INFO ] [LOCAL     ] RHI: Starting deletion of primary data.
[2025-10-24T20:50:36.184168] [DEBUG] [LOCAL     ] RHI: Deleted primary data file.
[2025-10-24T20:50:36.184224] [INFO ] [MAIN      ] RHI: Starting full primary refresh.
[2025-10-24T20:50:36.537108] [INFO ] [REMOTE    ] RHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:50:36.747213] [INFO ] [REMOTE    ] RGA: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T20:50:36.851929] [INFO ] [REMOTE    ] RH: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T20:50:36.947674] [INFO ] [REMOTE    ] RGT: Fetching primary data for 2025-03.
[2025-10-24T20:50:37.540869] [INFO ] [REMOTE    ] RGT: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T20:50:37.747680] [INFO ] [REMOTE    ] RGA: Fetching primary data for 2025-09.
[2025-10-24T20:50:38.547635] [INFO ] [REMOTE    ] RGT: Fetching primary data for 2025-04.
[2025-10-24T20:50:38.912744] [INFO ] [REMOTE    ] RGT: Incremental fetch complete for 2025-04 (0.37 seconds).
[2025-10-24T20:50:39.345057] [INFO ] [REMOTE    ] RGA: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T20:50:39.351579] [INFO ] [REMOTE    ] RH: Fetching primary data for 2025-06.
[2025-10-24T20:50:40.147711] [INFO ] [REMOTE    ] RHI: Fetching primary data for 2025-01.
[2025-10-24T20:50:40.236369] [INFO ] [REMOTE    ] RH: Incremental fetch complete for 2025-06 (0.88 seconds).
[2025-10-24T20:50:40.881476] [INFO ] [REMOTE    ] RHI: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T20:50:40.947606] [INFO ] [REMOTE    ] RHI: Fetching primary data for 2025-02.
[2025-10-24T20:50:41.747686] [INFO ] [REMOTE    ] RGA: Fetching primary data for 2025-10.
[2025-10-24T20:50:41.819139] [INFO ] [REMOTE    ] RHI: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T20:50:42.547733] [INFO ] [REMOTE    ] RH: Fetching primary data for 2025-07.
[2025-10-24T20:50:43.070075] [INFO ] [REMOTE    ] RGA: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T20:50:43.079718] [INFO ] [REMOTE    ] RGA: Full fetch complete (44837 records).
[2025-10-24T20:50:43.079934] [DEBUG] [VALIDATOR ] RGA: Validating primary data.
[2025-10-24T20:50:43.352921] [INFO ] [REMOTE    ] RHI: Fetching primary data for 2025-03.
[2025-10-24T20:50:43.509268] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present.
[2025-10-24T20:50:43.509415] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed.
[2025-10-24T20:50:43.510626] [INFO ] [MAIN      ] RGA: Fetched primary data is valid.
[2025-10-24T20:50:43.510776] [DEBUG] [LOCAL     ] RGA: Saving primary data.
[2025-10-24T20:50:43.511266] [FATAL] [LOCAL     ] RGA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:50:43.511485] [FATAL] [MAIN      ] RGA: Failed to save primary data.
[2025-10-24T20:50:43.511710] [WARN ] [MAIN      ] RGA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:50:43.511786] [INFO ] [LOCAL     ] RGA: Starting deletion of primary data.
[2025-10-24T20:50:43.511849] [DEBUG] [LOCAL     ] RGA: No primary data file found to delete.
[2025-10-24T20:50:43.511888] [INFO ] [LOCAL     ] RGA: Starting deletion of derivative data.
[2025-10-24T20:50:43.511933] [DEBUG] [LOCAL     ] RGA: No derivative data file found to delete.
[2025-10-24T20:50:43.511996] [INFO ] [MAIN      ] Update Progress: 1794/2366 symbols completed. RGA took 42.0s. Estimated remaining: 1h 13m 33s. Rate: 7.8 symbols/min
[2025-10-24T20:50:43.693047] [INFO ] [MAIN      ] RHLD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:50:43.693418] [DEBUG] [LOCAL     ] RHLD: No existing data file found in primary storage.
[2025-10-24T20:50:43.693498] [WARN ] [MAIN      ] RHLD: No existing data found, performing full refresh instead.
[2025-10-24T20:50:43.693844] [INFO ] [MAIN      ] RHLD: Wiping existing primary data before full refresh.
[2025-10-24T20:50:43.693960] [INFO ] [LOCAL     ] RHLD: Starting deletion of primary data.
[2025-10-24T20:50:43.694043] [DEBUG] [LOCAL     ] RHLD: No primary data file found to delete.
[2025-10-24T20:50:43.694271] [INFO ] [MAIN      ] RHLD: Starting full primary refresh.
[2025-10-24T20:50:43.843507] [INFO ] [REMOTE    ] RH: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T20:50:44.124695] [INFO ] [REMOTE    ] RHLD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:50:44.153181] [INFO ] [REMOTE    ] RHLD: Fetching primary data for 2025-01.
[2025-10-24T20:50:44.175701] [INFO ] [REMOTE    ] RHI: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T20:50:44.432427] [DEBUG] [REMOTE    ] RHLD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T20:50:44.432678] [WARN ] [REMOTE    ] RHLD: No data returned for month 2025-01
[2025-10-24T20:50:44.432763] [FATAL] [REMOTE    ] RHLD: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T20:50:44.432821] [FATAL] [MAIN      ] RHLD: Failed to fetch primary data.
[2025-10-24T20:50:44.432855] [WARN ] [MAIN      ] RHLD: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T20:50:44.432892] [INFO ] [LOCAL     ] RHLD: Starting deletion of primary data.
[2025-10-24T20:50:44.432942] [DEBUG] [LOCAL     ] RHLD: No primary data file found to delete.
[2025-10-24T20:50:44.432977] [INFO ] [LOCAL     ] RHLD: Starting deletion of derivative data.
[2025-10-24T20:50:44.433016] [DEBUG] [LOCAL     ] RHLD: No derivative data file found to delete.
[2025-10-24T20:50:44.433060] [INFO ] [MAIN      ] Update Progress: 1795/2366 symbols completed. RHLD took 0.9s. Estimated remaining: 1h 13m 23s. Rate: 7.8 symbols/min
[2025-10-24T20:50:44.604944] [INFO ] [MAIN      ] RHP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:50:44.642313] [DEBUG] [LOCAL     ] RHP: Loaded 40539 existing records from primary storage.
[2025-10-24T20:50:44.642632] [INFO ] [MAIN      ] RHP: Loaded 40539 existing records.
[2025-10-24T20:50:44.820617] [WARN ] [MAIN      ] RHP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:50:44.821020] [INFO ] [MAIN      ] RHP: Wiping existing primary data before full refresh.
[2025-10-24T20:50:44.821078] [INFO ] [LOCAL     ] RHP: Starting deletion of primary data.
[2025-10-24T20:50:44.821820] [DEBUG] [LOCAL     ] RHP: Deleted primary data file.
[2025-10-24T20:50:44.821877] [INFO ] [MAIN      ] RHP: Starting full primary refresh.
[2025-10-24T20:50:44.957706] [INFO ] [REMOTE    ] RH: Fetching primary data for 2025-08.
[2025-10-24T20:50:45.169104] [INFO ] [REMOTE    ] RHP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:50:45.747717] [INFO ] [REMOTE    ] RHP: Fetching primary data for 2025-01.
[2025-10-24T20:50:46.067500] [INFO ] [REMOTE    ] RH: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T20:50:46.547671] [INFO ] [REMOTE    ] RHI: Fetching primary data for 2025-04.
[2025-10-24T20:50:46.704131] [INFO ] [REMOTE    ] RHP: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T20:50:47.347640] [INFO ] [REMOTE    ] RHP: Fetching primary data for 2025-02.
[2025-10-24T20:50:47.959448] [INFO ] [REMOTE    ] RHI: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T20:50:48.147711] [INFO ] [REMOTE    ] RHI: Fetching primary data for 2025-05.
[2025-10-24T20:50:48.412431] [INFO ] [REMOTE    ] RHP: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T20:50:48.947615] [INFO ] [REMOTE    ] RGT: Fetching primary data for 2025-05.
[2025-10-24T20:50:49.222866] [INFO ] [REMOTE    ] RGT: Incremental fetch complete for 2025-05 (0.28 seconds).
[2025-10-24T20:50:49.260164] [INFO ] [REMOTE    ] RHI: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T20:50:49.747634] [INFO ] [REMOTE    ] RHP: Fetching primary data for 2025-03.
[2025-10-24T20:50:50.552384] [INFO ] [REMOTE    ] RH: Fetching primary data for 2025-09.
[2025-10-24T20:50:50.559001] [INFO ] [REMOTE    ] RHP: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T20:50:51.347625] [INFO ] [REMOTE    ] RHI: Fetching primary data for 2025-06.
[2025-10-24T20:50:51.914000] [INFO ] [REMOTE    ] RH: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T20:50:52.122051] [INFO ] [REMOTE    ] RHI: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T20:50:52.147672] [INFO ] [REMOTE    ] RHI: Fetching primary data for 2025-07.
[2025-10-24T20:50:52.947617] [INFO ] [REMOTE    ] RH: Fetching primary data for 2025-10.
[2025-10-24T20:50:53.424252] [INFO ] [REMOTE    ] RHI: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T20:50:53.747635] [INFO ] [REMOTE    ] RGT: Fetching primary data for 2025-06.
[2025-10-24T20:50:54.020152] [INFO ] [REMOTE    ] RH: Incremental fetch complete for 2025-10 (1.07 seconds).
[2025-10-24T20:50:54.027938] [INFO ] [REMOTE    ] RH: Full fetch complete (66057 records).
[2025-10-24T20:50:54.028065] [DEBUG] [VALIDATOR ] RH: Validating primary data.
[2025-10-24T20:50:54.029162] [FATAL] [VALIDATOR ] RH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:50:54.029252] [FATAL] [MAIN      ] RH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:50:54.029296] [WARN ] [MAIN      ] RH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:50:54.029342] [INFO ] [LOCAL     ] RH: Starting deletion of primary data.
[2025-10-24T20:50:54.029399] [DEBUG] [LOCAL     ] RH: No primary data file found to delete.
[2025-10-24T20:50:54.029435] [INFO ] [LOCAL     ] RH: Starting deletion of derivative data.
[2025-10-24T20:50:54.029597] [DEBUG] [LOCAL     ] RH: Deleted derivative data file.
[2025-10-24T20:50:54.029945] [INFO ] [MAIN      ] Update Progress: 1796/2366 symbols completed. RH took 30.3s. Estimated remaining: 1h 13m 16s. Rate: 7.8 symbols/min
[2025-10-24T20:50:54.138164] [INFO ] [REMOTE    ] RGT: Incremental fetch complete for 2025-06 (0.39 seconds).
[2025-10-24T20:50:54.233184] [INFO ] [MAIN      ] RIG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:50:54.290400] [DEBUG] [LOCAL     ] RIG: Loaded 54065 existing records from primary storage.
[2025-10-24T20:50:54.290906] [INFO ] [MAIN      ] RIG: Loaded 54065 existing records.
[2025-10-24T20:50:54.469117] [WARN ] [MAIN      ] RIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:50:54.469336] [INFO ] [MAIN      ] RIG: Wiping existing primary data before full refresh.
[2025-10-24T20:50:54.469383] [INFO ] [LOCAL     ] RIG: Starting deletion of primary data.
[2025-10-24T20:50:54.469995] [DEBUG] [LOCAL     ] RIG: Deleted primary data file.
[2025-10-24T20:50:54.470051] [INFO ] [MAIN      ] RIG: Starting full primary refresh.
[2025-10-24T20:50:54.552888] [INFO ] [REMOTE    ] RHI: Fetching primary data for 2025-08.
[2025-10-24T20:50:54.821406] [INFO ] [REMOTE    ] RIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:50:55.347703] [INFO ] [REMOTE    ] RGT: Fetching primary data for 2025-07.
[2025-10-24T20:50:55.525905] [INFO ] [REMOTE    ] RHI: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T20:50:56.099445] [INFO ] [REMOTE    ] RGT: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T20:50:56.147685] [INFO ] [REMOTE    ] RHI: Fetching primary data for 2025-09.
[2025-10-24T20:50:56.947688] [INFO ] [REMOTE    ] RIG: Fetching primary data for 2025-01.
[2025-10-24T20:50:57.084808] [INFO ] [REMOTE    ] RHI: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T20:50:57.747694] [INFO ] [REMOTE    ] RGT: Fetching primary data for 2025-08.
[2025-10-24T20:50:57.977097] [INFO ] [REMOTE    ] RIG: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T20:50:58.031559] [INFO ] [REMOTE    ] RGT: Incremental fetch complete for 2025-08 (0.28 seconds).
[2025-10-24T20:50:58.547717] [INFO ] [REMOTE    ] RGT: Fetching primary data for 2025-09.
[2025-10-24T20:50:59.148263] [INFO ] [REMOTE    ] RGT: Incremental fetch complete for 2025-09 (0.60 seconds).
[2025-10-24T20:50:59.347626] [INFO ] [REMOTE    ] RGT: Fetching primary data for 2025-10.
[2025-10-24T20:50:59.878081] [INFO ] [REMOTE    ] RGT: Incremental fetch complete for 2025-10 (0.53 seconds).
[2025-10-24T20:50:59.879123] [INFO ] [REMOTE    ] RGT: Full fetch complete (3925 records).
[2025-10-24T20:50:59.879208] [DEBUG] [VALIDATOR ] RGT: Validating primary data.
[2025-10-24T20:50:59.879584] [FATAL] [VALIDATOR ] RGT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:50:59.879691] [FATAL] [MAIN      ] RGT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:50:59.879740] [WARN ] [MAIN      ] RGT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:50:59.879789] [INFO ] [LOCAL     ] RGT: Starting deletion of primary data.
[2025-10-24T20:50:59.879962] [DEBUG] [LOCAL     ] RGT: No primary data file found to delete.
[2025-10-24T20:50:59.880021] [INFO ] [LOCAL     ] RGT: Starting deletion of derivative data.
[2025-10-24T20:50:59.880163] [DEBUG] [LOCAL     ] RGT: Deleted derivative data file.
[2025-10-24T20:50:59.880232] [INFO ] [MAIN      ] Update Progress: 1797/2366 symbols completed. RGT took 38.0s. Estimated remaining: 1h 13m 8s. Rate: 7.8 symbols/min
[2025-10-24T20:51:00.147685] [INFO ] [REMOTE    ] RHP: Fetching primary data for 2025-04.
[2025-10-24T20:51:00.947627] [INFO ] [REMOTE    ] RHI: Fetching primary data for 2025-10.
[2025-10-24T20:51:01.404810] [INFO ] [REMOTE    ] RHP: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T20:51:01.747727] [INFO ] [REMOTE    ] RHP: Fetching primary data for 2025-05.
[2025-10-24T20:51:01.957812] [INFO ] [REMOTE    ] RHI: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T20:51:01.966978] [INFO ] [REMOTE    ] RHI: Full fetch complete (70655 records).
[2025-10-24T20:51:01.967138] [DEBUG] [VALIDATOR ] RHI: Validating primary data.
[2025-10-24T20:51:01.968026] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:51:01.968130] [FATAL] [MAIN      ] RHI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:51:01.968174] [WARN ] [MAIN      ] RHI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:51:01.968239] [INFO ] [LOCAL     ] RHI: Starting deletion of primary data.
[2025-10-24T20:51:01.968303] [DEBUG] [LOCAL     ] RHI: No primary data file found to delete.
[2025-10-24T20:51:01.968339] [INFO ] [LOCAL     ] RHI: Starting deletion of derivative data.
[2025-10-24T20:51:01.968519] [DEBUG] [LOCAL     ] RHI: Deleted derivative data file.
[2025-10-24T20:51:01.968873] [INFO ] [MAIN      ] Update Progress: 1798/2366 symbols completed. RHI took 26.2s. Estimated remaining: 1h 12m 58s. Rate: 7.8 symbols/min
[2025-10-24T20:51:02.547628] [INFO ] [REMOTE    ] RIG: Fetching primary data for 2025-02.
[2025-10-24T20:51:02.873151] [INFO ] [REMOTE    ] RHP: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T20:51:03.302851] [INFO ] [REMOTE    ] RIG: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T20:51:03.347599] [INFO ] [REMOTE    ] RIG: Fetching primary data for 2025-03.
[2025-10-24T20:51:04.147625] [INFO ] [REMOTE    ] RHP: Fetching primary data for 2025-06.
[2025-10-24T20:51:04.223024] [INFO ] [REMOTE    ] RIG: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T20:51:04.947720] [INFO ] [REMOTE    ] RIG: Fetching primary data for 2025-04.
[2025-10-24T20:51:05.159791] [INFO ] [REMOTE    ] RHP: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T20:51:05.747602] [INFO ] [REMOTE    ] RHP: Fetching primary data for 2025-07.
[2025-10-24T20:51:06.181431] [INFO ] [REMOTE    ] RIG: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T20:51:06.547637] [INFO ] [REMOTE    ] RIG: Fetching primary data for 2025-05.
[2025-10-24T20:51:06.717415] [INFO ] [REMOTE    ] RHP: Incremental fetch complete for 2025-07 (0.97 seconds).
[2025-10-24T20:51:07.347746] [INFO ] [REMOTE    ] RHP: Fetching primary data for 2025-08.
[2025-10-24T20:51:07.549939] [INFO ] [REMOTE    ] RIG: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T20:51:07.980676] [INFO ] [REMOTE    ] RHP: Incremental fetch complete for 2025-08 (0.63 seconds).
[2025-10-24T20:51:08.147709] [INFO ] [REMOTE    ] RHP: Fetching primary data for 2025-09.
[2025-10-24T20:51:08.947719] [INFO ] [REMOTE    ] RIG: Fetching primary data for 2025-06.
[2025-10-24T20:51:09.046741] [INFO ] [REMOTE    ] RHP: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T20:51:09.747617] [INFO ] [REMOTE    ] RHP: Fetching primary data for 2025-10.
[2025-10-24T20:51:09.777253] [INFO ] [REMOTE    ] RIG: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T20:51:10.547610] [INFO ] [REMOTE    ] RIG: Fetching primary data for 2025-07.
[2025-10-24T20:51:10.712836] [INFO ] [REMOTE    ] RHP: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T20:51:10.721040] [INFO ] [REMOTE    ] RHP: Full fetch complete (57943 records).
[2025-10-24T20:51:10.721201] [DEBUG] [VALIDATOR ] RHP: Validating primary data.
[2025-10-24T20:51:10.722029] [FATAL] [VALIDATOR ] RHP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:51:10.722135] [FATAL] [MAIN      ] RHP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:51:10.722184] [WARN ] [MAIN      ] RHP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:51:10.722246] [INFO ] [LOCAL     ] RHP: Starting deletion of primary data.
[2025-10-24T20:51:10.722312] [DEBUG] [LOCAL     ] RHP: No primary data file found to delete.
[2025-10-24T20:51:10.722365] [INFO ] [LOCAL     ] RHP: Starting deletion of derivative data.
[2025-10-24T20:51:10.722528] [DEBUG] [LOCAL     ] RHP: Deleted derivative data file.
[2025-10-24T20:51:10.722953] [INFO ] [MAIN      ] Update Progress: 1799/2366 symbols completed. RHP took 26.3s. Estimated remaining: 1h 12m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:51:11.370125] [INFO ] [REMOTE    ] RIG: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T20:51:11.381955] [INFO ] [REMOTE    ] RIG: Fetching primary data for 2025-08.
[2025-10-24T20:51:12.420946] [INFO ] [REMOTE    ] RIG: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T20:51:12.432332] [INFO ] [REMOTE    ] RIG: Fetching primary data for 2025-09.
[2025-10-24T20:51:13.212437] [INFO ] [REMOTE    ] RIG: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T20:51:13.223879] [INFO ] [REMOTE    ] RIG: Fetching primary data for 2025-10.
[2025-10-24T20:51:13.998914] [INFO ] [REMOTE    ] RIG: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T20:51:14.008155] [INFO ] [REMOTE    ] RIG: Full fetch complete (77455 records).
[2025-10-24T20:51:14.008323] [DEBUG] [VALIDATOR ] RIG: Validating primary data.
[2025-10-24T20:51:14.009148] [FATAL] [VALIDATOR ] RIG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:51:14.009229] [FATAL] [MAIN      ] RIG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:51:14.009294] [WARN ] [MAIN      ] RIG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:51:14.009360] [INFO ] [LOCAL     ] RIG: Starting deletion of primary data.
[2025-10-24T20:51:14.009423] [DEBUG] [LOCAL     ] RIG: No primary data file found to delete.
[2025-10-24T20:51:14.009458] [INFO ] [LOCAL     ] RIG: Starting deletion of derivative data.
[2025-10-24T20:51:14.009626] [DEBUG] [LOCAL     ] RIG: Deleted derivative data file.
[2025-10-24T20:51:14.009937] [INFO ] [MAIN      ] Update Progress: 1800/2366 symbols completed. RIG took 20.0s. Estimated remaining: 1h 12m 42s. Rate: 7.8 symbols/min
[2025-10-24T20:51:14.615478] [INFO ] [MAIN      ] RIV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:51:14.588877] [INFO ] [MAIN      ] RJF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:51:14.694145] [INFO ] [MAIN      ] RIO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:51:14.723474] [INFO ] [MAIN      ] RITM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:51:14.741846] [DEBUG] [LOCAL     ] RIV: Loaded 12714 existing records from primary storage.
[2025-10-24T20:51:14.742140] [INFO ] [MAIN      ] RIV: Loaded 12714 existing records.
[2025-10-24T20:51:14.943621] [DEBUG] [LOCAL     ] RJF: Loaded 46930 existing records from primary storage.
[2025-10-24T20:51:14.974625] [WARN ] [MAIN      ] RIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:51:14.975518] [INFO ] [MAIN      ] RJF: Loaded 46930 existing records.
[2025-10-24T20:51:14.975677] [INFO ] [MAIN      ] RIV: Wiping existing primary data before full refresh.
[2025-10-24T20:51:14.975902] [INFO ] [LOCAL     ] RIV: Starting deletion of primary data.
[2025-10-24T20:51:15.003706] [DEBUG] [LOCAL     ] RIV: Deleted primary data file.
[2025-10-24T20:51:15.026227] [INFO ] [MAIN      ] RIV: Starting full primary refresh.
[2025-10-24T20:51:15.016748] [DEBUG] [LOCAL     ] RIO: Loaded 53792 existing records from primary storage.
[2025-10-24T20:51:15.101701] [INFO ] [MAIN      ] RIO: Loaded 53792 existing records.
[2025-10-24T20:51:15.230901] [DEBUG] [LOCAL     ] RITM: Loaded 53334 existing records from primary storage.
[2025-10-24T20:51:15.309276] [INFO ] [MAIN      ] RITM: Loaded 53334 existing records.
[2025-10-24T20:51:15.809327] [WARN ] [MAIN      ] RJF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:51:15.859298] [INFO ] [MAIN      ] RJF: Wiping existing primary data before full refresh.
[2025-10-24T20:51:15.885246] [WARN ] [MAIN      ] RIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:51:15.893520] [INFO ] [LOCAL     ] RJF: Starting deletion of primary data.
[2025-10-24T20:51:15.936187] [DEBUG] [LOCAL     ] RJF: Deleted primary data file.
[2025-10-24T20:51:15.959894] [INFO ] [MAIN      ] RIO: Wiping existing primary data before full refresh.
[2025-10-24T20:51:15.968577] [INFO ] [LOCAL     ] RIO: Starting deletion of primary data.
[2025-10-24T20:51:15.920578] [WARN ] [MAIN      ] RITM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:51:15.990509] [INFO ] [MAIN      ] RITM: Wiping existing primary data before full refresh.
[2025-10-24T20:51:15.949603] [INFO ] [MAIN      ] RJF: Starting full primary refresh.
[2025-10-24T20:51:15.996113] [DEBUG] [LOCAL     ] RIO: Deleted primary data file.
[2025-10-24T20:51:15.990427] [INFO ] [REMOTE    ] RIV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:51:15.990715] [INFO ] [LOCAL     ] RITM: Starting deletion of primary data.
[2025-10-24T20:51:16.020168] [INFO ] [MAIN      ] RIO: Starting full primary refresh.
[2025-10-24T20:51:16.030911] [INFO ] [REMOTE    ] RIV: Fetching primary data for 2025-01.
[2025-10-24T20:51:16.075171] [DEBUG] [LOCAL     ] RITM: Deleted primary data file.
[2025-10-24T20:51:16.113762] [INFO ] [MAIN      ] RITM: Starting full primary refresh.
[2025-10-24T20:51:17.070383] [INFO ] [REMOTE    ] RJF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:51:17.062240] [INFO ] [REMOTE    ] RIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:51:17.075877] [INFO ] [REMOTE    ] RJF: Fetching primary data for 2025-01.
[2025-10-24T20:51:17.076933] [INFO ] [REMOTE    ] RIO: Fetching primary data for 2025-01.
[2025-10-24T20:51:17.085442] [INFO ] [REMOTE    ] RIV: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T20:51:17.121552] [INFO ] [REMOTE    ] RIV: Fetching primary data for 2025-02.
[2025-10-24T20:51:17.152779] [INFO ] [REMOTE    ] RITM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:51:17.153829] [INFO ] [REMOTE    ] RITM: Fetching primary data for 2025-01.
[2025-10-24T20:51:17.626291] [INFO ] [REMOTE    ] RIV: Incremental fetch complete for 2025-02 (0.50 seconds).
[2025-10-24T20:51:17.747610] [INFO ] [REMOTE    ] RIV: Fetching primary data for 2025-03.
[2025-10-24T20:51:17.887427] [INFO ] [REMOTE    ] RJF: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T20:51:17.929223] [INFO ] [REMOTE    ] RITM: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T20:51:18.155050] [INFO ] [REMOTE    ] RIO: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T20:51:18.258661] [INFO ] [REMOTE    ] RIV: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T20:51:18.547710] [INFO ] [REMOTE    ] RJF: Fetching primary data for 2025-02.
[2025-10-24T20:51:19.347746] [INFO ] [REMOTE    ] RIO: Fetching primary data for 2025-02.
[2025-10-24T20:51:19.430716] [INFO ] [REMOTE    ] RJF: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T20:51:20.147729] [INFO ] [REMOTE    ] RJF: Fetching primary data for 2025-03.
[2025-10-24T20:51:20.608052] [INFO ] [REMOTE    ] RIO: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T20:51:20.947758] [INFO ] [REMOTE    ] RIV: Fetching primary data for 2025-04.
[2025-10-24T20:51:21.197993] [INFO ] [REMOTE    ] RJF: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T20:51:21.356488] [INFO ] [REMOTE    ] RIV: Incremental fetch complete for 2025-04 (0.41 seconds).
[2025-10-24T20:51:21.747683] [INFO ] [REMOTE    ] RIV: Fetching primary data for 2025-05.
[2025-10-24T20:51:22.157359] [INFO ] [REMOTE    ] RIV: Incremental fetch complete for 2025-05 (0.41 seconds).
[2025-10-24T20:51:22.547707] [INFO ] [REMOTE    ] RIV: Fetching primary data for 2025-06.
[2025-10-24T20:51:23.000337] [INFO ] [REMOTE    ] RIV: Incremental fetch complete for 2025-06 (0.45 seconds).
[2025-10-24T20:51:23.347719] [INFO ] [REMOTE    ] RIV: Fetching primary data for 2025-07.
[2025-10-24T20:51:23.825205] [INFO ] [REMOTE    ] RIV: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T20:51:24.147705] [INFO ] [REMOTE    ] RJF: Fetching primary data for 2025-04.
[2025-10-24T20:51:24.947724] [INFO ] [REMOTE    ] RIV: Fetching primary data for 2025-08.
[2025-10-24T20:51:25.567555] [INFO ] [REMOTE    ] RJF: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T20:51:25.747699] [INFO ] [REMOTE    ] RITM: Fetching primary data for 2025-02.
[2025-10-24T20:51:25.842907] [INFO ] [REMOTE    ] RIV: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T20:51:26.547666] [INFO ] [REMOTE    ] RJF: Fetching primary data for 2025-05.
[2025-10-24T20:51:26.859862] [INFO ] [REMOTE    ] RITM: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T20:51:26.956988] [INFO ] [REMOTE    ] RJF: Incremental fetch complete for 2025-05 (0.41 seconds).
[2025-10-24T20:51:27.347636] [INFO ] [REMOTE    ] RJF: Fetching primary data for 2025-06.
[2025-10-24T20:51:28.145160] [INFO ] [REMOTE    ] RJF: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T20:51:28.154046] [INFO ] [REMOTE    ] RITM: Fetching primary data for 2025-03.
[2025-10-24T20:51:28.947632] [INFO ] [REMOTE    ] RIO: Fetching primary data for 2025-03.
[2025-10-24T20:51:29.271340] [INFO ] [REMOTE    ] RITM: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T20:51:29.747764] [INFO ] [REMOTE    ] RIV: Fetching primary data for 2025-09.
[2025-10-24T20:51:29.854464] [INFO ] [REMOTE    ] RIO: Incremental fetch complete for 2025-03 (0.91 seconds).
[2025-10-24T20:51:30.547621] [INFO ] [REMOTE    ] RJF: Fetching primary data for 2025-07.
[2025-10-24T20:51:30.707801] [INFO ] [REMOTE    ] RIV: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T20:51:31.347676] [INFO ] [REMOTE    ] RIV: Fetching primary data for 2025-10.
[2025-10-24T20:51:31.787960] [INFO ] [REMOTE    ] RJF: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T20:51:32.121703] [INFO ] [REMOTE    ] RIV: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T20:51:32.125842] [INFO ] [REMOTE    ] RIV: Full fetch complete (17496 records).
[2025-10-24T20:51:32.126042] [DEBUG] [VALIDATOR ] RIV: Validating primary data.
[2025-10-24T20:51:32.127002] [FATAL] [VALIDATOR ] RIV: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:51:32.127370] [FATAL] [MAIN      ] RIV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:51:32.127500] [WARN ] [MAIN      ] RIV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:51:32.127706] [INFO ] [LOCAL     ] RIV: Starting deletion of primary data.
[2025-10-24T20:51:32.127859] [DEBUG] [LOCAL     ] RIV: No primary data file found to delete.
[2025-10-24T20:51:32.127933] [INFO ] [LOCAL     ] RIV: Starting deletion of derivative data.
[2025-10-24T20:51:32.128158] [DEBUG] [LOCAL     ] RIV: Deleted derivative data file.
[2025-10-24T20:51:32.128278] [INFO ] [MAIN      ] Update Progress: 1801/2366 symbols completed. RIV took 18.1s. Estimated remaining: 1h 12m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:51:32.157893] [INFO ] [REMOTE    ] RIO: Fetching primary data for 2025-04.
[2025-10-24T20:51:32.305753] [INFO ] [MAIN      ] RKT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:51:32.359967] [DEBUG] [LOCAL     ] RKT: Loaded 54119 existing records from primary storage.
[2025-10-24T20:51:32.360279] [INFO ] [MAIN      ] RKT: Loaded 54119 existing records.
[2025-10-24T20:51:32.546516] [WARN ] [MAIN      ] RKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:51:32.546845] [INFO ] [MAIN      ] RKT: Wiping existing primary data before full refresh.
[2025-10-24T20:51:32.546905] [INFO ] [LOCAL     ] RKT: Starting deletion of primary data.
[2025-10-24T20:51:32.547225] [DEBUG] [LOCAL     ] RKT: Deleted primary data file.
[2025-10-24T20:51:32.547282] [INFO ] [MAIN      ] RKT: Starting full primary refresh.
[2025-10-24T20:51:32.907115] [INFO ] [REMOTE    ] RKT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:51:32.947613] [INFO ] [REMOTE    ] RKT: Fetching primary data for 2025-01.
[2025-10-24T20:51:33.217511] [INFO ] [REMOTE    ] RIO: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T20:51:33.719901] [INFO ] [REMOTE    ] RKT: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T20:51:33.747672] [INFO ] [REMOTE    ] RJF: Fetching primary data for 2025-08.
[2025-10-24T20:51:34.547673] [INFO ] [REMOTE    ] RKT: Fetching primary data for 2025-02.
[2025-10-24T20:51:34.588575] [INFO ] [REMOTE    ] RJF: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T20:51:35.347638] [INFO ] [REMOTE    ] RITM: Fetching primary data for 2025-04.
[2025-10-24T20:51:36.020076] [INFO ] [REMOTE    ] RKT: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T20:51:36.147620] [INFO ] [REMOTE    ] RJF: Fetching primary data for 2025-09.
[2025-10-24T20:51:36.255812] [INFO ] [REMOTE    ] RITM: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T20:51:36.932062] [INFO ] [REMOTE    ] RJF: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T20:51:36.947606] [INFO ] [REMOTE    ] RJF: Fetching primary data for 2025-10.
[2025-10-24T20:51:37.747669] [INFO ] [REMOTE    ] RITM: Fetching primary data for 2025-05.
[2025-10-24T20:51:38.076332] [INFO ] [REMOTE    ] RJF: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T20:51:38.084756] [INFO ] [REMOTE    ] RJF: Full fetch complete (68533 records).
[2025-10-24T20:51:38.084920] [DEBUG] [VALIDATOR ] RJF: Validating primary data.
[2025-10-24T20:51:38.085884] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:51:38.085983] [FATAL] [MAIN      ] RJF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:51:38.086026] [WARN ] [MAIN      ] RJF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:51:38.086091] [INFO ] [LOCAL     ] RJF: Starting deletion of primary data.
[2025-10-24T20:51:38.086155] [DEBUG] [LOCAL     ] RJF: No primary data file found to delete.
[2025-10-24T20:51:38.086192] [INFO ] [LOCAL     ] RJF: Starting deletion of derivative data.
[2025-10-24T20:51:38.086366] [DEBUG] [LOCAL     ] RJF: Deleted derivative data file.
[2025-10-24T20:51:38.086456] [INFO ] [MAIN      ] Update Progress: 1802/2366 symbols completed. RJF took 24.1s. Estimated remaining: 1h 12m 29s. Rate: 7.8 symbols/min
[2025-10-24T20:51:38.252912] [INFO ] [MAIN      ] RL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:51:38.290040] [DEBUG] [LOCAL     ] RL: Loaded 39534 existing records from primary storage.
[2025-10-24T20:51:38.290326] [INFO ] [MAIN      ] RL: Loaded 39534 existing records.
[2025-10-24T20:51:38.471103] [WARN ] [MAIN      ] RL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:51:38.471345] [INFO ] [MAIN      ] RL: Wiping existing primary data before full refresh.
[2025-10-24T20:51:38.471398] [INFO ] [LOCAL     ] RL: Starting deletion of primary data.
[2025-10-24T20:51:38.471687] [DEBUG] [LOCAL     ] RL: Deleted primary data file.
[2025-10-24T20:51:38.471743] [INFO ] [MAIN      ] RL: Starting full primary refresh.
[2025-10-24T20:51:38.550748] [INFO ] [REMOTE    ] RIO: Fetching primary data for 2025-05.
[2025-10-24T20:51:38.838276] [INFO ] [REMOTE    ] RL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:51:38.872106] [INFO ] [REMOTE    ] RITM: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T20:51:39.347687] [INFO ] [REMOTE    ] RL: Fetching primary data for 2025-01.
[2025-10-24T20:51:39.631822] [INFO ] [REMOTE    ] RIO: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T20:51:40.070548] [INFO ] [REMOTE    ] RL: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T20:51:40.147630] [INFO ] [REMOTE    ] RL: Fetching primary data for 2025-02.
[2025-10-24T20:51:40.947709] [INFO ] [REMOTE    ] RKT: Fetching primary data for 2025-03.
[2025-10-24T20:51:41.321751] [INFO ] [REMOTE    ] RL: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T20:51:41.747633] [INFO ] [REMOTE    ] RIO: Fetching primary data for 2025-06.
[2025-10-24T20:51:42.363412] [INFO ] [REMOTE    ] RKT: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T20:51:42.523154] [INFO ] [REMOTE    ] RIO: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T20:51:42.547603] [INFO ] [REMOTE    ] RIO: Fetching primary data for 2025-07.
[2025-10-24T20:51:43.347613] [INFO ] [REMOTE    ] RL: Fetching primary data for 2025-03.
[2025-10-24T20:51:43.636347] [INFO ] [REMOTE    ] RIO: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T20:51:44.147679] [INFO ] [REMOTE    ] RKT: Fetching primary data for 2025-04.
[2025-10-24T20:51:44.208603] [INFO ] [REMOTE    ] RL: Incremental fetch complete for 2025-03 (0.86 seconds).
[2025-10-24T20:51:44.947621] [INFO ] [REMOTE    ] RITM: Fetching primary data for 2025-06.
[2025-10-24T20:51:45.278488] [INFO ] [REMOTE    ] RKT: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T20:51:45.690424] [INFO ] [REMOTE    ] RITM: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T20:51:45.747604] [INFO ] [REMOTE    ] RITM: Fetching primary data for 2025-07.
[2025-10-24T20:51:46.547676] [INFO ] [REMOTE    ] RIO: Fetching primary data for 2025-08.
[2025-10-24T20:51:46.940194] [INFO ] [REMOTE    ] RITM: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T20:51:47.320949] [INFO ] [REMOTE    ] RIO: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T20:51:47.347622] [INFO ] [REMOTE    ] RITM: Fetching primary data for 2025-08.
[2025-10-24T20:51:48.147717] [INFO ] [REMOTE    ] RKT: Fetching primary data for 2025-05.
[2025-10-24T20:51:48.190478] [INFO ] [REMOTE    ] RITM: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T20:51:48.947759] [INFO ] [REMOTE    ] RIO: Fetching primary data for 2025-09.
[2025-10-24T20:51:49.187170] [INFO ] [REMOTE    ] RKT: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T20:51:49.747725] [INFO ] [REMOTE    ] RL: Fetching primary data for 2025-04.
[2025-10-24T20:51:50.333965] [INFO ] [REMOTE    ] RIO: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T20:51:50.547635] [INFO ] [REMOTE    ] RKT: Fetching primary data for 2025-06.
[2025-10-24T20:51:50.719200] [INFO ] [REMOTE    ] RL: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T20:51:51.347619] [INFO ] [REMOTE    ] RITM: Fetching primary data for 2025-09.
[2025-10-24T20:51:51.553249] [INFO ] [REMOTE    ] RKT: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T20:51:51.989628] [INFO ] [REMOTE    ] RITM: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T20:51:52.147637] [INFO ] [REMOTE    ] RIO: Fetching primary data for 2025-10.
[2025-10-24T20:51:52.947617] [INFO ] [REMOTE    ] RL: Fetching primary data for 2025-05.
[2025-10-24T20:51:53.271504] [INFO ] [REMOTE    ] RIO: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T20:51:53.281136] [INFO ] [REMOTE    ] RIO: Full fetch complete (77124 records).
[2025-10-24T20:51:53.281259] [DEBUG] [VALIDATOR ] RIO: Validating primary data.
[2025-10-24T20:51:53.282016] [FATAL] [VALIDATOR ] RIO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:51:53.282125] [FATAL] [MAIN      ] RIO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:51:53.282197] [WARN ] [MAIN      ] RIO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:51:53.282293] [INFO ] [LOCAL     ] RIO: Starting deletion of primary data.
[2025-10-24T20:51:53.282372] [DEBUG] [LOCAL     ] RIO: No primary data file found to delete.
[2025-10-24T20:51:53.282408] [INFO ] [LOCAL     ] RIO: Starting deletion of derivative data.
[2025-10-24T20:51:53.282572] [DEBUG] [LOCAL     ] RIO: Deleted derivative data file.
[2025-10-24T20:51:53.282977] [INFO ] [MAIN      ] Update Progress: 1803/2366 symbols completed. RIO took 39.3s. Estimated remaining: 1h 12m 24s. Rate: 7.8 symbols/min
[2025-10-24T20:51:53.453000] [INFO ] [MAIN      ] RLI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:51:53.487590] [DEBUG] [LOCAL     ] RLI: Loaded 34958 existing records from primary storage.
[2025-10-24T20:51:53.487909] [INFO ] [MAIN      ] RLI: Loaded 34958 existing records.
[2025-10-24T20:51:53.670158] [WARN ] [MAIN      ] RLI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:51:53.670477] [INFO ] [MAIN      ] RLI: Wiping existing primary data before full refresh.
[2025-10-24T20:51:53.670625] [INFO ] [LOCAL     ] RLI: Starting deletion of primary data.
[2025-10-24T20:51:53.671161] [DEBUG] [LOCAL     ] RLI: Deleted primary data file.
[2025-10-24T20:51:53.671217] [INFO ] [MAIN      ] RLI: Starting full primary refresh.
[2025-10-24T20:51:53.752304] [INFO ] [REMOTE    ] RITM: Fetching primary data for 2025-10.
[2025-10-24T20:51:53.975307] [INFO ] [REMOTE    ] RL: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T20:51:54.083980] [INFO ] [REMOTE    ] RLI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:51:54.547727] [INFO ] [REMOTE    ] RL: Fetching primary data for 2025-06.
[2025-10-24T20:51:54.765233] [INFO ] [REMOTE    ] RITM: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T20:51:54.774989] [INFO ] [REMOTE    ] RITM: Full fetch complete (76358 records).
[2025-10-24T20:51:54.775191] [DEBUG] [VALIDATOR ] RITM: Validating primary data.
[2025-10-24T20:51:54.776024] [FATAL] [VALIDATOR ] RITM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:51:54.776131] [FATAL] [MAIN      ] RITM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:51:54.776172] [WARN ] [MAIN      ] RITM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:51:54.776212] [INFO ] [LOCAL     ] RITM: Starting deletion of primary data.
[2025-10-24T20:51:54.776268] [DEBUG] [LOCAL     ] RITM: No primary data file found to delete.
[2025-10-24T20:51:54.776303] [INFO ] [LOCAL     ] RITM: Starting deletion of derivative data.
[2025-10-24T20:51:54.776496] [DEBUG] [LOCAL     ] RITM: Deleted derivative data file.
[2025-10-24T20:51:54.776919] [INFO ] [MAIN      ] Update Progress: 1804/2366 symbols completed. RITM took 40.8s. Estimated remaining: 1h 12m 14s. Rate: 7.8 symbols/min
[2025-10-24T20:51:54.948084] [INFO ] [MAIN      ] RLJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:51:54.991677] [DEBUG] [LOCAL     ] RLJ: Loaded 48283 existing records from primary storage.
[2025-10-24T20:51:54.991983] [INFO ] [MAIN      ] RLJ: Loaded 48283 existing records.
[2025-10-24T20:51:55.163445] [WARN ] [MAIN      ] RLJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:51:55.163628] [INFO ] [MAIN      ] RLJ: Wiping existing primary data before full refresh.
[2025-10-24T20:51:55.163708] [INFO ] [LOCAL     ] RLJ: Starting deletion of primary data.
[2025-10-24T20:51:55.164432] [DEBUG] [LOCAL     ] RLJ: Deleted primary data file.
[2025-10-24T20:51:55.164489] [INFO ] [MAIN      ] RLJ: Starting full primary refresh.
[2025-10-24T20:51:55.356692] [INFO ] [REMOTE    ] RKT: Fetching primary data for 2025-07.
[2025-10-24T20:51:55.524495] [INFO ] [REMOTE    ] RLJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:51:55.808676] [INFO ] [REMOTE    ] RL: Incremental fetch complete for 2025-06 (1.26 seconds).
[2025-10-24T20:51:56.147733] [INFO ] [REMOTE    ] RLI: Fetching primary data for 2025-01.
[2025-10-24T20:51:56.756198] [INFO ] [REMOTE    ] RKT: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T20:51:56.947717] [INFO ] [REMOTE    ] RKT: Fetching primary data for 2025-08.
[2025-10-24T20:51:57.088084] [INFO ] [REMOTE    ] RLI: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T20:51:57.747670] [INFO ] [REMOTE    ] RL: Fetching primary data for 2025-07.
[2025-10-24T20:51:57.990621] [INFO ] [REMOTE    ] RKT: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T20:51:58.547741] [INFO ] [REMOTE    ] RLJ: Fetching primary data for 2025-01.
[2025-10-24T20:51:58.850347] [INFO ] [REMOTE    ] RL: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T20:51:59.347745] [INFO ] [REMOTE    ] RKT: Fetching primary data for 2025-09.
[2025-10-24T20:51:59.389516] [INFO ] [REMOTE    ] RLJ: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T20:52:00.147620] [INFO ] [REMOTE    ] RLJ: Fetching primary data for 2025-02.
[2025-10-24T20:52:00.405473] [INFO ] [REMOTE    ] RKT: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T20:52:00.870687] [INFO ] [REMOTE    ] RLJ: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:52:00.947666] [INFO ] [REMOTE    ] RLJ: Fetching primary data for 2025-03.
[2025-10-24T20:52:01.747631] [INFO ] [REMOTE    ] RL: Fetching primary data for 2025-08.
[2025-10-24T20:52:01.852115] [INFO ] [REMOTE    ] RLJ: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T20:52:02.547731] [INFO ] [REMOTE    ] RLI: Fetching primary data for 2025-02.
[2025-10-24T20:52:02.830987] [INFO ] [REMOTE    ] RL: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T20:52:03.347698] [INFO ] [REMOTE    ] RKT: Fetching primary data for 2025-10.
[2025-10-24T20:52:03.474750] [INFO ] [REMOTE    ] RLI: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T20:52:04.046875] [INFO ] [REMOTE    ] RKT: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T20:52:04.057779] [INFO ] [REMOTE    ] RKT: Full fetch complete (77220 records).
[2025-10-24T20:52:04.058025] [DEBUG] [VALIDATOR ] RKT: Validating primary data.
[2025-10-24T20:52:04.059069] [FATAL] [VALIDATOR ] RKT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:52:04.059169] [FATAL] [MAIN      ] RKT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:52:04.059213] [WARN ] [MAIN      ] RKT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:52:04.059283] [INFO ] [LOCAL     ] RKT: Starting deletion of primary data.
[2025-10-24T20:52:04.059356] [DEBUG] [LOCAL     ] RKT: No primary data file found to delete.
[2025-10-24T20:52:04.059396] [INFO ] [LOCAL     ] RKT: Starting deletion of derivative data.
[2025-10-24T20:52:04.059661] [DEBUG] [LOCAL     ] RKT: Deleted derivative data file.
[2025-10-24T20:52:04.060042] [INFO ] [MAIN      ] Update Progress: 1805/2366 symbols completed. RKT took 31.9s. Estimated remaining: 1h 12m 7s. Rate: 7.8 symbols/min
[2025-10-24T20:52:04.152921] [INFO ] [REMOTE    ] RLJ: Fetching primary data for 2025-04.
[2025-10-24T20:52:04.241390] [INFO ] [MAIN      ] RLTY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:52:04.256971] [DEBUG] [LOCAL     ] RLTY: Loaded 11046 existing records from primary storage.
[2025-10-24T20:52:04.257268] [INFO ] [MAIN      ] RLTY: Loaded 11046 existing records.
[2025-10-24T20:52:04.441575] [WARN ] [MAIN      ] RLTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:52:04.441880] [INFO ] [MAIN      ] RLTY: Wiping existing primary data before full refresh.
[2025-10-24T20:52:04.441966] [INFO ] [LOCAL     ] RLTY: Starting deletion of primary data.
[2025-10-24T20:52:04.442345] [DEBUG] [LOCAL     ] RLTY: Deleted primary data file.
[2025-10-24T20:52:04.442404] [INFO ] [MAIN      ] RLTY: Starting full primary refresh.
[2025-10-24T20:52:04.823682] [INFO ] [REMOTE    ] RLTY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:52:04.947629] [INFO ] [REMOTE    ] RL: Fetching primary data for 2025-09.
[2025-10-24T20:52:05.022069] [INFO ] [REMOTE    ] RLJ: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T20:52:05.747627] [INFO ] [REMOTE    ] RLI: Fetching primary data for 2025-03.
[2025-10-24T20:52:05.914235] [INFO ] [REMOTE    ] RL: Incremental fetch complete for 2025-09 (0.97 seconds).
[2025-10-24T20:52:06.437181] [INFO ] [REMOTE    ] RLI: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T20:52:06.547610] [INFO ] [REMOTE    ] RLTY: Fetching primary data for 2025-01.
[2025-10-24T20:52:07.264268] [INFO ] [REMOTE    ] RLTY: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T20:52:07.347671] [INFO ] [REMOTE    ] RLTY: Fetching primary data for 2025-02.
[2025-10-24T20:52:08.147612] [INFO ] [REMOTE    ] RL: Fetching primary data for 2025-10.
[2025-10-24T20:52:08.224310] [INFO ] [REMOTE    ] RLTY: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T20:52:08.947616] [INFO ] [REMOTE    ] RLTY: Fetching primary data for 2025-03.
[2025-10-24T20:52:08.998464] [INFO ] [REMOTE    ] RL: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T20:52:09.004408] [INFO ] [REMOTE    ] RL: Full fetch complete (58774 records).
[2025-10-24T20:52:09.004533] [DEBUG] [VALIDATOR ] RL: Validating primary data.
[2025-10-24T20:52:09.005140] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:52:09.005227] [FATAL] [MAIN      ] RL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:52:09.005270] [WARN ] [MAIN      ] RL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:52:09.005334] [INFO ] [LOCAL     ] RL: Starting deletion of primary data.
[2025-10-24T20:52:09.005396] [DEBUG] [LOCAL     ] RL: No primary data file found to delete.
[2025-10-24T20:52:09.005433] [INFO ] [LOCAL     ] RL: Starting deletion of derivative data.
[2025-10-24T20:52:09.005580] [DEBUG] [LOCAL     ] RL: Deleted derivative data file.
[2025-10-24T20:52:09.005672] [INFO ] [MAIN      ] Update Progress: 1806/2366 symbols completed. RL took 30.9s. Estimated remaining: 1h 11m 58s. Rate: 7.8 symbols/min
[2025-10-24T20:52:09.174257] [INFO ] [MAIN      ] RLX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:52:09.215628] [DEBUG] [LOCAL     ] RLX: Loaded 48484 existing records from primary storage.
[2025-10-24T20:52:09.215955] [INFO ] [MAIN      ] RLX: Loaded 48484 existing records.
[2025-10-24T20:52:09.394504] [WARN ] [MAIN      ] RLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:52:09.394765] [INFO ] [MAIN      ] RLX: Wiping existing primary data before full refresh.
[2025-10-24T20:52:09.394816] [INFO ] [LOCAL     ] RLX: Starting deletion of primary data.
[2025-10-24T20:52:09.395115] [DEBUG] [LOCAL     ] RLX: Deleted primary data file.
[2025-10-24T20:52:09.395170] [INFO ] [MAIN      ] RLX: Starting full primary refresh.
[2025-10-24T20:52:09.669385] [INFO ] [REMOTE    ] RLTY: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T20:52:09.751715] [INFO ] [REMOTE    ] RLTY: Fetching primary data for 2025-04.
[2025-10-24T20:52:09.773185] [INFO ] [REMOTE    ] RLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:52:10.535435] [INFO ] [REMOTE    ] RLTY: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:52:10.547601] [INFO ] [REMOTE    ] RLTY: Fetching primary data for 2025-05.
[2025-10-24T20:52:11.011825] [INFO ] [REMOTE    ] RLTY: Incremental fetch complete for 2025-05 (0.46 seconds).
[2025-10-24T20:52:11.347666] [INFO ] [REMOTE    ] RLJ: Fetching primary data for 2025-05.
[2025-10-24T20:52:12.096472] [INFO ] [REMOTE    ] RLJ: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T20:52:12.147604] [INFO ] [REMOTE    ] RLTY: Fetching primary data for 2025-06.
[2025-10-24T20:52:12.605331] [INFO ] [REMOTE    ] RLTY: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T20:52:12.947720] [INFO ] [REMOTE    ] RLX: Fetching primary data for 2025-01.
[2025-10-24T20:52:13.752740] [INFO ] [REMOTE    ] RLTY: Fetching primary data for 2025-07.
[2025-10-24T20:52:13.768987] [INFO ] [REMOTE    ] RLX: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T20:52:14.233920] [INFO ] [REMOTE    ] RLTY: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T20:52:14.547681] [INFO ] [REMOTE    ] RLJ: Fetching primary data for 2025-06.
[2025-10-24T20:52:15.347639] [INFO ] [REMOTE    ] RLI: Fetching primary data for 2025-04.
[2025-10-24T20:52:15.663765] [INFO ] [REMOTE    ] RLJ: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T20:52:16.147618] [INFO ] [REMOTE    ] RLJ: Fetching primary data for 2025-07.
[2025-10-24T20:52:16.319576] [INFO ] [REMOTE    ] RLI: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T20:52:16.947717] [INFO ] [REMOTE    ] RLX: Fetching primary data for 2025-02.
[2025-10-24T20:52:17.011548] [INFO ] [REMOTE    ] RLJ: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T20:52:17.747722] [INFO ] [REMOTE    ] RLTY: Fetching primary data for 2025-08.
[2025-10-24T20:52:17.935678] [INFO ] [REMOTE    ] RLX: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T20:52:18.547623] [INFO ] [REMOTE    ] RLI: Fetching primary data for 2025-05.
[2025-10-24T20:52:18.631538] [INFO ] [REMOTE    ] RLTY: Incremental fetch complete for 2025-08 (0.88 seconds).
[2025-10-24T20:52:19.347621] [INFO ] [REMOTE    ] RLTY: Fetching primary data for 2025-09.
[2025-10-24T20:52:19.550528] [INFO ] [REMOTE    ] RLI: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T20:52:19.808291] [INFO ] [REMOTE    ] RLTY: Incremental fetch complete for 2025-09 (0.46 seconds).
[2025-10-24T20:52:20.147709] [INFO ] [REMOTE    ] RLTY: Fetching primary data for 2025-10.
[2025-10-24T20:52:20.861956] [INFO ] [REMOTE    ] RLTY: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T20:52:20.864355] [INFO ] [REMOTE    ] RLTY: Full fetch complete (17136 records).
[2025-10-24T20:52:20.864426] [DEBUG] [VALIDATOR ] RLTY: Validating primary data.
[2025-10-24T20:52:20.864885] [FATAL] [VALIDATOR ] RLTY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:52:20.864967] [FATAL] [MAIN      ] RLTY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:52:20.865011] [WARN ] [MAIN      ] RLTY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:52:20.865070] [INFO ] [LOCAL     ] RLTY: Starting deletion of primary data.
[2025-10-24T20:52:20.865163] [DEBUG] [LOCAL     ] RLTY: No primary data file found to delete.
[2025-10-24T20:52:20.865206] [INFO ] [LOCAL     ] RLTY: Starting deletion of derivative data.
[2025-10-24T20:52:20.865378] [DEBUG] [LOCAL     ] RLTY: Deleted derivative data file.
[2025-10-24T20:52:20.865467] [INFO ] [MAIN      ] Update Progress: 1807/2366 symbols completed. RLTY took 16.8s. Estimated remaining: 1h 11m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:52:20.952827] [INFO ] [REMOTE    ] RLX: Fetching primary data for 2025-03.
[2025-10-24T20:52:21.054931] [INFO ] [MAIN      ] RM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:52:21.064795] [DEBUG] [LOCAL     ] RM: Loaded 7531 existing records from primary storage.
[2025-10-24T20:52:21.064997] [INFO ] [MAIN      ] RM: Loaded 7531 existing records.
[2025-10-24T20:52:21.246247] [WARN ] [MAIN      ] RM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:52:21.246449] [INFO ] [MAIN      ] RM: Wiping existing primary data before full refresh.
[2025-10-24T20:52:21.246513] [INFO ] [LOCAL     ] RM: Starting deletion of primary data.
[2025-10-24T20:52:21.246799] [DEBUG] [LOCAL     ] RM: Deleted primary data file.
[2025-10-24T20:52:21.246859] [INFO ] [MAIN      ] RM: Starting full primary refresh.
[2025-10-24T20:52:21.606832] [INFO ] [REMOTE    ] RM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:52:21.741793] [INFO ] [REMOTE    ] RLX: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T20:52:21.751780] [INFO ] [REMOTE    ] RM: Fetching primary data for 2025-01.
[2025-10-24T20:52:22.393577] [INFO ] [REMOTE    ] RM: Incremental fetch complete for 2025-01 (0.64 seconds).
[2025-10-24T20:52:22.547686] [INFO ] [REMOTE    ] RM: Fetching primary data for 2025-02.
[2025-10-24T20:52:23.005723] [INFO ] [REMOTE    ] RM: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T20:52:23.347715] [INFO ] [REMOTE    ] RM: Fetching primary data for 2025-03.
[2025-10-24T20:52:24.142150] [INFO ] [REMOTE    ] RM: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T20:52:24.147592] [INFO ] [REMOTE    ] RM: Fetching primary data for 2025-04.
[2025-10-24T20:52:24.947613] [INFO ] [REMOTE    ] RLI: Fetching primary data for 2025-06.
[2025-10-24T20:52:24.977186] [INFO ] [REMOTE    ] RM: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T20:52:25.747625] [INFO ] [REMOTE    ] RM: Fetching primary data for 2025-05.
[2025-10-24T20:52:26.054999] [INFO ] [REMOTE    ] RLI: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T20:52:26.547735] [INFO ] [REMOTE    ] RLX: Fetching primary data for 2025-04.
[2025-10-24T20:52:26.565894] [INFO ] [REMOTE    ] RM: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T20:52:27.347608] [INFO ] [REMOTE    ] RM: Fetching primary data for 2025-06.
[2025-10-24T20:52:27.652470] [INFO ] [REMOTE    ] RLX: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T20:52:27.793696] [INFO ] [REMOTE    ] RM: Incremental fetch complete for 2025-06 (0.45 seconds).
[2025-10-24T20:52:28.147633] [INFO ] [REMOTE    ] RLJ: Fetching primary data for 2025-08.
[2025-10-24T20:52:28.947700] [INFO ] [REMOTE    ] RLI: Fetching primary data for 2025-07.
[2025-10-24T20:52:29.150048] [INFO ] [REMOTE    ] RLJ: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T20:52:29.747633] [INFO ] [REMOTE    ] RM: Fetching primary data for 2025-07.
[2025-10-24T20:52:29.969854] [INFO ] [REMOTE    ] RLI: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T20:52:30.221312] [INFO ] [REMOTE    ] RM: Incremental fetch complete for 2025-07 (0.47 seconds).
[2025-10-24T20:52:30.547669] [INFO ] [REMOTE    ] RLX: Fetching primary data for 2025-05.
[2025-10-24T20:52:31.347621] [INFO ] [REMOTE    ] RLI: Fetching primary data for 2025-08.
[2025-10-24T20:52:31.581741] [INFO ] [REMOTE    ] RLX: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T20:52:32.147621] [INFO ] [REMOTE    ] RLX: Fetching primary data for 2025-06.
[2025-10-24T20:52:32.502022] [INFO ] [REMOTE    ] RLI: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T20:52:32.947676] [INFO ] [REMOTE    ] RM: Fetching primary data for 2025-08.
[2025-10-24T20:52:33.568527] [INFO ] [REMOTE    ] RLX: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T20:52:33.747706] [INFO ] [REMOTE    ] RLI: Fetching primary data for 2025-09.
[2025-10-24T20:52:33.848912] [INFO ] [REMOTE    ] RM: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T20:52:34.427158] [INFO ] [REMOTE    ] RLI: Incremental fetch complete for 2025-09 (0.68 seconds).
[2025-10-24T20:52:34.547673] [INFO ] [REMOTE    ] RLI: Fetching primary data for 2025-10.
[2025-10-24T20:52:35.347700] [INFO ] [REMOTE    ] RLJ: Fetching primary data for 2025-09.
[2025-10-24T20:52:35.500173] [INFO ] [REMOTE    ] RLI: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T20:52:35.507128] [INFO ] [REMOTE    ] RLI: Full fetch complete (49310 records).
[2025-10-24T20:52:35.507224] [DEBUG] [VALIDATOR ] RLI: Validating primary data.
[2025-10-24T20:52:35.507879] [FATAL] [VALIDATOR ] RLI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:52:35.507961] [FATAL] [MAIN      ] RLI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:52:35.508002] [WARN ] [MAIN      ] RLI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:52:35.508039] [INFO ] [LOCAL     ] RLI: Starting deletion of primary data.
[2025-10-24T20:52:35.508093] [DEBUG] [LOCAL     ] RLI: No primary data file found to delete.
[2025-10-24T20:52:35.508127] [INFO ] [LOCAL     ] RLI: Starting deletion of derivative data.
[2025-10-24T20:52:35.508302] [DEBUG] [LOCAL     ] RLI: Deleted derivative data file.
[2025-10-24T20:52:35.508980] [INFO ] [MAIN      ] Update Progress: 1808/2366 symbols completed. RLI took 42.2s. Estimated remaining: 1h 11m 46s. Rate: 7.8 symbols/min
[2025-10-24T20:52:35.697138] [INFO ] [MAIN      ] RMAX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:52:35.717876] [DEBUG] [LOCAL     ] RMAX: Loaded 21748 existing records from primary storage.
[2025-10-24T20:52:35.718115] [INFO ] [MAIN      ] RMAX: Loaded 21748 existing records.
[2025-10-24T20:52:35.891990] [WARN ] [MAIN      ] RMAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:52:35.892180] [INFO ] [MAIN      ] RMAX: Wiping existing primary data before full refresh.
[2025-10-24T20:52:35.892226] [INFO ] [LOCAL     ] RMAX: Starting deletion of primary data.
[2025-10-24T20:52:35.892446] [DEBUG] [LOCAL     ] RMAX: Deleted primary data file.
[2025-10-24T20:52:35.892487] [INFO ] [MAIN      ] RMAX: Starting full primary refresh.
[2025-10-24T20:52:36.152738] [INFO ] [REMOTE    ] RLX: Fetching primary data for 2025-07.
[2025-10-24T20:52:36.252727] [INFO ] [REMOTE    ] RMAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:52:36.515069] [INFO ] [REMOTE    ] RLJ: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T20:52:36.947690] [INFO ] [REMOTE    ] RM: Fetching primary data for 2025-09.
[2025-10-24T20:52:37.203236] [INFO ] [REMOTE    ] RLX: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T20:52:37.661847] [INFO ] [REMOTE    ] RM: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T20:52:37.747733] [INFO ] [REMOTE    ] RLX: Fetching primary data for 2025-08.
[2025-10-24T20:52:38.547745] [INFO ] [REMOTE    ] RLJ: Fetching primary data for 2025-10.
[2025-10-24T20:52:38.814979] [INFO ] [REMOTE    ] RLX: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T20:52:39.347701] [INFO ] [REMOTE    ] RMAX: Fetching primary data for 2025-01.
[2025-10-24T20:52:39.490255] [INFO ] [REMOTE    ] RLJ: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T20:52:39.498958] [INFO ] [REMOTE    ] RLJ: Full fetch complete (69045 records).
[2025-10-24T20:52:39.499114] [DEBUG] [VALIDATOR ] RLJ: Validating primary data.
[2025-10-24T20:52:39.499915] [FATAL] [VALIDATOR ] RLJ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:52:39.499997] [FATAL] [MAIN      ] RLJ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:52:39.500074] [WARN ] [MAIN      ] RLJ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:52:39.500147] [INFO ] [LOCAL     ] RLJ: Starting deletion of primary data.
[2025-10-24T20:52:39.500213] [DEBUG] [LOCAL     ] RLJ: No primary data file found to delete.
[2025-10-24T20:52:39.500250] [INFO ] [LOCAL     ] RLJ: Starting deletion of derivative data.
[2025-10-24T20:52:39.500407] [DEBUG] [LOCAL     ] RLJ: Deleted derivative data file.
[2025-10-24T20:52:39.500836] [INFO ] [MAIN      ] Update Progress: 1809/2366 symbols completed. RLJ took 44.7s. Estimated remaining: 1h 11m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:52:39.674750] [INFO ] [MAIN      ] RMD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:52:39.688913] [INFO ] [REMOTE    ] RMAX: Incremental fetch complete for 2025-01 (0.34 seconds).
[2025-10-24T20:52:39.731382] [DEBUG] [LOCAL     ] RMD: Loaded 42165 existing records from primary storage.
[2025-10-24T20:52:39.731752] [INFO ] [MAIN      ] RMD: Loaded 42165 existing records.
[2025-10-24T20:52:39.909743] [WARN ] [MAIN      ] RMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:52:39.909979] [INFO ] [MAIN      ] RMD: Wiping existing primary data before full refresh.
[2025-10-24T20:52:39.910026] [INFO ] [LOCAL     ] RMD: Starting deletion of primary data.
[2025-10-24T20:52:39.910281] [DEBUG] [LOCAL     ] RMD: Deleted primary data file.
[2025-10-24T20:52:39.910337] [INFO ] [MAIN      ] RMD: Starting full primary refresh.
[2025-10-24T20:52:40.152826] [INFO ] [REMOTE    ] RLX: Fetching primary data for 2025-09.
[2025-10-24T20:52:40.282085] [INFO ] [REMOTE    ] RMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:52:40.947632] [INFO ] [REMOTE    ] RMD: Fetching primary data for 2025-01.
[2025-10-24T20:52:41.212327] [INFO ] [REMOTE    ] RLX: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T20:52:41.676446] [INFO ] [REMOTE    ] RMD: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T20:52:41.747730] [INFO ] [REMOTE    ] RMD: Fetching primary data for 2025-02.
[2025-10-24T20:52:42.547734] [INFO ] [REMOTE    ] RMAX: Fetching primary data for 2025-02.
[2025-10-24T20:52:42.790520] [INFO ] [REMOTE    ] RMD: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T20:52:43.098795] [INFO ] [REMOTE    ] RMAX: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T20:52:43.347702] [INFO ] [REMOTE    ] RMAX: Fetching primary data for 2025-03.
[2025-10-24T20:52:44.153022] [INFO ] [REMOTE    ] RMD: Fetching primary data for 2025-03.
[2025-10-24T20:52:44.155371] [INFO ] [REMOTE    ] RMAX: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T20:52:44.947722] [INFO ] [REMOTE    ] RMAX: Fetching primary data for 2025-04.
[2025-10-24T20:52:45.240626] [INFO ] [REMOTE    ] RMD: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T20:52:45.512120] [INFO ] [REMOTE    ] RMAX: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T20:52:45.747758] [INFO ] [REMOTE    ] RMD: Fetching primary data for 2025-04.
[2025-10-24T20:52:46.223636] [INFO ] [REMOTE    ] RMD: Incremental fetch complete for 2025-04 (0.48 seconds).
[2025-10-24T20:52:46.547754] [INFO ] [REMOTE    ] RMD: Fetching primary data for 2025-05.
[2025-10-24T20:52:47.347736] [INFO ] [REMOTE    ] RM: Fetching primary data for 2025-10.
[2025-10-24T20:52:47.652366] [INFO ] [REMOTE    ] RMD: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T20:52:47.722154] [INFO ] [REMOTE    ] RM: Incremental fetch complete for 2025-10 (0.37 seconds).
[2025-10-24T20:52:47.724063] [INFO ] [REMOTE    ] RM: Full fetch complete (11403 records).
[2025-10-24T20:52:47.724140] [DEBUG] [VALIDATOR ] RM: Validating primary data.
[2025-10-24T20:52:47.724585] [FATAL] [VALIDATOR ] RM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:52:47.724719] [FATAL] [MAIN      ] RM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:52:47.724794] [WARN ] [MAIN      ] RM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:52:47.724894] [INFO ] [LOCAL     ] RM: Starting deletion of primary data.
[2025-10-24T20:52:47.725200] [DEBUG] [LOCAL     ] RM: No primary data file found to delete.
[2025-10-24T20:52:47.725421] [INFO ] [LOCAL     ] RM: Starting deletion of derivative data.
[2025-10-24T20:52:47.725689] [DEBUG] [LOCAL     ] RM: Deleted derivative data file.
[2025-10-24T20:52:47.725842] [INFO ] [MAIN      ] Update Progress: 1810/2366 symbols completed. RM took 26.9s. Estimated remaining: 1h 11m 30s. Rate: 7.8 symbols/min
[2025-10-24T20:52:47.896225] [INFO ] [MAIN      ] RMI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:52:47.904126] [DEBUG] [LOCAL     ] RMI: Loaded 4826 existing records from primary storage.
[2025-10-24T20:52:47.904350] [INFO ] [MAIN      ] RMI: Loaded 4826 existing records.
[2025-10-24T20:52:48.089541] [WARN ] [MAIN      ] RMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:52:48.089821] [INFO ] [MAIN      ] RMI: Wiping existing primary data before full refresh.
[2025-10-24T20:52:48.089895] [INFO ] [LOCAL     ] RMI: Starting deletion of primary data.
[2025-10-24T20:52:48.090128] [DEBUG] [LOCAL     ] RMI: Deleted primary data file.
[2025-10-24T20:52:48.090188] [INFO ] [MAIN      ] RMI: Starting full primary refresh.
[2025-10-24T20:52:48.155481] [INFO ] [REMOTE    ] RMD: Fetching primary data for 2025-06.
[2025-10-24T20:52:48.473062] [INFO ] [REMOTE    ] RMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:52:48.947635] [INFO ] [REMOTE    ] RMI: Fetching primary data for 2025-01.
[2025-10-24T20:52:49.205104] [INFO ] [REMOTE    ] RMD: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T20:52:49.225776] [INFO ] [REMOTE    ] RMI: Incremental fetch complete for 2025-01 (0.28 seconds).
[2025-10-24T20:52:49.747636] [INFO ] [REMOTE    ] RMI: Fetching primary data for 2025-02.
[2025-10-24T20:52:50.028578] [INFO ] [REMOTE    ] RMI: Incremental fetch complete for 2025-02 (0.28 seconds).
[2025-10-24T20:52:50.547686] [INFO ] [REMOTE    ] RMD: Fetching primary data for 2025-07.
[2025-10-24T20:52:51.347694] [INFO ] [REMOTE    ] RMI: Fetching primary data for 2025-03.
[2025-10-24T20:52:51.624310] [INFO ] [REMOTE    ] RMD: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T20:52:52.007844] [INFO ] [REMOTE    ] RMI: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T20:52:52.147631] [INFO ] [REMOTE    ] RMD: Fetching primary data for 2025-08.
[2025-10-24T20:52:52.947630] [INFO ] [REMOTE    ] RMAX: Fetching primary data for 2025-05.
[2025-10-24T20:52:53.300193] [INFO ] [REMOTE    ] RMD: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T20:52:53.509047] [INFO ] [REMOTE    ] RMAX: Incremental fetch complete for 2025-05 (0.56 seconds).
[2025-10-24T20:52:53.747640] [INFO ] [REMOTE    ] RMAX: Fetching primary data for 2025-06.
[2025-10-24T20:52:54.547690] [INFO ] [REMOTE    ] RLX: Fetching primary data for 2025-10.
[2025-10-24T20:52:54.570727] [INFO ] [REMOTE    ] RMAX: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T20:52:55.110455] [INFO ] [REMOTE    ] RLX: Incremental fetch complete for 2025-10 (0.56 seconds).
[2025-10-24T20:52:55.119049] [INFO ] [REMOTE    ] RLX: Full fetch complete (69703 records).
[2025-10-24T20:52:55.119169] [DEBUG] [VALIDATOR ] RLX: Validating primary data.
[2025-10-24T20:52:55.119985] [FATAL] [VALIDATOR ] RLX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:52:55.120070] [FATAL] [MAIN      ] RLX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:52:55.120138] [WARN ] [MAIN      ] RLX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:52:55.120210] [INFO ] [LOCAL     ] RLX: Starting deletion of primary data.
[2025-10-24T20:52:55.120275] [DEBUG] [LOCAL     ] RLX: No primary data file found to delete.
[2025-10-24T20:52:55.120313] [INFO ] [LOCAL     ] RLX: Starting deletion of derivative data.
[2025-10-24T20:52:55.120515] [DEBUG] [LOCAL     ] RLX: Deleted derivative data file.
[2025-10-24T20:52:55.120617] [INFO ] [MAIN      ] Update Progress: 1811/2366 symbols completed. RLX took 46.1s. Estimated remaining: 1h 11m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:52:55.292491] [INFO ] [MAIN      ] RMM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:52:55.304153] [DEBUG] [LOCAL     ] RMM: Loaded 11008 existing records from primary storage.
[2025-10-24T20:52:55.304367] [INFO ] [MAIN      ] RMM: Loaded 11008 existing records.
[2025-10-24T20:52:55.356776] [INFO ] [REMOTE    ] RMD: Fetching primary data for 2025-09.
[2025-10-24T20:52:55.483157] [WARN ] [MAIN      ] RMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:52:55.483350] [INFO ] [MAIN      ] RMM: Wiping existing primary data before full refresh.
[2025-10-24T20:52:55.483395] [INFO ] [LOCAL     ] RMM: Starting deletion of primary data.
[2025-10-24T20:52:55.483558] [DEBUG] [LOCAL     ] RMM: Deleted primary data file.
[2025-10-24T20:52:55.483596] [INFO ] [MAIN      ] RMM: Starting full primary refresh.
[2025-10-24T20:52:55.828892] [INFO ] [REMOTE    ] RMM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:52:56.147695] [INFO ] [REMOTE    ] RMM: Fetching primary data for 2025-01.
[2025-10-24T20:52:56.590795] [INFO ] [REMOTE    ] RMD: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T20:52:56.836754] [INFO ] [REMOTE    ] RMM: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T20:52:56.947640] [INFO ] [REMOTE    ] RMI: Fetching primary data for 2025-04.
[2025-10-24T20:52:57.319706] [INFO ] [REMOTE    ] RMI: Incremental fetch complete for 2025-04 (0.37 seconds).
[2025-10-24T20:52:57.747721] [INFO ] [REMOTE    ] RMI: Fetching primary data for 2025-05.
[2025-10-24T20:52:58.547619] [INFO ] [REMOTE    ] RMD: Fetching primary data for 2025-10.
[2025-10-24T20:52:58.561812] [INFO ] [REMOTE    ] RMI: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:52:59.278941] [INFO ] [REMOTE    ] RMD: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T20:52:59.286285] [INFO ] [REMOTE    ] RMD: Full fetch complete (61372 records).
[2025-10-24T20:52:59.286394] [DEBUG] [VALIDATOR ] RMD: Validating primary data.
[2025-10-24T20:52:59.287108] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:52:59.287200] [FATAL] [MAIN      ] RMD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:52:59.287246] [WARN ] [MAIN      ] RMD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:52:59.287321] [INFO ] [LOCAL     ] RMD: Starting deletion of primary data.
[2025-10-24T20:52:59.287457] [DEBUG] [LOCAL     ] RMD: No primary data file found to delete.
[2025-10-24T20:52:59.287512] [INFO ] [LOCAL     ] RMD: Starting deletion of derivative data.
[2025-10-24T20:52:59.287730] [DEBUG] [LOCAL     ] RMD: Deleted derivative data file.
[2025-10-24T20:52:59.288197] [INFO ] [MAIN      ] Update Progress: 1812/2366 symbols completed. RMD took 19.8s. Estimated remaining: 1h 11m 13s. Rate: 7.8 symbols/min
[2025-10-24T20:52:59.353033] [INFO ] [REMOTE    ] RMAX: Fetching primary data for 2025-07.
[2025-10-24T20:52:59.465935] [INFO ] [MAIN      ] RMMZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:52:59.473372] [DEBUG] [LOCAL     ] RMMZ: Loaded 4821 existing records from primary storage.
[2025-10-24T20:52:59.473600] [INFO ] [MAIN      ] RMMZ: Loaded 4821 existing records.
[2025-10-24T20:52:59.648984] [WARN ] [MAIN      ] RMMZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:52:59.649191] [INFO ] [MAIN      ] RMMZ: Wiping existing primary data before full refresh.
[2025-10-24T20:52:59.649254] [INFO ] [LOCAL     ] RMMZ: Starting deletion of primary data.
[2025-10-24T20:52:59.649532] [DEBUG] [LOCAL     ] RMMZ: Deleted primary data file.
[2025-10-24T20:52:59.649589] [INFO ] [MAIN      ] RMMZ: Starting full primary refresh.
[2025-10-24T20:53:00.005085] [INFO ] [REMOTE    ] RMMZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:53:00.147620] [INFO ] [REMOTE    ] RMMZ: Fetching primary data for 2025-01.
[2025-10-24T20:53:00.310215] [INFO ] [REMOTE    ] RMAX: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T20:53:00.813452] [INFO ] [REMOTE    ] RMMZ: Incremental fetch complete for 2025-01 (0.67 seconds).
[2025-10-24T20:53:00.947714] [INFO ] [REMOTE    ] RMI: Fetching primary data for 2025-06.
[2025-10-24T20:53:01.293837] [INFO ] [REMOTE    ] RMI: Incremental fetch complete for 2025-06 (0.35 seconds).
[2025-10-24T20:53:01.747683] [INFO ] [REMOTE    ] RMAX: Fetching primary data for 2025-08.
[2025-10-24T20:53:02.407101] [INFO ] [REMOTE    ] RMAX: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T20:53:02.547603] [INFO ] [REMOTE    ] RMAX: Fetching primary data for 2025-09.
[2025-10-24T20:53:03.350764] [INFO ] [REMOTE    ] RMM: Fetching primary data for 2025-02.
[2025-10-24T20:53:03.354298] [INFO ] [REMOTE    ] RMAX: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T20:53:03.819162] [INFO ] [REMOTE    ] RMM: Incremental fetch complete for 2025-02 (0.47 seconds).
[2025-10-24T20:53:04.147668] [INFO ] [REMOTE    ] RMM: Fetching primary data for 2025-03.
[2025-10-24T20:53:04.947628] [INFO ] [REMOTE    ] RMI: Fetching primary data for 2025-07.
[2025-10-24T20:53:05.246416] [INFO ] [REMOTE    ] RMM: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T20:53:05.747677] [INFO ] [REMOTE    ] RMM: Fetching primary data for 2025-04.
[2025-10-24T20:53:05.880002] [INFO ] [REMOTE    ] RMI: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T20:53:06.260490] [INFO ] [REMOTE    ] RMM: Incremental fetch complete for 2025-04 (0.51 seconds).
[2025-10-24T20:53:06.547709] [INFO ] [REMOTE    ] RMM: Fetching primary data for 2025-05.
[2025-10-24T20:53:07.347625] [INFO ] [REMOTE    ] RMAX: Fetching primary data for 2025-10.
[2025-10-24T20:53:07.426107] [INFO ] [REMOTE    ] RMM: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T20:53:08.147636] [INFO ] [REMOTE    ] RMM: Fetching primary data for 2025-06.
[2025-10-24T20:53:08.251841] [INFO ] [REMOTE    ] RMAX: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T20:53:08.255396] [INFO ] [REMOTE    ] RMAX: Full fetch complete (29776 records).
[2025-10-24T20:53:08.255474] [DEBUG] [VALIDATOR ] RMAX: Validating primary data.
[2025-10-24T20:53:08.256006] [FATAL] [VALIDATOR ] RMAX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:53:08.256123] [FATAL] [MAIN      ] RMAX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:53:08.256186] [WARN ] [MAIN      ] RMAX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:53:08.256274] [INFO ] [LOCAL     ] RMAX: Starting deletion of primary data.
[2025-10-24T20:53:08.256380] [DEBUG] [LOCAL     ] RMAX: No primary data file found to delete.
[2025-10-24T20:53:08.256449] [INFO ] [LOCAL     ] RMAX: Starting deletion of derivative data.
[2025-10-24T20:53:08.256713] [DEBUG] [LOCAL     ] RMAX: Deleted derivative data file.
[2025-10-24T20:53:08.256824] [INFO ] [MAIN      ] Update Progress: 1813/2366 symbols completed. RMAX took 32.7s. Estimated remaining: 1h 11m 6s. Rate: 7.8 symbols/min
[2025-10-24T20:53:08.424514] [INFO ] [MAIN      ] RMT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:53:08.442284] [DEBUG] [LOCAL     ] RMT: Loaded 17211 existing records from primary storage.
[2025-10-24T20:53:08.442532] [INFO ] [MAIN      ] RMT: Loaded 17211 existing records.
[2025-10-24T20:53:08.618057] [WARN ] [MAIN      ] RMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:53:08.618257] [INFO ] [MAIN      ] RMT: Wiping existing primary data before full refresh.
[2025-10-24T20:53:08.618322] [INFO ] [LOCAL     ] RMT: Starting deletion of primary data.
[2025-10-24T20:53:08.618931] [DEBUG] [LOCAL     ] RMT: Deleted primary data file.
[2025-10-24T20:53:08.618990] [INFO ] [MAIN      ] RMT: Starting full primary refresh.
[2025-10-24T20:53:08.742016] [INFO ] [REMOTE    ] RMM: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T20:53:08.956890] [INFO ] [REMOTE    ] RMI: Fetching primary data for 2025-08.
[2025-10-24T20:53:09.001318] [INFO ] [REMOTE    ] RMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:53:09.725299] [INFO ] [REMOTE    ] RMI: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T20:53:09.747602] [INFO ] [REMOTE    ] RMI: Fetching primary data for 2025-09.
[2025-10-24T20:53:10.206355] [INFO ] [REMOTE    ] RMI: Incremental fetch complete for 2025-09 (0.46 seconds).
[2025-10-24T20:53:10.547638] [INFO ] [REMOTE    ] RMI: Fetching primary data for 2025-10.
[2025-10-24T20:53:11.177896] [INFO ] [REMOTE    ] RMI: Incremental fetch complete for 2025-10 (0.63 seconds).
[2025-10-24T20:53:11.179246] [INFO ] [REMOTE    ] RMI: Full fetch complete (6097 records).
[2025-10-24T20:53:11.179313] [DEBUG] [VALIDATOR ] RMI: Validating primary data.
[2025-10-24T20:53:11.179679] [FATAL] [VALIDATOR ] RMI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:53:11.179748] [FATAL] [MAIN      ] RMI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:53:11.179784] [WARN ] [MAIN      ] RMI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:53:11.179849] [INFO ] [LOCAL     ] RMI: Starting deletion of primary data.
[2025-10-24T20:53:11.179908] [DEBUG] [LOCAL     ] RMI: No primary data file found to delete.
[2025-10-24T20:53:11.179943] [INFO ] [LOCAL     ] RMI: Starting deletion of derivative data.
[2025-10-24T20:53:11.180107] [DEBUG] [LOCAL     ] RMI: Deleted derivative data file.
[2025-10-24T20:53:11.180190] [INFO ] [MAIN      ] Update Progress: 1814/2366 symbols completed. RMI took 23.5s. Estimated remaining: 1h 10m 57s. Rate: 7.8 symbols/min
[2025-10-24T20:53:11.346149] [INFO ] [MAIN      ] RNG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:53:11.347626] [INFO ] [REMOTE    ] RMMZ: Fetching primary data for 2025-02.
[2025-10-24T20:53:11.389968] [DEBUG] [LOCAL     ] RNG: Loaded 48318 existing records from primary storage.
[2025-10-24T20:53:11.390256] [INFO ] [MAIN      ] RNG: Loaded 48318 existing records.
[2025-10-24T20:53:11.565820] [WARN ] [MAIN      ] RNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:53:11.566050] [INFO ] [MAIN      ] RNG: Wiping existing primary data before full refresh.
[2025-10-24T20:53:11.566099] [INFO ] [LOCAL     ] RNG: Starting deletion of primary data.
[2025-10-24T20:53:11.566495] [DEBUG] [LOCAL     ] RNG: Deleted primary data file.
[2025-10-24T20:53:11.566552] [INFO ] [MAIN      ] RNG: Starting full primary refresh.
[2025-10-24T20:53:11.950097] [INFO ] [REMOTE    ] RNG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:53:11.951688] [INFO ] [REMOTE    ] RMMZ: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T20:53:12.147719] [INFO ] [REMOTE    ] RMMZ: Fetching primary data for 2025-03.
[2025-10-24T20:53:12.905576] [INFO ] [REMOTE    ] RMMZ: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T20:53:12.947610] [INFO ] [REMOTE    ] RMMZ: Fetching primary data for 2025-04.
[2025-10-24T20:53:13.747617] [INFO ] [REMOTE    ] RNG: Fetching primary data for 2025-01.
[2025-10-24T20:53:13.922678] [INFO ] [REMOTE    ] RMMZ: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T20:53:14.482285] [INFO ] [REMOTE    ] RNG: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T20:53:14.547611] [INFO ] [REMOTE    ] RNG: Fetching primary data for 2025-02.
[2025-10-24T20:53:15.274387] [INFO ] [REMOTE    ] RNG: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T20:53:15.347605] [INFO ] [REMOTE    ] RMT: Fetching primary data for 2025-01.
[2025-10-24T20:53:16.147617] [INFO ] [REMOTE    ] RNG: Fetching primary data for 2025-03.
[2025-10-24T20:53:16.193149] [INFO ] [REMOTE    ] RMT: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T20:53:16.926145] [INFO ] [REMOTE    ] RNG: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T20:53:16.947602] [INFO ] [REMOTE    ] RNG: Fetching primary data for 2025-04.
[2025-10-24T20:53:17.747675] [INFO ] [REMOTE    ] RMT: Fetching primary data for 2025-02.
[2025-10-24T20:53:18.213052] [INFO ] [REMOTE    ] RMT: Incremental fetch complete for 2025-02 (0.47 seconds).
[2025-10-24T20:53:18.253450] [INFO ] [REMOTE    ] RNG: Incremental fetch complete for 2025-04 (1.31 seconds).
[2025-10-24T20:53:18.547678] [INFO ] [REMOTE    ] RMM: Fetching primary data for 2025-07.
[2025-10-24T20:53:19.333791] [INFO ] [REMOTE    ] RMM: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T20:53:19.347620] [INFO ] [REMOTE    ] RMM: Fetching primary data for 2025-08.
[2025-10-24T20:53:19.997833] [INFO ] [REMOTE    ] RMM: Incremental fetch complete for 2025-08 (0.65 seconds).
[2025-10-24T20:53:20.147686] [INFO ] [REMOTE    ] RMMZ: Fetching primary data for 2025-05.
[2025-10-24T20:53:20.713893] [INFO ] [REMOTE    ] RMMZ: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T20:53:20.947689] [INFO ] [REMOTE    ] RMMZ: Fetching primary data for 2025-06.
[2025-10-24T20:53:21.670528] [INFO ] [REMOTE    ] RMMZ: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T20:53:21.747699] [INFO ] [REMOTE    ] RMM: Fetching primary data for 2025-09.
[2025-10-24T20:53:22.313223] [INFO ] [REMOTE    ] RMM: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T20:53:22.547618] [INFO ] [REMOTE    ] RNG: Fetching primary data for 2025-05.
[2025-10-24T20:53:23.347617] [INFO ] [REMOTE    ] RMMZ: Fetching primary data for 2025-07.
[2025-10-24T20:53:23.728564] [INFO ] [REMOTE    ] RMMZ: Incremental fetch complete for 2025-07 (0.38 seconds).
[2025-10-24T20:53:23.763313] [INFO ] [REMOTE    ] RNG: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T20:53:24.147677] [INFO ] [REMOTE    ] RMMZ: Fetching primary data for 2025-08.
[2025-10-24T20:53:24.809340] [INFO ] [REMOTE    ] RMMZ: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T20:53:24.947705] [INFO ] [REMOTE    ] RMM: Fetching primary data for 2025-10.
[2025-10-24T20:53:25.650980] [INFO ] [REMOTE    ] RMM: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T20:53:25.653854] [INFO ] [REMOTE    ] RMM: Full fetch complete (14810 records).
[2025-10-24T20:53:25.654009] [DEBUG] [VALIDATOR ] RMM: Validating primary data.
[2025-10-24T20:53:25.654522] [FATAL] [VALIDATOR ] RMM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:53:25.654615] [FATAL] [MAIN      ] RMM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:53:25.654700] [WARN ] [MAIN      ] RMM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:53:25.654775] [INFO ] [LOCAL     ] RMM: Starting deletion of primary data.
[2025-10-24T20:53:25.654895] [DEBUG] [LOCAL     ] RMM: No primary data file found to delete.
[2025-10-24T20:53:25.654959] [INFO ] [LOCAL     ] RMM: Starting deletion of derivative data.
[2025-10-24T20:53:25.655482] [DEBUG] [LOCAL     ] RMM: Deleted derivative data file.
[2025-10-24T20:53:25.655584] [INFO ] [MAIN      ] Update Progress: 1815/2366 symbols completed. RMM took 30.5s. Estimated remaining: 1h 10m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:53:25.752974] [INFO ] [REMOTE    ] RNG: Fetching primary data for 2025-06.
[2025-10-24T20:53:25.908450] [INFO ] [MAIN      ] RNGR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:53:25.935475] [DEBUG] [LOCAL     ] RNGR: Loaded 20837 existing records from primary storage.
[2025-10-24T20:53:25.935864] [INFO ] [MAIN      ] RNGR: Loaded 20837 existing records.
[2025-10-24T20:53:26.186036] [WARN ] [MAIN      ] RNGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:53:26.186355] [INFO ] [MAIN      ] RNGR: Wiping existing primary data before full refresh.
[2025-10-24T20:53:26.186418] [INFO ] [LOCAL     ] RNGR: Starting deletion of primary data.
[2025-10-24T20:53:26.186743] [DEBUG] [LOCAL     ] RNGR: Deleted primary data file.
[2025-10-24T20:53:26.186799] [INFO ] [MAIN      ] RNGR: Starting full primary refresh.
[2025-10-24T20:53:26.549823] [INFO ] [REMOTE    ] RNGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:53:26.550098] [INFO ] [REMOTE    ] RMT: Fetching primary data for 2025-03.
[2025-10-24T20:53:26.577911] [INFO ] [REMOTE    ] RNG: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T20:53:27.284353] [INFO ] [REMOTE    ] RMT: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T20:53:27.347685] [INFO ] [REMOTE    ] RMT: Fetching primary data for 2025-04.
[2025-10-24T20:53:28.147615] [INFO ] [REMOTE    ] RNG: Fetching primary data for 2025-07.
[2025-10-24T20:53:28.365876] [INFO ] [REMOTE    ] RMT: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T20:53:28.947615] [INFO ] [REMOTE    ] RNGR: Fetching primary data for 2025-01.
[2025-10-24T20:53:29.354376] [INFO ] [REMOTE    ] RNG: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T20:53:29.395403] [INFO ] [REMOTE    ] RNGR: Incremental fetch complete for 2025-01 (0.45 seconds).
[2025-10-24T20:53:29.747640] [INFO ] [REMOTE    ] RNGR: Fetching primary data for 2025-02.
[2025-10-24T20:53:30.528203] [INFO ] [REMOTE    ] RNGR: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T20:53:30.547606] [INFO ] [REMOTE    ] RMT: Fetching primary data for 2025-05.
[2025-10-24T20:53:31.347627] [INFO ] [REMOTE    ] RMMZ: Fetching primary data for 2025-09.
[2025-10-24T20:53:31.452698] [INFO ] [REMOTE    ] RMT: Incremental fetch complete for 2025-05 (0.91 seconds).
[2025-10-24T20:53:32.147678] [INFO ] [REMOTE    ] RMT: Fetching primary data for 2025-06.
[2025-10-24T20:53:32.222579] [INFO ] [REMOTE    ] RMMZ: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T20:53:32.947633] [INFO ] [REMOTE    ] RNG: Fetching primary data for 2025-08.
[2025-10-24T20:53:32.990387] [INFO ] [REMOTE    ] RMT: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T20:53:33.747627] [INFO ] [REMOTE    ] RMMZ: Fetching primary data for 2025-10.
[2025-10-24T20:53:34.145080] [INFO ] [REMOTE    ] RNG: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T20:53:34.372557] [INFO ] [REMOTE    ] RMMZ: Incremental fetch complete for 2025-10 (0.62 seconds).
[2025-10-24T20:53:34.373822] [INFO ] [REMOTE    ] RMMZ: Full fetch complete (6553 records).
[2025-10-24T20:53:34.373913] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data.
[2025-10-24T20:53:34.374300] [FATAL] [VALIDATOR ] RMMZ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:53:34.374379] [FATAL] [MAIN      ] RMMZ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:53:34.374449] [WARN ] [MAIN      ] RMMZ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:53:34.374516] [INFO ] [LOCAL     ] RMMZ: Starting deletion of primary data.
[2025-10-24T20:53:34.374576] [DEBUG] [LOCAL     ] RMMZ: No primary data file found to delete.
[2025-10-24T20:53:34.374611] [INFO ] [LOCAL     ] RMMZ: Starting deletion of derivative data.
[2025-10-24T20:53:34.374784] [DEBUG] [LOCAL     ] RMMZ: Deleted derivative data file.
[2025-10-24T20:53:34.374868] [INFO ] [MAIN      ] Update Progress: 1816/2366 symbols completed. RMMZ took 35.1s. Estimated remaining: 1h 10m 44s. Rate: 7.8 symbols/min
[2025-10-24T20:53:34.542209] [INFO ] [MAIN      ] RNP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:53:34.547703] [INFO ] [REMOTE    ] RMT: Fetching primary data for 2025-07.
[2025-10-24T20:53:34.565489] [DEBUG] [LOCAL     ] RNP: Loaded 16013 existing records from primary storage.
[2025-10-24T20:53:34.565909] [INFO ] [MAIN      ] RNP: Loaded 16013 existing records.
[2025-10-24T20:53:34.740892] [WARN ] [MAIN      ] RNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:53:34.741099] [INFO ] [MAIN      ] RNP: Wiping existing primary data before full refresh.
[2025-10-24T20:53:34.741146] [INFO ] [LOCAL     ] RNP: Starting deletion of primary data.
[2025-10-24T20:53:34.741348] [DEBUG] [LOCAL     ] RNP: Deleted primary data file.
[2025-10-24T20:53:34.741384] [INFO ] [MAIN      ] RNP: Starting full primary refresh.
[2025-10-24T20:53:35.088494] [INFO ] [REMOTE    ] RNP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:53:35.347626] [INFO ] [REMOTE    ] RNG: Fetching primary data for 2025-09.
[2025-10-24T20:53:35.479183] [INFO ] [REMOTE    ] RMT: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T20:53:36.147665] [INFO ] [REMOTE    ] RMT: Fetching primary data for 2025-08.
[2025-10-24T20:53:36.781848] [INFO ] [REMOTE    ] RNG: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T20:53:36.947693] [INFO ] [REMOTE    ] RNGR: Fetching primary data for 2025-03.
[2025-10-24T20:53:36.996753] [INFO ] [REMOTE    ] RMT: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T20:53:37.745842] [INFO ] [REMOTE    ] RNGR: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T20:53:37.749968] [INFO ] [REMOTE    ] RMT: Fetching primary data for 2025-09.
[2025-10-24T20:53:38.492770] [INFO ] [REMOTE    ] RMT: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T20:53:38.547600] [INFO ] [REMOTE    ] RMT: Fetching primary data for 2025-10.
[2025-10-24T20:53:39.347711] [INFO ] [REMOTE    ] RNG: Fetching primary data for 2025-10.
[2025-10-24T20:53:39.847804] [INFO ] [REMOTE    ] RMT: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T20:53:39.851381] [INFO ] [REMOTE    ] RMT: Full fetch complete (25298 records).
[2025-10-24T20:53:39.851457] [DEBUG] [VALIDATOR ] RMT: Validating primary data.
[2025-10-24T20:53:39.851921] [FATAL] [VALIDATOR ] RMT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:53:39.852020] [FATAL] [MAIN      ] RMT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:53:39.852063] [WARN ] [MAIN      ] RMT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:53:39.852100] [INFO ] [LOCAL     ] RMT: Starting deletion of primary data.
[2025-10-24T20:53:39.852152] [DEBUG] [LOCAL     ] RMT: No primary data file found to delete.
[2025-10-24T20:53:39.852186] [INFO ] [LOCAL     ] RMT: Starting deletion of derivative data.
[2025-10-24T20:53:39.852350] [DEBUG] [LOCAL     ] RMT: Deleted derivative data file.
[2025-10-24T20:53:39.852433] [INFO ] [MAIN      ] Update Progress: 1817/2366 symbols completed. RMT took 31.6s. Estimated remaining: 1h 10m 35s. Rate: 7.8 symbols/min
[2025-10-24T20:53:40.025369] [INFO ] [MAIN      ] RNR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:53:40.072809] [DEBUG] [LOCAL     ] RNR: Loaded 33749 existing records from primary storage.
[2025-10-24T20:53:40.073182] [INFO ] [MAIN      ] RNR: Loaded 33749 existing records.
[2025-10-24T20:53:40.156756] [INFO ] [REMOTE    ] RNP: Fetching primary data for 2025-01.
[2025-10-24T20:53:40.257864] [WARN ] [MAIN      ] RNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:53:40.258057] [INFO ] [MAIN      ] RNR: Wiping existing primary data before full refresh.
[2025-10-24T20:53:40.258115] [INFO ] [LOCAL     ] RNR: Starting deletion of primary data.
[2025-10-24T20:53:40.258528] [DEBUG] [LOCAL     ] RNR: Deleted primary data file.
[2025-10-24T20:53:40.258568] [INFO ] [MAIN      ] RNR: Starting full primary refresh.
[2025-10-24T20:53:40.631960] [INFO ] [REMOTE    ] RNR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:53:40.647612] [INFO ] [REMOTE    ] RNG: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T20:53:40.656424] [INFO ] [REMOTE    ] RNG: Full fetch complete (69585 records).
[2025-10-24T20:53:40.656553] [DEBUG] [VALIDATOR ] RNG: Validating primary data.
[2025-10-24T20:53:40.658632] [FATAL] [VALIDATOR ] RNG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:53:40.658739] [FATAL] [MAIN      ] RNG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:53:40.658802] [WARN ] [MAIN      ] RNG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:53:40.658874] [INFO ] [LOCAL     ] RNG: Starting deletion of primary data.
[2025-10-24T20:53:40.658939] [DEBUG] [LOCAL     ] RNG: No primary data file found to delete.
[2025-10-24T20:53:40.658975] [INFO ] [LOCAL     ] RNG: Starting deletion of derivative data.
[2025-10-24T20:53:40.659118] [DEBUG] [LOCAL     ] RNG: Deleted derivative data file.
[2025-10-24T20:53:40.659620] [INFO ] [MAIN      ] Update Progress: 1818/2366 symbols completed. RNG took 29.5s. Estimated remaining: 1h 10m 25s. Rate: 7.8 symbols/min
[2025-10-24T20:53:40.846712] [INFO ] [MAIN      ] RNST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:53:40.859190] [INFO ] [REMOTE    ] RNP: Incremental fetch complete for 2025-01 (0.70 seconds).
[2025-10-24T20:53:40.898137] [DEBUG] [LOCAL     ] RNST: Loaded 36124 existing records from primary storage.
[2025-10-24T20:53:40.898430] [INFO ] [MAIN      ] RNST: Loaded 36124 existing records.
[2025-10-24T20:53:40.952920] [INFO ] [REMOTE    ] RNGR: Fetching primary data for 2025-04.
[2025-10-24T20:53:41.102199] [WARN ] [MAIN      ] RNST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:53:41.102410] [INFO ] [MAIN      ] RNST: Wiping existing primary data before full refresh.
[2025-10-24T20:53:41.102469] [INFO ] [LOCAL     ] RNST: Starting deletion of primary data.
[2025-10-24T20:53:41.103284] [DEBUG] [LOCAL     ] RNST: Deleted primary data file.
[2025-10-24T20:53:41.103341] [INFO ] [MAIN      ] RNST: Starting full primary refresh.
[2025-10-24T20:53:41.457704] [INFO ] [REMOTE    ] RNST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:53:41.575476] [INFO ] [REMOTE    ] RNGR: Incremental fetch complete for 2025-04 (0.62 seconds).
[2025-10-24T20:53:41.747616] [INFO ] [REMOTE    ] RNST: Fetching primary data for 2025-01.
[2025-10-24T20:53:42.547013] [INFO ] [REMOTE    ] RNST: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T20:53:42.553936] [INFO ] [REMOTE    ] RNR: Fetching primary data for 2025-01.
[2025-10-24T20:53:43.347709] [INFO ] [REMOTE    ] RNP: Fetching primary data for 2025-02.
[2025-10-24T20:53:43.504796] [INFO ] [REMOTE    ] RNR: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T20:53:43.899787] [INFO ] [REMOTE    ] RNP: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T20:53:44.147625] [INFO ] [REMOTE    ] RNR: Fetching primary data for 2025-02.
[2025-10-24T20:53:44.947627] [INFO ] [REMOTE    ] RNGR: Fetching primary data for 2025-05.
[2025-10-24T20:53:45.207302] [INFO ] [REMOTE    ] RNR: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T20:53:45.747619] [INFO ] [REMOTE    ] RNST: Fetching primary data for 2025-02.
[2025-10-24T20:53:45.815131] [INFO ] [REMOTE    ] RNGR: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T20:53:46.547618] [INFO ] [REMOTE    ] RNGR: Fetching primary data for 2025-06.
[2025-10-24T20:53:46.883156] [INFO ] [REMOTE    ] RNST: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T20:53:47.143209] [INFO ] [REMOTE    ] RNGR: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T20:53:47.347631] [INFO ] [REMOTE    ] RNST: Fetching primary data for 2025-03.
[2025-10-24T20:53:48.147620] [INFO ] [REMOTE    ] RNR: Fetching primary data for 2025-03.
[2025-10-24T20:53:48.372322] [INFO ] [REMOTE    ] RNST: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T20:53:48.947702] [INFO ] [REMOTE    ] RNST: Fetching primary data for 2025-04.
[2025-10-24T20:53:49.133849] [INFO ] [REMOTE    ] RNR: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T20:53:49.747693] [INFO ] [REMOTE    ] RNGR: Fetching primary data for 2025-07.
[2025-10-24T20:53:50.087134] [INFO ] [REMOTE    ] RNST: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T20:53:50.547694] [INFO ] [REMOTE    ] RNP: Fetching primary data for 2025-03.
[2025-10-24T20:53:50.823339] [INFO ] [REMOTE    ] RNGR: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T20:53:51.286130] [INFO ] [REMOTE    ] RNP: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T20:53:51.347605] [INFO ] [REMOTE    ] RNP: Fetching primary data for 2025-04.
[2025-10-24T20:53:52.147675] [INFO ] [REMOTE    ] RNGR: Fetching primary data for 2025-08.
[2025-10-24T20:53:52.176570] [INFO ] [REMOTE    ] RNP: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T20:53:52.947749] [INFO ] [REMOTE    ] RNP: Fetching primary data for 2025-05.
[2025-10-24T20:53:52.979046] [INFO ] [REMOTE    ] RNGR: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T20:53:53.494490] [INFO ] [REMOTE    ] RNP: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T20:53:53.747690] [INFO ] [REMOTE    ] RNR: Fetching primary data for 2025-04.
[2025-10-24T20:53:54.496112] [INFO ] [REMOTE    ] RNR: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T20:53:54.547617] [INFO ] [REMOTE    ] RNR: Fetching primary data for 2025-05.
[2025-10-24T20:53:55.347717] [INFO ] [REMOTE    ] RNP: Fetching primary data for 2025-06.
[2025-10-24T20:53:55.558790] [INFO ] [REMOTE    ] RNR: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T20:53:56.147678] [INFO ] [REMOTE    ] RNST: Fetching primary data for 2025-05.
[2025-10-24T20:53:56.347671] [INFO ] [REMOTE    ] RNP: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T20:53:56.947622] [INFO ] [REMOTE    ] RNGR: Fetching primary data for 2025-09.
[2025-10-24T20:53:57.098454] [INFO ] [REMOTE    ] RNST: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T20:53:57.747619] [INFO ] [REMOTE    ] RNR: Fetching primary data for 2025-06.
[2025-10-24T20:53:57.823732] [INFO ] [REMOTE    ] RNGR: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T20:53:58.547611] [INFO ] [REMOTE    ] RNP: Fetching primary data for 2025-07.
[2025-10-24T20:53:58.708036] [INFO ] [REMOTE    ] RNR: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T20:53:59.347729] [INFO ] [REMOTE    ] RNGR: Fetching primary data for 2025-10.
[2025-10-24T20:53:59.443487] [INFO ] [REMOTE    ] RNP: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T20:54:00.131786] [INFO ] [REMOTE    ] RNGR: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T20:54:00.135553] [INFO ] [REMOTE    ] RNGR: Full fetch complete (28256 records).
[2025-10-24T20:54:00.135628] [DEBUG] [VALIDATOR ] RNGR: Validating primary data.
[2025-10-24T20:54:00.136129] [FATAL] [VALIDATOR ] RNGR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:54:00.136224] [FATAL] [MAIN      ] RNGR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:54:00.136297] [WARN ] [MAIN      ] RNGR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:54:00.136386] [INFO ] [LOCAL     ] RNGR: Starting deletion of primary data.
[2025-10-24T20:54:00.136466] [DEBUG] [LOCAL     ] RNGR: No primary data file found to delete.
[2025-10-24T20:54:00.136503] [INFO ] [LOCAL     ] RNGR: Starting deletion of derivative data.
[2025-10-24T20:54:00.136730] [DEBUG] [LOCAL     ] RNGR: Deleted derivative data file.
[2025-10-24T20:54:00.136818] [INFO ] [MAIN      ] Update Progress: 1819/2366 symbols completed. RNGR took 34.5s. Estimated remaining: 1h 10m 21s. Rate: 7.8 symbols/min
[2025-10-24T20:54:00.152812] [INFO ] [REMOTE    ] RNR: Fetching primary data for 2025-07.
[2025-10-24T20:54:00.321766] [INFO ] [MAIN      ] ROG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:54:00.341558] [DEBUG] [LOCAL     ] ROG: Loaded 21699 existing records from primary storage.
[2025-10-24T20:54:00.341822] [INFO ] [MAIN      ] ROG: Loaded 21699 existing records.
[2025-10-24T20:54:00.521346] [WARN ] [MAIN      ] ROG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:54:00.521568] [INFO ] [MAIN      ] ROG: Wiping existing primary data before full refresh.
[2025-10-24T20:54:00.521615] [INFO ] [LOCAL     ] ROG: Starting deletion of primary data.
[2025-10-24T20:54:00.521872] [DEBUG] [LOCAL     ] ROG: Deleted primary data file.
[2025-10-24T20:54:00.521927] [INFO ] [MAIN      ] ROG: Starting full primary refresh.
[2025-10-24T20:54:00.875778] [INFO ] [REMOTE    ] ROG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:54:00.947622] [INFO ] [REMOTE    ] ROG: Fetching primary data for 2025-01.
[2025-10-24T20:54:01.588905] [INFO ] [REMOTE    ] RNR: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T20:54:01.747618] [INFO ] [REMOTE    ] RNP: Fetching primary data for 2025-08.
[2025-10-24T20:54:01.829675] [INFO ] [REMOTE    ] ROG: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T20:54:02.547694] [INFO ] [REMOTE    ] RNST: Fetching primary data for 2025-06.
[2025-10-24T20:54:02.581777] [INFO ] [REMOTE    ] RNP: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T20:54:03.347708] [INFO ] [REMOTE    ] RNR: Fetching primary data for 2025-08.
[2025-10-24T20:54:03.512437] [INFO ] [REMOTE    ] RNST: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T20:54:04.147633] [INFO ] [REMOTE    ] RNST: Fetching primary data for 2025-07.
[2025-10-24T20:54:04.310085] [INFO ] [REMOTE    ] RNR: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T20:54:04.947617] [INFO ] [REMOTE    ] RNR: Fetching primary data for 2025-09.
[2025-10-24T20:54:05.207631] [INFO ] [REMOTE    ] RNST: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T20:54:05.628104] [INFO ] [REMOTE    ] RNR: Incremental fetch complete for 2025-09 (0.68 seconds).
[2025-10-24T20:54:05.747698] [INFO ] [REMOTE    ] ROG: Fetching primary data for 2025-02.
[2025-10-24T20:54:06.315771] [INFO ] [REMOTE    ] ROG: Incremental fetch complete for 2025-02 (0.57 seconds).
[2025-10-24T20:54:06.547681] [INFO ] [REMOTE    ] RNR: Fetching primary data for 2025-10.
[2025-10-24T20:54:07.347724] [INFO ] [REMOTE    ] RNP: Fetching primary data for 2025-09.
[2025-10-24T20:54:07.837459] [INFO ] [REMOTE    ] RNR: Incremental fetch complete for 2025-10 (1.29 seconds).
[2025-10-24T20:54:07.843686] [INFO ] [REMOTE    ] RNR: Full fetch complete (50699 records).
[2025-10-24T20:54:07.843811] [DEBUG] [VALIDATOR ] RNR: Validating primary data.
[2025-10-24T20:54:07.844415] [FATAL] [VALIDATOR ] RNR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:54:07.844502] [FATAL] [MAIN      ] RNR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:54:07.844543] [WARN ] [MAIN      ] RNR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:54:07.844581] [INFO ] [LOCAL     ] RNR: Starting deletion of primary data.
[2025-10-24T20:54:07.844634] [DEBUG] [LOCAL     ] RNR: No primary data file found to delete.
[2025-10-24T20:54:07.844709] [INFO ] [LOCAL     ] RNR: Starting deletion of derivative data.
[2025-10-24T20:54:07.844886] [DEBUG] [LOCAL     ] RNR: Deleted derivative data file.
[2025-10-24T20:54:07.845279] [INFO ] [MAIN      ] Update Progress: 1820/2366 symbols completed. RNR took 28.0s. Estimated remaining: 1h 10m 13s. Rate: 7.8 symbols/min
[2025-10-24T20:54:08.032550] [INFO ] [MAIN      ] ROK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:54:08.030275] [INFO ] [REMOTE    ] RNP: Incremental fetch complete for 2025-09 (0.68 seconds).
[2025-10-24T20:54:08.075760] [DEBUG] [LOCAL     ] ROK: Loaded 43027 existing records from primary storage.
[2025-10-24T20:54:08.076044] [INFO ] [MAIN      ] ROK: Loaded 43027 existing records.
[2025-10-24T20:54:08.152731] [INFO ] [REMOTE    ] RNST: Fetching primary data for 2025-08.
[2025-10-24T20:54:08.253908] [WARN ] [MAIN      ] ROK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:54:08.254101] [INFO ] [MAIN      ] ROK: Wiping existing primary data before full refresh.
[2025-10-24T20:54:08.254147] [INFO ] [LOCAL     ] ROK: Starting deletion of primary data.
[2025-10-24T20:54:08.255064] [DEBUG] [LOCAL     ] ROK: Deleted primary data file.
[2025-10-24T20:54:08.255124] [INFO ] [MAIN      ] ROK: Starting full primary refresh.
[2025-10-24T20:54:08.609678] [INFO ] [REMOTE    ] ROK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:54:08.947628] [INFO ] [REMOTE    ] ROK: Fetching primary data for 2025-01.
[2025-10-24T20:54:09.194438] [INFO ] [REMOTE    ] RNST: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T20:54:09.666712] [INFO ] [REMOTE    ] ROK: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T20:54:09.747676] [INFO ] [REMOTE    ] ROK: Fetching primary data for 2025-02.
[2025-10-24T20:54:10.547630] [INFO ] [REMOTE    ] ROG: Fetching primary data for 2025-03.
[2025-10-24T20:54:10.713551] [INFO ] [REMOTE    ] ROK: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T20:54:11.148247] [INFO ] [REMOTE    ] ROG: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T20:54:11.347670] [INFO ] [REMOTE    ] RNP: Fetching primary data for 2025-10.
[2025-10-24T20:54:11.914741] [INFO ] [REMOTE    ] RNP: Incremental fetch complete for 2025-10 (0.57 seconds).
[2025-10-24T20:54:11.918198] [INFO ] [REMOTE    ] RNP: Full fetch complete (23190 records).
[2025-10-24T20:54:11.918271] [DEBUG] [VALIDATOR ] RNP: Validating primary data.
[2025-10-24T20:54:11.918703] [FATAL] [VALIDATOR ] RNP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:54:11.918785] [FATAL] [MAIN      ] RNP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:54:11.918831] [WARN ] [MAIN      ] RNP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:54:11.918895] [INFO ] [LOCAL     ] RNP: Starting deletion of primary data.
[2025-10-24T20:54:11.918955] [DEBUG] [LOCAL     ] RNP: No primary data file found to delete.
[2025-10-24T20:54:11.918990] [INFO ] [LOCAL     ] RNP: Starting deletion of derivative data.
[2025-10-24T20:54:11.919133] [DEBUG] [LOCAL     ] RNP: Deleted derivative data file.
[2025-10-24T20:54:11.919199] [INFO ] [MAIN      ] Update Progress: 1821/2366 symbols completed. RNP took 37.5s. Estimated remaining: 1h 10m 5s. Rate: 7.8 symbols/min
[2025-10-24T20:54:12.096192] [INFO ] [MAIN      ] ROL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:54:12.144901] [DEBUG] [LOCAL     ] ROL: Loaded 50634 existing records from primary storage.
[2025-10-24T20:54:12.145209] [INFO ] [MAIN      ] ROL: Loaded 50634 existing records.
[2025-10-24T20:54:12.155972] [INFO ] [REMOTE    ] ROG: Fetching primary data for 2025-04.
[2025-10-24T20:54:12.325111] [WARN ] [MAIN      ] ROL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:54:12.325345] [INFO ] [MAIN      ] ROL: Wiping existing primary data before full refresh.
[2025-10-24T20:54:12.325392] [INFO ] [LOCAL     ] ROL: Starting deletion of primary data.
[2025-10-24T20:54:12.326207] [DEBUG] [LOCAL     ] ROL: Deleted primary data file.
[2025-10-24T20:54:12.326265] [INFO ] [MAIN      ] ROL: Starting full primary refresh.
[2025-10-24T20:54:12.686752] [INFO ] [REMOTE    ] ROL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:54:12.938636] [INFO ] [REMOTE    ] ROG: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:54:12.949686] [INFO ] [REMOTE    ] RNST: Fetching primary data for 2025-09.
[2025-10-24T20:54:13.747621] [INFO ] [REMOTE    ] ROG: Fetching primary data for 2025-05.
[2025-10-24T20:54:13.951929] [INFO ] [REMOTE    ] RNST: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T20:54:14.475092] [INFO ] [REMOTE    ] ROG: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T20:54:14.547604] [INFO ] [REMOTE    ] ROG: Fetching primary data for 2025-06.
[2025-10-24T20:54:15.274889] [INFO ] [REMOTE    ] ROG: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T20:54:15.347723] [INFO ] [REMOTE    ] ROG: Fetching primary data for 2025-07.
[2025-10-24T20:54:16.021911] [INFO ] [REMOTE    ] ROG: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T20:54:16.147636] [INFO ] [REMOTE    ] ROG: Fetching primary data for 2025-08.
[2025-10-24T20:54:16.738366] [INFO ] [REMOTE    ] ROG: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T20:54:16.947687] [INFO ] [REMOTE    ] ROK: Fetching primary data for 2025-03.
[2025-10-24T20:54:17.715536] [INFO ] [REMOTE    ] ROK: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T20:54:17.747741] [INFO ] [REMOTE    ] ROK: Fetching primary data for 2025-04.
[2025-10-24T20:54:18.547730] [INFO ] [REMOTE    ] RNST: Fetching primary data for 2025-10.
[2025-10-24T20:54:19.218039] [INFO ] [REMOTE    ] ROK: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T20:54:19.347625] [INFO ] [REMOTE    ] ROK: Fetching primary data for 2025-05.
[2025-10-24T20:54:19.434462] [INFO ] [REMOTE    ] RNST: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T20:54:19.440906] [INFO ] [REMOTE    ] RNST: Full fetch complete (52502 records).
[2025-10-24T20:54:19.441078] [DEBUG] [VALIDATOR ] RNST: Validating primary data.
[2025-10-24T20:54:19.441843] [FATAL] [VALIDATOR ] RNST: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:54:19.441932] [FATAL] [MAIN      ] RNST: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:54:19.441986] [WARN ] [MAIN      ] RNST: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:54:19.442082] [INFO ] [LOCAL     ] RNST: Starting deletion of primary data.
[2025-10-24T20:54:19.442177] [DEBUG] [LOCAL     ] RNST: No primary data file found to delete.
[2025-10-24T20:54:19.442268] [INFO ] [LOCAL     ] RNST: Starting deletion of derivative data.
[2025-10-24T20:54:19.442469] [DEBUG] [LOCAL     ] RNST: Deleted derivative data file.
[2025-10-24T20:54:19.442591] [INFO ] [MAIN      ] Update Progress: 1822/2366 symbols completed. RNST took 38.8s. Estimated remaining: 1h 9m 57s. Rate: 7.8 symbols/min
[2025-10-24T20:54:19.615279] [INFO ] [MAIN      ] RPM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:54:19.656826] [DEBUG] [LOCAL     ] RPM: Loaded 42318 existing records from primary storage.
[2025-10-24T20:54:19.657114] [INFO ] [MAIN      ] RPM: Loaded 42318 existing records.
[2025-10-24T20:54:19.840391] [WARN ] [MAIN      ] RPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:54:19.840623] [INFO ] [MAIN      ] RPM: Wiping existing primary data before full refresh.
[2025-10-24T20:54:19.840725] [INFO ] [LOCAL     ] RPM: Starting deletion of primary data.
[2025-10-24T20:54:19.841697] [DEBUG] [LOCAL     ] RPM: Deleted primary data file.
[2025-10-24T20:54:19.841753] [INFO ] [MAIN      ] RPM: Starting full primary refresh.
[2025-10-24T20:54:20.151141] [INFO ] [REMOTE    ] ROL: Fetching primary data for 2025-01.
[2025-10-24T20:54:20.206480] [INFO ] [REMOTE    ] RPM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:54:20.431435] [INFO ] [REMOTE    ] ROK: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T20:54:20.595685] [INFO ] [REMOTE    ] ROL: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T20:54:20.947663] [INFO ] [REMOTE    ] RPM: Fetching primary data for 2025-01.
[2025-10-24T20:54:21.747703] [INFO ] [REMOTE    ] ROK: Fetching primary data for 2025-06.
[2025-10-24T20:54:22.069941] [INFO ] [REMOTE    ] RPM: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T20:54:22.163743] [INFO ] [REMOTE    ] ROK: Incremental fetch complete for 2025-06 (0.42 seconds).
[2025-10-24T20:54:22.547674] [INFO ] [REMOTE    ] ROL: Fetching primary data for 2025-02.
[2025-10-24T20:54:23.347624] [INFO ] [REMOTE    ] RPM: Fetching primary data for 2025-02.
[2025-10-24T20:54:23.425988] [INFO ] [REMOTE    ] ROL: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T20:54:24.147729] [INFO ] [REMOTE    ] ROG: Fetching primary data for 2025-09.
[2025-10-24T20:54:24.293500] [INFO ] [REMOTE    ] RPM: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T20:54:24.947989] [INFO ] [REMOTE    ] RPM: Fetching primary data for 2025-03.
[2025-10-24T20:54:24.947918] [INFO ] [REMOTE    ] ROG: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T20:54:25.747614] [INFO ] [REMOTE    ] ROG: Fetching primary data for 2025-10.
[2025-10-24T20:54:25.909392] [INFO ] [REMOTE    ] RPM: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T20:54:26.236057] [INFO ] [REMOTE    ] ROG: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T20:54:26.239600] [INFO ] [REMOTE    ] ROG: Full fetch complete (30629 records).
[2025-10-24T20:54:26.239730] [DEBUG] [VALIDATOR ] ROG: Validating primary data.
[2025-10-24T20:54:26.240282] [FATAL] [VALIDATOR ] ROG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:54:26.240366] [FATAL] [MAIN      ] ROG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:54:26.240409] [WARN ] [MAIN      ] ROG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:54:26.240475] [INFO ] [LOCAL     ] ROG: Starting deletion of primary data.
[2025-10-24T20:54:26.240538] [DEBUG] [LOCAL     ] ROG: No primary data file found to delete.
[2025-10-24T20:54:26.240575] [INFO ] [LOCAL     ] ROG: Starting deletion of derivative data.
[2025-10-24T20:54:26.240739] [DEBUG] [LOCAL     ] ROG: Deleted derivative data file.
[2025-10-24T20:54:26.240828] [INFO ] [MAIN      ] Update Progress: 1823/2366 symbols completed. ROG took 26.1s. Estimated remaining: 1h 9m 49s. Rate: 7.8 symbols/min
[2025-10-24T20:54:26.413121] [INFO ] [MAIN      ] RPT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:54:26.431622] [DEBUG] [LOCAL     ] RPT: Loaded 19086 existing records from primary storage.
[2025-10-24T20:54:26.431885] [INFO ] [MAIN      ] RPT: Loaded 19086 existing records.
[2025-10-24T20:54:26.552701] [INFO ] [REMOTE    ] ROL: Fetching primary data for 2025-03.
[2025-10-24T20:54:26.614973] [WARN ] [MAIN      ] RPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:54:26.615149] [INFO ] [MAIN      ] RPT: Wiping existing primary data before full refresh.
[2025-10-24T20:54:26.615194] [INFO ] [LOCAL     ] RPT: Starting deletion of primary data.
[2025-10-24T20:54:26.615361] [DEBUG] [LOCAL     ] RPT: Deleted primary data file.
[2025-10-24T20:54:26.615399] [INFO ] [MAIN      ] RPT: Starting full primary refresh.
[2025-10-24T20:54:26.975560] [INFO ] [REMOTE    ] RPT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:54:27.347689] [INFO ] [REMOTE    ] RPT: Fetching primary data for 2025-01.
[2025-10-24T20:54:27.452865] [INFO ] [REMOTE    ] ROL: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T20:54:28.147722] [INFO ] [REMOTE    ] RPM: Fetching primary data for 2025-04.
[2025-10-24T20:54:28.612481] [INFO ] [REMOTE    ] RPT: Incremental fetch complete for 2025-01 (1.26 seconds).
[2025-10-24T20:54:28.890882] [INFO ] [REMOTE    ] RPM: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T20:54:28.947597] [INFO ] [REMOTE    ] RPM: Fetching primary data for 2025-05.
[2025-10-24T20:54:29.751269] [INFO ] [REMOTE    ] RPT: Fetching primary data for 2025-02.
[2025-10-24T20:54:29.756381] [INFO ] [REMOTE    ] RPM: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:54:30.547670] [INFO ] [REMOTE    ] ROL: Fetching primary data for 2025-04.
[2025-10-24T20:54:30.776563] [INFO ] [REMOTE    ] RPT: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T20:54:31.347624] [INFO ] [REMOTE    ] RPT: Fetching primary data for 2025-03.
[2025-10-24T20:54:31.667577] [INFO ] [REMOTE    ] ROL: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T20:54:32.147622] [INFO ] [REMOTE    ] ROK: Fetching primary data for 2025-07.
[2025-10-24T20:54:32.226960] [INFO ] [REMOTE    ] RPT: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T20:54:32.947671] [INFO ] [REMOTE    ] ROL: Fetching primary data for 2025-05.
[2025-10-24T20:54:33.201568] [INFO ] [REMOTE    ] ROK: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T20:54:33.747616] [INFO ] [REMOTE    ] RPT: Fetching primary data for 2025-04.
[2025-10-24T20:54:34.313018] [INFO ] [REMOTE    ] ROL: Incremental fetch complete for 2025-05 (1.37 seconds).
[2025-10-24T20:54:34.342163] [INFO ] [REMOTE    ] RPT: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T20:54:34.547678] [INFO ] [REMOTE    ] RPM: Fetching primary data for 2025-06.
[2025-10-24T20:54:35.277172] [INFO ] [REMOTE    ] RPM: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T20:54:35.347629] [INFO ] [REMOTE    ] RPM: Fetching primary data for 2025-07.
[2025-10-24T20:54:36.101377] [INFO ] [REMOTE    ] RPM: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T20:54:36.147664] [INFO ] [REMOTE    ] RPM: Fetching primary data for 2025-08.
[2025-10-24T20:54:36.947668] [INFO ] [REMOTE    ] RPT: Fetching primary data for 2025-05.
[2025-10-24T20:54:37.163980] [INFO ] [REMOTE    ] RPM: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T20:54:37.577896] [INFO ] [REMOTE    ] RPT: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T20:54:37.747712] [INFO ] [REMOTE    ] RPM: Fetching primary data for 2025-09.
[2025-10-24T20:54:38.547684] [INFO ] [REMOTE    ] ROK: Fetching primary data for 2025-08.
[2025-10-24T20:54:38.823004] [INFO ] [REMOTE    ] RPM: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T20:54:39.321425] [INFO ] [REMOTE    ] ROK: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T20:54:39.347623] [INFO ] [REMOTE    ] ROK: Fetching primary data for 2025-09.
[2025-10-24T20:54:40.079313] [INFO ] [REMOTE    ] ROK: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T20:54:40.147605] [INFO ] [REMOTE    ] ROK: Fetching primary data for 2025-10.
[2025-10-24T20:54:40.947708] [INFO ] [REMOTE    ] RPM: Fetching primary data for 2025-10.
[2025-10-24T20:54:41.123608] [INFO ] [REMOTE    ] ROK: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T20:54:41.131019] [INFO ] [REMOTE    ] ROK: Full fetch complete (62312 records).
[2025-10-24T20:54:41.131211] [DEBUG] [VALIDATOR ] ROK: Validating primary data.
[2025-10-24T20:54:41.132187] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:54:41.132281] [FATAL] [MAIN      ] ROK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:54:41.132330] [WARN ] [MAIN      ] ROK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:54:41.132376] [INFO ] [LOCAL     ] ROK: Starting deletion of primary data.
[2025-10-24T20:54:41.132444] [DEBUG] [LOCAL     ] ROK: No primary data file found to delete.
[2025-10-24T20:54:41.132483] [INFO ] [LOCAL     ] ROK: Starting deletion of derivative data.
[2025-10-24T20:54:41.132731] [DEBUG] [LOCAL     ] ROK: Deleted derivative data file.
[2025-10-24T20:54:41.133272] [INFO ] [MAIN      ] Update Progress: 1824/2366 symbols completed. ROK took 33.3s. Estimated remaining: 1h 9m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:54:41.335821] [INFO ] [MAIN      ] RQI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:54:41.371925] [DEBUG] [LOCAL     ] RQI: Loaded 28922 existing records from primary storage.
[2025-10-24T20:54:41.372316] [INFO ] [MAIN      ] RQI: Loaded 28922 existing records.
[2025-10-24T20:54:41.561611] [WARN ] [MAIN      ] RQI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:54:41.561917] [INFO ] [MAIN      ] RQI: Wiping existing primary data before full refresh.
[2025-10-24T20:54:41.561967] [INFO ] [LOCAL     ] RQI: Starting deletion of primary data.
[2025-10-24T20:54:41.562455] [DEBUG] [LOCAL     ] RQI: Deleted primary data file.
[2025-10-24T20:54:41.562514] [INFO ] [MAIN      ] RQI: Starting full primary refresh.
[2025-10-24T20:54:41.754855] [INFO ] [REMOTE    ] ROL: Fetching primary data for 2025-06.
[2025-10-24T20:54:41.926291] [INFO ] [REMOTE    ] RQI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:54:42.265123] [INFO ] [REMOTE    ] RPM: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T20:54:42.276735] [INFO ] [REMOTE    ] RPM: Full fetch complete (59434 records).
[2025-10-24T20:54:42.277005] [DEBUG] [VALIDATOR ] RPM: Validating primary data.
[2025-10-24T20:54:42.278131] [FATAL] [VALIDATOR ] RPM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:54:42.278230] [FATAL] [MAIN      ] RPM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:54:42.278275] [WARN ] [MAIN      ] RPM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:54:42.278328] [INFO ] [LOCAL     ] RPM: Starting deletion of primary data.
[2025-10-24T20:54:42.278416] [DEBUG] [LOCAL     ] RPM: No primary data file found to delete.
[2025-10-24T20:54:42.278455] [INFO ] [LOCAL     ] RPM: Starting deletion of derivative data.
[2025-10-24T20:54:42.278711] [DEBUG] [LOCAL     ] RPM: Deleted derivative data file.
[2025-10-24T20:54:42.279299] [INFO ] [MAIN      ] Update Progress: 1825/2366 symbols completed. RPM took 22.8s. Estimated remaining: 1h 9m 34s. Rate: 7.8 symbols/min
[2025-10-24T20:54:42.460115] [INFO ] [MAIN      ] RRC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:54:42.520396] [DEBUG] [LOCAL     ] RRC: Loaded 53305 existing records from primary storage.
[2025-10-24T20:54:42.521020] [INFO ] [MAIN      ] RRC: Loaded 53305 existing records.
[2025-10-24T20:54:42.552844] [INFO ] [REMOTE    ] RPT: Fetching primary data for 2025-06.
[2025-10-24T20:54:42.710492] [WARN ] [MAIN      ] RRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:54:42.710891] [INFO ] [MAIN      ] RRC: Wiping existing primary data before full refresh.
[2025-10-24T20:54:42.710944] [INFO ] [LOCAL     ] RRC: Starting deletion of primary data.
[2025-10-24T20:54:42.711682] [DEBUG] [LOCAL     ] RRC: Deleted primary data file.
[2025-10-24T20:54:42.711741] [INFO ] [MAIN      ] RRC: Starting full primary refresh.
[2025-10-24T20:54:43.098562] [INFO ] [REMOTE    ] RRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:54:43.133216] [INFO ] [REMOTE    ] ROL: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T20:54:43.266463] [INFO ] [REMOTE    ] RPT: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T20:54:43.347639] [INFO ] [REMOTE    ] RPT: Fetching primary data for 2025-07.
[2025-10-24T20:54:44.149878] [INFO ] [REMOTE    ] RQI: Fetching primary data for 2025-01.
[2025-10-24T20:54:44.156164] [INFO ] [REMOTE    ] RPT: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T20:54:44.947735] [INFO ] [REMOTE    ] RPT: Fetching primary data for 2025-08.
[2025-10-24T20:54:45.085451] [INFO ] [REMOTE    ] RQI: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T20:54:45.673490] [INFO ] [REMOTE    ] RPT: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T20:54:45.747764] [INFO ] [REMOTE    ] RQI: Fetching primary data for 2025-02.
[2025-10-24T20:54:46.547713] [INFO ] [REMOTE    ] RPT: Fetching primary data for 2025-09.
[2025-10-24T20:54:46.590542] [INFO ] [REMOTE    ] RQI: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T20:54:47.347704] [INFO ] [REMOTE    ] RQI: Fetching primary data for 2025-03.
[2025-10-24T20:54:47.361826] [INFO ] [REMOTE    ] RPT: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T20:54:48.147637] [INFO ] [REMOTE    ] RPT: Fetching primary data for 2025-10.
[2025-10-24T20:54:48.300412] [INFO ] [REMOTE    ] RQI: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T20:54:48.942888] [INFO ] [REMOTE    ] RPT: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T20:54:48.946794] [INFO ] [REMOTE    ] RPT: Full fetch complete (28112 records).
[2025-10-24T20:54:48.946958] [DEBUG] [VALIDATOR ] RPT: Validating primary data.
[2025-10-24T20:54:48.947807] [FATAL] [VALIDATOR ] RPT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:54:48.947861] [INFO ] [REMOTE    ] ROL: Fetching primary data for 2025-07.
[2025-10-24T20:54:48.948140] [FATAL] [MAIN      ] RPT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:54:48.949124] [WARN ] [MAIN      ] RPT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:54:48.949201] [INFO ] [LOCAL     ] RPT: Starting deletion of primary data.
[2025-10-24T20:54:48.949263] [DEBUG] [LOCAL     ] RPT: No primary data file found to delete.
[2025-10-24T20:54:48.949314] [INFO ] [LOCAL     ] RPT: Starting deletion of derivative data.
[2025-10-24T20:54:48.949541] [DEBUG] [LOCAL     ] RPT: Deleted derivative data file.
[2025-10-24T20:54:48.949682] [INFO ] [MAIN      ] Update Progress: 1826/2366 symbols completed. RPT took 22.7s. Estimated remaining: 1h 9m 26s. Rate: 7.8 symbols/min
[2025-10-24T20:54:49.173853] [INFO ] [MAIN      ] RRX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:54:49.220570] [DEBUG] [LOCAL     ] RRX: Loaded 41001 existing records from primary storage.
[2025-10-24T20:54:49.220958] [INFO ] [MAIN      ] RRX: Loaded 41001 existing records.
[2025-10-24T20:54:49.400736] [WARN ] [MAIN      ] RRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:54:49.401025] [INFO ] [MAIN      ] RRX: Wiping existing primary data before full refresh.
[2025-10-24T20:54:49.401075] [INFO ] [LOCAL     ] RRX: Starting deletion of primary data.
[2025-10-24T20:54:49.401705] [DEBUG] [LOCAL     ] RRX: Deleted primary data file.
[2025-10-24T20:54:49.401764] [INFO ] [MAIN      ] RRX: Starting full primary refresh.
[2025-10-24T20:54:49.749310] [INFO ] [REMOTE    ] RQI: Fetching primary data for 2025-04.
[2025-10-24T20:54:49.763610] [INFO ] [REMOTE    ] RRX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:54:49.797323] [INFO ] [REMOTE    ] ROL: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T20:54:50.547679] [INFO ] [REMOTE    ] RRX: Fetching primary data for 2025-01.
[2025-10-24T20:54:50.687150] [INFO ] [REMOTE    ] RQI: Incremental fetch complete for 2025-04 (0.94 seconds).
[2025-10-24T20:54:51.276202] [INFO ] [REMOTE    ] RRX: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T20:54:51.347695] [INFO ] [REMOTE    ] RRX: Fetching primary data for 2025-02.
[2025-10-24T20:54:52.147677] [INFO ] [REMOTE    ] RQI: Fetching primary data for 2025-05.
[2025-10-24T20:54:52.303146] [INFO ] [REMOTE    ] RRX: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T20:54:52.947715] [INFO ] [REMOTE    ] ROL: Fetching primary data for 2025-08.
[2025-10-24T20:54:53.300306] [INFO ] [REMOTE    ] RQI: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T20:54:53.747738] [INFO ] [REMOTE    ] RQI: Fetching primary data for 2025-06.
[2025-10-24T20:54:53.823618] [INFO ] [REMOTE    ] ROL: Incremental fetch complete for 2025-08 (0.88 seconds).
[2025-10-24T20:54:54.343990] [INFO ] [REMOTE    ] RQI: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T20:54:54.547736] [INFO ] [REMOTE    ] RQI: Fetching primary data for 2025-07.
[2025-10-24T20:54:55.245270] [INFO ] [REMOTE    ] RQI: Incremental fetch complete for 2025-07 (0.70 seconds).
[2025-10-24T20:54:55.347709] [INFO ] [REMOTE    ] RRX: Fetching primary data for 2025-03.
[2025-10-24T20:54:56.081015] [INFO ] [REMOTE    ] RRX: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T20:54:56.147739] [INFO ] [REMOTE    ] RRX: Fetching primary data for 2025-04.
[2025-10-24T20:54:56.947733] [INFO ] [REMOTE    ] RQI: Fetching primary data for 2025-08.
[2025-10-24T20:54:57.586882] [INFO ] [REMOTE    ] RRX: Incremental fetch complete for 2025-04 (1.44 seconds).
[2025-10-24T20:54:57.747697] [INFO ] [REMOTE    ] RRX: Fetching primary data for 2025-05.
[2025-10-24T20:54:57.925970] [INFO ] [REMOTE    ] RQI: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T20:54:58.547636] [INFO ] [REMOTE    ] RRC: Fetching primary data for 2025-01.
[2025-10-24T20:54:58.955499] [INFO ] [REMOTE    ] RRX: Incremental fetch complete for 2025-05 (1.21 seconds).
[2025-10-24T20:54:59.347638] [INFO ] [REMOTE    ] ROL: Fetching primary data for 2025-09.
[2025-10-24T20:54:59.813721] [INFO ] [REMOTE    ] RRC: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T20:55:00.147709] [INFO ] [REMOTE    ] RQI: Fetching primary data for 2025-09.
[2025-10-24T20:55:00.394001] [INFO ] [REMOTE    ] ROL: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T20:55:00.947674] [INFO ] [REMOTE    ] RRX: Fetching primary data for 2025-06.
[2025-10-24T20:55:01.010247] [INFO ] [REMOTE    ] RQI: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T20:55:01.709856] [INFO ] [REMOTE    ] RRX: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T20:55:01.747733] [INFO ] [REMOTE    ] ROL: Fetching primary data for 2025-10.
[2025-10-24T20:55:02.547756] [INFO ] [REMOTE    ] RRC: Fetching primary data for 2025-02.
[2025-10-24T20:55:02.748772] [INFO ] [REMOTE    ] ROL: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T20:55:02.758377] [INFO ] [REMOTE    ] ROL: Full fetch complete (72857 records).
[2025-10-24T20:55:02.758565] [DEBUG] [VALIDATOR ] ROL: Validating primary data.
[2025-10-24T20:55:02.759597] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:55:02.759720] [FATAL] [MAIN      ] ROL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:55:02.759766] [WARN ] [MAIN      ] ROL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:55:02.759816] [INFO ] [LOCAL     ] ROL: Starting deletion of primary data.
[2025-10-24T20:55:02.759882] [DEBUG] [LOCAL     ] ROL: No primary data file found to delete.
[2025-10-24T20:55:02.759919] [INFO ] [LOCAL     ] ROL: Starting deletion of derivative data.
[2025-10-24T20:55:02.760107] [DEBUG] [LOCAL     ] ROL: Deleted derivative data file.
[2025-10-24T20:55:02.760554] [INFO ] [MAIN      ] Update Progress: 1827/2366 symbols completed. ROL took 50.8s. Estimated remaining: 1h 9m 20s. Rate: 7.8 symbols/min
[2025-10-24T20:55:02.935604] [INFO ] [MAIN      ] RS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:55:02.959821] [DEBUG] [LOCAL     ] RS: Loaded 24797 existing records from primary storage.
[2025-10-24T20:55:02.960085] [INFO ] [MAIN      ] RS: Loaded 24797 existing records.
[2025-10-24T20:55:03.165894] [WARN ] [MAIN      ] RS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:55:03.166227] [INFO ] [MAIN      ] RS: Wiping existing primary data before full refresh.
[2025-10-24T20:55:03.166298] [INFO ] [LOCAL     ] RS: Starting deletion of primary data.
[2025-10-24T20:55:03.166786] [DEBUG] [LOCAL     ] RS: Deleted primary data file.
[2025-10-24T20:55:03.166925] [INFO ] [MAIN      ] RS: Starting full primary refresh.
[2025-10-24T20:55:03.353745] [INFO ] [REMOTE    ] RRX: Fetching primary data for 2025-07.
[2025-10-24T20:55:03.497457] [INFO ] [REMOTE    ] RRC: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T20:55:03.589013] [INFO ] [REMOTE    ] RS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:55:04.147639] [INFO ] [REMOTE    ] RS: Fetching primary data for 2025-01.
[2025-10-24T20:55:04.423009] [INFO ] [REMOTE    ] RRX: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T20:55:04.952787] [INFO ] [REMOTE    ] RQI: Fetching primary data for 2025-10.
[2025-10-24T20:55:04.957325] [INFO ] [REMOTE    ] RS: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T20:55:05.747728] [INFO ] [REMOTE    ] RRX: Fetching primary data for 2025-08.
[2025-10-24T20:55:05.800746] [INFO ] [REMOTE    ] RQI: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T20:55:05.805816] [INFO ] [REMOTE    ] RQI: Full fetch complete (42400 records).
[2025-10-24T20:55:05.805943] [DEBUG] [VALIDATOR ] RQI: Validating primary data.
[2025-10-24T20:55:05.806536] [FATAL] [VALIDATOR ] RQI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:55:05.806632] [FATAL] [MAIN      ] RQI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:55:05.806734] [WARN ] [MAIN      ] RQI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:55:05.806825] [INFO ] [LOCAL     ] RQI: Starting deletion of primary data.
[2025-10-24T20:55:05.806904] [DEBUG] [LOCAL     ] RQI: No primary data file found to delete.
[2025-10-24T20:55:05.806944] [INFO ] [LOCAL     ] RQI: Starting deletion of derivative data.
[2025-10-24T20:55:05.807177] [DEBUG] [LOCAL     ] RQI: Deleted derivative data file.
[2025-10-24T20:55:05.807273] [INFO ] [MAIN      ] Update Progress: 1828/2366 symbols completed. RQI took 24.7s. Estimated remaining: 1h 9m 11s. Rate: 7.8 symbols/min
[2025-10-24T20:55:05.976406] [INFO ] [MAIN      ] RSF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:55:05.987722] [DEBUG] [LOCAL     ] RSF: Loaded 4278 existing records from primary storage.
[2025-10-24T20:55:05.988034] [INFO ] [MAIN      ] RSF: Loaded 4278 existing records.
[2025-10-24T20:55:06.162420] [WARN ] [MAIN      ] RSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:55:06.162696] [INFO ] [MAIN      ] RSF: Wiping existing primary data before full refresh.
[2025-10-24T20:55:06.162755] [INFO ] [LOCAL     ] RSF: Starting deletion of primary data.
[2025-10-24T20:55:06.162935] [DEBUG] [LOCAL     ] RSF: Deleted primary data file.
[2025-10-24T20:55:06.162994] [INFO ] [MAIN      ] RSF: Starting full primary refresh.
[2025-10-24T20:55:06.516840] [INFO ] [REMOTE    ] RSF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:55:06.547609] [INFO ] [REMOTE    ] RSF: Fetching primary data for 2025-01.
[2025-10-24T20:55:06.778766] [INFO ] [REMOTE    ] RRX: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T20:55:07.190544] [INFO ] [REMOTE    ] RSF: Incremental fetch complete for 2025-01 (0.64 seconds).
[2025-10-24T20:55:07.347681] [INFO ] [REMOTE    ] RSF: Fetching primary data for 2025-02.
[2025-10-24T20:55:08.147730] [INFO ] [REMOTE    ] RRC: Fetching primary data for 2025-03.
[2025-10-24T20:55:08.279896] [INFO ] [REMOTE    ] RSF: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T20:55:08.947686] [INFO ] [REMOTE    ] RRX: Fetching primary data for 2025-09.
[2025-10-24T20:55:09.425348] [INFO ] [REMOTE    ] RRC: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T20:55:09.692767] [INFO ] [REMOTE    ] RRX: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T20:55:09.747697] [INFO ] [REMOTE    ] RSF: Fetching primary data for 2025-03.
[2025-10-24T20:55:10.547725] [INFO ] [REMOTE    ] RRX: Fetching primary data for 2025-10.
[2025-10-24T20:55:10.552619] [INFO ] [REMOTE    ] RSF: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T20:55:11.347671] [INFO ] [REMOTE    ] RSF: Fetching primary data for 2025-04.
[2025-10-24T20:55:11.497386] [INFO ] [REMOTE    ] RRX: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T20:55:11.504292] [INFO ] [REMOTE    ] RRX: Full fetch complete (58409 records).
[2025-10-24T20:55:11.504432] [DEBUG] [VALIDATOR ] RRX: Validating primary data.
[2025-10-24T20:55:11.505061] [FATAL] [VALIDATOR ] RRX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:55:11.505149] [FATAL] [MAIN      ] RRX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:55:11.505191] [WARN ] [MAIN      ] RRX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:55:11.505248] [INFO ] [LOCAL     ] RRX: Starting deletion of primary data.
[2025-10-24T20:55:11.505303] [DEBUG] [LOCAL     ] RRX: No primary data file found to delete.
[2025-10-24T20:55:11.505338] [INFO ] [LOCAL     ] RRX: Starting deletion of derivative data.
[2025-10-24T20:55:11.505516] [DEBUG] [LOCAL     ] RRX: Deleted derivative data file.
[2025-10-24T20:55:11.505603] [INFO ] [MAIN      ] Update Progress: 1829/2366 symbols completed. RRX took 22.6s. Estimated remaining: 1h 9m 2s. Rate: 7.8 symbols/min
[2025-10-24T20:55:11.676308] [INFO ] [MAIN      ] RSG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:55:11.709587] [INFO ] [REMOTE    ] RSF: Incremental fetch complete for 2025-04 (0.36 seconds).
[2025-10-24T20:55:11.726288] [DEBUG] [LOCAL     ] RSG: Loaded 47641 existing records from primary storage.
[2025-10-24T20:55:11.727049] [INFO ] [MAIN      ] RSG: Loaded 47641 existing records.
[2025-10-24T20:55:11.902577] [WARN ] [MAIN      ] RSG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:55:11.902801] [INFO ] [MAIN      ] RSG: Wiping existing primary data before full refresh.
[2025-10-24T20:55:11.902851] [INFO ] [LOCAL     ] RSG: Starting deletion of primary data.
[2025-10-24T20:55:11.903301] [DEBUG] [LOCAL     ] RSG: Deleted primary data file.
[2025-10-24T20:55:11.903341] [INFO ] [MAIN      ] RSG: Starting full primary refresh.
[2025-10-24T20:55:12.152759] [INFO ] [REMOTE    ] RS: Fetching primary data for 2025-02.
[2025-10-24T20:55:12.252729] [INFO ] [REMOTE    ] RSG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:55:12.947727] [INFO ] [REMOTE    ] RSG: Fetching primary data for 2025-01.
[2025-10-24T20:55:13.497369] [INFO ] [REMOTE    ] RS: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T20:55:13.747725] [INFO ] [REMOTE    ] RSF: Fetching primary data for 2025-05.
[2025-10-24T20:55:14.368310] [INFO ] [REMOTE    ] RSG: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T20:55:14.450069] [INFO ] [REMOTE    ] RSF: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T20:55:14.547673] [INFO ] [REMOTE    ] RRC: Fetching primary data for 2025-04.
[2025-10-24T20:55:15.349131] [INFO ] [REMOTE    ] RSG: Fetching primary data for 2025-02.
[2025-10-24T20:55:15.355868] [INFO ] [REMOTE    ] RRC: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T20:55:16.143264] [INFO ] [REMOTE    ] RSG: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T20:55:16.152919] [INFO ] [REMOTE    ] RS: Fetching primary data for 2025-03.
[2025-10-24T20:55:16.947701] [INFO ] [REMOTE    ] RSF: Fetching primary data for 2025-06.
[2025-10-24T20:55:17.325796] [INFO ] [REMOTE    ] RSF: Incremental fetch complete for 2025-06 (0.38 seconds).
[2025-10-24T20:55:17.407232] [INFO ] [REMOTE    ] RS: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T20:55:17.747672] [INFO ] [REMOTE    ] RSG: Fetching primary data for 2025-03.
[2025-10-24T20:55:18.547638] [INFO ] [REMOTE    ] RS: Fetching primary data for 2025-04.
[2025-10-24T20:55:18.958508] [INFO ] [REMOTE    ] RSG: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T20:55:19.347617] [INFO ] [REMOTE    ] RSG: Fetching primary data for 2025-04.
[2025-10-24T20:55:19.530170] [INFO ] [REMOTE    ] RS: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T20:55:20.122467] [INFO ] [REMOTE    ] RSG: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T20:55:20.147627] [INFO ] [REMOTE    ] RS: Fetching primary data for 2025-05.
[2025-10-24T20:55:20.947626] [INFO ] [REMOTE    ] RRC: Fetching primary data for 2025-05.
[2025-10-24T20:55:21.077709] [INFO ] [REMOTE    ] RS: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T20:55:21.747687] [INFO ] [REMOTE    ] RS: Fetching primary data for 2025-06.
[2025-10-24T20:55:22.040884] [INFO ] [REMOTE    ] RRC: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T20:55:22.370284] [INFO ] [REMOTE    ] RS: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T20:55:22.547637] [INFO ] [REMOTE    ] RSF: Fetching primary data for 2025-07.
[2025-10-24T20:55:22.978874] [INFO ] [REMOTE    ] RSF: Incremental fetch complete for 2025-07 (0.43 seconds).
[2025-10-24T20:55:23.347639] [INFO ] [REMOTE    ] RSG: Fetching primary data for 2025-05.
[2025-10-24T20:55:24.135086] [INFO ] [REMOTE    ] RSG: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T20:55:24.147605] [INFO ] [REMOTE    ] RSG: Fetching primary data for 2025-06.
[2025-10-24T20:55:24.947632] [INFO ] [REMOTE    ] RRC: Fetching primary data for 2025-06.
[2025-10-24T20:55:25.149426] [INFO ] [REMOTE    ] RSG: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T20:55:25.740830] [INFO ] [REMOTE    ] RRC: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T20:55:25.750729] [INFO ] [REMOTE    ] RSF: Fetching primary data for 2025-08.
[2025-10-24T20:55:26.398482] [INFO ] [REMOTE    ] RSF: Incremental fetch complete for 2025-08 (0.65 seconds).
[2025-10-24T20:55:26.547634] [INFO ] [REMOTE    ] RRC: Fetching primary data for 2025-07.
[2025-10-24T20:55:27.347668] [INFO ] [REMOTE    ] RS: Fetching primary data for 2025-07.
[2025-10-24T20:55:27.915629] [INFO ] [REMOTE    ] RRC: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T20:55:28.147628] [INFO ] [REMOTE    ] RSF: Fetching primary data for 2025-09.
[2025-10-24T20:55:28.207234] [INFO ] [REMOTE    ] RS: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T20:55:28.516849] [INFO ] [REMOTE    ] RSF: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T20:55:28.947673] [INFO ] [REMOTE    ] RRC: Fetching primary data for 2025-08.
[2025-10-24T20:55:29.747726] [INFO ] [REMOTE    ] RSG: Fetching primary data for 2025-07.
[2025-10-24T20:55:30.057482] [INFO ] [REMOTE    ] RRC: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T20:55:30.552876] [INFO ] [REMOTE    ] RSF: Fetching primary data for 2025-10.
[2025-10-24T20:55:30.572749] [INFO ] [REMOTE    ] RSG: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T20:55:31.118553] [INFO ] [REMOTE    ] RSF: Incremental fetch complete for 2025-10 (0.57 seconds).
[2025-10-24T20:55:31.119826] [INFO ] [REMOTE    ] RSF: Full fetch complete (5559 records).
[2025-10-24T20:55:31.119900] [DEBUG] [VALIDATOR ] RSF: Validating primary data.
[2025-10-24T20:55:31.120246] [FATAL] [VALIDATOR ] RSF: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:55:31.120325] [FATAL] [MAIN      ] RSF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:55:31.120367] [WARN ] [MAIN      ] RSF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:55:31.120405] [INFO ] [LOCAL     ] RSF: Starting deletion of primary data.
[2025-10-24T20:55:31.120460] [DEBUG] [LOCAL     ] RSF: No primary data file found to delete.
[2025-10-24T20:55:31.120535] [INFO ] [LOCAL     ] RSF: Starting deletion of derivative data.
[2025-10-24T20:55:31.120762] [DEBUG] [LOCAL     ] RSF: Deleted derivative data file.
[2025-10-24T20:55:31.120866] [INFO ] [MAIN      ] Update Progress: 1830/2366 symbols completed. RSF took 25.3s. Estimated remaining: 1h 8m 58s. Rate: 7.8 symbols/min
[2025-10-24T20:55:31.290322] [INFO ] [MAIN      ] RSI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:55:31.333162] [DEBUG] [LOCAL     ] RSI: Loaded 47344 existing records from primary storage.
[2025-10-24T20:55:31.333440] [INFO ] [MAIN      ] RSI: Loaded 47344 existing records.
[2025-10-24T20:55:31.354053] [INFO ] [REMOTE    ] RSG: Fetching primary data for 2025-08.
[2025-10-24T20:55:31.521881] [WARN ] [MAIN      ] RSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:55:31.522104] [INFO ] [MAIN      ] RSI: Wiping existing primary data before full refresh.
[2025-10-24T20:55:31.522153] [INFO ] [LOCAL     ] RSI: Starting deletion of primary data.
[2025-10-24T20:55:31.522526] [DEBUG] [LOCAL     ] RSI: Deleted primary data file.
[2025-10-24T20:55:31.522582] [INFO ] [MAIN      ] RSI: Starting full primary refresh.
[2025-10-24T20:55:31.874922] [INFO ] [REMOTE    ] RSI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:55:32.147698] [INFO ] [REMOTE    ] RS: Fetching primary data for 2025-08.
[2025-10-24T20:55:32.414121] [INFO ] [REMOTE    ] RSG: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T20:55:32.742344] [INFO ] [REMOTE    ] RS: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T20:55:32.947684] [INFO ] [REMOTE    ] RSG: Fetching primary data for 2025-09.
[2025-10-24T20:55:33.747726] [INFO ] [REMOTE    ] RSI: Fetching primary data for 2025-01.
[2025-10-24T20:55:34.040948] [INFO ] [REMOTE    ] RSG: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T20:55:34.547613] [INFO ] [REMOTE    ] RRC: Fetching primary data for 2025-09.
[2025-10-24T20:55:34.787054] [INFO ] [REMOTE    ] RSI: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T20:55:35.347695] [INFO ] [REMOTE    ] RSG: Fetching primary data for 2025-10.
[2025-10-24T20:55:35.635535] [INFO ] [REMOTE    ] RRC: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T20:55:35.671348] [INFO ] [REMOTE    ] RSG: Incremental fetch complete for 2025-10 (0.32 seconds).
[2025-10-24T20:55:35.679457] [INFO ] [REMOTE    ] RSG: Full fetch complete (68077 records).
[2025-10-24T20:55:35.679574] [DEBUG] [VALIDATOR ] RSG: Validating primary data.
[2025-10-24T20:55:35.680382] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:55:35.680472] [FATAL] [MAIN      ] RSG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:55:35.680514] [WARN ] [MAIN      ] RSG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:55:35.680553] [INFO ] [LOCAL     ] RSG: Starting deletion of primary data.
[2025-10-24T20:55:35.680611] [DEBUG] [LOCAL     ] RSG: No primary data file found to delete.
[2025-10-24T20:55:35.680673] [INFO ] [LOCAL     ] RSG: Starting deletion of derivative data.
[2025-10-24T20:55:35.680851] [DEBUG] [LOCAL     ] RSG: Deleted derivative data file.
[2025-10-24T20:55:35.680923] [INFO ] [MAIN      ] Update Progress: 1831/2366 symbols completed. RSG took 24.2s. Estimated remaining: 1h 8m 49s. Rate: 7.8 symbols/min
[2025-10-24T20:55:35.861126] [INFO ] [MAIN      ] RSKD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:55:35.892433] [DEBUG] [LOCAL     ] RSKD: Loaded 33437 existing records from primary storage.
[2025-10-24T20:55:35.892735] [INFO ] [MAIN      ] RSKD: Loaded 33437 existing records.
[2025-10-24T20:55:36.098157] [WARN ] [MAIN      ] RSKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:55:36.098382] [INFO ] [MAIN      ] RSKD: Wiping existing primary data before full refresh.
[2025-10-24T20:55:36.098429] [INFO ] [LOCAL     ] RSKD: Starting deletion of primary data.
[2025-10-24T20:55:36.098724] [DEBUG] [LOCAL     ] RSKD: Deleted primary data file.
[2025-10-24T20:55:36.098779] [INFO ] [MAIN      ] RSKD: Starting full primary refresh.
[2025-10-24T20:55:36.152861] [INFO ] [REMOTE    ] RRC: Fetching primary data for 2025-10.
[2025-10-24T20:55:36.449636] [INFO ] [REMOTE    ] RSKD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:55:36.947691] [INFO ] [REMOTE    ] RSI: Fetching primary data for 2025-02.
[2025-10-24T20:55:37.349674] [INFO ] [REMOTE    ] RRC: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T20:55:37.358817] [INFO ] [REMOTE    ] RRC: Full fetch complete (76369 records).
[2025-10-24T20:55:37.358938] [DEBUG] [VALIDATOR ] RRC: Validating primary data.
[2025-10-24T20:55:37.359702] [FATAL] [VALIDATOR ] RRC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:55:37.359788] [FATAL] [MAIN      ] RRC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:55:37.359838] [WARN ] [MAIN      ] RRC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:55:37.359877] [INFO ] [LOCAL     ] RRC: Starting deletion of primary data.
[2025-10-24T20:55:37.359934] [DEBUG] [LOCAL     ] RRC: No primary data file found to delete.
[2025-10-24T20:55:37.359977] [INFO ] [LOCAL     ] RRC: Starting deletion of derivative data.
[2025-10-24T20:55:37.360150] [DEBUG] [LOCAL     ] RRC: Deleted derivative data file.
[2025-10-24T20:55:37.360583] [INFO ] [MAIN      ] Update Progress: 1832/2366 symbols completed. RRC took 55.1s. Estimated remaining: 1h 8m 40s. Rate: 7.8 symbols/min
[2025-10-24T20:55:37.529365] [INFO ] [MAIN      ] RTO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:55:37.566492] [DEBUG] [LOCAL     ] RTO: Loaded 40099 existing records from primary storage.
[2025-10-24T20:55:37.566789] [INFO ] [MAIN      ] RTO: Loaded 40099 existing records.
[2025-10-24T20:55:37.741555] [WARN ] [MAIN      ] RTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:55:37.741757] [INFO ] [MAIN      ] RTO: Wiping existing primary data before full refresh.
[2025-10-24T20:55:37.741805] [INFO ] [LOCAL     ] RTO: Starting deletion of primary data.
[2025-10-24T20:55:37.742236] [DEBUG] [LOCAL     ] RTO: Deleted primary data file.
[2025-10-24T20:55:37.742276] [INFO ] [MAIN      ] RTO: Starting full primary refresh.
[2025-10-24T20:55:37.753072] [INFO ] [REMOTE    ] RSKD: Fetching primary data for 2025-01.
[2025-10-24T20:55:38.107032] [INFO ] [REMOTE    ] RTO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:55:38.132054] [INFO ] [REMOTE    ] RSI: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T20:55:38.547700] [INFO ] [REMOTE    ] RSI: Fetching primary data for 2025-03.
[2025-10-24T20:55:39.014752] [INFO ] [REMOTE    ] RSKD: Incremental fetch complete for 2025-01 (1.26 seconds).
[2025-10-24T20:55:39.347676] [INFO ] [REMOTE    ] RTO: Fetching primary data for 2025-01.
[2025-10-24T20:55:39.561243] [INFO ] [REMOTE    ] RSI: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T20:55:39.641491] [INFO ] [REMOTE    ] RTO: Incremental fetch complete for 2025-01 (0.29 seconds).
[2025-10-24T20:55:40.147706] [INFO ] [REMOTE    ] RS: Fetching primary data for 2025-09.
[2025-10-24T20:55:40.731289] [INFO ] [REMOTE    ] RS: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T20:55:40.947713] [INFO ] [REMOTE    ] RSKD: Fetching primary data for 2025-02.
[2025-10-24T20:55:41.609099] [INFO ] [REMOTE    ] RSKD: Incremental fetch complete for 2025-02 (0.66 seconds).
[2025-10-24T20:55:41.747683] [INFO ] [REMOTE    ] RTO: Fetching primary data for 2025-02.
[2025-10-24T20:55:42.452352] [INFO ] [REMOTE    ] RTO: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T20:55:42.547627] [INFO ] [REMOTE    ] RTO: Fetching primary data for 2025-03.
[2025-10-24T20:55:43.347626] [INFO ] [REMOTE    ] RSKD: Fetching primary data for 2025-03.
[2025-10-24T20:55:43.535082] [INFO ] [REMOTE    ] RTO: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T20:55:44.147629] [INFO ] [REMOTE    ] RSI: Fetching primary data for 2025-04.
[2025-10-24T20:55:44.382409] [INFO ] [REMOTE    ] RSKD: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T20:55:44.947709] [INFO ] [REMOTE    ] RS: Fetching primary data for 2025-10.
[2025-10-24T20:55:45.373374] [INFO ] [REMOTE    ] RSI: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T20:55:45.728173] [INFO ] [REMOTE    ] RS: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T20:55:45.732719] [INFO ] [REMOTE    ] RS: Full fetch complete (38336 records).
[2025-10-24T20:55:45.732808] [DEBUG] [VALIDATOR ] RS: Validating primary data.
[2025-10-24T20:55:45.733272] [FATAL] [VALIDATOR ] RS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:55:45.733352] [FATAL] [MAIN      ] RS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:55:45.733394] [WARN ] [MAIN      ] RS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:55:45.733433] [INFO ] [LOCAL     ] RS: Starting deletion of primary data.
[2025-10-24T20:55:45.733485] [DEBUG] [LOCAL     ] RS: No primary data file found to delete.
[2025-10-24T20:55:45.733518] [INFO ] [LOCAL     ] RS: Starting deletion of derivative data.
[2025-10-24T20:55:45.733704] [DEBUG] [LOCAL     ] RS: Deleted derivative data file.
[2025-10-24T20:55:45.733795] [INFO ] [MAIN      ] Update Progress: 1833/2366 symbols completed. RS took 43.0s. Estimated remaining: 1h 8m 32s. Rate: 7.8 symbols/min
[2025-10-24T20:55:45.754153] [INFO ] [REMOTE    ] RSI: Fetching primary data for 2025-05.
[2025-10-24T20:55:45.908212] [INFO ] [MAIN      ] RTX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:55:45.961859] [DEBUG] [LOCAL     ] RTX: Loaded 54096 existing records from primary storage.
[2025-10-24T20:55:45.962169] [INFO ] [MAIN      ] RTX: Loaded 54096 existing records.
[2025-10-24T20:55:46.138437] [WARN ] [MAIN      ] RTX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:55:46.138714] [INFO ] [MAIN      ] RTX: Wiping existing primary data before full refresh.
[2025-10-24T20:55:46.138769] [INFO ] [LOCAL     ] RTX: Starting deletion of primary data.
[2025-10-24T20:55:46.139203] [DEBUG] [LOCAL     ] RTX: Deleted primary data file.
[2025-10-24T20:55:46.139241] [INFO ] [MAIN      ] RTX: Starting full primary refresh.
[2025-10-24T20:55:46.501268] [INFO ] [REMOTE    ] RTX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:55:46.556143] [INFO ] [REMOTE    ] RTX: Fetching primary data for 2025-01.
[2025-10-24T20:55:46.561279] [INFO ] [REMOTE    ] RSI: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:55:47.347627] [INFO ] [REMOTE    ] RSKD: Fetching primary data for 2025-04.
[2025-10-24T20:55:47.594455] [INFO ] [REMOTE    ] RTX: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T20:55:48.147682] [INFO ] [REMOTE    ] RTO: Fetching primary data for 2025-04.
[2025-10-24T20:55:48.451472] [INFO ] [REMOTE    ] RSKD: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T20:55:48.947708] [INFO ] [REMOTE    ] RSI: Fetching primary data for 2025-06.
[2025-10-24T20:55:49.269512] [INFO ] [REMOTE    ] RTO: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T20:55:49.679067] [INFO ] [REMOTE    ] RSI: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T20:55:49.747610] [INFO ] [REMOTE    ] RSI: Fetching primary data for 2025-07.
[2025-10-24T20:55:50.547631] [INFO ] [REMOTE    ] RTO: Fetching primary data for 2025-05.
[2025-10-24T20:55:50.775776] [INFO ] [REMOTE    ] RSI: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T20:55:51.347678] [INFO ] [REMOTE    ] RSKD: Fetching primary data for 2025-05.
[2025-10-24T20:55:51.569429] [INFO ] [REMOTE    ] RTO: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T20:55:52.026585] [INFO ] [REMOTE    ] RSKD: Incremental fetch complete for 2025-05 (0.68 seconds).
[2025-10-24T20:55:52.147626] [INFO ] [REMOTE    ] RSKD: Fetching primary data for 2025-06.
[2025-10-24T20:55:52.947722] [INFO ] [REMOTE    ] RTX: Fetching primary data for 2025-02.
[2025-10-24T20:55:53.479014] [INFO ] [REMOTE    ] RSKD: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T20:55:53.747615] [INFO ] [REMOTE    ] RSI: Fetching primary data for 2025-08.
[2025-10-24T20:55:53.967780] [INFO ] [REMOTE    ] RTX: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T20:55:54.547625] [INFO ] [REMOTE    ] RSKD: Fetching primary data for 2025-07.
[2025-10-24T20:55:54.715303] [INFO ] [REMOTE    ] RSI: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T20:55:55.226554] [INFO ] [REMOTE    ] RSKD: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T20:55:55.347702] [INFO ] [REMOTE    ] RSKD: Fetching primary data for 2025-08.
[2025-10-24T20:55:55.961047] [INFO ] [REMOTE    ] RSKD: Incremental fetch complete for 2025-08 (0.61 seconds).
[2025-10-24T20:55:56.147682] [INFO ] [REMOTE    ] RSKD: Fetching primary data for 2025-09.
[2025-10-24T20:55:56.910037] [INFO ] [REMOTE    ] RSKD: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T20:55:56.947603] [INFO ] [REMOTE    ] RSKD: Fetching primary data for 2025-10.
[2025-10-24T20:55:57.747700] [INFO ] [REMOTE    ] RSI: Fetching primary data for 2025-09.
[2025-10-24T20:55:57.772150] [INFO ] [REMOTE    ] RSKD: Incremental fetch complete for 2025-10 (0.82 seconds).
[2025-10-24T20:55:57.778125] [INFO ] [REMOTE    ] RSKD: Full fetch complete (48088 records).
[2025-10-24T20:55:57.778253] [DEBUG] [VALIDATOR ] RSKD: Validating primary data.
[2025-10-24T20:55:57.778984] [FATAL] [VALIDATOR ] RSKD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:55:57.779085] [FATAL] [MAIN      ] RSKD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:55:57.779127] [WARN ] [MAIN      ] RSKD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:55:57.779166] [INFO ] [LOCAL     ] RSKD: Starting deletion of primary data.
[2025-10-24T20:55:57.779220] [DEBUG] [LOCAL     ] RSKD: No primary data file found to delete.
[2025-10-24T20:55:57.779253] [INFO ] [LOCAL     ] RSKD: Starting deletion of derivative data.
[2025-10-24T20:55:57.779402] [DEBUG] [LOCAL     ] RSKD: Deleted derivative data file.
[2025-10-24T20:55:57.779470] [INFO ] [MAIN      ] Update Progress: 1834/2366 symbols completed. RSKD took 22.1s. Estimated remaining: 1h 8m 26s. Rate: 7.8 symbols/min
[2025-10-24T20:55:57.951736] [INFO ] [MAIN      ] RVLV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:55:57.997213] [DEBUG] [LOCAL     ] RVLV: Loaded 47671 existing records from primary storage.
[2025-10-24T20:55:57.997565] [INFO ] [MAIN      ] RVLV: Loaded 47671 existing records.
[2025-10-24T20:55:58.185181] [WARN ] [MAIN      ] RVLV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:55:58.185421] [INFO ] [MAIN      ] RVLV: Wiping existing primary data before full refresh.
[2025-10-24T20:55:58.185475] [INFO ] [LOCAL     ] RVLV: Starting deletion of primary data.
[2025-10-24T20:55:58.185876] [DEBUG] [LOCAL     ] RVLV: Deleted primary data file.
[2025-10-24T20:55:58.185932] [INFO ] [MAIN      ] RVLV: Starting full primary refresh.
[2025-10-24T20:55:58.554139] [INFO ] [REMOTE    ] RTX: Fetching primary data for 2025-03.
[2025-10-24T20:55:58.559950] [INFO ] [REMOTE    ] RVLV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:55:59.148729] [INFO ] [REMOTE    ] RSI: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T20:55:59.347686] [INFO ] [REMOTE    ] RVLV: Fetching primary data for 2025-01.
[2025-10-24T20:56:00.006208] [INFO ] [REMOTE    ] RTX: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T20:56:00.076369] [INFO ] [REMOTE    ] RVLV: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T20:56:00.147606] [INFO ] [REMOTE    ] RVLV: Fetching primary data for 2025-02.
[2025-10-24T20:56:00.947620] [INFO ] [REMOTE    ] RTX: Fetching primary data for 2025-04.
[2025-10-24T20:56:01.263694] [INFO ] [REMOTE    ] RVLV: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T20:56:01.747726] [INFO ] [REMOTE    ] RVLV: Fetching primary data for 2025-03.
[2025-10-24T20:56:01.893003] [INFO ] [REMOTE    ] RTX: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T20:56:02.500218] [INFO ] [REMOTE    ] RVLV: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T20:56:02.547610] [INFO ] [REMOTE    ] RVLV: Fetching primary data for 2025-04.
[2025-10-24T20:56:03.321775] [INFO ] [REMOTE    ] RVLV: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T20:56:03.347609] [INFO ] [REMOTE    ] RVLV: Fetching primary data for 2025-05.
[2025-10-24T20:56:04.147677] [INFO ] [REMOTE    ] RSI: Fetching primary data for 2025-10.
[2025-10-24T20:56:04.527983] [INFO ] [REMOTE    ] RVLV: Incremental fetch complete for 2025-05 (1.18 seconds).
[2025-10-24T20:56:04.947723] [INFO ] [REMOTE    ] RVLV: Fetching primary data for 2025-06.
[2025-10-24T20:56:05.257818] [INFO ] [REMOTE    ] RSI: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T20:56:05.266734] [INFO ] [REMOTE    ] RSI: Full fetch complete (69360 records).
[2025-10-24T20:56:05.266874] [DEBUG] [VALIDATOR ] RSI: Validating primary data.
[2025-10-24T20:56:05.267744] [FATAL] [VALIDATOR ] RSI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:56:05.267842] [FATAL] [MAIN      ] RSI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:56:05.267915] [WARN ] [MAIN      ] RSI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:56:05.267977] [INFO ] [LOCAL     ] RSI: Starting deletion of primary data.
[2025-10-24T20:56:05.268040] [DEBUG] [LOCAL     ] RSI: No primary data file found to delete.
[2025-10-24T20:56:05.268078] [INFO ] [LOCAL     ] RSI: Starting deletion of derivative data.
[2025-10-24T20:56:05.268271] [DEBUG] [LOCAL     ] RSI: Deleted derivative data file.
[2025-10-24T20:56:05.268535] [INFO ] [MAIN      ] Update Progress: 1835/2366 symbols completed. RSI took 34.1s. Estimated remaining: 1h 8m 18s. Rate: 7.8 symbols/min
[2025-10-24T20:56:05.468679] [INFO ] [MAIN      ] RVT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:56:05.496156] [DEBUG] [LOCAL     ] RVT: Loaded 26270 existing records from primary storage.
[2025-10-24T20:56:05.496419] [INFO ] [MAIN      ] RVT: Loaded 26270 existing records.
[2025-10-24T20:56:05.679015] [WARN ] [MAIN      ] RVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:56:05.679467] [INFO ] [MAIN      ] RVT: Wiping existing primary data before full refresh.
[2025-10-24T20:56:05.679604] [INFO ] [LOCAL     ] RVT: Starting deletion of primary data.
[2025-10-24T20:56:05.680203] [DEBUG] [LOCAL     ] RVT: Deleted primary data file.
[2025-10-24T20:56:05.680364] [INFO ] [MAIN      ] RVT: Starting full primary refresh.
[2025-10-24T20:56:05.749775] [INFO ] [REMOTE    ] RTO: Fetching primary data for 2025-06.
[2025-10-24T20:56:05.964914] [INFO ] [REMOTE    ] RVLV: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T20:56:06.075907] [INFO ] [REMOTE    ] RVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:56:06.547665] [INFO ] [REMOTE    ] RVLV: Fetching primary data for 2025-07.
[2025-10-24T20:56:06.621499] [INFO ] [REMOTE    ] RTO: Incremental fetch complete for 2025-06 (0.87 seconds).
[2025-10-24T20:56:06.931088] [INFO ] [REMOTE    ] RVLV: Incremental fetch complete for 2025-07 (0.38 seconds).
[2025-10-24T20:56:07.347708] [INFO ] [REMOTE    ] RTO: Fetching primary data for 2025-07.
[2025-10-24T20:56:08.147733] [INFO ] [REMOTE    ] RTX: Fetching primary data for 2025-05.
[2025-10-24T20:56:08.693128] [INFO ] [REMOTE    ] RTO: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T20:56:08.843773] [INFO ] [REMOTE    ] RTX: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T20:56:08.947752] [INFO ] [REMOTE    ] RTO: Fetching primary data for 2025-08.
[2025-10-24T20:56:09.747636] [INFO ] [REMOTE    ] RVLV: Fetching primary data for 2025-08.
[2025-10-24T20:56:09.987050] [INFO ] [REMOTE    ] RTO: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T20:56:10.533781] [INFO ] [REMOTE    ] RVLV: Incremental fetch complete for 2025-08 (0.79 seconds).
[2025-10-24T20:56:10.547604] [INFO ] [REMOTE    ] RVLV: Fetching primary data for 2025-09.
[2025-10-24T20:56:11.279542] [INFO ] [REMOTE    ] RVLV: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T20:56:11.347698] [INFO ] [REMOTE    ] RTX: Fetching primary data for 2025-06.
[2025-10-24T20:56:12.145421] [INFO ] [REMOTE    ] RTX: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T20:56:12.155295] [INFO ] [REMOTE    ] RVLV: Fetching primary data for 2025-10.
[2025-10-24T20:56:12.947724] [INFO ] [REMOTE    ] RVT: Fetching primary data for 2025-01.
[2025-10-24T20:56:12.991883] [INFO ] [REMOTE    ] RVLV: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T20:56:13.000358] [INFO ] [REMOTE    ] RVLV: Full fetch complete (68619 records).
[2025-10-24T20:56:13.000529] [DEBUG] [VALIDATOR ] RVLV: Validating primary data.
[2025-10-24T20:56:13.001525] [FATAL] [VALIDATOR ] RVLV: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:56:13.001627] [FATAL] [MAIN      ] RVLV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:56:13.001722] [WARN ] [MAIN      ] RVLV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:56:13.001802] [INFO ] [LOCAL     ] RVLV: Starting deletion of primary data.
[2025-10-24T20:56:13.001879] [DEBUG] [LOCAL     ] RVLV: No primary data file found to delete.
[2025-10-24T20:56:13.001929] [INFO ] [LOCAL     ] RVLV: Starting deletion of derivative data.
[2025-10-24T20:56:13.002116] [DEBUG] [LOCAL     ] RVLV: Deleted derivative data file.
[2025-10-24T20:56:13.002389] [INFO ] [MAIN      ] Update Progress: 1836/2366 symbols completed. RVLV took 15.2s. Estimated remaining: 1h 8m 10s. Rate: 7.8 symbols/min
[2025-10-24T20:56:13.231078] [INFO ] [MAIN      ] RVTY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:56:13.285024] [DEBUG] [LOCAL     ] RVTY: Loaded 48134 existing records from primary storage.
[2025-10-24T20:56:13.285352] [INFO ] [MAIN      ] RVTY: Loaded 48134 existing records.
[2025-10-24T20:56:13.572689] [WARN ] [MAIN      ] RVTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:56:13.573222] [INFO ] [MAIN      ] RVTY: Wiping existing primary data before full refresh.
[2025-10-24T20:56:13.573479] [INFO ] [LOCAL     ] RVTY: Starting deletion of primary data.
[2025-10-24T20:56:13.583133] [DEBUG] [LOCAL     ] RVTY: Deleted primary data file.
[2025-10-24T20:56:13.599704] [INFO ] [MAIN      ] RVTY: Starting full primary refresh.
[2025-10-24T20:56:13.636396] [INFO ] [REMOTE    ] RVT: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T20:56:13.752788] [INFO ] [REMOTE    ] RVT: Fetching primary data for 2025-02.
[2025-10-24T20:56:14.072894] [INFO ] [REMOTE    ] RVTY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:56:14.547701] [INFO ] [REMOTE    ] RVTY: Fetching primary data for 2025-01.
[2025-10-24T20:56:14.769038] [INFO ] [REMOTE    ] RVT: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T20:56:15.347625] [INFO ] [REMOTE    ] RTO: Fetching primary data for 2025-09.
[2025-10-24T20:56:15.712077] [INFO ] [REMOTE    ] RVTY: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T20:56:16.147682] [INFO ] [REMOTE    ] RVTY: Fetching primary data for 2025-02.
[2025-10-24T20:56:16.764965] [INFO ] [REMOTE    ] RTO: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T20:56:16.947687] [INFO ] [REMOTE    ] RTO: Fetching primary data for 2025-10.
[2025-10-24T20:56:17.569462] [INFO ] [REMOTE    ] RVTY: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T20:56:17.636472] [INFO ] [REMOTE    ] RTO: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T20:56:17.643708] [INFO ] [REMOTE    ] RTO: Full fetch complete (58626 records).
[2025-10-24T20:56:17.643826] [DEBUG] [VALIDATOR ] RTO: Validating primary data.
[2025-10-24T20:56:17.644443] [FATAL] [VALIDATOR ] RTO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:56:17.644541] [FATAL] [MAIN      ] RTO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:56:17.644614] [WARN ] [MAIN      ] RTO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:56:17.644724] [INFO ] [LOCAL     ] RTO: Starting deletion of primary data.
[2025-10-24T20:56:17.644794] [DEBUG] [LOCAL     ] RTO: No primary data file found to delete.
[2025-10-24T20:56:17.644831] [INFO ] [LOCAL     ] RTO: Starting deletion of derivative data.
[2025-10-24T20:56:17.644984] [DEBUG] [LOCAL     ] RTO: Deleted derivative data file.
[2025-10-24T20:56:17.645071] [INFO ] [MAIN      ] Update Progress: 1837/2366 symbols completed. RTO took 40.3s. Estimated remaining: 1h 8m 2s. Rate: 7.8 symbols/min
[2025-10-24T20:56:17.747603] [INFO ] [REMOTE    ] RVT: Fetching primary data for 2025-03.
[2025-10-24T20:56:18.432787] [INFO ] [REMOTE    ] RVT: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T20:56:18.547611] [INFO ] [REMOTE    ] RVTY: Fetching primary data for 2025-03.
[2025-10-24T20:56:19.347609] [INFO ] [REMOTE    ] RTX: Fetching primary data for 2025-07.
[2025-10-24T20:56:19.771377] [INFO ] [REMOTE    ] RVTY: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T20:56:20.147616] [INFO ] [REMOTE    ] RVT: Fetching primary data for 2025-04.
[2025-10-24T20:56:20.188324] [INFO ] [REMOTE    ] RTX: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T20:56:20.947621] [INFO ] [REMOTE    ] RTX: Fetching primary data for 2025-08.
[2025-10-24T20:56:21.002982] [INFO ] [REMOTE    ] RVT: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T20:56:21.747701] [INFO ] [REMOTE    ] RVT: Fetching primary data for 2025-05.
[2025-10-24T20:56:22.185469] [INFO ] [REMOTE    ] RTX: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T20:56:22.240112] [INFO ] [REMOTE    ] RVT: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T20:56:22.547624] [INFO ] [REMOTE    ] RVTY: Fetching primary data for 2025-04.
[2025-10-24T20:56:23.347692] [INFO ] [REMOTE    ] RVT: Fetching primary data for 2025-06.
[2025-10-24T20:56:24.147737] [INFO ] [REMOTE    ] RTX: Fetching primary data for 2025-09.
[2025-10-24T20:56:24.238753] [INFO ] [REMOTE    ] RVTY: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T20:56:24.492671] [INFO ] [REMOTE    ] RVT: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T20:56:24.958291] [INFO ] [REMOTE    ] RVT: Fetching primary data for 2025-07.
[2025-10-24T20:56:24.963927] [INFO ] [REMOTE    ] RTX: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T20:56:25.731886] [INFO ] [REMOTE    ] RVT: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T20:56:25.747602] [INFO ] [REMOTE    ] RVT: Fetching primary data for 2025-08.
[2025-10-24T20:56:26.547695] [INFO ] [REMOTE    ] RVTY: Fetching primary data for 2025-05.
[2025-10-24T20:56:26.690618] [INFO ] [REMOTE    ] RVT: Incremental fetch complete for 2025-08 (0.94 seconds).
[2025-10-24T20:56:27.347714] [INFO ] [REMOTE    ] RVT: Fetching primary data for 2025-09.
[2025-10-24T20:56:27.567824] [INFO ] [REMOTE    ] RVTY: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T20:56:27.987896] [INFO ] [REMOTE    ] RVT: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T20:56:28.147607] [INFO ] [REMOTE    ] RVT: Fetching primary data for 2025-10.
[2025-10-24T20:56:28.947615] [INFO ] [REMOTE    ] RTX: Fetching primary data for 2025-10.
[2025-10-24T20:56:29.210510] [INFO ] [REMOTE    ] RVT: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T20:56:29.214961] [INFO ] [REMOTE    ] RVT: Full fetch complete (38888 records).
[2025-10-24T20:56:29.215038] [DEBUG] [VALIDATOR ] RVT: Validating primary data.
[2025-10-24T20:56:29.215795] [FATAL] [VALIDATOR ] RVT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:56:29.215880] [FATAL] [MAIN      ] RVT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:56:29.215923] [WARN ] [MAIN      ] RVT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:56:29.215960] [INFO ] [LOCAL     ] RVT: Starting deletion of primary data.
[2025-10-24T20:56:29.216014] [DEBUG] [LOCAL     ] RVT: No primary data file found to delete.
[2025-10-24T20:56:29.216049] [INFO ] [LOCAL     ] RVT: Starting deletion of derivative data.
[2025-10-24T20:56:29.216214] [DEBUG] [LOCAL     ] RVT: Deleted derivative data file.
[2025-10-24T20:56:29.216296] [INFO ] [MAIN      ] Update Progress: 1838/2366 symbols completed. RVT took 23.9s. Estimated remaining: 1h 7m 55s. Rate: 7.8 symbols/min
[2025-10-24T20:56:29.747621] [INFO ] [REMOTE    ] RVTY: Fetching primary data for 2025-06.
[2025-10-24T20:56:30.035953] [INFO ] [REMOTE    ] RTX: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T20:56:30.045364] [INFO ] [REMOTE    ] RTX: Full fetch complete (77488 records).
[2025-10-24T20:56:30.045493] [DEBUG] [VALIDATOR ] RTX: Validating primary data.
[2025-10-24T20:56:30.046263] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:56:30.046350] [FATAL] [MAIN      ] RTX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:56:30.046394] [WARN ] [MAIN      ] RTX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:56:30.046431] [INFO ] [LOCAL     ] RTX: Starting deletion of primary data.
[2025-10-24T20:56:30.046484] [DEBUG] [LOCAL     ] RTX: No primary data file found to delete.
[2025-10-24T20:56:30.046518] [INFO ] [LOCAL     ] RTX: Starting deletion of derivative data.
[2025-10-24T20:56:30.046706] [DEBUG] [LOCAL     ] RTX: Deleted derivative data file.
[2025-10-24T20:56:30.046955] [INFO ] [MAIN      ] Update Progress: 1839/2366 symbols completed. RTX took 44.3s. Estimated remaining: 1h 7m 46s. Rate: 7.8 symbols/min
[2025-10-24T20:56:30.689045] [INFO ] [REMOTE    ] RVTY: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T20:56:30.698684] [INFO ] [REMOTE    ] RVTY: Fetching primary data for 2025-07.
[2025-10-24T20:56:31.598386] [INFO ] [REMOTE    ] RVTY: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T20:56:31.609560] [INFO ] [REMOTE    ] RVTY: Fetching primary data for 2025-08.
[2025-10-24T20:56:32.531028] [INFO ] [REMOTE    ] RVTY: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T20:56:32.541428] [INFO ] [REMOTE    ] RVTY: Fetching primary data for 2025-09.
[2025-10-24T20:56:33.569847] [INFO ] [REMOTE    ] RVTY: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T20:56:33.580207] [INFO ] [REMOTE    ] RVTY: Fetching primary data for 2025-10.
[2025-10-24T20:56:34.885364] [INFO ] [REMOTE    ] RVTY: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T20:56:34.894339] [INFO ] [REMOTE    ] RVTY: Full fetch complete (67848 records).
[2025-10-24T20:56:34.894476] [DEBUG] [VALIDATOR ] RVTY: Validating primary data.
[2025-10-24T20:56:34.896202] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:56:34.896310] [FATAL] [MAIN      ] RVTY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:56:34.896357] [WARN ] [MAIN      ] RVTY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:56:34.896434] [INFO ] [LOCAL     ] RVTY: Starting deletion of primary data.
[2025-10-24T20:56:34.896510] [DEBUG] [LOCAL     ] RVTY: No primary data file found to delete.
[2025-10-24T20:56:34.896558] [INFO ] [LOCAL     ] RVTY: Starting deletion of derivative data.
[2025-10-24T20:56:34.896763] [DEBUG] [LOCAL     ] RVTY: Deleted derivative data file.
[2025-10-24T20:56:34.897274] [INFO ] [MAIN      ] Update Progress: 1840/2366 symbols completed. RVTY took 21.9s. Estimated remaining: 1h 7m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:56:35.479752] [INFO ] [MAIN      ] RWTO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:56:35.520023] [DEBUG] [LOCAL     ] RWTO: No existing data file found in primary storage.
[2025-10-24T20:56:35.543061] [WARN ] [MAIN      ] RWTO: No existing data found, performing full refresh instead.
[2025-10-24T20:56:35.573762] [INFO ] [MAIN      ] RWT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:56:35.593112] [INFO ] [MAIN      ] RWTN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:56:35.611880] [DEBUG] [LOCAL     ] RWTN: No existing data file found in primary storage.
[2025-10-24T20:56:35.611638] [INFO ] [MAIN      ] RWTO: Wiping existing primary data before full refresh.
[2025-10-24T20:56:35.612059] [WARN ] [MAIN      ] RWTN: No existing data found, performing full refresh instead.
[2025-10-24T20:56:35.612227] [INFO ] [MAIN      ] RWTN: Wiping existing primary data before full refresh.
[2025-10-24T20:56:35.612300] [INFO ] [LOCAL     ] RWTN: Starting deletion of primary data.
[2025-10-24T20:56:35.612361] [INFO ] [LOCAL     ] RWTO: Starting deletion of primary data.
[2025-10-24T20:56:35.611576] [INFO ] [MAIN      ] RWTP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:56:35.612711] [DEBUG] [LOCAL     ] RWTO: No primary data file found to delete.
[2025-10-24T20:56:35.612531] [DEBUG] [LOCAL     ] RWTN: No primary data file found to delete.
[2025-10-24T20:56:35.612977] [INFO ] [MAIN      ] RWTN: Starting full primary refresh.
[2025-10-24T20:56:35.612859] [INFO ] [MAIN      ] RWTO: Starting full primary refresh.
[2025-10-24T20:56:35.612619] [DEBUG] [LOCAL     ] RWTP: No existing data file found in primary storage.
[2025-10-24T20:56:35.662762] [WARN ] [MAIN      ] RWTP: No existing data found, performing full refresh instead.
[2025-10-24T20:56:35.702292] [INFO ] [MAIN      ] RWTP: Wiping existing primary data before full refresh.
[2025-10-24T20:56:35.783234] [INFO ] [LOCAL     ] RWTP: Starting deletion of primary data.
[2025-10-24T20:56:35.822501] [DEBUG] [LOCAL     ] RWTP: No primary data file found to delete.
[2025-10-24T20:56:35.855346] [INFO ] [MAIN      ] RWTP: Starting full primary refresh.
[2025-10-24T20:56:36.073977] [DEBUG] [LOCAL     ] RWT: Loaded 40660 existing records from primary storage.
[2025-10-24T20:56:36.118521] [INFO ] [MAIN      ] RWT: Loaded 40660 existing records.
[2025-10-24T20:56:36.725047] [INFO ] [REMOTE    ] RWTO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:56:36.767153] [INFO ] [REMOTE    ] RWTO: Fetching primary data for 2025-01.
[2025-10-24T20:56:36.890246] [INFO ] [REMOTE    ] RWTN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:56:36.946556] [WARN ] [MAIN      ] RWT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:56:36.938387] [INFO ] [REMOTE    ] RWTN: Fetching primary data for 2025-01.
[2025-10-24T20:56:36.997862] [INFO ] [MAIN      ] RWT: Wiping existing primary data before full refresh.
[2025-10-24T20:56:36.998983] [INFO ] [LOCAL     ] RWT: Starting deletion of primary data.
[2025-10-24T20:56:37.002762] [INFO ] [REMOTE    ] RWTP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:56:37.003160] [INFO ] [REMOTE    ] RWTP: Fetching primary data for 2025-01.
[2025-10-24T20:56:37.004010] [DEBUG] [LOCAL     ] RWT: Deleted primary data file.
[2025-10-24T20:56:37.004071] [INFO ] [MAIN      ] RWT: Starting full primary refresh.
[2025-10-24T20:56:37.291692] [INFO ] [REMOTE    ] RWTO: Incremental fetch complete for 2025-01 (0.52 seconds).
[2025-10-24T20:56:37.309146] [INFO ] [REMOTE    ] RWTO: Fetching primary data for 2025-02.
[2025-10-24T20:56:37.366853] [INFO ] [REMOTE    ] RWT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:56:37.367125] [INFO ] [REMOTE    ] RWT: Fetching primary data for 2025-01.
[2025-10-24T20:56:37.739358] [INFO ] [REMOTE    ] RWTN: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T20:56:37.747595] [INFO ] [REMOTE    ] RWTN: Fetching primary data for 2025-02.
[2025-10-24T20:56:37.923397] [INFO ] [REMOTE    ] RWTP: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T20:56:38.113929] [INFO ] [REMOTE    ] RWTO: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T20:56:38.289719] [INFO ] [REMOTE    ] RWTN: Incremental fetch complete for 2025-02 (0.54 seconds).
[2025-10-24T20:56:38.510913] [INFO ] [REMOTE    ] RWT: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T20:56:38.547598] [INFO ] [REMOTE    ] RWT: Fetching primary data for 2025-02.
[2025-10-24T20:56:39.352727] [INFO ] [REMOTE    ] RWTN: Fetching primary data for 2025-03.
[2025-10-24T20:56:39.355224] [INFO ] [REMOTE    ] RWT: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T20:56:39.905321] [INFO ] [REMOTE    ] RWTN: Incremental fetch complete for 2025-03 (0.55 seconds).
[2025-10-24T20:56:40.147673] [INFO ] [REMOTE    ] RWTP: Fetching primary data for 2025-02.
[2025-10-24T20:56:40.870721] [INFO ] [REMOTE    ] RWTP: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:56:40.947618] [INFO ] [REMOTE    ] RWTP: Fetching primary data for 2025-03.
[2025-10-24T20:56:41.737415] [INFO ] [REMOTE    ] RWTP: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T20:56:41.747591] [INFO ] [REMOTE    ] RWTP: Fetching primary data for 2025-04.
[2025-10-24T20:56:42.125035] [INFO ] [REMOTE    ] RWTP: Incremental fetch complete for 2025-04 (0.38 seconds).
[2025-10-24T20:56:42.547683] [INFO ] [REMOTE    ] RWTN: Fetching primary data for 2025-04.
[2025-10-24T20:56:43.099022] [INFO ] [REMOTE    ] RWTN: Incremental fetch complete for 2025-04 (0.55 seconds).
[2025-10-24T20:56:43.347689] [INFO ] [REMOTE    ] RWTO: Fetching primary data for 2025-03.
[2025-10-24T20:56:43.970775] [INFO ] [REMOTE    ] RWTO: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T20:56:44.147622] [INFO ] [REMOTE    ] RWTN: Fetching primary data for 2025-05.
[2025-10-24T20:56:44.701153] [INFO ] [REMOTE    ] RWTN: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T20:56:44.947706] [INFO ] [REMOTE    ] RWT: Fetching primary data for 2025-03.
[2025-10-24T20:56:45.656857] [INFO ] [REMOTE    ] RWT: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T20:56:45.747623] [INFO ] [REMOTE    ] RWT: Fetching primary data for 2025-04.
[2025-10-24T20:56:46.529243] [INFO ] [REMOTE    ] RWT: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:56:46.547604] [INFO ] [REMOTE    ] RWT: Fetching primary data for 2025-05.
[2025-10-24T20:56:47.307731] [INFO ] [REMOTE    ] RWT: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T20:56:47.347610] [INFO ] [REMOTE    ] RWT: Fetching primary data for 2025-06.
[2025-10-24T20:56:48.147627] [INFO ] [REMOTE    ] RWTP: Fetching primary data for 2025-05.
[2025-10-24T20:56:48.208077] [INFO ] [REMOTE    ] RWT: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T20:56:48.718767] [INFO ] [REMOTE    ] RWTP: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T20:56:48.947624] [INFO ] [REMOTE    ] RWT: Fetching primary data for 2025-07.
[2025-10-24T20:56:49.677224] [INFO ] [REMOTE    ] RWT: Incremental fetch complete for 2025-07 (0.73 seconds).
[2025-10-24T20:56:49.747610] [INFO ] [REMOTE    ] RWT: Fetching primary data for 2025-08.
[2025-10-24T20:56:50.547713] [INFO ] [REMOTE    ] RWTN: Fetching primary data for 2025-06.
[2025-10-24T20:56:50.753620] [INFO ] [REMOTE    ] RWTN: Incremental fetch complete for 2025-06 (0.21 seconds).
[2025-10-24T20:56:50.845166] [INFO ] [REMOTE    ] RWT: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T20:56:51.347698] [INFO ] [REMOTE    ] RWTP: Fetching primary data for 2025-06.
[2025-10-24T20:56:51.631860] [INFO ] [REMOTE    ] RWTP: Incremental fetch complete for 2025-06 (0.28 seconds).
[2025-10-24T20:56:52.147662] [INFO ] [REMOTE    ] RWTP: Fetching primary data for 2025-07.
[2025-10-24T20:56:52.697230] [INFO ] [REMOTE    ] RWTP: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T20:56:52.947665] [INFO ] [REMOTE    ] RWTN: Fetching primary data for 2025-07.
[2025-10-24T20:56:53.153740] [INFO ] [REMOTE    ] RWTN: Incremental fetch complete for 2025-07 (0.21 seconds).
[2025-10-24T20:56:53.747712] [INFO ] [REMOTE    ] RWT: Fetching primary data for 2025-09.
[2025-10-24T20:56:54.485583] [INFO ] [REMOTE    ] RWT: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T20:56:54.547613] [INFO ] [REMOTE    ] RWT: Fetching primary data for 2025-10.
[2025-10-24T20:56:55.347625] [INFO ] [REMOTE    ] RWTN: Fetching primary data for 2025-08.
[2025-10-24T20:56:55.743513] [INFO ] [REMOTE    ] RWT: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T20:56:55.747677] [INFO ] [REMOTE    ] RWTN: Incremental fetch complete for 2025-08 (0.40 seconds).
[2025-10-24T20:56:55.755806] [INFO ] [REMOTE    ] RWT: Full fetch complete (57791 records).
[2025-10-24T20:56:55.755894] [DEBUG] [VALIDATOR ] RWT: Validating primary data.
[2025-10-24T20:56:55.756513] [FATAL] [VALIDATOR ] RWT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:56:55.756594] [FATAL] [MAIN      ] RWT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:56:55.756636] [WARN ] [MAIN      ] RWT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:56:55.756728] [INFO ] [LOCAL     ] RWT: Starting deletion of primary data.
[2025-10-24T20:56:55.756827] [DEBUG] [LOCAL     ] RWT: No primary data file found to delete.
[2025-10-24T20:56:55.756868] [INFO ] [LOCAL     ] RWT: Starting deletion of derivative data.
[2025-10-24T20:56:55.757011] [DEBUG] [LOCAL     ] RWT: Deleted derivative data file.
[2025-10-24T20:56:55.757188] [INFO ] [MAIN      ] Update Progress: 1841/2366 symbols completed. RWT took 20.8s. Estimated remaining: 1h 7m 33s. Rate: 7.8 symbols/min
[2025-10-24T20:56:55.922623] [INFO ] [MAIN      ] RXO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:56:55.969414] [DEBUG] [LOCAL     ] RXO: Loaded 48829 existing records from primary storage.
[2025-10-24T20:56:55.969734] [INFO ] [MAIN      ] RXO: Loaded 48829 existing records.
[2025-10-24T20:56:56.145588] [WARN ] [MAIN      ] RXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:56:56.145830] [INFO ] [MAIN      ] RXO: Wiping existing primary data before full refresh.
[2025-10-24T20:56:56.145888] [INFO ] [LOCAL     ] RXO: Starting deletion of primary data.
[2025-10-24T20:56:56.146348] [DEBUG] [LOCAL     ] RXO: Deleted primary data file.
[2025-10-24T20:56:56.146402] [INFO ] [MAIN      ] RXO: Starting full primary refresh.
[2025-10-24T20:56:56.157312] [INFO ] [REMOTE    ] RWTO: Fetching primary data for 2025-04.
[2025-10-24T20:56:56.497837] [INFO ] [REMOTE    ] RXO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:56:56.527193] [INFO ] [REMOTE    ] RWTO: Incremental fetch complete for 2025-04 (0.37 seconds).
[2025-10-24T20:56:56.947629] [INFO ] [REMOTE    ] RWTN: Fetching primary data for 2025-09.
[2025-10-24T20:56:57.243900] [INFO ] [REMOTE    ] RWTN: Incremental fetch complete for 2025-09 (0.30 seconds).
[2025-10-24T20:56:57.747633] [INFO ] [REMOTE    ] RWTN: Fetching primary data for 2025-10.
[2025-10-24T20:56:58.036739] [INFO ] [REMOTE    ] RWTN: Incremental fetch complete for 2025-10 (0.29 seconds).
[2025-10-24T20:56:58.037628] [INFO ] [REMOTE    ] RWTN: Full fetch complete (3165 records).
[2025-10-24T20:56:58.037743] [DEBUG] [VALIDATOR ] RWTN: Validating primary data.
[2025-10-24T20:56:58.038141] [FATAL] [VALIDATOR ] RWTN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:56:58.038224] [FATAL] [MAIN      ] RWTN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:56:58.038266] [WARN ] [MAIN      ] RWTN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:56:58.038303] [INFO ] [LOCAL     ] RWTN: Starting deletion of primary data.
[2025-10-24T20:56:58.038357] [DEBUG] [LOCAL     ] RWTN: No primary data file found to delete.
[2025-10-24T20:56:58.038389] [INFO ] [LOCAL     ] RWTN: Starting deletion of derivative data.
[2025-10-24T20:56:58.038426] [DEBUG] [LOCAL     ] RWTN: No derivative data file found to delete.
[2025-10-24T20:56:58.038485] [INFO ] [MAIN      ] Update Progress: 1842/2366 symbols completed. RWTN took 23.1s. Estimated remaining: 1h 7m 24s. Rate: 7.8 symbols/min
[2025-10-24T20:56:58.203132] [INFO ] [MAIN      ] RY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:56:58.203308] [DEBUG] [LOCAL     ] RY: No existing data file found in primary storage.
[2025-10-24T20:56:58.203344] [WARN ] [MAIN      ] RY: No existing data found, performing full refresh instead.
[2025-10-24T20:56:58.203451] [INFO ] [MAIN      ] RY: Wiping existing primary data before full refresh.
[2025-10-24T20:56:58.203492] [INFO ] [LOCAL     ] RY: Starting deletion of primary data.
[2025-10-24T20:56:58.203532] [DEBUG] [LOCAL     ] RY: No primary data file found to delete.
[2025-10-24T20:56:58.203563] [INFO ] [MAIN      ] RY: Starting full primary refresh.
[2025-10-24T20:56:58.552096] [INFO ] [REMOTE    ] RY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:56:58.548342] [INFO ] [REMOTE    ] RXO: Fetching primary data for 2025-01.
[2025-10-24T20:56:59.266894] [INFO ] [REMOTE    ] RXO: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T20:56:59.347680] [INFO ] [REMOTE    ] RY: Fetching primary data for 2025-01.
[2025-10-24T20:57:00.147697] [INFO ] [REMOTE    ] RXO: Fetching primary data for 2025-02.
[2025-10-24T20:57:00.285021] [INFO ] [REMOTE    ] RY: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T20:57:00.872335] [INFO ] [REMOTE    ] RXO: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T20:57:00.947753] [INFO ] [REMOTE    ] RWTP: Fetching primary data for 2025-08.
[2025-10-24T20:57:01.236998] [INFO ] [REMOTE    ] RWTP: Incremental fetch complete for 2025-08 (0.29 seconds).
[2025-10-24T20:57:01.747670] [INFO ] [REMOTE    ] RY: Fetching primary data for 2025-02.
[2025-10-24T20:57:02.551329] [INFO ] [REMOTE    ] RXO: Fetching primary data for 2025-03.
[2025-10-24T20:57:02.556148] [INFO ] [REMOTE    ] RY: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T20:57:03.291110] [INFO ] [REMOTE    ] RXO: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T20:57:03.347603] [INFO ] [REMOTE    ] RXO: Fetching primary data for 2025-04.
[2025-10-24T20:57:04.147681] [INFO ] [REMOTE    ] RWTO: Fetching primary data for 2025-05.
[2025-10-24T20:57:04.434173] [INFO ] [REMOTE    ] RXO: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T20:57:04.811871] [INFO ] [REMOTE    ] RWTO: Incremental fetch complete for 2025-05 (0.66 seconds).
[2025-10-24T20:57:04.947629] [INFO ] [REMOTE    ] RWTP: Fetching primary data for 2025-09.
[2025-10-24T20:57:05.325620] [INFO ] [REMOTE    ] RWTP: Incremental fetch complete for 2025-09 (0.38 seconds).
[2025-10-24T20:57:05.747671] [INFO ] [REMOTE    ] RXO: Fetching primary data for 2025-05.
[2025-10-24T20:57:06.547618] [INFO ] [REMOTE    ] RY: Fetching primary data for 2025-03.
[2025-10-24T20:57:06.807512] [INFO ] [REMOTE    ] RXO: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T20:57:07.347634] [INFO ] [REMOTE    ] RWTP: Fetching primary data for 2025-10.
[2025-10-24T20:57:07.350533] [INFO ] [REMOTE    ] RY: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T20:57:08.052711] [INFO ] [REMOTE    ] RWTP: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T20:57:08.053738] [INFO ] [REMOTE    ] RWTP: Full fetch complete (4699 records).
[2025-10-24T20:57:08.053817] [DEBUG] [VALIDATOR ] RWTP: Validating primary data.
[2025-10-24T20:57:08.054213] [FATAL] [VALIDATOR ] RWTP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:57:08.054300] [FATAL] [MAIN      ] RWTP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:57:08.054344] [WARN ] [MAIN      ] RWTP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:57:08.054409] [INFO ] [LOCAL     ] RWTP: Starting deletion of primary data.
[2025-10-24T20:57:08.054489] [DEBUG] [LOCAL     ] RWTP: No primary data file found to delete.
[2025-10-24T20:57:08.054534] [INFO ] [LOCAL     ] RWTP: Starting deletion of derivative data.
[2025-10-24T20:57:08.054588] [DEBUG] [LOCAL     ] RWTP: No derivative data file found to delete.
[2025-10-24T20:57:08.054702] [INFO ] [MAIN      ] Update Progress: 1843/2366 symbols completed. RWTP took 33.2s. Estimated remaining: 1h 7m 17s. Rate: 7.8 symbols/min
[2025-10-24T20:57:08.155752] [INFO ] [REMOTE    ] RY: Fetching primary data for 2025-04.
[2025-10-24T20:57:08.231082] [INFO ] [MAIN      ] RYAM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:57:08.264248] [DEBUG] [LOCAL     ] RYAM: Loaded 35289 existing records from primary storage.
[2025-10-24T20:57:08.264512] [INFO ] [MAIN      ] RYAM: Loaded 35289 existing records.
[2025-10-24T20:57:08.442229] [WARN ] [MAIN      ] RYAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:57:08.442455] [INFO ] [MAIN      ] RYAM: Wiping existing primary data before full refresh.
[2025-10-24T20:57:08.442520] [INFO ] [LOCAL     ] RYAM: Starting deletion of primary data.
[2025-10-24T20:57:08.442863] [DEBUG] [LOCAL     ] RYAM: Deleted primary data file.
[2025-10-24T20:57:08.442919] [INFO ] [MAIN      ] RYAM: Starting full primary refresh.
[2025-10-24T20:57:08.797908] [INFO ] [REMOTE    ] RYAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:57:08.947629] [INFO ] [REMOTE    ] RXO: Fetching primary data for 2025-06.
[2025-10-24T20:57:09.274518] [INFO ] [REMOTE    ] RY: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T20:57:09.665051] [INFO ] [REMOTE    ] RXO: Incremental fetch complete for 2025-06 (0.72 seconds).
[2025-10-24T20:57:09.747695] [INFO ] [REMOTE    ] RY: Fetching primary data for 2025-05.
[2025-10-24T20:57:10.517863] [INFO ] [REMOTE    ] RY: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T20:57:10.547608] [INFO ] [REMOTE    ] RY: Fetching primary data for 2025-06.
[2025-10-24T20:57:11.301229] [INFO ] [REMOTE    ] RY: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T20:57:11.347601] [INFO ] [REMOTE    ] RY: Fetching primary data for 2025-07.
[2025-10-24T20:57:12.147679] [INFO ] [REMOTE    ] RXO: Fetching primary data for 2025-07.
[2025-10-24T20:57:12.185536] [INFO ] [REMOTE    ] RY: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T20:57:12.947740] [INFO ] [REMOTE    ] RWTO: Fetching primary data for 2025-06.
[2025-10-24T20:57:13.409212] [INFO ] [REMOTE    ] RWTO: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T20:57:13.558661] [INFO ] [REMOTE    ] RXO: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T20:57:13.747665] [INFO ] [REMOTE    ] RWTO: Fetching primary data for 2025-07.
[2025-10-24T20:57:14.132306] [INFO ] [REMOTE    ] RWTO: Incremental fetch complete for 2025-07 (0.38 seconds).
[2025-10-24T20:57:14.547739] [INFO ] [REMOTE    ] RYAM: Fetching primary data for 2025-01.
[2025-10-24T20:57:15.347755] [INFO ] [REMOTE    ] RXO: Fetching primary data for 2025-08.
[2025-10-24T20:57:15.495341] [INFO ] [REMOTE    ] RYAM: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T20:57:16.106545] [INFO ] [REMOTE    ] RXO: Incremental fetch complete for 2025-08 (0.76 seconds).
[2025-10-24T20:57:16.147727] [INFO ] [REMOTE    ] RWTO: Fetching primary data for 2025-08.
[2025-10-24T20:57:16.524720] [INFO ] [REMOTE    ] RWTO: Incremental fetch complete for 2025-08 (0.38 seconds).
[2025-10-24T20:57:16.947744] [INFO ] [REMOTE    ] RXO: Fetching primary data for 2025-09.
[2025-10-24T20:57:17.747727] [INFO ] [REMOTE    ] RYAM: Fetching primary data for 2025-02.
[2025-10-24T20:57:17.868050] [INFO ] [REMOTE    ] RXO: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T20:57:18.547671] [INFO ] [REMOTE    ] RY: Fetching primary data for 2025-08.
[2025-10-24T20:57:18.963397] [INFO ] [REMOTE    ] RYAM: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T20:57:19.301863] [INFO ] [REMOTE    ] RY: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T20:57:19.347605] [INFO ] [REMOTE    ] RY: Fetching primary data for 2025-09.
[2025-10-24T20:57:20.147621] [INFO ] [REMOTE    ] RXO: Fetching primary data for 2025-10.
[2025-10-24T20:57:20.389675] [INFO ] [REMOTE    ] RY: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T20:57:20.947620] [INFO ] [REMOTE    ] RY: Fetching primary data for 2025-10.
[2025-10-24T20:57:21.195835] [INFO ] [REMOTE    ] RXO: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T20:57:21.204756] [INFO ] [REMOTE    ] RXO: Full fetch complete (68719 records).
[2025-10-24T20:57:21.204913] [DEBUG] [VALIDATOR ] RXO: Validating primary data.
[2025-10-24T20:57:21.205673] [FATAL] [VALIDATOR ] RXO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:57:21.205766] [FATAL] [MAIN      ] RXO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:57:21.205809] [WARN ] [MAIN      ] RXO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:57:21.205848] [INFO ] [LOCAL     ] RXO: Starting deletion of primary data.
[2025-10-24T20:57:21.205904] [DEBUG] [LOCAL     ] RXO: No primary data file found to delete.
[2025-10-24T20:57:21.205939] [INFO ] [LOCAL     ] RXO: Starting deletion of derivative data.
[2025-10-24T20:57:21.206124] [DEBUG] [LOCAL     ] RXO: Deleted derivative data file.
[2025-10-24T20:57:21.206458] [INFO ] [MAIN      ] Update Progress: 1844/2366 symbols completed. RXO took 25.4s. Estimated remaining: 1h 7m 11s. Rate: 7.8 symbols/min
[2025-10-24T20:57:21.383423] [INFO ] [MAIN      ] RYAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:57:21.429790] [DEBUG] [LOCAL     ] RYAN: Loaded 45325 existing records from primary storage.
[2025-10-24T20:57:21.430129] [INFO ] [MAIN      ] RYAN: Loaded 45325 existing records.
[2025-10-24T20:57:21.624007] [WARN ] [MAIN      ] RYAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:57:21.624218] [INFO ] [MAIN      ] RYAN: Wiping existing primary data before full refresh.
[2025-10-24T20:57:21.624283] [INFO ] [LOCAL     ] RYAN: Starting deletion of primary data.
[2025-10-24T20:57:21.624620] [DEBUG] [LOCAL     ] RYAN: Deleted primary data file.
[2025-10-24T20:57:21.624701] [INFO ] [MAIN      ] RYAN: Starting full primary refresh.
[2025-10-24T20:57:21.752785] [INFO ] [REMOTE    ] RYAM: Fetching primary data for 2025-03.
[2025-10-24T20:57:21.996606] [INFO ] [REMOTE    ] RYAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:57:22.547708] [INFO ] [REMOTE    ] RWTO: Fetching primary data for 2025-09.
[2025-10-24T20:57:22.576819] [INFO ] [REMOTE    ] RY: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T20:57:22.585204] [INFO ] [REMOTE    ] RY: Full fetch complete (69204 records).
[2025-10-24T20:57:22.585403] [DEBUG] [VALIDATOR ] RY: Validating primary data.
[2025-10-24T20:57:22.834787] [INFO ] [REMOTE    ] RWTO: Incremental fetch complete for 2025-09 (0.29 seconds).
[2025-10-24T20:57:22.937198] [INFO ] [REMOTE    ] RYAM: Incremental fetch complete for 2025-03 (1.18 seconds).
[2025-10-24T20:57:23.021335] [DEBUG] [VALIDATOR ] RY: All expected trading days are present.
[2025-10-24T20:57:23.021420] [DEBUG] [VALIDATOR ] RY: Primary data validation passed.
[2025-10-24T20:57:23.022530] [INFO ] [MAIN      ] RY: Fetched primary data is valid.
[2025-10-24T20:57:23.022593] [DEBUG] [LOCAL     ] RY: Saving primary data.
[2025-10-24T20:57:23.023201] [FATAL] [LOCAL     ] RY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T20:57:23.023287] [FATAL] [MAIN      ] RY: Failed to save primary data.
[2025-10-24T20:57:23.023328] [WARN ] [MAIN      ] RY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T20:57:23.023362] [INFO ] [LOCAL     ] RY: Starting deletion of primary data.
[2025-10-24T20:57:23.023415] [DEBUG] [LOCAL     ] RY: No primary data file found to delete.
[2025-10-24T20:57:23.023449] [INFO ] [LOCAL     ] RY: Starting deletion of derivative data.
[2025-10-24T20:57:23.023487] [DEBUG] [LOCAL     ] RY: No derivative data file found to delete.
[2025-10-24T20:57:23.023861] [INFO ] [MAIN      ] Update Progress: 1845/2366 symbols completed. RY took 25.0s. Estimated remaining: 1h 7m 1s. Rate: 7.8 symbols/min
[2025-10-24T20:57:23.198747] [INFO ] [MAIN      ] RYI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:57:23.220466] [DEBUG] [LOCAL     ] RYI: Loaded 21877 existing records from primary storage.
[2025-10-24T20:57:23.220738] [INFO ] [MAIN      ] RYI: Loaded 21877 existing records.
[2025-10-24T20:57:23.359130] [INFO ] [REMOTE    ] RWTO: Fetching primary data for 2025-10.
[2025-10-24T20:57:23.399037] [WARN ] [MAIN      ] RYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:57:23.399352] [INFO ] [MAIN      ] RYI: Wiping existing primary data before full refresh.
[2025-10-24T20:57:23.399401] [INFO ] [LOCAL     ] RYI: Starting deletion of primary data.
[2025-10-24T20:57:23.399621] [DEBUG] [LOCAL     ] RYI: Deleted primary data file.
[2025-10-24T20:57:23.399705] [INFO ] [MAIN      ] RYI: Starting full primary refresh.
[2025-10-24T20:57:23.746679] [INFO ] [REMOTE    ] RWTO: Incremental fetch complete for 2025-10 (0.39 seconds).
[2025-10-24T20:57:23.752214] [INFO ] [REMOTE    ] RYI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:57:23.754412] [INFO ] [REMOTE    ] RWTO: Full fetch complete (4812 records).
[2025-10-24T20:57:23.754574] [DEBUG] [VALIDATOR ] RWTO: Validating primary data.
[2025-10-24T20:57:23.755199] [FATAL] [VALIDATOR ] RWTO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:57:23.755297] [FATAL] [MAIN      ] RWTO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:57:23.755342] [WARN ] [MAIN      ] RWTO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:57:23.755417] [INFO ] [LOCAL     ] RWTO: Starting deletion of primary data.
[2025-10-24T20:57:23.755487] [DEBUG] [LOCAL     ] RWTO: No primary data file found to delete.
[2025-10-24T20:57:23.755527] [INFO ] [LOCAL     ] RWTO: Starting deletion of derivative data.
[2025-10-24T20:57:23.755624] [DEBUG] [LOCAL     ] RWTO: No derivative data file found to delete.
[2025-10-24T20:57:23.755743] [INFO ] [MAIN      ] Update Progress: 1846/2366 symbols completed. RWTO took 48.9s. Estimated remaining: 1h 6m 52s. Rate: 7.8 symbols/min
[2025-10-24T20:57:23.938520] [INFO ] [MAIN      ] RYN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:57:23.988757] [DEBUG] [LOCAL     ] RYN: Loaded 46088 existing records from primary storage.
[2025-10-24T20:57:23.989127] [INFO ] [MAIN      ] RYN: Loaded 46088 existing records.
[2025-10-24T20:57:24.152884] [INFO ] [REMOTE    ] RYI: Fetching primary data for 2025-01.
[2025-10-24T20:57:24.230083] [WARN ] [MAIN      ] RYN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:57:24.230296] [INFO ] [MAIN      ] RYN: Wiping existing primary data before full refresh.
[2025-10-24T20:57:24.230343] [INFO ] [LOCAL     ] RYN: Starting deletion of primary data.
[2025-10-24T20:57:24.230691] [DEBUG] [LOCAL     ] RYN: Deleted primary data file.
[2025-10-24T20:57:24.230747] [INFO ] [MAIN      ] RYN: Starting full primary refresh.
[2025-10-24T20:57:24.578041] [INFO ] [REMOTE    ] RYN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:57:24.947679] [INFO ] [REMOTE    ] RYN: Fetching primary data for 2025-01.
[2025-10-24T20:57:25.072847] [INFO ] [REMOTE    ] RYI: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T20:57:25.283107] [INFO ] [REMOTE    ] RYN: Incremental fetch complete for 2025-01 (0.34 seconds).
[2025-10-24T20:57:25.747669] [INFO ] [REMOTE    ] RYAM: Fetching primary data for 2025-04.
[2025-10-24T20:57:26.459729] [INFO ] [REMOTE    ] RYAM: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T20:57:26.547612] [INFO ] [REMOTE    ] RYAM: Fetching primary data for 2025-05.
[2025-10-24T20:57:27.347693] [INFO ] [REMOTE    ] RYI: Fetching primary data for 2025-02.
[2025-10-24T20:57:27.701862] [INFO ] [REMOTE    ] RYAM: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T20:57:27.865193] [INFO ] [REMOTE    ] RYI: Incremental fetch complete for 2025-02 (0.52 seconds).
[2025-10-24T20:57:28.147712] [INFO ] [REMOTE    ] RYAN: Fetching primary data for 2025-01.
[2025-10-24T20:57:28.898204] [INFO ] [REMOTE    ] RYAN: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T20:57:28.947604] [INFO ] [REMOTE    ] RYAN: Fetching primary data for 2025-02.
[2025-10-24T20:57:29.747680] [INFO ] [REMOTE    ] RYAM: Fetching primary data for 2025-06.
[2025-10-24T20:57:30.312586] [INFO ] [REMOTE    ] RYAN: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T20:57:30.487982] [INFO ] [REMOTE    ] RYAM: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T20:57:30.547611] [INFO ] [REMOTE    ] RYN: Fetching primary data for 2025-02.
[2025-10-24T20:57:31.347625] [INFO ] [REMOTE    ] RYI: Fetching primary data for 2025-03.
[2025-10-24T20:57:31.632445] [INFO ] [REMOTE    ] RYN: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T20:57:31.935634] [INFO ] [REMOTE    ] RYI: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T20:57:32.147609] [INFO ] [REMOTE    ] RYN: Fetching primary data for 2025-03.
[2025-10-24T20:57:32.902625] [INFO ] [REMOTE    ] RYN: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T20:57:32.947600] [INFO ] [REMOTE    ] RYI: Fetching primary data for 2025-04.
[2025-10-24T20:57:33.747613] [INFO ] [REMOTE    ] RYN: Fetching primary data for 2025-04.
[2025-10-24T20:57:33.793311] [INFO ] [REMOTE    ] RYI: Incremental fetch complete for 2025-04 (0.85 seconds).
[2025-10-24T20:57:34.502029] [INFO ] [REMOTE    ] RYN: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T20:57:34.547613] [INFO ] [REMOTE    ] RYN: Fetching primary data for 2025-05.
[2025-10-24T20:57:35.347625] [INFO ] [REMOTE    ] RYI: Fetching primary data for 2025-05.
[2025-10-24T20:57:35.829237] [INFO ] [REMOTE    ] RYN: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T20:57:36.147633] [INFO ] [REMOTE    ] RYAM: Fetching primary data for 2025-07.
[2025-10-24T20:57:36.162121] [INFO ] [REMOTE    ] RYI: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T20:57:36.947621] [INFO ] [REMOTE    ] RYN: Fetching primary data for 2025-06.
[2025-10-24T20:57:37.420034] [INFO ] [REMOTE    ] RYAM: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T20:57:37.716128] [INFO ] [REMOTE    ] RYN: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T20:57:37.747604] [INFO ] [REMOTE    ] RYN: Fetching primary data for 2025-07.
[2025-10-24T20:57:38.507716] [INFO ] [REMOTE    ] RYN: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T20:57:38.547614] [INFO ] [REMOTE    ] RYN: Fetching primary data for 2025-08.
[2025-10-24T20:57:39.294596] [INFO ] [REMOTE    ] RYN: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T20:57:39.347613] [INFO ] [REMOTE    ] RYN: Fetching primary data for 2025-09.
[2025-10-24T20:57:40.147666] [INFO ] [REMOTE    ] RYAN: Fetching primary data for 2025-03.
[2025-10-24T20:57:40.269995] [INFO ] [REMOTE    ] RYN: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T20:57:40.947709] [INFO ] [REMOTE    ] RYN: Fetching primary data for 2025-10.
[2025-10-24T20:57:41.333534] [INFO ] [REMOTE    ] RYAN: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T20:57:41.747631] [INFO ] [REMOTE    ] RYAN: Fetching primary data for 2025-04.
[2025-10-24T20:57:41.924706] [INFO ] [REMOTE    ] RYN: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T20:57:41.933128] [INFO ] [REMOTE    ] RYN: Full fetch complete (65514 records).
[2025-10-24T20:57:41.933277] [DEBUG] [VALIDATOR ] RYN: Validating primary data.
[2025-10-24T20:57:41.934079] [FATAL] [VALIDATOR ] RYN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:57:41.934169] [FATAL] [MAIN      ] RYN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:57:41.934213] [WARN ] [MAIN      ] RYN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:57:41.934276] [INFO ] [LOCAL     ] RYN: Starting deletion of primary data.
[2025-10-24T20:57:41.934340] [DEBUG] [LOCAL     ] RYN: No primary data file found to delete.
[2025-10-24T20:57:41.934377] [INFO ] [LOCAL     ] RYN: Starting deletion of derivative data.
[2025-10-24T20:57:41.934566] [DEBUG] [LOCAL     ] RYN: Deleted derivative data file.
[2025-10-24T20:57:41.934849] [INFO ] [MAIN      ] Update Progress: 1847/2366 symbols completed. RYN took 18.2s. Estimated remaining: 1h 6m 47s. Rate: 7.8 symbols/min
[2025-10-24T20:57:42.127321] [INFO ] [MAIN      ] RZB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:57:42.136347] [DEBUG] [LOCAL     ] RZB: Loaded 5912 existing records from primary storage.
[2025-10-24T20:57:42.136570] [INFO ] [MAIN      ] RZB: Loaded 5912 existing records.
[2025-10-24T20:57:42.320845] [WARN ] [MAIN      ] RZB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:57:42.321203] [INFO ] [MAIN      ] RZB: Wiping existing primary data before full refresh.
[2025-10-24T20:57:42.321369] [INFO ] [LOCAL     ] RZB: Starting deletion of primary data.
[2025-10-24T20:57:42.321744] [DEBUG] [LOCAL     ] RZB: Deleted primary data file.
[2025-10-24T20:57:42.321874] [INFO ] [MAIN      ] RZB: Starting full primary refresh.
[2025-10-24T20:57:42.552897] [INFO ] [REMOTE    ] RYAM: Fetching primary data for 2025-08.
[2025-10-24T20:57:42.695329] [INFO ] [REMOTE    ] RZB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:57:42.795251] [INFO ] [REMOTE    ] RYAN: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T20:57:43.347621] [INFO ] [REMOTE    ] RYAN: Fetching primary data for 2025-05.
[2025-10-24T20:57:43.668387] [INFO ] [REMOTE    ] RYAM: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T20:57:44.147611] [INFO ] [REMOTE    ] RYAM: Fetching primary data for 2025-09.
[2025-10-24T20:57:44.316095] [INFO ] [REMOTE    ] RYAN: Incremental fetch complete for 2025-05 (0.97 seconds).
[2025-10-24T20:57:44.947616] [INFO ] [REMOTE    ] RYAN: Fetching primary data for 2025-06.
[2025-10-24T20:57:45.015784] [INFO ] [REMOTE    ] RYAM: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T20:57:45.747618] [INFO ] [REMOTE    ] RYAM: Fetching primary data for 2025-10.
[2025-10-24T20:57:46.022609] [INFO ] [REMOTE    ] RYAN: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T20:57:46.547631] [INFO ] [REMOTE    ] RYI: Fetching primary data for 2025-06.
[2025-10-24T20:57:46.905998] [INFO ] [REMOTE    ] RYAM: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T20:57:46.912677] [INFO ] [REMOTE    ] RYAM: Full fetch complete (48976 records).
[2025-10-24T20:57:46.912793] [DEBUG] [VALIDATOR ] RYAM: Validating primary data.
[2025-10-24T20:57:46.913442] [FATAL] [VALIDATOR ] RYAM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:57:46.913543] [FATAL] [MAIN      ] RYAM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:57:46.913606] [WARN ] [MAIN      ] RYAM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:57:46.913708] [INFO ] [LOCAL     ] RYAM: Starting deletion of primary data.
[2025-10-24T20:57:46.913780] [DEBUG] [LOCAL     ] RYAM: No primary data file found to delete.
[2025-10-24T20:57:46.913818] [INFO ] [LOCAL     ] RYAM: Starting deletion of derivative data.
[2025-10-24T20:57:46.914113] [DEBUG] [LOCAL     ] RYAM: Deleted derivative data file.
[2025-10-24T20:57:46.914204] [INFO ] [MAIN      ] Update Progress: 1848/2366 symbols completed. RYAM took 38.9s. Estimated remaining: 1h 6m 38s. Rate: 7.8 symbols/min
[2025-10-24T20:57:47.104985] [INFO ] [MAIN      ] RZC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:57:47.115530] [DEBUG] [LOCAL     ] RZC: Loaded 6506 existing records from primary storage.
[2025-10-24T20:57:47.115880] [INFO ] [MAIN      ] RZC: Loaded 6506 existing records.
[2025-10-24T20:57:47.217797] [INFO ] [REMOTE    ] RYI: Incremental fetch complete for 2025-06 (0.67 seconds).
[2025-10-24T20:57:47.341294] [WARN ] [MAIN      ] RZC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:57:47.341570] [INFO ] [MAIN      ] RZC: Wiping existing primary data before full refresh.
[2025-10-24T20:57:47.341621] [INFO ] [LOCAL     ] RZC: Starting deletion of primary data.
[2025-10-24T20:57:47.341864] [DEBUG] [LOCAL     ] RZC: Deleted primary data file.
[2025-10-24T20:57:47.341921] [INFO ] [MAIN      ] RZC: Starting full primary refresh.
[2025-10-24T20:57:47.352807] [INFO ] [REMOTE    ] RYI: Fetching primary data for 2025-07.
[2025-10-24T20:57:47.691688] [INFO ] [REMOTE    ] RZC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:57:48.147676] [INFO ] [REMOTE    ] RYAN: Fetching primary data for 2025-07.
[2025-10-24T20:57:48.385131] [INFO ] [REMOTE    ] RYI: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T20:57:48.947724] [INFO ] [REMOTE    ] RYI: Fetching primary data for 2025-08.
[2025-10-24T20:57:49.256923] [INFO ] [REMOTE    ] RYAN: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T20:57:49.747698] [INFO ] [REMOTE    ] RZB: Fetching primary data for 2025-01.
[2025-10-24T20:57:49.789796] [INFO ] [REMOTE    ] RYI: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T20:57:50.126871] [INFO ] [REMOTE    ] RZB: Incremental fetch complete for 2025-01 (0.38 seconds).
[2025-10-24T20:57:50.547697] [INFO ] [REMOTE    ] RZB: Fetching primary data for 2025-02.
[2025-10-24T20:57:51.156368] [INFO ] [REMOTE    ] RZB: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T20:57:51.347668] [INFO ] [REMOTE    ] RZB: Fetching primary data for 2025-03.
[2025-10-24T20:57:52.066698] [INFO ] [REMOTE    ] RZB: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T20:57:52.147672] [INFO ] [REMOTE    ] RZC: Fetching primary data for 2025-01.
[2025-10-24T20:57:52.832632] [INFO ] [REMOTE    ] RZC: Incremental fetch complete for 2025-01 (0.68 seconds).
[2025-10-24T20:57:52.947719] [INFO ] [REMOTE    ] RYAN: Fetching primary data for 2025-08.
[2025-10-24T20:57:53.747766] [INFO ] [REMOTE    ] RZB: Fetching primary data for 2025-04.
[2025-10-24T20:57:54.120973] [INFO ] [REMOTE    ] RZB: Incremental fetch complete for 2025-04 (0.37 seconds).
[2025-10-24T20:57:54.547710] [INFO ] [REMOTE    ] RZB: Fetching primary data for 2025-05.
[2025-10-24T20:57:54.584933] [INFO ] [REMOTE    ] RYAN: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T20:57:54.920541] [INFO ] [REMOTE    ] RZB: Incremental fetch complete for 2025-05 (0.37 seconds).
[2025-10-24T20:57:55.347667] [INFO ] [REMOTE    ] RZC: Fetching primary data for 2025-02.
[2025-10-24T20:57:55.965595] [INFO ] [REMOTE    ] RZC: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T20:57:56.147760] [INFO ] [REMOTE    ] RZB: Fetching primary data for 2025-06.
[2025-10-24T20:57:56.947719] [INFO ] [REMOTE    ] RYAN: Fetching primary data for 2025-09.
[2025-10-24T20:57:56.995992] [INFO ] [REMOTE    ] RZB: Incremental fetch complete for 2025-06 (0.85 seconds).
[2025-10-24T20:57:57.698968] [INFO ] [REMOTE    ] RYAN: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T20:57:57.747604] [INFO ] [REMOTE    ] RYAN: Fetching primary data for 2025-10.
[2025-10-24T20:57:58.460721] [INFO ] [REMOTE    ] RYAN: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T20:57:58.469269] [INFO ] [REMOTE    ] RYAN: Full fetch complete (64612 records).
[2025-10-24T20:57:58.469414] [DEBUG] [VALIDATOR ] RYAN: Validating primary data.
[2025-10-24T20:57:58.471067] [FATAL] [VALIDATOR ] RYAN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:57:58.471154] [FATAL] [MAIN      ] RYAN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:57:58.471196] [WARN ] [MAIN      ] RYAN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:57:58.471241] [INFO ] [LOCAL     ] RYAN: Starting deletion of primary data.
[2025-10-24T20:57:58.471335] [DEBUG] [LOCAL     ] RYAN: No primary data file found to delete.
[2025-10-24T20:57:58.471407] [INFO ] [LOCAL     ] RYAN: Starting deletion of derivative data.
[2025-10-24T20:57:58.471610] [DEBUG] [LOCAL     ] RYAN: Deleted derivative data file.
[2025-10-24T20:57:58.472212] [INFO ] [MAIN      ] Update Progress: 1849/2366 symbols completed. RYAN took 37.3s. Estimated remaining: 1h 6m 32s. Rate: 7.8 symbols/min
[2025-10-24T20:57:58.552821] [INFO ] [REMOTE    ] RZB: Fetching primary data for 2025-07.
[2025-10-24T20:57:58.647217] [INFO ] [MAIN      ] S: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:57:58.699095] [DEBUG] [LOCAL     ] S: Loaded 53927 existing records from primary storage.
[2025-10-24T20:57:58.699390] [INFO ] [MAIN      ] S: Loaded 53927 existing records.
[2025-10-24T20:57:58.883208] [WARN ] [MAIN      ] S: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:57:58.883422] [INFO ] [MAIN      ] S: Wiping existing primary data before full refresh.
[2025-10-24T20:57:58.883487] [INFO ] [LOCAL     ] S: Starting deletion of primary data.
[2025-10-24T20:57:58.883704] [DEBUG] [LOCAL     ] S: Deleted primary data file.
[2025-10-24T20:57:58.883761] [INFO ] [MAIN      ] S: Starting full primary refresh.
[2025-10-24T20:57:58.996725] [INFO ] [REMOTE    ] RZB: Incremental fetch complete for 2025-07 (0.44 seconds).
[2025-10-24T20:57:59.247408] [INFO ] [REMOTE    ] S: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:57:59.347611] [INFO ] [REMOTE    ] RZC: Fetching primary data for 2025-03.
[2025-10-24T20:58:00.147632] [INFO ] [REMOTE    ] RZB: Fetching primary data for 2025-08.
[2025-10-24T20:58:00.376952] [INFO ] [REMOTE    ] RZC: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T20:58:00.554179] [INFO ] [REMOTE    ] RZB: Incremental fetch complete for 2025-08 (0.41 seconds).
[2025-10-24T20:58:00.947716] [INFO ] [REMOTE    ] S: Fetching primary data for 2025-01.
[2025-10-24T20:58:01.747722] [INFO ] [REMOTE    ] RYI: Fetching primary data for 2025-09.
[2025-10-24T20:58:01.787128] [INFO ] [REMOTE    ] S: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T20:58:02.547735] [INFO ] [REMOTE    ] RZC: Fetching primary data for 2025-04.
[2025-10-24T20:58:02.976147] [INFO ] [REMOTE    ] RYI: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T20:58:03.012144] [INFO ] [REMOTE    ] RZC: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T20:58:03.347710] [INFO ] [REMOTE    ] S: Fetching primary data for 2025-02.
[2025-10-24T20:58:04.099729] [INFO ] [REMOTE    ] S: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T20:58:04.147607] [INFO ] [REMOTE    ] S: Fetching primary data for 2025-03.
[2025-10-24T20:58:04.947677] [INFO ] [REMOTE    ] RZC: Fetching primary data for 2025-05.
[2025-10-24T20:58:05.276287] [INFO ] [REMOTE    ] S: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T20:58:05.651549] [INFO ] [REMOTE    ] RZC: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T20:58:05.747704] [INFO ] [REMOTE    ] RZC: Fetching primary data for 2025-06.
[2025-10-24T20:58:06.445936] [INFO ] [REMOTE    ] RZC: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T20:58:06.547607] [INFO ] [REMOTE    ] RZC: Fetching primary data for 2025-07.
[2025-10-24T20:58:07.026363] [INFO ] [REMOTE    ] RZC: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T20:58:07.347738] [INFO ] [REMOTE    ] RZC: Fetching primary data for 2025-08.
[2025-10-24T20:58:07.800350] [INFO ] [REMOTE    ] RZC: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T20:58:08.147723] [INFO ] [REMOTE    ] S: Fetching primary data for 2025-04.
[2025-10-24T20:58:08.947621] [INFO ] [REMOTE    ] RYI: Fetching primary data for 2025-10.
[2025-10-24T20:58:08.981495] [INFO ] [REMOTE    ] S: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T20:58:09.747709] [INFO ] [REMOTE    ] RZC: Fetching primary data for 2025-09.
[2025-10-24T20:58:09.773924] [INFO ] [REMOTE    ] RYI: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T20:58:09.778008] [INFO ] [REMOTE    ] RYI: Full fetch complete (31713 records).
[2025-10-24T20:58:09.778093] [DEBUG] [VALIDATOR ] RYI: Validating primary data.
[2025-10-24T20:58:09.778804] [FATAL] [VALIDATOR ] RYI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:58:09.778885] [FATAL] [MAIN      ] RYI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:58:09.778926] [WARN ] [MAIN      ] RYI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:58:09.778969] [INFO ] [LOCAL     ] RYI: Starting deletion of primary data.
[2025-10-24T20:58:09.779047] [DEBUG] [LOCAL     ] RYI: No primary data file found to delete.
[2025-10-24T20:58:09.779101] [INFO ] [LOCAL     ] RYI: Starting deletion of derivative data.
[2025-10-24T20:58:09.779280] [DEBUG] [LOCAL     ] RYI: Deleted derivative data file.
[2025-10-24T20:58:09.779367] [INFO ] [MAIN      ] Update Progress: 1850/2366 symbols completed. RYI took 46.8s. Estimated remaining: 1h 6m 25s. Rate: 7.8 symbols/min
[2025-10-24T20:58:09.959238] [INFO ] [MAIN      ] SA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:58:10.001673] [DEBUG] [LOCAL     ] SA: Loaded 44981 existing records from primary storage.
[2025-10-24T20:58:10.002005] [INFO ] [MAIN      ] SA: Loaded 44981 existing records.
[2025-10-24T20:58:10.178769] [WARN ] [MAIN      ] SA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:58:10.178961] [INFO ] [MAIN      ] SA: Wiping existing primary data before full refresh.
[2025-10-24T20:58:10.179010] [INFO ] [LOCAL     ] SA: Starting deletion of primary data.
[2025-10-24T20:58:10.179483] [DEBUG] [LOCAL     ] SA: Deleted primary data file.
[2025-10-24T20:58:10.179537] [INFO ] [MAIN      ] SA: Starting full primary refresh.
[2025-10-24T20:58:10.467122] [INFO ] [REMOTE    ] RZC: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T20:58:10.546169] [INFO ] [REMOTE    ] SA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:58:10.547605] [INFO ] [REMOTE    ] SA: Fetching primary data for 2025-01.
[2025-10-24T20:58:11.347709] [INFO ] [REMOTE    ] RZC: Fetching primary data for 2025-10.
[2025-10-24T20:58:11.900680] [INFO ] [REMOTE    ] SA: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T20:58:11.988831] [INFO ] [REMOTE    ] RZC: Incremental fetch complete for 2025-10 (0.64 seconds).
[2025-10-24T20:58:11.990258] [INFO ] [REMOTE    ] RZC: Full fetch complete (9568 records).
[2025-10-24T20:58:11.990330] [DEBUG] [VALIDATOR ] RZC: Validating primary data.
[2025-10-24T20:58:11.990733] [FATAL] [VALIDATOR ] RZC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:58:11.990815] [FATAL] [MAIN      ] RZC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:58:11.990858] [WARN ] [MAIN      ] RZC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:58:11.990898] [INFO ] [LOCAL     ] RZC: Starting deletion of primary data.
[2025-10-24T20:58:11.990954] [DEBUG] [LOCAL     ] RZC: No primary data file found to delete.
[2025-10-24T20:58:11.990989] [INFO ] [LOCAL     ] RZC: Starting deletion of derivative data.
[2025-10-24T20:58:11.991131] [DEBUG] [LOCAL     ] RZC: Deleted derivative data file.
[2025-10-24T20:58:11.991201] [INFO ] [MAIN      ] Update Progress: 1851/2366 symbols completed. RZC took 25.1s. Estimated remaining: 1h 6m 16s. Rate: 7.8 symbols/min
[2025-10-24T20:58:12.158086] [INFO ] [REMOTE    ] S: Fetching primary data for 2025-05.
[2025-10-24T20:58:12.160739] [INFO ] [MAIN      ] SABA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:58:12.173610] [DEBUG] [LOCAL     ] SABA: Loaded 9226 existing records from primary storage.
[2025-10-24T20:58:12.173952] [INFO ] [MAIN      ] SABA: Loaded 9226 existing records.
[2025-10-24T20:58:12.346543] [WARN ] [MAIN      ] SABA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:58:12.346766] [INFO ] [MAIN      ] SABA: Wiping existing primary data before full refresh.
[2025-10-24T20:58:12.346815] [INFO ] [LOCAL     ] SABA: Starting deletion of primary data.
[2025-10-24T20:58:12.346984] [DEBUG] [LOCAL     ] SABA: Deleted primary data file.
[2025-10-24T20:58:12.347021] [INFO ] [MAIN      ] SABA: Starting full primary refresh.
[2025-10-24T20:58:12.692881] [INFO ] [REMOTE    ] SABA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:58:12.947677] [INFO ] [REMOTE    ] SA: Fetching primary data for 2025-02.
[2025-10-24T20:58:13.244127] [INFO ] [REMOTE    ] S: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T20:58:13.747693] [INFO ] [REMOTE    ] SABA: Fetching primary data for 2025-01.
[2025-10-24T20:58:13.952467] [INFO ] [REMOTE    ] SA: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T20:58:14.547679] [INFO ] [REMOTE    ] S: Fetching primary data for 2025-06.
[2025-10-24T20:58:14.570214] [INFO ] [REMOTE    ] SABA: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T20:58:15.347610] [INFO ] [REMOTE    ] SABA: Fetching primary data for 2025-02.
[2025-10-24T20:58:15.640295] [INFO ] [REMOTE    ] S: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T20:58:16.096288] [INFO ] [REMOTE    ] SABA: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T20:58:16.147632] [INFO ] [REMOTE    ] SABA: Fetching primary data for 2025-03.
[2025-10-24T20:58:16.870759] [INFO ] [REMOTE    ] SABA: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T20:58:16.947639] [INFO ] [REMOTE    ] SABA: Fetching primary data for 2025-04.
[2025-10-24T20:58:17.355459] [INFO ] [REMOTE    ] SABA: Incremental fetch complete for 2025-04 (0.41 seconds).
[2025-10-24T20:58:17.747706] [INFO ] [REMOTE    ] SABA: Fetching primary data for 2025-05.
[2025-10-24T20:58:18.547699] [INFO ] [REMOTE    ] SA: Fetching primary data for 2025-03.
[2025-10-24T20:58:18.631204] [INFO ] [REMOTE    ] SABA: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T20:58:19.347721] [INFO ] [REMOTE    ] S: Fetching primary data for 2025-07.
[2025-10-24T20:58:19.536163] [INFO ] [REMOTE    ] SA: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T20:58:20.147721] [INFO ] [REMOTE    ] SA: Fetching primary data for 2025-04.
[2025-10-24T20:58:20.947733] [INFO ] [REMOTE    ] RZB: Fetching primary data for 2025-09.
[2025-10-24T20:58:21.102404] [INFO ] [REMOTE    ] S: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T20:58:21.188009] [INFO ] [REMOTE    ] SA: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T20:58:21.660362] [INFO ] [REMOTE    ] RZB: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T20:58:21.747607] [INFO ] [REMOTE    ] RZB: Fetching primary data for 2025-10.
[2025-10-24T20:58:22.034013] [INFO ] [REMOTE    ] RZB: Incremental fetch complete for 2025-10 (0.29 seconds).
[2025-10-24T20:58:22.035176] [INFO ] [REMOTE    ] RZB: Full fetch complete (8264 records).
[2025-10-24T20:58:22.035246] [DEBUG] [VALIDATOR ] RZB: Validating primary data.
[2025-10-24T20:58:22.035588] [FATAL] [VALIDATOR ] RZB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:58:22.035691] [FATAL] [MAIN      ] RZB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:58:22.035743] [WARN ] [MAIN      ] RZB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:58:22.035809] [INFO ] [LOCAL     ] RZB: Starting deletion of primary data.
[2025-10-24T20:58:22.035872] [DEBUG] [LOCAL     ] RZB: No primary data file found to delete.
[2025-10-24T20:58:22.035906] [INFO ] [LOCAL     ] RZB: Starting deletion of derivative data.
[2025-10-24T20:58:22.036073] [DEBUG] [LOCAL     ] RZB: Deleted derivative data file.
[2025-10-24T20:58:22.036158] [INFO ] [MAIN      ] Update Progress: 1852/2366 symbols completed. RZB took 40.1s. Estimated remaining: 1h 6m 9s. Rate: 7.8 symbols/min
[2025-10-24T20:58:22.203536] [INFO ] [MAIN      ] SAFE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:58:22.233514] [DEBUG] [LOCAL     ] SAFE: Loaded 30040 existing records from primary storage.
[2025-10-24T20:58:22.233815] [INFO ] [MAIN      ] SAFE: Loaded 30040 existing records.
[2025-10-24T20:58:22.409877] [WARN ] [MAIN      ] SAFE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:58:22.410114] [INFO ] [MAIN      ] SAFE: Wiping existing primary data before full refresh.
[2025-10-24T20:58:22.410181] [INFO ] [LOCAL     ] SAFE: Starting deletion of primary data.
[2025-10-24T20:58:22.410427] [DEBUG] [LOCAL     ] SAFE: Deleted primary data file.
[2025-10-24T20:58:22.410484] [INFO ] [MAIN      ] SAFE: Starting full primary refresh.
[2025-10-24T20:58:22.552810] [INFO ] [REMOTE    ] S: Fetching primary data for 2025-08.
[2025-10-24T20:58:22.767046] [INFO ] [REMOTE    ] SAFE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:58:23.347618] [INFO ] [REMOTE    ] SABA: Fetching primary data for 2025-06.
[2025-10-24T20:58:23.602482] [INFO ] [REMOTE    ] S: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T20:58:24.138055] [INFO ] [REMOTE    ] SABA: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T20:58:24.147600] [INFO ] [REMOTE    ] SABA: Fetching primary data for 2025-07.
[2025-10-24T20:58:24.835375] [INFO ] [REMOTE    ] SABA: Incremental fetch complete for 2025-07 (0.69 seconds).
[2025-10-24T20:58:24.947690] [INFO ] [REMOTE    ] SA: Fetching primary data for 2025-05.
[2025-10-24T20:58:25.655786] [INFO ] [REMOTE    ] SA: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T20:58:25.747635] [INFO ] [REMOTE    ] SA: Fetching primary data for 2025-06.
[2025-10-24T20:58:26.547631] [INFO ] [REMOTE    ] SAFE: Fetching primary data for 2025-01.
[2025-10-24T20:58:26.737958] [INFO ] [REMOTE    ] SA: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T20:58:27.347729] [INFO ] [REMOTE    ] S: Fetching primary data for 2025-09.
[2025-10-24T20:58:27.514052] [INFO ] [REMOTE    ] SAFE: Incremental fetch complete for 2025-01 (0.97 seconds).
[2025-10-24T20:58:28.147693] [INFO ] [REMOTE    ] SAFE: Fetching primary data for 2025-02.
[2025-10-24T20:58:28.479185] [INFO ] [REMOTE    ] S: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T20:58:28.947682] [INFO ] [REMOTE    ] SABA: Fetching primary data for 2025-08.
[2025-10-24T20:58:29.108202] [INFO ] [REMOTE    ] SAFE: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T20:58:29.747687] [INFO ] [REMOTE    ] SAFE: Fetching primary data for 2025-03.
[2025-10-24T20:58:29.757619] [INFO ] [REMOTE    ] SABA: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T20:58:30.476849] [INFO ] [REMOTE    ] SAFE: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T20:58:30.547698] [INFO ] [REMOTE    ] SAFE: Fetching primary data for 2025-04.
[2025-10-24T20:58:31.251870] [INFO ] [REMOTE    ] SAFE: Incremental fetch complete for 2025-04 (0.70 seconds).
[2025-10-24T20:58:31.347632] [INFO ] [REMOTE    ] SAFE: Fetching primary data for 2025-05.
[2025-10-24T20:58:32.147709] [INFO ] [REMOTE    ] SA: Fetching primary data for 2025-07.
[2025-10-24T20:58:32.414536] [INFO ] [REMOTE    ] SAFE: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T20:58:32.947617] [INFO ] [REMOTE    ] SAFE: Fetching primary data for 2025-06.
[2025-10-24T20:58:33.225856] [INFO ] [REMOTE    ] SA: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T20:58:33.261434] [INFO ] [REMOTE    ] SAFE: Incremental fetch complete for 2025-06 (0.31 seconds).
[2025-10-24T20:58:33.747626] [INFO ] [REMOTE    ] SA: Fetching primary data for 2025-08.
[2025-10-24T20:58:34.547703] [INFO ] [REMOTE    ] SAFE: Fetching primary data for 2025-07.
[2025-10-24T20:58:34.912628] [INFO ] [REMOTE    ] SA: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T20:58:34.989007] [INFO ] [REMOTE    ] SAFE: Incremental fetch complete for 2025-07 (0.44 seconds).
[2025-10-24T20:58:35.347665] [INFO ] [REMOTE    ] S: Fetching primary data for 2025-10.
[2025-10-24T20:58:36.070328] [INFO ] [REMOTE    ] S: Incremental fetch complete for 2025-10 (0.72 seconds).
[2025-10-24T20:58:36.079521] [INFO ] [REMOTE    ] S: Full fetch complete (77268 records).
[2025-10-24T20:58:36.079697] [DEBUG] [VALIDATOR ] S: Validating primary data.
[2025-10-24T20:58:36.080443] [FATAL] [VALIDATOR ] S: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:58:36.080547] [FATAL] [MAIN      ] S: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:58:36.080611] [WARN ] [MAIN      ] S: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:58:36.080702] [INFO ] [LOCAL     ] S: Starting deletion of primary data.
[2025-10-24T20:58:36.080773] [DEBUG] [LOCAL     ] S: No primary data file found to delete.
[2025-10-24T20:58:36.080810] [INFO ] [LOCAL     ] S: Starting deletion of derivative data.
[2025-10-24T20:58:36.080981] [DEBUG] [LOCAL     ] S: Deleted derivative data file.
[2025-10-24T20:58:36.081585] [INFO ] [MAIN      ] Update Progress: 1853/2366 symbols completed. S took 37.6s. Estimated remaining: 1h 6m 3s. Rate: 7.8 symbols/min
[2025-10-24T20:58:36.152830] [INFO ] [REMOTE    ] SAFE: Fetching primary data for 2025-08.
[2025-10-24T20:58:36.250994] [INFO ] [MAIN      ] SAH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:58:36.270799] [DEBUG] [LOCAL     ] SAH: Loaded 20933 existing records from primary storage.
[2025-10-24T20:58:36.271044] [INFO ] [MAIN      ] SAH: Loaded 20933 existing records.
[2025-10-24T20:58:36.447982] [WARN ] [MAIN      ] SAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:58:36.448207] [INFO ] [MAIN      ] SAH: Wiping existing primary data before full refresh.
[2025-10-24T20:58:36.448253] [INFO ] [LOCAL     ] SAH: Starting deletion of primary data.
[2025-10-24T20:58:36.448726] [DEBUG] [LOCAL     ] SAH: Deleted primary data file.
[2025-10-24T20:58:36.448781] [INFO ] [MAIN      ] SAH: Starting full primary refresh.
[2025-10-24T20:58:36.798514] [INFO ] [REMOTE    ] SAH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:58:36.947614] [INFO ] [REMOTE    ] SAH: Fetching primary data for 2025-01.
[2025-10-24T20:58:37.458801] [INFO ] [REMOTE    ] SAFE: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T20:58:37.482811] [INFO ] [REMOTE    ] SAH: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T20:58:37.747620] [INFO ] [REMOTE    ] SA: Fetching primary data for 2025-09.
[2025-10-24T20:58:38.547701] [INFO ] [REMOTE    ] SABA: Fetching primary data for 2025-09.
[2025-10-24T20:58:38.790505] [INFO ] [REMOTE    ] SA: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T20:58:39.323312] [INFO ] [REMOTE    ] SABA: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T20:58:39.347607] [INFO ] [REMOTE    ] SAFE: Fetching primary data for 2025-09.
[2025-10-24T20:58:40.147715] [INFO ] [REMOTE    ] SAH: Fetching primary data for 2025-02.
[2025-10-24T20:58:40.278572] [INFO ] [REMOTE    ] SAFE: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T20:58:40.947855] [INFO ] [REMOTE    ] SABA: Fetching primary data for 2025-10.
[2025-10-24T20:58:41.005837] [INFO ] [REMOTE    ] SAH: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T20:58:41.104094] [INFO ] [REMOTE    ] SABA: Incremental fetch complete for 2025-10 (0.16 seconds).
[2025-10-24T20:58:41.107269] [INFO ] [REMOTE    ] SABA: Full fetch complete (14940 records).
[2025-10-24T20:58:41.107454] [DEBUG] [VALIDATOR ] SABA: Validating primary data.
[2025-10-24T20:58:41.107996] [FATAL] [VALIDATOR ] SABA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:58:41.108084] [FATAL] [MAIN      ] SABA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:58:41.108136] [WARN ] [MAIN      ] SABA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:58:41.108185] [INFO ] [LOCAL     ] SABA: Starting deletion of primary data.
[2025-10-24T20:58:41.108242] [DEBUG] [LOCAL     ] SABA: No primary data file found to delete.
[2025-10-24T20:58:41.108298] [INFO ] [LOCAL     ] SABA: Starting deletion of derivative data.
[2025-10-24T20:58:41.108521] [DEBUG] [LOCAL     ] SABA: Deleted derivative data file.
[2025-10-24T20:58:41.108612] [INFO ] [MAIN      ] Update Progress: 1854/2366 symbols completed. SABA took 29.1s. Estimated remaining: 1h 5m 54s. Rate: 7.8 symbols/min
[2025-10-24T20:58:41.299609] [INFO ] [MAIN      ] SAJ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:58:41.299874] [DEBUG] [LOCAL     ] SAJ: No existing data file found in primary storage.
[2025-10-24T20:58:41.299925] [WARN ] [MAIN      ] SAJ: No existing data found, performing full refresh instead.
[2025-10-24T20:58:41.300041] [INFO ] [MAIN      ] SAJ: Wiping existing primary data before full refresh.
[2025-10-24T20:58:41.300083] [INFO ] [LOCAL     ] SAJ: Starting deletion of primary data.
[2025-10-24T20:58:41.300126] [DEBUG] [LOCAL     ] SAJ: No primary data file found to delete.
[2025-10-24T20:58:41.300159] [INFO ] [MAIN      ] SAJ: Starting full primary refresh.
[2025-10-24T20:58:41.704109] [INFO ] [REMOTE    ] SAJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:58:41.747711] [INFO ] [REMOTE    ] SAJ: Fetching primary data for 2025-01.
[2025-10-24T20:58:41.955576] [INFO ] [REMOTE    ] SAJ: Incremental fetch complete for 2025-01 (0.21 seconds).
[2025-10-24T20:58:42.547628] [INFO ] [REMOTE    ] SAFE: Fetching primary data for 2025-10.
[2025-10-24T20:58:43.350771] [INFO ] [REMOTE    ] SAJ: Fetching primary data for 2025-02.
[2025-10-24T20:58:43.354665] [INFO ] [REMOTE    ] SAFE: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T20:58:43.360696] [INFO ] [REMOTE    ] SAFE: Full fetch complete (43602 records).
[2025-10-24T20:58:43.360869] [DEBUG] [VALIDATOR ] SAFE: Validating primary data.
[2025-10-24T20:58:43.361839] [FATAL] [VALIDATOR ] SAFE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:58:43.361923] [FATAL] [MAIN      ] SAFE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:58:43.361990] [WARN ] [MAIN      ] SAFE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:58:43.362064] [INFO ] [LOCAL     ] SAFE: Starting deletion of primary data.
[2025-10-24T20:58:43.362130] [DEBUG] [LOCAL     ] SAFE: No primary data file found to delete.
[2025-10-24T20:58:43.362168] [INFO ] [LOCAL     ] SAFE: Starting deletion of derivative data.
[2025-10-24T20:58:43.362364] [DEBUG] [LOCAL     ] SAFE: Deleted derivative data file.
[2025-10-24T20:58:43.362457] [INFO ] [MAIN      ] Update Progress: 1855/2366 symbols completed. SAFE took 21.3s. Estimated remaining: 1h 5m 45s. Rate: 7.8 symbols/min
[2025-10-24T20:58:43.551743] [INFO ] [MAIN      ] SAM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:58:43.575499] [DEBUG] [LOCAL     ] SAM: Loaded 21387 existing records from primary storage.
[2025-10-24T20:58:43.575789] [INFO ] [MAIN      ] SAM: Loaded 21387 existing records.
[2025-10-24T20:58:43.769826] [WARN ] [MAIN      ] SAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:58:43.770057] [INFO ] [MAIN      ] SAM: Wiping existing primary data before full refresh.
[2025-10-24T20:58:43.770106] [INFO ] [LOCAL     ] SAM: Starting deletion of primary data.
[2025-10-24T20:58:43.770357] [DEBUG] [LOCAL     ] SAM: Deleted primary data file.
[2025-10-24T20:58:43.770438] [INFO ] [MAIN      ] SAM: Starting full primary refresh.
[2025-10-24T20:58:43.891728] [INFO ] [REMOTE    ] SAJ: Incremental fetch complete for 2025-02 (0.54 seconds).
[2025-10-24T20:58:44.162909] [INFO ] [REMOTE    ] SAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:58:44.157975] [INFO ] [REMOTE    ] SAJ: Fetching primary data for 2025-03.
[2025-10-24T20:58:44.460244] [INFO ] [REMOTE    ] SAJ: Incremental fetch complete for 2025-03 (0.30 seconds).
[2025-10-24T20:58:44.947697] [INFO ] [REMOTE    ] SAM: Fetching primary data for 2025-01.
[2025-10-24T20:58:45.747672] [INFO ] [REMOTE    ] SAH: Fetching primary data for 2025-03.
[2025-10-24T20:58:45.834531] [INFO ] [REMOTE    ] SAM: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T20:58:46.360399] [INFO ] [REMOTE    ] SAH: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T20:58:46.547742] [INFO ] [REMOTE    ] SAJ: Fetching primary data for 2025-04.
[2025-10-24T20:58:46.746068] [INFO ] [REMOTE    ] SAJ: Incremental fetch complete for 2025-04 (0.20 seconds).
[2025-10-24T20:58:47.347732] [INFO ] [REMOTE    ] SAH: Fetching primary data for 2025-04.
[2025-10-24T20:58:48.147687] [INFO ] [REMOTE    ] SA: Fetching primary data for 2025-10.
[2025-10-24T20:58:48.410354] [INFO ] [REMOTE    ] SAH: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T20:58:48.947611] [INFO ] [REMOTE    ] SAM: Fetching primary data for 2025-02.
[2025-10-24T20:58:49.210572] [INFO ] [REMOTE    ] SA: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T20:58:49.219347] [INFO ] [REMOTE    ] SA: Full fetch complete (63327 records).
[2025-10-24T20:58:49.219476] [DEBUG] [VALIDATOR ] SA: Validating primary data.
[2025-10-24T20:58:49.220416] [FATAL] [VALIDATOR ] SA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:58:49.220503] [FATAL] [MAIN      ] SA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:58:49.220546] [WARN ] [MAIN      ] SA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:58:49.220585] [INFO ] [LOCAL     ] SA: Starting deletion of primary data.
[2025-10-24T20:58:49.220661] [DEBUG] [LOCAL     ] SA: No primary data file found to delete.
[2025-10-24T20:58:49.220728] [INFO ] [LOCAL     ] SA: Starting deletion of derivative data.
[2025-10-24T20:58:49.220875] [DEBUG] [LOCAL     ] SA: Deleted derivative data file.
[2025-10-24T20:58:49.221101] [INFO ] [MAIN      ] Update Progress: 1856/2366 symbols completed. SA took 39.4s. Estimated remaining: 1h 5m 37s. Rate: 7.8 symbols/min
[2025-10-24T20:58:49.387301] [INFO ] [MAIN      ] SAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:58:49.443022] [DEBUG] [LOCAL     ] SAN: Loaded 53345 existing records from primary storage.
[2025-10-24T20:58:49.443983] [INFO ] [MAIN      ] SAN: Loaded 53345 existing records.
[2025-10-24T20:58:49.625422] [WARN ] [MAIN      ] SAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:58:49.625762] [INFO ] [MAIN      ] SAN: Wiping existing primary data before full refresh.
[2025-10-24T20:58:49.625895] [INFO ] [LOCAL     ] SAN: Starting deletion of primary data.
[2025-10-24T20:58:49.626586] [DEBUG] [LOCAL     ] SAN: Deleted primary data file.
[2025-10-24T20:58:49.626672] [INFO ] [MAIN      ] SAN: Starting full primary refresh.
[2025-10-24T20:58:49.752874] [INFO ] [REMOTE    ] SAH: Fetching primary data for 2025-05.
[2025-10-24T20:58:49.976209] [INFO ] [REMOTE    ] SAM: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T20:58:50.034154] [INFO ] [REMOTE    ] SAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:58:50.395024] [INFO ] [REMOTE    ] SAH: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T20:58:50.547715] [INFO ] [REMOTE    ] SAN: Fetching primary data for 2025-01.
[2025-10-24T20:58:51.347704] [INFO ] [REMOTE    ] SAJ: Fetching primary data for 2025-05.
[2025-10-24T20:58:51.621963] [INFO ] [REMOTE    ] SAN: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T20:58:51.795047] [INFO ] [REMOTE    ] SAJ: Incremental fetch complete for 2025-05 (0.45 seconds).
[2025-10-24T20:58:52.147716] [INFO ] [REMOTE    ] SAN: Fetching primary data for 2025-02.
[2025-10-24T20:58:52.947674] [INFO ] [REMOTE    ] SAJ: Fetching primary data for 2025-06.
[2025-10-24T20:58:53.118208] [INFO ] [REMOTE    ] SAN: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T20:58:53.377560] [INFO ] [REMOTE    ] SAJ: Incremental fetch complete for 2025-06 (0.43 seconds).
[2025-10-24T20:58:53.747622] [INFO ] [REMOTE    ] SAN: Fetching primary data for 2025-03.
[2025-10-24T20:58:54.547630] [INFO ] [REMOTE    ] SAH: Fetching primary data for 2025-06.
[2025-10-24T20:58:54.826270] [INFO ] [REMOTE    ] SAN: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T20:58:55.344151] [INFO ] [REMOTE    ] SAH: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T20:58:55.348416] [INFO ] [REMOTE    ] SAM: Fetching primary data for 2025-03.
[2025-10-24T20:58:56.147676] [INFO ] [REMOTE    ] SAH: Fetching primary data for 2025-07.
[2025-10-24T20:58:56.359908] [INFO ] [REMOTE    ] SAM: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T20:58:56.947704] [INFO ] [REMOTE    ] SAJ: Fetching primary data for 2025-07.
[2025-10-24T20:58:56.983031] [INFO ] [REMOTE    ] SAH: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T20:58:57.147162] [INFO ] [REMOTE    ] SAJ: Incremental fetch complete for 2025-07 (0.20 seconds).
[2025-10-24T20:58:57.747671] [INFO ] [REMOTE    ] SAN: Fetching primary data for 2025-04.
[2025-10-24T20:58:58.547717] [INFO ] [REMOTE    ] SAM: Fetching primary data for 2025-04.
[2025-10-24T20:58:58.671822] [INFO ] [REMOTE    ] SAN: Incremental fetch complete for 2025-04 (0.92 seconds).
[2025-10-24T20:58:59.347621] [INFO ] [REMOTE    ] SAJ: Fetching primary data for 2025-08.
[2025-10-24T20:58:59.414454] [INFO ] [REMOTE    ] SAM: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T20:58:59.798584] [INFO ] [REMOTE    ] SAJ: Incremental fetch complete for 2025-08 (0.45 seconds).
[2025-10-24T20:59:00.147702] [INFO ] [REMOTE    ] SAM: Fetching primary data for 2025-05.
[2025-10-24T20:59:00.947699] [INFO ] [REMOTE    ] SAJ: Fetching primary data for 2025-09.
[2025-10-24T20:59:01.075454] [INFO ] [REMOTE    ] SAM: Incremental fetch complete for 2025-05 (0.93 seconds).
[2025-10-24T20:59:01.421166] [INFO ] [REMOTE    ] SAJ: Incremental fetch complete for 2025-09 (0.47 seconds).
[2025-10-24T20:59:01.747692] [INFO ] [REMOTE    ] SAH: Fetching primary data for 2025-08.
[2025-10-24T20:59:02.379250] [INFO ] [REMOTE    ] SAH: Incremental fetch complete for 2025-08 (0.63 seconds).
[2025-10-24T20:59:02.547667] [INFO ] [REMOTE    ] SAH: Fetching primary data for 2025-09.
[2025-10-24T20:59:03.127484] [INFO ] [REMOTE    ] SAH: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T20:59:03.347693] [INFO ] [REMOTE    ] SAM: Fetching primary data for 2025-06.
[2025-10-24T20:59:04.147672] [INFO ] [REMOTE    ] SAH: Fetching primary data for 2025-10.
[2025-10-24T20:59:04.318047] [INFO ] [REMOTE    ] SAM: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T20:59:04.947670] [INFO ] [REMOTE    ] SAM: Fetching primary data for 2025-07.
[2025-10-24T20:59:05.086155] [INFO ] [REMOTE    ] SAH: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T20:59:05.094726] [INFO ] [REMOTE    ] SAH: Full fetch complete (30832 records).
[2025-10-24T20:59:05.095009] [DEBUG] [VALIDATOR ] SAH: Validating primary data.
[2025-10-24T20:59:05.095895] [FATAL] [VALIDATOR ] SAH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:59:05.095991] [FATAL] [MAIN      ] SAH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:59:05.096038] [WARN ] [MAIN      ] SAH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:59:05.096121] [INFO ] [LOCAL     ] SAH: Starting deletion of primary data.
[2025-10-24T20:59:05.096213] [DEBUG] [LOCAL     ] SAH: No primary data file found to delete.
[2025-10-24T20:59:05.096263] [INFO ] [LOCAL     ] SAH: Starting deletion of derivative data.
[2025-10-24T20:59:05.096701] [DEBUG] [LOCAL     ] SAH: Deleted derivative data file.
[2025-10-24T20:59:05.096835] [INFO ] [MAIN      ] Update Progress: 1857/2366 symbols completed. SAH took 29.0s. Estimated remaining: 1h 5m 31s. Rate: 7.8 symbols/min
[2025-10-24T20:59:05.278294] [INFO ] [MAIN      ] SAP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:59:05.330257] [DEBUG] [LOCAL     ] SAP: Loaded 50250 existing records from primary storage.
[2025-10-24T20:59:05.330717] [INFO ] [MAIN      ] SAP: Loaded 50250 existing records.
[2025-10-24T20:59:05.519972] [WARN ] [MAIN      ] SAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:59:05.520461] [INFO ] [MAIN      ] SAP: Wiping existing primary data before full refresh.
[2025-10-24T20:59:05.520574] [INFO ] [LOCAL     ] SAP: Starting deletion of primary data.
[2025-10-24T20:59:05.521154] [DEBUG] [LOCAL     ] SAP: Deleted primary data file.
[2025-10-24T20:59:05.521228] [INFO ] [MAIN      ] SAP: Starting full primary refresh.
[2025-10-24T20:59:05.752728] [INFO ] [REMOTE    ] SAJ: Fetching primary data for 2025-10.
[2025-10-24T20:59:05.776314] [INFO ] [REMOTE    ] SAM: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T20:59:05.954080] [INFO ] [REMOTE    ] SAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:59:06.008126] [INFO ] [REMOTE    ] SAJ: Incremental fetch complete for 2025-10 (0.26 seconds).
[2025-10-24T20:59:06.009217] [INFO ] [REMOTE    ] SAJ: Full fetch complete (977 records).
[2025-10-24T20:59:06.009291] [DEBUG] [VALIDATOR ] SAJ: Validating primary data.
[2025-10-24T20:59:06.009769] [FATAL] [VALIDATOR ] SAJ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:59:06.009856] [FATAL] [MAIN      ] SAJ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:59:06.009899] [WARN ] [MAIN      ] SAJ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:59:06.009941] [INFO ] [LOCAL     ] SAJ: Starting deletion of primary data.
[2025-10-24T20:59:06.010004] [DEBUG] [LOCAL     ] SAJ: No primary data file found to delete.
[2025-10-24T20:59:06.010041] [INFO ] [LOCAL     ] SAJ: Starting deletion of derivative data.
[2025-10-24T20:59:06.010080] [DEBUG] [LOCAL     ] SAJ: No derivative data file found to delete.
[2025-10-24T20:59:06.010136] [INFO ] [MAIN      ] Update Progress: 1858/2366 symbols completed. SAJ took 24.9s. Estimated remaining: 1h 5m 22s. Rate: 7.8 symbols/min
[2025-10-24T20:59:06.187877] [INFO ] [MAIN      ] SAR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:59:06.210549] [DEBUG] [LOCAL     ] SAR: Loaded 17208 existing records from primary storage.
[2025-10-24T20:59:06.210950] [INFO ] [MAIN      ] SAR: Loaded 17208 existing records.
[2025-10-24T20:59:06.406484] [WARN ] [MAIN      ] SAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:59:06.406779] [INFO ] [MAIN      ] SAR: Wiping existing primary data before full refresh.
[2025-10-24T20:59:06.406833] [INFO ] [LOCAL     ] SAR: Starting deletion of primary data.
[2025-10-24T20:59:06.407076] [DEBUG] [LOCAL     ] SAR: Deleted primary data file.
[2025-10-24T20:59:06.407115] [INFO ] [MAIN      ] SAR: Starting full primary refresh.
[2025-10-24T20:59:06.554881] [INFO ] [REMOTE    ] SAM: Fetching primary data for 2025-08.
[2025-10-24T20:59:06.790181] [INFO ] [REMOTE    ] SAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:59:07.347707] [INFO ] [REMOTE    ] SAP: Fetching primary data for 2025-01.
[2025-10-24T20:59:07.462039] [INFO ] [REMOTE    ] SAM: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T20:59:08.152701] [INFO ] [REMOTE    ] SAM: Fetching primary data for 2025-09.
[2025-10-24T20:59:08.166863] [INFO ] [REMOTE    ] SAP: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T20:59:08.947745] [INFO ] [REMOTE    ] SAP: Fetching primary data for 2025-02.
[2025-10-24T20:59:09.017562] [INFO ] [REMOTE    ] SAM: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T20:59:09.738193] [INFO ] [REMOTE    ] SAP: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T20:59:09.747632] [INFO ] [REMOTE    ] SAM: Fetching primary data for 2025-10.
[2025-10-24T20:59:10.309964] [INFO ] [REMOTE    ] SAM: Incremental fetch complete for 2025-10 (0.56 seconds).
[2025-10-24T20:59:10.313623] [INFO ] [REMOTE    ] SAM: Full fetch complete (31067 records).
[2025-10-24T20:59:10.313734] [DEBUG] [VALIDATOR ] SAM: Validating primary data.
[2025-10-24T20:59:10.314183] [FATAL] [VALIDATOR ] SAM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:59:10.314266] [FATAL] [MAIN      ] SAM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:59:10.314309] [WARN ] [MAIN      ] SAM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:59:10.314383] [INFO ] [LOCAL     ] SAM: Starting deletion of primary data.
[2025-10-24T20:59:10.314446] [DEBUG] [LOCAL     ] SAM: No primary data file found to delete.
[2025-10-24T20:59:10.314483] [INFO ] [LOCAL     ] SAM: Starting deletion of derivative data.
[2025-10-24T20:59:10.314687] [DEBUG] [LOCAL     ] SAM: Deleted derivative data file.
[2025-10-24T20:59:10.314774] [INFO ] [MAIN      ] Update Progress: 1859/2366 symbols completed. SAM took 27.0s. Estimated remaining: 1h 5m 13s. Rate: 7.8 symbols/min
[2025-10-24T20:59:10.485771] [INFO ] [MAIN      ] SARO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:59:10.528917] [DEBUG] [LOCAL     ] SARO: Loaded 48571 existing records from primary storage.
[2025-10-24T20:59:10.529203] [INFO ] [MAIN      ] SARO: Loaded 48571 existing records.
[2025-10-24T20:59:10.552768] [INFO ] [REMOTE    ] SAN: Fetching primary data for 2025-05.
[2025-10-24T20:59:10.710216] [WARN ] [MAIN      ] SARO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:59:10.710420] [INFO ] [MAIN      ] SARO: Wiping existing primary data before full refresh.
[2025-10-24T20:59:10.710469] [INFO ] [LOCAL     ] SARO: Starting deletion of primary data.
[2025-10-24T20:59:10.710839] [DEBUG] [LOCAL     ] SARO: Deleted primary data file.
[2025-10-24T20:59:10.710897] [INFO ] [MAIN      ] SARO: Starting full primary refresh.
[2025-10-24T20:59:11.073092] [INFO ] [REMOTE    ] SARO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:59:11.347637] [INFO ] [REMOTE    ] SAP: Fetching primary data for 2025-03.
[2025-10-24T20:59:11.413826] [INFO ] [REMOTE    ] SAN: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T20:59:12.147661] [INFO ] [REMOTE    ] SAR: Fetching primary data for 2025-01.
[2025-10-24T20:59:12.448055] [INFO ] [REMOTE    ] SAP: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T20:59:12.625517] [INFO ] [REMOTE    ] SAR: Incremental fetch complete for 2025-01 (0.48 seconds).
[2025-10-24T20:59:12.947694] [INFO ] [REMOTE    ] SAP: Fetching primary data for 2025-04.
[2025-10-24T20:59:13.747807] [INFO ] [REMOTE    ] SARO: Fetching primary data for 2025-01.
[2025-10-24T20:59:13.754577] [INFO ] [REMOTE    ] SAP: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T20:59:14.496697] [INFO ] [REMOTE    ] SARO: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T20:59:14.547605] [INFO ] [REMOTE    ] SAR: Fetching primary data for 2025-02.
[2025-10-24T20:59:15.347711] [INFO ] [REMOTE    ] SAN: Fetching primary data for 2025-06.
[2025-10-24T20:59:15.642268] [INFO ] [REMOTE    ] SAR: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T20:59:16.147681] [INFO ] [REMOTE    ] SARO: Fetching primary data for 2025-02.
[2025-10-24T20:59:16.505075] [INFO ] [REMOTE    ] SAN: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T20:59:16.880347] [INFO ] [REMOTE    ] SARO: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T20:59:16.947620] [INFO ] [REMOTE    ] SARO: Fetching primary data for 2025-03.
[2025-10-24T20:59:17.758356] [INFO ] [REMOTE    ] SAN: Fetching primary data for 2025-07.
[2025-10-24T20:59:17.766184] [INFO ] [REMOTE    ] SARO: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T20:59:18.547632] [INFO ] [REMOTE    ] SARO: Fetching primary data for 2025-04.
[2025-10-24T20:59:18.871827] [INFO ] [REMOTE    ] SAN: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T20:59:19.332091] [INFO ] [REMOTE    ] SARO: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:59:19.347596] [INFO ] [REMOTE    ] SARO: Fetching primary data for 2025-05.
[2025-10-24T20:59:20.147625] [INFO ] [REMOTE    ] SAP: Fetching primary data for 2025-05.
[2025-10-24T20:59:20.372465] [INFO ] [REMOTE    ] SARO: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T20:59:20.947614] [INFO ] [REMOTE    ] SARO: Fetching primary data for 2025-06.
[2025-10-24T20:59:21.322500] [INFO ] [REMOTE    ] SAP: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T20:59:21.482835] [INFO ] [REMOTE    ] SARO: Incremental fetch complete for 2025-06 (0.54 seconds).
[2025-10-24T20:59:21.747695] [INFO ] [REMOTE    ] SAN: Fetching primary data for 2025-08.
[2025-10-24T20:59:22.547694] [INFO ] [REMOTE    ] SAP: Fetching primary data for 2025-06.
[2025-10-24T20:59:23.011555] [INFO ] [REMOTE    ] SAN: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T20:59:23.347730] [INFO ] [REMOTE    ] SAN: Fetching primary data for 2025-09.
[2025-10-24T20:59:23.581323] [INFO ] [REMOTE    ] SAP: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T20:59:24.147629] [INFO ] [REMOTE    ] SAP: Fetching primary data for 2025-07.
[2025-10-24T20:59:24.204234] [INFO ] [REMOTE    ] SAN: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T20:59:24.947616] [INFO ] [REMOTE    ] SAN: Fetching primary data for 2025-10.
[2025-10-24T20:59:24.989965] [INFO ] [REMOTE    ] SAP: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T20:59:25.672992] [INFO ] [REMOTE    ] SAN: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T20:59:25.682036] [INFO ] [REMOTE    ] SAN: Full fetch complete (76218 records).
[2025-10-24T20:59:25.682159] [DEBUG] [VALIDATOR ] SAN: Validating primary data.
[2025-10-24T20:59:25.682913] [FATAL] [VALIDATOR ] SAN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:59:25.683002] [FATAL] [MAIN      ] SAN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:59:25.683044] [WARN ] [MAIN      ] SAN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:59:25.683084] [INFO ] [LOCAL     ] SAN: Starting deletion of primary data.
[2025-10-24T20:59:25.683142] [DEBUG] [LOCAL     ] SAN: No primary data file found to delete.
[2025-10-24T20:59:25.683181] [INFO ] [LOCAL     ] SAN: Starting deletion of derivative data.
[2025-10-24T20:59:25.683354] [DEBUG] [LOCAL     ] SAN: Deleted derivative data file.
[2025-10-24T20:59:25.683886] [INFO ] [MAIN      ] Update Progress: 1860/2366 symbols completed. SAN took 36.5s. Estimated remaining: 1h 5m 7s. Rate: 7.8 symbols/min
[2025-10-24T20:59:25.752851] [INFO ] [REMOTE    ] SAP: Fetching primary data for 2025-08.
[2025-10-24T20:59:25.900432] [INFO ] [MAIN      ] SAT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:59:25.900622] [DEBUG] [LOCAL     ] SAT: No existing data file found in primary storage.
[2025-10-24T20:59:25.900699] [WARN ] [MAIN      ] SAT: No existing data found, performing full refresh instead.
[2025-10-24T20:59:25.900831] [INFO ] [MAIN      ] SAT: Wiping existing primary data before full refresh.
[2025-10-24T20:59:25.900873] [INFO ] [LOCAL     ] SAT: Starting deletion of primary data.
[2025-10-24T20:59:25.900914] [DEBUG] [LOCAL     ] SAT: No primary data file found to delete.
[2025-10-24T20:59:25.900946] [INFO ] [MAIN      ] SAT: Starting full primary refresh.
[2025-10-24T20:59:26.247418] [INFO ] [REMOTE    ] SAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:59:26.547609] [INFO ] [REMOTE    ] SARO: Fetching primary data for 2025-07.
[2025-10-24T20:59:26.752710] [INFO ] [REMOTE    ] SAP: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T20:59:27.271211] [INFO ] [REMOTE    ] SARO: Incremental fetch complete for 2025-07 (0.72 seconds).
[2025-10-24T20:59:27.347609] [INFO ] [REMOTE    ] SARO: Fetching primary data for 2025-08.
[2025-10-24T20:59:28.147713] [INFO ] [REMOTE    ] SAT: Fetching primary data for 2025-01.
[2025-10-24T20:59:28.275591] [INFO ] [REMOTE    ] SAT: Incremental fetch complete for 2025-01 (0.13 seconds).
[2025-10-24T20:59:28.657970] [INFO ] [REMOTE    ] SARO: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T20:59:28.947712] [INFO ] [REMOTE    ] SAT: Fetching primary data for 2025-02.
[2025-10-24T20:59:29.152497] [INFO ] [REMOTE    ] SAT: Incremental fetch complete for 2025-02 (0.20 seconds).
[2025-10-24T20:59:29.747629] [INFO ] [REMOTE    ] SAT: Fetching primary data for 2025-03.
[2025-10-24T20:59:30.025319] [INFO ] [REMOTE    ] SAT: Incremental fetch complete for 2025-03 (0.28 seconds).
[2025-10-24T20:59:30.547625] [INFO ] [REMOTE    ] SAT: Fetching primary data for 2025-04.
[2025-10-24T20:59:30.840154] [INFO ] [REMOTE    ] SAT: Incremental fetch complete for 2025-04 (0.29 seconds).
[2025-10-24T20:59:31.347620] [INFO ] [REMOTE    ] SAP: Fetching primary data for 2025-09.
[2025-10-24T20:59:32.149677] [INFO ] [REMOTE    ] SARO: Fetching primary data for 2025-09.
[2025-10-24T20:59:32.161569] [INFO ] [REMOTE    ] SAP: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T20:59:32.933617] [INFO ] [REMOTE    ] SARO: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T20:59:32.947690] [INFO ] [REMOTE    ] SAR: Fetching primary data for 2025-03.
[2025-10-24T20:59:33.747661] [INFO ] [REMOTE    ] SAT: Fetching primary data for 2025-05.
[2025-10-24T20:59:33.858105] [INFO ] [REMOTE    ] SAR: Incremental fetch complete for 2025-03 (0.91 seconds).
[2025-10-24T20:59:33.973201] [INFO ] [REMOTE    ] SAT: Incremental fetch complete for 2025-05 (0.23 seconds).
[2025-10-24T20:59:34.547634] [INFO ] [REMOTE    ] SAT: Fetching primary data for 2025-06.
[2025-10-24T20:59:35.042386] [INFO ] [REMOTE    ] SAT: Incremental fetch complete for 2025-06 (0.49 seconds).
[2025-10-24T20:59:35.347739] [INFO ] [REMOTE    ] SAP: Fetching primary data for 2025-10.
[2025-10-24T20:59:36.147633] [INFO ] [REMOTE    ] SAT: Fetching primary data for 2025-07.
[2025-10-24T20:59:36.349086] [INFO ] [REMOTE    ] SAT: Incremental fetch complete for 2025-07 (0.20 seconds).
[2025-10-24T20:59:36.678631] [INFO ] [REMOTE    ] SAP: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T20:59:36.688180] [INFO ] [REMOTE    ] SAP: Full fetch complete (71971 records).
[2025-10-24T20:59:36.688310] [DEBUG] [VALIDATOR ] SAP: Validating primary data.
[2025-10-24T20:59:36.690555] [FATAL] [VALIDATOR ] SAP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:59:36.690687] [FATAL] [MAIN      ] SAP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:59:36.690741] [WARN ] [MAIN      ] SAP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:59:36.690782] [INFO ] [LOCAL     ] SAP: Starting deletion of primary data.
[2025-10-24T20:59:36.690841] [DEBUG] [LOCAL     ] SAP: No primary data file found to delete.
[2025-10-24T20:59:36.690887] [INFO ] [LOCAL     ] SAP: Starting deletion of derivative data.
[2025-10-24T20:59:36.691069] [DEBUG] [LOCAL     ] SAP: Deleted derivative data file.
[2025-10-24T20:59:36.691858] [INFO ] [MAIN      ] Update Progress: 1861/2366 symbols completed. SAP took 31.6s. Estimated remaining: 1h 5m 0s. Rate: 7.8 symbols/min
[2025-10-24T20:59:36.877512] [INFO ] [MAIN      ] SAY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:59:36.877622] [DEBUG] [LOCAL     ] SAY: No existing data file found in primary storage.
[2025-10-24T20:59:36.877689] [WARN ] [MAIN      ] SAY: No existing data found, performing full refresh instead.
[2025-10-24T20:59:36.877802] [INFO ] [MAIN      ] SAY: Wiping existing primary data before full refresh.
[2025-10-24T20:59:36.877843] [INFO ] [LOCAL     ] SAY: Starting deletion of primary data.
[2025-10-24T20:59:36.877886] [DEBUG] [LOCAL     ] SAY: No primary data file found to delete.
[2025-10-24T20:59:36.877917] [INFO ] [MAIN      ] SAY: Starting full primary refresh.
[2025-10-24T20:59:36.952710] [INFO ] [REMOTE    ] SARO: Fetching primary data for 2025-10.
[2025-10-24T20:59:37.225620] [INFO ] [REMOTE    ] SAY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:59:37.747604] [INFO ] [REMOTE    ] SAR: Fetching primary data for 2025-04.
[2025-10-24T20:59:37.987221] [INFO ] [REMOTE    ] SARO: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T20:59:37.995986] [INFO ] [REMOTE    ] SARO: Full fetch complete (68631 records).
[2025-10-24T20:59:37.996112] [DEBUG] [VALIDATOR ] SARO: Validating primary data.
[2025-10-24T20:59:37.996855] [FATAL] [VALIDATOR ] SARO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:59:37.996955] [FATAL] [MAIN      ] SARO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:59:37.997025] [WARN ] [MAIN      ] SARO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:59:37.997120] [INFO ] [LOCAL     ] SARO: Starting deletion of primary data.
[2025-10-24T20:59:37.997199] [DEBUG] [LOCAL     ] SARO: No primary data file found to delete.
[2025-10-24T20:59:37.997235] [INFO ] [LOCAL     ] SARO: Starting deletion of derivative data.
[2025-10-24T20:59:37.997406] [DEBUG] [LOCAL     ] SARO: Deleted derivative data file.
[2025-10-24T20:59:37.997936] [INFO ] [MAIN      ] Update Progress: 1862/2366 symbols completed. SARO took 27.7s. Estimated remaining: 1h 4m 51s. Rate: 7.8 symbols/min
[2025-10-24T20:59:38.167989] [INFO ] [MAIN      ] SAZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:59:38.168139] [DEBUG] [LOCAL     ] SAZ: No existing data file found in primary storage.
[2025-10-24T20:59:38.168181] [WARN ] [MAIN      ] SAZ: No existing data found, performing full refresh instead.
[2025-10-24T20:59:38.168329] [INFO ] [MAIN      ] SAZ: Wiping existing primary data before full refresh.
[2025-10-24T20:59:38.168394] [INFO ] [LOCAL     ] SAZ: Starting deletion of primary data.
[2025-10-24T20:59:38.168444] [DEBUG] [LOCAL     ] SAZ: No primary data file found to delete.
[2025-10-24T20:59:38.168477] [INFO ] [MAIN      ] SAZ: Starting full primary refresh.
[2025-10-24T20:59:38.520485] [INFO ] [REMOTE    ] SAZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:59:38.529515] [INFO ] [REMOTE    ] SAR: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T20:59:38.547595] [INFO ] [REMOTE    ] SAR: Fetching primary data for 2025-05.
[2025-10-24T20:59:39.126227] [INFO ] [REMOTE    ] SAR: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T20:59:39.347618] [INFO ] [REMOTE    ] SAT: Fetching primary data for 2025-08.
[2025-10-24T20:59:39.851980] [INFO ] [REMOTE    ] SAT: Incremental fetch complete for 2025-08 (0.50 seconds).
[2025-10-24T20:59:40.147713] [INFO ] [REMOTE    ] SAY: Fetching primary data for 2025-01.
[2025-10-24T20:59:40.589358] [INFO ] [REMOTE    ] SAY: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T20:59:40.947753] [INFO ] [REMOTE    ] SAR: Fetching primary data for 2025-06.
[2025-10-24T20:59:41.500152] [INFO ] [REMOTE    ] SAR: Incremental fetch complete for 2025-06 (0.55 seconds).
[2025-10-24T20:59:41.747637] [INFO ] [REMOTE    ] SAT: Fetching primary data for 2025-09.
[2025-10-24T20:59:42.224335] [INFO ] [REMOTE    ] SAT: Incremental fetch complete for 2025-09 (0.48 seconds).
[2025-10-24T20:59:42.547714] [INFO ] [REMOTE    ] SAT: Fetching primary data for 2025-10.
[2025-10-24T20:59:43.284252] [INFO ] [REMOTE    ] SAT: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T20:59:43.284995] [INFO ] [REMOTE    ] SAT: Full fetch complete (1472 records).
[2025-10-24T20:59:43.285062] [DEBUG] [VALIDATOR ] SAT: Validating primary data.
[2025-10-24T20:59:43.285436] [FATAL] [VALIDATOR ] SAT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T20:59:43.285518] [FATAL] [MAIN      ] SAT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T20:59:43.285559] [WARN ] [MAIN      ] SAT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T20:59:43.285596] [INFO ] [LOCAL     ] SAT: Starting deletion of primary data.
[2025-10-24T20:59:43.285679] [DEBUG] [LOCAL     ] SAT: No primary data file found to delete.
[2025-10-24T20:59:43.285767] [INFO ] [LOCAL     ] SAT: Starting deletion of derivative data.
[2025-10-24T20:59:43.285819] [DEBUG] [LOCAL     ] SAT: No derivative data file found to delete.
[2025-10-24T20:59:43.285871] [INFO ] [MAIN      ] Update Progress: 1863/2366 symbols completed. SAT took 17.6s. Estimated remaining: 1h 4m 43s. Rate: 7.8 symbols/min
[2025-10-24T20:59:43.352870] [INFO ] [REMOTE    ] SAZ: Fetching primary data for 2025-01.
[2025-10-24T20:59:43.453311] [INFO ] [MAIN      ] SB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T20:59:43.484854] [DEBUG] [LOCAL     ] SB: Loaded 32641 existing records from primary storage.
[2025-10-24T20:59:43.485109] [INFO ] [MAIN      ] SB: Loaded 32641 existing records.
[2025-10-24T20:59:43.639193] [INFO ] [REMOTE    ] SAZ: Incremental fetch complete for 2025-01 (0.29 seconds).
[2025-10-24T20:59:43.665558] [WARN ] [MAIN      ] SB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T20:59:43.667230] [INFO ] [MAIN      ] SB: Wiping existing primary data before full refresh.
[2025-10-24T20:59:43.667298] [INFO ] [LOCAL     ] SB: Starting deletion of primary data.
[2025-10-24T20:59:43.667678] [DEBUG] [LOCAL     ] SB: Deleted primary data file.
[2025-10-24T20:59:43.667735] [INFO ] [MAIN      ] SB: Starting full primary refresh.
[2025-10-24T20:59:44.012324] [INFO ] [REMOTE    ] SB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T20:59:44.147600] [INFO ] [REMOTE    ] SB: Fetching primary data for 2025-01.
[2025-10-24T20:59:44.947692] [INFO ] [REMOTE    ] SAZ: Fetching primary data for 2025-02.
[2025-10-24T20:59:45.318878] [INFO ] [REMOTE    ] SB: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T20:59:45.403725] [INFO ] [REMOTE    ] SAZ: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T20:59:45.747719] [INFO ] [REMOTE    ] SB: Fetching primary data for 2025-02.
[2025-10-24T20:59:46.451730] [INFO ] [REMOTE    ] SB: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T20:59:46.547608] [INFO ] [REMOTE    ] SB: Fetching primary data for 2025-03.
[2025-10-24T20:59:47.347721] [INFO ] [REMOTE    ] SAZ: Fetching primary data for 2025-03.
[2025-10-24T20:59:47.478908] [INFO ] [REMOTE    ] SB: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T20:59:47.636357] [INFO ] [REMOTE    ] SAZ: Incremental fetch complete for 2025-03 (0.29 seconds).
[2025-10-24T20:59:48.147705] [INFO ] [REMOTE    ] SAY: Fetching primary data for 2025-02.
[2025-10-24T20:59:48.593521] [INFO ] [REMOTE    ] SAY: Incremental fetch complete for 2025-02 (0.45 seconds).
[2025-10-24T20:59:48.947672] [INFO ] [REMOTE    ] SAZ: Fetching primary data for 2025-04.
[2025-10-24T20:59:49.509308] [INFO ] [REMOTE    ] SAZ: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T20:59:49.747704] [INFO ] [REMOTE    ] SAR: Fetching primary data for 2025-07.
[2025-10-24T20:59:50.335604] [INFO ] [REMOTE    ] SAR: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T20:59:50.547698] [INFO ] [REMOTE    ] SB: Fetching primary data for 2025-04.
[2025-10-24T20:59:51.347621] [INFO ] [REMOTE    ] SAZ: Fetching primary data for 2025-05.
[2025-10-24T20:59:51.509427] [INFO ] [REMOTE    ] SB: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T20:59:51.642933] [INFO ] [REMOTE    ] SAZ: Incremental fetch complete for 2025-05 (0.30 seconds).
[2025-10-24T20:59:52.147685] [INFO ] [REMOTE    ] SB: Fetching primary data for 2025-05.
[2025-10-24T20:59:52.947719] [INFO ] [REMOTE    ] SAY: Fetching primary data for 2025-03.
[2025-10-24T20:59:53.165364] [INFO ] [REMOTE    ] SB: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T20:59:53.460132] [INFO ] [REMOTE    ] SAY: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T20:59:53.747672] [INFO ] [REMOTE    ] SAR: Fetching primary data for 2025-08.
[2025-10-24T20:59:54.547681] [INFO ] [REMOTE    ] SAY: Fetching primary data for 2025-04.
[2025-10-24T20:59:54.601901] [INFO ] [REMOTE    ] SAR: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T20:59:54.755975] [INFO ] [REMOTE    ] SAY: Incremental fetch complete for 2025-04 (0.21 seconds).
[2025-10-24T20:59:55.347778] [INFO ] [REMOTE    ] SB: Fetching primary data for 2025-06.
[2025-10-24T20:59:56.147691] [INFO ] [REMOTE    ] SAY: Fetching primary data for 2025-05.
[2025-10-24T20:59:56.407154] [INFO ] [REMOTE    ] SB: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T20:59:56.699032] [INFO ] [REMOTE    ] SAY: Incremental fetch complete for 2025-05 (0.55 seconds).
[2025-10-24T20:59:56.947704] [INFO ] [REMOTE    ] SAY: Fetching primary data for 2025-06.
[2025-10-24T20:59:57.157493] [INFO ] [REMOTE    ] SAY: Incremental fetch complete for 2025-06 (0.21 seconds).
[2025-10-24T20:59:57.747732] [INFO ] [REMOTE    ] SAR: Fetching primary data for 2025-09.
[2025-10-24T20:59:58.547715] [INFO ] [REMOTE    ] SB: Fetching primary data for 2025-07.
[2025-10-24T20:59:58.890992] [INFO ] [REMOTE    ] SAR: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T20:59:59.236809] [INFO ] [REMOTE    ] SB: Incremental fetch complete for 2025-07 (0.69 seconds).
[2025-10-24T20:59:59.347606] [INFO ] [REMOTE    ] SB: Fetching primary data for 2025-08.
[2025-10-24T21:00:00.147669] [INFO ] [REMOTE    ] SAZ: Fetching primary data for 2025-06.
[2025-10-24T21:00:00.343262] [INFO ] [REMOTE    ] SB: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T21:00:00.528176] [INFO ] [REMOTE    ] SAZ: Incremental fetch complete for 2025-06 (0.38 seconds).
[2025-10-24T21:00:00.947748] [INFO ] [REMOTE    ] SB: Fetching primary data for 2025-09.
[2025-10-24T21:00:01.572959] [INFO ] [REMOTE    ] SB: Incremental fetch complete for 2025-09 (0.63 seconds).
[2025-10-24T21:00:01.747731] [INFO ] [REMOTE    ] SAY: Fetching primary data for 2025-07.
[2025-10-24T21:00:01.972254] [INFO ] [REMOTE    ] SAY: Incremental fetch complete for 2025-07 (0.22 seconds).
[2025-10-24T21:00:02.547733] [INFO ] [REMOTE    ] SAR: Fetching primary data for 2025-10.
[2025-10-24T21:00:03.347756] [INFO ] [REMOTE    ] SAZ: Fetching primary data for 2025-07.
[2025-10-24T21:00:03.542862] [INFO ] [REMOTE    ] SAR: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T21:00:03.547107] [INFO ] [REMOTE    ] SAR: Full fetch complete (24026 records).
[2025-10-24T21:00:03.547180] [DEBUG] [VALIDATOR ] SAR: Validating primary data.
[2025-10-24T21:00:03.547636] [FATAL] [VALIDATOR ] SAR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:00:03.547755] [FATAL] [MAIN      ] SAR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:00:03.547797] [WARN ] [MAIN      ] SAR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:00:03.547858] [INFO ] [LOCAL     ] SAR: Starting deletion of primary data.
[2025-10-24T21:00:03.547918] [DEBUG] [LOCAL     ] SAR: No primary data file found to delete.
[2025-10-24T21:00:03.547952] [INFO ] [LOCAL     ] SAR: Starting deletion of derivative data.
[2025-10-24T21:00:03.548122] [DEBUG] [LOCAL     ] SAR: Deleted derivative data file.
[2025-10-24T21:00:03.548204] [INFO ] [MAIN      ] Update Progress: 1864/2366 symbols completed. SAR took 57.5s. Estimated remaining: 1h 4m 38s. Rate: 7.8 symbols/min
[2025-10-24T21:00:03.719278] [INFO ] [MAIN      ] SBDS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:00:03.719460] [DEBUG] [LOCAL     ] SBDS: No existing data file found in primary storage.
[2025-10-24T21:00:03.719497] [WARN ] [MAIN      ] SBDS: No existing data found, performing full refresh instead.
[2025-10-24T21:00:03.719604] [INFO ] [MAIN      ] SBDS: Wiping existing primary data before full refresh.
[2025-10-24T21:00:03.719668] [INFO ] [LOCAL     ] SBDS: Starting deletion of primary data.
[2025-10-24T21:00:03.719734] [DEBUG] [LOCAL     ] SBDS: No primary data file found to delete.
[2025-10-24T21:00:03.719770] [INFO ] [MAIN      ] SBDS: Starting full primary refresh.
[2025-10-24T21:00:03.881714] [INFO ] [REMOTE    ] SAZ: Incremental fetch complete for 2025-07 (0.53 seconds).
[2025-10-24T21:00:04.083427] [INFO ] [REMOTE    ] SBDS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:00:04.147677] [INFO ] [REMOTE    ] SAZ: Fetching primary data for 2025-08.
[2025-10-24T21:00:04.947711] [INFO ] [REMOTE    ] SBDS: Fetching primary data for 2025-01.
[2025-10-24T21:00:05.184716] [INFO ] [REMOTE    ] SAZ: Incremental fetch complete for 2025-08 (1.04 seconds).
[2025-10-24T21:00:05.256227] [DEBUG] [REMOTE    ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:00:05.256536] [WARN ] [REMOTE    ] SBDS: No data returned for month 2025-01
[2025-10-24T21:00:05.256623] [FATAL] [REMOTE    ] SBDS: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:00:05.256729] [FATAL] [MAIN      ] SBDS: Failed to fetch primary data.
[2025-10-24T21:00:05.256796] [WARN ] [MAIN      ] SBDS: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:00:05.256868] [INFO ] [LOCAL     ] SBDS: Starting deletion of primary data.
[2025-10-24T21:00:05.256931] [DEBUG] [LOCAL     ] SBDS: No primary data file found to delete.
[2025-10-24T21:00:05.256965] [INFO ] [LOCAL     ] SBDS: Starting deletion of derivative data.
[2025-10-24T21:00:05.257003] [DEBUG] [LOCAL     ] SBDS: No derivative data file found to delete.
[2025-10-24T21:00:05.257049] [INFO ] [MAIN      ] Update Progress: 1865/2366 symbols completed. SBDS took 1.7s. Estimated remaining: 1h 4m 29s. Rate: 7.8 symbols/min
[2025-10-24T21:00:05.455704] [INFO ] [MAIN      ] SBH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:00:05.504319] [DEBUG] [LOCAL     ] SBH: Loaded 50207 existing records from primary storage.
[2025-10-24T21:00:05.504638] [INFO ] [MAIN      ] SBH: Loaded 50207 existing records.
[2025-10-24T21:00:05.698863] [WARN ] [MAIN      ] SBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:00:05.699094] [INFO ] [MAIN      ] SBH: Wiping existing primary data before full refresh.
[2025-10-24T21:00:05.699145] [INFO ] [LOCAL     ] SBH: Starting deletion of primary data.
[2025-10-24T21:00:05.699547] [DEBUG] [LOCAL     ] SBH: Deleted primary data file.
[2025-10-24T21:00:05.699618] [INFO ] [MAIN      ] SBH: Starting full primary refresh.
[2025-10-24T21:00:05.753256] [INFO ] [REMOTE    ] SAY: Fetching primary data for 2025-08.
[2025-10-24T21:00:06.070132] [INFO ] [REMOTE    ] SBH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:00:06.070315] [INFO ] [REMOTE    ] SAY: Incremental fetch complete for 2025-08 (0.32 seconds).
[2025-10-24T21:00:06.547701] [INFO ] [REMOTE    ] SB: Fetching primary data for 2025-10.
[2025-10-24T21:00:07.347629] [INFO ] [REMOTE    ] SAY: Fetching primary data for 2025-09.
[2025-10-24T21:00:07.505142] [INFO ] [REMOTE    ] SB: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T21:00:07.511748] [INFO ] [REMOTE    ] SB: Full fetch complete (48919 records).
[2025-10-24T21:00:07.511911] [DEBUG] [VALIDATOR ] SB: Validating primary data.
[2025-10-24T21:00:07.513294] [FATAL] [VALIDATOR ] SB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:00:07.513406] [FATAL] [MAIN      ] SB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:00:07.513451] [WARN ] [MAIN      ] SB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:00:07.513493] [INFO ] [LOCAL     ] SB: Starting deletion of primary data.
[2025-10-24T21:00:07.513550] [DEBUG] [LOCAL     ] SB: No primary data file found to delete.
[2025-10-24T21:00:07.513585] [INFO ] [LOCAL     ] SB: Starting deletion of derivative data.
[2025-10-24T21:00:07.513807] [DEBUG] [LOCAL     ] SB: Deleted derivative data file.
[2025-10-24T21:00:07.513901] [INFO ] [MAIN      ] Update Progress: 1866/2366 symbols completed. SB took 24.2s. Estimated remaining: 1h 4m 20s. Rate: 7.8 symbols/min
[2025-10-24T21:00:07.617063] [INFO ] [REMOTE    ] SAY: Incremental fetch complete for 2025-09 (0.27 seconds).
[2025-10-24T21:00:07.688057] [INFO ] [MAIN      ] SBI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:00:07.698907] [DEBUG] [LOCAL     ] SBI: Loaded 7797 existing records from primary storage.
[2025-10-24T21:00:07.699147] [INFO ] [MAIN      ] SBI: Loaded 7797 existing records.
[2025-10-24T21:00:07.870518] [WARN ] [MAIN      ] SBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:00:07.870726] [INFO ] [MAIN      ] SBI: Wiping existing primary data before full refresh.
[2025-10-24T21:00:07.870778] [INFO ] [LOCAL     ] SBI: Starting deletion of primary data.
[2025-10-24T21:00:07.870969] [DEBUG] [LOCAL     ] SBI: Deleted primary data file.
[2025-10-24T21:00:07.871024] [INFO ] [MAIN      ] SBI: Starting full primary refresh.
[2025-10-24T21:00:08.152930] [INFO ] [REMOTE    ] SBH: Fetching primary data for 2025-01.
[2025-10-24T21:00:08.234004] [INFO ] [REMOTE    ] SBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:00:08.947708] [INFO ] [REMOTE    ] SAY: Fetching primary data for 2025-10.
[2025-10-24T21:00:09.452713] [INFO ] [REMOTE    ] SBH: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T21:00:09.636134] [INFO ] [REMOTE    ] SAY: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T21:00:09.636936] [INFO ] [REMOTE    ] SAY: Full fetch complete (1366 records).
[2025-10-24T21:00:09.637002] [DEBUG] [VALIDATOR ] SAY: Validating primary data.
[2025-10-24T21:00:09.637327] [FATAL] [VALIDATOR ] SAY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:00:09.637461] [FATAL] [MAIN      ] SAY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:00:09.637513] [WARN ] [MAIN      ] SAY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:00:09.637553] [INFO ] [LOCAL     ] SAY: Starting deletion of primary data.
[2025-10-24T21:00:09.637623] [DEBUG] [LOCAL     ] SAY: No primary data file found to delete.
[2025-10-24T21:00:09.637692] [INFO ] [LOCAL     ] SAY: Starting deletion of derivative data.
[2025-10-24T21:00:09.637750] [DEBUG] [LOCAL     ] SAY: No derivative data file found to delete.
[2025-10-24T21:00:09.637801] [INFO ] [MAIN      ] Update Progress: 1867/2366 symbols completed. SAY took 32.9s. Estimated remaining: 1h 4m 11s. Rate: 7.8 symbols/min
[2025-10-24T21:00:09.752767] [INFO ] [REMOTE    ] SBH: Fetching primary data for 2025-02.
[2025-10-24T21:00:09.813028] [INFO ] [MAIN      ] SBR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:00:09.822983] [DEBUG] [LOCAL     ] SBR: Loaded 7861 existing records from primary storage.
[2025-10-24T21:00:09.823270] [INFO ] [MAIN      ] SBR: Loaded 7861 existing records.
[2025-10-24T21:00:10.002701] [WARN ] [MAIN      ] SBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:00:10.002931] [INFO ] [MAIN      ] SBR: Wiping existing primary data before full refresh.
[2025-10-24T21:00:10.002977] [INFO ] [LOCAL     ] SBR: Starting deletion of primary data.
[2025-10-24T21:00:10.003184] [DEBUG] [LOCAL     ] SBR: Deleted primary data file.
[2025-10-24T21:00:10.003222] [INFO ] [MAIN      ] SBR: Starting full primary refresh.
[2025-10-24T21:00:10.371102] [INFO ] [REMOTE    ] SBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:00:10.547612] [INFO ] [REMOTE    ] SBR: Fetching primary data for 2025-01.
[2025-10-24T21:00:10.652000] [INFO ] [REMOTE    ] SBH: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T21:00:11.037677] [INFO ] [REMOTE    ] SBR: Incremental fetch complete for 2025-01 (0.49 seconds).
[2025-10-24T21:00:11.347692] [INFO ] [REMOTE    ] SBH: Fetching primary data for 2025-03.
[2025-10-24T21:00:12.147661] [INFO ] [REMOTE    ] SBR: Fetching primary data for 2025-02.
[2025-10-24T21:00:12.545164] [INFO ] [REMOTE    ] SBH: Incremental fetch complete for 2025-03 (1.20 seconds).
[2025-10-24T21:00:12.613141] [INFO ] [REMOTE    ] SBR: Incremental fetch complete for 2025-02 (0.47 seconds).
[2025-10-24T21:00:12.947676] [INFO ] [REMOTE    ] SAZ: Fetching primary data for 2025-09.
[2025-10-24T21:00:13.483484] [INFO ] [REMOTE    ] SAZ: Incremental fetch complete for 2025-09 (0.54 seconds).
[2025-10-24T21:00:13.747630] [INFO ] [REMOTE    ] SBR: Fetching primary data for 2025-03.
[2025-10-24T21:00:14.547678] [INFO ] [REMOTE    ] SAZ: Fetching primary data for 2025-10.
[2025-10-24T21:00:14.919427] [INFO ] [REMOTE    ] SBR: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T21:00:15.009469] [INFO ] [REMOTE    ] SAZ: Incremental fetch complete for 2025-10 (0.46 seconds).
[2025-10-24T21:00:15.010320] [INFO ] [REMOTE    ] SAZ: Full fetch complete (1849 records).
[2025-10-24T21:00:15.010392] [DEBUG] [VALIDATOR ] SAZ: Validating primary data.
[2025-10-24T21:00:15.010787] [FATAL] [VALIDATOR ] SAZ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:00:15.010879] [FATAL] [MAIN      ] SAZ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:00:15.010957] [WARN ] [MAIN      ] SAZ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:00:15.011046] [INFO ] [LOCAL     ] SAZ: Starting deletion of primary data.
[2025-10-24T21:00:15.011123] [DEBUG] [LOCAL     ] SAZ: No primary data file found to delete.
[2025-10-24T21:00:15.011161] [INFO ] [LOCAL     ] SAZ: Starting deletion of derivative data.
[2025-10-24T21:00:15.011201] [DEBUG] [LOCAL     ] SAZ: No derivative data file found to delete.
[2025-10-24T21:00:15.011255] [INFO ] [MAIN      ] Update Progress: 1868/2366 symbols completed. SAZ took 37.0s. Estimated remaining: 1h 4m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:00:15.194536] [INFO ] [MAIN      ] SBS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:00:15.239328] [DEBUG] [LOCAL     ] SBS: Loaded 49623 existing records from primary storage.
[2025-10-24T21:00:15.239612] [INFO ] [MAIN      ] SBS: Loaded 49623 existing records.
[2025-10-24T21:00:15.352731] [INFO ] [REMOTE    ] SBI: Fetching primary data for 2025-01.
[2025-10-24T21:00:15.418483] [WARN ] [MAIN      ] SBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:00:15.418694] [INFO ] [MAIN      ] SBS: Wiping existing primary data before full refresh.
[2025-10-24T21:00:15.418753] [INFO ] [LOCAL     ] SBS: Starting deletion of primary data.
[2025-10-24T21:00:15.419070] [DEBUG] [LOCAL     ] SBS: Deleted primary data file.
[2025-10-24T21:00:15.419126] [INFO ] [MAIN      ] SBS: Starting full primary refresh.
[2025-10-24T21:00:15.771059] [INFO ] [REMOTE    ] SBS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:00:15.960547] [INFO ] [REMOTE    ] SBI: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T21:00:16.147619] [INFO ] [REMOTE    ] SBI: Fetching primary data for 2025-02.
[2025-10-24T21:00:16.536742] [INFO ] [REMOTE    ] SBI: Incremental fetch complete for 2025-02 (0.39 seconds).
[2025-10-24T21:00:16.947639] [INFO ] [REMOTE    ] SBI: Fetching primary data for 2025-03.
[2025-10-24T21:00:17.421329] [INFO ] [REMOTE    ] SBI: Incremental fetch complete for 2025-03 (0.47 seconds).
[2025-10-24T21:00:17.747631] [INFO ] [REMOTE    ] SBR: Fetching primary data for 2025-04.
[2025-10-24T21:00:18.204876] [INFO ] [REMOTE    ] SBR: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T21:00:18.547694] [INFO ] [REMOTE    ] SBR: Fetching primary data for 2025-05.
[2025-10-24T21:00:18.933261] [INFO ] [REMOTE    ] SBR: Incremental fetch complete for 2025-05 (0.39 seconds).
[2025-10-24T21:00:19.347672] [INFO ] [REMOTE    ] SBS: Fetching primary data for 2025-01.
[2025-10-24T21:00:20.119040] [INFO ] [REMOTE    ] SBS: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T21:00:20.147621] [INFO ] [REMOTE    ] SBH: Fetching primary data for 2025-04.
[2025-10-24T21:00:20.947628] [INFO ] [REMOTE    ] SBS: Fetching primary data for 2025-02.
[2025-10-24T21:00:21.221428] [INFO ] [REMOTE    ] SBH: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T21:00:21.747667] [INFO ] [REMOTE    ] SBR: Fetching primary data for 2025-06.
[2025-10-24T21:00:22.000709] [INFO ] [REMOTE    ] SBS: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T21:00:22.208128] [INFO ] [REMOTE    ] SBR: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T21:00:22.547680] [INFO ] [REMOTE    ] SBH: Fetching primary data for 2025-05.
[2025-10-24T21:00:23.347635] [INFO ] [REMOTE    ] SBR: Fetching primary data for 2025-07.
[2025-10-24T21:00:23.580405] [INFO ] [REMOTE    ] SBH: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T21:00:23.721183] [INFO ] [REMOTE    ] SBR: Incremental fetch complete for 2025-07 (0.37 seconds).
[2025-10-24T21:00:24.147705] [INFO ] [REMOTE    ] SBI: Fetching primary data for 2025-04.
[2025-10-24T21:00:24.612752] [INFO ] [REMOTE    ] SBI: Incremental fetch complete for 2025-04 (0.47 seconds).
[2025-10-24T21:00:24.947670] [INFO ] [REMOTE    ] SBS: Fetching primary data for 2025-03.
[2025-10-24T21:00:25.740584] [INFO ] [REMOTE    ] SBS: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T21:00:25.750169] [INFO ] [REMOTE    ] SBH: Fetching primary data for 2025-06.
[2025-10-24T21:00:26.487011] [INFO ] [REMOTE    ] SBH: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T21:00:26.547604] [INFO ] [REMOTE    ] SBH: Fetching primary data for 2025-07.
[2025-10-24T21:00:27.353378] [INFO ] [REMOTE    ] SBI: Fetching primary data for 2025-05.
[2025-10-24T21:00:27.375119] [INFO ] [REMOTE    ] SBH: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T21:00:27.756898] [INFO ] [REMOTE    ] SBI: Incremental fetch complete for 2025-05 (0.40 seconds).
[2025-10-24T21:00:28.147712] [INFO ] [REMOTE    ] SBR: Fetching primary data for 2025-08.
[2025-10-24T21:00:28.633096] [INFO ] [REMOTE    ] SBR: Incremental fetch complete for 2025-08 (0.49 seconds).
[2025-10-24T21:00:28.947678] [INFO ] [REMOTE    ] SBH: Fetching primary data for 2025-08.
[2025-10-24T21:00:29.641590] [INFO ] [REMOTE    ] SBH: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T21:00:29.747623] [INFO ] [REMOTE    ] SBH: Fetching primary data for 2025-09.
[2025-10-24T21:00:30.547670] [INFO ] [REMOTE    ] SBR: Fetching primary data for 2025-09.
[2025-10-24T21:00:31.035519] [INFO ] [REMOTE    ] SBH: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T21:00:31.068357] [INFO ] [REMOTE    ] SBR: Incremental fetch complete for 2025-09 (0.52 seconds).
[2025-10-24T21:00:31.347662] [INFO ] [REMOTE    ] SBS: Fetching primary data for 2025-04.
[2025-10-24T21:00:32.147618] [INFO ] [REMOTE    ] SBH: Fetching primary data for 2025-10.
[2025-10-24T21:00:32.457227] [INFO ] [REMOTE    ] SBS: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T21:00:32.547462] [INFO ] [REMOTE    ] SBH: Incremental fetch complete for 2025-10 (0.40 seconds).
[2025-10-24T21:00:32.556748] [INFO ] [REMOTE    ] SBH: Full fetch complete (72642 records).
[2025-10-24T21:00:32.556867] [DEBUG] [VALIDATOR ] SBH: Validating primary data.
[2025-10-24T21:00:32.557614] [FATAL] [VALIDATOR ] SBH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:00:32.557721] [FATAL] [MAIN      ] SBH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:00:32.557764] [WARN ] [MAIN      ] SBH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:00:32.557801] [INFO ] [LOCAL     ] SBH: Starting deletion of primary data.
[2025-10-24T21:00:32.557856] [DEBUG] [LOCAL     ] SBH: No primary data file found to delete.
[2025-10-24T21:00:32.557893] [INFO ] [LOCAL     ] SBH: Starting deletion of derivative data.
[2025-10-24T21:00:32.558071] [DEBUG] [LOCAL     ] SBH: Deleted derivative data file.
[2025-10-24T21:00:32.558364] [INFO ] [MAIN      ] Update Progress: 1869/2366 symbols completed. SBH took 27.3s. Estimated remaining: 1h 3m 57s. Rate: 7.8 symbols/min
[2025-10-24T21:00:32.727847] [INFO ] [MAIN      ] SBSI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:00:32.745509] [DEBUG] [LOCAL     ] SBSI: Loaded 14898 existing records from primary storage.
[2025-10-24T21:00:32.745789] [INFO ] [MAIN      ] SBSI: Loaded 14898 existing records.
[2025-10-24T21:00:32.921314] [WARN ] [MAIN      ] SBSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:00:32.921520] [INFO ] [MAIN      ] SBSI: Wiping existing primary data before full refresh.
[2025-10-24T21:00:32.921567] [INFO ] [LOCAL     ] SBSI: Starting deletion of primary data.
[2025-10-24T21:00:32.921795] [DEBUG] [LOCAL     ] SBSI: Deleted primary data file.
[2025-10-24T21:00:32.921852] [INFO ] [MAIN      ] SBSI: Starting full primary refresh.
[2025-10-24T21:00:32.952777] [INFO ] [REMOTE    ] SBR: Fetching primary data for 2025-10.
[2025-10-24T21:00:33.276871] [INFO ] [REMOTE    ] SBSI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:00:33.566394] [INFO ] [REMOTE    ] SBR: Incremental fetch complete for 2025-10 (0.61 seconds).
[2025-10-24T21:00:33.568766] [INFO ] [REMOTE    ] SBR: Full fetch complete (11332 records).
[2025-10-24T21:00:33.568854] [DEBUG] [VALIDATOR ] SBR: Validating primary data.
[2025-10-24T21:00:33.569236] [FATAL] [VALIDATOR ] SBR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:00:33.569317] [FATAL] [MAIN      ] SBR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:00:33.569375] [WARN ] [MAIN      ] SBR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:00:33.569441] [INFO ] [LOCAL     ] SBR: Starting deletion of primary data.
[2025-10-24T21:00:33.569501] [DEBUG] [LOCAL     ] SBR: No primary data file found to delete.
[2025-10-24T21:00:33.569535] [INFO ] [LOCAL     ] SBR: Starting deletion of derivative data.
[2025-10-24T21:00:33.569712] [DEBUG] [LOCAL     ] SBR: Deleted derivative data file.
[2025-10-24T21:00:33.569794] [INFO ] [MAIN      ] Update Progress: 1870/2366 symbols completed. SBR took 23.9s. Estimated remaining: 1h 3m 48s. Rate: 7.8 symbols/min
[2025-10-24T21:00:33.753713] [INFO ] [REMOTE    ] SBI: Fetching primary data for 2025-06.
[2025-10-24T21:00:33.756346] [INFO ] [MAIN      ] SBSW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:00:33.757260] [DEBUG] [LOCAL     ] SBSW: No existing data file found in primary storage.
[2025-10-24T21:00:33.757313] [WARN ] [MAIN      ] SBSW: No existing data found, performing full refresh instead.
[2025-10-24T21:00:33.757451] [INFO ] [MAIN      ] SBSW: Wiping existing primary data before full refresh.
[2025-10-24T21:00:33.757503] [INFO ] [LOCAL     ] SBSW: Starting deletion of primary data.
[2025-10-24T21:00:33.757546] [DEBUG] [LOCAL     ] SBSW: No primary data file found to delete.
[2025-10-24T21:00:33.757577] [INFO ] [MAIN      ] SBSW: Starting full primary refresh.
[2025-10-24T21:00:34.115902] [INFO ] [REMOTE    ] SBSW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:00:34.295821] [INFO ] [REMOTE    ] SBI: Incremental fetch complete for 2025-06 (0.54 seconds).
[2025-10-24T21:00:34.547714] [INFO ] [REMOTE    ] SBI: Fetching primary data for 2025-07.
[2025-10-24T21:00:35.001094] [INFO ] [REMOTE    ] SBI: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T21:00:35.347671] [INFO ] [REMOTE    ] SBSI: Fetching primary data for 2025-01.
[2025-10-24T21:00:36.147732] [INFO ] [REMOTE    ] SBI: Fetching primary data for 2025-08.
[2025-10-24T21:00:36.448407] [INFO ] [REMOTE    ] SBSI: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T21:00:36.634883] [INFO ] [REMOTE    ] SBI: Incremental fetch complete for 2025-08 (0.49 seconds).
[2025-10-24T21:00:36.947734] [INFO ] [REMOTE    ] SBS: Fetching primary data for 2025-05.
[2025-10-24T21:00:37.747610] [INFO ] [REMOTE    ] SBI: Fetching primary data for 2025-09.
[2025-10-24T21:00:38.014908] [INFO ] [REMOTE    ] SBS: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T21:00:38.130039] [INFO ] [REMOTE    ] SBI: Incremental fetch complete for 2025-09 (0.38 seconds).
[2025-10-24T21:00:38.547696] [INFO ] [REMOTE    ] SBS: Fetching primary data for 2025-06.
[2025-10-24T21:00:39.342730] [INFO ] [REMOTE    ] SBS: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T21:00:39.352046] [INFO ] [REMOTE    ] SBSI: Fetching primary data for 2025-02.
[2025-10-24T21:00:39.786128] [INFO ] [REMOTE    ] SBSI: Incremental fetch complete for 2025-02 (0.43 seconds).
[2025-10-24T21:00:40.147670] [INFO ] [REMOTE    ] SBI: Fetching primary data for 2025-10.
[2025-10-24T21:00:40.695238] [INFO ] [REMOTE    ] SBI: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T21:00:40.697045] [INFO ] [REMOTE    ] SBI: Full fetch complete (10575 records).
[2025-10-24T21:00:40.697115] [DEBUG] [VALIDATOR ] SBI: Validating primary data.
[2025-10-24T21:00:40.697530] [FATAL] [VALIDATOR ] SBI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:00:40.697610] [FATAL] [MAIN      ] SBI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:00:40.697798] [WARN ] [MAIN      ] SBI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:00:40.697871] [INFO ] [LOCAL     ] SBI: Starting deletion of primary data.
[2025-10-24T21:00:40.697931] [DEBUG] [LOCAL     ] SBI: No primary data file found to delete.
[2025-10-24T21:00:40.697985] [INFO ] [LOCAL     ] SBI: Starting deletion of derivative data.
[2025-10-24T21:00:40.698161] [DEBUG] [LOCAL     ] SBI: Deleted derivative data file.
[2025-10-24T21:00:40.698244] [INFO ] [MAIN      ] Update Progress: 1871/2366 symbols completed. SBI took 33.2s. Estimated remaining: 1h 3m 40s. Rate: 7.8 symbols/min
[2025-10-24T21:00:40.864594] [INFO ] [MAIN      ] SBXD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:00:40.864827] [DEBUG] [LOCAL     ] SBXD: No existing data file found in primary storage.
[2025-10-24T21:00:40.864869] [WARN ] [MAIN      ] SBXD: No existing data found, performing full refresh instead.
[2025-10-24T21:00:40.864980] [INFO ] [MAIN      ] SBXD: Wiping existing primary data before full refresh.
[2025-10-24T21:00:40.865021] [INFO ] [LOCAL     ] SBXD: Starting deletion of primary data.
[2025-10-24T21:00:40.865062] [DEBUG] [LOCAL     ] SBXD: No primary data file found to delete.
[2025-10-24T21:00:40.865096] [INFO ] [MAIN      ] SBXD: Starting full primary refresh.
[2025-10-24T21:00:40.952924] [INFO ] [REMOTE    ] SBSI: Fetching primary data for 2025-03.
[2025-10-24T21:00:41.216169] [INFO ] [REMOTE    ] SBXD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:00:41.544831] [INFO ] [REMOTE    ] SBSI: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T21:00:41.747681] [INFO ] [REMOTE    ] SBS: Fetching primary data for 2025-07.
[2025-10-24T21:00:42.528766] [INFO ] [REMOTE    ] SBS: Incremental fetch complete for 2025-07 (0.78 seconds).
[2025-10-24T21:00:42.547612] [INFO ] [REMOTE    ] SBS: Fetching primary data for 2025-08.
[2025-10-24T21:00:43.298941] [INFO ] [REMOTE    ] SBS: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T21:00:43.347610] [INFO ] [REMOTE    ] SBSI: Fetching primary data for 2025-04.
[2025-10-24T21:00:43.934231] [INFO ] [REMOTE    ] SBSI: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T21:00:44.147691] [INFO ] [REMOTE    ] SBS: Fetching primary data for 2025-09.
[2025-10-24T21:00:44.950509] [INFO ] [REMOTE    ] SBSW: Fetching primary data for 2025-01.
[2025-10-24T21:00:44.956253] [INFO ] [REMOTE    ] SBS: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T21:00:45.732229] [INFO ] [REMOTE    ] SBSW: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T21:00:45.747610] [INFO ] [REMOTE    ] SBSW: Fetching primary data for 2025-02.
[2025-10-24T21:00:46.554240] [INFO ] [REMOTE    ] SBS: Fetching primary data for 2025-10.
[2025-10-24T21:00:46.563800] [INFO ] [REMOTE    ] SBSW: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T21:00:47.297327] [INFO ] [REMOTE    ] SBS: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T21:00:47.306277] [INFO ] [REMOTE    ] SBS: Full fetch complete (70330 records).
[2025-10-24T21:00:47.306430] [DEBUG] [VALIDATOR ] SBS: Validating primary data.
[2025-10-24T21:00:47.307242] [FATAL] [VALIDATOR ] SBS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:00:47.307339] [FATAL] [MAIN      ] SBS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:00:47.307412] [WARN ] [MAIN      ] SBS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:00:47.307457] [INFO ] [LOCAL     ] SBS: Starting deletion of primary data.
[2025-10-24T21:00:47.307513] [DEBUG] [LOCAL     ] SBS: No primary data file found to delete.
[2025-10-24T21:00:47.307547] [INFO ] [LOCAL     ] SBS: Starting deletion of derivative data.
[2025-10-24T21:00:47.307741] [DEBUG] [LOCAL     ] SBS: Deleted derivative data file.
[2025-10-24T21:00:47.308025] [INFO ] [MAIN      ] Update Progress: 1872/2366 symbols completed. SBS took 32.3s. Estimated remaining: 1h 3m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:00:47.352856] [INFO ] [REMOTE    ] SBXD: Fetching primary data for 2025-01.
[2025-10-24T21:00:47.479277] [INFO ] [MAIN      ] SCCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:00:47.527946] [DEBUG] [LOCAL     ] SCCO: Loaded 49917 existing records from primary storage.
[2025-10-24T21:00:47.528245] [INFO ] [MAIN      ] SCCO: Loaded 49917 existing records.
[2025-10-24T21:00:47.704674] [WARN ] [MAIN      ] SCCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:00:47.704905] [INFO ] [MAIN      ] SCCO: Wiping existing primary data before full refresh.
[2025-10-24T21:00:47.704950] [INFO ] [LOCAL     ] SCCO: Starting deletion of primary data.
[2025-10-24T21:00:47.705211] [DEBUG] [LOCAL     ] SCCO: Deleted primary data file.
[2025-10-24T21:00:47.705266] [INFO ] [MAIN      ] SCCO: Starting full primary refresh.
[2025-10-24T21:00:47.977542] [INFO ] [REMOTE    ] SBXD: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T21:00:48.065848] [INFO ] [REMOTE    ] SCCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:00:48.147688] [INFO ] [REMOTE    ] SCCO: Fetching primary data for 2025-01.
[2025-10-24T21:00:48.947723] [INFO ] [REMOTE    ] SBSW: Fetching primary data for 2025-03.
[2025-10-24T21:00:49.204766] [INFO ] [REMOTE    ] SCCO: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T21:00:49.747676] [INFO ] [REMOTE    ] SBXD: Fetching primary data for 2025-02.
[2025-10-24T21:00:49.952827] [INFO ] [REMOTE    ] SBXD: Incremental fetch complete for 2025-02 (0.21 seconds).
[2025-10-24T21:00:50.547728] [INFO ] [REMOTE    ] SBXD: Fetching primary data for 2025-03.
[2025-10-24T21:00:50.674012] [INFO ] [REMOTE    ] SBXD: Incremental fetch complete for 2025-03 (0.13 seconds).
[2025-10-24T21:00:51.143010] [INFO ] [REMOTE    ] SBSW: Incremental fetch complete for 2025-03 (2.20 seconds).
[2025-10-24T21:00:51.347713] [INFO ] [REMOTE    ] SBSI: Fetching primary data for 2025-05.
[2025-10-24T21:00:52.147717] [INFO ] [REMOTE    ] SCCO: Fetching primary data for 2025-02.
[2025-10-24T21:00:52.511368] [INFO ] [REMOTE    ] SBSI: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T21:00:52.933032] [INFO ] [REMOTE    ] SCCO: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T21:00:52.947599] [INFO ] [REMOTE    ] SCCO: Fetching primary data for 2025-03.
[2025-10-24T21:00:53.749726] [INFO ] [REMOTE    ] SBSW: Fetching primary data for 2025-04.
[2025-10-24T21:00:53.752767] [INFO ] [REMOTE    ] SCCO: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T21:00:54.547635] [INFO ] [REMOTE    ] SCCO: Fetching primary data for 2025-04.
[2025-10-24T21:00:55.314370] [INFO ] [REMOTE    ] SCCO: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T21:00:55.347607] [INFO ] [REMOTE    ] SCCO: Fetching primary data for 2025-05.
[2025-10-24T21:00:55.797667] [INFO ] [REMOTE    ] SBSW: Incremental fetch complete for 2025-04 (2.05 seconds).
[2025-10-24T21:00:56.107752] [INFO ] [REMOTE    ] SCCO: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T21:00:56.147614] [INFO ] [REMOTE    ] SCCO: Fetching primary data for 2025-06.
[2025-10-24T21:00:56.947746] [INFO ] [REMOTE    ] SBSI: Fetching primary data for 2025-06.
[2025-10-24T21:00:57.413754] [INFO ] [REMOTE    ] SCCO: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T21:00:57.526093] [INFO ] [REMOTE    ] SBSI: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T21:00:57.747678] [INFO ] [REMOTE    ] SBXD: Fetching primary data for 2025-04.
[2025-10-24T21:00:57.878227] [INFO ] [REMOTE    ] SBXD: Incremental fetch complete for 2025-04 (0.13 seconds).
[2025-10-24T21:00:58.547634] [INFO ] [REMOTE    ] SBXD: Fetching primary data for 2025-05.
[2025-10-24T21:00:58.755699] [INFO ] [REMOTE    ] SBXD: Incremental fetch complete for 2025-05 (0.21 seconds).
[2025-10-24T21:00:59.347672] [INFO ] [REMOTE    ] SBXD: Fetching primary data for 2025-06.
[2025-10-24T21:00:59.813512] [INFO ] [REMOTE    ] SBXD: Incremental fetch complete for 2025-06 (0.47 seconds).
[2025-10-24T21:01:00.147678] [INFO ] [REMOTE    ] SBSW: Fetching primary data for 2025-05.
[2025-10-24T21:01:00.947706] [INFO ] [REMOTE    ] SBSI: Fetching primary data for 2025-07.
[2025-10-24T21:01:01.557198] [INFO ] [REMOTE    ] SBSI: Incremental fetch complete for 2025-07 (0.61 seconds).
[2025-10-24T21:01:01.747634] [INFO ] [REMOTE    ] SBXD: Fetching primary data for 2025-07.
[2025-10-24T21:01:02.122119] [INFO ] [REMOTE    ] SBXD: Incremental fetch complete for 2025-07 (0.37 seconds).
[2025-10-24T21:01:02.282060] [INFO ] [REMOTE    ] SBSW: Incremental fetch complete for 2025-05 (2.13 seconds).
[2025-10-24T21:01:02.547675] [INFO ] [REMOTE    ] SBXD: Fetching primary data for 2025-08.
[2025-10-24T21:01:03.347699] [INFO ] [REMOTE    ] SCCO: Fetching primary data for 2025-07.
[2025-10-24T21:01:03.593746] [INFO ] [REMOTE    ] SBXD: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T21:01:04.010943] [INFO ] [REMOTE    ] SCCO: Incremental fetch complete for 2025-07 (0.66 seconds).
[2025-10-24T21:01:04.147682] [INFO ] [REMOTE    ] SCCO: Fetching primary data for 2025-08.
[2025-10-24T21:01:04.923795] [INFO ] [REMOTE    ] SCCO: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T21:01:04.947702] [INFO ] [REMOTE    ] SBSI: Fetching primary data for 2025-08.
[2025-10-24T21:01:05.535501] [INFO ] [REMOTE    ] SBSI: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T21:01:05.747697] [INFO ] [REMOTE    ] SCCO: Fetching primary data for 2025-09.
[2025-10-24T21:01:06.547690] [INFO ] [REMOTE    ] SBXD: Fetching primary data for 2025-09.
[2025-10-24T21:01:06.759814] [INFO ] [REMOTE    ] SBXD: Incremental fetch complete for 2025-09 (0.21 seconds).
[2025-10-24T21:01:07.034122] [INFO ] [REMOTE    ] SCCO: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T21:01:07.347688] [INFO ] [REMOTE    ] SBXD: Fetching primary data for 2025-10.
[2025-10-24T21:01:07.550199] [INFO ] [REMOTE    ] SBXD: Incremental fetch complete for 2025-10 (0.20 seconds).
[2025-10-24T21:01:07.551222] [INFO ] [REMOTE    ] SBXD: Full fetch complete (3136 records).
[2025-10-24T21:01:07.551298] [DEBUG] [VALIDATOR ] SBXD: Validating primary data.
[2025-10-24T21:01:07.551784] [FATAL] [VALIDATOR ] SBXD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:01:07.551872] [FATAL] [MAIN      ] SBXD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:01:07.551917] [WARN ] [MAIN      ] SBXD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:01:07.551958] [INFO ] [LOCAL     ] SBXD: Starting deletion of primary data.
[2025-10-24T21:01:07.552025] [DEBUG] [LOCAL     ] SBXD: No primary data file found to delete.
[2025-10-24T21:01:07.552100] [INFO ] [LOCAL     ] SBXD: Starting deletion of derivative data.
[2025-10-24T21:01:07.552183] [DEBUG] [LOCAL     ] SBXD: No derivative data file found to delete.
[2025-10-24T21:01:07.552265] [INFO ] [MAIN      ] Update Progress: 1873/2366 symbols completed. SBXD took 26.9s. Estimated remaining: 1h 3m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:01:07.762900] [INFO ] [MAIN      ] SCD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:01:07.782398] [DEBUG] [LOCAL     ] SCD: Loaded 13638 existing records from primary storage.
[2025-10-24T21:01:07.782683] [INFO ] [MAIN      ] SCD: Loaded 13638 existing records.
[2025-10-24T21:01:07.980521] [WARN ] [MAIN      ] SCD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:01:07.980775] [INFO ] [MAIN      ] SCD: Wiping existing primary data before full refresh.
[2025-10-24T21:01:07.980825] [INFO ] [LOCAL     ] SCD: Starting deletion of primary data.
[2025-10-24T21:01:07.981043] [DEBUG] [LOCAL     ] SCD: Deleted primary data file.
[2025-10-24T21:01:07.981098] [INFO ] [MAIN      ] SCD: Starting full primary refresh.
[2025-10-24T21:01:08.157799] [INFO ] [REMOTE    ] SBSI: Fetching primary data for 2025-09.
[2025-10-24T21:01:08.332831] [INFO ] [REMOTE    ] SCD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:01:08.947693] [INFO ] [REMOTE    ] SBSW: Fetching primary data for 2025-06.
[2025-10-24T21:01:09.096413] [INFO ] [REMOTE    ] SBSI: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T21:01:09.747697] [INFO ] [REMOTE    ] SCD: Fetching primary data for 2025-01.
[2025-10-24T21:01:10.547626] [INFO ] [REMOTE    ] SBSI: Fetching primary data for 2025-10.
[2025-10-24T21:01:10.731989] [INFO ] [REMOTE    ] SCD: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T21:01:10.889247] [INFO ] [REMOTE    ] SBSW: Incremental fetch complete for 2025-06 (1.94 seconds).
[2025-10-24T21:01:11.313293] [INFO ] [REMOTE    ] SBSI: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T21:01:11.316690] [INFO ] [REMOTE    ] SBSI: Full fetch complete (21234 records).
[2025-10-24T21:01:11.316764] [DEBUG] [VALIDATOR ] SBSI: Validating primary data.
[2025-10-24T21:01:11.317155] [FATAL] [VALIDATOR ] SBSI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:01:11.317233] [FATAL] [MAIN      ] SBSI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:01:11.317301] [WARN ] [MAIN      ] SBSI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:01:11.317393] [INFO ] [LOCAL     ] SBSI: Starting deletion of primary data.
[2025-10-24T21:01:11.317462] [DEBUG] [LOCAL     ] SBSI: No primary data file found to delete.
[2025-10-24T21:01:11.317497] [INFO ] [LOCAL     ] SBSI: Starting deletion of derivative data.
[2025-10-24T21:01:11.317664] [DEBUG] [LOCAL     ] SBSI: Deleted derivative data file.
[2025-10-24T21:01:11.317753] [INFO ] [MAIN      ] Update Progress: 1874/2366 symbols completed. SBSI took 38.8s. Estimated remaining: 1h 3m 19s. Rate: 7.8 symbols/min
[2025-10-24T21:01:11.352782] [INFO ] [REMOTE    ] SBSW: Fetching primary data for 2025-07.
[2025-10-24T21:01:11.488593] [INFO ] [MAIN      ] SCHW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:01:11.537167] [DEBUG] [LOCAL     ] SCHW: Loaded 54075 existing records from primary storage.
[2025-10-24T21:01:11.537500] [INFO ] [MAIN      ] SCHW: Loaded 54075 existing records.
[2025-10-24T21:01:11.711726] [WARN ] [MAIN      ] SCHW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:01:11.711920] [INFO ] [MAIN      ] SCHW: Wiping existing primary data before full refresh.
[2025-10-24T21:01:11.711966] [INFO ] [LOCAL     ] SCHW: Starting deletion of primary data.
[2025-10-24T21:01:11.712376] [DEBUG] [LOCAL     ] SCHW: Deleted primary data file.
[2025-10-24T21:01:11.712415] [INFO ] [MAIN      ] SCHW: Starting full primary refresh.
[2025-10-24T21:01:12.059019] [INFO ] [REMOTE    ] SCHW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:01:12.147606] [INFO ] [REMOTE    ] SCHW: Fetching primary data for 2025-01.
[2025-10-24T21:01:12.947615] [INFO ] [REMOTE    ] SCCO: Fetching primary data for 2025-10.
[2025-10-24T21:01:13.222244] [INFO ] [REMOTE    ] SCHW: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T21:01:13.617049] [INFO ] [REMOTE    ] SBSW: Incremental fetch complete for 2025-07 (2.26 seconds).
[2025-10-24T21:01:13.747626] [INFO ] [REMOTE    ] SBSW: Fetching primary data for 2025-08.
[2025-10-24T21:01:13.990889] [INFO ] [REMOTE    ] SCCO: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T21:01:14.001358] [INFO ] [REMOTE    ] SCCO: Full fetch complete (71514 records).
[2025-10-24T21:01:14.001491] [DEBUG] [VALIDATOR ] SCCO: Validating primary data.
[2025-10-24T21:01:14.002283] [FATAL] [VALIDATOR ] SCCO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:01:14.002384] [FATAL] [MAIN      ] SCCO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:01:14.002427] [WARN ] [MAIN      ] SCCO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:01:14.002465] [INFO ] [LOCAL     ] SCCO: Starting deletion of primary data.
[2025-10-24T21:01:14.002521] [DEBUG] [LOCAL     ] SCCO: No primary data file found to delete.
[2025-10-24T21:01:14.002556] [INFO ] [LOCAL     ] SCCO: Starting deletion of derivative data.
[2025-10-24T21:01:14.002726] [DEBUG] [LOCAL     ] SCCO: Deleted derivative data file.
[2025-10-24T21:01:14.003211] [INFO ] [MAIN      ] Update Progress: 1875/2366 symbols completed. SCCO took 26.7s. Estimated remaining: 1h 3m 9s. Rate: 7.8 symbols/min
[2025-10-24T21:01:14.182526] [INFO ] [MAIN      ] SCI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:01:14.228022] [DEBUG] [LOCAL     ] SCI: Loaded 46439 existing records from primary storage.
[2025-10-24T21:01:14.228401] [INFO ] [MAIN      ] SCI: Loaded 46439 existing records.
[2025-10-24T21:01:14.434137] [WARN ] [MAIN      ] SCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:01:14.434354] [INFO ] [MAIN      ] SCI: Wiping existing primary data before full refresh.
[2025-10-24T21:01:14.434401] [INFO ] [LOCAL     ] SCI: Starting deletion of primary data.
[2025-10-24T21:01:14.434983] [DEBUG] [LOCAL     ] SCI: Deleted primary data file.
[2025-10-24T21:01:14.435039] [INFO ] [MAIN      ] SCI: Starting full primary refresh.
[2025-10-24T21:01:14.551615] [INFO ] [REMOTE    ] SCHW: Fetching primary data for 2025-02.
[2025-10-24T21:01:14.835205] [INFO ] [REMOTE    ] SCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:01:15.347620] [INFO ] [REMOTE    ] SCI: Fetching primary data for 2025-01.
[2025-10-24T21:01:15.376065] [INFO ] [REMOTE    ] SCHW: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T21:01:15.862001] [INFO ] [REMOTE    ] SBSW: Incremental fetch complete for 2025-08 (2.11 seconds).
[2025-10-24T21:01:16.147625] [INFO ] [REMOTE    ] SCD: Fetching primary data for 2025-02.
[2025-10-24T21:01:16.380477] [INFO ] [REMOTE    ] SCI: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T21:01:16.930406] [INFO ] [REMOTE    ] SCD: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T21:01:16.947600] [INFO ] [REMOTE    ] SCD: Fetching primary data for 2025-03.
[2025-10-24T21:01:17.421058] [INFO ] [REMOTE    ] SCD: Incremental fetch complete for 2025-03 (0.47 seconds).
[2025-10-24T21:01:17.747630] [INFO ] [REMOTE    ] SCI: Fetching primary data for 2025-02.
[2025-10-24T21:01:18.500974] [INFO ] [REMOTE    ] SCI: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T21:01:18.547610] [INFO ] [REMOTE    ] SCI: Fetching primary data for 2025-03.
[2025-10-24T21:01:19.347671] [INFO ] [REMOTE    ] SBSW: Fetching primary data for 2025-09.
[2025-10-24T21:01:19.484709] [INFO ] [REMOTE    ] SCI: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T21:01:20.147709] [INFO ] [REMOTE    ] SCI: Fetching primary data for 2025-04.
[2025-10-24T21:01:20.943520] [INFO ] [REMOTE    ] SCI: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T21:01:20.953162] [INFO ] [REMOTE    ] SCHW: Fetching primary data for 2025-03.
[2025-10-24T21:01:21.369865] [INFO ] [REMOTE    ] SBSW: Incremental fetch complete for 2025-09 (2.02 seconds).
[2025-10-24T21:01:21.747633] [INFO ] [REMOTE    ] SCD: Fetching primary data for 2025-04.
[2025-10-24T21:01:21.834934] [INFO ] [REMOTE    ] SCHW: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T21:01:22.500838] [INFO ] [REMOTE    ] SCD: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T21:01:22.547617] [INFO ] [REMOTE    ] SCHW: Fetching primary data for 2025-04.
[2025-10-24T21:01:23.347632] [INFO ] [REMOTE    ] SCI: Fetching primary data for 2025-05.
[2025-10-24T21:01:23.422270] [INFO ] [REMOTE    ] SCHW: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T21:01:23.875241] [INFO ] [REMOTE    ] SCI: Incremental fetch complete for 2025-05 (0.53 seconds).
[2025-10-24T21:01:24.147703] [INFO ] [REMOTE    ] SCI: Fetching primary data for 2025-06.
[2025-10-24T21:01:24.947672] [INFO ] [REMOTE    ] SCHW: Fetching primary data for 2025-05.
[2025-10-24T21:01:25.237731] [INFO ] [REMOTE    ] SCI: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T21:01:25.747619] [INFO ] [REMOTE    ] SCI: Fetching primary data for 2025-07.
[2025-10-24T21:01:26.077698] [INFO ] [REMOTE    ] SCHW: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T21:01:26.547617] [INFO ] [REMOTE    ] SBSW: Fetching primary data for 2025-10.
[2025-10-24T21:01:26.673402] [INFO ] [REMOTE    ] SCI: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T21:01:27.347733] [INFO ] [REMOTE    ] SCHW: Fetching primary data for 2025-06.
[2025-10-24T21:01:28.147715] [INFO ] [REMOTE    ] SCD: Fetching primary data for 2025-05.
[2025-10-24T21:01:28.493505] [INFO ] [REMOTE    ] SCHW: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T21:01:28.863518] [INFO ] [REMOTE    ] SBSW: Incremental fetch complete for 2025-10 (2.32 seconds).
[2025-10-24T21:01:28.874014] [INFO ] [REMOTE    ] SBSW: Full fetch complete (76768 records).
[2025-10-24T21:01:28.874180] [DEBUG] [VALIDATOR ] SBSW: Validating primary data.
[2025-10-24T21:01:28.952375] [INFO ] [REMOTE    ] SCI: Fetching primary data for 2025-08.
[2025-10-24T21:01:28.984166] [INFO ] [REMOTE    ] SCD: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T21:01:29.280424] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present.
[2025-10-24T21:01:29.280504] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed.
[2025-10-24T21:01:29.281689] [INFO ] [MAIN      ] SBSW: Fetched primary data is valid.
[2025-10-24T21:01:29.281752] [DEBUG] [LOCAL     ] SBSW: Saving primary data.
[2025-10-24T21:01:29.282327] [FATAL] [LOCAL     ] SBSW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:01:29.282436] [FATAL] [MAIN      ] SBSW: Failed to save primary data.
[2025-10-24T21:01:29.282478] [WARN ] [MAIN      ] SBSW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:01:29.282514] [INFO ] [LOCAL     ] SBSW: Starting deletion of primary data.
[2025-10-24T21:01:29.282565] [DEBUG] [LOCAL     ] SBSW: No primary data file found to delete.
[2025-10-24T21:01:29.282601] [INFO ] [LOCAL     ] SBSW: Starting deletion of derivative data.
[2025-10-24T21:01:29.282661] [DEBUG] [LOCAL     ] SBSW: No derivative data file found to delete.
[2025-10-24T21:01:29.283170] [INFO ] [MAIN      ] Update Progress: 1876/2366 symbols completed. SBSW took 55.7s. Estimated remaining: 1h 3m 4s. Rate: 7.8 symbols/min
[2025-10-24T21:01:29.450342] [INFO ] [MAIN      ] SCL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:01:29.466731] [DEBUG] [LOCAL     ] SCL: Loaded 15300 existing records from primary storage.
[2025-10-24T21:01:29.466958] [INFO ] [MAIN      ] SCL: Loaded 15300 existing records.
[2025-10-24T21:01:29.643246] [WARN ] [MAIN      ] SCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:01:29.643431] [INFO ] [MAIN      ] SCL: Wiping existing primary data before full refresh.
[2025-10-24T21:01:29.643476] [INFO ] [LOCAL     ] SCL: Starting deletion of primary data.
[2025-10-24T21:01:29.643812] [DEBUG] [LOCAL     ] SCL: Deleted primary data file.
[2025-10-24T21:01:29.643869] [INFO ] [MAIN      ] SCL: Starting full primary refresh.
[2025-10-24T21:01:29.749119] [INFO ] [REMOTE    ] SCHW: Fetching primary data for 2025-07.
[2025-10-24T21:01:30.030394] [INFO ] [REMOTE    ] SCL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:01:30.161808] [INFO ] [REMOTE    ] SCI: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T21:01:30.547623] [INFO ] [REMOTE    ] SCI: Fetching primary data for 2025-09.
[2025-10-24T21:01:30.624962] [INFO ] [REMOTE    ] SCHW: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T21:01:31.347624] [INFO ] [REMOTE    ] SCL: Fetching primary data for 2025-01.
[2025-10-24T21:01:31.647605] [INFO ] [REMOTE    ] SCI: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T21:01:32.147630] [INFO ] [REMOTE    ] SCD: Fetching primary data for 2025-06.
[2025-10-24T21:01:32.187120] [INFO ] [REMOTE    ] SCL: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T21:01:32.705943] [INFO ] [REMOTE    ] SCD: Incremental fetch complete for 2025-06 (0.56 seconds).
[2025-10-24T21:01:32.947683] [INFO ] [REMOTE    ] SCD: Fetching primary data for 2025-07.
[2025-10-24T21:01:33.529313] [INFO ] [REMOTE    ] SCD: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T21:01:33.747621] [INFO ] [REMOTE    ] SCL: Fetching primary data for 2025-02.
[2025-10-24T21:01:34.239206] [INFO ] [REMOTE    ] SCL: Incremental fetch complete for 2025-02 (0.49 seconds).
[2025-10-24T21:01:34.547705] [INFO ] [REMOTE    ] SCI: Fetching primary data for 2025-10.
[2025-10-24T21:01:35.244906] [INFO ] [REMOTE    ] SCI: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T21:01:35.252681] [INFO ] [REMOTE    ] SCI: Full fetch complete (67147 records).
[2025-10-24T21:01:35.252802] [DEBUG] [VALIDATOR ] SCI: Validating primary data.
[2025-10-24T21:01:35.253499] [FATAL] [VALIDATOR ] SCI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:01:35.253584] [FATAL] [MAIN      ] SCI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:01:35.253673] [WARN ] [MAIN      ] SCI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:01:35.253746] [INFO ] [LOCAL     ] SCI: Starting deletion of primary data.
[2025-10-24T21:01:35.253811] [DEBUG] [LOCAL     ] SCI: No primary data file found to delete.
[2025-10-24T21:01:35.253848] [INFO ] [LOCAL     ] SCI: Starting deletion of derivative data.
[2025-10-24T21:01:35.254024] [DEBUG] [LOCAL     ] SCI: Deleted derivative data file.
[2025-10-24T21:01:35.254358] [INFO ] [MAIN      ] Update Progress: 1877/2366 symbols completed. SCI took 21.3s. Estimated remaining: 1h 2m 56s. Rate: 7.8 symbols/min
[2025-10-24T21:01:35.347619] [INFO ] [REMOTE    ] SCD: Fetching primary data for 2025-08.
[2025-10-24T21:01:36.147716] [INFO ] [REMOTE    ] SCL: Fetching primary data for 2025-03.
[2025-10-24T21:01:36.231304] [INFO ] [REMOTE    ] SCD: Incremental fetch complete for 2025-08 (0.88 seconds).
[2025-10-24T21:01:36.947703] [INFO ] [REMOTE    ] SCD: Fetching primary data for 2025-09.
[2025-10-24T21:01:36.960789] [INFO ] [REMOTE    ] SCL: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T21:01:37.681374] [INFO ] [REMOTE    ] SCD: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T21:01:37.747620] [INFO ] [REMOTE    ] SCD: Fetching primary data for 2025-10.
[2025-10-24T21:01:38.221541] [INFO ] [REMOTE    ] SCD: Incremental fetch complete for 2025-10 (0.47 seconds).
[2025-10-24T21:01:38.224378] [INFO ] [REMOTE    ] SCD: Full fetch complete (17134 records).
[2025-10-24T21:01:38.224449] [DEBUG] [VALIDATOR ] SCD: Validating primary data.
[2025-10-24T21:01:38.224877] [FATAL] [VALIDATOR ] SCD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:01:38.224974] [FATAL] [MAIN      ] SCD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:01:38.225051] [WARN ] [MAIN      ] SCD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:01:38.225145] [INFO ] [LOCAL     ] SCD: Starting deletion of primary data.
[2025-10-24T21:01:38.225239] [DEBUG] [LOCAL     ] SCD: No primary data file found to delete.
[2025-10-24T21:01:38.225276] [INFO ] [LOCAL     ] SCD: Starting deletion of derivative data.
[2025-10-24T21:01:38.225412] [DEBUG] [LOCAL     ] SCD: Deleted derivative data file.
[2025-10-24T21:01:38.225478] [INFO ] [MAIN      ] Update Progress: 1878/2366 symbols completed. SCD took 30.7s. Estimated remaining: 1h 2m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:01:38.547741] [INFO ] [REMOTE    ] SCHW: Fetching primary data for 2025-08.
[2025-10-24T21:01:39.347742] [INFO ] [REMOTE    ] SCL: Fetching primary data for 2025-04.
[2025-10-24T21:01:39.927671] [INFO ] [REMOTE    ] SCL: Incremental fetch complete for 2025-04 (0.58 seconds).
[2025-10-24T21:01:40.112037] [INFO ] [REMOTE    ] SCHW: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T21:01:40.147709] [INFO ] [REMOTE    ] SCL: Fetching primary data for 2025-05.
[2025-10-24T21:01:40.947706] [INFO ] [REMOTE    ] SCHW: Fetching primary data for 2025-09.
[2025-10-24T21:01:40.980469] [INFO ] [REMOTE    ] SCL: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T21:01:41.747750] [INFO ] [REMOTE    ] SCL: Fetching primary data for 2025-06.
[2025-10-24T21:01:42.254065] [INFO ] [REMOTE    ] SCL: Incremental fetch complete for 2025-06 (0.51 seconds).
[2025-10-24T21:01:42.408734] [INFO ] [REMOTE    ] SCHW: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T21:01:42.547684] [INFO ] [REMOTE    ] SCL: Fetching primary data for 2025-07.
[2025-10-24T21:01:43.030583] [INFO ] [REMOTE    ] SCL: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T21:01:43.347744] [INFO ] [REMOTE    ] SCHW: Fetching primary data for 2025-10.
[2025-10-24T21:01:44.147890] [INFO ] [REMOTE    ] SCL: Fetching primary data for 2025-08.
[2025-10-24T21:01:44.378984] [INFO ] [REMOTE    ] SCHW: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T21:01:44.389174] [INFO ] [REMOTE    ] SCHW: Full fetch complete (77475 records).
[2025-10-24T21:01:44.389320] [DEBUG] [VALIDATOR ] SCHW: Validating primary data.
[2025-10-24T21:01:44.390151] [FATAL] [VALIDATOR ] SCHW: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:01:44.390241] [FATAL] [MAIN      ] SCHW: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:01:44.390283] [WARN ] [MAIN      ] SCHW: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:01:44.390321] [INFO ] [LOCAL     ] SCHW: Starting deletion of primary data.
[2025-10-24T21:01:44.390375] [DEBUG] [LOCAL     ] SCHW: No primary data file found to delete.
[2025-10-24T21:01:44.390412] [INFO ] [LOCAL     ] SCHW: Starting deletion of derivative data.
[2025-10-24T21:01:44.390557] [DEBUG] [LOCAL     ] SCHW: Deleted derivative data file.
[2025-10-24T21:01:44.390912] [INFO ] [MAIN      ] Update Progress: 1879/2366 symbols completed. SCHW took 33.1s. Estimated remaining: 1h 2m 39s. Rate: 7.8 symbols/min
[2025-10-24T21:01:44.750960] [INFO ] [REMOTE    ] SCL: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T21:01:44.947695] [INFO ] [REMOTE    ] SCL: Fetching primary data for 2025-09.
[2025-10-24T21:01:45.780721] [INFO ] [REMOTE    ] SCL: Incremental fetch complete for 2025-09 (0.83 seconds).
[2025-10-24T21:01:45.784941] [INFO ] [REMOTE    ] SCL: Fetching primary data for 2025-10.
[2025-10-24T21:01:46.205231] [INFO ] [REMOTE    ] SCL: Incremental fetch complete for 2025-10 (0.42 seconds).
[2025-10-24T21:01:46.208974] [INFO ] [REMOTE    ] SCL: Full fetch complete (21566 records).
[2025-10-24T21:01:46.209082] [DEBUG] [VALIDATOR ] SCL: Validating primary data.
[2025-10-24T21:01:46.209557] [FATAL] [VALIDATOR ] SCL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:01:46.209673] [FATAL] [MAIN      ] SCL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:01:46.209756] [WARN ] [MAIN      ] SCL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:01:46.209887] [INFO ] [LOCAL     ] SCL: Starting deletion of primary data.
[2025-10-24T21:01:46.209975] [DEBUG] [LOCAL     ] SCL: No primary data file found to delete.
[2025-10-24T21:01:46.210030] [INFO ] [LOCAL     ] SCL: Starting deletion of derivative data.
[2025-10-24T21:01:46.210457] [DEBUG] [LOCAL     ] SCL: Deleted derivative data file.
[2025-10-24T21:01:46.210546] [INFO ] [MAIN      ] Update Progress: 1880/2366 symbols completed. SCL took 16.9s. Estimated remaining: 1h 2m 29s. Rate: 7.8 symbols/min
[2025-10-24T21:01:46.852352] [INFO ] [MAIN      ] SDHC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:01:46.936415] [INFO ] [MAIN      ] SD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:01:46.940364] [INFO ] [MAIN      ] SCS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:01:46.942200] [INFO ] [MAIN      ] SCM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:01:46.958185] [DEBUG] [LOCAL     ] SDHC: Loaded 10434 existing records from primary storage.
[2025-10-24T21:01:46.958415] [INFO ] [MAIN      ] SDHC: Loaded 10434 existing records.
[2025-10-24T21:01:47.122491] [DEBUG] [LOCAL     ] SCM: Loaded 20250 existing records from primary storage.
[2025-10-24T21:01:47.139592] [INFO ] [MAIN      ] SCM: Loaded 20250 existing records.
[2025-10-24T21:01:47.140229] [DEBUG] [LOCAL     ] SD: Loaded 28416 existing records from primary storage.
[2025-10-24T21:01:47.238237] [INFO ] [MAIN      ] SD: Loaded 28416 existing records.
[2025-10-24T21:01:47.288936] [WARN ] [MAIN      ] SDHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:01:47.358389] [INFO ] [MAIN      ] SDHC: Wiping existing primary data before full refresh.
[2025-10-24T21:01:47.396903] [DEBUG] [LOCAL     ] SCS: Loaded 43507 existing records from primary storage.
[2025-10-24T21:01:47.396997] [INFO ] [LOCAL     ] SDHC: Starting deletion of primary data.
[2025-10-24T21:01:47.453917] [INFO ] [MAIN      ] SCS: Loaded 43507 existing records.
[2025-10-24T21:01:47.485838] [DEBUG] [LOCAL     ] SDHC: Deleted primary data file.
[2025-10-24T21:01:47.496961] [INFO ] [MAIN      ] SDHC: Starting full primary refresh.
[2025-10-24T21:01:47.688483] [WARN ] [MAIN      ] SCM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:01:47.783187] [WARN ] [MAIN      ] SD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:01:47.791743] [INFO ] [MAIN      ] SCM: Wiping existing primary data before full refresh.
[2025-10-24T21:01:47.807385] [INFO ] [LOCAL     ] SCM: Starting deletion of primary data.
[2025-10-24T21:01:47.842207] [INFO ] [MAIN      ] SD: Wiping existing primary data before full refresh.
[2025-10-24T21:01:47.842608] [INFO ] [LOCAL     ] SD: Starting deletion of primary data.
[2025-10-24T21:01:47.856162] [DEBUG] [LOCAL     ] SD: Deleted primary data file.
[2025-10-24T21:01:47.876751] [INFO ] [MAIN      ] SD: Starting full primary refresh.
[2025-10-24T21:01:47.850964] [DEBUG] [LOCAL     ] SCM: Deleted primary data file.
[2025-10-24T21:01:47.925778] [INFO ] [MAIN      ] SCM: Starting full primary refresh.
[2025-10-24T21:01:48.001785] [WARN ] [MAIN      ] SCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:01:48.091313] [INFO ] [MAIN      ] SCS: Wiping existing primary data before full refresh.
[2025-10-24T21:01:48.189460] [INFO ] [LOCAL     ] SCS: Starting deletion of primary data.
[2025-10-24T21:01:48.284407] [DEBUG] [LOCAL     ] SCS: Deleted primary data file.
[2025-10-24T21:01:48.312684] [INFO ] [MAIN      ] SCS: Starting full primary refresh.
[2025-10-24T21:01:48.791211] [INFO ] [REMOTE    ] SDHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:01:48.866465] [INFO ] [REMOTE    ] SDHC: Fetching primary data for 2025-01.
[2025-10-24T21:01:49.218625] [INFO ] [REMOTE    ] SD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:01:49.234050] [INFO ] [REMOTE    ] SD: Fetching primary data for 2025-01.
[2025-10-24T21:01:49.264072] [INFO ] [REMOTE    ] SCM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:01:49.264797] [INFO ] [REMOTE    ] SCM: Fetching primary data for 2025-01.
[2025-10-24T21:01:49.341734] [INFO ] [REMOTE    ] SCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:01:49.342003] [INFO ] [REMOTE    ] SCS: Fetching primary data for 2025-01.
[2025-10-24T21:01:49.794988] [INFO ] [REMOTE    ] SDHC: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T21:01:49.798439] [INFO ] [REMOTE    ] SDHC: Fetching primary data for 2025-02.
[2025-10-24T21:01:50.290583] [INFO ] [REMOTE    ] SCM: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T21:01:50.311143] [INFO ] [REMOTE    ] SD: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T21:01:50.532073] [INFO ] [REMOTE    ] SCS: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T21:01:50.547613] [INFO ] [REMOTE    ] SCS: Fetching primary data for 2025-02.
[2025-10-24T21:01:50.878492] [INFO ] [REMOTE    ] SDHC: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T21:01:51.347666] [INFO ] [REMOTE    ] SD: Fetching primary data for 2025-02.
[2025-10-24T21:01:51.708132] [INFO ] [REMOTE    ] SCS: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T21:01:52.147714] [INFO ] [REMOTE    ] SCS: Fetching primary data for 2025-03.
[2025-10-24T21:01:52.207491] [INFO ] [REMOTE    ] SD: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T21:01:52.947689] [INFO ] [REMOTE    ] SD: Fetching primary data for 2025-03.
[2025-10-24T21:01:53.183469] [INFO ] [REMOTE    ] SCS: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T21:01:53.397337] [INFO ] [REMOTE    ] SD: Incremental fetch complete for 2025-03 (0.45 seconds).
[2025-10-24T21:01:53.747712] [INFO ] [REMOTE    ] SCS: Fetching primary data for 2025-04.
[2025-10-24T21:01:54.547628] [INFO ] [REMOTE    ] SDHC: Fetching primary data for 2025-03.
[2025-10-24T21:01:54.787225] [INFO ] [REMOTE    ] SCS: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T21:01:55.110337] [INFO ] [REMOTE    ] SDHC: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T21:01:55.347667] [INFO ] [REMOTE    ] SD: Fetching primary data for 2025-04.
[2025-10-24T21:01:56.147620] [INFO ] [REMOTE    ] SDHC: Fetching primary data for 2025-04.
[2025-10-24T21:01:56.302730] [INFO ] [REMOTE    ] SD: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T21:01:56.947694] [INFO ] [REMOTE    ] SCM: Fetching primary data for 2025-02.
[2025-10-24T21:01:57.049238] [INFO ] [REMOTE    ] SDHC: Incremental fetch complete for 2025-04 (0.90 seconds).
[2025-10-24T21:01:57.747626] [INFO ] [REMOTE    ] SCS: Fetching primary data for 2025-05.
[2025-10-24T21:01:57.922246] [INFO ] [REMOTE    ] SCM: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T21:01:58.534247] [INFO ] [REMOTE    ] SCS: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T21:01:58.547600] [INFO ] [REMOTE    ] SCS: Fetching primary data for 2025-06.
[2025-10-24T21:01:59.347672] [INFO ] [REMOTE    ] SDHC: Fetching primary data for 2025-05.
[2025-10-24T21:01:59.704924] [INFO ] [REMOTE    ] SCS: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T21:01:59.819534] [INFO ] [REMOTE    ] SDHC: Incremental fetch complete for 2025-05 (0.47 seconds).
[2025-10-24T21:02:00.147728] [INFO ] [REMOTE    ] SD: Fetching primary data for 2025-05.
[2025-10-24T21:02:00.861772] [INFO ] [REMOTE    ] SD: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T21:02:00.947714] [INFO ] [REMOTE    ] SCS: Fetching primary data for 2025-07.
[2025-10-24T21:02:01.748476] [INFO ] [REMOTE    ] SCM: Fetching primary data for 2025-03.
[2025-10-24T21:02:01.748401] [INFO ] [REMOTE    ] SCS: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T21:02:02.445451] [INFO ] [REMOTE    ] SCM: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T21:02:02.547698] [INFO ] [REMOTE    ] SCM: Fetching primary data for 2025-04.
[2025-10-24T21:02:03.140293] [INFO ] [REMOTE    ] SCM: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T21:02:03.347726] [INFO ] [REMOTE    ] SDHC: Fetching primary data for 2025-06.
[2025-10-24T21:02:04.147623] [INFO ] [REMOTE    ] SD: Fetching primary data for 2025-06.
[2025-10-24T21:02:04.457093] [INFO ] [REMOTE    ] SDHC: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T21:02:04.947632] [INFO ] [REMOTE    ] SCM: Fetching primary data for 2025-05.
[2025-10-24T21:02:05.143596] [INFO ] [REMOTE    ] SD: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T21:02:05.706568] [INFO ] [REMOTE    ] SCM: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T21:02:05.747607] [INFO ] [REMOTE    ] SCM: Fetching primary data for 2025-06.
[2025-10-24T21:02:06.547685] [INFO ] [REMOTE    ] SDHC: Fetching primary data for 2025-07.
[2025-10-24T21:02:06.635748] [INFO ] [REMOTE    ] SCM: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T21:02:07.034798] [INFO ] [REMOTE    ] SDHC: Incremental fetch complete for 2025-07 (0.49 seconds).
[2025-10-24T21:02:07.347677] [INFO ] [REMOTE    ] SDHC: Fetching primary data for 2025-08.
[2025-10-24T21:02:07.815167] [INFO ] [REMOTE    ] SDHC: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T21:02:08.147719] [INFO ] [REMOTE    ] SDHC: Fetching primary data for 2025-09.
[2025-10-24T21:02:08.947632] [INFO ] [REMOTE    ] SCS: Fetching primary data for 2025-08.
[2025-10-24T21:02:09.103960] [INFO ] [REMOTE    ] SDHC: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T21:02:09.758918] [INFO ] [REMOTE    ] SCM: Fetching primary data for 2025-07.
[2025-10-24T21:02:09.762180] [INFO ] [REMOTE    ] SCS: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T21:02:10.347258] [INFO ] [REMOTE    ] SCM: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T21:02:10.547636] [INFO ] [REMOTE    ] SD: Fetching primary data for 2025-07.
[2025-10-24T21:02:11.347621] [INFO ] [REMOTE    ] SDHC: Fetching primary data for 2025-10.
[2025-10-24T21:02:11.621111] [INFO ] [REMOTE    ] SD: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T21:02:11.839546] [INFO ] [REMOTE    ] SDHC: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T21:02:11.842129] [INFO ] [REMOTE    ] SDHC: Full fetch complete (16643 records).
[2025-10-24T21:02:11.842214] [DEBUG] [VALIDATOR ] SDHC: Validating primary data.
[2025-10-24T21:02:11.842615] [FATAL] [VALIDATOR ] SDHC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:02:11.842722] [FATAL] [MAIN      ] SDHC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:02:11.842767] [WARN ] [MAIN      ] SDHC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:02:11.842831] [INFO ] [LOCAL     ] SDHC: Starting deletion of primary data.
[2025-10-24T21:02:11.842892] [DEBUG] [LOCAL     ] SDHC: No primary data file found to delete.
[2025-10-24T21:02:11.842940] [INFO ] [LOCAL     ] SDHC: Starting deletion of derivative data.
[2025-10-24T21:02:11.843099] [DEBUG] [LOCAL     ] SDHC: Deleted derivative data file.
[2025-10-24T21:02:11.843182] [INFO ] [MAIN      ] Update Progress: 1881/2366 symbols completed. SDHC took 25.6s. Estimated remaining: 1h 2m 26s. Rate: 7.8 symbols/min
[2025-10-24T21:02:12.026689] [INFO ] [MAIN      ] SDHY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:02:12.039875] [DEBUG] [LOCAL     ] SDHY: Loaded 11276 existing records from primary storage.
[2025-10-24T21:02:12.040102] [INFO ] [MAIN      ] SDHY: Loaded 11276 existing records.
[2025-10-24T21:02:12.152822] [INFO ] [REMOTE    ] SCS: Fetching primary data for 2025-09.
[2025-10-24T21:02:12.219491] [WARN ] [MAIN      ] SDHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:02:12.219694] [INFO ] [MAIN      ] SDHY: Wiping existing primary data before full refresh.
[2025-10-24T21:02:12.219751] [INFO ] [LOCAL     ] SDHY: Starting deletion of primary data.
[2025-10-24T21:02:12.219920] [DEBUG] [LOCAL     ] SDHY: Deleted primary data file.
[2025-10-24T21:02:12.219975] [INFO ] [MAIN      ] SDHY: Starting full primary refresh.
[2025-10-24T21:02:12.582609] [INFO ] [REMOTE    ] SDHY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:02:12.947614] [INFO ] [REMOTE    ] SD: Fetching primary data for 2025-08.
[2025-10-24T21:02:13.012621] [INFO ] [REMOTE    ] SCS: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T21:02:13.652286] [INFO ] [REMOTE    ] SD: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T21:02:13.747693] [INFO ] [REMOTE    ] SCS: Fetching primary data for 2025-10.
[2025-10-24T21:02:14.547671] [INFO ] [REMOTE    ] SDHY: Fetching primary data for 2025-01.
[2025-10-24T21:02:14.931611] [INFO ] [REMOTE    ] SCS: Incremental fetch complete for 2025-10 (1.18 seconds).
[2025-10-24T21:02:14.939472] [INFO ] [REMOTE    ] SCS: Full fetch complete (60761 records).
[2025-10-24T21:02:14.939616] [DEBUG] [VALIDATOR ] SCS: Validating primary data.
[2025-10-24T21:02:14.940342] [FATAL] [VALIDATOR ] SCS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:02:14.940425] [FATAL] [MAIN      ] SCS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:02:14.940467] [WARN ] [MAIN      ] SCS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:02:14.940509] [INFO ] [LOCAL     ] SCS: Starting deletion of primary data.
[2025-10-24T21:02:14.940566] [DEBUG] [LOCAL     ] SCS: No primary data file found to delete.
[2025-10-24T21:02:14.940600] [INFO ] [LOCAL     ] SCS: Starting deletion of derivative data.
[2025-10-24T21:02:14.940768] [DEBUG] [LOCAL     ] SCS: Deleted derivative data file.
[2025-10-24T21:02:14.941607] [INFO ] [MAIN      ] Update Progress: 1882/2366 symbols completed. SCS took 28.7s. Estimated remaining: 1h 2m 17s. Rate: 7.8 symbols/min
[2025-10-24T21:02:15.139363] [INFO ] [MAIN      ] SDRL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:02:15.179880] [DEBUG] [LOCAL     ] SDRL: Loaded 41448 existing records from primary storage.
[2025-10-24T21:02:15.180147] [INFO ] [MAIN      ] SDRL: Loaded 41448 existing records.
[2025-10-24T21:02:15.289078] [INFO ] [REMOTE    ] SDHY: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T21:02:15.347621] [INFO ] [REMOTE    ] SD: Fetching primary data for 2025-09.
[2025-10-24T21:02:15.368470] [WARN ] [MAIN      ] SDRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:02:15.369293] [INFO ] [MAIN      ] SDRL: Wiping existing primary data before full refresh.
[2025-10-24T21:02:15.369341] [INFO ] [LOCAL     ] SDRL: Starting deletion of primary data.
[2025-10-24T21:02:15.369679] [DEBUG] [LOCAL     ] SDRL: Deleted primary data file.
[2025-10-24T21:02:15.369750] [INFO ] [MAIN      ] SDRL: Starting full primary refresh.
[2025-10-24T21:02:15.727909] [INFO ] [REMOTE    ] SDRL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:02:16.147725] [INFO ] [REMOTE    ] SDRL: Fetching primary data for 2025-01.
[2025-10-24T21:02:16.693725] [INFO ] [REMOTE    ] SD: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T21:02:16.946492] [INFO ] [REMOTE    ] SDRL: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T21:02:16.954593] [INFO ] [REMOTE    ] SCM: Fetching primary data for 2025-08.
[2025-10-24T21:02:17.747638] [INFO ] [REMOTE    ] SDRL: Fetching primary data for 2025-02.
[2025-10-24T21:02:17.828564] [INFO ] [REMOTE    ] SCM: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T21:02:18.516735] [INFO ] [REMOTE    ] SDRL: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T21:02:18.547616] [INFO ] [REMOTE    ] SD: Fetching primary data for 2025-10.
[2025-10-24T21:02:19.130177] [INFO ] [REMOTE    ] SD: Incremental fetch complete for 2025-10 (0.58 seconds).
[2025-10-24T21:02:19.135248] [INFO ] [REMOTE    ] SD: Full fetch complete (40461 records).
[2025-10-24T21:02:19.135366] [DEBUG] [VALIDATOR ] SD: Validating primary data.
[2025-10-24T21:02:19.136020] [FATAL] [VALIDATOR ] SD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:02:19.136104] [FATAL] [MAIN      ] SD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:02:19.136147] [WARN ] [MAIN      ] SD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:02:19.136211] [INFO ] [LOCAL     ] SD: Starting deletion of primary data.
[2025-10-24T21:02:19.136273] [DEBUG] [LOCAL     ] SD: No primary data file found to delete.
[2025-10-24T21:02:19.136308] [INFO ] [LOCAL     ] SD: Starting deletion of derivative data.
[2025-10-24T21:02:19.136510] [DEBUG] [LOCAL     ] SD: Deleted derivative data file.
[2025-10-24T21:02:19.136598] [INFO ] [MAIN      ] Update Progress: 1883/2366 symbols completed. SD took 32.9s. Estimated remaining: 1h 2m 9s. Rate: 7.8 symbols/min
[2025-10-24T21:02:19.304326] [INFO ] [MAIN      ] SE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:02:19.354583] [INFO ] [REMOTE    ] SDRL: Fetching primary data for 2025-03.
[2025-10-24T21:02:19.357926] [DEBUG] [LOCAL     ] SE: Loaded 53690 existing records from primary storage.
[2025-10-24T21:02:19.358336] [INFO ] [MAIN      ] SE: Loaded 53690 existing records.
[2025-10-24T21:02:19.539516] [WARN ] [MAIN      ] SE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:02:19.539782] [INFO ] [MAIN      ] SE: Wiping existing primary data before full refresh.
[2025-10-24T21:02:19.539833] [INFO ] [LOCAL     ] SE: Starting deletion of primary data.
[2025-10-24T21:02:19.540788] [DEBUG] [LOCAL     ] SE: Deleted primary data file.
[2025-10-24T21:02:19.540847] [INFO ] [MAIN      ] SE: Starting full primary refresh.
[2025-10-24T21:02:19.884848] [INFO ] [REMOTE    ] SE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:02:20.147672] [INFO ] [REMOTE    ] SE: Fetching primary data for 2025-01.
[2025-10-24T21:02:20.818299] [INFO ] [REMOTE    ] SDRL: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T21:02:20.947635] [INFO ] [REMOTE    ] SDRL: Fetching primary data for 2025-04.
[2025-10-24T21:02:21.083888] [INFO ] [REMOTE    ] SE: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T21:02:21.682226] [INFO ] [REMOTE    ] SDRL: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T21:02:21.747607] [INFO ] [REMOTE    ] SDRL: Fetching primary data for 2025-05.
[2025-10-24T21:02:22.547716] [INFO ] [REMOTE    ] SDHY: Fetching primary data for 2025-02.
[2025-10-24T21:02:22.781386] [INFO ] [REMOTE    ] SDRL: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T21:02:22.835904] [INFO ] [REMOTE    ] SDHY: Incremental fetch complete for 2025-02 (0.29 seconds).
[2025-10-24T21:02:23.347705] [INFO ] [REMOTE    ] SE: Fetching primary data for 2025-02.
[2025-10-24T21:02:24.147668] [INFO ] [REMOTE    ] SDRL: Fetching primary data for 2025-06.
[2025-10-24T21:02:24.678514] [INFO ] [REMOTE    ] SE: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T21:02:24.879065] [INFO ] [REMOTE    ] SDRL: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T21:02:24.947671] [INFO ] [REMOTE    ] SE: Fetching primary data for 2025-03.
[2025-10-24T21:02:25.747724] [INFO ] [REMOTE    ] SCM: Fetching primary data for 2025-09.
[2025-10-24T21:02:26.111539] [INFO ] [REMOTE    ] SE: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T21:02:26.547678] [INFO ] [REMOTE    ] SE: Fetching primary data for 2025-04.
[2025-10-24T21:02:26.638486] [INFO ] [REMOTE    ] SCM: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T21:02:27.327929] [INFO ] [REMOTE    ] SE: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T21:02:27.347605] [INFO ] [REMOTE    ] SE: Fetching primary data for 2025-05.
[2025-10-24T21:02:28.147634] [INFO ] [REMOTE    ] SCM: Fetching primary data for 2025-10.
[2025-10-24T21:02:28.196786] [INFO ] [REMOTE    ] SE: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T21:02:28.947705] [INFO ] [REMOTE    ] SDRL: Fetching primary data for 2025-07.
[2025-10-24T21:02:29.022341] [INFO ] [REMOTE    ] SCM: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T21:02:29.027121] [INFO ] [REMOTE    ] SCM: Full fetch complete (29319 records).
[2025-10-24T21:02:29.027196] [DEBUG] [VALIDATOR ] SCM: Validating primary data.
[2025-10-24T21:02:29.027794] [FATAL] [VALIDATOR ] SCM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:02:29.027876] [FATAL] [MAIN      ] SCM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:02:29.027919] [WARN ] [MAIN      ] SCM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:02:29.027957] [INFO ] [LOCAL     ] SCM: Starting deletion of primary data.
[2025-10-24T21:02:29.028011] [DEBUG] [LOCAL     ] SCM: No primary data file found to delete.
[2025-10-24T21:02:29.028051] [INFO ] [LOCAL     ] SCM: Starting deletion of derivative data.
[2025-10-24T21:02:29.028189] [DEBUG] [LOCAL     ] SCM: Deleted derivative data file.
[2025-10-24T21:02:29.028270] [INFO ] [MAIN      ] Update Progress: 1884/2366 symbols completed. SCM took 42.8s. Estimated remaining: 1h 2m 1s. Rate: 7.8 symbols/min
[2025-10-24T21:02:29.212532] [INFO ] [MAIN      ] SEE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:02:29.257104] [DEBUG] [LOCAL     ] SEE: Loaded 48408 existing records from primary storage.
[2025-10-24T21:02:29.257430] [INFO ] [MAIN      ] SEE: Loaded 48408 existing records.
[2025-10-24T21:02:29.439961] [WARN ] [MAIN      ] SEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:02:29.440159] [INFO ] [MAIN      ] SEE: Wiping existing primary data before full refresh.
[2025-10-24T21:02:29.440206] [INFO ] [LOCAL     ] SEE: Starting deletion of primary data.
[2025-10-24T21:02:29.441213] [DEBUG] [LOCAL     ] SEE: Deleted primary data file.
[2025-10-24T21:02:29.441271] [INFO ] [MAIN      ] SEE: Starting full primary refresh.
[2025-10-24T21:02:29.751150] [INFO ] [REMOTE    ] SE: Fetching primary data for 2025-06.
[2025-10-24T21:02:29.827995] [INFO ] [REMOTE    ] SEE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:02:29.851300] [INFO ] [REMOTE    ] SDRL: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T21:02:30.547683] [INFO ] [REMOTE    ] SEE: Fetching primary data for 2025-01.
[2025-10-24T21:02:31.043755] [INFO ] [REMOTE    ] SE: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T21:02:31.347674] [INFO ] [REMOTE    ] SE: Fetching primary data for 2025-07.
[2025-10-24T21:02:31.467616] [INFO ] [REMOTE    ] SEE: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T21:02:32.147685] [INFO ] [REMOTE    ] SDRL: Fetching primary data for 2025-08.
[2025-10-24T21:02:32.440691] [INFO ] [REMOTE    ] SE: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T21:02:32.735692] [INFO ] [REMOTE    ] SDRL: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T21:02:32.947677] [INFO ] [REMOTE    ] SEE: Fetching primary data for 2025-02.
[2025-10-24T21:02:33.702711] [INFO ] [REMOTE    ] SEE: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T21:02:33.747604] [INFO ] [REMOTE    ] SEE: Fetching primary data for 2025-03.
[2025-10-24T21:02:34.521457] [INFO ] [REMOTE    ] SEE: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T21:02:34.547610] [INFO ] [REMOTE    ] SE: Fetching primary data for 2025-08.
[2025-10-24T21:02:35.347637] [INFO ] [REMOTE    ] SDRL: Fetching primary data for 2025-09.
[2025-10-24T21:02:35.807535] [INFO ] [REMOTE    ] SE: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T21:02:36.136240] [INFO ] [REMOTE    ] SDRL: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T21:02:36.147598] [INFO ] [REMOTE    ] SDRL: Fetching primary data for 2025-10.
[2025-10-24T21:02:36.947740] [INFO ] [REMOTE    ] SEE: Fetching primary data for 2025-04.
[2025-10-24T21:02:37.137298] [INFO ] [REMOTE    ] SDRL: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T21:02:37.145069] [INFO ] [REMOTE    ] SDRL: Full fetch complete (60932 records).
[2025-10-24T21:02:37.145210] [DEBUG] [VALIDATOR ] SDRL: Validating primary data.
[2025-10-24T21:02:37.147998] [FATAL] [VALIDATOR ] SDRL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:02:37.148213] [FATAL] [MAIN      ] SDRL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:02:37.148281] [WARN ] [MAIN      ] SDRL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:02:37.148360] [INFO ] [LOCAL     ] SDRL: Starting deletion of primary data.
[2025-10-24T21:02:37.148433] [DEBUG] [LOCAL     ] SDRL: No primary data file found to delete.
[2025-10-24T21:02:37.148471] [INFO ] [LOCAL     ] SDRL: Starting deletion of derivative data.
[2025-10-24T21:02:37.148631] [DEBUG] [LOCAL     ] SDRL: Deleted derivative data file.
[2025-10-24T21:02:37.149114] [INFO ] [MAIN      ] Update Progress: 1885/2366 symbols completed. SDRL took 22.2s. Estimated remaining: 1h 1m 54s. Rate: 7.8 symbols/min
[2025-10-24T21:02:37.316992] [INFO ] [MAIN      ] SEG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:02:37.330740] [DEBUG] [LOCAL     ] SEG: Loaded 12541 existing records from primary storage.
[2025-10-24T21:02:37.330988] [INFO ] [MAIN      ] SEG: Loaded 12541 existing records.
[2025-10-24T21:02:37.521637] [WARN ] [MAIN      ] SEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:02:37.521995] [INFO ] [MAIN      ] SEG: Wiping existing primary data before full refresh.
[2025-10-24T21:02:37.522074] [INFO ] [LOCAL     ] SEG: Starting deletion of primary data.
[2025-10-24T21:02:37.522415] [DEBUG] [LOCAL     ] SEG: Deleted primary data file.
[2025-10-24T21:02:37.522482] [INFO ] [MAIN      ] SEG: Starting full primary refresh.
[2025-10-24T21:02:37.752820] [INFO ] [REMOTE    ] SDHY: Fetching primary data for 2025-03.
[2025-10-24T21:02:37.939272] [INFO ] [REMOTE    ] SEG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:02:38.359063] [INFO ] [REMOTE    ] SEE: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T21:02:38.547684] [INFO ] [REMOTE    ] SEE: Fetching primary data for 2025-05.
[2025-10-24T21:02:38.699265] [INFO ] [REMOTE    ] SDHY: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T21:02:39.347728] [INFO ] [REMOTE    ] SDHY: Fetching primary data for 2025-04.
[2025-10-24T21:02:40.026745] [INFO ] [REMOTE    ] SEE: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T21:02:40.147624] [INFO ] [REMOTE    ] SE: Fetching primary data for 2025-09.
[2025-10-24T21:02:40.282567] [INFO ] [REMOTE    ] SDHY: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T21:02:40.947698] [INFO ] [REMOTE    ] SEE: Fetching primary data for 2025-06.
[2025-10-24T21:02:41.330036] [INFO ] [REMOTE    ] SE: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T21:02:41.747686] [INFO ] [REMOTE    ] SEG: Fetching primary data for 2025-01.
[2025-10-24T21:02:41.979119] [INFO ] [REMOTE    ] SEE: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T21:02:42.266469] [INFO ] [REMOTE    ] SEG: Incremental fetch complete for 2025-01 (0.52 seconds).
[2025-10-24T21:02:42.547737] [INFO ] [REMOTE    ] SE: Fetching primary data for 2025-10.
[2025-10-24T21:02:43.323883] [INFO ] [REMOTE    ] SE: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T21:02:43.334366] [INFO ] [REMOTE    ] SE: Full fetch complete (76908 records).
[2025-10-24T21:02:43.334509] [DEBUG] [VALIDATOR ] SE: Validating primary data.
[2025-10-24T21:02:43.335353] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:02:43.335444] [FATAL] [MAIN      ] SE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:02:43.335488] [WARN ] [MAIN      ] SE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:02:43.335552] [INFO ] [LOCAL     ] SE: Starting deletion of primary data.
[2025-10-24T21:02:43.335615] [DEBUG] [LOCAL     ] SE: No primary data file found to delete.
[2025-10-24T21:02:43.335688] [INFO ] [LOCAL     ] SE: Starting deletion of derivative data.
[2025-10-24T21:02:43.335922] [DEBUG] [LOCAL     ] SE: Deleted derivative data file.
[2025-10-24T21:02:43.336428] [INFO ] [MAIN      ] Update Progress: 1886/2366 symbols completed. SE took 24.2s. Estimated remaining: 1h 1m 46s. Rate: 7.8 symbols/min
[2025-10-24T21:02:43.352775] [INFO ] [REMOTE    ] SDHY: Fetching primary data for 2025-05.
[2025-10-24T21:02:43.538258] [INFO ] [MAIN      ] SEI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:02:43.585164] [DEBUG] [LOCAL     ] SEI: Loaded 50409 existing records from primary storage.
[2025-10-24T21:02:43.585497] [INFO ] [MAIN      ] SEI: Loaded 50409 existing records.
[2025-10-24T21:02:43.783672] [WARN ] [MAIN      ] SEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:02:43.783885] [INFO ] [MAIN      ] SEI: Wiping existing primary data before full refresh.
[2025-10-24T21:02:43.783944] [INFO ] [LOCAL     ] SEI: Starting deletion of primary data.
[2025-10-24T21:02:43.785052] [DEBUG] [LOCAL     ] SEI: Deleted primary data file.
[2025-10-24T21:02:43.785117] [INFO ] [MAIN      ] SEI: Starting full primary refresh.
[2025-10-24T21:02:44.116865] [INFO ] [REMOTE    ] SDHY: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T21:02:44.152785] [INFO ] [REMOTE    ] SEE: Fetching primary data for 2025-07.
[2025-10-24T21:02:44.193256] [INFO ] [REMOTE    ] SEI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:02:44.947735] [INFO ] [REMOTE    ] SDHY: Fetching primary data for 2025-06.
[2025-10-24T21:02:44.986767] [INFO ] [REMOTE    ] SEE: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T21:02:45.425365] [INFO ] [REMOTE    ] SDHY: Incremental fetch complete for 2025-06 (0.48 seconds).
[2025-10-24T21:02:45.747673] [INFO ] [REMOTE    ] SDHY: Fetching primary data for 2025-07.
[2025-10-24T21:02:46.547730] [INFO ] [REMOTE    ] SEG: Fetching primary data for 2025-02.
[2025-10-24T21:02:46.804061] [INFO ] [REMOTE    ] SDHY: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T21:02:46.889350] [INFO ] [REMOTE    ] SEG: Incremental fetch complete for 2025-02 (0.34 seconds).
[2025-10-24T21:02:47.347702] [INFO ] [REMOTE    ] SEI: Fetching primary data for 2025-01.
[2025-10-24T21:02:48.087438] [INFO ] [REMOTE    ] SEI: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T21:02:48.147600] [INFO ] [REMOTE    ] SEI: Fetching primary data for 2025-02.
[2025-10-24T21:02:48.947628] [INFO ] [REMOTE    ] SEE: Fetching primary data for 2025-08.
[2025-10-24T21:02:49.234476] [INFO ] [REMOTE    ] SEI: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T21:02:49.739364] [INFO ] [REMOTE    ] SEE: Incremental fetch complete for 2025-08 (0.79 seconds).
[2025-10-24T21:02:49.749221] [INFO ] [REMOTE    ] SEG: Fetching primary data for 2025-03.
[2025-10-24T21:02:50.318142] [INFO ] [REMOTE    ] SEG: Incremental fetch complete for 2025-03 (0.57 seconds).
[2025-10-24T21:02:50.547719] [INFO ] [REMOTE    ] SEG: Fetching primary data for 2025-04.
[2025-10-24T21:02:51.347712] [INFO ] [REMOTE    ] SEE: Fetching primary data for 2025-09.
[2025-10-24T21:02:51.438596] [INFO ] [REMOTE    ] SEG: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T21:02:52.147732] [INFO ] [REMOTE    ] SEG: Fetching primary data for 2025-05.
[2025-10-24T21:02:52.206451] [INFO ] [REMOTE    ] SEE: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T21:02:52.555485] [INFO ] [REMOTE    ] SEG: Incremental fetch complete for 2025-05 (0.41 seconds).
[2025-10-24T21:02:52.947679] [INFO ] [REMOTE    ] SEG: Fetching primary data for 2025-06.
[2025-10-24T21:02:53.747622] [INFO ] [REMOTE    ] SEI: Fetching primary data for 2025-03.
[2025-10-24T21:02:53.803237] [INFO ] [REMOTE    ] SEG: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T21:02:54.547689] [INFO ] [REMOTE    ] SEG: Fetching primary data for 2025-07.
[2025-10-24T21:02:54.800599] [INFO ] [REMOTE    ] SEI: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T21:02:55.023156] [INFO ] [REMOTE    ] SEG: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T21:02:55.347685] [INFO ] [REMOTE    ] SEG: Fetching primary data for 2025-08.
[2025-10-24T21:02:55.897376] [INFO ] [REMOTE    ] SEG: Incremental fetch complete for 2025-08 (0.55 seconds).
[2025-10-24T21:02:56.147716] [INFO ] [REMOTE    ] SEG: Fetching primary data for 2025-09.
[2025-10-24T21:02:56.792517] [INFO ] [REMOTE    ] SEG: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T21:02:56.947677] [INFO ] [REMOTE    ] SEI: Fetching primary data for 2025-04.
[2025-10-24T21:02:57.747637] [INFO ] [REMOTE    ] SDHY: Fetching primary data for 2025-08.
[2025-10-24T21:02:58.036116] [INFO ] [REMOTE    ] SEI: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T21:02:58.443043] [INFO ] [REMOTE    ] SDHY: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T21:02:58.547679] [INFO ] [REMOTE    ] SDHY: Fetching primary data for 2025-09.
[2025-10-24T21:02:59.347621] [INFO ] [REMOTE    ] SEI: Fetching primary data for 2025-05.
[2025-10-24T21:02:59.445337] [INFO ] [REMOTE    ] SDHY: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T21:03:00.085566] [INFO ] [REMOTE    ] SEI: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T21:03:00.147609] [INFO ] [REMOTE    ] SEI: Fetching primary data for 2025-06.
[2025-10-24T21:03:00.947669] [INFO ] [REMOTE    ] SEE: Fetching primary data for 2025-10.
[2025-10-24T21:03:01.361499] [INFO ] [REMOTE    ] SEI: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T21:03:01.747707] [INFO ] [REMOTE    ] SDHY: Fetching primary data for 2025-10.
[2025-10-24T21:03:02.306465] [INFO ] [REMOTE    ] SEE: Incremental fetch complete for 2025-10 (1.36 seconds).
[2025-10-24T21:03:02.315104] [INFO ] [REMOTE    ] SEE: Full fetch complete (69702 records).
[2025-10-24T21:03:02.315274] [DEBUG] [VALIDATOR ] SEE: Validating primary data.
[2025-10-24T21:03:02.316071] [FATAL] [VALIDATOR ] SEE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:03:02.316177] [FATAL] [MAIN      ] SEE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:03:02.316244] [WARN ] [MAIN      ] SEE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:03:02.316316] [INFO ] [LOCAL     ] SEE: Starting deletion of primary data.
[2025-10-24T21:03:02.316381] [DEBUG] [LOCAL     ] SEE: No primary data file found to delete.
[2025-10-24T21:03:02.316416] [INFO ] [LOCAL     ] SEE: Starting deletion of derivative data.
[2025-10-24T21:03:02.316565] [DEBUG] [LOCAL     ] SEE: Deleted derivative data file.
[2025-10-24T21:03:02.316972] [INFO ] [MAIN      ] Update Progress: 1887/2366 symbols completed. SEE took 33.3s. Estimated remaining: 1h 1m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:03:02.488115] [INFO ] [MAIN      ] SEM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:03:02.530248] [DEBUG] [LOCAL     ] SEM: Loaded 43469 existing records from primary storage.
[2025-10-24T21:03:02.530549] [INFO ] [MAIN      ] SEM: Loaded 43469 existing records.
[2025-10-24T21:03:02.552925] [INFO ] [REMOTE    ] SEI: Fetching primary data for 2025-07.
[2025-10-24T21:03:02.719102] [WARN ] [MAIN      ] SEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:03:02.719343] [INFO ] [MAIN      ] SEM: Wiping existing primary data before full refresh.
[2025-10-24T21:03:02.719395] [INFO ] [LOCAL     ] SEM: Starting deletion of primary data.
[2025-10-24T21:03:02.720362] [DEBUG] [LOCAL     ] SEM: Deleted primary data file.
[2025-10-24T21:03:02.720421] [INFO ] [MAIN      ] SEM: Starting full primary refresh.
[2025-10-24T21:03:03.011020] [INFO ] [REMOTE    ] SDHY: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T21:03:03.044420] [INFO ] [REMOTE    ] SDHY: Full fetch complete (15867 records).
[2025-10-24T21:03:03.069349] [DEBUG] [VALIDATOR ] SDHY: Validating primary data.
[2025-10-24T21:03:03.087573] [FATAL] [VALIDATOR ] SDHY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:03:03.091064] [FATAL] [MAIN      ] SDHY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:03:03.106983] [WARN ] [MAIN      ] SDHY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:03:03.112332] [INFO ] [LOCAL     ] SDHY: Starting deletion of primary data.
[2025-10-24T21:03:03.112243] [INFO ] [REMOTE    ] SEM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:03:03.112542] [DEBUG] [LOCAL     ] SDHY: No primary data file found to delete.
[2025-10-24T21:03:03.112903] [INFO ] [LOCAL     ] SDHY: Starting deletion of derivative data.
[2025-10-24T21:03:03.113080] [DEBUG] [LOCAL     ] SDHY: Deleted derivative data file.
[2025-10-24T21:03:03.113182] [INFO ] [MAIN      ] Update Progress: 1888/2366 symbols completed. SDHY took 51.3s. Estimated remaining: 1h 1m 31s. Rate: 7.8 symbols/min
[2025-10-24T21:03:03.292625] [INFO ] [MAIN      ] SEMR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:03:03.332745] [DEBUG] [LOCAL     ] SEMR: Loaded 42346 existing records from primary storage.
[2025-10-24T21:03:03.333101] [INFO ] [MAIN      ] SEMR: Loaded 42346 existing records.
[2025-10-24T21:03:03.355413] [INFO ] [REMOTE    ] SEM: Fetching primary data for 2025-01.
[2025-10-24T21:03:03.527172] [WARN ] [MAIN      ] SEMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:03:03.527420] [INFO ] [MAIN      ] SEMR: Wiping existing primary data before full refresh.
[2025-10-24T21:03:03.527481] [INFO ] [LOCAL     ] SEMR: Starting deletion of primary data.
[2025-10-24T21:03:03.528149] [DEBUG] [LOCAL     ] SEMR: Deleted primary data file.
[2025-10-24T21:03:03.528208] [INFO ] [MAIN      ] SEMR: Starting full primary refresh.
[2025-10-24T21:03:03.940551] [INFO ] [REMOTE    ] SEMR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:03:03.969933] [INFO ] [REMOTE    ] SEI: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T21:03:04.006821] [INFO ] [REMOTE    ] SEM: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T21:03:04.147690] [INFO ] [REMOTE    ] SEI: Fetching primary data for 2025-08.
[2025-10-24T21:03:04.899594] [INFO ] [REMOTE    ] SEI: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T21:03:04.947695] [INFO ] [REMOTE    ] SEG: Fetching primary data for 2025-10.
[2025-10-24T21:03:05.711747] [INFO ] [REMOTE    ] SEG: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T21:03:05.714498] [INFO ] [REMOTE    ] SEG: Full fetch complete (19717 records).
[2025-10-24T21:03:05.714731] [DEBUG] [VALIDATOR ] SEG: Validating primary data.
[2025-10-24T21:03:05.715342] [FATAL] [VALIDATOR ] SEG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:03:05.715430] [FATAL] [MAIN      ] SEG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:03:05.715501] [WARN ] [MAIN      ] SEG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:03:05.715578] [INFO ] [LOCAL     ] SEG: Starting deletion of primary data.
[2025-10-24T21:03:05.715685] [DEBUG] [LOCAL     ] SEG: No primary data file found to delete.
[2025-10-24T21:03:05.715744] [INFO ] [LOCAL     ] SEG: Starting deletion of derivative data.
[2025-10-24T21:03:05.715938] [DEBUG] [LOCAL     ] SEG: Deleted derivative data file.
[2025-10-24T21:03:05.716040] [INFO ] [MAIN      ] Update Progress: 1889/2366 symbols completed. SEG took 28.6s. Estimated remaining: 1h 1m 22s. Rate: 7.8 symbols/min
[2025-10-24T21:03:05.752756] [INFO ] [REMOTE    ] SEM: Fetching primary data for 2025-02.
[2025-10-24T21:03:05.908343] [INFO ] [MAIN      ] SES: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:03:05.968636] [DEBUG] [LOCAL     ] SES: Loaded 52003 existing records from primary storage.
[2025-10-24T21:03:05.969223] [INFO ] [MAIN      ] SES: Loaded 52003 existing records.
[2025-10-24T21:03:06.174209] [WARN ] [MAIN      ] SES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:03:06.174505] [INFO ] [MAIN      ] SES: Wiping existing primary data before full refresh.
[2025-10-24T21:03:06.174556] [INFO ] [LOCAL     ] SES: Starting deletion of primary data.
[2025-10-24T21:03:06.175614] [DEBUG] [LOCAL     ] SES: Deleted primary data file.
[2025-10-24T21:03:06.175724] [INFO ] [MAIN      ] SES: Starting full primary refresh.
[2025-10-24T21:03:06.565086] [INFO ] [REMOTE    ] SEMR: Fetching primary data for 2025-01.
[2025-10-24T21:03:06.570942] [INFO ] [REMOTE    ] SES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:03:06.595877] [INFO ] [REMOTE    ] SEM: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T21:03:07.347632] [INFO ] [REMOTE    ] SEI: Fetching primary data for 2025-09.
[2025-10-24T21:03:07.680135] [INFO ] [REMOTE    ] SEMR: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T21:03:08.129946] [INFO ] [REMOTE    ] SEI: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T21:03:08.147620] [INFO ] [REMOTE    ] SEI: Fetching primary data for 2025-10.
[2025-10-24T21:03:08.873885] [INFO ] [REMOTE    ] SEI: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:03:08.884069] [INFO ] [REMOTE    ] SEI: Full fetch complete (70972 records).
[2025-10-24T21:03:08.884206] [DEBUG] [VALIDATOR ] SEI: Validating primary data.
[2025-10-24T21:03:08.884990] [FATAL] [VALIDATOR ] SEI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:03:08.885094] [FATAL] [MAIN      ] SEI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:03:08.885136] [WARN ] [MAIN      ] SEI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:03:08.885175] [INFO ] [LOCAL     ] SEI: Starting deletion of primary data.
[2025-10-24T21:03:08.885230] [DEBUG] [LOCAL     ] SEI: No primary data file found to delete.
[2025-10-24T21:03:08.885264] [INFO ] [LOCAL     ] SEI: Starting deletion of derivative data.
[2025-10-24T21:03:08.885414] [DEBUG] [LOCAL     ] SEI: Deleted derivative data file.
[2025-10-24T21:03:08.885850] [INFO ] [MAIN      ] Update Progress: 1890/2366 symbols completed. SEI took 25.5s. Estimated remaining: 1h 1m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:03:08.952854] [INFO ] [REMOTE    ] SES: Fetching primary data for 2025-01.
[2025-10-24T21:03:09.062699] [INFO ] [MAIN      ] SF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:03:09.101742] [DEBUG] [LOCAL     ] SF: Loaded 41695 existing records from primary storage.
[2025-10-24T21:03:09.102015] [INFO ] [MAIN      ] SF: Loaded 41695 existing records.
[2025-10-24T21:03:09.277757] [WARN ] [MAIN      ] SF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:03:09.277982] [INFO ] [MAIN      ] SF: Wiping existing primary data before full refresh.
[2025-10-24T21:03:09.278026] [INFO ] [LOCAL     ] SF: Starting deletion of primary data.
[2025-10-24T21:03:09.278350] [DEBUG] [LOCAL     ] SF: Deleted primary data file.
[2025-10-24T21:03:09.278409] [INFO ] [MAIN      ] SF: Starting full primary refresh.
[2025-10-24T21:03:09.628080] [INFO ] [REMOTE    ] SF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:03:09.747618] [INFO ] [REMOTE    ] SF: Fetching primary data for 2025-01.
[2025-10-24T21:03:09.846623] [INFO ] [REMOTE    ] SES: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T21:03:10.561689] [INFO ] [REMOTE    ] SF: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T21:03:10.560254] [INFO ] [REMOTE    ] SEM: Fetching primary data for 2025-03.
[2025-10-24T21:03:11.347686] [INFO ] [REMOTE    ] SF: Fetching primary data for 2025-02.
[2025-10-24T21:03:11.479514] [INFO ] [REMOTE    ] SEM: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T21:03:12.147708] [INFO ] [REMOTE    ] SEM: Fetching primary data for 2025-04.
[2025-10-24T21:03:12.715174] [INFO ] [REMOTE    ] SF: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T21:03:12.947691] [INFO ] [REMOTE    ] SF: Fetching primary data for 2025-03.
[2025-10-24T21:03:13.616600] [INFO ] [REMOTE    ] SEM: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T21:03:13.747630] [INFO ] [REMOTE    ] SEM: Fetching primary data for 2025-05.
[2025-10-24T21:03:14.050746] [INFO ] [REMOTE    ] SF: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T21:03:14.547619] [INFO ] [REMOTE    ] SEMR: Fetching primary data for 2025-02.
[2025-10-24T21:03:14.634725] [INFO ] [REMOTE    ] SEM: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T21:03:14.811902] [INFO ] [REMOTE    ] SEMR: Incremental fetch complete for 2025-02 (0.26 seconds).
[2025-10-24T21:03:15.347666] [INFO ] [REMOTE    ] SES: Fetching primary data for 2025-02.
[2025-10-24T21:03:16.147611] [INFO ] [REMOTE    ] SEM: Fetching primary data for 2025-06.
[2025-10-24T21:03:16.647989] [INFO ] [REMOTE    ] SES: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T21:03:16.947722] [INFO ] [REMOTE    ] SEMR: Fetching primary data for 2025-03.
[2025-10-24T21:03:17.319932] [INFO ] [REMOTE    ] SEM: Incremental fetch complete for 2025-06 (1.17 seconds).
[2025-10-24T21:03:17.667876] [INFO ] [REMOTE    ] SEMR: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T21:03:17.747614] [INFO ] [REMOTE    ] SEMR: Fetching primary data for 2025-04.
[2025-10-24T21:03:18.547721] [INFO ] [REMOTE    ] SF: Fetching primary data for 2025-04.
[2025-10-24T21:03:18.988560] [INFO ] [REMOTE    ] SEMR: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T21:03:19.327457] [INFO ] [REMOTE    ] SF: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T21:03:19.347605] [INFO ] [REMOTE    ] SF: Fetching primary data for 2025-05.
[2025-10-24T21:03:20.126583] [INFO ] [REMOTE    ] SF: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T21:03:20.147594] [INFO ] [REMOTE    ] SF: Fetching primary data for 2025-06.
[2025-10-24T21:03:20.947628] [INFO ] [REMOTE    ] SEMR: Fetching primary data for 2025-05.
[2025-10-24T21:03:21.417334] [INFO ] [REMOTE    ] SF: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T21:03:21.747628] [INFO ] [REMOTE    ] SES: Fetching primary data for 2025-03.
[2025-10-24T21:03:22.262201] [INFO ] [REMOTE    ] SEMR: Incremental fetch complete for 2025-05 (1.31 seconds).
[2025-10-24T21:03:22.534116] [INFO ] [REMOTE    ] SES: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T21:03:22.547594] [INFO ] [REMOTE    ] SES: Fetching primary data for 2025-04.
[2025-10-24T21:03:23.347619] [INFO ] [REMOTE    ] SEM: Fetching primary data for 2025-07.
[2025-10-24T21:03:23.686278] [INFO ] [REMOTE    ] SES: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T21:03:24.153775] [INFO ] [REMOTE    ] SEMR: Fetching primary data for 2025-06.
[2025-10-24T21:03:24.169372] [INFO ] [REMOTE    ] SEM: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T21:03:24.889157] [INFO ] [REMOTE    ] SEMR: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T21:03:24.947679] [INFO ] [REMOTE    ] SF: Fetching primary data for 2025-07.
[2025-10-24T21:03:25.524621] [INFO ] [REMOTE    ] SF: Incremental fetch complete for 2025-07 (0.58 seconds).
[2025-10-24T21:03:25.747666] [INFO ] [REMOTE    ] SES: Fetching primary data for 2025-05.
[2025-10-24T21:03:26.547631] [INFO ] [REMOTE    ] SF: Fetching primary data for 2025-08.
[2025-10-24T21:03:26.601378] [INFO ] [REMOTE    ] SES: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T21:03:27.270502] [INFO ] [REMOTE    ] SF: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T21:03:27.347622] [INFO ] [REMOTE    ] SEMR: Fetching primary data for 2025-07.
[2025-10-24T21:03:28.144412] [INFO ] [REMOTE    ] SEMR: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T21:03:28.152336] [INFO ] [REMOTE    ] SES: Fetching primary data for 2025-06.
[2025-10-24T21:03:28.929899] [INFO ] [REMOTE    ] SES: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T21:03:28.947607] [INFO ] [REMOTE    ] SES: Fetching primary data for 2025-07.
[2025-10-24T21:03:29.747632] [INFO ] [REMOTE    ] SF: Fetching primary data for 2025-09.
[2025-10-24T21:03:30.382014] [INFO ] [REMOTE    ] SES: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T21:03:30.467091] [INFO ] [REMOTE    ] SF: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T21:03:30.547613] [INFO ] [REMOTE    ] SEM: Fetching primary data for 2025-08.
[2025-10-24T21:03:31.277791] [INFO ] [REMOTE    ] SEM: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T21:03:31.347597] [INFO ] [REMOTE    ] SEM: Fetching primary data for 2025-09.
[2025-10-24T21:03:32.075101] [INFO ] [REMOTE    ] SEM: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T21:03:32.147680] [INFO ] [REMOTE    ] SEM: Fetching primary data for 2025-10.
[2025-10-24T21:03:32.849801] [INFO ] [REMOTE    ] SEM: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T21:03:32.857438] [INFO ] [REMOTE    ] SEM: Full fetch complete (61185 records).
[2025-10-24T21:03:32.857590] [DEBUG] [VALIDATOR ] SEM: Validating primary data.
[2025-10-24T21:03:32.859168] [FATAL] [VALIDATOR ] SEM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:03:32.859271] [FATAL] [MAIN      ] SEM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:03:32.859315] [WARN ] [MAIN      ] SEM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:03:32.859354] [INFO ] [LOCAL     ] SEM: Starting deletion of primary data.
[2025-10-24T21:03:32.859409] [DEBUG] [LOCAL     ] SEM: No primary data file found to delete.
[2025-10-24T21:03:32.859444] [INFO ] [LOCAL     ] SEM: Starting deletion of derivative data.
[2025-10-24T21:03:32.859633] [DEBUG] [LOCAL     ] SEM: Deleted derivative data file.
[2025-10-24T21:03:32.860096] [INFO ] [MAIN      ] Update Progress: 1891/2366 symbols completed. SEM took 30.5s. Estimated remaining: 1h 1m 10s. Rate: 7.8 symbols/min
[2025-10-24T21:03:32.956594] [INFO ] [REMOTE    ] SES: Fetching primary data for 2025-08.
[2025-10-24T21:03:33.033775] [INFO ] [MAIN      ] SFB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:03:33.040293] [DEBUG] [LOCAL     ] SFB: Loaded 3706 existing records from primary storage.
[2025-10-24T21:03:33.040513] [INFO ] [MAIN      ] SFB: Loaded 3706 existing records.
[2025-10-24T21:03:33.211762] [WARN ] [MAIN      ] SFB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:03:33.211985] [INFO ] [MAIN      ] SFB: Wiping existing primary data before full refresh.
[2025-10-24T21:03:33.212033] [INFO ] [LOCAL     ] SFB: Starting deletion of primary data.
[2025-10-24T21:03:33.212300] [DEBUG] [LOCAL     ] SFB: Deleted primary data file.
[2025-10-24T21:03:33.212357] [INFO ] [MAIN      ] SFB: Starting full primary refresh.
[2025-10-24T21:03:33.556870] [INFO ] [REMOTE    ] SFB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:03:33.747638] [INFO ] [REMOTE    ] SFB: Fetching primary data for 2025-01.
[2025-10-24T21:03:34.273387] [INFO ] [REMOTE    ] SES: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T21:03:34.303359] [INFO ] [REMOTE    ] SFB: Incremental fetch complete for 2025-01 (0.56 seconds).
[2025-10-24T21:03:34.547609] [INFO ] [REMOTE    ] SES: Fetching primary data for 2025-09.
[2025-10-24T21:03:35.358045] [INFO ] [REMOTE    ] SF: Fetching primary data for 2025-10.
[2025-10-24T21:03:35.360586] [INFO ] [REMOTE    ] SES: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T21:03:36.075119] [INFO ] [REMOTE    ] SF: Incremental fetch complete for 2025-10 (0.72 seconds).
[2025-10-24T21:03:36.082464] [INFO ] [REMOTE    ] SF: Full fetch complete (60164 records).
[2025-10-24T21:03:36.082573] [DEBUG] [VALIDATOR ] SF: Validating primary data.
[2025-10-24T21:03:36.083193] [FATAL] [VALIDATOR ] SF: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:03:36.083279] [FATAL] [MAIN      ] SF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:03:36.083322] [WARN ] [MAIN      ] SF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:03:36.083360] [INFO ] [LOCAL     ] SF: Starting deletion of primary data.
[2025-10-24T21:03:36.083414] [DEBUG] [LOCAL     ] SF: No primary data file found to delete.
[2025-10-24T21:03:36.083450] [INFO ] [LOCAL     ] SF: Starting deletion of derivative data.
[2025-10-24T21:03:36.083604] [DEBUG] [LOCAL     ] SF: Deleted derivative data file.
[2025-10-24T21:03:36.083700] [INFO ] [MAIN      ] Update Progress: 1892/2366 symbols completed. SF took 27.2s. Estimated remaining: 1h 1m 1s. Rate: 7.8 symbols/min
[2025-10-24T21:03:36.152873] [INFO ] [REMOTE    ] SES: Fetching primary data for 2025-10.
[2025-10-24T21:03:36.259969] [INFO ] [MAIN      ] SFBS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:03:36.281515] [DEBUG] [LOCAL     ] SFBS: Loaded 21618 existing records from primary storage.
[2025-10-24T21:03:36.281774] [INFO ] [MAIN      ] SFBS: Loaded 21618 existing records.
[2025-10-24T21:03:36.458396] [WARN ] [MAIN      ] SFBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:03:36.458575] [INFO ] [MAIN      ] SFBS: Wiping existing primary data before full refresh.
[2025-10-24T21:03:36.458625] [INFO ] [LOCAL     ] SFBS: Starting deletion of primary data.
[2025-10-24T21:03:36.458916] [DEBUG] [LOCAL     ] SFBS: Deleted primary data file.
[2025-10-24T21:03:36.458962] [INFO ] [MAIN      ] SFBS: Starting full primary refresh.
[2025-10-24T21:03:36.822380] [INFO ] [REMOTE    ] SFBS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:03:36.950865] [INFO ] [REMOTE    ] SFB: Fetching primary data for 2025-02.
[2025-10-24T21:03:36.956041] [INFO ] [REMOTE    ] SES: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T21:03:36.965786] [INFO ] [REMOTE    ] SES: Full fetch complete (75256 records).
[2025-10-24T21:03:36.965895] [DEBUG] [VALIDATOR ] SES: Validating primary data.
[2025-10-24T21:03:36.966593] [FATAL] [VALIDATOR ] SES: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:03:36.966751] [FATAL] [MAIN      ] SES: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:03:36.966819] [WARN ] [MAIN      ] SES: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:03:36.966891] [INFO ] [LOCAL     ] SES: Starting deletion of primary data.
[2025-10-24T21:03:36.966953] [DEBUG] [LOCAL     ] SES: No primary data file found to delete.
[2025-10-24T21:03:36.966987] [INFO ] [LOCAL     ] SES: Starting deletion of derivative data.
[2025-10-24T21:03:36.967160] [DEBUG] [LOCAL     ] SES: Deleted derivative data file.
[2025-10-24T21:03:36.967568] [INFO ] [MAIN      ] Update Progress: 1893/2366 symbols completed. SES took 31.3s. Estimated remaining: 1h 0m 52s. Rate: 7.8 symbols/min
[2025-10-24T21:03:37.138367] [INFO ] [MAIN      ] SFL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:03:37.138518] [DEBUG] [LOCAL     ] SFL: No existing data file found in primary storage.
[2025-10-24T21:03:37.138555] [WARN ] [MAIN      ] SFL: No existing data found, performing full refresh instead.
[2025-10-24T21:03:37.138688] [INFO ] [MAIN      ] SFL: Wiping existing primary data before full refresh.
[2025-10-24T21:03:37.138742] [INFO ] [LOCAL     ] SFL: Starting deletion of primary data.
[2025-10-24T21:03:37.138786] [DEBUG] [LOCAL     ] SFL: No primary data file found to delete.
[2025-10-24T21:03:37.138854] [INFO ] [MAIN      ] SFL: Starting full primary refresh.
[2025-10-24T21:03:37.488115] [INFO ] [REMOTE    ] SFL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:03:37.539364] [INFO ] [REMOTE    ] SFB: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T21:03:37.747621] [INFO ] [REMOTE    ] SFB: Fetching primary data for 2025-03.
[2025-10-24T21:03:38.541603] [INFO ] [REMOTE    ] SFB: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T21:03:38.547595] [INFO ] [REMOTE    ] SFB: Fetching primary data for 2025-04.
[2025-10-24T21:03:39.050335] [INFO ] [REMOTE    ] SFB: Incremental fetch complete for 2025-04 (0.50 seconds).
[2025-10-24T21:03:39.347635] [INFO ] [REMOTE    ] SFB: Fetching primary data for 2025-05.
[2025-10-24T21:03:39.973807] [INFO ] [REMOTE    ] SFB: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T21:03:40.147673] [INFO ] [REMOTE    ] SFL: Fetching primary data for 2025-01.
[2025-10-24T21:03:40.856417] [INFO ] [REMOTE    ] SFL: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T21:03:40.947668] [INFO ] [REMOTE    ] SFBS: Fetching primary data for 2025-01.
[2025-10-24T21:03:41.747684] [INFO ] [REMOTE    ] SFL: Fetching primary data for 2025-02.
[2025-10-24T21:03:41.802842] [INFO ] [REMOTE    ] SFBS: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T21:03:42.539803] [INFO ] [REMOTE    ] SFL: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T21:03:42.548331] [INFO ] [REMOTE    ] SFB: Fetching primary data for 2025-06.
[2025-10-24T21:03:43.258914] [INFO ] [REMOTE    ] SFB: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T21:03:43.347683] [INFO ] [REMOTE    ] SFBS: Fetching primary data for 2025-02.
[2025-10-24T21:03:44.147636] [INFO ] [REMOTE    ] SFL: Fetching primary data for 2025-03.
[2025-10-24T21:03:44.562707] [INFO ] [REMOTE    ] SFBS: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T21:03:44.913880] [INFO ] [REMOTE    ] SFL: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T21:03:44.947684] [INFO ] [REMOTE    ] SFBS: Fetching primary data for 2025-03.
[2025-10-24T21:03:45.747696] [INFO ] [REMOTE    ] SFL: Fetching primary data for 2025-04.
[2025-10-24T21:03:46.150162] [INFO ] [REMOTE    ] SFBS: Incremental fetch complete for 2025-03 (1.20 seconds).
[2025-10-24T21:03:46.547623] [INFO ] [REMOTE    ] SEMR: Fetching primary data for 2025-08.
[2025-10-24T21:03:46.772528] [INFO ] [REMOTE    ] SFL: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T21:03:47.292002] [INFO ] [REMOTE    ] SEMR: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T21:03:47.347606] [INFO ] [REMOTE    ] SEMR: Fetching primary data for 2025-09.
[2025-10-24T21:03:48.147706] [INFO ] [REMOTE    ] SFBS: Fetching primary data for 2025-04.
[2025-10-24T21:03:48.466849] [INFO ] [REMOTE    ] SEMR: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T21:03:48.947699] [INFO ] [REMOTE    ] SFL: Fetching primary data for 2025-05.
[2025-10-24T21:03:49.406038] [INFO ] [REMOTE    ] SFBS: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T21:03:49.747620] [INFO ] [REMOTE    ] SEMR: Fetching primary data for 2025-10.
[2025-10-24T21:03:50.446953] [INFO ] [REMOTE    ] SEMR: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T21:03:50.455382] [INFO ] [REMOTE    ] SEMR: Full fetch complete (60407 records).
[2025-10-24T21:03:50.455499] [DEBUG] [VALIDATOR ] SEMR: Validating primary data.
[2025-10-24T21:03:50.456224] [FATAL] [VALIDATOR ] SEMR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:03:50.456326] [FATAL] [MAIN      ] SEMR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:03:50.456404] [WARN ] [MAIN      ] SEMR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:03:50.456497] [INFO ] [LOCAL     ] SEMR: Starting deletion of primary data.
[2025-10-24T21:03:50.456582] [DEBUG] [LOCAL     ] SEMR: No primary data file found to delete.
[2025-10-24T21:03:50.456668] [INFO ] [LOCAL     ] SEMR: Starting deletion of derivative data.
[2025-10-24T21:03:50.456844] [DEBUG] [LOCAL     ] SEMR: Deleted derivative data file.
[2025-10-24T21:03:50.457440] [INFO ] [MAIN      ] Update Progress: 1894/2366 symbols completed. SEMR took 47.3s. Estimated remaining: 1h 0m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:03:50.548087] [INFO ] [REMOTE    ] SFB: Fetching primary data for 2025-07.
[2025-10-24T21:03:50.658611] [INFO ] [MAIN      ] SG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:03:50.661070] [INFO ] [REMOTE    ] SFL: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T21:03:50.719194] [DEBUG] [LOCAL     ] SG: Loaded 53894 existing records from primary storage.
[2025-10-24T21:03:50.719483] [INFO ] [MAIN      ] SG: Loaded 53894 existing records.
[2025-10-24T21:03:50.893922] [WARN ] [MAIN      ] SG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:03:50.894115] [INFO ] [MAIN      ] SG: Wiping existing primary data before full refresh.
[2025-10-24T21:03:50.894170] [INFO ] [LOCAL     ] SG: Starting deletion of primary data.
[2025-10-24T21:03:50.895406] [DEBUG] [LOCAL     ] SG: Deleted primary data file.
[2025-10-24T21:03:50.895467] [INFO ] [MAIN      ] SG: Starting full primary refresh.
[2025-10-24T21:03:51.246136] [INFO ] [REMOTE    ] SG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:03:51.317441] [INFO ] [REMOTE    ] SFB: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T21:03:51.347595] [INFO ] [REMOTE    ] SG: Fetching primary data for 2025-01.
[2025-10-24T21:03:52.147623] [INFO ] [REMOTE    ] SFB: Fetching primary data for 2025-08.
[2025-10-24T21:03:52.641354] [INFO ] [REMOTE    ] SG: Incremental fetch complete for 2025-01 (1.29 seconds).
[2025-10-24T21:03:52.883507] [INFO ] [REMOTE    ] SFB: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T21:03:52.947760] [INFO ] [REMOTE    ] SFL: Fetching primary data for 2025-06.
[2025-10-24T21:03:53.747685] [INFO ] [REMOTE    ] SFB: Fetching primary data for 2025-09.
[2025-10-24T21:03:54.386906] [INFO ] [REMOTE    ] SFB: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T21:03:54.547724] [INFO ] [REMOTE    ] SG: Fetching primary data for 2025-02.
[2025-10-24T21:03:54.595307] [INFO ] [REMOTE    ] SFL: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T21:03:55.347717] [INFO ] [REMOTE    ] SFBS: Fetching primary data for 2025-05.
[2025-10-24T21:03:55.723219] [INFO ] [REMOTE    ] SG: Incremental fetch complete for 2025-02 (1.18 seconds).
[2025-10-24T21:03:56.147725] [INFO ] [REMOTE    ] SG: Fetching primary data for 2025-03.
[2025-10-24T21:03:56.204537] [INFO ] [REMOTE    ] SFBS: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T21:03:56.947714] [INFO ] [REMOTE    ] SFL: Fetching primary data for 2025-07.
[2025-10-24T21:03:57.496530] [INFO ] [REMOTE    ] SG: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T21:03:57.747613] [INFO ] [REMOTE    ] SFBS: Fetching primary data for 2025-06.
[2025-10-24T21:03:58.329994] [INFO ] [REMOTE    ] SFBS: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T21:03:58.531825] [INFO ] [REMOTE    ] SFL: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T21:03:58.547603] [INFO ] [REMOTE    ] SFL: Fetching primary data for 2025-08.
[2025-10-24T21:03:59.347726] [INFO ] [REMOTE    ] SG: Fetching primary data for 2025-04.
[2025-10-24T21:04:00.144027] [INFO ] [REMOTE    ] SG: Incremental fetch complete for 2025-04 (0.80 seconds).
[2025-10-24T21:04:00.154300] [INFO ] [REMOTE    ] SFBS: Fetching primary data for 2025-07.
[2025-10-24T21:04:00.220286] [INFO ] [REMOTE    ] SFL: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T21:04:00.947701] [INFO ] [REMOTE    ] SFB: Fetching primary data for 2025-10.
[2025-10-24T21:04:01.244054] [INFO ] [REMOTE    ] SFB: Incremental fetch complete for 2025-10 (0.30 seconds).
[2025-10-24T21:04:01.245197] [INFO ] [REMOTE    ] SFB: Full fetch complete (5726 records).
[2025-10-24T21:04:01.245267] [DEBUG] [VALIDATOR ] SFB: Validating primary data.
[2025-10-24T21:04:01.245625] [FATAL] [VALIDATOR ] SFB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:04:01.245733] [FATAL] [MAIN      ] SFB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:04:01.245776] [WARN ] [MAIN      ] SFB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:04:01.245814] [INFO ] [LOCAL     ] SFB: Starting deletion of primary data.
[2025-10-24T21:04:01.245868] [DEBUG] [LOCAL     ] SFB: No primary data file found to delete.
[2025-10-24T21:04:01.245903] [INFO ] [LOCAL     ] SFB: Starting deletion of derivative data.
[2025-10-24T21:04:01.246040] [DEBUG] [LOCAL     ] SFB: Deleted derivative data file.
[2025-10-24T21:04:01.246106] [INFO ] [MAIN      ] Update Progress: 1895/2366 symbols completed. SFB took 28.4s. Estimated remaining: 1h 0m 38s. Rate: 7.8 symbols/min
[2025-10-24T21:04:01.422127] [INFO ] [MAIN      ] SGHC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:04:01.465504] [DEBUG] [LOCAL     ] SGHC: Loaded 47651 existing records from primary storage.
[2025-10-24T21:04:01.465826] [INFO ] [MAIN      ] SGHC: Loaded 47651 existing records.
[2025-10-24T21:04:01.650696] [INFO ] [REMOTE    ] SFBS: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T21:04:01.669726] [WARN ] [MAIN      ] SGHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:04:01.675325] [INFO ] [MAIN      ] SGHC: Wiping existing primary data before full refresh.
[2025-10-24T21:04:01.675393] [INFO ] [LOCAL     ] SGHC: Starting deletion of primary data.
[2025-10-24T21:04:01.676002] [DEBUG] [LOCAL     ] SGHC: Deleted primary data file.
[2025-10-24T21:04:01.676060] [INFO ] [MAIN      ] SGHC: Starting full primary refresh.
[2025-10-24T21:04:01.752709] [INFO ] [REMOTE    ] SG: Fetching primary data for 2025-05.
[2025-10-24T21:04:02.032275] [INFO ] [REMOTE    ] SGHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:04:02.547724] [INFO ] [REMOTE    ] SGHC: Fetching primary data for 2025-01.
[2025-10-24T21:04:02.610856] [INFO ] [REMOTE    ] SG: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T21:04:03.244057] [INFO ] [REMOTE    ] SGHC: Incremental fetch complete for 2025-01 (0.70 seconds).
[2025-10-24T21:04:03.347628] [INFO ] [REMOTE    ] SGHC: Fetching primary data for 2025-02.
[2025-10-24T21:04:04.085623] [INFO ] [REMOTE    ] SGHC: Incremental fetch complete for 2025-02 (0.74 seconds).
[2025-10-24T21:04:04.147606] [INFO ] [REMOTE    ] SG: Fetching primary data for 2025-06.
[2025-10-24T21:04:04.947620] [INFO ] [REMOTE    ] SFBS: Fetching primary data for 2025-08.
[2025-10-24T21:04:05.129030] [INFO ] [REMOTE    ] SG: Incremental fetch complete for 2025-06 (0.98 seconds).
[2025-10-24T21:04:05.529905] [INFO ] [REMOTE    ] SFBS: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T21:04:05.747618] [INFO ] [REMOTE    ] SGHC: Fetching primary data for 2025-03.
[2025-10-24T21:04:06.547750] [INFO ] [REMOTE    ] SFL: Fetching primary data for 2025-09.
[2025-10-24T21:04:07.174599] [INFO ] [REMOTE    ] SGHC: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T21:04:07.347635] [INFO ] [REMOTE    ] SFBS: Fetching primary data for 2025-09.
[2025-10-24T21:04:08.147705] [INFO ] [REMOTE    ] SGHC: Fetching primary data for 2025-04.
[2025-10-24T21:04:08.185866] [INFO ] [REMOTE    ] SFL: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T21:04:08.276821] [INFO ] [REMOTE    ] SFBS: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T21:04:08.947708] [INFO ] [REMOTE    ] SG: Fetching primary data for 2025-07.
[2025-10-24T21:04:09.506869] [INFO ] [REMOTE    ] SGHC: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T21:04:09.741024] [INFO ] [REMOTE    ] SG: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T21:04:09.751957] [INFO ] [REMOTE    ] SGHC: Fetching primary data for 2025-05.
[2025-10-24T21:04:10.489963] [INFO ] [REMOTE    ] SGHC: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T21:04:10.547604] [INFO ] [REMOTE    ] SGHC: Fetching primary data for 2025-06.
[2025-10-24T21:04:11.347733] [INFO ] [REMOTE    ] SFL: Fetching primary data for 2025-10.
[2025-10-24T21:04:11.571043] [INFO ] [REMOTE    ] SGHC: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T21:04:12.147700] [INFO ] [REMOTE    ] SG: Fetching primary data for 2025-08.
[2025-10-24T21:04:12.947680] [INFO ] [REMOTE    ] SFBS: Fetching primary data for 2025-10.
[2025-10-24T21:04:12.999037] [INFO ] [REMOTE    ] SG: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T21:04:13.051040] [INFO ] [REMOTE    ] SFL: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T21:04:13.059986] [INFO ] [REMOTE    ] SFL: Full fetch complete (65892 records).
[2025-10-24T21:04:13.060154] [DEBUG] [VALIDATOR ] SFL: Validating primary data.
[2025-10-24T21:04:13.446708] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present.
[2025-10-24T21:04:13.446834] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed.
[2025-10-24T21:04:13.448033] [INFO ] [MAIN      ] SFL: Fetched primary data is valid.
[2025-10-24T21:04:13.448096] [DEBUG] [LOCAL     ] SFL: Saving primary data.
[2025-10-24T21:04:13.448712] [FATAL] [LOCAL     ] SFL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:04:13.448837] [FATAL] [MAIN      ] SFL: Failed to save primary data.
[2025-10-24T21:04:13.448878] [WARN ] [MAIN      ] SFL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:04:13.448913] [INFO ] [LOCAL     ] SFL: Starting deletion of primary data.
[2025-10-24T21:04:13.448967] [DEBUG] [LOCAL     ] SFL: No primary data file found to delete.
[2025-10-24T21:04:13.449002] [INFO ] [LOCAL     ] SFL: Starting deletion of derivative data.
[2025-10-24T21:04:13.449040] [DEBUG] [LOCAL     ] SFL: No derivative data file found to delete.
[2025-10-24T21:04:13.449774] [INFO ] [MAIN      ] Update Progress: 1896/2366 symbols completed. SFL took 36.5s. Estimated remaining: 1h 0m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:04:13.622290] [INFO ] [MAIN      ] SGI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:04:13.622569] [DEBUG] [LOCAL     ] SGI: No existing data file found in primary storage.
[2025-10-24T21:04:13.622623] [WARN ] [MAIN      ] SGI: No existing data found, performing full refresh instead.
[2025-10-24T21:04:13.622763] [INFO ] [MAIN      ] SGI: Wiping existing primary data before full refresh.
[2025-10-24T21:04:13.622805] [INFO ] [LOCAL     ] SGI: Starting deletion of primary data.
[2025-10-24T21:04:13.622844] [DEBUG] [LOCAL     ] SGI: No primary data file found to delete.
[2025-10-24T21:04:13.622876] [INFO ] [MAIN      ] SGI: Starting full primary refresh.
[2025-10-24T21:04:13.751750] [INFO ] [REMOTE    ] SGHC: Fetching primary data for 2025-07.
[2025-10-24T21:04:13.849244] [INFO ] [REMOTE    ] SFBS: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T21:04:13.896856] [INFO ] [REMOTE    ] SFBS: Full fetch complete (30472 records).
[2025-10-24T21:04:13.923242] [DEBUG] [VALIDATOR ] SFBS: Validating primary data.
[2025-10-24T21:04:13.970169] [FATAL] [VALIDATOR ] SFBS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:04:13.981362] [FATAL] [MAIN      ] SFBS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:04:13.987157] [WARN ] [MAIN      ] SFBS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:04:13.997515] [INFO ] [LOCAL     ] SFBS: Starting deletion of primary data.
[2025-10-24T21:04:13.997692] [DEBUG] [LOCAL     ] SFBS: No primary data file found to delete.
[2025-10-24T21:04:14.002888] [INFO ] [LOCAL     ] SFBS: Starting deletion of derivative data.
[2025-10-24T21:04:14.021394] [DEBUG] [LOCAL     ] SFBS: Deleted derivative data file.
[2025-10-24T21:04:14.037422] [INFO ] [MAIN      ] Update Progress: 1897/2366 symbols completed. SFBS took 38.0s. Estimated remaining: 1h 0m 22s. Rate: 7.8 symbols/min
[2025-10-24T21:04:14.125182] [INFO ] [REMOTE    ] SGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:04:14.230771] [INFO ] [MAIN      ] SGU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:04:14.241140] [DEBUG] [LOCAL     ] SGU: Loaded 6520 existing records from primary storage.
[2025-10-24T21:04:14.241358] [INFO ] [MAIN      ] SGU: Loaded 6520 existing records.
[2025-10-24T21:04:14.415477] [WARN ] [MAIN      ] SGU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:04:14.415672] [INFO ] [MAIN      ] SGU: Wiping existing primary data before full refresh.
[2025-10-24T21:04:14.415749] [INFO ] [LOCAL     ] SGU: Starting deletion of primary data.
[2025-10-24T21:04:14.415912] [DEBUG] [LOCAL     ] SGU: Deleted primary data file.
[2025-10-24T21:04:14.415975] [INFO ] [MAIN      ] SGU: Starting full primary refresh.
[2025-10-24T21:04:14.554126] [INFO ] [REMOTE    ] SG: Fetching primary data for 2025-09.
[2025-10-24T21:04:14.769583] [INFO ] [REMOTE    ] SGU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:04:14.798116] [INFO ] [REMOTE    ] SGHC: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T21:04:15.352778] [INFO ] [REMOTE    ] SGHC: Fetching primary data for 2025-08.
[2025-10-24T21:04:15.368908] [INFO ] [REMOTE    ] SG: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T21:04:16.147723] [INFO ] [REMOTE    ] SG: Fetching primary data for 2025-10.
[2025-10-24T21:04:16.836096] [INFO ] [REMOTE    ] SGHC: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T21:04:16.948549] [INFO ] [REMOTE    ] SGU: Fetching primary data for 2025-01.
[2025-10-24T21:04:16.951277] [INFO ] [REMOTE    ] SG: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T21:04:16.961228] [INFO ] [REMOTE    ] SG: Full fetch complete (77096 records).
[2025-10-24T21:04:16.961370] [DEBUG] [VALIDATOR ] SG: Validating primary data.
[2025-10-24T21:04:16.962270] [FATAL] [VALIDATOR ] SG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:04:16.962364] [FATAL] [MAIN      ] SG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:04:16.962407] [WARN ] [MAIN      ] SG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:04:16.962484] [INFO ] [LOCAL     ] SG: Starting deletion of primary data.
[2025-10-24T21:04:16.962550] [DEBUG] [LOCAL     ] SG: No primary data file found to delete.
[2025-10-24T21:04:16.962585] [INFO ] [LOCAL     ] SG: Starting deletion of derivative data.
[2025-10-24T21:04:16.962784] [DEBUG] [LOCAL     ] SG: Deleted derivative data file.
[2025-10-24T21:04:16.963314] [INFO ] [MAIN      ] Update Progress: 1898/2366 symbols completed. SG took 26.5s. Estimated remaining: 1h 0m 13s. Rate: 7.8 symbols/min
[2025-10-24T21:04:17.134709] [INFO ] [MAIN      ] SHAK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:04:17.182600] [DEBUG] [LOCAL     ] SHAK: Loaded 49001 existing records from primary storage.
[2025-10-24T21:04:17.182968] [INFO ] [MAIN      ] SHAK: Loaded 49001 existing records.
[2025-10-24T21:04:17.382327] [INFO ] [REMOTE    ] SGU: Incremental fetch complete for 2025-01 (0.43 seconds).
[2025-10-24T21:04:17.387510] [WARN ] [MAIN      ] SHAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:04:17.389725] [INFO ] [MAIN      ] SHAK: Wiping existing primary data before full refresh.
[2025-10-24T21:04:17.389797] [INFO ] [LOCAL     ] SHAK: Starting deletion of primary data.
[2025-10-24T21:04:17.390157] [DEBUG] [LOCAL     ] SHAK: Deleted primary data file.
[2025-10-24T21:04:17.390215] [INFO ] [MAIN      ] SHAK: Starting full primary refresh.
[2025-10-24T21:04:17.741185] [INFO ] [REMOTE    ] SHAK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:04:17.747615] [INFO ] [REMOTE    ] SHAK: Fetching primary data for 2025-01.
[2025-10-24T21:04:18.547693] [INFO ] [REMOTE    ] SGU: Fetching primary data for 2025-02.
[2025-10-24T21:04:18.930442] [INFO ] [REMOTE    ] SHAK: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T21:04:19.241341] [INFO ] [REMOTE    ] SGU: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T21:04:19.347720] [INFO ] [REMOTE    ] SGHC: Fetching primary data for 2025-09.
[2025-10-24T21:04:20.147707] [INFO ] [REMOTE    ] SHAK: Fetching primary data for 2025-02.
[2025-10-24T21:04:20.329912] [INFO ] [REMOTE    ] SGHC: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T21:04:20.947635] [INFO ] [REMOTE    ] SGI: Fetching primary data for 2025-01.
[2025-10-24T21:04:21.240204] [DEBUG] [REMOTE    ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:04:21.240517] [WARN ] [REMOTE    ] SGI: No data returned for month 2025-01
[2025-10-24T21:04:21.240606] [FATAL] [REMOTE    ] SGI: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:04:21.240709] [FATAL] [MAIN      ] SGI: Failed to fetch primary data.
[2025-10-24T21:04:21.240777] [WARN ] [MAIN      ] SGI: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:04:21.240850] [INFO ] [LOCAL     ] SGI: Starting deletion of primary data.
[2025-10-24T21:04:21.240912] [DEBUG] [LOCAL     ] SGI: No primary data file found to delete.
[2025-10-24T21:04:21.240948] [INFO ] [LOCAL     ] SGI: Starting deletion of derivative data.
[2025-10-24T21:04:21.240988] [DEBUG] [LOCAL     ] SGI: No derivative data file found to delete.
[2025-10-24T21:04:21.241032] [INFO ] [MAIN      ] Update Progress: 1899/2366 symbols completed. SGI took 7.8s. Estimated remaining: 1h 0m 5s. Rate: 7.8 symbols/min
[2025-10-24T21:04:21.419277] [INFO ] [MAIN      ] SHCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:04:21.446735] [DEBUG] [LOCAL     ] SHCO: Loaded 25438 existing records from primary storage.
[2025-10-24T21:04:21.446991] [INFO ] [MAIN      ] SHCO: Loaded 25438 existing records.
[2025-10-24T21:04:21.634255] [WARN ] [MAIN      ] SHCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:04:21.634483] [INFO ] [MAIN      ] SHCO: Wiping existing primary data before full refresh.
[2025-10-24T21:04:21.634705] [INFO ] [LOCAL     ] SHCO: Starting deletion of primary data.
[2025-10-24T21:04:21.649103] [DEBUG] [LOCAL     ] SHCO: Deleted primary data file.
[2025-10-24T21:04:21.665698] [INFO ] [MAIN      ] SHCO: Starting full primary refresh.
[2025-10-24T21:04:21.749077] [INFO ] [REMOTE    ] SGHC: Fetching primary data for 2025-10.
[2025-10-24T21:04:21.742377] [INFO ] [REMOTE    ] SHAK: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T21:04:22.046703] [INFO ] [REMOTE    ] SHCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:04:22.547637] [INFO ] [REMOTE    ] SHAK: Fetching primary data for 2025-03.
[2025-10-24T21:04:23.206122] [INFO ] [REMOTE    ] SGHC: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T21:04:23.215544] [INFO ] [REMOTE    ] SGHC: Full fetch complete (65563 records).
[2025-10-24T21:04:23.215705] [DEBUG] [VALIDATOR ] SGHC: Validating primary data.
[2025-10-24T21:04:23.216433] [FATAL] [VALIDATOR ] SGHC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:04:23.216519] [FATAL] [MAIN      ] SGHC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:04:23.216569] [WARN ] [MAIN      ] SGHC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:04:23.216632] [INFO ] [LOCAL     ] SGHC: Starting deletion of primary data.
[2025-10-24T21:04:23.216748] [DEBUG] [LOCAL     ] SGHC: No primary data file found to delete.
[2025-10-24T21:04:23.216803] [INFO ] [LOCAL     ] SGHC: Starting deletion of derivative data.
[2025-10-24T21:04:23.217234] [DEBUG] [LOCAL     ] SGHC: Deleted derivative data file.
[2025-10-24T21:04:23.217858] [INFO ] [MAIN      ] Update Progress: 1900/2366 symbols completed. SGHC took 22.0s. Estimated remaining: 59m 56s. Rate: 7.8 symbols/min
[2025-10-24T21:04:23.352857] [INFO ] [REMOTE    ] SHCO: Fetching primary data for 2025-01.
[2025-10-24T21:04:23.397628] [INFO ] [MAIN      ] SHEL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:04:23.454334] [DEBUG] [LOCAL     ] SHEL: Loaded 54065 existing records from primary storage.
[2025-10-24T21:04:23.454691] [INFO ] [MAIN      ] SHEL: Loaded 54065 existing records.
[2025-10-24T21:04:23.670149] [WARN ] [MAIN      ] SHEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:04:23.670379] [INFO ] [MAIN      ] SHEL: Wiping existing primary data before full refresh.
[2025-10-24T21:04:23.670506] [INFO ] [LOCAL     ] SHEL: Starting deletion of primary data.
[2025-10-24T21:04:23.671048] [DEBUG] [LOCAL     ] SHEL: Deleted primary data file.
[2025-10-24T21:04:23.671102] [INFO ] [MAIN      ] SHEL: Starting full primary refresh.
[2025-10-24T21:04:24.021437] [INFO ] [REMOTE    ] SHAK: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T21:04:24.118524] [INFO ] [REMOTE    ] SHCO: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T21:04:24.115610] [INFO ] [REMOTE    ] SHEL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:04:24.147638] [INFO ] [REMOTE    ] SHAK: Fetching primary data for 2025-04.
[2025-10-24T21:04:24.947727] [INFO ] [REMOTE    ] SHCO: Fetching primary data for 2025-02.
[2025-10-24T21:04:25.532780] [INFO ] [REMOTE    ] SHCO: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T21:04:25.621305] [INFO ] [REMOTE    ] SHAK: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T21:04:25.747674] [INFO ] [REMOTE    ] SHCO: Fetching primary data for 2025-03.
[2025-10-24T21:04:26.484789] [INFO ] [REMOTE    ] SHCO: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T21:04:26.547687] [INFO ] [REMOTE    ] SGU: Fetching primary data for 2025-03.
[2025-10-24T21:04:27.203464] [INFO ] [REMOTE    ] SGU: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T21:04:27.347622] [INFO ] [REMOTE    ] SHEL: Fetching primary data for 2025-01.
[2025-10-24T21:04:28.147618] [INFO ] [REMOTE    ] SHCO: Fetching primary data for 2025-04.
[2025-10-24T21:04:28.196473] [INFO ] [REMOTE    ] SHEL: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T21:04:28.887576] [INFO ] [REMOTE    ] SHCO: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T21:04:28.947609] [INFO ] [REMOTE    ] SGU: Fetching primary data for 2025-04.
[2025-10-24T21:04:29.340627] [INFO ] [REMOTE    ] SGU: Incremental fetch complete for 2025-04 (0.39 seconds).
[2025-10-24T21:04:29.747862] [INFO ] [REMOTE    ] SHEL: Fetching primary data for 2025-02.
[2025-10-24T21:04:30.547629] [INFO ] [REMOTE    ] SHCO: Fetching primary data for 2025-05.
[2025-10-24T21:04:30.795231] [INFO ] [REMOTE    ] SHEL: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T21:04:31.295998] [INFO ] [REMOTE    ] SHCO: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T21:04:31.347711] [INFO ] [REMOTE    ] SHCO: Fetching primary data for 2025-06.
[2025-10-24T21:04:31.917403] [INFO ] [REMOTE    ] SHCO: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T21:04:32.147695] [INFO ] [REMOTE    ] SHCO: Fetching primary data for 2025-07.
[2025-10-24T21:04:32.928213] [INFO ] [REMOTE    ] SHCO: Incremental fetch complete for 2025-07 (0.78 seconds).
[2025-10-24T21:04:32.947589] [INFO ] [REMOTE    ] SHCO: Fetching primary data for 2025-08.
[2025-10-24T21:04:33.747674] [INFO ] [REMOTE    ] SGU: Fetching primary data for 2025-05.
[2025-10-24T21:04:34.115822] [INFO ] [REMOTE    ] SGU: Incremental fetch complete for 2025-05 (0.37 seconds).
[2025-10-24T21:04:34.117167] [INFO ] [REMOTE    ] SHCO: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T21:04:34.547689] [INFO ] [REMOTE    ] SGU: Fetching primary data for 2025-06.
[2025-10-24T21:04:35.211103] [INFO ] [REMOTE    ] SGU: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T21:04:35.347614] [INFO ] [REMOTE    ] SHCO: Fetching primary data for 2025-09.
[2025-10-24T21:04:36.021128] [INFO ] [REMOTE    ] SHCO: Incremental fetch complete for 2025-09 (0.67 seconds).
[2025-10-24T21:04:36.147712] [INFO ] [REMOTE    ] SHEL: Fetching primary data for 2025-03.
[2025-10-24T21:04:36.947606] [INFO ] [REMOTE    ] SHAK: Fetching primary data for 2025-05.
[2025-10-24T21:04:37.514690] [INFO ] [REMOTE    ] SHEL: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T21:04:37.747617] [INFO ] [REMOTE    ] SHEL: Fetching primary data for 2025-04.
[2025-10-24T21:04:37.787796] [INFO ] [REMOTE    ] SHAK: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T21:04:38.547617] [INFO ] [REMOTE    ] SHAK: Fetching primary data for 2025-06.
[2025-10-24T21:04:38.703616] [INFO ] [REMOTE    ] SHEL: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T21:04:39.347722] [INFO ] [REMOTE    ] SHEL: Fetching primary data for 2025-05.
[2025-10-24T21:04:39.711995] [INFO ] [REMOTE    ] SHAK: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T21:04:40.147737] [INFO ] [REMOTE    ] SHCO: Fetching primary data for 2025-10.
[2025-10-24T21:04:40.376912] [INFO ] [REMOTE    ] SHEL: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T21:04:40.947691] [INFO ] [REMOTE    ] SHEL: Fetching primary data for 2025-06.
[2025-10-24T21:04:41.001683] [INFO ] [REMOTE    ] SHCO: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T21:04:41.006375] [INFO ] [REMOTE    ] SHCO: Full fetch complete (37617 records).
[2025-10-24T21:04:41.006483] [DEBUG] [VALIDATOR ] SHCO: Validating primary data.
[2025-10-24T21:04:41.007049] [FATAL] [VALIDATOR ] SHCO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:04:41.007134] [FATAL] [MAIN      ] SHCO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:04:41.007177] [WARN ] [MAIN      ] SHCO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:04:41.007215] [INFO ] [LOCAL     ] SHCO: Starting deletion of primary data.
[2025-10-24T21:04:41.007269] [DEBUG] [LOCAL     ] SHCO: No primary data file found to delete.
[2025-10-24T21:04:41.007304] [INFO ] [LOCAL     ] SHCO: Starting deletion of derivative data.
[2025-10-24T21:04:41.007503] [DEBUG] [LOCAL     ] SHCO: Deleted derivative data file.
[2025-10-24T21:04:41.007606] [INFO ] [MAIN      ] Update Progress: 1901/2366 symbols completed. SHCO took 19.8s. Estimated remaining: 59m 50s. Rate: 7.8 symbols/min
[2025-10-24T21:04:41.178851] [INFO ] [MAIN      ] SHG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:04:41.205536] [DEBUG] [LOCAL     ] SHG: Loaded 26875 existing records from primary storage.
[2025-10-24T21:04:41.205872] [INFO ] [MAIN      ] SHG: Loaded 26875 existing records.
[2025-10-24T21:04:41.390815] [WARN ] [MAIN      ] SHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:04:41.391038] [INFO ] [MAIN      ] SHG: Wiping existing primary data before full refresh.
[2025-10-24T21:04:41.391098] [INFO ] [LOCAL     ] SHG: Starting deletion of primary data.
[2025-10-24T21:04:41.391337] [DEBUG] [LOCAL     ] SHG: Deleted primary data file.
[2025-10-24T21:04:41.391393] [INFO ] [MAIN      ] SHG: Starting full primary refresh.
[2025-10-24T21:04:41.749136] [INFO ] [REMOTE    ] SGU: Fetching primary data for 2025-07.
[2025-10-24T21:04:41.784182] [INFO ] [REMOTE    ] SHG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:04:41.835944] [INFO ] [REMOTE    ] SHEL: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T21:04:42.250762] [INFO ] [REMOTE    ] SGU: Incremental fetch complete for 2025-07 (0.50 seconds).
[2025-10-24T21:04:42.547748] [INFO ] [REMOTE    ] SHAK: Fetching primary data for 2025-07.
[2025-10-24T21:04:43.312366] [INFO ] [REMOTE    ] SHAK: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T21:04:43.347618] [INFO ] [REMOTE    ] SHAK: Fetching primary data for 2025-08.
[2025-10-24T21:04:44.147618] [INFO ] [REMOTE    ] SHEL: Fetching primary data for 2025-07.
[2025-10-24T21:04:44.712310] [INFO ] [REMOTE    ] SHAK: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T21:04:44.832028] [INFO ] [REMOTE    ] SHEL: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T21:04:44.947774] [INFO ] [REMOTE    ] SHAK: Fetching primary data for 2025-09.
[2025-10-24T21:04:45.747634] [INFO ] [REMOTE    ] SHEL: Fetching primary data for 2025-08.
[2025-10-24T21:04:45.943332] [INFO ] [REMOTE    ] SHAK: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T21:04:46.547757] [INFO ] [REMOTE    ] SHAK: Fetching primary data for 2025-10.
[2025-10-24T21:04:46.638289] [INFO ] [REMOTE    ] SHEL: Incremental fetch complete for 2025-08 (0.89 seconds).
[2025-10-24T21:04:47.347716] [INFO ] [REMOTE    ] SHEL: Fetching primary data for 2025-09.
[2025-10-24T21:04:47.766929] [INFO ] [REMOTE    ] SHAK: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T21:04:47.776320] [INFO ] [REMOTE    ] SHAK: Full fetch complete (70895 records).
[2025-10-24T21:04:47.776629] [DEBUG] [VALIDATOR ] SHAK: Validating primary data.
[2025-10-24T21:04:47.779262] [FATAL] [VALIDATOR ] SHAK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:04:47.779400] [FATAL] [MAIN      ] SHAK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:04:47.779471] [WARN ] [MAIN      ] SHAK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:04:47.779548] [INFO ] [LOCAL     ] SHAK: Starting deletion of primary data.
[2025-10-24T21:04:47.779626] [DEBUG] [LOCAL     ] SHAK: No primary data file found to delete.
[2025-10-24T21:04:47.779712] [INFO ] [LOCAL     ] SHAK: Starting deletion of derivative data.
[2025-10-24T21:04:47.779958] [DEBUG] [LOCAL     ] SHAK: Deleted derivative data file.
[2025-10-24T21:04:47.780617] [INFO ] [MAIN      ] Update Progress: 1902/2366 symbols completed. SHAK took 30.8s. Estimated remaining: 59m 42s. Rate: 7.8 symbols/min
[2025-10-24T21:04:47.965981] [INFO ] [MAIN      ] SHO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:04:48.013188] [DEBUG] [LOCAL     ] SHO: Loaded 49414 existing records from primary storage.
[2025-10-24T21:04:48.013527] [INFO ] [MAIN      ] SHO: Loaded 49414 existing records.
[2025-10-24T21:04:48.157212] [INFO ] [REMOTE    ] SHG: Fetching primary data for 2025-01.
[2025-10-24T21:04:48.197943] [WARN ] [MAIN      ] SHO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:04:48.198286] [INFO ] [MAIN      ] SHO: Wiping existing primary data before full refresh.
[2025-10-24T21:04:48.198336] [INFO ] [LOCAL     ] SHO: Starting deletion of primary data.
[2025-10-24T21:04:48.199205] [DEBUG] [LOCAL     ] SHO: Deleted primary data file.
[2025-10-24T21:04:48.199269] [INFO ] [MAIN      ] SHO: Starting full primary refresh.
[2025-10-24T21:04:48.577559] [INFO ] [REMOTE    ] SHO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:04:48.612086] [INFO ] [REMOTE    ] SHEL: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T21:04:48.947702] [INFO ] [REMOTE    ] SGU: Fetching primary data for 2025-08.
[2025-10-24T21:04:49.413999] [INFO ] [REMOTE    ] SGU: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T21:04:49.435570] [INFO ] [REMOTE    ] SHG: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T21:04:49.747725] [INFO ] [REMOTE    ] SHO: Fetching primary data for 2025-01.
[2025-10-24T21:04:50.548316] [INFO ] [REMOTE    ] SGU: Fetching primary data for 2025-09.
[2025-10-24T21:04:50.551322] [INFO ] [REMOTE    ] SHO: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T21:04:51.302493] [INFO ] [REMOTE    ] SGU: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:04:51.347612] [INFO ] [REMOTE    ] SGU: Fetching primary data for 2025-10.
[2025-10-24T21:04:52.147697] [INFO ] [REMOTE    ] SHG: Fetching primary data for 2025-02.
[2025-10-24T21:04:52.174210] [INFO ] [REMOTE    ] SGU: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T21:04:52.175573] [INFO ] [REMOTE    ] SGU: Full fetch complete (8859 records).
[2025-10-24T21:04:52.175669] [DEBUG] [VALIDATOR ] SGU: Validating primary data.
[2025-10-24T21:04:52.176085] [FATAL] [VALIDATOR ] SGU: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:04:52.176170] [FATAL] [MAIN      ] SGU: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:04:52.176213] [WARN ] [MAIN      ] SGU: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:04:52.176279] [INFO ] [LOCAL     ] SGU: Starting deletion of primary data.
[2025-10-24T21:04:52.176341] [DEBUG] [LOCAL     ] SGU: No primary data file found to delete.
[2025-10-24T21:04:52.176377] [INFO ] [LOCAL     ] SGU: Starting deletion of derivative data.
[2025-10-24T21:04:52.176550] [DEBUG] [LOCAL     ] SGU: Deleted derivative data file.
[2025-10-24T21:04:52.176637] [INFO ] [MAIN      ] Update Progress: 1903/2366 symbols completed. SGU took 38.1s. Estimated remaining: 59m 34s. Rate: 7.8 symbols/min
[2025-10-24T21:04:52.358477] [INFO ] [MAIN      ] SHOC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:04:52.363156] [DEBUG] [LOCAL     ] SHOC: Loaded 3025 existing records from primary storage.
[2025-10-24T21:04:52.363309] [INFO ] [MAIN      ] SHOC: Loaded 3025 existing records.
[2025-10-24T21:04:52.564727] [WARN ] [MAIN      ] SHOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:04:52.564934] [INFO ] [MAIN      ] SHOC: Wiping existing primary data before full refresh.
[2025-10-24T21:04:52.564981] [INFO ] [LOCAL     ] SHOC: Starting deletion of primary data.
[2025-10-24T21:04:52.565321] [DEBUG] [LOCAL     ] SHOC: Deleted primary data file.
[2025-10-24T21:04:52.565377] [INFO ] [MAIN      ] SHOC: Starting full primary refresh.
[2025-10-24T21:04:52.930630] [INFO ] [REMOTE    ] SHOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:04:52.951033] [INFO ] [REMOTE    ] SHO: Fetching primary data for 2025-02.
[2025-10-24T21:04:52.954327] [INFO ] [REMOTE    ] SHG: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T21:04:53.698497] [INFO ] [REMOTE    ] SHO: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T21:04:53.747629] [INFO ] [REMOTE    ] SHO: Fetching primary data for 2025-03.
[2025-10-24T21:04:54.547737] [INFO ] [REMOTE    ] SHOC: Fetching primary data for 2025-01.
[2025-10-24T21:04:54.909004] [INFO ] [REMOTE    ] SHO: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T21:04:55.034557] [INFO ] [REMOTE    ] SHOC: Incremental fetch complete for 2025-01 (0.49 seconds).
[2025-10-24T21:04:55.347704] [INFO ] [REMOTE    ] SHO: Fetching primary data for 2025-04.
[2025-10-24T21:04:56.147711] [INFO ] [REMOTE    ] SHOC: Fetching primary data for 2025-02.
[2025-10-24T21:04:56.471272] [INFO ] [REMOTE    ] SHO: Incremental fetch complete for 2025-04 (1.12 seconds).
[2025-10-24T21:04:56.745528] [INFO ] [REMOTE    ] SHOC: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T21:04:56.947683] [INFO ] [REMOTE    ] SHOC: Fetching primary data for 2025-03.
[2025-10-24T21:04:57.432882] [INFO ] [REMOTE    ] SHOC: Incremental fetch complete for 2025-03 (0.49 seconds).
[2025-10-24T21:04:57.747672] [INFO ] [REMOTE    ] SHOC: Fetching primary data for 2025-04.
[2025-10-24T21:04:58.122226] [INFO ] [REMOTE    ] SHOC: Incremental fetch complete for 2025-04 (0.37 seconds).
[2025-10-24T21:04:58.547670] [INFO ] [REMOTE    ] SHO: Fetching primary data for 2025-05.
[2025-10-24T21:04:59.347622] [INFO ] [REMOTE    ] SHG: Fetching primary data for 2025-03.
[2025-10-24T21:04:59.538153] [INFO ] [REMOTE    ] SHO: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T21:05:00.044692] [INFO ] [REMOTE    ] SHG: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T21:05:00.147716] [INFO ] [REMOTE    ] SHG: Fetching primary data for 2025-04.
[2025-10-24T21:05:00.947692] [INFO ] [REMOTE    ] SHOC: Fetching primary data for 2025-05.
[2025-10-24T21:05:01.319991] [INFO ] [REMOTE    ] SHG: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T21:05:01.579851] [INFO ] [REMOTE    ] SHOC: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T21:05:01.747696] [INFO ] [REMOTE    ] SHO: Fetching primary data for 2025-06.
[2025-10-24T21:05:02.541762] [INFO ] [REMOTE    ] SHO: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T21:05:02.552204] [INFO ] [REMOTE    ] SHOC: Fetching primary data for 2025-06.
[2025-10-24T21:05:03.079597] [INFO ] [REMOTE    ] SHOC: Incremental fetch complete for 2025-06 (0.53 seconds).
[2025-10-24T21:05:03.347744] [INFO ] [REMOTE    ] SHEL: Fetching primary data for 2025-10.
[2025-10-24T21:05:04.131043] [INFO ] [REMOTE    ] SHEL: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T21:05:04.143682] [INFO ] [REMOTE    ] SHEL: Full fetch complete (77448 records).
[2025-10-24T21:05:04.143976] [DEBUG] [VALIDATOR ] SHEL: Validating primary data.
[2025-10-24T21:05:04.145540] [FATAL] [VALIDATOR ] SHEL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:05:04.145734] [FATAL] [MAIN      ] SHEL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:05:04.145809] [WARN ] [MAIN      ] SHEL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:05:04.145897] [INFO ] [LOCAL     ] SHEL: Starting deletion of primary data.
[2025-10-24T21:05:04.145981] [DEBUG] [LOCAL     ] SHEL: No primary data file found to delete.
[2025-10-24T21:05:04.146022] [INFO ] [LOCAL     ] SHEL: Starting deletion of derivative data.
[2025-10-24T21:05:04.146219] [DEBUG] [LOCAL     ] SHEL: Deleted derivative data file.
[2025-10-24T21:05:04.146993] [INFO ] [MAIN      ] Update Progress: 1904/2366 symbols completed. SHEL took 40.9s. Estimated remaining: 59m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:05:04.152773] [INFO ] [REMOTE    ] SHO: Fetching primary data for 2025-07.
[2025-10-24T21:05:04.348041] [INFO ] [MAIN      ] SHW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:05:04.400803] [DEBUG] [LOCAL     ] SHW: Loaded 50760 existing records from primary storage.
[2025-10-24T21:05:04.401129] [INFO ] [MAIN      ] SHW: Loaded 50760 existing records.
[2025-10-24T21:05:04.617665] [WARN ] [MAIN      ] SHW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:05:04.617883] [INFO ] [MAIN      ] SHW: Wiping existing primary data before full refresh.
[2025-10-24T21:05:04.617931] [INFO ] [LOCAL     ] SHW: Starting deletion of primary data.
[2025-10-24T21:05:04.618761] [DEBUG] [LOCAL     ] SHW: Deleted primary data file.
[2025-10-24T21:05:04.618821] [INFO ] [MAIN      ] SHW: Starting full primary refresh.
[2025-10-24T21:05:04.949403] [INFO ] [REMOTE    ] SHOC: Fetching primary data for 2025-07.
[2025-10-24T21:05:05.025994] [INFO ] [REMOTE    ] SHW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:05:05.057891] [INFO ] [REMOTE    ] SHO: Incremental fetch complete for 2025-07 (0.91 seconds).
[2025-10-24T21:05:05.668404] [INFO ] [REMOTE    ] SHOC: Incremental fetch complete for 2025-07 (0.72 seconds).
[2025-10-24T21:05:05.747701] [INFO ] [REMOTE    ] SHOC: Fetching primary data for 2025-08.
[2025-10-24T21:05:06.547689] [INFO ] [REMOTE    ] SHG: Fetching primary data for 2025-05.
[2025-10-24T21:05:06.910603] [INFO ] [REMOTE    ] SHOC: Incremental fetch complete for 2025-08 (1.16 seconds).
[2025-10-24T21:05:07.347675] [INFO ] [REMOTE    ] SHO: Fetching primary data for 2025-08.
[2025-10-24T21:05:07.456770] [DEBUG] [REMOTE    ] SHO: Error fetching primary data for 2025-08: 'API call returned an empty response.'
[2025-10-24T21:05:07.457082] [WARN ] [REMOTE    ] SHO: No data returned for month 2025-08
[2025-10-24T21:05:07.457185] [FATAL] [REMOTE    ] SHO: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:05:07.457284] [FATAL] [MAIN      ] SHO: Failed to fetch primary data.
[2025-10-24T21:05:07.457352] [WARN ] [MAIN      ] SHO: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:05:07.457456] [INFO ] [LOCAL     ] SHO: Starting deletion of primary data.
[2025-10-24T21:05:07.457522] [DEBUG] [LOCAL     ] SHO: No primary data file found to delete.
[2025-10-24T21:05:07.457559] [INFO ] [LOCAL     ] SHO: Starting deletion of derivative data.
[2025-10-24T21:05:07.457789] [DEBUG] [LOCAL     ] SHO: Deleted derivative data file.
[2025-10-24T21:05:07.458373] [INFO ] [MAIN      ] Update Progress: 1905/2366 symbols completed. SHO took 19.7s. Estimated remaining: 59m 18s. Rate: 7.8 symbols/min
[2025-10-24T21:05:07.630278] [INFO ] [MAIN      ] SI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:05:07.630637] [DEBUG] [LOCAL     ] SI: No existing data file found in primary storage.
[2025-10-24T21:05:07.630773] [WARN ] [MAIN      ] SI: No existing data found, performing full refresh instead.
[2025-10-24T21:05:07.637612] [INFO ] [MAIN      ] SI: Wiping existing primary data before full refresh.
[2025-10-24T21:05:07.648022] [INFO ] [LOCAL     ] SI: Starting deletion of primary data.
[2025-10-24T21:05:07.648773] [DEBUG] [LOCAL     ] SI: No primary data file found to delete.
[2025-10-24T21:05:07.650584] [INFO ] [MAIN      ] SI: Starting full primary refresh.
[2025-10-24T21:05:07.650505] [INFO ] [REMOTE    ] SHG: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T21:05:08.002150] [INFO ] [REMOTE    ] SI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:05:08.147668] [INFO ] [REMOTE    ] SI: Fetching primary data for 2025-01.
[2025-10-24T21:05:08.289974] [DEBUG] [REMOTE    ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:05:08.290344] [WARN ] [REMOTE    ] SI: No data returned for month 2025-01
[2025-10-24T21:05:08.290460] [FATAL] [REMOTE    ] SI: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:05:08.290541] [FATAL] [MAIN      ] SI: Failed to fetch primary data.
[2025-10-24T21:05:08.290626] [WARN ] [MAIN      ] SI: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:05:08.290728] [INFO ] [LOCAL     ] SI: Starting deletion of primary data.
[2025-10-24T21:05:08.290802] [DEBUG] [LOCAL     ] SI: No primary data file found to delete.
[2025-10-24T21:05:08.290841] [INFO ] [LOCAL     ] SI: Starting deletion of derivative data.
[2025-10-24T21:05:08.290882] [DEBUG] [LOCAL     ] SI: No derivative data file found to delete.
[2025-10-24T21:05:08.290929] [INFO ] [MAIN      ] Update Progress: 1906/2366 symbols completed. SI took 0.8s. Estimated remaining: 59m 9s. Rate: 7.8 symbols/min
[2025-10-24T21:05:08.484254] [INFO ] [MAIN      ] SID: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:05:08.528988] [DEBUG] [LOCAL     ] SID: Loaded 43285 existing records from primary storage.
[2025-10-24T21:05:08.529311] [INFO ] [MAIN      ] SID: Loaded 43285 existing records.
[2025-10-24T21:05:08.700817] [WARN ] [MAIN      ] SID: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:05:08.701018] [INFO ] [MAIN      ] SID: Wiping existing primary data before full refresh.
[2025-10-24T21:05:08.701083] [INFO ] [LOCAL     ] SID: Starting deletion of primary data.
[2025-10-24T21:05:08.701339] [DEBUG] [LOCAL     ] SID: Deleted primary data file.
[2025-10-24T21:05:08.701393] [INFO ] [MAIN      ] SID: Starting full primary refresh.
[2025-10-24T21:05:08.952765] [INFO ] [REMOTE    ] SHW: Fetching primary data for 2025-01.
[2025-10-24T21:05:09.046861] [INFO ] [REMOTE    ] SID: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:05:09.747749] [INFO ] [REMOTE    ] SHOC: Fetching primary data for 2025-09.
[2025-10-24T21:05:09.795224] [INFO ] [REMOTE    ] SHW: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T21:05:10.522587] [INFO ] [REMOTE    ] SHOC: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T21:05:10.547606] [INFO ] [REMOTE    ] SHOC: Fetching primary data for 2025-10.
[2025-10-24T21:05:10.853795] [INFO ] [REMOTE    ] SHOC: Incremental fetch complete for 2025-10 (0.31 seconds).
[2025-10-24T21:05:10.854944] [INFO ] [REMOTE    ] SHOC: Full fetch complete (6683 records).
[2025-10-24T21:05:10.855011] [DEBUG] [VALIDATOR ] SHOC: Validating primary data.
[2025-10-24T21:05:10.855359] [FATAL] [VALIDATOR ] SHOC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:05:10.855437] [FATAL] [MAIN      ] SHOC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:05:10.855479] [WARN ] [MAIN      ] SHOC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:05:10.855541] [INFO ] [LOCAL     ] SHOC: Starting deletion of primary data.
[2025-10-24T21:05:10.855604] [DEBUG] [LOCAL     ] SHOC: No primary data file found to delete.
[2025-10-24T21:05:10.855638] [INFO ] [LOCAL     ] SHOC: Starting deletion of derivative data.
[2025-10-24T21:05:10.855870] [DEBUG] [LOCAL     ] SHOC: Deleted derivative data file.
[2025-10-24T21:05:10.855960] [INFO ] [MAIN      ] Update Progress: 1907/2366 symbols completed. SHOC took 18.7s. Estimated remaining: 59m 0s. Rate: 7.8 symbols/min
[2025-10-24T21:05:11.020464] [INFO ] [MAIN      ] SIG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:05:11.059338] [DEBUG] [LOCAL     ] SIG: Loaded 45589 existing records from primary storage.
[2025-10-24T21:05:11.059609] [INFO ] [MAIN      ] SIG: Loaded 45589 existing records.
[2025-10-24T21:05:11.231536] [WARN ] [MAIN      ] SIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:05:11.231755] [INFO ] [MAIN      ] SIG: Wiping existing primary data before full refresh.
[2025-10-24T21:05:11.231804] [INFO ] [LOCAL     ] SIG: Starting deletion of primary data.
[2025-10-24T21:05:11.232204] [DEBUG] [LOCAL     ] SIG: Deleted primary data file.
[2025-10-24T21:05:11.232242] [INFO ] [MAIN      ] SIG: Starting full primary refresh.
[2025-10-24T21:05:11.352820] [INFO ] [REMOTE    ] SID: Fetching primary data for 2025-01.
[2025-10-24T21:05:11.584303] [INFO ] [REMOTE    ] SIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:05:12.153258] [INFO ] [REMOTE    ] SHG: Fetching primary data for 2025-06.
[2025-10-24T21:05:12.158027] [INFO ] [REMOTE    ] SID: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T21:05:12.773710] [INFO ] [REMOTE    ] SHG: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T21:05:12.947625] [INFO ] [REMOTE    ] SIG: Fetching primary data for 2025-01.
[2025-10-24T21:05:13.695374] [INFO ] [REMOTE    ] SIG: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T21:05:13.747601] [INFO ] [REMOTE    ] SIG: Fetching primary data for 2025-02.
[2025-10-24T21:05:14.490460] [INFO ] [REMOTE    ] SIG: Incremental fetch complete for 2025-02 (0.74 seconds).
[2025-10-24T21:05:14.547606] [INFO ] [REMOTE    ] SID: Fetching primary data for 2025-02.
[2025-10-24T21:05:15.356541] [INFO ] [REMOTE    ] SHG: Fetching primary data for 2025-07.
[2025-10-24T21:05:15.360961] [INFO ] [REMOTE    ] SID: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T21:05:16.059910] [INFO ] [REMOTE    ] SHG: Incremental fetch complete for 2025-07 (0.70 seconds).
[2025-10-24T21:05:16.147603] [INFO ] [REMOTE    ] SHG: Fetching primary data for 2025-08.
[2025-10-24T21:05:16.947689] [INFO ] [REMOTE    ] SID: Fetching primary data for 2025-03.
[2025-10-24T21:05:16.983129] [INFO ] [REMOTE    ] SHG: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T21:05:17.747751] [INFO ] [REMOTE    ] SHW: Fetching primary data for 2025-02.
[2025-10-24T21:05:18.004763] [INFO ] [REMOTE    ] SID: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T21:05:18.502436] [INFO ] [REMOTE    ] SHW: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T21:05:18.547686] [INFO ] [REMOTE    ] SID: Fetching primary data for 2025-04.
[2025-10-24T21:05:19.250057] [INFO ] [REMOTE    ] SID: Incremental fetch complete for 2025-04 (0.70 seconds).
[2025-10-24T21:05:19.347672] [INFO ] [REMOTE    ] SIG: Fetching primary data for 2025-03.
[2025-10-24T21:05:20.147678] [INFO ] [REMOTE    ] SHW: Fetching primary data for 2025-03.
[2025-10-24T21:05:20.497089] [INFO ] [REMOTE    ] SIG: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T21:05:20.712433] [INFO ] [REMOTE    ] SHW: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T21:05:20.947715] [INFO ] [REMOTE    ] SHG: Fetching primary data for 2025-09.
[2025-10-24T21:05:21.569401] [INFO ] [REMOTE    ] SHG: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T21:05:21.747686] [INFO ] [REMOTE    ] SIG: Fetching primary data for 2025-04.
[2025-10-24T21:05:22.547636] [INFO ] [REMOTE    ] SHG: Fetching primary data for 2025-10.
[2025-10-24T21:05:22.605420] [INFO ] [REMOTE    ] SIG: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T21:05:23.264348] [INFO ] [REMOTE    ] SHG: Incremental fetch complete for 2025-10 (0.72 seconds).
[2025-10-24T21:05:23.270071] [INFO ] [REMOTE    ] SHG: Full fetch complete (41159 records).
[2025-10-24T21:05:23.270171] [DEBUG] [VALIDATOR ] SHG: Validating primary data.
[2025-10-24T21:05:23.270754] [FATAL] [VALIDATOR ] SHG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:05:23.270856] [FATAL] [MAIN      ] SHG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:05:23.270931] [WARN ] [MAIN      ] SHG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:05:23.271024] [INFO ] [LOCAL     ] SHG: Starting deletion of primary data.
[2025-10-24T21:05:23.271104] [DEBUG] [LOCAL     ] SHG: No primary data file found to delete.
[2025-10-24T21:05:23.271142] [INFO ] [LOCAL     ] SHG: Starting deletion of derivative data.
[2025-10-24T21:05:23.271285] [DEBUG] [LOCAL     ] SHG: Deleted derivative data file.
[2025-10-24T21:05:23.271358] [INFO ] [MAIN      ] Update Progress: 1908/2366 symbols completed. SHG took 42.3s. Estimated remaining: 58m 54s. Rate: 7.8 symbols/min
[2025-10-24T21:05:23.352763] [INFO ] [REMOTE    ] SID: Fetching primary data for 2025-05.
[2025-10-24T21:05:23.459456] [INFO ] [MAIN      ] SII: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:05:23.482368] [DEBUG] [LOCAL     ] SII: Loaded 24307 existing records from primary storage.
[2025-10-24T21:05:23.482625] [INFO ] [MAIN      ] SII: Loaded 24307 existing records.
[2025-10-24T21:05:23.668964] [WARN ] [MAIN      ] SII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:05:23.669182] [INFO ] [MAIN      ] SII: Wiping existing primary data before full refresh.
[2025-10-24T21:05:23.669237] [INFO ] [LOCAL     ] SII: Starting deletion of primary data.
[2025-10-24T21:05:23.669457] [DEBUG] [LOCAL     ] SII: Deleted primary data file.
[2025-10-24T21:05:23.669527] [INFO ] [MAIN      ] SII: Starting full primary refresh.
[2025-10-24T21:05:24.061941] [INFO ] [REMOTE    ] SII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:05:24.147627] [INFO ] [REMOTE    ] SII: Fetching primary data for 2025-01.
[2025-10-24T21:05:24.214765] [INFO ] [REMOTE    ] SID: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T21:05:24.954611] [INFO ] [REMOTE    ] SHW: Fetching primary data for 2025-04.
[2025-10-24T21:05:24.959925] [INFO ] [REMOTE    ] SII: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T21:05:25.747634] [INFO ] [REMOTE    ] SII: Fetching primary data for 2025-02.
[2025-10-24T21:05:26.305470] [INFO ] [REMOTE    ] SHW: Incremental fetch complete for 2025-04 (1.35 seconds).
[2025-10-24T21:05:26.340018] [INFO ] [REMOTE    ] SII: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T21:05:26.547629] [INFO ] [REMOTE    ] SID: Fetching primary data for 2025-06.
[2025-10-24T21:05:27.072294] [INFO ] [REMOTE    ] SID: Incremental fetch complete for 2025-06 (0.52 seconds).
[2025-10-24T21:05:27.347629] [INFO ] [REMOTE    ] SII: Fetching primary data for 2025-03.
[2025-10-24T21:05:28.138569] [INFO ] [REMOTE    ] SII: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T21:05:28.147602] [INFO ] [REMOTE    ] SII: Fetching primary data for 2025-04.
[2025-10-24T21:05:28.820840] [INFO ] [REMOTE    ] SII: Incremental fetch complete for 2025-04 (0.67 seconds).
[2025-10-24T21:05:28.947732] [INFO ] [REMOTE    ] SHW: Fetching primary data for 2025-05.
[2025-10-24T21:05:29.708446] [INFO ] [REMOTE    ] SHW: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T21:05:29.747700] [INFO ] [REMOTE    ] SHW: Fetching primary data for 2025-06.
[2025-10-24T21:05:30.533272] [INFO ] [REMOTE    ] SHW: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T21:05:30.547613] [INFO ] [REMOTE    ] SHW: Fetching primary data for 2025-07.
[2025-10-24T21:05:31.347706] [INFO ] [REMOTE    ] SID: Fetching primary data for 2025-07.
[2025-10-24T21:05:31.839335] [INFO ] [REMOTE    ] SHW: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T21:05:32.107112] [INFO ] [REMOTE    ] SID: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T21:05:32.147612] [INFO ] [REMOTE    ] SID: Fetching primary data for 2025-08.
[2025-10-24T21:05:32.887967] [INFO ] [REMOTE    ] SID: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T21:05:32.947607] [INFO ] [REMOTE    ] SID: Fetching primary data for 2025-09.
[2025-10-24T21:05:33.682554] [INFO ] [REMOTE    ] SID: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T21:05:33.747632] [INFO ] [REMOTE    ] SID: Fetching primary data for 2025-10.
[2025-10-24T21:05:34.480066] [INFO ] [REMOTE    ] SID: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:05:34.489019] [INFO ] [REMOTE    ] SID: Full fetch complete (60922 records).
[2025-10-24T21:05:34.489142] [DEBUG] [VALIDATOR ] SID: Validating primary data.
[2025-10-24T21:05:34.489868] [FATAL] [VALIDATOR ] SID: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:05:34.489955] [FATAL] [MAIN      ] SID: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:05:34.489999] [WARN ] [MAIN      ] SID: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:05:34.490039] [INFO ] [LOCAL     ] SID: Starting deletion of primary data.
[2025-10-24T21:05:34.490096] [DEBUG] [LOCAL     ] SID: No primary data file found to delete.
[2025-10-24T21:05:34.490173] [INFO ] [LOCAL     ] SID: Starting deletion of derivative data.
[2025-10-24T21:05:34.490333] [DEBUG] [LOCAL     ] SID: Deleted derivative data file.
[2025-10-24T21:05:34.490716] [INFO ] [MAIN      ] Update Progress: 1909/2366 symbols completed. SID took 26.2s. Estimated remaining: 58m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:05:34.553033] [INFO ] [REMOTE    ] SHW: Fetching primary data for 2025-08.
[2025-10-24T21:05:34.669591] [INFO ] [MAIN      ] SILA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:05:34.701045] [DEBUG] [LOCAL     ] SILA: Loaded 30079 existing records from primary storage.
[2025-10-24T21:05:34.701312] [INFO ] [MAIN      ] SILA: Loaded 30079 existing records.
[2025-10-24T21:05:34.881462] [WARN ] [MAIN      ] SILA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:05:34.881701] [INFO ] [MAIN      ] SILA: Wiping existing primary data before full refresh.
[2025-10-24T21:05:34.881757] [INFO ] [LOCAL     ] SILA: Starting deletion of primary data.
[2025-10-24T21:05:34.882119] [DEBUG] [LOCAL     ] SILA: Deleted primary data file.
[2025-10-24T21:05:34.882173] [INFO ] [MAIN      ] SILA: Starting full primary refresh.
[2025-10-24T21:05:35.236727] [INFO ] [REMOTE    ] SILA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:05:35.347677] [INFO ] [REMOTE    ] SIG: Fetching primary data for 2025-05.
[2025-10-24T21:05:35.483193] [INFO ] [REMOTE    ] SHW: Incremental fetch complete for 2025-08 (0.93 seconds).
[2025-10-24T21:05:36.147719] [INFO ] [REMOTE    ] SHW: Fetching primary data for 2025-09.
[2025-10-24T21:05:36.427429] [INFO ] [REMOTE    ] SIG: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T21:05:36.935483] [INFO ] [REMOTE    ] SHW: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T21:05:36.947606] [INFO ] [REMOTE    ] SHW: Fetching primary data for 2025-10.
[2025-10-24T21:05:37.747615] [INFO ] [REMOTE    ] SILA: Fetching primary data for 2025-01.
[2025-10-24T21:05:38.080578] [INFO ] [REMOTE    ] SHW: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T21:05:38.089524] [INFO ] [REMOTE    ] SHW: Full fetch complete (72990 records).
[2025-10-24T21:05:38.089682] [DEBUG] [VALIDATOR ] SHW: Validating primary data.
[2025-10-24T21:05:38.090394] [FATAL] [VALIDATOR ] SHW: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:05:38.090478] [FATAL] [MAIN      ] SHW: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:05:38.090523] [WARN ] [MAIN      ] SHW: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:05:38.090607] [INFO ] [LOCAL     ] SHW: Starting deletion of primary data.
[2025-10-24T21:05:38.090719] [DEBUG] [LOCAL     ] SHW: No primary data file found to delete.
[2025-10-24T21:05:38.090778] [INFO ] [LOCAL     ] SHW: Starting deletion of derivative data.
[2025-10-24T21:05:38.090988] [DEBUG] [LOCAL     ] SHW: Deleted derivative data file.
[2025-10-24T21:05:38.091295] [INFO ] [MAIN      ] Update Progress: 1910/2366 symbols completed. SHW took 33.9s. Estimated remaining: 58m 38s. Rate: 7.8 symbols/min
[2025-10-24T21:05:38.273565] [INFO ] [MAIN      ] SITC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:05:38.311887] [DEBUG] [LOCAL     ] SITC: Loaded 42011 existing records from primary storage.
[2025-10-24T21:05:38.312165] [INFO ] [MAIN      ] SITC: Loaded 42011 existing records.
[2025-10-24T21:05:38.501154] [WARN ] [MAIN      ] SITC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:05:38.501366] [INFO ] [MAIN      ] SITC: Wiping existing primary data before full refresh.
[2025-10-24T21:05:38.501436] [INFO ] [LOCAL     ] SITC: Starting deletion of primary data.
[2025-10-24T21:05:38.502286] [DEBUG] [LOCAL     ] SITC: Deleted primary data file.
[2025-10-24T21:05:38.502344] [INFO ] [MAIN      ] SITC: Starting full primary refresh.
[2025-10-24T21:05:38.552826] [INFO ] [REMOTE    ] SIG: Fetching primary data for 2025-06.
[2025-10-24T21:05:38.909529] [INFO ] [REMOTE    ] SITC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:05:38.925556] [INFO ] [REMOTE    ] SILA: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T21:05:39.352727] [INFO ] [REMOTE    ] SILA: Fetching primary data for 2025-02.
[2025-10-24T21:05:39.368399] [INFO ] [REMOTE    ] SIG: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T21:05:40.098062] [INFO ] [REMOTE    ] SILA: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T21:05:40.147620] [INFO ] [REMOTE    ] SILA: Fetching primary data for 2025-03.
[2025-10-24T21:05:40.899502] [INFO ] [REMOTE    ] SILA: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T21:05:40.947623] [INFO ] [REMOTE    ] SILA: Fetching primary data for 2025-04.
[2025-10-24T21:05:41.747737] [INFO ] [REMOTE    ] SITC: Fetching primary data for 2025-01.
[2025-10-24T21:05:41.918940] [INFO ] [REMOTE    ] SILA: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T21:05:42.547702] [INFO ] [REMOTE    ] SILA: Fetching primary data for 2025-05.
[2025-10-24T21:05:42.791729] [INFO ] [REMOTE    ] SITC: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T21:05:42.867262] [INFO ] [REMOTE    ] SILA: Incremental fetch complete for 2025-05 (0.32 seconds).
[2025-10-24T21:05:43.347665] [INFO ] [REMOTE    ] SILA: Fetching primary data for 2025-06.
[2025-10-24T21:05:44.147681] [INFO ] [REMOTE    ] SII: Fetching primary data for 2025-05.
[2025-10-24T21:05:44.423345] [INFO ] [REMOTE    ] SILA: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T21:05:44.752195] [INFO ] [REMOTE    ] SII: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T21:05:44.947688] [INFO ] [REMOTE    ] SITC: Fetching primary data for 2025-02.
[2025-10-24T21:05:45.747626] [INFO ] [REMOTE    ] SILA: Fetching primary data for 2025-07.
[2025-10-24T21:05:45.988508] [INFO ] [REMOTE    ] SITC: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T21:05:46.473012] [INFO ] [REMOTE    ] SILA: Incremental fetch complete for 2025-07 (0.73 seconds).
[2025-10-24T21:05:46.547663] [INFO ] [REMOTE    ] SIG: Fetching primary data for 2025-07.
[2025-10-24T21:05:47.347700] [INFO ] [REMOTE    ] SILA: Fetching primary data for 2025-08.
[2025-10-24T21:05:47.791173] [INFO ] [REMOTE    ] SIG: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T21:05:48.147605] [INFO ] [REMOTE    ] SII: Fetching primary data for 2025-06.
[2025-10-24T21:05:48.286958] [INFO ] [REMOTE    ] SILA: Incremental fetch complete for 2025-08 (0.94 seconds).
[2025-10-24T21:05:48.879045] [INFO ] [REMOTE    ] SII: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T21:05:48.947708] [INFO ] [REMOTE    ] SII: Fetching primary data for 2025-07.
[2025-10-24T21:05:49.747696] [INFO ] [REMOTE    ] SILA: Fetching primary data for 2025-09.
[2025-10-24T21:05:49.822068] [INFO ] [REMOTE    ] SII: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T21:05:50.547701] [INFO ] [REMOTE    ] SII: Fetching primary data for 2025-08.
[2025-10-24T21:05:50.705325] [INFO ] [REMOTE    ] SILA: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T21:05:51.347727] [INFO ] [REMOTE    ] SILA: Fetching primary data for 2025-10.
[2025-10-24T21:05:51.407310] [INFO ] [REMOTE    ] SII: Incremental fetch complete for 2025-08 (0.86 seconds).
[2025-10-24T21:05:51.927553] [INFO ] [REMOTE    ] SILA: Incremental fetch complete for 2025-10 (0.58 seconds).
[2025-10-24T21:05:51.932256] [INFO ] [REMOTE    ] SILA: Full fetch complete (44096 records).
[2025-10-24T21:05:51.932372] [DEBUG] [VALIDATOR ] SILA: Validating primary data.
[2025-10-24T21:05:51.933009] [FATAL] [VALIDATOR ] SILA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:05:51.933094] [FATAL] [MAIN      ] SILA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:05:51.933138] [WARN ] [MAIN      ] SILA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:05:51.933221] [INFO ] [LOCAL     ] SILA: Starting deletion of primary data.
[2025-10-24T21:05:51.933286] [DEBUG] [LOCAL     ] SILA: No primary data file found to delete.
[2025-10-24T21:05:51.933360] [INFO ] [LOCAL     ] SILA: Starting deletion of derivative data.
[2025-10-24T21:05:51.933509] [DEBUG] [LOCAL     ] SILA: Deleted derivative data file.
[2025-10-24T21:05:51.933579] [INFO ] [MAIN      ] Update Progress: 1911/2366 symbols completed. SILA took 17.4s. Estimated remaining: 58m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:05:52.106815] [INFO ] [MAIN      ] SITE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:05:52.141169] [DEBUG] [LOCAL     ] SITE: Loaded 35740 existing records from primary storage.
[2025-10-24T21:05:52.141438] [INFO ] [MAIN      ] SITE: Loaded 35740 existing records.
[2025-10-24T21:05:52.152840] [INFO ] [REMOTE    ] SIG: Fetching primary data for 2025-08.
[2025-10-24T21:05:52.316492] [WARN ] [MAIN      ] SITE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:05:52.316738] [INFO ] [MAIN      ] SITE: Wiping existing primary data before full refresh.
[2025-10-24T21:05:52.316791] [INFO ] [LOCAL     ] SITE: Starting deletion of primary data.
[2025-10-24T21:05:52.317349] [DEBUG] [LOCAL     ] SITE: Deleted primary data file.
[2025-10-24T21:05:52.317430] [INFO ] [MAIN      ] SITE: Starting full primary refresh.
[2025-10-24T21:05:52.656319] [INFO ] [REMOTE    ] SITE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:05:52.947622] [INFO ] [REMOTE    ] SII: Fetching primary data for 2025-09.
[2025-10-24T21:05:53.416690] [INFO ] [REMOTE    ] SIG: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T21:05:53.747668] [INFO ] [REMOTE    ] SITC: Fetching primary data for 2025-03.
[2025-10-24T21:05:53.771956] [INFO ] [REMOTE    ] SII: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T21:05:54.547625] [INFO ] [REMOTE    ] SII: Fetching primary data for 2025-10.
[2025-10-24T21:05:54.779173] [INFO ] [REMOTE    ] SITC: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T21:05:55.151763] [INFO ] [REMOTE    ] SII: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T21:05:55.156410] [INFO ] [REMOTE    ] SII: Full fetch complete (31502 records).
[2025-10-24T21:05:55.156491] [DEBUG] [VALIDATOR ] SII: Validating primary data.
[2025-10-24T21:05:55.157027] [FATAL] [VALIDATOR ] SII: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:05:55.157108] [FATAL] [MAIN      ] SII: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:05:55.157166] [WARN ] [MAIN      ] SII: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:05:55.157250] [INFO ] [LOCAL     ] SII: Starting deletion of primary data.
[2025-10-24T21:05:55.157327] [DEBUG] [LOCAL     ] SII: No primary data file found to delete.
[2025-10-24T21:05:55.157400] [INFO ] [LOCAL     ] SII: Starting deletion of derivative data.
[2025-10-24T21:05:55.157692] [DEBUG] [LOCAL     ] SII: Deleted derivative data file.
[2025-10-24T21:05:55.157803] [INFO ] [MAIN      ] Update Progress: 1912/2366 symbols completed. SII took 31.9s. Estimated remaining: 58m 23s. Rate: 7.8 symbols/min
[2025-10-24T21:05:55.327861] [INFO ] [MAIN      ] SJM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:05:55.352401] [INFO ] [REMOTE    ] SIG: Fetching primary data for 2025-09.
[2025-10-24T21:05:55.374903] [DEBUG] [LOCAL     ] SJM: Loaded 50444 existing records from primary storage.
[2025-10-24T21:05:55.375187] [INFO ] [MAIN      ] SJM: Loaded 50444 existing records.
[2025-10-24T21:05:55.551218] [WARN ] [MAIN      ] SJM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:05:55.551504] [INFO ] [MAIN      ] SJM: Wiping existing primary data before full refresh.
[2025-10-24T21:05:55.551566] [INFO ] [LOCAL     ] SJM: Starting deletion of primary data.
[2025-10-24T21:05:55.552567] [DEBUG] [LOCAL     ] SJM: Deleted primary data file.
[2025-10-24T21:05:55.552625] [INFO ] [MAIN      ] SJM: Starting full primary refresh.
[2025-10-24T21:05:55.909435] [INFO ] [REMOTE    ] SJM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:05:56.113130] [INFO ] [REMOTE    ] SIG: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T21:05:56.147609] [INFO ] [REMOTE    ] SIG: Fetching primary data for 2025-10.
[2025-10-24T21:05:56.879856] [INFO ] [REMOTE    ] SIG: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:05:56.887722] [INFO ] [REMOTE    ] SIG: Full fetch complete (67241 records).
[2025-10-24T21:05:56.887895] [DEBUG] [VALIDATOR ] SIG: Validating primary data.
[2025-10-24T21:05:56.888588] [FATAL] [VALIDATOR ] SIG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:05:56.888732] [FATAL] [MAIN      ] SIG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:05:56.888828] [WARN ] [MAIN      ] SIG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:05:56.888923] [INFO ] [LOCAL     ] SIG: Starting deletion of primary data.
[2025-10-24T21:05:56.889003] [DEBUG] [LOCAL     ] SIG: No primary data file found to delete.
[2025-10-24T21:05:56.889041] [INFO ] [LOCAL     ] SIG: Starting deletion of derivative data.
[2025-10-24T21:05:56.889229] [DEBUG] [LOCAL     ] SIG: Deleted derivative data file.
[2025-10-24T21:05:56.889324] [INFO ] [MAIN      ] Update Progress: 1913/2366 symbols completed. SIG took 46.0s. Estimated remaining: 58m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:05:56.953791] [INFO ] [REMOTE    ] SITC: Fetching primary data for 2025-04.
[2025-10-24T21:05:57.067207] [INFO ] [MAIN      ] SJT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:05:57.088923] [DEBUG] [LOCAL     ] SJT: Loaded 22795 existing records from primary storage.
[2025-10-24T21:05:57.089177] [INFO ] [MAIN      ] SJT: Loaded 22795 existing records.
[2025-10-24T21:05:57.266049] [WARN ] [MAIN      ] SJT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:05:57.266343] [INFO ] [MAIN      ] SJT: Wiping existing primary data before full refresh.
[2025-10-24T21:05:57.266392] [INFO ] [LOCAL     ] SJT: Starting deletion of primary data.
[2025-10-24T21:05:57.266688] [DEBUG] [LOCAL     ] SJT: Deleted primary data file.
[2025-10-24T21:05:57.266746] [INFO ] [MAIN      ] SJT: Starting full primary refresh.
[2025-10-24T21:05:57.665036] [INFO ] [REMOTE    ] SJT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:05:57.752842] [INFO ] [REMOTE    ] SITE: Fetching primary data for 2025-01.
[2025-10-24T21:05:57.770578] [INFO ] [REMOTE    ] SITC: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T21:05:58.547727] [INFO ] [REMOTE    ] SITC: Fetching primary data for 2025-05.
[2025-10-24T21:05:58.673918] [INFO ] [REMOTE    ] SITE: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T21:05:59.347629] [INFO ] [REMOTE    ] SITE: Fetching primary data for 2025-02.
[2025-10-24T21:05:59.443333] [INFO ] [REMOTE    ] SITC: Incremental fetch complete for 2025-05 (0.90 seconds).
[2025-10-24T21:06:00.155000] [INFO ] [REMOTE    ] SITC: Fetching primary data for 2025-06.
[2025-10-24T21:06:00.171310] [INFO ] [REMOTE    ] SITE: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T21:06:00.952804] [INFO ] [REMOTE    ] SJT: Fetching primary data for 2025-01.
[2025-10-24T21:06:00.973401] [INFO ] [REMOTE    ] SITC: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T21:06:01.747624] [INFO ] [REMOTE    ] SITE: Fetching primary data for 2025-03.
[2025-10-24T21:06:02.047615] [INFO ] [REMOTE    ] SJT: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T21:06:02.547693] [INFO ] [REMOTE    ] SJT: Fetching primary data for 2025-02.
[2025-10-24T21:06:02.759351] [INFO ] [REMOTE    ] SITE: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T21:06:03.347620] [INFO ] [REMOTE    ] SJM: Fetching primary data for 2025-01.
[2025-10-24T21:06:03.490052] [INFO ] [REMOTE    ] SJT: Incremental fetch complete for 2025-02 (0.94 seconds).
[2025-10-24T21:06:04.147636] [INFO ] [REMOTE    ] SITE: Fetching primary data for 2025-04.
[2025-10-24T21:06:04.653843] [INFO ] [REMOTE    ] SJM: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T21:06:04.947622] [INFO ] [REMOTE    ] SITC: Fetching primary data for 2025-07.
[2025-10-24T21:06:05.133395] [INFO ] [REMOTE    ] SITE: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T21:06:05.691169] [INFO ] [REMOTE    ] SITC: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T21:06:05.747623] [INFO ] [REMOTE    ] SITC: Fetching primary data for 2025-08.
[2025-10-24T21:06:06.516754] [INFO ] [REMOTE    ] SITC: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T21:06:06.547605] [INFO ] [REMOTE    ] SITC: Fetching primary data for 2025-09.
[2025-10-24T21:06:07.347722] [INFO ] [REMOTE    ] SJT: Fetching primary data for 2025-03.
[2025-10-24T21:06:07.425145] [INFO ] [REMOTE    ] SITC: Incremental fetch complete for 2025-09 (0.88 seconds).
[2025-10-24T21:06:07.950503] [INFO ] [REMOTE    ] SJT: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T21:06:08.147688] [INFO ] [REMOTE    ] SJT: Fetching primary data for 2025-04.
[2025-10-24T21:06:08.947692] [INFO ] [REMOTE    ] SITC: Fetching primary data for 2025-10.
[2025-10-24T21:06:09.079155] [INFO ] [REMOTE    ] SJT: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T21:06:09.704319] [INFO ] [REMOTE    ] SITC: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T21:06:09.711723] [INFO ] [REMOTE    ] SITC: Full fetch complete (60346 records).
[2025-10-24T21:06:09.711824] [DEBUG] [VALIDATOR ] SITC: Validating primary data.
[2025-10-24T21:06:09.712463] [FATAL] [VALIDATOR ] SITC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:06:09.712548] [FATAL] [MAIN      ] SITC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:06:09.712591] [WARN ] [MAIN      ] SITC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:06:09.712630] [INFO ] [LOCAL     ] SITC: Starting deletion of primary data.
[2025-10-24T21:06:09.712727] [DEBUG] [LOCAL     ] SITC: No primary data file found to delete.
[2025-10-24T21:06:09.712771] [INFO ] [LOCAL     ] SITC: Starting deletion of derivative data.
[2025-10-24T21:06:09.712921] [DEBUG] [LOCAL     ] SITC: Deleted derivative data file.
[2025-10-24T21:06:09.713272] [INFO ] [MAIN      ] Update Progress: 1914/2366 symbols completed. SITC took 31.6s. Estimated remaining: 58m 7s. Rate: 7.8 symbols/min
[2025-10-24T21:06:09.747742] [INFO ] [REMOTE    ] SITE: Fetching primary data for 2025-05.
[2025-10-24T21:06:09.887871] [INFO ] [MAIN      ] SKE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:06:09.924966] [DEBUG] [LOCAL     ] SKE: Loaded 37582 existing records from primary storage.
[2025-10-24T21:06:09.925242] [INFO ] [MAIN      ] SKE: Loaded 37582 existing records.
[2025-10-24T21:06:10.099584] [WARN ] [MAIN      ] SKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:06:10.099833] [INFO ] [MAIN      ] SKE: Wiping existing primary data before full refresh.
[2025-10-24T21:06:10.099880] [INFO ] [LOCAL     ] SKE: Starting deletion of primary data.
[2025-10-24T21:06:10.100293] [DEBUG] [LOCAL     ] SKE: Deleted primary data file.
[2025-10-24T21:06:10.100352] [INFO ] [MAIN      ] SKE: Starting full primary refresh.
[2025-10-24T21:06:10.462859] [INFO ] [REMOTE    ] SKE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:06:10.547622] [INFO ] [REMOTE    ] SJM: Fetching primary data for 2025-02.
[2025-10-24T21:06:10.736456] [INFO ] [REMOTE    ] SITE: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T21:06:11.339242] [INFO ] [REMOTE    ] SJM: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T21:06:11.348607] [INFO ] [REMOTE    ] SKE: Fetching primary data for 2025-01.
[2025-10-24T21:06:12.147616] [INFO ] [REMOTE    ] SJM: Fetching primary data for 2025-03.
[2025-10-24T21:06:12.396044] [INFO ] [REMOTE    ] SKE: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T21:06:12.925261] [INFO ] [REMOTE    ] SJM: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T21:06:12.947665] [INFO ] [REMOTE    ] SJT: Fetching primary data for 2025-05.
[2025-10-24T21:06:13.561599] [INFO ] [REMOTE    ] SJT: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T21:06:13.747687] [INFO ] [REMOTE    ] SJM: Fetching primary data for 2025-04.
[2025-10-24T21:06:14.547637] [INFO ] [REMOTE    ] SKE: Fetching primary data for 2025-02.
[2025-10-24T21:06:14.682116] [INFO ] [REMOTE    ] SJM: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T21:06:15.347688] [INFO ] [REMOTE    ] SITE: Fetching primary data for 2025-06.
[2025-10-24T21:06:15.865983] [INFO ] [REMOTE    ] SKE: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T21:06:16.147621] [INFO ] [REMOTE    ] SKE: Fetching primary data for 2025-03.
[2025-10-24T21:06:16.473148] [INFO ] [REMOTE    ] SITE: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T21:06:16.568618] [INFO ] [REMOTE    ] SKE: Incremental fetch complete for 2025-03 (0.42 seconds).
[2025-10-24T21:06:16.947687] [INFO ] [REMOTE    ] SJT: Fetching primary data for 2025-06.
[2025-10-24T21:06:17.747722] [INFO ] [REMOTE    ] SJM: Fetching primary data for 2025-05.
[2025-10-24T21:06:17.888886] [INFO ] [REMOTE    ] SJT: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T21:06:18.547625] [INFO ] [REMOTE    ] SKE: Fetching primary data for 2025-04.
[2025-10-24T21:06:18.587407] [INFO ] [REMOTE    ] SJM: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T21:06:19.347613] [INFO ] [REMOTE    ] SJM: Fetching primary data for 2025-06.
[2025-10-24T21:06:19.506283] [INFO ] [REMOTE    ] SKE: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T21:06:20.116387] [INFO ] [REMOTE    ] SJM: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T21:06:20.147605] [INFO ] [REMOTE    ] SJM: Fetching primary data for 2025-07.
[2025-10-24T21:06:20.947618] [INFO ] [REMOTE    ] SJT: Fetching primary data for 2025-07.
[2025-10-24T21:06:21.227909] [INFO ] [REMOTE    ] SJM: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T21:06:21.513866] [INFO ] [REMOTE    ] SJT: Incremental fetch complete for 2025-07 (0.57 seconds).
[2025-10-24T21:06:21.747709] [INFO ] [REMOTE    ] SKE: Fetching primary data for 2025-05.
[2025-10-24T21:06:22.492507] [INFO ] [REMOTE    ] SKE: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T21:06:22.547635] [INFO ] [REMOTE    ] SKE: Fetching primary data for 2025-06.
[2025-10-24T21:06:23.242581] [INFO ] [REMOTE    ] SKE: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T21:06:23.347597] [INFO ] [REMOTE    ] SKE: Fetching primary data for 2025-07.
[2025-10-24T21:06:24.147683] [INFO ] [REMOTE    ] SJM: Fetching primary data for 2025-08.
[2025-10-24T21:06:24.333677] [INFO ] [REMOTE    ] SKE: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T21:06:24.795392] [INFO ] [REMOTE    ] SJM: Incremental fetch complete for 2025-08 (0.65 seconds).
[2025-10-24T21:06:24.947725] [INFO ] [REMOTE    ] SJM: Fetching primary data for 2025-09.
[2025-10-24T21:06:25.747701] [INFO ] [REMOTE    ] SITE: Fetching primary data for 2025-07.
[2025-10-24T21:06:25.993340] [INFO ] [REMOTE    ] SJM: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T21:06:26.547689] [INFO ] [REMOTE    ] SKE: Fetching primary data for 2025-08.
[2025-10-24T21:06:26.914451] [INFO ] [REMOTE    ] SITE: Incremental fetch complete for 2025-07 (1.17 seconds).
[2025-10-24T21:06:27.174093] [INFO ] [REMOTE    ] SKE: Incremental fetch complete for 2025-08 (0.63 seconds).
[2025-10-24T21:06:27.347694] [INFO ] [REMOTE    ] SKE: Fetching primary data for 2025-09.
[2025-10-24T21:06:28.147714] [INFO ] [REMOTE    ] SJM: Fetching primary data for 2025-10.
[2025-10-24T21:06:28.419057] [INFO ] [REMOTE    ] SKE: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T21:06:28.947570] [INFO ] [REMOTE    ] SKE: Fetching primary data for 2025-10.
[2025-10-24T21:06:29.205759] [INFO ] [REMOTE    ] SJM: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T21:06:29.215833] [INFO ] [REMOTE    ] SJM: Full fetch complete (71970 records).
[2025-10-24T21:06:29.216045] [DEBUG] [VALIDATOR ] SJM: Validating primary data.
[2025-10-24T21:06:29.217906] [FATAL] [VALIDATOR ] SJM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:06:29.218008] [FATAL] [MAIN      ] SJM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:06:29.218051] [WARN ] [MAIN      ] SJM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:06:29.218125] [INFO ] [LOCAL     ] SJM: Starting deletion of primary data.
[2025-10-24T21:06:29.218221] [DEBUG] [LOCAL     ] SJM: No primary data file found to delete.
[2025-10-24T21:06:29.218270] [INFO ] [LOCAL     ] SJM: Starting deletion of derivative data.
[2025-10-24T21:06:29.218461] [DEBUG] [LOCAL     ] SJM: Deleted derivative data file.
[2025-10-24T21:06:29.218831] [INFO ] [MAIN      ] Update Progress: 1915/2366 symbols completed. SJM took 34.1s. Estimated remaining: 58m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:06:29.395498] [INFO ] [MAIN      ] SKIL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:06:29.406032] [DEBUG] [LOCAL     ] SKIL: Loaded 6988 existing records from primary storage.
[2025-10-24T21:06:29.406339] [INFO ] [MAIN      ] SKIL: Loaded 6988 existing records.
[2025-10-24T21:06:29.606121] [WARN ] [MAIN      ] SKIL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:06:29.606419] [INFO ] [MAIN      ] SKIL: Wiping existing primary data before full refresh.
[2025-10-24T21:06:29.606496] [INFO ] [LOCAL     ] SKIL: Starting deletion of primary data.
[2025-10-24T21:06:29.606765] [DEBUG] [LOCAL     ] SKIL: Deleted primary data file.
[2025-10-24T21:06:29.606823] [INFO ] [MAIN      ] SKIL: Starting full primary refresh.
[2025-10-24T21:06:29.747768] [INFO ] [REMOTE    ] SITE: Fetching primary data for 2025-08.
[2025-10-24T21:06:30.027607] [INFO ] [REMOTE    ] SKE: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T21:06:30.048265] [INFO ] [REMOTE    ] SKIL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:06:30.057837] [INFO ] [REMOTE    ] SKE: Full fetch complete (52344 records).
[2025-10-24T21:06:30.057965] [DEBUG] [VALIDATOR ] SKE: Validating primary data.
[2025-10-24T21:06:30.058835] [FATAL] [VALIDATOR ] SKE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:06:30.058925] [FATAL] [MAIN      ] SKE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:06:30.058971] [WARN ] [MAIN      ] SKE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:06:30.059016] [INFO ] [LOCAL     ] SKE: Starting deletion of primary data.
[2025-10-24T21:06:30.059135] [DEBUG] [LOCAL     ] SKE: No primary data file found to delete.
[2025-10-24T21:06:30.059198] [INFO ] [LOCAL     ] SKE: Starting deletion of derivative data.
[2025-10-24T21:06:30.059414] [DEBUG] [LOCAL     ] SKE: Deleted derivative data file.
[2025-10-24T21:06:30.059520] [INFO ] [MAIN      ] Update Progress: 1916/2366 symbols completed. SKE took 20.3s. Estimated remaining: 57m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:06:30.242098] [INFO ] [MAIN      ] SKLZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:06:30.256819] [DEBUG] [LOCAL     ] SKLZ: Loaded 11598 existing records from primary storage.
[2025-10-24T21:06:30.257130] [INFO ] [MAIN      ] SKLZ: Loaded 11598 existing records.
[2025-10-24T21:06:30.437883] [WARN ] [MAIN      ] SKLZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:06:30.438162] [INFO ] [MAIN      ] SKLZ: Wiping existing primary data before full refresh.
[2025-10-24T21:06:30.438215] [INFO ] [LOCAL     ] SKLZ: Starting deletion of primary data.
[2025-10-24T21:06:30.438418] [DEBUG] [LOCAL     ] SKLZ: Deleted primary data file.
[2025-10-24T21:06:30.438458] [INFO ] [MAIN      ] SKLZ: Starting full primary refresh.
[2025-10-24T21:06:30.553240] [INFO ] [REMOTE    ] SJT: Fetching primary data for 2025-08.
[2025-10-24T21:06:30.818208] [INFO ] [REMOTE    ] SKLZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:06:30.843558] [INFO ] [REMOTE    ] SITE: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T21:06:31.266127] [INFO ] [REMOTE    ] SJT: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T21:06:31.347724] [INFO ] [REMOTE    ] SJT: Fetching primary data for 2025-09.
[2025-10-24T21:06:31.932922] [INFO ] [REMOTE    ] SJT: Incremental fetch complete for 2025-09 (0.59 seconds).
[2025-10-24T21:06:32.147708] [INFO ] [REMOTE    ] SJT: Fetching primary data for 2025-10.
[2025-10-24T21:06:32.733298] [INFO ] [REMOTE    ] SJT: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T21:06:32.740438] [INFO ] [REMOTE    ] SJT: Full fetch complete (31829 records).
[2025-10-24T21:06:32.740742] [DEBUG] [VALIDATOR ] SJT: Validating primary data.
[2025-10-24T21:06:32.741694] [FATAL] [VALIDATOR ] SJT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:06:32.741825] [FATAL] [MAIN      ] SJT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:06:32.741871] [WARN ] [MAIN      ] SJT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:06:32.741916] [INFO ] [LOCAL     ] SJT: Starting deletion of primary data.
[2025-10-24T21:06:32.741991] [DEBUG] [LOCAL     ] SJT: No primary data file found to delete.
[2025-10-24T21:06:32.742047] [INFO ] [LOCAL     ] SJT: Starting deletion of derivative data.
[2025-10-24T21:06:32.742332] [DEBUG] [LOCAL     ] SJT: Deleted derivative data file.
[2025-10-24T21:06:32.742445] [INFO ] [MAIN      ] Update Progress: 1917/2366 symbols completed. SJT took 35.9s. Estimated remaining: 57m 44s. Rate: 7.8 symbols/min
[2025-10-24T21:06:32.947693] [INFO ] [REMOTE    ] SKLZ: Fetching primary data for 2025-01.
[2025-10-24T21:06:33.747746] [INFO ] [REMOTE    ] SKIL: Fetching primary data for 2025-01.
[2025-10-24T21:06:34.192337] [INFO ] [REMOTE    ] SKLZ: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T21:06:34.223911] [INFO ] [REMOTE    ] SKIL: Incremental fetch complete for 2025-01 (0.48 seconds).
[2025-10-24T21:06:34.547702] [INFO ] [REMOTE    ] SITE: Fetching primary data for 2025-09.
[2025-10-24T21:06:35.271243] [INFO ] [REMOTE    ] SITE: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T21:06:35.347673] [INFO ] [REMOTE    ] SITE: Fetching primary data for 2025-10.
[2025-10-24T21:06:36.095409] [INFO ] [REMOTE    ] SITE: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T21:06:36.102870] [INFO ] [REMOTE    ] SITE: Full fetch complete (50634 records).
[2025-10-24T21:06:36.103008] [DEBUG] [VALIDATOR ] SITE: Validating primary data.
[2025-10-24T21:06:36.103864] [FATAL] [VALIDATOR ] SITE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:06:36.103958] [FATAL] [MAIN      ] SITE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:06:36.104002] [WARN ] [MAIN      ] SITE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:06:36.104043] [INFO ] [LOCAL     ] SITE: Starting deletion of primary data.
[2025-10-24T21:06:36.104109] [DEBUG] [LOCAL     ] SITE: No primary data file found to delete.
[2025-10-24T21:06:36.104162] [INFO ] [LOCAL     ] SITE: Starting deletion of derivative data.
[2025-10-24T21:06:36.104521] [DEBUG] [LOCAL     ] SITE: Deleted derivative data file.
[2025-10-24T21:06:36.104682] [INFO ] [MAIN      ] Update Progress: 1918/2366 symbols completed. SITE took 44.2s. Estimated remaining: 57m 35s. Rate: 7.8 symbols/min
[2025-10-24T21:06:36.147679] [INFO ] [REMOTE    ] SKIL: Fetching primary data for 2025-02.
[2025-10-24T21:06:36.537043] [INFO ] [REMOTE    ] SKIL: Incremental fetch complete for 2025-02 (0.39 seconds).
[2025-10-24T21:06:36.947744] [INFO ] [REMOTE    ] SKIL: Fetching primary data for 2025-03.
[2025-10-24T21:06:37.678267] [INFO ] [REMOTE    ] SKIL: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T21:06:37.747715] [INFO ] [REMOTE    ] SKIL: Fetching primary data for 2025-04.
[2025-10-24T21:06:38.141814] [INFO ] [REMOTE    ] SKIL: Incremental fetch complete for 2025-04 (0.39 seconds).
[2025-10-24T21:06:38.547760] [INFO ] [REMOTE    ] SKLZ: Fetching primary data for 2025-02.
[2025-10-24T21:06:39.347638] [INFO ] [REMOTE    ] SKIL: Fetching primary data for 2025-05.
[2025-10-24T21:06:39.510189] [INFO ] [REMOTE    ] SKLZ: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T21:06:39.731672] [INFO ] [REMOTE    ] SKIL: Incremental fetch complete for 2025-05 (0.38 seconds).
[2025-10-24T21:06:40.147714] [INFO ] [REMOTE    ] SKIL: Fetching primary data for 2025-06.
[2025-10-24T21:06:40.612240] [INFO ] [REMOTE    ] SKIL: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T21:06:40.947732] [INFO ] [REMOTE    ] SKLZ: Fetching primary data for 2025-03.
[2025-10-24T21:06:41.447674] [INFO ] [REMOTE    ] SKLZ: Incremental fetch complete for 2025-03 (0.50 seconds).
[2025-10-24T21:06:41.747732] [INFO ] [REMOTE    ] SKIL: Fetching primary data for 2025-07.
[2025-10-24T21:06:42.533544] [INFO ] [REMOTE    ] SKIL: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T21:06:42.547623] [INFO ] [REMOTE    ] SKIL: Fetching primary data for 2025-08.
[2025-10-24T21:06:43.277463] [INFO ] [REMOTE    ] SKIL: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T21:06:43.347748] [INFO ] [REMOTE    ] SKIL: Fetching primary data for 2025-09.
[2025-10-24T21:06:44.076347] [INFO ] [REMOTE    ] SKIL: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T21:06:44.147719] [INFO ] [REMOTE    ] SKIL: Fetching primary data for 2025-10.
[2025-10-24T21:06:44.619731] [INFO ] [REMOTE    ] SKIL: Incremental fetch complete for 2025-10 (0.47 seconds).
[2025-10-24T21:06:44.622466] [INFO ] [REMOTE    ] SKIL: Full fetch complete (10409 records).
[2025-10-24T21:06:44.622550] [DEBUG] [VALIDATOR ] SKIL: Validating primary data.
[2025-10-24T21:06:44.623066] [FATAL] [VALIDATOR ] SKIL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:06:44.623153] [FATAL] [MAIN      ] SKIL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:06:44.623197] [WARN ] [MAIN      ] SKIL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:06:44.623237] [INFO ] [LOCAL     ] SKIL: Starting deletion of primary data.
[2025-10-24T21:06:44.623417] [DEBUG] [LOCAL     ] SKIL: No primary data file found to delete.
[2025-10-24T21:06:44.623539] [INFO ] [LOCAL     ] SKIL: Starting deletion of derivative data.
[2025-10-24T21:06:44.623758] [DEBUG] [LOCAL     ] SKIL: Deleted derivative data file.
[2025-10-24T21:06:44.623862] [INFO ] [MAIN      ] Update Progress: 1919/2366 symbols completed. SKIL took 15.4s. Estimated remaining: 57m 28s. Rate: 7.8 symbols/min
[2025-10-24T21:06:44.947668] [INFO ] [REMOTE    ] SKLZ: Fetching primary data for 2025-04.
[2025-10-24T21:06:45.694682] [INFO ] [REMOTE    ] SKLZ: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T21:06:45.747639] [INFO ] [REMOTE    ] SKLZ: Fetching primary data for 2025-05.
[2025-10-24T21:06:46.236215] [INFO ] [REMOTE    ] SKLZ: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T21:06:46.547718] [INFO ] [REMOTE    ] SKLZ: Fetching primary data for 2025-06.
[2025-10-24T21:06:47.010150] [INFO ] [REMOTE    ] SKLZ: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T21:06:47.347740] [INFO ] [REMOTE    ] SKLZ: Fetching primary data for 2025-07.
[2025-10-24T21:06:48.219596] [INFO ] [REMOTE    ] SKLZ: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T21:06:48.224282] [INFO ] [REMOTE    ] SKLZ: Fetching primary data for 2025-08.
[2025-10-24T21:06:49.056308] [INFO ] [REMOTE    ] SKLZ: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T21:06:49.061200] [INFO ] [REMOTE    ] SKLZ: Fetching primary data for 2025-09.
[2025-10-24T21:06:50.056453] [INFO ] [REMOTE    ] SKLZ: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T21:06:50.060006] [INFO ] [REMOTE    ] SKLZ: Fetching primary data for 2025-10.
[2025-10-24T21:06:50.531851] [INFO ] [REMOTE    ] SKLZ: Incremental fetch complete for 2025-10 (0.47 seconds).
[2025-10-24T21:06:50.534873] [INFO ] [REMOTE    ] SKLZ: Full fetch complete (17550 records).
[2025-10-24T21:06:50.534981] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data.
[2025-10-24T21:06:50.535501] [FATAL] [VALIDATOR ] SKLZ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:06:50.535597] [FATAL] [MAIN      ] SKLZ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:06:50.535689] [WARN ] [MAIN      ] SKLZ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:06:50.535764] [INFO ] [LOCAL     ] SKLZ: Starting deletion of primary data.
[2025-10-24T21:06:50.535836] [DEBUG] [LOCAL     ] SKLZ: No primary data file found to delete.
[2025-10-24T21:06:50.535875] [INFO ] [LOCAL     ] SKLZ: Starting deletion of derivative data.
[2025-10-24T21:06:50.536161] [DEBUG] [LOCAL     ] SKLZ: Deleted derivative data file.
[2025-10-24T21:06:50.536257] [INFO ] [MAIN      ] Update Progress: 1920/2366 symbols completed. SKLZ took 20.5s. Estimated remaining: 57m 20s. Rate: 7.8 symbols/min
[2025-10-24T21:06:51.259503] [INFO ] [MAIN      ] SKYH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:06:51.229163] [INFO ] [MAIN      ] SKT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:06:51.280335] [INFO ] [MAIN      ] SKM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:06:51.330758] [INFO ] [MAIN      ] SKY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:06:51.348120] [DEBUG] [LOCAL     ] SKYH: Loaded 15863 existing records from primary storage.
[2025-10-24T21:06:51.348804] [INFO ] [MAIN      ] SKYH: Loaded 15863 existing records.
[2025-10-24T21:06:51.518975] [DEBUG] [LOCAL     ] SKM: Loaded 35467 existing records from primary storage.
[2025-10-24T21:06:51.577761] [INFO ] [MAIN      ] SKM: Loaded 35467 existing records.
[2025-10-24T21:06:51.587075] [DEBUG] [LOCAL     ] SKT: Loaded 42521 existing records from primary storage.
[2025-10-24T21:06:51.623544] [DEBUG] [LOCAL     ] SKY: Loaded 38830 existing records from primary storage.
[2025-10-24T21:06:51.644708] [INFO ] [MAIN      ] SKT: Loaded 42521 existing records.
[2025-10-24T21:06:51.655168] [INFO ] [MAIN      ] SKY: Loaded 38830 existing records.
[2025-10-24T21:06:51.669301] [WARN ] [MAIN      ] SKYH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:06:51.866299] [INFO ] [MAIN      ] SKYH: Wiping existing primary data before full refresh.
[2025-10-24T21:06:51.899209] [INFO ] [LOCAL     ] SKYH: Starting deletion of primary data.
[2025-10-24T21:06:51.945894] [DEBUG] [LOCAL     ] SKYH: Deleted primary data file.
[2025-10-24T21:06:51.977544] [INFO ] [MAIN      ] SKYH: Starting full primary refresh.
[2025-10-24T21:06:52.216380] [WARN ] [MAIN      ] SKM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:06:52.269498] [INFO ] [MAIN      ] SKM: Wiping existing primary data before full refresh.
[2025-10-24T21:06:52.296904] [WARN ] [MAIN      ] SKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:06:52.297108] [INFO ] [LOCAL     ] SKM: Starting deletion of primary data.
[2025-10-24T21:06:52.308726] [DEBUG] [LOCAL     ] SKM: Deleted primary data file.
[2025-10-24T21:06:52.317337] [INFO ] [MAIN      ] SKT: Wiping existing primary data before full refresh.
[2025-10-24T21:06:52.346389] [INFO ] [LOCAL     ] SKT: Starting deletion of primary data.
[2025-10-24T21:06:52.356812] [INFO ] [MAIN      ] SKM: Starting full primary refresh.
[2025-10-24T21:06:52.360279] [WARN ] [MAIN      ] SKY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:06:52.382667] [INFO ] [MAIN      ] SKY: Wiping existing primary data before full refresh.
[2025-10-24T21:06:52.427755] [INFO ] [LOCAL     ] SKY: Starting deletion of primary data.
[2025-10-24T21:06:52.434914] [DEBUG] [LOCAL     ] SKT: Deleted primary data file.
[2025-10-24T21:06:52.464269] [DEBUG] [LOCAL     ] SKY: Deleted primary data file.
[2025-10-24T21:06:52.443068] [INFO ] [MAIN      ] SKT: Starting full primary refresh.
[2025-10-24T21:06:52.507634] [INFO ] [MAIN      ] SKY: Starting full primary refresh.
[2025-10-24T21:06:53.336071] [INFO ] [REMOTE    ] SKYH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:06:53.391674] [INFO ] [REMOTE    ] SKYH: Fetching primary data for 2025-01.
[2025-10-24T21:06:53.631292] [INFO ] [REMOTE    ] SKM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:06:53.681377] [INFO ] [REMOTE    ] SKM: Fetching primary data for 2025-01.
[2025-10-24T21:06:53.755061] [INFO ] [REMOTE    ] SKY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:06:53.779975] [INFO ] [REMOTE    ] SKY: Fetching primary data for 2025-01.
[2025-10-24T21:06:53.822568] [INFO ] [REMOTE    ] SKT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:06:53.823388] [INFO ] [REMOTE    ] SKT: Fetching primary data for 2025-01.
[2025-10-24T21:06:53.987872] [INFO ] [REMOTE    ] SKYH: Incremental fetch complete for 2025-01 (0.60 seconds).
[2025-10-24T21:06:53.991040] [INFO ] [REMOTE    ] SKYH: Fetching primary data for 2025-02.
[2025-10-24T21:06:54.187859] [INFO ] [REMOTE    ] SKY: Incremental fetch complete for 2025-01 (0.41 seconds).
[2025-10-24T21:06:54.547629] [INFO ] [REMOTE    ] SKY: Fetching primary data for 2025-02.
[2025-10-24T21:06:54.772798] [INFO ] [REMOTE    ] SKYH: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T21:06:54.886039] [INFO ] [REMOTE    ] SKM: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T21:06:55.231068] [INFO ] [REMOTE    ] SKT: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T21:06:55.332718] [INFO ] [REMOTE    ] SKY: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T21:06:55.347617] [INFO ] [REMOTE    ] SKY: Fetching primary data for 2025-03.
[2025-10-24T21:06:56.049568] [INFO ] [REMOTE    ] SKY: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T21:06:56.147672] [INFO ] [REMOTE    ] SKY: Fetching primary data for 2025-04.
[2025-10-24T21:06:56.857741] [INFO ] [REMOTE    ] SKY: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T21:06:56.947604] [INFO ] [REMOTE    ] SKY: Fetching primary data for 2025-05.
[2025-10-24T21:06:57.698519] [INFO ] [REMOTE    ] SKY: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T21:06:57.747749] [INFO ] [REMOTE    ] SKM: Fetching primary data for 2025-02.
[2025-10-24T21:06:58.438891] [INFO ] [REMOTE    ] SKM: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T21:06:58.547631] [INFO ] [REMOTE    ] SKM: Fetching primary data for 2025-03.
[2025-10-24T21:06:59.229382] [INFO ] [REMOTE    ] SKM: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T21:06:59.347604] [INFO ] [REMOTE    ] SKM: Fetching primary data for 2025-04.
[2025-10-24T21:07:00.162913] [INFO ] [REMOTE    ] SKY: Fetching primary data for 2025-06.
[2025-10-24T21:07:00.166827] [INFO ] [REMOTE    ] SKM: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T21:07:00.947722] [INFO ] [REMOTE    ] SKYH: Fetching primary data for 2025-03.
[2025-10-24T21:07:00.949730] [INFO ] [REMOTE    ] SKY: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T21:07:01.610124] [INFO ] [REMOTE    ] SKYH: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T21:07:01.747679] [INFO ] [REMOTE    ] SKY: Fetching primary data for 2025-07.
[2025-10-24T21:07:02.494891] [INFO ] [REMOTE    ] SKY: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T21:07:02.547600] [INFO ] [REMOTE    ] SKY: Fetching primary data for 2025-08.
[2025-10-24T21:07:03.347687] [INFO ] [REMOTE    ] SKM: Fetching primary data for 2025-05.
[2025-10-24T21:07:03.922809] [INFO ] [REMOTE    ] SKY: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T21:07:04.147709] [INFO ] [REMOTE    ] SKY: Fetching primary data for 2025-09.
[2025-10-24T21:07:04.769408] [INFO ] [REMOTE    ] SKM: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T21:07:04.952772] [INFO ] [REMOTE    ] SKM: Fetching primary data for 2025-06.
[2025-10-24T21:07:04.965571] [INFO ] [REMOTE    ] SKY: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T21:07:05.686889] [INFO ] [REMOTE    ] SKM: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T21:07:05.747600] [INFO ] [REMOTE    ] SKM: Fetching primary data for 2025-07.
[2025-10-24T21:07:06.535038] [INFO ] [REMOTE    ] SKM: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T21:07:06.547592] [INFO ] [REMOTE    ] SKM: Fetching primary data for 2025-08.
[2025-10-24T21:07:07.235579] [INFO ] [REMOTE    ] SKM: Incremental fetch complete for 2025-08 (0.69 seconds).
[2025-10-24T21:07:07.347621] [INFO ] [REMOTE    ] SKM: Fetching primary data for 2025-09.
[2025-10-24T21:07:08.147612] [INFO ] [REMOTE    ] SKYH: Fetching primary data for 2025-04.
[2025-10-24T21:07:08.620697] [INFO ] [REMOTE    ] SKM: Incremental fetch complete for 2025-09 (1.27 seconds).
[2025-10-24T21:07:08.947704] [INFO ] [REMOTE    ] SKM: Fetching primary data for 2025-10.
[2025-10-24T21:07:09.060189] [DEBUG] [REMOTE    ] SKM: Error fetching primary data for 2025-10: 'API call returned an empty response.'
[2025-10-24T21:07:09.061083] [INFO ] [REMOTE    ] SKYH: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T21:07:09.062755] [WARN ] [REMOTE    ] SKM: No data returned for month 2025-10
[2025-10-24T21:07:09.066202] [FATAL] [REMOTE    ] SKM: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:07:09.066315] [FATAL] [MAIN      ] SKM: Failed to fetch primary data.
[2025-10-24T21:07:09.066403] [WARN ] [MAIN      ] SKM: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:07:09.066515] [INFO ] [LOCAL     ] SKM: Starting deletion of primary data.
[2025-10-24T21:07:09.066590] [DEBUG] [LOCAL     ] SKM: No primary data file found to delete.
[2025-10-24T21:07:09.066626] [INFO ] [LOCAL     ] SKM: Starting deletion of derivative data.
[2025-10-24T21:07:09.066838] [DEBUG] [LOCAL     ] SKM: Deleted derivative data file.
[2025-10-24T21:07:09.066919] [INFO ] [MAIN      ] Update Progress: 1921/2366 symbols completed. SKM took 18.5s. Estimated remaining: 57m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:07:09.240845] [INFO ] [MAIN      ] SLAI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:07:09.241017] [DEBUG] [LOCAL     ] SLAI: No existing data file found in primary storage.
[2025-10-24T21:07:09.241069] [WARN ] [MAIN      ] SLAI: No existing data found, performing full refresh instead.
[2025-10-24T21:07:09.241202] [INFO ] [MAIN      ] SLAI: Wiping existing primary data before full refresh.
[2025-10-24T21:07:09.241267] [INFO ] [LOCAL     ] SLAI: Starting deletion of primary data.
[2025-10-24T21:07:09.241318] [DEBUG] [LOCAL     ] SLAI: No primary data file found to delete.
[2025-10-24T21:07:09.241353] [INFO ] [MAIN      ] SLAI: Starting full primary refresh.
[2025-10-24T21:07:09.616495] [INFO ] [REMOTE    ] SLAI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:07:09.747608] [INFO ] [REMOTE    ] SLAI: Fetching primary data for 2025-01.
[2025-10-24T21:07:09.878562] [DEBUG] [REMOTE    ] SLAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:07:09.878995] [WARN ] [REMOTE    ] SLAI: No data returned for month 2025-01
[2025-10-24T21:07:09.879110] [FATAL] [REMOTE    ] SLAI: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:07:09.879190] [FATAL] [MAIN      ] SLAI: Failed to fetch primary data.
[2025-10-24T21:07:09.879267] [WARN ] [MAIN      ] SLAI: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:07:09.879354] [INFO ] [LOCAL     ] SLAI: Starting deletion of primary data.
[2025-10-24T21:07:09.879441] [DEBUG] [LOCAL     ] SLAI: No primary data file found to delete.
[2025-10-24T21:07:09.879497] [INFO ] [LOCAL     ] SLAI: Starting deletion of derivative data.
[2025-10-24T21:07:09.879559] [DEBUG] [LOCAL     ] SLAI: No derivative data file found to delete.
[2025-10-24T21:07:09.879626] [INFO ] [MAIN      ] Update Progress: 1922/2366 symbols completed. SLAI took 0.8s. Estimated remaining: 57m 5s. Rate: 7.8 symbols/min
[2025-10-24T21:07:10.069804] [INFO ] [MAIN      ] SLB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:07:10.119947] [DEBUG] [LOCAL     ] SLB: Loaded 54087 existing records from primary storage.
[2025-10-24T21:07:10.120263] [INFO ] [MAIN      ] SLB: Loaded 54087 existing records.
[2025-10-24T21:07:10.296541] [WARN ] [MAIN      ] SLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:07:10.296786] [INFO ] [MAIN      ] SLB: Wiping existing primary data before full refresh.
[2025-10-24T21:07:10.296832] [INFO ] [LOCAL     ] SLB: Starting deletion of primary data.
[2025-10-24T21:07:10.297443] [DEBUG] [LOCAL     ] SLB: Deleted primary data file.
[2025-10-24T21:07:10.297501] [INFO ] [MAIN      ] SLB: Starting full primary refresh.
[2025-10-24T21:07:10.552936] [INFO ] [REMOTE    ] SKT: Fetching primary data for 2025-02.
[2025-10-24T21:07:10.652898] [INFO ] [REMOTE    ] SLB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:07:11.347706] [INFO ] [REMOTE    ] SLB: Fetching primary data for 2025-01.
[2025-10-24T21:07:11.568849] [INFO ] [REMOTE    ] SKT: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T21:07:11.809390] [INFO ] [REMOTE    ] SLB: Incremental fetch complete for 2025-01 (0.46 seconds).
[2025-10-24T21:07:12.147623] [INFO ] [REMOTE    ] SLB: Fetching primary data for 2025-02.
[2025-10-24T21:07:12.947629] [INFO ] [REMOTE    ] SKY: Fetching primary data for 2025-10.
[2025-10-24T21:07:13.236575] [INFO ] [REMOTE    ] SLB: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T21:07:13.747624] [INFO ] [REMOTE    ] SLB: Fetching primary data for 2025-03.
[2025-10-24T21:07:13.919209] [INFO ] [REMOTE    ] SKY: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T21:07:13.926313] [INFO ] [REMOTE    ] SKY: Full fetch complete (53998 records).
[2025-10-24T21:07:13.926440] [DEBUG] [VALIDATOR ] SKY: Validating primary data.
[2025-10-24T21:07:13.927089] [FATAL] [VALIDATOR ] SKY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:07:13.927186] [FATAL] [MAIN      ] SKY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:07:13.927258] [WARN ] [MAIN      ] SKY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:07:13.927343] [INFO ] [LOCAL     ] SKY: Starting deletion of primary data.
[2025-10-24T21:07:13.927442] [DEBUG] [LOCAL     ] SKY: No primary data file found to delete.
[2025-10-24T21:07:13.927492] [INFO ] [LOCAL     ] SKY: Starting deletion of derivative data.
[2025-10-24T21:07:13.927636] [DEBUG] [LOCAL     ] SKY: Deleted derivative data file.
[2025-10-24T21:07:13.927913] [INFO ] [MAIN      ] Update Progress: 1923/2366 symbols completed. SKY took 23.4s. Estimated remaining: 56m 57s. Rate: 7.8 symbols/min
[2025-10-24T21:07:14.095612] [INFO ] [MAIN      ] SLF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:07:14.132844] [DEBUG] [LOCAL     ] SLF: Loaded 38557 existing records from primary storage.
[2025-10-24T21:07:14.133119] [INFO ] [MAIN      ] SLF: Loaded 38557 existing records.
[2025-10-24T21:07:14.305967] [WARN ] [MAIN      ] SLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:07:14.306213] [INFO ] [MAIN      ] SLF: Wiping existing primary data before full refresh.
[2025-10-24T21:07:14.306267] [INFO ] [LOCAL     ] SLF: Starting deletion of primary data.
[2025-10-24T21:07:14.306452] [DEBUG] [LOCAL     ] SLF: Deleted primary data file.
[2025-10-24T21:07:14.306490] [INFO ] [MAIN      ] SLF: Starting full primary refresh.
[2025-10-24T21:07:14.551796] [INFO ] [REMOTE    ] SKYH: Fetching primary data for 2025-05.
[2025-10-24T21:07:14.656906] [INFO ] [REMOTE    ] SLF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:07:14.949090] [INFO ] [REMOTE    ] SLB: Incremental fetch complete for 2025-03 (1.20 seconds).
[2025-10-24T21:07:15.150692] [INFO ] [REMOTE    ] SKYH: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T21:07:15.347679] [INFO ] [REMOTE    ] SLB: Fetching primary data for 2025-04.
[2025-10-24T21:07:16.147715] [INFO ] [REMOTE    ] SLF: Fetching primary data for 2025-01.
[2025-10-24T21:07:16.195894] [INFO ] [REMOTE    ] SLB: Incremental fetch complete for 2025-04 (0.85 seconds).
[2025-10-24T21:07:16.851215] [INFO ] [REMOTE    ] SLF: Incremental fetch complete for 2025-01 (0.70 seconds).
[2025-10-24T21:07:16.947616] [INFO ] [REMOTE    ] SLF: Fetching primary data for 2025-02.
[2025-10-24T21:07:17.672610] [INFO ] [REMOTE    ] SLF: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T21:07:17.747635] [INFO ] [REMOTE    ] SLB: Fetching primary data for 2025-05.
[2025-10-24T21:07:18.443670] [INFO ] [REMOTE    ] SLB: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T21:07:18.547631] [INFO ] [REMOTE    ] SLB: Fetching primary data for 2025-06.
[2025-10-24T21:07:19.347618] [INFO ] [REMOTE    ] SKT: Fetching primary data for 2025-03.
[2025-10-24T21:07:19.749482] [INFO ] [REMOTE    ] SLB: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T21:07:20.147704] [INFO ] [REMOTE    ] SKYH: Fetching primary data for 2025-06.
[2025-10-24T21:07:20.272593] [INFO ] [REMOTE    ] SKT: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T21:07:20.508027] [INFO ] [REMOTE    ] SKYH: Incremental fetch complete for 2025-06 (0.36 seconds).
[2025-10-24T21:07:20.947706] [INFO ] [REMOTE    ] SKYH: Fetching primary data for 2025-07.
[2025-10-24T21:07:21.519962] [INFO ] [REMOTE    ] SKYH: Incremental fetch complete for 2025-07 (0.57 seconds).
[2025-10-24T21:07:21.747696] [INFO ] [REMOTE    ] SLF: Fetching primary data for 2025-03.
[2025-10-24T21:07:22.547633] [INFO ] [REMOTE    ] SLB: Fetching primary data for 2025-07.
[2025-10-24T21:07:22.679235] [INFO ] [REMOTE    ] SLF: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T21:07:23.355254] [INFO ] [REMOTE    ] SKYH: Fetching primary data for 2025-08.
[2025-10-24T21:07:23.378145] [INFO ] [REMOTE    ] SLB: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T21:07:24.065715] [INFO ] [REMOTE    ] SKYH: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T21:07:24.147633] [INFO ] [REMOTE    ] SLF: Fetching primary data for 2025-04.
[2025-10-24T21:07:24.528122] [INFO ] [REMOTE    ] SLF: Incremental fetch complete for 2025-04 (0.38 seconds).
[2025-10-24T21:07:24.947630] [INFO ] [REMOTE    ] SKYH: Fetching primary data for 2025-09.
[2025-10-24T21:07:25.734781] [INFO ] [REMOTE    ] SKYH: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T21:07:25.747589] [INFO ] [REMOTE    ] SKYH: Fetching primary data for 2025-10.
[2025-10-24T21:07:26.328001] [INFO ] [REMOTE    ] SKYH: Incremental fetch complete for 2025-10 (0.58 seconds).
[2025-10-24T21:07:26.331263] [INFO ] [REMOTE    ] SKYH: Full fetch complete (22304 records).
[2025-10-24T21:07:26.331336] [DEBUG] [VALIDATOR ] SKYH: Validating primary data.
[2025-10-24T21:07:26.331771] [FATAL] [VALIDATOR ] SKYH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:07:26.331853] [FATAL] [MAIN      ] SKYH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:07:26.331895] [WARN ] [MAIN      ] SKYH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:07:26.331932] [INFO ] [LOCAL     ] SKYH: Starting deletion of primary data.
[2025-10-24T21:07:26.331984] [DEBUG] [LOCAL     ] SKYH: No primary data file found to delete.
[2025-10-24T21:07:26.332017] [INFO ] [LOCAL     ] SKYH: Starting deletion of derivative data.
[2025-10-24T21:07:26.332220] [DEBUG] [LOCAL     ] SKYH: Deleted derivative data file.
[2025-10-24T21:07:26.332302] [INFO ] [MAIN      ] Update Progress: 1924/2366 symbols completed. SKYH took 35.8s. Estimated remaining: 56m 50s. Rate: 7.8 symbols/min
[2025-10-24T21:07:26.506382] [INFO ] [MAIN      ] SLG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:07:26.548258] [INFO ] [REMOTE    ] SLB: Fetching primary data for 2025-08.
[2025-10-24T21:07:26.550134] [DEBUG] [LOCAL     ] SLG: Loaded 46144 existing records from primary storage.
[2025-10-24T21:07:26.550475] [INFO ] [MAIN      ] SLG: Loaded 46144 existing records.
[2025-10-24T21:07:26.729765] [WARN ] [MAIN      ] SLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:07:26.729984] [INFO ] [MAIN      ] SLG: Wiping existing primary data before full refresh.
[2025-10-24T21:07:26.730031] [INFO ] [LOCAL     ] SLG: Starting deletion of primary data.
[2025-10-24T21:07:26.730556] [DEBUG] [LOCAL     ] SLG: Deleted primary data file.
[2025-10-24T21:07:26.730611] [INFO ] [MAIN      ] SLG: Starting full primary refresh.
[2025-10-24T21:07:27.094593] [INFO ] [REMOTE    ] SLG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:07:27.347618] [INFO ] [REMOTE    ] SLG: Fetching primary data for 2025-01.
[2025-10-24T21:07:28.080571] [INFO ] [REMOTE    ] SLB: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T21:07:28.147624] [INFO ] [REMOTE    ] SLB: Fetching primary data for 2025-09.
[2025-10-24T21:07:28.698168] [INFO ] [REMOTE    ] SLG: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T21:07:28.947622] [INFO ] [REMOTE    ] SLG: Fetching primary data for 2025-02.
[2025-10-24T21:07:29.275171] [INFO ] [REMOTE    ] SLB: Incremental fetch complete for 2025-09 (1.13 seconds).
[2025-10-24T21:07:29.747619] [INFO ] [REMOTE    ] SLB: Fetching primary data for 2025-10.
[2025-10-24T21:07:29.852063] [INFO ] [REMOTE    ] SLG: Incremental fetch complete for 2025-02 (0.90 seconds).
[2025-10-24T21:07:30.547721] [INFO ] [REMOTE    ] SLG: Fetching primary data for 2025-03.
[2025-10-24T21:07:30.700913] [INFO ] [REMOTE    ] SLB: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T21:07:30.711774] [INFO ] [REMOTE    ] SLB: Full fetch complete (77487 records).
[2025-10-24T21:07:30.711928] [DEBUG] [VALIDATOR ] SLB: Validating primary data.
[2025-10-24T21:07:30.712897] [FATAL] [VALIDATOR ] SLB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:07:30.712995] [FATAL] [MAIN      ] SLB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:07:30.713038] [WARN ] [MAIN      ] SLB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:07:30.713079] [INFO ] [LOCAL     ] SLB: Starting deletion of primary data.
[2025-10-24T21:07:30.713136] [DEBUG] [LOCAL     ] SLB: No primary data file found to delete.
[2025-10-24T21:07:30.713173] [INFO ] [LOCAL     ] SLB: Starting deletion of derivative data.
[2025-10-24T21:07:30.713356] [DEBUG] [LOCAL     ] SLB: Deleted derivative data file.
[2025-10-24T21:07:30.713738] [INFO ] [MAIN      ] Update Progress: 1925/2366 symbols completed. SLB took 20.8s. Estimated remaining: 56m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:07:30.905821] [INFO ] [MAIN      ] SLGN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:07:30.945848] [DEBUG] [LOCAL     ] SLGN: Loaded 41337 existing records from primary storage.
[2025-10-24T21:07:30.946131] [INFO ] [MAIN      ] SLGN: Loaded 41337 existing records.
[2025-10-24T21:07:31.142690] [WARN ] [MAIN      ] SLGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:07:31.142904] [INFO ] [MAIN      ] SLGN: Wiping existing primary data before full refresh.
[2025-10-24T21:07:31.142967] [INFO ] [LOCAL     ] SLGN: Starting deletion of primary data.
[2025-10-24T21:07:31.143152] [DEBUG] [LOCAL     ] SLGN: Deleted primary data file.
[2025-10-24T21:07:31.143193] [INFO ] [MAIN      ] SLGN: Starting full primary refresh.
[2025-10-24T21:07:31.355461] [INFO ] [REMOTE    ] SKT: Fetching primary data for 2025-04.
[2025-10-24T21:07:31.545898] [INFO ] [REMOTE    ] SLGN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:07:31.573057] [INFO ] [REMOTE    ] SLG: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T21:07:32.147621] [INFO ] [REMOTE    ] SLGN: Fetching primary data for 2025-01.
[2025-10-24T21:07:32.564195] [INFO ] [REMOTE    ] SKT: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T21:07:32.947632] [INFO ] [REMOTE    ] SLG: Fetching primary data for 2025-04.
[2025-10-24T21:07:33.089785] [INFO ] [REMOTE    ] SLGN: Incremental fetch complete for 2025-01 (0.94 seconds).
[2025-10-24T21:07:33.747685] [INFO ] [REMOTE    ] SLF: Fetching primary data for 2025-05.
[2025-10-24T21:07:34.365820] [INFO ] [REMOTE    ] SLG: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T21:07:34.547672] [INFO ] [REMOTE    ] SLG: Fetching primary data for 2025-05.
[2025-10-24T21:07:35.152161] [INFO ] [REMOTE    ] SLF: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T21:07:35.347715] [INFO ] [REMOTE    ] SLF: Fetching primary data for 2025-06.
[2025-10-24T21:07:35.350576] [INFO ] [REMOTE    ] SLG: Incremental fetch complete for 2025-05 (0.80 seconds).
[2025-10-24T21:07:36.147604] [INFO ] [REMOTE    ] SLG: Fetching primary data for 2025-06.
[2025-10-24T21:07:36.642784] [INFO ] [REMOTE    ] SLF: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T21:07:36.947696] [INFO ] [REMOTE    ] SLGN: Fetching primary data for 2025-02.
[2025-10-24T21:07:37.747623] [INFO ] [REMOTE    ] SKT: Fetching primary data for 2025-05.
[2025-10-24T21:07:38.547676] [INFO ] [REMOTE    ] SLF: Fetching primary data for 2025-07.
[2025-10-24T21:07:38.711260] [INFO ] [REMOTE    ] SLG: Incremental fetch complete for 2025-06 (2.56 seconds).
[2025-10-24T21:07:38.747959] [INFO ] [REMOTE    ] SKT: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T21:07:39.285187] [INFO ] [REMOTE    ] SLF: Incremental fetch complete for 2025-07 (0.74 seconds).
[2025-10-24T21:07:39.347630] [INFO ] [REMOTE    ] SLF: Fetching primary data for 2025-08.
[2025-10-24T21:07:39.769267] [INFO ] [REMOTE    ] SLGN: Incremental fetch complete for 2025-02 (2.82 seconds).
[2025-10-24T21:07:40.147631] [INFO ] [REMOTE    ] SLGN: Fetching primary data for 2025-03.
[2025-10-24T21:07:40.885244] [INFO ] [REMOTE    ] SLF: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T21:07:40.947627] [INFO ] [REMOTE    ] SLF: Fetching primary data for 2025-09.
[2025-10-24T21:07:41.191466] [INFO ] [REMOTE    ] SLGN: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T21:07:41.672729] [INFO ] [REMOTE    ] SLF: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T21:07:41.747741] [INFO ] [REMOTE    ] SLF: Fetching primary data for 2025-10.
[2025-10-24T21:07:42.347415] [INFO ] [REMOTE    ] SLF: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T21:07:42.354235] [INFO ] [REMOTE    ] SLF: Full fetch complete (56052 records).
[2025-10-24T21:07:42.354389] [DEBUG] [VALIDATOR ] SLF: Validating primary data.
[2025-10-24T21:07:42.355762] [FATAL] [VALIDATOR ] SLF: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:07:42.355858] [FATAL] [MAIN      ] SLF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:07:42.355905] [WARN ] [MAIN      ] SLF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:07:42.355965] [INFO ] [LOCAL     ] SLF: Starting deletion of primary data.
[2025-10-24T21:07:42.356071] [DEBUG] [LOCAL     ] SLF: No primary data file found to delete.
[2025-10-24T21:07:42.356122] [INFO ] [LOCAL     ] SLF: Starting deletion of derivative data.
[2025-10-24T21:07:42.356538] [DEBUG] [LOCAL     ] SLF: Deleted derivative data file.
[2025-10-24T21:07:42.357180] [INFO ] [MAIN      ] Update Progress: 1926/2366 symbols completed. SLF took 28.4s. Estimated remaining: 56m 35s. Rate: 7.8 symbols/min
[2025-10-24T21:07:42.532888] [INFO ] [MAIN      ] SLNZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:07:42.533098] [DEBUG] [LOCAL     ] SLNZ: No existing data file found in primary storage.
[2025-10-24T21:07:42.533138] [WARN ] [MAIN      ] SLNZ: No existing data found, performing full refresh instead.
[2025-10-24T21:07:42.533257] [INFO ] [MAIN      ] SLNZ: Wiping existing primary data before full refresh.
[2025-10-24T21:07:42.533299] [INFO ] [LOCAL     ] SLNZ: Starting deletion of primary data.
[2025-10-24T21:07:42.533340] [DEBUG] [LOCAL     ] SLNZ: No primary data file found to delete.
[2025-10-24T21:07:42.533372] [INFO ] [MAIN      ] SLNZ: Starting full primary refresh.
[2025-10-24T21:07:42.555468] [INFO ] [REMOTE    ] SKT: Fetching primary data for 2025-06.
[2025-10-24T21:07:42.914195] [INFO ] [REMOTE    ] SLNZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:07:43.347677] [INFO ] [REMOTE    ] SLNZ: Fetching primary data for 2025-01.
[2025-10-24T21:07:43.559436] [INFO ] [REMOTE    ] SLNZ: Incremental fetch complete for 2025-01 (0.21 seconds).
[2025-10-24T21:07:43.720207] [INFO ] [REMOTE    ] SKT: Incremental fetch complete for 2025-06 (1.16 seconds).
[2025-10-24T21:07:44.147748] [INFO ] [REMOTE    ] SLNZ: Fetching primary data for 2025-02.
[2025-10-24T21:07:44.624567] [INFO ] [REMOTE    ] SLNZ: Incremental fetch complete for 2025-02 (0.48 seconds).
[2025-10-24T21:07:44.947702] [INFO ] [REMOTE    ] SLNZ: Fetching primary data for 2025-03.
[2025-10-24T21:07:45.435696] [INFO ] [REMOTE    ] SLNZ: Incremental fetch complete for 2025-03 (0.49 seconds).
[2025-10-24T21:07:45.747732] [INFO ] [REMOTE    ] SLGN: Fetching primary data for 2025-04.
[2025-10-24T21:07:46.547753] [INFO ] [REMOTE    ] SLNZ: Fetching primary data for 2025-04.
[2025-10-24T21:07:47.006443] [INFO ] [REMOTE    ] SLNZ: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T21:07:47.300953] [INFO ] [REMOTE    ] SLGN: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T21:07:47.347752] [INFO ] [REMOTE    ] SKT: Fetching primary data for 2025-07.
[2025-10-24T21:07:48.152836] [INFO ] [REMOTE    ] SLG: Fetching primary data for 2025-07.
[2025-10-24T21:07:48.181505] [INFO ] [REMOTE    ] SKT: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T21:07:48.947705] [INFO ] [REMOTE    ] SKT: Fetching primary data for 2025-08.
[2025-10-24T21:07:49.148834] [INFO ] [REMOTE    ] SLG: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T21:07:49.693629] [INFO ] [REMOTE    ] SKT: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T21:07:49.747601] [INFO ] [REMOTE    ] SKT: Fetching primary data for 2025-09.
[2025-10-24T21:07:50.473060] [INFO ] [REMOTE    ] SKT: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T21:07:50.547636] [INFO ] [REMOTE    ] SKT: Fetching primary data for 2025-10.
[2025-10-24T21:07:51.297229] [INFO ] [REMOTE    ] SKT: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T21:07:51.304262] [INFO ] [REMOTE    ] SKT: Full fetch complete (60471 records).
[2025-10-24T21:07:51.304400] [DEBUG] [VALIDATOR ] SKT: Validating primary data.
[2025-10-24T21:07:51.305111] [FATAL] [VALIDATOR ] SKT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:07:51.305195] [FATAL] [MAIN      ] SKT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:07:51.305237] [WARN ] [MAIN      ] SKT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:07:51.305274] [INFO ] [LOCAL     ] SKT: Starting deletion of primary data.
[2025-10-24T21:07:51.305327] [DEBUG] [LOCAL     ] SKT: No primary data file found to delete.
[2025-10-24T21:07:51.305362] [INFO ] [LOCAL     ] SKT: Starting deletion of derivative data.
[2025-10-24T21:07:51.305508] [DEBUG] [LOCAL     ] SKT: Deleted derivative data file.
[2025-10-24T21:07:51.305719] [INFO ] [MAIN      ] Update Progress: 1927/2366 symbols completed. SKT took 1m 1s. Estimated remaining: 56m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:07:51.352871] [INFO ] [REMOTE    ] SLGN: Fetching primary data for 2025-05.
[2025-10-24T21:07:51.499795] [INFO ] [MAIN      ] SLQT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:07:51.548139] [DEBUG] [LOCAL     ] SLQT: Loaded 43671 existing records from primary storage.
[2025-10-24T21:07:51.548442] [INFO ] [MAIN      ] SLQT: Loaded 43671 existing records.
[2025-10-24T21:07:51.727377] [WARN ] [MAIN      ] SLQT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:07:51.730597] [INFO ] [MAIN      ] SLQT: Wiping existing primary data before full refresh.
[2025-10-24T21:07:51.730701] [INFO ] [LOCAL     ] SLQT: Starting deletion of primary data.
[2025-10-24T21:07:51.730949] [DEBUG] [LOCAL     ] SLQT: Deleted primary data file.
[2025-10-24T21:07:51.731017] [INFO ] [MAIN      ] SLQT: Starting full primary refresh.
[2025-10-24T21:07:52.106871] [INFO ] [REMOTE    ] SLQT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:07:52.147686] [INFO ] [REMOTE    ] SLG: Fetching primary data for 2025-08.
[2025-10-24T21:07:52.947718] [INFO ] [REMOTE    ] SLQT: Fetching primary data for 2025-01.
[2025-10-24T21:07:53.373430] [INFO ] [REMOTE    ] SLGN: Incremental fetch complete for 2025-05 (2.02 seconds).
[2025-10-24T21:07:53.744171] [INFO ] [REMOTE    ] SLQT: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T21:07:53.752325] [INFO ] [REMOTE    ] SLGN: Fetching primary data for 2025-06.
[2025-10-24T21:07:54.366144] [INFO ] [REMOTE    ] SLG: Incremental fetch complete for 2025-08 (2.22 seconds).
[2025-10-24T21:07:54.547713] [INFO ] [REMOTE    ] SLQT: Fetching primary data for 2025-02.
[2025-10-24T21:07:54.980081] [INFO ] [REMOTE    ] SLGN: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T21:07:55.347679] [INFO ] [REMOTE    ] SLNZ: Fetching primary data for 2025-05.
[2025-10-24T21:07:55.776485] [INFO ] [REMOTE    ] SLNZ: Incremental fetch complete for 2025-05 (0.43 seconds).
[2025-10-24T21:07:55.806702] [INFO ] [REMOTE    ] SLQT: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T21:07:56.147690] [INFO ] [REMOTE    ] SLGN: Fetching primary data for 2025-07.
[2025-10-24T21:07:56.947663] [INFO ] [REMOTE    ] SLQT: Fetching primary data for 2025-03.
[2025-10-24T21:07:57.050524] [INFO ] [REMOTE    ] SLGN: Incremental fetch complete for 2025-07 (0.90 seconds).
[2025-10-24T21:07:57.747743] [INFO ] [REMOTE    ] SLNZ: Fetching primary data for 2025-06.
[2025-10-24T21:07:58.085461] [INFO ] [REMOTE    ] SLNZ: Incremental fetch complete for 2025-06 (0.34 seconds).
[2025-10-24T21:07:58.110933] [INFO ] [REMOTE    ] SLQT: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T21:07:58.547615] [INFO ] [REMOTE    ] SLNZ: Fetching primary data for 2025-07.
[2025-10-24T21:07:58.757560] [INFO ] [REMOTE    ] SLNZ: Incremental fetch complete for 2025-07 (0.21 seconds).
[2025-10-24T21:07:59.347676] [INFO ] [REMOTE    ] SLQT: Fetching primary data for 2025-04.
[2025-10-24T21:07:59.726918] [INFO ] [REMOTE    ] SLQT: Incremental fetch complete for 2025-04 (0.38 seconds).
[2025-10-24T21:08:00.147724] [INFO ] [REMOTE    ] SLGN: Fetching primary data for 2025-08.
[2025-10-24T21:08:00.947699] [INFO ] [REMOTE    ] SLG: Fetching primary data for 2025-09.
[2025-10-24T21:08:00.984120] [INFO ] [REMOTE    ] SLGN: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T21:08:01.747633] [INFO ] [REMOTE    ] SLQT: Fetching primary data for 2025-05.
[2025-10-24T21:08:02.359111] [INFO ] [REMOTE    ] SLG: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T21:08:02.547609] [INFO ] [REMOTE    ] SLGN: Fetching primary data for 2025-09.
[2025-10-24T21:08:02.880425] [INFO ] [REMOTE    ] SLQT: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T21:08:03.347629] [INFO ] [REMOTE    ] SLQT: Fetching primary data for 2025-06.
[2025-10-24T21:08:03.731448] [INFO ] [REMOTE    ] SLGN: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T21:08:04.147706] [INFO ] [REMOTE    ] SLNZ: Fetching primary data for 2025-08.
[2025-10-24T21:08:04.690434] [INFO ] [REMOTE    ] SLNZ: Incremental fetch complete for 2025-08 (0.54 seconds).
[2025-10-24T21:08:04.726533] [INFO ] [REMOTE    ] SLQT: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T21:08:04.947727] [INFO ] [REMOTE    ] SLNZ: Fetching primary data for 2025-09.
[2025-10-24T21:08:05.747612] [INFO ] [REMOTE    ] SLGN: Fetching primary data for 2025-10.
[2025-10-24T21:08:05.814907] [INFO ] [REMOTE    ] SLNZ: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T21:08:06.547731] [INFO ] [REMOTE    ] SLNZ: Fetching primary data for 2025-10.
[2025-10-24T21:08:06.754900] [INFO ] [REMOTE    ] SLNZ: Incremental fetch complete for 2025-10 (0.21 seconds).
[2025-10-24T21:08:06.755706] [INFO ] [REMOTE    ] SLNZ: Full fetch complete (1048 records).
[2025-10-24T21:08:06.755779] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data.
[2025-10-24T21:08:06.756149] [FATAL] [VALIDATOR ] SLNZ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:08:06.756256] [FATAL] [MAIN      ] SLNZ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:08:06.756319] [WARN ] [MAIN      ] SLNZ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:08:06.756381] [INFO ] [LOCAL     ] SLNZ: Starting deletion of primary data.
[2025-10-24T21:08:06.756494] [DEBUG] [LOCAL     ] SLNZ: No primary data file found to delete.
[2025-10-24T21:08:06.756565] [INFO ] [LOCAL     ] SLNZ: Starting deletion of derivative data.
[2025-10-24T21:08:06.756609] [DEBUG] [LOCAL     ] SLNZ: No derivative data file found to delete.
[2025-10-24T21:08:06.756686] [INFO ] [MAIN      ] Update Progress: 1928/2366 symbols completed. SLNZ took 24.4s. Estimated remaining: 56m 21s. Rate: 7.8 symbols/min
[2025-10-24T21:08:06.912112] [INFO ] [REMOTE    ] SLGN: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T21:08:06.958050] [INFO ] [REMOTE    ] SLGN: Full fetch complete (59135 records).
[2025-10-24T21:08:07.006226] [DEBUG] [VALIDATOR ] SLGN: Validating primary data.
[2025-10-24T21:08:07.009973] [INFO ] [MAIN      ] SLVM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:08:07.011235] [FATAL] [VALIDATOR ] SLGN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:08:07.011338] [FATAL] [MAIN      ] SLGN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:08:07.011551] [WARN ] [MAIN      ] SLGN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:08:07.011709] [INFO ] [LOCAL     ] SLGN: Starting deletion of primary data.
[2025-10-24T21:08:07.011852] [DEBUG] [LOCAL     ] SLGN: No primary data file found to delete.
[2025-10-24T21:08:07.011912] [INFO ] [LOCAL     ] SLGN: Starting deletion of derivative data.
[2025-10-24T21:08:07.012094] [DEBUG] [LOCAL     ] SLGN: Deleted derivative data file.
[2025-10-24T21:08:07.012221] [INFO ] [MAIN      ] Update Progress: 1929/2366 symbols completed. SLGN took 36.3s. Estimated remaining: 56m 12s. Rate: 7.8 symbols/min
[2025-10-24T21:08:07.209227] [INFO ] [MAIN      ] SM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:08:07.219088] [DEBUG] [LOCAL     ] SLVM: Loaded 27918 existing records from primary storage.
[2025-10-24T21:08:07.219533] [INFO ] [MAIN      ] SLVM: Loaded 27918 existing records.
[2025-10-24T21:08:07.352133] [INFO ] [REMOTE    ] SLG: Fetching primary data for 2025-10.
[2025-10-24T21:08:07.412214] [WARN ] [MAIN      ] SLVM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:08:07.412705] [INFO ] [MAIN      ] SLVM: Wiping existing primary data before full refresh.
[2025-10-24T21:08:07.412773] [INFO ] [LOCAL     ] SLVM: Starting deletion of primary data.
[2025-10-24T21:08:07.413149] [DEBUG] [LOCAL     ] SLVM: Deleted primary data file.
[2025-10-24T21:08:07.413219] [INFO ] [MAIN      ] SLVM: Starting full primary refresh.
[2025-10-24T21:08:07.614816] [DEBUG] [LOCAL     ] SM: Loaded 52743 existing records from primary storage.
[2025-10-24T21:08:07.627844] [INFO ] [MAIN      ] SM: Loaded 52743 existing records.
[2025-10-24T21:08:08.010585] [INFO ] [REMOTE    ] SLVM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:08:08.013938] [WARN ] [MAIN      ] SM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:08:08.014353] [INFO ] [MAIN      ] SM: Wiping existing primary data before full refresh.
[2025-10-24T21:08:08.014424] [INFO ] [LOCAL     ] SM: Starting deletion of primary data.
[2025-10-24T21:08:08.014995] [DEBUG] [LOCAL     ] SM: Deleted primary data file.
[2025-10-24T21:08:08.015052] [INFO ] [MAIN      ] SM: Starting full primary refresh.
[2025-10-24T21:08:08.152630] [INFO ] [REMOTE    ] SLVM: Fetching primary data for 2025-01.
[2025-10-24T21:08:08.373397] [INFO ] [REMOTE    ] SM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:08:08.785472] [INFO ] [REMOTE    ] SLG: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T21:08:08.798153] [INFO ] [REMOTE    ] SLG: Full fetch complete (64930 records).
[2025-10-24T21:08:08.798293] [DEBUG] [VALIDATOR ] SLG: Validating primary data.
[2025-10-24T21:08:08.799035] [FATAL] [VALIDATOR ] SLG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:08:08.799120] [FATAL] [MAIN      ] SLG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:08:08.799163] [WARN ] [MAIN      ] SLG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:08:08.799225] [INFO ] [LOCAL     ] SLG: Starting deletion of primary data.
[2025-10-24T21:08:08.799288] [DEBUG] [LOCAL     ] SLG: No primary data file found to delete.
[2025-10-24T21:08:08.799323] [INFO ] [LOCAL     ] SLG: Starting deletion of derivative data.
[2025-10-24T21:08:08.799469] [DEBUG] [LOCAL     ] SLG: Deleted derivative data file.
[2025-10-24T21:08:08.799692] [INFO ] [MAIN      ] Update Progress: 1930/2366 symbols completed. SLG took 42.5s. Estimated remaining: 56m 3s. Rate: 7.8 symbols/min
[2025-10-24T21:08:08.956232] [INFO ] [REMOTE    ] SLQT: Fetching primary data for 2025-07.
[2025-10-24T21:08:08.976547] [INFO ] [MAIN      ] SMA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:08:08.976837] [DEBUG] [LOCAL     ] SMA: No existing data file found in primary storage.
[2025-10-24T21:08:08.976885] [WARN ] [MAIN      ] SMA: No existing data found, performing full refresh instead.
[2025-10-24T21:08:08.976992] [INFO ] [MAIN      ] SMA: Wiping existing primary data before full refresh.
[2025-10-24T21:08:08.977041] [INFO ] [LOCAL     ] SMA: Starting deletion of primary data.
[2025-10-24T21:08:08.977082] [DEBUG] [LOCAL     ] SMA: No primary data file found to delete.
[2025-10-24T21:08:08.977114] [INFO ] [MAIN      ] SMA: Starting full primary refresh.
[2025-10-24T21:08:09.114877] [INFO ] [REMOTE    ] SLVM: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T21:08:09.359809] [INFO ] [REMOTE    ] SMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:08:09.747718] [INFO ] [REMOTE    ] SMA: Fetching primary data for 2025-01.
[2025-10-24T21:08:10.056959] [DEBUG] [REMOTE    ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:08:10.057259] [WARN ] [REMOTE    ] SMA: No data returned for month 2025-01
[2025-10-24T21:08:10.057368] [FATAL] [REMOTE    ] SMA: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:08:10.057489] [FATAL] [MAIN      ] SMA: Failed to fetch primary data.
[2025-10-24T21:08:10.057565] [WARN ] [MAIN      ] SMA: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:08:10.057677] [INFO ] [LOCAL     ] SMA: Starting deletion of primary data.
[2025-10-24T21:08:10.057757] [DEBUG] [LOCAL     ] SMA: No primary data file found to delete.
[2025-10-24T21:08:10.057797] [INFO ] [LOCAL     ] SMA: Starting deletion of derivative data.
[2025-10-24T21:08:10.057836] [DEBUG] [LOCAL     ] SMA: No derivative data file found to delete.
[2025-10-24T21:08:10.057882] [INFO ] [MAIN      ] Update Progress: 1931/2366 symbols completed. SMA took 1.3s. Estimated remaining: 55m 54s. Rate: 7.8 symbols/min
[2025-10-24T21:08:10.198208] [INFO ] [REMOTE    ] SLQT: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T21:08:10.276878] [INFO ] [MAIN      ] SMBK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:08:10.286844] [DEBUG] [LOCAL     ] SMBK: Loaded 8331 existing records from primary storage.
[2025-10-24T21:08:10.287071] [INFO ] [MAIN      ] SMBK: Loaded 8331 existing records.
[2025-10-24T21:08:10.467896] [WARN ] [MAIN      ] SMBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:08:10.468128] [INFO ] [MAIN      ] SMBK: Wiping existing primary data before full refresh.
[2025-10-24T21:08:10.468176] [INFO ] [LOCAL     ] SMBK: Starting deletion of primary data.
[2025-10-24T21:08:10.468357] [DEBUG] [LOCAL     ] SMBK: Deleted primary data file.
[2025-10-24T21:08:10.468414] [INFO ] [MAIN      ] SMBK: Starting full primary refresh.
[2025-10-24T21:08:10.552773] [INFO ] [REMOTE    ] SLQT: Fetching primary data for 2025-08.
[2025-10-24T21:08:10.821252] [INFO ] [REMOTE    ] SMBK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:08:11.353530] [INFO ] [REMOTE    ] SM: Fetching primary data for 2025-01.
[2025-10-24T21:08:11.361896] [INFO ] [REMOTE    ] SLQT: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T21:08:12.147718] [INFO ] [REMOTE    ] SLQT: Fetching primary data for 2025-09.
[2025-10-24T21:08:12.810177] [INFO ] [REMOTE    ] SM: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T21:08:12.859207] [INFO ] [REMOTE    ] SLQT: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T21:08:12.947639] [INFO ] [REMOTE    ] SLQT: Fetching primary data for 2025-10.
[2025-10-24T21:08:13.659129] [INFO ] [REMOTE    ] SLQT: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T21:08:13.666711] [INFO ] [REMOTE    ] SLQT: Full fetch complete (63427 records).
[2025-10-24T21:08:13.666837] [DEBUG] [VALIDATOR ] SLQT: Validating primary data.
[2025-10-24T21:08:13.667571] [FATAL] [VALIDATOR ] SLQT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:08:13.667679] [FATAL] [MAIN      ] SLQT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:08:13.667743] [WARN ] [MAIN      ] SLQT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:08:13.667814] [INFO ] [LOCAL     ] SLQT: Starting deletion of primary data.
[2025-10-24T21:08:13.667879] [DEBUG] [LOCAL     ] SLQT: No primary data file found to delete.
[2025-10-24T21:08:13.667915] [INFO ] [LOCAL     ] SLQT: Starting deletion of derivative data.
[2025-10-24T21:08:13.668090] [DEBUG] [LOCAL     ] SLQT: Deleted derivative data file.
[2025-10-24T21:08:13.668631] [INFO ] [MAIN      ] Update Progress: 1932/2366 symbols completed. SLQT took 22.4s. Estimated remaining: 55m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:08:13.752912] [INFO ] [REMOTE    ] SM: Fetching primary data for 2025-02.
[2025-10-24T21:08:13.838356] [INFO ] [MAIN      ] SMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:08:13.850803] [DEBUG] [LOCAL     ] SMC: Loaded 10961 existing records from primary storage.
[2025-10-24T21:08:13.851068] [INFO ] [MAIN      ] SMC: Loaded 10961 existing records.
[2025-10-24T21:08:14.027196] [WARN ] [MAIN      ] SMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:08:14.027497] [INFO ] [MAIN      ] SMC: Wiping existing primary data before full refresh.
[2025-10-24T21:08:14.027549] [INFO ] [LOCAL     ] SMC: Starting deletion of primary data.
[2025-10-24T21:08:14.027829] [DEBUG] [LOCAL     ] SMC: Deleted primary data file.
[2025-10-24T21:08:14.027886] [INFO ] [MAIN      ] SMC: Starting full primary refresh.
[2025-10-24T21:08:14.377187] [INFO ] [REMOTE    ] SMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:08:14.547615] [INFO ] [REMOTE    ] SMC: Fetching primary data for 2025-01.
[2025-10-24T21:08:14.633549] [INFO ] [REMOTE    ] SM: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T21:08:14.723165] [INFO ] [REMOTE    ] SMC: Incremental fetch complete for 2025-01 (0.18 seconds).
[2025-10-24T21:08:15.347679] [INFO ] [REMOTE    ] SMC: Fetching primary data for 2025-02.
[2025-10-24T21:08:16.077902] [INFO ] [REMOTE    ] SMC: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T21:08:16.147670] [INFO ] [REMOTE    ] SM: Fetching primary data for 2025-03.
[2025-10-24T21:08:16.947695] [INFO ] [REMOTE    ] SLVM: Fetching primary data for 2025-02.
[2025-10-24T21:08:17.081022] [INFO ] [REMOTE    ] SM: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T21:08:17.570136] [INFO ] [REMOTE    ] SLVM: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T21:08:17.747716] [INFO ] [REMOTE    ] SM: Fetching primary data for 2025-04.
[2025-10-24T21:08:18.542277] [INFO ] [REMOTE    ] SM: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T21:08:18.552937] [INFO ] [REMOTE    ] SMBK: Fetching primary data for 2025-01.
[2025-10-24T21:08:19.034895] [INFO ] [REMOTE    ] SMBK: Incremental fetch complete for 2025-01 (0.48 seconds).
[2025-10-24T21:08:19.347694] [INFO ] [REMOTE    ] SM: Fetching primary data for 2025-05.
[2025-10-24T21:08:20.147719] [INFO ] [REMOTE    ] SMBK: Fetching primary data for 2025-02.
[2025-10-24T21:08:20.519183] [INFO ] [REMOTE    ] SM: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T21:08:20.566237] [INFO ] [REMOTE    ] SMBK: Incremental fetch complete for 2025-02 (0.42 seconds).
[2025-10-24T21:08:20.947710] [INFO ] [REMOTE    ] SMBK: Fetching primary data for 2025-03.
[2025-10-24T21:08:21.613301] [INFO ] [REMOTE    ] SMBK: Incremental fetch complete for 2025-03 (0.67 seconds).
[2025-10-24T21:08:21.747702] [INFO ] [REMOTE    ] SM: Fetching primary data for 2025-06.
[2025-10-24T21:08:22.550305] [INFO ] [REMOTE    ] SLVM: Fetching primary data for 2025-03.
[2025-10-24T21:08:22.557474] [INFO ] [REMOTE    ] SM: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T21:08:23.347709] [INFO ] [REMOTE    ] SM: Fetching primary data for 2025-07.
[2025-10-24T21:08:23.595417] [INFO ] [REMOTE    ] SLVM: Incremental fetch complete for 2025-03 (1.05 seconds).
[2025-10-24T21:08:24.147695] [INFO ] [REMOTE    ] SMBK: Fetching primary data for 2025-04.
[2025-10-24T21:08:24.600109] [INFO ] [REMOTE    ] SM: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T21:08:24.947672] [INFO ] [REMOTE    ] SM: Fetching primary data for 2025-08.
[2025-10-24T21:08:25.047043] [INFO ] [REMOTE    ] SMBK: Incremental fetch complete for 2025-04 (0.90 seconds).
[2025-10-24T21:08:25.662984] [INFO ] [REMOTE    ] SM: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T21:08:25.747691] [INFO ] [REMOTE    ] SM: Fetching primary data for 2025-09.
[2025-10-24T21:08:26.539793] [INFO ] [REMOTE    ] SM: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T21:08:26.550809] [INFO ] [REMOTE    ] SLVM: Fetching primary data for 2025-04.
[2025-10-24T21:08:27.347702] [INFO ] [REMOTE    ] SMC: Fetching primary data for 2025-03.
[2025-10-24T21:08:27.749869] [INFO ] [REMOTE    ] SLVM: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T21:08:28.147722] [INFO ] [REMOTE    ] SLVM: Fetching primary data for 2025-05.
[2025-10-24T21:08:28.273704] [INFO ] [REMOTE    ] SMC: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T21:08:28.764683] [INFO ] [REMOTE    ] SLVM: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T21:08:28.947673] [INFO ] [REMOTE    ] SMC: Fetching primary data for 2025-04.
[2025-10-24T21:08:29.508907] [INFO ] [REMOTE    ] SMC: Incremental fetch complete for 2025-04 (0.56 seconds).
[2025-10-24T21:08:29.747720] [INFO ] [REMOTE    ] SM: Fetching primary data for 2025-10.
[2025-10-24T21:08:30.547745] [INFO ] [REMOTE    ] SMC: Fetching primary data for 2025-05.
[2025-10-24T21:08:30.823066] [INFO ] [REMOTE    ] SM: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T21:08:30.835909] [INFO ] [REMOTE    ] SM: Full fetch complete (75557 records).
[2025-10-24T21:08:30.836136] [DEBUG] [VALIDATOR ] SM: Validating primary data.
[2025-10-24T21:08:30.837857] [FATAL] [VALIDATOR ] SM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:08:30.837947] [FATAL] [MAIN      ] SM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:08:30.837991] [WARN ] [MAIN      ] SM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:08:30.838029] [INFO ] [LOCAL     ] SM: Starting deletion of primary data.
[2025-10-24T21:08:30.838087] [DEBUG] [LOCAL     ] SM: No primary data file found to delete.
[2025-10-24T21:08:30.838121] [INFO ] [LOCAL     ] SM: Starting deletion of derivative data.
[2025-10-24T21:08:30.838299] [DEBUG] [LOCAL     ] SM: Deleted derivative data file.
[2025-10-24T21:08:30.838676] [INFO ] [MAIN      ] Update Progress: 1933/2366 symbols completed. SM took 23.8s. Estimated remaining: 55m 39s. Rate: 7.8 symbols/min
[2025-10-24T21:08:31.030308] [INFO ] [MAIN      ] SMFG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:08:31.039190] [INFO ] [REMOTE    ] SMC: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T21:08:31.084234] [DEBUG] [LOCAL     ] SMFG: Loaded 48644 existing records from primary storage.
[2025-10-24T21:08:31.084556] [INFO ] [MAIN      ] SMFG: Loaded 48644 existing records.
[2025-10-24T21:08:31.262233] [WARN ] [MAIN      ] SMFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:08:31.262420] [INFO ] [MAIN      ] SMFG: Wiping existing primary data before full refresh.
[2025-10-24T21:08:31.262466] [INFO ] [LOCAL     ] SMFG: Starting deletion of primary data.
[2025-10-24T21:08:31.262937] [DEBUG] [LOCAL     ] SMFG: Deleted primary data file.
[2025-10-24T21:08:31.262994] [INFO ] [MAIN      ] SMFG: Starting full primary refresh.
[2025-10-24T21:08:31.352878] [INFO ] [REMOTE    ] SLVM: Fetching primary data for 2025-06.
[2025-10-24T21:08:31.620056] [INFO ] [REMOTE    ] SMFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:08:32.147729] [INFO ] [REMOTE    ] SMC: Fetching primary data for 2025-06.
[2025-10-24T21:08:32.455166] [INFO ] [REMOTE    ] SLVM: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T21:08:32.555927] [INFO ] [REMOTE    ] SMC: Incremental fetch complete for 2025-06 (0.41 seconds).
[2025-10-24T21:08:32.947731] [INFO ] [REMOTE    ] SMBK: Fetching primary data for 2025-05.
[2025-10-24T21:08:33.592253] [INFO ] [REMOTE    ] SMBK: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T21:08:33.747704] [INFO ] [REMOTE    ] SMBK: Fetching primary data for 2025-06.
[2025-10-24T21:08:34.215537] [INFO ] [REMOTE    ] SMBK: Incremental fetch complete for 2025-06 (0.47 seconds).
[2025-10-24T21:08:34.547731] [INFO ] [REMOTE    ] SMFG: Fetching primary data for 2025-01.
[2025-10-24T21:08:35.285177] [INFO ] [REMOTE    ] SMFG: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T21:08:35.347619] [INFO ] [REMOTE    ] SMFG: Fetching primary data for 2025-02.
[2025-10-24T21:08:36.147675] [INFO ] [REMOTE    ] SMC: Fetching primary data for 2025-07.
[2025-10-24T21:08:36.383383] [INFO ] [REMOTE    ] SMFG: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T21:08:36.943386] [INFO ] [REMOTE    ] SMC: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T21:08:36.947597] [INFO ] [REMOTE    ] SMC: Fetching primary data for 2025-08.
[2025-10-24T21:08:37.684334] [INFO ] [REMOTE    ] SMC: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T21:08:37.747692] [INFO ] [REMOTE    ] SMC: Fetching primary data for 2025-09.
[2025-10-24T21:08:38.217046] [INFO ] [REMOTE    ] SMC: Incremental fetch complete for 2025-09 (0.47 seconds).
[2025-10-24T21:08:38.547707] [INFO ] [REMOTE    ] SMC: Fetching primary data for 2025-10.
[2025-10-24T21:08:39.329887] [INFO ] [REMOTE    ] SMC: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T21:08:39.332552] [INFO ] [REMOTE    ] SMC: Full fetch complete (16432 records).
[2025-10-24T21:08:39.332671] [DEBUG] [VALIDATOR ] SMC: Validating primary data.
[2025-10-24T21:08:39.333218] [FATAL] [VALIDATOR ] SMC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:08:39.333303] [FATAL] [MAIN      ] SMC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:08:39.333346] [WARN ] [MAIN      ] SMC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:08:39.333387] [INFO ] [LOCAL     ] SMC: Starting deletion of primary data.
[2025-10-24T21:08:39.333460] [DEBUG] [LOCAL     ] SMC: No primary data file found to delete.
[2025-10-24T21:08:39.333517] [INFO ] [LOCAL     ] SMC: Starting deletion of derivative data.
[2025-10-24T21:08:39.333792] [DEBUG] [LOCAL     ] SMC: Deleted derivative data file.
[2025-10-24T21:08:39.333906] [INFO ] [MAIN      ] Update Progress: 1934/2366 symbols completed. SMC took 25.7s. Estimated remaining: 55m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:08:39.356417] [INFO ] [REMOTE    ] SLVM: Fetching primary data for 2025-07.
[2025-10-24T21:08:39.552301] [INFO ] [MAIN      ] SMG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:08:39.605054] [DEBUG] [LOCAL     ] SMG: Loaded 42957 existing records from primary storage.
[2025-10-24T21:08:39.605538] [INFO ] [MAIN      ] SMG: Loaded 42957 existing records.
[2025-10-24T21:08:39.887176] [WARN ] [MAIN      ] SMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:08:39.887752] [INFO ] [MAIN      ] SMG: Wiping existing primary data before full refresh.
[2025-10-24T21:08:39.887818] [INFO ] [LOCAL     ] SMG: Starting deletion of primary data.
[2025-10-24T21:08:39.888280] [DEBUG] [LOCAL     ] SMG: Deleted primary data file.
[2025-10-24T21:08:39.888340] [INFO ] [MAIN      ] SMG: Starting full primary refresh.
[2025-10-24T21:08:40.157147] [INFO ] [REMOTE    ] SMBK: Fetching primary data for 2025-07.
[2025-10-24T21:08:40.272469] [INFO ] [REMOTE    ] SLVM: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T21:08:40.470502] [INFO ] [REMOTE    ] SMG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:08:40.948191] [INFO ] [REMOTE    ] SMG: Fetching primary data for 2025-01.
[2025-10-24T21:08:40.951606] [INFO ] [REMOTE    ] SMBK: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T21:08:41.747709] [INFO ] [REMOTE    ] SMBK: Fetching primary data for 2025-08.
[2025-10-24T21:08:41.784834] [INFO ] [REMOTE    ] SMG: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T21:08:42.243605] [INFO ] [REMOTE    ] SMBK: Incremental fetch complete for 2025-08 (0.50 seconds).
[2025-10-24T21:08:42.547716] [INFO ] [REMOTE    ] SMBK: Fetching primary data for 2025-09.
[2025-10-24T21:08:43.013182] [INFO ] [REMOTE    ] SMBK: Incremental fetch complete for 2025-09 (0.47 seconds).
[2025-10-24T21:08:43.347743] [INFO ] [REMOTE    ] SMFG: Fetching primary data for 2025-03.
[2025-10-24T21:08:44.147723] [INFO ] [REMOTE    ] SMBK: Fetching primary data for 2025-10.
[2025-10-24T21:08:44.352491] [INFO ] [REMOTE    ] SMFG: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T21:08:44.791422] [INFO ] [REMOTE    ] SMBK: Incremental fetch complete for 2025-10 (0.64 seconds).
[2025-10-24T21:08:44.794445] [INFO ] [REMOTE    ] SMBK: Full fetch complete (11804 records).
[2025-10-24T21:08:44.794678] [DEBUG] [VALIDATOR ] SMBK: Validating primary data.
[2025-10-24T21:08:44.795294] [FATAL] [VALIDATOR ] SMBK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:08:44.795420] [FATAL] [MAIN      ] SMBK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:08:44.795498] [WARN ] [MAIN      ] SMBK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:08:44.795576] [INFO ] [LOCAL     ] SMBK: Starting deletion of primary data.
[2025-10-24T21:08:44.795675] [DEBUG] [LOCAL     ] SMBK: No primary data file found to delete.
[2025-10-24T21:08:44.795736] [INFO ] [LOCAL     ] SMBK: Starting deletion of derivative data.
[2025-10-24T21:08:44.795950] [DEBUG] [LOCAL     ] SMBK: Deleted derivative data file.
[2025-10-24T21:08:44.796051] [INFO ] [MAIN      ] Update Progress: 1935/2366 symbols completed. SMBK took 34.7s. Estimated remaining: 55m 24s. Rate: 7.8 symbols/min
[2025-10-24T21:08:44.972210] [INFO ] [REMOTE    ] SLVM: Fetching primary data for 2025-08.
[2025-10-24T21:08:44.975957] [INFO ] [MAIN      ] SMHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:08:44.993631] [DEBUG] [LOCAL     ] SMHI: Loaded 12718 existing records from primary storage.
[2025-10-24T21:08:44.994015] [INFO ] [MAIN      ] SMHI: Loaded 12718 existing records.
[2025-10-24T21:08:45.176109] [WARN ] [MAIN      ] SMHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:08:45.176348] [INFO ] [MAIN      ] SMHI: Wiping existing primary data before full refresh.
[2025-10-24T21:08:45.176397] [INFO ] [LOCAL     ] SMHI: Starting deletion of primary data.
[2025-10-24T21:08:45.176557] [DEBUG] [LOCAL     ] SMHI: Deleted primary data file.
[2025-10-24T21:08:45.176595] [INFO ] [MAIN      ] SMHI: Starting full primary refresh.
[2025-10-24T21:08:45.528823] [INFO ] [REMOTE    ] SMHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:08:45.683814] [INFO ] [REMOTE    ] SLVM: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T21:08:45.747701] [INFO ] [REMOTE    ] SMG: Fetching primary data for 2025-02.
[2025-10-24T21:08:46.496552] [INFO ] [REMOTE    ] SMG: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T21:08:46.547722] [INFO ] [REMOTE    ] SLVM: Fetching primary data for 2025-09.
[2025-10-24T21:08:47.233493] [INFO ] [REMOTE    ] SLVM: Incremental fetch complete for 2025-09 (0.69 seconds).
[2025-10-24T21:08:47.347698] [INFO ] [REMOTE    ] SLVM: Fetching primary data for 2025-10.
[2025-10-24T21:08:47.940137] [INFO ] [REMOTE    ] SLVM: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T21:08:47.945424] [INFO ] [REMOTE    ] SLVM: Full fetch complete (39937 records).
[2025-10-24T21:08:47.945567] [DEBUG] [VALIDATOR ] SLVM: Validating primary data.
[2025-10-24T21:08:47.946173] [FATAL] [VALIDATOR ] SLVM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:08:47.946260] [FATAL] [MAIN      ] SLVM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:08:47.946303] [WARN ] [MAIN      ] SLVM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:08:47.946367] [INFO ] [LOCAL     ] SLVM: Starting deletion of primary data.
[2025-10-24T21:08:47.946433] [DEBUG] [LOCAL     ] SLVM: No primary data file found to delete.
[2025-10-24T21:08:47.946467] [INFO ] [LOCAL     ] SLVM: Starting deletion of derivative data.
[2025-10-24T21:08:47.946709] [DEBUG] [LOCAL     ] SLVM: Deleted derivative data file.
[2025-10-24T21:08:47.946797] [INFO ] [MAIN      ] Update Progress: 1936/2366 symbols completed. SLVM took 41.2s. Estimated remaining: 55m 15s. Rate: 7.8 symbols/min
[2025-10-24T21:08:48.116360] [INFO ] [MAIN      ] SMP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:08:48.135009] [DEBUG] [LOCAL     ] SMP: Loaded 18750 existing records from primary storage.
[2025-10-24T21:08:48.135264] [INFO ] [MAIN      ] SMP: Loaded 18750 existing records.
[2025-10-24T21:08:48.156344] [INFO ] [REMOTE    ] SMG: Fetching primary data for 2025-03.
[2025-10-24T21:08:48.320733] [WARN ] [MAIN      ] SMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:08:48.320960] [INFO ] [MAIN      ] SMP: Wiping existing primary data before full refresh.
[2025-10-24T21:08:48.321006] [INFO ] [LOCAL     ] SMP: Starting deletion of primary data.
[2025-10-24T21:08:48.321281] [DEBUG] [LOCAL     ] SMP: Deleted primary data file.
[2025-10-24T21:08:48.321337] [INFO ] [MAIN      ] SMP: Starting full primary refresh.
[2025-10-24T21:08:48.698900] [INFO ] [REMOTE    ] SMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:08:48.947671] [INFO ] [REMOTE    ] SMP: Fetching primary data for 2025-01.
[2025-10-24T21:08:48.986167] [INFO ] [REMOTE    ] SMG: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T21:08:49.655818] [INFO ] [REMOTE    ] SMP: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T21:08:49.747698] [INFO ] [REMOTE    ] SMG: Fetching primary data for 2025-04.
[2025-10-24T21:08:50.547667] [INFO ] [REMOTE    ] SMFG: Fetching primary data for 2025-04.
[2025-10-24T21:08:51.234811] [INFO ] [REMOTE    ] SMG: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T21:08:51.347619] [INFO ] [REMOTE    ] SMG: Fetching primary data for 2025-05.
[2025-10-24T21:08:51.732314] [INFO ] [REMOTE    ] SMFG: Incremental fetch complete for 2025-04 (1.18 seconds).
[2025-10-24T21:08:52.147721] [INFO ] [REMOTE    ] SMHI: Fetching primary data for 2025-01.
[2025-10-24T21:08:52.732092] [INFO ] [REMOTE    ] SMG: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T21:08:52.947672] [INFO ] [REMOTE    ] SMP: Fetching primary data for 2025-02.
[2025-10-24T21:08:52.974274] [INFO ] [REMOTE    ] SMHI: Incremental fetch complete for 2025-01 (0.83 seconds).
[2025-10-24T21:08:53.546545] [INFO ] [REMOTE    ] SMP: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T21:08:53.747733] [INFO ] [REMOTE    ] SMHI: Fetching primary data for 2025-02.
[2025-10-24T21:08:54.547713] [INFO ] [REMOTE    ] SMP: Fetching primary data for 2025-03.
[2025-10-24T21:08:54.759612] [INFO ] [REMOTE    ] SMHI: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T21:08:55.144308] [INFO ] [REMOTE    ] SMP: Incremental fetch complete for 2025-03 (0.60 seconds).
[2025-10-24T21:08:55.347676] [INFO ] [REMOTE    ] SMHI: Fetching primary data for 2025-03.
[2025-10-24T21:08:56.147737] [INFO ] [REMOTE    ] SMFG: Fetching primary data for 2025-05.
[2025-10-24T21:08:56.184934] [INFO ] [REMOTE    ] SMHI: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T21:08:56.947710] [INFO ] [REMOTE    ] SMG: Fetching primary data for 2025-06.
[2025-10-24T21:08:57.311770] [INFO ] [REMOTE    ] SMFG: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T21:08:57.693360] [INFO ] [REMOTE    ] SMG: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T21:08:57.747611] [INFO ] [REMOTE    ] SMP: Fetching primary data for 2025-04.
[2025-10-24T21:08:58.552712] [INFO ] [REMOTE    ] SMG: Fetching primary data for 2025-07.
[2025-10-24T21:08:58.561168] [INFO ] [REMOTE    ] SMP: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T21:08:59.347706] [INFO ] [REMOTE    ] SMHI: Fetching primary data for 2025-04.
[2025-10-24T21:08:59.517957] [INFO ] [REMOTE    ] SMG: Incremental fetch complete for 2025-07 (0.97 seconds).
[2025-10-24T21:09:00.147720] [INFO ] [REMOTE    ] SMP: Fetching primary data for 2025-05.
[2025-10-24T21:09:00.173937] [INFO ] [REMOTE    ] SMHI: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T21:09:00.947629] [INFO ] [REMOTE    ] SMFG: Fetching primary data for 2025-06.
[2025-10-24T21:09:01.266750] [INFO ] [REMOTE    ] SMP: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T21:09:01.747731] [INFO ] [REMOTE    ] SMG: Fetching primary data for 2025-08.
[2025-10-24T21:09:02.057735] [INFO ] [REMOTE    ] SMFG: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T21:09:02.463377] [INFO ] [REMOTE    ] SMG: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T21:09:02.547759] [INFO ] [REMOTE    ] SMFG: Fetching primary data for 2025-07.
[2025-10-24T21:09:03.332470] [INFO ] [REMOTE    ] SMFG: Incremental fetch complete for 2025-07 (0.78 seconds).
[2025-10-24T21:09:03.347606] [INFO ] [REMOTE    ] SMFG: Fetching primary data for 2025-08.
[2025-10-24T21:09:04.094736] [INFO ] [REMOTE    ] SMFG: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T21:09:04.147617] [INFO ] [REMOTE    ] SMFG: Fetching primary data for 2025-09.
[2025-10-24T21:09:04.947662] [INFO ] [REMOTE    ] SMG: Fetching primary data for 2025-09.
[2025-10-24T21:09:05.208095] [INFO ] [REMOTE    ] SMFG: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T21:09:05.720998] [INFO ] [REMOTE    ] SMG: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T21:09:05.747609] [INFO ] [REMOTE    ] SMFG: Fetching primary data for 2025-10.
[2025-10-24T21:09:06.476602] [INFO ] [REMOTE    ] SMFG: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:09:06.486351] [INFO ] [REMOTE    ] SMFG: Full fetch complete (68981 records).
[2025-10-24T21:09:06.486519] [DEBUG] [VALIDATOR ] SMFG: Validating primary data.
[2025-10-24T21:09:06.487604] [FATAL] [VALIDATOR ] SMFG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:09:06.487743] [FATAL] [MAIN      ] SMFG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:09:06.487808] [WARN ] [MAIN      ] SMFG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:09:06.487884] [INFO ] [LOCAL     ] SMFG: Starting deletion of primary data.
[2025-10-24T21:09:06.487948] [DEBUG] [LOCAL     ] SMFG: No primary data file found to delete.
[2025-10-24T21:09:06.487982] [INFO ] [LOCAL     ] SMFG: Starting deletion of derivative data.
[2025-10-24T21:09:06.488137] [DEBUG] [LOCAL     ] SMFG: Deleted derivative data file.
[2025-10-24T21:09:06.488211] [INFO ] [MAIN      ] Update Progress: 1937/2366 symbols completed. SMFG took 35.6s. Estimated remaining: 55m 10s. Rate: 7.8 symbols/min
[2025-10-24T21:09:06.552864] [INFO ] [REMOTE    ] SMG: Fetching primary data for 2025-10.
[2025-10-24T21:09:06.659505] [INFO ] [MAIN      ] SMR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:09:06.708357] [DEBUG] [LOCAL     ] SMR: Loaded 54189 existing records from primary storage.
[2025-10-24T21:09:06.708708] [INFO ] [MAIN      ] SMR: Loaded 54189 existing records.
[2025-10-24T21:09:06.884289] [WARN ] [MAIN      ] SMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:09:06.884436] [INFO ] [MAIN      ] SMR: Wiping existing primary data before full refresh.
[2025-10-24T21:09:06.884477] [INFO ] [LOCAL     ] SMR: Starting deletion of primary data.
[2025-10-24T21:09:06.884782] [DEBUG] [LOCAL     ] SMR: Deleted primary data file.
[2025-10-24T21:09:06.884838] [INFO ] [MAIN      ] SMR: Starting full primary refresh.
[2025-10-24T21:09:07.256252] [INFO ] [REMOTE    ] SMR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:09:07.347608] [INFO ] [REMOTE    ] SMR: Fetching primary data for 2025-01.
[2025-10-24T21:09:07.416427] [INFO ] [REMOTE    ] SMG: Incremental fetch complete for 2025-10 (0.86 seconds).
[2025-10-24T21:09:07.423319] [INFO ] [REMOTE    ] SMG: Full fetch complete (62464 records).
[2025-10-24T21:09:07.423470] [DEBUG] [VALIDATOR ] SMG: Validating primary data.
[2025-10-24T21:09:07.424240] [FATAL] [VALIDATOR ] SMG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:09:07.424385] [FATAL] [MAIN      ] SMG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:09:07.424429] [WARN ] [MAIN      ] SMG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:09:07.424466] [INFO ] [LOCAL     ] SMG: Starting deletion of primary data.
[2025-10-24T21:09:07.424521] [DEBUG] [LOCAL     ] SMG: No primary data file found to delete.
[2025-10-24T21:09:07.424555] [INFO ] [LOCAL     ] SMG: Starting deletion of derivative data.
[2025-10-24T21:09:07.424805] [DEBUG] [LOCAL     ] SMG: Deleted derivative data file.
[2025-10-24T21:09:07.424898] [INFO ] [MAIN      ] Update Progress: 1938/2366 symbols completed. SMG took 28.1s. Estimated remaining: 55m 0s. Rate: 7.8 symbols/min
[2025-10-24T21:09:07.602910] [INFO ] [MAIN      ] SMRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:09:07.642372] [DEBUG] [LOCAL     ] SMRT: Loaded 44050 existing records from primary storage.
[2025-10-24T21:09:07.642698] [INFO ] [MAIN      ] SMRT: Loaded 44050 existing records.
[2025-10-24T21:09:07.840919] [WARN ] [MAIN      ] SMRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:09:07.841166] [INFO ] [MAIN      ] SMRT: Wiping existing primary data before full refresh.
[2025-10-24T21:09:07.841213] [INFO ] [LOCAL     ] SMRT: Starting deletion of primary data.
[2025-10-24T21:09:07.841390] [DEBUG] [LOCAL     ] SMRT: Deleted primary data file.
[2025-10-24T21:09:07.841427] [INFO ] [MAIN      ] SMRT: Starting full primary refresh.
[2025-10-24T21:09:08.165373] [INFO ] [REMOTE    ] SMP: Fetching primary data for 2025-06.
[2025-10-24T21:09:08.201415] [INFO ] [REMOTE    ] SMRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:09:08.331595] [INFO ] [REMOTE    ] SMR: Incremental fetch complete for 2025-01 (0.98 seconds).
[2025-10-24T21:09:08.947635] [INFO ] [REMOTE    ] SMRT: Fetching primary data for 2025-01.
[2025-10-24T21:09:09.227312] [INFO ] [REMOTE    ] SMP: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T21:09:09.747699] [INFO ] [REMOTE    ] SMP: Fetching primary data for 2025-07.
[2025-10-24T21:09:09.865352] [INFO ] [REMOTE    ] SMRT: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T21:09:10.547703] [INFO ] [REMOTE    ] SMHI: Fetching primary data for 2025-05.
[2025-10-24T21:09:10.567740] [INFO ] [REMOTE    ] SMP: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T21:09:11.347704] [INFO ] [REMOTE    ] SMRT: Fetching primary data for 2025-02.
[2025-10-24T21:09:11.394590] [INFO ] [REMOTE    ] SMHI: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T21:09:12.147625] [INFO ] [REMOTE    ] SMP: Fetching primary data for 2025-08.
[2025-10-24T21:09:12.392256] [INFO ] [REMOTE    ] SMRT: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T21:09:12.865140] [INFO ] [REMOTE    ] SMP: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T21:09:12.947619] [INFO ] [REMOTE    ] SMRT: Fetching primary data for 2025-03.
[2025-10-24T21:09:13.747625] [INFO ] [REMOTE    ] SMP: Fetching primary data for 2025-09.
[2025-10-24T21:09:13.990920] [INFO ] [REMOTE    ] SMRT: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T21:09:14.453907] [INFO ] [REMOTE    ] SMP: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T21:09:14.547699] [INFO ] [REMOTE    ] SMR: Fetching primary data for 2025-02.
[2025-10-24T21:09:15.347699] [INFO ] [REMOTE    ] SMP: Fetching primary data for 2025-10.
[2025-10-24T21:09:15.436157] [INFO ] [REMOTE    ] SMR: Incremental fetch complete for 2025-02 (0.89 seconds).
[2025-10-24T21:09:15.838256] [INFO ] [REMOTE    ] SMP: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T21:09:15.841451] [INFO ] [REMOTE    ] SMP: Full fetch complete (26481 records).
[2025-10-24T21:09:15.841528] [DEBUG] [VALIDATOR ] SMP: Validating primary data.
[2025-10-24T21:09:15.842004] [FATAL] [VALIDATOR ] SMP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:09:15.842090] [FATAL] [MAIN      ] SMP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:09:15.842131] [WARN ] [MAIN      ] SMP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:09:15.842195] [INFO ] [LOCAL     ] SMP: Starting deletion of primary data.
[2025-10-24T21:09:15.842256] [DEBUG] [LOCAL     ] SMP: No primary data file found to delete.
[2025-10-24T21:09:15.842291] [INFO ] [LOCAL     ] SMP: Starting deletion of derivative data.
[2025-10-24T21:09:15.842454] [DEBUG] [LOCAL     ] SMP: Deleted derivative data file.
[2025-10-24T21:09:15.842539] [INFO ] [MAIN      ] Update Progress: 1939/2366 symbols completed. SMP took 27.9s. Estimated remaining: 54m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:09:16.014952] [INFO ] [MAIN      ] SMWB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:09:16.044630] [DEBUG] [LOCAL     ] SMWB: Loaded 31720 existing records from primary storage.
[2025-10-24T21:09:16.044926] [INFO ] [MAIN      ] SMWB: Loaded 31720 existing records.
[2025-10-24T21:09:16.152881] [INFO ] [REMOTE    ] SMRT: Fetching primary data for 2025-04.
[2025-10-24T21:09:16.225602] [WARN ] [MAIN      ] SMWB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:09:16.225854] [INFO ] [MAIN      ] SMWB: Wiping existing primary data before full refresh.
[2025-10-24T21:09:16.225901] [INFO ] [LOCAL     ] SMWB: Starting deletion of primary data.
[2025-10-24T21:09:16.226116] [DEBUG] [LOCAL     ] SMWB: Deleted primary data file.
[2025-10-24T21:09:16.226154] [INFO ] [MAIN      ] SMWB: Starting full primary refresh.
[2025-10-24T21:09:16.579871] [INFO ] [REMOTE    ] SMWB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:09:16.953297] [INFO ] [REMOTE    ] SMWB: Fetching primary data for 2025-01.
[2025-10-24T21:09:16.965353] [INFO ] [REMOTE    ] SMRT: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T21:09:17.747682] [INFO ] [REMOTE    ] SMHI: Fetching primary data for 2025-06.
[2025-10-24T21:09:18.034577] [INFO ] [REMOTE    ] SMWB: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T21:09:18.436737] [INFO ] [REMOTE    ] SMHI: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T21:09:18.547627] [INFO ] [REMOTE    ] SMHI: Fetching primary data for 2025-07.
[2025-10-24T21:09:19.220448] [INFO ] [REMOTE    ] SMHI: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T21:09:19.347723] [INFO ] [REMOTE    ] SMWB: Fetching primary data for 2025-02.
[2025-10-24T21:09:20.058799] [INFO ] [REMOTE    ] SMWB: Incremental fetch complete for 2025-02 (0.71 seconds).
[2025-10-24T21:09:20.147682] [INFO ] [REMOTE    ] SMRT: Fetching primary data for 2025-05.
[2025-10-24T21:09:20.947614] [INFO ] [REMOTE    ] SMHI: Fetching primary data for 2025-08.
[2025-10-24T21:09:21.132324] [INFO ] [REMOTE    ] SMRT: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T21:09:21.747619] [INFO ] [REMOTE    ] SMR: Fetching primary data for 2025-03.
[2025-10-24T21:09:22.022127] [INFO ] [REMOTE    ] SMHI: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T21:09:22.547721] [INFO ] [REMOTE    ] SMRT: Fetching primary data for 2025-06.
[2025-10-24T21:09:22.749706] [INFO ] [REMOTE    ] SMR: Incremental fetch complete for 2025-03 (1.00 seconds).
[2025-10-24T21:09:23.171080] [INFO ] [REMOTE    ] SMRT: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T21:09:23.347630] [INFO ] [REMOTE    ] SMWB: Fetching primary data for 2025-03.
[2025-10-24T21:09:24.049891] [INFO ] [REMOTE    ] SMWB: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T21:09:24.147639] [INFO ] [REMOTE    ] SMWB: Fetching primary data for 2025-04.
[2025-10-24T21:09:24.844160] [INFO ] [REMOTE    ] SMWB: Incremental fetch complete for 2025-04 (0.70 seconds).
[2025-10-24T21:09:24.947630] [INFO ] [REMOTE    ] SMWB: Fetching primary data for 2025-05.
[2025-10-24T21:09:25.652065] [INFO ] [REMOTE    ] SMWB: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T21:09:25.747626] [INFO ] [REMOTE    ] SMRT: Fetching primary data for 2025-07.
[2025-10-24T21:09:26.547623] [INFO ] [REMOTE    ] SMR: Fetching primary data for 2025-04.
[2025-10-24T21:09:26.674625] [INFO ] [REMOTE    ] SMRT: Incremental fetch complete for 2025-07 (0.93 seconds).
[2025-10-24T21:09:27.347723] [INFO ] [REMOTE    ] SMWB: Fetching primary data for 2025-06.
[2025-10-24T21:09:27.804226] [INFO ] [REMOTE    ] SMR: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T21:09:28.147633] [INFO ] [REMOTE    ] SMRT: Fetching primary data for 2025-08.
[2025-10-24T21:09:28.652965] [INFO ] [REMOTE    ] SMWB: Incremental fetch complete for 2025-06 (1.31 seconds).
[2025-10-24T21:09:28.947717] [INFO ] [REMOTE    ] SMR: Fetching primary data for 2025-05.
[2025-10-24T21:09:29.219502] [INFO ] [REMOTE    ] SMRT: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T21:09:29.747691] [INFO ] [REMOTE    ] SMHI: Fetching primary data for 2025-09.
[2025-10-24T21:09:30.339510] [INFO ] [REMOTE    ] SMR: Incremental fetch complete for 2025-05 (1.39 seconds).
[2025-10-24T21:09:30.444208] [INFO ] [REMOTE    ] SMHI: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T21:09:30.547703] [INFO ] [REMOTE    ] SMR: Fetching primary data for 2025-06.
[2025-10-24T21:09:31.347691] [INFO ] [REMOTE    ] SMHI: Fetching primary data for 2025-10.
[2025-10-24T21:09:31.378952] [INFO ] [REMOTE    ] SMR: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T21:09:31.994834] [INFO ] [REMOTE    ] SMHI: Incremental fetch complete for 2025-10 (0.65 seconds).
[2025-10-24T21:09:31.996842] [INFO ] [REMOTE    ] SMHI: Full fetch complete (20952 records).
[2025-10-24T21:09:31.996915] [DEBUG] [VALIDATOR ] SMHI: Validating primary data.
[2025-10-24T21:09:31.997320] [FATAL] [VALIDATOR ] SMHI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:09:31.997446] [FATAL] [MAIN      ] SMHI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:09:31.997527] [WARN ] [MAIN      ] SMHI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:09:31.997619] [INFO ] [LOCAL     ] SMHI: Starting deletion of primary data.
[2025-10-24T21:09:31.997722] [DEBUG] [LOCAL     ] SMHI: No primary data file found to delete.
[2025-10-24T21:09:31.997767] [INFO ] [LOCAL     ] SMHI: Starting deletion of derivative data.
[2025-10-24T21:09:31.998140] [DEBUG] [LOCAL     ] SMHI: Deleted derivative data file.
[2025-10-24T21:09:31.998229] [INFO ] [MAIN      ] Update Progress: 1940/2366 symbols completed. SMHI took 47.2s. Estimated remaining: 54m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:09:32.152722] [INFO ] [REMOTE    ] SMRT: Fetching primary data for 2025-09.
[2025-10-24T21:09:32.186819] [INFO ] [MAIN      ] SN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:09:32.234329] [DEBUG] [LOCAL     ] SN: Loaded 50369 existing records from primary storage.
[2025-10-24T21:09:32.234690] [INFO ] [MAIN      ] SN: Loaded 50369 existing records.
[2025-10-24T21:09:32.414274] [WARN ] [MAIN      ] SN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:09:32.414478] [INFO ] [MAIN      ] SN: Wiping existing primary data before full refresh.
[2025-10-24T21:09:32.414535] [INFO ] [LOCAL     ] SN: Starting deletion of primary data.
[2025-10-24T21:09:32.415113] [DEBUG] [LOCAL     ] SN: Deleted primary data file.
[2025-10-24T21:09:32.415171] [INFO ] [MAIN      ] SN: Starting full primary refresh.
[2025-10-24T21:09:32.790012] [INFO ] [REMOTE    ] SN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:09:32.947607] [INFO ] [REMOTE    ] SN: Fetching primary data for 2025-01.
[2025-10-24T21:09:33.144916] [INFO ] [REMOTE    ] SMRT: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T21:09:33.747622] [INFO ] [REMOTE    ] SMR: Fetching primary data for 2025-07.
[2025-10-24T21:09:33.937985] [INFO ] [REMOTE    ] SN: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T21:09:34.547634] [INFO ] [REMOTE    ] SMRT: Fetching primary data for 2025-10.
[2025-10-24T21:09:34.849857] [INFO ] [REMOTE    ] SMR: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T21:09:35.347633] [INFO ] [REMOTE    ] SMWB: Fetching primary data for 2025-07.
[2025-10-24T21:09:35.401055] [INFO ] [REMOTE    ] SMRT: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T21:09:35.408260] [INFO ] [REMOTE    ] SMRT: Full fetch complete (62293 records).
[2025-10-24T21:09:35.408357] [DEBUG] [VALIDATOR ] SMRT: Validating primary data.
[2025-10-24T21:09:35.409193] [FATAL] [VALIDATOR ] SMRT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:09:35.409276] [FATAL] [MAIN      ] SMRT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:09:35.409318] [WARN ] [MAIN      ] SMRT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:09:35.409383] [INFO ] [LOCAL     ] SMRT: Starting deletion of primary data.
[2025-10-24T21:09:35.409445] [DEBUG] [LOCAL     ] SMRT: No primary data file found to delete.
[2025-10-24T21:09:35.409480] [INFO ] [LOCAL     ] SMRT: Starting deletion of derivative data.
[2025-10-24T21:09:35.409637] [DEBUG] [LOCAL     ] SMRT: Deleted derivative data file.
[2025-10-24T21:09:35.410151] [INFO ] [MAIN      ] Update Progress: 1941/2366 symbols completed. SMRT took 28.0s. Estimated remaining: 54m 38s. Rate: 7.8 symbols/min
[2025-10-24T21:09:35.576940] [INFO ] [MAIN      ] SNA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:09:35.602929] [DEBUG] [LOCAL     ] SNA: Loaded 25908 existing records from primary storage.
[2025-10-24T21:09:35.603172] [INFO ] [MAIN      ] SNA: Loaded 25908 existing records.
[2025-10-24T21:09:35.782981] [WARN ] [MAIN      ] SNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:09:35.783200] [INFO ] [MAIN      ] SNA: Wiping existing primary data before full refresh.
[2025-10-24T21:09:35.783249] [INFO ] [LOCAL     ] SNA: Starting deletion of primary data.
[2025-10-24T21:09:35.783518] [DEBUG] [LOCAL     ] SNA: Deleted primary data file.
[2025-10-24T21:09:35.783564] [INFO ] [MAIN      ] SNA: Starting full primary refresh.
[2025-10-24T21:09:36.138438] [INFO ] [REMOTE    ] SNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:09:36.147614] [INFO ] [REMOTE    ] SNA: Fetching primary data for 2025-01.
[2025-10-24T21:09:36.289388] [INFO ] [REMOTE    ] SMWB: Incremental fetch complete for 2025-07 (0.94 seconds).
[2025-10-24T21:09:36.947677] [INFO ] [REMOTE    ] SMWB: Fetching primary data for 2025-08.
[2025-10-24T21:09:37.066121] [INFO ] [REMOTE    ] SNA: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T21:09:37.681626] [INFO ] [REMOTE    ] SMWB: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T21:09:37.747607] [INFO ] [REMOTE    ] SMWB: Fetching primary data for 2025-09.
[2025-10-24T21:09:38.547708] [INFO ] [REMOTE    ] SNA: Fetching primary data for 2025-02.
[2025-10-24T21:09:38.810102] [INFO ] [REMOTE    ] SMWB: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T21:09:39.347679] [INFO ] [REMOTE    ] SMWB: Fetching primary data for 2025-10.
[2025-10-24T21:09:39.769799] [INFO ] [REMOTE    ] SNA: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T21:09:40.147618] [INFO ] [REMOTE    ] SN: Fetching primary data for 2025-02.
[2025-10-24T21:09:40.217114] [INFO ] [REMOTE    ] SMWB: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T21:09:40.221679] [INFO ] [REMOTE    ] SMWB: Full fetch complete (48226 records).
[2025-10-24T21:09:40.221803] [DEBUG] [VALIDATOR ] SMWB: Validating primary data.
[2025-10-24T21:09:40.222610] [FATAL] [VALIDATOR ] SMWB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:09:40.222720] [FATAL] [MAIN      ] SMWB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:09:40.222786] [WARN ] [MAIN      ] SMWB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:09:40.222857] [INFO ] [LOCAL     ] SMWB: Starting deletion of primary data.
[2025-10-24T21:09:40.222919] [DEBUG] [LOCAL     ] SMWB: No primary data file found to delete.
[2025-10-24T21:09:40.222955] [INFO ] [LOCAL     ] SMWB: Starting deletion of derivative data.
[2025-10-24T21:09:40.223093] [DEBUG] [LOCAL     ] SMWB: Deleted derivative data file.
[2025-10-24T21:09:40.223159] [INFO ] [MAIN      ] Update Progress: 1942/2366 symbols completed. SMWB took 24.4s. Estimated remaining: 54m 30s. Rate: 7.8 symbols/min
[2025-10-24T21:09:40.395190] [INFO ] [MAIN      ] SNAP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:09:40.443914] [DEBUG] [LOCAL     ] SNAP: Loaded 54186 existing records from primary storage.
[2025-10-24T21:09:40.444214] [INFO ] [MAIN      ] SNAP: Loaded 54186 existing records.
[2025-10-24T21:09:40.623216] [WARN ] [MAIN      ] SNAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:09:40.623424] [INFO ] [MAIN      ] SNAP: Wiping existing primary data before full refresh.
[2025-10-24T21:09:40.623468] [INFO ] [LOCAL     ] SNAP: Starting deletion of primary data.
[2025-10-24T21:09:40.623857] [DEBUG] [LOCAL     ] SNAP: Deleted primary data file.
[2025-10-24T21:09:40.623914] [INFO ] [MAIN      ] SNAP: Starting full primary refresh.
[2025-10-24T21:09:40.952905] [INFO ] [REMOTE    ] SNA: Fetching primary data for 2025-03.
[2025-10-24T21:09:40.991220] [INFO ] [REMOTE    ] SNAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:09:41.498184] [INFO ] [REMOTE    ] SN: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T21:09:41.747691] [INFO ] [REMOTE    ] SMR: Fetching primary data for 2025-08.
[2025-10-24T21:09:41.962501] [INFO ] [REMOTE    ] SNA: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T21:09:42.547679] [INFO ] [REMOTE    ] SNAP: Fetching primary data for 2025-01.
[2025-10-24T21:09:42.644812] [INFO ] [REMOTE    ] SMR: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T21:09:43.347619] [INFO ] [REMOTE    ] SN: Fetching primary data for 2025-03.
[2025-10-24T21:09:43.456624] [INFO ] [REMOTE    ] SNAP: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T21:09:44.147626] [INFO ] [REMOTE    ] SNA: Fetching primary data for 2025-04.
[2025-10-24T21:09:44.238979] [INFO ] [REMOTE    ] SN: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T21:09:44.437855] [INFO ] [REMOTE    ] SNA: Incremental fetch complete for 2025-04 (0.29 seconds).
[2025-10-24T21:09:44.947721] [INFO ] [REMOTE    ] SNA: Fetching primary data for 2025-05.
[2025-10-24T21:09:45.557053] [INFO ] [REMOTE    ] SNA: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T21:09:45.747702] [INFO ] [REMOTE    ] SNAP: Fetching primary data for 2025-02.
[2025-10-24T21:09:46.510476] [INFO ] [REMOTE    ] SNAP: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T21:09:46.547629] [INFO ] [REMOTE    ] SNAP: Fetching primary data for 2025-03.
[2025-10-24T21:09:47.347617] [INFO ] [REMOTE    ] SMR: Fetching primary data for 2025-09.
[2025-10-24T21:09:47.561258] [INFO ] [REMOTE    ] SNAP: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T21:09:47.994441] [INFO ] [REMOTE    ] SMR: Incremental fetch complete for 2025-09 (0.65 seconds).
[2025-10-24T21:09:48.147668] [INFO ] [REMOTE    ] SMR: Fetching primary data for 2025-10.
[2025-10-24T21:09:48.909016] [INFO ] [REMOTE    ] SMR: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T21:09:48.919339] [INFO ] [REMOTE    ] SMR: Full fetch complete (77587 records).
[2025-10-24T21:09:48.919490] [DEBUG] [VALIDATOR ] SMR: Validating primary data.
[2025-10-24T21:09:48.920384] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:09:48.920487] [FATAL] [MAIN      ] SMR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:09:48.920529] [WARN ] [MAIN      ] SMR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:09:48.920567] [INFO ] [LOCAL     ] SMR: Starting deletion of primary data.
[2025-10-24T21:09:48.920622] [DEBUG] [LOCAL     ] SMR: No primary data file found to delete.
[2025-10-24T21:09:48.920687] [INFO ] [LOCAL     ] SMR: Starting deletion of derivative data.
[2025-10-24T21:09:48.920854] [DEBUG] [LOCAL     ] SMR: Deleted derivative data file.
[2025-10-24T21:09:48.921196] [INFO ] [MAIN      ] Update Progress: 1943/2366 symbols completed. SMR took 42.4s. Estimated remaining: 54m 23s. Rate: 7.8 symbols/min
[2025-10-24T21:09:48.952881] [INFO ] [REMOTE    ] SNA: Fetching primary data for 2025-06.
[2025-10-24T21:09:49.100333] [INFO ] [MAIN      ] SNDA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:09:49.108711] [DEBUG] [LOCAL     ] SNDA: Loaded 4490 existing records from primary storage.
[2025-10-24T21:09:49.108937] [INFO ] [MAIN      ] SNDA: Loaded 4490 existing records.
[2025-10-24T21:09:49.292633] [WARN ] [MAIN      ] SNDA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:09:49.292823] [INFO ] [MAIN      ] SNDA: Wiping existing primary data before full refresh.
[2025-10-24T21:09:49.292870] [INFO ] [LOCAL     ] SNDA: Starting deletion of primary data.
[2025-10-24T21:09:49.293022] [DEBUG] [LOCAL     ] SNDA: Deleted primary data file.
[2025-10-24T21:09:49.293079] [INFO ] [MAIN      ] SNDA: Starting full primary refresh.
[2025-10-24T21:09:49.660099] [INFO ] [REMOTE    ] SNDA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:09:49.747604] [INFO ] [REMOTE    ] SNDA: Fetching primary data for 2025-01.
[2025-10-24T21:09:50.338951] [INFO ] [REMOTE    ] SNA: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T21:09:50.547720] [INFO ] [REMOTE    ] SN: Fetching primary data for 2025-04.
[2025-10-24T21:09:50.880970] [INFO ] [REMOTE    ] SNDA: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T21:09:51.347689] [INFO ] [REMOTE    ] SNDA: Fetching primary data for 2025-02.
[2025-10-24T21:09:51.413104] [INFO ] [REMOTE    ] SN: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T21:09:51.753535] [INFO ] [REMOTE    ] SNDA: Incremental fetch complete for 2025-02 (0.41 seconds).
[2025-10-24T21:09:52.147750] [INFO ] [REMOTE    ] SNAP: Fetching primary data for 2025-04.
[2025-10-24T21:09:52.947632] [INFO ] [REMOTE    ] SNA: Fetching primary data for 2025-07.
[2025-10-24T21:09:53.177628] [INFO ] [REMOTE    ] SNAP: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T21:09:53.235677] [INFO ] [REMOTE    ] SNA: Incremental fetch complete for 2025-07 (0.29 seconds).
[2025-10-24T21:09:53.747688] [INFO ] [REMOTE    ] SNDA: Fetching primary data for 2025-03.
[2025-10-24T21:09:54.131066] [INFO ] [REMOTE    ] SNDA: Incremental fetch complete for 2025-03 (0.38 seconds).
[2025-10-24T21:09:54.547666] [INFO ] [REMOTE    ] SNA: Fetching primary data for 2025-08.
[2025-10-24T21:09:55.143397] [INFO ] [REMOTE    ] SNA: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T21:09:55.347623] [INFO ] [REMOTE    ] SNA: Fetching primary data for 2025-09.
[2025-10-24T21:09:56.147613] [INFO ] [REMOTE    ] SNAP: Fetching primary data for 2025-05.
[2025-10-24T21:09:56.240909] [INFO ] [REMOTE    ] SNA: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T21:09:56.947701] [INFO ] [REMOTE    ] SNA: Fetching primary data for 2025-10.
[2025-10-24T21:09:57.368871] [INFO ] [REMOTE    ] SNAP: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T21:09:57.747608] [INFO ] [REMOTE    ] SN: Fetching primary data for 2025-05.
[2025-10-24T21:09:57.993617] [INFO ] [REMOTE    ] SNA: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T21:09:57.998800] [INFO ] [REMOTE    ] SNA: Full fetch complete (38894 records).
[2025-10-24T21:09:57.998922] [DEBUG] [VALIDATOR ] SNA: Validating primary data.
[2025-10-24T21:09:57.999516] [FATAL] [VALIDATOR ] SNA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:09:57.999604] [FATAL] [MAIN      ] SNA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:09:57.999679] [WARN ] [MAIN      ] SNA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:09:57.999740] [INFO ] [LOCAL     ] SNA: Starting deletion of primary data.
[2025-10-24T21:09:57.999798] [DEBUG] [LOCAL     ] SNA: No primary data file found to delete.
[2025-10-24T21:09:57.999833] [INFO ] [LOCAL     ] SNA: Starting deletion of derivative data.
[2025-10-24T21:09:58.000015] [DEBUG] [LOCAL     ] SNA: Deleted derivative data file.
[2025-10-24T21:09:58.000105] [INFO ] [MAIN      ] Update Progress: 1944/2366 symbols completed. SNA took 22.6s. Estimated remaining: 54m 15s. Rate: 7.8 symbols/min
[2025-10-24T21:09:58.169305] [INFO ] [MAIN      ] SNDR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:09:58.206769] [DEBUG] [LOCAL     ] SNDR: Loaded 41922 existing records from primary storage.
[2025-10-24T21:09:58.207061] [INFO ] [MAIN      ] SNDR: Loaded 41922 existing records.
[2025-10-24T21:09:58.382176] [WARN ] [MAIN      ] SNDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:09:58.382392] [INFO ] [MAIN      ] SNDR: Wiping existing primary data before full refresh.
[2025-10-24T21:09:58.382438] [INFO ] [LOCAL     ] SNDR: Starting deletion of primary data.
[2025-10-24T21:09:58.382810] [DEBUG] [LOCAL     ] SNDR: Deleted primary data file.
[2025-10-24T21:09:58.382865] [INFO ] [MAIN      ] SNDR: Starting full primary refresh.
[2025-10-24T21:09:58.552924] [INFO ] [REMOTE    ] SNAP: Fetching primary data for 2025-06.
[2025-10-24T21:09:58.737598] [INFO ] [REMOTE    ] SNDR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:09:59.145836] [INFO ] [REMOTE    ] SN: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T21:09:59.347666] [INFO ] [REMOTE    ] SNDR: Fetching primary data for 2025-01.
[2025-10-24T21:09:59.644317] [INFO ] [REMOTE    ] SNAP: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T21:10:00.125296] [INFO ] [REMOTE    ] SNDR: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T21:10:00.147602] [INFO ] [REMOTE    ] SNAP: Fetching primary data for 2025-07.
[2025-10-24T21:10:00.947705] [INFO ] [REMOTE    ] SNDR: Fetching primary data for 2025-02.
[2025-10-24T21:10:01.426559] [INFO ] [REMOTE    ] SNAP: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T21:10:01.693426] [INFO ] [REMOTE    ] SNDR: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T21:10:01.747747] [INFO ] [REMOTE    ] SN: Fetching primary data for 2025-06.
[2025-10-24T21:10:02.547694] [INFO ] [REMOTE    ] SNDA: Fetching primary data for 2025-04.
[2025-10-24T21:10:02.599681] [INFO ] [REMOTE    ] SN: Incremental fetch complete for 2025-06 (0.85 seconds).
[2025-10-24T21:10:02.961275] [INFO ] [REMOTE    ] SNDA: Incremental fetch complete for 2025-04 (0.41 seconds).
[2025-10-24T21:10:03.347668] [INFO ] [REMOTE    ] SNDA: Fetching primary data for 2025-05.
[2025-10-24T21:10:04.148698] [INFO ] [REMOTE    ] SNDR: Fetching primary data for 2025-03.
[2025-10-24T21:10:04.149821] [INFO ] [REMOTE    ] SNDA: Incremental fetch complete for 2025-05 (0.80 seconds).
[2025-10-24T21:10:04.947619] [INFO ] [REMOTE    ] SN: Fetching primary data for 2025-07.
[2025-10-24T21:10:05.113799] [INFO ] [REMOTE    ] SNDR: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T21:10:05.747735] [INFO ] [REMOTE    ] SNDR: Fetching primary data for 2025-04.
[2025-10-24T21:10:06.109611] [INFO ] [REMOTE    ] SN: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T21:10:06.547674] [INFO ] [REMOTE    ] SN: Fetching primary data for 2025-08.
[2025-10-24T21:10:06.803468] [INFO ] [REMOTE    ] SNDR: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T21:10:07.347635] [INFO ] [REMOTE    ] SNAP: Fetching primary data for 2025-08.
[2025-10-24T21:10:08.147715] [INFO ] [REMOTE    ] SNDR: Fetching primary data for 2025-05.
[2025-10-24T21:10:08.425398] [INFO ] [REMOTE    ] SN: Incremental fetch complete for 2025-08 (1.88 seconds).
[2025-10-24T21:10:08.947703] [INFO ] [REMOTE    ] SN: Fetching primary data for 2025-09.
[2025-10-24T21:10:09.562015] [INFO ] [REMOTE    ] SNDR: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T21:10:09.652876] [INFO ] [REMOTE    ] SN: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T21:10:09.731150] [INFO ] [REMOTE    ] SNAP: Incremental fetch complete for 2025-08 (2.38 seconds).
[2025-10-24T21:10:09.747612] [INFO ] [REMOTE    ] SNAP: Fetching primary data for 2025-09.
[2025-10-24T21:10:10.533511] [INFO ] [REMOTE    ] SNAP: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T21:10:10.547607] [INFO ] [REMOTE    ] SNAP: Fetching primary data for 2025-10.
[2025-10-24T21:10:11.347712] [INFO ] [REMOTE    ] SN: Fetching primary data for 2025-10.
[2025-10-24T21:10:11.550150] [INFO ] [REMOTE    ] SNAP: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T21:10:11.559918] [INFO ] [REMOTE    ] SNAP: Full fetch complete (77585 records).
[2025-10-24T21:10:11.560076] [DEBUG] [VALIDATOR ] SNAP: Validating primary data.
[2025-10-24T21:10:11.560959] [FATAL] [VALIDATOR ] SNAP: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:10:11.561075] [FATAL] [MAIN      ] SNAP: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:10:11.561157] [WARN ] [MAIN      ] SNAP: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:10:11.561241] [INFO ] [LOCAL     ] SNAP: Starting deletion of primary data.
[2025-10-24T21:10:11.561318] [DEBUG] [LOCAL     ] SNAP: No primary data file found to delete.
[2025-10-24T21:10:11.561370] [INFO ] [LOCAL     ] SNAP: Starting deletion of derivative data.
[2025-10-24T21:10:11.561550] [DEBUG] [LOCAL     ] SNAP: Deleted derivative data file.
[2025-10-24T21:10:11.561895] [INFO ] [MAIN      ] Update Progress: 1945/2366 symbols completed. SNAP took 31.3s. Estimated remaining: 54m 9s. Rate: 7.8 symbols/min
[2025-10-24T21:10:11.751932] [INFO ] [MAIN      ] SNN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:10:11.793799] [DEBUG] [LOCAL     ] SNN: Loaded 44659 existing records from primary storage.
[2025-10-24T21:10:11.794081] [INFO ] [MAIN      ] SNN: Loaded 44659 existing records.
[2025-10-24T21:10:11.983350] [WARN ] [MAIN      ] SNN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:10:11.983677] [INFO ] [MAIN      ] SNN: Wiping existing primary data before full refresh.
[2025-10-24T21:10:11.983752] [INFO ] [LOCAL     ] SNN: Starting deletion of primary data.
[2025-10-24T21:10:11.984158] [DEBUG] [LOCAL     ] SNN: Deleted primary data file.
[2025-10-24T21:10:11.984296] [INFO ] [MAIN      ] SNN: Starting full primary refresh.
[2025-10-24T21:10:12.165124] [INFO ] [REMOTE    ] SNDR: Fetching primary data for 2025-06.
[2025-10-24T21:10:12.312953] [INFO ] [REMOTE    ] SN: Incremental fetch complete for 2025-10 (0.97 seconds).
[2025-10-24T21:10:12.363970] [INFO ] [REMOTE    ] SN: Full fetch complete (71540 records).
[2025-10-24T21:10:12.384263] [DEBUG] [VALIDATOR ] SN: Validating primary data.
[2025-10-24T21:10:12.384189] [INFO ] [REMOTE    ] SNN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:10:12.385297] [FATAL] [VALIDATOR ] SN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:10:12.385398] [FATAL] [MAIN      ] SN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:10:12.385441] [WARN ] [MAIN      ] SN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:10:12.385504] [INFO ] [LOCAL     ] SN: Starting deletion of primary data.
[2025-10-24T21:10:12.385564] [DEBUG] [LOCAL     ] SN: No primary data file found to delete.
[2025-10-24T21:10:12.385599] [INFO ] [LOCAL     ] SN: Starting deletion of derivative data.
[2025-10-24T21:10:12.385813] [DEBUG] [LOCAL     ] SN: Deleted derivative data file.
[2025-10-24T21:10:12.386264] [INFO ] [MAIN      ] Update Progress: 1946/2366 symbols completed. SN took 40.4s. Estimated remaining: 53m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:10:12.554233] [INFO ] [MAIN      ] SNOW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:10:12.607446] [DEBUG] [LOCAL     ] SNOW: Loaded 53967 existing records from primary storage.
[2025-10-24T21:10:12.607785] [INFO ] [MAIN      ] SNOW: Loaded 53967 existing records.
[2025-10-24T21:10:12.785078] [WARN ] [MAIN      ] SNOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:10:12.785259] [INFO ] [MAIN      ] SNOW: Wiping existing primary data before full refresh.
[2025-10-24T21:10:12.785304] [INFO ] [LOCAL     ] SNOW: Starting deletion of primary data.
[2025-10-24T21:10:12.785793] [DEBUG] [LOCAL     ] SNOW: Deleted primary data file.
[2025-10-24T21:10:12.785848] [INFO ] [MAIN      ] SNOW: Starting full primary refresh.
[2025-10-24T21:10:12.948368] [INFO ] [REMOTE    ] SNN: Fetching primary data for 2025-01.
[2025-10-24T21:10:13.149067] [INFO ] [REMOTE    ] SNOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:10:13.454515] [INFO ] [REMOTE    ] SNDR: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T21:10:13.747608] [INFO ] [REMOTE    ] SNOW: Fetching primary data for 2025-01.
[2025-10-24T21:10:14.547703] [INFO ] [REMOTE    ] SNDR: Fetching primary data for 2025-07.
[2025-10-24T21:10:14.574403] [INFO ] [REMOTE    ] SNN: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T21:10:15.347670] [INFO ] [REMOTE    ] SNN: Fetching primary data for 2025-02.
[2025-10-24T21:10:15.412520] [INFO ] [REMOTE    ] SNDR: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T21:10:15.584818] [INFO ] [REMOTE    ] SNOW: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T21:10:16.147619] [INFO ] [REMOTE    ] SNOW: Fetching primary data for 2025-02.
[2025-10-24T21:10:16.255792] [INFO ] [REMOTE    ] SNN: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T21:10:16.947680] [INFO ] [REMOTE    ] SNDA: Fetching primary data for 2025-06.
[2025-10-24T21:10:17.328099] [INFO ] [REMOTE    ] SNDA: Incremental fetch complete for 2025-06 (0.38 seconds).
[2025-10-24T21:10:17.593527] [INFO ] [REMOTE    ] SNOW: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T21:10:17.747638] [INFO ] [REMOTE    ] SNOW: Fetching primary data for 2025-03.
[2025-10-24T21:10:18.547662] [INFO ] [REMOTE    ] SNDR: Fetching primary data for 2025-08.
[2025-10-24T21:10:18.593007] [INFO ] [REMOTE    ] SNOW: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T21:10:19.347688] [INFO ] [REMOTE    ] SNN: Fetching primary data for 2025-03.
[2025-10-24T21:10:19.807161] [INFO ] [REMOTE    ] SNDR: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T21:10:20.152868] [INFO ] [REMOTE    ] SNDR: Fetching primary data for 2025-09.
[2025-10-24T21:10:20.155557] [INFO ] [REMOTE    ] SNN: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T21:10:20.947620] [INFO ] [REMOTE    ] SNDA: Fetching primary data for 2025-07.
[2025-10-24T21:10:21.158300] [INFO ] [REMOTE    ] SNDR: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T21:10:21.747623] [INFO ] [REMOTE    ] SNOW: Fetching primary data for 2025-04.
[2025-10-24T21:10:21.975909] [INFO ] [REMOTE    ] SNDA: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T21:10:22.547682] [INFO ] [REMOTE    ] SNN: Fetching primary data for 2025-04.
[2025-10-24T21:10:22.778553] [INFO ] [REMOTE    ] SNOW: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T21:10:23.347676] [INFO ] [REMOTE    ] SNDR: Fetching primary data for 2025-10.
[2025-10-24T21:10:23.428990] [INFO ] [REMOTE    ] SNN: Incremental fetch complete for 2025-04 (0.88 seconds).
[2025-10-24T21:10:24.093636] [INFO ] [REMOTE    ] SNDR: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T21:10:24.101754] [INFO ] [REMOTE    ] SNDR: Full fetch complete (59974 records).
[2025-10-24T21:10:24.101850] [DEBUG] [VALIDATOR ] SNDR: Validating primary data.
[2025-10-24T21:10:24.102467] [FATAL] [VALIDATOR ] SNDR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:10:24.102556] [FATAL] [MAIN      ] SNDR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:10:24.102597] [WARN ] [MAIN      ] SNDR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:10:24.102636] [INFO ] [LOCAL     ] SNDR: Starting deletion of primary data.
[2025-10-24T21:10:24.102739] [DEBUG] [LOCAL     ] SNDR: No primary data file found to delete.
[2025-10-24T21:10:24.102778] [INFO ] [LOCAL     ] SNDR: Starting deletion of derivative data.
[2025-10-24T21:10:24.102962] [DEBUG] [LOCAL     ] SNDR: Deleted derivative data file.
[2025-10-24T21:10:24.103047] [INFO ] [MAIN      ] Update Progress: 1947/2366 symbols completed. SNDR took 26.1s. Estimated remaining: 53m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:10:24.156074] [INFO ] [REMOTE    ] SNN: Fetching primary data for 2025-05.
[2025-10-24T21:10:24.272618] [INFO ] [MAIN      ] SNV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:10:24.315574] [DEBUG] [LOCAL     ] SNV: Loaded 49425 existing records from primary storage.
[2025-10-24T21:10:24.315908] [INFO ] [MAIN      ] SNV: Loaded 49425 existing records.
[2025-10-24T21:10:24.493079] [WARN ] [MAIN      ] SNV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:10:24.493278] [INFO ] [MAIN      ] SNV: Wiping existing primary data before full refresh.
[2025-10-24T21:10:24.493321] [INFO ] [LOCAL     ] SNV: Starting deletion of primary data.
[2025-10-24T21:10:24.493938] [DEBUG] [LOCAL     ] SNV: Deleted primary data file.
[2025-10-24T21:10:24.493995] [INFO ] [MAIN      ] SNV: Starting full primary refresh.
[2025-10-24T21:10:24.844962] [INFO ] [REMOTE    ] SNV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:10:24.869892] [INFO ] [REMOTE    ] SNN: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T21:10:24.947613] [INFO ] [REMOTE    ] SNN: Fetching primary data for 2025-06.
[2025-10-24T21:10:25.679755] [INFO ] [REMOTE    ] SNN: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T21:10:25.747607] [INFO ] [REMOTE    ] SNN: Fetching primary data for 2025-07.
[2025-10-24T21:10:26.547676] [INFO ] [REMOTE    ] SNOW: Fetching primary data for 2025-05.
[2025-10-24T21:10:26.767794] [INFO ] [REMOTE    ] SNN: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T21:10:27.347719] [INFO ] [REMOTE    ] SNV: Fetching primary data for 2025-01.
[2025-10-24T21:10:27.835305] [INFO ] [REMOTE    ] SNOW: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T21:10:28.147677] [INFO ] [REMOTE    ] SNN: Fetching primary data for 2025-08.
[2025-10-24T21:10:28.710525] [INFO ] [REMOTE    ] SNV: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T21:10:28.797189] [INFO ] [REMOTE    ] SNN: Incremental fetch complete for 2025-08 (0.65 seconds).
[2025-10-24T21:10:28.947682] [INFO ] [REMOTE    ] SNV: Fetching primary data for 2025-02.
[2025-10-24T21:10:29.747638] [INFO ] [REMOTE    ] SNN: Fetching primary data for 2025-09.
[2025-10-24T21:10:29.983844] [INFO ] [REMOTE    ] SNV: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T21:10:30.547679] [INFO ] [REMOTE    ] SNOW: Fetching primary data for 2025-06.
[2025-10-24T21:10:30.749062] [INFO ] [REMOTE    ] SNN: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T21:10:31.347618] [INFO ] [REMOTE    ] SNDA: Fetching primary data for 2025-08.
[2025-10-24T21:10:31.607888] [INFO ] [REMOTE    ] SNOW: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T21:10:31.949027] [INFO ] [REMOTE    ] SNDA: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T21:10:32.147688] [INFO ] [REMOTE    ] SNDA: Fetching primary data for 2025-09.
[2025-10-24T21:10:32.522141] [INFO ] [REMOTE    ] SNDA: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T21:10:32.947694] [INFO ] [REMOTE    ] SNOW: Fetching primary data for 2025-07.
[2025-10-24T21:10:33.747726] [INFO ] [REMOTE    ] SNDA: Fetching primary data for 2025-10.
[2025-10-24T21:10:33.868320] [INFO ] [REMOTE    ] SNOW: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T21:10:34.117519] [INFO ] [REMOTE    ] SNDA: Incremental fetch complete for 2025-10 (0.37 seconds).
[2025-10-24T21:10:34.119159] [INFO ] [REMOTE    ] SNDA: Full fetch complete (7406 records).
[2025-10-24T21:10:34.119271] [DEBUG] [VALIDATOR ] SNDA: Validating primary data.
[2025-10-24T21:10:34.119850] [FATAL] [VALIDATOR ] SNDA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:10:34.119945] [FATAL] [MAIN      ] SNDA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:10:34.119989] [WARN ] [MAIN      ] SNDA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:10:34.120030] [INFO ] [LOCAL     ] SNDA: Starting deletion of primary data.
[2025-10-24T21:10:34.120093] [DEBUG] [LOCAL     ] SNDA: No primary data file found to delete.
[2025-10-24T21:10:34.120131] [INFO ] [LOCAL     ] SNDA: Starting deletion of derivative data.
[2025-10-24T21:10:34.120325] [DEBUG] [LOCAL     ] SNDA: Deleted derivative data file.
[2025-10-24T21:10:34.120407] [INFO ] [MAIN      ] Update Progress: 1948/2366 symbols completed. SNDA took 45.2s. Estimated remaining: 53m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:10:34.330921] [INFO ] [MAIN      ] SNX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:10:34.371959] [DEBUG] [LOCAL     ] SNX: Loaded 39146 existing records from primary storage.
[2025-10-24T21:10:34.372236] [INFO ] [MAIN      ] SNX: Loaded 39146 existing records.
[2025-10-24T21:10:34.554530] [INFO ] [REMOTE    ] SNOW: Fetching primary data for 2025-08.
[2025-10-24T21:10:34.560290] [WARN ] [MAIN      ] SNX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:10:34.561408] [INFO ] [MAIN      ] SNX: Wiping existing primary data before full refresh.
[2025-10-24T21:10:34.561461] [INFO ] [LOCAL     ] SNX: Starting deletion of primary data.
[2025-10-24T21:10:34.561874] [DEBUG] [LOCAL     ] SNX: Deleted primary data file.
[2025-10-24T21:10:34.561952] [INFO ] [MAIN      ] SNX: Starting full primary refresh.
[2025-10-24T21:10:34.942815] [INFO ] [REMOTE    ] SNX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:10:35.347768] [INFO ] [REMOTE    ] SNV: Fetching primary data for 2025-03.
[2025-10-24T21:10:35.495793] [INFO ] [REMOTE    ] SNOW: Incremental fetch complete for 2025-08 (0.94 seconds).
[2025-10-24T21:10:36.147732] [INFO ] [REMOTE    ] SNOW: Fetching primary data for 2025-09.
[2025-10-24T21:10:36.947698] [INFO ] [REMOTE    ] SNX: Fetching primary data for 2025-01.
[2025-10-24T21:10:37.155068] [INFO ] [REMOTE    ] SNV: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T21:10:37.749514] [INFO ] [REMOTE    ] SNN: Fetching primary data for 2025-10.
[2025-10-24T21:10:37.752557] [INFO ] [REMOTE    ] SNX: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T21:10:37.989590] [INFO ] [REMOTE    ] SNOW: Incremental fetch complete for 2025-09 (1.84 seconds).
[2025-10-24T21:10:38.547633] [INFO ] [REMOTE    ] SNV: Fetching primary data for 2025-04.
[2025-10-24T21:10:38.798038] [INFO ] [REMOTE    ] SNN: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T21:10:38.809097] [INFO ] [REMOTE    ] SNN: Full fetch complete (62738 records).
[2025-10-24T21:10:38.809317] [DEBUG] [VALIDATOR ] SNN: Validating primary data.
[2025-10-24T21:10:38.810295] [FATAL] [VALIDATOR ] SNN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:10:38.810405] [FATAL] [MAIN      ] SNN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:10:38.810462] [WARN ] [MAIN      ] SNN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:10:38.810542] [INFO ] [LOCAL     ] SNN: Starting deletion of primary data.
[2025-10-24T21:10:38.810624] [DEBUG] [LOCAL     ] SNN: No primary data file found to delete.
[2025-10-24T21:10:38.810712] [INFO ] [LOCAL     ] SNN: Starting deletion of derivative data.
[2025-10-24T21:10:38.810920] [DEBUG] [LOCAL     ] SNN: Deleted derivative data file.
[2025-10-24T21:10:38.811561] [INFO ] [MAIN      ] Update Progress: 1949/2366 symbols completed. SNN took 27.2s. Estimated remaining: 53m 37s. Rate: 7.8 symbols/min
[2025-10-24T21:10:39.003569] [INFO ] [MAIN      ] SO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:10:39.053882] [DEBUG] [LOCAL     ] SO: Loaded 54005 existing records from primary storage.
[2025-10-24T21:10:39.054188] [INFO ] [MAIN      ] SO: Loaded 54005 existing records.
[2025-10-24T21:10:39.233262] [WARN ] [MAIN      ] SO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:10:39.233583] [INFO ] [MAIN      ] SO: Wiping existing primary data before full refresh.
[2025-10-24T21:10:39.233731] [INFO ] [LOCAL     ] SO: Starting deletion of primary data.
[2025-10-24T21:10:39.234166] [DEBUG] [LOCAL     ] SO: Deleted primary data file.
[2025-10-24T21:10:39.234221] [INFO ] [MAIN      ] SO: Starting full primary refresh.
[2025-10-24T21:10:39.352800] [INFO ] [REMOTE    ] SNX: Fetching primary data for 2025-02.
[2025-10-24T21:10:39.615198] [INFO ] [REMOTE    ] SO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:10:39.647157] [INFO ] [REMOTE    ] SNV: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T21:10:40.147632] [INFO ] [REMOTE    ] SNOW: Fetching primary data for 2025-10.
[2025-10-24T21:10:40.475620] [INFO ] [REMOTE    ] SNX: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T21:10:40.947702] [INFO ] [REMOTE    ] SNX: Fetching primary data for 2025-03.
[2025-10-24T21:10:41.202842] [INFO ] [REMOTE    ] SNOW: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T21:10:41.212606] [INFO ] [REMOTE    ] SNOW: Full fetch complete (77328 records).
[2025-10-24T21:10:41.212817] [DEBUG] [VALIDATOR ] SNOW: Validating primary data.
[2025-10-24T21:10:41.213616] [FATAL] [VALIDATOR ] SNOW: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:10:41.213730] [FATAL] [MAIN      ] SNOW: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:10:41.213796] [WARN ] [MAIN      ] SNOW: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:10:41.213867] [INFO ] [LOCAL     ] SNOW: Starting deletion of primary data.
[2025-10-24T21:10:41.213930] [DEBUG] [LOCAL     ] SNOW: No primary data file found to delete.
[2025-10-24T21:10:41.213965] [INFO ] [LOCAL     ] SNOW: Starting deletion of derivative data.
[2025-10-24T21:10:41.214104] [DEBUG] [LOCAL     ] SNOW: Deleted derivative data file.
[2025-10-24T21:10:41.214690] [INFO ] [MAIN      ] Update Progress: 1950/2366 symbols completed. SNOW took 28.8s. Estimated remaining: 53m 28s. Rate: 7.8 symbols/min
[2025-10-24T21:10:41.385185] [INFO ] [MAIN      ] SOBO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:10:41.423002] [DEBUG] [LOCAL     ] SOBO: Loaded 39668 existing records from primary storage.
[2025-10-24T21:10:41.423286] [INFO ] [MAIN      ] SOBO: Loaded 39668 existing records.
[2025-10-24T21:10:41.610429] [WARN ] [MAIN      ] SOBO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:10:41.610794] [INFO ] [MAIN      ] SOBO: Wiping existing primary data before full refresh.
[2025-10-24T21:10:41.610965] [INFO ] [LOCAL     ] SOBO: Starting deletion of primary data.
[2025-10-24T21:10:41.611547] [DEBUG] [LOCAL     ] SOBO: Deleted primary data file.
[2025-10-24T21:10:41.611606] [INFO ] [MAIN      ] SOBO: Starting full primary refresh.
[2025-10-24T21:10:41.756804] [INFO ] [REMOTE    ] SNV: Fetching primary data for 2025-05.
[2025-10-24T21:10:41.907622] [INFO ] [REMOTE    ] SNX: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T21:10:42.033990] [INFO ] [REMOTE    ] SOBO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:10:42.547681] [INFO ] [REMOTE    ] SOBO: Fetching primary data for 2025-01.
[2025-10-24T21:10:42.594141] [INFO ] [REMOTE    ] SNV: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T21:10:43.274738] [INFO ] [REMOTE    ] SOBO: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T21:10:43.347600] [INFO ] [REMOTE    ] SOBO: Fetching primary data for 2025-02.
[2025-10-24T21:10:44.147702] [INFO ] [REMOTE    ] SNX: Fetching primary data for 2025-04.
[2025-10-24T21:10:44.380248] [INFO ] [REMOTE    ] SOBO: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T21:10:44.898041] [INFO ] [REMOTE    ] SNX: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T21:10:44.947608] [INFO ] [REMOTE    ] SNX: Fetching primary data for 2025-05.
[2025-10-24T21:10:45.677786] [INFO ] [REMOTE    ] SNX: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T21:10:45.747667] [INFO ] [REMOTE    ] SNX: Fetching primary data for 2025-06.
[2025-10-24T21:10:46.547676] [INFO ] [REMOTE    ] SO: Fetching primary data for 2025-01.
[2025-10-24T21:10:46.879491] [INFO ] [REMOTE    ] SNX: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T21:10:47.347685] [INFO ] [REMOTE    ] SNX: Fetching primary data for 2025-07.
[2025-10-24T21:10:47.391192] [INFO ] [REMOTE    ] SO: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T21:10:48.147723] [INFO ] [REMOTE    ] SNV: Fetching primary data for 2025-06.
[2025-10-24T21:10:48.197556] [INFO ] [REMOTE    ] SNX: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T21:10:48.947730] [INFO ] [REMOTE    ] SNX: Fetching primary data for 2025-08.
[2025-10-24T21:10:49.294345] [INFO ] [REMOTE    ] SNV: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T21:10:49.747620] [INFO ] [REMOTE    ] SNV: Fetching primary data for 2025-07.
[2025-10-24T21:10:49.867065] [INFO ] [REMOTE    ] SNX: Incremental fetch complete for 2025-08 (0.92 seconds).
[2025-10-24T21:10:50.151909] [INFO ] [REMOTE    ] SNV: Incremental fetch complete for 2025-07 (0.40 seconds).
[2025-10-24T21:10:50.547666] [INFO ] [REMOTE    ] SOBO: Fetching primary data for 2025-03.
[2025-10-24T21:10:51.347616] [INFO ] [REMOTE    ] SNX: Fetching primary data for 2025-09.
[2025-10-24T21:10:51.435053] [INFO ] [REMOTE    ] SOBO: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T21:10:51.931906] [INFO ] [REMOTE    ] SNX: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T21:10:52.147744] [INFO ] [REMOTE    ] SNV: Fetching primary data for 2025-08.
[2025-10-24T21:10:52.573185] [INFO ] [REMOTE    ] SNV: Incremental fetch complete for 2025-08 (0.43 seconds).
[2025-10-24T21:10:52.947674] [INFO ] [REMOTE    ] SO: Fetching primary data for 2025-02.
[2025-10-24T21:10:53.747689] [INFO ] [REMOTE    ] SNV: Fetching primary data for 2025-09.
[2025-10-24T21:10:53.802028] [INFO ] [REMOTE    ] SO: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T21:10:54.538577] [INFO ] [REMOTE    ] SNV: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T21:10:54.548580] [INFO ] [REMOTE    ] SOBO: Fetching primary data for 2025-04.
[2025-10-24T21:10:55.347705] [INFO ] [REMOTE    ] SNX: Fetching primary data for 2025-10.
[2025-10-24T21:10:55.504004] [INFO ] [REMOTE    ] SOBO: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T21:10:56.147701] [INFO ] [REMOTE    ] SOBO: Fetching primary data for 2025-05.
[2025-10-24T21:10:56.302239] [INFO ] [REMOTE    ] SNX: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T21:10:56.308856] [INFO ] [REMOTE    ] SNX: Full fetch complete (57011 records).
[2025-10-24T21:10:56.308954] [DEBUG] [VALIDATOR ] SNX: Validating primary data.
[2025-10-24T21:10:56.309508] [FATAL] [VALIDATOR ] SNX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:10:56.309591] [FATAL] [MAIN      ] SNX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:10:56.309636] [WARN ] [MAIN      ] SNX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:10:56.309717] [INFO ] [LOCAL     ] SNX: Starting deletion of primary data.
[2025-10-24T21:10:56.309777] [DEBUG] [LOCAL     ] SNX: No primary data file found to delete.
[2025-10-24T21:10:56.309812] [INFO ] [LOCAL     ] SNX: Starting deletion of derivative data.
[2025-10-24T21:10:56.310015] [DEBUG] [LOCAL     ] SNX: Deleted derivative data file.
[2025-10-24T21:10:56.310100] [INFO ] [MAIN      ] Update Progress: 1951/2366 symbols completed. SNX took 22.2s. Estimated remaining: 53m 22s. Rate: 7.8 symbols/min
[2025-10-24T21:10:56.486683] [INFO ] [MAIN      ] SOC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:10:56.534515] [DEBUG] [LOCAL     ] SOC: Loaded 51616 existing records from primary storage.
[2025-10-24T21:10:56.534852] [INFO ] [MAIN      ] SOC: Loaded 51616 existing records.
[2025-10-24T21:10:56.715923] [WARN ] [MAIN      ] SOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:10:56.716093] [INFO ] [MAIN      ] SOC: Wiping existing primary data before full refresh.
[2025-10-24T21:10:56.716140] [INFO ] [LOCAL     ] SOC: Starting deletion of primary data.
[2025-10-24T21:10:56.716515] [DEBUG] [LOCAL     ] SOC: Deleted primary data file.
[2025-10-24T21:10:56.716571] [INFO ] [MAIN      ] SOC: Starting full primary refresh.
[2025-10-24T21:10:56.952802] [INFO ] [REMOTE    ] SNV: Fetching primary data for 2025-10.
[2025-10-24T21:10:57.073171] [INFO ] [REMOTE    ] SOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:10:57.166841] [INFO ] [REMOTE    ] SOBO: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T21:10:57.747725] [INFO ] [REMOTE    ] SOC: Fetching primary data for 2025-01.
[2025-10-24T21:10:58.069202] [INFO ] [REMOTE    ] SNV: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T21:10:58.078429] [INFO ] [REMOTE    ] SNV: Full fetch complete (71502 records).
[2025-10-24T21:10:58.078588] [DEBUG] [VALIDATOR ] SNV: Validating primary data.
[2025-10-24T21:10:58.080367] [FATAL] [VALIDATOR ] SNV: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:10:58.080468] [FATAL] [MAIN      ] SNV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:10:58.080510] [WARN ] [MAIN      ] SNV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:10:58.080587] [INFO ] [LOCAL     ] SNV: Starting deletion of primary data.
[2025-10-24T21:10:58.080686] [DEBUG] [LOCAL     ] SNV: No primary data file found to delete.
[2025-10-24T21:10:58.080742] [INFO ] [LOCAL     ] SNV: Starting deletion of derivative data.
[2025-10-24T21:10:58.080917] [DEBUG] [LOCAL     ] SNV: Deleted derivative data file.
[2025-10-24T21:10:58.081463] [INFO ] [MAIN      ] Update Progress: 1952/2366 symbols completed. SNV took 34.0s. Estimated remaining: 53m 13s. Rate: 7.8 symbols/min
[2025-10-24T21:10:58.258404] [INFO ] [MAIN      ] SOJC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:10:58.265193] [DEBUG] [LOCAL     ] SOJC: Loaded 4596 existing records from primary storage.
[2025-10-24T21:10:58.265412] [INFO ] [MAIN      ] SOJC: Loaded 4596 existing records.
[2025-10-24T21:10:58.451308] [WARN ] [MAIN      ] SOJC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:10:58.451723] [INFO ] [MAIN      ] SOJC: Wiping existing primary data before full refresh.
[2025-10-24T21:10:58.451885] [INFO ] [LOCAL     ] SOJC: Starting deletion of primary data.
[2025-10-24T21:10:58.452153] [DEBUG] [LOCAL     ] SOJC: Deleted primary data file.
[2025-10-24T21:10:58.452261] [INFO ] [MAIN      ] SOJC: Starting full primary refresh.
[2025-10-24T21:10:58.554446] [INFO ] [REMOTE    ] SOBO: Fetching primary data for 2025-06.
[2025-10-24T21:10:58.776984] [INFO ] [REMOTE    ] SOC: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T21:10:58.862296] [INFO ] [REMOTE    ] SOJC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:10:59.347707] [INFO ] [REMOTE    ] SOJC: Fetching primary data for 2025-01.
[2025-10-24T21:10:59.418748] [INFO ] [REMOTE    ] SOBO: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T21:10:59.988994] [INFO ] [REMOTE    ] SOJC: Incremental fetch complete for 2025-01 (0.64 seconds).
[2025-10-24T21:11:00.147679] [INFO ] [REMOTE    ] SOBO: Fetching primary data for 2025-07.
[2025-10-24T21:11:00.914304] [INFO ] [REMOTE    ] SOBO: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T21:11:00.947617] [INFO ] [REMOTE    ] SOBO: Fetching primary data for 2025-08.
[2025-10-24T21:11:01.747978] [INFO ] [REMOTE    ] SOC: Fetching primary data for 2025-02.
[2025-10-24T21:11:01.750333] [INFO ] [REMOTE    ] SOBO: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T21:11:02.547627] [INFO ] [REMOTE    ] SO: Fetching primary data for 2025-03.
[2025-10-24T21:11:02.756801] [INFO ] [REMOTE    ] SOC: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T21:11:03.347727] [INFO ] [REMOTE    ] SOBO: Fetching primary data for 2025-09.
[2025-10-24T21:11:04.147705] [INFO ] [REMOTE    ] SOJC: Fetching primary data for 2025-02.
[2025-10-24T21:11:04.199489] [INFO ] [REMOTE    ] SO: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T21:11:04.294375] [INFO ] [REMOTE    ] SOBO: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T21:11:04.817329] [INFO ] [REMOTE    ] SOJC: Incremental fetch complete for 2025-02 (0.67 seconds).
[2025-10-24T21:11:04.947674] [INFO ] [REMOTE    ] SO: Fetching primary data for 2025-04.
[2025-10-24T21:11:05.747606] [INFO ] [REMOTE    ] SOJC: Fetching primary data for 2025-03.
[2025-10-24T21:11:05.781178] [INFO ] [REMOTE    ] SO: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T21:11:06.149757] [INFO ] [REMOTE    ] SOJC: Incremental fetch complete for 2025-03 (0.40 seconds).
[2025-10-24T21:11:06.547732] [INFO ] [REMOTE    ] SOC: Fetching primary data for 2025-03.
[2025-10-24T21:11:07.347737] [INFO ] [REMOTE    ] SOJC: Fetching primary data for 2025-04.
[2025-10-24T21:11:07.652717] [INFO ] [REMOTE    ] SOC: Incremental fetch complete for 2025-03 (1.10 seconds).
[2025-10-24T21:11:08.115187] [INFO ] [REMOTE    ] SOJC: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T21:11:08.147699] [INFO ] [REMOTE    ] SOJC: Fetching primary data for 2025-05.
[2025-10-24T21:11:08.790682] [INFO ] [REMOTE    ] SOJC: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T21:11:08.947745] [INFO ] [REMOTE    ] SO: Fetching primary data for 2025-05.
[2025-10-24T21:11:09.747734] [INFO ] [REMOTE    ] SOJC: Fetching primary data for 2025-06.
[2025-10-24T21:11:10.036718] [INFO ] [REMOTE    ] SO: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T21:11:10.407852] [INFO ] [REMOTE    ] SOJC: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T21:11:10.547681] [INFO ] [REMOTE    ] SO: Fetching primary data for 2025-06.
[2025-10-24T21:11:11.347609] [INFO ] [REMOTE    ] SOC: Fetching primary data for 2025-04.
[2025-10-24T21:11:12.025679] [INFO ] [REMOTE    ] SO: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T21:11:12.113739] [INFO ] [REMOTE    ] SOC: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T21:11:12.147620] [INFO ] [REMOTE    ] SOC: Fetching primary data for 2025-05.
[2025-10-24T21:11:12.947706] [INFO ] [REMOTE    ] SOBO: Fetching primary data for 2025-10.
[2025-10-24T21:11:13.319481] [INFO ] [REMOTE    ] SOC: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T21:11:13.381351] [INFO ] [REMOTE    ] SOBO: Incremental fetch complete for 2025-10 (0.43 seconds).
[2025-10-24T21:11:13.388721] [INFO ] [REMOTE    ] SOBO: Full fetch complete (58275 records).
[2025-10-24T21:11:13.388856] [DEBUG] [VALIDATOR ] SOBO: Validating primary data.
[2025-10-24T21:11:13.389524] [FATAL] [VALIDATOR ] SOBO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:11:13.389611] [FATAL] [MAIN      ] SOBO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:11:13.389689] [WARN ] [MAIN      ] SOBO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:11:13.389746] [INFO ] [LOCAL     ] SOBO: Starting deletion of primary data.
[2025-10-24T21:11:13.389802] [DEBUG] [LOCAL     ] SOBO: No primary data file found to delete.
[2025-10-24T21:11:13.389837] [INFO ] [LOCAL     ] SOBO: Starting deletion of derivative data.
[2025-10-24T21:11:13.390005] [DEBUG] [LOCAL     ] SOBO: Deleted derivative data file.
[2025-10-24T21:11:13.390322] [INFO ] [MAIN      ] Update Progress: 1953/2366 symbols completed. SOBO took 32.2s. Estimated remaining: 53m 7s. Rate: 7.8 symbols/min
[2025-10-24T21:11:13.558356] [INFO ] [MAIN      ] SOJD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:11:13.572961] [DEBUG] [LOCAL     ] SOJD: Loaded 12651 existing records from primary storage.
[2025-10-24T21:11:13.573193] [INFO ] [MAIN      ] SOJD: Loaded 12651 existing records.
[2025-10-24T21:11:13.750130] [WARN ] [MAIN      ] SOJD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:11:13.750218] [INFO ] [REMOTE    ] SO: Fetching primary data for 2025-07.
[2025-10-24T21:11:13.751197] [INFO ] [MAIN      ] SOJD: Wiping existing primary data before full refresh.
[2025-10-24T21:11:13.751266] [INFO ] [LOCAL     ] SOJD: Starting deletion of primary data.
[2025-10-24T21:11:13.751462] [DEBUG] [LOCAL     ] SOJD: Deleted primary data file.
[2025-10-24T21:11:13.751499] [INFO ] [MAIN      ] SOJD: Starting full primary refresh.
[2025-10-24T21:11:14.116368] [INFO ] [REMOTE    ] SOJD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:11:14.547703] [INFO ] [REMOTE    ] SOJC: Fetching primary data for 2025-07.
[2025-10-24T21:11:14.881329] [INFO ] [REMOTE    ] SO: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T21:11:15.144769] [INFO ] [REMOTE    ] SOJC: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T21:11:15.347695] [INFO ] [REMOTE    ] SOC: Fetching primary data for 2025-06.
[2025-10-24T21:11:16.147702] [INFO ] [REMOTE    ] SOJC: Fetching primary data for 2025-08.
[2025-10-24T21:11:16.250539] [INFO ] [REMOTE    ] SOC: Incremental fetch complete for 2025-06 (0.90 seconds).
[2025-10-24T21:11:16.556841] [INFO ] [REMOTE    ] SOJC: Incremental fetch complete for 2025-08 (0.41 seconds).
[2025-10-24T21:11:16.947698] [INFO ] [REMOTE    ] SOC: Fetching primary data for 2025-07.
[2025-10-24T21:11:17.747696] [INFO ] [REMOTE    ] SOJD: Fetching primary data for 2025-01.
[2025-10-24T21:11:17.803849] [INFO ] [REMOTE    ] SOC: Incremental fetch complete for 2025-07 (0.86 seconds).
[2025-10-24T21:11:18.477324] [INFO ] [REMOTE    ] SOJD: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T21:11:18.547608] [INFO ] [REMOTE    ] SO: Fetching primary data for 2025-08.
[2025-10-24T21:11:19.347703] [INFO ] [REMOTE    ] SOJC: Fetching primary data for 2025-09.
[2025-10-24T21:11:19.731362] [INFO ] [REMOTE    ] SO: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T21:11:19.906064] [INFO ] [REMOTE    ] SOJC: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T21:11:20.147724] [INFO ] [REMOTE    ] SOJD: Fetching primary data for 2025-02.
[2025-10-24T21:11:20.678158] [INFO ] [REMOTE    ] SOJD: Incremental fetch complete for 2025-02 (0.53 seconds).
[2025-10-24T21:11:20.947632] [INFO ] [REMOTE    ] SOJD: Fetching primary data for 2025-03.
[2025-10-24T21:11:21.464048] [INFO ] [REMOTE    ] SOJD: Incremental fetch complete for 2025-03 (0.52 seconds).
[2025-10-24T21:11:21.747620] [INFO ] [REMOTE    ] SOJC: Fetching primary data for 2025-10.
[2025-10-24T21:11:22.051720] [INFO ] [REMOTE    ] SOJC: Incremental fetch complete for 2025-10 (0.30 seconds).
[2025-10-24T21:11:22.052861] [INFO ] [REMOTE    ] SOJC: Full fetch complete (7175 records).
[2025-10-24T21:11:22.052930] [DEBUG] [VALIDATOR ] SOJC: Validating primary data.
[2025-10-24T21:11:22.053274] [FATAL] [VALIDATOR ] SOJC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:11:22.053354] [FATAL] [MAIN      ] SOJC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:11:22.053397] [WARN ] [MAIN      ] SOJC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:11:22.053460] [INFO ] [LOCAL     ] SOJC: Starting deletion of primary data.
[2025-10-24T21:11:22.053521] [DEBUG] [LOCAL     ] SOJC: No primary data file found to delete.
[2025-10-24T21:11:22.053556] [INFO ] [LOCAL     ] SOJC: Starting deletion of derivative data.
[2025-10-24T21:11:22.053719] [DEBUG] [LOCAL     ] SOJC: Deleted derivative data file.
[2025-10-24T21:11:22.053805] [INFO ] [MAIN      ] Update Progress: 1954/2366 symbols completed. SOJC took 24.0s. Estimated remaining: 52m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:11:22.222129] [INFO ] [MAIN      ] SOJE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:11:22.232618] [DEBUG] [LOCAL     ] SOJE: Loaded 8744 existing records from primary storage.
[2025-10-24T21:11:22.232871] [INFO ] [MAIN      ] SOJE: Loaded 8744 existing records.
[2025-10-24T21:11:22.413758] [WARN ] [MAIN      ] SOJE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:11:22.413986] [INFO ] [MAIN      ] SOJE: Wiping existing primary data before full refresh.
[2025-10-24T21:11:22.414034] [INFO ] [LOCAL     ] SOJE: Starting deletion of primary data.
[2025-10-24T21:11:22.414234] [DEBUG] [LOCAL     ] SOJE: Deleted primary data file.
[2025-10-24T21:11:22.414289] [INFO ] [MAIN      ] SOJE: Starting full primary refresh.
[2025-10-24T21:11:22.552825] [INFO ] [REMOTE    ] SO: Fetching primary data for 2025-09.
[2025-10-24T21:11:22.773112] [INFO ] [REMOTE    ] SOJE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:11:23.347680] [INFO ] [REMOTE    ] SOC: Fetching primary data for 2025-08.
[2025-10-24T21:11:23.657106] [INFO ] [REMOTE    ] SO: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T21:11:24.147618] [INFO ] [REMOTE    ] SO: Fetching primary data for 2025-10.
[2025-10-24T21:11:24.537496] [INFO ] [REMOTE    ] SOC: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T21:11:24.871357] [INFO ] [REMOTE    ] SO: Incremental fetch complete for 2025-10 (0.72 seconds).
[2025-10-24T21:11:24.881367] [INFO ] [REMOTE    ] SO: Full fetch complete (77388 records).
[2025-10-24T21:11:24.881521] [DEBUG] [VALIDATOR ] SO: Validating primary data.
[2025-10-24T21:11:24.882300] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:11:24.882390] [FATAL] [MAIN      ] SO: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:11:24.882433] [WARN ] [MAIN      ] SO: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:11:24.882472] [INFO ] [LOCAL     ] SO: Starting deletion of primary data.
[2025-10-24T21:11:24.882529] [DEBUG] [LOCAL     ] SO: No primary data file found to delete.
[2025-10-24T21:11:24.882565] [INFO ] [LOCAL     ] SO: Starting deletion of derivative data.
[2025-10-24T21:11:24.882748] [DEBUG] [LOCAL     ] SO: Deleted derivative data file.
[2025-10-24T21:11:24.883320] [INFO ] [MAIN      ] Update Progress: 1955/2366 symbols completed. SO took 46.1s. Estimated remaining: 52m 51s. Rate: 7.8 symbols/min
[2025-10-24T21:11:24.952877] [INFO ] [REMOTE    ] SOJD: Fetching primary data for 2025-04.
[2025-10-24T21:11:25.058421] [INFO ] [MAIN      ] SOJF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:11:25.058635] [DEBUG] [LOCAL     ] SOJF: No existing data file found in primary storage.
[2025-10-24T21:11:25.058715] [WARN ] [MAIN      ] SOJF: No existing data found, performing full refresh instead.
[2025-10-24T21:11:25.058796] [INFO ] [MAIN      ] SOJF: Wiping existing primary data before full refresh.
[2025-10-24T21:11:25.058835] [INFO ] [LOCAL     ] SOJF: Starting deletion of primary data.
[2025-10-24T21:11:25.058876] [DEBUG] [LOCAL     ] SOJF: No primary data file found to delete.
[2025-10-24T21:11:25.058909] [INFO ] [MAIN      ] SOJF: Starting full primary refresh.
[2025-10-24T21:11:25.410473] [INFO ] [REMOTE    ] SOJF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:11:25.747635] [INFO ] [REMOTE    ] SOC: Fetching primary data for 2025-09.
[2025-10-24T21:11:25.850315] [INFO ] [REMOTE    ] SOJD: Incremental fetch complete for 2025-04 (0.90 seconds).
[2025-10-24T21:11:26.555569] [INFO ] [REMOTE    ] SOJE: Fetching primary data for 2025-01.
[2025-10-24T21:11:26.585043] [INFO ] [REMOTE    ] SOC: Incremental fetch complete for 2025-09 (0.84 seconds).
[2025-10-24T21:11:27.058380] [INFO ] [REMOTE    ] SOJE: Incremental fetch complete for 2025-01 (0.50 seconds).
[2025-10-24T21:11:27.347723] [INFO ] [REMOTE    ] SOJF: Fetching primary data for 2025-01.
[2025-10-24T21:11:28.147621] [INFO ] [REMOTE    ] SOJD: Fetching primary data for 2025-05.
[2025-10-24T21:11:28.405804] [INFO ] [REMOTE    ] SOJF: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T21:11:28.722009] [INFO ] [REMOTE    ] SOJD: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T21:11:28.947636] [INFO ] [REMOTE    ] SOC: Fetching primary data for 2025-10.
[2025-10-24T21:11:29.687404] [INFO ] [REMOTE    ] SOC: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T21:11:29.696626] [INFO ] [REMOTE    ] SOC: Full fetch complete (71954 records).
[2025-10-24T21:11:29.696776] [DEBUG] [VALIDATOR ] SOC: Validating primary data.
[2025-10-24T21:11:29.697490] [FATAL] [VALIDATOR ] SOC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:11:29.697586] [FATAL] [MAIN      ] SOC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:11:29.697627] [WARN ] [MAIN      ] SOC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:11:29.697701] [INFO ] [LOCAL     ] SOC: Starting deletion of primary data.
[2025-10-24T21:11:29.697765] [DEBUG] [LOCAL     ] SOC: No primary data file found to delete.
[2025-10-24T21:11:29.697799] [INFO ] [LOCAL     ] SOC: Starting deletion of derivative data.
[2025-10-24T21:11:29.697977] [DEBUG] [LOCAL     ] SOC: Deleted derivative data file.
[2025-10-24T21:11:29.698303] [INFO ] [MAIN      ] Update Progress: 1956/2366 symbols completed. SOC took 33.4s. Estimated remaining: 52m 42s. Rate: 7.8 symbols/min
[2025-10-24T21:11:29.752867] [INFO ] [REMOTE    ] SOJD: Fetching primary data for 2025-06.
[2025-10-24T21:11:29.870913] [INFO ] [MAIN      ] SOL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:11:29.887623] [DEBUG] [LOCAL     ] SOL: Loaded 13627 existing records from primary storage.
[2025-10-24T21:11:29.887889] [INFO ] [MAIN      ] SOL: Loaded 13627 existing records.
[2025-10-24T21:11:30.071936] [WARN ] [MAIN      ] SOL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:11:30.072123] [INFO ] [MAIN      ] SOL: Wiping existing primary data before full refresh.
[2025-10-24T21:11:30.072168] [INFO ] [LOCAL     ] SOL: Starting deletion of primary data.
[2025-10-24T21:11:30.072349] [DEBUG] [LOCAL     ] SOL: Deleted primary data file.
[2025-10-24T21:11:30.072386] [INFO ] [MAIN      ] SOL: Starting full primary refresh.
[2025-10-24T21:11:30.389022] [INFO ] [REMOTE    ] SOJD: Incremental fetch complete for 2025-06 (0.64 seconds).
[2025-10-24T21:11:30.467782] [INFO ] [REMOTE    ] SOL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:11:30.547631] [INFO ] [REMOTE    ] SOL: Fetching primary data for 2025-01.
[2025-10-24T21:11:31.125338] [INFO ] [REMOTE    ] SOL: Incremental fetch complete for 2025-01 (0.58 seconds).
[2025-10-24T21:11:31.347639] [INFO ] [REMOTE    ] SOL: Fetching primary data for 2025-02.
[2025-10-24T21:11:32.147675] [INFO ] [REMOTE    ] SOJE: Fetching primary data for 2025-02.
[2025-10-24T21:11:32.162443] [INFO ] [REMOTE    ] SOL: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T21:11:32.932408] [INFO ] [REMOTE    ] SOJE: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T21:11:32.947619] [INFO ] [REMOTE    ] SOJF: Fetching primary data for 2025-02.
[2025-10-24T21:11:33.420303] [INFO ] [REMOTE    ] SOJF: Incremental fetch complete for 2025-02 (0.47 seconds).
[2025-10-24T21:11:33.747695] [INFO ] [REMOTE    ] SOJD: Fetching primary data for 2025-07.
[2025-10-24T21:11:34.547767] [INFO ] [REMOTE    ] SOL: Fetching primary data for 2025-03.
[2025-10-24T21:11:34.905170] [INFO ] [REMOTE    ] SOJD: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T21:11:34.985547] [INFO ] [REMOTE    ] SOL: Incremental fetch complete for 2025-03 (0.44 seconds).
[2025-10-24T21:11:35.347705] [INFO ] [REMOTE    ] SOJD: Fetching primary data for 2025-08.
[2025-10-24T21:11:35.870148] [INFO ] [REMOTE    ] SOJD: Incremental fetch complete for 2025-08 (0.52 seconds).
[2025-10-24T21:11:36.147706] [INFO ] [REMOTE    ] SOJD: Fetching primary data for 2025-09.
[2025-10-24T21:11:36.751183] [INFO ] [REMOTE    ] SOJD: Incremental fetch complete for 2025-09 (0.60 seconds).
[2025-10-24T21:11:36.947687] [INFO ] [REMOTE    ] SOJF: Fetching primary data for 2025-03.
[2025-10-24T21:11:37.749174] [INFO ] [REMOTE    ] SOJD: Fetching primary data for 2025-10.
[2025-10-24T21:11:37.752252] [INFO ] [REMOTE    ] SOJF: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T21:11:38.337143] [INFO ] [REMOTE    ] SOJD: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T21:11:38.339743] [INFO ] [REMOTE    ] SOJD: Full fetch complete (18992 records).
[2025-10-24T21:11:38.339821] [DEBUG] [VALIDATOR ] SOJD: Validating primary data.
[2025-10-24T21:11:38.340345] [FATAL] [VALIDATOR ] SOJD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:11:38.340436] [FATAL] [MAIN      ] SOJD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:11:38.340478] [WARN ] [MAIN      ] SOJD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:11:38.340536] [INFO ] [LOCAL     ] SOJD: Starting deletion of primary data.
[2025-10-24T21:11:38.340624] [DEBUG] [LOCAL     ] SOJD: No primary data file found to delete.
[2025-10-24T21:11:38.340721] [INFO ] [LOCAL     ] SOJD: Starting deletion of derivative data.
[2025-10-24T21:11:38.340937] [DEBUG] [LOCAL     ] SOJD: Deleted derivative data file.
[2025-10-24T21:11:38.341038] [INFO ] [MAIN      ] Update Progress: 1957/2366 symbols completed. SOJD took 25.0s. Estimated remaining: 52m 35s. Rate: 7.8 symbols/min
[2025-10-24T21:11:38.547705] [INFO ] [REMOTE    ] SOL: Fetching primary data for 2025-04.
[2025-10-24T21:11:39.038253] [INFO ] [REMOTE    ] SOL: Incremental fetch complete for 2025-04 (0.49 seconds).
[2025-10-24T21:11:39.347718] [INFO ] [REMOTE    ] SOJE: Fetching primary data for 2025-03.
[2025-10-24T21:11:40.147677] [INFO ] [REMOTE    ] SOJF: Fetching primary data for 2025-04.
[2025-10-24T21:11:40.232017] [INFO ] [REMOTE    ] SOJE: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T21:11:40.605397] [INFO ] [REMOTE    ] SOJF: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T21:11:40.947612] [INFO ] [REMOTE    ] SOJF: Fetching primary data for 2025-05.
[2025-10-24T21:11:41.737742] [INFO ] [REMOTE    ] SOJF: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T21:11:41.747592] [INFO ] [REMOTE    ] SOJF: Fetching primary data for 2025-06.
[2025-10-24T21:11:42.389890] [INFO ] [REMOTE    ] SOJF: Incremental fetch complete for 2025-06 (0.64 seconds).
[2025-10-24T21:11:42.547709] [INFO ] [REMOTE    ] SOL: Fetching primary data for 2025-05.
[2025-10-24T21:11:43.312372] [INFO ] [REMOTE    ] SOL: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T21:11:43.347614] [INFO ] [REMOTE    ] SOL: Fetching primary data for 2025-06.
[2025-10-24T21:11:43.919892] [INFO ] [REMOTE    ] SOL: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T21:11:44.147740] [INFO ] [REMOTE    ] SOJF: Fetching primary data for 2025-07.
[2025-10-24T21:11:44.947736] [INFO ] [REMOTE    ] SOJE: Fetching primary data for 2025-04.
[2025-10-24T21:11:45.037925] [INFO ] [REMOTE    ] SOJF: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T21:11:45.421283] [INFO ] [REMOTE    ] SOJE: Incremental fetch complete for 2025-04 (0.47 seconds).
[2025-10-24T21:11:45.747719] [INFO ] [REMOTE    ] SOJF: Fetching primary data for 2025-08.
[2025-10-24T21:11:46.209613] [INFO ] [REMOTE    ] SOJF: Incremental fetch complete for 2025-08 (0.46 seconds).
[2025-10-24T21:11:46.547718] [INFO ] [REMOTE    ] SOJE: Fetching primary data for 2025-05.
[2025-10-24T21:11:47.165144] [INFO ] [REMOTE    ] SOJE: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T21:11:47.347633] [INFO ] [REMOTE    ] SOJE: Fetching primary data for 2025-06.
[2025-10-24T21:11:47.816428] [INFO ] [REMOTE    ] SOJE: Incremental fetch complete for 2025-06 (0.47 seconds).
[2025-10-24T21:11:48.147733] [INFO ] [REMOTE    ] SOL: Fetching primary data for 2025-07.
[2025-10-24T21:11:48.947626] [INFO ] [REMOTE    ] SOJE: Fetching primary data for 2025-07.
[2025-10-24T21:11:49.111184] [INFO ] [REMOTE    ] SOL: Incremental fetch complete for 2025-07 (0.96 seconds).
[2025-10-24T21:11:49.187459] [INFO ] [REMOTE    ] SOJE: Incremental fetch complete for 2025-07 (0.24 seconds).
[2025-10-24T21:11:49.747711] [INFO ] [REMOTE    ] SOJE: Fetching primary data for 2025-08.
[2025-10-24T21:11:50.547689] [INFO ] [REMOTE    ] SOJF: Fetching primary data for 2025-09.
[2025-10-24T21:11:50.647183] [INFO ] [REMOTE    ] SOJE: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T21:11:51.179617] [INFO ] [REMOTE    ] SOJF: Incremental fetch complete for 2025-09 (0.63 seconds).
[2025-10-24T21:11:51.347758] [INFO ] [REMOTE    ] SOL: Fetching primary data for 2025-08.
[2025-10-24T21:11:52.087250] [INFO ] [REMOTE    ] SOL: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T21:11:52.147722] [INFO ] [REMOTE    ] SOJE: Fetching primary data for 2025-09.
[2025-10-24T21:11:52.876359] [INFO ] [REMOTE    ] SOJE: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T21:11:52.947621] [INFO ] [REMOTE    ] SOJF: Fetching primary data for 2025-10.
[2025-10-24T21:11:53.539369] [INFO ] [REMOTE    ] SOJF: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T21:11:53.541059] [INFO ] [REMOTE    ] SOJF: Full fetch complete (14155 records).
[2025-10-24T21:11:53.541130] [DEBUG] [VALIDATOR ] SOJF: Validating primary data.
[2025-10-24T21:11:53.541555] [FATAL] [VALIDATOR ] SOJF: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:11:53.541685] [FATAL] [MAIN      ] SOJF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:11:53.541739] [WARN ] [MAIN      ] SOJF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:11:53.541778] [INFO ] [LOCAL     ] SOJF: Starting deletion of primary data.
[2025-10-24T21:11:53.541832] [DEBUG] [LOCAL     ] SOJF: No primary data file found to delete.
[2025-10-24T21:11:53.541866] [INFO ] [LOCAL     ] SOJF: Starting deletion of derivative data.
[2025-10-24T21:11:53.541907] [DEBUG] [LOCAL     ] SOJF: No derivative data file found to delete.
[2025-10-24T21:11:53.541981] [INFO ] [MAIN      ] Update Progress: 1958/2366 symbols completed. SOJF took 28.7s. Estimated remaining: 52m 29s. Rate: 7.8 symbols/min
[2025-10-24T21:11:53.747636] [INFO ] [REMOTE    ] SOL: Fetching primary data for 2025-09.
[2025-10-24T21:11:54.547710] [INFO ] [REMOTE    ] SOJE: Fetching primary data for 2025-10.
[2025-10-24T21:11:54.562985] [INFO ] [REMOTE    ] SOL: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T21:11:54.933097] [INFO ] [REMOTE    ] SOJE: Incremental fetch complete for 2025-10 (0.39 seconds).
[2025-10-24T21:11:54.935413] [INFO ] [REMOTE    ] SOJE: Full fetch complete (13374 records).
[2025-10-24T21:11:54.935497] [DEBUG] [VALIDATOR ] SOJE: Validating primary data.
[2025-10-24T21:11:54.935926] [FATAL] [VALIDATOR ] SOJE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:11:54.936019] [FATAL] [MAIN      ] SOJE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:11:54.936105] [WARN ] [MAIN      ] SOJE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:11:54.936195] [INFO ] [LOCAL     ] SOJE: Starting deletion of primary data.
[2025-10-24T21:11:54.936273] [DEBUG] [LOCAL     ] SOJE: No primary data file found to delete.
[2025-10-24T21:11:54.936309] [INFO ] [LOCAL     ] SOJE: Starting deletion of derivative data.
[2025-10-24T21:11:54.936458] [DEBUG] [LOCAL     ] SOJE: Deleted derivative data file.
[2025-10-24T21:11:54.936541] [INFO ] [MAIN      ] Update Progress: 1959/2366 symbols completed. SOJE took 32.9s. Estimated remaining: 52m 20s. Rate: 7.8 symbols/min
[2025-10-24T21:11:55.347730] [INFO ] [REMOTE    ] SOL: Fetching primary data for 2025-10.
[2025-10-24T21:11:56.587680] [INFO ] [REMOTE    ] SOL: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T21:11:56.591173] [INFO ] [REMOTE    ] SOL: Full fetch complete (20806 records).
[2025-10-24T21:11:56.591271] [DEBUG] [VALIDATOR ] SOL: Validating primary data.
[2025-10-24T21:11:56.591736] [FATAL] [VALIDATOR ] SOL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:11:56.591821] [FATAL] [MAIN      ] SOL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:11:56.591865] [WARN ] [MAIN      ] SOL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:11:56.591902] [INFO ] [LOCAL     ] SOL: Starting deletion of primary data.
[2025-10-24T21:11:56.591958] [DEBUG] [LOCAL     ] SOL: No primary data file found to delete.
[2025-10-24T21:11:56.591992] [INFO ] [LOCAL     ] SOL: Starting deletion of derivative data.
[2025-10-24T21:11:56.592181] [DEBUG] [LOCAL     ] SOL: Deleted derivative data file.
[2025-10-24T21:11:56.592267] [INFO ] [MAIN      ] Update Progress: 1960/2366 symbols completed. SOL took 26.9s. Estimated remaining: 52m 11s. Rate: 7.8 symbols/min
[2025-10-24T21:11:57.161805] [INFO ] [MAIN      ] SOR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:11:57.286137] [INFO ] [MAIN      ] SOLV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:11:57.285177] [INFO ] [MAIN      ] SONY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:11:57.359039] [INFO ] [MAIN      ] SON: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:11:57.363637] [DEBUG] [LOCAL     ] SOR: Loaded 2831 existing records from primary storage.
[2025-10-24T21:11:57.364938] [INFO ] [MAIN      ] SOR: Loaded 2831 existing records.
[2025-10-24T21:11:57.594934] [WARN ] [MAIN      ] SOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:11:57.595812] [INFO ] [MAIN      ] SOR: Wiping existing primary data before full refresh.
[2025-10-24T21:11:57.595884] [INFO ] [LOCAL     ] SOR: Starting deletion of primary data.
[2025-10-24T21:11:57.596026] [DEBUG] [LOCAL     ] SOR: Deleted primary data file.
[2025-10-24T21:11:57.596146] [INFO ] [MAIN      ] SOR: Starting full primary refresh.
[2025-10-24T21:11:57.697156] [DEBUG] [LOCAL     ] SOLV: Loaded 43676 existing records from primary storage.
[2025-10-24T21:11:57.742193] [INFO ] [MAIN      ] SOLV: Loaded 43676 existing records.
[2025-10-24T21:11:57.742011] [DEBUG] [LOCAL     ] SON: Loaded 43926 existing records from primary storage.
[2025-10-24T21:11:57.778204] [INFO ] [MAIN      ] SON: Loaded 43926 existing records.
[2025-10-24T21:11:57.779047] [DEBUG] [LOCAL     ] SONY: Loaded 53765 existing records from primary storage.
[2025-10-24T21:11:57.862054] [INFO ] [MAIN      ] SONY: Loaded 53765 existing records.
[2025-10-24T21:11:58.260131] [WARN ] [MAIN      ] SOLV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:11:58.354008] [INFO ] [MAIN      ] SOLV: Wiping existing primary data before full refresh.
[2025-10-24T21:11:58.407208] [WARN ] [MAIN      ] SON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:11:58.429440] [INFO ] [LOCAL     ] SOLV: Starting deletion of primary data.
[2025-10-24T21:11:58.458702] [INFO ] [MAIN      ] SON: Wiping existing primary data before full refresh.
[2025-10-24T21:11:58.482233] [DEBUG] [LOCAL     ] SOLV: Deleted primary data file.
[2025-10-24T21:11:58.489798] [INFO ] [LOCAL     ] SON: Starting deletion of primary data.
[2025-10-24T21:11:58.482381] [INFO ] [MAIN      ] SOLV: Starting full primary refresh.
[2025-10-24T21:11:58.496677] [WARN ] [MAIN      ] SONY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:11:58.541495] [INFO ] [MAIN      ] SONY: Wiping existing primary data before full refresh.
[2025-10-24T21:11:58.542052] [INFO ] [LOCAL     ] SONY: Starting deletion of primary data.
[2025-10-24T21:11:58.574850] [DEBUG] [LOCAL     ] SON: Deleted primary data file.
[2025-10-24T21:11:58.585377] [DEBUG] [LOCAL     ] SONY: Deleted primary data file.
[2025-10-24T21:11:58.575056] [INFO ] [MAIN      ] SON: Starting full primary refresh.
[2025-10-24T21:11:58.619470] [INFO ] [MAIN      ] SONY: Starting full primary refresh.
[2025-10-24T21:11:58.784702] [INFO ] [REMOTE    ] SOR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:11:58.889721] [INFO ] [REMOTE    ] SOR: Fetching primary data for 2025-01.
[2025-10-24T21:11:59.543175] [INFO ] [REMOTE    ] SOR: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T21:11:59.605053] [INFO ] [REMOTE    ] SONY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:11:59.641018] [INFO ] [REMOTE    ] SOR: Fetching primary data for 2025-02.
[2025-10-24T21:11:59.642028] [INFO ] [REMOTE    ] SONY: Fetching primary data for 2025-01.
[2025-10-24T21:11:59.707941] [INFO ] [REMOTE    ] SON: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:11:59.715881] [INFO ] [REMOTE    ] SON: Fetching primary data for 2025-01.
[2025-10-24T21:11:59.738340] [INFO ] [REMOTE    ] SOLV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:11:59.738638] [INFO ] [REMOTE    ] SOLV: Fetching primary data for 2025-01.
[2025-10-24T21:11:59.871602] [INFO ] [REMOTE    ] SOR: Incremental fetch complete for 2025-02 (0.23 seconds).
[2025-10-24T21:12:00.147711] [INFO ] [REMOTE    ] SOR: Fetching primary data for 2025-03.
[2025-10-24T21:12:00.468473] [INFO ] [REMOTE    ] SON: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T21:12:00.558521] [INFO ] [REMOTE    ] SOLV: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T21:12:00.785614] [INFO ] [REMOTE    ] SONY: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T21:12:00.815850] [INFO ] [REMOTE    ] SOR: Incremental fetch complete for 2025-03 (0.67 seconds).
[2025-10-24T21:12:00.947691] [INFO ] [REMOTE    ] SOR: Fetching primary data for 2025-04.
[2025-10-24T21:12:01.633805] [INFO ] [REMOTE    ] SOR: Incremental fetch complete for 2025-04 (0.69 seconds).
[2025-10-24T21:12:01.747633] [INFO ] [REMOTE    ] SOR: Fetching primary data for 2025-05.
[2025-10-24T21:12:02.126087] [INFO ] [REMOTE    ] SOR: Incremental fetch complete for 2025-05 (0.38 seconds).
[2025-10-24T21:12:02.547732] [INFO ] [REMOTE    ] SON: Fetching primary data for 2025-02.
[2025-10-24T21:12:03.347607] [INFO ] [REMOTE    ] SOLV: Fetching primary data for 2025-02.
[2025-10-24T21:12:03.763783] [INFO ] [REMOTE    ] SON: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T21:12:04.147697] [INFO ] [REMOTE    ] SOR: Fetching primary data for 2025-06.
[2025-10-24T21:12:04.469330] [INFO ] [REMOTE    ] SOLV: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T21:12:04.817636] [INFO ] [REMOTE    ] SOR: Incremental fetch complete for 2025-06 (0.67 seconds).
[2025-10-24T21:12:04.947694] [INFO ] [REMOTE    ] SOLV: Fetching primary data for 2025-03.
[2025-10-24T21:12:05.709390] [INFO ] [REMOTE    ] SOLV: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T21:12:05.747716] [INFO ] [REMOTE    ] SONY: Fetching primary data for 2025-02.
[2025-10-24T21:12:06.530683] [INFO ] [REMOTE    ] SONY: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T21:12:06.547605] [INFO ] [REMOTE    ] SOR: Fetching primary data for 2025-07.
[2025-10-24T21:12:07.073823] [INFO ] [REMOTE    ] SOR: Incremental fetch complete for 2025-07 (0.53 seconds).
[2025-10-24T21:12:07.347685] [INFO ] [REMOTE    ] SOR: Fetching primary data for 2025-08.
[2025-10-24T21:12:08.147611] [INFO ] [REMOTE    ] SON: Fetching primary data for 2025-03.
[2025-10-24T21:12:08.299903] [INFO ] [REMOTE    ] SOR: Incremental fetch complete for 2025-08 (0.95 seconds).
[2025-10-24T21:12:08.947632] [INFO ] [REMOTE    ] SOR: Fetching primary data for 2025-09.
[2025-10-24T21:12:09.118368] [INFO ] [REMOTE    ] SON: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T21:12:09.243825] [INFO ] [REMOTE    ] SOR: Incremental fetch complete for 2025-09 (0.30 seconds).
[2025-10-24T21:12:09.747708] [INFO ] [REMOTE    ] SONY: Fetching primary data for 2025-03.
[2025-10-24T21:12:10.547624] [INFO ] [REMOTE    ] SOR: Fetching primary data for 2025-10.
[2025-10-24T21:12:10.596573] [INFO ] [REMOTE    ] SONY: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T21:12:11.215802] [INFO ] [REMOTE    ] SOR: Incremental fetch complete for 2025-10 (0.67 seconds).
[2025-10-24T21:12:11.216922] [INFO ] [REMOTE    ] SOR: Full fetch complete (4339 records).
[2025-10-24T21:12:11.216995] [DEBUG] [VALIDATOR ] SOR: Validating primary data.
[2025-10-24T21:12:11.217400] [FATAL] [VALIDATOR ] SOR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:12:11.217511] [FATAL] [MAIN      ] SOR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:12:11.217590] [WARN ] [MAIN      ] SOR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:12:11.217684] [INFO ] [LOCAL     ] SOR: Starting deletion of primary data.
[2025-10-24T21:12:11.217771] [DEBUG] [LOCAL     ] SOR: No primary data file found to delete.
[2025-10-24T21:12:11.217824] [INFO ] [LOCAL     ] SOR: Starting deletion of derivative data.
[2025-10-24T21:12:11.218247] [DEBUG] [LOCAL     ] SOR: Deleted derivative data file.
[2025-10-24T21:12:11.218334] [INFO ] [MAIN      ] Update Progress: 1961/2366 symbols completed. SOR took 14.6s. Estimated remaining: 52m 4s. Rate: 7.8 symbols/min
[2025-10-24T21:12:11.352779] [INFO ] [REMOTE    ] SOLV: Fetching primary data for 2025-04.
[2025-10-24T21:12:11.396568] [INFO ] [MAIN      ] SOS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:12:11.408502] [DEBUG] [LOCAL     ] SOS: Loaded 9744 existing records from primary storage.
[2025-10-24T21:12:11.408760] [INFO ] [MAIN      ] SOS: Loaded 9744 existing records.
[2025-10-24T21:12:11.589708] [WARN ] [MAIN      ] SOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:12:11.589936] [INFO ] [MAIN      ] SOS: Wiping existing primary data before full refresh.
[2025-10-24T21:12:11.589981] [INFO ] [LOCAL     ] SOS: Starting deletion of primary data.
[2025-10-24T21:12:11.590117] [DEBUG] [LOCAL     ] SOS: Deleted primary data file.
[2025-10-24T21:12:11.590155] [INFO ] [MAIN      ] SOS: Starting full primary refresh.
[2025-10-24T21:12:11.947772] [INFO ] [REMOTE    ] SOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:12:12.147709] [INFO ] [REMOTE    ] SON: Fetching primary data for 2025-04.
[2025-10-24T21:12:12.254233] [DEBUG] [REMOTE    ] SON: Error fetching primary data for 2025-04: 'API call returned an empty response.'
[2025-10-24T21:12:12.254744] [WARN ] [REMOTE    ] SON: No data returned for month 2025-04
[2025-10-24T21:12:12.254845] [FATAL] [REMOTE    ] SON: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:12:12.254977] [FATAL] [MAIN      ] SON: Failed to fetch primary data.
[2025-10-24T21:12:12.255047] [WARN ] [MAIN      ] SON: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:12:12.255125] [INFO ] [LOCAL     ] SON: Starting deletion of primary data.
[2025-10-24T21:12:12.255230] [DEBUG] [LOCAL     ] SON: No primary data file found to delete.
[2025-10-24T21:12:12.255270] [INFO ] [LOCAL     ] SON: Starting deletion of derivative data.
[2025-10-24T21:12:12.255607] [DEBUG] [LOCAL     ] SON: Deleted derivative data file.
[2025-10-24T21:12:12.255733] [INFO ] [MAIN      ] Update Progress: 1962/2366 symbols completed. SON took 15.7s. Estimated remaining: 51m 55s. Rate: 7.8 symbols/min
[2025-10-24T21:12:12.452408] [INFO ] [MAIN      ] SPB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:12:12.492691] [DEBUG] [LOCAL     ] SPB: Loaded 34159 existing records from primary storage.
[2025-10-24T21:12:12.493178] [INFO ] [MAIN      ] SPB: Loaded 34159 existing records.
[2025-10-24T21:12:12.692801] [WARN ] [MAIN      ] SPB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:12:12.693084] [INFO ] [MAIN      ] SPB: Wiping existing primary data before full refresh.
[2025-10-24T21:12:12.693145] [INFO ] [LOCAL     ] SPB: Starting deletion of primary data.
[2025-10-24T21:12:12.693591] [DEBUG] [LOCAL     ] SPB: Deleted primary data file.
[2025-10-24T21:12:12.693685] [INFO ] [MAIN      ] SPB: Starting full primary refresh.
[2025-10-24T21:12:12.954404] [INFO ] [REMOTE    ] SOS: Fetching primary data for 2025-01.
[2025-10-24T21:12:13.025626] [INFO ] [REMOTE    ] SOLV: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T21:12:13.138984] [INFO ] [REMOTE    ] SPB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:12:13.707387] [INFO ] [REMOTE    ] SOS: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T21:12:13.747673] [INFO ] [REMOTE    ] SPB: Fetching primary data for 2025-01.
[2025-10-24T21:12:14.357369] [INFO ] [REMOTE    ] SPB: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T21:12:14.547711] [INFO ] [REMOTE    ] SOLV: Fetching primary data for 2025-05.
[2025-10-24T21:12:15.347729] [INFO ] [REMOTE    ] SPB: Fetching primary data for 2025-02.
[2025-10-24T21:12:15.812619] [INFO ] [REMOTE    ] SOLV: Incremental fetch complete for 2025-05 (1.26 seconds).
[2025-10-24T21:12:15.879028] [INFO ] [REMOTE    ] SPB: Incremental fetch complete for 2025-02 (0.53 seconds).
[2025-10-24T21:12:16.147703] [INFO ] [REMOTE    ] SPB: Fetching primary data for 2025-03.
[2025-10-24T21:12:16.862834] [INFO ] [REMOTE    ] SPB: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T21:12:16.947639] [INFO ] [REMOTE    ] SPB: Fetching primary data for 2025-04.
[2025-10-24T21:12:17.677275] [INFO ] [REMOTE    ] SPB: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T21:12:17.747611] [INFO ] [REMOTE    ] SPB: Fetching primary data for 2025-05.
[2025-10-24T21:12:18.531247] [INFO ] [REMOTE    ] SPB: Incremental fetch complete for 2025-05 (0.78 seconds).
[2025-10-24T21:12:18.547614] [INFO ] [REMOTE    ] SOLV: Fetching primary data for 2025-06.
[2025-10-24T21:12:19.347634] [INFO ] [REMOTE    ] SONY: Fetching primary data for 2025-04.
[2025-10-24T21:12:19.728015] [INFO ] [REMOTE    ] SOLV: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T21:12:20.147621] [INFO ] [REMOTE    ] SOS: Fetching primary data for 2025-02.
[2025-10-24T21:12:20.525049] [INFO ] [REMOTE    ] SOS: Incremental fetch complete for 2025-02 (0.38 seconds).
[2025-10-24T21:12:20.940256] [INFO ] [REMOTE    ] SONY: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T21:12:20.950971] [INFO ] [REMOTE    ] SOLV: Fetching primary data for 2025-07.
[2025-10-24T21:12:21.667902] [INFO ] [REMOTE    ] SOLV: Incremental fetch complete for 2025-07 (0.72 seconds).
[2025-10-24T21:12:21.747603] [INFO ] [REMOTE    ] SOLV: Fetching primary data for 2025-08.
[2025-10-24T21:12:22.547613] [INFO ] [REMOTE    ] SPB: Fetching primary data for 2025-06.
[2025-10-24T21:12:22.752454] [INFO ] [REMOTE    ] SOLV: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T21:12:23.287823] [INFO ] [REMOTE    ] SPB: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T21:12:23.347604] [INFO ] [REMOTE    ] SPB: Fetching primary data for 2025-07.
[2025-10-24T21:12:24.147732] [INFO ] [REMOTE    ] SOLV: Fetching primary data for 2025-09.
[2025-10-24T21:12:24.810391] [INFO ] [REMOTE    ] SPB: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T21:12:24.902606] [INFO ] [REMOTE    ] SOLV: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:12:24.947616] [INFO ] [REMOTE    ] SOLV: Fetching primary data for 2025-10.
[2025-10-24T21:12:25.491527] [INFO ] [REMOTE    ] SOLV: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T21:12:25.499009] [INFO ] [REMOTE    ] SOLV: Full fetch complete (63072 records).
[2025-10-24T21:12:25.499138] [DEBUG] [VALIDATOR ] SOLV: Validating primary data.
[2025-10-24T21:12:25.500017] [FATAL] [VALIDATOR ] SOLV: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:12:25.500100] [FATAL] [MAIN      ] SOLV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:12:25.500148] [WARN ] [MAIN      ] SOLV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:12:25.500227] [INFO ] [LOCAL     ] SOLV: Starting deletion of primary data.
[2025-10-24T21:12:25.500305] [DEBUG] [LOCAL     ] SOLV: No primary data file found to delete.
[2025-10-24T21:12:25.500343] [INFO ] [LOCAL     ] SOLV: Starting deletion of derivative data.
[2025-10-24T21:12:25.500538] [DEBUG] [LOCAL     ] SOLV: Deleted derivative data file.
[2025-10-24T21:12:25.500912] [INFO ] [MAIN      ] Update Progress: 1963/2366 symbols completed. SOLV took 28.9s. Estimated remaining: 51m 49s. Rate: 7.8 symbols/min
[2025-10-24T21:12:25.675224] [INFO ] [MAIN      ] SPCE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:12:25.723472] [DEBUG] [LOCAL     ] SPCE: Loaded 50424 existing records from primary storage.
[2025-10-24T21:12:25.723813] [INFO ] [MAIN      ] SPCE: Loaded 50424 existing records.
[2025-10-24T21:12:25.753633] [INFO ] [REMOTE    ] SPB: Fetching primary data for 2025-08.
[2025-10-24T21:12:25.915741] [WARN ] [MAIN      ] SPCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:12:25.915977] [INFO ] [MAIN      ] SPCE: Wiping existing primary data before full refresh.
[2025-10-24T21:12:25.916033] [INFO ] [LOCAL     ] SPCE: Starting deletion of primary data.
[2025-10-24T21:12:25.916939] [DEBUG] [LOCAL     ] SPCE: Deleted primary data file.
[2025-10-24T21:12:25.916997] [INFO ] [MAIN      ] SPCE: Starting full primary refresh.
[2025-10-24T21:12:26.285839] [INFO ] [REMOTE    ] SPCE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:12:26.547623] [INFO ] [REMOTE    ] SPCE: Fetching primary data for 2025-01.
[2025-10-24T21:12:26.738157] [INFO ] [REMOTE    ] SPB: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T21:12:27.347625] [INFO ] [REMOTE    ] SONY: Fetching primary data for 2025-05.
[2025-10-24T21:12:27.590973] [INFO ] [REMOTE    ] SPCE: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T21:12:28.147760] [INFO ] [REMOTE    ] SOS: Fetching primary data for 2025-03.
[2025-10-24T21:12:28.148783] [INFO ] [REMOTE    ] SONY: Incremental fetch complete for 2025-05 (0.80 seconds).
[2025-10-24T21:12:28.381853] [INFO ] [REMOTE    ] SOS: Incremental fetch complete for 2025-03 (0.23 seconds).
[2025-10-24T21:12:28.947669] [INFO ] [REMOTE    ] SPB: Fetching primary data for 2025-09.
[2025-10-24T21:12:29.747635] [INFO ] [REMOTE    ] SOS: Fetching primary data for 2025-04.
[2025-10-24T21:12:30.328393] [INFO ] [REMOTE    ] SOS: Incremental fetch complete for 2025-04 (0.58 seconds).
[2025-10-24T21:12:30.356053] [INFO ] [REMOTE    ] SPB: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T21:12:30.547677] [INFO ] [REMOTE    ] SPCE: Fetching primary data for 2025-02.
[2025-10-24T21:12:31.272597] [INFO ] [REMOTE    ] SPCE: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T21:12:31.347611] [INFO ] [REMOTE    ] SPCE: Fetching primary data for 2025-03.
[2025-10-24T21:12:32.147620] [INFO ] [REMOTE    ] SPB: Fetching primary data for 2025-10.
[2025-10-24T21:12:32.284741] [INFO ] [REMOTE    ] SPCE: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T21:12:32.947634] [INFO ] [REMOTE    ] SPCE: Fetching primary data for 2025-04.
[2025-10-24T21:12:33.458853] [INFO ] [REMOTE    ] SPB: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T21:12:33.464079] [INFO ] [REMOTE    ] SPB: Full fetch complete (47466 records).
[2025-10-24T21:12:33.464198] [DEBUG] [VALIDATOR ] SPB: Validating primary data.
[2025-10-24T21:12:33.464921] [FATAL] [VALIDATOR ] SPB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:12:33.465015] [FATAL] [MAIN      ] SPB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:12:33.465088] [WARN ] [MAIN      ] SPB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:12:33.465176] [INFO ] [LOCAL     ] SPB: Starting deletion of primary data.
[2025-10-24T21:12:33.465296] [DEBUG] [LOCAL     ] SPB: No primary data file found to delete.
[2025-10-24T21:12:33.465354] [INFO ] [LOCAL     ] SPB: Starting deletion of derivative data.
[2025-10-24T21:12:33.465565] [DEBUG] [LOCAL     ] SPB: Deleted derivative data file.
[2025-10-24T21:12:33.466305] [INFO ] [MAIN      ] Update Progress: 1964/2366 symbols completed. SPB took 21.2s. Estimated remaining: 51m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:12:33.644555] [INFO ] [MAIN      ] SPE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:12:33.653395] [DEBUG] [LOCAL     ] SPE: Loaded 6180 existing records from primary storage.
[2025-10-24T21:12:33.653610] [INFO ] [MAIN      ] SPE: Loaded 6180 existing records.
[2025-10-24T21:12:33.751292] [INFO ] [REMOTE    ] SONY: Fetching primary data for 2025-06.
[2025-10-24T21:12:33.844000] [WARN ] [MAIN      ] SPE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:12:33.844329] [INFO ] [MAIN      ] SPE: Wiping existing primary data before full refresh.
[2025-10-24T21:12:33.844384] [INFO ] [LOCAL     ] SPE: Starting deletion of primary data.
[2025-10-24T21:12:33.853522] [DEBUG] [LOCAL     ] SPE: Deleted primary data file.
[2025-10-24T21:12:33.859184] [INFO ] [MAIN      ] SPE: Starting full primary refresh.
[2025-10-24T21:12:33.975155] [INFO ] [REMOTE    ] SPCE: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T21:12:34.261728] [INFO ] [REMOTE    ] SPE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:12:34.547636] [INFO ] [REMOTE    ] SPE: Fetching primary data for 2025-01.
[2025-10-24T21:12:34.967307] [INFO ] [REMOTE    ] SONY: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T21:12:35.004944] [INFO ] [REMOTE    ] SPE: Incremental fetch complete for 2025-01 (0.46 seconds).
[2025-10-24T21:12:35.347623] [INFO ] [REMOTE    ] SOS: Fetching primary data for 2025-05.
[2025-10-24T21:12:35.721025] [INFO ] [REMOTE    ] SOS: Incremental fetch complete for 2025-05 (0.37 seconds).
[2025-10-24T21:12:36.147680] [INFO ] [REMOTE    ] SPE: Fetching primary data for 2025-02.
[2025-10-24T21:12:36.648810] [INFO ] [REMOTE    ] SPE: Incremental fetch complete for 2025-02 (0.50 seconds).
[2025-10-24T21:12:36.947715] [INFO ] [REMOTE    ] SPE: Fetching primary data for 2025-03.
[2025-10-24T21:12:37.421273] [INFO ] [REMOTE    ] SPE: Incremental fetch complete for 2025-03 (0.47 seconds).
[2025-10-24T21:12:37.747717] [INFO ] [REMOTE    ] SOS: Fetching primary data for 2025-06.
[2025-10-24T21:12:38.057711] [INFO ] [REMOTE    ] SOS: Incremental fetch complete for 2025-06 (0.31 seconds).
[2025-10-24T21:12:38.547685] [INFO ] [REMOTE    ] SPE: Fetching primary data for 2025-04.
[2025-10-24T21:12:39.347696] [INFO ] [REMOTE    ] SONY: Fetching primary data for 2025-07.
[2025-10-24T21:12:39.362751] [INFO ] [REMOTE    ] SPE: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T21:12:40.147635] [INFO ] [REMOTE    ] SPCE: Fetching primary data for 2025-05.
[2025-10-24T21:12:40.784557] [INFO ] [REMOTE    ] SONY: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T21:12:40.947636] [INFO ] [REMOTE    ] SONY: Fetching primary data for 2025-08.
[2025-10-24T21:12:41.323121] [INFO ] [REMOTE    ] SPCE: Incremental fetch complete for 2025-05 (1.18 seconds).
[2025-10-24T21:12:41.749696] [INFO ] [REMOTE    ] SOS: Fetching primary data for 2025-07.
[2025-10-24T21:12:41.752395] [INFO ] [REMOTE    ] SONY: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T21:12:42.547621] [INFO ] [REMOTE    ] SPE: Fetching primary data for 2025-05.
[2025-10-24T21:12:42.558590] [INFO ] [REMOTE    ] SOS: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T21:12:42.702624] [INFO ] [REMOTE    ] SPE: Incremental fetch complete for 2025-05 (0.16 seconds).
[2025-10-24T21:12:43.347637] [INFO ] [REMOTE    ] SPE: Fetching primary data for 2025-06.
[2025-10-24T21:12:43.810829] [INFO ] [REMOTE    ] SPE: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T21:12:44.147681] [INFO ] [REMOTE    ] SPE: Fetching primary data for 2025-07.
[2025-10-24T21:12:44.698991] [INFO ] [REMOTE    ] SPE: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T21:12:44.947726] [INFO ] [REMOTE    ] SOS: Fetching primary data for 2025-08.
[2025-10-24T21:12:45.747724] [INFO ] [REMOTE    ] SPE: Fetching primary data for 2025-08.
[2025-10-24T21:12:45.779776] [INFO ] [REMOTE    ] SOS: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T21:12:46.431167] [INFO ] [REMOTE    ] SPE: Incremental fetch complete for 2025-08 (0.68 seconds).
[2025-10-24T21:12:46.547732] [INFO ] [REMOTE    ] SOS: Fetching primary data for 2025-09.
[2025-10-24T21:12:46.992254] [INFO ] [REMOTE    ] SOS: Incremental fetch complete for 2025-09 (0.44 seconds).
[2025-10-24T21:12:47.347635] [INFO ] [REMOTE    ] SOS: Fetching primary data for 2025-10.
[2025-10-24T21:12:48.024631] [INFO ] [REMOTE    ] SOS: Incremental fetch complete for 2025-10 (0.68 seconds).
[2025-10-24T21:12:48.027320] [INFO ] [REMOTE    ] SOS: Full fetch complete (11242 records).
[2025-10-24T21:12:48.027397] [DEBUG] [VALIDATOR ] SOS: Validating primary data.
[2025-10-24T21:12:48.027980] [FATAL] [VALIDATOR ] SOS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:12:48.028067] [FATAL] [MAIN      ] SOS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:12:48.028110] [WARN ] [MAIN      ] SOS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:12:48.028152] [INFO ] [LOCAL     ] SOS: Starting deletion of primary data.
[2025-10-24T21:12:48.028213] [DEBUG] [LOCAL     ] SOS: No primary data file found to delete.
[2025-10-24T21:12:48.028249] [INFO ] [LOCAL     ] SOS: Starting deletion of derivative data.
[2025-10-24T21:12:48.028436] [DEBUG] [LOCAL     ] SOS: Deleted derivative data file.
[2025-10-24T21:12:48.028511] [INFO ] [MAIN      ] Update Progress: 1965/2366 symbols completed. SOS took 36.8s. Estimated remaining: 51m 35s. Rate: 7.8 symbols/min
[2025-10-24T21:12:48.152857] [INFO ] [REMOTE    ] SONY: Fetching primary data for 2025-09.
[2025-10-24T21:12:48.211078] [INFO ] [MAIN      ] SPG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:12:48.267278] [DEBUG] [LOCAL     ] SPG: Loaded 50304 existing records from primary storage.
[2025-10-24T21:12:48.267796] [INFO ] [MAIN      ] SPG: Loaded 50304 existing records.
[2025-10-24T21:12:48.451861] [WARN ] [MAIN      ] SPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:12:48.452219] [INFO ] [MAIN      ] SPG: Wiping existing primary data before full refresh.
[2025-10-24T21:12:48.452272] [INFO ] [LOCAL     ] SPG: Starting deletion of primary data.
[2025-10-24T21:12:48.453337] [DEBUG] [LOCAL     ] SPG: Deleted primary data file.
[2025-10-24T21:12:48.453400] [INFO ] [MAIN      ] SPG: Starting full primary refresh.
[2025-10-24T21:12:48.848410] [INFO ] [REMOTE    ] SPG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:12:48.947764] [INFO ] [REMOTE    ] SPG: Fetching primary data for 2025-01.
[2025-10-24T21:12:48.994584] [INFO ] [REMOTE    ] SONY: Incremental fetch complete for 2025-09 (0.84 seconds).
[2025-10-24T21:12:49.747748] [INFO ] [REMOTE    ] SONY: Fetching primary data for 2025-10.
[2025-10-24T21:12:50.547621] [INFO ] [REMOTE    ] SPE: Fetching primary data for 2025-09.
[2025-10-24T21:12:50.616672] [INFO ] [REMOTE    ] SPG: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T21:12:50.741905] [INFO ] [REMOTE    ] SONY: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T21:12:50.751449] [INFO ] [REMOTE    ] SONY: Full fetch complete (77025 records).
[2025-10-24T21:12:50.751597] [DEBUG] [VALIDATOR ] SONY: Validating primary data.
[2025-10-24T21:12:50.752429] [FATAL] [VALIDATOR ] SONY: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:12:50.752537] [FATAL] [MAIN      ] SONY: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:12:50.752608] [WARN ] [MAIN      ] SONY: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:12:50.752722] [INFO ] [LOCAL     ] SONY: Starting deletion of primary data.
[2025-10-24T21:12:50.752806] [DEBUG] [LOCAL     ] SONY: No primary data file found to delete.
[2025-10-24T21:12:50.752899] [INFO ] [LOCAL     ] SONY: Starting deletion of derivative data.
[2025-10-24T21:12:50.753137] [DEBUG] [LOCAL     ] SONY: Deleted derivative data file.
[2025-10-24T21:12:50.753507] [INFO ] [MAIN      ] Update Progress: 1966/2366 symbols completed. SONY took 54.1s. Estimated remaining: 51m 26s. Rate: 7.8 symbols/min
[2025-10-24T21:12:50.918965] [INFO ] [MAIN      ] SPGI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:12:50.962192] [DEBUG] [LOCAL     ] SPGI: Loaded 46248 existing records from primary storage.
[2025-10-24T21:12:50.962479] [INFO ] [MAIN      ] SPGI: Loaded 46248 existing records.
[2025-10-24T21:12:51.147709] [WARN ] [MAIN      ] SPGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:12:51.147957] [INFO ] [MAIN      ] SPGI: Wiping existing primary data before full refresh.
[2025-10-24T21:12:51.148015] [INFO ] [LOCAL     ] SPGI: Starting deletion of primary data.
[2025-10-24T21:12:51.148770] [DEBUG] [LOCAL     ] SPGI: Deleted primary data file.
[2025-10-24T21:12:51.148827] [INFO ] [MAIN      ] SPGI: Starting full primary refresh.
[2025-10-24T21:12:51.278914] [INFO ] [REMOTE    ] SPE: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T21:12:51.350227] [INFO ] [REMOTE    ] SPE: Fetching primary data for 2025-10.
[2025-10-24T21:12:51.548981] [INFO ] [REMOTE    ] SPGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:12:52.147620] [INFO ] [REMOTE    ] SPGI: Fetching primary data for 2025-01.
[2025-10-24T21:12:52.190061] [INFO ] [REMOTE    ] SPE: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T21:12:52.191477] [INFO ] [REMOTE    ] SPE: Full fetch complete (9731 records).
[2025-10-24T21:12:52.191564] [DEBUG] [VALIDATOR ] SPE: Validating primary data.
[2025-10-24T21:12:52.192037] [FATAL] [VALIDATOR ] SPE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:12:52.192144] [FATAL] [MAIN      ] SPE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:12:52.192208] [WARN ] [MAIN      ] SPE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:12:52.192280] [INFO ] [LOCAL     ] SPE: Starting deletion of primary data.
[2025-10-24T21:12:52.192343] [DEBUG] [LOCAL     ] SPE: No primary data file found to delete.
[2025-10-24T21:12:52.192379] [INFO ] [LOCAL     ] SPE: Starting deletion of derivative data.
[2025-10-24T21:12:52.192524] [DEBUG] [LOCAL     ] SPE: Deleted derivative data file.
[2025-10-24T21:12:52.192593] [INFO ] [MAIN      ] Update Progress: 1967/2366 symbols completed. SPE took 18.7s. Estimated remaining: 51m 17s. Rate: 7.8 symbols/min
[2025-10-24T21:12:52.393428] [INFO ] [MAIN      ] SPH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:12:52.415870] [DEBUG] [LOCAL     ] SPH: Loaded 16559 existing records from primary storage.
[2025-10-24T21:12:52.416195] [INFO ] [MAIN      ] SPH: Loaded 16559 existing records.
[2025-10-24T21:12:52.612479] [WARN ] [MAIN      ] SPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:12:52.612724] [INFO ] [MAIN      ] SPH: Wiping existing primary data before full refresh.
[2025-10-24T21:12:52.612780] [INFO ] [LOCAL     ] SPH: Starting deletion of primary data.
[2025-10-24T21:12:52.613264] [DEBUG] [LOCAL     ] SPH: Deleted primary data file.
[2025-10-24T21:12:52.613322] [INFO ] [MAIN      ] SPH: Starting full primary refresh.
[2025-10-24T21:12:52.951760] [INFO ] [REMOTE    ] SPCE: Fetching primary data for 2025-06.
[2025-10-24T21:12:52.976256] [INFO ] [REMOTE    ] SPH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:12:53.006086] [INFO ] [REMOTE    ] SPGI: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T21:12:53.747728] [INFO ] [REMOTE    ] SPG: Fetching primary data for 2025-02.
[2025-10-24T21:12:53.993384] [INFO ] [REMOTE    ] SPCE: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T21:12:54.426861] [INFO ] [REMOTE    ] SPG: Incremental fetch complete for 2025-02 (0.68 seconds).
[2025-10-24T21:12:54.547688] [INFO ] [REMOTE    ] SPCE: Fetching primary data for 2025-07.
[2025-10-24T21:12:55.347731] [INFO ] [REMOTE    ] SPGI: Fetching primary data for 2025-02.
[2025-10-24T21:12:55.502471] [INFO ] [REMOTE    ] SPCE: Incremental fetch complete for 2025-07 (0.95 seconds).
[2025-10-24T21:12:56.147762] [INFO ] [REMOTE    ] SPH: Fetching primary data for 2025-01.
[2025-10-24T21:12:56.337747] [INFO ] [REMOTE    ] SPGI: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T21:12:56.452304] [INFO ] [REMOTE    ] SPH: Incremental fetch complete for 2025-01 (0.30 seconds).
[2025-10-24T21:12:56.947753] [INFO ] [REMOTE    ] SPG: Fetching primary data for 2025-03.
[2025-10-24T21:12:57.747721] [INFO ] [REMOTE    ] SPGI: Fetching primary data for 2025-03.
[2025-10-24T21:12:58.250183] [INFO ] [REMOTE    ] SPG: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T21:12:58.519952] [INFO ] [REMOTE    ] SPGI: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T21:12:58.547612] [INFO ] [REMOTE    ] SPGI: Fetching primary data for 2025-04.
[2025-10-24T21:12:59.324674] [INFO ] [REMOTE    ] SPGI: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T21:12:59.347634] [INFO ] [REMOTE    ] SPGI: Fetching primary data for 2025-05.
[2025-10-24T21:13:00.147631] [INFO ] [REMOTE    ] SPH: Fetching primary data for 2025-02.
[2025-10-24T21:13:00.301814] [INFO ] [REMOTE    ] SPGI: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T21:13:00.947707] [INFO ] [REMOTE    ] SPCE: Fetching primary data for 2025-08.
[2025-10-24T21:13:01.157677] [INFO ] [REMOTE    ] SPH: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T21:13:01.747705] [INFO ] [REMOTE    ] SPH: Fetching primary data for 2025-03.
[2025-10-24T21:13:02.073485] [INFO ] [REMOTE    ] SPCE: Incremental fetch complete for 2025-08 (1.13 seconds).
[2025-10-24T21:13:02.358264] [INFO ] [REMOTE    ] SPH: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T21:13:02.547716] [INFO ] [REMOTE    ] SPH: Fetching primary data for 2025-04.
[2025-10-24T21:13:03.347754] [INFO ] [REMOTE    ] SPG: Fetching primary data for 2025-04.
[2025-10-24T21:13:03.638684] [INFO ] [REMOTE    ] SPH: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T21:13:04.159625] [INFO ] [REMOTE    ] SPH: Fetching primary data for 2025-05.
[2025-10-24T21:13:04.165508] [INFO ] [REMOTE    ] SPG: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T21:13:04.947629] [INFO ] [REMOTE    ] SPGI: Fetching primary data for 2025-06.
[2025-10-24T21:13:05.032986] [INFO ] [REMOTE    ] SPH: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T21:13:05.747707] [INFO ] [REMOTE    ] SPCE: Fetching primary data for 2025-09.
[2025-10-24T21:13:05.995468] [INFO ] [REMOTE    ] SPGI: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T21:13:06.547694] [INFO ] [REMOTE    ] SPG: Fetching primary data for 2025-05.
[2025-10-24T21:13:06.785159] [INFO ] [REMOTE    ] SPCE: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T21:13:07.347725] [INFO ] [REMOTE    ] SPGI: Fetching primary data for 2025-07.
[2025-10-24T21:13:07.645915] [INFO ] [REMOTE    ] SPG: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T21:13:08.127158] [INFO ] [REMOTE    ] SPGI: Incremental fetch complete for 2025-07 (0.78 seconds).
[2025-10-24T21:13:08.147612] [INFO ] [REMOTE    ] SPGI: Fetching primary data for 2025-08.
[2025-10-24T21:13:08.947726] [INFO ] [REMOTE    ] SPG: Fetching primary data for 2025-06.
[2025-10-24T21:13:09.118853] [INFO ] [REMOTE    ] SPGI: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T21:13:09.747633] [INFO ] [REMOTE    ] SPCE: Fetching primary data for 2025-10.
[2025-10-24T21:13:09.965109] [INFO ] [REMOTE    ] SPG: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T21:13:10.525407] [INFO ] [REMOTE    ] SPCE: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T21:13:10.534601] [INFO ] [REMOTE    ] SPCE: Full fetch complete (72319 records).
[2025-10-24T21:13:10.534752] [DEBUG] [VALIDATOR ] SPCE: Validating primary data.
[2025-10-24T21:13:10.535453] [FATAL] [VALIDATOR ] SPCE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:13:10.535537] [FATAL] [MAIN      ] SPCE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:13:10.535579] [WARN ] [MAIN      ] SPCE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:13:10.535617] [INFO ] [LOCAL     ] SPCE: Starting deletion of primary data.
[2025-10-24T21:13:10.535701] [DEBUG] [LOCAL     ] SPCE: No primary data file found to delete.
[2025-10-24T21:13:10.535752] [INFO ] [LOCAL     ] SPCE: Starting deletion of derivative data.
[2025-10-24T21:13:10.535937] [DEBUG] [LOCAL     ] SPCE: Deleted derivative data file.
[2025-10-24T21:13:10.536378] [INFO ] [MAIN      ] Update Progress: 1968/2366 symbols completed. SPCE took 45.0s. Estimated remaining: 51m 11s. Rate: 7.8 symbols/min
[2025-10-24T21:13:10.552824] [INFO ] [REMOTE    ] SPGI: Fetching primary data for 2025-09.
[2025-10-24T21:13:10.714981] [INFO ] [MAIN      ] SPHR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:13:10.753836] [DEBUG] [LOCAL     ] SPHR: Loaded 40951 existing records from primary storage.
[2025-10-24T21:13:10.754115] [INFO ] [MAIN      ] SPHR: Loaded 40951 existing records.
[2025-10-24T21:13:10.927951] [WARN ] [MAIN      ] SPHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:13:10.928152] [INFO ] [MAIN      ] SPHR: Wiping existing primary data before full refresh.
[2025-10-24T21:13:10.928215] [INFO ] [LOCAL     ] SPHR: Starting deletion of primary data.
[2025-10-24T21:13:10.928554] [DEBUG] [LOCAL     ] SPHR: Deleted primary data file.
[2025-10-24T21:13:10.928591] [INFO ] [MAIN      ] SPHR: Starting full primary refresh.
[2025-10-24T21:13:11.285699] [INFO ] [REMOTE    ] SPHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:13:11.347613] [INFO ] [REMOTE    ] SPH: Fetching primary data for 2025-06.
[2025-10-24T21:13:11.615716] [INFO ] [REMOTE    ] SPGI: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T21:13:12.147665] [INFO ] [REMOTE    ] SPG: Fetching primary data for 2025-07.
[2025-10-24T21:13:12.284746] [INFO ] [REMOTE    ] SPH: Incremental fetch complete for 2025-06 (0.94 seconds).
[2025-10-24T21:13:12.947688] [INFO ] [REMOTE    ] SPHR: Fetching primary data for 2025-01.
[2025-10-24T21:13:13.283810] [INFO ] [REMOTE    ] SPG: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T21:13:13.591827] [INFO ] [REMOTE    ] SPHR: Incremental fetch complete for 2025-01 (0.64 seconds).
[2025-10-24T21:13:13.747639] [INFO ] [REMOTE    ] SPG: Fetching primary data for 2025-08.
[2025-10-24T21:13:14.547630] [INFO ] [REMOTE    ] SPH: Fetching primary data for 2025-07.
[2025-10-24T21:13:14.794614] [INFO ] [REMOTE    ] SPG: Incremental fetch complete for 2025-08 (1.05 seconds).
[2025-10-24T21:13:15.232434] [INFO ] [REMOTE    ] SPH: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T21:13:15.347609] [INFO ] [REMOTE    ] SPH: Fetching primary data for 2025-08.
[2025-10-24T21:13:15.919638] [INFO ] [REMOTE    ] SPH: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T21:13:16.147719] [INFO ] [REMOTE    ] SPHR: Fetching primary data for 2025-02.
[2025-10-24T21:13:16.880135] [INFO ] [REMOTE    ] SPHR: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T21:13:16.947620] [INFO ] [REMOTE    ] SPHR: Fetching primary data for 2025-03.
[2025-10-24T21:13:17.724752] [INFO ] [REMOTE    ] SPHR: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T21:13:17.747679] [INFO ] [REMOTE    ] SPHR: Fetching primary data for 2025-04.
[2025-10-24T21:13:18.523029] [INFO ] [REMOTE    ] SPHR: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T21:13:18.547611] [INFO ] [REMOTE    ] SPHR: Fetching primary data for 2025-05.
[2025-10-24T21:13:19.347692] [INFO ] [REMOTE    ] SPG: Fetching primary data for 2025-09.
[2025-10-24T21:13:19.647192] [INFO ] [REMOTE    ] SPHR: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T21:13:20.147679] [INFO ] [REMOTE    ] SPGI: Fetching primary data for 2025-10.
[2025-10-24T21:13:20.464583] [INFO ] [REMOTE    ] SPG: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T21:13:20.947714] [INFO ] [REMOTE    ] SPHR: Fetching primary data for 2025-06.
[2025-10-24T21:13:21.077818] [INFO ] [REMOTE    ] SPGI: Incremental fetch complete for 2025-10 (0.93 seconds).
[2025-10-24T21:13:21.086523] [INFO ] [REMOTE    ] SPGI: Full fetch complete (67465 records).
[2025-10-24T21:13:21.086672] [DEBUG] [VALIDATOR ] SPGI: Validating primary data.
[2025-10-24T21:13:21.087360] [FATAL] [VALIDATOR ] SPGI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:13:21.087476] [FATAL] [MAIN      ] SPGI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:13:21.087536] [WARN ] [MAIN      ] SPGI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:13:21.087608] [INFO ] [LOCAL     ] SPGI: Starting deletion of primary data.
[2025-10-24T21:13:21.087714] [DEBUG] [LOCAL     ] SPGI: No primary data file found to delete.
[2025-10-24T21:13:21.087765] [INFO ] [LOCAL     ] SPGI: Starting deletion of derivative data.
[2025-10-24T21:13:21.087939] [DEBUG] [LOCAL     ] SPGI: Deleted derivative data file.
[2025-10-24T21:13:21.088318] [INFO ] [MAIN      ] Update Progress: 1969/2366 symbols completed. SPGI took 30.3s. Estimated remaining: 51m 4s. Rate: 7.8 symbols/min
[2025-10-24T21:13:21.260475] [INFO ] [MAIN      ] SPIR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:13:21.298523] [DEBUG] [LOCAL     ] SPIR: Loaded 37729 existing records from primary storage.
[2025-10-24T21:13:21.298867] [INFO ] [MAIN      ] SPIR: Loaded 37729 existing records.
[2025-10-24T21:13:21.477894] [WARN ] [MAIN      ] SPIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:13:21.478160] [INFO ] [MAIN      ] SPIR: Wiping existing primary data before full refresh.
[2025-10-24T21:13:21.478224] [INFO ] [LOCAL     ] SPIR: Starting deletion of primary data.
[2025-10-24T21:13:21.478617] [DEBUG] [LOCAL     ] SPIR: Deleted primary data file.
[2025-10-24T21:13:21.478713] [INFO ] [MAIN      ] SPIR: Starting full primary refresh.
[2025-10-24T21:13:21.749290] [INFO ] [REMOTE    ] SPH: Fetching primary data for 2025-09.
[2025-10-24T21:13:21.873174] [INFO ] [REMOTE    ] SPIR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:13:21.966827] [INFO ] [REMOTE    ] SPHR: Incremental fetch complete for 2025-06 (1.02 seconds).
[2025-10-24T21:13:22.000371] [INFO ] [REMOTE    ] SPH: Incremental fetch complete for 2025-09 (0.25 seconds).
[2025-10-24T21:13:22.547728] [INFO ] [REMOTE    ] SPH: Fetching primary data for 2025-10.
[2025-10-24T21:13:23.274341] [INFO ] [REMOTE    ] SPH: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:13:23.278779] [INFO ] [REMOTE    ] SPH: Full fetch complete (27581 records).
[2025-10-24T21:13:23.278951] [DEBUG] [VALIDATOR ] SPH: Validating primary data.
[2025-10-24T21:13:23.279600] [FATAL] [VALIDATOR ] SPH: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:13:23.279725] [FATAL] [MAIN      ] SPH: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:13:23.279783] [WARN ] [MAIN      ] SPH: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:13:23.279866] [INFO ] [LOCAL     ] SPH: Starting deletion of primary data.
[2025-10-24T21:13:23.279946] [DEBUG] [LOCAL     ] SPH: No primary data file found to delete.
[2025-10-24T21:13:23.279996] [INFO ] [LOCAL     ] SPH: Starting deletion of derivative data.
[2025-10-24T21:13:23.280186] [DEBUG] [LOCAL     ] SPH: Deleted derivative data file.
[2025-10-24T21:13:23.280317] [INFO ] [MAIN      ] Update Progress: 1970/2366 symbols completed. SPH took 31.1s. Estimated remaining: 50m 56s. Rate: 7.8 symbols/min
[2025-10-24T21:13:23.352831] [INFO ] [REMOTE    ] SPIR: Fetching primary data for 2025-01.
[2025-10-24T21:13:23.475625] [INFO ] [MAIN      ] SPMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:13:23.483480] [DEBUG] [LOCAL     ] SPMC: Loaded 5288 existing records from primary storage.
[2025-10-24T21:13:23.483743] [INFO ] [MAIN      ] SPMC: Loaded 5288 existing records.
[2025-10-24T21:13:23.664278] [WARN ] [MAIN      ] SPMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:13:23.664510] [INFO ] [MAIN      ] SPMC: Wiping existing primary data before full refresh.
[2025-10-24T21:13:23.664557] [INFO ] [LOCAL     ] SPMC: Starting deletion of primary data.
[2025-10-24T21:13:23.664728] [DEBUG] [LOCAL     ] SPMC: Deleted primary data file.
[2025-10-24T21:13:23.664786] [INFO ] [MAIN      ] SPMC: Starting full primary refresh.
[2025-10-24T21:13:24.027057] [INFO ] [REMOTE    ] SPMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:13:24.091308] [INFO ] [REMOTE    ] SPIR: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T21:13:24.147637] [INFO ] [REMOTE    ] SPMC: Fetching primary data for 2025-01.
[2025-10-24T21:13:24.536680] [INFO ] [REMOTE    ] SPMC: Incremental fetch complete for 2025-01 (0.39 seconds).
[2025-10-24T21:13:24.947771] [INFO ] [REMOTE    ] SPMC: Fetching primary data for 2025-02.
[2025-10-24T21:13:25.411116] [INFO ] [REMOTE    ] SPMC: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T21:13:25.747686] [INFO ] [REMOTE    ] SPIR: Fetching primary data for 2025-02.
[2025-10-24T21:13:26.547721] [INFO ] [REMOTE    ] SPMC: Fetching primary data for 2025-03.
[2025-10-24T21:13:26.585920] [INFO ] [REMOTE    ] SPIR: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T21:13:26.718206] [INFO ] [REMOTE    ] SPMC: Incremental fetch complete for 2025-03 (0.17 seconds).
[2025-10-24T21:13:27.347741] [INFO ] [REMOTE    ] SPHR: Fetching primary data for 2025-07.
[2025-10-24T21:13:28.153868] [INFO ] [REMOTE    ] SPG: Fetching primary data for 2025-10.
[2025-10-24T21:13:28.177343] [INFO ] [REMOTE    ] SPHR: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T21:13:28.909040] [INFO ] [REMOTE    ] SPG: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T21:13:28.919618] [INFO ] [REMOTE    ] SPG: Full fetch complete (71675 records).
[2025-10-24T21:13:28.919811] [DEBUG] [VALIDATOR ] SPG: Validating primary data.
[2025-10-24T21:13:28.920628] [FATAL] [VALIDATOR ] SPG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:13:28.920753] [FATAL] [MAIN      ] SPG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:13:28.920797] [WARN ] [MAIN      ] SPG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:13:28.920835] [INFO ] [LOCAL     ] SPG: Starting deletion of primary data.
[2025-10-24T21:13:28.920891] [DEBUG] [LOCAL     ] SPG: No primary data file found to delete.
[2025-10-24T21:13:28.920926] [INFO ] [LOCAL     ] SPG: Starting deletion of derivative data.
[2025-10-24T21:13:28.921076] [DEBUG] [LOCAL     ] SPG: Deleted derivative data file.
[2025-10-24T21:13:28.921580] [INFO ] [MAIN      ] Update Progress: 1971/2366 symbols completed. SPG took 40.9s. Estimated remaining: 50m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:13:28.956391] [INFO ] [REMOTE    ] SPIR: Fetching primary data for 2025-03.
[2025-10-24T21:13:29.116953] [INFO ] [MAIN      ] SPME: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:13:29.117177] [DEBUG] [LOCAL     ] SPME: No existing data file found in primary storage.
[2025-10-24T21:13:29.117224] [WARN ] [MAIN      ] SPME: No existing data found, performing full refresh instead.
[2025-10-24T21:13:29.117335] [INFO ] [MAIN      ] SPME: Wiping existing primary data before full refresh.
[2025-10-24T21:13:29.117376] [INFO ] [LOCAL     ] SPME: Starting deletion of primary data.
[2025-10-24T21:13:29.117418] [DEBUG] [LOCAL     ] SPME: No primary data file found to delete.
[2025-10-24T21:13:29.117498] [INFO ] [MAIN      ] SPME: Starting full primary refresh.
[2025-10-24T21:13:29.504046] [INFO ] [REMOTE    ] SPME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:13:29.747680] [INFO ] [REMOTE    ] SPHR: Fetching primary data for 2025-08.
[2025-10-24T21:13:29.903956] [INFO ] [REMOTE    ] SPIR: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T21:13:30.547686] [INFO ] [REMOTE    ] SPMC: Fetching primary data for 2025-04.
[2025-10-24T21:13:30.809506] [INFO ] [REMOTE    ] SPHR: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T21:13:31.225926] [INFO ] [REMOTE    ] SPMC: Incremental fetch complete for 2025-04 (0.68 seconds).
[2025-10-24T21:13:31.347638] [INFO ] [REMOTE    ] SPIR: Fetching primary data for 2025-04.
[2025-10-24T21:13:32.147732] [INFO ] [REMOTE    ] SPHR: Fetching primary data for 2025-09.
[2025-10-24T21:13:32.258140] [INFO ] [REMOTE    ] SPIR: Incremental fetch complete for 2025-04 (0.91 seconds).
[2025-10-24T21:13:32.903151] [INFO ] [REMOTE    ] SPHR: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T21:13:32.947714] [INFO ] [REMOTE    ] SPHR: Fetching primary data for 2025-10.
[2025-10-24T21:13:33.747760] [INFO ] [REMOTE    ] SPMC: Fetching primary data for 2025-05.
[2025-10-24T21:13:33.888407] [INFO ] [REMOTE    ] SPHR: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T21:13:33.899237] [INFO ] [REMOTE    ] SPHR: Full fetch complete (58490 records).
[2025-10-24T21:13:33.899395] [DEBUG] [VALIDATOR ] SPHR: Validating primary data.
[2025-10-24T21:13:33.900160] [FATAL] [VALIDATOR ] SPHR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:13:33.900252] [FATAL] [MAIN      ] SPHR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:13:33.900296] [WARN ] [MAIN      ] SPHR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:13:33.900363] [INFO ] [LOCAL     ] SPHR: Starting deletion of primary data.
[2025-10-24T21:13:33.900425] [DEBUG] [LOCAL     ] SPHR: No primary data file found to delete.
[2025-10-24T21:13:33.900461] [INFO ] [LOCAL     ] SPHR: Starting deletion of derivative data.
[2025-10-24T21:13:33.900660] [DEBUG] [LOCAL     ] SPHR: Deleted derivative data file.
[2025-10-24T21:13:33.901128] [INFO ] [MAIN      ] Update Progress: 1972/2366 symbols completed. SPHR took 23.4s. Estimated remaining: 50m 39s. Rate: 7.8 symbols/min
[2025-10-24T21:13:34.067178] [INFO ] [MAIN      ] SPNT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:13:34.100616] [DEBUG] [LOCAL     ] SPNT: Loaded 34415 existing records from primary storage.
[2025-10-24T21:13:34.100920] [INFO ] [MAIN      ] SPNT: Loaded 34415 existing records.
[2025-10-24T21:13:34.206997] [INFO ] [REMOTE    ] SPMC: Incremental fetch complete for 2025-05 (0.46 seconds).
[2025-10-24T21:13:34.290833] [WARN ] [MAIN      ] SPNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:13:34.291105] [INFO ] [MAIN      ] SPNT: Wiping existing primary data before full refresh.
[2025-10-24T21:13:34.291155] [INFO ] [LOCAL     ] SPNT: Starting deletion of primary data.
[2025-10-24T21:13:34.291498] [DEBUG] [LOCAL     ] SPNT: Deleted primary data file.
[2025-10-24T21:13:34.291553] [INFO ] [MAIN      ] SPNT: Starting full primary refresh.
[2025-10-24T21:13:34.553050] [INFO ] [REMOTE    ] SPIR: Fetching primary data for 2025-05.
[2025-10-24T21:13:34.645947] [INFO ] [REMOTE    ] SPNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:13:35.347706] [INFO ] [REMOTE    ] SPME: Fetching primary data for 2025-01.
[2025-10-24T21:13:35.384682] [INFO ] [REMOTE    ] SPIR: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T21:13:35.491550] [DEBUG] [REMOTE    ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:13:35.491914] [WARN ] [REMOTE    ] SPME: No data returned for month 2025-01
[2025-10-24T21:13:35.492010] [FATAL] [REMOTE    ] SPME: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:13:35.492096] [FATAL] [MAIN      ] SPME: Failed to fetch primary data.
[2025-10-24T21:13:35.492181] [WARN ] [MAIN      ] SPME: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:13:35.492275] [INFO ] [LOCAL     ] SPME: Starting deletion of primary data.
[2025-10-24T21:13:35.492357] [DEBUG] [LOCAL     ] SPME: No primary data file found to delete.
[2025-10-24T21:13:35.492395] [INFO ] [LOCAL     ] SPME: Starting deletion of derivative data.
[2025-10-24T21:13:35.492434] [DEBUG] [LOCAL     ] SPME: No derivative data file found to delete.
[2025-10-24T21:13:35.492479] [INFO ] [MAIN      ] Update Progress: 1973/2366 symbols completed. SPME took 6.6s. Estimated remaining: 50m 30s. Rate: 7.8 symbols/min
[2025-10-24T21:13:35.659584] [INFO ] [MAIN      ] SPOT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:13:35.707868] [DEBUG] [LOCAL     ] SPOT: Loaded 50537 existing records from primary storage.
[2025-10-24T21:13:35.708199] [INFO ] [MAIN      ] SPOT: Loaded 50537 existing records.
[2025-10-24T21:13:35.880953] [WARN ] [MAIN      ] SPOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:13:35.881182] [INFO ] [MAIN      ] SPOT: Wiping existing primary data before full refresh.
[2025-10-24T21:13:35.881228] [INFO ] [LOCAL     ] SPOT: Starting deletion of primary data.
[2025-10-24T21:13:35.882251] [DEBUG] [LOCAL     ] SPOT: Deleted primary data file.
[2025-10-24T21:13:35.882306] [INFO ] [MAIN      ] SPOT: Starting full primary refresh.
[2025-10-24T21:13:36.155273] [INFO ] [REMOTE    ] SPIR: Fetching primary data for 2025-06.
[2025-10-24T21:13:36.236952] [INFO ] [REMOTE    ] SPOT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:13:36.947689] [INFO ] [REMOTE    ] SPOT: Fetching primary data for 2025-01.
[2025-10-24T21:13:37.272243] [INFO ] [REMOTE    ] SPIR: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T21:13:37.746549] [INFO ] [REMOTE    ] SPOT: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T21:13:37.756440] [INFO ] [REMOTE    ] SPIR: Fetching primary data for 2025-07.
[2025-10-24T21:13:38.547707] [INFO ] [REMOTE    ] SPOT: Fetching primary data for 2025-02.
[2025-10-24T21:13:38.693907] [INFO ] [REMOTE    ] SPIR: Incremental fetch complete for 2025-07 (0.94 seconds).
[2025-10-24T21:13:39.297192] [INFO ] [REMOTE    ] SPOT: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T21:13:39.347673] [INFO ] [REMOTE    ] SPOT: Fetching primary data for 2025-03.
[2025-10-24T21:13:40.147719] [INFO ] [REMOTE    ] SPIR: Fetching primary data for 2025-08.
[2025-10-24T21:13:40.431680] [INFO ] [REMOTE    ] SPOT: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T21:13:40.947724] [INFO ] [REMOTE    ] SPOT: Fetching primary data for 2025-04.
[2025-10-24T21:13:40.997568] [INFO ] [REMOTE    ] SPIR: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T21:13:41.747613] [INFO ] [REMOTE    ] SPIR: Fetching primary data for 2025-09.
[2025-10-24T21:13:41.927054] [INFO ] [REMOTE    ] SPOT: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T21:13:42.448777] [INFO ] [REMOTE    ] SPIR: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T21:13:42.547684] [INFO ] [REMOTE    ] SPIR: Fetching primary data for 2025-10.
[2025-10-24T21:13:43.232934] [INFO ] [REMOTE    ] SPIR: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T21:13:43.239938] [INFO ] [REMOTE    ] SPIR: Full fetch complete (53966 records).
[2025-10-24T21:13:43.240077] [DEBUG] [VALIDATOR ] SPIR: Validating primary data.
[2025-10-24T21:13:43.240791] [FATAL] [VALIDATOR ] SPIR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:13:43.240873] [FATAL] [MAIN      ] SPIR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:13:43.240915] [WARN ] [MAIN      ] SPIR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:13:43.240977] [INFO ] [LOCAL     ] SPIR: Starting deletion of primary data.
[2025-10-24T21:13:43.241039] [DEBUG] [LOCAL     ] SPIR: No primary data file found to delete.
[2025-10-24T21:13:43.241074] [INFO ] [LOCAL     ] SPIR: Starting deletion of derivative data.
[2025-10-24T21:13:43.241256] [DEBUG] [LOCAL     ] SPIR: Deleted derivative data file.
[2025-10-24T21:13:43.241344] [INFO ] [MAIN      ] Update Progress: 1974/2366 symbols completed. SPIR took 22.2s. Estimated remaining: 50m 22s. Rate: 7.8 symbols/min
[2025-10-24T21:13:43.352851] [INFO ] [REMOTE    ] SPMC: Fetching primary data for 2025-06.
[2025-10-24T21:13:43.415801] [INFO ] [MAIN      ] SPR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:13:43.452770] [DEBUG] [LOCAL     ] SPR: Loaded 40937 existing records from primary storage.
[2025-10-24T21:13:43.453035] [INFO ] [MAIN      ] SPR: Loaded 40937 existing records.
[2025-10-24T21:13:43.632604] [WARN ] [MAIN      ] SPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:13:43.632841] [INFO ] [MAIN      ] SPR: Wiping existing primary data before full refresh.
[2025-10-24T21:13:43.632888] [INFO ] [LOCAL     ] SPR: Starting deletion of primary data.
[2025-10-24T21:13:43.633293] [DEBUG] [LOCAL     ] SPR: Deleted primary data file.
[2025-10-24T21:13:43.633352] [INFO ] [MAIN      ] SPR: Starting full primary refresh.
[2025-10-24T21:13:43.914555] [INFO ] [REMOTE    ] SPMC: Incremental fetch complete for 2025-06 (0.56 seconds).
[2025-10-24T21:13:43.995695] [INFO ] [REMOTE    ] SPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:13:44.147618] [INFO ] [REMOTE    ] SPR: Fetching primary data for 2025-01.
[2025-10-24T21:13:44.947715] [INFO ] [REMOTE    ] SPMC: Fetching primary data for 2025-07.
[2025-10-24T21:13:45.272842] [INFO ] [REMOTE    ] SPR: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T21:13:45.566079] [INFO ] [REMOTE    ] SPMC: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T21:13:45.747678] [INFO ] [REMOTE    ] SPMC: Fetching primary data for 2025-08.
[2025-10-24T21:13:46.446744] [INFO ] [REMOTE    ] SPMC: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T21:13:46.547703] [INFO ] [REMOTE    ] SPR: Fetching primary data for 2025-02.
[2025-10-24T21:13:47.319089] [INFO ] [REMOTE    ] SPR: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T21:13:47.347628] [INFO ] [REMOTE    ] SPR: Fetching primary data for 2025-03.
[2025-10-24T21:13:48.147635] [INFO ] [REMOTE    ] SPOT: Fetching primary data for 2025-05.
[2025-10-24T21:13:48.692118] [INFO ] [REMOTE    ] SPR: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T21:13:48.940921] [INFO ] [REMOTE    ] SPOT: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T21:13:48.951210] [INFO ] [REMOTE    ] SPNT: Fetching primary data for 2025-01.
[2025-10-24T21:13:49.561045] [INFO ] [REMOTE    ] SPNT: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T21:13:49.747696] [INFO ] [REMOTE    ] SPR: Fetching primary data for 2025-04.
[2025-10-24T21:13:50.547615] [INFO ] [REMOTE    ] SPOT: Fetching primary data for 2025-06.
[2025-10-24T21:13:50.629030] [INFO ] [REMOTE    ] SPR: Incremental fetch complete for 2025-04 (0.88 seconds).
[2025-10-24T21:13:51.139049] [INFO ] [REMOTE    ] SPOT: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T21:13:51.347679] [INFO ] [REMOTE    ] SPMC: Fetching primary data for 2025-09.
[2025-10-24T21:13:51.735111] [INFO ] [REMOTE    ] SPMC: Incremental fetch complete for 2025-09 (0.39 seconds).
[2025-10-24T21:13:52.147638] [INFO ] [REMOTE    ] SPR: Fetching primary data for 2025-05.
[2025-10-24T21:13:52.947724] [INFO ] [REMOTE    ] SPMC: Fetching primary data for 2025-10.
[2025-10-24T21:13:53.424571] [INFO ] [REMOTE    ] SPMC: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T21:13:53.426274] [INFO ] [REMOTE    ] SPMC: Full fetch complete (8365 records).
[2025-10-24T21:13:53.426357] [DEBUG] [VALIDATOR ] SPMC: Validating primary data.
[2025-10-24T21:13:53.426787] [FATAL] [VALIDATOR ] SPMC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:13:53.427000] [FATAL] [MAIN      ] SPMC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:13:53.427082] [WARN ] [MAIN      ] SPMC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:13:53.427173] [INFO ] [LOCAL     ] SPMC: Starting deletion of primary data.
[2025-10-24T21:13:53.427285] [DEBUG] [LOCAL     ] SPMC: No primary data file found to delete.
[2025-10-24T21:13:53.427337] [INFO ] [LOCAL     ] SPMC: Starting deletion of derivative data.
[2025-10-24T21:13:53.427517] [DEBUG] [LOCAL     ] SPMC: Deleted derivative data file.
[2025-10-24T21:13:53.427609] [INFO ] [MAIN      ] Update Progress: 1975/2366 symbols completed. SPMC took 30.1s. Estimated remaining: 50m 15s. Rate: 7.8 symbols/min
[2025-10-24T21:13:53.625810] [INFO ] [MAIN      ] SPRU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:13:53.639020] [INFO ] [REMOTE    ] SPR: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T21:13:53.656639] [DEBUG] [LOCAL     ] SPRU: Loaded 10031 existing records from primary storage.
[2025-10-24T21:13:53.656936] [INFO ] [MAIN      ] SPRU: Loaded 10031 existing records.
[2025-10-24T21:13:53.755250] [INFO ] [REMOTE    ] SPNT: Fetching primary data for 2025-02.
[2025-10-24T21:13:53.841608] [WARN ] [MAIN      ] SPRU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:13:53.841800] [INFO ] [MAIN      ] SPRU: Wiping existing primary data before full refresh.
[2025-10-24T21:13:53.841847] [INFO ] [LOCAL     ] SPRU: Starting deletion of primary data.
[2025-10-24T21:13:53.841989] [DEBUG] [LOCAL     ] SPRU: Deleted primary data file.
[2025-10-24T21:13:53.842028] [INFO ] [MAIN      ] SPRU: Starting full primary refresh.
[2025-10-24T21:13:54.224313] [INFO ] [REMOTE    ] SPRU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:13:54.547725] [INFO ] [REMOTE    ] SPRU: Fetching primary data for 2025-01.
[2025-10-24T21:13:54.731023] [INFO ] [REMOTE    ] SPNT: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T21:13:54.922446] [INFO ] [REMOTE    ] SPRU: Incremental fetch complete for 2025-01 (0.37 seconds).
[2025-10-24T21:13:55.347635] [INFO ] [REMOTE    ] SPR: Fetching primary data for 2025-06.
[2025-10-24T21:13:56.147676] [INFO ] [REMOTE    ] SPOT: Fetching primary data for 2025-07.
[2025-10-24T21:13:56.260253] [INFO ] [REMOTE    ] SPR: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T21:13:56.947618] [INFO ] [REMOTE    ] SPRU: Fetching primary data for 2025-02.
[2025-10-24T21:13:57.057401] [INFO ] [REMOTE    ] SPOT: Incremental fetch complete for 2025-07 (0.91 seconds).
[2025-10-24T21:13:57.564748] [INFO ] [REMOTE    ] SPRU: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T21:13:57.747670] [INFO ] [REMOTE    ] SPNT: Fetching primary data for 2025-03.
[2025-10-24T21:13:58.547619] [INFO ] [REMOTE    ] SPR: Fetching primary data for 2025-07.
[2025-10-24T21:13:58.686153] [INFO ] [REMOTE    ] SPNT: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T21:13:59.332674] [INFO ] [REMOTE    ] SPR: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T21:13:59.347609] [INFO ] [REMOTE    ] SPR: Fetching primary data for 2025-08.
[2025-10-24T21:14:00.147709] [INFO ] [REMOTE    ] SPOT: Fetching primary data for 2025-08.
[2025-10-24T21:14:00.526146] [INFO ] [REMOTE    ] SPR: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T21:14:00.947716] [INFO ] [REMOTE    ] SPRU: Fetching primary data for 2025-03.
[2025-10-24T21:14:01.248748] [INFO ] [REMOTE    ] SPOT: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T21:14:01.489717] [INFO ] [REMOTE    ] SPRU: Incremental fetch complete for 2025-03 (0.54 seconds).
[2025-10-24T21:14:01.747665] [INFO ] [REMOTE    ] SPR: Fetching primary data for 2025-09.
[2025-10-24T21:14:02.547623] [INFO ] [REMOTE    ] SPRU: Fetching primary data for 2025-04.
[2025-10-24T21:14:02.886580] [INFO ] [REMOTE    ] SPR: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T21:14:03.024141] [INFO ] [REMOTE    ] SPRU: Incremental fetch complete for 2025-04 (0.48 seconds).
[2025-10-24T21:14:03.347713] [INFO ] [REMOTE    ] SPR: Fetching primary data for 2025-10.
[2025-10-24T21:14:03.769584] [INFO ] [REMOTE    ] SPR: Incremental fetch complete for 2025-10 (0.42 seconds).
[2025-10-24T21:14:03.776449] [INFO ] [REMOTE    ] SPR: Full fetch complete (59539 records).
[2025-10-24T21:14:03.776555] [DEBUG] [VALIDATOR ] SPR: Validating primary data.
[2025-10-24T21:14:03.777242] [FATAL] [VALIDATOR ] SPR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:14:03.777325] [FATAL] [MAIN      ] SPR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:14:03.777367] [WARN ] [MAIN      ] SPR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:14:03.777405] [INFO ] [LOCAL     ] SPR: Starting deletion of primary data.
[2025-10-24T21:14:03.777488] [DEBUG] [LOCAL     ] SPR: No primary data file found to delete.
[2025-10-24T21:14:03.777542] [INFO ] [LOCAL     ] SPR: Starting deletion of derivative data.
[2025-10-24T21:14:03.777743] [DEBUG] [LOCAL     ] SPR: Deleted derivative data file.
[2025-10-24T21:14:03.778383] [INFO ] [MAIN      ] Update Progress: 1976/2366 symbols completed. SPR took 20.5s. Estimated remaining: 50m 8s. Rate: 7.8 symbols/min
[2025-10-24T21:14:03.947488] [INFO ] [MAIN      ] SPXC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:14:03.971069] [DEBUG] [LOCAL     ] SPXC: Loaded 23294 existing records from primary storage.
[2025-10-24T21:14:03.971304] [INFO ] [MAIN      ] SPXC: Loaded 23294 existing records.
[2025-10-24T21:14:04.150326] [WARN ] [MAIN      ] SPXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:14:04.150423] [INFO ] [REMOTE    ] SPRU: Fetching primary data for 2025-05.
[2025-10-24T21:14:04.150826] [INFO ] [MAIN      ] SPXC: Wiping existing primary data before full refresh.
[2025-10-24T21:14:04.151678] [INFO ] [LOCAL     ] SPXC: Starting deletion of primary data.
[2025-10-24T21:14:04.152372] [DEBUG] [LOCAL     ] SPXC: Deleted primary data file.
[2025-10-24T21:14:04.152536] [INFO ] [MAIN      ] SPXC: Starting full primary refresh.
[2025-10-24T21:14:04.510102] [INFO ] [REMOTE    ] SPXC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:14:04.947721] [INFO ] [REMOTE    ] SPOT: Fetching primary data for 2025-09.
[2025-10-24T21:14:05.148101] [INFO ] [REMOTE    ] SPRU: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T21:14:05.719121] [INFO ] [REMOTE    ] SPOT: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T21:14:05.747601] [INFO ] [REMOTE    ] SPOT: Fetching primary data for 2025-10.
[2025-10-24T21:14:06.547685] [INFO ] [REMOTE    ] SPNT: Fetching primary data for 2025-04.
[2025-10-24T21:14:07.347690] [INFO ] [REMOTE    ] SPRU: Fetching primary data for 2025-06.
[2025-10-24T21:14:07.619824] [INFO ] [REMOTE    ] SPNT: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T21:14:08.147625] [INFO ] [REMOTE    ] SPNT: Fetching primary data for 2025-05.
[2025-10-24T21:14:08.414851] [INFO ] [REMOTE    ] SPOT: Incremental fetch complete for 2025-10 (2.67 seconds).
[2025-10-24T21:14:08.423676] [INFO ] [REMOTE    ] SPOT: Full fetch complete (73389 records).
[2025-10-24T21:14:08.423815] [DEBUG] [VALIDATOR ] SPOT: Validating primary data.
[2025-10-24T21:14:08.424568] [FATAL] [VALIDATOR ] SPOT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:14:08.424690] [FATAL] [MAIN      ] SPOT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:14:08.424744] [WARN ] [MAIN      ] SPOT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:14:08.424811] [INFO ] [LOCAL     ] SPOT: Starting deletion of primary data.
[2025-10-24T21:14:08.424875] [DEBUG] [LOCAL     ] SPOT: No primary data file found to delete.
[2025-10-24T21:14:08.424910] [INFO ] [LOCAL     ] SPOT: Starting deletion of derivative data.
[2025-10-24T21:14:08.425067] [DEBUG] [LOCAL     ] SPOT: Deleted derivative data file.
[2025-10-24T21:14:08.425319] [INFO ] [MAIN      ] Update Progress: 1977/2366 symbols completed. SPOT took 32.9s. Estimated remaining: 49m 60s. Rate: 7.8 symbols/min
[2025-10-24T21:14:08.619364] [INFO ] [MAIN      ] SPXX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:14:08.620232] [INFO ] [REMOTE    ] SPRU: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T21:14:08.633864] [DEBUG] [LOCAL     ] SPXX: Loaded 9189 existing records from primary storage.
[2025-10-24T21:14:08.634091] [INFO ] [MAIN      ] SPXX: Loaded 9189 existing records.
[2025-10-24T21:14:08.815677] [WARN ] [MAIN      ] SPXX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:14:08.815886] [INFO ] [MAIN      ] SPXX: Wiping existing primary data before full refresh.
[2025-10-24T21:14:08.815956] [INFO ] [LOCAL     ] SPXX: Starting deletion of primary data.
[2025-10-24T21:14:08.816220] [DEBUG] [LOCAL     ] SPXX: Deleted primary data file.
[2025-10-24T21:14:08.816276] [INFO ] [MAIN      ] SPXX: Starting full primary refresh.
[2025-10-24T21:14:08.965112] [INFO ] [REMOTE    ] SPRU: Fetching primary data for 2025-07.
[2025-10-24T21:14:09.138318] [INFO ] [REMOTE    ] SPNT: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T21:14:09.217546] [INFO ] [REMOTE    ] SPXX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:14:09.589579] [INFO ] [REMOTE    ] SPRU: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T21:14:09.747686] [INFO ] [REMOTE    ] SPNT: Fetching primary data for 2025-06.
[2025-10-24T21:14:10.439575] [INFO ] [REMOTE    ] SPNT: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T21:14:10.547734] [INFO ] [REMOTE    ] SPXC: Fetching primary data for 2025-01.
[2025-10-24T21:14:11.347731] [INFO ] [REMOTE    ] SPXX: Fetching primary data for 2025-01.
[2025-10-24T21:14:11.788731] [INFO ] [REMOTE    ] SPXX: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T21:14:11.821194] [INFO ] [REMOTE    ] SPXC: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T21:14:12.147681] [INFO ] [REMOTE    ] SPRU: Fetching primary data for 2025-08.
[2025-10-24T21:14:12.923241] [INFO ] [REMOTE    ] SPRU: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T21:14:12.947634] [INFO ] [REMOTE    ] SPRU: Fetching primary data for 2025-09.
[2025-10-24T21:14:13.424827] [INFO ] [REMOTE    ] SPRU: Incremental fetch complete for 2025-09 (0.48 seconds).
[2025-10-24T21:14:13.747671] [INFO ] [REMOTE    ] SPNT: Fetching primary data for 2025-07.
[2025-10-24T21:14:14.547630] [INFO ] [REMOTE    ] SPRU: Fetching primary data for 2025-10.
[2025-10-24T21:14:15.069941] [INFO ] [REMOTE    ] SPRU: Incremental fetch complete for 2025-10 (0.52 seconds).
[2025-10-24T21:14:15.072892] [INFO ] [REMOTE    ] SPRU: Full fetch complete (12144 records).
[2025-10-24T21:14:15.072962] [DEBUG] [VALIDATOR ] SPRU: Validating primary data.
[2025-10-24T21:14:15.073323] [FATAL] [VALIDATOR ] SPRU: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:14:15.073403] [FATAL] [MAIN      ] SPRU: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:14:15.073445] [WARN ] [MAIN      ] SPRU: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:14:15.073507] [INFO ] [LOCAL     ] SPRU: Starting deletion of primary data.
[2025-10-24T21:14:15.073567] [DEBUG] [LOCAL     ] SPRU: No primary data file found to delete.
[2025-10-24T21:14:15.073602] [INFO ] [LOCAL     ] SPRU: Starting deletion of derivative data.
[2025-10-24T21:14:15.073780] [DEBUG] [LOCAL     ] SPRU: Deleted derivative data file.
[2025-10-24T21:14:15.073864] [INFO ] [MAIN      ] Update Progress: 1978/2366 symbols completed. SPRU took 21.6s. Estimated remaining: 49m 52s. Rate: 7.8 symbols/min
[2025-10-24T21:14:15.265582] [INFO ] [MAIN      ] SQM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:14:15.310758] [DEBUG] [LOCAL     ] SQM: Loaded 49265 existing records from primary storage.
[2025-10-24T21:14:15.311054] [INFO ] [MAIN      ] SQM: Loaded 49265 existing records.
[2025-10-24T21:14:15.358054] [INFO ] [REMOTE    ] SPXC: Fetching primary data for 2025-02.
[2025-10-24T21:14:15.508768] [WARN ] [MAIN      ] SQM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:14:15.521775] [INFO ] [MAIN      ] SQM: Wiping existing primary data before full refresh.
[2025-10-24T21:14:15.522399] [INFO ] [LOCAL     ] SQM: Starting deletion of primary data.
[2025-10-24T21:14:15.523631] [DEBUG] [LOCAL     ] SQM: Deleted primary data file.
[2025-10-24T21:14:15.523589] [INFO ] [REMOTE    ] SPNT: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T21:14:15.523784] [INFO ] [MAIN      ] SQM: Starting full primary refresh.
[2025-10-24T21:14:15.884892] [INFO ] [REMOTE    ] SQM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:14:16.147615] [INFO ] [REMOTE    ] SQM: Fetching primary data for 2025-01.
[2025-10-24T21:14:16.414224] [INFO ] [REMOTE    ] SPXC: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T21:14:16.585079] [INFO ] [REMOTE    ] SQM: Incremental fetch complete for 2025-01 (0.44 seconds).
[2025-10-24T21:14:16.947708] [INFO ] [REMOTE    ] SPNT: Fetching primary data for 2025-08.
[2025-10-24T21:14:17.631495] [INFO ] [REMOTE    ] SPNT: Incremental fetch complete for 2025-08 (0.68 seconds).
[2025-10-24T21:14:17.747601] [INFO ] [REMOTE    ] SPNT: Fetching primary data for 2025-09.
[2025-10-24T21:14:18.547631] [INFO ] [REMOTE    ] SQM: Fetching primary data for 2025-02.
[2025-10-24T21:14:18.933787] [INFO ] [REMOTE    ] SPNT: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T21:14:19.347689] [INFO ] [REMOTE    ] SPXC: Fetching primary data for 2025-03.
[2025-10-24T21:14:19.480560] [INFO ] [REMOTE    ] SQM: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T21:14:19.941892] [INFO ] [REMOTE    ] SPXC: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T21:14:20.147700] [INFO ] [REMOTE    ] SPXC: Fetching primary data for 2025-04.
[2025-10-24T21:14:20.947635] [INFO ] [REMOTE    ] SPXX: Fetching primary data for 2025-02.
[2025-10-24T21:14:21.276014] [INFO ] [REMOTE    ] SPXC: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T21:14:21.643902] [INFO ] [REMOTE    ] SPXX: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T21:14:21.747746] [INFO ] [REMOTE    ] SQM: Fetching primary data for 2025-03.
[2025-10-24T21:14:22.547676] [INFO ] [REMOTE    ] SPXC: Fetching primary data for 2025-05.
[2025-10-24T21:14:22.717605] [INFO ] [REMOTE    ] SQM: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T21:14:23.131300] [INFO ] [REMOTE    ] SPXC: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T21:14:23.347673] [INFO ] [REMOTE    ] SPXC: Fetching primary data for 2025-06.
[2025-10-24T21:14:23.935955] [INFO ] [REMOTE    ] SPXC: Incremental fetch complete for 2025-06 (0.59 seconds).
[2025-10-24T21:14:24.147711] [INFO ] [REMOTE    ] SPNT: Fetching primary data for 2025-10.
[2025-10-24T21:14:24.947729] [INFO ] [REMOTE    ] SPXX: Fetching primary data for 2025-03.
[2025-10-24T21:14:25.047944] [INFO ] [REMOTE    ] SPNT: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T21:14:25.053474] [INFO ] [REMOTE    ] SPNT: Full fetch complete (48161 records).
[2025-10-24T21:14:25.053576] [DEBUG] [VALIDATOR ] SPNT: Validating primary data.
[2025-10-24T21:14:25.054461] [FATAL] [VALIDATOR ] SPNT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:14:25.054561] [FATAL] [MAIN      ] SPNT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:14:25.054604] [WARN ] [MAIN      ] SPNT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:14:25.054662] [INFO ] [LOCAL     ] SPNT: Starting deletion of primary data.
[2025-10-24T21:14:25.054739] [DEBUG] [LOCAL     ] SPNT: No primary data file found to delete.
[2025-10-24T21:14:25.054775] [INFO ] [LOCAL     ] SPNT: Starting deletion of derivative data.
[2025-10-24T21:14:25.054914] [DEBUG] [LOCAL     ] SPNT: Deleted derivative data file.
[2025-10-24T21:14:25.054982] [INFO ] [MAIN      ] Update Progress: 1979/2366 symbols completed. SPNT took 51.2s. Estimated remaining: 49m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:14:25.246672] [INFO ] [MAIN      ] SQNS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:14:25.273949] [DEBUG] [LOCAL     ] SQNS: Loaded 28317 existing records from primary storage.
[2025-10-24T21:14:25.274203] [INFO ] [MAIN      ] SQNS: Loaded 28317 existing records.
[2025-10-24T21:14:25.461770] [WARN ] [MAIN      ] SQNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:14:25.462023] [INFO ] [MAIN      ] SQNS: Wiping existing primary data before full refresh.
[2025-10-24T21:14:25.462101] [INFO ] [LOCAL     ] SQNS: Starting deletion of primary data.
[2025-10-24T21:14:25.469731] [DEBUG] [LOCAL     ] SQNS: Deleted primary data file.
[2025-10-24T21:14:25.469688] [INFO ] [REMOTE    ] SPXX: Incremental fetch complete for 2025-03 (0.52 seconds).
[2025-10-24T21:14:25.470803] [INFO ] [MAIN      ] SQNS: Starting full primary refresh.
[2025-10-24T21:14:25.752938] [INFO ] [REMOTE    ] SPXX: Fetching primary data for 2025-04.
[2025-10-24T21:14:25.848052] [INFO ] [REMOTE    ] SQNS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:14:26.482423] [INFO ] [REMOTE    ] SPXX: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T21:14:26.547627] [INFO ] [REMOTE    ] SPXX: Fetching primary data for 2025-05.
[2025-10-24T21:14:27.001521] [INFO ] [REMOTE    ] SPXX: Incremental fetch complete for 2025-05 (0.45 seconds).
[2025-10-24T21:14:27.347719] [INFO ] [REMOTE    ] SPXX: Fetching primary data for 2025-06.
[2025-10-24T21:14:28.042347] [INFO ] [REMOTE    ] SPXX: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T21:14:28.147622] [INFO ] [REMOTE    ] SPXX: Fetching primary data for 2025-07.
[2025-10-24T21:14:28.615984] [INFO ] [REMOTE    ] SPXX: Incremental fetch complete for 2025-07 (0.47 seconds).
[2025-10-24T21:14:28.947699] [INFO ] [REMOTE    ] SPXX: Fetching primary data for 2025-08.
[2025-10-24T21:14:29.403757] [INFO ] [REMOTE    ] SPXX: Incremental fetch complete for 2025-08 (0.46 seconds).
[2025-10-24T21:14:29.747702] [INFO ] [REMOTE    ] SPXX: Fetching primary data for 2025-09.
[2025-10-24T21:14:30.325922] [INFO ] [REMOTE    ] SPXX: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T21:14:30.547754] [INFO ] [REMOTE    ] SQM: Fetching primary data for 2025-04.
[2025-10-24T21:14:31.209961] [INFO ] [REMOTE    ] SQM: Incremental fetch complete for 2025-04 (0.66 seconds).
[2025-10-24T21:14:31.347672] [INFO ] [REMOTE    ] SQM: Fetching primary data for 2025-05.
[2025-10-24T21:14:32.091901] [INFO ] [REMOTE    ] SQM: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T21:14:32.147692] [INFO ] [REMOTE    ] SPXC: Fetching primary data for 2025-07.
[2025-10-24T21:14:32.788227] [INFO ] [REMOTE    ] SPXC: Incremental fetch complete for 2025-07 (0.64 seconds).
[2025-10-24T21:14:32.947761] [INFO ] [REMOTE    ] SQM: Fetching primary data for 2025-06.
[2025-10-24T21:14:33.747612] [INFO ] [REMOTE    ] SPXC: Fetching primary data for 2025-08.
[2025-10-24T21:14:34.234168] [INFO ] [REMOTE    ] SQM: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T21:14:34.547617] [INFO ] [REMOTE    ] SQNS: Fetching primary data for 2025-01.
[2025-10-24T21:14:35.304876] [INFO ] [REMOTE    ] SQNS: Incremental fetch complete for 2025-01 (0.76 seconds).
[2025-10-24T21:14:35.317703] [INFO ] [REMOTE    ] SPXC: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T21:14:35.347595] [INFO ] [REMOTE    ] SPXC: Fetching primary data for 2025-09.
[2025-10-24T21:14:35.947500] [INFO ] [REMOTE    ] SPXC: Incremental fetch complete for 2025-09 (0.60 seconds).
[2025-10-24T21:14:36.147636] [INFO ] [REMOTE    ] SPXC: Fetching primary data for 2025-10.
[2025-10-24T21:14:36.918419] [INFO ] [REMOTE    ] SPXC: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T21:14:36.922539] [INFO ] [REMOTE    ] SPXC: Full fetch complete (33899 records).
[2025-10-24T21:14:36.922615] [DEBUG] [VALIDATOR ] SPXC: Validating primary data.
[2025-10-24T21:14:36.923106] [FATAL] [VALIDATOR ] SPXC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:14:36.923187] [FATAL] [MAIN      ] SPXC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:14:36.923228] [WARN ] [MAIN      ] SPXC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:14:36.923290] [INFO ] [LOCAL     ] SPXC: Starting deletion of primary data.
[2025-10-24T21:14:36.923351] [DEBUG] [LOCAL     ] SPXC: No primary data file found to delete.
[2025-10-24T21:14:36.923386] [INFO ] [LOCAL     ] SPXC: Starting deletion of derivative data.
[2025-10-24T21:14:36.923529] [DEBUG] [LOCAL     ] SPXC: Deleted derivative data file.
[2025-10-24T21:14:36.923593] [INFO ] [MAIN      ] Update Progress: 1980/2366 symbols completed. SPXC took 33.1s. Estimated remaining: 49m 38s. Rate: 7.8 symbols/min
[2025-10-24T21:14:36.952718] [INFO ] [REMOTE    ] SQNS: Fetching primary data for 2025-02.
[2025-10-24T21:14:37.092051] [INFO ] [MAIN      ] SR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:14:37.122539] [DEBUG] [LOCAL     ] SR: Loaded 32475 existing records from primary storage.
[2025-10-24T21:14:37.122819] [INFO ] [MAIN      ] SR: Loaded 32475 existing records.
[2025-10-24T21:14:37.296763] [WARN ] [MAIN      ] SR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:14:37.296961] [INFO ] [MAIN      ] SR: Wiping existing primary data before full refresh.
[2025-10-24T21:14:37.297007] [INFO ] [LOCAL     ] SR: Starting deletion of primary data.
[2025-10-24T21:14:37.297539] [DEBUG] [LOCAL     ] SR: Deleted primary data file.
[2025-10-24T21:14:37.297594] [INFO ] [MAIN      ] SR: Starting full primary refresh.
[2025-10-24T21:14:37.656466] [INFO ] [REMOTE    ] SR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:14:37.747609] [INFO ] [REMOTE    ] SR: Fetching primary data for 2025-01.
[2025-10-24T21:14:37.788522] [INFO ] [REMOTE    ] SQNS: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T21:14:38.534987] [INFO ] [REMOTE    ] SR: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T21:14:38.547605] [INFO ] [REMOTE    ] SR: Fetching primary data for 2025-02.
[2025-10-24T21:14:39.214981] [INFO ] [REMOTE    ] SR: Incremental fetch complete for 2025-02 (0.67 seconds).
[2025-10-24T21:14:39.347698] [INFO ] [REMOTE    ] SR: Fetching primary data for 2025-03.
[2025-10-24T21:14:40.147680] [INFO ] [REMOTE    ] SQNS: Fetching primary data for 2025-03.
[2025-10-24T21:14:40.425579] [INFO ] [REMOTE    ] SR: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T21:14:40.564093] [INFO ] [REMOTE    ] SQNS: Incremental fetch complete for 2025-03 (0.42 seconds).
[2025-10-24T21:14:40.947701] [INFO ] [REMOTE    ] SQM: Fetching primary data for 2025-07.
[2025-10-24T21:14:41.738427] [INFO ] [REMOTE    ] SQM: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T21:14:41.748835] [INFO ] [REMOTE    ] SR: Fetching primary data for 2025-04.
[2025-10-24T21:14:42.547704] [INFO ] [REMOTE    ] SQM: Fetching primary data for 2025-08.
[2025-10-24T21:14:43.035162] [INFO ] [REMOTE    ] SR: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T21:14:43.312317] [INFO ] [REMOTE    ] SQM: Incremental fetch complete for 2025-08 (0.76 seconds).
[2025-10-24T21:14:43.347611] [INFO ] [REMOTE    ] SQM: Fetching primary data for 2025-09.
[2025-10-24T21:14:44.101773] [INFO ] [REMOTE    ] SQM: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:14:44.147606] [INFO ] [REMOTE    ] SQM: Fetching primary data for 2025-10.
[2025-10-24T21:14:44.931297] [INFO ] [REMOTE    ] SQM: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T21:14:44.940463] [INFO ] [REMOTE    ] SQM: Full fetch complete (69480 records).
[2025-10-24T21:14:44.940602] [DEBUG] [VALIDATOR ] SQM: Validating primary data.
[2025-10-24T21:14:44.941372] [FATAL] [VALIDATOR ] SQM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:14:44.941490] [FATAL] [MAIN      ] SQM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:14:44.941534] [WARN ] [MAIN      ] SQM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:14:44.941597] [INFO ] [LOCAL     ] SQM: Starting deletion of primary data.
[2025-10-24T21:14:44.941715] [DEBUG] [LOCAL     ] SQM: No primary data file found to delete.
[2025-10-24T21:14:44.941795] [INFO ] [LOCAL     ] SQM: Starting deletion of derivative data.
[2025-10-24T21:14:44.942002] [DEBUG] [LOCAL     ] SQM: Deleted derivative data file.
[2025-10-24T21:14:44.942479] [INFO ] [MAIN      ] Update Progress: 1981/2366 symbols completed. SQM took 29.9s. Estimated remaining: 49m 30s. Rate: 7.8 symbols/min
[2025-10-24T21:14:44.953930] [INFO ] [REMOTE    ] SR: Fetching primary data for 2025-05.
[2025-10-24T21:14:45.128171] [INFO ] [MAIN      ] SRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:14:45.179632] [DEBUG] [LOCAL     ] SRE: Loaded 53793 existing records from primary storage.
[2025-10-24T21:14:45.180026] [INFO ] [MAIN      ] SRE: Loaded 53793 existing records.
[2025-10-24T21:14:45.370305] [WARN ] [MAIN      ] SRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:14:45.370529] [INFO ] [MAIN      ] SRE: Wiping existing primary data before full refresh.
[2025-10-24T21:14:45.370576] [INFO ] [LOCAL     ] SRE: Starting deletion of primary data.
[2025-10-24T21:14:45.370899] [DEBUG] [LOCAL     ] SRE: Deleted primary data file.
[2025-10-24T21:14:45.370956] [INFO ] [MAIN      ] SRE: Starting full primary refresh.
[2025-10-24T21:14:45.749015] [INFO ] [REMOTE    ] SPXX: Fetching primary data for 2025-10.
[2025-10-24T21:14:45.754050] [INFO ] [REMOTE    ] SRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:14:45.775410] [INFO ] [REMOTE    ] SR: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T21:14:46.547696] [INFO ] [REMOTE    ] SR: Fetching primary data for 2025-06.
[2025-10-24T21:14:46.634096] [INFO ] [REMOTE    ] SPXX: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T21:14:46.636795] [INFO ] [REMOTE    ] SPXX: Full fetch complete (13439 records).
[2025-10-24T21:14:46.636866] [DEBUG] [VALIDATOR ] SPXX: Validating primary data.
[2025-10-24T21:14:46.637231] [FATAL] [VALIDATOR ] SPXX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:14:46.637309] [FATAL] [MAIN      ] SPXX: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:14:46.637392] [WARN ] [MAIN      ] SPXX: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:14:46.637498] [INFO ] [LOCAL     ] SPXX: Starting deletion of primary data.
[2025-10-24T21:14:46.637579] [DEBUG] [LOCAL     ] SPXX: No primary data file found to delete.
[2025-10-24T21:14:46.637697] [INFO ] [LOCAL     ] SPXX: Starting deletion of derivative data.
[2025-10-24T21:14:46.637906] [DEBUG] [LOCAL     ] SPXX: Deleted derivative data file.
[2025-10-24T21:14:46.638003] [INFO ] [MAIN      ] Update Progress: 1982/2366 symbols completed. SPXX took 38.2s. Estimated remaining: 49m 21s. Rate: 7.8 symbols/min
[2025-10-24T21:14:46.807902] [INFO ] [MAIN      ] SREA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:14:46.820011] [DEBUG] [LOCAL     ] SREA: Loaded 9711 existing records from primary storage.
[2025-10-24T21:14:46.820897] [INFO ] [MAIN      ] SREA: Loaded 9711 existing records.
[2025-10-24T21:14:47.003552] [WARN ] [MAIN      ] SREA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:14:47.003863] [INFO ] [MAIN      ] SREA: Wiping existing primary data before full refresh.
[2025-10-24T21:14:47.004000] [INFO ] [LOCAL     ] SREA: Starting deletion of primary data.
[2025-10-24T21:14:47.004206] [DEBUG] [LOCAL     ] SREA: Deleted primary data file.
[2025-10-24T21:14:47.004265] [INFO ] [MAIN      ] SREA: Starting full primary refresh.
[2025-10-24T21:14:47.122704] [INFO ] [REMOTE    ] SR: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T21:14:47.355364] [INFO ] [REMOTE    ] SR: Fetching primary data for 2025-07.
[2025-10-24T21:14:47.384685] [INFO ] [REMOTE    ] SREA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:14:48.147613] [INFO ] [REMOTE    ] SQNS: Fetching primary data for 2025-04.
[2025-10-24T21:14:48.246952] [INFO ] [REMOTE    ] SR: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T21:14:48.757903] [INFO ] [REMOTE    ] SQNS: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T21:14:48.947692] [INFO ] [REMOTE    ] SR: Fetching primary data for 2025-08.
[2025-10-24T21:14:49.699492] [INFO ] [REMOTE    ] SR: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T21:14:49.747607] [INFO ] [REMOTE    ] SR: Fetching primary data for 2025-09.
[2025-10-24T21:14:50.547615] [INFO ] [REMOTE    ] SQNS: Fetching primary data for 2025-05.
[2025-10-24T21:14:50.640826] [INFO ] [REMOTE    ] SR: Incremental fetch complete for 2025-09 (0.89 seconds).
[2025-10-24T21:14:51.273288] [INFO ] [REMOTE    ] SQNS: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T21:14:51.347713] [INFO ] [REMOTE    ] SR: Fetching primary data for 2025-10.
[2025-10-24T21:14:52.147727] [INFO ] [REMOTE    ] SREA: Fetching primary data for 2025-01.
[2025-10-24T21:14:52.296985] [INFO ] [REMOTE    ] SR: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T21:14:52.302256] [INFO ] [REMOTE    ] SR: Full fetch complete (45938 records).
[2025-10-24T21:14:52.302373] [DEBUG] [VALIDATOR ] SR: Validating primary data.
[2025-10-24T21:14:52.303056] [FATAL] [VALIDATOR ] SR: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:14:52.303138] [FATAL] [MAIN      ] SR: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:14:52.303181] [WARN ] [MAIN      ] SR: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:14:52.303246] [INFO ] [LOCAL     ] SR: Starting deletion of primary data.
[2025-10-24T21:14:52.303307] [DEBUG] [LOCAL     ] SR: No primary data file found to delete.
[2025-10-24T21:14:52.303343] [INFO ] [LOCAL     ] SR: Starting deletion of derivative data.
[2025-10-24T21:14:52.303481] [DEBUG] [LOCAL     ] SR: Deleted derivative data file.
[2025-10-24T21:14:52.303551] [INFO ] [MAIN      ] Update Progress: 1983/2366 symbols completed. SR took 15.4s. Estimated remaining: 49m 13s. Rate: 7.8 symbols/min
[2025-10-24T21:14:52.477566] [INFO ] [MAIN      ] SRFM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:14:52.517291] [DEBUG] [LOCAL     ] SRFM: Loaded 40399 existing records from primary storage.
[2025-10-24T21:14:52.517697] [INFO ] [MAIN      ] SRFM: Loaded 40399 existing records.
[2025-10-24T21:14:52.696268] [WARN ] [MAIN      ] SRFM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:14:52.696607] [INFO ] [MAIN      ] SRFM: Wiping existing primary data before full refresh.
[2025-10-24T21:14:52.696690] [INFO ] [LOCAL     ] SRFM: Starting deletion of primary data.
[2025-10-24T21:14:52.697348] [DEBUG] [LOCAL     ] SRFM: Deleted primary data file.
[2025-10-24T21:14:52.697407] [INFO ] [MAIN      ] SRFM: Starting full primary refresh.
[2025-10-24T21:14:52.952736] [INFO ] [REMOTE    ] SRE: Fetching primary data for 2025-01.
[2025-10-24T21:14:52.965153] [INFO ] [REMOTE    ] SREA: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T21:14:53.113397] [INFO ] [REMOTE    ] SRFM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:14:53.747670] [INFO ] [REMOTE    ] SQNS: Fetching primary data for 2025-06.
[2025-10-24T21:14:54.073945] [INFO ] [REMOTE    ] SRE: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T21:14:54.547671] [INFO ] [REMOTE    ] SRE: Fetching primary data for 2025-02.
[2025-10-24T21:14:54.736693] [INFO ] [REMOTE    ] SQNS: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T21:14:55.347611] [INFO ] [REMOTE    ] SQNS: Fetching primary data for 2025-07.
[2025-10-24T21:14:55.684113] [INFO ] [REMOTE    ] SRE: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T21:14:55.795792] [INFO ] [REMOTE    ] SQNS: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T21:14:56.147714] [INFO ] [REMOTE    ] SRFM: Fetching primary data for 2025-01.
[2025-10-24T21:14:56.947621] [INFO ] [REMOTE    ] SREA: Fetching primary data for 2025-02.
[2025-10-24T21:14:57.353934] [INFO ] [REMOTE    ] SRFM: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T21:14:57.425709] [INFO ] [REMOTE    ] SREA: Incremental fetch complete for 2025-02 (0.48 seconds).
[2025-10-24T21:14:57.747724] [INFO ] [REMOTE    ] SQNS: Fetching primary data for 2025-08.
[2025-10-24T21:14:58.547729] [INFO ] [REMOTE    ] SRFM: Fetching primary data for 2025-02.
[2025-10-24T21:14:58.850042] [INFO ] [REMOTE    ] SQNS: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T21:14:59.136721] [INFO ] [REMOTE    ] SRFM: Incremental fetch complete for 2025-02 (0.59 seconds).
[2025-10-24T21:14:59.347683] [INFO ] [REMOTE    ] SRE: Fetching primary data for 2025-03.
[2025-10-24T21:15:00.147685] [INFO ] [REMOTE    ] SREA: Fetching primary data for 2025-03.
[2025-10-24T21:15:00.477779] [INFO ] [REMOTE    ] SRE: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T21:15:00.947629] [INFO ] [REMOTE    ] SRE: Fetching primary data for 2025-04.
[2025-10-24T21:15:01.128057] [INFO ] [REMOTE    ] SREA: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T21:15:01.706749] [INFO ] [REMOTE    ] SRE: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T21:15:01.747717] [INFO ] [REMOTE    ] SQNS: Fetching primary data for 2025-09.
[2025-10-24T21:15:02.519861] [INFO ] [REMOTE    ] SQNS: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T21:15:02.547696] [INFO ] [REMOTE    ] SRFM: Fetching primary data for 2025-03.
[2025-10-24T21:15:03.305334] [INFO ] [REMOTE    ] SRFM: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T21:15:03.347671] [INFO ] [REMOTE    ] SRE: Fetching primary data for 2025-05.
[2025-10-24T21:15:04.147706] [INFO ] [REMOTE    ] SREA: Fetching primary data for 2025-04.
[2025-10-24T21:15:04.460742] [INFO ] [REMOTE    ] SRE: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T21:15:04.770211] [INFO ] [REMOTE    ] SREA: Incremental fetch complete for 2025-04 (0.62 seconds).
[2025-10-24T21:15:04.947681] [INFO ] [REMOTE    ] SREA: Fetching primary data for 2025-05.
[2025-10-24T21:15:05.664334] [INFO ] [REMOTE    ] SREA: Incremental fetch complete for 2025-05 (0.72 seconds).
[2025-10-24T21:15:05.747681] [INFO ] [REMOTE    ] SREA: Fetching primary data for 2025-06.
[2025-10-24T21:15:06.245357] [INFO ] [REMOTE    ] SREA: Incremental fetch complete for 2025-06 (0.50 seconds).
[2025-10-24T21:15:06.547700] [INFO ] [REMOTE    ] SREA: Fetching primary data for 2025-07.
[2025-10-24T21:15:07.033153] [INFO ] [REMOTE    ] SREA: Incremental fetch complete for 2025-07 (0.49 seconds).
[2025-10-24T21:15:07.347667] [INFO ] [REMOTE    ] SRFM: Fetching primary data for 2025-04.
[2025-10-24T21:15:08.147672] [INFO ] [REMOTE    ] SQNS: Fetching primary data for 2025-10.
[2025-10-24T21:15:08.310992] [INFO ] [REMOTE    ] SRFM: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T21:15:08.947707] [INFO ] [REMOTE    ] SRFM: Fetching primary data for 2025-05.
[2025-10-24T21:15:09.016312] [INFO ] [REMOTE    ] SQNS: Incremental fetch complete for 2025-10 (0.87 seconds).
[2025-10-24T21:15:09.021487] [INFO ] [REMOTE    ] SQNS: Full fetch complete (32963 records).
[2025-10-24T21:15:09.021828] [DEBUG] [VALIDATOR ] SQNS: Validating primary data.
[2025-10-24T21:15:09.022951] [FATAL] [VALIDATOR ] SQNS: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:15:09.023052] [FATAL] [MAIN      ] SQNS: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:15:09.023099] [WARN ] [MAIN      ] SQNS: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:15:09.023177] [INFO ] [LOCAL     ] SQNS: Starting deletion of primary data.
[2025-10-24T21:15:09.023246] [DEBUG] [LOCAL     ] SQNS: No primary data file found to delete.
[2025-10-24T21:15:09.023285] [INFO ] [LOCAL     ] SQNS: Starting deletion of derivative data.
[2025-10-24T21:15:09.023490] [DEBUG] [LOCAL     ] SQNS: Deleted derivative data file.
[2025-10-24T21:15:09.023618] [INFO ] [MAIN      ] Update Progress: 1984/2366 symbols completed. SQNS took 44.0s. Estimated remaining: 49m 7s. Rate: 7.8 symbols/min
[2025-10-24T21:15:09.196561] [INFO ] [MAIN      ] SRG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:15:09.212693] [DEBUG] [LOCAL     ] SRG: Loaded 14820 existing records from primary storage.
[2025-10-24T21:15:09.212937] [INFO ] [MAIN      ] SRG: Loaded 14820 existing records.
[2025-10-24T21:15:09.387990] [WARN ] [MAIN      ] SRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:15:09.388222] [INFO ] [MAIN      ] SRG: Wiping existing primary data before full refresh.
[2025-10-24T21:15:09.388269] [INFO ] [LOCAL     ] SRG: Starting deletion of primary data.
[2025-10-24T21:15:09.388470] [DEBUG] [LOCAL     ] SRG: Deleted primary data file.
[2025-10-24T21:15:09.388524] [INFO ] [MAIN      ] SRG: Starting full primary refresh.
[2025-10-24T21:15:09.748243] [INFO ] [REMOTE    ] SRG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:15:09.748453] [INFO ] [REMOTE    ] SRE: Fetching primary data for 2025-06.
[2025-10-24T21:15:09.821247] [INFO ] [REMOTE    ] SRFM: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T21:15:10.547689] [INFO ] [REMOTE    ] SREA: Fetching primary data for 2025-08.
[2025-10-24T21:15:10.790361] [INFO ] [REMOTE    ] SRE: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T21:15:11.279437] [INFO ] [REMOTE    ] SREA: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T21:15:11.347700] [INFO ] [REMOTE    ] SRFM: Fetching primary data for 2025-06.
[2025-10-24T21:15:12.057944] [INFO ] [REMOTE    ] SRFM: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T21:15:12.147621] [INFO ] [REMOTE    ] SRFM: Fetching primary data for 2025-07.
[2025-10-24T21:15:12.947615] [INFO ] [REMOTE    ] SRG: Fetching primary data for 2025-01.
[2025-10-24T21:15:13.274512] [INFO ] [REMOTE    ] SRFM: Incremental fetch complete for 2025-07 (1.13 seconds).
[2025-10-24T21:15:13.747669] [INFO ] [REMOTE    ] SREA: Fetching primary data for 2025-09.
[2025-10-24T21:15:14.028744] [INFO ] [REMOTE    ] SRG: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T21:15:14.236318] [INFO ] [REMOTE    ] SREA: Incremental fetch complete for 2025-09 (0.49 seconds).
[2025-10-24T21:15:14.547660] [INFO ] [REMOTE    ] SRFM: Fetching primary data for 2025-08.
[2025-10-24T21:15:14.654969] [DEBUG] [REMOTE    ] SRFM: Error fetching primary data for 2025-08: 'API call returned an empty response.'
[2025-10-24T21:15:14.655316] [WARN ] [REMOTE    ] SRFM: No data returned for month 2025-08
[2025-10-24T21:15:14.655404] [FATAL] [REMOTE    ] SRFM: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:15:14.655484] [FATAL] [MAIN      ] SRFM: Failed to fetch primary data.
[2025-10-24T21:15:14.655549] [WARN ] [MAIN      ] SRFM: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:15:14.655622] [INFO ] [LOCAL     ] SRFM: Starting deletion of primary data.
[2025-10-24T21:15:14.655727] [DEBUG] [LOCAL     ] SRFM: No primary data file found to delete.
[2025-10-24T21:15:14.655775] [INFO ] [LOCAL     ] SRFM: Starting deletion of derivative data.
[2025-10-24T21:15:14.655924] [DEBUG] [LOCAL     ] SRFM: Deleted derivative data file.
[2025-10-24T21:15:14.655988] [INFO ] [MAIN      ] Update Progress: 1985/2366 symbols completed. SRFM took 22.4s. Estimated remaining: 48m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:15:14.847126] [INFO ] [MAIN      ] SRI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:15:14.877874] [DEBUG] [LOCAL     ] SRI: Loaded 26338 existing records from primary storage.
[2025-10-24T21:15:14.878180] [INFO ] [MAIN      ] SRI: Loaded 26338 existing records.
[2025-10-24T21:15:15.057795] [WARN ] [MAIN      ] SRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:15:15.058039] [INFO ] [MAIN      ] SRI: Wiping existing primary data before full refresh.
[2025-10-24T21:15:15.058090] [INFO ] [LOCAL     ] SRI: Starting deletion of primary data.
[2025-10-24T21:15:15.058352] [DEBUG] [LOCAL     ] SRI: Deleted primary data file.
[2025-10-24T21:15:15.058391] [INFO ] [MAIN      ] SRI: Starting full primary refresh.
[2025-10-24T21:15:15.352707] [INFO ] [REMOTE    ] SREA: Fetching primary data for 2025-10.
[2025-10-24T21:15:15.416980] [INFO ] [REMOTE    ] SRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:15:15.802349] [INFO ] [REMOTE    ] SREA: Incremental fetch complete for 2025-10 (0.45 seconds).
[2025-10-24T21:15:15.804145] [INFO ] [REMOTE    ] SREA: Full fetch complete (14590 records).
[2025-10-24T21:15:15.804214] [DEBUG] [VALIDATOR ] SREA: Validating primary data.
[2025-10-24T21:15:15.804582] [FATAL] [VALIDATOR ] SREA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:15:15.804690] [FATAL] [MAIN      ] SREA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:15:15.804740] [WARN ] [MAIN      ] SREA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:15:15.804792] [INFO ] [LOCAL     ] SREA: Starting deletion of primary data.
[2025-10-24T21:15:15.804876] [DEBUG] [LOCAL     ] SREA: No primary data file found to delete.
[2025-10-24T21:15:15.804931] [INFO ] [LOCAL     ] SREA: Starting deletion of derivative data.
[2025-10-24T21:15:15.805128] [DEBUG] [LOCAL     ] SREA: Deleted derivative data file.
[2025-10-24T21:15:15.805226] [INFO ] [MAIN      ] Update Progress: 1986/2366 symbols completed. SREA took 29.2s. Estimated remaining: 48m 50s. Rate: 7.8 symbols/min
[2025-10-24T21:15:15.971273] [INFO ] [MAIN      ] SRL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:15:15.971471] [DEBUG] [LOCAL     ] SRL: No existing data file found in primary storage.
[2025-10-24T21:15:15.971509] [WARN ] [MAIN      ] SRL: No existing data found, performing full refresh instead.
[2025-10-24T21:15:15.971619] [INFO ] [MAIN      ] SRL: Wiping existing primary data before full refresh.
[2025-10-24T21:15:15.971712] [INFO ] [LOCAL     ] SRL: Starting deletion of primary data.
[2025-10-24T21:15:15.971794] [DEBUG] [LOCAL     ] SRL: No primary data file found to delete.
[2025-10-24T21:15:15.971883] [INFO ] [MAIN      ] SRL: Starting full primary refresh.
[2025-10-24T21:15:16.153994] [INFO ] [REMOTE    ] SRI: Fetching primary data for 2025-01.
[2025-10-24T21:15:16.339121] [INFO ] [REMOTE    ] SRL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:15:16.947681] [INFO ] [REMOTE    ] SRL: Fetching primary data for 2025-01.
[2025-10-24T21:15:17.462338] [INFO ] [REMOTE    ] SRI: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T21:15:17.747680] [INFO ] [REMOTE    ] SRI: Fetching primary data for 2025-02.
[2025-10-24T21:15:17.838987] [INFO ] [REMOTE    ] SRL: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T21:15:18.547626] [INFO ] [REMOTE    ] SRE: Fetching primary data for 2025-07.
[2025-10-24T21:15:18.712606] [INFO ] [REMOTE    ] SRI: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T21:15:19.314434] [INFO ] [REMOTE    ] SRE: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T21:15:19.347615] [INFO ] [REMOTE    ] SRE: Fetching primary data for 2025-08.
[2025-10-24T21:15:20.147628] [INFO ] [REMOTE    ] SRL: Fetching primary data for 2025-02.
[2025-10-24T21:15:20.250685] [INFO ] [REMOTE    ] SRE: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T21:15:20.369390] [INFO ] [REMOTE    ] SRL: Incremental fetch complete for 2025-02 (0.22 seconds).
[2025-10-24T21:15:20.947707] [INFO ] [REMOTE    ] SRI: Fetching primary data for 2025-03.
[2025-10-24T21:15:21.635811] [INFO ] [REMOTE    ] SRI: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T21:15:21.747679] [INFO ] [REMOTE    ] SRL: Fetching primary data for 2025-03.
[2025-10-24T21:15:22.243872] [INFO ] [REMOTE    ] SRL: Incremental fetch complete for 2025-03 (0.50 seconds).
[2025-10-24T21:15:22.547620] [INFO ] [REMOTE    ] SRE: Fetching primary data for 2025-09.
[2025-10-24T21:15:23.347618] [INFO ] [REMOTE    ] SRL: Fetching primary data for 2025-04.
[2025-10-24T21:15:23.559211] [INFO ] [REMOTE    ] SRL: Incremental fetch complete for 2025-04 (0.21 seconds).
[2025-10-24T21:15:23.912789] [INFO ] [REMOTE    ] SRE: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T21:15:24.147672] [INFO ] [REMOTE    ] SRG: Fetching primary data for 2025-02.
[2025-10-24T21:15:24.906369] [INFO ] [REMOTE    ] SRG: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T21:15:24.947631] [INFO ] [REMOTE    ] SRG: Fetching primary data for 2025-03.
[2025-10-24T21:15:25.698224] [INFO ] [REMOTE    ] SRG: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T21:15:25.747619] [INFO ] [REMOTE    ] SRG: Fetching primary data for 2025-04.
[2025-10-24T21:15:26.351899] [INFO ] [REMOTE    ] SRG: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T21:15:26.547694] [INFO ] [REMOTE    ] SRG: Fetching primary data for 2025-05.
[2025-10-24T21:15:27.113937] [INFO ] [REMOTE    ] SRG: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T21:15:27.347639] [INFO ] [REMOTE    ] SRG: Fetching primary data for 2025-06.
[2025-10-24T21:15:28.147622] [INFO ] [REMOTE    ] SRE: Fetching primary data for 2025-10.
[2025-10-24T21:15:28.204448] [INFO ] [REMOTE    ] SRG: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T21:15:28.947671] [INFO ] [REMOTE    ] SRI: Fetching primary data for 2025-04.
[2025-10-24T21:15:29.235607] [INFO ] [REMOTE    ] SRE: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T21:15:29.244793] [INFO ] [REMOTE    ] SRE: Full fetch complete (77106 records).
[2025-10-24T21:15:29.244930] [DEBUG] [VALIDATOR ] SRE: Validating primary data.
[2025-10-24T21:15:29.245681] [FATAL] [VALIDATOR ] SRE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:15:29.245766] [FATAL] [MAIN      ] SRE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:15:29.245807] [WARN ] [MAIN      ] SRE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:15:29.245873] [INFO ] [LOCAL     ] SRE: Starting deletion of primary data.
[2025-10-24T21:15:29.245935] [DEBUG] [LOCAL     ] SRE: No primary data file found to delete.
[2025-10-24T21:15:29.245970] [INFO ] [LOCAL     ] SRE: Starting deletion of derivative data.
[2025-10-24T21:15:29.246127] [DEBUG] [LOCAL     ] SRE: Deleted derivative data file.
[2025-10-24T21:15:29.246542] [INFO ] [MAIN      ] Update Progress: 1987/2366 symbols completed. SRE took 44.3s. Estimated remaining: 48m 43s. Rate: 7.8 symbols/min
[2025-10-24T21:15:29.417063] [INFO ] [MAIN      ] SRV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:15:29.427548] [DEBUG] [LOCAL     ] SRV: Loaded 7431 existing records from primary storage.
[2025-10-24T21:15:29.427803] [INFO ] [MAIN      ] SRV: Loaded 7431 existing records.
[2025-10-24T21:15:29.610209] [WARN ] [MAIN      ] SRV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:15:29.610414] [INFO ] [MAIN      ] SRV: Wiping existing primary data before full refresh.
[2025-10-24T21:15:29.610462] [INFO ] [LOCAL     ] SRV: Starting deletion of primary data.
[2025-10-24T21:15:29.610595] [DEBUG] [LOCAL     ] SRV: Deleted primary data file.
[2025-10-24T21:15:29.610633] [INFO ] [MAIN      ] SRV: Starting full primary refresh.
[2025-10-24T21:15:29.758899] [INFO ] [REMOTE    ] SRG: Fetching primary data for 2025-07.
[2025-10-24T21:15:29.978793] [INFO ] [REMOTE    ] SRV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:15:29.995911] [INFO ] [REMOTE    ] SRI: Incremental fetch complete for 2025-04 (1.05 seconds).
[2025-10-24T21:15:30.307225] [INFO ] [REMOTE    ] SRG: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T21:15:30.547628] [INFO ] [REMOTE    ] SRG: Fetching primary data for 2025-08.
[2025-10-24T21:15:31.347631] [INFO ] [REMOTE    ] SRL: Fetching primary data for 2025-05.
[2025-10-24T21:15:31.401121] [INFO ] [REMOTE    ] SRG: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T21:15:31.671285] [INFO ] [REMOTE    ] SRL: Incremental fetch complete for 2025-05 (0.32 seconds).
[2025-10-24T21:15:32.147675] [INFO ] [REMOTE    ] SRL: Fetching primary data for 2025-06.
[2025-10-24T21:15:32.362759] [INFO ] [REMOTE    ] SRL: Incremental fetch complete for 2025-06 (0.22 seconds).
[2025-10-24T21:15:32.947669] [INFO ] [REMOTE    ] SRL: Fetching primary data for 2025-07.
[2025-10-24T21:15:33.164219] [INFO ] [REMOTE    ] SRL: Incremental fetch complete for 2025-07 (0.22 seconds).
[2025-10-24T21:15:33.747702] [INFO ] [REMOTE    ] SRG: Fetching primary data for 2025-09.
[2025-10-24T21:15:34.547729] [INFO ] [REMOTE    ] SRL: Fetching primary data for 2025-08.
[2025-10-24T21:15:34.917825] [INFO ] [REMOTE    ] SRL: Incremental fetch complete for 2025-08 (0.37 seconds).
[2025-10-24T21:15:34.973301] [INFO ] [REMOTE    ] SRG: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T21:15:35.347670] [INFO ] [REMOTE    ] SRL: Fetching primary data for 2025-09.
[2025-10-24T21:15:36.031383] [INFO ] [REMOTE    ] SRL: Incremental fetch complete for 2025-09 (0.68 seconds).
[2025-10-24T21:15:36.147677] [INFO ] [REMOTE    ] SRL: Fetching primary data for 2025-10.
[2025-10-24T21:15:36.839577] [INFO ] [REMOTE    ] SRL: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T21:15:36.840713] [INFO ] [REMOTE    ] SRL: Full fetch complete (1632 records).
[2025-10-24T21:15:36.840845] [DEBUG] [VALIDATOR ] SRL: Validating primary data.
[2025-10-24T21:15:36.841284] [FATAL] [VALIDATOR ] SRL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:15:36.841379] [FATAL] [MAIN      ] SRL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:15:36.841434] [WARN ] [MAIN      ] SRL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:15:36.841493] [INFO ] [LOCAL     ] SRL: Starting deletion of primary data.
[2025-10-24T21:15:36.841586] [DEBUG] [LOCAL     ] SRL: No primary data file found to delete.
[2025-10-24T21:15:36.841635] [INFO ] [LOCAL     ] SRL: Starting deletion of derivative data.
[2025-10-24T21:15:36.841737] [DEBUG] [LOCAL     ] SRL: No derivative data file found to delete.
[2025-10-24T21:15:36.841998] [INFO ] [MAIN      ] Update Progress: 1988/2366 symbols completed. SRL took 21.0s. Estimated remaining: 48m 36s. Rate: 7.8 symbols/min
[2025-10-24T21:15:36.948383] [INFO ] [REMOTE    ] SRI: Fetching primary data for 2025-05.
[2025-10-24T21:15:37.020509] [INFO ] [MAIN      ] SSB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:15:37.060533] [DEBUG] [LOCAL     ] SSB: Loaded 43090 existing records from primary storage.
[2025-10-24T21:15:37.060896] [INFO ] [MAIN      ] SSB: Loaded 43090 existing records.
[2025-10-24T21:15:37.249946] [WARN ] [MAIN      ] SSB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:15:37.250272] [INFO ] [MAIN      ] SSB: Wiping existing primary data before full refresh.
[2025-10-24T21:15:37.250326] [INFO ] [LOCAL     ] SSB: Starting deletion of primary data.
[2025-10-24T21:15:37.250720] [DEBUG] [LOCAL     ] SSB: Deleted primary data file.
[2025-10-24T21:15:37.250779] [INFO ] [MAIN      ] SSB: Starting full primary refresh.
[2025-10-24T21:15:37.628797] [INFO ] [REMOTE    ] SSB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:15:37.747612] [INFO ] [REMOTE    ] SRV: Fetching primary data for 2025-01.
[2025-10-24T21:15:38.161547] [INFO ] [REMOTE    ] SRI: Incremental fetch complete for 2025-05 (1.21 seconds).
[2025-10-24T21:15:38.547714] [INFO ] [REMOTE    ] SRI: Fetching primary data for 2025-06.
[2025-10-24T21:15:38.738378] [INFO ] [REMOTE    ] SRV: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T21:15:39.221377] [INFO ] [REMOTE    ] SRI: Incremental fetch complete for 2025-06 (0.67 seconds).
[2025-10-24T21:15:39.347728] [INFO ] [REMOTE    ] SSB: Fetching primary data for 2025-01.
[2025-10-24T21:15:40.101465] [INFO ] [REMOTE    ] SSB: Incremental fetch complete for 2025-01 (0.75 seconds).
[2025-10-24T21:15:40.147631] [INFO ] [REMOTE    ] SSB: Fetching primary data for 2025-02.
[2025-10-24T21:15:40.889001] [INFO ] [REMOTE    ] SSB: Incremental fetch complete for 2025-02 (0.74 seconds).
[2025-10-24T21:15:40.947699] [INFO ] [REMOTE    ] SRI: Fetching primary data for 2025-07.
[2025-10-24T21:15:41.654256] [INFO ] [REMOTE    ] SRI: Incremental fetch complete for 2025-07 (0.71 seconds).
[2025-10-24T21:15:41.747679] [INFO ] [REMOTE    ] SRG: Fetching primary data for 2025-10.
[2025-10-24T21:15:42.219423] [INFO ] [REMOTE    ] SRG: Incremental fetch complete for 2025-10 (0.47 seconds).
[2025-10-24T21:15:42.222212] [INFO ] [REMOTE    ] SRG: Full fetch complete (23101 records).
[2025-10-24T21:15:42.222324] [DEBUG] [VALIDATOR ] SRG: Validating primary data.
[2025-10-24T21:15:42.222829] [FATAL] [VALIDATOR ] SRG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:15:42.222911] [FATAL] [MAIN      ] SRG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:15:42.222954] [WARN ] [MAIN      ] SRG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:15:42.222994] [INFO ] [LOCAL     ] SRG: Starting deletion of primary data.
[2025-10-24T21:15:42.223068] [DEBUG] [LOCAL     ] SRG: No primary data file found to delete.
[2025-10-24T21:15:42.223103] [INFO ] [LOCAL     ] SRG: Starting deletion of derivative data.
[2025-10-24T21:15:42.223268] [DEBUG] [LOCAL     ] SRG: Deleted derivative data file.
[2025-10-24T21:15:42.223355] [INFO ] [MAIN      ] Update Progress: 1989/2366 symbols completed. SRG took 33.2s. Estimated remaining: 48m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:15:42.397616] [INFO ] [MAIN      ] SSD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:15:42.419943] [DEBUG] [LOCAL     ] SSD: Loaded 22503 existing records from primary storage.
[2025-10-24T21:15:42.420181] [INFO ] [MAIN      ] SSD: Loaded 22503 existing records.
[2025-10-24T21:15:42.558147] [INFO ] [REMOTE    ] SSB: Fetching primary data for 2025-03.
[2025-10-24T21:15:42.597849] [WARN ] [MAIN      ] SSD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:15:42.598328] [INFO ] [MAIN      ] SSD: Wiping existing primary data before full refresh.
[2025-10-24T21:15:42.598382] [INFO ] [LOCAL     ] SSD: Starting deletion of primary data.
[2025-10-24T21:15:42.598630] [DEBUG] [LOCAL     ] SSD: Deleted primary data file.
[2025-10-24T21:15:42.598712] [INFO ] [MAIN      ] SSD: Starting full primary refresh.
[2025-10-24T21:15:42.952405] [INFO ] [REMOTE    ] SSD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:15:43.354583] [INFO ] [REMOTE    ] SRV: Fetching primary data for 2025-02.
[2025-10-24T21:15:43.357488] [INFO ] [REMOTE    ] SSB: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T21:15:43.791036] [INFO ] [REMOTE    ] SRV: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T21:15:44.147679] [INFO ] [REMOTE    ] SRV: Fetching primary data for 2025-03.
[2025-10-24T21:15:44.658301] [INFO ] [REMOTE    ] SRV: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T21:15:44.947716] [INFO ] [REMOTE    ] SSB: Fetching primary data for 2025-04.
[2025-10-24T21:15:45.747616] [INFO ] [REMOTE    ] SSD: Fetching primary data for 2025-01.
[2025-10-24T21:15:45.948512] [INFO ] [REMOTE    ] SSB: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T21:15:46.340781] [INFO ] [REMOTE    ] SSD: Incremental fetch complete for 2025-01 (0.59 seconds).
[2025-10-24T21:15:46.547693] [INFO ] [REMOTE    ] SRI: Fetching primary data for 2025-08.
[2025-10-24T21:15:47.347683] [INFO ] [REMOTE    ] SSB: Fetching primary data for 2025-05.
[2025-10-24T21:15:47.384928] [INFO ] [REMOTE    ] SRI: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T21:15:48.147703] [INFO ] [REMOTE    ] SRV: Fetching primary data for 2025-04.
[2025-10-24T21:15:48.218851] [INFO ] [REMOTE    ] SSB: Incremental fetch complete for 2025-05 (0.87 seconds).
[2025-10-24T21:15:48.820059] [INFO ] [REMOTE    ] SRV: Incremental fetch complete for 2025-04 (0.67 seconds).
[2025-10-24T21:15:48.947670] [INFO ] [REMOTE    ] SRV: Fetching primary data for 2025-05.
[2025-10-24T21:15:49.747674] [INFO ] [REMOTE    ] SSB: Fetching primary data for 2025-06.
[2025-10-24T21:15:49.797583] [INFO ] [REMOTE    ] SRV: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T21:15:50.547711] [INFO ] [REMOTE    ] SRI: Fetching primary data for 2025-09.
[2025-10-24T21:15:51.138170] [INFO ] [REMOTE    ] SSB: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T21:15:51.347739] [INFO ] [REMOTE    ] SRV: Fetching primary data for 2025-06.
[2025-10-24T21:15:51.594875] [INFO ] [REMOTE    ] SRI: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T21:15:52.025986] [INFO ] [REMOTE    ] SRV: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T21:15:52.147732] [INFO ] [REMOTE    ] SSB: Fetching primary data for 2025-07.
[2025-10-24T21:15:52.947696] [INFO ] [REMOTE    ] SSD: Fetching primary data for 2025-02.
[2025-10-24T21:15:53.451509] [INFO ] [REMOTE    ] SSB: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T21:15:53.708500] [INFO ] [REMOTE    ] SSD: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T21:15:53.747726] [INFO ] [REMOTE    ] SSD: Fetching primary data for 2025-03.
[2025-10-24T21:15:54.547734] [INFO ] [REMOTE    ] SSB: Fetching primary data for 2025-08.
[2025-10-24T21:15:54.576746] [INFO ] [REMOTE    ] SSD: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T21:15:55.347625] [INFO ] [REMOTE    ] SSD: Fetching primary data for 2025-04.
[2025-10-24T21:15:55.455916] [INFO ] [REMOTE    ] SSB: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T21:15:55.959158] [INFO ] [REMOTE    ] SSD: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T21:15:56.147687] [INFO ] [REMOTE    ] SRV: Fetching primary data for 2025-07.
[2025-10-24T21:15:56.617567] [INFO ] [REMOTE    ] SRV: Incremental fetch complete for 2025-07 (0.47 seconds).
[2025-10-24T21:15:56.947721] [INFO ] [REMOTE    ] SRV: Fetching primary data for 2025-08.
[2025-10-24T21:15:57.683203] [INFO ] [REMOTE    ] SRV: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T21:15:57.747744] [INFO ] [REMOTE    ] SRI: Fetching primary data for 2025-10.
[2025-10-24T21:15:58.335016] [INFO ] [REMOTE    ] SRI: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T21:15:58.338796] [INFO ] [REMOTE    ] SRI: Full fetch complete (39364 records).
[2025-10-24T21:15:58.338878] [DEBUG] [VALIDATOR ] SRI: Validating primary data.
[2025-10-24T21:15:58.339409] [FATAL] [VALIDATOR ] SRI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:15:58.339491] [FATAL] [MAIN      ] SRI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:15:58.339535] [WARN ] [MAIN      ] SRI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:15:58.339573] [INFO ] [LOCAL     ] SRI: Starting deletion of primary data.
[2025-10-24T21:15:58.339628] [DEBUG] [LOCAL     ] SRI: No primary data file found to delete.
[2025-10-24T21:15:58.339716] [INFO ] [LOCAL     ] SRI: Starting deletion of derivative data.
[2025-10-24T21:15:58.339877] [DEBUG] [LOCAL     ] SRI: Deleted derivative data file.
[2025-10-24T21:15:58.339945] [INFO ] [MAIN      ] Update Progress: 1990/2366 symbols completed. SRI took 43.7s. Estimated remaining: 48m 21s. Rate: 7.8 symbols/min
[2025-10-24T21:15:58.513420] [INFO ] [MAIN      ] SSL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:15:58.549687] [INFO ] [REMOTE    ] SSD: Fetching primary data for 2025-05.
[2025-10-24T21:15:58.550607] [DEBUG] [LOCAL     ] SSL: Loaded 41739 existing records from primary storage.
[2025-10-24T21:15:58.552136] [INFO ] [MAIN      ] SSL: Loaded 41739 existing records.
[2025-10-24T21:15:58.735047] [WARN ] [MAIN      ] SSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:15:58.735270] [INFO ] [MAIN      ] SSL: Wiping existing primary data before full refresh.
[2025-10-24T21:15:58.735317] [INFO ] [LOCAL     ] SSL: Starting deletion of primary data.
[2025-10-24T21:15:58.735623] [DEBUG] [LOCAL     ] SSL: Deleted primary data file.
[2025-10-24T21:15:58.735713] [INFO ] [MAIN      ] SSL: Starting full primary refresh.
[2025-10-24T21:15:59.092225] [INFO ] [REMOTE    ] SSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:15:59.286815] [INFO ] [REMOTE    ] SSD: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T21:15:59.347674] [INFO ] [REMOTE    ] SSL: Fetching primary data for 2025-01.
[2025-10-24T21:16:00.147717] [INFO ] [REMOTE    ] SRV: Fetching primary data for 2025-09.
[2025-10-24T21:16:00.406603] [INFO ] [REMOTE    ] SSL: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T21:16:00.947713] [INFO ] [REMOTE    ] SSL: Fetching primary data for 2025-02.
[2025-10-24T21:16:01.052712] [INFO ] [REMOTE    ] SRV: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T21:16:01.747680] [INFO ] [REMOTE    ] SSB: Fetching primary data for 2025-09.
[2025-10-24T21:16:01.778392] [INFO ] [REMOTE    ] SSL: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T21:16:02.547616] [INFO ] [REMOTE    ] SSL: Fetching primary data for 2025-03.
[2025-10-24T21:16:02.643460] [INFO ] [REMOTE    ] SSB: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T21:16:03.347712] [INFO ] [REMOTE    ] SSD: Fetching primary data for 2025-06.
[2025-10-24T21:16:04.056943] [INFO ] [REMOTE    ] SSL: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T21:16:04.147727] [INFO ] [REMOTE    ] SSB: Fetching primary data for 2025-10.
[2025-10-24T21:16:04.203797] [INFO ] [REMOTE    ] SSD: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T21:16:04.947679] [INFO ] [REMOTE    ] SRV: Fetching primary data for 2025-10.
[2025-10-24T21:16:05.102056] [INFO ] [REMOTE    ] SSB: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T21:16:05.109411] [INFO ] [REMOTE    ] SSB: Full fetch complete (61225 records).
[2025-10-24T21:16:05.109515] [DEBUG] [VALIDATOR ] SSB: Validating primary data.
[2025-10-24T21:16:05.110341] [FATAL] [VALIDATOR ] SSB: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:16:05.110430] [FATAL] [MAIN      ] SSB: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:16:05.110474] [WARN ] [MAIN      ] SSB: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:16:05.110514] [INFO ] [LOCAL     ] SSB: Starting deletion of primary data.
[2025-10-24T21:16:05.110570] [DEBUG] [LOCAL     ] SSB: No primary data file found to delete.
[2025-10-24T21:16:05.110607] [INFO ] [LOCAL     ] SSB: Starting deletion of derivative data.
[2025-10-24T21:16:05.110830] [DEBUG] [LOCAL     ] SSB: Deleted derivative data file.
[2025-10-24T21:16:05.110922] [INFO ] [MAIN      ] Update Progress: 1991/2366 symbols completed. SSB took 28.3s. Estimated remaining: 48m 13s. Rate: 7.8 symbols/min
[2025-10-24T21:16:05.280677] [INFO ] [MAIN      ] SST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:16:05.292084] [DEBUG] [LOCAL     ] SST: Loaded 11417 existing records from primary storage.
[2025-10-24T21:16:05.292324] [INFO ] [MAIN      ] SST: Loaded 11417 existing records.
[2025-10-24T21:16:05.479021] [WARN ] [MAIN      ] SST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:16:05.479263] [INFO ] [MAIN      ] SST: Wiping existing primary data before full refresh.
[2025-10-24T21:16:05.479315] [INFO ] [LOCAL     ] SST: Starting deletion of primary data.
[2025-10-24T21:16:05.479487] [DEBUG] [LOCAL     ] SST: Deleted primary data file.
[2025-10-24T21:16:05.479542] [INFO ] [MAIN      ] SST: Starting full primary refresh.
[2025-10-24T21:16:05.676557] [INFO ] [REMOTE    ] SRV: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:16:05.760825] [INFO ] [REMOTE    ] SRV: Full fetch complete (11180 records).
[2025-10-24T21:16:05.752939] [INFO ] [REMOTE    ] SSL: Fetching primary data for 2025-04.
[2025-10-24T21:16:05.761277] [DEBUG] [VALIDATOR ] SRV: Validating primary data.
[2025-10-24T21:16:05.774054] [FATAL] [VALIDATOR ] SRV: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:16:05.774182] [FATAL] [MAIN      ] SRV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:16:05.780733] [WARN ] [MAIN      ] SRV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:16:05.781009] [INFO ] [LOCAL     ] SRV: Starting deletion of primary data.
[2025-10-24T21:16:05.803915] [DEBUG] [LOCAL     ] SRV: No primary data file found to delete.
[2025-10-24T21:16:05.804068] [INFO ] [LOCAL     ] SRV: Starting deletion of derivative data.
[2025-10-24T21:16:05.804492] [DEBUG] [LOCAL     ] SRV: Deleted derivative data file.
[2025-10-24T21:16:05.815934] [INFO ] [MAIN      ] Update Progress: 1992/2366 symbols completed. SRV took 36.6s. Estimated remaining: 48m 4s. Rate: 7.8 symbols/min
[2025-10-24T21:16:05.985970] [INFO ] [REMOTE    ] SST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:16:06.056623] [INFO ] [MAIN      ] SSTK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:16:06.083685] [DEBUG] [LOCAL     ] SSTK: Loaded 25424 existing records from primary storage.
[2025-10-24T21:16:06.083984] [INFO ] [MAIN      ] SSTK: Loaded 25424 existing records.
[2025-10-24T21:16:06.257506] [WARN ] [MAIN      ] SSTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:16:06.257787] [INFO ] [MAIN      ] SSTK: Wiping existing primary data before full refresh.
[2025-10-24T21:16:06.257849] [INFO ] [LOCAL     ] SSTK: Starting deletion of primary data.
[2025-10-24T21:16:06.258101] [DEBUG] [LOCAL     ] SSTK: Deleted primary data file.
[2025-10-24T21:16:06.258139] [INFO ] [MAIN      ] SSTK: Starting full primary refresh.
[2025-10-24T21:16:06.552803] [INFO ] [REMOTE    ] SST: Fetching primary data for 2025-01.
[2025-10-24T21:16:06.607121] [INFO ] [REMOTE    ] SSTK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:16:07.065840] [INFO ] [REMOTE    ] SSL: Incremental fetch complete for 2025-04 (1.31 seconds).
[2025-10-24T21:16:07.347707] [INFO ] [REMOTE    ] SSTK: Fetching primary data for 2025-01.
[2025-10-24T21:16:07.445350] [INFO ] [REMOTE    ] SST: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T21:16:08.147622] [INFO ] [REMOTE    ] SST: Fetching primary data for 2025-02.
[2025-10-24T21:16:08.148697] [INFO ] [REMOTE    ] SSTK: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T21:16:08.952305] [INFO ] [REMOTE    ] SSL: Fetching primary data for 2025-05.
[2025-10-24T21:16:08.954264] [INFO ] [REMOTE    ] SST: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T21:16:09.707160] [INFO ] [REMOTE    ] SSL: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T21:16:09.747600] [INFO ] [REMOTE    ] SSL: Fetching primary data for 2025-06.
[2025-10-24T21:16:10.547614] [INFO ] [REMOTE    ] SST: Fetching primary data for 2025-03.
[2025-10-24T21:16:10.786475] [INFO ] [REMOTE    ] SSL: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T21:16:11.347695] [INFO ] [REMOTE    ] SSTK: Fetching primary data for 2025-02.
[2025-10-24T21:16:11.475200] [INFO ] [REMOTE    ] SST: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T21:16:12.046637] [INFO ] [REMOTE    ] SSTK: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T21:16:12.147627] [INFO ] [REMOTE    ] SSTK: Fetching primary data for 2025-03.
[2025-10-24T21:16:12.712020] [INFO ] [REMOTE    ] SSTK: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T21:16:12.947669] [INFO ] [REMOTE    ] SSD: Fetching primary data for 2025-07.
[2025-10-24T21:16:13.621796] [INFO ] [REMOTE    ] SSD: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T21:16:13.747598] [INFO ] [REMOTE    ] SSD: Fetching primary data for 2025-08.
[2025-10-24T21:16:14.547693] [INFO ] [REMOTE    ] SST: Fetching primary data for 2025-04.
[2025-10-24T21:16:14.778757] [INFO ] [REMOTE    ] SSD: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T21:16:15.031150] [INFO ] [REMOTE    ] SST: Incremental fetch complete for 2025-04 (0.48 seconds).
[2025-10-24T21:16:15.347636] [INFO ] [REMOTE    ] SST: Fetching primary data for 2025-05.
[2025-10-24T21:16:16.073220] [INFO ] [REMOTE    ] SST: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T21:16:16.147734] [INFO ] [REMOTE    ] SSL: Fetching primary data for 2025-07.
[2025-10-24T21:16:16.896487] [INFO ] [REMOTE    ] SSL: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T21:16:16.947677] [INFO ] [REMOTE    ] SSD: Fetching primary data for 2025-09.
[2025-10-24T21:16:17.747724] [INFO ] [REMOTE    ] SSTK: Fetching primary data for 2025-04.
[2025-10-24T21:16:17.868927] [INFO ] [REMOTE    ] SSD: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T21:16:18.445294] [INFO ] [REMOTE    ] SSTK: Incremental fetch complete for 2025-04 (0.70 seconds).
[2025-10-24T21:16:18.547604] [INFO ] [REMOTE    ] SSTK: Fetching primary data for 2025-05.
[2025-10-24T21:16:19.189996] [INFO ] [REMOTE    ] SSTK: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T21:16:19.347716] [INFO ] [REMOTE    ] SSD: Fetching primary data for 2025-10.
[2025-10-24T21:16:20.147618] [INFO ] [REMOTE    ] SST: Fetching primary data for 2025-06.
[2025-10-24T21:16:20.171341] [INFO ] [REMOTE    ] SSD: Incremental fetch complete for 2025-10 (0.82 seconds).
[2025-10-24T21:16:20.175405] [INFO ] [REMOTE    ] SSD: Full fetch complete (32364 records).
[2025-10-24T21:16:20.175491] [DEBUG] [VALIDATOR ] SSD: Validating primary data.
[2025-10-24T21:16:20.175995] [FATAL] [VALIDATOR ] SSD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:16:20.176075] [FATAL] [MAIN      ] SSD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:16:20.176117] [WARN ] [MAIN      ] SSD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:16:20.176181] [INFO ] [LOCAL     ] SSD: Starting deletion of primary data.
[2025-10-24T21:16:20.176241] [DEBUG] [LOCAL     ] SSD: No primary data file found to delete.
[2025-10-24T21:16:20.176275] [INFO ] [LOCAL     ] SSD: Starting deletion of derivative data.
[2025-10-24T21:16:20.176439] [DEBUG] [LOCAL     ] SSD: Deleted derivative data file.
[2025-10-24T21:16:20.176523] [INFO ] [MAIN      ] Update Progress: 1993/2366 symbols completed. SSD took 38.0s. Estimated remaining: 47m 58s. Rate: 7.8 symbols/min
[2025-10-24T21:16:20.352850] [INFO ] [MAIN      ] ST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:16:20.397568] [DEBUG] [LOCAL     ] ST: Loaded 50012 existing records from primary storage.
[2025-10-24T21:16:20.397902] [INFO ] [MAIN      ] ST: Loaded 50012 existing records.
[2025-10-24T21:16:20.585976] [WARN ] [MAIN      ] ST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:16:20.586309] [INFO ] [MAIN      ] ST: Wiping existing primary data before full refresh.
[2025-10-24T21:16:20.586361] [INFO ] [LOCAL     ] ST: Starting deletion of primary data.
[2025-10-24T21:16:20.586797] [DEBUG] [LOCAL     ] ST: Deleted primary data file.
[2025-10-24T21:16:20.586853] [INFO ] [MAIN      ] ST: Starting full primary refresh.
[2025-10-24T21:16:20.888569] [INFO ] [REMOTE    ] SST: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T21:16:20.950554] [INFO ] [REMOTE    ] SSL: Fetching primary data for 2025-08.
[2025-10-24T21:16:20.978195] [INFO ] [REMOTE    ] ST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:16:21.747632] [INFO ] [REMOTE    ] SST: Fetching primary data for 2025-07.
[2025-10-24T21:16:21.913930] [INFO ] [REMOTE    ] SSL: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T21:16:22.243063] [INFO ] [REMOTE    ] SST: Incremental fetch complete for 2025-07 (0.50 seconds).
[2025-10-24T21:16:22.547684] [INFO ] [REMOTE    ] SST: Fetching primary data for 2025-08.
[2025-10-24T21:16:23.298964] [INFO ] [REMOTE    ] SST: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T21:16:23.347688] [INFO ] [REMOTE    ] SSTK: Fetching primary data for 2025-06.
[2025-10-24T21:16:23.967187] [INFO ] [REMOTE    ] SSTK: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T21:16:24.147679] [INFO ] [REMOTE    ] ST: Fetching primary data for 2025-01.
[2025-10-24T21:16:24.892324] [INFO ] [REMOTE    ] ST: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T21:16:24.947710] [INFO ] [REMOTE    ] SST: Fetching primary data for 2025-09.
[2025-10-24T21:16:25.750613] [INFO ] [REMOTE    ] SSL: Fetching primary data for 2025-09.
[2025-10-24T21:16:25.751487] [INFO ] [REMOTE    ] SST: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T21:16:26.510736] [INFO ] [REMOTE    ] SSL: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T21:16:26.547620] [INFO ] [REMOTE    ] SSL: Fetching primary data for 2025-10.
[2025-10-24T21:16:27.347702] [INFO ] [REMOTE    ] ST: Fetching primary data for 2025-02.
[2025-10-24T21:16:27.472007] [INFO ] [REMOTE    ] SSL: Incremental fetch complete for 2025-10 (0.92 seconds).
[2025-10-24T21:16:27.480044] [INFO ] [REMOTE    ] SSL: Full fetch complete (59803 records).
[2025-10-24T21:16:27.480217] [DEBUG] [VALIDATOR ] SSL: Validating primary data.
[2025-10-24T21:16:27.481160] [FATAL] [VALIDATOR ] SSL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:16:27.481252] [FATAL] [MAIN      ] SSL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:16:27.481296] [WARN ] [MAIN      ] SSL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:16:27.481339] [INFO ] [LOCAL     ] SSL: Starting deletion of primary data.
[2025-10-24T21:16:27.481402] [DEBUG] [LOCAL     ] SSL: No primary data file found to delete.
[2025-10-24T21:16:27.481440] [INFO ] [LOCAL     ] SSL: Starting deletion of derivative data.
[2025-10-24T21:16:27.481724] [DEBUG] [LOCAL     ] SSL: Deleted derivative data file.
[2025-10-24T21:16:27.481825] [INFO ] [MAIN      ] Update Progress: 1994/2366 symbols completed. SSL took 29.1s. Estimated remaining: 47m 50s. Rate: 7.8 symbols/min
[2025-10-24T21:16:27.668874] [INFO ] [MAIN      ] STAG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:16:27.726525] [DEBUG] [LOCAL     ] STAG: Loaded 50429 existing records from primary storage.
[2025-10-24T21:16:27.727016] [INFO ] [MAIN      ] STAG: Loaded 50429 existing records.
[2025-10-24T21:16:27.912279] [WARN ] [MAIN      ] STAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:16:27.913209] [INFO ] [MAIN      ] STAG: Wiping existing primary data before full refresh.
[2025-10-24T21:16:27.913342] [INFO ] [LOCAL     ] STAG: Starting deletion of primary data.
[2025-10-24T21:16:27.914152] [DEBUG] [LOCAL     ] STAG: Deleted primary data file.
[2025-10-24T21:16:27.914212] [INFO ] [MAIN      ] STAG: Starting full primary refresh.
[2025-10-24T21:16:28.152863] [INFO ] [REMOTE    ] SSTK: Fetching primary data for 2025-07.
[2025-10-24T21:16:28.307411] [INFO ] [REMOTE    ] STAG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:16:28.334109] [INFO ] [REMOTE    ] ST: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T21:16:28.947633] [INFO ] [REMOTE    ] STAG: Fetching primary data for 2025-01.
[2025-10-24T21:16:29.142123] [INFO ] [REMOTE    ] SSTK: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T21:16:29.747617] [INFO ] [REMOTE    ] SST: Fetching primary data for 2025-10.
[2025-10-24T21:16:30.072256] [INFO ] [REMOTE    ] STAG: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T21:16:30.072448] [INFO ] [REMOTE    ] SST: Incremental fetch complete for 2025-10 (0.32 seconds).
[2025-10-24T21:16:30.084451] [INFO ] [REMOTE    ] SST: Full fetch complete (17697 records).
[2025-10-24T21:16:30.084536] [DEBUG] [VALIDATOR ] SST: Validating primary data.
[2025-10-24T21:16:30.084990] [FATAL] [VALIDATOR ] SST: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:16:30.085093] [FATAL] [MAIN      ] SST: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:16:30.085166] [WARN ] [MAIN      ] SST: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:16:30.085249] [INFO ] [LOCAL     ] SST: Starting deletion of primary data.
[2025-10-24T21:16:30.085324] [DEBUG] [LOCAL     ] SST: No primary data file found to delete.
[2025-10-24T21:16:30.085373] [INFO ] [LOCAL     ] SST: Starting deletion of derivative data.
[2025-10-24T21:16:30.085594] [DEBUG] [LOCAL     ] SST: Deleted derivative data file.
[2025-10-24T21:16:30.085736] [INFO ] [MAIN      ] Update Progress: 1995/2366 symbols completed. SST took 25.0s. Estimated remaining: 47m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:16:30.266662] [INFO ] [MAIN      ] STC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:16:30.284058] [DEBUG] [LOCAL     ] STC: Loaded 17598 existing records from primary storage.
[2025-10-24T21:16:30.284288] [INFO ] [MAIN      ] STC: Loaded 17598 existing records.
[2025-10-24T21:16:30.469131] [WARN ] [MAIN      ] STC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:16:30.469416] [INFO ] [MAIN      ] STC: Wiping existing primary data before full refresh.
[2025-10-24T21:16:30.469480] [INFO ] [LOCAL     ] STC: Starting deletion of primary data.
[2025-10-24T21:16:30.469759] [DEBUG] [LOCAL     ] STC: Deleted primary data file.
[2025-10-24T21:16:30.469815] [INFO ] [MAIN      ] STC: Starting full primary refresh.
[2025-10-24T21:16:30.552750] [INFO ] [REMOTE    ] STAG: Fetching primary data for 2025-02.
[2025-10-24T21:16:30.863084] [INFO ] [REMOTE    ] STC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:16:31.347622] [INFO ] [REMOTE    ] SSTK: Fetching primary data for 2025-08.
[2025-10-24T21:16:31.446121] [INFO ] [REMOTE    ] STAG: Incremental fetch complete for 2025-02 (0.89 seconds).
[2025-10-24T21:16:32.017729] [INFO ] [REMOTE    ] SSTK: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T21:16:32.147618] [INFO ] [REMOTE    ] SSTK: Fetching primary data for 2025-09.
[2025-10-24T21:16:32.947697] [INFO ] [REMOTE    ] STAG: Fetching primary data for 2025-03.
[2025-10-24T21:16:33.062091] [INFO ] [REMOTE    ] SSTK: Incremental fetch complete for 2025-09 (0.91 seconds).
[2025-10-24T21:16:33.747674] [INFO ] [REMOTE    ] SSTK: Fetching primary data for 2025-10.
[2025-10-24T21:16:34.134994] [INFO ] [REMOTE    ] STAG: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T21:16:34.547633] [INFO ] [REMOTE    ] ST: Fetching primary data for 2025-03.
[2025-10-24T21:16:34.634891] [INFO ] [REMOTE    ] SSTK: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T21:16:34.640107] [INFO ] [REMOTE    ] SSTK: Full fetch complete (41224 records).
[2025-10-24T21:16:34.640223] [DEBUG] [VALIDATOR ] SSTK: Validating primary data.
[2025-10-24T21:16:34.640818] [FATAL] [VALIDATOR ] SSTK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:16:34.640905] [FATAL] [MAIN      ] SSTK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:16:34.640947] [WARN ] [MAIN      ] SSTK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:16:34.640985] [INFO ] [LOCAL     ] SSTK: Starting deletion of primary data.
[2025-10-24T21:16:34.641039] [DEBUG] [LOCAL     ] SSTK: No primary data file found to delete.
[2025-10-24T21:16:34.641073] [INFO ] [LOCAL     ] SSTK: Starting deletion of derivative data.
[2025-10-24T21:16:34.641278] [DEBUG] [LOCAL     ] SSTK: Deleted derivative data file.
[2025-10-24T21:16:34.641368] [INFO ] [MAIN      ] Update Progress: 1996/2366 symbols completed. SSTK took 28.8s. Estimated remaining: 47m 33s. Rate: 7.8 symbols/min
[2025-10-24T21:16:34.814201] [INFO ] [MAIN      ] STE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:16:34.851358] [DEBUG] [LOCAL     ] STE: Loaded 35341 existing records from primary storage.
[2025-10-24T21:16:34.851697] [INFO ] [MAIN      ] STE: Loaded 35341 existing records.
[2025-10-24T21:16:35.033720] [WARN ] [MAIN      ] STE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:16:35.033913] [INFO ] [MAIN      ] STE: Wiping existing primary data before full refresh.
[2025-10-24T21:16:35.033958] [INFO ] [LOCAL     ] STE: Starting deletion of primary data.
[2025-10-24T21:16:35.034136] [DEBUG] [LOCAL     ] STE: Deleted primary data file.
[2025-10-24T21:16:35.034173] [INFO ] [MAIN      ] STE: Starting full primary refresh.
[2025-10-24T21:16:35.370829] [INFO ] [REMOTE    ] STAG: Fetching primary data for 2025-04.
[2025-10-24T21:16:35.402220] [INFO ] [REMOTE    ] STE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:16:35.434543] [INFO ] [REMOTE    ] ST: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T21:16:36.147683] [INFO ] [REMOTE    ] STE: Fetching primary data for 2025-01.
[2025-10-24T21:16:36.517331] [INFO ] [REMOTE    ] STAG: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T21:16:36.852736] [INFO ] [REMOTE    ] STE: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T21:16:36.947700] [INFO ] [REMOTE    ] STE: Fetching primary data for 2025-02.
[2025-10-24T21:16:37.747692] [INFO ] [REMOTE    ] ST: Fetching primary data for 2025-04.
[2025-10-24T21:16:38.151205] [INFO ] [REMOTE    ] STE: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T21:16:38.468578] [INFO ] [REMOTE    ] ST: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T21:16:38.547675] [INFO ] [REMOTE    ] ST: Fetching primary data for 2025-05.
[2025-10-24T21:16:39.347720] [INFO ] [REMOTE    ] STC: Fetching primary data for 2025-01.
[2025-10-24T21:16:39.523343] [INFO ] [REMOTE    ] ST: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T21:16:39.987548] [INFO ] [REMOTE    ] STC: Incremental fetch complete for 2025-01 (0.64 seconds).
[2025-10-24T21:16:40.147661] [INFO ] [REMOTE    ] STE: Fetching primary data for 2025-03.
[2025-10-24T21:16:40.947685] [INFO ] [REMOTE    ] ST: Fetching primary data for 2025-06.
[2025-10-24T21:16:41.393047] [INFO ] [REMOTE    ] STE: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T21:16:41.629610] [INFO ] [REMOTE    ] ST: Incremental fetch complete for 2025-06 (0.68 seconds).
[2025-10-24T21:16:41.747660] [INFO ] [REMOTE    ] ST: Fetching primary data for 2025-07.
[2025-10-24T21:16:42.547638] [INFO ] [REMOTE    ] STAG: Fetching primary data for 2025-05.
[2025-10-24T21:16:42.919762] [INFO ] [REMOTE    ] ST: Incremental fetch complete for 2025-07 (1.17 seconds).
[2025-10-24T21:16:43.088468] [INFO ] [REMOTE    ] STAG: Incremental fetch complete for 2025-05 (0.54 seconds).
[2025-10-24T21:16:43.347733] [INFO ] [REMOTE    ] ST: Fetching primary data for 2025-08.
[2025-10-24T21:16:44.147662] [INFO ] [REMOTE    ] STAG: Fetching primary data for 2025-06.
[2025-10-24T21:16:44.723881] [INFO ] [REMOTE    ] ST: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T21:16:44.947634] [INFO ] [REMOTE    ] STE: Fetching primary data for 2025-04.
[2025-10-24T21:16:45.345738] [INFO ] [REMOTE    ] STAG: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T21:16:45.747669] [INFO ] [REMOTE    ] STC: Fetching primary data for 2025-02.
[2025-10-24T21:16:45.797807] [INFO ] [REMOTE    ] STE: Incremental fetch complete for 2025-04 (0.85 seconds).
[2025-10-24T21:16:46.324690] [INFO ] [REMOTE    ] STC: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T21:16:46.547692] [INFO ] [REMOTE    ] STE: Fetching primary data for 2025-05.
[2025-10-24T21:16:47.347629] [INFO ] [REMOTE    ] STAG: Fetching primary data for 2025-07.
[2025-10-24T21:16:47.547964] [INFO ] [REMOTE    ] STE: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T21:16:48.147693] [INFO ] [REMOTE    ] STC: Fetching primary data for 2025-03.
[2025-10-24T21:16:48.413470] [INFO ] [REMOTE    ] STAG: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T21:16:48.741828] [INFO ] [REMOTE    ] STC: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T21:16:48.947621] [INFO ] [REMOTE    ] STAG: Fetching primary data for 2025-08.
[2025-10-24T21:16:49.747663] [INFO ] [REMOTE    ] STE: Fetching primary data for 2025-06.
[2025-10-24T21:16:49.917583] [INFO ] [REMOTE    ] STAG: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T21:16:50.547699] [INFO ] [REMOTE    ] ST: Fetching primary data for 2025-09.
[2025-10-24T21:16:50.665304] [INFO ] [REMOTE    ] STE: Incremental fetch complete for 2025-06 (0.92 seconds).
[2025-10-24T21:16:51.347689] [INFO ] [REMOTE    ] STC: Fetching primary data for 2025-04.
[2025-10-24T21:16:51.528860] [INFO ] [REMOTE    ] ST: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T21:16:52.135167] [INFO ] [REMOTE    ] STC: Incremental fetch complete for 2025-04 (0.79 seconds).
[2025-10-24T21:16:52.147636] [INFO ] [REMOTE    ] STC: Fetching primary data for 2025-05.
[2025-10-24T21:16:52.947794] [INFO ] [REMOTE    ] ST: Fetching primary data for 2025-10.
[2025-10-24T21:16:53.034913] [INFO ] [REMOTE    ] STC: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T21:16:53.378707] [INFO ] [REMOTE    ] ST: Incremental fetch complete for 2025-10 (0.43 seconds).
[2025-10-24T21:16:53.388066] [INFO ] [REMOTE    ] ST: Full fetch complete (71754 records).
[2025-10-24T21:16:53.388265] [DEBUG] [VALIDATOR ] ST: Validating primary data.
[2025-10-24T21:16:53.389260] [FATAL] [VALIDATOR ] ST: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:16:53.389355] [FATAL] [MAIN      ] ST: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:16:53.389399] [WARN ] [MAIN      ] ST: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:16:53.389444] [INFO ] [LOCAL     ] ST: Starting deletion of primary data.
[2025-10-24T21:16:53.389514] [DEBUG] [LOCAL     ] ST: No primary data file found to delete.
[2025-10-24T21:16:53.389559] [INFO ] [LOCAL     ] ST: Starting deletion of derivative data.
[2025-10-24T21:16:53.389848] [DEBUG] [LOCAL     ] ST: Deleted derivative data file.
[2025-10-24T21:16:53.390617] [INFO ] [MAIN      ] Update Progress: 1997/2366 symbols completed. ST took 33.2s. Estimated remaining: 47m 28s. Rate: 7.8 symbols/min
[2025-10-24T21:16:53.747731] [INFO ] [REMOTE    ] STE: Fetching primary data for 2025-07.
[2025-10-24T21:16:54.547711] [INFO ] [REMOTE    ] STAG: Fetching primary data for 2025-09.
[2025-10-24T21:16:54.816117] [INFO ] [REMOTE    ] STE: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T21:16:55.347631] [INFO ] [REMOTE    ] STC: Fetching primary data for 2025-06.
[2025-10-24T21:16:55.413255] [INFO ] [REMOTE    ] STAG: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T21:16:55.997354] [INFO ] [REMOTE    ] STC: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T21:16:56.147733] [INFO ] [REMOTE    ] STC: Fetching primary data for 2025-07.
[2025-10-24T21:16:56.947721] [INFO ] [REMOTE    ] STE: Fetching primary data for 2025-08.
[2025-10-24T21:16:57.033124] [INFO ] [REMOTE    ] STC: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T21:16:57.715148] [INFO ] [REMOTE    ] STE: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T21:16:57.747758] [INFO ] [REMOTE    ] STE: Fetching primary data for 2025-09.
[2025-10-24T21:16:58.547729] [INFO ] [REMOTE    ] STC: Fetching primary data for 2025-08.
[2025-10-24T21:16:58.694099] [INFO ] [REMOTE    ] STE: Incremental fetch complete for 2025-09 (0.95 seconds).
[2025-10-24T21:16:59.303328] [INFO ] [REMOTE    ] STC: Incremental fetch complete for 2025-08 (0.76 seconds).
[2025-10-24T21:16:59.347615] [INFO ] [REMOTE    ] STE: Fetching primary data for 2025-10.
[2025-10-24T21:17:00.147637] [INFO ] [REMOTE    ] STC: Fetching primary data for 2025-09.
[2025-10-24T21:17:00.193122] [INFO ] [REMOTE    ] STE: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T21:17:00.199244] [INFO ] [REMOTE    ] STE: Full fetch complete (50611 records).
[2025-10-24T21:17:00.199336] [DEBUG] [VALIDATOR ] STE: Validating primary data.
[2025-10-24T21:17:00.199975] [FATAL] [VALIDATOR ] STE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:17:00.200063] [FATAL] [MAIN      ] STE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:17:00.200106] [WARN ] [MAIN      ] STE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:17:00.200170] [INFO ] [LOCAL     ] STE: Starting deletion of primary data.
[2025-10-24T21:17:00.200232] [DEBUG] [LOCAL     ] STE: No primary data file found to delete.
[2025-10-24T21:17:00.200269] [INFO ] [LOCAL     ] STE: Starting deletion of derivative data.
[2025-10-24T21:17:00.200442] [DEBUG] [LOCAL     ] STE: Deleted derivative data file.
[2025-10-24T21:17:00.201216] [INFO ] [MAIN      ] Update Progress: 1998/2366 symbols completed. STE took 25.6s. Estimated remaining: 47m 20s. Rate: 7.8 symbols/min
[2025-10-24T21:17:00.947622] [INFO ] [REMOTE    ] STAG: Fetching primary data for 2025-10.
[2025-10-24T21:17:01.229738] [INFO ] [REMOTE    ] STC: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T21:17:01.747745] [INFO ] [REMOTE    ] STC: Fetching primary data for 2025-10.
[2025-10-24T21:17:01.884130] [INFO ] [REMOTE    ] STAG: Incremental fetch complete for 2025-10 (0.94 seconds).
[2025-10-24T21:17:01.893319] [INFO ] [REMOTE    ] STAG: Full fetch complete (72204 records).
[2025-10-24T21:17:01.893445] [DEBUG] [VALIDATOR ] STAG: Validating primary data.
[2025-10-24T21:17:01.895420] [FATAL] [VALIDATOR ] STAG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:17:01.895514] [FATAL] [MAIN      ] STAG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:17:01.895576] [WARN ] [MAIN      ] STAG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:17:01.895684] [INFO ] [LOCAL     ] STAG: Starting deletion of primary data.
[2025-10-24T21:17:01.895773] [DEBUG] [LOCAL     ] STAG: No primary data file found to delete.
[2025-10-24T21:17:01.895822] [INFO ] [LOCAL     ] STAG: Starting deletion of derivative data.
[2025-10-24T21:17:01.896020] [DEBUG] [LOCAL     ] STAG: Deleted derivative data file.
[2025-10-24T21:17:01.896838] [INFO ] [MAIN      ] Update Progress: 1999/2366 symbols completed. STAG took 34.4s. Estimated remaining: 47m 11s. Rate: 7.8 symbols/min
[2025-10-24T21:17:01.939846] [INFO ] [REMOTE    ] STC: Incremental fetch complete for 2025-10 (0.19 seconds).
[2025-10-24T21:17:01.943010] [INFO ] [REMOTE    ] STC: Full fetch complete (25499 records).
[2025-10-24T21:17:01.943081] [DEBUG] [VALIDATOR ] STC: Validating primary data.
[2025-10-24T21:17:01.943492] [FATAL] [VALIDATOR ] STC: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:17:01.943570] [FATAL] [MAIN      ] STC: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:17:01.943612] [WARN ] [MAIN      ] STC: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:17:01.943696] [INFO ] [LOCAL     ] STC: Starting deletion of primary data.
[2025-10-24T21:17:01.943760] [DEBUG] [LOCAL     ] STC: No primary data file found to delete.
[2025-10-24T21:17:01.943794] [INFO ] [LOCAL     ] STC: Starting deletion of derivative data.
[2025-10-24T21:17:01.943939] [DEBUG] [LOCAL     ] STC: Deleted derivative data file.
[2025-10-24T21:17:01.944003] [INFO ] [MAIN      ] Update Progress: 2000/2366 symbols completed. STC took 31.9s. Estimated remaining: 47m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:17:02.555408] [INFO ] [MAIN      ] STEW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:17:02.557581] [INFO ] [MAIN      ] STEM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:17:02.657053] [INFO ] [MAIN      ] STEL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:17:02.656116] [INFO ] [MAIN      ] STG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:17:02.657821] [DEBUG] [LOCAL     ] STG: No existing data file found in primary storage.
[2025-10-24T21:17:02.657932] [WARN ] [MAIN      ] STG: No existing data found, performing full refresh instead.
[2025-10-24T21:17:02.658196] [INFO ] [MAIN      ] STG: Wiping existing primary data before full refresh.
[2025-10-24T21:17:02.658327] [INFO ] [LOCAL     ] STG: Starting deletion of primary data.
[2025-10-24T21:17:02.658486] [DEBUG] [LOCAL     ] STG: No primary data file found to delete.
[2025-10-24T21:17:02.658733] [INFO ] [MAIN      ] STG: Starting full primary refresh.
[2025-10-24T21:17:02.813845] [DEBUG] [LOCAL     ] STEW: Loaded 15156 existing records from primary storage.
[2025-10-24T21:17:02.814527] [DEBUG] [LOCAL     ] STEL: Loaded 22468 existing records from primary storage.
[2025-10-24T21:17:02.825959] [INFO ] [MAIN      ] STEW: Loaded 15156 existing records.
[2025-10-24T21:17:02.820602] [INFO ] [MAIN      ] STEL: Loaded 22468 existing records.
[2025-10-24T21:17:03.137948] [DEBUG] [LOCAL     ] STEM: Loaded 38586 existing records from primary storage.
[2025-10-24T21:17:03.261789] [INFO ] [MAIN      ] STEM: Loaded 38586 existing records.
[2025-10-24T21:17:03.373787] [WARN ] [MAIN      ] STEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:17:03.420604] [WARN ] [MAIN      ] STEW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:17:03.475342] [INFO ] [MAIN      ] STEW: Wiping existing primary data before full refresh.
[2025-10-24T21:17:03.475453] [INFO ] [MAIN      ] STEL: Wiping existing primary data before full refresh.
[2025-10-24T21:17:03.526486] [INFO ] [LOCAL     ] STEL: Starting deletion of primary data.
[2025-10-24T21:17:03.511235] [INFO ] [LOCAL     ] STEW: Starting deletion of primary data.
[2025-10-24T21:17:03.571216] [INFO ] [REMOTE    ] STG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:17:03.581723] [DEBUG] [LOCAL     ] STEL: Deleted primary data file.
[2025-10-24T21:17:03.586981] [DEBUG] [LOCAL     ] STEW: Deleted primary data file.
[2025-10-24T21:17:03.592419] [INFO ] [MAIN      ] STEL: Starting full primary refresh.
[2025-10-24T21:17:03.592365] [INFO ] [REMOTE    ] STG: Fetching primary data for 2025-01.
[2025-10-24T21:17:03.630991] [INFO ] [MAIN      ] STEW: Starting full primary refresh.
[2025-10-24T21:17:03.739014] [WARN ] [MAIN      ] STEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:17:03.791936] [INFO ] [MAIN      ] STEM: Wiping existing primary data before full refresh.
[2025-10-24T21:17:03.792510] [INFO ] [LOCAL     ] STEM: Starting deletion of primary data.
[2025-10-24T21:17:03.844332] [DEBUG] [LOCAL     ] STEM: Deleted primary data file.
[2025-10-24T21:17:03.854717] [INFO ] [MAIN      ] STEM: Starting full primary refresh.
[2025-10-24T21:17:04.471090] [INFO ] [REMOTE    ] STG: Incremental fetch complete for 2025-01 (0.88 seconds).
[2025-10-24T21:17:04.531303] [INFO ] [REMOTE    ] STG: Fetching primary data for 2025-02.
[2025-10-24T21:17:04.721967] [INFO ] [REMOTE    ] STEW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:17:04.722562] [INFO ] [REMOTE    ] STEW: Fetching primary data for 2025-01.
[2025-10-24T21:17:04.726030] [INFO ] [REMOTE    ] STEL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:17:04.806068] [INFO ] [REMOTE    ] STEM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:17:04.933574] [INFO ] [REMOTE    ] STG: Incremental fetch complete for 2025-02 (0.40 seconds).
[2025-10-24T21:17:04.947599] [INFO ] [REMOTE    ] STG: Fetching primary data for 2025-03.
[2025-10-24T21:17:05.419151] [INFO ] [REMOTE    ] STEW: Incremental fetch complete for 2025-01 (0.70 seconds).
[2025-10-24T21:17:05.460292] [INFO ] [REMOTE    ] STG: Incremental fetch complete for 2025-03 (0.51 seconds).
[2025-10-24T21:17:05.747715] [INFO ] [REMOTE    ] STG: Fetching primary data for 2025-04.
[2025-10-24T21:17:05.966561] [INFO ] [REMOTE    ] STG: Incremental fetch complete for 2025-04 (0.22 seconds).
[2025-10-24T21:17:06.547704] [INFO ] [REMOTE    ] STG: Fetching primary data for 2025-05.
[2025-10-24T21:17:06.767832] [INFO ] [REMOTE    ] STG: Incremental fetch complete for 2025-05 (0.22 seconds).
[2025-10-24T21:17:07.347696] [INFO ] [REMOTE    ] STEL: Fetching primary data for 2025-01.
[2025-10-24T21:17:08.147726] [INFO ] [REMOTE    ] STEM: Fetching primary data for 2025-01.
[2025-10-24T21:17:08.198411] [INFO ] [REMOTE    ] STEL: Incremental fetch complete for 2025-01 (0.85 seconds).
[2025-10-24T21:17:08.947677] [INFO ] [REMOTE    ] STG: Fetching primary data for 2025-06.
[2025-10-24T21:17:09.300236] [INFO ] [REMOTE    ] STG: Incremental fetch complete for 2025-06 (0.35 seconds).
[2025-10-24T21:17:09.333183] [INFO ] [REMOTE    ] STEM: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T21:17:09.747724] [INFO ] [REMOTE    ] STEM: Fetching primary data for 2025-02.
[2025-10-24T21:17:10.547692] [INFO ] [REMOTE    ] STEW: Fetching primary data for 2025-02.
[2025-10-24T21:17:10.731545] [INFO ] [REMOTE    ] STEM: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T21:17:11.347698] [INFO ] [REMOTE    ] STG: Fetching primary data for 2025-07.
[2025-10-24T21:17:11.539929] [INFO ] [REMOTE    ] STEW: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T21:17:11.615236] [INFO ] [REMOTE    ] STG: Incremental fetch complete for 2025-07 (0.27 seconds).
[2025-10-24T21:17:12.147700] [INFO ] [REMOTE    ] STEW: Fetching primary data for 2025-03.
[2025-10-24T21:17:12.761113] [INFO ] [REMOTE    ] STEW: Incremental fetch complete for 2025-03 (0.61 seconds).
[2025-10-24T21:17:12.947696] [INFO ] [REMOTE    ] STEM: Fetching primary data for 2025-03.
[2025-10-24T21:17:13.752726] [INFO ] [REMOTE    ] STG: Fetching primary data for 2025-08.
[2025-10-24T21:17:13.766755] [INFO ] [REMOTE    ] STEM: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T21:17:14.073758] [INFO ] [REMOTE    ] STG: Incremental fetch complete for 2025-08 (0.32 seconds).
[2025-10-24T21:17:14.547703] [INFO ] [REMOTE    ] STEW: Fetching primary data for 2025-04.
[2025-10-24T21:17:15.146968] [INFO ] [REMOTE    ] STEW: Incremental fetch complete for 2025-04 (0.60 seconds).
[2025-10-24T21:17:15.347714] [INFO ] [REMOTE    ] STEL: Fetching primary data for 2025-02.
[2025-10-24T21:17:15.965159] [INFO ] [REMOTE    ] STEL: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T21:17:16.147694] [INFO ] [REMOTE    ] STEL: Fetching primary data for 2025-03.
[2025-10-24T21:17:16.806771] [INFO ] [REMOTE    ] STEL: Incremental fetch complete for 2025-03 (0.66 seconds).
[2025-10-24T21:17:16.947719] [INFO ] [REMOTE    ] STEL: Fetching primary data for 2025-04.
[2025-10-24T21:17:17.625096] [INFO ] [REMOTE    ] STEL: Incremental fetch complete for 2025-04 (0.68 seconds).
[2025-10-24T21:17:17.747703] [INFO ] [REMOTE    ] STEL: Fetching primary data for 2025-05.
[2025-10-24T21:17:18.547721] [INFO ] [REMOTE    ] STG: Fetching primary data for 2025-09.
[2025-10-24T21:17:18.670322] [INFO ] [REMOTE    ] STEL: Incremental fetch complete for 2025-05 (0.92 seconds).
[2025-10-24T21:17:19.064545] [INFO ] [REMOTE    ] STG: Incremental fetch complete for 2025-09 (0.52 seconds).
[2025-10-24T21:17:19.347699] [INFO ] [REMOTE    ] STEM: Fetching primary data for 2025-04.
[2025-10-24T21:17:20.157114] [INFO ] [REMOTE    ] STEW: Fetching primary data for 2025-05.
[2025-10-24T21:17:20.162082] [INFO ] [REMOTE    ] STEM: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T21:17:20.759487] [INFO ] [REMOTE    ] STEW: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T21:17:20.947709] [INFO ] [REMOTE    ] STEW: Fetching primary data for 2025-06.
[2025-10-24T21:17:21.747691] [INFO ] [REMOTE    ] STG: Fetching primary data for 2025-10.
[2025-10-24T21:17:21.776608] [INFO ] [REMOTE    ] STEW: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T21:17:21.963112] [INFO ] [REMOTE    ] STG: Incremental fetch complete for 2025-10 (0.22 seconds).
[2025-10-24T21:17:21.963874] [INFO ] [REMOTE    ] STG: Full fetch complete (2475 records).
[2025-10-24T21:17:21.963940] [DEBUG] [VALIDATOR ] STG: Validating primary data.
[2025-10-24T21:17:21.964311] [FATAL] [VALIDATOR ] STG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:17:21.964393] [FATAL] [MAIN      ] STG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:17:21.964435] [WARN ] [MAIN      ] STG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:17:21.964474] [INFO ] [LOCAL     ] STG: Starting deletion of primary data.
[2025-10-24T21:17:21.964527] [DEBUG] [LOCAL     ] STG: No primary data file found to delete.
[2025-10-24T21:17:21.964562] [INFO ] [LOCAL     ] STG: Starting deletion of derivative data.
[2025-10-24T21:17:21.964601] [DEBUG] [LOCAL     ] STG: No derivative data file found to delete.
[2025-10-24T21:17:21.964690] [INFO ] [MAIN      ] Update Progress: 2001/2366 symbols completed. STG took 20.0s. Estimated remaining: 46m 56s. Rate: 7.8 symbols/min
[2025-10-24T21:17:22.141096] [INFO ] [MAIN      ] STK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:17:22.152484] [DEBUG] [LOCAL     ] STK: Loaded 9757 existing records from primary storage.
[2025-10-24T21:17:22.152748] [INFO ] [MAIN      ] STK: Loaded 9757 existing records.
[2025-10-24T21:17:22.335752] [WARN ] [MAIN      ] STK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:17:22.335977] [INFO ] [MAIN      ] STK: Wiping existing primary data before full refresh.
[2025-10-24T21:17:22.336035] [INFO ] [LOCAL     ] STK: Starting deletion of primary data.
[2025-10-24T21:17:22.336317] [DEBUG] [LOCAL     ] STK: Deleted primary data file.
[2025-10-24T21:17:22.336373] [INFO ] [MAIN      ] STK: Starting full primary refresh.
[2025-10-24T21:17:22.552812] [INFO ] [REMOTE    ] STEW: Fetching primary data for 2025-07.
[2025-10-24T21:17:22.701431] [INFO ] [REMOTE    ] STK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:17:23.347623] [INFO ] [REMOTE    ] STEM: Fetching primary data for 2025-05.
[2025-10-24T21:17:23.574048] [INFO ] [REMOTE    ] STEW: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T21:17:24.096489] [INFO ] [REMOTE    ] STEM: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T21:17:24.147701] [INFO ] [REMOTE    ] STEL: Fetching primary data for 2025-06.
[2025-10-24T21:17:24.755379] [INFO ] [REMOTE    ] STEL: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T21:17:24.947670] [INFO ] [REMOTE    ] STEW: Fetching primary data for 2025-08.
[2025-10-24T21:17:25.733279] [INFO ] [REMOTE    ] STEW: Incremental fetch complete for 2025-08 (0.79 seconds).
[2025-10-24T21:17:25.747589] [INFO ] [REMOTE    ] STEW: Fetching primary data for 2025-09.
[2025-10-24T21:17:26.105775] [INFO ] [REMOTE    ] STEW: Incremental fetch complete for 2025-09 (0.36 seconds).
[2025-10-24T21:17:26.547701] [INFO ] [REMOTE    ] STEL: Fetching primary data for 2025-07.
[2025-10-24T21:17:27.219166] [INFO ] [REMOTE    ] STEL: Incremental fetch complete for 2025-07 (0.67 seconds).
[2025-10-24T21:17:27.347683] [INFO ] [REMOTE    ] STEW: Fetching primary data for 2025-10.
[2025-10-24T21:17:27.824726] [INFO ] [REMOTE    ] STEW: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T21:17:27.827422] [INFO ] [REMOTE    ] STEW: Full fetch complete (21668 records).
[2025-10-24T21:17:27.827516] [DEBUG] [VALIDATOR ] STEW: Validating primary data.
[2025-10-24T21:17:27.828009] [FATAL] [VALIDATOR ] STEW: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:17:27.828089] [FATAL] [MAIN      ] STEW: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:17:27.828132] [WARN ] [MAIN      ] STEW: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:17:27.828169] [INFO ] [LOCAL     ] STEW: Starting deletion of primary data.
[2025-10-24T21:17:27.828223] [DEBUG] [LOCAL     ] STEW: No primary data file found to delete.
[2025-10-24T21:17:27.828257] [INFO ] [LOCAL     ] STEW: Starting deletion of derivative data.
[2025-10-24T21:17:27.828415] [DEBUG] [LOCAL     ] STEW: Deleted derivative data file.
[2025-10-24T21:17:27.828499] [INFO ] [MAIN      ] Update Progress: 2002/2366 symbols completed. STEW took 25.9s. Estimated remaining: 46m 48s. Rate: 7.8 symbols/min
[2025-10-24T21:17:27.995598] [INFO ] [MAIN      ] STLA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:17:28.046943] [DEBUG] [LOCAL     ] STLA: Loaded 53944 existing records from primary storage.
[2025-10-24T21:17:28.047233] [INFO ] [MAIN      ] STLA: Loaded 53944 existing records.
[2025-10-24T21:17:28.147695] [INFO ] [REMOTE    ] STK: Fetching primary data for 2025-01.
[2025-10-24T21:17:28.225919] [WARN ] [MAIN      ] STLA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:17:28.226091] [INFO ] [MAIN      ] STLA: Wiping existing primary data before full refresh.
[2025-10-24T21:17:28.226135] [INFO ] [LOCAL     ] STLA: Starting deletion of primary data.
[2025-10-24T21:17:28.226567] [DEBUG] [LOCAL     ] STLA: Deleted primary data file.
[2025-10-24T21:17:28.226604] [INFO ] [MAIN      ] STLA: Starting full primary refresh.
[2025-10-24T21:17:28.584905] [INFO ] [REMOTE    ] STLA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:17:28.830939] [INFO ] [REMOTE    ] STK: Incremental fetch complete for 2025-01 (0.68 seconds).
[2025-10-24T21:17:28.947660] [INFO ] [REMOTE    ] STK: Fetching primary data for 2025-02.
[2025-10-24T21:17:29.425367] [INFO ] [REMOTE    ] STK: Incremental fetch complete for 2025-02 (0.48 seconds).
[2025-10-24T21:17:29.747637] [INFO ] [REMOTE    ] STK: Fetching primary data for 2025-03.
[2025-10-24T21:17:30.467865] [INFO ] [REMOTE    ] STK: Incremental fetch complete for 2025-03 (0.72 seconds).
[2025-10-24T21:17:30.547707] [INFO ] [REMOTE    ] STK: Fetching primary data for 2025-04.
[2025-10-24T21:17:31.264547] [INFO ] [REMOTE    ] STK: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T21:17:31.347626] [INFO ] [REMOTE    ] STEM: Fetching primary data for 2025-06.
[2025-10-24T21:17:32.156243] [INFO ] [REMOTE    ] STEL: Fetching primary data for 2025-08.
[2025-10-24T21:17:32.161726] [INFO ] [REMOTE    ] STEM: Incremental fetch complete for 2025-06 (0.81 seconds).
[2025-10-24T21:17:32.947630] [INFO ] [REMOTE    ] STK: Fetching primary data for 2025-05.
[2025-10-24T21:17:32.999049] [INFO ] [REMOTE    ] STEL: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T21:17:33.423263] [INFO ] [REMOTE    ] STK: Incremental fetch complete for 2025-05 (0.48 seconds).
[2025-10-24T21:17:33.747733] [INFO ] [REMOTE    ] STLA: Fetching primary data for 2025-01.
[2025-10-24T21:17:34.528833] [INFO ] [REMOTE    ] STLA: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T21:17:34.547599] [INFO ] [REMOTE    ] STLA: Fetching primary data for 2025-02.
[2025-10-24T21:17:35.347702] [INFO ] [REMOTE    ] STEL: Fetching primary data for 2025-09.
[2025-10-24T21:17:35.531840] [INFO ] [REMOTE    ] STLA: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T21:17:35.933567] [INFO ] [REMOTE    ] STEL: Incremental fetch complete for 2025-09 (0.59 seconds).
[2025-10-24T21:17:36.147727] [INFO ] [REMOTE    ] STLA: Fetching primary data for 2025-03.
[2025-10-24T21:17:36.947633] [INFO ] [REMOTE    ] STEL: Fetching primary data for 2025-10.
[2025-10-24T21:17:37.178419] [INFO ] [REMOTE    ] STLA: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T21:17:37.517012] [INFO ] [REMOTE    ] STEL: Incremental fetch complete for 2025-10 (0.57 seconds).
[2025-10-24T21:17:37.521531] [INFO ] [REMOTE    ] STEL: Full fetch complete (32242 records).
[2025-10-24T21:17:37.521710] [DEBUG] [VALIDATOR ] STEL: Validating primary data.
[2025-10-24T21:17:37.522389] [FATAL] [VALIDATOR ] STEL: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:17:37.522483] [FATAL] [MAIN      ] STEL: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:17:37.522528] [WARN ] [MAIN      ] STEL: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:17:37.522570] [INFO ] [LOCAL     ] STEL: Starting deletion of primary data.
[2025-10-24T21:17:37.522678] [DEBUG] [LOCAL     ] STEL: No primary data file found to delete.
[2025-10-24T21:17:37.522738] [INFO ] [LOCAL     ] STEL: Starting deletion of derivative data.
[2025-10-24T21:17:37.523129] [DEBUG] [LOCAL     ] STEL: Deleted derivative data file.
[2025-10-24T21:17:37.523229] [INFO ] [MAIN      ] Update Progress: 2003/2366 symbols completed. STEL took 35.6s. Estimated remaining: 46m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:17:37.700505] [INFO ] [MAIN      ] STM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:17:37.753634] [INFO ] [REMOTE    ] STEM: Fetching primary data for 2025-07.
[2025-10-24T21:17:37.757014] [DEBUG] [LOCAL     ] STM: Loaded 53963 existing records from primary storage.
[2025-10-24T21:17:37.757338] [INFO ] [MAIN      ] STM: Loaded 53963 existing records.
[2025-10-24T21:17:37.937260] [WARN ] [MAIN      ] STM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:17:37.937520] [INFO ] [MAIN      ] STM: Wiping existing primary data before full refresh.
[2025-10-24T21:17:37.937576] [INFO ] [LOCAL     ] STM: Starting deletion of primary data.
[2025-10-24T21:17:37.937851] [DEBUG] [LOCAL     ] STM: Deleted primary data file.
[2025-10-24T21:17:37.937911] [INFO ] [MAIN      ] STM: Starting full primary refresh.
[2025-10-24T21:17:38.314267] [INFO ] [REMOTE    ] STM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:17:38.547707] [INFO ] [REMOTE    ] STK: Fetching primary data for 2025-06.
[2025-10-24T21:17:38.913561] [INFO ] [REMOTE    ] STEM: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T21:17:39.294800] [INFO ] [REMOTE    ] STK: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T21:17:39.347619] [INFO ] [REMOTE    ] STK: Fetching primary data for 2025-07.
[2025-10-24T21:17:39.828118] [INFO ] [REMOTE    ] STK: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T21:17:40.147721] [INFO ] [REMOTE    ] STM: Fetching primary data for 2025-01.
[2025-10-24T21:17:40.947676] [INFO ] [REMOTE    ] STEM: Fetching primary data for 2025-08.
[2025-10-24T21:17:41.571571] [INFO ] [REMOTE    ] STM: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T21:17:41.675812] [INFO ] [REMOTE    ] STEM: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T21:17:41.747683] [INFO ] [REMOTE    ] STEM: Fetching primary data for 2025-09.
[2025-10-24T21:17:42.420894] [INFO ] [REMOTE    ] STEM: Incremental fetch complete for 2025-09 (0.67 seconds).
[2025-10-24T21:17:42.547681] [INFO ] [REMOTE    ] STM: Fetching primary data for 2025-02.
[2025-10-24T21:17:43.347626] [INFO ] [REMOTE    ] STK: Fetching primary data for 2025-08.
[2025-10-24T21:17:43.591886] [INFO ] [REMOTE    ] STM: Incremental fetch complete for 2025-02 (1.04 seconds).
[2025-10-24T21:17:44.124262] [INFO ] [REMOTE    ] STK: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T21:17:44.147598] [INFO ] [REMOTE    ] STK: Fetching primary data for 2025-09.
[2025-10-24T21:17:44.902624] [INFO ] [REMOTE    ] STK: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T21:17:44.947728] [INFO ] [REMOTE    ] STK: Fetching primary data for 2025-10.
[2025-10-24T21:17:45.431106] [INFO ] [REMOTE    ] STK: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T21:17:45.434151] [INFO ] [REMOTE    ] STK: Full fetch complete (14297 records).
[2025-10-24T21:17:45.434266] [DEBUG] [VALIDATOR ] STK: Validating primary data.
[2025-10-24T21:17:45.434803] [FATAL] [VALIDATOR ] STK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:17:45.434896] [FATAL] [MAIN      ] STK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:17:45.434940] [WARN ] [MAIN      ] STK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:17:45.434981] [INFO ] [LOCAL     ] STK: Starting deletion of primary data.
[2025-10-24T21:17:45.435044] [DEBUG] [LOCAL     ] STK: No primary data file found to delete.
[2025-10-24T21:17:45.435080] [INFO ] [LOCAL     ] STK: Starting deletion of derivative data.
[2025-10-24T21:17:45.435264] [DEBUG] [LOCAL     ] STK: Deleted derivative data file.
[2025-10-24T21:17:45.435341] [INFO ] [MAIN      ] Update Progress: 2004/2366 symbols completed. STK took 23.5s. Estimated remaining: 46m 33s. Rate: 7.8 symbols/min
[2025-10-24T21:17:45.607845] [INFO ] [MAIN      ] STN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:17:45.633010] [DEBUG] [LOCAL     ] STN: Loaded 22702 existing records from primary storage.
[2025-10-24T21:17:45.633341] [INFO ] [MAIN      ] STN: Loaded 22702 existing records.
[2025-10-24T21:17:45.752877] [INFO ] [REMOTE    ] STEM: Fetching primary data for 2025-10.
[2025-10-24T21:17:45.821515] [WARN ] [MAIN      ] STN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:17:45.821841] [INFO ] [MAIN      ] STN: Wiping existing primary data before full refresh.
[2025-10-24T21:17:45.821896] [INFO ] [LOCAL     ] STN: Starting deletion of primary data.
[2025-10-24T21:17:45.822189] [DEBUG] [LOCAL     ] STN: Deleted primary data file.
[2025-10-24T21:17:45.822247] [INFO ] [MAIN      ] STN: Starting full primary refresh.
[2025-10-24T21:17:46.196545] [INFO ] [REMOTE    ] STN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:17:46.547700] [INFO ] [REMOTE    ] STN: Fetching primary data for 2025-01.
[2025-10-24T21:17:46.804046] [INFO ] [REMOTE    ] STEM: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T21:17:46.814450] [INFO ] [REMOTE    ] STEM: Full fetch complete (60190 records).
[2025-10-24T21:17:46.814695] [DEBUG] [VALIDATOR ] STEM: Validating primary data.
[2025-10-24T21:17:46.815821] [FATAL] [VALIDATOR ] STEM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:17:46.815936] [FATAL] [MAIN      ] STEM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:17:46.815988] [WARN ] [MAIN      ] STEM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:17:46.816038] [INFO ] [LOCAL     ] STEM: Starting deletion of primary data.
[2025-10-24T21:17:46.816125] [DEBUG] [LOCAL     ] STEM: No primary data file found to delete.
[2025-10-24T21:17:46.816172] [INFO ] [LOCAL     ] STEM: Starting deletion of derivative data.
[2025-10-24T21:17:46.816393] [DEBUG] [LOCAL     ] STEM: Deleted derivative data file.
[2025-10-24T21:17:46.816826] [INFO ] [MAIN      ] Update Progress: 2005/2366 symbols completed. STEM took 44.9s. Estimated remaining: 46m 24s. Rate: 7.8 symbols/min
[2025-10-24T21:17:47.095965] [INFO ] [MAIN      ] STNG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:17:47.150263] [DEBUG] [LOCAL     ] STNG: Loaded 43583 existing records from primary storage.
[2025-10-24T21:17:47.150796] [INFO ] [MAIN      ] STNG: Loaded 43583 existing records.
[2025-10-24T21:17:47.352110] [INFO ] [REMOTE    ] STM: Fetching primary data for 2025-03.
[2025-10-24T21:17:47.439584] [WARN ] [MAIN      ] STNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:17:47.440068] [INFO ] [MAIN      ] STNG: Wiping existing primary data before full refresh.
[2025-10-24T21:17:47.440187] [INFO ] [LOCAL     ] STNG: Starting deletion of primary data.
[2025-10-24T21:17:47.445836] [DEBUG] [LOCAL     ] STNG: Deleted primary data file.
[2025-10-24T21:17:47.452634] [INFO ] [MAIN      ] STNG: Starting full primary refresh.
[2025-10-24T21:17:47.453338] [INFO ] [REMOTE    ] STN: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T21:17:47.856843] [INFO ] [REMOTE    ] STNG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:17:48.147702] [INFO ] [REMOTE    ] STN: Fetching primary data for 2025-02.
[2025-10-24T21:17:48.255235] [INFO ] [REMOTE    ] STM: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T21:17:48.940637] [INFO ] [REMOTE    ] STN: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T21:17:48.947596] [INFO ] [REMOTE    ] STN: Fetching primary data for 2025-03.
[2025-10-24T21:17:49.673280] [INFO ] [REMOTE    ] STN: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T21:17:49.747614] [INFO ] [REMOTE    ] STN: Fetching primary data for 2025-04.
[2025-10-24T21:17:50.458506] [INFO ] [REMOTE    ] STN: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T21:17:50.547612] [INFO ] [REMOTE    ] STN: Fetching primary data for 2025-05.
[2025-10-24T21:17:51.347712] [INFO ] [REMOTE    ] STLA: Fetching primary data for 2025-04.
[2025-10-24T21:17:51.436258] [INFO ] [REMOTE    ] STN: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T21:17:52.147638] [INFO ] [REMOTE    ] STN: Fetching primary data for 2025-06.
[2025-10-24T21:17:52.531806] [INFO ] [REMOTE    ] STLA: Incremental fetch complete for 2025-04 (1.18 seconds).
[2025-10-24T21:17:52.947736] [INFO ] [REMOTE    ] STM: Fetching primary data for 2025-04.
[2025-10-24T21:17:52.997159] [INFO ] [REMOTE    ] STN: Incremental fetch complete for 2025-06 (0.85 seconds).
[2025-10-24T21:17:53.747732] [INFO ] [REMOTE    ] STNG: Fetching primary data for 2025-01.
[2025-10-24T21:17:53.804487] [INFO ] [REMOTE    ] STM: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T21:17:54.547620] [INFO ] [REMOTE    ] STN: Fetching primary data for 2025-07.
[2025-10-24T21:17:54.803171] [INFO ] [REMOTE    ] STNG: Incremental fetch complete for 2025-01 (1.06 seconds).
[2025-10-24T21:17:55.347720] [INFO ] [REMOTE    ] STLA: Fetching primary data for 2025-05.
[2025-10-24T21:17:55.372727] [INFO ] [REMOTE    ] STN: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T21:17:56.147705] [INFO ] [REMOTE    ] STN: Fetching primary data for 2025-08.
[2025-10-24T21:17:56.448107] [INFO ] [REMOTE    ] STLA: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T21:17:56.758130] [INFO ] [REMOTE    ] STN: Incremental fetch complete for 2025-08 (0.61 seconds).
[2025-10-24T21:17:56.947691] [INFO ] [REMOTE    ] STN: Fetching primary data for 2025-09.
[2025-10-24T21:17:57.747706] [INFO ] [REMOTE    ] STLA: Fetching primary data for 2025-06.
[2025-10-24T21:17:58.203054] [INFO ] [REMOTE    ] STN: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T21:17:58.532827] [INFO ] [REMOTE    ] STLA: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T21:17:58.547609] [INFO ] [REMOTE    ] STLA: Fetching primary data for 2025-07.
[2025-10-24T21:17:59.347706] [INFO ] [REMOTE    ] STN: Fetching primary data for 2025-10.
[2025-10-24T21:17:59.619943] [INFO ] [REMOTE    ] STLA: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T21:17:59.641549] [INFO ] [REMOTE    ] STN: Incremental fetch complete for 2025-10 (0.29 seconds).
[2025-10-24T21:17:59.645309] [INFO ] [REMOTE    ] STN: Full fetch complete (32567 records).
[2025-10-24T21:17:59.645386] [DEBUG] [VALIDATOR ] STN: Validating primary data.
[2025-10-24T21:17:59.645939] [FATAL] [VALIDATOR ] STN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:17:59.646033] [FATAL] [MAIN      ] STN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:17:59.646108] [WARN ] [MAIN      ] STN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:17:59.646198] [INFO ] [LOCAL     ] STN: Starting deletion of primary data.
[2025-10-24T21:17:59.646273] [DEBUG] [LOCAL     ] STN: No primary data file found to delete.
[2025-10-24T21:17:59.646309] [INFO ] [LOCAL     ] STN: Starting deletion of derivative data.
[2025-10-24T21:17:59.646455] [DEBUG] [LOCAL     ] STN: Deleted derivative data file.
[2025-10-24T21:17:59.646519] [INFO ] [MAIN      ] Update Progress: 2006/2366 symbols completed. STN took 14.2s. Estimated remaining: 46m 17s. Rate: 7.8 symbols/min
[2025-10-24T21:17:59.814940] [INFO ] [MAIN      ] STRV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:17:59.825895] [DEBUG] [LOCAL     ] STRV: Loaded 10739 existing records from primary storage.
[2025-10-24T21:17:59.826108] [INFO ] [MAIN      ] STRV: Loaded 10739 existing records.
[2025-10-24T21:18:00.009497] [WARN ] [MAIN      ] STRV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:18:00.009788] [INFO ] [MAIN      ] STRV: Wiping existing primary data before full refresh.
[2025-10-24T21:18:00.009848] [INFO ] [LOCAL     ] STRV: Starting deletion of primary data.
[2025-10-24T21:18:00.010008] [DEBUG] [LOCAL     ] STRV: Deleted primary data file.
[2025-10-24T21:18:00.010047] [INFO ] [MAIN      ] STRV: Starting full primary refresh.
[2025-10-24T21:18:00.152808] [INFO ] [REMOTE    ] STNG: Fetching primary data for 2025-02.
[2025-10-24T21:18:00.369446] [INFO ] [REMOTE    ] STRV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:18:00.947707] [INFO ] [REMOTE    ] STLA: Fetching primary data for 2025-08.
[2025-10-24T21:18:01.350401] [INFO ] [REMOTE    ] STNG: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T21:18:01.747008] [INFO ] [REMOTE    ] STLA: Incremental fetch complete for 2025-08 (0.80 seconds).
[2025-10-24T21:18:01.754684] [INFO ] [REMOTE    ] STNG: Fetching primary data for 2025-03.
[2025-10-24T21:18:02.547625] [INFO ] [REMOTE    ] STLA: Fetching primary data for 2025-09.
[2025-10-24T21:18:02.761590] [INFO ] [REMOTE    ] STNG: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T21:18:03.347700] [INFO ] [REMOTE    ] STRV: Fetching primary data for 2025-01.
[2025-10-24T21:18:03.917785] [INFO ] [REMOTE    ] STLA: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T21:18:04.147693] [INFO ] [REMOTE    ] STM: Fetching primary data for 2025-05.
[2025-10-24T21:18:04.278595] [INFO ] [REMOTE    ] STRV: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T21:18:04.947737] [INFO ] [REMOTE    ] STRV: Fetching primary data for 2025-02.
[2025-10-24T21:18:05.384861] [INFO ] [REMOTE    ] STM: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T21:18:05.571883] [INFO ] [REMOTE    ] STRV: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T21:18:05.747716] [INFO ] [REMOTE    ] STM: Fetching primary data for 2025-06.
[2025-10-24T21:18:06.547675] [INFO ] [REMOTE    ] STNG: Fetching primary data for 2025-04.
[2025-10-24T21:18:06.843447] [INFO ] [REMOTE    ] STM: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T21:18:07.347692] [INFO ] [REMOTE    ] STRV: Fetching primary data for 2025-03.
[2025-10-24T21:18:07.483248] [INFO ] [REMOTE    ] STNG: Incremental fetch complete for 2025-04 (0.94 seconds).
[2025-10-24T21:18:07.913303] [INFO ] [REMOTE    ] STRV: Incremental fetch complete for 2025-03 (0.57 seconds).
[2025-10-24T21:18:08.147670] [INFO ] [REMOTE    ] STNG: Fetching primary data for 2025-05.
[2025-10-24T21:18:08.947639] [INFO ] [REMOTE    ] STLA: Fetching primary data for 2025-10.
[2025-10-24T21:18:09.206077] [INFO ] [REMOTE    ] STNG: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T21:18:09.747635] [INFO ] [REMOTE    ] STNG: Fetching primary data for 2025-06.
[2025-10-24T21:18:09.912375] [INFO ] [REMOTE    ] STLA: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T21:18:09.922000] [INFO ] [REMOTE    ] STLA: Full fetch complete (77276 records).
[2025-10-24T21:18:09.922158] [DEBUG] [VALIDATOR ] STLA: Validating primary data.
[2025-10-24T21:18:09.923012] [FATAL] [VALIDATOR ] STLA: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:18:09.923115] [FATAL] [MAIN      ] STLA: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:18:09.923181] [WARN ] [MAIN      ] STLA: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:18:09.923265] [INFO ] [LOCAL     ] STLA: Starting deletion of primary data.
[2025-10-24T21:18:09.923343] [DEBUG] [LOCAL     ] STLA: No primary data file found to delete.
[2025-10-24T21:18:09.923393] [INFO ] [LOCAL     ] STLA: Starting deletion of derivative data.
[2025-10-24T21:18:09.923587] [DEBUG] [LOCAL     ] STLA: Deleted derivative data file.
[2025-10-24T21:18:09.923949] [INFO ] [MAIN      ] Update Progress: 2007/2366 symbols completed. STLA took 42.1s. Estimated remaining: 46m 10s. Rate: 7.8 symbols/min
[2025-10-24T21:18:10.108501] [INFO ] [MAIN      ] STT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:18:10.160470] [DEBUG] [LOCAL     ] STT: Loaded 51483 existing records from primary storage.
[2025-10-24T21:18:10.160832] [INFO ] [MAIN      ] STT: Loaded 51483 existing records.
[2025-10-24T21:18:10.341410] [WARN ] [MAIN      ] STT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:18:10.341620] [INFO ] [MAIN      ] STT: Wiping existing primary data before full refresh.
[2025-10-24T21:18:10.341702] [INFO ] [LOCAL     ] STT: Starting deletion of primary data.
[2025-10-24T21:18:10.342172] [DEBUG] [LOCAL     ] STT: Deleted primary data file.
[2025-10-24T21:18:10.342212] [INFO ] [MAIN      ] STT: Starting full primary refresh.
[2025-10-24T21:18:10.552796] [INFO ] [REMOTE    ] STRV: Fetching primary data for 2025-04.
[2025-10-24T21:18:10.728021] [INFO ] [REMOTE    ] STT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:18:10.754056] [INFO ] [REMOTE    ] STNG: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T21:18:11.347687] [INFO ] [REMOTE    ] STNG: Fetching primary data for 2025-07.
[2025-10-24T21:18:11.821754] [INFO ] [REMOTE    ] STRV: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T21:18:12.147698] [INFO ] [REMOTE    ] STRV: Fetching primary data for 2025-05.
[2025-10-24T21:18:12.198791] [INFO ] [REMOTE    ] STNG: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T21:18:12.934978] [INFO ] [REMOTE    ] STRV: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T21:18:12.947591] [INFO ] [REMOTE    ] STRV: Fetching primary data for 2025-06.
[2025-10-24T21:18:13.357288] [INFO ] [REMOTE    ] STRV: Incremental fetch complete for 2025-06 (0.41 seconds).
[2025-10-24T21:18:13.747700] [INFO ] [REMOTE    ] STRV: Fetching primary data for 2025-07.
[2025-10-24T21:18:14.226378] [INFO ] [REMOTE    ] STRV: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T21:18:14.547674] [INFO ] [REMOTE    ] STRV: Fetching primary data for 2025-08.
[2025-10-24T21:18:15.024893] [INFO ] [REMOTE    ] STRV: Incremental fetch complete for 2025-08 (0.48 seconds).
[2025-10-24T21:18:15.347723] [INFO ] [REMOTE    ] STNG: Fetching primary data for 2025-08.
[2025-10-24T21:18:16.149604] [INFO ] [REMOTE    ] STT: Fetching primary data for 2025-01.
[2025-10-24T21:18:16.153379] [INFO ] [REMOTE    ] STNG: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T21:18:16.947632] [INFO ] [REMOTE    ] STM: Fetching primary data for 2025-07.
[2025-10-24T21:18:17.178421] [INFO ] [REMOTE    ] STT: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T21:18:17.747610] [INFO ] [REMOTE    ] STNG: Fetching primary data for 2025-09.
[2025-10-24T21:18:17.892530] [INFO ] [REMOTE    ] STM: Incremental fetch complete for 2025-07 (0.94 seconds).
[2025-10-24T21:18:18.504311] [INFO ] [REMOTE    ] STNG: Incremental fetch complete for 2025-09 (0.76 seconds).
[2025-10-24T21:18:18.547638] [INFO ] [REMOTE    ] STT: Fetching primary data for 2025-02.
[2025-10-24T21:18:19.347695] [INFO ] [REMOTE    ] STM: Fetching primary data for 2025-08.
[2025-10-24T21:18:19.633002] [INFO ] [REMOTE    ] STT: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T21:18:19.761190] [INFO ] [REMOTE    ] STM: Incremental fetch complete for 2025-08 (0.41 seconds).
[2025-10-24T21:18:20.147712] [INFO ] [REMOTE    ] STRV: Fetching primary data for 2025-09.
[2025-10-24T21:18:20.947628] [INFO ] [REMOTE    ] STNG: Fetching primary data for 2025-10.
[2025-10-24T21:18:21.253103] [INFO ] [REMOTE    ] STRV: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T21:18:21.747631] [INFO ] [REMOTE    ] STT: Fetching primary data for 2025-03.
[2025-10-24T21:18:21.977300] [INFO ] [REMOTE    ] STNG: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T21:18:21.984506] [INFO ] [REMOTE    ] STNG: Full fetch complete (63737 records).
[2025-10-24T21:18:21.984637] [DEBUG] [VALIDATOR ] STNG: Validating primary data.
[2025-10-24T21:18:21.986009] [FATAL] [VALIDATOR ] STNG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:18:21.986103] [FATAL] [MAIN      ] STNG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:18:21.986145] [WARN ] [MAIN      ] STNG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:18:21.986183] [INFO ] [LOCAL     ] STNG: Starting deletion of primary data.
[2025-10-24T21:18:21.986239] [DEBUG] [LOCAL     ] STNG: No primary data file found to delete.
[2025-10-24T21:18:21.986272] [INFO ] [LOCAL     ] STNG: Starting deletion of derivative data.
[2025-10-24T21:18:21.986461] [DEBUG] [LOCAL     ] STNG: Deleted derivative data file.
[2025-10-24T21:18:21.986879] [INFO ] [MAIN      ] Update Progress: 2008/2366 symbols completed. STNG took 35.2s. Estimated remaining: 46m 3s. Rate: 7.8 symbols/min
[2025-10-24T21:18:22.157987] [INFO ] [MAIN      ] STUB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:18:22.158169] [DEBUG] [LOCAL     ] STUB: No existing data file found in primary storage.
[2025-10-24T21:18:22.158220] [WARN ] [MAIN      ] STUB: No existing data found, performing full refresh instead.
[2025-10-24T21:18:22.158339] [INFO ] [MAIN      ] STUB: Wiping existing primary data before full refresh.
[2025-10-24T21:18:22.158383] [INFO ] [LOCAL     ] STUB: Starting deletion of primary data.
[2025-10-24T21:18:22.158463] [DEBUG] [LOCAL     ] STUB: No primary data file found to delete.
[2025-10-24T21:18:22.158519] [INFO ] [MAIN      ] STUB: Starting full primary refresh.
[2025-10-24T21:18:22.514965] [INFO ] [REMOTE    ] STUB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:18:22.547680] [INFO ] [REMOTE    ] STUB: Fetching primary data for 2025-01.
[2025-10-24T21:18:22.547602] [INFO ] [REMOTE    ] STT: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T21:18:22.968494] [DEBUG] [REMOTE    ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:18:22.968853] [WARN ] [REMOTE    ] STUB: No data returned for month 2025-01
[2025-10-24T21:18:22.968940] [FATAL] [REMOTE    ] STUB: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:18:22.968986] [FATAL] [MAIN      ] STUB: Failed to fetch primary data.
[2025-10-24T21:18:22.969045] [WARN ] [MAIN      ] STUB: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:18:22.969114] [INFO ] [LOCAL     ] STUB: Starting deletion of primary data.
[2025-10-24T21:18:22.969178] [DEBUG] [LOCAL     ] STUB: No primary data file found to delete.
[2025-10-24T21:18:22.969213] [INFO ] [LOCAL     ] STUB: Starting deletion of derivative data.
[2025-10-24T21:18:22.969251] [DEBUG] [LOCAL     ] STUB: No derivative data file found to delete.
[2025-10-24T21:18:22.969295] [INFO ] [MAIN      ] Update Progress: 2009/2366 symbols completed. STUB took 1.0s. Estimated remaining: 45m 54s. Rate: 7.8 symbols/min
[2025-10-24T21:18:23.136691] [INFO ] [MAIN      ] STVN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:18:23.162947] [DEBUG] [LOCAL     ] STVN: Loaded 26897 existing records from primary storage.
[2025-10-24T21:18:23.163206] [INFO ] [MAIN      ] STVN: Loaded 26897 existing records.
[2025-10-24T21:18:23.342266] [WARN ] [MAIN      ] STVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:18:23.342494] [INFO ] [MAIN      ] STVN: Wiping existing primary data before full refresh.
[2025-10-24T21:18:23.342547] [INFO ] [LOCAL     ] STVN: Starting deletion of primary data.
[2025-10-24T21:18:23.342791] [DEBUG] [LOCAL     ] STVN: Deleted primary data file.
[2025-10-24T21:18:23.342846] [INFO ] [MAIN      ] STVN: Starting full primary refresh.
[2025-10-24T21:18:23.353784] [INFO ] [REMOTE    ] STT: Fetching primary data for 2025-04.
[2025-10-24T21:18:23.692851] [INFO ] [REMOTE    ] STVN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:18:24.147717] [INFO ] [REMOTE    ] STRV: Fetching primary data for 2025-10.
[2025-10-24T21:18:24.683944] [INFO ] [REMOTE    ] STT: Incremental fetch complete for 2025-04 (1.33 seconds).
[2025-10-24T21:18:24.779547] [INFO ] [REMOTE    ] STRV: Incremental fetch complete for 2025-10 (0.63 seconds).
[2025-10-24T21:18:24.781696] [INFO ] [REMOTE    ] STRV: Full fetch complete (17156 records).
[2025-10-24T21:18:24.781769] [DEBUG] [VALIDATOR ] STRV: Validating primary data.
[2025-10-24T21:18:24.782211] [FATAL] [VALIDATOR ] STRV: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:18:24.782288] [FATAL] [MAIN      ] STRV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:18:24.782354] [WARN ] [MAIN      ] STRV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:18:24.782427] [INFO ] [LOCAL     ] STRV: Starting deletion of primary data.
[2025-10-24T21:18:24.782605] [DEBUG] [LOCAL     ] STRV: No primary data file found to delete.
[2025-10-24T21:18:24.782686] [INFO ] [LOCAL     ] STRV: Starting deletion of derivative data.
[2025-10-24T21:18:24.782871] [DEBUG] [LOCAL     ] STRV: Deleted derivative data file.
[2025-10-24T21:18:24.782980] [INFO ] [MAIN      ] Update Progress: 2010/2366 symbols completed. STRV took 25.1s. Estimated remaining: 45m 46s. Rate: 7.8 symbols/min
[2025-10-24T21:18:24.954094] [INFO ] [REMOTE    ] STVN: Fetching primary data for 2025-01.
[2025-10-24T21:18:24.957638] [INFO ] [MAIN      ] STWD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:18:25.008548] [DEBUG] [LOCAL     ] STWD: Loaded 52342 existing records from primary storage.
[2025-10-24T21:18:25.008897] [INFO ] [MAIN      ] STWD: Loaded 52342 existing records.
[2025-10-24T21:18:25.183800] [WARN ] [MAIN      ] STWD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:18:25.184022] [INFO ] [MAIN      ] STWD: Wiping existing primary data before full refresh.
[2025-10-24T21:18:25.184069] [INFO ] [LOCAL     ] STWD: Starting deletion of primary data.
[2025-10-24T21:18:25.184344] [DEBUG] [LOCAL     ] STWD: Deleted primary data file.
[2025-10-24T21:18:25.184392] [INFO ] [MAIN      ] STWD: Starting full primary refresh.
[2025-10-24T21:18:25.536584] [INFO ] [REMOTE    ] STWD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:18:25.747613] [INFO ] [REMOTE    ] STWD: Fetching primary data for 2025-01.
[2025-10-24T21:18:25.949187] [INFO ] [REMOTE    ] STVN: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T21:18:26.547693] [INFO ] [REMOTE    ] STVN: Fetching primary data for 2025-02.
[2025-10-24T21:18:26.604824] [INFO ] [REMOTE    ] STWD: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T21:18:27.347679] [INFO ] [REMOTE    ] STWD: Fetching primary data for 2025-02.
[2025-10-24T21:18:27.471346] [INFO ] [REMOTE    ] STVN: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T21:18:28.147692] [INFO ] [REMOTE    ] STT: Fetching primary data for 2025-05.
[2025-10-24T21:18:28.328065] [INFO ] [REMOTE    ] STWD: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T21:18:28.947677] [INFO ] [REMOTE    ] STM: Fetching primary data for 2025-09.
[2025-10-24T21:18:29.036464] [INFO ] [REMOTE    ] STT: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T21:18:29.733710] [INFO ] [REMOTE    ] STM: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T21:18:29.747592] [INFO ] [REMOTE    ] STM: Fetching primary data for 2025-10.
[2025-10-24T21:18:30.499347] [INFO ] [REMOTE    ] STM: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T21:18:30.509322] [INFO ] [REMOTE    ] STM: Full fetch complete (77307 records).
[2025-10-24T21:18:30.509577] [DEBUG] [VALIDATOR ] STM: Validating primary data.
[2025-10-24T21:18:30.510628] [FATAL] [VALIDATOR ] STM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:18:30.510743] [FATAL] [MAIN      ] STM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:18:30.510791] [WARN ] [MAIN      ] STM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:18:30.510831] [INFO ] [LOCAL     ] STM: Starting deletion of primary data.
[2025-10-24T21:18:30.510895] [DEBUG] [LOCAL     ] STM: No primary data file found to delete.
[2025-10-24T21:18:30.510932] [INFO ] [LOCAL     ] STM: Starting deletion of derivative data.
[2025-10-24T21:18:30.511163] [DEBUG] [LOCAL     ] STM: Deleted derivative data file.
[2025-10-24T21:18:30.511826] [INFO ] [MAIN      ] Update Progress: 2011/2366 symbols completed. STM took 53.0s. Estimated remaining: 45m 38s. Rate: 7.8 symbols/min
[2025-10-24T21:18:30.552899] [INFO ] [REMOTE    ] STT: Fetching primary data for 2025-06.
[2025-10-24T21:18:30.685124] [INFO ] [MAIN      ] STXD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:18:30.688441] [DEBUG] [LOCAL     ] STXD: Loaded 1352 existing records from primary storage.
[2025-10-24T21:18:30.688620] [INFO ] [MAIN      ] STXD: Loaded 1352 existing records.
[2025-10-24T21:18:30.866815] [WARN ] [MAIN      ] STXD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:18:30.867138] [INFO ] [MAIN      ] STXD: Wiping existing primary data before full refresh.
[2025-10-24T21:18:30.867190] [INFO ] [LOCAL     ] STXD: Starting deletion of primary data.
[2025-10-24T21:18:30.867359] [DEBUG] [LOCAL     ] STXD: Deleted primary data file.
[2025-10-24T21:18:30.867398] [INFO ] [MAIN      ] STXD: Starting full primary refresh.
[2025-10-24T21:18:31.230414] [INFO ] [REMOTE    ] STXD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:18:31.347697] [INFO ] [REMOTE    ] STWD: Fetching primary data for 2025-03.
[2025-10-24T21:18:31.730966] [INFO ] [REMOTE    ] STT: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T21:18:32.147630] [INFO ] [REMOTE    ] STVN: Fetching primary data for 2025-03.
[2025-10-24T21:18:32.194632] [INFO ] [REMOTE    ] STWD: Incremental fetch complete for 2025-03 (0.85 seconds).
[2025-10-24T21:18:32.947698] [INFO ] [REMOTE    ] STWD: Fetching primary data for 2025-04.
[2025-10-24T21:18:32.982305] [INFO ] [REMOTE    ] STVN: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T21:18:33.729967] [INFO ] [REMOTE    ] STWD: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T21:18:33.747610] [INFO ] [REMOTE    ] STVN: Fetching primary data for 2025-04.
[2025-10-24T21:18:34.547771] [INFO ] [REMOTE    ] STXD: Fetching primary data for 2025-01.
[2025-10-24T21:18:34.591039] [INFO ] [REMOTE    ] STVN: Incremental fetch complete for 2025-04 (0.84 seconds).
[2025-10-24T21:18:34.850545] [INFO ] [REMOTE    ] STXD: Incremental fetch complete for 2025-01 (0.30 seconds).
[2025-10-24T21:18:35.347673] [INFO ] [REMOTE    ] STXD: Fetching primary data for 2025-02.
[2025-10-24T21:18:35.639022] [INFO ] [REMOTE    ] STXD: Incremental fetch complete for 2025-02 (0.29 seconds).
[2025-10-24T21:18:36.147681] [INFO ] [REMOTE    ] STWD: Fetching primary data for 2025-05.
[2025-10-24T21:18:36.947720] [INFO ] [REMOTE    ] STVN: Fetching primary data for 2025-05.
[2025-10-24T21:18:37.234346] [INFO ] [REMOTE    ] STWD: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T21:18:37.373088] [INFO ] [REMOTE    ] STVN: Incremental fetch complete for 2025-05 (0.43 seconds).
[2025-10-24T21:18:37.747711] [INFO ] [REMOTE    ] STVN: Fetching primary data for 2025-06.
[2025-10-24T21:18:38.547637] [INFO ] [REMOTE    ] STXD: Fetching primary data for 2025-03.
[2025-10-24T21:18:38.626474] [INFO ] [REMOTE    ] STVN: Incremental fetch complete for 2025-06 (0.88 seconds).
[2025-10-24T21:18:39.190743] [INFO ] [REMOTE    ] STXD: Incremental fetch complete for 2025-03 (0.64 seconds).
[2025-10-24T21:18:39.347699] [INFO ] [REMOTE    ] STT: Fetching primary data for 2025-07.
[2025-10-24T21:18:40.147634] [INFO ] [REMOTE    ] STXD: Fetching primary data for 2025-04.
[2025-10-24T21:18:40.392010] [INFO ] [REMOTE    ] STT: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T21:18:40.442402] [INFO ] [REMOTE    ] STXD: Incremental fetch complete for 2025-04 (0.29 seconds).
[2025-10-24T21:18:40.947728] [INFO ] [REMOTE    ] STWD: Fetching primary data for 2025-06.
[2025-10-24T21:18:41.747620] [INFO ] [REMOTE    ] STXD: Fetching primary data for 2025-05.
[2025-10-24T21:18:41.904112] [INFO ] [REMOTE    ] STXD: Incremental fetch complete for 2025-05 (0.16 seconds).
[2025-10-24T21:18:41.942487] [INFO ] [REMOTE    ] STWD: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T21:18:42.547710] [INFO ] [REMOTE    ] STT: Fetching primary data for 2025-08.
[2025-10-24T21:18:43.347639] [INFO ] [REMOTE    ] STWD: Fetching primary data for 2025-07.
[2025-10-24T21:18:43.395251] [INFO ] [REMOTE    ] STT: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T21:18:44.147722] [INFO ] [REMOTE    ] STXD: Fetching primary data for 2025-06.
[2025-10-24T21:18:44.417363] [INFO ] [REMOTE    ] STXD: Incremental fetch complete for 2025-06 (0.27 seconds).
[2025-10-24T21:18:44.419462] [INFO ] [REMOTE    ] STWD: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T21:18:44.947664] [INFO ] [REMOTE    ] STT: Fetching primary data for 2025-09.
[2025-10-24T21:18:45.747694] [INFO ] [REMOTE    ] STXD: Fetching primary data for 2025-07.
[2025-10-24T21:18:45.815278] [INFO ] [REMOTE    ] STT: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T21:18:46.112313] [INFO ] [REMOTE    ] STXD: Incremental fetch complete for 2025-07 (0.36 seconds).
[2025-10-24T21:18:46.547707] [INFO ] [REMOTE    ] STXD: Fetching primary data for 2025-08.
[2025-10-24T21:18:47.041780] [INFO ] [REMOTE    ] STXD: Incremental fetch complete for 2025-08 (0.49 seconds).
[2025-10-24T21:18:47.347743] [INFO ] [REMOTE    ] STT: Fetching primary data for 2025-10.
[2025-10-24T21:18:48.080760] [INFO ] [REMOTE    ] STT: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:18:48.090470] [INFO ] [REMOTE    ] STT: Full fetch complete (74147 records).
[2025-10-24T21:18:48.090622] [DEBUG] [VALIDATOR ] STT: Validating primary data.
[2025-10-24T21:18:48.091463] [FATAL] [VALIDATOR ] STT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:18:48.091557] [FATAL] [MAIN      ] STT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:18:48.091600] [WARN ] [MAIN      ] STT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:18:48.091687] [INFO ] [LOCAL     ] STT: Starting deletion of primary data.
[2025-10-24T21:18:48.091768] [DEBUG] [LOCAL     ] STT: No primary data file found to delete.
[2025-10-24T21:18:48.091806] [INFO ] [LOCAL     ] STT: Starting deletion of derivative data.
[2025-10-24T21:18:48.091957] [DEBUG] [LOCAL     ] STT: Deleted derivative data file.
[2025-10-24T21:18:48.092779] [INFO ] [MAIN      ] Update Progress: 2012/2366 symbols completed. STT took 38.2s. Estimated remaining: 45m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:18:48.153993] [INFO ] [REMOTE    ] STVN: Fetching primary data for 2025-07.
[2025-10-24T21:18:48.263204] [INFO ] [MAIN      ] STXE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:18:48.267056] [DEBUG] [LOCAL     ] STXE: Loaded 2067 existing records from primary storage.
[2025-10-24T21:18:48.267212] [INFO ] [MAIN      ] STXE: Loaded 2067 existing records.
[2025-10-24T21:18:48.448705] [WARN ] [MAIN      ] STXE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:18:48.448957] [INFO ] [MAIN      ] STXE: Wiping existing primary data before full refresh.
[2025-10-24T21:18:48.449008] [INFO ] [LOCAL     ] STXE: Starting deletion of primary data.
[2025-10-24T21:18:48.449153] [DEBUG] [LOCAL     ] STXE: Deleted primary data file.
[2025-10-24T21:18:48.449208] [INFO ] [MAIN      ] STXE: Starting full primary refresh.
[2025-10-24T21:18:48.810135] [INFO ] [REMOTE    ] STXE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:18:48.947746] [INFO ] [REMOTE    ] STXD: Fetching primary data for 2025-09.
[2025-10-24T21:18:49.218358] [INFO ] [REMOTE    ] STVN: Incremental fetch complete for 2025-07 (1.06 seconds).
[2025-10-24T21:18:49.466713] [INFO ] [REMOTE    ] STXD: Incremental fetch complete for 2025-09 (0.52 seconds).
[2025-10-24T21:18:49.747738] [INFO ] [REMOTE    ] STXD: Fetching primary data for 2025-10.
[2025-10-24T21:18:50.146192] [INFO ] [REMOTE    ] STXD: Incremental fetch complete for 2025-10 (0.40 seconds).
[2025-10-24T21:18:50.147423] [INFO ] [REMOTE    ] STXD: Full fetch complete (2154 records).
[2025-10-24T21:18:50.147515] [DEBUG] [VALIDATOR ] STXD: Validating primary data.
[2025-10-24T21:18:50.147975] [FATAL] [VALIDATOR ] STXD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:18:50.148089] [FATAL] [MAIN      ] STXD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:18:50.148133] [WARN ] [MAIN      ] STXD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:18:50.148201] [INFO ] [LOCAL     ] STXD: Starting deletion of primary data.
[2025-10-24T21:18:50.148270] [DEBUG] [LOCAL     ] STXD: No primary data file found to delete.
[2025-10-24T21:18:50.148305] [INFO ] [LOCAL     ] STXD: Starting deletion of derivative data.
[2025-10-24T21:18:50.148599] [DEBUG] [LOCAL     ] STXD: Deleted derivative data file.
[2025-10-24T21:18:50.148720] [INFO ] [MAIN      ] Update Progress: 2013/2366 symbols completed. STXD took 19.6s. Estimated remaining: 45m 23s. Rate: 7.8 symbols/min
[2025-10-24T21:18:50.316236] [INFO ] [MAIN      ] STXG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:18:50.322664] [DEBUG] [LOCAL     ] STXG: Loaded 2312 existing records from primary storage.
[2025-10-24T21:18:50.322969] [INFO ] [MAIN      ] STXG: Loaded 2312 existing records.
[2025-10-24T21:18:50.506346] [WARN ] [MAIN      ] STXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:18:50.506687] [INFO ] [MAIN      ] STXG: Wiping existing primary data before full refresh.
[2025-10-24T21:18:50.506765] [INFO ] [LOCAL     ] STXG: Starting deletion of primary data.
[2025-10-24T21:18:50.506987] [DEBUG] [LOCAL     ] STXG: Deleted primary data file.
[2025-10-24T21:18:50.507045] [INFO ] [MAIN      ] STXG: Starting full primary refresh.
[2025-10-24T21:18:50.552921] [INFO ] [REMOTE    ] STXE: Fetching primary data for 2025-01.
[2025-10-24T21:18:50.875028] [INFO ] [REMOTE    ] STXG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:18:50.971369] [INFO ] [REMOTE    ] STXE: Incremental fetch complete for 2025-01 (0.42 seconds).
[2025-10-24T21:18:51.347727] [INFO ] [REMOTE    ] STWD: Fetching primary data for 2025-08.
[2025-10-24T21:18:52.157716] [INFO ] [REMOTE    ] STXG: Fetching primary data for 2025-01.
[2025-10-24T21:18:52.179153] [INFO ] [REMOTE    ] STWD: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T21:18:52.552280] [INFO ] [REMOTE    ] STXG: Incremental fetch complete for 2025-01 (0.39 seconds).
[2025-10-24T21:18:52.947675] [INFO ] [REMOTE    ] STWD: Fetching primary data for 2025-09.
[2025-10-24T21:18:53.747627] [INFO ] [REMOTE    ] STXG: Fetching primary data for 2025-02.
[2025-10-24T21:18:54.127607] [INFO ] [REMOTE    ] STXG: Incremental fetch complete for 2025-02 (0.38 seconds).
[2025-10-24T21:18:54.227077] [INFO ] [REMOTE    ] STWD: Incremental fetch complete for 2025-09 (1.28 seconds).
[2025-10-24T21:18:54.547713] [INFO ] [REMOTE    ] STVN: Fetching primary data for 2025-08.
[2025-10-24T21:18:55.246051] [INFO ] [REMOTE    ] STVN: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T21:18:55.347687] [INFO ] [REMOTE    ] STWD: Fetching primary data for 2025-10.
[2025-10-24T21:18:56.147724] [INFO ] [REMOTE    ] STXG: Fetching primary data for 2025-03.
[2025-10-24T21:18:56.372142] [INFO ] [REMOTE    ] STWD: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T21:18:56.381945] [INFO ] [REMOTE    ] STWD: Full fetch complete (74979 records).
[2025-10-24T21:18:56.382078] [DEBUG] [VALIDATOR ] STWD: Validating primary data.
[2025-10-24T21:18:56.382922] [FATAL] [VALIDATOR ] STWD: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:18:56.383011] [FATAL] [MAIN      ] STWD: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:18:56.383054] [WARN ] [MAIN      ] STWD: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:18:56.383095] [INFO ] [LOCAL     ] STWD: Starting deletion of primary data.
[2025-10-24T21:18:56.383166] [DEBUG] [LOCAL     ] STWD: No primary data file found to delete.
[2025-10-24T21:18:56.383201] [INFO ] [LOCAL     ] STWD: Starting deletion of derivative data.
[2025-10-24T21:18:56.383382] [DEBUG] [LOCAL     ] STWD: Deleted derivative data file.
[2025-10-24T21:18:56.383733] [INFO ] [MAIN      ] Update Progress: 2014/2366 symbols completed. STWD took 31.6s. Estimated remaining: 45m 15s. Rate: 7.8 symbols/min
[2025-10-24T21:18:56.534697] [INFO ] [REMOTE    ] STXG: Incremental fetch complete for 2025-03 (0.39 seconds).
[2025-10-24T21:18:56.559123] [INFO ] [MAIN      ] STXK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:18:56.563912] [DEBUG] [LOCAL     ] STXK: Loaded 1484 existing records from primary storage.
[2025-10-24T21:18:56.564051] [INFO ] [MAIN      ] STXK: Loaded 1484 existing records.
[2025-10-24T21:18:56.738001] [WARN ] [MAIN      ] STXK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:18:56.738349] [INFO ] [MAIN      ] STXK: Wiping existing primary data before full refresh.
[2025-10-24T21:18:56.738405] [INFO ] [LOCAL     ] STXK: Starting deletion of primary data.
[2025-10-24T21:18:56.738604] [DEBUG] [LOCAL     ] STXK: Deleted primary data file.
[2025-10-24T21:18:56.738698] [INFO ] [MAIN      ] STXK: Starting full primary refresh.
[2025-10-24T21:18:56.952940] [INFO ] [REMOTE    ] STXE: Fetching primary data for 2025-02.
[2025-10-24T21:18:57.089531] [INFO ] [REMOTE    ] STXK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:18:57.747619] [INFO ] [REMOTE    ] STVN: Fetching primary data for 2025-09.
[2025-10-24T21:18:57.786675] [INFO ] [REMOTE    ] STXE: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T21:18:58.432837] [INFO ] [REMOTE    ] STVN: Incremental fetch complete for 2025-09 (0.69 seconds).
[2025-10-24T21:18:58.547626] [INFO ] [REMOTE    ] STXK: Fetching primary data for 2025-01.
[2025-10-24T21:18:58.840255] [INFO ] [REMOTE    ] STXK: Incremental fetch complete for 2025-01 (0.29 seconds).
[2025-10-24T21:18:59.347683] [INFO ] [REMOTE    ] STXG: Fetching primary data for 2025-04.
[2025-10-24T21:18:59.924102] [INFO ] [REMOTE    ] STXG: Incremental fetch complete for 2025-04 (0.58 seconds).
[2025-10-24T21:19:00.147667] [INFO ] [REMOTE    ] STVN: Fetching primary data for 2025-10.
[2025-10-24T21:19:00.947723] [INFO ] [REMOTE    ] STXG: Fetching primary data for 2025-05.
[2025-10-24T21:19:01.112183] [INFO ] [REMOTE    ] STVN: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T21:19:01.117102] [INFO ] [REMOTE    ] STVN: Full fetch complete (39014 records).
[2025-10-24T21:19:01.117190] [DEBUG] [VALIDATOR ] STVN: Validating primary data.
[2025-10-24T21:19:01.117772] [FATAL] [VALIDATOR ] STVN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:19:01.117860] [FATAL] [MAIN      ] STVN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:19:01.117906] [WARN ] [MAIN      ] STVN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:19:01.117984] [INFO ] [LOCAL     ] STVN: Starting deletion of primary data.
[2025-10-24T21:19:01.118068] [DEBUG] [LOCAL     ] STVN: No primary data file found to delete.
[2025-10-24T21:19:01.118106] [INFO ] [LOCAL     ] STVN: Starting deletion of derivative data.
[2025-10-24T21:19:01.118287] [DEBUG] [LOCAL     ] STVN: Deleted derivative data file.
[2025-10-24T21:19:01.118377] [INFO ] [MAIN      ] Update Progress: 2015/2366 symbols completed. STVN took 38.1s. Estimated remaining: 45m 7s. Rate: 7.8 symbols/min
[2025-10-24T21:19:01.300319] [INFO ] [MAIN      ] STXM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:19:01.300553] [DEBUG] [LOCAL     ] STXM: No existing data file found in primary storage.
[2025-10-24T21:19:01.300608] [WARN ] [MAIN      ] STXM: No existing data found, performing full refresh instead.
[2025-10-24T21:19:01.300758] [INFO ] [MAIN      ] STXM: Wiping existing primary data before full refresh.
[2025-10-24T21:19:01.300802] [INFO ] [LOCAL     ] STXM: Starting deletion of primary data.
[2025-10-24T21:19:01.300847] [DEBUG] [LOCAL     ] STXM: No primary data file found to delete.
[2025-10-24T21:19:01.300877] [INFO ] [MAIN      ] STXM: Starting full primary refresh.
[2025-10-24T21:19:01.674586] [INFO ] [REMOTE    ] STXM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:19:01.747727] [INFO ] [REMOTE    ] STXM: Fetching primary data for 2025-01.
[2025-10-24T21:19:01.914619] [INFO ] [REMOTE    ] STXG: Incremental fetch complete for 2025-05 (0.97 seconds).
[2025-10-24T21:19:02.214340] [INFO ] [REMOTE    ] STXM: Incremental fetch complete for 2025-01 (0.47 seconds).
[2025-10-24T21:19:02.547740] [INFO ] [REMOTE    ] STXK: Fetching primary data for 2025-02.
[2025-10-24T21:19:02.852542] [INFO ] [REMOTE    ] STXK: Incremental fetch complete for 2025-02 (0.30 seconds).
[2025-10-24T21:19:03.347638] [INFO ] [REMOTE    ] STXG: Fetching primary data for 2025-06.
[2025-10-24T21:19:03.909100] [INFO ] [REMOTE    ] STXG: Incremental fetch complete for 2025-06 (0.56 seconds).
[2025-10-24T21:19:04.147639] [INFO ] [REMOTE    ] STXG: Fetching primary data for 2025-07.
[2025-10-24T21:19:04.881632] [INFO ] [REMOTE    ] STXG: Incremental fetch complete for 2025-07 (0.73 seconds).
[2025-10-24T21:19:04.947689] [INFO ] [REMOTE    ] STXE: Fetching primary data for 2025-03.
[2025-10-24T21:19:05.318672] [INFO ] [REMOTE    ] STXE: Incremental fetch complete for 2025-03 (0.37 seconds).
[2025-10-24T21:19:05.747713] [INFO ] [REMOTE    ] STXE: Fetching primary data for 2025-04.
[2025-10-24T21:19:06.547727] [INFO ] [REMOTE    ] STXM: Fetching primary data for 2025-02.
[2025-10-24T21:19:06.696710] [INFO ] [REMOTE    ] STXE: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T21:19:07.093707] [INFO ] [REMOTE    ] STXM: Incremental fetch complete for 2025-02 (0.55 seconds).
[2025-10-24T21:19:07.347703] [INFO ] [REMOTE    ] STXM: Fetching primary data for 2025-03.
[2025-10-24T21:19:07.843131] [INFO ] [REMOTE    ] STXM: Incremental fetch complete for 2025-03 (0.50 seconds).
[2025-10-24T21:19:08.147694] [INFO ] [REMOTE    ] STXG: Fetching primary data for 2025-08.
[2025-10-24T21:19:08.721193] [INFO ] [REMOTE    ] STXG: Incremental fetch complete for 2025-08 (0.57 seconds).
[2025-10-24T21:19:08.947722] [INFO ] [REMOTE    ] STXG: Fetching primary data for 2025-09.
[2025-10-24T21:19:09.242530] [INFO ] [REMOTE    ] STXG: Incremental fetch complete for 2025-09 (0.29 seconds).
[2025-10-24T21:19:09.747712] [INFO ] [REMOTE    ] STXK: Fetching primary data for 2025-03.
[2025-10-24T21:19:10.277426] [INFO ] [REMOTE    ] STXK: Incremental fetch complete for 2025-03 (0.53 seconds).
[2025-10-24T21:19:10.547721] [INFO ] [REMOTE    ] STXM: Fetching primary data for 2025-04.
[2025-10-24T21:19:11.063482] [INFO ] [REMOTE    ] STXM: Incremental fetch complete for 2025-04 (0.52 seconds).
[2025-10-24T21:19:11.347616] [INFO ] [REMOTE    ] STXG: Fetching primary data for 2025-10.
[2025-10-24T21:19:12.005697] [INFO ] [REMOTE    ] STXG: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T21:19:12.006623] [INFO ] [REMOTE    ] STXG: Full fetch complete (4018 records).
[2025-10-24T21:19:12.006720] [DEBUG] [VALIDATOR ] STXG: Validating primary data.
[2025-10-24T21:19:12.007080] [FATAL] [VALIDATOR ] STXG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:19:12.007162] [FATAL] [MAIN      ] STXG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:19:12.007205] [WARN ] [MAIN      ] STXG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:19:12.007276] [INFO ] [LOCAL     ] STXG: Starting deletion of primary data.
[2025-10-24T21:19:12.007337] [DEBUG] [LOCAL     ] STXG: No primary data file found to delete.
[2025-10-24T21:19:12.007390] [INFO ] [LOCAL     ] STXG: Starting deletion of derivative data.
[2025-10-24T21:19:12.007554] [DEBUG] [LOCAL     ] STXG: Deleted derivative data file.
[2025-10-24T21:19:12.007664] [INFO ] [MAIN      ] Update Progress: 2016/2366 symbols completed. STXG took 21.9s. Estimated remaining: 44m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:19:12.152884] [INFO ] [REMOTE    ] STXK: Fetching primary data for 2025-04.
[2025-10-24T21:19:12.185030] [INFO ] [MAIN      ] STXT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:19:12.189568] [DEBUG] [LOCAL     ] STXT: Loaded 2533 existing records from primary storage.
[2025-10-24T21:19:12.189779] [INFO ] [MAIN      ] STXT: Loaded 2533 existing records.
[2025-10-24T21:19:12.367769] [WARN ] [MAIN      ] STXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:19:12.367956] [INFO ] [MAIN      ] STXT: Wiping existing primary data before full refresh.
[2025-10-24T21:19:12.368001] [INFO ] [LOCAL     ] STXT: Starting deletion of primary data.
[2025-10-24T21:19:12.368135] [DEBUG] [LOCAL     ] STXT: Deleted primary data file.
[2025-10-24T21:19:12.368176] [INFO ] [MAIN      ] STXT: Starting full primary refresh.
[2025-10-24T21:19:12.737912] [INFO ] [REMOTE    ] STXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:19:12.832265] [INFO ] [REMOTE    ] STXK: Incremental fetch complete for 2025-04 (0.68 seconds).
[2025-10-24T21:19:12.947691] [INFO ] [REMOTE    ] STXE: Fetching primary data for 2025-05.
[2025-10-24T21:19:13.245566] [INFO ] [REMOTE    ] STXE: Incremental fetch complete for 2025-05 (0.30 seconds).
[2025-10-24T21:19:13.747711] [INFO ] [REMOTE    ] STXT: Fetching primary data for 2025-01.
[2025-10-24T21:19:14.514512] [INFO ] [REMOTE    ] STXT: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T21:19:14.547705] [INFO ] [REMOTE    ] STXT: Fetching primary data for 2025-02.
[2025-10-24T21:19:14.838200] [INFO ] [REMOTE    ] STXT: Incremental fetch complete for 2025-02 (0.29 seconds).
[2025-10-24T21:19:15.347690] [INFO ] [REMOTE    ] STXT: Fetching primary data for 2025-03.
[2025-10-24T21:19:16.147710] [INFO ] [REMOTE    ] STXM: Fetching primary data for 2025-05.
[2025-10-24T21:19:16.153848] [INFO ] [REMOTE    ] STXT: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T21:19:16.639830] [INFO ] [REMOTE    ] STXM: Incremental fetch complete for 2025-05 (0.49 seconds).
[2025-10-24T21:19:16.947622] [INFO ] [REMOTE    ] STXT: Fetching primary data for 2025-04.
[2025-10-24T21:19:17.533194] [INFO ] [REMOTE    ] STXT: Incremental fetch complete for 2025-04 (0.59 seconds).
[2025-10-24T21:19:17.747681] [INFO ] [REMOTE    ] STXT: Fetching primary data for 2025-05.
[2025-10-24T21:19:18.281107] [INFO ] [REMOTE    ] STXT: Incremental fetch complete for 2025-05 (0.53 seconds).
[2025-10-24T21:19:18.547704] [INFO ] [REMOTE    ] STXE: Fetching primary data for 2025-06.
[2025-10-24T21:19:18.862030] [INFO ] [REMOTE    ] STXE: Incremental fetch complete for 2025-06 (0.31 seconds).
[2025-10-24T21:19:19.347725] [INFO ] [REMOTE    ] STXM: Fetching primary data for 2025-06.
[2025-10-24T21:19:19.593591] [INFO ] [REMOTE    ] STXM: Incremental fetch complete for 2025-06 (0.25 seconds).
[2025-10-24T21:19:20.147633] [INFO ] [REMOTE    ] STXT: Fetching primary data for 2025-06.
[2025-10-24T21:19:20.617820] [INFO ] [REMOTE    ] STXT: Incremental fetch complete for 2025-06 (0.47 seconds).
[2025-10-24T21:19:20.947609] [INFO ] [REMOTE    ] STXE: Fetching primary data for 2025-07.
[2025-10-24T21:19:21.233506] [INFO ] [REMOTE    ] STXE: Incremental fetch complete for 2025-07 (0.29 seconds).
[2025-10-24T21:19:21.747723] [INFO ] [REMOTE    ] STXK: Fetching primary data for 2025-05.
[2025-10-24T21:19:22.259873] [INFO ] [REMOTE    ] STXK: Incremental fetch complete for 2025-05 (0.51 seconds).
[2025-10-24T21:19:22.547701] [INFO ] [REMOTE    ] STXT: Fetching primary data for 2025-07.
[2025-10-24T21:19:23.347725] [INFO ] [REMOTE    ] STXM: Fetching primary data for 2025-07.
[2025-10-24T21:19:23.571324] [INFO ] [REMOTE    ] STXM: Incremental fetch complete for 2025-07 (0.22 seconds).
[2025-10-24T21:19:23.581916] [INFO ] [REMOTE    ] STXT: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T21:19:24.147718] [INFO ] [REMOTE    ] STXE: Fetching primary data for 2025-08.
[2025-10-24T21:19:24.947694] [INFO ] [REMOTE    ] STXM: Fetching primary data for 2025-08.
[2025-10-24T21:19:25.114680] [INFO ] [REMOTE    ] STXE: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T21:19:25.450588] [INFO ] [REMOTE    ] STXM: Incremental fetch complete for 2025-08 (0.50 seconds).
[2025-10-24T21:19:25.747722] [INFO ] [REMOTE    ] STXE: Fetching primary data for 2025-09.
[2025-10-24T21:19:26.438576] [INFO ] [REMOTE    ] STXE: Incremental fetch complete for 2025-09 (0.69 seconds).
[2025-10-24T21:19:26.547749] [INFO ] [REMOTE    ] STXT: Fetching primary data for 2025-08.
[2025-10-24T21:19:27.071854] [INFO ] [REMOTE    ] STXT: Incremental fetch complete for 2025-08 (0.52 seconds).
[2025-10-24T21:19:27.347712] [INFO ] [REMOTE    ] STXE: Fetching primary data for 2025-10.
[2025-10-24T21:19:27.871056] [INFO ] [REMOTE    ] STXE: Incremental fetch complete for 2025-10 (0.52 seconds).
[2025-10-24T21:19:27.872306] [INFO ] [REMOTE    ] STXE: Full fetch complete (3449 records).
[2025-10-24T21:19:27.872382] [DEBUG] [VALIDATOR ] STXE: Validating primary data.
[2025-10-24T21:19:27.872872] [FATAL] [VALIDATOR ] STXE: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:19:27.873110] [FATAL] [MAIN      ] STXE: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:19:27.873183] [WARN ] [MAIN      ] STXE: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:19:27.873259] [INFO ] [LOCAL     ] STXE: Starting deletion of primary data.
[2025-10-24T21:19:27.873331] [DEBUG] [LOCAL     ] STXE: No primary data file found to delete.
[2025-10-24T21:19:27.873369] [INFO ] [LOCAL     ] STXE: Starting deletion of derivative data.
[2025-10-24T21:19:27.873550] [DEBUG] [LOCAL     ] STXE: Deleted derivative data file.
[2025-10-24T21:19:27.873636] [INFO ] [MAIN      ] Update Progress: 2017/2366 symbols completed. STXE took 39.8s. Estimated remaining: 44m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:19:28.054985] [INFO ] [MAIN      ] STXV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:19:28.058611] [DEBUG] [LOCAL     ] STXV: Loaded 1474 existing records from primary storage.
[2025-10-24T21:19:28.058797] [INFO ] [MAIN      ] STXV: Loaded 1474 existing records.
[2025-10-24T21:19:28.152913] [INFO ] [REMOTE    ] STXM: Fetching primary data for 2025-09.
[2025-10-24T21:19:28.254836] [WARN ] [MAIN      ] STXV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:19:28.255119] [INFO ] [MAIN      ] STXV: Wiping existing primary data before full refresh.
[2025-10-24T21:19:28.255173] [INFO ] [LOCAL     ] STXV: Starting deletion of primary data.
[2025-10-24T21:19:28.255340] [DEBUG] [LOCAL     ] STXV: Deleted primary data file.
[2025-10-24T21:19:28.255397] [INFO ] [MAIN      ] STXV: Starting full primary refresh.
[2025-10-24T21:19:28.644121] [INFO ] [REMOTE    ] STXV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:19:28.802510] [INFO ] [REMOTE    ] STXM: Incremental fetch complete for 2025-09 (0.65 seconds).
[2025-10-24T21:19:28.947634] [INFO ] [REMOTE    ] STXT: Fetching primary data for 2025-09.
[2025-10-24T21:19:29.249313] [INFO ] [REMOTE    ] STXT: Incremental fetch complete for 2025-09 (0.30 seconds).
[2025-10-24T21:19:29.747695] [INFO ] [REMOTE    ] STXT: Fetching primary data for 2025-10.
[2025-10-24T21:19:30.400448] [INFO ] [REMOTE    ] STXT: Incremental fetch complete for 2025-10 (0.65 seconds).
[2025-10-24T21:19:30.401689] [INFO ] [REMOTE    ] STXT: Full fetch complete (3846 records).
[2025-10-24T21:19:30.401763] [DEBUG] [VALIDATOR ] STXT: Validating primary data.
[2025-10-24T21:19:30.402121] [FATAL] [VALIDATOR ] STXT: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:19:30.402231] [FATAL] [MAIN      ] STXT: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:19:30.402304] [WARN ] [MAIN      ] STXT: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:19:30.402405] [INFO ] [LOCAL     ] STXT: Starting deletion of primary data.
[2025-10-24T21:19:30.402495] [DEBUG] [LOCAL     ] STXT: No primary data file found to delete.
[2025-10-24T21:19:30.402571] [INFO ] [LOCAL     ] STXT: Starting deletion of derivative data.
[2025-10-24T21:19:30.402940] [DEBUG] [LOCAL     ] STXT: Deleted derivative data file.
[2025-10-24T21:19:30.403061] [INFO ] [MAIN      ] Update Progress: 2018/2366 symbols completed. STXT took 18.4s. Estimated remaining: 44m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:19:30.552797] [INFO ] [REMOTE    ] STXK: Fetching primary data for 2025-06.
[2025-10-24T21:19:30.607988] [INFO ] [MAIN      ] STZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:19:30.665069] [DEBUG] [LOCAL     ] STZ: Loaded 52805 existing records from primary storage.
[2025-10-24T21:19:30.665414] [INFO ] [MAIN      ] STZ: Loaded 52805 existing records.
[2025-10-24T21:19:30.870008] [WARN ] [MAIN      ] STZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:19:30.870269] [INFO ] [MAIN      ] STZ: Wiping existing primary data before full refresh.
[2025-10-24T21:19:30.870321] [INFO ] [LOCAL     ] STZ: Starting deletion of primary data.
[2025-10-24T21:19:30.870990] [DEBUG] [LOCAL     ] STZ: Deleted primary data file.
[2025-10-24T21:19:30.871046] [INFO ] [MAIN      ] STZ: Starting full primary refresh.
[2025-10-24T21:19:31.244219] [INFO ] [REMOTE    ] STZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:19:31.337138] [INFO ] [REMOTE    ] STXK: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T21:19:31.347593] [INFO ] [REMOTE    ] STXK: Fetching primary data for 2025-07.
[2025-10-24T21:19:31.866497] [INFO ] [REMOTE    ] STXK: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T21:19:32.147667] [INFO ] [REMOTE    ] STXV: Fetching primary data for 2025-01.
[2025-10-24T21:19:32.680287] [INFO ] [REMOTE    ] STXV: Incremental fetch complete for 2025-01 (0.53 seconds).
[2025-10-24T21:19:32.947692] [INFO ] [REMOTE    ] STXV: Fetching primary data for 2025-02.
[2025-10-24T21:19:33.249577] [INFO ] [REMOTE    ] STXV: Incremental fetch complete for 2025-02 (0.30 seconds).
[2025-10-24T21:19:33.747710] [INFO ] [REMOTE    ] STXK: Fetching primary data for 2025-08.
[2025-10-24T21:19:34.140922] [INFO ] [REMOTE    ] STXK: Incremental fetch complete for 2025-08 (0.39 seconds).
[2025-10-24T21:19:34.547736] [INFO ] [REMOTE    ] STXK: Fetching primary data for 2025-09.
[2025-10-24T21:19:34.771843] [INFO ] [REMOTE    ] STXK: Incremental fetch complete for 2025-09 (0.22 seconds).
[2025-10-24T21:19:35.347673] [INFO ] [REMOTE    ] STXK: Fetching primary data for 2025-10.
[2025-10-24T21:19:35.760217] [INFO ] [REMOTE    ] STXK: Incremental fetch complete for 2025-10 (0.41 seconds).
[2025-10-24T21:19:35.761473] [INFO ] [REMOTE    ] STXK: Full fetch complete (2362 records).
[2025-10-24T21:19:35.761583] [DEBUG] [VALIDATOR ] STXK: Validating primary data.
[2025-10-24T21:19:35.762055] [FATAL] [VALIDATOR ] STXK: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:19:35.762260] [FATAL] [MAIN      ] STXK: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:19:35.762361] [WARN ] [MAIN      ] STXK: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:19:35.762447] [INFO ] [LOCAL     ] STXK: Starting deletion of primary data.
[2025-10-24T21:19:35.762523] [DEBUG] [LOCAL     ] STXK: No primary data file found to delete.
[2025-10-24T21:19:35.762574] [INFO ] [LOCAL     ] STXK: Starting deletion of derivative data.
[2025-10-24T21:19:35.762760] [DEBUG] [LOCAL     ] STXK: Deleted derivative data file.
[2025-10-24T21:19:35.762861] [INFO ] [MAIN      ] Update Progress: 2019/2366 symbols completed. STXK took 39.4s. Estimated remaining: 44m 36s. Rate: 7.8 symbols/min
[2025-10-24T21:19:35.939747] [INFO ] [MAIN      ] SU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:19:35.988736] [DEBUG] [LOCAL     ] SU: Loaded 53820 existing records from primary storage.
[2025-10-24T21:19:35.989061] [INFO ] [MAIN      ] SU: Loaded 53820 existing records.
[2025-10-24T21:19:36.165341] [WARN ] [MAIN      ] SU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:19:36.152883] [INFO ] [REMOTE    ] STXV: Fetching primary data for 2025-03.
[2025-10-24T21:19:36.166340] [INFO ] [MAIN      ] SU: Wiping existing primary data before full refresh.
[2025-10-24T21:19:36.166401] [INFO ] [LOCAL     ] SU: Starting deletion of primary data.
[2025-10-24T21:19:36.166939] [DEBUG] [LOCAL     ] SU: Deleted primary data file.
[2025-10-24T21:19:36.166994] [INFO ] [MAIN      ] SU: Starting full primary refresh.
[2025-10-24T21:19:36.521954] [INFO ] [REMOTE    ] SU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:19:36.947617] [INFO ] [REMOTE    ] STZ: Fetching primary data for 2025-01.
[2025-10-24T21:19:37.019035] [INFO ] [REMOTE    ] STXV: Incremental fetch complete for 2025-03 (0.87 seconds).
[2025-10-24T21:19:37.747698] [INFO ] [REMOTE    ] STXM: Fetching primary data for 2025-10.
[2025-10-24T21:19:37.955713] [INFO ] [REMOTE    ] STZ: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T21:19:37.968609] [INFO ] [REMOTE    ] STXM: Incremental fetch complete for 2025-10 (0.22 seconds).
[2025-10-24T21:19:37.969555] [INFO ] [REMOTE    ] STXM: Full fetch complete (1367 records).
[2025-10-24T21:19:37.969669] [DEBUG] [VALIDATOR ] STXM: Validating primary data.
[2025-10-24T21:19:37.970115] [FATAL] [VALIDATOR ] STXM: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:19:37.970219] [FATAL] [MAIN      ] STXM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:19:37.970277] [WARN ] [MAIN      ] STXM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:19:37.970355] [INFO ] [LOCAL     ] STXM: Starting deletion of primary data.
[2025-10-24T21:19:37.970432] [DEBUG] [LOCAL     ] STXM: No primary data file found to delete.
[2025-10-24T21:19:37.970484] [INFO ] [LOCAL     ] STXM: Starting deletion of derivative data.
[2025-10-24T21:19:37.970543] [DEBUG] [LOCAL     ] STXM: No derivative data file found to delete.
[2025-10-24T21:19:37.970613] [INFO ] [MAIN      ] Update Progress: 2020/2366 symbols completed. STXM took 36.9s. Estimated remaining: 44m 28s. Rate: 7.8 symbols/min
[2025-10-24T21:19:38.152444] [INFO ] [MAIN      ] SUI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:19:38.191509] [DEBUG] [LOCAL     ] SUI: Loaded 42165 existing records from primary storage.
[2025-10-24T21:19:38.191817] [INFO ] [MAIN      ] SUI: Loaded 42165 existing records.
[2025-10-24T21:19:38.366063] [WARN ] [MAIN      ] SUI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:19:38.366230] [INFO ] [MAIN      ] SUI: Wiping existing primary data before full refresh.
[2025-10-24T21:19:38.366274] [INFO ] [LOCAL     ] SUI: Starting deletion of primary data.
[2025-10-24T21:19:38.366828] [DEBUG] [LOCAL     ] SUI: Deleted primary data file.
[2025-10-24T21:19:38.366883] [INFO ] [MAIN      ] SUI: Starting full primary refresh.
[2025-10-24T21:19:38.553919] [INFO ] [REMOTE    ] STXV: Fetching primary data for 2025-04.
[2025-10-24T21:19:38.720959] [INFO ] [REMOTE    ] SUI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:19:39.058236] [INFO ] [REMOTE    ] STXV: Incremental fetch complete for 2025-04 (0.50 seconds).
[2025-10-24T21:19:39.347619] [INFO ] [REMOTE    ] SUI: Fetching primary data for 2025-01.
[2025-10-24T21:19:40.149311] [INFO ] [REMOTE    ] STZ: Fetching primary data for 2025-02.
[2025-10-24T21:19:40.154166] [INFO ] [REMOTE    ] SUI: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T21:19:40.947634] [INFO ] [REMOTE    ] SU: Fetching primary data for 2025-01.
[2025-10-24T21:19:41.164152] [INFO ] [REMOTE    ] STZ: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T21:19:41.747636] [INFO ] [REMOTE    ] STXV: Fetching primary data for 2025-05.
[2025-10-24T21:19:42.042034] [INFO ] [REMOTE    ] STXV: Incremental fetch complete for 2025-05 (0.29 seconds).
[2025-10-24T21:19:42.211833] [INFO ] [REMOTE    ] SU: Incremental fetch complete for 2025-01 (1.26 seconds).
[2025-10-24T21:19:42.547701] [INFO ] [REMOTE    ] STZ: Fetching primary data for 2025-03.
[2025-10-24T21:19:43.347719] [INFO ] [REMOTE    ] SU: Fetching primary data for 2025-02.
[2025-10-24T21:19:43.639596] [INFO ] [REMOTE    ] STZ: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T21:19:44.132596] [INFO ] [REMOTE    ] SU: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T21:19:44.147596] [INFO ] [REMOTE    ] SU: Fetching primary data for 2025-03.
[2025-10-24T21:19:44.947669] [INFO ] [REMOTE    ] STZ: Fetching primary data for 2025-04.
[2025-10-24T21:19:45.257040] [INFO ] [REMOTE    ] SU: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T21:19:45.335276] [INFO ] [REMOTE    ] STZ: Incremental fetch complete for 2025-04 (0.39 seconds).
[2025-10-24T21:19:45.747683] [INFO ] [REMOTE    ] STXV: Fetching primary data for 2025-06.
[2025-10-24T21:19:46.099615] [INFO ] [REMOTE    ] STXV: Incremental fetch complete for 2025-06 (0.35 seconds).
[2025-10-24T21:19:46.547768] [INFO ] [REMOTE    ] STZ: Fetching primary data for 2025-05.
[2025-10-24T21:19:47.347728] [INFO ] [REMOTE    ] SUI: Fetching primary data for 2025-02.
[2025-10-24T21:19:47.543192] [INFO ] [REMOTE    ] STZ: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T21:19:48.147695] [INFO ] [REMOTE    ] STXV: Fetching primary data for 2025-07.
[2025-10-24T21:19:48.412558] [INFO ] [REMOTE    ] SUI: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T21:19:48.443465] [INFO ] [REMOTE    ] STXV: Incremental fetch complete for 2025-07 (0.30 seconds).
[2025-10-24T21:19:48.947709] [INFO ] [REMOTE    ] SUI: Fetching primary data for 2025-03.
[2025-10-24T21:19:49.700632] [INFO ] [REMOTE    ] SUI: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T21:19:49.747608] [INFO ] [REMOTE    ] SU: Fetching primary data for 2025-04.
[2025-10-24T21:19:50.547621] [INFO ] [REMOTE    ] STZ: Fetching primary data for 2025-06.
[2025-10-24T21:19:50.899463] [INFO ] [REMOTE    ] SU: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T21:19:51.347715] [INFO ] [REMOTE    ] SU: Fetching primary data for 2025-05.
[2025-10-24T21:19:51.407272] [INFO ] [REMOTE    ] STZ: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T21:19:52.147716] [INFO ] [REMOTE    ] SUI: Fetching primary data for 2025-04.
[2025-10-24T21:19:52.711275] [INFO ] [REMOTE    ] SU: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T21:19:52.895548] [INFO ] [REMOTE    ] SUI: Incremental fetch complete for 2025-04 (0.75 seconds).
[2025-10-24T21:19:52.947626] [INFO ] [REMOTE    ] SUI: Fetching primary data for 2025-05.
[2025-10-24T21:19:53.747625] [INFO ] [REMOTE    ] STXV: Fetching primary data for 2025-08.
[2025-10-24T21:19:54.064345] [INFO ] [REMOTE    ] SUI: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T21:19:54.450974] [INFO ] [REMOTE    ] STXV: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T21:19:54.547667] [INFO ] [REMOTE    ] STZ: Fetching primary data for 2025-07.
[2025-10-24T21:19:55.347683] [INFO ] [REMOTE    ] STXV: Fetching primary data for 2025-09.
[2025-10-24T21:19:55.648317] [INFO ] [REMOTE    ] STXV: Incremental fetch complete for 2025-09 (0.30 seconds).
[2025-10-24T21:19:55.748842] [INFO ] [REMOTE    ] STZ: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T21:19:56.147719] [INFO ] [REMOTE    ] STZ: Fetching primary data for 2025-08.
[2025-10-24T21:19:56.947717] [INFO ] [REMOTE    ] SUI: Fetching primary data for 2025-06.
[2025-10-24T21:19:57.496404] [INFO ] [REMOTE    ] STZ: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T21:19:57.747732] [INFO ] [REMOTE    ] STZ: Fetching primary data for 2025-09.
[2025-10-24T21:19:57.791369] [INFO ] [REMOTE    ] SUI: Incremental fetch complete for 2025-06 (0.84 seconds).
[2025-10-24T21:19:58.547717] [INFO ] [REMOTE    ] SUI: Fetching primary data for 2025-07.
[2025-10-24T21:19:58.614449] [INFO ] [REMOTE    ] STZ: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T21:19:59.347727] [INFO ] [REMOTE    ] STZ: Fetching primary data for 2025-10.
[2025-10-24T21:19:59.420980] [INFO ] [REMOTE    ] SUI: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T21:20:00.096953] [INFO ] [REMOTE    ] STZ: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T21:20:00.107007] [INFO ] [REMOTE    ] STZ: Full fetch complete (75831 records).
[2025-10-24T21:20:00.107156] [DEBUG] [VALIDATOR ] STZ: Validating primary data.
[2025-10-24T21:20:00.107982] [FATAL] [VALIDATOR ] STZ: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:20:00.108081] [FATAL] [MAIN      ] STZ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:20:00.108124] [WARN ] [MAIN      ] STZ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:20:00.108165] [INFO ] [LOCAL     ] STZ: Starting deletion of primary data.
[2025-10-24T21:20:00.108221] [DEBUG] [LOCAL     ] STZ: No primary data file found to delete.
[2025-10-24T21:20:00.108256] [INFO ] [LOCAL     ] STZ: Starting deletion of derivative data.
[2025-10-24T21:20:00.108463] [DEBUG] [LOCAL     ] STZ: Deleted derivative data file.
[2025-10-24T21:20:00.108787] [INFO ] [MAIN      ] Update Progress: 2021/2366 symbols completed. STZ took 29.7s. Estimated remaining: 44m 23s. Rate: 7.8 symbols/min
[2025-10-24T21:20:00.152974] [INFO ] [REMOTE    ] SU: Fetching primary data for 2025-06.
[2025-10-24T21:20:00.286786] [INFO ] [MAIN      ] SUN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:20:00.324156] [DEBUG] [LOCAL     ] SUN: Loaded 39054 existing records from primary storage.
[2025-10-24T21:20:00.324440] [INFO ] [MAIN      ] SUN: Loaded 39054 existing records.
[2025-10-24T21:20:00.504625] [WARN ] [MAIN      ] SUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:20:00.504994] [INFO ] [MAIN      ] SUN: Wiping existing primary data before full refresh.
[2025-10-24T21:20:00.505042] [INFO ] [LOCAL     ] SUN: Starting deletion of primary data.
[2025-10-24T21:20:00.505492] [DEBUG] [LOCAL     ] SUN: Deleted primary data file.
[2025-10-24T21:20:00.505551] [INFO ] [MAIN      ] SUN: Starting full primary refresh.
[2025-10-24T21:20:00.871515] [INFO ] [REMOTE    ] SUN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:20:00.947607] [INFO ] [REMOTE    ] SUN: Fetching primary data for 2025-01.
[2025-10-24T21:20:01.225096] [INFO ] [REMOTE    ] SU: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T21:20:01.692584] [INFO ] [REMOTE    ] SUN: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T21:20:01.747662] [INFO ] [REMOTE    ] STXV: Fetching primary data for 2025-10.
[2025-10-24T21:20:02.084616] [INFO ] [REMOTE    ] STXV: Incremental fetch complete for 2025-10 (0.34 seconds).
[2025-10-24T21:20:02.085439] [INFO ] [REMOTE    ] STXV: Full fetch complete (2510 records).
[2025-10-24T21:20:02.085509] [DEBUG] [VALIDATOR ] STXV: Validating primary data.
[2025-10-24T21:20:02.085880] [FATAL] [VALIDATOR ] STXV: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:20:02.085980] [FATAL] [MAIN      ] STXV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:20:02.086023] [WARN ] [MAIN      ] STXV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:20:02.086090] [INFO ] [LOCAL     ] STXV: Starting deletion of primary data.
[2025-10-24T21:20:02.086152] [DEBUG] [LOCAL     ] STXV: No primary data file found to delete.
[2025-10-24T21:20:02.086189] [INFO ] [LOCAL     ] STXV: Starting deletion of derivative data.
[2025-10-24T21:20:02.086521] [DEBUG] [LOCAL     ] STXV: Deleted derivative data file.
[2025-10-24T21:20:02.086606] [INFO ] [MAIN      ] Update Progress: 2022/2366 symbols completed. STXV took 34.2s. Estimated remaining: 44m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:20:02.277578] [INFO ] [MAIN      ] SUPV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:20:02.322681] [DEBUG] [LOCAL     ] SUPV: Loaded 48430 existing records from primary storage.
[2025-10-24T21:20:02.322997] [INFO ] [MAIN      ] SUPV: Loaded 48430 existing records.
[2025-10-24T21:20:02.504849] [WARN ] [MAIN      ] SUPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:20:02.505091] [INFO ] [MAIN      ] SUPV: Wiping existing primary data before full refresh.
[2025-10-24T21:20:02.505138] [INFO ] [LOCAL     ] SUPV: Starting deletion of primary data.
[2025-10-24T21:20:02.505613] [DEBUG] [LOCAL     ] SUPV: Deleted primary data file.
[2025-10-24T21:20:02.505709] [INFO ] [MAIN      ] SUPV: Starting full primary refresh.
[2025-10-24T21:20:02.552732] [INFO ] [REMOTE    ] SUI: Fetching primary data for 2025-08.
[2025-10-24T21:20:02.875493] [INFO ] [REMOTE    ] SUPV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:20:03.347615] [INFO ] [REMOTE    ] SUN: Fetching primary data for 2025-02.
[2025-10-24T21:20:03.421299] [INFO ] [REMOTE    ] SUI: Incremental fetch complete for 2025-08 (0.87 seconds).
[2025-10-24T21:20:04.147614] [INFO ] [REMOTE    ] SUPV: Fetching primary data for 2025-01.
[2025-10-24T21:20:04.556796] [INFO ] [REMOTE    ] SUN: Incremental fetch complete for 2025-02 (1.21 seconds).
[2025-10-24T21:20:04.932209] [INFO ] [REMOTE    ] SUPV: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T21:20:04.947594] [INFO ] [REMOTE    ] SUPV: Fetching primary data for 2025-02.
[2025-10-24T21:20:05.712509] [INFO ] [REMOTE    ] SUPV: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T21:20:05.747612] [INFO ] [REMOTE    ] SUPV: Fetching primary data for 2025-03.
[2025-10-24T21:20:06.547633] [INFO ] [REMOTE    ] SUN: Fetching primary data for 2025-03.
[2025-10-24T21:20:06.574755] [INFO ] [REMOTE    ] SUPV: Incremental fetch complete for 2025-03 (0.83 seconds).
[2025-10-24T21:20:07.347618] [INFO ] [REMOTE    ] SU: Fetching primary data for 2025-07.
[2025-10-24T21:20:07.520490] [INFO ] [REMOTE    ] SUN: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T21:20:08.147626] [INFO ] [REMOTE    ] SUN: Fetching primary data for 2025-04.
[2025-10-24T21:20:08.239934] [INFO ] [REMOTE    ] SU: Incremental fetch complete for 2025-07 (0.89 seconds).
[2025-10-24T21:20:08.864660] [INFO ] [REMOTE    ] SUN: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T21:20:08.947614] [INFO ] [REMOTE    ] SUPV: Fetching primary data for 2025-04.
[2025-10-24T21:20:09.747625] [INFO ] [REMOTE    ] SU: Fetching primary data for 2025-08.
[2025-10-24T21:20:09.782572] [INFO ] [REMOTE    ] SUPV: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T21:20:10.547677] [INFO ] [REMOTE    ] SUN: Fetching primary data for 2025-05.
[2025-10-24T21:20:10.593547] [INFO ] [REMOTE    ] SU: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T21:20:11.280753] [INFO ] [REMOTE    ] SUN: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T21:20:11.347627] [INFO ] [REMOTE    ] SU: Fetching primary data for 2025-09.
[2025-10-24T21:20:12.147689] [INFO ] [REMOTE    ] SUPV: Fetching primary data for 2025-05.
[2025-10-24T21:20:12.359837] [INFO ] [REMOTE    ] SU: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T21:20:12.947712] [INFO ] [REMOTE    ] SUI: Fetching primary data for 2025-09.
[2025-10-24T21:20:13.108759] [INFO ] [REMOTE    ] SUPV: Incremental fetch complete for 2025-05 (0.96 seconds).
[2025-10-24T21:20:13.741416] [INFO ] [REMOTE    ] SUI: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T21:20:13.749705] [INFO ] [REMOTE    ] SUN: Fetching primary data for 2025-06.
[2025-10-24T21:20:14.547724] [INFO ] [REMOTE    ] SUI: Fetching primary data for 2025-10.
[2025-10-24T21:20:14.846371] [INFO ] [REMOTE    ] SUN: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T21:20:15.347664] [INFO ] [REMOTE    ] SU: Fetching primary data for 2025-10.
[2025-10-24T21:20:15.500928] [INFO ] [REMOTE    ] SUI: Incremental fetch complete for 2025-10 (0.95 seconds).
[2025-10-24T21:20:15.508166] [INFO ] [REMOTE    ] SUI: Full fetch complete (60467 records).
[2025-10-24T21:20:15.508268] [DEBUG] [VALIDATOR ] SUI: Validating primary data.
[2025-10-24T21:20:15.508990] [FATAL] [VALIDATOR ] SUI: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:20:15.509073] [FATAL] [MAIN      ] SUI: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:20:15.509115] [WARN ] [MAIN      ] SUI: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:20:15.509178] [INFO ] [LOCAL     ] SUI: Starting deletion of primary data.
[2025-10-24T21:20:15.509241] [DEBUG] [LOCAL     ] SUI: No primary data file found to delete.
[2025-10-24T21:20:15.509275] [INFO ] [LOCAL     ] SUI: Starting deletion of derivative data.
[2025-10-24T21:20:15.509457] [DEBUG] [LOCAL     ] SUI: Deleted derivative data file.
[2025-10-24T21:20:15.509710] [INFO ] [MAIN      ] Update Progress: 2023/2366 symbols completed. SUI took 37.5s. Estimated remaining: 44m 7s. Rate: 7.8 symbols/min
[2025-10-24T21:20:15.677016] [INFO ] [MAIN      ] SUZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:20:15.717959] [DEBUG] [LOCAL     ] SUZ: Loaded 45832 existing records from primary storage.
[2025-10-24T21:20:15.718316] [INFO ] [MAIN      ] SUZ: Loaded 45832 existing records.
[2025-10-24T21:20:15.903554] [WARN ] [MAIN      ] SUZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:20:15.904173] [INFO ] [MAIN      ] SUZ: Wiping existing primary data before full refresh.
[2025-10-24T21:20:15.904332] [INFO ] [LOCAL     ] SUZ: Starting deletion of primary data.
[2025-10-24T21:20:15.913684] [DEBUG] [LOCAL     ] SUZ: Deleted primary data file.
[2025-10-24T21:20:15.925794] [INFO ] [MAIN      ] SUZ: Starting full primary refresh.
[2025-10-24T21:20:16.005045] [INFO ] [REMOTE    ] SU: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T21:20:16.051469] [INFO ] [REMOTE    ] SU: Full fetch complete (77180 records).
[2025-10-24T21:20:16.067025] [DEBUG] [VALIDATOR ] SU: Validating primary data.
[2025-10-24T21:20:16.098569] [FATAL] [VALIDATOR ] SU: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:20:16.114104] [FATAL] [MAIN      ] SU: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:20:16.115237] [WARN ] [MAIN      ] SU: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:20:16.154306] [INFO ] [REMOTE    ] SUPV: Fetching primary data for 2025-06.
[2025-10-24T21:20:16.172177] [INFO ] [LOCAL     ] SU: Starting deletion of primary data.
[2025-10-24T21:20:16.193345] [DEBUG] [LOCAL     ] SU: No primary data file found to delete.
[2025-10-24T21:20:16.198682] [INFO ] [LOCAL     ] SU: Starting deletion of derivative data.
[2025-10-24T21:20:16.219932] [DEBUG] [LOCAL     ] SU: Deleted derivative data file.
[2025-10-24T21:20:16.220371] [INFO ] [MAIN      ] Update Progress: 2024/2366 symbols completed. SU took 40.5s. Estimated remaining: 43m 58s. Rate: 7.8 symbols/min
[2025-10-24T21:20:16.446093] [INFO ] [REMOTE    ] SUZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:20:16.509955] [INFO ] [MAIN      ] SVV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:20:16.548841] [DEBUG] [LOCAL     ] SVV: Loaded 40525 existing records from primary storage.
[2025-10-24T21:20:16.549129] [INFO ] [MAIN      ] SVV: Loaded 40525 existing records.
[2025-10-24T21:20:16.737226] [WARN ] [MAIN      ] SVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:20:16.737446] [INFO ] [MAIN      ] SVV: Wiping existing primary data before full refresh.
[2025-10-24T21:20:16.737492] [INFO ] [LOCAL     ] SVV: Starting deletion of primary data.
[2025-10-24T21:20:16.737935] [DEBUG] [LOCAL     ] SVV: Deleted primary data file.
[2025-10-24T21:20:16.737991] [INFO ] [MAIN      ] SVV: Starting full primary refresh.
[2025-10-24T21:20:16.952854] [INFO ] [REMOTE    ] SUN: Fetching primary data for 2025-07.
[2025-10-24T21:20:17.123493] [INFO ] [REMOTE    ] SVV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:20:17.153365] [INFO ] [REMOTE    ] SUPV: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T21:20:17.747749] [INFO ] [REMOTE    ] SVV: Fetching primary data for 2025-01.
[2025-10-24T21:20:17.991068] [INFO ] [REMOTE    ] SUN: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T21:20:18.547691] [INFO ] [REMOTE    ] SUZ: Fetching primary data for 2025-01.
[2025-10-24T21:20:18.743427] [INFO ] [REMOTE    ] SVV: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T21:20:19.347748] [INFO ] [REMOTE    ] SUPV: Fetching primary data for 2025-07.
[2025-10-24T21:20:19.643020] [INFO ] [REMOTE    ] SUZ: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T21:20:20.147729] [INFO ] [REMOTE    ] SVV: Fetching primary data for 2025-02.
[2025-10-24T21:20:20.696183] [INFO ] [REMOTE    ] SUPV: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T21:20:20.851750] [INFO ] [REMOTE    ] SVV: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T21:20:20.947608] [INFO ] [REMOTE    ] SVV: Fetching primary data for 2025-03.
[2025-10-24T21:20:21.747611] [INFO ] [REMOTE    ] SUN: Fetching primary data for 2025-08.
[2025-10-24T21:20:21.849562] [INFO ] [REMOTE    ] SVV: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T21:20:22.207896] [INFO ] [REMOTE    ] SUN: Incremental fetch complete for 2025-08 (0.46 seconds).
[2025-10-24T21:20:22.547720] [INFO ] [REMOTE    ] SUN: Fetching primary data for 2025-09.
[2025-10-24T21:20:23.288868] [INFO ] [REMOTE    ] SUN: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T21:20:23.347661] [INFO ] [REMOTE    ] SUN: Fetching primary data for 2025-10.
[2025-10-24T21:20:24.147687] [INFO ] [REMOTE    ] SUZ: Fetching primary data for 2025-02.
[2025-10-24T21:20:24.576314] [INFO ] [REMOTE    ] SUN: Incremental fetch complete for 2025-10 (1.23 seconds).
[2025-10-24T21:20:24.583740] [INFO ] [REMOTE    ] SUN: Full fetch complete (55428 records).
[2025-10-24T21:20:24.583922] [DEBUG] [VALIDATOR ] SUN: Validating primary data.
[2025-10-24T21:20:24.584771] [FATAL] [VALIDATOR ] SUN: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:20:24.584857] [FATAL] [MAIN      ] SUN: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:20:24.584924] [WARN ] [MAIN      ] SUN: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:20:24.584999] [INFO ] [LOCAL     ] SUN: Starting deletion of primary data.
[2025-10-24T21:20:24.585063] [DEBUG] [LOCAL     ] SUN: No primary data file found to delete.
[2025-10-24T21:20:24.585101] [INFO ] [LOCAL     ] SUN: Starting deletion of derivative data.
[2025-10-24T21:20:24.585268] [DEBUG] [LOCAL     ] SUN: Deleted derivative data file.
[2025-10-24T21:20:24.585567] [INFO ] [MAIN      ] Update Progress: 2025/2366 symbols completed. SUN took 24.5s. Estimated remaining: 43m 51s. Rate: 7.8 symbols/min
[2025-10-24T21:20:24.760500] [INFO ] [MAIN      ] SW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:20:24.811448] [DEBUG] [LOCAL     ] SW: Loaded 53568 existing records from primary storage.
[2025-10-24T21:20:24.811808] [INFO ] [MAIN      ] SW: Loaded 53568 existing records.
[2025-10-24T21:20:24.952623] [INFO ] [REMOTE    ] SUPV: Fetching primary data for 2025-08.
[2025-10-24T21:20:25.015960] [WARN ] [MAIN      ] SW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:20:25.016214] [INFO ] [MAIN      ] SW: Wiping existing primary data before full refresh.
[2025-10-24T21:20:25.016273] [INFO ] [LOCAL     ] SW: Starting deletion of primary data.
[2025-10-24T21:20:25.018783] [DEBUG] [LOCAL     ] SW: Deleted primary data file.
[2025-10-24T21:20:25.019065] [INFO ] [MAIN      ] SW: Starting full primary refresh.
[2025-10-24T21:20:25.091171] [INFO ] [REMOTE    ] SUZ: Incremental fetch complete for 2025-02 (0.94 seconds).
[2025-10-24T21:20:25.378130] [INFO ] [REMOTE    ] SW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:20:25.747722] [INFO ] [REMOTE    ] SUZ: Fetching primary data for 2025-03.
[2025-10-24T21:20:25.922186] [INFO ] [REMOTE    ] SUPV: Incremental fetch complete for 2025-08 (0.97 seconds).
[2025-10-24T21:20:26.547673] [INFO ] [REMOTE    ] SUPV: Fetching primary data for 2025-09.
[2025-10-24T21:20:26.679396] [INFO ] [REMOTE    ] SUZ: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T21:20:27.347728] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-01.
[2025-10-24T21:20:27.531294] [INFO ] [REMOTE    ] SUPV: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T21:20:28.147716] [INFO ] [REMOTE    ] SVV: Fetching primary data for 2025-04.
[2025-10-24T21:20:28.257032] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T21:20:28.947686] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-02.
[2025-10-24T21:20:29.037086] [INFO ] [REMOTE    ] SVV: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T21:20:29.747718] [INFO ] [REMOTE    ] SUZ: Fetching primary data for 2025-04.
[2025-10-24T21:20:29.998347] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T21:20:30.547697] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-03.
[2025-10-24T21:20:30.804335] [INFO ] [REMOTE    ] SUZ: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T21:20:31.347692] [INFO ] [REMOTE    ] SUPV: Fetching primary data for 2025-10.
[2025-10-24T21:20:31.584061] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-03 (1.04 seconds).
[2025-10-24T21:20:32.082954] [INFO ] [REMOTE    ] SUPV: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T21:20:32.092055] [INFO ] [REMOTE    ] SUPV: Full fetch complete (68629 records).
[2025-10-24T21:20:32.092221] [DEBUG] [VALIDATOR ] SUPV: Validating primary data.
[2025-10-24T21:20:32.093114] [FATAL] [VALIDATOR ] SUPV: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted.
[2025-10-24T21:20:32.093206] [FATAL] [MAIN      ] SUPV: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:20:32.093247] [WARN ] [MAIN      ] SUPV: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:20:32.093284] [INFO ] [LOCAL     ] SUPV: Starting deletion of primary data.
[2025-10-24T21:20:32.093340] [DEBUG] [LOCAL     ] SUPV: No primary data file found to delete.
[2025-10-24T21:20:32.093374] [INFO ] [LOCAL     ] SUPV: Starting deletion of derivative data.
[2025-10-24T21:20:32.093521] [DEBUG] [LOCAL     ] SUPV: Deleted derivative data file.
[2025-10-24T21:20:32.093819] [INFO ] [MAIN      ] Update Progress: 2026/2366 symbols completed. SUPV took 30.0s. Estimated remaining: 43m 43s. Rate: 7.8 symbols/min
[2025-10-24T21:20:32.155212] [INFO ] [REMOTE    ] SVV: Fetching primary data for 2025-05.
[2025-10-24T21:20:32.269015] [INFO ] [MAIN      ] SWK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:20:32.319254] [DEBUG] [LOCAL     ] SWK: Loaded 52755 existing records from primary storage.
[2025-10-24T21:20:32.319591] [INFO ] [MAIN      ] SWK: Loaded 52755 existing records.
[2025-10-24T21:20:32.507261] [WARN ] [MAIN      ] SWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:20:32.507542] [INFO ] [MAIN      ] SWK: Wiping existing primary data before full refresh.
[2025-10-24T21:20:32.507601] [INFO ] [LOCAL     ] SWK: Starting deletion of primary data.
[2025-10-24T21:20:32.508089] [DEBUG] [LOCAL     ] SWK: Deleted primary data file.
[2025-10-24T21:20:32.508142] [INFO ] [MAIN      ] SWK: Starting full primary refresh.
[2025-10-24T21:20:32.863105] [INFO ] [REMOTE    ] SWK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:20:32.947622] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-04.
[2025-10-24T21:20:33.177911] [INFO ] [REMOTE    ] SVV: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T21:20:33.747618] [INFO ] [REMOTE    ] SUZ: Fetching primary data for 2025-05.
[2025-10-24T21:20:33.806910] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T21:20:34.547679] [INFO ] [REMOTE    ] SVV: Fetching primary data for 2025-06.
[2025-10-24T21:20:34.742490] [INFO ] [REMOTE    ] SUZ: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T21:20:35.347706] [INFO ] [REMOTE    ] SUZ: Fetching primary data for 2025-06.
[2025-10-24T21:20:35.475211] [INFO ] [REMOTE    ] SVV: Incremental fetch complete for 2025-06 (0.93 seconds).
[2025-10-24T21:20:36.147620] [INFO ] [REMOTE    ] SVV: Fetching primary data for 2025-07.
[2025-10-24T21:20:36.333951] [INFO ] [REMOTE    ] SUZ: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T21:20:36.850350] [INFO ] [REMOTE    ] SVV: Incremental fetch complete for 2025-07 (0.70 seconds).
[2025-10-24T21:20:36.947672] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-05.
[2025-10-24T21:20:37.747715] [INFO ] [REMOTE    ] SUZ: Fetching primary data for 2025-07.
[2025-10-24T21:20:37.835023] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T21:20:38.550258] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-06.
[2025-10-24T21:20:38.556739] [INFO ] [REMOTE    ] SUZ: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T21:20:39.347631] [INFO ] [REMOTE    ] SUZ: Fetching primary data for 2025-08.
[2025-10-24T21:20:39.472296] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-06 (0.92 seconds).
[2025-10-24T21:20:40.116270] [INFO ] [REMOTE    ] SUZ: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T21:20:40.147617] [INFO ] [REMOTE    ] SUZ: Fetching primary data for 2025-09.
[2025-10-24T21:20:40.947637] [INFO ] [REMOTE    ] SVV: Fetching primary data for 2025-08.
[2025-10-24T21:20:41.289558] [INFO ] [REMOTE    ] SUZ: Incremental fetch complete for 2025-09 (1.14 seconds).
[2025-10-24T21:20:41.747713] [INFO ] [REMOTE    ] SUZ: Fetching primary data for 2025-10.
[2025-10-24T21:20:42.462967] [INFO ] [REMOTE    ] SVV: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T21:20:42.547721] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-01.
[2025-10-24T21:20:43.328227] [INFO ] [REMOTE    ] SUZ: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T21:20:43.337759] [INFO ] [REMOTE    ] SUZ: Full fetch complete (66655 records).
[2025-10-24T21:20:43.337923] [DEBUG] [VALIDATOR ] SUZ: Validating primary data.
[2025-10-24T21:20:43.353187] [INFO ] [REMOTE    ] SVV: Fetching primary data for 2025-09.
[2025-10-24T21:20:43.746886] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present.
[2025-10-24T21:20:43.747017] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed.
[2025-10-24T21:20:43.748598] [INFO ] [MAIN      ] SUZ: Fetched primary data is valid.
[2025-10-24T21:20:43.748688] [DEBUG] [LOCAL     ] SUZ: Saving primary data.
[2025-10-24T21:20:43.749573] [FATAL] [LOCAL     ] SUZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:20:43.749686] [FATAL] [MAIN      ] SUZ: Failed to save primary data.
[2025-10-24T21:20:43.749738] [WARN ] [MAIN      ] SUZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:20:43.749776] [INFO ] [LOCAL     ] SUZ: Starting deletion of primary data.
[2025-10-24T21:20:43.749835] [DEBUG] [LOCAL     ] SUZ: No primary data file found to delete.
[2025-10-24T21:20:43.749872] [INFO ] [LOCAL     ] SUZ: Starting deletion of derivative data.
[2025-10-24T21:20:43.750151] [DEBUG] [LOCAL     ] SUZ: Deleted derivative data file.
[2025-10-24T21:20:43.750858] [INFO ] [MAIN      ] Update Progress: 2027/2366 symbols completed. SUZ took 28.2s. Estimated remaining: 43m 36s. Rate: 7.8 symbols/min
[2025-10-24T21:20:43.938669] [INFO ] [MAIN      ] SWX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:20:43.973403] [DEBUG] [LOCAL     ] SWX: Loaded 30757 existing records from primary storage.
[2025-10-24T21:20:43.973803] [INFO ] [MAIN      ] SWX: Loaded 30757 existing records.
[2025-10-24T21:20:44.175454] [WARN ] [MAIN      ] SWX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:20:44.167946] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-07.
[2025-10-24T21:20:44.176051] [INFO ] [MAIN      ] SWX: Wiping existing primary data before full refresh.
[2025-10-24T21:20:44.177279] [INFO ] [LOCAL     ] SWX: Starting deletion of primary data.
[2025-10-24T21:20:44.177929] [DEBUG] [LOCAL     ] SWX: Deleted primary data file.
[2025-10-24T21:20:44.177997] [INFO ] [MAIN      ] SWX: Starting full primary refresh.
[2025-10-24T21:20:44.365610] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T21:20:44.615439] [INFO ] [REMOTE    ] SWX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:20:44.644350] [INFO ] [REMOTE    ] SVV: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T21:20:44.947747] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-01.
[2025-10-24T21:20:45.747624] [INFO ] [REMOTE    ] SVV: Fetching primary data for 2025-10.
[2025-10-24T21:20:45.972455] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T21:20:46.167449] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T21:20:46.547722] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-02.
[2025-10-24T21:20:47.186957] [INFO ] [REMOTE    ] SVV: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T21:20:47.195089] [INFO ] [REMOTE    ] SVV: Full fetch complete (57566 records).
[2025-10-24T21:20:47.195199] [DEBUG] [VALIDATOR ] SVV: Validating primary data.
[2025-10-24T21:20:47.350332] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-08.
[2025-10-24T21:20:47.575327] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present.
[2025-10-24T21:20:47.575399] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed.
[2025-10-24T21:20:47.576375] [INFO ] [MAIN      ] SVV: Fetched primary data is valid.
[2025-10-24T21:20:47.576436] [DEBUG] [LOCAL     ] SVV: Saving primary data.
[2025-10-24T21:20:47.576894] [FATAL] [LOCAL     ] SVV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:20:47.576982] [FATAL] [MAIN      ] SVV: Failed to save primary data.
[2025-10-24T21:20:47.577023] [WARN ] [MAIN      ] SVV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:20:47.577092] [INFO ] [LOCAL     ] SVV: Starting deletion of primary data.
[2025-10-24T21:20:47.577149] [DEBUG] [LOCAL     ] SVV: No primary data file found to delete.
[2025-10-24T21:20:47.577184] [INFO ] [LOCAL     ] SVV: Starting deletion of derivative data.
[2025-10-24T21:20:47.577326] [DEBUG] [LOCAL     ] SVV: Deleted derivative data file.
[2025-10-24T21:20:47.577400] [INFO ] [MAIN      ] Update Progress: 2028/2366 symbols completed. SVV took 31.4s. Estimated remaining: 43m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:20:47.743443] [INFO ] [MAIN      ] SWZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:20:47.751892] [DEBUG] [LOCAL     ] SWZ: Loaded 6009 existing records from primary storage.
[2025-10-24T21:20:47.752123] [INFO ] [MAIN      ] SWZ: Loaded 6009 existing records.
[2025-10-24T21:20:47.932149] [WARN ] [MAIN      ] SWZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:20:47.932490] [INFO ] [MAIN      ] SWZ: Wiping existing primary data before full refresh.
[2025-10-24T21:20:47.932550] [INFO ] [LOCAL     ] SWZ: Starting deletion of primary data.
[2025-10-24T21:20:47.932808] [DEBUG] [LOCAL     ] SWZ: Deleted primary data file.
[2025-10-24T21:20:47.932860] [INFO ] [MAIN      ] SWZ: Starting full primary refresh.
[2025-10-24T21:20:48.158037] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-02.
[2025-10-24T21:20:48.322406] [INFO ] [REMOTE    ] SWZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:20:48.324292] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T21:20:48.820142] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T21:20:48.947627] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-03.
[2025-10-24T21:20:49.435126] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T21:20:49.747676] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-03.
[2025-10-24T21:20:50.547611] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-01.
[2025-10-24T21:20:50.587629] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T21:20:51.050481] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-03 (1.30 seconds).
[2025-10-24T21:20:51.170983] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T21:20:51.347691] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-04.
[2025-10-24T21:20:52.147734] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-09.
[2025-10-24T21:20:52.947733] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-02.
[2025-10-24T21:20:53.334381] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-02 (0.39 seconds).
[2025-10-24T21:20:53.366393] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T21:20:53.747621] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-03.
[2025-10-24T21:20:53.779467] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T21:20:54.415199] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-03 (0.67 seconds).
[2025-10-24T21:20:54.547705] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-05.
[2025-10-24T21:20:55.347749] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-04.
[2025-10-24T21:20:56.147695] [INFO ] [REMOTE    ] SW: Fetching primary data for 2025-10.
[2025-10-24T21:20:56.201410] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-04 (0.85 seconds).
[2025-10-24T21:20:56.302052] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T21:20:56.947623] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-05.
[2025-10-24T21:20:57.549947] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T21:20:57.747687] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-06.
[2025-10-24T21:20:58.044760] [INFO ] [REMOTE    ] SW: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T21:20:58.054961] [INFO ] [REMOTE    ] SW: Full fetch complete (77120 records).
[2025-10-24T21:20:58.055088] [DEBUG] [VALIDATOR ] SW: Validating primary data.
[2025-10-24T21:20:58.411624] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T21:20:58.460599] [DEBUG] [VALIDATOR ] SW: All expected trading days are present.
[2025-10-24T21:20:58.460708] [DEBUG] [VALIDATOR ] SW: Primary data validation passed.
[2025-10-24T21:20:58.462056] [INFO ] [MAIN      ] SW: Fetched primary data is valid.
[2025-10-24T21:20:58.462131] [DEBUG] [LOCAL     ] SW: Saving primary data.
[2025-10-24T21:20:58.462824] [FATAL] [LOCAL     ] SW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:20:58.462940] [FATAL] [MAIN      ] SW: Failed to save primary data.
[2025-10-24T21:20:58.462988] [WARN ] [MAIN      ] SW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:20:58.463057] [INFO ] [LOCAL     ] SW: Starting deletion of primary data.
[2025-10-24T21:20:58.463122] [DEBUG] [LOCAL     ] SW: No primary data file found to delete.
[2025-10-24T21:20:58.463168] [INFO ] [LOCAL     ] SW: Starting deletion of derivative data.
[2025-10-24T21:20:58.463411] [DEBUG] [LOCAL     ] SW: Deleted derivative data file.
[2025-10-24T21:20:58.463864] [INFO ] [MAIN      ] Update Progress: 2029/2366 symbols completed. SW took 33.9s. Estimated remaining: 43m 20s. Rate: 7.8 symbols/min
[2025-10-24T21:20:58.552945] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-07.
[2025-10-24T21:20:58.659122] [INFO ] [MAIN      ] SXC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:20:58.697838] [DEBUG] [LOCAL     ] SXC: Loaded 41860 existing records from primary storage.
[2025-10-24T21:20:58.698121] [INFO ] [MAIN      ] SXC: Loaded 41860 existing records.
[2025-10-24T21:20:58.871977] [WARN ] [MAIN      ] SXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:20:58.872167] [INFO ] [MAIN      ] SXC: Wiping existing primary data before full refresh.
[2025-10-24T21:20:58.872213] [INFO ] [LOCAL     ] SXC: Starting deletion of primary data.
[2025-10-24T21:20:58.872723] [DEBUG] [LOCAL     ] SXC: Deleted primary data file.
[2025-10-24T21:20:58.872780] [INFO ] [MAIN      ] SXC: Starting full primary refresh.
[2025-10-24T21:20:59.224424] [INFO ] [REMOTE    ] SXC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:20:59.228961] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T21:20:59.347610] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-06.
[2025-10-24T21:21:00.147700] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-01.
[2025-10-24T21:21:00.947616] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-08.
[2025-10-24T21:21:01.374509] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-06 (2.03 seconds).
[2025-10-24T21:21:01.513431] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T21:21:01.671033] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-08 (0.72 seconds).
[2025-10-24T21:21:01.747729] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-04.
[2025-10-24T21:21:02.547686] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-07.
[2025-10-24T21:21:03.164907] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T21:21:03.347632] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-02.
[2025-10-24T21:21:04.147693] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-09.
[2025-10-24T21:21:04.316390] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T21:21:04.949074] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T21:21:04.949953] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-05.
[2025-10-24T21:21:04.949899] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T21:21:05.747701] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-03.
[2025-10-24T21:21:06.371430] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T21:21:06.547707] [INFO ] [REMOTE    ] SWZ: Fetching primary data for 2025-10.
[2025-10-24T21:21:07.189858] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T21:21:07.244621] [INFO ] [REMOTE    ] SWZ: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T21:21:07.246308] [INFO ] [REMOTE    ] SWZ: Full fetch complete (8261 records).
[2025-10-24T21:21:07.246384] [DEBUG] [VALIDATOR ] SWZ: Validating primary data.
[2025-10-24T21:21:07.352833] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-08.
[2025-10-24T21:21:07.615183] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present.
[2025-10-24T21:21:07.615265] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed.
[2025-10-24T21:21:07.615529] [INFO ] [MAIN      ] SWZ: Fetched primary data is valid.
[2025-10-24T21:21:07.615570] [DEBUG] [LOCAL     ] SWZ: Saving primary data.
[2025-10-24T21:21:07.615800] [FATAL] [LOCAL     ] SWZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:21:07.615890] [FATAL] [MAIN      ] SWZ: Failed to save primary data.
[2025-10-24T21:21:07.615932] [WARN ] [MAIN      ] SWZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:21:07.615968] [INFO ] [LOCAL     ] SWZ: Starting deletion of primary data.
[2025-10-24T21:21:07.616018] [DEBUG] [LOCAL     ] SWZ: No primary data file found to delete.
[2025-10-24T21:21:07.616053] [INFO ] [LOCAL     ] SWZ: Starting deletion of derivative data.
[2025-10-24T21:21:07.616204] [DEBUG] [LOCAL     ] SWZ: Deleted derivative data file.
[2025-10-24T21:21:07.616277] [INFO ] [MAIN      ] Update Progress: 2030/2366 symbols completed. SWZ took 20.0s. Estimated remaining: 43m 13s. Rate: 7.8 symbols/min
[2025-10-24T21:21:07.797661] [INFO ] [MAIN      ] SXI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:21:07.812181] [DEBUG] [LOCAL     ] SXI: Loaded 12093 existing records from primary storage.
[2025-10-24T21:21:07.812426] [INFO ] [MAIN      ] SXI: Loaded 12093 existing records.
[2025-10-24T21:21:08.012638] [WARN ] [MAIN      ] SXI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:21:08.012921] [INFO ] [MAIN      ] SXI: Wiping existing primary data before full refresh.
[2025-10-24T21:21:08.012977] [INFO ] [LOCAL     ] SXI: Starting deletion of primary data.
[2025-10-24T21:21:08.013204] [DEBUG] [LOCAL     ] SXI: Deleted primary data file.
[2025-10-24T21:21:08.013274] [INFO ] [MAIN      ] SXI: Starting full primary refresh.
[2025-10-24T21:21:08.152830] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-06.
[2025-10-24T21:21:08.395082] [INFO ] [REMOTE    ] SXI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:21:08.947715] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-01.
[2025-10-24T21:21:09.190715] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T21:21:09.486874] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T21:21:09.500028] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-01 (0.55 seconds).
[2025-10-24T21:21:09.747716] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-07.
[2025-10-24T21:21:10.547736] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-09.
[2025-10-24T21:21:11.054000] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T21:21:11.347707] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-04.
[2025-10-24T21:21:12.094830] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T21:21:12.147609] [INFO ] [REMOTE    ] SWK: Fetching primary data for 2025-10.
[2025-10-24T21:21:12.859085] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T21:21:12.947632] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-05.
[2025-10-24T21:21:13.747709] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-02.
[2025-10-24T21:21:13.980102] [INFO ] [REMOTE    ] SWK: Incremental fetch complete for 2025-10 (1.83 seconds).
[2025-10-24T21:21:13.990426] [INFO ] [REMOTE    ] SWK: Full fetch complete (75520 records).
[2025-10-24T21:21:13.990579] [DEBUG] [VALIDATOR ] SWK: Validating primary data.
[2025-10-24T21:21:14.368673] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T21:21:14.389435] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present.
[2025-10-24T21:21:14.392141] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed.
[2025-10-24T21:21:14.393441] [INFO ] [MAIN      ] SWK: Fetched primary data is valid.
[2025-10-24T21:21:14.393521] [DEBUG] [LOCAL     ] SWK: Saving primary data.
[2025-10-24T21:21:14.394272] [FATAL] [LOCAL     ] SWK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:21:14.402038] [FATAL] [MAIN      ] SWK: Failed to save primary data.
[2025-10-24T21:21:14.412197] [WARN ] [MAIN      ] SWK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:21:14.414483] [INFO ] [LOCAL     ] SWK: Starting deletion of primary data.
[2025-10-24T21:21:14.414737] [DEBUG] [LOCAL     ] SWK: No primary data file found to delete.
[2025-10-24T21:21:14.415128] [INFO ] [LOCAL     ] SWK: Starting deletion of derivative data.
[2025-10-24T21:21:14.415835] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T21:21:14.418824] [DEBUG] [LOCAL     ] SWK: Deleted derivative data file.
[2025-10-24T21:21:14.424277] [INFO ] [MAIN      ] Update Progress: 2031/2366 symbols completed. SWK took 42.3s. Estimated remaining: 43m 5s. Rate: 7.8 symbols/min
[2025-10-24T21:21:14.562228] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-06.
[2025-10-24T21:21:14.593896] [INFO ] [MAIN      ] SXT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:21:14.622693] [DEBUG] [LOCAL     ] SXT: Loaded 29769 existing records from primary storage.
[2025-10-24T21:21:14.622948] [INFO ] [MAIN      ] SXT: Loaded 29769 existing records.
[2025-10-24T21:21:14.800711] [WARN ] [MAIN      ] SXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:21:14.800912] [INFO ] [MAIN      ] SXT: Wiping existing primary data before full refresh.
[2025-10-24T21:21:14.800961] [INFO ] [LOCAL     ] SXT: Starting deletion of primary data.
[2025-10-24T21:21:14.801303] [DEBUG] [LOCAL     ] SXT: Deleted primary data file.
[2025-10-24T21:21:14.801370] [INFO ] [MAIN      ] SXT: Starting full primary refresh.
[2025-10-24T21:21:15.162309] [INFO ] [REMOTE    ] SXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:21:15.347604] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-03.
[2025-10-24T21:21:16.125154] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T21:21:16.147598] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-07.
[2025-10-24T21:21:16.157673] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T21:21:16.947629] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-04.
[2025-10-24T21:21:17.608737] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T21:21:17.747682] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-08.
[2025-10-24T21:21:17.873630] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T21:21:18.547715] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-01.
[2025-10-24T21:21:19.251176] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T21:21:19.347607] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-09.
[2025-10-24T21:21:19.630531] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T21:21:20.147701] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-02.
[2025-10-24T21:21:20.701924] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-09 (1.35 seconds).
[2025-10-24T21:21:20.947690] [INFO ] [REMOTE    ] SXC: Fetching primary data for 2025-10.
[2025-10-24T21:21:21.201464] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T21:21:21.747678] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-05.
[2025-10-24T21:21:22.140443] [INFO ] [REMOTE    ] SXC: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T21:21:22.148855] [INFO ] [REMOTE    ] SXC: Full fetch complete (60859 records).
[2025-10-24T21:21:22.148991] [DEBUG] [VALIDATOR ] SXC: Validating primary data.
[2025-10-24T21:21:22.547693] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-08.
[2025-10-24T21:21:22.635839] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-05 (0.89 seconds).
[2025-10-24T21:21:22.766426] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present.
[2025-10-24T21:21:22.766547] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed.
[2025-10-24T21:21:22.768798] [INFO ] [MAIN      ] SXC: Fetched primary data is valid.
[2025-10-24T21:21:22.768916] [DEBUG] [LOCAL     ] SXC: Saving primary data.
[2025-10-24T21:21:22.769636] [FATAL] [LOCAL     ] SXC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:21:22.769786] [FATAL] [MAIN      ] SXC: Failed to save primary data.
[2025-10-24T21:21:22.769845] [WARN ] [MAIN      ] SXC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:21:22.769901] [INFO ] [LOCAL     ] SXC: Starting deletion of primary data.
[2025-10-24T21:21:22.769980] [DEBUG] [LOCAL     ] SXC: No primary data file found to delete.
[2025-10-24T21:21:22.770034] [INFO ] [LOCAL     ] SXC: Starting deletion of derivative data.
[2025-10-24T21:21:22.770275] [DEBUG] [LOCAL     ] SXC: Deleted derivative data file.
[2025-10-24T21:21:22.771429] [INFO ] [MAIN      ] Update Progress: 2032/2366 symbols completed. SXC took 24.3s. Estimated remaining: 42m 57s. Rate: 7.8 symbols/min
[2025-10-24T21:21:23.031724] [INFO ] [MAIN      ] SYF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:21:23.090571] [DEBUG] [LOCAL     ] SYF: Loaded 53841 existing records from primary storage.
[2025-10-24T21:21:23.091019] [INFO ] [MAIN      ] SYF: Loaded 53841 existing records.
[2025-10-24T21:21:23.285987] [WARN ] [MAIN      ] SYF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:21:23.286256] [INFO ] [MAIN      ] SYF: Wiping existing primary data before full refresh.
[2025-10-24T21:21:23.286305] [INFO ] [LOCAL     ] SYF: Starting deletion of primary data.
[2025-10-24T21:21:23.287012] [DEBUG] [LOCAL     ] SYF: Deleted primary data file.
[2025-10-24T21:21:23.287070] [INFO ] [MAIN      ] SYF: Starting full primary refresh.
[2025-10-24T21:21:23.352879] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-03.
[2025-10-24T21:21:23.668791] [INFO ] [REMOTE    ] SYF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:21:24.010799] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T21:21:24.147741] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-09.
[2025-10-24T21:21:24.660286] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-03 (1.31 seconds).
[2025-10-24T21:21:24.947616] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-06.
[2025-10-24T21:21:25.333832] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T21:21:25.747706] [INFO ] [REMOTE    ] SWX: Fetching primary data for 2025-10.
[2025-10-24T21:21:25.779781] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-06 (0.83 seconds).
[2025-10-24T21:21:26.547719] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-01.
[2025-10-24T21:21:26.836280] [INFO ] [REMOTE    ] SWX: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T21:21:26.841282] [INFO ] [REMOTE    ] SWX: Full fetch complete (43817 records).
[2025-10-24T21:21:26.841362] [DEBUG] [VALIDATOR ] SWX: Validating primary data.
[2025-10-24T21:21:27.208498] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present.
[2025-10-24T21:21:27.208573] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed.
[2025-10-24T21:21:27.209599] [INFO ] [MAIN      ] SWX: Fetched primary data is valid.
[2025-10-24T21:21:27.209687] [DEBUG] [LOCAL     ] SWX: Saving primary data.
[2025-10-24T21:21:27.210126] [FATAL] [LOCAL     ] SWX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:21:27.210206] [FATAL] [MAIN      ] SWX: Failed to save primary data.
[2025-10-24T21:21:27.210272] [WARN ] [MAIN      ] SWX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:21:27.210346] [INFO ] [LOCAL     ] SWX: Starting deletion of primary data.
[2025-10-24T21:21:27.210406] [DEBUG] [LOCAL     ] SWX: No primary data file found to delete.
[2025-10-24T21:21:27.210443] [INFO ] [LOCAL     ] SWX: Starting deletion of derivative data.
[2025-10-24T21:21:27.210630] [DEBUG] [LOCAL     ] SWX: Deleted derivative data file.
[2025-10-24T21:21:27.210751] [INFO ] [MAIN      ] Update Progress: 2033/2366 symbols completed. SWX took 43.5s. Estimated remaining: 42m 49s. Rate: 7.8 symbols/min
[2025-10-24T21:21:27.354422] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-07.
[2025-10-24T21:21:27.385705] [INFO ] [MAIN      ] SYK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:21:27.429488] [DEBUG] [LOCAL     ] SYK: Loaded 47139 existing records from primary storage.
[2025-10-24T21:21:27.429845] [INFO ] [MAIN      ] SYK: Loaded 47139 existing records.
[2025-10-24T21:21:27.606177] [WARN ] [MAIN      ] SYK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:21:27.606445] [INFO ] [MAIN      ] SYK: Wiping existing primary data before full refresh.
[2025-10-24T21:21:27.606492] [INFO ] [LOCAL     ] SYK: Starting deletion of primary data.
[2025-10-24T21:21:27.607289] [DEBUG] [LOCAL     ] SYK: Deleted primary data file.
[2025-10-24T21:21:27.607348] [INFO ] [MAIN      ] SYK: Starting full primary refresh.
[2025-10-24T21:21:27.968345] [INFO ] [REMOTE    ] SYK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:21:28.152589] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-04.
[2025-10-24T21:21:28.158151] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T21:21:28.564514] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T21:21:28.947716] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-08.
[2025-10-24T21:21:29.508985] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T21:21:29.747730] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-01.
[2025-10-24T21:21:29.934848] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T21:21:30.547722] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-09.
[2025-10-24T21:21:31.347672] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-02.
[2025-10-24T21:21:31.415991] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T21:21:31.600186] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-01 (1.85 seconds).
[2025-10-24T21:21:32.147760] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-05.
[2025-10-24T21:21:32.904131] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T21:21:32.947619] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-03.
[2025-10-24T21:21:33.360003] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-05 (1.21 seconds).
[2025-10-24T21:21:33.747740] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-02.
[2025-10-24T21:21:34.547699] [INFO ] [REMOTE    ] SXI: Fetching primary data for 2025-10.
[2025-10-24T21:21:34.662604] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T21:21:35.347636] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-06.
[2025-10-24T21:21:35.398613] [INFO ] [REMOTE    ] SXI: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T21:21:35.401988] [INFO ] [REMOTE    ] SXI: Full fetch complete (15931 records).
[2025-10-24T21:21:35.402135] [DEBUG] [VALIDATOR ] SXI: Validating primary data.
[2025-10-24T21:21:35.581281] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T21:21:35.808613] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present.
[2025-10-24T21:21:35.808726] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed.
[2025-10-24T21:21:35.809116] [INFO ] [MAIN      ] SXI: Fetched primary data is valid.
[2025-10-24T21:21:35.809155] [DEBUG] [LOCAL     ] SXI: Saving primary data.
[2025-10-24T21:21:35.809471] [FATAL] [LOCAL     ] SXI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:21:35.809564] [FATAL] [MAIN      ] SXI: Failed to save primary data.
[2025-10-24T21:21:35.809632] [WARN ] [MAIN      ] SXI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:21:35.809720] [INFO ] [LOCAL     ] SXI: Starting deletion of primary data.
[2025-10-24T21:21:35.809777] [DEBUG] [LOCAL     ] SXI: No primary data file found to delete.
[2025-10-24T21:21:35.809812] [INFO ] [LOCAL     ] SXI: Starting deletion of derivative data.
[2025-10-24T21:21:35.809984] [DEBUG] [LOCAL     ] SXI: Deleted derivative data file.
[2025-10-24T21:21:35.810110] [INFO ] [MAIN      ] Update Progress: 2034/2366 symbols completed. SXI took 28.2s. Estimated remaining: 42m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:21:35.982043] [INFO ] [MAIN      ] SYY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:21:36.033368] [DEBUG] [LOCAL     ] SYY: Loaded 53592 existing records from primary storage.
[2025-10-24T21:21:36.033757] [INFO ] [MAIN      ] SYY: Loaded 53592 existing records.
[2025-10-24T21:21:36.148527] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-03.
[2025-10-24T21:21:36.226563] [WARN ] [MAIN      ] SYY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:21:36.226818] [INFO ] [MAIN      ] SYY: Wiping existing primary data before full refresh.
[2025-10-24T21:21:36.226864] [INFO ] [LOCAL     ] SYY: Starting deletion of primary data.
[2025-10-24T21:21:36.227890] [DEBUG] [LOCAL     ] SYY: Deleted primary data file.
[2025-10-24T21:21:36.227947] [INFO ] [MAIN      ] SYY: Starting full primary refresh.
[2025-10-24T21:21:36.591011] [INFO ] [REMOTE    ] SYY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:21:36.733287] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T21:21:36.947735] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-07.
[2025-10-24T21:21:37.747738] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-04.
[2025-10-24T21:21:38.004478] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-03 (1.86 seconds).
[2025-10-24T21:21:38.380736] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T21:21:38.547700] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-04.
[2025-10-24T21:21:39.347629] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-08.
[2025-10-24T21:21:39.626751] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T21:21:40.147618] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-05.
[2025-10-24T21:21:40.253266] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T21:21:40.583710] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T21:21:40.947618] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-05.
[2025-10-24T21:21:41.747708] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-09.
[2025-10-24T21:21:41.991471] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T21:21:42.547615] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-06.
[2025-10-24T21:21:42.743172] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T21:21:43.084961] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T21:21:43.347685] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-01.
[2025-10-24T21:21:44.147630] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-06.
[2025-10-24T21:21:44.282603] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T21:21:44.947635] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-07.
[2025-10-24T21:21:45.176139] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T21:21:45.752748] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-02.
[2025-10-24T21:21:45.767777] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T21:21:46.547633] [INFO ] [REMOTE    ] SXT: Fetching primary data for 2025-10.
[2025-10-24T21:21:46.748537] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T21:21:47.347733] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-07.
[2025-10-24T21:21:47.466408] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T21:21:47.845990] [INFO ] [REMOTE    ] SXT: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T21:21:47.851579] [INFO ] [REMOTE    ] SXT: Full fetch complete (39643 records).
[2025-10-24T21:21:47.851757] [DEBUG] [VALIDATOR ] SXT: Validating primary data.
[2025-10-24T21:21:48.152910] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-08.
[2025-10-24T21:21:48.232017] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present.
[2025-10-24T21:21:48.232116] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed.
[2025-10-24T21:21:48.232960] [INFO ] [MAIN      ] SXT: Fetched primary data is valid.
[2025-10-24T21:21:48.233026] [DEBUG] [LOCAL     ] SXT: Saving primary data.
[2025-10-24T21:21:48.233485] [FATAL] [LOCAL     ] SXT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:21:48.233590] [FATAL] [MAIN      ] SXT: Failed to save primary data.
[2025-10-24T21:21:48.233680] [WARN ] [MAIN      ] SXT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:21:48.233749] [INFO ] [LOCAL     ] SXT: Starting deletion of primary data.
[2025-10-24T21:21:48.233810] [DEBUG] [LOCAL     ] SXT: No primary data file found to delete.
[2025-10-24T21:21:48.233846] [INFO ] [LOCAL     ] SXT: Starting deletion of derivative data.
[2025-10-24T21:21:48.233993] [DEBUG] [LOCAL     ] SXT: Deleted derivative data file.
[2025-10-24T21:21:48.234072] [INFO ] [MAIN      ] Update Progress: 2035/2366 symbols completed. SXT took 33.8s. Estimated remaining: 42m 35s. Rate: 7.8 symbols/min
[2025-10-24T21:21:48.404082] [INFO ] [MAIN      ] T: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:21:48.455516] [DEBUG] [LOCAL     ] T: Loaded 54188 existing records from primary storage.
[2025-10-24T21:21:48.455905] [INFO ] [MAIN      ] T: Loaded 54188 existing records.
[2025-10-24T21:21:48.629512] [WARN ] [MAIN      ] T: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:21:48.629717] [INFO ] [MAIN      ] T: Wiping existing primary data before full refresh.
[2025-10-24T21:21:48.629770] [INFO ] [LOCAL     ] T: Starting deletion of primary data.
[2025-10-24T21:21:48.630281] [DEBUG] [LOCAL     ] T: Deleted primary data file.
[2025-10-24T21:21:48.630318] [INFO ] [MAIN      ] T: Starting full primary refresh.
[2025-10-24T21:21:48.959383] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-03.
[2025-10-24T21:21:48.979103] [INFO ] [REMOTE    ] T: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:21:49.101166] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T21:21:49.747630] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-08.
[2025-10-24T21:21:49.952351] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T21:21:50.482017] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T21:21:50.547701] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-01.
[2025-10-24T21:21:51.062486] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T21:21:51.347701] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-04.
[2025-10-24T21:21:52.147678] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-09.
[2025-10-24T21:21:52.464615] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T21:21:52.947686] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-09.
[2025-10-24T21:21:53.275517] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T21:21:53.747711] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-05.
[2025-10-24T21:21:54.009211] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-09 (1.86 seconds).
[2025-10-24T21:21:54.547692] [INFO ] [REMOTE    ] SYF: Fetching primary data for 2025-10.
[2025-10-24T21:21:54.667191] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T21:21:55.191498] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T21:21:55.347636] [INFO ] [REMOTE    ] SYK: Fetching primary data for 2025-10.
[2025-10-24T21:21:56.147699] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-02.
[2025-10-24T21:21:56.352353] [INFO ] [REMOTE    ] SYF: Incremental fetch complete for 2025-10 (1.80 seconds).
[2025-10-24T21:21:56.362284] [INFO ] [REMOTE    ] SYF: Full fetch complete (77581 records).
[2025-10-24T21:21:56.362429] [DEBUG] [VALIDATOR ] SYF: Validating primary data.
[2025-10-24T21:21:56.755829] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present.
[2025-10-24T21:21:56.755946] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed.
[2025-10-24T21:21:56.757164] [INFO ] [MAIN      ] SYF: Fetched primary data is valid.
[2025-10-24T21:21:56.757245] [DEBUG] [LOCAL     ] SYF: Saving primary data.
[2025-10-24T21:21:56.757934] [FATAL] [LOCAL     ] SYF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:21:56.758020] [FATAL] [MAIN      ] SYF: Failed to save primary data.
[2025-10-24T21:21:56.758082] [WARN ] [MAIN      ] SYF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:21:56.758150] [INFO ] [LOCAL     ] SYF: Starting deletion of primary data.
[2025-10-24T21:21:56.758212] [DEBUG] [LOCAL     ] SYF: No primary data file found to delete.
[2025-10-24T21:21:56.758247] [INFO ] [LOCAL     ] SYF: Starting deletion of derivative data.
[2025-10-24T21:21:56.758399] [DEBUG] [LOCAL     ] SYF: Deleted derivative data file.
[2025-10-24T21:21:56.758849] [INFO ] [MAIN      ] Update Progress: 2036/2366 symbols completed. SYF took 34.0s. Estimated remaining: 42m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:21:56.932271] [INFO ] [MAIN      ] TAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:21:56.955571] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-06.
[2025-10-24T21:21:56.979880] [DEBUG] [LOCAL     ] TAC: Loaded 43784 existing records from primary storage.
[2025-10-24T21:21:56.980479] [INFO ] [MAIN      ] TAC: Loaded 43784 existing records.
[2025-10-24T21:21:57.128841] [INFO ] [REMOTE    ] SYK: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T21:21:57.170923] [INFO ] [REMOTE    ] SYK: Full fetch complete (69152 records).
[2025-10-24T21:21:57.182431] [DEBUG] [VALIDATOR ] SYK: Validating primary data.
[2025-10-24T21:21:57.295589] [WARN ] [MAIN      ] TAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:21:57.334563] [INFO ] [MAIN      ] TAC: Wiping existing primary data before full refresh.
[2025-10-24T21:21:57.346154] [INFO ] [LOCAL     ] TAC: Starting deletion of primary data.
[2025-10-24T21:21:57.376228] [DEBUG] [LOCAL     ] TAC: Deleted primary data file.
[2025-10-24T21:21:57.386573] [INFO ] [MAIN      ] TAC: Starting full primary refresh.
[2025-10-24T21:21:58.033555] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present.
[2025-10-24T21:21:58.033405] [INFO ] [REMOTE    ] TAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:21:58.034262] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-01.
[2025-10-24T21:21:58.034036] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed.
[2025-10-24T21:21:58.035492] [INFO ] [MAIN      ] SYK: Fetched primary data is valid.
[2025-10-24T21:21:58.036579] [DEBUG] [LOCAL     ] SYK: Saving primary data.
[2025-10-24T21:21:58.037219] [FATAL] [LOCAL     ] SYK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:21:58.037293] [FATAL] [MAIN      ] SYK: Failed to save primary data.
[2025-10-24T21:21:58.037442] [WARN ] [MAIN      ] SYK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:21:58.037512] [INFO ] [LOCAL     ] SYK: Starting deletion of primary data.
[2025-10-24T21:21:58.037612] [DEBUG] [LOCAL     ] SYK: No primary data file found to delete.
[2025-10-24T21:21:58.037680] [INFO ] [LOCAL     ] SYK: Starting deletion of derivative data.
[2025-10-24T21:21:58.037846] [DEBUG] [LOCAL     ] SYK: Deleted derivative data file.
[2025-10-24T21:21:58.038199] [INFO ] [MAIN      ] Update Progress: 2037/2366 symbols completed. SYK took 30.8s. Estimated remaining: 42m 18s. Rate: 7.8 symbols/min
[2025-10-24T21:21:58.182828] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-02 (2.04 seconds).
[2025-10-24T21:21:58.329760] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T21:21:58.547752] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-03.
[2025-10-24T21:21:59.312212] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T21:21:59.347604] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-02.
[2025-10-24T21:22:00.147633] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-07.
[2025-10-24T21:22:00.480458] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-03 (1.93 seconds).
[2025-10-24T21:22:00.947630] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-04.
[2025-10-24T21:22:00.981491] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T21:22:01.739251] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T21:22:01.750672] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-03.
[2025-10-24T21:22:02.547679] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-08.
[2025-10-24T21:22:03.267304] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T21:22:03.347615] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-04.
[2025-10-24T21:22:03.480840] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-04 (2.53 seconds).
[2025-10-24T21:22:04.147683] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-05.
[2025-10-24T21:22:04.314786] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T21:22:04.948318] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T21:22:04.948435] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-09.
[2025-10-24T21:22:05.747752] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-05.
[2025-10-24T21:22:06.682947] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-05 (2.54 seconds).
[2025-10-24T21:22:06.694412] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-06.
[2025-10-24T21:22:06.770981] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T21:22:06.836856] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-05 (1.09 seconds).
[2025-10-24T21:22:07.347625] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-06.
[2025-10-24T21:22:08.147739] [INFO ] [REMOTE    ] SYY: Fetching primary data for 2025-10.
[2025-10-24T21:22:08.887297] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T21:22:08.960401] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-07.
[2025-10-24T21:22:08.964809] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-06 (2.27 seconds).
[2025-10-24T21:22:09.747744] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-07.
[2025-10-24T21:22:10.066864] [INFO ] [REMOTE    ] SYY: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T21:22:10.081761] [INFO ] [REMOTE    ] SYY: Full fetch complete (77243 records).
[2025-10-24T21:22:10.081989] [DEBUG] [VALIDATOR ] SYY: Validating primary data.
[2025-10-24T21:22:10.653619] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T21:22:10.686619] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present.
[2025-10-24T21:22:10.686855] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed.
[2025-10-24T21:22:10.688184] [INFO ] [MAIN      ] SYY: Fetched primary data is valid.
[2025-10-24T21:22:10.688299] [DEBUG] [LOCAL     ] SYY: Saving primary data.
[2025-10-24T21:22:10.688700] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-08.
[2025-10-24T21:22:10.689771] [FATAL] [LOCAL     ] SYY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:22:10.689901] [FATAL] [MAIN      ] SYY: Failed to save primary data.
[2025-10-24T21:22:10.689983] [WARN ] [MAIN      ] SYY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:22:10.690074] [INFO ] [LOCAL     ] SYY: Starting deletion of primary data.
[2025-10-24T21:22:10.690151] [DEBUG] [LOCAL     ] SYY: No primary data file found to delete.
[2025-10-24T21:22:10.690191] [INFO ] [LOCAL     ] SYY: Starting deletion of derivative data.
[2025-10-24T21:22:10.690368] [DEBUG] [LOCAL     ] SYY: Deleted derivative data file.
[2025-10-24T21:22:10.690808] [INFO ] [MAIN      ] Update Progress: 2038/2366 symbols completed. SYY took 34.9s. Estimated remaining: 42m 11s. Rate: 7.8 symbols/min
[2025-10-24T21:22:11.967980] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-07 (2.22 seconds).
[2025-10-24T21:22:11.980224] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-08.
[2025-10-24T21:22:12.279147] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T21:22:12.288359] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-09.
[2025-10-24T21:22:13.824373] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T21:22:13.834256] [INFO ] [REMOTE    ] TAC: Fetching primary data for 2025-10.
[2025-10-24T21:22:14.425746] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-08 (2.45 seconds).
[2025-10-24T21:22:14.437096] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-09.
[2025-10-24T21:22:15.151132] [INFO ] [REMOTE    ] TAC: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T21:22:15.160501] [INFO ] [REMOTE    ] TAC: Full fetch complete (64796 records).
[2025-10-24T21:22:15.160626] [DEBUG] [VALIDATOR ] TAC: Validating primary data.
[2025-10-24T21:22:15.539278] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present.
[2025-10-24T21:22:15.539356] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed.
[2025-10-24T21:22:15.540389] [INFO ] [MAIN      ] TAC: Fetched primary data is valid.
[2025-10-24T21:22:15.540457] [DEBUG] [LOCAL     ] TAC: Saving primary data.
[2025-10-24T21:22:15.541010] [FATAL] [LOCAL     ] TAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:22:15.541109] [FATAL] [MAIN      ] TAC: Failed to save primary data.
[2025-10-24T21:22:15.541151] [WARN ] [MAIN      ] TAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:22:15.541219] [INFO ] [LOCAL     ] TAC: Starting deletion of primary data.
[2025-10-24T21:22:15.541280] [DEBUG] [LOCAL     ] TAC: No primary data file found to delete.
[2025-10-24T21:22:15.541315] [INFO ] [LOCAL     ] TAC: Starting deletion of derivative data.
[2025-10-24T21:22:15.541483] [DEBUG] [LOCAL     ] TAC: Deleted derivative data file.
[2025-10-24T21:22:15.541794] [INFO ] [MAIN      ] Update Progress: 2039/2366 symbols completed. TAC took 18.8s. Estimated remaining: 42m 3s. Rate: 7.8 symbols/min
[2025-10-24T21:22:16.592875] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-09 (2.16 seconds).
[2025-10-24T21:22:16.604458] [INFO ] [REMOTE    ] T: Fetching primary data for 2025-10.
[2025-10-24T21:22:19.103676] [INFO ] [REMOTE    ] T: Incremental fetch complete for 2025-10 (2.50 seconds).
[2025-10-24T21:22:19.113421] [INFO ] [REMOTE    ] T: Full fetch complete (77978 records).
[2025-10-24T21:22:19.113541] [DEBUG] [VALIDATOR ] T: Validating primary data.
[2025-10-24T21:22:19.505749] [DEBUG] [VALIDATOR ] T: All expected trading days are present.
[2025-10-24T21:22:19.506063] [DEBUG] [VALIDATOR ] T: Primary data validation passed.
[2025-10-24T21:22:19.507352] [INFO ] [MAIN      ] T: Fetched primary data is valid.
[2025-10-24T21:22:19.507416] [DEBUG] [LOCAL     ] T: Saving primary data.
[2025-10-24T21:22:19.508047] [FATAL] [LOCAL     ] T: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:22:19.508133] [FATAL] [MAIN      ] T: Failed to save primary data.
[2025-10-24T21:22:19.508199] [WARN ] [MAIN      ] T: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:22:19.508267] [INFO ] [LOCAL     ] T: Starting deletion of primary data.
[2025-10-24T21:22:19.508342] [DEBUG] [LOCAL     ] T: No primary data file found to delete.
[2025-10-24T21:22:19.508397] [INFO ] [LOCAL     ] T: Starting deletion of derivative data.
[2025-10-24T21:22:19.509059] [DEBUG] [LOCAL     ] T: Deleted derivative data file.
[2025-10-24T21:22:19.509560] [INFO ] [MAIN      ] Update Progress: 2040/2366 symbols completed. T took 31.3s. Estimated remaining: 41m 55s. Rate: 7.8 symbols/min
[2025-10-24T21:22:20.133357] [INFO ] [MAIN      ] TAK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:22:20.124636] [INFO ] [MAIN      ] TAL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:22:20.222559] [INFO ] [MAIN      ] TAP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:22:20.199665] [INFO ] [MAIN      ] TALO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:22:20.307147] [DEBUG] [LOCAL     ] TAL: Loaded 52091 existing records from primary storage.
[2025-10-24T21:22:20.307694] [INFO ] [MAIN      ] TAL: Loaded 52091 existing records.
[2025-10-24T21:22:20.458427] [DEBUG] [LOCAL     ] TAK: Loaded 50590 existing records from primary storage.
[2025-10-24T21:22:20.463419] [INFO ] [MAIN      ] TAK: Loaded 50590 existing records.
[2025-10-24T21:22:20.463142] [DEBUG] [LOCAL     ] TALO: Loaded 51375 existing records from primary storage.
[2025-10-24T21:22:20.485391] [DEBUG] [LOCAL     ] TAP: Loaded 53338 existing records from primary storage.
[2025-10-24T21:22:20.520815] [INFO ] [MAIN      ] TAP: Loaded 53338 existing records.
[2025-10-24T21:22:20.520621] [INFO ] [MAIN      ] TALO: Loaded 51375 existing records.
[2025-10-24T21:22:20.836584] [WARN ] [MAIN      ] TAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:22:20.889774] [INFO ] [MAIN      ] TAL: Wiping existing primary data before full refresh.
[2025-10-24T21:22:20.997685] [WARN ] [MAIN      ] TAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:22:20.994619] [INFO ] [LOCAL     ] TAL: Starting deletion of primary data.
[2025-10-24T21:22:21.085038] [INFO ] [MAIN      ] TAK: Wiping existing primary data before full refresh.
[2025-10-24T21:22:21.084690] [WARN ] [MAIN      ] TAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:22:21.085164] [INFO ] [LOCAL     ] TAK: Starting deletion of primary data.
[2025-10-24T21:22:21.085276] [INFO ] [MAIN      ] TAP: Wiping existing primary data before full refresh.
[2025-10-24T21:22:21.085381] [INFO ] [LOCAL     ] TAP: Starting deletion of primary data.
[2025-10-24T21:22:21.085507] [DEBUG] [LOCAL     ] TAL: Deleted primary data file.
[2025-10-24T21:22:21.085609] [INFO ] [MAIN      ] TAL: Starting full primary refresh.
[2025-10-24T21:22:21.090939] [DEBUG] [LOCAL     ] TAP: Deleted primary data file.
[2025-10-24T21:22:21.091131] [DEBUG] [LOCAL     ] TAK: Deleted primary data file.
[2025-10-24T21:22:21.091086] [INFO ] [MAIN      ] TAP: Starting full primary refresh.
[2025-10-24T21:22:21.200470] [WARN ] [MAIN      ] TALO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:22:21.143275] [INFO ] [MAIN      ] TAK: Starting full primary refresh.
[2025-10-24T21:22:21.278625] [INFO ] [MAIN      ] TALO: Wiping existing primary data before full refresh.
[2025-10-24T21:22:21.296663] [INFO ] [LOCAL     ] TALO: Starting deletion of primary data.
[2025-10-24T21:22:21.360079] [DEBUG] [LOCAL     ] TALO: Deleted primary data file.
[2025-10-24T21:22:21.404764] [INFO ] [MAIN      ] TALO: Starting full primary refresh.
[2025-10-24T21:22:22.360186] [INFO ] [REMOTE    ] TAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:22:22.421353] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-01.
[2025-10-24T21:22:22.366619] [INFO ] [REMOTE    ] TAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:22:22.433377] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-01.
[2025-10-24T21:22:22.535088] [INFO ] [REMOTE    ] TAK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:22:22.550579] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-01.
[2025-10-24T21:22:22.649560] [INFO ] [REMOTE    ] TALO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:22:22.649925] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-01.
[2025-10-24T21:22:24.139856] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T21:22:24.150521] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-02.
[2025-10-24T21:22:24.194962] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T21:22:24.205351] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-02.
[2025-10-24T21:22:24.265437] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T21:22:24.276050] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-02.
[2025-10-24T21:22:24.308180] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T21:22:24.318195] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-02.
[2025-10-24T21:22:25.462894] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T21:22:25.472328] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-03.
[2025-10-24T21:22:25.850869] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-02 (1.53 seconds).
[2025-10-24T21:22:25.860915] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-03.
[2025-10-24T21:22:25.890763] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T21:22:25.901831] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-03.
[2025-10-24T21:22:25.946179] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T21:22:25.956583] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-03.
[2025-10-24T21:22:26.994284] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T21:22:27.004858] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-04.
[2025-10-24T21:22:27.291978] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T21:22:27.303275] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-04.
[2025-10-24T21:22:27.346811] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T21:22:27.361568] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-04.
[2025-10-24T21:22:27.523721] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T21:22:27.535038] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-04.
[2025-10-24T21:22:28.254700] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-04 (1.25 seconds).
[2025-10-24T21:22:28.265278] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-05.
[2025-10-24T21:22:29.095842] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-04 (1.79 seconds).
[2025-10-24T21:22:29.107808] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-05.
[2025-10-24T21:22:29.270021] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-04 (1.91 seconds).
[2025-10-24T21:22:29.310932] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T21:22:29.735028] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T21:22:29.747596] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-06.
[2025-10-24T21:22:30.547698] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-05.
[2025-10-24T21:22:30.888551] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T21:22:31.347707] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-05.
[2025-10-24T21:22:31.416931] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T21:22:32.147729] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-06.
[2025-10-24T21:22:32.351810] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T21:22:32.947632] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-06.
[2025-10-24T21:22:33.006114] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T21:22:33.747608] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-06.
[2025-10-24T21:22:33.859931] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T21:22:34.547625] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-07.
[2025-10-24T21:22:34.760310] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-06 (1.81 seconds).
[2025-10-24T21:22:35.342375] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T21:22:35.351718] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-07.
[2025-10-24T21:22:36.081574] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T21:22:36.147621] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-07.
[2025-10-24T21:22:36.947632] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-08.
[2025-10-24T21:22:37.251721] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T21:22:37.747626] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-07.
[2025-10-24T21:22:37.918689] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T21:22:38.547712] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-08.
[2025-10-24T21:22:38.738621] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T21:22:39.347703] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-08.
[2025-10-24T21:22:39.401186] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T21:22:40.147675] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-09.
[2025-10-24T21:22:40.265186] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T21:22:40.947713] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-08.
[2025-10-24T21:22:41.211192] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-08 (1.86 seconds).
[2025-10-24T21:22:41.570452] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T21:22:41.747714] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-09.
[2025-10-24T21:22:42.232084] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-08 (1.28 seconds).
[2025-10-24T21:22:42.547745] [INFO ] [REMOTE    ] TAL: Fetching primary data for 2025-10.
[2025-10-24T21:22:43.347667] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-09.
[2025-10-24T21:22:43.671885] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-09 (1.92 seconds).
[2025-10-24T21:22:44.147737] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-09.
[2025-10-24T21:22:44.267833] [INFO ] [REMOTE    ] TAL: Incremental fetch complete for 2025-10 (1.72 seconds).
[2025-10-24T21:22:44.277755] [INFO ] [REMOTE    ] TAL: Full fetch complete (75683 records).
[2025-10-24T21:22:44.277910] [DEBUG] [VALIDATOR ] TAL: Validating primary data.
[2025-10-24T21:22:44.667926] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present.
[2025-10-24T21:22:44.668085] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed.
[2025-10-24T21:22:44.669309] [INFO ] [MAIN      ] TAL: Fetched primary data is valid.
[2025-10-24T21:22:44.669397] [DEBUG] [LOCAL     ] TAL: Saving primary data.
[2025-10-24T21:22:44.670077] [FATAL] [LOCAL     ] TAL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:22:44.670163] [FATAL] [MAIN      ] TAL: Failed to save primary data.
[2025-10-24T21:22:44.670235] [WARN ] [MAIN      ] TAL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:22:44.670324] [INFO ] [LOCAL     ] TAL: Starting deletion of primary data.
[2025-10-24T21:22:44.670386] [DEBUG] [LOCAL     ] TAL: No primary data file found to delete.
[2025-10-24T21:22:44.670423] [INFO ] [LOCAL     ] TAL: Starting deletion of derivative data.
[2025-10-24T21:22:44.670577] [DEBUG] [LOCAL     ] TAL: Deleted derivative data file.
[2025-10-24T21:22:44.670933] [INFO ] [MAIN      ] Update Progress: 2041/2366 symbols completed. TAL took 25.2s. Estimated remaining: 41m 50s. Rate: 7.8 symbols/min
[2025-10-24T21:22:44.840086] [INFO ] [MAIN      ] TBB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:22:44.853528] [DEBUG] [LOCAL     ] TBB: Loaded 11343 existing records from primary storage.
[2025-10-24T21:22:44.853785] [INFO ] [MAIN      ] TBB: Loaded 11343 existing records.
[2025-10-24T21:22:44.954452] [INFO ] [REMOTE    ] TAP: Fetching primary data for 2025-10.
[2025-10-24T21:22:45.054454] [WARN ] [MAIN      ] TBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:22:45.073086] [INFO ] [MAIN      ] TBB: Wiping existing primary data before full refresh.
[2025-10-24T21:22:45.073262] [INFO ] [LOCAL     ] TBB: Starting deletion of primary data.
[2025-10-24T21:22:45.073956] [DEBUG] [LOCAL     ] TBB: Deleted primary data file.
[2025-10-24T21:22:45.074024] [INFO ] [MAIN      ] TBB: Starting full primary refresh.
[2025-10-24T21:22:45.075336] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T21:22:45.445278] [INFO ] [REMOTE    ] TBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:22:45.486457] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-09 (1.34 seconds).
[2025-10-24T21:22:45.747699] [INFO ] [REMOTE    ] TAK: Fetching primary data for 2025-10.
[2025-10-24T21:22:46.547682] [INFO ] [REMOTE    ] TALO: Fetching primary data for 2025-10.
[2025-10-24T21:22:46.858799] [INFO ] [REMOTE    ] TAP: Incremental fetch complete for 2025-10 (1.90 seconds).
[2025-10-24T21:22:46.868520] [INFO ] [REMOTE    ] TAP: Full fetch complete (76517 records).
[2025-10-24T21:22:46.868682] [DEBUG] [VALIDATOR ] TAP: Validating primary data.
[2025-10-24T21:22:47.261452] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present.
[2025-10-24T21:22:47.261690] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed.
[2025-10-24T21:22:47.262878] [INFO ] [MAIN      ] TAP: Fetched primary data is valid.
[2025-10-24T21:22:47.262950] [DEBUG] [LOCAL     ] TAP: Saving primary data.
[2025-10-24T21:22:47.263626] [FATAL] [LOCAL     ] TAP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:22:47.263989] [FATAL] [MAIN      ] TAP: Failed to save primary data.
[2025-10-24T21:22:47.264432] [WARN ] [MAIN      ] TAP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:22:47.264837] [INFO ] [LOCAL     ] TAP: Starting deletion of primary data.
[2025-10-24T21:22:47.273919] [DEBUG] [LOCAL     ] TAP: No primary data file found to delete.
[2025-10-24T21:22:47.279363] [INFO ] [LOCAL     ] TAP: Starting deletion of derivative data.
[2025-10-24T21:22:47.288967] [DEBUG] [LOCAL     ] TAP: Deleted derivative data file.
[2025-10-24T21:22:47.289915] [INFO ] [MAIN      ] Update Progress: 2042/2366 symbols completed. TAP took 27.8s. Estimated remaining: 41m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:22:47.290956] [INFO ] [REMOTE    ] TAK: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T21:22:47.360242] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-01.
[2025-10-24T21:22:47.409693] [INFO ] [REMOTE    ] TAK: Full fetch complete (72026 records).
[2025-10-24T21:22:47.410303] [DEBUG] [VALIDATOR ] TAK: Validating primary data.
[2025-10-24T21:22:47.587170] [INFO ] [MAIN      ] TBBB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:22:47.888538] [DEBUG] [LOCAL     ] TBBB: Loaded 35816 existing records from primary storage.
[2025-10-24T21:22:47.907551] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present.
[2025-10-24T21:22:47.907927] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed.
[2025-10-24T21:22:47.909283] [INFO ] [MAIN      ] TAK: Fetched primary data is valid.
[2025-10-24T21:22:47.909489] [INFO ] [MAIN      ] TBBB: Loaded 35816 existing records.
[2025-10-24T21:22:47.909595] [DEBUG] [LOCAL     ] TAK: Saving primary data.
[2025-10-24T21:22:47.953283] [FATAL] [LOCAL     ] TAK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:22:47.974812] [FATAL] [MAIN      ] TAK: Failed to save primary data.
[2025-10-24T21:22:48.013696] [WARN ] [MAIN      ] TAK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:22:48.019753] [INFO ] [LOCAL     ] TAK: Starting deletion of primary data.
[2025-10-24T21:22:48.053443] [DEBUG] [LOCAL     ] TAK: No primary data file found to delete.
[2025-10-24T21:22:48.110097] [WARN ] [MAIN      ] TBBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:22:48.124503] [INFO ] [MAIN      ] TBBB: Wiping existing primary data before full refresh.
[2025-10-24T21:22:48.124680] [INFO ] [LOCAL     ] TBBB: Starting deletion of primary data.
[2025-10-24T21:22:48.124383] [INFO ] [LOCAL     ] TAK: Starting deletion of derivative data.
[2025-10-24T21:22:48.125916] [DEBUG] [LOCAL     ] TBBB: Deleted primary data file.
[2025-10-24T21:22:48.127811] [INFO ] [REMOTE    ] TALO: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T21:22:48.125866] [DEBUG] [LOCAL     ] TAK: Deleted derivative data file.
[2025-10-24T21:22:48.137158] [INFO ] [MAIN      ] TBBB: Starting full primary refresh.
[2025-10-24T21:22:48.148958] [INFO ] [MAIN      ] Update Progress: 2043/2366 symbols completed. TAK took 28.6s. Estimated remaining: 41m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:22:48.215767] [INFO ] [REMOTE    ] TALO: Full fetch complete (73407 records).
[2025-10-24T21:22:48.284028] [DEBUG] [VALIDATOR ] TALO: Validating primary data.
[2025-10-24T21:22:48.482819] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T21:22:48.686565] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-02.
[2025-10-24T21:22:48.757032] [INFO ] [MAIN      ] TBI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:22:49.063297] [INFO ] [REMOTE    ] TBBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:22:49.088726] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-01.
[2025-10-24T21:22:49.105420] [DEBUG] [LOCAL     ] TBI: Loaded 22933 existing records from primary storage.
[2025-10-24T21:22:49.122300] [INFO ] [MAIN      ] TBI: Loaded 22933 existing records.
[2025-10-24T21:22:49.274916] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present.
[2025-10-24T21:22:49.287919] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed.
[2025-10-24T21:22:49.294494] [INFO ] [MAIN      ] TALO: Fetched primary data is valid.
[2025-10-24T21:22:49.294588] [DEBUG] [LOCAL     ] TALO: Saving primary data.
[2025-10-24T21:22:49.307064] [FATAL] [LOCAL     ] TALO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:22:49.315810] [FATAL] [MAIN      ] TALO: Failed to save primary data.
[2025-10-24T21:22:49.319413] [WARN ] [MAIN      ] TALO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:22:49.319609] [INFO ] [LOCAL     ] TALO: Starting deletion of primary data.
[2025-10-24T21:22:49.320476] [DEBUG] [LOCAL     ] TALO: No primary data file found to delete.
[2025-10-24T21:22:49.331295] [INFO ] [LOCAL     ] TALO: Starting deletion of derivative data.
[2025-10-24T21:22:49.346913] [DEBUG] [LOCAL     ] TALO: Deleted derivative data file.
[2025-10-24T21:22:49.360339] [INFO ] [MAIN      ] Update Progress: 2044/2366 symbols completed. TALO took 29.8s. Estimated remaining: 41m 24s. Rate: 7.8 symbols/min
[2025-10-24T21:22:49.486514] [WARN ] [MAIN      ] TBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:22:49.508362] [INFO ] [MAIN      ] TBI: Wiping existing primary data before full refresh.
[2025-10-24T21:22:49.508551] [INFO ] [LOCAL     ] TBI: Starting deletion of primary data.
[2025-10-24T21:22:49.524909] [DEBUG] [LOCAL     ] TBI: Deleted primary data file.
[2025-10-24T21:22:49.535255] [INFO ] [MAIN      ] TBI: Starting full primary refresh.
[2025-10-24T21:22:49.658728] [INFO ] [MAIN      ] TBLU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:22:49.664130] [DEBUG] [LOCAL     ] TBLU: No existing data file found in primary storage.
[2025-10-24T21:22:49.665032] [WARN ] [MAIN      ] TBLU: No existing data found, performing full refresh instead.
[2025-10-24T21:22:49.683363] [INFO ] [MAIN      ] TBLU: Wiping existing primary data before full refresh.
[2025-10-24T21:22:49.697937] [INFO ] [LOCAL     ] TBLU: Starting deletion of primary data.
[2025-10-24T21:22:49.698063] [DEBUG] [LOCAL     ] TBLU: No primary data file found to delete.
[2025-10-24T21:22:49.672888] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T21:22:49.698157] [INFO ] [MAIN      ] TBLU: Starting full primary refresh.
[2025-10-24T21:22:49.748941] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-03.
[2025-10-24T21:22:50.261702] [INFO ] [REMOTE    ] TBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:22:50.372544] [INFO ] [REMOTE    ] TBLU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:22:50.388971] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T21:22:50.547722] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-01.
[2025-10-24T21:22:50.675034] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T21:22:51.347679] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-04.
[2025-10-24T21:22:51.501187] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T21:22:52.120162] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T21:22:52.147609] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-02.
[2025-10-24T21:22:52.947751] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-01.
[2025-10-24T21:22:53.223049] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-02 (1.08 seconds).
[2025-10-24T21:22:53.319395] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-01 (0.37 seconds).
[2025-10-24T21:22:53.747702] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-02.
[2025-10-24T21:22:54.547680] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-03.
[2025-10-24T21:22:55.350745] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-05.
[2025-10-24T21:22:55.353525] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T21:22:55.720156] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T21:22:55.923017] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T21:22:56.147674] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-02.
[2025-10-24T21:22:56.523525] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-02 (0.38 seconds).
[2025-10-24T21:22:56.947707] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-03.
[2025-10-24T21:22:57.268387] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-03 (0.32 seconds).
[2025-10-24T21:22:57.747708] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-03.
[2025-10-24T21:22:58.547721] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-04.
[2025-10-24T21:22:58.890982] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-04 (0.34 seconds).
[2025-10-24T21:22:59.196538] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T21:22:59.347675] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-04.
[2025-10-24T21:23:00.147690] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-06.
[2025-10-24T21:23:00.947762] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-05.
[2025-10-24T21:23:01.747713] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-04.
[2025-10-24T21:23:05.510480] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-05 (4.56 seconds).
[2025-10-24T21:23:05.511394] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-06.
[2025-10-24T21:23:05.643344] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-04 (6.30 seconds).
[2025-10-24T21:23:05.649402] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-05.
[2025-10-24T21:23:05.681521] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-06 (5.53 seconds).
[2025-10-24T21:23:05.685308] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-07.
[2025-10-24T21:23:05.973685] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T21:23:05.974702] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-07.
[2025-10-24T21:23:06.460975] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-04 (4.71 seconds).
[2025-10-24T21:23:06.469678] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-05.
[2025-10-24T21:23:06.507402] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T21:23:06.530546] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T21:23:06.529897] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-07 (0.56 seconds).
[2025-10-24T21:23:06.547601] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-06.
[2025-10-24T21:23:07.347695] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-08.
[2025-10-24T21:23:07.534246] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-06 (0.99 seconds).
[2025-10-24T21:23:07.885378] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T21:23:07.925094] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-08 (0.58 seconds).
[2025-10-24T21:23:08.147688] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-06.
[2025-10-24T21:23:08.947691] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-08.
[2025-10-24T21:23:09.288042] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-08 (0.34 seconds).
[2025-10-24T21:23:09.475254] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T21:23:09.747631] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-07.
[2025-10-24T21:23:10.547700] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-09.
[2025-10-24T21:23:11.191198] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T21:23:11.190944] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T21:23:11.347673] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-07.
[2025-10-24T21:23:12.147603] [INFO ] [REMOTE    ] TBB: Fetching primary data for 2025-10.
[2025-10-24T21:23:12.527493] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T21:23:12.690227] [INFO ] [REMOTE    ] TBB: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T21:23:12.692298] [INFO ] [REMOTE    ] TBB: Full fetch complete (16196 records).
[2025-10-24T21:23:12.692368] [DEBUG] [VALIDATOR ] TBB: Validating primary data.
[2025-10-24T21:23:12.952828] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-08.
[2025-10-24T21:23:13.056593] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present.
[2025-10-24T21:23:13.056716] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed.
[2025-10-24T21:23:13.057130] [INFO ] [MAIN      ] TBB: Fetched primary data is valid.
[2025-10-24T21:23:13.057189] [DEBUG] [LOCAL     ] TBB: Saving primary data.
[2025-10-24T21:23:13.057429] [FATAL] [LOCAL     ] TBB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:23:13.057519] [FATAL] [MAIN      ] TBB: Failed to save primary data.
[2025-10-24T21:23:13.057606] [WARN ] [MAIN      ] TBB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:23:13.057702] [INFO ] [LOCAL     ] TBB: Starting deletion of primary data.
[2025-10-24T21:23:13.057766] [DEBUG] [LOCAL     ] TBB: No primary data file found to delete.
[2025-10-24T21:23:13.057802] [INFO ] [LOCAL     ] TBB: Starting deletion of derivative data.
[2025-10-24T21:23:13.057953] [DEBUG] [LOCAL     ] TBB: Deleted derivative data file.
[2025-10-24T21:23:13.058043] [INFO ] [MAIN      ] Update Progress: 2045/2366 symbols completed. TBB took 28.4s. Estimated remaining: 41m 19s. Rate: 7.8 symbols/min
[2025-10-24T21:23:13.230285] [INFO ] [MAIN      ] TBN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:23:13.237810] [DEBUG] [LOCAL     ] TBN: Loaded 4269 existing records from primary storage.
[2025-10-24T21:23:13.238030] [INFO ] [MAIN      ] TBN: Loaded 4269 existing records.
[2025-10-24T21:23:13.412760] [WARN ] [MAIN      ] TBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:23:13.412957] [INFO ] [MAIN      ] TBN: Wiping existing primary data before full refresh.
[2025-10-24T21:23:13.413002] [INFO ] [LOCAL     ] TBN: Starting deletion of primary data.
[2025-10-24T21:23:13.413174] [DEBUG] [LOCAL     ] TBN: Deleted primary data file.
[2025-10-24T21:23:13.413228] [INFO ] [MAIN      ] TBN: Starting full primary refresh.
[2025-10-24T21:23:13.760143] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-08.
[2025-10-24T21:23:13.765302] [INFO ] [REMOTE    ] TBN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:23:14.393004] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T21:23:14.547704] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-09.
[2025-10-24T21:23:14.782465] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T21:23:15.347747] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-01.
[2025-10-24T21:23:15.927720] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T21:23:16.002413] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-01 (0.65 seconds).
[2025-10-24T21:23:16.147714] [INFO ] [REMOTE    ] TBBB: Fetching primary data for 2025-10.
[2025-10-24T21:23:16.947729] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-09.
[2025-10-24T21:23:17.378436] [INFO ] [REMOTE    ] TBBB: Incremental fetch complete for 2025-10 (1.23 seconds).
[2025-10-24T21:23:17.385925] [INFO ] [REMOTE    ] TBBB: Full fetch complete (52327 records).
[2025-10-24T21:23:17.386077] [DEBUG] [VALIDATOR ] TBBB: Validating primary data.
[2025-10-24T21:23:17.747683] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-09.
[2025-10-24T21:23:17.791519] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present.
[2025-10-24T21:23:17.791636] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed.
[2025-10-24T21:23:17.793672] [INFO ] [MAIN      ] TBBB: Fetched primary data is valid.
[2025-10-24T21:23:17.793865] [DEBUG] [LOCAL     ] TBBB: Saving primary data.
[2025-10-24T21:23:17.794433] [FATAL] [LOCAL     ] TBBB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:23:17.794517] [FATAL] [MAIN      ] TBBB: Failed to save primary data.
[2025-10-24T21:23:17.794594] [WARN ] [MAIN      ] TBBB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:23:17.794703] [INFO ] [LOCAL     ] TBBB: Starting deletion of primary data.
[2025-10-24T21:23:17.794797] [DEBUG] [LOCAL     ] TBBB: No primary data file found to delete.
[2025-10-24T21:23:17.794849] [INFO ] [LOCAL     ] TBBB: Starting deletion of derivative data.
[2025-10-24T21:23:17.795031] [DEBUG] [LOCAL     ] TBBB: Deleted derivative data file.
[2025-10-24T21:23:17.795150] [INFO ] [MAIN      ] Update Progress: 2046/2366 symbols completed. TBBB took 30.5s. Estimated remaining: 41m 10s. Rate: 7.8 symbols/min
[2025-10-24T21:23:17.982891] [INFO ] [MAIN      ] TCAI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:23:17.988408] [DEBUG] [LOCAL     ] TCAI: No existing data file found in primary storage.
[2025-10-24T21:23:17.993989] [WARN ] [MAIN      ] TCAI: No existing data found, performing full refresh instead.
[2025-10-24T21:23:17.995147] [INFO ] [MAIN      ] TCAI: Wiping existing primary data before full refresh.
[2025-10-24T21:23:17.995034] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T21:23:17.995281] [INFO ] [LOCAL     ] TCAI: Starting deletion of primary data.
[2025-10-24T21:23:17.995478] [DEBUG] [LOCAL     ] TCAI: No primary data file found to delete.
[2025-10-24T21:23:18.000021] [INFO ] [MAIN      ] TCAI: Starting full primary refresh.
[2025-10-24T21:23:18.199312] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T21:23:18.393139] [INFO ] [REMOTE    ] TCAI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:23:18.547690] [INFO ] [REMOTE    ] TCAI: Fetching primary data for 2025-01.
[2025-10-24T21:23:18.783026] [DEBUG] [REMOTE    ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:23:18.783347] [WARN ] [REMOTE    ] TCAI: No data returned for month 2025-01
[2025-10-24T21:23:18.783434] [FATAL] [REMOTE    ] TCAI: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:23:18.783483] [FATAL] [MAIN      ] TCAI: Failed to fetch primary data.
[2025-10-24T21:23:18.783517] [WARN ] [MAIN      ] TCAI: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:23:18.783552] [INFO ] [LOCAL     ] TCAI: Starting deletion of primary data.
[2025-10-24T21:23:18.783605] [DEBUG] [LOCAL     ] TCAI: No primary data file found to delete.
[2025-10-24T21:23:18.783639] [INFO ] [LOCAL     ] TCAI: Starting deletion of derivative data.
[2025-10-24T21:23:18.783729] [DEBUG] [LOCAL     ] TCAI: No derivative data file found to delete.
[2025-10-24T21:23:18.783780] [INFO ] [MAIN      ] Update Progress: 2047/2366 symbols completed. TCAI took 1.0s. Estimated remaining: 41m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:23:18.950383] [INFO ] [MAIN      ] TCBX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:23:18.962725] [DEBUG] [LOCAL     ] TCBX: Loaded 10283 existing records from primary storage.
[2025-10-24T21:23:18.962964] [INFO ] [MAIN      ] TCBX: Loaded 10283 existing records.
[2025-10-24T21:23:19.138752] [WARN ] [MAIN      ] TCBX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:23:19.138997] [INFO ] [MAIN      ] TCBX: Wiping existing primary data before full refresh.
[2025-10-24T21:23:19.139048] [INFO ] [LOCAL     ] TCBX: Starting deletion of primary data.
[2025-10-24T21:23:19.139232] [DEBUG] [LOCAL     ] TCBX: Deleted primary data file.
[2025-10-24T21:23:19.139269] [INFO ] [MAIN      ] TCBX: Starting full primary refresh.
[2025-10-24T21:23:19.352978] [INFO ] [REMOTE    ] TBLU: Fetching primary data for 2025-10.
[2025-10-24T21:23:19.489259] [INFO ] [REMOTE    ] TCBX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:23:19.768324] [INFO ] [REMOTE    ] TBLU: Incremental fetch complete for 2025-10 (0.42 seconds).
[2025-10-24T21:23:19.769330] [INFO ] [REMOTE    ] TBLU: Full fetch complete (1219 records).
[2025-10-24T21:23:19.769400] [DEBUG] [VALIDATOR ] TBLU: Validating primary data.
[2025-10-24T21:23:19.958315] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days
[2025-10-24T21:23:19.958529] [FATAL] [MAIN      ] TBLU: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:23:19.958577] [WARN ] [MAIN      ] TBLU: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:23:19.958617] [INFO ] [LOCAL     ] TBLU: Starting deletion of primary data.
[2025-10-24T21:23:19.958705] [DEBUG] [LOCAL     ] TBLU: No primary data file found to delete.
[2025-10-24T21:23:19.958755] [INFO ] [LOCAL     ] TBLU: Starting deletion of derivative data.
[2025-10-24T21:23:19.958797] [DEBUG] [LOCAL     ] TBLU: No derivative data file found to delete.
[2025-10-24T21:23:19.958854] [INFO ] [MAIN      ] Update Progress: 2048/2366 symbols completed. TBLU took 30.6s. Estimated remaining: 40m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:23:20.153544] [INFO ] [REMOTE    ] TBI: Fetching primary data for 2025-10.
[2025-10-24T21:23:20.154506] [INFO ] [MAIN      ] TCPA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:23:20.155895] [DEBUG] [LOCAL     ] TCPA: No existing data file found in primary storage.
[2025-10-24T21:23:20.156050] [WARN ] [MAIN      ] TCPA: No existing data found, performing full refresh instead.
[2025-10-24T21:23:20.156167] [INFO ] [MAIN      ] TCPA: Wiping existing primary data before full refresh.
[2025-10-24T21:23:20.156211] [INFO ] [LOCAL     ] TCPA: Starting deletion of primary data.
[2025-10-24T21:23:20.156254] [DEBUG] [LOCAL     ] TCPA: No primary data file found to delete.
[2025-10-24T21:23:20.156288] [INFO ] [MAIN      ] TCPA: Starting full primary refresh.
[2025-10-24T21:23:20.537745] [INFO ] [REMOTE    ] TCPA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:23:20.947616] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-02.
[2025-10-24T21:23:21.271986] [INFO ] [REMOTE    ] TBI: Incremental fetch complete for 2025-10 (1.12 seconds).
[2025-10-24T21:23:21.277177] [INFO ] [REMOTE    ] TBI: Full fetch complete (32129 records).
[2025-10-24T21:23:21.277284] [DEBUG] [VALIDATOR ] TBI: Validating primary data.
[2025-10-24T21:23:21.641259] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present.
[2025-10-24T21:23:21.647026] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed.
[2025-10-24T21:23:21.647827] [INFO ] [MAIN      ] TBI: Fetched primary data is valid.
[2025-10-24T21:23:21.648188] [DEBUG] [LOCAL     ] TBI: Saving primary data.
[2025-10-24T21:23:21.648087] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-02 (0.70 seconds).
[2025-10-24T21:23:21.648683] [FATAL] [LOCAL     ] TBI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:23:21.651094] [FATAL] [MAIN      ] TBI: Failed to save primary data.
[2025-10-24T21:23:21.651168] [WARN ] [MAIN      ] TBI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:23:21.651238] [INFO ] [LOCAL     ] TBI: Starting deletion of primary data.
[2025-10-24T21:23:21.651300] [DEBUG] [LOCAL     ] TBI: No primary data file found to delete.
[2025-10-24T21:23:21.651337] [INFO ] [LOCAL     ] TBI: Starting deletion of derivative data.
[2025-10-24T21:23:21.651506] [DEBUG] [LOCAL     ] TBI: Deleted derivative data file.
[2025-10-24T21:23:21.651605] [INFO ] [MAIN      ] Update Progress: 2049/2366 symbols completed. TBI took 33.5s. Estimated remaining: 40m 44s. Rate: 7.8 symbols/min
[2025-10-24T21:23:21.752766] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-03.
[2025-10-24T21:23:21.850768] [INFO ] [MAIN      ] TD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:23:21.904383] [DEBUG] [LOCAL     ] TD: Loaded 52588 existing records from primary storage.
[2025-10-24T21:23:21.904854] [INFO ] [MAIN      ] TD: Loaded 52588 existing records.
[2025-10-24T21:23:22.090098] [WARN ] [MAIN      ] TD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:23:22.090405] [INFO ] [MAIN      ] TD: Wiping existing primary data before full refresh.
[2025-10-24T21:23:22.090459] [INFO ] [LOCAL     ] TD: Starting deletion of primary data.
[2025-10-24T21:23:22.091138] [DEBUG] [LOCAL     ] TD: Deleted primary data file.
[2025-10-24T21:23:22.091199] [INFO ] [MAIN      ] TD: Starting full primary refresh.
[2025-10-24T21:23:22.407223] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-03 (0.65 seconds).
[2025-10-24T21:23:22.484936] [INFO ] [REMOTE    ] TD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:23:22.547731] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-04.
[2025-10-24T21:23:22.964592] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-04 (0.42 seconds).
[2025-10-24T21:23:23.347692] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-01.
[2025-10-24T21:23:24.147705] [INFO ] [REMOTE    ] TCPA: Fetching primary data for 2025-01.
[2025-10-24T21:23:24.304100] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-01 (0.96 seconds).
[2025-10-24T21:23:24.374607] [DEBUG] [REMOTE    ] TCPA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:23:24.375015] [WARN ] [REMOTE    ] TCPA: No data returned for month 2025-01
[2025-10-24T21:23:24.375109] [FATAL] [REMOTE    ] TCPA: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:23:24.375156] [FATAL] [MAIN      ] TCPA: Failed to fetch primary data.
[2025-10-24T21:23:24.375193] [WARN ] [MAIN      ] TCPA: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:23:24.375259] [INFO ] [LOCAL     ] TCPA: Starting deletion of primary data.
[2025-10-24T21:23:24.375364] [DEBUG] [LOCAL     ] TCPA: No primary data file found to delete.
[2025-10-24T21:23:24.375408] [INFO ] [LOCAL     ] TCPA: Starting deletion of derivative data.
[2025-10-24T21:23:24.375449] [DEBUG] [LOCAL     ] TCPA: No derivative data file found to delete.
[2025-10-24T21:23:24.375496] [INFO ] [MAIN      ] Update Progress: 2050/2366 symbols completed. TCPA took 4.4s. Estimated remaining: 40m 36s. Rate: 7.8 symbols/min
[2025-10-24T21:23:24.552379] [INFO ] [MAIN      ] TDC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:23:24.599382] [DEBUG] [LOCAL     ] TDC: Loaded 46766 existing records from primary storage.
[2025-10-24T21:23:24.599741] [INFO ] [MAIN      ] TDC: Loaded 46766 existing records.
[2025-10-24T21:23:24.782360] [WARN ] [MAIN      ] TDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:23:24.782590] [INFO ] [MAIN      ] TDC: Wiping existing primary data before full refresh.
[2025-10-24T21:23:24.782637] [INFO ] [LOCAL     ] TDC: Starting deletion of primary data.
[2025-10-24T21:23:24.783223] [DEBUG] [LOCAL     ] TDC: Deleted primary data file.
[2025-10-24T21:23:24.783265] [INFO ] [MAIN      ] TDC: Starting full primary refresh.
[2025-10-24T21:23:24.948715] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-05.
[2025-10-24T21:23:25.141803] [INFO ] [REMOTE    ] TDC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:23:25.746353] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-05 (0.80 seconds).
[2025-10-24T21:23:25.747589] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-06.
[2025-10-24T21:23:26.404196] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-06 (0.66 seconds).
[2025-10-24T21:23:26.547723] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-01.
[2025-10-24T21:23:27.347698] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-02.
[2025-10-24T21:23:28.053924] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T21:23:28.147636] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-01.
[2025-10-24T21:23:28.167886] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T21:23:28.947703] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-03.
[2025-10-24T21:23:29.708442] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T21:23:29.747672] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-02.
[2025-10-24T21:23:29.795373] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T21:23:30.547639] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-07.
[2025-10-24T21:23:31.099422] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T21:23:31.326171] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T21:23:31.347594] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-03.
[2025-10-24T21:23:32.147699] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-02.
[2025-10-24T21:23:32.947629] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-04.
[2025-10-24T21:23:33.454602] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-03 (2.11 seconds).
[2025-10-24T21:23:33.747681] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-04.
[2025-10-24T21:23:33.802202] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T21:23:33.928397] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T21:23:34.547717] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-03.
[2025-10-24T21:23:35.347725] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-08.
[2025-10-24T21:23:35.457848] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T21:23:35.952419] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T21:23:36.147623] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-05.
[2025-10-24T21:23:36.412837] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T21:23:36.947726] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-05.
[2025-10-24T21:23:37.699916] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T21:23:37.752762] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-09.
[2025-10-24T21:23:37.767745] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T21:23:38.474995] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T21:23:38.547756] [INFO ] [REMOTE    ] TBN: Fetching primary data for 2025-10.
[2025-10-24T21:23:39.347615] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-04.
[2025-10-24T21:23:39.475680] [INFO ] [REMOTE    ] TBN: Incremental fetch complete for 2025-10 (0.93 seconds).
[2025-10-24T21:23:39.478353] [INFO ] [REMOTE    ] TBN: Full fetch complete (6308 records).
[2025-10-24T21:23:39.478436] [DEBUG] [VALIDATOR ] TBN: Validating primary data.
[2025-10-24T21:23:39.825099] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present.
[2025-10-24T21:23:39.825165] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed.
[2025-10-24T21:23:39.825330] [INFO ] [MAIN      ] TBN: Fetched primary data is valid.
[2025-10-24T21:23:39.825376] [DEBUG] [LOCAL     ] TBN: Saving primary data.
[2025-10-24T21:23:39.825560] [FATAL] [LOCAL     ] TBN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:23:39.825635] [FATAL] [MAIN      ] TBN: Failed to save primary data.
[2025-10-24T21:23:39.825714] [WARN ] [MAIN      ] TBN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:23:39.825795] [INFO ] [LOCAL     ] TBN: Starting deletion of primary data.
[2025-10-24T21:23:39.825851] [DEBUG] [LOCAL     ] TBN: No primary data file found to delete.
[2025-10-24T21:23:39.825886] [INFO ] [LOCAL     ] TBN: Starting deletion of derivative data.
[2025-10-24T21:23:39.826067] [DEBUG] [LOCAL     ] TBN: Deleted derivative data file.
[2025-10-24T21:23:39.826167] [INFO ] [MAIN      ] Update Progress: 2051/2366 symbols completed. TBN took 26.8s. Estimated remaining: 40m 29s. Rate: 7.8 symbols/min
[2025-10-24T21:23:39.990930] [INFO ] [MAIN      ] TDF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:23:39.999910] [DEBUG] [LOCAL     ] TDF: Loaded 6235 existing records from primary storage.
[2025-10-24T21:23:40.000119] [INFO ] [MAIN      ] TDF: Loaded 6235 existing records.
[2025-10-24T21:23:40.149820] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-06.
[2025-10-24T21:23:40.177503] [WARN ] [MAIN      ] TDF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:23:40.177724] [INFO ] [MAIN      ] TDF: Wiping existing primary data before full refresh.
[2025-10-24T21:23:40.177775] [INFO ] [LOCAL     ] TDF: Starting deletion of primary data.
[2025-10-24T21:23:40.177992] [DEBUG] [LOCAL     ] TDF: Deleted primary data file.
[2025-10-24T21:23:40.178029] [INFO ] [MAIN      ] TDF: Starting full primary refresh.
[2025-10-24T21:23:40.530235] [INFO ] [REMOTE    ] TDF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:23:40.947638] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-01.
[2025-10-24T21:23:41.130674] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T21:23:41.688715] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T21:23:41.747735] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-05.
[2025-10-24T21:23:41.794554] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T21:23:42.547727] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-02.
[2025-10-24T21:23:43.330883] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T21:23:43.347602] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-03.
[2025-10-24T21:23:43.447904] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-05 (1.70 seconds).
[2025-10-24T21:23:44.131502] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-03 (0.78 seconds).
[2025-10-24T21:23:44.147611] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-04.
[2025-10-24T21:23:44.886876] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T21:23:44.947702] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-05.
[2025-10-24T21:23:45.594209] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T21:23:45.747733] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-06.
[2025-10-24T21:23:46.547761] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-06.
[2025-10-24T21:23:47.260431] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T21:23:47.347663] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-07.
[2025-10-24T21:23:47.594750] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T21:23:48.094117] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T21:23:48.147613] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-08.
[2025-10-24T21:23:48.858131] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-08 (0.71 seconds).
[2025-10-24T21:23:48.947682] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-06.
[2025-10-24T21:23:49.520763] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T21:23:49.747754] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-07.
[2025-10-24T21:23:50.547726] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-07.
[2025-10-24T21:23:51.347693] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-07.
[2025-10-24T21:23:51.550093] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T21:23:51.788000] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T21:23:51.948945] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-07 (0.60 seconds).
[2025-10-24T21:23:52.147705] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-08.
[2025-10-24T21:23:52.885935] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-08 (0.74 seconds).
[2025-10-24T21:23:52.947710] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-09.
[2025-10-24T21:23:53.696122] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:23:53.747624] [INFO ] [REMOTE    ] TCBX: Fetching primary data for 2025-10.
[2025-10-24T21:23:54.533763] [INFO ] [REMOTE    ] TCBX: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T21:23:54.537907] [INFO ] [REMOTE    ] TCBX: Full fetch complete (15779 records).
[2025-10-24T21:23:54.538009] [DEBUG] [VALIDATOR ] TCBX: Validating primary data.
[2025-10-24T21:23:54.552930] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-08.
[2025-10-24T21:23:54.937451] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present.
[2025-10-24T21:23:54.937586] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed.
[2025-10-24T21:23:54.938268] [INFO ] [MAIN      ] TCBX: Fetched primary data is valid.
[2025-10-24T21:23:54.938334] [DEBUG] [LOCAL     ] TCBX: Saving primary data.
[2025-10-24T21:23:54.938713] [FATAL] [LOCAL     ] TCBX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:23:54.938801] [FATAL] [MAIN      ] TCBX: Failed to save primary data.
[2025-10-24T21:23:54.938844] [WARN ] [MAIN      ] TCBX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:23:54.938879] [INFO ] [LOCAL     ] TCBX: Starting deletion of primary data.
[2025-10-24T21:23:54.938933] [DEBUG] [LOCAL     ] TCBX: No primary data file found to delete.
[2025-10-24T21:23:54.938969] [INFO ] [LOCAL     ] TCBX: Starting deletion of derivative data.
[2025-10-24T21:23:54.939187] [DEBUG] [LOCAL     ] TCBX: Deleted derivative data file.
[2025-10-24T21:23:54.939303] [INFO ] [MAIN      ] Update Progress: 2052/2366 symbols completed. TCBX took 36.2s. Estimated remaining: 40m 23s. Rate: 7.8 symbols/min
[2025-10-24T21:23:55.118544] [INFO ] [MAIN      ] TDG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:23:55.145247] [DEBUG] [LOCAL     ] TDG: Loaded 22110 existing records from primary storage.
[2025-10-24T21:23:55.145603] [INFO ] [MAIN      ] TDG: Loaded 22110 existing records.
[2025-10-24T21:23:55.365926] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-08.
[2025-10-24T21:23:55.371346] [WARN ] [MAIN      ] TDG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:23:55.371741] [INFO ] [MAIN      ] TDG: Wiping existing primary data before full refresh.
[2025-10-24T21:23:55.371980] [INFO ] [LOCAL     ] TDG: Starting deletion of primary data.
[2025-10-24T21:23:55.373154] [DEBUG] [LOCAL     ] TDG: Deleted primary data file.
[2025-10-24T21:23:55.373222] [INFO ] [MAIN      ] TDG: Starting full primary refresh.
[2025-10-24T21:23:55.752475] [INFO ] [REMOTE    ] TDG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:23:56.147670] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-09.
[2025-10-24T21:23:56.364210] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T21:23:56.529779] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-09 (0.38 seconds).
[2025-10-24T21:23:56.947690] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-09.
[2025-10-24T21:23:57.276263] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T21:23:57.747639] [INFO ] [REMOTE    ] TDF: Fetching primary data for 2025-10.
[2025-10-24T21:23:58.547746] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-09.
[2025-10-24T21:23:58.650211] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T21:23:58.650577] [INFO ] [REMOTE    ] TDF: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T21:23:58.663350] [INFO ] [REMOTE    ] TDF: Full fetch complete (10226 records).
[2025-10-24T21:23:58.664156] [DEBUG] [VALIDATOR ] TDF: Validating primary data.
[2025-10-24T21:23:59.049843] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present.
[2025-10-24T21:23:59.049925] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed.
[2025-10-24T21:23:59.050171] [INFO ] [MAIN      ] TDF: Fetched primary data is valid.
[2025-10-24T21:23:59.050211] [DEBUG] [LOCAL     ] TDF: Saving primary data.
[2025-10-24T21:23:59.050433] [FATAL] [LOCAL     ] TDF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:23:59.050517] [FATAL] [MAIN      ] TDF: Failed to save primary data.
[2025-10-24T21:23:59.050565] [WARN ] [MAIN      ] TDF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:23:59.050625] [INFO ] [LOCAL     ] TDF: Starting deletion of primary data.
[2025-10-24T21:23:59.050720] [DEBUG] [LOCAL     ] TDF: No primary data file found to delete.
[2025-10-24T21:23:59.050763] [INFO ] [LOCAL     ] TDF: Starting deletion of derivative data.
[2025-10-24T21:23:59.050943] [DEBUG] [LOCAL     ] TDF: Deleted derivative data file.
[2025-10-24T21:23:59.051032] [INFO ] [MAIN      ] Update Progress: 2053/2366 symbols completed. TDF took 19.2s. Estimated remaining: 40m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:23:59.222071] [INFO ] [MAIN      ] TDOC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:23:59.271395] [DEBUG] [LOCAL     ] TDOC: Loaded 53758 existing records from primary storage.
[2025-10-24T21:23:59.271743] [INFO ] [MAIN      ] TDOC: Loaded 53758 existing records.
[2025-10-24T21:23:59.352838] [INFO ] [REMOTE    ] TDC: Fetching primary data for 2025-10.
[2025-10-24T21:23:59.455916] [WARN ] [MAIN      ] TDOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:23:59.456118] [INFO ] [MAIN      ] TDOC: Wiping existing primary data before full refresh.
[2025-10-24T21:23:59.456201] [INFO ] [LOCAL     ] TDOC: Starting deletion of primary data.
[2025-10-24T21:23:59.456744] [DEBUG] [LOCAL     ] TDOC: Deleted primary data file.
[2025-10-24T21:23:59.456800] [INFO ] [MAIN      ] TDOC: Starting full primary refresh.
[2025-10-24T21:23:59.810517] [INFO ] [REMOTE    ] TDOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:24:00.147675] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-01.
[2025-10-24T21:24:00.217806] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T21:24:00.947631] [INFO ] [REMOTE    ] TD: Fetching primary data for 2025-10.
[2025-10-24T21:24:01.273514] [INFO ] [REMOTE    ] TDC: Incremental fetch complete for 2025-10 (1.92 seconds).
[2025-10-24T21:24:01.284440] [INFO ] [REMOTE    ] TDC: Full fetch complete (67849 records).
[2025-10-24T21:24:01.284703] [DEBUG] [VALIDATOR ] TDC: Validating primary data.
[2025-10-24T21:24:01.698352] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present.
[2025-10-24T21:24:01.698465] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed.
[2025-10-24T21:24:01.701249] [INFO ] [MAIN      ] TDC: Fetched primary data is valid.
[2025-10-24T21:24:01.701318] [DEBUG] [LOCAL     ] TDC: Saving primary data.
[2025-10-24T21:24:01.702194] [FATAL] [LOCAL     ] TDC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:24:01.702323] [FATAL] [MAIN      ] TDC: Failed to save primary data.
[2025-10-24T21:24:01.702369] [WARN ] [MAIN      ] TDC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:24:01.702405] [INFO ] [LOCAL     ] TDC: Starting deletion of primary data.
[2025-10-24T21:24:01.702689] [DEBUG] [LOCAL     ] TDC: No primary data file found to delete.
[2025-10-24T21:24:01.702795] [INFO ] [LOCAL     ] TDC: Starting deletion of derivative data.
[2025-10-24T21:24:01.703139] [DEBUG] [LOCAL     ] TDC: Deleted derivative data file.
[2025-10-24T21:24:01.703723] [INFO ] [MAIN      ] Update Progress: 2054/2366 symbols completed. TDC took 37.3s. Estimated remaining: 40m 6s. Rate: 7.8 symbols/min
[2025-10-24T21:24:01.748848] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-01.
[2025-10-24T21:24:01.889621] [INFO ] [MAIN      ] TDS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:24:01.933732] [DEBUG] [LOCAL     ] TDS: Loaded 42409 existing records from primary storage.
[2025-10-24T21:24:01.934119] [INFO ] [MAIN      ] TDS: Loaded 42409 existing records.
[2025-10-24T21:24:02.131249] [WARN ] [MAIN      ] TDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:24:02.131582] [INFO ] [MAIN      ] TDS: Wiping existing primary data before full refresh.
[2025-10-24T21:24:02.131761] [INFO ] [LOCAL     ] TDS: Starting deletion of primary data.
[2025-10-24T21:24:02.132501] [DEBUG] [LOCAL     ] TDS: Deleted primary data file.
[2025-10-24T21:24:02.132575] [INFO ] [MAIN      ] TDS: Starting full primary refresh.
[2025-10-24T21:24:02.359907] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-01 (2.21 seconds).
[2025-10-24T21:24:02.566057] [INFO ] [REMOTE    ] TDS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:24:02.560999] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-02.
[2025-10-24T21:24:02.595135] [INFO ] [REMOTE    ] TD: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T21:24:02.605163] [INFO ] [REMOTE    ] TD: Full fetch complete (75839 records).
[2025-10-24T21:24:02.605323] [DEBUG] [VALIDATOR ] TD: Validating primary data.
[2025-10-24T21:24:03.004319] [DEBUG] [VALIDATOR ] TD: All expected trading days are present.
[2025-10-24T21:24:03.004478] [DEBUG] [VALIDATOR ] TD: Primary data validation passed.
[2025-10-24T21:24:03.005743] [INFO ] [MAIN      ] TD: Fetched primary data is valid.
[2025-10-24T21:24:03.005898] [DEBUG] [LOCAL     ] TD: Saving primary data.
[2025-10-24T21:24:03.006617] [FATAL] [LOCAL     ] TD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:24:03.011955] [FATAL] [MAIN      ] TD: Failed to save primary data.
[2025-10-24T21:24:03.019703] [WARN ] [MAIN      ] TD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:24:03.020117] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T21:24:03.020312] [INFO ] [LOCAL     ] TD: Starting deletion of primary data.
[2025-10-24T21:24:03.025343] [DEBUG] [LOCAL     ] TD: No primary data file found to delete.
[2025-10-24T21:24:03.025400] [INFO ] [LOCAL     ] TD: Starting deletion of derivative data.
[2025-10-24T21:24:03.025568] [DEBUG] [LOCAL     ] TD: Deleted derivative data file.
[2025-10-24T21:24:03.026188] [INFO ] [MAIN      ] Update Progress: 2055/2366 symbols completed. TD took 41.4s. Estimated remaining: 39m 57s. Rate: 7.8 symbols/min
[2025-10-24T21:24:03.202959] [INFO ] [MAIN      ] TDW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:24:03.244867] [DEBUG] [LOCAL     ] TDW: Loaded 45265 existing records from primary storage.
[2025-10-24T21:24:03.245174] [INFO ] [MAIN      ] TDW: Loaded 45265 existing records.
[2025-10-24T21:24:03.349047] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-02.
[2025-10-24T21:24:03.439067] [WARN ] [MAIN      ] TDW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:24:03.439283] [INFO ] [MAIN      ] TDW: Wiping existing primary data before full refresh.
[2025-10-24T21:24:03.439328] [INFO ] [LOCAL     ] TDW: Starting deletion of primary data.
[2025-10-24T21:24:03.439777] [DEBUG] [LOCAL     ] TDW: Deleted primary data file.
[2025-10-24T21:24:03.439835] [INFO ] [MAIN      ] TDW: Starting full primary refresh.
[2025-10-24T21:24:03.802149] [INFO ] [REMOTE    ] TDW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:24:04.147724] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-01.
[2025-10-24T21:24:04.506422] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T21:24:04.956422] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-03.
[2025-10-24T21:24:04.961848] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-02 (2.40 seconds).
[2025-10-24T21:24:05.699327] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T21:24:05.747604] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-02.
[2025-10-24T21:24:06.144247] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T21:24:06.547724] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-03.
[2025-10-24T21:24:07.295063] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T21:24:07.347607] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-03.
[2025-10-24T21:24:08.147707] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-04.
[2025-10-24T21:24:08.682425] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-03 (2.13 seconds).
[2025-10-24T21:24:08.952843] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-04.
[2025-10-24T21:24:08.957700] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T21:24:09.328324] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-04 (1.18 seconds).
[2025-10-24T21:24:09.747703] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-01.
[2025-10-24T21:24:10.547697] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-05.
[2025-10-24T21:24:11.066932] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-04 (2.11 seconds).
[2025-10-24T21:24:11.277584] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T21:24:11.347606] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-06.
[2025-10-24T21:24:11.559281] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T21:24:12.147755] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-04.
[2025-10-24T21:24:12.391632] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T21:24:12.947618] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-07.
[2025-10-24T21:24:13.652986] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T21:24:13.747782] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-05.
[2025-10-24T21:24:14.028513] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T21:24:14.547677] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-08.
[2025-10-24T21:24:15.347613] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-02.
[2025-10-24T21:24:15.764987] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-05 (2.02 seconds).
[2025-10-24T21:24:15.816636] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T21:24:16.147687] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-09.
[2025-10-24T21:24:16.945481] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T21:24:16.957930] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-05.
[2025-10-24T21:24:17.382902] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T21:24:17.747726] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-06.
[2025-10-24T21:24:18.494484] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T21:24:18.547660] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-06.
[2025-10-24T21:24:19.347707] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-03.
[2025-10-24T21:24:19.740432] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-06 (1.99 seconds).
[2025-10-24T21:24:20.033129] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T21:24:20.147723] [INFO ] [REMOTE    ] TDG: Fetching primary data for 2025-10.
[2025-10-24T21:24:20.947716] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-07.
[2025-10-24T21:24:21.012800] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T21:24:21.363535] [INFO ] [REMOTE    ] TDG: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T21:24:21.368122] [INFO ] [REMOTE    ] TDG: Full fetch complete (32022 records).
[2025-10-24T21:24:21.368214] [DEBUG] [VALIDATOR ] TDG: Validating primary data.
[2025-10-24T21:24:21.745740] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present.
[2025-10-24T21:24:21.745841] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed.
[2025-10-24T21:24:21.746517] [INFO ] [MAIN      ] TDG: Fetched primary data is valid.
[2025-10-24T21:24:21.746560] [DEBUG] [LOCAL     ] TDG: Saving primary data.
[2025-10-24T21:24:21.746966] [FATAL] [LOCAL     ] TDG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:24:21.747072] [FATAL] [MAIN      ] TDG: Failed to save primary data.
[2025-10-24T21:24:21.747113] [WARN ] [MAIN      ] TDG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:24:21.747147] [INFO ] [LOCAL     ] TDG: Starting deletion of primary data.
[2025-10-24T21:24:21.747197] [DEBUG] [LOCAL     ] TDG: No primary data file found to delete.
[2025-10-24T21:24:21.747232] [INFO ] [LOCAL     ] TDG: Starting deletion of derivative data.
[2025-10-24T21:24:21.747435] [DEBUG] [LOCAL     ] TDG: Deleted derivative data file.
[2025-10-24T21:24:21.747543] [INFO ] [MAIN      ] Update Progress: 2056/2366 symbols completed. TDG took 26.8s. Estimated remaining: 39m 51s. Rate: 7.8 symbols/min
[2025-10-24T21:24:21.747800] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-07.
[2025-10-24T21:24:21.919002] [INFO ] [MAIN      ] TDY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:24:21.941030] [DEBUG] [LOCAL     ] TDY: Loaded 22311 existing records from primary storage.
[2025-10-24T21:24:21.941272] [INFO ] [MAIN      ] TDY: Loaded 22311 existing records.
[2025-10-24T21:24:22.115221] [WARN ] [MAIN      ] TDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:24:22.115411] [INFO ] [MAIN      ] TDY: Wiping existing primary data before full refresh.
[2025-10-24T21:24:22.115458] [INFO ] [LOCAL     ] TDY: Starting deletion of primary data.
[2025-10-24T21:24:22.115948] [DEBUG] [LOCAL     ] TDY: Deleted primary data file.
[2025-10-24T21:24:22.115997] [INFO ] [MAIN      ] TDY: Starting full primary refresh.
[2025-10-24T21:24:22.476113] [INFO ] [REMOTE    ] TDY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:24:22.547616] [INFO ] [REMOTE    ] TDY: Fetching primary data for 2025-01.
[2025-10-24T21:24:22.652087] [DEBUG] [REMOTE    ] TDY: Error fetching primary data for 2025-01: 'API call returned an empty response.'
[2025-10-24T21:24:22.652412] [WARN ] [REMOTE    ] TDY: No data returned for month 2025-01
[2025-10-24T21:24:22.652518] [FATAL] [REMOTE    ] TDY: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:24:22.652585] [FATAL] [MAIN      ] TDY: Failed to fetch primary data.
[2025-10-24T21:24:22.652619] [WARN ] [MAIN      ] TDY: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:24:22.652690] [INFO ] [LOCAL     ] TDY: Starting deletion of primary data.
[2025-10-24T21:24:22.652762] [DEBUG] [LOCAL     ] TDY: No primary data file found to delete.
[2025-10-24T21:24:22.652798] [INFO ] [LOCAL     ] TDY: Starting deletion of derivative data.
[2025-10-24T21:24:22.652988] [DEBUG] [LOCAL     ] TDY: Deleted derivative data file.
[2025-10-24T21:24:22.653080] [INFO ] [MAIN      ] Update Progress: 2057/2366 symbols completed. TDY took 0.9s. Estimated remaining: 39m 42s. Rate: 7.8 symbols/min
[2025-10-24T21:24:22.831027] [INFO ] [MAIN      ] TE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:24:22.831203] [DEBUG] [LOCAL     ] TE: No existing data file found in primary storage.
[2025-10-24T21:24:22.831239] [WARN ] [MAIN      ] TE: No existing data found, performing full refresh instead.
[2025-10-24T21:24:22.831349] [INFO ] [MAIN      ] TE: Wiping existing primary data before full refresh.
[2025-10-24T21:24:22.831388] [INFO ] [LOCAL     ] TE: Starting deletion of primary data.
[2025-10-24T21:24:22.831428] [DEBUG] [LOCAL     ] TE: No primary data file found to delete.
[2025-10-24T21:24:22.831458] [INFO ] [MAIN      ] TE: Starting full primary refresh.
[2025-10-24T21:24:23.230081] [INFO ] [REMOTE    ] TE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:24:23.278713] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-07 (2.33 seconds).
[2025-10-24T21:24:23.347667] [INFO ] [REMOTE    ] TE: Fetching primary data for 2025-01.
[2025-10-24T21:24:23.534322] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T21:24:23.578915] [DEBUG] [REMOTE    ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:24:23.579238] [WARN ] [REMOTE    ] TE: No data returned for month 2025-01
[2025-10-24T21:24:23.579327] [FATAL] [REMOTE    ] TE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:24:23.579416] [FATAL] [MAIN      ] TE: Failed to fetch primary data.
[2025-10-24T21:24:23.579715] [WARN ] [MAIN      ] TE: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:24:23.579810] [INFO ] [LOCAL     ] TE: Starting deletion of primary data.
[2025-10-24T21:24:23.579909] [DEBUG] [LOCAL     ] TE: No primary data file found to delete.
[2025-10-24T21:24:23.579978] [INFO ] [LOCAL     ] TE: Starting deletion of derivative data.
[2025-10-24T21:24:23.580044] [DEBUG] [LOCAL     ] TE: No derivative data file found to delete.
[2025-10-24T21:24:23.580124] [INFO ] [MAIN      ] Update Progress: 2058/2366 symbols completed. TE took 0.9s. Estimated remaining: 39m 34s. Rate: 7.8 symbols/min
[2025-10-24T21:24:23.751275] [INFO ] [MAIN      ] TEAF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:24:23.761683] [DEBUG] [LOCAL     ] TEAF: Loaded 7393 existing records from primary storage.
[2025-10-24T21:24:23.761906] [INFO ] [MAIN      ] TEAF: Loaded 7393 existing records.
[2025-10-24T21:24:23.939370] [WARN ] [MAIN      ] TEAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:24:23.939585] [INFO ] [MAIN      ] TEAF: Wiping existing primary data before full refresh.
[2025-10-24T21:24:23.939630] [INFO ] [LOCAL     ] TEAF: Starting deletion of primary data.
[2025-10-24T21:24:23.940140] [DEBUG] [LOCAL     ] TEAF: Deleted primary data file.
[2025-10-24T21:24:23.940197] [INFO ] [MAIN      ] TEAF: Starting full primary refresh.
[2025-10-24T21:24:24.152863] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-08.
[2025-10-24T21:24:24.289177] [INFO ] [REMOTE    ] TEAF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:24:24.947682] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-04.
[2025-10-24T21:24:25.747638] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-08.
[2025-10-24T21:24:25.854406] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-08 (1.70 seconds).
[2025-10-24T21:24:26.547723] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-09.
[2025-10-24T21:24:26.811295] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T21:24:27.347688] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-01.
[2025-10-24T21:24:27.420270] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T21:24:27.967384] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T21:24:27.980819] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T21:24:28.147639] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-05.
[2025-10-24T21:24:28.947682] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-09.
[2025-10-24T21:24:29.747518] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T21:24:29.747609] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-02.
[2025-10-24T21:24:30.349081] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T21:24:30.547716] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-06.
[2025-10-24T21:24:30.939578] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-09 (1.99 seconds).
[2025-10-24T21:24:31.347628] [INFO ] [REMOTE    ] TDS: Fetching primary data for 2025-10.
[2025-10-24T21:24:31.761586] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T21:24:32.147678] [INFO ] [REMOTE    ] TDOC: Fetching primary data for 2025-10.
[2025-10-24T21:24:32.785016] [INFO ] [REMOTE    ] TDS: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T21:24:32.792185] [INFO ] [REMOTE    ] TDS: Full fetch complete (61170 records).
[2025-10-24T21:24:32.792315] [DEBUG] [VALIDATOR ] TDS: Validating primary data.
[2025-10-24T21:24:32.950897] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-03.
[2025-10-24T21:24:33.197510] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present.
[2025-10-24T21:24:33.197670] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed.
[2025-10-24T21:24:33.198890] [INFO ] [MAIN      ] TDS: Fetched primary data is valid.
[2025-10-24T21:24:33.198953] [DEBUG] [LOCAL     ] TDS: Saving primary data.
[2025-10-24T21:24:33.199505] [FATAL] [LOCAL     ] TDS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:24:33.199601] [FATAL] [MAIN      ] TDS: Failed to save primary data.
[2025-10-24T21:24:33.199701] [WARN ] [MAIN      ] TDS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:24:33.199797] [INFO ] [LOCAL     ] TDS: Starting deletion of primary data.
[2025-10-24T21:24:33.199874] [DEBUG] [LOCAL     ] TDS: No primary data file found to delete.
[2025-10-24T21:24:33.199911] [INFO ] [LOCAL     ] TDS: Starting deletion of derivative data.
[2025-10-24T21:24:33.200088] [DEBUG] [LOCAL     ] TDS: Deleted derivative data file.
[2025-10-24T21:24:33.200522] [INFO ] [MAIN      ] Update Progress: 2059/2366 symbols completed. TDS took 31.5s. Estimated remaining: 39m 26s. Rate: 7.8 symbols/min
[2025-10-24T21:24:33.389611] [INFO ] [MAIN      ] TECK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:24:33.442795] [DEBUG] [LOCAL     ] TECK: Loaded 53821 existing records from primary storage.
[2025-10-24T21:24:33.443102] [INFO ] [MAIN      ] TECK: Loaded 53821 existing records.
[2025-10-24T21:24:33.619489] [WARN ] [MAIN      ] TECK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:24:33.619794] [INFO ] [MAIN      ] TECK: Wiping existing primary data before full refresh.
[2025-10-24T21:24:33.619844] [INFO ] [LOCAL     ] TECK: Starting deletion of primary data.
[2025-10-24T21:24:33.620425] [DEBUG] [LOCAL     ] TECK: Deleted primary data file.
[2025-10-24T21:24:33.620480] [INFO ] [MAIN      ] TECK: Starting full primary refresh.
[2025-10-24T21:24:33.759010] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-07.
[2025-10-24T21:24:33.846282] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-03 (0.90 seconds).
[2025-10-24T21:24:33.989631] [INFO ] [REMOTE    ] TECK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:24:34.262195] [INFO ] [REMOTE    ] TDOC: Incremental fetch complete for 2025-10 (2.11 seconds).
[2025-10-24T21:24:34.272697] [INFO ] [REMOTE    ] TDOC: Full fetch complete (77445 records).
[2025-10-24T21:24:34.272836] [DEBUG] [VALIDATOR ] TDOC: Validating primary data.
[2025-10-24T21:24:34.552890] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-04.
[2025-10-24T21:24:34.664509] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present.
[2025-10-24T21:24:34.664595] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed.
[2025-10-24T21:24:34.665814] [INFO ] [MAIN      ] TDOC: Fetched primary data is valid.
[2025-10-24T21:24:34.665877] [DEBUG] [LOCAL     ] TDOC: Saving primary data.
[2025-10-24T21:24:34.666504] [FATAL] [LOCAL     ] TDOC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:24:34.666598] [FATAL] [MAIN      ] TDOC: Failed to save primary data.
[2025-10-24T21:24:34.666639] [WARN ] [MAIN      ] TDOC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:24:34.666723] [INFO ] [LOCAL     ] TDOC: Starting deletion of primary data.
[2025-10-24T21:24:34.666793] [DEBUG] [LOCAL     ] TDOC: No primary data file found to delete.
[2025-10-24T21:24:34.666830] [INFO ] [LOCAL     ] TDOC: Starting deletion of derivative data.
[2025-10-24T21:24:34.667019] [DEBUG] [LOCAL     ] TDOC: Deleted derivative data file.
[2025-10-24T21:24:34.667397] [INFO ] [MAIN      ] Update Progress: 2060/2366 symbols completed. TDOC took 35.6s. Estimated remaining: 39m 18s. Rate: 7.8 symbols/min
[2025-10-24T21:24:34.838952] [INFO ] [MAIN      ] TEF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:24:34.872878] [DEBUG] [LOCAL     ] TEF: Loaded 37042 existing records from primary storage.
[2025-10-24T21:24:34.873144] [INFO ] [MAIN      ] TEF: Loaded 37042 existing records.
[2025-10-24T21:24:35.054937] [WARN ] [MAIN      ] TEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:24:35.055187] [INFO ] [MAIN      ] TEF: Wiping existing primary data before full refresh.
[2025-10-24T21:24:35.055244] [INFO ] [LOCAL     ] TEF: Starting deletion of primary data.
[2025-10-24T21:24:35.055522] [DEBUG] [LOCAL     ] TEF: Deleted primary data file.
[2025-10-24T21:24:35.055561] [INFO ] [MAIN      ] TEF: Starting full primary refresh.
[2025-10-24T21:24:35.348705] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-01.
[2025-10-24T21:24:35.443885] [INFO ] [REMOTE    ] TEF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:24:35.470046] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T21:24:35.487095] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-04 (0.93 seconds).
[2025-10-24T21:24:36.147723] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-08.
[2025-10-24T21:24:36.947668] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-05.
[2025-10-24T21:24:37.032720] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T21:24:37.747600] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-02.
[2025-10-24T21:24:37.755722] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-05 (0.81 seconds).
[2025-10-24T21:24:37.788212] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T21:24:38.547697] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-09.
[2025-10-24T21:24:39.347629] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-01.
[2025-10-24T21:24:39.428574] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T21:24:39.976759] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T21:24:40.147625] [INFO ] [REMOTE    ] TDW: Fetching primary data for 2025-10.
[2025-10-24T21:24:40.905980] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T21:24:40.947605] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-02.
[2025-10-24T21:24:41.629479] [INFO ] [REMOTE    ] TDW: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T21:24:41.637683] [INFO ] [REMOTE    ] TDW: Full fetch complete (66696 records).
[2025-10-24T21:24:41.637795] [DEBUG] [VALIDATOR ] TDW: Validating primary data.
[2025-10-24T21:24:41.752526] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-06.
[2025-10-24T21:24:42.018380] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T21:24:42.061670] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present.
[2025-10-24T21:24:42.062085] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed.
[2025-10-24T21:24:42.063917] [INFO ] [MAIN      ] TDW: Fetched primary data is valid.
[2025-10-24T21:24:42.063980] [DEBUG] [LOCAL     ] TDW: Saving primary data.
[2025-10-24T21:24:42.064487] [FATAL] [LOCAL     ] TDW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:24:42.064573] [FATAL] [MAIN      ] TDW: Failed to save primary data.
[2025-10-24T21:24:42.064615] [WARN ] [MAIN      ] TDW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:24:42.064691] [INFO ] [LOCAL     ] TDW: Starting deletion of primary data.
[2025-10-24T21:24:42.064762] [DEBUG] [LOCAL     ] TDW: No primary data file found to delete.
[2025-10-24T21:24:42.064799] [INFO ] [LOCAL     ] TDW: Starting deletion of derivative data.
[2025-10-24T21:24:42.064978] [DEBUG] [LOCAL     ] TDW: Deleted derivative data file.
[2025-10-24T21:24:42.065285] [INFO ] [MAIN      ] Update Progress: 2061/2366 symbols completed. TDW took 39.0s. Estimated remaining: 39m 10s. Rate: 7.8 symbols/min
[2025-10-24T21:24:42.232343] [INFO ] [MAIN      ] TEI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:24:42.252447] [DEBUG] [LOCAL     ] TEI: Loaded 21262 existing records from primary storage.
[2025-10-24T21:24:42.252720] [INFO ] [MAIN      ] TEI: Loaded 21262 existing records.
[2025-10-24T21:24:42.432933] [WARN ] [MAIN      ] TEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:24:42.433141] [INFO ] [MAIN      ] TEI: Wiping existing primary data before full refresh.
[2025-10-24T21:24:42.433187] [INFO ] [LOCAL     ] TEI: Starting deletion of primary data.
[2025-10-24T21:24:42.433434] [DEBUG] [LOCAL     ] TEI: Deleted primary data file.
[2025-10-24T21:24:42.433487] [INFO ] [MAIN      ] TEI: Starting full primary refresh.
[2025-10-24T21:24:42.550520] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-03.
[2025-10-24T21:24:42.545224] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-06 (0.79 seconds).
[2025-10-24T21:24:42.794941] [INFO ] [REMOTE    ] TEI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:24:43.347729] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-01.
[2025-10-24T21:24:44.147628] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-07.
[2025-10-24T21:24:44.362931] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T21:24:44.430449] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T21:24:44.874563] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-07 (0.73 seconds).
[2025-10-24T21:24:44.947686] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-03.
[2025-10-24T21:24:45.747773] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-08.
[2025-10-24T21:24:46.318147] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T21:24:46.403080] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T21:24:46.547720] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-09.
[2025-10-24T21:24:47.259192] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T21:24:47.347636] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-02.
[2025-10-24T21:24:48.147635] [INFO ] [REMOTE    ] TEAF: Fetching primary data for 2025-10.
[2025-10-24T21:24:48.417847] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T21:24:48.895196] [INFO ] [REMOTE    ] TEAF: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T21:24:48.897225] [INFO ] [REMOTE    ] TEAF: Full fetch complete (10191 records).
[2025-10-24T21:24:48.897308] [DEBUG] [VALIDATOR ] TEAF: Validating primary data.
[2025-10-24T21:24:48.953983] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-03.
[2025-10-24T21:24:49.286131] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present.
[2025-10-24T21:24:49.286235] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed.
[2025-10-24T21:24:49.286618] [INFO ] [MAIN      ] TEAF: Fetched primary data is valid.
[2025-10-24T21:24:49.286689] [DEBUG] [LOCAL     ] TEAF: Saving primary data.
[2025-10-24T21:24:49.286962] [FATAL] [LOCAL     ] TEAF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:24:49.287051] [FATAL] [MAIN      ] TEAF: Failed to save primary data.
[2025-10-24T21:24:49.287094] [WARN ] [MAIN      ] TEAF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:24:49.287128] [INFO ] [LOCAL     ] TEAF: Starting deletion of primary data.
[2025-10-24T21:24:49.287181] [DEBUG] [LOCAL     ] TEAF: No primary data file found to delete.
[2025-10-24T21:24:49.287218] [INFO ] [LOCAL     ] TEAF: Starting deletion of derivative data.
[2025-10-24T21:24:49.287416] [DEBUG] [LOCAL     ] TEAF: Deleted derivative data file.
[2025-10-24T21:24:49.287500] [INFO ] [MAIN      ] Update Progress: 2062/2366 symbols completed. TEAF took 25.7s. Estimated remaining: 39m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:24:49.464054] [INFO ] [MAIN      ] TEL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:24:49.518122] [DEBUG] [LOCAL     ] TEL: Loaded 51400 existing records from primary storage.
[2025-10-24T21:24:49.518530] [INFO ] [MAIN      ] TEL: Loaded 51400 existing records.
[2025-10-24T21:24:49.710498] [WARN ] [MAIN      ] TEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:24:49.710879] [INFO ] [MAIN      ] TEL: Wiping existing primary data before full refresh.
[2025-10-24T21:24:49.710951] [INFO ] [LOCAL     ] TEL: Starting deletion of primary data.
[2025-10-24T21:24:49.712084] [DEBUG] [LOCAL     ] TEL: Deleted primary data file.
[2025-10-24T21:24:49.712144] [INFO ] [MAIN      ] TEL: Starting full primary refresh.
[2025-10-24T21:24:49.752859] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-04.
[2025-10-24T21:24:50.076420] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T21:24:50.137896] [INFO ] [REMOTE    ] TEL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:24:50.547686] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-04.
[2025-10-24T21:24:51.347681] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-04.
[2025-10-24T21:24:51.634886] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T21:24:51.777271] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-04 (2.02 seconds).
[2025-10-24T21:24:52.147671] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-05.
[2025-10-24T21:24:52.947689] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-01.
[2025-10-24T21:24:52.983765] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T21:24:53.314286] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T21:24:53.747672] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-06.
[2025-10-24T21:24:54.548092] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-05.
[2025-10-24T21:24:54.551923] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-01 (1.60 seconds).
[2025-10-24T21:24:55.347764] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-05.
[2025-10-24T21:24:55.491631] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T21:24:55.672376] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T21:24:56.147612] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-06.
[2025-10-24T21:24:56.383726] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-05 (1.04 seconds).
[2025-10-24T21:24:56.947677] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-02.
[2025-10-24T21:24:57.197877] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T21:24:57.747638] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-06.
[2025-10-24T21:24:58.087960] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T21:24:58.395588] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T21:24:58.547620] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-07.
[2025-10-24T21:24:59.347726] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-07.
[2025-10-24T21:24:59.720183] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-07 (1.17 seconds).
[2025-10-24T21:25:00.147689] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-07.
[2025-10-24T21:25:00.885137] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T21:25:00.947639] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-08.
[2025-10-24T21:25:01.747716] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-08.
[2025-10-24T21:25:02.056043] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T21:25:02.419842] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T21:25:02.547623] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-03.
[2025-10-24T21:25:02.600609] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-08 (0.85 seconds).
[2025-10-24T21:25:03.347692] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-09.
[2025-10-24T21:25:04.147697] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-09.
[2025-10-24T21:25:04.486759] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-03 (1.94 seconds).
[2025-10-24T21:25:04.558105] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T21:25:04.947670] [INFO ] [REMOTE    ] TEI: Fetching primary data for 2025-10.
[2025-10-24T21:25:05.707175] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T21:25:05.747619] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-04.
[2025-10-24T21:25:06.348637] [INFO ] [REMOTE    ] TEI: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T21:25:06.353493] [INFO ] [REMOTE    ] TEI: Full fetch complete (30696 records).
[2025-10-24T21:25:06.353603] [DEBUG] [VALIDATOR ] TEI: Validating primary data.
[2025-10-24T21:25:06.557764] [INFO ] [REMOTE    ] TEF: Fetching primary data for 2025-10.
[2025-10-24T21:25:06.736882] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present.
[2025-10-24T21:25:06.736962] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed.
[2025-10-24T21:25:06.737586] [INFO ] [MAIN      ] TEI: Fetched primary data is valid.
[2025-10-24T21:25:06.737701] [DEBUG] [LOCAL     ] TEI: Saving primary data.
[2025-10-24T21:25:06.738059] [FATAL] [LOCAL     ] TEI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:25:06.738152] [FATAL] [MAIN      ] TEI: Failed to save primary data.
[2025-10-24T21:25:06.738223] [WARN ] [MAIN      ] TEI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:25:06.738313] [INFO ] [LOCAL     ] TEI: Starting deletion of primary data.
[2025-10-24T21:25:06.738390] [DEBUG] [LOCAL     ] TEI: No primary data file found to delete.
[2025-10-24T21:25:06.738427] [INFO ] [LOCAL     ] TEI: Starting deletion of derivative data.
[2025-10-24T21:25:06.738573] [DEBUG] [LOCAL     ] TEI: Deleted derivative data file.
[2025-10-24T21:25:06.738675] [INFO ] [MAIN      ] Update Progress: 2063/2366 symbols completed. TEI took 24.7s. Estimated remaining: 38m 56s. Rate: 7.8 symbols/min
[2025-10-24T21:25:06.904943] [INFO ] [MAIN      ] TEN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:25:06.935773] [DEBUG] [LOCAL     ] TEN: Loaded 30505 existing records from primary storage.
[2025-10-24T21:25:06.936063] [INFO ] [MAIN      ] TEN: Loaded 30505 existing records.
[2025-10-24T21:25:07.120264] [WARN ] [MAIN      ] TEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:25:07.120498] [INFO ] [MAIN      ] TEN: Wiping existing primary data before full refresh.
[2025-10-24T21:25:07.120556] [INFO ] [LOCAL     ] TEN: Starting deletion of primary data.
[2025-10-24T21:25:07.120921] [DEBUG] [LOCAL     ] TEN: Deleted primary data file.
[2025-10-24T21:25:07.120977] [INFO ] [MAIN      ] TEN: Starting full primary refresh.
[2025-10-24T21:25:07.354370] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-08.
[2025-10-24T21:25:07.481767] [INFO ] [REMOTE    ] TEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:25:07.624618] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T21:25:08.064502] [INFO ] [REMOTE    ] TEF: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T21:25:08.071329] [INFO ] [REMOTE    ] TEF: Full fetch complete (54319 records).
[2025-10-24T21:25:08.071440] [DEBUG] [VALIDATOR ] TEF: Validating primary data.
[2025-10-24T21:25:08.152725] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-05.
[2025-10-24T21:25:08.475906] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present.
[2025-10-24T21:25:08.476000] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed.
[2025-10-24T21:25:08.477166] [INFO ] [MAIN      ] TEF: Fetched primary data is valid.
[2025-10-24T21:25:08.477232] [DEBUG] [LOCAL     ] TEF: Saving primary data.
[2025-10-24T21:25:08.477759] [FATAL] [LOCAL     ] TEF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:25:08.477847] [FATAL] [MAIN      ] TEF: Failed to save primary data.
[2025-10-24T21:25:08.477889] [WARN ] [MAIN      ] TEF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:25:08.477923] [INFO ] [LOCAL     ] TEF: Starting deletion of primary data.
[2025-10-24T21:25:08.477973] [DEBUG] [LOCAL     ] TEF: No primary data file found to delete.
[2025-10-24T21:25:08.478009] [INFO ] [LOCAL     ] TEF: Starting deletion of derivative data.
[2025-10-24T21:25:08.478155] [DEBUG] [LOCAL     ] TEF: Deleted derivative data file.
[2025-10-24T21:25:08.478231] [INFO ] [MAIN      ] Update Progress: 2064/2366 symbols completed. TEF took 33.8s. Estimated remaining: 38m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:25:08.663097] [INFO ] [MAIN      ] TEO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:25:08.684571] [DEBUG] [LOCAL     ] TEO: Loaded 23036 existing records from primary storage.
[2025-10-24T21:25:08.684852] [INFO ] [MAIN      ] TEO: Loaded 23036 existing records.
[2025-10-24T21:25:08.873242] [WARN ] [MAIN      ] TEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:25:08.873455] [INFO ] [MAIN      ] TEO: Wiping existing primary data before full refresh.
[2025-10-24T21:25:08.873511] [INFO ] [LOCAL     ] TEO: Starting deletion of primary data.
[2025-10-24T21:25:08.873793] [DEBUG] [LOCAL     ] TEO: Deleted primary data file.
[2025-10-24T21:25:08.873851] [INFO ] [MAIN      ] TEO: Starting full primary refresh.
[2025-10-24T21:25:08.956363] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-01.
[2025-10-24T21:25:09.251129] [INFO ] [REMOTE    ] TEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:25:09.280626] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T21:25:09.747710] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-01.
[2025-10-24T21:25:10.001633] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-05 (1.85 seconds).
[2025-10-24T21:25:10.375531] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T21:25:10.547617] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-09.
[2025-10-24T21:25:10.736952] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T21:25:11.347704] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-02.
[2025-10-24T21:25:12.147698] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-06.
[2025-10-24T21:25:12.199177] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T21:25:12.368834] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T21:25:12.947639] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-03.
[2025-10-24T21:25:13.477238] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T21:25:13.753715] [INFO ] [REMOTE    ] TECK: Fetching primary data for 2025-10.
[2025-10-24T21:25:13.760700] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T21:25:14.547692] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-02.
[2025-10-24T21:25:15.347627] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-07.
[2025-10-24T21:25:15.474080] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T21:25:15.686419] [INFO ] [REMOTE    ] TECK: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T21:25:15.696160] [INFO ] [REMOTE    ] TECK: Full fetch complete (77530 records).
[2025-10-24T21:25:15.696275] [DEBUG] [VALIDATOR ] TECK: Validating primary data.
[2025-10-24T21:25:16.077881] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present.
[2025-10-24T21:25:16.077962] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed.
[2025-10-24T21:25:16.079075] [INFO ] [MAIN      ] TECK: Fetched primary data is valid.
[2025-10-24T21:25:16.079135] [DEBUG] [LOCAL     ] TECK: Saving primary data.
[2025-10-24T21:25:16.079710] [FATAL] [LOCAL     ] TECK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:25:16.079798] [FATAL] [MAIN      ] TECK: Failed to save primary data.
[2025-10-24T21:25:16.079840] [WARN ] [MAIN      ] TECK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:25:16.079875] [INFO ] [LOCAL     ] TECK: Starting deletion of primary data.
[2025-10-24T21:25:16.079926] [DEBUG] [LOCAL     ] TECK: No primary data file found to delete.
[2025-10-24T21:25:16.079961] [INFO ] [LOCAL     ] TECK: Starting deletion of derivative data.
[2025-10-24T21:25:16.080118] [DEBUG] [LOCAL     ] TECK: Deleted derivative data file.
[2025-10-24T21:25:16.080993] [INFO ] [MAIN      ] Update Progress: 2065/2366 symbols completed. TECK took 42.9s. Estimated remaining: 38m 40s. Rate: 7.8 symbols/min
[2025-10-24T21:25:16.152919] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-03.
[2025-10-24T21:25:16.253782] [INFO ] [MAIN      ] TEVA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:25:16.305076] [DEBUG] [LOCAL     ] TEVA: Loaded 54007 existing records from primary storage.
[2025-10-24T21:25:16.305365] [INFO ] [MAIN      ] TEVA: Loaded 54007 existing records.
[2025-10-24T21:25:16.479228] [WARN ] [MAIN      ] TEVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:25:16.479419] [INFO ] [MAIN      ] TEVA: Wiping existing primary data before full refresh.
[2025-10-24T21:25:16.479466] [INFO ] [LOCAL     ] TEVA: Starting deletion of primary data.
[2025-10-24T21:25:16.479944] [DEBUG] [LOCAL     ] TEVA: Deleted primary data file.
[2025-10-24T21:25:16.479999] [INFO ] [MAIN      ] TEVA: Starting full primary refresh.
[2025-10-24T21:25:16.826972] [INFO ] [REMOTE    ] TEVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:25:16.947608] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-01.
[2025-10-24T21:25:17.157254] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T21:25:17.214441] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T21:25:17.747722] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-04.
[2025-10-24T21:25:18.547615] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-08.
[2025-10-24T21:25:18.938546] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-01 (1.99 seconds).
[2025-10-24T21:25:18.970261] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T21:25:19.347670] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-04.
[2025-10-24T21:25:20.147627] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-02.
[2025-10-24T21:25:20.289575] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T21:25:20.423697] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-04 (1.08 seconds).
[2025-10-24T21:25:20.947639] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-05.
[2025-10-24T21:25:21.747611] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-05.
[2025-10-24T21:25:21.971417] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T21:25:22.231979] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-02 (2.08 seconds).
[2025-10-24T21:25:22.547617] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-03.
[2025-10-24T21:25:22.980565] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T21:25:23.347688] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-09.
[2025-10-24T21:25:24.147624] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-06.
[2025-10-24T21:25:24.655284] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-03 (2.11 seconds).
[2025-10-24T21:25:24.947626] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-04.
[2025-10-24T21:25:25.090835] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T21:25:25.185698] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T21:25:25.747694] [INFO ] [REMOTE    ] TEL: Fetching primary data for 2025-10.
[2025-10-24T21:25:26.547622] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-06.
[2025-10-24T21:25:26.799749] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T21:25:27.347715] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-07.
[2025-10-24T21:25:27.420506] [INFO ] [REMOTE    ] TEL: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T21:25:27.430504] [INFO ] [REMOTE    ] TEL: Full fetch complete (73858 records).
[2025-10-24T21:25:27.430636] [DEBUG] [VALIDATOR ] TEL: Validating primary data.
[2025-10-24T21:25:27.832379] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present.
[2025-10-24T21:25:27.832486] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed.
[2025-10-24T21:25:27.833733] [INFO ] [MAIN      ] TEL: Fetched primary data is valid.
[2025-10-24T21:25:27.833795] [DEBUG] [LOCAL     ] TEL: Saving primary data.
[2025-10-24T21:25:27.834423] [FATAL] [LOCAL     ] TEL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:25:27.834528] [FATAL] [MAIN      ] TEL: Failed to save primary data.
[2025-10-24T21:25:27.834578] [WARN ] [MAIN      ] TEL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:25:27.834614] [INFO ] [LOCAL     ] TEL: Starting deletion of primary data.
[2025-10-24T21:25:27.834700] [DEBUG] [LOCAL     ] TEL: No primary data file found to delete.
[2025-10-24T21:25:27.834753] [INFO ] [LOCAL     ] TEL: Starting deletion of derivative data.
[2025-10-24T21:25:27.834923] [DEBUG] [LOCAL     ] TEL: Deleted derivative data file.
[2025-10-24T21:25:27.835526] [INFO ] [MAIN      ] Update Progress: 2066/2366 symbols completed. TEL took 38.5s. Estimated remaining: 38m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:25:28.011587] [INFO ] [MAIN      ] TEX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:25:28.023442] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T21:25:28.068618] [DEBUG] [LOCAL     ] TEX: Loaded 43837 existing records from primary storage.
[2025-10-24T21:25:28.068949] [INFO ] [MAIN      ] TEX: Loaded 43837 existing records.
[2025-10-24T21:25:28.152834] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-05.
[2025-10-24T21:25:28.249309] [WARN ] [MAIN      ] TEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:25:28.249507] [INFO ] [MAIN      ] TEX: Wiping existing primary data before full refresh.
[2025-10-24T21:25:28.249553] [INFO ] [LOCAL     ] TEX: Starting deletion of primary data.
[2025-10-24T21:25:28.249993] [DEBUG] [LOCAL     ] TEX: Deleted primary data file.
[2025-10-24T21:25:28.250048] [INFO ] [MAIN      ] TEX: Starting full primary refresh.
[2025-10-24T21:25:28.590958] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-07 (1.24 seconds).
[2025-10-24T21:25:28.623855] [INFO ] [REMOTE    ] TEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:25:28.947733] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-08.
[2025-10-24T21:25:29.747639] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-07.
[2025-10-24T21:25:30.061701] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T21:25:30.397085] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-05 (2.24 seconds).
[2025-10-24T21:25:30.547607] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-09.
[2025-10-24T21:25:31.027378] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-07 (1.28 seconds).
[2025-10-24T21:25:31.347679] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-06.
[2025-10-24T21:25:31.481928] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T21:25:32.147746] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-01.
[2025-10-24T21:25:32.947625] [INFO ] [REMOTE    ] TEO: Fetching primary data for 2025-10.
[2025-10-24T21:25:33.079347] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T21:25:33.694801] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T21:25:33.747618] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-02.
[2025-10-24T21:25:34.154207] [INFO ] [REMOTE    ] TEO: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T21:25:34.159477] [INFO ] [REMOTE    ] TEO: Full fetch complete (32810 records).
[2025-10-24T21:25:34.159604] [DEBUG] [VALIDATOR ] TEO: Validating primary data.
[2025-10-24T21:25:34.529420] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present.
[2025-10-24T21:25:34.529530] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed.
[2025-10-24T21:25:34.530209] [INFO ] [MAIN      ] TEO: Fetched primary data is valid.
[2025-10-24T21:25:34.530271] [DEBUG] [LOCAL     ] TEO: Saving primary data.
[2025-10-24T21:25:34.530591] [FATAL] [LOCAL     ] TEO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:25:34.530696] [FATAL] [MAIN      ] TEO: Failed to save primary data.
[2025-10-24T21:25:34.530743] [WARN ] [MAIN      ] TEO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:25:34.530778] [INFO ] [LOCAL     ] TEO: Starting deletion of primary data.
[2025-10-24T21:25:34.530828] [DEBUG] [LOCAL     ] TEO: No primary data file found to delete.
[2025-10-24T21:25:34.530862] [INFO ] [LOCAL     ] TEO: Starting deletion of derivative data.
[2025-10-24T21:25:34.531174] [DEBUG] [LOCAL     ] TEO: Deleted derivative data file.
[2025-10-24T21:25:34.531264] [INFO ] [MAIN      ] Update Progress: 2067/2366 symbols completed. TEO took 26.1s. Estimated remaining: 38m 25s. Rate: 7.8 symbols/min
[2025-10-24T21:25:34.552845] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-08.
[2025-10-24T21:25:34.703265] [INFO ] [MAIN      ] TFC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:25:34.752877] [DEBUG] [LOCAL     ] TFC: Loaded 54057 existing records from primary storage.
[2025-10-24T21:25:34.753190] [INFO ] [MAIN      ] TFC: Loaded 54057 existing records.
[2025-10-24T21:25:34.927048] [WARN ] [MAIN      ] TFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:25:34.927253] [INFO ] [MAIN      ] TFC: Wiping existing primary data before full refresh.
[2025-10-24T21:25:34.927322] [INFO ] [LOCAL     ] TFC: Starting deletion of primary data.
[2025-10-24T21:25:34.927843] [DEBUG] [LOCAL     ] TFC: Deleted primary data file.
[2025-10-24T21:25:34.927902] [INFO ] [MAIN      ] TFC: Starting full primary refresh.
[2025-10-24T21:25:35.277371] [INFO ] [REMOTE    ] TFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:25:35.347598] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-01.
[2025-10-24T21:25:35.394368] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T21:25:35.911537] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T21:25:36.147700] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-03.
[2025-10-24T21:25:36.947624] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-07.
[2025-10-24T21:25:37.152790] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T21:25:37.747621] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-02.
[2025-10-24T21:25:37.883967] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T21:25:38.547691] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-09.
[2025-10-24T21:25:38.903535] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-07 (1.96 seconds).
[2025-10-24T21:25:39.347629] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-04.
[2025-10-24T21:25:39.411091] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T21:25:39.947038] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T21:25:40.147635] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-03.
[2025-10-24T21:25:40.947633] [INFO ] [REMOTE    ] TEN: Fetching primary data for 2025-10.
[2025-10-24T21:25:41.109700] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T21:25:41.747625] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-05.
[2025-10-24T21:25:42.059256] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T21:25:42.198993] [INFO ] [REMOTE    ] TEN: Incremental fetch complete for 2025-10 (1.25 seconds).
[2025-10-24T21:25:42.204891] [INFO ] [REMOTE    ] TEN: Full fetch complete (44017 records).
[2025-10-24T21:25:42.204992] [DEBUG] [VALIDATOR ] TEN: Validating primary data.
[2025-10-24T21:25:42.556352] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-08.
[2025-10-24T21:25:42.595567] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present.
[2025-10-24T21:25:42.595635] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed.
[2025-10-24T21:25:42.596527] [INFO ] [MAIN      ] TEN: Fetched primary data is valid.
[2025-10-24T21:25:42.596572] [DEBUG] [LOCAL     ] TEN: Saving primary data.
[2025-10-24T21:25:42.596994] [FATAL] [LOCAL     ] TEN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:25:42.597074] [FATAL] [MAIN      ] TEN: Failed to save primary data.
[2025-10-24T21:25:42.597115] [WARN ] [MAIN      ] TEN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:25:42.597177] [INFO ] [LOCAL     ] TEN: Starting deletion of primary data.
[2025-10-24T21:25:42.597234] [DEBUG] [LOCAL     ] TEN: No primary data file found to delete.
[2025-10-24T21:25:42.597269] [INFO ] [LOCAL     ] TEN: Starting deletion of derivative data.
[2025-10-24T21:25:42.597448] [DEBUG] [LOCAL     ] TEN: Deleted derivative data file.
[2025-10-24T21:25:42.597563] [INFO ] [MAIN      ] Update Progress: 2068/2366 symbols completed. TEN took 35.9s. Estimated remaining: 38m 17s. Rate: 7.8 symbols/min
[2025-10-24T21:25:42.767869] [INFO ] [MAIN      ] TFII: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:25:42.798728] [DEBUG] [LOCAL     ] TFII: Loaded 32486 existing records from primary storage.
[2025-10-24T21:25:42.799008] [INFO ] [MAIN      ] TFII: Loaded 32486 existing records.
[2025-10-24T21:25:42.985682] [WARN ] [MAIN      ] TFII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:25:42.986003] [INFO ] [MAIN      ] TFII: Wiping existing primary data before full refresh.
[2025-10-24T21:25:42.986053] [INFO ] [LOCAL     ] TFII: Starting deletion of primary data.
[2025-10-24T21:25:42.986388] [DEBUG] [LOCAL     ] TFII: Deleted primary data file.
[2025-10-24T21:25:42.986446] [INFO ] [MAIN      ] TFII: Starting full primary refresh.
[2025-10-24T21:25:43.348894] [INFO ] [REMOTE    ] TFII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:25:43.348979] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-04.
[2025-10-24T21:25:43.379565] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T21:25:44.147618] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-06.
[2025-10-24T21:25:44.693761] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-08 (2.14 seconds).
[2025-10-24T21:25:44.872675] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T21:25:44.947695] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-05.
[2025-10-24T21:25:45.613229] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T21:25:45.747673] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-07.
[2025-10-24T21:25:46.547720] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-01.
[2025-10-24T21:25:46.898013] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T21:25:47.347701] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-09.
[2025-10-24T21:25:47.397245] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T21:25:47.774578] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T21:25:48.147675] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-02.
[2025-10-24T21:25:48.947706] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-08.
[2025-10-24T21:25:49.448624] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T21:25:49.557632] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-09 (2.21 seconds).
[2025-10-24T21:25:49.747714] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-03.
[2025-10-24T21:25:50.485350] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T21:25:50.547605] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-09.
[2025-10-24T21:25:51.272707] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T21:25:51.347609] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-04.
[2025-10-24T21:25:52.010441] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T21:25:52.147689] [INFO ] [REMOTE    ] TEX: Fetching primary data for 2025-10.
[2025-10-24T21:25:52.870963] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T21:25:52.947621] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-05.
[2025-10-24T21:25:53.650740] [INFO ] [REMOTE    ] TEX: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T21:25:53.658509] [INFO ] [REMOTE    ] TEX: Full fetch complete (64427 records).
[2025-10-24T21:25:53.658679] [DEBUG] [VALIDATOR ] TEX: Validating primary data.
[2025-10-24T21:25:53.754720] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-06.
[2025-10-24T21:25:54.040830] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present.
[2025-10-24T21:25:54.040928] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed.
[2025-10-24T21:25:54.042127] [INFO ] [MAIN      ] TEX: Fetched primary data is valid.
[2025-10-24T21:25:54.042245] [DEBUG] [LOCAL     ] TEX: Saving primary data.
[2025-10-24T21:25:54.042822] [FATAL] [LOCAL     ] TEX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:25:54.042905] [FATAL] [MAIN      ] TEX: Failed to save primary data.
[2025-10-24T21:25:54.042946] [WARN ] [MAIN      ] TEX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:25:54.042982] [INFO ] [LOCAL     ] TEX: Starting deletion of primary data.
[2025-10-24T21:25:54.043033] [DEBUG] [LOCAL     ] TEX: No primary data file found to delete.
[2025-10-24T21:25:54.043067] [INFO ] [LOCAL     ] TEX: Starting deletion of derivative data.
[2025-10-24T21:25:54.043254] [DEBUG] [LOCAL     ] TEX: Deleted derivative data file.
[2025-10-24T21:25:54.043605] [INFO ] [MAIN      ] Update Progress: 2069/2366 symbols completed. TEX took 26.2s. Estimated remaining: 38m 10s. Rate: 7.8 symbols/min
[2025-10-24T21:25:54.211672] [INFO ] [MAIN      ] TFIN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:25:54.235106] [DEBUG] [LOCAL     ] TFIN: Loaded 23831 existing records from primary storage.
[2025-10-24T21:25:54.235346] [INFO ] [MAIN      ] TFIN: Loaded 23831 existing records.
[2025-10-24T21:25:54.413611] [WARN ] [MAIN      ] TFIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:25:54.413910] [INFO ] [MAIN      ] TFIN: Wiping existing primary data before full refresh.
[2025-10-24T21:25:54.413972] [INFO ] [LOCAL     ] TFIN: Starting deletion of primary data.
[2025-10-24T21:25:54.414240] [DEBUG] [LOCAL     ] TFIN: Deleted primary data file.
[2025-10-24T21:25:54.414307] [INFO ] [MAIN      ] TFIN: Starting full primary refresh.
[2025-10-24T21:25:54.552587] [INFO ] [REMOTE    ] TEVA: Fetching primary data for 2025-10.
[2025-10-24T21:25:54.591729] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T21:25:54.795518] [INFO ] [REMOTE    ] TFIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:25:55.222487] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-06 (1.47 seconds).
[2025-10-24T21:25:55.347636] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-07.
[2025-10-24T21:25:56.147729] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-06.
[2025-10-24T21:25:56.824952] [INFO ] [REMOTE    ] TEVA: Incremental fetch complete for 2025-10 (2.27 seconds).
[2025-10-24T21:25:56.834832] [INFO ] [REMOTE    ] TEVA: Full fetch complete (77779 records).
[2025-10-24T21:25:56.834959] [DEBUG] [VALIDATOR ] TEVA: Validating primary data.
[2025-10-24T21:25:56.952800] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-01.
[2025-10-24T21:25:57.234718] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present.
[2025-10-24T21:25:57.234824] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed.
[2025-10-24T21:25:57.236044] [INFO ] [MAIN      ] TEVA: Fetched primary data is valid.
[2025-10-24T21:25:57.236205] [DEBUG] [LOCAL     ] TEVA: Saving primary data.
[2025-10-24T21:25:57.236871] [FATAL] [LOCAL     ] TEVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:25:57.236956] [FATAL] [MAIN      ] TEVA: Failed to save primary data.
[2025-10-24T21:25:57.236998] [WARN ] [MAIN      ] TEVA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:25:57.237061] [INFO ] [LOCAL     ] TEVA: Starting deletion of primary data.
[2025-10-24T21:25:57.237120] [DEBUG] [LOCAL     ] TEVA: No primary data file found to delete.
[2025-10-24T21:25:57.237156] [INFO ] [LOCAL     ] TEVA: Starting deletion of derivative data.
[2025-10-24T21:25:57.237345] [DEBUG] [LOCAL     ] TEVA: Deleted derivative data file.
[2025-10-24T21:25:57.237702] [INFO ] [MAIN      ] Update Progress: 2070/2366 symbols completed. TEVA took 41.2s. Estimated remaining: 38m 1s. Rate: 7.8 symbols/min
[2025-10-24T21:25:57.431935] [INFO ] [MAIN      ] TFPM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:25:57.466269] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-07 (2.12 seconds).
[2025-10-24T21:25:57.497391] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T21:25:57.530518] [DEBUG] [LOCAL     ] TFPM: Loaded 40157 existing records from primary storage.
[2025-10-24T21:25:57.530831] [INFO ] [MAIN      ] TFPM: Loaded 40157 existing records.
[2025-10-24T21:25:57.710283] [WARN ] [MAIN      ] TFPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:25:57.710788] [INFO ] [MAIN      ] TFPM: Wiping existing primary data before full refresh.
[2025-10-24T21:25:57.710844] [INFO ] [LOCAL     ] TFPM: Starting deletion of primary data.
[2025-10-24T21:25:57.711311] [DEBUG] [LOCAL     ] TFPM: Deleted primary data file.
[2025-10-24T21:25:57.711352] [INFO ] [MAIN      ] TFPM: Starting full primary refresh.
[2025-10-24T21:25:57.754052] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-08.
[2025-10-24T21:25:58.025844] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T21:25:58.089147] [INFO ] [REMOTE    ] TFPM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:25:58.547700] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-02.
[2025-10-24T21:25:59.347700] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-01.
[2025-10-24T21:25:59.745333] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-08 (1.99 seconds).
[2025-10-24T21:25:59.768531] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T21:26:00.147710] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-03.
[2025-10-24T21:26:00.582339] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T21:26:00.947691] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-02.
[2025-10-24T21:26:01.299613] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-03 (1.15 seconds).
[2025-10-24T21:26:01.747623] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-07.
[2025-10-24T21:26:02.214279] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T21:26:02.547708] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-03.
[2025-10-24T21:26:02.944419] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T21:26:03.347731] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-09.
[2025-10-24T21:26:03.867247] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-03 (1.32 seconds).
[2025-10-24T21:26:04.147669] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-08.
[2025-10-24T21:26:04.895000] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T21:26:04.947602] [INFO ] [REMOTE    ] TFC: Fetching primary data for 2025-10.
[2025-10-24T21:26:05.447611] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T21:26:05.747615] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-09.
[2025-10-24T21:26:06.547725] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-04.
[2025-10-24T21:26:06.808298] [INFO ] [REMOTE    ] TFC: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T21:26:06.818701] [INFO ] [REMOTE    ] TFC: Full fetch complete (77843 records).
[2025-10-24T21:26:06.818841] [DEBUG] [VALIDATOR ] TFC: Validating primary data.
[2025-10-24T21:26:07.149832] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T21:26:07.251789] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present.
[2025-10-24T21:26:07.251874] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed.
[2025-10-24T21:26:07.253042] [INFO ] [MAIN      ] TFC: Fetched primary data is valid.
[2025-10-24T21:26:07.253105] [DEBUG] [LOCAL     ] TFC: Saving primary data.
[2025-10-24T21:26:07.253708] [FATAL] [LOCAL     ] TFC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:26:07.253823] [FATAL] [MAIN      ] TFC: Failed to save primary data.
[2025-10-24T21:26:07.253867] [WARN ] [MAIN      ] TFC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:26:07.253901] [INFO ] [LOCAL     ] TFC: Starting deletion of primary data.
[2025-10-24T21:26:07.253953] [DEBUG] [LOCAL     ] TFC: No primary data file found to delete.
[2025-10-24T21:26:07.253987] [INFO ] [LOCAL     ] TFC: Starting deletion of derivative data.
[2025-10-24T21:26:07.254205] [DEBUG] [LOCAL     ] TFC: Deleted derivative data file.
[2025-10-24T21:26:07.254493] [INFO ] [MAIN      ] Update Progress: 2071/2366 symbols completed. TFC took 32.7s. Estimated remaining: 37m 54s. Rate: 7.8 symbols/min
[2025-10-24T21:26:07.352875] [INFO ] [REMOTE    ] TFII: Fetching primary data for 2025-10.
[2025-10-24T21:26:07.420889] [INFO ] [MAIN      ] TFX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:26:07.456737] [DEBUG] [LOCAL     ] TFX: Loaded 35805 existing records from primary storage.
[2025-10-24T21:26:07.457005] [INFO ] [MAIN      ] TFX: Loaded 35805 existing records.
[2025-10-24T21:26:07.629293] [WARN ] [MAIN      ] TFX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:26:07.629611] [INFO ] [MAIN      ] TFX: Wiping existing primary data before full refresh.
[2025-10-24T21:26:07.629703] [INFO ] [LOCAL     ] TFX: Starting deletion of primary data.
[2025-10-24T21:26:07.630190] [DEBUG] [LOCAL     ] TFX: Deleted primary data file.
[2025-10-24T21:26:07.630246] [INFO ] [MAIN      ] TFX: Starting full primary refresh.
[2025-10-24T21:26:08.006684] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T21:26:08.005494] [INFO ] [REMOTE    ] TFX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:26:08.147608] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-05.
[2025-10-24T21:26:08.720569] [INFO ] [REMOTE    ] TFII: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T21:26:08.726181] [INFO ] [REMOTE    ] TFII: Full fetch complete (47919 records).
[2025-10-24T21:26:08.726309] [DEBUG] [VALIDATOR ] TFII: Validating primary data.
[2025-10-24T21:26:08.952906] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-04.
[2025-10-24T21:26:09.098328] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present.
[2025-10-24T21:26:09.098405] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed.
[2025-10-24T21:26:09.099339] [INFO ] [MAIN      ] TFII: Fetched primary data is valid.
[2025-10-24T21:26:09.099399] [DEBUG] [LOCAL     ] TFII: Saving primary data.
[2025-10-24T21:26:09.099879] [FATAL] [LOCAL     ] TFII: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:26:09.099961] [FATAL] [MAIN      ] TFII: Failed to save primary data.
[2025-10-24T21:26:09.100003] [WARN ] [MAIN      ] TFII: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:26:09.100065] [INFO ] [LOCAL     ] TFII: Starting deletion of primary data.
[2025-10-24T21:26:09.100123] [DEBUG] [LOCAL     ] TFII: No primary data file found to delete.
[2025-10-24T21:26:09.100158] [INFO ] [LOCAL     ] TFII: Starting deletion of derivative data.
[2025-10-24T21:26:09.100300] [DEBUG] [LOCAL     ] TFII: Deleted derivative data file.
[2025-10-24T21:26:09.100375] [INFO ] [MAIN      ] Update Progress: 2072/2366 symbols completed. TFII took 26.5s. Estimated remaining: 37m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:26:09.270890] [INFO ] [MAIN      ] TG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:26:09.282847] [DEBUG] [LOCAL     ] TG: Loaded 10709 existing records from primary storage.
[2025-10-24T21:26:09.283086] [INFO ] [MAIN      ] TG: Loaded 10709 existing records.
[2025-10-24T21:26:09.463452] [WARN ] [MAIN      ] TG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:26:09.463717] [INFO ] [MAIN      ] TG: Wiping existing primary data before full refresh.
[2025-10-24T21:26:09.463777] [INFO ] [LOCAL     ] TG: Starting deletion of primary data.
[2025-10-24T21:26:09.463934] [DEBUG] [LOCAL     ] TG: Deleted primary data file.
[2025-10-24T21:26:09.463973] [INFO ] [MAIN      ] TG: Starting full primary refresh.
[2025-10-24T21:26:09.755748] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-01.
[2025-10-24T21:26:09.745335] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T21:26:09.852099] [INFO ] [REMOTE    ] TG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:26:10.293270] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-04 (1.34 seconds).
[2025-10-24T21:26:10.547732] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-06.
[2025-10-24T21:26:11.340690] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T21:26:11.351692] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-01.
[2025-10-24T21:26:11.948989] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T21:26:12.148745] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-05.
[2025-10-24T21:26:12.150257] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T21:26:12.947616] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-02.
[2025-10-24T21:26:13.143016] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T21:26:13.747622] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-02.
[2025-10-24T21:26:13.773433] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T21:26:14.547676] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-06.
[2025-10-24T21:26:15.107688] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T21:26:15.347701] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-07.
[2025-10-24T21:26:15.624844] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T21:26:16.147685] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-03.
[2025-10-24T21:26:16.839824] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T21:26:16.947708] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-08.
[2025-10-24T21:26:17.747635] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-07.
[2025-10-24T21:26:17.915152] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T21:26:18.513399] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T21:26:18.547617] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-09.
[2025-10-24T21:26:19.118224] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-07 (1.37 seconds).
[2025-10-24T21:26:19.347690] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-08.
[2025-10-24T21:26:20.147716] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-04.
[2025-10-24T21:26:20.235063] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T21:26:20.260079] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-08 (0.91 seconds).
[2025-10-24T21:26:20.947739] [INFO ] [REMOTE    ] TFPM: Fetching primary data for 2025-10.
[2025-10-24T21:26:21.709927] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T21:26:21.747604] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-05.
[2025-10-24T21:26:22.547724] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-09.
[2025-10-24T21:26:22.652428] [INFO ] [REMOTE    ] TFPM: Incremental fetch complete for 2025-10 (1.70 seconds).
[2025-10-24T21:26:22.660980] [INFO ] [REMOTE    ] TFPM: Full fetch complete (53154 records).
[2025-10-24T21:26:22.661098] [DEBUG] [VALIDATOR ] TFPM: Validating primary data.
[2025-10-24T21:26:23.066818] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present.
[2025-10-24T21:26:23.066962] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed.
[2025-10-24T21:26:23.068190] [INFO ] [MAIN      ] TFPM: Fetched primary data is valid.
[2025-10-24T21:26:23.068280] [DEBUG] [LOCAL     ] TFPM: Saving primary data.
[2025-10-24T21:26:23.068797] [FATAL] [LOCAL     ] TFPM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:26:23.068886] [FATAL] [MAIN      ] TFPM: Failed to save primary data.
[2025-10-24T21:26:23.068931] [WARN ] [MAIN      ] TFPM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:26:23.068996] [INFO ] [LOCAL     ] TFPM: Starting deletion of primary data.
[2025-10-24T21:26:23.069082] [DEBUG] [LOCAL     ] TFPM: No primary data file found to delete.
[2025-10-24T21:26:23.069147] [INFO ] [LOCAL     ] TFPM: Starting deletion of derivative data.
[2025-10-24T21:26:23.069375] [DEBUG] [LOCAL     ] TFPM: Deleted derivative data file.
[2025-10-24T21:26:23.069768] [INFO ] [MAIN      ] Update Progress: 2073/2366 symbols completed. TFPM took 25.8s. Estimated remaining: 37m 39s. Rate: 7.8 symbols/min
[2025-10-24T21:26:23.251844] [INFO ] [MAIN      ] TGE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:26:23.252071] [DEBUG] [LOCAL     ] TGE: No existing data file found in primary storage.
[2025-10-24T21:26:23.252156] [WARN ] [MAIN      ] TGE: No existing data found, performing full refresh instead.
[2025-10-24T21:26:23.252432] [INFO ] [MAIN      ] TGE: Wiping existing primary data before full refresh.
[2025-10-24T21:26:23.252618] [INFO ] [LOCAL     ] TGE: Starting deletion of primary data.
[2025-10-24T21:26:23.252904] [DEBUG] [LOCAL     ] TGE: No primary data file found to delete.
[2025-10-24T21:26:23.253110] [INFO ] [MAIN      ] TGE: Starting full primary refresh.
[2025-10-24T21:26:23.351731] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-03.
[2025-10-24T21:26:23.383820] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T21:26:23.632394] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T21:26:23.702294] [INFO ] [REMOTE    ] TGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:26:24.147700] [INFO ] [REMOTE    ] TGE: Fetching primary data for 2025-01.
[2025-10-24T21:26:24.231463] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-03 (0.88 seconds).
[2025-10-24T21:26:24.251170] [DEBUG] [REMOTE    ] TGE: Error fetching primary data for 2025-01: 'API call returned an empty response.'
[2025-10-24T21:26:24.251445] [WARN ] [REMOTE    ] TGE: No data returned for month 2025-01
[2025-10-24T21:26:24.251579] [FATAL] [REMOTE    ] TGE: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:26:24.251689] [FATAL] [MAIN      ] TGE: Failed to fetch primary data.
[2025-10-24T21:26:24.251766] [WARN ] [MAIN      ] TGE: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:26:24.251825] [INFO ] [LOCAL     ] TGE: Starting deletion of primary data.
[2025-10-24T21:26:24.251903] [DEBUG] [LOCAL     ] TGE: No primary data file found to delete.
[2025-10-24T21:26:24.251952] [INFO ] [LOCAL     ] TGE: Starting deletion of derivative data.
[2025-10-24T21:26:24.252007] [DEBUG] [LOCAL     ] TGE: No derivative data file found to delete.
[2025-10-24T21:26:24.252071] [INFO ] [MAIN      ] Update Progress: 2074/2366 symbols completed. TGE took 1.2s. Estimated remaining: 37m 30s. Rate: 7.8 symbols/min
[2025-10-24T21:26:24.422788] [INFO ] [MAIN      ] TGLS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:26:24.450437] [DEBUG] [LOCAL     ] TGLS: Loaded 27762 existing records from primary storage.
[2025-10-24T21:26:24.450729] [INFO ] [MAIN      ] TGLS: Loaded 27762 existing records.
[2025-10-24T21:26:24.625046] [WARN ] [MAIN      ] TGLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:26:24.625273] [INFO ] [MAIN      ] TGLS: Wiping existing primary data before full refresh.
[2025-10-24T21:26:24.625319] [INFO ] [LOCAL     ] TGLS: Starting deletion of primary data.
[2025-10-24T21:26:24.625716] [DEBUG] [LOCAL     ] TGLS: Deleted primary data file.
[2025-10-24T21:26:24.625771] [INFO ] [MAIN      ] TGLS: Starting full primary refresh.
[2025-10-24T21:26:24.948035] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-04.
[2025-10-24T21:26:24.979415] [INFO ] [REMOTE    ] TGLS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:26:25.747699] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-01.
[2025-10-24T21:26:25.817497] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T21:26:26.547745] [INFO ] [REMOTE    ] TFIN: Fetching primary data for 2025-10.
[2025-10-24T21:26:27.078457] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-01 (1.33 seconds).
[2025-10-24T21:26:27.327252] [INFO ] [REMOTE    ] TFIN: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T21:26:27.332948] [INFO ] [REMOTE    ] TFIN: Full fetch complete (32700 records).
[2025-10-24T21:26:27.333074] [DEBUG] [VALIDATOR ] TFIN: Validating primary data.
[2025-10-24T21:26:27.354369] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-06.
[2025-10-24T21:26:27.711459] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present.
[2025-10-24T21:26:27.711547] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed.
[2025-10-24T21:26:27.712246] [INFO ] [MAIN      ] TFIN: Fetched primary data is valid.
[2025-10-24T21:26:27.712313] [DEBUG] [LOCAL     ] TFIN: Saving primary data.
[2025-10-24T21:26:27.712750] [FATAL] [LOCAL     ] TFIN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:26:27.712832] [FATAL] [MAIN      ] TFIN: Failed to save primary data.
[2025-10-24T21:26:27.712874] [WARN ] [MAIN      ] TFIN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:26:27.712907] [INFO ] [LOCAL     ] TFIN: Starting deletion of primary data.
[2025-10-24T21:26:27.712985] [DEBUG] [LOCAL     ] TFIN: No primary data file found to delete.
[2025-10-24T21:26:27.713040] [INFO ] [LOCAL     ] TFIN: Starting deletion of derivative data.
[2025-10-24T21:26:27.713476] [DEBUG] [LOCAL     ] TFIN: Deleted derivative data file.
[2025-10-24T21:26:27.713571] [INFO ] [MAIN      ] Update Progress: 2075/2366 symbols completed. TFIN took 33.7s. Estimated remaining: 37m 22s. Rate: 7.8 symbols/min
[2025-10-24T21:26:27.882246] [INFO ] [MAIN      ] TGNA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:26:27.928519] [DEBUG] [LOCAL     ] TGNA: Loaded 48836 existing records from primary storage.
[2025-10-24T21:26:27.928891] [INFO ] [MAIN      ] TGNA: Loaded 48836 existing records.
[2025-10-24T21:26:28.112633] [WARN ] [MAIN      ] TGNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:26:28.112860] [INFO ] [MAIN      ] TGNA: Wiping existing primary data before full refresh.
[2025-10-24T21:26:28.112906] [INFO ] [LOCAL     ] TGNA: Starting deletion of primary data.
[2025-10-24T21:26:28.113495] [DEBUG] [LOCAL     ] TGNA: Deleted primary data file.
[2025-10-24T21:26:28.113550] [INFO ] [MAIN      ] TGNA: Starting full primary refresh.
[2025-10-24T21:26:28.156743] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-02.
[2025-10-24T21:26:28.477025] [INFO ] [REMOTE    ] TGNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:26:28.872874] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T21:26:28.947630] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-07.
[2025-10-24T21:26:29.378478] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T21:26:29.747746] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-01.
[2025-10-24T21:26:30.168754] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T21:26:30.547699] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-08.
[2025-10-24T21:26:31.233573] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T21:26:31.347722] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-02.
[2025-10-24T21:26:31.668553] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T21:26:32.147633] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-09.
[2025-10-24T21:26:32.906056] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T21:26:32.947620] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-03.
[2025-10-24T21:26:33.699454] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-09 (1.55 seconds).
[2025-10-24T21:26:33.747614] [INFO ] [REMOTE    ] TFX: Fetching primary data for 2025-10.
[2025-10-24T21:26:34.547725] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-03.
[2025-10-24T21:26:34.679163] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T21:26:34.750673] [INFO ] [REMOTE    ] TFX: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T21:26:34.756808] [INFO ] [REMOTE    ] TFX: Full fetch complete (54620 records).
[2025-10-24T21:26:34.756902] [DEBUG] [VALIDATOR ] TFX: Validating primary data.
[2025-10-24T21:26:35.131688] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present.
[2025-10-24T21:26:35.131782] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed.
[2025-10-24T21:26:35.132828] [INFO ] [MAIN      ] TFX: Fetched primary data is valid.
[2025-10-24T21:26:35.132890] [DEBUG] [LOCAL     ] TFX: Saving primary data.
[2025-10-24T21:26:35.133400] [FATAL] [LOCAL     ] TFX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:26:35.133484] [FATAL] [MAIN      ] TFX: Failed to save primary data.
[2025-10-24T21:26:35.133535] [WARN ] [MAIN      ] TFX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:26:35.133570] [INFO ] [LOCAL     ] TFX: Starting deletion of primary data.
[2025-10-24T21:26:35.133622] [DEBUG] [LOCAL     ] TFX: No primary data file found to delete.
[2025-10-24T21:26:35.133751] [INFO ] [LOCAL     ] TFX: Starting deletion of derivative data.
[2025-10-24T21:26:35.133997] [DEBUG] [LOCAL     ] TFX: Deleted derivative data file.
[2025-10-24T21:26:35.134091] [INFO ] [MAIN      ] Update Progress: 2076/2366 symbols completed. TFX took 27.9s. Estimated remaining: 37m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:26:35.304197] [INFO ] [MAIN      ] TGS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:26:35.335505] [DEBUG] [LOCAL     ] TGS: Loaded 34102 existing records from primary storage.
[2025-10-24T21:26:35.335809] [INFO ] [MAIN      ] TGS: Loaded 34102 existing records.
[2025-10-24T21:26:35.356114] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-05.
[2025-10-24T21:26:35.515383] [WARN ] [MAIN      ] TGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:26:35.515595] [INFO ] [MAIN      ] TGS: Wiping existing primary data before full refresh.
[2025-10-24T21:26:35.515662] [INFO ] [LOCAL     ] TGS: Starting deletion of primary data.
[2025-10-24T21:26:35.516037] [DEBUG] [LOCAL     ] TGS: Deleted primary data file.
[2025-10-24T21:26:35.516091] [INFO ] [MAIN      ] TGS: Starting full primary refresh.
[2025-10-24T21:26:35.864780] [INFO ] [REMOTE    ] TGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:26:35.884014] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T21:26:36.147755] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-04.
[2025-10-24T21:26:36.193753] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-05 (0.84 seconds).
[2025-10-24T21:26:36.947728] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-04.
[2025-10-24T21:26:37.747712] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-01.
[2025-10-24T21:26:37.886298] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T21:26:38.342217] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-04 (1.39 seconds).
[2025-10-24T21:26:38.547686] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-06.
[2025-10-24T21:26:39.228225] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T21:26:39.308320] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-06 (0.76 seconds).
[2025-10-24T21:26:39.347750] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-02.
[2025-10-24T21:26:40.147779] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-05.
[2025-10-24T21:26:40.707158] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T21:26:40.947721] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-07.
[2025-10-24T21:26:41.578468] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T21:26:41.740319] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T21:26:41.747593] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-08.
[2025-10-24T21:26:42.547673] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-05.
[2025-10-24T21:26:42.565193] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T21:26:43.347687] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-03.
[2025-10-24T21:26:44.147730] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-06.
[2025-10-24T21:26:44.224565] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T21:26:44.674352] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-03 (1.33 seconds).
[2025-10-24T21:26:44.947634] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-06.
[2025-10-24T21:26:45.322835] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-06 (1.18 seconds).
[2025-10-24T21:26:45.747769] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-07.
[2025-10-24T21:26:46.538367] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T21:26:46.547841] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-07.
[2025-10-24T21:26:46.961982] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T21:26:47.347631] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-08.
[2025-10-24T21:26:48.044891] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-07 (1.50 seconds).
[2025-10-24T21:26:48.147687] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-09.
[2025-10-24T21:26:48.670193] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-08 (1.32 seconds).
[2025-10-24T21:26:48.925961] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T21:26:48.947626] [INFO ] [REMOTE    ] TG: Fetching primary data for 2025-10.
[2025-10-24T21:26:49.747779] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-09.
[2025-10-24T21:26:49.792763] [INFO ] [REMOTE    ] TG: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T21:26:49.795869] [INFO ] [REMOTE    ] TG: Full fetch complete (15101 records).
[2025-10-24T21:26:49.795967] [DEBUG] [VALIDATOR ] TG: Validating primary data.
[2025-10-24T21:26:50.169931] [DEBUG] [VALIDATOR ] TG: All expected trading days are present.
[2025-10-24T21:26:50.170033] [DEBUG] [VALIDATOR ] TG: Primary data validation passed.
[2025-10-24T21:26:50.170570] [INFO ] [MAIN      ] TG: Fetched primary data is valid.
[2025-10-24T21:26:50.170613] [DEBUG] [LOCAL     ] TG: Saving primary data.
[2025-10-24T21:26:50.170928] [FATAL] [LOCAL     ] TG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:26:50.171015] [FATAL] [MAIN      ] TG: Failed to save primary data.
[2025-10-24T21:26:50.171057] [WARN ] [MAIN      ] TG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:26:50.171092] [INFO ] [LOCAL     ] TG: Starting deletion of primary data.
[2025-10-24T21:26:50.171144] [DEBUG] [LOCAL     ] TG: No primary data file found to delete.
[2025-10-24T21:26:50.171180] [INFO ] [LOCAL     ] TG: Starting deletion of derivative data.
[2025-10-24T21:26:50.171392] [DEBUG] [LOCAL     ] TG: Deleted derivative data file.
[2025-10-24T21:26:50.171476] [INFO ] [MAIN      ] Update Progress: 2077/2366 symbols completed. TG took 41.1s. Estimated remaining: 37m 7s. Rate: 7.8 symbols/min
[2025-10-24T21:26:50.547714] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-08.
[2025-10-24T21:26:50.924322] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T21:26:51.347626] [INFO ] [REMOTE    ] TGLS: Fetching primary data for 2025-10.
[2025-10-24T21:26:52.147607] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-04.
[2025-10-24T21:26:52.492079] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T21:26:52.521210] [INFO ] [REMOTE    ] TGLS: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T21:26:52.528371] [INFO ] [REMOTE    ] TGLS: Full fetch complete (40389 records).
[2025-10-24T21:26:52.528494] [DEBUG] [VALIDATOR ] TGLS: Validating primary data.
[2025-10-24T21:26:52.900978] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present.
[2025-10-24T21:26:52.901082] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed.
[2025-10-24T21:26:52.901895] [INFO ] [MAIN      ] TGLS: Fetched primary data is valid.
[2025-10-24T21:26:52.901957] [DEBUG] [LOCAL     ] TGLS: Saving primary data.
[2025-10-24T21:26:52.902358] [FATAL] [LOCAL     ] TGLS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:26:52.902445] [FATAL] [MAIN      ] TGLS: Failed to save primary data.
[2025-10-24T21:26:52.902486] [WARN ] [MAIN      ] TGLS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:26:52.902520] [INFO ] [LOCAL     ] TGLS: Starting deletion of primary data.
[2025-10-24T21:26:52.902570] [DEBUG] [LOCAL     ] TGLS: No primary data file found to delete.
[2025-10-24T21:26:52.902604] [INFO ] [LOCAL     ] TGLS: Starting deletion of derivative data.
[2025-10-24T21:26:52.902772] [DEBUG] [LOCAL     ] TGLS: Deleted derivative data file.
[2025-10-24T21:26:52.902868] [INFO ] [MAIN      ] Update Progress: 2078/2366 symbols completed. TGLS took 28.7s. Estimated remaining: 36m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:26:52.947719] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-09.
[2025-10-24T21:26:53.236021] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T21:26:53.747743] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-05.
[2025-10-24T21:26:54.455179] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T21:26:54.547625] [INFO ] [REMOTE    ] TGNA: Fetching primary data for 2025-10.
[2025-10-24T21:26:55.052588] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T21:26:55.347741] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-06.
[2025-10-24T21:26:56.176417] [INFO ] [REMOTE    ] TGNA: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T21:26:56.186075] [INFO ] [REMOTE    ] TGNA: Full fetch complete (69970 records).
[2025-10-24T21:26:56.186275] [DEBUG] [VALIDATOR ] TGNA: Validating primary data.
[2025-10-24T21:26:56.625749] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present.
[2025-10-24T21:26:56.626032] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed.
[2025-10-24T21:26:56.628133] [INFO ] [MAIN      ] TGNA: Fetched primary data is valid.
[2025-10-24T21:26:56.628297] [DEBUG] [LOCAL     ] TGNA: Saving primary data.
[2025-10-24T21:26:56.629336] [FATAL] [LOCAL     ] TGNA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:26:56.629436] [FATAL] [MAIN      ] TGNA: Failed to save primary data.
[2025-10-24T21:26:56.629481] [WARN ] [MAIN      ] TGNA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:26:56.629547] [INFO ] [LOCAL     ] TGNA: Starting deletion of primary data.
[2025-10-24T21:26:56.629623] [DEBUG] [LOCAL     ] TGNA: No primary data file found to delete.
[2025-10-24T21:26:56.629709] [INFO ] [LOCAL     ] TGNA: Starting deletion of derivative data.
[2025-10-24T21:26:56.630028] [DEBUG] [LOCAL     ] TGNA: Deleted derivative data file.
[2025-10-24T21:26:56.630936] [INFO ] [MAIN      ] Update Progress: 2079/2366 symbols completed. TGNA took 28.9s. Estimated remaining: 36m 51s. Rate: 7.8 symbols/min
[2025-10-24T21:26:56.683053] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T21:26:56.689671] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-07.
[2025-10-24T21:26:58.082182] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T21:26:58.089407] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-08.
[2025-10-24T21:26:59.436308] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T21:26:59.443810] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-09.
[2025-10-24T21:27:01.041236] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T21:27:01.051130] [INFO ] [REMOTE    ] TGS: Fetching primary data for 2025-10.
[2025-10-24T21:27:02.550079] [INFO ] [REMOTE    ] TGS: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T21:27:02.557529] [INFO ] [REMOTE    ] TGS: Full fetch complete (48701 records).
[2025-10-24T21:27:02.557715] [DEBUG] [VALIDATOR ] TGS: Validating primary data.
[2025-10-24T21:27:02.979917] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present.
[2025-10-24T21:27:02.980020] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed.
[2025-10-24T21:27:02.981517] [INFO ] [MAIN      ] TGS: Fetched primary data is valid.
[2025-10-24T21:27:02.981582] [DEBUG] [LOCAL     ] TGS: Saving primary data.
[2025-10-24T21:27:02.982207] [FATAL] [LOCAL     ] TGS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:27:02.982300] [FATAL] [MAIN      ] TGS: Failed to save primary data.
[2025-10-24T21:27:02.982342] [WARN ] [MAIN      ] TGS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:27:02.982377] [INFO ] [LOCAL     ] TGS: Starting deletion of primary data.
[2025-10-24T21:27:02.982434] [DEBUG] [LOCAL     ] TGS: No primary data file found to delete.
[2025-10-24T21:27:02.982468] [INFO ] [LOCAL     ] TGS: Starting deletion of derivative data.
[2025-10-24T21:27:02.982765] [DEBUG] [LOCAL     ] TGS: Deleted derivative data file.
[2025-10-24T21:27:02.982874] [INFO ] [MAIN      ] Update Progress: 2080/2366 symbols completed. TGS took 27.8s. Estimated remaining: 36m 43s. Rate: 7.8 symbols/min
[2025-10-24T21:27:03.605638] [INFO ] [MAIN      ] TGT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:27:03.689453] [INFO ] [MAIN      ] THIR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:27:03.722043] [INFO ] [MAIN      ] THG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:27:03.757408] [INFO ] [MAIN      ] THC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:27:03.764211] [DEBUG] [LOCAL     ] THIR: Loaded 2480 existing records from primary storage.
[2025-10-24T21:27:03.764808] [INFO ] [MAIN      ] THIR: Loaded 2480 existing records.
[2025-10-24T21:27:03.996095] [DEBUG] [LOCAL     ] THG: Loaded 21631 existing records from primary storage.
[2025-10-24T21:27:04.012109] [INFO ] [MAIN      ] THG: Loaded 21631 existing records.
[2025-10-24T21:27:04.021104] [WARN ] [MAIN      ] THIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:27:04.021606] [INFO ] [MAIN      ] THIR: Wiping existing primary data before full refresh.
[2025-10-24T21:27:04.021749] [INFO ] [LOCAL     ] THIR: Starting deletion of primary data.
[2025-10-24T21:27:04.023030] [DEBUG] [LOCAL     ] TGT: Loaded 54167 existing records from primary storage.
[2025-10-24T21:27:04.050147] [DEBUG] [LOCAL     ] THIR: Deleted primary data file.
[2025-10-24T21:27:04.060798] [INFO ] [MAIN      ] THIR: Starting full primary refresh.
[2025-10-24T21:27:04.128500] [INFO ] [MAIN      ] TGT: Loaded 54167 existing records.
[2025-10-24T21:27:04.263947] [DEBUG] [LOCAL     ] THC: Loaded 46974 existing records from primary storage.
[2025-10-24T21:27:04.290924] [INFO ] [MAIN      ] THC: Loaded 46974 existing records.
[2025-10-24T21:27:04.529563] [WARN ] [MAIN      ] THG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:27:04.571530] [INFO ] [MAIN      ] THG: Wiping existing primary data before full refresh.
[2025-10-24T21:27:04.581941] [INFO ] [LOCAL     ] THG: Starting deletion of primary data.
[2025-10-24T21:27:04.651205] [DEBUG] [LOCAL     ] THG: Deleted primary data file.
[2025-10-24T21:27:04.708099] [INFO ] [MAIN      ] THG: Starting full primary refresh.
[2025-10-24T21:27:04.737600] [WARN ] [MAIN      ] TGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:27:04.872276] [INFO ] [MAIN      ] TGT: Wiping existing primary data before full refresh.
[2025-10-24T21:27:04.898502] [INFO ] [LOCAL     ] TGT: Starting deletion of primary data.
[2025-10-24T21:27:04.908806] [WARN ] [MAIN      ] THC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:27:04.962604] [DEBUG] [LOCAL     ] TGT: Deleted primary data file.
[2025-10-24T21:27:04.983609] [INFO ] [MAIN      ] TGT: Starting full primary refresh.
[2025-10-24T21:27:04.983529] [INFO ] [MAIN      ] THC: Wiping existing primary data before full refresh.
[2025-10-24T21:27:05.045855] [INFO ] [LOCAL     ] THC: Starting deletion of primary data.
[2025-10-24T21:27:05.124897] [DEBUG] [LOCAL     ] THC: Deleted primary data file.
[2025-10-24T21:27:05.176253] [INFO ] [MAIN      ] THC: Starting full primary refresh.
[2025-10-24T21:27:05.483436] [INFO ] [REMOTE    ] THIR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:27:05.530731] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-01.
[2025-10-24T21:27:05.916596] [INFO ] [REMOTE    ] THG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:27:05.989958] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-01.
[2025-10-24T21:27:06.041775] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-01 (0.51 seconds).
[2025-10-24T21:27:06.057157] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-02.
[2025-10-24T21:27:06.137832] [INFO ] [REMOTE    ] TGT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:27:06.163266] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-01.
[2025-10-24T21:27:06.202411] [INFO ] [REMOTE    ] THC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:27:06.203157] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-01.
[2025-10-24T21:27:06.479577] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-02 (0.42 seconds).
[2025-10-24T21:27:06.480523] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-03.
[2025-10-24T21:27:06.821231] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-03 (0.34 seconds).
[2025-10-24T21:27:06.822551] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-04.
[2025-10-24T21:27:07.154951] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T21:27:07.159099] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-02.
[2025-10-24T21:27:07.258145] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-04 (0.44 seconds).
[2025-10-24T21:27:07.259560] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-05.
[2025-10-24T21:27:07.710259] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-05 (0.45 seconds).
[2025-10-24T21:27:07.711409] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-06.
[2025-10-24T21:27:07.836229] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T21:27:07.845509] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-02.
[2025-10-24T21:27:07.916300] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T21:27:08.063471] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-01 (1.90 seconds).
[2025-10-24T21:27:08.147613] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-02.
[2025-10-24T21:27:08.233529] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-06 (0.52 seconds).
[2025-10-24T21:27:08.947671] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-03.
[2025-10-24T21:27:09.013218] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-02 (1.17 seconds).
[2025-10-24T21:27:09.747711] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-07.
[2025-10-24T21:27:09.805953] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-03 (0.86 seconds).
[2025-10-24T21:27:10.153767] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-02 (2.01 seconds).
[2025-10-24T21:27:10.272560] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-07 (0.52 seconds).
[2025-10-24T21:27:10.547673] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-08.
[2025-10-24T21:27:11.102555] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-08 (0.55 seconds).
[2025-10-24T21:27:11.347631] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-03.
[2025-10-24T21:27:12.147723] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-09.
[2025-10-24T21:27:12.593271] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T21:27:12.947699] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-04.
[2025-10-24T21:27:13.105203] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T21:27:13.747708] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-03.
[2025-10-24T21:27:14.303767] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T21:27:14.547678] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-04.
[2025-10-24T21:27:15.348235] [INFO ] [REMOTE    ] THIR: Fetching primary data for 2025-10.
[2025-10-24T21:27:15.890083] [INFO ] [REMOTE    ] THIR: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T21:27:15.892340] [INFO ] [REMOTE    ] THIR: Full fetch complete (2982 records).
[2025-10-24T21:27:15.904398] [DEBUG] [VALIDATOR ] THIR: Validating primary data.
[2025-10-24T21:27:15.998568] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-03 (2.25 seconds).
[2025-10-24T21:27:16.152020] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-04.
[2025-10-24T21:27:16.334334] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present.
[2025-10-24T21:27:16.334497] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed.
[2025-10-24T21:27:16.334747] [INFO ] [MAIN      ] THIR: Fetched primary data is valid.
[2025-10-24T21:27:16.334891] [DEBUG] [LOCAL     ] THIR: Saving primary data.
[2025-10-24T21:27:16.335291] [FATAL] [LOCAL     ] THIR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:27:16.357797] [FATAL] [MAIN      ] THIR: Failed to save primary data.
[2025-10-24T21:27:16.381306] [WARN ] [MAIN      ] THIR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:27:16.381528] [INFO ] [LOCAL     ] THIR: Starting deletion of primary data.
[2025-10-24T21:27:16.381598] [DEBUG] [LOCAL     ] THIR: No primary data file found to delete.
[2025-10-24T21:27:16.381670] [INFO ] [LOCAL     ] THIR: Starting deletion of derivative data.
[2025-10-24T21:27:16.382041] [DEBUG] [LOCAL     ] THIR: Deleted derivative data file.
[2025-10-24T21:27:16.382181] [INFO ] [MAIN      ] Update Progress: 2081/2366 symbols completed. THIR took 13.4s. Estimated remaining: 36m 36s. Rate: 7.8 symbols/min
[2025-10-24T21:27:16.418525] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T21:27:16.578303] [INFO ] [MAIN      ] THLV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:27:16.582319] [DEBUG] [LOCAL     ] THLV: Loaded 1496 existing records from primary storage.
[2025-10-24T21:27:16.582493] [INFO ] [MAIN      ] THLV: Loaded 1496 existing records.
[2025-10-24T21:27:16.768661] [WARN ] [MAIN      ] THLV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:27:16.768898] [INFO ] [MAIN      ] THLV: Wiping existing primary data before full refresh.
[2025-10-24T21:27:16.768946] [INFO ] [LOCAL     ] THLV: Starting deletion of primary data.
[2025-10-24T21:27:16.769114] [DEBUG] [LOCAL     ] THLV: Deleted primary data file.
[2025-10-24T21:27:16.769170] [INFO ] [MAIN      ] THLV: Starting full primary refresh.
[2025-10-24T21:27:16.956511] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-05.
[2025-10-24T21:27:17.124577] [INFO ] [REMOTE    ] THLV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:27:17.747625] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-01.
[2025-10-24T21:27:18.106529] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T21:27:18.228667] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-01 (0.48 seconds).
[2025-10-24T21:27:18.547615] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-02.
[2025-10-24T21:27:18.657240] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-04 (2.51 seconds).
[2025-10-24T21:27:19.011221] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T21:27:19.347713] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-03.
[2025-10-24T21:27:19.792466] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-03 (0.44 seconds).
[2025-10-24T21:27:20.147740] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-05.
[2025-10-24T21:27:20.947686] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-05.
[2025-10-24T21:27:21.747737] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-06.
[2025-10-24T21:27:21.918100] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-05 (1.77 seconds).
[2025-10-24T21:27:22.547704] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-06.
[2025-10-24T21:27:22.758774] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T21:27:22.946929] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T21:27:23.347709] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-06.
[2025-10-24T21:27:24.147702] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-04.
[2025-10-24T21:27:24.287217] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T21:27:24.675549] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-04 (0.53 seconds).
[2025-10-24T21:27:24.947637] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-05.
[2025-10-24T21:27:25.377282] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-05 (0.43 seconds).
[2025-10-24T21:27:25.421446] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-06 (2.07 seconds).
[2025-10-24T21:27:25.747684] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-07.
[2025-10-24T21:27:26.547713] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-06.
[2025-10-24T21:27:26.878624] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-06 (0.33 seconds).
[2025-10-24T21:27:27.347680] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-07.
[2025-10-24T21:27:28.127618] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-07 (2.38 seconds).
[2025-10-24T21:27:28.147600] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-08.
[2025-10-24T21:27:28.947671] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-07.
[2025-10-24T21:27:29.075020] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-07 (1.73 seconds).
[2025-10-24T21:27:29.295244] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-07 (0.35 seconds).
[2025-10-24T21:27:29.747763] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-08.
[2025-10-24T21:27:30.100389] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-08 (0.35 seconds).
[2025-10-24T21:27:30.257738] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-08 (2.11 seconds).
[2025-10-24T21:27:30.547680] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-09.
[2025-10-24T21:27:30.913994] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T21:27:31.347694] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-08.
[2025-10-24T21:27:32.147694] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-09.
[2025-10-24T21:27:32.952775] [INFO ] [REMOTE    ] THLV: Fetching primary data for 2025-10.
[2025-10-24T21:27:32.969141] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T21:27:33.411610] [INFO ] [REMOTE    ] THLV: Incremental fetch complete for 2025-10 (0.46 seconds).
[2025-10-24T21:27:33.412465] [INFO ] [REMOTE    ] THLV: Full fetch complete (2513 records).
[2025-10-24T21:27:33.412531] [DEBUG] [VALIDATOR ] THLV: Validating primary data.
[2025-10-24T21:27:33.753683] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-09.
[2025-10-24T21:27:33.759477] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present.
[2025-10-24T21:27:33.760265] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed.
[2025-10-24T21:27:33.760431] [INFO ] [MAIN      ] THLV: Fetched primary data is valid.
[2025-10-24T21:27:33.760478] [DEBUG] [LOCAL     ] THLV: Saving primary data.
[2025-10-24T21:27:33.760675] [FATAL] [LOCAL     ] THLV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:27:33.760739] [FATAL] [MAIN      ] THLV: Failed to save primary data.
[2025-10-24T21:27:33.760778] [WARN ] [MAIN      ] THLV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:27:33.760812] [INFO ] [LOCAL     ] THLV: Starting deletion of primary data.
[2025-10-24T21:27:33.760857] [DEBUG] [LOCAL     ] THLV: No primary data file found to delete.
[2025-10-24T21:27:33.760891] [INFO ] [LOCAL     ] THLV: Starting deletion of derivative data.
[2025-10-24T21:27:33.761025] [DEBUG] [LOCAL     ] THLV: Deleted derivative data file.
[2025-10-24T21:27:33.761090] [INFO ] [MAIN      ] Update Progress: 2082/2366 symbols completed. THLV took 17.4s. Estimated remaining: 36m 29s. Rate: 7.8 symbols/min
[2025-10-24T21:27:33.930625] [INFO ] [MAIN      ] THO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:27:33.970359] [DEBUG] [LOCAL     ] THO: Loaded 41235 existing records from primary storage.
[2025-10-24T21:27:33.970684] [INFO ] [MAIN      ] THO: Loaded 41235 existing records.
[2025-10-24T21:27:34.157331] [WARN ] [MAIN      ] THO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:27:34.157596] [INFO ] [MAIN      ] THO: Wiping existing primary data before full refresh.
[2025-10-24T21:27:34.157681] [INFO ] [LOCAL     ] THO: Starting deletion of primary data.
[2025-10-24T21:27:34.158211] [DEBUG] [LOCAL     ] THO: Deleted primary data file.
[2025-10-24T21:27:34.158268] [INFO ] [MAIN      ] THO: Starting full primary refresh.
[2025-10-24T21:27:34.556454] [INFO ] [REMOTE    ] THO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:27:34.551610] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-07.
[2025-10-24T21:27:34.595329] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-09 (2.45 seconds).
[2025-10-24T21:27:35.088168] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T21:27:35.347718] [INFO ] [REMOTE    ] TGT: Fetching primary data for 2025-10.
[2025-10-24T21:27:35.759946] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T21:27:36.147691] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-01.
[2025-10-24T21:27:36.947748] [INFO ] [REMOTE    ] THC: Fetching primary data for 2025-10.
[2025-10-24T21:27:37.411775] [INFO ] [REMOTE    ] TGT: Incremental fetch complete for 2025-10 (2.06 seconds).
[2025-10-24T21:27:37.424290] [INFO ] [REMOTE    ] TGT: Full fetch complete (77955 records).
[2025-10-24T21:27:37.424548] [DEBUG] [VALIDATOR ] TGT: Validating primary data.
[2025-10-24T21:27:37.752331] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-08.
[2025-10-24T21:27:37.840965] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present.
[2025-10-24T21:27:37.841164] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed.
[2025-10-24T21:27:37.842451] [INFO ] [MAIN      ] TGT: Fetched primary data is valid.
[2025-10-24T21:27:37.842723] [DEBUG] [LOCAL     ] TGT: Saving primary data.
[2025-10-24T21:27:37.851113] [FATAL] [LOCAL     ] TGT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:27:37.864340] [FATAL] [MAIN      ] TGT: Failed to save primary data.
[2025-10-24T21:27:37.865049] [WARN ] [MAIN      ] TGT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:27:37.865883] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T21:27:37.866084] [INFO ] [LOCAL     ] TGT: Starting deletion of primary data.
[2025-10-24T21:27:37.874303] [DEBUG] [LOCAL     ] TGT: No primary data file found to delete.
[2025-10-24T21:27:37.874365] [INFO ] [LOCAL     ] TGT: Starting deletion of derivative data.
[2025-10-24T21:27:37.874575] [DEBUG] [LOCAL     ] TGT: Deleted derivative data file.
[2025-10-24T21:27:37.875014] [INFO ] [MAIN      ] Update Progress: 2083/2366 symbols completed. TGT took 34.9s. Estimated remaining: 36m 21s. Rate: 7.8 symbols/min
[2025-10-24T21:27:38.039606] [INFO ] [MAIN      ] THQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:27:38.066772] [DEBUG] [LOCAL     ] THQ: Loaded 25471 existing records from primary storage.
[2025-10-24T21:27:38.067024] [INFO ] [MAIN      ] THQ: Loaded 25471 existing records.
[2025-10-24T21:27:38.242238] [WARN ] [MAIN      ] THQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:27:38.242423] [INFO ] [MAIN      ] THQ: Wiping existing primary data before full refresh.
[2025-10-24T21:27:38.242466] [INFO ] [LOCAL     ] THQ: Starting deletion of primary data.
[2025-10-24T21:27:38.242783] [DEBUG] [LOCAL     ] THQ: Deleted primary data file.
[2025-10-24T21:27:38.242836] [INFO ] [MAIN      ] THQ: Starting full primary refresh.
[2025-10-24T21:27:38.547941] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-02.
[2025-10-24T21:27:38.600661] [INFO ] [REMOTE    ] THQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:27:38.620473] [INFO ] [REMOTE    ] THC: Incremental fetch complete for 2025-10 (1.67 seconds).
[2025-10-24T21:27:38.628389] [INFO ] [REMOTE    ] THC: Full fetch complete (68644 records).
[2025-10-24T21:27:38.628503] [DEBUG] [VALIDATOR ] THC: Validating primary data.
[2025-10-24T21:27:39.032923] [DEBUG] [VALIDATOR ] THC: All expected trading days are present.
[2025-10-24T21:27:39.033849] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-08 (1.28 seconds).
[2025-10-24T21:27:39.034060] [DEBUG] [VALIDATOR ] THC: Primary data validation passed.
[2025-10-24T21:27:39.040971] [INFO ] [MAIN      ] THC: Fetched primary data is valid.
[2025-10-24T21:27:39.041547] [DEBUG] [LOCAL     ] THC: Saving primary data.
[2025-10-24T21:27:39.042546] [FATAL] [LOCAL     ] THC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:27:39.042633] [FATAL] [MAIN      ] THC: Failed to save primary data.
[2025-10-24T21:27:39.042734] [WARN ] [MAIN      ] THC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:27:39.042802] [INFO ] [LOCAL     ] THC: Starting deletion of primary data.
[2025-10-24T21:27:39.042876] [DEBUG] [LOCAL     ] THC: No primary data file found to delete.
[2025-10-24T21:27:39.042912] [INFO ] [LOCAL     ] THC: Starting deletion of derivative data.
[2025-10-24T21:27:39.043116] [DEBUG] [LOCAL     ] THC: Deleted derivative data file.
[2025-10-24T21:27:39.043487] [INFO ] [MAIN      ] Update Progress: 2084/2366 symbols completed. THC took 36.0s. Estimated remaining: 36m 13s. Rate: 7.8 symbols/min
[2025-10-24T21:27:39.210272] [INFO ] [MAIN      ] THR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:27:39.229588] [DEBUG] [LOCAL     ] THR: Loaded 19624 existing records from primary storage.
[2025-10-24T21:27:39.229866] [INFO ] [MAIN      ] THR: Loaded 19624 existing records.
[2025-10-24T21:27:39.353000] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-09.
[2025-10-24T21:27:39.406673] [WARN ] [MAIN      ] THR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:27:39.407244] [INFO ] [MAIN      ] THR: Wiping existing primary data before full refresh.
[2025-10-24T21:27:39.407298] [INFO ] [LOCAL     ] THR: Starting deletion of primary data.
[2025-10-24T21:27:39.407798] [DEBUG] [LOCAL     ] THR: Deleted primary data file.
[2025-10-24T21:27:39.407855] [INFO ] [MAIN      ] THR: Starting full primary refresh.
[2025-10-24T21:27:39.755601] [INFO ] [REMOTE    ] THR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:27:40.043555] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T21:27:40.147636] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-01.
[2025-10-24T21:27:40.528183] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T21:27:40.686776] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T21:27:40.947674] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-02.
[2025-10-24T21:27:41.747624] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-03.
[2025-10-24T21:27:42.146625] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T21:27:42.547708] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-01.
[2025-10-24T21:27:43.278302] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T21:27:43.347617] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-04.
[2025-10-24T21:27:43.732481] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T21:27:44.147741] [INFO ] [REMOTE    ] THG: Fetching primary data for 2025-10.
[2025-10-24T21:27:44.947726] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-02.
[2025-10-24T21:27:45.088526] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T21:27:45.152991] [INFO ] [REMOTE    ] THG: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T21:27:45.157330] [INFO ] [REMOTE    ] THG: Full fetch complete (31553 records).
[2025-10-24T21:27:45.157420] [DEBUG] [VALIDATOR ] THG: Validating primary data.
[2025-10-24T21:27:45.563022] [DEBUG] [VALIDATOR ] THG: All expected trading days are present.
[2025-10-24T21:27:45.563199] [DEBUG] [VALIDATOR ] THG: Primary data validation passed.
[2025-10-24T21:27:45.563946] [INFO ] [MAIN      ] THG: Fetched primary data is valid.
[2025-10-24T21:27:45.564027] [DEBUG] [LOCAL     ] THG: Saving primary data.
[2025-10-24T21:27:45.564565] [FATAL] [LOCAL     ] THG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:27:45.564756] [FATAL] [MAIN      ] THG: Failed to save primary data.
[2025-10-24T21:27:45.564896] [WARN ] [MAIN      ] THG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:27:45.565027] [INFO ] [LOCAL     ] THG: Starting deletion of primary data.
[2025-10-24T21:27:45.565150] [DEBUG] [LOCAL     ] THG: No primary data file found to delete.
[2025-10-24T21:27:45.565235] [INFO ] [LOCAL     ] THG: Starting deletion of derivative data.
[2025-10-24T21:27:45.576157] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T21:27:45.575632] [DEBUG] [LOCAL     ] THG: Deleted derivative data file.
[2025-10-24T21:27:45.580801] [INFO ] [MAIN      ] Update Progress: 2085/2366 symbols completed. THG took 42.6s. Estimated remaining: 36m 5s. Rate: 7.8 symbols/min
[2025-10-24T21:27:45.752721] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-03.
[2025-10-24T21:27:45.756575] [INFO ] [MAIN      ] THS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:27:45.798250] [DEBUG] [LOCAL     ] THS: Loaded 38900 existing records from primary storage.
[2025-10-24T21:27:45.798576] [INFO ] [MAIN      ] THS: Loaded 38900 existing records.
[2025-10-24T21:27:45.973008] [WARN ] [MAIN      ] THS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:27:45.973279] [INFO ] [MAIN      ] THS: Wiping existing primary data before full refresh.
[2025-10-24T21:27:45.973349] [INFO ] [LOCAL     ] THS: Starting deletion of primary data.
[2025-10-24T21:27:45.973780] [DEBUG] [LOCAL     ] THS: Deleted primary data file.
[2025-10-24T21:27:45.973837] [INFO ] [MAIN      ] THS: Starting full primary refresh.
[2025-10-24T21:27:46.325784] [INFO ] [REMOTE    ] THS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:27:46.547635] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-01.
[2025-10-24T21:27:46.708573] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T21:27:47.347636] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-05.
[2025-10-24T21:27:47.780674] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T21:27:48.147744] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-02.
[2025-10-24T21:27:48.758205] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T21:27:48.947673] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-06.
[2025-10-24T21:27:49.560410] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T21:27:49.747706] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-03.
[2025-10-24T21:27:50.547726] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-03.
[2025-10-24T21:27:50.620866] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T21:27:51.066065] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-03 (1.32 seconds).
[2025-10-24T21:27:51.347635] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-04.
[2025-10-24T21:27:51.606155] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T21:27:52.147685] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-07.
[2025-10-24T21:27:52.870070] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T21:27:52.947680] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-04.
[2025-10-24T21:27:53.747628] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-05.
[2025-10-24T21:27:53.780163] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T21:27:54.082602] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T21:27:54.547671] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-08.
[2025-10-24T21:27:55.180861] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T21:27:55.347686] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-05.
[2025-10-24T21:27:56.147744] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-04.
[2025-10-24T21:27:56.187578] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T21:27:56.446452] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T21:27:56.947629] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-09.
[2025-10-24T21:27:57.250766] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T21:27:57.747720] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-06.
[2025-10-24T21:27:58.547705] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-06.
[2025-10-24T21:27:58.609522] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T21:27:58.814540] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T21:27:59.347685] [INFO ] [REMOTE    ] THO: Fetching primary data for 2025-10.
[2025-10-24T21:27:59.911591] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T21:28:00.147671] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-07.
[2025-10-24T21:28:00.426369] [INFO ] [REMOTE    ] THO: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T21:28:00.433014] [INFO ] [REMOTE    ] THO: Full fetch complete (60115 records).
[2025-10-24T21:28:00.433126] [DEBUG] [VALIDATOR ] THO: Validating primary data.
[2025-10-24T21:28:00.818495] [DEBUG] [VALIDATOR ] THO: All expected trading days are present.
[2025-10-24T21:28:00.818564] [DEBUG] [VALIDATOR ] THO: Primary data validation passed.
[2025-10-24T21:28:00.819733] [INFO ] [MAIN      ] THO: Fetched primary data is valid.
[2025-10-24T21:28:00.819796] [DEBUG] [LOCAL     ] THO: Saving primary data.
[2025-10-24T21:28:00.820317] [FATAL] [LOCAL     ] THO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:28:00.820400] [FATAL] [MAIN      ] THO: Failed to save primary data.
[2025-10-24T21:28:00.820450] [WARN ] [MAIN      ] THO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:28:00.820486] [INFO ] [LOCAL     ] THO: Starting deletion of primary data.
[2025-10-24T21:28:00.820537] [DEBUG] [LOCAL     ] THO: No primary data file found to delete.
[2025-10-24T21:28:00.820572] [INFO ] [LOCAL     ] THO: Starting deletion of derivative data.
[2025-10-24T21:28:00.820762] [DEBUG] [LOCAL     ] THO: Deleted derivative data file.
[2025-10-24T21:28:00.821029] [INFO ] [MAIN      ] Update Progress: 2086/2366 symbols completed. THO took 27.1s. Estimated remaining: 35m 58s. Rate: 7.8 symbols/min
[2025-10-24T21:28:00.960731] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-05.
[2025-10-24T21:28:00.992034] [INFO ] [MAIN      ] THW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:28:01.013501] [DEBUG] [LOCAL     ] THW: Loaded 19695 existing records from primary storage.
[2025-10-24T21:28:01.013760] [INFO ] [MAIN      ] THW: Loaded 19695 existing records.
[2025-10-24T21:28:01.192186] [WARN ] [MAIN      ] THW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:28:01.192386] [INFO ] [MAIN      ] THW: Wiping existing primary data before full refresh.
[2025-10-24T21:28:01.192431] [INFO ] [LOCAL     ] THW: Starting deletion of primary data.
[2025-10-24T21:28:01.192725] [DEBUG] [LOCAL     ] THW: Deleted primary data file.
[2025-10-24T21:28:01.192780] [INFO ] [MAIN      ] THW: Starting full primary refresh.
[2025-10-24T21:28:01.557066] [INFO ] [REMOTE    ] THW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:28:01.706257] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T21:28:01.747712] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-01.
[2025-10-24T21:28:02.114871] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T21:28:02.547625] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-06.
[2025-10-24T21:28:02.956541] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T21:28:03.347673] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-08.
[2025-10-24T21:28:03.580207] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-06 (1.03 seconds).
[2025-10-24T21:28:04.147719] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-02.
[2025-10-24T21:28:04.720485] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T21:28:04.947697] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-09.
[2025-10-24T21:28:05.173181] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T21:28:05.747686] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-07.
[2025-10-24T21:28:06.072273] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-09 (1.12 seconds).
[2025-10-24T21:28:06.547738] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-03.
[2025-10-24T21:28:07.260913] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T21:28:07.347636] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-07.
[2025-10-24T21:28:07.515348] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T21:28:08.147687] [INFO ] [REMOTE    ] THQ: Fetching primary data for 2025-10.
[2025-10-24T21:28:08.340889] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T21:28:08.947671] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-04.
[2025-10-24T21:28:09.157227] [INFO ] [REMOTE    ] THQ: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T21:28:09.161781] [INFO ] [REMOTE    ] THQ: Full fetch complete (34632 records).
[2025-10-24T21:28:09.162062] [DEBUG] [VALIDATOR ] THQ: Validating primary data.
[2025-10-24T21:28:09.530106] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present.
[2025-10-24T21:28:09.530205] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed.
[2025-10-24T21:28:09.530910] [INFO ] [MAIN      ] THQ: Fetched primary data is valid.
[2025-10-24T21:28:09.530972] [DEBUG] [LOCAL     ] THQ: Saving primary data.
[2025-10-24T21:28:09.531315] [FATAL] [LOCAL     ] THQ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:28:09.531398] [FATAL] [MAIN      ] THQ: Failed to save primary data.
[2025-10-24T21:28:09.531440] [WARN ] [MAIN      ] THQ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:28:09.531523] [INFO ] [LOCAL     ] THQ: Starting deletion of primary data.
[2025-10-24T21:28:09.531592] [DEBUG] [LOCAL     ] THQ: No primary data file found to delete.
[2025-10-24T21:28:09.531637] [INFO ] [LOCAL     ] THQ: Starting deletion of derivative data.
[2025-10-24T21:28:09.531883] [DEBUG] [LOCAL     ] THQ: Deleted derivative data file.
[2025-10-24T21:28:09.531988] [INFO ] [MAIN      ] Update Progress: 2087/2366 symbols completed. THQ took 31.7s. Estimated remaining: 35m 51s. Rate: 7.8 symbols/min
[2025-10-24T21:28:09.703197] [INFO ] [MAIN      ] TIC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:28:09.703345] [DEBUG] [LOCAL     ] TIC: No existing data file found in primary storage.
[2025-10-24T21:28:09.703381] [WARN ] [MAIN      ] TIC: No existing data found, performing full refresh instead.
[2025-10-24T21:28:09.703491] [INFO ] [MAIN      ] TIC: Wiping existing primary data before full refresh.
[2025-10-24T21:28:09.703532] [INFO ] [LOCAL     ] TIC: Starting deletion of primary data.
[2025-10-24T21:28:09.703572] [DEBUG] [LOCAL     ] TIC: No primary data file found to delete.
[2025-10-24T21:28:09.703604] [INFO ] [MAIN      ] TIC: Starting full primary refresh.
[2025-10-24T21:28:09.747835] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-08.
[2025-10-24T21:28:10.104963] [INFO ] [REMOTE    ] TIC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:28:10.099927] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T21:28:10.547738] [INFO ] [REMOTE    ] TIC: Fetching primary data for 2025-01.
[2025-10-24T21:28:10.763949] [DEBUG] [REMOTE    ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:28:10.764258] [WARN ] [REMOTE    ] TIC: No data returned for month 2025-01
[2025-10-24T21:28:10.764345] [FATAL] [REMOTE    ] TIC: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:28:10.764394] [FATAL] [MAIN      ] TIC: Failed to fetch primary data.
[2025-10-24T21:28:10.764427] [WARN ] [MAIN      ] TIC: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:28:10.764481] [INFO ] [LOCAL     ] TIC: Starting deletion of primary data.
[2025-10-24T21:28:10.764536] [DEBUG] [LOCAL     ] TIC: No primary data file found to delete.
[2025-10-24T21:28:10.764570] [INFO ] [LOCAL     ] TIC: Starting deletion of derivative data.
[2025-10-24T21:28:10.764608] [DEBUG] [LOCAL     ] TIC: No derivative data file found to delete.
[2025-10-24T21:28:10.764677] [INFO ] [MAIN      ] Update Progress: 2088/2366 symbols completed. TIC took 1.2s. Estimated remaining: 35m 42s. Rate: 7.8 symbols/min
[2025-10-24T21:28:10.932821] [INFO ] [MAIN      ] TIMB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:28:10.967814] [DEBUG] [LOCAL     ] TIMB: Loaded 34898 existing records from primary storage.
[2025-10-24T21:28:10.968107] [INFO ] [MAIN      ] TIMB: Loaded 34898 existing records.
[2025-10-24T21:28:11.155583] [WARN ] [MAIN      ] TIMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:28:11.155865] [INFO ] [MAIN      ] TIMB: Wiping existing primary data before full refresh.
[2025-10-24T21:28:11.155924] [INFO ] [LOCAL     ] TIMB: Starting deletion of primary data.
[2025-10-24T21:28:11.156374] [DEBUG] [LOCAL     ] TIMB: Deleted primary data file.
[2025-10-24T21:28:11.156430] [INFO ] [MAIN      ] TIMB: Starting full primary refresh.
[2025-10-24T21:28:11.352759] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-05.
[2025-10-24T21:28:11.550770] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T21:28:11.557740] [INFO ] [REMOTE    ] TIMB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:28:12.147718] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-01.
[2025-10-24T21:28:12.515601] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-05 (1.16 seconds).
[2025-10-24T21:28:12.947725] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-06.
[2025-10-24T21:28:13.594534] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T21:28:13.747668] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-02.
[2025-10-24T21:28:13.962688] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T21:28:14.547683] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-07.
[2025-10-24T21:28:15.288929] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T21:28:15.347615] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-03.
[2025-10-24T21:28:15.711150] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-07 (1.16 seconds).
[2025-10-24T21:28:16.147739] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-08.
[2025-10-24T21:28:16.819779] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T21:28:16.947636] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-08.
[2025-10-24T21:28:17.142232] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T21:28:17.747670] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-09.
[2025-10-24T21:28:18.023872] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-08 (1.08 seconds).
[2025-10-24T21:28:18.547751] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-04.
[2025-10-24T21:28:19.352895] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-09.
[2025-10-24T21:28:19.366566] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T21:28:20.014029] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T21:28:20.147614] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-05.
[2025-10-24T21:28:20.460976] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T21:28:20.947673] [INFO ] [REMOTE    ] THR: Fetching primary data for 2025-10.
[2025-10-24T21:28:21.571174] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T21:28:21.747619] [INFO ] [REMOTE    ] THS: Fetching primary data for 2025-10.
[2025-10-24T21:28:21.966788] [INFO ] [REMOTE    ] THR: Incremental fetch complete for 2025-10 (1.02 seconds).
[2025-10-24T21:28:21.970301] [INFO ] [REMOTE    ] THR: Full fetch complete (28767 records).
[2025-10-24T21:28:21.970386] [DEBUG] [VALIDATOR ] THR: Validating primary data.
[2025-10-24T21:28:22.344289] [DEBUG] [VALIDATOR ] THR: All expected trading days are present.
[2025-10-24T21:28:22.344379] [DEBUG] [VALIDATOR ] THR: Primary data validation passed.
[2025-10-24T21:28:22.345066] [INFO ] [MAIN      ] THR: Fetched primary data is valid.
[2025-10-24T21:28:22.345129] [DEBUG] [LOCAL     ] THR: Saving primary data.
[2025-10-24T21:28:22.345439] [FATAL] [LOCAL     ] THR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:28:22.345557] [FATAL] [MAIN      ] THR: Failed to save primary data.
[2025-10-24T21:28:22.345661] [WARN ] [MAIN      ] THR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:28:22.345746] [INFO ] [LOCAL     ] THR: Starting deletion of primary data.
[2025-10-24T21:28:22.345827] [DEBUG] [LOCAL     ] THR: No primary data file found to delete.
[2025-10-24T21:28:22.345868] [INFO ] [LOCAL     ] THR: Starting deletion of derivative data.
[2025-10-24T21:28:22.346069] [DEBUG] [LOCAL     ] THR: Deleted derivative data file.
[2025-10-24T21:28:22.346162] [INFO ] [MAIN      ] Update Progress: 2089/2366 symbols completed. THR took 43.3s. Estimated remaining: 35m 35s. Rate: 7.8 symbols/min
[2025-10-24T21:28:22.516296] [INFO ] [MAIN      ] TISI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:28:22.521371] [DEBUG] [LOCAL     ] TISI: Loaded 3185 existing records from primary storage.
[2025-10-24T21:28:22.521572] [INFO ] [MAIN      ] TISI: Loaded 3185 existing records.
[2025-10-24T21:28:22.552789] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-09.
[2025-10-24T21:28:22.706288] [WARN ] [MAIN      ] TISI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:28:22.706519] [INFO ] [MAIN      ] TISI: Wiping existing primary data before full refresh.
[2025-10-24T21:28:22.706574] [INFO ] [LOCAL     ] TISI: Starting deletion of primary data.
[2025-10-24T21:28:22.706752] [DEBUG] [LOCAL     ] TISI: Deleted primary data file.
[2025-10-24T21:28:22.706811] [INFO ] [MAIN      ] TISI: Starting full primary refresh.
[2025-10-24T21:28:23.063829] [INFO ] [REMOTE    ] TISI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:28:23.262187] [INFO ] [REMOTE    ] THS: Incremental fetch complete for 2025-10 (1.51 seconds).
[2025-10-24T21:28:23.269383] [INFO ] [REMOTE    ] THS: Full fetch complete (54577 records).
[2025-10-24T21:28:23.269497] [DEBUG] [VALIDATOR ] THS: Validating primary data.
[2025-10-24T21:28:23.352855] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-06.
[2025-10-24T21:28:23.647725] [DEBUG] [VALIDATOR ] THS: All expected trading days are present.
[2025-10-24T21:28:23.647842] [DEBUG] [VALIDATOR ] THS: Primary data validation passed.
[2025-10-24T21:28:23.648955] [INFO ] [MAIN      ] THS: Fetched primary data is valid.
[2025-10-24T21:28:23.649207] [DEBUG] [LOCAL     ] THS: Saving primary data.
[2025-10-24T21:28:23.654932] [FATAL] [LOCAL     ] THS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:28:23.662681] [FATAL] [MAIN      ] THS: Failed to save primary data.
[2025-10-24T21:28:23.662854] [WARN ] [MAIN      ] THS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:28:23.663684] [INFO ] [LOCAL     ] THS: Starting deletion of primary data.
[2025-10-24T21:28:23.663790] [DEBUG] [LOCAL     ] THS: No primary data file found to delete.
[2025-10-24T21:28:23.664819] [INFO ] [LOCAL     ] THS: Starting deletion of derivative data.
[2025-10-24T21:28:23.664714] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T21:28:23.669498] [DEBUG] [LOCAL     ] THS: Deleted derivative data file.
[2025-10-24T21:28:23.670236] [INFO ] [MAIN      ] Update Progress: 2090/2366 symbols completed. THS took 38.1s. Estimated remaining: 35m 26s. Rate: 7.8 symbols/min
[2025-10-24T21:28:23.842743] [INFO ] [MAIN      ] TIXT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:28:23.873479] [DEBUG] [LOCAL     ] TIXT: Loaded 32881 existing records from primary storage.
[2025-10-24T21:28:23.873783] [INFO ] [MAIN      ] TIXT: Loaded 32881 existing records.
[2025-10-24T21:28:24.051440] [WARN ] [MAIN      ] TIXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:28:24.051692] [INFO ] [MAIN      ] TIXT: Wiping existing primary data before full refresh.
[2025-10-24T21:28:24.051748] [INFO ] [LOCAL     ] TIXT: Starting deletion of primary data.
[2025-10-24T21:28:24.052040] [DEBUG] [LOCAL     ] TIXT: Deleted primary data file.
[2025-10-24T21:28:24.052095] [INFO ] [MAIN      ] TIXT: Starting full primary refresh.
[2025-10-24T21:28:24.153834] [INFO ] [REMOTE    ] THW: Fetching primary data for 2025-10.
[2025-10-24T21:28:24.415432] [INFO ] [REMOTE    ] TIXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:28:24.845776] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T21:28:24.947693] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-01.
[2025-10-24T21:28:25.246724] [INFO ] [REMOTE    ] THW: Incremental fetch complete for 2025-10 (1.09 seconds).
[2025-10-24T21:28:25.250575] [INFO ] [REMOTE    ] THW: Full fetch complete (28726 records).
[2025-10-24T21:28:25.250717] [DEBUG] [VALIDATOR ] THW: Validating primary data.
[2025-10-24T21:28:25.533823] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-01 (0.59 seconds).
[2025-10-24T21:28:25.640214] [DEBUG] [VALIDATOR ] THW: All expected trading days are present.
[2025-10-24T21:28:25.640290] [DEBUG] [VALIDATOR ] THW: Primary data validation passed.
[2025-10-24T21:28:25.640924] [INFO ] [MAIN      ] THW: Fetched primary data is valid.
[2025-10-24T21:28:25.641010] [DEBUG] [LOCAL     ] THW: Saving primary data.
[2025-10-24T21:28:25.641305] [FATAL] [LOCAL     ] THW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:28:25.641380] [FATAL] [MAIN      ] THW: Failed to save primary data.
[2025-10-24T21:28:25.641420] [WARN ] [MAIN      ] THW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:28:25.641455] [INFO ] [LOCAL     ] THW: Starting deletion of primary data.
[2025-10-24T21:28:25.641503] [DEBUG] [LOCAL     ] THW: No primary data file found to delete.
[2025-10-24T21:28:25.641537] [INFO ] [LOCAL     ] THW: Starting deletion of derivative data.
[2025-10-24T21:28:25.641720] [DEBUG] [LOCAL     ] THW: Deleted derivative data file.
[2025-10-24T21:28:25.641809] [INFO ] [MAIN      ] Update Progress: 2091/2366 symbols completed. THW took 24.8s. Estimated remaining: 35m 18s. Rate: 7.8 symbols/min
[2025-10-24T21:28:25.752780] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-07.
[2025-10-24T21:28:25.814702] [INFO ] [MAIN      ] TJX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:28:25.867600] [DEBUG] [LOCAL     ] TJX: Loaded 54050 existing records from primary storage.
[2025-10-24T21:28:25.867942] [INFO ] [MAIN      ] TJX: Loaded 54050 existing records.
[2025-10-24T21:28:26.063378] [WARN ] [MAIN      ] TJX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:28:26.063725] [INFO ] [MAIN      ] TJX: Wiping existing primary data before full refresh.
[2025-10-24T21:28:26.063779] [INFO ] [LOCAL     ] TJX: Starting deletion of primary data.
[2025-10-24T21:28:26.064423] [DEBUG] [LOCAL     ] TJX: Deleted primary data file.
[2025-10-24T21:28:26.064480] [INFO ] [MAIN      ] TJX: Starting full primary refresh.
[2025-10-24T21:28:26.448503] [INFO ] [REMOTE    ] TJX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:28:26.547724] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-01.
[2025-10-24T21:28:27.270914] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T21:28:27.347622] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-08.
[2025-10-24T21:28:28.147628] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-02.
[2025-10-24T21:28:28.394786] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-01 (1.85 seconds).
[2025-10-24T21:28:28.684677] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-02 (0.54 seconds).
[2025-10-24T21:28:28.780639] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T21:28:28.947632] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-01.
[2025-10-24T21:28:29.747728] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-02.
[2025-10-24T21:28:30.293355] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T21:28:30.547729] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-02.
[2025-10-24T21:28:31.347722] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-09.
[2025-10-24T21:28:31.547709] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-02 (1.80 seconds).
[2025-10-24T21:28:31.684222] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T21:28:32.147734] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-03.
[2025-10-24T21:28:32.326426] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-09 (0.98 seconds).
[2025-10-24T21:28:32.947688] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-03.
[2025-10-24T21:28:33.267772] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T21:28:33.578839] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-03 (0.63 seconds).
[2025-10-24T21:28:33.747719] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-04.
[2025-10-24T21:28:34.490755] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T21:28:34.547728] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-05.
[2025-10-24T21:28:35.117950] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-05 (0.57 seconds).
[2025-10-24T21:28:35.347828] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-06.
[2025-10-24T21:28:35.947669] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T21:28:36.147707] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-03.
[2025-10-24T21:28:36.947707] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-07.
[2025-10-24T21:28:37.394305] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-07 (0.45 seconds).
[2025-10-24T21:28:37.747636] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-04.
[2025-10-24T21:28:38.186528] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-03 (2.04 seconds).
[2025-10-24T21:28:38.547621] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-08.
[2025-10-24T21:28:38.787272] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-04 (1.04 seconds).
[2025-10-24T21:28:39.015011] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T21:28:39.347748] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-09.
[2025-10-24T21:28:39.995604] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-09 (0.65 seconds).
[2025-10-24T21:28:40.147668] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-04.
[2025-10-24T21:28:40.947713] [INFO ] [REMOTE    ] TIMB: Fetching primary data for 2025-10.
[2025-10-24T21:28:41.747722] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-05.
[2025-10-24T21:28:42.294532] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-04 (2.15 seconds).
[2025-10-24T21:28:42.319586] [INFO ] [REMOTE    ] TIMB: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T21:28:42.325070] [INFO ] [REMOTE    ] TIMB: Full fetch complete (53022 records).
[2025-10-24T21:28:42.325155] [DEBUG] [VALIDATOR ] TIMB: Validating primary data.
[2025-10-24T21:28:42.553559] [INFO ] [REMOTE    ] TISI: Fetching primary data for 2025-10.
[2025-10-24T21:28:42.701271] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present.
[2025-10-24T21:28:42.701342] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed.
[2025-10-24T21:28:42.702305] [INFO ] [MAIN      ] TIMB: Fetched primary data is valid.
[2025-10-24T21:28:42.702365] [DEBUG] [LOCAL     ] TIMB: Saving primary data.
[2025-10-24T21:28:42.702809] [FATAL] [LOCAL     ] TIMB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:28:42.702892] [FATAL] [MAIN      ] TIMB: Failed to save primary data.
[2025-10-24T21:28:42.702932] [WARN ] [MAIN      ] TIMB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:28:42.702966] [INFO ] [LOCAL     ] TIMB: Starting deletion of primary data.
[2025-10-24T21:28:42.703015] [DEBUG] [LOCAL     ] TIMB: No primary data file found to delete.
[2025-10-24T21:28:42.703049] [INFO ] [LOCAL     ] TIMB: Starting deletion of derivative data.
[2025-10-24T21:28:42.703350] [DEBUG] [LOCAL     ] TIMB: Deleted derivative data file.
[2025-10-24T21:28:42.704268] [INFO ] [MAIN      ] Update Progress: 2092/2366 symbols completed. TIMB took 31.9s. Estimated remaining: 35m 11s. Rate: 7.8 symbols/min
[2025-10-24T21:28:42.874814] [INFO ] [MAIN      ] TK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:28:42.912124] [DEBUG] [LOCAL     ] TK: Loaded 39324 existing records from primary storage.
[2025-10-24T21:28:42.912389] [INFO ] [MAIN      ] TK: Loaded 39324 existing records.
[2025-10-24T21:28:43.087839] [WARN ] [MAIN      ] TK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:28:43.088054] [INFO ] [MAIN      ] TK: Wiping existing primary data before full refresh.
[2025-10-24T21:28:43.088158] [INFO ] [LOCAL     ] TK: Starting deletion of primary data.
[2025-10-24T21:28:43.093894] [DEBUG] [LOCAL     ] TK: Deleted primary data file.
[2025-10-24T21:28:43.102687] [INFO ] [MAIN      ] TK: Starting full primary refresh.
[2025-10-24T21:28:43.150802] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T21:28:43.292334] [INFO ] [REMOTE    ] TISI: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T21:28:43.357829] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-05.
[2025-10-24T21:28:43.363191] [INFO ] [REMOTE    ] TISI: Full fetch complete (4849 records).
[2025-10-24T21:28:43.378175] [DEBUG] [VALIDATOR ] TISI: Validating primary data.
[2025-10-24T21:28:43.629465] [INFO ] [REMOTE    ] TK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:28:43.830154] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present.
[2025-10-24T21:28:43.830262] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed.
[2025-10-24T21:28:43.830391] [INFO ] [MAIN      ] TISI: Fetched primary data is valid.
[2025-10-24T21:28:43.830430] [DEBUG] [LOCAL     ] TISI: Saving primary data.
[2025-10-24T21:28:43.830600] [FATAL] [LOCAL     ] TISI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:28:43.830677] [FATAL] [MAIN      ] TISI: Failed to save primary data.
[2025-10-24T21:28:43.830730] [WARN ] [MAIN      ] TISI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:28:43.830764] [INFO ] [LOCAL     ] TISI: Starting deletion of primary data.
[2025-10-24T21:28:43.830835] [DEBUG] [LOCAL     ] TISI: No primary data file found to delete.
[2025-10-24T21:28:43.830869] [INFO ] [LOCAL     ] TISI: Starting deletion of derivative data.
[2025-10-24T21:28:43.831030] [DEBUG] [LOCAL     ] TISI: Deleted derivative data file.
[2025-10-24T21:28:43.831112] [INFO ] [MAIN      ] Update Progress: 2093/2366 symbols completed. TISI took 21.5s. Estimated remaining: 35m 3s. Rate: 7.8 symbols/min
[2025-10-24T21:28:43.998391] [INFO ] [MAIN      ] TKC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:28:44.035098] [DEBUG] [LOCAL     ] TKC: Loaded 40332 existing records from primary storage.
[2025-10-24T21:28:44.035380] [INFO ] [MAIN      ] TKC: Loaded 40332 existing records.
[2025-10-24T21:28:44.152816] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-01.
[2025-10-24T21:28:44.210069] [WARN ] [MAIN      ] TKC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:28:44.210439] [INFO ] [MAIN      ] TKC: Wiping existing primary data before full refresh.
[2025-10-24T21:28:44.210488] [INFO ] [LOCAL     ] TKC: Starting deletion of primary data.
[2025-10-24T21:28:44.210831] [DEBUG] [LOCAL     ] TKC: Deleted primary data file.
[2025-10-24T21:28:44.210888] [INFO ] [MAIN      ] TKC: Starting full primary refresh.
[2025-10-24T21:28:44.552936] [INFO ] [REMOTE    ] TKC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:28:44.947628] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-06.
[2025-10-24T21:28:45.370695] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-05 (2.01 seconds).
[2025-10-24T21:28:45.551115] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-01 (1.40 seconds).
[2025-10-24T21:28:45.747680] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-02.
[2025-10-24T21:28:46.347157] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T21:28:46.547682] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-07.
[2025-10-24T21:28:47.151062] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T21:28:47.347683] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-06.
[2025-10-24T21:28:47.936381] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T21:28:48.147691] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-03.
[2025-10-24T21:28:48.947690] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-08.
[2025-10-24T21:28:49.285687] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-06 (1.94 seconds).
[2025-10-24T21:28:49.684358] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T21:28:49.747614] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-04.
[2025-10-24T21:28:50.547827] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-07.
[2025-10-24T21:28:50.594248] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T21:28:51.289970] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T21:28:51.347624] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-05.
[2025-10-24T21:28:52.095405] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T21:28:52.147617] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-08.
[2025-10-24T21:28:52.802617] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T21:28:52.947620] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-06.
[2025-10-24T21:28:53.747751] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-09.
[2025-10-24T21:28:54.197821] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-08 (2.05 seconds).
[2025-10-24T21:28:54.537546] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T21:28:54.547778] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-07.
[2025-10-24T21:28:55.334343] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T21:28:55.347607] [INFO ] [REMOTE    ] TIXT: Fetching primary data for 2025-10.
[2025-10-24T21:28:56.058945] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T21:28:56.147633] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-08.
[2025-10-24T21:28:56.253919] [INFO ] [REMOTE    ] TIXT: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T21:28:56.260456] [INFO ] [REMOTE    ] TIXT: Full fetch complete (45962 records).
[2025-10-24T21:28:56.260553] [DEBUG] [VALIDATOR ] TIXT: Validating primary data.
[2025-10-24T21:28:56.640751] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present.
[2025-10-24T21:28:56.640861] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed.
[2025-10-24T21:28:56.641851] [INFO ] [MAIN      ] TIXT: Fetched primary data is valid.
[2025-10-24T21:28:56.641913] [DEBUG] [LOCAL     ] TIXT: Saving primary data.
[2025-10-24T21:28:56.642453] [FATAL] [LOCAL     ] TIXT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:28:56.642542] [FATAL] [MAIN      ] TIXT: Failed to save primary data.
[2025-10-24T21:28:56.642584] [WARN ] [MAIN      ] TIXT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:28:56.642619] [INFO ] [LOCAL     ] TIXT: Starting deletion of primary data.
[2025-10-24T21:28:56.642704] [DEBUG] [LOCAL     ] TIXT: No primary data file found to delete.
[2025-10-24T21:28:56.642754] [INFO ] [LOCAL     ] TIXT: Starting deletion of derivative data.
[2025-10-24T21:28:56.642917] [DEBUG] [LOCAL     ] TIXT: Deleted derivative data file.
[2025-10-24T21:28:56.642997] [INFO ] [MAIN      ] Update Progress: 2094/2366 symbols completed. TIXT took 33.0s. Estimated remaining: 34m 56s. Rate: 7.8 symbols/min
[2025-10-24T21:28:56.819052] [INFO ] [MAIN      ] TKO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:28:56.862153] [DEBUG] [LOCAL     ] TKO: Loaded 43818 existing records from primary storage.
[2025-10-24T21:28:56.862471] [INFO ] [MAIN      ] TKO: Loaded 43818 existing records.
[2025-10-24T21:28:56.955780] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-01.
[2025-10-24T21:28:57.045562] [WARN ] [MAIN      ] TKO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:28:57.045774] [INFO ] [MAIN      ] TKO: Wiping existing primary data before full refresh.
[2025-10-24T21:28:57.045831] [INFO ] [LOCAL     ] TKO: Starting deletion of primary data.
[2025-10-24T21:28:57.046292] [DEBUG] [LOCAL     ] TKO: Deleted primary data file.
[2025-10-24T21:28:57.046329] [INFO ] [MAIN      ] TKO: Starting full primary refresh.
[2025-10-24T21:28:57.395536] [INFO ] [REMOTE    ] TKO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:28:57.648483] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-08 (1.50 seconds).
[2025-10-24T21:28:57.747699] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-09.
[2025-10-24T21:28:58.365904] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T21:28:58.547677] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-02.
[2025-10-24T21:28:59.347714] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-01.
[2025-10-24T21:28:59.657421] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-09 (1.91 seconds).
[2025-10-24T21:28:59.811886] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T21:29:00.147635] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-03.
[2025-10-24T21:29:00.947630] [INFO ] [REMOTE    ] TJX: Fetching primary data for 2025-10.
[2025-10-24T21:29:01.358301] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T21:29:01.682914] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T21:29:01.747787] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-04.
[2025-10-24T21:29:02.547711] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-09.
[2025-10-24T21:29:02.942191] [INFO ] [REMOTE    ] TJX: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T21:29:02.952875] [INFO ] [REMOTE    ] TJX: Full fetch complete (77830 records).
[2025-10-24T21:29:02.953053] [DEBUG] [VALIDATOR ] TJX: Validating primary data.
[2025-10-24T21:29:03.371568] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-02.
[2025-10-24T21:29:03.356774] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T21:29:03.406530] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present.
[2025-10-24T21:29:03.406624] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed.
[2025-10-24T21:29:03.407910] [INFO ] [MAIN      ] TJX: Fetched primary data is valid.
[2025-10-24T21:29:03.407977] [DEBUG] [LOCAL     ] TJX: Saving primary data.
[2025-10-24T21:29:03.408638] [FATAL] [LOCAL     ] TJX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:29:03.408769] [FATAL] [MAIN      ] TJX: Failed to save primary data.
[2025-10-24T21:29:03.408813] [WARN ] [MAIN      ] TJX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:29:03.408874] [INFO ] [LOCAL     ] TJX: Starting deletion of primary data.
[2025-10-24T21:29:03.408939] [DEBUG] [LOCAL     ] TJX: No primary data file found to delete.
[2025-10-24T21:29:03.408977] [INFO ] [LOCAL     ] TJX: Starting deletion of derivative data.
[2025-10-24T21:29:03.409186] [DEBUG] [LOCAL     ] TJX: Deleted derivative data file.
[2025-10-24T21:29:03.409819] [INFO ] [MAIN      ] Update Progress: 2095/2366 symbols completed. TJX took 37.8s. Estimated remaining: 34m 48s. Rate: 7.8 symbols/min
[2025-10-24T21:29:03.579733] [INFO ] [MAIN      ] TKR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:29:03.617115] [DEBUG] [LOCAL     ] TKR: Loaded 39524 existing records from primary storage.
[2025-10-24T21:29:03.617397] [INFO ] [MAIN      ] TKR: Loaded 39524 existing records.
[2025-10-24T21:29:03.801697] [WARN ] [MAIN      ] TKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:29:03.801936] [INFO ] [MAIN      ] TKR: Wiping existing primary data before full refresh.
[2025-10-24T21:29:03.801990] [INFO ] [LOCAL     ] TKR: Starting deletion of primary data.
[2025-10-24T21:29:03.802479] [DEBUG] [LOCAL     ] TKR: Deleted primary data file.
[2025-10-24T21:29:03.802533] [INFO ] [MAIN      ] TKR: Starting full primary refresh.
[2025-10-24T21:29:04.152772] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-05.
[2025-10-24T21:29:04.176126] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T21:29:04.174844] [INFO ] [REMOTE    ] TKR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:29:04.947713] [INFO ] [REMOTE    ] TK: Fetching primary data for 2025-10.
[2025-10-24T21:29:05.217256] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T21:29:05.747638] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-03.
[2025-10-24T21:29:05.859452] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T21:29:06.314385] [INFO ] [REMOTE    ] TK: Incremental fetch complete for 2025-10 (1.37 seconds).
[2025-10-24T21:29:06.324552] [INFO ] [REMOTE    ] TK: Full fetch complete (56284 records).
[2025-10-24T21:29:06.324747] [DEBUG] [VALIDATOR ] TK: Validating primary data.
[2025-10-24T21:29:06.553244] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-06.
[2025-10-24T21:29:06.699342] [DEBUG] [VALIDATOR ] TK: All expected trading days are present.
[2025-10-24T21:29:06.699465] [DEBUG] [VALIDATOR ] TK: Primary data validation passed.
[2025-10-24T21:29:06.700487] [INFO ] [MAIN      ] TK: Fetched primary data is valid.
[2025-10-24T21:29:06.700548] [DEBUG] [LOCAL     ] TK: Saving primary data.
[2025-10-24T21:29:06.701042] [FATAL] [LOCAL     ] TK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:29:06.701133] [FATAL] [MAIN      ] TK: Failed to save primary data.
[2025-10-24T21:29:06.701175] [WARN ] [MAIN      ] TK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:29:06.701234] [INFO ] [LOCAL     ] TK: Starting deletion of primary data.
[2025-10-24T21:29:06.701291] [DEBUG] [LOCAL     ] TK: No primary data file found to delete.
[2025-10-24T21:29:06.701327] [INFO ] [LOCAL     ] TK: Starting deletion of derivative data.
[2025-10-24T21:29:06.701502] [DEBUG] [LOCAL     ] TK: Deleted derivative data file.
[2025-10-24T21:29:06.702066] [INFO ] [MAIN      ] Update Progress: 2096/2366 symbols completed. TK took 24.0s. Estimated remaining: 34m 40s. Rate: 7.8 symbols/min
[2025-10-24T21:29:06.868402] [INFO ] [MAIN      ] TLK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:29:06.906676] [DEBUG] [LOCAL     ] TLK: Loaded 39028 existing records from primary storage.
[2025-10-24T21:29:06.906953] [INFO ] [MAIN      ] TLK: Loaded 39028 existing records.
[2025-10-24T21:29:07.084561] [WARN ] [MAIN      ] TLK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:29:07.084781] [INFO ] [MAIN      ] TLK: Wiping existing primary data before full refresh.
[2025-10-24T21:29:07.084842] [INFO ] [LOCAL     ] TLK: Starting deletion of primary data.
[2025-10-24T21:29:07.085214] [DEBUG] [LOCAL     ] TLK: Deleted primary data file.
[2025-10-24T21:29:07.085261] [INFO ] [MAIN      ] TLK: Starting full primary refresh.
[2025-10-24T21:29:07.348265] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-01.
[2025-10-24T21:29:07.458721] [INFO ] [REMOTE    ] TLK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:29:07.649527] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T21:29:08.096504] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T21:29:08.147621] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-04.
[2025-10-24T21:29:08.947737] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-01.
[2025-10-24T21:29:08.985839] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T21:29:09.538874] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-04 (1.39 seconds).
[2025-10-24T21:29:09.747732] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-02.
[2025-10-24T21:29:10.459398] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T21:29:10.547713] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-02.
[2025-10-24T21:29:11.125542] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T21:29:11.347730] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-07.
[2025-10-24T21:29:11.540848] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T21:29:12.147704] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-05.
[2025-10-24T21:29:12.900506] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T21:29:12.947697] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-03.
[2025-10-24T21:29:13.747665] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-08.
[2025-10-24T21:29:13.865249] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T21:29:14.282904] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T21:29:14.547700] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-04.
[2025-10-24T21:29:15.217046] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T21:29:15.347729] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-06.
[2025-10-24T21:29:16.125864] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T21:29:16.147701] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-03.
[2025-10-24T21:29:16.934568] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T21:29:16.947606] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-07.
[2025-10-24T21:29:17.610825] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T21:29:17.747613] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-04.
[2025-10-24T21:29:18.478175] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T21:29:18.547733] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-09.
[2025-10-24T21:29:19.299465] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T21:29:19.347665] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-08.
[2025-10-24T21:29:20.146690] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T21:29:20.155972] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-05.
[2025-10-24T21:29:20.856569] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T21:29:20.947619] [INFO ] [REMOTE    ] TKC: Fetching primary data for 2025-10.
[2025-10-24T21:29:21.747684] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-09.
[2025-10-24T21:29:21.903890] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T21:29:22.209532] [INFO ] [REMOTE    ] TKC: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T21:29:22.218418] [INFO ] [REMOTE    ] TKC: Full fetch complete (54648 records).
[2025-10-24T21:29:22.218614] [DEBUG] [VALIDATOR ] TKC: Validating primary data.
[2025-10-24T21:29:22.549683] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-05.
[2025-10-24T21:29:22.726053] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present.
[2025-10-24T21:29:22.726302] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed.
[2025-10-24T21:29:22.729825] [INFO ] [MAIN      ] TKC: Fetched primary data is valid.
[2025-10-24T21:29:22.729949] [DEBUG] [LOCAL     ] TKC: Saving primary data.
[2025-10-24T21:29:22.730690] [FATAL] [LOCAL     ] TKC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:29:22.730934] [FATAL] [MAIN      ] TKC: Failed to save primary data.
[2025-10-24T21:29:22.731083] [WARN ] [MAIN      ] TKC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:29:22.731449] [INFO ] [LOCAL     ] TKC: Starting deletion of primary data.
[2025-10-24T21:29:22.731593] [DEBUG] [LOCAL     ] TKC: No primary data file found to delete.
[2025-10-24T21:29:22.731701] [INFO ] [LOCAL     ] TKC: Starting deletion of derivative data.
[2025-10-24T21:29:22.732142] [DEBUG] [LOCAL     ] TKC: Deleted derivative data file.
[2025-10-24T21:29:22.733670] [INFO ] [MAIN      ] Update Progress: 2097/2366 symbols completed. TKC took 38.9s. Estimated remaining: 34m 33s. Rate: 7.8 symbols/min
[2025-10-24T21:29:22.841100] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-09 (1.09 seconds).
[2025-10-24T21:29:23.026954] [INFO ] [MAIN      ] TLYS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:29:23.053244] [DEBUG] [LOCAL     ] TLYS: Loaded 16609 existing records from primary storage.
[2025-10-24T21:29:23.053591] [INFO ] [MAIN      ] TLYS: Loaded 16609 existing records.
[2025-10-24T21:29:23.293328] [WARN ] [MAIN      ] TLYS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:29:23.293599] [INFO ] [MAIN      ] TLYS: Wiping existing primary data before full refresh.
[2025-10-24T21:29:23.293704] [INFO ] [LOCAL     ] TLYS: Starting deletion of primary data.
[2025-10-24T21:29:23.293934] [DEBUG] [LOCAL     ] TLYS: Deleted primary data file.
[2025-10-24T21:29:23.293990] [INFO ] [MAIN      ] TLYS: Starting full primary refresh.
[2025-10-24T21:29:23.352849] [INFO ] [REMOTE    ] TKO: Fetching primary data for 2025-10.
[2025-10-24T21:29:23.712183] [INFO ] [REMOTE    ] TLYS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:29:24.021409] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T21:29:24.147689] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-06.
[2025-10-24T21:29:24.911238] [INFO ] [REMOTE    ] TKO: Incremental fetch complete for 2025-10 (1.56 seconds).
[2025-10-24T21:29:24.919782] [INFO ] [REMOTE    ] TKO: Full fetch complete (65544 records).
[2025-10-24T21:29:24.919926] [DEBUG] [VALIDATOR ] TKO: Validating primary data.
[2025-10-24T21:29:24.952873] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-06.
[2025-10-24T21:29:25.302513] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present.
[2025-10-24T21:29:25.302598] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed.
[2025-10-24T21:29:25.303711] [INFO ] [MAIN      ] TKO: Fetched primary data is valid.
[2025-10-24T21:29:25.303772] [DEBUG] [LOCAL     ] TKO: Saving primary data.
[2025-10-24T21:29:25.304322] [FATAL] [LOCAL     ] TKO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:29:25.304415] [FATAL] [MAIN      ] TKO: Failed to save primary data.
[2025-10-24T21:29:25.304458] [WARN ] [MAIN      ] TKO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:29:25.304494] [INFO ] [LOCAL     ] TKO: Starting deletion of primary data.
[2025-10-24T21:29:25.304550] [DEBUG] [LOCAL     ] TKO: No primary data file found to delete.
[2025-10-24T21:29:25.304586] [INFO ] [LOCAL     ] TKO: Starting deletion of derivative data.
[2025-10-24T21:29:25.304786] [DEBUG] [LOCAL     ] TKO: Deleted derivative data file.
[2025-10-24T21:29:25.305268] [INFO ] [MAIN      ] Update Progress: 2098/2366 symbols completed. TKO took 28.7s. Estimated remaining: 34m 25s. Rate: 7.8 symbols/min
[2025-10-24T21:29:25.476962] [INFO ] [MAIN      ] TM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:29:25.513936] [DEBUG] [LOCAL     ] TM: Loaded 36277 existing records from primary storage.
[2025-10-24T21:29:25.514199] [INFO ] [MAIN      ] TM: Loaded 36277 existing records.
[2025-10-24T21:29:25.696141] [WARN ] [MAIN      ] TM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:29:25.716101] [INFO ] [MAIN      ] TM: Wiping existing primary data before full refresh.
[2025-10-24T21:29:25.716671] [INFO ] [LOCAL     ] TM: Starting deletion of primary data.
[2025-10-24T21:29:25.717306] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T21:29:25.720564] [DEBUG] [LOCAL     ] TM: Deleted primary data file.
[2025-10-24T21:29:25.725590] [INFO ] [MAIN      ] TM: Starting full primary refresh.
[2025-10-24T21:29:25.761627] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-07.
[2025-10-24T21:29:26.077016] [INFO ] [REMOTE    ] TM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:29:26.547735] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-01.
[2025-10-24T21:29:26.643547] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T21:29:27.288839] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-07 (1.53 seconds).
[2025-10-24T21:29:27.347707] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-01.
[2025-10-24T21:29:27.846623] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T21:29:28.147721] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-08.
[2025-10-24T21:29:28.268075] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T21:29:28.947711] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-02.
[2025-10-24T21:29:29.744380] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T21:29:29.747605] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-03.
[2025-10-24T21:29:29.781213] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T21:29:30.547685] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-02.
[2025-10-24T21:29:30.558779] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T21:29:31.347686] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-07.
[2025-10-24T21:29:32.056183] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T21:29:32.147715] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-03.
[2025-10-24T21:29:32.947748] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-09.
[2025-10-24T21:29:32.982916] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T21:29:33.747704] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-08.
[2025-10-24T21:29:33.789556] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T21:29:34.387104] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T21:29:34.547721] [INFO ] [REMOTE    ] TLK: Fetching primary data for 2025-10.
[2025-10-24T21:29:35.186679] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T21:29:35.347722] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-04.
[2025-10-24T21:29:36.144735] [INFO ] [REMOTE    ] TLK: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T21:29:36.151811] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-04.
[2025-10-24T21:29:36.153795] [INFO ] [REMOTE    ] TLK: Full fetch complete (57741 records).
[2025-10-24T21:29:36.153883] [DEBUG] [VALIDATOR ] TLK: Validating primary data.
[2025-10-24T21:29:36.557363] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present.
[2025-10-24T21:29:36.557455] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed.
[2025-10-24T21:29:36.558669] [INFO ] [MAIN      ] TLK: Fetched primary data is valid.
[2025-10-24T21:29:36.558745] [DEBUG] [LOCAL     ] TLK: Saving primary data.
[2025-10-24T21:29:36.559285] [FATAL] [LOCAL     ] TLK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:29:36.559375] [FATAL] [MAIN      ] TLK: Failed to save primary data.
[2025-10-24T21:29:36.559418] [WARN ] [MAIN      ] TLK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:29:36.559482] [INFO ] [LOCAL     ] TLK: Starting deletion of primary data.
[2025-10-24T21:29:36.559540] [DEBUG] [LOCAL     ] TLK: No primary data file found to delete.
[2025-10-24T21:29:36.559576] [INFO ] [LOCAL     ] TLK: Starting deletion of derivative data.
[2025-10-24T21:29:36.559758] [DEBUG] [LOCAL     ] TLK: Deleted derivative data file.
[2025-10-24T21:29:36.560339] [INFO ] [MAIN      ] Update Progress: 2099/2366 symbols completed. TLK took 29.9s. Estimated remaining: 34m 17s. Rate: 7.8 symbols/min
[2025-10-24T21:29:36.742146] [INFO ] [MAIN      ] TME: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:29:36.796488] [DEBUG] [LOCAL     ] TME: Loaded 53583 existing records from primary storage.
[2025-10-24T21:29:36.796896] [INFO ] [MAIN      ] TME: Loaded 53583 existing records.
[2025-10-24T21:29:36.961342] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-09.
[2025-10-24T21:29:36.984159] [WARN ] [MAIN      ] TME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:29:36.985302] [INFO ] [MAIN      ] TME: Wiping existing primary data before full refresh.
[2025-10-24T21:29:36.985390] [INFO ] [LOCAL     ] TME: Starting deletion of primary data.
[2025-10-24T21:29:36.985986] [DEBUG] [LOCAL     ] TME: Deleted primary data file.
[2025-10-24T21:29:36.986053] [INFO ] [MAIN      ] TME: Starting full primary refresh.
[2025-10-24T21:29:37.181041] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T21:29:37.309197] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T21:29:37.428101] [INFO ] [REMOTE    ] TME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:29:37.747675] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-01.
[2025-10-24T21:29:38.179549] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T21:29:38.547726] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-05.
[2025-10-24T21:29:39.347763] [INFO ] [REMOTE    ] TKR: Fetching primary data for 2025-10.
[2025-10-24T21:29:39.354368] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T21:29:39.614597] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T21:29:40.147765] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-06.
[2025-10-24T21:29:40.781632] [INFO ] [REMOTE    ] TKR: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T21:29:40.788718] [INFO ] [REMOTE    ] TKR: Full fetch complete (57787 records).
[2025-10-24T21:29:40.788887] [DEBUG] [VALIDATOR ] TKR: Validating primary data.
[2025-10-24T21:29:40.971708] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-05.
[2025-10-24T21:29:41.199763] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present.
[2025-10-24T21:29:41.199850] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed.
[2025-10-24T21:29:41.200882] [INFO ] [MAIN      ] TKR: Fetched primary data is valid.
[2025-10-24T21:29:41.200943] [DEBUG] [LOCAL     ] TKR: Saving primary data.
[2025-10-24T21:29:41.201413] [FATAL] [LOCAL     ] TKR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:29:41.201498] [FATAL] [MAIN      ] TKR: Failed to save primary data.
[2025-10-24T21:29:41.201538] [WARN ] [MAIN      ] TKR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:29:41.201572] [INFO ] [LOCAL     ] TKR: Starting deletion of primary data.
[2025-10-24T21:29:41.201622] [DEBUG] [LOCAL     ] TKR: No primary data file found to delete.
[2025-10-24T21:29:41.201692] [INFO ] [LOCAL     ] TKR: Starting deletion of derivative data.
[2025-10-24T21:29:41.201894] [DEBUG] [LOCAL     ] TKR: Deleted derivative data file.
[2025-10-24T21:29:41.202170] [INFO ] [MAIN      ] Update Progress: 2100/2366 symbols completed. TKR took 37.8s. Estimated remaining: 34m 9s. Rate: 7.8 symbols/min
[2025-10-24T21:29:41.373093] [INFO ] [MAIN      ] TMHC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:29:41.413374] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T21:29:41.436251] [DEBUG] [LOCAL     ] TMHC: Loaded 46022 existing records from primary storage.
[2025-10-24T21:29:41.436524] [INFO ] [MAIN      ] TMHC: Loaded 46022 existing records.
[2025-10-24T21:29:41.614665] [WARN ] [MAIN      ] TMHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:29:41.614922] [INFO ] [MAIN      ] TMHC: Wiping existing primary data before full refresh.
[2025-10-24T21:29:41.614976] [INFO ] [LOCAL     ] TMHC: Starting deletion of primary data.
[2025-10-24T21:29:41.615453] [DEBUG] [LOCAL     ] TMHC: Deleted primary data file.
[2025-10-24T21:29:41.615511] [INFO ] [MAIN      ] TMHC: Starting full primary refresh.
[2025-10-24T21:29:41.755545] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-07.
[2025-10-24T21:29:41.970596] [INFO ] [REMOTE    ] TMHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:29:42.547701] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-02.
[2025-10-24T21:29:42.677309] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-05 (1.71 seconds).
[2025-10-24T21:29:42.735483] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-07 (0.98 seconds).
[2025-10-24T21:29:43.347702] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-06.
[2025-10-24T21:29:44.147718] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-01.
[2025-10-24T21:29:44.318004] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T21:29:44.592542] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-06 (1.24 seconds).
[2025-10-24T21:29:44.947767] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-08.
[2025-10-24T21:29:45.616345] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T21:29:45.747633] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-02.
[2025-10-24T21:29:45.768623] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T21:29:46.547619] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-07.
[2025-10-24T21:29:47.346560] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T21:29:47.355145] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-03.
[2025-10-24T21:29:48.147701] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-09.
[2025-10-24T21:29:48.339720] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T21:29:48.811419] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-09 (0.66 seconds).
[2025-10-24T21:29:48.947630] [INFO ] [REMOTE    ] TLYS: Fetching primary data for 2025-10.
[2025-10-24T21:29:49.177094] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T21:29:49.364407] [INFO ] [REMOTE    ] TLYS: Incremental fetch complete for 2025-10 (0.42 seconds).
[2025-10-24T21:29:49.366854] [INFO ] [REMOTE    ] TLYS: Full fetch complete (21085 records).
[2025-10-24T21:29:49.366929] [DEBUG] [VALIDATOR ] TLYS: Validating primary data.
[2025-10-24T21:29:49.752056] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-03.
[2025-10-24T21:29:49.753362] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present.
[2025-10-24T21:29:49.753446] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed.
[2025-10-24T21:29:49.753927] [INFO ] [MAIN      ] TLYS: Fetched primary data is valid.
[2025-10-24T21:29:49.753988] [DEBUG] [LOCAL     ] TLYS: Saving primary data.
[2025-10-24T21:29:49.754284] [FATAL] [LOCAL     ] TLYS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:29:49.754398] [FATAL] [MAIN      ] TLYS: Failed to save primary data.
[2025-10-24T21:29:49.754466] [WARN ] [MAIN      ] TLYS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:29:49.754534] [INFO ] [LOCAL     ] TLYS: Starting deletion of primary data.
[2025-10-24T21:29:49.754590] [DEBUG] [LOCAL     ] TLYS: No primary data file found to delete.
[2025-10-24T21:29:49.754625] [INFO ] [LOCAL     ] TLYS: Starting deletion of derivative data.
[2025-10-24T21:29:49.754927] [DEBUG] [LOCAL     ] TLYS: Deleted derivative data file.
[2025-10-24T21:29:49.755018] [INFO ] [MAIN      ] Update Progress: 2101/2366 symbols completed. TLYS took 27.0s. Estimated remaining: 34m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:29:49.929977] [INFO ] [MAIN      ] TMO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:29:49.983108] [DEBUG] [LOCAL     ] TMO: Loaded 52781 existing records from primary storage.
[2025-10-24T21:29:49.983426] [INFO ] [MAIN      ] TMO: Loaded 52781 existing records.
[2025-10-24T21:29:50.156098] [WARN ] [MAIN      ] TMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:29:50.156315] [INFO ] [MAIN      ] TMO: Wiping existing primary data before full refresh.
[2025-10-24T21:29:50.156360] [INFO ] [LOCAL     ] TMO: Starting deletion of primary data.
[2025-10-24T21:29:50.157081] [DEBUG] [LOCAL     ] TMO: Deleted primary data file.
[2025-10-24T21:29:50.157137] [INFO ] [MAIN      ] TMO: Starting full primary refresh.
[2025-10-24T21:29:50.523848] [INFO ] [REMOTE    ] TMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:29:50.547616] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-01.
[2025-10-24T21:29:51.280482] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T21:29:51.347618] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-04.
[2025-10-24T21:29:52.147631] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-04.
[2025-10-24T21:29:52.430178] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-01 (1.88 seconds).
[2025-10-24T21:29:52.588833] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-04 (1.24 seconds).
[2025-10-24T21:29:52.947696] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-05.
[2025-10-24T21:29:53.747716] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-08.
[2025-10-24T21:29:53.955763] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-04 (1.81 seconds).
[2025-10-24T21:29:54.370017] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T21:29:54.547630] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-06.
[2025-10-24T21:29:54.895475] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T21:29:55.347717] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-02.
[2025-10-24T21:29:56.003761] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T21:29:56.147678] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-07.
[2025-10-24T21:29:56.947689] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-05.
[2025-10-24T21:29:57.009934] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T21:29:57.747729] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-09.
[2025-10-24T21:29:57.855035] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T21:29:58.547717] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-08.
[2025-10-24T21:29:58.874264] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T21:29:59.135895] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T21:29:59.347702] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-03.
[2025-10-24T21:30:00.158242] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-06.
[2025-10-24T21:30:00.163698] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T21:30:00.947626] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-09.
[2025-10-24T21:30:01.056922] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T21:30:01.747733] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-04.
[2025-10-24T21:30:01.987840] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T21:30:02.249355] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T21:30:02.547760] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-07.
[2025-10-24T21:30:03.347726] [INFO ] [REMOTE    ] TMHC: Fetching primary data for 2025-10.
[2025-10-24T21:30:03.651683] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-04 (1.90 seconds).
[2025-10-24T21:30:04.147797] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-05.
[2025-10-24T21:30:04.603878] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-07 (2.06 seconds).
[2025-10-24T21:30:04.947671] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-08.
[2025-10-24T21:30:05.118060] [INFO ] [REMOTE    ] TMHC: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T21:30:05.127309] [INFO ] [REMOTE    ] TMHC: Full fetch complete (66806 records).
[2025-10-24T21:30:05.127473] [DEBUG] [VALIDATOR ] TMHC: Validating primary data.
[2025-10-24T21:30:05.526697] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present.
[2025-10-24T21:30:05.526857] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed.
[2025-10-24T21:30:05.528184] [INFO ] [MAIN      ] TMHC: Fetched primary data is valid.
[2025-10-24T21:30:05.528369] [DEBUG] [LOCAL     ] TMHC: Saving primary data.
[2025-10-24T21:30:05.529020] [FATAL] [LOCAL     ] TMHC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:30:05.529110] [FATAL] [MAIN      ] TMHC: Failed to save primary data.
[2025-10-24T21:30:05.529188] [WARN ] [MAIN      ] TMHC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:30:05.529275] [INFO ] [LOCAL     ] TMHC: Starting deletion of primary data.
[2025-10-24T21:30:05.529341] [DEBUG] [LOCAL     ] TMHC: No primary data file found to delete.
[2025-10-24T21:30:05.529418] [INFO ] [LOCAL     ] TMHC: Starting deletion of derivative data.
[2025-10-24T21:30:05.529576] [DEBUG] [LOCAL     ] TMHC: Deleted derivative data file.
[2025-10-24T21:30:05.530139] [INFO ] [MAIN      ] Update Progress: 2102/2366 symbols completed. TMHC took 24.3s. Estimated remaining: 33m 55s. Rate: 7.8 symbols/min
[2025-10-24T21:30:05.706855] [INFO ] [MAIN      ] TNC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:30:05.746512] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-05 (1.60 seconds).
[2025-10-24T21:30:05.757164] [INFO ] [REMOTE    ] TM: Fetching primary data for 2025-10.
[2025-10-24T21:30:05.763694] [DEBUG] [LOCAL     ] TNC: Loaded 14222 existing records from primary storage.
[2025-10-24T21:30:05.765273] [INFO ] [MAIN      ] TNC: Loaded 14222 existing records.
[2025-10-24T21:30:05.953798] [WARN ] [MAIN      ] TNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:30:05.954040] [INFO ] [MAIN      ] TNC: Wiping existing primary data before full refresh.
[2025-10-24T21:30:05.954088] [INFO ] [LOCAL     ] TNC: Starting deletion of primary data.
[2025-10-24T21:30:05.954318] [DEBUG] [LOCAL     ] TNC: Deleted primary data file.
[2025-10-24T21:30:05.954374] [INFO ] [MAIN      ] TNC: Starting full primary refresh.
[2025-10-24T21:30:06.319349] [INFO ] [REMOTE    ] TNC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:30:06.547696] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-01.
[2025-10-24T21:30:06.801397] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-08 (1.85 seconds).
[2025-10-24T21:30:07.257348] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T21:30:07.280242] [INFO ] [REMOTE    ] TM: Incremental fetch complete for 2025-10 (1.52 seconds).
[2025-10-24T21:30:07.289307] [INFO ] [REMOTE    ] TM: Full fetch complete (51763 records).
[2025-10-24T21:30:07.289495] [DEBUG] [VALIDATOR ] TM: Validating primary data.
[2025-10-24T21:30:07.352796] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-02.
[2025-10-24T21:30:07.678394] [DEBUG] [VALIDATOR ] TM: All expected trading days are present.
[2025-10-24T21:30:07.678466] [DEBUG] [VALIDATOR ] TM: Primary data validation passed.
[2025-10-24T21:30:07.679572] [INFO ] [MAIN      ] TM: Fetched primary data is valid.
[2025-10-24T21:30:07.679639] [DEBUG] [LOCAL     ] TM: Saving primary data.
[2025-10-24T21:30:07.680246] [FATAL] [LOCAL     ] TM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:30:07.680346] [FATAL] [MAIN      ] TM: Failed to save primary data.
[2025-10-24T21:30:07.680431] [WARN ] [MAIN      ] TM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:30:07.680531] [INFO ] [LOCAL     ] TM: Starting deletion of primary data.
[2025-10-24T21:30:07.680618] [DEBUG] [LOCAL     ] TM: No primary data file found to delete.
[2025-10-24T21:30:07.680706] [INFO ] [LOCAL     ] TM: Starting deletion of derivative data.
[2025-10-24T21:30:07.680913] [DEBUG] [LOCAL     ] TM: Deleted derivative data file.
[2025-10-24T21:30:07.681042] [INFO ] [MAIN      ] Update Progress: 2103/2366 symbols completed. TM took 42.4s. Estimated remaining: 33m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:30:07.851114] [INFO ] [MAIN      ] TNET: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:30:07.879041] [DEBUG] [LOCAL     ] TNET: Loaded 28369 existing records from primary storage.
[2025-10-24T21:30:07.879290] [INFO ] [MAIN      ] TNET: Loaded 28369 existing records.
[2025-10-24T21:30:08.053902] [WARN ] [MAIN      ] TNET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:30:08.054146] [INFO ] [MAIN      ] TNET: Wiping existing primary data before full refresh.
[2025-10-24T21:30:08.054200] [INFO ] [LOCAL     ] TNET: Starting deletion of primary data.
[2025-10-24T21:30:08.054474] [DEBUG] [LOCAL     ] TNET: Deleted primary data file.
[2025-10-24T21:30:08.054533] [INFO ] [MAIN      ] TNET: Starting full primary refresh.
[2025-10-24T21:30:08.154573] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-09.
[2025-10-24T21:30:08.420763] [INFO ] [REMOTE    ] TNET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:30:08.469493] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T21:30:08.947673] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-01.
[2025-10-24T21:30:09.747755] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-03.
[2025-10-24T21:30:10.088201] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-09 (1.93 seconds).
[2025-10-24T21:30:10.142709] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-01 (1.20 seconds).
[2025-10-24T21:30:10.486664] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T21:30:10.547731] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-02.
[2025-10-24T21:30:11.347749] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-04.
[2025-10-24T21:30:11.936740] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T21:30:12.147621] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-03.
[2025-10-24T21:30:12.408885] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-04 (1.06 seconds).
[2025-10-24T21:30:12.947689] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-06.
[2025-10-24T21:30:13.502227] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T21:30:13.747669] [INFO ] [REMOTE    ] TME: Fetching primary data for 2025-10.
[2025-10-24T21:30:14.547658] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-04.
[2025-10-24T21:30:14.677639] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T21:30:15.347777] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-05.
[2025-10-24T21:30:15.504877] [INFO ] [REMOTE    ] TME: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T21:30:15.531725] [INFO ] [REMOTE    ] TME: Full fetch complete (77153 records).
[2025-10-24T21:30:15.548534] [DEBUG] [VALIDATOR ] TME: Validating primary data.
[2025-10-24T21:30:15.552454] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T21:30:15.973374] [DEBUG] [VALIDATOR ] TME: All expected trading days are present.
[2025-10-24T21:30:15.973523] [DEBUG] [VALIDATOR ] TME: Primary data validation passed.
[2025-10-24T21:30:15.974806] [INFO ] [MAIN      ] TME: Fetched primary data is valid.
[2025-10-24T21:30:15.975001] [DEBUG] [LOCAL     ] TME: Saving primary data.
[2025-10-24T21:30:15.975853] [FATAL] [LOCAL     ] TME: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:30:15.976015] [FATAL] [MAIN      ] TME: Failed to save primary data.
[2025-10-24T21:30:15.976131] [WARN ] [MAIN      ] TME: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:30:15.976210] [INFO ] [LOCAL     ] TME: Starting deletion of primary data.
[2025-10-24T21:30:15.976312] [DEBUG] [LOCAL     ] TME: No primary data file found to delete.
[2025-10-24T21:30:15.976445] [INFO ] [LOCAL     ] TME: Starting deletion of derivative data.
[2025-10-24T21:30:15.986973] [DEBUG] [LOCAL     ] TME: Deleted derivative data file.
[2025-10-24T21:30:15.987543] [INFO ] [MAIN      ] Update Progress: 2104/2366 symbols completed. TME took 39.4s. Estimated remaining: 33m 39s. Rate: 7.8 symbols/min
[2025-10-24T21:30:15.986910] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-05 (0.64 seconds).
[2025-10-24T21:30:16.160142] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-05.
[2025-10-24T21:30:16.164380] [INFO ] [MAIN      ] TNGY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:30:16.164523] [DEBUG] [LOCAL     ] TNGY: No existing data file found in primary storage.
[2025-10-24T21:30:16.164565] [WARN ] [MAIN      ] TNGY: No existing data found, performing full refresh instead.
[2025-10-24T21:30:16.164693] [INFO ] [MAIN      ] TNGY: Wiping existing primary data before full refresh.
[2025-10-24T21:30:16.164746] [INFO ] [LOCAL     ] TNGY: Starting deletion of primary data.
[2025-10-24T21:30:16.164791] [DEBUG] [LOCAL     ] TNGY: No primary data file found to delete.
[2025-10-24T21:30:16.164865] [INFO ] [MAIN      ] TNGY: Starting full primary refresh.
[2025-10-24T21:30:16.521956] [INFO ] [REMOTE    ] TNGY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:30:16.947686] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-07.
[2025-10-24T21:30:17.359417] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-05 (1.20 seconds).
[2025-10-24T21:30:17.747719] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-06.
[2025-10-24T21:30:18.547680] [INFO ] [REMOTE    ] TNGY: Fetching primary data for 2025-01.
[2025-10-24T21:30:18.836175] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T21:30:18.870540] [DEBUG] [REMOTE    ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:30:18.870836] [WARN ] [REMOTE    ] TNGY: No data returned for month 2025-01
[2025-10-24T21:30:18.870911] [FATAL] [REMOTE    ] TNGY: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:30:18.870960] [FATAL] [MAIN      ] TNGY: Failed to fetch primary data.
[2025-10-24T21:30:18.871018] [WARN ] [MAIN      ] TNGY: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:30:18.871085] [INFO ] [LOCAL     ] TNGY: Starting deletion of primary data.
[2025-10-24T21:30:18.871145] [DEBUG] [LOCAL     ] TNGY: No primary data file found to delete.
[2025-10-24T21:30:18.871179] [INFO ] [LOCAL     ] TNGY: Starting deletion of derivative data.
[2025-10-24T21:30:18.871217] [DEBUG] [LOCAL     ] TNGY: No derivative data file found to delete.
[2025-10-24T21:30:18.871261] [INFO ] [MAIN      ] Update Progress: 2105/2366 symbols completed. TNGY took 2.9s. Estimated remaining: 33m 31s. Rate: 7.8 symbols/min
[2025-10-24T21:30:19.073200] [INFO ] [MAIN      ] TNK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:30:19.077276] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-07 (2.13 seconds).
[2025-10-24T21:30:19.120587] [DEBUG] [LOCAL     ] TNK: Loaded 35590 existing records from primary storage.
[2025-10-24T21:30:19.120872] [INFO ] [MAIN      ] TNK: Loaded 35590 existing records.
[2025-10-24T21:30:19.296222] [WARN ] [MAIN      ] TNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:30:19.296430] [INFO ] [MAIN      ] TNK: Wiping existing primary data before full refresh.
[2025-10-24T21:30:19.296475] [INFO ] [LOCAL     ] TNK: Starting deletion of primary data.
[2025-10-24T21:30:19.296861] [DEBUG] [LOCAL     ] TNK: Deleted primary data file.
[2025-10-24T21:30:19.296923] [INFO ] [MAIN      ] TNK: Starting full primary refresh.
[2025-10-24T21:30:19.352831] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-07.
[2025-10-24T21:30:19.649692] [INFO ] [REMOTE    ] TNK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:30:20.147676] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-01.
[2025-10-24T21:30:20.824328] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T21:30:20.947666] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-08.
[2025-10-24T21:30:21.325147] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T21:30:21.747748] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-02.
[2025-10-24T21:30:22.547741] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-08.
[2025-10-24T21:30:22.917168] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-08 (1.97 seconds).
[2025-10-24T21:30:23.234982] [INFO ] [REMOTE    ] TNK: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T21:30:23.347704] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-09.
[2025-10-24T21:30:23.966014] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T21:30:24.147715] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-09.
[2025-10-24T21:30:24.947717] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-06.
[2025-10-24T21:30:25.167373] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T21:30:25.436098] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T21:30:25.747677] [INFO ] [REMOTE    ] TNK: Fetching primary data for 2025-03.
[2025-10-24T21:30:25.944110] [DEBUG] [REMOTE    ] TNK: Error fetching primary data for 2025-03: 'API call returned an empty response.'
[2025-10-24T21:30:25.944401] [WARN ] [REMOTE    ] TNK: No data returned for month 2025-03
[2025-10-24T21:30:25.944486] [FATAL] [REMOTE    ] TNK: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:30:25.944563] [FATAL] [MAIN      ] TNK: Failed to fetch primary data.
[2025-10-24T21:30:25.944624] [WARN ] [MAIN      ] TNK: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:30:25.944714] [INFO ] [LOCAL     ] TNK: Starting deletion of primary data.
[2025-10-24T21:30:25.944776] [DEBUG] [LOCAL     ] TNK: No primary data file found to delete.
[2025-10-24T21:30:25.944810] [INFO ] [LOCAL     ] TNK: Starting deletion of derivative data.
[2025-10-24T21:30:25.944946] [DEBUG] [LOCAL     ] TNK: Deleted derivative data file.
[2025-10-24T21:30:25.945007] [INFO ] [MAIN      ] Update Progress: 2106/2366 symbols completed. TNK took 7.1s. Estimated remaining: 33m 23s. Rate: 7.8 symbols/min
[2025-10-24T21:30:26.118494] [INFO ] [MAIN      ] TNL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:30:26.156863] [DEBUG] [LOCAL     ] TNL: Loaded 42070 existing records from primary storage.
[2025-10-24T21:30:26.166625] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T21:30:26.166328] [INFO ] [MAIN      ] TNL: Loaded 42070 existing records.
[2025-10-24T21:30:26.371271] [WARN ] [MAIN      ] TNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:30:26.371494] [INFO ] [MAIN      ] TNL: Wiping existing primary data before full refresh.
[2025-10-24T21:30:26.371559] [INFO ] [LOCAL     ] TNL: Starting deletion of primary data.
[2025-10-24T21:30:26.372042] [DEBUG] [LOCAL     ] TNL: Deleted primary data file.
[2025-10-24T21:30:26.372120] [INFO ] [MAIN      ] TNL: Starting full primary refresh.
[2025-10-24T21:30:26.552854] [INFO ] [REMOTE    ] TMO: Fetching primary data for 2025-10.
[2025-10-24T21:30:26.725075] [INFO ] [REMOTE    ] TNL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:30:27.347718] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-07.
[2025-10-24T21:30:28.147885] [INFO ] [REMOTE    ] TNET: Fetching primary data for 2025-10.
[2025-10-24T21:30:28.312953] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-07 (0.97 seconds).
[2025-10-24T21:30:28.488039] [INFO ] [REMOTE    ] TMO: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T21:30:28.498101] [INFO ] [REMOTE    ] TMO: Full fetch complete (75752 records).
[2025-10-24T21:30:28.498270] [DEBUG] [VALIDATOR ] TMO: Validating primary data.
[2025-10-24T21:30:28.911085] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present.
[2025-10-24T21:30:28.911164] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed.
[2025-10-24T21:30:28.912317] [INFO ] [MAIN      ] TMO: Fetched primary data is valid.
[2025-10-24T21:30:28.912380] [DEBUG] [LOCAL     ] TMO: Saving primary data.
[2025-10-24T21:30:28.913007] [FATAL] [LOCAL     ] TMO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:30:28.913135] [FATAL] [MAIN      ] TMO: Failed to save primary data.
[2025-10-24T21:30:28.913178] [WARN ] [MAIN      ] TMO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:30:28.913214] [INFO ] [LOCAL     ] TMO: Starting deletion of primary data.
[2025-10-24T21:30:28.913267] [DEBUG] [LOCAL     ] TMO: No primary data file found to delete.
[2025-10-24T21:30:28.913302] [INFO ] [LOCAL     ] TMO: Starting deletion of derivative data.
[2025-10-24T21:30:28.913493] [DEBUG] [LOCAL     ] TMO: Deleted derivative data file.
[2025-10-24T21:30:28.914251] [INFO ] [MAIN      ] Update Progress: 2107/2366 symbols completed. TMO took 39.2s. Estimated remaining: 33m 15s. Rate: 7.8 symbols/min
[2025-10-24T21:30:28.952740] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-01.
[2025-10-24T21:30:29.096273] [INFO ] [MAIN      ] TOL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:30:29.112146] [INFO ] [REMOTE    ] TNET: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T21:30:29.118362] [INFO ] [REMOTE    ] TNET: Full fetch complete (41919 records).
[2025-10-24T21:30:29.118542] [DEBUG] [VALIDATOR ] TNET: Validating primary data.
[2025-10-24T21:30:29.451249] [DEBUG] [LOCAL     ] TOL: Loaded 50843 existing records from primary storage.
[2025-10-24T21:30:29.467139] [INFO ] [MAIN      ] TOL: Loaded 50843 existing records.
[2025-10-24T21:30:29.672895] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present.
[2025-10-24T21:30:29.685267] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed.
[2025-10-24T21:30:29.696381] [INFO ] [MAIN      ] TNET: Fetched primary data is valid.
[2025-10-24T21:30:29.704588] [DEBUG] [LOCAL     ] TNET: Saving primary data.
[2025-10-24T21:30:29.705290] [FATAL] [LOCAL     ] TNET: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:30:29.706015] [FATAL] [MAIN      ] TNET: Failed to save primary data.
[2025-10-24T21:30:29.725791] [WARN ] [MAIN      ] TOL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:30:29.725840] [WARN ] [MAIN      ] TNET: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:30:29.725984] [INFO ] [MAIN      ] TOL: Wiping existing primary data before full refresh.
[2025-10-24T21:30:29.726084] [INFO ] [LOCAL     ] TOL: Starting deletion of primary data.
[2025-10-24T21:30:29.726156] [INFO ] [LOCAL     ] TNET: Starting deletion of primary data.
[2025-10-24T21:30:29.726297] [DEBUG] [LOCAL     ] TNET: No primary data file found to delete.
[2025-10-24T21:30:29.726360] [INFO ] [LOCAL     ] TNET: Starting deletion of derivative data.
[2025-10-24T21:30:29.726519] [DEBUG] [LOCAL     ] TNET: Deleted derivative data file.
[2025-10-24T21:30:29.726606] [INFO ] [MAIN      ] Update Progress: 2108/2366 symbols completed. TNET took 22.0s. Estimated remaining: 33m 6s. Rate: 7.8 symbols/min
[2025-10-24T21:30:29.757218] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-08.
[2025-10-24T21:30:29.737673] [DEBUG] [LOCAL     ] TOL: Deleted primary data file.
[2025-10-24T21:30:29.758170] [INFO ] [MAIN      ] TOL: Starting full primary refresh.
[2025-10-24T21:30:30.052440] [INFO ] [MAIN      ] TOST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:30:30.294439] [INFO ] [REMOTE    ] TOL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:30:30.315517] [DEBUG] [LOCAL     ] TOST: Loaded 54080 existing records from primary storage.
[2025-10-24T21:30:30.315882] [INFO ] [MAIN      ] TOST: Loaded 54080 existing records.
[2025-10-24T21:30:30.503745] [WARN ] [MAIN      ] TOST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:30:30.521838] [INFO ] [MAIN      ] TOST: Wiping existing primary data before full refresh.
[2025-10-24T21:30:30.522388] [INFO ] [LOCAL     ] TOST: Starting deletion of primary data.
[2025-10-24T21:30:30.523067] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T21:30:30.523131] [DEBUG] [LOCAL     ] TOST: Deleted primary data file.
[2025-10-24T21:30:30.530988] [INFO ] [MAIN      ] TOST: Starting full primary refresh.
[2025-10-24T21:30:30.552779] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-01.
[2025-10-24T21:30:30.765726] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T21:30:30.912725] [INFO ] [REMOTE    ] TOST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:30:31.347706] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-09.
[2025-10-24T21:30:32.147668] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-02.
[2025-10-24T21:30:32.244297] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-09 (0.90 seconds).
[2025-10-24T21:30:32.361665] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-01 (1.81 seconds).
[2025-10-24T21:30:32.947743] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-01.
[2025-10-24T21:30:33.695070] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T21:30:33.747634] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-03.
[2025-10-24T21:30:34.547692] [INFO ] [REMOTE    ] TNC: Fetching primary data for 2025-10.
[2025-10-24T21:30:34.698238] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T21:30:35.201212] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T21:30:35.347699] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-04.
[2025-10-24T21:30:35.439413] [INFO ] [REMOTE    ] TNC: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T21:30:35.441859] [INFO ] [REMOTE    ] TNC: Full fetch complete (22075 records).
[2025-10-24T21:30:35.441959] [DEBUG] [VALIDATOR ] TNC: Validating primary data.
[2025-10-24T21:30:35.840118] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present.
[2025-10-24T21:30:35.840199] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed.
[2025-10-24T21:30:35.840693] [INFO ] [MAIN      ] TNC: Fetched primary data is valid.
[2025-10-24T21:30:35.840756] [DEBUG] [LOCAL     ] TNC: Saving primary data.
[2025-10-24T21:30:35.841027] [FATAL] [LOCAL     ] TNC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:30:35.841129] [FATAL] [MAIN      ] TNC: Failed to save primary data.
[2025-10-24T21:30:35.841177] [WARN ] [MAIN      ] TNC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:30:35.841239] [INFO ] [LOCAL     ] TNC: Starting deletion of primary data.
[2025-10-24T21:30:35.841298] [DEBUG] [LOCAL     ] TNC: No primary data file found to delete.
[2025-10-24T21:30:35.841333] [INFO ] [LOCAL     ] TNC: Starting deletion of derivative data.
[2025-10-24T21:30:35.841479] [DEBUG] [LOCAL     ] TNC: Deleted derivative data file.
[2025-10-24T21:30:35.841550] [INFO ] [MAIN      ] Update Progress: 2109/2366 symbols completed. TNC took 30.3s. Estimated remaining: 32m 58s. Rate: 7.8 symbols/min
[2025-10-24T21:30:36.008545] [INFO ] [MAIN      ] TPB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:30:36.040097] [DEBUG] [LOCAL     ] TPB: Loaded 26451 existing records from primary storage.
[2025-10-24T21:30:36.040405] [INFO ] [MAIN      ] TPB: Loaded 26451 existing records.
[2025-10-24T21:30:36.153422] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-02.
[2025-10-24T21:30:36.247501] [WARN ] [MAIN      ] TPB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:30:36.247960] [INFO ] [MAIN      ] TPB: Wiping existing primary data before full refresh.
[2025-10-24T21:30:36.248047] [INFO ] [LOCAL     ] TPB: Starting deletion of primary data.
[2025-10-24T21:30:36.248404] [DEBUG] [LOCAL     ] TPB: Deleted primary data file.
[2025-10-24T21:30:36.248460] [INFO ] [MAIN      ] TPB: Starting full primary refresh.
[2025-10-24T21:30:36.597091] [INFO ] [REMOTE    ] TPB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:30:36.947685] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-02.
[2025-10-24T21:30:36.992991] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T21:30:37.747692] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-01.
[2025-10-24T21:30:38.065007] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-02 (1.91 seconds).
[2025-10-24T21:30:38.547712] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-03.
[2025-10-24T21:30:38.850841] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T21:30:38.927624] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-02 (1.98 seconds).
[2025-10-24T21:30:39.347729] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-03.
[2025-10-24T21:30:40.147723] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-05.
[2025-10-24T21:30:40.257383] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T21:30:40.924382] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T21:30:40.947712] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-04.
[2025-10-24T21:30:41.690816] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T21:30:41.747725] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-04.
[2025-10-24T21:30:42.547705] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-02.
[2025-10-24T21:30:42.816865] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T21:30:43.347727] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-05.
[2025-10-24T21:30:43.537415] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-02 (0.99 seconds).
[2025-10-24T21:30:43.582769] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T21:30:44.147673] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-05.
[2025-10-24T21:30:44.947671] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-06.
[2025-10-24T21:30:45.333639] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-05 (1.99 seconds).
[2025-10-24T21:30:45.747662] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-03.
[2025-10-24T21:30:45.948041] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T21:30:46.316696] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T21:30:46.547666] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-06.
[2025-10-24T21:30:46.911680] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T21:30:47.347679] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-06.
[2025-10-24T21:30:48.147671] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-04.
[2025-10-24T21:30:48.296516] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T21:30:48.947635] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-07.
[2025-10-24T21:30:48.983044] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T21:30:49.033002] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-04 (0.89 seconds).
[2025-10-24T21:30:49.747687] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-05.
[2025-10-24T21:30:50.131562] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-07 (1.18 seconds).
[2025-10-24T21:30:50.547693] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-08.
[2025-10-24T21:30:50.771438] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T21:30:51.347695] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-06.
[2025-10-24T21:30:51.886816] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T21:30:52.147669] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-07.
[2025-10-24T21:30:52.482181] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T21:30:52.947690] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-07.
[2025-10-24T21:30:53.747704] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-09.
[2025-10-24T21:30:53.919149] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-07 (1.77 seconds).
[2025-10-24T21:30:54.156460] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T21:30:54.547728] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-08.
[2025-10-24T21:30:54.993359] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T21:30:55.347697] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-08.
[2025-10-24T21:30:56.092873] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T21:30:56.147688] [INFO ] [REMOTE    ] TNL: Fetching primary data for 2025-10.
[2025-10-24T21:30:56.712017] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T21:30:56.947682] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-07.
[2025-10-24T21:30:57.731460] [INFO ] [REMOTE    ] TNL: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T21:30:57.739322] [INFO ] [REMOTE    ] TNL: Full fetch complete (59792 records).
[2025-10-24T21:30:57.739457] [DEBUG] [VALIDATOR ] TNL: Validating primary data.
[2025-10-24T21:30:57.752752] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-09.
[2025-10-24T21:30:58.142727] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present.
[2025-10-24T21:30:58.142824] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed.
[2025-10-24T21:30:58.144011] [INFO ] [MAIN      ] TNL: Fetched primary data is valid.
[2025-10-24T21:30:58.144073] [DEBUG] [LOCAL     ] TNL: Saving primary data.
[2025-10-24T21:30:58.144553] [FATAL] [LOCAL     ] TNL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:30:58.144633] [FATAL] [MAIN      ] TNL: Failed to save primary data.
[2025-10-24T21:30:58.144725] [WARN ] [MAIN      ] TNL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:30:58.144818] [INFO ] [LOCAL     ] TNL: Starting deletion of primary data.
[2025-10-24T21:30:58.144904] [DEBUG] [LOCAL     ] TNL: No primary data file found to delete.
[2025-10-24T21:30:58.144958] [INFO ] [LOCAL     ] TNL: Starting deletion of derivative data.
[2025-10-24T21:30:58.145277] [DEBUG] [LOCAL     ] TNL: Deleted derivative data file.
[2025-10-24T21:30:58.145517] [INFO ] [MAIN      ] Update Progress: 2110/2366 symbols completed. TNL took 32.2s. Estimated remaining: 32m 52s. Rate: 7.8 symbols/min
[2025-10-24T21:30:58.322673] [INFO ] [MAIN      ] TPC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:30:58.360282] [DEBUG] [LOCAL     ] TPC: Loaded 39366 existing records from primary storage.
[2025-10-24T21:30:58.360581] [INFO ] [MAIN      ] TPC: Loaded 39366 existing records.
[2025-10-24T21:30:58.549117] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-09.
[2025-10-24T21:30:58.549009] [WARN ] [MAIN      ] TPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:30:58.550381] [INFO ] [MAIN      ] TPC: Wiping existing primary data before full refresh.
[2025-10-24T21:30:58.550513] [INFO ] [LOCAL     ] TPC: Starting deletion of primary data.
[2025-10-24T21:30:58.550890] [DEBUG] [LOCAL     ] TPC: Deleted primary data file.
[2025-10-24T21:30:58.550972] [INFO ] [MAIN      ] TPC: Starting full primary refresh.
[2025-10-24T21:30:58.901291] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-07 (1.95 seconds).
[2025-10-24T21:30:58.985457] [INFO ] [REMOTE    ] TPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:30:59.346806] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T21:30:59.358362] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-08.
[2025-10-24T21:30:59.854818] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T21:31:00.147692] [INFO ] [REMOTE    ] TOST: Fetching primary data for 2025-10.
[2025-10-24T21:31:00.947662] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-01.
[2025-10-24T21:31:01.100757] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T21:31:01.752914] [INFO ] [REMOTE    ] TPB: Fetching primary data for 2025-10.
[2025-10-24T21:31:01.780157] [INFO ] [REMOTE    ] TOST: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T21:31:01.795714] [INFO ] [REMOTE    ] TOST: Full fetch complete (77853 records).
[2025-10-24T21:31:01.795909] [DEBUG] [VALIDATOR ] TOST: Validating primary data.
[2025-10-24T21:31:02.389621] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present.
[2025-10-24T21:31:02.389789] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed.
[2025-10-24T21:31:02.391895] [INFO ] [MAIN      ] TOST: Fetched primary data is valid.
[2025-10-24T21:31:02.392095] [DEBUG] [LOCAL     ] TOST: Saving primary data.
[2025-10-24T21:31:02.403528] [FATAL] [LOCAL     ] TOST: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:31:02.425794] [FATAL] [MAIN      ] TOST: Failed to save primary data.
[2025-10-24T21:31:02.429043] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T21:31:02.439531] [WARN ] [MAIN      ] TOST: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:31:02.439731] [INFO ] [LOCAL     ] TOST: Starting deletion of primary data.
[2025-10-24T21:31:02.439824] [DEBUG] [LOCAL     ] TOST: No primary data file found to delete.
[2025-10-24T21:31:02.439875] [INFO ] [LOCAL     ] TOST: Starting deletion of derivative data.
[2025-10-24T21:31:02.440070] [DEBUG] [LOCAL     ] TOST: Deleted derivative data file.
[2025-10-24T21:31:02.440440] [INFO ] [MAIN      ] Update Progress: 2111/2366 symbols completed. TOST took 32.7s. Estimated remaining: 32m 44s. Rate: 7.8 symbols/min
[2025-10-24T21:31:02.552885] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-09.
[2025-10-24T21:31:02.714856] [INFO ] [MAIN      ] TPH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:31:02.757620] [DEBUG] [LOCAL     ] TPH: Loaded 45097 existing records from primary storage.
[2025-10-24T21:31:02.757965] [INFO ] [MAIN      ] TPH: Loaded 45097 existing records.
[2025-10-24T21:31:02.950295] [WARN ] [MAIN      ] TPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:31:02.950638] [INFO ] [MAIN      ] TPH: Wiping existing primary data before full refresh.
[2025-10-24T21:31:02.950752] [INFO ] [LOCAL     ] TPH: Starting deletion of primary data.
[2025-10-24T21:31:02.951200] [DEBUG] [LOCAL     ] TPH: Deleted primary data file.
[2025-10-24T21:31:02.951309] [INFO ] [MAIN      ] TPH: Starting full primary refresh.
[2025-10-24T21:31:03.088784] [INFO ] [REMOTE    ] TPB: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T21:31:03.135536] [INFO ] [REMOTE    ] TPB: Full fetch complete (36211 records).
[2025-10-24T21:31:03.155368] [DEBUG] [VALIDATOR ] TPB: Validating primary data.
[2025-10-24T21:31:03.350271] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-02.
[2025-10-24T21:31:03.677437] [INFO ] [REMOTE    ] TPH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:31:03.760343] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present.
[2025-10-24T21:31:03.760420] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed.
[2025-10-24T21:31:03.761197] [INFO ] [MAIN      ] TPB: Fetched primary data is valid.
[2025-10-24T21:31:03.761259] [DEBUG] [LOCAL     ] TPB: Saving primary data.
[2025-10-24T21:31:03.761601] [FATAL] [LOCAL     ] TPB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:31:03.761701] [FATAL] [MAIN      ] TPB: Failed to save primary data.
[2025-10-24T21:31:03.761746] [WARN ] [MAIN      ] TPB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:31:03.761812] [INFO ] [LOCAL     ] TPB: Starting deletion of primary data.
[2025-10-24T21:31:03.761869] [DEBUG] [LOCAL     ] TPB: No primary data file found to delete.
[2025-10-24T21:31:03.761904] [INFO ] [LOCAL     ] TPB: Starting deletion of derivative data.
[2025-10-24T21:31:03.762053] [DEBUG] [LOCAL     ] TPB: Deleted derivative data file.
[2025-10-24T21:31:03.762126] [INFO ] [MAIN      ] Update Progress: 2112/2366 symbols completed. TPB took 27.9s. Estimated remaining: 32m 36s. Rate: 7.8 symbols/min
[2025-10-24T21:31:03.928274] [INFO ] [MAIN      ] TPL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:31:03.942732] [DEBUG] [LOCAL     ] TPL: Loaded 12313 existing records from primary storage.
[2025-10-24T21:31:03.942963] [INFO ] [MAIN      ] TPL: Loaded 12313 existing records.
[2025-10-24T21:31:04.117174] [WARN ] [MAIN      ] TPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:31:04.117494] [INFO ] [MAIN      ] TPL: Wiping existing primary data before full refresh.
[2025-10-24T21:31:04.117557] [INFO ] [LOCAL     ] TPL: Starting deletion of primary data.
[2025-10-24T21:31:04.117786] [DEBUG] [LOCAL     ] TPL: Deleted primary data file.
[2025-10-24T21:31:04.117841] [INFO ] [MAIN      ] TPL: Starting full primary refresh.
[2025-10-24T21:31:04.159360] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-01.
[2025-10-24T21:31:04.475021] [INFO ] [REMOTE    ] TPL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:31:04.509378] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-09 (1.96 seconds).
[2025-10-24T21:31:04.767361] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T21:31:04.947718] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-03.
[2025-10-24T21:31:05.338834] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T21:31:05.747723] [INFO ] [REMOTE    ] TOL: Fetching primary data for 2025-10.
[2025-10-24T21:31:06.479596] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T21:31:06.547772] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-01.
[2025-10-24T21:31:07.347742] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-02.
[2025-10-24T21:31:07.424020] [INFO ] [REMOTE    ] TOL: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T21:31:07.433239] [INFO ] [REMOTE    ] TOL: Full fetch complete (73647 records).
[2025-10-24T21:31:07.433399] [DEBUG] [VALIDATOR ] TOL: Validating primary data.
[2025-10-24T21:31:07.588949] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-01 (1.04 seconds).
[2025-10-24T21:31:07.849776] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present.
[2025-10-24T21:31:07.849867] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed.
[2025-10-24T21:31:07.851140] [INFO ] [MAIN      ] TOL: Fetched primary data is valid.
[2025-10-24T21:31:07.851205] [DEBUG] [LOCAL     ] TOL: Saving primary data.
[2025-10-24T21:31:07.851833] [FATAL] [LOCAL     ] TOL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:31:07.851926] [FATAL] [MAIN      ] TOL: Failed to save primary data.
[2025-10-24T21:31:07.851969] [WARN ] [MAIN      ] TOL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:31:07.852007] [INFO ] [LOCAL     ] TOL: Starting deletion of primary data.
[2025-10-24T21:31:07.852062] [DEBUG] [LOCAL     ] TOL: No primary data file found to delete.
[2025-10-24T21:31:07.852101] [INFO ] [LOCAL     ] TOL: Starting deletion of derivative data.
[2025-10-24T21:31:07.852276] [DEBUG] [LOCAL     ] TOL: Deleted derivative data file.
[2025-10-24T21:31:07.852485] [INFO ] [MAIN      ] Update Progress: 2113/2366 symbols completed. TOL took 38.9s. Estimated remaining: 32m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:31:08.024099] [INFO ] [MAIN      ] TPR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:31:08.078434] [DEBUG] [LOCAL     ] TPR: Loaded 53752 existing records from primary storage.
[2025-10-24T21:31:08.078842] [INFO ] [MAIN      ] TPR: Loaded 53752 existing records.
[2025-10-24T21:31:08.152718] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-02.
[2025-10-24T21:31:08.261491] [WARN ] [MAIN      ] TPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:31:08.261706] [INFO ] [MAIN      ] TPR: Wiping existing primary data before full refresh.
[2025-10-24T21:31:08.261761] [INFO ] [LOCAL     ] TPR: Starting deletion of primary data.
[2025-10-24T21:31:08.262068] [DEBUG] [LOCAL     ] TPR: Deleted primary data file.
[2025-10-24T21:31:08.262107] [INFO ] [MAIN      ] TPR: Starting full primary refresh.
[2025-10-24T21:31:08.619870] [INFO ] [REMOTE    ] TPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:31:08.725452] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T21:31:08.947708] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-01.
[2025-10-24T21:31:09.078931] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-02 (0.93 seconds).
[2025-10-24T21:31:09.747728] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-03.
[2025-10-24T21:31:10.547736] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-04.
[2025-10-24T21:31:10.667718] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T21:31:10.820537] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T21:31:11.347707] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-03.
[2025-10-24T21:31:12.097061] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T21:31:12.147678] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-04.
[2025-10-24T21:31:12.947671] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-05.
[2025-10-24T21:31:13.101540] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T21:31:13.272715] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T21:31:13.747733] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-02.
[2025-10-24T21:31:14.090887] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-05 (1.14 seconds).
[2025-10-24T21:31:14.547712] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-05.
[2025-10-24T21:31:15.347629] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-06.
[2025-10-24T21:31:15.419729] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T21:31:15.566887] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T21:31:16.147712] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-04.
[2025-10-24T21:31:16.747165] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T21:31:16.947687] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-06.
[2025-10-24T21:31:17.633019] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T21:31:17.658773] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-06 (0.71 seconds).
[2025-10-24T21:31:17.747719] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-03.
[2025-10-24T21:31:18.547715] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-05.
[2025-10-24T21:31:19.347722] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-07.
[2025-10-24T21:31:19.481167] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T21:31:19.999958] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-07 (0.65 seconds).
[2025-10-24T21:31:20.031314] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T21:31:20.147622] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-06.
[2025-10-24T21:31:20.947730] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-07.
[2025-10-24T21:31:21.534914] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T21:31:21.747685] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-04.
[2025-10-24T21:31:21.980283] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-07 (1.03 seconds).
[2025-10-24T21:31:22.547748] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-08.
[2025-10-24T21:31:23.347699] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-08.
[2025-10-24T21:31:23.382019] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T21:31:24.134382] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T21:31:24.147733] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-09.
[2025-10-24T21:31:24.370386] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T21:31:24.947755] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-09.
[2025-10-24T21:31:25.396636] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-09 (0.45 seconds).
[2025-10-24T21:31:25.586567] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T21:31:25.747676] [INFO ] [REMOTE    ] TPL: Fetching primary data for 2025-10.
[2025-10-24T21:31:26.547667] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-07.
[2025-10-24T21:31:26.630842] [INFO ] [REMOTE    ] TPL: Incremental fetch complete for 2025-10 (0.88 seconds).
[2025-10-24T21:31:26.634702] [INFO ] [REMOTE    ] TPL: Full fetch complete (17460 records).
[2025-10-24T21:31:26.634877] [DEBUG] [VALIDATOR ] TPL: Validating primary data.
[2025-10-24T21:31:27.016458] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present.
[2025-10-24T21:31:27.016550] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed.
[2025-10-24T21:31:27.017012] [INFO ] [MAIN      ] TPL: Fetched primary data is valid.
[2025-10-24T21:31:27.017099] [DEBUG] [LOCAL     ] TPL: Saving primary data.
[2025-10-24T21:31:27.017344] [FATAL] [LOCAL     ] TPL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:31:27.017438] [FATAL] [MAIN      ] TPL: Failed to save primary data.
[2025-10-24T21:31:27.017513] [WARN ] [MAIN      ] TPL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:31:27.017659] [INFO ] [LOCAL     ] TPL: Starting deletion of primary data.
[2025-10-24T21:31:27.017749] [DEBUG] [LOCAL     ] TPL: No primary data file found to delete.
[2025-10-24T21:31:27.017797] [INFO ] [LOCAL     ] TPL: Starting deletion of derivative data.
[2025-10-24T21:31:27.017943] [DEBUG] [LOCAL     ] TPL: Deleted derivative data file.
[2025-10-24T21:31:27.018027] [INFO ] [MAIN      ] Update Progress: 2114/2366 symbols completed. TPL took 23.3s. Estimated remaining: 32m 21s. Rate: 7.8 symbols/min
[2025-10-24T21:31:27.184668] [INFO ] [MAIN      ] TPVG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:31:27.214359] [DEBUG] [LOCAL     ] TPVG: Loaded 27412 existing records from primary storage.
[2025-10-24T21:31:27.214690] [INFO ] [MAIN      ] TPVG: Loaded 27412 existing records.
[2025-10-24T21:31:27.354048] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-05.
[2025-10-24T21:31:27.393131] [WARN ] [MAIN      ] TPVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:31:27.394040] [INFO ] [MAIN      ] TPVG: Wiping existing primary data before full refresh.
[2025-10-24T21:31:27.394086] [INFO ] [LOCAL     ] TPVG: Starting deletion of primary data.
[2025-10-24T21:31:27.394270] [DEBUG] [LOCAL     ] TPVG: Deleted primary data file.
[2025-10-24T21:31:27.394324] [INFO ] [MAIN      ] TPVG: Starting full primary refresh.
[2025-10-24T21:31:27.756185] [INFO ] [REMOTE    ] TPVG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:31:28.001330] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T21:31:28.147672] [INFO ] [REMOTE    ] TPC: Fetching primary data for 2025-10.
[2025-10-24T21:31:28.890639] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T21:31:28.947606] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-06.
[2025-10-24T21:31:29.578009] [INFO ] [REMOTE    ] TPC: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T21:31:29.585079] [INFO ] [REMOTE    ] TPC: Full fetch complete (55530 records).
[2025-10-24T21:31:29.585191] [DEBUG] [VALIDATOR ] TPC: Validating primary data.
[2025-10-24T21:31:29.758924] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-01.
[2025-10-24T21:31:29.978952] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present.
[2025-10-24T21:31:29.979073] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed.
[2025-10-24T21:31:29.980116] [INFO ] [MAIN      ] TPC: Fetched primary data is valid.
[2025-10-24T21:31:29.980178] [DEBUG] [LOCAL     ] TPC: Saving primary data.
[2025-10-24T21:31:29.980638] [FATAL] [LOCAL     ] TPC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:31:29.980757] [FATAL] [MAIN      ] TPC: Failed to save primary data.
[2025-10-24T21:31:29.980817] [WARN ] [MAIN      ] TPC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:31:29.980905] [INFO ] [LOCAL     ] TPC: Starting deletion of primary data.
[2025-10-24T21:31:29.980991] [DEBUG] [LOCAL     ] TPC: No primary data file found to delete.
[2025-10-24T21:31:29.981059] [INFO ] [LOCAL     ] TPC: Starting deletion of derivative data.
[2025-10-24T21:31:29.981259] [DEBUG] [LOCAL     ] TPC: Deleted derivative data file.
[2025-10-24T21:31:29.981718] [INFO ] [MAIN      ] Update Progress: 2115/2366 symbols completed. TPC took 31.8s. Estimated remaining: 32m 13s. Rate: 7.8 symbols/min
[2025-10-24T21:31:30.154040] [INFO ] [MAIN      ] TPYP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:31:30.164427] [DEBUG] [LOCAL     ] TPYP: Loaded 7924 existing records from primary storage.
[2025-10-24T21:31:30.164634] [INFO ] [MAIN      ] TPYP: Loaded 7924 existing records.
[2025-10-24T21:31:30.366605] [WARN ] [MAIN      ] TPYP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:31:30.366820] [INFO ] [MAIN      ] TPYP: Wiping existing primary data before full refresh.
[2025-10-24T21:31:30.366890] [INFO ] [LOCAL     ] TPYP: Starting deletion of primary data.
[2025-10-24T21:31:30.367095] [DEBUG] [LOCAL     ] TPYP: Deleted primary data file.
[2025-10-24T21:31:30.367146] [INFO ] [MAIN      ] TPYP: Starting full primary refresh.
[2025-10-24T21:31:30.558669] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-08.
[2025-10-24T21:31:30.737765] [INFO ] [REMOTE    ] TPYP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:31:30.765735] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T21:31:31.097154] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-01 (1.34 seconds).
[2025-10-24T21:31:31.347696] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-01.
[2025-10-24T21:31:32.064269] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T21:31:32.148784] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-02.
[2025-10-24T21:31:32.151788] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T21:31:32.947702] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-02.
[2025-10-24T21:31:33.286198] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T21:31:33.409741] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-02 (0.46 seconds).
[2025-10-24T21:31:33.747669] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-03.
[2025-10-24T21:31:34.547628] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-07.
[2025-10-24T21:31:34.989295] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T21:31:35.347633] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-09.
[2025-10-24T21:31:36.147706] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-03.
[2025-10-24T21:31:36.339299] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T21:31:36.873921] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T21:31:36.947694] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-08.
[2025-10-24T21:31:36.995636] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T21:31:37.747717] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-04.
[2025-10-24T21:31:38.547719] [INFO ] [REMOTE    ] TPH: Fetching primary data for 2025-10.
[2025-10-24T21:31:39.069766] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-08 (2.12 seconds).
[2025-10-24T21:31:39.105323] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T21:31:39.347714] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-05.
[2025-10-24T21:31:39.752777] [INFO ] [REMOTE    ] TPH: Incremental fetch complete for 2025-10 (1.21 seconds).
[2025-10-24T21:31:39.762149] [INFO ] [REMOTE    ] TPH: Full fetch complete (65048 records).
[2025-10-24T21:31:39.762384] [DEBUG] [VALIDATOR ] TPH: Validating primary data.
[2025-10-24T21:31:40.159549] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-09.
[2025-10-24T21:31:40.162848] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present.
[2025-10-24T21:31:40.163874] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed.
[2025-10-24T21:31:40.165185] [INFO ] [MAIN      ] TPH: Fetched primary data is valid.
[2025-10-24T21:31:40.165408] [DEBUG] [LOCAL     ] TPH: Saving primary data.
[2025-10-24T21:31:40.166096] [FATAL] [LOCAL     ] TPH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:31:40.166370] [FATAL] [MAIN      ] TPH: Failed to save primary data.
[2025-10-24T21:31:40.166440] [WARN ] [MAIN      ] TPH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:31:40.166507] [INFO ] [LOCAL     ] TPH: Starting deletion of primary data.
[2025-10-24T21:31:40.166568] [DEBUG] [LOCAL     ] TPH: No primary data file found to delete.
[2025-10-24T21:31:40.166604] [INFO ] [LOCAL     ] TPH: Starting deletion of derivative data.
[2025-10-24T21:31:40.166807] [DEBUG] [LOCAL     ] TPH: Deleted derivative data file.
[2025-10-24T21:31:40.167007] [INFO ] [MAIN      ] Update Progress: 2116/2366 symbols completed. TPH took 37.7s. Estimated remaining: 32m 5s. Rate: 7.8 symbols/min
[2025-10-24T21:31:40.358141] [INFO ] [MAIN      ] TPZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:31:40.360925] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T21:31:40.373415] [DEBUG] [LOCAL     ] TPZ: Loaded 4619 existing records from primary storage.
[2025-10-24T21:31:40.373693] [INFO ] [MAIN      ] TPZ: Loaded 4619 existing records.
[2025-10-24T21:31:40.550824] [WARN ] [MAIN      ] TPZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:31:40.551048] [INFO ] [MAIN      ] TPZ: Wiping existing primary data before full refresh.
[2025-10-24T21:31:40.551097] [INFO ] [LOCAL     ] TPZ: Starting deletion of primary data.
[2025-10-24T21:31:40.551259] [DEBUG] [LOCAL     ] TPZ: Deleted primary data file.
[2025-10-24T21:31:40.551316] [INFO ] [MAIN      ] TPZ: Starting full primary refresh.
[2025-10-24T21:31:40.906343] [INFO ] [REMOTE    ] TPZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:31:40.947626] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-01.
[2025-10-24T21:31:41.016943] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-09 (0.86 seconds).
[2025-10-24T21:31:41.736773] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T21:31:41.747635] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-02.
[2025-10-24T21:31:42.491782] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-02 (0.74 seconds).
[2025-10-24T21:31:42.547689] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-03.
[2025-10-24T21:31:43.253450] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T21:31:43.347700] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-04.
[2025-10-24T21:31:44.117208] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T21:31:44.147621] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-05.
[2025-10-24T21:31:44.736181] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-05 (0.59 seconds).
[2025-10-24T21:31:44.947725] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-06.
[2025-10-24T21:31:45.560378] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T21:31:45.747692] [INFO ] [REMOTE    ] TPR: Fetching primary data for 2025-10.
[2025-10-24T21:31:46.547709] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-04.
[2025-10-24T21:31:47.324187] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T21:31:47.347617] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-05.
[2025-10-24T21:31:47.394944] [INFO ] [REMOTE    ] TPR: Incremental fetch complete for 2025-10 (1.65 seconds).
[2025-10-24T21:31:47.404694] [INFO ] [REMOTE    ] TPR: Full fetch complete (77483 records).
[2025-10-24T21:31:47.404878] [DEBUG] [VALIDATOR ] TPR: Validating primary data.
[2025-10-24T21:31:47.786006] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present.
[2025-10-24T21:31:47.786103] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed.
[2025-10-24T21:31:47.787298] [INFO ] [MAIN      ] TPR: Fetched primary data is valid.
[2025-10-24T21:31:47.787397] [DEBUG] [LOCAL     ] TPR: Saving primary data.
[2025-10-24T21:31:47.788071] [FATAL] [LOCAL     ] TPR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:31:47.788154] [FATAL] [MAIN      ] TPR: Failed to save primary data.
[2025-10-24T21:31:47.788219] [WARN ] [MAIN      ] TPR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:31:47.788288] [INFO ] [LOCAL     ] TPR: Starting deletion of primary data.
[2025-10-24T21:31:47.788350] [DEBUG] [LOCAL     ] TPR: No primary data file found to delete.
[2025-10-24T21:31:47.788386] [INFO ] [LOCAL     ] TPR: Starting deletion of derivative data.
[2025-10-24T21:31:47.788546] [DEBUG] [LOCAL     ] TPR: Deleted derivative data file.
[2025-10-24T21:31:47.789049] [INFO ] [MAIN      ] Update Progress: 2117/2366 symbols completed. TPR took 39.9s. Estimated remaining: 31m 58s. Rate: 7.8 symbols/min
[2025-10-24T21:31:48.092665] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T21:31:48.147624] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-06.
[2025-10-24T21:31:48.891718] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-06 (0.74 seconds).
[2025-10-24T21:31:48.947731] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-07.
[2025-10-24T21:31:49.673506] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-07 (0.73 seconds).
[2025-10-24T21:31:49.747620] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-08.
[2025-10-24T21:31:50.473123] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T21:31:50.547704] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-07.
[2025-10-24T21:31:51.180234] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-07 (0.63 seconds).
[2025-10-24T21:31:51.347688] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-06.
[2025-10-24T21:31:52.147669] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-09.
[2025-10-24T21:31:52.565696] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T21:31:52.898350] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:31:52.947617] [INFO ] [REMOTE    ] TPYP: Fetching primary data for 2025-10.
[2025-10-24T21:31:53.737970] [INFO ] [REMOTE    ] TPYP: Incremental fetch complete for 2025-10 (0.79 seconds).
[2025-10-24T21:31:53.739779] [INFO ] [REMOTE    ] TPYP: Full fetch complete (12256 records).
[2025-10-24T21:31:53.739849] [DEBUG] [VALIDATOR ] TPYP: Validating primary data.
[2025-10-24T21:31:53.752939] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-08.
[2025-10-24T21:31:54.120167] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present.
[2025-10-24T21:31:54.120238] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed.
[2025-10-24T21:31:54.120517] [INFO ] [MAIN      ] TPYP: Fetched primary data is valid.
[2025-10-24T21:31:54.120554] [DEBUG] [LOCAL     ] TPYP: Saving primary data.
[2025-10-24T21:31:54.120808] [FATAL] [LOCAL     ] TPYP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:31:54.120892] [FATAL] [MAIN      ] TPYP: Failed to save primary data.
[2025-10-24T21:31:54.120933] [WARN ] [MAIN      ] TPYP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:31:54.120967] [INFO ] [LOCAL     ] TPYP: Starting deletion of primary data.
[2025-10-24T21:31:54.121015] [DEBUG] [LOCAL     ] TPYP: No primary data file found to delete.
[2025-10-24T21:31:54.121049] [INFO ] [LOCAL     ] TPYP: Starting deletion of derivative data.
[2025-10-24T21:31:54.121233] [DEBUG] [LOCAL     ] TPYP: Deleted derivative data file.
[2025-10-24T21:31:54.121322] [INFO ] [MAIN      ] Update Progress: 2118/2366 symbols completed. TPYP took 24.1s. Estimated remaining: 31m 50s. Rate: 7.8 symbols/min
[2025-10-24T21:31:54.421377] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-08 (0.67 seconds).
[2025-10-24T21:31:54.547720] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-09.
[2025-10-24T21:31:55.105387] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T21:31:55.347685] [INFO ] [REMOTE    ] TPZ: Fetching primary data for 2025-10.
[2025-10-24T21:31:55.899127] [INFO ] [REMOTE    ] TPZ: Incremental fetch complete for 2025-10 (0.55 seconds).
[2025-10-24T21:31:55.900517] [INFO ] [REMOTE    ] TPZ: Full fetch complete (8292 records).
[2025-10-24T21:31:55.900604] [DEBUG] [VALIDATOR ] TPZ: Validating primary data.
[2025-10-24T21:31:56.157427] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-07.
[2025-10-24T21:31:56.268527] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present.
[2025-10-24T21:31:56.268606] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed.
[2025-10-24T21:31:56.268856] [INFO ] [MAIN      ] TPZ: Fetched primary data is valid.
[2025-10-24T21:31:56.268919] [DEBUG] [LOCAL     ] TPZ: Saving primary data.
[2025-10-24T21:31:56.269133] [FATAL] [LOCAL     ] TPZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:31:56.269225] [FATAL] [MAIN      ] TPZ: Failed to save primary data.
[2025-10-24T21:31:56.269297] [WARN ] [MAIN      ] TPZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:31:56.269387] [INFO ] [LOCAL     ] TPZ: Starting deletion of primary data.
[2025-10-24T21:31:56.269466] [DEBUG] [LOCAL     ] TPZ: No primary data file found to delete.
[2025-10-24T21:31:56.269504] [INFO ] [LOCAL     ] TPZ: Starting deletion of derivative data.
[2025-10-24T21:31:56.269706] [DEBUG] [LOCAL     ] TPZ: Deleted derivative data file.
[2025-10-24T21:31:56.269801] [INFO ] [MAIN      ] Update Progress: 2119/2366 symbols completed. TPZ took 16.1s. Estimated remaining: 31m 42s. Rate: 7.8 symbols/min
[2025-10-24T21:31:57.374140] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T21:31:57.379864] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-08.
[2025-10-24T21:31:58.642725] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T21:31:58.648885] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-09.
[2025-10-24T21:31:59.814748] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T21:31:59.821540] [INFO ] [REMOTE    ] TPVG: Fetching primary data for 2025-10.
[2025-10-24T21:32:00.805387] [INFO ] [REMOTE    ] TPVG: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T21:32:00.811393] [INFO ] [REMOTE    ] TPVG: Full fetch complete (39257 records).
[2025-10-24T21:32:00.811528] [DEBUG] [VALIDATOR ] TPVG: Validating primary data.
[2025-10-24T21:32:01.195211] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present.
[2025-10-24T21:32:01.195328] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed.
[2025-10-24T21:32:01.196147] [INFO ] [MAIN      ] TPVG: Fetched primary data is valid.
[2025-10-24T21:32:01.196211] [DEBUG] [LOCAL     ] TPVG: Saving primary data.
[2025-10-24T21:32:01.196694] [FATAL] [LOCAL     ] TPVG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:32:01.196789] [FATAL] [MAIN      ] TPVG: Failed to save primary data.
[2025-10-24T21:32:01.196833] [WARN ] [MAIN      ] TPVG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:32:01.196869] [INFO ] [LOCAL     ] TPVG: Starting deletion of primary data.
[2025-10-24T21:32:01.196923] [DEBUG] [LOCAL     ] TPVG: No primary data file found to delete.
[2025-10-24T21:32:01.196960] [INFO ] [LOCAL     ] TPVG: Starting deletion of derivative data.
[2025-10-24T21:32:01.197303] [DEBUG] [LOCAL     ] TPVG: Deleted derivative data file.
[2025-10-24T21:32:01.197397] [INFO ] [MAIN      ] Update Progress: 2120/2366 symbols completed. TPVG took 34.2s. Estimated remaining: 31m 34s. Rate: 7.8 symbols/min
[2025-10-24T21:32:01.861552] [INFO ] [MAIN      ] TRAK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:32:01.851040] [INFO ] [MAIN      ] TRC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:32:01.938953] [INFO ] [MAIN      ] TREX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:32:01.936629] [INFO ] [MAIN      ] TR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:32:01.964678] [DEBUG] [LOCAL     ] TRAK: Loaded 9632 existing records from primary storage.
[2025-10-24T21:32:01.978346] [INFO ] [MAIN      ] TRAK: Loaded 9632 existing records.
[2025-10-24T21:32:01.978109] [DEBUG] [LOCAL     ] TR: Loaded 19306 existing records from primary storage.
[2025-10-24T21:32:01.983882] [INFO ] [MAIN      ] TR: Loaded 19306 existing records.
[2025-10-24T21:32:01.995938] [DEBUG] [LOCAL     ] TRC: Loaded 15456 existing records from primary storage.
[2025-10-24T21:32:02.093183] [INFO ] [MAIN      ] TRC: Loaded 15456 existing records.
[2025-10-24T21:32:02.450362] [DEBUG] [LOCAL     ] TREX: Loaded 50160 existing records from primary storage.
[2025-10-24T21:32:02.458929] [WARN ] [MAIN      ] TR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:32:02.486606] [WARN ] [MAIN      ] TRAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:32:02.507993] [INFO ] [MAIN      ] TRAK: Wiping existing primary data before full refresh.
[2025-10-24T21:32:02.487023] [INFO ] [MAIN      ] TREX: Loaded 50160 existing records.
[2025-10-24T21:32:02.508231] [INFO ] [LOCAL     ] TRAK: Starting deletion of primary data.
[2025-10-24T21:32:02.549600] [INFO ] [MAIN      ] TR: Wiping existing primary data before full refresh.
[2025-10-24T21:32:02.608454] [INFO ] [LOCAL     ] TR: Starting deletion of primary data.
[2025-10-24T21:32:02.611826] [DEBUG] [LOCAL     ] TRAK: Deleted primary data file.
[2025-10-24T21:32:02.660662] [WARN ] [MAIN      ] TRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:32:02.681494] [DEBUG] [LOCAL     ] TR: Deleted primary data file.
[2025-10-24T21:32:02.671171] [INFO ] [MAIN      ] TRAK: Starting full primary refresh.
[2025-10-24T21:32:02.681858] [INFO ] [MAIN      ] TR: Starting full primary refresh.
[2025-10-24T21:32:02.717035] [INFO ] [MAIN      ] TRC: Wiping existing primary data before full refresh.
[2025-10-24T21:32:02.876234] [INFO ] [LOCAL     ] TRC: Starting deletion of primary data.
[2025-10-24T21:32:02.968047] [DEBUG] [LOCAL     ] TRC: Deleted primary data file.
[2025-10-24T21:32:03.076967] [WARN ] [MAIN      ] TREX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:32:03.099496] [INFO ] [MAIN      ] TREX: Wiping existing primary data before full refresh.
[2025-10-24T21:32:03.108974] [INFO ] [LOCAL     ] TREX: Starting deletion of primary data.
[2025-10-24T21:32:03.080854] [INFO ] [MAIN      ] TRC: Starting full primary refresh.
[2025-10-24T21:32:03.151792] [DEBUG] [LOCAL     ] TREX: Deleted primary data file.
[2025-10-24T21:32:03.255050] [INFO ] [MAIN      ] TREX: Starting full primary refresh.
[2025-10-24T21:32:03.824251] [INFO ] [REMOTE    ] TRAK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:32:03.888409] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-01.
[2025-10-24T21:32:04.001584] [INFO ] [REMOTE    ] TR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:32:04.062316] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-01.
[2025-10-24T21:32:04.266060] [INFO ] [REMOTE    ] TRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:32:04.279275] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-01.
[2025-10-24T21:32:04.386063] [INFO ] [REMOTE    ] TREX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:32:04.386373] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-01.
[2025-10-24T21:32:04.836426] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T21:32:04.838847] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-02.
[2025-10-24T21:32:05.132791] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T21:32:05.136708] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-02.
[2025-10-24T21:32:05.190001] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T21:32:05.193221] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-02.
[2025-10-24T21:32:05.281992] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-02 (0.44 seconds).
[2025-10-24T21:32:05.284138] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-03.
[2025-10-24T21:32:05.896044] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T21:32:05.906234] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-02.
[2025-10-24T21:32:05.917305] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-02 (0.72 seconds).
[2025-10-24T21:32:06.194856] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-03 (0.91 seconds).
[2025-10-24T21:32:06.208545] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T21:32:06.547731] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-03.
[2025-10-24T21:32:07.347629] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-04.
[2025-10-24T21:32:07.469072] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T21:32:07.502070] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T21:32:08.147673] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-04.
[2025-10-24T21:32:08.157942] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T21:32:08.947708] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-05.
[2025-10-24T21:32:09.127403] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T21:32:09.691837] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T21:32:09.747627] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-03.
[2025-10-24T21:32:10.547741] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-06.
[2025-10-24T21:32:10.772574] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T21:32:11.007883] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-06 (0.46 seconds).
[2025-10-24T21:32:11.347672] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-07.
[2025-10-24T21:32:11.846831] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-07 (0.50 seconds).
[2025-10-24T21:32:12.147718] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-03.
[2025-10-24T21:32:12.947709] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-04.
[2025-10-24T21:32:13.747698] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-08.
[2025-10-24T21:32:13.955057] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T21:32:14.086444] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-04 (1.14 seconds).
[2025-10-24T21:32:14.523936] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T21:32:14.547672] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-09.
[2025-10-24T21:32:15.252384] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T21:32:15.347703] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-05.
[2025-10-24T21:32:16.043746] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-05 (0.70 seconds).
[2025-10-24T21:32:16.147718] [INFO ] [REMOTE    ] TRAK: Fetching primary data for 2025-10.
[2025-10-24T21:32:16.947674] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-06.
[2025-10-24T21:32:16.998418] [INFO ] [REMOTE    ] TRAK: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T21:32:17.000934] [INFO ] [REMOTE    ] TRAK: Full fetch complete (13622 records).
[2025-10-24T21:32:17.001004] [DEBUG] [VALIDATOR ] TRAK: Validating primary data.
[2025-10-24T21:32:17.363601] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present.
[2025-10-24T21:32:17.363696] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed.
[2025-10-24T21:32:17.364014] [INFO ] [MAIN      ] TRAK: Fetched primary data is valid.
[2025-10-24T21:32:17.364055] [DEBUG] [LOCAL     ] TRAK: Saving primary data.
[2025-10-24T21:32:17.364321] [FATAL] [LOCAL     ] TRAK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:32:17.364375] [FATAL] [MAIN      ] TRAK: Failed to save primary data.
[2025-10-24T21:32:17.364409] [WARN ] [MAIN      ] TRAK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:32:17.364442] [INFO ] [LOCAL     ] TRAK: Starting deletion of primary data.
[2025-10-24T21:32:17.364493] [DEBUG] [LOCAL     ] TRAK: No primary data file found to delete.
[2025-10-24T21:32:17.364527] [INFO ] [LOCAL     ] TRAK: Starting deletion of derivative data.
[2025-10-24T21:32:17.364730] [DEBUG] [LOCAL     ] TRAK: Deleted derivative data file.
[2025-10-24T21:32:17.364821] [INFO ] [MAIN      ] Update Progress: 2121/2366 symbols completed. TRAK took 16.2s. Estimated remaining: 31m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:32:17.534597] [INFO ] [MAIN      ] TRGP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:32:17.584955] [DEBUG] [LOCAL     ] TRGP: Loaded 51093 existing records from primary storage.
[2025-10-24T21:32:17.585247] [INFO ] [MAIN      ] TRGP: Loaded 51093 existing records.
[2025-10-24T21:32:17.757429] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-05.
[2025-10-24T21:32:17.762112] [WARN ] [MAIN      ] TRGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:32:17.763189] [INFO ] [MAIN      ] TRGP: Wiping existing primary data before full refresh.
[2025-10-24T21:32:17.763238] [INFO ] [LOCAL     ] TRGP: Starting deletion of primary data.
[2025-10-24T21:32:17.763818] [DEBUG] [LOCAL     ] TRGP: Deleted primary data file.
[2025-10-24T21:32:17.763875] [INFO ] [MAIN      ] TRGP: Starting full primary refresh.
[2025-10-24T21:32:18.053731] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-06 (1.11 seconds).
[2025-10-24T21:32:18.131838] [INFO ] [REMOTE    ] TRGP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:32:18.547630] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-04.
[2025-10-24T21:32:18.926965] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T21:32:19.347705] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-01.
[2025-10-24T21:32:20.147722] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-06.
[2025-10-24T21:32:20.675579] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-04 (2.13 seconds).
[2025-10-24T21:32:20.887688] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T21:32:20.947722] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-07.
[2025-10-24T21:32:21.010737] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T21:32:21.747685] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-05.
[2025-10-24T21:32:21.871996] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T21:32:22.547691] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-02.
[2025-10-24T21:32:23.347723] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-07.
[2025-10-24T21:32:23.473280] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T21:32:24.147634] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-08.
[2025-10-24T21:32:24.186005] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T21:32:24.213498] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-07 (0.87 seconds).
[2025-10-24T21:32:24.947636] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-03.
[2025-10-24T21:32:25.174246] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-08 (1.03 seconds).
[2025-10-24T21:32:25.747690] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-09.
[2025-10-24T21:32:26.547634] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-08.
[2025-10-24T21:32:26.712363] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T21:32:26.793153] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T21:32:27.347701] [INFO ] [REMOTE    ] TRC: Fetching primary data for 2025-10.
[2025-10-24T21:32:27.551277] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T21:32:28.153584] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-09.
[2025-10-24T21:32:28.155960] [INFO ] [REMOTE    ] TRC: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T21:32:28.161160] [INFO ] [REMOTE    ] TRC: Full fetch complete (21716 records).
[2025-10-24T21:32:28.161274] [DEBUG] [VALIDATOR ] TRC: Validating primary data.
[2025-10-24T21:32:28.542852] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present.
[2025-10-24T21:32:28.542958] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed.
[2025-10-24T21:32:28.543435] [INFO ] [MAIN      ] TRC: Fetched primary data is valid.
[2025-10-24T21:32:28.543488] [DEBUG] [LOCAL     ] TRC: Saving primary data.
[2025-10-24T21:32:28.543861] [FATAL] [LOCAL     ] TRC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:32:28.543955] [FATAL] [MAIN      ] TRC: Failed to save primary data.
[2025-10-24T21:32:28.544000] [WARN ] [MAIN      ] TRC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:32:28.544035] [INFO ] [LOCAL     ] TRC: Starting deletion of primary data.
[2025-10-24T21:32:28.544084] [DEBUG] [LOCAL     ] TRC: No primary data file found to delete.
[2025-10-24T21:32:28.544119] [INFO ] [LOCAL     ] TRC: Starting deletion of derivative data.
[2025-10-24T21:32:28.544269] [DEBUG] [LOCAL     ] TRC: Deleted derivative data file.
[2025-10-24T21:32:28.544344] [INFO ] [MAIN      ] Update Progress: 2122/2366 symbols completed. TRC took 27.3s. Estimated remaining: 31m 20s. Rate: 7.8 symbols/min
[2025-10-24T21:32:28.712810] [INFO ] [MAIN      ] TRN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:32:28.746514] [DEBUG] [LOCAL     ] TRN: Loaded 36448 existing records from primary storage.
[2025-10-24T21:32:28.746848] [INFO ] [MAIN      ] TRN: Loaded 36448 existing records.
[2025-10-24T21:32:28.922729] [WARN ] [MAIN      ] TRN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:32:28.922965] [INFO ] [MAIN      ] TRN: Wiping existing primary data before full refresh.
[2025-10-24T21:32:28.923011] [INFO ] [LOCAL     ] TRN: Starting deletion of primary data.
[2025-10-24T21:32:28.923385] [DEBUG] [LOCAL     ] TRN: Deleted primary data file.
[2025-10-24T21:32:28.923424] [INFO ] [MAIN      ] TRN: Starting full primary refresh.
[2025-10-24T21:32:28.952903] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-06.
[2025-10-24T21:32:29.287083] [INFO ] [REMOTE    ] TRN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:32:29.328131] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T21:32:29.747716] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-04.
[2025-10-24T21:32:30.547691] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-01.
[2025-10-24T21:32:30.692618] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-06 (1.74 seconds).
[2025-10-24T21:32:31.347700] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-07.
[2025-10-24T21:32:31.950184] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-04 (2.20 seconds).
[2025-10-24T21:32:32.131792] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-01 (1.58 seconds).
[2025-10-24T21:32:32.147615] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-02.
[2025-10-24T21:32:32.947637] [INFO ] [REMOTE    ] TR: Fetching primary data for 2025-10.
[2025-10-24T21:32:33.044522] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T21:32:33.664468] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T21:32:33.747678] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-05.
[2025-10-24T21:32:33.990947] [INFO ] [REMOTE    ] TR: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T21:32:33.994867] [INFO ] [REMOTE    ] TR: Full fetch complete (25572 records).
[2025-10-24T21:32:33.995003] [DEBUG] [VALIDATOR ] TR: Validating primary data.
[2025-10-24T21:32:34.371627] [DEBUG] [VALIDATOR ] TR: All expected trading days are present.
[2025-10-24T21:32:34.371730] [DEBUG] [VALIDATOR ] TR: Primary data validation passed.
[2025-10-24T21:32:34.372271] [INFO ] [MAIN      ] TR: Fetched primary data is valid.
[2025-10-24T21:32:34.372310] [DEBUG] [LOCAL     ] TR: Saving primary data.
[2025-10-24T21:32:34.372597] [FATAL] [LOCAL     ] TR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:32:34.372702] [FATAL] [MAIN      ] TR: Failed to save primary data.
[2025-10-24T21:32:34.372754] [WARN ] [MAIN      ] TR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:32:34.372818] [INFO ] [LOCAL     ] TR: Starting deletion of primary data.
[2025-10-24T21:32:34.372876] [DEBUG] [LOCAL     ] TR: No primary data file found to delete.
[2025-10-24T21:32:34.372913] [INFO ] [LOCAL     ] TR: Starting deletion of derivative data.
[2025-10-24T21:32:34.373101] [DEBUG] [LOCAL     ] TR: Deleted derivative data file.
[2025-10-24T21:32:34.373194] [INFO ] [MAIN      ] Update Progress: 2123/2366 symbols completed. TR took 33.2s. Estimated remaining: 31m 12s. Rate: 7.8 symbols/min
[2025-10-24T21:32:34.552395] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-03.
[2025-10-24T21:32:34.552331] [INFO ] [MAIN      ] TRNO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:32:34.593583] [DEBUG] [LOCAL     ] TRNO: Loaded 43908 existing records from primary storage.
[2025-10-24T21:32:34.593895] [INFO ] [MAIN      ] TRNO: Loaded 43908 existing records.
[2025-10-24T21:32:34.780067] [WARN ] [MAIN      ] TRNO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:32:34.780283] [INFO ] [MAIN      ] TRNO: Wiping existing primary data before full refresh.
[2025-10-24T21:32:34.780329] [INFO ] [LOCAL     ] TRNO: Starting deletion of primary data.
[2025-10-24T21:32:34.780619] [DEBUG] [LOCAL     ] TRNO: Deleted primary data file.
[2025-10-24T21:32:34.780699] [INFO ] [MAIN      ] TRNO: Starting full primary refresh.
[2025-10-24T21:32:35.157099] [INFO ] [REMOTE    ] TRNO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:32:35.347667] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-01.
[2025-10-24T21:32:35.491042] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T21:32:35.581147] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T21:32:36.147677] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-06.
[2025-10-24T21:32:36.843195] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T21:32:36.947747] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-02.
[2025-10-24T21:32:37.343238] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T21:32:37.747707] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-07.
[2025-10-24T21:32:38.417434] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-02 (1.47 seconds).
[2025-10-24T21:32:38.547629] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-03.
[2025-10-24T21:32:39.347697] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-04.
[2025-10-24T21:32:39.506831] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T21:32:40.128029] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-03 (1.58 seconds).
[2025-10-24T21:32:40.147619] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-08.
[2025-10-24T21:32:40.902500] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-04 (1.55 seconds).
[2025-10-24T21:32:40.947636] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-05.
[2025-10-24T21:32:41.747668] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-04.
[2025-10-24T21:32:41.906864] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T21:32:42.295619] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T21:32:42.547723] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-08.
[2025-10-24T21:32:43.194903] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T21:32:43.347711] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-05.
[2025-10-24T21:32:43.917143] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T21:32:44.147714] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-09.
[2025-10-24T21:32:44.930450] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T21:32:44.947625] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-06.
[2025-10-24T21:32:45.373349] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T21:32:45.747716] [INFO ] [REMOTE    ] TREX: Fetching primary data for 2025-10.
[2025-10-24T21:32:45.995229] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-06 (1.05 seconds).
[2025-10-24T21:32:46.547726] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-09.
[2025-10-24T21:32:47.208554] [INFO ] [REMOTE    ] TREX: Incremental fetch complete for 2025-10 (1.46 seconds).
[2025-10-24T21:32:47.218728] [INFO ] [REMOTE    ] TREX: Full fetch complete (71903 records).
[2025-10-24T21:32:47.218899] [DEBUG] [VALIDATOR ] TREX: Validating primary data.
[2025-10-24T21:32:47.361467] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-07.
[2025-10-24T21:32:47.644497] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present.
[2025-10-24T21:32:47.644619] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed.
[2025-10-24T21:32:47.645821] [INFO ] [MAIN      ] TREX: Fetched primary data is valid.
[2025-10-24T21:32:47.645900] [DEBUG] [LOCAL     ] TREX: Saving primary data.
[2025-10-24T21:32:47.646488] [FATAL] [LOCAL     ] TREX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:32:47.646598] [FATAL] [MAIN      ] TREX: Failed to save primary data.
[2025-10-24T21:32:47.646662] [WARN ] [MAIN      ] TREX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:32:47.646723] [INFO ] [LOCAL     ] TREX: Starting deletion of primary data.
[2025-10-24T21:32:47.646868] [DEBUG] [LOCAL     ] TREX: No primary data file found to delete.
[2025-10-24T21:32:47.646919] [INFO ] [LOCAL     ] TREX: Starting deletion of derivative data.
[2025-10-24T21:32:47.647552] [DEBUG] [LOCAL     ] TREX: Deleted derivative data file.
[2025-10-24T21:32:47.648070] [INFO ] [MAIN      ] Update Progress: 2124/2366 symbols completed. TREX took 46.4s. Estimated remaining: 31m 5s. Rate: 7.8 symbols/min
[2025-10-24T21:32:47.821802] [INFO ] [MAIN      ] TROX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:32:47.871886] [DEBUG] [LOCAL     ] TROX: Loaded 52582 existing records from primary storage.
[2025-10-24T21:32:47.872250] [INFO ] [MAIN      ] TROX: Loaded 52582 existing records.
[2025-10-24T21:32:48.058806] [WARN ] [MAIN      ] TROX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:32:48.059055] [INFO ] [MAIN      ] TROX: Wiping existing primary data before full refresh.
[2025-10-24T21:32:48.059133] [INFO ] [LOCAL     ] TROX: Starting deletion of primary data.
[2025-10-24T21:32:48.059585] [DEBUG] [LOCAL     ] TROX: Deleted primary data file.
[2025-10-24T21:32:48.059683] [INFO ] [MAIN      ] TROX: Starting full primary refresh.
[2025-10-24T21:32:48.158059] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-06.
[2025-10-24T21:32:48.410329] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-09 (1.86 seconds).
[2025-10-24T21:32:48.464428] [INFO ] [REMOTE    ] TROX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:32:48.947689] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-01.
[2025-10-24T21:32:49.033012] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T21:32:49.747721] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-08.
[2025-10-24T21:32:49.852045] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T21:32:50.452842] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T21:32:50.547737] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-07.
[2025-10-24T21:32:50.846486] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-08 (1.10 seconds).
[2025-10-24T21:32:51.347707] [INFO ] [REMOTE    ] TRGP: Fetching primary data for 2025-10.
[2025-10-24T21:32:52.137497] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-07 (1.59 seconds).
[2025-10-24T21:32:52.150826] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-09.
[2025-10-24T21:32:52.947718] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-02.
[2025-10-24T21:32:53.099768] [INFO ] [REMOTE    ] TRGP: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T21:32:53.112228] [INFO ] [REMOTE    ] TRGP: Full fetch complete (73601 records).
[2025-10-24T21:32:53.112415] [DEBUG] [VALIDATOR ] TRGP: Validating primary data.
[2025-10-24T21:32:53.506534] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present.
[2025-10-24T21:32:53.506664] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed.
[2025-10-24T21:32:53.508017] [INFO ] [MAIN      ] TRGP: Fetched primary data is valid.
[2025-10-24T21:32:53.508108] [DEBUG] [LOCAL     ] TRGP: Saving primary data.
[2025-10-24T21:32:53.508883] [FATAL] [LOCAL     ] TRGP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:32:53.509157] [FATAL] [MAIN      ] TRGP: Failed to save primary data.
[2025-10-24T21:32:53.509229] [WARN ] [MAIN      ] TRGP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:32:53.509299] [INFO ] [LOCAL     ] TRGP: Starting deletion of primary data.
[2025-10-24T21:32:53.529439] [DEBUG] [LOCAL     ] TRGP: No primary data file found to delete.
[2025-10-24T21:32:53.530255] [INFO ] [LOCAL     ] TRGP: Starting deletion of derivative data.
[2025-10-24T21:32:53.531115] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T21:32:53.538556] [DEBUG] [LOCAL     ] TRGP: Deleted derivative data file.
[2025-10-24T21:32:53.539541] [INFO ] [MAIN      ] Update Progress: 2125/2366 symbols completed. TRGP took 36.2s. Estimated remaining: 30m 57s. Rate: 7.8 symbols/min
[2025-10-24T21:32:53.716193] [INFO ] [MAIN      ] TRP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:32:53.747746] [INFO ] [REMOTE    ] TRN: Fetching primary data for 2025-10.
[2025-10-24T21:32:53.765877] [DEBUG] [LOCAL     ] TRP: Loaded 52516 existing records from primary storage.
[2025-10-24T21:32:53.766218] [INFO ] [MAIN      ] TRP: Loaded 52516 existing records.
[2025-10-24T21:32:53.942061] [WARN ] [MAIN      ] TRP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:32:53.942266] [INFO ] [MAIN      ] TRP: Wiping existing primary data before full refresh.
[2025-10-24T21:32:53.942313] [INFO ] [LOCAL     ] TRP: Starting deletion of primary data.
[2025-10-24T21:32:53.942982] [DEBUG] [LOCAL     ] TRP: Deleted primary data file.
[2025-10-24T21:32:53.943037] [INFO ] [MAIN      ] TRP: Starting full primary refresh.
[2025-10-24T21:32:54.315515] [INFO ] [REMOTE    ] TRP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:32:54.531482] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T21:32:54.547619] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-03.
[2025-10-24T21:32:55.185058] [INFO ] [REMOTE    ] TRN: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T21:32:55.191798] [INFO ] [REMOTE    ] TRN: Full fetch complete (52499 records).
[2025-10-24T21:32:55.191965] [DEBUG] [VALIDATOR ] TRN: Validating primary data.
[2025-10-24T21:32:55.354740] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-08.
[2025-10-24T21:32:55.586097] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present.
[2025-10-24T21:32:55.586212] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed.
[2025-10-24T21:32:55.588053] [INFO ] [MAIN      ] TRN: Fetched primary data is valid.
[2025-10-24T21:32:55.588120] [DEBUG] [LOCAL     ] TRN: Saving primary data.
[2025-10-24T21:32:55.588872] [FATAL] [LOCAL     ] TRN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:32:55.588968] [FATAL] [MAIN      ] TRN: Failed to save primary data.
[2025-10-24T21:32:55.589015] [WARN ] [MAIN      ] TRN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:32:55.589051] [INFO ] [LOCAL     ] TRN: Starting deletion of primary data.
[2025-10-24T21:32:55.589108] [DEBUG] [LOCAL     ] TRN: No primary data file found to delete.
[2025-10-24T21:32:55.589145] [INFO ] [LOCAL     ] TRN: Starting deletion of derivative data.
[2025-10-24T21:32:55.589346] [DEBUG] [LOCAL     ] TRN: Deleted derivative data file.
[2025-10-24T21:32:55.589477] [INFO ] [MAIN      ] Update Progress: 2126/2366 symbols completed. TRN took 27.0s. Estimated remaining: 30m 48s. Rate: 7.8 symbols/min
[2025-10-24T21:32:55.771087] [INFO ] [MAIN      ] TRTX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:32:55.812107] [DEBUG] [LOCAL     ] TRTX: Loaded 37134 existing records from primary storage.
[2025-10-24T21:32:55.812489] [INFO ] [MAIN      ] TRTX: Loaded 37134 existing records.
[2025-10-24T21:32:56.002872] [WARN ] [MAIN      ] TRTX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:32:56.003291] [INFO ] [MAIN      ] TRTX: Wiping existing primary data before full refresh.
[2025-10-24T21:32:56.003380] [INFO ] [LOCAL     ] TRTX: Starting deletion of primary data.
[2025-10-24T21:32:56.003856] [DEBUG] [LOCAL     ] TRTX: Deleted primary data file.
[2025-10-24T21:32:56.003916] [INFO ] [MAIN      ] TRTX: Starting full primary refresh.
[2025-10-24T21:32:56.163771] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-01.
[2025-10-24T21:32:56.411000] [INFO ] [REMOTE    ] TRTX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:32:56.447478] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T21:32:56.953100] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-01.
[2025-10-24T21:32:56.964529] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T21:32:57.747708] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-09.
[2025-10-24T21:32:58.170633] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-01 (2.01 seconds).
[2025-10-24T21:32:58.379063] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T21:32:58.547937] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-04.
[2025-10-24T21:32:59.189792] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T21:32:59.347710] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-02.
[2025-10-24T21:33:00.155902] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-02.
[2025-10-24T21:33:00.161870] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T21:33:00.364532] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T21:33:00.947684] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-03.
[2025-10-24T21:33:01.747818] [INFO ] [REMOTE    ] TRNO: Fetching primary data for 2025-10.
[2025-10-24T21:33:01.805674] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T21:33:02.452308] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-03 (1.50 seconds).
[2025-10-24T21:33:02.547751] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-04.
[2025-10-24T21:33:03.198083] [INFO ] [REMOTE    ] TRNO: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T21:33:03.206405] [INFO ] [REMOTE    ] TRNO: Full fetch complete (62713 records).
[2025-10-24T21:33:03.206578] [DEBUG] [VALIDATOR ] TRNO: Validating primary data.
[2025-10-24T21:33:03.352868] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-03.
[2025-10-24T21:33:03.600464] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present.
[2025-10-24T21:33:03.600565] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed.
[2025-10-24T21:33:03.601764] [INFO ] [MAIN      ] TRNO: Fetched primary data is valid.
[2025-10-24T21:33:03.601841] [DEBUG] [LOCAL     ] TRNO: Saving primary data.
[2025-10-24T21:33:03.602432] [FATAL] [LOCAL     ] TRNO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:33:03.602515] [FATAL] [MAIN      ] TRNO: Failed to save primary data.
[2025-10-24T21:33:03.602560] [WARN ] [MAIN      ] TRNO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:33:03.602596] [INFO ] [LOCAL     ] TRNO: Starting deletion of primary data.
[2025-10-24T21:33:03.602677] [DEBUG] [LOCAL     ] TRNO: No primary data file found to delete.
[2025-10-24T21:33:03.602735] [INFO ] [LOCAL     ] TRNO: Starting deletion of derivative data.
[2025-10-24T21:33:03.602920] [DEBUG] [LOCAL     ] TRNO: Deleted derivative data file.
[2025-10-24T21:33:03.603247] [INFO ] [MAIN      ] Update Progress: 2127/2366 symbols completed. TRNO took 29.2s. Estimated remaining: 30m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:33:03.772178] [INFO ] [MAIN      ] TRU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:33:03.822131] [DEBUG] [LOCAL     ] TRU: Loaded 51849 existing records from primary storage.
[2025-10-24T21:33:03.822435] [INFO ] [MAIN      ] TRU: Loaded 51849 existing records.
[2025-10-24T21:33:04.002810] [WARN ] [MAIN      ] TRU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:33:04.003149] [INFO ] [MAIN      ] TRU: Wiping existing primary data before full refresh.
[2025-10-24T21:33:04.003200] [INFO ] [LOCAL     ] TRU: Starting deletion of primary data.
[2025-10-24T21:33:04.004481] [DEBUG] [LOCAL     ] TRU: Deleted primary data file.
[2025-10-24T21:33:04.004540] [INFO ] [MAIN      ] TRU: Starting full primary refresh.
[2025-10-24T21:33:04.150326] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-05.
[2025-10-24T21:33:04.404421] [INFO ] [REMOTE    ] TRU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:33:04.419752] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T21:33:04.947738] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-01.
[2025-10-24T21:33:05.148326] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T21:33:05.613208] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T21:33:05.747687] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-04.
[2025-10-24T21:33:06.533527] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T21:33:06.547612] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-02.
[2025-10-24T21:33:07.347668] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-06.
[2025-10-24T21:33:07.407022] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T21:33:08.147693] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-05.
[2025-10-24T21:33:08.227093] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T21:33:08.947728] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-03.
[2025-10-24T21:33:09.006988] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T21:33:09.053175] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T21:33:09.747715] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-06.
[2025-10-24T21:33:10.421830] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T21:33:10.547670] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-04.
[2025-10-24T21:33:11.027560] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T21:33:11.347712] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-07.
[2025-10-24T21:33:12.147689] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-05.
[2025-10-24T21:33:12.377414] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T21:33:12.820114] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T21:33:12.947679] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-08.
[2025-10-24T21:33:13.503926] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-05 (1.36 seconds).
[2025-10-24T21:33:13.747638] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-06.
[2025-10-24T21:33:14.547707] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-07.
[2025-10-24T21:33:14.682903] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T21:33:15.347693] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-05.
[2025-10-24T21:33:15.465857] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T21:33:16.091433] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T21:33:16.147668] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-08.
[2025-10-24T21:33:16.947630] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-07.
[2025-10-24T21:33:17.351896] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T21:33:17.534336] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-08 (1.39 seconds).
[2025-10-24T21:33:17.747722] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-06.
[2025-10-24T21:33:18.547740] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-09.
[2025-10-24T21:33:18.752314] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-07 (1.80 seconds).
[2025-10-24T21:33:19.347765] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-08.
[2025-10-24T21:33:19.410295] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T21:33:20.003064] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-09 (1.46 seconds).
[2025-10-24T21:33:20.147627] [INFO ] [REMOTE    ] TRTX: Fetching primary data for 2025-10.
[2025-10-24T21:33:20.947676] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-07.
[2025-10-24T21:33:21.183596] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T21:33:21.545623] [INFO ] [REMOTE    ] TRTX: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T21:33:21.552259] [INFO ] [REMOTE    ] TRTX: Full fetch complete (52967 records).
[2025-10-24T21:33:21.552379] [DEBUG] [VALIDATOR ] TRTX: Validating primary data.
[2025-10-24T21:33:21.758016] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-09.
[2025-10-24T21:33:21.927189] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present.
[2025-10-24T21:33:21.927273] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed.
[2025-10-24T21:33:21.928542] [INFO ] [MAIN      ] TRTX: Fetched primary data is valid.
[2025-10-24T21:33:21.928605] [DEBUG] [LOCAL     ] TRTX: Saving primary data.
[2025-10-24T21:33:21.929184] [FATAL] [LOCAL     ] TRTX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:33:21.929270] [FATAL] [MAIN      ] TRTX: Failed to save primary data.
[2025-10-24T21:33:21.929312] [WARN ] [MAIN      ] TRTX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:33:21.929346] [INFO ] [LOCAL     ] TRTX: Starting deletion of primary data.
[2025-10-24T21:33:21.929397] [DEBUG] [LOCAL     ] TRTX: No primary data file found to delete.
[2025-10-24T21:33:21.929431] [INFO ] [LOCAL     ] TRTX: Starting deletion of derivative data.
[2025-10-24T21:33:21.929593] [DEBUG] [LOCAL     ] TRTX: Deleted derivative data file.
[2025-10-24T21:33:21.929699] [INFO ] [MAIN      ] Update Progress: 2128/2366 symbols completed. TRTX took 26.3s. Estimated remaining: 30m 34s. Rate: 7.8 symbols/min
[2025-10-24T21:33:22.098478] [INFO ] [MAIN      ] TRV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:33:22.141639] [DEBUG] [LOCAL     ] TRV: Loaded 47845 existing records from primary storage.
[2025-10-24T21:33:22.141977] [INFO ] [MAIN      ] TRV: Loaded 47845 existing records.
[2025-10-24T21:33:22.325213] [WARN ] [MAIN      ] TRV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:33:22.325613] [INFO ] [MAIN      ] TRV: Wiping existing primary data before full refresh.
[2025-10-24T21:33:22.325822] [INFO ] [LOCAL     ] TRV: Starting deletion of primary data.
[2025-10-24T21:33:22.327202] [DEBUG] [LOCAL     ] TRV: Deleted primary data file.
[2025-10-24T21:33:22.327265] [INFO ] [MAIN      ] TRV: Starting full primary refresh.
[2025-10-24T21:33:22.551213] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-09.
[2025-10-24T21:33:22.658300] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T21:33:22.747976] [INFO ] [REMOTE    ] TRV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:33:23.185381] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T21:33:23.347745] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-08.
[2025-10-24T21:33:24.147697] [INFO ] [REMOTE    ] TRP: Fetching primary data for 2025-10.
[2025-10-24T21:33:24.197754] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T21:33:24.913822] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T21:33:24.947671] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-09.
[2025-10-24T21:33:25.526328] [INFO ] [REMOTE    ] TRP: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T21:33:25.535996] [INFO ] [REMOTE    ] TRP: Full fetch complete (75779 records).
[2025-10-24T21:33:25.536149] [DEBUG] [VALIDATOR ] TRP: Validating primary data.
[2025-10-24T21:33:25.755691] [INFO ] [REMOTE    ] TROX: Fetching primary data for 2025-10.
[2025-10-24T21:33:25.949113] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present.
[2025-10-24T21:33:25.949217] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed.
[2025-10-24T21:33:25.950449] [INFO ] [MAIN      ] TRP: Fetched primary data is valid.
[2025-10-24T21:33:25.950520] [DEBUG] [LOCAL     ] TRP: Saving primary data.
[2025-10-24T21:33:25.951242] [FATAL] [LOCAL     ] TRP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:33:25.951342] [FATAL] [MAIN      ] TRP: Failed to save primary data.
[2025-10-24T21:33:25.951384] [WARN ] [MAIN      ] TRP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:33:25.951459] [INFO ] [LOCAL     ] TRP: Starting deletion of primary data.
[2025-10-24T21:33:25.951523] [DEBUG] [LOCAL     ] TRP: No primary data file found to delete.
[2025-10-24T21:33:25.951559] [INFO ] [LOCAL     ] TRP: Starting deletion of derivative data.
[2025-10-24T21:33:25.951757] [DEBUG] [LOCAL     ] TRP: Deleted derivative data file.
[2025-10-24T21:33:25.952039] [INFO ] [MAIN      ] Update Progress: 2129/2366 symbols completed. TRP took 32.4s. Estimated remaining: 30m 26s. Rate: 7.8 symbols/min
[2025-10-24T21:33:26.121986] [INFO ] [MAIN      ] TS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:33:26.173588] [DEBUG] [LOCAL     ] TS: Loaded 52030 existing records from primary storage.
[2025-10-24T21:33:26.173956] [INFO ] [MAIN      ] TS: Loaded 52030 existing records.
[2025-10-24T21:33:26.348509] [WARN ] [MAIN      ] TS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:33:26.348756] [INFO ] [MAIN      ] TS: Wiping existing primary data before full refresh.
[2025-10-24T21:33:26.348807] [INFO ] [LOCAL     ] TS: Starting deletion of primary data.
[2025-10-24T21:33:26.349754] [DEBUG] [LOCAL     ] TS: Deleted primary data file.
[2025-10-24T21:33:26.349811] [INFO ] [MAIN      ] TS: Starting full primary refresh.
[2025-10-24T21:33:26.552954] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-01.
[2025-10-24T21:33:26.715010] [INFO ] [REMOTE    ] TS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:33:26.747880] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-09 (1.80 seconds).
[2025-10-24T21:33:27.347736] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-01.
[2025-10-24T21:33:27.684102] [INFO ] [REMOTE    ] TROX: Incremental fetch complete for 2025-10 (1.93 seconds).
[2025-10-24T21:33:27.694133] [INFO ] [REMOTE    ] TROX: Full fetch complete (74173 records).
[2025-10-24T21:33:27.694249] [DEBUG] [VALIDATOR ] TROX: Validating primary data.
[2025-10-24T21:33:28.092105] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present.
[2025-10-24T21:33:28.092181] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed.
[2025-10-24T21:33:28.093323] [INFO ] [MAIN      ] TROX: Fetched primary data is valid.
[2025-10-24T21:33:28.093384] [DEBUG] [LOCAL     ] TROX: Saving primary data.
[2025-10-24T21:33:28.093985] [FATAL] [LOCAL     ] TROX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:33:28.094084] [FATAL] [MAIN      ] TROX: Failed to save primary data.
[2025-10-24T21:33:28.094125] [WARN ] [MAIN      ] TROX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:33:28.094181] [INFO ] [LOCAL     ] TROX: Starting deletion of primary data.
[2025-10-24T21:33:28.094232] [DEBUG] [LOCAL     ] TROX: No primary data file found to delete.
[2025-10-24T21:33:28.094276] [INFO ] [LOCAL     ] TROX: Starting deletion of derivative data.
[2025-10-24T21:33:28.094424] [DEBUG] [LOCAL     ] TROX: Deleted derivative data file.
[2025-10-24T21:33:28.094790] [INFO ] [MAIN      ] Update Progress: 2130/2366 symbols completed. TROX took 40.4s. Estimated remaining: 30m 18s. Rate: 7.8 symbols/min
[2025-10-24T21:33:28.158312] [INFO ] [REMOTE    ] TRU: Fetching primary data for 2025-10.
[2025-10-24T21:33:28.269291] [INFO ] [MAIN      ] TSE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:33:28.297254] [DEBUG] [LOCAL     ] TSE: Loaded 27989 existing records from primary storage.
[2025-10-24T21:33:28.297532] [INFO ] [MAIN      ] TSE: Loaded 27989 existing records.
[2025-10-24T21:33:28.479416] [WARN ] [MAIN      ] TSE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:33:28.479803] [INFO ] [MAIN      ] TSE: Wiping existing primary data before full refresh.
[2025-10-24T21:33:28.479873] [INFO ] [LOCAL     ] TSE: Starting deletion of primary data.
[2025-10-24T21:33:28.501365] [DEBUG] [LOCAL     ] TSE: Deleted primary data file.
[2025-10-24T21:33:28.504019] [INFO ] [MAIN      ] TSE: Starting full primary refresh.
[2025-10-24T21:33:28.550213] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-01 (2.00 seconds).
[2025-10-24T21:33:28.888893] [INFO ] [REMOTE    ] TSE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:33:28.947625] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-01.
[2025-10-24T21:33:29.037733] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-01 (1.69 seconds).
[2025-10-24T21:33:29.747693] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-02.
[2025-10-24T21:33:29.972822] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-01 (1.03 seconds).
[2025-10-24T21:33:30.128880] [INFO ] [REMOTE    ] TRU: Incremental fetch complete for 2025-10 (1.97 seconds).
[2025-10-24T21:33:30.138831] [INFO ] [REMOTE    ] TRU: Full fetch complete (74197 records).
[2025-10-24T21:33:30.138999] [DEBUG] [VALIDATOR ] TRU: Validating primary data.
[2025-10-24T21:33:30.531781] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present.
[2025-10-24T21:33:30.531895] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed.
[2025-10-24T21:33:30.533139] [INFO ] [MAIN      ] TRU: Fetched primary data is valid.
[2025-10-24T21:33:30.533202] [DEBUG] [LOCAL     ] TRU: Saving primary data.
[2025-10-24T21:33:30.533810] [FATAL] [LOCAL     ] TRU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:33:30.533902] [FATAL] [MAIN      ] TRU: Failed to save primary data.
[2025-10-24T21:33:30.533943] [WARN ] [MAIN      ] TRU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:33:30.533979] [INFO ] [LOCAL     ] TRU: Starting deletion of primary data.
[2025-10-24T21:33:30.534029] [DEBUG] [LOCAL     ] TRU: No primary data file found to delete.
[2025-10-24T21:33:30.534063] [INFO ] [LOCAL     ] TRU: Starting deletion of derivative data.
[2025-10-24T21:33:30.534236] [DEBUG] [LOCAL     ] TRU: Deleted derivative data file.
[2025-10-24T21:33:30.534926] [INFO ] [MAIN      ] Update Progress: 2131/2366 symbols completed. TRU took 26.9s. Estimated remaining: 30m 9s. Rate: 7.8 symbols/min
[2025-10-24T21:33:30.555482] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-02.
[2025-10-24T21:33:30.710268] [INFO ] [MAIN      ] TSI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:33:30.719724] [DEBUG] [LOCAL     ] TSI: Loaded 8234 existing records from primary storage.
[2025-10-24T21:33:30.719936] [INFO ] [MAIN      ] TSI: Loaded 8234 existing records.
[2025-10-24T21:33:30.897160] [WARN ] [MAIN      ] TSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:33:30.897440] [INFO ] [MAIN      ] TSI: Wiping existing primary data before full refresh.
[2025-10-24T21:33:30.897492] [INFO ] [LOCAL     ] TSI: Starting deletion of primary data.
[2025-10-24T21:33:30.897703] [DEBUG] [LOCAL     ] TSI: Deleted primary data file.
[2025-10-24T21:33:30.897758] [INFO ] [MAIN      ] TSI: Starting full primary refresh.
[2025-10-24T21:33:31.246774] [INFO ] [REMOTE    ] TSI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:33:31.347626] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-01.
[2025-10-24T21:33:31.461342] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-02 (1.71 seconds).
[2025-10-24T21:33:31.946918] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-01 (0.60 seconds).
[2025-10-24T21:33:32.147718] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-03.
[2025-10-24T21:33:32.407099] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T21:33:32.947721] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-03.
[2025-10-24T21:33:33.747750] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-02.
[2025-10-24T21:33:33.998444] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T21:33:34.377284] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-02 (0.63 seconds).
[2025-10-24T21:33:34.547686] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-04.
[2025-10-24T21:33:34.912836] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T21:33:35.347728] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-02.
[2025-10-24T21:33:36.147662] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-03.
[2025-10-24T21:33:36.651835] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T21:33:36.681776] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-04 (2.13 seconds).
[2025-10-24T21:33:36.947692] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-04.
[2025-10-24T21:33:37.112954] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T21:33:37.747700] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-04.
[2025-10-24T21:33:38.547756] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-05.
[2025-10-24T21:33:38.573973] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T21:33:38.993376] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-04 (2.05 seconds).
[2025-10-24T21:33:39.347745] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-05.
[2025-10-24T21:33:39.781955] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-05 (0.43 seconds).
[2025-10-24T21:33:39.814012] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-05 (1.27 seconds).
[2025-10-24T21:33:40.147732] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-06.
[2025-10-24T21:33:40.893423] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T21:33:40.947731] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-05.
[2025-10-24T21:33:41.747726] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-06.
[2025-10-24T21:33:42.547694] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-07.
[2025-10-24T21:33:42.767218] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T21:33:43.347670] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-06.
[2025-10-24T21:33:43.430916] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T21:33:43.466068] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-07 (0.92 seconds).
[2025-10-24T21:33:44.147678] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-07.
[2025-10-24T21:33:44.947693] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-03.
[2025-10-24T21:33:45.058157] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T21:33:45.747708] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-07.
[2025-10-24T21:33:45.852932] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-03 (0.91 seconds).
[2025-10-24T21:33:45.993341] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T21:33:46.547700] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-04.
[2025-10-24T21:33:47.347704] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-08.
[2025-10-24T21:33:47.565484] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T21:33:47.696348] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-04 (1.15 seconds).
[2025-10-24T21:33:48.107027] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-08 (0.76 seconds).
[2025-10-24T21:33:48.147621] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-05.
[2025-10-24T21:33:48.947734] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-08.
[2025-10-24T21:33:49.549960] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-05 (1.40 seconds).
[2025-10-24T21:33:49.747705] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-06.
[2025-10-24T21:33:50.547661] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-08.
[2025-10-24T21:33:50.659551] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T21:33:51.002628] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-06 (1.25 seconds).
[2025-10-24T21:33:51.347688] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-09.
[2025-10-24T21:33:52.117800] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T21:33:52.147691] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-09.
[2025-10-24T21:33:52.947711] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-07.
[2025-10-24T21:33:53.070028] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T21:33:53.103420] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-09 (0.96 seconds).
[2025-10-24T21:33:53.747682] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-09.
[2025-10-24T21:33:54.342386] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T21:33:54.547672] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-08.
[2025-10-24T21:33:55.141280] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T21:33:55.347625] [INFO ] [REMOTE    ] TRV: Fetching primary data for 2025-10.
[2025-10-24T21:33:55.822404] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T21:33:56.147697] [INFO ] [REMOTE    ] TSI: Fetching primary data for 2025-10.
[2025-10-24T21:33:56.896357] [INFO ] [REMOTE    ] TSI: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T21:33:56.899275] [INFO ] [REMOTE    ] TSI: Full fetch complete (13954 records).
[2025-10-24T21:33:56.899369] [DEBUG] [VALIDATOR ] TSI: Validating primary data.
[2025-10-24T21:33:56.954283] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-09.
[2025-10-24T21:33:57.292278] [INFO ] [REMOTE    ] TRV: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T21:33:57.301122] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present.
[2025-10-24T21:33:57.301215] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed.
[2025-10-24T21:33:57.301544] [INFO ] [MAIN      ] TSI: Fetched primary data is valid.
[2025-10-24T21:33:57.309927] [DEBUG] [LOCAL     ] TSI: Saving primary data.
[2025-10-24T21:33:57.310484] [FATAL] [LOCAL     ] TSI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:33:57.310564] [FATAL] [MAIN      ] TSI: Failed to save primary data.
[2025-10-24T21:33:57.310607] [WARN ] [MAIN      ] TSI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:33:57.310712] [INFO ] [LOCAL     ] TSI: Starting deletion of primary data.
[2025-10-24T21:33:57.310777] [DEBUG] [LOCAL     ] TSI: No primary data file found to delete.
[2025-10-24T21:33:57.310814] [INFO ] [LOCAL     ] TSI: Starting deletion of derivative data.
[2025-10-24T21:33:57.311101] [DEBUG] [LOCAL     ] TSI: Deleted derivative data file.
[2025-10-24T21:33:57.311202] [INFO ] [MAIN      ] Update Progress: 2132/2366 symbols completed. TSI took 26.8s. Estimated remaining: 30m 4s. Rate: 7.8 symbols/min
[2025-10-24T21:33:57.343026] [INFO ] [REMOTE    ] TRV: Full fetch complete (69992 records).
[2025-10-24T21:33:57.381448] [DEBUG] [VALIDATOR ] TRV: Validating primary data.
[2025-10-24T21:33:57.643402] [INFO ] [MAIN      ] TSLX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:33:57.752998] [INFO ] [REMOTE    ] TS: Fetching primary data for 2025-10.
[2025-10-24T21:33:57.895808] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present.
[2025-10-24T21:33:57.895896] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed.
[2025-10-24T21:33:57.897116] [INFO ] [MAIN      ] TRV: Fetched primary data is valid.
[2025-10-24T21:33:57.897206] [DEBUG] [LOCAL     ] TRV: Saving primary data.
[2025-10-24T21:33:57.897935] [FATAL] [LOCAL     ] TRV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:33:57.898034] [FATAL] [MAIN      ] TRV: Failed to save primary data.
[2025-10-24T21:33:57.898078] [WARN ] [MAIN      ] TRV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:33:57.898117] [INFO ] [LOCAL     ] TRV: Starting deletion of primary data.
[2025-10-24T21:33:57.898175] [DEBUG] [LOCAL     ] TRV: No primary data file found to delete.
[2025-10-24T21:33:57.898213] [INFO ] [LOCAL     ] TRV: Starting deletion of derivative data.
[2025-10-24T21:33:57.898500] [DEBUG] [LOCAL     ] TRV: Deleted derivative data file.
[2025-10-24T21:33:57.899193] [INFO ] [MAIN      ] Update Progress: 2133/2366 symbols completed. TRV took 36.0s. Estimated remaining: 29m 55s. Rate: 7.8 symbols/min
[2025-10-24T21:33:58.019388] [DEBUG] [LOCAL     ] TSLX: Loaded 36029 existing records from primary storage.
[2025-10-24T21:33:58.065008] [INFO ] [MAIN      ] TSLX: Loaded 36029 existing records.
[2025-10-24T21:33:58.122602] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T21:33:58.113814] [INFO ] [MAIN      ] TSM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:33:58.315492] [WARN ] [MAIN      ] TSLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:33:58.315884] [INFO ] [MAIN      ] TSLX: Wiping existing primary data before full refresh.
[2025-10-24T21:33:58.315947] [INFO ] [LOCAL     ] TSLX: Starting deletion of primary data.
[2025-10-24T21:33:58.316347] [DEBUG] [LOCAL     ] TSLX: Deleted primary data file.
[2025-10-24T21:33:58.316387] [INFO ] [MAIN      ] TSLX: Starting full primary refresh.
[2025-10-24T21:33:58.554402] [INFO ] [REMOTE    ] TSE: Fetching primary data for 2025-10.
[2025-10-24T21:33:58.554305] [DEBUG] [LOCAL     ] TSM: Loaded 54209 existing records from primary storage.
[2025-10-24T21:33:58.607766] [INFO ] [MAIN      ] TSM: Loaded 54209 existing records.
[2025-10-24T21:33:58.879616] [INFO ] [REMOTE    ] TSLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:33:58.919578] [WARN ] [MAIN      ] TSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:33:58.919850] [INFO ] [MAIN      ] TSM: Wiping existing primary data before full refresh.
[2025-10-24T21:33:58.919906] [INFO ] [LOCAL     ] TSM: Starting deletion of primary data.
[2025-10-24T21:33:58.921144] [DEBUG] [LOCAL     ] TSM: Deleted primary data file.
[2025-10-24T21:33:58.921203] [INFO ] [MAIN      ] TSM: Starting full primary refresh.
[2025-10-24T21:33:59.268585] [INFO ] [REMOTE    ] TSM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:33:59.347619] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-01.
[2025-10-24T21:33:59.609974] [INFO ] [REMOTE    ] TS: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T21:33:59.619980] [INFO ] [REMOTE    ] TS: Full fetch complete (74913 records).
[2025-10-24T21:33:59.620107] [DEBUG] [VALIDATOR ] TS: Validating primary data.
[2025-10-24T21:33:59.774045] [INFO ] [REMOTE    ] TSE: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T21:33:59.815487] [INFO ] [REMOTE    ] TSE: Full fetch complete (40896 records).
[2025-10-24T21:33:59.851102] [DEBUG] [VALIDATOR ] TSE: Validating primary data.
[2025-10-24T21:34:00.149477] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-01.
[2025-10-24T21:34:00.307447] [DEBUG] [VALIDATOR ] TS: All expected trading days are present.
[2025-10-24T21:34:00.346155] [DEBUG] [VALIDATOR ] TS: Primary data validation passed.
[2025-10-24T21:34:00.367550] [INFO ] [MAIN      ] TS: Fetched primary data is valid.
[2025-10-24T21:34:00.367741] [DEBUG] [LOCAL     ] TS: Saving primary data.
[2025-10-24T21:34:00.370529] [FATAL] [LOCAL     ] TS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:34:00.370724] [FATAL] [MAIN      ] TS: Failed to save primary data.
[2025-10-24T21:34:00.371120] [WARN ] [MAIN      ] TS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:34:00.381712] [INFO ] [LOCAL     ] TS: Starting deletion of primary data.
[2025-10-24T21:34:00.386944] [DEBUG] [LOCAL     ] TS: No primary data file found to delete.
[2025-10-24T21:34:00.397278] [INFO ] [LOCAL     ] TS: Starting deletion of derivative data.
[2025-10-24T21:34:00.431565] [DEBUG] [LOCAL     ] TS: Deleted derivative data file.
[2025-10-24T21:34:00.448681] [INFO ] [MAIN      ] Update Progress: 2134/2366 symbols completed. TS took 34.5s. Estimated remaining: 29m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:34:00.463146] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present.
[2025-10-24T21:34:00.494674] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed.
[2025-10-24T21:34:00.506321] [INFO ] [MAIN      ] TSE: Fetched primary data is valid.
[2025-10-24T21:34:00.532273] [DEBUG] [LOCAL     ] TSE: Saving primary data.
[2025-10-24T21:34:00.543598] [FATAL] [LOCAL     ] TSE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:34:00.543754] [FATAL] [MAIN      ] TSE: Failed to save primary data.
[2025-10-24T21:34:00.554313] [WARN ] [MAIN      ] TSE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:34:00.562290] [INFO ] [LOCAL     ] TSE: Starting deletion of primary data.
[2025-10-24T21:34:00.564683] [DEBUG] [LOCAL     ] TSE: No primary data file found to delete.
[2025-10-24T21:34:00.565045] [INFO ] [LOCAL     ] TSE: Starting deletion of derivative data.
[2025-10-24T21:34:00.575712] [DEBUG] [LOCAL     ] TSE: Deleted derivative data file.
[2025-10-24T21:34:00.586069] [INFO ] [MAIN      ] Update Progress: 2135/2366 symbols completed. TSE took 32.5s. Estimated remaining: 29m 39s. Rate: 7.8 symbols/min
[2025-10-24T21:34:00.726879] [INFO ] [MAIN      ] TSN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:34:00.809780] [INFO ] [MAIN      ] TSQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:34:00.836579] [DEBUG] [LOCAL     ] TSQ: Loaded 11726 existing records from primary storage.
[2025-10-24T21:34:00.836934] [INFO ] [MAIN      ] TSQ: Loaded 11726 existing records.
[2025-10-24T21:34:00.980763] [DEBUG] [LOCAL     ] TSN: Loaded 53474 existing records from primary storage.
[2025-10-24T21:34:01.003054] [INFO ] [MAIN      ] TSN: Loaded 53474 existing records.
[2025-10-24T21:34:01.099426] [WARN ] [MAIN      ] TSQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:34:01.111424] [INFO ] [MAIN      ] TSQ: Wiping existing primary data before full refresh.
[2025-10-24T21:34:01.141020] [INFO ] [LOCAL     ] TSQ: Starting deletion of primary data.
[2025-10-24T21:34:01.157344] [DEBUG] [LOCAL     ] TSQ: Deleted primary data file.
[2025-10-24T21:34:01.167769] [INFO ] [MAIN      ] TSQ: Starting full primary refresh.
[2025-10-24T21:34:01.266315] [WARN ] [MAIN      ] TSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:34:01.310445] [INFO ] [MAIN      ] TSN: Wiping existing primary data before full refresh.
[2025-10-24T21:34:01.349095] [INFO ] [LOCAL     ] TSN: Starting deletion of primary data.
[2025-10-24T21:34:01.366373] [DEBUG] [LOCAL     ] TSN: Deleted primary data file.
[2025-10-24T21:34:01.372130] [INFO ] [MAIN      ] TSN: Starting full primary refresh.
[2025-10-24T21:34:01.630922] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T21:34:01.668720] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-02.
[2025-10-24T21:34:01.922524] [INFO ] [REMOTE    ] TSQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:34:01.931165] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-01.
[2025-10-24T21:34:02.060464] [INFO ] [REMOTE    ] TSN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:34:02.100570] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-01 (2.75 seconds).
[2025-10-24T21:34:02.547733] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-02.
[2025-10-24T21:34:02.817354] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T21:34:02.989119] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-02 (1.32 seconds).
[2025-10-24T21:34:03.347639] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-03.
[2025-10-24T21:34:04.147689] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-01.
[2025-10-24T21:34:04.755266] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T21:34:04.947683] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-02.
[2025-10-24T21:34:05.190580] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-02 (2.64 seconds).
[2025-10-24T21:34:05.521683] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T21:34:05.734077] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T21:34:05.747613] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-03.
[2025-10-24T21:34:06.547773] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-02.
[2025-10-24T21:34:06.547699] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T21:34:07.347689] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-04.
[2025-10-24T21:34:08.107770] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T21:34:08.146868] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T21:34:08.156127] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-05.
[2025-10-24T21:34:08.947705] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-03.
[2025-10-24T21:34:09.178453] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T21:34:09.747689] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-06.
[2025-10-24T21:34:10.547724] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-03.
[2025-10-24T21:34:10.813922] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T21:34:11.347722] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-07.
[2025-10-24T21:34:11.787932] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-03 (2.84 seconds).
[2025-10-24T21:34:12.147745] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-04.
[2025-10-24T21:34:12.185371] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T21:34:12.281613] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T21:34:12.947710] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-04.
[2025-10-24T21:34:13.747732] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-04.
[2025-10-24T21:34:14.547635] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-08.
[2025-10-24T21:34:14.701583] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T21:34:14.764698] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T21:34:15.098978] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-04 (2.95 seconds).
[2025-10-24T21:34:15.295674] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-08 (0.75 seconds).
[2025-10-24T21:34:15.347628] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-05.
[2025-10-24T21:34:16.147692] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-09.
[2025-10-24T21:34:16.935850] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-09 (0.79 seconds).
[2025-10-24T21:34:16.947605] [INFO ] [REMOTE    ] TSQ: Fetching primary data for 2025-10.
[2025-10-24T21:34:17.656336] [INFO ] [REMOTE    ] TSQ: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T21:34:17.659315] [INFO ] [REMOTE    ] TSQ: Full fetch complete (16425 records).
[2025-10-24T21:34:17.659533] [DEBUG] [VALIDATOR ] TSQ: Validating primary data.
[2025-10-24T21:34:17.752816] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-05.
[2025-10-24T21:34:18.095929] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present.
[2025-10-24T21:34:18.096298] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed.
[2025-10-24T21:34:18.097344] [INFO ] [MAIN      ] TSQ: Fetched primary data is valid.
[2025-10-24T21:34:18.099718] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-05 (2.75 seconds).
[2025-10-24T21:34:18.099803] [DEBUG] [LOCAL     ] TSQ: Saving primary data.
[2025-10-24T21:34:18.113528] [FATAL] [LOCAL     ] TSQ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:34:18.114105] [FATAL] [MAIN      ] TSQ: Failed to save primary data.
[2025-10-24T21:34:18.114538] [WARN ] [MAIN      ] TSQ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:34:18.114621] [INFO ] [LOCAL     ] TSQ: Starting deletion of primary data.
[2025-10-24T21:34:18.114732] [DEBUG] [LOCAL     ] TSQ: No primary data file found to delete.
[2025-10-24T21:34:18.114778] [INFO ] [LOCAL     ] TSQ: Starting deletion of derivative data.
[2025-10-24T21:34:18.114949] [DEBUG] [LOCAL     ] TSQ: Deleted derivative data file.
[2025-10-24T21:34:18.115055] [INFO ] [MAIN      ] Update Progress: 2136/2366 symbols completed. TSQ took 17.5s. Estimated remaining: 29m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:34:18.284767] [INFO ] [MAIN      ] TT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:34:18.328046] [DEBUG] [LOCAL     ] TT: Loaded 47349 existing records from primary storage.
[2025-10-24T21:34:18.328330] [INFO ] [MAIN      ] TT: Loaded 47349 existing records.
[2025-10-24T21:34:18.504815] [WARN ] [MAIN      ] TT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:34:18.505017] [INFO ] [MAIN      ] TT: Wiping existing primary data before full refresh.
[2025-10-24T21:34:18.505063] [INFO ] [LOCAL     ] TT: Starting deletion of primary data.
[2025-10-24T21:34:18.506144] [DEBUG] [LOCAL     ] TT: Deleted primary data file.
[2025-10-24T21:34:18.506201] [INFO ] [MAIN      ] TT: Starting full primary refresh.
[2025-10-24T21:34:18.552950] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-05.
[2025-10-24T21:34:18.861290] [INFO ] [REMOTE    ] TT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:34:19.347794] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-01.
[2025-10-24T21:34:19.534280] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-05 (1.78 seconds).
[2025-10-24T21:34:20.103600] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T21:34:20.147681] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-06.
[2025-10-24T21:34:20.947689] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-06.
[2025-10-24T21:34:21.188884] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T21:34:21.747669] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-06.
[2025-10-24T21:34:22.073480] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-06 (1.93 seconds).
[2025-10-24T21:34:22.547629] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-07.
[2025-10-24T21:34:23.033237] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T21:34:23.347710] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-02.
[2025-10-24T21:34:23.569515] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-06 (2.62 seconds).
[2025-10-24T21:34:24.147733] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-07.
[2025-10-24T21:34:24.731765] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T21:34:24.764251] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-07 (2.22 seconds).
[2025-10-24T21:34:24.947716] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-08.
[2025-10-24T21:34:25.747723] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-03.
[2025-10-24T21:34:26.547637] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-07.
[2025-10-24T21:34:26.723669] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-07 (2.58 seconds).
[2025-10-24T21:34:26.882283] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T21:34:27.347757] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-09.
[2025-10-24T21:34:27.699474] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-03 (1.95 seconds).
[2025-10-24T21:34:27.768226] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-07 (1.22 seconds).
[2025-10-24T21:34:28.150054] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-08.
[2025-10-24T21:34:28.156239] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T21:34:28.947716] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-08.
[2025-10-24T21:34:29.516121] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T21:34:29.747696] [INFO ] [REMOTE    ] TSN: Fetching primary data for 2025-10.
[2025-10-24T21:34:30.547670] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-04.
[2025-10-24T21:34:31.347618] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-09.
[2025-10-24T21:34:31.453913] [INFO ] [REMOTE    ] TSN: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T21:34:31.463768] [INFO ] [REMOTE    ] TSN: Full fetch complete (76677 records).
[2025-10-24T21:34:31.463886] [DEBUG] [VALIDATOR ] TSN: Validating primary data.
[2025-10-24T21:34:31.859931] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present.
[2025-10-24T21:34:31.860039] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed.
[2025-10-24T21:34:31.861207] [INFO ] [MAIN      ] TSN: Fetched primary data is valid.
[2025-10-24T21:34:31.861286] [DEBUG] [LOCAL     ] TSN: Saving primary data.
[2025-10-24T21:34:31.861984] [FATAL] [LOCAL     ] TSN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:34:31.862069] [FATAL] [MAIN      ] TSN: Failed to save primary data.
[2025-10-24T21:34:31.862110] [WARN ] [MAIN      ] TSN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:34:31.862192] [INFO ] [LOCAL     ] TSN: Starting deletion of primary data.
[2025-10-24T21:34:31.862254] [DEBUG] [LOCAL     ] TSN: No primary data file found to delete.
[2025-10-24T21:34:31.862290] [INFO ] [LOCAL     ] TSN: Starting deletion of derivative data.
[2025-10-24T21:34:31.862452] [DEBUG] [LOCAL     ] TSN: Deleted derivative data file.
[2025-10-24T21:34:31.862783] [INFO ] [MAIN      ] Update Progress: 2137/2366 symbols completed. TSN took 31.4s. Estimated remaining: 29m 25s. Rate: 7.8 symbols/min
[2025-10-24T21:34:32.069227] [INFO ] [MAIN      ] TTAM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:34:32.066092] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-08 (3.12 seconds).
[2025-10-24T21:34:32.069426] [DEBUG] [LOCAL     ] TTAM: No existing data file found in primary storage.
[2025-10-24T21:34:32.079780] [WARN ] [MAIN      ] TTAM: No existing data found, performing full refresh instead.
[2025-10-24T21:34:32.080081] [INFO ] [MAIN      ] TTAM: Wiping existing primary data before full refresh.
[2025-10-24T21:34:32.080358] [INFO ] [LOCAL     ] TTAM: Starting deletion of primary data.
[2025-10-24T21:34:32.080532] [DEBUG] [LOCAL     ] TTAM: No primary data file found to delete.
[2025-10-24T21:34:32.080577] [INFO ] [MAIN      ] TTAM: Starting full primary refresh.
[2025-10-24T21:34:32.160526] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-09.
[2025-10-24T21:34:32.466166] [INFO ] [REMOTE    ] TTAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:34:32.549910] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-04 (2.00 seconds).
[2025-10-24T21:34:32.595245] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-09 (1.25 seconds).
[2025-10-24T21:34:32.947768] [INFO ] [REMOTE    ] TSLX: Fetching primary data for 2025-10.
[2025-10-24T21:34:33.747699] [INFO ] [REMOTE    ] TTAM: Fetching primary data for 2025-01.
[2025-10-24T21:34:33.936018] [DEBUG] [REMOTE    ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:34:33.936386] [WARN ] [REMOTE    ] TTAM: No data returned for month 2025-01
[2025-10-24T21:34:33.936488] [FATAL] [REMOTE    ] TTAM: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:34:33.936569] [FATAL] [MAIN      ] TTAM: Failed to fetch primary data.
[2025-10-24T21:34:33.936633] [WARN ] [MAIN      ] TTAM: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:34:33.936720] [INFO ] [LOCAL     ] TTAM: Starting deletion of primary data.
[2025-10-24T21:34:33.936780] [DEBUG] [LOCAL     ] TTAM: No primary data file found to delete.
[2025-10-24T21:34:33.936815] [INFO ] [LOCAL     ] TTAM: Starting deletion of derivative data.
[2025-10-24T21:34:33.936854] [DEBUG] [LOCAL     ] TTAM: No derivative data file found to delete.
[2025-10-24T21:34:33.936900] [INFO ] [MAIN      ] Update Progress: 2138/2366 symbols completed. TTAM took 2.1s. Estimated remaining: 29m 16s. Rate: 7.8 symbols/min
[2025-10-24T21:34:34.117219] [INFO ] [MAIN      ] TTC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:34:34.156353] [DEBUG] [LOCAL     ] TTC: Loaded 41771 existing records from primary storage.
[2025-10-24T21:34:34.156637] [INFO ] [MAIN      ] TTC: Loaded 41771 existing records.
[2025-10-24T21:34:34.337285] [WARN ] [MAIN      ] TTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:34:34.337838] [INFO ] [MAIN      ] TTC: Wiping existing primary data before full refresh.
[2025-10-24T21:34:34.337999] [INFO ] [LOCAL     ] TTC: Starting deletion of primary data.
[2025-10-24T21:34:34.338595] [DEBUG] [LOCAL     ] TTC: Deleted primary data file.
[2025-10-24T21:34:34.338672] [INFO ] [MAIN      ] TTC: Starting full primary refresh.
[2025-10-24T21:34:34.515977] [INFO ] [REMOTE    ] TSLX: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T21:34:34.547678] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-05.
[2025-10-24T21:34:34.619610] [INFO ] [REMOTE    ] TSLX: Full fetch complete (50934 records).
[2025-10-24T21:34:34.635796] [DEBUG] [VALIDATOR ] TSLX: Validating primary data.
[2025-10-24T21:34:34.862154] [INFO ] [REMOTE    ] TTC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:34:35.099470] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-09 (2.94 seconds).
[2025-10-24T21:34:35.179193] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present.
[2025-10-24T21:34:35.179271] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed.
[2025-10-24T21:34:35.180265] [INFO ] [MAIN      ] TSLX: Fetched primary data is valid.
[2025-10-24T21:34:35.180327] [DEBUG] [LOCAL     ] TSLX: Saving primary data.
[2025-10-24T21:34:35.180785] [FATAL] [LOCAL     ] TSLX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:34:35.180870] [FATAL] [MAIN      ] TSLX: Failed to save primary data.
[2025-10-24T21:34:35.180911] [WARN ] [MAIN      ] TSLX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:34:35.180945] [INFO ] [LOCAL     ] TSLX: Starting deletion of primary data.
[2025-10-24T21:34:35.181042] [DEBUG] [LOCAL     ] TSLX: No primary data file found to delete.
[2025-10-24T21:34:35.181083] [INFO ] [LOCAL     ] TSLX: Starting deletion of derivative data.
[2025-10-24T21:34:35.181241] [DEBUG] [LOCAL     ] TSLX: Deleted derivative data file.
[2025-10-24T21:34:35.181314] [INFO ] [MAIN      ] Update Progress: 2139/2366 symbols completed. TSLX took 37.9s. Estimated remaining: 29m 8s. Rate: 7.8 symbols/min
[2025-10-24T21:34:35.348107] [INFO ] [REMOTE    ] TSM: Fetching primary data for 2025-10.
[2025-10-24T21:34:35.348019] [INFO ] [MAIN      ] TTE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:34:35.398744] [DEBUG] [LOCAL     ] TTE: Loaded 51922 existing records from primary storage.
[2025-10-24T21:34:35.399095] [INFO ] [MAIN      ] TTE: Loaded 51922 existing records.
[2025-10-24T21:34:35.573936] [WARN ] [MAIN      ] TTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:34:35.574165] [INFO ] [MAIN      ] TTE: Wiping existing primary data before full refresh.
[2025-10-24T21:34:35.574210] [INFO ] [LOCAL     ] TTE: Starting deletion of primary data.
[2025-10-24T21:34:35.574988] [DEBUG] [LOCAL     ] TTE: Deleted primary data file.
[2025-10-24T21:34:35.575047] [INFO ] [MAIN      ] TTE: Starting full primary refresh.
[2025-10-24T21:34:35.916704] [INFO ] [REMOTE    ] TTE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:34:36.147747] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-01.
[2025-10-24T21:34:36.377256] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-05 (1.83 seconds).
[2025-10-24T21:34:36.947691] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-06.
[2025-10-24T21:34:37.627724] [INFO ] [REMOTE    ] TSM: Incremental fetch complete for 2025-10 (2.28 seconds).
[2025-10-24T21:34:37.640613] [INFO ] [REMOTE    ] TSM: Full fetch complete (77999 records).
[2025-10-24T21:34:37.640919] [DEBUG] [VALIDATOR ] TSM: Validating primary data.
[2025-10-24T21:34:37.752820] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-01.
[2025-10-24T21:34:38.117139] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-01 (1.97 seconds).
[2025-10-24T21:34:38.114782] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present.
[2025-10-24T21:34:38.128735] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed.
[2025-10-24T21:34:38.131002] [INFO ] [MAIN      ] TSM: Fetched primary data is valid.
[2025-10-24T21:34:38.131149] [DEBUG] [LOCAL     ] TSM: Saving primary data.
[2025-10-24T21:34:38.131938] [FATAL] [LOCAL     ] TSM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:34:38.132038] [FATAL] [MAIN      ] TSM: Failed to save primary data.
[2025-10-24T21:34:38.132081] [WARN ] [MAIN      ] TSM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:34:38.132128] [INFO ] [LOCAL     ] TSM: Starting deletion of primary data.
[2025-10-24T21:34:38.132199] [DEBUG] [LOCAL     ] TSM: No primary data file found to delete.
[2025-10-24T21:34:38.132239] [INFO ] [LOCAL     ] TSM: Starting deletion of derivative data.
[2025-10-24T21:34:38.132399] [DEBUG] [LOCAL     ] TSM: Deleted derivative data file.
[2025-10-24T21:34:38.132875] [INFO ] [MAIN      ] Update Progress: 2140/2366 symbols completed. TSM took 40.2s. Estimated remaining: 28m 60s. Rate: 7.8 symbols/min
[2025-10-24T21:34:38.397437] [INFO ] [MAIN      ] TTI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:34:38.462488] [DEBUG] [LOCAL     ] TTI: Loaded 47037 existing records from primary storage.
[2025-10-24T21:34:38.463479] [INFO ] [MAIN      ] TTI: Loaded 47037 existing records.
[2025-10-24T21:34:38.558703] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-02.
[2025-10-24T21:34:38.749848] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T21:34:38.756181] [WARN ] [MAIN      ] TTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:34:38.766127] [INFO ] [MAIN      ] TTI: Wiping existing primary data before full refresh.
[2025-10-24T21:34:38.766573] [INFO ] [LOCAL     ] TTI: Starting deletion of primary data.
[2025-10-24T21:34:38.767053] [DEBUG] [LOCAL     ] TTI: Deleted primary data file.
[2025-10-24T21:34:38.767113] [INFO ] [MAIN      ] TTI: Starting full primary refresh.
[2025-10-24T21:34:39.149591] [INFO ] [REMOTE    ] TTI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:34:39.172866] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T21:34:39.347631] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-07.
[2025-10-24T21:34:40.147708] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-01.
[2025-10-24T21:34:40.285946] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T21:34:40.947687] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-02.
[2025-10-24T21:34:41.159687] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T21:34:41.444266] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T21:34:41.747704] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-02.
[2025-10-24T21:34:42.547890] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-08.
[2025-10-24T21:34:42.547751] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T21:34:43.349589] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-03.
[2025-10-24T21:34:43.359978] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T21:34:44.147766] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-03.
[2025-10-24T21:34:44.253259] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T21:34:44.947746] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-09.
[2025-10-24T21:34:45.189556] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T21:34:45.747679] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-04.
[2025-10-24T21:34:45.877698] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T21:34:46.547709] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-03.
[2025-10-24T21:34:46.736677] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T21:34:47.347716] [INFO ] [REMOTE    ] TT: Fetching primary data for 2025-10.
[2025-10-24T21:34:47.628505] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-04 (1.88 seconds).
[2025-10-24T21:34:47.755410] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T21:34:48.147693] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-05.
[2025-10-24T21:34:48.842409] [INFO ] [REMOTE    ] TT: Incremental fetch complete for 2025-10 (1.49 seconds).
[2025-10-24T21:34:48.851415] [INFO ] [REMOTE    ] TT: Full fetch complete (69945 records).
[2025-10-24T21:34:48.851574] [DEBUG] [VALIDATOR ] TT: Validating primary data.
[2025-10-24T21:34:48.952581] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-04.
[2025-10-24T21:34:49.258965] [DEBUG] [VALIDATOR ] TT: All expected trading days are present.
[2025-10-24T21:34:49.259099] [DEBUG] [VALIDATOR ] TT: Primary data validation passed.
[2025-10-24T21:34:49.260982] [INFO ] [MAIN      ] TT: Fetched primary data is valid.
[2025-10-24T21:34:49.261055] [DEBUG] [LOCAL     ] TT: Saving primary data.
[2025-10-24T21:34:49.262104] [FATAL] [LOCAL     ] TT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:34:49.262233] [FATAL] [MAIN      ] TT: Failed to save primary data.
[2025-10-24T21:34:49.262278] [WARN ] [MAIN      ] TT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:34:49.262319] [INFO ] [LOCAL     ] TT: Starting deletion of primary data.
[2025-10-24T21:34:49.262387] [DEBUG] [LOCAL     ] TT: No primary data file found to delete.
[2025-10-24T21:34:49.262434] [INFO ] [LOCAL     ] TT: Starting deletion of derivative data.
[2025-10-24T21:34:49.262693] [DEBUG] [LOCAL     ] TT: Deleted derivative data file.
[2025-10-24T21:34:49.262855] [INFO ] [MAIN      ] Update Progress: 2141/2366 symbols completed. TT took 31.1s. Estimated remaining: 28m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:34:49.452966] [INFO ] [MAIN      ] TU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:34:49.506192] [DEBUG] [LOCAL     ] TU: Loaded 50129 existing records from primary storage.
[2025-10-24T21:34:49.506623] [INFO ] [MAIN      ] TU: Loaded 50129 existing records.
[2025-10-24T21:34:49.695362] [WARN ] [MAIN      ] TU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:34:49.695639] [INFO ] [MAIN      ] TU: Wiping existing primary data before full refresh.
[2025-10-24T21:34:49.695723] [INFO ] [LOCAL     ] TU: Starting deletion of primary data.
[2025-10-24T21:34:49.696194] [DEBUG] [LOCAL     ] TU: Deleted primary data file.
[2025-10-24T21:34:49.696235] [INFO ] [MAIN      ] TU: Starting full primary refresh.
[2025-10-24T21:34:49.752817] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-04.
[2025-10-24T21:34:50.078275] [INFO ] [REMOTE    ] TU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:34:50.111925] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-05 (1.96 seconds).
[2025-10-24T21:34:50.547686] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-06.
[2025-10-24T21:34:50.667890] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-04 (1.72 seconds).
[2025-10-24T21:34:51.220879] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T21:34:51.347719] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-05.
[2025-10-24T21:34:52.147688] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-05.
[2025-10-24T21:34:52.308941] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T21:34:52.947676] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-01.
[2025-10-24T21:34:52.993017] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T21:34:53.439035] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-05 (1.29 seconds).
[2025-10-24T21:34:53.747677] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-06.
[2025-10-24T21:34:54.547689] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-07.
[2025-10-24T21:34:54.848989] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-01 (1.90 seconds).
[2025-10-24T21:34:55.256001] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T21:34:55.347695] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-07.
[2025-10-24T21:34:56.147734] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-06.
[2025-10-24T21:34:56.415592] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-07 (1.87 seconds).
[2025-10-24T21:34:56.869608] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T21:34:56.947672] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-08.
[2025-10-24T21:34:57.533098] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-06 (1.39 seconds).
[2025-10-24T21:34:57.747689] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-07.
[2025-10-24T21:34:58.547636] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-08.
[2025-10-24T21:34:58.668366] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T21:34:59.301787] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T21:34:59.347674] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-08.
[2025-10-24T21:35:00.060189] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T21:35:00.147724] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-09.
[2025-10-24T21:35:00.876954] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T21:35:00.947681] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-02.
[2025-10-24T21:35:01.762726] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-09.
[2025-10-24T21:35:01.771130] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T21:35:02.547777] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-09.
[2025-10-24T21:35:02.760615] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T21:35:03.347671] [INFO ] [REMOTE    ] TTI: Fetching primary data for 2025-10.
[2025-10-24T21:35:03.388271] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-09 (1.63 seconds).
[2025-10-24T21:35:04.147705] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-03.
[2025-10-24T21:35:04.244283] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-09 (1.70 seconds).
[2025-10-24T21:35:04.948277] [INFO ] [REMOTE    ] TTI: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T21:35:04.948397] [INFO ] [REMOTE    ] TTE: Fetching primary data for 2025-10.
[2025-10-24T21:35:04.959745] [INFO ] [REMOTE    ] TTI: Full fetch complete (66607 records).
[2025-10-24T21:35:04.960042] [DEBUG] [VALIDATOR ] TTI: Validating primary data.
[2025-10-24T21:35:05.370249] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present.
[2025-10-24T21:35:05.370331] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed.
[2025-10-24T21:35:05.371428] [INFO ] [MAIN      ] TTI: Fetched primary data is valid.
[2025-10-24T21:35:05.371491] [DEBUG] [LOCAL     ] TTI: Saving primary data.
[2025-10-24T21:35:05.372031] [FATAL] [LOCAL     ] TTI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:35:05.372119] [FATAL] [MAIN      ] TTI: Failed to save primary data.
[2025-10-24T21:35:05.372160] [WARN ] [MAIN      ] TTI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:35:05.372195] [INFO ] [LOCAL     ] TTI: Starting deletion of primary data.
[2025-10-24T21:35:05.372247] [DEBUG] [LOCAL     ] TTI: No primary data file found to delete.
[2025-10-24T21:35:05.372282] [INFO ] [LOCAL     ] TTI: Starting deletion of derivative data.
[2025-10-24T21:35:05.372612] [DEBUG] [LOCAL     ] TTI: Deleted derivative data file.
[2025-10-24T21:35:05.373079] [INFO ] [MAIN      ] Update Progress: 2142/2366 symbols completed. TTI took 27.2s. Estimated remaining: 28m 46s. Rate: 7.8 symbols/min
[2025-10-24T21:35:05.543297] [INFO ] [MAIN      ] TUYA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:35:05.586932] [DEBUG] [LOCAL     ] TUYA: Loaded 46014 existing records from primary storage.
[2025-10-24T21:35:05.587230] [INFO ] [MAIN      ] TUYA: Loaded 46014 existing records.
[2025-10-24T21:35:05.752470] [INFO ] [REMOTE    ] TTC: Fetching primary data for 2025-10.
[2025-10-24T21:35:05.794911] [WARN ] [MAIN      ] TUYA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:35:05.795805] [INFO ] [MAIN      ] TUYA: Wiping existing primary data before full refresh.
[2025-10-24T21:35:05.795938] [INFO ] [LOCAL     ] TUYA: Starting deletion of primary data.
[2025-10-24T21:35:05.796598] [DEBUG] [LOCAL     ] TUYA: Deleted primary data file.
[2025-10-24T21:35:05.796705] [INFO ] [MAIN      ] TUYA: Starting full primary refresh.
[2025-10-24T21:35:05.914775] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T21:35:06.225862] [INFO ] [REMOTE    ] TUYA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:35:06.547770] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-01.
[2025-10-24T21:35:06.663096] [INFO ] [REMOTE    ] TTE: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T21:35:06.672899] [INFO ] [REMOTE    ] TTE: Full fetch complete (75024 records).
[2025-10-24T21:35:06.673084] [DEBUG] [VALIDATOR ] TTE: Validating primary data.
[2025-10-24T21:35:07.081030] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present.
[2025-10-24T21:35:07.081173] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed.
[2025-10-24T21:35:07.082471] [INFO ] [MAIN      ] TTE: Fetched primary data is valid.
[2025-10-24T21:35:07.082557] [DEBUG] [LOCAL     ] TTE: Saving primary data.
[2025-10-24T21:35:07.083280] [FATAL] [LOCAL     ] TTE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:35:07.083368] [FATAL] [MAIN      ] TTE: Failed to save primary data.
[2025-10-24T21:35:07.083436] [WARN ] [MAIN      ] TTE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:35:07.083506] [INFO ] [LOCAL     ] TTE: Starting deletion of primary data.
[2025-10-24T21:35:07.083568] [DEBUG] [LOCAL     ] TTE: No primary data file found to delete.
[2025-10-24T21:35:07.083613] [INFO ] [LOCAL     ] TTE: Starting deletion of derivative data.
[2025-10-24T21:35:07.083822] [DEBUG] [LOCAL     ] TTE: Deleted derivative data file.
[2025-10-24T21:35:07.084402] [INFO ] [MAIN      ] Update Progress: 2143/2366 symbols completed. TTE took 31.9s. Estimated remaining: 28m 37s. Rate: 7.8 symbols/min
[2025-10-24T21:35:07.260928] [INFO ] [MAIN      ] TV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:35:07.289214] [INFO ] [REMOTE    ] TTC: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T21:35:07.298565] [INFO ] [REMOTE    ] TTC: Full fetch complete (61742 records).
[2025-10-24T21:35:07.298882] [DEBUG] [VALIDATOR ] TTC: Validating primary data.
[2025-10-24T21:35:07.359016] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-04.
[2025-10-24T21:35:07.520158] [DEBUG] [LOCAL     ] TV: Loaded 41483 existing records from primary storage.
[2025-10-24T21:35:07.577112] [INFO ] [MAIN      ] TV: Loaded 41483 existing records.
[2025-10-24T21:35:07.956166] [WARN ] [MAIN      ] TV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:35:07.972055] [INFO ] [MAIN      ] TV: Wiping existing primary data before full refresh.
[2025-10-24T21:35:07.972167] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present.
[2025-10-24T21:35:07.972413] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed.
[2025-10-24T21:35:07.972600] [INFO ] [LOCAL     ] TV: Starting deletion of primary data.
[2025-10-24T21:35:07.974555] [INFO ] [MAIN      ] TTC: Fetched primary data is valid.
[2025-10-24T21:35:07.974679] [DEBUG] [LOCAL     ] TTC: Saving primary data.
[2025-10-24T21:35:07.975362] [DEBUG] [LOCAL     ] TV: Deleted primary data file.
[2025-10-24T21:35:07.975840] [INFO ] [MAIN      ] TV: Starting full primary refresh.
[2025-10-24T21:35:07.975727] [FATAL] [LOCAL     ] TTC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:35:07.998909] [FATAL] [MAIN      ] TTC: Failed to save primary data.
[2025-10-24T21:35:07.999046] [WARN ] [MAIN      ] TTC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:35:08.018962] [INFO ] [LOCAL     ] TTC: Starting deletion of primary data.
[2025-10-24T21:35:08.044803] [DEBUG] [LOCAL     ] TTC: No primary data file found to delete.
[2025-10-24T21:35:08.051585] [INFO ] [LOCAL     ] TTC: Starting deletion of derivative data.
[2025-10-24T21:35:08.062276] [DEBUG] [LOCAL     ] TTC: Deleted derivative data file.
[2025-10-24T21:35:08.063211] [INFO ] [MAIN      ] Update Progress: 2144/2366 symbols completed. TTC took 34.1s. Estimated remaining: 28m 29s. Rate: 7.8 symbols/min
[2025-10-24T21:35:08.465131] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T21:35:08.463199] [INFO ] [MAIN      ] TVC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:35:08.473317] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-02.
[2025-10-24T21:35:08.539081] [DEBUG] [LOCAL     ] TVC: Loaded 3123 existing records from primary storage.
[2025-10-24T21:35:08.555142] [INFO ] [MAIN      ] TVC: Loaded 3123 existing records.
[2025-10-24T21:35:08.558828] [INFO ] [REMOTE    ] TV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:35:08.738914] [WARN ] [MAIN      ] TVC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:35:08.739118] [INFO ] [MAIN      ] TVC: Wiping existing primary data before full refresh.
[2025-10-24T21:35:08.739166] [INFO ] [LOCAL     ] TVC: Starting deletion of primary data.
[2025-10-24T21:35:08.739301] [DEBUG] [LOCAL     ] TVC: Deleted primary data file.
[2025-10-24T21:35:08.739339] [INFO ] [MAIN      ] TVC: Starting full primary refresh.
[2025-10-24T21:35:08.957625] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-01.
[2025-10-24T21:35:09.101018] [INFO ] [REMOTE    ] TVC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:35:09.209681] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T21:35:09.747708] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-01.
[2025-10-24T21:35:10.170836] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T21:35:10.342435] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-01 (0.59 seconds).
[2025-10-24T21:35:10.389144] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T21:35:10.547690] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-02.
[2025-10-24T21:35:11.347711] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-03.
[2025-10-24T21:35:11.605607] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T21:35:12.147717] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-03.
[2025-10-24T21:35:12.947730] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-02.
[2025-10-24T21:35:13.056783] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T21:35:13.723861] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T21:35:13.756401] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-05.
[2025-10-24T21:35:13.764352] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T21:35:14.547762] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-04.
[2025-10-24T21:35:15.353470] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-03.
[2025-10-24T21:35:15.366573] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T21:35:15.972902] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T21:35:16.060967] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T21:35:16.147705] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-05.
[2025-10-24T21:35:16.947731] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-04.
[2025-10-24T21:35:17.747713] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-06.
[2025-10-24T21:35:17.877009] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T21:35:18.554615] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-06.
[2025-10-24T21:35:18.573278] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T21:35:19.315340] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T21:35:19.347691] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-07.
[2025-10-24T21:35:20.033244] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T21:35:20.147723] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-07.
[2025-10-24T21:35:20.911142] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-07 (1.56 seconds).
[2025-10-24T21:35:20.947683] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-08.
[2025-10-24T21:35:21.730315] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T21:35:21.747637] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-08.
[2025-10-24T21:35:22.548803] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-04.
[2025-10-24T21:35:22.551332] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T21:35:23.272810] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T21:35:23.318780] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-04 (0.77 seconds).
[2025-10-24T21:35:23.347623] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-05.
[2025-10-24T21:35:24.147706] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-09.
[2025-10-24T21:35:24.938600] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T21:35:24.947921] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-05.
[2025-10-24T21:35:25.535964] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-05 (0.59 seconds).
[2025-10-24T21:35:25.747710] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-09.
[2025-10-24T21:35:25.937904] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-09 (1.79 seconds).
[2025-10-24T21:35:26.547692] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-06.
[2025-10-24T21:35:27.148543] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T21:35:27.347635] [INFO ] [REMOTE    ] TUYA: Fetching primary data for 2025-10.
[2025-10-24T21:35:27.477039] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T21:35:28.147669] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-07.
[2025-10-24T21:35:28.658055] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-07 (0.51 seconds).
[2025-10-24T21:35:28.659285] [INFO ] [REMOTE    ] TUYA: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T21:35:28.669488] [INFO ] [REMOTE    ] TUYA: Full fetch complete (67042 records).
[2025-10-24T21:35:28.669606] [DEBUG] [VALIDATOR ] TUYA: Validating primary data.
[2025-10-24T21:35:28.952847] [INFO ] [REMOTE    ] TU: Fetching primary data for 2025-10.
[2025-10-24T21:35:29.056896] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present.
[2025-10-24T21:35:29.056970] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed.
[2025-10-24T21:35:29.058049] [INFO ] [MAIN      ] TUYA: Fetched primary data is valid.
[2025-10-24T21:35:29.058109] [DEBUG] [LOCAL     ] TUYA: Saving primary data.
[2025-10-24T21:35:29.058602] [FATAL] [LOCAL     ] TUYA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:35:29.058708] [FATAL] [MAIN      ] TUYA: Failed to save primary data.
[2025-10-24T21:35:29.058751] [WARN ] [MAIN      ] TUYA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:35:29.058786] [INFO ] [LOCAL     ] TUYA: Starting deletion of primary data.
[2025-10-24T21:35:29.058836] [DEBUG] [LOCAL     ] TUYA: No primary data file found to delete.
[2025-10-24T21:35:29.058871] [INFO ] [LOCAL     ] TUYA: Starting deletion of derivative data.
[2025-10-24T21:35:29.059029] [DEBUG] [LOCAL     ] TUYA: Deleted derivative data file.
[2025-10-24T21:35:29.059558] [INFO ] [MAIN      ] Update Progress: 2145/2366 symbols completed. TUYA took 23.7s. Estimated remaining: 28m 23s. Rate: 7.8 symbols/min
[2025-10-24T21:35:29.227077] [INFO ] [MAIN      ] TVE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:35:29.231282] [DEBUG] [LOCAL     ] TVE: Loaded 2559 existing records from primary storage.
[2025-10-24T21:35:29.231437] [INFO ] [MAIN      ] TVE: Loaded 2559 existing records.
[2025-10-24T21:35:29.410108] [WARN ] [MAIN      ] TVE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:35:29.410333] [INFO ] [MAIN      ] TVE: Wiping existing primary data before full refresh.
[2025-10-24T21:35:29.410381] [INFO ] [LOCAL     ] TVE: Starting deletion of primary data.
[2025-10-24T21:35:29.410510] [DEBUG] [LOCAL     ] TVE: Deleted primary data file.
[2025-10-24T21:35:29.410548] [INFO ] [MAIN      ] TVE: Starting full primary refresh.
[2025-10-24T21:35:29.756540] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-06.
[2025-10-24T21:35:29.762607] [INFO ] [REMOTE    ] TVE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:35:30.547698] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-01.
[2025-10-24T21:35:30.729227] [INFO ] [REMOTE    ] TU: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T21:35:30.738920] [INFO ] [REMOTE    ] TU: Full fetch complete (72818 records).
[2025-10-24T21:35:30.739047] [DEBUG] [VALIDATOR ] TU: Validating primary data.
[2025-10-24T21:35:31.140182] [DEBUG] [VALIDATOR ] TU: All expected trading days are present.
[2025-10-24T21:35:31.140278] [DEBUG] [VALIDATOR ] TU: Primary data validation passed.
[2025-10-24T21:35:31.141481] [INFO ] [MAIN      ] TU: Fetched primary data is valid.
[2025-10-24T21:35:31.143705] [DEBUG] [LOCAL     ] TU: Saving primary data.
[2025-10-24T21:35:31.145692] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-01 (0.60 seconds).
[2025-10-24T21:35:31.147351] [FATAL] [LOCAL     ] TU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:35:31.147468] [FATAL] [MAIN      ] TU: Failed to save primary data.
[2025-10-24T21:35:31.147535] [WARN ] [MAIN      ] TU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:35:31.147634] [INFO ] [LOCAL     ] TU: Starting deletion of primary data.
[2025-10-24T21:35:31.147749] [DEBUG] [LOCAL     ] TU: No primary data file found to delete.
[2025-10-24T21:35:31.147796] [INFO ] [LOCAL     ] TU: Starting deletion of derivative data.
[2025-10-24T21:35:31.147967] [DEBUG] [LOCAL     ] TU: Deleted derivative data file.
[2025-10-24T21:35:31.148276] [INFO ] [MAIN      ] Update Progress: 2146/2366 symbols completed. TU took 41.9s. Estimated remaining: 28m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:35:31.318493] [INFO ] [MAIN      ] TWI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:35:31.341165] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T21:35:31.349322] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-02.
[2025-10-24T21:35:31.377521] [DEBUG] [LOCAL     ] TWI: Loaded 34041 existing records from primary storage.
[2025-10-24T21:35:31.377851] [INFO ] [MAIN      ] TWI: Loaded 34041 existing records.
[2025-10-24T21:35:31.558335] [WARN ] [MAIN      ] TWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:35:31.558621] [INFO ] [MAIN      ] TWI: Wiping existing primary data before full refresh.
[2025-10-24T21:35:31.558704] [INFO ] [LOCAL     ] TWI: Starting deletion of primary data.
[2025-10-24T21:35:31.558995] [DEBUG] [LOCAL     ] TWI: Deleted primary data file.
[2025-10-24T21:35:31.559052] [INFO ] [MAIN      ] TWI: Starting full primary refresh.
[2025-10-24T21:35:31.922934] [INFO ] [REMOTE    ] TWI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:35:31.927516] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T21:35:32.147679] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-01.
[2025-10-24T21:35:32.947699] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-07.
[2025-10-24T21:35:33.600099] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T21:35:33.747679] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-03.
[2025-10-24T21:35:34.547687] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-08.
[2025-10-24T21:35:34.611393] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-03 (0.86 seconds).
[2025-10-24T21:35:34.611255] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T21:35:35.012863] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T21:35:35.347686] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-02.
[2025-10-24T21:35:36.147804] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-04.
[2025-10-24T21:35:36.717088] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-04 (0.57 seconds).
[2025-10-24T21:35:36.739285] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T21:35:36.947730] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-08.
[2025-10-24T21:35:37.747726] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-05.
[2025-10-24T21:35:38.093370] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-05 (0.35 seconds).
[2025-10-24T21:35:38.122882] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T21:35:38.547717] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-06.
[2025-10-24T21:35:39.128818] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T21:35:39.347726] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-03.
[2025-10-24T21:35:40.147737] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-09.
[2025-10-24T21:35:40.754987] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T21:35:40.889377] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T21:35:40.947677] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-04.
[2025-10-24T21:35:41.747709] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-07.
[2025-10-24T21:35:42.221094] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-07 (0.47 seconds).
[2025-10-24T21:35:42.434031] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T21:35:42.547639] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-05.
[2025-10-24T21:35:43.347687] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-09.
[2025-10-24T21:35:43.818015] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-05 (1.27 seconds).
[2025-10-24T21:35:44.147719] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-06.
[2025-10-24T21:35:44.857561] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T21:35:44.947678] [INFO ] [REMOTE    ] TV: Fetching primary data for 2025-10.
[2025-10-24T21:35:45.507348] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T21:35:45.747716] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-08.
[2025-10-24T21:35:46.236600] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-08 (0.49 seconds).
[2025-10-24T21:35:46.272615] [INFO ] [REMOTE    ] TV: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T21:35:46.280070] [INFO ] [REMOTE    ] TV: Full fetch complete (60749 records).
[2025-10-24T21:35:46.280230] [DEBUG] [VALIDATOR ] TV: Validating primary data.
[2025-10-24T21:35:46.554849] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-09.
[2025-10-24T21:35:46.876636] [DEBUG] [VALIDATOR ] TV: All expected trading days are present.
[2025-10-24T21:35:46.876789] [DEBUG] [VALIDATOR ] TV: Primary data validation passed.
[2025-10-24T21:35:46.879036] [INFO ] [MAIN      ] TV: Fetched primary data is valid.
[2025-10-24T21:35:46.879145] [DEBUG] [LOCAL     ] TV: Saving primary data.
[2025-10-24T21:35:46.879892] [FATAL] [LOCAL     ] TV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:35:46.880011] [FATAL] [MAIN      ] TV: Failed to save primary data.
[2025-10-24T21:35:46.880074] [WARN ] [MAIN      ] TV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:35:46.880132] [INFO ] [LOCAL     ] TV: Starting deletion of primary data.
[2025-10-24T21:35:46.880243] [DEBUG] [LOCAL     ] TV: No primary data file found to delete.
[2025-10-24T21:35:46.880317] [INFO ] [LOCAL     ] TV: Starting deletion of derivative data.
[2025-10-24T21:35:46.880554] [DEBUG] [LOCAL     ] TV: Deleted derivative data file.
[2025-10-24T21:35:46.881604] [INFO ] [MAIN      ] Update Progress: 2147/2366 symbols completed. TV took 39.8s. Estimated remaining: 28m 8s. Rate: 7.8 symbols/min
[2025-10-24T21:35:47.143296] [INFO ] [MAIN      ] TWLO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:35:47.212183] [DEBUG] [LOCAL     ] TWLO: Loaded 53169 existing records from primary storage.
[2025-10-24T21:35:47.212534] [INFO ] [MAIN      ] TWLO: Loaded 53169 existing records.
[2025-10-24T21:35:47.306955] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:35:47.352742] [INFO ] [REMOTE    ] TVC: Fetching primary data for 2025-10.
[2025-10-24T21:35:47.425260] [WARN ] [MAIN      ] TWLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:35:47.425512] [INFO ] [MAIN      ] TWLO: Wiping existing primary data before full refresh.
[2025-10-24T21:35:47.425573] [INFO ] [LOCAL     ] TWLO: Starting deletion of primary data.
[2025-10-24T21:35:47.426575] [DEBUG] [LOCAL     ] TWLO: Deleted primary data file.
[2025-10-24T21:35:47.426634] [INFO ] [MAIN      ] TWLO: Starting full primary refresh.
[2025-10-24T21:35:47.809224] [INFO ] [REMOTE    ] TWLO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:35:47.881880] [INFO ] [REMOTE    ] TVC: Incremental fetch complete for 2025-10 (0.53 seconds).
[2025-10-24T21:35:47.883284] [INFO ] [REMOTE    ] TVC: Full fetch complete (5000 records).
[2025-10-24T21:35:47.883374] [DEBUG] [VALIDATOR ] TVC: Validating primary data.
[2025-10-24T21:35:48.152861] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-01.
[2025-10-24T21:35:48.303194] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present.
[2025-10-24T21:35:48.303269] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed.
[2025-10-24T21:35:48.303428] [INFO ] [MAIN      ] TVC: Fetched primary data is valid.
[2025-10-24T21:35:48.303516] [DEBUG] [LOCAL     ] TVC: Saving primary data.
[2025-10-24T21:35:48.303761] [FATAL] [LOCAL     ] TVC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:35:48.303846] [FATAL] [MAIN      ] TVC: Failed to save primary data.
[2025-10-24T21:35:48.303888] [WARN ] [MAIN      ] TVC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:35:48.303923] [INFO ] [LOCAL     ] TVC: Starting deletion of primary data.
[2025-10-24T21:35:48.303972] [DEBUG] [LOCAL     ] TVC: No primary data file found to delete.
[2025-10-24T21:35:48.304007] [INFO ] [LOCAL     ] TVC: Starting deletion of derivative data.
[2025-10-24T21:35:48.304151] [DEBUG] [LOCAL     ] TVC: Deleted derivative data file.
[2025-10-24T21:35:48.304220] [INFO ] [MAIN      ] Update Progress: 2148/2366 symbols completed. TVC took 40.2s. Estimated remaining: 27m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:35:48.481710] [INFO ] [MAIN      ] TWN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:35:48.486338] [DEBUG] [LOCAL     ] TWN: Loaded 3242 existing records from primary storage.
[2025-10-24T21:35:48.486503] [INFO ] [MAIN      ] TWN: Loaded 3242 existing records.
[2025-10-24T21:35:48.664016] [WARN ] [MAIN      ] TWN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:35:48.664214] [INFO ] [MAIN      ] TWN: Wiping existing primary data before full refresh.
[2025-10-24T21:35:48.664258] [INFO ] [LOCAL     ] TWN: Starting deletion of primary data.
[2025-10-24T21:35:48.664387] [DEBUG] [LOCAL     ] TWN: Deleted primary data file.
[2025-10-24T21:35:48.664425] [INFO ] [MAIN      ] TWN: Starting full primary refresh.
[2025-10-24T21:35:48.952923] [INFO ] [REMOTE    ] TVE: Fetching primary data for 2025-10.
[2025-10-24T21:35:49.021920] [INFO ] [REMOTE    ] TWN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:35:49.475314] [INFO ] [REMOTE    ] TVE: Incremental fetch complete for 2025-10 (0.52 seconds).
[2025-10-24T21:35:49.476995] [INFO ] [REMOTE    ] TVE: Full fetch complete (4196 records).
[2025-10-24T21:35:49.477114] [DEBUG] [VALIDATOR ] TVE: Validating primary data.
[2025-10-24T21:35:49.752936] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-01.
[2025-10-24T21:35:49.863538] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present.
[2025-10-24T21:35:49.863616] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed.
[2025-10-24T21:35:49.863805] [INFO ] [MAIN      ] TVE: Fetched primary data is valid.
[2025-10-24T21:35:49.863862] [DEBUG] [LOCAL     ] TVE: Saving primary data.
[2025-10-24T21:35:49.864042] [FATAL] [LOCAL     ] TVE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:35:49.864120] [FATAL] [MAIN      ] TVE: Failed to save primary data.
[2025-10-24T21:35:49.864160] [WARN ] [MAIN      ] TVE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:35:49.864194] [INFO ] [LOCAL     ] TVE: Starting deletion of primary data.
[2025-10-24T21:35:49.864245] [DEBUG] [LOCAL     ] TVE: No primary data file found to delete.
[2025-10-24T21:35:49.864280] [INFO ] [LOCAL     ] TVE: Starting deletion of derivative data.
[2025-10-24T21:35:49.864422] [DEBUG] [LOCAL     ] TVE: Deleted derivative data file.
[2025-10-24T21:35:49.864532] [INFO ] [MAIN      ] Update Progress: 2149/2366 symbols completed. TVE took 20.8s. Estimated remaining: 27m 51s. Rate: 7.8 symbols/min
[2025-10-24T21:35:50.035698] [INFO ] [MAIN      ] TWO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:35:50.079558] [DEBUG] [LOCAL     ] TWO: Loaded 48886 existing records from primary storage.
[2025-10-24T21:35:50.079903] [INFO ] [MAIN      ] TWO: Loaded 48886 existing records.
[2025-10-24T21:35:50.258097] [WARN ] [MAIN      ] TWO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:35:50.258477] [INFO ] [MAIN      ] TWO: Wiping existing primary data before full refresh.
[2025-10-24T21:35:50.258551] [INFO ] [LOCAL     ] TWO: Starting deletion of primary data.
[2025-10-24T21:35:50.271440] [DEBUG] [LOCAL     ] TWO: Deleted primary data file.
[2025-10-24T21:35:50.291027] [INFO ] [MAIN      ] TWO: Starting full primary refresh.
[2025-10-24T21:35:50.362826] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-01 (2.21 seconds).
[2025-10-24T21:35:50.378833] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-01 (0.63 seconds).
[2025-10-24T21:35:50.552881] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-02.
[2025-10-24T21:35:50.671899] [INFO ] [REMOTE    ] TWO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:35:51.347689] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-07.
[2025-10-24T21:35:52.147695] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-02.
[2025-10-24T21:35:52.390172] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-02 (1.84 seconds).
[2025-10-24T21:35:52.702925] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T21:35:52.731243] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T21:35:52.947730] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-01.
[2025-10-24T21:35:53.747713] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-03.
[2025-10-24T21:35:54.485746] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T21:35:54.513943] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T21:35:54.547619] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-02.
[2025-10-24T21:35:55.347677] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-08.
[2025-10-24T21:35:55.955519] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T21:35:56.147723] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-04.
[2025-10-24T21:35:56.652506] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T21:35:56.865672] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T21:35:56.947625] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-09.
[2025-10-24T21:35:57.747713] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-03.
[2025-10-24T21:35:58.186261] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T21:35:58.547712] [INFO ] [REMOTE    ] TWI: Fetching primary data for 2025-10.
[2025-10-24T21:35:59.347757] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-05.
[2025-10-24T21:35:59.444267] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T21:35:59.740921] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-05 (0.39 seconds).
[2025-10-24T21:35:59.844558] [INFO ] [REMOTE    ] TWI: Incremental fetch complete for 2025-10 (1.30 seconds).
[2025-10-24T21:35:59.851264] [INFO ] [REMOTE    ] TWI: Full fetch complete (51946 records).
[2025-10-24T21:35:59.851402] [DEBUG] [VALIDATOR ] TWI: Validating primary data.
[2025-10-24T21:36:00.152864] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-06.
[2025-10-24T21:36:00.233316] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present.
[2025-10-24T21:36:00.233396] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed.
[2025-10-24T21:36:00.234335] [INFO ] [MAIN      ] TWI: Fetched primary data is valid.
[2025-10-24T21:36:00.234396] [DEBUG] [LOCAL     ] TWI: Saving primary data.
[2025-10-24T21:36:00.234834] [FATAL] [LOCAL     ] TWI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:36:00.234911] [FATAL] [MAIN      ] TWI: Failed to save primary data.
[2025-10-24T21:36:00.234952] [WARN ] [MAIN      ] TWI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:36:00.235034] [INFO ] [LOCAL     ] TWI: Starting deletion of primary data.
[2025-10-24T21:36:00.235092] [DEBUG] [LOCAL     ] TWI: No primary data file found to delete.
[2025-10-24T21:36:00.235127] [INFO ] [LOCAL     ] TWI: Starting deletion of derivative data.
[2025-10-24T21:36:00.235270] [DEBUG] [LOCAL     ] TWI: Deleted derivative data file.
[2025-10-24T21:36:00.235344] [INFO ] [MAIN      ] Update Progress: 2150/2366 symbols completed. TWI took 29.1s. Estimated remaining: 27m 43s. Rate: 7.8 symbols/min
[2025-10-24T21:36:00.401447] [INFO ] [MAIN      ] TWOD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:36:00.401638] [DEBUG] [LOCAL     ] TWOD: No existing data file found in primary storage.
[2025-10-24T21:36:00.401714] [WARN ] [MAIN      ] TWOD: No existing data found, performing full refresh instead.
[2025-10-24T21:36:00.401826] [INFO ] [MAIN      ] TWOD: Wiping existing primary data before full refresh.
[2025-10-24T21:36:00.401866] [INFO ] [LOCAL     ] TWOD: Starting deletion of primary data.
[2025-10-24T21:36:00.401907] [DEBUG] [LOCAL     ] TWOD: No primary data file found to delete.
[2025-10-24T21:36:00.401937] [INFO ] [MAIN      ] TWOD: Starting full primary refresh.
[2025-10-24T21:36:00.776614] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T21:36:00.784116] [INFO ] [REMOTE    ] TWOD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:36:00.947624] [INFO ] [REMOTE    ] TWOD: Fetching primary data for 2025-01.
[2025-10-24T21:36:01.173112] [DEBUG] [REMOTE    ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:36:01.173421] [WARN ] [REMOTE    ] TWOD: No data returned for month 2025-01
[2025-10-24T21:36:01.173514] [FATAL] [REMOTE    ] TWOD: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:36:01.173603] [FATAL] [MAIN      ] TWOD: Failed to fetch primary data.
[2025-10-24T21:36:01.173705] [WARN ] [MAIN      ] TWOD: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:36:01.173779] [INFO ] [LOCAL     ] TWOD: Starting deletion of primary data.
[2025-10-24T21:36:01.173856] [DEBUG] [LOCAL     ] TWOD: No primary data file found to delete.
[2025-10-24T21:36:01.174099] [INFO ] [LOCAL     ] TWOD: Starting deletion of derivative data.
[2025-10-24T21:36:01.174145] [DEBUG] [LOCAL     ] TWOD: No derivative data file found to delete.
[2025-10-24T21:36:01.174191] [INFO ] [MAIN      ] Update Progress: 2151/2366 symbols completed. TWOD took 0.9s. Estimated remaining: 27m 35s. Rate: 7.8 symbols/min
[2025-10-24T21:36:01.355939] [INFO ] [MAIN      ] TX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:36:01.379072] [DEBUG] [LOCAL     ] TX: Loaded 23300 existing records from primary storage.
[2025-10-24T21:36:01.379350] [INFO ] [MAIN      ] TX: Loaded 23300 existing records.
[2025-10-24T21:36:01.555600] [WARN ] [MAIN      ] TX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:36:01.555885] [INFO ] [MAIN      ] TX: Wiping existing primary data before full refresh.
[2025-10-24T21:36:01.555938] [INFO ] [LOCAL     ] TX: Starting deletion of primary data.
[2025-10-24T21:36:01.556477] [DEBUG] [LOCAL     ] TX: Deleted primary data file.
[2025-10-24T21:36:01.556518] [INFO ] [MAIN      ] TX: Starting full primary refresh.
[2025-10-24T21:36:01.752887] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-04.
[2025-10-24T21:36:01.924254] [INFO ] [REMOTE    ] TX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:36:02.547740] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-07.
[2025-10-24T21:36:03.094484] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-07 (0.55 seconds).
[2025-10-24T21:36:03.347703] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-01.
[2025-10-24T21:36:03.759205] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T21:36:04.147723] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-03.
[2025-10-24T21:36:04.528396] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T21:36:04.947720] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-02.
[2025-10-24T21:36:05.747754] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-05.
[2025-10-24T21:36:06.309864] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-03 (2.16 seconds).
[2025-10-24T21:36:06.367113] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-02 (1.42 seconds).
[2025-10-24T21:36:06.547754] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-04.
[2025-10-24T21:36:07.317172] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T21:36:07.347721] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-06.
[2025-10-24T21:36:08.147751] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-03.
[2025-10-24T21:36:08.498003] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-04 (1.95 seconds).
[2025-10-24T21:36:08.574536] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T21:36:08.947784] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-07.
[2025-10-24T21:36:09.621450] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T21:36:09.747748] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-04.
[2025-10-24T21:36:10.547764] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-08.
[2025-10-24T21:36:10.766817] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-07 (1.82 seconds).
[2025-10-24T21:36:10.928892] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-04 (1.18 seconds).
[2025-10-24T21:36:10.976270] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-08 (0.43 seconds).
[2025-10-24T21:36:11.347711] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-09.
[2025-10-24T21:36:11.932242] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-09 (0.58 seconds).
[2025-10-24T21:36:12.147707] [INFO ] [REMOTE    ] TWN: Fetching primary data for 2025-10.
[2025-10-24T21:36:12.748665] [INFO ] [REMOTE    ] TWN: Incremental fetch complete for 2025-10 (0.60 seconds).
[2025-10-24T21:36:12.750295] [INFO ] [REMOTE    ] TWN: Full fetch complete (5176 records).
[2025-10-24T21:36:12.750372] [DEBUG] [VALIDATOR ] TWN: Validating primary data.
[2025-10-24T21:36:12.952873] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-08.
[2025-10-24T21:36:13.127260] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present.
[2025-10-24T21:36:13.127342] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed.
[2025-10-24T21:36:13.127546] [INFO ] [MAIN      ] TWN: Fetched primary data is valid.
[2025-10-24T21:36:13.127608] [DEBUG] [LOCAL     ] TWN: Saving primary data.
[2025-10-24T21:36:13.127858] [FATAL] [LOCAL     ] TWN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:36:13.127940] [FATAL] [MAIN      ] TWN: Failed to save primary data.
[2025-10-24T21:36:13.127982] [WARN ] [MAIN      ] TWN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:36:13.128017] [INFO ] [LOCAL     ] TWN: Starting deletion of primary data.
[2025-10-24T21:36:13.128065] [DEBUG] [LOCAL     ] TWN: No primary data file found to delete.
[2025-10-24T21:36:13.128099] [INFO ] [LOCAL     ] TWN: Starting deletion of derivative data.
[2025-10-24T21:36:13.128267] [DEBUG] [LOCAL     ] TWN: Deleted derivative data file.
[2025-10-24T21:36:13.128361] [INFO ] [MAIN      ] Update Progress: 2152/2366 symbols completed. TWN took 24.8s. Estimated remaining: 27m 28s. Rate: 7.8 symbols/min
[2025-10-24T21:36:13.296830] [INFO ] [MAIN      ] TXNM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:36:13.337167] [DEBUG] [LOCAL     ] TXNM: Loaded 43114 existing records from primary storage.
[2025-10-24T21:36:13.337470] [INFO ] [MAIN      ] TXNM: Loaded 43114 existing records.
[2025-10-24T21:36:13.514811] [WARN ] [MAIN      ] TXNM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:36:13.515071] [INFO ] [MAIN      ] TXNM: Wiping existing primary data before full refresh.
[2025-10-24T21:36:13.515117] [INFO ] [LOCAL     ] TXNM: Starting deletion of primary data.
[2025-10-24T21:36:13.515782] [DEBUG] [LOCAL     ] TXNM: Deleted primary data file.
[2025-10-24T21:36:13.515842] [INFO ] [MAIN      ] TXNM: Starting full primary refresh.
[2025-10-24T21:36:13.755279] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-05.
[2025-10-24T21:36:13.878581] [INFO ] [REMOTE    ] TXNM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:36:14.547686] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-05.
[2025-10-24T21:36:14.874158] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-08 (1.92 seconds).
[2025-10-24T21:36:14.944867] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T21:36:15.347738] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-06.
[2025-10-24T21:36:16.147687] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-09.
[2025-10-24T21:36:16.417152] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T21:36:16.428499] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-06 (1.08 seconds).
[2025-10-24T21:36:16.947748] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-07.
[2025-10-24T21:36:17.747628] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-01.
[2025-10-24T21:36:17.931320] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T21:36:18.146870] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T21:36:18.547731] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-08.
[2025-10-24T21:36:19.279872] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T21:36:19.347693] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-06.
[2025-10-24T21:36:19.779873] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-08 (1.23 seconds).
[2025-10-24T21:36:20.147739] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-02.
[2025-10-24T21:36:20.947711] [INFO ] [REMOTE    ] TWO: Fetching primary data for 2025-10.
[2025-10-24T21:36:21.236070] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T21:36:21.576564] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T21:36:21.747720] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-03.
[2025-10-24T21:36:22.547718] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-09.
[2025-10-24T21:36:22.633295] [INFO ] [REMOTE    ] TWO: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T21:36:22.642441] [INFO ] [REMOTE    ] TWO: Full fetch complete (69272 records).
[2025-10-24T21:36:22.642606] [DEBUG] [VALIDATOR ] TWO: Validating primary data.
[2025-10-24T21:36:23.036988] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present.
[2025-10-24T21:36:23.037061] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed.
[2025-10-24T21:36:23.038200] [INFO ] [MAIN      ] TWO: Fetched primary data is valid.
[2025-10-24T21:36:23.038273] [DEBUG] [LOCAL     ] TWO: Saving primary data.
[2025-10-24T21:36:23.038814] [FATAL] [LOCAL     ] TWO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:36:23.038903] [FATAL] [MAIN      ] TWO: Failed to save primary data.
[2025-10-24T21:36:23.038945] [WARN ] [MAIN      ] TWO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:36:23.039024] [INFO ] [LOCAL     ] TWO: Starting deletion of primary data.
[2025-10-24T21:36:23.039084] [DEBUG] [LOCAL     ] TWO: No primary data file found to delete.
[2025-10-24T21:36:23.039118] [INFO ] [LOCAL     ] TWO: Starting deletion of derivative data.
[2025-10-24T21:36:23.039325] [DEBUG] [LOCAL     ] TWO: Deleted derivative data file.
[2025-10-24T21:36:23.039994] [INFO ] [MAIN      ] Update Progress: 2153/2366 symbols completed. TWO took 33.2s. Estimated remaining: 27m 20s. Rate: 7.8 symbols/min
[2025-10-24T21:36:23.214220] [INFO ] [MAIN      ] TXO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:36:23.235934] [DEBUG] [LOCAL     ] TXO: Loaded 20165 existing records from primary storage.
[2025-10-24T21:36:23.236184] [INFO ] [MAIN      ] TXO: Loaded 20165 existing records.
[2025-10-24T21:36:23.354682] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-07.
[2025-10-24T21:36:23.423841] [WARN ] [MAIN      ] TXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:36:23.424427] [INFO ] [MAIN      ] TXO: Wiping existing primary data before full refresh.
[2025-10-24T21:36:23.438827] [INFO ] [LOCAL     ] TXO: Starting deletion of primary data.
[2025-10-24T21:36:23.450691] [DEBUG] [LOCAL     ] TXO: Deleted primary data file.
[2025-10-24T21:36:23.450782] [INFO ] [MAIN      ] TXO: Starting full primary refresh.
[2025-10-24T21:36:23.521751] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T21:36:23.812347] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T21:36:23.858288] [INFO ] [REMOTE    ] TXO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:36:24.147673] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-04.
[2025-10-24T21:36:24.947708] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-01.
[2025-10-24T21:36:25.265442] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-07 (1.91 seconds).
[2025-10-24T21:36:25.351361] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T21:36:25.747636] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-05.
[2025-10-24T21:36:25.860697] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T21:36:26.547736] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-02.
[2025-10-24T21:36:27.288898] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T21:36:27.309844] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T21:36:27.347619] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-06.
[2025-10-24T21:36:28.147696] [INFO ] [REMOTE    ] TX: Fetching primary data for 2025-10.
[2025-10-24T21:36:28.786038] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T21:36:28.845396] [INFO ] [REMOTE    ] TX: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T21:36:28.849918] [INFO ] [REMOTE    ] TX: Full fetch complete (35432 records).
[2025-10-24T21:36:28.849998] [DEBUG] [VALIDATOR ] TX: Validating primary data.
[2025-10-24T21:36:28.953137] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-08.
[2025-10-24T21:36:29.230765] [DEBUG] [VALIDATOR ] TX: All expected trading days are present.
[2025-10-24T21:36:29.230838] [DEBUG] [VALIDATOR ] TX: Primary data validation passed.
[2025-10-24T21:36:29.231524] [INFO ] [MAIN      ] TX: Fetched primary data is valid.
[2025-10-24T21:36:29.231563] [DEBUG] [LOCAL     ] TX: Saving primary data.
[2025-10-24T21:36:29.231900] [FATAL] [LOCAL     ] TX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:36:29.231984] [FATAL] [MAIN      ] TX: Failed to save primary data.
[2025-10-24T21:36:29.232043] [WARN ] [MAIN      ] TX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:36:29.232078] [INFO ] [LOCAL     ] TX: Starting deletion of primary data.
[2025-10-24T21:36:29.232139] [DEBUG] [LOCAL     ] TX: No primary data file found to delete.
[2025-10-24T21:36:29.232194] [INFO ] [LOCAL     ] TX: Starting deletion of derivative data.
[2025-10-24T21:36:29.232354] [DEBUG] [LOCAL     ] TX: Deleted derivative data file.
[2025-10-24T21:36:29.232423] [INFO ] [MAIN      ] Update Progress: 2154/2366 symbols completed. TX took 28.1s. Estimated remaining: 27m 12s. Rate: 7.8 symbols/min
[2025-10-24T21:36:29.402775] [INFO ] [MAIN      ] TXT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:36:29.447202] [DEBUG] [LOCAL     ] TXT: Loaded 49899 existing records from primary storage.
[2025-10-24T21:36:29.447504] [INFO ] [MAIN      ] TXT: Loaded 49899 existing records.
[2025-10-24T21:36:29.627099] [WARN ] [MAIN      ] TXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:36:29.627281] [INFO ] [MAIN      ] TXT: Wiping existing primary data before full refresh.
[2025-10-24T21:36:29.627326] [INFO ] [LOCAL     ] TXT: Starting deletion of primary data.
[2025-10-24T21:36:29.627910] [DEBUG] [LOCAL     ] TXT: Deleted primary data file.
[2025-10-24T21:36:29.627967] [INFO ] [MAIN      ] TXT: Starting full primary refresh.
[2025-10-24T21:36:29.752851] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-07.
[2025-10-24T21:36:29.994006] [INFO ] [REMOTE    ] TXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:36:30.547715] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-03.
[2025-10-24T21:36:31.127419] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-08 (2.17 seconds).
[2025-10-24T21:36:31.341852] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-03 (0.79 seconds).
[2025-10-24T21:36:31.347616] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-04.
[2025-10-24T21:36:31.561606] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T21:36:32.124379] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T21:36:32.147619] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-05.
[2025-10-24T21:36:32.947717] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-01.
[2025-10-24T21:36:33.195697] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T21:36:33.747733] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-06.
[2025-10-24T21:36:34.547789] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-09.
[2025-10-24T21:36:34.694111] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T21:36:35.077832] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T21:36:35.347718] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-07.
[2025-10-24T21:36:36.147741] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-08.
[2025-10-24T21:36:36.340180] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T21:36:36.506329] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-09 (1.96 seconds).
[2025-10-24T21:36:36.947725] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-08.
[2025-10-24T21:36:37.544126] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T21:36:37.747751] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-02.
[2025-10-24T21:36:38.014296] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T21:36:38.547723] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-09.
[2025-10-24T21:36:39.347690] [INFO ] [REMOTE    ] TWLO: Fetching primary data for 2025-10.
[2025-10-24T21:36:39.415049] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T21:36:39.607955] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T21:36:40.147749] [INFO ] [REMOTE    ] TXO: Fetching primary data for 2025-10.
[2025-10-24T21:36:40.947767] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-03.
[2025-10-24T21:36:41.175390] [INFO ] [REMOTE    ] TXO: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T21:36:41.181405] [INFO ] [REMOTE    ] TXO: Full fetch complete (27314 records).
[2025-10-24T21:36:41.181574] [DEBUG] [VALIDATOR ] TXO: Validating primary data.
[2025-10-24T21:36:41.504400] [INFO ] [REMOTE    ] TWLO: Incremental fetch complete for 2025-10 (2.16 seconds).
[2025-10-24T21:36:41.553503] [INFO ] [REMOTE    ] TWLO: Full fetch complete (76584 records).
[2025-10-24T21:36:41.569267] [DEBUG] [VALIDATOR ] TWLO: Validating primary data.
[2025-10-24T21:36:41.749789] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-09.
[2025-10-24T21:36:41.763313] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present.
[2025-10-24T21:36:41.788591] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed.
[2025-10-24T21:36:41.790597] [INFO ] [MAIN      ] TXO: Fetched primary data is valid.
[2025-10-24T21:36:41.807442] [DEBUG] [LOCAL     ] TXO: Saving primary data.
[2025-10-24T21:36:41.819094] [FATAL] [LOCAL     ] TXO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:36:41.837307] [FATAL] [MAIN      ] TXO: Failed to save primary data.
[2025-10-24T21:36:41.848706] [WARN ] [MAIN      ] TXO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:36:41.861600] [INFO ] [LOCAL     ] TXO: Starting deletion of primary data.
[2025-10-24T21:36:41.909361] [DEBUG] [LOCAL     ] TXO: No primary data file found to delete.
[2025-10-24T21:36:41.982694] [INFO ] [LOCAL     ] TXO: Starting deletion of derivative data.
[2025-10-24T21:36:42.006762] [DEBUG] [LOCAL     ] TXO: Deleted derivative data file.
[2025-10-24T21:36:42.019720] [INFO ] [MAIN      ] Update Progress: 2155/2366 symbols completed. TXO took 19.0s. Estimated remaining: 27m 5s. Rate: 7.8 symbols/min
[2025-10-24T21:36:42.344964] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present.
[2025-10-24T21:36:42.345075] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed.
[2025-10-24T21:36:42.344729] [INFO ] [MAIN      ] TY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:36:42.347556] [INFO ] [MAIN      ] TWLO: Fetched primary data is valid.
[2025-10-24T21:36:42.348131] [DEBUG] [LOCAL     ] TWLO: Saving primary data.
[2025-10-24T21:36:42.350160] [FATAL] [LOCAL     ] TWLO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:36:42.350536] [FATAL] [MAIN      ] TWLO: Failed to save primary data.
[2025-10-24T21:36:42.350619] [WARN ] [MAIN      ] TWLO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:36:42.350728] [INFO ] [LOCAL     ] TWLO: Starting deletion of primary data.
[2025-10-24T21:36:42.350813] [DEBUG] [LOCAL     ] TWLO: No primary data file found to delete.
[2025-10-24T21:36:42.350856] [INFO ] [LOCAL     ] TWLO: Starting deletion of derivative data.
[2025-10-24T21:36:42.351246] [DEBUG] [LOCAL     ] TWLO: Deleted derivative data file.
[2025-10-24T21:36:42.351760] [INFO ] [MAIN      ] Update Progress: 2156/2366 symbols completed. TWLO took 55.5s. Estimated remaining: 26m 57s. Rate: 7.8 symbols/min
[2025-10-24T21:36:42.465713] [DEBUG] [LOCAL     ] TY: Loaded 7553 existing records from primary storage.
[2025-10-24T21:36:42.466437] [INFO ] [MAIN      ] TY: Loaded 7553 existing records.
[2025-10-24T21:36:42.602956] [INFO ] [MAIN      ] TYG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:36:42.757334] [WARN ] [MAIN      ] TY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:36:42.758468] [INFO ] [MAIN      ] TY: Wiping existing primary data before full refresh.
[2025-10-24T21:36:42.763821] [DEBUG] [LOCAL     ] TYG: Loaded 14093 existing records from primary storage.
[2025-10-24T21:36:42.764125] [INFO ] [MAIN      ] TYG: Loaded 14093 existing records.
[2025-10-24T21:36:42.764190] [INFO ] [LOCAL     ] TY: Starting deletion of primary data.
[2025-10-24T21:36:42.834543] [DEBUG] [LOCAL     ] TY: Deleted primary data file.
[2025-10-24T21:36:42.850434] [INFO ] [MAIN      ] TY: Starting full primary refresh.
[2025-10-24T21:36:43.102436] [WARN ] [MAIN      ] TYG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:36:43.107562] [INFO ] [MAIN      ] TYG: Wiping existing primary data before full refresh.
[2025-10-24T21:36:43.106945] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-03 (2.16 seconds).
[2025-10-24T21:36:43.107877] [INFO ] [LOCAL     ] TYG: Starting deletion of primary data.
[2025-10-24T21:36:43.123713] [DEBUG] [LOCAL     ] TYG: Deleted primary data file.
[2025-10-24T21:36:43.130427] [INFO ] [MAIN      ] TYG: Starting full primary refresh.
[2025-10-24T21:36:43.171075] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-04.
[2025-10-24T21:36:43.442549] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T21:36:43.530887] [INFO ] [REMOTE    ] TXNM: Fetching primary data for 2025-10.
[2025-10-24T21:36:43.725201] [INFO ] [REMOTE    ] TY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:36:43.846212] [INFO ] [REMOTE    ] TYG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:36:44.147708] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-01.
[2025-10-24T21:36:44.947721] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-01.
[2025-10-24T21:36:45.069701] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T21:36:45.191253] [INFO ] [REMOTE    ] TXNM: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T21:36:45.213870] [INFO ] [REMOTE    ] TXNM: Full fetch complete (62715 records).
[2025-10-24T21:36:45.215976] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-04 (2.04 seconds).
[2025-10-24T21:36:45.226713] [DEBUG] [VALIDATOR ] TXNM: Validating primary data.
[2025-10-24T21:36:45.645660] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present.
[2025-10-24T21:36:45.645784] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed.
[2025-10-24T21:36:45.647461] [INFO ] [MAIN      ] TXNM: Fetched primary data is valid.
[2025-10-24T21:36:45.647538] [DEBUG] [LOCAL     ] TXNM: Saving primary data.
[2025-10-24T21:36:45.648467] [FATAL] [LOCAL     ] TXNM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:36:45.648566] [FATAL] [MAIN      ] TXNM: Failed to save primary data.
[2025-10-24T21:36:45.648615] [WARN ] [MAIN      ] TXNM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:36:45.648718] [INFO ] [LOCAL     ] TXNM: Starting deletion of primary data.
[2025-10-24T21:36:45.648788] [DEBUG] [LOCAL     ] TXNM: No primary data file found to delete.
[2025-10-24T21:36:45.648824] [INFO ] [LOCAL     ] TXNM: Starting deletion of derivative data.
[2025-10-24T21:36:45.649037] [DEBUG] [LOCAL     ] TXNM: Deleted derivative data file.
[2025-10-24T21:36:45.649615] [INFO ] [MAIN      ] Update Progress: 2157/2366 symbols completed. TXNM took 32.5s. Estimated remaining: 26m 49s. Rate: 7.8 symbols/min
[2025-10-24T21:36:45.747678] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-02.
[2025-10-24T21:36:45.758906] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T21:36:46.547678] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-02.
[2025-10-24T21:36:46.813139] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-02 (1.07 seconds).
[2025-10-24T21:36:47.298572] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T21:36:47.347677] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-03.
[2025-10-24T21:36:48.147712] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-05.
[2025-10-24T21:36:48.327505] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T21:36:48.947704] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-04.
[2025-10-24T21:36:49.747676] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-03.
[2025-10-24T21:36:49.911260] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-05 (1.76 seconds).
[2025-10-24T21:36:49.932817] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-04 (0.99 seconds).
[2025-10-24T21:36:50.486945] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-03 (0.74 seconds).
[2025-10-24T21:36:50.547741] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-05.
[2025-10-24T21:36:51.347705] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-04.
[2025-10-24T21:36:51.522376] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-05 (0.97 seconds).
[2025-10-24T21:36:52.130744] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-04 (0.78 seconds).
[2025-10-24T21:36:52.147677] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-05.
[2025-10-24T21:36:52.947045] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-05 (0.80 seconds).
[2025-10-24T21:36:52.949309] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-06.
[2025-10-24T21:36:53.747756] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-06.
[2025-10-24T21:36:54.522033] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T21:36:54.547667] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-07.
[2025-10-24T21:36:54.639476] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T21:36:55.347711] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-06.
[2025-10-24T21:36:55.851413] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T21:36:56.147728] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-07.
[2025-10-24T21:36:56.316527] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T21:36:56.947708] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-07.
[2025-10-24T21:36:57.747690] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-08.
[2025-10-24T21:36:57.950970] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T21:36:58.000558] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T21:36:58.526221] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T21:36:58.547620] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-09.
[2025-10-24T21:36:59.276597] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T21:36:59.347702] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-08.
[2025-10-24T21:37:00.147722] [INFO ] [REMOTE    ] TY: Fetching primary data for 2025-10.
[2025-10-24T21:37:00.235856] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-08 (0.89 seconds).
[2025-10-24T21:37:00.686577] [INFO ] [REMOTE    ] TY: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T21:37:00.689242] [INFO ] [REMOTE    ] TY: Full fetch complete (11277 records).
[2025-10-24T21:37:00.689423] [DEBUG] [VALIDATOR ] TY: Validating primary data.
[2025-10-24T21:37:00.957387] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-08.
[2025-10-24T21:37:01.095189] [DEBUG] [VALIDATOR ] TY: All expected trading days are present.
[2025-10-24T21:37:01.095339] [DEBUG] [VALIDATOR ] TY: Primary data validation passed.
[2025-10-24T21:37:01.095909] [INFO ] [MAIN      ] TY: Fetched primary data is valid.
[2025-10-24T21:37:01.095976] [DEBUG] [LOCAL     ] TY: Saving primary data.
[2025-10-24T21:37:01.096307] [FATAL] [LOCAL     ] TY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:37:01.096436] [FATAL] [MAIN      ] TY: Failed to save primary data.
[2025-10-24T21:37:01.096479] [WARN ] [MAIN      ] TY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:37:01.096515] [INFO ] [LOCAL     ] TY: Starting deletion of primary data.
[2025-10-24T21:37:01.096576] [DEBUG] [LOCAL     ] TY: No primary data file found to delete.
[2025-10-24T21:37:01.096637] [INFO ] [LOCAL     ] TY: Starting deletion of derivative data.
[2025-10-24T21:37:01.097016] [DEBUG] [LOCAL     ] TY: Deleted derivative data file.
[2025-10-24T21:37:01.097123] [INFO ] [MAIN      ] Update Progress: 2158/2366 symbols completed. TY took 19.1s. Estimated remaining: 26m 42s. Rate: 7.8 symbols/min
[2025-10-24T21:37:01.747690] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-09.
[2025-10-24T21:37:02.613777] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T21:37:02.617390] [INFO ] [REMOTE    ] TYG: Fetching primary data for 2025-10.
[2025-10-24T21:37:02.749802] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T21:37:03.347693] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-09.
[2025-10-24T21:37:03.472010] [INFO ] [REMOTE    ] TYG: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T21:37:03.474873] [INFO ] [REMOTE    ] TYG: Full fetch complete (22049 records).
[2025-10-24T21:37:03.474948] [DEBUG] [VALIDATOR ] TYG: Validating primary data.
[2025-10-24T21:37:03.834849] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present.
[2025-10-24T21:37:03.834946] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed.
[2025-10-24T21:37:03.835465] [INFO ] [MAIN      ] TYG: Fetched primary data is valid.
[2025-10-24T21:37:03.835522] [DEBUG] [LOCAL     ] TYG: Saving primary data.
[2025-10-24T21:37:03.835823] [FATAL] [LOCAL     ] TYG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:37:03.835904] [FATAL] [MAIN      ] TYG: Failed to save primary data.
[2025-10-24T21:37:03.835945] [WARN ] [MAIN      ] TYG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:37:03.835979] [INFO ] [LOCAL     ] TYG: Starting deletion of primary data.
[2025-10-24T21:37:03.836026] [DEBUG] [LOCAL     ] TYG: No primary data file found to delete.
[2025-10-24T21:37:03.836061] [INFO ] [LOCAL     ] TYG: Starting deletion of derivative data.
[2025-10-24T21:37:03.836271] [DEBUG] [LOCAL     ] TYG: Deleted derivative data file.
[2025-10-24T21:37:03.836361] [INFO ] [MAIN      ] Update Progress: 2159/2366 symbols completed. TYG took 21.5s. Estimated remaining: 26m 34s. Rate: 7.8 symbols/min
[2025-10-24T21:37:04.143373] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T21:37:04.153860] [INFO ] [REMOTE    ] TXT: Fetching primary data for 2025-10.
[2025-10-24T21:37:05.936205] [INFO ] [REMOTE    ] TXT: Incremental fetch complete for 2025-10 (1.78 seconds).
[2025-10-24T21:37:05.946818] [INFO ] [REMOTE    ] TXT: Full fetch complete (72461 records).
[2025-10-24T21:37:05.947086] [DEBUG] [VALIDATOR ] TXT: Validating primary data.
[2025-10-24T21:37:06.363020] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present.
[2025-10-24T21:37:06.363106] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed.
[2025-10-24T21:37:06.364389] [INFO ] [MAIN      ] TXT: Fetched primary data is valid.
[2025-10-24T21:37:06.364453] [DEBUG] [LOCAL     ] TXT: Saving primary data.
[2025-10-24T21:37:06.365067] [FATAL] [LOCAL     ] TXT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:37:06.365160] [FATAL] [MAIN      ] TXT: Failed to save primary data.
[2025-10-24T21:37:06.365203] [WARN ] [MAIN      ] TXT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:37:06.365241] [INFO ] [LOCAL     ] TXT: Starting deletion of primary data.
[2025-10-24T21:37:06.365316] [DEBUG] [LOCAL     ] TXT: No primary data file found to delete.
[2025-10-24T21:37:06.365354] [INFO ] [LOCAL     ] TXT: Starting deletion of derivative data.
[2025-10-24T21:37:06.365509] [DEBUG] [LOCAL     ] TXT: Deleted derivative data file.
[2025-10-24T21:37:06.366147] [INFO ] [MAIN      ] Update Progress: 2160/2366 symbols completed. TXT took 37.1s. Estimated remaining: 26m 25s. Rate: 7.8 symbols/min
[2025-10-24T21:37:07.048602] [INFO ] [MAIN      ] UA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:37:07.049399] [INFO ] [MAIN      ] U: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:37:07.120537] [INFO ] [MAIN      ] TYL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:37:07.123597] [INFO ] [MAIN      ] UAA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:37:07.149122] [DEBUG] [LOCAL     ] TYL: Loaded 22120 existing records from primary storage.
[2025-10-24T21:37:07.161259] [INFO ] [MAIN      ] TYL: Loaded 22120 existing records.
[2025-10-24T21:37:07.328329] [DEBUG] [LOCAL     ] UA: Loaded 50822 existing records from primary storage.
[2025-10-24T21:37:07.330374] [INFO ] [MAIN      ] UA: Loaded 50822 existing records.
[2025-10-24T21:37:07.341619] [DEBUG] [LOCAL     ] U: Loaded 54189 existing records from primary storage.
[2025-10-24T21:37:07.400202] [INFO ] [MAIN      ] U: Loaded 54189 existing records.
[2025-10-24T21:37:07.492606] [DEBUG] [LOCAL     ] UAA: Loaded 53888 existing records from primary storage.
[2025-10-24T21:37:07.524001] [WARN ] [MAIN      ] TYL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:37:07.534875] [INFO ] [MAIN      ] UAA: Loaded 53888 existing records.
[2025-10-24T21:37:07.596175] [INFO ] [MAIN      ] TYL: Wiping existing primary data before full refresh.
[2025-10-24T21:37:07.632742] [INFO ] [LOCAL     ] TYL: Starting deletion of primary data.
[2025-10-24T21:37:07.657182] [DEBUG] [LOCAL     ] TYL: Deleted primary data file.
[2025-10-24T21:37:07.684039] [INFO ] [MAIN      ] TYL: Starting full primary refresh.
[2025-10-24T21:37:08.046105] [WARN ] [MAIN      ] UA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:37:08.118215] [WARN ] [MAIN      ] UAA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:37:08.118521] [INFO ] [MAIN      ] UAA: Wiping existing primary data before full refresh.
[2025-10-24T21:37:08.122434] [INFO ] [MAIN      ] UA: Wiping existing primary data before full refresh.
[2025-10-24T21:37:08.122350] [WARN ] [MAIN      ] U: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:37:08.118621] [INFO ] [LOCAL     ] UAA: Starting deletion of primary data.
[2025-10-24T21:37:08.133321] [INFO ] [LOCAL     ] UA: Starting deletion of primary data.
[2025-10-24T21:37:08.127971] [INFO ] [MAIN      ] U: Wiping existing primary data before full refresh.
[2025-10-24T21:37:08.149113] [INFO ] [LOCAL     ] U: Starting deletion of primary data.
[2025-10-24T21:37:08.162515] [DEBUG] [LOCAL     ] UA: Deleted primary data file.
[2025-10-24T21:37:08.149164] [DEBUG] [LOCAL     ] UAA: Deleted primary data file.
[2025-10-24T21:37:08.181211] [INFO ] [MAIN      ] UAA: Starting full primary refresh.
[2025-10-24T21:37:08.197717] [INFO ] [MAIN      ] UA: Starting full primary refresh.
[2025-10-24T21:37:08.202995] [DEBUG] [LOCAL     ] U: Deleted primary data file.
[2025-10-24T21:37:08.203187] [INFO ] [MAIN      ] U: Starting full primary refresh.
[2025-10-24T21:37:08.928183] [INFO ] [REMOTE    ] TYL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:37:09.216037] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-01.
[2025-10-24T21:37:09.368458] [INFO ] [REMOTE    ] UAA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:37:09.410860] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-01.
[2025-10-24T21:37:09.480300] [INFO ] [REMOTE    ] U: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:37:09.494083] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-01.
[2025-10-24T21:37:09.535462] [INFO ] [REMOTE    ] UA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:37:09.535767] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-01.
[2025-10-24T21:37:10.512674] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T21:37:10.517030] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-02.
[2025-10-24T21:37:11.090310] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T21:37:11.100903] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-02.
[2025-10-24T21:37:11.174778] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T21:37:11.185394] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-02.
[2025-10-24T21:37:11.336017] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T21:37:11.346576] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-02.
[2025-10-24T21:37:11.360060] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-02 (0.84 seconds).
[2025-10-24T21:37:11.364890] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-03.
[2025-10-24T21:37:12.533449] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T21:37:12.539194] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-04.
[2025-10-24T21:37:12.743559] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-02 (1.64 seconds).
[2025-10-24T21:37:12.947758] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-03.
[2025-10-24T21:37:13.175413] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-02 (1.99 seconds).
[2025-10-24T21:37:13.218570] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T21:37:13.747630] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-03.
[2025-10-24T21:37:13.949680] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T21:37:14.461383] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-03 (1.51 seconds).
[2025-10-24T21:37:14.547623] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-04.
[2025-10-24T21:37:15.347717] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-05.
[2025-10-24T21:37:15.734871] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T21:37:16.147699] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-04.
[2025-10-24T21:37:16.467539] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T21:37:16.777758] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-04 (2.23 seconds).
[2025-10-24T21:37:16.947743] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-03.
[2025-10-24T21:37:17.747632] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-06.
[2025-10-24T21:37:17.995432] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T21:37:18.547727] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-05.
[2025-10-24T21:37:18.815693] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T21:37:19.255838] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-03 (2.31 seconds).
[2025-10-24T21:37:19.347674] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-04.
[2025-10-24T21:37:20.147706] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-05.
[2025-10-24T21:37:20.471776] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-05 (1.92 seconds).
[2025-10-24T21:37:20.947738] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-06.
[2025-10-24T21:37:21.711468] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-04 (2.36 seconds).
[2025-10-24T21:37:21.755944] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-07.
[2025-10-24T21:37:21.782266] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T21:37:22.547720] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-05.
[2025-10-24T21:37:22.803222] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-06 (1.86 seconds).
[2025-10-24T21:37:23.274501] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T21:37:23.347702] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-08.
[2025-10-24T21:37:24.147668] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-06.
[2025-10-24T21:37:24.568987] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-08 (1.22 seconds).
[2025-10-24T21:37:24.706352] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-05 (2.16 seconds).
[2025-10-24T21:37:24.947678] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-07.
[2025-10-24T21:37:25.747624] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-06.
[2025-10-24T21:37:25.853174] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T21:37:26.547732] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-09.
[2025-10-24T21:37:26.885488] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T21:37:27.121946] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-09 (0.57 seconds).
[2025-10-24T21:37:27.347735] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-08.
[2025-10-24T21:37:28.068337] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-06 (2.32 seconds).
[2025-10-24T21:37:28.147707] [INFO ] [REMOTE    ] TYL: Fetching primary data for 2025-10.
[2025-10-24T21:37:28.947689] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-07.
[2025-10-24T21:37:29.267562] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-08 (1.92 seconds).
[2025-10-24T21:37:29.284125] [INFO ] [REMOTE    ] TYL: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T21:37:29.289565] [INFO ] [REMOTE    ] TYL: Full fetch complete (31616 records).
[2025-10-24T21:37:29.289707] [DEBUG] [VALIDATOR ] TYL: Validating primary data.
[2025-10-24T21:37:29.661308] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present.
[2025-10-24T21:37:29.661385] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed.
[2025-10-24T21:37:29.662044] [INFO ] [MAIN      ] TYL: Fetched primary data is valid.
[2025-10-24T21:37:29.662104] [DEBUG] [LOCAL     ] TYL: Saving primary data.
[2025-10-24T21:37:29.662455] [FATAL] [LOCAL     ] TYL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:37:29.662536] [FATAL] [MAIN      ] TYL: Failed to save primary data.
[2025-10-24T21:37:29.662577] [WARN ] [MAIN      ] TYL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:37:29.662612] [INFO ] [LOCAL     ] TYL: Starting deletion of primary data.
[2025-10-24T21:37:29.662697] [DEBUG] [LOCAL     ] TYL: No primary data file found to delete.
[2025-10-24T21:37:29.662750] [INFO ] [LOCAL     ] TYL: Starting deletion of derivative data.
[2025-10-24T21:37:29.663034] [DEBUG] [LOCAL     ] TYL: Deleted derivative data file.
[2025-10-24T21:37:29.663126] [INFO ] [MAIN      ] Update Progress: 2161/2366 symbols completed. TYL took 23.3s. Estimated remaining: 26m 19s. Rate: 7.8 symbols/min
[2025-10-24T21:37:29.752833] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-09.
[2025-10-24T21:37:29.845260] [INFO ] [MAIN      ] UAN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:37:29.852562] [DEBUG] [LOCAL     ] UAN: Loaded 5331 existing records from primary storage.
[2025-10-24T21:37:29.852810] [INFO ] [MAIN      ] UAN: Loaded 5331 existing records.
[2025-10-24T21:37:30.026750] [WARN ] [MAIN      ] UAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:37:30.026964] [INFO ] [MAIN      ] UAN: Wiping existing primary data before full refresh.
[2025-10-24T21:37:30.027019] [INFO ] [LOCAL     ] UAN: Starting deletion of primary data.
[2025-10-24T21:37:30.027227] [DEBUG] [LOCAL     ] UAN: Deleted primary data file.
[2025-10-24T21:37:30.027267] [INFO ] [MAIN      ] UAN: Starting full primary refresh.
[2025-10-24T21:37:30.375458] [INFO ] [REMOTE    ] UAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:37:30.547710] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-07.
[2025-10-24T21:37:31.349911] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-01.
[2025-10-24T21:37:31.354891] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-07 (2.41 seconds).
[2025-10-24T21:37:31.664159] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-09 (1.91 seconds).
[2025-10-24T21:37:32.056572] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T21:37:32.147625] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-02.
[2025-10-24T21:37:32.289947] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T21:37:32.748591] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-02 (0.60 seconds).
[2025-10-24T21:37:32.947715] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-03.
[2025-10-24T21:37:33.573899] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-03 (0.63 seconds).
[2025-10-24T21:37:33.747710] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-04.
[2025-10-24T21:37:34.504811] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-04 (0.76 seconds).
[2025-10-24T21:37:34.547634] [INFO ] [REMOTE    ] UAA: Fetching primary data for 2025-10.
[2025-10-24T21:37:35.347749] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-05.
[2025-10-24T21:37:36.082944] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-05 (0.74 seconds).
[2025-10-24T21:37:36.147670] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-06.
[2025-10-24T21:37:36.563734] [INFO ] [REMOTE    ] UAA: Incremental fetch complete for 2025-10 (2.02 seconds).
[2025-10-24T21:37:36.575417] [INFO ] [REMOTE    ] UAA: Full fetch complete (77642 records).
[2025-10-24T21:37:36.575638] [DEBUG] [VALIDATOR ] UAA: Validating primary data.
[2025-10-24T21:37:36.840286] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-06 (0.69 seconds).
[2025-10-24T21:37:36.948152] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-08.
[2025-10-24T21:37:36.996426] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present.
[2025-10-24T21:37:36.996553] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed.
[2025-10-24T21:37:36.998616] [INFO ] [MAIN      ] UAA: Fetched primary data is valid.
[2025-10-24T21:37:36.998719] [DEBUG] [LOCAL     ] UAA: Saving primary data.
[2025-10-24T21:37:36.999823] [FATAL] [LOCAL     ] UAA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:37:36.999930] [FATAL] [MAIN      ] UAA: Failed to save primary data.
[2025-10-24T21:37:37.000009] [WARN ] [MAIN      ] UAA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:37:37.000097] [INFO ] [LOCAL     ] UAA: Starting deletion of primary data.
[2025-10-24T21:37:37.000182] [DEBUG] [LOCAL     ] UAA: No primary data file found to delete.
[2025-10-24T21:37:37.000226] [INFO ] [LOCAL     ] UAA: Starting deletion of derivative data.
[2025-10-24T21:37:37.000453] [DEBUG] [LOCAL     ] UAA: Deleted derivative data file.
[2025-10-24T21:37:37.000976] [INFO ] [MAIN      ] Update Progress: 2162/2366 symbols completed. UAA took 30.6s. Estimated remaining: 26m 11s. Rate: 7.8 symbols/min
[2025-10-24T21:37:37.194603] [INFO ] [MAIN      ] UBER: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:37:37.250374] [DEBUG] [LOCAL     ] UBER: Loaded 54196 existing records from primary storage.
[2025-10-24T21:37:37.250835] [INFO ] [MAIN      ] UBER: Loaded 54196 existing records.
[2025-10-24T21:37:37.433902] [WARN ] [MAIN      ] UBER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:37:37.434213] [INFO ] [MAIN      ] UBER: Wiping existing primary data before full refresh.
[2025-10-24T21:37:37.434274] [INFO ] [LOCAL     ] UBER: Starting deletion of primary data.
[2025-10-24T21:37:37.434825] [DEBUG] [LOCAL     ] UBER: Deleted primary data file.
[2025-10-24T21:37:37.434893] [INFO ] [MAIN      ] UBER: Starting full primary refresh.
[2025-10-24T21:37:37.759252] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-07.
[2025-10-24T21:37:37.803066] [INFO ] [REMOTE    ] UBER: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:37:38.381560] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T21:37:38.547635] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-08.
[2025-10-24T21:37:38.788750] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T21:37:39.323100] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T21:37:39.347684] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-09.
[2025-10-24T21:37:39.940833] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-09 (0.59 seconds).
[2025-10-24T21:37:40.147692] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-01.
[2025-10-24T21:37:40.947680] [INFO ] [REMOTE    ] UAN: Fetching primary data for 2025-10.
[2025-10-24T21:37:41.573845] [INFO ] [REMOTE    ] UAN: Incremental fetch complete for 2025-10 (0.63 seconds).
[2025-10-24T21:37:41.575242] [INFO ] [REMOTE    ] UAN: Full fetch complete (7856 records).
[2025-10-24T21:37:41.575343] [DEBUG] [VALIDATOR ] UAN: Validating primary data.
[2025-10-24T21:37:41.757791] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-09.
[2025-10-24T21:37:41.934458] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present.
[2025-10-24T21:37:41.934540] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed.
[2025-10-24T21:37:41.934767] [INFO ] [MAIN      ] UAN: Fetched primary data is valid.
[2025-10-24T21:37:41.934826] [DEBUG] [LOCAL     ] UAN: Saving primary data.
[2025-10-24T21:37:41.935016] [FATAL] [LOCAL     ] UAN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:37:41.935093] [FATAL] [MAIN      ] UAN: Failed to save primary data.
[2025-10-24T21:37:41.935134] [WARN ] [MAIN      ] UAN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:37:41.935167] [INFO ] [LOCAL     ] UAN: Starting deletion of primary data.
[2025-10-24T21:37:41.935214] [DEBUG] [LOCAL     ] UAN: No primary data file found to delete.
[2025-10-24T21:37:41.935248] [INFO ] [LOCAL     ] UAN: Starting deletion of derivative data.
[2025-10-24T21:37:41.935403] [DEBUG] [LOCAL     ] UAN: Deleted derivative data file.
[2025-10-24T21:37:41.935471] [INFO ] [MAIN      ] Update Progress: 2163/2366 symbols completed. UAN took 12.3s. Estimated remaining: 26m 3s. Rate: 7.8 symbols/min
[2025-10-24T21:37:42.113251] [INFO ] [MAIN      ] UBS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:37:42.163382] [DEBUG] [LOCAL     ] UBS: Loaded 52657 existing records from primary storage.
[2025-10-24T21:37:42.163740] [INFO ] [MAIN      ] UBS: Loaded 52657 existing records.
[2025-10-24T21:37:42.339512] [WARN ] [MAIN      ] UBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:37:42.339773] [INFO ] [MAIN      ] UBS: Wiping existing primary data before full refresh.
[2025-10-24T21:37:42.339857] [INFO ] [LOCAL     ] UBS: Starting deletion of primary data.
[2025-10-24T21:37:42.340294] [DEBUG] [LOCAL     ] UBS: Deleted primary data file.
[2025-10-24T21:37:42.340349] [INFO ] [MAIN      ] UBS: Starting full primary refresh.
[2025-10-24T21:37:42.550821] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-08.
[2025-10-24T21:37:42.706280] [INFO ] [REMOTE    ] UBS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:37:42.734388] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-01 (2.59 seconds).
[2025-10-24T21:37:43.347628] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-01.
[2025-10-24T21:37:43.795063] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-09 (2.04 seconds).
[2025-10-24T21:37:44.147725] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-02.
[2025-10-24T21:37:44.798434] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-08 (2.25 seconds).
[2025-10-24T21:37:44.947715] [INFO ] [REMOTE    ] UA: Fetching primary data for 2025-10.
[2025-10-24T21:37:45.233261] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T21:37:45.747667] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-09.
[2025-10-24T21:37:46.322966] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-02 (2.18 seconds).
[2025-10-24T21:37:46.547667] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-03.
[2025-10-24T21:37:46.591107] [INFO ] [REMOTE    ] UA: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T21:37:46.602490] [INFO ] [REMOTE    ] UA: Full fetch complete (73210 records).
[2025-10-24T21:37:46.602794] [DEBUG] [VALIDATOR ] UA: Validating primary data.
[2025-10-24T21:37:47.029195] [DEBUG] [VALIDATOR ] UA: All expected trading days are present.
[2025-10-24T21:37:47.029336] [DEBUG] [VALIDATOR ] UA: Primary data validation passed.
[2025-10-24T21:37:47.031150] [INFO ] [MAIN      ] UA: Fetched primary data is valid.
[2025-10-24T21:37:47.031223] [DEBUG] [LOCAL     ] UA: Saving primary data.
[2025-10-24T21:37:47.032232] [FATAL] [LOCAL     ] UA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:37:47.032337] [FATAL] [MAIN      ] UA: Failed to save primary data.
[2025-10-24T21:37:47.032381] [WARN ] [MAIN      ] UA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:37:47.032422] [INFO ] [LOCAL     ] UA: Starting deletion of primary data.
[2025-10-24T21:37:47.032491] [DEBUG] [LOCAL     ] UA: No primary data file found to delete.
[2025-10-24T21:37:47.032530] [INFO ] [LOCAL     ] UA: Starting deletion of derivative data.
[2025-10-24T21:37:47.032791] [DEBUG] [LOCAL     ] UA: Deleted derivative data file.
[2025-10-24T21:37:47.033459] [INFO ] [MAIN      ] Update Progress: 2164/2366 symbols completed. UA took 40.7s. Estimated remaining: 25m 56s. Rate: 7.8 symbols/min
[2025-10-24T21:37:47.230589] [INFO ] [MAIN      ] UCB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:37:47.286449] [DEBUG] [LOCAL     ] UCB: Loaded 38009 existing records from primary storage.
[2025-10-24T21:37:47.286977] [INFO ] [MAIN      ] UCB: Loaded 38009 existing records.
[2025-10-24T21:37:47.356333] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-02.
[2025-10-24T21:37:47.471591] [WARN ] [MAIN      ] UCB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:37:47.471934] [INFO ] [MAIN      ] UCB: Wiping existing primary data before full refresh.
[2025-10-24T21:37:47.471987] [INFO ] [LOCAL     ] UCB: Starting deletion of primary data.
[2025-10-24T21:37:47.472393] [DEBUG] [LOCAL     ] UCB: Deleted primary data file.
[2025-10-24T21:37:47.472453] [INFO ] [MAIN      ] UCB: Starting full primary refresh.
[2025-10-24T21:37:47.847135] [INFO ] [REMOTE    ] UCB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:37:48.147747] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-01.
[2025-10-24T21:37:48.215960] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-09 (2.47 seconds).
[2025-10-24T21:37:48.947668] [INFO ] [REMOTE    ] U: Fetching primary data for 2025-10.
[2025-10-24T21:37:49.060070] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-03 (2.51 seconds).
[2025-10-24T21:37:49.117037] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-01 (0.97 seconds).
[2025-10-24T21:37:49.185750] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T21:37:49.747671] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-04.
[2025-10-24T21:37:50.547722] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-03.
[2025-10-24T21:37:51.167387] [INFO ] [REMOTE    ] U: Incremental fetch complete for 2025-10 (2.22 seconds).
[2025-10-24T21:37:51.177239] [INFO ] [REMOTE    ] U: Full fetch complete (77975 records).
[2025-10-24T21:37:51.177371] [DEBUG] [VALIDATOR ] U: Validating primary data.
[2025-10-24T21:37:51.348368] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-02.
[2025-10-24T21:37:51.567813] [DEBUG] [VALIDATOR ] U: All expected trading days are present.
[2025-10-24T21:37:51.567914] [DEBUG] [VALIDATOR ] U: Primary data validation passed.
[2025-10-24T21:37:51.569136] [INFO ] [MAIN      ] U: Fetched primary data is valid.
[2025-10-24T21:37:51.569197] [DEBUG] [LOCAL     ] U: Saving primary data.
[2025-10-24T21:37:51.569858] [FATAL] [LOCAL     ] U: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:37:51.569946] [FATAL] [MAIN      ] U: Failed to save primary data.
[2025-10-24T21:37:51.569988] [WARN ] [MAIN      ] U: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:37:51.570022] [INFO ] [LOCAL     ] U: Starting deletion of primary data.
[2025-10-24T21:37:51.570072] [DEBUG] [LOCAL     ] U: No primary data file found to delete.
[2025-10-24T21:37:51.570106] [INFO ] [LOCAL     ] U: Starting deletion of derivative data.
[2025-10-24T21:37:51.570295] [DEBUG] [LOCAL     ] U: Deleted derivative data file.
[2025-10-24T21:37:51.570585] [INFO ] [MAIN      ] Update Progress: 2165/2366 symbols completed. U took 45.2s. Estimated remaining: 25m 48s. Rate: 7.8 symbols/min
[2025-10-24T21:37:51.767411] [INFO ] [MAIN      ] UDR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:37:51.808608] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-04 (2.06 seconds).
[2025-10-24T21:37:51.861558] [DEBUG] [LOCAL     ] UDR: Loaded 52492 existing records from primary storage.
[2025-10-24T21:37:51.861943] [INFO ] [MAIN      ] UDR: Loaded 52492 existing records.
[2025-10-24T21:37:52.044611] [WARN ] [MAIN      ] UDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:37:52.044870] [INFO ] [MAIN      ] UDR: Wiping existing primary data before full refresh.
[2025-10-24T21:37:52.044965] [INFO ] [LOCAL     ] UDR: Starting deletion of primary data.
[2025-10-24T21:37:52.045480] [DEBUG] [LOCAL     ] UDR: Deleted primary data file.
[2025-10-24T21:37:52.045523] [INFO ] [MAIN      ] UDR: Starting full primary refresh.
[2025-10-24T21:37:52.155026] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-05.
[2025-10-24T21:37:52.421406] [INFO ] [REMOTE    ] UDR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:37:52.554181] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-03 (2.01 seconds).
[2025-10-24T21:37:52.778450] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T21:37:52.947695] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-01.
[2025-10-24T21:37:53.747731] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-04.
[2025-10-24T21:37:54.547733] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-03.
[2025-10-24T21:37:54.615811] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T21:37:54.754836] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-05 (2.60 seconds).
[2025-10-24T21:37:55.347783] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-02.
[2025-10-24T21:37:55.421271] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T21:37:55.613698] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-03 (1.07 seconds).
[2025-10-24T21:37:56.147677] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-04.
[2025-10-24T21:37:56.947699] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-05.
[2025-10-24T21:37:57.046638] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T21:37:57.642627] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-04 (1.49 seconds).
[2025-10-24T21:37:57.747690] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-05.
[2025-10-24T21:37:58.547697] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-03.
[2025-10-24T21:37:58.906143] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-05 (1.96 seconds).
[2025-10-24T21:37:59.050670] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T21:37:59.347685] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-06.
[2025-10-24T21:38:00.147770] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-06.
[2025-10-24T21:38:00.298945] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T21:38:00.772538] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T21:38:00.947749] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-06.
[2025-10-24T21:38:01.747704] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-07.
[2025-10-24T21:38:02.547744] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-04.
[2025-10-24T21:38:02.677122] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-06 (2.53 seconds).
[2025-10-24T21:38:02.897891] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T21:38:03.219725] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T21:38:03.347750] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-08.
[2025-10-24T21:38:04.147733] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-07.
[2025-10-24T21:38:04.417625] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T21:38:04.464625] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T21:38:04.947737] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-05.
[2025-10-24T21:38:05.747728] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-09.
[2025-10-24T21:38:06.547761] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-07.
[2025-10-24T21:38:06.705285] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-07 (2.56 seconds).
[2025-10-24T21:38:06.753745] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-05 (1.81 seconds).
[2025-10-24T21:38:06.799266] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-09 (1.05 seconds).
[2025-10-24T21:38:07.347737] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-08.
[2025-10-24T21:38:08.147694] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-06.
[2025-10-24T21:38:08.484420] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T21:38:08.947789] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-08.
[2025-10-24T21:38:09.645476] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T21:38:09.747673] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-07.
[2025-10-24T21:38:09.859980] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-08 (2.51 seconds).
[2025-10-24T21:38:10.547749] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-09.
[2025-10-24T21:38:10.850386] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-08 (1.90 seconds).
[2025-10-24T21:38:11.347735] [INFO ] [REMOTE    ] UCB: Fetching primary data for 2025-10.
[2025-10-24T21:38:11.642826] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T21:38:12.147729] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-09.
[2025-10-24T21:38:12.389158] [INFO ] [REMOTE    ] UCB: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T21:38:12.400174] [INFO ] [REMOTE    ] UCB: Full fetch complete (55081 records).
[2025-10-24T21:38:12.400352] [DEBUG] [VALIDATOR ] UCB: Validating primary data.
[2025-10-24T21:38:12.796056] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present.
[2025-10-24T21:38:12.796179] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed.
[2025-10-24T21:38:12.797293] [INFO ] [MAIN      ] UCB: Fetched primary data is valid.
[2025-10-24T21:38:12.797374] [DEBUG] [LOCAL     ] UCB: Saving primary data.
[2025-10-24T21:38:12.797983] [FATAL] [LOCAL     ] UCB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:38:12.798067] [FATAL] [MAIN      ] UCB: Failed to save primary data.
[2025-10-24T21:38:12.798109] [WARN ] [MAIN      ] UCB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:38:12.798171] [INFO ] [LOCAL     ] UCB: Starting deletion of primary data.
[2025-10-24T21:38:12.798247] [DEBUG] [LOCAL     ] UCB: No primary data file found to delete.
[2025-10-24T21:38:12.798304] [INFO ] [LOCAL     ] UCB: Starting deletion of derivative data.
[2025-10-24T21:38:12.798455] [DEBUG] [LOCAL     ] UCB: Deleted derivative data file.
[2025-10-24T21:38:12.798534] [INFO ] [MAIN      ] Update Progress: 2166/2366 symbols completed. UCB took 25.8s. Estimated remaining: 25m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:38:12.974691] [INFO ] [MAIN      ] UE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:38:12.949940] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-08.
[2025-10-24T21:38:13.029462] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-09 (2.48 seconds).
[2025-10-24T21:38:13.054239] [DEBUG] [LOCAL     ] UE: Loaded 42745 existing records from primary storage.
[2025-10-24T21:38:13.054934] [INFO ] [MAIN      ] UE: Loaded 42745 existing records.
[2025-10-24T21:38:13.227887] [WARN ] [MAIN      ] UE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:38:13.228101] [INFO ] [MAIN      ] UE: Wiping existing primary data before full refresh.
[2025-10-24T21:38:13.228147] [INFO ] [LOCAL     ] UE: Starting deletion of primary data.
[2025-10-24T21:38:13.228464] [DEBUG] [LOCAL     ] UE: Deleted primary data file.
[2025-10-24T21:38:13.228501] [INFO ] [MAIN      ] UE: Starting full primary refresh.
[2025-10-24T21:38:13.579787] [INFO ] [REMOTE    ] UE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:38:13.722046] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T21:38:13.747715] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-01.
[2025-10-24T21:38:14.547969] [INFO ] [REMOTE    ] UBS: Fetching primary data for 2025-10.
[2025-10-24T21:38:14.860130] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T21:38:15.163390] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T21:38:15.347671] [INFO ] [REMOTE    ] UBER: Fetching primary data for 2025-10.
[2025-10-24T21:38:16.078362] [INFO ] [REMOTE    ] UBS: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T21:38:16.089567] [INFO ] [REMOTE    ] UBS: Full fetch complete (75942 records).
[2025-10-24T21:38:16.089829] [DEBUG] [VALIDATOR ] UBS: Validating primary data.
[2025-10-24T21:38:16.150984] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-09.
[2025-10-24T21:38:16.383262] [INFO ] [REMOTE    ] UBER: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T21:38:16.455048] [INFO ] [REMOTE    ] UBER: Full fetch complete (77986 records).
[2025-10-24T21:38:16.455266] [DEBUG] [VALIDATOR ] UBER: Validating primary data.
[2025-10-24T21:38:16.658198] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present.
[2025-10-24T21:38:16.658389] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed.
[2025-10-24T21:38:16.659896] [INFO ] [MAIN      ] UBS: Fetched primary data is valid.
[2025-10-24T21:38:16.660083] [DEBUG] [LOCAL     ] UBS: Saving primary data.
[2025-10-24T21:38:16.660692] [FATAL] [LOCAL     ] UBS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:38:16.671361] [FATAL] [MAIN      ] UBS: Failed to save primary data.
[2025-10-24T21:38:16.681714] [WARN ] [MAIN      ] UBS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:38:16.704764] [INFO ] [LOCAL     ] UBS: Starting deletion of primary data.
[2025-10-24T21:38:16.720382] [DEBUG] [LOCAL     ] UBS: No primary data file found to delete.
[2025-10-24T21:38:16.762254] [INFO ] [LOCAL     ] UBS: Starting deletion of derivative data.
[2025-10-24T21:38:16.823915] [DEBUG] [LOCAL     ] UBS: Deleted derivative data file.
[2025-10-24T21:38:16.863930] [INFO ] [MAIN      ] Update Progress: 2167/2366 symbols completed. UBS took 34.9s. Estimated remaining: 25m 33s. Rate: 7.8 symbols/min
[2025-10-24T21:38:16.953112] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-02.
[2025-10-24T21:38:17.106826] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present.
[2025-10-24T21:38:17.117260] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed.
[2025-10-24T21:38:17.171527] [INFO ] [MAIN      ] UBER: Fetched primary data is valid.
[2025-10-24T21:38:17.173860] [DEBUG] [LOCAL     ] UBER: Saving primary data.
[2025-10-24T21:38:17.173682] [INFO ] [MAIN      ] UFI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:38:17.174857] [FATAL] [LOCAL     ] UBER: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:38:17.175019] [FATAL] [MAIN      ] UBER: Failed to save primary data.
[2025-10-24T21:38:17.185742] [WARN ] [MAIN      ] UBER: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:38:17.206334] [INFO ] [LOCAL     ] UBER: Starting deletion of primary data.
[2025-10-24T21:38:17.206546] [DEBUG] [LOCAL     ] UBER: No primary data file found to delete.
[2025-10-24T21:38:17.208366] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T21:38:17.207206] [INFO ] [LOCAL     ] UBER: Starting deletion of derivative data.
[2025-10-24T21:38:17.222863] [DEBUG] [LOCAL     ] UFI: Loaded 8257 existing records from primary storage.
[2025-10-24T21:38:17.223414] [INFO ] [MAIN      ] UFI: Loaded 8257 existing records.
[2025-10-24T21:38:17.234516] [DEBUG] [LOCAL     ] UBER: Deleted derivative data file.
[2025-10-24T21:38:17.254419] [INFO ] [MAIN      ] Update Progress: 2168/2366 symbols completed. UBER took 40.3s. Estimated remaining: 25m 25s. Rate: 7.8 symbols/min
[2025-10-24T21:38:17.549165] [WARN ] [MAIN      ] UFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:38:17.567561] [INFO ] [MAIN      ] UGI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:38:17.567629] [INFO ] [MAIN      ] UFI: Wiping existing primary data before full refresh.
[2025-10-24T21:38:17.568044] [INFO ] [LOCAL     ] UFI: Starting deletion of primary data.
[2025-10-24T21:38:17.568312] [DEBUG] [LOCAL     ] UFI: Deleted primary data file.
[2025-10-24T21:38:17.568369] [INFO ] [MAIN      ] UFI: Starting full primary refresh.
[2025-10-24T21:38:17.756408] [INFO ] [REMOTE    ] UDR: Fetching primary data for 2025-10.
[2025-10-24T21:38:17.957507] [INFO ] [REMOTE    ] UFI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:38:17.959476] [DEBUG] [LOCAL     ] UGI: Loaded 50834 existing records from primary storage.
[2025-10-24T21:38:17.959753] [INFO ] [MAIN      ] UGI: Loaded 50834 existing records.
[2025-10-24T21:38:18.133177] [WARN ] [MAIN      ] UGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:38:18.133417] [INFO ] [MAIN      ] UGI: Wiping existing primary data before full refresh.
[2025-10-24T21:38:18.133467] [INFO ] [LOCAL     ] UGI: Starting deletion of primary data.
[2025-10-24T21:38:18.133754] [DEBUG] [LOCAL     ] UGI: Deleted primary data file.
[2025-10-24T21:38:18.133810] [INFO ] [MAIN      ] UGI: Starting full primary refresh.
[2025-10-24T21:38:18.500190] [INFO ] [REMOTE    ] UGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:38:18.525305] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-02 (1.57 seconds).
[2025-10-24T21:38:18.547622] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-01.
[2025-10-24T21:38:19.347722] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-01.
[2025-10-24T21:38:19.608987] [INFO ] [REMOTE    ] UDR: Incremental fetch complete for 2025-10 (1.85 seconds).
[2025-10-24T21:38:19.620707] [INFO ] [REMOTE    ] UDR: Full fetch complete (75143 records).
[2025-10-24T21:38:19.620991] [DEBUG] [VALIDATOR ] UDR: Validating primary data.
[2025-10-24T21:38:20.059493] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present.
[2025-10-24T21:38:20.059806] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed.
[2025-10-24T21:38:20.061423] [INFO ] [MAIN      ] UDR: Fetched primary data is valid.
[2025-10-24T21:38:20.061515] [DEBUG] [LOCAL     ] UDR: Saving primary data.
[2025-10-24T21:38:20.062293] [FATAL] [LOCAL     ] UDR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:38:20.062388] [FATAL] [MAIN      ] UDR: Failed to save primary data.
[2025-10-24T21:38:20.062430] [WARN ] [MAIN      ] UDR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:38:20.062468] [INFO ] [LOCAL     ] UDR: Starting deletion of primary data.
[2025-10-24T21:38:20.062526] [DEBUG] [LOCAL     ] UDR: No primary data file found to delete.
[2025-10-24T21:38:20.062563] [INFO ] [LOCAL     ] UDR: Starting deletion of derivative data.
[2025-10-24T21:38:20.062764] [DEBUG] [LOCAL     ] UDR: Deleted derivative data file.
[2025-10-24T21:38:20.063160] [INFO ] [MAIN      ] Update Progress: 2169/2366 symbols completed. UDR took 28.5s. Estimated remaining: 25m 17s. Rate: 7.8 symbols/min
[2025-10-24T21:38:20.161558] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-03.
[2025-10-24T21:38:20.173204] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-01 (0.83 seconds).
[2025-10-24T21:38:20.289032] [INFO ] [MAIN      ] UGP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:38:20.305443] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-01 (1.76 seconds).
[2025-10-24T21:38:20.360414] [DEBUG] [LOCAL     ] UGP: Loaded 43339 existing records from primary storage.
[2025-10-24T21:38:20.360956] [INFO ] [MAIN      ] UGP: Loaded 43339 existing records.
[2025-10-24T21:38:20.548762] [WARN ] [MAIN      ] UGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:38:20.549091] [INFO ] [MAIN      ] UGP: Wiping existing primary data before full refresh.
[2025-10-24T21:38:20.549143] [INFO ] [LOCAL     ] UGP: Starting deletion of primary data.
[2025-10-24T21:38:20.549485] [DEBUG] [LOCAL     ] UGP: Deleted primary data file.
[2025-10-24T21:38:20.549525] [INFO ] [MAIN      ] UGP: Starting full primary refresh.
[2025-10-24T21:38:20.927545] [INFO ] [REMOTE    ] UGP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:38:20.947639] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-01.
[2025-10-24T21:38:21.752901] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-02.
[2025-10-24T21:38:21.757516] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-03 (1.60 seconds).
[2025-10-24T21:38:22.533165] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T21:38:22.547625] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-02.
[2025-10-24T21:38:22.600080] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T21:38:23.347711] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-02.
[2025-10-24T21:38:23.883343] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T21:38:24.147695] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-03.
[2025-10-24T21:38:24.916337] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T21:38:24.947699] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-04.
[2025-10-24T21:38:25.014783] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-02 (1.67 seconds).
[2025-10-24T21:38:25.747684] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-03.
[2025-10-24T21:38:25.886459] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-04 (0.94 seconds).
[2025-10-24T21:38:26.547732] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-03.
[2025-10-24T21:38:27.347656] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-05.
[2025-10-24T21:38:27.415746] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T21:38:28.102208] [INFO ] [REMOTE    ] UFI: Incremental fetch complete for 2025-05 (0.75 seconds).
[2025-10-24T21:38:28.147724] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-04.
[2025-10-24T21:38:28.378208] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T21:38:28.947715] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-04.
[2025-10-24T21:38:29.612335] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-04 (1.46 seconds).
[2025-10-24T21:38:29.747770] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-05.
[2025-10-24T21:38:30.547686] [INFO ] [REMOTE    ] UFI: Fetching primary data for 2025-06.
[2025-10-24T21:38:30.638379] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T21:38:30.650832] [DEBUG] [REMOTE    ] UFI: Error fetching primary data for 2025-06: 'API call returned an empty response.'
[2025-10-24T21:38:30.651169] [WARN ] [REMOTE    ] UFI: No data returned for month 2025-06
[2025-10-24T21:38:30.651254] [FATAL] [REMOTE    ] UFI: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:38:30.651339] [FATAL] [MAIN      ] UFI: Failed to fetch primary data.
[2025-10-24T21:38:30.651400] [WARN ] [MAIN      ] UFI: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:38:30.651473] [INFO ] [LOCAL     ] UFI: Starting deletion of primary data.
[2025-10-24T21:38:30.651535] [DEBUG] [LOCAL     ] UFI: No primary data file found to delete.
[2025-10-24T21:38:30.651597] [INFO ] [LOCAL     ] UFI: Starting deletion of derivative data.
[2025-10-24T21:38:30.651887] [DEBUG] [LOCAL     ] UFI: Deleted derivative data file.
[2025-10-24T21:38:30.651974] [INFO ] [MAIN      ] Update Progress: 2170/2366 symbols completed. UFI took 13.8s. Estimated remaining: 25m 9s. Rate: 7.8 symbols/min
[2025-10-24T21:38:30.824122] [INFO ] [MAIN      ] UHAL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:38:30.843240] [DEBUG] [LOCAL     ] UHAL: Loaded 16970 existing records from primary storage.
[2025-10-24T21:38:30.843476] [INFO ] [MAIN      ] UHAL: Loaded 16970 existing records.
[2025-10-24T21:38:31.018470] [WARN ] [MAIN      ] UHAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:38:31.018713] [INFO ] [MAIN      ] UHAL: Wiping existing primary data before full refresh.
[2025-10-24T21:38:31.018769] [INFO ] [LOCAL     ] UHAL: Starting deletion of primary data.
[2025-10-24T21:38:31.019000] [DEBUG] [LOCAL     ] UHAL: Deleted primary data file.
[2025-10-24T21:38:31.019058] [INFO ] [MAIN      ] UHAL: Starting full primary refresh.
[2025-10-24T21:38:31.365394] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-04.
[2025-10-24T21:38:31.393290] [INFO ] [REMOTE    ] UHAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:38:31.421121] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T21:38:32.147714] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-05.
[2025-10-24T21:38:32.947731] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-01.
[2025-10-24T21:38:33.213015] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T21:38:33.664922] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T21:38:33.747707] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-06.
[2025-10-24T21:38:33.950191] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T21:38:34.547728] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-05.
[2025-10-24T21:38:35.227205] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T21:38:35.347713] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-06.
[2025-10-24T21:38:36.147724] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-02.
[2025-10-24T21:38:36.308110] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-05 (1.76 seconds).
[2025-10-24T21:38:36.871809] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T21:38:36.947688] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-07.
[2025-10-24T21:38:37.095464] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T21:38:37.747728] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-03.
[2025-10-24T21:38:38.547734] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-07.
[2025-10-24T21:38:38.580986] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T21:38:38.730004] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T21:38:39.347718] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-08.
[2025-10-24T21:38:39.947236] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T21:38:40.147630] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-04.
[2025-10-24T21:38:40.947696] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-08.
[2025-10-24T21:38:41.107200] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-08 (1.76 seconds).
[2025-10-24T21:38:41.171798] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-04 (1.02 seconds).
[2025-10-24T21:38:41.747727] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-05.
[2025-10-24T21:38:42.460338] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T21:38:42.547701] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-06.
[2025-10-24T21:38:42.777276] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-05 (1.03 seconds).
[2025-10-24T21:38:43.347708] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-06.
[2025-10-24T21:38:44.147706] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-09.
[2025-10-24T21:38:44.311796] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T21:38:44.357674] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-06 (1.01 seconds).
[2025-10-24T21:38:44.947697] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-09.
[2025-10-24T21:38:45.749198] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-07.
[2025-10-24T21:38:45.754705] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T21:38:46.528258] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T21:38:46.547636] [INFO ] [REMOTE    ] UGP: Fetching primary data for 2025-10.
[2025-10-24T21:38:47.347766] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-07.
[2025-10-24T21:38:48.134681] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-07 (2.39 seconds).
[2025-10-24T21:38:48.147614] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-08.
[2025-10-24T21:38:48.649790] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T21:38:48.815427] [INFO ] [REMOTE    ] UGP: Incremental fetch complete for 2025-10 (2.27 seconds).
[2025-10-24T21:38:48.823845] [INFO ] [REMOTE    ] UGP: Full fetch complete (62219 records).
[2025-10-24T21:38:48.824002] [DEBUG] [VALIDATOR ] UGP: Validating primary data.
[2025-10-24T21:38:48.952869] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-08.
[2025-10-24T21:38:49.224920] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present.
[2025-10-24T21:38:49.225008] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed.
[2025-10-24T21:38:49.226067] [INFO ] [MAIN      ] UGP: Fetched primary data is valid.
[2025-10-24T21:38:49.226133] [DEBUG] [LOCAL     ] UGP: Saving primary data.
[2025-10-24T21:38:49.226709] [FATAL] [LOCAL     ] UGP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:38:49.226801] [FATAL] [MAIN      ] UGP: Failed to save primary data.
[2025-10-24T21:38:49.226844] [WARN ] [MAIN      ] UGP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:38:49.226907] [INFO ] [LOCAL     ] UGP: Starting deletion of primary data.
[2025-10-24T21:38:49.226969] [DEBUG] [LOCAL     ] UGP: No primary data file found to delete.
[2025-10-24T21:38:49.227005] [INFO ] [LOCAL     ] UGP: Starting deletion of derivative data.
[2025-10-24T21:38:49.227178] [DEBUG] [LOCAL     ] UGP: Deleted derivative data file.
[2025-10-24T21:38:49.227752] [INFO ] [MAIN      ] Update Progress: 2171/2366 symbols completed. UGP took 29.2s. Estimated remaining: 25m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:38:49.399769] [INFO ] [MAIN      ] UHS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:38:49.399982] [DEBUG] [LOCAL     ] UHS: No existing data file found in primary storage.
[2025-10-24T21:38:49.400036] [WARN ] [MAIN      ] UHS: No existing data found, performing full refresh instead.
[2025-10-24T21:38:49.400151] [INFO ] [MAIN      ] UHS: Wiping existing primary data before full refresh.
[2025-10-24T21:38:49.400193] [INFO ] [LOCAL     ] UHS: Starting deletion of primary data.
[2025-10-24T21:38:49.400234] [DEBUG] [LOCAL     ] UHS: No primary data file found to delete.
[2025-10-24T21:38:49.400270] [INFO ] [MAIN      ] UHS: Starting full primary refresh.
[2025-10-24T21:38:49.749568] [INFO ] [REMOTE    ] UE: Fetching primary data for 2025-10.
[2025-10-24T21:38:49.771962] [INFO ] [REMOTE    ] UHS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:38:49.806040] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T21:38:50.105998] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T21:38:50.547728] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-01.
[2025-10-24T21:38:50.969132] [INFO ] [REMOTE    ] UE: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T21:38:50.976697] [INFO ] [REMOTE    ] UE: Full fetch complete (60961 records).
[2025-10-24T21:38:50.976858] [DEBUG] [VALIDATOR ] UE: Validating primary data.
[2025-10-24T21:38:51.350520] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-09.
[2025-10-24T21:38:51.369855] [DEBUG] [VALIDATOR ] UE: All expected trading days are present.
[2025-10-24T21:38:51.369982] [DEBUG] [VALIDATOR ] UE: Primary data validation passed.
[2025-10-24T21:38:51.371053] [INFO ] [MAIN      ] UE: Fetched primary data is valid.
[2025-10-24T21:38:51.371227] [DEBUG] [LOCAL     ] UE: Saving primary data.
[2025-10-24T21:38:51.371868] [FATAL] [LOCAL     ] UE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:38:51.371953] [FATAL] [MAIN      ] UE: Failed to save primary data.
[2025-10-24T21:38:51.372000] [WARN ] [MAIN      ] UE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:38:51.372064] [INFO ] [LOCAL     ] UE: Starting deletion of primary data.
[2025-10-24T21:38:51.372139] [DEBUG] [LOCAL     ] UE: No primary data file found to delete.
[2025-10-24T21:38:51.372197] [INFO ] [LOCAL     ] UE: Starting deletion of derivative data.
[2025-10-24T21:38:51.372388] [DEBUG] [LOCAL     ] UE: Deleted derivative data file.
[2025-10-24T21:38:51.372945] [INFO ] [MAIN      ] Update Progress: 2172/2366 symbols completed. UE took 38.6s. Estimated remaining: 24m 54s. Rate: 7.8 symbols/min
[2025-10-24T21:38:51.540824] [INFO ] [MAIN      ] UHT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:38:51.553259] [DEBUG] [LOCAL     ] UHT: Loaded 10280 existing records from primary storage.
[2025-10-24T21:38:51.553476] [INFO ] [MAIN      ] UHT: Loaded 10280 existing records.
[2025-10-24T21:38:51.731723] [WARN ] [MAIN      ] UHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:38:51.731952] [INFO ] [MAIN      ] UHT: Wiping existing primary data before full refresh.
[2025-10-24T21:38:51.731999] [INFO ] [LOCAL     ] UHT: Starting deletion of primary data.
[2025-10-24T21:38:51.732210] [DEBUG] [LOCAL     ] UHT: Deleted primary data file.
[2025-10-24T21:38:51.732265] [INFO ] [MAIN      ] UHT: Starting full primary refresh.
[2025-10-24T21:38:52.092696] [INFO ] [REMOTE    ] UHT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:38:52.113848] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T21:38:52.147630] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-01.
[2025-10-24T21:38:52.523831] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T21:38:52.689951] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-01 (0.54 seconds).
[2025-10-24T21:38:52.947728] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-02.
[2025-10-24T21:38:53.747724] [INFO ] [REMOTE    ] UHAL: Fetching primary data for 2025-10.
[2025-10-24T21:38:54.546736] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T21:38:54.554260] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-09.
[2025-10-24T21:38:54.745552] [INFO ] [REMOTE    ] UHAL: Incremental fetch complete for 2025-10 (1.00 seconds).
[2025-10-24T21:38:54.749108] [INFO ] [REMOTE    ] UHAL: Full fetch complete (23401 records).
[2025-10-24T21:38:54.749192] [DEBUG] [VALIDATOR ] UHAL: Validating primary data.
[2025-10-24T21:38:55.114696] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present.
[2025-10-24T21:38:55.114777] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed.
[2025-10-24T21:38:55.115257] [INFO ] [MAIN      ] UHAL: Fetched primary data is valid.
[2025-10-24T21:38:55.115294] [DEBUG] [LOCAL     ] UHAL: Saving primary data.
[2025-10-24T21:38:55.115553] [FATAL] [LOCAL     ] UHAL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:38:55.115633] [FATAL] [MAIN      ] UHAL: Failed to save primary data.
[2025-10-24T21:38:55.115710] [WARN ] [MAIN      ] UHAL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:38:55.115750] [INFO ] [LOCAL     ] UHAL: Starting deletion of primary data.
[2025-10-24T21:38:55.115799] [DEBUG] [LOCAL     ] UHAL: No primary data file found to delete.
[2025-10-24T21:38:55.115880] [INFO ] [LOCAL     ] UHAL: Starting deletion of derivative data.
[2025-10-24T21:38:55.116066] [DEBUG] [LOCAL     ] UHAL: Deleted derivative data file.
[2025-10-24T21:38:55.116160] [INFO ] [MAIN      ] Update Progress: 2173/2366 symbols completed. UHAL took 24.5s. Estimated remaining: 24m 46s. Rate: 7.8 symbols/min
[2025-10-24T21:38:55.283201] [INFO ] [MAIN      ] UI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:38:55.299296] [DEBUG] [LOCAL     ] UI: Loaded 14283 existing records from primary storage.
[2025-10-24T21:38:55.299557] [INFO ] [MAIN      ] UI: Loaded 14283 existing records.
[2025-10-24T21:38:55.353518] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-02.
[2025-10-24T21:38:55.479776] [WARN ] [MAIN      ] UI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:38:55.480004] [INFO ] [MAIN      ] UI: Wiping existing primary data before full refresh.
[2025-10-24T21:38:55.480050] [INFO ] [LOCAL     ] UI: Starting deletion of primary data.
[2025-10-24T21:38:55.480230] [DEBUG] [LOCAL     ] UI: Deleted primary data file.
[2025-10-24T21:38:55.480269] [INFO ] [MAIN      ] UI: Starting full primary refresh.
[2025-10-24T21:38:55.872909] [INFO ] [REMOTE    ] UI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:38:56.147677] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-01.
[2025-10-24T21:38:56.183302] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T21:38:56.312919] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T21:38:56.947690] [INFO ] [REMOTE    ] UGI: Fetching primary data for 2025-10.
[2025-10-24T21:38:57.046400] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-01 (0.90 seconds).
[2025-10-24T21:38:57.747739] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-02.
[2025-10-24T21:38:58.475702] [INFO ] [REMOTE    ] UGI: Incremental fetch complete for 2025-10 (1.53 seconds).
[2025-10-24T21:38:58.485571] [INFO ] [REMOTE    ] UGI: Full fetch complete (73392 records).
[2025-10-24T21:38:58.485776] [DEBUG] [VALIDATOR ] UGI: Validating primary data.
[2025-10-24T21:38:58.553139] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-03.
[2025-10-24T21:38:58.841763] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T21:38:58.914434] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present.
[2025-10-24T21:38:58.914515] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed.
[2025-10-24T21:38:58.915679] [INFO ] [MAIN      ] UGI: Fetched primary data is valid.
[2025-10-24T21:38:58.915741] [DEBUG] [LOCAL     ] UGI: Saving primary data.
[2025-10-24T21:38:58.916355] [FATAL] [LOCAL     ] UGI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:38:58.916480] [FATAL] [MAIN      ] UGI: Failed to save primary data.
[2025-10-24T21:38:58.916549] [WARN ] [MAIN      ] UGI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:38:58.916619] [INFO ] [LOCAL     ] UGI: Starting deletion of primary data.
[2025-10-24T21:38:58.916718] [DEBUG] [LOCAL     ] UGI: No primary data file found to delete.
[2025-10-24T21:38:58.916763] [INFO ] [LOCAL     ] UGI: Starting deletion of derivative data.
[2025-10-24T21:38:58.916943] [DEBUG] [LOCAL     ] UGI: Deleted derivative data file.
[2025-10-24T21:38:58.917262] [INFO ] [MAIN      ] Update Progress: 2174/2366 symbols completed. UGI took 41.6s. Estimated remaining: 24m 38s. Rate: 7.8 symbols/min
[2025-10-24T21:38:59.108556] [INFO ] [MAIN      ] UIS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:38:59.142594] [DEBUG] [LOCAL     ] UIS: Loaded 36820 existing records from primary storage.
[2025-10-24T21:38:59.142895] [INFO ] [MAIN      ] UIS: Loaded 36820 existing records.
[2025-10-24T21:38:59.258700] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-03 (0.71 seconds).
[2025-10-24T21:38:59.332638] [WARN ] [MAIN      ] UIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:38:59.332877] [INFO ] [MAIN      ] UIS: Wiping existing primary data before full refresh.
[2025-10-24T21:38:59.332927] [INFO ] [LOCAL     ] UIS: Starting deletion of primary data.
[2025-10-24T21:38:59.333231] [DEBUG] [LOCAL     ] UIS: Deleted primary data file.
[2025-10-24T21:38:59.333269] [INFO ] [MAIN      ] UIS: Starting full primary refresh.
[2025-10-24T21:38:59.353590] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-03.
[2025-10-24T21:38:59.689704] [INFO ] [REMOTE    ] UIS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:39:00.147636] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-04.
[2025-10-24T21:39:00.343542] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T21:39:00.947697] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-01.
[2025-10-24T21:39:01.050847] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-04 (0.90 seconds).
[2025-10-24T21:39:01.747703] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-03.
[2025-10-24T21:39:02.266139] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-01 (1.32 seconds).
[2025-10-24T21:39:02.547695] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-02.
[2025-10-24T21:39:03.347714] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-05.
[2025-10-24T21:39:03.647280] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-03 (1.90 seconds).
[2025-10-24T21:39:03.859307] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T21:39:03.872684] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-05 (0.52 seconds).
[2025-10-24T21:39:04.147690] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-04.
[2025-10-24T21:39:04.947681] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-04.
[2025-10-24T21:39:05.116176] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-04 (0.97 seconds).
[2025-10-24T21:39:05.747725] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-05.
[2025-10-24T21:39:06.547720] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-03.
[2025-10-24T21:39:06.579553] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T21:39:06.748402] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T21:39:07.347707] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-05.
[2025-10-24T21:39:07.957689] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T21:39:08.147728] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-06.
[2025-10-24T21:39:08.935871] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-05 (1.59 seconds).
[2025-10-24T21:39:08.947632] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-06.
[2025-10-24T21:39:08.972460] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-06 (0.82 seconds).
[2025-10-24T21:39:09.747740] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-06.
[2025-10-24T21:39:10.392168] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T21:39:10.545377] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T21:39:10.548114] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-07.
[2025-10-24T21:39:11.347716] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-07.
[2025-10-24T21:39:11.586748] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T21:39:12.147700] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-08.
[2025-10-24T21:39:12.947718] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-07.
[2025-10-24T21:39:13.194588] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-07 (1.85 seconds).
[2025-10-24T21:39:13.242303] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T21:39:13.747783] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-08.
[2025-10-24T21:39:13.791292] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T21:39:14.547749] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-08.
[2025-10-24T21:39:15.089233] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T21:39:15.347713] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-09.
[2025-10-24T21:39:15.359873] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T21:39:16.147687] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-04.
[2025-10-24T21:39:16.418364] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T21:39:16.947720] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-09.
[2025-10-24T21:39:17.747731] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-09.
[2025-10-24T21:39:18.519194] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T21:39:18.547684] [INFO ] [REMOTE    ] UHS: Fetching primary data for 2025-10.
[2025-10-24T21:39:19.347723] [INFO ] [REMOTE    ] UI: Fetching primary data for 2025-10.
[2025-10-24T21:39:19.935499] [INFO ] [REMOTE    ] UHS: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T21:39:19.942303] [INFO ] [REMOTE    ] UHS: Full fetch complete (58172 records).
[2025-10-24T21:39:19.942464] [DEBUG] [VALIDATOR ] UHS: Validating primary data.
[2025-10-24T21:39:20.333275] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-04 (4.19 seconds).
[2025-10-24T21:39:20.395054] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present.
[2025-10-24T21:39:20.395584] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-05.
[2025-10-24T21:39:20.396054] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed.
[2025-10-24T21:39:20.397525] [INFO ] [MAIN      ] UHS: Fetched primary data is valid.
[2025-10-24T21:39:20.398429] [DEBUG] [LOCAL     ] UHS: Saving primary data.
[2025-10-24T21:39:20.399113] [FATAL] [LOCAL     ] UHS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:39:20.399208] [FATAL] [MAIN      ] UHS: Failed to save primary data.
[2025-10-24T21:39:20.399252] [WARN ] [MAIN      ] UHS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:39:20.399291] [INFO ] [LOCAL     ] UHS: Starting deletion of primary data.
[2025-10-24T21:39:20.399351] [DEBUG] [LOCAL     ] UHS: No primary data file found to delete.
[2025-10-24T21:39:20.399388] [INFO ] [LOCAL     ] UHS: Starting deletion of derivative data.
[2025-10-24T21:39:20.399429] [DEBUG] [LOCAL     ] UHS: No derivative data file found to delete.
[2025-10-24T21:39:20.399871] [INFO ] [MAIN      ] Update Progress: 2175/2366 symbols completed. UHS took 31.2s. Estimated remaining: 24m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:39:20.538977] [INFO ] [REMOTE    ] UI: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T21:39:20.595437] [INFO ] [REMOTE    ] UI: Full fetch complete (19845 records).
[2025-10-24T21:39:20.595256] [INFO ] [MAIN      ] UL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:39:20.596014] [DEBUG] [VALIDATOR ] UI: Validating primary data.
[2025-10-24T21:39:20.948110] [DEBUG] [LOCAL     ] UL: Loaded 53459 existing records from primary storage.
[2025-10-24T21:39:20.966057] [INFO ] [MAIN      ] UL: Loaded 53459 existing records.
[2025-10-24T21:39:21.158574] [DEBUG] [VALIDATOR ] UI: All expected trading days are present.
[2025-10-24T21:39:21.164757] [DEBUG] [VALIDATOR ] UI: Primary data validation passed.
[2025-10-24T21:39:21.187304] [INFO ] [MAIN      ] UI: Fetched primary data is valid.
[2025-10-24T21:39:21.221077] [DEBUG] [LOCAL     ] UI: Saving primary data.
[2025-10-24T21:39:21.240807] [WARN ] [MAIN      ] UL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:39:21.241497] [INFO ] [MAIN      ] UL: Wiping existing primary data before full refresh.
[2025-10-24T21:39:21.241588] [INFO ] [LOCAL     ] UL: Starting deletion of primary data.
[2025-10-24T21:39:21.241166] [FATAL] [LOCAL     ] UI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:39:21.241798] [FATAL] [MAIN      ] UI: Failed to save primary data.
[2025-10-24T21:39:21.241878] [WARN ] [MAIN      ] UI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:39:21.241954] [INFO ] [LOCAL     ] UI: Starting deletion of primary data.
[2025-10-24T21:39:21.242006] [DEBUG] [LOCAL     ] UL: Deleted primary data file.
[2025-10-24T21:39:21.242166] [DEBUG] [LOCAL     ] UI: No primary data file found to delete.
[2025-10-24T21:39:21.242275] [INFO ] [MAIN      ] UL: Starting full primary refresh.
[2025-10-24T21:39:21.242399] [INFO ] [LOCAL     ] UI: Starting deletion of derivative data.
[2025-10-24T21:39:21.305874] [DEBUG] [LOCAL     ] UI: Deleted derivative data file.
[2025-10-24T21:39:21.317498] [INFO ] [MAIN      ] Update Progress: 2176/2366 symbols completed. UI took 26.2s. Estimated remaining: 24m 23s. Rate: 7.8 symbols/min
[2025-10-24T21:39:21.728329] [INFO ] [MAIN      ] ULS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:39:21.826289] [INFO ] [REMOTE    ] UL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:39:21.827415] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-01.
[2025-10-24T21:39:21.860563] [DEBUG] [LOCAL     ] ULS: Loaded 38712 existing records from primary storage.
[2025-10-24T21:39:21.861317] [INFO ] [MAIN      ] ULS: Loaded 38712 existing records.
[2025-10-24T21:39:22.051374] [WARN ] [MAIN      ] ULS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:39:22.051830] [INFO ] [MAIN      ] ULS: Wiping existing primary data before full refresh.
[2025-10-24T21:39:22.051893] [INFO ] [LOCAL     ] ULS: Starting deletion of primary data.
[2025-10-24T21:39:22.052622] [DEBUG] [LOCAL     ] ULS: Deleted primary data file.
[2025-10-24T21:39:22.052721] [INFO ] [MAIN      ] ULS: Starting full primary refresh.
[2025-10-24T21:39:22.429153] [INFO ] [REMOTE    ] ULS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:39:22.429572] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-01.
[2025-10-24T21:39:23.639312] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T21:39:23.645676] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-02.
[2025-10-24T21:39:23.943080] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-09 (7.00 seconds).
[2025-10-24T21:39:23.945949] [INFO ] [REMOTE    ] UHT: Fetching primary data for 2025-10.
[2025-10-24T21:39:25.090251] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T21:39:25.097237] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-03.
[2025-10-24T21:39:26.508772] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T21:39:26.516518] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-04.
[2025-10-24T21:39:28.074757] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T21:39:28.084294] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-05.
[2025-10-24T21:39:29.604311] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T21:39:29.612957] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-06.
[2025-10-24T21:39:31.049788] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-06 (1.44 seconds).
[2025-10-24T21:39:31.061589] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-07.
[2025-10-24T21:39:32.506054] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T21:39:32.514500] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-08.
[2025-10-24T21:39:33.181122] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-05 (12.79 seconds).
[2025-10-24T21:39:33.189521] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-06.
[2025-10-24T21:39:34.037474] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-08 (1.52 seconds).
[2025-10-24T21:39:34.048532] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-09.
[2025-10-24T21:39:34.465520] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T21:39:34.476515] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-07.
[2025-10-24T21:39:35.523694] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-09 (1.48 seconds).
[2025-10-24T21:39:35.532188] [INFO ] [REMOTE    ] ULS: Fetching primary data for 2025-10.
[2025-10-24T21:39:35.917715] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T21:39:35.925393] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-08.
[2025-10-24T21:39:36.558491] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-01 (14.73 seconds).
[2025-10-24T21:39:36.569437] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-02.
[2025-10-24T21:39:36.995376] [INFO ] [REMOTE    ] UHT: Incremental fetch complete for 2025-10 (13.05 seconds).
[2025-10-24T21:39:36.998159] [INFO ] [REMOTE    ] UHT: Full fetch complete (15019 records).
[2025-10-24T21:39:36.998227] [DEBUG] [VALIDATOR ] UHT: Validating primary data.
[2025-10-24T21:39:37.367096] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present.
[2025-10-24T21:39:37.367169] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed.
[2025-10-24T21:39:37.367507] [INFO ] [MAIN      ] UHT: Fetched primary data is valid.
[2025-10-24T21:39:37.367546] [DEBUG] [LOCAL     ] UHT: Saving primary data.
[2025-10-24T21:39:37.367837] [FATAL] [LOCAL     ] UHT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:39:37.367916] [FATAL] [MAIN      ] UHT: Failed to save primary data.
[2025-10-24T21:39:37.367957] [WARN ] [MAIN      ] UHT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:39:37.367991] [INFO ] [LOCAL     ] UHT: Starting deletion of primary data.
[2025-10-24T21:39:37.368057] [DEBUG] [LOCAL     ] UHT: No primary data file found to delete.
[2025-10-24T21:39:37.368126] [INFO ] [LOCAL     ] UHT: Starting deletion of derivative data.
[2025-10-24T21:39:37.368339] [DEBUG] [LOCAL     ] UHT: Deleted derivative data file.
[2025-10-24T21:39:37.368443] [INFO ] [MAIN      ] Update Progress: 2177/2366 symbols completed. UHT took 46.0s. Estimated remaining: 24m 16s. Rate: 7.8 symbols/min
[2025-10-24T21:39:37.560269] [INFO ] [MAIN      ] UMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:39:37.608534] [DEBUG] [LOCAL     ] UMC: Loaded 53054 existing records from primary storage.
[2025-10-24T21:39:37.608880] [INFO ] [MAIN      ] UMC: Loaded 53054 existing records.
[2025-10-24T21:39:37.799014] [WARN ] [MAIN      ] UMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:39:37.800233] [INFO ] [MAIN      ] UMC: Wiping existing primary data before full refresh.
[2025-10-24T21:39:37.800293] [INFO ] [LOCAL     ] UMC: Starting deletion of primary data.
[2025-10-24T21:39:37.800502] [DEBUG] [LOCAL     ] UMC: Deleted primary data file.
[2025-10-24T21:39:37.800541] [INFO ] [MAIN      ] UMC: Starting full primary refresh.
[2025-10-24T21:39:38.185058] [INFO ] [REMOTE    ] ULS: Incremental fetch complete for 2025-10 (2.65 seconds).
[2025-10-24T21:39:38.190187] [INFO ] [REMOTE    ] UMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:39:38.196792] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-01.
[2025-10-24T21:39:38.198914] [INFO ] [REMOTE    ] ULS: Full fetch complete (53725 records).
[2025-10-24T21:39:38.199094] [DEBUG] [VALIDATOR ] ULS: Validating primary data.
[2025-10-24T21:39:38.530182] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-02 (1.96 seconds).
[2025-10-24T21:39:38.580421] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-03.
[2025-10-24T21:39:38.635757] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present.
[2025-10-24T21:39:38.635858] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed.
[2025-10-24T21:39:38.636907] [INFO ] [MAIN      ] ULS: Fetched primary data is valid.
[2025-10-24T21:39:38.636970] [DEBUG] [LOCAL     ] ULS: Saving primary data.
[2025-10-24T21:39:38.637535] [FATAL] [LOCAL     ] ULS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:39:38.638145] [FATAL] [MAIN      ] ULS: Failed to save primary data.
[2025-10-24T21:39:38.638253] [WARN ] [MAIN      ] ULS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:39:38.638325] [INFO ] [LOCAL     ] ULS: Starting deletion of primary data.
[2025-10-24T21:39:38.638394] [DEBUG] [LOCAL     ] ULS: No primary data file found to delete.
[2025-10-24T21:39:38.638432] [INFO ] [LOCAL     ] ULS: Starting deletion of derivative data.
[2025-10-24T21:39:38.638577] [DEBUG] [LOCAL     ] ULS: Deleted derivative data file.
[2025-10-24T21:39:38.639303] [INFO ] [MAIN      ] Update Progress: 2178/2366 symbols completed. ULS took 17.3s. Estimated remaining: 24m 8s. Rate: 7.8 symbols/min
[2025-10-24T21:39:38.812733] [INFO ] [MAIN      ] UMH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:39:38.848538] [DEBUG] [LOCAL     ] UMH: Loaded 34448 existing records from primary storage.
[2025-10-24T21:39:38.848827] [INFO ] [MAIN      ] UMH: Loaded 34448 existing records.
[2025-10-24T21:39:39.036371] [WARN ] [MAIN      ] UMH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:39:39.036681] [INFO ] [MAIN      ] UMH: Wiping existing primary data before full refresh.
[2025-10-24T21:39:39.036742] [INFO ] [LOCAL     ] UMH: Starting deletion of primary data.
[2025-10-24T21:39:39.037108] [DEBUG] [LOCAL     ] UMH: Deleted primary data file.
[2025-10-24T21:39:39.037150] [INFO ] [MAIN      ] UMH: Starting full primary refresh.
[2025-10-24T21:39:39.397709] [INFO ] [REMOTE    ] UMH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:39:39.398092] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-01.
[2025-10-24T21:39:39.421035] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-08 (3.50 seconds).
[2025-10-24T21:39:39.430199] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-09.
[2025-10-24T21:39:40.447226] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-03 (1.87 seconds).
[2025-10-24T21:39:40.459397] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-04.
[2025-10-24T21:39:40.625365] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T21:39:40.653782] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-02.
[2025-10-24T21:39:40.657939] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-01 (2.46 seconds).
[2025-10-24T21:39:40.670181] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-02.
[2025-10-24T21:39:41.151393] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T21:39:41.159366] [INFO ] [REMOTE    ] UIS: Fetching primary data for 2025-10.
[2025-10-24T21:39:41.613977] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-02 (0.96 seconds).
[2025-10-24T21:39:41.619265] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-03.
[2025-10-24T21:39:42.346079] [INFO ] [REMOTE    ] UIS: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T21:39:42.383566] [INFO ] [REMOTE    ] UIS: Full fetch complete (52015 records).
[2025-10-24T21:39:42.384963] [DEBUG] [VALIDATOR ] UIS: Validating primary data.
[2025-10-24T21:39:42.386899] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T21:39:42.444519] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-03.
[2025-10-24T21:39:42.791736] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-04 (2.33 seconds).
[2025-10-24T21:39:42.846963] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present.
[2025-10-24T21:39:42.854849] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed.
[2025-10-24T21:39:42.854742] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-05.
[2025-10-24T21:39:42.866755] [INFO ] [MAIN      ] UIS: Fetched primary data is valid.
[2025-10-24T21:39:42.866874] [DEBUG] [LOCAL     ] UIS: Saving primary data.
[2025-10-24T21:39:42.869250] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T21:39:42.869484] [FATAL] [LOCAL     ] UIS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:39:42.876587] [FATAL] [MAIN      ] UIS: Failed to save primary data.
[2025-10-24T21:39:42.877410] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-04.
[2025-10-24T21:39:42.878367] [WARN ] [MAIN      ] UIS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:39:42.878450] [INFO ] [LOCAL     ] UIS: Starting deletion of primary data.
[2025-10-24T21:39:42.878517] [DEBUG] [LOCAL     ] UIS: No primary data file found to delete.
[2025-10-24T21:39:42.878554] [INFO ] [LOCAL     ] UIS: Starting deletion of derivative data.
[2025-10-24T21:39:42.878722] [DEBUG] [LOCAL     ] UIS: Deleted derivative data file.
[2025-10-24T21:39:42.878849] [INFO ] [MAIN      ] Update Progress: 2179/2366 symbols completed. UIS took 44.0s. Estimated remaining: 24m 0s. Rate: 7.8 symbols/min
[2025-10-24T21:39:43.055254] [INFO ] [MAIN      ] UNF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:39:43.068293] [DEBUG] [LOCAL     ] UNF: Loaded 11947 existing records from primary storage.
[2025-10-24T21:39:43.068528] [INFO ] [MAIN      ] UNF: Loaded 11947 existing records.
[2025-10-24T21:39:43.244010] [WARN ] [MAIN      ] UNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:39:43.244218] [INFO ] [MAIN      ] UNF: Wiping existing primary data before full refresh.
[2025-10-24T21:39:43.244268] [INFO ] [LOCAL     ] UNF: Starting deletion of primary data.
[2025-10-24T21:39:43.244424] [DEBUG] [LOCAL     ] UNF: Deleted primary data file.
[2025-10-24T21:39:43.244464] [INFO ] [MAIN      ] UNF: Starting full primary refresh.
[2025-10-24T21:39:43.601913] [INFO ] [REMOTE    ] UNF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:39:43.602209] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-01.
[2025-10-24T21:39:44.238708] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T21:39:44.249845] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-04.
[2025-10-24T21:39:44.357875] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T21:39:44.588106] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T21:39:44.829281] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-05 (1.97 seconds).
[2025-10-24T21:39:44.947724] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-02.
[2025-10-24T21:39:45.746900] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-02 (0.80 seconds).
[2025-10-24T21:39:45.749548] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-03.
[2025-10-24T21:39:46.146924] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-04 (1.90 seconds).
[2025-10-24T21:39:46.547685] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-05.
[2025-10-24T21:39:46.593135] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-03 (0.84 seconds).
[2025-10-24T21:39:47.347736] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-06.
[2025-10-24T21:39:47.860050] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-05 (1.31 seconds).
[2025-10-24T21:39:48.147759] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-04.
[2025-10-24T21:39:48.962085] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-06.
[2025-10-24T21:39:48.964480] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T21:39:49.016634] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-04 (0.87 seconds).
[2025-10-24T21:39:49.747716] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-05.
[2025-10-24T21:39:50.243260] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-06 (1.28 seconds).
[2025-10-24T21:39:50.547734] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-07.
[2025-10-24T21:39:51.347751] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-07.
[2025-10-24T21:39:51.746079] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T21:39:51.968594] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T21:39:52.147707] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-05.
[2025-10-24T21:39:52.947705] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-06.
[2025-10-24T21:39:53.250412] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-07 (1.90 seconds).
[2025-10-24T21:39:53.299553] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T21:39:53.747714] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-06.
[2025-10-24T21:39:54.547699] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-08.
[2025-10-24T21:39:54.635302] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T21:39:54.694379] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-06 (0.95 seconds).
[2025-10-24T21:39:55.347698] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-07.
[2025-10-24T21:39:56.147715] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-08.
[2025-10-24T21:39:56.366389] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T21:39:56.395801] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T21:39:56.947675] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-09.
[2025-10-24T21:39:57.302675] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T21:39:57.747718] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-07.
[2025-10-24T21:39:58.547758] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-09.
[2025-10-24T21:39:58.712750] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T21:39:59.191173] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T21:39:59.347733] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-08.
[2025-10-24T21:40:00.045686] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T21:40:00.076463] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T21:40:00.147676] [INFO ] [REMOTE    ] UL: Fetching primary data for 2025-10.
[2025-10-24T21:40:00.947721] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-08.
[2025-10-24T21:40:01.747700] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-09.
[2025-10-24T21:40:02.106182] [INFO ] [REMOTE    ] UL: Incremental fetch complete for 2025-10 (1.96 seconds).
[2025-10-24T21:40:02.116793] [INFO ] [REMOTE    ] UL: Full fetch complete (77077 records).
[2025-10-24T21:40:02.116994] [DEBUG] [VALIDATOR ] UL: Validating primary data.
[2025-10-24T21:40:02.472381] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T21:40:02.555333] [INFO ] [REMOTE    ] UNF: Fetching primary data for 2025-10.
[2025-10-24T21:40:02.557573] [DEBUG] [VALIDATOR ] UL: All expected trading days are present.
[2025-10-24T21:40:02.557794] [DEBUG] [VALIDATOR ] UL: Primary data validation passed.
[2025-10-24T21:40:02.559724] [INFO ] [MAIN      ] UL: Fetched primary data is valid.
[2025-10-24T21:40:02.559926] [DEBUG] [LOCAL     ] UL: Saving primary data.
[2025-10-24T21:40:02.561071] [FATAL] [LOCAL     ] UL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:40:02.561216] [FATAL] [MAIN      ] UL: Failed to save primary data.
[2025-10-24T21:40:02.561261] [WARN ] [MAIN      ] UL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:40:02.561299] [INFO ] [LOCAL     ] UL: Starting deletion of primary data.
[2025-10-24T21:40:02.561365] [DEBUG] [LOCAL     ] UL: No primary data file found to delete.
[2025-10-24T21:40:02.561433] [INFO ] [LOCAL     ] UL: Starting deletion of derivative data.
[2025-10-24T21:40:02.561788] [DEBUG] [LOCAL     ] UL: Deleted derivative data file.
[2025-10-24T21:40:02.562299] [INFO ] [MAIN      ] Update Progress: 2180/2366 symbols completed. UL took 42.2s. Estimated remaining: 23m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:40:02.758314] [INFO ] [MAIN      ] UNFI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:40:02.804170] [DEBUG] [LOCAL     ] UNFI: Loaded 42908 existing records from primary storage.
[2025-10-24T21:40:02.804597] [INFO ] [MAIN      ] UNFI: Loaded 42908 existing records.
[2025-10-24T21:40:03.011758] [WARN ] [MAIN      ] UNFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:40:03.041516] [INFO ] [MAIN      ] UNFI: Wiping existing primary data before full refresh.
[2025-10-24T21:40:03.041828] [INFO ] [LOCAL     ] UNFI: Starting deletion of primary data.
[2025-10-24T21:40:03.042589] [DEBUG] [LOCAL     ] UNFI: Deleted primary data file.
[2025-10-24T21:40:03.043862] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-08 (2.10 seconds).
[2025-10-24T21:40:03.042707] [INFO ] [MAIN      ] UNFI: Starting full primary refresh.
[2025-10-24T21:40:03.358224] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-09.
[2025-10-24T21:40:03.484082] [INFO ] [REMOTE    ] UNFI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:40:03.689683] [INFO ] [REMOTE    ] UNF: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T21:40:03.693432] [INFO ] [REMOTE    ] UNF: Full fetch complete (17890 records).
[2025-10-24T21:40:03.693516] [DEBUG] [VALIDATOR ] UNF: Validating primary data.
[2025-10-24T21:40:04.103937] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present.
[2025-10-24T21:40:04.104027] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed.
[2025-10-24T21:40:04.104528] [INFO ] [MAIN      ] UNF: Fetched primary data is valid.
[2025-10-24T21:40:04.104592] [DEBUG] [LOCAL     ] UNF: Saving primary data.
[2025-10-24T21:40:04.104927] [FATAL] [LOCAL     ] UNF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:40:04.105043] [FATAL] [MAIN      ] UNF: Failed to save primary data.
[2025-10-24T21:40:04.105093] [WARN ] [MAIN      ] UNF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:40:04.105158] [INFO ] [LOCAL     ] UNF: Starting deletion of primary data.
[2025-10-24T21:40:04.105241] [DEBUG] [LOCAL     ] UNF: No primary data file found to delete.
[2025-10-24T21:40:04.105317] [INFO ] [LOCAL     ] UNF: Starting deletion of derivative data.
[2025-10-24T21:40:04.105606] [DEBUG] [LOCAL     ] UNF: Deleted derivative data file.
[2025-10-24T21:40:04.105739] [INFO ] [MAIN      ] Update Progress: 2181/2366 symbols completed. UNF took 21.2s. Estimated remaining: 23m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:40:04.153072] [INFO ] [REMOTE    ] UMH: Fetching primary data for 2025-10.
[2025-10-24T21:40:04.298824] [INFO ] [MAIN      ] UNH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:40:04.360371] [DEBUG] [LOCAL     ] UNH: Loaded 54209 existing records from primary storage.
[2025-10-24T21:40:04.360831] [INFO ] [MAIN      ] UNH: Loaded 54209 existing records.
[2025-10-24T21:40:04.553901] [WARN ] [MAIN      ] UNH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:40:04.554225] [INFO ] [MAIN      ] UNH: Wiping existing primary data before full refresh.
[2025-10-24T21:40:04.554282] [INFO ] [LOCAL     ] UNH: Starting deletion of primary data.
[2025-10-24T21:40:04.555007] [DEBUG] [LOCAL     ] UNH: Deleted primary data file.
[2025-10-24T21:40:04.555076] [INFO ] [MAIN      ] UNH: Starting full primary refresh.
[2025-10-24T21:40:04.935304] [INFO ] [REMOTE    ] UNH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:40:04.947673] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-01.
[2025-10-24T21:40:05.301091] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-09 (1.94 seconds).
[2025-10-24T21:40:05.747700] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-01.
[2025-10-24T21:40:06.477530] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T21:40:06.547701] [INFO ] [REMOTE    ] UMC: Fetching primary data for 2025-10.
[2025-10-24T21:40:07.347778] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-02.
[2025-10-24T21:40:08.024923] [INFO ] [REMOTE    ] UMH: Incremental fetch complete for 2025-10 (3.87 seconds).
[2025-10-24T21:40:08.033411] [INFO ] [REMOTE    ] UMH: Full fetch complete (47477 records).
[2025-10-24T21:40:08.033773] [DEBUG] [VALIDATOR ] UMH: Validating primary data.
[2025-10-24T21:40:08.208728] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-01 (2.46 seconds).
[2025-10-24T21:40:08.241299] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-02.
[2025-10-24T21:40:08.490403] [INFO ] [REMOTE    ] UMC: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T21:40:08.569748] [INFO ] [REMOTE    ] UMC: Full fetch complete (76658 records).
[2025-10-24T21:40:08.573988] [DEBUG] [VALIDATOR ] UMC: Validating primary data.
[2025-10-24T21:40:08.574135] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present.
[2025-10-24T21:40:08.574683] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed.
[2025-10-24T21:40:08.576712] [INFO ] [MAIN      ] UMH: Fetched primary data is valid.
[2025-10-24T21:40:08.598813] [DEBUG] [LOCAL     ] UMH: Saving primary data.
[2025-10-24T21:40:08.642038] [FATAL] [LOCAL     ] UMH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:40:08.660020] [FATAL] [MAIN      ] UMH: Failed to save primary data.
[2025-10-24T21:40:08.671809] [WARN ] [MAIN      ] UMH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:40:08.684200] [INFO ] [LOCAL     ] UMH: Starting deletion of primary data.
[2025-10-24T21:40:08.690008] [DEBUG] [LOCAL     ] UMH: No primary data file found to delete.
[2025-10-24T21:40:08.700363] [INFO ] [LOCAL     ] UMH: Starting deletion of derivative data.
[2025-10-24T21:40:08.710897] [DEBUG] [LOCAL     ] UMH: Deleted derivative data file.
[2025-10-24T21:40:08.716337] [INFO ] [MAIN      ] Update Progress: 2182/2366 symbols completed. UMH took 30.1s. Estimated remaining: 23m 37s. Rate: 7.8 symbols/min
[2025-10-24T21:40:09.035264] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T21:40:09.165359] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-03.
[2025-10-24T21:40:09.155320] [INFO ] [MAIN      ] UNM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:40:09.215698] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present.
[2025-10-24T21:40:09.215845] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed.
[2025-10-24T21:40:09.217148] [INFO ] [MAIN      ] UMC: Fetched primary data is valid.
[2025-10-24T21:40:09.217231] [DEBUG] [LOCAL     ] UMC: Saving primary data.
[2025-10-24T21:40:09.217937] [FATAL] [LOCAL     ] UMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:40:09.218025] [FATAL] [MAIN      ] UMC: Failed to save primary data.
[2025-10-24T21:40:09.218068] [WARN ] [MAIN      ] UMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:40:09.218131] [INFO ] [LOCAL     ] UMC: Starting deletion of primary data.
[2025-10-24T21:40:09.218192] [DEBUG] [LOCAL     ] UMC: No primary data file found to delete.
[2025-10-24T21:40:09.218229] [INFO ] [LOCAL     ] UMC: Starting deletion of derivative data.
[2025-10-24T21:40:09.218387] [DEBUG] [LOCAL     ] UMC: Deleted derivative data file.
[2025-10-24T21:40:09.218842] [INFO ] [MAIN      ] Update Progress: 2183/2366 symbols completed. UMC took 31.9s. Estimated remaining: 23m 29s. Rate: 7.8 symbols/min
[2025-10-24T21:40:09.399414] [INFO ] [MAIN      ] UNMA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:40:09.417347] [DEBUG] [LOCAL     ] UNM: Loaded 48281 existing records from primary storage.
[2025-10-24T21:40:09.420097] [INFO ] [MAIN      ] UNM: Loaded 48281 existing records.
[2025-10-24T21:40:09.419984] [DEBUG] [LOCAL     ] UNMA: Loaded 3427 existing records from primary storage.
[2025-10-24T21:40:09.483186] [INFO ] [MAIN      ] UNMA: Loaded 3427 existing records.
[2025-10-24T21:40:09.804700] [WARN ] [MAIN      ] UNM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:40:09.822221] [INFO ] [MAIN      ] UNM: Wiping existing primary data before full refresh.
[2025-10-24T21:40:09.850711] [INFO ] [LOCAL     ] UNM: Starting deletion of primary data.
[2025-10-24T21:40:09.850503] [WARN ] [MAIN      ] UNMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:40:09.851000] [INFO ] [MAIN      ] UNMA: Wiping existing primary data before full refresh.
[2025-10-24T21:40:09.851067] [INFO ] [LOCAL     ] UNMA: Starting deletion of primary data.
[2025-10-24T21:40:09.851208] [DEBUG] [LOCAL     ] UNMA: Deleted primary data file.
[2025-10-24T21:40:09.851270] [INFO ] [MAIN      ] UNMA: Starting full primary refresh.
[2025-10-24T21:40:09.856477] [DEBUG] [LOCAL     ] UNM: Deleted primary data file.
[2025-10-24T21:40:09.874427] [INFO ] [MAIN      ] UNM: Starting full primary refresh.
[2025-10-24T21:40:10.853730] [INFO ] [REMOTE    ] UNMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:40:10.854211] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-01.
[2025-10-24T21:40:10.878483] [INFO ] [REMOTE    ] UNM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:40:10.879238] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-01.
[2025-10-24T21:40:10.932487] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-02 (2.69 seconds).
[2025-10-24T21:40:10.945892] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T21:40:11.347722] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-04.
[2025-10-24T21:40:11.527434] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-01 (0.67 seconds).
[2025-10-24T21:40:12.147717] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-03.
[2025-10-24T21:40:12.524994] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T21:40:12.860483] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T21:40:12.947706] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-02.
[2025-10-24T21:40:13.486496] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-02 (0.54 seconds).
[2025-10-24T21:40:13.747709] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-02.
[2025-10-24T21:40:14.080145] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-03 (1.93 seconds).
[2025-10-24T21:40:14.547681] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-05.
[2025-10-24T21:40:15.208179] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-02 (1.46 seconds).
[2025-10-24T21:40:15.347685] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-03.
[2025-10-24T21:40:16.111451] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T21:40:16.147672] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-06.
[2025-10-24T21:40:16.947700] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-03.
[2025-10-24T21:40:17.255154] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T21:40:17.638541] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T21:40:17.750800] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-04.
[2025-10-24T21:40:17.864517] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T21:40:18.294763] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-04 (0.54 seconds).
[2025-10-24T21:40:18.547693] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-05.
[2025-10-24T21:40:19.073091] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-05 (0.53 seconds).
[2025-10-24T21:40:19.347730] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-04.
[2025-10-24T21:40:20.147724] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-06.
[2025-10-24T21:40:20.722213] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T21:40:20.947681] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-07.
[2025-10-24T21:40:20.980176] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T21:40:21.553776] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-07 (0.61 seconds).
[2025-10-24T21:40:21.747708] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-08.
[2025-10-24T21:40:22.310149] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T21:40:22.547681] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-05.
[2025-10-24T21:40:23.347690] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-07.
[2025-10-24T21:40:24.147721] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-09.
[2025-10-24T21:40:24.692195] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-09 (0.54 seconds).
[2025-10-24T21:40:24.947738] [INFO ] [REMOTE    ] UNMA: Fetching primary data for 2025-10.
[2025-10-24T21:40:25.003303] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T21:40:25.566992] [INFO ] [REMOTE    ] UNMA: Incremental fetch complete for 2025-10 (0.62 seconds).
[2025-10-24T21:40:25.568145] [INFO ] [REMOTE    ] UNMA: Full fetch complete (5398 records).
[2025-10-24T21:40:25.568219] [DEBUG] [VALIDATOR ] UNMA: Validating primary data.
[2025-10-24T21:40:25.748870] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-08.
[2025-10-24T21:40:25.959360] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present.
[2025-10-24T21:40:25.959457] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed.
[2025-10-24T21:40:25.959674] [INFO ] [MAIN      ] UNMA: Fetched primary data is valid.
[2025-10-24T21:40:25.959738] [DEBUG] [LOCAL     ] UNMA: Saving primary data.
[2025-10-24T21:40:25.959946] [FATAL] [LOCAL     ] UNMA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:40:25.960047] [FATAL] [MAIN      ] UNMA: Failed to save primary data.
[2025-10-24T21:40:25.960098] [WARN ] [MAIN      ] UNMA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:40:25.960136] [INFO ] [LOCAL     ] UNMA: Starting deletion of primary data.
[2025-10-24T21:40:25.960210] [DEBUG] [LOCAL     ] UNMA: No primary data file found to delete.
[2025-10-24T21:40:25.960246] [INFO ] [LOCAL     ] UNMA: Starting deletion of derivative data.
[2025-10-24T21:40:25.960425] [DEBUG] [LOCAL     ] UNMA: Deleted derivative data file.
[2025-10-24T21:40:25.960513] [INFO ] [MAIN      ] Update Progress: 2184/2366 symbols completed. UNMA took 16.7s. Estimated remaining: 23m 22s. Rate: 7.8 symbols/min
[2025-10-24T21:40:26.138160] [INFO ] [MAIN      ] UNP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:40:26.188929] [DEBUG] [LOCAL     ] UNP: Loaded 53752 existing records from primary storage.
[2025-10-24T21:40:26.189255] [INFO ] [MAIN      ] UNP: Loaded 53752 existing records.
[2025-10-24T21:40:26.365973] [WARN ] [MAIN      ] UNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:40:26.366205] [INFO ] [MAIN      ] UNP: Wiping existing primary data before full refresh.
[2025-10-24T21:40:26.366250] [INFO ] [LOCAL     ] UNP: Starting deletion of primary data.
[2025-10-24T21:40:26.366754] [DEBUG] [LOCAL     ] UNP: Deleted primary data file.
[2025-10-24T21:40:26.366809] [INFO ] [MAIN      ] UNP: Starting full primary refresh.
[2025-10-24T21:40:26.551109] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-04.
[2025-10-24T21:40:26.737248] [INFO ] [REMOTE    ] UNP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:40:27.353840] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-01.
[2025-10-24T21:40:27.371062] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T21:40:28.147705] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-09.
[2025-10-24T21:40:29.117449] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-04 (2.57 seconds).
[2025-10-24T21:40:29.129401] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-05.
[2025-10-24T21:40:29.273682] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-01 (1.92 seconds).
[2025-10-24T21:40:29.725813] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-09 (1.58 seconds).
[2025-10-24T21:40:29.747734] [INFO ] [REMOTE    ] UNFI: Fetching primary data for 2025-10.
[2025-10-24T21:40:30.547718] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-02.
[2025-10-24T21:40:31.459983] [INFO ] [REMOTE    ] UNFI: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T21:40:31.468234] [INFO ] [REMOTE    ] UNFI: Full fetch complete (59891 records).
[2025-10-24T21:40:31.468333] [DEBUG] [VALIDATOR ] UNFI: Validating primary data.
[2025-10-24T21:40:31.884983] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present.
[2025-10-24T21:40:31.885074] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed.
[2025-10-24T21:40:31.886115] [INFO ] [MAIN      ] UNFI: Fetched primary data is valid.
[2025-10-24T21:40:31.886191] [DEBUG] [LOCAL     ] UNFI: Saving primary data.
[2025-10-24T21:40:31.886791] [FATAL] [LOCAL     ] UNFI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:40:31.886872] [FATAL] [MAIN      ] UNFI: Failed to save primary data.
[2025-10-24T21:40:31.886934] [WARN ] [MAIN      ] UNFI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:40:31.886999] [INFO ] [LOCAL     ] UNFI: Starting deletion of primary data.
[2025-10-24T21:40:31.887058] [DEBUG] [LOCAL     ] UNFI: No primary data file found to delete.
[2025-10-24T21:40:31.887093] [INFO ] [LOCAL     ] UNFI: Starting deletion of derivative data.
[2025-10-24T21:40:31.887240] [DEBUG] [LOCAL     ] UNFI: Deleted derivative data file.
[2025-10-24T21:40:31.887852] [INFO ] [MAIN      ] Update Progress: 2185/2366 symbols completed. UNFI took 29.3s. Estimated remaining: 23m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:40:32.070959] [INFO ] [MAIN      ] UP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:40:32.102161] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-05 (2.97 seconds).
[2025-10-24T21:40:32.114174] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-06.
[2025-10-24T21:40:32.151408] [DEBUG] [LOCAL     ] UP: Loaded 44786 existing records from primary storage.
[2025-10-24T21:40:32.151734] [INFO ] [MAIN      ] UP: Loaded 44786 existing records.
[2025-10-24T21:40:32.329700] [WARN ] [MAIN      ] UP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:40:32.330017] [INFO ] [MAIN      ] UP: Wiping existing primary data before full refresh.
[2025-10-24T21:40:32.330145] [INFO ] [LOCAL     ] UP: Starting deletion of primary data.
[2025-10-24T21:40:32.330521] [DEBUG] [LOCAL     ] UP: Deleted primary data file.
[2025-10-24T21:40:32.330581] [INFO ] [MAIN      ] UP: Starting full primary refresh.
[2025-10-24T21:40:32.486114] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-02 (1.94 seconds).
[2025-10-24T21:40:32.550080] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-03.
[2025-10-24T21:40:32.729455] [INFO ] [REMOTE    ] UP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:40:32.947706] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-01.
[2025-10-24T21:40:34.444841] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T21:40:34.453352] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-02.
[2025-10-24T21:40:34.562432] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-03 (2.01 seconds).
[2025-10-24T21:40:34.574523] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-04.
[2025-10-24T21:40:34.818191] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-06 (2.70 seconds).
[2025-10-24T21:40:35.347721] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-07.
[2025-10-24T21:40:35.821891] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T21:40:36.147629] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-03.
[2025-10-24T21:40:36.185734] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-04 (1.61 seconds).
[2025-10-24T21:40:36.440471] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-05 (13.89 seconds).
[2025-10-24T21:40:36.947709] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-06.
[2025-10-24T21:40:37.671387] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T21:40:37.747636] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-04.
[2025-10-24T21:40:38.311085] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-07 (2.96 seconds).
[2025-10-24T21:40:38.377751] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T21:40:38.547690] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-08.
[2025-10-24T21:40:39.348082] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-07.
[2025-10-24T21:40:39.348994] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-04 (1.60 seconds).
[2025-10-24T21:40:40.147707] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-05.
[2025-10-24T21:40:40.947740] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-05.
[2025-10-24T21:40:41.094924] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T21:40:41.182121] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-08 (2.63 seconds).
[2025-10-24T21:40:41.747756] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-08.
[2025-10-24T21:40:42.547703] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-09.
[2025-10-24T21:40:42.849614] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T21:40:43.018538] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-08 (1.27 seconds).
[2025-10-24T21:40:43.347754] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-09.
[2025-10-24T21:40:44.116810] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-05 (3.97 seconds).
[2025-10-24T21:40:44.147624] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-06.
[2025-10-24T21:40:44.947715] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-06.
[2025-10-24T21:40:45.087444] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T21:40:45.339532] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-09 (2.79 seconds).
[2025-10-24T21:40:45.684403] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T21:40:45.747627] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-07.
[2025-10-24T21:40:46.531962] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T21:40:46.547623] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-07.
[2025-10-24T21:40:47.347705] [INFO ] [REMOTE    ] UNH: Fetching primary data for 2025-10.
[2025-10-24T21:40:47.456007] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T21:40:48.079404] [INFO ] [REMOTE    ] UNH: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:40:48.091077] [INFO ] [REMOTE    ] UNH: Full fetch complete (77960 records).
[2025-10-24T21:40:48.091248] [DEBUG] [VALIDATOR ] UNH: Validating primary data.
[2025-10-24T21:40:48.159769] [INFO ] [REMOTE    ] UNM: Fetching primary data for 2025-10.
[2025-10-24T21:40:48.519041] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present.
[2025-10-24T21:40:48.519161] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed.
[2025-10-24T21:40:48.520415] [INFO ] [MAIN      ] UNH: Fetched primary data is valid.
[2025-10-24T21:40:48.520636] [DEBUG] [LOCAL     ] UNH: Saving primary data.
[2025-10-24T21:40:48.521431] [FATAL] [LOCAL     ] UNH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:40:48.521546] [FATAL] [MAIN      ] UNH: Failed to save primary data.
[2025-10-24T21:40:48.521588] [WARN ] [MAIN      ] UNH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:40:48.521683] [INFO ] [LOCAL     ] UNH: Starting deletion of primary data.
[2025-10-24T21:40:48.521759] [DEBUG] [LOCAL     ] UNH: No primary data file found to delete.
[2025-10-24T21:40:48.521796] [INFO ] [LOCAL     ] UNH: Starting deletion of derivative data.
[2025-10-24T21:40:48.522001] [DEBUG] [LOCAL     ] UNH: Deleted derivative data file.
[2025-10-24T21:40:48.522379] [INFO ] [MAIN      ] Update Progress: 2186/2366 symbols completed. UNH took 44.4s. Estimated remaining: 23m 7s. Rate: 7.8 symbols/min
[2025-10-24T21:40:48.699394] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-07 (2.15 seconds).
[2025-10-24T21:40:48.743561] [INFO ] [MAIN      ] UPS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:40:48.796526] [DEBUG] [LOCAL     ] UPS: Loaded 54111 existing records from primary storage.
[2025-10-24T21:40:48.796937] [INFO ] [MAIN      ] UPS: Loaded 54111 existing records.
[2025-10-24T21:40:48.954128] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-08.
[2025-10-24T21:40:48.977493] [WARN ] [MAIN      ] UPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:40:48.978614] [INFO ] [MAIN      ] UPS: Wiping existing primary data before full refresh.
[2025-10-24T21:40:48.978704] [INFO ] [LOCAL     ] UPS: Starting deletion of primary data.
[2025-10-24T21:40:48.980162] [DEBUG] [LOCAL     ] UPS: Deleted primary data file.
[2025-10-24T21:40:48.980225] [INFO ] [MAIN      ] UPS: Starting full primary refresh.
[2025-10-24T21:40:49.330031] [INFO ] [REMOTE    ] UPS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:40:49.747707] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-01.
[2025-10-24T21:40:49.848965] [INFO ] [REMOTE    ] UNM: Incremental fetch complete for 2025-10 (1.69 seconds).
[2025-10-24T21:40:49.857254] [INFO ] [REMOTE    ] UNM: Full fetch complete (69920 records).
[2025-10-24T21:40:49.857372] [DEBUG] [VALIDATOR ] UNM: Validating primary data.
[2025-10-24T21:40:50.251902] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present.
[2025-10-24T21:40:50.251979] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed.
[2025-10-24T21:40:50.253228] [INFO ] [MAIN      ] UNM: Fetched primary data is valid.
[2025-10-24T21:40:50.253291] [DEBUG] [LOCAL     ] UNM: Saving primary data.
[2025-10-24T21:40:50.253846] [FATAL] [LOCAL     ] UNM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:40:50.253938] [FATAL] [MAIN      ] UNM: Failed to save primary data.
[2025-10-24T21:40:50.253981] [WARN ] [MAIN      ] UNM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:40:50.254017] [INFO ] [LOCAL     ] UNM: Starting deletion of primary data.
[2025-10-24T21:40:50.254069] [DEBUG] [LOCAL     ] UNM: No primary data file found to delete.
[2025-10-24T21:40:50.254103] [INFO ] [LOCAL     ] UNM: Starting deletion of derivative data.
[2025-10-24T21:40:50.254253] [DEBUG] [LOCAL     ] UNM: Deleted derivative data file.
[2025-10-24T21:40:50.254757] [INFO ] [MAIN      ] Update Progress: 2187/2366 symbols completed. UNM took 41.5s. Estimated remaining: 22m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:40:50.429962] [INFO ] [MAIN      ] URI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:40:50.465089] [DEBUG] [LOCAL     ] URI: Loaded 34614 existing records from primary storage.
[2025-10-24T21:40:50.465384] [INFO ] [MAIN      ] URI: Loaded 34614 existing records.
[2025-10-24T21:40:50.556945] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-08.
[2025-10-24T21:40:50.644097] [WARN ] [MAIN      ] URI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:40:50.644287] [INFO ] [MAIN      ] URI: Wiping existing primary data before full refresh.
[2025-10-24T21:40:50.644332] [INFO ] [LOCAL     ] URI: Starting deletion of primary data.
[2025-10-24T21:40:50.644614] [DEBUG] [LOCAL     ] URI: Deleted primary data file.
[2025-10-24T21:40:50.644705] [INFO ] [MAIN      ] URI: Starting full primary refresh.
[2025-10-24T21:40:51.023411] [INFO ] [REMOTE    ] URI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:40:51.052158] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-08 (2.10 seconds).
[2025-10-24T21:40:51.334844] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T21:40:51.347620] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-02.
[2025-10-24T21:40:52.147701] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-01.
[2025-10-24T21:40:52.232364] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T21:40:52.947628] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-09.
[2025-10-24T21:40:53.509754] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-02 (2.16 seconds).
[2025-10-24T21:40:53.747630] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-09.
[2025-10-24T21:40:53.843464] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T21:40:54.547734] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-03.
[2025-10-24T21:40:55.048571] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-09 (2.10 seconds).
[2025-10-24T21:40:55.347693] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-02.
[2025-10-24T21:40:55.807564] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-09 (2.06 seconds).
[2025-10-24T21:40:56.147686] [INFO ] [REMOTE    ] UNP: Fetching primary data for 2025-10.
[2025-10-24T21:40:56.690393] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-03 (2.14 seconds).
[2025-10-24T21:40:56.861952] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T21:40:56.947634] [INFO ] [REMOTE    ] UP: Fetching primary data for 2025-10.
[2025-10-24T21:40:56.994993] [INFO ] [REMOTE    ] UNP: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T21:40:57.004701] [INFO ] [REMOTE    ] UNP: Full fetch complete (77156 records).
[2025-10-24T21:40:57.004841] [DEBUG] [VALIDATOR ] UNP: Validating primary data.
[2025-10-24T21:40:57.400396] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present.
[2025-10-24T21:40:57.400483] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed.
[2025-10-24T21:40:57.401704] [INFO ] [MAIN      ] UNP: Fetched primary data is valid.
[2025-10-24T21:40:57.401771] [DEBUG] [LOCAL     ] UNP: Saving primary data.
[2025-10-24T21:40:57.402412] [FATAL] [LOCAL     ] UNP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:40:57.402505] [FATAL] [MAIN      ] UNP: Failed to save primary data.
[2025-10-24T21:40:57.402547] [WARN ] [MAIN      ] UNP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:40:57.402582] [INFO ] [LOCAL     ] UNP: Starting deletion of primary data.
[2025-10-24T21:40:57.402635] [DEBUG] [LOCAL     ] UNP: No primary data file found to delete.
[2025-10-24T21:40:57.402720] [INFO ] [LOCAL     ] UNP: Starting deletion of derivative data.
[2025-10-24T21:40:57.402888] [DEBUG] [LOCAL     ] UNP: Deleted derivative data file.
[2025-10-24T21:40:57.403151] [INFO ] [MAIN      ] Update Progress: 2188/2366 symbols completed. UNP took 31.4s. Estimated remaining: 22m 51s. Rate: 7.8 symbols/min
[2025-10-24T21:40:57.588157] [INFO ] [MAIN      ] USA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:40:57.623915] [DEBUG] [LOCAL     ] USA: Loaded 36639 existing records from primary storage.
[2025-10-24T21:40:57.624207] [INFO ] [MAIN      ] USA: Loaded 36639 existing records.
[2025-10-24T21:40:57.753000] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-03.
[2025-10-24T21:40:57.859884] [WARN ] [MAIN      ] USA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:40:57.860119] [INFO ] [MAIN      ] USA: Wiping existing primary data before full refresh.
[2025-10-24T21:40:57.860169] [INFO ] [LOCAL     ] USA: Starting deletion of primary data.
[2025-10-24T21:40:57.860417] [DEBUG] [LOCAL     ] USA: Deleted primary data file.
[2025-10-24T21:40:57.860475] [INFO ] [MAIN      ] USA: Starting full primary refresh.
[2025-10-24T21:40:58.234002] [INFO ] [REMOTE    ] USA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:40:58.547639] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-04.
[2025-10-24T21:40:58.973957] [INFO ] [REMOTE    ] UP: Incremental fetch complete for 2025-10 (2.03 seconds).
[2025-10-24T21:40:58.985325] [INFO ] [REMOTE    ] UP: Full fetch complete (63064 records).
[2025-10-24T21:40:58.985617] [DEBUG] [VALIDATOR ] UP: Validating primary data.
[2025-10-24T21:40:59.352270] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-01.
[2025-10-24T21:40:59.437273] [DEBUG] [VALIDATOR ] UP: All expected trading days are present.
[2025-10-24T21:40:59.437523] [DEBUG] [VALIDATOR ] UP: Primary data validation passed.
[2025-10-24T21:40:59.438969] [INFO ] [MAIN      ] UP: Fetched primary data is valid.
[2025-10-24T21:40:59.439064] [DEBUG] [LOCAL     ] UP: Saving primary data.
[2025-10-24T21:40:59.439827] [FATAL] [LOCAL     ] UP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:40:59.439972] [FATAL] [MAIN      ] UP: Failed to save primary data.
[2025-10-24T21:40:59.440132] [WARN ] [MAIN      ] UP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:40:59.440261] [INFO ] [LOCAL     ] UP: Starting deletion of primary data.
[2025-10-24T21:40:59.440478] [DEBUG] [LOCAL     ] UP: No primary data file found to delete.
[2025-10-24T21:40:59.440607] [INFO ] [LOCAL     ] UP: Starting deletion of derivative data.
[2025-10-24T21:40:59.440823] [DEBUG] [LOCAL     ] UP: Deleted derivative data file.
[2025-10-24T21:40:59.441281] [INFO ] [MAIN      ] Update Progress: 2189/2366 symbols completed. UP took 27.6s. Estimated remaining: 22m 43s. Rate: 7.8 symbols/min
[2025-10-24T21:40:59.591873] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T21:40:59.672288] [INFO ] [MAIN      ] USAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:40:59.694861] [DEBUG] [LOCAL     ] USAC: Loaded 21803 existing records from primary storage.
[2025-10-24T21:40:59.695106] [INFO ] [MAIN      ] USAC: Loaded 21803 existing records.
[2025-10-24T21:40:59.882456] [WARN ] [MAIN      ] USAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:40:59.882687] [INFO ] [MAIN      ] USAC: Wiping existing primary data before full refresh.
[2025-10-24T21:40:59.882745] [INFO ] [LOCAL     ] USAC: Starting deletion of primary data.
[2025-10-24T21:40:59.882935] [DEBUG] [LOCAL     ] USAC: Deleted primary data file.
[2025-10-24T21:40:59.882975] [INFO ] [MAIN      ] USAC: Starting full primary refresh.
[2025-10-24T21:41:00.158557] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-04.
[2025-10-24T21:41:00.242383] [INFO ] [REMOTE    ] USAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:41:00.865906] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-04 (2.32 seconds).
[2025-10-24T21:41:00.906846] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-01 (1.55 seconds).
[2025-10-24T21:41:00.947627] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-02.
[2025-10-24T21:41:01.747724] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-05.
[2025-10-24T21:41:01.985686] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T21:41:02.251327] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T21:41:02.547744] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-03.
[2025-10-24T21:41:03.347712] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-01.
[2025-10-24T21:41:04.004446] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-03 (1.46 seconds).
[2025-10-24T21:41:04.103153] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-05 (2.36 seconds).
[2025-10-24T21:41:04.147735] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-05.
[2025-10-24T21:41:04.579748] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T21:41:04.947725] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-04.
[2025-10-24T21:41:05.315675] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-05 (1.17 seconds).
[2025-10-24T21:41:05.747704] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-02.
[2025-10-24T21:41:06.378443] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T21:41:06.547670] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-05.
[2025-10-24T21:41:06.627160] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T21:41:07.347637] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-03.
[2025-10-24T21:41:07.970044] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T21:41:08.147710] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-06.
[2025-10-24T21:41:08.609168] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-03 (1.26 seconds).
[2025-10-24T21:41:08.947716] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-04.
[2025-10-24T21:41:09.497470] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T21:41:09.747682] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-07.
[2025-10-24T21:41:10.547704] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-06.
[2025-10-24T21:41:11.150406] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-04 (2.20 seconds).
[2025-10-24T21:41:11.347751] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-05.
[2025-10-24T21:41:11.915996] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-06 (1.37 seconds).
[2025-10-24T21:41:12.147685] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-06.
[2025-10-24T21:41:12.589166] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T21:41:12.947709] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-06.
[2025-10-24T21:41:13.005678] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-07 (3.26 seconds).
[2025-10-24T21:41:13.747717] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-07.
[2025-10-24T21:41:14.120745] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-06 (1.97 seconds).
[2025-10-24T21:41:14.169824] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T21:41:14.547724] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-07.
[2025-10-24T21:41:15.103868] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T21:41:15.347623] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-08.
[2025-10-24T21:41:16.147723] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-08.
[2025-10-24T21:41:16.686728] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-08 (1.34 seconds).
[2025-10-24T21:41:16.829487] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-07 (2.28 seconds).
[2025-10-24T21:41:16.947719] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-09.
[2025-10-24T21:41:17.505868] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T21:41:17.747693] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-08.
[2025-10-24T21:41:18.333069] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-09 (1.39 seconds).
[2025-10-24T21:41:18.547702] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-07.
[2025-10-24T21:41:19.347727] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-09.
[2025-10-24T21:41:19.520019] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-07 (0.97 seconds).
[2025-10-24T21:41:19.657521] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T21:41:20.147732] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-09.
[2025-10-24T21:41:20.758786] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T21:41:20.947696] [INFO ] [REMOTE    ] USA: Fetching primary data for 2025-10.
[2025-10-24T21:41:21.747678] [INFO ] [REMOTE    ] URI: Fetching primary data for 2025-10.
[2025-10-24T21:41:22.256548] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-09 (2.11 seconds).
[2025-10-24T21:41:22.381119] [INFO ] [REMOTE    ] USA: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T21:41:22.388680] [INFO ] [REMOTE    ] USA: Full fetch complete (52514 records).
[2025-10-24T21:41:22.388804] [DEBUG] [VALIDATOR ] USA: Validating primary data.
[2025-10-24T21:41:22.547739] [INFO ] [REMOTE    ] UPS: Fetching primary data for 2025-10.
[2025-10-24T21:41:22.774527] [DEBUG] [VALIDATOR ] USA: All expected trading days are present.
[2025-10-24T21:41:22.774604] [DEBUG] [VALIDATOR ] USA: Primary data validation passed.
[2025-10-24T21:41:22.775634] [INFO ] [MAIN      ] USA: Fetched primary data is valid.
[2025-10-24T21:41:22.775717] [DEBUG] [LOCAL     ] USA: Saving primary data.
[2025-10-24T21:41:22.776203] [FATAL] [LOCAL     ] USA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:41:22.776281] [FATAL] [MAIN      ] USA: Failed to save primary data.
[2025-10-24T21:41:22.776348] [WARN ] [MAIN      ] USA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:41:22.776417] [INFO ] [LOCAL     ] USA: Starting deletion of primary data.
[2025-10-24T21:41:22.776491] [DEBUG] [LOCAL     ] USA: No primary data file found to delete.
[2025-10-24T21:41:22.776527] [INFO ] [LOCAL     ] USA: Starting deletion of derivative data.
[2025-10-24T21:41:22.776692] [DEBUG] [LOCAL     ] USA: Deleted derivative data file.
[2025-10-24T21:41:22.776786] [INFO ] [MAIN      ] Update Progress: 2190/2366 symbols completed. USA took 25.4s. Estimated remaining: 22m 37s. Rate: 7.8 symbols/min
[2025-10-24T21:41:22.948325] [INFO ] [MAIN      ] USB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:41:22.992220] [INFO ] [REMOTE    ] URI: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T21:41:22.998696] [INFO ] [REMOTE    ] URI: Full fetch complete (52714 records).
[2025-10-24T21:41:22.998877] [DEBUG] [VALIDATOR ] URI: Validating primary data.
[2025-10-24T21:41:23.124218] [DEBUG] [LOCAL     ] USB: Loaded 54078 existing records from primary storage.
[2025-10-24T21:41:23.135262] [INFO ] [MAIN      ] USB: Loaded 54078 existing records.
[2025-10-24T21:41:23.356014] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-08.
[2025-10-24T21:41:23.586151] [WARN ] [MAIN      ] USB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:41:23.604942] [INFO ] [MAIN      ] USB: Wiping existing primary data before full refresh.
[2025-10-24T21:41:23.605029] [INFO ] [LOCAL     ] USB: Starting deletion of primary data.
[2025-10-24T21:41:23.605352] [DEBUG] [VALIDATOR ] URI: All expected trading days are present.
[2025-10-24T21:41:23.605690] [DEBUG] [VALIDATOR ] URI: Primary data validation passed.
[2025-10-24T21:41:23.607169] [DEBUG] [LOCAL     ] USB: Deleted primary data file.
[2025-10-24T21:41:23.607098] [INFO ] [MAIN      ] URI: Fetched primary data is valid.
[2025-10-24T21:41:23.607316] [DEBUG] [LOCAL     ] URI: Saving primary data.
[2025-10-24T21:41:23.607446] [INFO ] [MAIN      ] USB: Starting full primary refresh.
[2025-10-24T21:41:23.629936] [FATAL] [LOCAL     ] URI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:41:23.645721] [FATAL] [MAIN      ] URI: Failed to save primary data.
[2025-10-24T21:41:23.692040] [WARN ] [MAIN      ] URI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:41:23.745612] [INFO ] [LOCAL     ] URI: Starting deletion of primary data.
[2025-10-24T21:41:23.762015] [DEBUG] [LOCAL     ] URI: No primary data file found to delete.
[2025-10-24T21:41:23.769679] [INFO ] [REMOTE    ] UPS: Incremental fetch complete for 2025-10 (1.22 seconds).
[2025-10-24T21:41:23.809405] [INFO ] [LOCAL     ] URI: Starting deletion of derivative data.
[2025-10-24T21:41:23.861405] [DEBUG] [LOCAL     ] URI: Deleted derivative data file.
[2025-10-24T21:41:23.872066] [INFO ] [REMOTE    ] UPS: Full fetch complete (77880 records).
[2025-10-24T21:41:23.872503] [INFO ] [MAIN      ] Update Progress: 2191/2366 symbols completed. URI took 33.6s. Estimated remaining: 22m 28s. Rate: 7.8 symbols/min
[2025-10-24T21:41:23.900443] [DEBUG] [VALIDATOR ] UPS: Validating primary data.
[2025-10-24T21:41:24.305024] [INFO ] [REMOTE    ] USB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:41:24.345313] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-01.
[2025-10-24T21:41:24.495468] [INFO ] [MAIN      ] USFD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:41:24.549571] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-08 (1.19 seconds).
[2025-10-24T21:41:24.647770] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present.
[2025-10-24T21:41:24.647860] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed.
[2025-10-24T21:41:24.649079] [INFO ] [MAIN      ] UPS: Fetched primary data is valid.
[2025-10-24T21:41:24.649164] [DEBUG] [LOCAL     ] UPS: Saving primary data.
[2025-10-24T21:41:24.649868] [FATAL] [LOCAL     ] UPS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:41:24.649979] [FATAL] [MAIN      ] UPS: Failed to save primary data.
[2025-10-24T21:41:24.650024] [WARN ] [MAIN      ] UPS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:41:24.650087] [INFO ] [LOCAL     ] UPS: Starting deletion of primary data.
[2025-10-24T21:41:24.650150] [DEBUG] [LOCAL     ] UPS: No primary data file found to delete.
[2025-10-24T21:41:24.650185] [INFO ] [LOCAL     ] UPS: Starting deletion of derivative data.
[2025-10-24T21:41:24.650339] [DEBUG] [LOCAL     ] UPS: Deleted derivative data file.
[2025-10-24T21:41:24.650937] [INFO ] [MAIN      ] Update Progress: 2192/2366 symbols completed. UPS took 36.1s. Estimated remaining: 22m 20s. Rate: 7.8 symbols/min
[2025-10-24T21:41:24.848190] [INFO ] [MAIN      ] USNA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:41:24.849098] [DEBUG] [LOCAL     ] USFD: Loaded 51509 existing records from primary storage.
[2025-10-24T21:41:24.849922] [INFO ] [MAIN      ] USFD: Loaded 51509 existing records.
[2025-10-24T21:41:24.948403] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-09.
[2025-10-24T21:41:25.026174] [DEBUG] [LOCAL     ] USNA: Loaded 18214 existing records from primary storage.
[2025-10-24T21:41:25.046356] [WARN ] [MAIN      ] USFD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:41:25.046734] [INFO ] [MAIN      ] USFD: Wiping existing primary data before full refresh.
[2025-10-24T21:41:25.046638] [INFO ] [MAIN      ] USNA: Loaded 18214 existing records.
[2025-10-24T21:41:25.078457] [INFO ] [LOCAL     ] USFD: Starting deletion of primary data.
[2025-10-24T21:41:25.140612] [DEBUG] [LOCAL     ] USFD: Deleted primary data file.
[2025-10-24T21:41:25.149752] [INFO ] [MAIN      ] USFD: Starting full primary refresh.
[2025-10-24T21:41:25.355606] [WARN ] [MAIN      ] USNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:41:25.386875] [INFO ] [MAIN      ] USNA: Wiping existing primary data before full refresh.
[2025-10-24T21:41:25.402707] [INFO ] [LOCAL     ] USNA: Starting deletion of primary data.
[2025-10-24T21:41:25.471019] [DEBUG] [LOCAL     ] USNA: Deleted primary data file.
[2025-10-24T21:41:25.482386] [INFO ] [MAIN      ] USNA: Starting full primary refresh.
[2025-10-24T21:41:25.758116] [INFO ] [REMOTE    ] USFD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:41:25.782040] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-01.
[2025-10-24T21:41:25.958243] [INFO ] [REMOTE    ] USNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:41:26.048303] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T21:41:26.415588] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-01 (2.07 seconds).
[2025-10-24T21:41:26.547622] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-02.
[2025-10-24T21:41:27.347727] [INFO ] [REMOTE    ] USAC: Fetching primary data for 2025-10.
[2025-10-24T21:41:27.537020] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-01 (1.75 seconds).
[2025-10-24T21:41:28.151920] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-01.
[2025-10-24T21:41:28.359619] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T21:41:28.424361] [INFO ] [REMOTE    ] USAC: Incremental fetch complete for 2025-10 (1.08 seconds).
[2025-10-24T21:41:28.428726] [INFO ] [REMOTE    ] USAC: Full fetch complete (35363 records).
[2025-10-24T21:41:28.428813] [DEBUG] [VALIDATOR ] USAC: Validating primary data.
[2025-10-24T21:41:28.786578] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present.
[2025-10-24T21:41:28.786678] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed.
[2025-10-24T21:41:28.787455] [INFO ] [MAIN      ] USAC: Fetched primary data is valid.
[2025-10-24T21:41:28.787511] [DEBUG] [LOCAL     ] USAC: Saving primary data.
[2025-10-24T21:41:28.787902] [FATAL] [LOCAL     ] USAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:41:28.788013] [FATAL] [MAIN      ] USAC: Failed to save primary data.
[2025-10-24T21:41:28.788054] [WARN ] [MAIN      ] USAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:41:28.788089] [INFO ] [LOCAL     ] USAC: Starting deletion of primary data.
[2025-10-24T21:41:28.788137] [DEBUG] [LOCAL     ] USAC: No primary data file found to delete.
[2025-10-24T21:41:28.788185] [INFO ] [LOCAL     ] USAC: Starting deletion of derivative data.
[2025-10-24T21:41:28.788432] [DEBUG] [LOCAL     ] USAC: Deleted derivative data file.
[2025-10-24T21:41:28.788525] [INFO ] [MAIN      ] Update Progress: 2193/2366 symbols completed. USAC took 29.3s. Estimated remaining: 22m 12s. Rate: 7.8 symbols/min
[2025-10-24T21:41:28.953676] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-03.
[2025-10-24T21:41:28.953556] [INFO ] [MAIN      ] USPH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:41:28.973197] [DEBUG] [LOCAL     ] USPH: Loaded 17083 existing records from primary storage.
[2025-10-24T21:41:28.973435] [INFO ] [MAIN      ] USPH: Loaded 17083 existing records.
[2025-10-24T21:41:29.148693] [WARN ] [MAIN      ] USPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:41:29.148901] [INFO ] [MAIN      ] USPH: Wiping existing primary data before full refresh.
[2025-10-24T21:41:29.148946] [INFO ] [LOCAL     ] USPH: Starting deletion of primary data.
[2025-10-24T21:41:29.149152] [DEBUG] [LOCAL     ] USPH: Deleted primary data file.
[2025-10-24T21:41:29.149189] [INFO ] [MAIN      ] USPH: Starting full primary refresh.
[2025-10-24T21:41:29.335001] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T21:41:29.518719] [INFO ] [REMOTE    ] USPH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:41:29.747687] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-01.
[2025-10-24T21:41:30.547673] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-02.
[2025-10-24T21:41:30.674207] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T21:41:30.921929] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T21:41:31.347728] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-02.
[2025-10-24T21:41:31.818697] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-02 (1.27 seconds).
[2025-10-24T21:41:32.147729] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-04.
[2025-10-24T21:41:32.221216] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T21:41:32.947726] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-02.
[2025-10-24T21:41:33.747743] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-03.
[2025-10-24T21:41:34.159660] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T21:41:34.190165] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T21:41:34.547689] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-05.
[2025-10-24T21:41:34.698953] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-03 (0.95 seconds).
[2025-10-24T21:41:35.347681] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-04.
[2025-10-24T21:41:36.147750] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-03.
[2025-10-24T21:41:36.332221] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T21:41:36.467766] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-05 (1.92 seconds).
[2025-10-24T21:41:36.947711] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-06.
[2025-10-24T21:41:37.639981] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-03 (1.49 seconds).
[2025-10-24T21:41:37.747678] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-04.
[2025-10-24T21:41:38.547700] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-03.
[2025-10-24T21:41:38.633020] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T21:41:39.347724] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-05.
[2025-10-24T21:41:39.388831] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T21:41:39.622719] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-03 (1.08 seconds).
[2025-10-24T21:41:40.109630] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T21:41:40.147627] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-06.
[2025-10-24T21:41:40.947699] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-05.
[2025-10-24T21:41:41.008328] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T21:41:41.747696] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-04.
[2025-10-24T21:41:42.547719] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-07.
[2025-10-24T21:41:42.599827] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T21:41:42.935585] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-04 (1.19 seconds).
[2025-10-24T21:41:43.347732] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-05.
[2025-10-24T21:41:43.537377] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T21:41:44.147712] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-06.
[2025-10-24T21:41:44.334813] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T21:41:44.947684] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-06.
[2025-10-24T21:41:45.753509] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-07.
[2025-10-24T21:41:45.766184] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T21:41:45.857358] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T21:41:46.547690] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-07.
[2025-10-24T21:41:47.347674] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-08.
[2025-10-24T21:41:47.692236] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T21:41:47.931569] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-07 (1.38 seconds).
[2025-10-24T21:41:48.147692] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-08.
[2025-10-24T21:41:48.351009] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T21:41:48.947710] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-07.
[2025-10-24T21:41:49.583531] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T21:41:49.747751] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-09.
[2025-10-24T21:41:49.950201] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T21:41:50.547918] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-09.
[2025-10-24T21:41:51.311843] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T21:41:51.347638] [INFO ] [REMOTE    ] USFD: Fetching primary data for 2025-10.
[2025-10-24T21:41:51.360766] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-09 (0.81 seconds).
[2025-10-24T21:41:52.147698] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-08.
[2025-10-24T21:41:52.947676] [INFO ] [REMOTE    ] USPH: Fetching primary data for 2025-10.
[2025-10-24T21:41:53.115594] [INFO ] [REMOTE    ] USFD: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T21:41:53.124934] [INFO ] [REMOTE    ] USFD: Full fetch complete (74295 records).
[2025-10-24T21:41:53.125055] [DEBUG] [VALIDATOR ] USFD: Validating primary data.
[2025-10-24T21:41:53.518703] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present.
[2025-10-24T21:41:53.518823] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed.
[2025-10-24T21:41:53.520605] [INFO ] [MAIN      ] USFD: Fetched primary data is valid.
[2025-10-24T21:41:53.520729] [DEBUG] [LOCAL     ] USFD: Saving primary data.
[2025-10-24T21:41:53.521499] [FATAL] [LOCAL     ] USFD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:41:53.521608] [FATAL] [MAIN      ] USFD: Failed to save primary data.
[2025-10-24T21:41:53.521715] [WARN ] [MAIN      ] USFD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:41:53.521804] [INFO ] [LOCAL     ] USFD: Starting deletion of primary data.
[2025-10-24T21:41:53.521907] [DEBUG] [LOCAL     ] USFD: No primary data file found to delete.
[2025-10-24T21:41:53.521978] [INFO ] [LOCAL     ] USFD: Starting deletion of derivative data.
[2025-10-24T21:41:53.522391] [DEBUG] [LOCAL     ] USFD: Deleted derivative data file.
[2025-10-24T21:41:53.523152] [INFO ] [MAIN      ] Update Progress: 2194/2366 symbols completed. USFD took 29.6s. Estimated remaining: 22m 6s. Rate: 7.8 symbols/min
[2025-10-24T21:41:53.691582] [INFO ] [MAIN      ] UTF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:41:53.722260] [DEBUG] [LOCAL     ] UTF: Loaded 31254 existing records from primary storage.
[2025-10-24T21:41:53.722535] [INFO ] [MAIN      ] UTF: Loaded 31254 existing records.
[2025-10-24T21:41:53.753546] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-08.
[2025-10-24T21:41:53.903965] [WARN ] [MAIN      ] UTF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:41:53.904390] [INFO ] [MAIN      ] UTF: Wiping existing primary data before full refresh.
[2025-10-24T21:41:53.904609] [INFO ] [LOCAL     ] UTF: Starting deletion of primary data.
[2025-10-24T21:41:53.905209] [DEBUG] [LOCAL     ] UTF: Deleted primary data file.
[2025-10-24T21:41:53.905269] [INFO ] [MAIN      ] UTF: Starting full primary refresh.
[2025-10-24T21:41:54.223924] [INFO ] [REMOTE    ] USPH: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T21:41:54.289813] [INFO ] [REMOTE    ] USPH: Full fetch complete (22976 records).
[2025-10-24T21:41:54.301239] [DEBUG] [VALIDATOR ] USPH: Validating primary data.
[2025-10-24T21:41:54.322853] [INFO ] [REMOTE    ] UTF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:41:54.381901] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-08 (2.23 seconds).
[2025-10-24T21:41:54.488503] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-08 (0.73 seconds).
[2025-10-24T21:41:54.555084] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-01.
[2025-10-24T21:41:54.719164] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present.
[2025-10-24T21:41:54.719239] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed.
[2025-10-24T21:41:54.719740] [INFO ] [MAIN      ] USPH: Fetched primary data is valid.
[2025-10-24T21:41:54.719800] [DEBUG] [LOCAL     ] USPH: Saving primary data.
[2025-10-24T21:41:54.720073] [FATAL] [LOCAL     ] USPH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:41:54.720156] [FATAL] [MAIN      ] USPH: Failed to save primary data.
[2025-10-24T21:41:54.720197] [WARN ] [MAIN      ] USPH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:41:54.720231] [INFO ] [LOCAL     ] USPH: Starting deletion of primary data.
[2025-10-24T21:41:54.720280] [DEBUG] [LOCAL     ] USPH: No primary data file found to delete.
[2025-10-24T21:41:54.720314] [INFO ] [LOCAL     ] USPH: Starting deletion of derivative data.
[2025-10-24T21:41:54.720479] [DEBUG] [LOCAL     ] USPH: Deleted derivative data file.
[2025-10-24T21:41:54.720551] [INFO ] [MAIN      ] Update Progress: 2195/2366 symbols completed. USPH took 25.9s. Estimated remaining: 21m 58s. Rate: 7.8 symbols/min
[2025-10-24T21:41:54.891476] [INFO ] [MAIN      ] UTI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:41:54.930608] [DEBUG] [LOCAL     ] UTI: Loaded 40647 existing records from primary storage.
[2025-10-24T21:41:54.930939] [INFO ] [MAIN      ] UTI: Loaded 40647 existing records.
[2025-10-24T21:41:55.107411] [WARN ] [MAIN      ] UTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:41:55.107676] [INFO ] [MAIN      ] UTI: Wiping existing primary data before full refresh.
[2025-10-24T21:41:55.107735] [INFO ] [LOCAL     ] UTI: Starting deletion of primary data.
[2025-10-24T21:41:55.108226] [DEBUG] [LOCAL     ] UTI: Deleted primary data file.
[2025-10-24T21:41:55.108265] [INFO ] [MAIN      ] UTI: Starting full primary refresh.
[2025-10-24T21:41:55.352934] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-09.
[2025-10-24T21:41:55.468406] [INFO ] [REMOTE    ] UTI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:41:55.770566] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T21:41:56.147690] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-09.
[2025-10-24T21:41:56.710503] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T21:41:56.947715] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-01.
[2025-10-24T21:41:57.747734] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-02.
[2025-10-24T21:41:58.034546] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-09 (1.89 seconds).
[2025-10-24T21:41:58.336059] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-01 (1.39 seconds).
[2025-10-24T21:41:58.547664] [INFO ] [REMOTE    ] USB: Fetching primary data for 2025-10.
[2025-10-24T21:41:59.297456] [INFO ] [REMOTE    ] USB: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T21:41:59.307237] [INFO ] [REMOTE    ] USB: Full fetch complete (77867 records).
[2025-10-24T21:41:59.307366] [DEBUG] [VALIDATOR ] USB: Validating primary data.
[2025-10-24T21:41:59.352762] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-02.
[2025-10-24T21:41:59.598403] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T21:41:59.741141] [DEBUG] [VALIDATOR ] USB: All expected trading days are present.
[2025-10-24T21:41:59.741235] [DEBUG] [VALIDATOR ] USB: Primary data validation passed.
[2025-10-24T21:41:59.742415] [INFO ] [MAIN      ] USB: Fetched primary data is valid.
[2025-10-24T21:41:59.742479] [DEBUG] [LOCAL     ] USB: Saving primary data.
[2025-10-24T21:41:59.743128] [FATAL] [LOCAL     ] USB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:41:59.743235] [FATAL] [MAIN      ] USB: Failed to save primary data.
[2025-10-24T21:41:59.743306] [WARN ] [MAIN      ] USB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:41:59.743395] [INFO ] [LOCAL     ] USB: Starting deletion of primary data.
[2025-10-24T21:41:59.743471] [DEBUG] [LOCAL     ] USB: No primary data file found to delete.
[2025-10-24T21:41:59.743509] [INFO ] [LOCAL     ] USB: Starting deletion of derivative data.
[2025-10-24T21:41:59.743692] [DEBUG] [LOCAL     ] USB: Deleted derivative data file.
[2025-10-24T21:41:59.743971] [INFO ] [MAIN      ] Update Progress: 2196/2366 symbols completed. USB took 37.0s. Estimated remaining: 21m 50s. Rate: 7.8 symbols/min
[2025-10-24T21:41:59.913105] [INFO ] [MAIN      ] UTL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:41:59.926787] [DEBUG] [LOCAL     ] UTL: Loaded 11902 existing records from primary storage.
[2025-10-24T21:41:59.927024] [INFO ] [MAIN      ] UTL: Loaded 11902 existing records.
[2025-10-24T21:42:00.102617] [WARN ] [MAIN      ] UTL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:42:00.102870] [INFO ] [MAIN      ] UTL: Wiping existing primary data before full refresh.
[2025-10-24T21:42:00.102916] [INFO ] [LOCAL     ] UTL: Starting deletion of primary data.
[2025-10-24T21:42:00.103110] [DEBUG] [LOCAL     ] UTL: Deleted primary data file.
[2025-10-24T21:42:00.103174] [INFO ] [MAIN      ] UTL: Starting full primary refresh.
[2025-10-24T21:42:00.156194] [INFO ] [REMOTE    ] USNA: Fetching primary data for 2025-10.
[2025-10-24T21:42:00.461401] [INFO ] [REMOTE    ] UTL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:42:00.957830] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-01.
[2025-10-24T21:42:00.963100] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T21:42:01.413159] [INFO ] [REMOTE    ] USNA: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T21:42:01.417686] [INFO ] [REMOTE    ] USNA: Full fetch complete (27251 records).
[2025-10-24T21:42:01.417789] [DEBUG] [VALIDATOR ] USNA: Validating primary data.
[2025-10-24T21:42:01.760883] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-03.
[2025-10-24T21:42:01.816315] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T21:42:01.895417] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present.
[2025-10-24T21:42:01.895508] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed.
[2025-10-24T21:42:01.896185] [INFO ] [MAIN      ] USNA: Fetched primary data is valid.
[2025-10-24T21:42:01.896252] [DEBUG] [LOCAL     ] USNA: Saving primary data.
[2025-10-24T21:42:01.896724] [FATAL] [LOCAL     ] USNA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:42:01.896815] [FATAL] [MAIN      ] USNA: Failed to save primary data.
[2025-10-24T21:42:01.896858] [WARN ] [MAIN      ] USNA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:42:01.896919] [INFO ] [LOCAL     ] USNA: Starting deletion of primary data.
[2025-10-24T21:42:01.896979] [DEBUG] [LOCAL     ] USNA: No primary data file found to delete.
[2025-10-24T21:42:01.897016] [INFO ] [LOCAL     ] USNA: Starting deletion of derivative data.
[2025-10-24T21:42:01.897174] [DEBUG] [LOCAL     ] USNA: Deleted derivative data file.
[2025-10-24T21:42:01.897255] [INFO ] [MAIN      ] Update Progress: 2197/2366 symbols completed. USNA took 37.2s. Estimated remaining: 21m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:42:02.547638] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-02.
[2025-10-24T21:42:03.347703] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-03.
[2025-10-24T21:42:03.422297] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T21:42:03.469381] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-02 (0.92 seconds).
[2025-10-24T21:42:04.147685] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-04.
[2025-10-24T21:42:04.742882] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T21:42:04.947695] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-04.
[2025-10-24T21:42:05.747717] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-03.
[2025-10-24T21:42:06.252092] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T21:42:06.476850] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-04 (2.33 seconds).
[2025-10-24T21:42:06.493023] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T21:42:06.547625] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-04.
[2025-10-24T21:42:07.347636] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-05.
[2025-10-24T21:42:07.429696] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-04 (0.88 seconds).
[2025-10-24T21:42:08.147710] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-05.
[2025-10-24T21:42:08.359802] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-05 (1.01 seconds).
[2025-10-24T21:42:08.947735] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-06.
[2025-10-24T21:42:09.635241] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T21:42:09.719980] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T21:42:09.747691] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-07.
[2025-10-24T21:42:10.547676] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-06.
[2025-10-24T21:42:11.002961] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T21:42:11.347692] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-05.
[2025-10-24T21:42:12.012153] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T21:42:12.147724] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-08.
[2025-10-24T21:42:12.170636] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T21:42:12.947669] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-06.
[2025-10-24T21:42:13.383303] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-08 (1.24 seconds).
[2025-10-24T21:42:13.695329] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-06 (0.75 seconds).
[2025-10-24T21:42:13.747743] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-07.
[2025-10-24T21:42:14.547724] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-09.
[2025-10-24T21:42:15.205241] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-07 (1.46 seconds).
[2025-10-24T21:42:15.347737] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-07.
[2025-10-24T21:42:15.982389] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T21:42:16.120368] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T21:42:16.147667] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-08.
[2025-10-24T21:42:16.947775] [INFO ] [REMOTE    ] UTF: Fetching primary data for 2025-10.
[2025-10-24T21:42:17.145107] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T21:42:17.747723] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-09.
[2025-10-24T21:42:18.379481] [INFO ] [REMOTE    ] UTF: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T21:42:18.387999] [INFO ] [REMOTE    ] UTF: Full fetch complete (44082 records).
[2025-10-24T21:42:18.388155] [DEBUG] [VALIDATOR ] UTF: Validating primary data.
[2025-10-24T21:42:18.568579] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-08.
[2025-10-24T21:42:18.791330] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-09 (1.04 seconds).
[2025-10-24T21:42:18.791456] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present.
[2025-10-24T21:42:18.791723] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed.
[2025-10-24T21:42:18.792857] [INFO ] [MAIN      ] UTF: Fetched primary data is valid.
[2025-10-24T21:42:18.792946] [DEBUG] [LOCAL     ] UTF: Saving primary data.
[2025-10-24T21:42:18.796573] [FATAL] [LOCAL     ] UTF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:42:18.797434] [FATAL] [MAIN      ] UTF: Failed to save primary data.
[2025-10-24T21:42:18.797505] [WARN ] [MAIN      ] UTF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:42:18.797575] [INFO ] [LOCAL     ] UTF: Starting deletion of primary data.
[2025-10-24T21:42:18.797705] [DEBUG] [LOCAL     ] UTF: No primary data file found to delete.
[2025-10-24T21:42:18.797757] [INFO ] [LOCAL     ] UTF: Starting deletion of derivative data.
[2025-10-24T21:42:18.797940] [DEBUG] [LOCAL     ] UTF: Deleted derivative data file.
[2025-10-24T21:42:18.798027] [INFO ] [MAIN      ] Update Progress: 2198/2366 symbols completed. UTF took 25.3s. Estimated remaining: 21m 34s. Rate: 7.8 symbols/min
[2025-10-24T21:42:19.347721] [INFO ] [REMOTE    ] UTL: Fetching primary data for 2025-10.
[2025-10-24T21:42:20.054909] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T21:42:20.147617] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-09.
[2025-10-24T21:42:20.188354] [INFO ] [REMOTE    ] UTL: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T21:42:20.191199] [INFO ] [REMOTE    ] UTL: Full fetch complete (15830 records).
[2025-10-24T21:42:20.191268] [DEBUG] [VALIDATOR ] UTL: Validating primary data.
[2025-10-24T21:42:20.542008] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present.
[2025-10-24T21:42:20.542089] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed.
[2025-10-24T21:42:20.542434] [INFO ] [MAIN      ] UTL: Fetched primary data is valid.
[2025-10-24T21:42:20.542472] [DEBUG] [LOCAL     ] UTL: Saving primary data.
[2025-10-24T21:42:20.542761] [FATAL] [LOCAL     ] UTL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:42:20.542844] [FATAL] [MAIN      ] UTL: Failed to save primary data.
[2025-10-24T21:42:20.542885] [WARN ] [MAIN      ] UTL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:42:20.542928] [INFO ] [LOCAL     ] UTL: Starting deletion of primary data.
[2025-10-24T21:42:20.542976] [DEBUG] [LOCAL     ] UTL: No primary data file found to delete.
[2025-10-24T21:42:20.543052] [INFO ] [LOCAL     ] UTL: Starting deletion of derivative data.
[2025-10-24T21:42:20.543228] [DEBUG] [LOCAL     ] UTL: Deleted derivative data file.
[2025-10-24T21:42:20.543301] [INFO ] [MAIN      ] Update Progress: 2199/2366 symbols completed. UTL took 20.8s. Estimated remaining: 21m 26s. Rate: 7.8 symbols/min
[2025-10-24T21:42:21.462414] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T21:42:21.471061] [INFO ] [REMOTE    ] UTI: Fetching primary data for 2025-10.
[2025-10-24T21:42:22.913829] [INFO ] [REMOTE    ] UTI: Incremental fetch complete for 2025-10 (1.44 seconds).
[2025-10-24T21:42:22.921200] [INFO ] [REMOTE    ] UTI: Full fetch complete (59014 records).
[2025-10-24T21:42:22.921323] [DEBUG] [VALIDATOR ] UTI: Validating primary data.
[2025-10-24T21:42:23.294224] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present.
[2025-10-24T21:42:23.294302] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed.
[2025-10-24T21:42:23.295339] [INFO ] [MAIN      ] UTI: Fetched primary data is valid.
[2025-10-24T21:42:23.295418] [DEBUG] [LOCAL     ] UTI: Saving primary data.
[2025-10-24T21:42:23.295928] [FATAL] [LOCAL     ] UTI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:42:23.296017] [FATAL] [MAIN      ] UTI: Failed to save primary data.
[2025-10-24T21:42:23.296059] [WARN ] [MAIN      ] UTI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:42:23.296093] [INFO ] [LOCAL     ] UTI: Starting deletion of primary data.
[2025-10-24T21:42:23.296144] [DEBUG] [LOCAL     ] UTI: No primary data file found to delete.
[2025-10-24T21:42:23.296181] [INFO ] [LOCAL     ] UTI: Starting deletion of derivative data.
[2025-10-24T21:42:23.296343] [DEBUG] [LOCAL     ] UTI: Deleted derivative data file.
[2025-10-24T21:42:23.296436] [INFO ] [MAIN      ] Update Progress: 2200/2366 symbols completed. UTI took 28.6s. Estimated remaining: 21m 18s. Rate: 7.8 symbols/min
[2025-10-24T21:42:23.885595] [INFO ] [MAIN      ] UTZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:42:23.947123] [INFO ] [MAIN      ] UWMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:42:23.941115] [INFO ] [MAIN      ] UVV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:42:24.001214] [INFO ] [MAIN      ] UVE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:42:24.039542] [DEBUG] [LOCAL     ] UVE: Loaded 22079 existing records from primary storage.
[2025-10-24T21:42:24.040178] [DEBUG] [LOCAL     ] UVV: Loaded 22875 existing records from primary storage.
[2025-10-24T21:42:24.040500] [INFO ] [MAIN      ] UVE: Loaded 22079 existing records.
[2025-10-24T21:42:24.040602] [INFO ] [MAIN      ] UVV: Loaded 22875 existing records.
[2025-10-24T21:42:24.320378] [DEBUG] [LOCAL     ] UTZ: Loaded 44488 existing records from primary storage.
[2025-10-24T21:42:24.377692] [DEBUG] [LOCAL     ] UWMC: Loaded 53348 existing records from primary storage.
[2025-10-24T21:42:24.403928] [INFO ] [MAIN      ] UTZ: Loaded 44488 existing records.
[2025-10-24T21:42:24.410220] [WARN ] [MAIN      ] UVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:42:24.472145] [INFO ] [MAIN      ] UVV: Wiping existing primary data before full refresh.
[2025-10-24T21:42:24.454810] [INFO ] [MAIN      ] UWMC: Loaded 53348 existing records.
[2025-10-24T21:42:24.558949] [WARN ] [MAIN      ] UVE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:42:24.588533] [INFO ] [MAIN      ] UVE: Wiping existing primary data before full refresh.
[2025-10-24T21:42:24.572868] [INFO ] [LOCAL     ] UVV: Starting deletion of primary data.
[2025-10-24T21:42:24.624615] [DEBUG] [LOCAL     ] UVV: Deleted primary data file.
[2025-10-24T21:42:24.670715] [INFO ] [MAIN      ] UVV: Starting full primary refresh.
[2025-10-24T21:42:24.644530] [INFO ] [LOCAL     ] UVE: Starting deletion of primary data.
[2025-10-24T21:42:24.753100] [DEBUG] [LOCAL     ] UVE: Deleted primary data file.
[2025-10-24T21:42:24.753277] [INFO ] [MAIN      ] UVE: Starting full primary refresh.
[2025-10-24T21:42:24.863480] [WARN ] [MAIN      ] UTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:42:24.952588] [INFO ] [MAIN      ] UTZ: Wiping existing primary data before full refresh.
[2025-10-24T21:42:25.016599] [INFO ] [LOCAL     ] UTZ: Starting deletion of primary data.
[2025-10-24T21:42:25.011381] [WARN ] [MAIN      ] UWMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:42:25.058871] [DEBUG] [LOCAL     ] UTZ: Deleted primary data file.
[2025-10-24T21:42:25.081340] [INFO ] [MAIN      ] UWMC: Wiping existing primary data before full refresh.
[2025-10-24T21:42:25.092155] [INFO ] [LOCAL     ] UWMC: Starting deletion of primary data.
[2025-10-24T21:42:25.092245] [INFO ] [MAIN      ] UTZ: Starting full primary refresh.
[2025-10-24T21:42:25.120685] [DEBUG] [LOCAL     ] UWMC: Deleted primary data file.
[2025-10-24T21:42:25.125997] [INFO ] [MAIN      ] UWMC: Starting full primary refresh.
[2025-10-24T21:42:25.829711] [INFO ] [REMOTE    ] UVV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:42:25.938701] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-01.
[2025-10-24T21:42:26.028345] [INFO ] [REMOTE    ] UVE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:42:26.069034] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-01.
[2025-10-24T21:42:26.262952] [INFO ] [REMOTE    ] UTZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:42:26.271838] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-01.
[2025-10-24T21:42:26.291202] [INFO ] [REMOTE    ] UWMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:42:26.291592] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-01.
[2025-10-24T21:42:26.989927] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-01 (1.05 seconds).
[2025-10-24T21:42:26.994116] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-02.
[2025-10-24T21:42:27.145210] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-01 (1.08 seconds).
[2025-10-24T21:42:27.152962] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-02.
[2025-10-24T21:42:27.787805] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-01 (1.52 seconds).
[2025-10-24T21:42:27.796700] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-02.
[2025-10-24T21:42:27.844197] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-02 (0.69 seconds).
[2025-10-24T21:42:27.848632] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-03.
[2025-10-24T21:42:28.023284] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-01 (1.73 seconds).
[2025-10-24T21:42:28.148406] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-02.
[2025-10-24T21:42:28.153481] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T21:42:28.664865] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T21:42:28.905749] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T21:42:28.947684] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-03.
[2025-10-24T21:42:29.747679] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-03.
[2025-10-24T21:42:29.796158] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-02 (1.65 seconds).
[2025-10-24T21:42:30.537247] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T21:42:30.547618] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-04.
[2025-10-24T21:42:30.777735] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-03 (1.03 seconds).
[2025-10-24T21:42:31.267370] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-04 (0.72 seconds).
[2025-10-24T21:42:31.347622] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-05.
[2025-10-24T21:42:32.147759] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-04.
[2025-10-24T21:42:32.455037] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-05 (1.11 seconds).
[2025-10-24T21:42:32.947725] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-04.
[2025-10-24T21:42:32.973300] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T21:42:33.747729] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-06.
[2025-10-24T21:42:34.547637] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-03.
[2025-10-24T21:42:34.586515] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T21:42:34.804242] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T21:42:35.347732] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-05.
[2025-10-24T21:42:36.147742] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-07.
[2025-10-24T21:42:36.282474] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T21:42:36.339603] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-05 (0.99 seconds).
[2025-10-24T21:42:36.947695] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-06.
[2025-10-24T21:42:37.457583] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-07 (1.31 seconds).
[2025-10-24T21:42:37.647055] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T21:42:37.747621] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-07.
[2025-10-24T21:42:38.547706] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-08.
[2025-10-24T21:42:39.009843] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-07 (1.26 seconds).
[2025-10-24T21:42:39.347631] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-04.
[2025-10-24T21:42:39.510168] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-08 (0.96 seconds).
[2025-10-24T21:42:40.147683] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-08.
[2025-10-24T21:42:40.947693] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-09.
[2025-10-24T21:42:41.239144] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-04 (1.89 seconds).
[2025-10-24T21:42:41.263030] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T21:42:41.659224] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T21:42:41.747663] [INFO ] [REMOTE    ] UVE: Fetching primary data for 2025-10.
[2025-10-24T21:42:42.547735] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-05.
[2025-10-24T21:42:42.795850] [INFO ] [REMOTE    ] UVE: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T21:42:42.800174] [INFO ] [REMOTE    ] UVE: Full fetch complete (30438 records).
[2025-10-24T21:42:42.800251] [DEBUG] [VALIDATOR ] UVE: Validating primary data.
[2025-10-24T21:42:43.165589] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present.
[2025-10-24T21:42:43.165687] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed.
[2025-10-24T21:42:43.166357] [INFO ] [MAIN      ] UVE: Fetched primary data is valid.
[2025-10-24T21:42:43.166415] [DEBUG] [LOCAL     ] UVE: Saving primary data.
[2025-10-24T21:42:43.166731] [FATAL] [LOCAL     ] UVE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:42:43.166811] [FATAL] [MAIN      ] UVE: Failed to save primary data.
[2025-10-24T21:42:43.166852] [WARN ] [MAIN      ] UVE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:42:43.166885] [INFO ] [LOCAL     ] UVE: Starting deletion of primary data.
[2025-10-24T21:42:43.166933] [DEBUG] [LOCAL     ] UVE: No primary data file found to delete.
[2025-10-24T21:42:43.166966] [INFO ] [LOCAL     ] UVE: Starting deletion of derivative data.
[2025-10-24T21:42:43.167115] [DEBUG] [LOCAL     ] UVE: Deleted derivative data file.
[2025-10-24T21:42:43.167184] [INFO ] [MAIN      ] Update Progress: 2201/2366 symbols completed. UVE took 19.8s. Estimated remaining: 21m 11s. Rate: 7.8 symbols/min
[2025-10-24T21:42:43.331768] [INFO ] [MAIN      ] UZD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:42:43.339212] [DEBUG] [LOCAL     ] UZD: Loaded 5805 existing records from primary storage.
[2025-10-24T21:42:43.339393] [INFO ] [MAIN      ] UZD: Loaded 5805 existing records.
[2025-10-24T21:42:43.352922] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-09.
[2025-10-24T21:42:43.515522] [WARN ] [MAIN      ] UZD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:42:43.515845] [INFO ] [MAIN      ] UZD: Wiping existing primary data before full refresh.
[2025-10-24T21:42:43.515895] [INFO ] [LOCAL     ] UZD: Starting deletion of primary data.
[2025-10-24T21:42:43.516095] [DEBUG] [LOCAL     ] UZD: Deleted primary data file.
[2025-10-24T21:42:43.516143] [INFO ] [MAIN      ] UZD: Starting full primary refresh.
[2025-10-24T21:42:43.861692] [INFO ] [REMOTE    ] UZD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:42:44.147623] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-05.
[2025-10-24T21:42:44.452678] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T21:42:44.549238] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-05 (2.00 seconds).
[2025-10-24T21:42:44.947712] [INFO ] [REMOTE    ] UVV: Fetching primary data for 2025-10.
[2025-10-24T21:42:45.690693] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T21:42:45.747714] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-06.
[2025-10-24T21:42:45.962394] [INFO ] [REMOTE    ] UVV: Incremental fetch complete for 2025-10 (1.01 seconds).
[2025-10-24T21:42:45.966252] [INFO ] [REMOTE    ] UVV: Full fetch complete (30187 records).
[2025-10-24T21:42:45.966325] [DEBUG] [VALIDATOR ] UVV: Validating primary data.
[2025-10-24T21:42:46.328279] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present.
[2025-10-24T21:42:46.328353] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed.
[2025-10-24T21:42:46.329004] [INFO ] [MAIN      ] UVV: Fetched primary data is valid.
[2025-10-24T21:42:46.329064] [DEBUG] [LOCAL     ] UVV: Saving primary data.
[2025-10-24T21:42:46.329355] [FATAL] [LOCAL     ] UVV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:42:46.329437] [FATAL] [MAIN      ] UVV: Failed to save primary data.
[2025-10-24T21:42:46.329478] [WARN ] [MAIN      ] UVV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:42:46.329512] [INFO ] [LOCAL     ] UVV: Starting deletion of primary data.
[2025-10-24T21:42:46.329560] [DEBUG] [LOCAL     ] UVV: No primary data file found to delete.
[2025-10-24T21:42:46.329594] [INFO ] [LOCAL     ] UVV: Starting deletion of derivative data.
[2025-10-24T21:42:46.329795] [DEBUG] [LOCAL     ] UVV: Deleted derivative data file.
[2025-10-24T21:42:46.329881] [INFO ] [MAIN      ] Update Progress: 2202/2366 symbols completed. UVV took 23.0s. Estimated remaining: 21m 3s. Rate: 7.8 symbols/min
[2025-10-24T21:42:46.495784] [INFO ] [MAIN      ] UZE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:42:46.504800] [DEBUG] [LOCAL     ] UZE: Loaded 6952 existing records from primary storage.
[2025-10-24T21:42:46.505016] [INFO ] [MAIN      ] UZE: Loaded 6952 existing records.
[2025-10-24T21:42:46.558414] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-01.
[2025-10-24T21:42:46.682156] [WARN ] [MAIN      ] UZE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:42:46.682374] [INFO ] [MAIN      ] UZE: Wiping existing primary data before full refresh.
[2025-10-24T21:42:46.682425] [INFO ] [LOCAL     ] UZE: Starting deletion of primary data.
[2025-10-24T21:42:46.682712] [DEBUG] [LOCAL     ] UZE: Deleted primary data file.
[2025-10-24T21:42:46.682772] [INFO ] [MAIN      ] UZE: Starting full primary refresh.
[2025-10-24T21:42:47.076197] [INFO ] [REMOTE    ] UZE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:42:47.289735] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T21:42:47.318267] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T21:42:47.347627] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-07.
[2025-10-24T21:42:48.147762] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-02.
[2025-10-24T21:42:48.947716] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-01.
[2025-10-24T21:42:48.975626] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-02 (0.83 seconds).
[2025-10-24T21:42:49.004925] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T21:42:49.650931] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-01 (0.70 seconds).
[2025-10-24T21:42:49.747710] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-02.
[2025-10-24T21:42:50.323076] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T21:42:50.547706] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-03.
[2025-10-24T21:42:51.239514] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-03 (0.69 seconds).
[2025-10-24T21:42:51.347619] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-04.
[2025-10-24T21:42:52.147718] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-06.
[2025-10-24T21:42:52.159349] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-04 (0.81 seconds).
[2025-10-24T21:42:52.947716] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-08.
[2025-10-24T21:42:53.747689] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-03.
[2025-10-24T21:42:53.901823] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-06 (1.75 seconds).
[2025-10-24T21:42:54.503321] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T21:42:54.527624] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T21:42:54.547614] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-09.
[2025-10-24T21:42:55.347707] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-04.
[2025-10-24T21:42:56.060798] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T21:42:56.103955] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T21:42:56.147670] [INFO ] [REMOTE    ] UTZ: Fetching primary data for 2025-10.
[2025-10-24T21:42:56.947703] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-05.
[2025-10-24T21:42:57.622924] [INFO ] [REMOTE    ] UTZ: Incremental fetch complete for 2025-10 (1.48 seconds).
[2025-10-24T21:42:57.632266] [INFO ] [REMOTE    ] UTZ: Full fetch complete (64391 records).
[2025-10-24T21:42:57.632477] [DEBUG] [VALIDATOR ] UTZ: Validating primary data.
[2025-10-24T21:42:57.712683] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T21:42:57.753105] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-06.
[2025-10-24T21:42:58.065792] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present.
[2025-10-24T21:42:58.065910] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed.
[2025-10-24T21:42:58.067628] [INFO ] [MAIN      ] UTZ: Fetched primary data is valid.
[2025-10-24T21:42:58.067723] [DEBUG] [LOCAL     ] UTZ: Saving primary data.
[2025-10-24T21:42:58.068537] [FATAL] [LOCAL     ] UTZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:42:58.068631] [FATAL] [MAIN      ] UTZ: Failed to save primary data.
[2025-10-24T21:42:58.068715] [WARN ] [MAIN      ] UTZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:42:58.068758] [INFO ] [LOCAL     ] UTZ: Starting deletion of primary data.
[2025-10-24T21:42:58.068818] [DEBUG] [LOCAL     ] UTZ: No primary data file found to delete.
[2025-10-24T21:42:58.068854] [INFO ] [LOCAL     ] UTZ: Starting deletion of derivative data.
[2025-10-24T21:42:58.069160] [DEBUG] [LOCAL     ] UTZ: Deleted derivative data file.
[2025-10-24T21:42:58.069280] [INFO ] [MAIN      ] Update Progress: 2203/2366 symbols completed. UTZ took 34.8s. Estimated remaining: 20m 56s. Rate: 7.8 symbols/min
[2025-10-24T21:42:58.247245] [INFO ] [MAIN      ] UZF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:42:58.247490] [DEBUG] [LOCAL     ] UZF: No existing data file found in primary storage.
[2025-10-24T21:42:58.247531] [WARN ] [MAIN      ] UZF: No existing data found, performing full refresh instead.
[2025-10-24T21:42:58.247729] [INFO ] [MAIN      ] UZF: Wiping existing primary data before full refresh.
[2025-10-24T21:42:58.247778] [INFO ] [LOCAL     ] UZF: Starting deletion of primary data.
[2025-10-24T21:42:58.247822] [DEBUG] [LOCAL     ] UZF: No primary data file found to delete.
[2025-10-24T21:42:58.247856] [INFO ] [MAIN      ] UZF: Starting full primary refresh.
[2025-10-24T21:42:58.554452] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-06 (0.80 seconds).
[2025-10-24T21:42:58.552742] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-05.
[2025-10-24T21:42:58.675751] [INFO ] [REMOTE    ] UZF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:42:59.264429] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-05 (0.71 seconds).
[2025-10-24T21:42:59.347697] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-06.
[2025-10-24T21:42:59.997831] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T21:43:00.147742] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-07.
[2025-10-24T21:43:00.947719] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-07.
[2025-10-24T21:43:01.541806] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T21:43:01.747785] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-07.
[2025-10-24T21:43:02.082590] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-07 (1.93 seconds).
[2025-10-24T21:43:02.383456] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-07 (0.64 seconds).
[2025-10-24T21:43:02.547735] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-08.
[2025-10-24T21:43:03.347735] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-08.
[2025-10-24T21:43:03.385715] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T21:43:04.147638] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-01.
[2025-10-24T21:43:04.740983] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-01 (0.59 seconds).
[2025-10-24T21:43:04.947691] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-08.
[2025-10-24T21:43:05.066710] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T21:43:05.747736] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-02.
[2025-10-24T21:43:05.955792] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T21:43:06.077115] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-02 (0.33 seconds).
[2025-10-24T21:43:06.547704] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-09.
[2025-10-24T21:43:07.347680] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-09.
[2025-10-24T21:43:07.989674] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-09 (0.64 seconds).
[2025-10-24T21:43:08.147713] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-03.
[2025-10-24T21:43:08.403874] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-09 (1.86 seconds).
[2025-10-24T21:43:08.910323] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T21:43:08.947671] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-04.
[2025-10-24T21:43:09.674053] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T21:43:09.747671] [INFO ] [REMOTE    ] UZE: Fetching primary data for 2025-10.
[2025-10-24T21:43:10.162193] [INFO ] [REMOTE    ] UZE: Incremental fetch complete for 2025-10 (0.41 seconds).
[2025-10-24T21:43:10.163987] [INFO ] [REMOTE    ] UZE: Full fetch complete (9691 records).
[2025-10-24T21:43:10.164107] [DEBUG] [VALIDATOR ] UZE: Validating primary data.
[2025-10-24T21:43:10.543980] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present.
[2025-10-24T21:43:10.544081] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed.
[2025-10-24T21:43:10.544466] [INFO ] [MAIN      ] UZE: Fetched primary data is valid.
[2025-10-24T21:43:10.544510] [DEBUG] [LOCAL     ] UZE: Saving primary data.
[2025-10-24T21:43:10.544789] [FATAL] [LOCAL     ] UZE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:43:10.544879] [FATAL] [MAIN      ] UZE: Failed to save primary data.
[2025-10-24T21:43:10.544921] [WARN ] [MAIN      ] UZE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:43:10.544955] [INFO ] [LOCAL     ] UZE: Starting deletion of primary data.
[2025-10-24T21:43:10.545008] [DEBUG] [LOCAL     ] UZE: No primary data file found to delete.
[2025-10-24T21:43:10.545042] [INFO ] [LOCAL     ] UZE: Starting deletion of derivative data.
[2025-10-24T21:43:10.545257] [DEBUG] [LOCAL     ] UZE: Deleted derivative data file.
[2025-10-24T21:43:10.545341] [INFO ] [MAIN      ] Update Progress: 2204/2366 symbols completed. UZE took 24.2s. Estimated remaining: 20m 49s. Rate: 7.8 symbols/min
[2025-10-24T21:43:10.555587] [INFO ] [REMOTE    ] UWMC: Fetching primary data for 2025-10.
[2025-10-24T21:43:10.734231] [INFO ] [MAIN      ] V: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:43:10.794284] [DEBUG] [LOCAL     ] V: Loaded 54139 existing records from primary storage.
[2025-10-24T21:43:10.794803] [INFO ] [MAIN      ] V: Loaded 54139 existing records.
[2025-10-24T21:43:10.999434] [WARN ] [MAIN      ] V: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:43:10.999815] [INFO ] [MAIN      ] V: Wiping existing primary data before full refresh.
[2025-10-24T21:43:10.999870] [INFO ] [LOCAL     ] V: Starting deletion of primary data.
[2025-10-24T21:43:11.000474] [DEBUG] [LOCAL     ] V: Deleted primary data file.
[2025-10-24T21:43:11.000532] [INFO ] [MAIN      ] V: Starting full primary refresh.
[2025-10-24T21:43:11.356518] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-05.
[2025-10-24T21:43:11.371939] [INFO ] [REMOTE    ] V: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:43:11.990514] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T21:43:12.147694] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-09.
[2025-10-24T21:43:12.441095] [INFO ] [REMOTE    ] UWMC: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T21:43:12.451292] [INFO ] [REMOTE    ] UWMC: Full fetch complete (75938 records).
[2025-10-24T21:43:12.451462] [DEBUG] [VALIDATOR ] UWMC: Validating primary data.
[2025-10-24T21:43:12.776455] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-09 (0.63 seconds).
[2025-10-24T21:43:12.864843] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present.
[2025-10-24T21:43:12.864991] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed.
[2025-10-24T21:43:12.866177] [INFO ] [MAIN      ] UWMC: Fetched primary data is valid.
[2025-10-24T21:43:12.866239] [DEBUG] [LOCAL     ] UWMC: Saving primary data.
[2025-10-24T21:43:12.866832] [FATAL] [LOCAL     ] UWMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:43:12.866919] [FATAL] [MAIN      ] UWMC: Failed to save primary data.
[2025-10-24T21:43:12.866961] [WARN ] [MAIN      ] UWMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:43:12.867028] [INFO ] [LOCAL     ] UWMC: Starting deletion of primary data.
[2025-10-24T21:43:12.867102] [DEBUG] [LOCAL     ] UWMC: No primary data file found to delete.
[2025-10-24T21:43:12.867158] [INFO ] [LOCAL     ] UWMC: Starting deletion of derivative data.
[2025-10-24T21:43:12.867452] [DEBUG] [LOCAL     ] UWMC: Deleted derivative data file.
[2025-10-24T21:43:12.867749] [INFO ] [MAIN      ] Update Progress: 2205/2366 symbols completed. UWMC took 49.6s. Estimated remaining: 20m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:43:12.952944] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-06.
[2025-10-24T21:43:13.034616] [INFO ] [MAIN      ] VAC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:43:13.066836] [DEBUG] [LOCAL     ] VAC: Loaded 33922 existing records from primary storage.
[2025-10-24T21:43:13.067098] [INFO ] [MAIN      ] VAC: Loaded 33922 existing records.
[2025-10-24T21:43:13.238925] [WARN ] [MAIN      ] VAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:43:13.239113] [INFO ] [MAIN      ] VAC: Wiping existing primary data before full refresh.
[2025-10-24T21:43:13.239159] [INFO ] [LOCAL     ] VAC: Starting deletion of primary data.
[2025-10-24T21:43:13.239790] [DEBUG] [LOCAL     ] VAC: Deleted primary data file.
[2025-10-24T21:43:13.239847] [INFO ] [MAIN      ] VAC: Starting full primary refresh.
[2025-10-24T21:43:13.597161] [INFO ] [REMOTE    ] VAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:43:13.602101] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-06 (0.65 seconds).
[2025-10-24T21:43:13.747696] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-07.
[2025-10-24T21:43:14.228136] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T21:43:14.547718] [INFO ] [REMOTE    ] UZD: Fetching primary data for 2025-10.
[2025-10-24T21:43:15.039994] [INFO ] [REMOTE    ] UZD: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T21:43:15.040963] [INFO ] [REMOTE    ] UZD: Full fetch complete (8783 records).
[2025-10-24T21:43:15.041032] [DEBUG] [VALIDATOR ] UZD: Validating primary data.
[2025-10-24T21:43:15.353125] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-01.
[2025-10-24T21:43:15.396357] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present.
[2025-10-24T21:43:15.396498] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed.
[2025-10-24T21:43:15.396797] [INFO ] [MAIN      ] UZD: Fetched primary data is valid.
[2025-10-24T21:43:15.396863] [DEBUG] [LOCAL     ] UZD: Saving primary data.
[2025-10-24T21:43:15.397068] [FATAL] [LOCAL     ] UZD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:43:15.397145] [FATAL] [MAIN      ] UZD: Failed to save primary data.
[2025-10-24T21:43:15.397188] [WARN ] [MAIN      ] UZD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:43:15.397228] [INFO ] [LOCAL     ] UZD: Starting deletion of primary data.
[2025-10-24T21:43:15.397288] [DEBUG] [LOCAL     ] UZD: No primary data file found to delete.
[2025-10-24T21:43:15.397335] [INFO ] [LOCAL     ] UZD: Starting deletion of derivative data.
[2025-10-24T21:43:15.397542] [DEBUG] [LOCAL     ] UZD: Deleted derivative data file.
[2025-10-24T21:43:15.397705] [INFO ] [MAIN      ] Update Progress: 2206/2366 symbols completed. UZD took 32.2s. Estimated remaining: 20m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:43:15.569297] [INFO ] [MAIN      ] VAL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:43:15.612334] [DEBUG] [LOCAL     ] VAL: Loaded 50242 existing records from primary storage.
[2025-10-24T21:43:15.612616] [INFO ] [MAIN      ] VAL: Loaded 50242 existing records.
[2025-10-24T21:43:15.785495] [WARN ] [MAIN      ] VAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:43:15.785741] [INFO ] [MAIN      ] VAL: Wiping existing primary data before full refresh.
[2025-10-24T21:43:15.785797] [INFO ] [LOCAL     ] VAL: Starting deletion of primary data.
[2025-10-24T21:43:15.786232] [DEBUG] [LOCAL     ] VAL: Deleted primary data file.
[2025-10-24T21:43:15.786288] [INFO ] [MAIN      ] VAL: Starting full primary refresh.
[2025-10-24T21:43:16.130496] [INFO ] [REMOTE    ] VAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:43:16.147632] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-01.
[2025-10-24T21:43:16.947693] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-08.
[2025-10-24T21:43:17.541941] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-01 (2.19 seconds).
[2025-10-24T21:43:17.747631] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-02.
[2025-10-24T21:43:17.845332] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T21:43:17.847470] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T21:43:18.547675] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-01.
[2025-10-24T21:43:19.347671] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-09.
[2025-10-24T21:43:19.781935] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-01 (1.23 seconds).
[2025-10-24T21:43:19.882393] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-02 (2.13 seconds).
[2025-10-24T21:43:19.906053] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-09 (0.56 seconds).
[2025-10-24T21:43:20.147729] [INFO ] [REMOTE    ] UZF: Fetching primary data for 2025-10.
[2025-10-24T21:43:20.629350] [INFO ] [REMOTE    ] UZF: Incremental fetch complete for 2025-10 (0.48 seconds).
[2025-10-24T21:43:20.630410] [INFO ] [REMOTE    ] UZF: Full fetch complete (8288 records).
[2025-10-24T21:43:20.630479] [DEBUG] [VALIDATOR ] UZF: Validating primary data.
[2025-10-24T21:43:20.809189] [WARN ] [VALIDATOR ] UZF: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T21:43:20.809471] [FATAL] [MAIN      ] UZF: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:43:20.809548] [WARN ] [MAIN      ] UZF: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:43:20.809601] [INFO ] [LOCAL     ] UZF: Starting deletion of primary data.
[2025-10-24T21:43:20.809683] [DEBUG] [LOCAL     ] UZF: No primary data file found to delete.
[2025-10-24T21:43:20.809739] [INFO ] [LOCAL     ] UZF: Starting deletion of derivative data.
[2025-10-24T21:43:20.809788] [DEBUG] [LOCAL     ] UZF: No derivative data file found to delete.
[2025-10-24T21:43:20.809842] [INFO ] [MAIN      ] Update Progress: 2207/2366 symbols completed. UZF took 22.7s. Estimated remaining: 20m 25s. Rate: 7.8 symbols/min
[2025-10-24T21:43:20.953002] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-03.
[2025-10-24T21:43:20.978869] [INFO ] [MAIN      ] VALE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:43:21.029844] [DEBUG] [LOCAL     ] VALE: Loaded 54083 existing records from primary storage.
[2025-10-24T21:43:21.030138] [INFO ] [MAIN      ] VALE: Loaded 54083 existing records.
[2025-10-24T21:43:21.205169] [WARN ] [MAIN      ] VALE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:43:21.205409] [INFO ] [MAIN      ] VALE: Wiping existing primary data before full refresh.
[2025-10-24T21:43:21.205463] [INFO ] [LOCAL     ] VALE: Starting deletion of primary data.
[2025-10-24T21:43:21.205948] [DEBUG] [LOCAL     ] VALE: Deleted primary data file.
[2025-10-24T21:43:21.206005] [INFO ] [MAIN      ] VALE: Starting full primary refresh.
[2025-10-24T21:43:21.553988] [INFO ] [REMOTE    ] VALE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:43:21.747636] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-01.
[2025-10-24T21:43:22.547725] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-02.
[2025-10-24T21:43:23.318266] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-03 (2.37 seconds).
[2025-10-24T21:43:23.347623] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-04.
[2025-10-24T21:43:23.806676] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-01 (2.06 seconds).
[2025-10-24T21:43:23.887408] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-02 (1.34 seconds).
[2025-10-24T21:43:24.147714] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-02.
[2025-10-24T21:43:24.947691] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-03.
[2025-10-24T21:43:25.489723] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-04 (2.14 seconds).
[2025-10-24T21:43:25.747715] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-05.
[2025-10-24T21:43:25.838356] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T21:43:26.463401] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T21:43:26.547632] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-04.
[2025-10-24T21:43:27.347693] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-03.
[2025-10-24T21:43:27.680417] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-05 (1.93 seconds).
[2025-10-24T21:43:27.753263] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T21:43:28.147690] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-05.
[2025-10-24T21:43:28.760703] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T21:43:28.947726] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-04.
[2025-10-24T21:43:29.731264] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T21:43:29.747670] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-06.
[2025-10-24T21:43:30.547697] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-06.
[2025-10-24T21:43:30.709903] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T21:43:31.092396] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T21:43:31.347680] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-07.
[2025-10-24T21:43:32.147704] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-02.
[2025-10-24T21:43:32.426764] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T21:43:32.761894] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T21:43:32.947705] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-08.
[2025-10-24T21:43:33.747693] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-07.
[2025-10-24T21:43:34.163542] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-08 (1.22 seconds).
[2025-10-24T21:43:34.336116] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-02 (2.19 seconds).
[2025-10-24T21:43:34.547728] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-09.
[2025-10-24T21:43:35.347688] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-05.
[2025-10-24T21:43:35.787266] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-09 (1.24 seconds).
[2025-10-24T21:43:35.904938] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-07 (2.16 seconds).
[2025-10-24T21:43:36.147707] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-08.
[2025-10-24T21:43:36.947713] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-03.
[2025-10-24T21:43:36.981346] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T21:43:37.747690] [INFO ] [REMOTE    ] VAC: Fetching primary data for 2025-10.
[2025-10-24T21:43:38.201362] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-08 (2.05 seconds).
[2025-10-24T21:43:38.383713] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-03 (1.44 seconds).
[2025-10-24T21:43:38.547713] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-06.
[2025-10-24T21:43:39.077069] [INFO ] [REMOTE    ] VAC: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T21:43:39.082996] [INFO ] [REMOTE    ] VAC: Full fetch complete (48775 records).
[2025-10-24T21:43:39.083098] [DEBUG] [VALIDATOR ] VAC: Validating primary data.
[2025-10-24T21:43:39.355942] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-09.
[2025-10-24T21:43:39.488696] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present.
[2025-10-24T21:43:39.488805] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed.
[2025-10-24T21:43:39.489783] [INFO ] [MAIN      ] VAC: Fetched primary data is valid.
[2025-10-24T21:43:39.489844] [DEBUG] [LOCAL     ] VAC: Saving primary data.
[2025-10-24T21:43:39.490316] [FATAL] [LOCAL     ] VAC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:43:39.490392] [FATAL] [MAIN      ] VAC: Failed to save primary data.
[2025-10-24T21:43:39.490457] [WARN ] [MAIN      ] VAC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:43:39.490521] [INFO ] [LOCAL     ] VAC: Starting deletion of primary data.
[2025-10-24T21:43:39.490580] [DEBUG] [LOCAL     ] VAC: No primary data file found to delete.
[2025-10-24T21:43:39.490616] [INFO ] [LOCAL     ] VAC: Starting deletion of derivative data.
[2025-10-24T21:43:39.490782] [DEBUG] [LOCAL     ] VAC: Deleted derivative data file.
[2025-10-24T21:43:39.490869] [INFO ] [MAIN      ] Update Progress: 2208/2366 symbols completed. VAC took 26.6s. Estimated remaining: 20m 18s. Rate: 7.8 symbols/min
[2025-10-24T21:43:39.664042] [INFO ] [MAIN      ] VATE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:43:39.672032] [DEBUG] [LOCAL     ] VATE: Loaded 5078 existing records from primary storage.
[2025-10-24T21:43:39.672241] [INFO ] [MAIN      ] VATE: Loaded 5078 existing records.
[2025-10-24T21:43:39.851147] [WARN ] [MAIN      ] VATE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:43:39.851359] [INFO ] [MAIN      ] VATE: Wiping existing primary data before full refresh.
[2025-10-24T21:43:39.851406] [INFO ] [LOCAL     ] VATE: Starting deletion of primary data.
[2025-10-24T21:43:39.851561] [DEBUG] [LOCAL     ] VATE: Deleted primary data file.
[2025-10-24T21:43:39.851618] [INFO ] [MAIN      ] VATE: Starting full primary refresh.
[2025-10-24T21:43:40.154904] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-04.
[2025-10-24T21:43:40.217779] [INFO ] [REMOTE    ] VATE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:43:40.246406] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-06 (1.70 seconds).
[2025-10-24T21:43:40.947687] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-01.
[2025-10-24T21:43:41.498869] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-09 (2.14 seconds).
[2025-10-24T21:43:41.686430] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-01 (0.74 seconds).
[2025-10-24T21:43:41.747610] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-02.
[2025-10-24T21:43:42.180356] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-04 (2.03 seconds).
[2025-10-24T21:43:42.547697] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-07.
[2025-10-24T21:43:42.615135] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-02 (0.87 seconds).
[2025-10-24T21:43:43.347684] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-03.
[2025-10-24T21:43:44.073251] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T21:43:44.153783] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-04.
[2025-10-24T21:43:44.178850] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T21:43:44.764022] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-04 (0.61 seconds).
[2025-10-24T21:43:44.947705] [INFO ] [REMOTE    ] V: Fetching primary data for 2025-10.
[2025-10-24T21:43:45.446769] [INFO ] [REMOTE    ] V: Incremental fetch complete for 2025-10 (0.50 seconds).
[2025-10-24T21:43:45.456609] [INFO ] [REMOTE    ] V: Full fetch complete (77922 records).
[2025-10-24T21:43:45.456779] [DEBUG] [VALIDATOR ] V: Validating primary data.
[2025-10-24T21:43:45.756276] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-08.
[2025-10-24T21:43:45.855535] [DEBUG] [VALIDATOR ] V: All expected trading days are present.
[2025-10-24T21:43:45.855611] [DEBUG] [VALIDATOR ] V: Primary data validation passed.
[2025-10-24T21:43:45.856793] [INFO ] [MAIN      ] V: Fetched primary data is valid.
[2025-10-24T21:43:45.856854] [DEBUG] [LOCAL     ] V: Saving primary data.
[2025-10-24T21:43:45.857414] [FATAL] [LOCAL     ] V: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:43:45.857501] [FATAL] [MAIN      ] V: Failed to save primary data.
[2025-10-24T21:43:45.857542] [WARN ] [MAIN      ] V: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:43:45.857577] [INFO ] [LOCAL     ] V: Starting deletion of primary data.
[2025-10-24T21:43:45.857693] [DEBUG] [LOCAL     ] V: No primary data file found to delete.
[2025-10-24T21:43:45.857749] [INFO ] [LOCAL     ] V: Starting deletion of derivative data.
[2025-10-24T21:43:45.857919] [DEBUG] [LOCAL     ] V: Deleted derivative data file.
[2025-10-24T21:43:45.858161] [INFO ] [MAIN      ] Update Progress: 2209/2366 symbols completed. V took 35.3s. Estimated remaining: 20m 10s. Rate: 7.8 symbols/min
[2025-10-24T21:43:46.026475] [INFO ] [MAIN      ] VBF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:43:46.036130] [DEBUG] [LOCAL     ] VBF: Loaded 7227 existing records from primary storage.
[2025-10-24T21:43:46.036374] [INFO ] [MAIN      ] VBF: Loaded 7227 existing records.
[2025-10-24T21:43:46.209996] [WARN ] [MAIN      ] VBF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:43:46.210195] [INFO ] [MAIN      ] VBF: Wiping existing primary data before full refresh.
[2025-10-24T21:43:46.210243] [INFO ] [LOCAL     ] VBF: Starting deletion of primary data.
[2025-10-24T21:43:46.210457] [DEBUG] [LOCAL     ] VBF: Deleted primary data file.
[2025-10-24T21:43:46.210513] [INFO ] [MAIN      ] VBF: Starting full primary refresh.
[2025-10-24T21:43:46.554074] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-05.
[2025-10-24T21:43:46.567901] [INFO ] [REMOTE    ] VBF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:43:47.356939] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-05.
[2025-10-24T21:43:47.363280] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T21:43:48.090430] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T21:43:48.147733] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-06.
[2025-10-24T21:43:48.405319] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-05 (1.85 seconds).
[2025-10-24T21:43:48.767247] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T21:43:48.947724] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-09.
[2025-10-24T21:43:49.747701] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-06.
[2025-10-24T21:43:50.558712] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-01.
[2025-10-24T21:43:50.564462] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T21:43:51.167838] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T21:43:51.335180] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T21:43:51.347658] [INFO ] [REMOTE    ] VAL: Fetching primary data for 2025-10.
[2025-10-24T21:43:52.147758] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-07.
[2025-10-24T21:43:52.848209] [INFO ] [REMOTE    ] VAL: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T21:43:52.857716] [INFO ] [REMOTE    ] VAL: Full fetch complete (72939 records).
[2025-10-24T21:43:52.857918] [DEBUG] [VALIDATOR ] VAL: Validating primary data.
[2025-10-24T21:43:52.954413] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-07.
[2025-10-24T21:43:53.269020] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present.
[2025-10-24T21:43:53.269154] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed.
[2025-10-24T21:43:53.271622] [INFO ] [MAIN      ] VAL: Fetched primary data is valid.
[2025-10-24T21:43:53.271712] [DEBUG] [LOCAL     ] VAL: Saving primary data.
[2025-10-24T21:43:53.272766] [FATAL] [LOCAL     ] VAL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:43:53.272870] [FATAL] [MAIN      ] VAL: Failed to save primary data.
[2025-10-24T21:43:53.272914] [WARN ] [MAIN      ] VAL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:43:53.272953] [INFO ] [LOCAL     ] VAL: Starting deletion of primary data.
[2025-10-24T21:43:53.273017] [DEBUG] [LOCAL     ] VAL: No primary data file found to delete.
[2025-10-24T21:43:53.273056] [INFO ] [LOCAL     ] VAL: Starting deletion of derivative data.
[2025-10-24T21:43:53.273260] [DEBUG] [LOCAL     ] VAL: Deleted derivative data file.
[2025-10-24T21:43:53.273558] [INFO ] [MAIN      ] Update Progress: 2210/2366 symbols completed. VAL took 37.9s. Estimated remaining: 20m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:43:53.455977] [INFO ] [MAIN      ] VCV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:43:53.472464] [DEBUG] [LOCAL     ] VCV: Loaded 13232 existing records from primary storage.
[2025-10-24T21:43:53.472807] [INFO ] [MAIN      ] VCV: Loaded 13232 existing records.
[2025-10-24T21:43:53.591525] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-07 (0.64 seconds).
[2025-10-24T21:43:53.668855] [WARN ] [MAIN      ] VCV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:43:53.669126] [INFO ] [MAIN      ] VCV: Wiping existing primary data before full refresh.
[2025-10-24T21:43:53.669343] [INFO ] [LOCAL     ] VCV: Starting deletion of primary data.
[2025-10-24T21:43:53.669615] [DEBUG] [LOCAL     ] VCV: Deleted primary data file.
[2025-10-24T21:43:53.669715] [INFO ] [MAIN      ] VCV: Starting full primary refresh.
[2025-10-24T21:43:53.753750] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-08.
[2025-10-24T21:43:54.037691] [INFO ] [REMOTE    ] VCV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:43:54.071100] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T21:43:54.450326] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-08 (0.70 seconds).
[2025-10-24T21:43:54.547719] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-09.
[2025-10-24T21:43:55.159106] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-09 (0.61 seconds).
[2025-10-24T21:43:55.347705] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-08.
[2025-10-24T21:43:56.147734] [INFO ] [REMOTE    ] VATE: Fetching primary data for 2025-10.
[2025-10-24T21:43:56.756627] [INFO ] [REMOTE    ] VATE: Incremental fetch complete for 2025-10 (0.61 seconds).
[2025-10-24T21:43:56.758211] [INFO ] [REMOTE    ] VATE: Full fetch complete (10679 records).
[2025-10-24T21:43:56.758278] [DEBUG] [VALIDATOR ] VATE: Validating primary data.
[2025-10-24T21:43:56.964615] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-02.
[2025-10-24T21:43:57.135154] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present.
[2025-10-24T21:43:57.135331] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed.
[2025-10-24T21:43:57.135716] [INFO ] [MAIN      ] VATE: Fetched primary data is valid.
[2025-10-24T21:43:57.135796] [DEBUG] [LOCAL     ] VATE: Saving primary data.
[2025-10-24T21:43:57.136104] [FATAL] [LOCAL     ] VATE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:43:57.136213] [FATAL] [MAIN      ] VATE: Failed to save primary data.
[2025-10-24T21:43:57.136306] [WARN ] [MAIN      ] VATE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:43:57.136529] [INFO ] [LOCAL     ] VATE: Starting deletion of primary data.
[2025-10-24T21:43:57.136668] [DEBUG] [LOCAL     ] VATE: No primary data file found to delete.
[2025-10-24T21:43:57.136740] [INFO ] [LOCAL     ] VATE: Starting deletion of derivative data.
[2025-10-24T21:43:57.137164] [DEBUG] [LOCAL     ] VATE: Deleted derivative data file.
[2025-10-24T21:43:57.137266] [INFO ] [MAIN      ] Update Progress: 2211/2366 symbols completed. VATE took 17.6s. Estimated remaining: 19m 54s. Rate: 7.8 symbols/min
[2025-10-24T21:43:57.287115] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T21:43:57.403305] [INFO ] [MAIN      ] VEEV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:43:57.446892] [DEBUG] [LOCAL     ] VEEV: Loaded 47474 existing records from primary storage.
[2025-10-24T21:43:57.447203] [INFO ] [MAIN      ] VEEV: Loaded 47474 existing records.
[2025-10-24T21:43:57.624519] [WARN ] [MAIN      ] VEEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:43:57.624783] [INFO ] [MAIN      ] VEEV: Wiping existing primary data before full refresh.
[2025-10-24T21:43:57.624834] [INFO ] [LOCAL     ] VEEV: Starting deletion of primary data.
[2025-10-24T21:43:57.625409] [DEBUG] [LOCAL     ] VEEV: Deleted primary data file.
[2025-10-24T21:43:57.625467] [INFO ] [MAIN      ] VEEV: Starting full primary refresh.
[2025-10-24T21:43:57.752760] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-01.
[2025-10-24T21:43:57.875925] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T21:43:58.012603] [INFO ] [REMOTE    ] VEEV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:43:58.547684] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-01.
[2025-10-24T21:43:58.674595] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T21:43:59.347712] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-02.
[2025-10-24T21:44:00.110899] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T21:44:00.126617] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-02 (0.78 seconds).
[2025-10-24T21:44:00.147614] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-03.
[2025-10-24T21:44:00.954117] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-02.
[2025-10-24T21:44:00.959027] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-03 (0.81 seconds).
[2025-10-24T21:44:01.747722] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-04.
[2025-10-24T21:44:02.557329] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-09.
[2025-10-24T21:44:02.566332] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T21:44:02.701596] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T21:44:03.347725] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-03.
[2025-10-24T21:44:04.115542] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T21:44:04.147638] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-04.
[2025-10-24T21:44:04.361136] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-09 (1.80 seconds).
[2025-10-24T21:44:04.817456] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-04 (0.67 seconds).
[2025-10-24T21:44:04.947700] [INFO ] [REMOTE    ] VALE: Fetching primary data for 2025-10.
[2025-10-24T21:44:05.747741] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-03.
[2025-10-24T21:44:06.547666] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-05.
[2025-10-24T21:44:07.027274] [INFO ] [REMOTE    ] VALE: Incremental fetch complete for 2025-10 (2.08 seconds).
[2025-10-24T21:44:07.038999] [INFO ] [REMOTE    ] VALE: Full fetch complete (77873 records).
[2025-10-24T21:44:07.039151] [DEBUG] [VALIDATOR ] VALE: Validating primary data.
[2025-10-24T21:44:07.156298] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T21:44:07.353741] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-06.
[2025-10-24T21:44:07.458698] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present.
[2025-10-24T21:44:07.458846] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed.
[2025-10-24T21:44:07.460123] [INFO ] [MAIN      ] VALE: Fetched primary data is valid.
[2025-10-24T21:44:07.460205] [DEBUG] [LOCAL     ] VALE: Saving primary data.
[2025-10-24T21:44:07.461015] [FATAL] [LOCAL     ] VALE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:44:07.461166] [FATAL] [MAIN      ] VALE: Failed to save primary data.
[2025-10-24T21:44:07.461255] [WARN ] [MAIN      ] VALE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:44:07.461415] [INFO ] [LOCAL     ] VALE: Starting deletion of primary data.
[2025-10-24T21:44:07.461550] [DEBUG] [LOCAL     ] VALE: No primary data file found to delete.
[2025-10-24T21:44:07.461764] [INFO ] [LOCAL     ] VALE: Starting deletion of derivative data.
[2025-10-24T21:44:07.471090] [DEBUG] [LOCAL     ] VALE: Deleted derivative data file.
[2025-10-24T21:44:07.487502] [INFO ] [MAIN      ] Update Progress: 2212/2366 symbols completed. VALE took 46.7s. Estimated remaining: 19m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:44:07.489494] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T21:44:07.675698] [INFO ] [MAIN      ] VEL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:44:07.689006] [DEBUG] [LOCAL     ] VEL: Loaded 11991 existing records from primary storage.
[2025-10-24T21:44:07.689236] [INFO ] [MAIN      ] VEL: Loaded 11991 existing records.
[2025-10-24T21:44:07.881423] [WARN ] [MAIN      ] VEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:44:07.881700] [INFO ] [MAIN      ] VEL: Wiping existing primary data before full refresh.
[2025-10-24T21:44:07.881761] [INFO ] [LOCAL     ] VEL: Starting deletion of primary data.
[2025-10-24T21:44:07.881925] [DEBUG] [LOCAL     ] VEL: Deleted primary data file.
[2025-10-24T21:44:07.881966] [INFO ] [MAIN      ] VEL: Starting full primary refresh.
[2025-10-24T21:44:08.153046] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-04.
[2025-10-24T21:44:08.216103] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-06 (0.86 seconds).
[2025-10-24T21:44:08.298531] [INFO ] [REMOTE    ] VEL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:44:08.947735] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-01.
[2025-10-24T21:44:09.667581] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T21:44:09.747707] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-02.
[2025-10-24T21:44:09.806337] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T21:44:10.475339] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-02 (0.73 seconds).
[2025-10-24T21:44:10.547668] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-03.
[2025-10-24T21:44:11.347695] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-05.
[2025-10-24T21:44:11.479430] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-03 (0.93 seconds).
[2025-10-24T21:44:12.106260] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-05 (0.76 seconds).
[2025-10-24T21:44:12.147722] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-05.
[2025-10-24T21:44:12.947718] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-06.
[2025-10-24T21:44:13.755177] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-04.
[2025-10-24T21:44:13.760533] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T21:44:13.866085] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-06 (0.92 seconds).
[2025-10-24T21:44:14.547705] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-07.
[2025-10-24T21:44:14.614106] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T21:44:15.302234] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T21:44:15.347692] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-05.
[2025-10-24T21:44:16.147727] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-06.
[2025-10-24T21:44:16.230221] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T21:44:16.947683] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-06.
[2025-10-24T21:44:17.477145] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T21:44:17.747685] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-07.
[2025-10-24T21:44:17.827366] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-06 (0.88 seconds).
[2025-10-24T21:44:18.547674] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-07.
[2025-10-24T21:44:19.292190] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T21:44:19.347629] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-08.
[2025-10-24T21:44:19.453324] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-07 (0.91 seconds).
[2025-10-24T21:44:20.147676] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-08.
[2025-10-24T21:44:20.176086] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T21:44:20.947691] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-08.
[2025-10-24T21:44:21.624132] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T21:44:21.747675] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-09.
[2025-10-24T21:44:21.843752] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-08 (0.90 seconds).
[2025-10-24T21:44:22.454667] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T21:44:22.547686] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-09.
[2025-10-24T21:44:23.347699] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-07.
[2025-10-24T21:44:24.083947] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T21:44:24.101761] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T21:44:24.147669] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-08.
[2025-10-24T21:44:24.947676] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-09.
[2025-10-24T21:44:24.977111] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-08 (0.83 seconds).
[2025-10-24T21:44:25.747683] [INFO ] [REMOTE    ] VBF: Fetching primary data for 2025-10.
[2025-10-24T21:44:25.871251] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-09 (0.92 seconds).
[2025-10-24T21:44:26.491839] [INFO ] [REMOTE    ] VBF: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T21:44:26.494598] [INFO ] [REMOTE    ] VBF: Full fetch complete (10926 records).
[2025-10-24T21:44:26.494744] [DEBUG] [VALIDATOR ] VBF: Validating primary data.
[2025-10-24T21:44:26.552834] [INFO ] [REMOTE    ] VEEV: Fetching primary data for 2025-10.
[2025-10-24T21:44:26.865620] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present.
[2025-10-24T21:44:26.865725] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed.
[2025-10-24T21:44:26.866020] [INFO ] [MAIN      ] VBF: Fetched primary data is valid.
[2025-10-24T21:44:26.866058] [DEBUG] [LOCAL     ] VBF: Saving primary data.
[2025-10-24T21:44:26.866264] [FATAL] [LOCAL     ] VBF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:44:26.866342] [FATAL] [MAIN      ] VBF: Failed to save primary data.
[2025-10-24T21:44:26.866383] [WARN ] [MAIN      ] VBF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:44:26.866441] [INFO ] [LOCAL     ] VBF: Starting deletion of primary data.
[2025-10-24T21:44:26.866499] [DEBUG] [LOCAL     ] VBF: No primary data file found to delete.
[2025-10-24T21:44:26.866533] [INFO ] [LOCAL     ] VBF: Starting deletion of derivative data.
[2025-10-24T21:44:26.866818] [DEBUG] [LOCAL     ] VBF: Deleted derivative data file.
[2025-10-24T21:44:26.866909] [INFO ] [MAIN      ] Update Progress: 2213/2366 symbols completed. VBF took 41.0s. Estimated remaining: 19m 40s. Rate: 7.8 symbols/min
[2025-10-24T21:44:27.036634] [INFO ] [MAIN      ] VET: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:44:27.076328] [DEBUG] [LOCAL     ] VET: Loaded 44405 existing records from primary storage.
[2025-10-24T21:44:27.076613] [INFO ] [MAIN      ] VET: Loaded 44405 existing records.
[2025-10-24T21:44:27.254107] [WARN ] [MAIN      ] VET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:44:27.254354] [INFO ] [MAIN      ] VET: Wiping existing primary data before full refresh.
[2025-10-24T21:44:27.254406] [INFO ] [LOCAL     ] VET: Starting deletion of primary data.
[2025-10-24T21:44:27.254779] [DEBUG] [LOCAL     ] VET: Deleted primary data file.
[2025-10-24T21:44:27.254837] [INFO ] [MAIN      ] VET: Starting full primary refresh.
[2025-10-24T21:44:27.353924] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-09.
[2025-10-24T21:44:27.614124] [INFO ] [REMOTE    ] VET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:44:28.147688] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-01.
[2025-10-24T21:44:28.156945] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-09 (0.80 seconds).
[2025-10-24T21:44:28.228470] [INFO ] [REMOTE    ] VEEV: Incremental fetch complete for 2025-10 (1.68 seconds).
[2025-10-24T21:44:28.239616] [INFO ] [REMOTE    ] VEEV: Full fetch complete (68333 records).
[2025-10-24T21:44:28.239762] [DEBUG] [VALIDATOR ] VEEV: Validating primary data.
[2025-10-24T21:44:28.645732] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present.
[2025-10-24T21:44:28.645815] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed.
[2025-10-24T21:44:28.646897] [INFO ] [MAIN      ] VEEV: Fetched primary data is valid.
[2025-10-24T21:44:28.646957] [DEBUG] [LOCAL     ] VEEV: Saving primary data.
[2025-10-24T21:44:28.647515] [FATAL] [LOCAL     ] VEEV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:44:28.647618] [FATAL] [MAIN      ] VEEV: Failed to save primary data.
[2025-10-24T21:44:28.647716] [WARN ] [MAIN      ] VEEV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:44:28.647762] [INFO ] [LOCAL     ] VEEV: Starting deletion of primary data.
[2025-10-24T21:44:28.647820] [DEBUG] [LOCAL     ] VEEV: No primary data file found to delete.
[2025-10-24T21:44:28.647855] [INFO ] [LOCAL     ] VEEV: Starting deletion of derivative data.
[2025-10-24T21:44:28.648003] [DEBUG] [LOCAL     ] VEEV: Deleted derivative data file.
[2025-10-24T21:44:28.648712] [INFO ] [MAIN      ] Update Progress: 2214/2366 symbols completed. VEEV took 31.5s. Estimated remaining: 19m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:44:28.819903] [INFO ] [MAIN      ] VFC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:44:28.872412] [DEBUG] [LOCAL     ] VFC: Loaded 53996 existing records from primary storage.
[2025-10-24T21:44:28.872740] [INFO ] [MAIN      ] VFC: Loaded 53996 existing records.
[2025-10-24T21:44:28.952881] [INFO ] [REMOTE    ] VEL: Fetching primary data for 2025-10.
[2025-10-24T21:44:29.055144] [WARN ] [MAIN      ] VFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:44:29.055337] [INFO ] [MAIN      ] VFC: Wiping existing primary data before full refresh.
[2025-10-24T21:44:29.055385] [INFO ] [LOCAL     ] VFC: Starting deletion of primary data.
[2025-10-24T21:44:29.056412] [DEBUG] [LOCAL     ] VFC: Deleted primary data file.
[2025-10-24T21:44:29.056497] [INFO ] [MAIN      ] VFC: Starting full primary refresh.
[2025-10-24T21:44:29.416266] [INFO ] [REMOTE    ] VFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:44:29.623560] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T21:44:29.747728] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-01.
[2025-10-24T21:44:29.755721] [INFO ] [REMOTE    ] VEL: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T21:44:29.758724] [INFO ] [REMOTE    ] VEL: Full fetch complete (17173 records).
[2025-10-24T21:44:29.758803] [DEBUG] [VALIDATOR ] VEL: Validating primary data.
[2025-10-24T21:44:30.128417] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present.
[2025-10-24T21:44:30.128497] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed.
[2025-10-24T21:44:30.128921] [INFO ] [MAIN      ] VEL: Fetched primary data is valid.
[2025-10-24T21:44:30.128980] [DEBUG] [LOCAL     ] VEL: Saving primary data.
[2025-10-24T21:44:30.129208] [FATAL] [LOCAL     ] VEL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:44:30.129287] [FATAL] [MAIN      ] VEL: Failed to save primary data.
[2025-10-24T21:44:30.129329] [WARN ] [MAIN      ] VEL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:44:30.129396] [INFO ] [LOCAL     ] VEL: Starting deletion of primary data.
[2025-10-24T21:44:30.129451] [DEBUG] [LOCAL     ] VEL: No primary data file found to delete.
[2025-10-24T21:44:30.129485] [INFO ] [LOCAL     ] VEL: Starting deletion of derivative data.
[2025-10-24T21:44:30.129633] [DEBUG] [LOCAL     ] VEL: Deleted derivative data file.
[2025-10-24T21:44:30.129745] [INFO ] [MAIN      ] Update Progress: 2215/2366 symbols completed. VEL took 22.6s. Estimated remaining: 19m 23s. Rate: 7.8 symbols/min
[2025-10-24T21:44:30.293231] [INFO ] [MAIN      ] VG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:44:30.293360] [DEBUG] [LOCAL     ] VG: No existing data file found in primary storage.
[2025-10-24T21:44:30.293396] [WARN ] [MAIN      ] VG: No existing data found, performing full refresh instead.
[2025-10-24T21:44:30.293498] [INFO ] [MAIN      ] VG: Wiping existing primary data before full refresh.
[2025-10-24T21:44:30.293538] [INFO ] [LOCAL     ] VG: Starting deletion of primary data.
[2025-10-24T21:44:30.293578] [DEBUG] [LOCAL     ] VG: No primary data file found to delete.
[2025-10-24T21:44:30.293608] [INFO ] [MAIN      ] VG: Starting full primary refresh.
[2025-10-24T21:44:30.552808] [INFO ] [REMOTE    ] VCV: Fetching primary data for 2025-10.
[2025-10-24T21:44:30.641816] [INFO ] [REMOTE    ] VG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:44:31.347617] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-02.
[2025-10-24T21:44:31.371966] [INFO ] [REMOTE    ] VCV: Incremental fetch complete for 2025-10 (0.82 seconds).
[2025-10-24T21:44:31.373959] [INFO ] [REMOTE    ] VCV: Full fetch complete (18356 records).
[2025-10-24T21:44:31.374028] [DEBUG] [VALIDATOR ] VCV: Validating primary data.
[2025-10-24T21:44:31.740390] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present.
[2025-10-24T21:44:31.740562] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed.
[2025-10-24T21:44:31.741001] [INFO ] [MAIN      ] VCV: Fetched primary data is valid.
[2025-10-24T21:44:31.741340] [DEBUG] [LOCAL     ] VCV: Saving primary data.
[2025-10-24T21:44:31.741671] [FATAL] [LOCAL     ] VCV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:44:31.741752] [FATAL] [MAIN      ] VCV: Failed to save primary data.
[2025-10-24T21:44:31.741793] [WARN ] [MAIN      ] VCV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:44:31.741828] [INFO ] [LOCAL     ] VCV: Starting deletion of primary data.
[2025-10-24T21:44:31.741879] [DEBUG] [LOCAL     ] VCV: No primary data file found to delete.
[2025-10-24T21:44:31.741913] [INFO ] [LOCAL     ] VCV: Starting deletion of derivative data.
[2025-10-24T21:44:31.742074] [DEBUG] [LOCAL     ] VCV: Deleted derivative data file.
[2025-10-24T21:44:31.742167] [INFO ] [MAIN      ] Update Progress: 2216/2366 symbols completed. VCV took 38.5s. Estimated remaining: 19m 15s. Rate: 7.8 symbols/min
[2025-10-24T21:44:31.873340] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-01 (2.13 seconds).
[2025-10-24T21:44:31.952450] [INFO ] [MAIN      ] VGI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:44:31.959352] [DEBUG] [LOCAL     ] VGI: Loaded 5240 existing records from primary storage.
[2025-10-24T21:44:31.959544] [INFO ] [MAIN      ] VGI: Loaded 5240 existing records.
[2025-10-24T21:44:32.131442] [WARN ] [MAIN      ] VGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:44:32.131697] [INFO ] [MAIN      ] VGI: Wiping existing primary data before full refresh.
[2025-10-24T21:44:32.131758] [INFO ] [LOCAL     ] VGI: Starting deletion of primary data.
[2025-10-24T21:44:32.131892] [DEBUG] [LOCAL     ] VGI: Deleted primary data file.
[2025-10-24T21:44:32.131929] [INFO ] [MAIN      ] VGI: Starting full primary refresh.
[2025-10-24T21:44:32.152891] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-02.
[2025-10-24T21:44:32.488333] [INFO ] [REMOTE    ] VGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:44:32.510682] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-02 (1.16 seconds).
[2025-10-24T21:44:32.947713] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-01.
[2025-10-24T21:44:33.669026] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-01 (0.72 seconds).
[2025-10-24T21:44:33.747595] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-01.
[2025-10-24T21:44:33.848102] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-02 (1.70 seconds).
[2025-10-24T21:44:34.364761] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-01 (0.62 seconds).
[2025-10-24T21:44:34.547676] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-02.
[2025-10-24T21:44:35.128771] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T21:44:35.347687] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-03.
[2025-10-24T21:44:35.936536] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-03 (0.59 seconds).
[2025-10-24T21:44:36.147697] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-04.
[2025-10-24T21:44:36.815160] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-04 (0.67 seconds).
[2025-10-24T21:44:36.947763] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-02.
[2025-10-24T21:44:37.747733] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-05.
[2025-10-24T21:44:38.395377] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-05 (0.65 seconds).
[2025-10-24T21:44:38.547770] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-06.
[2025-10-24T21:44:38.847124] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-02 (1.90 seconds).
[2025-10-24T21:44:39.153388] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T21:44:39.347777] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-03.
[2025-10-24T21:44:40.147738] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-07.
[2025-10-24T21:44:40.768015] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-07 (0.62 seconds).
[2025-10-24T21:44:40.947747] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-08.
[2025-10-24T21:44:41.142445] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-03 (1.79 seconds).
[2025-10-24T21:44:41.342392] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-08 (0.39 seconds).
[2025-10-24T21:44:41.747714] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-09.
[2025-10-24T21:44:42.495261] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:44:42.547695] [INFO ] [REMOTE    ] VGI: Fetching primary data for 2025-10.
[2025-10-24T21:44:43.133432] [INFO ] [REMOTE    ] VGI: Incremental fetch complete for 2025-10 (0.59 seconds).
[2025-10-24T21:44:43.134816] [INFO ] [REMOTE    ] VGI: Full fetch complete (7517 records).
[2025-10-24T21:44:43.134885] [DEBUG] [VALIDATOR ] VGI: Validating primary data.
[2025-10-24T21:44:43.352861] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-04.
[2025-10-24T21:44:43.507728] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present.
[2025-10-24T21:44:43.507812] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed.
[2025-10-24T21:44:43.508102] [INFO ] [MAIN      ] VGI: Fetched primary data is valid.
[2025-10-24T21:44:43.508162] [DEBUG] [LOCAL     ] VGI: Saving primary data.
[2025-10-24T21:44:43.508386] [FATAL] [LOCAL     ] VGI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:44:43.508477] [FATAL] [MAIN      ] VGI: Failed to save primary data.
[2025-10-24T21:44:43.508518] [WARN ] [MAIN      ] VGI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:44:43.508554] [INFO ] [LOCAL     ] VGI: Starting deletion of primary data.
[2025-10-24T21:44:43.508608] [DEBUG] [LOCAL     ] VGI: No primary data file found to delete.
[2025-10-24T21:44:43.508666] [INFO ] [LOCAL     ] VGI: Starting deletion of derivative data.
[2025-10-24T21:44:43.508853] [DEBUG] [LOCAL     ] VGI: Deleted derivative data file.
[2025-10-24T21:44:43.508939] [INFO ] [MAIN      ] Update Progress: 2217/2366 symbols completed. VGI took 11.8s. Estimated remaining: 19m 8s. Rate: 7.8 symbols/min
[2025-10-24T21:44:43.676518] [INFO ] [MAIN      ] VGM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:44:43.694959] [DEBUG] [LOCAL     ] VGM: Loaded 18736 existing records from primary storage.
[2025-10-24T21:44:43.695201] [INFO ] [MAIN      ] VGM: Loaded 18736 existing records.
[2025-10-24T21:44:43.869992] [WARN ] [MAIN      ] VGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:44:43.870172] [INFO ] [MAIN      ] VGM: Wiping existing primary data before full refresh.
[2025-10-24T21:44:43.870218] [INFO ] [LOCAL     ] VGM: Starting deletion of primary data.
[2025-10-24T21:44:43.870570] [DEBUG] [LOCAL     ] VGM: Deleted primary data file.
[2025-10-24T21:44:43.870626] [INFO ] [MAIN      ] VGM: Starting full primary refresh.
[2025-10-24T21:44:44.153015] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-03.
[2025-10-24T21:44:44.231557] [INFO ] [REMOTE    ] VGM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:44:44.947704] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-03.
[2025-10-24T21:44:45.447935] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-04 (2.10 seconds).
[2025-10-24T21:44:45.747706] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-01.
[2025-10-24T21:44:46.092212] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-03 (1.94 seconds).
[2025-10-24T21:44:46.166285] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-03 (1.22 seconds).
[2025-10-24T21:44:46.547682] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-04.
[2025-10-24T21:44:46.671418] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-01 (0.92 seconds).
[2025-10-24T21:44:47.347723] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-04.
[2025-10-24T21:44:48.134798] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T21:44:48.147628] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-05.
[2025-10-24T21:44:48.947721] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-02.
[2025-10-24T21:44:49.406444] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-04 (2.06 seconds).
[2025-10-24T21:44:49.747665] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-05.
[2025-10-24T21:44:49.784904] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-05 (1.64 seconds).
[2025-10-24T21:44:49.961861] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T21:44:50.547745] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-06.
[2025-10-24T21:44:51.347757] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-03.
[2025-10-24T21:44:51.758882] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-05 (2.01 seconds).
[2025-10-24T21:44:52.123286] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T21:44:52.147618] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-07.
[2025-10-24T21:44:52.169738] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T21:44:52.947697] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-05.
[2025-10-24T21:44:53.641350] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T21:44:53.747720] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-08.
[2025-10-24T21:44:54.547693] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-04.
[2025-10-24T21:44:54.994264] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-05 (2.05 seconds).
[2025-10-24T21:44:55.295269] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T21:44:55.347633] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-09.
[2025-10-24T21:44:55.407388] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-04 (0.86 seconds).
[2025-10-24T21:44:56.147699] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-05.
[2025-10-24T21:44:56.947724] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-06.
[2025-10-24T21:44:56.994546] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T21:44:57.166461] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T21:44:57.747703] [INFO ] [REMOTE    ] VET: Fetching primary data for 2025-10.
[2025-10-24T21:44:58.547692] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-06.
[2025-10-24T21:44:58.838756] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T21:44:59.175557] [INFO ] [REMOTE    ] VET: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T21:44:59.184935] [INFO ] [REMOTE    ] VET: Full fetch complete (64465 records).
[2025-10-24T21:44:59.185087] [DEBUG] [VALIDATOR ] VET: Validating primary data.
[2025-10-24T21:44:59.352910] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-07.
[2025-10-24T21:44:59.621303] [DEBUG] [VALIDATOR ] VET: All expected trading days are present.
[2025-10-24T21:44:59.621447] [DEBUG] [VALIDATOR ] VET: Primary data validation passed.
[2025-10-24T21:44:59.622745] [INFO ] [MAIN      ] VET: Fetched primary data is valid.
[2025-10-24T21:44:59.622809] [DEBUG] [LOCAL     ] VET: Saving primary data.
[2025-10-24T21:44:59.623334] [FATAL] [LOCAL     ] VET: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:44:59.623423] [FATAL] [MAIN      ] VET: Failed to save primary data.
[2025-10-24T21:44:59.623470] [WARN ] [MAIN      ] VET: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:44:59.623506] [INFO ] [LOCAL     ] VET: Starting deletion of primary data.
[2025-10-24T21:44:59.623572] [DEBUG] [LOCAL     ] VET: No primary data file found to delete.
[2025-10-24T21:44:59.623626] [INFO ] [LOCAL     ] VET: Starting deletion of derivative data.
[2025-10-24T21:44:59.623827] [DEBUG] [LOCAL     ] VET: Deleted derivative data file.
[2025-10-24T21:44:59.624102] [INFO ] [MAIN      ] Update Progress: 2218/2366 symbols completed. VET took 32.8s. Estimated remaining: 19m 1s. Rate: 7.8 symbols/min
[2025-10-24T21:44:59.741890] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T21:44:59.816279] [INFO ] [MAIN      ] VHI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:44:59.821130] [DEBUG] [LOCAL     ] VHI: Loaded 2684 existing records from primary storage.
[2025-10-24T21:44:59.821319] [INFO ] [MAIN      ] VHI: Loaded 2684 existing records.
[2025-10-24T21:44:59.997881] [WARN ] [MAIN      ] VHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:44:59.998110] [INFO ] [MAIN      ] VHI: Wiping existing primary data before full refresh.
[2025-10-24T21:44:59.998167] [INFO ] [LOCAL     ] VHI: Starting deletion of primary data.
[2025-10-24T21:44:59.998290] [DEBUG] [LOCAL     ] VHI: Deleted primary data file.
[2025-10-24T21:44:59.998331] [INFO ] [MAIN      ] VHI: Starting full primary refresh.
[2025-10-24T21:45:00.152808] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-06.
[2025-10-24T21:45:00.357408] [INFO ] [REMOTE    ] VHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:45:00.947700] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-07.
[2025-10-24T21:45:01.070351] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T21:45:01.720236] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-07 (0.77 seconds).
[2025-10-24T21:45:01.747674] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-08.
[2025-10-24T21:45:02.328999] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-06 (2.18 seconds).
[2025-10-24T21:45:02.547702] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-07.
[2025-10-24T21:45:02.859898] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-08 (1.11 seconds).
[2025-10-24T21:45:03.347707] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-09.
[2025-10-24T21:45:04.147762] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-01.
[2025-10-24T21:45:04.381097] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T21:45:04.624593] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-01 (0.48 seconds).
[2025-10-24T21:45:04.947664] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-08.
[2025-10-24T21:45:04.986368] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-07 (2.44 seconds).
[2025-10-24T21:45:05.747722] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-08.
[2025-10-24T21:45:06.547691] [INFO ] [REMOTE    ] VGM: Fetching primary data for 2025-10.
[2025-10-24T21:45:07.004810] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-08 (2.06 seconds).
[2025-10-24T21:45:07.347708] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-02.
[2025-10-24T21:45:07.527842] [INFO ] [REMOTE    ] VGM: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T21:45:07.531613] [INFO ] [REMOTE    ] VGM: Full fetch complete (25702 records).
[2025-10-24T21:45:07.531769] [DEBUG] [VALIDATOR ] VGM: Validating primary data.
[2025-10-24T21:45:07.875066] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-08 (2.13 seconds).
[2025-10-24T21:45:07.892527] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-02 (0.54 seconds).
[2025-10-24T21:45:08.030898] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present.
[2025-10-24T21:45:08.030972] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed.
[2025-10-24T21:45:08.031534] [INFO ] [MAIN      ] VGM: Fetched primary data is valid.
[2025-10-24T21:45:08.031595] [DEBUG] [LOCAL     ] VGM: Saving primary data.
[2025-10-24T21:45:08.031933] [FATAL] [LOCAL     ] VGM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:45:08.032013] [FATAL] [MAIN      ] VGM: Failed to save primary data.
[2025-10-24T21:45:08.032055] [WARN ] [MAIN      ] VGM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:45:08.032117] [INFO ] [LOCAL     ] VGM: Starting deletion of primary data.
[2025-10-24T21:45:08.032173] [DEBUG] [LOCAL     ] VGM: No primary data file found to delete.
[2025-10-24T21:45:08.032210] [INFO ] [LOCAL     ] VGM: Starting deletion of derivative data.
[2025-10-24T21:45:08.032376] [DEBUG] [LOCAL     ] VGM: Deleted derivative data file.
[2025-10-24T21:45:08.032466] [INFO ] [MAIN      ] Update Progress: 2219/2366 symbols completed. VGM took 24.5s. Estimated remaining: 18m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:45:08.152798] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-09.
[2025-10-24T21:45:08.207677] [INFO ] [MAIN      ] VIA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:45:08.207850] [DEBUG] [LOCAL     ] VIA: No existing data file found in primary storage.
[2025-10-24T21:45:08.207887] [WARN ] [MAIN      ] VIA: No existing data found, performing full refresh instead.
[2025-10-24T21:45:08.208015] [INFO ] [MAIN      ] VIA: Wiping existing primary data before full refresh.
[2025-10-24T21:45:08.208057] [INFO ] [LOCAL     ] VIA: Starting deletion of primary data.
[2025-10-24T21:45:08.208098] [DEBUG] [LOCAL     ] VIA: No primary data file found to delete.
[2025-10-24T21:45:08.208130] [INFO ] [MAIN      ] VIA: Starting full primary refresh.
[2025-10-24T21:45:08.564318] [INFO ] [REMOTE    ] VIA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:45:08.947696] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-03.
[2025-10-24T21:45:09.649031] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-03 (0.70 seconds).
[2025-10-24T21:45:09.747712] [INFO ] [REMOTE    ] VIA: Fetching primary data for 2025-01.
[2025-10-24T21:45:09.963617] [DEBUG] [REMOTE    ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:45:09.974790] [WARN ] [REMOTE    ] VIA: No data returned for month 2025-01
[2025-10-24T21:45:09.976544] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T21:45:09.976675] [FATAL] [REMOTE    ] VIA: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:45:09.987877] [FATAL] [MAIN      ] VIA: Failed to fetch primary data.
[2025-10-24T21:45:09.988136] [WARN ] [MAIN      ] VIA: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:45:09.988236] [INFO ] [LOCAL     ] VIA: Starting deletion of primary data.
[2025-10-24T21:45:09.988715] [DEBUG] [LOCAL     ] VIA: No primary data file found to delete.
[2025-10-24T21:45:09.988778] [INFO ] [LOCAL     ] VIA: Starting deletion of derivative data.
[2025-10-24T21:45:09.988825] [DEBUG] [LOCAL     ] VIA: No derivative data file found to delete.
[2025-10-24T21:45:09.988874] [INFO ] [MAIN      ] Update Progress: 2220/2366 symbols completed. VIA took 2.0s. Estimated remaining: 18m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:45:10.154227] [INFO ] [MAIN      ] VICI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:45:10.204771] [DEBUG] [LOCAL     ] VICI: Loaded 54043 existing records from primary storage.
[2025-10-24T21:45:10.205087] [INFO ] [MAIN      ] VICI: Loaded 54043 existing records.
[2025-10-24T21:45:10.377859] [WARN ] [MAIN      ] VICI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:45:10.378055] [INFO ] [MAIN      ] VICI: Wiping existing primary data before full refresh.
[2025-10-24T21:45:10.378102] [INFO ] [LOCAL     ] VICI: Starting deletion of primary data.
[2025-10-24T21:45:10.379067] [DEBUG] [LOCAL     ] VICI: Deleted primary data file.
[2025-10-24T21:45:10.379123] [INFO ] [MAIN      ] VICI: Starting full primary refresh.
[2025-10-24T21:45:10.552806] [INFO ] [REMOTE    ] VG: Fetching primary data for 2025-10.
[2025-10-24T21:45:10.737032] [INFO ] [REMOTE    ] VICI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:45:11.347703] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-09.
[2025-10-24T21:45:12.147750] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-04.
[2025-10-24T21:45:12.732180] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-04 (0.58 seconds).
[2025-10-24T21:45:12.774901] [INFO ] [REMOTE    ] VG: Incremental fetch complete for 2025-10 (2.22 seconds).
[2025-10-24T21:45:12.785607] [INFO ] [REMOTE    ] VG: Full fetch complete (73468 records).
[2025-10-24T21:45:12.785855] [DEBUG] [VALIDATOR ] VG: Validating primary data.
[2025-10-24T21:45:12.970082] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-05.
[2025-10-24T21:45:12.994974] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 190 unique days, need 200 days
[2025-10-24T21:45:12.996525] [FATAL] [MAIN      ] VG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:45:12.996722] [WARN ] [MAIN      ] VG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:45:12.996804] [INFO ] [LOCAL     ] VG: Starting deletion of primary data.
[2025-10-24T21:45:12.996878] [DEBUG] [LOCAL     ] VG: No primary data file found to delete.
[2025-10-24T21:45:12.996917] [INFO ] [LOCAL     ] VG: Starting deletion of derivative data.
[2025-10-24T21:45:12.996956] [DEBUG] [LOCAL     ] VG: No derivative data file found to delete.
[2025-10-24T21:45:12.997028] [INFO ] [MAIN      ] Update Progress: 2221/2366 symbols completed. VG took 42.9s. Estimated remaining: 18m 37s. Rate: 7.8 symbols/min
[2025-10-24T21:45:13.196036] [INFO ] [MAIN      ] VIK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:45:13.247560] [DEBUG] [LOCAL     ] VIK: Loaded 52713 existing records from primary storage.
[2025-10-24T21:45:13.248199] [INFO ] [MAIN      ] VIK: Loaded 52713 existing records.
[2025-10-24T21:45:13.470231] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-09 (2.12 seconds).
[2025-10-24T21:45:13.474489] [WARN ] [MAIN      ] VIK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:45:13.486419] [INFO ] [MAIN      ] VIK: Wiping existing primary data before full refresh.
[2025-10-24T21:45:13.486676] [INFO ] [LOCAL     ] VIK: Starting deletion of primary data.
[2025-10-24T21:45:13.487835] [DEBUG] [LOCAL     ] VIK: Deleted primary data file.
[2025-10-24T21:45:13.487904] [INFO ] [MAIN      ] VIK: Starting full primary refresh.
[2025-10-24T21:45:13.573291] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-05 (0.60 seconds).
[2025-10-24T21:45:13.752926] [INFO ] [REMOTE    ] VFC: Fetching primary data for 2025-10.
[2025-10-24T21:45:13.849844] [INFO ] [REMOTE    ] VIK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:45:14.547708] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-06.
[2025-10-24T21:45:15.163288] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-06 (0.62 seconds).
[2025-10-24T21:45:15.347695] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-01.
[2025-10-24T21:45:15.689710] [INFO ] [REMOTE    ] VFC: Incremental fetch complete for 2025-10 (1.94 seconds).
[2025-10-24T21:45:15.702907] [INFO ] [REMOTE    ] VFC: Full fetch complete (77752 records).
[2025-10-24T21:45:15.703095] [DEBUG] [VALIDATOR ] VFC: Validating primary data.
[2025-10-24T21:45:16.119124] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present.
[2025-10-24T21:45:16.119206] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed.
[2025-10-24T21:45:16.120627] [INFO ] [MAIN      ] VFC: Fetched primary data is valid.
[2025-10-24T21:45:16.120722] [DEBUG] [LOCAL     ] VFC: Saving primary data.
[2025-10-24T21:45:16.121326] [FATAL] [LOCAL     ] VFC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:45:16.121425] [FATAL] [MAIN      ] VFC: Failed to save primary data.
[2025-10-24T21:45:16.121468] [WARN ] [MAIN      ] VFC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:45:16.121506] [INFO ] [LOCAL     ] VFC: Starting deletion of primary data.
[2025-10-24T21:45:16.121560] [DEBUG] [LOCAL     ] VFC: No primary data file found to delete.
[2025-10-24T21:45:16.121597] [INFO ] [LOCAL     ] VFC: Starting deletion of derivative data.
[2025-10-24T21:45:16.121810] [DEBUG] [LOCAL     ] VFC: Deleted derivative data file.
[2025-10-24T21:45:16.122207] [INFO ] [MAIN      ] Update Progress: 2222/2366 symbols completed. VFC took 47.5s. Estimated remaining: 18m 29s. Rate: 7.8 symbols/min
[2025-10-24T21:45:16.156053] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-01.
[2025-10-24T21:45:16.301627] [INFO ] [MAIN      ] VIPS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:45:16.354377] [DEBUG] [LOCAL     ] VIPS: Loaded 51623 existing records from primary storage.
[2025-10-24T21:45:16.354788] [INFO ] [MAIN      ] VIPS: Loaded 51623 existing records.
[2025-10-24T21:45:16.547173] [WARN ] [MAIN      ] VIPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:45:16.547415] [INFO ] [MAIN      ] VIPS: Wiping existing primary data before full refresh.
[2025-10-24T21:45:16.547469] [INFO ] [LOCAL     ] VIPS: Starting deletion of primary data.
[2025-10-24T21:45:16.548349] [DEBUG] [LOCAL     ] VIPS: Deleted primary data file.
[2025-10-24T21:45:16.548408] [INFO ] [MAIN      ] VIPS: Starting full primary refresh.
[2025-10-24T21:45:16.908824] [INFO ] [REMOTE    ] VIPS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:45:16.947626] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-01.
[2025-10-24T21:45:17.747723] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-07.
[2025-10-24T21:45:18.307813] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-07 (0.56 seconds).
[2025-10-24T21:45:18.377773] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-01 (3.03 seconds).
[2025-10-24T21:45:18.547699] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-02.
[2025-10-24T21:45:18.622004] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-01 (1.67 seconds).
[2025-10-24T21:45:18.941734] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-01 (2.79 seconds).
[2025-10-24T21:45:19.347726] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-02.
[2025-10-24T21:45:20.147627] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-08.
[2025-10-24T21:45:20.423630] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-02 (1.88 seconds).
[2025-10-24T21:45:20.741624] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-08 (0.59 seconds).
[2025-10-24T21:45:20.866007] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T21:45:20.947622] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-03.
[2025-10-24T21:45:21.747683] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-09.
[2025-10-24T21:45:22.229739] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-09 (0.48 seconds).
[2025-10-24T21:45:22.547687] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-03.
[2025-10-24T21:45:22.755148] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T21:45:23.347714] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-04.
[2025-10-24T21:45:24.147701] [INFO ] [REMOTE    ] VHI: Fetching primary data for 2025-10.
[2025-10-24T21:45:24.521920] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-03 (1.97 seconds).
[2025-10-24T21:45:24.636127] [INFO ] [REMOTE    ] VHI: Incremental fetch complete for 2025-10 (0.49 seconds).
[2025-10-24T21:45:24.637184] [INFO ] [REMOTE    ] VHI: Full fetch complete (4302 records).
[2025-10-24T21:45:24.637251] [DEBUG] [VALIDATOR ] VHI: Validating primary data.
[2025-10-24T21:45:24.957168] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-04.
[2025-10-24T21:45:24.998115] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present.
[2025-10-24T21:45:24.998220] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed.
[2025-10-24T21:45:24.998482] [INFO ] [MAIN      ] VHI: Fetched primary data is valid.
[2025-10-24T21:45:24.998666] [DEBUG] [LOCAL     ] VHI: Saving primary data.
[2025-10-24T21:45:24.998968] [FATAL] [LOCAL     ] VHI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:45:24.999169] [FATAL] [MAIN      ] VHI: Failed to save primary data.
[2025-10-24T21:45:24.999246] [WARN ] [MAIN      ] VHI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:45:24.999333] [INFO ] [LOCAL     ] VHI: Starting deletion of primary data.
[2025-10-24T21:45:24.999547] [DEBUG] [LOCAL     ] VHI: No primary data file found to delete.
[2025-10-24T21:45:24.999681] [INFO ] [LOCAL     ] VHI: Starting deletion of derivative data.
[2025-10-24T21:45:24.999930] [DEBUG] [LOCAL     ] VHI: Deleted derivative data file.
[2025-10-24T21:45:25.000023] [INFO ] [MAIN      ] Update Progress: 2223/2366 symbols completed. VHI took 25.4s. Estimated remaining: 18m 21s. Rate: 7.8 symbols/min
[2025-10-24T21:45:25.173265] [INFO ] [MAIN      ] VIRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:45:25.203131] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T21:45:25.250602] [DEBUG] [LOCAL     ] VIRT: Loaded 46759 existing records from primary storage.
[2025-10-24T21:45:25.250921] [INFO ] [MAIN      ] VIRT: Loaded 46759 existing records.
[2025-10-24T21:45:25.426406] [WARN ] [MAIN      ] VIRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:45:25.426584] [INFO ] [MAIN      ] VIRT: Wiping existing primary data before full refresh.
[2025-10-24T21:45:25.426630] [INFO ] [LOCAL     ] VIRT: Starting deletion of primary data.
[2025-10-24T21:45:25.427327] [DEBUG] [LOCAL     ] VIRT: Deleted primary data file.
[2025-10-24T21:45:25.427374] [INFO ] [MAIN      ] VIRT: Starting full primary refresh.
[2025-10-24T21:45:25.748125] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-02.
[2025-10-24T21:45:25.782525] [INFO ] [REMOTE    ] VIRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:45:26.547714] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-05.
[2025-10-24T21:45:27.045478] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-04 (2.09 seconds).
[2025-10-24T21:45:27.347746] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-05.
[2025-10-24T21:45:27.427666] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T21:45:27.777242] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-05 (1.23 seconds).
[2025-10-24T21:45:28.147713] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-01.
[2025-10-24T21:45:28.947686] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-06.
[2025-10-24T21:45:29.012501] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T21:45:29.747730] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-03.
[2025-10-24T21:45:29.790411] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T21:45:30.547689] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-06.
[2025-10-24T21:45:30.706853] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-06 (1.76 seconds).
[2025-10-24T21:45:31.347694] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-07.
[2025-10-24T21:45:31.591027] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T21:45:32.147631] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-04.
[2025-10-24T21:45:32.498273] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-06 (1.95 seconds).
[2025-10-24T21:45:32.865603] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T21:45:32.947638] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-02.
[2025-10-24T21:45:33.747674] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-07.
[2025-10-24T21:45:33.980491] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T21:45:34.434621] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T21:45:34.547698] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-03.
[2025-10-24T21:45:35.347710] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-05.
[2025-10-24T21:45:35.785539] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-07 (2.04 seconds).
[2025-10-24T21:45:35.922230] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T21:45:36.147736] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-08.
[2025-10-24T21:45:36.947630] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-08.
[2025-10-24T21:45:37.136527] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T21:45:37.747692] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-04.
[2025-10-24T21:45:38.077508] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-08 (1.93 seconds).
[2025-10-24T21:45:38.293358] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-08 (1.35 seconds).
[2025-10-24T21:45:38.547724] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-09.
[2025-10-24T21:45:39.035443] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-04 (1.29 seconds).
[2025-10-24T21:45:39.347728] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-05.
[2025-10-24T21:45:40.147711] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-06.
[2025-10-24T21:45:40.318723] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T21:45:40.893163] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T21:45:40.947678] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-09.
[2025-10-24T21:45:41.603578] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T21:45:41.747683] [INFO ] [REMOTE    ] VIK: Fetching primary data for 2025-10.
[2025-10-24T21:45:42.450285] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T21:45:42.547624] [INFO ] [REMOTE    ] VICI: Fetching primary data for 2025-10.
[2025-10-24T21:45:43.320240] [INFO ] [REMOTE    ] VICI: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T21:45:43.330275] [INFO ] [REMOTE    ] VICI: Full fetch complete (77802 records).
[2025-10-24T21:45:43.330445] [DEBUG] [VALIDATOR ] VICI: Validating primary data.
[2025-10-24T21:45:43.353177] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-07.
[2025-10-24T21:45:43.803626] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present.
[2025-10-24T21:45:43.804085] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed.
[2025-10-24T21:45:43.805352] [INFO ] [MAIN      ] VICI: Fetched primary data is valid.
[2025-10-24T21:45:43.807977] [INFO ] [REMOTE    ] VIK: Incremental fetch complete for 2025-10 (2.06 seconds).
[2025-10-24T21:45:43.808128] [DEBUG] [LOCAL     ] VICI: Saving primary data.
[2025-10-24T21:45:43.819127] [FATAL] [LOCAL     ] VICI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:45:43.819409] [FATAL] [MAIN      ] VICI: Failed to save primary data.
[2025-10-24T21:45:43.819478] [WARN ] [MAIN      ] VICI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:45:43.819547] [INFO ] [LOCAL     ] VICI: Starting deletion of primary data.
[2025-10-24T21:45:43.819674] [DEBUG] [LOCAL     ] VICI: No primary data file found to delete.
[2025-10-24T21:45:43.819731] [INFO ] [LOCAL     ] VICI: Starting deletion of derivative data.
[2025-10-24T21:45:43.819945] [DEBUG] [LOCAL     ] VICI: Deleted derivative data file.
[2025-10-24T21:45:43.820247] [INFO ] [MAIN      ] Update Progress: 2224/2366 symbols completed. VICI took 33.8s. Estimated remaining: 18m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:45:43.820458] [INFO ] [REMOTE    ] VIK: Full fetch complete (75877 records).
[2025-10-24T21:45:43.841439] [DEBUG] [VALIDATOR ] VIK: Validating primary data.
[2025-10-24T21:45:44.145438] [INFO ] [MAIN      ] VIST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:45:44.179609] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-06.
[2025-10-24T21:45:44.415594] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present.
[2025-10-24T21:45:44.415707] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed.
[2025-10-24T21:45:44.416944] [INFO ] [MAIN      ] VIK: Fetched primary data is valid.
[2025-10-24T21:45:44.418163] [DEBUG] [LOCAL     ] VIK: Saving primary data.
[2025-10-24T21:45:44.430255] [FATAL] [LOCAL     ] VIK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:45:44.431349] [FATAL] [MAIN      ] VIK: Failed to save primary data.
[2025-10-24T21:45:44.431428] [WARN ] [MAIN      ] VIK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:45:44.432206] [DEBUG] [LOCAL     ] VIST: Loaded 47029 existing records from primary storage.
[2025-10-24T21:45:44.432274] [INFO ] [LOCAL     ] VIK: Starting deletion of primary data.
[2025-10-24T21:45:44.432565] [INFO ] [MAIN      ] VIST: Loaded 47029 existing records.
[2025-10-24T21:45:44.432471] [DEBUG] [LOCAL     ] VIK: No primary data file found to delete.
[2025-10-24T21:45:44.465262] [INFO ] [LOCAL     ] VIK: Starting deletion of derivative data.
[2025-10-24T21:45:44.490218] [DEBUG] [LOCAL     ] VIK: Deleted derivative data file.
[2025-10-24T21:45:44.499528] [INFO ] [MAIN      ] Update Progress: 2225/2366 symbols completed. VIK took 31.5s. Estimated remaining: 18m 6s. Rate: 7.8 symbols/min
[2025-10-24T21:45:44.738312] [WARN ] [MAIN      ] VIST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:45:44.754305] [INFO ] [MAIN      ] VIST: Wiping existing primary data before full refresh.
[2025-10-24T21:45:44.779996] [INFO ] [LOCAL     ] VIST: Starting deletion of primary data.
[2025-10-24T21:45:44.805569] [INFO ] [MAIN      ] VIV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:45:44.806146] [DEBUG] [LOCAL     ] VIST: Deleted primary data file.
[2025-10-24T21:45:44.806219] [INFO ] [MAIN      ] VIST: Starting full primary refresh.
[2025-10-24T21:45:45.124608] [DEBUG] [LOCAL     ] VIV: Loaded 44842 existing records from primary storage.
[2025-10-24T21:45:45.140757] [INFO ] [MAIN      ] VIV: Loaded 44842 existing records.
[2025-10-24T21:45:45.287137] [INFO ] [REMOTE    ] VIST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:45:45.299092] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-01.
[2025-10-24T21:45:45.391719] [WARN ] [MAIN      ] VIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:45:45.392056] [INFO ] [MAIN      ] VIV: Wiping existing primary data before full refresh.
[2025-10-24T21:45:45.392130] [INFO ] [LOCAL     ] VIV: Starting deletion of primary data.
[2025-10-24T21:45:45.402256] [DEBUG] [LOCAL     ] VIV: Deleted primary data file.
[2025-10-24T21:45:45.419500] [INFO ] [MAIN      ] VIV: Starting full primary refresh.
[2025-10-24T21:45:45.459183] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-07 (2.11 seconds).
[2025-10-24T21:45:45.760397] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-08.
[2025-10-24T21:45:45.804452] [INFO ] [REMOTE    ] VIV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:45:45.852358] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T21:45:46.547698] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-01.
[2025-10-24T21:45:46.942374] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-01 (1.64 seconds).
[2025-10-24T21:45:47.293449] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T21:45:47.347636] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-02.
[2025-10-24T21:45:48.155371] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-07.
[2025-10-24T21:45:48.159844] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T21:45:48.947640] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-02.
[2025-10-24T21:45:49.009192] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-02 (1.66 seconds).
[2025-10-24T21:45:49.747677] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-03.
[2025-10-24T21:45:49.984767] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-07 (1.83 seconds).
[2025-10-24T21:45:50.324187] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-02 (1.38 seconds).
[2025-10-24T21:45:50.547722] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-08.
[2025-10-24T21:45:51.276620] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T21:45:51.347732] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-04.
[2025-10-24T21:45:52.147719] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-03.
[2025-10-24T21:45:52.360330] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-08 (1.81 seconds).
[2025-10-24T21:45:52.947671] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-09.
[2025-10-24T21:45:53.124984] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T21:45:53.695995] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-03 (1.55 seconds).
[2025-10-24T21:45:53.747664] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-04.
[2025-10-24T21:45:54.442408] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T21:45:54.547726] [INFO ] [REMOTE    ] VIRT: Fetching primary data for 2025-10.
[2025-10-24T21:45:55.274727] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T21:45:55.347705] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-09.
[2025-10-24T21:45:56.153733] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-05.
[2025-10-24T21:45:56.169207] [INFO ] [REMOTE    ] VIRT: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T21:45:56.179859] [INFO ] [REMOTE    ] VIRT: Full fetch complete (67549 records).
[2025-10-24T21:45:56.179977] [DEBUG] [VALIDATOR ] VIRT: Validating primary data.
[2025-10-24T21:45:56.571067] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present.
[2025-10-24T21:45:56.571157] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed.
[2025-10-24T21:45:56.572244] [INFO ] [MAIN      ] VIRT: Fetched primary data is valid.
[2025-10-24T21:45:56.572304] [DEBUG] [LOCAL     ] VIRT: Saving primary data.
[2025-10-24T21:45:56.572841] [FATAL] [LOCAL     ] VIRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:45:56.572926] [FATAL] [MAIN      ] VIRT: Failed to save primary data.
[2025-10-24T21:45:56.572967] [WARN ] [MAIN      ] VIRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:45:56.573000] [INFO ] [LOCAL     ] VIRT: Starting deletion of primary data.
[2025-10-24T21:45:56.573049] [DEBUG] [LOCAL     ] VIRT: No primary data file found to delete.
[2025-10-24T21:45:56.573083] [INFO ] [LOCAL     ] VIRT: Starting deletion of derivative data.
[2025-10-24T21:45:56.573258] [DEBUG] [LOCAL     ] VIRT: Deleted derivative data file.
[2025-10-24T21:45:56.573583] [INFO ] [MAIN      ] Update Progress: 2226/2366 symbols completed. VIRT took 31.6s. Estimated remaining: 17m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:45:56.747238] [INFO ] [MAIN      ] VKQ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:45:56.764917] [DEBUG] [LOCAL     ] VKQ: Loaded 17940 existing records from primary storage.
[2025-10-24T21:45:56.765180] [INFO ] [MAIN      ] VKQ: Loaded 17940 existing records.
[2025-10-24T21:45:56.941637] [WARN ] [MAIN      ] VKQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:45:56.941875] [INFO ] [MAIN      ] VKQ: Wiping existing primary data before full refresh.
[2025-10-24T21:45:56.941919] [INFO ] [LOCAL     ] VKQ: Starting deletion of primary data.
[2025-10-24T21:45:56.942275] [DEBUG] [LOCAL     ] VKQ: Deleted primary data file.
[2025-10-24T21:45:56.942330] [INFO ] [MAIN      ] VKQ: Starting full primary refresh.
[2025-10-24T21:45:56.953636] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-05.
[2025-10-24T21:45:57.334729] [INFO ] [REMOTE    ] VKQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:45:57.337238] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-09 (1.99 seconds).
[2025-10-24T21:45:57.723141] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-05 (1.57 seconds).
[2025-10-24T21:45:57.747616] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-06.
[2025-10-24T21:45:58.297452] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T21:45:58.547702] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-06.
[2025-10-24T21:45:59.347725] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-01.
[2025-10-24T21:45:59.601403] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T21:45:59.689831] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T21:46:00.147639] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-07.
[2025-10-24T21:46:00.260299] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-01 (0.91 seconds).
[2025-10-24T21:46:00.947723] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-02.
[2025-10-24T21:46:01.747674] [INFO ] [REMOTE    ] VIPS: Fetching primary data for 2025-10.
[2025-10-24T21:46:02.160227] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-07 (2.01 seconds).
[2025-10-24T21:46:02.192761] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T21:46:02.547665] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-08.
[2025-10-24T21:46:03.347682] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-07.
[2025-10-24T21:46:03.638946] [INFO ] [REMOTE    ] VIPS: Incremental fetch complete for 2025-10 (1.89 seconds).
[2025-10-24T21:46:03.649803] [INFO ] [REMOTE    ] VIPS: Full fetch complete (74849 records).
[2025-10-24T21:46:03.649953] [DEBUG] [VALIDATOR ] VIPS: Validating primary data.
[2025-10-24T21:46:04.057005] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present.
[2025-10-24T21:46:04.057190] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed.
[2025-10-24T21:46:04.058406] [INFO ] [MAIN      ] VIPS: Fetched primary data is valid.
[2025-10-24T21:46:04.058486] [DEBUG] [LOCAL     ] VIPS: Saving primary data.
[2025-10-24T21:46:04.059253] [FATAL] [LOCAL     ] VIPS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:46:04.068496] [FATAL] [MAIN      ] VIPS: Failed to save primary data.
[2025-10-24T21:46:04.081120] [WARN ] [MAIN      ] VIPS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:46:04.083798] [INFO ] [LOCAL     ] VIPS: Starting deletion of primary data.
[2025-10-24T21:46:04.084062] [DEBUG] [LOCAL     ] VIPS: No primary data file found to delete.
[2025-10-24T21:46:04.085306] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T21:46:04.084468] [INFO ] [LOCAL     ] VIPS: Starting deletion of derivative data.
[2025-10-24T21:46:04.094991] [DEBUG] [LOCAL     ] VIPS: Deleted derivative data file.
[2025-10-24T21:46:04.095573] [INFO ] [MAIN      ] Update Progress: 2227/2366 symbols completed. VIPS took 48.0s. Estimated remaining: 17m 51s. Rate: 7.8 symbols/min
[2025-10-24T21:46:04.159401] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-03.
[2025-10-24T21:46:04.277814] [INFO ] [MAIN      ] VLN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:46:04.307687] [DEBUG] [LOCAL     ] VLN: Loaded 31255 existing records from primary storage.
[2025-10-24T21:46:04.307983] [INFO ] [MAIN      ] VLN: Loaded 31255 existing records.
[2025-10-24T21:46:04.484756] [WARN ] [MAIN      ] VLN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:46:04.485038] [INFO ] [MAIN      ] VLN: Wiping existing primary data before full refresh.
[2025-10-24T21:46:04.485101] [INFO ] [LOCAL     ] VLN: Starting deletion of primary data.
[2025-10-24T21:46:04.485413] [DEBUG] [LOCAL     ] VLN: Deleted primary data file.
[2025-10-24T21:46:04.485471] [INFO ] [MAIN      ] VLN: Starting full primary refresh.
[2025-10-24T21:46:04.849244] [INFO ] [REMOTE    ] VLN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:46:04.943461] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T21:46:04.952940] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-01.
[2025-10-24T21:46:05.299276] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-03 (1.14 seconds).
[2025-10-24T21:46:05.747662] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-08.
[2025-10-24T21:46:06.556173] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-09.
[2025-10-24T21:46:06.562145] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T21:46:07.289626] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-08 (1.54 seconds).
[2025-10-24T21:46:07.347690] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-04.
[2025-10-24T21:46:07.880180] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-09 (1.32 seconds).
[2025-10-24T21:46:08.075559] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T21:46:08.147723] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-05.
[2025-10-24T21:46:08.947713] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-09.
[2025-10-24T21:46:09.087676] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-05 (0.94 seconds).
[2025-10-24T21:46:09.747726] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-06.
[2025-10-24T21:46:10.351532] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T21:46:10.547678] [INFO ] [REMOTE    ] VIV: Fetching primary data for 2025-10.
[2025-10-24T21:46:10.745200] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T21:46:11.347706] [INFO ] [REMOTE    ] VIST: Fetching primary data for 2025-10.
[2025-10-24T21:46:12.136193] [INFO ] [REMOTE    ] VIV: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T21:46:12.144346] [INFO ] [REMOTE    ] VIV: Full fetch complete (64261 records).
[2025-10-24T21:46:12.144486] [DEBUG] [VALIDATOR ] VIV: Validating primary data.
[2025-10-24T21:46:12.156795] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-07.
[2025-10-24T21:46:12.560499] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present.
[2025-10-24T21:46:12.560605] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed.
[2025-10-24T21:46:12.561871] [INFO ] [MAIN      ] VIV: Fetched primary data is valid.
[2025-10-24T21:46:12.561936] [DEBUG] [LOCAL     ] VIV: Saving primary data.
[2025-10-24T21:46:12.562530] [FATAL] [LOCAL     ] VIV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:46:12.562684] [FATAL] [MAIN      ] VIV: Failed to save primary data.
[2025-10-24T21:46:12.562738] [WARN ] [MAIN      ] VIV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:46:12.562795] [INFO ] [LOCAL     ] VIV: Starting deletion of primary data.
[2025-10-24T21:46:12.562888] [DEBUG] [LOCAL     ] VIV: No primary data file found to delete.
[2025-10-24T21:46:12.562935] [INFO ] [LOCAL     ] VIV: Starting deletion of derivative data.
[2025-10-24T21:46:12.563188] [DEBUG] [LOCAL     ] VIV: Deleted derivative data file.
[2025-10-24T21:46:12.563287] [INFO ] [MAIN      ] Update Progress: 2228/2366 symbols completed. VIV took 28.1s. Estimated remaining: 17m 43s. Rate: 7.8 symbols/min
[2025-10-24T21:46:12.740395] [INFO ] [MAIN      ] VLO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:46:12.795440] [DEBUG] [LOCAL     ] VLO: Loaded 53345 existing records from primary storage.
[2025-10-24T21:46:12.795819] [INFO ] [MAIN      ] VLO: Loaded 53345 existing records.
[2025-10-24T21:46:12.951144] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-02.
[2025-10-24T21:46:12.983418] [WARN ] [MAIN      ] VLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:46:12.983744] [INFO ] [MAIN      ] VLO: Wiping existing primary data before full refresh.
[2025-10-24T21:46:12.983853] [INFO ] [LOCAL     ] VLO: Starting deletion of primary data.
[2025-10-24T21:46:12.984370] [DEBUG] [LOCAL     ] VLO: Deleted primary data file.
[2025-10-24T21:46:12.984411] [INFO ] [MAIN      ] VLO: Starting full primary refresh.
[2025-10-24T21:46:13.232469] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-07 (1.08 seconds).
[2025-10-24T21:46:13.407231] [INFO ] [REMOTE    ] VIST: Incremental fetch complete for 2025-10 (2.06 seconds).
[2025-10-24T21:46:13.412032] [INFO ] [REMOTE    ] VLO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:46:13.421062] [INFO ] [REMOTE    ] VIST: Full fetch complete (67550 records).
[2025-10-24T21:46:13.421151] [DEBUG] [VALIDATOR ] VIST: Validating primary data.
[2025-10-24T21:46:13.751614] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-08.
[2025-10-24T21:46:13.801849] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present.
[2025-10-24T21:46:13.801973] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed.
[2025-10-24T21:46:13.803110] [INFO ] [MAIN      ] VIST: Fetched primary data is valid.
[2025-10-24T21:46:13.803172] [DEBUG] [LOCAL     ] VIST: Saving primary data.
[2025-10-24T21:46:13.803738] [FATAL] [LOCAL     ] VIST: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:46:13.803823] [FATAL] [MAIN      ] VIST: Failed to save primary data.
[2025-10-24T21:46:13.803865] [WARN ] [MAIN      ] VIST: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:46:13.803925] [INFO ] [LOCAL     ] VIST: Starting deletion of primary data.
[2025-10-24T21:46:13.803983] [DEBUG] [LOCAL     ] VIST: No primary data file found to delete.
[2025-10-24T21:46:13.804018] [INFO ] [LOCAL     ] VIST: Starting deletion of derivative data.
[2025-10-24T21:46:13.804232] [DEBUG] [LOCAL     ] VIST: Deleted derivative data file.
[2025-10-24T21:46:13.804673] [INFO ] [MAIN      ] Update Progress: 2229/2366 symbols completed. VIST took 30.0s. Estimated remaining: 17m 35s. Rate: 7.8 symbols/min
[2025-10-24T21:46:13.972133] [INFO ] [MAIN      ] VLRS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:46:14.007722] [DEBUG] [LOCAL     ] VLRS: Loaded 39561 existing records from primary storage.
[2025-10-24T21:46:14.008015] [INFO ] [MAIN      ] VLRS: Loaded 39561 existing records.
[2025-10-24T21:46:14.192094] [WARN ] [MAIN      ] VLRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:46:14.200358] [INFO ] [MAIN      ] VLRS: Wiping existing primary data before full refresh.
[2025-10-24T21:46:14.200873] [INFO ] [LOCAL     ] VLRS: Starting deletion of primary data.
[2025-10-24T21:46:14.201358] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-02 (1.25 seconds).
[2025-10-24T21:46:14.207086] [DEBUG] [LOCAL     ] VLRS: Deleted primary data file.
[2025-10-24T21:46:14.207158] [INFO ] [MAIN      ] VLRS: Starting full primary refresh.
[2025-10-24T21:46:14.563139] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-03.
[2025-10-24T21:46:14.571796] [INFO ] [REMOTE    ] VLRS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:46:14.575245] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T21:46:15.347713] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-09.
[2025-10-24T21:46:15.649043] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-03 (1.09 seconds).
[2025-10-24T21:46:16.147692] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-01.
[2025-10-24T21:46:16.373600] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T21:46:16.947786] [INFO ] [REMOTE    ] VKQ: Fetching primary data for 2025-10.
[2025-10-24T21:46:17.624475] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T21:46:17.641367] [INFO ] [REMOTE    ] VKQ: Incremental fetch complete for 2025-10 (0.69 seconds).
[2025-10-24T21:46:17.644956] [INFO ] [REMOTE    ] VKQ: Full fetch complete (24508 records).
[2025-10-24T21:46:17.645034] [DEBUG] [VALIDATOR ] VKQ: Validating primary data.
[2025-10-24T21:46:17.752813] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-01.
[2025-10-24T21:46:18.034563] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present.
[2025-10-24T21:46:18.034667] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed.
[2025-10-24T21:46:18.035255] [INFO ] [MAIN      ] VKQ: Fetched primary data is valid.
[2025-10-24T21:46:18.035318] [DEBUG] [LOCAL     ] VKQ: Saving primary data.
[2025-10-24T21:46:18.035625] [FATAL] [LOCAL     ] VKQ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:46:18.035729] [FATAL] [MAIN      ] VKQ: Failed to save primary data.
[2025-10-24T21:46:18.035772] [WARN ] [MAIN      ] VKQ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:46:18.035807] [INFO ] [LOCAL     ] VKQ: Starting deletion of primary data.
[2025-10-24T21:46:18.035857] [DEBUG] [LOCAL     ] VKQ: No primary data file found to delete.
[2025-10-24T21:46:18.035892] [INFO ] [LOCAL     ] VKQ: Starting deletion of derivative data.
[2025-10-24T21:46:18.036071] [DEBUG] [LOCAL     ] VKQ: Deleted derivative data file.
[2025-10-24T21:46:18.036161] [INFO ] [MAIN      ] Update Progress: 2230/2366 symbols completed. VKQ took 21.5s. Estimated remaining: 17m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:46:18.206008] [INFO ] [MAIN      ] VLT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:46:18.213739] [DEBUG] [LOCAL     ] VLT: Loaded 4306 existing records from primary storage.
[2025-10-24T21:46:18.213982] [INFO ] [MAIN      ] VLT: Loaded 4306 existing records.
[2025-10-24T21:46:18.405554] [WARN ] [MAIN      ] VLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:46:18.405801] [INFO ] [MAIN      ] VLT: Wiping existing primary data before full refresh.
[2025-10-24T21:46:18.405852] [INFO ] [LOCAL     ] VLT: Starting deletion of primary data.
[2025-10-24T21:46:18.406027] [DEBUG] [LOCAL     ] VLT: Deleted primary data file.
[2025-10-24T21:46:18.406082] [INFO ] [MAIN      ] VLT: Starting full primary refresh.
[2025-10-24T21:46:18.555724] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-02.
[2025-10-24T21:46:18.770124] [INFO ] [REMOTE    ] VLT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:46:19.347709] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-01.
[2025-10-24T21:46:19.803780] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-01 (2.05 seconds).
[2025-10-24T21:46:20.100677] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-02 (1.54 seconds).
[2025-10-24T21:46:20.147632] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-03.
[2025-10-24T21:46:20.168110] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-01 (0.82 seconds).
[2025-10-24T21:46:20.947715] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-04.
[2025-10-24T21:46:21.747680] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-02.
[2025-10-24T21:46:21.854000] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T21:46:22.299368] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-04 (1.35 seconds).
[2025-10-24T21:46:22.356293] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T21:46:22.547711] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-02.
[2025-10-24T21:46:23.347700] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-04.
[2025-10-24T21:46:24.147707] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-03.
[2025-10-24T21:46:24.271680] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T21:46:24.862783] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T21:46:24.899382] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T21:46:24.947717] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-03.
[2025-10-24T21:46:25.747683] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-05.
[2025-10-24T21:46:26.547694] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-04.
[2025-10-24T21:46:26.966051] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T21:46:27.067537] [INFO ] [REMOTE    ] VLT: Incremental fetch complete for 2025-04 (0.52 seconds).
[2025-10-24T21:46:27.266930] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T21:46:27.347699] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-05.
[2025-10-24T21:46:28.147681] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-06.
[2025-10-24T21:46:28.401140] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T21:46:28.947695] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-04.
[2025-10-24T21:46:29.730946] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-06 (1.58 seconds).
[2025-10-24T21:46:29.747616] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-07.
[2025-10-24T21:46:30.547726] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-06.
[2025-10-24T21:46:30.996943] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-04 (2.05 seconds).
[2025-10-24T21:46:31.142172] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-07 (1.39 seconds).
[2025-10-24T21:46:31.347656] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-08.
[2025-10-24T21:46:31.621801] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T21:46:32.147711] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-05.
[2025-10-24T21:46:32.412111] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T21:46:32.947737] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-07.
[2025-10-24T21:46:33.747735] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-09.
[2025-10-24T21:46:33.986880] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-05 (1.84 seconds).
[2025-10-24T21:46:34.438412] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-07 (1.49 seconds).
[2025-10-24T21:46:34.547771] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-08.
[2025-10-24T21:46:35.153782] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T21:46:35.347803] [INFO ] [REMOTE    ] VLT: Fetching primary data for 2025-05.
[2025-10-24T21:46:35.454491] [DEBUG] [REMOTE    ] VLT: Error fetching primary data for 2025-05: 'API call returned an empty response.'
[2025-10-24T21:46:35.454934] [WARN ] [REMOTE    ] VLT: No data returned for month 2025-05
[2025-10-24T21:46:35.455065] [FATAL] [REMOTE    ] VLT: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:46:35.455194] [FATAL] [MAIN      ] VLT: Failed to fetch primary data.
[2025-10-24T21:46:35.455284] [WARN ] [MAIN      ] VLT: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:46:35.455355] [INFO ] [LOCAL     ] VLT: Starting deletion of primary data.
[2025-10-24T21:46:35.455439] [DEBUG] [LOCAL     ] VLT: No primary data file found to delete.
[2025-10-24T21:46:35.455499] [INFO ] [LOCAL     ] VLT: Starting deletion of derivative data.
[2025-10-24T21:46:35.455876] [DEBUG] [LOCAL     ] VLT: Deleted derivative data file.
[2025-10-24T21:46:35.455986] [INFO ] [MAIN      ] Update Progress: 2231/2366 symbols completed. VLT took 17.4s. Estimated remaining: 17m 20s. Rate: 7.8 symbols/min
[2025-10-24T21:46:35.699717] [INFO ] [MAIN      ] VLTO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:46:35.747503] [DEBUG] [LOCAL     ] VLTO: Loaded 46360 existing records from primary storage.
[2025-10-24T21:46:35.747972] [INFO ] [MAIN      ] VLTO: Loaded 46360 existing records.
[2025-10-24T21:46:35.961332] [WARN ] [MAIN      ] VLTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:46:35.961821] [INFO ] [MAIN      ] VLTO: Wiping existing primary data before full refresh.
[2025-10-24T21:46:35.961901] [INFO ] [LOCAL     ] VLTO: Starting deletion of primary data.
[2025-10-24T21:46:35.962466] [DEBUG] [LOCAL     ] VLTO: Deleted primary data file.
[2025-10-24T21:46:35.962530] [INFO ] [MAIN      ] VLTO: Starting full primary refresh.
[2025-10-24T21:46:36.148154] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-06.
[2025-10-24T21:46:36.222813] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T21:46:36.380220] [INFO ] [REMOTE    ] VLTO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:46:36.947706] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-09.
[2025-10-24T21:46:37.747750] [INFO ] [REMOTE    ] VLRS: Fetching primary data for 2025-10.
[2025-10-24T21:46:38.164637] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-06 (2.02 seconds).
[2025-10-24T21:46:38.360027] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-09 (1.41 seconds).
[2025-10-24T21:46:38.547689] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-01.
[2025-10-24T21:46:38.654592] [INFO ] [REMOTE    ] VLRS: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T21:46:38.661556] [INFO ] [REMOTE    ] VLRS: Full fetch complete (58351 records).
[2025-10-24T21:46:38.661699] [DEBUG] [VALIDATOR ] VLRS: Validating primary data.
[2025-10-24T21:46:39.050752] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present.
[2025-10-24T21:46:39.050834] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed.
[2025-10-24T21:46:39.051882] [INFO ] [MAIN      ] VLRS: Fetched primary data is valid.
[2025-10-24T21:46:39.051941] [DEBUG] [LOCAL     ] VLRS: Saving primary data.
[2025-10-24T21:46:39.052421] [FATAL] [LOCAL     ] VLRS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:46:39.052507] [FATAL] [MAIN      ] VLRS: Failed to save primary data.
[2025-10-24T21:46:39.052548] [WARN ] [MAIN      ] VLRS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:46:39.052590] [INFO ] [LOCAL     ] VLRS: Starting deletion of primary data.
[2025-10-24T21:46:39.052686] [DEBUG] [LOCAL     ] VLRS: No primary data file found to delete.
[2025-10-24T21:46:39.052741] [INFO ] [LOCAL     ] VLRS: Starting deletion of derivative data.
[2025-10-24T21:46:39.052917] [DEBUG] [LOCAL     ] VLRS: Deleted derivative data file.
[2025-10-24T21:46:39.053348] [INFO ] [MAIN      ] Update Progress: 2232/2366 symbols completed. VLRS took 25.2s. Estimated remaining: 17m 12s. Rate: 7.8 symbols/min
[2025-10-24T21:46:39.223357] [INFO ] [MAIN      ] VMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:46:39.262012] [DEBUG] [LOCAL     ] VMC: Loaded 42397 existing records from primary storage.
[2025-10-24T21:46:39.262290] [INFO ] [MAIN      ] VMC: Loaded 42397 existing records.
[2025-10-24T21:46:39.356164] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-07.
[2025-10-24T21:46:39.445466] [WARN ] [MAIN      ] VMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:46:39.445707] [INFO ] [MAIN      ] VMC: Wiping existing primary data before full refresh.
[2025-10-24T21:46:39.445762] [INFO ] [LOCAL     ] VMC: Starting deletion of primary data.
[2025-10-24T21:46:39.446162] [DEBUG] [LOCAL     ] VMC: Deleted primary data file.
[2025-10-24T21:46:39.446218] [INFO ] [MAIN      ] VMC: Starting full primary refresh.
[2025-10-24T21:46:39.806499] [INFO ] [REMOTE    ] VMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:46:40.135595] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T21:46:40.147596] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-02.
[2025-10-24T21:46:40.947699] [INFO ] [REMOTE    ] VLN: Fetching primary data for 2025-10.
[2025-10-24T21:46:41.316723] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-07 (1.96 seconds).
[2025-10-24T21:46:41.405003] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T21:46:41.747679] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-03.
[2025-10-24T21:46:42.331489] [INFO ] [REMOTE    ] VLN: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T21:46:42.338616] [INFO ] [REMOTE    ] VLN: Full fetch complete (43203 records).
[2025-10-24T21:46:42.338749] [DEBUG] [VALIDATOR ] VLN: Validating primary data.
[2025-10-24T21:46:42.552867] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-08.
[2025-10-24T21:46:42.710027] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present.
[2025-10-24T21:46:42.710102] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed.
[2025-10-24T21:46:42.711115] [INFO ] [MAIN      ] VLN: Fetched primary data is valid.
[2025-10-24T21:46:42.711175] [DEBUG] [LOCAL     ] VLN: Saving primary data.
[2025-10-24T21:46:42.711541] [FATAL] [LOCAL     ] VLN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:46:42.711623] [FATAL] [MAIN      ] VLN: Failed to save primary data.
[2025-10-24T21:46:42.711700] [WARN ] [MAIN      ] VLN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:46:42.711769] [INFO ] [LOCAL     ] VLN: Starting deletion of primary data.
[2025-10-24T21:46:42.711827] [DEBUG] [LOCAL     ] VLN: No primary data file found to delete.
[2025-10-24T21:46:42.711862] [INFO ] [LOCAL     ] VLN: Starting deletion of derivative data.
[2025-10-24T21:46:42.712027] [DEBUG] [LOCAL     ] VLN: Deleted derivative data file.
[2025-10-24T21:46:42.712099] [INFO ] [MAIN      ] Update Progress: 2233/2366 symbols completed. VLN took 38.6s. Estimated remaining: 17m 4s. Rate: 7.8 symbols/min
[2025-10-24T21:46:42.876923] [INFO ] [MAIN      ] VMI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:46:42.877099] [DEBUG] [LOCAL     ] VMI: No existing data file found in primary storage.
[2025-10-24T21:46:42.877134] [WARN ] [MAIN      ] VMI: No existing data found, performing full refresh instead.
[2025-10-24T21:46:42.877238] [INFO ] [MAIN      ] VMI: Wiping existing primary data before full refresh.
[2025-10-24T21:46:42.877279] [INFO ] [LOCAL     ] VMI: Starting deletion of primary data.
[2025-10-24T21:46:42.877319] [DEBUG] [LOCAL     ] VMI: No primary data file found to delete.
[2025-10-24T21:46:42.877351] [INFO ] [MAIN      ] VMI: Starting full primary refresh.
[2025-10-24T21:46:43.232583] [INFO ] [REMOTE    ] VMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:46:43.347621] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-01.
[2025-10-24T21:46:43.443521] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T21:46:44.147677] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-01.
[2025-10-24T21:46:44.236678] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-01 (0.89 seconds).
[2025-10-24T21:46:44.490002] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T21:46:44.947716] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-09.
[2025-10-24T21:46:45.673488] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T21:46:45.747673] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-02.
[2025-10-24T21:46:46.547671] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-04.
[2025-10-24T21:46:46.701517] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T21:46:47.272220] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T21:46:47.347671] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-02.
[2025-10-24T21:46:48.147707] [INFO ] [REMOTE    ] VLO: Fetching primary data for 2025-10.
[2025-10-24T21:46:48.258829] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-02 (0.91 seconds).
[2025-10-24T21:46:48.387020] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T21:46:48.894818] [INFO ] [REMOTE    ] VLO: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T21:46:48.906279] [INFO ] [REMOTE    ] VLO: Full fetch complete (76910 records).
[2025-10-24T21:46:48.906515] [DEBUG] [VALIDATOR ] VLO: Validating primary data.
[2025-10-24T21:46:48.952961] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-03.
[2025-10-24T21:46:49.330117] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present.
[2025-10-24T21:46:49.330242] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed.
[2025-10-24T21:46:49.332262] [INFO ] [MAIN      ] VLO: Fetched primary data is valid.
[2025-10-24T21:46:49.332361] [DEBUG] [LOCAL     ] VLO: Saving primary data.
[2025-10-24T21:46:49.333420] [FATAL] [LOCAL     ] VLO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:46:49.333527] [FATAL] [MAIN      ] VLO: Failed to save primary data.
[2025-10-24T21:46:49.333570] [WARN ] [MAIN      ] VLO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:46:49.333608] [INFO ] [LOCAL     ] VLO: Starting deletion of primary data.
[2025-10-24T21:46:49.333699] [DEBUG] [LOCAL     ] VLO: No primary data file found to delete.
[2025-10-24T21:46:49.333759] [INFO ] [LOCAL     ] VLO: Starting deletion of derivative data.
[2025-10-24T21:46:49.333966] [DEBUG] [LOCAL     ] VLO: Deleted derivative data file.
[2025-10-24T21:46:49.334458] [INFO ] [MAIN      ] Update Progress: 2234/2366 symbols completed. VLO took 36.8s. Estimated remaining: 16m 57s. Rate: 7.8 symbols/min
[2025-10-24T21:46:49.520348] [INFO ] [MAIN      ] VMO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:46:49.545593] [DEBUG] [LOCAL     ] VMO: Loaded 20786 existing records from primary storage.
[2025-10-24T21:46:49.545964] [INFO ] [MAIN      ] VMO: Loaded 20786 existing records.
[2025-10-24T21:46:49.738863] [WARN ] [MAIN      ] VMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:46:49.739186] [INFO ] [MAIN      ] VMO: Wiping existing primary data before full refresh.
[2025-10-24T21:46:49.739241] [INFO ] [LOCAL     ] VMO: Starting deletion of primary data.
[2025-10-24T21:46:49.739547] [DEBUG] [LOCAL     ] VMO: Deleted primary data file.
[2025-10-24T21:46:49.739611] [INFO ] [MAIN      ] VMO: Starting full primary refresh.
[2025-10-24T21:46:49.753916] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-05.
[2025-10-24T21:46:50.124166] [INFO ] [REMOTE    ] VMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:46:50.547741] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-03.
[2025-10-24T21:46:50.780601] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-03 (1.83 seconds).
[2025-10-24T21:46:51.347668] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-04.
[2025-10-24T21:46:51.500386] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T21:46:51.665026] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-03 (1.12 seconds).
[2025-10-24T21:46:52.147731] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-04.
[2025-10-24T21:46:52.947704] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-01.
[2025-10-24T21:46:53.102310] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T21:46:53.258863] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-04 (1.11 seconds).
[2025-10-24T21:46:53.736548] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-01 (0.79 seconds).
[2025-10-24T21:46:53.747613] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-02.
[2025-10-24T21:46:54.547685] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-06.
[2025-10-24T21:46:54.876237] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T21:46:55.347708] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-05.
[2025-10-24T21:46:56.009424] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T21:46:56.147719] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-07.
[2025-10-24T21:46:56.648213] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-05 (1.30 seconds).
[2025-10-24T21:46:56.947697] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-03.
[2025-10-24T21:46:57.747718] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-05.
[2025-10-24T21:46:57.815707] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T21:46:58.120216] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T21:46:58.547671] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-08.
[2025-10-24T21:46:58.605180] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T21:46:59.347702] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-04.
[2025-10-24T21:47:00.124916] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T21:47:00.147633] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-09.
[2025-10-24T21:47:00.441746] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T21:47:00.893795] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:47:00.947622] [INFO ] [REMOTE    ] VLTO: Fetching primary data for 2025-10.
[2025-10-24T21:47:01.747728] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-05.
[2025-10-24T21:47:02.546390] [INFO ] [REMOTE    ] VLTO: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T21:47:02.554352] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-06.
[2025-10-24T21:47:02.556050] [INFO ] [REMOTE    ] VLTO: Full fetch complete (67334 records).
[2025-10-24T21:47:02.556131] [DEBUG] [VALIDATOR ] VLTO: Validating primary data.
[2025-10-24T21:47:02.869840] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T21:47:02.986926] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present.
[2025-10-24T21:47:02.987057] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed.
[2025-10-24T21:47:02.988713] [INFO ] [MAIN      ] VLTO: Fetched primary data is valid.
[2025-10-24T21:47:02.988788] [DEBUG] [LOCAL     ] VLTO: Saving primary data.
[2025-10-24T21:47:02.989510] [FATAL] [LOCAL     ] VLTO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:47:02.989630] [FATAL] [MAIN      ] VLTO: Failed to save primary data.
[2025-10-24T21:47:02.989739] [WARN ] [MAIN      ] VLTO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:47:02.989817] [INFO ] [LOCAL     ] VLTO: Starting deletion of primary data.
[2025-10-24T21:47:02.989883] [DEBUG] [LOCAL     ] VLTO: No primary data file found to delete.
[2025-10-24T21:47:02.989920] [INFO ] [LOCAL     ] VLTO: Starting deletion of derivative data.
[2025-10-24T21:47:02.990173] [DEBUG] [LOCAL     ] VLTO: Deleted derivative data file.
[2025-10-24T21:47:02.990874] [INFO ] [MAIN      ] Update Progress: 2235/2366 symbols completed. VLTO took 27.5s. Estimated remaining: 16m 49s. Rate: 7.8 symbols/min
[2025-10-24T21:47:03.178278] [INFO ] [MAIN      ] VNO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:47:03.223738] [DEBUG] [LOCAL     ] VNO: Loaded 49140 existing records from primary storage.
[2025-10-24T21:47:03.224045] [INFO ] [MAIN      ] VNO: Loaded 49140 existing records.
[2025-10-24T21:47:03.352902] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-06.
[2025-10-24T21:47:03.421288] [WARN ] [MAIN      ] VNO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:47:03.421521] [INFO ] [MAIN      ] VNO: Wiping existing primary data before full refresh.
[2025-10-24T21:47:03.421572] [INFO ] [LOCAL     ] VNO: Starting deletion of primary data.
[2025-10-24T21:47:03.422067] [DEBUG] [LOCAL     ] VNO: Deleted primary data file.
[2025-10-24T21:47:03.422127] [INFO ] [MAIN      ] VNO: Starting full primary refresh.
[2025-10-24T21:47:03.786523] [INFO ] [REMOTE    ] VNO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:47:04.147747] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-01.
[2025-10-24T21:47:04.189985] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T21:47:04.241301] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-06 (0.89 seconds).
[2025-10-24T21:47:04.947723] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-07.
[2025-10-24T21:47:05.651233] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-01 (1.50 seconds).
[2025-10-24T21:47:05.703589] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-07 (0.76 seconds).
[2025-10-24T21:47:05.747632] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-02.
[2025-10-24T21:47:06.547725] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-08.
[2025-10-24T21:47:07.230639] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-02 (1.48 seconds).
[2025-10-24T21:47:07.347685] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-03.
[2025-10-24T21:47:07.539738] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-08 (0.99 seconds).
[2025-10-24T21:47:08.147709] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-06.
[2025-10-24T21:47:08.821035] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-03 (1.47 seconds).
[2025-10-24T21:47:08.947633] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-04.
[2025-10-24T21:47:09.235514] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T21:47:09.747718] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-09.
[2025-10-24T21:47:10.547702] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-07.
[2025-10-24T21:47:10.641363] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-04 (1.69 seconds).
[2025-10-24T21:47:10.813573] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T21:47:11.347717] [INFO ] [REMOTE    ] VMI: Fetching primary data for 2025-10.
[2025-10-24T21:47:11.835694] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T21:47:12.147736] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-07.
[2025-10-24T21:47:12.245038] [INFO ] [REMOTE    ] VMI: Incremental fetch complete for 2025-10 (0.90 seconds).
[2025-10-24T21:47:12.248547] [INFO ] [REMOTE    ] VMI: Full fetch complete (21395 records).
[2025-10-24T21:47:12.248635] [DEBUG] [VALIDATOR ] VMI: Validating primary data.
[2025-10-24T21:47:12.627909] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present.
[2025-10-24T21:47:12.627986] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed.
[2025-10-24T21:47:12.628508] [INFO ] [MAIN      ] VMI: Fetched primary data is valid.
[2025-10-24T21:47:12.628549] [DEBUG] [LOCAL     ] VMI: Saving primary data.
[2025-10-24T21:47:12.628840] [FATAL] [LOCAL     ] VMI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:47:12.628922] [FATAL] [MAIN      ] VMI: Failed to save primary data.
[2025-10-24T21:47:12.628963] [WARN ] [MAIN      ] VMI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:47:12.628998] [INFO ] [LOCAL     ] VMI: Starting deletion of primary data.
[2025-10-24T21:47:12.629046] [DEBUG] [LOCAL     ] VMI: No primary data file found to delete.
[2025-10-24T21:47:12.629080] [INFO ] [LOCAL     ] VMI: Starting deletion of derivative data.
[2025-10-24T21:47:12.629117] [DEBUG] [LOCAL     ] VMI: No derivative data file found to delete.
[2025-10-24T21:47:12.629171] [INFO ] [MAIN      ] Update Progress: 2236/2366 symbols completed. VMI took 29.9s. Estimated remaining: 16m 42s. Rate: 7.8 symbols/min
[2025-10-24T21:47:12.793058] [INFO ] [MAIN      ] VNT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:47:12.833972] [DEBUG] [LOCAL     ] VNT: Loaded 44209 existing records from primary storage.
[2025-10-24T21:47:12.834257] [INFO ] [MAIN      ] VNT: Loaded 44209 existing records.
[2025-10-24T21:47:12.952840] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-08.
[2025-10-24T21:47:13.015268] [WARN ] [MAIN      ] VNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:47:13.015848] [INFO ] [MAIN      ] VNT: Wiping existing primary data before full refresh.
[2025-10-24T21:47:13.015913] [INFO ] [LOCAL     ] VNT: Starting deletion of primary data.
[2025-10-24T21:47:13.016258] [DEBUG] [LOCAL     ] VNT: Deleted primary data file.
[2025-10-24T21:47:13.016303] [INFO ] [MAIN      ] VNT: Starting full primary refresh.
[2025-10-24T21:47:13.381117] [INFO ] [REMOTE    ] VNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:47:13.381637] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-07 (1.23 seconds).
[2025-10-24T21:47:13.747687] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-05.
[2025-10-24T21:47:14.478326] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T21:47:14.547737] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-01.
[2025-10-24T21:47:15.254150] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-05 (1.51 seconds).
[2025-10-24T21:47:15.347635] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-06.
[2025-10-24T21:47:16.106760] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-01 (1.56 seconds).
[2025-10-24T21:47:16.147619] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-02.
[2025-10-24T21:47:16.947698] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-08.
[2025-10-24T21:47:17.017201] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T21:47:17.118600] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-02 (0.97 seconds).
[2025-10-24T21:47:17.747710] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-09.
[2025-10-24T21:47:17.943440] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T21:47:18.547684] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-03.
[2025-10-24T21:47:19.173584] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-09 (1.43 seconds).
[2025-10-24T21:47:19.347695] [INFO ] [REMOTE    ] VMC: Fetching primary data for 2025-10.
[2025-10-24T21:47:19.645983] [INFO ] [REMOTE    ] VMC: Incremental fetch complete for 2025-10 (0.30 seconds).
[2025-10-24T21:47:19.653325] [INFO ] [REMOTE    ] VMC: Full fetch complete (62281 records).
[2025-10-24T21:47:19.653434] [DEBUG] [VALIDATOR ] VMC: Validating primary data.
[2025-10-24T21:47:20.043956] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present.
[2025-10-24T21:47:20.044074] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed.
[2025-10-24T21:47:20.045239] [INFO ] [MAIN      ] VMC: Fetched primary data is valid.
[2025-10-24T21:47:20.045300] [DEBUG] [LOCAL     ] VMC: Saving primary data.
[2025-10-24T21:47:20.045819] [FATAL] [LOCAL     ] VMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:47:20.045913] [FATAL] [MAIN      ] VMC: Failed to save primary data.
[2025-10-24T21:47:20.045968] [WARN ] [MAIN      ] VMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:47:20.046050] [INFO ] [LOCAL     ] VMC: Starting deletion of primary data.
[2025-10-24T21:47:20.046113] [DEBUG] [LOCAL     ] VMC: No primary data file found to delete.
[2025-10-24T21:47:20.046150] [INFO ] [LOCAL     ] VMC: Starting deletion of derivative data.
[2025-10-24T21:47:20.046306] [DEBUG] [LOCAL     ] VMC: Deleted derivative data file.
[2025-10-24T21:47:20.046619] [INFO ] [MAIN      ] Update Progress: 2237/2366 symbols completed. VMC took 41.0s. Estimated remaining: 16m 34s. Rate: 7.8 symbols/min
[2025-10-24T21:47:20.147635] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-07.
[2025-10-24T21:47:20.178223] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T21:47:20.947676] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-04.
[2025-10-24T21:47:21.747701] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-09.
[2025-10-24T21:47:21.827789] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T21:47:22.475380] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T21:47:22.528389] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-09 (0.78 seconds).
[2025-10-24T21:47:22.547683] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-05.
[2025-10-24T21:47:23.347726] [INFO ] [REMOTE    ] VMO: Fetching primary data for 2025-10.
[2025-10-24T21:47:24.024997] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T21:47:24.147641] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-06.
[2025-10-24T21:47:24.395055] [INFO ] [REMOTE    ] VMO: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T21:47:24.399993] [INFO ] [REMOTE    ] VMO: Full fetch complete (30721 records).
[2025-10-24T21:47:24.400176] [DEBUG] [VALIDATOR ] VMO: Validating primary data.
[2025-10-24T21:47:24.793423] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present.
[2025-10-24T21:47:24.793530] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed.
[2025-10-24T21:47:24.794837] [INFO ] [MAIN      ] VMO: Fetched primary data is valid.
[2025-10-24T21:47:24.794903] [DEBUG] [LOCAL     ] VMO: Saving primary data.
[2025-10-24T21:47:24.795364] [FATAL] [LOCAL     ] VMO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:47:24.795457] [FATAL] [MAIN      ] VMO: Failed to save primary data.
[2025-10-24T21:47:24.795500] [WARN ] [MAIN      ] VMO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:47:24.795536] [INFO ] [LOCAL     ] VMO: Starting deletion of primary data.
[2025-10-24T21:47:24.795593] [DEBUG] [LOCAL     ] VMO: No primary data file found to delete.
[2025-10-24T21:47:24.795631] [INFO ] [LOCAL     ] VMO: Starting deletion of derivative data.
[2025-10-24T21:47:24.795911] [DEBUG] [LOCAL     ] VMO: Deleted derivative data file.
[2025-10-24T21:47:24.796030] [INFO ] [MAIN      ] Update Progress: 2238/2366 symbols completed. VMO took 35.5s. Estimated remaining: 16m 26s. Rate: 7.8 symbols/min
[2025-10-24T21:47:24.947720] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-08.
[2025-10-24T21:47:25.632014] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T21:47:25.747676] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-07.
[2025-10-24T21:47:26.150345] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-08 (1.20 seconds).
[2025-10-24T21:47:26.547714] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-09.
[2025-10-24T21:47:27.367129] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T21:47:27.377242] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-08.
[2025-10-24T21:47:28.143168] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T21:47:28.154050] [INFO ] [REMOTE    ] VNO: Fetching primary data for 2025-10.
[2025-10-24T21:47:28.909597] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T21:47:28.947785] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-09.
[2025-10-24T21:47:29.862476] [INFO ] [REMOTE    ] VNO: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T21:47:29.871721] [INFO ] [REMOTE    ] VNO: Full fetch complete (70426 records).
[2025-10-24T21:47:29.871850] [DEBUG] [VALIDATOR ] VNO: Validating primary data.
[2025-10-24T21:47:30.283240] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present.
[2025-10-24T21:47:30.283357] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed.
[2025-10-24T21:47:30.284499] [INFO ] [MAIN      ] VNO: Fetched primary data is valid.
[2025-10-24T21:47:30.284662] [DEBUG] [LOCAL     ] VNO: Saving primary data.
[2025-10-24T21:47:30.285342] [FATAL] [LOCAL     ] VNO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:47:30.285430] [FATAL] [MAIN      ] VNO: Failed to save primary data.
[2025-10-24T21:47:30.285472] [WARN ] [MAIN      ] VNO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:47:30.285508] [INFO ] [LOCAL     ] VNO: Starting deletion of primary data.
[2025-10-24T21:47:30.285560] [DEBUG] [LOCAL     ] VNO: No primary data file found to delete.
[2025-10-24T21:47:30.285597] [INFO ] [LOCAL     ] VNO: Starting deletion of derivative data.
[2025-10-24T21:47:30.285820] [DEBUG] [LOCAL     ] VNO: Deleted derivative data file.
[2025-10-24T21:47:30.286524] [INFO ] [MAIN      ] Update Progress: 2239/2366 symbols completed. VNO took 27.3s. Estimated remaining: 16m 18s. Rate: 7.8 symbols/min
[2025-10-24T21:47:30.313838] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T21:47:30.322760] [INFO ] [REMOTE    ] VNT: Fetching primary data for 2025-10.
[2025-10-24T21:47:31.718397] [INFO ] [REMOTE    ] VNT: Incremental fetch complete for 2025-10 (1.40 seconds).
[2025-10-24T21:47:31.729981] [INFO ] [REMOTE    ] VNT: Full fetch complete (64280 records).
[2025-10-24T21:47:31.730129] [DEBUG] [VALIDATOR ] VNT: Validating primary data.
[2025-10-24T21:47:32.113520] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present.
[2025-10-24T21:47:32.113588] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed.
[2025-10-24T21:47:32.114675] [INFO ] [MAIN      ] VNT: Fetched primary data is valid.
[2025-10-24T21:47:32.114735] [DEBUG] [LOCAL     ] VNT: Saving primary data.
[2025-10-24T21:47:32.115233] [FATAL] [LOCAL     ] VNT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:47:32.115316] [FATAL] [MAIN      ] VNT: Failed to save primary data.
[2025-10-24T21:47:32.115358] [WARN ] [MAIN      ] VNT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:47:32.115424] [INFO ] [LOCAL     ] VNT: Starting deletion of primary data.
[2025-10-24T21:47:32.115482] [DEBUG] [LOCAL     ] VNT: No primary data file found to delete.
[2025-10-24T21:47:32.115518] [INFO ] [LOCAL     ] VNT: Starting deletion of derivative data.
[2025-10-24T21:47:32.115789] [DEBUG] [LOCAL     ] VNT: Deleted derivative data file.
[2025-10-24T21:47:32.116203] [INFO ] [MAIN      ] Update Progress: 2240/2366 symbols completed. VNT took 19.5s. Estimated remaining: 16m 10s. Rate: 7.8 symbols/min
[2025-10-24T21:47:32.718834] [INFO ] [MAIN      ] VPG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:47:32.759966] [INFO ] [MAIN      ] VOYA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:47:32.760966] [INFO ] [MAIN      ] VOC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:47:32.814183] [INFO ] [MAIN      ] VOYG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:47:32.814609] [DEBUG] [LOCAL     ] VOYG: No existing data file found in primary storage.
[2025-10-24T21:47:32.814683] [WARN ] [MAIN      ] VOYG: No existing data found, performing full refresh instead.
[2025-10-24T21:47:32.814788] [INFO ] [MAIN      ] VOYG: Wiping existing primary data before full refresh.
[2025-10-24T21:47:32.814826] [INFO ] [LOCAL     ] VOYG: Starting deletion of primary data.
[2025-10-24T21:47:32.814867] [DEBUG] [LOCAL     ] VOYG: No primary data file found to delete.
[2025-10-24T21:47:32.814900] [INFO ] [MAIN      ] VOYG: Starting full primary refresh.
[2025-10-24T21:47:32.902892] [DEBUG] [LOCAL     ] VOC: Loaded 9134 existing records from primary storage.
[2025-10-24T21:47:32.913987] [INFO ] [MAIN      ] VOC: Loaded 9134 existing records.
[2025-10-24T21:47:32.914540] [DEBUG] [LOCAL     ] VPG: Loaded 16985 existing records from primary storage.
[2025-10-24T21:47:32.958488] [INFO ] [MAIN      ] VPG: Loaded 16985 existing records.
[2025-10-24T21:47:33.305319] [DEBUG] [LOCAL     ] VOYA: Loaded 42078 existing records from primary storage.
[2025-10-24T21:47:33.341676] [INFO ] [MAIN      ] VOYA: Loaded 42078 existing records.
[2025-10-24T21:47:33.635745] [WARN ] [MAIN      ] VOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:47:33.734087] [INFO ] [REMOTE    ] VOYG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:47:33.650280] [WARN ] [MAIN      ] VPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:47:33.734360] [INFO ] [MAIN      ] VOC: Wiping existing primary data before full refresh.
[2025-10-24T21:47:33.734669] [INFO ] [LOCAL     ] VOC: Starting deletion of primary data.
[2025-10-24T21:47:33.745692] [INFO ] [MAIN      ] VPG: Wiping existing primary data before full refresh.
[2025-10-24T21:47:33.745791] [DEBUG] [LOCAL     ] VOC: Deleted primary data file.
[2025-10-24T21:47:33.740323] [INFO ] [REMOTE    ] VOYG: Fetching primary data for 2025-01.
[2025-10-24T21:47:33.751092] [INFO ] [LOCAL     ] VPG: Starting deletion of primary data.
[2025-10-24T21:47:33.756557] [INFO ] [MAIN      ] VOC: Starting full primary refresh.
[2025-10-24T21:47:33.774042] [DEBUG] [LOCAL     ] VPG: Deleted primary data file.
[2025-10-24T21:47:33.774243] [INFO ] [MAIN      ] VPG: Starting full primary refresh.
[2025-10-24T21:47:33.953826] [WARN ] [MAIN      ] VOYA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:47:34.002615] [INFO ] [MAIN      ] VOYA: Wiping existing primary data before full refresh.
[2025-10-24T21:47:34.029374] [INFO ] [LOCAL     ] VOYA: Starting deletion of primary data.
[2025-10-24T21:47:34.080905] [DEBUG] [REMOTE    ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:47:34.114466] [DEBUG] [LOCAL     ] VOYA: Deleted primary data file.
[2025-10-24T21:47:34.189027] [WARN ] [REMOTE    ] VOYG: No data returned for month 2025-01
[2025-10-24T21:47:34.225134] [INFO ] [MAIN      ] VOYA: Starting full primary refresh.
[2025-10-24T21:47:34.278468] [FATAL] [REMOTE    ] VOYG: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:47:34.364025] [FATAL] [MAIN      ] VOYG: Failed to fetch primary data.
[2025-10-24T21:47:34.434556] [WARN ] [MAIN      ] VOYG: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:47:34.545784] [INFO ] [LOCAL     ] VOYG: Starting deletion of primary data.
[2025-10-24T21:47:34.660625] [DEBUG] [LOCAL     ] VOYG: No primary data file found to delete.
[2025-10-24T21:47:34.655342] [INFO ] [REMOTE    ] VPG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:47:34.660926] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-01.
[2025-10-24T21:47:34.676258] [INFO ] [LOCAL     ] VOYG: Starting deletion of derivative data.
[2025-10-24T21:47:34.737268] [DEBUG] [LOCAL     ] VOYG: No derivative data file found to delete.
[2025-10-24T21:47:34.794201] [INFO ] [MAIN      ] Update Progress: 2241/2366 symbols completed. VOYG took 2.7s. Estimated remaining: 16m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:47:34.802706] [INFO ] [REMOTE    ] VOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:47:34.887974] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-01.
[2025-10-24T21:47:35.119971] [INFO ] [REMOTE    ] VOYA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:47:35.126866] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-01.
[2025-10-24T21:47:35.128638] [INFO ] [MAIN      ] VPV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:47:35.136320] [DEBUG] [LOCAL     ] VPV: Loaded 5234 existing records from primary storage.
[2025-10-24T21:47:35.136526] [INFO ] [MAIN      ] VPV: Loaded 5234 existing records.
[2025-10-24T21:47:35.310187] [WARN ] [MAIN      ] VPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:47:35.310405] [INFO ] [MAIN      ] VPV: Wiping existing primary data before full refresh.
[2025-10-24T21:47:35.310452] [INFO ] [LOCAL     ] VPV: Starting deletion of primary data.
[2025-10-24T21:47:35.310612] [DEBUG] [LOCAL     ] VPV: Deleted primary data file.
[2025-10-24T21:47:35.310701] [INFO ] [MAIN      ] VPV: Starting full primary refresh.
[2025-10-24T21:47:35.594262] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T21:47:35.612766] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-02.
[2025-10-24T21:47:35.675975] [INFO ] [REMOTE    ] VPV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:47:35.676454] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-01.
[2025-10-24T21:47:35.729076] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T21:47:35.731777] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-02.
[2025-10-24T21:47:36.101057] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-01 (0.42 seconds).
[2025-10-24T21:47:36.147596] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-02.
[2025-10-24T21:47:36.470358] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T21:47:36.539600] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-02 (0.81 seconds).
[2025-10-24T21:47:36.754418] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T21:47:36.915429] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T21:47:36.947696] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-03.
[2025-10-24T21:47:37.626026] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-03 (0.68 seconds).
[2025-10-24T21:47:37.747633] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-04.
[2025-10-24T21:47:38.489255] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-04 (0.74 seconds).
[2025-10-24T21:47:38.547686] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-05.
[2025-10-24T21:47:39.132359] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T21:47:39.347719] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-03.
[2025-10-24T21:47:40.109012] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-03 (0.76 seconds).
[2025-10-24T21:47:40.147624] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-04.
[2025-10-24T21:47:40.947694] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-03.
[2025-10-24T21:47:40.999862] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-04 (0.85 seconds).
[2025-10-24T21:47:41.747637] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-05.
[2025-10-24T21:47:41.836360] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-03 (0.89 seconds).
[2025-10-24T21:47:42.522584] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T21:47:42.547629] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-06.
[2025-10-24T21:47:43.330780] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T21:47:43.347637] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-02.
[2025-10-24T21:47:44.147703] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-06.
[2025-10-24T21:47:44.779748] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T21:47:44.848431] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T21:47:44.947743] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-07.
[2025-10-24T21:47:45.515724] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-07 (0.57 seconds).
[2025-10-24T21:47:45.747734] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-07.
[2025-10-24T21:47:46.547679] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-04.
[2025-10-24T21:47:46.601330] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-07 (0.85 seconds).
[2025-10-24T21:47:47.347631] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-08.
[2025-10-24T21:47:47.722018] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-04 (1.17 seconds).
[2025-10-24T21:47:48.010283] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-08 (0.66 seconds).
[2025-10-24T21:47:48.147676] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-09.
[2025-10-24T21:47:48.793926] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-09 (0.65 seconds).
[2025-10-24T21:47:48.947720] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-05.
[2025-10-24T21:47:49.747766] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-08.
[2025-10-24T21:47:49.996758] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T21:47:50.547698] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-03.
[2025-10-24T21:47:50.560888] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-08 (0.81 seconds).
[2025-10-24T21:47:51.347712] [INFO ] [REMOTE    ] VPV: Fetching primary data for 2025-10.
[2025-10-24T21:47:52.011706] [INFO ] [REMOTE    ] VPV: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T21:47:52.013116] [INFO ] [REMOTE    ] VPV: Full fetch complete (8805 records).
[2025-10-24T21:47:52.013183] [DEBUG] [VALIDATOR ] VPV: Validating primary data.
[2025-10-24T21:47:52.154865] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-06.
[2025-10-24T21:47:52.326013] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T21:47:52.412244] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present.
[2025-10-24T21:47:52.412323] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed.
[2025-10-24T21:47:52.412537] [INFO ] [MAIN      ] VPV: Fetched primary data is valid.
[2025-10-24T21:47:52.412576] [DEBUG] [LOCAL     ] VPV: Saving primary data.
[2025-10-24T21:47:52.412810] [FATAL] [LOCAL     ] VPV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:47:52.412896] [FATAL] [MAIN      ] VPV: Failed to save primary data.
[2025-10-24T21:47:52.412937] [WARN ] [MAIN      ] VPV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:47:52.413039] [INFO ] [LOCAL     ] VPV: Starting deletion of primary data.
[2025-10-24T21:47:52.413108] [DEBUG] [LOCAL     ] VPV: No primary data file found to delete.
[2025-10-24T21:47:52.413144] [INFO ] [LOCAL     ] VPV: Starting deletion of derivative data.
[2025-10-24T21:47:52.413325] [DEBUG] [LOCAL     ] VPV: Deleted derivative data file.
[2025-10-24T21:47:52.413414] [INFO ] [MAIN      ] Update Progress: 2242/2366 symbols completed. VPV took 17.6s. Estimated remaining: 15m 55s. Rate: 7.8 symbols/min
[2025-10-24T21:47:52.576343] [INFO ] [MAIN      ] VRE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:47:52.611272] [DEBUG] [LOCAL     ] VRE: Loaded 35499 existing records from primary storage.
[2025-10-24T21:47:52.611534] [INFO ] [MAIN      ] VRE: Loaded 35499 existing records.
[2025-10-24T21:47:52.785627] [WARN ] [MAIN      ] VRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:47:52.785909] [INFO ] [MAIN      ] VRE: Wiping existing primary data before full refresh.
[2025-10-24T21:47:52.785956] [INFO ] [LOCAL     ] VRE: Starting deletion of primary data.
[2025-10-24T21:47:52.786716] [DEBUG] [LOCAL     ] VRE: Deleted primary data file.
[2025-10-24T21:47:52.786772] [INFO ] [MAIN      ] VRE: Starting full primary refresh.
[2025-10-24T21:47:52.952761] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-04.
[2025-10-24T21:47:53.173198] [INFO ] [REMOTE    ] VRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:47:53.295616] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-06 (1.14 seconds).
[2025-10-24T21:47:53.747719] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-01.
[2025-10-24T21:47:54.547717] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-09.
[2025-10-24T21:47:54.593560] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-04 (1.64 seconds).
[2025-10-24T21:47:54.894031] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-01 (1.15 seconds).
[2025-10-24T21:47:55.300594] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:47:55.347618] [INFO ] [REMOTE    ] VOC: Fetching primary data for 2025-10.
[2025-10-24T21:47:56.081260] [INFO ] [REMOTE    ] VOC: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:47:56.083455] [INFO ] [REMOTE    ] VOC: Full fetch complete (13332 records).
[2025-10-24T21:47:56.083529] [DEBUG] [VALIDATOR ] VOC: Validating primary data.
[2025-10-24T21:47:56.157866] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-05.
[2025-10-24T21:47:56.490630] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present.
[2025-10-24T21:47:56.490738] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed.
[2025-10-24T21:47:56.491141] [INFO ] [MAIN      ] VOC: Fetched primary data is valid.
[2025-10-24T21:47:56.491179] [DEBUG] [LOCAL     ] VOC: Saving primary data.
[2025-10-24T21:47:56.491455] [FATAL] [LOCAL     ] VOC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:47:56.491512] [FATAL] [MAIN      ] VOC: Failed to save primary data.
[2025-10-24T21:47:56.491549] [WARN ] [MAIN      ] VOC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:47:56.491582] [INFO ] [LOCAL     ] VOC: Starting deletion of primary data.
[2025-10-24T21:47:56.491630] [DEBUG] [LOCAL     ] VOC: No primary data file found to delete.
[2025-10-24T21:47:56.491701] [INFO ] [LOCAL     ] VOC: Starting deletion of derivative data.
[2025-10-24T21:47:56.491910] [DEBUG] [LOCAL     ] VOC: Deleted derivative data file.
[2025-10-24T21:47:56.492000] [INFO ] [MAIN      ] Update Progress: 2243/2366 symbols completed. VOC took 24.4s. Estimated remaining: 15m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:47:56.655305] [INFO ] [MAIN      ] VRT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:47:56.707963] [DEBUG] [LOCAL     ] VRT: Loaded 54143 existing records from primary storage.
[2025-10-24T21:47:56.708309] [INFO ] [MAIN      ] VRT: Loaded 54143 existing records.
[2025-10-24T21:47:56.880546] [WARN ] [MAIN      ] VRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:47:56.880781] [INFO ] [MAIN      ] VRT: Wiping existing primary data before full refresh.
[2025-10-24T21:47:56.880829] [INFO ] [LOCAL     ] VRT: Starting deletion of primary data.
[2025-10-24T21:47:56.881342] [DEBUG] [LOCAL     ] VRT: Deleted primary data file.
[2025-10-24T21:47:56.881397] [INFO ] [MAIN      ] VRT: Starting full primary refresh.
[2025-10-24T21:47:56.953756] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-02.
[2025-10-24T21:47:57.231672] [INFO ] [REMOTE    ] VRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:47:57.657520] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T21:47:57.747664] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-06.
[2025-10-24T21:47:58.070686] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T21:47:58.547727] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-01.
[2025-10-24T21:47:59.128560] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-06 (1.38 seconds).
[2025-10-24T21:47:59.347728] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-07.
[2025-10-24T21:48:00.147712] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-07.
[2025-10-24T21:48:00.862157] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T21:48:00.947672] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-08.
[2025-10-24T21:48:01.020198] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-01 (2.47 seconds).
[2025-10-24T21:48:01.202689] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-07 (1.05 seconds).
[2025-10-24T21:48:01.747732] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-02.
[2025-10-24T21:48:02.402037] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T21:48:02.547746] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-09.
[2025-10-24T21:48:03.347731] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-03.
[2025-10-24T21:48:03.976311] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-02 (2.23 seconds).
[2025-10-24T21:48:04.014981] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T21:48:04.152795] [INFO ] [REMOTE    ] VOYA: Fetching primary data for 2025-10.
[2025-10-24T21:48:04.163328] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-03 (0.82 seconds).
[2025-10-24T21:48:04.947730] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-08.
[2025-10-24T21:48:05.531258] [INFO ] [REMOTE    ] VOYA: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T21:48:05.540384] [INFO ] [REMOTE    ] VOYA: Full fetch complete (61459 records).
[2025-10-24T21:48:05.540614] [DEBUG] [VALIDATOR ] VOYA: Validating primary data.
[2025-10-24T21:48:05.752830] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-04.
[2025-10-24T21:48:05.952886] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present.
[2025-10-24T21:48:05.953407] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-08 (1.01 seconds).
[2025-10-24T21:48:05.953503] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed.
[2025-10-24T21:48:05.958145] [INFO ] [MAIN      ] VOYA: Fetched primary data is valid.
[2025-10-24T21:48:05.958699] [DEBUG] [LOCAL     ] VOYA: Saving primary data.
[2025-10-24T21:48:05.959589] [FATAL] [LOCAL     ] VOYA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:48:05.959713] [FATAL] [MAIN      ] VOYA: Failed to save primary data.
[2025-10-24T21:48:05.959762] [WARN ] [MAIN      ] VOYA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:48:05.959855] [INFO ] [LOCAL     ] VOYA: Starting deletion of primary data.
[2025-10-24T21:48:05.959958] [DEBUG] [LOCAL     ] VOYA: No primary data file found to delete.
[2025-10-24T21:48:05.960016] [INFO ] [LOCAL     ] VOYA: Starting deletion of derivative data.
[2025-10-24T21:48:05.960219] [DEBUG] [LOCAL     ] VOYA: Deleted derivative data file.
[2025-10-24T21:48:05.960326] [INFO ] [MAIN      ] Update Progress: 2244/2366 symbols completed. VOYA took 33.8s. Estimated remaining: 15m 40s. Rate: 7.8 symbols/min
[2025-10-24T21:48:06.128605] [INFO ] [MAIN      ] VRTS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:48:06.143389] [DEBUG] [LOCAL     ] VRTS: Loaded 9434 existing records from primary storage.
[2025-10-24T21:48:06.143735] [INFO ] [MAIN      ] VRTS: Loaded 9434 existing records.
[2025-10-24T21:48:06.319532] [WARN ] [MAIN      ] VRTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:48:06.319851] [INFO ] [MAIN      ] VRTS: Wiping existing primary data before full refresh.
[2025-10-24T21:48:06.319901] [INFO ] [LOCAL     ] VRTS: Starting deletion of primary data.
[2025-10-24T21:48:06.320285] [DEBUG] [LOCAL     ] VRTS: Deleted primary data file.
[2025-10-24T21:48:06.320344] [INFO ] [MAIN      ] VRTS: Starting full primary refresh.
[2025-10-24T21:48:06.552962] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-03.
[2025-10-24T21:48:06.695967] [INFO ] [REMOTE    ] VRTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:48:07.342169] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-04 (1.59 seconds).
[2025-10-24T21:48:07.350409] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-09.
[2025-10-24T21:48:08.147709] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-05.
[2025-10-24T21:48:08.217375] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-09 (0.87 seconds).
[2025-10-24T21:48:08.566007] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-03 (2.01 seconds).
[2025-10-24T21:48:08.947711] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-04.
[2025-10-24T21:48:09.554743] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T21:48:09.747690] [INFO ] [REMOTE    ] VPG: Fetching primary data for 2025-10.
[2025-10-24T21:48:10.547744] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-01.
[2025-10-24T21:48:10.590374] [INFO ] [REMOTE    ] VPG: Incremental fetch complete for 2025-10 (0.84 seconds).
[2025-10-24T21:48:10.594198] [INFO ] [REMOTE    ] VPG: Full fetch complete (23218 records).
[2025-10-24T21:48:10.594323] [DEBUG] [VALIDATOR ] VPG: Validating primary data.
[2025-10-24T21:48:11.055032] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present.
[2025-10-24T21:48:11.055160] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed.
[2025-10-24T21:48:11.055880] [INFO ] [MAIN      ] VPG: Fetched primary data is valid.
[2025-10-24T21:48:11.055965] [DEBUG] [LOCAL     ] VPG: Saving primary data.
[2025-10-24T21:48:11.056339] [FATAL] [LOCAL     ] VPG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:48:11.056550] [FATAL] [MAIN      ] VPG: Failed to save primary data.
[2025-10-24T21:48:11.056725] [WARN ] [MAIN      ] VPG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:48:11.056899] [INFO ] [LOCAL     ] VPG: Starting deletion of primary data.
[2025-10-24T21:48:11.056998] [DEBUG] [LOCAL     ] VPG: No primary data file found to delete.
[2025-10-24T21:48:11.057050] [INFO ] [LOCAL     ] VPG: Starting deletion of derivative data.
[2025-10-24T21:48:11.057375] [DEBUG] [LOCAL     ] VPG: Deleted derivative data file.
[2025-10-24T21:48:11.057471] [INFO ] [MAIN      ] Update Progress: 2245/2366 symbols completed. VPG took 38.9s. Estimated remaining: 15m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:48:11.233865] [INFO ] [MAIN      ] VSCO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:48:11.234493] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-01 (0.69 seconds).
[2025-10-24T21:48:11.268965] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-04 (2.32 seconds).
[2025-10-24T21:48:11.323194] [DEBUG] [LOCAL     ] VSCO: Loaded 53067 existing records from primary storage.
[2025-10-24T21:48:11.323501] [INFO ] [MAIN      ] VSCO: Loaded 53067 existing records.
[2025-10-24T21:48:11.352818] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-06.
[2025-10-24T21:48:11.501829] [WARN ] [MAIN      ] VSCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:48:11.502081] [INFO ] [MAIN      ] VSCO: Wiping existing primary data before full refresh.
[2025-10-24T21:48:11.502127] [INFO ] [LOCAL     ] VSCO: Starting deletion of primary data.
[2025-10-24T21:48:11.502616] [DEBUG] [LOCAL     ] VSCO: Deleted primary data file.
[2025-10-24T21:48:11.502710] [INFO ] [MAIN      ] VSCO: Starting full primary refresh.
[2025-10-24T21:48:11.849255] [INFO ] [REMOTE    ] VSCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:48:12.147693] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-02.
[2025-10-24T21:48:12.677220] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-02 (0.53 seconds).
[2025-10-24T21:48:12.678273] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-06 (1.33 seconds).
[2025-10-24T21:48:12.947697] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-05.
[2025-10-24T21:48:13.747717] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-01.
[2025-10-24T21:48:14.547697] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-07.
[2025-10-24T21:48:15.353725] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-03.
[2025-10-24T21:48:15.374585] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-01 (1.63 seconds).
[2025-10-24T21:48:15.470804] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-05 (2.52 seconds).
[2025-10-24T21:48:15.621795] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T21:48:15.856012] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-03 (0.50 seconds).
[2025-10-24T21:48:16.147725] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-06.
[2025-10-24T21:48:16.947726] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-02.
[2025-10-24T21:48:17.747700] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-04.
[2025-10-24T21:48:18.230148] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-06 (2.08 seconds).
[2025-10-24T21:48:18.452813] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-04 (0.71 seconds).
[2025-10-24T21:48:18.557471] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-08.
[2025-10-24T21:48:18.563186] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-02 (1.62 seconds).
[2025-10-24T21:48:19.347699] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-05.
[2025-10-24T21:48:19.856992] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T21:48:20.081597] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-05 (0.73 seconds).
[2025-10-24T21:48:20.147729] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-06.
[2025-10-24T21:48:20.947676] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-03.
[2025-10-24T21:48:21.057573] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-06 (0.91 seconds).
[2025-10-24T21:48:21.747732] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-09.
[2025-10-24T21:48:22.547632] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-07.
[2025-10-24T21:48:22.678197] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T21:48:23.335817] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-09 (1.59 seconds).
[2025-10-24T21:48:23.347622] [INFO ] [REMOTE    ] VRE: Fetching primary data for 2025-10.
[2025-10-24T21:48:23.381183] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-07 (0.83 seconds).
[2025-10-24T21:48:24.147699] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-04.
[2025-10-24T21:48:24.795415] [INFO ] [REMOTE    ] VRE: Incremental fetch complete for 2025-10 (1.45 seconds).
[2025-10-24T21:48:24.801969] [INFO ] [REMOTE    ] VRE: Full fetch complete (48759 records).
[2025-10-24T21:48:24.802058] [DEBUG] [VALIDATOR ] VRE: Validating primary data.
[2025-10-24T21:48:24.956729] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-08.
[2025-10-24T21:48:25.196454] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present.
[2025-10-24T21:48:25.196534] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed.
[2025-10-24T21:48:25.197524] [INFO ] [MAIN      ] VRE: Fetched primary data is valid.
[2025-10-24T21:48:25.197585] [DEBUG] [LOCAL     ] VRE: Saving primary data.
[2025-10-24T21:48:25.198066] [FATAL] [LOCAL     ] VRE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:48:25.198155] [FATAL] [MAIN      ] VRE: Failed to save primary data.
[2025-10-24T21:48:25.198198] [WARN ] [MAIN      ] VRE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:48:25.198235] [INFO ] [LOCAL     ] VRE: Starting deletion of primary data.
[2025-10-24T21:48:25.198285] [DEBUG] [LOCAL     ] VRE: No primary data file found to delete.
[2025-10-24T21:48:25.198321] [INFO ] [LOCAL     ] VRE: Starting deletion of derivative data.
[2025-10-24T21:48:25.198479] [DEBUG] [LOCAL     ] VRE: Deleted derivative data file.
[2025-10-24T21:48:25.198551] [INFO ] [MAIN      ] Update Progress: 2246/2366 symbols completed. VRE took 32.8s. Estimated remaining: 15m 24s. Rate: 7.8 symbols/min
[2025-10-24T21:48:25.365428] [INFO ] [MAIN      ] VSH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:48:25.409851] [DEBUG] [LOCAL     ] VSH: Loaded 48614 existing records from primary storage.
[2025-10-24T21:48:25.410141] [INFO ] [MAIN      ] VSH: Loaded 48614 existing records.
[2025-10-24T21:48:25.588094] [WARN ] [MAIN      ] VSH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:48:25.588583] [INFO ] [MAIN      ] VSH: Wiping existing primary data before full refresh.
[2025-10-24T21:48:25.588757] [INFO ] [LOCAL     ] VSH: Starting deletion of primary data.
[2025-10-24T21:48:25.589385] [DEBUG] [LOCAL     ] VSH: Deleted primary data file.
[2025-10-24T21:48:25.589425] [INFO ] [MAIN      ] VSH: Starting full primary refresh.
[2025-10-24T21:48:25.751993] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-07.
[2025-10-24T21:48:25.895084] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-08 (0.94 seconds).
[2025-10-24T21:48:26.011177] [INFO ] [REMOTE    ] VSH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:48:26.013419] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T21:48:26.547685] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-09.
[2025-10-24T21:48:27.248402] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-09 (0.70 seconds).
[2025-10-24T21:48:27.347588] [INFO ] [REMOTE    ] VRTS: Fetching primary data for 2025-10.
[2025-10-24T21:48:28.064549] [INFO ] [REMOTE    ] VRTS: Incremental fetch complete for 2025-10 (0.72 seconds).
[2025-10-24T21:48:28.067703] [INFO ] [REMOTE    ] VRTS: Full fetch complete (11905 records).
[2025-10-24T21:48:28.067955] [DEBUG] [VALIDATOR ] VRTS: Validating primary data.
[2025-10-24T21:48:28.152821] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-01.
[2025-10-24T21:48:28.453673] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present.
[2025-10-24T21:48:28.453761] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed.
[2025-10-24T21:48:28.454169] [INFO ] [MAIN      ] VRTS: Fetched primary data is valid.
[2025-10-24T21:48:28.454284] [DEBUG] [LOCAL     ] VRTS: Saving primary data.
[2025-10-24T21:48:28.454695] [FATAL] [LOCAL     ] VRTS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:48:28.454790] [FATAL] [MAIN      ] VRTS: Failed to save primary data.
[2025-10-24T21:48:28.454946] [WARN ] [MAIN      ] VRTS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:48:28.455021] [INFO ] [LOCAL     ] VRTS: Starting deletion of primary data.
[2025-10-24T21:48:28.455107] [DEBUG] [LOCAL     ] VRTS: No primary data file found to delete.
[2025-10-24T21:48:28.455245] [INFO ] [LOCAL     ] VRTS: Starting deletion of derivative data.
[2025-10-24T21:48:28.455724] [DEBUG] [LOCAL     ] VRTS: Deleted derivative data file.
[2025-10-24T21:48:28.455834] [INFO ] [MAIN      ] Update Progress: 2247/2366 symbols completed. VRTS took 22.5s. Estimated remaining: 15m 16s. Rate: 7.8 symbols/min
[2025-10-24T21:48:28.604394] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-07 (2.85 seconds).
[2025-10-24T21:48:28.704116] [INFO ] [MAIN      ] VST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:48:28.755573] [DEBUG] [LOCAL     ] VST: Loaded 54099 existing records from primary storage.
[2025-10-24T21:48:28.755916] [INFO ] [MAIN      ] VST: Loaded 54099 existing records.
[2025-10-24T21:48:28.936365] [WARN ] [MAIN      ] VST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:48:28.936594] [INFO ] [MAIN      ] VST: Wiping existing primary data before full refresh.
[2025-10-24T21:48:28.936663] [INFO ] [LOCAL     ] VST: Starting deletion of primary data.
[2025-10-24T21:48:28.938038] [DEBUG] [LOCAL     ] VST: Deleted primary data file.
[2025-10-24T21:48:28.938095] [INFO ] [MAIN      ] VST: Starting full primary refresh.
[2025-10-24T21:48:28.952853] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-08.
[2025-10-24T21:48:29.305995] [INFO ] [REMOTE    ] VST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:48:29.563407] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-01 (1.41 seconds).
[2025-10-24T21:48:29.747729] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-01.
[2025-10-24T21:48:30.547717] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-02.
[2025-10-24T21:48:31.347750] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-05.
[2025-10-24T21:48:31.547551] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-08 (2.59 seconds).
[2025-10-24T21:48:31.698072] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-01 (1.95 seconds).
[2025-10-24T21:48:31.859826] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T21:48:32.147739] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-09.
[2025-10-24T21:48:32.947726] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-02.
[2025-10-24T21:48:33.213162] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T21:48:33.747749] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-06.
[2025-10-24T21:48:34.524244] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-09 (2.38 seconds).
[2025-10-24T21:48:34.547685] [INFO ] [REMOTE    ] VRT: Fetching primary data for 2025-10.
[2025-10-24T21:48:35.347718] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-03.
[2025-10-24T21:48:35.446696] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-02 (2.50 seconds).
[2025-10-24T21:48:35.518019] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T21:48:36.147767] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-03.
[2025-10-24T21:48:36.955202] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-07.
[2025-10-24T21:48:36.975369] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T21:48:37.118868] [INFO ] [REMOTE    ] VRT: Incremental fetch complete for 2025-10 (2.57 seconds).
[2025-10-24T21:48:37.129067] [INFO ] [REMOTE    ] VRT: Full fetch complete (77932 records).
[2025-10-24T21:48:37.129264] [DEBUG] [VALIDATOR ] VRT: Validating primary data.
[2025-10-24T21:48:37.541681] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present.
[2025-10-24T21:48:37.541779] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed.
[2025-10-24T21:48:37.542989] [INFO ] [MAIN      ] VRT: Fetched primary data is valid.
[2025-10-24T21:48:37.543055] [DEBUG] [LOCAL     ] VRT: Saving primary data.
[2025-10-24T21:48:37.543775] [FATAL] [LOCAL     ] VRT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:48:37.543873] [FATAL] [MAIN      ] VRT: Failed to save primary data.
[2025-10-24T21:48:37.543918] [WARN ] [MAIN      ] VRT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:48:37.543990] [INFO ] [LOCAL     ] VRT: Starting deletion of primary data.
[2025-10-24T21:48:37.544069] [DEBUG] [LOCAL     ] VRT: No primary data file found to delete.
[2025-10-24T21:48:37.544118] [INFO ] [LOCAL     ] VRT: Starting deletion of derivative data.
[2025-10-24T21:48:37.544368] [DEBUG] [LOCAL     ] VRT: Deleted derivative data file.
[2025-10-24T21:48:37.545194] [INFO ] [MAIN      ] Update Progress: 2248/2366 symbols completed. VRT took 41.1s. Estimated remaining: 15m 9s. Rate: 7.8 symbols/min
[2025-10-24T21:48:37.723319] [INFO ] [MAIN      ] VSTS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:48:37.748352] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-04.
[2025-10-24T21:48:37.770993] [DEBUG] [LOCAL     ] VSTS: Loaded 49200 existing records from primary storage.
[2025-10-24T21:48:37.771339] [INFO ] [MAIN      ] VSTS: Loaded 49200 existing records.
[2025-10-24T21:48:37.956120] [WARN ] [MAIN      ] VSTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:48:37.956369] [INFO ] [MAIN      ] VSTS: Wiping existing primary data before full refresh.
[2025-10-24T21:48:37.956443] [INFO ] [LOCAL     ] VSTS: Starting deletion of primary data.
[2025-10-24T21:48:37.957396] [DEBUG] [LOCAL     ] VSTS: Deleted primary data file.
[2025-10-24T21:48:37.957464] [INFO ] [MAIN      ] VSTS: Starting full primary refresh.
[2025-10-24T21:48:38.327352] [INFO ] [REMOTE    ] VSTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:48:38.546566] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-03 (2.40 seconds).
[2025-10-24T21:48:38.557406] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-01.
[2025-10-24T21:48:38.892541] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T21:48:39.347619] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-04.
[2025-10-24T21:48:39.414871] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T21:48:39.657409] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T21:48:40.147695] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-08.
[2025-10-24T21:48:40.947742] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-05.
[2025-10-24T21:48:41.703413] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-04 (2.36 seconds).
[2025-10-24T21:48:41.747696] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-05.
[2025-10-24T21:48:41.948866] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T21:48:42.300477] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-05 (1.35 seconds).
[2025-10-24T21:48:42.547681] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-09.
[2025-10-24T21:48:43.347720] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-02.
[2025-10-24T21:48:44.152836] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-06.
[2025-10-24T21:48:44.168450] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-05 (2.42 seconds).
[2025-10-24T21:48:44.238063] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T21:48:44.681398] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T21:48:44.947685] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-03.
[2025-10-24T21:48:45.747707] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-06.
[2025-10-24T21:48:45.866469] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T21:48:46.547696] [INFO ] [REMOTE    ] VSCO: Fetching primary data for 2025-10.
[2025-10-24T21:48:46.938121] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T21:48:47.347639] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-04.
[2025-10-24T21:48:47.899977] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-06 (2.15 seconds).
[2025-10-24T21:48:48.147672] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-07.
[2025-10-24T21:48:48.184331] [INFO ] [REMOTE    ] VSCO: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T21:48:48.194315] [INFO ] [REMOTE    ] VSCO: Full fetch complete (76425 records).
[2025-10-24T21:48:48.194469] [DEBUG] [VALIDATOR ] VSCO: Validating primary data.
[2025-10-24T21:48:48.603901] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present.
[2025-10-24T21:48:48.603998] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed.
[2025-10-24T21:48:48.605166] [INFO ] [MAIN      ] VSCO: Fetched primary data is valid.
[2025-10-24T21:48:48.605247] [DEBUG] [LOCAL     ] VSCO: Saving primary data.
[2025-10-24T21:48:48.605923] [FATAL] [LOCAL     ] VSCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:48:48.606058] [FATAL] [MAIN      ] VSCO: Failed to save primary data.
[2025-10-24T21:48:48.606201] [WARN ] [MAIN      ] VSCO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:48:48.606269] [INFO ] [LOCAL     ] VSCO: Starting deletion of primary data.
[2025-10-24T21:48:48.606330] [DEBUG] [LOCAL     ] VSCO: No primary data file found to delete.
[2025-10-24T21:48:48.606366] [INFO ] [LOCAL     ] VSCO: Starting deletion of derivative data.
[2025-10-24T21:48:48.606519] [DEBUG] [LOCAL     ] VSCO: Deleted derivative data file.
[2025-10-24T21:48:48.607080] [INFO ] [MAIN      ] Update Progress: 2249/2366 symbols completed. VSCO took 37.5s. Estimated remaining: 15m 1s. Rate: 7.8 symbols/min
[2025-10-24T21:48:48.791188] [INFO ] [MAIN      ] VTEX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:48:48.819109] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T21:48:48.864808] [DEBUG] [LOCAL     ] VTEX: Loaded 43140 existing records from primary storage.
[2025-10-24T21:48:48.865085] [INFO ] [MAIN      ] VTEX: Loaded 43140 existing records.
[2025-10-24T21:48:48.952753] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-05.
[2025-10-24T21:48:49.055186] [WARN ] [MAIN      ] VTEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:48:49.055385] [INFO ] [MAIN      ] VTEX: Wiping existing primary data before full refresh.
[2025-10-24T21:48:49.055432] [INFO ] [LOCAL     ] VTEX: Starting deletion of primary data.
[2025-10-24T21:48:49.055828] [DEBUG] [LOCAL     ] VTEX: Deleted primary data file.
[2025-10-24T21:48:49.055886] [INFO ] [MAIN      ] VTEX: Starting full primary refresh.
[2025-10-24T21:48:49.412261] [INFO ] [REMOTE    ] VTEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:48:49.665412] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-07 (1.52 seconds).
[2025-10-24T21:48:49.747618] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-07.
[2025-10-24T21:48:50.424932] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-05 (1.47 seconds).
[2025-10-24T21:48:50.547623] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-06.
[2025-10-24T21:48:51.347720] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-08.
[2025-10-24T21:48:52.147753] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-01.
[2025-10-24T21:48:52.228439] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-06 (1.68 seconds).
[2025-10-24T21:48:52.453501] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-07 (2.71 seconds).
[2025-10-24T21:48:52.947681] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-07.
[2025-10-24T21:48:53.052871] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-08 (1.71 seconds).
[2025-10-24T21:48:53.217188] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-01 (1.07 seconds).
[2025-10-24T21:48:53.747735] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-02.
[2025-10-24T21:48:54.515166] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T21:48:54.547630] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-08.
[2025-10-24T21:48:55.117913] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T21:48:55.347679] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-03.
[2025-10-24T21:48:55.725309] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-08 (1.18 seconds).
[2025-10-24T21:48:56.147723] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-09.
[2025-10-24T21:48:56.947678] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-08.
[2025-10-24T21:48:57.083877] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T21:48:57.678250] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T21:48:57.747690] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-04.
[2025-10-24T21:48:58.547721] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-09.
[2025-10-24T21:48:59.073027] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-08 (2.13 seconds).
[2025-10-24T21:48:59.232067] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T21:48:59.347691] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-05.
[2025-10-24T21:48:59.807753] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-09 (1.26 seconds).
[2025-10-24T21:49:00.147719] [INFO ] [REMOTE    ] VSTS: Fetching primary data for 2025-10.
[2025-10-24T21:49:00.958193] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-09.
[2025-10-24T21:49:00.960776] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T21:49:01.742323] [INFO ] [REMOTE    ] VSTS: Incremental fetch complete for 2025-10 (1.59 seconds).
[2025-10-24T21:49:01.750575] [INFO ] [REMOTE    ] VSH: Fetching primary data for 2025-10.
[2025-10-24T21:49:01.751976] [INFO ] [REMOTE    ] VSTS: Full fetch complete (69712 records).
[2025-10-24T21:49:01.752051] [DEBUG] [VALIDATOR ] VSTS: Validating primary data.
[2025-10-24T21:49:02.138573] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present.
[2025-10-24T21:49:02.138698] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed.
[2025-10-24T21:49:02.139839] [INFO ] [MAIN      ] VSTS: Fetched primary data is valid.
[2025-10-24T21:49:02.139900] [DEBUG] [LOCAL     ] VSTS: Saving primary data.
[2025-10-24T21:49:02.140439] [FATAL] [LOCAL     ] VSTS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:49:02.140532] [FATAL] [MAIN      ] VSTS: Failed to save primary data.
[2025-10-24T21:49:02.140574] [WARN ] [MAIN      ] VSTS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:49:02.140608] [INFO ] [LOCAL     ] VSTS: Starting deletion of primary data.
[2025-10-24T21:49:02.140732] [DEBUG] [LOCAL     ] VSTS: No primary data file found to delete.
[2025-10-24T21:49:02.140790] [INFO ] [LOCAL     ] VSTS: Starting deletion of derivative data.
[2025-10-24T21:49:02.140969] [DEBUG] [LOCAL     ] VSTS: Deleted derivative data file.
[2025-10-24T21:49:02.141414] [INFO ] [MAIN      ] Update Progress: 2250/2366 symbols completed. VSTS took 24.6s. Estimated remaining: 14m 54s. Rate: 7.8 symbols/min
[2025-10-24T21:49:02.307998] [INFO ] [MAIN      ] VTLE: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:49:02.352959] [DEBUG] [LOCAL     ] VTLE: Loaded 47877 existing records from primary storage.
[2025-10-24T21:49:02.353312] [INFO ] [MAIN      ] VTLE: Loaded 47877 existing records.
[2025-10-24T21:49:02.552886] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-06.
[2025-10-24T21:49:02.562980] [WARN ] [MAIN      ] VTLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:49:02.564394] [INFO ] [MAIN      ] VTLE: Wiping existing primary data before full refresh.
[2025-10-24T21:49:02.564464] [INFO ] [LOCAL     ] VTLE: Starting deletion of primary data.
[2025-10-24T21:49:02.565898] [DEBUG] [LOCAL     ] VTLE: Deleted primary data file.
[2025-10-24T21:49:02.565973] [INFO ] [MAIN      ] VTLE: Starting full primary refresh.
[2025-10-24T21:49:03.048430] [INFO ] [REMOTE    ] VTLE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:49:03.250446] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-09 (2.29 seconds).
[2025-10-24T21:49:03.332091] [INFO ] [REMOTE    ] VSH: Incremental fetch complete for 2025-10 (1.58 seconds).
[2025-10-24T21:49:03.343014] [INFO ] [REMOTE    ] VSH: Full fetch complete (70993 records).
[2025-10-24T21:49:03.343242] [DEBUG] [VALIDATOR ] VSH: Validating primary data.
[2025-10-24T21:49:03.356795] [INFO ] [REMOTE    ] VST: Fetching primary data for 2025-10.
[2025-10-24T21:49:03.778135] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present.
[2025-10-24T21:49:03.778211] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed.
[2025-10-24T21:49:03.779325] [INFO ] [MAIN      ] VSH: Fetched primary data is valid.
[2025-10-24T21:49:03.779386] [DEBUG] [LOCAL     ] VSH: Saving primary data.
[2025-10-24T21:49:03.779940] [FATAL] [LOCAL     ] VSH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:49:03.780023] [FATAL] [MAIN      ] VSH: Failed to save primary data.
[2025-10-24T21:49:03.780065] [WARN ] [MAIN      ] VSH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:49:03.780099] [INFO ] [LOCAL     ] VSH: Starting deletion of primary data.
[2025-10-24T21:49:03.780149] [DEBUG] [LOCAL     ] VSH: No primary data file found to delete.
[2025-10-24T21:49:03.780183] [INFO ] [LOCAL     ] VSH: Starting deletion of derivative data.
[2025-10-24T21:49:03.780366] [DEBUG] [LOCAL     ] VSH: Deleted derivative data file.
[2025-10-24T21:49:03.780698] [INFO ] [MAIN      ] Update Progress: 2251/2366 symbols completed. VSH took 38.6s. Estimated remaining: 14m 46s. Rate: 7.8 symbols/min
[2025-10-24T21:49:03.952498] [INFO ] [MAIN      ] VTMX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:49:03.970387] [DEBUG] [LOCAL     ] VTMX: Loaded 17668 existing records from primary storage.
[2025-10-24T21:49:03.970626] [INFO ] [MAIN      ] VTMX: Loaded 17668 existing records.
[2025-10-24T21:49:04.152519] [WARN ] [MAIN      ] VTMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:49:04.148929] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-01.
[2025-10-24T21:49:04.153237] [INFO ] [MAIN      ] VTMX: Wiping existing primary data before full refresh.
[2025-10-24T21:49:04.154662] [INFO ] [LOCAL     ] VTMX: Starting deletion of primary data.
[2025-10-24T21:49:04.164023] [DEBUG] [LOCAL     ] VTMX: Deleted primary data file.
[2025-10-24T21:49:04.169585] [INFO ] [MAIN      ] VTMX: Starting full primary refresh.
[2025-10-24T21:49:04.285828] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T21:49:04.400006] [INFO ] [REMOTE    ] VST: Incremental fetch complete for 2025-10 (1.04 seconds).
[2025-10-24T21:49:04.489989] [INFO ] [REMOTE    ] VST: Full fetch complete (77888 records).
[2025-10-24T21:49:04.506071] [DEBUG] [VALIDATOR ] VST: Validating primary data.
[2025-10-24T21:49:04.731213] [INFO ] [REMOTE    ] VTMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:49:04.952811] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-07.
[2025-10-24T21:49:05.027440] [DEBUG] [VALIDATOR ] VST: All expected trading days are present.
[2025-10-24T21:49:05.027530] [DEBUG] [VALIDATOR ] VST: Primary data validation passed.
[2025-10-24T21:49:05.028894] [INFO ] [MAIN      ] VST: Fetched primary data is valid.
[2025-10-24T21:49:05.028956] [DEBUG] [LOCAL     ] VST: Saving primary data.
[2025-10-24T21:49:05.029707] [FATAL] [LOCAL     ] VST: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:49:05.029799] [FATAL] [MAIN      ] VST: Failed to save primary data.
[2025-10-24T21:49:05.029840] [WARN ] [MAIN      ] VST: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:49:05.029900] [INFO ] [LOCAL     ] VST: Starting deletion of primary data.
[2025-10-24T21:49:05.029962] [DEBUG] [LOCAL     ] VST: No primary data file found to delete.
[2025-10-24T21:49:05.029997] [INFO ] [LOCAL     ] VST: Starting deletion of derivative data.
[2025-10-24T21:49:05.030175] [DEBUG] [LOCAL     ] VST: Deleted derivative data file.
[2025-10-24T21:49:05.030459] [INFO ] [MAIN      ] Update Progress: 2252/2366 symbols completed. VST took 36.6s. Estimated remaining: 14m 38s. Rate: 7.8 symbols/min
[2025-10-24T21:49:05.201771] [INFO ] [MAIN      ] VTN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:49:05.212297] [DEBUG] [LOCAL     ] VTN: Loaded 7335 existing records from primary storage.
[2025-10-24T21:49:05.212514] [INFO ] [MAIN      ] VTN: Loaded 7335 existing records.
[2025-10-24T21:49:05.394795] [WARN ] [MAIN      ] VTN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:49:05.394989] [INFO ] [MAIN      ] VTN: Wiping existing primary data before full refresh.
[2025-10-24T21:49:05.395035] [INFO ] [LOCAL     ] VTN: Starting deletion of primary data.
[2025-10-24T21:49:05.395211] [DEBUG] [LOCAL     ] VTN: Deleted primary data file.
[2025-10-24T21:49:05.395250] [INFO ] [MAIN      ] VTN: Starting full primary refresh.
[2025-10-24T21:49:05.761831] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-01.
[2025-10-24T21:49:05.771109] [INFO ] [REMOTE    ] VTN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:49:05.799526] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T21:49:06.547637] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-01.
[2025-10-24T21:49:06.612563] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T21:49:06.783220] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-01 (1.02 seconds).
[2025-10-24T21:49:07.322636] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-01 (0.77 seconds).
[2025-10-24T21:49:07.347675] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-02.
[2025-10-24T21:49:08.092841] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T21:49:08.147692] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-02.
[2025-10-24T21:49:08.947764] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-02.
[2025-10-24T21:49:09.660707] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-02 (1.51 seconds).
[2025-10-24T21:49:09.747724] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-08.
[2025-10-24T21:49:09.951129] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-02 (1.00 seconds).
[2025-10-24T21:49:10.547746] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-03.
[2025-10-24T21:49:11.125683] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-08 (1.38 seconds).
[2025-10-24T21:49:11.347665] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-03.
[2025-10-24T21:49:11.482764] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-03 (0.94 seconds).
[2025-10-24T21:49:12.117849] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-03 (0.77 seconds).
[2025-10-24T21:49:12.147627] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-03.
[2025-10-24T21:49:12.947718] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-09.
[2025-10-24T21:49:13.747723] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-04.
[2025-10-24T21:49:13.834176] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-03 (1.69 seconds).
[2025-10-24T21:49:14.438594] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-09 (1.49 seconds).
[2025-10-24T21:49:14.547631] [INFO ] [REMOTE    ] VTEX: Fetching primary data for 2025-10.
[2025-10-24T21:49:14.828798] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-04 (1.08 seconds).
[2025-10-24T21:49:15.347712] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-04.
[2025-10-24T21:49:15.678095] [INFO ] [REMOTE    ] VTEX: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T21:49:15.685737] [INFO ] [REMOTE    ] VTEX: Full fetch complete (61083 records).
[2025-10-24T21:49:15.685847] [DEBUG] [VALIDATOR ] VTEX: Validating primary data.
[2025-10-24T21:49:16.066150] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present.
[2025-10-24T21:49:16.066273] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed.
[2025-10-24T21:49:16.067310] [INFO ] [MAIN      ] VTEX: Fetched primary data is valid.
[2025-10-24T21:49:16.067382] [DEBUG] [LOCAL     ] VTEX: Saving primary data.
[2025-10-24T21:49:16.067929] [FATAL] [LOCAL     ] VTEX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:49:16.068014] [FATAL] [MAIN      ] VTEX: Failed to save primary data.
[2025-10-24T21:49:16.068056] [WARN ] [MAIN      ] VTEX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:49:16.068090] [INFO ] [LOCAL     ] VTEX: Starting deletion of primary data.
[2025-10-24T21:49:16.068139] [DEBUG] [LOCAL     ] VTEX: No primary data file found to delete.
[2025-10-24T21:49:16.068173] [INFO ] [LOCAL     ] VTEX: Starting deletion of derivative data.
[2025-10-24T21:49:16.068341] [DEBUG] [LOCAL     ] VTEX: Deleted derivative data file.
[2025-10-24T21:49:16.068867] [INFO ] [MAIN      ] Update Progress: 2253/2366 symbols completed. VTEX took 27.5s. Estimated remaining: 14m 30s. Rate: 7.8 symbols/min
[2025-10-24T21:49:16.158728] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-04.
[2025-10-24T21:49:16.175822] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-04 (0.83 seconds).
[2025-10-24T21:49:16.249826] [INFO ] [MAIN      ] VTOL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:49:16.270264] [DEBUG] [LOCAL     ] VTOL: Loaded 19509 existing records from primary storage.
[2025-10-24T21:49:16.270519] [INFO ] [MAIN      ] VTOL: Loaded 19509 existing records.
[2025-10-24T21:49:16.444562] [WARN ] [MAIN      ] VTOL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:49:16.444761] [INFO ] [MAIN      ] VTOL: Wiping existing primary data before full refresh.
[2025-10-24T21:49:16.444807] [INFO ] [LOCAL     ] VTOL: Starting deletion of primary data.
[2025-10-24T21:49:16.445384] [DEBUG] [LOCAL     ] VTOL: Deleted primary data file.
[2025-10-24T21:49:16.445440] [INFO ] [MAIN      ] VTOL: Starting full primary refresh.
[2025-10-24T21:49:16.816697] [INFO ] [REMOTE    ] VTOL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:49:16.947601] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-01.
[2025-10-24T21:49:17.744965] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-01 (0.80 seconds).
[2025-10-24T21:49:17.747764] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-02.
[2025-10-24T21:49:17.930309] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-04 (1.77 seconds).
[2025-10-24T21:49:18.547746] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-05.
[2025-10-24T21:49:18.760722] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T21:49:19.170671] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T21:49:19.347600] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-05.
[2025-10-24T21:49:20.147688] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-03.
[2025-10-24T21:49:20.428775] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-05 (1.08 seconds).
[2025-10-24T21:49:20.947709] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-06.
[2025-10-24T21:49:21.116243] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-03 (0.97 seconds).
[2025-10-24T21:49:21.747712] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-04.
[2025-10-24T21:49:22.013263] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T21:49:22.547706] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-07.
[2025-10-24T21:49:22.851536] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-04 (1.10 seconds).
[2025-10-24T21:49:23.347719] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-05.
[2025-10-24T21:49:23.550710] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-07 (1.00 seconds).
[2025-10-24T21:49:24.063089] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-05 (0.72 seconds).
[2025-10-24T21:49:24.147697] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-08.
[2025-10-24T21:49:24.904915] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-08 (0.76 seconds).
[2025-10-24T21:49:24.947672] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-09.
[2025-10-24T21:49:25.747682] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-06.
[2025-10-24T21:49:25.982391] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-09 (1.03 seconds).
[2025-10-24T21:49:26.547734] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-05.
[2025-10-24T21:49:26.792326] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-06 (1.04 seconds).
[2025-10-24T21:49:27.347714] [INFO ] [REMOTE    ] VTMX: Fetching primary data for 2025-10.
[2025-10-24T21:49:28.101097] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T21:49:28.145964] [INFO ] [REMOTE    ] VTMX: Incremental fetch complete for 2025-10 (0.80 seconds).
[2025-10-24T21:49:28.149487] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-06.
[2025-10-24T21:49:28.150226] [INFO ] [REMOTE    ] VTMX: Full fetch complete (26035 records).
[2025-10-24T21:49:28.151036] [DEBUG] [VALIDATOR ] VTMX: Validating primary data.
[2025-10-24T21:49:28.519659] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present.
[2025-10-24T21:49:28.519752] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed.
[2025-10-24T21:49:28.520269] [INFO ] [MAIN      ] VTMX: Fetched primary data is valid.
[2025-10-24T21:49:28.520310] [DEBUG] [LOCAL     ] VTMX: Saving primary data.
[2025-10-24T21:49:28.520596] [FATAL] [LOCAL     ] VTMX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:49:28.520706] [FATAL] [MAIN      ] VTMX: Failed to save primary data.
[2025-10-24T21:49:28.520751] [WARN ] [MAIN      ] VTMX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:49:28.520845] [INFO ] [LOCAL     ] VTMX: Starting deletion of primary data.
[2025-10-24T21:49:28.520939] [DEBUG] [LOCAL     ] VTMX: No primary data file found to delete.
[2025-10-24T21:49:28.520999] [INFO ] [LOCAL     ] VTMX: Starting deletion of derivative data.
[2025-10-24T21:49:28.521214] [DEBUG] [LOCAL     ] VTMX: Deleted derivative data file.
[2025-10-24T21:49:28.521307] [INFO ] [MAIN      ] Update Progress: 2254/2366 symbols completed. VTMX took 24.7s. Estimated remaining: 14m 23s. Rate: 7.8 symbols/min
[2025-10-24T21:49:28.689469] [INFO ] [MAIN      ] VTR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:49:28.740051] [DEBUG] [LOCAL     ] VTR: Loaded 53049 existing records from primary storage.
[2025-10-24T21:49:28.740353] [INFO ] [MAIN      ] VTR: Loaded 53049 existing records.
[2025-10-24T21:49:28.915250] [WARN ] [MAIN      ] VTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:49:28.915437] [INFO ] [MAIN      ] VTR: Wiping existing primary data before full refresh.
[2025-10-24T21:49:28.915482] [INFO ] [LOCAL     ] VTR: Starting deletion of primary data.
[2025-10-24T21:49:28.915995] [DEBUG] [LOCAL     ] VTR: Deleted primary data file.
[2025-10-24T21:49:28.916051] [INFO ] [MAIN      ] VTR: Starting full primary refresh.
[2025-10-24T21:49:28.952784] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-06.
[2025-10-24T21:49:29.265094] [INFO ] [REMOTE    ] VTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:49:29.652462] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-06 (0.70 seconds).
[2025-10-24T21:49:29.747689] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-07.
[2025-10-24T21:49:29.914891] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-06 (1.77 seconds).
[2025-10-24T21:49:30.547782] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-07.
[2025-10-24T21:49:30.548042] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-07 (0.80 seconds).
[2025-10-24T21:49:31.347712] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-01.
[2025-10-24T21:49:31.839670] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T21:49:32.147727] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-07.
[2025-10-24T21:49:32.947638] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-08.
[2025-10-24T21:49:33.147972] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T21:49:33.416363] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T21:49:33.747697] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-08.
[2025-10-24T21:49:33.939582] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T21:49:34.547696] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-08.
[2025-10-24T21:49:34.919278] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T21:49:35.347695] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-09.
[2025-10-24T21:49:36.125902] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T21:49:36.147617] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-09.
[2025-10-24T21:49:36.285880] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-09 (0.94 seconds).
[2025-10-24T21:49:36.947680] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-09.
[2025-10-24T21:49:37.644501] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T21:49:37.715622] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T21:49:37.747707] [INFO ] [REMOTE    ] VTOL: Fetching primary data for 2025-10.
[2025-10-24T21:49:38.547759] [INFO ] [REMOTE    ] VTN: Fetching primary data for 2025-10.
[2025-10-24T21:49:38.664367] [INFO ] [REMOTE    ] VTOL: Incremental fetch complete for 2025-10 (0.92 seconds).
[2025-10-24T21:49:38.667991] [INFO ] [REMOTE    ] VTOL: Full fetch complete (26515 records).
[2025-10-24T21:49:38.668117] [DEBUG] [VALIDATOR ] VTOL: Validating primary data.
[2025-10-24T21:49:39.032950] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present.
[2025-10-24T21:49:39.033032] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed.
[2025-10-24T21:49:39.033581] [INFO ] [MAIN      ] VTOL: Fetched primary data is valid.
[2025-10-24T21:49:39.033619] [DEBUG] [LOCAL     ] VTOL: Saving primary data.
[2025-10-24T21:49:39.033945] [FATAL] [LOCAL     ] VTOL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:49:39.034027] [FATAL] [MAIN      ] VTOL: Failed to save primary data.
[2025-10-24T21:49:39.034069] [WARN ] [MAIN      ] VTOL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:49:39.034103] [INFO ] [LOCAL     ] VTOL: Starting deletion of primary data.
[2025-10-24T21:49:39.034153] [DEBUG] [LOCAL     ] VTOL: No primary data file found to delete.
[2025-10-24T21:49:39.034187] [INFO ] [LOCAL     ] VTOL: Starting deletion of derivative data.
[2025-10-24T21:49:39.034360] [DEBUG] [LOCAL     ] VTOL: Deleted derivative data file.
[2025-10-24T21:49:39.034450] [INFO ] [MAIN      ] Update Progress: 2255/2366 symbols completed. VTOL took 23.0s. Estimated remaining: 14m 15s. Rate: 7.8 symbols/min
[2025-10-24T21:49:39.217567] [INFO ] [MAIN      ] VTS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:49:39.247025] [DEBUG] [LOCAL     ] VTS: Loaded 30045 existing records from primary storage.
[2025-10-24T21:49:39.247428] [INFO ] [MAIN      ] VTS: Loaded 30045 existing records.
[2025-10-24T21:49:39.348194] [INFO ] [REMOTE    ] VTLE: Fetching primary data for 2025-10.
[2025-10-24T21:49:39.427477] [WARN ] [MAIN      ] VTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:49:39.434083] [INFO ] [MAIN      ] VTS: Wiping existing primary data before full refresh.
[2025-10-24T21:49:39.434465] [INFO ] [LOCAL     ] VTS: Starting deletion of primary data.
[2025-10-24T21:49:39.434383] [INFO ] [REMOTE    ] VTN: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T21:49:39.436573] [DEBUG] [LOCAL     ] VTS: Deleted primary data file.
[2025-10-24T21:49:39.436676] [INFO ] [MAIN      ] VTS: Starting full primary refresh.
[2025-10-24T21:49:39.479392] [INFO ] [REMOTE    ] VTN: Full fetch complete (11011 records).
[2025-10-24T21:49:39.505406] [DEBUG] [VALIDATOR ] VTN: Validating primary data.
[2025-10-24T21:49:40.097963] [INFO ] [REMOTE    ] VTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:49:40.155115] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-02.
[2025-10-24T21:49:40.182891] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present.
[2025-10-24T21:49:40.182960] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed.
[2025-10-24T21:49:40.183247] [INFO ] [MAIN      ] VTN: Fetched primary data is valid.
[2025-10-24T21:49:40.183287] [DEBUG] [LOCAL     ] VTN: Saving primary data.
[2025-10-24T21:49:40.183555] [FATAL] [LOCAL     ] VTN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:49:40.183760] [FATAL] [MAIN      ] VTN: Failed to save primary data.
[2025-10-24T21:49:40.183833] [WARN ] [MAIN      ] VTN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:49:40.183889] [INFO ] [LOCAL     ] VTN: Starting deletion of primary data.
[2025-10-24T21:49:40.183960] [DEBUG] [LOCAL     ] VTN: No primary data file found to delete.
[2025-10-24T21:49:40.184008] [INFO ] [LOCAL     ] VTN: Starting deletion of derivative data.
[2025-10-24T21:49:40.184165] [DEBUG] [LOCAL     ] VTN: Deleted derivative data file.
[2025-10-24T21:49:40.184259] [INFO ] [MAIN      ] Update Progress: 2256/2366 symbols completed. VTN took 35.2s. Estimated remaining: 14m 7s. Rate: 7.8 symbols/min
[2025-10-24T21:49:40.356123] [INFO ] [MAIN      ] VVR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:49:40.385585] [DEBUG] [LOCAL     ] VVR: Loaded 31357 existing records from primary storage.
[2025-10-24T21:49:40.385890] [INFO ] [MAIN      ] VVR: Loaded 31357 existing records.
[2025-10-24T21:49:40.576752] [WARN ] [MAIN      ] VVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:49:40.576991] [INFO ] [MAIN      ] VVR: Wiping existing primary data before full refresh.
[2025-10-24T21:49:40.577043] [INFO ] [LOCAL     ] VVR: Starting deletion of primary data.
[2025-10-24T21:49:40.577566] [DEBUG] [LOCAL     ] VVR: Deleted primary data file.
[2025-10-24T21:49:40.577680] [INFO ] [MAIN      ] VVR: Starting full primary refresh.
[2025-10-24T21:49:40.930661] [INFO ] [REMOTE    ] VVR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:49:40.948743] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-01.
[2025-10-24T21:49:40.950882] [INFO ] [REMOTE    ] VTLE: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T21:49:40.958822] [INFO ] [REMOTE    ] VTLE: Full fetch complete (68303 records).
[2025-10-24T21:49:40.958920] [DEBUG] [VALIDATOR ] VTLE: Validating primary data.
[2025-10-24T21:49:41.337902] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present.
[2025-10-24T21:49:41.337979] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed.
[2025-10-24T21:49:41.339086] [INFO ] [MAIN      ] VTLE: Fetched primary data is valid.
[2025-10-24T21:49:41.339147] [DEBUG] [LOCAL     ] VTLE: Saving primary data.
[2025-10-24T21:49:41.339706] [FATAL] [LOCAL     ] VTLE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:49:41.339808] [FATAL] [MAIN      ] VTLE: Failed to save primary data.
[2025-10-24T21:49:41.339877] [WARN ] [MAIN      ] VTLE: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:49:41.339975] [INFO ] [LOCAL     ] VTLE: Starting deletion of primary data.
[2025-10-24T21:49:41.340053] [DEBUG] [LOCAL     ] VTLE: No primary data file found to delete.
[2025-10-24T21:49:41.340090] [INFO ] [LOCAL     ] VTLE: Starting deletion of derivative data.
[2025-10-24T21:49:41.340335] [DEBUG] [LOCAL     ] VTLE: Deleted derivative data file.
[2025-10-24T21:49:41.340768] [INFO ] [MAIN      ] Update Progress: 2257/2366 symbols completed. VTLE took 39.2s. Estimated remaining: 13m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:49:41.508502] [INFO ] [MAIN      ] VVV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:49:41.556284] [DEBUG] [LOCAL     ] VVV: Loaded 50497 existing records from primary storage.
[2025-10-24T21:49:41.556576] [INFO ] [MAIN      ] VVV: Loaded 50497 existing records.
[2025-10-24T21:49:41.747336] [WARN ] [MAIN      ] VVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:49:41.747756] [INFO ] [MAIN      ] VVV: Wiping existing primary data before full refresh.
[2025-10-24T21:49:41.747931] [INFO ] [LOCAL     ] VVV: Starting deletion of primary data.
[2025-10-24T21:49:41.747668] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-01.
[2025-10-24T21:49:41.749613] [DEBUG] [LOCAL     ] VVV: Deleted primary data file.
[2025-10-24T21:49:41.749711] [INFO ] [MAIN      ] VVV: Starting full primary refresh.
[2025-10-24T21:49:42.123848] [INFO ] [REMOTE    ] VVV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:49:42.152996] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-02 (2.00 seconds).
[2025-10-24T21:49:42.323802] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-01 (1.38 seconds).
[2025-10-24T21:49:42.547712] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-03.
[2025-10-24T21:49:42.882723] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T21:49:43.347738] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-02.
[2025-10-24T21:49:44.147633] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-01.
[2025-10-24T21:49:44.244209] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T21:49:44.358825] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-02 (1.01 seconds).
[2025-10-24T21:49:44.947709] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-02.
[2025-10-24T21:49:45.573073] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-01 (1.43 seconds).
[2025-10-24T21:49:45.747675] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-02.
[2025-10-24T21:49:46.313703] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-02 (1.37 seconds).
[2025-10-24T21:49:46.547716] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-03.
[2025-10-24T21:49:47.093142] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T21:49:47.347694] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-03.
[2025-10-24T21:49:47.911484] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T21:49:48.147736] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-04.
[2025-10-24T21:49:48.947689] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-04.
[2025-10-24T21:49:49.007170] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-03 (1.66 seconds).
[2025-10-24T21:49:49.463441] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-04 (1.32 seconds).
[2025-10-24T21:49:49.747720] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-03.
[2025-10-24T21:49:50.547730] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-04.
[2025-10-24T21:49:50.818982] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-04 (1.87 seconds).
[2025-10-24T21:49:51.171397] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-03 (1.42 seconds).
[2025-10-24T21:49:51.347758] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-04.
[2025-10-24T21:49:52.110485] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-04 (1.56 seconds).
[2025-10-24T21:49:52.147598] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-05.
[2025-10-24T21:49:52.269852] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-04 (0.92 seconds).
[2025-10-24T21:49:52.947741] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-05.
[2025-10-24T21:49:53.747696] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-05.
[2025-10-24T21:49:53.951424] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T21:49:54.547726] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-06.
[2025-10-24T21:49:54.671021] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T21:49:54.731174] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T21:49:55.347727] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-06.
[2025-10-24T21:49:56.147754] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-06.
[2025-10-24T21:49:56.204577] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T21:49:56.947681] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-07.
[2025-10-24T21:49:57.078048] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T21:49:57.422322] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T21:49:57.747747] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-05.
[2025-10-24T21:49:58.547740] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-07.
[2025-10-24T21:49:58.723461] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T21:49:59.029173] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T21:49:59.347695] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-06.
[2025-10-24T21:49:59.760839] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-07 (1.21 seconds).
[2025-10-24T21:50:00.147703] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-08.
[2025-10-24T21:50:00.745093] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-06 (1.40 seconds).
[2025-10-24T21:50:00.947701] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-07.
[2025-10-24T21:50:01.747722] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-07.
[2025-10-24T21:50:01.940437] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T21:50:01.950119] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-08 (1.80 seconds).
[2025-10-24T21:50:02.547764] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-09.
[2025-10-24T21:50:03.347667] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-08.
[2025-10-24T21:50:03.684355] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-07 (1.94 seconds).
[2025-10-24T21:50:04.144439] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-09 (1.60 seconds).
[2025-10-24T21:50:04.153943] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-08.
[2025-10-24T21:50:04.677516] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T21:50:04.947724] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-08.
[2025-10-24T21:50:05.747740] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-09.
[2025-10-24T21:50:05.971545] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-08 (1.82 seconds).
[2025-10-24T21:50:06.036590] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-08 (1.09 seconds).
[2025-10-24T21:50:06.547714] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-09.
[2025-10-24T21:50:06.853673] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-09 (1.11 seconds).
[2025-10-24T21:50:07.347706] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-09.
[2025-10-24T21:50:07.556673] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T21:50:08.147704] [INFO ] [REMOTE    ] VTS: Fetching primary data for 2025-10.
[2025-10-24T21:50:08.947709] [INFO ] [REMOTE    ] VVR: Fetching primary data for 2025-10.
[2025-10-24T21:50:09.038876] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T21:50:09.410544] [INFO ] [REMOTE    ] VTS: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T21:50:09.416139] [INFO ] [REMOTE    ] VTS: Full fetch complete (41603 records).
[2025-10-24T21:50:09.416226] [DEBUG] [VALIDATOR ] VTS: Validating primary data.
[2025-10-24T21:50:09.757021] [INFO ] [REMOTE    ] VTR: Fetching primary data for 2025-10.
[2025-10-24T21:50:09.800070] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present.
[2025-10-24T21:50:09.800295] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed.
[2025-10-24T21:50:09.801827] [INFO ] [MAIN      ] VTS: Fetched primary data is valid.
[2025-10-24T21:50:09.801900] [DEBUG] [LOCAL     ] VTS: Saving primary data.
[2025-10-24T21:50:09.802692] [FATAL] [LOCAL     ] VTS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:50:09.802788] [FATAL] [MAIN      ] VTS: Failed to save primary data.
[2025-10-24T21:50:09.802833] [WARN ] [MAIN      ] VTS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:50:09.802900] [INFO ] [LOCAL     ] VTS: Starting deletion of primary data.
[2025-10-24T21:50:09.802973] [DEBUG] [LOCAL     ] VTS: No primary data file found to delete.
[2025-10-24T21:50:09.803012] [INFO ] [LOCAL     ] VTS: Starting deletion of derivative data.
[2025-10-24T21:50:09.803208] [DEBUG] [LOCAL     ] VTS: Deleted derivative data file.
[2025-10-24T21:50:09.803309] [INFO ] [MAIN      ] Update Progress: 2258/2366 symbols completed. VTS took 30.8s. Estimated remaining: 13m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:50:09.994282] [INFO ] [MAIN      ] VVX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:50:10.021022] [DEBUG] [LOCAL     ] VVX: Loaded 23194 existing records from primary storage.
[2025-10-24T21:50:10.021371] [INFO ] [MAIN      ] VVX: Loaded 23194 existing records.
[2025-10-24T21:50:10.177971] [INFO ] [REMOTE    ] VVR: Incremental fetch complete for 2025-10 (1.23 seconds).
[2025-10-24T21:50:10.216056] [INFO ] [REMOTE    ] VVR: Full fetch complete (46658 records).
[2025-10-24T21:50:10.244146] [DEBUG] [VALIDATOR ] VVR: Validating primary data.
[2025-10-24T21:50:10.251709] [WARN ] [MAIN      ] VVX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:50:10.339411] [INFO ] [MAIN      ] VVX: Wiping existing primary data before full refresh.
[2025-10-24T21:50:10.353235] [INFO ] [LOCAL     ] VVX: Starting deletion of primary data.
[2025-10-24T21:50:10.358707] [DEBUG] [LOCAL     ] VVX: Deleted primary data file.
[2025-10-24T21:50:10.359029] [INFO ] [MAIN      ] VVX: Starting full primary refresh.
[2025-10-24T21:50:10.554243] [INFO ] [REMOTE    ] VVV: Fetching primary data for 2025-10.
[2025-10-24T21:50:11.000325] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present.
[2025-10-24T21:50:11.020168] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed.
[2025-10-24T21:50:11.032532] [INFO ] [MAIN      ] VVR: Fetched primary data is valid.
[2025-10-24T21:50:11.034604] [INFO ] [REMOTE    ] VTR: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T21:50:11.041924] [DEBUG] [LOCAL     ] VVR: Saving primary data.
[2025-10-24T21:50:11.075426] [INFO ] [REMOTE    ] VVX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:50:11.075691] [FATAL] [LOCAL     ] VVR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:50:11.077533] [FATAL] [MAIN      ] VVR: Failed to save primary data.
[2025-10-24T21:50:11.077712] [WARN ] [MAIN      ] VVR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:50:11.078011] [INFO ] [LOCAL     ] VVR: Starting deletion of primary data.
[2025-10-24T21:50:11.078223] [INFO ] [REMOTE    ] VTR: Full fetch complete (76432 records).
[2025-10-24T21:50:11.078334] [DEBUG] [VALIDATOR ] VTR: Validating primary data.
[2025-10-24T21:50:11.078563] [DEBUG] [LOCAL     ] VVR: No primary data file found to delete.
[2025-10-24T21:50:11.078738] [INFO ] [LOCAL     ] VVR: Starting deletion of derivative data.
[2025-10-24T21:50:11.084401] [DEBUG] [LOCAL     ] VVR: Deleted derivative data file.
[2025-10-24T21:50:11.163522] [INFO ] [MAIN      ] Update Progress: 2259/2366 symbols completed. VVR took 31.0s. Estimated remaining: 13m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:50:11.359637] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-01.
[2025-10-24T21:50:11.742427] [INFO ] [MAIN      ] VYX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:50:11.881674] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present.
[2025-10-24T21:50:11.881868] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed.
[2025-10-24T21:50:11.883433] [INFO ] [MAIN      ] VTR: Fetched primary data is valid.
[2025-10-24T21:50:11.883557] [DEBUG] [LOCAL     ] VTR: Saving primary data.
[2025-10-24T21:50:11.884468] [FATAL] [LOCAL     ] VTR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:50:11.884591] [FATAL] [MAIN      ] VTR: Failed to save primary data.
[2025-10-24T21:50:11.884636] [WARN ] [MAIN      ] VTR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:50:11.884730] [INFO ] [LOCAL     ] VTR: Starting deletion of primary data.
[2025-10-24T21:50:11.884795] [DEBUG] [LOCAL     ] VTR: No primary data file found to delete.
[2025-10-24T21:50:11.884834] [INFO ] [LOCAL     ] VTR: Starting deletion of derivative data.
[2025-10-24T21:50:11.885067] [DEBUG] [LOCAL     ] VTR: Deleted derivative data file.
[2025-10-24T21:50:11.885539] [INFO ] [MAIN      ] Update Progress: 2260/2366 symbols completed. VTR took 43.4s. Estimated remaining: 13m 37s. Rate: 7.8 symbols/min
[2025-10-24T21:50:12.078580] [DEBUG] [LOCAL     ] VYX: Loaded 48651 existing records from primary storage.
[2025-10-24T21:50:12.129177] [INFO ] [MAIN      ] VZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:50:12.130262] [INFO ] [MAIN      ] VYX: Loaded 48651 existing records.
[2025-10-24T21:50:12.333557] [WARN ] [MAIN      ] VYX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:50:12.334258] [INFO ] [MAIN      ] VYX: Wiping existing primary data before full refresh.
[2025-10-24T21:50:12.334504] [INFO ] [LOCAL     ] VYX: Starting deletion of primary data.
[2025-10-24T21:50:12.335146] [DEBUG] [LOCAL     ] VYX: Deleted primary data file.
[2025-10-24T21:50:12.349690] [INFO ] [MAIN      ] VYX: Starting full primary refresh.
[2025-10-24T21:50:12.410028] [INFO ] [REMOTE    ] VVV: Incremental fetch complete for 2025-10 (1.86 seconds).
[2025-10-24T21:50:12.488949] [INFO ] [REMOTE    ] VVV: Full fetch complete (72454 records).
[2025-10-24T21:50:12.502903] [DEBUG] [VALIDATOR ] VVV: Validating primary data.
[2025-10-24T21:50:12.526898] [DEBUG] [LOCAL     ] VZ: Loaded 54181 existing records from primary storage.
[2025-10-24T21:50:12.549329] [INFO ] [MAIN      ] VZ: Loaded 54181 existing records.
[2025-10-24T21:50:13.055277] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T21:50:13.171400] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-02.
[2025-10-24T21:50:13.179788] [WARN ] [MAIN      ] VZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:50:13.246684] [INFO ] [MAIN      ] VZ: Wiping existing primary data before full refresh.
[2025-10-24T21:50:13.265932] [INFO ] [REMOTE    ] VYX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:50:13.262736] [INFO ] [LOCAL     ] VZ: Starting deletion of primary data.
[2025-10-24T21:50:13.315520] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-01.
[2025-10-24T21:50:13.320470] [DEBUG] [LOCAL     ] VZ: Deleted primary data file.
[2025-10-24T21:50:13.320940] [INFO ] [MAIN      ] VZ: Starting full primary refresh.
[2025-10-24T21:50:13.579310] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present.
[2025-10-24T21:50:13.587002] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed.
[2025-10-24T21:50:13.625825] [INFO ] [MAIN      ] VVV: Fetched primary data is valid.
[2025-10-24T21:50:13.654618] [DEBUG] [LOCAL     ] VVV: Saving primary data.
[2025-10-24T21:50:13.693619] [FATAL] [LOCAL     ] VVV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:50:13.713494] [FATAL] [MAIN      ] VVV: Failed to save primary data.
[2025-10-24T21:50:13.716120] [WARN ] [MAIN      ] VVV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:50:13.716538] [INFO ] [LOCAL     ] VVV: Starting deletion of primary data.
[2025-10-24T21:50:13.727278] [DEBUG] [LOCAL     ] VVV: No primary data file found to delete.
[2025-10-24T21:50:13.727388] [INFO ] [LOCAL     ] VVV: Starting deletion of derivative data.
[2025-10-24T21:50:13.743011] [DEBUG] [LOCAL     ] VVV: Deleted derivative data file.
[2025-10-24T21:50:13.761887] [INFO ] [MAIN      ] Update Progress: 2261/2366 symbols completed. VVV took 32.4s. Estimated remaining: 13m 29s. Rate: 7.8 symbols/min
[2025-10-24T21:50:13.870457] [INFO ] [REMOTE    ] VZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:50:13.884380] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-01.
[2025-10-24T21:50:13.985771] [INFO ] [MAIN      ] W: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:50:14.036981] [DEBUG] [LOCAL     ] W: Loaded 53793 existing records from primary storage.
[2025-10-24T21:50:14.037328] [INFO ] [MAIN      ] W: Loaded 53793 existing records.
[2025-10-24T21:50:14.234346] [WARN ] [MAIN      ] W: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:50:14.234716] [INFO ] [MAIN      ] W: Wiping existing primary data before full refresh.
[2025-10-24T21:50:14.234775] [INFO ] [LOCAL     ] W: Starting deletion of primary data.
[2025-10-24T21:50:14.235561] [DEBUG] [LOCAL     ] W: Deleted primary data file.
[2025-10-24T21:50:14.235618] [INFO ] [MAIN      ] W: Starting full primary refresh.
[2025-10-24T21:50:14.390898] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-02 (1.22 seconds).
[2025-10-24T21:50:14.552845] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-03.
[2025-10-24T21:50:14.609558] [INFO ] [REMOTE    ] W: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:50:15.081113] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T21:50:15.347743] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-01.
[2025-10-24T21:50:15.658998] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T21:50:15.819957] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-03 (1.27 seconds).
[2025-10-24T21:50:16.147672] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-04.
[2025-10-24T21:50:16.947680] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-02.
[2025-10-24T21:50:17.175848] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T21:50:17.365187] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-04 (1.22 seconds).
[2025-10-24T21:50:17.747701] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-02.
[2025-10-24T21:50:18.547713] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-05.
[2025-10-24T21:50:18.639009] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-02 (1.69 seconds).
[2025-10-24T21:50:19.347631] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-03.
[2025-10-24T21:50:19.616536] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-02 (1.87 seconds).
[2025-10-24T21:50:19.675023] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-05 (1.13 seconds).
[2025-10-24T21:50:20.147718] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-02.
[2025-10-24T21:50:20.722956] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-03 (1.38 seconds).
[2025-10-24T21:50:20.947635] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-06.
[2025-10-24T21:50:21.747632] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-03.
[2025-10-24T21:50:22.012770] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-06 (1.07 seconds).
[2025-10-24T21:50:22.338431] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-02 (2.19 seconds).
[2025-10-24T21:50:22.547598] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-07.
[2025-10-24T21:50:23.347588] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-04.
[2025-10-24T21:50:23.639852] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-07 (1.09 seconds).
[2025-10-24T21:50:23.890226] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-03 (2.14 seconds).
[2025-10-24T21:50:24.147713] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-08.
[2025-10-24T21:50:24.947635] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-03.
[2025-10-24T21:50:25.044278] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-04 (1.70 seconds).
[2025-10-24T21:50:25.426475] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-08 (1.28 seconds).
[2025-10-24T21:50:25.747713] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-05.
[2025-10-24T21:50:26.547718] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-04.
[2025-10-24T21:50:27.329956] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-03 (2.38 seconds).
[2025-10-24T21:50:27.347632] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-04.
[2025-10-24T21:50:27.414567] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-05 (1.67 seconds).
[2025-10-24T21:50:28.147693] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-06.
[2025-10-24T21:50:28.748380] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-04 (2.20 seconds).
[2025-10-24T21:50:28.947699] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-09.
[2025-10-24T21:50:29.747639] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-05.
[2025-10-24T21:50:29.793830] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-04 (2.45 seconds).
[2025-10-24T21:50:29.834835] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T21:50:29.881395] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-09 (0.93 seconds).
[2025-10-24T21:50:30.547708] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-07.
[2025-10-24T21:50:31.347673] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-05.
[2025-10-24T21:50:31.727269] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-05 (1.98 seconds).
[2025-10-24T21:50:32.147728] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-06.
[2025-10-24T21:50:32.354147] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T21:50:32.947726] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-08.
[2025-10-24T21:50:33.691399] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-05 (2.34 seconds).
[2025-10-24T21:50:33.747599] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-06.
[2025-10-24T21:50:34.042048] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T21:50:34.432058] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T21:50:34.547679] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-09.
[2025-10-24T21:50:35.347709] [INFO ] [REMOTE    ] VVX: Fetching primary data for 2025-10.
[2025-10-24T21:50:35.543189] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-06 (1.80 seconds).
[2025-10-24T21:50:36.158807] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-07.
[2025-10-24T21:50:36.161223] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T21:50:36.409179] [INFO ] [REMOTE    ] VVX: Incremental fetch complete for 2025-10 (1.06 seconds).
[2025-10-24T21:50:36.413533] [INFO ] [REMOTE    ] VVX: Full fetch complete (33072 records).
[2025-10-24T21:50:36.413638] [DEBUG] [VALIDATOR ] VVX: Validating primary data.
[2025-10-24T21:50:36.783234] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present.
[2025-10-24T21:50:36.783361] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed.
[2025-10-24T21:50:36.784197] [INFO ] [MAIN      ] VVX: Fetched primary data is valid.
[2025-10-24T21:50:36.784273] [DEBUG] [LOCAL     ] VVX: Saving primary data.
[2025-10-24T21:50:36.784680] [FATAL] [LOCAL     ] VVX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:50:36.784776] [FATAL] [MAIN      ] VVX: Failed to save primary data.
[2025-10-24T21:50:36.784861] [WARN ] [MAIN      ] VVX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:50:36.784946] [INFO ] [LOCAL     ] VVX: Starting deletion of primary data.
[2025-10-24T21:50:36.785028] [DEBUG] [LOCAL     ] VVX: No primary data file found to delete.
[2025-10-24T21:50:36.785065] [INFO ] [LOCAL     ] VVX: Starting deletion of derivative data.
[2025-10-24T21:50:36.785420] [DEBUG] [LOCAL     ] VVX: Deleted derivative data file.
[2025-10-24T21:50:36.785512] [INFO ] [MAIN      ] Update Progress: 2262/2366 symbols completed. VVX took 27.0s. Estimated remaining: 13m 22s. Rate: 7.8 symbols/min
[2025-10-24T21:50:36.948661] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-07.
[2025-10-24T21:50:36.959021] [INFO ] [MAIN      ] WAB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:50:37.001162] [DEBUG] [LOCAL     ] WAB: Loaded 44111 existing records from primary storage.
[2025-10-24T21:50:37.001483] [INFO ] [MAIN      ] WAB: Loaded 44111 existing records.
[2025-10-24T21:50:37.180686] [WARN ] [MAIN      ] WAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:50:37.180935] [INFO ] [MAIN      ] WAB: Wiping existing primary data before full refresh.
[2025-10-24T21:50:37.180980] [INFO ] [LOCAL     ] WAB: Starting deletion of primary data.
[2025-10-24T21:50:37.181960] [DEBUG] [LOCAL     ] WAB: Deleted primary data file.
[2025-10-24T21:50:37.182018] [INFO ] [MAIN      ] WAB: Starting full primary refresh.
[2025-10-24T21:50:37.566384] [INFO ] [REMOTE    ] WAB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:50:37.747742] [INFO ] [REMOTE    ] VYX: Fetching primary data for 2025-10.
[2025-10-24T21:50:38.000690] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-07 (1.84 seconds).
[2025-10-24T21:50:38.547737] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-01.
[2025-10-24T21:50:39.174836] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-07 (2.23 seconds).
[2025-10-24T21:50:39.302137] [INFO ] [REMOTE    ] VYX: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T21:50:39.310914] [INFO ] [REMOTE    ] VYX: Full fetch complete (70163 records).
[2025-10-24T21:50:39.311048] [DEBUG] [VALIDATOR ] VYX: Validating primary data.
[2025-10-24T21:50:39.356972] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-08.
[2025-10-24T21:50:39.700255] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present.
[2025-10-24T21:50:39.700340] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed.
[2025-10-24T21:50:39.701536] [INFO ] [MAIN      ] VYX: Fetched primary data is valid.
[2025-10-24T21:50:39.701598] [DEBUG] [LOCAL     ] VYX: Saving primary data.
[2025-10-24T21:50:39.702190] [FATAL] [LOCAL     ] VYX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:50:39.702282] [FATAL] [MAIN      ] VYX: Failed to save primary data.
[2025-10-24T21:50:39.702324] [WARN ] [MAIN      ] VYX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:50:39.702359] [INFO ] [LOCAL     ] VYX: Starting deletion of primary data.
[2025-10-24T21:50:39.702409] [DEBUG] [LOCAL     ] VYX: No primary data file found to delete.
[2025-10-24T21:50:39.702443] [INFO ] [LOCAL     ] VYX: Starting deletion of derivative data.
[2025-10-24T21:50:39.702669] [DEBUG] [LOCAL     ] VYX: Deleted derivative data file.
[2025-10-24T21:50:39.702979] [INFO ] [MAIN      ] Update Progress: 2263/2366 symbols completed. VYX took 28.5s. Estimated remaining: 13m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:50:39.877503] [INFO ] [MAIN      ] WAL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:50:39.904441] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T21:50:39.949849] [DEBUG] [LOCAL     ] WAL: Loaded 46034 existing records from primary storage.
[2025-10-24T21:50:39.950185] [INFO ] [MAIN      ] WAL: Loaded 46034 existing records.
[2025-10-24T21:50:40.124423] [WARN ] [MAIN      ] WAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:50:40.124662] [INFO ] [MAIN      ] WAL: Wiping existing primary data before full refresh.
[2025-10-24T21:50:40.124733] [INFO ] [LOCAL     ] WAL: Starting deletion of primary data.
[2025-10-24T21:50:40.125944] [DEBUG] [LOCAL     ] WAL: Deleted primary data file.
[2025-10-24T21:50:40.126000] [INFO ] [MAIN      ] WAL: Starting full primary refresh.
[2025-10-24T21:50:40.156622] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-08.
[2025-10-24T21:50:40.489955] [INFO ] [REMOTE    ] WAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:50:40.947722] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-01.
[2025-10-24T21:50:41.747677] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-02.
[2025-10-24T21:50:41.859962] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-08 (2.50 seconds).
[2025-10-24T21:50:42.193681] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-08 (2.04 seconds).
[2025-10-24T21:50:42.255506] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-01 (1.31 seconds).
[2025-10-24T21:50:42.547724] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-09.
[2025-10-24T21:50:42.986731] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T21:50:43.347633] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-09.
[2025-10-24T21:50:44.147675] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-02.
[2025-10-24T21:50:44.692633] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-09 (2.14 seconds).
[2025-10-24T21:50:44.947674] [INFO ] [REMOTE    ] VZ: Fetching primary data for 2025-10.
[2025-10-24T21:50:45.164964] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-09 (1.82 seconds).
[2025-10-24T21:50:45.252899] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T21:50:45.328916] [INFO ] [REMOTE    ] VZ: Incremental fetch complete for 2025-10 (0.38 seconds).
[2025-10-24T21:50:45.338755] [INFO ] [REMOTE    ] VZ: Full fetch complete (77971 records).
[2025-10-24T21:50:45.338901] [DEBUG] [VALIDATOR ] VZ: Validating primary data.
[2025-10-24T21:50:45.728781] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present.
[2025-10-24T21:50:45.728874] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed.
[2025-10-24T21:50:45.730090] [INFO ] [MAIN      ] VZ: Fetched primary data is valid.
[2025-10-24T21:50:45.730152] [DEBUG] [LOCAL     ] VZ: Saving primary data.
[2025-10-24T21:50:45.730799] [FATAL] [LOCAL     ] VZ: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:50:45.730889] [FATAL] [MAIN      ] VZ: Failed to save primary data.
[2025-10-24T21:50:45.730931] [WARN ] [MAIN      ] VZ: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:50:45.730969] [INFO ] [LOCAL     ] VZ: Starting deletion of primary data.
[2025-10-24T21:50:45.731022] [DEBUG] [LOCAL     ] VZ: No primary data file found to delete.
[2025-10-24T21:50:45.731058] [INFO ] [LOCAL     ] VZ: Starting deletion of derivative data.
[2025-10-24T21:50:45.731217] [DEBUG] [LOCAL     ] VZ: Deleted derivative data file.
[2025-10-24T21:50:45.731482] [INFO ] [MAIN      ] Update Progress: 2264/2366 symbols completed. VZ took 33.8s. Estimated remaining: 13m 6s. Rate: 7.8 symbols/min
[2025-10-24T21:50:45.752813] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-03.
[2025-10-24T21:50:45.925360] [INFO ] [MAIN      ] WAT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:50:45.959682] [DEBUG] [LOCAL     ] WAT: Loaded 35962 existing records from primary storage.
[2025-10-24T21:50:45.959960] [INFO ] [MAIN      ] WAT: Loaded 35962 existing records.
[2025-10-24T21:50:46.132915] [WARN ] [MAIN      ] WAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:50:46.133125] [INFO ] [MAIN      ] WAT: Wiping existing primary data before full refresh.
[2025-10-24T21:50:46.133171] [INFO ] [LOCAL     ] WAT: Starting deletion of primary data.
[2025-10-24T21:50:46.133951] [DEBUG] [LOCAL     ] WAT: Deleted primary data file.
[2025-10-24T21:50:46.134032] [INFO ] [MAIN      ] WAT: Starting full primary refresh.
[2025-10-24T21:50:46.487011] [INFO ] [REMOTE    ] WAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:50:46.547603] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-01.
[2025-10-24T21:50:47.347636] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-03.
[2025-10-24T21:50:47.593563] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T21:50:47.895330] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T21:50:48.147677] [INFO ] [REMOTE    ] W: Fetching primary data for 2025-10.
[2025-10-24T21:50:48.750119] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-03 (1.40 seconds).
[2025-10-24T21:50:48.947715] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-04.
[2025-10-24T21:50:49.747691] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-04.
[2025-10-24T21:50:50.018350] [INFO ] [REMOTE    ] W: Incremental fetch complete for 2025-10 (1.87 seconds).
[2025-10-24T21:50:50.028220] [INFO ] [REMOTE    ] W: Full fetch complete (77506 records).
[2025-10-24T21:50:50.028393] [DEBUG] [VALIDATOR ] W: Validating primary data.
[2025-10-24T21:50:50.426404] [DEBUG] [VALIDATOR ] W: All expected trading days are present.
[2025-10-24T21:50:50.426582] [DEBUG] [VALIDATOR ] W: Primary data validation passed.
[2025-10-24T21:50:50.427940] [INFO ] [MAIN      ] W: Fetched primary data is valid.
[2025-10-24T21:50:50.428102] [DEBUG] [LOCAL     ] W: Saving primary data.
[2025-10-24T21:50:50.428882] [FATAL] [LOCAL     ] W: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:50:50.428977] [FATAL] [MAIN      ] W: Failed to save primary data.
[2025-10-24T21:50:50.429020] [WARN ] [MAIN      ] W: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:50:50.429084] [INFO ] [LOCAL     ] W: Starting deletion of primary data.
[2025-10-24T21:50:50.429174] [DEBUG] [LOCAL     ] W: No primary data file found to delete.
[2025-10-24T21:50:50.429220] [INFO ] [LOCAL     ] W: Starting deletion of derivative data.
[2025-10-24T21:50:50.429402] [DEBUG] [LOCAL     ] W: Deleted derivative data file.
[2025-10-24T21:50:50.429981] [INFO ] [MAIN      ] Update Progress: 2265/2366 symbols completed. W took 36.7s. Estimated remaining: 12m 58s. Rate: 7.8 symbols/min
[2025-10-24T21:50:50.552759] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-02.
[2025-10-24T21:50:50.604806] [INFO ] [MAIN      ] WBI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:50:50.605134] [DEBUG] [LOCAL     ] WBI: No existing data file found in primary storage.
[2025-10-24T21:50:50.605305] [WARN ] [MAIN      ] WBI: No existing data found, performing full refresh instead.
[2025-10-24T21:50:50.605505] [INFO ] [MAIN      ] WBI: Wiping existing primary data before full refresh.
[2025-10-24T21:50:50.605726] [INFO ] [LOCAL     ] WBI: Starting deletion of primary data.
[2025-10-24T21:50:50.605794] [DEBUG] [LOCAL     ] WBI: No primary data file found to delete.
[2025-10-24T21:50:50.605894] [INFO ] [MAIN      ] WBI: Starting full primary refresh.
[2025-10-24T21:50:50.954418] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T21:50:51.024064] [INFO ] [REMOTE    ] WBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:50:51.055701] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-04 (1.31 seconds).
[2025-10-24T21:50:51.347700] [INFO ] [REMOTE    ] WBI: Fetching primary data for 2025-01.
[2025-10-24T21:50:51.570314] [DEBUG] [REMOTE    ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:50:51.570712] [WARN ] [REMOTE    ] WBI: No data returned for month 2025-01
[2025-10-24T21:50:51.570824] [FATAL] [REMOTE    ] WBI: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:50:51.570882] [FATAL] [MAIN      ] WBI: Failed to fetch primary data.
[2025-10-24T21:50:51.570954] [WARN ] [MAIN      ] WBI: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:50:51.571062] [INFO ] [LOCAL     ] WBI: Starting deletion of primary data.
[2025-10-24T21:50:51.571142] [DEBUG] [LOCAL     ] WBI: No primary data file found to delete.
[2025-10-24T21:50:51.571215] [INFO ] [LOCAL     ] WBI: Starting deletion of derivative data.
[2025-10-24T21:50:51.571283] [DEBUG] [LOCAL     ] WBI: No derivative data file found to delete.
[2025-10-24T21:50:51.571349] [INFO ] [MAIN      ] Update Progress: 2266/2366 symbols completed. WBI took 1.1s. Estimated remaining: 12m 50s. Rate: 7.8 symbols/min
[2025-10-24T21:50:51.753228] [INFO ] [MAIN      ] WBS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:50:51.799330] [DEBUG] [LOCAL     ] WBS: Loaded 49206 existing records from primary storage.
[2025-10-24T21:50:51.799701] [INFO ] [MAIN      ] WBS: Loaded 49206 existing records.
[2025-10-24T21:50:51.983025] [WARN ] [MAIN      ] WBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:50:51.983261] [INFO ] [MAIN      ] WBS: Wiping existing primary data before full refresh.
[2025-10-24T21:50:51.983320] [INFO ] [LOCAL     ] WBS: Starting deletion of primary data.
[2025-10-24T21:50:51.983802] [DEBUG] [LOCAL     ] WBS: Deleted primary data file.
[2025-10-24T21:50:51.983859] [INFO ] [MAIN      ] WBS: Starting full primary refresh.
[2025-10-24T21:50:52.148285] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-05.
[2025-10-24T21:50:52.377889] [INFO ] [REMOTE    ] WBS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:50:52.379928] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-02 (1.83 seconds).
[2025-10-24T21:50:52.947740] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-01.
[2025-10-24T21:50:53.747722] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-05.
[2025-10-24T21:50:53.805536] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T21:50:54.533879] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T21:50:54.547599] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-02.
[2025-10-24T21:50:55.312004] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T21:50:55.347724] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-06.
[2025-10-24T21:50:55.696580] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-02 (1.15 seconds).
[2025-10-24T21:50:56.147738] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-03.
[2025-10-24T21:50:56.848753] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-06 (1.50 seconds).
[2025-10-24T21:50:56.947697] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-07.
[2025-10-24T21:50:57.747706] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-03.
[2025-10-24T21:50:57.880906] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-03 (1.73 seconds).
[2025-10-24T21:50:58.547729] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-04.
[2025-10-24T21:50:58.683283] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T21:50:58.852989] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-03 (1.11 seconds).
[2025-10-24T21:50:59.347726] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-06.
[2025-10-24T21:51:00.147696] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-04.
[2025-10-24T21:51:00.283153] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T21:51:00.809558] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T21:51:00.947630] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-07.
[2025-10-24T21:51:01.405804] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-04 (1.26 seconds).
[2025-10-24T21:51:01.747732] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-05.
[2025-10-24T21:51:02.547725] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-05.
[2025-10-24T21:51:02.694368] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-07 (1.75 seconds).
[2025-10-24T21:51:03.201225] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T21:51:03.347701] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-06.
[2025-10-24T21:51:04.147714] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-08.
[2025-10-24T21:51:04.193493] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-05 (1.65 seconds).
[2025-10-24T21:51:04.692892] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-06 (1.35 seconds).
[2025-10-24T21:51:04.947688] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-07.
[2025-10-24T21:51:05.700816] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T21:51:05.747627] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-09.
[2025-10-24T21:51:06.547748] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-08.
[2025-10-24T21:51:06.651638] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T21:51:06.961727] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-09 (1.21 seconds).
[2025-10-24T21:51:07.347728] [INFO ] [REMOTE    ] WAB: Fetching primary data for 2025-10.
[2025-10-24T21:51:08.050961] [INFO ] [REMOTE    ] WAB: Incremental fetch complete for 2025-10 (0.70 seconds).
[2025-10-24T21:51:08.058992] [INFO ] [REMOTE    ] WAB: Full fetch complete (64396 records).
[2025-10-24T21:51:08.059121] [DEBUG] [VALIDATOR ] WAB: Validating primary data.
[2025-10-24T21:51:08.151318] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-06.
[2025-10-24T21:51:08.462538] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T21:51:08.492029] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present.
[2025-10-24T21:51:08.492233] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed.
[2025-10-24T21:51:08.494146] [INFO ] [MAIN      ] WAB: Fetched primary data is valid.
[2025-10-24T21:51:08.494229] [DEBUG] [LOCAL     ] WAB: Saving primary data.
[2025-10-24T21:51:08.495115] [FATAL] [LOCAL     ] WAB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:51:08.495212] [FATAL] [MAIN      ] WAB: Failed to save primary data.
[2025-10-24T21:51:08.495285] [WARN ] [MAIN      ] WAB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:51:08.495373] [INFO ] [LOCAL     ] WAB: Starting deletion of primary data.
[2025-10-24T21:51:08.495455] [DEBUG] [LOCAL     ] WAB: No primary data file found to delete.
[2025-10-24T21:51:08.495493] [INFO ] [LOCAL     ] WAB: Starting deletion of derivative data.
[2025-10-24T21:51:08.495715] [DEBUG] [LOCAL     ] WAB: Deleted derivative data file.
[2025-10-24T21:51:08.496106] [INFO ] [MAIN      ] Update Progress: 2267/2366 symbols completed. WAB took 31.7s. Estimated remaining: 12m 43s. Rate: 7.8 symbols/min
[2025-10-24T21:51:08.663395] [INFO ] [MAIN      ] WBX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:51:08.675178] [DEBUG] [LOCAL     ] WBX: Loaded 9989 existing records from primary storage.
[2025-10-24T21:51:08.675418] [INFO ] [MAIN      ] WBX: Loaded 9989 existing records.
[2025-10-24T21:51:08.849267] [WARN ] [MAIN      ] WBX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:51:08.849532] [INFO ] [MAIN      ] WBX: Wiping existing primary data before full refresh.
[2025-10-24T21:51:08.849583] [INFO ] [LOCAL     ] WBX: Starting deletion of primary data.
[2025-10-24T21:51:08.849830] [DEBUG] [LOCAL     ] WBX: Deleted primary data file.
[2025-10-24T21:51:08.849887] [INFO ] [MAIN      ] WBX: Starting full primary refresh.
[2025-10-24T21:51:08.949198] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-08.
[2025-10-24T21:51:09.198261] [INFO ] [REMOTE    ] WBX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:51:09.738129] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T21:51:09.752542] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-09.
[2025-10-24T21:51:10.433935] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T21:51:10.547668] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-07.
[2025-10-24T21:51:11.352726] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-01.
[2025-10-24T21:51:11.370060] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-09 (1.62 seconds).
[2025-10-24T21:51:12.147725] [INFO ] [REMOTE    ] WAL: Fetching primary data for 2025-10.
[2025-10-24T21:51:12.226098] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T21:51:12.617028] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-01 (1.26 seconds).
[2025-10-24T21:51:12.947713] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-09.
[2025-10-24T21:51:13.654918] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-09 (0.71 seconds).
[2025-10-24T21:51:13.747734] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-02.
[2025-10-24T21:51:13.898818] [INFO ] [REMOTE    ] WAL: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T21:51:13.907833] [INFO ] [REMOTE    ] WAL: Full fetch complete (67339 records).
[2025-10-24T21:51:13.907993] [DEBUG] [VALIDATOR ] WAL: Validating primary data.
[2025-10-24T21:51:14.297042] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present.
[2025-10-24T21:51:14.297122] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed.
[2025-10-24T21:51:14.298294] [INFO ] [MAIN      ] WAL: Fetched primary data is valid.
[2025-10-24T21:51:14.298357] [DEBUG] [LOCAL     ] WAL: Saving primary data.
[2025-10-24T21:51:14.298988] [FATAL] [LOCAL     ] WAL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:51:14.299078] [FATAL] [MAIN      ] WAL: Failed to save primary data.
[2025-10-24T21:51:14.299120] [WARN ] [MAIN      ] WAL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:51:14.299156] [INFO ] [LOCAL     ] WAL: Starting deletion of primary data.
[2025-10-24T21:51:14.299208] [DEBUG] [LOCAL     ] WAL: No primary data file found to delete.
[2025-10-24T21:51:14.299243] [INFO ] [LOCAL     ] WAL: Starting deletion of derivative data.
[2025-10-24T21:51:14.299406] [DEBUG] [LOCAL     ] WAL: Deleted derivative data file.
[2025-10-24T21:51:14.299504] [INFO ] [MAIN      ] Update Progress: 2268/2366 symbols completed. WAL took 34.6s. Estimated remaining: 12m 35s. Rate: 7.8 symbols/min
[2025-10-24T21:51:14.466525] [INFO ] [MAIN      ] WCC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:51:14.503312] [DEBUG] [LOCAL     ] WCC: Loaded 38640 existing records from primary storage.
[2025-10-24T21:51:14.503587] [INFO ] [MAIN      ] WCC: Loaded 38640 existing records.
[2025-10-24T21:51:14.558906] [INFO ] [REMOTE    ] WAT: Fetching primary data for 2025-10.
[2025-10-24T21:51:14.686455] [WARN ] [MAIN      ] WCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:51:14.686681] [INFO ] [MAIN      ] WCC: Wiping existing primary data before full refresh.
[2025-10-24T21:51:14.686744] [INFO ] [LOCAL     ] WCC: Starting deletion of primary data.
[2025-10-24T21:51:14.687462] [DEBUG] [LOCAL     ] WCC: Deleted primary data file.
[2025-10-24T21:51:14.687520] [INFO ] [MAIN      ] WCC: Starting full primary refresh.
[2025-10-24T21:51:15.058073] [INFO ] [REMOTE    ] WCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:51:15.073965] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T21:51:15.271536] [INFO ] [REMOTE    ] WAT: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T21:51:15.279136] [INFO ] [REMOTE    ] WAT: Full fetch complete (50937 records).
[2025-10-24T21:51:15.279267] [DEBUG] [VALIDATOR ] WAT: Validating primary data.
[2025-10-24T21:51:15.352870] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-08.
[2025-10-24T21:51:15.681120] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present.
[2025-10-24T21:51:15.681201] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed.
[2025-10-24T21:51:15.682190] [INFO ] [MAIN      ] WAT: Fetched primary data is valid.
[2025-10-24T21:51:15.682290] [DEBUG] [LOCAL     ] WAT: Saving primary data.
[2025-10-24T21:51:15.682753] [FATAL] [LOCAL     ] WAT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:51:15.682818] [FATAL] [MAIN      ] WAT: Failed to save primary data.
[2025-10-24T21:51:15.682854] [WARN ] [MAIN      ] WAT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:51:15.682886] [INFO ] [LOCAL     ] WAT: Starting deletion of primary data.
[2025-10-24T21:51:15.682936] [DEBUG] [LOCAL     ] WAT: No primary data file found to delete.
[2025-10-24T21:51:15.682970] [INFO ] [LOCAL     ] WAT: Starting deletion of derivative data.
[2025-10-24T21:51:15.683138] [DEBUG] [LOCAL     ] WAT: Deleted derivative data file.
[2025-10-24T21:51:15.683235] [INFO ] [MAIN      ] Update Progress: 2269/2366 symbols completed. WAT took 30.0s. Estimated remaining: 12m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:51:15.849714] [INFO ] [MAIN      ] WCN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:51:15.894557] [DEBUG] [LOCAL     ] WCN: Loaded 48248 existing records from primary storage.
[2025-10-24T21:51:15.894884] [INFO ] [MAIN      ] WCN: Loaded 48248 existing records.
[2025-10-24T21:51:16.076112] [WARN ] [MAIN      ] WCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:51:16.076363] [INFO ] [MAIN      ] WCN: Wiping existing primary data before full refresh.
[2025-10-24T21:51:16.076410] [INFO ] [LOCAL     ] WCN: Starting deletion of primary data.
[2025-10-24T21:51:16.077159] [DEBUG] [LOCAL     ] WCN: Deleted primary data file.
[2025-10-24T21:51:16.077218] [INFO ] [MAIN      ] WCN: Starting full primary refresh.
[2025-10-24T21:51:16.147772] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-01.
[2025-10-24T21:51:16.439903] [INFO ] [REMOTE    ] WCN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:51:16.947674] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-03.
[2025-10-24T21:51:17.094604] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-08 (1.74 seconds).
[2025-10-24T21:51:17.747708] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-09.
[2025-10-24T21:51:17.851116] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T21:51:18.190475] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-03 (1.24 seconds).
[2025-10-24T21:51:18.547691] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-01.
[2025-10-24T21:51:19.347691] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-04.
[2025-10-24T21:51:19.428793] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-09 (1.68 seconds).
[2025-10-24T21:51:20.087290] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T21:51:20.147602] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-02.
[2025-10-24T21:51:20.361631] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-04 (1.01 seconds).
[2025-10-24T21:51:20.947733] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-02.
[2025-10-24T21:51:21.747687] [INFO ] [REMOTE    ] WBS: Fetching primary data for 2025-10.
[2025-10-24T21:51:21.887135] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T21:51:22.378554] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T21:51:22.547724] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-05.
[2025-10-24T21:51:23.061303] [INFO ] [REMOTE    ] WBS: Incremental fetch complete for 2025-10 (1.31 seconds).
[2025-10-24T21:51:23.070518] [INFO ] [REMOTE    ] WBS: Full fetch complete (70399 records).
[2025-10-24T21:51:23.070639] [DEBUG] [VALIDATOR ] WBS: Validating primary data.
[2025-10-24T21:51:23.354269] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-03.
[2025-10-24T21:51:23.457574] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present.
[2025-10-24T21:51:23.457713] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed.
[2025-10-24T21:51:23.458981] [INFO ] [MAIN      ] WBS: Fetched primary data is valid.
[2025-10-24T21:51:23.459163] [DEBUG] [LOCAL     ] WBS: Saving primary data.
[2025-10-24T21:51:23.459787] [FATAL] [LOCAL     ] WBS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:51:23.459878] [FATAL] [MAIN      ] WBS: Failed to save primary data.
[2025-10-24T21:51:23.459922] [WARN ] [MAIN      ] WBS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:51:23.459957] [INFO ] [LOCAL     ] WBS: Starting deletion of primary data.
[2025-10-24T21:51:23.460009] [DEBUG] [LOCAL     ] WBS: No primary data file found to delete.
[2025-10-24T21:51:23.460043] [INFO ] [LOCAL     ] WBS: Starting deletion of derivative data.
[2025-10-24T21:51:23.460209] [DEBUG] [LOCAL     ] WBS: Deleted derivative data file.
[2025-10-24T21:51:23.460887] [INFO ] [MAIN      ] Update Progress: 2270/2366 symbols completed. WBS took 31.9s. Estimated remaining: 12m 19s. Rate: 7.8 symbols/min
[2025-10-24T21:51:23.633125] [INFO ] [MAIN      ] WD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:51:23.643260] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-05 (1.10 seconds).
[2025-10-24T21:51:23.668059] [DEBUG] [LOCAL     ] WD: Loaded 22618 existing records from primary storage.
[2025-10-24T21:51:23.668313] [INFO ] [MAIN      ] WD: Loaded 22618 existing records.
[2025-10-24T21:51:23.841036] [WARN ] [MAIN      ] WD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:51:23.841221] [INFO ] [MAIN      ] WD: Wiping existing primary data before full refresh.
[2025-10-24T21:51:23.841267] [INFO ] [LOCAL     ] WD: Starting deletion of primary data.
[2025-10-24T21:51:23.841933] [DEBUG] [LOCAL     ] WD: Deleted primary data file.
[2025-10-24T21:51:23.841989] [INFO ] [MAIN      ] WD: Starting full primary refresh.
[2025-10-24T21:51:24.152908] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-06.
[2025-10-24T21:51:24.189422] [INFO ] [REMOTE    ] WD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:51:24.835566] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T21:51:24.947699] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-01.
[2025-10-24T21:51:25.278268] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T21:51:25.747701] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-03.
[2025-10-24T21:51:26.052572] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-01 (1.10 seconds).
[2025-10-24T21:51:26.547726] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-04.
[2025-10-24T21:51:27.347711] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-02.
[2025-10-24T21:51:27.413586] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T21:51:28.147714] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-04.
[2025-10-24T21:51:28.367707] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T21:51:28.590735] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T21:51:28.947680] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-07.
[2025-10-24T21:51:29.637932] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-07 (0.69 seconds).
[2025-10-24T21:51:29.747745] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-05.
[2025-10-24T21:51:29.895129] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T21:51:30.547726] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-05.
[2025-10-24T21:51:31.352799] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-03.
[2025-10-24T21:51:31.368371] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-05 (1.62 seconds).
[2025-10-24T21:51:31.995757] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-05 (1.45 seconds).
[2025-10-24T21:51:32.147703] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-08.
[2025-10-24T21:51:32.564010] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T21:51:32.776542] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-08 (0.63 seconds).
[2025-10-24T21:51:32.947746] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-06.
[2025-10-24T21:51:33.747730] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-09.
[2025-10-24T21:51:34.364676] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-09 (0.62 seconds).
[2025-10-24T21:51:34.405073] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T21:51:34.547697] [INFO ] [REMOTE    ] WBX: Fetching primary data for 2025-10.
[2025-10-24T21:51:35.295888] [INFO ] [REMOTE    ] WBX: Incremental fetch complete for 2025-10 (0.75 seconds).
[2025-10-24T21:51:35.298361] [INFO ] [REMOTE    ] WBX: Full fetch complete (21129 records).
[2025-10-24T21:51:35.298445] [DEBUG] [VALIDATOR ] WBX: Validating primary data.
[2025-10-24T21:51:35.352927] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-06.
[2025-10-24T21:51:35.661787] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present.
[2025-10-24T21:51:35.661885] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed.
[2025-10-24T21:51:35.662354] [INFO ] [MAIN      ] WBX: Fetched primary data is valid.
[2025-10-24T21:51:35.662394] [DEBUG] [LOCAL     ] WBX: Saving primary data.
[2025-10-24T21:51:35.662674] [FATAL] [LOCAL     ] WBX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:51:35.662758] [FATAL] [MAIN      ] WBX: Failed to save primary data.
[2025-10-24T21:51:35.662809] [WARN ] [MAIN      ] WBX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:51:35.662871] [INFO ] [LOCAL     ] WBX: Starting deletion of primary data.
[2025-10-24T21:51:35.662923] [DEBUG] [LOCAL     ] WBX: No primary data file found to delete.
[2025-10-24T21:51:35.662957] [INFO ] [LOCAL     ] WBX: Starting deletion of derivative data.
[2025-10-24T21:51:35.663116] [DEBUG] [LOCAL     ] WBX: Deleted derivative data file.
[2025-10-24T21:51:35.663204] [INFO ] [MAIN      ] Update Progress: 2271/2366 symbols completed. WBX took 27.2s. Estimated remaining: 12m 12s. Rate: 7.8 symbols/min
[2025-10-24T21:51:35.826514] [INFO ] [MAIN      ] WDH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:51:35.845297] [DEBUG] [LOCAL     ] WDH: Loaded 18142 existing records from primary storage.
[2025-10-24T21:51:35.845547] [INFO ] [MAIN      ] WDH: Loaded 18142 existing records.
[2025-10-24T21:51:36.017111] [WARN ] [MAIN      ] WDH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:51:36.017344] [INFO ] [MAIN      ] WDH: Wiping existing primary data before full refresh.
[2025-10-24T21:51:36.017391] [INFO ] [LOCAL     ] WDH: Starting deletion of primary data.
[2025-10-24T21:51:36.017798] [DEBUG] [LOCAL     ] WDH: Deleted primary data file.
[2025-10-24T21:51:36.017854] [INFO ] [MAIN      ] WDH: Starting full primary refresh.
[2025-10-24T21:51:36.152904] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-07.
[2025-10-24T21:51:36.371608] [INFO ] [REMOTE    ] WDH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:51:36.840930] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T21:51:36.947675] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-07.
[2025-10-24T21:51:37.747672] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-04.
[2025-10-24T21:51:37.915541] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-07 (1.76 seconds).
[2025-10-24T21:51:38.412770] [INFO ] [REMOTE    ] WCC: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T21:51:38.547719] [INFO ] [REMOTE    ] WCC: Fetching primary data for 2025-08.
[2025-10-24T21:51:38.651005] [DEBUG] [REMOTE    ] WCC: Error fetching primary data for 2025-08: 'API call returned an empty response.'
[2025-10-24T21:51:38.651507] [WARN ] [REMOTE    ] WCC: No data returned for month 2025-08
[2025-10-24T21:51:38.651626] [FATAL] [REMOTE    ] WCC: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:51:38.651789] [FATAL] [MAIN      ] WCC: Failed to fetch primary data.
[2025-10-24T21:51:38.651875] [WARN ] [MAIN      ] WCC: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:51:38.651965] [INFO ] [LOCAL     ] WCC: Starting deletion of primary data.
[2025-10-24T21:51:38.652056] [DEBUG] [LOCAL     ] WCC: No primary data file found to delete.
[2025-10-24T21:51:38.652122] [INFO ] [LOCAL     ] WCC: Starting deletion of derivative data.
[2025-10-24T21:51:38.652519] [DEBUG] [LOCAL     ] WCC: Deleted derivative data file.
[2025-10-24T21:51:38.652823] [INFO ] [MAIN      ] Update Progress: 2272/2366 symbols completed. WCC took 24.4s. Estimated remaining: 12m 4s. Rate: 7.8 symbols/min
[2025-10-24T21:51:38.835581] [INFO ] [MAIN      ] WDI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:51:38.855976] [DEBUG] [LOCAL     ] WDI: Loaded 21400 existing records from primary storage.
[2025-10-24T21:51:38.856253] [INFO ] [MAIN      ] WDI: Loaded 21400 existing records.
[2025-10-24T21:51:39.045339] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T21:51:39.048943] [WARN ] [MAIN      ] WDI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:51:39.054085] [INFO ] [MAIN      ] WDI: Wiping existing primary data before full refresh.
[2025-10-24T21:51:39.054517] [INFO ] [LOCAL     ] WDI: Starting deletion of primary data.
[2025-10-24T21:51:39.055263] [DEBUG] [LOCAL     ] WDI: Deleted primary data file.
[2025-10-24T21:51:39.055320] [INFO ] [MAIN      ] WDI: Starting full primary refresh.
[2025-10-24T21:51:39.352735] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-05.
[2025-10-24T21:51:39.415171] [INFO ] [REMOTE    ] WDI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:51:40.149036] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-01.
[2025-10-24T21:51:40.490435] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-05 (1.14 seconds).
[2025-10-24T21:51:40.763239] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-01 (0.61 seconds).
[2025-10-24T21:51:40.947696] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-02.
[2025-10-24T21:51:41.747632] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-01.
[2025-10-24T21:51:41.929353] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-02 (0.98 seconds).
[2025-10-24T21:51:42.547683] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-06.
[2025-10-24T21:51:42.560630] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T21:51:43.347692] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-03.
[2025-10-24T21:51:43.668822] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T21:51:44.097685] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-03 (0.75 seconds).
[2025-10-24T21:51:44.147697] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-04.
[2025-10-24T21:51:44.947692] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-07.
[2025-10-24T21:51:45.304264] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-04 (1.16 seconds).
[2025-10-24T21:51:45.747686] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-05.
[2025-10-24T21:51:45.826776] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-07 (0.88 seconds).
[2025-10-24T21:51:46.547720] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-08.
[2025-10-24T21:51:46.577528] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T21:51:47.347685] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-08.
[2025-10-24T21:51:47.614230] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-08 (1.07 seconds).
[2025-10-24T21:51:48.147715] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-09.
[2025-10-24T21:51:48.784739] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-08 (1.44 seconds).
[2025-10-24T21:51:48.947710] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-09.
[2025-10-24T21:51:49.222720] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-09 (1.07 seconds).
[2025-10-24T21:51:49.747723] [INFO ] [REMOTE    ] WD: Fetching primary data for 2025-10.
[2025-10-24T21:51:50.558358] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-02.
[2025-10-24T21:51:50.591091] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T21:51:50.623629] [INFO ] [REMOTE    ] WD: Incremental fetch complete for 2025-10 (0.88 seconds).
[2025-10-24T21:51:50.627079] [INFO ] [REMOTE    ] WD: Full fetch complete (32966 records).
[2025-10-24T21:51:50.627164] [DEBUG] [VALIDATOR ] WD: Validating primary data.
[2025-10-24T21:51:50.989179] [DEBUG] [VALIDATOR ] WD: All expected trading days are present.
[2025-10-24T21:51:50.989256] [DEBUG] [VALIDATOR ] WD: Primary data validation passed.
[2025-10-24T21:51:50.989954] [INFO ] [MAIN      ] WD: Fetched primary data is valid.
[2025-10-24T21:51:50.990028] [DEBUG] [LOCAL     ] WD: Saving primary data.
[2025-10-24T21:51:50.990404] [FATAL] [LOCAL     ] WD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:51:50.990487] [FATAL] [MAIN      ] WD: Failed to save primary data.
[2025-10-24T21:51:50.990529] [WARN ] [MAIN      ] WD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:51:50.990563] [INFO ] [LOCAL     ] WD: Starting deletion of primary data.
[2025-10-24T21:51:50.990613] [DEBUG] [LOCAL     ] WD: No primary data file found to delete.
[2025-10-24T21:51:50.990672] [INFO ] [LOCAL     ] WD: Starting deletion of derivative data.
[2025-10-24T21:51:50.990879] [DEBUG] [LOCAL     ] WD: Deleted derivative data file.
[2025-10-24T21:51:50.990970] [INFO ] [MAIN      ] Update Progress: 2273/2366 symbols completed. WD took 27.5s. Estimated remaining: 11m 56s. Rate: 7.8 symbols/min
[2025-10-24T21:51:51.159912] [INFO ] [MAIN      ] WDS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:51:51.202147] [DEBUG] [LOCAL     ] WDS: Loaded 43353 existing records from primary storage.
[2025-10-24T21:51:51.202451] [INFO ] [MAIN      ] WDS: Loaded 43353 existing records.
[2025-10-24T21:51:51.356427] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-06.
[2025-10-24T21:51:51.404133] [WARN ] [MAIN      ] WDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:51:51.414346] [INFO ] [MAIN      ] WDS: Wiping existing primary data before full refresh.
[2025-10-24T21:51:51.415514] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-02 (0.86 seconds).
[2025-10-24T21:51:51.415576] [INFO ] [LOCAL     ] WDS: Starting deletion of primary data.
[2025-10-24T21:51:51.421370] [DEBUG] [LOCAL     ] WDS: Deleted primary data file.
[2025-10-24T21:51:51.421460] [INFO ] [MAIN      ] WDS: Starting full primary refresh.
[2025-10-24T21:51:51.898955] [INFO ] [REMOTE    ] WDS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:51:52.147746] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-01.
[2025-10-24T21:51:52.511055] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T21:51:52.947741] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-03.
[2025-10-24T21:51:53.397143] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-01 (1.25 seconds).
[2025-10-24T21:51:53.747713] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-02.
[2025-10-24T21:51:53.870263] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-03 (0.92 seconds).
[2025-10-24T21:51:54.547749] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-04.
[2025-10-24T21:51:55.347705] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-07.
[2025-10-24T21:51:56.147721] [INFO ] [REMOTE    ] WCN: Fetching primary data for 2025-10.
[2025-10-24T21:51:56.339267] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-07 (0.99 seconds).
[2025-10-24T21:51:56.947697] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-08.
[2025-10-24T21:51:57.307023] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-02 (3.56 seconds).
[2025-10-24T21:51:57.747682] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-03.
[2025-10-24T21:51:57.904001] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-04 (3.36 seconds).
[2025-10-24T21:51:57.906114] [INFO ] [REMOTE    ] WCN: Incremental fetch complete for 2025-10 (1.76 seconds).
[2025-10-24T21:51:57.920237] [INFO ] [REMOTE    ] WCN: Full fetch complete (69455 records).
[2025-10-24T21:51:57.920420] [DEBUG] [VALIDATOR ] WCN: Validating primary data.
[2025-10-24T21:51:58.071406] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-08 (1.12 seconds).
[2025-10-24T21:51:58.340838] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present.
[2025-10-24T21:51:58.340918] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed.
[2025-10-24T21:51:58.341950] [INFO ] [MAIN      ] WCN: Fetched primary data is valid.
[2025-10-24T21:51:58.342013] [DEBUG] [LOCAL     ] WCN: Saving primary data.
[2025-10-24T21:51:58.342539] [FATAL] [LOCAL     ] WCN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:51:58.342628] [FATAL] [MAIN      ] WCN: Failed to save primary data.
[2025-10-24T21:51:58.342708] [WARN ] [MAIN      ] WCN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:51:58.342776] [INFO ] [LOCAL     ] WCN: Starting deletion of primary data.
[2025-10-24T21:51:58.342836] [DEBUG] [LOCAL     ] WCN: No primary data file found to delete.
[2025-10-24T21:51:58.342873] [INFO ] [LOCAL     ] WCN: Starting deletion of derivative data.
[2025-10-24T21:51:58.343084] [DEBUG] [LOCAL     ] WCN: Deleted derivative data file.
[2025-10-24T21:51:58.343381] [INFO ] [MAIN      ] Update Progress: 2274/2366 symbols completed. WCN took 42.7s. Estimated remaining: 11m 49s. Rate: 7.8 symbols/min
[2025-10-24T21:51:58.506952] [INFO ] [MAIN      ] WEA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:51:58.516710] [DEBUG] [LOCAL     ] WEA: Loaded 7912 existing records from primary storage.
[2025-10-24T21:51:58.516940] [INFO ] [MAIN      ] WEA: Loaded 7912 existing records.
[2025-10-24T21:51:58.552816] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-05.
[2025-10-24T21:51:58.692432] [WARN ] [MAIN      ] WEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:51:58.692638] [INFO ] [MAIN      ] WEA: Wiping existing primary data before full refresh.
[2025-10-24T21:51:58.692719] [INFO ] [LOCAL     ] WEA: Starting deletion of primary data.
[2025-10-24T21:51:58.692964] [DEBUG] [LOCAL     ] WEA: Deleted primary data file.
[2025-10-24T21:51:58.693005] [INFO ] [MAIN      ] WEA: Starting full primary refresh.
[2025-10-24T21:51:59.041093] [INFO ] [REMOTE    ] WEA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:51:59.350595] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-01.
[2025-10-24T21:51:59.375637] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-05 (0.82 seconds).
[2025-10-24T21:51:59.374822] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T21:52:00.026402] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-01 (0.68 seconds).
[2025-10-24T21:52:00.147639] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-02.
[2025-10-24T21:52:00.762123] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T21:52:00.947700] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-09.
[2025-10-24T21:52:01.747755] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-06.
[2025-10-24T21:52:02.043629] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-09 (1.10 seconds).
[2025-10-24T21:52:02.547709] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-04.
[2025-10-24T21:52:02.895518] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-06 (1.15 seconds).
[2025-10-24T21:52:03.347695] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-07.
[2025-10-24T21:52:03.741297] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-04 (1.19 seconds).
[2025-10-24T21:52:04.147701] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-03.
[2025-10-24T21:52:04.541712] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-07 (1.19 seconds).
[2025-10-24T21:52:04.729509] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-03 (0.58 seconds).
[2025-10-24T21:52:04.947694] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-04.
[2025-10-24T21:52:05.639874] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-04 (0.69 seconds).
[2025-10-24T21:52:05.747720] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-05.
[2025-10-24T21:52:06.547698] [INFO ] [REMOTE    ] WDI: Fetching primary data for 2025-10.
[2025-10-24T21:52:06.603476] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-05 (0.86 seconds).
[2025-10-24T21:52:07.347633] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-05.
[2025-10-24T21:52:07.643837] [INFO ] [REMOTE    ] WDI: Incremental fetch complete for 2025-10 (1.10 seconds).
[2025-10-24T21:52:07.648056] [INFO ] [REMOTE    ] WDI: Full fetch complete (30340 records).
[2025-10-24T21:52:07.648142] [DEBUG] [VALIDATOR ] WDI: Validating primary data.
[2025-10-24T21:52:08.022994] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present.
[2025-10-24T21:52:08.023086] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed.
[2025-10-24T21:52:08.023812] [INFO ] [MAIN      ] WDI: Fetched primary data is valid.
[2025-10-24T21:52:08.023876] [DEBUG] [LOCAL     ] WDI: Saving primary data.
[2025-10-24T21:52:08.024313] [FATAL] [LOCAL     ] WDI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:52:08.024406] [FATAL] [MAIN      ] WDI: Failed to save primary data.
[2025-10-24T21:52:08.024450] [WARN ] [MAIN      ] WDI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:52:08.024515] [INFO ] [LOCAL     ] WDI: Starting deletion of primary data.
[2025-10-24T21:52:08.024623] [DEBUG] [LOCAL     ] WDI: No primary data file found to delete.
[2025-10-24T21:52:08.024718] [INFO ] [LOCAL     ] WDI: Starting deletion of derivative data.
[2025-10-24T21:52:08.024915] [DEBUG] [LOCAL     ] WDI: Deleted derivative data file.
[2025-10-24T21:52:08.025025] [INFO ] [MAIN      ] Update Progress: 2275/2366 symbols completed. WDI took 29.4s. Estimated remaining: 11m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:52:08.152750] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-06.
[2025-10-24T21:52:08.195073] [INFO ] [MAIN      ] WEAV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:52:08.233693] [DEBUG] [LOCAL     ] WEAV: Loaded 42662 existing records from primary storage.
[2025-10-24T21:52:08.234009] [INFO ] [MAIN      ] WEAV: Loaded 42662 existing records.
[2025-10-24T21:52:08.410592] [WARN ] [MAIN      ] WEAV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:52:08.410844] [INFO ] [MAIN      ] WEAV: Wiping existing primary data before full refresh.
[2025-10-24T21:52:08.410906] [INFO ] [LOCAL     ] WEAV: Starting deletion of primary data.
[2025-10-24T21:52:08.411556] [DEBUG] [LOCAL     ] WEAV: Deleted primary data file.
[2025-10-24T21:52:08.411617] [INFO ] [MAIN      ] WEAV: Starting full primary refresh.
[2025-10-24T21:52:08.778331] [INFO ] [REMOTE    ] WEAV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:52:08.870874] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-05 (1.52 seconds).
[2025-10-24T21:52:08.918356] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-06 (0.77 seconds).
[2025-10-24T21:52:08.947636] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-06.
[2025-10-24T21:52:09.747671] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-01.
[2025-10-24T21:52:10.533666] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T21:52:10.547702] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-08.
[2025-10-24T21:52:11.207873] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-01 (1.46 seconds).
[2025-10-24T21:52:11.347717] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-07.
[2025-10-24T21:52:11.524329] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-08 (0.98 seconds).
[2025-10-24T21:52:12.147689] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-09.
[2025-10-24T21:52:12.856364] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-07 (1.51 seconds).
[2025-10-24T21:52:12.947678] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-08.
[2025-10-24T21:52:13.747714] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-07.
[2025-10-24T21:52:14.181385] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-09 (2.03 seconds).
[2025-10-24T21:52:14.434740] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-08 (1.49 seconds).
[2025-10-24T21:52:14.547702] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-09.
[2025-10-24T21:52:14.567108] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T21:52:15.347679] [INFO ] [REMOTE    ] WDH: Fetching primary data for 2025-10.
[2025-10-24T21:52:15.983966] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T21:52:16.147679] [INFO ] [REMOTE    ] WDS: Fetching primary data for 2025-10.
[2025-10-24T21:52:16.518721] [INFO ] [REMOTE    ] WDH: Incremental fetch complete for 2025-10 (1.17 seconds).
[2025-10-24T21:52:16.523096] [INFO ] [REMOTE    ] WDH: Full fetch complete (23956 records).
[2025-10-24T21:52:16.523197] [DEBUG] [VALIDATOR ] WDH: Validating primary data.
[2025-10-24T21:52:16.891995] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present.
[2025-10-24T21:52:16.892074] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed.
[2025-10-24T21:52:16.892570] [INFO ] [MAIN      ] WDH: Fetched primary data is valid.
[2025-10-24T21:52:16.892609] [DEBUG] [LOCAL     ] WDH: Saving primary data.
[2025-10-24T21:52:16.892922] [FATAL] [LOCAL     ] WDH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:52:16.893007] [FATAL] [MAIN      ] WDH: Failed to save primary data.
[2025-10-24T21:52:16.893056] [WARN ] [MAIN      ] WDH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:52:16.893098] [INFO ] [LOCAL     ] WDH: Starting deletion of primary data.
[2025-10-24T21:52:16.893183] [DEBUG] [LOCAL     ] WDH: No primary data file found to delete.
[2025-10-24T21:52:16.893226] [INFO ] [LOCAL     ] WDH: Starting deletion of derivative data.
[2025-10-24T21:52:16.893398] [DEBUG] [LOCAL     ] WDH: Deleted derivative data file.
[2025-10-24T21:52:16.893489] [INFO ] [MAIN      ] Update Progress: 2276/2366 symbols completed. WDH took 41.2s. Estimated remaining: 11m 33s. Rate: 7.8 symbols/min
[2025-10-24T21:52:16.957123] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-02.
[2025-10-24T21:52:17.068790] [INFO ] [MAIN      ] WEC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:52:17.121896] [DEBUG] [LOCAL     ] WEC: Loaded 52524 existing records from primary storage.
[2025-10-24T21:52:17.122233] [INFO ] [MAIN      ] WEC: Loaded 52524 existing records.
[2025-10-24T21:52:17.307927] [WARN ] [MAIN      ] WEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:52:17.308475] [INFO ] [MAIN      ] WEC: Wiping existing primary data before full refresh.
[2025-10-24T21:52:17.308536] [INFO ] [LOCAL     ] WEC: Starting deletion of primary data.
[2025-10-24T21:52:17.309116] [DEBUG] [LOCAL     ] WEC: Deleted primary data file.
[2025-10-24T21:52:17.309336] [INFO ] [MAIN      ] WEC: Starting full primary refresh.
[2025-10-24T21:52:17.672375] [INFO ] [REMOTE    ] WEC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:52:17.695811] [INFO ] [REMOTE    ] WDS: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T21:52:17.705117] [INFO ] [REMOTE    ] WDS: Full fetch complete (64081 records).
[2025-10-24T21:52:17.705367] [DEBUG] [VALIDATOR ] WDS: Validating primary data.
[2025-10-24T21:52:17.752815] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-01.
[2025-10-24T21:52:18.108076] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present.
[2025-10-24T21:52:18.108186] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed.
[2025-10-24T21:52:18.109879] [INFO ] [MAIN      ] WDS: Fetched primary data is valid.
[2025-10-24T21:52:18.109946] [DEBUG] [LOCAL     ] WDS: Saving primary data.
[2025-10-24T21:52:18.110804] [FATAL] [LOCAL     ] WDS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:52:18.110906] [FATAL] [MAIN      ] WDS: Failed to save primary data.
[2025-10-24T21:52:18.110957] [WARN ] [MAIN      ] WDS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:52:18.110996] [INFO ] [LOCAL     ] WDS: Starting deletion of primary data.
[2025-10-24T21:52:18.111075] [DEBUG] [LOCAL     ] WDS: No primary data file found to delete.
[2025-10-24T21:52:18.111112] [INFO ] [LOCAL     ] WDS: Starting deletion of derivative data.
[2025-10-24T21:52:18.111444] [DEBUG] [LOCAL     ] WDS: Deleted derivative data file.
[2025-10-24T21:52:18.111897] [INFO ] [MAIN      ] Update Progress: 2277/2366 symbols completed. WDS took 27.1s. Estimated remaining: 11m 25s. Rate: 7.8 symbols/min
[2025-10-24T21:52:18.547719] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-08.
[2025-10-24T21:52:18.552620] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T21:52:19.090976] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-08 (0.54 seconds).
[2025-10-24T21:52:19.347695] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-09.
[2025-10-24T21:52:19.595342] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-01 (1.84 seconds).
[2025-10-24T21:52:20.086629] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T21:52:20.147691] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-02.
[2025-10-24T21:52:20.947695] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-03.
[2025-10-24T21:52:21.747751] [INFO ] [REMOTE    ] WEA: Fetching primary data for 2025-10.
[2025-10-24T21:52:21.872065] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T21:52:22.319733] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T21:52:22.486866] [INFO ] [REMOTE    ] WEA: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T21:52:22.489011] [INFO ] [REMOTE    ] WEA: Full fetch complete (10070 records).
[2025-10-24T21:52:22.489096] [DEBUG] [VALIDATOR ] WEA: Validating primary data.
[2025-10-24T21:52:22.555869] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-03.
[2025-10-24T21:52:22.869323] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present.
[2025-10-24T21:52:22.869421] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed.
[2025-10-24T21:52:22.869764] [INFO ] [MAIN      ] WEA: Fetched primary data is valid.
[2025-10-24T21:52:22.869835] [DEBUG] [LOCAL     ] WEA: Saving primary data.
[2025-10-24T21:52:22.870100] [FATAL] [LOCAL     ] WEA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:52:22.870193] [FATAL] [MAIN      ] WEA: Failed to save primary data.
[2025-10-24T21:52:22.870238] [WARN ] [MAIN      ] WEA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:52:22.870278] [INFO ] [LOCAL     ] WEA: Starting deletion of primary data.
[2025-10-24T21:52:22.870333] [DEBUG] [LOCAL     ] WEA: No primary data file found to delete.
[2025-10-24T21:52:22.870372] [INFO ] [LOCAL     ] WEA: Starting deletion of derivative data.
[2025-10-24T21:52:22.870565] [DEBUG] [LOCAL     ] WEA: Deleted derivative data file.
[2025-10-24T21:52:22.870705] [INFO ] [MAIN      ] Update Progress: 2278/2366 symbols completed. WEA took 24.5s. Estimated remaining: 11m 18s. Rate: 7.8 symbols/min
[2025-10-24T21:52:23.347760] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-04.
[2025-10-24T21:52:24.353958] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T21:52:24.365109] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-04.
[2025-10-24T21:52:24.823785] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T21:52:24.947734] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-05.
[2025-10-24T21:52:26.111201] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T21:52:26.121915] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-05.
[2025-10-24T21:52:26.184067] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T21:52:26.547736] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-06.
[2025-10-24T21:52:28.032841] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T21:52:28.072580] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T21:52:28.084418] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-07.
[2025-10-24T21:52:28.147681] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-06.
[2025-10-24T21:52:29.634319] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T21:52:29.644098] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-08.
[2025-10-24T21:52:29.763627] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T21:52:29.774932] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-07.
[2025-10-24T21:52:31.241318] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-08 (1.60 seconds).
[2025-10-24T21:52:31.251716] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-09.
[2025-10-24T21:52:31.435834] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T21:52:31.448123] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-08.
[2025-10-24T21:52:32.577311] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T21:52:32.586515] [INFO ] [REMOTE    ] WEAV: Fetching primary data for 2025-10.
[2025-10-24T21:52:33.085283] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-08 (1.64 seconds).
[2025-10-24T21:52:33.096519] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-09.
[2025-10-24T21:52:34.018906] [INFO ] [REMOTE    ] WEAV: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T21:52:34.031482] [INFO ] [REMOTE    ] WEAV: Full fetch complete (61724 records).
[2025-10-24T21:52:34.031742] [DEBUG] [VALIDATOR ] WEAV: Validating primary data.
[2025-10-24T21:52:34.444304] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present.
[2025-10-24T21:52:34.444731] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed.
[2025-10-24T21:52:34.446538] [INFO ] [MAIN      ] WEAV: Fetched primary data is valid.
[2025-10-24T21:52:34.446627] [DEBUG] [LOCAL     ] WEAV: Saving primary data.
[2025-10-24T21:52:34.447530] [FATAL] [LOCAL     ] WEAV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:52:34.447725] [FATAL] [MAIN      ] WEAV: Failed to save primary data.
[2025-10-24T21:52:34.447772] [WARN ] [MAIN      ] WEAV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:52:34.447810] [INFO ] [LOCAL     ] WEAV: Starting deletion of primary data.
[2025-10-24T21:52:34.447882] [DEBUG] [LOCAL     ] WEAV: No primary data file found to delete.
[2025-10-24T21:52:34.447946] [INFO ] [LOCAL     ] WEAV: Starting deletion of derivative data.
[2025-10-24T21:52:34.448900] [DEBUG] [LOCAL     ] WEAV: Deleted derivative data file.
[2025-10-24T21:52:34.449017] [INFO ] [MAIN      ] Update Progress: 2279/2366 symbols completed. WEAV took 26.4s. Estimated remaining: 11m 10s. Rate: 7.8 symbols/min
[2025-10-24T21:52:34.710781] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-09 (1.61 seconds).
[2025-10-24T21:52:34.722115] [INFO ] [REMOTE    ] WEC: Fetching primary data for 2025-10.
[2025-10-24T21:52:35.496800] [INFO ] [REMOTE    ] WEC: Incremental fetch complete for 2025-10 (0.77 seconds).
[2025-10-24T21:52:35.507028] [INFO ] [REMOTE    ] WEC: Full fetch complete (75873 records).
[2025-10-24T21:52:35.507229] [DEBUG] [VALIDATOR ] WEC: Validating primary data.
[2025-10-24T21:52:35.894443] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present.
[2025-10-24T21:52:35.894521] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed.
[2025-10-24T21:52:35.895679] [INFO ] [MAIN      ] WEC: Fetched primary data is valid.
[2025-10-24T21:52:35.895741] [DEBUG] [LOCAL     ] WEC: Saving primary data.
[2025-10-24T21:52:35.896307] [FATAL] [LOCAL     ] WEC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:52:35.896414] [FATAL] [MAIN      ] WEC: Failed to save primary data.
[2025-10-24T21:52:35.896483] [WARN ] [MAIN      ] WEC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:52:35.896571] [INFO ] [LOCAL     ] WEC: Starting deletion of primary data.
[2025-10-24T21:52:35.896669] [DEBUG] [LOCAL     ] WEC: No primary data file found to delete.
[2025-10-24T21:52:35.896727] [INFO ] [LOCAL     ] WEC: Starting deletion of derivative data.
[2025-10-24T21:52:35.896985] [DEBUG] [LOCAL     ] WEC: Deleted derivative data file.
[2025-10-24T21:52:35.897860] [INFO ] [MAIN      ] Update Progress: 2280/2366 symbols completed. WEC took 19.0s. Estimated remaining: 11m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:52:36.542770] [INFO ] [MAIN      ] WES: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:52:36.615848] [INFO ] [MAIN      ] WELL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:52:36.612706] [INFO ] [MAIN      ] WEX: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:52:36.609700] [INFO ] [MAIN      ] WF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:52:36.643939] [DEBUG] [LOCAL     ] WF: Loaded 10779 existing records from primary storage.
[2025-10-24T21:52:36.644214] [INFO ] [MAIN      ] WF: Loaded 10779 existing records.
[2025-10-24T21:52:36.761295] [DEBUG] [LOCAL     ] WEX: Loaded 32584 existing records from primary storage.
[2025-10-24T21:52:36.783433] [INFO ] [MAIN      ] WEX: Loaded 32584 existing records.
[2025-10-24T21:52:36.933284] [WARN ] [MAIN      ] WF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:52:36.943997] [INFO ] [MAIN      ] WF: Wiping existing primary data before full refresh.
[2025-10-24T21:52:36.949326] [INFO ] [LOCAL     ] WF: Starting deletion of primary data.
[2025-10-24T21:52:37.026359] [DEBUG] [LOCAL     ] WELL: Loaded 52666 existing records from primary storage.
[2025-10-24T21:52:37.014617] [DEBUG] [LOCAL     ] WF: Deleted primary data file.
[2025-10-24T21:52:37.062576] [INFO ] [MAIN      ] WF: Starting full primary refresh.
[2025-10-24T21:52:37.062458] [DEBUG] [LOCAL     ] WES: Loaded 49086 existing records from primary storage.
[2025-10-24T21:52:37.074208] [INFO ] [MAIN      ] WELL: Loaded 52666 existing records.
[2025-10-24T21:52:37.124107] [INFO ] [MAIN      ] WES: Loaded 49086 existing records.
[2025-10-24T21:52:37.123988] [WARN ] [MAIN      ] WEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:52:37.325199] [INFO ] [MAIN      ] WEX: Wiping existing primary data before full refresh.
[2025-10-24T21:52:37.406171] [INFO ] [LOCAL     ] WEX: Starting deletion of primary data.
[2025-10-24T21:52:37.437785] [DEBUG] [LOCAL     ] WEX: Deleted primary data file.
[2025-10-24T21:52:37.484790] [INFO ] [MAIN      ] WEX: Starting full primary refresh.
[2025-10-24T21:52:37.779253] [WARN ] [MAIN      ] WELL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:52:37.827638] [INFO ] [MAIN      ] WELL: Wiping existing primary data before full refresh.
[2025-10-24T21:52:37.832936] [INFO ] [LOCAL     ] WELL: Starting deletion of primary data.
[2025-10-24T21:52:37.836056] [WARN ] [MAIN      ] WES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:52:37.856911] [INFO ] [MAIN      ] WES: Wiping existing primary data before full refresh.
[2025-10-24T21:52:37.862164] [INFO ] [LOCAL     ] WES: Starting deletion of primary data.
[2025-10-24T21:52:37.890199] [DEBUG] [LOCAL     ] WELL: Deleted primary data file.
[2025-10-24T21:52:37.910956] [INFO ] [MAIN      ] WELL: Starting full primary refresh.
[2025-10-24T21:52:37.905758] [DEBUG] [LOCAL     ] WES: Deleted primary data file.
[2025-10-24T21:52:37.962681] [INFO ] [MAIN      ] WES: Starting full primary refresh.
[2025-10-24T21:52:38.062284] [INFO ] [REMOTE    ] WF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:52:38.165708] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-01.
[2025-10-24T21:52:38.704728] [INFO ] [REMOTE    ] WEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:52:38.760482] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-01.
[2025-10-24T21:52:39.033483] [INFO ] [REMOTE    ] WELL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:52:39.055343] [INFO ] [REMOTE    ] WES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:52:39.055917] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-01.
[2025-10-24T21:52:39.050821] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-01.
[2025-10-24T21:52:39.114057] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-01 (0.95 seconds).
[2025-10-24T21:52:39.119297] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-02.
[2025-10-24T21:52:39.935829] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-02 (0.82 seconds).
[2025-10-24T21:52:39.939067] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-03.
[2025-10-24T21:52:40.105520] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T21:52:40.115454] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-02.
[2025-10-24T21:52:40.464593] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-03 (0.53 seconds).
[2025-10-24T21:52:40.468138] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-04.
[2025-10-24T21:52:40.698294] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T21:52:40.737788] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-01 (1.68 seconds).
[2025-10-24T21:52:40.947721] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-02.
[2025-10-24T21:52:41.134893] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-04 (0.67 seconds).
[2025-10-24T21:52:41.637469] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-02 (1.52 seconds).
[2025-10-24T21:52:41.747710] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-03.
[2025-10-24T21:52:42.262333] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T21:52:42.547729] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-05.
[2025-10-24T21:52:43.347675] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-03.
[2025-10-24T21:52:43.388295] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T21:52:43.428597] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-05 (0.88 seconds).
[2025-10-24T21:52:44.147681] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-06.
[2025-10-24T21:52:44.863381] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T21:52:44.922817] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T21:52:44.947603] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-07.
[2025-10-24T21:52:45.747635] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-04.
[2025-10-24T21:52:45.984476] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-07 (1.04 seconds).
[2025-10-24T21:52:46.547712] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-02.
[2025-10-24T21:52:47.216887] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T21:52:47.347684] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-04.
[2025-10-24T21:52:48.147874] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-05.
[2025-10-24T21:52:48.947721] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-08.
[2025-10-24T21:52:49.088330] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T21:52:49.382934] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T21:52:49.423598] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-02 (2.88 seconds).
[2025-10-24T21:52:49.637192] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T21:52:49.747667] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-06.
[2025-10-24T21:52:50.547727] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-09.
[2025-10-24T21:52:51.040126] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T21:52:51.347677] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-05.
[2025-10-24T21:52:51.401245] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-09 (0.85 seconds).
[2025-10-24T21:52:52.147702] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-03.
[2025-10-24T21:52:52.947711] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-07.
[2025-10-24T21:52:53.163558] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T21:52:53.747720] [INFO ] [REMOTE    ] WF: Fetching primary data for 2025-10.
[2025-10-24T21:52:54.106002] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-03 (1.96 seconds).
[2025-10-24T21:52:54.367434] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-07 (1.42 seconds).
[2025-10-24T21:52:54.547698] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-08.
[2025-10-24T21:52:54.609325] [INFO ] [REMOTE    ] WF: Incremental fetch complete for 2025-10 (0.86 seconds).
[2025-10-24T21:52:54.611901] [INFO ] [REMOTE    ] WF: Full fetch complete (15945 records).
[2025-10-24T21:52:54.611989] [DEBUG] [VALIDATOR ] WF: Validating primary data.
[2025-10-24T21:52:54.974921] [DEBUG] [VALIDATOR ] WF: All expected trading days are present.
[2025-10-24T21:52:54.974995] [DEBUG] [VALIDATOR ] WF: Primary data validation passed.
[2025-10-24T21:52:54.975293] [INFO ] [MAIN      ] WF: Fetched primary data is valid.
[2025-10-24T21:52:54.975331] [DEBUG] [LOCAL     ] WF: Saving primary data.
[2025-10-24T21:52:54.975568] [FATAL] [LOCAL     ] WF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:52:54.975688] [FATAL] [MAIN      ] WF: Failed to save primary data.
[2025-10-24T21:52:54.975740] [WARN ] [MAIN      ] WF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:52:54.975777] [INFO ] [LOCAL     ] WF: Starting deletion of primary data.
[2025-10-24T21:52:54.975825] [DEBUG] [LOCAL     ] WF: No primary data file found to delete.
[2025-10-24T21:52:54.975860] [INFO ] [LOCAL     ] WF: Starting deletion of derivative data.
[2025-10-24T21:52:54.976014] [DEBUG] [LOCAL     ] WF: Deleted derivative data file.
[2025-10-24T21:52:54.976083] [INFO ] [MAIN      ] Update Progress: 2281/2366 symbols completed. WF took 19.1s. Estimated remaining: 10m 55s. Rate: 7.8 symbols/min
[2025-10-24T21:52:55.145147] [INFO ] [MAIN      ] WFC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:52:55.199074] [DEBUG] [LOCAL     ] WFC: Loaded 54138 existing records from primary storage.
[2025-10-24T21:52:55.199401] [INFO ] [MAIN      ] WFC: Loaded 54138 existing records.
[2025-10-24T21:52:55.352957] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-04.
[2025-10-24T21:52:55.385578] [WARN ] [MAIN      ] WFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:52:55.385962] [INFO ] [MAIN      ] WFC: Wiping existing primary data before full refresh.
[2025-10-24T21:52:55.386074] [INFO ] [LOCAL     ] WFC: Starting deletion of primary data.
[2025-10-24T21:52:55.386802] [DEBUG] [LOCAL     ] WFC: Deleted primary data file.
[2025-10-24T21:52:55.386859] [INFO ] [MAIN      ] WFC: Starting full primary refresh.
[2025-10-24T21:52:55.766196] [INFO ] [REMOTE    ] WFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:52:55.855920] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T21:52:56.147744] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-09.
[2025-10-24T21:52:56.947724] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-01.
[2025-10-24T21:52:57.214703] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-04 (1.86 seconds).
[2025-10-24T21:52:57.434148] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-09 (1.29 seconds).
[2025-10-24T21:52:57.747826] [INFO ] [REMOTE    ] WEX: Fetching primary data for 2025-10.
[2025-10-24T21:52:58.547720] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-05.
[2025-10-24T21:52:58.779217] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-01 (1.83 seconds).
[2025-10-24T21:52:58.859716] [INFO ] [REMOTE    ] WEX: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T21:52:58.865202] [INFO ] [REMOTE    ] WEX: Full fetch complete (50353 records).
[2025-10-24T21:52:58.865352] [DEBUG] [VALIDATOR ] WEX: Validating primary data.
[2025-10-24T21:52:59.249766] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present.
[2025-10-24T21:52:59.249846] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed.
[2025-10-24T21:52:59.250806] [INFO ] [MAIN      ] WEX: Fetched primary data is valid.
[2025-10-24T21:52:59.250889] [DEBUG] [LOCAL     ] WEX: Saving primary data.
[2025-10-24T21:52:59.251326] [FATAL] [LOCAL     ] WEX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:52:59.251428] [FATAL] [MAIN      ] WEX: Failed to save primary data.
[2025-10-24T21:52:59.251497] [WARN ] [MAIN      ] WEX: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:52:59.251585] [INFO ] [LOCAL     ] WEX: Starting deletion of primary data.
[2025-10-24T21:52:59.251697] [DEBUG] [LOCAL     ] WEX: No primary data file found to delete.
[2025-10-24T21:52:59.251756] [INFO ] [LOCAL     ] WEX: Starting deletion of derivative data.
[2025-10-24T21:52:59.251914] [DEBUG] [LOCAL     ] WEX: Deleted derivative data file.
[2025-10-24T21:52:59.251989] [INFO ] [MAIN      ] Update Progress: 2282/2366 symbols completed. WEX took 23.3s. Estimated remaining: 10m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:52:59.354400] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-02.
[2025-10-24T21:52:59.429474] [INFO ] [MAIN      ] WFG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:52:59.455703] [DEBUG] [LOCAL     ] WFG: Loaded 24704 existing records from primary storage.
[2025-10-24T21:52:59.456036] [INFO ] [MAIN      ] WFG: Loaded 24704 existing records.
[2025-10-24T21:52:59.632289] [WARN ] [MAIN      ] WFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:52:59.632509] [INFO ] [MAIN      ] WFG: Wiping existing primary data before full refresh.
[2025-10-24T21:52:59.632555] [INFO ] [LOCAL     ] WFG: Starting deletion of primary data.
[2025-10-24T21:52:59.632897] [DEBUG] [LOCAL     ] WFG: Deleted primary data file.
[2025-10-24T21:52:59.632952] [INFO ] [MAIN      ] WFG: Starting full primary refresh.
[2025-10-24T21:52:59.986343] [INFO ] [REMOTE    ] WFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:53:00.147684] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-06.
[2025-10-24T21:53:00.225958] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T21:53:00.947739] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-06.
[2025-10-24T21:53:01.747729] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-01.
[2025-10-24T21:53:01.840451] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T21:53:02.205878] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-02 (2.85 seconds).
[2025-10-24T21:53:02.547718] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-03.
[2025-10-24T21:53:02.763540] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-06 (1.82 seconds).
[2025-10-24T21:53:02.919242] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T21:53:03.347705] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-02.
[2025-10-24T21:53:04.147750] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-07.
[2025-10-24T21:53:04.449038] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-02 (1.10 seconds).
[2025-10-24T21:53:04.618126] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-03 (2.07 seconds).
[2025-10-24T21:53:04.947786] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-03.
[2025-10-24T21:53:05.747715] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-04.
[2025-10-24T21:53:05.939829] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-07 (1.79 seconds).
[2025-10-24T21:53:06.074060] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T21:53:06.547722] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-04.
[2025-10-24T21:53:07.347706] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-08.
[2025-10-24T21:53:07.494383] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T21:53:07.954526] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T21:53:08.147712] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-07.
[2025-10-24T21:53:08.947701] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-05.
[2025-10-24T21:53:09.026107] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-08 (1.68 seconds).
[2025-10-24T21:53:09.747755] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-09.
[2025-10-24T21:53:09.809112] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-07 (1.66 seconds).
[2025-10-24T21:53:10.547747] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-08.
[2025-10-24T21:53:11.125548] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-05 (2.18 seconds).
[2025-10-24T21:53:11.347702] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-06.
[2025-10-24T21:53:11.543210] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-09 (1.80 seconds).
[2025-10-24T21:53:12.147702] [INFO ] [REMOTE    ] WELL: Fetching primary data for 2025-10.
[2025-10-24T21:53:12.300897] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T21:53:12.949547] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-09.
[2025-10-24T21:53:12.957756] [INFO ] [REMOTE    ] WELL: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T21:53:12.968044] [INFO ] [REMOTE    ] WELL: Full fetch complete (76010 records).
[2025-10-24T21:53:12.968218] [DEBUG] [VALIDATOR ] WELL: Validating primary data.
[2025-10-24T21:53:13.384839] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present.
[2025-10-24T21:53:13.385007] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed.
[2025-10-24T21:53:13.386920] [INFO ] [MAIN      ] WELL: Fetched primary data is valid.
[2025-10-24T21:53:13.387010] [DEBUG] [LOCAL     ] WELL: Saving primary data.
[2025-10-24T21:53:13.388114] [FATAL] [LOCAL     ] WELL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:53:13.388446] [FATAL] [MAIN      ] WELL: Failed to save primary data.
[2025-10-24T21:53:13.388579] [WARN ] [MAIN      ] WELL: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:53:13.388715] [INFO ] [LOCAL     ] WELL: Starting deletion of primary data.
[2025-10-24T21:53:13.388888] [DEBUG] [LOCAL     ] WELL: No primary data file found to delete.
[2025-10-24T21:53:13.388946] [INFO ] [LOCAL     ] WELL: Starting deletion of derivative data.
[2025-10-24T21:53:13.389182] [DEBUG] [LOCAL     ] WELL: Deleted derivative data file.
[2025-10-24T21:53:13.389684] [INFO ] [MAIN      ] Update Progress: 2283/2366 symbols completed. WELL took 37.5s. Estimated remaining: 10m 40s. Rate: 7.8 symbols/min
[2025-10-24T21:53:13.577390] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-06 (2.23 seconds).
[2025-10-24T21:53:13.604263] [INFO ] [MAIN      ] WGO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:53:13.658619] [DEBUG] [LOCAL     ] WGO: Loaded 38321 existing records from primary storage.
[2025-10-24T21:53:13.659041] [INFO ] [MAIN      ] WGO: Loaded 38321 existing records.
[2025-10-24T21:53:13.755770] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-07.
[2025-10-24T21:53:13.853344] [WARN ] [MAIN      ] WGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:53:13.853666] [INFO ] [MAIN      ] WGO: Wiping existing primary data before full refresh.
[2025-10-24T21:53:13.853732] [INFO ] [LOCAL     ] WGO: Starting deletion of primary data.
[2025-10-24T21:53:13.854493] [DEBUG] [LOCAL     ] WGO: Deleted primary data file.
[2025-10-24T21:53:13.854552] [INFO ] [MAIN      ] WGO: Starting full primary refresh.
[2025-10-24T21:53:14.225551] [INFO ] [REMOTE    ] WGO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:53:14.547628] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-05.
[2025-10-24T21:53:14.727449] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-09 (1.78 seconds).
[2025-10-24T21:53:15.347701] [INFO ] [REMOTE    ] WES: Fetching primary data for 2025-10.
[2025-10-24T21:53:15.596518] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-05 (1.05 seconds).
[2025-10-24T21:53:15.790756] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-07 (2.03 seconds).
[2025-10-24T21:53:16.147686] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-06.
[2025-10-24T21:53:16.586437] [INFO ] [REMOTE    ] WES: Incremental fetch complete for 2025-10 (1.24 seconds).
[2025-10-24T21:53:16.596227] [INFO ] [REMOTE    ] WES: Full fetch complete (70670 records).
[2025-10-24T21:53:16.596393] [DEBUG] [VALIDATOR ] WES: Validating primary data.
[2025-10-24T21:53:16.959227] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-01.
[2025-10-24T21:53:17.029638] [DEBUG] [VALIDATOR ] WES: All expected trading days are present.
[2025-10-24T21:53:17.029854] [DEBUG] [VALIDATOR ] WES: Primary data validation passed.
[2025-10-24T21:53:17.031507] [INFO ] [MAIN      ] WES: Fetched primary data is valid.
[2025-10-24T21:53:17.031601] [DEBUG] [LOCAL     ] WES: Saving primary data.
[2025-10-24T21:53:17.032379] [FATAL] [LOCAL     ] WES: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:53:17.032482] [FATAL] [MAIN      ] WES: Failed to save primary data.
[2025-10-24T21:53:17.032545] [WARN ] [MAIN      ] WES: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:53:17.032611] [INFO ] [LOCAL     ] WES: Starting deletion of primary data.
[2025-10-24T21:53:17.032718] [DEBUG] [LOCAL     ] WES: No primary data file found to delete.
[2025-10-24T21:53:17.032770] [INFO ] [LOCAL     ] WES: Starting deletion of derivative data.
[2025-10-24T21:53:17.032966] [DEBUG] [LOCAL     ] WES: Deleted derivative data file.
[2025-10-24T21:53:17.033722] [INFO ] [MAIN      ] Update Progress: 2284/2366 symbols completed. WES took 41.1s. Estimated remaining: 10m 32s. Rate: 7.8 symbols/min
[2025-10-24T21:53:17.223385] [INFO ] [MAIN      ] WH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:53:17.239541] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-06 (1.09 seconds).
[2025-10-24T21:53:17.282011] [DEBUG] [LOCAL     ] WH: Loaded 45647 existing records from primary storage.
[2025-10-24T21:53:17.282324] [INFO ] [MAIN      ] WH: Loaded 45647 existing records.
[2025-10-24T21:53:17.455956] [WARN ] [MAIN      ] WH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:53:17.456184] [INFO ] [MAIN      ] WH: Wiping existing primary data before full refresh.
[2025-10-24T21:53:17.456229] [INFO ] [LOCAL     ] WH: Starting deletion of primary data.
[2025-10-24T21:53:17.456622] [DEBUG] [LOCAL     ] WH: Deleted primary data file.
[2025-10-24T21:53:17.456693] [INFO ] [MAIN      ] WH: Starting full primary refresh.
[2025-10-24T21:53:17.752784] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-08.
[2025-10-24T21:53:17.813824] [INFO ] [REMOTE    ] WH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:53:18.472704] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T21:53:18.547681] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-01.
[2025-10-24T21:53:19.347715] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-07.
[2025-10-24T21:53:19.900099] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-08 (2.15 seconds).
[2025-10-24T21:53:19.970991] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T21:53:20.147674] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-02.
[2025-10-24T21:53:20.454274] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-07 (1.11 seconds).
[2025-10-24T21:53:20.947757] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-02.
[2025-10-24T21:53:21.559777] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-02 (1.41 seconds).
[2025-10-24T21:53:21.747698] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-08.
[2025-10-24T21:53:21.824734] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-02 (0.88 seconds).
[2025-10-24T21:53:22.547718] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-03.
[2025-10-24T21:53:22.902904] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-08 (1.16 seconds).
[2025-10-24T21:53:23.347732] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-09.
[2025-10-24T21:53:24.065149] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T21:53:24.147683] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-04.
[2025-10-24T21:53:24.530392] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-09 (1.18 seconds).
[2025-10-24T21:53:24.947765] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-09.
[2025-10-24T21:53:25.747707] [INFO ] [REMOTE    ] WFG: Fetching primary data for 2025-10.
[2025-10-24T21:53:25.924495] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T21:53:26.547690] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-03.
[2025-10-24T21:53:26.949943] [INFO ] [REMOTE    ] WFG: Incremental fetch complete for 2025-10 (1.20 seconds).
[2025-10-24T21:53:26.954838] [INFO ] [REMOTE    ] WFG: Full fetch complete (36573 records).
[2025-10-24T21:53:26.954980] [DEBUG] [VALIDATOR ] WFG: Validating primary data.
[2025-10-24T21:53:27.346946] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present.
[2025-10-24T21:53:27.347081] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed.
[2025-10-24T21:53:27.348221] [INFO ] [MAIN      ] WFG: Fetched primary data is valid.
[2025-10-24T21:53:27.360813] [DEBUG] [LOCAL     ] WFG: Saving primary data.
[2025-10-24T21:53:27.361034] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-05.
[2025-10-24T21:53:27.361233] [FATAL] [LOCAL     ] WFG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:53:27.380065] [FATAL] [MAIN      ] WFG: Failed to save primary data.
[2025-10-24T21:53:27.383392] [WARN ] [MAIN      ] WFG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:53:27.384339] [INFO ] [LOCAL     ] WFG: Starting deletion of primary data.
[2025-10-24T21:53:27.384482] [DEBUG] [LOCAL     ] WFG: No primary data file found to delete.
[2025-10-24T21:53:27.384553] [INFO ] [LOCAL     ] WFG: Starting deletion of derivative data.
[2025-10-24T21:53:27.385123] [DEBUG] [LOCAL     ] WFG: Deleted derivative data file.
[2025-10-24T21:53:27.385518] [INFO ] [MAIN      ] Update Progress: 2285/2366 symbols completed. WFG took 28.1s. Estimated remaining: 10m 24s. Rate: 7.8 symbols/min
[2025-10-24T21:53:27.389938] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-09 (2.44 seconds).
[2025-10-24T21:53:27.570311] [INFO ] [MAIN      ] WHD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:53:27.605197] [DEBUG] [LOCAL     ] WHD: Loaded 40265 existing records from primary storage.
[2025-10-24T21:53:27.605477] [INFO ] [MAIN      ] WHD: Loaded 40265 existing records.
[2025-10-24T21:53:27.780812] [WARN ] [MAIN      ] WHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:53:27.781080] [INFO ] [MAIN      ] WHD: Wiping existing primary data before full refresh.
[2025-10-24T21:53:27.781129] [INFO ] [LOCAL     ] WHD: Starting deletion of primary data.
[2025-10-24T21:53:27.781325] [DEBUG] [LOCAL     ] WHD: Deleted primary data file.
[2025-10-24T21:53:27.781362] [INFO ] [MAIN      ] WHD: Starting full primary refresh.
[2025-10-24T21:53:28.165284] [INFO ] [REMOTE    ] WHD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:53:28.160704] [INFO ] [REMOTE    ] WFC: Fetching primary data for 2025-10.
[2025-10-24T21:53:28.301851] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-03 (1.75 seconds).
[2025-10-24T21:53:28.771157] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-05 (1.41 seconds).
[2025-10-24T21:53:28.924256] [INFO ] [REMOTE    ] WFC: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T21:53:28.934244] [INFO ] [REMOTE    ] WFC: Full fetch complete (77927 records).
[2025-10-24T21:53:28.934409] [DEBUG] [VALIDATOR ] WFC: Validating primary data.
[2025-10-24T21:53:28.955503] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-01.
[2025-10-24T21:53:29.336213] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present.
[2025-10-24T21:53:29.336337] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed.
[2025-10-24T21:53:29.337559] [INFO ] [MAIN      ] WFC: Fetched primary data is valid.
[2025-10-24T21:53:29.337666] [DEBUG] [LOCAL     ] WFC: Saving primary data.
[2025-10-24T21:53:29.338488] [FATAL] [LOCAL     ] WFC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:53:29.338590] [FATAL] [MAIN      ] WFC: Failed to save primary data.
[2025-10-24T21:53:29.338631] [WARN ] [MAIN      ] WFC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:53:29.338709] [INFO ] [LOCAL     ] WFC: Starting deletion of primary data.
[2025-10-24T21:53:29.338772] [DEBUG] [LOCAL     ] WFC: No primary data file found to delete.
[2025-10-24T21:53:29.338813] [INFO ] [LOCAL     ] WFC: Starting deletion of derivative data.
[2025-10-24T21:53:29.338961] [DEBUG] [LOCAL     ] WFC: Deleted derivative data file.
[2025-10-24T21:53:29.339234] [INFO ] [MAIN      ] Update Progress: 2286/2366 symbols completed. WFC took 34.4s. Estimated remaining: 10m 16s. Rate: 7.8 symbols/min
[2025-10-24T21:53:29.508717] [INFO ] [MAIN      ] WHG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:53:29.513473] [DEBUG] [LOCAL     ] WHG: Loaded 3056 existing records from primary storage.
[2025-10-24T21:53:29.513690] [INFO ] [MAIN      ] WHG: Loaded 3056 existing records.
[2025-10-24T21:53:29.692106] [WARN ] [MAIN      ] WHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:53:29.692327] [INFO ] [MAIN      ] WHG: Wiping existing primary data before full refresh.
[2025-10-24T21:53:29.692372] [INFO ] [LOCAL     ] WHG: Starting deletion of primary data.
[2025-10-24T21:53:29.692526] [DEBUG] [LOCAL     ] WHG: Deleted primary data file.
[2025-10-24T21:53:29.692588] [INFO ] [MAIN      ] WHG: Starting full primary refresh.
[2025-10-24T21:53:29.754795] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-06.
[2025-10-24T21:53:30.046135] [INFO ] [REMOTE    ] WHG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:53:30.481627] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T21:53:30.547692] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-02.
[2025-10-24T21:53:31.347674] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-01.
[2025-10-24T21:53:31.412372] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T21:53:31.485532] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-02 (0.94 seconds).
[2025-10-24T21:53:31.915241] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-01 (0.57 seconds).
[2025-10-24T21:53:32.147732] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-02.
[2025-10-24T21:53:32.724708] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-02 (0.58 seconds).
[2025-10-24T21:53:32.947713] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-07.
[2025-10-24T21:53:33.747741] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-04.
[2025-10-24T21:53:34.558672] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-03.
[2025-10-24T21:53:34.562972] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-07 (1.62 seconds).
[2025-10-24T21:53:35.122171] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T21:53:35.195680] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-04 (1.45 seconds).
[2025-10-24T21:53:35.347603] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-05.
[2025-10-24T21:53:36.147717] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-04.
[2025-10-24T21:53:36.547004] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-04 (0.40 seconds).
[2025-10-24T21:53:36.923798] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T21:53:36.947599] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-06.
[2025-10-24T21:53:37.747720] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-08.
[2025-10-24T21:53:38.052462] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-06 (1.10 seconds).
[2025-10-24T21:53:38.547690] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-05.
[2025-10-24T21:53:39.169671] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-05 (0.62 seconds).
[2025-10-24T21:53:39.195762] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-08 (1.45 seconds).
[2025-10-24T21:53:39.347669] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-06.
[2025-10-24T21:53:39.947795] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-06 (0.60 seconds).
[2025-10-24T21:53:40.147695] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-07.
[2025-10-24T21:53:40.740507] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-07 (0.59 seconds).
[2025-10-24T21:53:40.947763] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-03.
[2025-10-24T21:53:41.747720] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-08.
[2025-10-24T21:53:42.213302] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-08 (0.47 seconds).
[2025-10-24T21:53:42.548572] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-09.
[2025-10-24T21:53:42.554140] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-03 (1.61 seconds).
[2025-10-24T21:53:43.068004] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-09 (0.52 seconds).
[2025-10-24T21:53:43.347634] [INFO ] [REMOTE    ] WHG: Fetching primary data for 2025-10.
[2025-10-24T21:53:43.809601] [INFO ] [REMOTE    ] WHG: Incremental fetch complete for 2025-10 (0.46 seconds).
[2025-10-24T21:53:43.810402] [INFO ] [REMOTE    ] WHG: Full fetch complete (4325 records).
[2025-10-24T21:53:43.810468] [DEBUG] [VALIDATOR ] WHG: Validating primary data.
[2025-10-24T21:53:44.149905] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-09.
[2025-10-24T21:53:44.171350] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present.
[2025-10-24T21:53:44.172240] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed.
[2025-10-24T21:53:44.172394] [INFO ] [MAIN      ] WHG: Fetched primary data is valid.
[2025-10-24T21:53:44.172433] [DEBUG] [LOCAL     ] WHG: Saving primary data.
[2025-10-24T21:53:44.172611] [FATAL] [LOCAL     ] WHG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:53:44.172715] [FATAL] [MAIN      ] WHG: Failed to save primary data.
[2025-10-24T21:53:44.172781] [WARN ] [MAIN      ] WHG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:53:44.172830] [INFO ] [LOCAL     ] WHG: Starting deletion of primary data.
[2025-10-24T21:53:44.172878] [DEBUG] [LOCAL     ] WHG: No primary data file found to delete.
[2025-10-24T21:53:44.172912] [INFO ] [LOCAL     ] WHG: Starting deletion of derivative data.
[2025-10-24T21:53:44.173065] [DEBUG] [LOCAL     ] WHG: Deleted derivative data file.
[2025-10-24T21:53:44.173149] [INFO ] [MAIN      ] Update Progress: 2287/2366 symbols completed. WHG took 14.8s. Estimated remaining: 10m 9s. Rate: 7.8 symbols/min
[2025-10-24T21:53:44.365377] [INFO ] [MAIN      ] WHR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:53:44.409547] [DEBUG] [LOCAL     ] WHR: Loaded 49256 existing records from primary storage.
[2025-10-24T21:53:44.409913] [INFO ] [MAIN      ] WHR: Loaded 49256 existing records.
[2025-10-24T21:53:44.584548] [WARN ] [MAIN      ] WHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:53:44.584778] [INFO ] [MAIN      ] WHR: Wiping existing primary data before full refresh.
[2025-10-24T21:53:44.584827] [INFO ] [LOCAL     ] WHR: Starting deletion of primary data.
[2025-10-24T21:53:44.585041] [DEBUG] [LOCAL     ] WHR: Deleted primary data file.
[2025-10-24T21:53:44.585098] [INFO ] [MAIN      ] WHR: Starting full primary refresh.
[2025-10-24T21:53:44.955029] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-04.
[2025-10-24T21:53:44.959615] [INFO ] [REMOTE    ] WHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:53:45.660873] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T21:53:45.747600] [INFO ] [REMOTE    ] WGO: Fetching primary data for 2025-10.
[2025-10-24T21:53:46.258871] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T21:53:46.547708] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-07.
[2025-10-24T21:53:46.774167] [INFO ] [REMOTE    ] WGO: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T21:53:46.781282] [INFO ] [REMOTE    ] WGO: Full fetch complete (57228 records).
[2025-10-24T21:53:46.781388] [DEBUG] [VALIDATOR ] WGO: Validating primary data.
[2025-10-24T21:53:47.161841] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present.
[2025-10-24T21:53:47.161923] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed.
[2025-10-24T21:53:47.162947] [INFO ] [MAIN      ] WGO: Fetched primary data is valid.
[2025-10-24T21:53:47.163008] [DEBUG] [LOCAL     ] WGO: Saving primary data.
[2025-10-24T21:53:47.163543] [FATAL] [LOCAL     ] WGO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:53:47.163633] [FATAL] [MAIN      ] WGO: Failed to save primary data.
[2025-10-24T21:53:47.163713] [WARN ] [MAIN      ] WGO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:53:47.163756] [INFO ] [LOCAL     ] WGO: Starting deletion of primary data.
[2025-10-24T21:53:47.163808] [DEBUG] [LOCAL     ] WGO: No primary data file found to delete.
[2025-10-24T21:53:47.163845] [INFO ] [LOCAL     ] WGO: Starting deletion of derivative data.
[2025-10-24T21:53:47.164212] [DEBUG] [LOCAL     ] WGO: Deleted derivative data file.
[2025-10-24T21:53:47.164891] [INFO ] [MAIN      ] Update Progress: 2288/2366 symbols completed. WGO took 33.8s. Estimated remaining: 10m 1s. Rate: 7.8 symbols/min
[2025-10-24T21:53:47.359538] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-05.
[2025-10-24T21:53:47.363208] [INFO ] [MAIN      ] WIA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:53:47.374168] [DEBUG] [LOCAL     ] WIA: Loaded 5067 existing records from primary storage.
[2025-10-24T21:53:47.374885] [INFO ] [MAIN      ] WIA: Loaded 5067 existing records.
[2025-10-24T21:53:47.618460] [WARN ] [MAIN      ] WIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:53:47.618778] [INFO ] [MAIN      ] WIA: Wiping existing primary data before full refresh.
[2025-10-24T21:53:47.618850] [INFO ] [LOCAL     ] WIA: Starting deletion of primary data.
[2025-10-24T21:53:47.619042] [DEBUG] [LOCAL     ] WIA: Deleted primary data file.
[2025-10-24T21:53:47.619108] [INFO ] [MAIN      ] WIA: Starting full primary refresh.
[2025-10-24T21:53:48.150438] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-01.
[2025-10-24T21:53:48.185239] [INFO ] [REMOTE    ] WIA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:53:48.221581] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T21:53:48.848747] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-05 (1.49 seconds).
[2025-10-24T21:53:48.947710] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-06.
[2025-10-24T21:53:49.747721] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-08.
[2025-10-24T21:53:49.870361] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-01 (1.72 seconds).
[2025-10-24T21:53:49.944920] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-06 (1.00 seconds).
[2025-10-24T21:53:50.547713] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-02.
[2025-10-24T21:53:51.046392] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T21:53:51.347700] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-09.
[2025-10-24T21:53:52.150258] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-07.
[2025-10-24T21:53:52.152704] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-02 (1.60 seconds).
[2025-10-24T21:53:52.869235] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T21:53:52.947678] [INFO ] [REMOTE    ] WH: Fetching primary data for 2025-10.
[2025-10-24T21:53:53.623993] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-07 (1.47 seconds).
[2025-10-24T21:53:53.747683] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-03.
[2025-10-24T21:53:54.552907] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-01.
[2025-10-24T21:53:54.564873] [INFO ] [REMOTE    ] WH: Incremental fetch complete for 2025-10 (1.62 seconds).
[2025-10-24T21:53:54.574580] [INFO ] [REMOTE    ] WH: Full fetch complete (65841 records).
[2025-10-24T21:53:54.574749] [DEBUG] [VALIDATOR ] WH: Validating primary data.
[2025-10-24T21:53:54.975731] [DEBUG] [VALIDATOR ] WH: All expected trading days are present.
[2025-10-24T21:53:54.975835] [DEBUG] [VALIDATOR ] WH: Primary data validation passed.
[2025-10-24T21:53:54.977015] [INFO ] [MAIN      ] WH: Fetched primary data is valid.
[2025-10-24T21:53:54.977085] [DEBUG] [LOCAL     ] WH: Saving primary data.
[2025-10-24T21:53:54.977769] [FATAL] [LOCAL     ] WH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:53:54.977866] [FATAL] [MAIN      ] WH: Failed to save primary data.
[2025-10-24T21:53:54.977912] [WARN ] [MAIN      ] WH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:53:54.977956] [INFO ] [LOCAL     ] WH: Starting deletion of primary data.
[2025-10-24T21:53:54.978022] [DEBUG] [LOCAL     ] WH: No primary data file found to delete.
[2025-10-24T21:53:54.978062] [INFO ] [LOCAL     ] WH: Starting deletion of derivative data.
[2025-10-24T21:53:54.978251] [DEBUG] [LOCAL     ] WH: Deleted derivative data file.
[2025-10-24T21:53:54.978737] [INFO ] [MAIN      ] Update Progress: 2289/2366 symbols completed. WH took 37.9s. Estimated remaining: 9m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:53:55.146674] [INFO ] [MAIN      ] WINN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:53:55.159718] [DEBUG] [LOCAL     ] WINN: Loaded 11255 existing records from primary storage.
[2025-10-24T21:53:55.159965] [INFO ] [MAIN      ] WINN: Loaded 11255 existing records.
[2025-10-24T21:53:55.279461] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-01 (0.73 seconds).
[2025-10-24T21:53:55.350477] [WARN ] [MAIN      ] WINN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:53:55.350625] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-08.
[2025-10-24T21:53:55.351117] [INFO ] [MAIN      ] WINN: Wiping existing primary data before full refresh.
[2025-10-24T21:53:55.352257] [INFO ] [LOCAL     ] WINN: Starting deletion of primary data.
[2025-10-24T21:53:55.352529] [DEBUG] [LOCAL     ] WINN: Deleted primary data file.
[2025-10-24T21:53:55.352605] [INFO ] [MAIN      ] WINN: Starting full primary refresh.
[2025-10-24T21:53:55.623535] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-03 (1.88 seconds).
[2025-10-24T21:53:55.749427] [INFO ] [REMOTE    ] WINN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:53:56.147720] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-01.
[2025-10-24T21:53:56.720170] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T21:53:56.947734] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-09.
[2025-10-24T21:53:57.074454] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-01 (0.93 seconds).
[2025-10-24T21:53:57.747703] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-02.
[2025-10-24T21:53:58.356494] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-02 (0.61 seconds).
[2025-10-24T21:53:58.503462] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-09 (1.56 seconds).
[2025-10-24T21:53:58.547689] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-04.
[2025-10-24T21:53:59.347697] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-03.
[2025-10-24T21:53:59.916042] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-03 (0.57 seconds).
[2025-10-24T21:54:00.147738] [INFO ] [REMOTE    ] WHD: Fetching primary data for 2025-10.
[2025-10-24T21:54:00.947768] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-02.
[2025-10-24T21:54:01.386252] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-04 (2.84 seconds).
[2025-10-24T21:54:01.747764] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-04.
[2025-10-24T21:54:02.497218] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T21:54:02.547760] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-05.
[2025-10-24T21:54:02.745059] [INFO ] [REMOTE    ] WHD: Incremental fetch complete for 2025-10 (2.60 seconds).
[2025-10-24T21:54:02.752695] [INFO ] [REMOTE    ] WHD: Full fetch complete (57965 records).
[2025-10-24T21:54:02.752866] [DEBUG] [VALIDATOR ] WHD: Validating primary data.
[2025-10-24T21:54:03.026890] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-04 (1.28 seconds).
[2025-10-24T21:54:03.149861] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present.
[2025-10-24T21:54:03.149930] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed.
[2025-10-24T21:54:03.150910] [INFO ] [MAIN      ] WHD: Fetched primary data is valid.
[2025-10-24T21:54:03.150971] [DEBUG] [LOCAL     ] WHD: Saving primary data.
[2025-10-24T21:54:03.151415] [FATAL] [LOCAL     ] WHD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:54:03.151504] [FATAL] [MAIN      ] WHD: Failed to save primary data.
[2025-10-24T21:54:03.151545] [WARN ] [MAIN      ] WHD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:54:03.151579] [INFO ] [LOCAL     ] WHD: Starting deletion of primary data.
[2025-10-24T21:54:03.151628] [DEBUG] [LOCAL     ] WHD: No primary data file found to delete.
[2025-10-24T21:54:03.151697] [INFO ] [LOCAL     ] WHD: Starting deletion of derivative data.
[2025-10-24T21:54:03.151894] [DEBUG] [LOCAL     ] WHD: Deleted derivative data file.
[2025-10-24T21:54:03.151983] [INFO ] [MAIN      ] Update Progress: 2290/2366 symbols completed. WHD took 35.8s. Estimated remaining: 9m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:54:03.322972] [INFO ] [MAIN      ] WIT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:54:03.348031] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-05.
[2025-10-24T21:54:03.371602] [DEBUG] [LOCAL     ] WIT: Loaded 52922 existing records from primary storage.
[2025-10-24T21:54:03.371953] [INFO ] [MAIN      ] WIT: Loaded 52922 existing records.
[2025-10-24T21:54:03.548147] [WARN ] [MAIN      ] WIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:54:03.548404] [INFO ] [MAIN      ] WIT: Wiping existing primary data before full refresh.
[2025-10-24T21:54:03.548451] [INFO ] [LOCAL     ] WIT: Starting deletion of primary data.
[2025-10-24T21:54:03.548702] [DEBUG] [LOCAL     ] WIT: Deleted primary data file.
[2025-10-24T21:54:03.548758] [INFO ] [MAIN      ] WIT: Starting full primary refresh.
[2025-10-24T21:54:03.896932] [INFO ] [REMOTE    ] WIT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:54:03.980552] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-05 (0.63 seconds).
[2025-10-24T21:54:04.147701] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-06.
[2025-10-24T21:54:04.444093] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T21:54:04.947707] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-03.
[2025-10-24T21:54:05.449722] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-06 (1.30 seconds).
[2025-10-24T21:54:05.747695] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-01.
[2025-10-24T21:54:06.547693] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-06.
[2025-10-24T21:54:06.710242] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-03 (1.76 seconds).
[2025-10-24T21:54:07.347677] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-04.
[2025-10-24T21:54:07.567094] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T21:54:08.152792] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-07.
[2025-10-24T21:54:08.175352] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-06 (1.63 seconds).
[2025-10-24T21:54:08.311281] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-04 (0.96 seconds).
[2025-10-24T21:54:08.833924] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T21:54:08.947701] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-07.
[2025-10-24T21:54:09.747693] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-08.
[2025-10-24T21:54:10.350002] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-08 (0.60 seconds).
[2025-10-24T21:54:10.547665] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-02.
[2025-10-24T21:54:10.919769] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-07 (1.97 seconds).
[2025-10-24T21:54:11.347723] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-09.
[2025-10-24T21:54:12.035229] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T21:54:12.077253] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-09 (0.73 seconds).
[2025-10-24T21:54:12.147636] [INFO ] [REMOTE    ] WIA: Fetching primary data for 2025-10.
[2025-10-24T21:54:12.804060] [INFO ] [REMOTE    ] WIA: Incremental fetch complete for 2025-10 (0.66 seconds).
[2025-10-24T21:54:12.806455] [INFO ] [REMOTE    ] WIA: Full fetch complete (7321 records).
[2025-10-24T21:54:12.806542] [DEBUG] [VALIDATOR ] WIA: Validating primary data.
[2025-10-24T21:54:12.956847] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-03.
[2025-10-24T21:54:13.180690] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present.
[2025-10-24T21:54:13.180820] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed.
[2025-10-24T21:54:13.181056] [INFO ] [MAIN      ] WIA: Fetched primary data is valid.
[2025-10-24T21:54:13.181096] [DEBUG] [LOCAL     ] WIA: Saving primary data.
[2025-10-24T21:54:13.181285] [FATAL] [LOCAL     ] WIA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:54:13.181407] [FATAL] [MAIN      ] WIA: Failed to save primary data.
[2025-10-24T21:54:13.181448] [WARN ] [MAIN      ] WIA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:54:13.181481] [INFO ] [LOCAL     ] WIA: Starting deletion of primary data.
[2025-10-24T21:54:13.181541] [DEBUG] [LOCAL     ] WIA: No primary data file found to delete.
[2025-10-24T21:54:13.181639] [INFO ] [LOCAL     ] WIA: Starting deletion of derivative data.
[2025-10-24T21:54:13.181954] [DEBUG] [LOCAL     ] WIA: Deleted derivative data file.
[2025-10-24T21:54:13.182041] [INFO ] [MAIN      ] Update Progress: 2291/2366 symbols completed. WIA took 26.0s. Estimated remaining: 9m 38s. Rate: 7.8 symbols/min
[2025-10-24T21:54:13.347475] [INFO ] [MAIN      ] WIW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:54:13.366607] [DEBUG] [LOCAL     ] WIW: Loaded 20389 existing records from primary storage.
[2025-10-24T21:54:13.366881] [INFO ] [MAIN      ] WIW: Loaded 20389 existing records.
[2025-10-24T21:54:13.545990] [WARN ] [MAIN      ] WIW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:54:13.546166] [INFO ] [MAIN      ] WIW: Wiping existing primary data before full refresh.
[2025-10-24T21:54:13.546214] [INFO ] [LOCAL     ] WIW: Starting deletion of primary data.
[2025-10-24T21:54:13.546427] [DEBUG] [LOCAL     ] WIW: Deleted primary data file.
[2025-10-24T21:54:13.546467] [INFO ] [MAIN      ] WIW: Starting full primary refresh.
[2025-10-24T21:54:13.753581] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-08.
[2025-10-24T21:54:13.919710] [INFO ] [REMOTE    ] WIW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:54:14.547682] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-05.
[2025-10-24T21:54:14.772769] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-03 (1.82 seconds).
[2025-10-24T21:54:15.318929] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-05 (0.77 seconds).
[2025-10-24T21:54:15.347598] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-06.
[2025-10-24T21:54:15.591244] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-08 (1.84 seconds).
[2025-10-24T21:54:15.919046] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T21:54:16.147678] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-07.
[2025-10-24T21:54:16.947629] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-04.
[2025-10-24T21:54:16.955911] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-07 (0.81 seconds).
[2025-10-24T21:54:17.747719] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-08.
[2025-10-24T21:54:18.244131] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T21:54:18.542094] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-08 (0.79 seconds).
[2025-10-24T21:54:18.547588] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-09.
[2025-10-24T21:54:19.298489] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:54:19.347714] [INFO ] [REMOTE    ] WINN: Fetching primary data for 2025-10.
[2025-10-24T21:54:20.125156] [INFO ] [REMOTE    ] WINN: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T21:54:20.127743] [INFO ] [REMOTE    ] WINN: Full fetch complete (17318 records).
[2025-10-24T21:54:20.127850] [DEBUG] [VALIDATOR ] WINN: Validating primary data.
[2025-10-24T21:54:20.147730] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-01.
[2025-10-24T21:54:20.498454] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present.
[2025-10-24T21:54:20.498531] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed.
[2025-10-24T21:54:20.498929] [INFO ] [MAIN      ] WINN: Fetched primary data is valid.
[2025-10-24T21:54:20.498991] [DEBUG] [LOCAL     ] WINN: Saving primary data.
[2025-10-24T21:54:20.499224] [FATAL] [LOCAL     ] WINN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:54:20.499304] [FATAL] [MAIN      ] WINN: Failed to save primary data.
[2025-10-24T21:54:20.499346] [WARN ] [MAIN      ] WINN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:54:20.499406] [INFO ] [LOCAL     ] WINN: Starting deletion of primary data.
[2025-10-24T21:54:20.499456] [DEBUG] [LOCAL     ] WINN: No primary data file found to delete.
[2025-10-24T21:54:20.499490] [INFO ] [LOCAL     ] WINN: Starting deletion of derivative data.
[2025-10-24T21:54:20.499710] [DEBUG] [LOCAL     ] WINN: Deleted derivative data file.
[2025-10-24T21:54:20.499800] [INFO ] [MAIN      ] Update Progress: 2292/2366 symbols completed. WINN took 25.5s. Estimated remaining: 9m 30s. Rate: 7.8 symbols/min
[2025-10-24T21:54:20.663327] [INFO ] [MAIN      ] WK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:54:20.697471] [DEBUG] [LOCAL     ] WK: Loaded 37264 existing records from primary storage.
[2025-10-24T21:54:20.697815] [INFO ] [MAIN      ] WK: Loaded 37264 existing records.
[2025-10-24T21:54:20.873078] [WARN ] [MAIN      ] WK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:54:20.873272] [INFO ] [MAIN      ] WK: Wiping existing primary data before full refresh.
[2025-10-24T21:54:20.873316] [INFO ] [LOCAL     ] WK: Starting deletion of primary data.
[2025-10-24T21:54:20.873681] [DEBUG] [LOCAL     ] WK: Deleted primary data file.
[2025-10-24T21:54:20.873736] [INFO ] [MAIN      ] WK: Starting full primary refresh.
[2025-10-24T21:54:20.952480] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-05.
[2025-10-24T21:54:21.239120] [INFO ] [REMOTE    ] WK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:54:21.265268] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T21:54:21.747767] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-02.
[2025-10-24T21:54:22.547740] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-09.
[2025-10-24T21:54:22.672554] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T21:54:22.694262] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-02 (0.95 seconds).
[2025-10-24T21:54:23.347759] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-01.
[2025-10-24T21:54:24.147730] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-03.
[2025-10-24T21:54:24.192946] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-09 (1.65 seconds).
[2025-10-24T21:54:24.709346] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-01 (1.36 seconds).
[2025-10-24T21:54:24.816243] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-03 (0.67 seconds).
[2025-10-24T21:54:24.947713] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-04.
[2025-10-24T21:54:25.747704] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-02.
[2025-10-24T21:54:26.019124] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-04 (1.07 seconds).
[2025-10-24T21:54:26.547726] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-06.
[2025-10-24T21:54:26.889210] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-02 (1.14 seconds).
[2025-10-24T21:54:27.347711] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-05.
[2025-10-24T21:54:28.151823] [INFO ] [REMOTE    ] WHR: Fetching primary data for 2025-10.
[2025-10-24T21:54:28.157914] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-06 (1.61 seconds).
[2025-10-24T21:54:28.402795] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-05 (1.06 seconds).
[2025-10-24T21:54:28.947727] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-03.
[2025-10-24T21:54:29.747716] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-06.
[2025-10-24T21:54:29.993912] [INFO ] [REMOTE    ] WHR: Incremental fetch complete for 2025-10 (1.84 seconds).
[2025-10-24T21:54:30.003882] [INFO ] [REMOTE    ] WHR: Full fetch complete (69808 records).
[2025-10-24T21:54:30.004163] [DEBUG] [VALIDATOR ] WHR: Validating primary data.
[2025-10-24T21:54:30.340302] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T21:54:30.440664] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present.
[2025-10-24T21:54:30.440749] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed.
[2025-10-24T21:54:30.441977] [INFO ] [MAIN      ] WHR: Fetched primary data is valid.
[2025-10-24T21:54:30.442479] [DEBUG] [LOCAL     ] WHR: Saving primary data.
[2025-10-24T21:54:30.443061] [FATAL] [LOCAL     ] WHR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:54:30.443142] [FATAL] [MAIN      ] WHR: Failed to save primary data.
[2025-10-24T21:54:30.443185] [WARN ] [MAIN      ] WHR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:54:30.443220] [INFO ] [LOCAL     ] WHR: Starting deletion of primary data.
[2025-10-24T21:54:30.443289] [DEBUG] [LOCAL     ] WHR: No primary data file found to delete.
[2025-10-24T21:54:30.443352] [INFO ] [LOCAL     ] WHR: Starting deletion of derivative data.
[2025-10-24T21:54:30.443733] [DEBUG] [LOCAL     ] WHR: Deleted derivative data file.
[2025-10-24T21:54:30.444136] [INFO ] [MAIN      ] Update Progress: 2293/2366 symbols completed. WHR took 46.3s. Estimated remaining: 9m 22s. Rate: 7.8 symbols/min
[2025-10-24T21:54:30.552839] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-07.
[2025-10-24T21:54:30.616229] [INFO ] [MAIN      ] WKC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:54:30.649098] [DEBUG] [LOCAL     ] WKC: Loaded 34728 existing records from primary storage.
[2025-10-24T21:54:30.649368] [INFO ] [MAIN      ] WKC: Loaded 34728 existing records.
[2025-10-24T21:54:30.847007] [WARN ] [MAIN      ] WKC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:54:30.847329] [INFO ] [MAIN      ] WKC: Wiping existing primary data before full refresh.
[2025-10-24T21:54:30.847395] [INFO ] [LOCAL     ] WKC: Starting deletion of primary data.
[2025-10-24T21:54:30.857045] [DEBUG] [LOCAL     ] WKC: Deleted primary data file.
[2025-10-24T21:54:30.857286] [INFO ] [MAIN      ] WKC: Starting full primary refresh.
[2025-10-24T21:54:30.872490] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-06 (1.12 seconds).
[2025-10-24T21:54:31.214049] [INFO ] [REMOTE    ] WKC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:54:31.347607] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-01.
[2025-10-24T21:54:32.153299] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-04.
[2025-10-24T21:54:32.159313] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T21:54:32.589251] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T21:54:32.947729] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-08.
[2025-10-24T21:54:33.637503] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-04 (1.48 seconds).
[2025-10-24T21:54:33.747693] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-05.
[2025-10-24T21:54:34.547712] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-02.
[2025-10-24T21:54:34.612587] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-08 (1.66 seconds).
[2025-10-24T21:54:35.244275] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T21:54:35.347726] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-09.
[2025-10-24T21:54:35.898877] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-02 (1.35 seconds).
[2025-10-24T21:54:36.147689] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-06.
[2025-10-24T21:54:36.947697] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-03.
[2025-10-24T21:54:37.079957] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-09 (1.73 seconds).
[2025-10-24T21:54:37.504440] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T21:54:37.747728] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-07.
[2025-10-24T21:54:37.926537] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-03 (0.98 seconds).
[2025-10-24T21:54:38.547713] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-04.
[2025-10-24T21:54:39.094166] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T21:54:39.347787] [INFO ] [REMOTE    ] WIT: Fetching primary data for 2025-10.
[2025-10-24T21:54:39.552348] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-04 (1.00 seconds).
[2025-10-24T21:54:40.147728] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-07.
[2025-10-24T21:54:40.725499] [INFO ] [REMOTE    ] WIT: Incremental fetch complete for 2025-10 (1.38 seconds).
[2025-10-24T21:54:40.736575] [INFO ] [REMOTE    ] WIT: Full fetch complete (76023 records).
[2025-10-24T21:54:40.736777] [DEBUG] [VALIDATOR ] WIT: Validating primary data.
[2025-10-24T21:54:40.892983] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-07 (0.75 seconds).
[2025-10-24T21:54:40.954712] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-05.
[2025-10-24T21:54:41.154693] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present.
[2025-10-24T21:54:41.154778] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed.
[2025-10-24T21:54:41.156342] [INFO ] [MAIN      ] WIT: Fetched primary data is valid.
[2025-10-24T21:54:41.156405] [DEBUG] [LOCAL     ] WIT: Saving primary data.
[2025-10-24T21:54:41.157076] [FATAL] [LOCAL     ] WIT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:54:41.157178] [FATAL] [MAIN      ] WIT: Failed to save primary data.
[2025-10-24T21:54:41.157232] [WARN ] [MAIN      ] WIT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:54:41.157280] [INFO ] [LOCAL     ] WIT: Starting deletion of primary data.
[2025-10-24T21:54:41.157349] [DEBUG] [LOCAL     ] WIT: No primary data file found to delete.
[2025-10-24T21:54:41.157401] [INFO ] [LOCAL     ] WIT: Starting deletion of derivative data.
[2025-10-24T21:54:41.157724] [DEBUG] [LOCAL     ] WIT: Deleted derivative data file.
[2025-10-24T21:54:41.158097] [INFO ] [MAIN      ] Update Progress: 2294/2366 symbols completed. WIT took 38.0s. Estimated remaining: 9m 15s. Rate: 7.8 symbols/min
[2025-10-24T21:54:41.322246] [INFO ] [MAIN      ] WLK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:54:41.362898] [DEBUG] [LOCAL     ] WLK: Loaded 46176 existing records from primary storage.
[2025-10-24T21:54:41.363192] [INFO ] [MAIN      ] WLK: Loaded 46176 existing records.
[2025-10-24T21:54:41.534976] [WARN ] [MAIN      ] WLK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:54:41.535181] [INFO ] [MAIN      ] WLK: Wiping existing primary data before full refresh.
[2025-10-24T21:54:41.535231] [INFO ] [LOCAL     ] WLK: Starting deletion of primary data.
[2025-10-24T21:54:41.535692] [DEBUG] [LOCAL     ] WLK: Deleted primary data file.
[2025-10-24T21:54:41.535747] [INFO ] [MAIN      ] WLK: Starting full primary refresh.
[2025-10-24T21:54:41.752922] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-08.
[2025-10-24T21:54:41.911868] [INFO ] [REMOTE    ] WLK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:54:42.416786] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-05 (1.46 seconds).
[2025-10-24T21:54:42.547681] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-08.
[2025-10-24T21:54:43.339550] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-08 (1.59 seconds).
[2025-10-24T21:54:43.347717] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-01.
[2025-10-24T21:54:43.699847] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T21:54:44.147689] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-09.
[2025-10-24T21:54:44.842006] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T21:54:44.947696] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-09.
[2025-10-24T21:54:45.583074] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T21:54:45.747607] [INFO ] [REMOTE    ] WK: Fetching primary data for 2025-10.
[2025-10-24T21:54:45.957584] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-09 (1.01 seconds).
[2025-10-24T21:54:46.547711] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-02.
[2025-10-24T21:54:47.154939] [INFO ] [REMOTE    ] WK: Incremental fetch complete for 2025-10 (1.41 seconds).
[2025-10-24T21:54:47.162175] [INFO ] [REMOTE    ] WK: Full fetch complete (53444 records).
[2025-10-24T21:54:47.162292] [DEBUG] [VALIDATOR ] WK: Validating primary data.
[2025-10-24T21:54:47.352845] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-06.
[2025-10-24T21:54:47.547233] [DEBUG] [VALIDATOR ] WK: All expected trading days are present.
[2025-10-24T21:54:47.547306] [DEBUG] [VALIDATOR ] WK: Primary data validation passed.
[2025-10-24T21:54:47.548304] [INFO ] [MAIN      ] WK: Fetched primary data is valid.
[2025-10-24T21:54:47.548365] [DEBUG] [LOCAL     ] WK: Saving primary data.
[2025-10-24T21:54:47.548795] [FATAL] [LOCAL     ] WK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:54:47.548882] [FATAL] [MAIN      ] WK: Failed to save primary data.
[2025-10-24T21:54:47.548923] [WARN ] [MAIN      ] WK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:54:47.548956] [INFO ] [LOCAL     ] WK: Starting deletion of primary data.
[2025-10-24T21:54:47.549005] [DEBUG] [LOCAL     ] WK: No primary data file found to delete.
[2025-10-24T21:54:47.549039] [INFO ] [LOCAL     ] WK: Starting deletion of derivative data.
[2025-10-24T21:54:47.549194] [DEBUG] [LOCAL     ] WK: Deleted derivative data file.
[2025-10-24T21:54:47.549265] [INFO ] [MAIN      ] Update Progress: 2295/2366 symbols completed. WK took 27.0s. Estimated remaining: 9m 7s. Rate: 7.8 symbols/min
[2025-10-24T21:54:47.723489] [INFO ] [MAIN      ] WLKP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:54:47.733512] [DEBUG] [LOCAL     ] WLKP: Loaded 7323 existing records from primary storage.
[2025-10-24T21:54:47.733761] [INFO ] [MAIN      ] WLKP: Loaded 7323 existing records.
[2025-10-24T21:54:47.915815] [WARN ] [MAIN      ] WLKP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:54:47.916168] [INFO ] [MAIN      ] WLKP: Wiping existing primary data before full refresh.
[2025-10-24T21:54:47.916296] [INFO ] [LOCAL     ] WLKP: Starting deletion of primary data.
[2025-10-24T21:54:47.916493] [DEBUG] [LOCAL     ] WLKP: Deleted primary data file.
[2025-10-24T21:54:47.916546] [INFO ] [MAIN      ] WLKP: Starting full primary refresh.
[2025-10-24T21:54:48.157354] [INFO ] [REMOTE    ] WIW: Fetching primary data for 2025-10.
[2025-10-24T21:54:48.274916] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-02 (1.73 seconds).
[2025-10-24T21:54:48.310400] [INFO ] [REMOTE    ] WLKP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:54:48.828619] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T21:54:48.947666] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-03.
[2025-10-24T21:54:49.292529] [INFO ] [REMOTE    ] WIW: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T21:54:49.296428] [INFO ] [REMOTE    ] WIW: Full fetch complete (29268 records).
[2025-10-24T21:54:49.296511] [DEBUG] [VALIDATOR ] WIW: Validating primary data.
[2025-10-24T21:54:49.668420] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present.
[2025-10-24T21:54:49.668511] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed.
[2025-10-24T21:54:49.669219] [INFO ] [MAIN      ] WIW: Fetched primary data is valid.
[2025-10-24T21:54:49.669302] [DEBUG] [LOCAL     ] WIW: Saving primary data.
[2025-10-24T21:54:49.669612] [FATAL] [LOCAL     ] WIW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:54:49.669714] [FATAL] [MAIN      ] WIW: Failed to save primary data.
[2025-10-24T21:54:49.669758] [WARN ] [MAIN      ] WIW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:54:49.669795] [INFO ] [LOCAL     ] WIW: Starting deletion of primary data.
[2025-10-24T21:54:49.669846] [DEBUG] [LOCAL     ] WIW: No primary data file found to delete.
[2025-10-24T21:54:49.669882] [INFO ] [LOCAL     ] WIW: Starting deletion of derivative data.
[2025-10-24T21:54:49.670072] [DEBUG] [LOCAL     ] WIW: Deleted derivative data file.
[2025-10-24T21:54:49.670163] [INFO ] [MAIN      ] Update Progress: 2296/2366 symbols completed. WIW took 36.5s. Estimated remaining: 8m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:54:49.752757] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-01.
[2025-10-24T21:54:49.849609] [INFO ] [MAIN      ] WLTG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:54:49.849777] [DEBUG] [LOCAL     ] WLTG: No existing data file found in primary storage.
[2025-10-24T21:54:49.849821] [WARN ] [MAIN      ] WLTG: No existing data found, performing full refresh instead.
[2025-10-24T21:54:49.849932] [INFO ] [MAIN      ] WLTG: Wiping existing primary data before full refresh.
[2025-10-24T21:54:49.849976] [INFO ] [LOCAL     ] WLTG: Starting deletion of primary data.
[2025-10-24T21:54:49.850023] [DEBUG] [LOCAL     ] WLTG: No primary data file found to delete.
[2025-10-24T21:54:49.850056] [INFO ] [MAIN      ] WLTG: Starting full primary refresh.
[2025-10-24T21:54:50.230225] [INFO ] [REMOTE    ] WLTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:54:50.400009] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T21:54:50.535774] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-01 (0.78 seconds).
[2025-10-24T21:54:50.547601] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-04.
[2025-10-24T21:54:51.347706] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-07.
[2025-10-24T21:54:52.147712] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-01.
[2025-10-24T21:54:52.204382] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T21:54:52.533046] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-01 (0.39 seconds).
[2025-10-24T21:54:52.675061] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-07 (1.33 seconds).
[2025-10-24T21:54:52.947687] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-05.
[2025-10-24T21:54:53.747724] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-02.
[2025-10-24T21:54:54.423221] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-02 (0.68 seconds).
[2025-10-24T21:54:54.547635] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-08.
[2025-10-24T21:54:54.743192] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-05 (1.80 seconds).
[2025-10-24T21:54:55.347698] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-06.
[2025-10-24T21:54:55.968009] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-08 (1.42 seconds).
[2025-10-24T21:54:56.147719] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-03.
[2025-10-24T21:54:56.764070] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-03 (0.62 seconds).
[2025-10-24T21:54:56.947720] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-09.
[2025-10-24T21:54:57.225877] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-06 (1.88 seconds).
[2025-10-24T21:54:57.747704] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-02.
[2025-10-24T21:54:58.363615] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-02 (0.62 seconds).
[2025-10-24T21:54:58.388573] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-09 (1.44 seconds).
[2025-10-24T21:54:58.547672] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-07.
[2025-10-24T21:54:59.347677] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-03.
[2025-10-24T21:54:59.715046] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-03 (0.37 seconds).
[2025-10-24T21:55:00.147685] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-04.
[2025-10-24T21:55:00.184130] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-07 (1.64 seconds).
[2025-10-24T21:55:00.610406] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-04 (0.46 seconds).
[2025-10-24T21:55:00.947694] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-04.
[2025-10-24T21:55:01.747741] [INFO ] [REMOTE    ] WKC: Fetching primary data for 2025-10.
[2025-10-24T21:55:01.772590] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T21:55:02.547717] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-05.
[2025-10-24T21:55:02.917067] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-05 (0.37 seconds).
[2025-10-24T21:55:03.082257] [INFO ] [REMOTE    ] WKC: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T21:55:03.088684] [INFO ] [REMOTE    ] WKC: Full fetch complete (50217 records).
[2025-10-24T21:55:03.088879] [DEBUG] [VALIDATOR ] WKC: Validating primary data.
[2025-10-24T21:55:03.353741] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-08.
[2025-10-24T21:55:03.487729] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present.
[2025-10-24T21:55:03.487839] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed.
[2025-10-24T21:55:03.489053] [INFO ] [MAIN      ] WKC: Fetched primary data is valid.
[2025-10-24T21:55:03.489119] [DEBUG] [LOCAL     ] WKC: Saving primary data.
[2025-10-24T21:55:03.489702] [FATAL] [LOCAL     ] WKC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:55:03.489798] [FATAL] [MAIN      ] WKC: Failed to save primary data.
[2025-10-24T21:55:03.489849] [WARN ] [MAIN      ] WKC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:55:03.489885] [INFO ] [LOCAL     ] WKC: Starting deletion of primary data.
[2025-10-24T21:55:03.489939] [DEBUG] [LOCAL     ] WKC: No primary data file found to delete.
[2025-10-24T21:55:03.489976] [INFO ] [LOCAL     ] WKC: Starting deletion of derivative data.
[2025-10-24T21:55:03.490159] [DEBUG] [LOCAL     ] WKC: Deleted derivative data file.
[2025-10-24T21:55:03.490242] [INFO ] [MAIN      ] Update Progress: 2297/2366 symbols completed. WKC took 33.0s. Estimated remaining: 8m 52s. Rate: 7.8 symbols/min
[2025-10-24T21:55:03.661945] [INFO ] [MAIN      ] WLY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:55:03.690227] [DEBUG] [LOCAL     ] WLY: Loaded 29962 existing records from primary storage.
[2025-10-24T21:55:03.690485] [INFO ] [MAIN      ] WLY: Loaded 29962 existing records.
[2025-10-24T21:55:03.867396] [WARN ] [MAIN      ] WLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:55:03.867692] [INFO ] [MAIN      ] WLY: Wiping existing primary data before full refresh.
[2025-10-24T21:55:03.867754] [INFO ] [LOCAL     ] WLY: Starting deletion of primary data.
[2025-10-24T21:55:03.868115] [DEBUG] [LOCAL     ] WLY: Deleted primary data file.
[2025-10-24T21:55:03.868169] [INFO ] [MAIN      ] WLY: Starting full primary refresh.
[2025-10-24T21:55:04.152714] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-06.
[2025-10-24T21:55:04.224969] [INFO ] [REMOTE    ] WLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:55:04.577962] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-06 (0.43 seconds).
[2025-10-24T21:55:04.947710] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-07.
[2025-10-24T21:55:05.039372] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T21:55:05.425904] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-07 (0.48 seconds).
[2025-10-24T21:55:05.747714] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-08.
[2025-10-24T21:55:06.187341] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-08 (0.44 seconds).
[2025-10-24T21:55:06.547688] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-09.
[2025-10-24T21:55:07.347679] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-09.
[2025-10-24T21:55:07.707606] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-09 (0.36 seconds).
[2025-10-24T21:55:08.147689] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-01.
[2025-10-24T21:55:08.222156] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T21:55:08.947673] [INFO ] [REMOTE    ] WLK: Fetching primary data for 2025-10.
[2025-10-24T21:55:09.342489] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-01 (1.19 seconds).
[2025-10-24T21:55:09.747706] [INFO ] [REMOTE    ] WLTG: Fetching primary data for 2025-10.
[2025-10-24T21:55:10.137571] [INFO ] [REMOTE    ] WLTG: Incremental fetch complete for 2025-10 (0.39 seconds).
[2025-10-24T21:55:10.142046] [INFO ] [REMOTE    ] WLTG: Full fetch complete (1658 records).
[2025-10-24T21:55:10.142155] [DEBUG] [VALIDATOR ] WLTG: Validating primary data.
[2025-10-24T21:55:10.332125] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T21:55:10.332337] [FATAL] [MAIN      ] WLTG: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:55:10.332414] [WARN ] [MAIN      ] WLTG: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:55:10.332496] [INFO ] [LOCAL     ] WLTG: Starting deletion of primary data.
[2025-10-24T21:55:10.332575] [DEBUG] [LOCAL     ] WLTG: No primary data file found to delete.
[2025-10-24T21:55:10.332618] [INFO ] [LOCAL     ] WLTG: Starting deletion of derivative data.
[2025-10-24T21:55:10.332706] [DEBUG] [LOCAL     ] WLTG: No derivative data file found to delete.
[2025-10-24T21:55:10.332800] [INFO ] [MAIN      ] Update Progress: 2298/2366 symbols completed. WLTG took 20.7s. Estimated remaining: 8m 44s. Rate: 7.8 symbols/min
[2025-10-24T21:55:10.515189] [INFO ] [MAIN      ] WM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:55:10.547779] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-05.
[2025-10-24T21:55:10.550830] [INFO ] [REMOTE    ] WLK: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T21:55:10.560494] [INFO ] [REMOTE    ] WLK: Full fetch complete (64112 records).
[2025-10-24T21:55:10.560688] [DEBUG] [VALIDATOR ] WLK: Validating primary data.
[2025-10-24T21:55:10.718243] [DEBUG] [LOCAL     ] WM: Loaded 51209 existing records from primary storage.
[2025-10-24T21:55:10.742008] [INFO ] [MAIN      ] WM: Loaded 51209 existing records.
[2025-10-24T21:55:11.093574] [WARN ] [MAIN      ] WM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:55:11.093876] [INFO ] [MAIN      ] WM: Wiping existing primary data before full refresh.
[2025-10-24T21:55:11.099520] [INFO ] [LOCAL     ] WM: Starting deletion of primary data.
[2025-10-24T21:55:11.120479] [DEBUG] [LOCAL     ] WM: Deleted primary data file.
[2025-10-24T21:55:11.166965] [INFO ] [MAIN      ] WM: Starting full primary refresh.
[2025-10-24T21:55:11.223750] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present.
[2025-10-24T21:55:11.241716] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed.
[2025-10-24T21:55:11.251423] [INFO ] [MAIN      ] WLK: Fetched primary data is valid.
[2025-10-24T21:55:11.263249] [DEBUG] [LOCAL     ] WLK: Saving primary data.
[2025-10-24T21:55:11.269030] [FATAL] [LOCAL     ] WLK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:55:11.287640] [FATAL] [MAIN      ] WLK: Failed to save primary data.
[2025-10-24T21:55:11.289994] [WARN ] [MAIN      ] WLK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:55:11.290111] [INFO ] [LOCAL     ] WLK: Starting deletion of primary data.
[2025-10-24T21:55:11.290203] [DEBUG] [LOCAL     ] WLK: No primary data file found to delete.
[2025-10-24T21:55:11.295883] [INFO ] [LOCAL     ] WLK: Starting deletion of derivative data.
[2025-10-24T21:55:11.340435] [DEBUG] [LOCAL     ] WLK: Deleted derivative data file.
[2025-10-24T21:55:11.340909] [INFO ] [MAIN      ] Update Progress: 2299/2366 symbols completed. WLK took 30.2s. Estimated remaining: 8m 36s. Rate: 7.8 symbols/min
[2025-10-24T21:55:11.351760] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-02.
[2025-10-24T21:55:11.340785] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T21:55:11.724137] [INFO ] [MAIN      ] WMB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:55:11.722773] [INFO ] [REMOTE    ] WM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:55:11.772509] [DEBUG] [LOCAL     ] WMB: Loaded 54062 existing records from primary storage.
[2025-10-24T21:55:11.772849] [INFO ] [MAIN      ] WMB: Loaded 54062 existing records.
[2025-10-24T21:55:11.948993] [WARN ] [MAIN      ] WMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:55:11.949208] [INFO ] [MAIN      ] WMB: Wiping existing primary data before full refresh.
[2025-10-24T21:55:11.949255] [INFO ] [LOCAL     ] WMB: Starting deletion of primary data.
[2025-10-24T21:55:11.949863] [DEBUG] [LOCAL     ] WMB: Deleted primary data file.
[2025-10-24T21:55:11.949919] [INFO ] [MAIN      ] WMB: Starting full primary refresh.
[2025-10-24T21:55:12.156970] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-01.
[2025-10-24T21:55:12.308512] [INFO ] [REMOTE    ] WMB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:55:12.656834] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-02 (1.31 seconds).
[2025-10-24T21:55:12.947716] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-01.
[2025-10-24T21:55:13.747717] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-06.
[2025-10-24T21:55:14.260169] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-01 (2.10 seconds).
[2025-10-24T21:55:14.442295] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-01 (1.49 seconds).
[2025-10-24T21:55:14.472767] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T21:55:14.547607] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-07.
[2025-10-24T21:55:15.232409] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-07 (0.68 seconds).
[2025-10-24T21:55:15.347639] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-08.
[2025-10-24T21:55:16.114134] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-08 (0.77 seconds).
[2025-10-24T21:55:16.147662] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-09.
[2025-10-24T21:55:16.890185] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-09 (0.74 seconds).
[2025-10-24T21:55:16.947671] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-03.
[2025-10-24T21:55:17.747691] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-02.
[2025-10-24T21:55:17.954355] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-03 (1.01 seconds).
[2025-10-24T21:55:18.547742] [INFO ] [REMOTE    ] WLKP: Fetching primary data for 2025-10.
[2025-10-24T21:55:19.347634] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-02.
[2025-10-24T21:55:19.424142] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-02 (1.68 seconds).
[2025-10-24T21:55:19.440366] [INFO ] [REMOTE    ] WLKP: Incremental fetch complete for 2025-10 (0.89 seconds).
[2025-10-24T21:55:19.442688] [INFO ] [REMOTE    ] WLKP: Full fetch complete (10057 records).
[2025-10-24T21:55:19.442763] [DEBUG] [VALIDATOR ] WLKP: Validating primary data.
[2025-10-24T21:55:19.801255] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present.
[2025-10-24T21:55:19.801329] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed.
[2025-10-24T21:55:19.801568] [INFO ] [MAIN      ] WLKP: Fetched primary data is valid.
[2025-10-24T21:55:19.801606] [DEBUG] [LOCAL     ] WLKP: Saving primary data.
[2025-10-24T21:55:19.801828] [FATAL] [LOCAL     ] WLKP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:55:19.801922] [FATAL] [MAIN      ] WLKP: Failed to save primary data.
[2025-10-24T21:55:19.801990] [WARN ] [MAIN      ] WLKP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:55:19.802084] [INFO ] [LOCAL     ] WLKP: Starting deletion of primary data.
[2025-10-24T21:55:19.802157] [DEBUG] [LOCAL     ] WLKP: No primary data file found to delete.
[2025-10-24T21:55:19.802193] [INFO ] [LOCAL     ] WLKP: Starting deletion of derivative data.
[2025-10-24T21:55:19.802358] [DEBUG] [LOCAL     ] WLKP: Deleted derivative data file.
[2025-10-24T21:55:19.802444] [INFO ] [MAIN      ] Update Progress: 2300/2366 symbols completed. WLKP took 32.3s. Estimated remaining: 8m 28s. Rate: 7.8 symbols/min
[2025-10-24T21:55:19.981431] [INFO ] [MAIN      ] WMK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:55:19.997137] [DEBUG] [LOCAL     ] WMK: Loaded 14724 existing records from primary storage.
[2025-10-24T21:55:19.997377] [INFO ] [MAIN      ] WMK: Loaded 14724 existing records.
[2025-10-24T21:55:20.150147] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-04.
[2025-10-24T21:55:20.179995] [WARN ] [MAIN      ] WMK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:55:20.180616] [INFO ] [MAIN      ] WMK: Wiping existing primary data before full refresh.
[2025-10-24T21:55:20.180703] [INFO ] [LOCAL     ] WMK: Starting deletion of primary data.
[2025-10-24T21:55:20.180915] [DEBUG] [LOCAL     ] WMK: Deleted primary data file.
[2025-10-24T21:55:20.180973] [INFO ] [MAIN      ] WMK: Starting full primary refresh.
[2025-10-24T21:55:20.549126] [INFO ] [REMOTE    ] WMK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:55:20.947698] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-03.
[2025-10-24T21:55:21.194266] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-02 (1.85 seconds).
[2025-10-24T21:55:21.560299] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-04 (1.41 seconds).
[2025-10-24T21:55:21.747697] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-05.
[2025-10-24T21:55:22.547636] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-03.
[2025-10-24T21:55:22.792577] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-03 (1.84 seconds).
[2025-10-24T21:55:23.006488] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-05 (1.26 seconds).
[2025-10-24T21:55:23.347717] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-04.
[2025-10-24T21:55:24.147604] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-06.
[2025-10-24T21:55:24.343092] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-03 (1.80 seconds).
[2025-10-24T21:55:24.947664] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-01.
[2025-10-24T21:55:25.355403] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-04 (2.01 seconds).
[2025-10-24T21:55:25.507873] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-06 (1.36 seconds).
[2025-10-24T21:55:25.747747] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-05.
[2025-10-24T21:55:25.789106] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T21:55:26.547687] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-07.
[2025-10-24T21:55:27.347722] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-02.
[2025-10-24T21:55:27.434905] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-05 (1.69 seconds).
[2025-10-24T21:55:27.884807] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-07 (1.34 seconds).
[2025-10-24T21:55:28.113190] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-02 (0.77 seconds).
[2025-10-24T21:55:28.147699] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-08.
[2025-10-24T21:55:28.947696] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-06.
[2025-10-24T21:55:29.294632] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T21:55:29.747717] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-09.
[2025-10-24T21:55:30.547631] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-03.
[2025-10-24T21:55:30.671824] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-06 (1.72 seconds).
[2025-10-24T21:55:30.966189] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T21:55:31.347631] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-04.
[2025-10-24T21:55:31.510975] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-03 (0.96 seconds).
[2025-10-24T21:55:32.147791] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-04.
[2025-10-24T21:55:32.947629] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-07.
[2025-10-24T21:55:33.171602] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T21:55:33.242733] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T21:55:33.747712] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-05.
[2025-10-24T21:55:34.547701] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-05.
[2025-10-24T21:55:34.759046] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-07 (1.81 seconds).
[2025-10-24T21:55:35.347638] [INFO ] [REMOTE    ] WLY: Fetching primary data for 2025-10.
[2025-10-24T21:55:35.501962] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T21:55:35.544419] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-05 (1.00 seconds).
[2025-10-24T21:55:36.147705] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-06.
[2025-10-24T21:55:36.533962] [INFO ] [REMOTE    ] WLY: Incremental fetch complete for 2025-10 (1.19 seconds).
[2025-10-24T21:55:36.539497] [INFO ] [REMOTE    ] WLY: Full fetch complete (42815 records).
[2025-10-24T21:55:36.539583] [DEBUG] [VALIDATOR ] WLY: Validating primary data.
[2025-10-24T21:55:36.943000] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present.
[2025-10-24T21:55:36.943087] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed.
[2025-10-24T21:55:36.944004] [INFO ] [MAIN      ] WLY: Fetched primary data is valid.
[2025-10-24T21:55:36.944066] [DEBUG] [LOCAL     ] WLY: Saving primary data.
[2025-10-24T21:55:36.944438] [FATAL] [LOCAL     ] WLY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:55:36.944517] [FATAL] [MAIN      ] WLY: Failed to save primary data.
[2025-10-24T21:55:36.944560] [WARN ] [MAIN      ] WLY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:55:36.944626] [INFO ] [LOCAL     ] WLY: Starting deletion of primary data.
[2025-10-24T21:55:36.944723] [DEBUG] [LOCAL     ] WLY: No primary data file found to delete.
[2025-10-24T21:55:36.944769] [INFO ] [LOCAL     ] WLY: Starting deletion of derivative data.
[2025-10-24T21:55:36.944946] [DEBUG] [LOCAL     ] WLY: Deleted derivative data file.
[2025-10-24T21:55:36.945038] [INFO ] [MAIN      ] Update Progress: 2301/2366 symbols completed. WLY took 33.5s. Estimated remaining: 8m 21s. Rate: 7.8 symbols/min
[2025-10-24T21:55:36.956822] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-06.
[2025-10-24T21:55:37.104787] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-06 (0.96 seconds).
[2025-10-24T21:55:37.137839] [INFO ] [MAIN      ] WMS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:55:37.175315] [DEBUG] [LOCAL     ] WMS: Loaded 39739 existing records from primary storage.
[2025-10-24T21:55:37.175590] [INFO ] [MAIN      ] WMS: Loaded 39739 existing records.
[2025-10-24T21:55:37.358204] [WARN ] [MAIN      ] WMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:55:37.358454] [INFO ] [MAIN      ] WMS: Wiping existing primary data before full refresh.
[2025-10-24T21:55:37.358500] [INFO ] [LOCAL     ] WMS: Starting deletion of primary data.
[2025-10-24T21:55:37.358771] [DEBUG] [LOCAL     ] WMS: Deleted primary data file.
[2025-10-24T21:55:37.358829] [INFO ] [MAIN      ] WMS: Starting full primary refresh.
[2025-10-24T21:55:37.717813] [INFO ] [REMOTE    ] WMS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:55:37.747606] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-01.
[2025-10-24T21:55:38.547628] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-08.
[2025-10-24T21:55:38.742189] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T21:55:39.097224] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-01 (1.35 seconds).
[2025-10-24T21:55:39.347731] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-07.
[2025-10-24T21:55:40.147747] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-07.
[2025-10-24T21:55:40.316903] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T21:55:40.940038] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-07 (0.79 seconds).
[2025-10-24T21:55:40.947591] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-08.
[2025-10-24T21:55:41.680390] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-07 (2.33 seconds).
[2025-10-24T21:55:41.747720] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-02.
[2025-10-24T21:55:41.943782] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T21:55:42.547691] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-08.
[2025-10-24T21:55:43.180611] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T21:55:43.347727] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-09.
[2025-10-24T21:55:44.093587] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T21:55:44.147639] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-09.
[2025-10-24T21:55:44.947637] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-03.
[2025-10-24T21:55:45.042250] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T21:55:45.747726] [INFO ] [REMOTE    ] WMB: Fetching primary data for 2025-10.
[2025-10-24T21:55:46.015255] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-09 (1.87 seconds).
[2025-10-24T21:55:46.339195] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-03 (1.39 seconds).
[2025-10-24T21:55:46.476241] [INFO ] [REMOTE    ] WMB: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:55:46.486471] [INFO ] [REMOTE    ] WMB: Full fetch complete (77851 records).
[2025-10-24T21:55:46.486671] [DEBUG] [VALIDATOR ] WMB: Validating primary data.
[2025-10-24T21:55:46.552807] [INFO ] [REMOTE    ] WM: Fetching primary data for 2025-10.
[2025-10-24T21:55:46.886284] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present.
[2025-10-24T21:55:46.886363] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed.
[2025-10-24T21:55:46.887593] [INFO ] [MAIN      ] WMB: Fetched primary data is valid.
[2025-10-24T21:55:46.887702] [DEBUG] [LOCAL     ] WMB: Saving primary data.
[2025-10-24T21:55:46.888337] [FATAL] [LOCAL     ] WMB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:55:46.888455] [FATAL] [MAIN      ] WMB: Failed to save primary data.
[2025-10-24T21:55:46.888535] [WARN ] [MAIN      ] WMB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:55:46.888616] [INFO ] [LOCAL     ] WMB: Starting deletion of primary data.
[2025-10-24T21:55:46.888724] [DEBUG] [LOCAL     ] WMB: No primary data file found to delete.
[2025-10-24T21:55:46.888770] [INFO ] [LOCAL     ] WMB: Starting deletion of derivative data.
[2025-10-24T21:55:46.888970] [DEBUG] [LOCAL     ] WMB: Deleted derivative data file.
[2025-10-24T21:55:46.889377] [INFO ] [MAIN      ] Update Progress: 2302/2366 symbols completed. WMB took 35.5s. Estimated remaining: 8m 13s. Rate: 7.8 symbols/min
[2025-10-24T21:55:47.059465] [INFO ] [MAIN      ] WMT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:55:47.111220] [DEBUG] [LOCAL     ] WMT: Loaded 54190 existing records from primary storage.
[2025-10-24T21:55:47.111535] [INFO ] [MAIN      ] WMT: Loaded 54190 existing records.
[2025-10-24T21:55:47.290796] [WARN ] [MAIN      ] WMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:55:47.291045] [INFO ] [MAIN      ] WMT: Wiping existing primary data before full refresh.
[2025-10-24T21:55:47.291210] [INFO ] [LOCAL     ] WMT: Starting deletion of primary data.
[2025-10-24T21:55:47.292167] [DEBUG] [LOCAL     ] WMT: Deleted primary data file.
[2025-10-24T21:55:47.292226] [INFO ] [MAIN      ] WMT: Starting full primary refresh.
[2025-10-24T21:55:47.354952] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-09.
[2025-10-24T21:55:47.605372] [INFO ] [REMOTE    ] WM: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T21:55:47.648935] [INFO ] [REMOTE    ] WM: Full fetch complete (73828 records).
[2025-10-24T21:55:47.685066] [DEBUG] [VALIDATOR ] WM: Validating primary data.
[2025-10-24T21:55:47.712176] [INFO ] [REMOTE    ] WMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:55:48.151840] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-01.
[2025-10-24T21:55:48.152143] [DEBUG] [VALIDATOR ] WM: All expected trading days are present.
[2025-10-24T21:55:48.153100] [DEBUG] [VALIDATOR ] WM: Primary data validation passed.
[2025-10-24T21:55:48.154289] [INFO ] [MAIN      ] WM: Fetched primary data is valid.
[2025-10-24T21:55:48.154354] [DEBUG] [LOCAL     ] WM: Saving primary data.
[2025-10-24T21:55:48.154966] [FATAL] [LOCAL     ] WM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:55:48.155059] [FATAL] [MAIN      ] WM: Failed to save primary data.
[2025-10-24T21:55:48.155121] [WARN ] [MAIN      ] WM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:55:48.155186] [INFO ] [LOCAL     ] WM: Starting deletion of primary data.
[2025-10-24T21:55:48.155245] [DEBUG] [LOCAL     ] WM: No primary data file found to delete.
[2025-10-24T21:55:48.155281] [INFO ] [LOCAL     ] WM: Starting deletion of derivative data.
[2025-10-24T21:55:48.155515] [DEBUG] [LOCAL     ] WM: Deleted derivative data file.
[2025-10-24T21:55:48.155850] [INFO ] [MAIN      ] Update Progress: 2303/2366 symbols completed. WM took 37.8s. Estimated remaining: 8m 5s. Rate: 7.8 symbols/min
[2025-10-24T21:55:48.332947] [INFO ] [MAIN      ] WNC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:55:48.343030] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T21:55:48.381275] [DEBUG] [LOCAL     ] WNC: Loaded 38303 existing records from primary storage.
[2025-10-24T21:55:48.381548] [INFO ] [MAIN      ] WNC: Loaded 38303 existing records.
[2025-10-24T21:55:48.569803] [WARN ] [MAIN      ] WNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:55:48.570126] [INFO ] [MAIN      ] WNC: Wiping existing primary data before full refresh.
[2025-10-24T21:55:48.570228] [INFO ] [LOCAL     ] WNC: Starting deletion of primary data.
[2025-10-24T21:55:48.570741] [DEBUG] [LOCAL     ] WNC: Deleted primary data file.
[2025-10-24T21:55:48.570798] [INFO ] [MAIN      ] WNC: Starting full primary refresh.
[2025-10-24T21:55:48.948849] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-04.
[2025-10-24T21:55:48.948749] [INFO ] [REMOTE    ] WNC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:55:49.747732] [INFO ] [REMOTE    ] WMK: Fetching primary data for 2025-10.
[2025-10-24T21:55:50.309855] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-04 (1.36 seconds).
[2025-10-24T21:55:50.399441] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-01 (2.25 seconds).
[2025-10-24T21:55:50.547635] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-02.
[2025-10-24T21:55:50.601345] [INFO ] [REMOTE    ] WMK: Incremental fetch complete for 2025-10 (0.85 seconds).
[2025-10-24T21:55:50.604103] [INFO ] [REMOTE    ] WMK: Full fetch complete (20033 records).
[2025-10-24T21:55:50.604173] [DEBUG] [VALIDATOR ] WMK: Validating primary data.
[2025-10-24T21:55:50.961039] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present.
[2025-10-24T21:55:50.961120] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed.
[2025-10-24T21:55:50.961775] [INFO ] [MAIN      ] WMK: Fetched primary data is valid.
[2025-10-24T21:55:50.961836] [DEBUG] [LOCAL     ] WMK: Saving primary data.
[2025-10-24T21:55:50.962102] [FATAL] [LOCAL     ] WMK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:55:50.962183] [FATAL] [MAIN      ] WMK: Failed to save primary data.
[2025-10-24T21:55:50.962224] [WARN ] [MAIN      ] WMK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:55:50.962258] [INFO ] [LOCAL     ] WMK: Starting deletion of primary data.
[2025-10-24T21:55:50.962307] [DEBUG] [LOCAL     ] WMK: No primary data file found to delete.
[2025-10-24T21:55:50.962341] [INFO ] [LOCAL     ] WMK: Starting deletion of derivative data.
[2025-10-24T21:55:50.962517] [DEBUG] [LOCAL     ] WMK: Deleted derivative data file.
[2025-10-24T21:55:50.962610] [INFO ] [MAIN      ] Update Progress: 2304/2366 symbols completed. WMK took 31.2s. Estimated remaining: 7m 58s. Rate: 7.8 symbols/min
[2025-10-24T21:55:51.129526] [INFO ] [MAIN      ] WOLF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:55:51.180628] [DEBUG] [LOCAL     ] WOLF: Loaded 53356 existing records from primary storage.
[2025-10-24T21:55:51.181013] [INFO ] [MAIN      ] WOLF: Loaded 53356 existing records.
[2025-10-24T21:55:51.353207] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-05.
[2025-10-24T21:55:51.359736] [WARN ] [MAIN      ] WOLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:55:51.360077] [INFO ] [MAIN      ] WOLF: Wiping existing primary data before full refresh.
[2025-10-24T21:55:51.360125] [INFO ] [LOCAL     ] WOLF: Starting deletion of primary data.
[2025-10-24T21:55:51.361021] [DEBUG] [LOCAL     ] WOLF: Deleted primary data file.
[2025-10-24T21:55:51.361080] [INFO ] [MAIN      ] WOLF: Starting full primary refresh.
[2025-10-24T21:55:51.714470] [INFO ] [REMOTE    ] WOLF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:55:52.147730] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-01.
[2025-10-24T21:55:52.744743] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-02 (2.20 seconds).
[2025-10-24T21:55:52.930616] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-05 (1.58 seconds).
[2025-10-24T21:55:52.947682] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-03.
[2025-10-24T21:55:53.142020] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-01 (0.99 seconds).
[2025-10-24T21:55:53.747695] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-06.
[2025-10-24T21:55:54.547640] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-02.
[2025-10-24T21:55:55.231451] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-06 (1.48 seconds).
[2025-10-24T21:55:55.347720] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-01.
[2025-10-24T21:55:55.633923] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-03 (2.69 seconds).
[2025-10-24T21:55:55.673933] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-02 (1.13 seconds).
[2025-10-24T21:55:56.147720] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-04.
[2025-10-24T21:55:56.947702] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-03.
[2025-10-24T21:55:57.721821] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-01 (2.37 seconds).
[2025-10-24T21:55:57.747636] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-02.
[2025-10-24T21:55:57.972026] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-04 (1.82 seconds).
[2025-10-24T21:55:58.468326] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-03 (1.52 seconds).
[2025-10-24T21:55:58.547668] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-04.
[2025-10-24T21:55:59.347701] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-07.
[2025-10-24T21:55:59.714800] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-02 (1.97 seconds).
[2025-10-24T21:56:00.054961] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-04 (1.51 seconds).
[2025-10-24T21:56:00.147720] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-03.
[2025-10-24T21:56:00.420228] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T21:56:00.947747] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-05.
[2025-10-24T21:56:01.747696] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-08.
[2025-10-24T21:56:01.917312] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T21:56:02.096492] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-05 (1.15 seconds).
[2025-10-24T21:56:02.547702] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-06.
[2025-10-24T21:56:02.959267] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T21:56:03.347686] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-09.
[2025-10-24T21:56:04.005277] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T21:56:04.147682] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-07.
[2025-10-24T21:56:04.862393] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T21:56:04.947708] [INFO ] [REMOTE    ] WMS: Fetching primary data for 2025-10.
[2025-10-24T21:56:05.243972] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T21:56:05.747693] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-08.
[2025-10-24T21:56:06.380537] [INFO ] [REMOTE    ] WMS: Incremental fetch complete for 2025-10 (1.43 seconds).
[2025-10-24T21:56:06.389639] [INFO ] [REMOTE    ] WMS: Full fetch complete (57043 records).
[2025-10-24T21:56:06.389826] [DEBUG] [VALIDATOR ] WMS: Validating primary data.
[2025-10-24T21:56:06.568790] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-04.
[2025-10-24T21:56:06.779811] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present.
[2025-10-24T21:56:06.779889] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed.
[2025-10-24T21:56:06.780883] [INFO ] [MAIN      ] WMS: Fetched primary data is valid.
[2025-10-24T21:56:06.780945] [DEBUG] [LOCAL     ] WMS: Saving primary data.
[2025-10-24T21:56:06.781413] [FATAL] [LOCAL     ] WMS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:56:06.781494] [FATAL] [MAIN      ] WMS: Failed to save primary data.
[2025-10-24T21:56:06.781535] [WARN ] [MAIN      ] WMS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:56:06.781596] [INFO ] [LOCAL     ] WMS: Starting deletion of primary data.
[2025-10-24T21:56:06.781693] [DEBUG] [LOCAL     ] WMS: No primary data file found to delete.
[2025-10-24T21:56:06.781749] [INFO ] [LOCAL     ] WMS: Starting deletion of derivative data.
[2025-10-24T21:56:06.781912] [DEBUG] [LOCAL     ] WMS: Deleted derivative data file.
[2025-10-24T21:56:06.781986] [INFO ] [MAIN      ] Update Progress: 2305/2366 symbols completed. WMS took 29.8s. Estimated remaining: 7m 50s. Rate: 7.8 symbols/min
[2025-10-24T21:56:06.952341] [INFO ] [MAIN      ] WOR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:56:06.974517] [DEBUG] [LOCAL     ] WOR: Loaded 23641 existing records from primary storage.
[2025-10-24T21:56:06.974823] [INFO ] [MAIN      ] WOR: Loaded 23641 existing records.
[2025-10-24T21:56:07.158697] [WARN ] [MAIN      ] WOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:56:07.159075] [INFO ] [MAIN      ] WOR: Wiping existing primary data before full refresh.
[2025-10-24T21:56:07.159161] [INFO ] [LOCAL     ] WOR: Starting deletion of primary data.
[2025-10-24T21:56:07.159435] [DEBUG] [LOCAL     ] WOR: Deleted primary data file.
[2025-10-24T21:56:07.167045] [INFO ] [MAIN      ] WOR: Starting full primary refresh.
[2025-10-24T21:56:07.232173] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T21:56:07.352733] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-09.
[2025-10-24T21:56:07.575909] [INFO ] [REMOTE    ] WOR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:56:08.147692] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-01.
[2025-10-24T21:56:08.734595] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-09 (1.38 seconds).
[2025-10-24T21:56:08.854909] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-04 (2.29 seconds).
[2025-10-24T21:56:08.947669] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-05.
[2025-10-24T21:56:09.261804] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-01 (1.11 seconds).
[2025-10-24T21:56:09.747677] [INFO ] [REMOTE    ] WNC: Fetching primary data for 2025-10.
[2025-10-24T21:56:10.547640] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-02.
[2025-10-24T21:56:11.009052] [INFO ] [REMOTE    ] WNC: Incremental fetch complete for 2025-10 (1.26 seconds).
[2025-10-24T21:56:11.015772] [INFO ] [REMOTE    ] WNC: Full fetch complete (57757 records).
[2025-10-24T21:56:11.015894] [DEBUG] [VALIDATOR ] WNC: Validating primary data.
[2025-10-24T21:56:11.360033] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-05.
[2025-10-24T21:56:11.416566] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present.
[2025-10-24T21:56:11.416711] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed.
[2025-10-24T21:56:11.418106] [INFO ] [MAIN      ] WNC: Fetched primary data is valid.
[2025-10-24T21:56:11.418276] [DEBUG] [LOCAL     ] WNC: Saving primary data.
[2025-10-24T21:56:11.419039] [FATAL] [LOCAL     ] WNC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:56:11.419204] [FATAL] [MAIN      ] WNC: Failed to save primary data.
[2025-10-24T21:56:11.419252] [WARN ] [MAIN      ] WNC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:56:11.419289] [INFO ] [LOCAL     ] WNC: Starting deletion of primary data.
[2025-10-24T21:56:11.419346] [DEBUG] [LOCAL     ] WNC: No primary data file found to delete.
[2025-10-24T21:56:11.419383] [INFO ] [LOCAL     ] WNC: Starting deletion of derivative data.
[2025-10-24T21:56:11.419583] [DEBUG] [LOCAL     ] WNC: Deleted derivative data file.
[2025-10-24T21:56:11.419941] [INFO ] [MAIN      ] Update Progress: 2306/2366 symbols completed. WNC took 23.3s. Estimated remaining: 7m 42s. Rate: 7.8 symbols/min
[2025-10-24T21:56:11.614763] [INFO ] [MAIN      ] WOW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:56:11.634216] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-05 (2.69 seconds).
[2025-10-24T21:56:11.672946] [DEBUG] [LOCAL     ] WOW: Loaded 31346 existing records from primary storage.
[2025-10-24T21:56:11.673426] [INFO ] [MAIN      ] WOW: Loaded 31346 existing records.
[2025-10-24T21:56:11.834711] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-02 (1.29 seconds).
[2025-10-24T21:56:11.881952] [WARN ] [MAIN      ] WOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:56:11.882194] [INFO ] [MAIN      ] WOW: Wiping existing primary data before full refresh.
[2025-10-24T21:56:11.882244] [INFO ] [LOCAL     ] WOW: Starting deletion of primary data.
[2025-10-24T21:56:11.882492] [DEBUG] [LOCAL     ] WOW: Deleted primary data file.
[2025-10-24T21:56:11.882533] [INFO ] [MAIN      ] WOW: Starting full primary refresh.
[2025-10-24T21:56:12.153408] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-06.
[2025-10-24T21:56:12.244408] [INFO ] [REMOTE    ] WOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:56:12.947685] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-03.
[2025-10-24T21:56:13.737891] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-05 (2.38 seconds).
[2025-10-24T21:56:13.748355] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-01.
[2025-10-24T21:56:14.054439] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-06 (1.90 seconds).
[2025-10-24T21:56:14.322452] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-03 (1.37 seconds).
[2025-10-24T21:56:14.547756] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-06.
[2025-10-24T21:56:14.843235] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T21:56:15.347728] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-02.
[2025-10-24T21:56:16.147669] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-07.
[2025-10-24T21:56:16.399879] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-02 (1.05 seconds).
[2025-10-24T21:56:16.947728] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-04.
[2025-10-24T21:56:17.036490] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-06 (2.49 seconds).
[2025-10-24T21:56:17.747726] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-03.
[2025-10-24T21:56:18.151245] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T21:56:18.547712] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-05.
[2025-10-24T21:56:18.839349] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-07 (2.69 seconds).
[2025-10-24T21:56:18.998809] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T21:56:19.347727] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-08.
[2025-10-24T21:56:19.617997] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T21:56:20.147692] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-07.
[2025-10-24T21:56:20.947733] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-04.
[2025-10-24T21:56:21.552587] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-08 (2.20 seconds).
[2025-10-24T21:56:21.747685] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-06.
[2025-10-24T21:56:22.255623] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-04 (1.31 seconds).
[2025-10-24T21:56:22.530808] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-06 (0.78 seconds).
[2025-10-24T21:56:22.547605] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-07.
[2025-10-24T21:56:22.713882] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-07 (2.57 seconds).
[2025-10-24T21:56:23.347691] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-05.
[2025-10-24T21:56:23.744864] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-07 (1.20 seconds).
[2025-10-24T21:56:24.147696] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-08.
[2025-10-24T21:56:24.470383] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-05 (1.12 seconds).
[2025-10-24T21:56:24.947801] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-08.
[2025-10-24T21:56:25.747679] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-09.
[2025-10-24T21:56:25.787721] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-08 (0.84 seconds).
[2025-10-24T21:56:26.408063] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-08 (2.26 seconds).
[2025-10-24T21:56:26.547721] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-09.
[2025-10-24T21:56:27.347674] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-09.
[2025-10-24T21:56:28.147712] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-06.
[2025-10-24T21:56:28.205030] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-09 (2.46 seconds).
[2025-10-24T21:56:28.571879] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-09 (1.22 seconds).
[2025-10-24T21:56:28.947995] [INFO ] [REMOTE    ] WOR: Fetching primary data for 2025-10.
[2025-10-24T21:56:29.034962] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-09 (2.49 seconds).
[2025-10-24T21:56:29.354961] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-06 (1.21 seconds).
[2025-10-24T21:56:29.747778] [INFO ] [REMOTE    ] WMT: Fetching primary data for 2025-10.
[2025-10-24T21:56:30.074013] [INFO ] [REMOTE    ] WOR: Incremental fetch complete for 2025-10 (1.13 seconds).
[2025-10-24T21:56:30.079557] [INFO ] [REMOTE    ] WOR: Full fetch complete (36181 records).
[2025-10-24T21:56:30.079741] [DEBUG] [VALIDATOR ] WOR: Validating primary data.
[2025-10-24T21:56:30.496305] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present.
[2025-10-24T21:56:30.496462] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed.
[2025-10-24T21:56:30.497915] [INFO ] [MAIN      ] WOR: Fetched primary data is valid.
[2025-10-24T21:56:30.498004] [DEBUG] [LOCAL     ] WOR: Saving primary data.
[2025-10-24T21:56:30.498781] [FATAL] [LOCAL     ] WOR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:56:30.498874] [FATAL] [MAIN      ] WOR: Failed to save primary data.
[2025-10-24T21:56:30.498918] [WARN ] [MAIN      ] WOR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:56:30.498956] [INFO ] [LOCAL     ] WOR: Starting deletion of primary data.
[2025-10-24T21:56:30.499030] [DEBUG] [LOCAL     ] WOR: No primary data file found to delete.
[2025-10-24T21:56:30.499101] [INFO ] [LOCAL     ] WOR: Starting deletion of derivative data.
[2025-10-24T21:56:30.499302] [DEBUG] [LOCAL     ] WOR: Deleted derivative data file.
[2025-10-24T21:56:30.499398] [INFO ] [MAIN      ] Update Progress: 2307/2366 symbols completed. WOR took 23.7s. Estimated remaining: 7m 35s. Rate: 7.8 symbols/min
[2025-10-24T21:56:30.557220] [INFO ] [REMOTE    ] WOLF: Fetching primary data for 2025-10.
[2025-10-24T21:56:30.660995] [INFO ] [REMOTE    ] WMT: Incremental fetch complete for 2025-10 (0.91 seconds).
[2025-10-24T21:56:30.728677] [INFO ] [MAIN      ] WPC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:56:30.728883] [INFO ] [REMOTE    ] WMT: Full fetch complete (77980 records).
[2025-10-24T21:56:30.729712] [DEBUG] [VALIDATOR ] WMT: Validating primary data.
[2025-10-24T21:56:31.097115] [DEBUG] [LOCAL     ] WPC: Loaded 48471 existing records from primary storage.
[2025-10-24T21:56:31.113331] [INFO ] [MAIN      ] WPC: Loaded 48471 existing records.
[2025-10-24T21:56:31.323574] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present.
[2025-10-24T21:56:31.328858] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed.
[2025-10-24T21:56:31.340438] [INFO ] [MAIN      ] WMT: Fetched primary data is valid.
[2025-10-24T21:56:31.345721] [DEBUG] [LOCAL     ] WMT: Saving primary data.
[2025-10-24T21:56:31.369833] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-07.
[2025-10-24T21:56:31.369755] [FATAL] [LOCAL     ] WMT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:56:31.380470] [FATAL] [MAIN      ] WMT: Failed to save primary data.
[2025-10-24T21:56:31.429597] [WARN ] [MAIN      ] WPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:56:31.422816] [WARN ] [MAIN      ] WMT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:56:31.429993] [INFO ] [MAIN      ] WPC: Wiping existing primary data before full refresh.
[2025-10-24T21:56:31.429929] [INFO ] [LOCAL     ] WMT: Starting deletion of primary data.
[2025-10-24T21:56:31.430104] [DEBUG] [LOCAL     ] WMT: No primary data file found to delete.
[2025-10-24T21:56:31.430206] [INFO ] [LOCAL     ] WPC: Starting deletion of primary data.
[2025-10-24T21:56:31.430856] [DEBUG] [LOCAL     ] WPC: Deleted primary data file.
[2025-10-24T21:56:31.430916] [INFO ] [MAIN      ] WPC: Starting full primary refresh.
[2025-10-24T21:56:31.452970] [INFO ] [LOCAL     ] WMT: Starting deletion of derivative data.
[2025-10-24T21:56:31.476300] [DEBUG] [LOCAL     ] WMT: Deleted derivative data file.
[2025-10-24T21:56:31.504529] [INFO ] [MAIN      ] Update Progress: 2308/2366 symbols completed. WMT took 44.6s. Estimated remaining: 7m 27s. Rate: 7.8 symbols/min
[2025-10-24T21:56:31.891097] [INFO ] [MAIN      ] WPM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:56:31.981467] [INFO ] [REMOTE    ] WPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:56:32.023431] [DEBUG] [LOCAL     ] WPM: Loaded 53176 existing records from primary storage.
[2025-10-24T21:56:32.023791] [INFO ] [MAIN      ] WPM: Loaded 53176 existing records.
[2025-10-24T21:56:32.162782] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-01.
[2025-10-24T21:56:32.202935] [WARN ] [MAIN      ] WPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:56:32.203263] [INFO ] [MAIN      ] WPM: Wiping existing primary data before full refresh.
[2025-10-24T21:56:32.203309] [INFO ] [LOCAL     ] WPM: Starting deletion of primary data.
[2025-10-24T21:56:32.204139] [DEBUG] [LOCAL     ] WPM: Deleted primary data file.
[2025-10-24T21:56:32.204195] [INFO ] [MAIN      ] WPM: Starting full primary refresh.
[2025-10-24T21:56:32.552056] [INFO ] [REMOTE    ] WPM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:56:32.768511] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-07 (1.40 seconds).
[2025-10-24T21:56:32.954990] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-08.
[2025-10-24T21:56:32.961606] [INFO ] [REMOTE    ] WOLF: Incremental fetch complete for 2025-10 (2.40 seconds).
[2025-10-24T21:56:32.971979] [INFO ] [REMOTE    ] WOLF: Full fetch complete (77067 records).
[2025-10-24T21:56:32.972175] [DEBUG] [VALIDATOR ] WOLF: Validating primary data.
[2025-10-24T21:56:33.391156] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present.
[2025-10-24T21:56:33.391245] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed.
[2025-10-24T21:56:33.392436] [INFO ] [MAIN      ] WOLF: Fetched primary data is valid.
[2025-10-24T21:56:33.392500] [DEBUG] [LOCAL     ] WOLF: Saving primary data.
[2025-10-24T21:56:33.393152] [FATAL] [LOCAL     ] WOLF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:56:33.393248] [FATAL] [MAIN      ] WOLF: Failed to save primary data.
[2025-10-24T21:56:33.393290] [WARN ] [MAIN      ] WOLF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:56:33.393347] [INFO ] [LOCAL     ] WOLF: Starting deletion of primary data.
[2025-10-24T21:56:33.393402] [DEBUG] [LOCAL     ] WOLF: No primary data file found to delete.
[2025-10-24T21:56:33.393437] [INFO ] [LOCAL     ] WOLF: Starting deletion of derivative data.
[2025-10-24T21:56:33.393589] [DEBUG] [LOCAL     ] WOLF: Deleted derivative data file.
[2025-10-24T21:56:33.393816] [INFO ] [MAIN      ] Update Progress: 2309/2366 symbols completed. WOLF took 42.4s. Estimated remaining: 7m 19s. Rate: 7.8 symbols/min
[2025-10-24T21:56:33.565720] [INFO ] [MAIN      ] WPP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:56:33.600035] [DEBUG] [LOCAL     ] WPP: Loaded 34564 existing records from primary storage.
[2025-10-24T21:56:33.600344] [INFO ] [MAIN      ] WPP: Loaded 34564 existing records.
[2025-10-24T21:56:33.749512] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-01.
[2025-10-24T21:56:33.791697] [WARN ] [MAIN      ] WPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:56:33.792070] [INFO ] [MAIN      ] WPP: Wiping existing primary data before full refresh.
[2025-10-24T21:56:33.792134] [INFO ] [LOCAL     ] WPP: Starting deletion of primary data.
[2025-10-24T21:56:33.792365] [DEBUG] [LOCAL     ] WPP: Deleted primary data file.
[2025-10-24T21:56:33.792403] [INFO ] [MAIN      ] WPP: Starting full primary refresh.
[2025-10-24T21:56:34.184189] [INFO ] [REMOTE    ] WPP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:56:34.186738] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-01 (2.02 seconds).
[2025-10-24T21:56:34.552722] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-01.
[2025-10-24T21:56:34.564666] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-08 (1.61 seconds).
[2025-10-24T21:56:35.349544] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-02.
[2025-10-24T21:56:35.355084] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-01 (1.61 seconds).
[2025-10-24T21:56:35.999904] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-01 (1.45 seconds).
[2025-10-24T21:56:36.147692] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-02.
[2025-10-24T21:56:36.947695] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-09.
[2025-10-24T21:56:37.094533] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-02 (1.74 seconds).
[2025-10-24T21:56:37.539029] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-02 (1.39 seconds).
[2025-10-24T21:56:37.747753] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-03.
[2025-10-24T21:56:38.344854] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T21:56:38.547725] [INFO ] [REMOTE    ] WOW: Fetching primary data for 2025-10.
[2025-10-24T21:56:39.347718] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-03.
[2025-10-24T21:56:39.732922] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-03 (1.99 seconds).
[2025-10-24T21:56:39.890102] [INFO ] [REMOTE    ] WOW: Incremental fetch complete for 2025-10 (1.34 seconds).
[2025-10-24T21:56:39.896542] [INFO ] [REMOTE    ] WOW: Full fetch complete (43124 records).
[2025-10-24T21:56:39.896868] [DEBUG] [VALIDATOR ] WOW: Validating primary data.
[2025-10-24T21:56:40.153683] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-04.
[2025-10-24T21:56:40.285453] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present.
[2025-10-24T21:56:40.285536] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed.
[2025-10-24T21:56:40.286506] [INFO ] [MAIN      ] WOW: Fetched primary data is valid.
[2025-10-24T21:56:40.286572] [DEBUG] [LOCAL     ] WOW: Saving primary data.
[2025-10-24T21:56:40.287088] [FATAL] [LOCAL     ] WOW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:56:40.287183] [FATAL] [MAIN      ] WOW: Failed to save primary data.
[2025-10-24T21:56:40.287248] [WARN ] [MAIN      ] WOW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:56:40.287285] [INFO ] [LOCAL     ] WOW: Starting deletion of primary data.
[2025-10-24T21:56:40.287337] [DEBUG] [LOCAL     ] WOW: No primary data file found to delete.
[2025-10-24T21:56:40.287374] [INFO ] [LOCAL     ] WOW: Starting deletion of derivative data.
[2025-10-24T21:56:40.287556] [DEBUG] [LOCAL     ] WOW: Deleted derivative data file.
[2025-10-24T21:56:40.287710] [INFO ] [MAIN      ] Update Progress: 2310/2366 symbols completed. WOW took 28.9s. Estimated remaining: 7m 11s. Rate: 7.8 symbols/min
[2025-10-24T21:56:40.462270] [INFO ] [MAIN      ] WRB: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:56:40.510924] [DEBUG] [LOCAL     ] WRB: Loaded 51176 existing records from primary storage.
[2025-10-24T21:56:40.511240] [INFO ] [MAIN      ] WRB: Loaded 51176 existing records.
[2025-10-24T21:56:40.696890] [WARN ] [MAIN      ] WRB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:56:40.697155] [INFO ] [MAIN      ] WRB: Wiping existing primary data before full refresh.
[2025-10-24T21:56:40.697360] [INFO ] [LOCAL     ] WRB: Starting deletion of primary data.
[2025-10-24T21:56:40.697971] [DEBUG] [LOCAL     ] WRB: Deleted primary data file.
[2025-10-24T21:56:40.698104] [INFO ] [MAIN      ] WRB: Starting full primary refresh.
[2025-10-24T21:56:40.952277] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-02.
[2025-10-24T21:56:41.085840] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T21:56:41.090114] [INFO ] [REMOTE    ] WRB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:56:41.747639] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-01.
[2025-10-24T21:56:42.186395] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-02 (1.23 seconds).
[2025-10-24T21:56:42.241625] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-04 (2.09 seconds).
[2025-10-24T21:56:42.547729] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-03.
[2025-10-24T21:56:43.224974] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T21:56:43.347685] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-02.
[2025-10-24T21:56:43.958983] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-03 (1.41 seconds).
[2025-10-24T21:56:44.147711] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-05.
[2025-10-24T21:56:44.950311] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-04.
[2025-10-24T21:56:44.962049] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-02 (1.61 seconds).
[2025-10-24T21:56:45.747732] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-04.
[2025-10-24T21:56:46.018204] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-05 (1.87 seconds).
[2025-10-24T21:56:46.077699] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T21:56:46.547719] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-03.
[2025-10-24T21:56:47.347679] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-06.
[2025-10-24T21:56:47.408622] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T21:56:48.147736] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-05.
[2025-10-24T21:56:48.243054] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-03 (1.70 seconds).
[2025-10-24T21:56:48.947667] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-05.
[2025-10-24T21:56:49.076053] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T21:56:49.131060] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-05 (0.98 seconds).
[2025-10-24T21:56:49.747693] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-06.
[2025-10-24T21:56:50.547674] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-07.
[2025-10-24T21:56:50.719730] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-05 (1.77 seconds).
[2025-10-24T21:56:51.179720] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-06 (1.43 seconds).
[2025-10-24T21:56:51.347691] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-06.
[2025-10-24T21:56:51.987342] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-07 (1.44 seconds).
[2025-10-24T21:56:52.147679] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-04.
[2025-10-24T21:56:52.947689] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-07.
[2025-10-24T21:56:52.998912] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T21:56:53.747668] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-08.
[2025-10-24T21:56:53.831169] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-04 (1.68 seconds).
[2025-10-24T21:56:54.521954] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T21:56:54.547701] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-07.
[2025-10-24T21:56:55.347713] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-05.
[2025-10-24T21:56:55.713300] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-08 (1.97 seconds).
[2025-10-24T21:56:56.147608] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-09.
[2025-10-24T21:56:56.221830] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-07 (1.67 seconds).
[2025-10-24T21:56:56.632332] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-05 (1.28 seconds).
[2025-10-24T21:56:56.947732] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-08.
[2025-10-24T21:56:57.747673] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-06.
[2025-10-24T21:56:57.906718] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-09 (1.76 seconds).
[2025-10-24T21:56:58.420076] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-08 (1.47 seconds).
[2025-10-24T21:56:58.547721] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-09.
[2025-10-24T21:56:59.307017] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T21:56:59.347596] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-07.
[2025-10-24T21:57:00.147665] [INFO ] [REMOTE    ] WPM: Fetching primary data for 2025-10.
[2025-10-24T21:57:00.187859] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T21:57:00.947601] [INFO ] [REMOTE    ] WPC: Fetching primary data for 2025-10.
[2025-10-24T21:57:01.510950] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-07 (2.16 seconds).
[2025-10-24T21:57:01.747763] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-08.
[2025-10-24T21:57:01.939036] [INFO ] [REMOTE    ] WPM: Incremental fetch complete for 2025-10 (1.79 seconds).
[2025-10-24T21:57:01.950580] [INFO ] [REMOTE    ] WPM: Full fetch complete (76446 records).
[2025-10-24T21:57:01.950785] [DEBUG] [VALIDATOR ] WPM: Validating primary data.
[2025-10-24T21:57:02.342794] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present.
[2025-10-24T21:57:02.342915] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed.
[2025-10-24T21:57:02.344198] [INFO ] [MAIN      ] WPM: Fetched primary data is valid.
[2025-10-24T21:57:02.344320] [DEBUG] [LOCAL     ] WPM: Saving primary data.
[2025-10-24T21:57:02.345069] [FATAL] [LOCAL     ] WPM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:57:02.345156] [FATAL] [MAIN      ] WPM: Failed to save primary data.
[2025-10-24T21:57:02.345199] [WARN ] [MAIN      ] WPM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:57:02.345237] [INFO ] [LOCAL     ] WPM: Starting deletion of primary data.
[2025-10-24T21:57:02.345289] [DEBUG] [LOCAL     ] WPM: No primary data file found to delete.
[2025-10-24T21:57:02.345325] [INFO ] [LOCAL     ] WPM: Starting deletion of derivative data.
[2025-10-24T21:57:02.345491] [DEBUG] [LOCAL     ] WPM: Deleted derivative data file.
[2025-10-24T21:57:02.346048] [INFO ] [MAIN      ] Update Progress: 2311/2366 symbols completed. WPM took 30.8s. Estimated remaining: 7m 4s. Rate: 7.8 symbols/min
[2025-10-24T21:57:02.513260] [INFO ] [MAIN      ] WRBY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:57:02.558064] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-08.
[2025-10-24T21:57:02.560673] [DEBUG] [LOCAL     ] WRBY: Loaded 51034 existing records from primary storage.
[2025-10-24T21:57:02.561003] [INFO ] [MAIN      ] WRBY: Loaded 51034 existing records.
[2025-10-24T21:57:02.715997] [INFO ] [REMOTE    ] WPC: Incremental fetch complete for 2025-10 (1.77 seconds).
[2025-10-24T21:57:02.777419] [WARN ] [MAIN      ] WRBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:57:02.778575] [INFO ] [MAIN      ] WRBY: Wiping existing primary data before full refresh.
[2025-10-24T21:57:02.778937] [INFO ] [LOCAL     ] WRBY: Starting deletion of primary data.
[2025-10-24T21:57:02.778863] [INFO ] [REMOTE    ] WPC: Full fetch complete (70379 records).
[2025-10-24T21:57:02.779364] [DEBUG] [VALIDATOR ] WPC: Validating primary data.
[2025-10-24T21:57:02.779543] [DEBUG] [LOCAL     ] WRBY: Deleted primary data file.
[2025-10-24T21:57:02.779831] [INFO ] [MAIN      ] WRBY: Starting full primary refresh.
[2025-10-24T21:57:03.206739] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-08 (1.46 seconds).
[2025-10-24T21:57:03.393388] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-09.
[2025-10-24T21:57:03.488382] [INFO ] [REMOTE    ] WRBY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:57:03.567834] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present.
[2025-10-24T21:57:03.567896] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed.
[2025-10-24T21:57:03.569015] [INFO ] [MAIN      ] WPC: Fetched primary data is valid.
[2025-10-24T21:57:03.569075] [DEBUG] [LOCAL     ] WPC: Saving primary data.
[2025-10-24T21:57:03.569594] [FATAL] [LOCAL     ] WPC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:57:03.569702] [FATAL] [MAIN      ] WPC: Failed to save primary data.
[2025-10-24T21:57:03.569745] [WARN ] [MAIN      ] WPC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:57:03.569805] [INFO ] [LOCAL     ] WPC: Starting deletion of primary data.
[2025-10-24T21:57:03.569864] [DEBUG] [LOCAL     ] WPC: No primary data file found to delete.
[2025-10-24T21:57:03.569898] [INFO ] [LOCAL     ] WPC: Starting deletion of derivative data.
[2025-10-24T21:57:03.570044] [DEBUG] [LOCAL     ] WPC: Deleted derivative data file.
[2025-10-24T21:57:03.570310] [INFO ] [MAIN      ] Update Progress: 2312/2366 symbols completed. WPC took 33.1s. Estimated remaining: 6m 56s. Rate: 7.8 symbols/min
[2025-10-24T21:57:03.736577] [INFO ] [MAIN      ] WS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:57:03.758753] [DEBUG] [LOCAL     ] WS: Loaded 23638 existing records from primary storage.
[2025-10-24T21:57:03.759015] [INFO ] [MAIN      ] WS: Loaded 23638 existing records.
[2025-10-24T21:57:03.931985] [WARN ] [MAIN      ] WS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:57:03.932205] [INFO ] [MAIN      ] WS: Wiping existing primary data before full refresh.
[2025-10-24T21:57:03.932260] [INFO ] [LOCAL     ] WS: Starting deletion of primary data.
[2025-10-24T21:57:03.932515] [DEBUG] [LOCAL     ] WS: Deleted primary data file.
[2025-10-24T21:57:03.932553] [INFO ] [MAIN      ] WS: Starting full primary refresh.
[2025-10-24T21:57:04.149851] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-01.
[2025-10-24T21:57:04.288057] [INFO ] [REMOTE    ] WS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:57:04.344150] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-08 (1.79 seconds).
[2025-10-24T21:57:04.933704] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T21:57:04.947595] [INFO ] [REMOTE    ] WPP: Fetching primary data for 2025-10.
[2025-10-24T21:57:05.747731] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-09.
[2025-10-24T21:57:05.946380] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T21:57:06.497867] [INFO ] [REMOTE    ] WPP: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T21:57:06.504791] [INFO ] [REMOTE    ] WPP: Full fetch complete (47710 records).
[2025-10-24T21:57:06.504883] [DEBUG] [VALIDATOR ] WPP: Validating primary data.
[2025-10-24T21:57:06.548480] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-01.
[2025-10-24T21:57:06.803862] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-09 (1.06 seconds).
[2025-10-24T21:57:06.927367] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present.
[2025-10-24T21:57:06.927451] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed.
[2025-10-24T21:57:06.928432] [INFO ] [MAIN      ] WPP: Fetched primary data is valid.
[2025-10-24T21:57:06.928509] [DEBUG] [LOCAL     ] WPP: Saving primary data.
[2025-10-24T21:57:06.929036] [FATAL] [LOCAL     ] WPP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:57:06.929132] [FATAL] [MAIN      ] WPP: Failed to save primary data.
[2025-10-24T21:57:06.929174] [WARN ] [MAIN      ] WPP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:57:06.929208] [INFO ] [LOCAL     ] WPP: Starting deletion of primary data.
[2025-10-24T21:57:06.929260] [DEBUG] [LOCAL     ] WPP: No primary data file found to delete.
[2025-10-24T21:57:06.929294] [INFO ] [LOCAL     ] WPP: Starting deletion of derivative data.
[2025-10-24T21:57:06.929476] [DEBUG] [LOCAL     ] WPP: Deleted derivative data file.
[2025-10-24T21:57:06.929567] [INFO ] [MAIN      ] Update Progress: 2313/2366 symbols completed. WPP took 33.5s. Estimated remaining: 6m 48s. Rate: 7.8 symbols/min
[2025-10-24T21:57:07.097245] [INFO ] [MAIN      ] WSM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:57:07.147933] [DEBUG] [LOCAL     ] WSM: Loaded 49047 existing records from primary storage.
[2025-10-24T21:57:07.148307] [INFO ] [MAIN      ] WSM: Loaded 49047 existing records.
[2025-10-24T21:57:07.328485] [WARN ] [MAIN      ] WSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:57:07.329061] [INFO ] [MAIN      ] WSM: Wiping existing primary data before full refresh.
[2025-10-24T21:57:07.329109] [INFO ] [LOCAL     ] WSM: Starting deletion of primary data.
[2025-10-24T21:57:07.330053] [DEBUG] [LOCAL     ] WSM: Deleted primary data file.
[2025-10-24T21:57:07.330111] [INFO ] [MAIN      ] WSM: Starting full primary refresh.
[2025-10-24T21:57:07.352909] [INFO ] [REMOTE    ] WRB: Fetching primary data for 2025-10.
[2025-10-24T21:57:07.688878] [INFO ] [REMOTE    ] WSM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:57:07.733307] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-01 (1.18 seconds).
[2025-10-24T21:57:08.114767] [INFO ] [REMOTE    ] WRB: Incremental fetch complete for 2025-10 (0.76 seconds).
[2025-10-24T21:57:08.124243] [INFO ] [REMOTE    ] WRB: Full fetch complete (73875 records).
[2025-10-24T21:57:08.124388] [DEBUG] [VALIDATOR ] WRB: Validating primary data.
[2025-10-24T21:57:08.154045] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-02.
[2025-10-24T21:57:08.526873] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present.
[2025-10-24T21:57:08.526963] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed.
[2025-10-24T21:57:08.528120] [INFO ] [MAIN      ] WRB: Fetched primary data is valid.
[2025-10-24T21:57:08.528183] [DEBUG] [LOCAL     ] WRB: Saving primary data.
[2025-10-24T21:57:08.528802] [FATAL] [LOCAL     ] WRB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:57:08.528909] [FATAL] [MAIN      ] WRB: Failed to save primary data.
[2025-10-24T21:57:08.528982] [WARN ] [MAIN      ] WRB: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:57:08.529063] [INFO ] [LOCAL     ] WRB: Starting deletion of primary data.
[2025-10-24T21:57:08.529136] [DEBUG] [LOCAL     ] WRB: No primary data file found to delete.
[2025-10-24T21:57:08.529173] [INFO ] [LOCAL     ] WRB: Starting deletion of derivative data.
[2025-10-24T21:57:08.529341] [DEBUG] [LOCAL     ] WRB: Deleted derivative data file.
[2025-10-24T21:57:08.529733] [INFO ] [MAIN      ] Update Progress: 2314/2366 symbols completed. WRB took 28.2s. Estimated remaining: 6m 41s. Rate: 7.8 symbols/min
[2025-10-24T21:57:08.695437] [INFO ] [MAIN      ] WSO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:57:08.721152] [DEBUG] [LOCAL     ] WSO: Loaded 26088 existing records from primary storage.
[2025-10-24T21:57:08.721403] [INFO ] [MAIN      ] WSO: Loaded 26088 existing records.
[2025-10-24T21:57:08.898519] [WARN ] [MAIN      ] WSO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:57:08.898727] [INFO ] [MAIN      ] WSO: Wiping existing primary data before full refresh.
[2025-10-24T21:57:08.898779] [INFO ] [LOCAL     ] WSO: Starting deletion of primary data.
[2025-10-24T21:57:08.899573] [DEBUG] [LOCAL     ] WSO: Deleted primary data file.
[2025-10-24T21:57:08.899630] [INFO ] [MAIN      ] WSO: Starting full primary refresh.
[2025-10-24T21:57:08.952966] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-01.
[2025-10-24T21:57:09.254183] [INFO ] [REMOTE    ] WSO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:57:09.725778] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-02 (1.57 seconds).
[2025-10-24T21:57:09.747597] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-03.
[2025-10-24T21:57:10.547608] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-01.
[2025-10-24T21:57:10.821006] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T21:57:11.352894] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-02.
[2025-10-24T21:57:11.368432] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-03 (1.62 seconds).
[2025-10-24T21:57:11.562136] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-01 (1.01 seconds).
[2025-10-24T21:57:12.147701] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-02.
[2025-10-24T21:57:12.469181] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-02 (1.12 seconds).
[2025-10-24T21:57:12.947695] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-03.
[2025-10-24T21:57:13.211448] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T21:57:13.747719] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-04.
[2025-10-24T21:57:14.201398] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-03 (1.25 seconds).
[2025-10-24T21:57:14.547695] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-02.
[2025-10-24T21:57:15.347693] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-03.
[2025-10-24T21:57:15.578428] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-04 (1.83 seconds).
[2025-10-24T21:57:16.082692] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-03 (0.73 seconds).
[2025-10-24T21:57:16.155421] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-04.
[2025-10-24T21:57:16.172944] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-02 (1.63 seconds).
[2025-10-24T21:57:16.947750] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-04.
[2025-10-24T21:57:17.242109] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-04 (1.09 seconds).
[2025-10-24T21:57:17.747690] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-05.
[2025-10-24T21:57:18.160913] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T21:57:18.547725] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-03.
[2025-10-24T21:57:18.814942] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-05 (1.07 seconds).
[2025-10-24T21:57:19.347716] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-05.
[2025-10-24T21:57:20.105840] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T21:57:20.147694] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-04.
[2025-10-24T21:57:20.176918] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-05 (0.83 seconds).
[2025-10-24T21:57:20.947680] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-05.
[2025-10-24T21:57:21.747693] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-06.
[2025-10-24T21:57:22.095484] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-04 (1.95 seconds).
[2025-10-24T21:57:22.187917] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-05 (1.24 seconds).
[2025-10-24T21:57:22.547697] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-06.
[2025-10-24T21:57:23.022691] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T21:57:23.347712] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-06.
[2025-10-24T21:57:24.142118] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-06 (1.59 seconds).
[2025-10-24T21:57:24.151897] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-07.
[2025-10-24T21:57:24.538904] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-06 (1.19 seconds).
[2025-10-24T21:57:24.947710] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-07.
[2025-10-24T21:57:25.249906] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-07 (1.10 seconds).
[2025-10-24T21:57:25.747690] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-08.
[2025-10-24T21:57:26.361214] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-07 (1.41 seconds).
[2025-10-24T21:57:26.547684] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-08.
[2025-10-24T21:57:26.959245] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-08 (1.21 seconds).
[2025-10-24T21:57:27.347678] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-07.
[2025-10-24T21:57:27.693577] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-08 (1.15 seconds).
[2025-10-24T21:57:28.147725] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-05.
[2025-10-24T21:57:28.947707] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-09.
[2025-10-24T21:57:29.043863] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T21:57:29.747667] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-09.
[2025-10-24T21:57:29.941230] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-05 (1.79 seconds).
[2025-10-24T21:57:30.278390] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-09 (1.33 seconds).
[2025-10-24T21:57:30.547695] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-06.
[2025-10-24T21:57:30.921610] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T21:57:31.347679] [INFO ] [REMOTE    ] WS: Fetching primary data for 2025-10.
[2025-10-24T21:57:32.147715] [INFO ] [REMOTE    ] WSO: Fetching primary data for 2025-10.
[2025-10-24T21:57:32.256269] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-06 (1.71 seconds).
[2025-10-24T21:57:32.305261] [INFO ] [REMOTE    ] WS: Incremental fetch complete for 2025-10 (0.96 seconds).
[2025-10-24T21:57:32.310003] [INFO ] [REMOTE    ] WS: Full fetch complete (35424 records).
[2025-10-24T21:57:32.310129] [DEBUG] [VALIDATOR ] WS: Validating primary data.
[2025-10-24T21:57:32.682738] [DEBUG] [VALIDATOR ] WS: All expected trading days are present.
[2025-10-24T21:57:32.682828] [DEBUG] [VALIDATOR ] WS: Primary data validation passed.
[2025-10-24T21:57:32.683679] [INFO ] [MAIN      ] WS: Fetched primary data is valid.
[2025-10-24T21:57:32.683745] [DEBUG] [LOCAL     ] WS: Saving primary data.
[2025-10-24T21:57:32.684220] [FATAL] [LOCAL     ] WS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:57:32.684315] [FATAL] [MAIN      ] WS: Failed to save primary data.
[2025-10-24T21:57:32.684401] [WARN ] [MAIN      ] WS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:57:32.684483] [INFO ] [LOCAL     ] WS: Starting deletion of primary data.
[2025-10-24T21:57:32.684561] [DEBUG] [LOCAL     ] WS: No primary data file found to delete.
[2025-10-24T21:57:32.684630] [INFO ] [LOCAL     ] WS: Starting deletion of derivative data.
[2025-10-24T21:57:32.684844] [DEBUG] [LOCAL     ] WS: Deleted derivative data file.
[2025-10-24T21:57:32.684945] [INFO ] [MAIN      ] Update Progress: 2315/2366 symbols completed. WS took 29.1s. Estimated remaining: 6m 33s. Rate: 7.8 symbols/min
[2025-10-24T21:57:32.858147] [INFO ] [MAIN      ] WSR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:57:32.881392] [DEBUG] [LOCAL     ] WSR: Loaded 22684 existing records from primary storage.
[2025-10-24T21:57:32.881690] [INFO ] [MAIN      ] WSR: Loaded 22684 existing records.
[2025-10-24T21:57:32.954137] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-07.
[2025-10-24T21:57:33.064571] [WARN ] [MAIN      ] WSR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:57:33.064800] [INFO ] [MAIN      ] WSR: Wiping existing primary data before full refresh.
[2025-10-24T21:57:33.064846] [INFO ] [LOCAL     ] WSR: Starting deletion of primary data.
[2025-10-24T21:57:33.065268] [DEBUG] [LOCAL     ] WSR: Deleted primary data file.
[2025-10-24T21:57:33.065324] [INFO ] [MAIN      ] WSR: Starting full primary refresh.
[2025-10-24T21:57:33.418985] [INFO ] [REMOTE    ] WSR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:57:33.478988] [INFO ] [REMOTE    ] WSO: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T21:57:33.484886] [INFO ] [REMOTE    ] WSO: Full fetch complete (36033 records).
[2025-10-24T21:57:33.484991] [DEBUG] [VALIDATOR ] WSO: Validating primary data.
[2025-10-24T21:57:33.756308] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-01.
[2025-10-24T21:57:33.853177] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present.
[2025-10-24T21:57:33.853248] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed.
[2025-10-24T21:57:33.854021] [INFO ] [MAIN      ] WSO: Fetched primary data is valid.
[2025-10-24T21:57:33.854087] [DEBUG] [LOCAL     ] WSO: Saving primary data.
[2025-10-24T21:57:33.854527] [FATAL] [LOCAL     ] WSO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:57:33.854613] [FATAL] [MAIN      ] WSO: Failed to save primary data.
[2025-10-24T21:57:33.854685] [WARN ] [MAIN      ] WSO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:57:33.854735] [INFO ] [LOCAL     ] WSO: Starting deletion of primary data.
[2025-10-24T21:57:33.854786] [DEBUG] [LOCAL     ] WSO: No primary data file found to delete.
[2025-10-24T21:57:33.854820] [INFO ] [LOCAL     ] WSO: Starting deletion of derivative data.
[2025-10-24T21:57:33.854968] [DEBUG] [LOCAL     ] WSO: Deleted derivative data file.
[2025-10-24T21:57:33.855055] [INFO ] [MAIN      ] Update Progress: 2316/2366 symbols completed. WSO took 25.3s. Estimated remaining: 6m 25s. Rate: 7.8 symbols/min
[2025-10-24T21:57:34.018122] [INFO ] [MAIN      ] WST: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:57:34.053012] [DEBUG] [LOCAL     ] WST: Loaded 37059 existing records from primary storage.
[2025-10-24T21:57:34.053287] [INFO ] [MAIN      ] WST: Loaded 37059 existing records.
[2025-10-24T21:57:34.250254] [WARN ] [MAIN      ] WST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:57:34.250392] [INFO ] [MAIN      ] WST: Wiping existing primary data before full refresh.
[2025-10-24T21:57:34.250438] [INFO ] [LOCAL     ] WST: Starting deletion of primary data.
[2025-10-24T21:57:34.251008] [DEBUG] [LOCAL     ] WST: Deleted primary data file.
[2025-10-24T21:57:34.251069] [INFO ] [MAIN      ] WST: Starting full primary refresh.
[2025-10-24T21:57:34.570190] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-08.
[2025-10-24T21:57:34.616090] [INFO ] [REMOTE    ] WST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:57:34.648248] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-07 (1.69 seconds).
[2025-10-24T21:57:34.871353] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-01 (1.12 seconds).
[2025-10-24T21:57:35.347672] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-08.
[2025-10-24T21:57:35.874784] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-08 (1.30 seconds).
[2025-10-24T21:57:36.147714] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-02.
[2025-10-24T21:57:36.947703] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-01.
[2025-10-24T21:57:37.015268] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-08 (1.67 seconds).
[2025-10-24T21:57:37.164331] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-02 (1.02 seconds).
[2025-10-24T21:57:37.747722] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-09.
[2025-10-24T21:57:38.318731] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-01 (1.37 seconds).
[2025-10-24T21:57:38.497485] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-09 (0.75 seconds).
[2025-10-24T21:57:38.547611] [INFO ] [REMOTE    ] WSM: Fetching primary data for 2025-10.
[2025-10-24T21:57:39.109422] [INFO ] [REMOTE    ] WSM: Incremental fetch complete for 2025-10 (0.56 seconds).
[2025-10-24T21:57:39.117692] [INFO ] [REMOTE    ] WSM: Full fetch complete (71220 records).
[2025-10-24T21:57:39.117861] [DEBUG] [VALIDATOR ] WSM: Validating primary data.
[2025-10-24T21:57:39.352871] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-02.
[2025-10-24T21:57:39.531877] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present.
[2025-10-24T21:57:39.531957] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed.
[2025-10-24T21:57:39.533109] [INFO ] [MAIN      ] WSM: Fetched primary data is valid.
[2025-10-24T21:57:39.533173] [DEBUG] [LOCAL     ] WSM: Saving primary data.
[2025-10-24T21:57:39.533775] [FATAL] [LOCAL     ] WSM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:57:39.533861] [FATAL] [MAIN      ] WSM: Failed to save primary data.
[2025-10-24T21:57:39.533903] [WARN ] [MAIN      ] WSM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:57:39.533937] [INFO ] [LOCAL     ] WSM: Starting deletion of primary data.
[2025-10-24T21:57:39.533987] [DEBUG] [LOCAL     ] WSM: No primary data file found to delete.
[2025-10-24T21:57:39.534022] [INFO ] [LOCAL     ] WSM: Starting deletion of derivative data.
[2025-10-24T21:57:39.534228] [DEBUG] [LOCAL     ] WSM: Deleted derivative data file.
[2025-10-24T21:57:39.534550] [INFO ] [MAIN      ] Update Progress: 2317/2366 symbols completed. WSM took 32.6s. Estimated remaining: 6m 18s. Rate: 7.8 symbols/min
[2025-10-24T21:57:40.147815] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-09.
[2025-10-24T21:57:40.547181] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T21:57:40.947697] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-03.
[2025-10-24T21:57:41.747698] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-03.
[2025-10-24T21:57:41.842730] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-09 (1.69 seconds).
[2025-10-24T21:57:42.430309] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T21:57:42.547702] [INFO ] [REMOTE    ] WRBY: Fetching primary data for 2025-10.
[2025-10-24T21:57:42.876619] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-03 (1.13 seconds).
[2025-10-24T21:57:43.347639] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-04.
[2025-10-24T21:57:44.147685] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-04.
[2025-10-24T21:57:44.260050] [INFO ] [REMOTE    ] WRBY: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T21:57:44.271189] [INFO ] [REMOTE    ] WRBY: Full fetch complete (73640 records).
[2025-10-24T21:57:44.271401] [DEBUG] [VALIDATOR ] WRBY: Validating primary data.
[2025-10-24T21:57:44.677991] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present.
[2025-10-24T21:57:44.678182] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed.
[2025-10-24T21:57:44.681006] [INFO ] [MAIN      ] WRBY: Fetched primary data is valid.
[2025-10-24T21:57:44.681107] [DEBUG] [LOCAL     ] WRBY: Saving primary data.
[2025-10-24T21:57:44.682150] [FATAL] [LOCAL     ] WRBY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:57:44.682247] [FATAL] [MAIN      ] WRBY: Failed to save primary data.
[2025-10-24T21:57:44.682291] [WARN ] [MAIN      ] WRBY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:57:44.682358] [INFO ] [LOCAL     ] WRBY: Starting deletion of primary data.
[2025-10-24T21:57:44.682430] [DEBUG] [LOCAL     ] WRBY: No primary data file found to delete.
[2025-10-24T21:57:44.682470] [INFO ] [LOCAL     ] WRBY: Starting deletion of derivative data.
[2025-10-24T21:57:44.682745] [DEBUG] [LOCAL     ] WRBY: Deleted derivative data file.
[2025-10-24T21:57:44.683144] [INFO ] [MAIN      ] Update Progress: 2318/2366 symbols completed. WRBY took 42.3s. Estimated remaining: 6m 10s. Rate: 7.8 symbols/min
[2025-10-24T21:57:44.871771] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-04 (1.52 seconds).
[2025-10-24T21:57:44.947684] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-05.
[2025-10-24T21:57:45.345822] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-04 (1.20 seconds).
[2025-10-24T21:57:45.747714] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-05.
[2025-10-24T21:57:46.498490] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T21:57:46.547607] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-06.
[2025-10-24T21:57:46.927638] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-05 (1.18 seconds).
[2025-10-24T21:57:47.347689] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-06.
[2025-10-24T21:57:47.819329] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-06 (1.27 seconds).
[2025-10-24T21:57:48.147630] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-07.
[2025-10-24T21:57:48.551886] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-06 (1.20 seconds).
[2025-10-24T21:57:48.947702] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-07.
[2025-10-24T21:57:49.435173] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T21:57:49.747718] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-08.
[2025-10-24T21:57:50.197261] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-07 (1.25 seconds).
[2025-10-24T21:57:50.547711] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-08.
[2025-10-24T21:57:50.803925] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T21:57:51.347715] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-09.
[2025-10-24T21:57:51.610004] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-08 (1.06 seconds).
[2025-10-24T21:57:51.719753] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-09 (0.37 seconds).
[2025-10-24T21:57:52.147681] [INFO ] [REMOTE    ] WST: Fetching primary data for 2025-10.
[2025-10-24T21:57:52.884760] [INFO ] [REMOTE    ] WST: Incremental fetch complete for 2025-10 (0.74 seconds).
[2025-10-24T21:57:52.892677] [INFO ] [REMOTE    ] WST: Full fetch complete (54677 records).
[2025-10-24T21:57:52.892828] [DEBUG] [VALIDATOR ] WST: Validating primary data.
[2025-10-24T21:57:52.959819] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-09.
[2025-10-24T21:57:53.331866] [DEBUG] [VALIDATOR ] WST: All expected trading days are present.
[2025-10-24T21:57:53.331978] [DEBUG] [VALIDATOR ] WST: Primary data validation passed.
[2025-10-24T21:57:53.333002] [INFO ] [MAIN      ] WST: Fetched primary data is valid.
[2025-10-24T21:57:53.333063] [DEBUG] [LOCAL     ] WST: Saving primary data.
[2025-10-24T21:57:53.333590] [FATAL] [LOCAL     ] WST: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:57:53.333712] [FATAL] [MAIN      ] WST: Failed to save primary data.
[2025-10-24T21:57:53.333801] [WARN ] [MAIN      ] WST: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:57:53.333873] [INFO ] [LOCAL     ] WST: Starting deletion of primary data.
[2025-10-24T21:57:53.333946] [DEBUG] [LOCAL     ] WST: No primary data file found to delete.
[2025-10-24T21:57:53.334001] [INFO ] [LOCAL     ] WST: Starting deletion of derivative data.
[2025-10-24T21:57:53.334185] [DEBUG] [LOCAL     ] WST: Deleted derivative data file.
[2025-10-24T21:57:53.334787] [INFO ] [MAIN      ] Update Progress: 2319/2366 symbols completed. WST took 19.5s. Estimated remaining: 6m 2s. Rate: 7.8 symbols/min
[2025-10-24T21:57:54.124987] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-09 (1.17 seconds).
[2025-10-24T21:57:54.130199] [INFO ] [REMOTE    ] WSR: Fetching primary data for 2025-10.
[2025-10-24T21:57:55.107785] [INFO ] [REMOTE    ] WSR: Incremental fetch complete for 2025-10 (0.98 seconds).
[2025-10-24T21:57:55.113790] [INFO ] [REMOTE    ] WSR: Full fetch complete (32581 records).
[2025-10-24T21:57:55.113956] [DEBUG] [VALIDATOR ] WSR: Validating primary data.
[2025-10-24T21:57:55.480061] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present.
[2025-10-24T21:57:55.480134] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed.
[2025-10-24T21:57:55.480796] [INFO ] [MAIN      ] WSR: Fetched primary data is valid.
[2025-10-24T21:57:55.480854] [DEBUG] [LOCAL     ] WSR: Saving primary data.
[2025-10-24T21:57:55.481185] [FATAL] [LOCAL     ] WSR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:57:55.481267] [FATAL] [MAIN      ] WSR: Failed to save primary data.
[2025-10-24T21:57:55.481308] [WARN ] [MAIN      ] WSR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:57:55.481374] [INFO ] [LOCAL     ] WSR: Starting deletion of primary data.
[2025-10-24T21:57:55.481429] [DEBUG] [LOCAL     ] WSR: No primary data file found to delete.
[2025-10-24T21:57:55.481463] [INFO ] [LOCAL     ] WSR: Starting deletion of derivative data.
[2025-10-24T21:57:55.481618] [DEBUG] [LOCAL     ] WSR: Deleted derivative data file.
[2025-10-24T21:57:55.481752] [INFO ] [MAIN      ] Update Progress: 2320/2366 symbols completed. WSR took 22.8s. Estimated remaining: 5m 54s. Rate: 7.8 symbols/min
[2025-10-24T21:57:56.001482] [INFO ] [MAIN      ] WT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:57:56.159431] [INFO ] [MAIN      ] WTM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:57:56.187349] [INFO ] [MAIN      ] WTRG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:57:56.188298] [INFO ] [MAIN      ] WTI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:57:56.188980] [DEBUG] [LOCAL     ] WTM: No existing data file found in primary storage.
[2025-10-24T21:57:56.189199] [WARN ] [MAIN      ] WTM: No existing data found, performing full refresh instead.
[2025-10-24T21:57:56.189331] [INFO ] [MAIN      ] WTM: Wiping existing primary data before full refresh.
[2025-10-24T21:57:56.191776] [INFO ] [LOCAL     ] WTM: Starting deletion of primary data.
[2025-10-24T21:57:56.191980] [DEBUG] [LOCAL     ] WTM: No primary data file found to delete.
[2025-10-24T21:57:56.192025] [INFO ] [MAIN      ] WTM: Starting full primary refresh.
[2025-10-24T21:57:56.540008] [DEBUG] [LOCAL     ] WT: Loaded 48552 existing records from primary storage.
[2025-10-24T21:57:56.554576] [INFO ] [MAIN      ] WT: Loaded 48552 existing records.
[2025-10-24T21:57:56.570836] [DEBUG] [LOCAL     ] WTI: Loaded 45096 existing records from primary storage.
[2025-10-24T21:57:56.588101] [DEBUG] [LOCAL     ] WTRG: Loaded 51295 existing records from primary storage.
[2025-10-24T21:57:56.616805] [INFO ] [MAIN      ] WTRG: Loaded 51295 existing records.
[2025-10-24T21:57:56.616894] [INFO ] [MAIN      ] WTI: Loaded 45096 existing records.
[2025-10-24T21:57:56.711061] [INFO ] [REMOTE    ] WTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:57:56.790761] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-01.
[2025-10-24T21:57:57.129739] [WARN ] [MAIN      ] WTRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:57:57.146915] [INFO ] [MAIN      ] WTRG: Wiping existing primary data before full refresh.
[2025-10-24T21:57:57.146769] [WARN ] [MAIN      ] WT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:57:57.159851] [INFO ] [LOCAL     ] WTRG: Starting deletion of primary data.
[2025-10-24T21:57:57.184920] [DEBUG] [LOCAL     ] WTRG: Deleted primary data file.
[2025-10-24T21:57:57.188955] [INFO ] [MAIN      ] WTRG: Starting full primary refresh.
[2025-10-24T21:57:57.188736] [WARN ] [MAIN      ] WTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:57:57.188815] [INFO ] [MAIN      ] WT: Wiping existing primary data before full refresh.
[2025-10-24T21:57:57.232124] [INFO ] [LOCAL     ] WT: Starting deletion of primary data.
[2025-10-24T21:57:57.239290] [INFO ] [MAIN      ] WTI: Wiping existing primary data before full refresh.
[2025-10-24T21:57:57.272573] [DEBUG] [LOCAL     ] WT: Deleted primary data file.
[2025-10-24T21:57:57.266467] [INFO ] [LOCAL     ] WTI: Starting deletion of primary data.
[2025-10-24T21:57:57.295898] [INFO ] [MAIN      ] WT: Starting full primary refresh.
[2025-10-24T21:57:57.311343] [DEBUG] [LOCAL     ] WTI: Deleted primary data file.
[2025-10-24T21:57:57.320955] [INFO ] [MAIN      ] WTI: Starting full primary refresh.
[2025-10-24T21:57:57.348029] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-01 (0.56 seconds).
[2025-10-24T21:57:57.349393] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-02.
[2025-10-24T21:57:58.100472] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-02 (0.75 seconds).
[2025-10-24T21:57:58.160316] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-03.
[2025-10-24T21:57:58.246113] [INFO ] [REMOTE    ] WTRG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:57:58.257444] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-01.
[2025-10-24T21:57:58.294534] [INFO ] [REMOTE    ] WT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:57:58.365493] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-01.
[2025-10-24T21:57:58.370410] [INFO ] [REMOTE    ] WTI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:57:58.547694] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-01.
[2025-10-24T21:57:58.718416] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-03 (0.56 seconds).
[2025-10-24T21:57:59.347728] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-04.
[2025-10-24T21:57:59.851135] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-04 (0.50 seconds).
[2025-10-24T21:57:59.905013] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-01 (1.65 seconds).
[2025-10-24T21:57:59.953308] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-01 (1.59 seconds).
[2025-10-24T21:58:00.084727] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T21:58:00.147706] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-02.
[2025-10-24T21:58:00.947703] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-02.
[2025-10-24T21:58:01.650280] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T21:58:01.747685] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-03.
[2025-10-24T21:58:02.445035] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-02 (1.50 seconds).
[2025-10-24T21:58:02.547675] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-05.
[2025-10-24T21:58:02.958311] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-05 (0.41 seconds).
[2025-10-24T21:58:03.347633] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-02.
[2025-10-24T21:58:03.392939] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-03 (1.65 seconds).
[2025-10-24T21:58:04.147687] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-06.
[2025-10-24T21:58:04.631583] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-06 (0.48 seconds).
[2025-10-24T21:58:04.906277] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-02 (1.56 seconds).
[2025-10-24T21:58:04.947664] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-03.
[2025-10-24T21:58:05.747721] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-07.
[2025-10-24T21:58:06.204325] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-07 (0.46 seconds).
[2025-10-24T21:58:06.535770] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-03 (1.59 seconds).
[2025-10-24T21:58:06.547593] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-04.
[2025-10-24T21:58:07.347718] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-03.
[2025-10-24T21:58:08.126431] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T21:58:08.147675] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-08.
[2025-10-24T21:58:08.554477] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T21:58:08.707752] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-08 (0.56 seconds).
[2025-10-24T21:58:08.947607] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-09.
[2025-10-24T21:58:09.600863] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-09 (0.65 seconds).
[2025-10-24T21:58:09.747698] [INFO ] [REMOTE    ] WTM: Fetching primary data for 2025-10.
[2025-10-24T21:58:10.466290] [INFO ] [REMOTE    ] WTM: Incremental fetch complete for 2025-10 (0.72 seconds).
[2025-10-24T21:58:10.470286] [INFO ] [REMOTE    ] WTM: Full fetch complete (2806 records).
[2025-10-24T21:58:10.470531] [DEBUG] [VALIDATOR ] WTM: Validating primary data.
[2025-10-24T21:58:10.552920] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-04.
[2025-10-24T21:58:10.760555] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days
[2025-10-24T21:58:10.760858] [FATAL] [MAIN      ] WTM: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T21:58:10.760952] [WARN ] [MAIN      ] WTM: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T21:58:10.761046] [INFO ] [LOCAL     ] WTM: Starting deletion of primary data.
[2025-10-24T21:58:10.761139] [DEBUG] [LOCAL     ] WTM: No primary data file found to delete.
[2025-10-24T21:58:10.761202] [INFO ] [LOCAL     ] WTM: Starting deletion of derivative data.
[2025-10-24T21:58:10.761294] [DEBUG] [LOCAL     ] WTM: No derivative data file found to delete.
[2025-10-24T21:58:10.761385] [INFO ] [MAIN      ] Update Progress: 2321/2366 symbols completed. WTM took 15.3s. Estimated remaining: 5m 47s. Rate: 7.8 symbols/min
[2025-10-24T21:58:11.003705] [INFO ] [MAIN      ] WTS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:58:11.030957] [DEBUG] [LOCAL     ] WTS: Loaded 17345 existing records from primary storage.
[2025-10-24T21:58:11.031292] [INFO ] [MAIN      ] WTS: Loaded 17345 existing records.
[2025-10-24T21:58:11.217475] [WARN ] [MAIN      ] WTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:58:11.217749] [INFO ] [MAIN      ] WTS: Wiping existing primary data before full refresh.
[2025-10-24T21:58:11.217800] [INFO ] [LOCAL     ] WTS: Starting deletion of primary data.
[2025-10-24T21:58:11.218054] [DEBUG] [LOCAL     ] WTS: Deleted primary data file.
[2025-10-24T21:58:11.218110] [INFO ] [MAIN      ] WTS: Starting full primary refresh.
[2025-10-24T21:58:11.355673] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-05.
[2025-10-24T21:58:11.570438] [INFO ] [REMOTE    ] WTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:58:12.147789] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-01.
[2025-10-24T21:58:12.304304] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-04 (1.75 seconds).
[2025-10-24T21:58:12.892249] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-05 (1.54 seconds).
[2025-10-24T21:58:12.947662] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-06.
[2025-10-24T21:58:13.235975] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-01 (1.09 seconds).
[2025-10-24T21:58:13.747701] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-04.
[2025-10-24T21:58:14.547711] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-02.
[2025-10-24T21:58:14.774879] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T21:58:15.217907] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T21:58:15.347636] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-05.
[2025-10-24T21:58:15.608573] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-02 (1.06 seconds).
[2025-10-24T21:58:16.147719] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-07.
[2025-10-24T21:58:16.791701] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-05 (1.44 seconds).
[2025-10-24T21:58:16.947698] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-06.
[2025-10-24T21:58:17.689625] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T21:58:17.747714] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-05.
[2025-10-24T21:58:18.486946] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T21:58:18.547726] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-03.
[2025-10-24T21:58:19.080199] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T21:58:19.347745] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-08.
[2025-10-24T21:58:19.686227] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-03 (1.14 seconds).
[2025-10-24T21:58:20.147734] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-07.
[2025-10-24T21:58:20.947670] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-06.
[2025-10-24T21:58:20.979017] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-08 (1.63 seconds).
[2025-10-24T21:58:21.747710] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-09.
[2025-10-24T21:58:21.824977] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T21:58:22.547755] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-08.
[2025-10-24T21:58:22.679261] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-06 (1.73 seconds).
[2025-10-24T21:58:23.347677] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-07.
[2025-10-24T21:58:23.387052] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T21:58:24.132460] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T21:58:24.147591] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-09.
[2025-10-24T21:58:24.710568] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-07 (1.36 seconds).
[2025-10-24T21:58:24.947753] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-04.
[2025-10-24T21:58:25.454793] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-09 (1.31 seconds).
[2025-10-24T21:58:25.747715] [INFO ] [REMOTE    ] WTI: Fetching primary data for 2025-10.
[2025-10-24T21:58:26.156626] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T21:58:26.547736] [INFO ] [REMOTE    ] WT: Fetching primary data for 2025-10.
[2025-10-24T21:58:27.347695] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-08.
[2025-10-24T21:58:27.405519] [INFO ] [REMOTE    ] WTI: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T21:58:27.414552] [INFO ] [REMOTE    ] WTI: Full fetch complete (63950 records).
[2025-10-24T21:58:27.414738] [DEBUG] [VALIDATOR ] WTI: Validating primary data.
[2025-10-24T21:58:27.830720] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present.
[2025-10-24T21:58:27.830823] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed.
[2025-10-24T21:58:27.833317] [INFO ] [MAIN      ] WTI: Fetched primary data is valid.
[2025-10-24T21:58:27.833383] [DEBUG] [LOCAL     ] WTI: Saving primary data.
[2025-10-24T21:58:27.833939] [FATAL] [LOCAL     ] WTI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:58:27.834024] [FATAL] [MAIN      ] WTI: Failed to save primary data.
[2025-10-24T21:58:27.834069] [WARN ] [MAIN      ] WTI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:58:27.834109] [INFO ] [LOCAL     ] WTI: Starting deletion of primary data.
[2025-10-24T21:58:27.834164] [DEBUG] [LOCAL     ] WTI: No primary data file found to delete.
[2025-10-24T21:58:27.834201] [INFO ] [LOCAL     ] WTI: Starting deletion of derivative data.
[2025-10-24T21:58:27.834404] [DEBUG] [LOCAL     ] WTI: Deleted derivative data file.
[2025-10-24T21:58:27.834516] [INFO ] [MAIN      ] Update Progress: 2322/2366 symbols completed. WTI took 32.3s. Estimated remaining: 5m 39s. Rate: 7.8 symbols/min
[2025-10-24T21:58:28.010980] [INFO ] [MAIN      ] WTTR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:58:28.050051] [DEBUG] [LOCAL     ] WTTR: Loaded 44859 existing records from primary storage.
[2025-10-24T21:58:28.050336] [INFO ] [MAIN      ] WTTR: Loaded 44859 existing records.
[2025-10-24T21:58:28.150978] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-05.
[2025-10-24T21:58:28.231713] [WARN ] [MAIN      ] WTTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:58:28.231999] [INFO ] [MAIN      ] WTTR: Wiping existing primary data before full refresh.
[2025-10-24T21:58:28.232066] [INFO ] [LOCAL     ] WTTR: Starting deletion of primary data.
[2025-10-24T21:58:28.242151] [DEBUG] [LOCAL     ] WTTR: Deleted primary data file.
[2025-10-24T21:58:28.256188] [INFO ] [MAIN      ] WTTR: Starting full primary refresh.
[2025-10-24T21:58:28.354884] [INFO ] [REMOTE    ] WT: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T21:58:28.386502] [INFO ] [REMOTE    ] WT: Full fetch complete (69828 records).
[2025-10-24T21:58:28.402068] [DEBUG] [VALIDATOR ] WT: Validating primary data.
[2025-10-24T21:58:28.889876] [INFO ] [REMOTE    ] WTTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:58:28.948572] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-01.
[2025-10-24T21:58:29.034618] [DEBUG] [VALIDATOR ] WT: All expected trading days are present.
[2025-10-24T21:58:29.034798] [DEBUG] [VALIDATOR ] WT: Primary data validation passed.
[2025-10-24T21:58:29.035976] [INFO ] [MAIN      ] WT: Fetched primary data is valid.
[2025-10-24T21:58:29.036086] [DEBUG] [LOCAL     ] WT: Saving primary data.
[2025-10-24T21:58:29.036855] [FATAL] [LOCAL     ] WT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:58:29.036939] [FATAL] [MAIN      ] WT: Failed to save primary data.
[2025-10-24T21:58:29.036981] [WARN ] [MAIN      ] WT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:58:29.037048] [INFO ] [LOCAL     ] WT: Starting deletion of primary data.
[2025-10-24T21:58:29.037109] [DEBUG] [LOCAL     ] WT: No primary data file found to delete.
[2025-10-24T21:58:29.037144] [INFO ] [LOCAL     ] WT: Starting deletion of derivative data.
[2025-10-24T21:58:29.037321] [DEBUG] [LOCAL     ] WT: Deleted derivative data file.
[2025-10-24T21:58:29.038050] [INFO ] [MAIN      ] Update Progress: 2323/2366 symbols completed. WT took 33.6s. Estimated remaining: 5m 31s. Rate: 7.8 symbols/min
[2025-10-24T21:58:29.209055] [INFO ] [MAIN      ] WU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:58:29.239737] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-08 (1.89 seconds).
[2025-10-24T21:58:29.300532] [DEBUG] [LOCAL     ] WU: Loaded 53877 existing records from primary storage.
[2025-10-24T21:58:29.306105] [INFO ] [MAIN      ] WU: Loaded 53877 existing records.
[2025-10-24T21:58:29.345757] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-05 (1.19 seconds).
[2025-10-24T21:58:29.494298] [WARN ] [MAIN      ] WU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:58:29.494515] [INFO ] [MAIN      ] WU: Wiping existing primary data before full refresh.
[2025-10-24T21:58:29.494559] [INFO ] [LOCAL     ] WU: Starting deletion of primary data.
[2025-10-24T21:58:29.495710] [DEBUG] [LOCAL     ] WU: Deleted primary data file.
[2025-10-24T21:58:29.495771] [INFO ] [MAIN      ] WU: Starting full primary refresh.
[2025-10-24T21:58:29.757575] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-06.
[2025-10-24T21:58:29.847395] [INFO ] [REMOTE    ] WU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:58:30.173255] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-01 (1.22 seconds).
[2025-10-24T21:58:30.547718] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-01.
[2025-10-24T21:58:30.727604] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-06 (0.97 seconds).
[2025-10-24T21:58:31.347690] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-02.
[2025-10-24T21:58:32.078736] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-01 (1.53 seconds).
[2025-10-24T21:58:32.147605] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-02.
[2025-10-24T21:58:32.545048] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-02 (1.20 seconds).
[2025-10-24T21:58:32.947719] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-07.
[2025-10-24T21:58:33.747699] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-09.
[2025-10-24T21:58:33.867987] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-02 (1.72 seconds).
[2025-10-24T21:58:33.961457] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-07 (1.01 seconds).
[2025-10-24T21:58:34.547679] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-08.
[2025-10-24T21:58:35.347630] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-03.
[2025-10-24T21:58:35.411355] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-09 (1.66 seconds).
[2025-10-24T21:58:35.715020] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-08 (1.17 seconds).
[2025-10-24T21:58:36.147702] [INFO ] [REMOTE    ] WTRG: Fetching primary data for 2025-10.
[2025-10-24T21:58:36.874547] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T21:58:36.947706] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-09.
[2025-10-24T21:58:37.747634] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-04.
[2025-10-24T21:58:37.958438] [INFO ] [REMOTE    ] WTRG: Incremental fetch complete for 2025-10 (1.81 seconds).
[2025-10-24T21:58:37.967596] [INFO ] [REMOTE    ] WTRG: Full fetch complete (73897 records).
[2025-10-24T21:58:37.967790] [DEBUG] [VALIDATOR ] WTRG: Validating primary data.
[2025-10-24T21:58:38.099778] [INFO ] [REMOTE    ] WTS: Incremental fetch complete for 2025-09 (1.15 seconds).
[2025-10-24T21:58:38.411637] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present.
[2025-10-24T21:58:38.411767] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed.
[2025-10-24T21:58:38.413017] [INFO ] [MAIN      ] WTRG: Fetched primary data is valid.
[2025-10-24T21:58:38.413081] [DEBUG] [LOCAL     ] WTRG: Saving primary data.
[2025-10-24T21:58:38.413695] [FATAL] [LOCAL     ] WTRG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:58:38.413783] [FATAL] [MAIN      ] WTRG: Failed to save primary data.
[2025-10-24T21:58:38.413825] [WARN ] [MAIN      ] WTRG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:58:38.413868] [INFO ] [LOCAL     ] WTRG: Starting deletion of primary data.
[2025-10-24T21:58:38.413923] [DEBUG] [LOCAL     ] WTRG: No primary data file found to delete.
[2025-10-24T21:58:38.413958] [INFO ] [LOCAL     ] WTRG: Starting deletion of derivative data.
[2025-10-24T21:58:38.414128] [DEBUG] [LOCAL     ] WTRG: Deleted derivative data file.
[2025-10-24T21:58:38.414474] [INFO ] [MAIN      ] Update Progress: 2324/2366 symbols completed. WTRG took 42.9s. Estimated remaining: 5m 24s. Rate: 7.8 symbols/min
[2025-10-24T21:58:38.552847] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-03.
[2025-10-24T21:58:38.608340] [INFO ] [MAIN      ] WWW: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:58:38.657337] [DEBUG] [LOCAL     ] WWW: Loaded 49577 existing records from primary storage.
[2025-10-24T21:58:38.657714] [INFO ] [MAIN      ] WWW: Loaded 49577 existing records.
[2025-10-24T21:58:38.853155] [WARN ] [MAIN      ] WWW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:58:38.853380] [INFO ] [MAIN      ] WWW: Wiping existing primary data before full refresh.
[2025-10-24T21:58:38.853428] [INFO ] [LOCAL     ] WWW: Starting deletion of primary data.
[2025-10-24T21:58:38.854460] [DEBUG] [LOCAL     ] WWW: Deleted primary data file.
[2025-10-24T21:58:38.854519] [INFO ] [MAIN      ] WWW: Starting full primary refresh.
[2025-10-24T21:58:39.254324] [INFO ] [REMOTE    ] WWW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:58:39.347638] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-01.
[2025-10-24T21:58:39.417169] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-04 (1.67 seconds).
[2025-10-24T21:58:40.147682] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-05.
[2025-10-24T21:58:40.501155] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-03 (1.95 seconds).
[2025-10-24T21:58:40.828581] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-01 (1.48 seconds).
[2025-10-24T21:58:40.947601] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-02.
[2025-10-24T21:58:41.747701] [INFO ] [REMOTE    ] WTS: Fetching primary data for 2025-10.
[2025-10-24T21:58:41.780114] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-05 (1.63 seconds).
[2025-10-24T21:58:41.853416] [DEBUG] [REMOTE    ] WTS: Error fetching primary data for 2025-10: 'API call returned an empty response.'
[2025-10-24T21:58:41.853779] [WARN ] [REMOTE    ] WTS: No data returned for month 2025-10
[2025-10-24T21:58:41.853902] [FATAL] [REMOTE    ] WTS: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:58:41.853970] [FATAL] [MAIN      ] WTS: Failed to fetch primary data.
[2025-10-24T21:58:41.854006] [WARN ] [MAIN      ] WTS: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:58:41.854041] [INFO ] [LOCAL     ] WTS: Starting deletion of primary data.
[2025-10-24T21:58:41.854095] [DEBUG] [LOCAL     ] WTS: No primary data file found to delete.
[2025-10-24T21:58:41.854128] [INFO ] [LOCAL     ] WTS: Starting deletion of derivative data.
[2025-10-24T21:58:41.854329] [DEBUG] [LOCAL     ] WTS: Deleted derivative data file.
[2025-10-24T21:58:41.854412] [INFO ] [MAIN      ] Update Progress: 2325/2366 symbols completed. WTS took 31.1s. Estimated remaining: 5m 16s. Rate: 7.8 symbols/min
[2025-10-24T21:58:42.028636] [INFO ] [MAIN      ] WY: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:58:42.054534] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-02 (1.11 seconds).
[2025-10-24T21:58:42.107454] [DEBUG] [LOCAL     ] WY: Loaded 53597 existing records from primary storage.
[2025-10-24T21:58:42.107829] [INFO ] [MAIN      ] WY: Loaded 53597 existing records.
[2025-10-24T21:58:42.281953] [WARN ] [MAIN      ] WY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:58:42.282186] [INFO ] [MAIN      ] WY: Wiping existing primary data before full refresh.
[2025-10-24T21:58:42.282231] [INFO ] [LOCAL     ] WY: Starting deletion of primary data.
[2025-10-24T21:58:42.283198] [DEBUG] [LOCAL     ] WY: Deleted primary data file.
[2025-10-24T21:58:42.283254] [INFO ] [MAIN      ] WY: Starting full primary refresh.
[2025-10-24T21:58:42.552788] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-06.
[2025-10-24T21:58:42.650138] [INFO ] [REMOTE    ] WY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:58:43.347706] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-04.
[2025-10-24T21:58:44.008498] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-06 (1.46 seconds).
[2025-10-24T21:58:44.147714] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-07.
[2025-10-24T21:58:44.947704] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-01.
[2025-10-24T21:58:45.311533] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-04 (1.96 seconds).
[2025-10-24T21:58:45.747699] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-03.
[2025-10-24T21:58:45.829738] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-07 (1.68 seconds).
[2025-10-24T21:58:46.547734] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-08.
[2025-10-24T21:58:47.199372] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-01 (2.25 seconds).
[2025-10-24T21:58:47.347602] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-02.
[2025-10-24T21:58:47.915398] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-03 (2.17 seconds).
[2025-10-24T21:58:48.147612] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-05.
[2025-10-24T21:58:48.483469] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-08 (1.94 seconds).
[2025-10-24T21:58:48.947709] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-09.
[2025-10-24T21:58:49.349514] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-02 (2.00 seconds).
[2025-10-24T21:58:49.747690] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-04.
[2025-10-24T21:58:50.116892] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-05 (1.97 seconds).
[2025-10-24T21:58:50.458149] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-09 (1.51 seconds).
[2025-10-24T21:58:50.547605] [INFO ] [REMOTE    ] WTTR: Fetching primary data for 2025-10.
[2025-10-24T21:58:51.347706] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-06.
[2025-10-24T21:58:51.508886] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-04 (1.76 seconds).
[2025-10-24T21:58:52.118089] [INFO ] [REMOTE    ] WTTR: Incremental fetch complete for 2025-10 (1.57 seconds).
[2025-10-24T21:58:52.126357] [INFO ] [REMOTE    ] WTTR: Full fetch complete (65524 records).
[2025-10-24T21:58:52.126470] [DEBUG] [VALIDATOR ] WTTR: Validating primary data.
[2025-10-24T21:58:52.157780] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-05.
[2025-10-24T21:58:52.509961] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present.
[2025-10-24T21:58:52.510038] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed.
[2025-10-24T21:58:52.511097] [INFO ] [MAIN      ] WTTR: Fetched primary data is valid.
[2025-10-24T21:58:52.511157] [DEBUG] [LOCAL     ] WTTR: Saving primary data.
[2025-10-24T21:58:52.511684] [FATAL] [LOCAL     ] WTTR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:58:52.511787] [FATAL] [MAIN      ] WTTR: Failed to save primary data.
[2025-10-24T21:58:52.511830] [WARN ] [MAIN      ] WTTR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:58:52.511913] [INFO ] [LOCAL     ] WTTR: Starting deletion of primary data.
[2025-10-24T21:58:52.511986] [DEBUG] [LOCAL     ] WTTR: No primary data file found to delete.
[2025-10-24T21:58:52.512033] [INFO ] [LOCAL     ] WTTR: Starting deletion of derivative data.
[2025-10-24T21:58:52.512250] [DEBUG] [LOCAL     ] WTTR: Deleted derivative data file.
[2025-10-24T21:58:52.512343] [INFO ] [MAIN      ] Update Progress: 2326/2366 symbols completed. WTTR took 24.7s. Estimated remaining: 5m 8s. Rate: 7.8 symbols/min
[2025-10-24T21:58:52.678545] [INFO ] [MAIN      ] XFLT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:58:52.707119] [DEBUG] [LOCAL     ] XFLT: Loaded 30116 existing records from primary storage.
[2025-10-24T21:58:52.707383] [INFO ] [MAIN      ] XFLT: Loaded 30116 existing records.
[2025-10-24T21:58:52.893176] [WARN ] [MAIN      ] XFLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:58:52.893367] [INFO ] [MAIN      ] XFLT: Wiping existing primary data before full refresh.
[2025-10-24T21:58:52.893412] [INFO ] [LOCAL     ] XFLT: Starting deletion of primary data.
[2025-10-24T21:58:52.893928] [DEBUG] [LOCAL     ] XFLT: Deleted primary data file.
[2025-10-24T21:58:52.893984] [INFO ] [MAIN      ] XFLT: Starting full primary refresh.
[2025-10-24T21:58:52.955787] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-03.
[2025-10-24T21:58:53.255018] [INFO ] [REMOTE    ] XFLT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:58:53.284801] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-06 (1.94 seconds).
[2025-10-24T21:58:53.747694] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-01.
[2025-10-24T21:58:53.879376] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-05 (1.72 seconds).
[2025-10-24T21:58:54.547663] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-06.
[2025-10-24T21:58:54.970549] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-03 (2.01 seconds).
[2025-10-24T21:58:55.025733] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-01 (1.28 seconds).
[2025-10-24T21:58:55.347723] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-02.
[2025-10-24T21:58:56.143159] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-06 (1.60 seconds).
[2025-10-24T21:58:56.152825] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-04.
[2025-10-24T21:58:56.584902] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-02 (1.24 seconds).
[2025-10-24T21:58:56.947742] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-07.
[2025-10-24T21:58:57.747694] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-07.
[2025-10-24T21:58:58.085017] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T21:58:58.547726] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-05.
[2025-10-24T21:58:58.943470] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-07 (2.00 seconds).
[2025-10-24T21:58:59.093232] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-07 (1.35 seconds).
[2025-10-24T21:58:59.347713] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-08.
[2025-10-24T21:59:00.147678] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-08.
[2025-10-24T21:59:00.369929] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-05 (1.82 seconds).
[2025-10-24T21:59:00.947673] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-03.
[2025-10-24T21:59:01.435075] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-08 (2.09 seconds).
[2025-10-24T21:59:01.659954] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T21:59:01.747609] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-09.
[2025-10-24T21:59:02.301868] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-03 (1.35 seconds).
[2025-10-24T21:59:02.547730] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-04.
[2025-10-24T21:59:03.347818] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-09.
[2025-10-24T21:59:03.698193] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-09 (1.95 seconds).
[2025-10-24T21:59:03.972754] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-04 (1.43 seconds).
[2025-10-24T21:59:04.147725] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-05.
[2025-10-24T21:59:04.947729] [INFO ] [REMOTE    ] WU: Fetching primary data for 2025-10.
[2025-10-24T21:59:05.115712] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-09 (1.77 seconds).
[2025-10-24T21:59:05.486144] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T21:59:05.747722] [INFO ] [REMOTE    ] WWW: Fetching primary data for 2025-10.
[2025-10-24T21:59:06.547682] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-06.
[2025-10-24T21:59:06.658054] [INFO ] [REMOTE    ] WU: Incremental fetch complete for 2025-10 (1.71 seconds).
[2025-10-24T21:59:06.669360] [INFO ] [REMOTE    ] WU: Full fetch complete (77522 records).
[2025-10-24T21:59:06.669587] [DEBUG] [VALIDATOR ] WU: Validating primary data.
[2025-10-24T21:59:07.085777] [DEBUG] [VALIDATOR ] WU: All expected trading days are present.
[2025-10-24T21:59:07.085975] [DEBUG] [VALIDATOR ] WU: Primary data validation passed.
[2025-10-24T21:59:07.088149] [INFO ] [MAIN      ] WU: Fetched primary data is valid.
[2025-10-24T21:59:07.088391] [DEBUG] [LOCAL     ] WU: Saving primary data.
[2025-10-24T21:59:07.089573] [FATAL] [LOCAL     ] WU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:59:07.089709] [FATAL] [MAIN      ] WU: Failed to save primary data.
[2025-10-24T21:59:07.089762] [WARN ] [MAIN      ] WU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:59:07.089832] [INFO ] [LOCAL     ] WU: Starting deletion of primary data.
[2025-10-24T21:59:07.089910] [DEBUG] [LOCAL     ] WU: No primary data file found to delete.
[2025-10-24T21:59:07.089951] [INFO ] [LOCAL     ] WU: Starting deletion of derivative data.
[2025-10-24T21:59:07.090235] [DEBUG] [LOCAL     ] WU: Deleted derivative data file.
[2025-10-24T21:59:07.090598] [INFO ] [MAIN      ] Update Progress: 2327/2366 symbols completed. WU took 38.1s. Estimated remaining: 5m 1s. Rate: 7.8 symbols/min
[2025-10-24T21:59:07.292720] [INFO ] [REMOTE    ] WWW: Incremental fetch complete for 2025-10 (1.55 seconds).
[2025-10-24T21:59:07.310914] [INFO ] [MAIN      ] XHR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:59:07.312176] [INFO ] [REMOTE    ] WWW: Full fetch complete (70654 records).
[2025-10-24T21:59:07.312468] [DEBUG] [VALIDATOR ] WWW: Validating primary data.
[2025-10-24T21:59:07.352891] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-06.
[2025-10-24T21:59:07.678061] [DEBUG] [LOCAL     ] XHR: Loaded 43601 existing records from primary storage.
[2025-10-24T21:59:07.725222] [INFO ] [MAIN      ] XHR: Loaded 43601 existing records.
[2025-10-24T21:59:07.822454] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present.
[2025-10-24T21:59:07.827719] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed.
[2025-10-24T21:59:07.847361] [INFO ] [MAIN      ] WWW: Fetched primary data is valid.
[2025-10-24T21:59:07.850723] [DEBUG] [LOCAL     ] WWW: Saving primary data.
[2025-10-24T21:59:07.867432] [FATAL] [LOCAL     ] WWW: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:59:07.878422] [FATAL] [MAIN      ] WWW: Failed to save primary data.
[2025-10-24T21:59:07.892014] [WARN ] [MAIN      ] WWW: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:59:07.929719] [INFO ] [LOCAL     ] WWW: Starting deletion of primary data.
[2025-10-24T21:59:07.931838] [DEBUG] [LOCAL     ] WWW: No primary data file found to delete.
[2025-10-24T21:59:07.935006] [WARN ] [MAIN      ] XHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:59:07.935302] [INFO ] [MAIN      ] XHR: Wiping existing primary data before full refresh.
[2025-10-24T21:59:07.935493] [INFO ] [LOCAL     ] WWW: Starting deletion of derivative data.
[2025-10-24T21:59:07.935399] [INFO ] [LOCAL     ] XHR: Starting deletion of primary data.
[2025-10-24T21:59:07.948548] [DEBUG] [LOCAL     ] WWW: Deleted derivative data file.
[2025-10-24T21:59:07.950542] [DEBUG] [LOCAL     ] XHR: Deleted primary data file.
[2025-10-24T21:59:07.951269] [INFO ] [MAIN      ] Update Progress: 2328/2366 symbols completed. WWW took 29.5s. Estimated remaining: 4m 53s. Rate: 7.8 symbols/min
[2025-10-24T21:59:07.950692] [INFO ] [MAIN      ] XHR: Starting full primary refresh.
[2025-10-24T21:59:07.969410] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T21:59:08.148821] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-07.
[2025-10-24T21:59:08.378694] [INFO ] [MAIN      ] XIFR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:59:08.405500] [DEBUG] [LOCAL     ] XIFR: No existing data file found in primary storage.
[2025-10-24T21:59:08.411392] [WARN ] [MAIN      ] XIFR: No existing data found, performing full refresh instead.
[2025-10-24T21:59:08.436445] [INFO ] [MAIN      ] XIFR: Wiping existing primary data before full refresh.
[2025-10-24T21:59:08.438866] [INFO ] [LOCAL     ] XIFR: Starting deletion of primary data.
[2025-10-24T21:59:08.439240] [DEBUG] [LOCAL     ] XIFR: No primary data file found to delete.
[2025-10-24T21:59:08.444747] [INFO ] [MAIN      ] XIFR: Starting full primary refresh.
[2025-10-24T21:59:08.627266] [INFO ] [REMOTE    ] XHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:59:08.892798] [INFO ] [REMOTE    ] XIFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:59:08.947679] [INFO ] [REMOTE    ] XIFR: Fetching primary data for 2025-01.
[2025-10-24T21:59:09.147685] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-06 (1.79 seconds).
[2025-10-24T21:59:09.164942] [DEBUG] [REMOTE    ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY.
[2025-10-24T21:59:09.165266] [WARN ] [REMOTE    ] XIFR: No data returned for month 2025-01
[2025-10-24T21:59:09.165367] [FATAL] [REMOTE    ] XIFR: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T21:59:09.165417] [FATAL] [MAIN      ] XIFR: Failed to fetch primary data.
[2025-10-24T21:59:09.165450] [WARN ] [MAIN      ] XIFR: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T21:59:09.165550] [INFO ] [LOCAL     ] XIFR: Starting deletion of primary data.
[2025-10-24T21:59:09.165612] [DEBUG] [LOCAL     ] XIFR: No primary data file found to delete.
[2025-10-24T21:59:09.165672] [INFO ] [LOCAL     ] XIFR: Starting deletion of derivative data.
[2025-10-24T21:59:09.165737] [DEBUG] [LOCAL     ] XIFR: No derivative data file found to delete.
[2025-10-24T21:59:09.165784] [INFO ] [MAIN      ] Update Progress: 2329/2366 symbols completed. XIFR took 1.2s. Estimated remaining: 4m 45s. Rate: 7.8 symbols/min
[2025-10-24T21:59:09.340987] [INFO ] [MAIN      ] XOM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:59:09.395682] [DEBUG] [LOCAL     ] XOM: Loaded 54183 existing records from primary storage.
[2025-10-24T21:59:09.396004] [INFO ] [MAIN      ] XOM: Loaded 54183 existing records.
[2025-10-24T21:59:09.584638] [WARN ] [MAIN      ] XOM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:59:09.585111] [INFO ] [MAIN      ] XOM: Wiping existing primary data before full refresh.
[2025-10-24T21:59:09.585251] [INFO ] [LOCAL     ] XOM: Starting deletion of primary data.
[2025-10-24T21:59:09.586180] [DEBUG] [LOCAL     ] XOM: Deleted primary data file.
[2025-10-24T21:59:09.586240] [INFO ] [MAIN      ] XOM: Starting full primary refresh.
[2025-10-24T21:59:09.715950] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T21:59:09.765412] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-07.
[2025-10-24T21:59:09.986820] [INFO ] [REMOTE    ] XOM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:59:10.547723] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-01.
[2025-10-24T21:59:11.347679] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-08.
[2025-10-24T21:59:11.633725] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-07 (1.87 seconds).
[2025-10-24T21:59:12.147640] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-08.
[2025-10-24T21:59:12.612066] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-08 (1.26 seconds).
[2025-10-24T21:59:12.947672] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-01.
[2025-10-24T21:59:13.023968] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-01 (2.48 seconds).
[2025-10-24T21:59:13.747721] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-02.
[2025-10-24T21:59:14.055580] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-08 (1.91 seconds).
[2025-10-24T21:59:14.188781] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-01 (1.24 seconds).
[2025-10-24T21:59:14.547725] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-09.
[2025-10-24T21:59:15.347709] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-09.
[2025-10-24T21:59:15.973110] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-02 (2.23 seconds).
[2025-10-24T21:59:16.000891] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-09 (1.45 seconds).
[2025-10-24T21:59:16.158030] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-02.
[2025-10-24T21:59:16.185019] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-09 (0.84 seconds).
[2025-10-24T21:59:16.947713] [INFO ] [REMOTE    ] WY: Fetching primary data for 2025-10.
[2025-10-24T21:59:17.678154] [INFO ] [REMOTE    ] WY: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T21:59:17.707732] [INFO ] [REMOTE    ] WY: Full fetch complete (77046 records).
[2025-10-24T21:59:17.708699] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-02 (1.55 seconds).
[2025-10-24T21:59:17.708869] [DEBUG] [VALIDATOR ] WY: Validating primary data.
[2025-10-24T21:59:17.752716] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-03.
[2025-10-24T21:59:18.119287] [DEBUG] [VALIDATOR ] WY: All expected trading days are present.
[2025-10-24T21:59:18.119398] [DEBUG] [VALIDATOR ] WY: Primary data validation passed.
[2025-10-24T21:59:18.120623] [INFO ] [MAIN      ] WY: Fetched primary data is valid.
[2025-10-24T21:59:18.120707] [DEBUG] [LOCAL     ] WY: Saving primary data.
[2025-10-24T21:59:18.121303] [FATAL] [LOCAL     ] WY: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:59:18.121397] [FATAL] [MAIN      ] WY: Failed to save primary data.
[2025-10-24T21:59:18.121438] [WARN ] [MAIN      ] WY: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:59:18.121473] [INFO ] [LOCAL     ] WY: Starting deletion of primary data.
[2025-10-24T21:59:18.121524] [DEBUG] [LOCAL     ] WY: No primary data file found to delete.
[2025-10-24T21:59:18.121559] [INFO ] [LOCAL     ] WY: Starting deletion of derivative data.
[2025-10-24T21:59:18.121763] [DEBUG] [LOCAL     ] WY: Deleted derivative data file.
[2025-10-24T21:59:18.122768] [INFO ] [MAIN      ] Update Progress: 2330/2366 symbols completed. WY took 36.3s. Estimated remaining: 4m 37s. Rate: 7.8 symbols/min
[2025-10-24T21:59:18.290059] [INFO ] [MAIN      ] XPER: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:59:18.319738] [DEBUG] [LOCAL     ] XPER: Loaded 30878 existing records from primary storage.
[2025-10-24T21:59:18.319994] [INFO ] [MAIN      ] XPER: Loaded 30878 existing records.
[2025-10-24T21:59:18.495821] [WARN ] [MAIN      ] XPER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:59:18.496013] [INFO ] [MAIN      ] XPER: Wiping existing primary data before full refresh.
[2025-10-24T21:59:18.496057] [INFO ] [LOCAL     ] XPER: Starting deletion of primary data.
[2025-10-24T21:59:18.496256] [DEBUG] [LOCAL     ] XPER: Deleted primary data file.
[2025-10-24T21:59:18.496293] [INFO ] [MAIN      ] XPER: Starting full primary refresh.
[2025-10-24T21:59:18.553789] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-03.
[2025-10-24T21:59:18.853243] [INFO ] [REMOTE    ] XPER: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:59:19.347735] [INFO ] [REMOTE    ] XFLT: Fetching primary data for 2025-10.
[2025-10-24T21:59:19.392175] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-03 (1.64 seconds).
[2025-10-24T21:59:20.147813] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-04.
[2025-10-24T21:59:20.669114] [INFO ] [REMOTE    ] XFLT: Incremental fetch complete for 2025-10 (1.32 seconds).
[2025-10-24T21:59:20.675738] [INFO ] [REMOTE    ] XFLT: Full fetch complete (43840 records).
[2025-10-24T21:59:20.676029] [DEBUG] [VALIDATOR ] XFLT: Validating primary data.
[2025-10-24T21:59:20.954481] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-01.
[2025-10-24T21:59:21.099454] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present.
[2025-10-24T21:59:21.099687] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed.
[2025-10-24T21:59:21.101113] [INFO ] [MAIN      ] XFLT: Fetched primary data is valid.
[2025-10-24T21:59:21.101266] [DEBUG] [LOCAL     ] XFLT: Saving primary data.
[2025-10-24T21:59:21.101957] [FATAL] [LOCAL     ] XFLT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:59:21.118847] [FATAL] [MAIN      ] XFLT: Failed to save primary data.
[2025-10-24T21:59:21.129741] [WARN ] [MAIN      ] XFLT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:59:21.132895] [INFO ] [LOCAL     ] XFLT: Starting deletion of primary data.
[2025-10-24T21:59:21.133067] [DEBUG] [LOCAL     ] XFLT: No primary data file found to delete.
[2025-10-24T21:59:21.133175] [INFO ] [LOCAL     ] XFLT: Starting deletion of derivative data.
[2025-10-24T21:59:21.133480] [DEBUG] [LOCAL     ] XFLT: Deleted derivative data file.
[2025-10-24T21:59:21.133625] [INFO ] [MAIN      ] Update Progress: 2331/2366 symbols completed. XFLT took 28.6s. Estimated remaining: 4m 30s. Rate: 7.8 symbols/min
[2025-10-24T21:59:21.136216] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-03 (2.58 seconds).
[2025-10-24T21:59:21.325666] [INFO ] [MAIN      ] XPEV: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:59:21.359733] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-04 (1.21 seconds).
[2025-10-24T21:59:21.419440] [DEBUG] [LOCAL     ] XPEV: Loaded 54006 existing records from primary storage.
[2025-10-24T21:59:21.419967] [INFO ] [MAIN      ] XPEV: Loaded 54006 existing records.
[2025-10-24T21:59:21.601329] [WARN ] [MAIN      ] XPEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:59:21.601605] [INFO ] [MAIN      ] XPEV: Wiping existing primary data before full refresh.
[2025-10-24T21:59:21.601682] [INFO ] [LOCAL     ] XPEV: Starting deletion of primary data.
[2025-10-24T21:59:21.602030] [DEBUG] [LOCAL     ] XPEV: Deleted primary data file.
[2025-10-24T21:59:21.602070] [INFO ] [MAIN      ] XPEV: Starting full primary refresh.
[2025-10-24T21:59:21.752880] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-05.
[2025-10-24T21:59:22.049916] [INFO ] [REMOTE    ] XPEV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:59:22.252199] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T21:59:22.547736] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-02.
[2025-10-24T21:59:23.133075] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-05 (1.38 seconds).
[2025-10-24T21:59:23.347690] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-06.
[2025-10-24T21:59:23.742148] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-02 (1.19 seconds).
[2025-10-24T21:59:24.147701] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-01.
[2025-10-24T21:59:24.573904] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-06 (1.23 seconds).
[2025-10-24T21:59:24.947742] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-03.
[2025-10-24T21:59:25.747694] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-07.
[2025-10-24T21:59:26.108512] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-03 (1.16 seconds).
[2025-10-24T21:59:26.231878] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-01 (2.08 seconds).
[2025-10-24T21:59:26.547732] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-04.
[2025-10-24T21:59:27.300249] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T21:59:27.347674] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-08.
[2025-10-24T21:59:27.777140] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-04 (1.23 seconds).
[2025-10-24T21:59:28.147723] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-04.
[2025-10-24T21:59:28.916765] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-08 (1.57 seconds).
[2025-10-24T21:59:28.947674] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-09.
[2025-10-24T21:59:29.747689] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-02.
[2025-10-24T21:59:30.568243] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-05.
[2025-10-24T21:59:30.586112] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-09 (1.64 seconds).
[2025-10-24T21:59:30.688052] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-04 (2.54 seconds).
[2025-10-24T21:59:31.347797] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-05.
[2025-10-24T21:59:31.896258] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-05 (1.33 seconds).
[2025-10-24T21:59:32.003207] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-02 (2.26 seconds).
[2025-10-24T21:59:32.147674] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-03.
[2025-10-24T21:59:32.947696] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-06.
[2025-10-24T21:59:33.465835] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-05 (2.12 seconds).
[2025-10-24T21:59:33.747609] [INFO ] [REMOTE    ] XHR: Fetching primary data for 2025-10.
[2025-10-24T21:59:34.082493] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-06 (1.13 seconds).
[2025-10-24T21:59:34.547681] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-07.
[2025-10-24T21:59:34.670396] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-03 (2.52 seconds).
[2025-10-24T21:59:35.214898] [INFO ] [REMOTE    ] XHR: Incremental fetch complete for 2025-10 (1.47 seconds).
[2025-10-24T21:59:35.222415] [INFO ] [REMOTE    ] XHR: Full fetch complete (61912 records).
[2025-10-24T21:59:35.222571] [DEBUG] [VALIDATOR ] XHR: Validating primary data.
[2025-10-24T21:59:35.352857] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-06.
[2025-10-24T21:59:35.625814] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present.
[2025-10-24T21:59:35.625901] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed.
[2025-10-24T21:59:35.627155] [INFO ] [MAIN      ] XHR: Fetched primary data is valid.
[2025-10-24T21:59:35.627219] [DEBUG] [LOCAL     ] XHR: Saving primary data.
[2025-10-24T21:59:35.627780] [FATAL] [LOCAL     ] XHR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:59:35.627867] [FATAL] [MAIN      ] XHR: Failed to save primary data.
[2025-10-24T21:59:35.627911] [WARN ] [MAIN      ] XHR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:59:35.627945] [INFO ] [LOCAL     ] XHR: Starting deletion of primary data.
[2025-10-24T21:59:35.627996] [DEBUG] [LOCAL     ] XHR: No primary data file found to delete.
[2025-10-24T21:59:35.628033] [INFO ] [LOCAL     ] XHR: Starting deletion of derivative data.
[2025-10-24T21:59:35.628245] [DEBUG] [LOCAL     ] XHR: Deleted derivative data file.
[2025-10-24T21:59:35.628547] [INFO ] [MAIN      ] Update Progress: 2332/2366 symbols completed. XHR took 28.5s. Estimated remaining: 4m 22s. Rate: 7.8 symbols/min
[2025-10-24T21:59:35.804205] [INFO ] [MAIN      ] XPO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:59:35.821130] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-07 (1.27 seconds).
[2025-10-24T21:59:35.869714] [DEBUG] [LOCAL     ] XPO: Loaded 47814 existing records from primary storage.
[2025-10-24T21:59:35.870039] [INFO ] [MAIN      ] XPO: Loaded 47814 existing records.
[2025-10-24T21:59:36.057193] [WARN ] [MAIN      ] XPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:59:36.057502] [INFO ] [MAIN      ] XPO: Wiping existing primary data before full refresh.
[2025-10-24T21:59:36.057565] [INFO ] [LOCAL     ] XPO: Starting deletion of primary data.
[2025-10-24T21:59:36.057850] [DEBUG] [LOCAL     ] XPO: Deleted primary data file.
[2025-10-24T21:59:36.057907] [INFO ] [MAIN      ] XPO: Starting full primary refresh.
[2025-10-24T21:59:36.152942] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-04.
[2025-10-24T21:59:36.446153] [INFO ] [REMOTE    ] XPO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:59:36.947725] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-01.
[2025-10-24T21:59:37.747714] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-08.
[2025-10-24T21:59:38.011723] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-06 (2.66 seconds).
[2025-10-24T21:59:38.547671] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-07.
[2025-10-24T21:59:38.646551] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T21:59:38.742149] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-04 (2.59 seconds).
[2025-10-24T21:59:39.172784] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-08 (1.43 seconds).
[2025-10-24T21:59:39.347744] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-02.
[2025-10-24T21:59:40.147761] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-05.
[2025-10-24T21:59:40.933733] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-02 (1.59 seconds).
[2025-10-24T21:59:40.947605] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-03.
[2025-10-24T21:59:41.005860] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-07 (2.46 seconds).
[2025-10-24T21:59:41.747719] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-09.
[2025-10-24T21:59:42.547713] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-08.
[2025-10-24T21:59:42.651219] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-05 (2.50 seconds).
[2025-10-24T21:59:42.718141] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-03 (1.77 seconds).
[2025-10-24T21:59:43.152359] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-09 (1.40 seconds).
[2025-10-24T21:59:43.347712] [INFO ] [REMOTE    ] XPER: Fetching primary data for 2025-10.
[2025-10-24T21:59:44.147700] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-04.
[2025-10-24T21:59:44.675243] [INFO ] [REMOTE    ] XPER: Incremental fetch complete for 2025-10 (1.33 seconds).
[2025-10-24T21:59:44.681570] [INFO ] [REMOTE    ] XPER: Full fetch complete (43533 records).
[2025-10-24T21:59:44.681711] [DEBUG] [VALIDATOR ] XPER: Validating primary data.
[2025-10-24T21:59:44.948487] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-06.
[2025-10-24T21:59:45.094873] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-08 (2.55 seconds).
[2025-10-24T21:59:45.160711] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present.
[2025-10-24T21:59:45.160804] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed.
[2025-10-24T21:59:45.161865] [INFO ] [MAIN      ] XPER: Fetched primary data is valid.
[2025-10-24T21:59:45.161927] [DEBUG] [LOCAL     ] XPER: Saving primary data.
[2025-10-24T21:59:45.162387] [FATAL] [LOCAL     ] XPER: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:59:45.162504] [FATAL] [MAIN      ] XPER: Failed to save primary data.
[2025-10-24T21:59:45.162582] [WARN ] [MAIN      ] XPER: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:59:45.162693] [INFO ] [LOCAL     ] XPER: Starting deletion of primary data.
[2025-10-24T21:59:45.162779] [DEBUG] [LOCAL     ] XPER: No primary data file found to delete.
[2025-10-24T21:59:45.162834] [INFO ] [LOCAL     ] XPER: Starting deletion of derivative data.
[2025-10-24T21:59:45.163086] [DEBUG] [LOCAL     ] XPER: Deleted derivative data file.
[2025-10-24T21:59:45.163212] [INFO ] [MAIN      ] Update Progress: 2333/2366 symbols completed. XPER took 27.0s. Estimated remaining: 4m 14s. Rate: 7.8 symbols/min
[2025-10-24T21:59:45.356958] [INFO ] [MAIN      ] XPOF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:59:45.391744] [DEBUG] [LOCAL     ] XPOF: Loaded 37137 existing records from primary storage.
[2025-10-24T21:59:45.392068] [INFO ] [MAIN      ] XPOF: Loaded 37137 existing records.
[2025-10-24T21:59:45.583307] [WARN ] [MAIN      ] XPOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:59:45.583538] [INFO ] [MAIN      ] XPOF: Wiping existing primary data before full refresh.
[2025-10-24T21:59:45.583590] [INFO ] [LOCAL     ] XPOF: Starting deletion of primary data.
[2025-10-24T21:59:45.583855] [DEBUG] [LOCAL     ] XPOF: Deleted primary data file.
[2025-10-24T21:59:45.583911] [INFO ] [MAIN      ] XPOF: Starting full primary refresh.
[2025-10-24T21:59:45.760467] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-09.
[2025-10-24T21:59:45.953801] [INFO ] [REMOTE    ] XPOF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:59:45.985574] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-04 (1.84 seconds).
[2025-10-24T21:59:46.547698] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-05.
[2025-10-24T21:59:47.350216] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-01.
[2025-10-24T21:59:47.353148] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-06 (2.40 seconds).
[2025-10-24T21:59:47.972854] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-09 (2.21 seconds).
[2025-10-24T21:59:48.147690] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-07.
[2025-10-24T21:59:48.287235] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T21:59:48.352728] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-01 (1.00 seconds).
[2025-10-24T21:59:48.947754] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-06.
[2025-10-24T21:59:49.747723] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-02.
[2025-10-24T21:59:50.364624] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-07 (2.22 seconds).
[2025-10-24T21:59:50.547835] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-08.
[2025-10-24T21:59:50.586258] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-06 (1.64 seconds).
[2025-10-24T21:59:51.051755] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T21:59:51.347750] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-07.
[2025-10-24T21:59:52.147704] [INFO ] [REMOTE    ] XOM: Fetching primary data for 2025-10.
[2025-10-24T21:59:52.947706] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-03.
[2025-10-24T21:59:52.981054] [INFO ] [REMOTE    ] XOM: Incremental fetch complete for 2025-10 (0.83 seconds).
[2025-10-24T21:59:52.990860] [INFO ] [REMOTE    ] XOM: Full fetch complete (77973 records).
[2025-10-24T21:59:52.991014] [DEBUG] [VALIDATOR ] XOM: Validating primary data.
[2025-10-24T21:59:53.419353] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-08 (2.87 seconds).
[2025-10-24T21:59:53.439014] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present.
[2025-10-24T21:59:53.439221] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed.
[2025-10-24T21:59:53.452205] [INFO ] [MAIN      ] XOM: Fetched primary data is valid.
[2025-10-24T21:59:53.452860] [DEBUG] [LOCAL     ] XOM: Saving primary data.
[2025-10-24T21:59:53.453680] [FATAL] [LOCAL     ] XOM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:59:53.453778] [FATAL] [MAIN      ] XOM: Failed to save primary data.
[2025-10-24T21:59:53.453845] [WARN ] [MAIN      ] XOM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:59:53.453912] [INFO ] [LOCAL     ] XOM: Starting deletion of primary data.
[2025-10-24T21:59:53.453980] [DEBUG] [LOCAL     ] XOM: No primary data file found to delete.
[2025-10-24T21:59:53.454018] [INFO ] [LOCAL     ] XOM: Starting deletion of derivative data.
[2025-10-24T21:59:53.454201] [DEBUG] [LOCAL     ] XOM: Deleted derivative data file.
[2025-10-24T21:59:53.454557] [INFO ] [MAIN      ] Update Progress: 2334/2366 symbols completed. XOM took 44.3s. Estimated remaining: 4m 7s. Rate: 7.8 symbols/min
[2025-10-24T21:59:53.632412] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-07 (2.28 seconds).
[2025-10-24T21:59:53.712448] [INFO ] [MAIN      ] XPRO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T21:59:53.753808] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-09.
[2025-10-24T21:59:53.757722] [DEBUG] [LOCAL     ] XPRO: Loaded 46174 existing records from primary storage.
[2025-10-24T21:59:53.758127] [INFO ] [MAIN      ] XPRO: Loaded 46174 existing records.
[2025-10-24T21:59:53.931508] [WARN ] [MAIN      ] XPRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T21:59:53.931718] [INFO ] [MAIN      ] XPRO: Wiping existing primary data before full refresh.
[2025-10-24T21:59:53.931771] [INFO ] [LOCAL     ] XPRO: Starting deletion of primary data.
[2025-10-24T21:59:53.932363] [DEBUG] [LOCAL     ] XPRO: Deleted primary data file.
[2025-10-24T21:59:53.932414] [INFO ] [MAIN      ] XPRO: Starting full primary refresh.
[2025-10-24T21:59:54.278994] [INFO ] [REMOTE    ] XPRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T21:59:54.430458] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-03 (1.48 seconds).
[2025-10-24T21:59:54.547685] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-04.
[2025-10-24T21:59:55.347731] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-01.
[2025-10-24T21:59:55.820838] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-04 (1.27 seconds).
[2025-10-24T21:59:56.147732] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-05.
[2025-10-24T21:59:56.256300] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-09 (2.50 seconds).
[2025-10-24T21:59:56.945469] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-01 (1.60 seconds).
[2025-10-24T21:59:56.954261] [INFO ] [REMOTE    ] XPEV: Fetching primary data for 2025-10.
[2025-10-24T21:59:57.578737] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-05 (1.43 seconds).
[2025-10-24T21:59:57.747667] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-08.
[2025-10-24T21:59:58.547675] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-06.
[2025-10-24T21:59:59.356057] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-02.
[2025-10-24T21:59:59.361827] [INFO ] [REMOTE    ] XPEV: Incremental fetch complete for 2025-10 (2.41 seconds).
[2025-10-24T21:59:59.373184] [INFO ] [REMOTE    ] XPEV: Full fetch complete (77770 records).
[2025-10-24T21:59:59.373349] [DEBUG] [VALIDATOR ] XPEV: Validating primary data.
[2025-10-24T21:59:59.802235] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present.
[2025-10-24T21:59:59.802704] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed.
[2025-10-24T21:59:59.804166] [INFO ] [MAIN      ] XPEV: Fetched primary data is valid.
[2025-10-24T21:59:59.804259] [DEBUG] [LOCAL     ] XPEV: Saving primary data.
[2025-10-24T21:59:59.820995] [FATAL] [LOCAL     ] XPEV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T21:59:59.831579] [FATAL] [MAIN      ] XPEV: Failed to save primary data.
[2025-10-24T21:59:59.831736] [WARN ] [MAIN      ] XPEV: Deleting existing primary and derivative data due to save failure.
[2025-10-24T21:59:59.831847] [INFO ] [LOCAL     ] XPEV: Starting deletion of primary data.
[2025-10-24T21:59:59.832679] [DEBUG] [LOCAL     ] XPEV: No primary data file found to delete.
[2025-10-24T21:59:59.833604] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T21:59:59.833724] [INFO ] [LOCAL     ] XPEV: Starting deletion of derivative data.
[2025-10-24T21:59:59.844987] [DEBUG] [LOCAL     ] XPEV: Deleted derivative data file.
[2025-10-24T21:59:59.845537] [INFO ] [MAIN      ] Update Progress: 2335/2366 symbols completed. XPEV took 38.7s. Estimated remaining: 3m 59s. Rate: 7.8 symbols/min
[2025-10-24T21:59:59.979180] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-08 (2.23 seconds).
[2025-10-24T22:00:00.056091] [INFO ] [MAIN      ] XYF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:00:00.084983] [DEBUG] [LOCAL     ] XYF: Loaded 27493 existing records from primary storage.
[2025-10-24T22:00:00.085232] [INFO ] [MAIN      ] XYF: Loaded 27493 existing records.
[2025-10-24T22:00:00.152732] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-07.
[2025-10-24T22:00:00.266472] [WARN ] [MAIN      ] XYF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:00:00.266743] [INFO ] [MAIN      ] XYF: Wiping existing primary data before full refresh.
[2025-10-24T22:00:00.266800] [INFO ] [LOCAL     ] XYF: Starting deletion of primary data.
[2025-10-24T22:00:00.267022] [DEBUG] [LOCAL     ] XYF: Deleted primary data file.
[2025-10-24T22:00:00.267095] [INFO ] [MAIN      ] XYF: Starting full primary refresh.
[2025-10-24T22:00:00.627204] [INFO ] [REMOTE    ] XYF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:00:00.847049] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-02 (1.49 seconds).
[2025-10-24T22:00:00.947609] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-09.
[2025-10-24T22:00:01.747638] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-01.
[2025-10-24T22:00:01.929468] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-07 (1.78 seconds).
[2025-10-24T22:00:02.152803] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-01 (0.41 seconds).
[2025-10-24T22:00:02.371637] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-09 (1.42 seconds).
[2025-10-24T22:00:02.547687] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-08.
[2025-10-24T22:00:03.347690] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-02.
[2025-10-24T22:00:04.147673] [INFO ] [REMOTE    ] XPO: Fetching primary data for 2025-10.
[2025-10-24T22:00:04.295543] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T22:00:04.376984] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-02 (1.03 seconds).
[2025-10-24T22:00:04.947703] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-09.
[2025-10-24T22:00:05.747723] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-03.
[2025-10-24T22:00:05.786833] [INFO ] [REMOTE    ] XPO: Incremental fetch complete for 2025-10 (1.64 seconds).
[2025-10-24T22:00:05.795503] [INFO ] [REMOTE    ] XPO: Full fetch complete (69558 records).
[2025-10-24T22:00:05.795628] [DEBUG] [VALIDATOR ] XPO: Validating primary data.
[2025-10-24T22:00:06.236879] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present.
[2025-10-24T22:00:06.236991] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed.
[2025-10-24T22:00:06.238333] [INFO ] [MAIN      ] XPO: Fetched primary data is valid.
[2025-10-24T22:00:06.238463] [DEBUG] [LOCAL     ] XPO: Saving primary data.
[2025-10-24T22:00:06.239190] [FATAL] [LOCAL     ] XPO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:00:06.239390] [FATAL] [MAIN      ] XPO: Failed to save primary data.
[2025-10-24T22:00:06.239485] [WARN ] [MAIN      ] XPO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:00:06.239588] [INFO ] [LOCAL     ] XPO: Starting deletion of primary data.
[2025-10-24T22:00:06.239686] [DEBUG] [LOCAL     ] XPO: No primary data file found to delete.
[2025-10-24T22:00:06.239743] [INFO ] [LOCAL     ] XPO: Starting deletion of derivative data.
[2025-10-24T22:00:06.239957] [DEBUG] [LOCAL     ] XPO: Deleted derivative data file.
[2025-10-24T22:00:06.240377] [INFO ] [MAIN      ] Update Progress: 2336/2366 symbols completed. XPO took 30.6s. Estimated remaining: 3m 51s. Rate: 7.8 symbols/min
[2025-10-24T22:00:06.421629] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T22:00:06.454007] [INFO ] [MAIN      ] XYL: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:00:06.502555] [DEBUG] [LOCAL     ] XYL: Loaded 47890 existing records from primary storage.
[2025-10-24T22:00:06.502928] [INFO ] [MAIN      ] XYL: Loaded 47890 existing records.
[2025-10-24T22:00:06.556339] [INFO ] [REMOTE    ] XPOF: Fetching primary data for 2025-10.
[2025-10-24T22:00:06.684958] [WARN ] [MAIN      ] XYL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:00:06.685200] [INFO ] [MAIN      ] XYL: Wiping existing primary data before full refresh.
[2025-10-24T22:00:06.685248] [INFO ] [LOCAL     ] XYL: Starting deletion of primary data.
[2025-10-24T22:00:06.685482] [DEBUG] [LOCAL     ] XYL: Deleted primary data file.
[2025-10-24T22:00:06.685541] [INFO ] [MAIN      ] XYL: Starting full primary refresh.
[2025-10-24T22:00:07.084877] [INFO ] [REMOTE    ] XYL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:00:07.086404] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-03 (1.34 seconds).
[2025-10-24T22:00:07.347729] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-04.
[2025-10-24T22:00:08.057904] [INFO ] [REMOTE    ] XPOF: Incremental fetch complete for 2025-10 (1.50 seconds).
[2025-10-24T22:00:08.064485] [INFO ] [REMOTE    ] XPOF: Full fetch complete (52886 records).
[2025-10-24T22:00:08.064639] [DEBUG] [VALIDATOR ] XPOF: Validating primary data.
[2025-10-24T22:00:08.153837] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-01.
[2025-10-24T22:00:08.464851] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present.
[2025-10-24T22:00:08.465040] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed.
[2025-10-24T22:00:08.466216] [INFO ] [MAIN      ] XPOF: Fetched primary data is valid.
[2025-10-24T22:00:08.466301] [DEBUG] [LOCAL     ] XPOF: Saving primary data.
[2025-10-24T22:00:08.472109] [FATAL] [LOCAL     ] XPOF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:00:08.480334] [FATAL] [MAIN      ] XPOF: Failed to save primary data.
[2025-10-24T22:00:08.481011] [WARN ] [MAIN      ] XPOF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:00:08.481812] [INFO ] [LOCAL     ] XPOF: Starting deletion of primary data.
[2025-10-24T22:00:08.481622] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-04 (1.13 seconds).
[2025-10-24T22:00:08.487526] [DEBUG] [LOCAL     ] XPOF: No primary data file found to delete.
[2025-10-24T22:00:08.487592] [INFO ] [LOCAL     ] XPOF: Starting deletion of derivative data.
[2025-10-24T22:00:08.487866] [DEBUG] [LOCAL     ] XPOF: Deleted derivative data file.
[2025-10-24T22:00:08.488357] [INFO ] [MAIN      ] Update Progress: 2337/2366 symbols completed. XPOF took 23.3s. Estimated remaining: 3m 43s. Rate: 7.8 symbols/min
[2025-10-24T22:00:08.699286] [INFO ] [MAIN      ] XYZ: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:00:08.699485] [DEBUG] [LOCAL     ] XYZ: No existing data file found in primary storage.
[2025-10-24T22:00:08.699522] [WARN ] [MAIN      ] XYZ: No existing data found, performing full refresh instead.
[2025-10-24T22:00:08.699634] [INFO ] [MAIN      ] XYZ: Wiping existing primary data before full refresh.
[2025-10-24T22:00:08.699715] [INFO ] [LOCAL     ] XYZ: Starting deletion of primary data.
[2025-10-24T22:00:08.699763] [DEBUG] [LOCAL     ] XYZ: No primary data file found to delete.
[2025-10-24T22:00:08.699795] [INFO ] [MAIN      ] XYZ: Starting full primary refresh.
[2025-10-24T22:00:08.953020] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-03.
[2025-10-24T22:00:09.051578] [INFO ] [REMOTE    ] XYZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:00:09.747719] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-01.
[2025-10-24T22:00:09.849342] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-01 (1.70 seconds).
[2025-10-24T22:00:10.159953] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-03 (1.21 seconds).
[2025-10-24T22:00:10.547691] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-04.
[2025-10-24T22:00:10.961634] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-01 (1.21 seconds).
[2025-10-24T22:00:11.347720] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-02.
[2025-10-24T22:00:12.124154] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-04 (1.58 seconds).
[2025-10-24T22:00:12.147669] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-05.
[2025-10-24T22:00:12.609013] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-02 (1.26 seconds).
[2025-10-24T22:00:12.947707] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-02.
[2025-10-24T22:00:13.622908] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-05 (1.48 seconds).
[2025-10-24T22:00:13.747748] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-06.
[2025-10-24T22:00:14.547790] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-05.
[2025-10-24T22:00:15.284523] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-02 (2.34 seconds).
[2025-10-24T22:00:15.354492] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-03.
[2025-10-24T22:00:15.372064] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-06 (1.62 seconds).
[2025-10-24T22:00:15.768253] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T22:00:16.147714] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-06.
[2025-10-24T22:00:16.947744] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-07.
[2025-10-24T22:00:17.369767] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-03 (2.02 seconds).
[2025-10-24T22:00:17.600901] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-06 (1.45 seconds).
[2025-10-24T22:00:17.747604] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-07.
[2025-10-24T22:00:18.238336] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-07 (1.29 seconds).
[2025-10-24T22:00:18.547749] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-03.
[2025-10-24T22:00:19.295891] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-07 (1.55 seconds).
[2025-10-24T22:00:19.347681] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-08.
[2025-10-24T22:00:20.147710] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-04.
[2025-10-24T22:00:20.325225] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-03 (1.78 seconds).
[2025-10-24T22:00:20.898891] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-08 (1.55 seconds).
[2025-10-24T22:00:20.947723] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-04.
[2025-10-24T22:00:21.747711] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-08.
[2025-10-24T22:00:22.389352] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-04 (2.24 seconds).
[2025-10-24T22:00:22.473175] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-04 (1.53 seconds).
[2025-10-24T22:00:22.547605] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-05.
[2025-10-24T22:00:23.347639] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-09.
[2025-10-24T22:00:23.396212] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-08 (1.65 seconds).
[2025-10-24T22:00:24.147681] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-09.
[2025-10-24T22:00:24.285003] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-05 (1.74 seconds).
[2025-10-24T22:00:24.431141] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-09 (1.08 seconds).
[2025-10-24T22:00:24.947719] [INFO ] [REMOTE    ] XYF: Fetching primary data for 2025-10.
[2025-10-24T22:00:25.672114] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-09 (1.52 seconds).
[2025-10-24T22:00:25.747603] [INFO ] [REMOTE    ] XPRO: Fetching primary data for 2025-10.
[2025-10-24T22:00:25.996413] [INFO ] [REMOTE    ] XYF: Incremental fetch complete for 2025-10 (1.05 seconds).
[2025-10-24T22:00:26.000614] [INFO ] [REMOTE    ] XYF: Full fetch complete (33865 records).
[2025-10-24T22:00:26.000787] [DEBUG] [VALIDATOR ] XYF: Validating primary data.
[2025-10-24T22:00:26.364854] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present.
[2025-10-24T22:00:26.364927] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed.
[2025-10-24T22:00:26.365598] [INFO ] [MAIN      ] XYF: Fetched primary data is valid.
[2025-10-24T22:00:26.365636] [DEBUG] [LOCAL     ] XYF: Saving primary data.
[2025-10-24T22:00:26.365984] [FATAL] [LOCAL     ] XYF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:00:26.366062] [FATAL] [MAIN      ] XYF: Failed to save primary data.
[2025-10-24T22:00:26.366103] [WARN ] [MAIN      ] XYF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:00:26.366157] [INFO ] [LOCAL     ] XYF: Starting deletion of primary data.
[2025-10-24T22:00:26.366207] [DEBUG] [LOCAL     ] XYF: No primary data file found to delete.
[2025-10-24T22:00:26.366240] [INFO ] [LOCAL     ] XYF: Starting deletion of derivative data.
[2025-10-24T22:00:26.366432] [DEBUG] [LOCAL     ] XYF: Deleted derivative data file.
[2025-10-24T22:00:26.366522] [INFO ] [MAIN      ] Update Progress: 2338/2366 symbols completed. XYF took 26.5s. Estimated remaining: 3m 36s. Rate: 7.8 symbols/min
[2025-10-24T22:00:26.534323] [INFO ] [MAIN      ] YALA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:00:26.551776] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-05.
[2025-10-24T22:00:26.567974] [DEBUG] [LOCAL     ] YALA: Loaded 36512 existing records from primary storage.
[2025-10-24T22:00:26.568276] [INFO ] [MAIN      ] YALA: Loaded 36512 existing records.
[2025-10-24T22:00:26.747025] [WARN ] [MAIN      ] YALA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:00:26.747283] [INFO ] [MAIN      ] YALA: Wiping existing primary data before full refresh.
[2025-10-24T22:00:26.747331] [INFO ] [LOCAL     ] YALA: Starting deletion of primary data.
[2025-10-24T22:00:26.747519] [DEBUG] [LOCAL     ] YALA: Deleted primary data file.
[2025-10-24T22:00:26.747559] [INFO ] [MAIN      ] YALA: Starting full primary refresh.
[2025-10-24T22:00:27.118287] [INFO ] [REMOTE    ] YALA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:00:27.141857] [INFO ] [REMOTE    ] XPRO: Incremental fetch complete for 2025-10 (1.39 seconds).
[2025-10-24T22:00:27.150776] [INFO ] [REMOTE    ] XPRO: Full fetch complete (66501 records).
[2025-10-24T22:00:27.151000] [DEBUG] [VALIDATOR ] XPRO: Validating primary data.
[2025-10-24T22:00:27.352963] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-06.
[2025-10-24T22:00:27.565516] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present.
[2025-10-24T22:00:27.565593] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed.
[2025-10-24T22:00:27.566822] [INFO ] [MAIN      ] XPRO: Fetched primary data is valid.
[2025-10-24T22:00:27.566901] [DEBUG] [LOCAL     ] XPRO: Saving primary data.
[2025-10-24T22:00:27.567433] [FATAL] [LOCAL     ] XPRO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:00:27.567519] [FATAL] [MAIN      ] XPRO: Failed to save primary data.
[2025-10-24T22:00:27.567564] [WARN ] [MAIN      ] XPRO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:00:27.567600] [INFO ] [LOCAL     ] XPRO: Starting deletion of primary data.
[2025-10-24T22:00:27.567708] [DEBUG] [LOCAL     ] XPRO: No primary data file found to delete.
[2025-10-24T22:00:27.567758] [INFO ] [LOCAL     ] XPRO: Starting deletion of derivative data.
[2025-10-24T22:00:27.567945] [DEBUG] [LOCAL     ] XPRO: Deleted derivative data file.
[2025-10-24T22:00:27.568288] [INFO ] [MAIN      ] Update Progress: 2339/2366 symbols completed. XPRO took 34.1s. Estimated remaining: 3m 28s. Rate: 7.8 symbols/min
[2025-10-24T22:00:27.775242] [INFO ] [MAIN      ] YELP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:00:27.816338] [DEBUG] [LOCAL     ] YELP: Loaded 45479 existing records from primary storage.
[2025-10-24T22:00:27.816630] [INFO ] [MAIN      ] YELP: Loaded 45479 existing records.
[2025-10-24T22:00:28.006057] [WARN ] [MAIN      ] YELP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:00:28.006323] [INFO ] [MAIN      ] YELP: Wiping existing primary data before full refresh.
[2025-10-24T22:00:28.006376] [INFO ] [LOCAL     ] YELP: Starting deletion of primary data.
[2025-10-24T22:00:28.006632] [DEBUG] [LOCAL     ] YELP: Deleted primary data file.
[2025-10-24T22:00:28.006732] [INFO ] [MAIN      ] YELP: Starting full primary refresh.
[2025-10-24T22:00:28.155704] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-01.
[2025-10-24T22:00:28.365896] [INFO ] [REMOTE    ] YELP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:00:28.950024] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-01.
[2025-10-24T22:00:28.971074] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-05 (2.42 seconds).
[2025-10-24T22:00:29.045363] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-06 (1.69 seconds).
[2025-10-24T22:00:29.296831] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-01 (1.14 seconds).
[2025-10-24T22:00:29.747698] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-06.
[2025-10-24T22:00:30.113742] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-01 (1.16 seconds).
[2025-10-24T22:00:30.547696] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-02.
[2025-10-24T22:00:31.347722] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-02.
[2025-10-24T22:00:31.641074] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-06 (1.89 seconds).
[2025-10-24T22:00:31.984049] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T22:00:32.147676] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-07.
[2025-10-24T22:00:32.437445] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-02 (1.09 seconds).
[2025-10-24T22:00:32.947692] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-03.
[2025-10-24T22:00:33.747715] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-03.
[2025-10-24T22:00:34.380055] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-03 (1.43 seconds).
[2025-10-24T22:00:34.547799] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-07.
[2025-10-24T22:00:34.658317] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-07 (2.51 seconds).
[2025-10-24T22:00:35.015009] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-03 (1.27 seconds).
[2025-10-24T22:00:35.347712] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-04.
[2025-10-24T22:00:36.084557] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T22:00:36.147754] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-04.
[2025-10-24T22:00:36.947761] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-08.
[2025-10-24T22:00:36.998685] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T22:00:37.747673] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-05.
[2025-10-24T22:00:37.774362] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T22:00:38.547679] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-08.
[2025-10-24T22:00:38.670206] [INFO ] [REMOTE    ] XYL: Incremental fetch complete for 2025-08 (1.72 seconds).
[2025-10-24T22:00:38.771770] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-05 (1.02 seconds).
[2025-10-24T22:00:39.347707] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-06.
[2025-10-24T22:00:40.147639] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-05.
[2025-10-24T22:00:40.331142] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-08 (1.78 seconds).
[2025-10-24T22:00:40.870269] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-06 (1.52 seconds).
[2025-10-24T22:00:40.947687] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-07.
[2025-10-24T22:00:41.747695] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-09.
[2025-10-24T22:00:41.876156] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T22:00:42.020278] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-07 (1.07 seconds).
[2025-10-24T22:00:42.547691] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-06.
[2025-10-24T22:00:43.347705] [INFO ] [REMOTE    ] XYL: Fetching primary data for 2025-09.
[2025-10-24T22:00:43.450991] [DEBUG] [REMOTE    ] XYL: Error fetching primary data for 2025-09: 'API call returned an empty response.'
[2025-10-24T22:00:43.451344] [WARN ] [REMOTE    ] XYL: No data returned for month 2025-09
[2025-10-24T22:00:43.451442] [FATAL] [REMOTE    ] XYL: API call failed - aborting fetch to avoid wasting further API calls
[2025-10-24T22:00:43.451523] [FATAL] [MAIN      ] XYL: Failed to fetch primary data.
[2025-10-24T22:00:43.451562] [WARN ] [MAIN      ] XYL: Deleting existing primary and derivative data due to fetch failure.
[2025-10-24T22:00:43.451630] [INFO ] [LOCAL     ] XYL: Starting deletion of primary data.
[2025-10-24T22:00:43.451732] [DEBUG] [LOCAL     ] XYL: No primary data file found to delete.
[2025-10-24T22:00:43.451774] [INFO ] [LOCAL     ] XYL: Starting deletion of derivative data.
[2025-10-24T22:00:43.451955] [DEBUG] [LOCAL     ] XYL: Deleted derivative data file.
[2025-10-24T22:00:43.452342] [INFO ] [MAIN      ] Update Progress: 2340/2366 symbols completed. XYL took 37.2s. Estimated remaining: 3m 20s. Rate: 7.8 symbols/min
[2025-10-24T22:00:43.632583] [INFO ] [MAIN      ] YETI: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:00:43.682988] [DEBUG] [LOCAL     ] YETI: Loaded 52897 existing records from primary storage.
[2025-10-24T22:00:43.683282] [INFO ] [MAIN      ] YETI: Loaded 52897 existing records.
[2025-10-24T22:00:43.871950] [WARN ] [MAIN      ] YETI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:00:43.872537] [INFO ] [MAIN      ] YETI: Wiping existing primary data before full refresh.
[2025-10-24T22:00:43.872847] [INFO ] [LOCAL     ] YETI: Starting deletion of primary data.
[2025-10-24T22:00:43.889273] [DEBUG] [LOCAL     ] YETI: Deleted primary data file.
[2025-10-24T22:00:43.901490] [INFO ] [MAIN      ] YETI: Starting full primary refresh.
[2025-10-24T22:00:43.959576] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-09 (2.21 seconds).
[2025-10-24T22:00:44.084602] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-06 (1.54 seconds).
[2025-10-24T22:00:44.155747] [INFO ] [REMOTE    ] XYZ: Fetching primary data for 2025-10.
[2025-10-24T22:00:44.307970] [INFO ] [REMOTE    ] YETI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:00:44.957200] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-08.
[2025-10-24T22:00:44.962701] [INFO ] [REMOTE    ] XYZ: Incremental fetch complete for 2025-10 (0.81 seconds).
[2025-10-24T22:00:44.972785] [INFO ] [REMOTE    ] XYZ: Full fetch complete (75193 records).
[2025-10-24T22:00:44.972898] [DEBUG] [VALIDATOR ] XYZ: Validating primary data.
[2025-10-24T22:00:45.167045] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 193 unique days, need 200 days
[2025-10-24T22:00:45.167821] [FATAL] [MAIN      ] XYZ: Fetched primary data is invalid.  Refusing to save it.
[2025-10-24T22:00:45.167892] [WARN ] [MAIN      ] XYZ: Deleting existing primary and derivative data due to validation failure.
[2025-10-24T22:00:45.167969] [INFO ] [LOCAL     ] XYZ: Starting deletion of primary data.
[2025-10-24T22:00:45.168030] [DEBUG] [LOCAL     ] XYZ: No primary data file found to delete.
[2025-10-24T22:00:45.168066] [INFO ] [LOCAL     ] XYZ: Starting deletion of derivative data.
[2025-10-24T22:00:45.168105] [DEBUG] [LOCAL     ] XYZ: No derivative data file found to delete.
[2025-10-24T22:00:45.168368] [INFO ] [MAIN      ] Update Progress: 2341/2366 symbols completed. XYZ took 36.7s. Estimated remaining: 3m 13s. Rate: 7.8 symbols/min
[2025-10-24T22:00:45.336832] [INFO ] [MAIN      ] YEXT: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:00:45.375344] [DEBUG] [LOCAL     ] YEXT: Loaded 43337 existing records from primary storage.
[2025-10-24T22:00:45.375616] [INFO ] [MAIN      ] YEXT: Loaded 43337 existing records.
[2025-10-24T22:00:45.549569] [WARN ] [MAIN      ] YEXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:00:45.549782] [INFO ] [MAIN      ] YEXT: Wiping existing primary data before full refresh.
[2025-10-24T22:00:45.549828] [INFO ] [LOCAL     ] YEXT: Starting deletion of primary data.
[2025-10-24T22:00:45.550180] [DEBUG] [LOCAL     ] YEXT: Deleted primary data file.
[2025-10-24T22:00:45.550218] [INFO ] [MAIN      ] YEXT: Starting full primary refresh.
[2025-10-24T22:00:45.754751] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-07.
[2025-10-24T22:00:45.901047] [INFO ] [REMOTE    ] YEXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:00:46.547695] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-01.
[2025-10-24T22:00:46.724294] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-08 (1.77 seconds).
[2025-10-24T22:00:47.206382] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T22:00:47.347697] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-09.
[2025-10-24T22:00:47.852020] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-01 (1.30 seconds).
[2025-10-24T22:00:48.147715] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-01.
[2025-10-24T22:00:48.885168] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-09 (1.54 seconds).
[2025-10-24T22:00:48.947610] [INFO ] [REMOTE    ] YELP: Fetching primary data for 2025-10.
[2025-10-24T22:00:49.690152] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-01 (1.54 seconds).
[2025-10-24T22:00:49.747605] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-02.
[2025-10-24T22:00:50.549008] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-02.
[2025-10-24T22:00:50.552237] [INFO ] [REMOTE    ] YELP: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T22:00:50.561894] [INFO ] [REMOTE    ] YELP: Full fetch complete (64726 records).
[2025-10-24T22:00:50.562112] [DEBUG] [VALIDATOR ] YELP: Validating primary data.
[2025-10-24T22:00:50.980916] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present.
[2025-10-24T22:00:50.981015] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed.
[2025-10-24T22:00:50.982291] [INFO ] [MAIN      ] YELP: Fetched primary data is valid.
[2025-10-24T22:00:50.982360] [DEBUG] [LOCAL     ] YELP: Saving primary data.
[2025-10-24T22:00:50.983059] [FATAL] [LOCAL     ] YELP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:00:50.983176] [FATAL] [MAIN      ] YELP: Failed to save primary data.
[2025-10-24T22:00:50.983251] [WARN ] [MAIN      ] YELP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:00:50.983325] [INFO ] [LOCAL     ] YELP: Starting deletion of primary data.
[2025-10-24T22:00:50.983415] [DEBUG] [LOCAL     ] YELP: No primary data file found to delete.
[2025-10-24T22:00:50.983474] [INFO ] [LOCAL     ] YELP: Starting deletion of derivative data.
[2025-10-24T22:00:50.983720] [DEBUG] [LOCAL     ] YELP: Deleted derivative data file.
[2025-10-24T22:00:50.984119] [INFO ] [MAIN      ] Update Progress: 2342/2366 symbols completed. YELP took 23.4s. Estimated remaining: 3m 5s. Rate: 7.8 symbols/min
[2025-10-24T22:00:51.166316] [INFO ] [MAIN      ] YMM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:00:51.216891] [DEBUG] [LOCAL     ] YMM: Loaded 52966 existing records from primary storage.
[2025-10-24T22:00:51.217198] [INFO ] [MAIN      ] YMM: Loaded 52966 existing records.
[2025-10-24T22:00:51.403857] [WARN ] [MAIN      ] YMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:00:51.404302] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-08.
[2025-10-24T22:00:51.404205] [INFO ] [MAIN      ] YMM: Wiping existing primary data before full refresh.
[2025-10-24T22:00:51.405579] [INFO ] [LOCAL     ] YMM: Starting deletion of primary data.
[2025-10-24T22:00:51.406421] [DEBUG] [LOCAL     ] YMM: Deleted primary data file.
[2025-10-24T22:00:51.406596] [INFO ] [MAIN      ] YMM: Starting full primary refresh.
[2025-10-24T22:00:51.696341] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-02 (1.95 seconds).
[2025-10-24T22:00:51.829999] [INFO ] [REMOTE    ] YMM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:00:51.950268] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-02 (1.40 seconds).
[2025-10-24T22:00:52.147681] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-03.
[2025-10-24T22:00:52.761985] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-08 (1.36 seconds).
[2025-10-24T22:00:52.947679] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-09.
[2025-10-24T22:00:53.747611] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-03.
[2025-10-24T22:00:53.821715] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T22:00:54.141261] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-09 (1.19 seconds).
[2025-10-24T22:00:54.547704] [INFO ] [REMOTE    ] YALA: Fetching primary data for 2025-10.
[2025-10-24T22:00:55.347691] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-04.
[2025-10-24T22:00:55.459126] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-03 (1.71 seconds).
[2025-10-24T22:00:55.690758] [INFO ] [REMOTE    ] YALA: Incremental fetch complete for 2025-10 (1.14 seconds).
[2025-10-24T22:00:55.695859] [INFO ] [REMOTE    ] YALA: Full fetch complete (47110 records).
[2025-10-24T22:00:55.695973] [DEBUG] [VALIDATOR ] YALA: Validating primary data.
[2025-10-24T22:00:56.062837] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present.
[2025-10-24T22:00:56.062914] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed.
[2025-10-24T22:00:56.063801] [INFO ] [MAIN      ] YALA: Fetched primary data is valid.
[2025-10-24T22:00:56.063861] [DEBUG] [LOCAL     ] YALA: Saving primary data.
[2025-10-24T22:00:56.064241] [FATAL] [LOCAL     ] YALA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:00:56.064350] [FATAL] [MAIN      ] YALA: Failed to save primary data.
[2025-10-24T22:00:56.064392] [WARN ] [MAIN      ] YALA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:00:56.064426] [INFO ] [LOCAL     ] YALA: Starting deletion of primary data.
[2025-10-24T22:00:56.064474] [DEBUG] [LOCAL     ] YALA: No primary data file found to delete.
[2025-10-24T22:00:56.064508] [INFO ] [LOCAL     ] YALA: Starting deletion of derivative data.
[2025-10-24T22:00:56.064758] [DEBUG] [LOCAL     ] YALA: Deleted derivative data file.
[2025-10-24T22:00:56.064849] [INFO ] [MAIN      ] Update Progress: 2343/2366 symbols completed. YALA took 29.7s. Estimated remaining: 2m 57s. Rate: 7.8 symbols/min
[2025-10-24T22:00:56.156039] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-04.
[2025-10-24T22:00:56.238815] [INFO ] [MAIN      ] YOU: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:00:56.282062] [DEBUG] [LOCAL     ] YOU: Loaded 49826 existing records from primary storage.
[2025-10-24T22:00:56.282367] [INFO ] [MAIN      ] YOU: Loaded 49826 existing records.
[2025-10-24T22:00:56.460226] [WARN ] [MAIN      ] YOU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:00:56.460445] [INFO ] [MAIN      ] YOU: Wiping existing primary data before full refresh.
[2025-10-24T22:00:56.460493] [INFO ] [LOCAL     ] YOU: Starting deletion of primary data.
[2025-10-24T22:00:56.460977] [DEBUG] [LOCAL     ] YOU: Deleted primary data file.
[2025-10-24T22:00:56.461035] [INFO ] [MAIN      ] YOU: Starting full primary refresh.
[2025-10-24T22:00:56.843447] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-04 (1.50 seconds).
[2025-10-24T22:00:56.847454] [INFO ] [REMOTE    ] YOU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:00:56.947699] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-01.
[2025-10-24T22:00:57.747612] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-05.
[2025-10-24T22:00:57.861037] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-04 (1.71 seconds).
[2025-10-24T22:00:58.520615] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-01 (1.57 seconds).
[2025-10-24T22:00:58.547608] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-02.
[2025-10-24T22:00:59.086018] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-05 (1.34 seconds).
[2025-10-24T22:00:59.347709] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-06.
[2025-10-24T22:00:59.851369] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-02 (1.30 seconds).
[2025-10-24T22:01:00.147740] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-01.
[2025-10-24T22:01:00.832772] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T22:01:00.947639] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-07.
[2025-10-24T22:01:01.749180] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-05.
[2025-10-24T22:01:01.749057] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-01 (1.60 seconds).
[2025-10-24T22:01:02.547687] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-03.
[2025-10-24T22:01:02.582461] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-07 (1.63 seconds).
[2025-10-24T22:01:03.347696] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-02.
[2025-10-24T22:01:03.475567] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-05 (1.73 seconds).
[2025-10-24T22:01:04.147694] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-06.
[2025-10-24T22:01:04.284240] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-03 (1.74 seconds).
[2025-10-24T22:01:04.947678] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-08.
[2025-10-24T22:01:05.156192] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T22:01:05.711437] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-06 (1.56 seconds).
[2025-10-24T22:01:05.747698] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-04.
[2025-10-24T22:01:06.430518] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-08 (1.48 seconds).
[2025-10-24T22:01:06.547688] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-07.
[2025-10-24T22:01:07.347697] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-09.
[2025-10-24T22:01:07.406109] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-04 (1.66 seconds).
[2025-10-24T22:01:08.147719] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-05.
[2025-10-24T22:01:08.245742] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-07 (1.70 seconds).
[2025-10-24T22:01:08.913773] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-09 (1.57 seconds).
[2025-10-24T22:01:08.947707] [INFO ] [REMOTE    ] YEXT: Fetching primary data for 2025-10.
[2025-10-24T22:01:09.747728] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-03.
[2025-10-24T22:01:10.045528] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-05 (1.90 seconds).
[2025-10-24T22:01:10.111728] [INFO ] [REMOTE    ] YEXT: Incremental fetch complete for 2025-10 (1.16 seconds).
[2025-10-24T22:01:10.120551] [INFO ] [REMOTE    ] YEXT: Full fetch complete (62974 records).
[2025-10-24T22:01:10.120745] [DEBUG] [VALIDATOR ] YEXT: Validating primary data.
[2025-10-24T22:01:10.557120] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-08.
[2025-10-24T22:01:10.580117] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present.
[2025-10-24T22:01:10.580240] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed.
[2025-10-24T22:01:10.581947] [INFO ] [MAIN      ] YEXT: Fetched primary data is valid.
[2025-10-24T22:01:10.582205] [DEBUG] [LOCAL     ] YEXT: Saving primary data.
[2025-10-24T22:01:10.582870] [FATAL] [LOCAL     ] YEXT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:01:10.582976] [FATAL] [MAIN      ] YEXT: Failed to save primary data.
[2025-10-24T22:01:10.583055] [WARN ] [MAIN      ] YEXT: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:01:10.583137] [INFO ] [LOCAL     ] YEXT: Starting deletion of primary data.
[2025-10-24T22:01:10.583217] [DEBUG] [LOCAL     ] YEXT: No primary data file found to delete.
[2025-10-24T22:01:10.583257] [INFO ] [LOCAL     ] YEXT: Starting deletion of derivative data.
[2025-10-24T22:01:10.583498] [DEBUG] [LOCAL     ] YEXT: Deleted derivative data file.
[2025-10-24T22:01:10.584015] [INFO ] [MAIN      ] Update Progress: 2344/2366 symbols completed. YEXT took 25.4s. Estimated remaining: 2m 50s. Rate: 7.8 symbols/min
[2025-10-24T22:01:10.773610] [INFO ] [MAIN      ] YPF: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:01:10.821632] [DEBUG] [LOCAL     ] YPF: Loaded 51139 existing records from primary storage.
[2025-10-24T22:01:10.821959] [INFO ] [MAIN      ] YPF: Loaded 51139 existing records.
[2025-10-24T22:01:10.996122] [WARN ] [MAIN      ] YPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:01:10.996350] [INFO ] [MAIN      ] YPF: Wiping existing primary data before full refresh.
[2025-10-24T22:01:10.996395] [INFO ] [LOCAL     ] YPF: Starting deletion of primary data.
[2025-10-24T22:01:10.996767] [DEBUG] [LOCAL     ] YPF: Deleted primary data file.
[2025-10-24T22:01:10.996822] [INFO ] [MAIN      ] YPF: Starting full primary refresh.
[2025-10-24T22:01:11.351128] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-06.
[2025-10-24T22:01:11.355808] [INFO ] [REMOTE    ] YPF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:01:11.601400] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-03 (1.85 seconds).
[2025-10-24T22:01:12.152827] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-01.
[2025-10-24T22:01:12.174487] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-08 (1.62 seconds).
[2025-10-24T22:01:12.640846] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T22:01:12.947767] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-04.
[2025-10-24T22:01:13.747610] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-07.
[2025-10-24T22:01:14.024388] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-01 (1.87 seconds).
[2025-10-24T22:01:14.547696] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-09.
[2025-10-24T22:01:14.684413] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-04 (1.74 seconds).
[2025-10-24T22:01:15.347678] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-05.
[2025-10-24T22:01:15.491852] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-07 (1.74 seconds).
[2025-10-24T22:01:15.776904] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-09 (1.23 seconds).
[2025-10-24T22:01:16.147780] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-02.
[2025-10-24T22:01:16.568297] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-05 (1.22 seconds).
[2025-10-24T22:01:16.947722] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-08.
[2025-10-24T22:01:17.747707] [INFO ] [REMOTE    ] YETI: Fetching primary data for 2025-10.
[2025-10-24T22:01:17.927874] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-02 (1.78 seconds).
[2025-10-24T22:01:18.547736] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-03.
[2025-10-24T22:01:18.700184] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-08 (1.75 seconds).
[2025-10-24T22:01:19.347722] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-09.
[2025-10-24T22:01:19.501552] [INFO ] [REMOTE    ] YETI: Incremental fetch complete for 2025-10 (1.75 seconds).
[2025-10-24T22:01:19.512005] [INFO ] [REMOTE    ] YETI: Full fetch complete (75524 records).
[2025-10-24T22:01:19.512180] [DEBUG] [VALIDATOR ] YETI: Validating primary data.
[2025-10-24T22:01:19.899540] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present.
[2025-10-24T22:01:19.899666] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed.
[2025-10-24T22:01:19.900906] [INFO ] [MAIN      ] YETI: Fetched primary data is valid.
[2025-10-24T22:01:19.901022] [DEBUG] [LOCAL     ] YETI: Saving primary data.
[2025-10-24T22:01:19.901749] [FATAL] [LOCAL     ] YETI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:01:19.901921] [FATAL] [MAIN      ] YETI: Failed to save primary data.
[2025-10-24T22:01:19.902032] [WARN ] [MAIN      ] YETI: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:01:19.902104] [INFO ] [LOCAL     ] YETI: Starting deletion of primary data.
[2025-10-24T22:01:19.902191] [DEBUG] [LOCAL     ] YETI: No primary data file found to delete.
[2025-10-24T22:01:19.902241] [INFO ] [LOCAL     ] YETI: Starting deletion of derivative data.
[2025-10-24T22:01:19.902691] [DEBUG] [LOCAL     ] YETI: Deleted derivative data file.
[2025-10-24T22:01:19.903168] [INFO ] [MAIN      ] Update Progress: 2345/2366 symbols completed. YETI took 36.5s. Estimated remaining: 2m 42s. Rate: 7.8 symbols/min
[2025-10-24T22:01:20.073075] [INFO ] [MAIN      ] YRD: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:01:20.107338] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-03 (1.56 seconds).
[2025-10-24T22:01:20.123456] [DEBUG] [LOCAL     ] YRD: Loaded 11205 existing records from primary storage.
[2025-10-24T22:01:20.123717] [INFO ] [MAIN      ] YRD: Loaded 11205 existing records.
[2025-10-24T22:01:20.154117] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-04.
[2025-10-24T22:01:20.301423] [WARN ] [MAIN      ] YRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:01:20.301665] [INFO ] [MAIN      ] YRD: Wiping existing primary data before full refresh.
[2025-10-24T22:01:20.301725] [INFO ] [LOCAL     ] YRD: Starting deletion of primary data.
[2025-10-24T22:01:20.301918] [DEBUG] [LOCAL     ] YRD: Deleted primary data file.
[2025-10-24T22:01:20.301972] [INFO ] [MAIN      ] YRD: Starting full primary refresh.
[2025-10-24T22:01:20.656817] [INFO ] [REMOTE    ] YRD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:01:20.703078] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T22:01:20.947684] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-01.
[2025-10-24T22:01:21.747750] [INFO ] [REMOTE    ] YOU: Fetching primary data for 2025-10.
[2025-10-24T22:01:21.806180] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-01 (0.86 seconds).
[2025-10-24T22:01:22.058475] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-04 (1.90 seconds).
[2025-10-24T22:01:22.547698] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-05.
[2025-10-24T22:01:23.357137] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-02.
[2025-10-24T22:01:23.362206] [INFO ] [REMOTE    ] YOU: Incremental fetch complete for 2025-10 (1.61 seconds).
[2025-10-24T22:01:23.372439] [INFO ] [REMOTE    ] YOU: Full fetch complete (72334 records).
[2025-10-24T22:01:23.372571] [DEBUG] [VALIDATOR ] YOU: Validating primary data.
[2025-10-24T22:01:23.827781] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present.
[2025-10-24T22:01:23.827930] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed.
[2025-10-24T22:01:23.829333] [INFO ] [MAIN      ] YOU: Fetched primary data is valid.
[2025-10-24T22:01:23.829418] [DEBUG] [LOCAL     ] YOU: Saving primary data.
[2025-10-24T22:01:23.830150] [FATAL] [LOCAL     ] YOU: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:01:23.830365] [FATAL] [MAIN      ] YOU: Failed to save primary data.
[2025-10-24T22:01:23.830571] [WARN ] [MAIN      ] YOU: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:01:23.830687] [INFO ] [LOCAL     ] YOU: Starting deletion of primary data.
[2025-10-24T22:01:23.830853] [DEBUG] [LOCAL     ] YOU: No primary data file found to delete.
[2025-10-24T22:01:23.830993] [INFO ] [LOCAL     ] YOU: Starting deletion of derivative data.
[2025-10-24T22:01:23.831306] [DEBUG] [LOCAL     ] YOU: Deleted derivative data file.
[2025-10-24T22:01:23.831704] [INFO ] [MAIN      ] Update Progress: 2346/2366 symbols completed. YOU took 27.8s. Estimated remaining: 2m 34s. Rate: 7.8 symbols/min
[2025-10-24T22:01:23.972568] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-05 (1.42 seconds).
[2025-10-24T22:01:24.106696] [INFO ] [MAIN      ] YSG: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:01:24.112164] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-02 (0.76 seconds).
[2025-10-24T22:01:24.142314] [DEBUG] [LOCAL     ] YSG: Loaded 25773 existing records from primary storage.
[2025-10-24T22:01:24.142580] [INFO ] [MAIN      ] YSG: Loaded 25773 existing records.
[2025-10-24T22:01:24.155531] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-06.
[2025-10-24T22:01:24.357020] [WARN ] [MAIN      ] YSG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:01:24.357261] [INFO ] [MAIN      ] YSG: Wiping existing primary data before full refresh.
[2025-10-24T22:01:24.357319] [INFO ] [LOCAL     ] YSG: Starting deletion of primary data.
[2025-10-24T22:01:24.357525] [DEBUG] [LOCAL     ] YSG: Deleted primary data file.
[2025-10-24T22:01:24.357596] [INFO ] [MAIN      ] YSG: Starting full primary refresh.
[2025-10-24T22:01:24.799688] [INFO ] [REMOTE    ] YSG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:01:24.947720] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-01.
[2025-10-24T22:01:25.747683] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-06.
[2025-10-24T22:01:25.757889] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-01 (0.81 seconds).
[2025-10-24T22:01:25.986820] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-06 (1.83 seconds).
[2025-10-24T22:01:26.547739] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-07.
[2025-10-24T22:01:27.255272] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-06 (1.51 seconds).
[2025-10-24T22:01:27.347604] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-07.
[2025-10-24T22:01:28.147678] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-03.
[2025-10-24T22:01:28.265898] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-07 (1.72 seconds).
[2025-10-24T22:01:28.947670] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-02.
[2025-10-24T22:01:29.178795] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-07 (1.83 seconds).
[2025-10-24T22:01:29.202747] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-03 (1.06 seconds).
[2025-10-24T22:01:29.734595] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-02 (0.79 seconds).
[2025-10-24T22:01:29.747602] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-03.
[2025-10-24T22:01:30.547749] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-08.
[2025-10-24T22:01:30.916807] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-03 (1.17 seconds).
[2025-10-24T22:01:31.347725] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-04.
[2025-10-24T22:01:32.131627] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-08 (1.58 seconds).
[2025-10-24T22:01:32.147599] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-09.
[2025-10-24T22:01:32.165620] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-04 (0.82 seconds).
[2025-10-24T22:01:32.947716] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-05.
[2025-10-24T22:01:33.747681] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-04.
[2025-10-24T22:01:33.871365] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-09 (1.72 seconds).
[2025-10-24T22:01:33.899209] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-05 (0.95 seconds).
[2025-10-24T22:01:34.547733] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-06.
[2025-10-24T22:01:34.726571] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-04 (0.98 seconds).
[2025-10-24T22:01:35.347733] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-08.
[2025-10-24T22:01:35.764860] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-06 (1.22 seconds).
[2025-10-24T22:01:36.147693] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-07.
[2025-10-24T22:01:36.904529] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-08 (1.56 seconds).
[2025-10-24T22:01:36.947711] [INFO ] [REMOTE    ] YPF: Fetching primary data for 2025-10.
[2025-10-24T22:01:36.986769] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-07 (0.84 seconds).
[2025-10-24T22:01:37.747671] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-08.
[2025-10-24T22:01:38.549667] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-09.
[2025-10-24T22:01:38.552666] [INFO ] [REMOTE    ] YPF: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T22:01:38.563241] [INFO ] [REMOTE    ] YPF: Full fetch complete (73874 records).
[2025-10-24T22:01:38.563406] [DEBUG] [VALIDATOR ] YPF: Validating primary data.
[2025-10-24T22:01:38.959596] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present.
[2025-10-24T22:01:38.959791] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed.
[2025-10-24T22:01:38.961038] [INFO ] [MAIN      ] YPF: Fetched primary data is valid.
[2025-10-24T22:01:38.961132] [DEBUG] [LOCAL     ] YPF: Saving primary data.
[2025-10-24T22:01:38.961811] [FATAL] [LOCAL     ] YPF: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:01:38.961900] [FATAL] [MAIN      ] YPF: Failed to save primary data.
[2025-10-24T22:01:38.961943] [WARN ] [MAIN      ] YPF: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:01:38.961979] [INFO ] [LOCAL     ] YPF: Starting deletion of primary data.
[2025-10-24T22:01:38.962032] [DEBUG] [LOCAL     ] YPF: No primary data file found to delete.
[2025-10-24T22:01:38.962067] [INFO ] [LOCAL     ] YPF: Starting deletion of derivative data.
[2025-10-24T22:01:38.962257] [DEBUG] [LOCAL     ] YPF: Deleted derivative data file.
[2025-10-24T22:01:38.962531] [INFO ] [MAIN      ] Update Progress: 2347/2366 symbols completed. YPF took 28.4s. Estimated remaining: 2m 26s. Rate: 7.8 symbols/min
[2025-10-24T22:01:39.077556] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-08 (1.33 seconds).
[2025-10-24T22:01:39.161553] [INFO ] [MAIN      ] YUM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:01:39.211507] [DEBUG] [LOCAL     ] YUM: Loaded 51489 existing records from primary storage.
[2025-10-24T22:01:39.211843] [INFO ] [MAIN      ] YUM: Loaded 51489 existing records.
[2025-10-24T22:01:39.353485] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-05.
[2025-10-24T22:01:39.393146] [WARN ] [MAIN      ] YUM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:01:39.393438] [INFO ] [MAIN      ] YUM: Wiping existing primary data before full refresh.
[2025-10-24T22:01:39.393490] [INFO ] [LOCAL     ] YUM: Starting deletion of primary data.
[2025-10-24T22:01:39.393906] [DEBUG] [LOCAL     ] YUM: Deleted primary data file.
[2025-10-24T22:01:39.393966] [INFO ] [MAIN      ] YUM: Starting full primary refresh.
[2025-10-24T22:01:39.741598] [INFO ] [REMOTE    ] YUM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:01:40.147729] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-09.
[2025-10-24T22:01:40.201341] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-05 (0.85 seconds).
[2025-10-24T22:01:40.297117] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-09 (1.75 seconds).
[2025-10-24T22:01:40.947616] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-01.
[2025-10-24T22:01:41.149995] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-09 (1.00 seconds).
[2025-10-24T22:01:41.747728] [INFO ] [REMOTE    ] YSG: Fetching primary data for 2025-10.
[2025-10-24T22:01:42.547724] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-06.
[2025-10-24T22:01:42.768817] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-01 (1.82 seconds).
[2025-10-24T22:01:42.979786] [INFO ] [REMOTE    ] YSG: Incremental fetch complete for 2025-10 (1.23 seconds).
[2025-10-24T22:01:42.985967] [INFO ] [REMOTE    ] YSG: Full fetch complete (32637 records).
[2025-10-24T22:01:42.986063] [DEBUG] [VALIDATOR ] YSG: Validating primary data.
[2025-10-24T22:01:43.181114] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-06 (0.63 seconds).
[2025-10-24T22:01:43.351183] [INFO ] [REMOTE    ] YMM: Fetching primary data for 2025-10.
[2025-10-24T22:01:43.384747] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present.
[2025-10-24T22:01:43.384829] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed.
[2025-10-24T22:01:43.385499] [INFO ] [MAIN      ] YSG: Fetched primary data is valid.
[2025-10-24T22:01:43.385539] [DEBUG] [LOCAL     ] YSG: Saving primary data.
[2025-10-24T22:01:43.385918] [FATAL] [LOCAL     ] YSG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:01:43.385998] [FATAL] [MAIN      ] YSG: Failed to save primary data.
[2025-10-24T22:01:43.386039] [WARN ] [MAIN      ] YSG: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:01:43.386100] [INFO ] [LOCAL     ] YSG: Starting deletion of primary data.
[2025-10-24T22:01:43.386158] [DEBUG] [LOCAL     ] YSG: No primary data file found to delete.
[2025-10-24T22:01:43.386193] [INFO ] [LOCAL     ] YSG: Starting deletion of derivative data.
[2025-10-24T22:01:43.386394] [DEBUG] [LOCAL     ] YSG: Deleted derivative data file.
[2025-10-24T22:01:43.386507] [INFO ] [MAIN      ] Update Progress: 2348/2366 symbols completed. YSG took 19.6s. Estimated remaining: 2m 19s. Rate: 7.8 symbols/min
[2025-10-24T22:01:43.551704] [INFO ] [MAIN      ] YUMC: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:01:43.598954] [DEBUG] [LOCAL     ] YUMC: Loaded 52963 existing records from primary storage.
[2025-10-24T22:01:43.599266] [INFO ] [MAIN      ] YUMC: Loaded 52963 existing records.
[2025-10-24T22:01:43.771148] [WARN ] [MAIN      ] YUMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:01:43.771347] [INFO ] [MAIN      ] YUMC: Wiping existing primary data before full refresh.
[2025-10-24T22:01:43.771391] [INFO ] [LOCAL     ] YUMC: Starting deletion of primary data.
[2025-10-24T22:01:43.771697] [DEBUG] [LOCAL     ] YUMC: Deleted primary data file.
[2025-10-24T22:01:43.771752] [INFO ] [MAIN      ] YUMC: Starting full primary refresh.
[2025-10-24T22:01:44.142934] [INFO ] [REMOTE    ] YUMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:01:44.147683] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-02.
[2025-10-24T22:01:44.955078] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-01.
[2025-10-24T22:01:44.981434] [INFO ] [REMOTE    ] YMM: Incremental fetch complete for 2025-10 (1.63 seconds).
[2025-10-24T22:01:44.991956] [INFO ] [REMOTE    ] YMM: Full fetch complete (76469 records).
[2025-10-24T22:01:44.992102] [DEBUG] [VALIDATOR ] YMM: Validating primary data.
[2025-10-24T22:01:45.425582] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present.
[2025-10-24T22:01:45.425775] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed.
[2025-10-24T22:01:45.427108] [INFO ] [MAIN      ] YMM: Fetched primary data is valid.
[2025-10-24T22:01:45.427283] [DEBUG] [LOCAL     ] YMM: Saving primary data.
[2025-10-24T22:01:45.428008] [FATAL] [LOCAL     ] YMM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:01:45.428096] [FATAL] [MAIN      ] YMM: Failed to save primary data.
[2025-10-24T22:01:45.428138] [WARN ] [MAIN      ] YMM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:01:45.428200] [INFO ] [LOCAL     ] YMM: Starting deletion of primary data.
[2025-10-24T22:01:45.428261] [DEBUG] [LOCAL     ] YMM: No primary data file found to delete.
[2025-10-24T22:01:45.428296] [INFO ] [LOCAL     ] YMM: Starting deletion of derivative data.
[2025-10-24T22:01:45.428452] [DEBUG] [LOCAL     ] YMM: Deleted derivative data file.
[2025-10-24T22:01:45.429166] [INFO ] [MAIN      ] Update Progress: 2349/2366 symbols completed. YMM took 54.4s. Estimated remaining: 2m 11s. Rate: 7.8 symbols/min
[2025-10-24T22:01:45.595185] [INFO ] [MAIN      ] ZBH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:01:45.644019] [DEBUG] [LOCAL     ] ZBH: Loaded 51035 existing records from primary storage.
[2025-10-24T22:01:45.644325] [INFO ] [MAIN      ] ZBH: Loaded 51035 existing records.
[2025-10-24T22:01:45.747853] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-07.
[2025-10-24T22:01:45.827447] [WARN ] [MAIN      ] ZBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:01:45.827834] [INFO ] [MAIN      ] ZBH: Wiping existing primary data before full refresh.
[2025-10-24T22:01:45.827940] [INFO ] [LOCAL     ] ZBH: Starting deletion of primary data.
[2025-10-24T22:01:45.837542] [DEBUG] [LOCAL     ] ZBH: Deleted primary data file.
[2025-10-24T22:01:45.844517] [INFO ] [MAIN      ] ZBH: Starting full primary refresh.
[2025-10-24T22:01:45.918970] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-02 (1.77 seconds).
[2025-10-24T22:01:46.214390] [INFO ] [REMOTE    ] ZBH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:01:46.547725] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-01.
[2025-10-24T22:01:46.568772] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-07 (0.82 seconds).
[2025-10-24T22:01:46.729666] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-01 (1.77 seconds).
[2025-10-24T22:01:47.347743] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-08.
[2025-10-24T22:01:48.147640] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-03.
[2025-10-24T22:01:48.170081] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-08 (0.82 seconds).
[2025-10-24T22:01:48.344901] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T22:01:48.947743] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-02.
[2025-10-24T22:01:49.747696] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-02.
[2025-10-24T22:01:49.819551] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-03 (1.67 seconds).
[2025-10-24T22:01:50.547705] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-04.
[2025-10-24T22:01:50.837506] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-02 (1.89 seconds).
[2025-10-24T22:01:51.347686] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-09.
[2025-10-24T22:01:51.560577] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-02 (1.81 seconds).
[2025-10-24T22:01:52.147683] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-03.
[2025-10-24T22:01:52.170882] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-09 (0.82 seconds).
[2025-10-24T22:01:52.482543] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-04 (1.93 seconds).
[2025-10-24T22:01:52.947701] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-03.
[2025-10-24T22:01:53.502927] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-03 (1.36 seconds).
[2025-10-24T22:01:53.747788] [INFO ] [REMOTE    ] YRD: Fetching primary data for 2025-10.
[2025-10-24T22:01:54.530028] [INFO ] [REMOTE    ] YRD: Incremental fetch complete for 2025-10 (0.78 seconds).
[2025-10-24T22:01:54.532343] [INFO ] [REMOTE    ] YRD: Full fetch complete (18720 records).
[2025-10-24T22:01:54.532421] [DEBUG] [VALIDATOR ] YRD: Validating primary data.
[2025-10-24T22:01:54.553678] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-05.
[2025-10-24T22:01:54.985967] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present.
[2025-10-24T22:01:54.989336] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-03 (2.04 seconds).
[2025-10-24T22:01:54.986842] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed.
[2025-10-24T22:01:55.002462] [INFO ] [MAIN      ] YRD: Fetched primary data is valid.
[2025-10-24T22:01:55.003190] [DEBUG] [LOCAL     ] YRD: Saving primary data.
[2025-10-24T22:01:55.004324] [FATAL] [LOCAL     ] YRD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:01:55.004422] [FATAL] [MAIN      ] YRD: Failed to save primary data.
[2025-10-24T22:01:55.004466] [WARN ] [MAIN      ] YRD: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:01:55.004505] [INFO ] [LOCAL     ] YRD: Starting deletion of primary data.
[2025-10-24T22:01:55.004575] [DEBUG] [LOCAL     ] YRD: No primary data file found to delete.
[2025-10-24T22:01:55.004614] [INFO ] [LOCAL     ] YRD: Starting deletion of derivative data.
[2025-10-24T22:01:55.004883] [DEBUG] [LOCAL     ] YRD: Deleted derivative data file.
[2025-10-24T22:01:55.005008] [INFO ] [MAIN      ] Update Progress: 2350/2366 symbols completed. YRD took 35.1s. Estimated remaining: 2m 3s. Rate: 7.8 symbols/min
[2025-10-24T22:01:55.194012] [INFO ] [MAIN      ] ZEPP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:01:55.217072] [DEBUG] [LOCAL     ] ZEPP: Loaded 19786 existing records from primary storage.
[2025-10-24T22:01:55.217416] [INFO ] [MAIN      ] ZEPP: Loaded 19786 existing records.
[2025-10-24T22:01:55.352892] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-04.
[2025-10-24T22:01:55.410383] [WARN ] [MAIN      ] ZEPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:01:55.410691] [INFO ] [MAIN      ] ZEPP: Wiping existing primary data before full refresh.
[2025-10-24T22:01:55.410754] [INFO ] [LOCAL     ] ZEPP: Starting deletion of primary data.
[2025-10-24T22:01:55.410978] [DEBUG] [LOCAL     ] ZEPP: Deleted primary data file.
[2025-10-24T22:01:55.411018] [INFO ] [MAIN      ] ZEPP: Starting full primary refresh.
[2025-10-24T22:01:55.803778] [INFO ] [REMOTE    ] ZEPP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:01:56.147686] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-04.
[2025-10-24T22:01:56.301123] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-05 (1.75 seconds).
[2025-10-24T22:01:56.947722] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-01.
[2025-10-24T22:01:57.137561] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-04 (1.78 seconds).
[2025-10-24T22:01:57.447279] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-01 (0.50 seconds).
[2025-10-24T22:01:57.747713] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-06.
[2025-10-24T22:01:58.151354] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-04 (2.00 seconds).
[2025-10-24T22:01:58.547699] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-02.
[2025-10-24T22:01:59.015059] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-02 (0.47 seconds).
[2025-10-24T22:01:59.347679] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-05.
[2025-10-24T22:01:59.396765] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-06 (1.65 seconds).
[2025-10-24T22:02:00.147610] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-07.
[2025-10-24T22:02:00.947708] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-05.
[2025-10-24T22:02:01.005064] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T22:02:01.725549] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-07 (1.58 seconds).
[2025-10-24T22:02:01.747767] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-08.
[2025-10-24T22:02:02.547613] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-03.
[2025-10-24T22:02:02.629806] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-05 (1.68 seconds).
[2025-10-24T22:02:02.909084] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-03 (0.36 seconds).
[2025-10-24T22:02:03.143209] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T22:02:03.347676] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-06.
[2025-10-24T22:02:04.147689] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-04.
[2025-10-24T22:02:04.873751] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-04 (0.73 seconds).
[2025-10-24T22:02:04.947592] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-06.
[2025-10-24T22:02:05.020307] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-06 (1.67 seconds).
[2025-10-24T22:02:05.747792] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-09.
[2025-10-24T22:02:06.440444] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-06 (1.49 seconds).
[2025-10-24T22:02:06.547696] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-07.
[2025-10-24T22:02:07.347722] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-07.
[2025-10-24T22:02:07.482884] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-09 (1.74 seconds).
[2025-10-24T22:02:08.150223] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-05.
[2025-10-24T22:02:08.153232] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-07 (1.61 seconds).
[2025-10-24T22:02:08.650926] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-07 (1.30 seconds).
[2025-10-24T22:02:08.762613] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-05 (0.61 seconds).
[2025-10-24T22:02:08.947753] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-06.
[2025-10-24T22:02:09.553706] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-06 (0.61 seconds).
[2025-10-24T22:02:09.747689] [INFO ] [REMOTE    ] YUM: Fetching primary data for 2025-10.
[2025-10-24T22:02:10.475071] [INFO ] [REMOTE    ] YUM: Incremental fetch complete for 2025-10 (0.73 seconds).
[2025-10-24T22:02:10.484443] [INFO ] [REMOTE    ] YUM: Full fetch complete (74614 records).
[2025-10-24T22:02:10.484578] [DEBUG] [VALIDATOR ] YUM: Validating primary data.
[2025-10-24T22:02:10.552829] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-08.
[2025-10-24T22:02:10.874665] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present.
[2025-10-24T22:02:10.874766] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed.
[2025-10-24T22:02:10.876047] [INFO ] [MAIN      ] YUM: Fetched primary data is valid.
[2025-10-24T22:02:10.876113] [DEBUG] [LOCAL     ] YUM: Saving primary data.
[2025-10-24T22:02:10.876759] [FATAL] [LOCAL     ] YUM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:02:10.876857] [FATAL] [MAIN      ] YUM: Failed to save primary data.
[2025-10-24T22:02:10.876902] [WARN ] [MAIN      ] YUM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:02:10.876940] [INFO ] [LOCAL     ] YUM: Starting deletion of primary data.
[2025-10-24T22:02:10.876995] [DEBUG] [LOCAL     ] YUM: No primary data file found to delete.
[2025-10-24T22:02:10.877052] [INFO ] [LOCAL     ] YUM: Starting deletion of derivative data.
[2025-10-24T22:02:10.877207] [DEBUG] [LOCAL     ] YUM: Deleted derivative data file.
[2025-10-24T22:02:10.877852] [INFO ] [MAIN      ] Update Progress: 2351/2366 symbols completed. YUM took 31.9s. Estimated remaining: 1m 56s. Rate: 7.8 symbols/min
[2025-10-24T22:02:11.044731] [INFO ] [MAIN      ] ZETA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:02:11.101242] [DEBUG] [LOCAL     ] ZETA: Loaded 54008 existing records from primary storage.
[2025-10-24T22:02:11.101613] [INFO ] [MAIN      ] ZETA: Loaded 54008 existing records.
[2025-10-24T22:02:11.273896] [WARN ] [MAIN      ] ZETA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:02:11.274117] [INFO ] [MAIN      ] ZETA: Wiping existing primary data before full refresh.
[2025-10-24T22:02:11.274163] [INFO ] [LOCAL     ] ZETA: Starting deletion of primary data.
[2025-10-24T22:02:11.274559] [DEBUG] [LOCAL     ] ZETA: Deleted primary data file.
[2025-10-24T22:02:11.274615] [INFO ] [MAIN      ] ZETA: Starting full primary refresh.
[2025-10-24T22:02:11.352829] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-08.
[2025-10-24T22:02:11.622079] [INFO ] [REMOTE    ] ZETA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:02:12.147690] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-01.
[2025-10-24T22:02:12.284616] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-08 (1.73 seconds).
[2025-10-24T22:02:12.947708] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-09.
[2025-10-24T22:02:13.255727] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-08 (1.90 seconds).
[2025-10-24T22:02:13.747700] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-09.
[2025-10-24T22:02:13.888347] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-01 (1.74 seconds).
[2025-10-24T22:02:14.516605] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-09 (0.77 seconds).
[2025-10-24T22:02:14.547604] [INFO ] [REMOTE    ] ZBH: Fetching primary data for 2025-10.
[2025-10-24T22:02:14.621743] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-09 (1.67 seconds).
[2025-10-24T22:02:15.257582] [INFO ] [REMOTE    ] ZBH: Incremental fetch complete for 2025-10 (0.71 seconds).
[2025-10-24T22:02:15.268901] [INFO ] [REMOTE    ] ZBH: Full fetch complete (73894 records).
[2025-10-24T22:02:15.269020] [DEBUG] [VALIDATOR ] ZBH: Validating primary data.
[2025-10-24T22:02:15.352836] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-02.
[2025-10-24T22:02:15.661569] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present.
[2025-10-24T22:02:15.661675] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed.
[2025-10-24T22:02:15.662822] [INFO ] [MAIN      ] ZBH: Fetched primary data is valid.
[2025-10-24T22:02:15.662883] [DEBUG] [LOCAL     ] ZBH: Saving primary data.
[2025-10-24T22:02:15.663468] [FATAL] [LOCAL     ] ZBH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:02:15.663558] [FATAL] [MAIN      ] ZBH: Failed to save primary data.
[2025-10-24T22:02:15.663600] [WARN ] [MAIN      ] ZBH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:02:15.663636] [INFO ] [LOCAL     ] ZBH: Starting deletion of primary data.
[2025-10-24T22:02:15.663737] [DEBUG] [LOCAL     ] ZBH: No primary data file found to delete.
[2025-10-24T22:02:15.663778] [INFO ] [LOCAL     ] ZBH: Starting deletion of derivative data.
[2025-10-24T22:02:15.663962] [DEBUG] [LOCAL     ] ZBH: Deleted derivative data file.
[2025-10-24T22:02:15.664766] [INFO ] [MAIN      ] Update Progress: 2352/2366 symbols completed. ZBH took 30.2s. Estimated remaining: 1m 48s. Rate: 7.8 symbols/min
[2025-10-24T22:02:15.837030] [INFO ] [MAIN      ] ZGN: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:02:15.874874] [DEBUG] [LOCAL     ] ZGN: Loaded 41195 existing records from primary storage.
[2025-10-24T22:02:15.875164] [INFO ] [MAIN      ] ZGN: Loaded 41195 existing records.
[2025-10-24T22:02:16.048483] [WARN ] [MAIN      ] ZGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:02:16.048706] [INFO ] [MAIN      ] ZGN: Wiping existing primary data before full refresh.
[2025-10-24T22:02:16.048762] [INFO ] [LOCAL     ] ZGN: Starting deletion of primary data.
[2025-10-24T22:02:16.049047] [DEBUG] [LOCAL     ] ZGN: Deleted primary data file.
[2025-10-24T22:02:16.049103] [INFO ] [MAIN      ] ZGN: Starting full primary refresh.
[2025-10-24T22:02:16.152889] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-07.
[2025-10-24T22:02:16.398193] [INFO ] [REMOTE    ] ZGN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:02:16.947614] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-01.
[2025-10-24T22:02:17.342740] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-02 (1.99 seconds).
[2025-10-24T22:02:17.747706] [INFO ] [REMOTE    ] YUMC: Fetching primary data for 2025-10.
[2025-10-24T22:02:17.801832] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-07 (1.65 seconds).
[2025-10-24T22:02:18.075209] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-01 (1.13 seconds).
[2025-10-24T22:02:18.547750] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-02.
[2025-10-24T22:02:19.347695] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-08.
[2025-10-24T22:02:19.491832] [INFO ] [REMOTE    ] YUMC: Incremental fetch complete for 2025-10 (1.74 seconds).
[2025-10-24T22:02:19.502288] [INFO ] [REMOTE    ] YUMC: Full fetch complete (76453 records).
[2025-10-24T22:02:19.502420] [DEBUG] [VALIDATOR ] YUMC: Validating primary data.
[2025-10-24T22:02:19.873350] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-02 (1.33 seconds).
[2025-10-24T22:02:19.935236] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present.
[2025-10-24T22:02:19.935311] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed.
[2025-10-24T22:02:19.936495] [INFO ] [MAIN      ] YUMC: Fetched primary data is valid.
[2025-10-24T22:02:19.936558] [DEBUG] [LOCAL     ] YUMC: Saving primary data.
[2025-10-24T22:02:19.937154] [FATAL] [LOCAL     ] YUMC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:02:19.937245] [FATAL] [MAIN      ] YUMC: Failed to save primary data.
[2025-10-24T22:02:19.937288] [WARN ] [MAIN      ] YUMC: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:02:19.937361] [INFO ] [LOCAL     ] YUMC: Starting deletion of primary data.
[2025-10-24T22:02:19.937452] [DEBUG] [LOCAL     ] YUMC: No primary data file found to delete.
[2025-10-24T22:02:19.937506] [INFO ] [LOCAL     ] YUMC: Starting deletion of derivative data.
[2025-10-24T22:02:19.937745] [DEBUG] [LOCAL     ] YUMC: Deleted derivative data file.
[2025-10-24T22:02:19.938519] [INFO ] [MAIN      ] Update Progress: 2353/2366 symbols completed. YUMC took 36.6s. Estimated remaining: 1m 40s. Rate: 7.8 symbols/min
[2025-10-24T22:02:20.109157] [INFO ] [MAIN      ] ZH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:02:20.132334] [DEBUG] [LOCAL     ] ZH: Loaded 24766 existing records from primary storage.
[2025-10-24T22:02:20.132586] [INFO ] [MAIN      ] ZH: Loaded 24766 existing records.
[2025-10-24T22:02:20.153719] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-03.
[2025-10-24T22:02:20.316064] [WARN ] [MAIN      ] ZH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:02:20.316349] [INFO ] [MAIN      ] ZH: Wiping existing primary data before full refresh.
[2025-10-24T22:02:20.316397] [INFO ] [LOCAL     ] ZH: Starting deletion of primary data.
[2025-10-24T22:02:20.316576] [DEBUG] [LOCAL     ] ZH: Deleted primary data file.
[2025-10-24T22:02:20.316623] [INFO ] [MAIN      ] ZH: Starting full primary refresh.
[2025-10-24T22:02:20.684744] [INFO ] [REMOTE    ] ZH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:02:20.853987] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T22:02:20.947611] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-09.
[2025-10-24T22:02:21.685750] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-03 (1.53 seconds).
[2025-10-24T22:02:21.747669] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-04.
[2025-10-24T22:02:22.246507] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-09 (1.30 seconds).
[2025-10-24T22:02:22.547699] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-03.
[2025-10-24T22:02:23.170999] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-04 (1.42 seconds).
[2025-10-24T22:02:23.347688] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-05.
[2025-10-24T22:02:24.147681] [INFO ] [REMOTE    ] ZEPP: Fetching primary data for 2025-10.
[2025-10-24T22:02:24.458906] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-03 (1.91 seconds).
[2025-10-24T22:02:24.956577] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-01.
[2025-10-24T22:02:24.959556] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T22:02:25.258432] [INFO ] [REMOTE    ] ZEPP: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T22:02:25.262954] [INFO ] [REMOTE    ] ZEPP: Full fetch complete (21551 records).
[2025-10-24T22:02:25.263030] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data.
[2025-10-24T22:02:25.630679] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present.
[2025-10-24T22:02:25.630777] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed.
[2025-10-24T22:02:25.631331] [INFO ] [MAIN      ] ZEPP: Fetched primary data is valid.
[2025-10-24T22:02:25.631445] [DEBUG] [LOCAL     ] ZEPP: Saving primary data.
[2025-10-24T22:02:25.631781] [FATAL] [LOCAL     ] ZEPP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:02:25.631861] [FATAL] [MAIN      ] ZEPP: Failed to save primary data.
[2025-10-24T22:02:25.631902] [WARN ] [MAIN      ] ZEPP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:02:25.631939] [INFO ] [LOCAL     ] ZEPP: Starting deletion of primary data.
[2025-10-24T22:02:25.631988] [DEBUG] [LOCAL     ] ZEPP: No primary data file found to delete.
[2025-10-24T22:02:25.632023] [INFO ] [LOCAL     ] ZEPP: Starting deletion of derivative data.
[2025-10-24T22:02:25.632216] [DEBUG] [LOCAL     ] ZEPP: Deleted derivative data file.
[2025-10-24T22:02:25.632304] [INFO ] [MAIN      ] Update Progress: 2354/2366 symbols completed. ZEPP took 30.6s. Estimated remaining: 1m 32s. Rate: 7.8 symbols/min
[2025-10-24T22:02:25.749704] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-04.
[2025-10-24T22:02:25.794882] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-01 (0.84 seconds).
[2025-10-24T22:02:25.817411] [INFO ] [MAIN      ] ZIM: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:02:25.873632] [DEBUG] [LOCAL     ] ZIM: Loaded 53836 existing records from primary storage.
[2025-10-24T22:02:25.873966] [INFO ] [MAIN      ] ZIM: Loaded 53836 existing records.
[2025-10-24T22:02:26.048108] [WARN ] [MAIN      ] ZIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:02:26.048350] [INFO ] [MAIN      ] ZIM: Wiping existing primary data before full refresh.
[2025-10-24T22:02:26.048395] [INFO ] [LOCAL     ] ZIM: Starting deletion of primary data.
[2025-10-24T22:02:26.048783] [DEBUG] [LOCAL     ] ZIM: Deleted primary data file.
[2025-10-24T22:02:26.048838] [INFO ] [MAIN      ] ZIM: Starting full primary refresh.
[2025-10-24T22:02:26.398888] [INFO ] [REMOTE    ] ZIM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:02:26.547616] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-01.
[2025-10-24T22:02:27.347620] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-06.
[2025-10-24T22:02:27.651987] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-04 (1.90 seconds).
[2025-10-24T22:02:28.147739] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-02.
[2025-10-24T22:02:28.406677] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-06 (1.06 seconds).
[2025-10-24T22:02:28.512853] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-01 (1.97 seconds).
[2025-10-24T22:02:28.947708] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-07.
[2025-10-24T22:02:29.728432] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-02 (1.58 seconds).
[2025-10-24T22:02:29.747609] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-03.
[2025-10-24T22:02:30.518963] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-07 (1.57 seconds).
[2025-10-24T22:02:30.547614] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-08.
[2025-10-24T22:02:30.740346] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-03 (0.99 seconds).
[2025-10-24T22:02:31.347686] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-04.
[2025-10-24T22:02:31.944780] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T22:02:32.147718] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-05.
[2025-10-24T22:02:32.300487] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-04 (0.95 seconds).
[2025-10-24T22:02:32.947724] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-05.
[2025-10-24T22:02:33.747795] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-09.
[2025-10-24T22:02:33.919221] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-05 (0.97 seconds).
[2025-10-24T22:02:34.099787] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-05 (1.95 seconds).
[2025-10-24T22:02:34.547708] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-02.
[2025-10-24T22:02:35.276221] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T22:02:35.347609] [INFO ] [REMOTE    ] ZGN: Fetching primary data for 2025-10.
[2025-10-24T22:02:36.147640] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-06.
[2025-10-24T22:02:36.334100] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-02 (1.79 seconds).
[2025-10-24T22:02:36.877546] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-06 (0.73 seconds).
[2025-10-24T22:02:36.942888] [INFO ] [REMOTE    ] ZGN: Incremental fetch complete for 2025-10 (1.60 seconds).
[2025-10-24T22:02:36.950559] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-06.
[2025-10-24T22:02:36.952502] [INFO ] [REMOTE    ] ZGN: Full fetch complete (58898 records).
[2025-10-24T22:02:36.952605] [DEBUG] [VALIDATOR ] ZGN: Validating primary data.
[2025-10-24T22:02:37.355406] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present.
[2025-10-24T22:02:37.355498] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed.
[2025-10-24T22:02:37.356563] [INFO ] [MAIN      ] ZGN: Fetched primary data is valid.
[2025-10-24T22:02:37.356629] [DEBUG] [LOCAL     ] ZGN: Saving primary data.
[2025-10-24T22:02:37.357228] [FATAL] [LOCAL     ] ZGN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:02:37.357327] [FATAL] [MAIN      ] ZGN: Failed to save primary data.
[2025-10-24T22:02:37.357369] [WARN ] [MAIN      ] ZGN: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:02:37.357403] [INFO ] [LOCAL     ] ZGN: Starting deletion of primary data.
[2025-10-24T22:02:37.357456] [DEBUG] [LOCAL     ] ZGN: No primary data file found to delete.
[2025-10-24T22:02:37.357493] [INFO ] [LOCAL     ] ZGN: Starting deletion of derivative data.
[2025-10-24T22:02:37.357717] [DEBUG] [LOCAL     ] ZGN: Deleted derivative data file.
[2025-10-24T22:02:37.358107] [INFO ] [MAIN      ] Update Progress: 2355/2366 symbols completed. ZGN took 21.7s. Estimated remaining: 1m 25s. Rate: 7.8 symbols/min
[2025-10-24T22:02:37.534148] [INFO ] [MAIN      ] ZIP: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:02:37.573034] [DEBUG] [LOCAL     ] ZIP: Loaded 43737 existing records from primary storage.
[2025-10-24T22:02:37.573318] [INFO ] [MAIN      ] ZIP: Loaded 43737 existing records.
[2025-10-24T22:02:37.754092] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-07.
[2025-10-24T22:02:37.756153] [WARN ] [MAIN      ] ZIP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:02:37.757288] [INFO ] [MAIN      ] ZIP: Wiping existing primary data before full refresh.
[2025-10-24T22:02:37.757346] [INFO ] [LOCAL     ] ZIP: Starting deletion of primary data.
[2025-10-24T22:02:37.757736] [DEBUG] [LOCAL     ] ZIP: Deleted primary data file.
[2025-10-24T22:02:37.757792] [INFO ] [MAIN      ] ZIP: Starting full primary refresh.
[2025-10-24T22:02:38.119479] [INFO ] [REMOTE    ] ZIP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:02:38.547679] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-03.
[2025-10-24T22:02:39.030365] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-06 (2.08 seconds).
[2025-10-24T22:02:39.069242] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-07 (1.32 seconds).
[2025-10-24T22:02:39.347729] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-07.
[2025-10-24T22:02:40.087575] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-03 (1.54 seconds).
[2025-10-24T22:02:40.147725] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-08.
[2025-10-24T22:02:40.947700] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-01.
[2025-10-24T22:02:41.167752] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-08 (1.02 seconds).
[2025-10-24T22:02:41.545993] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-07 (2.20 seconds).
[2025-10-24T22:02:41.747680] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-04.
[2025-10-24T22:02:42.213389] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-01 (1.27 seconds).
[2025-10-24T22:02:42.547713] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-08.
[2025-10-24T22:02:43.347730] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-09.
[2025-10-24T22:02:44.020838] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-04 (2.27 seconds).
[2025-10-24T22:02:44.147680] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-05.
[2025-10-24T22:02:44.669094] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-08 (2.12 seconds).
[2025-10-24T22:02:44.704762] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-09 (1.36 seconds).
[2025-10-24T22:02:44.947727] [INFO ] [REMOTE    ] ZH: Fetching primary data for 2025-10.
[2025-10-24T22:02:45.747672] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-09.
[2025-10-24T22:02:45.942498] [INFO ] [REMOTE    ] ZH: Incremental fetch complete for 2025-10 (0.99 seconds).
[2025-10-24T22:02:45.946413] [INFO ] [REMOTE    ] ZH: Full fetch complete (39716 records).
[2025-10-24T22:02:45.946501] [DEBUG] [VALIDATOR ] ZH: Validating primary data.
[2025-10-24T22:02:46.342294] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present.
[2025-10-24T22:02:46.342431] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed.
[2025-10-24T22:02:46.343377] [INFO ] [MAIN      ] ZH: Fetched primary data is valid.
[2025-10-24T22:02:46.343582] [DEBUG] [LOCAL     ] ZH: Saving primary data.
[2025-10-24T22:02:46.344113] [FATAL] [LOCAL     ] ZH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:02:46.344301] [FATAL] [MAIN      ] ZH: Failed to save primary data.
[2025-10-24T22:02:46.344478] [WARN ] [MAIN      ] ZH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:02:46.344812] [INFO ] [LOCAL     ] ZH: Starting deletion of primary data.
[2025-10-24T22:02:46.344934] [DEBUG] [LOCAL     ] ZH: No primary data file found to delete.
[2025-10-24T22:02:46.345026] [INFO ] [LOCAL     ] ZH: Starting deletion of derivative data.
[2025-10-24T22:02:46.360806] [DEBUG] [LOCAL     ] ZH: Deleted derivative data file.
[2025-10-24T22:02:46.373573] [INFO ] [MAIN      ] Update Progress: 2356/2366 symbols completed. ZH took 26.4s. Estimated remaining: 1m 17s. Rate: 7.8 symbols/min
[2025-10-24T22:02:46.420759] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-05 (2.27 seconds).
[2025-10-24T22:02:46.558417] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-02.
[2025-10-24T22:02:46.560885] [INFO ] [MAIN      ] ZK: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:02:46.596815] [DEBUG] [LOCAL     ] ZK: Loaded 39272 existing records from primary storage.
[2025-10-24T22:02:46.597084] [INFO ] [MAIN      ] ZK: Loaded 39272 existing records.
[2025-10-24T22:02:46.772234] [WARN ] [MAIN      ] ZK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:02:46.772456] [INFO ] [MAIN      ] ZK: Wiping existing primary data before full refresh.
[2025-10-24T22:02:46.772501] [INFO ] [LOCAL     ] ZK: Starting deletion of primary data.
[2025-10-24T22:02:46.772793] [DEBUG] [LOCAL     ] ZK: Deleted primary data file.
[2025-10-24T22:02:46.772849] [INFO ] [MAIN      ] ZK: Starting full primary refresh.
[2025-10-24T22:02:47.123734] [INFO ] [REMOTE    ] ZK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:02:47.347689] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-01.
[2025-10-24T22:02:47.841975] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-02 (1.28 seconds).
[2025-10-24T22:02:48.009262] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-09 (2.26 seconds).
[2025-10-24T22:02:48.147682] [INFO ] [REMOTE    ] ZETA: Fetching primary data for 2025-10.
[2025-10-24T22:02:48.771152] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-01 (1.42 seconds).
[2025-10-24T22:02:48.947691] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-03.
[2025-10-24T22:02:49.747722] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-02.
[2025-10-24T22:02:50.137932] [INFO ] [REMOTE    ] ZETA: Incremental fetch complete for 2025-10 (1.99 seconds).
[2025-10-24T22:02:50.147687] [INFO ] [REMOTE    ] ZETA: Full fetch complete (77737 records).
[2025-10-24T22:02:50.147839] [DEBUG] [VALIDATOR ] ZETA: Validating primary data.
[2025-10-24T22:02:50.542804] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present.
[2025-10-24T22:02:50.542906] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed.
[2025-10-24T22:02:50.544076] [INFO ] [MAIN      ] ZETA: Fetched primary data is valid.
[2025-10-24T22:02:50.544155] [DEBUG] [LOCAL     ] ZETA: Saving primary data.
[2025-10-24T22:02:50.544802] [FATAL] [LOCAL     ] ZETA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:02:50.545005] [FATAL] [MAIN      ] ZETA: Failed to save primary data.
[2025-10-24T22:02:50.545072] [WARN ] [MAIN      ] ZETA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:02:50.554781] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-06.
[2025-10-24T22:02:50.569667] [INFO ] [LOCAL     ] ZETA: Starting deletion of primary data.
[2025-10-24T22:02:50.573631] [DEBUG] [LOCAL     ] ZETA: No primary data file found to delete.
[2025-10-24T22:02:50.573762] [INFO ] [LOCAL     ] ZETA: Starting deletion of derivative data.
[2025-10-24T22:02:50.574017] [DEBUG] [LOCAL     ] ZETA: Deleted derivative data file.
[2025-10-24T22:02:50.574977] [INFO ] [MAIN      ] Update Progress: 2357/2366 symbols completed. ZETA took 39.7s. Estimated remaining: 1m 9s. Rate: 7.8 symbols/min
[2025-10-24T22:02:50.576694] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-03 (1.63 seconds).
[2025-10-24T22:02:51.180287] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-02 (1.43 seconds).
[2025-10-24T22:02:51.347716] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-03.
[2025-10-24T22:02:52.147695] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-04.
[2025-10-24T22:02:52.631688] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-03 (1.28 seconds).
[2025-10-24T22:02:52.802149] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-06 (2.25 seconds).
[2025-10-24T22:02:52.947730] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-04.
[2025-10-24T22:02:53.747699] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-07.
[2025-10-24T22:02:53.798831] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-04 (1.65 seconds).
[2025-10-24T22:02:54.552753] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-05.
[2025-10-24T22:02:54.572919] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-04 (1.63 seconds).
[2025-10-24T22:02:55.347717] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-05.
[2025-10-24T22:02:55.458746] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-07 (1.71 seconds).
[2025-10-24T22:02:56.152881] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-08.
[2025-10-24T22:02:56.165882] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-05 (1.61 seconds).
[2025-10-24T22:02:56.894761] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-05 (1.55 seconds).
[2025-10-24T22:02:56.947699] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-06.
[2025-10-24T22:02:57.747699] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-06.
[2025-10-24T22:02:58.369483] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-06 (1.42 seconds).
[2025-10-24T22:02:58.488102] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-08 (2.34 seconds).
[2025-10-24T22:02:58.547686] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-09.
[2025-10-24T22:02:59.088310] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-06 (1.34 seconds).
[2025-10-24T22:02:59.347675] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-07.
[2025-10-24T22:03:00.147734] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-07.
[2025-10-24T22:03:00.702345] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-09 (2.15 seconds).
[2025-10-24T22:03:00.795781] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-07 (1.45 seconds).
[2025-10-24T22:03:00.947610] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-08.
[2025-10-24T22:03:01.748483] [INFO ] [REMOTE    ] ZIM: Fetching primary data for 2025-10.
[2025-10-24T22:03:01.748403] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T22:03:02.253281] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-08 (1.31 seconds).
[2025-10-24T22:03:02.547728] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-08.
[2025-10-24T22:03:03.347703] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-09.
[2025-10-24T22:03:03.871245] [INFO ] [REMOTE    ] ZIM: Incremental fetch complete for 2025-10 (2.12 seconds).
[2025-10-24T22:03:03.881725] [INFO ] [REMOTE    ] ZIM: Full fetch complete (77557 records).
[2025-10-24T22:03:03.881864] [DEBUG] [VALIDATOR ] ZIM: Validating primary data.
[2025-10-24T22:03:04.074020] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-08 (1.53 seconds).
[2025-10-24T22:03:04.185598] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-09.
[2025-10-24T22:03:04.322979] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present.
[2025-10-24T22:03:04.323064] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed.
[2025-10-24T22:03:04.324296] [INFO ] [MAIN      ] ZIM: Fetched primary data is valid.
[2025-10-24T22:03:04.324360] [DEBUG] [LOCAL     ] ZIM: Saving primary data.
[2025-10-24T22:03:04.325001] [FATAL] [LOCAL     ] ZIM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:03:04.325141] [FATAL] [MAIN      ] ZIM: Failed to save primary data.
[2025-10-24T22:03:04.325217] [WARN ] [MAIN      ] ZIM: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:03:04.325304] [INFO ] [LOCAL     ] ZIM: Starting deletion of primary data.
[2025-10-24T22:03:04.325381] [DEBUG] [LOCAL     ] ZIM: No primary data file found to delete.
[2025-10-24T22:03:04.325418] [INFO ] [LOCAL     ] ZIM: Starting deletion of derivative data.
[2025-10-24T22:03:04.325570] [DEBUG] [LOCAL     ] ZIM: Deleted derivative data file.
[2025-10-24T22:03:04.325849] [INFO ] [MAIN      ] Update Progress: 2358/2366 symbols completed. ZIM took 38.7s. Estimated remaining: 1m 2s. Rate: 7.8 symbols/min
[2025-10-24T22:03:04.879695] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-09 (1.53 seconds).
[2025-10-24T22:03:04.947615] [INFO ] [REMOTE    ] ZK: Fetching primary data for 2025-10.
[2025-10-24T22:03:05.686545] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-09 (1.50 seconds).
[2025-10-24T22:03:05.747621] [INFO ] [REMOTE    ] ZIP: Fetching primary data for 2025-10.
[2025-10-24T22:03:05.980241] [INFO ] [REMOTE    ] ZK: Incremental fetch complete for 2025-10 (1.03 seconds).
[2025-10-24T22:03:05.988602] [INFO ] [REMOTE    ] ZK: Full fetch complete (57117 records).
[2025-10-24T22:03:05.988864] [DEBUG] [VALIDATOR ] ZK: Validating primary data.
[2025-10-24T22:03:06.404373] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present.
[2025-10-24T22:03:06.404771] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed.
[2025-10-24T22:03:06.407381] [INFO ] [MAIN      ] ZK: Fetched primary data is valid.
[2025-10-24T22:03:06.407455] [DEBUG] [LOCAL     ] ZK: Saving primary data.
[2025-10-24T22:03:06.408389] [FATAL] [LOCAL     ] ZK: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:03:06.408538] [FATAL] [MAIN      ] ZK: Failed to save primary data.
[2025-10-24T22:03:06.408592] [WARN ] [MAIN      ] ZK: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:03:06.408630] [INFO ] [LOCAL     ] ZK: Starting deletion of primary data.
[2025-10-24T22:03:06.408755] [DEBUG] [LOCAL     ] ZK: No primary data file found to delete.
[2025-10-24T22:03:06.408831] [INFO ] [LOCAL     ] ZK: Starting deletion of derivative data.
[2025-10-24T22:03:06.409919] [DEBUG] [LOCAL     ] ZK: Deleted derivative data file.
[2025-10-24T22:03:06.410042] [INFO ] [MAIN      ] Update Progress: 2359/2366 symbols completed. ZK took 20.0s. Estimated remaining: 54.0s. Rate: 7.8 symbols/min
[2025-10-24T22:03:07.029803] [INFO ] [REMOTE    ] ZIP: Incremental fetch complete for 2025-10 (1.28 seconds).
[2025-10-24T22:03:07.040547] [INFO ] [REMOTE    ] ZIP: Full fetch complete (60847 records).
[2025-10-24T22:03:07.040719] [DEBUG] [VALIDATOR ] ZIP: Validating primary data.
[2025-10-24T22:03:07.416616] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present.
[2025-10-24T22:03:07.416731] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed.
[2025-10-24T22:03:07.417787] [INFO ] [MAIN      ] ZIP: Fetched primary data is valid.
[2025-10-24T22:03:07.417848] [DEBUG] [LOCAL     ] ZIP: Saving primary data.
[2025-10-24T22:03:07.418313] [FATAL] [LOCAL     ] ZIP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:03:07.418400] [FATAL] [MAIN      ] ZIP: Failed to save primary data.
[2025-10-24T22:03:07.418442] [WARN ] [MAIN      ] ZIP: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:03:07.418478] [INFO ] [LOCAL     ] ZIP: Starting deletion of primary data.
[2025-10-24T22:03:07.418532] [DEBUG] [LOCAL     ] ZIP: No primary data file found to delete.
[2025-10-24T22:03:07.418569] [INFO ] [LOCAL     ] ZIP: Starting deletion of derivative data.
[2025-10-24T22:03:07.418788] [DEBUG] [LOCAL     ] ZIP: Deleted derivative data file.
[2025-10-24T22:03:07.419238] [INFO ] [MAIN      ] Update Progress: 2360/2366 symbols completed. ZIP took 30.1s. Estimated remaining: 46.2s. Rate: 7.8 symbols/min
[2025-10-24T22:03:08.012506] [INFO ] [MAIN      ] ZTO: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:03:08.070306] [INFO ] [MAIN      ] ZTR: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:03:08.158154] [INFO ] [MAIN      ] ZTS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:03:08.154133] [INFO ] [MAIN      ] ZKH: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:03:08.179825] [DEBUG] [LOCAL     ] ZKH: Loaded 7354 existing records from primary storage.
[2025-10-24T22:03:08.188063] [INFO ] [MAIN      ] ZKH: Loaded 7354 existing records.
[2025-10-24T22:03:08.188776] [DEBUG] [LOCAL     ] ZTR: Loaded 16659 existing records from primary storage.
[2025-10-24T22:03:08.238435] [INFO ] [MAIN      ] ZTR: Loaded 16659 existing records.
[2025-10-24T22:03:08.471018] [DEBUG] [LOCAL     ] ZTO: Loaded 49634 existing records from primary storage.
[2025-10-24T22:03:08.557512] [INFO ] [MAIN      ] ZTO: Loaded 49634 existing records.
[2025-10-24T22:03:08.607134] [WARN ] [MAIN      ] ZKH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:03:08.709316] [INFO ] [MAIN      ] ZKH: Wiping existing primary data before full refresh.
[2025-10-24T22:03:08.718115] [INFO ] [LOCAL     ] ZKH: Starting deletion of primary data.
[2025-10-24T22:03:08.703892] [WARN ] [MAIN      ] ZTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:03:08.750001] [DEBUG] [LOCAL     ] ZKH: Deleted primary data file.
[2025-10-24T22:03:08.772986] [INFO ] [MAIN      ] ZKH: Starting full primary refresh.
[2025-10-24T22:03:08.757249] [INFO ] [MAIN      ] ZTR: Wiping existing primary data before full refresh.
[2025-10-24T22:03:08.788168] [INFO ] [LOCAL     ] ZTR: Starting deletion of primary data.
[2025-10-24T22:03:08.790733] [DEBUG] [LOCAL     ] ZTS: Loaded 53500 existing records from primary storage.
[2025-10-24T22:03:08.811582] [DEBUG] [LOCAL     ] ZTR: Deleted primary data file.
[2025-10-24T22:03:08.847549] [INFO ] [MAIN      ] ZTR: Starting full primary refresh.
[2025-10-24T22:03:08.847432] [INFO ] [MAIN      ] ZTS: Loaded 53500 existing records.
[2025-10-24T22:03:09.115522] [WARN ] [MAIN      ] ZTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:03:09.126485] [INFO ] [MAIN      ] ZTO: Wiping existing primary data before full refresh.
[2025-10-24T22:03:09.142012] [INFO ] [LOCAL     ] ZTO: Starting deletion of primary data.
[2025-10-24T22:03:09.239548] [DEBUG] [LOCAL     ] ZTO: Deleted primary data file.
[2025-10-24T22:03:09.256732] [INFO ] [MAIN      ] ZTO: Starting full primary refresh.
[2025-10-24T22:03:09.779449] [WARN ] [MAIN      ] ZTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:03:09.829135] [INFO ] [MAIN      ] ZTS: Wiping existing primary data before full refresh.
[2025-10-24T22:03:09.911227] [INFO ] [LOCAL     ] ZTS: Starting deletion of primary data.
[2025-10-24T22:03:09.923169] [INFO ] [REMOTE    ] ZKH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:03:09.973956] [DEBUG] [LOCAL     ] ZTS: Deleted primary data file.
[2025-10-24T22:03:09.964168] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-01.
[2025-10-24T22:03:10.008919] [INFO ] [MAIN      ] ZTS: Starting full primary refresh.
[2025-10-24T22:03:10.162382] [INFO ] [REMOTE    ] ZTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:03:10.204113] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-01.
[2025-10-24T22:03:10.362781] [INFO ] [REMOTE    ] ZTO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:03:10.373114] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-01.
[2025-10-24T22:03:10.567878] [INFO ] [REMOTE    ] ZTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:03:10.568244] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-01.
[2025-10-24T22:03:10.675982] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-01 (0.71 seconds).
[2025-10-24T22:03:10.678283] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-02.
[2025-10-24T22:03:11.234285] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-02 (0.56 seconds).
[2025-10-24T22:03:11.237522] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-03.
[2025-10-24T22:03:11.372031] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-01 (1.17 seconds).
[2025-10-24T22:03:11.378423] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-02.
[2025-10-24T22:03:12.041959] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-03 (0.80 seconds).
[2025-10-24T22:03:12.154212] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-04.
[2025-10-24T22:03:12.175823] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-01 (1.80 seconds).
[2025-10-24T22:03:12.223440] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-02 (0.85 seconds).
[2025-10-24T22:03:12.462058] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-01 (1.89 seconds).
[2025-10-24T22:03:12.542282] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-04 (0.39 seconds).
[2025-10-24T22:03:12.947686] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-02.
[2025-10-24T22:03:13.747735] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-02.
[2025-10-24T22:03:14.547620] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-03.
[2025-10-24T22:03:14.694793] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-02 (1.75 seconds).
[2025-10-24T22:03:15.194018] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-02 (1.45 seconds).
[2025-10-24T22:03:15.347691] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-03.
[2025-10-24T22:03:15.571455] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-03 (1.02 seconds).
[2025-10-24T22:03:16.147686] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-03.
[2025-10-24T22:03:16.947702] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-04.
[2025-10-24T22:03:17.239610] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-03 (1.89 seconds).
[2025-10-24T22:03:17.747621] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-04.
[2025-10-24T22:03:17.959012] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-03 (1.81 seconds).
[2025-10-24T22:03:17.977113] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-04 (1.03 seconds).
[2025-10-24T22:03:18.550629] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-04.
[2025-10-24T22:03:19.288757] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-04 (1.54 seconds).
[2025-10-24T22:03:19.347696] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-05.
[2025-10-24T22:03:20.142228] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-05 (0.79 seconds).
[2025-10-24T22:03:20.147597] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-06.
[2025-10-24T22:03:20.404742] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-04 (1.85 seconds).
[2025-10-24T22:03:20.719488] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-06 (0.57 seconds).
[2025-10-24T22:03:20.947726] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-05.
[2025-10-24T22:03:21.747614] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-05.
[2025-10-24T22:03:22.329455] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-05 (0.58 seconds).
[2025-10-24T22:03:22.547682] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-05.
[2025-10-24T22:03:22.603665] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-05 (1.66 seconds).
[2025-10-24T22:03:23.347766] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-06.
[2025-10-24T22:03:23.929715] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-06 (0.58 seconds).
[2025-10-24T22:03:24.147624] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-07.
[2025-10-24T22:03:24.562802] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-05 (2.02 seconds).
[2025-10-24T22:03:24.947714] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-06.
[2025-10-24T22:03:25.170815] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-07 (1.02 seconds).
[2025-10-24T22:03:25.747712] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-07.
[2025-10-24T22:03:26.514844] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-06 (1.57 seconds).
[2025-10-24T22:03:26.547735] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-06.
[2025-10-24T22:03:26.883569] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-07 (1.14 seconds).
[2025-10-24T22:03:27.347784] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-08.
[2025-10-24T22:03:28.147727] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-08.
[2025-10-24T22:03:28.202883] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-06 (1.66 seconds).
[2025-10-24T22:03:28.349197] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-08 (1.00 seconds).
[2025-10-24T22:03:28.930973] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-08 (0.78 seconds).
[2025-10-24T22:03:28.947599] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-09.
[2025-10-24T22:03:29.662745] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-09 (0.72 seconds).
[2025-10-24T22:03:29.747731] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-09.
[2025-10-24T22:03:30.547733] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-07.
[2025-10-24T22:03:30.734055] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-09 (0.99 seconds).
[2025-10-24T22:03:31.347725] [INFO ] [REMOTE    ] ZKH: Fetching primary data for 2025-10.
[2025-10-24T22:03:31.845297] [INFO ] [REMOTE    ] ZKH: Incremental fetch complete for 2025-10 (0.50 seconds).
[2025-10-24T22:03:31.846951] [INFO ] [REMOTE    ] ZKH: Full fetch complete (11746 records).
[2025-10-24T22:03:31.847371] [DEBUG] [VALIDATOR ] ZKH: Validating primary data.
[2025-10-24T22:03:32.149361] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-07.
[2025-10-24T22:03:32.238922] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present.
[2025-10-24T22:03:32.239161] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed.
[2025-10-24T22:03:32.239610] [INFO ] [MAIN      ] ZKH: Fetched primary data is valid.
[2025-10-24T22:03:32.239724] [DEBUG] [LOCAL     ] ZKH: Saving primary data.
[2025-10-24T22:03:32.240195] [FATAL] [LOCAL     ] ZKH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:03:32.240283] [FATAL] [MAIN      ] ZKH: Failed to save primary data.
[2025-10-24T22:03:32.240327] [WARN ] [MAIN      ] ZKH: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:03:32.240362] [INFO ] [LOCAL     ] ZKH: Starting deletion of primary data.
[2025-10-24T22:03:32.240414] [DEBUG] [LOCAL     ] ZKH: No primary data file found to delete.
[2025-10-24T22:03:32.240454] [INFO ] [LOCAL     ] ZKH: Starting deletion of derivative data.
[2025-10-24T22:03:32.240678] [DEBUG] [LOCAL     ] ZKH: Deleted derivative data file.
[2025-10-24T22:03:32.240781] [INFO ] [MAIN      ] Update Progress: 2361/2366 symbols completed. ZKH took 24.8s. Estimated remaining: 38.6s. Rate: 7.8 symbols/min
[2025-10-24T22:03:32.461500] [INFO ] [MAIN      ] ZVIA: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:03:32.466966] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-07 (1.92 seconds).
[2025-10-24T22:03:32.515169] [DEBUG] [LOCAL     ] ZVIA: Loaded 36071 existing records from primary storage.
[2025-10-24T22:03:32.515514] [INFO ] [MAIN      ] ZVIA: Loaded 36071 existing records.
[2025-10-24T22:03:32.717282] [WARN ] [MAIN      ] ZVIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:03:32.717566] [INFO ] [MAIN      ] ZVIA: Wiping existing primary data before full refresh.
[2025-10-24T22:03:32.717624] [INFO ] [LOCAL     ] ZVIA: Starting deletion of primary data.
[2025-10-24T22:03:32.718754] [DEBUG] [LOCAL     ] ZVIA: Deleted primary data file.
[2025-10-24T22:03:32.718815] [INFO ] [MAIN      ] ZVIA: Starting full primary refresh.
[2025-10-24T22:03:32.956312] [INFO ] [REMOTE    ] ZTR: Fetching primary data for 2025-10.
[2025-10-24T22:03:33.106752] [INFO ] [REMOTE    ] ZVIA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:03:33.749249] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-07 (1.60 seconds).
[2025-10-24T22:03:33.747895] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-01.
[2025-10-24T22:03:34.069148] [INFO ] [REMOTE    ] ZTR: Incremental fetch complete for 2025-10 (1.11 seconds).
[2025-10-24T22:03:34.073939] [INFO ] [REMOTE    ] ZTR: Full fetch complete (26927 records).
[2025-10-24T22:03:34.074137] [DEBUG] [VALIDATOR ] ZTR: Validating primary data.
[2025-10-24T22:03:34.434844] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present.
[2025-10-24T22:03:34.434918] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed.
[2025-10-24T22:03:34.435451] [INFO ] [MAIN      ] ZTR: Fetched primary data is valid.
[2025-10-24T22:03:34.435490] [DEBUG] [LOCAL     ] ZTR: Saving primary data.
[2025-10-24T22:03:34.435792] [FATAL] [LOCAL     ] ZTR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:03:34.435876] [FATAL] [MAIN      ] ZTR: Failed to save primary data.
[2025-10-24T22:03:34.435917] [WARN ] [MAIN      ] ZTR: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:03:34.435951] [INFO ] [LOCAL     ] ZTR: Starting deletion of primary data.
[2025-10-24T22:03:34.435999] [DEBUG] [LOCAL     ] ZTR: No primary data file found to delete.
[2025-10-24T22:03:34.436033] [INFO ] [LOCAL     ] ZTR: Starting deletion of derivative data.
[2025-10-24T22:03:34.436191] [DEBUG] [LOCAL     ] ZTR: Deleted derivative data file.
[2025-10-24T22:03:34.436261] [INFO ] [MAIN      ] Update Progress: 2362/2366 symbols completed. ZTR took 27.0s. Estimated remaining: 30.8s. Rate: 7.8 symbols/min
[2025-10-24T22:03:34.552923] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-08.
[2025-10-24T22:03:34.605282] [INFO ] [MAIN      ] ZWS: Starting incremental primary update from 2025-10-16 to 2025-10-24.
[2025-10-24T22:03:34.643615] [DEBUG] [LOCAL     ] ZWS: Loaded 42439 existing records from primary storage.
[2025-10-24T22:03:34.643955] [INFO ] [MAIN      ] ZWS: Loaded 42439 existing records.
[2025-10-24T22:03:34.824122] [WARN ] [MAIN      ] ZWS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-08 for 200 day retention. Performing full refresh.
[2025-10-24T22:03:34.824445] [INFO ] [MAIN      ] ZWS: Wiping existing primary data before full refresh.
[2025-10-24T22:03:34.824495] [INFO ] [LOCAL     ] ZWS: Starting deletion of primary data.
[2025-10-24T22:03:34.825456] [DEBUG] [LOCAL     ] ZWS: Deleted primary data file.
[2025-10-24T22:03:34.825515] [INFO ] [MAIN      ] ZWS: Starting full primary refresh.
[2025-10-24T22:03:35.195436] [INFO ] [REMOTE    ] ZWS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull).
[2025-10-24T22:03:35.217008] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-01 (1.47 seconds).
[2025-10-24T22:03:35.347612] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-01.
[2025-10-24T22:03:36.147610] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-08.
[2025-10-24T22:03:36.238834] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-08 (1.69 seconds).
[2025-10-24T22:03:36.862094] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-01 (1.51 seconds).
[2025-10-24T22:03:36.947691] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-02.
[2025-10-24T22:03:37.513437] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-08 (1.37 seconds).
[2025-10-24T22:03:37.747738] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-02.
[2025-10-24T22:03:38.312247] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-02 (1.36 seconds).
[2025-10-24T22:03:38.547744] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-03.
[2025-10-24T22:03:39.186545] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-02 (1.44 seconds).
[2025-10-24T22:03:39.347699] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-03.
[2025-10-24T22:03:39.738407] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-03 (1.19 seconds).
[2025-10-24T22:03:40.147746] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-04.
[2025-10-24T22:03:40.792931] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-03 (1.45 seconds).
[2025-10-24T22:03:40.947718] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-04.
[2025-10-24T22:03:41.620736] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-04 (1.47 seconds).
[2025-10-24T22:03:41.747672] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-09.
[2025-10-24T22:03:42.249852] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-04 (1.30 seconds).
[2025-10-24T22:03:42.547692] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-05.
[2025-10-24T22:03:43.347678] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-09.
[2025-10-24T22:03:43.692376] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-09 (1.94 seconds).
[2025-10-24T22:03:44.108411] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-05 (1.56 seconds).
[2025-10-24T22:03:44.147603] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-06.
[2025-10-24T22:03:44.947763] [INFO ] [REMOTE    ] ZTS: Fetching primary data for 2025-10.
[2025-10-24T22:03:45.484521] [INFO ] [REMOTE    ] ZTS: Incremental fetch complete for 2025-10 (0.54 seconds).
[2025-10-24T22:03:45.494911] [INFO ] [REMOTE    ] ZTS: Full fetch complete (76856 records).
[2025-10-24T22:03:45.495048] [DEBUG] [VALIDATOR ] ZTS: Validating primary data.
[2025-10-24T22:03:45.754100] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-05.
[2025-10-24T22:03:45.827174] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-09 (2.48 seconds).
[2025-10-24T22:03:45.991441] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present.
[2025-10-24T22:03:45.991602] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed.
[2025-10-24T22:03:45.992943] [INFO ] [MAIN      ] ZTS: Fetched primary data is valid.
[2025-10-24T22:03:45.994434] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-06 (1.85 seconds).
[2025-10-24T22:03:45.993533] [DEBUG] [LOCAL     ] ZTS: Saving primary data.
[2025-10-24T22:03:46.002552] [FATAL] [LOCAL     ] ZTS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:03:46.002707] [FATAL] [MAIN      ] ZTS: Failed to save primary data.
[2025-10-24T22:03:46.002772] [WARN ] [MAIN      ] ZTS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:03:46.002839] [INFO ] [LOCAL     ] ZTS: Starting deletion of primary data.
[2025-10-24T22:03:46.002906] [DEBUG] [LOCAL     ] ZTS: No primary data file found to delete.
[2025-10-24T22:03:46.002942] [INFO ] [LOCAL     ] ZTS: Starting deletion of derivative data.
[2025-10-24T22:03:46.003135] [DEBUG] [LOCAL     ] ZTS: Deleted derivative data file.
[2025-10-24T22:03:46.003474] [INFO ] [MAIN      ] Update Progress: 2363/2366 symbols completed. ZTS took 38.6s. Estimated remaining: 23.1s. Rate: 7.8 symbols/min
[2025-10-24T22:03:46.547728] [INFO ] [REMOTE    ] ZTO: Fetching primary data for 2025-10.
[2025-10-24T22:03:47.252623] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-05 (1.50 seconds).
[2025-10-24T22:03:47.347686] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-06.
[2025-10-24T22:03:48.147784] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-07.
[2025-10-24T22:03:48.205156] [INFO ] [REMOTE    ] ZTO: Incremental fetch complete for 2025-10 (1.66 seconds).
[2025-10-24T22:03:48.213868] [INFO ] [REMOTE    ] ZTO: Full fetch complete (72602 records).
[2025-10-24T22:03:48.214003] [DEBUG] [VALIDATOR ] ZTO: Validating primary data.
[2025-10-24T22:03:48.641197] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present.
[2025-10-24T22:03:48.640991] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-06 (1.29 seconds).
[2025-10-24T22:03:48.641320] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed.
[2025-10-24T22:03:48.649973] [INFO ] [MAIN      ] ZTO: Fetched primary data is valid.
[2025-10-24T22:03:48.650074] [DEBUG] [LOCAL     ] ZTO: Saving primary data.
[2025-10-24T22:03:48.650744] [FATAL] [LOCAL     ] ZTO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:03:48.650831] [FATAL] [MAIN      ] ZTO: Failed to save primary data.
[2025-10-24T22:03:48.650874] [WARN ] [MAIN      ] ZTO: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:03:48.650908] [INFO ] [LOCAL     ] ZTO: Starting deletion of primary data.
[2025-10-24T22:03:48.650962] [DEBUG] [LOCAL     ] ZTO: No primary data file found to delete.
[2025-10-24T22:03:48.650999] [INFO ] [LOCAL     ] ZTO: Starting deletion of derivative data.
[2025-10-24T22:03:48.651164] [DEBUG] [LOCAL     ] ZTO: Deleted derivative data file.
[2025-10-24T22:03:48.651427] [INFO ] [MAIN      ] Update Progress: 2364/2366 symbols completed. ZTO took 41.2s. Estimated remaining: 15.4s. Rate: 7.8 symbols/min
[2025-10-24T22:03:48.947694] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-07.
[2025-10-24T22:03:49.691145] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-07 (1.54 seconds).
[2025-10-24T22:03:49.747717] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-08.
[2025-10-24T22:03:50.377563] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-07 (1.43 seconds).
[2025-10-24T22:03:50.547779] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-08.
[2025-10-24T22:03:51.260854] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-08 (1.51 seconds).
[2025-10-24T22:03:51.347612] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-09.
[2025-10-24T22:03:51.951407] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-08 (1.40 seconds).
[2025-10-24T22:03:52.147771] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-09.
[2025-10-24T22:03:52.813084] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-09 (1.47 seconds).
[2025-10-24T22:03:52.947731] [INFO ] [REMOTE    ] ZWS: Fetching primary data for 2025-10.
[2025-10-24T22:03:53.519436] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-09 (1.37 seconds).
[2025-10-24T22:03:53.747666] [INFO ] [REMOTE    ] ZVIA: Fetching primary data for 2025-10.
[2025-10-24T22:03:54.489833] [INFO ] [REMOTE    ] ZWS: Incremental fetch complete for 2025-10 (1.54 seconds).
[2025-10-24T22:03:54.497561] [INFO ] [REMOTE    ] ZWS: Full fetch complete (61961 records).
[2025-10-24T22:03:54.497767] [DEBUG] [VALIDATOR ] ZWS: Validating primary data.
[2025-10-24T22:03:54.903690] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present.
[2025-10-24T22:03:54.903800] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed.
[2025-10-24T22:03:54.905002] [INFO ] [MAIN      ] ZWS: Fetched primary data is valid.
[2025-10-24T22:03:54.905065] [DEBUG] [LOCAL     ] ZWS: Saving primary data.
[2025-10-24T22:03:54.905537] [FATAL] [LOCAL     ] ZWS: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:03:54.905624] [FATAL] [MAIN      ] ZWS: Failed to save primary data.
[2025-10-24T22:03:54.905703] [WARN ] [MAIN      ] ZWS: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:03:54.905770] [INFO ] [LOCAL     ] ZWS: Starting deletion of primary data.
[2025-10-24T22:03:54.905824] [DEBUG] [LOCAL     ] ZWS: No primary data file found to delete.
[2025-10-24T22:03:54.905858] [INFO ] [LOCAL     ] ZWS: Starting deletion of derivative data.
[2025-10-24T22:03:54.906017] [DEBUG] [LOCAL     ] ZWS: Deleted derivative data file.
[2025-10-24T22:03:54.906091] [INFO ] [MAIN      ] Update Progress: 2365/2366 symbols completed. ZWS took 20.5s. Estimated remaining: 7.7s. Rate: 7.8 symbols/min
[2025-10-24T22:03:55.169177] [INFO ] [REMOTE    ] ZVIA: Incremental fetch complete for 2025-10 (1.42 seconds).
[2025-10-24T22:03:55.176901] [INFO ] [REMOTE    ] ZVIA: Full fetch complete (52518 records).
[2025-10-24T22:03:55.177062] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data.
[2025-10-24T22:03:55.569497] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present.
[2025-10-24T22:03:55.569619] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed.
[2025-10-24T22:03:55.571668] [INFO ] [MAIN      ] ZVIA: Fetched primary data is valid.
[2025-10-24T22:03:55.571740] [DEBUG] [LOCAL     ] ZVIA: Saving primary data.
[2025-10-24T22:03:55.572537] [FATAL] [LOCAL     ] ZVIA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date
[2025-10-24T22:03:55.572630] [FATAL] [MAIN      ] ZVIA: Failed to save primary data.
[2025-10-24T22:03:55.572713] [WARN ] [MAIN      ] ZVIA: Deleting existing primary and derivative data due to save failure.
[2025-10-24T22:03:55.572757] [INFO ] [LOCAL     ] ZVIA: Starting deletion of primary data.
[2025-10-24T22:03:55.572859] [DEBUG] [LOCAL     ] ZVIA: No primary data file found to delete.
[2025-10-24T22:03:55.572900] [INFO ] [LOCAL     ] ZVIA: Starting deletion of derivative data.
[2025-10-24T22:03:55.573145] [DEBUG] [LOCAL     ] ZVIA: Deleted derivative data file.
[2025-10-24T22:03:55.574246] [INFO ] [MAIN      ] Update Progress: 2366/2366 symbols completed. ZVIA took 23.3s. Estimated remaining: 0.0s. Rate: 7.8 symbols/min
[2025-10-24T22:03:55.576101] [INFO ] [MAIN      ] Parallel update completed in 5h 3m 53s
[2025-10-24T22:03:55.576319] [WARN ] [MAIN      ] Failed symbols (2366): AAM, AAMI, AA, A, AAUC, AAT, AAP, AB, ABCB, ABBV...
[2025-10-24T22:03:55.576400] [INFO ] [MAIN      ] Update success rate: 0.0% (0/2366 symbols)
[2025-10-24T22:04:00.687261] [DEBUG] [EMAIL     ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (0/2366 @ 0.00%)'
[2025-10-24T22:04:00.687827] [INFO ] [MAIN      ] Primary update successful. Now generating derivatives...
[2025-10-24T22:04:00.687945] [INFO ] [MAIN      ] Refreshing symbols list before derivative generation...
[2025-10-24T22:04:00.688010] [INFO ] [MAIN      ] Starting TDM symbol refresh process.
[2025-10-24T22:04:00.688174] [INFO ] [MAIN      ] Fetching latest NYSE symbols list.
[2025-10-24T22:04:00.688242] [DEBUG] [SYMBOL    ] Starting fetch of NYSE Symbols.
[2025-10-24T22:04:01.572075] [DEBUG] [SYMBOL    ] Found 2418 valid NYSE symbols.
[2025-10-24T22:04:01.572204] [INFO ] [SYMBOL    ] Completed fetch of NYSE Symbols.
[2025-10-24T22:04:01.572400] [INFO ] [MAIN      ] Filtered out 54 blacklisted symbols.
[2025-10-24T22:04:01.572958] [INFO ] [LOCAL     ] Symbols cache updated with 2366 symbols.
[2025-10-24T22:04:01.573014] [INFO ] [MAIN      ] Successfully refreshed symbols list.
[2025-10-24T22:04:01.573045] [INFO ] [MAIN      ] Finished TDM symbol refresh process.
[2025-10-24T22:04:01.573101] [INFO ] [MAIN      ] Pruning stale symbols...
[2025-10-24T22:04:01.573133] [INFO ] [MAIN      ] Starting TDM stale symbol pruning process.
[2025-10-24T22:04:01.573160] [INFO ] [LOCAL     ] Reading cached symbols list.
[2025-10-24T22:04:01.573582] [DEBUG] [LOCAL     ] Found 2366 symbols in cached list.
[2025-10-24T22:04:01.573633] [INFO ] [LOCAL     ] Completed reading cached symbols list.
[2025-10-24T22:04:01.573854] [INFO ] [MAIN      ] Including 54 blacklisted symbols for pruning.
[2025-10-24T22:04:01.573894] [INFO ] [MAIN      ] Pruning data for symbols not in current list of 2366 valid symbols.
[2025-10-24T22:04:01.573933] [INFO ] [LOCAL     ] Starting pruning of local symbol history data for inactive/invalid symbols.
[2025-10-24T22:04:01.573965] [DEBUG] [LOCAL     ] Checking directory: '/opt/tdm/output/data/primary_storage'
[2025-10-24T22:04:01.574036] [DEBUG] [LOCAL     ] Checking directory: '/opt/tdm/output/data/derivative_storage'
[2025-10-24T22:04:01.574095] [INFO ] [LOCAL     ] Deleted 0 obsolete data files.
[2025-10-24T22:04:01.574125] [INFO ] [LOCAL     ] Completed pruning of unlisted local symbol history data.
[2025-10-24T22:04:01.574156] [INFO ] [MAIN      ] Successfully pruned stale symbol data.
[2025-10-24T22:04:01.574183] [INFO ] [MAIN      ] Finished TDM stale symbol pruning process.
[2025-10-24T22:04:01.574234] [INFO ] [MAIN      ] Running derivative generation in parallel mode
[2025-10-24T22:04:01.574264] [INFO ] [MAIN      ] Wiping all existing derivative data before regeneration.
[2025-10-24T22:04:01.574296] [INFO ] [LOCAL     ] Starting deletion of all local derivative data.
[2025-10-24T22:04:01.574395] [INFO ] [LOCAL     ] Deleted 0 derivative data files.
[2025-10-24T22:04:01.574434] [INFO ] [LOCAL     ] Scanning primary storage for available symbols.
[2025-10-24T22:04:01.574488] [INFO ] [LOCAL     ] Found 0 symbols with primary data.
[2025-10-24T22:04:01.574518] [WARN ] [MAIN      ] No symbols with primary data found to generate derivatives.
[2025-10-24T22:04:01.574551] [FATAL] [MAIN      ] Derivative generation encountered errors.
[2025-10-24T22:04:02.039332] [DEBUG] [EMAIL     ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_ERROR: TDM All Symbols Derivative Generation Failed'
[2025-10-24T22:04:02.039520] [FATAL] [MAIN      ] Primary update succeeded but derivative generation failed.
[2025-10-24T22:04:02.440998] [DEBUG] [EMAIL     ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_ERROR: TDM Primary Update Succeeded but Derivative Generation Failed'
[2025-10-24T22:04:02.441380] [WARN ] [STATE     ] State set to: COMPLETED_ERROR
[2025-10-24T22:04:02.441592] [INFO ] [STATE     ] Last completion updated: 2025-10-24T22:04:02.441455